2024-02-21T22:41:19.859 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-02-21T22:41:19.859 DEBUG:teuthology.run:Teuthology command: teuthology --name leonidus-2024-02-21_22:31:03-fs-wip-lusov-qdb-distro-default-smithi --archive /home/teuthworker/archive/leonidus-2024-02-21_22:31:03-fs-wip-lusov-qdb-distro-default-smithi/7569996 --verbose --owner scheduled_leonidus@teuthology --description fs/workload/{0-centos_9.stream begin/{0-install 1-ceph 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-workunit/suites/fsx}} -- /home/teuthworker/archive/leonidus-2024-02-21_22:31:03-fs-wip-lusov-qdb-distro-default-smithi/7569996/orig.config.yaml 2024-02-21T22:41:19.912 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T22:41:20.001 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/leonidus-2024-02-21_22:31:03-fs-wip-lusov-qdb-distro-default-smithi/7569996 branch: wip-lusov-qdb description: fs/workload/{0-centos_9.stream begin/{0-install 1-ceph 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-workunit/suites/fsx}} email: null first_in_suite: false job_id: '7569996' kernel: client: branch: testing kdb: true sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: leonidus-2024-02-21_22:31:03-fs-wip-lusov-qdb-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-lusov-qdb ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 3 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_export_ephemeral_random_max: 0.1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug cephsqlite: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - slow metadata IO - SLOW_OPS - slow request sha1: 3bfc837d7b45ce8e095d92fa9c342964cea5e95f subvols: create: 2 subvol_options: --size 25000000000 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount - mds.dir_split install: ceph: flavor: default sha1: 3bfc837d7b45ce8e095d92fa9c342964cea5e95f kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=legacy - nowsync syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-lusov-qdb sha1: 3bfc837d7b45ce8e095d92fa9c342964cea5e95f owner: scheduled_leonidus@teuthology priority: 80 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 6562 sha1: 3bfc837d7b45ce8e095d92fa9c342964cea5e95f sleep_before_teardown: 0 subset: 111/10000 suite: fs suite_branch: wip-lusov-qdb suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_3bfc837d7b45ce8e095d92fa9c342964cea5e95f/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 3bfc837d7b45ce8e095d92fa9c342964cea5e95f syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi099.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBbsxG0N50+UN7ym+G75bwvacDLBprjEIIj9m2NrEU4iIn2/F7gQVGeV0IiiqHiJuSbRXUhzkwQKdfhJ6It4JUM= smithi162.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDprMEvFEYup72AphAePaVP9XF2ePgeJBRAf3tOCAQgpTqhVYgWnsMjGrpOMqA5baaIZh1IS815ukmQBDqOqO5c= smithi181.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJGxpBmgiHFvfK24zkudM4plSU+FSLbF4SgKgRfpJDyL3jcS0bK3bS1V+K13Li1uzfMvSnWf10Veqka+JRjkhP4= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate false - ceph fs subvolumegroup pin cephfs qa random 0.10 - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - exec: mon.a: - ceph mgr module enable snap_schedule - ceph config set mgr mgr/snap_schedule/allow_m_granularity true - ceph config set mgr mgr/snap_schedule/dump_on_update true - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - workunit: clients: all: - suites/fsx.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: b1dac5519c57c269ea98a22fb7729016a1d0e4d2 timestamp: 2024-02-21_22:31:03 tube: smithi user: leonidus verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-02-21T22:41:20.001 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_3bfc837d7b45ce8e095d92fa9c342964cea5e95f/qa; will attempt to use it 2024-02-21T22:41:20.002 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_3bfc837d7b45ce8e095d92fa9c342964cea5e95f/qa/tasks 2024-02-21T22:41:20.002 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-02-21T22:41:20.003 INFO:teuthology.task.internal:Checking packages... 2024-02-21T22:41:20.026 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '3bfc837d7b45ce8e095d92fa9c342964cea5e95f' 2024-02-21T22:41:20.026 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-21T22:41:20.027 INFO:teuthology.packaging:ref: None 2024-02-21T22:41:20.027 INFO:teuthology.packaging:tag: None 2024-02-21T22:41:20.027 INFO:teuthology.packaging:branch: wip-lusov-qdb 2024-02-21T22:41:20.027 INFO:teuthology.packaging:sha1: 3bfc837d7b45ce8e095d92fa9c342964cea5e95f 2024-02-21T22:41:20.027 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-lusov-qdb 2024-02-21T22:41:20.420 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-1643.g3bfc837d 2024-02-21T22:41:20.422 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-02-21T22:41:20.429 INFO:teuthology.task.internal:no buildpackages task found 2024-02-21T22:41:20.429 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-02-21T22:41:20.521 INFO:teuthology.task.internal:Saving configuration 2024-02-21T22:41:20.539 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-02-21T22:41:20.553 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-21T22:41:20.580 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi099.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-02-21_22:31:03-fs-wip-lusov-qdb-distro-default-smithi/7569996', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-21 22:32:36.522543', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBbsxG0N50+UN7ym+G75bwvacDLBprjEIIj9m2NrEU4iIn2/F7gQVGeV0IiiqHiJuSbRXUhzkwQKdfhJ6It4JUM='} 2024-02-21T22:41:20.605 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi162.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-02-21_22:31:03-fs-wip-lusov-qdb-distro-default-smithi/7569996', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-21 22:32:36.521466', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDprMEvFEYup72AphAePaVP9XF2ePgeJBRAf3tOCAQgpTqhVYgWnsMjGrpOMqA5baaIZh1IS815ukmQBDqOqO5c='} 2024-02-21T22:41:20.628 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi181.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-02-21_22:31:03-fs-wip-lusov-qdb-distro-default-smithi/7569996', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-21 22:32:36.520346', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJGxpBmgiHFvfK24zkudM4plSU+FSLbF4SgKgRfpJDyL3jcS0bK3bS1V+K13Li1uzfMvSnWf10Veqka+JRjkhP4='} 2024-02-21T22:41:20.628 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-02-21T22:41:20.635 INFO:teuthology.task.internal:roles: ubuntu@smithi099.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-02-21T22:41:20.635 INFO:teuthology.task.internal:roles: ubuntu@smithi162.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-02-21T22:41:20.635 INFO:teuthology.task.internal:roles: ubuntu@smithi181.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-02-21T22:41:20.635 INFO:teuthology.run_tasks:Running task console_log... 2024-02-21T22:41:20.755 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fcf7798d0d0>, signals=[15]) 2024-02-21T22:41:20.755 INFO:teuthology.run_tasks:Running task internal.connect... 2024-02-21T22:41:20.762 INFO:teuthology.task.internal:Opening connections... 2024-02-21T22:41:20.762 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi099.front.sepia.ceph.com 2024-02-21T22:41:20.764 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T22:41:20.857 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi162.front.sepia.ceph.com 2024-02-21T22:41:20.858 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T22:41:20.949 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi181.front.sepia.ceph.com 2024-02-21T22:41:20.950 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T22:41:21.041 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-02-21T22:41:21.047 DEBUG:teuthology.orchestra.run.smithi099:> uname -m 2024-02-21T22:41:21.065 INFO:teuthology.orchestra.run.smithi099.stdout:x86_64 2024-02-21T22:41:21.065 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release 2024-02-21T22:41:21.126 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="CentOS Stream" 2024-02-21T22:41:21.126 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="9" 2024-02-21T22:41:21.126 INFO:teuthology.orchestra.run.smithi099.stdout:ID="centos" 2024-02-21T22:41:21.126 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE="rhel fedora" 2024-02-21T22:41:21.126 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="9" 2024-02-21T22:41:21.126 INFO:teuthology.orchestra.run.smithi099.stdout:PLATFORM_ID="platform:el9" 2024-02-21T22:41:21.127 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-21T22:41:21.127 INFO:teuthology.orchestra.run.smithi099.stdout:ANSI_COLOR="0;31" 2024-02-21T22:41:21.127 INFO:teuthology.orchestra.run.smithi099.stdout:LOGO="fedora-logo-icon" 2024-02-21T22:41:21.127 INFO:teuthology.orchestra.run.smithi099.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-21T22:41:21.127 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://centos.org/" 2024-02-21T22:41:21.127 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-21T22:41:21.127 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-21T22:41:21.127 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-21T22:41:21.128 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server 2024-02-21T22:41:21.155 DEBUG:teuthology.orchestra.run.smithi162:> uname -m 2024-02-21T22:41:21.173 INFO:teuthology.orchestra.run.smithi162.stdout:x86_64 2024-02-21T22:41:21.173 DEBUG:teuthology.orchestra.run.smithi162:> cat /etc/os-release 2024-02-21T22:41:21.229 INFO:teuthology.orchestra.run.smithi162.stdout:NAME="CentOS Stream" 2024-02-21T22:41:21.229 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION="9" 2024-02-21T22:41:21.230 INFO:teuthology.orchestra.run.smithi162.stdout:ID="centos" 2024-02-21T22:41:21.230 INFO:teuthology.orchestra.run.smithi162.stdout:ID_LIKE="rhel fedora" 2024-02-21T22:41:21.230 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION_ID="9" 2024-02-21T22:41:21.230 INFO:teuthology.orchestra.run.smithi162.stdout:PLATFORM_ID="platform:el9" 2024-02-21T22:41:21.230 INFO:teuthology.orchestra.run.smithi162.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-21T22:41:21.230 INFO:teuthology.orchestra.run.smithi162.stdout:ANSI_COLOR="0;31" 2024-02-21T22:41:21.230 INFO:teuthology.orchestra.run.smithi162.stdout:LOGO="fedora-logo-icon" 2024-02-21T22:41:21.230 INFO:teuthology.orchestra.run.smithi162.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-21T22:41:21.230 INFO:teuthology.orchestra.run.smithi162.stdout:HOME_URL="https://centos.org/" 2024-02-21T22:41:21.230 INFO:teuthology.orchestra.run.smithi162.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-21T22:41:21.230 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-21T22:41:21.230 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-21T22:41:21.230 INFO:teuthology.lock.ops:Updating smithi162.front.sepia.ceph.com on lock server 2024-02-21T22:41:21.255 DEBUG:teuthology.orchestra.run.smithi181:> uname -m 2024-02-21T22:41:21.272 INFO:teuthology.orchestra.run.smithi181.stdout:x86_64 2024-02-21T22:41:21.273 DEBUG:teuthology.orchestra.run.smithi181:> cat /etc/os-release 2024-02-21T22:41:21.329 INFO:teuthology.orchestra.run.smithi181.stdout:NAME="CentOS Stream" 2024-02-21T22:41:21.329 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION="9" 2024-02-21T22:41:21.330 INFO:teuthology.orchestra.run.smithi181.stdout:ID="centos" 2024-02-21T22:41:21.330 INFO:teuthology.orchestra.run.smithi181.stdout:ID_LIKE="rhel fedora" 2024-02-21T22:41:21.330 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_ID="9" 2024-02-21T22:41:21.330 INFO:teuthology.orchestra.run.smithi181.stdout:PLATFORM_ID="platform:el9" 2024-02-21T22:41:21.330 INFO:teuthology.orchestra.run.smithi181.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-21T22:41:21.330 INFO:teuthology.orchestra.run.smithi181.stdout:ANSI_COLOR="0;31" 2024-02-21T22:41:21.330 INFO:teuthology.orchestra.run.smithi181.stdout:LOGO="fedora-logo-icon" 2024-02-21T22:41:21.330 INFO:teuthology.orchestra.run.smithi181.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-21T22:41:21.330 INFO:teuthology.orchestra.run.smithi181.stdout:HOME_URL="https://centos.org/" 2024-02-21T22:41:21.330 INFO:teuthology.orchestra.run.smithi181.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-21T22:41:21.330 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-21T22:41:21.330 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-21T22:41:21.331 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server 2024-02-21T22:41:21.355 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-02-21T22:41:21.366 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-02-21T22:41:21.387 INFO:teuthology.task.internal:Checking for old test directory... 2024-02-21T22:41:21.387 DEBUG:teuthology.orchestra.run.smithi099:> test '!' -e /home/ubuntu/cephtest 2024-02-21T22:41:21.390 DEBUG:teuthology.orchestra.run.smithi162:> test '!' -e /home/ubuntu/cephtest 2024-02-21T22:41:21.392 DEBUG:teuthology.orchestra.run.smithi181:> test '!' -e /home/ubuntu/cephtest 2024-02-21T22:41:21.408 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-02-21T22:41:21.414 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-02-21T22:41:21.414 DEBUG:teuthology.orchestra.run.smithi099:> test -z $(ls -A /var/lib/ceph) 2024-02-21T22:41:21.450 DEBUG:teuthology.orchestra.run.smithi162:> test -z $(ls -A /var/lib/ceph) 2024-02-21T22:41:21.452 DEBUG:teuthology.orchestra.run.smithi181:> test -z $(ls -A /var/lib/ceph) 2024-02-21T22:41:21.484 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-02-21T22:41:21.560 INFO:teuthology.run_tasks:Running task kernel... 2024-02-21T22:41:21.575 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2024-02-21T22:41:21.575 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2024-02-21T22:41:21.576 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2024-02-21T22:41:21.576 DEBUG:teuthology.orchestra.run.smithi099:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-21T22:41:21.592 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-21T22:41:21.593 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-02-21T22:41:21.769 DEBUG:teuthology.task.kernel:sha1 for client.0 is 1130e053228021b1be9cac260b5ed52c5a9027c5 2024-02-21T22:41:21.769 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "1130e053228021b1be9cac260b5ed52c5a9027c5"... 2024-02-21T22:41:21.769 DEBUG:teuthology.orchestra.run.smithi099:> uname -r 2024-02-21T22:41:21.786 INFO:teuthology.orchestra.run.smithi099.stdout:5.14.0-361.el9.x86_64 2024-02-21T22:41:21.786 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 1130e053228021b1be9cac260b5ed52c5a9027c5 2024-02-21T22:41:21.787 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-02-21T22:41:21.787 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum upgrade -y linux-firmware 2024-02-21T22:41:24.297 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS-9 - AppStream 9.9 MB/s | 8.1 MB 00:00 2024-02-21T22:41:26.155 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS-9 - BaseOS 4.6 MB/s | 2.5 MB 00:00 2024-02-21T22:41:27.481 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - BaseOS 9.1 MB/s | 8.0 MB 00:00 2024-02-21T22:41:59.574 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - AppStream 631 kB/s | 19 MB 00:30 2024-02-21T22:42:03.666 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - CRB 15 MB/s | 6.1 MB 00:00 2024-02-21T22:42:05.092 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - Extras packages 58 kB/s | 15 kB 00:00 2024-02-21T22:42:08.452 INFO:teuthology.orchestra.run.smithi099.stdout:Extra Packages for Enterprise Linux 6.4 MB/s | 20 MB 00:03 2024-02-21T22:42:13.433 INFO:teuthology.orchestra.run.smithi099.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2024-02-21T22:42:15.663 INFO:teuthology.orchestra.run.smithi099.stderr:Modular dependency problems: 2024-02-21T22:42:15.664 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-02-21T22:42:15.664 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 1: conflicting requests 2024-02-21T22:42:15.664 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240219154654:20125149.x86_64 from CentOS-AppStream 2024-02-21T22:42:15.664 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 2: conflicting requests 2024-02-21T22:42:15.664 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-21T22:42:15.664 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 3: conflicting requests 2024-02-21T22:42:15.664 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-21T22:42:15.664 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 4: conflicting requests 2024-02-21T22:42:15.664 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-21T22:42:15.664 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 5: conflicting requests 2024-02-21T22:42:15.664 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-21T22:42:15.664 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 6: conflicting requests 2024-02-21T22:42:15.665 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-21T22:42:15.665 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 7: conflicting requests 2024-02-21T22:42:15.665 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-21T22:42:15.665 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 8: conflicting requests 2024-02-21T22:42:15.665 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-21T22:42:15.665 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 9: conflicting requests 2024-02-21T22:42:15.665 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-21T22:42:15.665 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 10: conflicting requests 2024-02-21T22:42:15.665 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-21T22:42:15.665 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 11: conflicting requests 2024-02-21T22:42:15.665 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-21T22:42:15.665 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 12: conflicting requests 2024-02-21T22:42:15.666 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-21T22:42:15.666 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 13: conflicting requests 2024-02-21T22:42:15.666 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-21T22:42:15.666 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 14: conflicting requests 2024-02-21T22:42:15.666 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-21T22:42:15.666 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 15: conflicting requests 2024-02-21T22:42:15.666 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-21T22:42:15.666 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 16: conflicting requests 2024-02-21T22:42:15.666 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-21T22:42:15.666 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 17: conflicting requests 2024-02-21T22:42:15.666 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-21T22:42:15.666 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 18: conflicting requests 2024-02-21T22:42:15.666 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-21T22:42:15.667 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 19: conflicting requests 2024-02-21T22:42:15.667 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-21T22:42:15.667 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 20: conflicting requests 2024-02-21T22:42:15.667 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-21T22:42:15.667 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 21: conflicting requests 2024-02-21T22:42:15.667 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-21T22:42:15.667 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 22: conflicting requests 2024-02-21T22:42:15.667 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-21T22:42:15.667 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 23: conflicting requests 2024-02-21T22:42:15.667 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-21T22:42:15.667 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 24: conflicting requests 2024-02-21T22:42:15.667 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-21T22:42:15.667 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 25: conflicting requests 2024-02-21T22:42:15.667 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-21T22:42:15.668 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 26: conflicting requests 2024-02-21T22:42:15.668 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-21T22:42:15.668 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 27: conflicting requests 2024-02-21T22:42:15.668 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-21T22:42:15.668 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 28: conflicting requests 2024-02-21T22:42:15.668 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-21T22:42:15.668 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 29: conflicting requests 2024-02-21T22:42:15.668 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-21T22:42:15.668 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 30: conflicting requests 2024-02-21T22:42:15.668 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-21T22:42:15.668 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 31: conflicting requests 2024-02-21T22:42:15.668 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-21T22:42:15.668 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 32: conflicting requests 2024-02-21T22:42:15.668 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-21T22:42:15.669 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 33: conflicting requests 2024-02-21T22:42:15.669 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-21T22:42:15.669 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 34: conflicting requests 2024-02-21T22:42:15.669 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-21T22:42:15.669 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 35: conflicting requests 2024-02-21T22:42:15.669 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-21T22:42:15.669 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 36: conflicting requests 2024-02-21T22:42:15.669 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-21T22:42:15.669 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-21T22:42:15.669 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-21T22:42:15.669 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 37: cannot install the best candidate for the job 2024-02-21T22:42:15.669 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-21T22:42:15.669 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-21T22:42:15.669 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-21T22:42:15.669 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-21T22:42:15.670 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 38: conflicting requests 2024-02-21T22:42:15.670 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-21T22:42:15.670 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-21T22:42:15.670 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-21T22:42:15.670 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-21T22:42:15.670 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-21T22:42:15.670 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-21T22:42:15.670 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 39: cannot install the best candidate for the job 2024-02-21T22:42:15.670 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-21T22:42:15.670 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-21T22:42:15.670 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-21T22:42:15.670 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-21T22:42:15.670 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 40: cannot install the best candidate for the job 2024-02-21T22:42:15.670 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-21T22:42:15.670 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-21T22:42:15.671 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-21T22:42:15.671 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-21T22:42:15.671 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 41: cannot install the best candidate for the job 2024-02-21T22:42:15.671 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-21T22:42:15.671 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-21T22:42:15.671 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-21T22:42:15.671 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-21T22:42:15.671 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 42: cannot install the best candidate for the job 2024-02-21T22:42:15.671 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-21T22:42:15.671 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-21T22:42:15.671 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-21T22:42:15.671 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-21T22:42:15.671 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 43: cannot install the best candidate for the job 2024-02-21T22:42:15.671 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-21T22:42:15.672 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-21T22:42:15.672 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-21T22:42:15.672 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-21T22:42:15.674 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 44: cannot install the best candidate for the job 2024-02-21T22:42:15.675 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-21T22:42:15.675 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-21T22:42:15.675 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-21T22:42:15.675 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-21T22:42:16.124 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-02-21T22:42:16.132 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-02-21T22:42:16.132 INFO:teuthology.orchestra.run.smithi099.stdout: Package Arch Version Repository Size 2024-02-21T22:42:16.132 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-02-21T22:42:16.132 INFO:teuthology.orchestra.run.smithi099.stdout:Upgrading: 2024-02-21T22:42:16.132 INFO:teuthology.orchestra.run.smithi099.stdout: linux-firmware noarch 20240111-121.gitb3132c18.el8 CentOS-BaseOS 354 M 2024-02-21T22:42:16.132 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T22:42:16.132 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2024-02-21T22:42:16.132 INFO:teuthology.orchestra.run.smithi099.stdout:================================================================================ 2024-02-21T22:42:16.132 INFO:teuthology.orchestra.run.smithi099.stdout:Upgrade 1 Package 2024-02-21T22:42:16.132 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T22:42:16.133 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 354 M 2024-02-21T22:42:16.133 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2024-02-21T22:42:26.275 INFO:teuthology.orchestra.run.smithi099.stdout:linux-firmware-20240111-121.gitb3132c18.el8.noa 35 MB/s | 354 MB 00:10 2024-02-21T22:42:26.276 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2024-02-21T22:42:26.276 INFO:teuthology.orchestra.run.smithi099.stdout:Total 35 MB/s | 354 MB 00:10 2024-02-21T22:42:26.277 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2024-02-21T22:42:26.368 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2024-02-21T22:42:26.368 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2024-02-21T22:42:27.986 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2024-02-21T22:42:27.987 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2024-02-21T22:42:49.300 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2024-02-21T22:42:49.544 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : linux-firmware-20240111-121.gitb3132c18.el8.noarch 1/2 2024-02-21T22:42:49.651 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2024-02-21T22:42:57.325 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2024-02-21T22:42:57.325 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : linux-firmware-20240111-121.gitb3132c18.el8.noarch 1/2 2024-02-21T22:42:57.739 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2024-02-21T22:42:57.739 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T22:42:57.739 INFO:teuthology.orchestra.run.smithi099.stdout:Upgraded: 2024-02-21T22:42:57.740 INFO:teuthology.orchestra.run.smithi099.stdout: linux-firmware-20240111-121.gitb3132c18.el8.noarch 2024-02-21T22:42:57.740 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T22:42:57.740 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-02-21T22:42:58.049 INFO:teuthology.task.kernel:Downloading kernel 1130e053228021b1be9cac260b5ed52c5a9027c5 on client.0... 2024-02-21T22:42:58.050 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1130e053228021b1be9cac260b5ed52c5a9027c5 2024-02-21T22:42:58.305 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/1130e053228021b1be9cac260b5ed52c5a9027c5/centos/9/flavors/default/x86_64/ 2024-02-21T22:42:58.306 DEBUG:teuthology.orchestra.run.smithi099:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.8.0_rc4_g1130e0532280-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/1130e053228021b1be9cac260b5ed52c5a9027c5/centos/9/flavors/default/x86_64/ --input-file=- 2024-02-21T22:42:58.308 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi099.front.sepia.ceph.com to complete... 2024-02-21T22:48:22.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21 22:48:22 URL:https://3.chacra.ceph.com/r/kernel/testing/1130e053228021b1be9cac260b5ed52c5a9027c5/centos/9/flavors/default/x86_64/kernel-6.8.0_rc4_g1130e0532280-1.x86_64.rpm [332924888/332924888] -> "/tmp/kernel.x86_64.rpm" [1] 2024-02-21T22:48:22.212 INFO:teuthology.orchestra.run.smithi099.stderr:FINISHED --2024-02-21 22:48:22-- 2024-02-21T22:48:22.212 INFO:teuthology.orchestra.run.smithi099.stderr:Total wall clock time: 5m 24s 2024-02-21T22:48:22.213 INFO:teuthology.orchestra.run.smithi099.stderr:Downloaded: 1 files, 318M in 5m 23s (1006 KB/s) 2024-02-21T22:48:22.216 INFO:teuthology.task.kernel:Installing kernel 1130e053228021b1be9cac260b5ed52c5a9027c5 on client.0... 2024-02-21T22:48:22.217 DEBUG:teuthology.orchestra.run.smithi099:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-02-21T22:48:24.131 INFO:teuthology.orchestra.run.smithi099.stdout:Verifying... ######################################## 2024-02-21T22:48:24.293 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing... ######################################## 2024-02-21T22:48:24.372 INFO:teuthology.orchestra.run.smithi099.stdout:Updating / installing... 2024-02-21T22:48:31.807 INFO:teuthology.orchestra.run.smithi099.stdout:kernel-6.8.0_rc4_g1130e0532280-1 ######################################## 2024-02-21T22:48:46.014 INFO:teuthology.orchestra.run.smithi099.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-02-21T22:49:08.143 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi099.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-02-21T22:49:08.144 DEBUG:teuthology.orchestra.run.smithi099:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-02-21T22:49:08.228 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280 2024-02-21T22:49:08.228 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/System.map 2024-02-21T22:49:08.228 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/config 2024-02-21T22:49:08.228 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel 2024-02-21T22:49:08.228 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch 2024-02-21T22:49:08.228 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86 2024-02-21T22:49:08.229 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/crypto 2024-02-21T22:49:08.229 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-02-21T22:49:08.229 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-02-21T22:49:08.229 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-02-21T22:49:08.229 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-02-21T22:49:08.229 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-02-21T22:49:08.229 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-02-21T22:49:08.229 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-02-21T22:49:08.229 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/crypto/crc32c-intel.ko 2024-02-21T22:49:08.229 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-02-21T22:49:08.229 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-02-21T22:49:08.230 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-02-21T22:49:08.230 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-02-21T22:49:08.230 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/crypto/serpent-avx2.ko 2024-02-21T22:49:08.230 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-02-21T22:49:08.230 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-02-21T22:49:08.230 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-02-21T22:49:08.230 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-02-21T22:49:08.230 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-02-21T22:49:08.230 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-02-21T22:49:08.230 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-02-21T22:49:08.230 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/kernel 2024-02-21T22:49:08.230 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/kernel/cpu 2024-02-21T22:49:08.230 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/kernel/cpu/mce 2024-02-21T22:49:08.231 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-02-21T22:49:08.231 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/kvm 2024-02-21T22:49:08.231 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/kvm/kvm-amd.ko 2024-02-21T22:49:08.231 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/kvm/kvm-intel.ko 2024-02-21T22:49:08.231 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/arch/x86/kvm/kvm.ko 2024-02-21T22:49:08.231 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto 2024-02-21T22:49:08.231 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/ansi_cprng.ko 2024-02-21T22:49:08.231 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/anubis.ko 2024-02-21T22:49:08.231 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/arc4.ko 2024-02-21T22:49:08.231 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/async_tx 2024-02-21T22:49:08.231 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/async_tx/async_memcpy.ko 2024-02-21T22:49:08.231 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/async_tx/async_pq.ko 2024-02-21T22:49:08.231 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/async_tx/async_raid6_recov.ko 2024-02-21T22:49:08.231 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/async_tx/async_tx.ko 2024-02-21T22:49:08.232 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/async_tx/async_xor.ko 2024-02-21T22:49:08.232 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/async_tx/raid6test.ko 2024-02-21T22:49:08.232 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/authenc.ko 2024-02-21T22:49:08.232 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/authencesn.ko 2024-02-21T22:49:08.232 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/blake2b_generic.ko 2024-02-21T22:49:08.232 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/blowfish_common.ko 2024-02-21T22:49:08.232 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/blowfish_generic.ko 2024-02-21T22:49:08.232 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/camellia_generic.ko 2024-02-21T22:49:08.232 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/cast5_generic.ko 2024-02-21T22:49:08.232 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/cast6_generic.ko 2024-02-21T22:49:08.232 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/cast_common.ko 2024-02-21T22:49:08.232 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/ccm.ko 2024-02-21T22:49:08.232 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/cmac.ko 2024-02-21T22:49:08.233 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/crc32_generic.ko 2024-02-21T22:49:08.233 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/crypto_engine.ko 2024-02-21T22:49:08.233 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/crypto_user.ko 2024-02-21T22:49:08.233 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/cts.ko 2024-02-21T22:49:08.233 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/des_generic.ko 2024-02-21T22:49:08.233 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/dh_generic.ko 2024-02-21T22:49:08.233 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/echainiv.ko 2024-02-21T22:49:08.233 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/essiv.ko 2024-02-21T22:49:08.233 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/fcrypt.ko 2024-02-21T22:49:08.233 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/khazad.ko 2024-02-21T22:49:08.233 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/lz4.ko 2024-02-21T22:49:08.233 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/lz4hc.ko 2024-02-21T22:49:08.233 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/md4.ko 2024-02-21T22:49:08.234 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/michael_mic.ko 2024-02-21T22:49:08.234 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/pcbc.ko 2024-02-21T22:49:08.234 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/pcrypt.ko 2024-02-21T22:49:08.234 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/rmd160.ko 2024-02-21T22:49:08.234 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/seed.ko 2024-02-21T22:49:08.234 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/serpent_generic.ko 2024-02-21T22:49:08.234 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/tcrypt.ko 2024-02-21T22:49:08.234 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/tea.ko 2024-02-21T22:49:08.234 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/twofish_common.ko 2024-02-21T22:49:08.234 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/twofish_generic.ko 2024-02-21T22:49:08.234 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/vmac.ko 2024-02-21T22:49:08.234 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/wp512.ko 2024-02-21T22:49:08.235 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/xcbc.ko 2024-02-21T22:49:08.235 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/xor.ko 2024-02-21T22:49:08.235 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/crypto/xxhash_generic.ko 2024-02-21T22:49:08.235 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers 2024-02-21T22:49:08.235 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/acpi 2024-02-21T22:49:08.235 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/acpi/acpi_ipmi.ko 2024-02-21T22:49:08.235 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/acpi/acpi_pad.ko 2024-02-21T22:49:08.235 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/acpi/custom_method.ko 2024-02-21T22:49:08.235 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/acpi/ec_sys.ko 2024-02-21T22:49:08.235 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/acpi/platform_profile.ko 2024-02-21T22:49:08.235 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/acpi/sbs.ko 2024-02-21T22:49:08.235 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/acpi/sbshc.ko 2024-02-21T22:49:08.235 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/acpi/video.ko 2024-02-21T22:49:08.235 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata 2024-02-21T22:49:08.236 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/acard-ahci.ko 2024-02-21T22:49:08.236 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/ahci_platform.ko 2024-02-21T22:49:08.236 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/ata_generic.ko 2024-02-21T22:49:08.236 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/libahci_platform.ko 2024-02-21T22:49:08.236 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_acpi.ko 2024-02-21T22:49:08.236 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_ali.ko 2024-02-21T22:49:08.236 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_amd.ko 2024-02-21T22:49:08.236 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_artop.ko 2024-02-21T22:49:08.236 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_atiixp.ko 2024-02-21T22:49:08.236 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_atp867x.ko 2024-02-21T22:49:08.236 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_cmd640.ko 2024-02-21T22:49:08.236 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_cmd64x.ko 2024-02-21T22:49:08.236 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_cypress.ko 2024-02-21T22:49:08.236 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_efar.ko 2024-02-21T22:49:08.237 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_hpt366.ko 2024-02-21T22:49:08.237 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_hpt37x.ko 2024-02-21T22:49:08.237 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_hpt3x2n.ko 2024-02-21T22:49:08.237 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_hpt3x3.ko 2024-02-21T22:49:08.237 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_it8213.ko 2024-02-21T22:49:08.237 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_it821x.ko 2024-02-21T22:49:08.237 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_jmicron.ko 2024-02-21T22:49:08.237 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_marvell.ko 2024-02-21T22:49:08.237 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_mpiix.ko 2024-02-21T22:49:08.237 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_netcell.ko 2024-02-21T22:49:08.237 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_ninja32.ko 2024-02-21T22:49:08.237 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_ns87410.ko 2024-02-21T22:49:08.237 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_ns87415.ko 2024-02-21T22:49:08.238 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_oldpiix.ko 2024-02-21T22:49:08.238 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_opti.ko 2024-02-21T22:49:08.238 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_optidma.ko 2024-02-21T22:49:08.238 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_pcmcia.ko 2024-02-21T22:49:08.238 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_pdc2027x.ko 2024-02-21T22:49:08.238 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-02-21T22:49:08.238 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_piccolo.ko 2024-02-21T22:49:08.238 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_rdc.ko 2024-02-21T22:49:08.238 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_sch.ko 2024-02-21T22:49:08.238 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_serverworks.ko 2024-02-21T22:49:08.239 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_sil680.ko 2024-02-21T22:49:08.239 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_sis.ko 2024-02-21T22:49:08.239 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_sl82c105.ko 2024-02-21T22:49:08.239 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_triflex.ko 2024-02-21T22:49:08.239 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pata_via.ko 2024-02-21T22:49:08.239 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/pdc_adma.ko 2024-02-21T22:49:08.239 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/sata_inic162x.ko 2024-02-21T22:49:08.239 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/sata_mv.ko 2024-02-21T22:49:08.239 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/sata_nv.ko 2024-02-21T22:49:08.239 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/sata_promise.ko 2024-02-21T22:49:08.239 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/sata_qstor.ko 2024-02-21T22:49:08.239 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/sata_sil.ko 2024-02-21T22:49:08.239 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/sata_sil24.ko 2024-02-21T22:49:08.239 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/sata_sis.ko 2024-02-21T22:49:08.240 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/sata_svw.ko 2024-02-21T22:49:08.240 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/sata_sx4.ko 2024-02-21T22:49:08.240 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/sata_uli.ko 2024-02-21T22:49:08.240 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/sata_via.ko 2024-02-21T22:49:08.240 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ata/sata_vsc.ko 2024-02-21T22:49:08.240 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/auxdisplay 2024-02-21T22:49:08.240 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/auxdisplay/ks0108.ko 2024-02-21T22:49:08.240 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/base 2024-02-21T22:49:08.240 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/base/regmap 2024-02-21T22:49:08.240 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/base/regmap/regmap-i2c.ko 2024-02-21T22:49:08.240 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/base/regmap/regmap-mmio.ko 2024-02-21T22:49:08.240 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/bcma 2024-02-21T22:49:08.240 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/bcma/bcma.ko 2024-02-21T22:49:08.241 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/block 2024-02-21T22:49:08.241 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/block/aoe 2024-02-21T22:49:08.241 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/block/aoe/aoe.ko 2024-02-21T22:49:08.241 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/block/brd.ko 2024-02-21T22:49:08.241 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/block/drbd 2024-02-21T22:49:08.241 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/block/drbd/drbd.ko 2024-02-21T22:49:08.241 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/block/floppy.ko 2024-02-21T22:49:08.241 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/block/loop.ko 2024-02-21T22:49:08.241 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/block/mtip32xx 2024-02-21T22:49:08.241 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-02-21T22:49:08.241 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/block/nbd.ko 2024-02-21T22:49:08.241 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/block/null_blk 2024-02-21T22:49:08.241 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/block/null_blk/null_blk.ko 2024-02-21T22:49:08.241 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/block/pktcdvd.ko 2024-02-21T22:49:08.242 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/block/rbd.ko 2024-02-21T22:49:08.242 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/block/virtio_blk.ko 2024-02-21T22:49:08.242 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/block/xen-blkback 2024-02-21T22:49:08.242 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-02-21T22:49:08.242 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/block/xen-blkfront.ko 2024-02-21T22:49:08.242 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/block/zram 2024-02-21T22:49:08.242 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/block/zram/zram.ko 2024-02-21T22:49:08.242 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char 2024-02-21T22:49:08.242 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char/hangcheck-timer.ko 2024-02-21T22:49:08.242 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char/hw_random 2024-02-21T22:49:08.242 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char/hw_random/amd-rng.ko 2024-02-21T22:49:08.242 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char/hw_random/intel-rng.ko 2024-02-21T22:49:08.242 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-02-21T22:49:08.243 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char/hw_random/via-rng.ko 2024-02-21T22:49:08.243 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char/hw_random/virtio-rng.ko 2024-02-21T22:49:08.243 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char/ipmi 2024-02-21T22:49:08.243 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-02-21T22:49:08.243 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-02-21T22:49:08.243 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-02-21T22:49:08.243 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char/ipmi/ipmi_si.ko 2024-02-21T22:49:08.243 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-02-21T22:49:08.243 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-02-21T22:49:08.243 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char/lp.ko 2024-02-21T22:49:08.243 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char/mwave 2024-02-21T22:49:08.243 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char/mwave/mwave.ko 2024-02-21T22:49:08.243 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char/ppdev.ko 2024-02-21T22:49:08.243 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char/tlclk.ko 2024-02-21T22:49:08.243 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char/tpm 2024-02-21T22:49:08.244 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char/tpm/tpm.ko 2024-02-21T22:49:08.244 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char/tpm/tpm_atmel.ko 2024-02-21T22:49:08.244 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char/tpm/tpm_infineon.ko 2024-02-21T22:49:08.244 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char/tpm/tpm_nsc.ko 2024-02-21T22:49:08.244 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char/tpm/tpm_tis.ko 2024-02-21T22:49:08.244 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-02-21T22:49:08.244 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char/uv_mmtimer.ko 2024-02-21T22:49:08.244 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/char/virtio_console.ko 2024-02-21T22:49:08.244 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/cpufreq 2024-02-21T22:49:08.244 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-02-21T22:49:08.244 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-02-21T22:49:08.244 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/cpufreq/p4-clockmod.ko 2024-02-21T22:49:08.244 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-02-21T22:49:08.245 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/cpufreq/powernow-k8.ko 2024-02-21T22:49:08.245 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/cpufreq/speedstep-lib.ko 2024-02-21T22:49:08.245 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/crypto 2024-02-21T22:49:08.245 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/crypto/ccp 2024-02-21T22:49:08.245 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-02-21T22:49:08.245 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/crypto/ccp/ccp.ko 2024-02-21T22:49:08.245 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/crypto/intel 2024-02-21T22:49:08.245 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/crypto/intel/qat 2024-02-21T22:49:08.245 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/crypto/intel/qat/qat_common 2024-02-21T22:49:08.245 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-02-21T22:49:08.245 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-02-21T22:49:08.245 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-02-21T22:49:08.245 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/crypto/padlock-aes.ko 2024-02-21T22:49:08.245 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/crypto/padlock-sha.ko 2024-02-21T22:49:08.246 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/crypto/virtio 2024-02-21T22:49:08.246 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-02-21T22:49:08.246 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/dca 2024-02-21T22:49:08.246 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/dca/dca.ko 2024-02-21T22:49:08.246 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/devfreq 2024-02-21T22:49:08.246 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-02-21T22:49:08.246 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/dma 2024-02-21T22:49:08.246 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/dma/dw 2024-02-21T22:49:08.246 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/dma/dw/dw_dmac.ko 2024-02-21T22:49:08.246 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/dma/ioat 2024-02-21T22:49:08.246 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/dma/ioat/ioatdma.ko 2024-02-21T22:49:08.246 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/edac 2024-02-21T22:49:08.246 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/edac/amd64_edac.ko 2024-02-21T22:49:08.247 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/edac/e752x_edac.ko 2024-02-21T22:49:08.247 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/edac/edac_mce_amd.ko 2024-02-21T22:49:08.247 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/edac/i3000_edac.ko 2024-02-21T22:49:08.247 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/edac/i3200_edac.ko 2024-02-21T22:49:08.247 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/edac/i5100_edac.ko 2024-02-21T22:49:08.247 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/edac/i5400_edac.ko 2024-02-21T22:49:08.247 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/edac/i7300_edac.ko 2024-02-21T22:49:08.247 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/edac/i7core_edac.ko 2024-02-21T22:49:08.247 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/edac/i82975x_edac.ko 2024-02-21T22:49:08.247 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/edac/ie31200_edac.ko 2024-02-21T22:49:08.247 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/edac/sb_edac.ko 2024-02-21T22:49:08.247 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/edac/x38_edac.ko 2024-02-21T22:49:08.248 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/firmware 2024-02-21T22:49:08.248 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/firmware/edd.ko 2024-02-21T22:49:08.248 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/firmware/iscsi_ibft.ko 2024-02-21T22:49:08.248 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/gpio 2024-02-21T22:49:08.248 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/gpio/gpio-ich.ko 2024-02-21T22:49:08.248 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/gpio/gpio-viperboard.ko 2024-02-21T22:49:08.248 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid 2024-02-21T22:49:08.248 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-appleir.ko 2024-02-21T22:49:08.248 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-aureal.ko 2024-02-21T22:49:08.248 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-axff.ko 2024-02-21T22:49:08.248 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-dr.ko 2024-02-21T22:49:08.248 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-elecom.ko 2024-02-21T22:49:08.248 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-elo.ko 2024-02-21T22:49:08.248 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-emsff.ko 2024-02-21T22:49:08.249 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-gaff.ko 2024-02-21T22:49:08.249 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-gt683r.ko 2024-02-21T22:49:08.249 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-gyration.ko 2024-02-21T22:49:08.249 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-holtek-kbd.ko 2024-02-21T22:49:08.249 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-holtek-mouse.ko 2024-02-21T22:49:08.249 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-holtekff.ko 2024-02-21T22:49:08.249 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-hyperv.ko 2024-02-21T22:49:08.249 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-icade.ko 2024-02-21T22:49:08.249 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-keytouch.ko 2024-02-21T22:49:08.249 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-kye.ko 2024-02-21T22:49:08.249 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-lcpower.ko 2024-02-21T22:49:08.249 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-led.ko 2024-02-21T22:49:08.249 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-lenovo.ko 2024-02-21T22:49:08.249 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-logitech-dj.ko 2024-02-21T22:49:08.249 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-02-21T22:49:08.250 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-multitouch.ko 2024-02-21T22:49:08.250 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-ortek.ko 2024-02-21T22:49:08.250 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-penmount.ko 2024-02-21T22:49:08.250 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-petalynx.ko 2024-02-21T22:49:08.250 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-picolcd.ko 2024-02-21T22:49:08.250 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-pl.ko 2024-02-21T22:49:08.250 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-plantronics.ko 2024-02-21T22:49:08.250 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-primax.ko 2024-02-21T22:49:08.250 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-rmi.ko 2024-02-21T22:49:08.250 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-roccat-arvo.ko 2024-02-21T22:49:08.250 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-roccat-common.ko 2024-02-21T22:49:08.250 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-roccat-isku.ko 2024-02-21T22:49:08.250 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-roccat-kone.ko 2024-02-21T22:49:08.250 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-02-21T22:49:08.251 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-roccat-konepure.ko 2024-02-21T22:49:08.251 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-02-21T22:49:08.251 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-roccat-lua.ko 2024-02-21T22:49:08.251 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-roccat-pyra.ko 2024-02-21T22:49:08.251 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-roccat-ryos.ko 2024-02-21T22:49:08.251 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-roccat-savu.ko 2024-02-21T22:49:08.251 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-roccat.ko 2024-02-21T22:49:08.251 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-saitek.ko 2024-02-21T22:49:08.251 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-samsung.ko 2024-02-21T22:49:08.251 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-sensor-hub.ko 2024-02-21T22:49:08.252 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-sjoy.ko 2024-02-21T22:49:08.252 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-sony.ko 2024-02-21T22:49:08.252 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-speedlink.ko 2024-02-21T22:49:08.252 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-steelseries.ko 2024-02-21T22:49:08.252 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-sunplus.ko 2024-02-21T22:49:08.252 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-thrustmaster.ko 2024-02-21T22:49:08.252 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-tivo.ko 2024-02-21T22:49:08.252 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-tmff.ko 2024-02-21T22:49:08.252 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-topseed.ko 2024-02-21T22:49:08.252 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-twinhan.ko 2024-02-21T22:49:08.252 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-uclogic.ko 2024-02-21T22:49:08.252 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-waltop.ko 2024-02-21T22:49:08.252 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-wiimote.ko 2024-02-21T22:49:08.252 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-xinmo.ko 2024-02-21T22:49:08.253 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-zpff.ko 2024-02-21T22:49:08.253 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/hid-zydacron.ko 2024-02-21T22:49:08.253 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/uhid.ko 2024-02-21T22:49:08.253 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hid/wacom.ko 2024-02-21T22:49:08.253 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hv 2024-02-21T22:49:08.253 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hv/hv_balloon.ko 2024-02-21T22:49:08.253 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hv/hv_utils.ko 2024-02-21T22:49:08.253 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hv/hv_vmbus.ko 2024-02-21T22:49:08.253 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon 2024-02-21T22:49:08.253 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/abituguru.ko 2024-02-21T22:49:08.253 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/abituguru3.ko 2024-02-21T22:49:08.253 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/acpi_power_meter.ko 2024-02-21T22:49:08.253 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/ad7414.ko 2024-02-21T22:49:08.253 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/ad7418.ko 2024-02-21T22:49:08.254 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/adc128d818.ko 2024-02-21T22:49:08.254 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/adm1025.ko 2024-02-21T22:49:08.254 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/adm1026.ko 2024-02-21T22:49:08.254 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/adm1029.ko 2024-02-21T22:49:08.254 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/adm1031.ko 2024-02-21T22:49:08.254 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/adm9240.ko 2024-02-21T22:49:08.254 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/ads7828.ko 2024-02-21T22:49:08.254 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/adt7410.ko 2024-02-21T22:49:08.254 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/adt7411.ko 2024-02-21T22:49:08.254 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/adt7462.ko 2024-02-21T22:49:08.254 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/adt7470.ko 2024-02-21T22:49:08.254 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/adt7475.ko 2024-02-21T22:49:08.254 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/adt7x10.ko 2024-02-21T22:49:08.254 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/amc6821.ko 2024-02-21T22:49:08.254 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/applesmc.ko 2024-02-21T22:49:08.255 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/asb100.ko 2024-02-21T22:49:08.255 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/asc7621.ko 2024-02-21T22:49:08.255 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/asus_atk0110.ko 2024-02-21T22:49:08.255 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/atxp1.ko 2024-02-21T22:49:08.255 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/coretemp.ko 2024-02-21T22:49:08.255 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-02-21T22:49:08.255 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/dme1737.ko 2024-02-21T22:49:08.255 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/ds1621.ko 2024-02-21T22:49:08.255 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/ds620.ko 2024-02-21T22:49:08.255 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/emc1403.ko 2024-02-21T22:49:08.255 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/emc6w201.ko 2024-02-21T22:49:08.255 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/f71805f.ko 2024-02-21T22:49:08.255 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/f71882fg.ko 2024-02-21T22:49:08.255 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/f75375s.ko 2024-02-21T22:49:08.256 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/fam15h_power.ko 2024-02-21T22:49:08.256 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/fschmd.ko 2024-02-21T22:49:08.256 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/g760a.ko 2024-02-21T22:49:08.256 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/g762.ko 2024-02-21T22:49:08.256 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/gl518sm.ko 2024-02-21T22:49:08.256 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/gl520sm.ko 2024-02-21T22:49:08.256 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/hwmon-vid.ko 2024-02-21T22:49:08.256 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/i5500_temp.ko 2024-02-21T22:49:08.256 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/i5k_amb.ko 2024-02-21T22:49:08.256 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/ibmaem.ko 2024-02-21T22:49:08.256 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/ibmpex.ko 2024-02-21T22:49:08.256 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/ina209.ko 2024-02-21T22:49:08.256 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/ina2xx.ko 2024-02-21T22:49:08.256 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/it87.ko 2024-02-21T22:49:08.257 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/k10temp.ko 2024-02-21T22:49:08.257 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/k8temp.ko 2024-02-21T22:49:08.257 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/lineage-pem.ko 2024-02-21T22:49:08.257 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/lm63.ko 2024-02-21T22:49:08.257 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/lm73.ko 2024-02-21T22:49:08.257 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/lm75.ko 2024-02-21T22:49:08.257 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/lm77.ko 2024-02-21T22:49:08.257 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/lm78.ko 2024-02-21T22:49:08.257 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/lm80.ko 2024-02-21T22:49:08.257 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/lm83.ko 2024-02-21T22:49:08.257 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/lm85.ko 2024-02-21T22:49:08.257 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/lm87.ko 2024-02-21T22:49:08.257 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/lm90.ko 2024-02-21T22:49:08.257 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/lm92.ko 2024-02-21T22:49:08.258 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/lm93.ko 2024-02-21T22:49:08.258 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/lm95234.ko 2024-02-21T22:49:08.258 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/lm95241.ko 2024-02-21T22:49:08.258 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/lm95245.ko 2024-02-21T22:49:08.258 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/ltc2945.ko 2024-02-21T22:49:08.258 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/ltc4151.ko 2024-02-21T22:49:08.258 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/ltc4215.ko 2024-02-21T22:49:08.258 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/ltc4222.ko 2024-02-21T22:49:08.258 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/ltc4245.ko 2024-02-21T22:49:08.258 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/ltc4260.ko 2024-02-21T22:49:08.258 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/ltc4261.ko 2024-02-21T22:49:08.258 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/max16065.ko 2024-02-21T22:49:08.258 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/max1619.ko 2024-02-21T22:49:08.258 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/max1668.ko 2024-02-21T22:49:08.258 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/max197.ko 2024-02-21T22:49:08.259 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/max6639.ko 2024-02-21T22:49:08.259 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/max6650.ko 2024-02-21T22:49:08.259 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/max6697.ko 2024-02-21T22:49:08.259 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/mcp3021.ko 2024-02-21T22:49:08.259 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/nct6683.ko 2024-02-21T22:49:08.259 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/nct6775-core.ko 2024-02-21T22:49:08.259 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/nct6775.ko 2024-02-21T22:49:08.259 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/nct7802.ko 2024-02-21T22:49:08.259 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/pc87360.ko 2024-02-21T22:49:08.259 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/pc87427.ko 2024-02-21T22:49:08.259 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/pcf8591.ko 2024-02-21T22:49:08.259 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/pmbus 2024-02-21T22:49:08.259 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-02-21T22:49:08.259 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-02-21T22:49:08.260 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-02-21T22:49:08.260 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/pmbus/max16064.ko 2024-02-21T22:49:08.260 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/pmbus/max34440.ko 2024-02-21T22:49:08.260 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/pmbus/max8688.ko 2024-02-21T22:49:08.260 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-02-21T22:49:08.260 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-02-21T22:49:08.260 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-02-21T22:49:08.260 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-02-21T22:49:08.260 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-02-21T22:49:08.260 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-02-21T22:49:08.260 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/powr1220.ko 2024-02-21T22:49:08.260 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/sch5627.ko 2024-02-21T22:49:08.260 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/sch5636.ko 2024-02-21T22:49:08.260 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/sch56xx-common.ko 2024-02-21T22:49:08.261 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/sht15.ko 2024-02-21T22:49:08.261 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/sht21.ko 2024-02-21T22:49:08.261 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/shtc1.ko 2024-02-21T22:49:08.261 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/sis5595.ko 2024-02-21T22:49:08.261 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/smsc47b397.ko 2024-02-21T22:49:08.261 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/smsc47m1.ko 2024-02-21T22:49:08.261 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/smsc47m192.ko 2024-02-21T22:49:08.261 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/thmc50.ko 2024-02-21T22:49:08.261 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/tmp102.ko 2024-02-21T22:49:08.261 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/tmp103.ko 2024-02-21T22:49:08.261 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/tmp401.ko 2024-02-21T22:49:08.261 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/tmp421.ko 2024-02-21T22:49:08.261 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/via-cputemp.ko 2024-02-21T22:49:08.262 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/via686a.ko 2024-02-21T22:49:08.262 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/vt1211.ko 2024-02-21T22:49:08.262 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/vt8231.ko 2024-02-21T22:49:08.262 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/w83627ehf.ko 2024-02-21T22:49:08.262 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/w83627hf.ko 2024-02-21T22:49:08.262 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/w83781d.ko 2024-02-21T22:49:08.262 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/w83791d.ko 2024-02-21T22:49:08.262 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/w83792d.ko 2024-02-21T22:49:08.262 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/w83793.ko 2024-02-21T22:49:08.262 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/w83795.ko 2024-02-21T22:49:08.262 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/w83l785ts.ko 2024-02-21T22:49:08.262 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/hwmon/w83l786ng.ko 2024-02-21T22:49:08.262 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c 2024-02-21T22:49:08.262 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/algos 2024-02-21T22:49:08.262 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-02-21T22:49:08.263 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-02-21T22:49:08.263 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/busses 2024-02-21T22:49:08.263 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-02-21T22:49:08.263 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-02-21T22:49:08.263 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-02-21T22:49:08.263 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-02-21T22:49:08.263 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-02-21T22:49:08.263 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-02-21T22:49:08.264 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-02-21T22:49:08.264 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-02-21T22:49:08.264 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/busses/i2c-i801.ko 2024-02-21T22:49:08.264 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/busses/i2c-isch.ko 2024-02-21T22:49:08.264 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-02-21T22:49:08.264 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-02-21T22:49:08.264 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-02-21T22:49:08.264 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/busses/i2c-parport.ko 2024-02-21T22:49:08.264 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-02-21T22:49:08.264 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-02-21T22:49:08.264 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-02-21T22:49:08.264 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-02-21T22:49:08.264 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-02-21T22:49:08.265 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-02-21T22:49:08.265 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/busses/i2c-via.ko 2024-02-21T22:49:08.265 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-02-21T22:49:08.265 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-02-21T22:49:08.265 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/i2c-dev.ko 2024-02-21T22:49:08.265 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/i2c-mux.ko 2024-02-21T22:49:08.265 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-02-21T22:49:08.265 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/i2c-smbus.ko 2024-02-21T22:49:08.265 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/i2c/i2c-stub.ko 2024-02-21T22:49:08.265 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband 2024-02-21T22:49:08.265 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband/core 2024-02-21T22:49:08.265 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband/core/ib_cm.ko 2024-02-21T22:49:08.265 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband/core/ib_core.ko 2024-02-21T22:49:08.265 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband/core/ib_umad.ko 2024-02-21T22:49:08.266 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-02-21T22:49:08.266 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband/core/iw_cm.ko 2024-02-21T22:49:08.266 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband/core/rdma_cm.ko 2024-02-21T22:49:08.266 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-02-21T22:49:08.266 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband/hw 2024-02-21T22:49:08.266 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband/hw/cxgb4 2024-02-21T22:49:08.266 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-02-21T22:49:08.266 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband/hw/mlx4 2024-02-21T22:49:08.266 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-02-21T22:49:08.266 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband/hw/mlx5 2024-02-21T22:49:08.266 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-02-21T22:49:08.266 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband/hw/mthca 2024-02-21T22:49:08.266 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-02-21T22:49:08.266 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband/ulp 2024-02-21T22:49:08.266 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband/ulp/ipoib 2024-02-21T22:49:08.267 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-02-21T22:49:08.267 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband/ulp/iser 2024-02-21T22:49:08.267 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-02-21T22:49:08.267 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband/ulp/isert 2024-02-21T22:49:08.267 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-02-21T22:49:08.267 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband/ulp/srp 2024-02-21T22:49:08.267 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-02-21T22:49:08.267 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband/ulp/srpt 2024-02-21T22:49:08.267 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-02-21T22:49:08.267 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/input 2024-02-21T22:49:08.267 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/input/gameport 2024-02-21T22:49:08.267 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-02-21T22:49:08.267 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/input/gameport/fm801-gp.ko 2024-02-21T22:49:08.267 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/input/gameport/gameport.ko 2024-02-21T22:49:08.268 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/input/joydev.ko 2024-02-21T22:49:08.268 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/input/keyboard 2024-02-21T22:49:08.268 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/input/keyboard/gpio_keys.ko 2024-02-21T22:49:08.268 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/input/mouse 2024-02-21T22:49:08.268 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/input/mouse/appletouch.ko 2024-02-21T22:49:08.268 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/input/mouse/bcm5974.ko 2024-02-21T22:49:08.268 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/input/mouse/cyapatp.ko 2024-02-21T22:49:08.268 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/input/mouse/elan_i2c.ko 2024-02-21T22:49:08.268 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/input/mouse/sermouse.ko 2024-02-21T22:49:08.268 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-02-21T22:49:08.268 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/input/mouse/synaptics_usb.ko 2024-02-21T22:49:08.268 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/input/mouse/vsxxxaa.ko 2024-02-21T22:49:08.268 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/input/rmi4 2024-02-21T22:49:08.268 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/input/rmi4/rmi_core.ko 2024-02-21T22:49:08.269 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/input/serio 2024-02-21T22:49:08.269 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/input/serio/altera_ps2.ko 2024-02-21T22:49:08.269 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/input/serio/arc_ps2.ko 2024-02-21T22:49:08.269 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-02-21T22:49:08.269 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/input/serio/serio_raw.ko 2024-02-21T22:49:08.269 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/input/sparse-keymap.ko 2024-02-21T22:49:08.269 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/leds 2024-02-21T22:49:08.269 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/leds/leds-blinkm.ko 2024-02-21T22:49:08.269 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/leds/leds-lm3530.ko 2024-02-21T22:49:08.269 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/leds/leds-lp3944.ko 2024-02-21T22:49:08.269 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/leds/leds-ss4200.ko 2024-02-21T22:49:08.269 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/leds/trigger 2024-02-21T22:49:08.269 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-02-21T22:49:08.269 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-02-21T22:49:08.270 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-02-21T22:49:08.270 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-02-21T22:49:08.270 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-02-21T22:49:08.270 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-02-21T22:49:08.270 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-02-21T22:49:08.270 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-02-21T22:49:08.270 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-02-21T22:49:08.270 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/md 2024-02-21T22:49:08.270 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/md/bcache 2024-02-21T22:49:08.270 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/md/bcache/bcache.ko 2024-02-21T22:49:08.270 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/md/dm-bio-prison.ko 2024-02-21T22:49:08.270 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/md/dm-cache-smq.ko 2024-02-21T22:49:08.270 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/md/dm-cache.ko 2024-02-21T22:49:08.270 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/md/dm-crypt.ko 2024-02-21T22:49:08.271 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/md/dm-delay.ko 2024-02-21T22:49:08.271 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/md/dm-flakey.ko 2024-02-21T22:49:08.271 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/md/dm-log-userspace.ko 2024-02-21T22:49:08.271 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/md/dm-multipath.ko 2024-02-21T22:49:08.271 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/md/dm-queue-length.ko 2024-02-21T22:49:08.271 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/md/dm-raid.ko 2024-02-21T22:49:08.271 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/md/dm-round-robin.ko 2024-02-21T22:49:08.271 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/md/dm-service-time.ko 2024-02-21T22:49:08.271 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/md/dm-switch.ko 2024-02-21T22:49:08.271 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/md/dm-thin-pool.ko 2024-02-21T22:49:08.271 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/md/dm-verity.ko 2024-02-21T22:49:08.271 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/md/persistent-data 2024-02-21T22:49:08.271 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-02-21T22:49:08.271 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/md/raid0.ko 2024-02-21T22:49:08.272 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/md/raid1.ko 2024-02-21T22:49:08.272 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/md/raid10.ko 2024-02-21T22:49:08.272 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/md/raid456.ko 2024-02-21T22:49:08.272 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/message 2024-02-21T22:49:08.272 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/message/fusion 2024-02-21T22:49:08.272 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/message/fusion/mptbase.ko 2024-02-21T22:49:08.272 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/message/fusion/mptctl.ko 2024-02-21T22:49:08.272 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/message/fusion/mptfc.ko 2024-02-21T22:49:08.272 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/message/fusion/mptlan.ko 2024-02-21T22:49:08.272 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/message/fusion/mptsas.ko 2024-02-21T22:49:08.272 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/message/fusion/mptscsih.ko 2024-02-21T22:49:08.272 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/message/fusion/mptspi.ko 2024-02-21T22:49:08.272 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/mfd 2024-02-21T22:49:08.272 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/mfd/lpc_ich.ko 2024-02-21T22:49:08.273 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/mfd/lpc_sch.ko 2024-02-21T22:49:08.273 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/mfd/mfd-core.ko 2024-02-21T22:49:08.273 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/mfd/sm501.ko 2024-02-21T22:49:08.273 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/mfd/viperboard.ko 2024-02-21T22:49:08.273 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/mfd/vx855.ko 2024-02-21T22:49:08.273 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/mfd/wl1273-core.ko 2024-02-21T22:49:08.273 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc 2024-02-21T22:49:08.273 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/altera-stapl 2024-02-21T22:49:08.273 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-02-21T22:49:08.273 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/apds9802als.ko 2024-02-21T22:49:08.273 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/apds990x.ko 2024-02-21T22:49:08.273 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/bh1770glc.ko 2024-02-21T22:49:08.273 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/cb710 2024-02-21T22:49:08.273 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/cb710/cb710.ko 2024-02-21T22:49:08.273 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/eeprom 2024-02-21T22:49:08.274 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/eeprom/at24.ko 2024-02-21T22:49:08.274 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-02-21T22:49:08.274 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/eeprom/max6875.ko 2024-02-21T22:49:08.274 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/enclosure.ko 2024-02-21T22:49:08.274 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/hpilo.ko 2024-02-21T22:49:08.274 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/isl29003.ko 2024-02-21T22:49:08.274 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/isl29020.ko 2024-02-21T22:49:08.274 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/lis3lv02d 2024-02-21T22:49:08.274 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-02-21T22:49:08.274 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-02-21T22:49:08.274 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/mei 2024-02-21T22:49:08.274 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/mei/mei-me.ko 2024-02-21T22:49:08.274 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/mei/mei-txe.ko 2024-02-21T22:49:08.275 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/mei/mei.ko 2024-02-21T22:49:08.275 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/sgi-gru 2024-02-21T22:49:08.275 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/sgi-gru/gru.ko 2024-02-21T22:49:08.275 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/sgi-xp 2024-02-21T22:49:08.275 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/sgi-xp/xp.ko 2024-02-21T22:49:08.275 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/sgi-xp/xpc.ko 2024-02-21T22:49:08.275 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-02-21T22:49:08.275 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/tifm_7xx1.ko 2024-02-21T22:49:08.275 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/tifm_core.ko 2024-02-21T22:49:08.275 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/tsl2550.ko 2024-02-21T22:49:08.275 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/vmw_balloon.ko 2024-02-21T22:49:08.275 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/vmw_vmci 2024-02-21T22:49:08.275 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-02-21T22:49:08.275 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net 2024-02-21T22:49:08.275 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/bonding 2024-02-21T22:49:08.276 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/bonding/bonding.ko 2024-02-21T22:49:08.276 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/dsa 2024-02-21T22:49:08.276 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/dsa/b53 2024-02-21T22:49:08.276 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/dsa/b53/b53_common.ko 2024-02-21T22:49:08.276 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/dsa/bcm-sf2.ko 2024-02-21T22:49:08.276 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/dsa/mv88e6060.ko 2024-02-21T22:49:08.276 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/dsa/mv88e6xxx 2024-02-21T22:49:08.276 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-02-21T22:49:08.276 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/dummy.ko 2024-02-21T22:49:08.276 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/eql.ko 2024-02-21T22:49:08.276 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet 2024-02-21T22:49:08.276 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/3com 2024-02-21T22:49:08.276 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-02-21T22:49:08.276 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-02-21T22:49:08.277 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-02-21T22:49:08.277 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-02-21T22:49:08.277 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/8390 2024-02-21T22:49:08.277 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/8390/8390.ko 2024-02-21T22:49:08.277 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-02-21T22:49:08.277 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-02-21T22:49:08.277 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-02-21T22:49:08.277 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/adaptec 2024-02-21T22:49:08.277 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-02-21T22:49:08.277 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/agere 2024-02-21T22:49:08.278 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/agere/et131x.ko 2024-02-21T22:49:08.278 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/alteon 2024-02-21T22:49:08.278 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-02-21T22:49:08.278 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/altera 2024-02-21T22:49:08.278 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-02-21T22:49:08.278 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/amd 2024-02-21T22:49:08.278 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-02-21T22:49:08.278 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-02-21T22:49:08.278 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-02-21T22:49:08.278 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/atheros 2024-02-21T22:49:08.278 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/atheros/alx 2024-02-21T22:49:08.278 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-02-21T22:49:08.278 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/atheros/atl1c 2024-02-21T22:49:08.279 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-02-21T22:49:08.279 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/atheros/atl1e 2024-02-21T22:49:08.279 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-02-21T22:49:08.279 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/atheros/atlx 2024-02-21T22:49:08.279 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-02-21T22:49:08.279 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-02-21T22:49:08.279 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/broadcom 2024-02-21T22:49:08.279 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-02-21T22:49:08.279 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-02-21T22:49:08.279 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-02-21T22:49:08.279 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-02-21T22:49:08.279 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-02-21T22:49:08.279 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/broadcom/genet 2024-02-21T22:49:08.279 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-02-21T22:49:08.280 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-02-21T22:49:08.280 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/brocade 2024-02-21T22:49:08.280 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/brocade/bna 2024-02-21T22:49:08.280 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-02-21T22:49:08.280 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/chelsio 2024-02-21T22:49:08.280 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/chelsio/cxgb 2024-02-21T22:49:08.280 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-02-21T22:49:08.280 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-02-21T22:49:08.280 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-02-21T22:49:08.280 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-02-21T22:49:08.280 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-02-21T22:49:08.280 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-02-21T22:49:08.280 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-02-21T22:49:08.281 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-02-21T22:49:08.281 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-02-21T22:49:08.281 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/cisco 2024-02-21T22:49:08.281 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/cisco/enic 2024-02-21T22:49:08.281 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-02-21T22:49:08.281 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/dec 2024-02-21T22:49:08.281 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/dec/tulip 2024-02-21T22:49:08.281 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-02-21T22:49:08.281 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-02-21T22:49:08.281 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-02-21T22:49:08.281 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-02-21T22:49:08.281 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-02-21T22:49:08.281 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-02-21T22:49:08.281 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/dlink 2024-02-21T22:49:08.282 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-02-21T22:49:08.282 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-02-21T22:49:08.282 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/dnet.ko 2024-02-21T22:49:08.282 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/emulex 2024-02-21T22:49:08.282 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/emulex/benet 2024-02-21T22:49:08.282 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-02-21T22:49:08.282 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/ethoc.ko 2024-02-21T22:49:08.282 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/fealnx.ko 2024-02-21T22:49:08.282 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/intel 2024-02-21T22:49:08.282 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/intel/e100.ko 2024-02-21T22:49:08.282 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/intel/e1000 2024-02-21T22:49:08.282 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-02-21T22:49:08.282 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/intel/e1000e 2024-02-21T22:49:08.283 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-02-21T22:49:08.283 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/intel/fm10k 2024-02-21T22:49:08.283 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-02-21T22:49:08.283 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/intel/i40e 2024-02-21T22:49:08.283 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-02-21T22:49:08.283 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/intel/iavf 2024-02-21T22:49:08.283 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-02-21T22:49:08.283 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/intel/igb 2024-02-21T22:49:08.283 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-02-21T22:49:08.283 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/intel/igbvf 2024-02-21T22:49:08.284 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-02-21T22:49:08.284 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/intel/ixgbe 2024-02-21T22:49:08.284 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-02-21T22:49:08.284 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/intel/ixgbevf 2024-02-21T22:49:08.284 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-02-21T22:49:08.284 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/jme.ko 2024-02-21T22:49:08.284 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/marvell 2024-02-21T22:49:08.284 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-02-21T22:49:08.284 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/marvell/skge.ko 2024-02-21T22:49:08.284 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-02-21T22:49:08.284 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/mellanox 2024-02-21T22:49:08.284 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/mellanox/mlx4 2024-02-21T22:49:08.284 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-02-21T22:49:08.284 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-02-21T22:49:08.285 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/mellanox/mlx5 2024-02-21T22:49:08.285 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-02-21T22:49:08.285 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-02-21T22:49:08.285 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/micrel 2024-02-21T22:49:08.285 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-02-21T22:49:08.285 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/myricom 2024-02-21T22:49:08.285 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/myricom/myri10ge 2024-02-21T22:49:08.285 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-02-21T22:49:08.285 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/natsemi 2024-02-21T22:49:08.285 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-02-21T22:49:08.285 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-02-21T22:49:08.285 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/neterion 2024-02-21T22:49:08.286 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-02-21T22:49:08.286 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/nvidia 2024-02-21T22:49:08.286 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-02-21T22:49:08.286 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/packetengines 2024-02-21T22:49:08.286 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-02-21T22:49:08.286 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-02-21T22:49:08.286 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/qlogic 2024-02-21T22:49:08.286 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/qlogic/netxen 2024-02-21T22:49:08.286 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-02-21T22:49:08.286 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-02-21T22:49:08.286 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-02-21T22:49:08.286 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-02-21T22:49:08.286 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/rdc 2024-02-21T22:49:08.286 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-02-21T22:49:08.287 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/realtek 2024-02-21T22:49:08.287 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-02-21T22:49:08.287 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-02-21T22:49:08.287 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/realtek/atp.ko 2024-02-21T22:49:08.287 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-02-21T22:49:08.287 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/rocker 2024-02-21T22:49:08.287 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-02-21T22:49:08.287 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/sfc 2024-02-21T22:49:08.287 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-02-21T22:49:08.287 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/silan 2024-02-21T22:49:08.287 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-02-21T22:49:08.287 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/sis 2024-02-21T22:49:08.287 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/sis/sis190.ko 2024-02-21T22:49:08.287 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/sis/sis900.ko 2024-02-21T22:49:08.288 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/smsc 2024-02-21T22:49:08.288 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-02-21T22:49:08.288 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-02-21T22:49:08.288 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-02-21T22:49:08.288 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-02-21T22:49:08.288 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/stmicro 2024-02-21T22:49:08.288 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/stmicro/stmmac 2024-02-21T22:49:08.288 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-02-21T22:49:08.288 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-02-21T22:49:08.288 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/sun 2024-02-21T22:49:08.288 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/sun/cassini.ko 2024-02-21T22:49:08.288 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/sun/niu.ko 2024-02-21T22:49:08.288 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/sun/sungem.ko 2024-02-21T22:49:08.288 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-02-21T22:49:08.289 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/tehuti 2024-02-21T22:49:08.289 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-02-21T22:49:08.289 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/ti 2024-02-21T22:49:08.289 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/ti/tlan.ko 2024-02-21T22:49:08.289 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/via 2024-02-21T22:49:08.289 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-02-21T22:49:08.289 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-02-21T22:49:08.289 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/wiznet 2024-02-21T22:49:08.289 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-02-21T22:49:08.289 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-02-21T22:49:08.289 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/xircom 2024-02-21T22:49:08.289 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-02-21T22:49:08.289 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/geneve.ko 2024-02-21T22:49:08.289 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/hyperv 2024-02-21T22:49:08.290 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-02-21T22:49:08.290 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ieee802154 2024-02-21T22:49:08.290 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ieee802154/fakelb.ko 2024-02-21T22:49:08.290 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ifb.ko 2024-02-21T22:49:08.290 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ipvlan 2024-02-21T22:49:08.290 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ipvlan/ipvlan.ko 2024-02-21T22:49:08.290 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/macvlan.ko 2024-02-21T22:49:08.290 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/macvtap.ko 2024-02-21T22:49:08.290 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/mdio 2024-02-21T22:49:08.290 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/mdio.ko 2024-02-21T22:49:08.290 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-02-21T22:49:08.290 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-02-21T22:49:08.290 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/mdio/mdio-regmap.ko 2024-02-21T22:49:08.290 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/mii.ko 2024-02-21T22:49:08.290 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/net_failover.ko 2024-02-21T22:49:08.291 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/netconsole.ko 2024-02-21T22:49:08.291 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/nlmon.ko 2024-02-21T22:49:08.291 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/pcs 2024-02-21T22:49:08.291 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/pcs/pcs-lynx.ko 2024-02-21T22:49:08.291 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-02-21T22:49:08.291 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/phy 2024-02-21T22:49:08.291 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/phy/amd.ko 2024-02-21T22:49:08.291 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-02-21T22:49:08.291 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-02-21T22:49:08.291 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/phy/bcm7xxx.ko 2024-02-21T22:49:08.291 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/phy/bcm87xx.ko 2024-02-21T22:49:08.291 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/phy/broadcom.ko 2024-02-21T22:49:08.291 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/phy/cicada.ko 2024-02-21T22:49:08.291 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/phy/davicom.ko 2024-02-21T22:49:08.291 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/phy/dp83640.ko 2024-02-21T22:49:08.292 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/phy/et1011c.ko 2024-02-21T22:49:08.292 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/phy/icplus.ko 2024-02-21T22:49:08.292 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/phy/lxt.ko 2024-02-21T22:49:08.292 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/phy/marvell.ko 2024-02-21T22:49:08.292 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/phy/micrel.ko 2024-02-21T22:49:08.292 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/phy/national.ko 2024-02-21T22:49:08.292 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/phy/phylink.ko 2024-02-21T22:49:08.292 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/phy/qsemi.ko 2024-02-21T22:49:08.292 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/phy/realtek.ko 2024-02-21T22:49:08.292 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/phy/smsc.ko 2024-02-21T22:49:08.292 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/phy/ste10Xp.ko 2024-02-21T22:49:08.292 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/phy/vitesse.ko 2024-02-21T22:49:08.292 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ppp 2024-02-21T22:49:08.292 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ppp/bsd_comp.ko 2024-02-21T22:49:08.292 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ppp/ppp_async.ko 2024-02-21T22:49:08.293 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ppp/ppp_deflate.ko 2024-02-21T22:49:08.293 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ppp/ppp_generic.ko 2024-02-21T22:49:08.293 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ppp/ppp_mppe.ko 2024-02-21T22:49:08.293 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ppp/ppp_synctty.ko 2024-02-21T22:49:08.293 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ppp/pppoe.ko 2024-02-21T22:49:08.293 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ppp/pppox.ko 2024-02-21T22:49:08.293 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/ppp/pptp.ko 2024-02-21T22:49:08.293 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/slip 2024-02-21T22:49:08.293 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/slip/slhc.ko 2024-02-21T22:49:08.293 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/slip/slip.ko 2024-02-21T22:49:08.293 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/sungem_phy.ko 2024-02-21T22:49:08.293 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/tap.ko 2024-02-21T22:49:08.293 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/team 2024-02-21T22:49:08.293 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/team/team.ko 2024-02-21T22:49:08.294 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/team/team_mode_activebackup.ko 2024-02-21T22:49:08.294 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/team/team_mode_broadcast.ko 2024-02-21T22:49:08.294 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-02-21T22:49:08.294 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/team/team_mode_random.ko 2024-02-21T22:49:08.294 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-02-21T22:49:08.294 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/tun.ko 2024-02-21T22:49:08.294 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/veth.ko 2024-02-21T22:49:08.294 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/virtio_net.ko 2024-02-21T22:49:08.294 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/vmxnet3 2024-02-21T22:49:08.294 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-02-21T22:49:08.294 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/vxlan 2024-02-21T22:49:08.294 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/vxlan/vxlan.ko 2024-02-21T22:49:08.294 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/xen-netback 2024-02-21T22:49:08.295 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/xen-netback/xen-netback.ko 2024-02-21T22:49:08.295 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/net/xen-netfront.ko 2024-02-21T22:49:08.295 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ntb 2024-02-21T22:49:08.295 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ntb/ntb.ko 2024-02-21T22:49:08.295 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/nvme 2024-02-21T22:49:08.295 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/nvme/host 2024-02-21T22:49:08.295 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/nvme/host/nvme-core.ko 2024-02-21T22:49:08.295 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/nvme/host/nvme.ko 2024-02-21T22:49:08.295 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/parport 2024-02-21T22:49:08.295 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/parport/parport.ko 2024-02-21T22:49:08.295 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/parport/parport_cs.ko 2024-02-21T22:49:08.296 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/parport/parport_pc.ko 2024-02-21T22:49:08.296 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/parport/parport_serial.ko 2024-02-21T22:49:08.296 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/pci 2024-02-21T22:49:08.296 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/pci/hotplug 2024-02-21T22:49:08.296 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-02-21T22:49:08.296 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/pci/pcie 2024-02-21T22:49:08.296 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/pci/pcie/aer_inject.ko 2024-02-21T22:49:08.296 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/pci/xen-pcifront.ko 2024-02-21T22:49:08.296 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/pcmcia 2024-02-21T22:49:08.296 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/pcmcia/i82092.ko 2024-02-21T22:49:08.296 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/pcmcia/pd6729.ko 2024-02-21T22:49:08.296 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/pcmcia/yenta_socket.ko 2024-02-21T22:49:08.296 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/pinctrl 2024-02-21T22:49:08.296 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/pinctrl/intel 2024-02-21T22:49:08.297 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-02-21T22:49:08.297 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/platform 2024-02-21T22:49:08.297 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/platform/x86 2024-02-21T22:49:08.297 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/platform/x86/acer-wmi.ko 2024-02-21T22:49:08.297 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/platform/x86/acerhdf.ko 2024-02-21T22:49:08.297 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/platform/x86/apple-gmux.ko 2024-02-21T22:49:08.297 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/platform/x86/asus-laptop.ko 2024-02-21T22:49:08.297 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-02-21T22:49:08.297 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/platform/x86/asus-wmi.ko 2024-02-21T22:49:08.297 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/platform/x86/classmate-laptop.ko 2024-02-21T22:49:08.297 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-02-21T22:49:08.297 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-02-21T22:49:08.297 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-02-21T22:49:08.297 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-02-21T22:49:08.298 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/platform/x86/hdaps.ko 2024-02-21T22:49:08.298 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/platform/x86/intel 2024-02-21T22:49:08.298 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-02-21T22:49:08.298 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/platform/x86/intel_ips.ko 2024-02-21T22:49:08.298 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/platform/x86/msi-wmi.ko 2024-02-21T22:49:08.298 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/platform/x86/mxm-wmi.ko 2024-02-21T22:49:08.298 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-02-21T22:49:08.298 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/platform/x86/samsung-laptop.ko 2024-02-21T22:49:08.298 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/platform/x86/samsung-q10.ko 2024-02-21T22:49:08.298 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/platform/x86/topstar-laptop.ko 2024-02-21T22:49:08.299 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-02-21T22:49:08.299 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/platform/x86/toshiba_haps.ko 2024-02-21T22:49:08.299 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/platform/x86/wmi-bmof.ko 2024-02-21T22:49:08.299 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/platform/x86/wmi.ko 2024-02-21T22:49:08.299 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/powercap 2024-02-21T22:49:08.299 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/powercap/intel_rapl_common.ko 2024-02-21T22:49:08.299 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/powercap/intel_rapl_msr.ko 2024-02-21T22:49:08.299 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/pps 2024-02-21T22:49:08.299 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/pps/clients 2024-02-21T22:49:08.299 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/pps/clients/pps-gpio.ko 2024-02-21T22:49:08.299 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/pps/clients/pps-ldisc.ko 2024-02-21T22:49:08.299 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/pps/clients/pps_parport.ko 2024-02-21T22:49:08.299 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/pps/pps_core.ko 2024-02-21T22:49:08.299 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ptp 2024-02-21T22:49:08.299 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ptp/ptp.ko 2024-02-21T22:49:08.300 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ptp/ptp_kvm.ko 2024-02-21T22:49:08.300 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc 2024-02-21T22:49:08.300 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-bq32k.ko 2024-02-21T22:49:08.300 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-ds1286.ko 2024-02-21T22:49:08.300 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-ds1307.ko 2024-02-21T22:49:08.300 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-ds1374.ko 2024-02-21T22:49:08.300 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-ds1511.ko 2024-02-21T22:49:08.300 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-ds1553.ko 2024-02-21T22:49:08.300 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-ds1672.ko 2024-02-21T22:49:08.300 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-ds1742.ko 2024-02-21T22:49:08.300 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-ds2404.ko 2024-02-21T22:49:08.300 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-ds3232.ko 2024-02-21T22:49:08.301 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-em3027.ko 2024-02-21T22:49:08.301 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-fm3130.ko 2024-02-21T22:49:08.301 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-isl12022.ko 2024-02-21T22:49:08.301 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-isl1208.ko 2024-02-21T22:49:08.301 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-m41t80.ko 2024-02-21T22:49:08.301 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-m48t35.ko 2024-02-21T22:49:08.301 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-m48t59.ko 2024-02-21T22:49:08.301 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-max6900.ko 2024-02-21T22:49:08.301 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-msm6242.ko 2024-02-21T22:49:08.301 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-pcf2127.ko 2024-02-21T22:49:08.301 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-pcf85063.ko 2024-02-21T22:49:08.301 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-pcf8523.ko 2024-02-21T22:49:08.301 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-pcf8563.ko 2024-02-21T22:49:08.301 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-pcf8583.ko 2024-02-21T22:49:08.301 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-rp5c01.ko 2024-02-21T22:49:08.302 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-rs5c372.ko 2024-02-21T22:49:08.302 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-02-21T22:49:08.302 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-rx8025.ko 2024-02-21T22:49:08.302 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-rx8581.ko 2024-02-21T22:49:08.302 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-02-21T22:49:08.302 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/rtc/rtc-x1205.ko 2024-02-21T22:49:08.302 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi 2024-02-21T22:49:08.302 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/3w-9xxx.ko 2024-02-21T22:49:08.302 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/3w-sas.ko 2024-02-21T22:49:08.302 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/3w-xxxx.ko 2024-02-21T22:49:08.302 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/BusLogic.ko 2024-02-21T22:49:08.302 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/a100u2w.ko 2024-02-21T22:49:08.302 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/aacraid 2024-02-21T22:49:08.302 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/aacraid/aacraid.ko 2024-02-21T22:49:08.302 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/advansys.ko 2024-02-21T22:49:08.303 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/aic7xxx 2024-02-21T22:49:08.303 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-02-21T22:49:08.303 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-02-21T22:49:08.303 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/am53c974.ko 2024-02-21T22:49:08.303 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/arcmsr 2024-02-21T22:49:08.303 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-02-21T22:49:08.303 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/atp870u.ko 2024-02-21T22:49:08.303 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/be2iscsi 2024-02-21T22:49:08.303 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-02-21T22:49:08.303 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/bfa 2024-02-21T22:49:08.303 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/bfa/bfa.ko 2024-02-21T22:49:08.303 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/bnx2fc 2024-02-21T22:49:08.303 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-02-21T22:49:08.303 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/bnx2i 2024-02-21T22:49:08.303 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-02-21T22:49:08.304 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/ch.ko 2024-02-21T22:49:08.304 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/csiostor 2024-02-21T22:49:08.304 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/csiostor/csiostor.ko 2024-02-21T22:49:08.304 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/cxgbi 2024-02-21T22:49:08.304 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/cxgbi/cxgb3i 2024-02-21T22:49:08.304 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-02-21T22:49:08.304 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/cxgbi/cxgb4i 2024-02-21T22:49:08.304 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-02-21T22:49:08.304 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-02-21T22:49:08.304 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/dc395x.ko 2024-02-21T22:49:08.304 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/device_handler 2024-02-21T22:49:08.304 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-02-21T22:49:08.304 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-02-21T22:49:08.304 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-02-21T22:49:08.305 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-02-21T22:49:08.305 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/dmx3191d.ko 2024-02-21T22:49:08.305 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/esas2r 2024-02-21T22:49:08.305 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/esas2r/esas2r.ko 2024-02-21T22:49:08.305 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/esp_scsi.ko 2024-02-21T22:49:08.305 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/fcoe 2024-02-21T22:49:08.305 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/fcoe/fcoe.ko 2024-02-21T22:49:08.305 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-02-21T22:49:08.305 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/fnic 2024-02-21T22:49:08.305 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/fnic/fnic.ko 2024-02-21T22:49:08.305 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/hpsa.ko 2024-02-21T22:49:08.305 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/hptiop.ko 2024-02-21T22:49:08.305 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/hv_storvsc.ko 2024-02-21T22:49:08.305 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/initio.ko 2024-02-21T22:49:08.306 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/ipr.ko 2024-02-21T22:49:08.306 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/ips.ko 2024-02-21T22:49:08.306 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/isci 2024-02-21T22:49:08.306 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/isci/isci.ko 2024-02-21T22:49:08.306 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-02-21T22:49:08.306 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/iscsi_tcp.ko 2024-02-21T22:49:08.306 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/libfc 2024-02-21T22:49:08.306 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/libfc/libfc.ko 2024-02-21T22:49:08.306 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/libiscsi.ko 2024-02-21T22:49:08.306 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/libiscsi_tcp.ko 2024-02-21T22:49:08.306 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/libsas 2024-02-21T22:49:08.306 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/libsas/libsas.ko 2024-02-21T22:49:08.306 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/lpfc 2024-02-21T22:49:08.306 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/lpfc/lpfc.ko 2024-02-21T22:49:08.307 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/megaraid 2024-02-21T22:49:08.307 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/megaraid.ko 2024-02-21T22:49:08.307 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-02-21T22:49:08.307 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-02-21T22:49:08.307 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-02-21T22:49:08.307 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/mpt3sas 2024-02-21T22:49:08.307 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-02-21T22:49:08.307 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/mvsas 2024-02-21T22:49:08.307 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/mvsas/mvsas.ko 2024-02-21T22:49:08.307 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/mvumi.ko 2024-02-21T22:49:08.307 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/pm8001 2024-02-21T22:49:08.308 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-02-21T22:49:08.309 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/pmcraid.ko 2024-02-21T22:49:08.309 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/qla1280.ko 2024-02-21T22:49:08.309 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/qla2xxx 2024-02-21T22:49:08.309 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-02-21T22:49:08.309 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-02-21T22:49:08.309 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/qla4xxx 2024-02-21T22:49:08.309 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-02-21T22:49:08.309 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/raid_class.ko 2024-02-21T22:49:08.309 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/scsi_debug.ko 2024-02-21T22:49:08.309 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/scsi_transport_fc.ko 2024-02-21T22:49:08.309 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-02-21T22:49:08.309 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/scsi_transport_sas.ko 2024-02-21T22:49:08.310 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/scsi_transport_spi.ko 2024-02-21T22:49:08.310 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/scsi_transport_srp.ko 2024-02-21T22:49:08.310 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/ses.ko 2024-02-21T22:49:08.310 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/st.ko 2024-02-21T22:49:08.310 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/stex.ko 2024-02-21T22:49:08.310 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/sym53c8xx_2 2024-02-21T22:49:08.310 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-02-21T22:49:08.310 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/virtio_scsi.ko 2024-02-21T22:49:08.310 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/vmw_pvscsi.ko 2024-02-21T22:49:08.310 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/scsi/wd719x.ko 2024-02-21T22:49:08.310 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ssb 2024-02-21T22:49:08.311 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ssb/ssb.ko 2024-02-21T22:49:08.311 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/target 2024-02-21T22:49:08.311 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/target/iscsi 2024-02-21T22:49:08.311 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-02-21T22:49:08.311 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/target/loopback 2024-02-21T22:49:08.311 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/target/loopback/tcm_loop.ko 2024-02-21T22:49:08.311 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/target/target_core_file.ko 2024-02-21T22:49:08.311 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/target/target_core_iblock.ko 2024-02-21T22:49:08.311 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/target/target_core_mod.ko 2024-02-21T22:49:08.311 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/target/target_core_pscsi.ko 2024-02-21T22:49:08.311 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/target/target_core_user.ko 2024-02-21T22:49:08.312 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/target/tcm_fc 2024-02-21T22:49:08.312 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-02-21T22:49:08.312 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/thermal 2024-02-21T22:49:08.312 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/thermal/intel 2024-02-21T22:49:08.312 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/thermal/intel/int340x_thermal 2024-02-21T22:49:08.312 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-02-21T22:49:08.312 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-02-21T22:49:08.312 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-02-21T22:49:08.312 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-02-21T22:49:08.313 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-02-21T22:49:08.313 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-02-21T22:49:08.313 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-02-21T22:49:08.313 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-02-21T22:49:08.313 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-02-21T22:49:08.313 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-02-21T22:49:08.313 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-02-21T22:49:08.313 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-02-21T22:49:08.313 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-02-21T22:49:08.313 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-02-21T22:49:08.313 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-02-21T22:49:08.313 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-02-21T22:49:08.313 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-02-21T22:49:08.313 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-02-21T22:49:08.314 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/tty 2024-02-21T22:49:08.314 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/tty/ipwireless 2024-02-21T22:49:08.314 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-02-21T22:49:08.314 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/tty/n_gsm.ko 2024-02-21T22:49:08.314 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/tty/n_hdlc.ko 2024-02-21T22:49:08.314 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/tty/nozomi.ko 2024-02-21T22:49:08.314 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/tty/serial 2024-02-21T22:49:08.314 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/tty/serial/8250 2024-02-21T22:49:08.314 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-02-21T22:49:08.314 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/tty/serial/arc_uart.ko 2024-02-21T22:49:08.314 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/tty/serial/jsm 2024-02-21T22:49:08.315 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/tty/serial/jsm/jsm.ko 2024-02-21T22:49:08.315 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ufs 2024-02-21T22:49:08.315 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ufs/core 2024-02-21T22:49:08.315 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ufs/core/ufshcd-core.ko 2024-02-21T22:49:08.315 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ufs/host 2024-02-21T22:49:08.315 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-02-21T22:49:08.315 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/uio 2024-02-21T22:49:08.315 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/uio/uio.ko 2024-02-21T22:49:08.315 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/uio/uio_aec.ko 2024-02-21T22:49:08.315 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/uio/uio_cif.ko 2024-02-21T22:49:08.315 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/uio/uio_pci_generic.ko 2024-02-21T22:49:08.315 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/uio/uio_sercos3.ko 2024-02-21T22:49:08.315 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb 2024-02-21T22:49:08.316 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/class 2024-02-21T22:49:08.316 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/class/cdc-acm.ko 2024-02-21T22:49:08.316 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/class/cdc-wdm.ko 2024-02-21T22:49:08.316 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/class/usblp.ko 2024-02-21T22:49:08.316 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/class/usbtmc.ko 2024-02-21T22:49:08.316 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/host 2024-02-21T22:49:08.316 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/host/sl811-hcd.ko 2024-02-21T22:49:08.316 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/image 2024-02-21T22:49:08.316 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/image/mdc800.ko 2024-02-21T22:49:08.316 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/image/microtek.ko 2024-02-21T22:49:08.316 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/misc 2024-02-21T22:49:08.316 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/misc/adutux.ko 2024-02-21T22:49:08.316 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/misc/appledisplay.ko 2024-02-21T22:49:08.317 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/misc/emi26.ko 2024-02-21T22:49:08.317 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/misc/emi62.ko 2024-02-21T22:49:08.317 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/misc/ezusb.ko 2024-02-21T22:49:08.317 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/misc/idmouse.ko 2024-02-21T22:49:08.317 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/misc/iowarrior.ko 2024-02-21T22:49:08.317 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/misc/isight_firmware.ko 2024-02-21T22:49:08.317 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/misc/ldusb.ko 2024-02-21T22:49:08.317 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/misc/legousbtower.ko 2024-02-21T22:49:08.317 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/misc/sisusbvga 2024-02-21T22:49:08.317 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-02-21T22:49:08.318 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/misc/trancevibrator.ko 2024-02-21T22:49:08.318 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/misc/usb3503.ko 2024-02-21T22:49:08.318 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/misc/usblcd.ko 2024-02-21T22:49:08.318 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/misc/usbsevseg.ko 2024-02-21T22:49:08.318 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/misc/uss720.ko 2024-02-21T22:49:08.318 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/misc/yurex.ko 2024-02-21T22:49:08.318 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/phy 2024-02-21T22:49:08.318 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/phy/phy-generic.ko 2024-02-21T22:49:08.318 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial 2024-02-21T22:49:08.318 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/aircable.ko 2024-02-21T22:49:08.318 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/ark3116.ko 2024-02-21T22:49:08.318 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/belkin_sa.ko 2024-02-21T22:49:08.318 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/ch341.ko 2024-02-21T22:49:08.319 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/cp210x.ko 2024-02-21T22:49:08.319 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/cyberjack.ko 2024-02-21T22:49:08.319 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/cypress_m8.ko 2024-02-21T22:49:08.319 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/digi_acceleport.ko 2024-02-21T22:49:08.319 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/empeg.ko 2024-02-21T22:49:08.319 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/ftdi_sio.ko 2024-02-21T22:49:08.319 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/garmin_gps.ko 2024-02-21T22:49:08.319 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/io_edgeport.ko 2024-02-21T22:49:08.319 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/io_ti.ko 2024-02-21T22:49:08.319 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/ipaq.ko 2024-02-21T22:49:08.319 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/ipw.ko 2024-02-21T22:49:08.319 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/ir-usb.ko 2024-02-21T22:49:08.319 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-02-21T22:49:08.319 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/keyspan.ko 2024-02-21T22:49:08.320 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/keyspan_pda.ko 2024-02-21T22:49:08.320 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/kl5kusb105.ko 2024-02-21T22:49:08.320 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/kobil_sct.ko 2024-02-21T22:49:08.320 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/mct_u232.ko 2024-02-21T22:49:08.320 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/mos7720.ko 2024-02-21T22:49:08.320 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/mos7840.ko 2024-02-21T22:49:08.320 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/navman.ko 2024-02-21T22:49:08.320 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/omninet.ko 2024-02-21T22:49:08.320 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/opticon.ko 2024-02-21T22:49:08.320 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/option.ko 2024-02-21T22:49:08.320 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/oti6858.ko 2024-02-21T22:49:08.320 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/pl2303.ko 2024-02-21T22:49:08.320 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/qcaux.ko 2024-02-21T22:49:08.320 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/qcserial.ko 2024-02-21T22:49:08.320 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/quatech2.ko 2024-02-21T22:49:08.321 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/safe_serial.ko 2024-02-21T22:49:08.321 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/sierra.ko 2024-02-21T22:49:08.321 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/spcp8x5.ko 2024-02-21T22:49:08.321 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/ssu100.ko 2024-02-21T22:49:08.321 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/symbolserial.ko 2024-02-21T22:49:08.321 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-02-21T22:49:08.321 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-02-21T22:49:08.321 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/usb_debug.ko 2024-02-21T22:49:08.321 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/usb_wwan.ko 2024-02-21T22:49:08.321 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/visor.ko 2024-02-21T22:49:08.321 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/whiteheat.ko 2024-02-21T22:49:08.321 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/serial/xsens_mt.ko 2024-02-21T22:49:08.321 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/storage 2024-02-21T22:49:08.322 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/storage/uas.ko 2024-02-21T22:49:08.322 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/storage/ums-alauda.ko 2024-02-21T22:49:08.322 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/storage/ums-cypress.ko 2024-02-21T22:49:08.322 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/storage/ums-datafab.ko 2024-02-21T22:49:08.322 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-02-21T22:49:08.322 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/storage/ums-freecom.ko 2024-02-21T22:49:08.322 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/storage/ums-isd200.ko 2024-02-21T22:49:08.322 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-02-21T22:49:08.322 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/storage/ums-karma.ko 2024-02-21T22:49:08.322 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/storage/ums-onetouch.ko 2024-02-21T22:49:08.322 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/storage/ums-realtek.ko 2024-02-21T22:49:08.322 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/storage/ums-sddr09.ko 2024-02-21T22:49:08.322 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/storage/ums-sddr55.ko 2024-02-21T22:49:08.322 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/storage/ums-usbat.ko 2024-02-21T22:49:08.323 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/storage/usb-storage.ko 2024-02-21T22:49:08.323 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/usbip 2024-02-21T22:49:08.323 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/usbip/usbip-core.ko 2024-02-21T22:49:08.323 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/usbip/usbip-host.ko 2024-02-21T22:49:08.323 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-02-21T22:49:08.323 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/vfio 2024-02-21T22:49:08.323 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/vfio/pci 2024-02-21T22:49:08.323 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-02-21T22:49:08.323 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/vfio/pci/vfio-pci.ko 2024-02-21T22:49:08.323 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/vfio/vfio.ko 2024-02-21T22:49:08.323 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-02-21T22:49:08.323 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/vhost 2024-02-21T22:49:08.323 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/vhost/vhost.ko 2024-02-21T22:49:08.323 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/vhost/vhost_iotlb.ko 2024-02-21T22:49:08.324 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/vhost/vhost_net.ko 2024-02-21T22:49:08.324 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/vhost/vhost_scsi.ko 2024-02-21T22:49:08.324 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/video 2024-02-21T22:49:08.324 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/video/backlight 2024-02-21T22:49:08.324 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/video/backlight/apple_bl.ko 2024-02-21T22:49:08.324 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/video/backlight/lcd.ko 2024-02-21T22:49:08.324 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/video/backlight/platform_lcd.ko 2024-02-21T22:49:08.324 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/virtio 2024-02-21T22:49:08.324 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/virtio/virtio.ko 2024-02-21T22:49:08.324 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/virtio/virtio_balloon.ko 2024-02-21T22:49:08.324 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/virtio/virtio_mmio.ko 2024-02-21T22:49:08.324 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/virtio/virtio_pci.ko 2024-02-21T22:49:08.324 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-02-21T22:49:08.325 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-02-21T22:49:08.325 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/virtio/virtio_ring.ko 2024-02-21T22:49:08.325 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/w1 2024-02-21T22:49:08.325 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/w1/masters 2024-02-21T22:49:08.325 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/w1/masters/ds2482.ko 2024-02-21T22:49:08.325 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/w1/masters/ds2490.ko 2024-02-21T22:49:08.325 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/w1/slaves 2024-02-21T22:49:08.325 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-02-21T22:49:08.325 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-02-21T22:49:08.325 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-02-21T22:49:08.325 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-02-21T22:49:08.325 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-02-21T22:49:08.325 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-02-21T22:49:08.325 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-02-21T22:49:08.326 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-02-21T22:49:08.326 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-02-21T22:49:08.326 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/w1/slaves/w1_smem.ko 2024-02-21T22:49:08.326 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/w1/slaves/w1_therm.ko 2024-02-21T22:49:08.326 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/w1/wire.ko 2024-02-21T22:49:08.326 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/watchdog 2024-02-21T22:49:08.326 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/watchdog/alim1535_wdt.ko 2024-02-21T22:49:08.326 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/watchdog/alim7101_wdt.ko 2024-02-21T22:49:08.326 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/watchdog/f71808e_wdt.ko 2024-02-21T22:49:08.326 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/watchdog/hpwdt.ko 2024-02-21T22:49:08.326 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/watchdog/i6300esb.ko 2024-02-21T22:49:08.326 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-02-21T22:49:08.326 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/watchdog/iTCO_wdt.ko 2024-02-21T22:49:08.326 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/watchdog/ib700wdt.ko 2024-02-21T22:49:08.326 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/watchdog/ibmasr.ko 2024-02-21T22:49:08.327 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-02-21T22:49:08.327 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/watchdog/it8712f_wdt.ko 2024-02-21T22:49:08.327 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/watchdog/it87_wdt.ko 2024-02-21T22:49:08.327 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/watchdog/machzwd.ko 2024-02-21T22:49:08.327 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/watchdog/nv_tco.ko 2024-02-21T22:49:08.327 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/watchdog/pcwd_pci.ko 2024-02-21T22:49:08.327 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/watchdog/pcwd_usb.ko 2024-02-21T22:49:08.327 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-02-21T22:49:08.327 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/watchdog/sch311x_wdt.ko 2024-02-21T22:49:08.327 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/watchdog/softdog.ko 2024-02-21T22:49:08.327 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/watchdog/sp5100_tco.ko 2024-02-21T22:49:08.327 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/watchdog/via_wdt.ko 2024-02-21T22:49:08.327 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-02-21T22:49:08.327 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/watchdog/w83877f_wdt.ko 2024-02-21T22:49:08.328 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/watchdog/w83977f_wdt.ko 2024-02-21T22:49:08.328 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/watchdog/wdt_pci.ko 2024-02-21T22:49:08.328 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/watchdog/xen_wdt.ko 2024-02-21T22:49:08.328 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/xen 2024-02-21T22:49:08.328 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/xen/xen-acpi-processor.ko 2024-02-21T22:49:08.328 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/xen/xen-evtchn.ko 2024-02-21T22:49:08.328 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/xen/xen-gntalloc.ko 2024-02-21T22:49:08.328 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/xen/xen-gntdev.ko 2024-02-21T22:49:08.328 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/xen/xen-pciback 2024-02-21T22:49:08.328 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-02-21T22:49:08.328 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/xen/xen-privcmd.ko 2024-02-21T22:49:08.328 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/xen/xenfs 2024-02-21T22:49:08.328 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/drivers/xen/xenfs/xenfs.ko 2024-02-21T22:49:08.328 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs 2024-02-21T22:49:08.329 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/9p 2024-02-21T22:49:08.329 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/9p/9p.ko 2024-02-21T22:49:08.329 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/affs 2024-02-21T22:49:08.329 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/affs/affs.ko 2024-02-21T22:49:08.329 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/befs 2024-02-21T22:49:08.329 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/befs/befs.ko 2024-02-21T22:49:08.329 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/binfmt_misc.ko 2024-02-21T22:49:08.329 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/btrfs 2024-02-21T22:49:08.329 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/btrfs/btrfs.ko 2024-02-21T22:49:08.329 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/cachefiles 2024-02-21T22:49:08.329 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/cachefiles/cachefiles.ko 2024-02-21T22:49:08.329 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/ceph 2024-02-21T22:49:08.329 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/ceph/ceph.ko 2024-02-21T22:49:08.329 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/coda 2024-02-21T22:49:08.329 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/coda/coda.ko 2024-02-21T22:49:08.330 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/cramfs 2024-02-21T22:49:08.330 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/cramfs/cramfs.ko 2024-02-21T22:49:08.330 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/dlm 2024-02-21T22:49:08.330 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/dlm/dlm.ko 2024-02-21T22:49:08.330 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/ecryptfs 2024-02-21T22:49:08.330 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/ecryptfs/ecryptfs.ko 2024-02-21T22:49:08.330 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/f2fs 2024-02-21T22:49:08.330 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/f2fs/f2fs.ko 2024-02-21T22:49:08.330 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/fat 2024-02-21T22:49:08.330 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/fat/fat.ko 2024-02-21T22:49:08.330 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/fat/msdos.ko 2024-02-21T22:49:08.330 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/fat/vfat.ko 2024-02-21T22:49:08.330 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/fuse 2024-02-21T22:49:08.330 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/fuse/cuse.ko 2024-02-21T22:49:08.330 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/fuse/fuse.ko 2024-02-21T22:49:08.331 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/gfs2 2024-02-21T22:49:08.331 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/gfs2/gfs2.ko 2024-02-21T22:49:08.331 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/hfs 2024-02-21T22:49:08.331 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/hfs/hfs.ko 2024-02-21T22:49:08.331 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/hfsplus 2024-02-21T22:49:08.331 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/hfsplus/hfsplus.ko 2024-02-21T22:49:08.331 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/isofs 2024-02-21T22:49:08.331 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/isofs/isofs.ko 2024-02-21T22:49:08.331 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/jfs 2024-02-21T22:49:08.331 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/jfs/jfs.ko 2024-02-21T22:49:08.331 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/lockd 2024-02-21T22:49:08.331 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/lockd/lockd.ko 2024-02-21T22:49:08.331 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/minix 2024-02-21T22:49:08.331 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/minix/minix.ko 2024-02-21T22:49:08.332 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/netfs 2024-02-21T22:49:08.332 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/netfs/netfs.ko 2024-02-21T22:49:08.332 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nfs 2024-02-21T22:49:08.332 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nfs/blocklayout 2024-02-21T22:49:08.332 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-02-21T22:49:08.332 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nfs/filelayout 2024-02-21T22:49:08.332 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-02-21T22:49:08.332 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nfs/flexfilelayout 2024-02-21T22:49:08.332 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-02-21T22:49:08.332 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nfs/nfs.ko 2024-02-21T22:49:08.332 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nfs/nfsv3.ko 2024-02-21T22:49:08.332 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nfs/nfsv4.ko 2024-02-21T22:49:08.332 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nfs_common 2024-02-21T22:49:08.332 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nfs_common/grace.ko 2024-02-21T22:49:08.333 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nfs_common/nfs_acl.ko 2024-02-21T22:49:08.333 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nfsd 2024-02-21T22:49:08.333 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nfsd/nfsd.ko 2024-02-21T22:49:08.333 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nilfs2 2024-02-21T22:49:08.333 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nilfs2/nilfs2.ko 2024-02-21T22:49:08.333 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls 2024-02-21T22:49:08.333 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/mac-celtic.ko 2024-02-21T22:49:08.333 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/mac-centeuro.ko 2024-02-21T22:49:08.333 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/mac-croatian.ko 2024-02-21T22:49:08.333 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/mac-cyrillic.ko 2024-02-21T22:49:08.333 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/mac-gaelic.ko 2024-02-21T22:49:08.333 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/mac-greek.ko 2024-02-21T22:49:08.333 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/mac-iceland.ko 2024-02-21T22:49:08.333 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/mac-inuit.ko 2024-02-21T22:49:08.334 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/mac-roman.ko 2024-02-21T22:49:08.334 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/mac-romanian.ko 2024-02-21T22:49:08.334 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/mac-turkish.ko 2024-02-21T22:49:08.334 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_cp1250.ko 2024-02-21T22:49:08.334 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_cp1251.ko 2024-02-21T22:49:08.334 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_cp1255.ko 2024-02-21T22:49:08.334 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_cp737.ko 2024-02-21T22:49:08.334 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_cp775.ko 2024-02-21T22:49:08.334 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_cp850.ko 2024-02-21T22:49:08.334 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_cp852.ko 2024-02-21T22:49:08.334 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_cp855.ko 2024-02-21T22:49:08.334 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_cp857.ko 2024-02-21T22:49:08.334 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_cp860.ko 2024-02-21T22:49:08.334 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_cp861.ko 2024-02-21T22:49:08.335 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_cp862.ko 2024-02-21T22:49:08.335 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_cp863.ko 2024-02-21T22:49:08.335 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_cp864.ko 2024-02-21T22:49:08.335 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_cp865.ko 2024-02-21T22:49:08.335 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_cp866.ko 2024-02-21T22:49:08.335 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_cp869.ko 2024-02-21T22:49:08.335 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_cp874.ko 2024-02-21T22:49:08.335 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_cp932.ko 2024-02-21T22:49:08.335 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_cp936.ko 2024-02-21T22:49:08.335 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_cp949.ko 2024-02-21T22:49:08.335 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_cp950.ko 2024-02-21T22:49:08.335 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_euc-jp.ko 2024-02-21T22:49:08.335 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_iso8859-1.ko 2024-02-21T22:49:08.335 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_iso8859-13.ko 2024-02-21T22:49:08.336 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_iso8859-14.ko 2024-02-21T22:49:08.336 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_iso8859-15.ko 2024-02-21T22:49:08.336 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_iso8859-2.ko 2024-02-21T22:49:08.336 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_iso8859-3.ko 2024-02-21T22:49:08.336 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_iso8859-4.ko 2024-02-21T22:49:08.336 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_iso8859-5.ko 2024-02-21T22:49:08.336 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_iso8859-6.ko 2024-02-21T22:49:08.336 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_iso8859-7.ko 2024-02-21T22:49:08.336 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_iso8859-9.ko 2024-02-21T22:49:08.336 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_koi8-r.ko 2024-02-21T22:49:08.336 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_koi8-ru.ko 2024-02-21T22:49:08.336 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_koi8-u.ko 2024-02-21T22:49:08.336 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_ucs2_utils.ko 2024-02-21T22:49:08.336 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/nls/nls_utf8.ko 2024-02-21T22:49:08.337 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/ocfs2 2024-02-21T22:49:08.337 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/ocfs2/cluster 2024-02-21T22:49:08.337 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-02-21T22:49:08.337 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/ocfs2/dlm 2024-02-21T22:49:08.337 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-02-21T22:49:08.337 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/ocfs2/dlmfs 2024-02-21T22:49:08.337 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-02-21T22:49:08.337 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/ocfs2/ocfs2.ko 2024-02-21T22:49:08.337 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-02-21T22:49:08.337 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-02-21T22:49:08.337 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-02-21T22:49:08.337 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/overlayfs 2024-02-21T22:49:08.337 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/overlayfs/overlay.ko 2024-02-21T22:49:08.338 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/pstore 2024-02-21T22:49:08.338 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/pstore/ramoops.ko 2024-02-21T22:49:08.338 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/reiserfs 2024-02-21T22:49:08.338 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/reiserfs/reiserfs.ko 2024-02-21T22:49:08.338 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/romfs 2024-02-21T22:49:08.338 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/romfs/romfs.ko 2024-02-21T22:49:08.338 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/smb 2024-02-21T22:49:08.338 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/smb/client 2024-02-21T22:49:08.338 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/smb/client/cifs.ko 2024-02-21T22:49:08.338 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/smb/common 2024-02-21T22:49:08.338 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/smb/common/cifs_arc4.ko 2024-02-21T22:49:08.338 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/smb/common/cifs_md4.ko 2024-02-21T22:49:08.338 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/squashfs 2024-02-21T22:49:08.338 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/squashfs/squashfs.ko 2024-02-21T22:49:08.338 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/sysv 2024-02-21T22:49:08.339 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/sysv/sysv.ko 2024-02-21T22:49:08.339 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/udf 2024-02-21T22:49:08.339 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/udf/udf.ko 2024-02-21T22:49:08.339 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/ufs 2024-02-21T22:49:08.339 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/ufs/ufs.ko 2024-02-21T22:49:08.339 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/xfs 2024-02-21T22:49:08.339 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/fs/xfs/xfs.ko 2024-02-21T22:49:08.339 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/kernel 2024-02-21T22:49:08.339 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/kernel/rcu 2024-02-21T22:49:08.339 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/kernel/rcu/rcutorture.ko 2024-02-21T22:49:08.339 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/kernel/torture.ko 2024-02-21T22:49:08.340 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/kernel/trace 2024-02-21T22:49:08.340 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-02-21T22:49:08.340 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/lib 2024-02-21T22:49:08.340 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/lib/asn1_encoder.ko 2024-02-21T22:49:08.340 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/lib/crc-itu-t.ko 2024-02-21T22:49:08.340 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/lib/crc8.ko 2024-02-21T22:49:08.340 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/lib/crypto 2024-02-21T22:49:08.340 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/lib/crypto/libarc4.ko 2024-02-21T22:49:08.340 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/lib/crypto/libdes.ko 2024-02-21T22:49:08.340 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/lib/libcrc32c.ko 2024-02-21T22:49:08.340 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/lib/lru_cache.ko 2024-02-21T22:49:08.340 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/lib/lz4 2024-02-21T22:49:08.341 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/lib/lz4/lz4_compress.ko 2024-02-21T22:49:08.341 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/lib/lz4/lz4hc_compress.ko 2024-02-21T22:49:08.341 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/lib/math 2024-02-21T22:49:08.341 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/lib/math/cordic.ko 2024-02-21T22:49:08.341 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/lib/raid6 2024-02-21T22:49:08.341 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/lib/raid6/raid6_pq.ko 2024-02-21T22:49:08.341 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/lib/reed_solomon 2024-02-21T22:49:08.341 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/lib/reed_solomon/reed_solomon.ko 2024-02-21T22:49:08.342 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/lib/ts_bm.ko 2024-02-21T22:49:08.342 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/lib/ts_fsm.ko 2024-02-21T22:49:08.342 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/lib/ts_kmp.ko 2024-02-21T22:49:08.342 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/lib/zstd 2024-02-21T22:49:08.342 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/lib/zstd/zstd_compress.ko 2024-02-21T22:49:08.342 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/mm 2024-02-21T22:49:08.342 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/mm/hwpoison-inject.ko 2024-02-21T22:49:08.342 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net 2024-02-21T22:49:08.342 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/6lowpan 2024-02-21T22:49:08.342 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/6lowpan/6lowpan.ko 2024-02-21T22:49:08.342 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/6lowpan/nhc_dest.ko 2024-02-21T22:49:08.342 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/6lowpan/nhc_fragment.ko 2024-02-21T22:49:08.342 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/6lowpan/nhc_hop.ko 2024-02-21T22:49:08.343 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/6lowpan/nhc_ipv6.ko 2024-02-21T22:49:08.343 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/6lowpan/nhc_mobility.ko 2024-02-21T22:49:08.343 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/6lowpan/nhc_routing.ko 2024-02-21T22:49:08.343 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/6lowpan/nhc_udp.ko 2024-02-21T22:49:08.343 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/802 2024-02-21T22:49:08.343 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/802/garp.ko 2024-02-21T22:49:08.343 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/802/mrp.ko 2024-02-21T22:49:08.343 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/802/p8022.ko 2024-02-21T22:49:08.343 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/802/psnap.ko 2024-02-21T22:49:08.343 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/802/stp.ko 2024-02-21T22:49:08.343 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/8021q 2024-02-21T22:49:08.343 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/8021q/8021q.ko 2024-02-21T22:49:08.343 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/9p 2024-02-21T22:49:08.343 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/9p/9pnet.ko 2024-02-21T22:49:08.344 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/9p/9pnet_fd.ko 2024-02-21T22:49:08.344 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/9p/9pnet_rdma.ko 2024-02-21T22:49:08.344 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/9p/9pnet_virtio.ko 2024-02-21T22:49:08.344 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/batman-adv 2024-02-21T22:49:08.344 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/batman-adv/batman-adv.ko 2024-02-21T22:49:08.344 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/bridge 2024-02-21T22:49:08.344 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/bridge/br_netfilter.ko 2024-02-21T22:49:08.344 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/bridge/bridge.ko 2024-02-21T22:49:08.344 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/bridge/netfilter 2024-02-21T22:49:08.344 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-02-21T22:49:08.344 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/bridge/netfilter/ebt_among.ko 2024-02-21T22:49:08.344 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/bridge/netfilter/ebt_arp.ko 2024-02-21T22:49:08.344 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-02-21T22:49:08.344 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-02-21T22:49:08.345 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/bridge/netfilter/ebt_ip.ko 2024-02-21T22:49:08.345 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-02-21T22:49:08.345 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/bridge/netfilter/ebt_limit.ko 2024-02-21T22:49:08.345 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/bridge/netfilter/ebt_log.ko 2024-02-21T22:49:08.345 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/bridge/netfilter/ebt_mark.ko 2024-02-21T22:49:08.345 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-02-21T22:49:08.345 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-02-21T22:49:08.345 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-02-21T22:49:08.345 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-02-21T22:49:08.345 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/bridge/netfilter/ebt_snat.ko 2024-02-21T22:49:08.345 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/bridge/netfilter/ebt_stp.ko 2024-02-21T22:49:08.345 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-02-21T22:49:08.345 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-02-21T22:49:08.345 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-02-21T22:49:08.346 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-02-21T22:49:08.346 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/bridge/netfilter/ebtables.ko 2024-02-21T22:49:08.346 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-02-21T22:49:08.346 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-02-21T22:49:08.346 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-02-21T22:49:08.346 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ceph 2024-02-21T22:49:08.346 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ceph/libceph.ko 2024-02-21T22:49:08.346 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/core 2024-02-21T22:49:08.346 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/core/failover.ko 2024-02-21T22:49:08.346 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/core/pktgen.ko 2024-02-21T22:49:08.346 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/dccp 2024-02-21T22:49:08.346 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/dccp/dccp.ko 2024-02-21T22:49:08.346 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/dccp/dccp_diag.ko 2024-02-21T22:49:08.346 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/dccp/dccp_ipv4.ko 2024-02-21T22:49:08.347 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/dccp/dccp_ipv6.ko 2024-02-21T22:49:08.347 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/dns_resolver 2024-02-21T22:49:08.347 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/dns_resolver/dns_resolver.ko 2024-02-21T22:49:08.347 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/dsa 2024-02-21T22:49:08.347 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/dsa/dsa_core.ko 2024-02-21T22:49:08.347 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/dsa/tag_brcm.ko 2024-02-21T22:49:08.347 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/dsa/tag_dsa.ko 2024-02-21T22:49:08.347 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/dsa/tag_none.ko 2024-02-21T22:49:08.347 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/dsa/tag_trailer.ko 2024-02-21T22:49:08.347 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ieee802154 2024-02-21T22:49:08.347 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ieee802154/6lowpan 2024-02-21T22:49:08.347 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-02-21T22:49:08.347 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ieee802154/ieee802154.ko 2024-02-21T22:49:08.348 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ieee802154/ieee802154_socket.ko 2024-02-21T22:49:08.348 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4 2024-02-21T22:49:08.348 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/ah4.ko 2024-02-21T22:49:08.348 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/esp4.ko 2024-02-21T22:49:08.348 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/fou.ko 2024-02-21T22:49:08.348 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/gre.ko 2024-02-21T22:49:08.348 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/inet_diag.ko 2024-02-21T22:49:08.348 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/ip_gre.ko 2024-02-21T22:49:08.348 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/ip_tunnel.ko 2024-02-21T22:49:08.348 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/ip_vti.ko 2024-02-21T22:49:08.348 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/ipcomp.ko 2024-02-21T22:49:08.348 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/ipip.ko 2024-02-21T22:49:08.348 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/netfilter 2024-02-21T22:49:08.349 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/netfilter/arp_tables.ko 2024-02-21T22:49:08.349 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-02-21T22:49:08.349 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-02-21T22:49:08.349 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-02-21T22:49:08.349 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-02-21T22:49:08.349 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-02-21T22:49:08.349 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-02-21T22:49:08.349 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-02-21T22:49:08.349 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-02-21T22:49:08.349 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-02-21T22:49:08.349 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/netfilter/iptable_security.ko 2024-02-21T22:49:08.349 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-02-21T22:49:08.349 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-02-21T22:49:08.350 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-02-21T22:49:08.350 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-02-21T22:49:08.350 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-02-21T22:49:08.350 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-02-21T22:49:08.350 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-02-21T22:49:08.350 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-02-21T22:49:08.350 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-02-21T22:49:08.350 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-02-21T22:49:08.350 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/tcp_bic.ko 2024-02-21T22:49:08.350 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/tcp_dctcp.ko 2024-02-21T22:49:08.350 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/tcp_diag.ko 2024-02-21T22:49:08.350 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/tcp_highspeed.ko 2024-02-21T22:49:08.350 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/tcp_htcp.ko 2024-02-21T22:49:08.350 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/tcp_hybla.ko 2024-02-21T22:49:08.351 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/tcp_illinois.ko 2024-02-21T22:49:08.351 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/tcp_lp.ko 2024-02-21T22:49:08.351 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/tcp_scalable.ko 2024-02-21T22:49:08.351 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/tcp_vegas.ko 2024-02-21T22:49:08.351 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/tcp_veno.ko 2024-02-21T22:49:08.351 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/tcp_westwood.ko 2024-02-21T22:49:08.351 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/tcp_yeah.ko 2024-02-21T22:49:08.351 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/tunnel4.ko 2024-02-21T22:49:08.351 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/udp_diag.ko 2024-02-21T22:49:08.351 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/udp_tunnel.ko 2024-02-21T22:49:08.351 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv4/xfrm4_tunnel.ko 2024-02-21T22:49:08.351 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6 2024-02-21T22:49:08.351 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/ah6.ko 2024-02-21T22:49:08.351 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/esp6.ko 2024-02-21T22:49:08.351 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/fou6.ko 2024-02-21T22:49:08.352 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/ip6_tunnel.ko 2024-02-21T22:49:08.352 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-02-21T22:49:08.352 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/ip6_vti.ko 2024-02-21T22:49:08.352 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/ipcomp6.ko 2024-02-21T22:49:08.352 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/netfilter 2024-02-21T22:49:08.352 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-02-21T22:49:08.352 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-02-21T22:49:08.352 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-02-21T22:49:08.352 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-02-21T22:49:08.352 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-02-21T22:49:08.352 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-02-21T22:49:08.352 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-02-21T22:49:08.352 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-02-21T22:49:08.353 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-02-21T22:49:08.353 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-02-21T22:49:08.353 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-02-21T22:49:08.353 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-02-21T22:49:08.353 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-02-21T22:49:08.353 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-02-21T22:49:08.353 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-02-21T22:49:08.353 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-02-21T22:49:08.353 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-02-21T22:49:08.353 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-02-21T22:49:08.353 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-02-21T22:49:08.353 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-02-21T22:49:08.353 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-02-21T22:49:08.354 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-02-21T22:49:08.354 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-02-21T22:49:08.354 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-02-21T22:49:08.354 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/sit.ko 2024-02-21T22:49:08.354 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/tunnel6.ko 2024-02-21T22:49:08.354 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/ipv6/xfrm6_tunnel.ko 2024-02-21T22:49:08.354 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/key 2024-02-21T22:49:08.354 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/key/af_key.ko 2024-02-21T22:49:08.354 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/l2tp 2024-02-21T22:49:08.354 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/l2tp/l2tp_core.ko 2024-02-21T22:49:08.354 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/l2tp/l2tp_debugfs.ko 2024-02-21T22:49:08.354 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/l2tp/l2tp_eth.ko 2024-02-21T22:49:08.354 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/l2tp/l2tp_ip.ko 2024-02-21T22:49:08.354 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/l2tp/l2tp_ip6.ko 2024-02-21T22:49:08.355 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/l2tp/l2tp_netlink.ko 2024-02-21T22:49:08.355 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/l2tp/l2tp_ppp.ko 2024-02-21T22:49:08.355 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/llc 2024-02-21T22:49:08.355 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/llc/llc.ko 2024-02-21T22:49:08.355 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/mac802154 2024-02-21T22:49:08.355 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/mac802154/mac802154.ko 2024-02-21T22:49:08.355 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/mpls 2024-02-21T22:49:08.355 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/mpls/mpls_gso.ko 2024-02-21T22:49:08.355 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter 2024-02-21T22:49:08.355 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipset 2024-02-21T22:49:08.355 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipset/ip_set.ko 2024-02-21T22:49:08.355 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-02-21T22:49:08.355 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-02-21T22:49:08.355 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-02-21T22:49:08.356 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-02-21T22:49:08.356 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-02-21T22:49:08.356 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-02-21T22:49:08.356 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-02-21T22:49:08.356 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-02-21T22:49:08.356 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-02-21T22:49:08.356 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-02-21T22:49:08.356 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-02-21T22:49:08.356 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-02-21T22:49:08.356 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-02-21T22:49:08.356 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-02-21T22:49:08.356 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-02-21T22:49:08.356 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipvs 2024-02-21T22:49:08.357 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipvs/ip_vs.ko 2024-02-21T22:49:08.357 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-02-21T22:49:08.357 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-02-21T22:49:08.357 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-02-21T22:49:08.357 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-02-21T22:49:08.357 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-02-21T22:49:08.357 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-02-21T22:49:08.357 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-02-21T22:49:08.357 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-02-21T22:49:08.357 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-02-21T22:49:08.357 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-02-21T22:49:08.357 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-02-21T22:49:08.357 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-02-21T22:49:08.357 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-02-21T22:49:08.357 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nf_conncount.ko 2024-02-21T22:49:08.358 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nf_conntrack.ko 2024-02-21T22:49:08.358 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-02-21T22:49:08.358 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-02-21T22:49:08.358 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-02-21T22:49:08.358 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nf_conntrack_h323.ko 2024-02-21T22:49:08.358 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nf_conntrack_irc.ko 2024-02-21T22:49:08.358 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-02-21T22:49:08.358 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-02-21T22:49:08.358 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-02-21T22:49:08.358 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nf_conntrack_sane.ko 2024-02-21T22:49:08.358 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nf_conntrack_sip.ko 2024-02-21T22:49:08.358 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-02-21T22:49:08.358 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-02-21T22:49:08.358 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nf_dup_netdev.ko 2024-02-21T22:49:08.359 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nf_flow_table.ko 2024-02-21T22:49:08.359 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nf_flow_table_inet.ko 2024-02-21T22:49:08.359 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nf_log_syslog.ko 2024-02-21T22:49:08.359 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nf_nat.ko 2024-02-21T22:49:08.359 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nf_nat_amanda.ko 2024-02-21T22:49:08.359 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nf_nat_ftp.ko 2024-02-21T22:49:08.359 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nf_nat_irc.ko 2024-02-21T22:49:08.359 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nf_nat_sip.ko 2024-02-21T22:49:08.359 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nf_nat_tftp.ko 2024-02-21T22:49:08.359 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nf_synproxy_core.ko 2024-02-21T22:49:08.359 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nf_tables.ko 2024-02-21T22:49:08.359 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nfnetlink.ko 2024-02-21T22:49:08.359 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nfnetlink_acct.ko 2024-02-21T22:49:08.359 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nfnetlink_log.ko 2024-02-21T22:49:08.360 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nfnetlink_osf.ko 2024-02-21T22:49:08.360 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nfnetlink_queue.ko 2024-02-21T22:49:08.360 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nft_chain_nat.ko 2024-02-21T22:49:08.360 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nft_compat.ko 2024-02-21T22:49:08.360 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nft_ct.ko 2024-02-21T22:49:08.360 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nft_dup_netdev.ko 2024-02-21T22:49:08.360 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nft_fib.ko 2024-02-21T22:49:08.360 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nft_fwd_netdev.ko 2024-02-21T22:49:08.360 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nft_hash.ko 2024-02-21T22:49:08.360 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nft_limit.ko 2024-02-21T22:49:08.360 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nft_log.ko 2024-02-21T22:49:08.360 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nft_masq.ko 2024-02-21T22:49:08.360 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nft_nat.ko 2024-02-21T22:49:08.360 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nft_numgen.ko 2024-02-21T22:49:08.361 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nft_queue.ko 2024-02-21T22:49:08.361 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nft_quota.ko 2024-02-21T22:49:08.361 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nft_redir.ko 2024-02-21T22:49:08.361 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nft_reject.ko 2024-02-21T22:49:08.361 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nft_reject_inet.ko 2024-02-21T22:49:08.361 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nft_socket.ko 2024-02-21T22:49:08.361 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/nft_tunnel.ko 2024-02-21T22:49:08.361 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_AUDIT.ko 2024-02-21T22:49:08.361 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_CHECKSUM.ko 2024-02-21T22:49:08.361 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_CLASSIFY.ko 2024-02-21T22:49:08.361 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-02-21T22:49:08.361 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_CT.ko 2024-02-21T22:49:08.361 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_DSCP.ko 2024-02-21T22:49:08.362 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_HL.ko 2024-02-21T22:49:08.362 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_HMARK.ko 2024-02-21T22:49:08.362 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_IDLETIMER.ko 2024-02-21T22:49:08.362 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_LED.ko 2024-02-21T22:49:08.362 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_LOG.ko 2024-02-21T22:49:08.362 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_MASQUERADE.ko 2024-02-21T22:49:08.362 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_NETMAP.ko 2024-02-21T22:49:08.362 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_NFLOG.ko 2024-02-21T22:49:08.362 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_NFQUEUE.ko 2024-02-21T22:49:08.362 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_RATEEST.ko 2024-02-21T22:49:08.362 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_REDIRECT.ko 2024-02-21T22:49:08.362 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_SECMARK.ko 2024-02-21T22:49:08.362 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_TCPMSS.ko 2024-02-21T22:49:08.362 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-02-21T22:49:08.362 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_TEE.ko 2024-02-21T22:49:08.363 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_TPROXY.ko 2024-02-21T22:49:08.363 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_TRACE.ko 2024-02-21T22:49:08.363 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_addrtype.ko 2024-02-21T22:49:08.363 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_bpf.ko 2024-02-21T22:49:08.363 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_cgroup.ko 2024-02-21T22:49:08.363 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_cluster.ko 2024-02-21T22:49:08.363 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_comment.ko 2024-02-21T22:49:08.363 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_connbytes.ko 2024-02-21T22:49:08.363 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_connlabel.ko 2024-02-21T22:49:08.363 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_connlimit.ko 2024-02-21T22:49:08.363 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_connmark.ko 2024-02-21T22:49:08.363 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_conntrack.ko 2024-02-21T22:49:08.363 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_cpu.ko 2024-02-21T22:49:08.363 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_dccp.ko 2024-02-21T22:49:08.364 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_devgroup.ko 2024-02-21T22:49:08.364 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_dscp.ko 2024-02-21T22:49:08.364 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_ecn.ko 2024-02-21T22:49:08.364 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_esp.ko 2024-02-21T22:49:08.364 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_hashlimit.ko 2024-02-21T22:49:08.364 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_helper.ko 2024-02-21T22:49:08.364 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_hl.ko 2024-02-21T22:49:08.364 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_ipcomp.ko 2024-02-21T22:49:08.364 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_iprange.ko 2024-02-21T22:49:08.364 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_ipvs.ko 2024-02-21T22:49:08.364 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_l2tp.ko 2024-02-21T22:49:08.364 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_length.ko 2024-02-21T22:49:08.364 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_limit.ko 2024-02-21T22:49:08.365 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_mac.ko 2024-02-21T22:49:08.365 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_mark.ko 2024-02-21T22:49:08.365 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_multiport.ko 2024-02-21T22:49:08.365 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_nat.ko 2024-02-21T22:49:08.365 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_nfacct.ko 2024-02-21T22:49:08.365 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_osf.ko 2024-02-21T22:49:08.365 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_owner.ko 2024-02-21T22:49:08.365 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_physdev.ko 2024-02-21T22:49:08.365 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_pkttype.ko 2024-02-21T22:49:08.365 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_policy.ko 2024-02-21T22:49:08.365 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_quota.ko 2024-02-21T22:49:08.365 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_rateest.ko 2024-02-21T22:49:08.365 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_realm.ko 2024-02-21T22:49:08.365 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_recent.ko 2024-02-21T22:49:08.366 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_sctp.ko 2024-02-21T22:49:08.366 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_set.ko 2024-02-21T22:49:08.366 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_socket.ko 2024-02-21T22:49:08.366 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_state.ko 2024-02-21T22:49:08.366 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_statistic.ko 2024-02-21T22:49:08.366 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_string.ko 2024-02-21T22:49:08.366 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_tcpmss.ko 2024-02-21T22:49:08.366 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_time.ko 2024-02-21T22:49:08.366 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netfilter/xt_u32.ko 2024-02-21T22:49:08.366 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netlink 2024-02-21T22:49:08.366 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/netlink/netlink_diag.ko 2024-02-21T22:49:08.366 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/nsh 2024-02-21T22:49:08.366 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/nsh/nsh.ko 2024-02-21T22:49:08.367 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/openvswitch 2024-02-21T22:49:08.367 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/openvswitch/openvswitch.ko 2024-02-21T22:49:08.367 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/openvswitch/vport-geneve.ko 2024-02-21T22:49:08.367 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/openvswitch/vport-gre.ko 2024-02-21T22:49:08.367 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/openvswitch/vport-vxlan.ko 2024-02-21T22:49:08.367 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/packet 2024-02-21T22:49:08.367 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/packet/af_packet_diag.ko 2024-02-21T22:49:08.367 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/rds 2024-02-21T22:49:08.367 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/rds/rds.ko 2024-02-21T22:49:08.367 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/rds/rds_rdma.ko 2024-02-21T22:49:08.367 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/rds/rds_tcp.ko 2024-02-21T22:49:08.367 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched 2024-02-21T22:49:08.367 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/act_csum.ko 2024-02-21T22:49:08.367 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/act_gact.ko 2024-02-21T22:49:08.368 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/act_mirred.ko 2024-02-21T22:49:08.368 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/act_nat.ko 2024-02-21T22:49:08.368 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/act_pedit.ko 2024-02-21T22:49:08.368 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/act_police.ko 2024-02-21T22:49:08.368 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/act_simple.ko 2024-02-21T22:49:08.368 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/act_skbedit.ko 2024-02-21T22:49:08.368 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/act_vlan.ko 2024-02-21T22:49:08.368 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/cls_basic.ko 2024-02-21T22:49:08.368 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/cls_bpf.ko 2024-02-21T22:49:08.368 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/cls_flow.ko 2024-02-21T22:49:08.368 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/cls_fw.ko 2024-02-21T22:49:08.368 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/cls_route.ko 2024-02-21T22:49:08.369 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/cls_u32.ko 2024-02-21T22:49:08.369 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/em_cmp.ko 2024-02-21T22:49:08.369 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/em_ipset.ko 2024-02-21T22:49:08.369 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/em_meta.ko 2024-02-21T22:49:08.369 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/em_nbyte.ko 2024-02-21T22:49:08.369 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/em_text.ko 2024-02-21T22:49:08.369 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/em_u32.ko 2024-02-21T22:49:08.369 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/sch_choke.ko 2024-02-21T22:49:08.369 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/sch_codel.ko 2024-02-21T22:49:08.369 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/sch_drr.ko 2024-02-21T22:49:08.369 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/sch_fq.ko 2024-02-21T22:49:08.369 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/sch_gred.ko 2024-02-21T22:49:08.369 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/sch_hfsc.ko 2024-02-21T22:49:08.369 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/sch_hhf.ko 2024-02-21T22:49:08.370 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/sch_htb.ko 2024-02-21T22:49:08.370 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/sch_ingress.ko 2024-02-21T22:49:08.370 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/sch_mqprio.ko 2024-02-21T22:49:08.370 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/sch_mqprio_lib.ko 2024-02-21T22:49:08.370 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/sch_multiq.ko 2024-02-21T22:49:08.370 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/sch_netem.ko 2024-02-21T22:49:08.370 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/sch_pie.ko 2024-02-21T22:49:08.370 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/sch_plug.ko 2024-02-21T22:49:08.370 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/sch_prio.ko 2024-02-21T22:49:08.370 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/sch_qfq.ko 2024-02-21T22:49:08.370 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/sch_red.ko 2024-02-21T22:49:08.370 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/sch_sfb.ko 2024-02-21T22:49:08.370 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/sch_sfq.ko 2024-02-21T22:49:08.370 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/sch_tbf.ko 2024-02-21T22:49:08.370 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sched/sch_teql.ko 2024-02-21T22:49:08.371 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sctp 2024-02-21T22:49:08.371 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sctp/sctp.ko 2024-02-21T22:49:08.371 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sctp/sctp_diag.ko 2024-02-21T22:49:08.371 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sunrpc 2024-02-21T22:49:08.371 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sunrpc/auth_gss 2024-02-21T22:49:08.371 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-02-21T22:49:08.371 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-02-21T22:49:08.371 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sunrpc/sunrpc.ko 2024-02-21T22:49:08.371 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sunrpc/xprtrdma 2024-02-21T22:49:08.371 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-02-21T22:49:08.371 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/tipc 2024-02-21T22:49:08.371 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/tipc/diag.ko 2024-02-21T22:49:08.371 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/tipc/tipc.ko 2024-02-21T22:49:08.371 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/unix 2024-02-21T22:49:08.372 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/unix/unix_diag.ko 2024-02-21T22:49:08.372 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/vmw_vsock 2024-02-21T22:49:08.372 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-02-21T22:49:08.372 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-02-21T22:49:08.372 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/vmw_vsock/vsock.ko 2024-02-21T22:49:08.372 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/vmw_vsock/vsock_diag.ko 2024-02-21T22:49:08.372 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/vmw_vsock/vsock_loopback.ko 2024-02-21T22:49:08.372 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/xfrm 2024-02-21T22:49:08.372 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/net/xfrm/xfrm_ipcomp.ko 2024-02-21T22:49:08.372 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/security 2024-02-21T22:49:08.372 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/security/keys 2024-02-21T22:49:08.372 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/security/keys/encrypted-keys 2024-02-21T22:49:08.372 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-02-21T22:49:08.373 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/security/keys/trusted-keys 2024-02-21T22:49:08.373 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/security/keys/trusted-keys/trusted.ko 2024-02-21T22:49:08.373 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/virt 2024-02-21T22:49:08.373 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/virt/lib 2024-02-21T22:49:08.373 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/kernel/virt/lib/irqbypass.ko 2024-02-21T22:49:08.373 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/modules.alias 2024-02-21T22:49:08.373 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/modules.alias.bin 2024-02-21T22:49:08.373 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/modules.builtin 2024-02-21T22:49:08.373 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/modules.builtin.alias.bin 2024-02-21T22:49:08.373 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/modules.builtin.bin 2024-02-21T22:49:08.373 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/modules.builtin.modinfo 2024-02-21T22:49:08.373 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/modules.dep 2024-02-21T22:49:08.373 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/modules.dep.bin 2024-02-21T22:49:08.373 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/modules.devname 2024-02-21T22:49:08.373 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/modules.order 2024-02-21T22:49:08.374 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/modules.softdep 2024-02-21T22:49:08.374 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/modules.symbols 2024-02-21T22:49:08.374 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/modules.symbols.bin 2024-02-21T22:49:08.374 INFO:teuthology.orchestra.run.smithi099.stdout:/lib/modules/6.8.0-rc4-g1130e0532280/vmlinuz 2024-02-21T22:49:08.378 DEBUG:teuthology.task.kernel:get_image_version: 6.8.0-rc4-g1130e0532280 2024-02-21T22:49:08.378 DEBUG:teuthology.orchestra.run.smithi099:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-02-21T22:49:08.402 INFO:teuthology.orchestra.run.smithi099.stdout:postinstall scriptlet (using /bin/sh): 2024-02-21T22:49:08.402 INFO:teuthology.orchestra.run.smithi099.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-02-21T22:49:08.402 INFO:teuthology.orchestra.run.smithi099.stdout: /usr/bin/kernel-install add 6.8.0-rc4-g1130e0532280 /lib/modules/6.8.0-rc4-g1130e0532280/vmlinuz 2024-02-21T22:49:08.402 INFO:teuthology.orchestra.run.smithi099.stdout:fi 2024-02-21T22:49:08.402 INFO:teuthology.orchestra.run.smithi099.stdout:for file in vmlinuz System.map config; do 2024-02-21T22:49:08.402 INFO:teuthology.orchestra.run.smithi099.stdout: if ! cmp --silent "/lib/modules/6.8.0-rc4-g1130e0532280/${file}" "/boot/${file}-6.8.0-rc4-g1130e0532280"; then 2024-02-21T22:49:08.402 INFO:teuthology.orchestra.run.smithi099.stdout: cp "/lib/modules/6.8.0-rc4-g1130e0532280/${file}" "/boot/${file}-6.8.0-rc4-g1130e0532280" 2024-02-21T22:49:08.403 INFO:teuthology.orchestra.run.smithi099.stdout: fi 2024-02-21T22:49:08.403 INFO:teuthology.orchestra.run.smithi099.stdout:done 2024-02-21T22:49:08.403 INFO:teuthology.orchestra.run.smithi099.stdout:preuninstall scriptlet (using /bin/sh): 2024-02-21T22:49:08.403 INFO:teuthology.orchestra.run.smithi099.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2024-02-21T22:49:08.403 INFO:teuthology.orchestra.run.smithi099.stdout:new-kernel-pkg --remove 6.8.0-rc4-g1130e0532280 --rminitrd --initrdfile=/boot/initramfs-6.8.0-rc4-g1130e0532280.img 2024-02-21T22:49:08.403 INFO:teuthology.orchestra.run.smithi099.stdout:elif [ -x /usr/bin/kernel-install ]; then 2024-02-21T22:49:08.403 INFO:teuthology.orchestra.run.smithi099.stdout:kernel-install remove 6.8.0-rc4-g1130e0532280 2024-02-21T22:49:08.403 INFO:teuthology.orchestra.run.smithi099.stdout:fi 2024-02-21T22:49:08.403 INFO:teuthology.orchestra.run.smithi099.stdout:postuninstall scriptlet (using /bin/sh): 2024-02-21T22:49:08.403 INFO:teuthology.orchestra.run.smithi099.stdout:if [ -x /sbin/update-bootloader ]; then 2024-02-21T22:49:08.403 INFO:teuthology.orchestra.run.smithi099.stdout:/sbin/update-bootloader --remove 6.8.0-rc4-g1130e0532280 2024-02-21T22:49:08.403 INFO:teuthology.orchestra.run.smithi099.stdout:fi 2024-02-21T22:49:08.404 DEBUG:teuthology.orchestra.run.smithi099:> sudo rpm -qi grub2-tools 2024-02-21T22:49:08.481 INFO:teuthology.orchestra.run.smithi099.stdout:Name : grub2-tools 2024-02-21T22:49:08.481 INFO:teuthology.orchestra.run.smithi099.stdout:Epoch : 1 2024-02-21T22:49:08.481 INFO:teuthology.orchestra.run.smithi099.stdout:Version : 2.06 2024-02-21T22:49:08.481 INFO:teuthology.orchestra.run.smithi099.stdout:Release : 68.el9 2024-02-21T22:49:08.481 INFO:teuthology.orchestra.run.smithi099.stdout:Architecture: x86_64 2024-02-21T22:49:08.482 INFO:teuthology.orchestra.run.smithi099.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-02-21T22:49:08.482 INFO:teuthology.orchestra.run.smithi099.stdout:Group : Unspecified 2024-02-21T22:49:08.482 INFO:teuthology.orchestra.run.smithi099.stdout:Size : 8264254 2024-02-21T22:49:08.482 INFO:teuthology.orchestra.run.smithi099.stdout:License : GPLv3+ 2024-02-21T22:49:08.482 INFO:teuthology.orchestra.run.smithi099.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-02-21T22:49:08.482 INFO:teuthology.orchestra.run.smithi099.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-02-21T22:49:08.482 INFO:teuthology.orchestra.run.smithi099.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-02-21T22:49:08.482 INFO:teuthology.orchestra.run.smithi099.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-02-21T22:49:08.482 INFO:teuthology.orchestra.run.smithi099.stdout:Packager : builder@centos.org 2024-02-21T22:49:08.482 INFO:teuthology.orchestra.run.smithi099.stdout:Vendor : CentOS 2024-02-21T22:49:08.482 INFO:teuthology.orchestra.run.smithi099.stdout:URL : http://www.gnu.org/software/grub/ 2024-02-21T22:49:08.482 INFO:teuthology.orchestra.run.smithi099.stdout:Summary : Support tools for GRUB. 2024-02-21T22:49:08.482 INFO:teuthology.orchestra.run.smithi099.stdout:Description : 2024-02-21T22:49:08.482 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T22:49:08.482 INFO:teuthology.orchestra.run.smithi099.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-02-21T22:49:08.483 INFO:teuthology.orchestra.run.smithi099.stdout:customizable bootloader with modular architecture. It supports a rich 2024-02-21T22:49:08.483 INFO:teuthology.orchestra.run.smithi099.stdout:variety of kernel formats, file systems, computer architectures and 2024-02-21T22:49:08.483 INFO:teuthology.orchestra.run.smithi099.stdout:hardware devices. 2024-02-21T22:49:08.483 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T22:49:08.483 INFO:teuthology.orchestra.run.smithi099.stdout:This subpackage provides tools for support of all platforms. 2024-02-21T22:49:08.484 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-02-21T22:49:08.484 INFO:teuthology.task.kernel:Updating grub on smithi099 to boot 6.8.0-rc4-g1130e0532280 2024-02-21T22:49:08.484 DEBUG:teuthology.orchestra.run.smithi099:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-02-21T22:49:09.076 INFO:teuthology.orchestra.run.smithi099.stderr:Generating grub configuration file ... 2024-02-21T22:49:10.414 INFO:teuthology.orchestra.run.smithi099.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-02-21T22:49:10.462 INFO:teuthology.orchestra.run.smithi099.stderr:done 2024-02-21T22:49:10.465 DEBUG:teuthology.orchestra.run.smithi099:> mktemp 2024-02-21T22:49:10.480 INFO:teuthology.orchestra.run.smithi099.stdout:/tmp/tmp.yeGyqMUg3d 2024-02-21T22:49:10.481 DEBUG:teuthology.orchestra.run.smithi099:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.yeGyqMUg3d 2024-02-21T22:49:10.560 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 0666 /tmp/tmp.yeGyqMUg3d 2024-02-21T22:49:10.703 DEBUG:teuthology.orchestra.remote:smithi099:/tmp/tmp.yeGyqMUg3d is 6KB 2024-02-21T22:49:10.751 DEBUG:teuthology.orchestra.run.smithi099:> rm -fr /tmp/tmp.yeGyqMUg3d 2024-02-21T22:49:10.766 DEBUG:teuthology.orchestra.run.smithi099:> sudo /bin/ls /boot/loader/entries || true 2024-02-21T22:49:10.830 INFO:teuthology.orchestra.run.smithi099.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-02-21T22:49:10.830 INFO:teuthology.orchestra.run.smithi099.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-02-21T22:49:10.830 INFO:teuthology.orchestra.run.smithi099.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-02-21T22:49:10.830 INFO:teuthology.orchestra.run.smithi099.stdout:15949e3c88704300882482eddfd7baae-6.8.0-rc4-g1130e0532280.conf 2024-02-21T22:49:10.831 DEBUG:teuthology.orchestra.run.smithi099:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.8.0-rc4-g1130e0532280 2024-02-21T22:49:10.972 DEBUG:teuthology.orchestra.run.smithi099:> sudo shutdown -r now 2024-02-21T22:49:40.975 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-02-21T22:49:40.976 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-02-21T22:49:40.977 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T22:49:59.356 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-02-21T22:50:08.357 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-02-21T22:50:08.358 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T22:50:11.424 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-02-21T22:50:23.425 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-02-21T22:50:23.426 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T22:50:26.492 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-02-21T22:50:41.493 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-02-21T22:50:41.494 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T22:50:44.572 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-02-21T22:51:02.573 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-02-21T22:51:02.574 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T22:51:03.048 DEBUG:teuthology.orchestra.run.smithi099:> true 2024-02-21T22:51:03.804 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-02-21T22:51:03.804 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.8.0-rc4-g1130e0532280"... 2024-02-21T22:51:03.804 DEBUG:teuthology.orchestra.run.smithi099:> uname -r 2024-02-21T22:51:03.848 INFO:teuthology.orchestra.run.smithi099.stdout:6.8.0-rc4-g1130e0532280 2024-02-21T22:51:03.848 DEBUG:teuthology.task.kernel:current kernel version is 6.8.0-rc4-g1130e0532280 vs 6.8.0-rc4-g1130e0532280 2024-02-21T22:51:03.848 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-21T22:51:03.849 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-02-21T22:51:04.849 DEBUG:teuthology.parallel:result is None 2024-02-21T22:51:04.850 INFO:teuthology.run_tasks:Running task internal.base... 2024-02-21T22:51:04.857 INFO:teuthology.task.internal:Creating test directory... 2024-02-21T22:51:04.857 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-21T22:51:04.866 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-21T22:51:04.869 DEBUG:teuthology.orchestra.run.smithi181:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-21T22:51:04.905 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-02-21T22:51:04.914 INFO:teuthology.run_tasks:Running task internal.archive... 2024-02-21T22:51:04.943 INFO:teuthology.task.internal:Creating archive directory... 2024-02-21T22:51:04.944 DEBUG:teuthology.orchestra.run.smithi099:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-21T22:51:04.955 DEBUG:teuthology.orchestra.run.smithi162:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-21T22:51:04.957 DEBUG:teuthology.orchestra.run.smithi181:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-21T22:51:05.012 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-02-21T22:51:05.019 INFO:teuthology.task.internal:Enabling coredump saving... 2024-02-21T22:51:05.019 DEBUG:teuthology.orchestra.run.smithi162:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-21T22:51:05.050 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-21T22:51:05.051 DEBUG:teuthology.orchestra.run.smithi181:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-21T22:51:05.068 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-21T22:51:05.069 DEBUG:teuthology.orchestra.run.smithi099:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-21T22:51:05.073 DEBUG:teuthology.orchestra.run.smithi162:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-21T22:51:05.093 DEBUG:teuthology.orchestra.run.smithi181:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-21T22:51:05.132 INFO:teuthology.orchestra.run.smithi162.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-21T22:51:05.148 INFO:teuthology.orchestra.run.smithi162.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-21T22:51:05.150 INFO:teuthology.orchestra.run.smithi181.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-21T22:51:05.168 INFO:teuthology.orchestra.run.smithi181.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-21T22:51:05.228 INFO:teuthology.orchestra.run.smithi099.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-21T22:51:05.308 INFO:teuthology.orchestra.run.smithi099.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-21T22:51:05.313 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-02-21T22:51:05.321 INFO:teuthology.task.internal:Configuring sudo... 2024-02-21T22:51:05.322 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-21T22:51:05.326 DEBUG:teuthology.orchestra.run.smithi162:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-21T22:51:05.328 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-21T22:51:05.393 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-02-21T22:51:05.403 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-02-21T22:51:05.404 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-21T22:51:05.407 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-21T22:51:05.410 DEBUG:teuthology.orchestra.run.smithi181:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-21T22:51:05.441 DEBUG:teuthology.orchestra.run.smithi099:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-21T22:51:05.554 DEBUG:teuthology.orchestra.run.smithi099:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-21T22:51:05.647 DEBUG:teuthology.orchestra.run.smithi099:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-21T22:51:05.712 DEBUG:teuthology.orchestra.run.smithi099:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-21T22:51:05.801 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-02-21T22:51:05.801 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-21T22:51:05.890 DEBUG:teuthology.orchestra.run.smithi162:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-21T22:51:05.935 DEBUG:teuthology.orchestra.run.smithi162:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-21T22:51:06.011 DEBUG:teuthology.orchestra.run.smithi162:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-21T22:51:06.054 DEBUG:teuthology.orchestra.run.smithi162:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-21T22:51:06.099 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-02-21T22:51:06.099 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-21T22:51:06.168 DEBUG:teuthology.orchestra.run.smithi181:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-21T22:51:06.213 DEBUG:teuthology.orchestra.run.smithi181:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-21T22:51:06.285 DEBUG:teuthology.orchestra.run.smithi181:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-21T22:51:06.328 DEBUG:teuthology.orchestra.run.smithi181:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-21T22:51:06.373 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-02-21T22:51:06.373 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-21T22:51:06.441 DEBUG:teuthology.orchestra.run.smithi099:> sudo service rsyslog restart 2024-02-21T22:51:06.446 DEBUG:teuthology.orchestra.run.smithi162:> sudo service rsyslog restart 2024-02-21T22:51:06.448 DEBUG:teuthology.orchestra.run.smithi181:> sudo service rsyslog restart 2024-02-21T22:51:06.488 INFO:teuthology.orchestra.run.smithi162.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-21T22:51:06.521 INFO:teuthology.orchestra.run.smithi181.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-21T22:51:06.553 INFO:teuthology.orchestra.run.smithi099.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-21T22:51:06.847 INFO:teuthology.run_tasks:Running task internal.timer... 2024-02-21T22:51:06.855 INFO:teuthology.task.internal:Starting timer... 2024-02-21T22:51:06.855 INFO:teuthology.run_tasks:Running task pcp... 2024-02-21T22:51:06.889 INFO:teuthology.run_tasks:Running task selinux... 2024-02-21T22:51:06.924 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-02-21T22:51:06.925 DEBUG:teuthology.orchestra.run.smithi099:> sudo service auditd rotate 2024-02-21T22:51:07.036 INFO:teuthology.orchestra.run.smithi099.stdout:Rotating logs: 2024-02-21T22:51:07.040 DEBUG:teuthology.orchestra.run.smithi162:> sudo service auditd rotate 2024-02-21T22:51:07.135 INFO:teuthology.orchestra.run.smithi162.stdout:Rotating logs: 2024-02-21T22:51:07.137 DEBUG:teuthology.orchestra.run.smithi181:> sudo service auditd rotate 2024-02-21T22:51:07.220 INFO:teuthology.orchestra.run.smithi181.stdout:Rotating logs: 2024-02-21T22:51:07.221 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-02-21T22:51:07.221 DEBUG:teuthology.orchestra.run.smithi099:> /usr/sbin/getenforce 2024-02-21T22:51:07.278 INFO:teuthology.orchestra.run.smithi099.stdout:Permissive 2024-02-21T22:51:07.278 DEBUG:teuthology.orchestra.run.smithi162:> /usr/sbin/getenforce 2024-02-21T22:51:07.302 INFO:teuthology.orchestra.run.smithi162.stdout:Permissive 2024-02-21T22:51:07.302 DEBUG:teuthology.orchestra.run.smithi181:> /usr/sbin/getenforce 2024-02-21T22:51:07.320 INFO:teuthology.orchestra.run.smithi181.stdout:Permissive 2024-02-21T22:51:07.320 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi099.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi162.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi181.front.sepia.ceph.com': 'permissive'} 2024-02-21T22:51:07.320 DEBUG:teuthology.orchestra.run.smithi099:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-21T22:51:07.402 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-21T22:51:07.402 DEBUG:teuthology.orchestra.run.smithi162:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-21T22:51:07.431 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-21T22:51:07.432 DEBUG:teuthology.orchestra.run.smithi181:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-21T22:51:07.460 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-21T22:51:07.461 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-02-21T22:51:07.461 DEBUG:teuthology.orchestra.run.smithi099:> sudo /usr/sbin/setenforce permissive 2024-02-21T22:51:07.550 DEBUG:teuthology.orchestra.run.smithi162:> sudo /usr/sbin/setenforce permissive 2024-02-21T22:51:07.587 DEBUG:teuthology.orchestra.run.smithi181:> sudo /usr/sbin/setenforce permissive 2024-02-21T22:51:07.622 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-02-21T22:51:07.633 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-02-21T22:51:07.650 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-02-21T22:51:07.652 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi099.front.sepia.ceph.com,smithi162.front.sepia.ceph.com,smithi181.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-02-21T22:57:19.690 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi099.front.sepia.ceph.com'), Remote(name='ubuntu@smithi162.front.sepia.ceph.com'), Remote(name='ubuntu@smithi181.front.sepia.ceph.com')] 2024-02-21T22:57:19.691 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-02-21T22:57:19.692 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T22:57:19.840 DEBUG:teuthology.orchestra.run.smithi099:> true 2024-02-21T22:57:19.995 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-02-21T22:57:19.995 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-02-21T22:57:19.996 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T22:57:20.083 DEBUG:teuthology.orchestra.run.smithi162:> true 2024-02-21T22:57:20.155 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-02-21T22:57:20.155 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-02-21T22:57:20.155 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T22:57:20.244 DEBUG:teuthology.orchestra.run.smithi181:> true 2024-02-21T22:57:20.312 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi181.front.sepia.ceph.com' 2024-02-21T22:57:20.313 INFO:teuthology.run_tasks:Running task clock... 2024-02-21T22:57:20.325 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-02-21T22:57:20.326 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-21T22:57:20.326 DEBUG:teuthology.orchestra.run.smithi099:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-21T22:57:20.334 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-21T22:57:20.334 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-21T22:57:20.336 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-21T22:57:20.336 DEBUG:teuthology.orchestra.run.smithi181:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-21T22:57:20.367 INFO:teuthology.orchestra.run.smithi162.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-02-21T22:57:20.382 INFO:teuthology.orchestra.run.smithi162.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-02-21T22:57:20.384 INFO:teuthology.orchestra.run.smithi181.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-02-21T22:57:20.402 INFO:teuthology.orchestra.run.smithi181.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-02-21T22:57:20.412 INFO:teuthology.orchestra.run.smithi162.stderr:sudo: ntpd: command not found 2024-02-21T22:57:20.425 INFO:teuthology.orchestra.run.smithi099.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-02-21T22:57:20.426 INFO:teuthology.orchestra.run.smithi162.stdout:506 Cannot talk to daemon 2024-02-21T22:57:20.433 INFO:teuthology.orchestra.run.smithi181.stderr:sudo: ntpd: command not found 2024-02-21T22:57:20.443 INFO:teuthology.orchestra.run.smithi162.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-02-21T22:57:20.447 INFO:teuthology.orchestra.run.smithi181.stdout:506 Cannot talk to daemon 2024-02-21T22:57:20.460 INFO:teuthology.orchestra.run.smithi162.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-02-21T22:57:20.465 INFO:teuthology.orchestra.run.smithi181.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-02-21T22:57:20.478 INFO:teuthology.orchestra.run.smithi099.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-02-21T22:57:20.483 INFO:teuthology.orchestra.run.smithi181.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-02-21T22:57:20.506 INFO:teuthology.orchestra.run.smithi162.stderr:bash: line 1: ntpq: command not found 2024-02-21T22:57:20.510 INFO:teuthology.orchestra.run.smithi162.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-21T22:57:20.510 INFO:teuthology.orchestra.run.smithi162.stdout:=============================================================================== 2024-02-21T22:57:20.511 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-21T22:57:20.511 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-21T22:57:20.511 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-21T22:57:20.511 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-21T22:57:20.527 INFO:teuthology.orchestra.run.smithi181.stderr:bash: line 1: ntpq: command not found 2024-02-21T22:57:20.531 INFO:teuthology.orchestra.run.smithi181.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-21T22:57:20.531 INFO:teuthology.orchestra.run.smithi181.stdout:=============================================================================== 2024-02-21T22:57:20.532 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-21T22:57:20.532 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-21T22:57:20.532 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-21T22:57:20.532 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-21T22:57:20.567 INFO:teuthology.orchestra.run.smithi099.stderr:sudo: ntpd: command not found 2024-02-21T22:57:20.611 INFO:teuthology.orchestra.run.smithi099.stdout:506 Cannot talk to daemon 2024-02-21T22:57:20.663 INFO:teuthology.orchestra.run.smithi099.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-02-21T22:57:20.715 INFO:teuthology.orchestra.run.smithi099.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-02-21T22:57:20.840 INFO:teuthology.orchestra.run.smithi099.stderr:bash: line 1: ntpq: command not found 2024-02-21T22:57:20.847 INFO:teuthology.orchestra.run.smithi099.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-21T22:57:20.847 INFO:teuthology.orchestra.run.smithi099.stdout:=============================================================================== 2024-02-21T22:57:20.847 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-21T22:57:20.847 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-21T22:57:20.847 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-21T22:57:20.848 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-21T22:57:20.849 INFO:teuthology.run_tasks:Running task install... 2024-02-21T22:57:20.857 DEBUG:teuthology.task.install:project ceph 2024-02-21T22:57:20.857 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '3bfc837d7b45ce8e095d92fa9c342964cea5e95f'}} 2024-02-21T22:57:20.857 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '3bfc837d7b45ce8e095d92fa9c342964cea5e95f'} 2024-02-21T22:57:20.858 INFO:teuthology.task.install:Using flavor: default 2024-02-21T22:57:20.863 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-02-21T22:57:20.864 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-02-21T22:57:20.864 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3bfc837d7b45ce8e095d92fa9c342964cea5e95f', 'tag': None, 'wait_for_package': False} 2024-02-21T22:57:20.865 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3bfc837d7b45ce8e095d92fa9c342964cea5e95f 2024-02-21T22:57:20.867 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3bfc837d7b45ce8e095d92fa9c342964cea5e95f', 'tag': None, 'wait_for_package': False} 2024-02-21T22:57:20.867 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3bfc837d7b45ce8e095d92fa9c342964cea5e95f 2024-02-21T22:57:20.868 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3bfc837d7b45ce8e095d92fa9c342964cea5e95f', 'tag': None, 'wait_for_package': False} 2024-02-21T22:57:20.868 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3bfc837d7b45ce8e095d92fa9c342964cea5e95f 2024-02-21T22:57:21.025 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-lusov-qdb/3bfc837d7b45ce8e095d92fa9c342964cea5e95f/centos/9/flavors/default/ 2024-02-21T22:57:21.025 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1643.g3bfc837d 2024-02-21T22:57:21.132 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-lusov-qdb/3bfc837d7b45ce8e095d92fa9c342964cea5e95f/centos/9/flavors/default/ 2024-02-21T22:57:21.132 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1643.g3bfc837d 2024-02-21T22:57:21.135 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-lusov-qdb/3bfc837d7b45ce8e095d92fa9c342964cea5e95f/centos/9/flavors/default/ 2024-02-21T22:57:21.135 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1643.g3bfc837d 2024-02-21T22:57:21.202 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-qdb/3bfc837d7b45ce8e095d92fa9c342964cea5e95f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-qdb/3bfc837d7b45ce8e095d92fa9c342964cea5e95f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-qdb/3bfc837d7b45ce8e095d92fa9c342964cea5e95f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-02-21T22:57:21.202 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-02-21T22:57:21.202 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-02-21T22:57:21.230 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-02-21T22:57:21.230 DEBUG:teuthology.orchestra.run.smithi162:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3bfc837d7b45ce8e095d92fa9c342964cea5e95f/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-02-21T22:57:21.242 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-qdb/3bfc837d7b45ce8e095d92fa9c342964cea5e95f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-qdb/3bfc837d7b45ce8e095d92fa9c342964cea5e95f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-qdb/3bfc837d7b45ce8e095d92fa9c342964cea5e95f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-02-21T22:57:21.242 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-02-21T22:57:21.242 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-02-21T22:57:21.270 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-02-21T22:57:21.271 DEBUG:teuthology.orchestra.run.smithi181:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3bfc837d7b45ce8e095d92fa9c342964cea5e95f/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-02-21T22:57:21.298 DEBUG:teuthology.orchestra.run.smithi162:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-02-21T22:57:21.306 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-qdb/3bfc837d7b45ce8e095d92fa9c342964cea5e95f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-qdb/3bfc837d7b45ce8e095d92fa9c342964cea5e95f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-qdb/3bfc837d7b45ce8e095d92fa9c342964cea5e95f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-02-21T22:57:21.307 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-02-21T22:57:21.307 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-02-21T22:57:21.338 DEBUG:teuthology.orchestra.run.smithi181:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-02-21T22:57:21.378 DEBUG:teuthology.orchestra.run.smithi162:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-02-21T22:57:21.394 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-02-21T22:57:21.394 DEBUG:teuthology.orchestra.run.smithi099:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3bfc837d7b45ce8e095d92fa9c342964cea5e95f/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-02-21T22:57:21.416 DEBUG:teuthology.orchestra.run.smithi181:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-02-21T22:57:21.444 INFO:teuthology.orchestra.run.smithi162.stdout:check_obsoletes = 1 2024-02-21T22:57:21.446 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum clean all 2024-02-21T22:57:21.482 INFO:teuthology.orchestra.run.smithi181.stdout:check_obsoletes = 1 2024-02-21T22:57:21.483 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum clean all 2024-02-21T22:57:21.518 DEBUG:teuthology.orchestra.run.smithi099:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-02-21T22:57:21.638 DEBUG:teuthology.orchestra.run.smithi099:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-02-21T22:57:21.683 INFO:teuthology.orchestra.run.smithi162.stdout:74 files removed 2024-02-21T22:57:21.710 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-02-21T22:57:21.717 INFO:teuthology.orchestra.run.smithi181.stdout:74 files removed 2024-02-21T22:57:21.719 INFO:teuthology.orchestra.run.smithi099.stdout:check_obsoletes = 1 2024-02-21T22:57:21.723 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum clean all 2024-02-21T22:57:21.743 DEBUG:teuthology.orchestra.run.smithi181:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-02-21T22:57:22.068 INFO:teuthology.orchestra.run.smithi099.stdout:74 files removed 2024-02-21T22:57:22.105 DEBUG:teuthology.orchestra.run.smithi099:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-02-21T22:57:22.362 INFO:teuthology.orchestra.run.smithi162.stdout:ceph packages for x86_64 231 kB/s | 83 kB 00:00 2024-02-21T22:57:22.416 INFO:teuthology.orchestra.run.smithi181.stdout:ceph packages for x86_64 217 kB/s | 83 kB 00:00 2024-02-21T22:57:22.721 INFO:teuthology.orchestra.run.smithi162.stdout:ceph noarch packages 31 kB/s | 10 kB 00:00 2024-02-21T22:57:22.834 INFO:teuthology.orchestra.run.smithi181.stdout:ceph noarch packages 27 kB/s | 10 kB 00:00 2024-02-21T22:57:23.092 INFO:teuthology.orchestra.run.smithi099.stdout:ceph packages for x86_64 173 kB/s | 83 kB 00:00 2024-02-21T22:57:23.113 INFO:teuthology.orchestra.run.smithi162.stdout:ceph source packages 5.2 kB/s | 1.9 kB 00:00 2024-02-21T22:57:23.234 INFO:teuthology.orchestra.run.smithi181.stdout:ceph source packages 5.1 kB/s | 1.9 kB 00:00 2024-02-21T22:57:23.541 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS-9 - AppStream 20 MB/s | 8.1 MB 00:00 2024-02-21T22:57:23.659 INFO:teuthology.orchestra.run.smithi099.stdout:ceph noarch packages 21 kB/s | 10 kB 00:00 2024-02-21T22:57:23.687 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS-9 - AppStream 19 MB/s | 8.1 MB 00:00 2024-02-21T22:57:24.210 INFO:teuthology.orchestra.run.smithi099.stdout:ceph source packages 4.0 kB/s | 1.9 kB 00:00 2024-02-21T22:57:24.855 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS-9 - AppStream 14 MB/s | 8.1 MB 00:00 2024-02-21T22:57:25.150 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS-9 - BaseOS 8.3 MB/s | 2.5 MB 00:00 2024-02-21T22:57:25.320 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS-9 - BaseOS 8.3 MB/s | 2.5 MB 00:00 2024-02-21T22:57:26.706 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS-9 - BaseOS 7.4 MB/s | 2.5 MB 00:00 2024-02-21T22:57:28.235 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - BaseOS 7.6 MB/s | 8.0 MB 00:01 2024-02-21T22:57:30.286 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - AppStream 25 MB/s | 19 MB 00:00 2024-02-21T22:57:34.972 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - BaseOS 871 kB/s | 8.0 MB 00:09 2024-02-21T22:57:35.137 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - CRB 6.5 MB/s | 6.1 MB 00:00 2024-02-21T22:57:36.763 INFO:teuthology.orchestra.run.smithi099.stdout:CentOS Stream 9 - Extras packages 55 kB/s | 15 kB 00:00 2024-02-21T22:57:36.830 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - AppStream 26 MB/s | 19 MB 00:00 2024-02-21T22:57:37.765 INFO:teuthology.orchestra.run.smithi099.stdout:Extra Packages for Enterprise Linux 26 MB/s | 20 MB 00:00 2024-02-21T22:57:41.275 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - CRB 7.3 MB/s | 6.1 MB 00:00 2024-02-21T22:57:42.856 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - Extras packages 43 kB/s | 15 kB 00:00 2024-02-21T22:57:43.565 INFO:teuthology.orchestra.run.smithi099.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-02-21T22:57:44.158 INFO:teuthology.orchestra.run.smithi162.stdout:Extra Packages for Enterprise Linux 18 MB/s | 20 MB 00:01 2024-02-21T22:57:44.884 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - BaseOS 427 kB/s | 8.0 MB 00:19 2024-02-21T22:57:46.239 INFO:teuthology.orchestra.run.smithi099.stderr:Modular dependency problems: 2024-02-21T22:57:46.240 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-02-21T22:57:46.240 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 1: conflicting requests 2024-02-21T22:57:46.240 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240219154654:20125149.x86_64 from CentOS-AppStream 2024-02-21T22:57:46.240 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 2: conflicting requests 2024-02-21T22:57:46.241 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-21T22:57:46.241 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 3: conflicting requests 2024-02-21T22:57:46.241 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-21T22:57:46.241 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 4: conflicting requests 2024-02-21T22:57:46.241 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-21T22:57:46.241 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 5: conflicting requests 2024-02-21T22:57:46.241 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-21T22:57:46.242 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 6: conflicting requests 2024-02-21T22:57:46.242 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-21T22:57:46.242 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 7: conflicting requests 2024-02-21T22:57:46.242 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-21T22:57:46.242 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 8: conflicting requests 2024-02-21T22:57:46.242 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-21T22:57:46.242 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 9: conflicting requests 2024-02-21T22:57:46.242 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-21T22:57:46.243 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 10: conflicting requests 2024-02-21T22:57:46.243 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-21T22:57:46.243 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 11: conflicting requests 2024-02-21T22:57:46.243 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-21T22:57:46.243 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 12: conflicting requests 2024-02-21T22:57:46.243 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-21T22:57:46.243 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 13: conflicting requests 2024-02-21T22:57:46.244 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-21T22:57:46.244 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 14: conflicting requests 2024-02-21T22:57:46.244 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-21T22:57:46.244 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 15: conflicting requests 2024-02-21T22:57:46.244 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-21T22:57:46.244 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 16: conflicting requests 2024-02-21T22:57:46.245 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-21T22:57:46.245 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 17: conflicting requests 2024-02-21T22:57:46.245 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-21T22:57:46.245 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 18: conflicting requests 2024-02-21T22:57:46.245 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-21T22:57:46.245 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 19: conflicting requests 2024-02-21T22:57:46.246 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-21T22:57:46.246 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 20: conflicting requests 2024-02-21T22:57:46.246 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-21T22:57:46.246 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 21: conflicting requests 2024-02-21T22:57:46.246 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-21T22:57:46.246 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 22: conflicting requests 2024-02-21T22:57:46.246 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-21T22:57:46.246 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 23: conflicting requests 2024-02-21T22:57:46.247 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-21T22:57:46.247 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 24: conflicting requests 2024-02-21T22:57:46.247 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-21T22:57:46.247 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 25: conflicting requests 2024-02-21T22:57:46.247 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-21T22:57:46.247 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 26: conflicting requests 2024-02-21T22:57:46.247 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-21T22:57:46.247 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 27: conflicting requests 2024-02-21T22:57:46.247 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-21T22:57:46.247 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 28: conflicting requests 2024-02-21T22:57:46.247 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-21T22:57:46.247 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 29: conflicting requests 2024-02-21T22:57:46.247 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-21T22:57:46.248 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 30: conflicting requests 2024-02-21T22:57:46.248 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-21T22:57:46.248 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 31: conflicting requests 2024-02-21T22:57:46.248 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-21T22:57:46.248 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 32: conflicting requests 2024-02-21T22:57:46.248 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-21T22:57:46.248 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 33: conflicting requests 2024-02-21T22:57:46.248 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-21T22:57:46.248 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 34: conflicting requests 2024-02-21T22:57:46.248 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-21T22:57:46.248 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 35: conflicting requests 2024-02-21T22:57:46.248 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-21T22:57:46.249 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 36: conflicting requests 2024-02-21T22:57:46.249 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-21T22:57:46.249 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-21T22:57:46.249 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-21T22:57:46.249 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 37: cannot install the best candidate for the job 2024-02-21T22:57:46.249 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-21T22:57:46.249 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-21T22:57:46.249 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-21T22:57:46.249 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-21T22:57:46.249 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 38: conflicting requests 2024-02-21T22:57:46.249 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-21T22:57:46.250 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-21T22:57:46.250 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-21T22:57:46.250 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-21T22:57:46.250 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-21T22:57:46.250 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-21T22:57:46.250 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 39: cannot install the best candidate for the job 2024-02-21T22:57:46.250 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-21T22:57:46.250 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-21T22:57:46.250 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-21T22:57:46.250 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-21T22:57:46.250 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 40: cannot install the best candidate for the job 2024-02-21T22:57:46.250 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-21T22:57:46.251 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-21T22:57:46.251 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-21T22:57:46.251 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-21T22:57:46.251 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 41: cannot install the best candidate for the job 2024-02-21T22:57:46.251 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-21T22:57:46.251 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-21T22:57:46.251 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-21T22:57:46.251 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-21T22:57:46.251 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 42: cannot install the best candidate for the job 2024-02-21T22:57:46.251 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-21T22:57:46.251 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-21T22:57:46.251 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-21T22:57:46.252 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-21T22:57:46.252 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 43: cannot install the best candidate for the job 2024-02-21T22:57:46.252 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-21T22:57:46.252 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-21T22:57:46.252 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-21T22:57:46.252 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-21T22:57:46.252 INFO:teuthology.orchestra.run.smithi099.stderr: Problem 44: cannot install the best candidate for the job 2024-02-21T22:57:46.252 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-21T22:57:46.252 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-21T22:57:46.252 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-21T22:57:46.252 INFO:teuthology.orchestra.run.smithi099.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-21T22:57:46.793 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - AppStream 24 MB/s | 19 MB 00:00 2024-02-21T22:57:46.871 INFO:teuthology.orchestra.run.smithi099.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-02-21T22:57:46.873 INFO:teuthology.orchestra.run.smithi099.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-02-21T22:57:46.895 INFO:teuthology.orchestra.run.smithi099.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-02-21T22:57:46.897 INFO:teuthology.orchestra.run.smithi099.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-02-21T22:57:46.898 INFO:teuthology.orchestra.run.smithi099.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-02-21T22:57:46.899 INFO:teuthology.orchestra.run.smithi099.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-02-21T22:57:46.902 INFO:teuthology.orchestra.run.smithi099.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-02-21T22:57:46.906 INFO:teuthology.orchestra.run.smithi099.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-02-21T22:57:46.907 INFO:teuthology.orchestra.run.smithi099.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-02-21T22:57:47.004 INFO:teuthology.orchestra.run.smithi099.stdout:Dependencies resolved. 2024-02-21T22:57:47.023 INFO:teuthology.orchestra.run.smithi099.stdout:========================================================================================= 2024-02-21T22:57:47.023 INFO:teuthology.orchestra.run.smithi099.stdout: Package Arch Version Repository Size 2024-02-21T22:57:47.023 INFO:teuthology.orchestra.run.smithi099.stdout:========================================================================================= 2024-02-21T22:57:47.023 INFO:teuthology.orchestra.run.smithi099.stdout:Installing: 2024-02-21T22:57:47.023 INFO:teuthology.orchestra.run.smithi099.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-02-21T22:57:47.023 INFO:teuthology.orchestra.run.smithi099.stdout: ceph x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 6.6 k 2024-02-21T22:57:47.023 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-base x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 5.3 M 2024-02-21T22:57:47.023 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-fuse x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 889 k 2024-02-21T22:57:47.024 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 145 k 2024-02-21T22:57:47.024 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 1.5 M 2024-02-21T22:57:47.024 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1643.g3bfc837d.el9 ceph-noarch 138 k 2024-02-21T22:57:47.024 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1643.g3bfc837d.el9 ceph-noarch 1.8 M 2024-02-21T22:57:47.024 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1643.g3bfc837d.el9 ceph-noarch 7.4 M 2024-02-21T22:57:47.024 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-rook noarch 2:19.0.0-1643.g3bfc837d.el9 ceph-noarch 49 k 2024-02-21T22:57:47.024 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-radosgw x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 9.8 M 2024-02-21T22:57:47.024 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-test x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 47 M 2024-02-21T22:57:47.024 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-volume noarch 2:19.0.0-1643.g3bfc837d.el9 ceph-noarch 264 k 2024-02-21T22:57:47.024 INFO:teuthology.orchestra.run.smithi099.stdout: cephadm noarch 2:19.0.0-1643.g3bfc837d.el9 ceph-noarch 748 k 2024-02-21T22:57:47.024 INFO:teuthology.orchestra.run.smithi099.stdout: cephfs-mirror x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 220 k 2024-02-21T22:57:47.024 INFO:teuthology.orchestra.run.smithi099.stdout: cephfs-shell x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 27 k 2024-02-21T22:57:47.025 INFO:teuthology.orchestra.run.smithi099.stdout: cephfs-top noarch 2:19.0.0-1643.g3bfc837d.el9 ceph-noarch 18 k 2024-02-21T22:57:47.025 INFO:teuthology.orchestra.run.smithi099.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-02-21T22:57:47.025 INFO:teuthology.orchestra.run.smithi099.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-02-21T22:57:47.025 INFO:teuthology.orchestra.run.smithi099.stdout: libaio-devel x86_64 0.3.112-1.el8 CentOS-BaseOS 18 k 2024-02-21T22:57:47.025 INFO:teuthology.orchestra.run.smithi099.stdout: libcephfs-devel x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 31 k 2024-02-21T22:57:47.025 INFO:teuthology.orchestra.run.smithi099.stdout: libcephfs2 x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 745 k 2024-02-21T22:57:47.025 INFO:teuthology.orchestra.run.smithi099.stdout: librados-devel x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 127 k 2024-02-21T22:57:47.025 INFO:teuthology.orchestra.run.smithi099.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-02-21T22:57:47.025 INFO:teuthology.orchestra.run.smithi099.stdout: libuuid-devel x86_64 2.37.4-15.el9 appstream 26 k 2024-02-21T22:57:47.025 INFO:teuthology.orchestra.run.smithi099.stdout: openssl-devel x86_64 1:3.0.7-25.el9 appstream 4.1 M 2024-02-21T22:57:47.025 INFO:teuthology.orchestra.run.smithi099.stdout: postgresql x86_64 13.11-1.el9 appstream 1.6 M 2024-02-21T22:57:47.025 INFO:teuthology.orchestra.run.smithi099.stdout: postgresql-contrib x86_64 13.11-1.el9 appstream 905 k 2024-02-21T22:57:47.025 INFO:teuthology.orchestra.run.smithi099.stdout: postgresql-server x86_64 13.11-1.el9 appstream 5.7 M 2024-02-21T22:57:47.026 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cephfs x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 161 k 2024-02-21T22:57:47.026 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rados x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 321 k 2024-02-21T22:57:47.026 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rbd x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 298 k 2024-02-21T22:57:47.026 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rgw x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 100 k 2024-02-21T22:57:47.026 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-fuse x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 85 k 2024-02-21T22:57:47.026 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-mirror x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 3.1 M 2024-02-21T22:57:47.026 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-nbd x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 170 k 2024-02-21T22:57:47.026 INFO:teuthology.orchestra.run.smithi099.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-02-21T22:57:47.026 INFO:teuthology.orchestra.run.smithi099.stdout:Upgrading: 2024-02-21T22:57:47.026 INFO:teuthology.orchestra.run.smithi099.stdout: NetworkManager x86_64 1:1.45.91-1.el9 baseos 2.3 M 2024-02-21T22:57:47.026 INFO:teuthology.orchestra.run.smithi099.stdout: NetworkManager-libnm x86_64 1:1.45.91-1.el9 baseos 1.8 M 2024-02-21T22:57:47.026 INFO:teuthology.orchestra.run.smithi099.stdout: NetworkManager-team x86_64 1:1.45.91-1.el9 baseos 42 k 2024-02-21T22:57:47.026 INFO:teuthology.orchestra.run.smithi099.stdout: NetworkManager-tui x86_64 1:1.45.91-1.el9 baseos 247 k 2024-02-21T22:57:47.027 INFO:teuthology.orchestra.run.smithi099.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-02-21T22:57:47.027 INFO:teuthology.orchestra.run.smithi099.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-02-21T22:57:47.027 INFO:teuthology.orchestra.run.smithi099.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-02-21T22:57:47.027 INFO:teuthology.orchestra.run.smithi099.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-02-21T22:57:47.027 INFO:teuthology.orchestra.run.smithi099.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-02-21T22:57:47.027 INFO:teuthology.orchestra.run.smithi099.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-02-21T22:57:47.027 INFO:teuthology.orchestra.run.smithi099.stdout: librados2 x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 3.4 M 2024-02-21T22:57:47.027 INFO:teuthology.orchestra.run.smithi099.stdout: librbd1 x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 3.1 M 2024-02-21T22:57:47.027 INFO:teuthology.orchestra.run.smithi099.stdout: openssl x86_64 1:3.0.7-25.el9 baseos 1.2 M 2024-02-21T22:57:47.027 INFO:teuthology.orchestra.run.smithi099.stdout: openssl-libs x86_64 1:3.0.7-25.el9 baseos 2.2 M 2024-02-21T22:57:47.027 INFO:teuthology.orchestra.run.smithi099.stdout: xfsdump x86_64 3.1.12-4.el9 baseos 323 k 2024-02-21T22:57:47.027 INFO:teuthology.orchestra.run.smithi099.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-02-21T22:57:47.027 INFO:teuthology.orchestra.run.smithi099.stdout:Installing dependencies: 2024-02-21T22:57:47.028 INFO:teuthology.orchestra.run.smithi099.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-02-21T22:57:47.028 INFO:teuthology.orchestra.run.smithi099.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-02-21T22:57:47.028 INFO:teuthology.orchestra.run.smithi099.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-02-21T22:57:47.028 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-common x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 20 M 2024-02-21T22:57:47.028 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1643.g3bfc837d.el9 ceph-noarch 31 k 2024-02-21T22:57:47.028 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mds x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 2.3 M 2024-02-21T22:57:47.028 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1643.g3bfc837d.el9 ceph-noarch 248 k 2024-02-21T22:57:47.028 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mon x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 4.7 M 2024-02-21T22:57:47.028 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-osd x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 17 M 2024-02-21T22:57:47.028 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1643.g3bfc837d.el9 ceph-noarch 15 k 2024-02-21T22:57:47.028 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-selinux x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 25 k 2024-02-21T22:57:47.028 INFO:teuthology.orchestra.run.smithi099.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-02-21T22:57:47.028 INFO:teuthology.orchestra.run.smithi099.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-02-21T22:57:47.029 INFO:teuthology.orchestra.run.smithi099.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-02-21T22:57:47.029 INFO:teuthology.orchestra.run.smithi099.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-02-21T22:57:47.029 INFO:teuthology.orchestra.run.smithi099.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-02-21T22:57:47.029 INFO:teuthology.orchestra.run.smithi099.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-02-21T22:57:47.029 INFO:teuthology.orchestra.run.smithi099.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-02-21T22:57:47.029 INFO:teuthology.orchestra.run.smithi099.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-02-21T22:57:47.029 INFO:teuthology.orchestra.run.smithi099.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-02-21T22:57:47.029 INFO:teuthology.orchestra.run.smithi099.stdout: libcephsqlite x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 163 k 2024-02-21T22:57:47.030 INFO:teuthology.orchestra.run.smithi099.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-02-21T22:57:47.030 INFO:teuthology.orchestra.run.smithi099.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-02-21T22:57:47.030 INFO:teuthology.orchestra.run.smithi099.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-02-21T22:57:47.030 INFO:teuthology.orchestra.run.smithi099.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-02-21T22:57:47.030 INFO:teuthology.orchestra.run.smithi099.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-02-21T22:57:47.030 INFO:teuthology.orchestra.run.smithi099.stdout: libradosstriper1 x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 502 k 2024-02-21T22:57:47.030 INFO:teuthology.orchestra.run.smithi099.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-02-21T22:57:47.031 INFO:teuthology.orchestra.run.smithi099.stdout: librgw2 x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 5.1 M 2024-02-21T22:57:47.031 INFO:teuthology.orchestra.run.smithi099.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-02-21T22:57:47.031 INFO:teuthology.orchestra.run.smithi099.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-02-21T22:57:47.031 INFO:teuthology.orchestra.run.smithi099.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-02-21T22:57:47.031 INFO:teuthology.orchestra.run.smithi099.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-02-21T22:57:47.031 INFO:teuthology.orchestra.run.smithi099.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-02-21T22:57:47.031 INFO:teuthology.orchestra.run.smithi099.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-02-21T22:57:47.031 INFO:teuthology.orchestra.run.smithi099.stdout: oniguruma x86_64 6.9.6-1.el9.5 baseos 218 k 2024-02-21T22:57:47.031 INFO:teuthology.orchestra.run.smithi099.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-02-21T22:57:47.031 INFO:teuthology.orchestra.run.smithi099.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-02-21T22:57:47.031 INFO:teuthology.orchestra.run.smithi099.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-02-21T22:57:47.031 INFO:teuthology.orchestra.run.smithi099.stdout: postgresql-private-libs x86_64 13.11-1.el9 appstream 135 k 2024-02-21T22:57:47.032 INFO:teuthology.orchestra.run.smithi099.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-02-21T22:57:47.032 INFO:teuthology.orchestra.run.smithi099.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-02-21T22:57:47.032 INFO:teuthology.orchestra.run.smithi099.stdout: python3-asyncssh noarch 2.13.2-4.el9 epel 548 k 2024-02-21T22:57:47.032 INFO:teuthology.orchestra.run.smithi099.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-02-21T22:57:47.032 INFO:teuthology.orchestra.run.smithi099.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-02-21T22:57:47.032 INFO:teuthology.orchestra.run.smithi099.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-02-21T22:57:47.032 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-02-21T22:57:47.032 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ceph-argparse x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 45 k 2024-02-21T22:57:47.033 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ceph-common x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 131 k 2024-02-21T22:57:47.033 INFO:teuthology.orchestra.run.smithi099.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-02-21T22:57:47.033 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-02-21T22:57:47.033 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-02-21T22:57:47.033 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-02-21T22:57:47.033 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-02-21T22:57:47.033 INFO:teuthology.orchestra.run.smithi099.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-02-21T22:57:47.033 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-02-21T22:57:47.033 INFO:teuthology.orchestra.run.smithi099.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-02-21T22:57:47.033 INFO:teuthology.orchestra.run.smithi099.stdout: python3-google-auth noarch 1:2.27.0-1.el9 epel 203 k 2024-02-21T22:57:47.033 INFO:teuthology.orchestra.run.smithi099.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-02-21T22:57:47.033 INFO:teuthology.orchestra.run.smithi099.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-02-21T22:57:47.033 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-02-21T22:57:47.034 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-02-21T22:57:47.034 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-02-21T22:57:47.034 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-02-21T22:57:47.034 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-02-21T22:57:47.034 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-02-21T22:57:47.034 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-02-21T22:57:47.034 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-02-21T22:57:47.034 INFO:teuthology.orchestra.run.smithi099.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-02-21T22:57:47.034 INFO:teuthology.orchestra.run.smithi099.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-02-21T22:57:47.034 INFO:teuthology.orchestra.run.smithi099.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-02-21T22:57:47.034 INFO:teuthology.orchestra.run.smithi099.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-02-21T22:57:47.034 INFO:teuthology.orchestra.run.smithi099.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-02-21T22:57:47.034 INFO:teuthology.orchestra.run.smithi099.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-02-21T22:57:47.034 INFO:teuthology.orchestra.run.smithi099.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-02-21T22:57:47.035 INFO:teuthology.orchestra.run.smithi099.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-02-21T22:57:47.035 INFO:teuthology.orchestra.run.smithi099.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-02-21T22:57:47.035 INFO:teuthology.orchestra.run.smithi099.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-02-21T22:57:47.035 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-02-21T22:57:47.035 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-02-21T22:57:47.035 INFO:teuthology.orchestra.run.smithi099.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-02-21T22:57:47.035 INFO:teuthology.orchestra.run.smithi099.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-02-21T22:57:47.035 INFO:teuthology.orchestra.run.smithi099.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-02-21T22:57:47.035 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-02-21T22:57:47.035 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-02-21T22:57:47.035 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-02-21T22:57:47.035 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-02-21T22:57:47.035 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-02-21T22:57:47.035 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-02-21T22:57:47.036 INFO:teuthology.orchestra.run.smithi099.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-02-21T22:57:47.036 INFO:teuthology.orchestra.run.smithi099.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-02-21T22:57:47.036 INFO:teuthology.orchestra.run.smithi099.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-02-21T22:57:47.036 INFO:teuthology.orchestra.run.smithi099.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-02-21T22:57:47.036 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-02-21T22:57:47.036 INFO:teuthology.orchestra.run.smithi099.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-02-21T22:57:47.036 INFO:teuthology.orchestra.run.smithi099.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-02-21T22:57:47.036 INFO:teuthology.orchestra.run.smithi099.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-02-21T22:57:47.036 INFO:teuthology.orchestra.run.smithi099.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-02-21T22:57:47.036 INFO:teuthology.orchestra.run.smithi099.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-02-21T22:57:47.036 INFO:teuthology.orchestra.run.smithi099.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-02-21T22:57:47.037 INFO:teuthology.orchestra.run.smithi099.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-02-21T22:57:47.037 INFO:teuthology.orchestra.run.smithi099.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-02-21T22:57:47.037 INFO:teuthology.orchestra.run.smithi099.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-02-21T22:57:47.037 INFO:teuthology.orchestra.run.smithi099.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-02-21T22:57:47.037 INFO:teuthology.orchestra.run.smithi099.stdout: qatlib x86_64 23.11.0-1.el9 appstream 216 k 2024-02-21T22:57:47.037 INFO:teuthology.orchestra.run.smithi099.stdout: qatzip-libs x86_64 1.1.2-2.el9 appstream 44 k 2024-02-21T22:57:47.038 INFO:teuthology.orchestra.run.smithi099.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-02-21T22:57:47.038 INFO:teuthology.orchestra.run.smithi099.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-02-21T22:57:47.038 INFO:teuthology.orchestra.run.smithi099.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-02-21T22:57:47.038 INFO:teuthology.orchestra.run.smithi099.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-02-21T22:57:47.038 INFO:teuthology.orchestra.run.smithi099.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-02-21T22:57:47.038 INFO:teuthology.orchestra.run.smithi099.stdout: zlib-devel x86_64 1.2.11-40.el9 appstream 45 k 2024-02-21T22:57:47.038 INFO:teuthology.orchestra.run.smithi099.stdout:Installing weak dependencies: 2024-02-21T22:57:47.039 INFO:teuthology.orchestra.run.smithi099.stdout: qatlib-service x86_64 23.11.0-1.el9 appstream 35 k 2024-02-21T22:57:47.039 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T22:57:47.039 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction Summary 2024-02-21T22:57:47.039 INFO:teuthology.orchestra.run.smithi099.stdout:========================================================================================= 2024-02-21T22:57:47.039 INFO:teuthology.orchestra.run.smithi099.stdout:Install 150 Packages 2024-02-21T22:57:47.039 INFO:teuthology.orchestra.run.smithi099.stdout:Upgrade 16 Packages 2024-02-21T22:57:47.040 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T22:57:47.041 INFO:teuthology.orchestra.run.smithi099.stdout:Total download size: 222 M 2024-02-21T22:57:47.041 INFO:teuthology.orchestra.run.smithi099.stdout:Downloading Packages: 2024-02-21T22:57:47.732 INFO:teuthology.orchestra.run.smithi099.stdout:(1/166): ceph-19.0.0-1643.g3bfc837d.el9.x86_64. 28 kB/s | 6.6 kB 00:00 2024-02-21T22:57:47.974 INFO:teuthology.orchestra.run.smithi099.stdout:(2/166): ceph-fuse-19.0.0-1643.g3bfc837d.el9.x8 3.6 MB/s | 889 kB 00:00 2024-02-21T22:57:48.058 INFO:teuthology.orchestra.run.smithi099.stdout:(3/166): ceph-immutable-object-cache-19.0.0-164 1.7 MB/s | 145 kB 00:00 2024-02-21T22:57:48.325 INFO:teuthology.orchestra.run.smithi099.stdout:(4/166): ceph-base-19.0.0-1643.g3bfc837d.el9.x8 6.5 MB/s | 5.3 MB 00:00 2024-02-21T22:57:48.508 INFO:teuthology.orchestra.run.smithi099.stdout:(5/166): ceph-mds-19.0.0-1643.g3bfc837d.el9.x86 5.1 MB/s | 2.3 MB 00:00 2024-02-21T22:57:48.584 INFO:teuthology.orchestra.run.smithi099.stdout:(6/166): ceph-mgr-19.0.0-1643.g3bfc837d.el9.x86 5.8 MB/s | 1.5 MB 00:00 2024-02-21T22:57:49.324 INFO:teuthology.orchestra.run.smithi162.stdout:lab-extras 16 kB/s | 1.7 kB 00:00 2024-02-21T22:57:49.476 INFO:teuthology.orchestra.run.smithi099.stdout:(7/166): ceph-common-19.0.0-1643.g3bfc837d.el9. 10 MB/s | 20 MB 00:01 2024-02-21T22:57:49.618 INFO:teuthology.orchestra.run.smithi099.stdout:(8/166): ceph-mon-19.0.0-1643.g3bfc837d.el9.x86 4.2 MB/s | 4.7 MB 00:01 2024-02-21T22:57:49.676 INFO:teuthology.orchestra.run.smithi099.stdout:(9/166): ceph-selinux-19.0.0-1643.g3bfc837d.el9 438 kB/s | 25 kB 00:00 2024-02-21T22:57:50.352 INFO:teuthology.orchestra.run.smithi099.stdout:(10/166): ceph-radosgw-19.0.0-1643.g3bfc837d.el 11 MB/s | 9.8 MB 00:00 2024-02-21T22:57:50.410 INFO:teuthology.orchestra.run.smithi099.stdout:(11/166): cephfs-mirror-19.0.0-1643.g3bfc837d.e 3.8 MB/s | 220 kB 00:00 2024-02-21T22:57:50.660 INFO:teuthology.orchestra.run.smithi099.stdout:(12/166): ceph-osd-19.0.0-1643.g3bfc837d.el9.x8 8.1 MB/s | 17 MB 00:02 2024-02-21T22:57:50.686 INFO:teuthology.orchestra.run.smithi099.stdout:(13/166): cephfs-shell-19.0.0-1643.g3bfc837d.el 98 kB/s | 27 kB 00:00 2024-02-21T22:57:50.711 INFO:teuthology.orchestra.run.smithi099.stdout:(14/166): libcephfs-devel-19.0.0-1643.g3bfc837d 631 kB/s | 31 kB 00:00 2024-02-21T22:57:50.778 INFO:teuthology.orchestra.run.smithi099.stdout:(15/166): libcephsqlite-19.0.0-1643.g3bfc837d.e 2.4 MB/s | 163 kB 00:00 2024-02-21T22:57:50.820 INFO:teuthology.orchestra.run.smithi099.stdout:(16/166): libcephfs2-19.0.0-1643.g3bfc837d.el9. 5.5 MB/s | 745 kB 00:00 2024-02-21T22:57:50.854 INFO:teuthology.orchestra.run.smithi099.stdout:(17/166): librados-devel-19.0.0-1643.g3bfc837d. 1.7 MB/s | 127 kB 00:00 2024-02-21T22:57:50.896 INFO:teuthology.orchestra.run.smithi099.stdout:(18/166): libradosstriper1-19.0.0-1643.g3bfc837 6.6 MB/s | 502 kB 00:00 2024-02-21T22:57:51.004 INFO:teuthology.orchestra.run.smithi099.stdout:(19/166): python3-ceph-argparse-19.0.0-1643.g3b 419 kB/s | 45 kB 00:00 2024-02-21T22:57:51.079 INFO:teuthology.orchestra.run.smithi099.stdout:(20/166): python3-ceph-common-19.0.0-1643.g3bfc 1.7 MB/s | 131 kB 00:00 2024-02-21T22:57:51.155 INFO:teuthology.orchestra.run.smithi099.stdout:(21/166): python3-cephfs-19.0.0-1643.g3bfc837d. 2.1 MB/s | 161 kB 00:00 2024-02-21T22:57:51.238 INFO:teuthology.orchestra.run.smithi099.stdout:(22/166): python3-rados-19.0.0-1643.g3bfc837d.e 3.8 MB/s | 321 kB 00:00 2024-02-21T22:57:51.372 INFO:teuthology.orchestra.run.smithi099.stdout:(23/166): librgw2-19.0.0-1643.g3bfc837d.el9.x86 9.9 MB/s | 5.1 MB 00:00 2024-02-21T22:57:51.406 INFO:teuthology.orchestra.run.smithi099.stdout:(24/166): python3-rbd-19.0.0-1643.g3bfc837d.el9 1.8 MB/s | 298 kB 00:00 2024-02-21T22:57:51.439 INFO:teuthology.orchestra.run.smithi099.stdout:(25/166): python3-rgw-19.0.0-1643.g3bfc837d.el9 1.5 MB/s | 100 kB 00:00 2024-02-21T22:57:51.471 INFO:teuthology.orchestra.run.smithi099.stdout:(26/166): rbd-fuse-19.0.0-1643.g3bfc837d.el9.x8 1.3 MB/s | 85 kB 00:00 2024-02-21T22:57:51.549 INFO:teuthology.orchestra.run.smithi099.stdout:(27/166): rbd-nbd-19.0.0-1643.g3bfc837d.el9.x86 2.2 MB/s | 170 kB 00:00 2024-02-21T22:57:51.616 INFO:teuthology.orchestra.run.smithi099.stdout:(28/166): ceph-grafana-dashboards-19.0.0-1643.g 477 kB/s | 31 kB 00:00 2024-02-21T22:57:51.724 INFO:teuthology.orchestra.run.smithi099.stdout:(29/166): rbd-mirror-19.0.0-1643.g3bfc837d.el9. 11 MB/s | 3.1 MB 00:00 2024-02-21T22:57:51.758 INFO:teuthology.orchestra.run.smithi099.stdout:(30/166): ceph-mgr-cephadm-19.0.0-1643.g3bfc837 978 kB/s | 138 kB 00:00 2024-02-21T22:57:51.899 INFO:teuthology.orchestra.run.smithi162.stderr:Modular dependency problems: 2024-02-21T22:57:51.899 INFO:teuthology.orchestra.run.smithi162.stderr: 2024-02-21T22:57:51.899 INFO:teuthology.orchestra.run.smithi162.stderr: Problem 1: conflicting requests 2024-02-21T22:57:51.899 INFO:teuthology.orchestra.run.smithi162.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240219154654:20125149.x86_64 from CentOS-AppStream 2024-02-21T22:57:51.899 INFO:teuthology.orchestra.run.smithi162.stderr: Problem 2: conflicting requests 2024-02-21T22:57:51.899 INFO:teuthology.orchestra.run.smithi162.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-21T22:57:51.900 INFO:teuthology.orchestra.run.smithi162.stderr: Problem 3: conflicting requests 2024-02-21T22:57:51.900 INFO:teuthology.orchestra.run.smithi162.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-21T22:57:51.900 INFO:teuthology.orchestra.run.smithi162.stderr: Problem 4: conflicting requests 2024-02-21T22:57:51.900 INFO:teuthology.orchestra.run.smithi162.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-21T22:57:51.900 INFO:teuthology.orchestra.run.smithi162.stderr: Problem 5: conflicting requests 2024-02-21T22:57:51.900 INFO:teuthology.orchestra.run.smithi162.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-21T22:57:51.900 INFO:teuthology.orchestra.run.smithi162.stderr: Problem 6: conflicting requests 2024-02-21T22:57:51.900 INFO:teuthology.orchestra.run.smithi162.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-21T22:57:51.900 INFO:teuthology.orchestra.run.smithi162.stderr: Problem 7: conflicting requests 2024-02-21T22:57:51.900 INFO:teuthology.orchestra.run.smithi162.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-21T22:57:51.900 INFO:teuthology.orchestra.run.smithi162.stderr: Problem 8: conflicting requests 2024-02-21T22:57:51.900 INFO:teuthology.orchestra.run.smithi162.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-21T22:57:51.901 INFO:teuthology.orchestra.run.smithi162.stderr: Problem 9: conflicting requests 2024-02-21T22:57:51.901 INFO:teuthology.orchestra.run.smithi162.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-21T22:57:51.901 INFO:teuthology.orchestra.run.smithi162.stderr: Problem 10: conflicting requests 2024-02-21T22:57:51.901 INFO:teuthology.orchestra.run.smithi162.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-21T22:57:51.901 INFO:teuthology.orchestra.run.smithi162.stderr: Problem 11: conflicting requests 2024-02-21T22:57:51.901 INFO:teuthology.orchestra.run.smithi162.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-21T22:57:51.901 INFO:teuthology.orchestra.run.smithi162.stderr: Problem 12: conflicting requests 2024-02-21T22:57:51.901 INFO:teuthology.orchestra.run.smithi162.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-21T22:57:51.901 INFO:teuthology.orchestra.run.smithi162.stderr: Problem 13: conflicting requests 2024-02-21T22:57:51.901 INFO:teuthology.orchestra.run.smithi162.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-21T22:57:51.901 INFO:teuthology.orchestra.run.smithi162.stderr: Problem 14: conflicting requests 2024-02-21T22:57:51.901 INFO:teuthology.orchestra.run.smithi162.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-21T22:57:51.901 INFO:teuthology.orchestra.run.smithi162.stderr: Problem 15: conflicting requests 2024-02-21T22:57:51.901 INFO:teuthology.orchestra.run.smithi162.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-21T22:57:51.902 INFO:teuthology.orchestra.run.smithi162.stderr: Problem 16: conflicting requests 2024-02-21T22:57:51.902 INFO:teuthology.orchestra.run.smithi162.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-21T22:57:51.902 INFO:teuthology.orchestra.run.smithi162.stderr: Problem 17: conflicting requests 2024-02-21T22:57:51.902 INFO:teuthology.orchestra.run.smithi162.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-21T22:57:51.902 INFO:teuthology.orchestra.run.smithi162.stderr: Problem 18: conflicting requests 2024-02-21T22:57:51.902 INFO:teuthology.orchestra.run.smithi162.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-21T22:57:51.902 INFO:teuthology.orchestra.run.smithi162.stderr: Problem 19: conflicting requests 2024-02-21T22:57:51.902 INFO:teuthology.orchestra.run.smithi162.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-21T22:57:51.902 INFO:teuthology.orchestra.run.smithi162.stderr: Problem 20: conflicting requests 2024-02-21T22:57:51.902 INFO:teuthology.orchestra.run.smithi162.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-21T22:57:51.902 INFO:teuthology.orchestra.run.smithi162.stderr: Problem 21: conflicting requests 2024-02-21T22:57:51.902 INFO:teuthology.orchestra.run.smithi162.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-21T22:57:51.902 INFO:teuthology.orchestra.run.smithi162.stderr: Problem 22: conflicting requests 2024-02-21T22:57:51.903 INFO:teuthology.orchestra.run.smithi162.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-21T22:57:51.903 INFO:teuthology.orchestra.run.smithi162.stderr: Problem 23: conflicting requests 2024-02-21T22:57:51.903 INFO:teuthology.orchestra.run.smithi162.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-21T22:57:51.903 INFO:teuthology.orchestra.run.smithi162.stderr: Problem 24: conflicting requests 2024-02-21T22:57:51.903 INFO:teuthology.orchestra.run.smithi162.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-21T22:57:51.903 INFO:teuthology.orchestra.run.smithi162.stderr: Problem 25: conflicting requests 2024-02-21T22:57:51.903 INFO:teuthology.orchestra.run.smithi162.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-21T22:57:51.903 INFO:teuthology.orchestra.run.smithi162.stderr: Problem 26: conflicting requests 2024-02-21T22:57:51.903 INFO:teuthology.orchestra.run.smithi162.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-21T22:57:51.903 INFO:teuthology.orchestra.run.smithi162.stderr: Problem 27: conflicting requests 2024-02-21T22:57:51.903 INFO:teuthology.orchestra.run.smithi162.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-21T22:57:51.903 INFO:teuthology.orchestra.run.smithi162.stderr: Problem 28: conflicting requests 2024-02-21T22:57:51.903 INFO:teuthology.orchestra.run.smithi162.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-21T22:57:51.904 INFO:teuthology.orchestra.run.smithi162.stderr: Problem 29: conflicting requests 2024-02-21T22:57:51.904 INFO:teuthology.orchestra.run.smithi162.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-21T22:57:51.904 INFO:teuthology.orchestra.run.smithi162.stderr: Problem 30: conflicting requests 2024-02-21T22:57:51.904 INFO:teuthology.orchestra.run.smithi162.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-21T22:57:51.904 INFO:teuthology.orchestra.run.smithi162.stderr: Problem 31: conflicting requests 2024-02-21T22:57:51.904 INFO:teuthology.orchestra.run.smithi162.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-21T22:57:51.904 INFO:teuthology.orchestra.run.smithi162.stderr: Problem 32: conflicting requests 2024-02-21T22:57:51.904 INFO:teuthology.orchestra.run.smithi162.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-21T22:57:51.904 INFO:teuthology.orchestra.run.smithi162.stderr: Problem 33: conflicting requests 2024-02-21T22:57:51.904 INFO:teuthology.orchestra.run.smithi162.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-21T22:57:51.904 INFO:teuthology.orchestra.run.smithi162.stderr: Problem 34: conflicting requests 2024-02-21T22:57:51.904 INFO:teuthology.orchestra.run.smithi162.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-21T22:57:51.905 INFO:teuthology.orchestra.run.smithi162.stderr: Problem 35: conflicting requests 2024-02-21T22:57:51.905 INFO:teuthology.orchestra.run.smithi162.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-21T22:57:51.905 INFO:teuthology.orchestra.run.smithi162.stderr: Problem 36: conflicting requests 2024-02-21T22:57:51.905 INFO:teuthology.orchestra.run.smithi162.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-21T22:57:51.905 INFO:teuthology.orchestra.run.smithi162.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-21T22:57:51.905 INFO:teuthology.orchestra.run.smithi162.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-21T22:57:51.905 INFO:teuthology.orchestra.run.smithi162.stderr: Problem 37: cannot install the best candidate for the job 2024-02-21T22:57:51.905 INFO:teuthology.orchestra.run.smithi162.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-21T22:57:51.905 INFO:teuthology.orchestra.run.smithi162.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-21T22:57:51.905 INFO:teuthology.orchestra.run.smithi162.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-21T22:57:51.905 INFO:teuthology.orchestra.run.smithi162.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-21T22:57:51.905 INFO:teuthology.orchestra.run.smithi162.stderr: Problem 38: conflicting requests 2024-02-21T22:57:51.905 INFO:teuthology.orchestra.run.smithi162.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-21T22:57:51.906 INFO:teuthology.orchestra.run.smithi162.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-21T22:57:51.906 INFO:teuthology.orchestra.run.smithi162.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-21T22:57:51.906 INFO:teuthology.orchestra.run.smithi162.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-21T22:57:51.906 INFO:teuthology.orchestra.run.smithi162.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-21T22:57:51.906 INFO:teuthology.orchestra.run.smithi162.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-21T22:57:51.906 INFO:teuthology.orchestra.run.smithi162.stderr: Problem 39: cannot install the best candidate for the job 2024-02-21T22:57:51.906 INFO:teuthology.orchestra.run.smithi162.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-21T22:57:51.906 INFO:teuthology.orchestra.run.smithi162.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-21T22:57:51.906 INFO:teuthology.orchestra.run.smithi162.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-21T22:57:51.906 INFO:teuthology.orchestra.run.smithi162.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-21T22:57:51.906 INFO:teuthology.orchestra.run.smithi162.stderr: Problem 40: cannot install the best candidate for the job 2024-02-21T22:57:51.906 INFO:teuthology.orchestra.run.smithi162.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-21T22:57:51.906 INFO:teuthology.orchestra.run.smithi162.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-21T22:57:51.907 INFO:teuthology.orchestra.run.smithi162.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-21T22:57:51.907 INFO:teuthology.orchestra.run.smithi162.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-21T22:57:51.907 INFO:teuthology.orchestra.run.smithi162.stderr: Problem 41: cannot install the best candidate for the job 2024-02-21T22:57:51.907 INFO:teuthology.orchestra.run.smithi162.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-21T22:57:51.907 INFO:teuthology.orchestra.run.smithi162.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-21T22:57:51.907 INFO:teuthology.orchestra.run.smithi162.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-21T22:57:51.907 INFO:teuthology.orchestra.run.smithi162.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-21T22:57:51.907 INFO:teuthology.orchestra.run.smithi162.stderr: Problem 42: cannot install the best candidate for the job 2024-02-21T22:57:51.907 INFO:teuthology.orchestra.run.smithi162.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-21T22:57:51.907 INFO:teuthology.orchestra.run.smithi162.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-21T22:57:51.907 INFO:teuthology.orchestra.run.smithi162.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-21T22:57:51.907 INFO:teuthology.orchestra.run.smithi162.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-21T22:57:51.907 INFO:teuthology.orchestra.run.smithi162.stderr: Problem 43: cannot install the best candidate for the job 2024-02-21T22:57:51.908 INFO:teuthology.orchestra.run.smithi162.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-21T22:57:51.908 INFO:teuthology.orchestra.run.smithi162.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-21T22:57:51.908 INFO:teuthology.orchestra.run.smithi162.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-21T22:57:51.908 INFO:teuthology.orchestra.run.smithi162.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-21T22:57:51.908 INFO:teuthology.orchestra.run.smithi162.stderr: Problem 44: cannot install the best candidate for the job 2024-02-21T22:57:51.908 INFO:teuthology.orchestra.run.smithi162.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-21T22:57:51.908 INFO:teuthology.orchestra.run.smithi162.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-21T22:57:51.908 INFO:teuthology.orchestra.run.smithi162.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-21T22:57:51.908 INFO:teuthology.orchestra.run.smithi162.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-21T22:57:51.950 INFO:teuthology.orchestra.run.smithi099.stdout:(31/166): ceph-mgr-dashboard-19.0.0-1643.g3bfc8 7.9 MB/s | 1.8 MB 00:00 2024-02-21T22:57:52.050 INFO:teuthology.orchestra.run.smithi099.stdout:(32/166): ceph-mgr-modules-core-19.0.0-1643.g3b 2.5 MB/s | 248 kB 00:00 2024-02-21T22:57:52.134 INFO:teuthology.orchestra.run.smithi099.stdout:(33/166): ceph-mgr-rook-19.0.0-1643.g3bfc837d.e 597 kB/s | 49 kB 00:00 2024-02-21T22:57:52.209 INFO:teuthology.orchestra.run.smithi099.stdout:(34/166): ceph-prometheus-alerts-19.0.0-1643.g3 207 kB/s | 15 kB 00:00 2024-02-21T22:57:52.269 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - CRB 3.3 MB/s | 6.1 MB 00:01 2024-02-21T22:57:52.343 INFO:teuthology.orchestra.run.smithi099.stdout:(35/166): ceph-mgr-diskprediction-local-19.0.0- 13 MB/s | 7.4 MB 00:00 2024-02-21T22:57:52.393 INFO:teuthology.orchestra.run.smithi099.stdout:(36/166): ceph-volume-19.0.0-1643.g3bfc837d.el9 1.4 MB/s | 264 kB 00:00 2024-02-21T22:57:52.411 INFO:teuthology.orchestra.run.smithi162.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-02-21T22:57:52.412 INFO:teuthology.orchestra.run.smithi162.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-02-21T22:57:52.425 INFO:teuthology.orchestra.run.smithi162.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-02-21T22:57:52.426 INFO:teuthology.orchestra.run.smithi162.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-02-21T22:57:52.427 INFO:teuthology.orchestra.run.smithi162.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-02-21T22:57:52.428 INFO:teuthology.orchestra.run.smithi162.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-02-21T22:57:52.430 INFO:teuthology.orchestra.run.smithi162.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-02-21T22:57:52.432 INFO:teuthology.orchestra.run.smithi162.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-02-21T22:57:52.433 INFO:teuthology.orchestra.run.smithi162.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-02-21T22:57:52.443 INFO:teuthology.orchestra.run.smithi099.stdout:(37/166): cephadm-19.0.0-1643.g3bfc837d.el9.noa 7.4 MB/s | 748 kB 00:00 2024-02-21T22:57:52.468 INFO:teuthology.orchestra.run.smithi099.stdout:(38/166): cephfs-top-19.0.0-1643.g3bfc837d.el9. 244 kB/s | 18 kB 00:00 2024-02-21T22:57:52.696 INFO:teuthology.orchestra.run.smithi099.stdout:(39/166): libaio-devel-0.3.112-1.el8.x86_64.rpm 118 kB/s | 18 kB 00:00 2024-02-21T22:57:52.696 INFO:teuthology.orchestra.run.smithi099.stdout:(40/166): fuse-2.9.9-15.el9.x86_64.rpm 484 kB/s | 80 kB 00:00 2024-02-21T22:57:52.696 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-02-21T22:57:52.696 INFO:teuthology.orchestra.run.smithi162.stdout:========================================================================================= 2024-02-21T22:57:52.696 INFO:teuthology.orchestra.run.smithi162.stdout: Package Arch Version Repository Size 2024-02-21T22:57:52.696 INFO:teuthology.orchestra.run.smithi162.stdout:========================================================================================= 2024-02-21T22:57:52.696 INFO:teuthology.orchestra.run.smithi162.stdout:Installing: 2024-02-21T22:57:52.697 INFO:teuthology.orchestra.run.smithi162.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-02-21T22:57:52.697 INFO:teuthology.orchestra.run.smithi162.stdout: ceph x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 6.6 k 2024-02-21T22:57:52.697 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-base x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 5.3 M 2024-02-21T22:57:52.697 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-fuse x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 889 k 2024-02-21T22:57:52.697 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 145 k 2024-02-21T22:57:52.697 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 1.5 M 2024-02-21T22:57:52.697 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1643.g3bfc837d.el9 ceph-noarch 138 k 2024-02-21T22:57:52.697 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1643.g3bfc837d.el9 ceph-noarch 1.8 M 2024-02-21T22:57:52.697 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1643.g3bfc837d.el9 ceph-noarch 7.4 M 2024-02-21T22:57:52.697 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-rook noarch 2:19.0.0-1643.g3bfc837d.el9 ceph-noarch 49 k 2024-02-21T22:57:52.697 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-radosgw x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 9.8 M 2024-02-21T22:57:52.697 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-test x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 47 M 2024-02-21T22:57:52.697 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-volume noarch 2:19.0.0-1643.g3bfc837d.el9 ceph-noarch 264 k 2024-02-21T22:57:52.697 INFO:teuthology.orchestra.run.smithi162.stdout: cephadm noarch 2:19.0.0-1643.g3bfc837d.el9 ceph-noarch 748 k 2024-02-21T22:57:52.698 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-mirror x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 220 k 2024-02-21T22:57:52.698 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-shell x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 27 k 2024-02-21T22:57:52.698 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-top noarch 2:19.0.0-1643.g3bfc837d.el9 ceph-noarch 18 k 2024-02-21T22:57:52.698 INFO:teuthology.orchestra.run.smithi162.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-02-21T22:57:52.698 INFO:teuthology.orchestra.run.smithi162.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-02-21T22:57:52.698 INFO:teuthology.orchestra.run.smithi162.stdout: libaio-devel x86_64 0.3.112-1.el8 CentOS-BaseOS 18 k 2024-02-21T22:57:52.698 INFO:teuthology.orchestra.run.smithi162.stdout: libcephfs-devel x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 31 k 2024-02-21T22:57:52.698 INFO:teuthology.orchestra.run.smithi162.stdout: libcephfs2 x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 745 k 2024-02-21T22:57:52.698 INFO:teuthology.orchestra.run.smithi162.stdout: librados-devel x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 127 k 2024-02-21T22:57:52.698 INFO:teuthology.orchestra.run.smithi162.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-02-21T22:57:52.698 INFO:teuthology.orchestra.run.smithi162.stdout: libuuid-devel x86_64 2.37.4-15.el9 appstream 26 k 2024-02-21T22:57:52.698 INFO:teuthology.orchestra.run.smithi162.stdout: openssl-devel x86_64 1:3.0.7-25.el9 appstream 4.1 M 2024-02-21T22:57:52.698 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql x86_64 13.11-1.el9 appstream 1.6 M 2024-02-21T22:57:52.698 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-contrib x86_64 13.11-1.el9 appstream 905 k 2024-02-21T22:57:52.699 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-server x86_64 13.11-1.el9 appstream 5.7 M 2024-02-21T22:57:52.699 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cephfs x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 161 k 2024-02-21T22:57:52.699 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rados x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 321 k 2024-02-21T22:57:52.699 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rbd x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 298 k 2024-02-21T22:57:52.699 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rgw x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 100 k 2024-02-21T22:57:52.699 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-fuse x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 85 k 2024-02-21T22:57:52.699 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-mirror x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 3.1 M 2024-02-21T22:57:52.699 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-nbd x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 170 k 2024-02-21T22:57:52.699 INFO:teuthology.orchestra.run.smithi162.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-02-21T22:57:52.699 INFO:teuthology.orchestra.run.smithi162.stdout:Upgrading: 2024-02-21T22:57:52.699 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager x86_64 1:1.45.91-1.el9 baseos 2.3 M 2024-02-21T22:57:52.699 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-libnm x86_64 1:1.45.91-1.el9 baseos 1.8 M 2024-02-21T22:57:52.700 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-team x86_64 1:1.45.91-1.el9 baseos 42 k 2024-02-21T22:57:52.700 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-tui x86_64 1:1.45.91-1.el9 baseos 247 k 2024-02-21T22:57:52.700 INFO:teuthology.orchestra.run.smithi162.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-02-21T22:57:52.700 INFO:teuthology.orchestra.run.smithi162.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-02-21T22:57:52.700 INFO:teuthology.orchestra.run.smithi162.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-02-21T22:57:52.700 INFO:teuthology.orchestra.run.smithi162.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-02-21T22:57:52.700 INFO:teuthology.orchestra.run.smithi162.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-02-21T22:57:52.700 INFO:teuthology.orchestra.run.smithi162.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-02-21T22:57:52.700 INFO:teuthology.orchestra.run.smithi162.stdout: librados2 x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 3.4 M 2024-02-21T22:57:52.700 INFO:teuthology.orchestra.run.smithi162.stdout: librbd1 x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 3.1 M 2024-02-21T22:57:52.701 INFO:teuthology.orchestra.run.smithi162.stdout: openssl x86_64 1:3.0.7-25.el9 baseos 1.2 M 2024-02-21T22:57:52.701 INFO:teuthology.orchestra.run.smithi162.stdout: openssl-libs x86_64 1:3.0.7-25.el9 baseos 2.2 M 2024-02-21T22:57:52.701 INFO:teuthology.orchestra.run.smithi162.stdout: xfsdump x86_64 3.1.12-4.el9 baseos 323 k 2024-02-21T22:57:52.701 INFO:teuthology.orchestra.run.smithi162.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-02-21T22:57:52.701 INFO:teuthology.orchestra.run.smithi162.stdout:Installing dependencies: 2024-02-21T22:57:52.701 INFO:teuthology.orchestra.run.smithi162.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-02-21T22:57:52.701 INFO:teuthology.orchestra.run.smithi162.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-02-21T22:57:52.702 INFO:teuthology.orchestra.run.smithi162.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-02-21T22:57:52.702 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-common x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 20 M 2024-02-21T22:57:52.702 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1643.g3bfc837d.el9 ceph-noarch 31 k 2024-02-21T22:57:52.702 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mds x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 2.3 M 2024-02-21T22:57:52.702 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1643.g3bfc837d.el9 ceph-noarch 248 k 2024-02-21T22:57:52.702 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mon x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 4.7 M 2024-02-21T22:57:52.702 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-osd x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 17 M 2024-02-21T22:57:52.702 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1643.g3bfc837d.el9 ceph-noarch 15 k 2024-02-21T22:57:52.702 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-selinux x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 25 k 2024-02-21T22:57:52.702 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-02-21T22:57:52.702 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-02-21T22:57:52.703 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-02-21T22:57:52.703 INFO:teuthology.orchestra.run.smithi162.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-02-21T22:57:52.703 INFO:teuthology.orchestra.run.smithi162.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-02-21T22:57:52.703 INFO:teuthology.orchestra.run.smithi162.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-02-21T22:57:52.703 INFO:teuthology.orchestra.run.smithi162.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-02-21T22:57:52.703 INFO:teuthology.orchestra.run.smithi162.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-02-21T22:57:52.703 INFO:teuthology.orchestra.run.smithi162.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-02-21T22:57:52.703 INFO:teuthology.orchestra.run.smithi162.stdout: libcephsqlite x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 163 k 2024-02-21T22:57:52.704 INFO:teuthology.orchestra.run.smithi162.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-02-21T22:57:52.704 INFO:teuthology.orchestra.run.smithi162.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-02-21T22:57:52.704 INFO:teuthology.orchestra.run.smithi162.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-02-21T22:57:52.704 INFO:teuthology.orchestra.run.smithi162.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-02-21T22:57:52.704 INFO:teuthology.orchestra.run.smithi162.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-02-21T22:57:52.704 INFO:teuthology.orchestra.run.smithi162.stdout: libradosstriper1 x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 502 k 2024-02-21T22:57:52.704 INFO:teuthology.orchestra.run.smithi162.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-02-21T22:57:52.704 INFO:teuthology.orchestra.run.smithi162.stdout: librgw2 x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 5.1 M 2024-02-21T22:57:52.704 INFO:teuthology.orchestra.run.smithi162.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-02-21T22:57:52.705 INFO:teuthology.orchestra.run.smithi162.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-02-21T22:57:52.705 INFO:teuthology.orchestra.run.smithi162.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-02-21T22:57:52.705 INFO:teuthology.orchestra.run.smithi162.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-02-21T22:57:52.705 INFO:teuthology.orchestra.run.smithi162.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-02-21T22:57:52.705 INFO:teuthology.orchestra.run.smithi162.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-02-21T22:57:52.705 INFO:teuthology.orchestra.run.smithi162.stdout: oniguruma x86_64 6.9.6-1.el9.5 baseos 218 k 2024-02-21T22:57:52.705 INFO:teuthology.orchestra.run.smithi162.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-02-21T22:57:52.705 INFO:teuthology.orchestra.run.smithi162.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-02-21T22:57:52.705 INFO:teuthology.orchestra.run.smithi162.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-02-21T22:57:52.705 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-private-libs x86_64 13.11-1.el9 appstream 135 k 2024-02-21T22:57:52.706 INFO:teuthology.orchestra.run.smithi162.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-02-21T22:57:52.706 INFO:teuthology.orchestra.run.smithi162.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-02-21T22:57:52.706 INFO:teuthology.orchestra.run.smithi162.stdout: python3-asyncssh noarch 2.13.2-4.el9 epel 548 k 2024-02-21T22:57:52.706 INFO:teuthology.orchestra.run.smithi162.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-02-21T22:57:52.706 INFO:teuthology.orchestra.run.smithi162.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-02-21T22:57:52.706 INFO:teuthology.orchestra.run.smithi162.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-02-21T22:57:52.706 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-02-21T22:57:52.706 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-argparse x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 45 k 2024-02-21T22:57:52.707 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-common x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 131 k 2024-02-21T22:57:52.707 INFO:teuthology.orchestra.run.smithi162.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-02-21T22:57:52.707 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-02-21T22:57:52.707 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-02-21T22:57:52.707 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-02-21T22:57:52.707 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-02-21T22:57:52.707 INFO:teuthology.orchestra.run.smithi162.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-02-21T22:57:52.707 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-02-21T22:57:52.707 INFO:teuthology.orchestra.run.smithi162.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-02-21T22:57:52.708 INFO:teuthology.orchestra.run.smithi162.stdout: python3-google-auth noarch 1:2.27.0-1.el9 epel 203 k 2024-02-21T22:57:52.708 INFO:teuthology.orchestra.run.smithi162.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-02-21T22:57:52.708 INFO:teuthology.orchestra.run.smithi162.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-02-21T22:57:52.708 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-02-21T22:57:52.708 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-02-21T22:57:52.708 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-02-21T22:57:52.708 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-02-21T22:57:52.708 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-02-21T22:57:52.708 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-02-21T22:57:52.708 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-02-21T22:57:52.709 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-02-21T22:57:52.709 INFO:teuthology.orchestra.run.smithi162.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-02-21T22:57:52.709 INFO:teuthology.orchestra.run.smithi162.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-02-21T22:57:52.709 INFO:teuthology.orchestra.run.smithi162.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-02-21T22:57:52.709 INFO:teuthology.orchestra.run.smithi162.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-02-21T22:57:52.709 INFO:teuthology.orchestra.run.smithi162.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-02-21T22:57:52.709 INFO:teuthology.orchestra.run.smithi162.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-02-21T22:57:52.709 INFO:teuthology.orchestra.run.smithi162.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-02-21T22:57:52.710 INFO:teuthology.orchestra.run.smithi162.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-02-21T22:57:52.710 INFO:teuthology.orchestra.run.smithi162.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-02-21T22:57:52.710 INFO:teuthology.orchestra.run.smithi162.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-02-21T22:57:52.710 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-02-21T22:57:52.710 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-02-21T22:57:52.710 INFO:teuthology.orchestra.run.smithi162.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-02-21T22:57:52.710 INFO:teuthology.orchestra.run.smithi162.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-02-21T22:57:52.710 INFO:teuthology.orchestra.run.smithi162.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-02-21T22:57:52.710 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-02-21T22:57:52.711 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-02-21T22:57:52.711 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-02-21T22:57:52.711 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-02-21T22:57:52.711 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-02-21T22:57:52.711 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-02-21T22:57:52.711 INFO:teuthology.orchestra.run.smithi162.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-02-21T22:57:52.711 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-02-21T22:57:52.711 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-02-21T22:57:52.712 INFO:teuthology.orchestra.run.smithi162.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-02-21T22:57:52.712 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-02-21T22:57:52.712 INFO:teuthology.orchestra.run.smithi162.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-02-21T22:57:52.712 INFO:teuthology.orchestra.run.smithi162.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-02-21T22:57:52.712 INFO:teuthology.orchestra.run.smithi162.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-02-21T22:57:52.712 INFO:teuthology.orchestra.run.smithi162.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-02-21T22:57:52.712 INFO:teuthology.orchestra.run.smithi162.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-02-21T22:57:52.712 INFO:teuthology.orchestra.run.smithi162.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-02-21T22:57:52.713 INFO:teuthology.orchestra.run.smithi162.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-02-21T22:57:52.713 INFO:teuthology.orchestra.run.smithi162.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-02-21T22:57:52.713 INFO:teuthology.orchestra.run.smithi162.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-02-21T22:57:52.713 INFO:teuthology.orchestra.run.smithi162.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-02-21T22:57:52.713 INFO:teuthology.orchestra.run.smithi162.stdout: qatlib x86_64 23.11.0-1.el9 appstream 216 k 2024-02-21T22:57:52.713 INFO:teuthology.orchestra.run.smithi162.stdout: qatzip-libs x86_64 1.1.2-2.el9 appstream 44 k 2024-02-21T22:57:52.713 INFO:teuthology.orchestra.run.smithi162.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-02-21T22:57:52.713 INFO:teuthology.orchestra.run.smithi162.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-02-21T22:57:52.714 INFO:teuthology.orchestra.run.smithi162.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-02-21T22:57:52.714 INFO:teuthology.orchestra.run.smithi162.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-02-21T22:57:52.714 INFO:teuthology.orchestra.run.smithi162.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-02-21T22:57:52.714 INFO:teuthology.orchestra.run.smithi162.stdout: zlib-devel x86_64 1.2.11-40.el9 appstream 45 k 2024-02-21T22:57:52.714 INFO:teuthology.orchestra.run.smithi162.stdout:Installing weak dependencies: 2024-02-21T22:57:52.714 INFO:teuthology.orchestra.run.smithi162.stdout: qatlib-service x86_64 23.11.0-1.el9 appstream 35 k 2024-02-21T22:57:52.714 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-02-21T22:57:52.714 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction Summary 2024-02-21T22:57:52.714 INFO:teuthology.orchestra.run.smithi162.stdout:========================================================================================= 2024-02-21T22:57:52.715 INFO:teuthology.orchestra.run.smithi162.stdout:Install 150 Packages 2024-02-21T22:57:52.715 INFO:teuthology.orchestra.run.smithi162.stdout:Upgrade 16 Packages 2024-02-21T22:57:52.715 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-02-21T22:57:52.715 INFO:teuthology.orchestra.run.smithi162.stdout:Total download size: 222 M 2024-02-21T22:57:52.715 INFO:teuthology.orchestra.run.smithi162.stdout:Downloading Packages: 2024-02-21T22:57:52.761 INFO:teuthology.orchestra.run.smithi099.stdout:(41/166): jq-1.6-16.el9.x86_64.rpm 1.1 MB/s | 187 kB 00:00 2024-02-21T22:57:52.812 INFO:teuthology.orchestra.run.smithi099.stdout:(42/166): libgfortran-11.4.1-3.el9.x86_64.rpm 4.5 MB/s | 803 kB 00:00 2024-02-21T22:57:52.862 INFO:teuthology.orchestra.run.smithi099.stdout:(43/166): libquadmath-11.4.1-3.el9.x86_64.rpm 1.9 MB/s | 195 kB 00:00 2024-02-21T22:57:52.896 INFO:teuthology.orchestra.run.smithi099.stdout:(44/166): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.6 MB/s | 218 kB 00:00 2024-02-21T22:57:52.946 INFO:teuthology.orchestra.run.smithi099.stdout:(45/166): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.0 MB/s | 253 kB 00:00 2024-02-21T22:57:52.996 INFO:teuthology.orchestra.run.smithi099.stdout:(46/166): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-02-21T22:57:53.084 INFO:teuthology.orchestra.run.smithi099.stdout:(47/166): python3-pycparser-2.20-6.el9.noarch.r 1.5 MB/s | 135 kB 00:00 2024-02-21T22:57:53.180 INFO:teuthology.orchestra.run.smithi099.stdout:(48/166): python3-requests-2.25.1-8.el9.noarch. 1.3 MB/s | 125 kB 00:00 2024-02-21T22:57:53.255 INFO:teuthology.orchestra.run.smithi099.stdout:(49/166): python3-urllib3-1.26.5-5.el9.noarch.r 2.8 MB/s | 215 kB 00:00 2024-02-21T22:57:53.305 INFO:teuthology.orchestra.run.smithi099.stdout:(50/166): python3-cryptography-36.0.1-4.el9.x86 3.0 MB/s | 1.2 MB 00:00 2024-02-21T22:57:53.575 INFO:teuthology.orchestra.run.smithi162.stdout:(1/166): ceph-19.0.0-1643.g3bfc837d.el9.x86_64. 21 kB/s | 6.6 kB 00:00 2024-02-21T22:57:53.739 INFO:teuthology.orchestra.run.smithi099.stdout:(51/166): automake-1.16.2-8.el9.noarch.rpm 1.4 MB/s | 689 kB 00:00 2024-02-21T22:57:53.823 INFO:teuthology.orchestra.run.smithi099.stdout:(52/166): boost-program-options-1.75.0-8.el9.x8 1.3 MB/s | 107 kB 00:00 2024-02-21T22:57:53.881 INFO:teuthology.orchestra.run.smithi099.stdout:(53/166): bison-3.7.4-5.el9.x86_64.rpm 1.6 MB/s | 943 kB 00:00 2024-02-21T22:57:53.894 INFO:teuthology.orchestra.run.smithi181.stdout:CentOS Stream 9 - Extras packages 33 kB/s | 15 kB 00:00 2024-02-21T22:57:53.907 INFO:teuthology.orchestra.run.smithi099.stdout:(54/166): elfutils-libelf-devel-0.190-2.el9.x86 259 kB/s | 21 kB 00:00 2024-02-21T22:57:54.017 INFO:teuthology.orchestra.run.smithi162.stdout:(2/166): ceph-base-19.0.0-1643.g3bfc837d.el9.x8 7.1 MB/s | 5.3 MB 00:00 2024-02-21T22:57:54.067 INFO:teuthology.orchestra.run.smithi162.stdout:(3/166): ceph-immutable-object-cache-19.0.0-164 2.8 MB/s | 145 kB 00:00 2024-02-21T22:57:54.268 INFO:teuthology.orchestra.run.smithi162.stdout:(4/166): ceph-mds-19.0.0-1643.g3bfc837d.el9.x86 12 MB/s | 2.3 MB 00:00 2024-02-21T22:57:54.399 INFO:teuthology.orchestra.run.smithi099.stdout:(55/166): ceph-test-19.0.0-1643.g3bfc837d.el9.x 10 MB/s | 47 MB 00:04 2024-02-21T22:57:54.401 INFO:teuthology.orchestra.run.smithi162.stdout:(5/166): ceph-mgr-19.0.0-1643.g3bfc837d.el9.x86 11 MB/s | 1.5 MB 00:00 2024-02-21T22:57:54.424 INFO:teuthology.orchestra.run.smithi099.stdout:(56/166): flexiblas-3.0.4-8.el9.x86_64.rpm 63 kB/s | 33 kB 00:00 2024-02-21T22:57:54.483 INFO:teuthology.orchestra.run.smithi099.stdout:(57/166): flex-2.6.4-9.el9.x86_64.rpm 522 kB/s | 313 kB 00:00 2024-02-21T22:57:54.516 INFO:teuthology.orchestra.run.smithi099.stdout:(58/166): flexiblas-openblas-openmp-3.0.4-8.el9 199 kB/s | 18 kB 00:00 2024-02-21T22:57:54.575 INFO:teuthology.orchestra.run.smithi099.stdout:(59/166): librabbitmq-0.11.0-7.el9.x86_64.rpm 783 kB/s | 45 kB 00:00 2024-02-21T22:57:54.592 INFO:teuthology.orchestra.run.smithi099.stdout:(60/166): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.4 MB/s | 160 kB 00:00 2024-02-21T22:57:54.793 INFO:teuthology.orchestra.run.smithi162.stdout:(6/166): ceph-mon-19.0.0-1643.g3bfc837d.el9.x86 12 MB/s | 4.7 MB 00:00 2024-02-21T22:57:54.967 INFO:teuthology.orchestra.run.smithi099.stdout:(61/166): libtool-2.4.6-45.el9.x86_64.rpm 1.5 MB/s | 582 kB 00:00 2024-02-21T22:57:55.026 INFO:teuthology.orchestra.run.smithi099.stdout:(62/166): libuuid-devel-2.37.4-15.el9.x86_64.rp 440 kB/s | 26 kB 00:00 2024-02-21T22:57:55.069 INFO:teuthology.orchestra.run.smithi162.stdout:(7/166): ceph-fuse-19.0.0-1643.g3bfc837d.el9.x8 596 kB/s | 889 kB 00:01 2024-02-21T22:57:55.084 INFO:teuthology.orchestra.run.smithi099.stdout:(63/166): libzstd-devel-1.5.1-2.el9.x86_64.rpm 824 kB/s | 47 kB 00:00 2024-02-21T22:57:55.126 INFO:teuthology.orchestra.run.smithi099.stdout:(64/166): librdkafka-1.6.1-102.el9.x86_64.rpm 1.2 MB/s | 662 kB 00:00 2024-02-21T22:57:55.218 INFO:teuthology.orchestra.run.smithi099.stdout:(65/166): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.1 MB/s | 292 kB 00:00 2024-02-21T22:57:55.244 INFO:teuthology.orchestra.run.smithi099.stdout:(66/166): lua-5.4.4-4.el9.x86_64.rpm 1.6 MB/s | 188 kB 00:00 2024-02-21T22:57:55.277 INFO:teuthology.orchestra.run.smithi099.stdout:(67/166): openblas-0.3.21-2.el9.x86_64.rpm 606 kB/s | 35 kB 00:00 2024-02-21T22:57:55.386 INFO:teuthology.orchestra.run.smithi162.stdout:(8/166): ceph-common-19.0.0-1643.g3bfc837d.el9. 9.6 MB/s | 20 MB 00:02 2024-02-21T22:57:55.419 INFO:teuthology.orchestra.run.smithi162.stdout:(9/166): ceph-selinux-19.0.0-1643.g3bfc837d.el9 766 kB/s | 25 kB 00:00 2024-02-21T22:57:55.653 INFO:teuthology.orchestra.run.smithi099.stdout:(68/166): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.4 MB/s | 3.0 MB 00:01 2024-02-21T22:57:56.028 INFO:teuthology.orchestra.run.smithi099.stdout:(69/166): postgresql-13.11-1.el9.x86_64.rpm 4.2 MB/s | 1.6 MB 00:00 2024-02-21T22:57:56.094 INFO:teuthology.orchestra.run.smithi162.stdout:(10/166): ceph-osd-19.0.0-1643.g3bfc837d.el9.x8 13 MB/s | 17 MB 00:01 2024-02-21T22:57:56.144 INFO:teuthology.orchestra.run.smithi162.stdout:(11/166): cephfs-mirror-19.0.0-1643.g3bfc837d.e 4.3 MB/s | 220 kB 00:00 2024-02-21T22:57:56.219 INFO:teuthology.orchestra.run.smithi162.stdout:(12/166): cephfs-shell-19.0.0-1643.g3bfc837d.el 361 kB/s | 27 kB 00:00 2024-02-21T22:57:56.303 INFO:teuthology.orchestra.run.smithi162.stdout:(13/166): libcephfs-devel-19.0.0-1643.g3bfc837d 374 kB/s | 31 kB 00:00 2024-02-21T22:57:56.320 INFO:teuthology.orchestra.run.smithi099.stdout:(70/166): openssl-devel-3.0.7-25.el9.x86_64.rpm 4.0 MB/s | 4.1 MB 00:01 2024-02-21T22:57:56.370 INFO:teuthology.orchestra.run.smithi099.stdout:(71/166): postgresql-contrib-13.11-1.el9.x86_64 2.6 MB/s | 905 kB 00:00 2024-02-21T22:57:56.404 INFO:teuthology.orchestra.run.smithi099.stdout:(72/166): postgresql-private-libs-13.11-1.el9.x 1.6 MB/s | 135 kB 00:00 2024-02-21T22:57:56.563 INFO:teuthology.orchestra.run.smithi099.stdout:(73/166): openblas-openmp-0.3.21-2.el9.x86_64.r 3.6 MB/s | 4.7 MB 00:01 2024-02-21T22:57:56.621 INFO:teuthology.orchestra.run.smithi099.stdout:(74/166): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-02-21T22:57:56.722 INFO:teuthology.orchestra.run.smithi099.stdout:(75/166): protobuf-3.14.0-13.el9.x86_64.rpm 3.2 MB/s | 1.0 MB 00:00 2024-02-21T22:57:56.813 INFO:teuthology.orchestra.run.smithi099.stdout:(76/166): python3-devel-3.9.17-2.el9.x86_64.rpm 2.6 MB/s | 245 kB 00:00 2024-02-21T22:57:56.931 INFO:teuthology.orchestra.run.smithi099.stdout:(77/166): python3-jinja2-2.11.3-5.el9.noarch.rp 2.1 MB/s | 248 kB 00:00 2024-02-21T22:57:56.989 INFO:teuthology.orchestra.run.smithi099.stdout:(78/166): python3-jsonpatch-1.21-16.el9.noarch. 446 kB/s | 26 kB 00:00 2024-02-21T22:57:57.048 INFO:teuthology.orchestra.run.smithi099.stdout:(79/166): python3-jsonpointer-2.0-4.el9.noarch. 334 kB/s | 19 kB 00:00 2024-02-21T22:57:57.095 INFO:teuthology.orchestra.run.smithi162.stdout:(14/166): libcephfs2-19.0.0-1643.g3bfc837d.el9. 942 kB/s | 745 kB 00:00 2024-02-21T22:57:57.106 INFO:teuthology.orchestra.run.smithi099.stdout:(80/166): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-02-21T22:57:57.165 INFO:teuthology.orchestra.run.smithi099.stdout:(81/166): python3-markupsafe-1.1.1-12.el9.x86_6 606 kB/s | 35 kB 00:00 2024-02-21T22:57:57.178 INFO:teuthology.orchestra.run.smithi162.stdout:(15/166): libcephsqlite-19.0.0-1643.g3bfc837d.e 1.9 MB/s | 163 kB 00:00 2024-02-21T22:57:57.354 INFO:teuthology.orchestra.run.smithi162.stdout:(16/166): librados-devel-19.0.0-1643.g3bfc837d. 723 kB/s | 127 kB 00:00 2024-02-21T22:57:57.398 INFO:teuthology.orchestra.run.smithi099.stdout:(82/166): postgresql-server-13.11-1.el9.x86_64. 5.6 MB/s | 5.7 MB 00:01 2024-02-21T22:57:57.421 INFO:teuthology.orchestra.run.smithi162.stdout:(17/166): libradosstriper1-19.0.0-1643.g3bfc837 7.4 MB/s | 502 kB 00:00 2024-02-21T22:57:57.490 INFO:teuthology.orchestra.run.smithi099.stdout:(83/166): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.7 MB/s | 250 kB 00:00 2024-02-21T22:57:57.766 INFO:teuthology.orchestra.run.smithi099.stdout:(84/166): python3-babel-2.9.1-2.el9.noarch.rpm 5.2 MB/s | 6.0 MB 00:01 2024-02-21T22:57:57.800 INFO:teuthology.orchestra.run.smithi099.stdout:(85/166): python3-oauthlib-3.1.1-5.el9.noarch.r 721 kB/s | 222 kB 00:00 2024-02-21T22:57:57.850 INFO:teuthology.orchestra.run.smithi099.stdout:(86/166): python3-packaging-20.9-5.el9.noarch.r 934 kB/s | 77 kB 00:00 2024-02-21T22:57:57.867 INFO:teuthology.orchestra.run.smithi099.stdout:(87/166): python3-prettytable-0.7.2-27.el9.noar 639 kB/s | 42 kB 00:00 2024-02-21T22:57:57.938 INFO:teuthology.orchestra.run.smithi162.stdout:(18/166): ceph-test-19.0.0-1643.g3bfc837d.el9.x 19 MB/s | 47 MB 00:02 2024-02-21T22:57:57.967 INFO:teuthology.orchestra.run.smithi099.stdout:(88/166): python3-protobuf-3.14.0-13.el9.noarch 2.3 MB/s | 269 kB 00:00 2024-02-21T22:57:57.988 INFO:teuthology.orchestra.run.smithi162.stdout:(19/166): python3-ceph-argparse-19.0.0-1643.g3b 910 kB/s | 45 kB 00:00 2024-02-21T22:57:57.992 INFO:teuthology.orchestra.run.smithi099.stdout:(89/166): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.2 MB/s | 159 kB 00:00 2024-02-21T22:57:58.064 INFO:teuthology.orchestra.run.smithi162.stdout:(20/166): librgw2-19.0.0-1643.g3bfc837d.el9.x86 8.0 MB/s | 5.1 MB 00:00 2024-02-21T22:57:58.089 INFO:teuthology.orchestra.run.smithi162.stdout:(21/166): python3-ceph-common-19.0.0-1643.g3bfc 1.3 MB/s | 131 kB 00:00 2024-02-21T22:57:58.101 INFO:teuthology.orchestra.run.smithi099.stdout:(90/166): python3-numpy-1.20.1-5.el9.x86_64.rpm 5.5 MB/s | 5.1 MB 00:00 2024-02-21T22:57:58.114 INFO:teuthology.orchestra.run.smithi162.stdout:(22/166): python3-cephfs-19.0.0-1643.g3bfc837d. 3.2 MB/s | 161 kB 00:00 2024-02-21T22:57:58.126 INFO:teuthology.orchestra.run.smithi099.stdout:(91/166): python3-pytz-2021.1-5.el9.noarch.rpm 382 kB/s | 51 kB 00:00 2024-02-21T22:57:58.148 INFO:teuthology.orchestra.run.smithi162.stdout:(23/166): python3-rados-19.0.0-1643.g3bfc837d.e 5.4 MB/s | 321 kB 00:00 2024-02-21T22:57:58.160 INFO:teuthology.orchestra.run.smithi099.stdout:(92/166): python3-pyasn1-modules-0.4.8-6.el9.no 1.4 MB/s | 279 kB 00:00 2024-02-21T22:57:58.173 INFO:teuthology.orchestra.run.smithi162.stdout:(24/166): python3-rbd-19.0.0-1643.g3bfc837d.el9 5.0 MB/s | 298 kB 00:00 2024-02-21T22:57:58.185 INFO:teuthology.orchestra.run.smithi099.stdout:(93/166): python3-requests-oauthlib-1.3.0-12.el 644 kB/s | 54 kB 00:00 2024-02-21T22:57:58.192 INFO:teuthology.orchestra.run.smithi162.stdout:(25/166): python3-rgw-19.0.0-1643.g3bfc837d.el9 2.2 MB/s | 100 kB 00:00 2024-02-21T22:57:58.217 INFO:teuthology.orchestra.run.smithi162.stdout:(26/166): rbd-fuse-19.0.0-1643.g3bfc837d.el9.x8 1.9 MB/s | 85 kB 00:00 2024-02-21T22:57:58.219 INFO:teuthology.orchestra.run.smithi099.stdout:(94/166): python3-toml-0.10.2-6.el9.noarch.rpm 715 kB/s | 42 kB 00:00 2024-02-21T22:57:58.244 INFO:teuthology.orchestra.run.smithi099.stdout:(95/166): python3-wcwidth-0.2.5-8.el9.noarch.rp 762 kB/s | 44 kB 00:00 2024-02-21T22:57:58.293 INFO:teuthology.orchestra.run.smithi162.stdout:(27/166): rbd-nbd-19.0.0-1643.g3bfc837d.el9.x86 2.2 MB/s | 170 kB 00:00 2024-02-21T22:57:58.303 INFO:teuthology.orchestra.run.smithi099.stdout:(96/166): qatlib-23.11.0-1.el9.x86_64.rpm 2.5 MB/s | 216 kB 00:00 2024-02-21T22:57:58.328 INFO:teuthology.orchestra.run.smithi099.stdout:(97/166): qatlib-service-23.11.0-1.el9.x86_64.r 420 kB/s | 35 kB 00:00 2024-02-21T22:57:58.362 INFO:teuthology.orchestra.run.smithi099.stdout:(98/166): qatzip-libs-1.1.2-2.el9.x86_64.rpm 771 kB/s | 44 kB 00:00 2024-02-21T22:57:58.376 INFO:teuthology.orchestra.run.smithi162.stdout:(28/166): rbd-mirror-19.0.0-1643.g3bfc837d.el9. 17 MB/s | 3.1 MB 00:00 2024-02-21T22:57:58.393 INFO:teuthology.orchestra.run.smithi162.stdout:(29/166): ceph-grafana-dashboards-19.0.0-1643.g 313 kB/s | 31 kB 00:00 2024-02-21T22:57:58.395 INFO:teuthology.orchestra.run.smithi099.stdout:(99/166): socat-1.7.4.1-5.el9.x86_64.rpm 4.5 MB/s | 305 kB 00:00 2024-02-21T22:57:58.421 INFO:teuthology.orchestra.run.smithi099.stdout:(100/166): uuid-1.6.2-55.el9.x86_64.rpm 1.0 MB/s | 58 kB 00:00 2024-02-21T22:57:58.427 INFO:teuthology.orchestra.run.smithi162.stdout:(30/166): ceph-mgr-cephadm-19.0.0-1643.g3bfc837 2.7 MB/s | 138 kB 00:00 2024-02-21T22:57:58.455 INFO:teuthology.orchestra.run.smithi099.stdout:(101/166): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.6 MB/s | 94 kB 00:00 2024-02-21T22:57:58.480 INFO:teuthology.orchestra.run.smithi099.stdout:(102/166): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-02-21T22:57:58.513 INFO:teuthology.orchestra.run.smithi099.stdout:(103/166): zlib-devel-1.2.11-40.el9.x86_64.rpm 782 kB/s | 45 kB 00:00 2024-02-21T22:57:58.560 INFO:teuthology.orchestra.run.smithi162.stdout:(31/166): ceph-mgr-dashboard-19.0.0-1643.g3bfc8 11 MB/s | 1.8 MB 00:00 2024-02-21T22:57:58.644 INFO:teuthology.orchestra.run.smithi162.stdout:(32/166): ceph-mgr-modules-core-19.0.0-1643.g3b 2.9 MB/s | 248 kB 00:00 2024-02-21T22:57:58.720 INFO:teuthology.orchestra.run.smithi162.stdout:(33/166): ceph-mgr-rook-19.0.0-1643.g3bfc837d.e 658 kB/s | 49 kB 00:00 2024-02-21T22:57:58.730 INFO:teuthology.orchestra.run.smithi099.stdout:(104/166): lua-devel-5.4.4-4.el9.x86_64.rpm 89 kB/s | 22 kB 00:00 2024-02-21T22:57:58.837 INFO:teuthology.orchestra.run.smithi162.stdout:(34/166): ceph-mgr-diskprediction-local-19.0.0- 18 MB/s | 7.4 MB 00:00 2024-02-21T22:57:58.848 INFO:teuthology.orchestra.run.smithi099.stdout:(105/166): protobuf-compiler-3.14.0-13.el9.x86_ 2.5 MB/s | 863 kB 00:00 2024-02-21T22:57:58.862 INFO:teuthology.orchestra.run.smithi162.stdout:(35/166): ceph-prometheus-alerts-19.0.0-1643.g3 108 kB/s | 15 kB 00:00 2024-02-21T22:57:58.887 INFO:teuthology.orchestra.run.smithi162.stdout:(36/166): ceph-volume-19.0.0-1643.g3bfc837d.el9 5.2 MB/s | 264 kB 00:00 2024-02-21T22:57:58.929 INFO:teuthology.orchestra.run.smithi162.stdout:(37/166): cephadm-19.0.0-1643.g3bfc837d.el9.noa 11 MB/s | 748 kB 00:00 2024-02-21T22:57:58.979 INFO:teuthology.orchestra.run.smithi162.stdout:(38/166): cephfs-top-19.0.0-1643.g3bfc837d.el9. 198 kB/s | 18 kB 00:00 2024-02-21T22:57:59.063 INFO:teuthology.orchestra.run.smithi162.stdout:(39/166): fuse-2.9.9-15.el9.x86_64.rpm 965 kB/s | 80 kB 00:00 2024-02-21T22:57:59.105 INFO:teuthology.orchestra.run.smithi162.stdout:(40/166): libaio-devel-0.3.112-1.el8.x86_64.rpm 100 kB/s | 18 kB 00:00 2024-02-21T22:57:59.147 INFO:teuthology.orchestra.run.smithi162.stdout:(41/166): jq-1.6-16.el9.x86_64.rpm 2.2 MB/s | 187 kB 00:00 2024-02-21T22:57:59.214 INFO:teuthology.orchestra.run.smithi162.stdout:(42/166): libgfortran-11.4.1-3.el9.x86_64.rpm 7.2 MB/s | 803 kB 00:00 2024-02-21T22:57:59.240 INFO:teuthology.orchestra.run.smithi162.stdout:(43/166): libquadmath-11.4.1-3.el9.x86_64.rpm 2.1 MB/s | 195 kB 00:00 2024-02-21T22:57:59.315 INFO:teuthology.orchestra.run.smithi162.stdout:(44/166): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.1 MB/s | 218 kB 00:00 2024-02-21T22:57:59.348 INFO:teuthology.orchestra.run.smithi162.stdout:(45/166): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.3 MB/s | 253 kB 00:00 2024-02-21T22:57:59.415 INFO:teuthology.orchestra.run.smithi162.stdout:(46/166): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-02-21T22:57:59.466 INFO:teuthology.orchestra.run.smithi162.stdout:(47/166): python3-cryptography-36.0.1-4.el9.x86 8.1 MB/s | 1.2 MB 00:00 2024-02-21T22:57:59.499 INFO:teuthology.orchestra.run.smithi162.stdout:(48/166): python3-pycparser-2.20-6.el9.noarch.r 1.6 MB/s | 135 kB 00:00 2024-02-21T22:57:59.533 INFO:teuthology.orchestra.run.smithi162.stdout:(49/166): python3-requests-2.25.1-8.el9.noarch. 1.8 MB/s | 125 kB 00:00 2024-02-21T22:57:59.600 INFO:teuthology.orchestra.run.smithi162.stdout:(50/166): python3-urllib3-1.26.5-5.el9.noarch.r 2.1 MB/s | 215 kB 00:00 2024-02-21T22:58:00.797 INFO:teuthology.orchestra.run.smithi099.stdout:(106/166): python3-scipy-1.6.2-8.el9.x86_64.rpm 6.1 MB/s | 16 MB 00:02 2024-02-21T22:58:00.917 INFO:teuthology.orchestra.run.smithi162.stdout:(51/166): ceph-radosgw-19.0.0-1643.g3bfc837d.el 1.7 MB/s | 9.8 MB 00:05 2024-02-21T22:58:01.047 INFO:teuthology.orchestra.run.smithi099.stdout:(107/166): abseil-cpp-20211102.0-3.el9.x86_64.r 237 kB/s | 548 kB 00:02 2024-02-21T22:58:01.058 INFO:teuthology.orchestra.run.smithi162.stdout:(52/166): automake-1.16.2-8.el9.noarch.rpm 452 kB/s | 689 kB 00:01 2024-02-21T22:58:01.381 INFO:teuthology.orchestra.run.smithi099.stdout:(108/166): libarrow-9.0.0-10.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2024-02-21T22:58:01.464 INFO:teuthology.orchestra.run.smithi099.stdout:(109/166): libarrow-doc-9.0.0-10.el9.noarch.rpm 314 kB/s | 26 kB 00:00 2024-02-21T22:58:01.517 INFO:teuthology.orchestra.run.smithi162.stdout:(53/166): bison-3.7.4-5.el9.x86_64.rpm 492 kB/s | 943 kB 00:01 2024-02-21T22:58:01.531 INFO:teuthology.orchestra.run.smithi099.stdout:(110/166): liboath-2.6.7-2.el9.x86_64.rpm 733 kB/s | 49 kB 00:00 2024-02-21T22:58:01.598 INFO:teuthology.orchestra.run.smithi099.stdout:(111/166): libunwind-1.6.2-1.el9.x86_64.rpm 1.0 MB/s | 67 kB 00:00 2024-02-21T22:58:01.642 INFO:teuthology.orchestra.run.smithi162.stdout:(54/166): elfutils-libelf-devel-0.190-2.el9.x86 37 kB/s | 21 kB 00:00 2024-02-21T22:58:01.665 INFO:teuthology.orchestra.run.smithi099.stdout:(112/166): luarocks-3.9.2-1.el9.noarch.rpm 2.2 MB/s | 151 kB 00:00 2024-02-21T22:58:01.676 INFO:teuthology.orchestra.run.smithi162.stdout:(55/166): boost-program-options-1.75.0-8.el9.x8 141 kB/s | 107 kB 00:00 2024-02-21T22:58:01.712 INFO:teuthology.orchestra.run.smithi181.stdout:Extra Packages for Enterprise Linux 2.7 MB/s | 20 MB 00:07 2024-02-21T22:58:01.774 INFO:teuthology.orchestra.run.smithi099.stdout:(113/166): parquet-libs-9.0.0-10.el9.x86_64.rpm 7.6 MB/s | 838 kB 00:00 2024-02-21T22:58:01.882 INFO:teuthology.orchestra.run.smithi099.stdout:(114/166): python3-asyncssh-2.13.2-4.el9.noarch 5.0 MB/s | 548 kB 00:00 2024-02-21T22:58:01.950 INFO:teuthology.orchestra.run.smithi099.stdout:(115/166): python3-bcrypt-3.2.2-1.el9.x86_64.rp 656 kB/s | 43 kB 00:00 2024-02-21T22:58:02.016 INFO:teuthology.orchestra.run.smithi099.stdout:(116/166): python3-cachetools-4.2.4-1.el9.noarc 487 kB/s | 32 kB 00:00 2024-02-21T22:58:02.083 INFO:teuthology.orchestra.run.smithi099.stdout:(117/166): python3-certifi-2021.10.8-2.el9.noar 226 kB/s | 15 kB 00:00 2024-02-21T22:58:02.167 INFO:teuthology.orchestra.run.smithi099.stdout:(118/166): python3-cheroot-8.6.0-4.el9.noarch.r 2.0 MB/s | 172 kB 00:00 2024-02-21T22:58:02.250 INFO:teuthology.orchestra.run.smithi099.stdout:(119/166): python3-cherrypy-18.6.1-2.el9.noarch 4.2 MB/s | 358 kB 00:00 2024-02-21T22:58:02.293 INFO:teuthology.orchestra.run.smithi162.stdout:(56/166): flexiblas-3.0.4-8.el9.x86_64.rpm 50 kB/s | 33 kB 00:00 2024-02-21T22:58:02.326 INFO:teuthology.orchestra.run.smithi099.stdout:(120/166): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.0 MB/s | 303 kB 00:00 2024-02-21T22:58:02.385 INFO:teuthology.orchestra.run.smithi099.stdout:(121/166): python3-colorama-0.4.4-12.el9.noarch 607 kB/s | 35 kB 00:00 2024-02-21T22:58:02.460 INFO:teuthology.orchestra.run.smithi099.stdout:(122/166): python3-google-auth-2.27.0-1.el9.noa 2.7 MB/s | 203 kB 00:00 2024-02-21T22:58:02.618 INFO:teuthology.orchestra.run.smithi162.stdout:(57/166): flex-2.6.4-9.el9.x86_64.rpm 285 kB/s | 313 kB 00:01 2024-02-21T22:58:02.643 INFO:teuthology.orchestra.run.smithi099.stdout:(123/166): python3-grpcio-1.46.7-10.el9.x86_64. 11 MB/s | 2.0 MB 00:00 2024-02-21T22:58:02.710 INFO:teuthology.orchestra.run.smithi099.stdout:(124/166): python3-grpcio-tools-1.46.7-10.el9.x 2.1 MB/s | 144 kB 00:00 2024-02-21T22:58:02.835 INFO:teuthology.orchestra.run.smithi162.stdout:(58/166): flexiblas-openblas-openmp-3.0.4-8.el9 34 kB/s | 18 kB 00:00 2024-02-21T22:58:02.846 INFO:teuthology.orchestra.run.smithi099.stdout:(125/166): python3-jaraco-8.2.1-3.el9.noarch.rp 79 kB/s | 11 kB 00:00 2024-02-21T22:58:02.928 INFO:teuthology.orchestra.run.smithi099.stdout:(126/166): python3-jaraco-classes-3.2.1-5.el9.n 218 kB/s | 18 kB 00:00 2024-02-21T22:58:03.003 INFO:teuthology.orchestra.run.smithi099.stdout:(127/166): python3-jaraco-collections-3.0.0-8.e 311 kB/s | 23 kB 00:00 2024-02-21T22:58:03.079 INFO:teuthology.orchestra.run.smithi099.stdout:(128/166): python3-jaraco-functools-3.5.0-2.el9 261 kB/s | 19 kB 00:00 2024-02-21T22:58:03.162 INFO:teuthology.orchestra.run.smithi099.stdout:(129/166): python3-jaraco-text-3.2.0-6.el9.noar 237 kB/s | 20 kB 00:00 2024-02-21T22:58:03.321 INFO:teuthology.orchestra.run.smithi099.stdout:(130/166): python3-kubernetes-26.1.0-2.el9.noar 6.5 MB/s | 1.0 MB 00:00 2024-02-21T22:58:03.379 INFO:teuthology.orchestra.run.smithi099.stdout:(131/166): gperftools-libs-2.9.1-2.el9.x86_64.r 68 kB/s | 309 kB 00:04 2024-02-21T22:58:03.396 INFO:teuthology.orchestra.run.smithi099.stdout:(132/166): python3-logutils-0.3.5-21.el9.noarch 620 kB/s | 46 kB 00:00 2024-02-21T22:58:03.446 INFO:teuthology.orchestra.run.smithi099.stdout:(133/166): python3-more-itertools-8.12.0-2.el9. 1.2 MB/s | 79 kB 00:00 2024-02-21T22:58:03.463 INFO:teuthology.orchestra.run.smithi099.stdout:(134/166): python3-natsort-7.1.1-5.el9.noarch.r 870 kB/s | 58 kB 00:00 2024-02-21T22:58:03.518 INFO:teuthology.orchestra.run.smithi162.stdout:(59/166): libpmemobj-1.12.1-1.el9.x86_64.rpm 178 kB/s | 160 kB 00:00 2024-02-21T22:58:03.544 INFO:teuthology.orchestra.run.smithi162.stdout:(60/166): librabbitmq-0.11.0-7.el9.x86_64.rpm 64 kB/s | 45 kB 00:00 2024-02-21T22:58:03.547 INFO:teuthology.orchestra.run.smithi099.stdout:(135/166): python3-portend-3.1.0-2.el9.noarch.r 197 kB/s | 16 kB 00:00 2024-02-21T22:58:03.580 INFO:teuthology.orchestra.run.smithi099.stdout:(136/166): python3-pecan-1.4.2-3.el9.noarch.rpm 2.0 MB/s | 272 kB 00:00 2024-02-21T22:58:03.614 INFO:teuthology.orchestra.run.smithi099.stdout:(137/166): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.3 MB/s | 90 kB 00:00 2024-02-21T22:58:03.631 INFO:teuthology.orchestra.run.smithi099.stdout:(138/166): python3-pyperclip-1.8.2-2.el9.noarch 567 kB/s | 28 kB 00:00 2024-02-21T22:58:03.665 INFO:teuthology.orchestra.run.smithi099.stdout:(139/166): python3-repoze-lru-0.7-16.el9.noarch 618 kB/s | 31 kB 00:00 2024-02-21T22:58:03.698 INFO:teuthology.orchestra.run.smithi099.stdout:(140/166): python3-routes-2.5.1-5.el9.noarch.rp 2.8 MB/s | 188 kB 00:00 2024-02-21T22:58:03.732 INFO:teuthology.orchestra.run.smithi099.stdout:(141/166): python3-rsa-4.9-2.el9.noarch.rpm 889 kB/s | 59 kB 00:00 2024-02-21T22:58:03.765 INFO:teuthology.orchestra.run.smithi099.stdout:(142/166): python3-tempora-5.0.0-2.el9.noarch.r 538 kB/s | 36 kB 00:00 2024-02-21T22:58:03.791 INFO:teuthology.orchestra.run.smithi099.stdout:(143/166): python3-typing-extensions-4.4.0-2.el 878 kB/s | 51 kB 00:00 2024-02-21T22:58:03.833 INFO:teuthology.orchestra.run.smithi099.stdout:(144/166): python3-webob-1.8.7-6.el9.noarch.rpm 3.4 MB/s | 230 kB 00:00 2024-02-21T22:58:03.892 INFO:teuthology.orchestra.run.smithi099.stdout:(145/166): python3-websocket-client-1.2.3-2.el9 899 kB/s | 90 kB 00:00 2024-02-21T22:58:03.936 INFO:teuthology.orchestra.run.smithi099.stdout:(146/166): python3-werkzeug-2.0.3-3.el9.1.noarc 4.1 MB/s | 427 kB 00:00 2024-02-21T22:58:03.970 INFO:teuthology.orchestra.run.smithi099.stdout:(147/166): python3-zc-lockfile-2.0-10.el9.noarc 256 kB/s | 20 kB 00:00 2024-02-21T22:58:04.012 INFO:teuthology.orchestra.run.smithi099.stdout:(148/166): re2-20211101-3.el9.x86_64.rpm 2.6 MB/s | 192 kB 00:00 2024-02-21T22:58:04.129 INFO:teuthology.orchestra.run.smithi099.stdout:(149/166): thrift-0.15.0-2.el9.x86_64.rpm 10 MB/s | 1.6 MB 00:00 2024-02-21T22:58:04.896 INFO:teuthology.orchestra.run.smithi099.stdout:(150/166): librados2-19.0.0-1643.g3bfc837d.el9. 3.8 MB/s | 3.4 MB 00:00 2024-02-21T22:58:05.013 INFO:teuthology.orchestra.run.smithi099.stdout:(151/166): grpc-data-1.46.7-10.el9.noarch.rpm 4.6 kB/s | 19 kB 00:04 2024-02-21T22:58:05.027 INFO:teuthology.orchestra.run.smithi162.stdout:(61/166): libtool-2.4.6-45.el9.x86_64.rpm 393 kB/s | 582 kB 00:01 2024-02-21T22:58:05.069 INFO:teuthology.orchestra.run.smithi162.stdout:(62/166): librdkafka-1.6.1-102.el9.x86_64.rpm 428 kB/s | 662 kB 00:01 2024-02-21T22:58:05.472 INFO:teuthology.orchestra.run.smithi099.stdout:(152/166): NetworkManager-1.45.91-1.el9.x86_64. 4.0 MB/s | 2.3 MB 00:00 2024-02-21T22:58:05.547 INFO:teuthology.orchestra.run.smithi099.stdout:(153/166): NetworkManager-libnm-1.45.91-1.el9.x 3.4 MB/s | 1.8 MB 00:00 2024-02-21T22:58:05.564 INFO:teuthology.orchestra.run.smithi099.stdout:(154/166): NetworkManager-team-1.45.91-1.el9.x8 466 kB/s | 42 kB 00:00 2024-02-21T22:58:05.627 INFO:teuthology.orchestra.run.smithi162.stdout:(63/166): libuuid-devel-2.37.4-15.el9.x86_64.rp 43 kB/s | 26 kB 00:00 2024-02-21T22:58:05.639 INFO:teuthology.orchestra.run.smithi099.stdout:(155/166): acl-2.3.1-4.el9.x86_64.rpm 966 kB/s | 71 kB 00:00 2024-02-21T22:58:05.673 INFO:teuthology.orchestra.run.smithi099.stdout:(156/166): NetworkManager-tui-1.45.91-1.el9.x86 2.2 MB/s | 247 kB 00:00 2024-02-21T22:58:05.690 INFO:teuthology.orchestra.run.smithi099.stdout:(157/166): elfutils-debuginfod-client-0.190-2.e 740 kB/s | 36 kB 00:00 2024-02-21T22:58:05.744 INFO:teuthology.orchestra.run.smithi162.stdout:(64/166): libzstd-devel-1.5.1-2.el9.x86_64.rpm 70 kB/s | 47 kB 00:00 2024-02-21T22:58:05.765 INFO:teuthology.orchestra.run.smithi099.stdout:(158/166): librbd1-19.0.0-1643.g3bfc837d.el9.x8 1.9 MB/s | 3.1 MB 00:01 2024-02-21T22:58:05.791 INFO:teuthology.orchestra.run.smithi099.stdout:(159/166): elfutils-libelf-0.190-2.el9.x86_64.r 1.6 MB/s | 192 kB 00:00 2024-02-21T22:58:05.824 INFO:teuthology.orchestra.run.smithi099.stdout:(160/166): elfutils-libs-0.190-2.el9.x86_64.rpm 1.9 MB/s | 256 kB 00:00 2024-02-21T22:58:05.841 INFO:teuthology.orchestra.run.smithi099.stdout:(161/166): libacl-2.3.1-4.el9.x86_64.rpm 308 kB/s | 23 kB 00:00 2024-02-21T22:58:05.967 INFO:teuthology.orchestra.run.smithi099.stdout:(162/166): openssl-3.0.7-25.el9.x86_64.rpm 6.9 MB/s | 1.2 MB 00:00 2024-02-21T22:58:06.009 INFO:teuthology.orchestra.run.smithi099.stdout:(163/166): xfsdump-3.1.12-4.el9.x86_64.rpm 1.9 MB/s | 323 kB 00:00 2024-02-21T22:58:06.125 INFO:teuthology.orchestra.run.smithi099.stdout:(164/166): openssl-libs-3.0.7-25.el9.x86_64.rpm 7.2 MB/s | 2.2 MB 00:00 2024-02-21T22:58:06.151 INFO:teuthology.orchestra.run.smithi099.stdout:(165/166): libacl-devel-2.3.1-4.el9.x86_64.rpm 527 kB/s | 74 kB 00:00 2024-02-21T22:58:06.192 INFO:teuthology.orchestra.run.smithi099.stdout:(166/166): xfsprogs-6.3.0-1.el9.x86_64.rpm 4.8 MB/s | 1.1 MB 00:00 2024-02-21T22:58:06.199 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------------------- 2024-02-21T22:58:06.199 INFO:teuthology.orchestra.run.smithi099.stdout:Total 12 MB/s | 222 MB 00:19 2024-02-21T22:58:06.361 INFO:teuthology.orchestra.run.smithi162.stdout:(65/166): flexiblas-netlib-3.0.4-8.el9.x86_64.r 653 kB/s | 3.0 MB 00:04 2024-02-21T22:58:06.654 INFO:teuthology.orchestra.run.smithi162.stdout:(66/166): lua-5.4.4-4.el9.x86_64.rpm 207 kB/s | 188 kB 00:00 2024-02-21T22:58:06.753 INFO:teuthology.orchestra.run.smithi181.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2024-02-21T22:58:06.770 INFO:teuthology.orchestra.run.smithi162.stdout:(67/166): lttng-ust-2.12.0-6.el9.x86_64.rpm 256 kB/s | 292 kB 00:01 2024-02-21T22:58:06.978 INFO:teuthology.orchestra.run.smithi162.stdout:(68/166): openblas-0.3.21-2.el9.x86_64.rpm 57 kB/s | 35 kB 00:00 2024-02-21T22:58:09.331 INFO:teuthology.orchestra.run.smithi181.stderr:Modular dependency problems: 2024-02-21T22:58:09.331 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-02-21T22:58:09.331 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 1: conflicting requests 2024-02-21T22:58:09.331 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240219154654:20125149.x86_64 from CentOS-AppStream 2024-02-21T22:58:09.331 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 2: conflicting requests 2024-02-21T22:58:09.331 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-21T22:58:09.332 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 3: conflicting requests 2024-02-21T22:58:09.332 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-21T22:58:09.332 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 4: conflicting requests 2024-02-21T22:58:09.332 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-21T22:58:09.332 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 5: conflicting requests 2024-02-21T22:58:09.332 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-21T22:58:09.332 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 6: conflicting requests 2024-02-21T22:58:09.332 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-21T22:58:09.332 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 7: conflicting requests 2024-02-21T22:58:09.332 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-21T22:58:09.332 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 8: conflicting requests 2024-02-21T22:58:09.332 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-21T22:58:09.333 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 9: conflicting requests 2024-02-21T22:58:09.333 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-21T22:58:09.333 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 10: conflicting requests 2024-02-21T22:58:09.333 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-21T22:58:09.333 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 11: conflicting requests 2024-02-21T22:58:09.333 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-21T22:58:09.333 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 12: conflicting requests 2024-02-21T22:58:09.333 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-21T22:58:09.333 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 13: conflicting requests 2024-02-21T22:58:09.333 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-21T22:58:09.333 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 14: conflicting requests 2024-02-21T22:58:09.333 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-21T22:58:09.333 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 15: conflicting requests 2024-02-21T22:58:09.334 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-21T22:58:09.334 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 16: conflicting requests 2024-02-21T22:58:09.334 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-21T22:58:09.334 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 17: conflicting requests 2024-02-21T22:58:09.334 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-21T22:58:09.334 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 18: conflicting requests 2024-02-21T22:58:09.334 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-21T22:58:09.334 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 19: conflicting requests 2024-02-21T22:58:09.334 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-21T22:58:09.334 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 20: conflicting requests 2024-02-21T22:58:09.334 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-21T22:58:09.334 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 21: conflicting requests 2024-02-21T22:58:09.334 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-21T22:58:09.335 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 22: conflicting requests 2024-02-21T22:58:09.335 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-21T22:58:09.335 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 23: conflicting requests 2024-02-21T22:58:09.335 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-21T22:58:09.335 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 24: conflicting requests 2024-02-21T22:58:09.335 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-21T22:58:09.335 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 25: conflicting requests 2024-02-21T22:58:09.335 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-21T22:58:09.335 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 26: conflicting requests 2024-02-21T22:58:09.335 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-21T22:58:09.335 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 27: conflicting requests 2024-02-21T22:58:09.335 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-21T22:58:09.336 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 28: conflicting requests 2024-02-21T22:58:09.336 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-21T22:58:09.336 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 29: conflicting requests 2024-02-21T22:58:09.336 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-21T22:58:09.336 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 30: conflicting requests 2024-02-21T22:58:09.336 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-21T22:58:09.336 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 31: conflicting requests 2024-02-21T22:58:09.336 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-21T22:58:09.336 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 32: conflicting requests 2024-02-21T22:58:09.336 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-21T22:58:09.336 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 33: conflicting requests 2024-02-21T22:58:09.336 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-21T22:58:09.337 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 34: conflicting requests 2024-02-21T22:58:09.337 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-21T22:58:09.337 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 35: conflicting requests 2024-02-21T22:58:09.337 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240203221207:9edba152.x86_64 from CentOS-AppStream 2024-02-21T22:58:09.337 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 36: conflicting requests 2024-02-21T22:58:09.337 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-21T22:58:09.337 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-21T22:58:09.337 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-21T22:58:09.337 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 37: cannot install the best candidate for the job 2024-02-21T22:58:09.337 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-21T22:58:09.337 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-21T22:58:09.337 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-21T22:58:09.337 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-21T22:58:09.337 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 38: conflicting requests 2024-02-21T22:58:09.338 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-21T22:58:09.338 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-21T22:58:09.338 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-21T22:58:09.338 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-21T22:58:09.338 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-21T22:58:09.338 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-21T22:58:09.338 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 39: cannot install the best candidate for the job 2024-02-21T22:58:09.338 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-21T22:58:09.338 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-21T22:58:09.338 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-21T22:58:09.338 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-21T22:58:09.338 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 40: cannot install the best candidate for the job 2024-02-21T22:58:09.339 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-21T22:58:09.339 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-21T22:58:09.339 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-21T22:58:09.339 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-21T22:58:09.339 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 41: cannot install the best candidate for the job 2024-02-21T22:58:09.339 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-21T22:58:09.339 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-21T22:58:09.339 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-21T22:58:09.339 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-21T22:58:09.339 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 42: cannot install the best candidate for the job 2024-02-21T22:58:09.339 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-21T22:58:09.339 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-21T22:58:09.339 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-21T22:58:09.339 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-21T22:58:09.340 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 43: cannot install the best candidate for the job 2024-02-21T22:58:09.340 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-21T22:58:09.340 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-21T22:58:09.340 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-21T22:58:09.340 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-21T22:58:09.340 INFO:teuthology.orchestra.run.smithi181.stderr: Problem 44: cannot install the best candidate for the job 2024-02-21T22:58:09.340 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-21T22:58:09.340 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-21T22:58:09.340 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-21T22:58:09.340 INFO:teuthology.orchestra.run.smithi181.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-21T22:58:09.586 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction check 2024-02-21T22:58:09.662 INFO:teuthology.orchestra.run.smithi162.stdout:(69/166): openblas-openmp-0.3.21-2.el9.x86_64.r 1.6 MB/s | 4.7 MB 00:03 2024-02-21T22:58:09.724 INFO:teuthology.orchestra.run.smithi181.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-02-21T22:58:09.725 INFO:teuthology.orchestra.run.smithi181.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-02-21T22:58:09.738 INFO:teuthology.orchestra.run.smithi181.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-02-21T22:58:09.739 INFO:teuthology.orchestra.run.smithi181.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-02-21T22:58:09.740 INFO:teuthology.orchestra.run.smithi181.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-02-21T22:58:09.740 INFO:teuthology.orchestra.run.smithi181.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-02-21T22:58:09.742 INFO:teuthology.orchestra.run.smithi181.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-02-21T22:58:09.745 INFO:teuthology.orchestra.run.smithi181.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-02-21T22:58:09.746 INFO:teuthology.orchestra.run.smithi181.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-02-21T22:58:09.834 INFO:teuthology.orchestra.run.smithi181.stdout:Dependencies resolved. 2024-02-21T22:58:09.845 INFO:teuthology.orchestra.run.smithi162.stdout:(70/166): postgresql-13.11-1.el9.x86_64.rpm 565 kB/s | 1.6 MB 00:02 2024-02-21T22:58:09.855 INFO:teuthology.orchestra.run.smithi181.stdout:========================================================================================= 2024-02-21T22:58:09.855 INFO:teuthology.orchestra.run.smithi181.stdout: Package Arch Version Repository Size 2024-02-21T22:58:09.856 INFO:teuthology.orchestra.run.smithi181.stdout:========================================================================================= 2024-02-21T22:58:09.856 INFO:teuthology.orchestra.run.smithi181.stdout:Installing: 2024-02-21T22:58:09.856 INFO:teuthology.orchestra.run.smithi181.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-02-21T22:58:09.856 INFO:teuthology.orchestra.run.smithi181.stdout: ceph x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 6.6 k 2024-02-21T22:58:09.856 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-base x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 5.3 M 2024-02-21T22:58:09.856 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-fuse x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 889 k 2024-02-21T22:58:09.856 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 145 k 2024-02-21T22:58:09.856 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 1.5 M 2024-02-21T22:58:09.856 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1643.g3bfc837d.el9 ceph-noarch 138 k 2024-02-21T22:58:09.856 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1643.g3bfc837d.el9 ceph-noarch 1.8 M 2024-02-21T22:58:09.856 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1643.g3bfc837d.el9 ceph-noarch 7.4 M 2024-02-21T22:58:09.857 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-rook noarch 2:19.0.0-1643.g3bfc837d.el9 ceph-noarch 49 k 2024-02-21T22:58:09.857 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-radosgw x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 9.8 M 2024-02-21T22:58:09.857 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-test x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 47 M 2024-02-21T22:58:09.857 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-volume noarch 2:19.0.0-1643.g3bfc837d.el9 ceph-noarch 264 k 2024-02-21T22:58:09.857 INFO:teuthology.orchestra.run.smithi181.stdout: cephadm noarch 2:19.0.0-1643.g3bfc837d.el9 ceph-noarch 748 k 2024-02-21T22:58:09.857 INFO:teuthology.orchestra.run.smithi181.stdout: cephfs-mirror x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 220 k 2024-02-21T22:58:09.857 INFO:teuthology.orchestra.run.smithi181.stdout: cephfs-shell x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 27 k 2024-02-21T22:58:09.857 INFO:teuthology.orchestra.run.smithi181.stdout: cephfs-top noarch 2:19.0.0-1643.g3bfc837d.el9 ceph-noarch 18 k 2024-02-21T22:58:09.857 INFO:teuthology.orchestra.run.smithi181.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-02-21T22:58:09.857 INFO:teuthology.orchestra.run.smithi181.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-02-21T22:58:09.857 INFO:teuthology.orchestra.run.smithi181.stdout: libaio-devel x86_64 0.3.112-1.el8 CentOS-BaseOS 18 k 2024-02-21T22:58:09.857 INFO:teuthology.orchestra.run.smithi181.stdout: libcephfs-devel x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 31 k 2024-02-21T22:58:09.857 INFO:teuthology.orchestra.run.smithi181.stdout: libcephfs2 x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 745 k 2024-02-21T22:58:09.858 INFO:teuthology.orchestra.run.smithi181.stdout: librados-devel x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 127 k 2024-02-21T22:58:09.858 INFO:teuthology.orchestra.run.smithi181.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-02-21T22:58:09.858 INFO:teuthology.orchestra.run.smithi181.stdout: libuuid-devel x86_64 2.37.4-15.el9 appstream 26 k 2024-02-21T22:58:09.858 INFO:teuthology.orchestra.run.smithi181.stdout: openssl-devel x86_64 1:3.0.7-25.el9 appstream 4.1 M 2024-02-21T22:58:09.858 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql x86_64 13.11-1.el9 appstream 1.6 M 2024-02-21T22:58:09.858 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-contrib x86_64 13.11-1.el9 appstream 905 k 2024-02-21T22:58:09.858 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-server x86_64 13.11-1.el9 appstream 5.7 M 2024-02-21T22:58:09.858 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cephfs x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 161 k 2024-02-21T22:58:09.858 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rados x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 321 k 2024-02-21T22:58:09.858 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rbd x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 298 k 2024-02-21T22:58:09.858 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rgw x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 100 k 2024-02-21T22:58:09.858 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-fuse x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 85 k 2024-02-21T22:58:09.858 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-mirror x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 3.1 M 2024-02-21T22:58:09.858 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-nbd x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 170 k 2024-02-21T22:58:09.859 INFO:teuthology.orchestra.run.smithi181.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-02-21T22:58:09.859 INFO:teuthology.orchestra.run.smithi181.stdout:Upgrading: 2024-02-21T22:58:09.859 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager x86_64 1:1.45.91-1.el9 baseos 2.3 M 2024-02-21T22:58:09.859 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager-libnm x86_64 1:1.45.91-1.el9 baseos 1.8 M 2024-02-21T22:58:09.859 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager-team x86_64 1:1.45.91-1.el9 baseos 42 k 2024-02-21T22:58:09.859 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager-tui x86_64 1:1.45.91-1.el9 baseos 247 k 2024-02-21T22:58:09.859 INFO:teuthology.orchestra.run.smithi181.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-02-21T22:58:09.859 INFO:teuthology.orchestra.run.smithi181.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-02-21T22:58:09.859 INFO:teuthology.orchestra.run.smithi181.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-02-21T22:58:09.859 INFO:teuthology.orchestra.run.smithi181.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-02-21T22:58:09.859 INFO:teuthology.orchestra.run.smithi181.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-02-21T22:58:09.859 INFO:teuthology.orchestra.run.smithi181.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-02-21T22:58:09.859 INFO:teuthology.orchestra.run.smithi181.stdout: librados2 x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 3.4 M 2024-02-21T22:58:09.860 INFO:teuthology.orchestra.run.smithi181.stdout: librbd1 x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 3.1 M 2024-02-21T22:58:09.860 INFO:teuthology.orchestra.run.smithi181.stdout: openssl x86_64 1:3.0.7-25.el9 baseos 1.2 M 2024-02-21T22:58:09.860 INFO:teuthology.orchestra.run.smithi181.stdout: openssl-libs x86_64 1:3.0.7-25.el9 baseos 2.2 M 2024-02-21T22:58:09.860 INFO:teuthology.orchestra.run.smithi181.stdout: xfsdump x86_64 3.1.12-4.el9 baseos 323 k 2024-02-21T22:58:09.860 INFO:teuthology.orchestra.run.smithi181.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-02-21T22:58:09.860 INFO:teuthology.orchestra.run.smithi181.stdout:Installing dependencies: 2024-02-21T22:58:09.860 INFO:teuthology.orchestra.run.smithi181.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-02-21T22:58:09.860 INFO:teuthology.orchestra.run.smithi181.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-02-21T22:58:09.860 INFO:teuthology.orchestra.run.smithi181.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-02-21T22:58:09.860 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-common x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 20 M 2024-02-21T22:58:09.860 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1643.g3bfc837d.el9 ceph-noarch 31 k 2024-02-21T22:58:09.860 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mds x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 2.3 M 2024-02-21T22:58:09.860 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1643.g3bfc837d.el9 ceph-noarch 248 k 2024-02-21T22:58:09.860 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mon x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 4.7 M 2024-02-21T22:58:09.861 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-osd x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 17 M 2024-02-21T22:58:09.861 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1643.g3bfc837d.el9 ceph-noarch 15 k 2024-02-21T22:58:09.861 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-selinux x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 25 k 2024-02-21T22:58:09.861 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-02-21T22:58:09.861 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-02-21T22:58:09.861 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-02-21T22:58:09.861 INFO:teuthology.orchestra.run.smithi181.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-02-21T22:58:09.861 INFO:teuthology.orchestra.run.smithi181.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-02-21T22:58:09.861 INFO:teuthology.orchestra.run.smithi181.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-02-21T22:58:09.861 INFO:teuthology.orchestra.run.smithi181.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-02-21T22:58:09.861 INFO:teuthology.orchestra.run.smithi181.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-02-21T22:58:09.861 INFO:teuthology.orchestra.run.smithi181.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-02-21T22:58:09.862 INFO:teuthology.orchestra.run.smithi181.stdout: libcephsqlite x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 163 k 2024-02-21T22:58:09.862 INFO:teuthology.orchestra.run.smithi181.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-02-21T22:58:09.862 INFO:teuthology.orchestra.run.smithi181.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-02-21T22:58:09.862 INFO:teuthology.orchestra.run.smithi181.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-02-21T22:58:09.862 INFO:teuthology.orchestra.run.smithi181.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-02-21T22:58:09.862 INFO:teuthology.orchestra.run.smithi181.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-02-21T22:58:09.862 INFO:teuthology.orchestra.run.smithi181.stdout: libradosstriper1 x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 502 k 2024-02-21T22:58:09.862 INFO:teuthology.orchestra.run.smithi181.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-02-21T22:58:09.862 INFO:teuthology.orchestra.run.smithi181.stdout: librgw2 x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 5.1 M 2024-02-21T22:58:09.862 INFO:teuthology.orchestra.run.smithi181.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-02-21T22:58:09.862 INFO:teuthology.orchestra.run.smithi181.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-02-21T22:58:09.862 INFO:teuthology.orchestra.run.smithi181.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-02-21T22:58:09.862 INFO:teuthology.orchestra.run.smithi181.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-02-21T22:58:09.863 INFO:teuthology.orchestra.run.smithi181.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-02-21T22:58:09.863 INFO:teuthology.orchestra.run.smithi181.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-02-21T22:58:09.863 INFO:teuthology.orchestra.run.smithi181.stdout: oniguruma x86_64 6.9.6-1.el9.5 baseos 218 k 2024-02-21T22:58:09.863 INFO:teuthology.orchestra.run.smithi181.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-02-21T22:58:09.863 INFO:teuthology.orchestra.run.smithi181.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-02-21T22:58:09.863 INFO:teuthology.orchestra.run.smithi181.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-02-21T22:58:09.863 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-private-libs x86_64 13.11-1.el9 appstream 135 k 2024-02-21T22:58:09.863 INFO:teuthology.orchestra.run.smithi181.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-02-21T22:58:09.863 INFO:teuthology.orchestra.run.smithi181.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-02-21T22:58:09.863 INFO:teuthology.orchestra.run.smithi181.stdout: python3-asyncssh noarch 2.13.2-4.el9 epel 548 k 2024-02-21T22:58:09.863 INFO:teuthology.orchestra.run.smithi181.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-02-21T22:58:09.863 INFO:teuthology.orchestra.run.smithi181.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-02-21T22:58:09.863 INFO:teuthology.orchestra.run.smithi181.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-02-21T22:58:09.863 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-02-21T22:58:09.864 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ceph-argparse x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 45 k 2024-02-21T22:58:09.864 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ceph-common x86_64 2:19.0.0-1643.g3bfc837d.el9 ceph 131 k 2024-02-21T22:58:09.864 INFO:teuthology.orchestra.run.smithi181.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-02-21T22:58:09.864 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-02-21T22:58:09.864 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-02-21T22:58:09.864 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-02-21T22:58:09.864 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-02-21T22:58:09.864 INFO:teuthology.orchestra.run.smithi181.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-02-21T22:58:09.864 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-02-21T22:58:09.864 INFO:teuthology.orchestra.run.smithi181.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-02-21T22:58:09.864 INFO:teuthology.orchestra.run.smithi181.stdout: python3-google-auth noarch 1:2.27.0-1.el9 epel 203 k 2024-02-21T22:58:09.865 INFO:teuthology.orchestra.run.smithi181.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-02-21T22:58:09.865 INFO:teuthology.orchestra.run.smithi181.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-02-21T22:58:09.865 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-02-21T22:58:09.865 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-02-21T22:58:09.865 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-02-21T22:58:09.865 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-02-21T22:58:09.865 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-02-21T22:58:09.865 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-02-21T22:58:09.865 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-02-21T22:58:09.865 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-02-21T22:58:09.865 INFO:teuthology.orchestra.run.smithi181.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-02-21T22:58:09.865 INFO:teuthology.orchestra.run.smithi181.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-02-21T22:58:09.865 INFO:teuthology.orchestra.run.smithi181.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-02-21T22:58:09.865 INFO:teuthology.orchestra.run.smithi181.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-02-21T22:58:09.865 INFO:teuthology.orchestra.run.smithi181.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-02-21T22:58:09.866 INFO:teuthology.orchestra.run.smithi181.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-02-21T22:58:09.866 INFO:teuthology.orchestra.run.smithi181.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-02-21T22:58:09.866 INFO:teuthology.orchestra.run.smithi181.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-02-21T22:58:09.866 INFO:teuthology.orchestra.run.smithi181.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-02-21T22:58:09.866 INFO:teuthology.orchestra.run.smithi181.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-02-21T22:58:09.866 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-02-21T22:58:09.866 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-02-21T22:58:09.866 INFO:teuthology.orchestra.run.smithi181.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-02-21T22:58:09.866 INFO:teuthology.orchestra.run.smithi181.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-02-21T22:58:09.866 INFO:teuthology.orchestra.run.smithi181.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-02-21T22:58:09.866 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-02-21T22:58:09.866 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-02-21T22:58:09.866 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-02-21T22:58:09.866 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-02-21T22:58:09.866 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-02-21T22:58:09.867 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-02-21T22:58:09.867 INFO:teuthology.orchestra.run.smithi181.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-02-21T22:58:09.867 INFO:teuthology.orchestra.run.smithi181.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-02-21T22:58:09.867 INFO:teuthology.orchestra.run.smithi181.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-02-21T22:58:09.867 INFO:teuthology.orchestra.run.smithi181.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-02-21T22:58:09.867 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-02-21T22:58:09.867 INFO:teuthology.orchestra.run.smithi181.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-02-21T22:58:09.867 INFO:teuthology.orchestra.run.smithi181.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-02-21T22:58:09.867 INFO:teuthology.orchestra.run.smithi181.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-02-21T22:58:09.867 INFO:teuthology.orchestra.run.smithi181.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-02-21T22:58:09.867 INFO:teuthology.orchestra.run.smithi181.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-02-21T22:58:09.867 INFO:teuthology.orchestra.run.smithi181.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-02-21T22:58:09.867 INFO:teuthology.orchestra.run.smithi181.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-02-21T22:58:09.867 INFO:teuthology.orchestra.run.smithi181.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-02-21T22:58:09.868 INFO:teuthology.orchestra.run.smithi181.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-02-21T22:58:09.868 INFO:teuthology.orchestra.run.smithi181.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-02-21T22:58:09.868 INFO:teuthology.orchestra.run.smithi181.stdout: qatlib x86_64 23.11.0-1.el9 appstream 216 k 2024-02-21T22:58:09.868 INFO:teuthology.orchestra.run.smithi181.stdout: qatzip-libs x86_64 1.1.2-2.el9 appstream 44 k 2024-02-21T22:58:09.868 INFO:teuthology.orchestra.run.smithi181.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-02-21T22:58:09.868 INFO:teuthology.orchestra.run.smithi181.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-02-21T22:58:09.868 INFO:teuthology.orchestra.run.smithi181.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-02-21T22:58:09.868 INFO:teuthology.orchestra.run.smithi181.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-02-21T22:58:09.868 INFO:teuthology.orchestra.run.smithi181.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-02-21T22:58:09.868 INFO:teuthology.orchestra.run.smithi181.stdout: zlib-devel x86_64 1.2.11-40.el9 appstream 45 k 2024-02-21T22:58:09.868 INFO:teuthology.orchestra.run.smithi181.stdout:Installing weak dependencies: 2024-02-21T22:58:09.868 INFO:teuthology.orchestra.run.smithi181.stdout: qatlib-service x86_64 23.11.0-1.el9 appstream 35 k 2024-02-21T22:58:09.869 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-02-21T22:58:09.869 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction Summary 2024-02-21T22:58:09.869 INFO:teuthology.orchestra.run.smithi181.stdout:========================================================================================= 2024-02-21T22:58:09.869 INFO:teuthology.orchestra.run.smithi181.stdout:Install 150 Packages 2024-02-21T22:58:09.869 INFO:teuthology.orchestra.run.smithi181.stdout:Upgrade 16 Packages 2024-02-21T22:58:09.869 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-02-21T22:58:09.870 INFO:teuthology.orchestra.run.smithi181.stdout:Total download size: 222 M 2024-02-21T22:58:09.870 INFO:teuthology.orchestra.run.smithi181.stdout:Downloading Packages: 2024-02-21T22:58:09.952 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction check succeeded. 2024-02-21T22:58:09.952 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction test 2024-02-21T22:58:10.338 INFO:teuthology.orchestra.run.smithi181.stdout:(1/166): ceph-19.0.0-1643.g3bfc837d.el9.x86_64. 38 kB/s | 6.6 kB 00:00 2024-02-21T22:58:10.497 INFO:teuthology.orchestra.run.smithi181.stdout:(2/166): ceph-fuse-19.0.0-1643.g3bfc837d.el9.x8 5.5 MB/s | 889 kB 00:00 2024-02-21T22:58:10.547 INFO:teuthology.orchestra.run.smithi181.stdout:(3/166): ceph-immutable-object-cache-19.0.0-164 2.8 MB/s | 145 kB 00:00 2024-02-21T22:58:10.612 INFO:teuthology.orchestra.run.smithi162.stdout:(71/166): postgresql-private-libs-13.11-1.el9.x 176 kB/s | 135 kB 00:00 2024-02-21T22:58:10.789 INFO:teuthology.orchestra.run.smithi181.stdout:(4/166): ceph-mds-19.0.0-1643.g3bfc837d.el9.x86 9.5 MB/s | 2.3 MB 00:00 2024-02-21T22:58:10.956 INFO:teuthology.orchestra.run.smithi181.stdout:(5/166): ceph-mgr-19.0.0-1643.g3bfc837d.el9.x86 9.0 MB/s | 1.5 MB 00:00 2024-02-21T22:58:11.115 INFO:teuthology.orchestra.run.smithi181.stdout:(6/166): ceph-base-19.0.0-1643.g3bfc837d.el9.x8 5.6 MB/s | 5.3 MB 00:00 2024-02-21T22:58:11.415 INFO:teuthology.orchestra.run.smithi181.stdout:(7/166): ceph-mon-19.0.0-1643.g3bfc837d.el9.x86 10 MB/s | 4.7 MB 00:00 2024-02-21T22:58:11.513 INFO:teuthology.orchestra.run.smithi162.stdout:(72/166): postgresql-contrib-13.11-1.el9.x86_64 490 kB/s | 905 kB 00:01 2024-02-21T22:58:12.413 INFO:teuthology.orchestra.run.smithi099.stdout:Transaction test succeeded. 2024-02-21T22:58:12.414 INFO:teuthology.orchestra.run.smithi099.stdout:Running transaction 2024-02-21T22:58:12.831 INFO:teuthology.orchestra.run.smithi181.stdout:(8/166): ceph-radosgw-19.0.0-1643.g3bfc837d.el9 6.9 MB/s | 9.8 MB 00:01 2024-02-21T22:58:13.074 INFO:teuthology.orchestra.run.smithi181.stdout:(9/166): ceph-common-19.0.0-1643.g3bfc837d.el9. 7.0 MB/s | 20 MB 00:02 2024-02-21T22:58:13.099 INFO:teuthology.orchestra.run.smithi181.stdout:(10/166): ceph-selinux-19.0.0-1643.g3bfc837d.el 94 kB/s | 25 kB 00:00 2024-02-21T22:58:13.111 INFO:teuthology.orchestra.run.smithi162.stdout:(73/166): openssl-devel-3.0.7-25.el9.x86_64.rpm 666 kB/s | 4.1 MB 00:06 2024-02-21T22:58:13.266 INFO:teuthology.orchestra.run.smithi181.stdout:(11/166): ceph-osd-19.0.0-1643.g3bfc837d.el9.x8 7.8 MB/s | 17 MB 00:02 2024-02-21T22:58:13.291 INFO:teuthology.orchestra.run.smithi181.stdout:(12/166): cephfs-mirror-19.0.0-1643.g3bfc837d.e 1.1 MB/s | 220 kB 00:00 2024-02-21T22:58:13.333 INFO:teuthology.orchestra.run.smithi181.stdout:(13/166): libcephfs-devel-19.0.0-1643.g3bfc837d 752 kB/s | 31 kB 00:00 2024-02-21T22:58:13.359 INFO:teuthology.orchestra.run.smithi181.stdout:(14/166): cephfs-shell-19.0.0-1643.g3bfc837d.el 294 kB/s | 27 kB 00:00 2024-02-21T22:58:13.433 INFO:teuthology.orchestra.run.smithi181.stdout:(15/166): libcephfs2-19.0.0-1643.g3bfc837d.el9. 7.3 MB/s | 745 kB 00:00 2024-02-21T22:58:13.459 INFO:teuthology.orchestra.run.smithi181.stdout:(16/166): libcephsqlite-19.0.0-1643.g3bfc837d.e 1.6 MB/s | 163 kB 00:00 2024-02-21T22:58:13.484 INFO:teuthology.orchestra.run.smithi181.stdout:(17/166): librados-devel-19.0.0-1643.g3bfc837d. 2.5 MB/s | 127 kB 00:00 2024-02-21T22:58:13.580 INFO:teuthology.orchestra.run.smithi162.stdout:(74/166): protobuf-3.14.0-13.el9.x86_64.rpm 500 kB/s | 1.0 MB 00:02 2024-02-21T22:58:13.592 INFO:teuthology.orchestra.run.smithi181.stdout:(18/166): libradosstriper1-19.0.0-1643.g3bfc837 3.7 MB/s | 502 kB 00:00 2024-02-21T22:58:13.668 INFO:teuthology.orchestra.run.smithi181.stdout:(19/166): python3-ceph-argparse-19.0.0-1643.g3b 601 kB/s | 45 kB 00:00 2024-02-21T22:58:13.752 INFO:teuthology.orchestra.run.smithi181.stdout:(20/166): python3-ceph-common-19.0.0-1643.g3bfc 1.5 MB/s | 131 kB 00:00 2024-02-21T22:58:13.830 INFO:teuthology.orchestra.run.smithi162.stdout:(75/166): python3-attrs-20.3.0-7.el9.noarch.rpm 122 kB/s | 87 kB 00:00 2024-02-21T22:58:13.835 INFO:teuthology.orchestra.run.smithi181.stdout:(21/166): python3-cephfs-19.0.0-1643.g3bfc837d. 1.9 MB/s | 161 kB 00:00 2024-02-21T22:58:13.919 INFO:teuthology.orchestra.run.smithi181.stdout:(22/166): python3-rados-19.0.0-1643.g3bfc837d.e 3.8 MB/s | 321 kB 00:00 2024-02-21T22:58:14.019 INFO:teuthology.orchestra.run.smithi181.stdout:(23/166): librgw2-19.0.0-1643.g3bfc837d.el9.x86 9.6 MB/s | 5.1 MB 00:00 2024-02-21T22:58:14.044 INFO:teuthology.orchestra.run.smithi181.stdout:(24/166): python3-rbd-19.0.0-1643.g3bfc837d.el9 2.3 MB/s | 298 kB 00:00 2024-02-21T22:58:14.070 INFO:teuthology.orchestra.run.smithi181.stdout:(25/166): python3-rgw-19.0.0-1643.g3bfc837d.el9 1.9 MB/s | 100 kB 00:00 2024-02-21T22:58:14.112 INFO:teuthology.orchestra.run.smithi181.stdout:(26/166): rbd-fuse-19.0.0-1643.g3bfc837d.el9.x8 1.2 MB/s | 85 kB 00:00 2024-02-21T22:58:14.195 INFO:teuthology.orchestra.run.smithi181.stdout:(27/166): rbd-nbd-19.0.0-1643.g3bfc837d.el9.x86 2.0 MB/s | 170 kB 00:00 2024-02-21T22:58:14.270 INFO:teuthology.orchestra.run.smithi181.stdout:(28/166): ceph-grafana-dashboards-19.0.0-1643.g 419 kB/s | 31 kB 00:00 2024-02-21T22:58:14.396 INFO:teuthology.orchestra.run.smithi181.stdout:(29/166): rbd-mirror-19.0.0-1643.g3bfc837d.el9. 9.5 MB/s | 3.1 MB 00:00 2024-02-21T22:58:14.421 INFO:teuthology.orchestra.run.smithi181.stdout:(30/166): ceph-mgr-cephadm-19.0.0-1643.g3bfc837 918 kB/s | 138 kB 00:00 2024-02-21T22:58:14.663 INFO:teuthology.orchestra.run.smithi181.stdout:(31/166): ceph-mgr-dashboard-19.0.0-1643.g3bfc8 6.7 MB/s | 1.8 MB 00:00 2024-02-21T22:58:14.747 INFO:teuthology.orchestra.run.smithi181.stdout:(32/166): ceph-mgr-modules-core-19.0.0-1643.g3b 2.9 MB/s | 248 kB 00:00 2024-02-21T22:58:14.814 INFO:teuthology.orchestra.run.smithi181.stdout:(33/166): ceph-mgr-rook-19.0.0-1643.g3bfc837d.e 741 kB/s | 49 kB 00:00 2024-02-21T22:58:14.838 INFO:teuthology.orchestra.run.smithi162.stdout:(76/166): python3-devel-3.9.17-2.el9.x86_64.rpm 250 kB/s | 245 kB 00:00 2024-02-21T22:58:14.872 INFO:teuthology.orchestra.run.smithi181.stdout:(34/166): ceph-prometheus-alerts-19.0.0-1643.g3 263 kB/s | 15 kB 00:00 2024-02-21T22:58:14.998 INFO:teuthology.orchestra.run.smithi181.stdout:(35/166): ceph-volume-19.0.0-1643.g3bfc837d.el9 2.1 MB/s | 264 kB 00:00 2024-02-21T22:58:15.140 INFO:teuthology.orchestra.run.smithi181.stdout:(36/166): ceph-mgr-diskprediction-local-19.0.0- 10 MB/s | 7.4 MB 00:00 2024-02-21T22:58:15.189 INFO:teuthology.orchestra.run.smithi181.stdout:(37/166): cephadm-19.0.0-1643.g3bfc837d.el9.noa 3.8 MB/s | 748 kB 00:00 2024-02-21T22:58:15.206 INFO:teuthology.orchestra.run.smithi181.stdout:(38/166): cephfs-top-19.0.0-1643.g3bfc837d.el9. 275 kB/s | 18 kB 00:00 2024-02-21T22:58:15.299 INFO:teuthology.orchestra.run.smithi181.stdout:(39/166): libaio-devel-0.3.112-1.el8.x86_64.rpm 162 kB/s | 18 kB 00:00 2024-02-21T22:58:15.466 INFO:teuthology.orchestra.run.smithi181.stdout:(40/166): fuse-2.9.9-15.el9.x86_64.rpm 310 kB/s | 80 kB 00:00 2024-02-21T22:58:15.567 INFO:teuthology.orchestra.run.smithi181.stdout:(41/166): jq-1.6-16.el9.x86_64.rpm 774 kB/s | 187 kB 00:00 2024-02-21T22:58:15.600 INFO:teuthology.orchestra.run.smithi181.stdout:(42/166): libgfortran-11.4.1-3.el9.x86_64.rpm 5.9 MB/s | 803 kB 00:00 2024-02-21T22:58:15.642 INFO:teuthology.orchestra.run.smithi181.stdout:(43/166): libquadmath-11.4.1-3.el9.x86_64.rpm 2.5 MB/s | 195 kB 00:00 2024-02-21T22:58:15.668 INFO:teuthology.orchestra.run.smithi181.stdout:(44/166): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.2 MB/s | 218 kB 00:00 2024-02-21T22:58:15.717 INFO:teuthology.orchestra.run.smithi181.stdout:(45/166): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.3 MB/s | 253 kB 00:00 2024-02-21T22:58:15.776 INFO:teuthology.orchestra.run.smithi181.stdout:(46/166): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-02-21T22:58:15.780 INFO:teuthology.orchestra.run.smithi162.stdout:(77/166): python3-jinja2-2.11.3-5.el9.noarch.rp 263 kB/s | 248 kB 00:00 2024-02-21T22:58:15.810 INFO:teuthology.orchestra.run.smithi181.stdout:(47/166): python3-cryptography-36.0.1-4.el9.x86 8.6 MB/s | 1.2 MB 00:00 2024-02-21T22:58:15.851 INFO:teuthology.orchestra.run.smithi181.stdout:(48/166): python3-pycparser-2.20-6.el9.noarch.r 1.8 MB/s | 135 kB 00:00 2024-02-21T22:58:15.877 INFO:teuthology.orchestra.run.smithi181.stdout:(49/166): python3-requests-2.25.1-8.el9.noarch. 1.8 MB/s | 125 kB 00:00 2024-02-21T22:58:15.919 INFO:teuthology.orchestra.run.smithi181.stdout:(50/166): python3-urllib3-1.26.5-5.el9.noarch.r 3.1 MB/s | 215 kB 00:00 2024-02-21T22:58:16.380 INFO:teuthology.orchestra.run.smithi162.stdout:(78/166): python3-jsonpatch-1.21-16.el9.noarch. 43 kB/s | 26 kB 00:00 2024-02-21T22:58:16.461 INFO:teuthology.orchestra.run.smithi181.stdout:(51/166): ceph-test-19.0.0-1643.g3bfc837d.el9.x 14 MB/s | 47 MB 00:03 2024-02-21T22:58:16.894 INFO:teuthology.orchestra.run.smithi181.stdout:(52/166): automake-1.16.2-8.el9.noarch.rpm 677 kB/s | 689 kB 00:01 2024-02-21T22:58:16.920 INFO:teuthology.orchestra.run.smithi181.stdout:(53/166): boost-program-options-1.75.0-8.el9.x8 233 kB/s | 107 kB 00:00 2024-02-21T22:58:16.938 INFO:teuthology.orchestra.run.smithi162.stdout:(79/166): python3-jsonpointer-2.0-4.el9.noarch. 34 kB/s | 19 kB 00:00 2024-02-21T22:58:16.970 INFO:teuthology.orchestra.run.smithi181.stdout:(54/166): bison-3.7.4-5.el9.x86_64.rpm 897 kB/s | 943 kB 00:01 2024-02-21T22:58:16.995 INFO:teuthology.orchestra.run.smithi181.stdout:(55/166): elfutils-libelf-devel-0.190-2.el9.x86 214 kB/s | 21 kB 00:00 2024-02-21T22:58:17.120 INFO:teuthology.orchestra.run.smithi181.stdout:(56/166): flexiblas-3.0.4-8.el9.x86_64.rpm 218 kB/s | 33 kB 00:00 2024-02-21T22:58:17.187 INFO:teuthology.orchestra.run.smithi181.stdout:(57/166): flex-2.6.4-9.el9.x86_64.rpm 1.1 MB/s | 313 kB 00:00 2024-02-21T22:58:17.221 INFO:teuthology.orchestra.run.smithi181.stdout:(58/166): flexiblas-openblas-openmp-3.0.4-8.el9 182 kB/s | 18 kB 00:00 2024-02-21T22:58:17.296 INFO:teuthology.orchestra.run.smithi181.stdout:(59/166): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.4 MB/s | 160 kB 00:00 2024-02-21T22:58:17.321 INFO:teuthology.orchestra.run.smithi181.stdout:(60/166): librabbitmq-0.11.0-7.el9.x86_64.rpm 451 kB/s | 45 kB 00:00 2024-02-21T22:58:17.438 INFO:teuthology.orchestra.run.smithi181.stdout:(61/166): libtool-2.4.6-45.el9.x86_64.rpm 4.9 MB/s | 582 kB 00:00 2024-02-21T22:58:17.580 INFO:teuthology.orchestra.run.smithi181.stdout:(62/166): flexiblas-netlib-3.0.4-8.el9.x86_64.r 5.1 MB/s | 3.0 MB 00:00 2024-02-21T22:58:17.606 INFO:teuthology.orchestra.run.smithi181.stdout:(63/166): libuuid-devel-2.37.4-15.el9.x86_64.rp 153 kB/s | 26 kB 00:00 2024-02-21T22:58:17.656 INFO:teuthology.orchestra.run.smithi181.stdout:(64/166): librdkafka-1.6.1-102.el9.x86_64.rpm 1.8 MB/s | 662 kB 00:00 2024-02-21T22:58:17.681 INFO:teuthology.orchestra.run.smithi181.stdout:(65/166): libzstd-devel-1.5.1-2.el9.x86_64.rpm 471 kB/s | 47 kB 00:00 2024-02-21T22:58:17.715 INFO:teuthology.orchestra.run.smithi181.stdout:(66/166): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.6 MB/s | 292 kB 00:00 2024-02-21T22:58:17.765 INFO:teuthology.orchestra.run.smithi181.stdout:(67/166): lua-5.4.4-4.el9.x86_64.rpm 1.7 MB/s | 188 kB 00:00 2024-02-21T22:58:17.780 INFO:teuthology.orchestra.run.smithi162.stdout:(80/166): python3-mako-1.1.4-6.el9.noarch.rpm 205 kB/s | 172 kB 00:00 2024-02-21T22:58:17.791 INFO:teuthology.orchestra.run.smithi181.stdout:(68/166): openblas-0.3.21-2.el9.x86_64.rpm 323 kB/s | 35 kB 00:00 2024-02-21T22:58:18.430 INFO:teuthology.orchestra.run.smithi162.stdout:(81/166): python3-markupsafe-1.1.1-12.el9.x86_6 53 kB/s | 35 kB 00:00 2024-02-21T22:58:18.689 INFO:teuthology.orchestra.run.smithi162.stdout:(82/166): postgresql-server-13.11-1.el9.x86_64. 729 kB/s | 5.7 MB 00:08 2024-02-21T22:58:19.648 INFO:teuthology.orchestra.run.smithi162.stdout:(83/166): python3-numpy-f2py-1.20.1-5.el9.x86_6 269 kB/s | 250 kB 00:00 2024-02-21T22:58:19.807 INFO:teuthology.orchestra.run.smithi181.stdout:(69/166): postgresql-13.11-1.el9.x86_64.rpm 803 kB/s | 1.6 MB 00:02 2024-02-21T22:58:20.060 INFO:teuthology.orchestra.run.smithi099.stdout: Preparing : 1/1 2024-02-21T22:58:20.273 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/182 2024-02-21T22:58:20.291 INFO:teuthology.orchestra.run.smithi181.stdout:(70/166): openssl-devel-3.0.7-25.el9.x86_64.rpm 1.6 MB/s | 4.1 MB 00:02 2024-02-21T22:58:20.365 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/182 2024-02-21T22:58:20.466 INFO:teuthology.orchestra.run.smithi181.stdout:(71/166): postgresql-private-libs-13.11-1.el9.x 773 kB/s | 135 kB 00:00 2024-02-21T22:58:20.501 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/182 2024-02-21T22:58:20.553 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/182 2024-02-21T22:58:20.581 INFO:teuthology.orchestra.run.smithi162.stdout:(84/166): python3-oauthlib-3.1.1-5.el9.noarch.r 238 kB/s | 222 kB 00:00 2024-02-21T22:58:20.582 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/182 2024-02-21T22:58:20.677 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/182 2024-02-21T22:58:20.883 INFO:teuthology.orchestra.run.smithi181.stdout:(72/166): postgresql-contrib-13.11-1.el9.x86_64 842 kB/s | 905 kB 00:01 2024-02-21T22:58:21.000 INFO:teuthology.orchestra.run.smithi181.stdout:(73/166): openblas-openmp-0.3.21-2.el9.x86_64.r 1.4 MB/s | 4.7 MB 00:03 2024-02-21T22:58:21.088 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/182 2024-02-21T22:58:21.109 INFO:teuthology.orchestra.run.smithi181.stdout:(74/166): python3-attrs-20.3.0-7.el9.noarch.rpm 811 kB/s | 87 kB 00:00 2024-02-21T22:58:21.165 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : librados2-2:19.0.0-1643.g3bfc837d.el9.x86_64 8/182 2024-02-21T22:58:21.281 INFO:teuthology.orchestra.run.smithi162.stdout:(85/166): python3-packaging-20.9-5.el9.noarch.r 110 kB/s | 77 kB 00:00 2024-02-21T22:58:21.327 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librados2-2:19.0.0-1643.g3bfc837d.el9.x86_64 8/182 2024-02-21T22:58:21.363 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libcephfs2-2:19.0.0-1643.g3bfc837d.el9.x86_64 9/182 2024-02-21T22:58:21.488 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: libcephfs2-2:19.0.0-1643.g3bfc837d.el9.x86_64 9/182 2024-02-21T22:58:21.537 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-rados-2:19.0.0-1643.g3bfc837d.el9.x86_64 10/182 2024-02-21T22:58:21.692 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/182 2024-02-21T22:58:21.818 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 12/182 2024-02-21T22:58:21.923 INFO:teuthology.orchestra.run.smithi162.stdout:(86/166): python3-prettytable-0.7.2-27.el9.noar 66 kB/s | 42 kB 00:00 2024-02-21T22:58:22.032 INFO:teuthology.orchestra.run.smithi162.stdout:(87/166): python3-babel-2.9.1-2.el9.noarch.rpm 722 kB/s | 6.0 MB 00:08 2024-02-21T22:58:22.145 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 13/182 2024-02-21T22:58:22.159 INFO:teuthology.orchestra.run.smithi181.stdout:(75/166): protobuf-3.14.0-13.el9.x86_64.rpm 810 kB/s | 1.0 MB 00:01 2024-02-21T22:58:22.204 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : postgresql-13.11-1.el9.x86_64 14/182 2024-02-21T22:58:22.228 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libcephsqlite-2:19.0.0-1643.g3bfc837d.el9.x86_64 15/182 2024-02-21T22:58:22.362 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1643.g3bfc837d.el9.x86_64 15/182 2024-02-21T22:58:22.388 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libradosstriper1-2:19.0.0-1643.g3bfc837d.el9.x86 16/182 2024-02-21T22:58:22.426 INFO:teuthology.orchestra.run.smithi181.stdout:(76/166): python3-devel-3.9.17-2.el9.x86_64.rpm 925 kB/s | 245 kB 00:00 2024-02-21T22:58:22.484 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1643.g3bfc837d.el9.x86 16/182 2024-02-21T22:58:22.531 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : qatlib-service-23.11.0-1.el9.x86_64 17/182 2024-02-21T22:58:22.589 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: qatlib-service-23.11.0-1.el9.x86_64 17/182 2024-02-21T22:58:22.693 INFO:teuthology.orchestra.run.smithi181.stdout:(77/166): python3-jinja2-2.11.3-5.el9.noarch.rp 929 kB/s | 248 kB 00:00 2024-02-21T22:58:22.810 INFO:teuthology.orchestra.run.smithi181.stdout:(78/166): python3-jsonpatch-1.21-16.el9.noarch. 220 kB/s | 26 kB 00:00 2024-02-21T22:58:22.896 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: qatlib-23.11.0-1.el9.x86_64 18/182 2024-02-21T22:58:22.898 INFO:teuthology.orchestra.run.smithi162.stdout:(88/166): python3-pyasn1-0.4.8-6.el9.noarch.rpm 183 kB/s | 159 kB 00:00 2024-02-21T22:58:22.910 INFO:teuthology.orchestra.run.smithi181.stdout:(79/166): python3-jsonpointer-2.0-4.el9.noarch. 192 kB/s | 19 kB 00:00 2024-02-21T22:58:22.924 INFO:teuthology.orchestra.run.smithi162.stdout:(89/166): python3-protobuf-3.14.0-13.el9.noarch 269 kB/s | 269 kB 00:01 2024-02-21T22:58:22.932 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : qatlib-23.11.0-1.el9.x86_64 18/182 2024-02-21T22:58:23.102 INFO:teuthology.orchestra.run.smithi181.stdout:(80/166): python3-mako-1.1.4-6.el9.noarch.rpm 898 kB/s | 172 kB 00:00 2024-02-21T22:58:23.203 INFO:teuthology.orchestra.run.smithi181.stdout:(81/166): python3-markupsafe-1.1.1-12.el9.x86_6 348 kB/s | 35 kB 00:00 2024-02-21T22:58:23.360 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 19/182 2024-02-21T22:58:23.462 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : NetworkManager-libnm-1:1.45.91-1.el9.x86_64 20/182 2024-02-21T22:58:23.575 INFO:teuthology.orchestra.run.smithi162.stdout:(90/166): python3-pytz-2021.1-5.el9.noarch.rpm 78 kB/s | 51 kB 00:00 2024-02-21T22:58:23.584 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.91-1.el9.x86_64 20/182 2024-02-21T22:58:23.802 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: NetworkManager-1:1.45.91-1.el9.x86_64 21/182 2024-02-21T22:58:23.848 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : NetworkManager-1:1.45.91-1.el9.x86_64 21/182 2024-02-21T22:58:23.858 INFO:teuthology.orchestra.run.smithi162.stdout:(91/166): python3-pyasn1-modules-0.4.8-6.el9.no 291 kB/s | 279 kB 00:00 2024-02-21T22:58:24.179 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: NetworkManager-1:1.45.91-1.el9.x86_64 21/182 2024-02-21T22:58:24.250 INFO:teuthology.orchestra.run.smithi162.stdout:(92/166): python3-requests-oauthlib-1.3.0-12.el 79 kB/s | 54 kB 00:00 2024-02-21T22:58:24.361 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : re2-1:20211101-3.el9.x86_64 22/182 2024-02-21T22:58:24.483 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 23/182 2024-02-21T22:58:24.529 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 24/182 2024-02-21T22:58:24.579 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : liboath-2.6.7-2.el9.x86_64 25/182 2024-02-21T22:58:24.682 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 26/182 2024-02-21T22:58:24.734 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 27/182 2024-02-21T22:58:24.806 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 28/182 2024-02-21T22:58:24.854 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 29/182 2024-02-21T22:58:24.886 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : lua-5.4.4-4.el9.x86_64 30/182 2024-02-21T22:58:24.916 INFO:teuthology.orchestra.run.smithi162.stdout:(93/166): python3-toml-0.10.2-6.el9.noarch.rpm 62 kB/s | 42 kB 00:00 2024-02-21T22:58:25.003 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 31/182 2024-02-21T22:58:25.073 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 32/182 2024-02-21T22:58:25.104 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 33/182 2024-02-21T22:58:25.162 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 34/182 2024-02-21T22:58:25.268 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 35/182 2024-02-21T22:58:25.324 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-ceph-common-2:19.0.0-1643.g3bfc837d.el9. 36/182 2024-02-21T22:58:25.374 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-ceph-argparse-2:19.0.0-1643.g3bfc837d.el 37/182 2024-02-21T22:58:25.406 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cephfs-2:19.0.0-1643.g3bfc837d.el9.x86_6 38/182 2024-02-21T22:58:25.517 INFO:teuthology.orchestra.run.smithi162.stdout:(94/166): python3-numpy-1.20.1-5.el9.x86_64.rpm 737 kB/s | 5.1 MB 00:07 2024-02-21T22:58:25.522 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 39/182 2024-02-21T22:58:25.567 INFO:teuthology.orchestra.run.smithi162.stdout:(95/166): python3-wcwidth-0.2.5-8.el9.noarch.rp 68 kB/s | 44 kB 00:00 2024-02-21T22:58:25.575 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : luarocks-3.9.2-1.el9.noarch 40/182 2024-02-21T22:58:25.674 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 41/182 2024-02-21T22:58:25.855 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 42/182 2024-02-21T22:58:25.913 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 43/182 2024-02-21T22:58:26.217 INFO:teuthology.orchestra.run.smithi162.stdout:(96/166): qatlib-service-23.11.0-1.el9.x86_64.r 54 kB/s | 35 kB 00:00 2024-02-21T22:58:26.434 INFO:teuthology.orchestra.run.smithi162.stdout:(97/166): qatlib-23.11.0-1.el9.x86_64.rpm 236 kB/s | 216 kB 00:00 2024-02-21T22:58:26.609 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-rsa-4.9-2.el9.noarch 44/182 2024-02-21T22:58:26.734 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 45/182 2024-02-21T22:58:26.777 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 46/182 2024-02-21T22:58:26.827 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : qatzip-libs-1.1.2-2.el9.x86_64 47/182 2024-02-21T22:58:26.876 INFO:teuthology.orchestra.run.smithi162.stdout:(98/166): qatzip-libs-1.1.2-2.el9.x86_64.rpm 68 kB/s | 44 kB 00:00 2024-02-21T22:58:26.896 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 48/182 2024-02-21T22:58:26.947 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : librados-devel-2:19.0.0-1643.g3bfc837d.el9.x86_6 49/182 2024-02-21T22:58:27.024 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 50/182 2024-02-21T22:58:27.249 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 51/182 2024-02-21T22:58:27.299 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 52/182 2024-02-21T22:58:27.380 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 53/182 2024-02-21T22:58:27.394 INFO:teuthology.orchestra.run.smithi181.stdout:(82/166): postgresql-server-13.11-1.el9.x86_64. 849 kB/s | 5.7 MB 00:06 2024-02-21T22:58:27.451 INFO:teuthology.orchestra.run.smithi162.stdout:(99/166): socat-1.7.4.1-5.el9.x86_64.rpm 300 kB/s | 305 kB 00:01 2024-02-21T22:58:27.486 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 54/182 2024-02-21T22:58:27.523 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 55/182 2024-02-21T22:58:27.543 INFO:teuthology.orchestra.run.smithi162.stdout:(100/166): uuid-1.6.2-55.el9.x86_64.rpm 87 kB/s | 58 kB 00:00 2024-02-21T22:58:27.563 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 56/182 2024-02-21T22:58:27.631 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 57/182 2024-02-21T22:58:27.669 INFO:teuthology.orchestra.run.smithi181.stdout:(83/166): python3-numpy-f2py-1.20.1-5.el9.x86_6 912 kB/s | 250 kB 00:00 2024-02-21T22:58:27.671 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 58/182 2024-02-21T22:58:27.758 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 59/182 2024-02-21T22:58:27.820 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 60/182 2024-02-21T22:58:27.936 INFO:teuthology.orchestra.run.smithi181.stdout:(84/166): python3-oauthlib-3.1.1-5.el9.noarch.r 833 kB/s | 222 kB 00:00 2024-02-21T22:58:28.015 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 61/182 2024-02-21T22:58:28.044 INFO:teuthology.orchestra.run.smithi181.stdout:(85/166): python3-packaging-20.9-5.el9.noarch.r 713 kB/s | 77 kB 00:00 2024-02-21T22:58:28.094 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 62/182 2024-02-21T22:58:28.133 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 63/182 2024-02-21T22:58:28.153 INFO:teuthology.orchestra.run.smithi181.stdout:(86/166): python3-prettytable-0.7.2-27.el9.noar 390 kB/s | 42 kB 00:00 2024-02-21T22:58:28.202 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 64/182 2024-02-21T22:58:28.218 INFO:teuthology.orchestra.run.smithi162.stdout:(101/166): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 122 kB/s | 94 kB 00:00 2024-02-21T22:58:28.222 INFO:teuthology.orchestra.run.smithi181.stdout:(87/166): python3-numpy-1.20.1-5.el9.x86_64.rpm 1.0 MB/s | 5.1 MB 00:05 2024-02-21T22:58:28.243 INFO:teuthology.orchestra.run.smithi162.stdout:(102/166): xmlstarlet-1.6.1-20.el9.x86_64.rpm 91 kB/s | 64 kB 00:00 2024-02-21T22:58:28.331 INFO:teuthology.orchestra.run.smithi181.stdout:(88/166): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 159 kB 00:00 2024-02-21T22:58:28.341 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 65/182 2024-02-21T22:58:28.377 INFO:teuthology.orchestra.run.smithi162.stdout:(103/166): lua-devel-5.4.4-4.el9.x86_64.rpm 167 kB/s | 22 kB 00:00 2024-02-21T22:58:28.425 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-google-auth-1:2.27.0-1.el9.noarch 66/182 2024-02-21T22:58:28.473 INFO:teuthology.orchestra.run.smithi181.stdout:(89/166): python3-pyasn1-modules-0.4.8-6.el9.no 1.9 MB/s | 279 kB 00:00 2024-02-21T22:58:28.501 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 67/182 2024-02-21T22:58:28.539 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 68/182 2024-02-21T22:58:28.549 INFO:teuthology.orchestra.run.smithi181.stdout:(90/166): python3-babel-2.9.1-2.el9.noarch.rpm 821 kB/s | 6.0 MB 00:07 2024-02-21T22:58:28.564 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 69/182 2024-02-21T22:58:28.574 INFO:teuthology.orchestra.run.smithi181.stdout:(91/166): python3-protobuf-3.14.0-13.el9.noarch 640 kB/s | 269 kB 00:00 2024-02-21T22:58:28.578 INFO:teuthology.orchestra.run.smithi162.stdout:(104/166): python3-scipy-1.6.2-8.el9.x86_64.rpm 3.4 MB/s | 16 MB 00:04 2024-02-21T22:58:28.599 INFO:teuthology.orchestra.run.smithi181.stdout:(92/166): python3-pytz-2021.1-5.el9.noarch.rpm 406 kB/s | 51 kB 00:00 2024-02-21T22:58:28.650 INFO:teuthology.orchestra.run.smithi181.stdout:(93/166): python3-requests-oauthlib-1.3.0-12.el 534 kB/s | 54 kB 00:00 2024-02-21T22:58:28.700 INFO:teuthology.orchestra.run.smithi181.stdout:(94/166): python3-toml-0.10.2-6.el9.noarch.rpm 415 kB/s | 42 kB 00:00 2024-02-21T22:58:28.746 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 70/182 2024-02-21T22:58:28.750 INFO:teuthology.orchestra.run.smithi181.stdout:(95/166): python3-wcwidth-0.2.5-8.el9.noarch.rp 440 kB/s | 44 kB 00:00 2024-02-21T22:58:28.769 INFO:teuthology.orchestra.run.smithi162.stdout:(105/166): protobuf-compiler-3.14.0-13.el9.x86_ 2.2 MB/s | 863 kB 00:00 2024-02-21T22:58:28.809 INFO:teuthology.orchestra.run.smithi181.stdout:(96/166): qatlib-23.11.0-1.el9.x86_64.rpm 1.9 MB/s | 216 kB 00:00 2024-02-21T22:58:28.850 INFO:teuthology.orchestra.run.smithi181.stdout:(97/166): qatlib-service-23.11.0-1.el9.x86_64.r 348 kB/s | 35 kB 00:00 2024-02-21T22:58:28.909 INFO:teuthology.orchestra.run.smithi181.stdout:(98/166): qatzip-libs-1.1.2-2.el9.x86_64.rpm 443 kB/s | 44 kB 00:00 2024-02-21T22:58:28.930 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 71/182 2024-02-21T22:58:28.961 INFO:teuthology.orchestra.run.smithi162.stdout:(106/166): abseil-cpp-20211102.0-3.el9.x86_64.r 1.5 MB/s | 548 kB 00:00 2024-02-21T22:58:28.977 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 72/182 2024-02-21T22:58:29.009 INFO:teuthology.orchestra.run.smithi181.stdout:(99/166): uuid-1.6.2-55.el9.x86_64.rpm 579 kB/s | 58 kB 00:00 2024-02-21T22:58:29.011 INFO:teuthology.orchestra.run.smithi162.stdout:(107/166): zlib-devel-1.2.11-40.el9.x86_64.rpm 57 kB/s | 45 kB 00:00 2024-02-21T22:58:29.015 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 73/182 2024-02-21T22:58:29.037 INFO:teuthology.orchestra.run.smithi162.stdout:(108/166): grpc-data-1.46.7-10.el9.noarch.rpm 259 kB/s | 19 kB 00:00 2024-02-21T22:58:29.059 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 74/182 2024-02-21T22:58:29.096 INFO:teuthology.orchestra.run.smithi162.stdout:(109/166): gperftools-libs-2.9.1-2.el9.x86_64.r 949 kB/s | 309 kB 00:00 2024-02-21T22:58:29.118 INFO:teuthology.orchestra.run.smithi181.stdout:(100/166): socat-1.7.4.1-5.el9.x86_64.rpm 1.1 MB/s | 305 kB 00:00 2024-02-21T22:58:29.143 INFO:teuthology.orchestra.run.smithi181.stdout:(101/166): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 702 kB/s | 94 kB 00:00 2024-02-21T22:58:29.147 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : uuid-1.6.2-55.el9.x86_64 75/182 2024-02-21T22:58:29.200 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 76/182 2024-02-21T22:58:29.219 INFO:teuthology.orchestra.run.smithi181.stdout:(102/166): xmlstarlet-1.6.1-20.el9.x86_64.rpm 636 kB/s | 64 kB 00:00 2024-02-21T22:58:29.244 INFO:teuthology.orchestra.run.smithi181.stdout:(103/166): zlib-devel-1.2.11-40.el9.x86_64.rpm 449 kB/s | 45 kB 00:00 2024-02-21T22:58:29.249 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 77/182 2024-02-21T22:58:29.303 INFO:teuthology.orchestra.run.smithi181.stdout:(104/166): lua-devel-5.4.4-4.el9.x86_64.rpm 268 kB/s | 22 kB 00:00 2024-02-21T22:58:29.337 INFO:teuthology.orchestra.run.smithi162.stdout:(110/166): libarrow-doc-9.0.0-10.el9.noarch.rpm 86 kB/s | 26 kB 00:00 2024-02-21T22:58:29.360 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 78/182 2024-02-21T22:58:29.362 INFO:teuthology.orchestra.run.smithi162.stdout:(111/166): liboath-2.6.7-2.el9.x86_64.rpm 182 kB/s | 49 kB 00:00 2024-02-21T22:58:29.411 INFO:teuthology.orchestra.run.smithi181.stdout:(105/166): protobuf-compiler-3.14.0-13.el9.x86_ 5.1 MB/s | 863 kB 00:00 2024-02-21T22:58:29.412 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 79/182 2024-02-21T22:58:29.421 INFO:teuthology.orchestra.run.smithi162.stdout:(112/166): libunwind-1.6.2-1.el9.x86_64.rpm 806 kB/s | 67 kB 00:00 2024-02-21T22:58:29.446 INFO:teuthology.orchestra.run.smithi162.stdout:(113/166): luarocks-3.9.2-1.el9.noarch.rpm 1.8 MB/s | 151 kB 00:00 2024-02-21T22:58:29.507 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 80/182 2024-02-21T22:58:29.550 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 81/182 2024-02-21T22:58:29.611 INFO:teuthology.orchestra.run.smithi181.stdout:(106/166): abseil-cpp-20211102.0-3.el9.x86_64.r 1.7 MB/s | 548 kB 00:00 2024-02-21T22:58:29.637 INFO:teuthology.orchestra.run.smithi181.stdout:(107/166): gperftools-libs-2.9.1-2.el9.x86_64.r 1.3 MB/s | 309 kB 00:00 2024-02-21T22:58:29.654 INFO:teuthology.orchestra.run.smithi181.stdout:(108/166): grpc-data-1.46.7-10.el9.noarch.rpm 465 kB/s | 19 kB 00:00 2024-02-21T22:58:29.687 INFO:teuthology.orchestra.run.smithi181.stdout:(109/166): libarrow-doc-9.0.0-10.el9.noarch.rpm 775 kB/s | 26 kB 00:00 2024-02-21T22:58:29.695 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 82/182 2024-02-21T22:58:29.729 INFO:teuthology.orchestra.run.smithi181.stdout:(110/166): liboath-2.6.7-2.el9.x86_64.rpm 1.1 MB/s | 49 kB 00:00 2024-02-21T22:58:29.760 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 83/182 2024-02-21T22:58:29.771 INFO:teuthology.orchestra.run.smithi181.stdout:(111/166): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2024-02-21T22:58:29.813 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 84/182 2024-02-21T22:58:29.813 INFO:teuthology.orchestra.run.smithi162.stdout:(114/166): libarrow-9.0.0-10.el9.x86_64.rpm 5.5 MB/s | 4.4 MB 00:00 2024-02-21T22:58:29.830 INFO:teuthology.orchestra.run.smithi181.stdout:(112/166): luarocks-3.9.2-1.el9.noarch.rpm 2.5 MB/s | 151 kB 00:00 2024-02-21T22:58:29.855 INFO:teuthology.orchestra.run.smithi162.stdout:(115/166): parquet-libs-9.0.0-10.el9.x86_64.rpm 1.9 MB/s | 838 kB 00:00 2024-02-21T22:58:29.875 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 85/182 2024-02-21T22:58:29.889 INFO:teuthology.orchestra.run.smithi162.stdout:(116/166): python3-asyncssh-2.13.2-4.el9.noarch 1.2 MB/s | 548 kB 00:00 2024-02-21T22:58:29.914 INFO:teuthology.orchestra.run.smithi162.stdout:(117/166): python3-bcrypt-3.2.2-1.el9.x86_64.rp 432 kB/s | 43 kB 00:00 2024-02-21T22:58:29.939 INFO:teuthology.orchestra.run.smithi162.stdout:(118/166): python3-cachetools-4.2.4-1.el9.noarc 383 kB/s | 32 kB 00:00 2024-02-21T22:58:29.965 INFO:teuthology.orchestra.run.smithi162.stdout:(119/166): python3-certifi-2021.10.8-2.el9.noar 199 kB/s | 15 kB 00:00 2024-02-21T22:58:29.990 INFO:teuthology.orchestra.run.smithi162.stdout:(120/166): python3-cheroot-8.6.0-4.el9.noarch.r 2.2 MB/s | 172 kB 00:00 2024-02-21T22:58:30.024 INFO:teuthology.orchestra.run.smithi162.stdout:(121/166): python3-cherrypy-18.6.1-2.el9.noarch 4.2 MB/s | 358 kB 00:00 2024-02-21T22:58:30.031 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-packaging-20.9-5.el9.noarch 86/182 2024-02-21T22:58:30.074 INFO:teuthology.orchestra.run.smithi162.stdout:(122/166): python3-colorama-0.4.4-12.el9.noarch 421 kB/s | 35 kB 00:00 2024-02-21T22:58:30.080 INFO:teuthology.orchestra.run.smithi181.stdout:(113/166): parquet-libs-9.0.0-10.el9.x86_64.rpm 3.3 MB/s | 838 kB 00:00 2024-02-21T22:58:30.094 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 87/182 2024-02-21T22:58:30.099 INFO:teuthology.orchestra.run.smithi162.stdout:(123/166): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.2 MB/s | 303 kB 00:00 2024-02-21T22:58:30.125 INFO:teuthology.orchestra.run.smithi162.stdout:(124/166): python3-google-auth-2.27.0-1.el9.noa 2.0 MB/s | 203 kB 00:00 2024-02-21T22:58:30.183 INFO:teuthology.orchestra.run.smithi162.stdout:(125/166): python3-grpcio-1.46.7-10.el9.x86_64. 19 MB/s | 2.0 MB 00:00 2024-02-21T22:58:30.209 INFO:teuthology.orchestra.run.smithi162.stdout:(126/166): python3-jaraco-8.2.1-3.el9.noarch.rp 128 kB/s | 11 kB 00:00 2024-02-21T22:58:30.234 INFO:teuthology.orchestra.run.smithi162.stdout:(127/166): python3-grpcio-tools-1.46.7-10.el9.x 1.1 MB/s | 144 kB 00:00 2024-02-21T22:58:30.259 INFO:teuthology.orchestra.run.smithi162.stdout:(128/166): python3-jaraco-classes-3.2.1-5.el9.n 234 kB/s | 18 kB 00:00 2024-02-21T22:58:30.272 INFO:teuthology.orchestra.run.smithi181.stdout:(114/166): python3-asyncssh-2.13.2-4.el9.noarch 2.8 MB/s | 548 kB 00:00 2024-02-21T22:58:30.284 INFO:teuthology.orchestra.run.smithi162.stdout:(129/166): python3-jaraco-collections-3.0.0-8.e 306 kB/s | 23 kB 00:00 2024-02-21T22:58:30.310 INFO:teuthology.orchestra.run.smithi162.stdout:(130/166): python3-jaraco-functools-3.5.0-2.el9 257 kB/s | 19 kB 00:00 2024-02-21T22:58:30.335 INFO:teuthology.orchestra.run.smithi162.stdout:(131/166): python3-jaraco-text-3.2.0-6.el9.noar 260 kB/s | 20 kB 00:00 2024-02-21T22:58:30.347 INFO:teuthology.orchestra.run.smithi181.stdout:(115/166): python3-bcrypt-3.2.2-1.el9.x86_64.rp 580 kB/s | 43 kB 00:00 2024-02-21T22:58:30.377 INFO:teuthology.orchestra.run.smithi162.stdout:(132/166): python3-kubernetes-26.1.0-2.el9.noar 11 MB/s | 1.0 MB 00:00 2024-02-21T22:58:30.389 INFO:teuthology.orchestra.run.smithi181.stdout:(116/166): python3-cachetools-4.2.4-1.el9.noarc 773 kB/s | 32 kB 00:00 2024-02-21T22:58:30.402 INFO:teuthology.orchestra.run.smithi162.stdout:(133/166): python3-logutils-0.3.5-21.el9.noarch 502 kB/s | 46 kB 00:00 2024-02-21T22:58:30.427 INFO:teuthology.orchestra.run.smithi162.stdout:(134/166): python3-more-itertools-8.12.0-2.el9. 855 kB/s | 79 kB 00:00 2024-02-21T22:58:30.433 INFO:teuthology.orchestra.run.smithi181.stdout:(117/166): python3-certifi-2021.10.8-2.el9.noar 343 kB/s | 15 kB 00:00 2024-02-21T22:58:30.478 INFO:teuthology.orchestra.run.smithi162.stdout:(135/166): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-02-21T22:58:30.511 INFO:teuthology.orchestra.run.smithi162.stdout:(136/166): python3-portend-3.1.0-2.el9.noarch.r 196 kB/s | 16 kB 00:00 2024-02-21T22:58:30.525 INFO:teuthology.orchestra.run.smithi181.stdout:(118/166): python3-cheroot-8.6.0-4.el9.noarch.r 1.8 MB/s | 172 kB 00:00 2024-02-21T22:58:30.537 INFO:teuthology.orchestra.run.smithi162.stdout:(137/166): python3-natsort-7.1.1-5.el9.noarch.r 362 kB/s | 58 kB 00:00 2024-02-21T22:58:30.562 INFO:teuthology.orchestra.run.smithi162.stdout:(138/166): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.0 MB/s | 90 kB 00:00 2024-02-21T22:58:30.604 INFO:teuthology.orchestra.run.smithi162.stdout:(139/166): python3-repoze-lru-0.7-16.el9.noarch 459 kB/s | 31 kB 00:00 2024-02-21T22:58:30.629 INFO:teuthology.orchestra.run.smithi162.stdout:(140/166): python3-pyperclip-1.8.2-2.el9.noarch 240 kB/s | 28 kB 00:00 2024-02-21T22:58:30.643 INFO:teuthology.orchestra.run.smithi181.stdout:(119/166): python3-cherrypy-18.6.1-2.el9.noarch 3.0 MB/s | 358 kB 00:00 2024-02-21T22:58:30.654 INFO:teuthology.orchestra.run.smithi162.stdout:(141/166): python3-routes-2.5.1-5.el9.noarch.rp 2.0 MB/s | 188 kB 00:00 2024-02-21T22:58:30.680 INFO:teuthology.orchestra.run.smithi162.stdout:(142/166): python3-rsa-4.9-2.el9.noarch.rpm 783 kB/s | 59 kB 00:00 2024-02-21T22:58:30.705 INFO:teuthology.orchestra.run.smithi162.stdout:(143/166): python3-tempora-5.0.0-2.el9.noarch.r 473 kB/s | 36 kB 00:00 2024-02-21T22:58:30.738 INFO:teuthology.orchestra.run.smithi162.stdout:(144/166): python3-typing-extensions-4.4.0-2.el 611 kB/s | 51 kB 00:00 2024-02-21T22:58:30.751 INFO:teuthology.orchestra.run.smithi181.stdout:(120/166): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.7 MB/s | 303 kB 00:00 2024-02-21T22:58:30.764 INFO:teuthology.orchestra.run.smithi162.stdout:(145/166): python3-webob-1.8.7-6.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-02-21T22:58:30.789 INFO:teuthology.orchestra.run.smithi162.stdout:(146/166): python3-websocket-client-1.2.3-2.el9 1.0 MB/s | 90 kB 00:00 2024-02-21T22:58:30.794 INFO:teuthology.orchestra.run.smithi181.stdout:(121/166): python3-colorama-0.4.4-12.el9.noarch 851 kB/s | 35 kB 00:00 2024-02-21T22:58:30.831 INFO:teuthology.orchestra.run.smithi162.stdout:(147/166): python3-zc-lockfile-2.0-10.el9.noarc 298 kB/s | 20 kB 00:00 2024-02-21T22:58:30.868 INFO:teuthology.orchestra.run.smithi181.stdout:(122/166): python3-google-auth-2.27.0-1.el9.noa 2.6 MB/s | 203 kB 00:00 2024-02-21T22:58:30.873 INFO:teuthology.orchestra.run.smithi162.stdout:(148/166): re2-20211101-3.el9.x86_64.rpm 2.2 MB/s | 192 kB 00:00 2024-02-21T22:58:30.898 INFO:teuthology.orchestra.run.smithi162.stdout:(149/166): python3-werkzeug-2.0.3-3.el9.1.noarc 2.6 MB/s | 427 kB 00:00 2024-02-21T22:58:31.024 INFO:teuthology.orchestra.run.smithi162.stdout:(150/166): thrift-0.15.0-2.el9.x86_64.rpm 8.2 MB/s | 1.6 MB 00:00 2024-02-21T22:58:31.043 INFO:teuthology.orchestra.run.smithi181.stdout:(123/166): libarrow-9.0.0-10.el9.x86_64.rpm 3.1 MB/s | 4.4 MB 00:01 2024-02-21T22:58:31.076 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 88/182 2024-02-21T22:58:31.127 INFO:teuthology.orchestra.run.smithi181.stdout:(124/166): python3-grpcio-tools-1.46.7-10.el9.x 1.7 MB/s | 144 kB 00:00 2024-02-21T22:58:31.143 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 89/182 2024-02-21T22:58:31.166 INFO:teuthology.orchestra.run.smithi162.stdout:(151/166): NetworkManager-1.45.91-1.el9.x86_64. 16 MB/s | 2.3 MB 00:00 2024-02-21T22:58:31.186 INFO:teuthology.orchestra.run.smithi181.stdout:(125/166): python3-jaraco-8.2.1-3.el9.noarch.rp 183 kB/s | 11 kB 00:00 2024-02-21T22:58:31.193 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 90/182 2024-02-21T22:58:31.236 INFO:teuthology.orchestra.run.smithi181.stdout:(126/166): python3-jaraco-classes-3.2.1-5.el9.n 354 kB/s | 18 kB 00:00 2024-02-21T22:58:31.278 INFO:teuthology.orchestra.run.smithi181.stdout:(127/166): python3-jaraco-collections-3.0.0-8.e 561 kB/s | 23 kB 00:00 2024-02-21T22:58:31.320 INFO:teuthology.orchestra.run.smithi181.stdout:(128/166): python3-jaraco-functools-3.5.0-2.el9 466 kB/s | 19 kB 00:00 2024-02-21T22:58:31.324 INFO:teuthology.orchestra.run.smithi162.stdout:(152/166): NetworkManager-libnm-1.45.91-1.el9.x 11 MB/s | 1.8 MB 00:00 2024-02-21T22:58:31.340 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 91/182 2024-02-21T22:58:31.362 INFO:teuthology.orchestra.run.smithi181.stdout:(129/166): python3-jaraco-text-3.2.0-6.el9.noar 472 kB/s | 20 kB 00:00 2024-02-21T22:58:31.375 INFO:teuthology.orchestra.run.smithi162.stdout:(153/166): NetworkManager-team-1.45.91-1.el9.x8 850 kB/s | 42 kB 00:00 2024-02-21T22:58:31.404 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 92/182 2024-02-21T22:58:31.458 INFO:teuthology.orchestra.run.smithi162.stdout:(154/166): NetworkManager-tui-1.45.91-1.el9.x86 2.9 MB/s | 247 kB 00:00 2024-02-21T22:58:31.513 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 93/182 2024-02-21T22:58:31.517 INFO:teuthology.orchestra.run.smithi162.stdout:(155/166): acl-2.3.1-4.el9.x86_64.rpm 1.2 MB/s | 71 kB 00:00 2024-02-21T22:58:31.555 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 94/182 2024-02-21T22:58:31.556 INFO:teuthology.orchestra.run.smithi181.stdout:(130/166): python3-grpcio-1.46.7-10.el9.x86_64. 3.0 MB/s | 2.0 MB 00:00 2024-02-21T22:58:31.559 INFO:teuthology.orchestra.run.smithi162.stdout:(156/166): elfutils-debuginfod-client-0.190-2.e 874 kB/s | 36 kB 00:00 2024-02-21T22:58:31.596 INFO:teuthology.orchestra.run.smithi181.stdout:(131/166): python3-logutils-0.3.5-21.el9.noarch 1.1 MB/s | 46 kB 00:00 2024-02-21T22:58:31.638 INFO:teuthology.orchestra.run.smithi181.stdout:(132/166): python3-more-itertools-8.12.0-2.el9. 1.9 MB/s | 79 kB 00:00 2024-02-21T22:58:31.642 INFO:teuthology.orchestra.run.smithi162.stdout:(157/166): librbd1-19.0.0-1643.g3bfc837d.el9.x8 4.2 MB/s | 3.1 MB 00:00 2024-02-21T22:58:31.676 INFO:teuthology.orchestra.run.smithi162.stdout:(158/166): elfutils-libelf-0.190-2.el9.x86_64.r 1.6 MB/s | 192 kB 00:00 2024-02-21T22:58:31.680 INFO:teuthology.orchestra.run.smithi181.stdout:(133/166): python3-natsort-7.1.1-5.el9.noarch.r 1.4 MB/s | 58 kB 00:00 2024-02-21T22:58:31.718 INFO:teuthology.orchestra.run.smithi162.stdout:(159/166): libacl-2.3.1-4.el9.x86_64.rpm 553 kB/s | 23 kB 00:00 2024-02-21T22:58:31.730 INFO:teuthology.orchestra.run.smithi181.stdout:(134/166): python3-kubernetes-26.1.0-2.el9.noar 2.8 MB/s | 1.0 MB 00:00 2024-02-21T22:58:31.752 INFO:teuthology.orchestra.run.smithi162.stdout:(160/166): elfutils-libs-0.190-2.el9.x86_64.rpm 2.3 MB/s | 256 kB 00:00 2024-02-21T22:58:31.763 INFO:teuthology.orchestra.run.smithi181.stdout:(135/166): python3-portend-3.1.0-2.el9.noarch.r 498 kB/s | 16 kB 00:00 2024-02-21T22:58:31.780 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : openblas-0.3.21-2.el9.x86_64 95/182 2024-02-21T22:58:31.806 INFO:teuthology.orchestra.run.smithi181.stdout:(136/166): python3-pecan-1.4.2-3.el9.noarch.rpm 2.1 MB/s | 272 kB 00:00 2024-02-21T22:58:31.817 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 96/182 2024-02-21T22:58:31.831 INFO:teuthology.orchestra.run.smithi181.stdout:(137/166): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.3 MB/s | 90 kB 00:00 2024-02-21T22:58:31.848 INFO:teuthology.orchestra.run.smithi181.stdout:(138/166): python3-pyperclip-1.8.2-2.el9.noarch 672 kB/s | 28 kB 00:00 2024-02-21T22:58:31.852 INFO:teuthology.orchestra.run.smithi162.stdout:(161/166): openssl-3.0.7-25.el9.x86_64.rpm 9.1 MB/s | 1.2 MB 00:00 2024-02-21T22:58:31.864 INFO:teuthology.orchestra.run.smithi181.stdout:(139/166): python3-repoze-lru-0.7-16.el9.noarch 915 kB/s | 31 kB 00:00 2024-02-21T22:58:31.899 INFO:teuthology.orchestra.run.smithi181.stdout:(140/166): python3-rsa-4.9-2.el9.noarch.rpm 1.7 MB/s | 59 kB 00:00 2024-02-21T22:58:31.919 INFO:teuthology.orchestra.run.smithi162.stdout:(162/166): openssl-libs-3.0.7-25.el9.x86_64.rpm 13 MB/s | 2.2 MB 00:00 2024-02-21T22:58:31.923 INFO:teuthology.orchestra.run.smithi181.stdout:(141/166): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-02-21T22:58:31.929 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 97/182 2024-02-21T22:58:31.949 INFO:teuthology.orchestra.run.smithi181.stdout:(142/166): python3-tempora-5.0.0-2.el9.noarch.r 711 kB/s | 36 kB 00:00 2024-02-21T22:58:31.969 INFO:teuthology.orchestra.run.smithi162.stdout:(163/166): xfsdump-3.1.12-4.el9.x86_64.rpm 2.7 MB/s | 323 kB 00:00 2024-02-21T22:58:31.974 INFO:teuthology.orchestra.run.smithi181.stdout:(143/166): python3-typing-extensions-4.4.0-2.el 1.0 MB/s | 51 kB 00:00 2024-02-21T22:58:32.033 INFO:teuthology.orchestra.run.smithi181.stdout:(144/166): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2024-02-21T22:58:32.036 INFO:teuthology.orchestra.run.smithi162.stdout:(164/166): xfsprogs-6.3.0-1.el9.x86_64.rpm 9.2 MB/s | 1.1 MB 00:00 2024-02-21T22:58:32.058 INFO:teuthology.orchestra.run.smithi181.stdout:(145/166): python3-webob-1.8.7-6.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-02-21T22:58:32.109 INFO:teuthology.orchestra.run.smithi181.stdout:(146/166): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-02-21T22:58:32.192 INFO:teuthology.orchestra.run.smithi181.stdout:(147/166): python3-werkzeug-2.0.3-3.el9.1.noarc 2.6 MB/s | 427 kB 00:00 2024-02-21T22:58:32.217 INFO:teuthology.orchestra.run.smithi181.stdout:(148/166): re2-20211101-3.el9.x86_64.rpm 1.7 MB/s | 192 kB 00:00 2024-02-21T22:58:32.651 INFO:teuthology.orchestra.run.smithi181.stdout:(149/166): thrift-0.15.0-2.el9.x86_64.rpm 3.5 MB/s | 1.6 MB 00:00 2024-02-21T22:58:32.678 INFO:teuthology.orchestra.run.smithi162.stdout:(165/166): libacl-devel-2.3.1-4.el9.x86_64.rpm 105 kB/s | 74 kB 00:00 2024-02-21T22:58:32.712 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 98/182 2024-02-21T22:58:32.853 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 99/182 2024-02-21T22:58:32.993 INFO:teuthology.orchestra.run.smithi181.stdout:(150/166): librados2-19.0.0-1643.g3bfc837d.el9. 4.4 MB/s | 3.4 MB 00:00 2024-02-21T22:58:33.302 INFO:teuthology.orchestra.run.smithi181.stdout:(151/166): NetworkManager-1.45.91-1.el9.x86_64. 7.4 MB/s | 2.3 MB 00:00 2024-02-21T22:58:33.420 INFO:teuthology.orchestra.run.smithi162.stdout:(166/166): librados2-19.0.0-1643.g3bfc837d.el9. 1.3 MB/s | 3.4 MB 00:02 2024-02-21T22:58:33.424 INFO:teuthology.orchestra.run.smithi162.stdout:-------------------------------------------------------------------------------- 2024-02-21T22:58:33.424 INFO:teuthology.orchestra.run.smithi162.stdout:Total 5.4 MB/s | 222 MB 00:40 2024-02-21T22:58:33.443 INFO:teuthology.orchestra.run.smithi181.stdout:(152/166): NetworkManager-libnm-1.45.91-1.el9.x 13 MB/s | 1.8 MB 00:00 2024-02-21T22:58:33.494 INFO:teuthology.orchestra.run.smithi181.stdout:(153/166): librbd1-19.0.0-1643.g3bfc837d.el9.x8 3.7 MB/s | 3.1 MB 00:00 2024-02-21T22:58:33.636 INFO:teuthology.orchestra.run.smithi181.stdout:(154/166): NetworkManager-team-1.45.91-1.el9.x8 221 kB/s | 42 kB 00:00 2024-02-21T22:58:33.728 INFO:teuthology.orchestra.run.smithi181.stdout:(155/166): acl-2.3.1-4.el9.x86_64.rpm 1.1 MB/s | 71 kB 00:00 2024-02-21T22:58:33.836 INFO:teuthology.orchestra.run.smithi181.stdout:(156/166): elfutils-debuginfod-client-0.190-2.e 336 kB/s | 36 kB 00:00 2024-02-21T22:58:33.903 INFO:teuthology.orchestra.run.smithi181.stdout:(157/166): elfutils-libelf-0.190-2.el9.x86_64.r 2.8 MB/s | 192 kB 00:00 2024-02-21T22:58:33.928 INFO:teuthology.orchestra.run.smithi181.stdout:(158/166): NetworkManager-tui-1.45.91-1.el9.x86 569 kB/s | 247 kB 00:00 2024-02-21T22:58:33.979 INFO:teuthology.orchestra.run.smithi181.stdout:(159/166): elfutils-libs-0.190-2.el9.x86_64.rpm 3.3 MB/s | 256 kB 00:00 2024-02-21T22:58:34.004 INFO:teuthology.orchestra.run.smithi181.stdout:(160/166): libacl-2.3.1-4.el9.x86_64.rpm 306 kB/s | 23 kB 00:00 2024-02-21T22:58:34.088 INFO:teuthology.orchestra.run.smithi181.stdout:(161/166): openssl-3.0.7-25.el9.x86_64.rpm 11 MB/s | 1.2 MB 00:00 2024-02-21T22:58:34.163 INFO:teuthology.orchestra.run.smithi181.stdout:(162/166): xfsdump-3.1.12-4.el9.x86_64.rpm 4.2 MB/s | 323 kB 00:00 2024-02-21T22:58:34.238 INFO:teuthology.orchestra.run.smithi181.stdout:(163/166): xfsprogs-6.3.0-1.el9.x86_64.rpm 14 MB/s | 1.1 MB 00:00 2024-02-21T22:58:34.455 INFO:teuthology.orchestra.run.smithi181.stdout:(164/166): openssl-libs-3.0.7-25.el9.x86_64.rpm 4.8 MB/s | 2.2 MB 00:00 2024-02-21T22:58:34.481 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 100/182 2024-02-21T22:58:34.571 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 101/182 2024-02-21T22:58:34.589 INFO:teuthology.orchestra.run.smithi181.stdout:(165/166): libacl-devel-2.3.1-4.el9.x86_64.rpm 212 kB/s | 74 kB 00:00 2024-02-21T22:58:34.608 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 102/182 2024-02-21T22:58:34.676 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 103/182 2024-02-21T22:58:34.688 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction check 2024-02-21T22:58:34.954 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction check succeeded. 2024-02-21T22:58:34.954 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction test 2024-02-21T22:58:35.043 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 104/182 2024-02-21T22:58:35.076 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : librbd1-2:19.0.0-1643.g3bfc837d.el9.x86_64 105/182 2024-02-21T22:58:35.195 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librbd1-2:19.0.0-1643.g3bfc837d.el9.x86_64 105/182 2024-02-21T22:58:35.232 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-rbd-2:19.0.0-1643.g3bfc837d.el9.x86_64 106/182 2024-02-21T22:58:35.286 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 107/182 2024-02-21T22:58:35.816 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 108/182 2024-02-21T22:58:35.862 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : librgw2-2:19.0.0-1643.g3bfc837d.el9.x86_64 109/182 2024-02-21T22:58:35.953 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librgw2-2:19.0.0-1643.g3bfc837d.el9.x86_64 109/182 2024-02-21T22:58:35.981 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-rgw-2:19.0.0-1643.g3bfc837d.el9.x86_64 110/182 2024-02-21T22:58:36.780 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction test succeeded. 2024-02-21T22:58:36.781 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction 2024-02-21T22:58:37.555 INFO:teuthology.orchestra.run.smithi181.stdout:(166/166): python3-scipy-1.6.2-8.el9.x86_64.rpm 1.8 MB/s | 16 MB 00:08 2024-02-21T22:58:37.563 INFO:teuthology.orchestra.run.smithi181.stdout:-------------------------------------------------------------------------------- 2024-02-21T22:58:37.563 INFO:teuthology.orchestra.run.smithi181.stdout:Total 8.0 MB/s | 222 MB 00:27 2024-02-21T22:58:38.599 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-common-2:19.0.0-1643.g3bfc837d.el9.x86_64 111/182 2024-02-21T22:58:38.635 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-common-2:19.0.0-1643.g3bfc837d.el9.x86_64 111/182 2024-02-21T22:58:38.847 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction check 2024-02-21T22:58:39.110 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction check succeeded. 2024-02-21T22:58:39.110 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction test 2024-02-21T22:58:39.279 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-common-2:19.0.0-1643.g3bfc837d.el9.x86_64 111/182 2024-02-21T22:58:39.322 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-base-2:19.0.0-1643.g3bfc837d.el9.x86_64 112/182 2024-02-21T22:58:39.461 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-base-2:19.0.0-1643.g3bfc837d.el9.x86_64 112/182 2024-02-21T22:58:39.462 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-02-21T22:58:39.462 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-02-21T22:58:39.462 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T22:58:39.506 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-selinux-2:19.0.0-1643.g3bfc837d.el9.x86_64 113/182 2024-02-21T22:58:40.917 INFO:teuthology.orchestra.run.smithi181.stdout:Transaction test succeeded. 2024-02-21T22:58:40.917 INFO:teuthology.orchestra.run.smithi181.stdout:Running transaction 2024-02-21T22:58:43.435 INFO:teuthology.orchestra.run.smithi162.stdout: Preparing : 1/1 2024-02-21T22:58:43.556 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/182 2024-02-21T22:58:43.602 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/182 2024-02-21T22:58:43.664 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/182 2024-02-21T22:58:43.701 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/182 2024-02-21T22:58:43.726 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/182 2024-02-21T22:58:43.768 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/182 2024-02-21T22:58:44.088 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/182 2024-02-21T22:58:44.152 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : librados2-2:19.0.0-1643.g3bfc837d.el9.x86_64 8/182 2024-02-21T22:58:44.273 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librados2-2:19.0.0-1643.g3bfc837d.el9.x86_64 8/182 2024-02-21T22:58:44.303 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libcephfs2-2:19.0.0-1643.g3bfc837d.el9.x86_64 9/182 2024-02-21T22:58:44.394 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: libcephfs2-2:19.0.0-1643.g3bfc837d.el9.x86_64 9/182 2024-02-21T22:58:44.432 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-rados-2:19.0.0-1643.g3bfc837d.el9.x86_64 10/182 2024-02-21T22:58:44.513 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/182 2024-02-21T22:58:44.601 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 12/182 2024-02-21T22:58:44.776 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 13/182 2024-02-21T22:58:44.824 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : postgresql-13.11-1.el9.x86_64 14/182 2024-02-21T22:58:44.852 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libcephsqlite-2:19.0.0-1643.g3bfc837d.el9.x86_64 15/182 2024-02-21T22:58:44.956 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1643.g3bfc837d.el9.x86_64 15/182 2024-02-21T22:58:44.979 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libradosstriper1-2:19.0.0-1643.g3bfc837d.el9.x86 16/182 2024-02-21T22:58:45.056 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1643.g3bfc837d.el9.x86 16/182 2024-02-21T22:58:45.080 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : qatlib-service-23.11.0-1.el9.x86_64 17/182 2024-02-21T22:58:45.096 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: qatlib-service-23.11.0-1.el9.x86_64 17/182 2024-02-21T22:58:45.237 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: qatlib-23.11.0-1.el9.x86_64 18/182 2024-02-21T22:58:45.268 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : qatlib-23.11.0-1.el9.x86_64 18/182 2024-02-21T22:58:45.363 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 19/182 2024-02-21T22:58:45.453 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : NetworkManager-libnm-1:1.45.91-1.el9.x86_64 20/182 2024-02-21T22:58:45.497 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.91-1.el9.x86_64 20/182 2024-02-21T22:58:45.570 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: NetworkManager-1:1.45.91-1.el9.x86_64 21/182 2024-02-21T22:58:45.623 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : NetworkManager-1:1.45.91-1.el9.x86_64 21/182 2024-02-21T22:58:45.832 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: NetworkManager-1:1.45.91-1.el9.x86_64 21/182 2024-02-21T22:58:45.938 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : re2-1:20211101-3.el9.x86_64 22/182 2024-02-21T22:58:46.033 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 23/182 2024-02-21T22:58:46.078 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 24/182 2024-02-21T22:58:46.113 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : liboath-2.6.7-2.el9.x86_64 25/182 2024-02-21T22:58:46.177 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 26/182 2024-02-21T22:58:46.212 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 27/182 2024-02-21T22:58:46.256 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 28/182 2024-02-21T22:58:46.288 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 29/182 2024-02-21T22:58:46.316 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : lua-5.4.4-4.el9.x86_64 30/182 2024-02-21T22:58:46.385 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 31/182 2024-02-21T22:58:46.439 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 32/182 2024-02-21T22:58:46.470 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 33/182 2024-02-21T22:58:46.514 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 34/182 2024-02-21T22:58:46.597 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 35/182 2024-02-21T22:58:46.633 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-ceph-common-2:19.0.0-1643.g3bfc837d.el9. 36/182 2024-02-21T22:58:46.679 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-ceph-argparse-2:19.0.0-1643.g3bfc837d.el 37/182 2024-02-21T22:58:46.705 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cephfs-2:19.0.0-1643.g3bfc837d.el9.x86_6 38/182 2024-02-21T22:58:46.775 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 39/182 2024-02-21T22:58:46.820 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : luarocks-3.9.2-1.el9.noarch 40/182 2024-02-21T22:58:46.893 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 41/182 2024-02-21T22:58:47.027 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 42/182 2024-02-21T22:58:47.080 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 43/182 2024-02-21T22:58:47.509 INFO:teuthology.orchestra.run.smithi181.stdout: Preparing : 1/1 2024-02-21T22:58:47.617 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/182 2024-02-21T22:58:47.618 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-rsa-4.9-2.el9.noarch 44/182 2024-02-21T22:58:47.655 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/182 2024-02-21T22:58:47.701 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 45/182 2024-02-21T22:58:47.716 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/182 2024-02-21T22:58:47.736 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 46/182 2024-02-21T22:58:47.751 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/182 2024-02-21T22:58:47.773 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : qatzip-libs-1.1.2-2.el9.x86_64 47/182 2024-02-21T22:58:47.776 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/182 2024-02-21T22:58:47.818 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/182 2024-02-21T22:58:47.831 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 48/182 2024-02-21T22:58:47.877 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : librados-devel-2:19.0.0-1643.g3bfc837d.el9.x86_6 49/182 2024-02-21T22:58:47.919 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 50/182 2024-02-21T22:58:48.049 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 51/182 2024-02-21T22:58:48.105 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 52/182 2024-02-21T22:58:48.144 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/182 2024-02-21T22:58:48.161 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 53/182 2024-02-21T22:58:48.202 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : librados2-2:19.0.0-1643.g3bfc837d.el9.x86_64 8/182 2024-02-21T22:58:48.234 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 54/182 2024-02-21T22:58:48.265 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 55/182 2024-02-21T22:58:48.310 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 56/182 2024-02-21T22:58:48.323 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librados2-2:19.0.0-1643.g3bfc837d.el9.x86_64 8/182 2024-02-21T22:58:48.361 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libcephfs2-2:19.0.0-1643.g3bfc837d.el9.x86_64 9/182 2024-02-21T22:58:48.366 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 57/182 2024-02-21T22:58:48.401 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 58/182 2024-02-21T22:58:48.444 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 59/182 2024-02-21T22:58:48.452 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: libcephfs2-2:19.0.0-1643.g3bfc837d.el9.x86_64 9/182 2024-02-21T22:58:48.482 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-rados-2:19.0.0-1643.g3bfc837d.el9.x86_64 10/182 2024-02-21T22:58:48.486 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 60/182 2024-02-21T22:58:48.559 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/182 2024-02-21T22:58:48.620 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 61/182 2024-02-21T22:58:48.633 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 12/182 2024-02-21T22:58:48.659 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 62/182 2024-02-21T22:58:48.689 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 63/182 2024-02-21T22:58:48.731 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 64/182 2024-02-21T22:58:48.815 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 13/182 2024-02-21T22:58:48.825 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 65/182 2024-02-21T22:58:48.865 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : postgresql-13.11-1.el9.x86_64 14/182 2024-02-21T22:58:48.872 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-google-auth-1:2.27.0-1.el9.noarch 66/182 2024-02-21T22:58:48.894 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libcephsqlite-2:19.0.0-1643.g3bfc837d.el9.x86_64 15/182 2024-02-21T22:58:48.938 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 67/182 2024-02-21T22:58:48.972 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 68/182 2024-02-21T22:58:48.997 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 69/182 2024-02-21T22:58:48.997 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1643.g3bfc837d.el9.x86_64 15/182 2024-02-21T22:58:49.020 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libradosstriper1-2:19.0.0-1643.g3bfc837d.el9.x86 16/182 2024-02-21T22:58:49.069 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 70/182 2024-02-21T22:58:49.082 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1643.g3bfc837d.el9.x86 16/182 2024-02-21T22:58:49.104 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : qatlib-service-23.11.0-1.el9.x86_64 17/182 2024-02-21T22:58:49.120 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: qatlib-service-23.11.0-1.el9.x86_64 17/182 2024-02-21T22:58:49.198 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 71/182 2024-02-21T22:58:49.229 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 72/182 2024-02-21T22:58:49.257 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 73/182 2024-02-21T22:58:49.300 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 74/182 2024-02-21T22:58:49.303 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: qatlib-23.11.0-1.el9.x86_64 18/182 2024-02-21T22:58:49.333 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : qatlib-23.11.0-1.el9.x86_64 18/182 2024-02-21T22:58:49.339 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : uuid-1.6.2-55.el9.x86_64 75/182 2024-02-21T22:58:49.371 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 76/182 2024-02-21T22:58:49.400 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 77/182 2024-02-21T22:58:49.435 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 78/182 2024-02-21T22:58:49.439 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 19/182 2024-02-21T22:58:49.477 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 79/182 2024-02-21T22:58:49.526 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : NetworkManager-libnm-1:1.45.91-1.el9.x86_64 20/182 2024-02-21T22:58:49.527 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 80/182 2024-02-21T22:58:49.562 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 81/182 2024-02-21T22:58:49.595 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.91-1.el9.x86_64 20/182 2024-02-21T22:58:49.649 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 82/182 2024-02-21T22:58:49.668 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: NetworkManager-1:1.45.91-1.el9.x86_64 21/182 2024-02-21T22:58:49.692 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 83/182 2024-02-21T22:58:49.721 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : NetworkManager-1:1.45.91-1.el9.x86_64 21/182 2024-02-21T22:58:49.723 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 84/182 2024-02-21T22:58:49.770 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 85/182 2024-02-21T22:58:49.868 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-packaging-20.9-5.el9.noarch 86/182 2024-02-21T22:58:49.917 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 87/182 2024-02-21T22:58:49.926 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: NetworkManager-1:1.45.91-1.el9.x86_64 21/182 2024-02-21T22:58:50.033 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : re2-1:20211101-3.el9.x86_64 22/182 2024-02-21T22:58:50.130 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 23/182 2024-02-21T22:58:50.168 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 24/182 2024-02-21T22:58:50.202 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : liboath-2.6.7-2.el9.x86_64 25/182 2024-02-21T22:58:50.266 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 26/182 2024-02-21T22:58:50.302 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 27/182 2024-02-21T22:58:50.353 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 28/182 2024-02-21T22:58:50.386 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 29/182 2024-02-21T22:58:50.414 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : lua-5.4.4-4.el9.x86_64 30/182 2024-02-21T22:58:50.481 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 31/182 2024-02-21T22:58:50.537 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 32/182 2024-02-21T22:58:50.567 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 33/182 2024-02-21T22:58:50.602 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 34/182 2024-02-21T22:58:50.653 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 88/182 2024-02-21T22:58:50.678 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 35/182 2024-02-21T22:58:50.697 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 89/182 2024-02-21T22:58:50.713 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-ceph-common-2:19.0.0-1643.g3bfc837d.el9. 36/182 2024-02-21T22:58:50.731 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 90/182 2024-02-21T22:58:50.748 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-ceph-argparse-2:19.0.0-1643.g3bfc837d.el 37/182 2024-02-21T22:58:50.777 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cephfs-2:19.0.0-1643.g3bfc837d.el9.x86_6 38/182 2024-02-21T22:58:50.830 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 91/182 2024-02-21T22:58:50.847 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 39/182 2024-02-21T22:58:50.890 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 92/182 2024-02-21T22:58:50.891 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : luarocks-3.9.2-1.el9.noarch 40/182 2024-02-21T22:58:50.966 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 41/182 2024-02-21T22:58:50.977 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 93/182 2024-02-21T22:58:51.017 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 94/182 2024-02-21T22:58:51.102 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 42/182 2024-02-21T22:58:51.168 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 43/182 2024-02-21T22:58:51.206 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : openblas-0.3.21-2.el9.x86_64 95/182 2024-02-21T22:58:51.240 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 96/182 2024-02-21T22:58:51.318 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 97/182 2024-02-21T22:58:51.680 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-rsa-4.9-2.el9.noarch 44/182 2024-02-21T22:58:51.772 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 45/182 2024-02-21T22:58:51.800 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 46/182 2024-02-21T22:58:51.829 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : qatzip-libs-1.1.2-2.el9.x86_64 47/182 2024-02-21T22:58:51.870 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 48/182 2024-02-21T22:58:51.908 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : librados-devel-2:19.0.0-1643.g3bfc837d.el9.x86_6 49/182 2024-02-21T22:58:51.950 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 50/182 2024-02-21T22:58:51.963 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 98/182 2024-02-21T22:58:52.079 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 99/182 2024-02-21T22:58:52.087 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 51/182 2024-02-21T22:58:52.144 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 52/182 2024-02-21T22:58:52.200 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 53/182 2024-02-21T22:58:52.271 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 54/182 2024-02-21T22:58:52.303 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 55/182 2024-02-21T22:58:52.339 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 56/182 2024-02-21T22:58:52.356 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1643.g3bfc837d.el9.x86_64 113/182 2024-02-21T22:58:52.357 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /sys 2024-02-21T22:58:52.357 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /proc 2024-02-21T22:58:52.357 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /mnt 2024-02-21T22:58:52.357 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /var/tmp 2024-02-21T22:58:52.357 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /home 2024-02-21T22:58:52.357 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /root 2024-02-21T22:58:52.357 INFO:teuthology.orchestra.run.smithi099.stdout:skipping the directory /tmp 2024-02-21T22:58:52.357 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T22:58:52.386 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 57/182 2024-02-21T22:58:52.422 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 58/182 2024-02-21T22:58:52.474 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 59/182 2024-02-21T22:58:52.516 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 60/182 2024-02-21T22:58:52.575 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-volume-2:19.0.0-1643.g3bfc837d.el9.noarch 114/182 2024-02-21T22:58:52.622 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-volume-2:19.0.0-1643.g3bfc837d.el9.noarch 114/182 2024-02-21T22:58:52.622 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T22:58:52.622 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-02-21T22:58:52.622 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T22:58:52.647 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 61/182 2024-02-21T22:58:52.688 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 62/182 2024-02-21T22:58:52.718 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 63/182 2024-02-21T22:58:52.759 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 64/182 2024-02-21T22:58:52.854 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 65/182 2024-02-21T22:58:52.901 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-google-auth-1:2.27.0-1.el9.noarch 66/182 2024-02-21T22:58:52.941 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 67/182 2024-02-21T22:58:52.967 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 68/182 2024-02-21T22:58:53.001 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 69/182 2024-02-21T22:58:53.072 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 70/182 2024-02-21T22:58:53.200 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 71/182 2024-02-21T22:58:53.242 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 72/182 2024-02-21T22:58:53.270 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 73/182 2024-02-21T22:58:53.303 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 100/182 2024-02-21T22:58:53.304 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 74/182 2024-02-21T22:58:53.343 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : uuid-1.6.2-55.el9.x86_64 75/182 2024-02-21T22:58:53.374 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 76/182 2024-02-21T22:58:53.378 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 101/182 2024-02-21T22:58:53.404 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 77/182 2024-02-21T22:58:53.406 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 102/182 2024-02-21T22:58:53.439 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 78/182 2024-02-21T22:58:53.439 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 103/182 2024-02-21T22:58:53.472 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 79/182 2024-02-21T22:58:53.514 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 80/182 2024-02-21T22:58:53.548 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 81/182 2024-02-21T22:58:53.635 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 82/182 2024-02-21T22:58:53.687 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 83/182 2024-02-21T22:58:53.718 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 84/182 2024-02-21T22:58:53.753 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 104/182 2024-02-21T22:58:53.765 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 85/182 2024-02-21T22:58:53.778 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : librbd1-2:19.0.0-1643.g3bfc837d.el9.x86_64 105/182 2024-02-21T22:58:53.852 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librbd1-2:19.0.0-1643.g3bfc837d.el9.x86_64 105/182 2024-02-21T22:58:53.862 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-packaging-20.9-5.el9.noarch 86/182 2024-02-21T22:58:53.883 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-rbd-2:19.0.0-1643.g3bfc837d.el9.x86_64 106/182 2024-02-21T22:58:53.912 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 87/182 2024-02-21T22:58:53.973 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 107/182 2024-02-21T22:58:54.244 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-osd-2:19.0.0-1643.g3bfc837d.el9.x86_64 115/182 2024-02-21T22:58:54.321 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-osd-2:19.0.0-1643.g3bfc837d.el9.x86_64 115/182 2024-02-21T22:58:54.321 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T22:58:54.321 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-02-21T22:58:54.321 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-21T22:58:54.321 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-21T22:58:54.321 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T22:58:54.373 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 108/182 2024-02-21T22:58:54.398 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : librgw2-2:19.0.0-1643.g3bfc837d.el9.x86_64 109/182 2024-02-21T22:58:54.453 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librgw2-2:19.0.0-1643.g3bfc837d.el9.x86_64 109/182 2024-02-21T22:58:54.483 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-rgw-2:19.0.0-1643.g3bfc837d.el9.x86_64 110/182 2024-02-21T22:58:54.577 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mds-2:19.0.0-1643.g3bfc837d.el9.x86_64 116/182 2024-02-21T22:58:54.639 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 88/182 2024-02-21T22:58:54.646 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mds-2:19.0.0-1643.g3bfc837d.el9.x86_64 116/182 2024-02-21T22:58:54.646 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T22:58:54.646 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-02-21T22:58:54.646 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-21T22:58:54.646 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-21T22:58:54.646 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T22:58:54.892 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 89/182 2024-02-21T22:58:54.925 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 90/182 2024-02-21T22:58:55.023 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 91/182 2024-02-21T22:58:55.075 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 92/182 2024-02-21T22:58:55.137 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mon-2:19.0.0-1643.g3bfc837d.el9.x86_64 117/182 2024-02-21T22:58:55.152 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 93/182 2024-02-21T22:58:55.194 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 94/182 2024-02-21T22:58:55.204 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mon-2:19.0.0-1643.g3bfc837d.el9.x86_64 117/182 2024-02-21T22:58:55.204 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T22:58:55.204 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-02-21T22:58:55.204 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-21T22:58:55.204 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-21T22:58:55.204 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T22:58:55.336 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : automake-1.16.2-8.el9.noarch 118/182 2024-02-21T22:58:55.371 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : openblas-0.3.21-2.el9.x86_64 95/182 2024-02-21T22:58:55.400 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-ply-3.11-14.el9.noarch 119/182 2024-02-21T22:58:55.400 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 96/182 2024-02-21T22:58:55.477 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 97/182 2024-02-21T22:58:55.483 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 120/182 2024-02-21T22:58:55.714 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 121/182 2024-02-21T22:58:55.774 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 122/182 2024-02-21T22:58:55.859 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 123/182 2024-02-21T22:58:55.967 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 124/182 2024-02-21T22:58:56.116 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 98/182 2024-02-21T22:58:56.184 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 125/182 2024-02-21T22:58:56.222 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 99/182 2024-02-21T22:58:56.231 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-asyncssh-2.13.2-4.el9.noarch 126/182 2024-02-21T22:58:56.307 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 127/182 2024-02-21T22:58:56.347 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 128/182 2024-02-21T22:58:56.387 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : jq-1.6-16.el9.x86_64 129/182 2024-02-21T22:58:56.415 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : fuse-2.9.9-15.el9.x86_64 130/182 2024-02-21T22:58:56.745 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-common-2:19.0.0-1643.g3bfc837d.el9.x86_64 111/182 2024-02-21T22:58:56.781 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-common-2:19.0.0-1643.g3bfc837d.el9.x86_64 111/182 2024-02-21T22:58:57.111 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: cephadm-2:19.0.0-1643.g3bfc837d.el9.noarch 131/182 2024-02-21T22:58:57.143 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : cephadm-2:19.0.0-1643.g3bfc837d.el9.noarch 131/182 2024-02-21T22:58:57.187 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1643.g3bfc837d.e 132/182 2024-02-21T22:58:57.286 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1643.g3bfc837d. 133/182 2024-02-21T22:58:57.319 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1643.g3bfc837d.el9.noa 134/182 2024-02-21T22:58:57.320 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-common-2:19.0.0-1643.g3bfc837d.el9.x86_64 111/182 2024-02-21T22:58:57.369 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-base-2:19.0.0-1643.g3bfc837d.el9.x86_64 112/182 2024-02-21T22:58:57.435 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 100/182 2024-02-21T22:58:57.450 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-base-2:19.0.0-1643.g3bfc837d.el9.x86_64 112/182 2024-02-21T22:58:57.450 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-02-21T22:58:57.450 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-02-21T22:58:57.450 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-02-21T22:58:57.495 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-selinux-2:19.0.0-1643.g3bfc837d.el9.x86_64 113/182 2024-02-21T22:58:57.521 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 101/182 2024-02-21T22:58:57.548 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 102/182 2024-02-21T22:58:57.573 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 103/182 2024-02-21T22:58:57.642 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1643.g3bfc837d.el9.noa 134/182 2024-02-21T22:58:57.699 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1643.g3bfc837d.el9.n 135/182 2024-02-21T22:58:57.875 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 104/182 2024-02-21T22:58:57.903 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : librbd1-2:19.0.0-1643.g3bfc837d.el9.x86_64 105/182 2024-02-21T22:58:57.978 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librbd1-2:19.0.0-1643.g3bfc837d.el9.x86_64 105/182 2024-02-21T22:58:58.007 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-rbd-2:19.0.0-1643.g3bfc837d.el9.x86_64 106/182 2024-02-21T22:58:58.066 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 107/182 2024-02-21T22:58:58.520 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 108/182 2024-02-21T22:58:58.548 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : librgw2-2:19.0.0-1643.g3bfc837d.el9.x86_64 109/182 2024-02-21T22:58:58.602 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librgw2-2:19.0.0-1643.g3bfc837d.el9.x86_64 109/182 2024-02-21T22:58:58.633 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-rgw-2:19.0.0-1643.g3bfc837d.el9.x86_64 110/182 2024-02-21T22:58:58.821 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1643.g3bfc837d.el9.n 135/182 2024-02-21T22:58:58.854 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1643.g3bf 136/182 2024-02-21T22:58:58.996 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1643.g3bf 136/182 2024-02-21T22:58:59.167 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1643.g3bfc837d.el 137/182 2024-02-21T22:58:59.198 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-2:19.0.0-1643.g3bfc837d.el9.x86_64 138/182 2024-02-21T22:58:59.266 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1643.g3bfc837d.el9.x86_64 138/182 2024-02-21T22:58:59.266 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T22:58:59.267 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-02-21T22:58:59.267 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-21T22:58:59.267 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-21T22:58:59.267 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T22:58:59.332 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-mgr-rook-2:19.0.0-1643.g3bfc837d.el9.noarch 139/182 2024-02-21T22:58:59.369 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1643.g3bfc837d.el9.noarch 139/182 2024-02-21T22:58:59.513 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-2:19.0.0-1643.g3bfc837d.el9.x86_64 140/182 2024-02-21T22:59:00.872 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-common-2:19.0.0-1643.g3bfc837d.el9.x86_64 111/182 2024-02-21T22:59:00.912 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-common-2:19.0.0-1643.g3bfc837d.el9.x86_64 111/182 2024-02-21T22:59:01.450 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-common-2:19.0.0-1643.g3bfc837d.el9.x86_64 111/182 2024-02-21T22:59:01.505 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-base-2:19.0.0-1643.g3bfc837d.el9.x86_64 112/182 2024-02-21T22:59:01.589 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-base-2:19.0.0-1643.g3bfc837d.el9.x86_64 112/182 2024-02-21T22:59:01.589 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-02-21T22:59:01.589 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-02-21T22:59:01.589 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-02-21T22:59:01.617 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-selinux-2:19.0.0-1643.g3bfc837d.el9.x86_64 113/182 2024-02-21T22:59:04.263 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-fuse-2:19.0.0-1643.g3bfc837d.el9.x86_64 141/182 2024-02-21T22:59:04.381 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-test-2:19.0.0-1643.g3bfc837d.el9.x86_64 142/182 2024-02-21T22:59:05.310 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libtool-2.4.6-45.el9.x86_64 143/182 2024-02-21T22:59:05.345 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-radosgw-2:19.0.0-1643.g3bfc837d.el9.x86_64 144/182 2024-02-21T22:59:05.422 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1643.g3bfc837d.el9.x86_64 144/182 2024-02-21T22:59:05.422 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T22:59:05.422 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-02-21T22:59:05.422 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-21T22:59:05.422 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-21T22:59:05.422 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T22:59:05.471 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1643.g3bfc8 145/182 2024-02-21T22:59:05.543 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1643.g3bfc8 145/182 2024-02-21T22:59:05.543 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T22:59:05.543 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-02-21T22:59:05.544 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T22:59:05.613 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : cephfs-mirror-2:19.0.0-1643.g3bfc837d.el9.x86_64 146/182 2024-02-21T22:59:05.687 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-1643.g3bfc837d.el9.x86_64 146/182 2024-02-21T22:59:05.687 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T22:59:05.687 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-02-21T22:59:05.687 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-02-21T22:59:05.687 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-02-21T22:59:05.688 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T22:59:06.031 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : rbd-mirror-2:19.0.0-1643.g3bfc837d.el9.x86_64 147/182 2024-02-21T22:59:06.105 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1643.g3bfc837d.el9.x86_64 147/182 2024-02-21T22:59:06.105 INFO:teuthology.orchestra.run.smithi099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T22:59:06.105 INFO:teuthology.orchestra.run.smithi099.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-02-21T22:59:06.105 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-21T22:59:06.105 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-21T22:59:06.105 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T22:59:06.175 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : rbd-fuse-2:19.0.0-1643.g3bfc837d.el9.x86_64 148/182 2024-02-21T22:59:06.240 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : rbd-nbd-2:19.0.0-1643.g3bfc837d.el9.x86_64 149/182 2024-02-21T22:59:06.275 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 150/182 2024-02-21T22:59:06.321 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 151/182 2024-02-21T22:59:06.626 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : cephfs-shell-2:19.0.0-1643.g3bfc837d.el9.x86_64 152/182 2024-02-21T22:59:06.698 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 153/182 2024-02-21T22:59:06.736 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libcephfs-devel-2:19.0.0-1643.g3bfc837d.el9.x86_ 154/182 2024-02-21T22:59:06.792 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 155/182 2024-02-21T22:59:06.839 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : NetworkManager-team-1:1.45.91-1.el9.x86_64 156/182 2024-02-21T22:59:06.911 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : NetworkManager-tui-1:1.45.91-1.el9.x86_64 157/182 2024-02-21T22:59:07.016 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 158/182 2024-02-21T22:59:07.088 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 159/182 2024-02-21T22:59:08.028 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 160/182 2024-02-21T22:59:08.089 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 160/182 2024-02-21T22:59:08.182 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 160/182 2024-02-21T22:59:08.245 INFO:teuthology.orchestra.run.smithi099.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/182 2024-02-21T22:59:09.180 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1643.g3bfc837d.el9.x86_64 113/182 2024-02-21T22:59:09.180 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /sys 2024-02-21T22:59:09.180 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /proc 2024-02-21T22:59:09.180 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /mnt 2024-02-21T22:59:09.180 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /var/tmp 2024-02-21T22:59:09.180 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /home 2024-02-21T22:59:09.180 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /root 2024-02-21T22:59:09.180 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /tmp 2024-02-21T22:59:09.180 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-02-21T22:59:09.341 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-volume-2:19.0.0-1643.g3bfc837d.el9.noarch 114/182 2024-02-21T22:59:09.357 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-volume-2:19.0.0-1643.g3bfc837d.el9.noarch 114/182 2024-02-21T22:59:09.357 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T22:59:09.358 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-02-21T22:59:09.358 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-02-21T22:59:09.620 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : cephfs-top-2:19.0.0-1643.g3bfc837d.el9.noarch 162/182 2024-02-21T22:59:09.741 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 163/182 2024-02-21T22:59:09.853 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : flex-2.6.4-9.el9.x86_64 164/182 2024-02-21T22:59:09.896 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : bison-3.7.4-5.el9.x86_64 165/182 2024-02-21T22:59:09.921 INFO:teuthology.orchestra.run.smithi099.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 166/182 2024-02-21T22:59:09.946 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 167/182 2024-02-21T22:59:09.981 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/182 2024-02-21T22:59:10.025 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 169/182 2024-02-21T22:59:10.025 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 170/182 2024-02-21T22:59:10.189 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 170/182 2024-02-21T22:59:10.236 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 171/182 2024-02-21T22:59:10.285 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 172/182 2024-02-21T22:59:10.319 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 173/182 2024-02-21T22:59:10.352 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 174/182 2024-02-21T22:59:10.352 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 175/182 2024-02-21T22:59:10.498 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 175/182 2024-02-21T22:59:10.553 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 176/182 2024-02-21T22:59:10.589 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 177/182 2024-02-21T22:59:10.589 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 177/182 2024-02-21T22:59:10.853 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-osd-2:19.0.0-1643.g3bfc837d.el9.x86_64 115/182 2024-02-21T22:59:10.879 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-osd-2:19.0.0-1643.g3bfc837d.el9.x86_64 115/182 2024-02-21T22:59:10.879 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T22:59:10.879 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-02-21T22:59:10.879 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-21T22:59:10.879 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-21T22:59:10.879 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-02-21T22:59:10.927 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 177/182 2024-02-21T22:59:10.927 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 178/182 2024-02-21T22:59:11.069 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 178/182 2024-02-21T22:59:11.106 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 179/182 2024-02-21T22:59:11.112 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mds-2:19.0.0-1643.g3bfc837d.el9.x86_64 116/182 2024-02-21T22:59:11.135 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mds-2:19.0.0-1643.g3bfc837d.el9.x86_64 116/182 2024-02-21T22:59:11.135 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T22:59:11.135 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-02-21T22:59:11.136 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-21T22:59:11.136 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-21T22:59:11.136 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-02-21T22:59:11.141 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 180/182 2024-02-21T22:59:11.182 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 181/182 2024-02-21T22:59:11.329 INFO:teuthology.orchestra.run.smithi099.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 182/182 2024-02-21T22:59:11.588 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mon-2:19.0.0-1643.g3bfc837d.el9.x86_64 117/182 2024-02-21T22:59:11.591 INFO:teuthology.orchestra.run.smithi099.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 182/182 2024-02-21T22:59:11.591 INFO:teuthology.orchestra.run.smithi099.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-02-21T22:59:11.591 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T22:59:11.611 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mon-2:19.0.0-1643.g3bfc837d.el9.x86_64 117/182 2024-02-21T22:59:11.611 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T22:59:11.611 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-02-21T22:59:11.611 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-21T22:59:11.611 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-21T22:59:11.611 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-02-21T22:59:11.726 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : automake-1.16.2-8.el9.noarch 118/182 2024-02-21T22:59:11.775 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-ply-3.11-14.el9.noarch 119/182 2024-02-21T22:59:11.830 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 120/182 2024-02-21T22:59:12.017 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 121/182 2024-02-21T22:59:12.064 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 122/182 2024-02-21T22:59:12.142 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 123/182 2024-02-21T22:59:12.231 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 124/182 2024-02-21T22:59:12.372 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 125/182 2024-02-21T22:59:12.414 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-asyncssh-2.13.2-4.el9.noarch 126/182 2024-02-21T22:59:12.447 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 127/182 2024-02-21T22:59:12.479 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 128/182 2024-02-21T22:59:12.514 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : jq-1.6-16.el9.x86_64 129/182 2024-02-21T22:59:12.551 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : fuse-2.9.9-15.el9.x86_64 130/182 2024-02-21T22:59:12.920 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: cephadm-2:19.0.0-1643.g3bfc837d.el9.noarch 131/182 2024-02-21T22:59:12.949 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : cephadm-2:19.0.0-1643.g3bfc837d.el9.noarch 131/182 2024-02-21T22:59:12.981 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1643.g3bfc837d.e 132/182 2024-02-21T22:59:13.019 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1643.g3bfc837d.el9.x86_64 113/182 2024-02-21T22:59:13.019 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /sys 2024-02-21T22:59:13.019 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /proc 2024-02-21T22:59:13.019 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /mnt 2024-02-21T22:59:13.019 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /var/tmp 2024-02-21T22:59:13.020 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /home 2024-02-21T22:59:13.020 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /root 2024-02-21T22:59:13.020 INFO:teuthology.orchestra.run.smithi181.stdout:skipping the directory /tmp 2024-02-21T22:59:13.020 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-02-21T22:59:13.061 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1643.g3bfc837d. 133/182 2024-02-21T22:59:13.089 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1643.g3bfc837d.el9.noa 134/182 2024-02-21T22:59:13.186 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-volume-2:19.0.0-1643.g3bfc837d.el9.noarch 114/182 2024-02-21T22:59:13.201 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-volume-2:19.0.0-1643.g3bfc837d.el9.noarch 114/182 2024-02-21T22:59:13.201 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T22:59:13.201 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-02-21T22:59:13.201 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-02-21T22:59:13.319 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1643.g3bfc837d.el9.noa 134/182 2024-02-21T22:59:13.357 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1643.g3bfc837d.el9.n 135/182 2024-02-21T22:59:14.325 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1643.g3bfc837d.el9.n 135/182 2024-02-21T22:59:14.357 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1643.g3bf 136/182 2024-02-21T22:59:14.457 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1643.g3bf 136/182 2024-02-21T22:59:14.620 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1643.g3bfc837d.el 137/182 2024-02-21T22:59:14.651 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-2:19.0.0-1643.g3bfc837d.el9.x86_64 138/182 2024-02-21T22:59:14.675 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1643.g3bfc837d.el9.x86_64 138/182 2024-02-21T22:59:14.675 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T22:59:14.675 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-02-21T22:59:14.675 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-21T22:59:14.675 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-21T22:59:14.675 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-02-21T22:59:14.680 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-osd-2:19.0.0-1643.g3bfc837d.el9.x86_64 115/182 2024-02-21T22:59:14.706 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-osd-2:19.0.0-1643.g3bfc837d.el9.x86_64 115/182 2024-02-21T22:59:14.706 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T22:59:14.706 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-02-21T22:59:14.706 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-21T22:59:14.706 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-21T22:59:14.706 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-02-21T22:59:14.719 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-rook-2:19.0.0-1643.g3bfc837d.el9.noarch 139/182 2024-02-21T22:59:14.730 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1643.g3bfc837d.el9.noarch 139/182 2024-02-21T22:59:14.829 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-2:19.0.0-1643.g3bfc837d.el9.x86_64 140/182 2024-02-21T22:59:14.932 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mds-2:19.0.0-1643.g3bfc837d.el9.x86_64 116/182 2024-02-21T22:59:14.955 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mds-2:19.0.0-1643.g3bfc837d.el9.x86_64 116/182 2024-02-21T22:59:14.955 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T22:59:14.955 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-02-21T22:59:14.955 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-21T22:59:14.955 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-21T22:59:14.955 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-02-21T22:59:15.400 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mon-2:19.0.0-1643.g3bfc837d.el9.x86_64 117/182 2024-02-21T22:59:15.422 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mon-2:19.0.0-1643.g3bfc837d.el9.x86_64 117/182 2024-02-21T22:59:15.422 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T22:59:15.422 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-02-21T22:59:15.423 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-21T22:59:15.423 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-21T22:59:15.423 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-02-21T22:59:15.530 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : automake-1.16.2-8.el9.noarch 118/182 2024-02-21T22:59:15.587 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-ply-3.11-14.el9.noarch 119/182 2024-02-21T22:59:15.642 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 120/182 2024-02-21T22:59:15.827 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 121/182 2024-02-21T22:59:15.892 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 122/182 2024-02-21T22:59:15.961 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 123/182 2024-02-21T22:59:16.049 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 124/182 2024-02-21T22:59:16.182 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 125/182 2024-02-21T22:59:16.234 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-asyncssh-2.13.2-4.el9.noarch 126/182 2024-02-21T22:59:16.267 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 127/182 2024-02-21T22:59:16.299 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 128/182 2024-02-21T22:59:16.334 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : jq-1.6-16.el9.x86_64 129/182 2024-02-21T22:59:16.362 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : fuse-2.9.9-15.el9.x86_64 130/182 2024-02-21T22:59:16.756 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-2:19.0.0-1643.g3bfc837d.el9.x86_64 1/182 2024-02-21T22:59:16.757 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-base-2:19.0.0-1643.g3bfc837d.el9.x86_64 2/182 2024-02-21T22:59:16.757 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-common-2:19.0.0-1643.g3bfc837d.el9.x86_64 3/182 2024-02-21T22:59:16.757 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-fuse-2:19.0.0-1643.g3bfc837d.el9.x86_64 4/182 2024-02-21T22:59:16.757 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1643.g3bfc8 5/182 2024-02-21T22:59:16.757 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mds-2:19.0.0-1643.g3bfc837d.el9.x86_64 6/182 2024-02-21T22:59:16.757 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-2:19.0.0-1643.g3bfc837d.el9.x86_64 7/182 2024-02-21T22:59:16.757 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mon-2:19.0.0-1643.g3bfc837d.el9.x86_64 8/182 2024-02-21T22:59:16.757 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-osd-2:19.0.0-1643.g3bfc837d.el9.x86_64 9/182 2024-02-21T22:59:16.757 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-radosgw-2:19.0.0-1643.g3bfc837d.el9.x86_64 10/182 2024-02-21T22:59:16.757 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-selinux-2:19.0.0-1643.g3bfc837d.el9.x86_64 11/182 2024-02-21T22:59:16.757 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-test-2:19.0.0-1643.g3bfc837d.el9.x86_64 12/182 2024-02-21T22:59:16.757 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : cephfs-mirror-2:19.0.0-1643.g3bfc837d.el9.x86_64 13/182 2024-02-21T22:59:16.758 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : cephfs-shell-2:19.0.0-1643.g3bfc837d.el9.x86_64 14/182 2024-02-21T22:59:16.758 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libcephfs-devel-2:19.0.0-1643.g3bfc837d.el9.x86_ 15/182 2024-02-21T22:59:16.758 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libcephfs2-2:19.0.0-1643.g3bfc837d.el9.x86_64 16/182 2024-02-21T22:59:16.758 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libcephsqlite-2:19.0.0-1643.g3bfc837d.el9.x86_64 17/182 2024-02-21T22:59:16.758 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librados-devel-2:19.0.0-1643.g3bfc837d.el9.x86_6 18/182 2024-02-21T22:59:16.758 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libradosstriper1-2:19.0.0-1643.g3bfc837d.el9.x86 19/182 2024-02-21T22:59:16.758 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librgw2-2:19.0.0-1643.g3bfc837d.el9.x86_64 20/182 2024-02-21T22:59:16.758 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1643.g3bfc837d.el 21/182 2024-02-21T22:59:16.758 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-ceph-common-2:19.0.0-1643.g3bfc837d.el9. 22/182 2024-02-21T22:59:16.758 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cephfs-2:19.0.0-1643.g3bfc837d.el9.x86_6 23/182 2024-02-21T22:59:16.758 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-rados-2:19.0.0-1643.g3bfc837d.el9.x86_64 24/182 2024-02-21T22:59:16.758 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-rbd-2:19.0.0-1643.g3bfc837d.el9.x86_64 25/182 2024-02-21T22:59:16.759 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-rgw-2:19.0.0-1643.g3bfc837d.el9.x86_64 26/182 2024-02-21T22:59:16.759 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : rbd-fuse-2:19.0.0-1643.g3bfc837d.el9.x86_64 27/182 2024-02-21T22:59:16.773 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : rbd-mirror-2:19.0.0-1643.g3bfc837d.el9.x86_64 28/182 2024-02-21T22:59:16.774 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : rbd-nbd-2:19.0.0-1643.g3bfc837d.el9.x86_64 29/182 2024-02-21T22:59:16.774 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1643.g3bfc837d. 30/182 2024-02-21T22:59:16.774 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1643.g3bfc837d.el9.noa 31/182 2024-02-21T22:59:16.774 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1643.g3bfc837d.el9.n 32/182 2024-02-21T22:59:16.774 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1643.g3bf 33/182 2024-02-21T22:59:16.774 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1643.g3bfc837d.el 34/182 2024-02-21T22:59:16.774 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1643.g3bfc837d.el9.noarch 35/182 2024-02-21T22:59:16.774 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1643.g3bfc837d.e 36/182 2024-02-21T22:59:16.774 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : ceph-volume-2:19.0.0-1643.g3bfc837d.el9.noarch 37/182 2024-02-21T22:59:16.774 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : cephadm-2:19.0.0-1643.g3bfc837d.el9.noarch 38/182 2024-02-21T22:59:16.774 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : cephfs-top-2:19.0.0-1643.g3bfc837d.el9.noarch 39/182 2024-02-21T22:59:16.774 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 40/182 2024-02-21T22:59:16.774 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 41/182 2024-02-21T22:59:16.774 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : jq-1.6-16.el9.x86_64 42/182 2024-02-21T22:59:16.775 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 43/182 2024-02-21T22:59:16.775 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 44/182 2024-02-21T22:59:16.775 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 45/182 2024-02-21T22:59:16.775 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/182 2024-02-21T22:59:16.775 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 47/182 2024-02-21T22:59:16.775 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-ply-3.11-14.el9.noarch 48/182 2024-02-21T22:59:16.775 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 49/182 2024-02-21T22:59:16.775 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 50/182 2024-02-21T22:59:16.775 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 51/182 2024-02-21T22:59:16.775 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : automake-1.16.2-8.el9.noarch 52/182 2024-02-21T22:59:16.775 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : bison-3.7.4-5.el9.x86_64 53/182 2024-02-21T22:59:16.775 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 54/182 2024-02-21T22:59:16.775 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 55/182 2024-02-21T22:59:16.775 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : flex-2.6.4-9.el9.x86_64 56/182 2024-02-21T22:59:16.776 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 57/182 2024-02-21T22:59:16.776 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 58/182 2024-02-21T22:59:16.776 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 59/182 2024-02-21T22:59:16.776 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 60/182 2024-02-21T22:59:16.776 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 61/182 2024-02-21T22:59:16.776 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 62/182 2024-02-21T22:59:16.776 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 63/182 2024-02-21T22:59:16.776 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 64/182 2024-02-21T22:59:16.776 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 65/182 2024-02-21T22:59:16.776 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 66/182 2024-02-21T22:59:16.776 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : lua-5.4.4-4.el9.x86_64 67/182 2024-02-21T22:59:16.777 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 68/182 2024-02-21T22:59:16.777 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 69/182 2024-02-21T22:59:16.777 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 70/182 2024-02-21T22:59:16.777 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : postgresql-13.11-1.el9.x86_64 71/182 2024-02-21T22:59:16.777 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 72/182 2024-02-21T22:59:16.777 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 73/182 2024-02-21T22:59:16.777 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 74/182 2024-02-21T22:59:16.777 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 75/182 2024-02-21T22:59:16.777 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 76/182 2024-02-21T22:59:16.777 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 77/182 2024-02-21T22:59:16.777 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 78/182 2024-02-21T22:59:16.777 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 79/182 2024-02-21T22:59:16.777 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/182 2024-02-21T22:59:16.777 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/182 2024-02-21T22:59:16.778 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/182 2024-02-21T22:59:16.778 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/182 2024-02-21T22:59:16.778 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/182 2024-02-21T22:59:16.778 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/182 2024-02-21T22:59:16.778 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/182 2024-02-21T22:59:16.778 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/182 2024-02-21T22:59:16.778 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/182 2024-02-21T22:59:16.778 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/182 2024-02-21T22:59:16.778 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/182 2024-02-21T22:59:16.778 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/182 2024-02-21T22:59:16.778 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/182 2024-02-21T22:59:16.778 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/182 2024-02-21T22:59:16.779 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/182 2024-02-21T22:59:16.779 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/182 2024-02-21T22:59:16.779 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/182 2024-02-21T22:59:16.779 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : qatlib-23.11.0-1.el9.x86_64 97/182 2024-02-21T22:59:16.779 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : qatlib-service-23.11.0-1.el9.x86_64 98/182 2024-02-21T22:59:16.779 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : qatzip-libs-1.1.2-2.el9.x86_64 99/182 2024-02-21T22:59:16.779 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 100/182 2024-02-21T22:59:16.779 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/182 2024-02-21T22:59:16.779 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 102/182 2024-02-21T22:59:16.779 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/182 2024-02-21T22:59:16.779 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 104/182 2024-02-21T22:59:16.779 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/182 2024-02-21T22:59:16.779 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/182 2024-02-21T22:59:16.779 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/182 2024-02-21T22:59:16.780 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/182 2024-02-21T22:59:16.780 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/182 2024-02-21T22:59:16.780 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/182 2024-02-21T22:59:16.780 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/182 2024-02-21T22:59:16.780 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/182 2024-02-21T22:59:16.780 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/182 2024-02-21T22:59:16.780 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/182 2024-02-21T22:59:16.780 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/182 2024-02-21T22:59:16.780 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-asyncssh-2.13.2-4.el9.noarch 116/182 2024-02-21T22:59:16.780 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/182 2024-02-21T22:59:16.780 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/182 2024-02-21T22:59:16.780 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/182 2024-02-21T22:59:16.780 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/182 2024-02-21T22:59:16.780 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/182 2024-02-21T22:59:16.781 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/182 2024-02-21T22:59:16.781 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/182 2024-02-21T22:59:16.781 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-google-auth-1:2.27.0-1.el9.noarch 124/182 2024-02-21T22:59:16.781 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/182 2024-02-21T22:59:16.781 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/182 2024-02-21T22:59:16.781 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/182 2024-02-21T22:59:16.781 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/182 2024-02-21T22:59:16.781 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/182 2024-02-21T22:59:16.781 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/182 2024-02-21T22:59:16.781 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/182 2024-02-21T22:59:16.781 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/182 2024-02-21T22:59:16.781 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/182 2024-02-21T22:59:16.781 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/182 2024-02-21T22:59:16.781 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/182 2024-02-21T22:59:16.782 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/182 2024-02-21T22:59:16.782 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/182 2024-02-21T22:59:16.782 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/182 2024-02-21T22:59:16.782 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/182 2024-02-21T22:59:16.782 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/182 2024-02-21T22:59:16.782 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/182 2024-02-21T22:59:16.782 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/182 2024-02-21T22:59:16.782 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/182 2024-02-21T22:59:16.782 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/182 2024-02-21T22:59:16.782 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/182 2024-02-21T22:59:16.782 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/182 2024-02-21T22:59:16.782 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/182 2024-02-21T22:59:16.782 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/182 2024-02-21T22:59:16.782 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/182 2024-02-21T22:59:16.783 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/182 2024-02-21T22:59:16.783 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librados2-2:19.0.0-1643.g3bfc837d.el9.x86_64 151/182 2024-02-21T22:59:16.783 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/182 2024-02-21T22:59:16.783 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librbd1-2:19.0.0-1643.g3bfc837d.el9.x86_64 153/182 2024-02-21T22:59:16.783 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/182 2024-02-21T22:59:16.783 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : NetworkManager-1:1.45.91-1.el9.x86_64 155/182 2024-02-21T22:59:16.783 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 156/182 2024-02-21T22:59:16.783 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : NetworkManager-libnm-1:1.45.91-1.el9.x86_64 157/182 2024-02-21T22:59:16.783 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/182 2024-02-21T22:59:16.783 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : NetworkManager-team-1:1.45.91-1.el9.x86_64 159/182 2024-02-21T22:59:16.783 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 160/182 2024-02-21T22:59:16.783 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : NetworkManager-tui-1:1.45.91-1.el9.x86_64 161/182 2024-02-21T22:59:16.783 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 162/182 2024-02-21T22:59:16.783 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : acl-2.3.1-4.el9.x86_64 163/182 2024-02-21T22:59:16.783 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : acl-2.3.1-3.el9.x86_64 164/182 2024-02-21T22:59:16.784 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 165/182 2024-02-21T22:59:16.784 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 166/182 2024-02-21T22:59:16.784 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 167/182 2024-02-21T22:59:16.784 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 168/182 2024-02-21T22:59:16.784 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 169/182 2024-02-21T22:59:16.784 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 170/182 2024-02-21T22:59:16.784 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 171/182 2024-02-21T22:59:16.784 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 172/182 2024-02-21T22:59:16.784 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 173/182 2024-02-21T22:59:16.784 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 174/182 2024-02-21T22:59:16.784 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 175/182 2024-02-21T22:59:16.784 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 176/182 2024-02-21T22:59:16.784 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 177/182 2024-02-21T22:59:16.784 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 178/182 2024-02-21T22:59:16.785 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 179/182 2024-02-21T22:59:16.785 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 180/182 2024-02-21T22:59:16.785 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 181/182 2024-02-21T22:59:16.821 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: cephadm-2:19.0.0-1643.g3bfc837d.el9.noarch 131/182 2024-02-21T22:59:16.851 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : cephadm-2:19.0.0-1643.g3bfc837d.el9.noarch 131/182 2024-02-21T22:59:16.883 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1643.g3bfc837d.e 132/182 2024-02-21T22:59:16.943 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1643.g3bfc837d. 133/182 2024-02-21T22:59:16.966 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1643.g3bfc837d.el9.noa 134/182 2024-02-21T22:59:17.193 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1643.g3bfc837d.el9.noa 134/182 2024-02-21T22:59:17.226 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1643.g3bfc837d.el9.n 135/182 2024-02-21T22:59:18.187 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1643.g3bfc837d.el9.n 135/182 2024-02-21T22:59:18.218 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1643.g3bf 136/182 2024-02-21T22:59:18.317 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1643.g3bf 136/182 2024-02-21T22:59:18.474 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1643.g3bfc837d.el 137/182 2024-02-21T22:59:18.503 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-2:19.0.0-1643.g3bfc837d.el9.x86_64 138/182 2024-02-21T22:59:18.527 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1643.g3bfc837d.el9.x86_64 138/182 2024-02-21T22:59:18.527 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T22:59:18.527 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-02-21T22:59:18.527 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-21T22:59:18.527 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-21T22:59:18.527 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-02-21T22:59:18.571 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-mgr-rook-2:19.0.0-1643.g3bfc837d.el9.noarch 139/182 2024-02-21T22:59:18.582 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1643.g3bfc837d.el9.noarch 139/182 2024-02-21T22:59:18.679 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-2:19.0.0-1643.g3bfc837d.el9.x86_64 140/182 2024-02-21T22:59:19.223 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-fuse-2:19.0.0-1643.g3bfc837d.el9.x86_64 141/182 2024-02-21T22:59:19.287 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-test-2:19.0.0-1643.g3bfc837d.el9.x86_64 142/182 2024-02-21T22:59:19.362 INFO:teuthology.orchestra.run.smithi099.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 182/182 2024-02-21T22:59:19.362 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T22:59:19.362 INFO:teuthology.orchestra.run.smithi099.stdout:Upgraded: 2024-02-21T22:59:19.362 INFO:teuthology.orchestra.run.smithi099.stdout: NetworkManager-1:1.45.91-1.el9.x86_64 2024-02-21T22:59:19.362 INFO:teuthology.orchestra.run.smithi099.stdout: NetworkManager-libnm-1:1.45.91-1.el9.x86_64 2024-02-21T22:59:19.362 INFO:teuthology.orchestra.run.smithi099.stdout: NetworkManager-team-1:1.45.91-1.el9.x86_64 2024-02-21T22:59:19.362 INFO:teuthology.orchestra.run.smithi099.stdout: NetworkManager-tui-1:1.45.91-1.el9.x86_64 2024-02-21T22:59:19.362 INFO:teuthology.orchestra.run.smithi099.stdout: acl-2.3.1-4.el9.x86_64 2024-02-21T22:59:19.362 INFO:teuthology.orchestra.run.smithi099.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-02-21T22:59:19.362 INFO:teuthology.orchestra.run.smithi099.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-02-21T22:59:19.362 INFO:teuthology.orchestra.run.smithi099.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-02-21T22:59:19.363 INFO:teuthology.orchestra.run.smithi099.stdout: libacl-2.3.1-4.el9.x86_64 2024-02-21T22:59:19.363 INFO:teuthology.orchestra.run.smithi099.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-02-21T22:59:19.363 INFO:teuthology.orchestra.run.smithi099.stdout: librados2-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:19.363 INFO:teuthology.orchestra.run.smithi099.stdout: librbd1-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:19.363 INFO:teuthology.orchestra.run.smithi099.stdout: openssl-1:3.0.7-25.el9.x86_64 2024-02-21T22:59:19.363 INFO:teuthology.orchestra.run.smithi099.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2024-02-21T22:59:19.363 INFO:teuthology.orchestra.run.smithi099.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-02-21T22:59:19.363 INFO:teuthology.orchestra.run.smithi099.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-02-21T22:59:19.363 INFO:teuthology.orchestra.run.smithi099.stdout:Installed: 2024-02-21T22:59:19.363 INFO:teuthology.orchestra.run.smithi099.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-02-21T22:59:19.363 INFO:teuthology.orchestra.run.smithi099.stdout: automake-1.16.2-8.el9.noarch 2024-02-21T22:59:19.363 INFO:teuthology.orchestra.run.smithi099.stdout: bison-3.7.4-5.el9.x86_64 2024-02-21T22:59:19.363 INFO:teuthology.orchestra.run.smithi099.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-02-21T22:59:19.363 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:19.364 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-base-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:19.364 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-common-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:19.364 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-fuse-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:19.364 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-grafana-dashboards-2:19.0.0-1643.g3bfc837d.el9.noarch 2024-02-21T22:59:19.364 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-immutable-object-cache-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:19.364 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mds-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:19.364 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:19.364 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-cephadm-2:19.0.0-1643.g3bfc837d.el9.noarch 2024-02-21T22:59:19.364 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-dashboard-2:19.0.0-1643.g3bfc837d.el9.noarch 2024-02-21T22:59:19.364 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1643.g3bfc837d.el9.noarch 2024-02-21T22:59:19.364 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-modules-core-2:19.0.0-1643.g3bfc837d.el9.noarch 2024-02-21T22:59:19.364 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-rook-2:19.0.0-1643.g3bfc837d.el9.noarch 2024-02-21T22:59:19.364 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mon-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:19.364 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-osd-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:19.365 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-prometheus-alerts-2:19.0.0-1643.g3bfc837d.el9.noarch 2024-02-21T22:59:19.365 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-radosgw-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:19.365 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-selinux-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:19.365 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-test-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:19.365 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-volume-2:19.0.0-1643.g3bfc837d.el9.noarch 2024-02-21T22:59:19.365 INFO:teuthology.orchestra.run.smithi099.stdout: cephadm-2:19.0.0-1643.g3bfc837d.el9.noarch 2024-02-21T22:59:19.365 INFO:teuthology.orchestra.run.smithi099.stdout: cephfs-mirror-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:19.365 INFO:teuthology.orchestra.run.smithi099.stdout: cephfs-shell-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:19.365 INFO:teuthology.orchestra.run.smithi099.stdout: cephfs-top-2:19.0.0-1643.g3bfc837d.el9.noarch 2024-02-21T22:59:19.365 INFO:teuthology.orchestra.run.smithi099.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-02-21T22:59:19.365 INFO:teuthology.orchestra.run.smithi099.stdout: flex-2.6.4-9.el9.x86_64 2024-02-21T22:59:19.365 INFO:teuthology.orchestra.run.smithi099.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-02-21T22:59:19.365 INFO:teuthology.orchestra.run.smithi099.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-02-21T22:59:19.366 INFO:teuthology.orchestra.run.smithi099.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-02-21T22:59:19.366 INFO:teuthology.orchestra.run.smithi099.stdout: fuse-2.9.9-15.el9.x86_64 2024-02-21T22:59:19.366 INFO:teuthology.orchestra.run.smithi099.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-02-21T22:59:19.366 INFO:teuthology.orchestra.run.smithi099.stdout: grpc-data-1.46.7-10.el9.noarch 2024-02-21T22:59:19.366 INFO:teuthology.orchestra.run.smithi099.stdout: jq-1.6-16.el9.x86_64 2024-02-21T22:59:19.366 INFO:teuthology.orchestra.run.smithi099.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-02-21T22:59:19.366 INFO:teuthology.orchestra.run.smithi099.stdout: libarrow-9.0.0-10.el9.x86_64 2024-02-21T22:59:19.366 INFO:teuthology.orchestra.run.smithi099.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-02-21T22:59:19.366 INFO:teuthology.orchestra.run.smithi099.stdout: libcephfs-devel-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:19.366 INFO:teuthology.orchestra.run.smithi099.stdout: libcephfs2-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:19.366 INFO:teuthology.orchestra.run.smithi099.stdout: libcephsqlite-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:19.366 INFO:teuthology.orchestra.run.smithi099.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-02-21T22:59:19.366 INFO:teuthology.orchestra.run.smithi099.stdout: liboath-2.6.7-2.el9.x86_64 2024-02-21T22:59:19.366 INFO:teuthology.orchestra.run.smithi099.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-02-21T22:59:19.367 INFO:teuthology.orchestra.run.smithi099.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-02-21T22:59:19.367 INFO:teuthology.orchestra.run.smithi099.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-02-21T22:59:19.367 INFO:teuthology.orchestra.run.smithi099.stdout: librados-devel-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:19.367 INFO:teuthology.orchestra.run.smithi099.stdout: libradosstriper1-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:19.367 INFO:teuthology.orchestra.run.smithi099.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-02-21T22:59:19.367 INFO:teuthology.orchestra.run.smithi099.stdout: librgw2-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:19.367 INFO:teuthology.orchestra.run.smithi099.stdout: libtool-2.4.6-45.el9.x86_64 2024-02-21T22:59:19.367 INFO:teuthology.orchestra.run.smithi099.stdout: libunwind-1.6.2-1.el9.x86_64 2024-02-21T22:59:19.367 INFO:teuthology.orchestra.run.smithi099.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2024-02-21T22:59:19.367 INFO:teuthology.orchestra.run.smithi099.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-02-21T22:59:19.367 INFO:teuthology.orchestra.run.smithi099.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-02-21T22:59:19.367 INFO:teuthology.orchestra.run.smithi099.stdout: lua-5.4.4-4.el9.x86_64 2024-02-21T22:59:19.367 INFO:teuthology.orchestra.run.smithi099.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-02-21T22:59:19.367 INFO:teuthology.orchestra.run.smithi099.stdout: luarocks-3.9.2-1.el9.noarch 2024-02-21T22:59:19.367 INFO:teuthology.orchestra.run.smithi099.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-02-21T22:59:19.368 INFO:teuthology.orchestra.run.smithi099.stdout: openblas-0.3.21-2.el9.x86_64 2024-02-21T22:59:19.368 INFO:teuthology.orchestra.run.smithi099.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-02-21T22:59:19.368 INFO:teuthology.orchestra.run.smithi099.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2024-02-21T22:59:19.368 INFO:teuthology.orchestra.run.smithi099.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-02-21T22:59:19.368 INFO:teuthology.orchestra.run.smithi099.stdout: postgresql-13.11-1.el9.x86_64 2024-02-21T22:59:19.368 INFO:teuthology.orchestra.run.smithi099.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-02-21T22:59:19.368 INFO:teuthology.orchestra.run.smithi099.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-02-21T22:59:19.368 INFO:teuthology.orchestra.run.smithi099.stdout: postgresql-server-13.11-1.el9.x86_64 2024-02-21T22:59:19.368 INFO:teuthology.orchestra.run.smithi099.stdout: protobuf-3.14.0-13.el9.x86_64 2024-02-21T22:59:19.368 INFO:teuthology.orchestra.run.smithi099.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-02-21T22:59:19.368 INFO:teuthology.orchestra.run.smithi099.stdout: python3-asyncssh-2.13.2-4.el9.noarch 2024-02-21T22:59:19.368 INFO:teuthology.orchestra.run.smithi099.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-02-21T22:59:19.368 INFO:teuthology.orchestra.run.smithi099.stdout: python3-babel-2.9.1-2.el9.noarch 2024-02-21T22:59:19.369 INFO:teuthology.orchestra.run.smithi099.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-02-21T22:59:19.369 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-02-21T22:59:19.369 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ceph-argparse-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:19.369 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ceph-common-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:19.369 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cephfs-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:19.369 INFO:teuthology.orchestra.run.smithi099.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-02-21T22:59:19.369 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-02-21T22:59:19.369 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-02-21T22:59:19.369 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-02-21T22:59:19.369 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-02-21T22:59:19.369 INFO:teuthology.orchestra.run.smithi099.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-02-21T22:59:19.369 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-02-21T22:59:19.369 INFO:teuthology.orchestra.run.smithi099.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-02-21T22:59:19.369 INFO:teuthology.orchestra.run.smithi099.stdout: python3-google-auth-1:2.27.0-1.el9.noarch 2024-02-21T22:59:19.370 INFO:teuthology.orchestra.run.smithi099.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-02-21T22:59:19.370 INFO:teuthology.orchestra.run.smithi099.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-02-21T22:59:19.370 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-02-21T22:59:19.370 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-02-21T22:59:19.370 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-02-21T22:59:19.370 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-02-21T22:59:19.370 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-02-21T22:59:19.370 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-02-21T22:59:19.370 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-02-21T22:59:19.370 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-02-21T22:59:19.370 INFO:teuthology.orchestra.run.smithi099.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-02-21T22:59:19.370 INFO:teuthology.orchestra.run.smithi099.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-02-21T22:59:19.370 INFO:teuthology.orchestra.run.smithi099.stdout: python3-mako-1.1.4-6.el9.noarch 2024-02-21T22:59:19.370 INFO:teuthology.orchestra.run.smithi099.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-02-21T22:59:19.371 INFO:teuthology.orchestra.run.smithi099.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-02-21T22:59:19.371 INFO:teuthology.orchestra.run.smithi099.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-02-21T22:59:19.371 INFO:teuthology.orchestra.run.smithi099.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-02-21T22:59:19.371 INFO:teuthology.orchestra.run.smithi099.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-02-21T22:59:19.371 INFO:teuthology.orchestra.run.smithi099.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-02-21T22:59:19.371 INFO:teuthology.orchestra.run.smithi099.stdout: python3-packaging-20.9-5.el9.noarch 2024-02-21T22:59:19.371 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-02-21T22:59:19.371 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ply-3.11-14.el9.noarch 2024-02-21T22:59:19.371 INFO:teuthology.orchestra.run.smithi099.stdout: python3-portend-3.1.0-2.el9.noarch 2024-02-21T22:59:19.371 INFO:teuthology.orchestra.run.smithi099.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-02-21T22:59:19.371 INFO:teuthology.orchestra.run.smithi099.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-02-21T22:59:19.371 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-02-21T22:59:19.371 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-02-21T22:59:19.371 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-02-21T22:59:19.372 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pycparser-2.20-6.el9.noarch 2024-02-21T22:59:19.372 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-02-21T22:59:19.372 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pytz-2021.1-5.el9.noarch 2024-02-21T22:59:19.372 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rados-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:19.372 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rbd-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:19.372 INFO:teuthology.orchestra.run.smithi099.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-02-21T22:59:19.372 INFO:teuthology.orchestra.run.smithi099.stdout: python3-requests-2.25.1-8.el9.noarch 2024-02-21T22:59:19.372 INFO:teuthology.orchestra.run.smithi099.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-02-21T22:59:19.372 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rgw-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:19.372 INFO:teuthology.orchestra.run.smithi099.stdout: python3-routes-2.5.1-5.el9.noarch 2024-02-21T22:59:19.372 INFO:teuthology.orchestra.run.smithi099.stdout: python3-rsa-4.9-2.el9.noarch 2024-02-21T22:59:19.372 INFO:teuthology.orchestra.run.smithi099.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-02-21T22:59:19.372 INFO:teuthology.orchestra.run.smithi099.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-02-21T22:59:19.373 INFO:teuthology.orchestra.run.smithi099.stdout: python3-toml-0.10.2-6.el9.noarch 2024-02-21T22:59:19.373 INFO:teuthology.orchestra.run.smithi099.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-02-21T22:59:19.373 INFO:teuthology.orchestra.run.smithi099.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-02-21T22:59:19.375 INFO:teuthology.orchestra.run.smithi099.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-02-21T22:59:19.375 INFO:teuthology.orchestra.run.smithi099.stdout: python3-webob-1.8.7-6.el9.noarch 2024-02-21T22:59:19.375 INFO:teuthology.orchestra.run.smithi099.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-02-21T22:59:19.375 INFO:teuthology.orchestra.run.smithi099.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-02-21T22:59:19.375 INFO:teuthology.orchestra.run.smithi099.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-02-21T22:59:19.375 INFO:teuthology.orchestra.run.smithi099.stdout: qatlib-23.11.0-1.el9.x86_64 2024-02-21T22:59:19.375 INFO:teuthology.orchestra.run.smithi099.stdout: qatlib-service-23.11.0-1.el9.x86_64 2024-02-21T22:59:19.375 INFO:teuthology.orchestra.run.smithi099.stdout: qatzip-libs-1.1.2-2.el9.x86_64 2024-02-21T22:59:19.375 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-fuse-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:19.376 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-mirror-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:19.376 INFO:teuthology.orchestra.run.smithi099.stdout: rbd-nbd-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:19.376 INFO:teuthology.orchestra.run.smithi099.stdout: re2-1:20211101-3.el9.x86_64 2024-02-21T22:59:19.376 INFO:teuthology.orchestra.run.smithi099.stdout: socat-1.7.4.1-5.el9.x86_64 2024-02-21T22:59:19.376 INFO:teuthology.orchestra.run.smithi099.stdout: thrift-0.15.0-2.el9.x86_64 2024-02-21T22:59:19.376 INFO:teuthology.orchestra.run.smithi099.stdout: uuid-1.6.2-55.el9.x86_64 2024-02-21T22:59:19.376 INFO:teuthology.orchestra.run.smithi099.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-02-21T22:59:19.376 INFO:teuthology.orchestra.run.smithi099.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-02-21T22:59:19.376 INFO:teuthology.orchestra.run.smithi099.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-02-21T22:59:19.376 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T22:59:19.377 INFO:teuthology.orchestra.run.smithi099.stdout:Complete! 2024-02-21T22:59:20.059 DEBUG:teuthology.parallel:result is None 2024-02-21T22:59:20.144 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libtool-2.4.6-45.el9.x86_64 143/182 2024-02-21T22:59:20.180 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-radosgw-2:19.0.0-1643.g3bfc837d.el9.x86_64 144/182 2024-02-21T22:59:20.203 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1643.g3bfc837d.el9.x86_64 144/182 2024-02-21T22:59:20.203 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T22:59:20.203 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-02-21T22:59:20.203 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-21T22:59:20.204 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-21T22:59:20.204 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-02-21T22:59:20.243 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1643.g3bfc8 145/182 2024-02-21T22:59:20.265 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1643.g3bfc8 145/182 2024-02-21T22:59:20.265 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T22:59:20.265 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-02-21T22:59:20.265 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-02-21T22:59:20.310 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : cephfs-mirror-2:19.0.0-1643.g3bfc837d.el9.x86_64 146/182 2024-02-21T22:59:20.333 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-1643.g3bfc837d.el9.x86_64 146/182 2024-02-21T22:59:20.333 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T22:59:20.333 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-02-21T22:59:20.333 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-02-21T22:59:20.333 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-02-21T22:59:20.333 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-02-21T22:59:20.652 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : rbd-mirror-2:19.0.0-1643.g3bfc837d.el9.x86_64 147/182 2024-02-21T22:59:20.676 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1643.g3bfc837d.el9.x86_64 147/182 2024-02-21T22:59:20.676 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T22:59:20.676 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-02-21T22:59:20.676 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-21T22:59:20.676 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-21T22:59:20.677 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-02-21T22:59:20.727 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : rbd-fuse-2:19.0.0-1643.g3bfc837d.el9.x86_64 148/182 2024-02-21T22:59:20.777 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : rbd-nbd-2:19.0.0-1643.g3bfc837d.el9.x86_64 149/182 2024-02-21T22:59:20.808 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 150/182 2024-02-21T22:59:20.836 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 151/182 2024-02-21T22:59:21.020 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : cephfs-shell-2:19.0.0-1643.g3bfc837d.el9.x86_64 152/182 2024-02-21T22:59:21.066 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 153/182 2024-02-21T22:59:21.099 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libcephfs-devel-2:19.0.0-1643.g3bfc837d.el9.x86_ 154/182 2024-02-21T22:59:21.139 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 155/182 2024-02-21T22:59:21.169 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : NetworkManager-team-1:1.45.91-1.el9.x86_64 156/182 2024-02-21T22:59:21.223 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : NetworkManager-tui-1:1.45.91-1.el9.x86_64 157/182 2024-02-21T22:59:21.278 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 158/182 2024-02-21T22:59:21.320 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 159/182 2024-02-21T22:59:21.918 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 160/182 2024-02-21T22:59:21.952 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 160/182 2024-02-21T22:59:21.979 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 160/182 2024-02-21T22:59:22.042 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/182 2024-02-21T22:59:22.880 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : cephfs-top-2:19.0.0-1643.g3bfc837d.el9.noarch 162/182 2024-02-21T22:59:22.982 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 163/182 2024-02-21T22:59:23.059 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-fuse-2:19.0.0-1643.g3bfc837d.el9.x86_64 141/182 2024-02-21T22:59:23.065 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : flex-2.6.4-9.el9.x86_64 164/182 2024-02-21T22:59:23.095 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : bison-3.7.4-5.el9.x86_64 165/182 2024-02-21T22:59:23.120 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 166/182 2024-02-21T22:59:23.122 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-test-2:19.0.0-1643.g3bfc837d.el9.x86_64 142/182 2024-02-21T22:59:23.145 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 167/182 2024-02-21T22:59:23.170 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/182 2024-02-21T22:59:23.197 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 169/182 2024-02-21T22:59:23.197 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 170/182 2024-02-21T22:59:23.268 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 170/182 2024-02-21T22:59:23.298 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 171/182 2024-02-21T22:59:23.323 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 172/182 2024-02-21T22:59:23.349 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 173/182 2024-02-21T22:59:23.374 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 174/182 2024-02-21T22:59:23.374 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 175/182 2024-02-21T22:59:23.458 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 175/182 2024-02-21T22:59:23.483 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 176/182 2024-02-21T22:59:23.490 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 177/182 2024-02-21T22:59:23.490 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 177/182 2024-02-21T22:59:23.678 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 177/182 2024-02-21T22:59:23.679 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 178/182 2024-02-21T22:59:23.778 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 178/182 2024-02-21T22:59:23.803 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 179/182 2024-02-21T22:59:23.855 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 180/182 2024-02-21T22:59:23.888 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 181/182 2024-02-21T22:59:23.952 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 182/182 2024-02-21T22:59:23.972 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libtool-2.4.6-45.el9.x86_64 143/182 2024-02-21T22:59:24.002 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-radosgw-2:19.0.0-1643.g3bfc837d.el9.x86_64 144/182 2024-02-21T22:59:24.024 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1643.g3bfc837d.el9.x86_64 144/182 2024-02-21T22:59:24.025 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T22:59:24.025 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-02-21T22:59:24.025 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-21T22:59:24.025 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-21T22:59:24.025 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-02-21T22:59:24.069 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1643.g3bfc8 145/182 2024-02-21T22:59:24.092 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1643.g3bfc8 145/182 2024-02-21T22:59:24.092 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T22:59:24.092 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-02-21T22:59:24.092 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-02-21T22:59:24.136 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : cephfs-mirror-2:19.0.0-1643.g3bfc837d.el9.x86_64 146/182 2024-02-21T22:59:24.159 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-1643.g3bfc837d.el9.x86_64 146/182 2024-02-21T22:59:24.159 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T22:59:24.159 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-02-21T22:59:24.159 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-02-21T22:59:24.159 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-02-21T22:59:24.159 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-02-21T22:59:24.470 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : rbd-mirror-2:19.0.0-1643.g3bfc837d.el9.x86_64 147/182 2024-02-21T22:59:24.493 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1643.g3bfc837d.el9.x86_64 147/182 2024-02-21T22:59:24.493 INFO:teuthology.orchestra.run.smithi181.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-21T22:59:24.493 INFO:teuthology.orchestra.run.smithi181.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-02-21T22:59:24.494 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-21T22:59:24.494 INFO:teuthology.orchestra.run.smithi181.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-21T22:59:24.494 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-02-21T22:59:24.545 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : rbd-fuse-2:19.0.0-1643.g3bfc837d.el9.x86_64 148/182 2024-02-21T22:59:24.586 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : rbd-nbd-2:19.0.0-1643.g3bfc837d.el9.x86_64 149/182 2024-02-21T22:59:24.618 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 150/182 2024-02-21T22:59:24.711 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 151/182 2024-02-21T22:59:24.825 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : cephfs-shell-2:19.0.0-1643.g3bfc837d.el9.x86_64 152/182 2024-02-21T22:59:24.877 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 153/182 2024-02-21T22:59:24.909 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libcephfs-devel-2:19.0.0-1643.g3bfc837d.el9.x86_ 154/182 2024-02-21T22:59:24.942 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 155/182 2024-02-21T22:59:24.972 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : NetworkManager-team-1:1.45.91-1.el9.x86_64 156/182 2024-02-21T22:59:25.017 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : NetworkManager-tui-1:1.45.91-1.el9.x86_64 157/182 2024-02-21T22:59:25.069 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 158/182 2024-02-21T22:59:25.104 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 159/182 2024-02-21T22:59:25.672 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 160/182 2024-02-21T22:59:25.718 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 160/182 2024-02-21T22:59:25.743 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 160/182 2024-02-21T22:59:25.799 INFO:teuthology.orchestra.run.smithi181.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/182 2024-02-21T22:59:26.629 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : cephfs-top-2:19.0.0-1643.g3bfc837d.el9.noarch 162/182 2024-02-21T22:59:26.722 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 163/182 2024-02-21T22:59:26.802 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : flex-2.6.4-9.el9.x86_64 164/182 2024-02-21T22:59:26.842 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : bison-3.7.4-5.el9.x86_64 165/182 2024-02-21T22:59:26.859 INFO:teuthology.orchestra.run.smithi181.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 166/182 2024-02-21T22:59:26.884 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 167/182 2024-02-21T22:59:26.909 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/182 2024-02-21T22:59:26.936 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 169/182 2024-02-21T22:59:26.936 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 170/182 2024-02-21T22:59:27.032 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 170/182 2024-02-21T22:59:27.070 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 171/182 2024-02-21T22:59:27.096 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 172/182 2024-02-21T22:59:27.121 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 173/182 2024-02-21T22:59:27.146 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 174/182 2024-02-21T22:59:27.146 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 175/182 2024-02-21T22:59:27.239 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 175/182 2024-02-21T22:59:27.264 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 176/182 2024-02-21T22:59:27.271 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 177/182 2024-02-21T22:59:27.271 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 177/182 2024-02-21T22:59:27.458 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 177/182 2024-02-21T22:59:27.458 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 178/182 2024-02-21T22:59:27.542 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 178/182 2024-02-21T22:59:27.566 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 179/182 2024-02-21T22:59:27.593 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 180/182 2024-02-21T22:59:27.634 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 181/182 2024-02-21T22:59:27.698 INFO:teuthology.orchestra.run.smithi181.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 182/182 2024-02-21T22:59:29.158 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 182/182 2024-02-21T22:59:29.158 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-2:19.0.0-1643.g3bfc837d.el9.x86_64 1/182 2024-02-21T22:59:29.158 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-base-2:19.0.0-1643.g3bfc837d.el9.x86_64 2/182 2024-02-21T22:59:29.158 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-common-2:19.0.0-1643.g3bfc837d.el9.x86_64 3/182 2024-02-21T22:59:29.159 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-fuse-2:19.0.0-1643.g3bfc837d.el9.x86_64 4/182 2024-02-21T22:59:29.159 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1643.g3bfc8 5/182 2024-02-21T22:59:29.159 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mds-2:19.0.0-1643.g3bfc837d.el9.x86_64 6/182 2024-02-21T22:59:29.159 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-2:19.0.0-1643.g3bfc837d.el9.x86_64 7/182 2024-02-21T22:59:29.159 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mon-2:19.0.0-1643.g3bfc837d.el9.x86_64 8/182 2024-02-21T22:59:29.159 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-osd-2:19.0.0-1643.g3bfc837d.el9.x86_64 9/182 2024-02-21T22:59:29.159 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-radosgw-2:19.0.0-1643.g3bfc837d.el9.x86_64 10/182 2024-02-21T22:59:29.159 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-selinux-2:19.0.0-1643.g3bfc837d.el9.x86_64 11/182 2024-02-21T22:59:29.159 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-test-2:19.0.0-1643.g3bfc837d.el9.x86_64 12/182 2024-02-21T22:59:29.159 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : cephfs-mirror-2:19.0.0-1643.g3bfc837d.el9.x86_64 13/182 2024-02-21T22:59:29.159 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : cephfs-shell-2:19.0.0-1643.g3bfc837d.el9.x86_64 14/182 2024-02-21T22:59:29.160 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libcephfs-devel-2:19.0.0-1643.g3bfc837d.el9.x86_ 15/182 2024-02-21T22:59:29.160 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libcephfs2-2:19.0.0-1643.g3bfc837d.el9.x86_64 16/182 2024-02-21T22:59:29.160 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libcephsqlite-2:19.0.0-1643.g3bfc837d.el9.x86_64 17/182 2024-02-21T22:59:29.160 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librados-devel-2:19.0.0-1643.g3bfc837d.el9.x86_6 18/182 2024-02-21T22:59:29.160 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libradosstriper1-2:19.0.0-1643.g3bfc837d.el9.x86 19/182 2024-02-21T22:59:29.160 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librgw2-2:19.0.0-1643.g3bfc837d.el9.x86_64 20/182 2024-02-21T22:59:29.160 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1643.g3bfc837d.el 21/182 2024-02-21T22:59:29.160 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-ceph-common-2:19.0.0-1643.g3bfc837d.el9. 22/182 2024-02-21T22:59:29.160 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cephfs-2:19.0.0-1643.g3bfc837d.el9.x86_6 23/182 2024-02-21T22:59:29.160 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-rados-2:19.0.0-1643.g3bfc837d.el9.x86_64 24/182 2024-02-21T22:59:29.160 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-rbd-2:19.0.0-1643.g3bfc837d.el9.x86_64 25/182 2024-02-21T22:59:29.161 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-rgw-2:19.0.0-1643.g3bfc837d.el9.x86_64 26/182 2024-02-21T22:59:29.161 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : rbd-fuse-2:19.0.0-1643.g3bfc837d.el9.x86_64 27/182 2024-02-21T22:59:29.161 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : rbd-mirror-2:19.0.0-1643.g3bfc837d.el9.x86_64 28/182 2024-02-21T22:59:29.161 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : rbd-nbd-2:19.0.0-1643.g3bfc837d.el9.x86_64 29/182 2024-02-21T22:59:29.161 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1643.g3bfc837d. 30/182 2024-02-21T22:59:29.161 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1643.g3bfc837d.el9.noa 31/182 2024-02-21T22:59:29.161 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1643.g3bfc837d.el9.n 32/182 2024-02-21T22:59:29.161 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1643.g3bf 33/182 2024-02-21T22:59:29.161 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1643.g3bfc837d.el 34/182 2024-02-21T22:59:29.161 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1643.g3bfc837d.el9.noarch 35/182 2024-02-21T22:59:29.161 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1643.g3bfc837d.e 36/182 2024-02-21T22:59:29.162 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-volume-2:19.0.0-1643.g3bfc837d.el9.noarch 37/182 2024-02-21T22:59:29.162 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : cephadm-2:19.0.0-1643.g3bfc837d.el9.noarch 38/182 2024-02-21T22:59:29.162 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : cephfs-top-2:19.0.0-1643.g3bfc837d.el9.noarch 39/182 2024-02-21T22:59:29.162 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 40/182 2024-02-21T22:59:29.162 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 41/182 2024-02-21T22:59:29.162 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : jq-1.6-16.el9.x86_64 42/182 2024-02-21T22:59:29.162 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 43/182 2024-02-21T22:59:29.162 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 44/182 2024-02-21T22:59:29.162 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 45/182 2024-02-21T22:59:29.162 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/182 2024-02-21T22:59:29.162 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 47/182 2024-02-21T22:59:29.163 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-ply-3.11-14.el9.noarch 48/182 2024-02-21T22:59:29.163 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 49/182 2024-02-21T22:59:29.163 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 50/182 2024-02-21T22:59:29.163 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 51/182 2024-02-21T22:59:29.163 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : automake-1.16.2-8.el9.noarch 52/182 2024-02-21T22:59:29.163 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : bison-3.7.4-5.el9.x86_64 53/182 2024-02-21T22:59:29.163 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 54/182 2024-02-21T22:59:29.163 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 55/182 2024-02-21T22:59:29.163 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : flex-2.6.4-9.el9.x86_64 56/182 2024-02-21T22:59:29.163 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 57/182 2024-02-21T22:59:29.163 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 58/182 2024-02-21T22:59:29.163 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 59/182 2024-02-21T22:59:29.164 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 60/182 2024-02-21T22:59:29.164 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 61/182 2024-02-21T22:59:29.164 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 62/182 2024-02-21T22:59:29.164 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 63/182 2024-02-21T22:59:29.164 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 64/182 2024-02-21T22:59:29.164 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 65/182 2024-02-21T22:59:29.164 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 66/182 2024-02-21T22:59:29.164 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : lua-5.4.4-4.el9.x86_64 67/182 2024-02-21T22:59:29.164 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 68/182 2024-02-21T22:59:29.165 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 69/182 2024-02-21T22:59:29.165 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 70/182 2024-02-21T22:59:29.165 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : postgresql-13.11-1.el9.x86_64 71/182 2024-02-21T22:59:29.165 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 72/182 2024-02-21T22:59:29.165 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 73/182 2024-02-21T22:59:29.165 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 74/182 2024-02-21T22:59:29.165 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 75/182 2024-02-21T22:59:29.165 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 76/182 2024-02-21T22:59:29.165 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 77/182 2024-02-21T22:59:29.165 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 78/182 2024-02-21T22:59:29.165 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 79/182 2024-02-21T22:59:29.165 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/182 2024-02-21T22:59:29.166 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/182 2024-02-21T22:59:29.166 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/182 2024-02-21T22:59:29.166 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/182 2024-02-21T22:59:29.166 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/182 2024-02-21T22:59:29.166 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/182 2024-02-21T22:59:29.166 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/182 2024-02-21T22:59:29.166 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/182 2024-02-21T22:59:29.166 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/182 2024-02-21T22:59:29.166 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/182 2024-02-21T22:59:29.166 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/182 2024-02-21T22:59:29.167 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/182 2024-02-21T22:59:29.167 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/182 2024-02-21T22:59:29.167 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/182 2024-02-21T22:59:29.167 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/182 2024-02-21T22:59:29.167 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/182 2024-02-21T22:59:29.167 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/182 2024-02-21T22:59:29.167 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : qatlib-23.11.0-1.el9.x86_64 97/182 2024-02-21T22:59:29.167 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : qatlib-service-23.11.0-1.el9.x86_64 98/182 2024-02-21T22:59:29.167 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : qatzip-libs-1.1.2-2.el9.x86_64 99/182 2024-02-21T22:59:29.167 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 100/182 2024-02-21T22:59:29.167 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/182 2024-02-21T22:59:29.168 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 102/182 2024-02-21T22:59:29.168 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/182 2024-02-21T22:59:29.168 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 104/182 2024-02-21T22:59:29.168 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/182 2024-02-21T22:59:29.168 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/182 2024-02-21T22:59:29.168 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/182 2024-02-21T22:59:29.168 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/182 2024-02-21T22:59:29.168 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/182 2024-02-21T22:59:29.168 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/182 2024-02-21T22:59:29.169 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/182 2024-02-21T22:59:29.169 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/182 2024-02-21T22:59:29.169 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/182 2024-02-21T22:59:29.169 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/182 2024-02-21T22:59:29.169 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/182 2024-02-21T22:59:29.169 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-asyncssh-2.13.2-4.el9.noarch 116/182 2024-02-21T22:59:29.169 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/182 2024-02-21T22:59:29.169 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/182 2024-02-21T22:59:29.169 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/182 2024-02-21T22:59:29.169 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/182 2024-02-21T22:59:29.170 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/182 2024-02-21T22:59:29.170 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/182 2024-02-21T22:59:29.170 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/182 2024-02-21T22:59:29.170 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-google-auth-1:2.27.0-1.el9.noarch 124/182 2024-02-21T22:59:29.170 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/182 2024-02-21T22:59:29.170 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/182 2024-02-21T22:59:29.170 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/182 2024-02-21T22:59:29.170 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/182 2024-02-21T22:59:29.170 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/182 2024-02-21T22:59:29.170 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/182 2024-02-21T22:59:29.170 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/182 2024-02-21T22:59:29.170 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/182 2024-02-21T22:59:29.171 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/182 2024-02-21T22:59:29.171 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/182 2024-02-21T22:59:29.171 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/182 2024-02-21T22:59:29.171 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/182 2024-02-21T22:59:29.171 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/182 2024-02-21T22:59:29.171 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/182 2024-02-21T22:59:29.171 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/182 2024-02-21T22:59:29.171 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/182 2024-02-21T22:59:29.172 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/182 2024-02-21T22:59:29.172 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/182 2024-02-21T22:59:29.172 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/182 2024-02-21T22:59:29.172 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/182 2024-02-21T22:59:29.172 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/182 2024-02-21T22:59:29.172 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/182 2024-02-21T22:59:29.172 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/182 2024-02-21T22:59:29.172 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/182 2024-02-21T22:59:29.172 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/182 2024-02-21T22:59:29.172 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/182 2024-02-21T22:59:29.172 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librados2-2:19.0.0-1643.g3bfc837d.el9.x86_64 151/182 2024-02-21T22:59:29.172 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/182 2024-02-21T22:59:29.173 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librbd1-2:19.0.0-1643.g3bfc837d.el9.x86_64 153/182 2024-02-21T22:59:29.173 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/182 2024-02-21T22:59:29.173 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-1:1.45.91-1.el9.x86_64 155/182 2024-02-21T22:59:29.173 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 156/182 2024-02-21T22:59:29.173 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-libnm-1:1.45.91-1.el9.x86_64 157/182 2024-02-21T22:59:29.173 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/182 2024-02-21T22:59:29.173 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-team-1:1.45.91-1.el9.x86_64 159/182 2024-02-21T22:59:29.173 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 160/182 2024-02-21T22:59:29.173 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-tui-1:1.45.91-1.el9.x86_64 161/182 2024-02-21T22:59:29.173 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 162/182 2024-02-21T22:59:29.173 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : acl-2.3.1-4.el9.x86_64 163/182 2024-02-21T22:59:29.174 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : acl-2.3.1-3.el9.x86_64 164/182 2024-02-21T22:59:29.174 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 165/182 2024-02-21T22:59:29.174 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 166/182 2024-02-21T22:59:29.174 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 167/182 2024-02-21T22:59:29.174 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 168/182 2024-02-21T22:59:29.174 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 169/182 2024-02-21T22:59:29.174 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 170/182 2024-02-21T22:59:29.174 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 171/182 2024-02-21T22:59:29.174 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 172/182 2024-02-21T22:59:29.174 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 173/182 2024-02-21T22:59:29.174 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 174/182 2024-02-21T22:59:29.175 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 175/182 2024-02-21T22:59:29.175 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 176/182 2024-02-21T22:59:29.175 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 177/182 2024-02-21T22:59:29.175 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 178/182 2024-02-21T22:59:29.175 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 179/182 2024-02-21T22:59:29.175 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 180/182 2024-02-21T22:59:29.175 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 181/182 2024-02-21T22:59:31.869 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 182/182 2024-02-21T22:59:31.870 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-02-21T22:59:31.870 INFO:teuthology.orchestra.run.smithi162.stdout:Upgraded: 2024-02-21T22:59:31.870 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-1:1.45.91-1.el9.x86_64 2024-02-21T22:59:31.870 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-libnm-1:1.45.91-1.el9.x86_64 2024-02-21T22:59:31.870 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-team-1:1.45.91-1.el9.x86_64 2024-02-21T22:59:31.870 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-tui-1:1.45.91-1.el9.x86_64 2024-02-21T22:59:31.870 INFO:teuthology.orchestra.run.smithi162.stdout: acl-2.3.1-4.el9.x86_64 2024-02-21T22:59:31.870 INFO:teuthology.orchestra.run.smithi162.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-02-21T22:59:31.870 INFO:teuthology.orchestra.run.smithi162.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-02-21T22:59:31.870 INFO:teuthology.orchestra.run.smithi162.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-02-21T22:59:31.870 INFO:teuthology.orchestra.run.smithi162.stdout: libacl-2.3.1-4.el9.x86_64 2024-02-21T22:59:31.871 INFO:teuthology.orchestra.run.smithi162.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-02-21T22:59:31.871 INFO:teuthology.orchestra.run.smithi162.stdout: librados2-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:31.871 INFO:teuthology.orchestra.run.smithi162.stdout: librbd1-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:31.871 INFO:teuthology.orchestra.run.smithi162.stdout: openssl-1:3.0.7-25.el9.x86_64 2024-02-21T22:59:31.871 INFO:teuthology.orchestra.run.smithi162.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2024-02-21T22:59:31.871 INFO:teuthology.orchestra.run.smithi162.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-02-21T22:59:31.871 INFO:teuthology.orchestra.run.smithi162.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-02-21T22:59:31.871 INFO:teuthology.orchestra.run.smithi162.stdout:Installed: 2024-02-21T22:59:31.871 INFO:teuthology.orchestra.run.smithi162.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-02-21T22:59:31.871 INFO:teuthology.orchestra.run.smithi162.stdout: automake-1.16.2-8.el9.noarch 2024-02-21T22:59:31.871 INFO:teuthology.orchestra.run.smithi162.stdout: bison-3.7.4-5.el9.x86_64 2024-02-21T22:59:31.871 INFO:teuthology.orchestra.run.smithi162.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-02-21T22:59:31.872 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:31.872 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-base-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:31.872 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-common-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:31.872 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-fuse-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:31.872 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-grafana-dashboards-2:19.0.0-1643.g3bfc837d.el9.noarch 2024-02-21T22:59:31.872 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-immutable-object-cache-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:31.872 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mds-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:31.872 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:31.872 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-cephadm-2:19.0.0-1643.g3bfc837d.el9.noarch 2024-02-21T22:59:31.872 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-dashboard-2:19.0.0-1643.g3bfc837d.el9.noarch 2024-02-21T22:59:31.872 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1643.g3bfc837d.el9.noarch 2024-02-21T22:59:31.873 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-modules-core-2:19.0.0-1643.g3bfc837d.el9.noarch 2024-02-21T22:59:31.873 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-rook-2:19.0.0-1643.g3bfc837d.el9.noarch 2024-02-21T22:59:31.873 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mon-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:31.873 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-osd-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:31.873 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-prometheus-alerts-2:19.0.0-1643.g3bfc837d.el9.noarch 2024-02-21T22:59:31.873 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-radosgw-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:31.873 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-selinux-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:31.873 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-test-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:31.873 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-volume-2:19.0.0-1643.g3bfc837d.el9.noarch 2024-02-21T22:59:31.873 INFO:teuthology.orchestra.run.smithi162.stdout: cephadm-2:19.0.0-1643.g3bfc837d.el9.noarch 2024-02-21T22:59:31.873 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-mirror-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:31.873 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-shell-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:31.874 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-top-2:19.0.0-1643.g3bfc837d.el9.noarch 2024-02-21T22:59:31.874 INFO:teuthology.orchestra.run.smithi162.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-02-21T22:59:31.874 INFO:teuthology.orchestra.run.smithi162.stdout: flex-2.6.4-9.el9.x86_64 2024-02-21T22:59:31.874 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-02-21T22:59:31.874 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-02-21T22:59:31.874 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-02-21T22:59:31.874 INFO:teuthology.orchestra.run.smithi162.stdout: fuse-2.9.9-15.el9.x86_64 2024-02-21T22:59:31.874 INFO:teuthology.orchestra.run.smithi162.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-02-21T22:59:31.874 INFO:teuthology.orchestra.run.smithi162.stdout: grpc-data-1.46.7-10.el9.noarch 2024-02-21T22:59:31.874 INFO:teuthology.orchestra.run.smithi162.stdout: jq-1.6-16.el9.x86_64 2024-02-21T22:59:31.874 INFO:teuthology.orchestra.run.smithi162.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-02-21T22:59:31.874 INFO:teuthology.orchestra.run.smithi162.stdout: libarrow-9.0.0-10.el9.x86_64 2024-02-21T22:59:31.874 INFO:teuthology.orchestra.run.smithi162.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-02-21T22:59:31.875 INFO:teuthology.orchestra.run.smithi162.stdout: libcephfs-devel-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:31.875 INFO:teuthology.orchestra.run.smithi162.stdout: libcephfs2-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:31.875 INFO:teuthology.orchestra.run.smithi162.stdout: libcephsqlite-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:31.875 INFO:teuthology.orchestra.run.smithi162.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-02-21T22:59:31.875 INFO:teuthology.orchestra.run.smithi162.stdout: liboath-2.6.7-2.el9.x86_64 2024-02-21T22:59:31.875 INFO:teuthology.orchestra.run.smithi162.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-02-21T22:59:31.875 INFO:teuthology.orchestra.run.smithi162.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-02-21T22:59:31.875 INFO:teuthology.orchestra.run.smithi162.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-02-21T22:59:31.875 INFO:teuthology.orchestra.run.smithi162.stdout: librados-devel-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:31.875 INFO:teuthology.orchestra.run.smithi162.stdout: libradosstriper1-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:31.875 INFO:teuthology.orchestra.run.smithi162.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-02-21T22:59:31.876 INFO:teuthology.orchestra.run.smithi162.stdout: librgw2-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:31.876 INFO:teuthology.orchestra.run.smithi162.stdout: libtool-2.4.6-45.el9.x86_64 2024-02-21T22:59:31.876 INFO:teuthology.orchestra.run.smithi162.stdout: libunwind-1.6.2-1.el9.x86_64 2024-02-21T22:59:31.876 INFO:teuthology.orchestra.run.smithi162.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2024-02-21T22:59:31.876 INFO:teuthology.orchestra.run.smithi162.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-02-21T22:59:31.876 INFO:teuthology.orchestra.run.smithi162.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-02-21T22:59:31.876 INFO:teuthology.orchestra.run.smithi162.stdout: lua-5.4.4-4.el9.x86_64 2024-02-21T22:59:31.876 INFO:teuthology.orchestra.run.smithi162.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-02-21T22:59:31.876 INFO:teuthology.orchestra.run.smithi162.stdout: luarocks-3.9.2-1.el9.noarch 2024-02-21T22:59:31.876 INFO:teuthology.orchestra.run.smithi162.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-02-21T22:59:31.876 INFO:teuthology.orchestra.run.smithi162.stdout: openblas-0.3.21-2.el9.x86_64 2024-02-21T22:59:31.877 INFO:teuthology.orchestra.run.smithi162.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-02-21T22:59:31.877 INFO:teuthology.orchestra.run.smithi162.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2024-02-21T22:59:31.877 INFO:teuthology.orchestra.run.smithi162.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-02-21T22:59:31.877 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-13.11-1.el9.x86_64 2024-02-21T22:59:31.877 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-02-21T22:59:31.877 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-02-21T22:59:31.877 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-server-13.11-1.el9.x86_64 2024-02-21T22:59:31.877 INFO:teuthology.orchestra.run.smithi162.stdout: protobuf-3.14.0-13.el9.x86_64 2024-02-21T22:59:31.877 INFO:teuthology.orchestra.run.smithi162.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-02-21T22:59:31.877 INFO:teuthology.orchestra.run.smithi162.stdout: python3-asyncssh-2.13.2-4.el9.noarch 2024-02-21T22:59:31.877 INFO:teuthology.orchestra.run.smithi162.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-02-21T22:59:31.877 INFO:teuthology.orchestra.run.smithi162.stdout: python3-babel-2.9.1-2.el9.noarch 2024-02-21T22:59:31.878 INFO:teuthology.orchestra.run.smithi162.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-02-21T22:59:31.878 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-02-21T22:59:31.878 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-argparse-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:31.878 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-common-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:31.878 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cephfs-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:31.878 INFO:teuthology.orchestra.run.smithi162.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-02-21T22:59:31.878 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-02-21T22:59:31.878 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-02-21T22:59:31.878 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-02-21T22:59:31.878 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-02-21T22:59:31.878 INFO:teuthology.orchestra.run.smithi162.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-02-21T22:59:31.878 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-02-21T22:59:31.878 INFO:teuthology.orchestra.run.smithi162.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-02-21T22:59:31.878 INFO:teuthology.orchestra.run.smithi162.stdout: python3-google-auth-1:2.27.0-1.el9.noarch 2024-02-21T22:59:31.879 INFO:teuthology.orchestra.run.smithi162.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-02-21T22:59:31.879 INFO:teuthology.orchestra.run.smithi162.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-02-21T22:59:31.879 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-02-21T22:59:31.879 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-02-21T22:59:31.879 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-02-21T22:59:31.879 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-02-21T22:59:31.879 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-02-21T22:59:31.879 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-02-21T22:59:31.879 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-02-21T22:59:31.879 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-02-21T22:59:31.879 INFO:teuthology.orchestra.run.smithi162.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-02-21T22:59:31.880 INFO:teuthology.orchestra.run.smithi162.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-02-21T22:59:31.880 INFO:teuthology.orchestra.run.smithi162.stdout: python3-mako-1.1.4-6.el9.noarch 2024-02-21T22:59:31.880 INFO:teuthology.orchestra.run.smithi162.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-02-21T22:59:31.880 INFO:teuthology.orchestra.run.smithi162.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-02-21T22:59:31.880 INFO:teuthology.orchestra.run.smithi162.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-02-21T22:59:31.880 INFO:teuthology.orchestra.run.smithi162.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-02-21T22:59:31.880 INFO:teuthology.orchestra.run.smithi162.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-02-21T22:59:31.880 INFO:teuthology.orchestra.run.smithi162.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-02-21T22:59:31.880 INFO:teuthology.orchestra.run.smithi162.stdout: python3-packaging-20.9-5.el9.noarch 2024-02-21T22:59:31.880 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-02-21T22:59:31.880 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ply-3.11-14.el9.noarch 2024-02-21T22:59:31.880 INFO:teuthology.orchestra.run.smithi162.stdout: python3-portend-3.1.0-2.el9.noarch 2024-02-21T22:59:31.881 INFO:teuthology.orchestra.run.smithi162.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-02-21T22:59:31.881 INFO:teuthology.orchestra.run.smithi162.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-02-21T22:59:31.881 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-02-21T22:59:31.881 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-02-21T22:59:31.881 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-02-21T22:59:31.881 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pycparser-2.20-6.el9.noarch 2024-02-21T22:59:31.881 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-02-21T22:59:31.881 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pytz-2021.1-5.el9.noarch 2024-02-21T22:59:31.881 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rados-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:31.881 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rbd-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:31.881 INFO:teuthology.orchestra.run.smithi162.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-02-21T22:59:31.881 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests-2.25.1-8.el9.noarch 2024-02-21T22:59:31.882 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-02-21T22:59:31.882 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rgw-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:31.882 INFO:teuthology.orchestra.run.smithi162.stdout: python3-routes-2.5.1-5.el9.noarch 2024-02-21T22:59:31.882 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rsa-4.9-2.el9.noarch 2024-02-21T22:59:31.882 INFO:teuthology.orchestra.run.smithi162.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-02-21T22:59:31.882 INFO:teuthology.orchestra.run.smithi162.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-02-21T22:59:31.882 INFO:teuthology.orchestra.run.smithi162.stdout: python3-toml-0.10.2-6.el9.noarch 2024-02-21T22:59:31.882 INFO:teuthology.orchestra.run.smithi162.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-02-21T22:59:31.882 INFO:teuthology.orchestra.run.smithi162.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-02-21T22:59:31.882 INFO:teuthology.orchestra.run.smithi162.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-02-21T22:59:31.882 INFO:teuthology.orchestra.run.smithi162.stdout: python3-webob-1.8.7-6.el9.noarch 2024-02-21T22:59:31.882 INFO:teuthology.orchestra.run.smithi162.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-02-21T22:59:31.883 INFO:teuthology.orchestra.run.smithi162.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-02-21T22:59:31.883 INFO:teuthology.orchestra.run.smithi162.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-02-21T22:59:31.883 INFO:teuthology.orchestra.run.smithi162.stdout: qatlib-23.11.0-1.el9.x86_64 2024-02-21T22:59:31.883 INFO:teuthology.orchestra.run.smithi162.stdout: qatlib-service-23.11.0-1.el9.x86_64 2024-02-21T22:59:31.883 INFO:teuthology.orchestra.run.smithi162.stdout: qatzip-libs-1.1.2-2.el9.x86_64 2024-02-21T22:59:31.883 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-fuse-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:31.883 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-mirror-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:31.883 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-nbd-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:31.883 INFO:teuthology.orchestra.run.smithi162.stdout: re2-1:20211101-3.el9.x86_64 2024-02-21T22:59:31.883 INFO:teuthology.orchestra.run.smithi162.stdout: socat-1.7.4.1-5.el9.x86_64 2024-02-21T22:59:31.883 INFO:teuthology.orchestra.run.smithi162.stdout: thrift-0.15.0-2.el9.x86_64 2024-02-21T22:59:31.883 INFO:teuthology.orchestra.run.smithi162.stdout: uuid-1.6.2-55.el9.x86_64 2024-02-21T22:59:31.884 INFO:teuthology.orchestra.run.smithi162.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-02-21T22:59:31.884 INFO:teuthology.orchestra.run.smithi162.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-02-21T22:59:31.884 INFO:teuthology.orchestra.run.smithi162.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-02-21T22:59:31.884 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-02-21T22:59:31.884 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-02-21T22:59:32.394 DEBUG:teuthology.parallel:result is None 2024-02-21T22:59:32.653 INFO:teuthology.orchestra.run.smithi181.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 182/182 2024-02-21T22:59:32.653 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-2:19.0.0-1643.g3bfc837d.el9.x86_64 1/182 2024-02-21T22:59:32.654 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-base-2:19.0.0-1643.g3bfc837d.el9.x86_64 2/182 2024-02-21T22:59:32.654 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-common-2:19.0.0-1643.g3bfc837d.el9.x86_64 3/182 2024-02-21T22:59:32.654 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-fuse-2:19.0.0-1643.g3bfc837d.el9.x86_64 4/182 2024-02-21T22:59:32.654 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1643.g3bfc8 5/182 2024-02-21T22:59:32.654 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mds-2:19.0.0-1643.g3bfc837d.el9.x86_64 6/182 2024-02-21T22:59:32.654 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-2:19.0.0-1643.g3bfc837d.el9.x86_64 7/182 2024-02-21T22:59:32.654 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mon-2:19.0.0-1643.g3bfc837d.el9.x86_64 8/182 2024-02-21T22:59:32.654 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-osd-2:19.0.0-1643.g3bfc837d.el9.x86_64 9/182 2024-02-21T22:59:32.654 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-radosgw-2:19.0.0-1643.g3bfc837d.el9.x86_64 10/182 2024-02-21T22:59:32.654 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-selinux-2:19.0.0-1643.g3bfc837d.el9.x86_64 11/182 2024-02-21T22:59:32.654 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-test-2:19.0.0-1643.g3bfc837d.el9.x86_64 12/182 2024-02-21T22:59:32.654 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : cephfs-mirror-2:19.0.0-1643.g3bfc837d.el9.x86_64 13/182 2024-02-21T22:59:32.654 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : cephfs-shell-2:19.0.0-1643.g3bfc837d.el9.x86_64 14/182 2024-02-21T22:59:32.655 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libcephfs-devel-2:19.0.0-1643.g3bfc837d.el9.x86_ 15/182 2024-02-21T22:59:32.655 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libcephfs2-2:19.0.0-1643.g3bfc837d.el9.x86_64 16/182 2024-02-21T22:59:32.655 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libcephsqlite-2:19.0.0-1643.g3bfc837d.el9.x86_64 17/182 2024-02-21T22:59:32.655 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librados-devel-2:19.0.0-1643.g3bfc837d.el9.x86_6 18/182 2024-02-21T22:59:32.655 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libradosstriper1-2:19.0.0-1643.g3bfc837d.el9.x86 19/182 2024-02-21T22:59:32.655 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librgw2-2:19.0.0-1643.g3bfc837d.el9.x86_64 20/182 2024-02-21T22:59:32.655 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1643.g3bfc837d.el 21/182 2024-02-21T22:59:32.655 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-ceph-common-2:19.0.0-1643.g3bfc837d.el9. 22/182 2024-02-21T22:59:32.655 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cephfs-2:19.0.0-1643.g3bfc837d.el9.x86_6 23/182 2024-02-21T22:59:32.655 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-rados-2:19.0.0-1643.g3bfc837d.el9.x86_64 24/182 2024-02-21T22:59:32.655 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-rbd-2:19.0.0-1643.g3bfc837d.el9.x86_64 25/182 2024-02-21T22:59:32.655 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-rgw-2:19.0.0-1643.g3bfc837d.el9.x86_64 26/182 2024-02-21T22:59:32.655 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : rbd-fuse-2:19.0.0-1643.g3bfc837d.el9.x86_64 27/182 2024-02-21T22:59:32.655 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : rbd-mirror-2:19.0.0-1643.g3bfc837d.el9.x86_64 28/182 2024-02-21T22:59:32.655 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : rbd-nbd-2:19.0.0-1643.g3bfc837d.el9.x86_64 29/182 2024-02-21T22:59:32.656 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1643.g3bfc837d. 30/182 2024-02-21T22:59:32.669 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1643.g3bfc837d.el9.noa 31/182 2024-02-21T22:59:32.669 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1643.g3bfc837d.el9.n 32/182 2024-02-21T22:59:32.670 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1643.g3bf 33/182 2024-02-21T22:59:32.670 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1643.g3bfc837d.el 34/182 2024-02-21T22:59:32.670 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1643.g3bfc837d.el9.noarch 35/182 2024-02-21T22:59:32.670 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1643.g3bfc837d.e 36/182 2024-02-21T22:59:32.670 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : ceph-volume-2:19.0.0-1643.g3bfc837d.el9.noarch 37/182 2024-02-21T22:59:32.670 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : cephadm-2:19.0.0-1643.g3bfc837d.el9.noarch 38/182 2024-02-21T22:59:32.670 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : cephfs-top-2:19.0.0-1643.g3bfc837d.el9.noarch 39/182 2024-02-21T22:59:32.670 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 40/182 2024-02-21T22:59:32.670 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 41/182 2024-02-21T22:59:32.670 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : jq-1.6-16.el9.x86_64 42/182 2024-02-21T22:59:32.670 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 43/182 2024-02-21T22:59:32.670 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 44/182 2024-02-21T22:59:32.670 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 45/182 2024-02-21T22:59:32.671 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/182 2024-02-21T22:59:32.671 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 47/182 2024-02-21T22:59:32.671 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-ply-3.11-14.el9.noarch 48/182 2024-02-21T22:59:32.671 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 49/182 2024-02-21T22:59:32.671 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 50/182 2024-02-21T22:59:32.671 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 51/182 2024-02-21T22:59:32.671 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : automake-1.16.2-8.el9.noarch 52/182 2024-02-21T22:59:32.671 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : bison-3.7.4-5.el9.x86_64 53/182 2024-02-21T22:59:32.671 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 54/182 2024-02-21T22:59:32.671 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 55/182 2024-02-21T22:59:32.671 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : flex-2.6.4-9.el9.x86_64 56/182 2024-02-21T22:59:32.671 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 57/182 2024-02-21T22:59:32.671 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 58/182 2024-02-21T22:59:32.671 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 59/182 2024-02-21T22:59:32.672 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 60/182 2024-02-21T22:59:32.672 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 61/182 2024-02-21T22:59:32.672 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 62/182 2024-02-21T22:59:32.672 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 63/182 2024-02-21T22:59:32.672 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 64/182 2024-02-21T22:59:32.672 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 65/182 2024-02-21T22:59:32.672 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 66/182 2024-02-21T22:59:32.672 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : lua-5.4.4-4.el9.x86_64 67/182 2024-02-21T22:59:32.672 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 68/182 2024-02-21T22:59:32.672 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 69/182 2024-02-21T22:59:32.672 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 70/182 2024-02-21T22:59:32.672 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : postgresql-13.11-1.el9.x86_64 71/182 2024-02-21T22:59:32.672 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 72/182 2024-02-21T22:59:32.673 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 73/182 2024-02-21T22:59:32.673 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 74/182 2024-02-21T22:59:32.673 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 75/182 2024-02-21T22:59:32.673 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 76/182 2024-02-21T22:59:32.673 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 77/182 2024-02-21T22:59:32.673 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 78/182 2024-02-21T22:59:32.673 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 79/182 2024-02-21T22:59:32.673 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/182 2024-02-21T22:59:32.673 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/182 2024-02-21T22:59:32.673 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/182 2024-02-21T22:59:32.673 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/182 2024-02-21T22:59:32.673 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/182 2024-02-21T22:59:32.673 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/182 2024-02-21T22:59:32.674 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/182 2024-02-21T22:59:32.674 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/182 2024-02-21T22:59:32.674 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/182 2024-02-21T22:59:32.674 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/182 2024-02-21T22:59:32.674 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/182 2024-02-21T22:59:32.674 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/182 2024-02-21T22:59:32.674 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/182 2024-02-21T22:59:32.674 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/182 2024-02-21T22:59:32.674 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/182 2024-02-21T22:59:32.674 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/182 2024-02-21T22:59:32.674 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/182 2024-02-21T22:59:32.674 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : qatlib-23.11.0-1.el9.x86_64 97/182 2024-02-21T22:59:32.674 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : qatlib-service-23.11.0-1.el9.x86_64 98/182 2024-02-21T22:59:32.674 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : qatzip-libs-1.1.2-2.el9.x86_64 99/182 2024-02-21T22:59:32.675 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 100/182 2024-02-21T22:59:32.675 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/182 2024-02-21T22:59:32.675 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 102/182 2024-02-21T22:59:32.675 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/182 2024-02-21T22:59:32.675 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 104/182 2024-02-21T22:59:32.675 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/182 2024-02-21T22:59:32.675 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/182 2024-02-21T22:59:32.675 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/182 2024-02-21T22:59:32.675 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/182 2024-02-21T22:59:32.675 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/182 2024-02-21T22:59:32.675 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/182 2024-02-21T22:59:32.675 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/182 2024-02-21T22:59:32.675 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/182 2024-02-21T22:59:32.675 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/182 2024-02-21T22:59:32.675 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/182 2024-02-21T22:59:32.676 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/182 2024-02-21T22:59:32.676 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-asyncssh-2.13.2-4.el9.noarch 116/182 2024-02-21T22:59:32.676 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/182 2024-02-21T22:59:32.676 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/182 2024-02-21T22:59:32.676 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/182 2024-02-21T22:59:32.676 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/182 2024-02-21T22:59:32.676 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/182 2024-02-21T22:59:32.676 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/182 2024-02-21T22:59:32.676 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/182 2024-02-21T22:59:32.676 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-google-auth-1:2.27.0-1.el9.noarch 124/182 2024-02-21T22:59:32.676 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/182 2024-02-21T22:59:32.676 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/182 2024-02-21T22:59:32.676 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/182 2024-02-21T22:59:32.676 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/182 2024-02-21T22:59:32.677 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/182 2024-02-21T22:59:32.677 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/182 2024-02-21T22:59:32.677 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/182 2024-02-21T22:59:32.677 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/182 2024-02-21T22:59:32.677 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/182 2024-02-21T22:59:32.677 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/182 2024-02-21T22:59:32.677 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/182 2024-02-21T22:59:32.677 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/182 2024-02-21T22:59:32.677 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/182 2024-02-21T22:59:32.677 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/182 2024-02-21T22:59:32.677 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/182 2024-02-21T22:59:32.677 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/182 2024-02-21T22:59:32.677 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/182 2024-02-21T22:59:32.677 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/182 2024-02-21T22:59:32.678 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/182 2024-02-21T22:59:32.678 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/182 2024-02-21T22:59:32.678 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/182 2024-02-21T22:59:32.678 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/182 2024-02-21T22:59:32.678 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/182 2024-02-21T22:59:32.678 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/182 2024-02-21T22:59:32.678 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/182 2024-02-21T22:59:32.678 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/182 2024-02-21T22:59:32.678 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librados2-2:19.0.0-1643.g3bfc837d.el9.x86_64 151/182 2024-02-21T22:59:32.678 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/182 2024-02-21T22:59:32.678 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librbd1-2:19.0.0-1643.g3bfc837d.el9.x86_64 153/182 2024-02-21T22:59:32.678 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/182 2024-02-21T22:59:32.678 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-1:1.45.91-1.el9.x86_64 155/182 2024-02-21T22:59:32.678 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 156/182 2024-02-21T22:59:32.678 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-libnm-1:1.45.91-1.el9.x86_64 157/182 2024-02-21T22:59:32.679 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/182 2024-02-21T22:59:32.679 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-team-1:1.45.91-1.el9.x86_64 159/182 2024-02-21T22:59:32.679 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 160/182 2024-02-21T22:59:32.679 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-tui-1:1.45.91-1.el9.x86_64 161/182 2024-02-21T22:59:32.679 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 162/182 2024-02-21T22:59:32.679 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : acl-2.3.1-4.el9.x86_64 163/182 2024-02-21T22:59:32.679 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : acl-2.3.1-3.el9.x86_64 164/182 2024-02-21T22:59:32.679 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 165/182 2024-02-21T22:59:32.679 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 166/182 2024-02-21T22:59:32.679 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 167/182 2024-02-21T22:59:32.679 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 168/182 2024-02-21T22:59:32.679 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 169/182 2024-02-21T22:59:32.679 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 170/182 2024-02-21T22:59:32.679 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 171/182 2024-02-21T22:59:32.679 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 172/182 2024-02-21T22:59:32.680 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 173/182 2024-02-21T22:59:32.680 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 174/182 2024-02-21T22:59:32.680 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 175/182 2024-02-21T22:59:32.680 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 176/182 2024-02-21T22:59:32.680 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 177/182 2024-02-21T22:59:32.680 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 178/182 2024-02-21T22:59:32.680 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 179/182 2024-02-21T22:59:32.680 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 180/182 2024-02-21T22:59:32.680 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 181/182 2024-02-21T22:59:35.607 INFO:teuthology.orchestra.run.smithi181.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 182/182 2024-02-21T22:59:35.608 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-02-21T22:59:35.608 INFO:teuthology.orchestra.run.smithi181.stdout:Upgraded: 2024-02-21T22:59:35.608 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager-1:1.45.91-1.el9.x86_64 2024-02-21T22:59:35.608 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager-libnm-1:1.45.91-1.el9.x86_64 2024-02-21T22:59:35.608 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager-team-1:1.45.91-1.el9.x86_64 2024-02-21T22:59:35.608 INFO:teuthology.orchestra.run.smithi181.stdout: NetworkManager-tui-1:1.45.91-1.el9.x86_64 2024-02-21T22:59:35.608 INFO:teuthology.orchestra.run.smithi181.stdout: acl-2.3.1-4.el9.x86_64 2024-02-21T22:59:35.608 INFO:teuthology.orchestra.run.smithi181.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-02-21T22:59:35.608 INFO:teuthology.orchestra.run.smithi181.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-02-21T22:59:35.608 INFO:teuthology.orchestra.run.smithi181.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-02-21T22:59:35.608 INFO:teuthology.orchestra.run.smithi181.stdout: libacl-2.3.1-4.el9.x86_64 2024-02-21T22:59:35.608 INFO:teuthology.orchestra.run.smithi181.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-02-21T22:59:35.609 INFO:teuthology.orchestra.run.smithi181.stdout: librados2-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:35.609 INFO:teuthology.orchestra.run.smithi181.stdout: librbd1-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:35.609 INFO:teuthology.orchestra.run.smithi181.stdout: openssl-1:3.0.7-25.el9.x86_64 2024-02-21T22:59:35.609 INFO:teuthology.orchestra.run.smithi181.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2024-02-21T22:59:35.609 INFO:teuthology.orchestra.run.smithi181.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-02-21T22:59:35.609 INFO:teuthology.orchestra.run.smithi181.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-02-21T22:59:35.609 INFO:teuthology.orchestra.run.smithi181.stdout:Installed: 2024-02-21T22:59:35.609 INFO:teuthology.orchestra.run.smithi181.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-02-21T22:59:35.609 INFO:teuthology.orchestra.run.smithi181.stdout: automake-1.16.2-8.el9.noarch 2024-02-21T22:59:35.609 INFO:teuthology.orchestra.run.smithi181.stdout: bison-3.7.4-5.el9.x86_64 2024-02-21T22:59:35.609 INFO:teuthology.orchestra.run.smithi181.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-02-21T22:59:35.609 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:35.609 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-base-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:35.610 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-common-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:35.610 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-fuse-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:35.610 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-grafana-dashboards-2:19.0.0-1643.g3bfc837d.el9.noarch 2024-02-21T22:59:35.610 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-immutable-object-cache-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:35.610 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mds-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:35.610 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:35.610 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-cephadm-2:19.0.0-1643.g3bfc837d.el9.noarch 2024-02-21T22:59:35.610 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-dashboard-2:19.0.0-1643.g3bfc837d.el9.noarch 2024-02-21T22:59:35.610 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1643.g3bfc837d.el9.noarch 2024-02-21T22:59:35.610 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-modules-core-2:19.0.0-1643.g3bfc837d.el9.noarch 2024-02-21T22:59:35.610 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mgr-rook-2:19.0.0-1643.g3bfc837d.el9.noarch 2024-02-21T22:59:35.610 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-mon-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:35.610 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-osd-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:35.611 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-prometheus-alerts-2:19.0.0-1643.g3bfc837d.el9.noarch 2024-02-21T22:59:35.611 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-radosgw-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:35.611 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-selinux-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:35.611 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-test-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:35.611 INFO:teuthology.orchestra.run.smithi181.stdout: ceph-volume-2:19.0.0-1643.g3bfc837d.el9.noarch 2024-02-21T22:59:35.611 INFO:teuthology.orchestra.run.smithi181.stdout: cephadm-2:19.0.0-1643.g3bfc837d.el9.noarch 2024-02-21T22:59:35.611 INFO:teuthology.orchestra.run.smithi181.stdout: cephfs-mirror-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:35.611 INFO:teuthology.orchestra.run.smithi181.stdout: cephfs-shell-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:35.611 INFO:teuthology.orchestra.run.smithi181.stdout: cephfs-top-2:19.0.0-1643.g3bfc837d.el9.noarch 2024-02-21T22:59:35.611 INFO:teuthology.orchestra.run.smithi181.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-02-21T22:59:35.611 INFO:teuthology.orchestra.run.smithi181.stdout: flex-2.6.4-9.el9.x86_64 2024-02-21T22:59:35.611 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-02-21T22:59:35.611 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-02-21T22:59:35.612 INFO:teuthology.orchestra.run.smithi181.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-02-21T22:59:35.612 INFO:teuthology.orchestra.run.smithi181.stdout: fuse-2.9.9-15.el9.x86_64 2024-02-21T22:59:35.612 INFO:teuthology.orchestra.run.smithi181.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-02-21T22:59:35.612 INFO:teuthology.orchestra.run.smithi181.stdout: grpc-data-1.46.7-10.el9.noarch 2024-02-21T22:59:35.612 INFO:teuthology.orchestra.run.smithi181.stdout: jq-1.6-16.el9.x86_64 2024-02-21T22:59:35.612 INFO:teuthology.orchestra.run.smithi181.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-02-21T22:59:35.612 INFO:teuthology.orchestra.run.smithi181.stdout: libarrow-9.0.0-10.el9.x86_64 2024-02-21T22:59:35.612 INFO:teuthology.orchestra.run.smithi181.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-02-21T22:59:35.612 INFO:teuthology.orchestra.run.smithi181.stdout: libcephfs-devel-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:35.612 INFO:teuthology.orchestra.run.smithi181.stdout: libcephfs2-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:35.612 INFO:teuthology.orchestra.run.smithi181.stdout: libcephsqlite-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:35.612 INFO:teuthology.orchestra.run.smithi181.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-02-21T22:59:35.612 INFO:teuthology.orchestra.run.smithi181.stdout: liboath-2.6.7-2.el9.x86_64 2024-02-21T22:59:35.613 INFO:teuthology.orchestra.run.smithi181.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-02-21T22:59:35.613 INFO:teuthology.orchestra.run.smithi181.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-02-21T22:59:35.613 INFO:teuthology.orchestra.run.smithi181.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-02-21T22:59:35.613 INFO:teuthology.orchestra.run.smithi181.stdout: librados-devel-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:35.613 INFO:teuthology.orchestra.run.smithi181.stdout: libradosstriper1-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:35.613 INFO:teuthology.orchestra.run.smithi181.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-02-21T22:59:35.613 INFO:teuthology.orchestra.run.smithi181.stdout: librgw2-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:35.613 INFO:teuthology.orchestra.run.smithi181.stdout: libtool-2.4.6-45.el9.x86_64 2024-02-21T22:59:35.613 INFO:teuthology.orchestra.run.smithi181.stdout: libunwind-1.6.2-1.el9.x86_64 2024-02-21T22:59:35.613 INFO:teuthology.orchestra.run.smithi181.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2024-02-21T22:59:35.613 INFO:teuthology.orchestra.run.smithi181.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-02-21T22:59:35.613 INFO:teuthology.orchestra.run.smithi181.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-02-21T22:59:35.613 INFO:teuthology.orchestra.run.smithi181.stdout: lua-5.4.4-4.el9.x86_64 2024-02-21T22:59:35.614 INFO:teuthology.orchestra.run.smithi181.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-02-21T22:59:35.614 INFO:teuthology.orchestra.run.smithi181.stdout: luarocks-3.9.2-1.el9.noarch 2024-02-21T22:59:35.614 INFO:teuthology.orchestra.run.smithi181.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-02-21T22:59:35.614 INFO:teuthology.orchestra.run.smithi181.stdout: openblas-0.3.21-2.el9.x86_64 2024-02-21T22:59:35.614 INFO:teuthology.orchestra.run.smithi181.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-02-21T22:59:35.614 INFO:teuthology.orchestra.run.smithi181.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2024-02-21T22:59:35.614 INFO:teuthology.orchestra.run.smithi181.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-02-21T22:59:35.614 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-13.11-1.el9.x86_64 2024-02-21T22:59:35.614 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-02-21T22:59:35.614 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-02-21T22:59:35.614 INFO:teuthology.orchestra.run.smithi181.stdout: postgresql-server-13.11-1.el9.x86_64 2024-02-21T22:59:35.614 INFO:teuthology.orchestra.run.smithi181.stdout: protobuf-3.14.0-13.el9.x86_64 2024-02-21T22:59:35.614 INFO:teuthology.orchestra.run.smithi181.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-02-21T22:59:35.615 INFO:teuthology.orchestra.run.smithi181.stdout: python3-asyncssh-2.13.2-4.el9.noarch 2024-02-21T22:59:35.615 INFO:teuthology.orchestra.run.smithi181.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-02-21T22:59:35.615 INFO:teuthology.orchestra.run.smithi181.stdout: python3-babel-2.9.1-2.el9.noarch 2024-02-21T22:59:35.615 INFO:teuthology.orchestra.run.smithi181.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-02-21T22:59:35.615 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-02-21T22:59:35.615 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ceph-argparse-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:35.615 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ceph-common-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:35.615 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cephfs-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:35.615 INFO:teuthology.orchestra.run.smithi181.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-02-21T22:59:35.615 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-02-21T22:59:35.615 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-02-21T22:59:35.615 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-02-21T22:59:35.615 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-02-21T22:59:35.615 INFO:teuthology.orchestra.run.smithi181.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-02-21T22:59:35.616 INFO:teuthology.orchestra.run.smithi181.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-02-21T22:59:35.616 INFO:teuthology.orchestra.run.smithi181.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-02-21T22:59:35.616 INFO:teuthology.orchestra.run.smithi181.stdout: python3-google-auth-1:2.27.0-1.el9.noarch 2024-02-21T22:59:35.616 INFO:teuthology.orchestra.run.smithi181.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-02-21T22:59:35.616 INFO:teuthology.orchestra.run.smithi181.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-02-21T22:59:35.616 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-02-21T22:59:35.616 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-02-21T22:59:35.616 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-02-21T22:59:35.616 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-02-21T22:59:35.616 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-02-21T22:59:35.616 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-02-21T22:59:35.616 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-02-21T22:59:35.617 INFO:teuthology.orchestra.run.smithi181.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-02-21T22:59:35.617 INFO:teuthology.orchestra.run.smithi181.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-02-21T22:59:35.617 INFO:teuthology.orchestra.run.smithi181.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-02-21T22:59:35.617 INFO:teuthology.orchestra.run.smithi181.stdout: python3-mako-1.1.4-6.el9.noarch 2024-02-21T22:59:35.617 INFO:teuthology.orchestra.run.smithi181.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-02-21T22:59:35.617 INFO:teuthology.orchestra.run.smithi181.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-02-21T22:59:35.617 INFO:teuthology.orchestra.run.smithi181.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-02-21T22:59:35.617 INFO:teuthology.orchestra.run.smithi181.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-02-21T22:59:35.617 INFO:teuthology.orchestra.run.smithi181.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-02-21T22:59:35.617 INFO:teuthology.orchestra.run.smithi181.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-02-21T22:59:35.617 INFO:teuthology.orchestra.run.smithi181.stdout: python3-packaging-20.9-5.el9.noarch 2024-02-21T22:59:35.617 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-02-21T22:59:35.618 INFO:teuthology.orchestra.run.smithi181.stdout: python3-ply-3.11-14.el9.noarch 2024-02-21T22:59:35.618 INFO:teuthology.orchestra.run.smithi181.stdout: python3-portend-3.1.0-2.el9.noarch 2024-02-21T22:59:35.618 INFO:teuthology.orchestra.run.smithi181.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-02-21T22:59:35.618 INFO:teuthology.orchestra.run.smithi181.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-02-21T22:59:35.618 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-02-21T22:59:35.618 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-02-21T22:59:35.618 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-02-21T22:59:35.618 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pycparser-2.20-6.el9.noarch 2024-02-21T22:59:35.618 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-02-21T22:59:35.618 INFO:teuthology.orchestra.run.smithi181.stdout: python3-pytz-2021.1-5.el9.noarch 2024-02-21T22:59:35.618 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rados-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:35.618 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rbd-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:35.618 INFO:teuthology.orchestra.run.smithi181.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-02-21T22:59:35.618 INFO:teuthology.orchestra.run.smithi181.stdout: python3-requests-2.25.1-8.el9.noarch 2024-02-21T22:59:35.619 INFO:teuthology.orchestra.run.smithi181.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-02-21T22:59:35.619 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rgw-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:35.619 INFO:teuthology.orchestra.run.smithi181.stdout: python3-routes-2.5.1-5.el9.noarch 2024-02-21T22:59:35.619 INFO:teuthology.orchestra.run.smithi181.stdout: python3-rsa-4.9-2.el9.noarch 2024-02-21T22:59:35.619 INFO:teuthology.orchestra.run.smithi181.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-02-21T22:59:35.619 INFO:teuthology.orchestra.run.smithi181.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-02-21T22:59:35.619 INFO:teuthology.orchestra.run.smithi181.stdout: python3-toml-0.10.2-6.el9.noarch 2024-02-21T22:59:35.619 INFO:teuthology.orchestra.run.smithi181.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-02-21T22:59:35.619 INFO:teuthology.orchestra.run.smithi181.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-02-21T22:59:35.619 INFO:teuthology.orchestra.run.smithi181.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-02-21T22:59:35.619 INFO:teuthology.orchestra.run.smithi181.stdout: python3-webob-1.8.7-6.el9.noarch 2024-02-21T22:59:35.619 INFO:teuthology.orchestra.run.smithi181.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-02-21T22:59:35.619 INFO:teuthology.orchestra.run.smithi181.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-02-21T22:59:35.619 INFO:teuthology.orchestra.run.smithi181.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-02-21T22:59:35.619 INFO:teuthology.orchestra.run.smithi181.stdout: qatlib-23.11.0-1.el9.x86_64 2024-02-21T22:59:35.620 INFO:teuthology.orchestra.run.smithi181.stdout: qatlib-service-23.11.0-1.el9.x86_64 2024-02-21T22:59:35.620 INFO:teuthology.orchestra.run.smithi181.stdout: qatzip-libs-1.1.2-2.el9.x86_64 2024-02-21T22:59:35.620 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-fuse-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:35.620 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-mirror-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:35.620 INFO:teuthology.orchestra.run.smithi181.stdout: rbd-nbd-2:19.0.0-1643.g3bfc837d.el9.x86_64 2024-02-21T22:59:35.620 INFO:teuthology.orchestra.run.smithi181.stdout: re2-1:20211101-3.el9.x86_64 2024-02-21T22:59:35.620 INFO:teuthology.orchestra.run.smithi181.stdout: socat-1.7.4.1-5.el9.x86_64 2024-02-21T22:59:35.620 INFO:teuthology.orchestra.run.smithi181.stdout: thrift-0.15.0-2.el9.x86_64 2024-02-21T22:59:35.620 INFO:teuthology.orchestra.run.smithi181.stdout: uuid-1.6.2-55.el9.x86_64 2024-02-21T22:59:35.620 INFO:teuthology.orchestra.run.smithi181.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-02-21T22:59:35.620 INFO:teuthology.orchestra.run.smithi181.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-02-21T22:59:35.621 INFO:teuthology.orchestra.run.smithi181.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-02-21T22:59:35.621 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-02-21T22:59:35.621 INFO:teuthology.orchestra.run.smithi181.stdout:Complete! 2024-02-21T22:59:36.102 DEBUG:teuthology.parallel:result is None 2024-02-21T22:59:36.103 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3bfc837d7b45ce8e095d92fa9c342964cea5e95f 2024-02-21T22:59:36.325 DEBUG:teuthology.orchestra.run.smithi099:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-02-21T22:59:36.396 INFO:teuthology.orchestra.run.smithi099.stdout:19.0.0-1643.g3bfc837d.el9 2024-02-21T22:59:36.396 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1643.g3bfc837d.el9 2024-02-21T22:59:36.397 INFO:teuthology.task.install:The correct ceph version 19.0.0-1643.g3bfc837d is installed. 2024-02-21T22:59:36.398 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3bfc837d7b45ce8e095d92fa9c342964cea5e95f 2024-02-21T22:59:36.536 DEBUG:teuthology.orchestra.run.smithi162:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-02-21T22:59:36.562 INFO:teuthology.orchestra.run.smithi162.stdout:19.0.0-1643.g3bfc837d.el9 2024-02-21T22:59:36.562 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1643.g3bfc837d.el9 2024-02-21T22:59:36.563 INFO:teuthology.task.install:The correct ceph version 19.0.0-1643.g3bfc837d is installed. 2024-02-21T22:59:36.564 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3bfc837d7b45ce8e095d92fa9c342964cea5e95f 2024-02-21T22:59:36.783 DEBUG:teuthology.orchestra.run.smithi181:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-02-21T22:59:36.807 INFO:teuthology.orchestra.run.smithi181.stdout:19.0.0-1643.g3bfc837d.el9 2024-02-21T22:59:36.807 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1643.g3bfc837d.el9 2024-02-21T22:59:36.808 INFO:teuthology.task.install:The correct ceph version 19.0.0-1643.g3bfc837d is installed. 2024-02-21T22:59:36.809 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-02-21T22:59:36.809 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-02-21T22:59:36.809 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-21T22:59:36.899 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-02-21T22:59:36.899 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-21T22:59:36.933 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-02-21T22:59:36.933 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-21T22:59:36.967 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-02-21T22:59:36.967 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-02-21T22:59:36.967 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/usr/bin/daemon-helper 2024-02-21T22:59:37.064 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-21T22:59:37.154 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-02-21T22:59:37.154 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/usr/bin/daemon-helper 2024-02-21T22:59:37.186 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-21T22:59:37.256 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-02-21T22:59:37.256 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/usr/bin/daemon-helper 2024-02-21T22:59:37.288 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-21T22:59:37.357 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-02-21T22:59:37.358 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-02-21T22:59:37.358 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-21T22:59:37.452 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-21T22:59:37.587 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-02-21T22:59:37.587 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-21T22:59:37.620 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-21T22:59:37.689 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-02-21T22:59:37.689 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-21T22:59:37.721 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-21T22:59:37.791 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-02-21T22:59:37.792 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-02-21T22:59:37.792 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/usr/bin/stdin-killer 2024-02-21T22:59:37.889 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-21T22:59:37.982 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-02-21T22:59:37.983 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/usr/bin/stdin-killer 2024-02-21T22:59:38.014 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-21T22:59:38.084 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-02-21T22:59:38.085 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/usr/bin/stdin-killer 2024-02-21T22:59:38.116 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-21T22:59:38.187 INFO:teuthology.run_tasks:Running task ceph... 2024-02-21T22:59:38.273 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-02-21T22:59:38.273 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 777 /var/log/ceph 2024-02-21T22:59:38.280 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 777 /var/log/ceph 2024-02-21T22:59:38.283 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 777 /var/log/ceph 2024-02-21T22:59:38.370 INFO:tasks.ceph:Disabling ceph logrotate... 2024-02-21T22:59:38.370 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f -- /etc/logrotate.d/ceph 2024-02-21T22:59:38.377 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f -- /etc/logrotate.d/ceph 2024-02-21T22:59:38.379 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -f -- /etc/logrotate.d/ceph 2024-02-21T22:59:38.464 INFO:tasks.ceph:Creating extra log directories... 2024-02-21T22:59:38.464 DEBUG:teuthology.orchestra.run.smithi099:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-02-21T22:59:38.471 DEBUG:teuthology.orchestra.run.smithi162:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-02-21T22:59:38.473 DEBUG:teuthology.orchestra.run.smithi181:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-02-21T22:59:38.569 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-02-21T22:59:38.569 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-02-21T22:59:38.569 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-02-21T22:59:38.569 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-02-21T22:59:38.569 DEBUG:teuthology.orchestra.run.smithi099:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-02-21T22:59:38.622 DEBUG:teuthology.orchestra.run.smithi099:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-02-21T22:59:38.890 DEBUG:teuthology.orchestra.run.smithi099:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-02-21T22:59:38.987 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-02-21T22:59:38.987 DEBUG:teuthology.orchestra.run.smithi162:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-02-21T22:59:39.005 DEBUG:teuthology.orchestra.run.smithi162:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-02-21T22:59:39.130 DEBUG:teuthology.orchestra.run.smithi162:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-02-21T22:59:39.159 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-02-21T22:59:39.159 DEBUG:teuthology.orchestra.run.smithi181:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-02-21T22:59:39.177 DEBUG:teuthology.orchestra.run.smithi181:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-02-21T22:59:39.299 DEBUG:teuthology.orchestra.run.smithi181:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-02-21T22:59:39.335 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-02-21T22:59:39.335 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_export_ephemeral_random_max': 0.1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug cephsqlite': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-02-21T22:59:39.335 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/leonidus-2024-02-21_22:31:03-fs-wip-lusov-qdb-distro-default-smithi/7569996', 'branch': 'wip-lusov-qdb', 'description': 'fs/workload/{0-centos_9.stream begin/{0-install 1-ceph 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-workunit/suites/fsx}}', 'email': None, 'first_in_suite': False, 'job_id': '7569996', 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'leonidus-2024-02-21_22:31:03-fs-wip-lusov-qdb-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-lusov-qdb'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_export_ephemeral_random_max': 0.1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug cephsqlite': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '3bfc837d7b45ce8e095d92fa9c342964cea5e95f', 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'ceph-fuse': {'client.0': {'mount_subvol_num': 0}}, 'check-counter': {'counters': {'mds': ['mds.exported', 'mds.imported', 'mds.root_rsnaps', 'mds_server.req_mksnap_latency.avgcount', 'mds_server.req_rmsnap_latency.avgcount', 'mds.dir_split']}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '3bfc837d7b45ce8e095d92fa9c342964cea5e95f'}}, 'kclient': {'client.0': {'mount_subvol_num': 1}, 'mntopts': ['ms_mode=legacy', 'nowsync'], 'syntax': 'v1'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-lusov-qdb', 'sha1': '3bfc837d7b45ce8e095d92fa9c342964cea5e95f'}}, 'owner': 'scheduled_leonidus@teuthology', 'priority': 80, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'], ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'], ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11']], 'seed': 6562, 'sha1': '3bfc837d7b45ce8e095d92fa9c342964cea5e95f', 'sleep_before_teardown': 0, 'subset': '111/10000', 'suite': 'fs', 'suite_branch': 'wip-lusov-qdb', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_3bfc837d7b45ce8e095d92fa9c342964cea5e95f/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '3bfc837d7b45ce8e095d92fa9c342964cea5e95f', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi099.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBbsxG0N50+UN7ym+G75bwvacDLBprjEIIj9m2NrEU4iIn2/F7gQVGeV0IiiqHiJuSbRXUhzkwQKdfhJ6It4JUM=', 'smithi162.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDprMEvFEYup72AphAePaVP9XF2ePgeJBRAf3tOCAQgpTqhVYgWnsMjGrpOMqA5baaIZh1IS815ukmQBDqOqO5c=', 'smithi181.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJGxpBmgiHFvfK24zkudM4plSU+FSLbF4SgKgRfpJDyL3jcS0bK3bS1V+K13Li1uzfMvSnWf10Veqka+JRjkhP4='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '3bfc837d7b45ce8e095d92fa9c342964cea5e95f'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_export_ephemeral_random_max': 0.1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug cephsqlite': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '3bfc837d7b45ce8e095d92fa9c342964cea5e95f', 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}, 'cluster': 'ceph'}}, {'kclient': None}, {'exec': {'mon.a': ['ceph fs set cephfs balance_automate false', 'ceph fs subvolumegroup pin cephfs qa random 0.10']}}, {'check-counter': {}}, {'fwd_scrub': {'scrub_timeout': 900, 'sleep_between_iterations': 1}}, {'exec': {'mon.a': ['ceph mgr module enable snap_schedule', 'ceph config set mgr mgr/snap_schedule/allow_m_granularity true', 'ceph config set mgr mgr/snap_schedule/dump_on_update true', 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m', 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h', 'ceph fs snap-schedule status --fs=cephfs --path=/', 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true', 'date +%s > START_TIME']}}, {'full_sequential_finally': [{'exec': {'mon.a': ['date +%s > END_TIME', 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi', 'ceph fs snap-schedule status --fs=cephfs --path=/', 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true']}}]}, {'workunit': {'clients': {'all': ['suites/fsx.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': 'b1dac5519c57c269ea98a22fb7729016a1d0e4d2', 'timestamp': '2024-02-21_22:31:03', 'tube': 'smithi', 'user': 'leonidus', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-02-21T22:59:39.336 DEBUG:teuthology.orchestra.run.smithi099:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-02-21T22:59:39.343 DEBUG:teuthology.orchestra.run.smithi162:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-02-21T22:59:39.346 DEBUG:teuthology.orchestra.run.smithi181:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-02-21T22:59:39.393 DEBUG:teuthology.orchestra.run.smithi099:> sudo install -d -m0777 -- /var/run/ceph 2024-02-21T22:59:39.398 DEBUG:teuthology.orchestra.run.smithi162:> sudo install -d -m0777 -- /var/run/ceph 2024-02-21T22:59:39.403 DEBUG:teuthology.orchestra.run.smithi181:> sudo install -d -m0777 -- /var/run/ceph 2024-02-21T22:59:39.484 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-02-21T22:59:39.484 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/scratch_devs of=/dev/stdout 2024-02-21T22:59:39.536 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-21T22:59:39.536 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_1 2024-02-21T22:59:39.587 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-21T22:59:39.587 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-21T22:59:39.587 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 5h/5d Inode: 632 Links: 1 2024-02-21T22:59:39.588 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-21T22:59:39.588 INFO:teuthology.orchestra.run.smithi099.stdout:Context: system_u:object_r:device_t:s0 2024-02-21T22:59:39.588 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2024-02-21 22:59:12.042526595 +0000 2024-02-21T22:59:39.588 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2024-02-21 22:56:35.079923230 +0000 2024-02-21T22:59:39.588 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2024-02-21 22:56:35.079923230 +0000 2024-02-21T22:59:39.588 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: 2024-02-21 22:56:35.079923230 +0000 2024-02-21T22:59:39.588 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-21T22:59:39.672 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2024-02-21T22:59:39.672 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2024-02-21T22:59:39.672 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000323408 s, 1.6 MB/s 2024-02-21T22:59:39.676 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-21T22:59:39.733 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_2 2024-02-21T22:59:39.782 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-21T22:59:39.782 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-21T22:59:39.782 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 5h/5d Inode: 652 Links: 1 2024-02-21T22:59:39.782 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-21T22:59:39.782 INFO:teuthology.orchestra.run.smithi099.stdout:Context: system_u:object_r:device_t:s0 2024-02-21T22:59:39.782 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2024-02-21 22:59:12.043526572 +0000 2024-02-21T22:59:39.782 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2024-02-21 22:56:35.635910350 +0000 2024-02-21T22:59:39.782 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2024-02-21 22:56:35.635910350 +0000 2024-02-21T22:59:39.782 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: 2024-02-21 22:56:35.635910350 +0000 2024-02-21T22:59:39.783 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-21T22:59:39.873 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2024-02-21T22:59:39.873 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2024-02-21T22:59:39.873 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.00031573 s, 1.6 MB/s 2024-02-21T22:59:39.877 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-21T22:59:39.935 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_3 2024-02-21T22:59:39.984 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-21T22:59:39.984 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-21T22:59:39.984 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 5h/5d Inode: 670 Links: 1 2024-02-21T22:59:39.984 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-21T22:59:39.984 INFO:teuthology.orchestra.run.smithi099.stdout:Context: system_u:object_r:device_t:s0 2024-02-21T22:59:39.984 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2024-02-21 22:59:12.044526549 +0000 2024-02-21T22:59:39.984 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2024-02-21 22:56:36.200897261 +0000 2024-02-21T22:59:39.984 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2024-02-21 22:56:36.200897261 +0000 2024-02-21T22:59:39.984 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: 2024-02-21 22:56:36.200897261 +0000 2024-02-21T22:59:39.984 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-21T22:59:40.071 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2024-02-21T22:59:40.071 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2024-02-21T22:59:40.071 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.00036142 s, 1.4 MB/s 2024-02-21T22:59:40.074 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-21T22:59:40.125 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_4 2024-02-21T22:59:40.175 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-21T22:59:40.175 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-21T22:59:40.175 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 5h/5d Inode: 688 Links: 1 2024-02-21T22:59:40.175 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-21T22:59:40.175 INFO:teuthology.orchestra.run.smithi099.stdout:Context: system_u:object_r:device_t:s0 2024-02-21T22:59:40.175 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2024-02-21 22:59:12.044526549 +0000 2024-02-21T22:59:40.175 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2024-02-21 22:56:36.753884450 +0000 2024-02-21T22:59:40.175 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2024-02-21 22:56:36.753884450 +0000 2024-02-21T22:59:40.175 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: 2024-02-21 22:56:36.753884450 +0000 2024-02-21T22:59:40.176 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-21T22:59:40.255 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2024-02-21T22:59:40.255 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2024-02-21T22:59:40.255 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000294353 s, 1.7 MB/s 2024-02-21T22:59:40.258 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-21T22:59:40.311 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.9': '/dev/vg_nvme/lv_4'} 2024-02-21T22:59:40.311 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-02-21T22:59:40.311 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/scratch_devs of=/dev/stdout 2024-02-21T22:59:40.329 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-21T22:59:40.330 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_1 2024-02-21T22:59:40.387 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-21T22:59:40.387 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-21T22:59:40.387 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 5h/5d Inode: 663 Links: 1 2024-02-21T22:59:40.387 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-21T22:59:40.387 INFO:teuthology.orchestra.run.smithi162.stdout:Context: system_u:object_r:device_t:s0 2024-02-21T22:59:40.387 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-02-21 22:59:24.281036933 +0000 2024-02-21T22:59:40.387 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-02-21 22:55:45.788853657 +0000 2024-02-21T22:59:40.387 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-02-21 22:55:45.788853657 +0000 2024-02-21T22:59:40.387 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: 2024-02-21 22:55:45.788853657 +0000 2024-02-21T22:59:40.387 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-21T22:59:40.456 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-02-21T22:59:40.456 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-02-21T22:59:40.456 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000192899 s, 2.7 MB/s 2024-02-21T22:59:40.458 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-21T22:59:40.515 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_2 2024-02-21T22:59:40.572 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-21T22:59:40.572 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-21T22:59:40.572 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 5h/5d Inode: 682 Links: 1 2024-02-21T22:59:40.572 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-21T22:59:40.572 INFO:teuthology.orchestra.run.smithi162.stdout:Context: system_u:object_r:device_t:s0 2024-02-21T22:59:40.572 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-02-21 22:59:24.281036933 +0000 2024-02-21T22:59:40.572 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-02-21 22:55:46.138846528 +0000 2024-02-21T22:59:40.573 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-02-21 22:55:46.138846528 +0000 2024-02-21T22:59:40.573 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: 2024-02-21 22:55:46.138846528 +0000 2024-02-21T22:59:40.573 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-21T22:59:40.641 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-02-21T22:59:40.641 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-02-21T22:59:40.641 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000221556 s, 2.3 MB/s 2024-02-21T22:59:40.642 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-21T22:59:40.700 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_3 2024-02-21T22:59:40.757 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-21T22:59:40.757 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-21T22:59:40.757 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-02-21T22:59:40.757 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-21T22:59:40.757 INFO:teuthology.orchestra.run.smithi162.stdout:Context: system_u:object_r:device_t:s0 2024-02-21T22:59:40.757 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-02-21 22:59:24.281036933 +0000 2024-02-21T22:59:40.757 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-02-21 22:55:46.473839704 +0000 2024-02-21T22:59:40.757 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-02-21 22:55:46.474839683 +0000 2024-02-21T22:59:40.758 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: 2024-02-21 22:55:46.473839704 +0000 2024-02-21T22:59:40.758 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-21T22:59:40.826 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-02-21T22:59:40.826 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-02-21T22:59:40.826 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000222585 s, 2.3 MB/s 2024-02-21T22:59:40.827 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-21T22:59:40.884 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_4 2024-02-21T22:59:40.940 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-21T22:59:40.940 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-21T22:59:40.940 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 5h/5d Inode: 718 Links: 1 2024-02-21T22:59:40.940 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-21T22:59:40.941 INFO:teuthology.orchestra.run.smithi162.stdout:Context: system_u:object_r:device_t:s0 2024-02-21T22:59:40.941 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-02-21 22:59:24.282036912 +0000 2024-02-21T22:59:40.941 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-02-21 22:55:46.801833022 +0000 2024-02-21T22:59:40.941 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-02-21 22:55:46.801833022 +0000 2024-02-21T22:59:40.941 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: 2024-02-21 22:55:46.801833022 +0000 2024-02-21T22:59:40.941 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-21T22:59:41.008 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-02-21T22:59:41.008 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-02-21T22:59:41.008 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000214039 s, 2.4 MB/s 2024-02-21T22:59:41.009 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-21T22:59:41.066 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.10': '/dev/vg_nvme/lv_4'} 2024-02-21T22:59:41.066 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-02-21T22:59:41.066 DEBUG:teuthology.orchestra.run.smithi181:> dd if=/scratch_devs of=/dev/stdout 2024-02-21T22:59:41.084 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-21T22:59:41.085 DEBUG:teuthology.orchestra.run.smithi181:> stat /dev/vg_nvme/lv_1 2024-02-21T22:59:41.142 INFO:teuthology.orchestra.run.smithi181.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-21T22:59:41.142 INFO:teuthology.orchestra.run.smithi181.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-21T22:59:41.142 INFO:teuthology.orchestra.run.smithi181.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-02-21T22:59:41.142 INFO:teuthology.orchestra.run.smithi181.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-21T22:59:41.142 INFO:teuthology.orchestra.run.smithi181.stdout:Context: system_u:object_r:device_t:s0 2024-02-21T22:59:41.142 INFO:teuthology.orchestra.run.smithi181.stdout:Access: 2024-02-21 22:59:28.042056479 +0000 2024-02-21T22:59:41.142 INFO:teuthology.orchestra.run.smithi181.stdout:Modify: 2024-02-21 22:56:02.643185500 +0000 2024-02-21T22:59:41.142 INFO:teuthology.orchestra.run.smithi181.stdout:Change: 2024-02-21 22:56:02.643185500 +0000 2024-02-21T22:59:41.142 INFO:teuthology.orchestra.run.smithi181.stdout: Birth: 2024-02-21 22:56:02.643185500 +0000 2024-02-21T22:59:41.143 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-21T22:59:41.211 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records in 2024-02-21T22:59:41.211 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records out 2024-02-21T22:59:41.211 INFO:teuthology.orchestra.run.smithi181.stderr:512 bytes copied, 0.000277373 s, 1.8 MB/s 2024-02-21T22:59:41.212 DEBUG:teuthology.orchestra.run.smithi181:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-21T22:59:41.269 DEBUG:teuthology.orchestra.run.smithi181:> stat /dev/vg_nvme/lv_2 2024-02-21T22:59:41.326 INFO:teuthology.orchestra.run.smithi181.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-21T22:59:41.326 INFO:teuthology.orchestra.run.smithi181.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-21T22:59:41.327 INFO:teuthology.orchestra.run.smithi181.stdout:Device: 5h/5d Inode: 680 Links: 1 2024-02-21T22:59:41.327 INFO:teuthology.orchestra.run.smithi181.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-21T22:59:41.327 INFO:teuthology.orchestra.run.smithi181.stdout:Context: system_u:object_r:device_t:s0 2024-02-21T22:59:41.327 INFO:teuthology.orchestra.run.smithi181.stdout:Access: 2024-02-21 22:59:28.043056461 +0000 2024-02-21T22:59:41.327 INFO:teuthology.orchestra.run.smithi181.stdout:Modify: 2024-02-21 22:56:02.978179094 +0000 2024-02-21T22:59:41.327 INFO:teuthology.orchestra.run.smithi181.stdout:Change: 2024-02-21 22:56:02.978179094 +0000 2024-02-21T22:59:41.327 INFO:teuthology.orchestra.run.smithi181.stdout: Birth: 2024-02-21 22:56:02.978179094 +0000 2024-02-21T22:59:41.327 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-21T22:59:41.394 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records in 2024-02-21T22:59:41.394 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records out 2024-02-21T22:59:41.394 INFO:teuthology.orchestra.run.smithi181.stderr:512 bytes copied, 0.000234202 s, 2.2 MB/s 2024-02-21T22:59:41.395 DEBUG:teuthology.orchestra.run.smithi181:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-21T22:59:41.452 DEBUG:teuthology.orchestra.run.smithi181:> stat /dev/vg_nvme/lv_3 2024-02-21T22:59:41.507 INFO:teuthology.orchestra.run.smithi181.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-21T22:59:41.507 INFO:teuthology.orchestra.run.smithi181.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-21T22:59:41.508 INFO:teuthology.orchestra.run.smithi181.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-02-21T22:59:41.508 INFO:teuthology.orchestra.run.smithi181.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-21T22:59:41.508 INFO:teuthology.orchestra.run.smithi181.stdout:Context: system_u:object_r:device_t:s0 2024-02-21T22:59:41.508 INFO:teuthology.orchestra.run.smithi181.stdout:Access: 2024-02-21 22:59:28.043056461 +0000 2024-02-21T22:59:41.508 INFO:teuthology.orchestra.run.smithi181.stdout:Modify: 2024-02-21 22:56:03.321172536 +0000 2024-02-21T22:59:41.508 INFO:teuthology.orchestra.run.smithi181.stdout:Change: 2024-02-21 22:56:03.321172536 +0000 2024-02-21T22:59:41.508 INFO:teuthology.orchestra.run.smithi181.stdout: Birth: 2024-02-21 22:56:03.321172536 +0000 2024-02-21T22:59:41.508 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-21T22:59:41.574 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records in 2024-02-21T22:59:41.574 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records out 2024-02-21T22:59:41.574 INFO:teuthology.orchestra.run.smithi181.stderr:512 bytes copied, 0.000212856 s, 2.4 MB/s 2024-02-21T22:59:41.576 DEBUG:teuthology.orchestra.run.smithi181:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-21T22:59:41.631 DEBUG:teuthology.orchestra.run.smithi181:> stat /dev/vg_nvme/lv_4 2024-02-21T22:59:41.687 INFO:teuthology.orchestra.run.smithi181.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-21T22:59:41.687 INFO:teuthology.orchestra.run.smithi181.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-21T22:59:41.687 INFO:teuthology.orchestra.run.smithi181.stdout:Device: 5h/5d Inode: 718 Links: 1 2024-02-21T22:59:41.687 INFO:teuthology.orchestra.run.smithi181.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-21T22:59:41.687 INFO:teuthology.orchestra.run.smithi181.stdout:Context: system_u:object_r:device_t:s0 2024-02-21T22:59:41.688 INFO:teuthology.orchestra.run.smithi181.stdout:Access: 2024-02-21 22:59:28.043056461 +0000 2024-02-21T22:59:41.688 INFO:teuthology.orchestra.run.smithi181.stdout:Modify: 2024-02-21 22:56:03.678165708 +0000 2024-02-21T22:59:41.688 INFO:teuthology.orchestra.run.smithi181.stdout:Change: 2024-02-21 22:56:03.678165708 +0000 2024-02-21T22:59:41.688 INFO:teuthology.orchestra.run.smithi181.stdout: Birth: 2024-02-21 22:56:03.678165708 +0000 2024-02-21T22:59:41.688 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-21T22:59:41.753 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records in 2024-02-21T22:59:41.753 INFO:teuthology.orchestra.run.smithi181.stderr:1+0 records out 2024-02-21T22:59:41.753 INFO:teuthology.orchestra.run.smithi181.stderr:512 bytes copied, 0.000205577 s, 2.5 MB/s 2024-02-21T22:59:41.754 DEBUG:teuthology.orchestra.run.smithi181:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-21T22:59:41.809 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.11': '/dev/vg_nvme/lv_4'} 2024-02-21T22:59:41.809 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi099.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.9': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi162.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.10': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi181.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.11': '/dev/vg_nvme/lv_4'}} 2024-02-21T22:59:41.809 INFO:tasks.ceph:Generating config... 2024-02-21T22:59:41.810 INFO:tasks.ceph:[client] client mount timeout = 600 2024-02-21T22:59:41.811 INFO:tasks.ceph:[client] debug client = 20 2024-02-21T22:59:41.811 INFO:tasks.ceph:[client] debug ms = 1 2024-02-21T22:59:41.811 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-02-21T22:59:41.811 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-02-21T22:59:41.811 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-02-21T22:59:41.811 INFO:tasks.ceph:[mds] debug mds = 20 2024-02-21T22:59:41.811 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-02-21T22:59:41.811 INFO:tasks.ceph:[mds] debug ms = 1 2024-02-21T22:59:41.811 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2024-02-21T22:59:41.811 INFO:tasks.ceph:[mds] mds bal merge size = 5 2024-02-21T22:59:41.811 INFO:tasks.ceph:[mds] mds bal split bits = 3 2024-02-21T22:59:41.811 INFO:tasks.ceph:[mds] mds bal split size = 100 2024-02-21T22:59:41.811 INFO:tasks.ceph:[mds] mds debug frag = True 2024-02-21T22:59:41.812 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-02-21T22:59:41.812 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-02-21T22:59:41.812 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-02-21T22:59:41.812 INFO:tasks.ceph:[mds] mds_export_ephemeral_random_max = 0.1 2024-02-21T22:59:41.812 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-02-21T22:59:41.812 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-02-21T22:59:41.812 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-02-21T22:59:41.812 INFO:tasks.ceph:[mgr] cephsqlite lock renewal timeout = 900000 2024-02-21T22:59:41.812 INFO:tasks.ceph:[mgr] debug cephsqlite = 20 2024-02-21T22:59:41.812 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-02-21T22:59:41.812 INFO:tasks.ceph:[mgr] debug ms = 1 2024-02-21T22:59:41.812 INFO:tasks.ceph:[mon] debug mon = 20 2024-02-21T22:59:41.812 INFO:tasks.ceph:[mon] debug ms = 1 2024-02-21T22:59:41.813 INFO:tasks.ceph:[mon] debug paxos = 20 2024-02-21T22:59:41.813 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-02-21T22:59:41.813 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-02-21T22:59:41.813 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-02-21T22:59:41.813 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-02-21T22:59:41.813 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-02-21T22:59:41.813 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-02-21T22:59:41.813 INFO:tasks.ceph:[osd] debug ms = 1 2024-02-21T22:59:41.813 INFO:tasks.ceph:[osd] debug osd = 20 2024-02-21T22:59:41.813 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-02-21T22:59:41.813 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-02-21T22:59:41.813 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-02-21T22:59:41.813 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-02-21T22:59:41.813 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-02-21T22:59:41.813 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-02-21T22:59:41.813 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-02-21T22:59:41.814 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-02-21T22:59:41.814 INFO:tasks.ceph:[osd] osd_max_omap_entries_per_request = 10 2024-02-21T22:59:41.814 INFO:tasks.ceph:Setting up mon.a... 2024-02-21T22:59:41.814 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-02-21T22:59:41.964 INFO:teuthology.orchestra.run.smithi099.stdout:creating /etc/ceph/ceph.keyring 2024-02-21T22:59:41.973 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-02-21T22:59:42.104 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-02-21T22:59:42.199 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.99'), ('mon.b', '172.21.15.162'), ('mon.c', '172.21.15.181')] 2024-02-21T22:59:42.200 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.99,172.21.15.162,172.21.15.181', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'cephsqlite lock renewal timeout': 900000, 'debug cephsqlite': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.d': {}, 'mds.g': {}, 'mds.j': {}, 'mds.b': {}, 'mds.e': {}, 'mds.h': {}, 'mds.k': {}, 'mds.c': {}, 'mds.f': {}, 'mds.i': {}, 'mds.l': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_export_ephemeral_random_max': 0.1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-02-21T22:59:42.201 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-02-21T22:59:42.201 DEBUG:teuthology.orchestra.run.smithi099:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-02-21T22:59:42.253 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.99 --add b 172.21.15.162 --add c 172.21.15.181 --print /home/ubuntu/cephtest/ceph.monmap 2024-02-21T22:59:42.407 INFO:teuthology.orchestra.run.smithi099.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-02-21T22:59:42.408 INFO:teuthology.orchestra.run.smithi099.stdout:monmaptool: generated fsid e8af98cd-45a1-425f-96a7-f24da8ee4efb 2024-02-21T22:59:42.408 INFO:teuthology.orchestra.run.smithi099.stdout:setting min_mon_release = quincy 2024-02-21T22:59:42.408 INFO:teuthology.orchestra.run.smithi099.stdout:epoch 0 2024-02-21T22:59:42.408 INFO:teuthology.orchestra.run.smithi099.stdout:fsid e8af98cd-45a1-425f-96a7-f24da8ee4efb 2024-02-21T22:59:42.408 INFO:teuthology.orchestra.run.smithi099.stdout:last_changed 2024-02-21T22:59:42.419386+0000 2024-02-21T22:59:42.408 INFO:teuthology.orchestra.run.smithi099.stdout:created 2024-02-21T22:59:42.419386+0000 2024-02-21T22:59:42.408 INFO:teuthology.orchestra.run.smithi099.stdout:min_mon_release 17 (quincy) 2024-02-21T22:59:42.408 INFO:teuthology.orchestra.run.smithi099.stdout:election_strategy: 1 2024-02-21T22:59:42.408 INFO:teuthology.orchestra.run.smithi099.stdout:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-02-21T22:59:42.408 INFO:teuthology.orchestra.run.smithi099.stdout:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-02-21T22:59:42.408 INFO:teuthology.orchestra.run.smithi099.stdout:2: [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] mon.c 2024-02-21T22:59:42.408 INFO:teuthology.orchestra.run.smithi099.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-02-21T22:59:42.411 DEBUG:teuthology.orchestra.run.smithi099:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-02-21T22:59:42.461 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID e8af98cd-45a1-425f-96a7-f24da8ee4efb... 2024-02-21T22:59:42.461 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-02-21T22:59:42.467 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-02-21T22:59:42.469 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-02-21T22:59:42.523 INFO:teuthology.orchestra.run.smithi162.stdout:[global] 2024-02-21T22:59:42.524 INFO:teuthology.orchestra.run.smithi162.stdout: chdir = "" 2024-02-21T22:59:42.524 INFO:teuthology.orchestra.run.smithi162.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-02-21T22:59:42.524 INFO:teuthology.orchestra.run.smithi162.stdout: auth supported = cephx 2024-02-21T22:59:42.524 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-02-21T22:59:42.524 INFO:teuthology.orchestra.run.smithi162.stdout: filestore xattr use omap = true 2024-02-21T22:59:42.524 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-02-21T22:59:42.524 INFO:teuthology.orchestra.run.smithi162.stdout: mon clock drift allowed = 1.000 2024-02-21T22:59:42.524 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-02-21T22:59:42.524 INFO:teuthology.orchestra.run.smithi162.stdout: osd crush chooseleaf type = 0 2024-02-21T22:59:42.524 INFO:teuthology.orchestra.run.smithi162.stdout: auth debug = true 2024-02-21T22:59:42.524 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-02-21T22:59:42.524 INFO:teuthology.orchestra.run.smithi162.stdout: ms die on old message = true 2024-02-21T22:59:42.524 INFO:teuthology.orchestra.run.smithi162.stdout: ms die on bug = true 2024-02-21T22:59:42.525 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-02-21T22:59:42.525 INFO:teuthology.orchestra.run.smithi162.stdout: mon max pg per osd = 10000 # >= luminous 2024-02-21T22:59:42.525 INFO:teuthology.orchestra.run.smithi162.stdout: mon pg warn max object skew = 0 2024-02-21T22:59:42.525 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-02-21T22:59:42.525 INFO:teuthology.orchestra.run.smithi162.stdout: # disable pg_autoscaler by default for new pools 2024-02-21T22:59:42.525 INFO:teuthology.orchestra.run.smithi162.stdout: osd_pool_default_pg_autoscale_mode = off 2024-02-21T22:59:42.525 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-02-21T22:59:42.525 INFO:teuthology.orchestra.run.smithi162.stdout: osd pool default size = 2 2024-02-21T22:59:42.525 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-02-21T22:59:42.525 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd allow primary affinity = true 2024-02-21T22:59:42.525 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd allow pg remap = true 2024-02-21T22:59:42.525 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on legacy crush tunables = false 2024-02-21T22:59:42.525 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on crush straw calc version zero = false 2024-02-21T22:59:42.525 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on no sortbitwise = false 2024-02-21T22:59:42.525 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on osd down out interval zero = false 2024-02-21T22:59:42.526 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on too few osds = false 2024-02-21T22:59:42.526 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-02-21T22:59:42.526 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_pool_no_redundancy = false 2024-02-21T22:59:42.526 INFO:teuthology.orchestra.run.smithi162.stdout: mon_allow_pool_size_one = true 2024-02-21T22:59:42.526 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-02-21T22:59:42.526 INFO:teuthology.orchestra.run.smithi162.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-02-21T22:59:42.526 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-02-21T22:59:42.526 INFO:teuthology.orchestra.run.smithi162.stdout: osd default data pool replay window = 5 2024-02-21T22:59:42.526 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-02-21T22:59:42.526 INFO:teuthology.orchestra.run.smithi162.stdout: mon allow pool delete = true 2024-02-21T22:59:42.526 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-02-21T22:59:42.526 INFO:teuthology.orchestra.run.smithi162.stdout: mon cluster log file level = debug 2024-02-21T22:59:42.526 INFO:teuthology.orchestra.run.smithi162.stdout: debug asserts on shutdown = true 2024-02-21T22:59:42.526 INFO:teuthology.orchestra.run.smithi162.stdout: mon health detail to clog = false 2024-02-21T22:59:42.526 INFO:teuthology.orchestra.run.smithi162.stdout: mon host = "172.21.15.99,172.21.15.162,172.21.15.181" 2024-02-21T22:59:42.526 INFO:teuthology.orchestra.run.smithi162.stdout: ms die on skipped message = False 2024-02-21T22:59:42.527 INFO:teuthology.orchestra.run.smithi162.stdout: fsid = e8af98cd-45a1-425f-96a7-f24da8ee4efb 2024-02-21T22:59:42.527 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-02-21T22:59:42.527 INFO:teuthology.orchestra.run.smithi162.stdout:[osd] 2024-02-21T22:59:42.527 INFO:teuthology.orchestra.run.smithi162.stdout: osd journal size = 100 2024-02-21T22:59:42.527 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-02-21T22:59:42.527 INFO:teuthology.orchestra.run.smithi162.stdout: osd scrub load threshold = 5.0 2024-02-21T22:59:42.527 INFO:teuthology.orchestra.run.smithi162.stdout: osd scrub max interval = 600 2024-02-21T22:59:42.527 INFO:teuthology.orchestra.run.smithi162.stdout: osd mclock profile = high_recovery_ops 2024-02-21T22:59:42.527 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-02-21T22:59:42.527 INFO:teuthology.orchestra.run.smithi162.stdout: osd recover clone overlap = true 2024-02-21T22:59:42.527 INFO:teuthology.orchestra.run.smithi162.stdout: osd recovery max chunk = 1048576 2024-02-21T22:59:42.527 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-02-21T22:59:42.527 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug shutdown = true 2024-02-21T22:59:42.527 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug op order = true 2024-02-21T22:59:42.527 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug verify stray on activate = true 2024-02-21T22:59:42.527 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug trim objects = true 2024-02-21T22:59:42.528 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-02-21T22:59:42.528 INFO:teuthology.orchestra.run.smithi162.stdout: osd open classes on start = true 2024-02-21T22:59:42.528 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug pg log writeout = true 2024-02-21T22:59:42.528 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-02-21T22:59:42.528 INFO:teuthology.orchestra.run.smithi162.stdout: osd deep scrub update digest min age = 30 2024-02-21T22:59:42.528 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-02-21T22:59:42.528 INFO:teuthology.orchestra.run.smithi162.stdout: osd map max advance = 10 2024-02-21T22:59:42.528 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-02-21T22:59:42.528 INFO:teuthology.orchestra.run.smithi162.stdout: journal zero on create = true 2024-02-21T22:59:42.528 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-02-21T22:59:42.528 INFO:teuthology.orchestra.run.smithi162.stdout: filestore ondisk finisher threads = 3 2024-02-21T22:59:42.528 INFO:teuthology.orchestra.run.smithi162.stdout: filestore apply finisher threads = 3 2024-02-21T22:59:42.528 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-02-21T22:59:42.528 INFO:teuthology.orchestra.run.smithi162.stdout: bdev debug aio = true 2024-02-21T22:59:42.529 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug misdirected ops = true 2024-02-21T22:59:42.529 INFO:teuthology.orchestra.run.smithi162.stdout: bluestore block size = 96636764160 2024-02-21T22:59:42.529 INFO:teuthology.orchestra.run.smithi162.stdout: bluestore compression mode = aggressive 2024-02-21T22:59:42.529 INFO:teuthology.orchestra.run.smithi162.stdout: bluestore fsck on mount = True 2024-02-21T22:59:42.529 INFO:teuthology.orchestra.run.smithi162.stdout: debug bluefs = 20 2024-02-21T22:59:42.529 INFO:teuthology.orchestra.run.smithi162.stdout: debug bluestore = 20 2024-02-21T22:59:42.529 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2024-02-21T22:59:42.529 INFO:teuthology.orchestra.run.smithi162.stdout: debug osd = 20 2024-02-21T22:59:42.529 INFO:teuthology.orchestra.run.smithi162.stdout: debug rocksdb = 10 2024-02-21T22:59:42.529 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd backfillfull_ratio = 0.85 2024-02-21T22:59:42.529 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd full ratio = 0.9 2024-02-21T22:59:42.529 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd nearfull ratio = 0.8 2024-02-21T22:59:42.529 INFO:teuthology.orchestra.run.smithi162.stdout: osd failsafe full ratio = 0.95 2024-02-21T22:59:42.529 INFO:teuthology.orchestra.run.smithi162.stdout: osd objectstore = bluestore 2024-02-21T22:59:42.530 INFO:teuthology.orchestra.run.smithi162.stdout: osd op complaint time = 180 2024-02-21T22:59:42.530 INFO:teuthology.orchestra.run.smithi162.stdout: osd shutdown pgref assert = True 2024-02-21T22:59:42.530 INFO:teuthology.orchestra.run.smithi162.stdout: osd_max_omap_entries_per_request = 10 2024-02-21T22:59:42.530 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-02-21T22:59:42.530 INFO:teuthology.orchestra.run.smithi162.stdout:[mgr] 2024-02-21T22:59:42.530 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2024-02-21T22:59:42.530 INFO:teuthology.orchestra.run.smithi162.stdout: debug mgr = 20 2024-02-21T22:59:42.530 INFO:teuthology.orchestra.run.smithi162.stdout: debug mon = 20 2024-02-21T22:59:42.530 INFO:teuthology.orchestra.run.smithi162.stdout: debug auth = 20 2024-02-21T22:59:42.530 INFO:teuthology.orchestra.run.smithi162.stdout: mon reweight min pgs per osd = 4 2024-02-21T22:59:42.530 INFO:teuthology.orchestra.run.smithi162.stdout: mon reweight min bytes per osd = 10 2024-02-21T22:59:42.530 INFO:teuthology.orchestra.run.smithi162.stdout: mgr/telemetry/nag = false 2024-02-21T22:59:42.530 INFO:teuthology.orchestra.run.smithi162.stdout: cephsqlite lock renewal timeout = 900000 2024-02-21T22:59:42.530 INFO:teuthology.orchestra.run.smithi162.stdout: debug cephsqlite = 20 2024-02-21T22:59:42.531 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-02-21T22:59:42.531 INFO:teuthology.orchestra.run.smithi162.stdout:[mon] 2024-02-21T22:59:42.531 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2024-02-21T22:59:42.531 INFO:teuthology.orchestra.run.smithi162.stdout: debug mon = 20 2024-02-21T22:59:42.531 INFO:teuthology.orchestra.run.smithi162.stdout: debug paxos = 20 2024-02-21T22:59:42.531 INFO:teuthology.orchestra.run.smithi162.stdout: debug auth = 20 2024-02-21T22:59:42.531 INFO:teuthology.orchestra.run.smithi162.stdout: mon data avail warn = 5 2024-02-21T22:59:42.531 INFO:teuthology.orchestra.run.smithi162.stdout: mon mgr mkfs grace = 240 2024-02-21T22:59:42.531 INFO:teuthology.orchestra.run.smithi162.stdout: mon reweight min pgs per osd = 4 2024-02-21T22:59:42.531 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd reporter subtree level = osd 2024-02-21T22:59:42.531 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd prime pg temp = true 2024-02-21T22:59:42.531 INFO:teuthology.orchestra.run.smithi162.stdout: mon reweight min bytes per osd = 10 2024-02-21T22:59:42.531 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-02-21T22:59:42.531 INFO:teuthology.orchestra.run.smithi162.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-02-21T22:59:42.532 INFO:teuthology.orchestra.run.smithi162.stdout: auth mon ticket ttl = 660 # 11m 2024-02-21T22:59:42.532 INFO:teuthology.orchestra.run.smithi162.stdout: auth service ticket ttl = 240 # 4m 2024-02-21T22:59:42.532 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-02-21T22:59:42.532 INFO:teuthology.orchestra.run.smithi162.stdout: # don't complain about insecure global_id in the test suite 2024-02-21T22:59:42.532 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-02-21T22:59:42.532 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-02-21T22:59:42.532 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-02-21T22:59:42.532 INFO:teuthology.orchestra.run.smithi162.stdout: # 1m isn't quite enough 2024-02-21T22:59:42.532 INFO:teuthology.orchestra.run.smithi162.stdout: mon_down_mkfs_grace = 2m 2024-02-21T22:59:42.532 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-02-21T22:59:42.532 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_filestore_osds = false 2024-02-21T22:59:42.532 INFO:teuthology.orchestra.run.smithi162.stdout: mon op complaint time = 120 2024-02-21T22:59:42.532 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-02-21T22:59:42.532 INFO:teuthology.orchestra.run.smithi162.stdout:[client] 2024-02-21T22:59:42.533 INFO:teuthology.orchestra.run.smithi162.stdout: rgw cache enabled = true 2024-02-21T22:59:42.533 INFO:teuthology.orchestra.run.smithi162.stdout: rgw enable ops log = true 2024-02-21T22:59:42.533 INFO:teuthology.orchestra.run.smithi162.stdout: rgw enable usage log = true 2024-02-21T22:59:42.533 INFO:teuthology.orchestra.run.smithi162.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-02-21T22:59:42.533 INFO:teuthology.orchestra.run.smithi162.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-02-21T22:59:42.533 INFO:teuthology.orchestra.run.smithi162.stdout: client mount timeout = 600 2024-02-21T22:59:42.533 INFO:teuthology.orchestra.run.smithi162.stdout: debug client = 20 2024-02-21T22:59:42.533 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2024-02-21T22:59:42.533 INFO:teuthology.orchestra.run.smithi162.stdout: rados mon op timeout = 900 2024-02-21T22:59:42.533 INFO:teuthology.orchestra.run.smithi162.stdout: rados osd op timeout = 900 2024-02-21T22:59:42.533 INFO:teuthology.orchestra.run.smithi162.stdout:[mon.a] 2024-02-21T22:59:42.533 INFO:teuthology.orchestra.run.smithi162.stdout:[mon.b] 2024-02-21T22:59:42.533 INFO:teuthology.orchestra.run.smithi162.stdout:[mon.c] 2024-02-21T22:59:42.533 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.a] 2024-02-21T22:59:42.533 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.d] 2024-02-21T22:59:42.533 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.g] 2024-02-21T22:59:42.534 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.j] 2024-02-21T22:59:42.534 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.b] 2024-02-21T22:59:42.534 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.e] 2024-02-21T22:59:42.534 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.h] 2024-02-21T22:59:42.534 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.k] 2024-02-21T22:59:42.534 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.c] 2024-02-21T22:59:42.534 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.f] 2024-02-21T22:59:42.534 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.i] 2024-02-21T22:59:42.534 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.l] 2024-02-21T22:59:42.534 INFO:teuthology.orchestra.run.smithi162.stdout:[mds] 2024-02-21T22:59:42.534 INFO:teuthology.orchestra.run.smithi162.stdout: debug mds = 20 2024-02-21T22:59:42.534 INFO:teuthology.orchestra.run.smithi162.stdout: debug mds balancer = 20 2024-02-21T22:59:42.534 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2024-02-21T22:59:42.534 INFO:teuthology.orchestra.run.smithi162.stdout: mds bal fragment size max = 10000 2024-02-21T22:59:42.534 INFO:teuthology.orchestra.run.smithi162.stdout: mds bal merge size = 5 2024-02-21T22:59:42.535 INFO:teuthology.orchestra.run.smithi162.stdout: mds bal split bits = 3 2024-02-21T22:59:42.535 INFO:teuthology.orchestra.run.smithi162.stdout: mds bal split size = 100 2024-02-21T22:59:42.535 INFO:teuthology.orchestra.run.smithi162.stdout: mds debug frag = True 2024-02-21T22:59:42.535 INFO:teuthology.orchestra.run.smithi162.stdout: mds debug scatterstat = True 2024-02-21T22:59:42.535 INFO:teuthology.orchestra.run.smithi162.stdout: mds op complaint time = 180 2024-02-21T22:59:42.535 INFO:teuthology.orchestra.run.smithi162.stdout: mds verify scatter = True 2024-02-21T22:59:42.535 INFO:teuthology.orchestra.run.smithi162.stdout: mds_export_ephemeral_random_max = 0.1 2024-02-21T22:59:42.535 INFO:teuthology.orchestra.run.smithi162.stdout: osd op complaint time = 180 2024-02-21T22:59:42.535 INFO:teuthology.orchestra.run.smithi162.stdout: rados mon op timeout = 900 2024-02-21T22:59:42.535 INFO:teuthology.orchestra.run.smithi162.stdout: rados osd op timeout = 900 2024-02-21T22:59:42.535 INFO:teuthology.orchestra.run.smithi181.stdout:[global] 2024-02-21T22:59:42.536 INFO:teuthology.orchestra.run.smithi181.stdout: chdir = "" 2024-02-21T22:59:42.536 INFO:teuthology.orchestra.run.smithi181.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-02-21T22:59:42.536 INFO:teuthology.orchestra.run.smithi181.stdout: auth supported = cephx 2024-02-21T22:59:42.536 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-02-21T22:59:42.536 INFO:teuthology.orchestra.run.smithi181.stdout: filestore xattr use omap = true 2024-02-21T22:59:42.536 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-02-21T22:59:42.536 INFO:teuthology.orchestra.run.smithi181.stdout: mon clock drift allowed = 1.000 2024-02-21T22:59:42.536 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-02-21T22:59:42.536 INFO:teuthology.orchestra.run.smithi181.stdout: osd crush chooseleaf type = 0 2024-02-21T22:59:42.536 INFO:teuthology.orchestra.run.smithi181.stdout: auth debug = true 2024-02-21T22:59:42.536 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-02-21T22:59:42.536 INFO:teuthology.orchestra.run.smithi181.stdout: ms die on old message = true 2024-02-21T22:59:42.536 INFO:teuthology.orchestra.run.smithi181.stdout: ms die on bug = true 2024-02-21T22:59:42.537 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-02-21T22:59:42.537 INFO:teuthology.orchestra.run.smithi181.stdout: mon max pg per osd = 10000 # >= luminous 2024-02-21T22:59:42.537 INFO:teuthology.orchestra.run.smithi181.stdout: mon pg warn max object skew = 0 2024-02-21T22:59:42.537 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-02-21T22:59:42.537 INFO:teuthology.orchestra.run.smithi181.stdout: # disable pg_autoscaler by default for new pools 2024-02-21T22:59:42.537 INFO:teuthology.orchestra.run.smithi181.stdout: osd_pool_default_pg_autoscale_mode = off 2024-02-21T22:59:42.537 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-02-21T22:59:42.537 INFO:teuthology.orchestra.run.smithi181.stdout: osd pool default size = 2 2024-02-21T22:59:42.537 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-02-21T22:59:42.537 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd allow primary affinity = true 2024-02-21T22:59:42.537 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd allow pg remap = true 2024-02-21T22:59:42.537 INFO:teuthology.orchestra.run.smithi181.stdout: mon warn on legacy crush tunables = false 2024-02-21T22:59:42.537 INFO:teuthology.orchestra.run.smithi181.stdout: mon warn on crush straw calc version zero = false 2024-02-21T22:59:42.537 INFO:teuthology.orchestra.run.smithi181.stdout: mon warn on no sortbitwise = false 2024-02-21T22:59:42.538 INFO:teuthology.orchestra.run.smithi181.stdout: mon warn on osd down out interval zero = false 2024-02-21T22:59:42.538 INFO:teuthology.orchestra.run.smithi181.stdout: mon warn on too few osds = false 2024-02-21T22:59:42.538 INFO:teuthology.orchestra.run.smithi181.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-02-21T22:59:42.538 INFO:teuthology.orchestra.run.smithi181.stdout: mon_warn_on_pool_no_redundancy = false 2024-02-21T22:59:42.538 INFO:teuthology.orchestra.run.smithi181.stdout: mon_allow_pool_size_one = true 2024-02-21T22:59:42.538 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-02-21T22:59:42.538 INFO:teuthology.orchestra.run.smithi181.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-02-21T22:59:42.538 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-02-21T22:59:42.538 INFO:teuthology.orchestra.run.smithi181.stdout: osd default data pool replay window = 5 2024-02-21T22:59:42.538 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-02-21T22:59:42.538 INFO:teuthology.orchestra.run.smithi181.stdout: mon allow pool delete = true 2024-02-21T22:59:42.538 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-02-21T22:59:42.538 INFO:teuthology.orchestra.run.smithi181.stdout: mon cluster log file level = debug 2024-02-21T22:59:42.538 INFO:teuthology.orchestra.run.smithi181.stdout: debug asserts on shutdown = true 2024-02-21T22:59:42.539 INFO:teuthology.orchestra.run.smithi181.stdout: mon health detail to clog = false 2024-02-21T22:59:42.539 INFO:teuthology.orchestra.run.smithi181.stdout: mon host = "172.21.15.99,172.21.15.162,172.21.15.181" 2024-02-21T22:59:42.539 INFO:teuthology.orchestra.run.smithi181.stdout: ms die on skipped message = False 2024-02-21T22:59:42.539 INFO:teuthology.orchestra.run.smithi181.stdout: fsid = e8af98cd-45a1-425f-96a7-f24da8ee4efb 2024-02-21T22:59:42.539 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-02-21T22:59:42.539 INFO:teuthology.orchestra.run.smithi181.stdout:[osd] 2024-02-21T22:59:42.539 INFO:teuthology.orchestra.run.smithi181.stdout: osd journal size = 100 2024-02-21T22:59:42.539 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-02-21T22:59:42.539 INFO:teuthology.orchestra.run.smithi181.stdout: osd scrub load threshold = 5.0 2024-02-21T22:59:42.539 INFO:teuthology.orchestra.run.smithi181.stdout: osd scrub max interval = 600 2024-02-21T22:59:42.539 INFO:teuthology.orchestra.run.smithi181.stdout: osd mclock profile = high_recovery_ops 2024-02-21T22:59:42.539 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-02-21T22:59:42.539 INFO:teuthology.orchestra.run.smithi181.stdout: osd recover clone overlap = true 2024-02-21T22:59:42.539 INFO:teuthology.orchestra.run.smithi181.stdout: osd recovery max chunk = 1048576 2024-02-21T22:59:42.539 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-02-21T22:59:42.540 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug shutdown = true 2024-02-21T22:59:42.540 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug op order = true 2024-02-21T22:59:42.540 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug verify stray on activate = true 2024-02-21T22:59:42.540 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug trim objects = true 2024-02-21T22:59:42.540 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-02-21T22:59:42.540 INFO:teuthology.orchestra.run.smithi181.stdout: osd open classes on start = true 2024-02-21T22:59:42.540 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug pg log writeout = true 2024-02-21T22:59:42.540 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-02-21T22:59:42.540 INFO:teuthology.orchestra.run.smithi181.stdout: osd deep scrub update digest min age = 30 2024-02-21T22:59:42.540 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-02-21T22:59:42.540 INFO:teuthology.orchestra.run.smithi181.stdout: osd map max advance = 10 2024-02-21T22:59:42.540 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-02-21T22:59:42.540 INFO:teuthology.orchestra.run.smithi181.stdout: journal zero on create = true 2024-02-21T22:59:42.540 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-02-21T22:59:42.541 INFO:teuthology.orchestra.run.smithi181.stdout: filestore ondisk finisher threads = 3 2024-02-21T22:59:42.541 INFO:teuthology.orchestra.run.smithi181.stdout: filestore apply finisher threads = 3 2024-02-21T22:59:42.541 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-02-21T22:59:42.541 INFO:teuthology.orchestra.run.smithi181.stdout: bdev debug aio = true 2024-02-21T22:59:42.541 INFO:teuthology.orchestra.run.smithi181.stdout: osd debug misdirected ops = true 2024-02-21T22:59:42.541 INFO:teuthology.orchestra.run.smithi181.stdout: bluestore block size = 96636764160 2024-02-21T22:59:42.541 INFO:teuthology.orchestra.run.smithi181.stdout: bluestore compression mode = aggressive 2024-02-21T22:59:42.541 INFO:teuthology.orchestra.run.smithi181.stdout: bluestore fsck on mount = True 2024-02-21T22:59:42.541 INFO:teuthology.orchestra.run.smithi181.stdout: debug bluefs = 20 2024-02-21T22:59:42.541 INFO:teuthology.orchestra.run.smithi181.stdout: debug bluestore = 20 2024-02-21T22:59:42.541 INFO:teuthology.orchestra.run.smithi181.stdout: debug ms = 1 2024-02-21T22:59:42.541 INFO:teuthology.orchestra.run.smithi181.stdout: debug osd = 20 2024-02-21T22:59:42.541 INFO:teuthology.orchestra.run.smithi181.stdout: debug rocksdb = 10 2024-02-21T22:59:42.541 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd backfillfull_ratio = 0.85 2024-02-21T22:59:42.542 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd full ratio = 0.9 2024-02-21T22:59:42.542 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd nearfull ratio = 0.8 2024-02-21T22:59:42.542 INFO:teuthology.orchestra.run.smithi181.stdout: osd failsafe full ratio = 0.95 2024-02-21T22:59:42.542 INFO:teuthology.orchestra.run.smithi181.stdout: osd objectstore = bluestore 2024-02-21T22:59:42.542 INFO:teuthology.orchestra.run.smithi181.stdout: osd op complaint time = 180 2024-02-21T22:59:42.542 INFO:teuthology.orchestra.run.smithi181.stdout: osd shutdown pgref assert = True 2024-02-21T22:59:42.542 INFO:teuthology.orchestra.run.smithi181.stdout: osd_max_omap_entries_per_request = 10 2024-02-21T22:59:42.542 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-02-21T22:59:42.542 INFO:teuthology.orchestra.run.smithi181.stdout:[mgr] 2024-02-21T22:59:42.542 INFO:teuthology.orchestra.run.smithi181.stdout: debug ms = 1 2024-02-21T22:59:42.542 INFO:teuthology.orchestra.run.smithi181.stdout: debug mgr = 20 2024-02-21T22:59:42.542 INFO:teuthology.orchestra.run.smithi181.stdout: debug mon = 20 2024-02-21T22:59:42.542 INFO:teuthology.orchestra.run.smithi181.stdout: debug auth = 20 2024-02-21T22:59:42.542 INFO:teuthology.orchestra.run.smithi181.stdout: mon reweight min pgs per osd = 4 2024-02-21T22:59:42.542 INFO:teuthology.orchestra.run.smithi181.stdout: mon reweight min bytes per osd = 10 2024-02-21T22:59:42.542 INFO:teuthology.orchestra.run.smithi181.stdout: mgr/telemetry/nag = false 2024-02-21T22:59:42.543 INFO:teuthology.orchestra.run.smithi181.stdout: cephsqlite lock renewal timeout = 900000 2024-02-21T22:59:42.543 INFO:teuthology.orchestra.run.smithi181.stdout: debug cephsqlite = 20 2024-02-21T22:59:42.543 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-02-21T22:59:42.543 INFO:teuthology.orchestra.run.smithi181.stdout:[mon] 2024-02-21T22:59:42.543 INFO:teuthology.orchestra.run.smithi181.stdout: debug ms = 1 2024-02-21T22:59:42.543 INFO:teuthology.orchestra.run.smithi181.stdout: debug mon = 20 2024-02-21T22:59:42.543 INFO:teuthology.orchestra.run.smithi181.stdout: debug paxos = 20 2024-02-21T22:59:42.543 INFO:teuthology.orchestra.run.smithi181.stdout: debug auth = 20 2024-02-21T22:59:42.543 INFO:teuthology.orchestra.run.smithi181.stdout: mon data avail warn = 5 2024-02-21T22:59:42.543 INFO:teuthology.orchestra.run.smithi181.stdout: mon mgr mkfs grace = 240 2024-02-21T22:59:42.543 INFO:teuthology.orchestra.run.smithi181.stdout: mon reweight min pgs per osd = 4 2024-02-21T22:59:42.543 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd reporter subtree level = osd 2024-02-21T22:59:42.543 INFO:teuthology.orchestra.run.smithi181.stdout: mon osd prime pg temp = true 2024-02-21T22:59:42.543 INFO:teuthology.orchestra.run.smithi181.stdout: mon reweight min bytes per osd = 10 2024-02-21T22:59:42.544 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-02-21T22:59:42.544 INFO:teuthology.orchestra.run.smithi181.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-02-21T22:59:42.544 INFO:teuthology.orchestra.run.smithi181.stdout: auth mon ticket ttl = 660 # 11m 2024-02-21T22:59:42.544 INFO:teuthology.orchestra.run.smithi181.stdout: auth service ticket ttl = 240 # 4m 2024-02-21T22:59:42.544 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-02-21T22:59:42.544 INFO:teuthology.orchestra.run.smithi181.stdout: # don't complain about insecure global_id in the test suite 2024-02-21T22:59:42.544 INFO:teuthology.orchestra.run.smithi181.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-02-21T22:59:42.544 INFO:teuthology.orchestra.run.smithi181.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-02-21T22:59:42.544 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-02-21T22:59:42.544 INFO:teuthology.orchestra.run.smithi181.stdout: # 1m isn't quite enough 2024-02-21T22:59:42.544 INFO:teuthology.orchestra.run.smithi181.stdout: mon_down_mkfs_grace = 2m 2024-02-21T22:59:42.544 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-02-21T22:59:42.544 INFO:teuthology.orchestra.run.smithi181.stdout: mon_warn_on_filestore_osds = false 2024-02-21T22:59:42.545 INFO:teuthology.orchestra.run.smithi181.stdout: mon op complaint time = 120 2024-02-21T22:59:42.545 INFO:teuthology.orchestra.run.smithi181.stdout: 2024-02-21T22:59:42.545 INFO:teuthology.orchestra.run.smithi181.stdout:[client] 2024-02-21T22:59:42.545 INFO:teuthology.orchestra.run.smithi181.stdout: rgw cache enabled = true 2024-02-21T22:59:42.545 INFO:teuthology.orchestra.run.smithi181.stdout: rgw enable ops log = true 2024-02-21T22:59:42.545 INFO:teuthology.orchestra.run.smithi181.stdout: rgw enable usage log = true 2024-02-21T22:59:42.545 INFO:teuthology.orchestra.run.smithi181.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-02-21T22:59:42.545 INFO:teuthology.orchestra.run.smithi181.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-02-21T22:59:42.545 INFO:teuthology.orchestra.run.smithi181.stdout: client mount timeout = 600 2024-02-21T22:59:42.545 INFO:teuthology.orchestra.run.smithi181.stdout: debug client = 20 2024-02-21T22:59:42.545 INFO:teuthology.orchestra.run.smithi181.stdout: debug ms = 1 2024-02-21T22:59:42.545 INFO:teuthology.orchestra.run.smithi181.stdout: rados mon op timeout = 900 2024-02-21T22:59:42.545 INFO:teuthology.orchestra.run.smithi181.stdout: rados osd op timeout = 900 2024-02-21T22:59:42.545 INFO:teuthology.orchestra.run.smithi181.stdout:[mon.a] 2024-02-21T22:59:42.545 INFO:teuthology.orchestra.run.smithi181.stdout:[mon.b] 2024-02-21T22:59:42.546 INFO:teuthology.orchestra.run.smithi181.stdout:[mon.c] 2024-02-21T22:59:42.546 INFO:teuthology.orchestra.run.smithi181.stdout:[mds.a] 2024-02-21T22:59:42.546 INFO:teuthology.orchestra.run.smithi181.stdout:[mds.d] 2024-02-21T22:59:42.546 INFO:teuthology.orchestra.run.smithi181.stdout:[mds.g] 2024-02-21T22:59:42.546 INFO:teuthology.orchestra.run.smithi181.stdout:[mds.j] 2024-02-21T22:59:42.546 INFO:teuthology.orchestra.run.smithi181.stdout:[mds.b] 2024-02-21T22:59:42.546 INFO:teuthology.orchestra.run.smithi181.stdout:[mds.e] 2024-02-21T22:59:42.546 INFO:teuthology.orchestra.run.smithi181.stdout:[mds.h] 2024-02-21T22:59:42.546 INFO:teuthology.orchestra.run.smithi181.stdout:[mds.k] 2024-02-21T22:59:42.546 INFO:teuthology.orchestra.run.smithi181.stdout:[mds.c] 2024-02-21T22:59:42.546 INFO:teuthology.orchestra.run.smithi181.stdout:[mds.f] 2024-02-21T22:59:42.546 INFO:teuthology.orchestra.run.smithi181.stdout:[mds.i] 2024-02-21T22:59:42.546 INFO:teuthology.orchestra.run.smithi181.stdout:[mds.l] 2024-02-21T22:59:42.546 INFO:teuthology.orchestra.run.smithi181.stdout:[mds] 2024-02-21T22:59:42.546 INFO:teuthology.orchestra.run.smithi181.stdout: debug mds = 20 2024-02-21T22:59:42.546 INFO:teuthology.orchestra.run.smithi181.stdout: debug mds balancer = 20 2024-02-21T22:59:42.547 INFO:teuthology.orchestra.run.smithi181.stdout: debug ms = 1 2024-02-21T22:59:42.547 INFO:teuthology.orchestra.run.smithi181.stdout: mds bal fragment size max = 10000 2024-02-21T22:59:42.547 INFO:teuthology.orchestra.run.smithi181.stdout: mds bal merge size = 5 2024-02-21T22:59:42.547 INFO:teuthology.orchestra.run.smithi181.stdout: mds bal split bits = 3 2024-02-21T22:59:42.547 INFO:teuthology.orchestra.run.smithi181.stdout: mds bal split size = 100 2024-02-21T22:59:42.547 INFO:teuthology.orchestra.run.smithi181.stdout: mds debug frag = True 2024-02-21T22:59:42.547 INFO:teuthology.orchestra.run.smithi181.stdout: mds debug scatterstat = True 2024-02-21T22:59:42.547 INFO:teuthology.orchestra.run.smithi181.stdout: mds op complaint time = 180 2024-02-21T22:59:42.547 INFO:teuthology.orchestra.run.smithi181.stdout: mds verify scatter = True 2024-02-21T22:59:42.547 INFO:teuthology.orchestra.run.smithi181.stdout: mds_export_ephemeral_random_max = 0.1 2024-02-21T22:59:42.547 INFO:teuthology.orchestra.run.smithi181.stdout: osd op complaint time = 180 2024-02-21T22:59:42.547 INFO:teuthology.orchestra.run.smithi181.stdout: rados mon op timeout = 900 2024-02-21T22:59:42.547 INFO:teuthology.orchestra.run.smithi181.stdout: rados osd op timeout = 900 2024-02-21T22:59:42.628 INFO:teuthology.orchestra.run.smithi099.stdout:[global] 2024-02-21T22:59:42.628 INFO:teuthology.orchestra.run.smithi099.stdout: chdir = "" 2024-02-21T22:59:42.628 INFO:teuthology.orchestra.run.smithi099.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-02-21T22:59:42.629 INFO:teuthology.orchestra.run.smithi099.stdout: auth supported = cephx 2024-02-21T22:59:42.629 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T22:59:42.629 INFO:teuthology.orchestra.run.smithi099.stdout: filestore xattr use omap = true 2024-02-21T22:59:42.629 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T22:59:42.629 INFO:teuthology.orchestra.run.smithi099.stdout: mon clock drift allowed = 1.000 2024-02-21T22:59:42.629 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T22:59:42.629 INFO:teuthology.orchestra.run.smithi099.stdout: osd crush chooseleaf type = 0 2024-02-21T22:59:42.629 INFO:teuthology.orchestra.run.smithi099.stdout: auth debug = true 2024-02-21T22:59:42.629 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T22:59:42.629 INFO:teuthology.orchestra.run.smithi099.stdout: ms die on old message = true 2024-02-21T22:59:42.629 INFO:teuthology.orchestra.run.smithi099.stdout: ms die on bug = true 2024-02-21T22:59:42.629 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T22:59:42.629 INFO:teuthology.orchestra.run.smithi099.stdout: mon max pg per osd = 10000 # >= luminous 2024-02-21T22:59:42.630 INFO:teuthology.orchestra.run.smithi099.stdout: mon pg warn max object skew = 0 2024-02-21T22:59:42.630 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T22:59:42.630 INFO:teuthology.orchestra.run.smithi099.stdout: # disable pg_autoscaler by default for new pools 2024-02-21T22:59:42.630 INFO:teuthology.orchestra.run.smithi099.stdout: osd_pool_default_pg_autoscale_mode = off 2024-02-21T22:59:42.630 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T22:59:42.630 INFO:teuthology.orchestra.run.smithi099.stdout: osd pool default size = 2 2024-02-21T22:59:42.630 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T22:59:42.630 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd allow primary affinity = true 2024-02-21T22:59:42.630 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd allow pg remap = true 2024-02-21T22:59:42.630 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on legacy crush tunables = false 2024-02-21T22:59:42.630 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on crush straw calc version zero = false 2024-02-21T22:59:42.630 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on no sortbitwise = false 2024-02-21T22:59:42.630 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on osd down out interval zero = false 2024-02-21T22:59:42.630 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on too few osds = false 2024-02-21T22:59:42.630 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-02-21T22:59:42.631 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_pool_no_redundancy = false 2024-02-21T22:59:42.631 INFO:teuthology.orchestra.run.smithi099.stdout: mon_allow_pool_size_one = true 2024-02-21T22:59:42.631 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T22:59:42.631 INFO:teuthology.orchestra.run.smithi099.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-02-21T22:59:42.631 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T22:59:42.631 INFO:teuthology.orchestra.run.smithi099.stdout: osd default data pool replay window = 5 2024-02-21T22:59:42.631 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T22:59:42.631 INFO:teuthology.orchestra.run.smithi099.stdout: mon allow pool delete = true 2024-02-21T22:59:42.631 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T22:59:42.631 INFO:teuthology.orchestra.run.smithi099.stdout: mon cluster log file level = debug 2024-02-21T22:59:42.631 INFO:teuthology.orchestra.run.smithi099.stdout: debug asserts on shutdown = true 2024-02-21T22:59:42.631 INFO:teuthology.orchestra.run.smithi099.stdout: mon health detail to clog = false 2024-02-21T22:59:42.632 INFO:teuthology.orchestra.run.smithi099.stdout: mon host = "172.21.15.99,172.21.15.162,172.21.15.181" 2024-02-21T22:59:42.632 INFO:teuthology.orchestra.run.smithi099.stdout: ms die on skipped message = False 2024-02-21T22:59:42.632 INFO:teuthology.orchestra.run.smithi099.stdout: fsid = e8af98cd-45a1-425f-96a7-f24da8ee4efb 2024-02-21T22:59:42.632 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T22:59:42.632 INFO:teuthology.orchestra.run.smithi099.stdout:[osd] 2024-02-21T22:59:42.632 INFO:teuthology.orchestra.run.smithi099.stdout: osd journal size = 100 2024-02-21T22:59:42.632 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T22:59:42.632 INFO:teuthology.orchestra.run.smithi099.stdout: osd scrub load threshold = 5.0 2024-02-21T22:59:42.632 INFO:teuthology.orchestra.run.smithi099.stdout: osd scrub max interval = 600 2024-02-21T22:59:42.632 INFO:teuthology.orchestra.run.smithi099.stdout: osd mclock profile = high_recovery_ops 2024-02-21T22:59:42.632 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T22:59:42.632 INFO:teuthology.orchestra.run.smithi099.stdout: osd recover clone overlap = true 2024-02-21T22:59:42.632 INFO:teuthology.orchestra.run.smithi099.stdout: osd recovery max chunk = 1048576 2024-02-21T22:59:42.632 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T22:59:42.633 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug shutdown = true 2024-02-21T22:59:42.633 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug op order = true 2024-02-21T22:59:42.633 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug verify stray on activate = true 2024-02-21T22:59:42.633 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug trim objects = true 2024-02-21T22:59:42.633 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T22:59:42.633 INFO:teuthology.orchestra.run.smithi099.stdout: osd open classes on start = true 2024-02-21T22:59:42.633 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug pg log writeout = true 2024-02-21T22:59:42.633 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T22:59:42.633 INFO:teuthology.orchestra.run.smithi099.stdout: osd deep scrub update digest min age = 30 2024-02-21T22:59:42.633 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T22:59:42.633 INFO:teuthology.orchestra.run.smithi099.stdout: osd map max advance = 10 2024-02-21T22:59:42.633 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T22:59:42.633 INFO:teuthology.orchestra.run.smithi099.stdout: journal zero on create = true 2024-02-21T22:59:42.633 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T22:59:42.634 INFO:teuthology.orchestra.run.smithi099.stdout: filestore ondisk finisher threads = 3 2024-02-21T22:59:42.634 INFO:teuthology.orchestra.run.smithi099.stdout: filestore apply finisher threads = 3 2024-02-21T22:59:42.634 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T22:59:42.634 INFO:teuthology.orchestra.run.smithi099.stdout: bdev debug aio = true 2024-02-21T22:59:42.634 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug misdirected ops = true 2024-02-21T22:59:42.634 INFO:teuthology.orchestra.run.smithi099.stdout: bluestore block size = 96636764160 2024-02-21T22:59:42.634 INFO:teuthology.orchestra.run.smithi099.stdout: bluestore compression mode = aggressive 2024-02-21T22:59:42.634 INFO:teuthology.orchestra.run.smithi099.stdout: bluestore fsck on mount = True 2024-02-21T22:59:42.634 INFO:teuthology.orchestra.run.smithi099.stdout: debug bluefs = 20 2024-02-21T22:59:42.634 INFO:teuthology.orchestra.run.smithi099.stdout: debug bluestore = 20 2024-02-21T22:59:42.634 INFO:teuthology.orchestra.run.smithi099.stdout: debug ms = 1 2024-02-21T22:59:42.634 INFO:teuthology.orchestra.run.smithi099.stdout: debug osd = 20 2024-02-21T22:59:42.634 INFO:teuthology.orchestra.run.smithi099.stdout: debug rocksdb = 10 2024-02-21T22:59:42.634 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd backfillfull_ratio = 0.85 2024-02-21T22:59:42.635 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd full ratio = 0.9 2024-02-21T22:59:42.635 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd nearfull ratio = 0.8 2024-02-21T22:59:42.635 INFO:teuthology.orchestra.run.smithi099.stdout: osd failsafe full ratio = 0.95 2024-02-21T22:59:42.635 INFO:teuthology.orchestra.run.smithi099.stdout: osd objectstore = bluestore 2024-02-21T22:59:42.635 INFO:teuthology.orchestra.run.smithi099.stdout: osd op complaint time = 180 2024-02-21T22:59:42.635 INFO:teuthology.orchestra.run.smithi099.stdout: osd shutdown pgref assert = True 2024-02-21T22:59:42.635 INFO:teuthology.orchestra.run.smithi099.stdout: osd_max_omap_entries_per_request = 10 2024-02-21T22:59:42.635 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T22:59:42.635 INFO:teuthology.orchestra.run.smithi099.stdout:[mgr] 2024-02-21T22:59:42.635 INFO:teuthology.orchestra.run.smithi099.stdout: debug ms = 1 2024-02-21T22:59:42.635 INFO:teuthology.orchestra.run.smithi099.stdout: debug mgr = 20 2024-02-21T22:59:42.635 INFO:teuthology.orchestra.run.smithi099.stdout: debug mon = 20 2024-02-21T22:59:42.635 INFO:teuthology.orchestra.run.smithi099.stdout: debug auth = 20 2024-02-21T22:59:42.635 INFO:teuthology.orchestra.run.smithi099.stdout: mon reweight min pgs per osd = 4 2024-02-21T22:59:42.636 INFO:teuthology.orchestra.run.smithi099.stdout: mon reweight min bytes per osd = 10 2024-02-21T22:59:42.636 INFO:teuthology.orchestra.run.smithi099.stdout: mgr/telemetry/nag = false 2024-02-21T22:59:42.636 INFO:teuthology.orchestra.run.smithi099.stdout: cephsqlite lock renewal timeout = 900000 2024-02-21T22:59:42.636 INFO:teuthology.orchestra.run.smithi099.stdout: debug cephsqlite = 20 2024-02-21T22:59:42.636 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T22:59:42.636 INFO:teuthology.orchestra.run.smithi099.stdout:[mon] 2024-02-21T22:59:42.636 INFO:teuthology.orchestra.run.smithi099.stdout: debug ms = 1 2024-02-21T22:59:42.636 INFO:teuthology.orchestra.run.smithi099.stdout: debug mon = 20 2024-02-21T22:59:42.636 INFO:teuthology.orchestra.run.smithi099.stdout: debug paxos = 20 2024-02-21T22:59:42.636 INFO:teuthology.orchestra.run.smithi099.stdout: debug auth = 20 2024-02-21T22:59:42.636 INFO:teuthology.orchestra.run.smithi099.stdout: mon data avail warn = 5 2024-02-21T22:59:42.636 INFO:teuthology.orchestra.run.smithi099.stdout: mon mgr mkfs grace = 240 2024-02-21T22:59:42.636 INFO:teuthology.orchestra.run.smithi099.stdout: mon reweight min pgs per osd = 4 2024-02-21T22:59:42.637 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd reporter subtree level = osd 2024-02-21T22:59:42.637 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd prime pg temp = true 2024-02-21T22:59:42.637 INFO:teuthology.orchestra.run.smithi099.stdout: mon reweight min bytes per osd = 10 2024-02-21T22:59:42.637 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T22:59:42.637 INFO:teuthology.orchestra.run.smithi099.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-02-21T22:59:42.637 INFO:teuthology.orchestra.run.smithi099.stdout: auth mon ticket ttl = 660 # 11m 2024-02-21T22:59:42.637 INFO:teuthology.orchestra.run.smithi099.stdout: auth service ticket ttl = 240 # 4m 2024-02-21T22:59:42.637 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T22:59:42.637 INFO:teuthology.orchestra.run.smithi099.stdout: # don't complain about insecure global_id in the test suite 2024-02-21T22:59:42.637 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-02-21T22:59:42.637 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-02-21T22:59:42.637 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T22:59:42.637 INFO:teuthology.orchestra.run.smithi099.stdout: # 1m isn't quite enough 2024-02-21T22:59:42.637 INFO:teuthology.orchestra.run.smithi099.stdout: mon_down_mkfs_grace = 2m 2024-02-21T22:59:42.638 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T22:59:42.638 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_filestore_osds = false 2024-02-21T22:59:42.638 INFO:teuthology.orchestra.run.smithi099.stdout: mon op complaint time = 120 2024-02-21T22:59:42.638 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T22:59:42.638 INFO:teuthology.orchestra.run.smithi099.stdout:[client] 2024-02-21T22:59:42.638 INFO:teuthology.orchestra.run.smithi099.stdout: rgw cache enabled = true 2024-02-21T22:59:42.638 INFO:teuthology.orchestra.run.smithi099.stdout: rgw enable ops log = true 2024-02-21T22:59:42.638 INFO:teuthology.orchestra.run.smithi099.stdout: rgw enable usage log = true 2024-02-21T22:59:42.638 INFO:teuthology.orchestra.run.smithi099.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-02-21T22:59:42.638 INFO:teuthology.orchestra.run.smithi099.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-02-21T22:59:42.638 INFO:teuthology.orchestra.run.smithi099.stdout: client mount timeout = 600 2024-02-21T22:59:42.638 INFO:teuthology.orchestra.run.smithi099.stdout: debug client = 20 2024-02-21T22:59:42.638 INFO:teuthology.orchestra.run.smithi099.stdout: debug ms = 1 2024-02-21T22:59:42.638 INFO:teuthology.orchestra.run.smithi099.stdout: rados mon op timeout = 900 2024-02-21T22:59:42.638 INFO:teuthology.orchestra.run.smithi099.stdout: rados osd op timeout = 900 2024-02-21T22:59:42.639 INFO:teuthology.orchestra.run.smithi099.stdout:[mon.a] 2024-02-21T22:59:42.639 INFO:teuthology.orchestra.run.smithi099.stdout:[mon.b] 2024-02-21T22:59:42.639 INFO:teuthology.orchestra.run.smithi099.stdout:[mon.c] 2024-02-21T22:59:42.639 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.a] 2024-02-21T22:59:42.639 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.d] 2024-02-21T22:59:42.639 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.g] 2024-02-21T22:59:42.639 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.j] 2024-02-21T22:59:42.639 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.b] 2024-02-21T22:59:42.639 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.e] 2024-02-21T22:59:42.639 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.h] 2024-02-21T22:59:42.639 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.k] 2024-02-21T22:59:42.639 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.c] 2024-02-21T22:59:42.639 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.f] 2024-02-21T22:59:42.639 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.i] 2024-02-21T22:59:42.639 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.l] 2024-02-21T22:59:42.639 INFO:teuthology.orchestra.run.smithi099.stdout:[mds] 2024-02-21T22:59:42.640 INFO:teuthology.orchestra.run.smithi099.stdout: debug mds = 20 2024-02-21T22:59:42.640 INFO:teuthology.orchestra.run.smithi099.stdout: debug mds balancer = 20 2024-02-21T22:59:42.640 INFO:teuthology.orchestra.run.smithi099.stdout: debug ms = 1 2024-02-21T22:59:42.640 INFO:teuthology.orchestra.run.smithi099.stdout: mds bal fragment size max = 10000 2024-02-21T22:59:42.640 INFO:teuthology.orchestra.run.smithi099.stdout: mds bal merge size = 5 2024-02-21T22:59:42.640 INFO:teuthology.orchestra.run.smithi099.stdout: mds bal split bits = 3 2024-02-21T22:59:42.640 INFO:teuthology.orchestra.run.smithi099.stdout: mds bal split size = 100 2024-02-21T22:59:42.640 INFO:teuthology.orchestra.run.smithi099.stdout: mds debug frag = True 2024-02-21T22:59:42.640 INFO:teuthology.orchestra.run.smithi099.stdout: mds debug scatterstat = True 2024-02-21T22:59:42.640 INFO:teuthology.orchestra.run.smithi099.stdout: mds op complaint time = 180 2024-02-21T22:59:42.640 INFO:teuthology.orchestra.run.smithi099.stdout: mds verify scatter = True 2024-02-21T22:59:42.640 INFO:teuthology.orchestra.run.smithi099.stdout: mds_export_ephemeral_random_max = 0.1 2024-02-21T22:59:42.640 INFO:teuthology.orchestra.run.smithi099.stdout: osd op complaint time = 180 2024-02-21T22:59:42.640 INFO:teuthology.orchestra.run.smithi099.stdout: rados mon op timeout = 900 2024-02-21T22:59:42.640 INFO:teuthology.orchestra.run.smithi099.stdout: rados osd op timeout = 900 2024-02-21T22:59:42.673 INFO:tasks.ceph:Creating admin key on mon.a... 2024-02-21T22:59:42.673 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-02-21T22:59:42.817 INFO:tasks.ceph:Copying monmap to all nodes... 2024-02-21T22:59:42.818 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-02-21T22:59:42.818 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-02-21T22:59:42.863 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-02-21T22:59:42.863 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-02-21T22:59:42.960 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi099.front.sepia.ceph.com 2024-02-21T22:59:42.960 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-02-21T22:59:42.960 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/ceph/ceph.keyring 2024-02-21T22:59:42.961 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-02-21T22:59:43.104 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-02-21T22:59:43.104 DEBUG:teuthology.orchestra.run.smithi099:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-02-21T22:59:43.203 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi162.front.sepia.ceph.com 2024-02-21T22:59:43.204 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-02-21T22:59:43.204 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/ceph/ceph.keyring 2024-02-21T22:59:43.204 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-02-21T22:59:43.249 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-02-21T22:59:43.249 DEBUG:teuthology.orchestra.run.smithi162:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-02-21T22:59:43.305 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi181.front.sepia.ceph.com 2024-02-21T22:59:43.305 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-02-21T22:59:43.305 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd of=/etc/ceph/ceph.keyring 2024-02-21T22:59:43.305 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-02-21T22:59:43.350 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-02-21T22:59:43.351 DEBUG:teuthology.orchestra.run.smithi181:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-02-21T22:59:43.407 INFO:tasks.ceph:Setting up mon nodes... 2024-02-21T22:59:43.407 INFO:tasks.ceph:Setting up mgr nodes... 2024-02-21T22:59:43.408 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-02-21T22:59:43.588 INFO:teuthology.orchestra.run.smithi099.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-02-21T22:59:43.598 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-02-21T22:59:43.666 INFO:teuthology.orchestra.run.smithi162.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-02-21T22:59:43.670 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/mgr/ceph-z && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.z /var/lib/ceph/mgr/ceph-z/keyring 2024-02-21T22:59:43.740 INFO:teuthology.orchestra.run.smithi181.stdout:creating /var/lib/ceph/mgr/ceph-z/keyring 2024-02-21T22:59:43.743 INFO:tasks.ceph:Setting up mds nodes... 2024-02-21T22:59:43.743 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-02-21T22:59:43.926 INFO:teuthology.orchestra.run.smithi099.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-02-21T22:59:43.935 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-02-21T22:59:44.026 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-02-21T22:59:44.200 INFO:teuthology.orchestra.run.smithi099.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-02-21T22:59:44.210 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-02-21T22:59:44.288 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/mds/ceph-g && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.g /var/lib/ceph/mds/ceph-g/keyring 2024-02-21T22:59:44.459 INFO:teuthology.orchestra.run.smithi099.stdout:creating /var/lib/ceph/mds/ceph-g/keyring 2024-02-21T22:59:44.469 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-g 2024-02-21T22:59:44.558 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/mds/ceph-j && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.j /var/lib/ceph/mds/ceph-j/keyring 2024-02-21T22:59:44.731 INFO:teuthology.orchestra.run.smithi099.stdout:creating /var/lib/ceph/mds/ceph-j/keyring 2024-02-21T22:59:44.740 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-j 2024-02-21T22:59:44.826 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-02-21T22:59:44.887 INFO:teuthology.orchestra.run.smithi162.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-02-21T22:59:44.890 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-02-21T22:59:44.918 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2024-02-21T22:59:45.015 INFO:teuthology.orchestra.run.smithi162.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2024-02-21T22:59:45.018 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2024-02-21T22:59:45.045 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/mds/ceph-h && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.h /var/lib/ceph/mds/ceph-h/keyring 2024-02-21T22:59:45.139 INFO:teuthology.orchestra.run.smithi162.stdout:creating /var/lib/ceph/mds/ceph-h/keyring 2024-02-21T22:59:45.142 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-h 2024-02-21T22:59:45.168 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/mds/ceph-k && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.k /var/lib/ceph/mds/ceph-k/keyring 2024-02-21T22:59:45.262 INFO:teuthology.orchestra.run.smithi162.stdout:creating /var/lib/ceph/mds/ceph-k/keyring 2024-02-21T22:59:45.264 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-k 2024-02-21T22:59:45.290 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-02-21T22:59:45.354 INFO:teuthology.orchestra.run.smithi181.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-02-21T22:59:45.356 DEBUG:teuthology.orchestra.run.smithi181:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-02-21T22:59:45.385 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2024-02-21T22:59:45.481 INFO:teuthology.orchestra.run.smithi181.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2024-02-21T22:59:45.483 DEBUG:teuthology.orchestra.run.smithi181:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2024-02-21T22:59:45.510 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/mds/ceph-i && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.i /var/lib/ceph/mds/ceph-i/keyring 2024-02-21T22:59:45.604 INFO:teuthology.orchestra.run.smithi181.stdout:creating /var/lib/ceph/mds/ceph-i/keyring 2024-02-21T22:59:45.607 DEBUG:teuthology.orchestra.run.smithi181:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-i 2024-02-21T22:59:45.633 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/mds/ceph-l && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.l /var/lib/ceph/mds/ceph-l/keyring 2024-02-21T22:59:45.727 INFO:teuthology.orchestra.run.smithi181.stdout:creating /var/lib/ceph/mds/ceph-l/keyring 2024-02-21T22:59:45.730 DEBUG:teuthology.orchestra.run.smithi181:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-l 2024-02-21T22:59:45.755 INFO:tasks.ceph_client:Setting up client nodes... 2024-02-21T22:59:45.756 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-02-21T22:59:45.887 INFO:teuthology.orchestra.run.smithi099.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-02-21T22:59:45.951 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-02-21T22:59:45.951 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi099.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.9': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi162.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.10': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi181.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.11': '/dev/vg_nvme/lv_4'}} 2024-02-21T22:59:45.951 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-02-21T22:59:46.044 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.9': '/dev/vg_nvme/lv_4'} 2024-02-21T22:59:46.044 INFO:tasks.ceph:role: osd.0 2024-02-21T22:59:46.044 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi099.front.sepia.ceph.com 2024-02-21T22:59:46.045 DEBUG:teuthology.orchestra.run.smithi099:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-02-21T22:59:46.144 INFO:teuthology.orchestra.run.smithi099.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-02-21T22:59:46.144 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-21T22:59:46.144 INFO:teuthology.orchestra.run.smithi099.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-21T22:59:46.144 INFO:teuthology.orchestra.run.smithi099.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-21T22:59:46.144 INFO:teuthology.orchestra.run.smithi099.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-21T22:59:46.144 INFO:teuthology.orchestra.run.smithi099.stdout: = sunit=0 swidth=0 blks 2024-02-21T22:59:46.144 INFO:teuthology.orchestra.run.smithi099.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-21T22:59:46.144 INFO:teuthology.orchestra.run.smithi099.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-21T22:59:46.144 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-21T22:59:46.144 INFO:teuthology.orchestra.run.smithi099.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-21T22:59:46.652 INFO:teuthology.orchestra.run.smithi099.stdout:Discarding blocks...Done. 2024-02-21T22:59:46.658 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi099.front.sepia.ceph.com -o noatime 2024-02-21T22:59:46.659 DEBUG:teuthology.orchestra.run.smithi099:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-02-21T22:59:46.837 DEBUG:teuthology.orchestra.run.smithi099:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-02-21T22:59:46.960 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-02-21T22:59:47.039 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.9': '/dev/vg_nvme/lv_4'} 2024-02-21T22:59:47.039 INFO:tasks.ceph:role: osd.3 2024-02-21T22:59:47.039 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi099.front.sepia.ceph.com 2024-02-21T22:59:47.039 DEBUG:teuthology.orchestra.run.smithi099:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-02-21T22:59:47.128 INFO:teuthology.orchestra.run.smithi099.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-02-21T22:59:47.128 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-21T22:59:47.129 INFO:teuthology.orchestra.run.smithi099.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-21T22:59:47.129 INFO:teuthology.orchestra.run.smithi099.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-21T22:59:47.129 INFO:teuthology.orchestra.run.smithi099.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-21T22:59:47.129 INFO:teuthology.orchestra.run.smithi099.stdout: = sunit=0 swidth=0 blks 2024-02-21T22:59:47.129 INFO:teuthology.orchestra.run.smithi099.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-21T22:59:47.129 INFO:teuthology.orchestra.run.smithi099.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-21T22:59:47.129 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-21T22:59:47.129 INFO:teuthology.orchestra.run.smithi099.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-21T22:59:47.605 INFO:teuthology.orchestra.run.smithi099.stdout:Discarding blocks...Done. 2024-02-21T22:59:47.611 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi099.front.sepia.ceph.com -o noatime 2024-02-21T22:59:47.611 DEBUG:teuthology.orchestra.run.smithi099:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-3 2024-02-21T22:59:47.738 DEBUG:teuthology.orchestra.run.smithi099:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-02-21T22:59:47.819 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-02-21T22:59:47.892 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.9': '/dev/vg_nvme/lv_4'} 2024-02-21T22:59:47.893 INFO:tasks.ceph:role: osd.6 2024-02-21T22:59:47.893 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi099.front.sepia.ceph.com 2024-02-21T22:59:47.893 DEBUG:teuthology.orchestra.run.smithi099:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-02-21T22:59:47.976 INFO:teuthology.orchestra.run.smithi099.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-02-21T22:59:47.976 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-21T22:59:47.976 INFO:teuthology.orchestra.run.smithi099.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-21T22:59:47.976 INFO:teuthology.orchestra.run.smithi099.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-21T22:59:47.976 INFO:teuthology.orchestra.run.smithi099.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-21T22:59:47.976 INFO:teuthology.orchestra.run.smithi099.stdout: = sunit=0 swidth=0 blks 2024-02-21T22:59:47.976 INFO:teuthology.orchestra.run.smithi099.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-21T22:59:47.976 INFO:teuthology.orchestra.run.smithi099.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-21T22:59:47.976 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-21T22:59:47.977 INFO:teuthology.orchestra.run.smithi099.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-21T22:59:48.507 INFO:teuthology.orchestra.run.smithi099.stdout:Discarding blocks...Done. 2024-02-21T22:59:48.515 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi099.front.sepia.ceph.com -o noatime 2024-02-21T22:59:48.515 DEBUG:teuthology.orchestra.run.smithi099:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-02-21T22:59:48.660 DEBUG:teuthology.orchestra.run.smithi099:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-02-21T22:59:48.753 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/osd/ceph-9 2024-02-21T22:59:48.841 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.9': '/dev/vg_nvme/lv_4'} 2024-02-21T22:59:48.841 INFO:tasks.ceph:role: osd.9 2024-02-21T22:59:48.841 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi099.front.sepia.ceph.com 2024-02-21T22:59:48.841 DEBUG:teuthology.orchestra.run.smithi099:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-02-21T22:59:48.938 INFO:teuthology.orchestra.run.smithi099.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-02-21T22:59:48.938 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-21T22:59:48.938 INFO:teuthology.orchestra.run.smithi099.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-21T22:59:48.938 INFO:teuthology.orchestra.run.smithi099.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-21T22:59:48.938 INFO:teuthology.orchestra.run.smithi099.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-21T22:59:48.938 INFO:teuthology.orchestra.run.smithi099.stdout: = sunit=0 swidth=0 blks 2024-02-21T22:59:48.938 INFO:teuthology.orchestra.run.smithi099.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-21T22:59:48.938 INFO:teuthology.orchestra.run.smithi099.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-21T22:59:48.938 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-21T22:59:48.939 INFO:teuthology.orchestra.run.smithi099.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-21T22:59:49.398 INFO:teuthology.orchestra.run.smithi099.stdout:Discarding blocks...Done. 2024-02-21T22:59:49.403 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi099.front.sepia.ceph.com -o noatime 2024-02-21T22:59:49.403 DEBUG:teuthology.orchestra.run.smithi099:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-9 2024-02-21T22:59:49.514 DEBUG:teuthology.orchestra.run.smithi099:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-9 2024-02-21T22:59:49.601 DEBUG:teuthology.orchestra.run.smithi099:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-21T22:59:49.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T22:59:49.752+0000 7f014500c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-02-21T22:59:49.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T22:59:49.753+0000 7f014500c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-02-21T22:59:49.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T22:59:49.753+0000 7f014500c640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-02-21T22:59:49.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T22:59:49.753+0000 7f014500c640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-02-21T22:59:49.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T22:59:49.753+0000 7f014500c640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-02-21T22:59:49.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T22:59:49.756+0000 7f014500c640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-02-21T22:59:52.954 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-02-21T22:59:53.050 DEBUG:teuthology.orchestra.run.smithi099:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-21T22:59:53.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T22:59:53.197+0000 7f3ceda11640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-02-21T22:59:53.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T22:59:53.198+0000 7f3ceda11640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-02-21T22:59:53.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T22:59:53.198+0000 7f3ceda11640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-02-21T22:59:53.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T22:59:53.198+0000 7f3ceda11640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-02-21T22:59:53.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T22:59:53.198+0000 7f3ceda11640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-02-21T22:59:53.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T22:59:53.200+0000 7f3ceda11640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-02-21T22:59:56.119 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-02-21T22:59:56.218 DEBUG:teuthology.orchestra.run.smithi099:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-21T22:59:56.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T22:59:56.366+0000 7f563208b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-02-21T22:59:56.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T22:59:56.366+0000 7f563208b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-02-21T22:59:56.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T22:59:56.366+0000 7f563208b640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-02-21T22:59:56.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T22:59:56.366+0000 7f563208b640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-02-21T22:59:56.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T22:59:56.367+0000 7f563208b640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-02-21T22:59:56.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T22:59:56.369+0000 7f563208b640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-02-21T22:59:59.283 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-02-21T22:59:59.377 DEBUG:teuthology.orchestra.run.smithi099:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 9 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-21T22:59:59.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T22:59:59.524+0000 7fd59aeb5640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-9/keyring: can't open /var/lib/ceph/osd/ceph-9/keyring: (2) No such file or directory 2024-02-21T22:59:59.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T22:59:59.525+0000 7fd59aeb5640 -1 created new key in keyring /var/lib/ceph/osd/ceph-9/keyring 2024-02-21T22:59:59.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T22:59:59.525+0000 7fd59aeb5640 -1 bluestore(/var/lib/ceph/osd/ceph-9/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-9/block: (2) No such file or directory 2024-02-21T22:59:59.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T22:59:59.525+0000 7fd59aeb5640 -1 bluestore(/var/lib/ceph/osd/ceph-9/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-9/block: (2) No such file or directory 2024-02-21T22:59:59.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T22:59:59.525+0000 7fd59aeb5640 -1 bluestore(/var/lib/ceph/osd/ceph-9/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-9/block: (2) No such file or directory 2024-02-21T22:59:59.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T22:59:59.527+0000 7fd59aeb5640 -1 bluestore(/var/lib/ceph/osd/ceph-9) _read_fsid unparsable uuid 2024-02-21T23:00:02.428 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-9 2024-02-21T23:00:02.527 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-02-21T23:00:02.559 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.10': '/dev/vg_nvme/lv_4'} 2024-02-21T23:00:02.559 INFO:tasks.ceph:role: osd.1 2024-02-21T23:00:02.559 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi162.front.sepia.ceph.com 2024-02-21T23:00:02.560 DEBUG:teuthology.orchestra.run.smithi162:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-02-21T23:00:02.637 INFO:teuthology.orchestra.run.smithi162.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-02-21T23:00:02.637 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-21T23:00:02.637 INFO:teuthology.orchestra.run.smithi162.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-21T23:00:02.637 INFO:teuthology.orchestra.run.smithi162.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-21T23:00:02.637 INFO:teuthology.orchestra.run.smithi162.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-21T23:00:02.637 INFO:teuthology.orchestra.run.smithi162.stdout: = sunit=0 swidth=0 blks 2024-02-21T23:00:02.637 INFO:teuthology.orchestra.run.smithi162.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-21T23:00:02.637 INFO:teuthology.orchestra.run.smithi162.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-21T23:00:02.637 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-21T23:00:02.637 INFO:teuthology.orchestra.run.smithi162.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-21T23:00:03.153 INFO:teuthology.orchestra.run.smithi162.stdout:Discarding blocks...Done. 2024-02-21T23:00:03.155 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi162.front.sepia.ceph.com -o noatime 2024-02-21T23:00:03.155 DEBUG:teuthology.orchestra.run.smithi162:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-02-21T23:00:03.296 DEBUG:teuthology.orchestra.run.smithi162:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-02-21T23:00:03.332 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-02-21T23:00:03.402 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.10': '/dev/vg_nvme/lv_4'} 2024-02-21T23:00:03.402 INFO:tasks.ceph:role: osd.4 2024-02-21T23:00:03.402 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi162.front.sepia.ceph.com 2024-02-21T23:00:03.402 DEBUG:teuthology.orchestra.run.smithi162:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-02-21T23:00:03.479 INFO:teuthology.orchestra.run.smithi162.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-02-21T23:00:03.479 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-21T23:00:03.479 INFO:teuthology.orchestra.run.smithi162.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-21T23:00:03.479 INFO:teuthology.orchestra.run.smithi162.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-21T23:00:03.479 INFO:teuthology.orchestra.run.smithi162.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-21T23:00:03.479 INFO:teuthology.orchestra.run.smithi162.stdout: = sunit=0 swidth=0 blks 2024-02-21T23:00:03.479 INFO:teuthology.orchestra.run.smithi162.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-21T23:00:03.479 INFO:teuthology.orchestra.run.smithi162.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-21T23:00:03.479 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-21T23:00:03.479 INFO:teuthology.orchestra.run.smithi162.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-21T23:00:03.925 INFO:teuthology.orchestra.run.smithi162.stdout:Discarding blocks...Done. 2024-02-21T23:00:03.927 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi162.front.sepia.ceph.com -o noatime 2024-02-21T23:00:03.927 DEBUG:teuthology.orchestra.run.smithi162:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-4 2024-02-21T23:00:04.029 DEBUG:teuthology.orchestra.run.smithi162:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-02-21T23:00:04.062 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-02-21T23:00:04.131 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.10': '/dev/vg_nvme/lv_4'} 2024-02-21T23:00:04.131 INFO:tasks.ceph:role: osd.7 2024-02-21T23:00:04.131 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi162.front.sepia.ceph.com 2024-02-21T23:00:04.131 DEBUG:teuthology.orchestra.run.smithi162:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-02-21T23:00:04.207 INFO:teuthology.orchestra.run.smithi162.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-02-21T23:00:04.207 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-21T23:00:04.207 INFO:teuthology.orchestra.run.smithi162.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-21T23:00:04.207 INFO:teuthology.orchestra.run.smithi162.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-21T23:00:04.207 INFO:teuthology.orchestra.run.smithi162.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-21T23:00:04.207 INFO:teuthology.orchestra.run.smithi162.stdout: = sunit=0 swidth=0 blks 2024-02-21T23:00:04.207 INFO:teuthology.orchestra.run.smithi162.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-21T23:00:04.207 INFO:teuthology.orchestra.run.smithi162.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-21T23:00:04.208 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-21T23:00:04.208 INFO:teuthology.orchestra.run.smithi162.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-21T23:00:04.694 INFO:teuthology.orchestra.run.smithi162.stdout:Discarding blocks...Done. 2024-02-21T23:00:04.696 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi162.front.sepia.ceph.com -o noatime 2024-02-21T23:00:04.696 DEBUG:teuthology.orchestra.run.smithi162:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-7 2024-02-21T23:00:04.829 DEBUG:teuthology.orchestra.run.smithi162:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-02-21T23:00:04.863 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/osd/ceph-10 2024-02-21T23:00:04.932 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.10': '/dev/vg_nvme/lv_4'} 2024-02-21T23:00:04.932 INFO:tasks.ceph:role: osd.10 2024-02-21T23:00:04.932 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi162.front.sepia.ceph.com 2024-02-21T23:00:04.932 DEBUG:teuthology.orchestra.run.smithi162:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-02-21T23:00:05.009 INFO:teuthology.orchestra.run.smithi162.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-02-21T23:00:05.010 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-21T23:00:05.010 INFO:teuthology.orchestra.run.smithi162.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-21T23:00:05.010 INFO:teuthology.orchestra.run.smithi162.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-21T23:00:05.010 INFO:teuthology.orchestra.run.smithi162.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-21T23:00:05.010 INFO:teuthology.orchestra.run.smithi162.stdout: = sunit=0 swidth=0 blks 2024-02-21T23:00:05.010 INFO:teuthology.orchestra.run.smithi162.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-21T23:00:05.010 INFO:teuthology.orchestra.run.smithi162.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-21T23:00:05.010 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-21T23:00:05.010 INFO:teuthology.orchestra.run.smithi162.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-21T23:00:05.514 INFO:teuthology.orchestra.run.smithi162.stdout:Discarding blocks...Done. 2024-02-21T23:00:05.516 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi162.front.sepia.ceph.com -o noatime 2024-02-21T23:00:05.516 DEBUG:teuthology.orchestra.run.smithi162:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-10 2024-02-21T23:00:05.637 DEBUG:teuthology.orchestra.run.smithi162:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-10 2024-02-21T23:00:05.675 DEBUG:teuthology.orchestra.run.smithi162:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-21T23:00:05.768 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-21T23:00:05.779+0000 7fbe95e11640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-02-21T23:00:05.769 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-21T23:00:05.779+0000 7fbe95e11640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-02-21T23:00:05.769 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-21T23:00:05.779+0000 7fbe95e11640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-02-21T23:00:05.769 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-21T23:00:05.779+0000 7fbe95e11640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-02-21T23:00:05.769 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-21T23:00:05.779+0000 7fbe95e11640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-02-21T23:00:05.769 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-21T23:00:05.780+0000 7fbe95e11640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-02-21T23:00:08.625 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-02-21T23:00:08.656 DEBUG:teuthology.orchestra.run.smithi162:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-21T23:00:08.747 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-21T23:00:08.757+0000 7fc2fb424640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-02-21T23:00:08.747 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-21T23:00:08.757+0000 7fc2fb424640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-02-21T23:00:08.747 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-21T23:00:08.757+0000 7fc2fb424640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-02-21T23:00:08.747 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-21T23:00:08.757+0000 7fc2fb424640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-02-21T23:00:08.747 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-21T23:00:08.757+0000 7fc2fb424640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-02-21T23:00:08.748 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-21T23:00:08.758+0000 7fc2fb424640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-02-21T23:00:09.337 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:00:09.345 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:00:09.348 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:00:11.592 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-02-21T23:00:11.622 DEBUG:teuthology.orchestra.run.smithi162:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-21T23:00:11.713 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-21T23:00:11.724+0000 7f370fe10640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-02-21T23:00:11.714 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-21T23:00:11.725+0000 7f370fe10640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-02-21T23:00:11.714 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-21T23:00:11.725+0000 7f370fe10640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-02-21T23:00:11.714 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-21T23:00:11.725+0000 7f370fe10640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-02-21T23:00:11.714 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-21T23:00:11.725+0000 7f370fe10640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-02-21T23:00:11.714 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-21T23:00:11.725+0000 7f370fe10640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-02-21T23:00:14.567 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-02-21T23:00:14.598 DEBUG:teuthology.orchestra.run.smithi162:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 10 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-21T23:00:14.690 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-21T23:00:14.702+0000 7f6953f49640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-10/keyring: can't open /var/lib/ceph/osd/ceph-10/keyring: (2) No such file or directory 2024-02-21T23:00:14.691 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-21T23:00:14.702+0000 7f6953f49640 -1 created new key in keyring /var/lib/ceph/osd/ceph-10/keyring 2024-02-21T23:00:14.691 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-21T23:00:14.702+0000 7f6953f49640 -1 bluestore(/var/lib/ceph/osd/ceph-10/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-10/block: (2) No such file or directory 2024-02-21T23:00:14.691 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-21T23:00:14.702+0000 7f6953f49640 -1 bluestore(/var/lib/ceph/osd/ceph-10/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-10/block: (2) No such file or directory 2024-02-21T23:00:14.691 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-21T23:00:14.702+0000 7f6953f49640 -1 bluestore(/var/lib/ceph/osd/ceph-10/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-10/block: (2) No such file or directory 2024-02-21T23:00:14.691 INFO:teuthology.orchestra.run.smithi162.stderr:2024-02-21T23:00:14.703+0000 7f6953f49640 -1 bluestore(/var/lib/ceph/osd/ceph-10) _read_fsid unparsable uuid 2024-02-21T23:00:17.550 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-10 2024-02-21T23:00:17.581 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-02-21T23:00:17.615 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.11': '/dev/vg_nvme/lv_4'} 2024-02-21T23:00:17.615 INFO:tasks.ceph:role: osd.2 2024-02-21T23:00:17.615 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi181.front.sepia.ceph.com 2024-02-21T23:00:17.615 DEBUG:teuthology.orchestra.run.smithi181:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-02-21T23:00:17.693 INFO:teuthology.orchestra.run.smithi181.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-02-21T23:00:17.693 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-21T23:00:17.693 INFO:teuthology.orchestra.run.smithi181.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-21T23:00:17.693 INFO:teuthology.orchestra.run.smithi181.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-21T23:00:17.693 INFO:teuthology.orchestra.run.smithi181.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-21T23:00:17.693 INFO:teuthology.orchestra.run.smithi181.stdout: = sunit=0 swidth=0 blks 2024-02-21T23:00:17.693 INFO:teuthology.orchestra.run.smithi181.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-21T23:00:17.693 INFO:teuthology.orchestra.run.smithi181.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-21T23:00:17.693 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-21T23:00:17.693 INFO:teuthology.orchestra.run.smithi181.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-21T23:00:18.202 INFO:teuthology.orchestra.run.smithi181.stdout:Discarding blocks...Done. 2024-02-21T23:00:18.205 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi181.front.sepia.ceph.com -o noatime 2024-02-21T23:00:18.205 DEBUG:teuthology.orchestra.run.smithi181:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2024-02-21T23:00:18.353 DEBUG:teuthology.orchestra.run.smithi181:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-02-21T23:00:18.392 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-02-21T23:00:18.461 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.11': '/dev/vg_nvme/lv_4'} 2024-02-21T23:00:18.462 INFO:tasks.ceph:role: osd.5 2024-02-21T23:00:18.462 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi181.front.sepia.ceph.com 2024-02-21T23:00:18.462 DEBUG:teuthology.orchestra.run.smithi181:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-02-21T23:00:18.538 INFO:teuthology.orchestra.run.smithi181.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-02-21T23:00:18.538 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-21T23:00:18.539 INFO:teuthology.orchestra.run.smithi181.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-21T23:00:18.539 INFO:teuthology.orchestra.run.smithi181.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-21T23:00:18.539 INFO:teuthology.orchestra.run.smithi181.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-21T23:00:18.539 INFO:teuthology.orchestra.run.smithi181.stdout: = sunit=0 swidth=0 blks 2024-02-21T23:00:18.539 INFO:teuthology.orchestra.run.smithi181.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-21T23:00:18.539 INFO:teuthology.orchestra.run.smithi181.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-21T23:00:18.539 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-21T23:00:18.539 INFO:teuthology.orchestra.run.smithi181.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-21T23:00:18.990 INFO:teuthology.orchestra.run.smithi181.stdout:Discarding blocks...Done. 2024-02-21T23:00:18.992 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi181.front.sepia.ceph.com -o noatime 2024-02-21T23:00:18.992 DEBUG:teuthology.orchestra.run.smithi181:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-02-21T23:00:19.094 DEBUG:teuthology.orchestra.run.smithi181:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-02-21T23:00:19.128 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/osd/ceph-8 2024-02-21T23:00:19.197 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.11': '/dev/vg_nvme/lv_4'} 2024-02-21T23:00:19.197 INFO:tasks.ceph:role: osd.8 2024-02-21T23:00:19.198 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi181.front.sepia.ceph.com 2024-02-21T23:00:19.198 DEBUG:teuthology.orchestra.run.smithi181:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-02-21T23:00:19.273 INFO:teuthology.orchestra.run.smithi181.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-02-21T23:00:19.273 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-21T23:00:19.273 INFO:teuthology.orchestra.run.smithi181.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-21T23:00:19.273 INFO:teuthology.orchestra.run.smithi181.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-21T23:00:19.273 INFO:teuthology.orchestra.run.smithi181.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-21T23:00:19.273 INFO:teuthology.orchestra.run.smithi181.stdout: = sunit=0 swidth=0 blks 2024-02-21T23:00:19.274 INFO:teuthology.orchestra.run.smithi181.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-21T23:00:19.274 INFO:teuthology.orchestra.run.smithi181.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-21T23:00:19.274 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-21T23:00:19.274 INFO:teuthology.orchestra.run.smithi181.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-21T23:00:19.768 INFO:teuthology.orchestra.run.smithi181.stdout:Discarding blocks...Done. 2024-02-21T23:00:19.771 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi181.front.sepia.ceph.com -o noatime 2024-02-21T23:00:19.771 DEBUG:teuthology.orchestra.run.smithi181:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-8 2024-02-21T23:00:19.928 DEBUG:teuthology.orchestra.run.smithi181:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-8 2024-02-21T23:00:19.964 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/osd/ceph-11 2024-02-21T23:00:20.036 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.11': '/dev/vg_nvme/lv_4'} 2024-02-21T23:00:20.036 INFO:tasks.ceph:role: osd.11 2024-02-21T23:00:20.036 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi181.front.sepia.ceph.com 2024-02-21T23:00:20.036 DEBUG:teuthology.orchestra.run.smithi181:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-02-21T23:00:20.112 INFO:teuthology.orchestra.run.smithi181.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-02-21T23:00:20.112 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 attr=2, projid32bit=1 2024-02-21T23:00:20.112 INFO:teuthology.orchestra.run.smithi181.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-02-21T23:00:20.112 INFO:teuthology.orchestra.run.smithi181.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-02-21T23:00:20.112 INFO:teuthology.orchestra.run.smithi181.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-02-21T23:00:20.112 INFO:teuthology.orchestra.run.smithi181.stdout: = sunit=0 swidth=0 blks 2024-02-21T23:00:20.112 INFO:teuthology.orchestra.run.smithi181.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-02-21T23:00:20.112 INFO:teuthology.orchestra.run.smithi181.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-02-21T23:00:20.112 INFO:teuthology.orchestra.run.smithi181.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-02-21T23:00:20.112 INFO:teuthology.orchestra.run.smithi181.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-02-21T23:00:20.624 INFO:teuthology.orchestra.run.smithi181.stdout:Discarding blocks...Done. 2024-02-21T23:00:20.626 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi181.front.sepia.ceph.com -o noatime 2024-02-21T23:00:20.626 DEBUG:teuthology.orchestra.run.smithi181:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-11 2024-02-21T23:00:20.747 DEBUG:teuthology.orchestra.run.smithi181:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-11 2024-02-21T23:00:20.779 DEBUG:teuthology.orchestra.run.smithi181:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-21T23:00:20.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:20.880+0000 7febb2411640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-02-21T23:00:20.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:20.880+0000 7febb2411640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-02-21T23:00:20.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:20.880+0000 7febb2411640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-02-21T23:00:20.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:20.880+0000 7febb2411640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-02-21T23:00:20.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:20.880+0000 7febb2411640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-02-21T23:00:20.870 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:20.881+0000 7febb2411640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-02-21T23:00:23.726 DEBUG:teuthology.orchestra.run.smithi181:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-02-21T23:00:23.757 DEBUG:teuthology.orchestra.run.smithi181:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-21T23:00:23.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:23.858+0000 7f00eea48640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-02-21T23:00:23.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:23.858+0000 7f00eea48640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-02-21T23:00:23.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:23.858+0000 7f00eea48640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-02-21T23:00:23.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:23.858+0000 7f00eea48640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-02-21T23:00:23.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:23.858+0000 7f00eea48640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-02-21T23:00:23.848 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:23.859+0000 7f00eea48640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-02-21T23:00:26.703 DEBUG:teuthology.orchestra.run.smithi181:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-02-21T23:00:26.733 DEBUG:teuthology.orchestra.run.smithi181:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 8 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-21T23:00:26.826 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:26.837+0000 7f7da12c1640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-8/keyring: can't open /var/lib/ceph/osd/ceph-8/keyring: (2) No such file or directory 2024-02-21T23:00:26.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:26.837+0000 7f7da12c1640 -1 created new key in keyring /var/lib/ceph/osd/ceph-8/keyring 2024-02-21T23:00:26.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:26.837+0000 7f7da12c1640 -1 bluestore(/var/lib/ceph/osd/ceph-8/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-8/block: (2) No such file or directory 2024-02-21T23:00:26.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:26.837+0000 7f7da12c1640 -1 bluestore(/var/lib/ceph/osd/ceph-8/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-8/block: (2) No such file or directory 2024-02-21T23:00:26.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:26.837+0000 7f7da12c1640 -1 bluestore(/var/lib/ceph/osd/ceph-8/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-8/block: (2) No such file or directory 2024-02-21T23:00:26.827 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:26.837+0000 7f7da12c1640 -1 bluestore(/var/lib/ceph/osd/ceph-8) _read_fsid unparsable uuid 2024-02-21T23:00:29.678 DEBUG:teuthology.orchestra.run.smithi181:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-8 2024-02-21T23:00:29.708 DEBUG:teuthology.orchestra.run.smithi181:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 11 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-02-21T23:00:29.798 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:29.809+0000 7fd68f415640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-11/keyring: can't open /var/lib/ceph/osd/ceph-11/keyring: (2) No such file or directory 2024-02-21T23:00:29.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:29.809+0000 7fd68f415640 -1 created new key in keyring /var/lib/ceph/osd/ceph-11/keyring 2024-02-21T23:00:29.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:29.809+0000 7fd68f415640 -1 bluestore(/var/lib/ceph/osd/ceph-11/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-11/block: (2) No such file or directory 2024-02-21T23:00:29.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:29.809+0000 7fd68f415640 -1 bluestore(/var/lib/ceph/osd/ceph-11/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-11/block: (2) No such file or directory 2024-02-21T23:00:29.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:29.809+0000 7fd68f415640 -1 bluestore(/var/lib/ceph/osd/ceph-11/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-11/block: (2) No such file or directory 2024-02-21T23:00:29.799 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:29.810+0000 7fd68f415640 -1 bluestore(/var/lib/ceph/osd/ceph-11) _read_fsid unparsable uuid 2024-02-21T23:00:32.656 DEBUG:teuthology.orchestra.run.smithi181:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-11 2024-02-21T23:00:32.684 INFO:tasks.ceph:Reading keys from all nodes... 2024-02-21T23:00:32.685 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-02-21T23:00:32.685 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-02-21T23:00:32.782 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-02-21T23:00:32.782 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-02-21T23:00:32.875 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-02-21T23:00:32.875 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-02-21T23:00:32.965 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-02-21T23:00:32.966 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/mds/ceph-g/keyring of=/dev/stdout 2024-02-21T23:00:33.051 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-02-21T23:00:33.051 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/mds/ceph-j/keyring of=/dev/stdout 2024-02-21T23:00:33.143 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-02-21T23:00:33.143 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-02-21T23:00:33.277 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-02-21T23:00:33.277 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-02-21T23:00:33.370 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-02-21T23:00:33.370 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-02-21T23:00:33.460 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-02-21T23:00:33.460 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-9/keyring of=/dev/stdout 2024-02-21T23:00:33.546 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-02-21T23:00:33.547 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-02-21T23:00:33.579 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-02-21T23:00:33.579 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-02-21T23:00:33.649 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-02-21T23:00:33.650 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2024-02-21T23:00:33.718 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-02-21T23:00:33.718 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/mds/ceph-h/keyring of=/dev/stdout 2024-02-21T23:00:33.787 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-02-21T23:00:33.787 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/mds/ceph-k/keyring of=/dev/stdout 2024-02-21T23:00:33.855 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-02-21T23:00:33.855 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-02-21T23:00:33.923 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-02-21T23:00:33.923 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-02-21T23:00:33.991 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-02-21T23:00:33.991 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-02-21T23:00:34.058 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-02-21T23:00:34.058 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-10/keyring of=/dev/stdout 2024-02-21T23:00:34.125 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-02-21T23:00:34.125 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/mgr/ceph-z/keyring of=/dev/stdout 2024-02-21T23:00:34.156 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-02-21T23:00:34.156 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-02-21T23:00:34.226 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-02-21T23:00:34.226 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2024-02-21T23:00:34.295 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-02-21T23:00:34.295 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/mds/ceph-i/keyring of=/dev/stdout 2024-02-21T23:00:34.363 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-02-21T23:00:34.363 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/mds/ceph-l/keyring of=/dev/stdout 2024-02-21T23:00:34.432 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-02-21T23:00:34.432 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-02-21T23:00:34.499 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-02-21T23:00:34.499 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-02-21T23:00:34.567 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-02-21T23:00:34.567 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-8/keyring of=/dev/stdout 2024-02-21T23:00:34.634 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-02-21T23:00:34.634 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-11/keyring of=/dev/stdout 2024-02-21T23:00:34.701 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-02-21T23:00:34.701 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-02-21T23:00:34.757 INFO:tasks.ceph:Adding keys to all mons... 2024-02-21T23:00:34.757 DEBUG:teuthology.orchestra.run.smithi099:> sudo tee -a /etc/ceph/ceph.keyring 2024-02-21T23:00:34.761 DEBUG:teuthology.orchestra.run.smithi162:> sudo tee -a /etc/ceph/ceph.keyring 2024-02-21T23:00:34.764 DEBUG:teuthology.orchestra.run.smithi181:> sudo tee -a /etc/ceph/ceph.keyring 2024-02-21T23:00:34.789 INFO:teuthology.orchestra.run.smithi162.stdout:[mgr.x] 2024-02-21T23:00:34.789 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBfgNZlr3jIIxAAytEN/Qdgg6K1XwH+XMhJUg== 2024-02-21T23:00:34.789 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.a] 2024-02-21T23:00:34.789 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBfgNZlUpXqNxAAKqxp0YkP2MHmdgMwzVFMGA== 2024-02-21T23:00:34.789 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.d] 2024-02-21T23:00:34.789 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBggNZln5+rDBAA0CiaJl7apqSoYTygOEpLjw== 2024-02-21T23:00:34.789 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.g] 2024-02-21T23:00:34.789 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBggNZlQ8cZHBAAYDyPVlYCVWZGN9KkIsQ4PQ== 2024-02-21T23:00:34.789 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.j] 2024-02-21T23:00:34.789 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBggNZlkQ9JLBAA9jQzZo2iQQdIX7sL9oSYIQ== 2024-02-21T23:00:34.790 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.0] 2024-02-21T23:00:34.790 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBlgNZljW/mLBAAmiHEYDEBPq5yWYJHIVLFHg== 2024-02-21T23:00:34.790 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.3] 2024-02-21T23:00:34.790 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBpgNZlp0/WCxAALWcaaryNk78qZ6SXzPTGtA== 2024-02-21T23:00:34.790 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.6] 2024-02-21T23:00:34.790 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBsgNZleUfhFRAASphHuzjt+36txgCgHyn9Iw== 2024-02-21T23:00:34.790 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.9] 2024-02-21T23:00:34.790 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBvgNZlFV1RHxAAJg4PA4X1WoAEz6Z8fJMjbA== 2024-02-21T23:00:34.790 INFO:teuthology.orchestra.run.smithi162.stdout:[mgr.y] 2024-02-21T23:00:34.790 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBfgNZlOrdzKBAA6yQNKGWocRQVplcVCY/3+Q== 2024-02-21T23:00:34.790 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.b] 2024-02-21T23:00:34.790 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBggNZlSZKdNRAAYyC8EJchIWb0SfM2ux3WAA== 2024-02-21T23:00:34.790 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.e] 2024-02-21T23:00:34.791 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBhgNZlcSanARAA4AwUl6uXq+sfFBrx5tntQA== 2024-02-21T23:00:34.791 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.h] 2024-02-21T23:00:34.791 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBhgNZlr7UKCRAAR2l07nENSAK4uWcIOQxIxQ== 2024-02-21T23:00:34.791 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.k] 2024-02-21T23:00:34.791 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBhgNZlIlNWEBAAg3J0fSOdasYFQqaOTpbBtQ== 2024-02-21T23:00:34.791 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.1] 2024-02-21T23:00:34.791 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQB1gNZlCBqDLhAA+kikoQsjOu6M//Z2ZGm7FA== 2024-02-21T23:00:34.791 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.4] 2024-02-21T23:00:34.791 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQB4gNZll+A5LRAAgXVROuin6sasaO7gd5vCMA== 2024-02-21T23:00:34.791 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.7] 2024-02-21T23:00:34.791 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQB7gNZl0AM0KxAAuFH+BECPdGHkAmjhFmMrIg== 2024-02-21T23:00:34.791 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.10] 2024-02-21T23:00:34.791 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQB+gNZlV0fcKRAAJeJNuOnk0vgiAKN819cdbg== 2024-02-21T23:00:34.792 INFO:teuthology.orchestra.run.smithi162.stdout:[mgr.z] 2024-02-21T23:00:34.792 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBfgNZlqCXbLBAAdWZfCugu9sHwb9ZcjAKFEA== 2024-02-21T23:00:34.792 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.c] 2024-02-21T23:00:34.792 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBhgNZllw3NFRAAbDrqVYQ5CypMWRvhHC/nkA== 2024-02-21T23:00:34.792 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.f] 2024-02-21T23:00:34.792 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBhgNZlq7pkHRAA0wGtzfXGL6vXcD9FKt1tDw== 2024-02-21T23:00:34.792 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.i] 2024-02-21T23:00:34.792 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBhgNZlLpTCJBAAH66iNLbwHAiacBIxzrRGLw== 2024-02-21T23:00:34.792 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.l] 2024-02-21T23:00:34.792 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBhgNZl4pkSLBAAbszaA87LJuGxvZzFcXx6CA== 2024-02-21T23:00:34.792 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.2] 2024-02-21T23:00:34.792 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQCEgNZlsY+GNBAAxKBK92NqPOH6n1lPWv3IiA== 2024-02-21T23:00:34.792 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.5] 2024-02-21T23:00:34.793 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQCHgNZl02s6MxAAhDMD4PeO7PYod1iCVURlfA== 2024-02-21T23:00:34.793 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.8] 2024-02-21T23:00:34.793 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQCKgNZldqP3MRAA4Y9VkQwK68KgM/R6A2rIvQ== 2024-02-21T23:00:34.793 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.11] 2024-02-21T23:00:34.793 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQCNgNZlK3tQMBAAwFf9l/oIcZqMwdzPTnpGtg== 2024-02-21T23:00:34.793 INFO:teuthology.orchestra.run.smithi162.stdout:[client.0] 2024-02-21T23:00:34.793 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBhgNZlGpuUNRAAiIiZ4p/NytGBNjHa6IGaLA== 2024-02-21T23:00:34.794 INFO:teuthology.orchestra.run.smithi181.stdout:[mgr.x] 2024-02-21T23:00:34.795 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQBfgNZlr3jIIxAAytEN/Qdgg6K1XwH+XMhJUg== 2024-02-21T23:00:34.795 INFO:teuthology.orchestra.run.smithi181.stdout:[mds.a] 2024-02-21T23:00:34.795 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQBfgNZlUpXqNxAAKqxp0YkP2MHmdgMwzVFMGA== 2024-02-21T23:00:34.795 INFO:teuthology.orchestra.run.smithi181.stdout:[mds.d] 2024-02-21T23:00:34.795 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQBggNZln5+rDBAA0CiaJl7apqSoYTygOEpLjw== 2024-02-21T23:00:34.795 INFO:teuthology.orchestra.run.smithi181.stdout:[mds.g] 2024-02-21T23:00:34.795 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQBggNZlQ8cZHBAAYDyPVlYCVWZGN9KkIsQ4PQ== 2024-02-21T23:00:34.795 INFO:teuthology.orchestra.run.smithi181.stdout:[mds.j] 2024-02-21T23:00:34.795 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQBggNZlkQ9JLBAA9jQzZo2iQQdIX7sL9oSYIQ== 2024-02-21T23:00:34.795 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.0] 2024-02-21T23:00:34.795 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQBlgNZljW/mLBAAmiHEYDEBPq5yWYJHIVLFHg== 2024-02-21T23:00:34.795 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.3] 2024-02-21T23:00:34.795 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQBpgNZlp0/WCxAALWcaaryNk78qZ6SXzPTGtA== 2024-02-21T23:00:34.796 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.6] 2024-02-21T23:00:34.796 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQBsgNZleUfhFRAASphHuzjt+36txgCgHyn9Iw== 2024-02-21T23:00:34.796 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.9] 2024-02-21T23:00:34.796 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQBvgNZlFV1RHxAAJg4PA4X1WoAEz6Z8fJMjbA== 2024-02-21T23:00:34.796 INFO:teuthology.orchestra.run.smithi181.stdout:[mgr.y] 2024-02-21T23:00:34.796 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQBfgNZlOrdzKBAA6yQNKGWocRQVplcVCY/3+Q== 2024-02-21T23:00:34.796 INFO:teuthology.orchestra.run.smithi181.stdout:[mds.b] 2024-02-21T23:00:34.796 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQBggNZlSZKdNRAAYyC8EJchIWb0SfM2ux3WAA== 2024-02-21T23:00:34.796 INFO:teuthology.orchestra.run.smithi181.stdout:[mds.e] 2024-02-21T23:00:34.796 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQBhgNZlcSanARAA4AwUl6uXq+sfFBrx5tntQA== 2024-02-21T23:00:34.796 INFO:teuthology.orchestra.run.smithi181.stdout:[mds.h] 2024-02-21T23:00:34.796 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQBhgNZlr7UKCRAAR2l07nENSAK4uWcIOQxIxQ== 2024-02-21T23:00:34.796 INFO:teuthology.orchestra.run.smithi181.stdout:[mds.k] 2024-02-21T23:00:34.796 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQBhgNZlIlNWEBAAg3J0fSOdasYFQqaOTpbBtQ== 2024-02-21T23:00:34.797 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.1] 2024-02-21T23:00:34.797 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQB1gNZlCBqDLhAA+kikoQsjOu6M//Z2ZGm7FA== 2024-02-21T23:00:34.797 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.4] 2024-02-21T23:00:34.797 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQB4gNZll+A5LRAAgXVROuin6sasaO7gd5vCMA== 2024-02-21T23:00:34.797 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.7] 2024-02-21T23:00:34.797 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQB7gNZl0AM0KxAAuFH+BECPdGHkAmjhFmMrIg== 2024-02-21T23:00:34.797 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.10] 2024-02-21T23:00:34.797 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQB+gNZlV0fcKRAAJeJNuOnk0vgiAKN819cdbg== 2024-02-21T23:00:34.797 INFO:teuthology.orchestra.run.smithi181.stdout:[mgr.z] 2024-02-21T23:00:34.797 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQBfgNZlqCXbLBAAdWZfCugu9sHwb9ZcjAKFEA== 2024-02-21T23:00:34.797 INFO:teuthology.orchestra.run.smithi181.stdout:[mds.c] 2024-02-21T23:00:34.797 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQBhgNZllw3NFRAAbDrqVYQ5CypMWRvhHC/nkA== 2024-02-21T23:00:34.797 INFO:teuthology.orchestra.run.smithi181.stdout:[mds.f] 2024-02-21T23:00:34.797 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQBhgNZlq7pkHRAA0wGtzfXGL6vXcD9FKt1tDw== 2024-02-21T23:00:34.798 INFO:teuthology.orchestra.run.smithi181.stdout:[mds.i] 2024-02-21T23:00:34.798 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQBhgNZlLpTCJBAAH66iNLbwHAiacBIxzrRGLw== 2024-02-21T23:00:34.798 INFO:teuthology.orchestra.run.smithi181.stdout:[mds.l] 2024-02-21T23:00:34.798 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQBhgNZl4pkSLBAAbszaA87LJuGxvZzFcXx6CA== 2024-02-21T23:00:34.798 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.2] 2024-02-21T23:00:34.798 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQCEgNZlsY+GNBAAxKBK92NqPOH6n1lPWv3IiA== 2024-02-21T23:00:34.798 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.5] 2024-02-21T23:00:34.798 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQCHgNZl02s6MxAAhDMD4PeO7PYod1iCVURlfA== 2024-02-21T23:00:34.798 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.8] 2024-02-21T23:00:34.798 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQCKgNZldqP3MRAA4Y9VkQwK68KgM/R6A2rIvQ== 2024-02-21T23:00:34.798 INFO:teuthology.orchestra.run.smithi181.stdout:[osd.11] 2024-02-21T23:00:34.798 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQCNgNZlK3tQMBAAwFf9l/oIcZqMwdzPTnpGtg== 2024-02-21T23:00:34.798 INFO:teuthology.orchestra.run.smithi181.stdout:[client.0] 2024-02-21T23:00:34.798 INFO:teuthology.orchestra.run.smithi181.stdout: key = AQBhgNZlGpuUNRAAiIiZ4p/NytGBNjHa6IGaLA== 2024-02-21T23:00:34.845 INFO:teuthology.orchestra.run.smithi099.stdout:[mgr.x] 2024-02-21T23:00:34.845 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQBfgNZlr3jIIxAAytEN/Qdgg6K1XwH+XMhJUg== 2024-02-21T23:00:34.845 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.a] 2024-02-21T23:00:34.845 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQBfgNZlUpXqNxAAKqxp0YkP2MHmdgMwzVFMGA== 2024-02-21T23:00:34.845 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.d] 2024-02-21T23:00:34.845 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQBggNZln5+rDBAA0CiaJl7apqSoYTygOEpLjw== 2024-02-21T23:00:34.845 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.g] 2024-02-21T23:00:34.845 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQBggNZlQ8cZHBAAYDyPVlYCVWZGN9KkIsQ4PQ== 2024-02-21T23:00:34.846 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.j] 2024-02-21T23:00:34.846 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQBggNZlkQ9JLBAA9jQzZo2iQQdIX7sL9oSYIQ== 2024-02-21T23:00:34.846 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.0] 2024-02-21T23:00:34.846 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQBlgNZljW/mLBAAmiHEYDEBPq5yWYJHIVLFHg== 2024-02-21T23:00:34.846 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.3] 2024-02-21T23:00:34.846 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQBpgNZlp0/WCxAALWcaaryNk78qZ6SXzPTGtA== 2024-02-21T23:00:34.846 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.6] 2024-02-21T23:00:34.846 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQBsgNZleUfhFRAASphHuzjt+36txgCgHyn9Iw== 2024-02-21T23:00:34.846 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.9] 2024-02-21T23:00:34.846 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQBvgNZlFV1RHxAAJg4PA4X1WoAEz6Z8fJMjbA== 2024-02-21T23:00:34.846 INFO:teuthology.orchestra.run.smithi099.stdout:[mgr.y] 2024-02-21T23:00:34.846 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQBfgNZlOrdzKBAA6yQNKGWocRQVplcVCY/3+Q== 2024-02-21T23:00:34.846 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.b] 2024-02-21T23:00:34.846 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQBggNZlSZKdNRAAYyC8EJchIWb0SfM2ux3WAA== 2024-02-21T23:00:34.847 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.e] 2024-02-21T23:00:34.847 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQBhgNZlcSanARAA4AwUl6uXq+sfFBrx5tntQA== 2024-02-21T23:00:34.847 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.h] 2024-02-21T23:00:34.847 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQBhgNZlr7UKCRAAR2l07nENSAK4uWcIOQxIxQ== 2024-02-21T23:00:34.847 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.k] 2024-02-21T23:00:34.847 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQBhgNZlIlNWEBAAg3J0fSOdasYFQqaOTpbBtQ== 2024-02-21T23:00:34.847 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.1] 2024-02-21T23:00:34.847 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQB1gNZlCBqDLhAA+kikoQsjOu6M//Z2ZGm7FA== 2024-02-21T23:00:34.847 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.4] 2024-02-21T23:00:34.847 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQB4gNZll+A5LRAAgXVROuin6sasaO7gd5vCMA== 2024-02-21T23:00:34.847 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.7] 2024-02-21T23:00:34.847 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQB7gNZl0AM0KxAAuFH+BECPdGHkAmjhFmMrIg== 2024-02-21T23:00:34.847 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.10] 2024-02-21T23:00:34.847 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQB+gNZlV0fcKRAAJeJNuOnk0vgiAKN819cdbg== 2024-02-21T23:00:34.848 INFO:teuthology.orchestra.run.smithi099.stdout:[mgr.z] 2024-02-21T23:00:34.848 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQBfgNZlqCXbLBAAdWZfCugu9sHwb9ZcjAKFEA== 2024-02-21T23:00:34.848 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.c] 2024-02-21T23:00:34.848 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQBhgNZllw3NFRAAbDrqVYQ5CypMWRvhHC/nkA== 2024-02-21T23:00:34.848 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.f] 2024-02-21T23:00:34.848 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQBhgNZlq7pkHRAA0wGtzfXGL6vXcD9FKt1tDw== 2024-02-21T23:00:34.848 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.i] 2024-02-21T23:00:34.848 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQBhgNZlLpTCJBAAH66iNLbwHAiacBIxzrRGLw== 2024-02-21T23:00:34.848 INFO:teuthology.orchestra.run.smithi099.stdout:[mds.l] 2024-02-21T23:00:34.848 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQBhgNZl4pkSLBAAbszaA87LJuGxvZzFcXx6CA== 2024-02-21T23:00:34.848 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.2] 2024-02-21T23:00:34.848 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQCEgNZlsY+GNBAAxKBK92NqPOH6n1lPWv3IiA== 2024-02-21T23:00:34.849 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.5] 2024-02-21T23:00:34.849 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQCHgNZl02s6MxAAhDMD4PeO7PYod1iCVURlfA== 2024-02-21T23:00:34.849 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.8] 2024-02-21T23:00:34.849 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQCKgNZldqP3MRAA4Y9VkQwK68KgM/R6A2rIvQ== 2024-02-21T23:00:34.849 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.11] 2024-02-21T23:00:34.849 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQCNgNZlK3tQMBAAwFf9l/oIcZqMwdzPTnpGtg== 2024-02-21T23:00:34.849 INFO:teuthology.orchestra.run.smithi099.stdout:[client.0] 2024-02-21T23:00:34.849 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQBhgNZlGpuUNRAAiIiZ4p/NytGBNjHa6IGaLA== 2024-02-21T23:00:34.850 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-02-21T23:00:34.855 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-02-21T23:00:34.857 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-02-21T23:00:34.992 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T23:00:34.997 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T23:00:34.999 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T23:00:35.128 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T23:00:35.134 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T23:00:35.136 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T23:00:35.264 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.g --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T23:00:35.270 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.g --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T23:00:35.272 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.g --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T23:00:35.406 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.j --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T23:00:35.411 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.j --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T23:00:35.413 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.j --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T23:00:35.553 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T23:00:35.557 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T23:00:35.560 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T23:00:35.691 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T23:00:35.696 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T23:00:35.698 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T23:00:35.831 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T23:00:35.836 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T23:00:35.838 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T23:00:35.964 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T23:00:35.969 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T23:00:35.971 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T23:00:36.100 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-02-21T23:00:36.104 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-02-21T23:00:36.107 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-02-21T23:00:36.239 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T23:00:36.244 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T23:00:36.246 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T23:00:36.378 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T23:00:36.384 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T23:00:36.386 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T23:00:36.516 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.h --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T23:00:36.520 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.h --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T23:00:36.523 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.h --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T23:00:36.655 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.k --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T23:00:36.663 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.k --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T23:00:36.665 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.k --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T23:00:36.798 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T23:00:36.804 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T23:00:36.806 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T23:00:36.938 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T23:00:36.945 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T23:00:36.947 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T23:00:37.077 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T23:00:37.083 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T23:00:37.086 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T23:00:37.221 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T23:00:37.226 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T23:00:37.228 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T23:00:37.361 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.z --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-02-21T23:00:37.369 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.z --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-02-21T23:00:37.372 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.z --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-02-21T23:00:37.494 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T23:00:37.499 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T23:00:37.501 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T23:00:37.635 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T23:00:37.642 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T23:00:37.644 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T23:00:37.780 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.i --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T23:00:37.787 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.i --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T23:00:37.789 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.i --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T23:00:37.922 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.l --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T23:00:37.927 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.l --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T23:00:37.929 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.l --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-02-21T23:00:38.062 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T23:00:38.067 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T23:00:38.069 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T23:00:38.200 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T23:00:38.206 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T23:00:38.208 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T23:00:38.338 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T23:00:38.344 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T23:00:38.346 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T23:00:38.479 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T23:00:38.483 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T23:00:38.485 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-02-21T23:00:38.615 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-02-21T23:00:38.621 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-02-21T23:00:38.623 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-02-21T23:00:38.755 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-02-21T23:00:38.755 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-02-21T23:00:38.846 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-02-21T23:00:39.004 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-02-21T23:00:39.095 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-02-21T23:00:39.122 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-02-21T23:00:39.219 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-02-21T23:00:39.245 DEBUG:teuthology.orchestra.run.smithi181:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-02-21T23:00:39.274 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-02-21T23:00:39.372 DEBUG:teuthology.orchestra.run.smithi181:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-02-21T23:00:39.399 DEBUG:teuthology.orchestra.run.smithi099:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-02-21T23:00:39.407 DEBUG:teuthology.orchestra.run.smithi162:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-02-21T23:00:39.409 DEBUG:teuthology.orchestra.run.smithi181:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-02-21T23:00:39.455 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-02-21T23:00:39.455 INFO:tasks.ceph.mon.a:Restarting daemon 2024-02-21T23:00:39.455 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-02-21T23:00:39.460 INFO:tasks.ceph.mon.a:Started 2024-02-21T23:00:39.460 INFO:tasks.ceph.mon.b:Restarting daemon 2024-02-21T23:00:39.460 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-02-21T23:00:39.463 INFO:tasks.ceph.mon.b:Started 2024-02-21T23:00:39.464 INFO:tasks.ceph.mon.c:Restarting daemon 2024-02-21T23:00:39.464 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-02-21T23:00:39.496 INFO:tasks.ceph.mon.c:Started 2024-02-21T23:00:39.497 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-02-21T23:00:39.497 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-02-21T23:00:39.497 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-02-21T23:00:39.498 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:00:39.504 INFO:tasks.ceph.mgr.x:Started 2024-02-21T23:00:39.504 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-02-21T23:00:39.504 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-02-21T23:00:39.506 INFO:tasks.ceph.mgr.y:Started 2024-02-21T23:00:39.506 INFO:tasks.ceph.mgr.z:Restarting daemon 2024-02-21T23:00:39.507 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i z 2024-02-21T23:00:39.509 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:00:39.510 INFO:tasks.ceph.mgr.z:Started 2024-02-21T23:00:39.510 INFO:tasks.ceph:Setting crush tunables to default 2024-02-21T23:00:39.510 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph --cluster ceph osd crush tunables default 2024-02-21T23:00:39.511 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:00:39.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:39.741+0000 7fed14200640 1 Processor -- start 2024-02-21T23:00:39.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:39.741+0000 7fed14200640 1 -- start start 2024-02-21T23:00:39.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:39.743+0000 7fed14200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fed0c18a9b0 0x7fed0c18ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:39.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:39.743+0000 7fed14200640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fed0c18e510 0x7fed0c18af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:39.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:39.743+0000 7fed14200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed0c18ec00 con 0x7fed0c06ecb0 2024-02-21T23:00:39.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:39.743+0000 7fed14200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed0c18e9a0 con 0x7fed0c18a9b0 2024-02-21T23:00:39.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:39.743+0000 7fed14200640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed0c18eee0 con 0x7fed0c18e510 2024-02-21T23:00:39.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:39.743+0000 7fed10e00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fed0c18e510 0x7fed0c18af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:39.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:39.743+0000 7fed10e00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fed0c18e510 0x7fed0c18af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:40152/0 (socket says 172.21.15.99:40152) 2024-02-21T23:00:39.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:39.743+0000 7fed10e00640 1 -- 172.21.15.99:0/4042292771 learned_addr learned my addr 172.21.15.99:0/4042292771 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:00:39.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:39.743+0000 7fed11800640 1 --2- 172.21.15.99:0/4042292771 >> v2:172.21.15.99:3300/0 conn(0x7fed0c18a9b0 0x7fed0c18ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:39.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:39.743+0000 7fed10e00640 1 -- 172.21.15.99:0/4042292771 >> v2:172.21.15.181:3300/0 conn(0x7fed0c18e510 msgr2=0x7fed0c18af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-02-21T23:00:39.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:39.743+0000 7fed10e00640 1 -- 172.21.15.99:0/4042292771 >> v2:172.21.15.181:3300/0 conn(0x7fed0c18e510 msgr2=0x7fed0c18af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-21T23:00:39.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:39.743+0000 7fed10e00640 1 --2- 172.21.15.99:0/4042292771 >> v2:172.21.15.181:3300/0 conn(0x7fed0c18e510 0x7fed0c18af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-21T23:00:39.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:39.743+0000 7fed10e00640 1 --2- 172.21.15.99:0/4042292771 >> v2:172.21.15.181:3300/0 conn(0x7fed0c18e510 0x7fed0c18af90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T23:00:39.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:39.744+0000 7fed11800640 1 -- 172.21.15.99:0/4042292771 >> v2:172.21.15.99:3300/0 conn(0x7fed0c18a9b0 msgr2=0x7fed0c18ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-02-21T23:00:39.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:39.744+0000 7fed11800640 1 -- 172.21.15.99:0/4042292771 >> v2:172.21.15.99:3300/0 conn(0x7fed0c18a9b0 msgr2=0x7fed0c18ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-21T23:00:39.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:39.744+0000 7fed11800640 1 --2- 172.21.15.99:0/4042292771 >> v2:172.21.15.99:3300/0 conn(0x7fed0c18a9b0 0x7fed0c18ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-21T23:00:39.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:39.744+0000 7fed11800640 1 --2- 172.21.15.99:0/4042292771 >> v2:172.21.15.99:3300/0 conn(0x7fed0c18a9b0 0x7fed0c18ff80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T23:00:39.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:39.944+0000 7fed10e00640 1 --2- 172.21.15.99:0/4042292771 >> v2:172.21.15.181:3300/0 conn(0x7fed0c18e510 0x7fed0c18af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:39.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:39.945+0000 7fed10e00640 1 -- 172.21.15.99:0/4042292771 >> v2:172.21.15.181:3300/0 conn(0x7fed0c18e510 msgr2=0x7fed0c18af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-02-21T23:00:39.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:39.945+0000 7fed10e00640 1 -- 172.21.15.99:0/4042292771 >> v2:172.21.15.181:3300/0 conn(0x7fed0c18e510 msgr2=0x7fed0c18af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-21T23:00:39.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:39.945+0000 7fed10e00640 1 --2- 172.21.15.99:0/4042292771 >> v2:172.21.15.181:3300/0 conn(0x7fed0c18e510 0x7fed0c18af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-21T23:00:39.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:39.945+0000 7fed10e00640 1 --2- 172.21.15.99:0/4042292771 >> v2:172.21.15.181:3300/0 conn(0x7fed0c18e510 0x7fed0c18af90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T23:00:39.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:39.945+0000 7fed11800640 1 --2- 172.21.15.99:0/4042292771 >> v2:172.21.15.99:3300/0 conn(0x7fed0c18a9b0 0x7fed0c18ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:39.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:39.945+0000 7fed11800640 1 -- 172.21.15.99:0/4042292771 >> v2:172.21.15.99:3300/0 conn(0x7fed0c18a9b0 msgr2=0x7fed0c18ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-02-21T23:00:39.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:39.946+0000 7fed11800640 1 -- 172.21.15.99:0/4042292771 >> v2:172.21.15.99:3300/0 conn(0x7fed0c18a9b0 msgr2=0x7fed0c18ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-21T23:00:39.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:39.946+0000 7fed11800640 1 --2- 172.21.15.99:0/4042292771 >> v2:172.21.15.99:3300/0 conn(0x7fed0c18a9b0 0x7fed0c18ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-21T23:00:39.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:39.946+0000 7fed11800640 1 --2- 172.21.15.99:0/4042292771 >> v2:172.21.15.99:3300/0 conn(0x7fed0c18a9b0 0x7fed0c18ff80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T23:00:40.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:40.346+0000 7fed10e00640 1 --2- 172.21.15.99:0/4042292771 >> v2:172.21.15.181:3300/0 conn(0x7fed0c18e510 0x7fed0c18af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:40.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:40.346+0000 7fed10e00640 1 -- 172.21.15.99:0/4042292771 >> v2:172.21.15.181:3300/0 conn(0x7fed0c18e510 msgr2=0x7fed0c18af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-02-21T23:00:40.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:40.346+0000 7fed10e00640 1 -- 172.21.15.99:0/4042292771 >> v2:172.21.15.181:3300/0 conn(0x7fed0c18e510 msgr2=0x7fed0c18af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-21T23:00:40.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:40.346+0000 7fed10e00640 1 --2- 172.21.15.99:0/4042292771 >> v2:172.21.15.181:3300/0 conn(0x7fed0c18e510 0x7fed0c18af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-21T23:00:40.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:40.346+0000 7fed10e00640 1 --2- 172.21.15.99:0/4042292771 >> v2:172.21.15.181:3300/0 conn(0x7fed0c18e510 0x7fed0c18af90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T23:00:40.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:40.347+0000 7fed11800640 1 --2- 172.21.15.99:0/4042292771 >> v2:172.21.15.99:3300/0 conn(0x7fed0c18a9b0 0x7fed0c18ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:40.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:40.348+0000 7fed11800640 1 -- 172.21.15.99:0/4042292771 >> v2:172.21.15.99:3300/0 conn(0x7fed0c18a9b0 msgr2=0x7fed0c18ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-02-21T23:00:40.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:40.348+0000 7fed11800640 1 -- 172.21.15.99:0/4042292771 >> v2:172.21.15.99:3300/0 conn(0x7fed0c18a9b0 msgr2=0x7fed0c18ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-21T23:00:40.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:40.348+0000 7fed11800640 1 --2- 172.21.15.99:0/4042292771 >> v2:172.21.15.99:3300/0 conn(0x7fed0c18a9b0 0x7fed0c18ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-21T23:00:40.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:40.348+0000 7fed11800640 1 --2- 172.21.15.99:0/4042292771 >> v2:172.21.15.99:3300/0 conn(0x7fed0c18a9b0 0x7fed0c18ff80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T23:00:41.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:41.148+0000 7fed10e00640 1 --2- 172.21.15.99:0/4042292771 >> v2:172.21.15.181:3300/0 conn(0x7fed0c18e510 0x7fed0c18af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:41.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:41.148+0000 7fed10e00640 1 -- 172.21.15.99:0/4042292771 >> v2:172.21.15.181:3300/0 conn(0x7fed0c18e510 msgr2=0x7fed0c18af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-02-21T23:00:41.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:41.148+0000 7fed10e00640 1 -- 172.21.15.99:0/4042292771 >> v2:172.21.15.181:3300/0 conn(0x7fed0c18e510 msgr2=0x7fed0c18af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-21T23:00:41.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:41.148+0000 7fed10e00640 1 --2- 172.21.15.99:0/4042292771 >> v2:172.21.15.181:3300/0 conn(0x7fed0c18e510 0x7fed0c18af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-21T23:00:41.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:41.148+0000 7fed10e00640 1 --2- 172.21.15.99:0/4042292771 >> v2:172.21.15.181:3300/0 conn(0x7fed0c18e510 0x7fed0c18af90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T23:00:41.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:41.149+0000 7fed11800640 1 --2- 172.21.15.99:0/4042292771 >> v2:172.21.15.99:3300/0 conn(0x7fed0c18a9b0 0x7fed0c18ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:41.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:41.150+0000 7fed11800640 1 -- 172.21.15.99:0/4042292771 >> v2:172.21.15.99:3300/0 conn(0x7fed0c18a9b0 msgr2=0x7fed0c18ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-02-21T23:00:41.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:41.150+0000 7fed11800640 1 -- 172.21.15.99:0/4042292771 >> v2:172.21.15.99:3300/0 conn(0x7fed0c18a9b0 msgr2=0x7fed0c18ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-21T23:00:41.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:41.150+0000 7fed11800640 1 --2- 172.21.15.99:0/4042292771 >> v2:172.21.15.99:3300/0 conn(0x7fed0c18a9b0 0x7fed0c18ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-21T23:00:41.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:41.150+0000 7fed11800640 1 --2- 172.21.15.99:0/4042292771 >> v2:172.21.15.99:3300/0 conn(0x7fed0c18a9b0 0x7fed0c18ff80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T23:00:42.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:42.743+0000 7fed0aa00640 1 -- 172.21.15.99:0/4042292771 >> v2:172.21.15.181:3300/0 conn(0x7fed0c18e510 msgr2=0x7fed0c18af90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T23:00:42.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:42.743+0000 7fed0aa00640 1 --2- 172.21.15.99:0/4042292771 >> v2:172.21.15.181:3300/0 conn(0x7fed0c18e510 0x7fed0c18af90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:42.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:42.743+0000 7fed0aa00640 1 -- 172.21.15.99:0/4042292771 >> v2:172.21.15.99:3300/0 conn(0x7fed0c18a9b0 msgr2=0x7fed0c18ff80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T23:00:42.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:42.743+0000 7fed0aa00640 1 --2- 172.21.15.99:0/4042292771 >> v2:172.21.15.99:3300/0 conn(0x7fed0c18a9b0 0x7fed0c18ff80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:42.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:42.743+0000 7fed0aa00640 1 -- 172.21.15.99:0/4042292771 >> v1:172.21.15.99:6789/0 conn(0x7fed0c06ecb0 legacy=0x7fed0c06f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:42.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:42.743+0000 7fed0aa00640 1 --2- 172.21.15.99:0/4042292771 >> v2:172.21.15.162:3300/0 conn(0x7fecec0036e0 0x7fecec005af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:42.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:42.743+0000 7fed0aa00640 1 -- 172.21.15.99:0/4042292771 --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed0c18f1c0 con 0x7fecec0061e0 2024-02-21T23:00:42.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:42.743+0000 7fed0aa00640 1 -- 172.21.15.99:0/4042292771 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecec00ed10 con 0x7fecec009f50 2024-02-21T23:00:42.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:42.743+0000 7fed0aa00640 1 -- 172.21.15.99:0/4042292771 --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed0c18e9a0 con 0x7fecec0036e0 2024-02-21T23:00:42.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:42.744+0000 7fed11800640 1 --2- 172.21.15.99:0/4042292771 >> v2:172.21.15.162:3300/0 conn(0x7fecec0036e0 0x7fecec005af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:42.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:42.744+0000 7fed11800640 1 -- 172.21.15.99:0/4042292771 >> v2:172.21.15.162:3300/0 conn(0x7fecec0036e0 msgr2=0x7fecec005af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-02-21T23:00:42.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:42.744+0000 7fed11800640 1 -- 172.21.15.99:0/4042292771 >> v2:172.21.15.162:3300/0 conn(0x7fecec0036e0 msgr2=0x7fecec005af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-21T23:00:42.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:42.744+0000 7fed11800640 1 --2- 172.21.15.99:0/4042292771 >> v2:172.21.15.162:3300/0 conn(0x7fecec0036e0 0x7fecec005af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-21T23:00:42.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:42.744+0000 7fed11800640 1 --2- 172.21.15.99:0/4042292771 >> v2:172.21.15.162:3300/0 conn(0x7fecec0036e0 0x7fecec005af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T23:00:42.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:42.945+0000 7fed11800640 1 --2- 172.21.15.99:0/4042292771 >> v2:172.21.15.162:3300/0 conn(0x7fecec0036e0 0x7fecec005af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:42.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:42.945+0000 7fed11800640 1 -- 172.21.15.99:0/4042292771 >> v2:172.21.15.162:3300/0 conn(0x7fecec0036e0 msgr2=0x7fecec005af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-02-21T23:00:42.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:42.945+0000 7fed11800640 1 -- 172.21.15.99:0/4042292771 >> v2:172.21.15.162:3300/0 conn(0x7fecec0036e0 msgr2=0x7fecec005af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-21T23:00:42.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:42.945+0000 7fed11800640 1 --2- 172.21.15.99:0/4042292771 >> v2:172.21.15.162:3300/0 conn(0x7fecec0036e0 0x7fecec005af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-21T23:00:42.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:42.945+0000 7fed11800640 1 --2- 172.21.15.99:0/4042292771 >> v2:172.21.15.162:3300/0 conn(0x7fecec0036e0 0x7fecec005af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T23:00:43.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:43.346+0000 7fed11800640 1 --2- 172.21.15.99:0/4042292771 >> v2:172.21.15.162:3300/0 conn(0x7fecec0036e0 0x7fecec005af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:43.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:43.347+0000 7fed11800640 1 -- 172.21.15.99:0/4042292771 >> v2:172.21.15.162:3300/0 conn(0x7fecec0036e0 msgr2=0x7fecec005af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-02-21T23:00:43.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:43.347+0000 7fed11800640 1 -- 172.21.15.99:0/4042292771 >> v2:172.21.15.162:3300/0 conn(0x7fecec0036e0 msgr2=0x7fecec005af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-21T23:00:43.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:43.347+0000 7fed11800640 1 --2- 172.21.15.99:0/4042292771 >> v2:172.21.15.162:3300/0 conn(0x7fecec0036e0 0x7fecec005af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-21T23:00:43.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:43.347+0000 7fed11800640 1 --2- 172.21.15.99:0/4042292771 >> v2:172.21.15.162:3300/0 conn(0x7fecec0036e0 0x7fecec005af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T23:00:44.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:44.148+0000 7fed11800640 1 --2- 172.21.15.99:0/4042292771 >> v2:172.21.15.162:3300/0 conn(0x7fecec0036e0 0x7fecec005af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:44.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:44.148+0000 7fed11800640 1 -- 172.21.15.99:0/4042292771 >> v2:172.21.15.162:3300/0 conn(0x7fecec0036e0 msgr2=0x7fecec005af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-02-21T23:00:44.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:44.148+0000 7fed11800640 1 -- 172.21.15.99:0/4042292771 >> v2:172.21.15.162:3300/0 conn(0x7fecec0036e0 msgr2=0x7fecec005af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-02-21T23:00:44.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:44.148+0000 7fed11800640 1 --2- 172.21.15.99:0/4042292771 >> v2:172.21.15.162:3300/0 conn(0x7fecec0036e0 0x7fecec005af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-21T23:00:44.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:44.149+0000 7fed11800640 1 --2- 172.21.15.99:0/4042292771 >> v2:172.21.15.162:3300/0 conn(0x7fecec0036e0 0x7fecec005af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T23:00:44.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:44.739+0000 7fed0be00640 1 -- 172.21.15.99:0/4042292771 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2548688238 0 0) 0x7fed0c18f1c0 con 0x7fecec0061e0 2024-02-21T23:00:44.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:44.739+0000 7fed0be00640 1 -- 172.21.15.99:0/4042292771 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fecf4003520 con 0x7fecec0061e0 2024-02-21T23:00:44.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:44.740+0000 7fed0be00640 1 -- 172.21.15.99:0/4042292771 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3888410688 0 0) 0x7fecec00ed10 con 0x7fecec009f50 2024-02-21T23:00:44.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:44.740+0000 7fed0be00640 1 -- 172.21.15.99:0/4042292771 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed0c18f1c0 con 0x7fecec009f50 2024-02-21T23:00:44.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:44.740+0000 7fed0be00640 1 -- 172.21.15.99:0/4042292771 <== mon.2 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1395468905 0 0) 0x7fed0c18f1c0 con 0x7fecec009f50 2024-02-21T23:00:44.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:44.740+0000 7fed0be00640 1 -- 172.21.15.99:0/4042292771 >> v2:172.21.15.162:3300/0 conn(0x7fecec0036e0 msgr2=0x7fecec005af0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T23:00:44.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:44.740+0000 7fed0be00640 1 --2- 172.21.15.99:0/4042292771 >> v2:172.21.15.162:3300/0 conn(0x7fecec0036e0 0x7fecec005af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:44.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:44.740+0000 7fed0be00640 1 -- 172.21.15.99:0/4042292771 >> v1:172.21.15.162:6789/0 conn(0x7fecec0061e0 legacy=0x7fecec0086a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:44.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:44.740+0000 7fed0be00640 1 -- 172.21.15.99:0/4042292771 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecec010030 con 0x7fecec009f50 2024-02-21T23:00:44.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:44.740+0000 7fed0be00640 1 -- 172.21.15.99:0/4042292771 <== mon.2 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2069890144 0 0) 0x7fed04001a30 con 0x7fecec009f50 2024-02-21T23:00:44.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:44.741+0000 7fed0be00640 1 -- 172.21.15.99:0/4042292771 >> v1:172.21.15.181:6789/0 conn(0x7fecec009f50 legacy=0x7fecec00c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:44.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:44.741+0000 7fed0be00640 1 --2- 172.21.15.99:0/4042292771 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fecf4004ba0 0x7fecf4004f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:44.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:44.741+0000 7fed12200640 1 -- 172.21.15.99:0/4042292771 reap_dead start 2024-02-21T23:00:44.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:44.741+0000 7fed0be00640 1 --2- 172.21.15.99:0/4042292771 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fecf40037a0 0x7fecf4003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:44.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:44.741+0000 7fed0be00640 1 --2- 172.21.15.99:0/4042292771 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fecf4004280 0x7fecf400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:44.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:44.741+0000 7fed0be00640 1 -- 172.21.15.99:0/4042292771 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed0c18e9a0 con 0x7fecf4004ba0 2024-02-21T23:00:44.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:44.741+0000 7fed0be00640 1 -- 172.21.15.99:0/4042292771 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf400c1b0 con 0x7fecf4004280 2024-02-21T23:00:44.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:44.741+0000 7fed0be00640 1 -- 172.21.15.99:0/4042292771 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf400c3b0 con 0x7fecf40037a0 2024-02-21T23:00:44.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:44.741+0000 7fed12200640 1 -- 172.21.15.99:0/4042292771 reap_dead start 2024-02-21T23:00:44.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:44.741+0000 7fed10e00640 1 --2- 172.21.15.99:0/4042292771 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fecf40037a0 0x7fecf4003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:44.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:44.741+0000 7fed12200640 1 --2- 172.21.15.99:0/4042292771 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fecf4004280 0x7fecf400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:44.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:44.742+0000 7fed11800640 1 --2- 172.21.15.99:0/4042292771 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fecf4004ba0 0x7fecf4004f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:44.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:44.742+0000 7fed10e00640 1 -- 172.21.15.99:0/4042292771 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fecf4004280 msgr2=0x7fecf400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:00:44.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:44.742+0000 7fed10e00640 1 --2- 172.21.15.99:0/4042292771 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fecf4004280 0x7fecf400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:44.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:44.742+0000 7fed10e00640 1 -- 172.21.15.99:0/4042292771 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fecf4004ba0 msgr2=0x7fecf4004f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:00:44.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:44.742+0000 7fed10e00640 1 --2- 172.21.15.99:0/4042292771 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fecf4004ba0 0x7fecf4004f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:44.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:44.742+0000 7fed10e00640 1 -- 172.21.15.99:0/4042292771 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecec010030 con 0x7fecf40037a0 2024-02-21T23:00:44.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:44.745+0000 7fed10e00640 1 --2- 172.21.15.99:0/4042292771 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fecf40037a0 0x7fecf4003c20 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fecf800cf30 tx=0x7fecf4005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84167c5b3024d656 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:00:44.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:44.745+0000 7fed0be00640 1 -- 172.21.15.99:0/4042292771 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf8033070 con 0x7fecf40037a0 2024-02-21T23:00:44.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:44.745+0000 7fed0be00640 1 -- 172.21.15.99:0/4042292771 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecf802d830 con 0x7fecf40037a0 2024-02-21T23:00:44.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:44.745+0000 7fed0be00640 1 -- 172.21.15.99:0/4042292771 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf800cb30 con 0x7fecf40037a0 2024-02-21T23:00:44.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:44.747+0000 7fed14200640 1 -- 172.21.15.99:0/4042292771 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fecf40037a0 msgr2=0x7fecf4003c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:44.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:44.747+0000 7fed14200640 1 --2- 172.21.15.99:0/4042292771 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fecf40037a0 0x7fecf4003c20 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fecf800cf30 tx=0x7fecf4005830 comp rx=0 tx=0).stop 2024-02-21T23:00:44.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:44.747+0000 7fed14200640 1 -- 172.21.15.99:0/4042292771 shutdown_connections 2024-02-21T23:00:44.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:44.747+0000 7fed14200640 1 --2- 172.21.15.99:0/4042292771 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fecf4004280 0x7fecf400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:44.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:44.747+0000 7fed14200640 1 --2- 172.21.15.99:0/4042292771 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fecf4004ba0 0x7fecf4004f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:44.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:44.747+0000 7fed14200640 1 --2- 172.21.15.99:0/4042292771 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fecf40037a0 0x7fecf4003c20 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:44.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:44.747+0000 7fed14200640 1 -- 172.21.15.99:0/4042292771 >> 172.21.15.99:0/4042292771 conn(0x7fed0c0ce5f0 msgr2=0x7fed0c0cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:00:44.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:44.747+0000 7fed14200640 1 -- 172.21.15.99:0/4042292771 shutdown_connections 2024-02-21T23:00:44.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:44.748+0000 7fed14200640 1 -- 172.21.15.99:0/4042292771 wait complete. 2024-02-21T23:00:44.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:44.752+0000 7fed14200640 1 Processor -- start 2024-02-21T23:00:44.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:44.753+0000 7fed14200640 1 -- start start 2024-02-21T23:00:44.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:44.757+0000 7fed14200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fecf40037a0 0x7fed0c0ccea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:44.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:44.757+0000 7fed14200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fecf4004280 0x7fed0c173210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:44.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:44.757+0000 7fed14200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fecf4004ba0 0x7fed0c0f4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:44.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:44.757+0000 7fed14200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed0c18fa60 con 0x7fecf40037a0 2024-02-21T23:00:44.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:44.757+0000 7fed14200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed0c18f780 con 0x7fecf4004ba0 2024-02-21T23:00:44.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:44.757+0000 7fed14200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed0c18ff80 con 0x7fecf4004280 2024-02-21T23:00:44.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:44.757+0000 7fed11800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fecf40037a0 0x7fed0c0ccea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:44.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:44.757+0000 7fed12200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fecf4004ba0 0x7fed0c0f4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:44.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:44.757+0000 7fed12200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fecf4004ba0 0x7fed0c0f4ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:60924/0 (socket says 172.21.15.99:60924) 2024-02-21T23:00:44.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:44.757+0000 7fed12200640 1 -- 172.21.15.99:0/2944828654 learned_addr learned my addr 172.21.15.99:0/2944828654 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:00:44.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:44.757+0000 7fed10e00640 1 --2- 172.21.15.99:0/2944828654 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fecf4004280 0x7fed0c173210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:44.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:44.758+0000 7fed12200640 1 -- 172.21.15.99:0/2944828654 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fecf4004280 msgr2=0x7fed0c173210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:44.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:44.758+0000 7fed12200640 1 --2- 172.21.15.99:0/2944828654 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fecf4004280 0x7fed0c173210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:44.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:44.758+0000 7fed12200640 1 -- 172.21.15.99:0/2944828654 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fecf40037a0 msgr2=0x7fed0c0ccea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:44.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:44.758+0000 7fed12200640 1 --2- 172.21.15.99:0/2944828654 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fecf40037a0 0x7fed0c0ccea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:44.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:44.758+0000 7fed12200640 1 -- 172.21.15.99:0/2944828654 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed0c0cd3e0 con 0x7fecf4004ba0 2024-02-21T23:00:44.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:44.758+0000 7fed12200640 1 --2- 172.21.15.99:0/2944828654 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fecf4004ba0 0x7fed0c0f4ec0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fecec00dc90 tx=0x7fed040019f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:00:44.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:44.758+0000 7fed09600640 1 -- 172.21.15.99:0/2944828654 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed04019070 con 0x7fecf4004ba0 2024-02-21T23:00:44.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:44.758+0000 7fed09600640 1 -- 172.21.15.99:0/2944828654 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed04005e10 con 0x7fecf4004ba0 2024-02-21T23:00:44.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:44.758+0000 7fed09600640 1 -- 172.21.15.99:0/2944828654 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed0400d940 con 0x7fecf4004ba0 2024-02-21T23:00:44.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:44.758+0000 7fed14200640 1 -- 172.21.15.99:0/2944828654 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed0c0cd6b0 con 0x7fecf4004ba0 2024-02-21T23:00:44.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:44.759+0000 7fed14200640 1 -- 172.21.15.99:0/2944828654 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed0c0cdc70 con 0x7fecf4004ba0 2024-02-21T23:00:44.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:44.759+0000 7fed09600640 1 -- 172.21.15.99:0/2944828654 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fed0401c070 con 0x7fecf4004ba0 2024-02-21T23:00:44.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:44.759+0000 7fed09600640 1 -- 172.21.15.99:0/2944828654 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fed040070d0 con 0x7fecf4004ba0 2024-02-21T23:00:44.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:44.761+0000 7fed14200640 1 -- 172.21.15.99:0/2944828654 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed0c068780 con 0x7fecf4004ba0 2024-02-21T23:00:44.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:44.764+0000 7fed09600640 1 -- 172.21.15.99:0/2944828654 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fed04023070 con 0x7fecf4004ba0 2024-02-21T23:00:44.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:44.870+0000 7fed14200640 1 -- 172.21.15.99:0/2944828654 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fed0c187fb0 con 0x7fecf4004ba0 2024-02-21T23:00:44.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:44.877+0000 7fed09600640 1 -- 172.21.15.99:0/2944828654 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fed04007940 con 0x7fecf4004ba0 2024-02-21T23:00:44.866 INFO:teuthology.orchestra.run.smithi099.stderr:adjusted tunables profile to default 2024-02-21T23:00:44.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:44.879+0000 7fed14200640 1 -- 172.21.15.99:0/2944828654 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fecf4004ba0 msgr2=0x7fed0c0f4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:44.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:44.879+0000 7fed14200640 1 --2- 172.21.15.99:0/2944828654 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fecf4004ba0 0x7fed0c0f4ec0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fecec00dc90 tx=0x7fed040019f0 comp rx=0 tx=0).stop 2024-02-21T23:00:44.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:44.879+0000 7fed14200640 1 -- 172.21.15.99:0/2944828654 shutdown_connections 2024-02-21T23:00:44.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:44.879+0000 7fed14200640 1 --2- 172.21.15.99:0/2944828654 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fecf4004ba0 0x7fed0c0f4ec0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:44.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:44.879+0000 7fed14200640 1 --2- 172.21.15.99:0/2944828654 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fecf4004280 0x7fed0c173210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:44.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:44.879+0000 7fed14200640 1 --2- 172.21.15.99:0/2944828654 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fecf40037a0 0x7fed0c0ccea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:44.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:44.879+0000 7fed14200640 1 -- 172.21.15.99:0/2944828654 >> 172.21.15.99:0/2944828654 conn(0x7fed0c0ce5f0 msgr2=0x7fed0c0ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:00:44.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:44.879+0000 7fed14200640 1 -- 172.21.15.99:0/2944828654 shutdown_connections 2024-02-21T23:00:44.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:44.879+0000 7fed14200640 1 -- 172.21.15.99:0/2944828654 wait complete. 2024-02-21T23:00:44.885 INFO:tasks.ceph:check_enable_crimson: False 2024-02-21T23:00:44.885 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-02-21T23:00:44.886 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-02-21T23:00:44.886 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-02-21T23:00:44.963 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-02-21T23:00:44.963 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-02-21T23:00:45.089 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-02-21T23:00:45.089 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-02-21T23:00:45.199 INFO:tasks.ceph.mgr.z.smithi181.stderr:2024-02-21T23:00:45.210+0000 7fe068a2b040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-02-21T23:00:45.220 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-02-21T23:00:45.220 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-9/fsid of=/dev/stdout 2024-02-21T23:00:45.242 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-02-21T23:00:45.253+0000 7fda7b02b040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-02-21T23:00:45.252 INFO:tasks.ceph.mgr.z.smithi181.stderr:2024-02-21T23:00:45.263+0000 7fe068a2b040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-21T23:00:45.296 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-02-21T23:00:45.307+0000 7fda7b02b040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-21T23:00:45.304 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-02-21T23:00:45.304 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-02-21T23:00:45.331 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-02-21T23:00:45.331 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-02-21T23:00:45.347 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-02-21T23:00:45.358+0000 7f29159b1040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-02-21T23:00:45.402 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-02-21T23:00:45.402 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-02-21T23:00:45.409 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-02-21T23:00:45.420+0000 7f29159b1040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-21T23:00:45.469 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-02-21T23:00:45.469 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-10/fsid of=/dev/stdout 2024-02-21T23:00:45.535 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-02-21T23:00:45.535 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-02-21T23:00:45.562 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-02-21T23:00:45.562 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-02-21T23:00:45.629 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-02-21T23:00:45.629 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-8/fsid of=/dev/stdout 2024-02-21T23:00:45.695 DEBUG:teuthology.orchestra.run.smithi181:> set -ex 2024-02-21T23:00:45.695 DEBUG:teuthology.orchestra.run.smithi181:> sudo dd if=/var/lib/ceph/osd/ceph-11/fsid of=/dev/stdout 2024-02-21T23:00:45.762 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --cluster ceph osd new c49de9b2-dc53-4882-b14c-7059ed40bf59 0 2024-02-21T23:00:45.769 INFO:tasks.ceph.mgr.z.smithi181.stderr:2024-02-21T23:00:45.780+0000 7fe068a2b040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-21T23:00:45.827 INFO:tasks.ceph.mgr.z.smithi181.stderr:2024-02-21T23:00:45.837+0000 7fe068a2b040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-21T23:00:45.842 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-02-21T23:00:45.853+0000 7fda7b02b040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-21T23:00:45.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:45.880+0000 7f777de88640 1 Processor -- start 2024-02-21T23:00:45.869 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:45.880+0000 7f777de88640 1 -- start start 2024-02-21T23:00:45.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:45.881+0000 7f777de88640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f7778182e50 0x7f777818bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:45.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:45.881+0000 7f777de88640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f777818c3b0 0x7f777818c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:45.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:45.881+0000 7f777de88640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f777818a570 con 0x7f777818a0f0 2024-02-21T23:00:45.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:45.881+0000 7f777de88640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f777818a7e0 con 0x7f777818c3b0 2024-02-21T23:00:45.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:45.881+0000 7f777de88640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f777818aac0 con 0x7f7778182e50 2024-02-21T23:00:45.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:45.881+0000 7f77777fe640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f7778182e50 0x7f777818bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:45.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:45.881+0000 7f77777fe640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f7778182e50 0x7f777818bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:49282/0 (socket says 172.21.15.181:49282) 2024-02-21T23:00:45.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:45.881+0000 7f77777fe640 1 -- 172.21.15.181:0/1959440901 learned_addr learned my addr 172.21.15.181:0/1959440901 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-02-21T23:00:45.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:45.881+0000 7f7777fff640 1 --2- 172.21.15.181:0/1959440901 >> v2:172.21.15.162:3300/0 conn(0x7f777818c3b0 0x7f777818c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:45.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:45.881+0000 7f77777fe640 1 -- 172.21.15.181:0/1959440901 >> v2:172.21.15.162:3300/0 conn(0x7f777818c3b0 msgr2=0x7f777818c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:00:45.871 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:45.881+0000 7f77777fe640 1 --2- 172.21.15.181:0/1959440901 >> v2:172.21.15.162:3300/0 conn(0x7f777818c3b0 0x7f777818c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:45.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:45.881+0000 7f77777fe640 1 -- 172.21.15.181:0/1959440901 >> v1:172.21.15.181:6789/0 conn(0x7f777818a0f0 legacy=0x7f7778186b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:45.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:45.881+0000 7f77777fe640 1 -- 172.21.15.181:0/1959440901 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f777818ada0 con 0x7f7778182e50 2024-02-21T23:00:45.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:45.881+0000 7f77767fc640 1 -- 172.21.15.181:0/1959440901 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4041585737 0 0) 0x7f777818a570 con 0x7f777818a0f0 2024-02-21T23:00:45.872 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:45.881+0000 7f7777fff640 1 --2- 172.21.15.181:0/1959440901 >> v2:172.21.15.162:3300/0 conn(0x7f777818c3b0 0x7f777818c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:00:45.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:45.882+0000 7f77777fe640 1 --2- 172.21.15.181:0/1959440901 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7778182e50 0x7f777818bb60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7778067d50 tx=0x7f776802b880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f38fbc57f4f14568 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:00:45.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:45.882+0000 7f77767fc640 1 -- 172.21.15.181:0/1959440901 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f776802e070 con 0x7f7778182e50 2024-02-21T23:00:45.873 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:45.882+0000 7f77767fc640 1 -- 172.21.15.181:0/1959440901 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7768037070 con 0x7f7778182e50 2024-02-21T23:00:45.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:45.882+0000 7f77767fc640 1 -- 172.21.15.181:0/1959440901 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7768031a00 con 0x7f7778182e50 2024-02-21T23:00:45.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:45.883+0000 7f777de88640 1 -- 172.21.15.181:0/1959440901 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7778182e50 msgr2=0x7f777818bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:45.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:45.883+0000 7f777de88640 1 --2- 172.21.15.181:0/1959440901 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7778182e50 0x7f777818bb60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7778067d50 tx=0x7f776802b880 comp rx=0 tx=0).stop 2024-02-21T23:00:45.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:45.883+0000 7f777de88640 1 -- 172.21.15.181:0/1959440901 shutdown_connections 2024-02-21T23:00:45.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:45.883+0000 7f777de88640 1 --2- 172.21.15.181:0/1959440901 >> v2:172.21.15.162:3300/0 conn(0x7f777818c3b0 0x7f777818c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:45.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:45.883+0000 7f777de88640 1 --2- 172.21.15.181:0/1959440901 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7778182e50 0x7f777818bb60 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:45.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:45.883+0000 7f777de88640 1 -- 172.21.15.181:0/1959440901 >> 172.21.15.181:0/1959440901 conn(0x7f77780ceee0 msgr2=0x7f77780cf2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:00:45.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:45.883+0000 7f777de88640 1 -- 172.21.15.181:0/1959440901 shutdown_connections 2024-02-21T23:00:45.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:45.883+0000 7f777de88640 1 -- 172.21.15.181:0/1959440901 wait complete. 2024-02-21T23:00:45.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:45.884+0000 7f777de88640 1 Processor -- start 2024-02-21T23:00:45.874 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:45.884+0000 7f777de88640 1 -- start start 2024-02-21T23:00:45.875 INFO:tasks.ceph.mgr.z.smithi181.stderr:2024-02-21T23:00:45.885+0000 7fe068a2b040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-21T23:00:45.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:45.885+0000 7f777de88640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7778182e50 0x7f7778171c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:45.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:45.885+0000 7f777de88640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f777818a0f0 0x7f77782122d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:45.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:45.885+0000 7f777de88640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f777818c3b0 0x7f7778212810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:45.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:45.885+0000 7f777de88640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f777818cd80 con 0x7f777818c3b0 2024-02-21T23:00:45.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:45.885+0000 7f777de88640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f777818b360 con 0x7f777818a0f0 2024-02-21T23:00:45.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:45.885+0000 7f777de88640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f777818cf00 con 0x7f7778182e50 2024-02-21T23:00:45.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:45.886+0000 7f77777fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7778182e50 0x7f7778171c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:45.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:45.886+0000 7f77777fe640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7778182e50 0x7f7778171c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:49290/0 (socket says 172.21.15.181:49290) 2024-02-21T23:00:45.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:45.886+0000 7f77777fe640 1 -- 172.21.15.181:0/1741653404 learned_addr learned my addr 172.21.15.181:0/1741653404 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-02-21T23:00:45.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:45.886+0000 7f7776ffd640 1 --2- 172.21.15.181:0/1741653404 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f777818a0f0 0x7f77782122d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:45.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:45.886+0000 7f77777fe640 1 -- 172.21.15.181:0/1741653404 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f777818a0f0 msgr2=0x7f77782122d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:45.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:45.886+0000 7f77777fe640 1 --2- 172.21.15.181:0/1741653404 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f777818a0f0 0x7f77782122d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:45.877 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:45.886+0000 7f77777fe640 1 -- 172.21.15.181:0/1741653404 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f777818c3b0 msgr2=0x7f7778212810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:45.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:45.886+0000 7f77777fe640 1 --2- 172.21.15.181:0/1741653404 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f777818c3b0 0x7f7778212810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:45.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:45.886+0000 7f77777fe640 1 -- 172.21.15.181:0/1741653404 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f777821e2d0 con 0x7f7778182e50 2024-02-21T23:00:45.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:45.886+0000 7f77777fe640 1 --2- 172.21.15.181:0/1741653404 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7778182e50 0x7f7778171c00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7768000c00 tx=0x7f77680046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:00:45.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:45.886+0000 7f775ffff640 1 -- 172.21.15.181:0/1741653404 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7768032880 con 0x7f7778182e50 2024-02-21T23:00:45.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:45.886+0000 7f775ffff640 1 -- 172.21.15.181:0/1741653404 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7768032a40 con 0x7f7778182e50 2024-02-21T23:00:45.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:45.886+0000 7f775ffff640 1 -- 172.21.15.181:0/1741653404 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7768032e30 con 0x7f7778182e50 2024-02-21T23:00:45.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:45.886+0000 7f777de88640 1 -- 172.21.15.181:0/1741653404 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f777821e5b0 con 0x7f7778182e50 2024-02-21T23:00:45.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:45.886+0000 7f777de88640 1 -- 172.21.15.181:0/1741653404 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f777821eb70 con 0x7f7778182e50 2024-02-21T23:00:45.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:45.886+0000 7f775ffff640 1 -- 172.21.15.181:0/1741653404 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f77680453f0 con 0x7f7778182e50 2024-02-21T23:00:45.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:45.886+0000 7f775ffff640 1 -- 172.21.15.181:0/1741653404 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f776804e5b0 con 0x7f7778182e50 2024-02-21T23:00:45.878 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:45.888+0000 7f777de88640 1 -- 172.21.15.181:0/1741653404 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f777821edb0 con 0x7f7778182e50 2024-02-21T23:00:45.879 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:45.890+0000 7f775ffff640 1 -- 172.21.15.181:0/1741653404 <== mon.2 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f777821edb0 con 0x7f7778182e50 2024-02-21T23:00:45.897 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-02-21T23:00:45.908+0000 7fda7b02b040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-21T23:00:45.941 INFO:tasks.ceph.mgr.z.smithi181.stderr:2024-02-21T23:00:45.952+0000 7fe068a2b040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-21T23:00:45.942 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-02-21T23:00:45.952+0000 7fda7b02b040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-21T23:00:45.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:45.976+0000 7f777de88640 1 -- 172.21.15.181:0/1741653404 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c49de9b2-dc53-4882-b14c-7059ed40bf59", "id": 0} v 0) v1 -- 0x7f7778066c60 con 0x7f7778182e50 2024-02-21T23:00:45.975 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:45.984+0000 7f775ffff640 1 -- 172.21.15.181:0/1741653404 <== mon.2 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c49de9b2-dc53-4882-b14c-7059ed40bf59", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7768040070 con 0x7f7778182e50 2024-02-21T23:00:45.975 INFO:teuthology.orchestra.run.smithi181.stdout:0 2024-02-21T23:00:45.976 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:45.985+0000 7f777de88640 1 -- 172.21.15.181:0/1741653404 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7778182e50 msgr2=0x7f7778171c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:45.976 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:45.985+0000 7f777de88640 1 --2- 172.21.15.181:0/1741653404 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7778182e50 0x7f7778171c00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7768000c00 tx=0x7f77680046c0 comp rx=0 tx=0).stop 2024-02-21T23:00:45.976 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:45.985+0000 7f777de88640 1 -- 172.21.15.181:0/1741653404 shutdown_connections 2024-02-21T23:00:45.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:45.985+0000 7f777de88640 1 --2- 172.21.15.181:0/1741653404 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f777818c3b0 0x7f7778212810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:45.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:45.985+0000 7f777de88640 1 --2- 172.21.15.181:0/1741653404 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f777818a0f0 0x7f77782122d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:45.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:45.985+0000 7f777de88640 1 --2- 172.21.15.181:0/1741653404 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7778182e50 0x7f7778171c00 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:45.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:45.985+0000 7f777de88640 1 -- 172.21.15.181:0/1741653404 >> 172.21.15.181:0/1741653404 conn(0x7f77780ceee0 msgr2=0x7f777817a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:00:45.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:45.986+0000 7f777de88640 1 -- 172.21.15.181:0/1741653404 shutdown_connections 2024-02-21T23:00:45.977 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:45.986+0000 7f777de88640 1 -- 172.21.15.181:0/1741653404 wait complete. 2024-02-21T23:00:45.985 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --cluster ceph osd new 58398292-2fe5-4291-94fd-03a0ca29d49d 1 2024-02-21T23:00:45.986 INFO:tasks.ceph.mgr.z.smithi181.stderr:2024-02-21T23:00:45.996+0000 7fe068a2b040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-21T23:00:45.997 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-02-21T23:00:46.008+0000 7fda7b02b040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-21T23:00:46.008 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-02-21T23:00:46.019+0000 7f29159b1040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-21T23:00:46.040 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-02-21T23:00:46.051+0000 7fda7b02b040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-21T23:00:46.072 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-02-21T23:00:46.083+0000 7f29159b1040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-21T23:00:46.086 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.096+0000 7fd20aa88640 1 Processor -- start 2024-02-21T23:00:46.086 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.097+0000 7fd20aa88640 1 -- start start 2024-02-21T23:00:46.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.098+0000 7fd20aa88640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd20418bb60 0x7fd20418a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:46.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.098+0000 7fd20aa88640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd20418a7e0 con 0x7fd204182e50 2024-02-21T23:00:46.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.098+0000 7fd20aa88640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd20418aac0 con 0x7fd20418c3b0 2024-02-21T23:00:46.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.098+0000 7fd20aa88640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd20418bfe0 con 0x7fd20418bb60 2024-02-21T23:00:46.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.098+0000 7fd209025640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fd20418c3b0 0x7fd20418c840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.181:58714/0 (socket says 172.21.15.181:58714) 2024-02-21T23:00:46.089 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.098+0000 7fd209025640 1 -- 172.21.15.181:0/3188223689 learned_addr learned my addr 172.21.15.181:0/3188223689 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-02-21T23:00:46.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.098+0000 7fd203fff640 1 --2- 172.21.15.181:0/3188223689 >> v2:172.21.15.99:3300/0 conn(0x7fd20418bb60 0x7fd20418a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:46.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.098+0000 7fd2037fe640 1 -- 172.21.15.181:0/3188223689 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 642668793 0 0) 0x7fd20418aac0 con 0x7fd20418c3b0 2024-02-21T23:00:46.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.098+0000 7fd2037fe640 1 -- 172.21.15.181:0/3188223689 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1f4003520 con 0x7fd20418c3b0 2024-02-21T23:00:46.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.098+0000 7fd2037fe640 1 -- 172.21.15.181:0/3188223689 <== mon.1 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3846090308 0 0) 0x7fd1f4003520 con 0x7fd20418c3b0 2024-02-21T23:00:46.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.098+0000 7fd2037fe640 1 -- 172.21.15.181:0/3188223689 >> v2:172.21.15.99:3300/0 conn(0x7fd20418bb60 msgr2=0x7fd20418a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:00:46.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.098+0000 7fd2037fe640 1 --2- 172.21.15.181:0/3188223689 >> v2:172.21.15.99:3300/0 conn(0x7fd20418bb60 0x7fd20418a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:46.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.098+0000 7fd2037fe640 1 -- 172.21.15.181:0/3188223689 >> v1:172.21.15.99:6789/0 conn(0x7fd204182e50 legacy=0x7fd204186b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:46.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.098+0000 7fd2037fe640 1 -- 172.21.15.181:0/3188223689 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd20418ada0 con 0x7fd20418c3b0 2024-02-21T23:00:46.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.098+0000 7fd2037fe640 1 -- 172.21.15.181:0/3188223689 <== mon.1 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2069890144 0 0) 0x7fd1fc0019f0 con 0x7fd20418c3b0 2024-02-21T23:00:46.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.099+0000 7fd2037fe640 1 -- 172.21.15.181:0/3188223689 >> v1:172.21.15.162:6789/0 conn(0x7fd20418c3b0 legacy=0x7fd20418c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:46.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.099+0000 7fd2037fe640 1 --2- 172.21.15.181:0/3188223689 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd1f4003a00 0x7fd1f4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:46.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.099+0000 7fd2037fe640 1 --2- 172.21.15.181:0/3188223689 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd1f4004800 0x7fd1f4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:46.090 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.099+0000 7fd2037fe640 1 --2- 172.21.15.181:0/3188223689 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd1f40052e0 0x7fd1f400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:46.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.099+0000 7fd2037fe640 1 -- 172.21.15.181:0/3188223689 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd20418bfe0 con 0x7fd1f4004800 2024-02-21T23:00:46.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.099+0000 7fd2037fe640 1 -- 172.21.15.181:0/3188223689 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f400c1e0 con 0x7fd1f40052e0 2024-02-21T23:00:46.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.099+0000 7fd2037fe640 1 -- 172.21.15.181:0/3188223689 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f400c3e0 con 0x7fd1f4003a00 2024-02-21T23:00:46.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.099+0000 7fd208824640 1 --2- 172.21.15.181:0/3188223689 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd1f4003a00 0x7fd1f4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:46.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.099+0000 7fd209025640 1 --2- 172.21.15.181:0/3188223689 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd1f40052e0 0x7fd1f400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:46.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.099+0000 7fd203fff640 1 --2- 172.21.15.181:0/3188223689 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd1f4004800 0x7fd1f4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:46.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.099+0000 7fd208824640 1 -- 172.21.15.181:0/3188223689 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd1f40052e0 msgr2=0x7fd1f400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:00:46.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.099+0000 7fd208824640 1 --2- 172.21.15.181:0/3188223689 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd1f40052e0 0x7fd1f400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:46.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.099+0000 7fd208824640 1 -- 172.21.15.181:0/3188223689 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd1f4004800 msgr2=0x7fd1f4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:00:46.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.099+0000 7fd208824640 1 --2- 172.21.15.181:0/3188223689 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd1f4004800 0x7fd1f4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:46.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.099+0000 7fd208824640 1 -- 172.21.15.181:0/3188223689 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1f4003520 con 0x7fd1f4003a00 2024-02-21T23:00:46.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.099+0000 7fd209025640 1 -- 172.21.15.181:0/3188223689 reap_dead start 2024-02-21T23:00:46.091 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.100+0000 7fd208824640 1 --2- 172.21.15.181:0/3188223689 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd1f4003a00 0x7fd1f4003e20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd1f8001750 tx=0x7fd1f4005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd9140dea031ad1a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:00:46.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.100+0000 7fd2037fe640 1 -- 172.21.15.181:0/3188223689 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f8001370 con 0x7fd1f4003a00 2024-02-21T23:00:46.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.100+0000 7fd2037fe640 1 -- 172.21.15.181:0/3188223689 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1f80052d0 con 0x7fd1f4003a00 2024-02-21T23:00:46.092 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.100+0000 7fd2037fe640 1 -- 172.21.15.181:0/3188223689 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f8003830 con 0x7fd1f4003a00 2024-02-21T23:00:46.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.100+0000 7fd20aa88640 1 -- 172.21.15.181:0/3188223689 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd1f4003a00 msgr2=0x7fd1f4003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:46.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.100+0000 7fd20aa88640 1 --2- 172.21.15.181:0/3188223689 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd1f4003a00 0x7fd1f4003e20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd1f8001750 tx=0x7fd1f4005830 comp rx=0 tx=0).stop 2024-02-21T23:00:46.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.101+0000 7fd20aa88640 1 -- 172.21.15.181:0/3188223689 shutdown_connections 2024-02-21T23:00:46.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.101+0000 7fd20aa88640 1 --2- 172.21.15.181:0/3188223689 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd1f4003a00 0x7fd1f4003e20 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:46.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.101+0000 7fd20aa88640 1 -- 172.21.15.181:0/3188223689 >> 172.21.15.181:0/3188223689 conn(0x7fd2040ceee0 msgr2=0x7fd2040cf2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:00:46.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.101+0000 7fd20aa88640 1 -- 172.21.15.181:0/3188223689 shutdown_connections 2024-02-21T23:00:46.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.101+0000 7fd20aa88640 1 -- 172.21.15.181:0/3188223689 wait complete. 2024-02-21T23:00:46.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.102+0000 7fd20aa88640 1 Processor -- start 2024-02-21T23:00:46.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.102+0000 7fd20aa88640 1 -- start start 2024-02-21T23:00:46.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.103+0000 7fd20aa88640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd1f4003a00 0x7fd204170eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:46.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.103+0000 7fd20aa88640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd20421f3e0 0x7fd20421f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:46.095 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.103+0000 7fd20aa88640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd20421d260 0x7fd20421d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:46.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.103+0000 7fd20aa88640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd20418a0f0 con 0x7fd20421f3e0 2024-02-21T23:00:46.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.103+0000 7fd20aa88640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd20418b360 con 0x7fd20421d260 2024-02-21T23:00:46.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.103+0000 7fd20aa88640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd20418a270 con 0x7fd1f4003a00 2024-02-21T23:00:46.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.103+0000 7fd208824640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd1f4003a00 0x7fd204170eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:46.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.103+0000 7fd208824640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd1f4003a00 0x7fd204170eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:49308/0 (socket says 172.21.15.181:49308) 2024-02-21T23:00:46.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.103+0000 7fd208824640 1 -- 172.21.15.181:0/907532136 learned_addr learned my addr 172.21.15.181:0/907532136 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-02-21T23:00:46.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.103+0000 7fd209025640 1 --2- 172.21.15.181:0/907532136 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd20421d260 0x7fd20421d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:46.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.104+0000 7fd203fff640 1 --2- 172.21.15.181:0/907532136 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd20421f3e0 0x7fd20421f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:46.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.104+0000 7fd208824640 1 -- 172.21.15.181:0/907532136 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd20421d260 msgr2=0x7fd20421d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:46.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.104+0000 7fd208824640 1 --2- 172.21.15.181:0/907532136 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd20421d260 0x7fd20421d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:46.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.104+0000 7fd208824640 1 -- 172.21.15.181:0/907532136 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd20421f3e0 msgr2=0x7fd20421f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:46.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.104+0000 7fd208824640 1 --2- 172.21.15.181:0/907532136 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd20421f3e0 0x7fd20421f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:46.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.104+0000 7fd208824640 1 -- 172.21.15.181:0/907532136 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd204221470 con 0x7fd1f4003a00 2024-02-21T23:00:46.096 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.104+0000 7fd208824640 1 --2- 172.21.15.181:0/907532136 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd1f4003a00 0x7fd204170eb0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd1f8005040 tx=0x7fd1f8001120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:00:46.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.104+0000 7fd2017fa640 1 -- 172.21.15.181:0/907532136 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f8041020 con 0x7fd1f4003a00 2024-02-21T23:00:46.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.104+0000 7fd2017fa640 1 -- 172.21.15.181:0/907532136 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1f8005480 con 0x7fd1f4003a00 2024-02-21T23:00:46.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.104+0000 7fd20aa88640 1 -- 172.21.15.181:0/907532136 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd204221750 con 0x7fd1f4003a00 2024-02-21T23:00:46.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.104+0000 7fd2017fa640 1 -- 172.21.15.181:0/907532136 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f8001370 con 0x7fd1f4003a00 2024-02-21T23:00:46.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.104+0000 7fd20aa88640 1 -- 172.21.15.181:0/907532136 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd204221d10 con 0x7fd1f4003a00 2024-02-21T23:00:46.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.104+0000 7fd2017fa640 1 -- 172.21.15.181:0/907532136 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fd1f8044020 con 0x7fd1f4003a00 2024-02-21T23:00:46.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.104+0000 7fd2017fa640 1 -- 172.21.15.181:0/907532136 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fd1f803da50 con 0x7fd1f4003a00 2024-02-21T23:00:46.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.105+0000 7fd20aa88640 1 -- 172.21.15.181:0/907532136 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd204066c60 con 0x7fd1f4003a00 2024-02-21T23:00:46.097 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.107+0000 7fd2017fa640 1 -- 172.21.15.181:0/907532136 <== mon.2 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fd1f804b030 con 0x7fd1f4003a00 2024-02-21T23:00:46.122 INFO:tasks.ceph.mgr.z.smithi181.stderr:2024-02-21T23:00:46.133+0000 7fe068a2b040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-02-21T23:00:46.124 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-02-21T23:00:46.135+0000 7f29159b1040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-21T23:00:46.156 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-02-21T23:00:46.166+0000 7fda7b02b040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-02-21T23:00:46.186 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-02-21T23:00:46.197+0000 7f29159b1040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-21T23:00:46.196 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.207+0000 7fd20aa88640 1 -- 172.21.15.181:0/907532136 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd new", "uuid": "58398292-2fe5-4291-94fd-03a0ca29d49d", "id": 1} v 0) v1 -- 0x7fd2040f2a80 con 0x7fd1f4003a00 2024-02-21T23:00:46.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.214+0000 7fd2017fa640 1 -- 172.21.15.181:0/907532136 <== mon.2 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "58398292-2fe5-4291-94fd-03a0ca29d49d", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd1f803dca0 con 0x7fd1f4003a00 2024-02-21T23:00:46.204 INFO:teuthology.orchestra.run.smithi181.stdout:1 2024-02-21T23:00:46.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.215+0000 7fd20aa88640 1 -- 172.21.15.181:0/907532136 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd1f4003a00 msgr2=0x7fd204170eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:46.204 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.215+0000 7fd20aa88640 1 --2- 172.21.15.181:0/907532136 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd1f4003a00 0x7fd204170eb0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd1f8005040 tx=0x7fd1f8001120 comp rx=0 tx=0).stop 2024-02-21T23:00:46.205 INFO:tasks.ceph.mgr.z.smithi181.stderr:2024-02-21T23:00:46.215+0000 7fe068a2b040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-21T23:00:46.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.215+0000 7fd20aa88640 1 -- 172.21.15.181:0/907532136 shutdown_connections 2024-02-21T23:00:46.205 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.215+0000 7fd20aa88640 1 --2- 172.21.15.181:0/907532136 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd20421d260 0x7fd20421d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:46.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.215+0000 7fd20aa88640 1 --2- 172.21.15.181:0/907532136 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd20421f3e0 0x7fd20421f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:46.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.215+0000 7fd20aa88640 1 --2- 172.21.15.181:0/907532136 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd1f4003a00 0x7fd204170eb0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:46.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.215+0000 7fd20aa88640 1 -- 172.21.15.181:0/907532136 >> 172.21.15.181:0/907532136 conn(0x7fd2040ceee0 msgr2=0x7fd2040f63e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:00:46.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.216+0000 7fd20aa88640 1 -- 172.21.15.181:0/907532136 shutdown_connections 2024-02-21T23:00:46.206 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.216+0000 7fd20aa88640 1 -- 172.21.15.181:0/907532136 wait complete. 2024-02-21T23:00:46.215 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --cluster ceph osd new 94cddec1-e08f-438d-a7c8-48a0e47d71a6 2 2024-02-21T23:00:46.226 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-02-21T23:00:46.237+0000 7fda7b02b040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-21T23:00:46.237 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-02-21T23:00:46.248+0000 7f29159b1040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-21T23:00:46.254 INFO:tasks.ceph.mgr.z.smithi181.stderr:2024-02-21T23:00:46.265+0000 7fe068a2b040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-21T23:00:46.273 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-02-21T23:00:46.284+0000 7fda7b02b040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-21T23:00:46.310 INFO:tasks.ceph.mgr.z.smithi181.stderr:2024-02-21T23:00:46.321+0000 7fe068a2b040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-21T23:00:46.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.326+0000 7f513346d640 1 Processor -- start 2024-02-21T23:00:46.315 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.326+0000 7f513346d640 1 -- start start 2024-02-21T23:00:46.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.327+0000 7f513346d640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f512c06aef0 0x7f512c189710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:46.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.327+0000 7f513346d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f512c06b2d0 0x7f512c06b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:46.317 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.327+0000 7f513346d640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f512c188300 con 0x7f512c0f9bd0 2024-02-21T23:00:46.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.327+0000 7f513346d640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f512c1866a0 con 0x7f512c06aef0 2024-02-21T23:00:46.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.327+0000 7f513346d640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f512c0f9180 con 0x7f512c06b2d0 2024-02-21T23:00:46.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.328+0000 7f5130a08640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f512c06b2d0 0x7f512c06b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:46.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.328+0000 7f5130a08640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f512c06b2d0 0x7f512c06b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.181:54720/0 (socket says 172.21.15.181:54720) 2024-02-21T23:00:46.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.328+0000 7f5130a08640 1 -- 172.21.15.181:0/1477141149 learned_addr learned my addr 172.21.15.181:0/1477141149 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-02-21T23:00:46.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.328+0000 7f5131209640 1 --2- 172.21.15.181:0/1477141149 >> v2:172.21.15.99:3300/0 conn(0x7f512c06aef0 0x7f512c189710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:46.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.328+0000 7f5130a08640 1 -- 172.21.15.181:0/1477141149 >> v2:172.21.15.99:3300/0 conn(0x7f512c06aef0 msgr2=0x7f512c189710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:00:46.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.328+0000 7f5130a08640 1 --2- 172.21.15.181:0/1477141149 >> v2:172.21.15.99:3300/0 conn(0x7f512c06aef0 0x7f512c189710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:46.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.328+0000 7f5130a08640 1 -- 172.21.15.181:0/1477141149 >> v1:172.21.15.99:6789/0 conn(0x7f512c0f9bd0 legacy=0x7f512c0fa020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:00:46.318 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.328+0000 7f5130a08640 1 -- 172.21.15.181:0/1477141149 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f512c1885e0 con 0x7f512c06b2d0 2024-02-21T23:00:46.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.329+0000 7f5130a08640 1 --2- 172.21.15.181:0/1477141149 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f512c06b2d0 0x7f512c06b780 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f512c08d260 tx=0x7f512802b7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=53368b1af6f462c2 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:00:46.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.329+0000 7f5123fff640 1 -- 172.21.15.181:0/1477141149 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5128038070 con 0x7f512c06b2d0 2024-02-21T23:00:46.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.329+0000 7f5123fff640 1 -- 172.21.15.181:0/1477141149 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f512802f050 con 0x7f512c06b2d0 2024-02-21T23:00:46.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.329+0000 7f5123fff640 1 -- 172.21.15.181:0/1477141149 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5128031970 con 0x7f512c06b2d0 2024-02-21T23:00:46.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.330+0000 7f513346d640 1 -- 172.21.15.181:0/1477141149 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f512c06b2d0 msgr2=0x7f512c06b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:46.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.330+0000 7f513346d640 1 --2- 172.21.15.181:0/1477141149 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f512c06b2d0 0x7f512c06b780 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f512c08d260 tx=0x7f512802b7f0 comp rx=0 tx=0).stop 2024-02-21T23:00:46.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.330+0000 7f513346d640 1 -- 172.21.15.181:0/1477141149 shutdown_connections 2024-02-21T23:00:46.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.330+0000 7f513346d640 1 --2- 172.21.15.181:0/1477141149 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f512c06b2d0 0x7f512c06b780 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:46.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.330+0000 7f513346d640 1 --2- 172.21.15.181:0/1477141149 >> v2:172.21.15.99:3300/0 conn(0x7f512c06aef0 0x7f512c189710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:46.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.330+0000 7f513346d640 1 -- 172.21.15.181:0/1477141149 >> 172.21.15.181:0/1477141149 conn(0x7f512c0cf750 msgr2=0x7f512c0cfb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:00:46.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.330+0000 7f513346d640 1 -- 172.21.15.181:0/1477141149 shutdown_connections 2024-02-21T23:00:46.320 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.330+0000 7f513346d640 1 -- 172.21.15.181:0/1477141149 wait complete. 2024-02-21T23:00:46.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.331+0000 7f513346d640 1 Processor -- start 2024-02-21T23:00:46.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.331+0000 7f513346d640 1 -- start start 2024-02-21T23:00:46.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.332+0000 7f513346d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f512c06aef0 0x7f512c168690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:46.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.332+0000 7f513346d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f512c06b2d0 0x7f512c06ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:46.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.332+0000 7f513346d640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f512c0f9bd0 0x7f512c0ce3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:46.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.332+0000 7f513346d640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f512c0f93d0 con 0x7f512c0f9bd0 2024-02-21T23:00:46.323 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.332+0000 7f513346d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f512c0f9740 con 0x7f512c06b2d0 2024-02-21T23:00:46.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.332+0000 7f513346d640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f512c06bcc0 con 0x7f512c06aef0 2024-02-21T23:00:46.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.332+0000 7f5131209640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f512c06aef0 0x7f512c168690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:46.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.332+0000 7f5131209640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f512c06aef0 0x7f512c168690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:49310/0 (socket says 172.21.15.181:49310) 2024-02-21T23:00:46.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.332+0000 7f5131209640 1 -- 172.21.15.181:0/610002726 learned_addr learned my addr 172.21.15.181:0/610002726 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-02-21T23:00:46.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.332+0000 7f5130a08640 1 --2- 172.21.15.181:0/610002726 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f512c06b2d0 0x7f512c06ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:46.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.332+0000 7f5131a0a640 1 --2- 172.21.15.181:0/610002726 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f512c0f9bd0 0x7f512c0ce3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:46.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.332+0000 7f5131209640 1 -- 172.21.15.181:0/610002726 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f512c06b2d0 msgr2=0x7f512c06ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:46.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.332+0000 7f5131209640 1 --2- 172.21.15.181:0/610002726 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f512c06b2d0 0x7f512c06ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:46.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.332+0000 7f5131209640 1 -- 172.21.15.181:0/610002726 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f512c0f9bd0 msgr2=0x7f512c0ce3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:46.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.332+0000 7f5131209640 1 --2- 172.21.15.181:0/610002726 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f512c0f9bd0 0x7f512c0ce3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:46.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.333+0000 7f5131209640 1 -- 172.21.15.181:0/610002726 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f512c0cf010 con 0x7f512c06aef0 2024-02-21T23:00:46.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.333+0000 7f5131209640 1 --2- 172.21.15.181:0/610002726 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f512c06aef0 0x7f512c168690 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f511c00d620 tx=0x7f511c00dae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:00:46.324 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.333+0000 7f5121ffb640 1 -- 172.21.15.181:0/610002726 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511c00b620 con 0x7f512c06aef0 2024-02-21T23:00:46.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.333+0000 7f5121ffb640 1 -- 172.21.15.181:0/610002726 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f511c019070 con 0x7f512c06aef0 2024-02-21T23:00:46.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.333+0000 7f513346d640 1 -- 172.21.15.181:0/610002726 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f512c0cf2f0 con 0x7f512c06aef0 2024-02-21T23:00:46.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.333+0000 7f5121ffb640 1 -- 172.21.15.181:0/610002726 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511c00ba00 con 0x7f512c06aef0 2024-02-21T23:00:46.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.333+0000 7f513346d640 1 -- 172.21.15.181:0/610002726 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f512c185310 con 0x7f512c06aef0 2024-02-21T23:00:46.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.333+0000 7f5121ffb640 1 -- 172.21.15.181:0/610002726 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f511c00bba0 con 0x7f512c06aef0 2024-02-21T23:00:46.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.333+0000 7f5121ffb640 1 -- 172.21.15.181:0/610002726 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f511c01e880 con 0x7f512c06aef0 2024-02-21T23:00:46.325 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.334+0000 7f513346d640 1 -- 172.21.15.181:0/610002726 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f512c066c60 con 0x7f512c06aef0 2024-02-21T23:00:46.326 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-02-21T23:00:46.337+0000 7fda7b02b040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-21T23:00:46.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.338+0000 7f5121ffb640 1 -- 172.21.15.181:0/610002726 <== mon.2 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f511c01ea80 con 0x7f512c06aef0 2024-02-21T23:00:46.360 INFO:tasks.ceph.mgr.z.smithi181.stderr:2024-02-21T23:00:46.371+0000 7fe068a2b040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-02-21T23:00:46.369 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-02-21T23:00:46.379+0000 7f29159b1040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-02-21T23:00:46.374 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-02-21T23:00:46.385+0000 7fda7b02b040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-02-21T23:00:46.397 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.408+0000 7f513346d640 1 -- 172.21.15.181:0/610002726 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd new", "uuid": "94cddec1-e08f-438d-a7c8-48a0e47d71a6", "id": 2} v 0) v1 -- 0x7f512c08e210 con 0x7f512c06aef0 2024-02-21T23:00:46.403 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.413+0000 7f5121ffb640 1 -- 172.21.15.181:0/610002726 <== mon.2 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "94cddec1-e08f-438d-a7c8-48a0e47d71a6", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f511c01e460 con 0x7f512c06aef0 2024-02-21T23:00:46.403 INFO:teuthology.orchestra.run.smithi181.stdout:2 2024-02-21T23:00:46.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.414+0000 7f513346d640 1 -- 172.21.15.181:0/610002726 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f512c06aef0 msgr2=0x7f512c168690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:46.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.414+0000 7f513346d640 1 --2- 172.21.15.181:0/610002726 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f512c06aef0 0x7f512c168690 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f511c00d620 tx=0x7f511c00dae0 comp rx=0 tx=0).stop 2024-02-21T23:00:46.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.414+0000 7f513346d640 1 -- 172.21.15.181:0/610002726 shutdown_connections 2024-02-21T23:00:46.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.414+0000 7f513346d640 1 --2- 172.21.15.181:0/610002726 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f512c0f9bd0 0x7f512c0ce3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:46.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.414+0000 7f513346d640 1 --2- 172.21.15.181:0/610002726 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f512c06b2d0 0x7f512c06ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:46.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.414+0000 7f513346d640 1 --2- 172.21.15.181:0/610002726 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f512c06aef0 0x7f512c168690 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:46.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.415+0000 7f513346d640 1 -- 172.21.15.181:0/610002726 >> 172.21.15.181:0/610002726 conn(0x7f512c0cf750 msgr2=0x7f512c0ee120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:00:46.404 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.415+0000 7f513346d640 1 -- 172.21.15.181:0/610002726 shutdown_connections 2024-02-21T23:00:46.405 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.415+0000 7f513346d640 1 -- 172.21.15.181:0/610002726 wait complete. 2024-02-21T23:00:46.414 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --cluster ceph osd new d29abb74-9b89-4fd7-88b1-7c2eb8231189 3 2024-02-21T23:00:46.449 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-02-21T23:00:46.460+0000 7f29159b1040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-21T23:00:46.503 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-02-21T23:00:46.513+0000 7f29159b1040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-21T23:00:46.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.567+0000 7f324b476640 1 Processor -- start 2024-02-21T23:00:46.556 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.567+0000 7f324b476640 1 -- start start 2024-02-21T23:00:46.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.568+0000 7f324b476640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f3244180d80 0x7f32440f5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:46.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.568+0000 7f324b476640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f32440728f0 0x7f3244072d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:46.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.568+0000 7f324b476640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32440f6500 con 0x7f324406f4b0 2024-02-21T23:00:46.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.568+0000 7f324b476640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32440f67e0 con 0x7f32440728f0 2024-02-21T23:00:46.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.568+0000 7f324b476640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32440f6ac0 con 0x7f3244180d80 2024-02-21T23:00:46.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.568+0000 7f3249212640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f3244180d80 0x7f32440f5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:46.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.568+0000 7f3249212640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f3244180d80 0x7f32440f5ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:49314/0 (socket says 172.21.15.181:49314) 2024-02-21T23:00:46.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.568+0000 7f3249212640 1 -- 172.21.15.181:0/1853795395 learned_addr learned my addr 172.21.15.181:0/1853795395 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-02-21T23:00:46.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.568+0000 7f3248a11640 1 --1- 172.21.15.181:0/1853795395 >> v1:172.21.15.181:6789/0 conn(0x7f324406f4b0 0x7f324406f930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:43480/0 (socket says 172.21.15.181:43480) 2024-02-21T23:00:46.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.568+0000 7f3249a13640 1 --2- 172.21.15.181:0/1853795395 >> v2:172.21.15.162:3300/0 conn(0x7f32440728f0 0x7f3244072d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:46.559 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.569+0000 7f3249212640 1 -- 172.21.15.181:0/1853795395 >> v2:172.21.15.162:3300/0 conn(0x7f32440728f0 msgr2=0x7f3244072d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:00:46.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.569+0000 7f3249212640 1 --2- 172.21.15.181:0/1853795395 >> v2:172.21.15.162:3300/0 conn(0x7f32440728f0 0x7f3244072d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:46.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.569+0000 7f3249212640 1 -- 172.21.15.181:0/1853795395 >> v1:172.21.15.181:6789/0 conn(0x7f324406f4b0 legacy=0x7f324406f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:46.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.569+0000 7f323bfff640 1 -- 172.21.15.181:0/1853795395 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3771238976 0 0) 0x7f32440f6500 con 0x7f324406f4b0 2024-02-21T23:00:46.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.569+0000 7f3249212640 1 -- 172.21.15.181:0/1853795395 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32440f6da0 con 0x7f3244180d80 2024-02-21T23:00:46.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.569+0000 7f3249a13640 1 --2- 172.21.15.181:0/1853795395 >> v2:172.21.15.162:3300/0 conn(0x7f32440728f0 0x7f3244072d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:00:46.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.569+0000 7f3249212640 1 --2- 172.21.15.181:0/1853795395 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3244180d80 0x7f32440f5ca0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f32440d0830 tx=0x7f323402b880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d23f368a1f31ca0a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:00:46.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.570+0000 7f323bfff640 1 -- 172.21.15.181:0/1853795395 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f323402e070 con 0x7f3244180d80 2024-02-21T23:00:46.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.570+0000 7f323bfff640 1 -- 172.21.15.181:0/1853795395 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3234037070 con 0x7f3244180d80 2024-02-21T23:00:46.560 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.570+0000 7f323bfff640 1 -- 172.21.15.181:0/1853795395 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3234031a00 con 0x7f3244180d80 2024-02-21T23:00:46.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.570+0000 7f324b476640 1 -- 172.21.15.181:0/1853795395 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3244180d80 msgr2=0x7f32440f5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:46.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.570+0000 7f324b476640 1 --2- 172.21.15.181:0/1853795395 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3244180d80 0x7f32440f5ca0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f32440d0830 tx=0x7f323402b880 comp rx=0 tx=0).stop 2024-02-21T23:00:46.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.570+0000 7f324b476640 1 -- 172.21.15.181:0/1853795395 shutdown_connections 2024-02-21T23:00:46.561 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.570+0000 7f324b476640 1 --2- 172.21.15.181:0/1853795395 >> v2:172.21.15.162:3300/0 conn(0x7f32440728f0 0x7f3244072d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:46.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.570+0000 7f324b476640 1 --2- 172.21.15.181:0/1853795395 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3244180d80 0x7f32440f5ca0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:46.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.570+0000 7f324b476640 1 -- 172.21.15.181:0/1853795395 >> 172.21.15.181:0/1853795395 conn(0x7f32440cf7f0 msgr2=0x7f32440cfc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:00:46.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.570+0000 7f324b476640 1 -- 172.21.15.181:0/1853795395 shutdown_connections 2024-02-21T23:00:46.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.570+0000 7f324b476640 1 -- 172.21.15.181:0/1853795395 wait complete. 2024-02-21T23:00:46.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.572+0000 7f324b476640 1 Processor -- start 2024-02-21T23:00:46.562 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.572+0000 7f324b476640 1 -- start start 2024-02-21T23:00:46.564 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.573+0000 7f324b476640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f324406f4b0 0x7f32441661a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:46.564 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.573+0000 7f324b476640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32440728f0 0x7f32441666e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:46.564 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.573+0000 7f324b476640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3244180d80 0x7f324408dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:46.564 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.573+0000 7f324b476640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32440f61e0 con 0x7f3244180d80 2024-02-21T23:00:46.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.573+0000 7f324b476640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32440f7360 con 0x7f32440728f0 2024-02-21T23:00:46.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.573+0000 7f324b476640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3244070040 con 0x7f324406f4b0 2024-02-21T23:00:46.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.573+0000 7f3249212640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f324406f4b0 0x7f32441661a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:46.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.573+0000 7f3249212640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f324406f4b0 0x7f32441661a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:49324/0 (socket says 172.21.15.181:49324) 2024-02-21T23:00:46.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.573+0000 7f3249212640 1 -- 172.21.15.181:0/2553383745 learned_addr learned my addr 172.21.15.181:0/2553383745 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-02-21T23:00:46.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.573+0000 7f3248a11640 1 --2- 172.21.15.181:0/2553383745 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32440728f0 0x7f32441666e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:46.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.573+0000 7f3249212640 1 -- 172.21.15.181:0/2553383745 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32440728f0 msgr2=0x7f32441666e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:46.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.573+0000 7f3249212640 1 --2- 172.21.15.181:0/2553383745 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32440728f0 0x7f32441666e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:46.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.573+0000 7f3249212640 1 -- 172.21.15.181:0/2553383745 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3244180d80 msgr2=0x7f324408dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:46.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.573+0000 7f3249212640 1 --2- 172.21.15.181:0/2553383745 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3244180d80 0x7f324408dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:46.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.573+0000 7f3249212640 1 -- 172.21.15.181:0/2553383745 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f324416df70 con 0x7f324406f4b0 2024-02-21T23:00:46.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.573+0000 7f3249212640 1 --2- 172.21.15.181:0/2553383745 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f324406f4b0 0x7f32441661a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3234000c00 tx=0x7f32340046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:00:46.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.573+0000 7f3239ffb640 1 -- 172.21.15.181:0/2553383745 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3234032670 con 0x7f324406f4b0 2024-02-21T23:00:46.565 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.573+0000 7f3239ffb640 1 -- 172.21.15.181:0/2553383745 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3234032850 con 0x7f324406f4b0 2024-02-21T23:00:46.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.574+0000 7f324b476640 1 -- 172.21.15.181:0/2553383745 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f324416e250 con 0x7f324406f4b0 2024-02-21T23:00:46.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.574+0000 7f3239ffb640 1 -- 172.21.15.181:0/2553383745 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3234032c40 con 0x7f324406f4b0 2024-02-21T23:00:46.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.574+0000 7f324b476640 1 -- 172.21.15.181:0/2553383745 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f324416e810 con 0x7f324406f4b0 2024-02-21T23:00:46.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.574+0000 7f3239ffb640 1 -- 172.21.15.181:0/2553383745 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f323404c060 con 0x7f324406f4b0 2024-02-21T23:00:46.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.574+0000 7f3239ffb640 1 -- 172.21.15.181:0/2553383745 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f3234045920 con 0x7f324406f4b0 2024-02-21T23:00:46.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.575+0000 7f324b476640 1 -- 172.21.15.181:0/2553383745 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3244066c60 con 0x7f324406f4b0 2024-02-21T23:00:46.566 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-02-21T23:00:46.575+0000 7f29159b1040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-21T23:00:46.566 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.577+0000 7f3239ffb640 1 -- 172.21.15.181:0/2553383745 <== mon.2 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f3234064dd0 con 0x7f324406f4b0 2024-02-21T23:00:46.620 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-02-21T23:00:46.630+0000 7f29159b1040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-02-21T23:00:46.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.649+0000 7f324b476640 1 -- 172.21.15.181:0/2553383745 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d29abb74-9b89-4fd7-88b1-7c2eb8231189", "id": 3} v 0) v1 -- 0x7f32440cd070 con 0x7f324406f4b0 2024-02-21T23:00:46.644 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.654+0000 7f3239ffb640 1 -- 172.21.15.181:0/2553383745 <== mon.2 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d29abb74-9b89-4fd7-88b1-7c2eb8231189", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3234053030 con 0x7f324406f4b0 2024-02-21T23:00:46.644 INFO:teuthology.orchestra.run.smithi181.stdout:3 2024-02-21T23:00:46.645 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.655+0000 7f324b476640 1 -- 172.21.15.181:0/2553383745 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f324406f4b0 msgr2=0x7f32441661a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:46.645 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.655+0000 7f324b476640 1 --2- 172.21.15.181:0/2553383745 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f324406f4b0 0x7f32441661a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3234000c00 tx=0x7f32340046c0 comp rx=0 tx=0).stop 2024-02-21T23:00:46.645 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.655+0000 7f324b476640 1 -- 172.21.15.181:0/2553383745 shutdown_connections 2024-02-21T23:00:46.646 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.656+0000 7f324b476640 1 --2- 172.21.15.181:0/2553383745 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3244180d80 0x7f324408dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:46.646 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.656+0000 7f324b476640 1 --2- 172.21.15.181:0/2553383745 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32440728f0 0x7f32441666e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:46.646 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.656+0000 7f324b476640 1 --2- 172.21.15.181:0/2553383745 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f324406f4b0 0x7f32441661a0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:46.646 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.656+0000 7f324b476640 1 -- 172.21.15.181:0/2553383745 >> 172.21.15.181:0/2553383745 conn(0x7f32440cf7f0 msgr2=0x7f32440cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:00:46.646 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.656+0000 7f324b476640 1 -- 172.21.15.181:0/2553383745 shutdown_connections 2024-02-21T23:00:46.646 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.656+0000 7f324b476640 1 -- 172.21.15.181:0/2553383745 wait complete. 2024-02-21T23:00:46.655 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --cluster ceph osd new 0d8c9ea3-880a-4d69-9dcb-cf7d35abd449 4 2024-02-21T23:00:46.756 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-02-21T23:00:46.767+0000 7fda7b02b040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-21T23:00:46.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.767+0000 7fc47cec8640 1 Processor -- start 2024-02-21T23:00:46.757 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.767+0000 7fc47cec8640 1 -- start start 2024-02-21T23:00:46.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.768+0000 7fc47cec8640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc4781866c0 0x7fc478189350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:46.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.768+0000 7fc47cec8640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fc478189890 0x7fc4780f23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:46.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.768+0000 7fc47cec8640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc478186aa0 con 0x7fc4780f2930 2024-02-21T23:00:46.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.768+0000 7fc47cec8640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4780f4000 con 0x7fc4781866c0 2024-02-21T23:00:46.760 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.768+0000 7fc47cec8640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4780f3110 con 0x7fc478189890 2024-02-21T23:00:46.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.768+0000 7fc46ffff640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fc478189890 0x7fc4780f23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:46.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.769+0000 7fc46ffff640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fc478189890 0x7fc4780f23f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:49328/0 (socket says 172.21.15.181:49328) 2024-02-21T23:00:46.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.769+0000 7fc46ffff640 1 -- 172.21.15.181:0/3405689277 learned_addr learned my addr 172.21.15.181:0/3405689277 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-02-21T23:00:46.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.769+0000 7fc47659c640 1 --2- 172.21.15.181:0/3405689277 >> v2:172.21.15.162:3300/0 conn(0x7fc4781866c0 0x7fc478189350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:46.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.769+0000 7fc46ffff640 1 -- 172.21.15.181:0/3405689277 >> v2:172.21.15.162:3300/0 conn(0x7fc4781866c0 msgr2=0x7fc478189350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:00:46.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.769+0000 7fc46ffff640 1 --2- 172.21.15.181:0/3405689277 >> v2:172.21.15.162:3300/0 conn(0x7fc4781866c0 0x7fc478189350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:46.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.769+0000 7fc46ffff640 1 -- 172.21.15.181:0/3405689277 >> v1:172.21.15.162:6789/0 conn(0x7fc4780f2930 legacy=0x7fc47818a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:46.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.769+0000 7fc46ffff640 1 -- 172.21.15.181:0/3405689277 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4780f33f0 con 0x7fc478189890 2024-02-21T23:00:46.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.769+0000 7fc475d9b640 1 -- 172.21.15.181:0/3405689277 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2253500567 0 0) 0x7fc478186aa0 con 0x7fc4780f2930 2024-02-21T23:00:46.761 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.770+0000 7fc46ffff640 1 --2- 172.21.15.181:0/3405689277 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc478189890 0x7fc4780f23f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc4780f4740 tx=0x7fc46002b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f8332283e98a1c7 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:00:46.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.770+0000 7fc475d9b640 1 -- 172.21.15.181:0/3405689277 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc460035020 con 0x7fc478189890 2024-02-21T23:00:46.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.770+0000 7fc475d9b640 1 -- 172.21.15.181:0/3405689277 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc460031870 con 0x7fc478189890 2024-02-21T23:00:46.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.770+0000 7fc475d9b640 1 -- 172.21.15.181:0/3405689277 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc460031c40 con 0x7fc478189890 2024-02-21T23:00:46.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.770+0000 7fc47cec8640 1 -- 172.21.15.181:0/3405689277 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc478189890 msgr2=0x7fc4780f23f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:46.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.770+0000 7fc47cec8640 1 --2- 172.21.15.181:0/3405689277 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc478189890 0x7fc4780f23f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc4780f4740 tx=0x7fc46002b910 comp rx=0 tx=0).stop 2024-02-21T23:00:46.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.770+0000 7fc47cec8640 1 -- 172.21.15.181:0/3405689277 shutdown_connections 2024-02-21T23:00:46.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.770+0000 7fc47cec8640 1 --2- 172.21.15.181:0/3405689277 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc478189890 0x7fc4780f23f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:46.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.770+0000 7fc47cec8640 1 --2- 172.21.15.181:0/3405689277 >> v2:172.21.15.162:3300/0 conn(0x7fc4781866c0 0x7fc478189350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:46.762 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.770+0000 7fc47cec8640 1 -- 172.21.15.181:0/3405689277 >> 172.21.15.181:0/3405689277 conn(0x7fc4780f7490 msgr2=0x7fc4780f78a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:00:46.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.770+0000 7fc47cec8640 1 -- 172.21.15.181:0/3405689277 shutdown_connections 2024-02-21T23:00:46.763 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.770+0000 7fc47cec8640 1 -- 172.21.15.181:0/3405689277 wait complete. 2024-02-21T23:00:46.763 INFO:tasks.ceph.mgr.z.smithi181.stderr:2024-02-21T23:00:46.771+0000 7fe068a2b040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-21T23:00:46.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.772+0000 7fc47cec8640 1 Processor -- start 2024-02-21T23:00:46.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.772+0000 7fc47cec8640 1 -- start start 2024-02-21T23:00:46.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.773+0000 7fc47cec8640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc4780f2930 0x7fc478178b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:46.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.773+0000 7fc47cec8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc4781866c0 0x7fc47818b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:46.766 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.773+0000 7fc47cec8640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc478189890 0x7fc47818b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:46.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.773+0000 7fc47cec8640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4780f3c90 con 0x7fc4780f2930 2024-02-21T23:00:46.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.773+0000 7fc47cec8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4780f39b0 con 0x7fc4781866c0 2024-02-21T23:00:46.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.773+0000 7fc47cec8640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc478189d20 con 0x7fc478189890 2024-02-21T23:00:46.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.773+0000 7fc476d9d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc478189890 0x7fc47818b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:46.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.773+0000 7fc476d9d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc478189890 0x7fc47818b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:49344/0 (socket says 172.21.15.181:49344) 2024-02-21T23:00:46.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.773+0000 7fc476d9d640 1 -- 172.21.15.181:0/283674487 learned_addr learned my addr 172.21.15.181:0/283674487 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-02-21T23:00:46.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.773+0000 7fc46ffff640 1 --2- 172.21.15.181:0/283674487 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc4781866c0 0x7fc47818b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:46.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.774+0000 7fc476d9d640 1 -- 172.21.15.181:0/283674487 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc4781866c0 msgr2=0x7fc47818b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:46.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.774+0000 7fc476d9d640 1 --2- 172.21.15.181:0/283674487 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc4781866c0 0x7fc47818b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:46.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.774+0000 7fc476d9d640 1 -- 172.21.15.181:0/283674487 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc4780f2930 msgr2=0x7fc478178b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:46.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.774+0000 7fc476d9d640 1 --2- 172.21.15.181:0/283674487 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc4780f2930 0x7fc478178b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:46.767 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.774+0000 7fc476d9d640 1 -- 172.21.15.181:0/283674487 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc47818c010 con 0x7fc478189890 2024-02-21T23:00:46.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.774+0000 7fc46ffff640 1 --2- 172.21.15.181:0/283674487 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc4781866c0 0x7fc47818b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:00:46.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.774+0000 7fc476d9d640 1 --2- 172.21.15.181:0/283674487 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc478189890 0x7fc47818b9d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc47000c780 tx=0x7fc47000cb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:00:46.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.774+0000 7fc46effd640 1 -- 172.21.15.181:0/283674487 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc470003b70 con 0x7fc478189890 2024-02-21T23:00:46.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.774+0000 7fc46effd640 1 -- 172.21.15.181:0/283674487 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc470003d10 con 0x7fc478189890 2024-02-21T23:00:46.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.774+0000 7fc47cec8640 1 -- 172.21.15.181:0/283674487 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc47818c2f0 con 0x7fc478189890 2024-02-21T23:00:46.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.774+0000 7fc46effd640 1 -- 172.21.15.181:0/283674487 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc470005270 con 0x7fc478189890 2024-02-21T23:00:46.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.774+0000 7fc47cec8640 1 -- 172.21.15.181:0/283674487 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4780cce40 con 0x7fc478189890 2024-02-21T23:00:46.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.775+0000 7fc47cec8640 1 -- 172.21.15.181:0/283674487 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc478066c60 con 0x7fc478189890 2024-02-21T23:00:46.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.775+0000 7fc46effd640 1 -- 172.21.15.181:0/283674487 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fc470005410 con 0x7fc478189890 2024-02-21T23:00:46.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.775+0000 7fc46effd640 1 -- 172.21.15.181:0/283674487 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fc47001b960 con 0x7fc478189890 2024-02-21T23:00:46.768 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.777+0000 7fc46effd640 1 -- 172.21.15.181:0/283674487 <== mon.2 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fc470005700 con 0x7fc478189890 2024-02-21T23:00:46.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.850+0000 7fc47cec8640 1 -- 172.21.15.181:0/283674487 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0d8c9ea3-880a-4d69-9dcb-cf7d35abd449", "id": 4} v 0) v1 -- 0x7fc4781799f0 con 0x7fc478189890 2024-02-21T23:00:46.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.854+0000 7fc46effd640 1 -- 172.21.15.181:0/283674487 <== mon.2 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0d8c9ea3-880a-4d69-9dcb-cf7d35abd449", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc47001bcf0 con 0x7fc478189890 2024-02-21T23:00:46.844 INFO:teuthology.orchestra.run.smithi181.stdout:4 2024-02-21T23:00:46.844 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.855+0000 7fc47cec8640 1 -- 172.21.15.181:0/283674487 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc478189890 msgr2=0x7fc47818b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:46.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.855+0000 7fc47cec8640 1 --2- 172.21.15.181:0/283674487 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc478189890 0x7fc47818b9d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc47000c780 tx=0x7fc47000cb80 comp rx=0 tx=0).stop 2024-02-21T23:00:46.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.855+0000 7fc47cec8640 1 -- 172.21.15.181:0/283674487 shutdown_connections 2024-02-21T23:00:46.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.855+0000 7fc47cec8640 1 --2- 172.21.15.181:0/283674487 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc478189890 0x7fc47818b9d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:46.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.855+0000 7fc47cec8640 1 --2- 172.21.15.181:0/283674487 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc4781866c0 0x7fc47818b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:46.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.855+0000 7fc47cec8640 1 --2- 172.21.15.181:0/283674487 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc4780f2930 0x7fc478178b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:46.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.855+0000 7fc47cec8640 1 -- 172.21.15.181:0/283674487 >> 172.21.15.181:0/283674487 conn(0x7fc4780f7490 msgr2=0x7fc4780f7870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:00:46.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.855+0000 7fc47cec8640 1 -- 172.21.15.181:0/283674487 shutdown_connections 2024-02-21T23:00:46.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.855+0000 7fc47cec8640 1 -- 172.21.15.181:0/283674487 wait complete. 2024-02-21T23:00:46.855 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --cluster ceph osd new 2e3a9340-6fd0-4d7a-8e00-fe305649296e 5 2024-02-21T23:00:46.892 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-02-21T23:00:46.902+0000 7fda7b02b040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-21T23:00:46.904 INFO:tasks.ceph.mgr.z.smithi181.stderr:2024-02-21T23:00:46.915+0000 7fe068a2b040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-21T23:00:46.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.966+0000 7f498fade640 1 Processor -- start 2024-02-21T23:00:46.955 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.966+0000 7f498fade640 1 -- start start 2024-02-21T23:00:46.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.967+0000 7f498fade640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f4988184150 0x7f49880f7050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:46.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.967+0000 7f498fade640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f49880719a0 0x7f49881869d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:46.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.967+0000 7f498fade640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49880f5cd0 con 0x7f4988186f10 2024-02-21T23:00:46.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.967+0000 7f498fade640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49880f6bc0 con 0x7f4988184150 2024-02-21T23:00:46.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.967+0000 7f498fade640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49880f7590 con 0x7f49880719a0 2024-02-21T23:00:46.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.967+0000 7f498d079640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f49880719a0 0x7f49881869d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:46.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.967+0000 7f498d079640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f49880719a0 0x7f49881869d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:49346/0 (socket says 172.21.15.181:49346) 2024-02-21T23:00:46.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.967+0000 7f498d079640 1 -- 172.21.15.181:0/1930472462 learned_addr learned my addr 172.21.15.181:0/1930472462 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-02-21T23:00:46.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.967+0000 7f498d079640 1 -- 172.21.15.181:0/1930472462 >> v2:172.21.15.99:3300/0 conn(0x7f4988184150 msgr2=0x7f49880f7050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:00:46.957 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.967+0000 7f498d079640 1 --2- 172.21.15.181:0/1930472462 >> v2:172.21.15.99:3300/0 conn(0x7f4988184150 0x7f49880f7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:46.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.967+0000 7f498d079640 1 -- 172.21.15.181:0/1930472462 >> v1:172.21.15.162:6789/0 conn(0x7f4988186f10 legacy=0x7f49881873a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:46.958 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.967+0000 7f498d079640 1 -- 172.21.15.181:0/1930472462 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49880f5fb0 con 0x7f49880719a0 2024-02-21T23:00:46.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.968+0000 7f498d079640 1 --2- 172.21.15.181:0/1930472462 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f49880719a0 0x7f49881869d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f498806b6e0 tx=0x7f497802b9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd77eeef43f2c155 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:00:46.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.968+0000 7f498c878640 1 -- 172.21.15.181:0/1930472462 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4978034070 con 0x7f49880719a0 2024-02-21T23:00:46.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.968+0000 7f498c878640 1 -- 172.21.15.181:0/1930472462 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4978030860 con 0x7f49880719a0 2024-02-21T23:00:46.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.968+0000 7f498c878640 1 -- 172.21.15.181:0/1930472462 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4978030c30 con 0x7f49880719a0 2024-02-21T23:00:46.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.969+0000 7f498fade640 1 -- 172.21.15.181:0/1930472462 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f49880719a0 msgr2=0x7f49881869d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:46.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.969+0000 7f498fade640 1 --2- 172.21.15.181:0/1930472462 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f49880719a0 0x7f49881869d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f498806b6e0 tx=0x7f497802b9a0 comp rx=0 tx=0).stop 2024-02-21T23:00:46.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.969+0000 7f498fade640 1 -- 172.21.15.181:0/1930472462 shutdown_connections 2024-02-21T23:00:46.959 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.969+0000 7f498fade640 1 --2- 172.21.15.181:0/1930472462 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f49880719a0 0x7f49881869d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:46.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.969+0000 7f498fade640 1 --2- 172.21.15.181:0/1930472462 >> v2:172.21.15.99:3300/0 conn(0x7f4988184150 0x7f49880f7050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:46.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.969+0000 7f498fade640 1 -- 172.21.15.181:0/1930472462 >> 172.21.15.181:0/1930472462 conn(0x7f49880cf780 msgr2=0x7f49880cfb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:00:46.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.969+0000 7f498fade640 1 -- 172.21.15.181:0/1930472462 shutdown_connections 2024-02-21T23:00:46.960 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.969+0000 7f498fade640 1 -- 172.21.15.181:0/1930472462 wait complete. 2024-02-21T23:00:46.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.970+0000 7f498fade640 1 Processor -- start 2024-02-21T23:00:46.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.971+0000 7f498fade640 1 -- start start 2024-02-21T23:00:46.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.971+0000 7f498fade640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f49880719a0 0x7f49880c9730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:46.962 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.971+0000 7f498fade640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4988184150 0x7f4988182820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:46.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.971+0000 7f498fade640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4988186f10 0x7f4988180ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:46.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.971+0000 7f498fade640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49880f6850 con 0x7f4988186f10 2024-02-21T23:00:46.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.971+0000 7f498fade640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49880f6570 con 0x7f4988184150 2024-02-21T23:00:46.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.971+0000 7f498fade640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49880709b0 con 0x7f49880719a0 2024-02-21T23:00:46.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.972+0000 7f498d87a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f49880719a0 0x7f49880c9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:46.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.972+0000 7f498d87a640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f49880719a0 0x7f49880c9730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:49358/0 (socket says 172.21.15.181:49358) 2024-02-21T23:00:46.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.972+0000 7f498d87a640 1 -- 172.21.15.181:0/2371932432 learned_addr learned my addr 172.21.15.181:0/2371932432 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-02-21T23:00:46.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.972+0000 7f498d079640 1 --2- 172.21.15.181:0/2371932432 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4988184150 0x7f4988182820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:46.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.972+0000 7f498d87a640 1 -- 172.21.15.181:0/2371932432 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4988184150 msgr2=0x7f4988182820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:46.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.972+0000 7f498d87a640 1 --2- 172.21.15.181:0/2371932432 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4988184150 0x7f4988182820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:46.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.972+0000 7f498d87a640 1 -- 172.21.15.181:0/2371932432 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4988186f10 msgr2=0x7f4988180ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:46.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.972+0000 7f498d87a640 1 --2- 172.21.15.181:0/2371932432 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4988186f10 0x7f4988180ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:46.963 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.972+0000 7f498d87a640 1 -- 172.21.15.181:0/2371932432 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49881802f0 con 0x7f49880719a0 2024-02-21T23:00:46.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.972+0000 7f498d079640 1 --2- 172.21.15.181:0/2371932432 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4988184150 0x7f4988182820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:00:46.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.972+0000 7f498d87a640 1 --2- 172.21.15.181:0/2371932432 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f49880719a0 0x7f49880c9730 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f498400b410 tx=0x7f498400b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:00:46.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.972+0000 7f497e7fc640 1 -- 172.21.15.181:0/2371932432 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4984015020 con 0x7f49880719a0 2024-02-21T23:00:46.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.972+0000 7f497e7fc640 1 -- 172.21.15.181:0/2371932432 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4984011850 con 0x7f49880719a0 2024-02-21T23:00:46.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.972+0000 7f498fade640 1 -- 172.21.15.181:0/2371932432 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4988182f80 con 0x7f49880719a0 2024-02-21T23:00:46.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.972+0000 7f497e7fc640 1 -- 172.21.15.181:0/2371932432 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4984011c40 con 0x7f49880719a0 2024-02-21T23:00:46.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.972+0000 7f498fade640 1 -- 172.21.15.181:0/2371932432 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4988183540 con 0x7f49880719a0 2024-02-21T23:00:46.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.972+0000 7f497e7fc640 1 -- 172.21.15.181:0/2371932432 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f4984018020 con 0x7f49880719a0 2024-02-21T23:00:46.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.972+0000 7f497e7fc640 1 -- 172.21.15.181:0/2371932432 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f4984019ca0 con 0x7f49880719a0 2024-02-21T23:00:46.964 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.973+0000 7f498fade640 1 -- 172.21.15.181:0/2371932432 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49880f8e80 con 0x7f49880719a0 2024-02-21T23:00:46.965 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:46.975+0000 7f497e7fc640 1 -- 172.21.15.181:0/2371932432 <== mon.2 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f49880f8e80 con 0x7f49880719a0 2024-02-21T23:00:47.016 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-02-21T23:00:47.027+0000 7fda7b02b040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-21T23:00:47.033 INFO:tasks.ceph.mgr.z.smithi181.stderr:2024-02-21T23:00:47.044+0000 7fe068a2b040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-21T23:00:47.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.048+0000 7f498fade640 1 -- 172.21.15.181:0/2371932432 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2e3a9340-6fd0-4d7a-8e00-fe305649296e", "id": 5} v 0) v1 -- 0x7f4988066c60 con 0x7f49880719a0 2024-02-21T23:00:47.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.052+0000 7f497e7fc640 1 -- 172.21.15.181:0/2371932432 <== mon.2 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2e3a9340-6fd0-4d7a-8e00-fe305649296e", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f498401f020 con 0x7f49880719a0 2024-02-21T23:00:47.042 INFO:teuthology.orchestra.run.smithi181.stdout:5 2024-02-21T23:00:47.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.053+0000 7f498fade640 1 -- 172.21.15.181:0/2371932432 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f49880719a0 msgr2=0x7f49880c9730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:47.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.053+0000 7f498fade640 1 --2- 172.21.15.181:0/2371932432 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f49880719a0 0x7f49880c9730 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f498400b410 tx=0x7f498400b8d0 comp rx=0 tx=0).stop 2024-02-21T23:00:47.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.053+0000 7f498fade640 1 -- 172.21.15.181:0/2371932432 shutdown_connections 2024-02-21T23:00:47.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.053+0000 7f498fade640 1 --2- 172.21.15.181:0/2371932432 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4988186f10 0x7f4988180ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:47.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.053+0000 7f498fade640 1 --2- 172.21.15.181:0/2371932432 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4988184150 0x7f4988182820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:47.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.053+0000 7f498fade640 1 --2- 172.21.15.181:0/2371932432 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f49880719a0 0x7f49880c9730 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:47.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.053+0000 7f498fade640 1 -- 172.21.15.181:0/2371932432 >> 172.21.15.181:0/2371932432 conn(0x7f49880cf780 msgr2=0x7f498808cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:00:47.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.053+0000 7f498fade640 1 -- 172.21.15.181:0/2371932432 shutdown_connections 2024-02-21T23:00:47.043 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.053+0000 7f498fade640 1 -- 172.21.15.181:0/2371932432 wait complete. 2024-02-21T23:00:47.053 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --cluster ceph osd new d9e37ce7-1b0e-4019-8f2e-b670403abf7e 6 2024-02-21T23:00:47.063 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-02-21T23:00:47.074+0000 7fda7b02b040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-21T23:00:47.072 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-02-21T23:00:47.083+0000 7f29159b1040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-21T23:00:47.084 INFO:tasks.ceph.mgr.z.smithi181.stderr:2024-02-21T23:00:47.095+0000 7fe068a2b040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-21T23:00:47.152 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.163+0000 7f6279ed5640 1 Processor -- start 2024-02-21T23:00:47.152 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.163+0000 7f6279ed5640 1 -- start start 2024-02-21T23:00:47.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.164+0000 7f6279ed5640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f627417fc10 0x7f6274071b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:47.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.164+0000 7f6279ed5640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f627406f630 con 0x7f62741870b0 2024-02-21T23:00:47.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.164+0000 7f6279ed5640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6274072440 con 0x7f6274185ae0 2024-02-21T23:00:47.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.164+0000 7f6279ed5640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f627417fff0 con 0x7f627417fc10 2024-02-21T23:00:47.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.165+0000 7f6273fff640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f6274185ae0 0x7f6274185f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.181:58748/0 (socket says 172.21.15.181:58748) 2024-02-21T23:00:47.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.165+0000 7f6273fff640 1 -- 172.21.15.181:0/3365062448 learned_addr learned my addr 172.21.15.181:0/3365062448 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-02-21T23:00:47.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.165+0000 7f62737fe640 1 --2- 172.21.15.181:0/3365062448 >> v2:172.21.15.99:3300/0 conn(0x7f627417fc10 0x7f6274071b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:47.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.165+0000 7f62727fc640 1 -- 172.21.15.181:0/3365062448 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3286447420 0 0) 0x7f6274072440 con 0x7f6274185ae0 2024-02-21T23:00:47.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.165+0000 7f62727fc640 1 -- 172.21.15.181:0/3365062448 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f625c003520 con 0x7f6274185ae0 2024-02-21T23:00:47.157 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.165+0000 7f62727fc640 1 -- 172.21.15.181:0/3365062448 <== mon.1 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 556562756 0 0) 0x7f625c003520 con 0x7f6274185ae0 2024-02-21T23:00:47.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.165+0000 7f62727fc640 1 -- 172.21.15.181:0/3365062448 >> v2:172.21.15.99:3300/0 conn(0x7f627417fc10 msgr2=0x7f6274071b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:00:47.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.165+0000 7f62727fc640 1 --2- 172.21.15.181:0/3365062448 >> v2:172.21.15.99:3300/0 conn(0x7f627417fc10 0x7f6274071b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:47.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.165+0000 7f62727fc640 1 -- 172.21.15.181:0/3365062448 >> v1:172.21.15.99:6789/0 conn(0x7f62741870b0 legacy=0x7f6274187560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:00:47.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.165+0000 7f62727fc640 1 -- 172.21.15.181:0/3365062448 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6274072720 con 0x7f6274185ae0 2024-02-21T23:00:47.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.165+0000 7f62727fc640 1 -- 172.21.15.181:0/3365062448 <== mon.1 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2069890144 0 0) 0x7f626c001670 con 0x7f6274185ae0 2024-02-21T23:00:47.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.165+0000 7f62727fc640 1 -- 172.21.15.181:0/3365062448 >> v1:172.21.15.162:6789/0 conn(0x7f6274185ae0 legacy=0x7f6274185f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:47.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.165+0000 7f62727fc640 1 --2- 172.21.15.181:0/3365062448 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f625c003a00 0x7f625c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:47.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.165+0000 7f62727fc640 1 --2- 172.21.15.181:0/3365062448 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f625c004800 0x7f625c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:47.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.165+0000 7f62727fc640 1 --2- 172.21.15.181:0/3365062448 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f625c0053c0 0x7f625c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:47.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.165+0000 7f62727fc640 1 -- 172.21.15.181:0/3365062448 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f627417fff0 con 0x7f625c003a00 2024-02-21T23:00:47.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.165+0000 7f62727fc640 1 -- 172.21.15.181:0/3365062448 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f625c00c280 con 0x7f625c004800 2024-02-21T23:00:47.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.165+0000 7f62727fc640 1 -- 172.21.15.181:0/3365062448 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f625c00c480 con 0x7f625c0053c0 2024-02-21T23:00:47.158 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.165+0000 7f62737fe640 1 --2- 172.21.15.181:0/3365062448 >> v2:172.21.15.99:3300/0 conn(0x7f627417fc10 0x7f6274071b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:00:47.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.165+0000 7f6273fff640 1 --2- 172.21.15.181:0/3365062448 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f625c0053c0 0x7f625c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:47.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.165+0000 7f6272ffd640 1 --2- 172.21.15.181:0/3365062448 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f625c004800 0x7f625c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:47.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.166+0000 7f62737fe640 1 --2- 172.21.15.181:0/3365062448 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f625c003a00 0x7f625c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:47.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.166+0000 7f6272ffd640 1 -- 172.21.15.181:0/3365062448 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f625c0053c0 msgr2=0x7f625c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:00:47.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.166+0000 7f6272ffd640 1 --2- 172.21.15.181:0/3365062448 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f625c0053c0 0x7f625c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:47.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.166+0000 7f6272ffd640 1 -- 172.21.15.181:0/3365062448 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f625c003a00 msgr2=0x7f625c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:00:47.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.166+0000 7f6272ffd640 1 --2- 172.21.15.181:0/3365062448 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f625c003a00 0x7f625c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:47.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.166+0000 7f6272ffd640 1 -- 172.21.15.181:0/3365062448 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f625c003520 con 0x7f625c004800 2024-02-21T23:00:47.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.166+0000 7f6273fff640 1 --2- 172.21.15.181:0/3365062448 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f625c0053c0 0x7f625c00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:00:47.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.166+0000 7f62737fe640 1 --2- 172.21.15.181:0/3365062448 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f625c003a00 0x7f625c003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T23:00:47.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.166+0000 7f6273fff640 1 -- 172.21.15.181:0/3365062448 reap_dead start 2024-02-21T23:00:47.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.166+0000 7f6272ffd640 1 --2- 172.21.15.181:0/3365062448 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f625c004800 0x7f625c004c80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f6268003db0 tx=0x7f625c005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4b2bb5e918e3af2 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:00:47.159 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.167+0000 7f62727fc640 1 -- 172.21.15.181:0/3365062448 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6268037070 con 0x7f625c004800 2024-02-21T23:00:47.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.167+0000 7f62727fc640 1 -- 172.21.15.181:0/3365062448 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f626802be50 con 0x7f625c004800 2024-02-21T23:00:47.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.167+0000 7f62727fc640 1 -- 172.21.15.181:0/3365062448 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6268003980 con 0x7f625c004800 2024-02-21T23:00:47.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.167+0000 7f6279ed5640 1 -- 172.21.15.181:0/3365062448 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f625c004800 msgr2=0x7f625c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:47.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.167+0000 7f6279ed5640 1 --2- 172.21.15.181:0/3365062448 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f625c004800 0x7f625c004c80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f6268003db0 tx=0x7f625c005830 comp rx=0 tx=0).stop 2024-02-21T23:00:47.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.167+0000 7f6279ed5640 1 -- 172.21.15.181:0/3365062448 shutdown_connections 2024-02-21T23:00:47.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.167+0000 7f6279ed5640 1 --2- 172.21.15.181:0/3365062448 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f625c004800 0x7f625c004c80 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:47.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.167+0000 7f6279ed5640 1 -- 172.21.15.181:0/3365062448 >> 172.21.15.181:0/3365062448 conn(0x7f62740cfbd0 msgr2=0x7f62740cffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:00:47.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.167+0000 7f6279ed5640 1 -- 172.21.15.181:0/3365062448 shutdown_connections 2024-02-21T23:00:47.160 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.167+0000 7f6279ed5640 1 -- 172.21.15.181:0/3365062448 wait complete. 2024-02-21T23:00:47.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.169+0000 7f6279ed5640 1 Processor -- start 2024-02-21T23:00:47.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.169+0000 7f6279ed5640 1 -- start start 2024-02-21T23:00:47.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.170+0000 7f6279ed5640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f625c004800 0x7f627416e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:47.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.170+0000 7f6279ed5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f627416eec0 0x7f627421dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:47.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.170+0000 7f6279ed5640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f627421e1a0 0x7f6274183950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:47.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.170+0000 7f6279ed5640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6274072fc0 con 0x7f625c004800 2024-02-21T23:00:47.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.170+0000 7f6279ed5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6274072ce0 con 0x7f627416eec0 2024-02-21T23:00:47.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.170+0000 7f6279ed5640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62740732a0 con 0x7f627421e1a0 2024-02-21T23:00:47.163 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.170+0000 7f6273fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f627421e1a0 0x7f6274183950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:47.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.170+0000 7f6273fff640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f627421e1a0 0x7f6274183950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:49370/0 (socket says 172.21.15.181:49370) 2024-02-21T23:00:47.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.170+0000 7f6273fff640 1 -- 172.21.15.181:0/3311612278 learned_addr learned my addr 172.21.15.181:0/3311612278 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-02-21T23:00:47.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.170+0000 7f6272ffd640 1 --2- 172.21.15.181:0/3311612278 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f627416eec0 0x7f627421dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:47.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.170+0000 7f62737fe640 1 --2- 172.21.15.181:0/3311612278 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f625c004800 0x7f627416e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:47.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.170+0000 7f6272ffd640 1 -- 172.21.15.181:0/3311612278 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f627421e1a0 msgr2=0x7f6274183950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:47.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.170+0000 7f6272ffd640 1 --2- 172.21.15.181:0/3311612278 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f627421e1a0 0x7f6274183950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:47.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.170+0000 7f6272ffd640 1 -- 172.21.15.181:0/3311612278 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f625c004800 msgr2=0x7f627416e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:47.164 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.170+0000 7f6272ffd640 1 --2- 172.21.15.181:0/3311612278 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f625c004800 0x7f627416e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:47.165 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.170+0000 7f6272ffd640 1 -- 172.21.15.181:0/3311612278 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62741845a0 con 0x7f627416eec0 2024-02-21T23:00:47.165 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.170+0000 7f62737fe640 1 --2- 172.21.15.181:0/3311612278 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f625c004800 0x7f627416e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T23:00:47.165 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.170+0000 7f6273fff640 1 --2- 172.21.15.181:0/3311612278 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f627421e1a0 0x7f6274183950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:00:47.165 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.171+0000 7f6272ffd640 1 --2- 172.21.15.181:0/3311612278 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f627416eec0 0x7f627421dc60 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f625c00c450 tx=0x7f62680036f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:00:47.165 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.171+0000 7f625bfff640 1 -- 172.21.15.181:0/3311612278 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6268042030 con 0x7f627416eec0 2024-02-21T23:00:47.165 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.171+0000 7f625bfff640 1 -- 172.21.15.181:0/3311612278 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6268007470 con 0x7f627416eec0 2024-02-21T23:00:47.165 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.171+0000 7f6279ed5640 1 -- 172.21.15.181:0/3311612278 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6274184880 con 0x7f627416eec0 2024-02-21T23:00:47.165 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.171+0000 7f625bfff640 1 -- 172.21.15.181:0/3311612278 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6268037040 con 0x7f627416eec0 2024-02-21T23:00:47.165 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.171+0000 7f6279ed5640 1 -- 172.21.15.181:0/3311612278 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62740f93f0 con 0x7f627416eec0 2024-02-21T23:00:47.166 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.171+0000 7f625bfff640 1 -- 172.21.15.181:0/3311612278 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f6268045070 con 0x7f627416eec0 2024-02-21T23:00:47.166 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.171+0000 7f625bfff640 1 -- 172.21.15.181:0/3311612278 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f626803dbf0 con 0x7f627416eec0 2024-02-21T23:00:47.166 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.172+0000 7f6279ed5640 1 -- 172.21.15.181:0/3311612278 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6274066c60 con 0x7f627416eec0 2024-02-21T23:00:47.166 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.174+0000 7f625bfff640 1 -- 172.21.15.181:0/3311612278 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f626804c070 con 0x7f627416eec0 2024-02-21T23:00:47.175 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-02-21T23:00:47.186+0000 7fda7b02b040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-21T23:00:47.229 INFO:tasks.ceph.mgr.z.smithi181.stderr:2024-02-21T23:00:47.240+0000 7fe068a2b040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-21T23:00:47.234 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-02-21T23:00:47.245+0000 7f29159b1040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-21T23:00:47.267 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.278+0000 7f6279ed5640 1 -- 172.21.15.181:0/3311612278 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d9e37ce7-1b0e-4019-8f2e-b670403abf7e", "id": 6} v 0) v1 -- 0x7f627406c450 con 0x7f627416eec0 2024-02-21T23:00:47.269 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-02-21T23:00:47.280+0000 7fda7b02b040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-21T23:00:47.273 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.283+0000 7f625bfff640 1 -- 172.21.15.181:0/3311612278 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d9e37ce7-1b0e-4019-8f2e-b670403abf7e", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f626803d470 con 0x7f627416eec0 2024-02-21T23:00:47.273 INFO:teuthology.orchestra.run.smithi181.stdout:6 2024-02-21T23:00:47.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.284+0000 7f6279ed5640 1 -- 172.21.15.181:0/3311612278 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f627416eec0 msgr2=0x7f627421dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:47.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.284+0000 7f6279ed5640 1 --2- 172.21.15.181:0/3311612278 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f627416eec0 0x7f627421dc60 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f625c00c450 tx=0x7f62680036f0 comp rx=0 tx=0).stop 2024-02-21T23:00:47.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.284+0000 7f6279ed5640 1 -- 172.21.15.181:0/3311612278 shutdown_connections 2024-02-21T23:00:47.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.284+0000 7f6279ed5640 1 --2- 172.21.15.181:0/3311612278 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f627421e1a0 0x7f6274183950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:47.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.284+0000 7f6279ed5640 1 --2- 172.21.15.181:0/3311612278 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f627416eec0 0x7f627421dc60 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:47.274 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.284+0000 7f6279ed5640 1 --2- 172.21.15.181:0/3311612278 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f625c004800 0x7f627416e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:47.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.284+0000 7f6279ed5640 1 -- 172.21.15.181:0/3311612278 >> 172.21.15.181:0/3311612278 conn(0x7f62740cfbd0 msgr2=0x7f62740740b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:00:47.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.285+0000 7f6279ed5640 1 -- 172.21.15.181:0/3311612278 shutdown_connections 2024-02-21T23:00:47.275 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.285+0000 7f6279ed5640 1 -- 172.21.15.181:0/3311612278 wait complete. 2024-02-21T23:00:47.284 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --cluster ceph osd new 49988754-232e-4b8c-bd72-bfa25b418e5a 7 2024-02-21T23:00:47.329 INFO:tasks.ceph.mgr.z.smithi181.stderr:2024-02-21T23:00:47.340+0000 7fe068a2b040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-21T23:00:47.368 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-02-21T23:00:47.379+0000 7f29159b1040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-21T23:00:47.421 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-02-21T23:00:47.432+0000 7f29159b1040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-21T23:00:47.424 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.435+0000 7fa8cecc8640 1 Processor -- start 2024-02-21T23:00:47.425 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.435+0000 7fa8cecc8640 1 -- start start 2024-02-21T23:00:47.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.436+0000 7fa8cecc8640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fa8c8188dd0 0x7fa8c8189230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:47.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.436+0000 7fa8cecc8640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8c817d9b0 con 0x7fa8c817d5d0 2024-02-21T23:00:47.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.436+0000 7fa8cecc8640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8c8072100 con 0x7fa8c8189770 2024-02-21T23:00:47.426 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.436+0000 7fa8cecc8640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8c80723c0 con 0x7fa8c8188dd0 2024-02-21T23:00:47.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.437+0000 7fa8c7fff640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fa8c8188dd0 0x7fa8c8189230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:47.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.437+0000 7fa8c7fff640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fa8c8188dd0 0x7fa8c8189230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:49384/0 (socket says 172.21.15.181:49384) 2024-02-21T23:00:47.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.437+0000 7fa8c7fff640 1 -- 172.21.15.181:0/3352464820 learned_addr learned my addr 172.21.15.181:0/3352464820 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-02-21T23:00:47.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.437+0000 7fa8cd265640 1 --1- 172.21.15.181:0/3352464820 >> v1:172.21.15.181:6789/0 conn(0x7fa8c8189770 0x7fa8c80d0760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:43482/0 (socket says 172.21.15.181:43482) 2024-02-21T23:00:47.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.437+0000 7fa8c7fff640 1 -- 172.21.15.181:0/3352464820 >> v1:172.21.15.181:6789/0 conn(0x7fa8c8189770 legacy=0x7fa8c80d0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:47.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.437+0000 7fa8c7fff640 1 -- 172.21.15.181:0/3352464820 >> v1:172.21.15.99:6789/0 conn(0x7fa8c817d5d0 legacy=0x7fa8c806e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:00:47.427 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.437+0000 7fa8c7fff640 1 -- 172.21.15.181:0/3352464820 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8c80726a0 con 0x7fa8c8188dd0 2024-02-21T23:00:47.428 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-02-21T23:00:47.436+0000 7fda7b02b040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-21T23:00:47.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.438+0000 7fa8c7fff640 1 --2- 172.21.15.181:0/3352464820 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa8c8188dd0 0x7fa8c8189230 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa8b0009870 tx=0x7fa8b002b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a58bcbfa63d3c97 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:00:47.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.438+0000 7fa8c77fe640 1 -- 172.21.15.181:0/3352464820 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b0034070 con 0x7fa8c8188dd0 2024-02-21T23:00:47.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.438+0000 7fa8c77fe640 1 -- 172.21.15.181:0/3352464820 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8b0030840 con 0x7fa8c8188dd0 2024-02-21T23:00:47.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.438+0000 7fa8c77fe640 1 -- 172.21.15.181:0/3352464820 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b0030c10 con 0x7fa8c8188dd0 2024-02-21T23:00:47.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.438+0000 7fa8cecc8640 1 -- 172.21.15.181:0/3352464820 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa8c8188dd0 msgr2=0x7fa8c8189230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:47.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.438+0000 7fa8cecc8640 1 --2- 172.21.15.181:0/3352464820 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa8c8188dd0 0x7fa8c8189230 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa8b0009870 tx=0x7fa8b002b980 comp rx=0 tx=0).stop 2024-02-21T23:00:47.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.438+0000 7fa8cecc8640 1 -- 172.21.15.181:0/3352464820 shutdown_connections 2024-02-21T23:00:47.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.438+0000 7fa8cecc8640 1 --2- 172.21.15.181:0/3352464820 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa8c8188dd0 0x7fa8c8189230 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:47.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.438+0000 7fa8cecc8640 1 -- 172.21.15.181:0/3352464820 >> 172.21.15.181:0/3352464820 conn(0x7fa8c80fc340 msgr2=0x7fa8c80fc750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:00:47.429 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.438+0000 7fa8cecc8640 1 -- 172.21.15.181:0/3352464820 shutdown_connections 2024-02-21T23:00:47.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.438+0000 7fa8cecc8640 1 -- 172.21.15.181:0/3352464820 wait complete. 2024-02-21T23:00:47.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.440+0000 7fa8cecc8640 1 Processor -- start 2024-02-21T23:00:47.430 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.440+0000 7fa8cecc8640 1 -- start start 2024-02-21T23:00:47.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.441+0000 7fa8cecc8640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8c817d5d0 0x7fa8c806c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:47.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.441+0000 7fa8cecc8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa8c8188dd0 0x7fa8c815c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:47.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.441+0000 7fa8cecc8640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa8c8189770 0x7fa8c8220670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:47.432 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.441+0000 7fa8cecc8640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c81885d0 con 0x7fa8c817d5d0 2024-02-21T23:00:47.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.441+0000 7fa8cecc8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c81882f0 con 0x7fa8c8188dd0 2024-02-21T23:00:47.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.441+0000 7fa8cecc8640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c81888b0 con 0x7fa8c8189770 2024-02-21T23:00:47.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.441+0000 7fa8cd265640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa8c8189770 0x7fa8c8220670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:47.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.441+0000 7fa8cd265640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa8c8189770 0x7fa8c8220670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:49394/0 (socket says 172.21.15.181:49394) 2024-02-21T23:00:47.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.441+0000 7fa8cd265640 1 -- 172.21.15.181:0/882073023 learned_addr learned my addr 172.21.15.181:0/882073023 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-02-21T23:00:47.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.441+0000 7fa8c7fff640 1 --2- 172.21.15.181:0/882073023 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa8c8188dd0 0x7fa8c815c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:47.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.441+0000 7fa8cca64640 1 --2- 172.21.15.181:0/882073023 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8c817d5d0 0x7fa8c806c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:47.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.441+0000 7fa8cd265640 1 -- 172.21.15.181:0/882073023 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa8c8188dd0 msgr2=0x7fa8c815c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:47.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.441+0000 7fa8cd265640 1 --2- 172.21.15.181:0/882073023 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa8c8188dd0 0x7fa8c815c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:47.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.441+0000 7fa8cd265640 1 -- 172.21.15.181:0/882073023 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8c817d5d0 msgr2=0x7fa8c806c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:47.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.441+0000 7fa8cd265640 1 --2- 172.21.15.181:0/882073023 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8c817d5d0 0x7fa8c806c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:47.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.441+0000 7fa8cd265640 1 -- 172.21.15.181:0/882073023 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8c806ce20 con 0x7fa8c8189770 2024-02-21T23:00:47.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.441+0000 7fa8c7fff640 1 --2- 172.21.15.181:0/882073023 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa8c8188dd0 0x7fa8c815c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:00:47.433 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.441+0000 7fa8cca64640 1 --2- 172.21.15.181:0/882073023 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8c817d5d0 0x7fa8c806c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T23:00:47.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.441+0000 7fa8cd265640 1 --2- 172.21.15.181:0/882073023 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa8c8189770 0x7fa8c8220670 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa8b800c3c0 tx=0x7fa8b800c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:00:47.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.442+0000 7fa8c57fa640 1 -- 172.21.15.181:0/882073023 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b80074e0 con 0x7fa8c8189770 2024-02-21T23:00:47.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.442+0000 7fa8c57fa640 1 -- 172.21.15.181:0/882073023 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8b8007680 con 0x7fa8c8189770 2024-02-21T23:00:47.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.442+0000 7fa8cecc8640 1 -- 172.21.15.181:0/882073023 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8c806d100 con 0x7fa8c8189770 2024-02-21T23:00:47.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.442+0000 7fa8c57fa640 1 -- 172.21.15.181:0/882073023 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b80049e0 con 0x7fa8c8189770 2024-02-21T23:00:47.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.442+0000 7fa8cecc8640 1 -- 172.21.15.181:0/882073023 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8c806d6c0 con 0x7fa8c8189770 2024-02-21T23:00:47.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.442+0000 7fa8c57fa640 1 -- 172.21.15.181:0/882073023 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fa8b801a020 con 0x7fa8c8189770 2024-02-21T23:00:47.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.442+0000 7fa8c57fa640 1 -- 172.21.15.181:0/882073023 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fa8b8012a50 con 0x7fa8c8189770 2024-02-21T23:00:47.434 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.443+0000 7fa8cecc8640 1 -- 172.21.15.181:0/882073023 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8c806ff80 con 0x7fa8c8189770 2024-02-21T23:00:47.435 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.445+0000 7fa8c57fa640 1 -- 172.21.15.181:0/882073023 <== mon.2 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fa8c806ff80 con 0x7fa8c8189770 2024-02-21T23:00:47.468 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-02-21T23:00:47.479+0000 7fda7b02b040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-21T23:00:47.493 INFO:tasks.ceph.mgr.z.smithi181.stderr:2024-02-21T23:00:47.504+0000 7fe068a2b040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-21T23:00:47.506 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.517+0000 7fa8cecc8640 1 -- 172.21.15.181:0/882073023 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd new", "uuid": "49988754-232e-4b8c-bd72-bfa25b418e5a", "id": 7} v 0) v1 -- 0x7fa8c8066c60 con 0x7fa8c8189770 2024-02-21T23:00:47.511 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.522+0000 7fa8c57fa640 1 -- 172.21.15.181:0/882073023 <== mon.2 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "49988754-232e-4b8c-bd72-bfa25b418e5a", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa8b8021070 con 0x7fa8c8189770 2024-02-21T23:00:47.511 INFO:teuthology.orchestra.run.smithi181.stdout:7 2024-02-21T23:00:47.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.523+0000 7fa8cecc8640 1 -- 172.21.15.181:0/882073023 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa8c8189770 msgr2=0x7fa8c8220670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:47.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.523+0000 7fa8cecc8640 1 --2- 172.21.15.181:0/882073023 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa8c8189770 0x7fa8c8220670 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa8b800c3c0 tx=0x7fa8b800c880 comp rx=0 tx=0).stop 2024-02-21T23:00:47.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.523+0000 7fa8cecc8640 1 -- 172.21.15.181:0/882073023 shutdown_connections 2024-02-21T23:00:47.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.523+0000 7fa8cecc8640 1 --2- 172.21.15.181:0/882073023 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa8c8189770 0x7fa8c8220670 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:47.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.523+0000 7fa8cecc8640 1 --2- 172.21.15.181:0/882073023 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa8c8188dd0 0x7fa8c815c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:47.512 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.523+0000 7fa8cecc8640 1 --2- 172.21.15.181:0/882073023 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa8c817d5d0 0x7fa8c806c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:47.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.523+0000 7fa8cecc8640 1 -- 172.21.15.181:0/882073023 >> 172.21.15.181:0/882073023 conn(0x7fa8c80fc340 msgr2=0x7fa8c808f060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:00:47.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.523+0000 7fa8cecc8640 1 -- 172.21.15.181:0/882073023 shutdown_connections 2024-02-21T23:00:47.513 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.523+0000 7fa8cecc8640 1 -- 172.21.15.181:0/882073023 wait complete. 2024-02-21T23:00:47.522 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --cluster ceph osd new ebc6e462-8368-4d64-b242-9c8735ac672c 8 2024-02-21T23:00:47.538 INFO:tasks.ceph.mgr.z.smithi181.stderr:2024-02-21T23:00:47.549+0000 7fe068a2b040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-21T23:00:47.548 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-02-21T23:00:47.559+0000 7f29159b1040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-21T23:00:47.623 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-02-21T23:00:47.634+0000 7fda7b02b040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-21T23:00:47.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.649+0000 7fa13d6b0640 1 Processor -- start 2024-02-21T23:00:47.638 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.649+0000 7fa13d6b0640 1 -- start start 2024-02-21T23:00:47.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.650+0000 7fa13d6b0640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa138183130 con 0x7fa138182d50 2024-02-21T23:00:47.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.650+0000 7fa13d6b0640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1380cb5e0 con 0x7fa1380cb0d0 2024-02-21T23:00:47.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.650+0000 7fa13d6b0640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1380cb8c0 con 0x7fa138071400 2024-02-21T23:00:47.643 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.650+0000 7fa1377fe640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fa138071400 0x7fa138071850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.181:43496/0 (socket says 172.21.15.181:43496) 2024-02-21T23:00:47.644 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.650+0000 7fa1377fe640 1 -- 172.21.15.181:0/1660551515 learned_addr learned my addr 172.21.15.181:0/1660551515 (peer_addr_for_me v1:172.21.15.181:0/0) 2024-02-21T23:00:47.644 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.651+0000 7fa135ffb640 1 -- 172.21.15.181:0/1660551515 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 664213760 0 0) 0x7fa1380cb8c0 con 0x7fa138071400 2024-02-21T23:00:47.644 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.651+0000 7fa135ffb640 1 -- 172.21.15.181:0/1660551515 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa120003520 con 0x7fa138071400 2024-02-21T23:00:47.644 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.651+0000 7fa135ffb640 1 -- 172.21.15.181:0/1660551515 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1493131943 0 0) 0x7fa1380cb5e0 con 0x7fa1380cb0d0 2024-02-21T23:00:47.644 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.651+0000 7fa135ffb640 1 -- 172.21.15.181:0/1660551515 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1380cb8c0 con 0x7fa1380cb0d0 2024-02-21T23:00:47.644 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.651+0000 7fa135ffb640 1 -- 172.21.15.181:0/1660551515 <== mon.2 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 282597589 0 0) 0x7fa120003520 con 0x7fa138071400 2024-02-21T23:00:47.644 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.651+0000 7fa135ffb640 1 -- 172.21.15.181:0/1660551515 >> v1:172.21.15.162:6789/0 conn(0x7fa1380cb0d0 legacy=0x7fa1380f7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:47.644 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.651+0000 7fa135ffb640 1 -- 172.21.15.181:0/1660551515 >> v1:172.21.15.99:6789/0 conn(0x7fa138182d50 legacy=0x7fa1380f7690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:00:47.644 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.651+0000 7fa135ffb640 1 -- 172.21.15.181:0/1660551515 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1380cbba0 con 0x7fa138071400 2024-02-21T23:00:47.644 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.651+0000 7fa135ffb640 1 -- 172.21.15.181:0/1660551515 <== mon.2 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2069890144 0 0) 0x7fa1300019f0 con 0x7fa138071400 2024-02-21T23:00:47.644 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.651+0000 7fa135ffb640 1 -- 172.21.15.181:0/1660551515 >> v1:172.21.15.181:6789/0 conn(0x7fa138071400 legacy=0x7fa138071850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:47.644 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.651+0000 7fa135ffb640 1 --2- 172.21.15.181:0/1660551515 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa120003b90 0x7fa120003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:47.645 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.651+0000 7fa135ffb640 1 --2- 172.21.15.181:0/1660551515 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa120004800 0x7fa120004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:47.645 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.651+0000 7fa135ffb640 1 --2- 172.21.15.181:0/1660551515 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa1200052e0 0x7fa12000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:47.645 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.651+0000 7fa135ffb640 1 -- 172.21.15.181:0/1660551515 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa12000c1d0 con 0x7fa120004800 2024-02-21T23:00:47.645 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.651+0000 7fa135ffb640 1 -- 172.21.15.181:0/1660551515 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa12000c380 con 0x7fa120003b90 2024-02-21T23:00:47.645 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.651+0000 7fa135ffb640 1 -- 172.21.15.181:0/1660551515 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa12000c580 con 0x7fa1200052e0 2024-02-21T23:00:47.645 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.651+0000 7fa1377fe640 1 --2- 172.21.15.181:0/1660551515 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa1200052e0 0x7fa12000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:47.645 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.651+0000 7fa136ffd640 1 --2- 172.21.15.181:0/1660551515 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa120003b90 0x7fa120003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:47.645 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.651+0000 7fa1367fc640 1 --2- 172.21.15.181:0/1660551515 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa120004800 0x7fa120004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:47.645 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.651+0000 7fa1377fe640 1 -- 172.21.15.181:0/1660551515 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa120003b90 msgr2=0x7fa120003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:00:47.645 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.651+0000 7fa1377fe640 1 --2- 172.21.15.181:0/1660551515 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa120003b90 0x7fa120003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:47.645 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.652+0000 7fa1377fe640 1 -- 172.21.15.181:0/1660551515 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa120004800 msgr2=0x7fa120004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:00:47.645 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.652+0000 7fa1377fe640 1 --2- 172.21.15.181:0/1660551515 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa120004800 0x7fa120004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:47.645 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.652+0000 7fa1377fe640 1 -- 172.21.15.181:0/1660551515 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa120003520 con 0x7fa1200052e0 2024-02-21T23:00:47.645 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.652+0000 7fa1377fe640 1 -- 172.21.15.181:0/1660551515 reap_dead start 2024-02-21T23:00:47.646 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.652+0000 7fa1377fe640 1 --2- 172.21.15.181:0/1660551515 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa1200052e0 0x7fa12000b9c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa13000a800 tx=0x7fa120005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2ad6a0163622d67 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:00:47.646 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.652+0000 7fa135ffb640 1 -- 172.21.15.181:0/1660551515 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa13000a450 con 0x7fa1200052e0 2024-02-21T23:00:47.646 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.652+0000 7fa135ffb640 1 -- 172.21.15.181:0/1660551515 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa130034650 con 0x7fa1200052e0 2024-02-21T23:00:47.646 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.652+0000 7fa135ffb640 1 -- 172.21.15.181:0/1660551515 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa13002ce60 con 0x7fa1200052e0 2024-02-21T23:00:47.646 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.653+0000 7fa13d6b0640 1 -- 172.21.15.181:0/1660551515 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa1200052e0 msgr2=0x7fa12000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:47.646 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.653+0000 7fa13d6b0640 1 --2- 172.21.15.181:0/1660551515 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa1200052e0 0x7fa12000b9c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa13000a800 tx=0x7fa120005830 comp rx=0 tx=0).stop 2024-02-21T23:00:47.646 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.653+0000 7fa13d6b0640 1 -- 172.21.15.181:0/1660551515 shutdown_connections 2024-02-21T23:00:47.646 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.653+0000 7fa13d6b0640 1 --2- 172.21.15.181:0/1660551515 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa1200052e0 0x7fa12000b9c0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:47.646 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.653+0000 7fa13d6b0640 1 -- 172.21.15.181:0/1660551515 >> 172.21.15.181:0/1660551515 conn(0x7fa1380fc330 msgr2=0x7fa1380fc710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:00:47.646 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.653+0000 7fa13d6b0640 1 -- 172.21.15.181:0/1660551515 shutdown_connections 2024-02-21T23:00:47.646 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.653+0000 7fa13d6b0640 1 -- 172.21.15.181:0/1660551515 wait complete. 2024-02-21T23:00:47.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.655+0000 7fa13d6b0640 1 Processor -- start 2024-02-21T23:00:47.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.655+0000 7fa13d6b0640 1 -- start start 2024-02-21T23:00:47.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.656+0000 7fa13d6b0640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa1200052e0 0x7fa13816e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:47.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.656+0000 7fa13d6b0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa13821d9b0 0x7fa13821de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:47.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.656+0000 7fa13d6b0640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa13821e370 0x7fa138221f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:47.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.656+0000 7fa13d6b0640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1380cc4d0 con 0x7fa13821e370 2024-02-21T23:00:47.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.656+0000 7fa13d6b0640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1380cc160 con 0x7fa13821d9b0 2024-02-21T23:00:47.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.656+0000 7fa13d6b0640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1380ce0f0 con 0x7fa1200052e0 2024-02-21T23:00:47.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.656+0000 7fa136ffd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa1200052e0 0x7fa13816e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:47.649 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.656+0000 7fa136ffd640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa1200052e0 0x7fa13816e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:49418/0 (socket says 172.21.15.181:49418) 2024-02-21T23:00:47.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.656+0000 7fa136ffd640 1 -- 172.21.15.181:0/2531766656 learned_addr learned my addr 172.21.15.181:0/2531766656 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-02-21T23:00:47.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.656+0000 7fa1367fc640 1 --2- 172.21.15.181:0/2531766656 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa13821d9b0 0x7fa13821de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:47.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.656+0000 7fa136ffd640 1 -- 172.21.15.181:0/2531766656 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa13821d9b0 msgr2=0x7fa13821de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:47.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.656+0000 7fa136ffd640 1 --2- 172.21.15.181:0/2531766656 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa13821d9b0 0x7fa13821de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:47.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.656+0000 7fa136ffd640 1 -- 172.21.15.181:0/2531766656 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa13821e370 msgr2=0x7fa138221f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:47.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.656+0000 7fa136ffd640 1 --2- 172.21.15.181:0/2531766656 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa13821e370 0x7fa138221f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:47.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.656+0000 7fa136ffd640 1 -- 172.21.15.181:0/2531766656 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa13818be50 con 0x7fa1200052e0 2024-02-21T23:00:47.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.656+0000 7fa136ffd640 1 --2- 172.21.15.181:0/2531766656 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa1200052e0 0x7fa13816e900 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa12c00f650 tx=0x7fa12c00fb10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:00:47.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.656+0000 7fa11f7fe640 1 -- 172.21.15.181:0/2531766656 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa12c017020 con 0x7fa1200052e0 2024-02-21T23:00:47.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.656+0000 7fa11f7fe640 1 -- 172.21.15.181:0/2531766656 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa12c003860 con 0x7fa1200052e0 2024-02-21T23:00:47.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.656+0000 7fa13d6b0640 1 -- 172.21.15.181:0/2531766656 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa13821c910 con 0x7fa1200052e0 2024-02-21T23:00:47.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.656+0000 7fa11f7fe640 1 -- 172.21.15.181:0/2531766656 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa12c003c50 con 0x7fa1200052e0 2024-02-21T23:00:47.650 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.656+0000 7fa13d6b0640 1 -- 172.21.15.181:0/2531766656 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa13821ced0 con 0x7fa1200052e0 2024-02-21T23:00:47.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.657+0000 7fa11f7fe640 1 -- 172.21.15.181:0/2531766656 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fa12c01a020 con 0x7fa1200052e0 2024-02-21T23:00:47.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.657+0000 7fa11f7fe640 1 -- 172.21.15.181:0/2531766656 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fa12c00dd70 con 0x7fa1200052e0 2024-02-21T23:00:47.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.657+0000 7fa13d6b0640 1 -- 172.21.15.181:0/2531766656 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa138066c60 con 0x7fa1200052e0 2024-02-21T23:00:47.651 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.659+0000 7fa11f7fe640 1 -- 172.21.15.181:0/2531766656 <== mon.2 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fa12c021020 con 0x7fa1200052e0 2024-02-21T23:00:47.660 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-02-21T23:00:47.671+0000 7f29159b1040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-21T23:00:47.702 INFO:tasks.ceph.mgr.z.smithi181.stderr:2024-02-21T23:00:47.713+0000 7fe068a2b040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-21T23:00:47.721 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.732+0000 7fa13d6b0640 1 -- 172.21.15.181:0/2531766656 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ebc6e462-8368-4d64-b242-9c8735ac672c", "id": 8} v 0) v1 -- 0x7fa1380faf00 con 0x7fa1200052e0 2024-02-21T23:00:47.726 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.737+0000 7fa11f7fe640 1 -- 172.21.15.181:0/2531766656 <== mon.2 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ebc6e462-8368-4d64-b242-9c8735ac672c", "id": 8}]=0 v11) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa12c004660 con 0x7fa1200052e0 2024-02-21T23:00:47.726 INFO:teuthology.orchestra.run.smithi181.stdout:8 2024-02-21T23:00:47.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.737+0000 7fa13d6b0640 1 -- 172.21.15.181:0/2531766656 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa1200052e0 msgr2=0x7fa13816e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:47.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.738+0000 7fa13d6b0640 1 --2- 172.21.15.181:0/2531766656 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa1200052e0 0x7fa13816e900 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa12c00f650 tx=0x7fa12c00fb10 comp rx=0 tx=0).stop 2024-02-21T23:00:47.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.738+0000 7fa13d6b0640 1 -- 172.21.15.181:0/2531766656 shutdown_connections 2024-02-21T23:00:47.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.738+0000 7fa13d6b0640 1 --2- 172.21.15.181:0/2531766656 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa13821e370 0x7fa138221f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:47.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.738+0000 7fa13d6b0640 1 --2- 172.21.15.181:0/2531766656 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa13821d9b0 0x7fa13821de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:47.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.738+0000 7fa13d6b0640 1 --2- 172.21.15.181:0/2531766656 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa1200052e0 0x7fa13816e900 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:47.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.738+0000 7fa13d6b0640 1 -- 172.21.15.181:0/2531766656 >> 172.21.15.181:0/2531766656 conn(0x7fa1380fc330 msgr2=0x7fa1380f8410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:00:47.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.738+0000 7fa13d6b0640 1 -- 172.21.15.181:0/2531766656 shutdown_connections 2024-02-21T23:00:47.728 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.738+0000 7fa13d6b0640 1 -- 172.21.15.181:0/2531766656 wait complete. 2024-02-21T23:00:47.737 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --cluster ceph osd new 72af1b02-b965-4d6a-8964-527ec24c4daa 9 2024-02-21T23:00:47.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.848+0000 7f507f2a2640 1 Processor -- start 2024-02-21T23:00:47.838 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.849+0000 7f507f2a2640 1 -- start start 2024-02-21T23:00:47.838 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-02-21T23:00:47.848+0000 7f29159b1040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-21T23:00:47.839 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.850+0000 7f507f2a2640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5078184150 0x7f50780f7050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:47.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.850+0000 7f507f2a2640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f50780719a0 0x7f50781869d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:47.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.850+0000 7f507f2a2640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50780f5cd0 con 0x7f5078186f10 2024-02-21T23:00:47.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.850+0000 7f507f2a2640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50780f6bc0 con 0x7f5078184150 2024-02-21T23:00:47.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.850+0000 7f507f2a2640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50780f7590 con 0x7f50780719a0 2024-02-21T23:00:47.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.850+0000 7f507c83d640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f50780719a0 0x7f50781869d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:47.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.850+0000 7f507c83d640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f50780719a0 0x7f50781869d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:49424/0 (socket says 172.21.15.181:49424) 2024-02-21T23:00:47.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.850+0000 7f507c83d640 1 -- 172.21.15.181:0/1889133253 learned_addr learned my addr 172.21.15.181:0/1889133253 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-02-21T23:00:47.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.850+0000 7f507d03e640 1 --2- 172.21.15.181:0/1889133253 >> v2:172.21.15.162:3300/0 conn(0x7f5078184150 0x7f50780f7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:47.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.850+0000 7f507c83d640 1 -- 172.21.15.181:0/1889133253 >> v2:172.21.15.162:3300/0 conn(0x7f5078184150 msgr2=0x7f50780f7050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:00:47.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.850+0000 7f507c83d640 1 --2- 172.21.15.181:0/1889133253 >> v2:172.21.15.162:3300/0 conn(0x7f5078184150 0x7f50780f7050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:47.840 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.850+0000 7f507c83d640 1 -- 172.21.15.181:0/1889133253 >> v1:172.21.15.99:6789/0 conn(0x7f5078186f10 legacy=0x7f50781873a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:00:47.841 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.850+0000 7f507c83d640 1 -- 172.21.15.181:0/1889133253 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50780f5fb0 con 0x7f50780719a0 2024-02-21T23:00:47.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.851+0000 7f507c83d640 1 --2- 172.21.15.181:0/1889133253 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f50780719a0 0x7f50781869d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f507806b6e0 tx=0x7f507402b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6228326c716d8425 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:00:47.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.851+0000 7f506ffff640 1 -- 172.21.15.181:0/1889133253 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5074035020 con 0x7f50780719a0 2024-02-21T23:00:47.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.851+0000 7f506ffff640 1 -- 172.21.15.181:0/1889133253 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5074031870 con 0x7f50780719a0 2024-02-21T23:00:47.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.851+0000 7f506ffff640 1 -- 172.21.15.181:0/1889133253 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5074031c40 con 0x7f50780719a0 2024-02-21T23:00:47.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.851+0000 7f507f2a2640 1 -- 172.21.15.181:0/1889133253 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f50780719a0 msgr2=0x7f50781869d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:47.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.851+0000 7f507f2a2640 1 --2- 172.21.15.181:0/1889133253 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f50780719a0 0x7f50781869d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f507806b6e0 tx=0x7f507402b910 comp rx=0 tx=0).stop 2024-02-21T23:00:47.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.852+0000 7f507f2a2640 1 -- 172.21.15.181:0/1889133253 shutdown_connections 2024-02-21T23:00:47.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.852+0000 7f507f2a2640 1 --2- 172.21.15.181:0/1889133253 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f50780719a0 0x7f50781869d0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:47.842 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.852+0000 7f507f2a2640 1 --2- 172.21.15.181:0/1889133253 >> v2:172.21.15.162:3300/0 conn(0x7f5078184150 0x7f50780f7050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:47.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.852+0000 7f507f2a2640 1 -- 172.21.15.181:0/1889133253 >> 172.21.15.181:0/1889133253 conn(0x7f50780cf780 msgr2=0x7f50780cfb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:00:47.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.852+0000 7f507f2a2640 1 -- 172.21.15.181:0/1889133253 shutdown_connections 2024-02-21T23:00:47.843 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.852+0000 7f507f2a2640 1 -- 172.21.15.181:0/1889133253 wait complete. 2024-02-21T23:00:47.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.853+0000 7f507f2a2640 1 Processor -- start 2024-02-21T23:00:47.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.853+0000 7f507f2a2640 1 -- start start 2024-02-21T23:00:47.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.854+0000 7f507f2a2640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f50780719a0 0x7f5078220110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:47.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.854+0000 7f507f2a2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5078184150 0x7f50782218f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:47.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.854+0000 7f507f2a2640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5078186f10 0x7f5078221e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:47.845 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.854+0000 7f507f2a2640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50780f6850 con 0x7f50780719a0 2024-02-21T23:00:47.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.854+0000 7f507f2a2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50780f6570 con 0x7f5078184150 2024-02-21T23:00:47.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.854+0000 7f507f2a2640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50780709b0 con 0x7f5078186f10 2024-02-21T23:00:47.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.854+0000 7f507d83f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5078186f10 0x7f5078221e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:47.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.854+0000 7f507d83f640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5078186f10 0x7f5078221e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:49440/0 (socket says 172.21.15.181:49440) 2024-02-21T23:00:47.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.854+0000 7f507d83f640 1 -- 172.21.15.181:0/4244720834 learned_addr learned my addr 172.21.15.181:0/4244720834 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-02-21T23:00:47.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.854+0000 7f507c83d640 1 --2- 172.21.15.181:0/4244720834 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5078184150 0x7f50782218f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:47.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.854+0000 7f507d83f640 1 -- 172.21.15.181:0/4244720834 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5078184150 msgr2=0x7f50782218f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:47.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.854+0000 7f507d83f640 1 --2- 172.21.15.181:0/4244720834 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5078184150 0x7f50782218f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:47.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.854+0000 7f507d83f640 1 -- 172.21.15.181:0/4244720834 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f50780719a0 msgr2=0x7f5078220110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:47.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.854+0000 7f507d83f640 1 --2- 172.21.15.181:0/4244720834 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f50780719a0 0x7f5078220110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:47.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.854+0000 7f507d83f640 1 -- 172.21.15.181:0/4244720834 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5078212b20 con 0x7f5078186f10 2024-02-21T23:00:47.846 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.855+0000 7f507d83f640 1 --2- 172.21.15.181:0/4244720834 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5078186f10 0x7f5078221e30 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f507000c780 tx=0x7f507000cc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:00:47.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.855+0000 7f506dffb640 1 -- 172.21.15.181:0/4244720834 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5070017070 con 0x7f5078186f10 2024-02-21T23:00:47.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.855+0000 7f506dffb640 1 -- 172.21.15.181:0/4244720834 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5070003da0 con 0x7f5078186f10 2024-02-21T23:00:47.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.855+0000 7f507f2a2640 1 -- 172.21.15.181:0/4244720834 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5078212840 con 0x7f5078186f10 2024-02-21T23:00:47.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.855+0000 7f506dffb640 1 -- 172.21.15.181:0/4244720834 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50700052b0 con 0x7f5078186f10 2024-02-21T23:00:47.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.855+0000 7f506dffb640 1 -- 172.21.15.181:0/4244720834 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f507001a070 con 0x7f5078186f10 2024-02-21T23:00:47.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.855+0000 7f507f2a2640 1 -- 172.21.15.181:0/4244720834 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5078220e10 con 0x7f5078186f10 2024-02-21T23:00:47.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.855+0000 7f506dffb640 1 -- 172.21.15.181:0/4244720834 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 1760+0+0 (secure 0 0 0) 0x7f507000ad70 con 0x7f5078186f10 2024-02-21T23:00:47.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.856+0000 7f507f2a2640 1 -- 172.21.15.181:0/4244720834 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5078066c60 con 0x7f5078186f10 2024-02-21T23:00:47.847 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.858+0000 7f506dffb640 1 -- 172.21.15.181:0/4244720834 <== mon.2 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f5070022020 con 0x7f5078186f10 2024-02-21T23:00:47.888 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-02-21T23:00:47.899+0000 7f29159b1040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-21T23:00:47.919 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.930+0000 7f507f2a2640 1 -- 172.21.15.181:0/4244720834 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd new", "uuid": "72af1b02-b965-4d6a-8964-527ec24c4daa", "id": 9} v 0) v1 -- 0x7f5078187720 con 0x7f5078186f10 2024-02-21T23:00:47.925 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.936+0000 7f506dffb640 1 -- 172.21.15.181:0/4244720834 <== mon.2 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "72af1b02-b965-4d6a-8964-527ec24c4daa", "id": 9}]=0 v12) v1 ==== 112+0+2 (secure 0 0 0) 0x7f507000a6b0 con 0x7f5078186f10 2024-02-21T23:00:47.925 INFO:teuthology.orchestra.run.smithi181.stdout:9 2024-02-21T23:00:47.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.937+0000 7f507f2a2640 1 -- 172.21.15.181:0/4244720834 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5078186f10 msgr2=0x7f5078221e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:47.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.937+0000 7f507f2a2640 1 --2- 172.21.15.181:0/4244720834 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5078186f10 0x7f5078221e30 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f507000c780 tx=0x7f507000cc40 comp rx=0 tx=0).stop 2024-02-21T23:00:47.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.937+0000 7f507f2a2640 1 -- 172.21.15.181:0/4244720834 shutdown_connections 2024-02-21T23:00:47.926 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.937+0000 7f507f2a2640 1 --2- 172.21.15.181:0/4244720834 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5078186f10 0x7f5078221e30 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:47.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.937+0000 7f507f2a2640 1 --2- 172.21.15.181:0/4244720834 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5078184150 0x7f50782218f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:47.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.937+0000 7f507f2a2640 1 --2- 172.21.15.181:0/4244720834 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f50780719a0 0x7f5078220110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:47.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.937+0000 7f507f2a2640 1 -- 172.21.15.181:0/4244720834 >> 172.21.15.181:0/4244720834 conn(0x7f50780cf780 msgr2=0x7f507808cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:00:47.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.937+0000 7f507f2a2640 1 -- 172.21.15.181:0/4244720834 shutdown_connections 2024-02-21T23:00:47.927 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:47.937+0000 7f507f2a2640 1 -- 172.21.15.181:0/4244720834 wait complete. 2024-02-21T23:00:47.936 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --cluster ceph osd new adb5cb06-6453-41e4-b847-d7c78bbb7d4e 10 2024-02-21T23:00:48.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.047+0000 7f91272ad640 1 Processor -- start 2024-02-21T23:00:48.037 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.048+0000 7f91272ad640 1 -- start start 2024-02-21T23:00:48.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.049+0000 7f91272ad640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f912017d640 0x7f912006f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:48.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.049+0000 7f91272ad640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f912006f9b0 0x7f912006b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:48.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.049+0000 7f91272ad640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f912006fe40 con 0x7f912006bb10 2024-02-21T23:00:48.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.049+0000 7f91272ad640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9120070120 con 0x7f912017d640 2024-02-21T23:00:48.040 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.049+0000 7f91272ad640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9120070400 con 0x7f912006f9b0 2024-02-21T23:00:48.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.049+0000 7f9124848640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f912006f9b0 0x7f912006b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:48.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.049+0000 7f9124848640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f912006f9b0 0x7f912006b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:49456/0 (socket says 172.21.15.181:49456) 2024-02-21T23:00:48.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.049+0000 7f9124848640 1 -- 172.21.15.181:0/2420912908 learned_addr learned my addr 172.21.15.181:0/2420912908 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-02-21T23:00:48.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.049+0000 7f9124848640 1 -- 172.21.15.181:0/2420912908 >> v2:172.21.15.99:3300/0 conn(0x7f912017d640 msgr2=0x7f912006f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:00:48.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.049+0000 7f9124848640 1 --2- 172.21.15.181:0/2420912908 >> v2:172.21.15.99:3300/0 conn(0x7f912017d640 0x7f912006f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:48.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.049+0000 7f9124848640 1 -- 172.21.15.181:0/2420912908 >> v1:172.21.15.99:6789/0 conn(0x7f912006bb10 legacy=0x7f91200718d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:00:48.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.049+0000 7f9124848640 1 -- 172.21.15.181:0/2420912908 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91200706e0 con 0x7f912006f9b0 2024-02-21T23:00:48.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.050+0000 7f9124848640 1 --2- 172.21.15.181:0/2420912908 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f912006f9b0 0x7f912006b5d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f91200ca6c0 tx=0x7f911c02b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=542886f910cc5c7 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:00:48.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.050+0000 7f9117fff640 1 -- 172.21.15.181:0/2420912908 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f911c035020 con 0x7f912006f9b0 2024-02-21T23:00:48.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.050+0000 7f9117fff640 1 -- 172.21.15.181:0/2420912908 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f911c031870 con 0x7f912006f9b0 2024-02-21T23:00:48.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.050+0000 7f9117fff640 1 -- 172.21.15.181:0/2420912908 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f911c031c40 con 0x7f912006f9b0 2024-02-21T23:00:48.041 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.050+0000 7f91272ad640 1 -- 172.21.15.181:0/2420912908 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f912006f9b0 msgr2=0x7f912006b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:48.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.050+0000 7f91272ad640 1 --2- 172.21.15.181:0/2420912908 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f912006f9b0 0x7f912006b5d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f91200ca6c0 tx=0x7f911c02b910 comp rx=0 tx=0).stop 2024-02-21T23:00:48.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.050+0000 7f91272ad640 1 -- 172.21.15.181:0/2420912908 shutdown_connections 2024-02-21T23:00:48.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.050+0000 7f91272ad640 1 --2- 172.21.15.181:0/2420912908 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f912006f9b0 0x7f912006b5d0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:48.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.050+0000 7f91272ad640 1 --2- 172.21.15.181:0/2420912908 >> v2:172.21.15.99:3300/0 conn(0x7f912017d640 0x7f912006f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:48.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.050+0000 7f91272ad640 1 -- 172.21.15.181:0/2420912908 >> 172.21.15.181:0/2420912908 conn(0x7f91200cfbd0 msgr2=0x7f91200cffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:00:48.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.051+0000 7f91272ad640 1 -- 172.21.15.181:0/2420912908 shutdown_connections 2024-02-21T23:00:48.042 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.051+0000 7f91272ad640 1 -- 172.21.15.181:0/2420912908 wait complete. 2024-02-21T23:00:48.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.052+0000 7f91272ad640 1 Processor -- start 2024-02-21T23:00:48.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.052+0000 7f91272ad640 1 -- start start 2024-02-21T23:00:48.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.053+0000 7f91272ad640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f912006bb10 0x7f9120222fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:48.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.053+0000 7f91272ad640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f912017d640 0x7f9120168590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:48.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.053+0000 7f91272ad640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f912017ae60 0x7f9120168ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:48.045 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.053+0000 7f91272ad640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9120071fe0 con 0x7f912006bb10 2024-02-21T23:00:48.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.053+0000 7f91272ad640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9120070ca0 con 0x7f912017ae60 2024-02-21T23:00:48.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.053+0000 7f91272ad640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9120072160 con 0x7f912017d640 2024-02-21T23:00:48.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.053+0000 7f9124848640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f912017d640 0x7f9120168590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:48.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.053+0000 7f9124848640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f912017d640 0x7f9120168590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:49472/0 (socket says 172.21.15.181:49472) 2024-02-21T23:00:48.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.053+0000 7f9124848640 1 -- 172.21.15.181:0/3363426639 learned_addr learned my addr 172.21.15.181:0/3363426639 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-02-21T23:00:48.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.053+0000 7f912584a640 1 --2- 172.21.15.181:0/3363426639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f912017ae60 0x7f9120168ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:48.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.053+0000 7f9124848640 1 -- 172.21.15.181:0/3363426639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f912017ae60 msgr2=0x7f9120168ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:48.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.053+0000 7f9124848640 1 --2- 172.21.15.181:0/3363426639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f912017ae60 0x7f9120168ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:48.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.053+0000 7f9124848640 1 -- 172.21.15.181:0/3363426639 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f912006bb10 msgr2=0x7f9120222fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:48.046 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.053+0000 7f9125049640 1 --2- 172.21.15.181:0/3363426639 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f912006bb10 0x7f9120222fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:48.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.053+0000 7f9124848640 1 --2- 172.21.15.181:0/3363426639 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f912006bb10 0x7f9120222fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:48.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.053+0000 7f9124848640 1 -- 172.21.15.181:0/3363426639 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f912017b390 con 0x7f912017d640 2024-02-21T23:00:48.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.053+0000 7f912584a640 1 --2- 172.21.15.181:0/3363426639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f912017ae60 0x7f9120168ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T23:00:48.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.053+0000 7f9124848640 1 --2- 172.21.15.181:0/3363426639 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f912017d640 0x7f9120168590 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f911c02b950 tx=0x7f911c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:00:48.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.054+0000 7f9115ffb640 1 -- 172.21.15.181:0/3363426639 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f911c03ad60 con 0x7f912017d640 2024-02-21T23:00:48.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.054+0000 7f9115ffb640 1 -- 172.21.15.181:0/3363426639 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f911c0443f0 con 0x7f912017d640 2024-02-21T23:00:48.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.054+0000 7f91272ad640 1 -- 172.21.15.181:0/3363426639 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f912017b670 con 0x7f912017d640 2024-02-21T23:00:48.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.054+0000 7f9115ffb640 1 -- 172.21.15.181:0/3363426639 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f911c0447e0 con 0x7f912017d640 2024-02-21T23:00:48.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.054+0000 7f91272ad640 1 -- 172.21.15.181:0/3363426639 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f912017bc30 con 0x7f912017d640 2024-02-21T23:00:48.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.054+0000 7f9115ffb640 1 -- 172.21.15.181:0/3363426639 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f911c038020 con 0x7f912017d640 2024-02-21T23:00:48.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.054+0000 7f9115ffb640 1 -- 172.21.15.181:0/3363426639 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 1875+0+0 (secure 0 0 0) 0x7f911c0303c0 con 0x7f912017d640 2024-02-21T23:00:48.047 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.055+0000 7f91272ad640 1 -- 172.21.15.181:0/3363426639 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f912008e2d0 con 0x7f912017d640 2024-02-21T23:00:48.048 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.057+0000 7f9115ffb640 1 -- 172.21.15.181:0/3363426639 <== mon.2 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f912008e2d0 con 0x7f912017d640 2024-02-21T23:00:48.065 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-02-21T23:00:48.076+0000 7f29159b1040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-21T23:00:48.117 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.128+0000 7f91272ad640 1 -- 172.21.15.181:0/3363426639 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd new", "uuid": "adb5cb06-6453-41e4-b847-d7c78bbb7d4e", "id": 10} v 0) v1 -- 0x7f91200caaf0 con 0x7f912017d640 2024-02-21T23:00:48.122 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.133+0000 7f9115ffb640 1 -- 172.21.15.181:0/3363426639 <== mon.2 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "adb5cb06-6453-41e4-b847-d7c78bbb7d4e", "id": 10}]=0 v13) v1 ==== 113+0+3 (secure 0 0 0) 0x7f91200caaf0 con 0x7f912017d640 2024-02-21T23:00:48.122 INFO:teuthology.orchestra.run.smithi181.stdout:10 2024-02-21T23:00:48.123 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.134+0000 7f91272ad640 1 -- 172.21.15.181:0/3363426639 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f912017d640 msgr2=0x7f9120168590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:48.123 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.134+0000 7f91272ad640 1 --2- 172.21.15.181:0/3363426639 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f912017d640 0x7f9120168590 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f911c02b950 tx=0x7f911c0046c0 comp rx=0 tx=0).stop 2024-02-21T23:00:48.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.134+0000 7f91272ad640 1 -- 172.21.15.181:0/3363426639 shutdown_connections 2024-02-21T23:00:48.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.134+0000 7f91272ad640 1 --2- 172.21.15.181:0/3363426639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f912017ae60 0x7f9120168ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:48.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.134+0000 7f91272ad640 1 --2- 172.21.15.181:0/3363426639 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f912017d640 0x7f9120168590 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:48.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.134+0000 7f91272ad640 1 --2- 172.21.15.181:0/3363426639 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f912006bb10 0x7f9120222fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:48.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.134+0000 7f91272ad640 1 -- 172.21.15.181:0/3363426639 >> 172.21.15.181:0/3363426639 conn(0x7f91200cfbd0 msgr2=0x7f91200cffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:00:48.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.134+0000 7f91272ad640 1 -- 172.21.15.181:0/3363426639 shutdown_connections 2024-02-21T23:00:48.124 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.134+0000 7f91272ad640 1 -- 172.21.15.181:0/3363426639 wait complete. 2024-02-21T23:00:48.133 DEBUG:teuthology.orchestra.run.smithi181:> sudo ceph --cluster ceph osd new 118563d9-1e8f-4dc7-a92c-2f4c4dc3e20f 11 2024-02-21T23:00:48.234 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.245+0000 7ffbb8ed1640 1 Processor -- start 2024-02-21T23:00:48.235 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.245+0000 7ffbb8ed1640 1 -- start start 2024-02-21T23:00:48.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.246+0000 7ffbb8ed1640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7ffbb40f8020 0x7ffbb4188e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:48.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.246+0000 7ffbb8ed1640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ffbb40f8b10 0x7ffbb4187d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:48.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.246+0000 7ffbb8ed1640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbb4189b70 con 0x7ffbb4189390 2024-02-21T23:00:48.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.246+0000 7ffbb8ed1640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbb4186d50 con 0x7ffbb40f8b10 2024-02-21T23:00:48.238 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.246+0000 7ffbb8ed1640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbb41878d0 con 0x7ffbb40f8020 2024-02-21T23:00:48.239 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.246+0000 7ffbb259c640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7ffbb40f8020 0x7ffbb4188e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:48.239 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.247+0000 7ffbb259c640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7ffbb40f8020 0x7ffbb4188e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:49474/0 (socket says 172.21.15.181:49474) 2024-02-21T23:00:48.239 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.247+0000 7ffbb259c640 1 -- 172.21.15.181:0/1028281535 learned_addr learned my addr 172.21.15.181:0/1028281535 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-02-21T23:00:48.239 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.247+0000 7ffbb2d9d640 1 --2- 172.21.15.181:0/1028281535 >> v2:172.21.15.162:3300/0 conn(0x7ffbb40f8b10 0x7ffbb4187d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:48.239 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.247+0000 7ffbb259c640 1 -- 172.21.15.181:0/1028281535 >> v2:172.21.15.162:3300/0 conn(0x7ffbb40f8b10 msgr2=0x7ffbb4187d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:00:48.239 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.247+0000 7ffbb259c640 1 --2- 172.21.15.181:0/1028281535 >> v2:172.21.15.162:3300/0 conn(0x7ffbb40f8b10 0x7ffbb4187d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:48.239 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.247+0000 7ffbb259c640 1 -- 172.21.15.181:0/1028281535 >> v1:172.21.15.162:6789/0 conn(0x7ffbb4189390 legacy=0x7ffbb40f8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:48.239 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.247+0000 7ffbb259c640 1 -- 172.21.15.181:0/1028281535 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbb4186fa0 con 0x7ffbb40f8020 2024-02-21T23:00:48.239 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.247+0000 7ffbb259c640 1 --2- 172.21.15.181:0/1028281535 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffbb40f8020 0x7ffbb4188e50 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ffbb408e190 tx=0x7ffba802b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e442ebe23a36c74 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:00:48.239 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.248+0000 7ffbb159a640 1 -- 172.21.15.181:0/1028281535 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba8035020 con 0x7ffbb40f8020 2024-02-21T23:00:48.239 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.248+0000 7ffbb159a640 1 -- 172.21.15.181:0/1028281535 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffba8031870 con 0x7ffbb40f8020 2024-02-21T23:00:48.239 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.248+0000 7ffbb159a640 1 -- 172.21.15.181:0/1028281535 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba8031c40 con 0x7ffbb40f8020 2024-02-21T23:00:48.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.248+0000 7ffbb8ed1640 1 -- 172.21.15.181:0/1028281535 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffbb40f8020 msgr2=0x7ffbb4188e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:48.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.248+0000 7ffbb8ed1640 1 --2- 172.21.15.181:0/1028281535 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffbb40f8020 0x7ffbb4188e50 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ffbb408e190 tx=0x7ffba802b910 comp rx=0 tx=0).stop 2024-02-21T23:00:48.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.248+0000 7ffbb8ed1640 1 -- 172.21.15.181:0/1028281535 shutdown_connections 2024-02-21T23:00:48.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.248+0000 7ffbb8ed1640 1 --2- 172.21.15.181:0/1028281535 >> v2:172.21.15.162:3300/0 conn(0x7ffbb40f8b10 0x7ffbb4187d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:48.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.248+0000 7ffbb8ed1640 1 --2- 172.21.15.181:0/1028281535 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffbb40f8020 0x7ffbb4188e50 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:48.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.248+0000 7ffbb8ed1640 1 -- 172.21.15.181:0/1028281535 >> 172.21.15.181:0/1028281535 conn(0x7ffbb40ce5f0 msgr2=0x7ffbb40cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:00:48.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.248+0000 7ffbb8ed1640 1 -- 172.21.15.181:0/1028281535 shutdown_connections 2024-02-21T23:00:48.240 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.248+0000 7ffbb8ed1640 1 -- 172.21.15.181:0/1028281535 wait complete. 2024-02-21T23:00:48.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.250+0000 7ffbb8ed1640 1 Processor -- start 2024-02-21T23:00:48.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.250+0000 7ffbb8ed1640 1 -- start start 2024-02-21T23:00:48.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.251+0000 7ffbb8ed1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffbb40f8020 0x7ffbb4166a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:48.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.251+0000 7ffbb8ed1640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffbb40f8b10 0x7ffbb421f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:48.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.251+0000 7ffbb8ed1640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffbb4189390 0x7ffbb40cd750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:48.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.251+0000 7ffbb8ed1640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb4187560 con 0x7ffbb40f8b10 2024-02-21T23:00:48.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.251+0000 7ffbb8ed1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb40f9f60 con 0x7ffbb40f8020 2024-02-21T23:00:48.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.251+0000 7ffbb8ed1640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb417c660 con 0x7ffbb4189390 2024-02-21T23:00:48.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.251+0000 7ffbb259c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffbb40f8020 0x7ffbb4166a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:48.243 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.251+0000 7ffbb2d9d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffbb4189390 0x7ffbb40cd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:48.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.251+0000 7ffbb259c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffbb40f8020 0x7ffbb4166a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.181:54852/0 (socket says 172.21.15.181:54852) 2024-02-21T23:00:48.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.251+0000 7ffbb259c640 1 -- 172.21.15.181:0/2254144209 learned_addr learned my addr 172.21.15.181:0/2254144209 (peer_addr_for_me v2:172.21.15.181:0/0) 2024-02-21T23:00:48.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.251+0000 7ffbb2d9d640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffbb4189390 0x7ffbb40cd750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.181:49478/0 (socket says 172.21.15.181:49478) 2024-02-21T23:00:48.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.251+0000 7ffbb2d9d640 1 -- 172.21.15.181:0/2254144209 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffbb40f8020 msgr2=0x7ffbb4166a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:48.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.251+0000 7ffbb2d9d640 1 --2- 172.21.15.181:0/2254144209 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffbb40f8020 0x7ffbb4166a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:48.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.251+0000 7ffbb2d9d640 1 -- 172.21.15.181:0/2254144209 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffbb40f8b10 msgr2=0x7ffbb421f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:48.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.251+0000 7ffbb2d9d640 1 --2- 172.21.15.181:0/2254144209 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffbb40f8b10 0x7ffbb421f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:48.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.251+0000 7ffbb2d9d640 1 -- 172.21.15.181:0/2254144209 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbb421fa80 con 0x7ffbb4189390 2024-02-21T23:00:48.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.251+0000 7ffbb2d9d640 1 --2- 172.21.15.181:0/2254144209 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffbb4189390 0x7ffbb40cd750 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ffbac007d90 tx=0x7ffbac00e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:00:48.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.252+0000 7ffba2ffd640 1 -- 172.21.15.181:0/2254144209 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbac00edd0 con 0x7ffbb4189390 2024-02-21T23:00:48.244 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.252+0000 7ffba2ffd640 1 -- 172.21.15.181:0/2254144209 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbac003990 con 0x7ffbb4189390 2024-02-21T23:00:48.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.252+0000 7ffba2ffd640 1 -- 172.21.15.181:0/2254144209 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbac003d80 con 0x7ffbb4189390 2024-02-21T23:00:48.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.252+0000 7ffbb8ed1640 1 -- 172.21.15.181:0/2254144209 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbb4178450 con 0x7ffbb4189390 2024-02-21T23:00:48.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.252+0000 7ffbb8ed1640 1 -- 172.21.15.181:0/2254144209 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbb40ccc70 con 0x7ffbb4189390 2024-02-21T23:00:48.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.252+0000 7ffba2ffd640 1 -- 172.21.15.181:0/2254144209 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7ffbac01b020 con 0x7ffbb4189390 2024-02-21T23:00:48.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.252+0000 7ffba2ffd640 1 -- 172.21.15.181:0/2254144209 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 1990+0+0 (secure 0 0 0) 0x7ffbac01dc40 con 0x7ffbb4189390 2024-02-21T23:00:48.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.253+0000 7ffbb8ed1640 1 -- 172.21.15.181:0/2254144209 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbb4068780 con 0x7ffbb4189390 2024-02-21T23:00:48.245 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.256+0000 7ffba2ffd640 1 -- 172.21.15.181:0/2254144209 <== mon.2 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7ffbac014420 con 0x7ffbb4189390 2024-02-21T23:00:48.319 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.330+0000 7ffbb8ed1640 1 -- 172.21.15.181:0/2254144209 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd new", "uuid": "118563d9-1e8f-4dc7-a92c-2f4c4dc3e20f", "id": 11} v 0) v1 -- 0x7ffbb40f90c0 con 0x7ffbb4189390 2024-02-21T23:00:48.326 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.336+0000 7ffba2ffd640 1 -- 172.21.15.181:0/2254144209 <== mon.2 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "118563d9-1e8f-4dc7-a92c-2f4c4dc3e20f", "id": 11}]=0 v14) v1 ==== 113+0+3 (secure 0 0 0) 0x7ffbac004490 con 0x7ffbb4189390 2024-02-21T23:00:48.326 INFO:teuthology.orchestra.run.smithi181.stdout:11 2024-02-21T23:00:48.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.337+0000 7ffbb8ed1640 1 -- 172.21.15.181:0/2254144209 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffbb4189390 msgr2=0x7ffbb40cd750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:48.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.337+0000 7ffbb8ed1640 1 --2- 172.21.15.181:0/2254144209 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffbb4189390 0x7ffbb40cd750 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ffbac007d90 tx=0x7ffbac00e4b0 comp rx=0 tx=0).stop 2024-02-21T23:00:48.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.337+0000 7ffbb8ed1640 1 -- 172.21.15.181:0/2254144209 shutdown_connections 2024-02-21T23:00:48.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.337+0000 7ffbb8ed1640 1 --2- 172.21.15.181:0/2254144209 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffbb4189390 0x7ffbb40cd750 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:48.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.337+0000 7ffbb8ed1640 1 --2- 172.21.15.181:0/2254144209 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffbb40f8b10 0x7ffbb421f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:48.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.337+0000 7ffbb8ed1640 1 --2- 172.21.15.181:0/2254144209 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffbb40f8020 0x7ffbb4166a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:48.327 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.337+0000 7ffbb8ed1640 1 -- 172.21.15.181:0/2254144209 >> 172.21.15.181:0/2254144209 conn(0x7ffbb40ce5f0 msgr2=0x7ffbb40ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:00:48.328 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.337+0000 7ffbb8ed1640 1 -- 172.21.15.181:0/2254144209 shutdown_connections 2024-02-21T23:00:48.328 INFO:teuthology.orchestra.run.smithi181.stderr:2024-02-21T23:00:48.337+0000 7ffbb8ed1640 1 -- 172.21.15.181:0/2254144209 wait complete. 2024-02-21T23:00:48.337 INFO:tasks.ceph.osd.0:Restarting daemon 2024-02-21T23:00:48.337 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-02-21T23:00:48.345 INFO:tasks.ceph.osd.0:Started 2024-02-21T23:00:48.345 INFO:tasks.ceph.osd.3:Restarting daemon 2024-02-21T23:00:48.345 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-02-21T23:00:48.353 INFO:tasks.ceph.osd.3:Started 2024-02-21T23:00:48.353 INFO:tasks.ceph.osd.6:Restarting daemon 2024-02-21T23:00:48.353 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-02-21T23:00:48.359 INFO:tasks.ceph.osd.6:Started 2024-02-21T23:00:48.359 INFO:tasks.ceph.osd.9:Restarting daemon 2024-02-21T23:00:48.359 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 9 2024-02-21T23:00:48.365 INFO:tasks.ceph.osd.9:Started 2024-02-21T23:00:48.365 INFO:tasks.ceph.osd.1:Restarting daemon 2024-02-21T23:00:48.365 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-02-21T23:00:48.367 INFO:tasks.ceph.osd.1:Started 2024-02-21T23:00:48.367 INFO:tasks.ceph.osd.4:Restarting daemon 2024-02-21T23:00:48.368 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-02-21T23:00:48.370 INFO:tasks.ceph.osd.4:Started 2024-02-21T23:00:48.370 INFO:tasks.ceph.osd.7:Restarting daemon 2024-02-21T23:00:48.370 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-02-21T23:00:48.372 INFO:tasks.ceph.osd.7:Started 2024-02-21T23:00:48.372 INFO:tasks.ceph.osd.10:Restarting daemon 2024-02-21T23:00:48.372 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 10 2024-02-21T23:00:48.375 INFO:tasks.ceph.osd.10:Started 2024-02-21T23:00:48.375 INFO:tasks.ceph.osd.2:Restarting daemon 2024-02-21T23:00:48.375 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-02-21T23:00:48.377 INFO:tasks.ceph.osd.2:Started 2024-02-21T23:00:48.377 INFO:tasks.ceph.osd.5:Restarting daemon 2024-02-21T23:00:48.377 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-02-21T23:00:48.379 INFO:tasks.ceph.osd.5:Started 2024-02-21T23:00:48.379 INFO:tasks.ceph.osd.8:Restarting daemon 2024-02-21T23:00:48.379 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 8 2024-02-21T23:00:48.382 INFO:tasks.ceph.osd.8:Started 2024-02-21T23:00:48.382 INFO:tasks.ceph.osd.11:Restarting daemon 2024-02-21T23:00:48.382 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 11 2024-02-21T23:00:48.384 INFO:tasks.ceph.osd.11:Started 2024-02-21T23:00:48.384 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T23:00:48.446 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-02-21T23:00:48.457+0000 7fda7b02b040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-21T23:00:48.560 INFO:tasks.ceph.mgr.z.smithi181.stderr:2024-02-21T23:00:48.570+0000 7fe068a2b040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-21T23:00:48.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:48.611+0000 7f7e70600640 1 Processor -- start 2024-02-21T23:00:48.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:48.611+0000 7f7e70600640 1 -- start start 2024-02-21T23:00:48.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:48.613+0000 7f7e70600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f7e681861e0 0x7f7e681865c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:48.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:48.613+0000 7f7e70600640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e680cf7e0 con 0x7f7e68187a80 2024-02-21T23:00:48.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:48.613+0000 7f7e70600640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e680cfac0 con 0x7f7e680d4300 2024-02-21T23:00:48.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:48.613+0000 7f7e70600640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e68186d50 con 0x7f7e681861e0 2024-02-21T23:00:48.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:48.613+0000 7f7e6dc00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f7e681861e0 0x7f7e681865c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:48.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:48.613+0000 7f7e6dc00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f7e681861e0 0x7f7e681865c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:51650/0 (socket says 172.21.15.99:51650) 2024-02-21T23:00:48.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:48.613+0000 7f7e6dc00640 1 -- 172.21.15.99:0/4075878820 learned_addr learned my addr 172.21.15.99:0/4075878820 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:00:48.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:48.613+0000 7f7e6dc00640 1 -- 172.21.15.99:0/4075878820 >> v1:172.21.15.181:6789/0 conn(0x7f7e680d4300 legacy=0x7f7e680d4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:48.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:48.613+0000 7f7e6dc00640 1 -- 172.21.15.99:0/4075878820 >> v1:172.21.15.99:6789/0 conn(0x7f7e68187a80 legacy=0x7f7e68187f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:48.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:48.613+0000 7f7e6dc00640 1 -- 172.21.15.99:0/4075878820 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e68186fa0 con 0x7f7e681861e0 2024-02-21T23:00:48.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:48.615+0000 7f7e6dc00640 1 --2- 172.21.15.99:0/4075878820 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e681861e0 0x7f7e681865c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c009870 tx=0x7f7e5c02b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3450365aab00be9e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:00:48.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:48.615+0000 7f7e67e00640 1 -- 172.21.15.99:0/4075878820 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c034070 con 0x7f7e681861e0 2024-02-21T23:00:48.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:48.615+0000 7f7e67e00640 1 -- 172.21.15.99:0/4075878820 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e5c030860 con 0x7f7e681861e0 2024-02-21T23:00:48.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:48.615+0000 7f7e67e00640 1 -- 172.21.15.99:0/4075878820 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c030c30 con 0x7f7e681861e0 2024-02-21T23:00:48.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:48.615+0000 7f7e70600640 1 -- 172.21.15.99:0/4075878820 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e681861e0 msgr2=0x7f7e681865c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:48.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:48.615+0000 7f7e70600640 1 --2- 172.21.15.99:0/4075878820 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e681861e0 0x7f7e681865c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c009870 tx=0x7f7e5c02b9a0 comp rx=0 tx=0).stop 2024-02-21T23:00:48.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:48.615+0000 7f7e70600640 1 -- 172.21.15.99:0/4075878820 shutdown_connections 2024-02-21T23:00:48.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:48.615+0000 7f7e70600640 1 --2- 172.21.15.99:0/4075878820 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e681861e0 0x7f7e681865c0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:48.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:48.616+0000 7f7e70600640 1 -- 172.21.15.99:0/4075878820 >> 172.21.15.99:0/4075878820 conn(0x7f7e680d6ac0 msgr2=0x7f7e680740b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:00:48.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:48.616+0000 7f7e70600640 1 -- 172.21.15.99:0/4075878820 shutdown_connections 2024-02-21T23:00:48.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:48.616+0000 7f7e70600640 1 -- 172.21.15.99:0/4075878820 wait complete. 2024-02-21T23:00:48.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:48.617+0000 7f7e70600640 1 Processor -- start 2024-02-21T23:00:48.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:48.618+0000 7f7e70600640 1 -- start start 2024-02-21T23:00:48.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:48.619+0000 7f7e70600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7e680d4300 0x7f7e6816b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:48.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:48.619+0000 7f7e70600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e681861e0 0x7f7e68188e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:48.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:48.619+0000 7f7e70600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e68187a80 0x7f7e6821d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:48.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:48.619+0000 7f7e70600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e68188620 con 0x7f7e681861e0 2024-02-21T23:00:48.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:48.619+0000 7f7e70600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e681875f0 con 0x7f7e68187a80 2024-02-21T23:00:48.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:48.619+0000 7f7e70600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e680ceeb0 con 0x7f7e680d4300 2024-02-21T23:00:48.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:48.619+0000 7f7e6d200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e681861e0 0x7f7e68188e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:48.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:48.619+0000 7f7e6dc00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7e680d4300 0x7f7e6816b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:48.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:48.619+0000 7f7e6d200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e681861e0 0x7f7e68188e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:51746/0 (socket says 172.21.15.99:51746) 2024-02-21T23:00:48.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:48.619+0000 7f7e6dc00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7e680d4300 0x7f7e6816b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:41814/0 (socket says 172.21.15.99:41814) 2024-02-21T23:00:48.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:48.619+0000 7f7e6d200640 1 -- 172.21.15.99:0/3607626525 learned_addr learned my addr 172.21.15.99:0/3607626525 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:00:48.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:48.619+0000 7f7e6e600640 1 --2- 172.21.15.99:0/3607626525 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e68187a80 0x7f7e6821d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:48.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:48.620+0000 7f7e6d200640 1 -- 172.21.15.99:0/3607626525 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7e680d4300 msgr2=0x7f7e6816b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:48.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:48.620+0000 7f7e6d200640 1 --2- 172.21.15.99:0/3607626525 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7e680d4300 0x7f7e6816b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:48.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:48.620+0000 7f7e6d200640 1 -- 172.21.15.99:0/3607626525 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e68187a80 msgr2=0x7f7e6821d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:48.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:48.620+0000 7f7e6d200640 1 --2- 172.21.15.99:0/3607626525 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e68187a80 0x7f7e6821d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:48.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:48.620+0000 7f7e6d200640 1 -- 172.21.15.99:0/3607626525 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e68189390 con 0x7f7e681861e0 2024-02-21T23:00:48.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:48.620+0000 7f7e6dc00640 1 --2- 172.21.15.99:0/3607626525 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7e680d4300 0x7f7e6816b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:00:48.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:48.620+0000 7f7e6e600640 1 --2- 172.21.15.99:0/3607626525 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e68187a80 0x7f7e6821d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:00:48.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:48.620+0000 7f7e6d200640 1 --2- 172.21.15.99:0/3607626525 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e681861e0 0x7f7e68188e50 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7e5400c3c0 tx=0x7f7e5400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:00:48.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:48.620+0000 7f7e65600640 1 -- 172.21.15.99:0/3607626525 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e540052d0 con 0x7f7e681861e0 2024-02-21T23:00:48.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:48.620+0000 7f7e65600640 1 -- 172.21.15.99:0/3607626525 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e54005490 con 0x7f7e681861e0 2024-02-21T23:00:48.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:48.620+0000 7f7e70600640 1 -- 172.21.15.99:0/3607626525 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e68189660 con 0x7f7e681861e0 2024-02-21T23:00:48.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:48.620+0000 7f7e65600640 1 -- 172.21.15.99:0/3607626525 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e54007260 con 0x7f7e681861e0 2024-02-21T23:00:48.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:48.620+0000 7f7e70600640 1 -- 172.21.15.99:0/3607626525 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e68189c20 con 0x7f7e681861e0 2024-02-21T23:00:48.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:48.620+0000 7f7e65600640 1 -- 172.21.15.99:0/3607626525 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f7e54007400 con 0x7f7e681861e0 2024-02-21T23:00:48.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:48.621+0000 7f7e65600640 1 -- 172.21.15.99:0/3607626525 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2105+0+0 (secure 0 0 0) 0x7f7e54003a00 con 0x7f7e681861e0 2024-02-21T23:00:48.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:48.622+0000 7f7e70600640 1 -- 172.21.15.99:0/3607626525 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e680d3630 con 0x7f7e681861e0 2024-02-21T23:00:48.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:48.624+0000 7f7e65600640 1 -- 172.21.15.99:0/3607626525 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f7e540035f0 con 0x7f7e681861e0 2024-02-21T23:00:48.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:48.690+0000 7f7e70600640 1 -- 172.21.15.99:0/3607626525 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7e680d3350 con 0x7f7e681861e0 2024-02-21T23:00:48.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:48.690+0000 7f7e65600640 1 -- 172.21.15.99:0/3607626525 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+9967 (secure 0 0 0) 0x7f7e54003ce0 con 0x7f7e681861e0 2024-02-21T23:00:48.680 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T23:00:48.680 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":14,"fsid":"e8af98cd-45a1-425f-96a7-f24da8ee4efb","created":"2024-02-21T23:00:44.699708+0000","modified":"2024-02-21T23:00:48.332297+0000","last_up_change":"0.000000","last_in_change":"2024-02-21T23:00:48.332297+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c49de9b2-dc53-4882-b14c-7059ed40bf59","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"58398292-2fe5-4291-94fd-03a0ca29d49d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"94cddec1-e08f-438d-a7c8-48a0e47d71a6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d29abb74-9b89-4fd7-88b1-7c2eb8231189","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"0d8c9ea3-880a-4d69-9dcb-cf7d35abd449","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"2e3a9340-6fd0-4d7a-8e00-fe305649296e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d9e37ce7-1b0e-4019-8f2e-b670403abf7e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"49988754-232e-4b8c-bd72-bfa25b418e5a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"ebc6e462-8368-4d64-b242-9c8735ac672c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"72af1b02-b965-4d6a-8964-527ec24c4daa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"adb5cb06-6453-41e4-b847-d7c78bbb7d4e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"118563d9-1e8f-4dc7-a92c-2f4c4dc3e20f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T23:00:48.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:48.691+0000 7f7e70600640 1 -- 172.21.15.99:0/3607626525 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e681861e0 msgr2=0x7f7e68188e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:48.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:48.691+0000 7f7e70600640 1 --2- 172.21.15.99:0/3607626525 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e681861e0 0x7f7e68188e50 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7e5400c3c0 tx=0x7f7e5400c880 comp rx=0 tx=0).stop 2024-02-21T23:00:48.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:48.691+0000 7f7e70600640 1 -- 172.21.15.99:0/3607626525 shutdown_connections 2024-02-21T23:00:48.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:48.691+0000 7f7e70600640 1 --2- 172.21.15.99:0/3607626525 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e68187a80 0x7f7e6821d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:48.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:48.691+0000 7f7e70600640 1 --2- 172.21.15.99:0/3607626525 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e681861e0 0x7f7e68188e50 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:48.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:48.691+0000 7f7e70600640 1 --2- 172.21.15.99:0/3607626525 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7e680d4300 0x7f7e6816b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:48.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:48.691+0000 7f7e70600640 1 -- 172.21.15.99:0/3607626525 >> 172.21.15.99:0/3607626525 conn(0x7f7e680d6ac0 msgr2=0x7f7e681865c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:00:48.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:48.692+0000 7f7e70600640 1 -- 172.21.15.99:0/3607626525 shutdown_connections 2024-02-21T23:00:48.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:48.692+0000 7f7e70600640 1 -- 172.21.15.99:0/3607626525 wait complete. 2024-02-21T23:00:48.695 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-02-21T23:00:48.695 INFO:tasks.ceph:Waiting for OSDs to come up 2024-02-21T23:00:48.739 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-02-21T23:00:48.749+0000 7fda7b02b040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-21T23:00:48.791 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-02-21T23:00:48.802+0000 7fda7b02b040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-21T23:00:48.843 INFO:tasks.ceph.mgr.z.smithi181.stderr:2024-02-21T23:00:48.852+0000 7fe068a2b040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-21T23:00:48.892 INFO:tasks.ceph.mgr.z.smithi181.stderr:2024-02-21T23:00:48.903+0000 7fe068a2b040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-21T23:00:48.905 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-02-21T23:00:48.915+0000 7fda7b02b040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-21T23:00:48.967 INFO:tasks.ceph.osd.7.smithi162.stderr:2024-02-21T23:00:48.978+0000 7fd4ba38f640 -1 Falling back to public interface 2024-02-21T23:00:48.969 INFO:tasks.ceph.osd.4.smithi162.stderr:2024-02-21T23:00:48.980+0000 7f2f16615640 -1 Falling back to public interface 2024-02-21T23:00:48.980 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-02-21T23:00:48.990+0000 7f8dd2c11640 -1 Falling back to public interface 2024-02-21T23:00:48.980 INFO:tasks.ceph.osd.8.smithi181.stderr:2024-02-21T23:00:48.990+0000 7fd29a0f9640 -1 Falling back to public interface 2024-02-21T23:00:48.981 INFO:tasks.ceph.osd.8.smithi181.stderr:2024-02-21T23:00:48.990+0000 7fd298dfd640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6800/0: (98) Address already in use 2024-02-21T23:00:48.981 INFO:tasks.ceph.osd.8.smithi181.stderr:2024-02-21T23:00:48.990+0000 7fd298dfd640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6801/0: (98) Address already in use 2024-02-21T23:00:49.002 INFO:tasks.ceph.osd.10.smithi162.stderr:2024-02-21T23:00:49.013+0000 7f4b46193640 -1 Falling back to public interface 2024-02-21T23:00:49.010 INFO:tasks.ceph.osd.1.smithi162.stderr:2024-02-21T23:00:49.021+0000 7fe49d015640 -1 Falling back to public interface 2024-02-21T23:00:49.011 INFO:tasks.ceph.osd.2.smithi181.stderr:2024-02-21T23:00:49.022+0000 7f2cab549640 -1 Falling back to public interface 2024-02-21T23:00:49.012 INFO:tasks.ceph.osd.11.smithi181.stderr:2024-02-21T23:00:49.022+0000 7f7a05613640 -1 Falling back to public interface 2024-02-21T23:00:49.013 INFO:tasks.ceph.mgr.z.smithi181.stderr:2024-02-21T23:00:49.024+0000 7fe068a2b040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-21T23:00:49.044 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-02-21T23:00:49.055+0000 7f4f4a637640 -1 Falling back to public interface 2024-02-21T23:00:49.076 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-02-21T23:00:49.087+0000 7f514241b640 -1 Falling back to public interface 2024-02-21T23:00:49.076 INFO:tasks.ceph.osd.6.smithi099.stderr:2024-02-21T23:00:49.087+0000 7fde0480d640 -1 Falling back to public interface 2024-02-21T23:00:49.090 INFO:tasks.ceph.osd.9.smithi099.stderr:2024-02-21T23:00:49.101+0000 7fd834373640 -1 Falling back to public interface 2024-02-21T23:00:49.225 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-02-21T23:00:49.235+0000 7f29159b1040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-21T23:00:49.537 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-02-21T23:00:49.547+0000 7f29159b1040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-21T23:00:49.596 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-02-21T23:00:49.607+0000 7f29159b1040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-21T23:00:49.728 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-02-21T23:00:49.739+0000 7f29159b1040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-21T23:00:49.906 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-02-21T23:00:49.939 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-02-21T23:00:49.950+0000 7fda1b31a640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-02-21T23:00:49.942 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-02-21T23:00:49.952+0000 7fda1b31a640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-02-21T23:00:50.065 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:50.076+0000 7f2953e00640 1 Processor -- start 2024-02-21T23:00:50.065 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:50.076+0000 7f2953e00640 1 -- start start 2024-02-21T23:00:50.067 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:50.078+0000 7f2953e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2954187af0 0x7f29540fcd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:50.067 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:50.078+0000 7f2953e00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2954188320 con 0x7f29541864e0 2024-02-21T23:00:50.067 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:50.078+0000 7f2953e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2954188600 con 0x7f29540d1ba0 2024-02-21T23:00:50.067 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:50.078+0000 7f2953e00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29540d1000 con 0x7f2954187af0 2024-02-21T23:00:50.067 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:50.078+0000 7f2952a00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f29541864e0 0x7f29540d1490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:39748/0 (socket says 172.21.15.99:39748) 2024-02-21T23:00:50.068 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:50.078+0000 7f2952a00640 1 -- 172.21.15.99:0/3429369356 learned_addr learned my addr 172.21.15.99:0/3429369356 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:00:50.068 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:50.078+0000 7f2953400640 1 --2- 172.21.15.99:0/3429369356 >> v2:172.21.15.162:3300/0 conn(0x7f2954187af0 0x7f29540fcd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:50.069 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:50.079+0000 7f2952000640 1 -- 172.21.15.99:0/3429369356 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3065057069 0 0) 0x7f2954188600 con 0x7f29540d1ba0 2024-02-21T23:00:50.069 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:50.079+0000 7f2952000640 1 -- 172.21.15.99:0/3429369356 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2938003520 con 0x7f29540d1ba0 2024-02-21T23:00:50.069 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:50.079+0000 7f2953400640 1 -- 172.21.15.99:0/3429369356 >> v1:172.21.15.162:6789/0 conn(0x7f29540d1ba0 legacy=0x7f29540fc5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:50.069 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:50.079+0000 7f2953400640 1 -- 172.21.15.99:0/3429369356 >> v1:172.21.15.99:6789/0 conn(0x7f29541864e0 legacy=0x7f29540d1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:50.069 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:50.079+0000 7f2952000640 1 -- 172.21.15.99:0/3429369356 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2762926484 0 0) 0x7f2954188320 con 0x7f29541864e0 2024-02-21T23:00:50.069 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:50.079+0000 7f2953400640 1 -- 172.21.15.99:0/3429369356 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29541888e0 con 0x7f2954187af0 2024-02-21T23:00:50.069 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:50.080+0000 7f2953400640 1 --2- 172.21.15.99:0/3429369356 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2954187af0 0x7f29540fcd00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f294c009d90 tx=0x7f294c02be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f75503637f52b519 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:00:50.070 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:50.080+0000 7f2952000640 1 -- 172.21.15.99:0/3429369356 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f294c039070 con 0x7f2954187af0 2024-02-21T23:00:50.070 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:50.080+0000 7f2952000640 1 -- 172.21.15.99:0/3429369356 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f294c02cbd0 con 0x7f2954187af0 2024-02-21T23:00:50.070 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:50.080+0000 7f2952000640 1 -- 172.21.15.99:0/3429369356 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f294c034440 con 0x7f2954187af0 2024-02-21T23:00:50.070 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:50.081+0000 7f2953e00640 1 -- 172.21.15.99:0/3429369356 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2954187af0 msgr2=0x7f29540fcd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:50.071 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:50.081+0000 7f2953e00640 1 --2- 172.21.15.99:0/3429369356 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2954187af0 0x7f29540fcd00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f294c009d90 tx=0x7f294c02be20 comp rx=0 tx=0).stop 2024-02-21T23:00:50.071 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:50.081+0000 7f2953e00640 1 -- 172.21.15.99:0/3429369356 shutdown_connections 2024-02-21T23:00:50.071 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:50.081+0000 7f2953e00640 1 --2- 172.21.15.99:0/3429369356 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2954187af0 0x7f29540fcd00 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:50.071 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:50.081+0000 7f2953e00640 1 -- 172.21.15.99:0/3429369356 >> 172.21.15.99:0/3429369356 conn(0x7f29540d2b10 msgr2=0x7f29540d2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:00:50.071 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:50.081+0000 7f2953e00640 1 -- 172.21.15.99:0/3429369356 shutdown_connections 2024-02-21T23:00:50.071 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:50.081+0000 7f2953e00640 1 -- 172.21.15.99:0/3429369356 wait complete. 2024-02-21T23:00:50.072 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:50.083+0000 7f2953e00640 1 Processor -- start 2024-02-21T23:00:50.072 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:50.083+0000 7f2953e00640 1 -- start start 2024-02-21T23:00:50.074 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:50.084+0000 7f2953e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29540d1ba0 0x7f295416bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:50.074 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:50.084+0000 7f2953e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29541864e0 0x7f2954214af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:50.074 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:50.084+0000 7f2953e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2954187af0 0x7f2954220ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:50.075 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:50.084+0000 7f2953e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29540d2000 con 0x7f29541864e0 2024-02-21T23:00:50.075 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:50.084+0000 7f2953e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29540d0c90 con 0x7f29540d1ba0 2024-02-21T23:00:50.075 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:50.084+0000 7f2953e00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2954187f20 con 0x7f2954187af0 2024-02-21T23:00:50.075 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:50.084+0000 7f294be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29541864e0 0x7f2954214af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:50.075 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:50.084+0000 7f294be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29541864e0 0x7f2954214af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:51750/0 (socket says 172.21.15.99:51750) 2024-02-21T23:00:50.075 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:50.084+0000 7f294be00640 1 -- 172.21.15.99:0/2407997098 learned_addr learned my addr 172.21.15.99:0/2407997098 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:00:50.075 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:50.084+0000 7f2952a00640 1 --2- 172.21.15.99:0/2407997098 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29540d1ba0 0x7f295416bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:50.075 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:50.084+0000 7f2953400640 1 --2- 172.21.15.99:0/2407997098 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2954187af0 0x7f2954220ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:50.075 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:50.085+0000 7f294be00640 1 -- 172.21.15.99:0/2407997098 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2954187af0 msgr2=0x7f2954220ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:50.075 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:50.085+0000 7f294be00640 1 --2- 172.21.15.99:0/2407997098 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2954187af0 0x7f2954220ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:50.075 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:50.085+0000 7f294be00640 1 -- 172.21.15.99:0/2407997098 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29540d1ba0 msgr2=0x7f295416bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:50.075 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:50.085+0000 7f294be00640 1 --2- 172.21.15.99:0/2407997098 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29540d1ba0 0x7f295416bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:50.075 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:50.085+0000 7f294be00640 1 -- 172.21.15.99:0/2407997098 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2954223060 con 0x7f29541864e0 2024-02-21T23:00:50.075 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:50.085+0000 7f294be00640 1 --2- 172.21.15.99:0/2407997098 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29541864e0 0x7f2954214af0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f293c00c500 tx=0x7f293c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:00:50.076 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:50.085+0000 7f294aa00640 1 -- 172.21.15.99:0/2407997098 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f293c0052d0 con 0x7f29541864e0 2024-02-21T23:00:50.076 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:50.085+0000 7f294aa00640 1 -- 172.21.15.99:0/2407997098 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f293c005490 con 0x7f29541864e0 2024-02-21T23:00:50.076 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:50.085+0000 7f2953e00640 1 -- 172.21.15.99:0/2407997098 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29542154c0 con 0x7f29541864e0 2024-02-21T23:00:50.076 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:50.085+0000 7f294aa00640 1 -- 172.21.15.99:0/2407997098 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f293c012870 con 0x7f29541864e0 2024-02-21T23:00:50.076 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:50.085+0000 7f2953e00640 1 -- 172.21.15.99:0/2407997098 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2954215a80 con 0x7f29541864e0 2024-02-21T23:00:50.076 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:50.086+0000 7f2953e00640 1 -- 172.21.15.99:0/2407997098 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2954068290 con 0x7f29541864e0 2024-02-21T23:00:50.077 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:50.088+0000 7f294aa00640 1 -- 172.21.15.99:0/2407997098 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 3) v1 ==== 134194+0+0 (secure 0 0 0) 0x7f293c012a10 con 0x7f29541864e0 2024-02-21T23:00:50.078 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:50.089+0000 7f294aa00640 1 --2- 172.21.15.99:0/2407997098 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f293009ebb0 0x7f29300a1070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:50.078 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:50.090+0000 7f294aa00640 1 -- 172.21.15.99:0/2407997098 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2105+0+0 (secure 0 0 0) 0x7f293c0c7b50 con 0x7f29541864e0 2024-02-21T23:00:50.079 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:50.090+0000 7f2952a00640 1 --2- 172.21.15.99:0/2407997098 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f293009ebb0 0x7f29300a1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:50.079 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:50.090+0000 7f2952a00640 1 --2- 172.21.15.99:0/2407997098 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f293009ebb0 0x7f29300a1070 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2944000f60 tx=0x7f2944007d50 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:00:50.083 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:50.094+0000 7f294aa00640 1 -- 172.21.15.99:0/2407997098 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f293c0979d0 con 0x7f29541864e0 2024-02-21T23:00:50.276 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:50.287+0000 7f2953e00640 1 -- 172.21.15.99:0/2407997098 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2954091790 con 0x7f29541864e0 2024-02-21T23:00:50.277 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:50.288+0000 7f294aa00640 1 -- 172.21.15.99:0/2407997098 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+9967 (secure 0 0 0) 0x7f293c0972d0 con 0x7f29541864e0 2024-02-21T23:00:50.278 INFO:teuthology.misc.health.smithi099.stdout: 2024-02-21T23:00:50.278 INFO:teuthology.misc.health.smithi099.stdout:{"epoch":14,"fsid":"e8af98cd-45a1-425f-96a7-f24da8ee4efb","created":"2024-02-21T23:00:44.699708+0000","modified":"2024-02-21T23:00:48.332297+0000","last_up_change":"0.000000","last_in_change":"2024-02-21T23:00:48.332297+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c49de9b2-dc53-4882-b14c-7059ed40bf59","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"58398292-2fe5-4291-94fd-03a0ca29d49d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"94cddec1-e08f-438d-a7c8-48a0e47d71a6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d29abb74-9b89-4fd7-88b1-7c2eb8231189","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"0d8c9ea3-880a-4d69-9dcb-cf7d35abd449","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"2e3a9340-6fd0-4d7a-8e00-fe305649296e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d9e37ce7-1b0e-4019-8f2e-b670403abf7e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"49988754-232e-4b8c-bd72-bfa25b418e5a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"ebc6e462-8368-4d64-b242-9c8735ac672c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"72af1b02-b965-4d6a-8964-527ec24c4daa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"adb5cb06-6453-41e4-b847-d7c78bbb7d4e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"118563d9-1e8f-4dc7-a92c-2f4c4dc3e20f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T23:00:50.281 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:50.291+0000 7f2953e00640 1 -- 172.21.15.99:0/2407997098 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f293009ebb0 msgr2=0x7f29300a1070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:50.281 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:50.291+0000 7f2953e00640 1 --2- 172.21.15.99:0/2407997098 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f293009ebb0 0x7f29300a1070 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2944000f60 tx=0x7f2944007d50 comp rx=0 tx=0).stop 2024-02-21T23:00:50.281 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:50.291+0000 7f2953e00640 1 -- 172.21.15.99:0/2407997098 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29541864e0 msgr2=0x7f2954214af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:50.282 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:50.291+0000 7f2953e00640 1 --2- 172.21.15.99:0/2407997098 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29541864e0 0x7f2954214af0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f293c00c500 tx=0x7f293c00c9c0 comp rx=0 tx=0).stop 2024-02-21T23:00:50.282 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:50.292+0000 7f2953e00640 1 -- 172.21.15.99:0/2407997098 shutdown_connections 2024-02-21T23:00:50.282 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:50.292+0000 7f2953e00640 1 --2- 172.21.15.99:0/2407997098 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f293009ebb0 0x7f29300a1070 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:50.282 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:50.292+0000 7f2953e00640 1 --2- 172.21.15.99:0/2407997098 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2954187af0 0x7f2954220ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:50.282 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:50.292+0000 7f2953e00640 1 --2- 172.21.15.99:0/2407997098 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29541864e0 0x7f2954214af0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:50.282 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:50.292+0000 7f2953e00640 1 --2- 172.21.15.99:0/2407997098 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29540d1ba0 0x7f295416bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:50.282 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:50.292+0000 7f2953e00640 1 -- 172.21.15.99:0/2407997098 >> 172.21.15.99:0/2407997098 conn(0x7f29540d2b10 msgr2=0x7f29540fcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:00:50.282 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:50.292+0000 7f2953e00640 1 -- 172.21.15.99:0/2407997098 shutdown_connections 2024-02-21T23:00:50.282 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:50.292+0000 7f2953e00640 1 -- 172.21.15.99:0/2407997098 wait complete. 2024-02-21T23:00:50.294 DEBUG:teuthology.misc:0 of 12 OSDs are up 2024-02-21T23:00:52.407 INFO:tasks.ceph.osd.7.smithi162.stderr:2024-02-21T23:00:52.417+0000 7fd4ba38f640 -1 osd.7 0 log_to_monitors true 2024-02-21T23:00:52.420 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-02-21T23:00:52.431+0000 7f8dd2c11640 -1 osd.5 0 log_to_monitors true 2024-02-21T23:00:52.429 INFO:tasks.ceph.osd.9.smithi099.stderr:2024-02-21T23:00:52.440+0000 7fd834373640 -1 osd.9 0 log_to_monitors true 2024-02-21T23:00:52.456 INFO:tasks.ceph.osd.4.smithi162.stderr:2024-02-21T23:00:52.466+0000 7f2f16615640 -1 osd.4 0 log_to_monitors true 2024-02-21T23:00:52.468 INFO:tasks.ceph.osd.8.smithi181.stderr:2024-02-21T23:00:52.479+0000 7fd29a0f9640 -1 osd.8 0 log_to_monitors true 2024-02-21T23:00:52.474 INFO:tasks.ceph.osd.11.smithi181.stderr:2024-02-21T23:00:52.485+0000 7f7a05613640 -1 osd.11 0 log_to_monitors true 2024-02-21T23:00:52.480 INFO:tasks.ceph.osd.10.smithi162.stderr:2024-02-21T23:00:52.491+0000 7f4b46193640 -1 osd.10 0 log_to_monitors true 2024-02-21T23:00:52.514 INFO:tasks.ceph.osd.2.smithi181.stderr:2024-02-21T23:00:52.525+0000 7f2cab549640 -1 osd.2 0 log_to_monitors true 2024-02-21T23:00:52.522 INFO:tasks.ceph.osd.1.smithi162.stderr:2024-02-21T23:00:52.532+0000 7fe49d015640 -1 osd.1 0 log_to_monitors true 2024-02-21T23:00:52.569 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-02-21T23:00:52.580+0000 7f4f4a637640 -1 osd.3 0 log_to_monitors true 2024-02-21T23:00:52.626 INFO:tasks.ceph.osd.6.smithi099.stderr:2024-02-21T23:00:52.637+0000 7fde0480d640 -1 osd.6 0 log_to_monitors true 2024-02-21T23:00:52.658 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-02-21T23:00:52.670+0000 7f514241b640 -1 osd.0 0 log_to_monitors true 2024-02-21T23:00:54.702 INFO:tasks.ceph.osd.7.smithi162.stderr:2024-02-21T23:00:54.712+0000 7fd4b5ff7640 -1 osd.7 0 waiting for initial osdmap 2024-02-21T23:00:54.721 INFO:tasks.ceph.osd.2.smithi181.stderr:2024-02-21T23:00:54.732+0000 7f2ca71f7640 -1 osd.2 0 waiting for initial osdmap 2024-02-21T23:00:54.726 INFO:tasks.ceph.osd.10.smithi162.stderr:2024-02-21T23:00:54.737+0000 7f4b425f8640 -1 osd.10 0 waiting for initial osdmap 2024-02-21T23:00:54.727 INFO:tasks.ceph.osd.4.smithi162.stderr:2024-02-21T23:00:54.738+0000 7f2f11bf7640 -1 osd.4 0 waiting for initial osdmap 2024-02-21T23:00:54.727 INFO:tasks.ceph.osd.7.smithi162.stderr:2024-02-21T23:00:54.738+0000 7fd4ade80640 -1 osd.7 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-21T23:00:54.738 INFO:tasks.ceph.osd.2.smithi181.stderr:2024-02-21T23:00:54.749+0000 7f2c9f080640 -1 osd.2 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-21T23:00:54.745 INFO:tasks.ceph.osd.4.smithi162.stderr:2024-02-21T23:00:54.756+0000 7f2f09a80640 -1 osd.4 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-21T23:00:54.745 INFO:tasks.ceph.osd.10.smithi162.stderr:2024-02-21T23:00:54.756+0000 7f4b39c80640 -1 osd.10 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-21T23:00:54.746 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-02-21T23:00:54.757+0000 7f8dce1f7640 -1 osd.5 0 waiting for initial osdmap 2024-02-21T23:00:54.756 INFO:tasks.ceph.osd.8.smithi181.stderr:2024-02-21T23:00:54.766+0000 7fd295df7640 -1 osd.8 0 waiting for initial osdmap 2024-02-21T23:00:54.761 INFO:tasks.ceph.osd.5.smithi181.stderr:2024-02-21T23:00:54.772+0000 7f8dc6080640 -1 osd.5 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-21T23:00:54.768 INFO:tasks.ceph.osd.11.smithi181.stderr:2024-02-21T23:00:54.779+0000 7f7a00bf7640 -1 osd.11 0 waiting for initial osdmap 2024-02-21T23:00:54.769 INFO:tasks.ceph.osd.8.smithi181.stderr:2024-02-21T23:00:54.780+0000 7fd28dc80640 -1 osd.8 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-21T23:00:54.783 INFO:tasks.ceph.osd.11.smithi181.stderr:2024-02-21T23:00:54.794+0000 7f79f8a80640 -1 osd.11 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-21T23:00:54.933 INFO:tasks.ceph.osd.1.smithi162.stderr:2024-02-21T23:00:54.944+0000 7fe4985f7640 -1 osd.1 0 waiting for initial osdmap 2024-02-21T23:00:54.944 INFO:tasks.ceph.osd.1.smithi162.stderr:2024-02-21T23:00:54.955+0000 7fe4905e7640 -1 osd.1 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-21T23:00:55.165 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-02-21T23:00:55.176+0000 7f4f45c00640 -1 osd.3 0 waiting for initial osdmap 2024-02-21T23:00:55.176 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-02-21T23:00:55.187+0000 7f4f3b200640 -1 osd.3 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-21T23:00:55.182 INFO:tasks.ceph.osd.6.smithi099.stderr:2024-02-21T23:00:55.192+0000 7fddfec00640 -1 osd.6 0 waiting for initial osdmap 2024-02-21T23:00:55.192 INFO:tasks.ceph.osd.6.smithi099.stderr:2024-02-21T23:00:55.203+0000 7fddf4c00640 -1 osd.6 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-21T23:00:55.238 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-02-21T23:00:55.249+0000 7f513d400640 -1 osd.0 0 waiting for initial osdmap 2024-02-21T23:00:55.242 INFO:tasks.ceph.osd.9.smithi099.stderr:2024-02-21T23:00:55.253+0000 7fd82ee00640 -1 osd.9 0 waiting for initial osdmap 2024-02-21T23:00:55.245 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-02-21T23:00:55.256+0000 7f5132a00640 -1 osd.0 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-21T23:00:55.254 INFO:tasks.ceph.osd.9.smithi099.stderr:2024-02-21T23:00:55.265+0000 7fd824e00640 -1 osd.9 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-21T23:00:57.504 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-02-21T23:00:57.691 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:57.702+0000 7ff0fde00640 1 Processor -- start 2024-02-21T23:00:57.691 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:57.702+0000 7ff0fde00640 1 -- start start 2024-02-21T23:00:57.694 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:57.704+0000 7ff0fde00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff0f8184380 0x7ff0f8071a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:57.694 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:57.704+0000 7ff0fde00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0f8184760 con 0x7ff0f8071f60 2024-02-21T23:00:57.694 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:57.704+0000 7ff0fde00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0f80f5e70 con 0x7ff0f80f71f0 2024-02-21T23:00:57.694 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:57.704+0000 7ff0fde00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0f8162b50 con 0x7ff0f8184380 2024-02-21T23:00:57.694 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:57.705+0000 7ff0f6000640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7ff0f8071f60 0x7ff0f80740f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:33588/0 (socket says 172.21.15.99:33588) 2024-02-21T23:00:57.694 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:57.705+0000 7ff0f6a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff0f8184380 0x7ff0f8071a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:57.694 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:57.705+0000 7ff0f6000640 1 -- 172.21.15.99:0/2589379003 learned_addr learned my addr 172.21.15.99:0/2589379003 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:00:57.694 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:57.705+0000 7ff0f7400640 1 --1- 172.21.15.99:0/2589379003 >> v1:172.21.15.162:6789/0 conn(0x7ff0f80f71f0 0x7ff0f8074800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.99:57772/0 (socket says 172.21.15.99:57772) 2024-02-21T23:00:57.695 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:57.705+0000 7ff0f5600640 1 -- 172.21.15.99:0/2589379003 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2105554172 0 0) 0x7ff0f80f5e70 con 0x7ff0f80f71f0 2024-02-21T23:00:57.695 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:57.705+0000 7ff0f5600640 1 -- 172.21.15.99:0/2589379003 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0dc003520 con 0x7ff0f80f71f0 2024-02-21T23:00:57.695 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:57.705+0000 7ff0f6a00640 1 -- 172.21.15.99:0/2589379003 >> v1:172.21.15.162:6789/0 conn(0x7ff0f80f71f0 legacy=0x7ff0f8074800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:57.695 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:57.705+0000 7ff0f6a00640 1 -- 172.21.15.99:0/2589379003 >> v1:172.21.15.99:6789/0 conn(0x7ff0f8071f60 legacy=0x7ff0f80740f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:57.695 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:57.705+0000 7ff0f6a00640 1 -- 172.21.15.99:0/2589379003 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0f80f6150 con 0x7ff0f8184380 2024-02-21T23:00:57.697 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:57.706+0000 7ff0f6a00640 1 --2- 172.21.15.99:0/2589379003 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0f8184380 0x7ff0f8071a20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff0e80097a0 tx=0x7ff0e802b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a095150f34e1753e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:00:57.697 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:57.707+0000 7ff0f5600640 1 -- 172.21.15.99:0/2589379003 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e8035020 con 0x7ff0f8184380 2024-02-21T23:00:57.697 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:57.707+0000 7ff0f5600640 1 -- 172.21.15.99:0/2589379003 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0e8031830 con 0x7ff0f8184380 2024-02-21T23:00:57.697 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:57.707+0000 7ff0f5600640 1 -- 172.21.15.99:0/2589379003 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e8031be0 con 0x7ff0f8184380 2024-02-21T23:00:57.697 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:57.707+0000 7ff0fde00640 1 -- 172.21.15.99:0/2589379003 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0f8184380 msgr2=0x7ff0f8071a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:57.697 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:57.707+0000 7ff0fde00640 1 --2- 172.21.15.99:0/2589379003 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0f8184380 0x7ff0f8071a20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff0e80097a0 tx=0x7ff0e802b8d0 comp rx=0 tx=0).stop 2024-02-21T23:00:57.697 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:57.708+0000 7ff0fde00640 1 -- 172.21.15.99:0/2589379003 shutdown_connections 2024-02-21T23:00:57.697 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:57.708+0000 7ff0fde00640 1 --2- 172.21.15.99:0/2589379003 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0f8184380 0x7ff0f8071a20 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:57.697 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:57.708+0000 7ff0fde00640 1 -- 172.21.15.99:0/2589379003 >> 172.21.15.99:0/2589379003 conn(0x7ff0f80cf770 msgr2=0x7ff0f80cfb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:00:57.698 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:57.708+0000 7ff0fde00640 1 -- 172.21.15.99:0/2589379003 shutdown_connections 2024-02-21T23:00:57.698 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:57.708+0000 7ff0fde00640 1 -- 172.21.15.99:0/2589379003 wait complete. 2024-02-21T23:00:57.698 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:57.710+0000 7ff0fde00640 1 Processor -- start 2024-02-21T23:00:57.699 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:57.710+0000 7ff0fde00640 1 -- start start 2024-02-21T23:00:57.701 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:57.711+0000 7ff0fde00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0f8071f60 0x7ff0f80cd890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:57.701 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:57.711+0000 7ff0fde00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff0f80f71f0 0x7ff0f806bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:57.701 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:57.711+0000 7ff0fde00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff0f8184380 0x7ff0f81793c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:57.701 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:57.711+0000 7ff0fde00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f80f6710 con 0x7ff0f8184380 2024-02-21T23:00:57.701 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:57.711+0000 7ff0fde00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f80f5c20 con 0x7ff0f8071f60 2024-02-21T23:00:57.702 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:57.711+0000 7ff0fde00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f80f69f0 con 0x7ff0f80f71f0 2024-02-21T23:00:57.702 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:57.711+0000 7ff0f7400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff0f8184380 0x7ff0f81793c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:57.702 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:57.711+0000 7ff0f6a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0f8071f60 0x7ff0f80cd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:57.702 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:57.711+0000 7ff0f7400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff0f8184380 0x7ff0f81793c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56246/0 (socket says 172.21.15.99:56246) 2024-02-21T23:00:57.702 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:57.711+0000 7ff0f7400640 1 -- 172.21.15.99:0/3773523392 learned_addr learned my addr 172.21.15.99:0/3773523392 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:00:57.702 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:57.712+0000 7ff0f6000640 1 --2- 172.21.15.99:0/3773523392 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff0f80f71f0 0x7ff0f806bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:57.702 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:57.712+0000 7ff0f6a00640 1 -- 172.21.15.99:0/3773523392 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff0f80f71f0 msgr2=0x7ff0f806bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:57.702 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:57.712+0000 7ff0f6a00640 1 --2- 172.21.15.99:0/3773523392 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff0f80f71f0 0x7ff0f806bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:57.702 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:57.712+0000 7ff0f6a00640 1 -- 172.21.15.99:0/3773523392 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff0f8184380 msgr2=0x7ff0f81793c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:57.702 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:57.712+0000 7ff0f6a00640 1 --2- 172.21.15.99:0/3773523392 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff0f8184380 0x7ff0f81793c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:57.702 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:57.712+0000 7ff0f6a00640 1 -- 172.21.15.99:0/3773523392 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0f80fafe0 con 0x7ff0f8071f60 2024-02-21T23:00:57.702 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:57.712+0000 7ff0f7400640 1 --2- 172.21.15.99:0/3773523392 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff0f8184380 0x7ff0f81793c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:00:57.702 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:57.712+0000 7ff0f6a00640 1 --2- 172.21.15.99:0/3773523392 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0f8071f60 0x7ff0f80cd890 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff0e8033000 tx=0x7ff0e80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:00:57.703 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:57.713+0000 7ff0ef400640 1 -- 172.21.15.99:0/3773523392 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e8004220 con 0x7ff0f8071f60 2024-02-21T23:00:57.703 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:57.713+0000 7ff0ef400640 1 -- 172.21.15.99:0/3773523392 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0e80043c0 con 0x7ff0f8071f60 2024-02-21T23:00:57.703 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:57.713+0000 7ff0ef400640 1 -- 172.21.15.99:0/3773523392 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e803a830 con 0x7ff0f8071f60 2024-02-21T23:00:57.703 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:57.713+0000 7ff0fde00640 1 -- 172.21.15.99:0/3773523392 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0f80fad00 con 0x7ff0f8071f60 2024-02-21T23:00:57.704 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:57.713+0000 7ff0fde00640 1 -- 172.21.15.99:0/3773523392 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0f806b2f0 con 0x7ff0f8071f60 2024-02-21T23:00:57.704 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:57.714+0000 7ff0fde00640 1 -- 172.21.15.99:0/3773523392 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0f80cd340 con 0x7ff0f8071f60 2024-02-21T23:00:57.705 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:57.716+0000 7ff0ef400640 1 -- 172.21.15.99:0/3773523392 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 4) v1 ==== 134300+0+0 (secure 0 0 0) 0x7ff0e8038020 con 0x7ff0f8071f60 2024-02-21T23:00:57.706 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:57.717+0000 7ff0ef400640 1 --2- 172.21.15.99:0/3773523392 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7ff0d809ed80 0x7ff0d80a1240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:57.706 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:57.717+0000 7ff0ef400640 1 -- 172.21.15.99:0/3773523392 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 6311+0+0 (secure 0 0 0) 0x7ff0e80eaca0 con 0x7ff0f8071f60 2024-02-21T23:00:57.706 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:57.717+0000 7ff0f6000640 1 --2- 172.21.15.99:0/3773523392 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7ff0d809ed80 0x7ff0d80a1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:57.707 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:57.718+0000 7ff0f6000640 1 --2- 172.21.15.99:0/3773523392 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7ff0d809ed80 0x7ff0d80a1240 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff0f8161270 tx=0x7ff0e4001990 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:00:57.709 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:57.720+0000 7ff0ef400640 1 -- 172.21.15.99:0/3773523392 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7ff0f80cd340 con 0x7ff0f8071f60 2024-02-21T23:00:57.913 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:57.924+0000 7ff0fde00640 1 -- 172.21.15.99:0/3773523392 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff0f806d780 con 0x7ff0f8071f60 2024-02-21T23:00:57.915 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:57.926+0000 7ff0ef400640 1 -- 172.21.15.99:0/3773523392 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+17900 (secure 0 0 0) 0x7ff0e8040070 con 0x7ff0f8071f60 2024-02-21T23:00:57.915 INFO:teuthology.misc.health.smithi099.stdout: 2024-02-21T23:00:57.916 INFO:teuthology.misc.health.smithi099.stdout:{"epoch":19,"fsid":"e8af98cd-45a1-425f-96a7-f24da8ee4efb","created":"2024-02-21T23:00:44.699708+0000","modified":"2024-02-21T23:00:57.811198+0000","last_up_change":"2024-02-21T23:00:55.749829+0000","last_in_change":"2024-02-21T23:00:48.332297+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T23:00:57.020557+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{},"read_balance":{"score_type":"Fair distribution","score_acting":11.760000228881836,"score_stable":11.760000228881836,"optimal_score":0.17000000178813934,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c49de9b2-dc53-4882-b14c-7059ed40bf59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6809","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6811","nonce":1026112937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6813","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6815","nonce":1026112937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6823","nonce":1026112937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6819","nonce":1026112937}]},"public_addr":"172.21.15.99:6811/1026112937","cluster_addr":"172.21.15.99:6815/1026112937","heartbeat_back_addr":"172.21.15.99:6823/1026112937","heartbeat_front_addr":"172.21.15.99:6819/1026112937","state":["exists","up"]},{"osd":1,"uuid":"58398292-2fe5-4291-94fd-03a0ca29d49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6827","nonce":3030871566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6829","nonce":3030871566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6833","nonce":3030871566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6831","nonce":3030871566}]},"public_addr":"172.21.15.162:6827/3030871566","cluster_addr":"172.21.15.162:6829/3030871566","heartbeat_back_addr":"172.21.15.162:6833/3030871566","heartbeat_front_addr":"172.21.15.162:6831/3030871566","state":["exists","up"]},{"osd":2,"uuid":"94cddec1-e08f-438d-a7c8-48a0e47d71a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6818","nonce":2782386148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6821","nonce":2782386148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6827","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6829","nonce":2782386148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6823","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6825","nonce":2782386148}]},"public_addr":"172.21.15.181:6818/2782386148","cluster_addr":"172.21.15.181:6821/2782386148","heartbeat_back_addr":"172.21.15.181:6829/2782386148","heartbeat_front_addr":"172.21.15.181:6825/2782386148","state":["exists","up"]},{"osd":3,"uuid":"d29abb74-9b89-4fd7-88b1-7c2eb8231189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6801","nonce":2316185310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6803","nonce":2316185310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6807","nonce":2316185310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6805","nonce":2316185310}]},"public_addr":"172.21.15.99:6801/2316185310","cluster_addr":"172.21.15.99:6803/2316185310","heartbeat_back_addr":"172.21.15.99:6807/2316185310","heartbeat_front_addr":"172.21.15.99:6805/2316185310","state":["exists","up"]},{"osd":4,"uuid":"0d8c9ea3-880a-4d69-9dcb-cf7d35abd449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6811","nonce":3137681258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6813","nonce":3137681258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6817","nonce":3137681258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6815","nonce":3137681258}]},"public_addr":"172.21.15.162:6811/3137681258","cluster_addr":"172.21.15.162:6813/3137681258","heartbeat_back_addr":"172.21.15.162:6817/3137681258","heartbeat_front_addr":"172.21.15.162:6815/3137681258","state":["exists","up"]},{"osd":5,"uuid":"2e3a9340-6fd0-4d7a-8e00-fe305649296e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6801","nonce":2011264527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6803","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6805","nonce":2011264527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6811","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6813","nonce":2011264527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6807","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6809","nonce":2011264527}]},"public_addr":"172.21.15.181:6801/2011264527","cluster_addr":"172.21.15.181:6805/2011264527","heartbeat_back_addr":"172.21.15.181:6813/2011264527","heartbeat_front_addr":"172.21.15.181:6809/2011264527","state":["exists","up"]},{"osd":6,"uuid":"d9e37ce7-1b0e-4019-8f2e-b670403abf7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6810","nonce":753870050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6814","nonce":753870050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6822","nonce":753870050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6818","nonce":753870050}]},"public_addr":"172.21.15.99:6810/753870050","cluster_addr":"172.21.15.99:6814/753870050","heartbeat_back_addr":"172.21.15.99:6822/753870050","heartbeat_front_addr":"172.21.15.99:6818/753870050","state":["exists","up"]},{"osd":7,"uuid":"49988754-232e-4b8c-bd72-bfa25b418e5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6803","nonce":1659412949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6805","nonce":1659412949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6809","nonce":1659412949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6807","nonce":1659412949}]},"public_addr":"172.21.15.162:6803/1659412949","cluster_addr":"172.21.15.162:6805/1659412949","heartbeat_back_addr":"172.21.15.162:6809/1659412949","heartbeat_front_addr":"172.21.15.162:6807/1659412949","state":["exists","up"]},{"osd":8,"uuid":"ebc6e462-8368-4d64-b242-9c8735ac672c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6804","nonce":3389807042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6808","nonce":3389807042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6815","nonce":3389807042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6812","nonce":3389807042}]},"public_addr":"172.21.15.181:6804/3389807042","cluster_addr":"172.21.15.181:6808/3389807042","heartbeat_back_addr":"172.21.15.181:6815/3389807042","heartbeat_front_addr":"172.21.15.181:6812/3389807042","state":["exists","up"]},{"osd":9,"uuid":"72af1b02-b965-4d6a-8964-527ec24c4daa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6825","nonce":4055669590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6827","nonce":4055669590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6831","nonce":4055669590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6829","nonce":4055669590}]},"public_addr":"172.21.15.99:6825/4055669590","cluster_addr":"172.21.15.99:6827/4055669590","heartbeat_back_addr":"172.21.15.99:6831/4055669590","heartbeat_front_addr":"172.21.15.99:6829/4055669590","state":["exists","up"]},{"osd":10,"uuid":"adb5cb06-6453-41e4-b847-d7c78bbb7d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6819","nonce":1421879617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6821","nonce":1421879617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6825","nonce":1421879617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6823","nonce":1421879617}]},"public_addr":"172.21.15.162:6819/1421879617","cluster_addr":"172.21.15.162:6821/1421879617","heartbeat_back_addr":"172.21.15.162:6825/1421879617","heartbeat_front_addr":"172.21.15.162:6823/1421879617","state":["exists","up"]},{"osd":11,"uuid":"118563d9-1e8f-4dc7-a92c-2f4c4dc3e20f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6817","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6819","nonce":3219928272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6824","nonce":3219928272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6831","nonce":3219928272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6828","nonce":3219928272}]},"public_addr":"172.21.15.181:6819/3219928272","cluster_addr":"172.21.15.181:6824/3219928272","heartbeat_back_addr":"172.21.15.181:6831/3219928272","heartbeat_front_addr":"172.21.15.181:6828/3219928272","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.651219+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.549859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.529659+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.591004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.440836+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.414250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.630130+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.411954+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.439371+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.428173+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.511203+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.482806+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T23:00:57.918 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:57.928+0000 7ff0fde00640 1 -- 172.21.15.99:0/3773523392 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7ff0d809ed80 msgr2=0x7ff0d80a1240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:57.918 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:57.929+0000 7ff0fde00640 1 --2- 172.21.15.99:0/3773523392 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7ff0d809ed80 0x7ff0d80a1240 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff0f8161270 tx=0x7ff0e4001990 comp rx=0 tx=0).stop 2024-02-21T23:00:57.918 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:57.929+0000 7ff0fde00640 1 -- 172.21.15.99:0/3773523392 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0f8071f60 msgr2=0x7ff0f80cd890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:57.918 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:57.929+0000 7ff0fde00640 1 --2- 172.21.15.99:0/3773523392 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0f8071f60 0x7ff0f80cd890 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff0e8033000 tx=0x7ff0e80046c0 comp rx=0 tx=0).stop 2024-02-21T23:00:57.918 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:57.929+0000 7ff0fde00640 1 -- 172.21.15.99:0/3773523392 shutdown_connections 2024-02-21T23:00:57.919 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:57.929+0000 7ff0fde00640 1 --2- 172.21.15.99:0/3773523392 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7ff0d809ed80 0x7ff0d80a1240 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:57.919 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:57.929+0000 7ff0fde00640 1 --2- 172.21.15.99:0/3773523392 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff0f8184380 0x7ff0f81793c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:57.919 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:57.929+0000 7ff0fde00640 1 --2- 172.21.15.99:0/3773523392 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff0f80f71f0 0x7ff0f806bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:57.919 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:57.929+0000 7ff0fde00640 1 --2- 172.21.15.99:0/3773523392 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0f8071f60 0x7ff0f80cd890 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:57.919 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:57.929+0000 7ff0fde00640 1 -- 172.21.15.99:0/3773523392 >> 172.21.15.99:0/3773523392 conn(0x7ff0f80cf770 msgr2=0x7ff0f80cfb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:00:57.919 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:57.929+0000 7ff0fde00640 1 -- 172.21.15.99:0/3773523392 shutdown_connections 2024-02-21T23:00:57.919 INFO:teuthology.misc.health.smithi099.stderr:2024-02-21T23:00:57.929+0000 7ff0fde00640 1 -- 172.21.15.99:0/3773523392 wait complete. 2024-02-21T23:00:57.932 DEBUG:teuthology.misc:12 of 12 OSDs are up 2024-02-21T23:00:57.932 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-02-21T23:00:57.932 INFO:tasks.ceph.mds.a:Restarting daemon 2024-02-21T23:00:57.933 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-02-21T23:00:57.938 INFO:tasks.ceph.mds.a:Started 2024-02-21T23:00:57.939 INFO:tasks.ceph.mds.d:Restarting daemon 2024-02-21T23:00:57.939 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-02-21T23:00:57.944 INFO:tasks.ceph.mds.d:Started 2024-02-21T23:00:57.944 INFO:tasks.ceph.mds.g:Restarting daemon 2024-02-21T23:00:57.945 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i g 2024-02-21T23:00:57.949 INFO:tasks.ceph.mds.g:Started 2024-02-21T23:00:57.949 INFO:tasks.ceph.mds.j:Restarting daemon 2024-02-21T23:00:57.949 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i j 2024-02-21T23:00:57.953 INFO:tasks.ceph.mds.j:Started 2024-02-21T23:00:57.953 INFO:tasks.ceph.mds.b:Restarting daemon 2024-02-21T23:00:57.953 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-02-21T23:00:57.955 INFO:tasks.ceph.mds.b:Started 2024-02-21T23:00:57.956 INFO:tasks.ceph.mds.e:Restarting daemon 2024-02-21T23:00:57.956 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i e 2024-02-21T23:00:57.958 INFO:tasks.ceph.mds.e:Started 2024-02-21T23:00:57.958 INFO:tasks.ceph.mds.h:Restarting daemon 2024-02-21T23:00:57.958 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i h 2024-02-21T23:00:57.960 INFO:tasks.ceph.mds.h:Started 2024-02-21T23:00:57.960 INFO:tasks.ceph.mds.k:Restarting daemon 2024-02-21T23:00:57.960 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i k 2024-02-21T23:00:57.962 INFO:tasks.ceph.mds.k:Started 2024-02-21T23:00:57.962 INFO:tasks.ceph.mds.c:Restarting daemon 2024-02-21T23:00:57.963 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-02-21T23:00:57.965 INFO:tasks.ceph.mds.c:Started 2024-02-21T23:00:57.966 INFO:tasks.ceph.mds.f:Restarting daemon 2024-02-21T23:00:57.966 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i f 2024-02-21T23:00:57.968 INFO:tasks.ceph.mds.f:Started 2024-02-21T23:00:57.968 INFO:tasks.ceph.mds.i:Restarting daemon 2024-02-21T23:00:57.968 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i i 2024-02-21T23:00:57.970 INFO:tasks.ceph.mds.i:Started 2024-02-21T23:00:57.970 INFO:tasks.ceph.mds.l:Restarting daemon 2024-02-21T23:00:57.971 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i l 2024-02-21T23:00:57.973 INFO:tasks.ceph.mds.l:Started 2024-02-21T23:00:57.973 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-02-21T23:00:57.973 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T23:00:58.044 INFO:tasks.ceph.mds.h.smithi162.stdout:starting mds.h at 2024-02-21T23:00:58.045 INFO:tasks.ceph.mds.e.smithi162.stdout:starting mds.e at 2024-02-21T23:00:58.045 INFO:tasks.ceph.mds.b.smithi162.stdout:starting mds.b at 2024-02-21T23:00:58.049 INFO:tasks.ceph.mds.k.smithi162.stdout:starting mds.k at 2024-02-21T23:00:58.056 INFO:tasks.ceph.mds.f.smithi181.stdout:starting mds.f at 2024-02-21T23:00:58.057 INFO:tasks.ceph.mds.l.smithi181.stdout:starting mds.l at 2024-02-21T23:00:58.057 INFO:tasks.ceph.mds.c.smithi181.stdout:starting mds.c at 2024-02-21T23:00:58.058 INFO:tasks.ceph.mds.i.smithi181.stdout:starting mds.i at 2024-02-21T23:00:58.107 INFO:tasks.ceph.mds.g.smithi099.stdout:starting mds.g at 2024-02-21T23:00:58.117 INFO:tasks.ceph.mds.d.smithi099.stdout:starting mds.d at 2024-02-21T23:00:58.131 INFO:tasks.ceph.mds.a.smithi099.stdout:starting mds.a at 2024-02-21T23:00:58.135 INFO:tasks.ceph.mds.j.smithi099.stdout:starting mds.j at 2024-02-21T23:00:58.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.182+0000 7ff0f4a00640 1 Processor -- start 2024-02-21T23:00:58.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.182+0000 7ff0f4a00640 1 -- start start 2024-02-21T23:00:58.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.184+0000 7ff0f4a00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7ff0f0182a80 0x7ff0f018a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:58.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.184+0000 7ff0f4a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff0f018b980 0x7ff0f0186a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:58.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.184+0000 7ff0f4a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff0f01606a0 0x7ff0f0160b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:58.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.184+0000 7ff0f4a00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0f018a600 con 0x7ff0f018b980 2024-02-21T23:00:58.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.184+0000 7ff0f4a00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0f018a8e0 con 0x7ff0f01606a0 2024-02-21T23:00:58.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.184+0000 7ff0f4a00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0f018abc0 con 0x7ff0f0182a80 2024-02-21T23:00:58.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.184+0000 7ff0ee800640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7ff0f0182a80 0x7ff0f018a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:58.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.184+0000 7ff0ee800640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7ff0f0182a80 0x7ff0f018a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:36158/0 (socket says 172.21.15.99:36158) 2024-02-21T23:00:58.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.184+0000 7ff0ee800640 1 -- 172.21.15.99:0/384756749 learned_addr learned my addr 172.21.15.99:0/384756749 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:00:58.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.184+0000 7ff0ede00640 1 --2- 172.21.15.99:0/384756749 >> v2:172.21.15.99:3300/0 conn(0x7ff0f018b980 0x7ff0f0186a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:58.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.184+0000 7ff0ef200640 1 --2- 172.21.15.99:0/384756749 >> v2:172.21.15.162:3300/0 conn(0x7ff0f01606a0 0x7ff0f0160b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:58.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.184+0000 7ff0ee800640 1 -- 172.21.15.99:0/384756749 >> v2:172.21.15.162:3300/0 conn(0x7ff0f01606a0 msgr2=0x7ff0f0160b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:00:58.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.184+0000 7ff0ee800640 1 --2- 172.21.15.99:0/384756749 >> v2:172.21.15.162:3300/0 conn(0x7ff0f01606a0 0x7ff0f0160b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:58.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.184+0000 7ff0ee800640 1 -- 172.21.15.99:0/384756749 >> v2:172.21.15.99:3300/0 conn(0x7ff0f018b980 msgr2=0x7ff0f0186a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:00:58.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.184+0000 7ff0ee800640 1 --2- 172.21.15.99:0/384756749 >> v2:172.21.15.99:3300/0 conn(0x7ff0f018b980 0x7ff0f0186a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:58.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.184+0000 7ff0ee800640 1 -- 172.21.15.99:0/384756749 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0f018aea0 con 0x7ff0f0182a80 2024-02-21T23:00:58.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.186+0000 7ff0ee800640 1 --2- 172.21.15.99:0/384756749 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff0f0182a80 0x7ff0f018a010 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff0f018c720 tx=0x7ff0e002b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9dd8ca81904d7d09 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:00:58.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.186+0000 7ff0ed400640 1 -- 172.21.15.99:0/384756749 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e0035020 con 0x7ff0f0182a80 2024-02-21T23:00:58.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.186+0000 7ff0ed400640 1 -- 172.21.15.99:0/384756749 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0e0031800 con 0x7ff0f0182a80 2024-02-21T23:00:58.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.186+0000 7ff0ed400640 1 -- 172.21.15.99:0/384756749 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e0031bd0 con 0x7ff0f0182a80 2024-02-21T23:00:58.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.186+0000 7ff0f4a00640 1 -- 172.21.15.99:0/384756749 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff0f0182a80 msgr2=0x7ff0f018a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:58.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.186+0000 7ff0f4a00640 1 --2- 172.21.15.99:0/384756749 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff0f0182a80 0x7ff0f018a010 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff0f018c720 tx=0x7ff0e002b8a0 comp rx=0 tx=0).stop 2024-02-21T23:00:58.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.186+0000 7ff0f4a00640 1 -- 172.21.15.99:0/384756749 shutdown_connections 2024-02-21T23:00:58.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.186+0000 7ff0f4a00640 1 --2- 172.21.15.99:0/384756749 >> v2:172.21.15.99:3300/0 conn(0x7ff0f018b980 0x7ff0f0186a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:58.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.186+0000 7ff0f4a00640 1 --2- 172.21.15.99:0/384756749 >> v2:172.21.15.162:3300/0 conn(0x7ff0f01606a0 0x7ff0f0160b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:58.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.186+0000 7ff0f4a00640 1 --2- 172.21.15.99:0/384756749 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff0f0182a80 0x7ff0f018a010 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:58.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.186+0000 7ff0f4a00640 1 -- 172.21.15.99:0/384756749 >> 172.21.15.99:0/384756749 conn(0x7ff0f00d29f0 msgr2=0x7ff0f00d2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:00:58.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.187+0000 7ff0f4a00640 1 -- 172.21.15.99:0/384756749 shutdown_connections 2024-02-21T23:00:58.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.187+0000 7ff0f4a00640 1 -- 172.21.15.99:0/384756749 wait complete. 2024-02-21T23:00:58.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.188+0000 7ff0f4a00640 1 Processor -- start 2024-02-21T23:00:58.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.189+0000 7ff0f4a00640 1 -- start start 2024-02-21T23:00:58.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.190+0000 7ff0f4a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff0f01606a0 0x7ff0f017cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:58.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.190+0000 7ff0f4a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff0f0182a80 0x7ff0f01892e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:58.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.190+0000 7ff0f4a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0f018b980 0x7ff0f0189820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:58.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.190+0000 7ff0f4a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f018be00 con 0x7ff0f0182a80 2024-02-21T23:00:58.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.190+0000 7ff0f4a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f018b460 con 0x7ff0f018b980 2024-02-21T23:00:58.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.190+0000 7ff0f4a00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f0186fd0 con 0x7ff0f01606a0 2024-02-21T23:00:58.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.190+0000 7ff0ee800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff0f01606a0 0x7ff0f017cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:58.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.190+0000 7ff0ede00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff0f0182a80 0x7ff0f01892e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:58.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.190+0000 7ff0ee800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff0f01606a0 0x7ff0f017cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:36174/0 (socket says 172.21.15.99:36174) 2024-02-21T23:00:58.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.190+0000 7ff0ee800640 1 -- 172.21.15.99:0/3161073044 learned_addr learned my addr 172.21.15.99:0/3161073044 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:00:58.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.190+0000 7ff0ef200640 1 --2- 172.21.15.99:0/3161073044 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0f018b980 0x7ff0f0189820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:58.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.190+0000 7ff0ee800640 1 -- 172.21.15.99:0/3161073044 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0f018b980 msgr2=0x7ff0f0189820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:58.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.190+0000 7ff0ee800640 1 --2- 172.21.15.99:0/3161073044 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0f018b980 0x7ff0f0189820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:58.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.190+0000 7ff0ee800640 1 -- 172.21.15.99:0/3161073044 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff0f0182a80 msgr2=0x7ff0f01892e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:58.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.190+0000 7ff0ee800640 1 --2- 172.21.15.99:0/3161073044 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff0f0182a80 0x7ff0f01892e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:58.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.190+0000 7ff0ee800640 1 -- 172.21.15.99:0/3161073044 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0f00d4fc0 con 0x7ff0f01606a0 2024-02-21T23:00:58.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.190+0000 7ff0ede00640 1 --2- 172.21.15.99:0/3161073044 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff0f0182a80 0x7ff0f01892e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:00:58.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.191+0000 7ff0ef200640 1 --2- 172.21.15.99:0/3161073044 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0f018b980 0x7ff0f0189820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:00:58.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.191+0000 7ff0ee800640 1 --2- 172.21.15.99:0/3161073044 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff0f01606a0 0x7ff0f017cb70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff0e002b8e0 tx=0x7ff0e00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:00:58.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.191+0000 7ff0e6a00640 1 -- 172.21.15.99:0/3161073044 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e0040070 con 0x7ff0f01606a0 2024-02-21T23:00:58.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.191+0000 7ff0e6a00640 1 -- 172.21.15.99:0/3161073044 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0e0039c10 con 0x7ff0f01606a0 2024-02-21T23:00:58.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.191+0000 7ff0e6a00640 1 -- 172.21.15.99:0/3161073044 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e0035040 con 0x7ff0f01606a0 2024-02-21T23:00:58.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.191+0000 7ff0f4a00640 1 -- 172.21.15.99:0/3161073044 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0f00d52a0 con 0x7ff0f01606a0 2024-02-21T23:00:58.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.191+0000 7ff0f4a00640 1 -- 172.21.15.99:0/3161073044 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0f0188ae0 con 0x7ff0f01606a0 2024-02-21T23:00:58.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.192+0000 7ff0f4a00640 1 -- 172.21.15.99:0/3161073044 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0f00fc320 con 0x7ff0f01606a0 2024-02-21T23:00:58.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.194+0000 7ff0e6a00640 1 -- 172.21.15.99:0/3161073044 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 4) v1 ==== 134300+0+0 (secure 0 0 0) 0x7ff0e004b060 con 0x7ff0f01606a0 2024-02-21T23:00:58.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.195+0000 7ff0e6a00640 1 --2- 172.21.15.99:0/3161073044 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7ff0d009ec50 0x7ff0d00a1110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:58.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.195+0000 7ff0e6a00640 1 -- 172.21.15.99:0/3161073044 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 6686+0+0 (secure 0 0 0) 0x7ff0e00ead00 con 0x7ff0f01606a0 2024-02-21T23:00:58.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.196+0000 7ff0ede00640 1 --2- 172.21.15.99:0/3161073044 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7ff0d009ec50 0x7ff0d00a1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:58.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.196+0000 7ff0ede00640 1 --2- 172.21.15.99:0/3161073044 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7ff0d009ec50 0x7ff0d00a1110 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff0f00d23d0 tx=0x7ff0dc009110 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:00:58.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.199+0000 7ff0e6a00640 1 -- 172.21.15.99:0/3161073044 <== mon.2 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7ff0f00fc320 con 0x7ff0f01606a0 2024-02-21T23:00:58.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.379+0000 7ff0f4a00640 1 -- 172.21.15.99:0/3161073044 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff0f0068320 con 0x7ff0f01606a0 2024-02-21T23:00:58.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.381+0000 7ff0e6a00640 1 -- 172.21.15.99:0/3161073044 <== mon.2 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+17900 (secure 0 0 0) 0x7ff0e00b96e0 con 0x7ff0f01606a0 2024-02-21T23:00:58.370 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T23:00:58.370 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":19,"fsid":"e8af98cd-45a1-425f-96a7-f24da8ee4efb","created":"2024-02-21T23:00:44.699708+0000","modified":"2024-02-21T23:00:57.811198+0000","last_up_change":"2024-02-21T23:00:55.749829+0000","last_in_change":"2024-02-21T23:00:48.332297+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T23:00:57.020557+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{},"read_balance":{"score_type":"Fair distribution","score_acting":11.760000228881836,"score_stable":11.760000228881836,"optimal_score":0.17000000178813934,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c49de9b2-dc53-4882-b14c-7059ed40bf59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6809","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6811","nonce":1026112937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6813","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6815","nonce":1026112937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6823","nonce":1026112937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6819","nonce":1026112937}]},"public_addr":"172.21.15.99:6811/1026112937","cluster_addr":"172.21.15.99:6815/1026112937","heartbeat_back_addr":"172.21.15.99:6823/1026112937","heartbeat_front_addr":"172.21.15.99:6819/1026112937","state":["exists","up"]},{"osd":1,"uuid":"58398292-2fe5-4291-94fd-03a0ca29d49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6827","nonce":3030871566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6829","nonce":3030871566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6833","nonce":3030871566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6831","nonce":3030871566}]},"public_addr":"172.21.15.162:6827/3030871566","cluster_addr":"172.21.15.162:6829/3030871566","heartbeat_back_addr":"172.21.15.162:6833/3030871566","heartbeat_front_addr":"172.21.15.162:6831/3030871566","state":["exists","up"]},{"osd":2,"uuid":"94cddec1-e08f-438d-a7c8-48a0e47d71a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6818","nonce":2782386148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6821","nonce":2782386148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6827","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6829","nonce":2782386148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6823","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6825","nonce":2782386148}]},"public_addr":"172.21.15.181:6818/2782386148","cluster_addr":"172.21.15.181:6821/2782386148","heartbeat_back_addr":"172.21.15.181:6829/2782386148","heartbeat_front_addr":"172.21.15.181:6825/2782386148","state":["exists","up"]},{"osd":3,"uuid":"d29abb74-9b89-4fd7-88b1-7c2eb8231189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6801","nonce":2316185310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6803","nonce":2316185310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6807","nonce":2316185310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6805","nonce":2316185310}]},"public_addr":"172.21.15.99:6801/2316185310","cluster_addr":"172.21.15.99:6803/2316185310","heartbeat_back_addr":"172.21.15.99:6807/2316185310","heartbeat_front_addr":"172.21.15.99:6805/2316185310","state":["exists","up"]},{"osd":4,"uuid":"0d8c9ea3-880a-4d69-9dcb-cf7d35abd449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6811","nonce":3137681258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6813","nonce":3137681258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6817","nonce":3137681258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6815","nonce":3137681258}]},"public_addr":"172.21.15.162:6811/3137681258","cluster_addr":"172.21.15.162:6813/3137681258","heartbeat_back_addr":"172.21.15.162:6817/3137681258","heartbeat_front_addr":"172.21.15.162:6815/3137681258","state":["exists","up"]},{"osd":5,"uuid":"2e3a9340-6fd0-4d7a-8e00-fe305649296e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6801","nonce":2011264527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6803","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6805","nonce":2011264527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6811","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6813","nonce":2011264527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6807","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6809","nonce":2011264527}]},"public_addr":"172.21.15.181:6801/2011264527","cluster_addr":"172.21.15.181:6805/2011264527","heartbeat_back_addr":"172.21.15.181:6813/2011264527","heartbeat_front_addr":"172.21.15.181:6809/2011264527","state":["exists","up"]},{"osd":6,"uuid":"d9e37ce7-1b0e-4019-8f2e-b670403abf7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6810","nonce":753870050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6814","nonce":753870050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6822","nonce":753870050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6818","nonce":753870050}]},"public_addr":"172.21.15.99:6810/753870050","cluster_addr":"172.21.15.99:6814/753870050","heartbeat_back_addr":"172.21.15.99:6822/753870050","heartbeat_front_addr":"172.21.15.99:6818/753870050","state":["exists","up"]},{"osd":7,"uuid":"49988754-232e-4b8c-bd72-bfa25b418e5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6803","nonce":1659412949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6805","nonce":1659412949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6809","nonce":1659412949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6807","nonce":1659412949}]},"public_addr":"172.21.15.162:6803/1659412949","cluster_addr":"172.21.15.162:6805/1659412949","heartbeat_back_addr":"172.21.15.162:6809/1659412949","heartbeat_front_addr":"172.21.15.162:6807/1659412949","state":["exists","up"]},{"osd":8,"uuid":"ebc6e462-8368-4d64-b242-9c8735ac672c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6804","nonce":3389807042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6808","nonce":3389807042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6815","nonce":3389807042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6812","nonce":3389807042}]},"public_addr":"172.21.15.181:6804/3389807042","cluster_addr":"172.21.15.181:6808/3389807042","heartbeat_back_addr":"172.21.15.181:6815/3389807042","heartbeat_front_addr":"172.21.15.181:6812/3389807042","state":["exists","up"]},{"osd":9,"uuid":"72af1b02-b965-4d6a-8964-527ec24c4daa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6825","nonce":4055669590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6827","nonce":4055669590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6831","nonce":4055669590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6829","nonce":4055669590}]},"public_addr":"172.21.15.99:6825/4055669590","cluster_addr":"172.21.15.99:6827/4055669590","heartbeat_back_addr":"172.21.15.99:6831/4055669590","heartbeat_front_addr":"172.21.15.99:6829/4055669590","state":["exists","up"]},{"osd":10,"uuid":"adb5cb06-6453-41e4-b847-d7c78bbb7d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6819","nonce":1421879617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6821","nonce":1421879617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6825","nonce":1421879617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6823","nonce":1421879617}]},"public_addr":"172.21.15.162:6819/1421879617","cluster_addr":"172.21.15.162:6821/1421879617","heartbeat_back_addr":"172.21.15.162:6825/1421879617","heartbeat_front_addr":"172.21.15.162:6823/1421879617","state":["exists","up"]},{"osd":11,"uuid":"118563d9-1e8f-4dc7-a92c-2f4c4dc3e20f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6817","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6819","nonce":3219928272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6824","nonce":3219928272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6831","nonce":3219928272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6828","nonce":3219928272}]},"public_addr":"172.21.15.181:6819/3219928272","cluster_addr":"172.21.15.181:6824/3219928272","heartbeat_back_addr":"172.21.15.181:6831/3219928272","heartbeat_front_addr":"172.21.15.181:6828/3219928272","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.651219+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.549859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.529659+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.591004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.440836+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.414250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.630130+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.411954+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.439371+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.428173+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.511203+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.482806+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T23:00:58.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.383+0000 7ff0f4a00640 1 -- 172.21.15.99:0/3161073044 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7ff0d009ec50 msgr2=0x7ff0d00a1110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:58.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.383+0000 7ff0f4a00640 1 --2- 172.21.15.99:0/3161073044 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7ff0d009ec50 0x7ff0d00a1110 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff0f00d23d0 tx=0x7ff0dc009110 comp rx=0 tx=0).stop 2024-02-21T23:00:58.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.383+0000 7ff0f4a00640 1 -- 172.21.15.99:0/3161073044 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff0f01606a0 msgr2=0x7ff0f017cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:58.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.383+0000 7ff0f4a00640 1 --2- 172.21.15.99:0/3161073044 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff0f01606a0 0x7ff0f017cb70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff0e002b8e0 tx=0x7ff0e00046c0 comp rx=0 tx=0).stop 2024-02-21T23:00:58.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.383+0000 7ff0f4a00640 1 -- 172.21.15.99:0/3161073044 shutdown_connections 2024-02-21T23:00:58.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.383+0000 7ff0f4a00640 1 --2- 172.21.15.99:0/3161073044 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7ff0d009ec50 0x7ff0d00a1110 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:58.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.383+0000 7ff0f4a00640 1 --2- 172.21.15.99:0/3161073044 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0f018b980 0x7ff0f0189820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:58.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.383+0000 7ff0f4a00640 1 --2- 172.21.15.99:0/3161073044 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff0f0182a80 0x7ff0f01892e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:58.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.383+0000 7ff0f4a00640 1 --2- 172.21.15.99:0/3161073044 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff0f01606a0 0x7ff0f017cb70 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:58.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.383+0000 7ff0f4a00640 1 -- 172.21.15.99:0/3161073044 >> 172.21.15.99:0/3161073044 conn(0x7ff0f00d29f0 msgr2=0x7ff0f00d2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:00:58.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.383+0000 7ff0f4a00640 1 -- 172.21.15.99:0/3161073044 shutdown_connections 2024-02-21T23:00:58.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.383+0000 7ff0f4a00640 1 -- 172.21.15.99:0/3161073044 wait complete. 2024-02-21T23:00:58.390 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-21T23:00:57.020557+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 11.760000228881836, 'score_stable': 11.760000228881836, 'optimal_score': 0.17000000178813934, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-21T23:00:58.390 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-21T23:00:58.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.600+0000 7efc2c200640 1 Processor -- start 2024-02-21T23:00:58.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.601+0000 7efc2c200640 1 -- start start 2024-02-21T23:00:58.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.603+0000 7efc2c200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7efc24186400 0x7efc24187ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:58.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.603+0000 7efc2c200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7efc241867e0 0x7efc24188010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:58.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.603+0000 7efc2c200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc240cf820 con 0x7efc24188550 2024-02-21T23:00:58.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.603+0000 7efc2c200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc24187640 con 0x7efc24186400 2024-02-21T23:00:58.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.603+0000 7efc2c200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc240cfb00 con 0x7efc241867e0 2024-02-21T23:00:58.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.603+0000 7efc29800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7efc24186400 0x7efc24187ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:58.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.603+0000 7efc28e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7efc241867e0 0x7efc24188010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:58.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.603+0000 7efc29800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7efc24186400 0x7efc24187ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56344/0 (socket says 172.21.15.99:56344) 2024-02-21T23:00:58.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.603+0000 7efc29800640 1 -- 172.21.15.99:0/1896345223 learned_addr learned my addr 172.21.15.99:0/1896345223 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:00:58.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.603+0000 7efc2a200640 1 --1- 172.21.15.99:0/1896345223 >> v1:172.21.15.162:6789/0 conn(0x7efc24188550 0x7efc2418c390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.99:57780/0 (socket says 172.21.15.99:57780) 2024-02-21T23:00:58.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.604+0000 7efc28e00640 1 -- 172.21.15.99:0/1896345223 >> v2:172.21.15.99:3300/0 conn(0x7efc24186400 msgr2=0x7efc24187ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:00:58.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.604+0000 7efc28e00640 1 --2- 172.21.15.99:0/1896345223 >> v2:172.21.15.99:3300/0 conn(0x7efc24186400 0x7efc24187ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:58.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.604+0000 7efc23e00640 1 -- 172.21.15.99:0/1896345223 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2686978797 0 0) 0x7efc240cf820 con 0x7efc24188550 2024-02-21T23:00:58.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.604+0000 7efc28e00640 1 -- 172.21.15.99:0/1896345223 >> v1:172.21.15.162:6789/0 conn(0x7efc24188550 legacy=0x7efc2418c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:58.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.604+0000 7efc28e00640 1 -- 172.21.15.99:0/1896345223 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc24186d10 con 0x7efc241867e0 2024-02-21T23:00:58.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.605+0000 7efc28e00640 1 --2- 172.21.15.99:0/1896345223 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efc241867e0 0x7efc24188010 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7efc24092ea0 tx=0x7efc1002b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c84bd429b37fee70 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:00:58.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.605+0000 7efc23e00640 1 -- 172.21.15.99:0/1896345223 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc100315a0 con 0x7efc241867e0 2024-02-21T23:00:58.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.605+0000 7efc23e00640 1 -- 172.21.15.99:0/1896345223 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc10037070 con 0x7efc241867e0 2024-02-21T23:00:58.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.605+0000 7efc23e00640 1 -- 172.21.15.99:0/1896345223 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc10031960 con 0x7efc241867e0 2024-02-21T23:00:58.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.606+0000 7efc2c200640 1 -- 172.21.15.99:0/1896345223 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efc241867e0 msgr2=0x7efc24188010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:58.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.606+0000 7efc2c200640 1 --2- 172.21.15.99:0/1896345223 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efc241867e0 0x7efc24188010 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7efc24092ea0 tx=0x7efc1002b840 comp rx=0 tx=0).stop 2024-02-21T23:00:58.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.606+0000 7efc2c200640 1 -- 172.21.15.99:0/1896345223 shutdown_connections 2024-02-21T23:00:58.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.606+0000 7efc2c200640 1 --2- 172.21.15.99:0/1896345223 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efc241867e0 0x7efc24188010 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:58.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.606+0000 7efc2c200640 1 --2- 172.21.15.99:0/1896345223 >> v2:172.21.15.99:3300/0 conn(0x7efc24186400 0x7efc24187ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:58.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.606+0000 7efc2c200640 1 -- 172.21.15.99:0/1896345223 >> 172.21.15.99:0/1896345223 conn(0x7efc240d6af0 msgr2=0x7efc240740b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:00:58.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.606+0000 7efc2c200640 1 -- 172.21.15.99:0/1896345223 shutdown_connections 2024-02-21T23:00:58.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.606+0000 7efc2c200640 1 -- 172.21.15.99:0/1896345223 wait complete. 2024-02-21T23:00:58.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.608+0000 7efc2c200640 1 Processor -- start 2024-02-21T23:00:58.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.608+0000 7efc2c200640 1 -- start start 2024-02-21T23:00:58.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.610+0000 7efc2c200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efc24186400 0x7efc24158da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:58.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.610+0000 7efc2c200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efc241867e0 0x7efc24183d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:58.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.610+0000 7efc2c200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc24188550 0x7efc241842d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:58.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.610+0000 7efc2c200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc240d5330 con 0x7efc241867e0 2024-02-21T23:00:58.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.610+0000 7efc2c200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc241872d0 con 0x7efc24186400 2024-02-21T23:00:58.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.610+0000 7efc2c200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc240d54b0 con 0x7efc24188550 2024-02-21T23:00:58.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.610+0000 7efc28e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efc241867e0 0x7efc24183d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:58.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.610+0000 7efc29800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efc24186400 0x7efc24158da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:58.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.610+0000 7efc29800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efc24186400 0x7efc24158da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:47798/0 (socket says 172.21.15.99:47798) 2024-02-21T23:00:58.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.610+0000 7efc29800640 1 -- 172.21.15.99:0/1517662117 learned_addr learned my addr 172.21.15.99:0/1517662117 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:00:58.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.610+0000 7efc28e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efc241867e0 0x7efc24183d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56360/0 (socket says 172.21.15.99:56360) 2024-02-21T23:00:58.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.610+0000 7efc2a200640 1 --2- 172.21.15.99:0/1517662117 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc24188550 0x7efc241842d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:58.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.611+0000 7efc29800640 1 -- 172.21.15.99:0/1517662117 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc24188550 msgr2=0x7efc241842d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:58.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.611+0000 7efc29800640 1 --2- 172.21.15.99:0/1517662117 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc24188550 0x7efc241842d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:58.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.611+0000 7efc29800640 1 -- 172.21.15.99:0/1517662117 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efc241867e0 msgr2=0x7efc24183d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:58.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.611+0000 7efc29800640 1 --2- 172.21.15.99:0/1517662117 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efc241867e0 0x7efc24183d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:58.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.611+0000 7efc29800640 1 -- 172.21.15.99:0/1517662117 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc24220ca0 con 0x7efc24186400 2024-02-21T23:00:58.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.611+0000 7efc29800640 1 --2- 172.21.15.99:0/1517662117 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efc24186400 0x7efc24158da0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7efc18009fd0 tx=0x7efc1800ed40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:00:58.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.611+0000 7efc21600640 1 -- 172.21.15.99:0/1517662117 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc18017070 con 0x7efc24186400 2024-02-21T23:00:58.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.611+0000 7efc21600640 1 -- 172.21.15.99:0/1517662117 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc1800c8e0 con 0x7efc24186400 2024-02-21T23:00:58.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.611+0000 7efc2c200640 1 -- 172.21.15.99:0/1517662117 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc24220f80 con 0x7efc24186400 2024-02-21T23:00:58.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.611+0000 7efc21600640 1 -- 172.21.15.99:0/1517662117 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc1800ccb0 con 0x7efc24186400 2024-02-21T23:00:58.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.612+0000 7efc2c200640 1 -- 172.21.15.99:0/1517662117 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc24221540 con 0x7efc24186400 2024-02-21T23:00:58.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.613+0000 7efc2c200640 1 -- 172.21.15.99:0/1517662117 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc24068780 con 0x7efc24186400 2024-02-21T23:00:58.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.615+0000 7efc21600640 1 -- 172.21.15.99:0/1517662117 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 4) v1 ==== 134300+0+0 (secure 0 0 0) 0x7efc1801a070 con 0x7efc24186400 2024-02-21T23:00:58.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.616+0000 7efc21600640 1 --2- 172.21.15.99:0/1517662117 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7efc0409ecd0 0x7efc040a1190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:58.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.616+0000 7efc21600640 1 -- 172.21.15.99:0/1517662117 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 6686+0+0 (secure 0 0 0) 0x7efc180c99b0 con 0x7efc24186400 2024-02-21T23:00:58.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.617+0000 7efc28e00640 1 --2- 172.21.15.99:0/1517662117 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7efc0409ecd0 0x7efc040a1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:58.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.617+0000 7efc28e00640 1 --2- 172.21.15.99:0/1517662117 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7efc0409ecd0 0x7efc040a1190 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7efc10036000 tx=0x7efc1003d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:00:58.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.618+0000 7efc21600640 1 -- 172.21.15.99:0/1517662117 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7efc18097d40 con 0x7efc24186400 2024-02-21T23:00:58.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.813+0000 7efc2c200640 1 -- 172.21.15.99:0/1517662117 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efc240d05f0 con 0x7efc24186400 2024-02-21T23:00:58.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.814+0000 7efc21600640 1 -- 172.21.15.99:0/1517662117 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7efc1809bde0 con 0x7efc24186400 2024-02-21T23:00:58.804 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 1 2024-02-21T23:00:58.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.817+0000 7efc2c200640 1 -- 172.21.15.99:0/1517662117 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7efc0409ecd0 msgr2=0x7efc040a1190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:58.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.817+0000 7efc2c200640 1 --2- 172.21.15.99:0/1517662117 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7efc0409ecd0 0x7efc040a1190 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7efc10036000 tx=0x7efc1003d040 comp rx=0 tx=0).stop 2024-02-21T23:00:58.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.817+0000 7efc2c200640 1 -- 172.21.15.99:0/1517662117 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efc24186400 msgr2=0x7efc24158da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:58.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.817+0000 7efc2c200640 1 --2- 172.21.15.99:0/1517662117 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efc24186400 0x7efc24158da0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7efc18009fd0 tx=0x7efc1800ed40 comp rx=0 tx=0).stop 2024-02-21T23:00:58.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.817+0000 7efc2c200640 1 -- 172.21.15.99:0/1517662117 shutdown_connections 2024-02-21T23:00:58.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.817+0000 7efc2c200640 1 --2- 172.21.15.99:0/1517662117 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7efc0409ecd0 0x7efc040a1190 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:58.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.817+0000 7efc2c200640 1 --2- 172.21.15.99:0/1517662117 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efc24188550 0x7efc241842d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:58.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.817+0000 7efc2c200640 1 --2- 172.21.15.99:0/1517662117 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efc241867e0 0x7efc24183d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:58.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.817+0000 7efc2c200640 1 --2- 172.21.15.99:0/1517662117 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efc24186400 0x7efc24158da0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:58.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.817+0000 7efc2c200640 1 -- 172.21.15.99:0/1517662117 >> 172.21.15.99:0/1517662117 conn(0x7efc240d6af0 msgr2=0x7efc24068e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:00:58.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.817+0000 7efc2c200640 1 -- 172.21.15.99:0/1517662117 shutdown_connections 2024-02-21T23:00:58.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:58.817+0000 7efc2c200640 1 -- 172.21.15.99:0/1517662117 wait complete. 2024-02-21T23:00:58.826 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T23:00:59.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.034+0000 7f82c8a00640 1 Processor -- start 2024-02-21T23:00:59.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.034+0000 7f82c8a00640 1 -- start start 2024-02-21T23:00:59.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.036+0000 7f82c8a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f82c40d5310 0x7f82c40cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:59.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.036+0000 7f82c8a00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82c4186a50 con 0x7f82c41861e0 2024-02-21T23:00:59.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.036+0000 7f82c8a00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82c40d5740 con 0x7f82c41865c0 2024-02-21T23:00:59.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.036+0000 7f82c8a00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82c4186d50 con 0x7f82c40d5310 2024-02-21T23:00:59.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.037+0000 7f82bbe00640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f82c41865c0 0x7f82c4188190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:45186/0 (socket says 172.21.15.99:45186) 2024-02-21T23:00:59.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.037+0000 7f82bbe00640 1 -- 172.21.15.99:0/2338488566 learned_addr learned my addr 172.21.15.99:0/2338488566 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:00:59.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.037+0000 7f82c2800640 1 --2- 172.21.15.99:0/2338488566 >> v2:172.21.15.162:3300/0 conn(0x7f82c40d5310 0x7f82c40cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:59.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.037+0000 7f82c1400640 1 -- 172.21.15.99:0/2338488566 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1378481850 0 0) 0x7f82c40d5740 con 0x7f82c41865c0 2024-02-21T23:00:59.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.037+0000 7f82c1400640 1 -- 172.21.15.99:0/2338488566 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82a8003520 con 0x7f82c41865c0 2024-02-21T23:00:59.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.037+0000 7f82c1400640 1 -- 172.21.15.99:0/2338488566 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3793287246 0 0) 0x7f82c4186a50 con 0x7f82c41861e0 2024-02-21T23:00:59.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.037+0000 7f82c1400640 1 -- 172.21.15.99:0/2338488566 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82c40d5740 con 0x7f82c41861e0 2024-02-21T23:00:59.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.037+0000 7f82c2800640 1 -- 172.21.15.99:0/2338488566 >> v1:172.21.15.181:6789/0 conn(0x7f82c41865c0 legacy=0x7f82c4188190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:59.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.037+0000 7f82c2800640 1 -- 172.21.15.99:0/2338488566 >> v1:172.21.15.162:6789/0 conn(0x7f82c41861e0 legacy=0x7f82c4187a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:59.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.037+0000 7f82c2800640 1 -- 172.21.15.99:0/2338488566 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82c40cf7e0 con 0x7f82c40d5310 2024-02-21T23:00:59.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.038+0000 7f82c2800640 1 --2- 172.21.15.99:0/2338488566 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82c40d5310 0x7f82c40cdea0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f82c4186ed0 tx=0x7f82bc02bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a2bdfa0041de0bf server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:00:59.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.038+0000 7f82c1400640 1 -- 172.21.15.99:0/2338488566 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82bc039070 con 0x7f82c40d5310 2024-02-21T23:00:59.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.038+0000 7f82c1400640 1 -- 172.21.15.99:0/2338488566 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82bc02cc50 con 0x7f82c40d5310 2024-02-21T23:00:59.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.038+0000 7f82c1400640 1 -- 172.21.15.99:0/2338488566 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82bc034440 con 0x7f82c40d5310 2024-02-21T23:00:59.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.039+0000 7f82c8a00640 1 -- 172.21.15.99:0/2338488566 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82c40d5310 msgr2=0x7f82c40cdea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:59.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.039+0000 7f82c8a00640 1 --2- 172.21.15.99:0/2338488566 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82c40d5310 0x7f82c40cdea0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f82c4186ed0 tx=0x7f82bc02bea0 comp rx=0 tx=0).stop 2024-02-21T23:00:59.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.039+0000 7f82c8a00640 1 -- 172.21.15.99:0/2338488566 shutdown_connections 2024-02-21T23:00:59.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.039+0000 7f82c8a00640 1 --2- 172.21.15.99:0/2338488566 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82c40d5310 0x7f82c40cdea0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:59.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.039+0000 7f82c8a00640 1 -- 172.21.15.99:0/2338488566 >> 172.21.15.99:0/2338488566 conn(0x7f82c40d6ac0 msgr2=0x7f82c40740b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:00:59.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.039+0000 7f82c8a00640 1 -- 172.21.15.99:0/2338488566 shutdown_connections 2024-02-21T23:00:59.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.039+0000 7f82c8a00640 1 -- 172.21.15.99:0/2338488566 wait complete. 2024-02-21T23:00:59.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.041+0000 7f82c8a00640 1 Processor -- start 2024-02-21T23:00:59.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.041+0000 7f82c8a00640 1 -- start start 2024-02-21T23:00:59.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.042+0000 7f82c8a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82c40d5310 0x7f82c4171360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:59.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.042+0000 7f82c8a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f82c41861e0 0x7f82c41789f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:59.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.042+0000 7f82c8a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f82c41865c0 0x7f82c4178f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:59.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.042+0000 7f82c8a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82c4186fa0 con 0x7f82c41865c0 2024-02-21T23:00:59.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.042+0000 7f82c8a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82c41875f0 con 0x7f82c40d5310 2024-02-21T23:00:59.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.042+0000 7f82c8a00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82c4187280 con 0x7f82c41861e0 2024-02-21T23:00:59.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.042+0000 7f82c2800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f82c41865c0 0x7f82c4178f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:59.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.042+0000 7f82c1e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82c40d5310 0x7f82c4171360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:59.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.043+0000 7f82bbe00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f82c41861e0 0x7f82c41789f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:59.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.043+0000 7f82c2800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f82c41865c0 0x7f82c4178f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56362/0 (socket says 172.21.15.99:56362) 2024-02-21T23:00:59.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.043+0000 7f82c2800640 1 -- 172.21.15.99:0/1826693787 learned_addr learned my addr 172.21.15.99:0/1826693787 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:00:59.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.043+0000 7f82c2800640 1 -- 172.21.15.99:0/1826693787 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f82c41861e0 msgr2=0x7f82c41789f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:59.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.043+0000 7f82c2800640 1 --2- 172.21.15.99:0/1826693787 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f82c41861e0 0x7f82c41789f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:59.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.043+0000 7f82c2800640 1 -- 172.21.15.99:0/1826693787 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82c40d5310 msgr2=0x7f82c4171360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:59.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.043+0000 7f82c2800640 1 --2- 172.21.15.99:0/1826693787 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82c40d5310 0x7f82c4171360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:59.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.043+0000 7f82c2800640 1 -- 172.21.15.99:0/1826693787 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82c4179e70 con 0x7f82c41865c0 2024-02-21T23:00:59.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.043+0000 7f82c1e00640 1 --2- 172.21.15.99:0/1826693787 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82c40d5310 0x7f82c4171360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:00:59.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.043+0000 7f82c2800640 1 --2- 172.21.15.99:0/1826693787 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f82c41865c0 0x7f82c4178f30 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f82bc009e80 tx=0x7f82bc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:00:59.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.043+0000 7f82ba000640 1 -- 172.21.15.99:0/1826693787 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82bc039050 con 0x7f82c41865c0 2024-02-21T23:00:59.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.044+0000 7f82ba000640 1 -- 172.21.15.99:0/1826693787 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82bc045070 con 0x7f82c41865c0 2024-02-21T23:00:59.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.044+0000 7f82ba000640 1 -- 172.21.15.99:0/1826693787 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82bc009450 con 0x7f82c41865c0 2024-02-21T23:00:59.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.044+0000 7f82c8a00640 1 -- 172.21.15.99:0/1826693787 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82c41795d0 con 0x7f82c41865c0 2024-02-21T23:00:59.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.044+0000 7f82c8a00640 1 -- 172.21.15.99:0/1826693787 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82c4179b90 con 0x7f82c41865c0 2024-02-21T23:00:59.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.045+0000 7f82c8a00640 1 -- 172.21.15.99:0/1826693787 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82c40d5e60 con 0x7f82c41865c0 2024-02-21T23:00:59.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.048+0000 7f82ba000640 1 -- 172.21.15.99:0/1826693787 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 4) v1 ==== 134300+0+0 (secure 0 0 0) 0x7f82bc03e610 con 0x7f82c41865c0 2024-02-21T23:00:59.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.049+0000 7f82ba000640 1 --2- 172.21.15.99:0/1826693787 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f82a009ecd0 0x7f82a00a1190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:59.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.049+0000 7f82ba000640 1 -- 172.21.15.99:0/1826693787 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6697+0+0 (secure 0 0 0) 0x7f82bc0ec750 con 0x7f82c41865c0 2024-02-21T23:00:59.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.049+0000 7f82c1e00640 1 --2- 172.21.15.99:0/1826693787 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f82a009ecd0 0x7f82a00a1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:59.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.050+0000 7f82c1e00640 1 --2- 172.21.15.99:0/1826693787 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f82a009ecd0 0x7f82a00a1190 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f82b4007fd0 tx=0x7f82b4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:00:59.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.052+0000 7f82ba000640 1 -- 172.21.15.99:0/1826693787 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f82c4179e70 con 0x7f82c41865c0 2024-02-21T23:00:59.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.292+0000 7f82c8a00640 1 -- 172.21.15.99:0/1826693787 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f82c417d910 con 0x7f82c41865c0 2024-02-21T23:00:59.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.293+0000 7f82ba000640 1 -- 172.21.15.99:0/1826693787 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+10038 (secure 0 0 0) 0x7f82bc0bb120 con 0x7f82c41865c0 2024-02-21T23:00:59.283 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T23:00:59.283 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4307,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/3514452812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3514452812},{"type":"v1","addr":"172.21.15.162:6836","nonce":3514452812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4312,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6838/2169982089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":2169982089},{"type":"v1","addr":"172.21.15.162:6838","nonce":2169982089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4315,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6839/3335972724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6837","nonce":3335972724},{"type":"v1","addr":"172.21.15.162:6839","nonce":3335972724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4318,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6841/2135456697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6840","nonce":2135456697},{"type":"v1","addr":"172.21.15.162:6841","nonce":2135456697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4325,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2452242758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2452242758},{"type":"v1","addr":"172.21.15.181:6833","nonce":2452242758}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4328,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6836/2751486400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":2751486400},{"type":"v1","addr":"172.21.15.181:6836","nonce":2751486400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4331,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6838/3728901330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6835","nonce":3728901330},{"type":"v1","addr":"172.21.15.181:6838","nonce":3728901330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4339,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6839/3357929641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6837","nonce":3357929641},{"type":"v1","addr":"172.21.15.181:6839","nonce":3357929641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4343,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6833/2793485078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":2793485078},{"type":"v1","addr":"172.21.15.99:6833","nonce":2793485078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4348,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2243461688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2243461688},{"type":"v1","addr":"172.21.15.99:6835","nonce":2243461688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4352,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/1676159950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":1676159950},{"type":"v1","addr":"172.21.15.99:6837","nonce":1676159950}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4355,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6839/4239008786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":4239008786},{"type":"v1","addr":"172.21.15.99:6839","nonce":4239008786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2024-02-21T23:00:59.283 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 3 2024-02-21T23:00:59.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.296+0000 7f82c8a00640 1 -- 172.21.15.99:0/1826693787 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f82a009ecd0 msgr2=0x7f82a00a1190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:59.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.296+0000 7f82c8a00640 1 --2- 172.21.15.99:0/1826693787 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f82a009ecd0 0x7f82a00a1190 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f82b4007fd0 tx=0x7f82b4009040 comp rx=0 tx=0).stop 2024-02-21T23:00:59.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.296+0000 7f82c8a00640 1 -- 172.21.15.99:0/1826693787 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f82c41865c0 msgr2=0x7f82c4178f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:59.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.296+0000 7f82c8a00640 1 --2- 172.21.15.99:0/1826693787 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f82c41865c0 0x7f82c4178f30 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f82bc009e80 tx=0x7f82bc004a40 comp rx=0 tx=0).stop 2024-02-21T23:00:59.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.296+0000 7f82c8a00640 1 -- 172.21.15.99:0/1826693787 shutdown_connections 2024-02-21T23:00:59.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.296+0000 7f82c8a00640 1 --2- 172.21.15.99:0/1826693787 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f82a009ecd0 0x7f82a00a1190 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:59.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.296+0000 7f82c8a00640 1 --2- 172.21.15.99:0/1826693787 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f82c41865c0 0x7f82c4178f30 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:59.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.296+0000 7f82c8a00640 1 --2- 172.21.15.99:0/1826693787 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f82c41861e0 0x7f82c41789f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:59.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.296+0000 7f82c8a00640 1 --2- 172.21.15.99:0/1826693787 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f82c40d5310 0x7f82c4171360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:59.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.296+0000 7f82c8a00640 1 -- 172.21.15.99:0/1826693787 >> 172.21.15.99:0/1826693787 conn(0x7f82c40d6ac0 msgr2=0x7f82c40740b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:00:59.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.296+0000 7f82c8a00640 1 -- 172.21.15.99:0/1826693787 shutdown_connections 2024-02-21T23:00:59.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.296+0000 7f82c8a00640 1 -- 172.21.15.99:0/1826693787 wait complete. 2024-02-21T23:00:59.302 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T23:00:59.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.513+0000 7f57bfe00640 1 Processor -- start 2024-02-21T23:00:59.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.514+0000 7f57bfe00640 1 -- start start 2024-02-21T23:00:59.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.516+0000 7f57bfe00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f57c018a010 0x7f57c018b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:59.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.516+0000 7f57bfe00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f57c00719b0 0x7f57c0071e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:59.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.516+0000 7f57bfe00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57c018a600 con 0x7f57c0182a80 2024-02-21T23:00:59.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.516+0000 7f57bfe00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57c018bec0 con 0x7f57c00719b0 2024-02-21T23:00:59.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.516+0000 7f57bfe00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57c018a8e0 con 0x7f57c018a010 2024-02-21T23:00:59.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.516+0000 7f57bea00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f57c0182a80 0x7f57c0186a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.99:57794/0 (socket says 172.21.15.99:57794) 2024-02-21T23:00:59.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.516+0000 7f57bea00640 1 -- 172.21.15.99:0/3229895048 learned_addr learned my addr 172.21.15.99:0/3229895048 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:00:59.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.516+0000 7f57bf400640 1 --2- 172.21.15.99:0/3229895048 >> v2:172.21.15.99:3300/0 conn(0x7f57c00719b0 0x7f57c0071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:59.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.516+0000 7f57b7e00640 1 --2- 172.21.15.99:0/3229895048 >> v2:172.21.15.162:3300/0 conn(0x7f57c018a010 0x7f57c018b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:59.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.516+0000 7f57be000640 1 -- 172.21.15.99:0/3229895048 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 749125873 0 0) 0x7f57c018a600 con 0x7f57c0182a80 2024-02-21T23:00:59.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.516+0000 7f57be000640 1 -- 172.21.15.99:0/3229895048 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57a4003520 con 0x7f57c0182a80 2024-02-21T23:00:59.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.517+0000 7f57be000640 1 -- 172.21.15.99:0/3229895048 <== mon.1 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3462307308 0 0) 0x7f57a4003520 con 0x7f57c0182a80 2024-02-21T23:00:59.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.517+0000 7f57be000640 1 -- 172.21.15.99:0/3229895048 >> v2:172.21.15.162:3300/0 conn(0x7f57c018a010 msgr2=0x7f57c018b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:00:59.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.517+0000 7f57be000640 1 --2- 172.21.15.99:0/3229895048 >> v2:172.21.15.162:3300/0 conn(0x7f57c018a010 0x7f57c018b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:59.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.517+0000 7f57be000640 1 -- 172.21.15.99:0/3229895048 >> v2:172.21.15.99:3300/0 conn(0x7f57c00719b0 msgr2=0x7f57c0071e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:00:59.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.517+0000 7f57be000640 1 --2- 172.21.15.99:0/3229895048 >> v2:172.21.15.99:3300/0 conn(0x7f57c00719b0 0x7f57c0071e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:59.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.517+0000 7f57be000640 1 -- 172.21.15.99:0/3229895048 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c018abc0 con 0x7f57c0182a80 2024-02-21T23:00:59.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.517+0000 7f57be000640 1 -- 172.21.15.99:0/3229895048 <== mon.1 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2069890144 0 0) 0x7f57b0001670 con 0x7f57c0182a80 2024-02-21T23:00:59.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.517+0000 7f57be000640 1 -- 172.21.15.99:0/3229895048 >> v1:172.21.15.162:6789/0 conn(0x7f57c0182a80 legacy=0x7f57c0186a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:59.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.517+0000 7f57be000640 1 --2- 172.21.15.99:0/3229895048 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f57a4003a00 0x7f57a4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:59.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.517+0000 7f57be000640 1 --2- 172.21.15.99:0/3229895048 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f57a4004800 0x7f57a4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:59.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.517+0000 7f57be000640 1 --2- 172.21.15.99:0/3229895048 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f57a40052e0 0x7f57a400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:59.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.517+0000 7f57be000640 1 -- 172.21.15.99:0/3229895048 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c018bec0 con 0x7f57a4004800 2024-02-21T23:00:59.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.517+0000 7f57be000640 1 -- 172.21.15.99:0/3229895048 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c018a8e0 con 0x7f57a4003a00 2024-02-21T23:00:59.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.517+0000 7f57be000640 1 -- 172.21.15.99:0/3229895048 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57a400c230 con 0x7f57a40052e0 2024-02-21T23:00:59.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.517+0000 7f57bf400640 1 --2- 172.21.15.99:0/3229895048 >> v2:172.21.15.99:3300/0 conn(0x7f57c00719b0 0x7f57c0071e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:00:59.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.517+0000 7f57bea00640 1 --2- 172.21.15.99:0/3229895048 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f57a4003a00 0x7f57a4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:59.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.517+0000 7f57bf400640 1 --2- 172.21.15.99:0/3229895048 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f57a40052e0 0x7f57a400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:59.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.518+0000 7f57b7e00640 1 --2- 172.21.15.99:0/3229895048 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f57a4004800 0x7f57a4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:59.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.518+0000 7f57bea00640 1 -- 172.21.15.99:0/3229895048 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f57a40052e0 msgr2=0x7f57a400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:00:59.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.518+0000 7f57bea00640 1 --2- 172.21.15.99:0/3229895048 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f57a40052e0 0x7f57a400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:59.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.518+0000 7f57bea00640 1 -- 172.21.15.99:0/3229895048 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f57a4004800 msgr2=0x7f57a4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:00:59.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.518+0000 7f57bea00640 1 --2- 172.21.15.99:0/3229895048 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f57a4004800 0x7f57a4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:59.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.518+0000 7f57bea00640 1 -- 172.21.15.99:0/3229895048 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57a4003520 con 0x7f57a4003a00 2024-02-21T23:00:59.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.518+0000 7f57bf400640 1 --2- 172.21.15.99:0/3229895048 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f57a40052e0 0x7f57a400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:00:59.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.518+0000 7f57b7e00640 1 --2- 172.21.15.99:0/3229895048 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f57a4004800 0x7f57a4004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:00:59.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.518+0000 7f57bf400640 1 -- 172.21.15.99:0/3229895048 reap_dead start 2024-02-21T23:00:59.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.520+0000 7f57bea00640 1 --2- 172.21.15.99:0/3229895048 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f57a4003a00 0x7f57a4003e20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f57b000c290 tx=0x7f57a4005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b388a2c350cbdc5c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:00:59.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.521+0000 7f57be000640 1 -- 172.21.15.99:0/3229895048 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b0007d50 con 0x7f57a4003a00 2024-02-21T23:00:59.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.521+0000 7f57be000640 1 -- 172.21.15.99:0/3229895048 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57b0030070 con 0x7f57a4003a00 2024-02-21T23:00:59.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.521+0000 7f57be000640 1 -- 172.21.15.99:0/3229895048 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b0005d70 con 0x7f57a4003a00 2024-02-21T23:00:59.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.521+0000 7f57bfe00640 1 -- 172.21.15.99:0/3229895048 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f57a4003a00 msgr2=0x7f57a4003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:59.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.521+0000 7f57bfe00640 1 --2- 172.21.15.99:0/3229895048 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f57a4003a00 0x7f57a4003e20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f57b000c290 tx=0x7f57a4005830 comp rx=0 tx=0).stop 2024-02-21T23:00:59.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.522+0000 7f57bfe00640 1 -- 172.21.15.99:0/3229895048 shutdown_connections 2024-02-21T23:00:59.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.522+0000 7f57bfe00640 1 --2- 172.21.15.99:0/3229895048 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f57a4003a00 0x7f57a4003e20 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:59.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.522+0000 7f57bfe00640 1 -- 172.21.15.99:0/3229895048 >> 172.21.15.99:0/3229895048 conn(0x7f57c00d29f0 msgr2=0x7f57c00d2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:00:59.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.522+0000 7f57bfe00640 1 -- 172.21.15.99:0/3229895048 shutdown_connections 2024-02-21T23:00:59.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.522+0000 7f57bfe00640 1 -- 172.21.15.99:0/3229895048 wait complete. 2024-02-21T23:00:59.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.524+0000 7f57bfe00640 1 Processor -- start 2024-02-21T23:00:59.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.524+0000 7f57bfe00640 1 -- start start 2024-02-21T23:00:59.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.525+0000 7f57bfe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f57a4003a00 0x7f57c017c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:59.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.525+0000 7f57bfe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f57c017c9f0 0x7f57c00f4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:59.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.525+0000 7f57bfe00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f57c00f4a40 0x7f57c02203b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:59.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.525+0000 7f57bfe00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c018b460 con 0x7f57c017c9f0 2024-02-21T23:00:59.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.525+0000 7f57bfe00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c018b180 con 0x7f57a4003a00 2024-02-21T23:00:59.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.525+0000 7f57bfe00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c0182e60 con 0x7f57c00f4a40 2024-02-21T23:00:59.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.525+0000 7f57b7e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f57c017c9f0 0x7f57c00f4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:59.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.525+0000 7f57b7e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f57c017c9f0 0x7f57c00f4500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56384/0 (socket says 172.21.15.99:56384) 2024-02-21T23:00:59.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.525+0000 7f57bea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f57a4003a00 0x7f57c017c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:59.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.525+0000 7f57b7e00640 1 -- 172.21.15.99:0/2563054786 learned_addr learned my addr 172.21.15.99:0/2563054786 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:00:59.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.525+0000 7f57bf400640 1 --2- 172.21.15.99:0/2563054786 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f57c00f4a40 0x7f57c02203b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:59.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.526+0000 7f57bea00640 1 -- 172.21.15.99:0/2563054786 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f57c00f4a40 msgr2=0x7f57c02203b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:59.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.526+0000 7f57bea00640 1 --2- 172.21.15.99:0/2563054786 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f57c00f4a40 0x7f57c02203b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:59.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.526+0000 7f57bea00640 1 -- 172.21.15.99:0/2563054786 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f57c017c9f0 msgr2=0x7f57c00f4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:59.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.526+0000 7f57bea00640 1 --2- 172.21.15.99:0/2563054786 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f57c017c9f0 0x7f57c00f4500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:59.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.526+0000 7f57bea00640 1 -- 172.21.15.99:0/2563054786 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c00fdf60 con 0x7f57a4003a00 2024-02-21T23:00:59.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.526+0000 7f57bf400640 1 --2- 172.21.15.99:0/2563054786 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f57c00f4a40 0x7f57c02203b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:00:59.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.526+0000 7f57bea00640 1 --2- 172.21.15.99:0/2563054786 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f57a4003a00 0x7f57c017c4b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f57b0031000 tx=0x7f57b0001a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:00:59.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.526+0000 7f57b6a00640 1 -- 172.21.15.99:0/2563054786 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b0007d50 con 0x7f57a4003a00 2024-02-21T23:00:59.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.526+0000 7f57b6a00640 1 -- 172.21.15.99:0/2563054786 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57b0004bf0 con 0x7f57a4003a00 2024-02-21T23:00:59.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.526+0000 7f57b6a00640 1 -- 172.21.15.99:0/2563054786 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b0001c80 con 0x7f57a4003a00 2024-02-21T23:00:59.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.526+0000 7f57bfe00640 1 -- 172.21.15.99:0/2563054786 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57c00fe240 con 0x7f57a4003a00 2024-02-21T23:00:59.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.527+0000 7f57bfe00640 1 -- 172.21.15.99:0/2563054786 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57c00fe800 con 0x7f57a4003a00 2024-02-21T23:00:59.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.528+0000 7f57bfe00640 1 -- 172.21.15.99:0/2563054786 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57c0068320 con 0x7f57a4003a00 2024-02-21T23:00:59.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.529+0000 7f57b6a00640 1 -- 172.21.15.99:0/2563054786 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 4) v1 ==== 134300+0+0 (secure 0 0 0) 0x7f57b0007070 con 0x7f57a4003a00 2024-02-21T23:00:59.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.530+0000 7f57b6a00640 1 --2- 172.21.15.99:0/2563054786 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f579c09ecd0 0x7f579c0a1190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:59.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.530+0000 7f57b6a00640 1 -- 172.21.15.99:0/2563054786 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6697+0+0 (secure 0 0 0) 0x7f57b00ea5d0 con 0x7f57a4003a00 2024-02-21T23:00:59.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.530+0000 7f57b7e00640 1 --2- 172.21.15.99:0/2563054786 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f579c09ecd0 0x7f579c0a1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:59.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.531+0000 7f57b7e00640 1 --2- 172.21.15.99:0/2563054786 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f579c09ecd0 0x7f579c0a1190 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f57c0186850 tx=0x7f57a8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:00:59.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.534+0000 7f57b6a00640 1 -- 172.21.15.99:0/2563054786 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f57b00b8a20 con 0x7f57a4003a00 2024-02-21T23:00:59.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.735+0000 7f57bfe00640 1 -- 172.21.15.99:0/2563054786 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f57c021fcf0 con 0x7f57a4003a00 2024-02-21T23:00:59.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.736+0000 7f57b6a00640 1 -- 172.21.15.99:0/2563054786 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+17909 (secure 0 0 0) 0x7f57b00bcac0 con 0x7f57a4003a00 2024-02-21T23:00:59.725 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T23:00:59.725 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":20,"fsid":"e8af98cd-45a1-425f-96a7-f24da8ee4efb","created":"2024-02-21T23:00:44.699708+0000","modified":"2024-02-21T23:00:58.820716+0000","last_up_change":"2024-02-21T23:00:55.749829+0000","last_in_change":"2024-02-21T23:00:48.332297+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T23:00:57.020557+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":11.760000228881836,"score_stable":11.760000228881836,"optimal_score":0.17000000178813934,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c49de9b2-dc53-4882-b14c-7059ed40bf59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6809","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6811","nonce":1026112937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6813","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6815","nonce":1026112937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6823","nonce":1026112937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6819","nonce":1026112937}]},"public_addr":"172.21.15.99:6811/1026112937","cluster_addr":"172.21.15.99:6815/1026112937","heartbeat_back_addr":"172.21.15.99:6823/1026112937","heartbeat_front_addr":"172.21.15.99:6819/1026112937","state":["exists","up"]},{"osd":1,"uuid":"58398292-2fe5-4291-94fd-03a0ca29d49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6827","nonce":3030871566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6829","nonce":3030871566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6833","nonce":3030871566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6831","nonce":3030871566}]},"public_addr":"172.21.15.162:6827/3030871566","cluster_addr":"172.21.15.162:6829/3030871566","heartbeat_back_addr":"172.21.15.162:6833/3030871566","heartbeat_front_addr":"172.21.15.162:6831/3030871566","state":["exists","up"]},{"osd":2,"uuid":"94cddec1-e08f-438d-a7c8-48a0e47d71a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6818","nonce":2782386148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6821","nonce":2782386148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6827","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6829","nonce":2782386148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6823","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6825","nonce":2782386148}]},"public_addr":"172.21.15.181:6818/2782386148","cluster_addr":"172.21.15.181:6821/2782386148","heartbeat_back_addr":"172.21.15.181:6829/2782386148","heartbeat_front_addr":"172.21.15.181:6825/2782386148","state":["exists","up"]},{"osd":3,"uuid":"d29abb74-9b89-4fd7-88b1-7c2eb8231189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6801","nonce":2316185310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6803","nonce":2316185310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6807","nonce":2316185310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6805","nonce":2316185310}]},"public_addr":"172.21.15.99:6801/2316185310","cluster_addr":"172.21.15.99:6803/2316185310","heartbeat_back_addr":"172.21.15.99:6807/2316185310","heartbeat_front_addr":"172.21.15.99:6805/2316185310","state":["exists","up"]},{"osd":4,"uuid":"0d8c9ea3-880a-4d69-9dcb-cf7d35abd449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6811","nonce":3137681258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6813","nonce":3137681258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6817","nonce":3137681258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6815","nonce":3137681258}]},"public_addr":"172.21.15.162:6811/3137681258","cluster_addr":"172.21.15.162:6813/3137681258","heartbeat_back_addr":"172.21.15.162:6817/3137681258","heartbeat_front_addr":"172.21.15.162:6815/3137681258","state":["exists","up"]},{"osd":5,"uuid":"2e3a9340-6fd0-4d7a-8e00-fe305649296e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6801","nonce":2011264527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6803","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6805","nonce":2011264527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6811","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6813","nonce":2011264527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6807","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6809","nonce":2011264527}]},"public_addr":"172.21.15.181:6801/2011264527","cluster_addr":"172.21.15.181:6805/2011264527","heartbeat_back_addr":"172.21.15.181:6813/2011264527","heartbeat_front_addr":"172.21.15.181:6809/2011264527","state":["exists","up"]},{"osd":6,"uuid":"d9e37ce7-1b0e-4019-8f2e-b670403abf7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6810","nonce":753870050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6814","nonce":753870050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6822","nonce":753870050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6818","nonce":753870050}]},"public_addr":"172.21.15.99:6810/753870050","cluster_addr":"172.21.15.99:6814/753870050","heartbeat_back_addr":"172.21.15.99:6822/753870050","heartbeat_front_addr":"172.21.15.99:6818/753870050","state":["exists","up"]},{"osd":7,"uuid":"49988754-232e-4b8c-bd72-bfa25b418e5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6803","nonce":1659412949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6805","nonce":1659412949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6809","nonce":1659412949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6807","nonce":1659412949}]},"public_addr":"172.21.15.162:6803/1659412949","cluster_addr":"172.21.15.162:6805/1659412949","heartbeat_back_addr":"172.21.15.162:6809/1659412949","heartbeat_front_addr":"172.21.15.162:6807/1659412949","state":["exists","up"]},{"osd":8,"uuid":"ebc6e462-8368-4d64-b242-9c8735ac672c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6804","nonce":3389807042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6808","nonce":3389807042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6815","nonce":3389807042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6812","nonce":3389807042}]},"public_addr":"172.21.15.181:6804/3389807042","cluster_addr":"172.21.15.181:6808/3389807042","heartbeat_back_addr":"172.21.15.181:6815/3389807042","heartbeat_front_addr":"172.21.15.181:6812/3389807042","state":["exists","up"]},{"osd":9,"uuid":"72af1b02-b965-4d6a-8964-527ec24c4daa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6825","nonce":4055669590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6827","nonce":4055669590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6831","nonce":4055669590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6829","nonce":4055669590}]},"public_addr":"172.21.15.99:6825/4055669590","cluster_addr":"172.21.15.99:6827/4055669590","heartbeat_back_addr":"172.21.15.99:6831/4055669590","heartbeat_front_addr":"172.21.15.99:6829/4055669590","state":["exists","up"]},{"osd":10,"uuid":"adb5cb06-6453-41e4-b847-d7c78bbb7d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6819","nonce":1421879617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6821","nonce":1421879617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6825","nonce":1421879617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6823","nonce":1421879617}]},"public_addr":"172.21.15.162:6819/1421879617","cluster_addr":"172.21.15.162:6821/1421879617","heartbeat_back_addr":"172.21.15.162:6825/1421879617","heartbeat_front_addr":"172.21.15.162:6823/1421879617","state":["exists","up"]},{"osd":11,"uuid":"118563d9-1e8f-4dc7-a92c-2f4c4dc3e20f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6817","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6819","nonce":3219928272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6824","nonce":3219928272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6831","nonce":3219928272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6828","nonce":3219928272}]},"public_addr":"172.21.15.181:6819/3219928272","cluster_addr":"172.21.15.181:6824/3219928272","heartbeat_back_addr":"172.21.15.181:6831/3219928272","heartbeat_front_addr":"172.21.15.181:6828/3219928272","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.651219+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.549859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.529659+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.591004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.440836+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.414250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.630130+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.411954+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.439371+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.428173+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.511203+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.482806+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T23:00:59.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.738+0000 7f57bfe00640 1 -- 172.21.15.99:0/2563054786 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f579c09ecd0 msgr2=0x7f579c0a1190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:59.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.738+0000 7f57bfe00640 1 --2- 172.21.15.99:0/2563054786 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f579c09ecd0 0x7f579c0a1190 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f57c0186850 tx=0x7f57a8008040 comp rx=0 tx=0).stop 2024-02-21T23:00:59.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.738+0000 7f57bfe00640 1 -- 172.21.15.99:0/2563054786 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f57a4003a00 msgr2=0x7f57c017c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:59.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.738+0000 7f57bfe00640 1 --2- 172.21.15.99:0/2563054786 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f57a4003a00 0x7f57c017c4b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f57b0031000 tx=0x7f57b0001a40 comp rx=0 tx=0).stop 2024-02-21T23:00:59.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.738+0000 7f57bfe00640 1 -- 172.21.15.99:0/2563054786 shutdown_connections 2024-02-21T23:00:59.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.738+0000 7f57bfe00640 1 --2- 172.21.15.99:0/2563054786 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f579c09ecd0 0x7f579c0a1190 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:59.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.738+0000 7f57bfe00640 1 --2- 172.21.15.99:0/2563054786 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f57c00f4a40 0x7f57c02203b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:59.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.738+0000 7f57bfe00640 1 --2- 172.21.15.99:0/2563054786 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f57c017c9f0 0x7f57c00f4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:59.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.738+0000 7f57bfe00640 1 --2- 172.21.15.99:0/2563054786 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f57a4003a00 0x7f57c017c4b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:59.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.738+0000 7f57bfe00640 1 -- 172.21.15.99:0/2563054786 >> 172.21.15.99:0/2563054786 conn(0x7f57c00d29f0 msgr2=0x7f57c0186990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:00:59.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.738+0000 7f57bfe00640 1 -- 172.21.15.99:0/2563054786 shutdown_connections 2024-02-21T23:00:59.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.738+0000 7f57bfe00640 1 -- 172.21.15.99:0/2563054786 wait complete. 2024-02-21T23:00:59.744 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-21T23:00:57.020557+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 11.760000228881836, 'score_stable': 11.760000228881836, 'optimal_score': 0.17000000178813934, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-21T23:00:59.744 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-21T23:00:59.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.950+0000 7fe983200640 1 Processor -- start 2024-02-21T23:00:59.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.950+0000 7fe983200640 1 -- start start 2024-02-21T23:00:59.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.952+0000 7fe983200640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fe97c182ac0 0x7fe97c0f8de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:59.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.952+0000 7fe983200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe97c0fc810 0x7fe97c0fcc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:59.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.952+0000 7fe983200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe97c186db0 con 0x7fe97c188130 2024-02-21T23:00:59.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.952+0000 7fe983200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe97c182ea0 con 0x7fe97c0fc810 2024-02-21T23:00:59.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.952+0000 7fe983200640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe97c187090 con 0x7fe97c182ac0 2024-02-21T23:00:59.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.952+0000 7fe981400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe97c0fc810 0x7fe97c0fcc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:59.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.952+0000 7fe981e00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fe97c182ac0 0x7fe97c0f8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:59.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.952+0000 7fe981e00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fe97c182ac0 0x7fe97c0f8de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:36224/0 (socket says 172.21.15.99:36224) 2024-02-21T23:00:59.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.952+0000 7fe982800640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fe97c188130 0x7fe97c188580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.99:57796/0 (socket says 172.21.15.99:57796) 2024-02-21T23:00:59.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.952+0000 7fe981e00640 1 -- 172.21.15.99:0/207024923 learned_addr learned my addr 172.21.15.99:0/207024923 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:00:59.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.953+0000 7fe981e00640 1 -- 172.21.15.99:0/207024923 >> v2:172.21.15.99:3300/0 conn(0x7fe97c0fc810 msgr2=0x7fe97c0fcc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:00:59.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.953+0000 7fe981e00640 1 --2- 172.21.15.99:0/207024923 >> v2:172.21.15.99:3300/0 conn(0x7fe97c0fc810 0x7fe97c0fcc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:59.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.953+0000 7fe981e00640 1 -- 172.21.15.99:0/207024923 >> v1:172.21.15.162:6789/0 conn(0x7fe97c188130 legacy=0x7fe97c188580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:59.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.953+0000 7fe980a00640 1 -- 172.21.15.99:0/207024923 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2249586405 0 0) 0x7fe97c186db0 con 0x7fe97c188130 2024-02-21T23:00:59.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.953+0000 7fe981e00640 1 -- 172.21.15.99:0/207024923 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe97c187370 con 0x7fe97c182ac0 2024-02-21T23:00:59.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.954+0000 7fe981e00640 1 --2- 172.21.15.99:0/207024923 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe97c182ac0 0x7fe97c0f8de0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe97c075140 tx=0x7fe97002b9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=518ad8f99f2bbedc server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:00:59.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.954+0000 7fe980a00640 1 -- 172.21.15.99:0/207024923 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe970034070 con 0x7fe97c182ac0 2024-02-21T23:00:59.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.954+0000 7fe980a00640 1 -- 172.21.15.99:0/207024923 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe970030860 con 0x7fe97c182ac0 2024-02-21T23:00:59.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.954+0000 7fe980a00640 1 -- 172.21.15.99:0/207024923 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe970030c30 con 0x7fe97c182ac0 2024-02-21T23:00:59.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.955+0000 7fe983200640 1 -- 172.21.15.99:0/207024923 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe97c182ac0 msgr2=0x7fe97c0f8de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:59.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.955+0000 7fe983200640 1 --2- 172.21.15.99:0/207024923 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe97c182ac0 0x7fe97c0f8de0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe97c075140 tx=0x7fe97002b9a0 comp rx=0 tx=0).stop 2024-02-21T23:00:59.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.955+0000 7fe983200640 1 -- 172.21.15.99:0/207024923 shutdown_connections 2024-02-21T23:00:59.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.955+0000 7fe983200640 1 --2- 172.21.15.99:0/207024923 >> v2:172.21.15.99:3300/0 conn(0x7fe97c0fc810 0x7fe97c0fcc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:59.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.955+0000 7fe983200640 1 --2- 172.21.15.99:0/207024923 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe97c182ac0 0x7fe97c0f8de0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:59.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.955+0000 7fe983200640 1 -- 172.21.15.99:0/207024923 >> 172.21.15.99:0/207024923 conn(0x7fe97c0fe460 msgr2=0x7fe97c0fe870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:00:59.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.955+0000 7fe983200640 1 -- 172.21.15.99:0/207024923 shutdown_connections 2024-02-21T23:00:59.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.955+0000 7fe983200640 1 -- 172.21.15.99:0/207024923 wait complete. 2024-02-21T23:00:59.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.957+0000 7fe983200640 1 Processor -- start 2024-02-21T23:00:59.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.957+0000 7fe983200640 1 -- start start 2024-02-21T23:00:59.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.958+0000 7fe983200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe97c0fc810 0x7fe97c16ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:59.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.958+0000 7fe983200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe97c182ac0 0x7fe97c0d4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:59.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.958+0000 7fe983200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe97c188130 0x7fe97c0d5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:59.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.958+0000 7fe983200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe97c0fd1b0 con 0x7fe97c188130 2024-02-21T23:00:59.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.958+0000 7fe983200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe97c187930 con 0x7fe97c0fc810 2024-02-21T23:00:59.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.958+0000 7fe983200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe97c1869a0 con 0x7fe97c182ac0 2024-02-21T23:00:59.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.958+0000 7fe981e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe97c0fc810 0x7fe97c16ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:59.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.958+0000 7fe981e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe97c0fc810 0x7fe97c16ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:47862/0 (socket says 172.21.15.99:47862) 2024-02-21T23:00:59.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.958+0000 7fe981e00640 1 -- 172.21.15.99:0/2752318368 learned_addr learned my addr 172.21.15.99:0/2752318368 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:00:59.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.958+0000 7fe982800640 1 --2- 172.21.15.99:0/2752318368 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe97c188130 0x7fe97c0d5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:59.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.958+0000 7fe981400640 1 --2- 172.21.15.99:0/2752318368 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe97c182ac0 0x7fe97c0d4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:59.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.959+0000 7fe981e00640 1 -- 172.21.15.99:0/2752318368 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe97c182ac0 msgr2=0x7fe97c0d4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:59.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.959+0000 7fe981e00640 1 --2- 172.21.15.99:0/2752318368 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe97c182ac0 0x7fe97c0d4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:59.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.959+0000 7fe981e00640 1 -- 172.21.15.99:0/2752318368 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe97c188130 msgr2=0x7fe97c0d5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:00:59.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.959+0000 7fe981e00640 1 --2- 172.21.15.99:0/2752318368 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe97c188130 0x7fe97c0d5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:00:59.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.959+0000 7fe981e00640 1 -- 172.21.15.99:0/2752318368 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe97c179230 con 0x7fe97c0fc810 2024-02-21T23:00:59.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.959+0000 7fe982800640 1 --2- 172.21.15.99:0/2752318368 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe97c188130 0x7fe97c0d5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:00:59.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.959+0000 7fe981e00640 1 --2- 172.21.15.99:0/2752318368 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe97c0fc810 0x7fe97c16ebf0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe97002b9e0 tx=0x7fe9700046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:00:59.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.959+0000 7fe976000640 1 -- 172.21.15.99:0/2752318368 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe970034040 con 0x7fe97c0fc810 2024-02-21T23:00:59.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.959+0000 7fe976000640 1 -- 172.21.15.99:0/2752318368 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe970039d90 con 0x7fe97c0fc810 2024-02-21T23:00:59.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.959+0000 7fe983200640 1 -- 172.21.15.99:0/2752318368 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe97c179510 con 0x7fe97c0fc810 2024-02-21T23:00:59.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.959+0000 7fe976000640 1 -- 172.21.15.99:0/2752318368 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe970043610 con 0x7fe97c0fc810 2024-02-21T23:00:59.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.959+0000 7fe983200640 1 -- 172.21.15.99:0/2752318368 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe97c179ad0 con 0x7fe97c0fc810 2024-02-21T23:00:59.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.960+0000 7fe983200640 1 -- 172.21.15.99:0/2752318368 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe97c0f51c0 con 0x7fe97c0fc810 2024-02-21T23:00:59.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.962+0000 7fe976000640 1 -- 172.21.15.99:0/2752318368 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 134356+0+0 (secure 0 0 0) 0x7fe970037070 con 0x7fe97c0fc810 2024-02-21T23:00:59.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.963+0000 7fe976000640 1 --2- 172.21.15.99:0/2752318368 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fe96009ed90 0x7fe9600a1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:00:59.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.964+0000 7fe976000640 1 -- 172.21.15.99:0/2752318368 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6697+0+0 (secure 0 0 0) 0x7fe9700eb3f0 con 0x7fe97c0fc810 2024-02-21T23:00:59.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.964+0000 7fe981400640 1 --2- 172.21.15.99:0/2752318368 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fe96009ed90 0x7fe9600a1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:00:59.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.964+0000 7fe981400640 1 --2- 172.21.15.99:0/2752318368 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fe96009ed90 0x7fe9600a1250 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe97c17bf70 tx=0x7fe96c009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:00:59.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:00:59.967+0000 7fe976000640 1 -- 172.21.15.99:0/2752318368 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fe97c0f51c0 con 0x7fe97c0fc810 2024-02-21T23:01:00.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.167+0000 7fe983200640 1 -- 172.21.15.99:0/2752318368 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe97c068320 con 0x7fe97c0fc810 2024-02-21T23:01:00.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.167+0000 7fe976000640 1 -- 172.21.15.99:0/2752318368 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe97003e070 con 0x7fe97c0fc810 2024-02-21T23:01:00.157 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 1 2024-02-21T23:01:00.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.170+0000 7fe983200640 1 -- 172.21.15.99:0/2752318368 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fe96009ed90 msgr2=0x7fe9600a1250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:00.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.170+0000 7fe983200640 1 --2- 172.21.15.99:0/2752318368 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fe96009ed90 0x7fe9600a1250 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe97c17bf70 tx=0x7fe96c009190 comp rx=0 tx=0).stop 2024-02-21T23:01:00.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.170+0000 7fe983200640 1 -- 172.21.15.99:0/2752318368 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe97c0fc810 msgr2=0x7fe97c16ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:00.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.170+0000 7fe983200640 1 --2- 172.21.15.99:0/2752318368 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe97c0fc810 0x7fe97c16ebf0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe97002b9e0 tx=0x7fe9700046c0 comp rx=0 tx=0).stop 2024-02-21T23:01:00.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.170+0000 7fe983200640 1 -- 172.21.15.99:0/2752318368 shutdown_connections 2024-02-21T23:01:00.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.170+0000 7fe983200640 1 --2- 172.21.15.99:0/2752318368 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fe96009ed90 0x7fe9600a1250 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:00.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.170+0000 7fe983200640 1 --2- 172.21.15.99:0/2752318368 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe97c188130 0x7fe97c0d5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:00.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.170+0000 7fe983200640 1 --2- 172.21.15.99:0/2752318368 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe97c182ac0 0x7fe97c0d4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:00.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.170+0000 7fe983200640 1 --2- 172.21.15.99:0/2752318368 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe97c0fc810 0x7fe97c16ebf0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:00.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.170+0000 7fe983200640 1 -- 172.21.15.99:0/2752318368 >> 172.21.15.99:0/2752318368 conn(0x7fe97c0fe460 msgr2=0x7fe97c180070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:00.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.170+0000 7fe983200640 1 -- 172.21.15.99:0/2752318368 shutdown_connections 2024-02-21T23:01:00.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.170+0000 7fe983200640 1 -- 172.21.15.99:0/2752318368 wait complete. 2024-02-21T23:01:00.175 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-02-21T23:01:00.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.365+0000 7f4a23200640 1 Processor -- start 2024-02-21T23:01:00.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.365+0000 7f4a23200640 1 -- start start 2024-02-21T23:01:00.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.367+0000 7f4a23200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f4a1c0f5ff0 0x7f4a1c0f6420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:00.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.367+0000 7f4a23200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a1c189a20 con 0x7f4a1c185f00 2024-02-21T23:01:00.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.367+0000 7f4a23200640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a1c184750 con 0x7f4a1c183fd0 2024-02-21T23:01:00.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.367+0000 7f4a23200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a1c184a30 con 0x7f4a1c0f5ff0 2024-02-21T23:01:00.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.367+0000 7f4a21e00640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f4a1c183fd0 0x7f4a1c1857f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:45200/0 (socket says 172.21.15.99:45200) 2024-02-21T23:01:00.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.367+0000 7f4a22800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f4a1c0f5ff0 0x7f4a1c0f6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:00.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.367+0000 7f4a21e00640 1 -- 172.21.15.99:0/1429941504 learned_addr learned my addr 172.21.15.99:0/1429941504 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:01:00.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.368+0000 7f4a20a00640 1 -- 172.21.15.99:0/1429941504 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 629702978 0 0) 0x7f4a1c184750 con 0x7f4a1c183fd0 2024-02-21T23:01:00.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.368+0000 7f4a20a00640 1 -- 172.21.15.99:0/1429941504 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a04003520 con 0x7f4a1c183fd0 2024-02-21T23:01:00.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.368+0000 7f4a20a00640 1 -- 172.21.15.99:0/1429941504 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2065106896 0 0) 0x7f4a1c189a20 con 0x7f4a1c185f00 2024-02-21T23:01:00.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.368+0000 7f4a20a00640 1 -- 172.21.15.99:0/1429941504 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a1c184750 con 0x7f4a1c185f00 2024-02-21T23:01:00.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.368+0000 7f4a22800640 1 -- 172.21.15.99:0/1429941504 >> v1:172.21.15.181:6789/0 conn(0x7f4a1c183fd0 legacy=0x7f4a1c1857f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:00.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.368+0000 7f4a22800640 1 -- 172.21.15.99:0/1429941504 >> v1:172.21.15.99:6789/0 conn(0x7f4a1c185f00 legacy=0x7f4a1c0f58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:00.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.368+0000 7f4a22800640 1 -- 172.21.15.99:0/1429941504 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a1c184d10 con 0x7f4a1c0f5ff0 2024-02-21T23:01:00.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.369+0000 7f4a22800640 1 --2- 172.21.15.99:0/1429941504 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4a1c0f5ff0 0x7f4a1c0f6420 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4a18009d90 tx=0x7f4a1802be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=425a536f66d2cce server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:00.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.369+0000 7f4a20a00640 1 -- 172.21.15.99:0/1429941504 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a18039070 con 0x7f4a1c0f5ff0 2024-02-21T23:01:00.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.369+0000 7f4a20a00640 1 -- 172.21.15.99:0/1429941504 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a1802cbd0 con 0x7f4a1c0f5ff0 2024-02-21T23:01:00.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.369+0000 7f4a20a00640 1 -- 172.21.15.99:0/1429941504 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a18034440 con 0x7f4a1c0f5ff0 2024-02-21T23:01:00.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.370+0000 7f4a23200640 1 -- 172.21.15.99:0/1429941504 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4a1c0f5ff0 msgr2=0x7f4a1c0f6420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:00.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.370+0000 7f4a23200640 1 --2- 172.21.15.99:0/1429941504 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4a1c0f5ff0 0x7f4a1c0f6420 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4a18009d90 tx=0x7f4a1802be20 comp rx=0 tx=0).stop 2024-02-21T23:01:00.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.370+0000 7f4a23200640 1 -- 172.21.15.99:0/1429941504 shutdown_connections 2024-02-21T23:01:00.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.370+0000 7f4a23200640 1 --2- 172.21.15.99:0/1429941504 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4a1c0f5ff0 0x7f4a1c0f6420 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:00.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.370+0000 7f4a23200640 1 -- 172.21.15.99:0/1429941504 >> 172.21.15.99:0/1429941504 conn(0x7f4a1c0ce470 msgr2=0x7f4a1c0ce850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:00.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.370+0000 7f4a23200640 1 -- 172.21.15.99:0/1429941504 shutdown_connections 2024-02-21T23:01:00.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.370+0000 7f4a23200640 1 -- 172.21.15.99:0/1429941504 wait complete. 2024-02-21T23:01:00.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.372+0000 7f4a23200640 1 Processor -- start 2024-02-21T23:01:00.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.372+0000 7f4a23200640 1 -- start start 2024-02-21T23:01:00.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.373+0000 7f4a23200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4a1c0f5ff0 0x7f4a1c16e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:00.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.373+0000 7f4a23200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a1c183fd0 0x7f4a1c17ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:00.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.373+0000 7f4a23200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4a1c185f00 0x7f4a1c21fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:00.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.373+0000 7f4a23200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1c1843b0 con 0x7f4a1c0f5ff0 2024-02-21T23:01:00.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.373+0000 7f4a23200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1c1852d0 con 0x7f4a1c183fd0 2024-02-21T23:01:00.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.373+0000 7f4a23200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1c186390 con 0x7f4a1c185f00 2024-02-21T23:01:00.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.373+0000 7f4a21e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4a1c0f5ff0 0x7f4a1c16e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:00.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.373+0000 7f4a22800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4a1c185f00 0x7f4a1c21fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:00.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.373+0000 7f4a22800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4a1c185f00 0x7f4a1c21fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:36242/0 (socket says 172.21.15.99:36242) 2024-02-21T23:01:00.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.373+0000 7f4a22800640 1 -- 172.21.15.99:0/1156015904 learned_addr learned my addr 172.21.15.99:0/1156015904 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:00.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.373+0000 7f4a22800640 1 -- 172.21.15.99:0/1156015904 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a1c183fd0 msgr2=0x7f4a1c17ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:00.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.373+0000 7f4a22800640 1 --2- 172.21.15.99:0/1156015904 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a1c183fd0 0x7f4a1c17ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:00.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.373+0000 7f4a22800640 1 -- 172.21.15.99:0/1156015904 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4a1c0f5ff0 msgr2=0x7f4a1c16e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:00.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.373+0000 7f4a22800640 1 --2- 172.21.15.99:0/1156015904 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4a1c0f5ff0 0x7f4a1c16e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:00.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.373+0000 7f4a22800640 1 -- 172.21.15.99:0/1156015904 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a1c187d90 con 0x7f4a1c185f00 2024-02-21T23:01:00.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.374+0000 7f4a22800640 1 --2- 172.21.15.99:0/1156015904 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4a1c185f00 0x7f4a1c21fd80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4a18009eb0 tx=0x7f4a18004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:00.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.374+0000 7f4a16000640 1 -- 172.21.15.99:0/1156015904 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a18039050 con 0x7f4a1c185f00 2024-02-21T23:01:00.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.374+0000 7f4a16000640 1 -- 172.21.15.99:0/1156015904 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a18045070 con 0x7f4a1c185f00 2024-02-21T23:01:00.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.374+0000 7f4a16000640 1 -- 172.21.15.99:0/1156015904 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1803e850 con 0x7f4a1c185f00 2024-02-21T23:01:00.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.374+0000 7f4a23200640 1 -- 172.21.15.99:0/1156015904 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a1c188070 con 0x7f4a1c185f00 2024-02-21T23:01:00.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.374+0000 7f4a23200640 1 -- 172.21.15.99:0/1156015904 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a1c188630 con 0x7f4a1c185f00 2024-02-21T23:01:00.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.375+0000 7f4a23200640 1 -- 172.21.15.99:0/1156015904 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a1c0f6420 con 0x7f4a1c185f00 2024-02-21T23:01:00.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.377+0000 7f4a16000640 1 -- 172.21.15.99:0/1156015904 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) v1 ==== 134356+0+0 (secure 0 0 0) 0x7f4a1803e9f0 con 0x7f4a1c185f00 2024-02-21T23:01:00.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.378+0000 7f4a16000640 1 --2- 172.21.15.99:0/1156015904 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f4a0009ed60 0x7f4a000a1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:00.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.378+0000 7f4a16000640 1 -- 172.21.15.99:0/1156015904 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6697+0+0 (secure 0 0 0) 0x7f4a180ec420 con 0x7f4a1c185f00 2024-02-21T23:01:00.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.378+0000 7f4a21e00640 1 --2- 172.21.15.99:0/1156015904 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f4a0009ed60 0x7f4a000a1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:00.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.379+0000 7f4a21e00640 1 --2- 172.21.15.99:0/1156015904 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f4a0009ed60 0x7f4a000a1220 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4a10000f60 tx=0x7f4a10009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:00.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.383+0000 7f4a16000640 1 -- 172.21.15.99:0/1156015904 <== mon.2 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f4a1c0f6420 con 0x7f4a1c185f00 2024-02-21T23:01:00.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.580+0000 7f4a23200640 1 -- 172.21.15.99:0/1156015904 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f4a1c16ee00 con 0x7f4a1c185f00 2024-02-21T23:01:00.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.581+0000 7f4a16000640 1 -- 172.21.15.99:0/1156015904 <== mon.2 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v21) v1 ==== 84+0+65 (secure 0 0 0) 0x7f4a180baec0 con 0x7f4a1c185f00 2024-02-21T23:01:00.571 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T23:01:00.572 INFO:teuthology.orchestra.run.smithi099.stdout:[ 2024-02-21T23:01:00.572 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:01:00.572 INFO:teuthology.orchestra.run.smithi099.stdout: "poolnum": 1, 2024-02-21T23:01:00.572 INFO:teuthology.orchestra.run.smithi099.stdout: "poolname": ".mgr" 2024-02-21T23:01:00.572 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:01:00.572 INFO:teuthology.orchestra.run.smithi099.stdout:] 2024-02-21T23:01:00.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.584+0000 7f4a23200640 1 -- 172.21.15.99:0/1156015904 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f4a0009ed60 msgr2=0x7f4a000a1220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:00.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.584+0000 7f4a23200640 1 --2- 172.21.15.99:0/1156015904 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f4a0009ed60 0x7f4a000a1220 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4a10000f60 tx=0x7f4a10009040 comp rx=0 tx=0).stop 2024-02-21T23:01:00.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.584+0000 7f4a23200640 1 -- 172.21.15.99:0/1156015904 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4a1c185f00 msgr2=0x7f4a1c21fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:00.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.584+0000 7f4a23200640 1 --2- 172.21.15.99:0/1156015904 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4a1c185f00 0x7f4a1c21fd80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4a18009eb0 tx=0x7f4a18004a40 comp rx=0 tx=0).stop 2024-02-21T23:01:00.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.584+0000 7f4a23200640 1 -- 172.21.15.99:0/1156015904 shutdown_connections 2024-02-21T23:01:00.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.584+0000 7f4a23200640 1 --2- 172.21.15.99:0/1156015904 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f4a0009ed60 0x7f4a000a1220 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:00.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.584+0000 7f4a23200640 1 --2- 172.21.15.99:0/1156015904 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4a1c185f00 0x7f4a1c21fd80 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:00.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.584+0000 7f4a23200640 1 --2- 172.21.15.99:0/1156015904 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a1c183fd0 0x7f4a1c17ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:00.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.584+0000 7f4a23200640 1 --2- 172.21.15.99:0/1156015904 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4a1c0f5ff0 0x7f4a1c16e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:00.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.584+0000 7f4a23200640 1 -- 172.21.15.99:0/1156015904 >> 172.21.15.99:0/1156015904 conn(0x7f4a1c0ce470 msgr2=0x7f4a1c189d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:00.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.584+0000 7f4a23200640 1 -- 172.21.15.99:0/1156015904 shutdown_connections 2024-02-21T23:01:00.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.584+0000 7f4a23200640 1 -- 172.21.15.99:0/1156015904 wait complete. 2024-02-21T23:01:00.592 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-02-21T23:01:00.592 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-02-21T23:01:00.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.799+0000 7f253d800640 1 Processor -- start 2024-02-21T23:01:00.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.800+0000 7f253d800640 1 -- start start 2024-02-21T23:01:00.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.802+0000 7f253d800640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f2538185d30 0x7f25381861c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:00.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.802+0000 7f253d800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2538184860 0x7f2538184c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:00.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.802+0000 7f253d800640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f253806ee90 con 0x7f2538185950 2024-02-21T23:01:00.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.802+0000 7f253d800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2538183850 con 0x7f2538184860 2024-02-21T23:01:00.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.802+0000 7f253d800640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25380f8f30 con 0x7f2538185d30 2024-02-21T23:01:00.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.802+0000 7f2537e00640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f2538185950 0x7f253806e780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:45214/0 (socket says 172.21.15.99:45214) 2024-02-21T23:01:00.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.802+0000 7f2537e00640 1 -- 172.21.15.99:0/873304577 learned_addr learned my addr 172.21.15.99:0/873304577 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:01:00.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.802+0000 7f252f400640 1 --2- 172.21.15.99:0/873304577 >> v2:172.21.15.181:3300/0 conn(0x7f2538185d30 0x7f25381861c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:00.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.802+0000 7f2537400640 1 -- 172.21.15.99:0/873304577 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2248801313 0 0) 0x7f253806ee90 con 0x7f2538185950 2024-02-21T23:01:00.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.802+0000 7f253ce00640 1 --2- 172.21.15.99:0/873304577 >> v2:172.21.15.162:3300/0 conn(0x7f2538184860 0x7f2538184c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:00.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.802+0000 7f2537400640 1 -- 172.21.15.99:0/873304577 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f251c005730 con 0x7f2538185950 2024-02-21T23:01:00.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.803+0000 7f252f400640 1 -- 172.21.15.99:0/873304577 >> v2:172.21.15.162:3300/0 conn(0x7f2538184860 msgr2=0x7f2538184c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:00.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.803+0000 7f252f400640 1 --2- 172.21.15.99:0/873304577 >> v2:172.21.15.162:3300/0 conn(0x7f2538184860 0x7f2538184c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:00.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.803+0000 7f252f400640 1 -- 172.21.15.99:0/873304577 >> v1:172.21.15.181:6789/0 conn(0x7f2538185950 legacy=0x7f253806e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:00.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.803+0000 7f2537400640 1 -- 172.21.15.99:0/873304577 <== mon.2 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 15836975 0 0) 0x7f251c005730 con 0x7f2538185950 2024-02-21T23:01:00.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.803+0000 7f252f400640 1 -- 172.21.15.99:0/873304577 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2538183aa0 con 0x7f2538185d30 2024-02-21T23:01:00.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.804+0000 7f252f400640 1 --2- 172.21.15.99:0/873304577 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2538185d30 0x7f25381861c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f253806cfb0 tx=0x7f252002b710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9278327bd8d3345 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:00.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.804+0000 7f2537400640 1 -- 172.21.15.99:0/873304577 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2520037070 con 0x7f2538185d30 2024-02-21T23:01:00.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.804+0000 7f2537400640 1 -- 172.21.15.99:0/873304577 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2520030510 con 0x7f2538185d30 2024-02-21T23:01:00.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.804+0000 7f2537400640 1 -- 172.21.15.99:0/873304577 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2528001670 con 0x7f2538185d30 2024-02-21T23:01:00.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.805+0000 7f253d800640 1 -- 172.21.15.99:0/873304577 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2538185d30 msgr2=0x7f25381861c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:00.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.805+0000 7f253d800640 1 --2- 172.21.15.99:0/873304577 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2538185d30 0x7f25381861c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f253806cfb0 tx=0x7f252002b710 comp rx=0 tx=0).stop 2024-02-21T23:01:00.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.805+0000 7f253d800640 1 -- 172.21.15.99:0/873304577 shutdown_connections 2024-02-21T23:01:00.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.805+0000 7f253d800640 1 --2- 172.21.15.99:0/873304577 >> v2:172.21.15.162:3300/0 conn(0x7f2538184860 0x7f2538184c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:00.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.805+0000 7f253d800640 1 --2- 172.21.15.99:0/873304577 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2538185d30 0x7f25381861c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:00.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.805+0000 7f253d800640 1 -- 172.21.15.99:0/873304577 >> 172.21.15.99:0/873304577 conn(0x7f25380ce3d0 msgr2=0x7f25380ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:00.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.805+0000 7f253d800640 1 -- 172.21.15.99:0/873304577 shutdown_connections 2024-02-21T23:01:00.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.805+0000 7f253d800640 1 -- 172.21.15.99:0/873304577 wait complete. 2024-02-21T23:01:00.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.807+0000 7f253d800640 1 Processor -- start 2024-02-21T23:01:00.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.807+0000 7f253d800640 1 -- start start 2024-02-21T23:01:00.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.808+0000 7f253d800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2538184860 0x7f2538188550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:00.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.808+0000 7f253d800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2538185950 0x7f2538161120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:00.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.808+0000 7f253d800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2538185d30 0x7f25380711b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:00.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.808+0000 7f253d800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2538184340 con 0x7f2538185d30 2024-02-21T23:01:00.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.808+0000 7f253d800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2538184060 con 0x7f2538185950 2024-02-21T23:01:00.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.808+0000 7f253d800640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f253817c660 con 0x7f2538184860 2024-02-21T23:01:00.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.808+0000 7f2537e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2538184860 0x7f2538188550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:00.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.808+0000 7f253ce00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2538185d30 0x7f25380711b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:00.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.808+0000 7f252f400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2538185950 0x7f2538161120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:00.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.808+0000 7f2537e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2538184860 0x7f2538188550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:36270/0 (socket says 172.21.15.99:36270) 2024-02-21T23:01:00.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.808+0000 7f252f400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2538185950 0x7f2538161120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:47880/0 (socket says 172.21.15.99:47880) 2024-02-21T23:01:00.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.808+0000 7f2537e00640 1 -- 172.21.15.99:0/1808521710 learned_addr learned my addr 172.21.15.99:0/1808521710 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:00.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.808+0000 7f253ce00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2538185d30 0x7f25380711b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56434/0 (socket says 172.21.15.99:56434) 2024-02-21T23:01:00.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.809+0000 7f252f400640 1 -- 172.21.15.99:0/1808521710 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2538184860 msgr2=0x7f2538188550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:00.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.809+0000 7f252f400640 1 --2- 172.21.15.99:0/1808521710 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2538184860 0x7f2538188550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:00.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.809+0000 7f252f400640 1 -- 172.21.15.99:0/1808521710 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2538185d30 msgr2=0x7f25380711b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:00.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.809+0000 7f252f400640 1 --2- 172.21.15.99:0/1808521710 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2538185d30 0x7f25380711b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:00.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.809+0000 7f252f400640 1 -- 172.21.15.99:0/1808521710 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2538070710 con 0x7f2538185950 2024-02-21T23:01:00.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.809+0000 7f252f400640 1 --2- 172.21.15.99:0/1808521710 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2538185950 0x7f2538161120 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2520032000 tx=0x7f25200046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:00.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.810+0000 7f2534c00640 1 -- 172.21.15.99:0/1808521710 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2520041020 con 0x7f2538185950 2024-02-21T23:01:00.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.810+0000 7f253d800640 1 -- 172.21.15.99:0/1808521710 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2538187ab0 con 0x7f2538185950 2024-02-21T23:01:00.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.810+0000 7f2534c00640 1 -- 172.21.15.99:0/1808521710 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f252003c870 con 0x7f2538185950 2024-02-21T23:01:00.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.810+0000 7f2534c00640 1 -- 172.21.15.99:0/1808521710 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2520037040 con 0x7f2538185950 2024-02-21T23:01:00.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.810+0000 7f253d800640 1 -- 172.21.15.99:0/1808521710 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25380709b0 con 0x7f2538185950 2024-02-21T23:01:00.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.811+0000 7f253d800640 1 -- 172.21.15.99:0/1808521710 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f253817aac0 con 0x7f2538185950 2024-02-21T23:01:00.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.812+0000 7f2534c00640 1 -- 172.21.15.99:0/1808521710 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 134356+0+0 (secure 0 0 0) 0x7f2520044020 con 0x7f2538185950 2024-02-21T23:01:00.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.814+0000 7f2534c00640 1 --2- 172.21.15.99:0/1808521710 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f251409ece0 0x7f25140a11a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:00.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.814+0000 7f2534c00640 1 -- 172.21.15.99:0/1808521710 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6697+0+0 (secure 0 0 0) 0x7f25200eaeb0 con 0x7f2538185950 2024-02-21T23:01:00.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.814+0000 7f2537e00640 1 --2- 172.21.15.99:0/1808521710 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f251409ece0 0x7f25140a11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:00.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.814+0000 7f2537e00640 1 --2- 172.21.15.99:0/1808521710 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f251409ece0 0x7f25140a11a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2528001ac0 tx=0x7f2528001170 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:00.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:00.818+0000 7f2534c00640 1 -- 172.21.15.99:0/1808521710 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f253817aac0 con 0x7f2538185950 2024-02-21T23:01:01.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:01.019+0000 7f253d800640 1 -- 172.21.15.99:0/1808521710 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f25380f92d0 con 0x7f2538185950 2024-02-21T23:01:01.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:01.183+0000 7f2534c00640 1 -- 172.21.15.99:0/1808521710 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v22) v1 ==== 138+0+0 (secure 0 0 0) 0x7f252004b030 con 0x7f2538185950 2024-02-21T23:01:01.174 INFO:teuthology.orchestra.run.smithi099.stderr:pool 'cephfs_metadata' created 2024-02-21T23:01:01.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:01.188+0000 7f253d800640 1 -- 172.21.15.99:0/1808521710 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f251409ece0 msgr2=0x7f25140a11a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:01.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:01.188+0000 7f253d800640 1 --2- 172.21.15.99:0/1808521710 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f251409ece0 0x7f25140a11a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2528001ac0 tx=0x7f2528001170 comp rx=0 tx=0).stop 2024-02-21T23:01:01.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:01.188+0000 7f253d800640 1 -- 172.21.15.99:0/1808521710 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2538185950 msgr2=0x7f2538161120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:01.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:01.188+0000 7f253d800640 1 --2- 172.21.15.99:0/1808521710 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2538185950 0x7f2538161120 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2520032000 tx=0x7f25200046c0 comp rx=0 tx=0).stop 2024-02-21T23:01:01.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:01.189+0000 7f253d800640 1 -- 172.21.15.99:0/1808521710 shutdown_connections 2024-02-21T23:01:01.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:01.189+0000 7f253d800640 1 --2- 172.21.15.99:0/1808521710 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f251409ece0 0x7f25140a11a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:01.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:01.189+0000 7f253d800640 1 --2- 172.21.15.99:0/1808521710 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2538185d30 0x7f25380711b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:01.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:01.189+0000 7f253d800640 1 --2- 172.21.15.99:0/1808521710 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2538185950 0x7f2538161120 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:01.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:01.189+0000 7f253d800640 1 --2- 172.21.15.99:0/1808521710 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2538184860 0x7f2538188550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:01.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:01.189+0000 7f253d800640 1 -- 172.21.15.99:0/1808521710 >> 172.21.15.99:0/1808521710 conn(0x7f25380ce3d0 msgr2=0x7f2538184c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:01.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:01.189+0000 7f253d800640 1 -- 172.21.15.99:0/1808521710 shutdown_connections 2024-02-21T23:01:01.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:01.189+0000 7f253d800640 1 -- 172.21.15.99:0/1808521710 wait complete. 2024-02-21T23:01:01.200 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-02-21T23:01:01.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:01.419+0000 7f4d70e00640 1 Processor -- start 2024-02-21T23:01:01.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:01.419+0000 7f4d70e00640 1 -- start start 2024-02-21T23:01:01.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:01.421+0000 7f4d70e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4d6c18a4a0 0x7f4d6c18a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:01.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:01.421+0000 7f4d70e00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d6c1886d0 con 0x7f4d6c0700e0 2024-02-21T23:01:01.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:01.421+0000 7f4d70e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d6c06ed60 con 0x7f4d6c18a0c0 2024-02-21T23:01:01.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:01.421+0000 7f4d70e00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d6c187ae0 con 0x7f4d6c18a4a0 2024-02-21T23:01:01.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:01.421+0000 7f4d69400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f4d6c0700e0 0x7f4d6c187fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:33632/0 (socket says 172.21.15.99:33632) 2024-02-21T23:01:01.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:01.421+0000 7f4d69400640 1 -- 172.21.15.99:0/4228813910 learned_addr learned my addr 172.21.15.99:0/4228813910 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:01:01.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:01.422+0000 7f4d6a800640 1 --2- 172.21.15.99:0/4228813910 >> v2:172.21.15.162:3300/0 conn(0x7f4d6c18a4a0 0x7f4d6c18a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:01.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:01.422+0000 7f4d6a800640 1 -- 172.21.15.99:0/4228813910 >> v1:172.21.15.162:6789/0 conn(0x7f4d6c18a0c0 legacy=0x7f4d6c0f5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:01.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:01.422+0000 7f4d68a00640 1 -- 172.21.15.99:0/4228813910 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 900906425 0 0) 0x7f4d6c1886d0 con 0x7f4d6c0700e0 2024-02-21T23:01:01.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:01.422+0000 7f4d6a800640 1 -- 172.21.15.99:0/4228813910 >> v1:172.21.15.99:6789/0 conn(0x7f4d6c0700e0 legacy=0x7f4d6c187fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:01.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:01.422+0000 7f4d6a800640 1 -- 172.21.15.99:0/4228813910 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d6c06f040 con 0x7f4d6c18a4a0 2024-02-21T23:01:01.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:01.423+0000 7f4d6a800640 1 --2- 172.21.15.99:0/4228813910 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d6c18a4a0 0x7f4d6c18a910 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4d64009720 tx=0x7f4d6402b6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b543ce341820fe27 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:01.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:01.423+0000 7f4d68a00640 1 -- 172.21.15.99:0/4228813910 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d64037070 con 0x7f4d6c18a4a0 2024-02-21T23:01:01.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:01.423+0000 7f4d68a00640 1 -- 172.21.15.99:0/4228813910 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d64030710 con 0x7f4d6c18a4a0 2024-02-21T23:01:01.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:01.423+0000 7f4d68a00640 1 -- 172.21.15.99:0/4228813910 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d64030ae0 con 0x7f4d6c18a4a0 2024-02-21T23:01:01.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:01.424+0000 7f4d70e00640 1 -- 172.21.15.99:0/4228813910 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d6c18a4a0 msgr2=0x7f4d6c18a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:01.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:01.424+0000 7f4d70e00640 1 --2- 172.21.15.99:0/4228813910 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d6c18a4a0 0x7f4d6c18a910 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4d64009720 tx=0x7f4d6402b6a0 comp rx=0 tx=0).stop 2024-02-21T23:01:01.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:01.424+0000 7f4d70e00640 1 -- 172.21.15.99:0/4228813910 shutdown_connections 2024-02-21T23:01:01.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:01.424+0000 7f4d70e00640 1 --2- 172.21.15.99:0/4228813910 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d6c18a4a0 0x7f4d6c18a910 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:01.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:01.424+0000 7f4d70e00640 1 -- 172.21.15.99:0/4228813910 >> 172.21.15.99:0/4228813910 conn(0x7f4d6c0ce670 msgr2=0x7f4d6c0cea80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:01.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:01.424+0000 7f4d70e00640 1 -- 172.21.15.99:0/4228813910 shutdown_connections 2024-02-21T23:01:01.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:01.424+0000 7f4d70e00640 1 -- 172.21.15.99:0/4228813910 wait complete. 2024-02-21T23:01:01.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:01.426+0000 7f4d70e00640 1 Processor -- start 2024-02-21T23:01:01.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:01.426+0000 7f4d70e00640 1 -- start start 2024-02-21T23:01:01.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:01.427+0000 7f4d70e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d6c0700e0 0x7f4d6c0730d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:01.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:01.427+0000 7f4d70e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d6c18a0c0 0x7f4d6c1798d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:01.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:01.427+0000 7f4d70e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4d6c18a4a0 0x7f4d6c17c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:01.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:01.427+0000 7f4d70e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6c06fc50 con 0x7f4d6c18a0c0 2024-02-21T23:01:01.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:01.427+0000 7f4d70e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6c06eb10 con 0x7f4d6c0700e0 2024-02-21T23:01:01.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:01.427+0000 7f4d70e00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6c06f600 con 0x7f4d6c18a4a0 2024-02-21T23:01:01.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:01.428+0000 7f4d69e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d6c0700e0 0x7f4d6c0730d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:01.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:01.428+0000 7f4d69400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d6c18a0c0 0x7f4d6c1798d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:01.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:01.428+0000 7f4d69e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d6c0700e0 0x7f4d6c0730d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:47892/0 (socket says 172.21.15.99:47892) 2024-02-21T23:01:01.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:01.428+0000 7f4d69e00640 1 -- 172.21.15.99:0/1532841893 learned_addr learned my addr 172.21.15.99:0/1532841893 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:01.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:01.428+0000 7f4d6a800640 1 --2- 172.21.15.99:0/1532841893 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4d6c18a4a0 0x7f4d6c17c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:01.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:01.428+0000 7f4d69e00640 1 -- 172.21.15.99:0/1532841893 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4d6c18a4a0 msgr2=0x7f4d6c17c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:01.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:01.428+0000 7f4d69e00640 1 --2- 172.21.15.99:0/1532841893 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4d6c18a4a0 0x7f4d6c17c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:01.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:01.428+0000 7f4d69e00640 1 -- 172.21.15.99:0/1532841893 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d6c18a0c0 msgr2=0x7f4d6c1798d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:01.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:01.428+0000 7f4d69e00640 1 --2- 172.21.15.99:0/1532841893 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d6c18a0c0 0x7f4d6c1798d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:01.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:01.428+0000 7f4d69e00640 1 -- 172.21.15.99:0/1532841893 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d6c179e10 con 0x7f4d6c0700e0 2024-02-21T23:01:01.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:01.428+0000 7f4d69e00640 1 --2- 172.21.15.99:0/1532841893 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d6c0700e0 0x7f4d6c0730d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4d5400c780 tx=0x7f4d5400cc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:01.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:01.429+0000 7f4d62000640 1 -- 172.21.15.99:0/1532841893 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d54017070 con 0x7f4d6c0700e0 2024-02-21T23:01:01.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:01.429+0000 7f4d62000640 1 -- 172.21.15.99:0/1532841893 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d54005290 con 0x7f4d6c0700e0 2024-02-21T23:01:01.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:01.429+0000 7f4d70e00640 1 -- 172.21.15.99:0/1532841893 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d6c185240 con 0x7f4d6c0700e0 2024-02-21T23:01:01.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:01.429+0000 7f4d62000640 1 -- 172.21.15.99:0/1532841893 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5400a880 con 0x7f4d6c0700e0 2024-02-21T23:01:01.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:01.429+0000 7f4d70e00640 1 -- 172.21.15.99:0/1532841893 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d6c185800 con 0x7f4d6c0700e0 2024-02-21T23:01:01.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:01.430+0000 7f4d70e00640 1 -- 172.21.15.99:0/1532841893 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d6c068780 con 0x7f4d6c0700e0 2024-02-21T23:01:01.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:01.432+0000 7f4d62000640 1 -- 172.21.15.99:0/1532841893 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 134356+0+0 (secure 0 0 0) 0x7f4d5401a070 con 0x7f4d6c0700e0 2024-02-21T23:01:01.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:01.433+0000 7f4d62000640 1 --2- 172.21.15.99:0/1532841893 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f4d4809ed60 0x7f4d480a1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:01.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:01.433+0000 7f4d62000640 1 -- 172.21.15.99:0/1532841893 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 7067+0+0 (secure 0 0 0) 0x7f4d540c8ab0 con 0x7f4d6c0700e0 2024-02-21T23:01:01.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:01.433+0000 7f4d69400640 1 --2- 172.21.15.99:0/1532841893 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f4d4809ed60 0x7f4d480a1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:01.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:01.434+0000 7f4d69400640 1 --2- 172.21.15.99:0/1532841893 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f4d4809ed60 0x7f4d480a1220 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c0f6430 tx=0x7f4d5c001630 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:01.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:01.437+0000 7f4d62000640 1 -- 172.21.15.99:0/1532841893 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f4d54096be0 con 0x7f4d6c0700e0 2024-02-21T23:01:01.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:01.631+0000 7f4d70e00640 1 -- 172.21.15.99:0/1532841893 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f4d6c17ad10 con 0x7f4d6c0700e0 2024-02-21T23:01:02.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:02.191+0000 7f4d62000640 1 -- 172.21.15.99:0/1532841893 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v23) v1 ==== 171+0+0 (secure 0 0 0) 0x7f4d5409ac80 con 0x7f4d6c0700e0 2024-02-21T23:01:02.181 INFO:teuthology.orchestra.run.smithi099.stderr:pool 'cephfs_data' created 2024-02-21T23:01:02.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:02.200+0000 7f4d70e00640 1 -- 172.21.15.99:0/1532841893 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f4d4809ed60 msgr2=0x7f4d480a1220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:02.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:02.200+0000 7f4d70e00640 1 --2- 172.21.15.99:0/1532841893 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f4d4809ed60 0x7f4d480a1220 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c0f6430 tx=0x7f4d5c001630 comp rx=0 tx=0).stop 2024-02-21T23:01:02.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:02.200+0000 7f4d70e00640 1 -- 172.21.15.99:0/1532841893 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d6c0700e0 msgr2=0x7f4d6c0730d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:02.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:02.200+0000 7f4d70e00640 1 --2- 172.21.15.99:0/1532841893 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d6c0700e0 0x7f4d6c0730d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4d5400c780 tx=0x7f4d5400cc40 comp rx=0 tx=0).stop 2024-02-21T23:01:02.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:02.200+0000 7f4d70e00640 1 -- 172.21.15.99:0/1532841893 shutdown_connections 2024-02-21T23:01:02.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:02.200+0000 7f4d70e00640 1 --2- 172.21.15.99:0/1532841893 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f4d4809ed60 0x7f4d480a1220 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:02.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:02.200+0000 7f4d70e00640 1 --2- 172.21.15.99:0/1532841893 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4d6c18a4a0 0x7f4d6c17c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:02.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:02.200+0000 7f4d70e00640 1 --2- 172.21.15.99:0/1532841893 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4d6c18a0c0 0x7f4d6c1798d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:02.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:02.200+0000 7f4d70e00640 1 --2- 172.21.15.99:0/1532841893 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d6c0700e0 0x7f4d6c0730d0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:02.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:02.200+0000 7f4d70e00640 1 -- 172.21.15.99:0/1532841893 >> 172.21.15.99:0/1532841893 conn(0x7f4d6c0ce670 msgr2=0x7f4d6c06c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:02.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:02.202+0000 7f4d70e00640 1 -- 172.21.15.99:0/1532841893 shutdown_connections 2024-02-21T23:01:02.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:02.202+0000 7f4d70e00640 1 -- 172.21.15.99:0/1532841893 wait complete. 2024-02-21T23:01:02.222 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-02-21T23:01:02.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:02.412+0000 7f2b33400640 1 Processor -- start 2024-02-21T23:01:02.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:02.413+0000 7f2b33400640 1 -- start start 2024-02-21T23:01:02.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:02.414+0000 7f2b33400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f2b2c189560 0x7f2b2c0f8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:02.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:02.414+0000 7f2b33400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2b2c0f8940 0x7f2b2c187d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:02.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:02.415+0000 7f2b33400640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b2c189b70 con 0x7f2b2c0f8020 2024-02-21T23:01:02.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:02.415+0000 7f2b33400640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b2c186d50 con 0x7f2b2c189560 2024-02-21T23:01:02.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:02.415+0000 7f2b33400640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b2c1878d0 con 0x7f2b2c0f8940 2024-02-21T23:01:02.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:02.415+0000 7f2b30a00640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f2b2c0f8020 0x7f2b2c188e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:45222/0 (socket says 172.21.15.99:45222) 2024-02-21T23:01:02.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:02.415+0000 7f2b30a00640 1 -- 172.21.15.99:0/1952140601 learned_addr learned my addr 172.21.15.99:0/1952140601 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:01:02.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:02.415+0000 7f2b2be00640 1 --2- 172.21.15.99:0/1952140601 >> v2:172.21.15.99:3300/0 conn(0x7f2b2c189560 0x7f2b2c0f8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:02.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:02.415+0000 7f2b31400640 1 --2- 172.21.15.99:0/1952140601 >> v2:172.21.15.162:3300/0 conn(0x7f2b2c0f8940 0x7f2b2c187d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:02.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:02.415+0000 7f2b2b400640 1 -- 172.21.15.99:0/1952140601 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 74983063 0 0) 0x7f2b2c189b70 con 0x7f2b2c0f8020 2024-02-21T23:01:02.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:02.415+0000 7f2b2b400640 1 -- 172.21.15.99:0/1952140601 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b10003520 con 0x7f2b2c0f8020 2024-02-21T23:01:02.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:02.415+0000 7f2b2be00640 1 -- 172.21.15.99:0/1952140601 >> v2:172.21.15.162:3300/0 conn(0x7f2b2c0f8940 msgr2=0x7f2b2c187d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:02.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:02.415+0000 7f2b2be00640 1 --2- 172.21.15.99:0/1952140601 >> v2:172.21.15.162:3300/0 conn(0x7f2b2c0f8940 0x7f2b2c187d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:02.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:02.415+0000 7f2b2be00640 1 -- 172.21.15.99:0/1952140601 >> v1:172.21.15.181:6789/0 conn(0x7f2b2c0f8020 legacy=0x7f2b2c188e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:02.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:02.415+0000 7f2b2be00640 1 -- 172.21.15.99:0/1952140601 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b2c186fa0 con 0x7f2b2c189560 2024-02-21T23:01:02.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:02.417+0000 7f2b2be00640 1 --2- 172.21.15.99:0/1952140601 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b2c189560 0x7f2b2c0f8400 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c08e100 tx=0x7f2b1802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7805063143c9e9f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:02.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:02.417+0000 7f2b2b400640 1 -- 172.21.15.99:0/1952140601 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b180315a0 con 0x7f2b2c189560 2024-02-21T23:01:02.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:02.417+0000 7f2b2b400640 1 -- 172.21.15.99:0/1952140601 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b18037070 con 0x7f2b2c189560 2024-02-21T23:01:02.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:02.417+0000 7f2b2b400640 1 -- 172.21.15.99:0/1952140601 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b18031960 con 0x7f2b2c189560 2024-02-21T23:01:02.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:02.417+0000 7f2b33400640 1 -- 172.21.15.99:0/1952140601 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b2c189560 msgr2=0x7f2b2c0f8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:02.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:02.417+0000 7f2b33400640 1 --2- 172.21.15.99:0/1952140601 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b2c189560 0x7f2b2c0f8400 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c08e100 tx=0x7f2b1802b840 comp rx=0 tx=0).stop 2024-02-21T23:01:02.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:02.418+0000 7f2b33400640 1 -- 172.21.15.99:0/1952140601 shutdown_connections 2024-02-21T23:01:02.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:02.418+0000 7f2b33400640 1 --2- 172.21.15.99:0/1952140601 >> v2:172.21.15.162:3300/0 conn(0x7f2b2c0f8940 0x7f2b2c187d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:02.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:02.418+0000 7f2b33400640 1 --2- 172.21.15.99:0/1952140601 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b2c189560 0x7f2b2c0f8400 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:02.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:02.418+0000 7f2b33400640 1 -- 172.21.15.99:0/1952140601 >> 172.21.15.99:0/1952140601 conn(0x7f2b2c0ce5f0 msgr2=0x7f2b2c0cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:02.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:02.418+0000 7f2b33400640 1 -- 172.21.15.99:0/1952140601 shutdown_connections 2024-02-21T23:01:02.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:02.418+0000 7f2b33400640 1 -- 172.21.15.99:0/1952140601 wait complete. 2024-02-21T23:01:02.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:02.420+0000 7f2b33400640 1 Processor -- start 2024-02-21T23:01:02.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:02.420+0000 7f2b33400640 1 -- start start 2024-02-21T23:01:02.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:02.421+0000 7f2b33400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b2c0f8020 0x7f2b2c1624c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:02.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:02.421+0000 7f2b33400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b2c0f8940 0x7f2b2c21ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:02.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:02.421+0000 7f2b33400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b2c189560 0x7f2b2c21cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:02.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:02.421+0000 7f2b33400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2c187560 con 0x7f2b2c0f8940 2024-02-21T23:01:02.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:02.421+0000 7f2b33400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2c0f9f60 con 0x7f2b2c0f8020 2024-02-21T23:01:02.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:02.421+0000 7f2b33400640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2c17c660 con 0x7f2b2c189560 2024-02-21T23:01:02.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:02.421+0000 7f2b2be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b2c0f8940 0x7f2b2c21ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:02.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:02.421+0000 7f2b2be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b2c0f8940 0x7f2b2c21ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56450/0 (socket says 172.21.15.99:56450) 2024-02-21T23:01:02.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:02.421+0000 7f2b2be00640 1 -- 172.21.15.99:0/1072396534 learned_addr learned my addr 172.21.15.99:0/1072396534 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:02.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:02.421+0000 7f2b30a00640 1 --2- 172.21.15.99:0/1072396534 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b2c0f8020 0x7f2b2c1624c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:02.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:02.421+0000 7f2b31400640 1 --2- 172.21.15.99:0/1072396534 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b2c189560 0x7f2b2c21cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:02.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:02.422+0000 7f2b2be00640 1 -- 172.21.15.99:0/1072396534 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b2c189560 msgr2=0x7f2b2c21cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:02.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:02.422+0000 7f2b2be00640 1 --2- 172.21.15.99:0/1072396534 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b2c189560 0x7f2b2c21cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:02.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:02.422+0000 7f2b2be00640 1 -- 172.21.15.99:0/1072396534 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b2c0f8020 msgr2=0x7f2b2c1624c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:02.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:02.422+0000 7f2b2be00640 1 --2- 172.21.15.99:0/1072396534 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b2c0f8020 0x7f2b2c1624c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:02.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:02.422+0000 7f2b2be00640 1 -- 172.21.15.99:0/1072396534 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b2c071730 con 0x7f2b2c0f8940 2024-02-21T23:01:02.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:02.422+0000 7f2b2be00640 1 --2- 172.21.15.99:0/1072396534 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b2c0f8940 0x7f2b2c21ca80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2b1802be50 tx=0x7f2b180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:02.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:02.422+0000 7f2b28c00640 1 -- 172.21.15.99:0/1072396534 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b18032630 con 0x7f2b2c0f8940 2024-02-21T23:01:02.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:02.422+0000 7f2b28c00640 1 -- 172.21.15.99:0/1072396534 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b180327d0 con 0x7f2b2c0f8940 2024-02-21T23:01:02.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:02.422+0000 7f2b28c00640 1 -- 172.21.15.99:0/1072396534 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b18032bc0 con 0x7f2b2c0f8940 2024-02-21T23:01:02.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:02.422+0000 7f2b33400640 1 -- 172.21.15.99:0/1072396534 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b2c176b50 con 0x7f2b2c0f8940 2024-02-21T23:01:02.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:02.422+0000 7f2b33400640 1 -- 172.21.15.99:0/1072396534 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b2c177110 con 0x7f2b2c0f8940 2024-02-21T23:01:02.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:02.424+0000 7f2b33400640 1 -- 172.21.15.99:0/1072396534 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b2c068780 con 0x7f2b2c0f8940 2024-02-21T23:01:02.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:02.425+0000 7f2b28c00640 1 -- 172.21.15.99:0/1072396534 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 134356+0+0 (secure 0 0 0) 0x7f2b1804c020 con 0x7f2b2c0f8940 2024-02-21T23:01:02.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:02.427+0000 7f2b28c00640 1 --2- 172.21.15.99:0/1072396534 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f2b0c09ed60 0x7f2b0c0a1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:02.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:02.427+0000 7f2b28c00640 1 -- 172.21.15.99:0/1072396534 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 7449+0+0 (secure 0 0 0) 0x7f2b1802f020 con 0x7f2b2c0f8940 2024-02-21T23:01:02.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:02.427+0000 7f2b30a00640 1 --2- 172.21.15.99:0/1072396534 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f2b0c09ed60 0x7f2b0c0a1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:02.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:02.427+0000 7f2b30a00640 1 --2- 172.21.15.99:0/1072396534 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f2b0c09ed60 0x7f2b0c0a1220 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c005c00 tx=0x7f2b1c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:02.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:02.429+0000 7f2b28c00640 1 -- 172.21.15.99:0/1072396534 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f2b18040070 con 0x7f2b2c0f8940 2024-02-21T23:01:02.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:02.653+0000 7f2b33400640 1 -- 172.21.15.99:0/1072396534 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f2b2c0f90c0 con 0x7f2b2c0f8940 2024-02-21T23:01:03.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:03.190+0000 7f2b28c00640 1 -- 172.21.15.99:0/1072396534 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f2b180b9ae0 con 0x7f2b2c0f8940 2024-02-21T23:01:03.180 INFO:teuthology.orchestra.run.smithi099.stderr:new fs with metadata pool 2 and data pool 3 2024-02-21T23:01:03.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:03.193+0000 7f2b33400640 1 -- 172.21.15.99:0/1072396534 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f2b0c09ed60 msgr2=0x7f2b0c0a1220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:03.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:03.193+0000 7f2b33400640 1 --2- 172.21.15.99:0/1072396534 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f2b0c09ed60 0x7f2b0c0a1220 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c005c00 tx=0x7f2b1c009040 comp rx=0 tx=0).stop 2024-02-21T23:01:03.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:03.193+0000 7f2b33400640 1 -- 172.21.15.99:0/1072396534 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b2c0f8940 msgr2=0x7f2b2c21ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:03.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:03.193+0000 7f2b33400640 1 --2- 172.21.15.99:0/1072396534 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b2c0f8940 0x7f2b2c21ca80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2b1802be50 tx=0x7f2b180046c0 comp rx=0 tx=0).stop 2024-02-21T23:01:03.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:03.194+0000 7f2b33400640 1 -- 172.21.15.99:0/1072396534 shutdown_connections 2024-02-21T23:01:03.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:03.194+0000 7f2b33400640 1 --2- 172.21.15.99:0/1072396534 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f2b0c09ed60 0x7f2b0c0a1220 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:03.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:03.194+0000 7f2b33400640 1 --2- 172.21.15.99:0/1072396534 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b2c189560 0x7f2b2c21cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:03.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:03.194+0000 7f2b33400640 1 --2- 172.21.15.99:0/1072396534 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b2c0f8940 0x7f2b2c21ca80 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:03.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:03.194+0000 7f2b33400640 1 --2- 172.21.15.99:0/1072396534 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b2c0f8020 0x7f2b2c1624c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:03.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:03.194+0000 7f2b33400640 1 -- 172.21.15.99:0/1072396534 >> 172.21.15.99:0/1072396534 conn(0x7f2b2c0ce5f0 msgr2=0x7f2b2c06c910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:03.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:03.194+0000 7f2b33400640 1 -- 172.21.15.99:0/1072396534 shutdown_connections 2024-02-21T23:01:03.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:03.195+0000 7f2b33400640 1 -- 172.21.15.99:0/1072396534 wait complete. 2024-02-21T23:01:03.220 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-02-21T23:01:03.220 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-02-21T23:01:03.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:03.417+0000 7f4a34c00640 1 Processor -- start 2024-02-21T23:01:03.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:03.417+0000 7f4a34c00640 1 -- start start 2024-02-21T23:01:03.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:03.419+0000 7f4a34c00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f4a301899a0 0x7f4a300f8010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:03.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:03.419+0000 7f4a34c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4a300f8550 0x7f4a30184700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:03.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:03.419+0000 7f4a34c00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a300f91d0 con 0x7f4a30188eb0 2024-02-21T23:01:03.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:03.419+0000 7f4a34c00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a301868d0 con 0x7f4a301899a0 2024-02-21T23:01:03.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:03.419+0000 7f4a34c00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a300f8ef0 con 0x7f4a300f8550 2024-02-21T23:01:03.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:03.420+0000 7f4a2d400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f4a301899a0 0x7f4a300f8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:03.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:03.420+0000 7f4a2d400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f4a301899a0 0x7f4a300f8010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56458/0 (socket says 172.21.15.99:56458) 2024-02-21T23:01:03.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:03.420+0000 7f4a2e800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4a300f8550 0x7f4a30184700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:03.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:03.420+0000 7f4a2d400640 1 -- 172.21.15.99:0/2056700370 learned_addr learned my addr 172.21.15.99:0/2056700370 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:03.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:03.420+0000 7f4a2d400640 1 -- 172.21.15.99:0/2056700370 >> v2:172.21.15.162:3300/0 conn(0x7f4a300f8550 msgr2=0x7f4a30184700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:03.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:03.420+0000 7f4a2d400640 1 --2- 172.21.15.99:0/2056700370 >> v2:172.21.15.162:3300/0 conn(0x7f4a300f8550 0x7f4a30184700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:03.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:03.420+0000 7f4a2d400640 1 -- 172.21.15.99:0/2056700370 >> v1:172.21.15.162:6789/0 conn(0x7f4a30188eb0 legacy=0x7f4a30189290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:03.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:03.420+0000 7f4a2d400640 1 -- 172.21.15.99:0/2056700370 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a30183940 con 0x7f4a301899a0 2024-02-21T23:01:03.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:03.421+0000 7f4a2d400640 1 --2- 172.21.15.99:0/2056700370 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4a301899a0 0x7f4a300f8010 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4a300f4bd0 tx=0x7f4a1c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6baf045c2fd40d4b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:03.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:03.421+0000 7f4a2ca00640 1 -- 172.21.15.99:0/2056700370 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1c035020 con 0x7f4a301899a0 2024-02-21T23:01:03.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:03.421+0000 7f4a2ca00640 1 -- 172.21.15.99:0/2056700370 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a1c031870 con 0x7f4a301899a0 2024-02-21T23:01:03.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:03.421+0000 7f4a2ca00640 1 -- 172.21.15.99:0/2056700370 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1c031c40 con 0x7f4a301899a0 2024-02-21T23:01:03.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:03.422+0000 7f4a34c00640 1 -- 172.21.15.99:0/2056700370 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4a301899a0 msgr2=0x7f4a300f8010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:03.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:03.422+0000 7f4a34c00640 1 --2- 172.21.15.99:0/2056700370 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4a301899a0 0x7f4a300f8010 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4a300f4bd0 tx=0x7f4a1c02b910 comp rx=0 tx=0).stop 2024-02-21T23:01:03.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:03.422+0000 7f4a34c00640 1 -- 172.21.15.99:0/2056700370 shutdown_connections 2024-02-21T23:01:03.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:03.422+0000 7f4a34c00640 1 --2- 172.21.15.99:0/2056700370 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4a301899a0 0x7f4a300f8010 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:03.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:03.422+0000 7f4a34c00640 1 --2- 172.21.15.99:0/2056700370 >> v2:172.21.15.162:3300/0 conn(0x7f4a300f8550 0x7f4a30184700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:03.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:03.422+0000 7f4a34c00640 1 -- 172.21.15.99:0/2056700370 >> 172.21.15.99:0/2056700370 conn(0x7f4a300ce5e0 msgr2=0x7f4a300ce9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:03.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:03.422+0000 7f4a34c00640 1 -- 172.21.15.99:0/2056700370 shutdown_connections 2024-02-21T23:01:03.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:03.422+0000 7f4a34c00640 1 -- 172.21.15.99:0/2056700370 wait complete. 2024-02-21T23:01:03.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:03.424+0000 7f4a34c00640 1 Processor -- start 2024-02-21T23:01:03.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:03.424+0000 7f4a34c00640 1 -- start start 2024-02-21T23:01:03.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:03.425+0000 7f4a34c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4a300f8550 0x7f4a301812f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:03.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:03.425+0000 7f4a34c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4a30188eb0 0x7f4a30184f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:03.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:03.425+0000 7f4a34c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a301899a0 0x7f4a3016b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:03.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:03.425+0000 7f4a34c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a301833e0 con 0x7f4a300f8550 2024-02-21T23:01:03.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:03.425+0000 7f4a34c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a30183f00 con 0x7f4a301899a0 2024-02-21T23:01:03.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:03.425+0000 7f4a34c00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a30183560 con 0x7f4a30188eb0 2024-02-21T23:01:03.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:03.425+0000 7f4a2de00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4a300f8550 0x7f4a301812f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:03.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:03.425+0000 7f4a2de00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4a300f8550 0x7f4a301812f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56466/0 (socket says 172.21.15.99:56466) 2024-02-21T23:01:03.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:03.426+0000 7f4a2de00640 1 -- 172.21.15.99:0/2478238106 learned_addr learned my addr 172.21.15.99:0/2478238106 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:03.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:03.426+0000 7f4a2d400640 1 --2- 172.21.15.99:0/2478238106 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4a30188eb0 0x7f4a30184f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:03.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:03.426+0000 7f4a2e800640 1 --2- 172.21.15.99:0/2478238106 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a301899a0 0x7f4a3016b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:03.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:03.426+0000 7f4a2de00640 1 -- 172.21.15.99:0/2478238106 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4a30188eb0 msgr2=0x7f4a30184f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:03.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:03.426+0000 7f4a2de00640 1 --2- 172.21.15.99:0/2478238106 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4a30188eb0 0x7f4a30184f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:03.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:03.426+0000 7f4a2de00640 1 -- 172.21.15.99:0/2478238106 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a301899a0 msgr2=0x7f4a3016b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:03.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:03.426+0000 7f4a2de00640 1 --2- 172.21.15.99:0/2478238106 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a301899a0 0x7f4a3016b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:03.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:03.426+0000 7f4a2de00640 1 -- 172.21.15.99:0/2478238106 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a3016b550 con 0x7f4a300f8550 2024-02-21T23:01:03.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:03.426+0000 7f4a2e800640 1 --2- 172.21.15.99:0/2478238106 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a301899a0 0x7f4a3016b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:01:03.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:03.426+0000 7f4a2de00640 1 --2- 172.21.15.99:0/2478238106 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4a300f8550 0x7f4a301812f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4a2000c3c0 tx=0x7f4a2000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:03.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:03.426+0000 7f4a26000640 1 -- 172.21.15.99:0/2478238106 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a200052d0 con 0x7f4a300f8550 2024-02-21T23:01:03.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:03.426+0000 7f4a26000640 1 -- 172.21.15.99:0/2478238106 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a20005490 con 0x7f4a300f8550 2024-02-21T23:01:03.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:03.426+0000 7f4a26000640 1 -- 172.21.15.99:0/2478238106 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a20007260 con 0x7f4a300f8550 2024-02-21T23:01:03.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:03.427+0000 7f4a34c00640 1 -- 172.21.15.99:0/2478238106 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a30181950 con 0x7f4a300f8550 2024-02-21T23:01:03.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:03.427+0000 7f4a34c00640 1 -- 172.21.15.99:0/2478238106 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a30181f10 con 0x7f4a300f8550 2024-02-21T23:01:03.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:03.428+0000 7f4a34c00640 1 -- 172.21.15.99:0/2478238106 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a300683c0 con 0x7f4a300f8550 2024-02-21T23:01:03.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:03.430+0000 7f4a26000640 1 -- 172.21.15.99:0/2478238106 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 134356+0+0 (secure 0 0 0) 0x7f4a20007400 con 0x7f4a300f8550 2024-02-21T23:01:03.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:03.431+0000 7f4a26000640 1 --2- 172.21.15.99:0/2478238106 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f4a1009ed90 0x7f4a100a1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:03.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:03.431+0000 7f4a26000640 1 -- 172.21.15.99:0/2478238106 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 7549+0+0 (secure 0 0 0) 0x7f4a200c8bf0 con 0x7f4a300f8550 2024-02-21T23:01:03.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:03.431+0000 7f4a2d400640 1 --2- 172.21.15.99:0/2478238106 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f4a1009ed90 0x7f4a100a1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:03.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:03.432+0000 7f4a2d400640 1 --2- 172.21.15.99:0/2478238106 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f4a1009ed90 0x7f4a100a1250 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c036000 tx=0x7f4a1c03c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:03.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:03.435+0000 7f4a26000640 1 -- 172.21.15.99:0/2478238106 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f4a20097220 con 0x7f4a300f8550 2024-02-21T23:01:03.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:03.635+0000 7f4a34c00640 1 -- 172.21.15.99:0/2478238106 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f4a300d2a90 con 0x7f4a300f8550 2024-02-21T23:01:04.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:04.207+0000 7f4a26000640 1 -- 172.21.15.99:0/2478238106 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v25) v1 ==== 157+0+0 (secure 0 0 0) 0x7f4a20096b20 con 0x7f4a300f8550 2024-02-21T23:01:04.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:04.211+0000 7f4a34c00640 1 -- 172.21.15.99:0/2478238106 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f4a1009ed90 msgr2=0x7f4a100a1250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:04.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:04.211+0000 7f4a34c00640 1 --2- 172.21.15.99:0/2478238106 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f4a1009ed90 0x7f4a100a1250 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c036000 tx=0x7f4a1c03c040 comp rx=0 tx=0).stop 2024-02-21T23:01:04.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:04.211+0000 7f4a34c00640 1 -- 172.21.15.99:0/2478238106 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4a300f8550 msgr2=0x7f4a301812f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:04.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:04.211+0000 7f4a34c00640 1 --2- 172.21.15.99:0/2478238106 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4a300f8550 0x7f4a301812f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4a2000c3c0 tx=0x7f4a2000c880 comp rx=0 tx=0).stop 2024-02-21T23:01:04.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:04.211+0000 7f4a34c00640 1 -- 172.21.15.99:0/2478238106 shutdown_connections 2024-02-21T23:01:04.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:04.211+0000 7f4a34c00640 1 --2- 172.21.15.99:0/2478238106 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f4a1009ed90 0x7f4a100a1250 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:04.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:04.211+0000 7f4a34c00640 1 --2- 172.21.15.99:0/2478238106 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a301899a0 0x7f4a3016b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:04.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:04.211+0000 7f4a34c00640 1 --2- 172.21.15.99:0/2478238106 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4a30188eb0 0x7f4a30184f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:04.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:04.211+0000 7f4a34c00640 1 --2- 172.21.15.99:0/2478238106 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4a300f8550 0x7f4a301812f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:04.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:04.211+0000 7f4a34c00640 1 -- 172.21.15.99:0/2478238106 >> 172.21.15.99:0/2478238106 conn(0x7f4a300ce5e0 msgr2=0x7f4a30189290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:04.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:04.211+0000 7f4a34c00640 1 -- 172.21.15.99:0/2478238106 shutdown_connections 2024-02-21T23:01:04.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:04.211+0000 7f4a34c00640 1 -- 172.21.15.99:0/2478238106 wait complete. 2024-02-21T23:01:04.222 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-02-21T23:01:04.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:04.428+0000 7f1a8e400640 1 Processor -- start 2024-02-21T23:01:04.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:04.428+0000 7f1a8e400640 1 -- start start 2024-02-21T23:01:04.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:04.430+0000 7f1a8e400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f1a88186ab0 0x7f1a8806f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:04.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:04.430+0000 7f1a8e400640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f1a88074730 0x7f1a88074b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:04.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:04.430+0000 7f1a8e400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f1a88071880 0x7f1a88071d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:04.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:04.430+0000 7f1a8e400640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a880715e0 con 0x7f1a88071880 2024-02-21T23:01:04.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:04.430+0000 7f1a8e400640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a88070260 con 0x7f1a88186ab0 2024-02-21T23:01:04.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:04.430+0000 7f1a8e400640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a88070540 con 0x7f1a88074730 2024-02-21T23:01:04.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:04.430+0000 7f1a87e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f1a88071880 0x7f1a88071d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:04.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:04.431+0000 7f1a87e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f1a88071880 0x7f1a88071d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56480/0 (socket says 172.21.15.99:56480) 2024-02-21T23:01:04.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:04.431+0000 7f1a87e00640 1 -- 172.21.15.99:0/8519506 learned_addr learned my addr 172.21.15.99:0/8519506 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:04.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:04.431+0000 7f1a7fe00640 1 --2- 172.21.15.99:0/8519506 >> v2:172.21.15.181:3300/0 conn(0x7f1a88074730 0x7f1a88074b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:04.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:04.431+0000 7f1a87400640 1 --2- 172.21.15.99:0/8519506 >> v2:172.21.15.162:3300/0 conn(0x7f1a88186ab0 0x7f1a8806f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:04.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:04.431+0000 7f1a87e00640 1 -- 172.21.15.99:0/8519506 >> v2:172.21.15.181:3300/0 conn(0x7f1a88074730 msgr2=0x7f1a88074b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:04.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:04.431+0000 7f1a87e00640 1 --2- 172.21.15.99:0/8519506 >> v2:172.21.15.181:3300/0 conn(0x7f1a88074730 0x7f1a88074b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:04.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:04.431+0000 7f1a87e00640 1 -- 172.21.15.99:0/8519506 >> v2:172.21.15.162:3300/0 conn(0x7f1a88186ab0 msgr2=0x7f1a8806f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:04.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:04.431+0000 7f1a87e00640 1 --2- 172.21.15.99:0/8519506 >> v2:172.21.15.162:3300/0 conn(0x7f1a88186ab0 0x7f1a8806f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:04.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:04.431+0000 7f1a87e00640 1 -- 172.21.15.99:0/8519506 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a88070820 con 0x7f1a88071880 2024-02-21T23:01:04.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:04.431+0000 7f1a7fe00640 1 --2- 172.21.15.99:0/8519506 >> v2:172.21.15.181:3300/0 conn(0x7f1a88074730 0x7f1a88074b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:01:04.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:04.432+0000 7f1a87e00640 1 --2- 172.21.15.99:0/8519506 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a88071880 0x7f1a88071d10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1a8808e930 tx=0x7f1a8002be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf2285198a19ead4 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:04.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:04.432+0000 7f1a86a00640 1 -- 172.21.15.99:0/8519506 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8002ca10 con 0x7f1a88071880 2024-02-21T23:01:04.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:04.432+0000 7f1a86a00640 1 -- 172.21.15.99:0/8519506 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a8002cbb0 con 0x7f1a88071880 2024-02-21T23:01:04.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:04.432+0000 7f1a86a00640 1 -- 172.21.15.99:0/8519506 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a800343f0 con 0x7f1a88071880 2024-02-21T23:01:04.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:04.433+0000 7f1a8e400640 1 -- 172.21.15.99:0/8519506 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a88071880 msgr2=0x7f1a88071d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:04.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:04.433+0000 7f1a8e400640 1 --2- 172.21.15.99:0/8519506 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a88071880 0x7f1a88071d10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1a8808e930 tx=0x7f1a8002be70 comp rx=0 tx=0).stop 2024-02-21T23:01:04.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:04.433+0000 7f1a8e400640 1 -- 172.21.15.99:0/8519506 shutdown_connections 2024-02-21T23:01:04.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:04.433+0000 7f1a8e400640 1 --2- 172.21.15.99:0/8519506 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a88071880 0x7f1a88071d10 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:04.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:04.433+0000 7f1a8e400640 1 --2- 172.21.15.99:0/8519506 >> v2:172.21.15.181:3300/0 conn(0x7f1a88074730 0x7f1a88074b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:04.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:04.433+0000 7f1a8e400640 1 --2- 172.21.15.99:0/8519506 >> v2:172.21.15.162:3300/0 conn(0x7f1a88186ab0 0x7f1a8806f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:04.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:04.433+0000 7f1a8e400640 1 -- 172.21.15.99:0/8519506 >> 172.21.15.99:0/8519506 conn(0x7f1a8806e2c0 msgr2=0x7f1a8806e6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:04.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:04.433+0000 7f1a8e400640 1 -- 172.21.15.99:0/8519506 shutdown_connections 2024-02-21T23:01:04.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:04.433+0000 7f1a8e400640 1 -- 172.21.15.99:0/8519506 wait complete. 2024-02-21T23:01:04.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:04.435+0000 7f1a8e400640 1 Processor -- start 2024-02-21T23:01:04.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:04.436+0000 7f1a8e400640 1 -- start start 2024-02-21T23:01:04.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:04.437+0000 7f1a8e400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a88071880 0x7f1a8806b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:04.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:04.437+0000 7f1a8e400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1a88074730 0x7f1a88176c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:04.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:04.437+0000 7f1a8e400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1a88186ab0 0x7f1a88174fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:04.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:04.437+0000 7f1a8e400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a880710c0 con 0x7f1a88071880 2024-02-21T23:01:04.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:04.437+0000 7f1a8e400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a88070de0 con 0x7f1a88074730 2024-02-21T23:01:04.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:04.437+0000 7f1a8e400640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a88072250 con 0x7f1a88186ab0 2024-02-21T23:01:04.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:04.437+0000 7f1a87400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a88071880 0x7f1a8806b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:04.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:04.437+0000 7f1a87400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a88071880 0x7f1a8806b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56482/0 (socket says 172.21.15.99:56482) 2024-02-21T23:01:04.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:04.437+0000 7f1a87400640 1 -- 172.21.15.99:0/591899363 learned_addr learned my addr 172.21.15.99:0/591899363 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:04.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:04.437+0000 7f1a7fe00640 1 --2- 172.21.15.99:0/591899363 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1a88074730 0x7f1a88176c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:04.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:04.437+0000 7f1a87e00640 1 --2- 172.21.15.99:0/591899363 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1a88186ab0 0x7f1a88174fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:04.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:04.437+0000 7f1a87400640 1 -- 172.21.15.99:0/591899363 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1a88186ab0 msgr2=0x7f1a88174fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:04.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:04.437+0000 7f1a87400640 1 --2- 172.21.15.99:0/591899363 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1a88186ab0 0x7f1a88174fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:04.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:04.437+0000 7f1a87400640 1 -- 172.21.15.99:0/591899363 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1a88074730 msgr2=0x7f1a88176c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:04.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:04.437+0000 7f1a87400640 1 --2- 172.21.15.99:0/591899363 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1a88074730 0x7f1a88176c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:04.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:04.437+0000 7f1a87400640 1 -- 172.21.15.99:0/591899363 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a88175b80 con 0x7f1a88071880 2024-02-21T23:01:04.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:04.437+0000 7f1a87e00640 1 --2- 172.21.15.99:0/591899363 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1a88186ab0 0x7f1a88174fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:01:04.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:04.438+0000 7f1a87400640 1 --2- 172.21.15.99:0/591899363 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a88071880 0x7f1a8806b420 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1a7800e8a0 tx=0x7f1a7800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:04.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:04.438+0000 7f1a7f400640 1 -- 172.21.15.99:0/591899363 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a78017070 con 0x7f1a88071880 2024-02-21T23:01:04.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:04.438+0000 7f1a7f400640 1 -- 172.21.15.99:0/591899363 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a7800c940 con 0x7f1a88071880 2024-02-21T23:01:04.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:04.438+0000 7f1a7f400640 1 -- 172.21.15.99:0/591899363 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7800cd30 con 0x7f1a88071880 2024-02-21T23:01:04.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:04.438+0000 7f1a8e400640 1 -- 172.21.15.99:0/591899363 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a88175e60 con 0x7f1a88071880 2024-02-21T23:01:04.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:04.438+0000 7f1a8e400640 1 -- 172.21.15.99:0/591899363 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a88176420 con 0x7f1a88071880 2024-02-21T23:01:04.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:04.439+0000 7f1a8e400640 1 -- 172.21.15.99:0/591899363 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a880ca130 con 0x7f1a88071880 2024-02-21T23:01:04.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:04.442+0000 7f1a7f400640 1 -- 172.21.15.99:0/591899363 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 134356+0+0 (secure 0 0 0) 0x7f1a7801a070 con 0x7f1a88071880 2024-02-21T23:01:04.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:04.444+0000 7f1a7f400640 1 --2- 172.21.15.99:0/591899363 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f1a6409ed60 0x7f1a640a1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:04.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:04.444+0000 7f1a7f400640 1 -- 172.21.15.99:0/591899363 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 7847+0+0 (secure 0 0 0) 0x7f1a780c9780 con 0x7f1a88071880 2024-02-21T23:01:04.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:04.444+0000 7f1a7fe00640 1 --2- 172.21.15.99:0/591899363 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f1a6409ed60 0x7f1a640a1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:04.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:04.446+0000 7f1a7fe00640 1 --2- 172.21.15.99:0/591899363 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f1a6409ed60 0x7f1a640a1220 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1a70009560 tx=0x7f1a70009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:04.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:04.448+0000 7f1a7f400640 1 -- 172.21.15.99:0/591899363 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f1a880ca130 con 0x7f1a88071880 2024-02-21T23:01:04.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:04.635+0000 7f1a8e400640 1 -- 172.21.15.99:0/591899363 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f1a8817d830 con 0x7f1a88071880 2024-02-21T23:01:06.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:06.233+0000 7f1a7f400640 1 -- 172.21.15.99:0/591899363 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v27) v1 ==== 228+0+0 (secure 0 0 0) 0x7f1a8817d830 con 0x7f1a88071880 2024-02-21T23:01:06.224 INFO:teuthology.orchestra.run.smithi099.stderr:pool 'cephfs_data_ec' created 2024-02-21T23:01:06.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:06.237+0000 7f1a8e400640 1 -- 172.21.15.99:0/591899363 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f1a6409ed60 msgr2=0x7f1a640a1220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:06.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:06.237+0000 7f1a8e400640 1 --2- 172.21.15.99:0/591899363 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f1a6409ed60 0x7f1a640a1220 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1a70009560 tx=0x7f1a70009190 comp rx=0 tx=0).stop 2024-02-21T23:01:06.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:06.237+0000 7f1a8e400640 1 -- 172.21.15.99:0/591899363 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a88071880 msgr2=0x7f1a8806b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:06.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:06.237+0000 7f1a8e400640 1 --2- 172.21.15.99:0/591899363 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a88071880 0x7f1a8806b420 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1a7800e8a0 tx=0x7f1a7800ed60 comp rx=0 tx=0).stop 2024-02-21T23:01:06.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:06.237+0000 7f1a8e400640 1 -- 172.21.15.99:0/591899363 shutdown_connections 2024-02-21T23:01:06.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:06.237+0000 7f1a8e400640 1 --2- 172.21.15.99:0/591899363 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f1a6409ed60 0x7f1a640a1220 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:06.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:06.237+0000 7f1a8e400640 1 --2- 172.21.15.99:0/591899363 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1a88186ab0 0x7f1a88174fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:06.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:06.237+0000 7f1a8e400640 1 --2- 172.21.15.99:0/591899363 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1a88074730 0x7f1a88176c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:06.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:06.237+0000 7f1a8e400640 1 --2- 172.21.15.99:0/591899363 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a88071880 0x7f1a8806b420 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:06.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:06.237+0000 7f1a8e400640 1 -- 172.21.15.99:0/591899363 >> 172.21.15.99:0/591899363 conn(0x7f1a8806e2c0 msgr2=0x7f1a8817b050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:06.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:06.238+0000 7f1a8e400640 1 -- 172.21.15.99:0/591899363 shutdown_connections 2024-02-21T23:01:06.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:06.238+0000 7f1a8e400640 1 -- 172.21.15.99:0/591899363 wait complete. 2024-02-21T23:01:06.256 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-02-21T23:01:06.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:06.451+0000 7f7ba6600640 1 Processor -- start 2024-02-21T23:01:06.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:06.451+0000 7f7ba6600640 1 -- start start 2024-02-21T23:01:06.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:06.453+0000 7f7ba6600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7ba00fa1d0 0x7f7ba00fa660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:06.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:06.453+0000 7f7ba6600640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ba00f9a10 con 0x7f7ba018c0e0 2024-02-21T23:01:06.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:06.453+0000 7f7ba6600640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ba006d2a0 con 0x7f7ba018c4c0 2024-02-21T23:01:06.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:06.453+0000 7f7ba6600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ba00703b0 con 0x7f7ba00fa1d0 2024-02-21T23:01:06.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:06.453+0000 7f7ba5200640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f7ba018c0e0 0x7f7ba006cab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:33642/0 (socket says 172.21.15.99:33642) 2024-02-21T23:01:06.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:06.453+0000 7f7ba5200640 1 -- 172.21.15.99:0/3000588318 learned_addr learned my addr 172.21.15.99:0/3000588318 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:01:06.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:06.453+0000 7f7ba5c00640 1 --2- 172.21.15.99:0/3000588318 >> v2:172.21.15.99:3300/0 conn(0x7f7ba00fa1d0 0x7f7ba00fa660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:06.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:06.454+0000 7f7ba5c00640 1 -- 172.21.15.99:0/3000588318 >> v1:172.21.15.181:6789/0 conn(0x7f7ba018c4c0 legacy=0x7f7ba018c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:06.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:06.454+0000 7f7ba5c00640 1 -- 172.21.15.99:0/3000588318 >> v1:172.21.15.99:6789/0 conn(0x7f7ba018c0e0 legacy=0x7f7ba006cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:06.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:06.454+0000 7f7b9f400640 1 -- 172.21.15.99:0/3000588318 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2247255849 0 0) 0x7f7ba006d2a0 con 0x7f7ba018c4c0 2024-02-21T23:01:06.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:06.454+0000 7f7ba5c00640 1 -- 172.21.15.99:0/3000588318 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ba006d580 con 0x7f7ba00fa1d0 2024-02-21T23:01:06.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:06.455+0000 7f7ba5c00640 1 --2- 172.21.15.99:0/3000588318 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ba00fa1d0 0x7f7ba00fa660 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7b98009d90 tx=0x7f7b9802bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c993b352d9786c9a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:06.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:06.455+0000 7f7b9f400640 1 -- 172.21.15.99:0/3000588318 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b98039070 con 0x7f7ba00fa1d0 2024-02-21T23:01:06.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:06.455+0000 7f7b9f400640 1 -- 172.21.15.99:0/3000588318 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b9802ccf0 con 0x7f7ba00fa1d0 2024-02-21T23:01:06.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:06.455+0000 7f7b9f400640 1 -- 172.21.15.99:0/3000588318 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b98034660 con 0x7f7ba00fa1d0 2024-02-21T23:01:06.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:06.456+0000 7f7ba6600640 1 -- 172.21.15.99:0/3000588318 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ba00fa1d0 msgr2=0x7f7ba00fa660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:06.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:06.456+0000 7f7ba6600640 1 --2- 172.21.15.99:0/3000588318 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ba00fa1d0 0x7f7ba00fa660 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7b98009d90 tx=0x7f7b9802bf40 comp rx=0 tx=0).stop 2024-02-21T23:01:06.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:06.456+0000 7f7ba6600640 1 -- 172.21.15.99:0/3000588318 shutdown_connections 2024-02-21T23:01:06.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:06.456+0000 7f7ba6600640 1 --2- 172.21.15.99:0/3000588318 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ba00fa1d0 0x7f7ba00fa660 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:06.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:06.456+0000 7f7ba6600640 1 -- 172.21.15.99:0/3000588318 >> 172.21.15.99:0/3000588318 conn(0x7f7ba008cfd0 msgr2=0x7f7ba008d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:06.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:06.456+0000 7f7ba6600640 1 -- 172.21.15.99:0/3000588318 shutdown_connections 2024-02-21T23:01:06.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:06.456+0000 7f7ba6600640 1 -- 172.21.15.99:0/3000588318 wait complete. 2024-02-21T23:01:06.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:06.458+0000 7f7ba6600640 1 Processor -- start 2024-02-21T23:01:06.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:06.458+0000 7f7ba6600640 1 -- start start 2024-02-21T23:01:06.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:06.459+0000 7f7ba6600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ba00fa1d0 0x7f7ba00f62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:06.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:06.459+0000 7f7ba6600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7ba018c0e0 0x7f7ba0173470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:06.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:06.459+0000 7f7ba6600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7ba018c4c0 0x7f7ba0220720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:06.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:06.459+0000 7f7ba6600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba006db40 con 0x7f7ba00fa1d0 2024-02-21T23:01:06.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:06.459+0000 7f7ba6600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba0189b00 con 0x7f7ba018c0e0 2024-02-21T23:01:06.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:06.459+0000 7f7ba6600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba00f9cb0 con 0x7f7ba018c4c0 2024-02-21T23:01:06.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:06.459+0000 7f7ba5200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ba00fa1d0 0x7f7ba00f62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:06.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:06.459+0000 7f7ba5200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ba00fa1d0 0x7f7ba00f62d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56512/0 (socket says 172.21.15.99:56512) 2024-02-21T23:01:06.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:06.459+0000 7f7ba5200640 1 -- 172.21.15.99:0/3237987798 learned_addr learned my addr 172.21.15.99:0/3237987798 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:06.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:06.460+0000 7f7b9fe00640 1 --2- 172.21.15.99:0/3237987798 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7ba018c0e0 0x7f7ba0173470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:06.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:06.460+0000 7f7ba5c00640 1 --2- 172.21.15.99:0/3237987798 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7ba018c4c0 0x7f7ba0220720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:06.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:06.460+0000 7f7ba5200640 1 -- 172.21.15.99:0/3237987798 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7ba018c4c0 msgr2=0x7f7ba0220720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:06.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:06.460+0000 7f7ba5200640 1 --2- 172.21.15.99:0/3237987798 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7ba018c4c0 0x7f7ba0220720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:06.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:06.460+0000 7f7ba5200640 1 -- 172.21.15.99:0/3237987798 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7ba018c0e0 msgr2=0x7f7ba0173470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:06.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:06.460+0000 7f7ba5200640 1 --2- 172.21.15.99:0/3237987798 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7ba018c0e0 0x7f7ba0173470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:06.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:06.460+0000 7f7ba5200640 1 -- 172.21.15.99:0/3237987798 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ba0181110 con 0x7f7ba00fa1d0 2024-02-21T23:01:06.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:06.460+0000 7f7ba5200640 1 --2- 172.21.15.99:0/3237987798 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ba00fa1d0 0x7f7ba00f62d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7b9400c3f0 tx=0x7f7b9400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:06.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:06.460+0000 7f7b9cc00640 1 -- 172.21.15.99:0/3237987798 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b94017070 con 0x7f7ba00fa1d0 2024-02-21T23:01:06.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:06.461+0000 7f7b9cc00640 1 -- 172.21.15.99:0/3237987798 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b94005ce0 con 0x7f7ba00fa1d0 2024-02-21T23:01:06.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:06.461+0000 7f7b9cc00640 1 -- 172.21.15.99:0/3237987798 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b940072f0 con 0x7f7ba00fa1d0 2024-02-21T23:01:06.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:06.461+0000 7f7ba6600640 1 -- 172.21.15.99:0/3237987798 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ba01813f0 con 0x7f7ba00fa1d0 2024-02-21T23:01:06.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:06.461+0000 7f7ba6600640 1 -- 172.21.15.99:0/3237987798 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ba01819b0 con 0x7f7ba00fa1d0 2024-02-21T23:01:06.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:06.462+0000 7f7ba6600640 1 -- 172.21.15.99:0/3237987798 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ba006dd80 con 0x7f7ba00fa1d0 2024-02-21T23:01:06.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:06.464+0000 7f7b9cc00640 1 -- 172.21.15.99:0/3237987798 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 134356+0+0 (secure 0 0 0) 0x7f7b9401a070 con 0x7f7ba00fa1d0 2024-02-21T23:01:06.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:06.465+0000 7f7b9cc00640 1 --2- 172.21.15.99:0/3237987798 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f7b8009ee30 0x7f7b800a12f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:06.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:06.465+0000 7f7b9cc00640 1 -- 172.21.15.99:0/3237987798 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 8340+0+0 (secure 0 0 0) 0x7f7b940c9030 con 0x7f7ba00fa1d0 2024-02-21T23:01:06.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:06.465+0000 7f7b9fe00640 1 --2- 172.21.15.99:0/3237987798 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f7b8009ee30 0x7f7b800a12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:06.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:06.466+0000 7f7b9fe00640 1 --2- 172.21.15.99:0/3237987798 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f7b8009ee30 0x7f7b800a12f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7ba00ccc70 tx=0x7f7b8c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:06.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:06.468+0000 7f7b9cc00640 1 -- 172.21.15.99:0/3237987798 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f7ba006dd80 con 0x7f7ba00fa1d0 2024-02-21T23:01:06.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:06.650+0000 7f7ba6600640 1 -- 172.21.15.99:0/3237987798 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f7ba0070560 con 0x7f7ba00fa1d0 2024-02-21T23:01:07.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:07.237+0000 7f7b9cc00640 1 -- 172.21.15.99:0/3237987798 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v28) v1 ==== 169+0+0 (secure 0 0 0) 0x7f7b94021020 con 0x7f7ba00fa1d0 2024-02-21T23:01:07.227 INFO:teuthology.orchestra.run.smithi099.stderr:set pool 4 allow_ec_overwrites to true 2024-02-21T23:01:07.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:07.240+0000 7f7ba6600640 1 -- 172.21.15.99:0/3237987798 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f7b8009ee30 msgr2=0x7f7b800a12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:07.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:07.240+0000 7f7ba6600640 1 --2- 172.21.15.99:0/3237987798 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f7b8009ee30 0x7f7b800a12f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7ba00ccc70 tx=0x7f7b8c009040 comp rx=0 tx=0).stop 2024-02-21T23:01:07.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:07.240+0000 7f7ba6600640 1 -- 172.21.15.99:0/3237987798 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ba00fa1d0 msgr2=0x7f7ba00f62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:07.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:07.240+0000 7f7ba6600640 1 --2- 172.21.15.99:0/3237987798 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ba00fa1d0 0x7f7ba00f62d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7b9400c3f0 tx=0x7f7b9400c8b0 comp rx=0 tx=0).stop 2024-02-21T23:01:07.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:07.240+0000 7f7ba6600640 1 -- 172.21.15.99:0/3237987798 shutdown_connections 2024-02-21T23:01:07.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:07.240+0000 7f7ba6600640 1 --2- 172.21.15.99:0/3237987798 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f7b8009ee30 0x7f7b800a12f0 secure :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7ba00ccc70 tx=0x7f7b8c009040 comp rx=0 tx=0).stop 2024-02-21T23:01:07.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:07.240+0000 7f7ba6600640 1 --2- 172.21.15.99:0/3237987798 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7ba018c4c0 0x7f7ba0220720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:07.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:07.240+0000 7f7ba6600640 1 --2- 172.21.15.99:0/3237987798 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7ba018c0e0 0x7f7ba0173470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:07.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:07.240+0000 7f7ba6600640 1 --2- 172.21.15.99:0/3237987798 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7ba00fa1d0 0x7f7ba00f62d0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:07.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:07.240+0000 7f7ba6600640 1 -- 172.21.15.99:0/3237987798 >> 172.21.15.99:0/3237987798 conn(0x7f7ba008cfd0 msgr2=0x7f7ba00fa5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:07.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:07.241+0000 7f7ba6600640 1 -- 172.21.15.99:0/3237987798 shutdown_connections 2024-02-21T23:01:07.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:07.241+0000 7f7ba6600640 1 -- 172.21.15.99:0/3237987798 wait complete. 2024-02-21T23:01:07.271 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-02-21T23:01:07.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:07.456+0000 7f4392c00640 1 Processor -- start 2024-02-21T23:01:07.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:07.456+0000 7f4392c00640 1 -- start start 2024-02-21T23:01:07.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:07.458+0000 7f4392c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f438c186400 0x7f438c187ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:07.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:07.458+0000 7f4392c00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f438c188720 con 0x7f438c0d4320 2024-02-21T23:01:07.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:07.458+0000 7f4392c00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f438c0cf820 con 0x7f438c1867e0 2024-02-21T23:01:07.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:07.458+0000 7f4392c00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f438c187640 con 0x7f438c186400 2024-02-21T23:01:07.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:07.458+0000 7f4390c00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f438c0d4320 0x7f438c0d4750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:36060/0 (socket says 172.21.15.99:36060) 2024-02-21T23:01:07.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:07.458+0000 7f438be00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f438c186400 0x7f438c187ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:07.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:07.458+0000 7f4390c00640 1 -- 172.21.15.99:0/1356671874 learned_addr learned my addr 172.21.15.99:0/1356671874 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:01:07.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:07.459+0000 7f438aa00640 1 -- 172.21.15.99:0/1356671874 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1078371051 0 0) 0x7f438c188720 con 0x7f438c0d4320 2024-02-21T23:01:07.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:07.459+0000 7f438aa00640 1 -- 172.21.15.99:0/1356671874 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4370003520 con 0x7f438c0d4320 2024-02-21T23:01:07.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:07.459+0000 7f438aa00640 1 -- 172.21.15.99:0/1356671874 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3330829074 0 0) 0x7f438c0cf820 con 0x7f438c1867e0 2024-02-21T23:01:07.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:07.459+0000 7f438be00640 1 -- 172.21.15.99:0/1356671874 >> v1:172.21.15.162:6789/0 conn(0x7f438c1867e0 legacy=0x7f438c188010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:07.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:07.459+0000 7f438be00640 1 -- 172.21.15.99:0/1356671874 >> v1:172.21.15.99:6789/0 conn(0x7f438c0d4320 legacy=0x7f438c0d4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:07.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:07.459+0000 7f438be00640 1 -- 172.21.15.99:0/1356671874 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f438c0cfb00 con 0x7f438c186400 2024-02-21T23:01:07.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:07.460+0000 7f438be00640 1 --2- 172.21.15.99:0/1356671874 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f438c186400 0x7f438c187ad0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f437c0097a0 tx=0x7f437c02b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4077f7c50678b6ac server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:07.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:07.460+0000 7f438aa00640 1 -- 172.21.15.99:0/1356671874 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f437c0315a0 con 0x7f438c186400 2024-02-21T23:01:07.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:07.460+0000 7f438aa00640 1 -- 172.21.15.99:0/1356671874 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f437c037070 con 0x7f438c186400 2024-02-21T23:01:07.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:07.460+0000 7f438aa00640 1 -- 172.21.15.99:0/1356671874 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f437c031960 con 0x7f438c186400 2024-02-21T23:01:07.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:07.461+0000 7f4392c00640 1 -- 172.21.15.99:0/1356671874 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f438c186400 msgr2=0x7f438c187ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:07.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:07.461+0000 7f4392c00640 1 --2- 172.21.15.99:0/1356671874 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f438c186400 0x7f438c187ad0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f437c0097a0 tx=0x7f437c02b840 comp rx=0 tx=0).stop 2024-02-21T23:01:07.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:07.461+0000 7f4392c00640 1 -- 172.21.15.99:0/1356671874 shutdown_connections 2024-02-21T23:01:07.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:07.461+0000 7f4392c00640 1 --2- 172.21.15.99:0/1356671874 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f438c186400 0x7f438c187ad0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:07.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:07.461+0000 7f4392c00640 1 -- 172.21.15.99:0/1356671874 >> 172.21.15.99:0/1356671874 conn(0x7f438c0d6af0 msgr2=0x7f438c0740b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:07.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:07.461+0000 7f4392c00640 1 -- 172.21.15.99:0/1356671874 shutdown_connections 2024-02-21T23:01:07.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:07.461+0000 7f4392c00640 1 -- 172.21.15.99:0/1356671874 wait complete. 2024-02-21T23:01:07.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:07.463+0000 7f4392c00640 1 Processor -- start 2024-02-21T23:01:07.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:07.463+0000 7f4392c00640 1 -- start start 2024-02-21T23:01:07.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:07.464+0000 7f4392c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f438c0d4320 0x7f438c16a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:07.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:07.464+0000 7f4392c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f438c186400 0x7f438c0fa980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:07.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:07.464+0000 7f4392c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f438c1867e0 0x7f438c0d0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:07.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:07.464+0000 7f4392c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f438c1872d0 con 0x7f438c186400 2024-02-21T23:01:07.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:07.464+0000 7f4392c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f438c186ff0 con 0x7f438c1867e0 2024-02-21T23:01:07.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:07.464+0000 7f4392c00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f438c0ceeb0 con 0x7f438c0d4320 2024-02-21T23:01:07.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:07.464+0000 7f438b400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f438c186400 0x7f438c0fa980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:07.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:07.464+0000 7f4390c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f438c1867e0 0x7f438c0d0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:07.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:07.464+0000 7f438b400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f438c186400 0x7f438c0fa980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:57602/0 (socket says 172.21.15.99:57602) 2024-02-21T23:01:07.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:07.464+0000 7f438b400640 1 -- 172.21.15.99:0/2576751796 learned_addr learned my addr 172.21.15.99:0/2576751796 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:07.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:07.464+0000 7f438be00640 1 --2- 172.21.15.99:0/2576751796 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f438c0d4320 0x7f438c16a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:07.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:07.465+0000 7f438b400640 1 -- 172.21.15.99:0/2576751796 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f438c0d4320 msgr2=0x7f438c16a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:07.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:07.465+0000 7f438b400640 1 --2- 172.21.15.99:0/2576751796 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f438c0d4320 0x7f438c16a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:07.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:07.465+0000 7f438b400640 1 -- 172.21.15.99:0/2576751796 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f438c1867e0 msgr2=0x7f438c0d0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:07.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:07.465+0000 7f438b400640 1 --2- 172.21.15.99:0/2576751796 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f438c1867e0 0x7f438c0d0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:07.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:07.465+0000 7f438b400640 1 -- 172.21.15.99:0/2576751796 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f438c16ae50 con 0x7f438c186400 2024-02-21T23:01:07.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:07.465+0000 7f4390c00640 1 --2- 172.21.15.99:0/2576751796 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f438c1867e0 0x7f438c0d0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:01:07.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:07.465+0000 7f438b400640 1 --2- 172.21.15.99:0/2576751796 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f438c186400 0x7f438c0fa980 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f437800c3c0 tx=0x7f437800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:07.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:07.465+0000 7f4383e00640 1 -- 172.21.15.99:0/2576751796 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4378017070 con 0x7f438c186400 2024-02-21T23:01:07.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:07.465+0000 7f4383e00640 1 -- 172.21.15.99:0/2576751796 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43780035f0 con 0x7f438c186400 2024-02-21T23:01:07.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:07.465+0000 7f4392c00640 1 -- 172.21.15.99:0/2576751796 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f438c185b40 con 0x7f438c186400 2024-02-21T23:01:07.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:07.465+0000 7f4383e00640 1 -- 172.21.15.99:0/2576751796 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43780039e0 con 0x7f438c186400 2024-02-21T23:01:07.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:07.466+0000 7f4392c00640 1 -- 172.21.15.99:0/2576751796 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f438c0d0230 con 0x7f438c186400 2024-02-21T23:01:07.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:07.467+0000 7f4392c00640 1 -- 172.21.15.99:0/2576751796 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f438c068780 con 0x7f438c186400 2024-02-21T23:01:07.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:07.469+0000 7f4383e00640 1 -- 172.21.15.99:0/2576751796 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 134356+0+0 (secure 0 0 0) 0x7f437801a070 con 0x7f438c186400 2024-02-21T23:01:07.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:07.470+0000 7f4383e00640 1 --2- 172.21.15.99:0/2576751796 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f436c09ed60 0x7f436c0a1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:07.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:07.470+0000 7f4383e00640 1 -- 172.21.15.99:0/2576751796 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8340+0+0 (secure 0 0 0) 0x7f43780c9120 con 0x7f438c186400 2024-02-21T23:01:07.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:07.470+0000 7f438be00640 1 --2- 172.21.15.99:0/2576751796 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f436c09ed60 0x7f436c0a1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:07.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:07.471+0000 7f438be00640 1 --2- 172.21.15.99:0/2576751796 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f436c09ed60 0x7f436c0a1220 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f437c036000 tx=0x7f437c03d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:07.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:07.472+0000 7f4383e00640 1 -- 172.21.15.99:0/2576751796 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f4378021020 con 0x7f438c186400 2024-02-21T23:01:07.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:07.720+0000 7f4392c00640 1 -- 172.21.15.99:0/2576751796 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f438c08d210 con 0x7f438c186400 2024-02-21T23:01:08.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.267+0000 7f4383e00640 1 -- 172.21.15.99:0/2576751796 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7f4378096da0 con 0x7f438c186400 2024-02-21T23:01:08.257 INFO:teuthology.orchestra.run.smithi099.stderr:added data pool 4 to fsmap 2024-02-21T23:01:08.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.270+0000 7f4392c00640 1 -- 172.21.15.99:0/2576751796 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f436c09ed60 msgr2=0x7f436c0a1220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:08.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.270+0000 7f4392c00640 1 --2- 172.21.15.99:0/2576751796 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f436c09ed60 0x7f436c0a1220 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f437c036000 tx=0x7f437c03d040 comp rx=0 tx=0).stop 2024-02-21T23:01:08.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.270+0000 7f4392c00640 1 -- 172.21.15.99:0/2576751796 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f438c186400 msgr2=0x7f438c0fa980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:08.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.270+0000 7f4392c00640 1 --2- 172.21.15.99:0/2576751796 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f438c186400 0x7f438c0fa980 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f437800c3c0 tx=0x7f437800c880 comp rx=0 tx=0).stop 2024-02-21T23:01:08.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.270+0000 7f4392c00640 1 -- 172.21.15.99:0/2576751796 shutdown_connections 2024-02-21T23:01:08.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.270+0000 7f4392c00640 1 --2- 172.21.15.99:0/2576751796 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f436c09ed60 0x7f436c0a1220 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:08.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.270+0000 7f4392c00640 1 --2- 172.21.15.99:0/2576751796 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f438c1867e0 0x7f438c0d0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:08.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.270+0000 7f4392c00640 1 --2- 172.21.15.99:0/2576751796 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f438c186400 0x7f438c0fa980 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:08.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.270+0000 7f4392c00640 1 --2- 172.21.15.99:0/2576751796 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f438c0d4320 0x7f438c16a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:08.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.270+0000 7f4392c00640 1 -- 172.21.15.99:0/2576751796 >> 172.21.15.99:0/2576751796 conn(0x7f438c0d6af0 msgr2=0x7f438c17ed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:08.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.270+0000 7f4392c00640 1 -- 172.21.15.99:0/2576751796 shutdown_connections 2024-02-21T23:01:08.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.271+0000 7f4392c00640 1 -- 172.21.15.99:0/2576751796 wait complete. 2024-02-21T23:01:08.281 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T23:01:08.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.490+0000 7fe5e1400640 1 Processor -- start 2024-02-21T23:01:08.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.490+0000 7fe5e1400640 1 -- start start 2024-02-21T23:01:08.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.492+0000 7fe5e1400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe5dc186b90 0x7fe5dc186f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:08.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.492+0000 7fe5e1400640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5dc17d980 con 0x7fe5dc18ab00 2024-02-21T23:01:08.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.492+0000 7fe5e1400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5dc185950 con 0x7fe5dc1874b0 2024-02-21T23:01:08.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.492+0000 7fe5e1400640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5dc185c30 con 0x7fe5dc186b90 2024-02-21T23:01:08.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.493+0000 7fe5da800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe5dc186b90 0x7fe5dc186f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:08.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.493+0000 7fe5d1e00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fe5dc1874b0 0x7fe5dc18a3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.99:38020/0 (socket says 172.21.15.99:38020) 2024-02-21T23:01:08.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.493+0000 7fe5d1e00640 1 -- 172.21.15.99:0/3598412896 learned_addr learned my addr 172.21.15.99:0/3598412896 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:01:08.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.493+0000 7fe5db200640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fe5dc18ab00 0x7fe5dc184a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:36074/0 (socket says 172.21.15.99:36074) 2024-02-21T23:01:08.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.493+0000 7fe5da800640 1 -- 172.21.15.99:0/3598412896 >> v1:172.21.15.162:6789/0 conn(0x7fe5dc1874b0 legacy=0x7fe5dc18a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:08.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.493+0000 7fe5da800640 1 -- 172.21.15.99:0/3598412896 >> v1:172.21.15.99:6789/0 conn(0x7fe5dc18ab00 legacy=0x7fe5dc184a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:08.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.493+0000 7fe5d9e00640 1 -- 172.21.15.99:0/3598412896 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1675954975 0 0) 0x7fe5dc185950 con 0x7fe5dc1874b0 2024-02-21T23:01:08.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.493+0000 7fe5da800640 1 -- 172.21.15.99:0/3598412896 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5dc185f10 con 0x7fe5dc186b90 2024-02-21T23:01:08.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.495+0000 7fe5da800640 1 --2- 172.21.15.99:0/3598412896 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe5dc186b90 0x7fe5dc186f70 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc0097a0 tx=0x7fe5cc02b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e14a3c7b9c6c676d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:08.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.495+0000 7fe5d9e00640 1 -- 172.21.15.99:0/3598412896 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5cc037070 con 0x7fe5dc186b90 2024-02-21T23:01:08.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.495+0000 7fe5d9e00640 1 -- 172.21.15.99:0/3598412896 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5cc030710 con 0x7fe5dc186b90 2024-02-21T23:01:08.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.495+0000 7fe5d9e00640 1 -- 172.21.15.99:0/3598412896 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5cc030ae0 con 0x7fe5dc186b90 2024-02-21T23:01:08.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.495+0000 7fe5e1400640 1 -- 172.21.15.99:0/3598412896 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe5dc186b90 msgr2=0x7fe5dc186f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:08.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.495+0000 7fe5e1400640 1 --2- 172.21.15.99:0/3598412896 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe5dc186b90 0x7fe5dc186f70 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc0097a0 tx=0x7fe5cc02b790 comp rx=0 tx=0).stop 2024-02-21T23:01:08.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.496+0000 7fe5e1400640 1 -- 172.21.15.99:0/3598412896 shutdown_connections 2024-02-21T23:01:08.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.496+0000 7fe5e1400640 1 --2- 172.21.15.99:0/3598412896 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe5dc186b90 0x7fe5dc186f70 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:08.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.496+0000 7fe5e1400640 1 -- 172.21.15.99:0/3598412896 >> 172.21.15.99:0/3598412896 conn(0x7fe5dc0ce5f0 msgr2=0x7fe5dc0cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:08.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.496+0000 7fe5e1400640 1 -- 172.21.15.99:0/3598412896 shutdown_connections 2024-02-21T23:01:08.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.496+0000 7fe5e1400640 1 -- 172.21.15.99:0/3598412896 wait complete. 2024-02-21T23:01:08.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.498+0000 7fe5e1400640 1 Processor -- start 2024-02-21T23:01:08.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.498+0000 7fe5e1400640 1 -- start start 2024-02-21T23:01:08.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.499+0000 7fe5e1400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe5dc186b90 0x7fe5dc16c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:08.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.499+0000 7fe5e1400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe5dc1874b0 0x7fe5dc220540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:08.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.499+0000 7fe5e1400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe5dc18ab00 0x7fe5dc21f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:08.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.499+0000 7fe5e1400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5dc1867b0 con 0x7fe5dc186b90 2024-02-21T23:01:08.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.499+0000 7fe5e1400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5dc1864d0 con 0x7fe5dc18ab00 2024-02-21T23:01:08.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.499+0000 7fe5e1400640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5dc0cbf20 con 0x7fe5dc1874b0 2024-02-21T23:01:08.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.499+0000 7fe5da800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe5dc186b90 0x7fe5dc16c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:08.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.499+0000 7fe5da800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe5dc186b90 0x7fe5dc16c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:57622/0 (socket says 172.21.15.99:57622) 2024-02-21T23:01:08.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.499+0000 7fe5da800640 1 -- 172.21.15.99:0/298952622 learned_addr learned my addr 172.21.15.99:0/298952622 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:08.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.499+0000 7fe5db200640 1 --2- 172.21.15.99:0/298952622 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe5dc18ab00 0x7fe5dc21f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:08.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.499+0000 7fe5d1e00640 1 --2- 172.21.15.99:0/298952622 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe5dc1874b0 0x7fe5dc220540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:08.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.500+0000 7fe5da800640 1 -- 172.21.15.99:0/298952622 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe5dc1874b0 msgr2=0x7fe5dc220540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:08.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.500+0000 7fe5da800640 1 --2- 172.21.15.99:0/298952622 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe5dc1874b0 0x7fe5dc220540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:08.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.500+0000 7fe5da800640 1 -- 172.21.15.99:0/298952622 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe5dc18ab00 msgr2=0x7fe5dc21f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:08.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.500+0000 7fe5da800640 1 --2- 172.21.15.99:0/298952622 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe5dc18ab00 0x7fe5dc21f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:08.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.500+0000 7fe5da800640 1 -- 172.21.15.99:0/298952622 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5dc16f410 con 0x7fe5dc186b90 2024-02-21T23:01:08.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.500+0000 7fe5da800640 1 --2- 172.21.15.99:0/298952622 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe5dc186b90 0x7fe5dc16c2a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc000c00 tx=0x7fe5cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:08.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.500+0000 7fe5d3400640 1 -- 172.21.15.99:0/298952622 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5cc042070 con 0x7fe5dc186b90 2024-02-21T23:01:08.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.500+0000 7fe5d3400640 1 -- 172.21.15.99:0/298952622 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5cc032a40 con 0x7fe5dc186b90 2024-02-21T23:01:08.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.500+0000 7fe5e1400640 1 -- 172.21.15.99:0/298952622 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5dc16ca60 con 0x7fe5dc186b90 2024-02-21T23:01:08.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.501+0000 7fe5d3400640 1 -- 172.21.15.99:0/298952622 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5cc037040 con 0x7fe5dc186b90 2024-02-21T23:01:08.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.501+0000 7fe5e1400640 1 -- 172.21.15.99:0/298952622 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5dc16d020 con 0x7fe5dc186b90 2024-02-21T23:01:08.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.502+0000 7fe5e1400640 1 -- 172.21.15.99:0/298952622 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5dc0cc1c0 con 0x7fe5dc186b90 2024-02-21T23:01:08.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.504+0000 7fe5d3400640 1 -- 172.21.15.99:0/298952622 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 134356+0+0 (secure 0 0 0) 0x7fe5cc045070 con 0x7fe5dc186b90 2024-02-21T23:01:08.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.505+0000 7fe5d3400640 1 --2- 172.21.15.99:0/298952622 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fe5b809ed60 0x7fe5b80a1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:08.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.505+0000 7fe5d3400640 1 -- 172.21.15.99:0/298952622 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fe5cc0eb900 con 0x7fe5dc186b90 2024-02-21T23:01:08.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.505+0000 7fe5d1e00640 1 --2- 172.21.15.99:0/298952622 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fe5b809ed60 0x7fe5b80a1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:08.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.506+0000 7fe5d1e00640 1 --2- 172.21.15.99:0/298952622 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fe5b809ed60 0x7fe5b80a1220 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe5dc21cf10 tx=0x7fe5c4007e40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:08.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.509+0000 7fe5d3400640 1 -- 172.21.15.99:0/298952622 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fe5cc0b9680 con 0x7fe5dc186b90 2024-02-21T23:01:08.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.747+0000 7fe5e1400640 1 -- 172.21.15.99:0/298952622 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe5dc0f8ac0 con 0x7fe5dc186b90 2024-02-21T23:01:08.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.749+0000 7fe5d3400640 1 -- 172.21.15.99:0/298952622 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+11278 (secure 0 0 0) 0x7fe5cc0bd720 con 0x7fe5dc186b90 2024-02-21T23:01:08.739 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T23:01:08.740 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4307,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/3514452812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3514452812},{"type":"v1","addr":"172.21.15.162:6836","nonce":3514452812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4312,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6838/2169982089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":2169982089},{"type":"v1","addr":"172.21.15.162:6838","nonce":2169982089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4315,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6839/3335972724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6837","nonce":3335972724},{"type":"v1","addr":"172.21.15.162:6839","nonce":3335972724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4318,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6841/2135456697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6840","nonce":2135456697},{"type":"v1","addr":"172.21.15.162:6841","nonce":2135456697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4325,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2452242758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2452242758},{"type":"v1","addr":"172.21.15.181:6833","nonce":2452242758}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4328,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6836/2751486400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":2751486400},{"type":"v1","addr":"172.21.15.181:6836","nonce":2751486400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4331,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6838/3728901330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6835","nonce":3728901330},{"type":"v1","addr":"172.21.15.181:6838","nonce":3728901330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4339,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6839/3357929641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6837","nonce":3357929641},{"type":"v1","addr":"172.21.15.181:6839","nonce":3357929641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4343,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6833/2793485078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":2793485078},{"type":"v1","addr":"172.21.15.99:6833","nonce":2793485078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4348,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2243461688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2243461688},{"type":"v1","addr":"172.21.15.99:6835","nonce":2243461688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4352,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/1676159950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":1676159950},{"type":"v1","addr":"172.21.15.99:6837","nonce":1676159950}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-21T23:01:02.656130+0000","modified":"2024-02-21T23:01:07.722827+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4355},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4355":{"gid":4355,"name":"j","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6839/4239008786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":4239008786},{"type":"v1","addr":"172.21.15.99:6839","nonce":4239008786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-21T23:01:08.740 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 7 2024-02-21T23:01:08.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.752+0000 7fe5e1400640 1 -- 172.21.15.99:0/298952622 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fe5b809ed60 msgr2=0x7fe5b80a1220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:08.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.752+0000 7fe5e1400640 1 --2- 172.21.15.99:0/298952622 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fe5b809ed60 0x7fe5b80a1220 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe5dc21cf10 tx=0x7fe5c4007e40 comp rx=0 tx=0).stop 2024-02-21T23:01:08.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.752+0000 7fe5e1400640 1 -- 172.21.15.99:0/298952622 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe5dc186b90 msgr2=0x7fe5dc16c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:08.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.752+0000 7fe5e1400640 1 --2- 172.21.15.99:0/298952622 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe5dc186b90 0x7fe5dc16c2a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc000c00 tx=0x7fe5cc0046c0 comp rx=0 tx=0).stop 2024-02-21T23:01:08.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.752+0000 7fe5e1400640 1 -- 172.21.15.99:0/298952622 shutdown_connections 2024-02-21T23:01:08.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.752+0000 7fe5e1400640 1 --2- 172.21.15.99:0/298952622 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fe5b809ed60 0x7fe5b80a1220 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:08.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.752+0000 7fe5e1400640 1 --2- 172.21.15.99:0/298952622 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe5dc18ab00 0x7fe5dc21f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:08.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.752+0000 7fe5e1400640 1 --2- 172.21.15.99:0/298952622 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe5dc1874b0 0x7fe5dc220540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:08.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.752+0000 7fe5e1400640 1 --2- 172.21.15.99:0/298952622 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe5dc186b90 0x7fe5dc16c2a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:08.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.752+0000 7fe5e1400640 1 -- 172.21.15.99:0/298952622 >> 172.21.15.99:0/298952622 conn(0x7fe5dc0ce5f0 msgr2=0x7fe5dc18a0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:08.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.752+0000 7fe5e1400640 1 -- 172.21.15.99:0/298952622 shutdown_connections 2024-02-21T23:01:08.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.752+0000 7fe5e1400640 1 -- 172.21.15.99:0/298952622 wait complete. 2024-02-21T23:01:08.763 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T23:01:08.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.970+0000 7f409ee00640 1 Processor -- start 2024-02-21T23:01:08.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.970+0000 7f409ee00640 1 -- start start 2024-02-21T23:01:08.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.972+0000 7f409ee00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f40980740b0 0x7f4098188f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:08.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.972+0000 7f409ee00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4098189450 0x7f4098074490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:08.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.972+0000 7f409ee00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f40980749d0 0x7f40980fa250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:08.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.972+0000 7f409ee00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f409806dd90 con 0x7f40980740b0 2024-02-21T23:01:08.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.972+0000 7f409ee00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40980f91b0 con 0x7f4098189450 2024-02-21T23:01:08.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.972+0000 7f409ee00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40980f9490 con 0x7f40980749d0 2024-02-21T23:01:08.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.973+0000 7f409da00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f40980740b0 0x7f4098188f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:08.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.973+0000 7f409d000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4098189450 0x7f4098074490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:08.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.973+0000 7f409da00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f40980740b0 0x7f4098188f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:57624/0 (socket says 172.21.15.99:57624) 2024-02-21T23:01:08.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.973+0000 7f409da00640 1 -- 172.21.15.99:0/3451768616 learned_addr learned my addr 172.21.15.99:0/3451768616 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:08.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.973+0000 7f409e400640 1 --2- 172.21.15.99:0/3451768616 >> v2:172.21.15.181:3300/0 conn(0x7f40980749d0 0x7f40980fa250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:08.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.973+0000 7f409d000640 1 -- 172.21.15.99:0/3451768616 >> v2:172.21.15.181:3300/0 conn(0x7f40980749d0 msgr2=0x7f40980fa250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:08.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.973+0000 7f409d000640 1 --2- 172.21.15.99:0/3451768616 >> v2:172.21.15.181:3300/0 conn(0x7f40980749d0 0x7f40980fa250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:08.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.973+0000 7f409d000640 1 -- 172.21.15.99:0/3451768616 >> v2:172.21.15.99:3300/0 conn(0x7f40980740b0 msgr2=0x7f4098188f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:08.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.973+0000 7f409d000640 1 --2- 172.21.15.99:0/3451768616 >> v2:172.21.15.99:3300/0 conn(0x7f40980740b0 0x7f4098188f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:08.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.973+0000 7f409d000640 1 -- 172.21.15.99:0/3451768616 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40980f9770 con 0x7f4098189450 2024-02-21T23:01:08.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.973+0000 7f409da00640 1 --2- 172.21.15.99:0/3451768616 >> v2:172.21.15.99:3300/0 conn(0x7f40980740b0 0x7f4098188f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:01:08.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.974+0000 7f409d000640 1 --2- 172.21.15.99:0/3451768616 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4098189450 0x7f4098074490 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f40980706e0 tx=0x7f408402b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74cdee9aa4a1c837 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:08.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.975+0000 7f4097e00640 1 -- 172.21.15.99:0/3451768616 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40840317c0 con 0x7f4098189450 2024-02-21T23:01:08.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.975+0000 7f4097e00640 1 -- 172.21.15.99:0/3451768616 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4084037070 con 0x7f4098189450 2024-02-21T23:01:08.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.975+0000 7f4097e00640 1 -- 172.21.15.99:0/3451768616 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4084031b80 con 0x7f4098189450 2024-02-21T23:01:08.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.975+0000 7f409ee00640 1 -- 172.21.15.99:0/3451768616 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4098189450 msgr2=0x7f4098074490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:08.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.975+0000 7f409ee00640 1 --2- 172.21.15.99:0/3451768616 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4098189450 0x7f4098074490 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f40980706e0 tx=0x7f408402b860 comp rx=0 tx=0).stop 2024-02-21T23:01:08.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.975+0000 7f409ee00640 1 -- 172.21.15.99:0/3451768616 shutdown_connections 2024-02-21T23:01:08.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.975+0000 7f409ee00640 1 --2- 172.21.15.99:0/3451768616 >> v2:172.21.15.181:3300/0 conn(0x7f40980749d0 0x7f40980fa250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:08.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.975+0000 7f409ee00640 1 --2- 172.21.15.99:0/3451768616 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4098189450 0x7f4098074490 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:08.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.975+0000 7f409ee00640 1 --2- 172.21.15.99:0/3451768616 >> v2:172.21.15.99:3300/0 conn(0x7f40980740b0 0x7f4098188f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:08.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.975+0000 7f409ee00640 1 -- 172.21.15.99:0/3451768616 >> 172.21.15.99:0/3451768616 conn(0x7f409808cfd0 msgr2=0x7f409808d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:08.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.975+0000 7f409ee00640 1 -- 172.21.15.99:0/3451768616 shutdown_connections 2024-02-21T23:01:08.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.975+0000 7f409ee00640 1 -- 172.21.15.99:0/3451768616 wait complete. 2024-02-21T23:01:08.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.977+0000 7f409ee00640 1 Processor -- start 2024-02-21T23:01:08.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.977+0000 7f409ee00640 1 -- start start 2024-02-21T23:01:08.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.978+0000 7f409ee00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40980740b0 0x7f4098171400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:08.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.979+0000 7f409ee00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f40980749d0 0x7f4098222a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:08.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.979+0000 7f409ee00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4098189450 0x7f4098187900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:08.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.979+0000 7f409ee00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4098186670 con 0x7f40980740b0 2024-02-21T23:01:08.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.979+0000 7f409ee00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40980f9d30 con 0x7f4098189450 2024-02-21T23:01:08.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.979+0000 7f409ee00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40981898b0 con 0x7f40980749d0 2024-02-21T23:01:08.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.979+0000 7f409da00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40980740b0 0x7f4098171400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:08.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.979+0000 7f409da00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40980740b0 0x7f4098171400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:57640/0 (socket says 172.21.15.99:57640) 2024-02-21T23:01:08.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.979+0000 7f409da00640 1 -- 172.21.15.99:0/3606335237 learned_addr learned my addr 172.21.15.99:0/3606335237 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:08.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.979+0000 7f409d000640 1 --2- 172.21.15.99:0/3606335237 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f40980749d0 0x7f4098222a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:08.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.979+0000 7f409e400640 1 --2- 172.21.15.99:0/3606335237 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4098189450 0x7f4098187900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:08.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.979+0000 7f409da00640 1 -- 172.21.15.99:0/3606335237 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f40980749d0 msgr2=0x7f4098222a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:08.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.979+0000 7f409da00640 1 --2- 172.21.15.99:0/3606335237 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f40980749d0 0x7f4098222a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:08.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.979+0000 7f409da00640 1 -- 172.21.15.99:0/3606335237 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4098189450 msgr2=0x7f4098187900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:08.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.979+0000 7f409da00640 1 --2- 172.21.15.99:0/3606335237 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4098189450 0x7f4098187900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:08.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.979+0000 7f409da00640 1 -- 172.21.15.99:0/3606335237 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f409817f2a0 con 0x7f40980740b0 2024-02-21T23:01:08.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.980+0000 7f409da00640 1 --2- 172.21.15.99:0/3606335237 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40980740b0 0x7f4098171400 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f408c006ca0 tx=0x7f408c00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:08.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.980+0000 7f4095600640 1 -- 172.21.15.99:0/3606335237 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408c004030 con 0x7f40980740b0 2024-02-21T23:01:08.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.980+0000 7f4095600640 1 -- 172.21.15.99:0/3606335237 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f408c0041d0 con 0x7f40980740b0 2024-02-21T23:01:08.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.980+0000 7f409ee00640 1 -- 172.21.15.99:0/3606335237 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f409817f580 con 0x7f40980740b0 2024-02-21T23:01:08.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.980+0000 7f4095600640 1 -- 172.21.15.99:0/3606335237 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408c00c8e0 con 0x7f40980740b0 2024-02-21T23:01:08.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.980+0000 7f409ee00640 1 -- 172.21.15.99:0/3606335237 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f409817fb40 con 0x7f40980740b0 2024-02-21T23:01:08.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.981+0000 7f409ee00640 1 -- 172.21.15.99:0/3606335237 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4098068320 con 0x7f40980740b0 2024-02-21T23:01:08.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.983+0000 7f4095600640 1 -- 172.21.15.99:0/3606335237 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 134356+0+0 (secure 0 0 0) 0x7f408c00ca80 con 0x7f40980740b0 2024-02-21T23:01:08.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.985+0000 7f4095600640 1 --2- 172.21.15.99:0/3606335237 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f407809ed90 0x7f40780a1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:08.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.985+0000 7f4095600640 1 -- 172.21.15.99:0/3606335237 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f408c0c9cc0 con 0x7f40980740b0 2024-02-21T23:01:08.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.985+0000 7f409d000640 1 --2- 172.21.15.99:0/3606335237 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f407809ed90 0x7f40780a1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:08.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.986+0000 7f409d000640 1 --2- 172.21.15.99:0/3606335237 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f407809ed90 0x7f40780a1250 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4084036000 tx=0x7f408403d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:08.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:08.990+0000 7f4095600640 1 -- 172.21.15.99:0/3606335237 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f408c0d0080 con 0x7f40980740b0 2024-02-21T23:01:09.066 INFO:tasks.ceph.mds.j.smithi099.stderr:2024-02-21T23:01:09.076+0000 7f1e1aa00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-02-21T23:01:09.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:09.190+0000 7f409ee00640 1 -- 172.21.15.99:0/3606335237 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f40980ee8c0 con 0x7f40980740b0 2024-02-21T23:01:09.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:09.194+0000 7f4095600640 1 -- 172.21.15.99:0/3606335237 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+23570 (secure 0 0 0) 0x7f408c017020 con 0x7f40980740b0 2024-02-21T23:01:09.185 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T23:01:09.185 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":29,"fsid":"e8af98cd-45a1-425f-96a7-f24da8ee4efb","created":"2024-02-21T23:00:44.699708+0000","modified":"2024-02-21T23:01:07.722511+0000","last_up_change":"2024-02-21T23:00:55.749829+0000","last_in_change":"2024-02-21T23:00:48.332297+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T23:00:57.020557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":11.760000228881836,"score_stable":11.760000228881836,"optimal_score":0.17000000178813934,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-21T23:01:01.124398+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-21T23:01:01.684258+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-21T23:01:05.290089+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c49de9b2-dc53-4882-b14c-7059ed40bf59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6809","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6811","nonce":1026112937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6813","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6815","nonce":1026112937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6823","nonce":1026112937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6819","nonce":1026112937}]},"public_addr":"172.21.15.99:6811/1026112937","cluster_addr":"172.21.15.99:6815/1026112937","heartbeat_back_addr":"172.21.15.99:6823/1026112937","heartbeat_front_addr":"172.21.15.99:6819/1026112937","state":["exists","up"]},{"osd":1,"uuid":"58398292-2fe5-4291-94fd-03a0ca29d49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6827","nonce":3030871566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6829","nonce":3030871566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6833","nonce":3030871566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6831","nonce":3030871566}]},"public_addr":"172.21.15.162:6827/3030871566","cluster_addr":"172.21.15.162:6829/3030871566","heartbeat_back_addr":"172.21.15.162:6833/3030871566","heartbeat_front_addr":"172.21.15.162:6831/3030871566","state":["exists","up"]},{"osd":2,"uuid":"94cddec1-e08f-438d-a7c8-48a0e47d71a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6818","nonce":2782386148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6821","nonce":2782386148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6827","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6829","nonce":2782386148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6823","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6825","nonce":2782386148}]},"public_addr":"172.21.15.181:6818/2782386148","cluster_addr":"172.21.15.181:6821/2782386148","heartbeat_back_addr":"172.21.15.181:6829/2782386148","heartbeat_front_addr":"172.21.15.181:6825/2782386148","state":["exists","up"]},{"osd":3,"uuid":"d29abb74-9b89-4fd7-88b1-7c2eb8231189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6801","nonce":2316185310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6803","nonce":2316185310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6807","nonce":2316185310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6805","nonce":2316185310}]},"public_addr":"172.21.15.99:6801/2316185310","cluster_addr":"172.21.15.99:6803/2316185310","heartbeat_back_addr":"172.21.15.99:6807/2316185310","heartbeat_front_addr":"172.21.15.99:6805/2316185310","state":["exists","up"]},{"osd":4,"uuid":"0d8c9ea3-880a-4d69-9dcb-cf7d35abd449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6811","nonce":3137681258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6813","nonce":3137681258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6817","nonce":3137681258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6815","nonce":3137681258}]},"public_addr":"172.21.15.162:6811/3137681258","cluster_addr":"172.21.15.162:6813/3137681258","heartbeat_back_addr":"172.21.15.162:6817/3137681258","heartbeat_front_addr":"172.21.15.162:6815/3137681258","state":["exists","up"]},{"osd":5,"uuid":"2e3a9340-6fd0-4d7a-8e00-fe305649296e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6801","nonce":2011264527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6803","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6805","nonce":2011264527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6811","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6813","nonce":2011264527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6807","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6809","nonce":2011264527}]},"public_addr":"172.21.15.181:6801/2011264527","cluster_addr":"172.21.15.181:6805/2011264527","heartbeat_back_addr":"172.21.15.181:6813/2011264527","heartbeat_front_addr":"172.21.15.181:6809/2011264527","state":["exists","up"]},{"osd":6,"uuid":"d9e37ce7-1b0e-4019-8f2e-b670403abf7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6810","nonce":753870050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6814","nonce":753870050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6822","nonce":753870050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6818","nonce":753870050}]},"public_addr":"172.21.15.99:6810/753870050","cluster_addr":"172.21.15.99:6814/753870050","heartbeat_back_addr":"172.21.15.99:6822/753870050","heartbeat_front_addr":"172.21.15.99:6818/753870050","state":["exists","up"]},{"osd":7,"uuid":"49988754-232e-4b8c-bd72-bfa25b418e5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6803","nonce":1659412949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6805","nonce":1659412949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6809","nonce":1659412949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6807","nonce":1659412949}]},"public_addr":"172.21.15.162:6803/1659412949","cluster_addr":"172.21.15.162:6805/1659412949","heartbeat_back_addr":"172.21.15.162:6809/1659412949","heartbeat_front_addr":"172.21.15.162:6807/1659412949","state":["exists","up"]},{"osd":8,"uuid":"ebc6e462-8368-4d64-b242-9c8735ac672c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6804","nonce":3389807042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6808","nonce":3389807042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6815","nonce":3389807042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6812","nonce":3389807042}]},"public_addr":"172.21.15.181:6804/3389807042","cluster_addr":"172.21.15.181:6808/3389807042","heartbeat_back_addr":"172.21.15.181:6815/3389807042","heartbeat_front_addr":"172.21.15.181:6812/3389807042","state":["exists","up"]},{"osd":9,"uuid":"72af1b02-b965-4d6a-8964-527ec24c4daa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6825","nonce":4055669590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6827","nonce":4055669590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6831","nonce":4055669590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6829","nonce":4055669590}]},"public_addr":"172.21.15.99:6825/4055669590","cluster_addr":"172.21.15.99:6827/4055669590","heartbeat_back_addr":"172.21.15.99:6831/4055669590","heartbeat_front_addr":"172.21.15.99:6829/4055669590","state":["exists","up"]},{"osd":10,"uuid":"adb5cb06-6453-41e4-b847-d7c78bbb7d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6819","nonce":1421879617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6821","nonce":1421879617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6825","nonce":1421879617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6823","nonce":1421879617}]},"public_addr":"172.21.15.162:6819/1421879617","cluster_addr":"172.21.15.162:6821/1421879617","heartbeat_back_addr":"172.21.15.162:6825/1421879617","heartbeat_front_addr":"172.21.15.162:6823/1421879617","state":["exists","up"]},{"osd":11,"uuid":"118563d9-1e8f-4dc7-a92c-2f4c4dc3e20f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6817","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6819","nonce":3219928272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6824","nonce":3219928272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6831","nonce":3219928272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6828","nonce":3219928272}]},"public_addr":"172.21.15.181:6819/3219928272","cluster_addr":"172.21.15.181:6824/3219928272","heartbeat_back_addr":"172.21.15.181:6831/3219928272","heartbeat_front_addr":"172.21.15.181:6828/3219928272","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.651219+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.549859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.529659+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.591004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.440836+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.414250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.630130+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.411954+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.439371+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.428173+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.511203+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.482806+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T23:01:09.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:09.198+0000 7f409ee00640 1 -- 172.21.15.99:0/3606335237 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f407809ed90 msgr2=0x7f40780a1250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:09.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:09.198+0000 7f409ee00640 1 --2- 172.21.15.99:0/3606335237 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f407809ed90 0x7f40780a1250 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4084036000 tx=0x7f408403d040 comp rx=0 tx=0).stop 2024-02-21T23:01:09.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:09.198+0000 7f409ee00640 1 -- 172.21.15.99:0/3606335237 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40980740b0 msgr2=0x7f4098171400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:09.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:09.198+0000 7f409ee00640 1 --2- 172.21.15.99:0/3606335237 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40980740b0 0x7f4098171400 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f408c006ca0 tx=0x7f408c00ed60 comp rx=0 tx=0).stop 2024-02-21T23:01:09.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:09.198+0000 7f409ee00640 1 -- 172.21.15.99:0/3606335237 shutdown_connections 2024-02-21T23:01:09.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:09.198+0000 7f409ee00640 1 --2- 172.21.15.99:0/3606335237 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f407809ed90 0x7f40780a1250 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:09.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:09.198+0000 7f409ee00640 1 --2- 172.21.15.99:0/3606335237 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4098189450 0x7f4098187900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:09.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:09.198+0000 7f409ee00640 1 --2- 172.21.15.99:0/3606335237 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f40980749d0 0x7f4098222a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:09.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:09.198+0000 7f409ee00640 1 --2- 172.21.15.99:0/3606335237 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40980740b0 0x7f4098171400 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:09.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:09.198+0000 7f409ee00640 1 -- 172.21.15.99:0/3606335237 >> 172.21.15.99:0/3606335237 conn(0x7f409808cfd0 msgr2=0x7f4098188050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:09.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:09.198+0000 7f409ee00640 1 -- 172.21.15.99:0/3606335237 shutdown_connections 2024-02-21T23:01:09.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:09.198+0000 7f409ee00640 1 -- 172.21.15.99:0/3606335237 wait complete. 2024-02-21T23:01:09.214 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T23:01:09.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:09.429+0000 7f6cb7e00640 1 Processor -- start 2024-02-21T23:01:09.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:09.430+0000 7f6cb7e00640 1 -- start start 2024-02-21T23:01:09.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:09.432+0000 7f6cb7e00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f6cb80fde40 0x7f6cb818b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:09.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:09.432+0000 7f6cb7e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cb818a600 con 0x7f6cb818a010 2024-02-21T23:01:09.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:09.432+0000 7f6cb7e00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cb818a8e0 con 0x7f6cb8182a80 2024-02-21T23:01:09.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:09.432+0000 7f6cb7e00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cb818bec0 con 0x7f6cb80fde40 2024-02-21T23:01:09.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:09.432+0000 7f6cb6a00640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f6cb8182a80 0x7f6cb8186a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:37268/0 (socket says 172.21.15.99:37268) 2024-02-21T23:01:09.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:09.432+0000 7f6cb6a00640 1 -- 172.21.15.99:0/1658510486 learned_addr learned my addr 172.21.15.99:0/1658510486 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:01:09.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:09.432+0000 7f6cb7400640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f6cb80fde40 0x7f6cb818b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:09.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:09.433+0000 7f6cb7400640 1 -- 172.21.15.99:0/1658510486 >> v1:172.21.15.181:6789/0 conn(0x7f6cb8182a80 legacy=0x7f6cb8186a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:09.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:09.433+0000 7f6cb7400640 1 -- 172.21.15.99:0/1658510486 >> v1:172.21.15.162:6789/0 conn(0x7f6cb818a010 legacy=0x7f6cb80719b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:09.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:09.433+0000 7f6cb7400640 1 -- 172.21.15.99:0/1658510486 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cb818abc0 con 0x7f6cb80fde40 2024-02-21T23:01:09.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:09.433+0000 7f6cb6000640 1 -- 172.21.15.99:0/1658510486 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4043788019 0 0) 0x7f6cb818a8e0 con 0x7f6cb8182a80 2024-02-21T23:01:09.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:09.434+0000 7f6cb7400640 1 --2- 172.21.15.99:0/1658510486 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6cb80fde40 0x7f6cb818b980 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6cb0009d90 tx=0x7f6cb002bc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=699684b60b6d3329 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:09.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:09.434+0000 7f6cb6000640 1 -- 172.21.15.99:0/1658510486 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb0039070 con 0x7f6cb80fde40 2024-02-21T23:01:09.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:09.434+0000 7f6cb6000640 1 -- 172.21.15.99:0/1658510486 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cb002c990 con 0x7f6cb80fde40 2024-02-21T23:01:09.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:09.434+0000 7f6cb6000640 1 -- 172.21.15.99:0/1658510486 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb002cd60 con 0x7f6cb80fde40 2024-02-21T23:01:09.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:09.435+0000 7f6cb7e00640 1 -- 172.21.15.99:0/1658510486 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6cb80fde40 msgr2=0x7f6cb818b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:09.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:09.435+0000 7f6cb7e00640 1 --2- 172.21.15.99:0/1658510486 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6cb80fde40 0x7f6cb818b980 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6cb0009d90 tx=0x7f6cb002bc60 comp rx=0 tx=0).stop 2024-02-21T23:01:09.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:09.435+0000 7f6cb7e00640 1 -- 172.21.15.99:0/1658510486 shutdown_connections 2024-02-21T23:01:09.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:09.435+0000 7f6cb7e00640 1 --2- 172.21.15.99:0/1658510486 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6cb80fde40 0x7f6cb818b980 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:09.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:09.435+0000 7f6cb7e00640 1 -- 172.21.15.99:0/1658510486 >> 172.21.15.99:0/1658510486 conn(0x7f6cb80d29f0 msgr2=0x7f6cb80d2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:09.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:09.435+0000 7f6cb7e00640 1 -- 172.21.15.99:0/1658510486 shutdown_connections 2024-02-21T23:01:09.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:09.435+0000 7f6cb7e00640 1 -- 172.21.15.99:0/1658510486 wait complete. 2024-02-21T23:01:09.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:09.437+0000 7f6cb7e00640 1 Processor -- start 2024-02-21T23:01:09.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:09.437+0000 7f6cb7e00640 1 -- start start 2024-02-21T23:01:09.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:09.438+0000 7f6cb7e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6cb80fde40 0x7f6cb821f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:09.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:09.438+0000 7f6cb7e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6cb8182a80 0x7f6cb81753b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:09.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:09.438+0000 7f6cb7e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6cb818a010 0x7f6cb81758f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:09.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:09.438+0000 7f6cb7e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb818b460 con 0x7f6cb80fde40 2024-02-21T23:01:09.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:09.438+0000 7f6cb7e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb818b180 con 0x7f6cb818a010 2024-02-21T23:01:09.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:09.438+0000 7f6cb7e00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb8182e60 con 0x7f6cb8182a80 2024-02-21T23:01:09.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:09.438+0000 7f6cb6a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6cb80fde40 0x7f6cb821f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:09.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:09.438+0000 7f6cb6a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6cb80fde40 0x7f6cb821f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:57648/0 (socket says 172.21.15.99:57648) 2024-02-21T23:01:09.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:09.438+0000 7f6cb6a00640 1 -- 172.21.15.99:0/1726128699 learned_addr learned my addr 172.21.15.99:0/1726128699 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:09.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:09.438+0000 7f6cb7400640 1 --2- 172.21.15.99:0/1726128699 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6cb818a010 0x7f6cb81758f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:09.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:09.439+0000 7f6cb6a00640 1 -- 172.21.15.99:0/1726128699 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6cb8182a80 msgr2=0x7f6cb81753b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-21T23:01:09.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:09.439+0000 7f6cb6a00640 1 --2- 172.21.15.99:0/1726128699 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6cb8182a80 0x7f6cb81753b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:09.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:09.439+0000 7f6cb6a00640 1 -- 172.21.15.99:0/1726128699 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6cb818a010 msgr2=0x7f6cb81758f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:09.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:09.439+0000 7f6cb6a00640 1 --2- 172.21.15.99:0/1726128699 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6cb818a010 0x7f6cb81758f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:09.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:09.439+0000 7f6cb6a00640 1 -- 172.21.15.99:0/1726128699 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cb8221270 con 0x7f6cb80fde40 2024-02-21T23:01:09.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:09.439+0000 7f6cb6a00640 1 --2- 172.21.15.99:0/1726128699 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6cb80fde40 0x7f6cb821f650 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6ca800c4a0 tx=0x7f6ca800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:09.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:09.439+0000 7f6caea00640 1 -- 172.21.15.99:0/1726128699 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca8018070 con 0x7f6cb80fde40 2024-02-21T23:01:09.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:09.439+0000 7f6caea00640 1 -- 172.21.15.99:0/1726128699 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ca80074e0 con 0x7f6cb80fde40 2024-02-21T23:01:09.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:09.439+0000 7f6caea00640 1 -- 172.21.15.99:0/1726128699 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca8004a20 con 0x7f6cb80fde40 2024-02-21T23:01:09.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:09.439+0000 7f6cb7e00640 1 -- 172.21.15.99:0/1726128699 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cb8221550 con 0x7f6cb80fde40 2024-02-21T23:01:09.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:09.439+0000 7f6cb7e00640 1 -- 172.21.15.99:0/1726128699 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cb8221b10 con 0x7f6cb80fde40 2024-02-21T23:01:09.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:09.441+0000 7f6cb7e00640 1 -- 172.21.15.99:0/1726128699 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cb8068320 con 0x7f6cb80fde40 2024-02-21T23:01:09.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:09.442+0000 7f6caea00640 1 -- 172.21.15.99:0/1726128699 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 134356+0+0 (secure 0 0 0) 0x7f6ca8004bc0 con 0x7f6cb80fde40 2024-02-21T23:01:09.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:09.444+0000 7f6caea00640 1 --2- 172.21.15.99:0/1726128699 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f6c9409ed90 0x7f6c940a1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:09.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:09.444+0000 7f6caea00640 1 -- 172.21.15.99:0/1726128699 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f6ca80c8e40 con 0x7f6cb80fde40 2024-02-21T23:01:09.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:09.444+0000 7f6cafe00640 1 --2- 172.21.15.99:0/1726128699 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f6c9409ed90 0x7f6c940a1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:09.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:09.446+0000 7f6cafe00640 1 --2- 172.21.15.99:0/1726128699 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f6c9409ed90 0x7f6c940a1250 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6cb8216080 tx=0x7f6ca00079e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:09.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:09.448+0000 7f6caea00640 1 -- 172.21.15.99:0/1726128699 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f6ca8097090 con 0x7f6cb80fde40 2024-02-21T23:01:09.599 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:01:09.606 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:01:09.609 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:01:09.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:09.720+0000 7f6cb7e00640 1 -- 172.21.15.99:0/1726128699 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6cb80fcc10 con 0x7f6cb80fde40 2024-02-21T23:01:09.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:09.723+0000 7f6caea00640 1 -- 172.21.15.99:0/1726128699 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+23570 (secure 0 0 0) 0x7f6ca8096990 con 0x7f6cb80fde40 2024-02-21T23:01:09.714 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T23:01:09.714 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":29,"fsid":"e8af98cd-45a1-425f-96a7-f24da8ee4efb","created":"2024-02-21T23:00:44.699708+0000","modified":"2024-02-21T23:01:07.722511+0000","last_up_change":"2024-02-21T23:00:55.749829+0000","last_in_change":"2024-02-21T23:00:48.332297+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T23:00:57.020557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":11.760000228881836,"score_stable":11.760000228881836,"optimal_score":0.17000000178813934,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-21T23:01:01.124398+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-21T23:01:01.684258+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-21T23:01:05.290089+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c49de9b2-dc53-4882-b14c-7059ed40bf59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6809","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6811","nonce":1026112937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6813","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6815","nonce":1026112937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6823","nonce":1026112937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6819","nonce":1026112937}]},"public_addr":"172.21.15.99:6811/1026112937","cluster_addr":"172.21.15.99:6815/1026112937","heartbeat_back_addr":"172.21.15.99:6823/1026112937","heartbeat_front_addr":"172.21.15.99:6819/1026112937","state":["exists","up"]},{"osd":1,"uuid":"58398292-2fe5-4291-94fd-03a0ca29d49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6827","nonce":3030871566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6829","nonce":3030871566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6833","nonce":3030871566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6831","nonce":3030871566}]},"public_addr":"172.21.15.162:6827/3030871566","cluster_addr":"172.21.15.162:6829/3030871566","heartbeat_back_addr":"172.21.15.162:6833/3030871566","heartbeat_front_addr":"172.21.15.162:6831/3030871566","state":["exists","up"]},{"osd":2,"uuid":"94cddec1-e08f-438d-a7c8-48a0e47d71a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6818","nonce":2782386148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6821","nonce":2782386148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6827","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6829","nonce":2782386148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6823","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6825","nonce":2782386148}]},"public_addr":"172.21.15.181:6818/2782386148","cluster_addr":"172.21.15.181:6821/2782386148","heartbeat_back_addr":"172.21.15.181:6829/2782386148","heartbeat_front_addr":"172.21.15.181:6825/2782386148","state":["exists","up"]},{"osd":3,"uuid":"d29abb74-9b89-4fd7-88b1-7c2eb8231189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6801","nonce":2316185310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6803","nonce":2316185310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6807","nonce":2316185310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6805","nonce":2316185310}]},"public_addr":"172.21.15.99:6801/2316185310","cluster_addr":"172.21.15.99:6803/2316185310","heartbeat_back_addr":"172.21.15.99:6807/2316185310","heartbeat_front_addr":"172.21.15.99:6805/2316185310","state":["exists","up"]},{"osd":4,"uuid":"0d8c9ea3-880a-4d69-9dcb-cf7d35abd449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6811","nonce":3137681258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6813","nonce":3137681258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6817","nonce":3137681258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6815","nonce":3137681258}]},"public_addr":"172.21.15.162:6811/3137681258","cluster_addr":"172.21.15.162:6813/3137681258","heartbeat_back_addr":"172.21.15.162:6817/3137681258","heartbeat_front_addr":"172.21.15.162:6815/3137681258","state":["exists","up"]},{"osd":5,"uuid":"2e3a9340-6fd0-4d7a-8e00-fe305649296e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6801","nonce":2011264527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6803","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6805","nonce":2011264527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6811","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6813","nonce":2011264527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6807","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6809","nonce":2011264527}]},"public_addr":"172.21.15.181:6801/2011264527","cluster_addr":"172.21.15.181:6805/2011264527","heartbeat_back_addr":"172.21.15.181:6813/2011264527","heartbeat_front_addr":"172.21.15.181:6809/2011264527","state":["exists","up"]},{"osd":6,"uuid":"d9e37ce7-1b0e-4019-8f2e-b670403abf7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6810","nonce":753870050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6814","nonce":753870050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6822","nonce":753870050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6818","nonce":753870050}]},"public_addr":"172.21.15.99:6810/753870050","cluster_addr":"172.21.15.99:6814/753870050","heartbeat_back_addr":"172.21.15.99:6822/753870050","heartbeat_front_addr":"172.21.15.99:6818/753870050","state":["exists","up"]},{"osd":7,"uuid":"49988754-232e-4b8c-bd72-bfa25b418e5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6803","nonce":1659412949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6805","nonce":1659412949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6809","nonce":1659412949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6807","nonce":1659412949}]},"public_addr":"172.21.15.162:6803/1659412949","cluster_addr":"172.21.15.162:6805/1659412949","heartbeat_back_addr":"172.21.15.162:6809/1659412949","heartbeat_front_addr":"172.21.15.162:6807/1659412949","state":["exists","up"]},{"osd":8,"uuid":"ebc6e462-8368-4d64-b242-9c8735ac672c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6804","nonce":3389807042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6808","nonce":3389807042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6815","nonce":3389807042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6812","nonce":3389807042}]},"public_addr":"172.21.15.181:6804/3389807042","cluster_addr":"172.21.15.181:6808/3389807042","heartbeat_back_addr":"172.21.15.181:6815/3389807042","heartbeat_front_addr":"172.21.15.181:6812/3389807042","state":["exists","up"]},{"osd":9,"uuid":"72af1b02-b965-4d6a-8964-527ec24c4daa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6825","nonce":4055669590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6827","nonce":4055669590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6831","nonce":4055669590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6829","nonce":4055669590}]},"public_addr":"172.21.15.99:6825/4055669590","cluster_addr":"172.21.15.99:6827/4055669590","heartbeat_back_addr":"172.21.15.99:6831/4055669590","heartbeat_front_addr":"172.21.15.99:6829/4055669590","state":["exists","up"]},{"osd":10,"uuid":"adb5cb06-6453-41e4-b847-d7c78bbb7d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6819","nonce":1421879617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6821","nonce":1421879617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6825","nonce":1421879617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6823","nonce":1421879617}]},"public_addr":"172.21.15.162:6819/1421879617","cluster_addr":"172.21.15.162:6821/1421879617","heartbeat_back_addr":"172.21.15.162:6825/1421879617","heartbeat_front_addr":"172.21.15.162:6823/1421879617","state":["exists","up"]},{"osd":11,"uuid":"118563d9-1e8f-4dc7-a92c-2f4c4dc3e20f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6817","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6819","nonce":3219928272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6824","nonce":3219928272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6831","nonce":3219928272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6828","nonce":3219928272}]},"public_addr":"172.21.15.181:6819/3219928272","cluster_addr":"172.21.15.181:6824/3219928272","heartbeat_back_addr":"172.21.15.181:6831/3219928272","heartbeat_front_addr":"172.21.15.181:6828/3219928272","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.651219+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.549859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.529659+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.591004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.440836+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.414250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.630130+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.411954+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.439371+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.428173+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.511203+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.482806+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T23:01:09.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:09.726+0000 7f6cb7e00640 1 -- 172.21.15.99:0/1726128699 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f6c9409ed90 msgr2=0x7f6c940a1250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:09.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:09.726+0000 7f6cb7e00640 1 --2- 172.21.15.99:0/1726128699 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f6c9409ed90 0x7f6c940a1250 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6cb8216080 tx=0x7f6ca00079e0 comp rx=0 tx=0).stop 2024-02-21T23:01:09.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:09.726+0000 7f6cb7e00640 1 -- 172.21.15.99:0/1726128699 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6cb80fde40 msgr2=0x7f6cb821f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:09.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:09.726+0000 7f6cb7e00640 1 --2- 172.21.15.99:0/1726128699 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6cb80fde40 0x7f6cb821f650 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6ca800c4a0 tx=0x7f6ca800c960 comp rx=0 tx=0).stop 2024-02-21T23:01:09.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:09.726+0000 7f6cb7e00640 1 -- 172.21.15.99:0/1726128699 shutdown_connections 2024-02-21T23:01:09.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:09.726+0000 7f6cb7e00640 1 --2- 172.21.15.99:0/1726128699 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f6c9409ed90 0x7f6c940a1250 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:09.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:09.726+0000 7f6cb7e00640 1 --2- 172.21.15.99:0/1726128699 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6cb818a010 0x7f6cb81758f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:09.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:09.726+0000 7f6cb7e00640 1 --2- 172.21.15.99:0/1726128699 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6cb8182a80 0x7f6cb81753b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:09.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:09.726+0000 7f6cb7e00640 1 --2- 172.21.15.99:0/1726128699 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6cb80fde40 0x7f6cb821f650 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:09.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:09.726+0000 7f6cb7e00640 1 -- 172.21.15.99:0/1726128699 >> 172.21.15.99:0/1726128699 conn(0x7f6cb80d29f0 msgr2=0x7f6cb817ffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:09.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:09.726+0000 7f6cb7e00640 1 -- 172.21.15.99:0/1726128699 shutdown_connections 2024-02-21T23:01:09.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:09.726+0000 7f6cb7e00640 1 -- 172.21.15.99:0/1726128699 wait complete. 2024-02-21T23:01:09.748 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T23:01:10.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.023+0000 7f659a800640 1 Processor -- start 2024-02-21T23:01:10.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.023+0000 7f659a800640 1 -- start start 2024-02-21T23:01:10.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.025+0000 7f659a800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f65941833f0 0x7f65940f8020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:10.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.025+0000 7f659a800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f65940f8560 0x7f65941845c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:10.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.025+0000 7f659a800640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f6594184b00 0x7f659406e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:10.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.025+0000 7f659a800640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65940f89a0 con 0x7f65941833f0 2024-02-21T23:01:10.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.025+0000 7f659a800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65940f8c40 con 0x7f65940f8560 2024-02-21T23:01:10.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.025+0000 7f659a800640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65940f8f20 con 0x7f6594184b00 2024-02-21T23:01:10.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.025+0000 7f6593400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f65941833f0 0x7f65940f8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:10.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.025+0000 7f658be00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f65940f8560 0x7f65941845c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:10.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.025+0000 7f6593400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f65941833f0 0x7f65940f8020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:57662/0 (socket says 172.21.15.99:57662) 2024-02-21T23:01:10.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.025+0000 7f6593e00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f6594184b00 0x7f659406e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:10.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.025+0000 7f6593400640 1 -- 172.21.15.99:0/1105319078 learned_addr learned my addr 172.21.15.99:0/1105319078 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:10.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.025+0000 7f6593400640 1 -- 172.21.15.99:0/1105319078 >> v2:172.21.15.181:3300/0 conn(0x7f6594184b00 msgr2=0x7f659406e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:10.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.026+0000 7f6593400640 1 --2- 172.21.15.99:0/1105319078 >> v2:172.21.15.181:3300/0 conn(0x7f6594184b00 0x7f659406e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:10.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.026+0000 7f6593400640 1 -- 172.21.15.99:0/1105319078 >> v2:172.21.15.162:3300/0 conn(0x7f65940f8560 msgr2=0x7f65941845c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:10.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.026+0000 7f6593400640 1 --2- 172.21.15.99:0/1105319078 >> v2:172.21.15.162:3300/0 conn(0x7f65940f8560 0x7f65941845c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:10.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.026+0000 7f6593400640 1 -- 172.21.15.99:0/1105319078 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6594183ae0 con 0x7f65941833f0 2024-02-21T23:01:10.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.027+0000 7f6593400640 1 --2- 172.21.15.99:0/1105319078 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f65941833f0 0x7f65940f8020 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f65940f4720 tx=0x7f658402b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1107bac260cdd6d8 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:10.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.027+0000 7f6592a00640 1 -- 172.21.15.99:0/1105319078 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6584034070 con 0x7f65941833f0 2024-02-21T23:01:10.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.027+0000 7f6592a00640 1 -- 172.21.15.99:0/1105319078 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6584030800 con 0x7f65941833f0 2024-02-21T23:01:10.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.027+0000 7f6592a00640 1 -- 172.21.15.99:0/1105319078 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6584030bd0 con 0x7f65941833f0 2024-02-21T23:01:10.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.028+0000 7f659a800640 1 -- 172.21.15.99:0/1105319078 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f65941833f0 msgr2=0x7f65940f8020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:10.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.028+0000 7f659a800640 1 --2- 172.21.15.99:0/1105319078 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f65941833f0 0x7f65940f8020 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f65940f4720 tx=0x7f658402b940 comp rx=0 tx=0).stop 2024-02-21T23:01:10.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.028+0000 7f659a800640 1 -- 172.21.15.99:0/1105319078 shutdown_connections 2024-02-21T23:01:10.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.028+0000 7f659a800640 1 --2- 172.21.15.99:0/1105319078 >> v2:172.21.15.181:3300/0 conn(0x7f6594184b00 0x7f659406e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:10.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.028+0000 7f659a800640 1 --2- 172.21.15.99:0/1105319078 >> v2:172.21.15.162:3300/0 conn(0x7f65940f8560 0x7f65941845c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:10.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.028+0000 7f659a800640 1 --2- 172.21.15.99:0/1105319078 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f65941833f0 0x7f65940f8020 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:10.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.028+0000 7f659a800640 1 -- 172.21.15.99:0/1105319078 >> 172.21.15.99:0/1105319078 conn(0x7f65940ce5f0 msgr2=0x7f65940cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:10.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.028+0000 7f659a800640 1 -- 172.21.15.99:0/1105319078 shutdown_connections 2024-02-21T23:01:10.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.028+0000 7f659a800640 1 -- 172.21.15.99:0/1105319078 wait complete. 2024-02-21T23:01:10.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.031+0000 7f659a800640 1 Processor -- start 2024-02-21T23:01:10.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.031+0000 7f659a800640 1 -- start start 2024-02-21T23:01:10.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.033+0000 7f659a800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f65940f8560 0x7f65941715a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:10.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.033+0000 7f659a800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f65941833f0 0x7f6594171ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:10.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.033+0000 7f659a800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6594184b00 0x7f659421f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:10.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.034+0000 7f659a800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6594184f50 con 0x7f65941833f0 2024-02-21T23:01:10.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.034+0000 7f659a800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65941840a0 con 0x7f6594184b00 2024-02-21T23:01:10.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.034+0000 7f659a800640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65941850d0 con 0x7f65940f8560 2024-02-21T23:01:10.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.034+0000 7f658be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f65941833f0 0x7f6594171ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:10.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.034+0000 7f658be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f65941833f0 0x7f6594171ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:57672/0 (socket says 172.21.15.99:57672) 2024-02-21T23:01:10.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.034+0000 7f658be00640 1 -- 172.21.15.99:0/3832370074 learned_addr learned my addr 172.21.15.99:0/3832370074 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:10.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.034+0000 7f6593400640 1 --2- 172.21.15.99:0/3832370074 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f65940f8560 0x7f65941715a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:10.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.034+0000 7f658be00640 1 -- 172.21.15.99:0/3832370074 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f65940f8560 msgr2=0x7f65941715a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:10.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.034+0000 7f658be00640 1 --2- 172.21.15.99:0/3832370074 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f65940f8560 0x7f65941715a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:10.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.034+0000 7f658be00640 1 -- 172.21.15.99:0/3832370074 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6594184b00 msgr2=0x7f659421f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:10.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.034+0000 7f658be00640 1 --2- 172.21.15.99:0/3832370074 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6594184b00 0x7f659421f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:10.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.034+0000 7f658be00640 1 -- 172.21.15.99:0/3832370074 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6594220240 con 0x7f65941833f0 2024-02-21T23:01:10.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.034+0000 7f658be00640 1 --2- 172.21.15.99:0/3832370074 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f65941833f0 0x7f6594171ae0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f657c00e870 tx=0x7f657c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:10.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.035+0000 7f658b400640 1 -- 172.21.15.99:0/3832370074 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f657c017070 con 0x7f65941833f0 2024-02-21T23:01:10.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.035+0000 7f658b400640 1 -- 172.21.15.99:0/3832370074 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f657c00ee60 con 0x7f65941833f0 2024-02-21T23:01:10.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.035+0000 7f659a800640 1 -- 172.21.15.99:0/3832370074 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f659406d300 con 0x7f65941833f0 2024-02-21T23:01:10.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.035+0000 7f658b400640 1 -- 172.21.15.99:0/3832370074 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f657c00cb00 con 0x7f65941833f0 2024-02-21T23:01:10.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.035+0000 7f659a800640 1 -- 172.21.15.99:0/3832370074 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f659406d8c0 con 0x7f65941833f0 2024-02-21T23:01:10.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.036+0000 7f659a800640 1 -- 172.21.15.99:0/3832370074 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65940d2aa0 con 0x7f65941833f0 2024-02-21T23:01:10.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.038+0000 7f658b400640 1 -- 172.21.15.99:0/3832370074 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 134356+0+0 (secure 0 0 0) 0x7f657c01a070 con 0x7f65941833f0 2024-02-21T23:01:10.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.040+0000 7f658b400640 1 --2- 172.21.15.99:0/3832370074 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f657009ed60 0x7f65700a1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:10.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.040+0000 7f658b400640 1 -- 172.21.15.99:0/3832370074 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f657c0c9cd0 con 0x7f65941833f0 2024-02-21T23:01:10.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.040+0000 7f6593400640 1 --2- 172.21.15.99:0/3832370074 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f657009ed60 0x7f65700a1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:10.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.041+0000 7f6593400640 1 --2- 172.21.15.99:0/3832370074 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f657009ed60 0x7f65700a1220 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6584036000 tx=0x7f658403b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:10.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.045+0000 7f658b400640 1 -- 172.21.15.99:0/3832370074 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f657c097f20 con 0x7f65941833f0 2024-02-21T23:01:10.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.291+0000 7f659a800640 1 -- 172.21.15.99:0/3832370074 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6594189ed0 con 0x7f65941833f0 2024-02-21T23:01:10.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.292+0000 7f658b400640 1 -- 172.21.15.99:0/3832370074 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+11278 (secure 0 0 0) 0x7f657c097820 con 0x7f65941833f0 2024-02-21T23:01:10.282 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T23:01:10.283 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4307,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/3514452812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3514452812},{"type":"v1","addr":"172.21.15.162:6836","nonce":3514452812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4312,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6838/2169982089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":2169982089},{"type":"v1","addr":"172.21.15.162:6838","nonce":2169982089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4315,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6839/3335972724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6837","nonce":3335972724},{"type":"v1","addr":"172.21.15.162:6839","nonce":3335972724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4318,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6841/2135456697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6840","nonce":2135456697},{"type":"v1","addr":"172.21.15.162:6841","nonce":2135456697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4325,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2452242758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2452242758},{"type":"v1","addr":"172.21.15.181:6833","nonce":2452242758}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4328,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6836/2751486400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":2751486400},{"type":"v1","addr":"172.21.15.181:6836","nonce":2751486400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4331,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6838/3728901330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6835","nonce":3728901330},{"type":"v1","addr":"172.21.15.181:6838","nonce":3728901330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4339,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6839/3357929641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6837","nonce":3357929641},{"type":"v1","addr":"172.21.15.181:6839","nonce":3357929641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4343,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6833/2793485078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":2793485078},{"type":"v1","addr":"172.21.15.99:6833","nonce":2793485078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4348,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6835/2243461688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2243461688},{"type":"v1","addr":"172.21.15.99:6835","nonce":2243461688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4352,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.99:6837/1676159950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":1676159950},{"type":"v1","addr":"172.21.15.99:6837","nonce":1676159950}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-02-21T23:01:02.656130+0000","modified":"2024-02-21T23:01:07.722827+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4355},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4355":{"gid":4355,"name":"j","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6839/4239008786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":4239008786},{"type":"v1","addr":"172.21.15.99:6839","nonce":4239008786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-21T23:01:10.283 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 7 2024-02-21T23:01:10.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.296+0000 7f659a800640 1 -- 172.21.15.99:0/3832370074 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f657009ed60 msgr2=0x7f65700a1220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:10.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.296+0000 7f659a800640 1 --2- 172.21.15.99:0/3832370074 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f657009ed60 0x7f65700a1220 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6584036000 tx=0x7f658403b040 comp rx=0 tx=0).stop 2024-02-21T23:01:10.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.296+0000 7f659a800640 1 -- 172.21.15.99:0/3832370074 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f65941833f0 msgr2=0x7f6594171ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:10.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.296+0000 7f659a800640 1 --2- 172.21.15.99:0/3832370074 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f65941833f0 0x7f6594171ae0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f657c00e870 tx=0x7f657c00ed30 comp rx=0 tx=0).stop 2024-02-21T23:01:10.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.296+0000 7f659a800640 1 -- 172.21.15.99:0/3832370074 shutdown_connections 2024-02-21T23:01:10.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.296+0000 7f659a800640 1 --2- 172.21.15.99:0/3832370074 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f657009ed60 0x7f65700a1220 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:10.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.296+0000 7f659a800640 1 --2- 172.21.15.99:0/3832370074 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6594184b00 0x7f659421f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:10.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.296+0000 7f659a800640 1 --2- 172.21.15.99:0/3832370074 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f65941833f0 0x7f6594171ae0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:10.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.296+0000 7f659a800640 1 --2- 172.21.15.99:0/3832370074 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f65940f8560 0x7f65941715a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:10.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.296+0000 7f659a800640 1 -- 172.21.15.99:0/3832370074 >> 172.21.15.99:0/3832370074 conn(0x7f65940ce5f0 msgr2=0x7f6594179430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:10.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.296+0000 7f659a800640 1 -- 172.21.15.99:0/3832370074 shutdown_connections 2024-02-21T23:01:10.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.296+0000 7f659a800640 1 -- 172.21.15.99:0/3832370074 wait complete. 2024-02-21T23:01:10.305 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T23:01:10.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.514+0000 7f305ba00640 1 Processor -- start 2024-02-21T23:01:10.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.514+0000 7f305ba00640 1 -- start start 2024-02-21T23:01:10.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.516+0000 7f305ba00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3054187680 0x7f305418a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:10.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.516+0000 7f305ba00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f305417d980 con 0x7f3054186b90 2024-02-21T23:01:10.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.516+0000 7f305ba00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3054185950 con 0x7f305418a930 2024-02-21T23:01:10.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.516+0000 7f305ba00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3054185c30 con 0x7f3054187680 2024-02-21T23:01:10.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.517+0000 7f3059000640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f3054186b90 0x7f3054186f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:36090/0 (socket says 172.21.15.99:36090) 2024-02-21T23:01:10.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.517+0000 7f3059000640 1 -- 172.21.15.99:0/4138202777 learned_addr learned my addr 172.21.15.99:0/4138202777 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:01:10.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.517+0000 7f3053e00640 1 --2- 172.21.15.99:0/4138202777 >> v2:172.21.15.162:3300/0 conn(0x7f3054187680 0x7f305418a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:10.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.517+0000 7f3053400640 1 -- 172.21.15.99:0/4138202777 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2484350731 0 0) 0x7f305417d980 con 0x7f3054186b90 2024-02-21T23:01:10.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.517+0000 7f3053400640 1 -- 172.21.15.99:0/4138202777 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f303c003520 con 0x7f3054186b90 2024-02-21T23:01:10.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.517+0000 7f3053e00640 1 -- 172.21.15.99:0/4138202777 >> v1:172.21.15.181:6789/0 conn(0x7f305418a930 legacy=0x7f3054184a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:10.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.517+0000 7f3053e00640 1 -- 172.21.15.99:0/4138202777 >> v1:172.21.15.99:6789/0 conn(0x7f3054186b90 legacy=0x7f3054186f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:10.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.517+0000 7f3053e00640 1 -- 172.21.15.99:0/4138202777 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3054185f10 con 0x7f3054187680 2024-02-21T23:01:10.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.518+0000 7f3053e00640 1 --2- 172.21.15.99:0/4138202777 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3054187680 0x7f305418a3f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f30400097a0 tx=0x7f304002b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86b315cb13ed8364 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:10.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.519+0000 7f3053400640 1 -- 172.21.15.99:0/4138202777 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3040034070 con 0x7f3054187680 2024-02-21T23:01:10.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.519+0000 7f3053400640 1 -- 172.21.15.99:0/4138202777 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3040030610 con 0x7f3054187680 2024-02-21T23:01:10.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.519+0000 7f3053400640 1 -- 172.21.15.99:0/4138202777 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30400309e0 con 0x7f3054187680 2024-02-21T23:01:10.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.519+0000 7f305ba00640 1 -- 172.21.15.99:0/4138202777 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3054187680 msgr2=0x7f305418a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:10.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.519+0000 7f305ba00640 1 --2- 172.21.15.99:0/4138202777 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3054187680 0x7f305418a3f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f30400097a0 tx=0x7f304002b960 comp rx=0 tx=0).stop 2024-02-21T23:01:10.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.520+0000 7f305ba00640 1 -- 172.21.15.99:0/4138202777 shutdown_connections 2024-02-21T23:01:10.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.520+0000 7f305ba00640 1 --2- 172.21.15.99:0/4138202777 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3054187680 0x7f305418a3f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:10.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.520+0000 7f305ba00640 1 -- 172.21.15.99:0/4138202777 >> 172.21.15.99:0/4138202777 conn(0x7f30540ce5f0 msgr2=0x7f30540cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:10.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.520+0000 7f305ba00640 1 -- 172.21.15.99:0/4138202777 shutdown_connections 2024-02-21T23:01:10.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.520+0000 7f305ba00640 1 -- 172.21.15.99:0/4138202777 wait complete. 2024-02-21T23:01:10.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.522+0000 7f305ba00640 1 Processor -- start 2024-02-21T23:01:10.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.522+0000 7f305ba00640 1 -- start start 2024-02-21T23:01:10.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.523+0000 7f305ba00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3054186b90 0x7f305417c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:10.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.523+0000 7f305ba00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3054187680 0x7f3054188b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:10.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.523+0000 7f305ba00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f305418a930 0x7f3054189040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:10.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.523+0000 7f305ba00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30541867b0 con 0x7f3054187680 2024-02-21T23:01:10.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.523+0000 7f305ba00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30541864d0 con 0x7f3054186b90 2024-02-21T23:01:10.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.523+0000 7f305ba00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30540cbf20 con 0x7f305418a930 2024-02-21T23:01:10.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.523+0000 7f3059000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3054186b90 0x7f305417c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:10.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.523+0000 7f3053e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3054187680 0x7f3054188b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:10.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.523+0000 7f3059000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3054186b90 0x7f305417c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:59262/0 (socket says 172.21.15.99:59262) 2024-02-21T23:01:10.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.523+0000 7f3059000640 1 -- 172.21.15.99:0/1059176210 learned_addr learned my addr 172.21.15.99:0/1059176210 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:10.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.523+0000 7f3059a00640 1 --2- 172.21.15.99:0/1059176210 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f305418a930 0x7f3054189040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:10.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.524+0000 7f3059000640 1 -- 172.21.15.99:0/1059176210 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f305418a930 msgr2=0x7f3054189040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:10.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.524+0000 7f3059000640 1 --2- 172.21.15.99:0/1059176210 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f305418a930 0x7f3054189040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:10.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.524+0000 7f3059000640 1 -- 172.21.15.99:0/1059176210 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3054187680 msgr2=0x7f3054188b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:10.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.524+0000 7f3059000640 1 --2- 172.21.15.99:0/1059176210 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3054187680 0x7f3054188b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:10.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.524+0000 7f3059000640 1 -- 172.21.15.99:0/1059176210 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f305417c970 con 0x7f3054186b90 2024-02-21T23:01:10.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.524+0000 7f3053e00640 1 --2- 172.21.15.99:0/1059176210 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3054187680 0x7f3054188b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:01:10.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.524+0000 7f3059000640 1 --2- 172.21.15.99:0/1059176210 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3054186b90 0x7f305417c430 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f304800c390 tx=0x7f304800c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:10.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.524+0000 7f3050c00640 1 -- 172.21.15.99:0/1059176210 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3048017070 con 0x7f3054186b90 2024-02-21T23:01:10.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.524+0000 7f3050c00640 1 -- 172.21.15.99:0/1059176210 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3048005ce0 con 0x7f3054186b90 2024-02-21T23:01:10.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.524+0000 7f305ba00640 1 -- 172.21.15.99:0/1059176210 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30540726a0 con 0x7f3054186b90 2024-02-21T23:01:10.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.524+0000 7f3050c00640 1 -- 172.21.15.99:0/1059176210 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30480072f0 con 0x7f3054186b90 2024-02-21T23:01:10.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.524+0000 7f305ba00640 1 -- 172.21.15.99:0/1059176210 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3054188020 con 0x7f3054186b90 2024-02-21T23:01:10.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.526+0000 7f305ba00640 1 -- 172.21.15.99:0/1059176210 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30540cc1c0 con 0x7f3054186b90 2024-02-21T23:01:10.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.528+0000 7f3050c00640 1 -- 172.21.15.99:0/1059176210 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 134356+0+0 (secure 0 0 0) 0x7f304801a070 con 0x7f3054186b90 2024-02-21T23:01:10.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.529+0000 7f3050c00640 1 --2- 172.21.15.99:0/1059176210 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f303409ed60 0x7f30340a1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:10.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.529+0000 7f3050c00640 1 -- 172.21.15.99:0/1059176210 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f30480c8e60 con 0x7f3054186b90 2024-02-21T23:01:10.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.530+0000 7f3053e00640 1 --2- 172.21.15.99:0/1059176210 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f303409ed60 0x7f30340a1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:10.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.530+0000 7f3053e00640 1 --2- 172.21.15.99:0/1059176210 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f303409ed60 0x7f30340a1220 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3040036000 tx=0x7f304003b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:10.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.534+0000 7f3050c00640 1 -- 172.21.15.99:0/1059176210 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f30480971a0 con 0x7f3054186b90 2024-02-21T23:01:10.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.730+0000 7f305ba00640 1 -- 172.21.15.99:0/1059176210 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3054072ad0 con 0x7f3054186b90 2024-02-21T23:01:10.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.732+0000 7f3050c00640 1 -- 172.21.15.99:0/1059176210 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+23570 (secure 0 0 0) 0x7f3048096aa0 con 0x7f3054186b90 2024-02-21T23:01:10.723 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T23:01:10.723 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":29,"fsid":"e8af98cd-45a1-425f-96a7-f24da8ee4efb","created":"2024-02-21T23:00:44.699708+0000","modified":"2024-02-21T23:01:07.722511+0000","last_up_change":"2024-02-21T23:00:55.749829+0000","last_in_change":"2024-02-21T23:00:48.332297+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T23:00:57.020557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":11.760000228881836,"score_stable":11.760000228881836,"optimal_score":0.17000000178813934,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-21T23:01:01.124398+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-21T23:01:01.684258+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-21T23:01:05.290089+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c49de9b2-dc53-4882-b14c-7059ed40bf59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6809","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6811","nonce":1026112937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6813","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6815","nonce":1026112937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6823","nonce":1026112937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6819","nonce":1026112937}]},"public_addr":"172.21.15.99:6811/1026112937","cluster_addr":"172.21.15.99:6815/1026112937","heartbeat_back_addr":"172.21.15.99:6823/1026112937","heartbeat_front_addr":"172.21.15.99:6819/1026112937","state":["exists","up"]},{"osd":1,"uuid":"58398292-2fe5-4291-94fd-03a0ca29d49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6827","nonce":3030871566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6829","nonce":3030871566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6833","nonce":3030871566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6831","nonce":3030871566}]},"public_addr":"172.21.15.162:6827/3030871566","cluster_addr":"172.21.15.162:6829/3030871566","heartbeat_back_addr":"172.21.15.162:6833/3030871566","heartbeat_front_addr":"172.21.15.162:6831/3030871566","state":["exists","up"]},{"osd":2,"uuid":"94cddec1-e08f-438d-a7c8-48a0e47d71a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6818","nonce":2782386148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6821","nonce":2782386148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6827","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6829","nonce":2782386148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6823","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6825","nonce":2782386148}]},"public_addr":"172.21.15.181:6818/2782386148","cluster_addr":"172.21.15.181:6821/2782386148","heartbeat_back_addr":"172.21.15.181:6829/2782386148","heartbeat_front_addr":"172.21.15.181:6825/2782386148","state":["exists","up"]},{"osd":3,"uuid":"d29abb74-9b89-4fd7-88b1-7c2eb8231189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6801","nonce":2316185310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6803","nonce":2316185310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6807","nonce":2316185310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6805","nonce":2316185310}]},"public_addr":"172.21.15.99:6801/2316185310","cluster_addr":"172.21.15.99:6803/2316185310","heartbeat_back_addr":"172.21.15.99:6807/2316185310","heartbeat_front_addr":"172.21.15.99:6805/2316185310","state":["exists","up"]},{"osd":4,"uuid":"0d8c9ea3-880a-4d69-9dcb-cf7d35abd449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6811","nonce":3137681258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6813","nonce":3137681258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6817","nonce":3137681258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6815","nonce":3137681258}]},"public_addr":"172.21.15.162:6811/3137681258","cluster_addr":"172.21.15.162:6813/3137681258","heartbeat_back_addr":"172.21.15.162:6817/3137681258","heartbeat_front_addr":"172.21.15.162:6815/3137681258","state":["exists","up"]},{"osd":5,"uuid":"2e3a9340-6fd0-4d7a-8e00-fe305649296e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6801","nonce":2011264527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6803","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6805","nonce":2011264527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6811","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6813","nonce":2011264527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6807","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6809","nonce":2011264527}]},"public_addr":"172.21.15.181:6801/2011264527","cluster_addr":"172.21.15.181:6805/2011264527","heartbeat_back_addr":"172.21.15.181:6813/2011264527","heartbeat_front_addr":"172.21.15.181:6809/2011264527","state":["exists","up"]},{"osd":6,"uuid":"d9e37ce7-1b0e-4019-8f2e-b670403abf7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6810","nonce":753870050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6814","nonce":753870050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6822","nonce":753870050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6818","nonce":753870050}]},"public_addr":"172.21.15.99:6810/753870050","cluster_addr":"172.21.15.99:6814/753870050","heartbeat_back_addr":"172.21.15.99:6822/753870050","heartbeat_front_addr":"172.21.15.99:6818/753870050","state":["exists","up"]},{"osd":7,"uuid":"49988754-232e-4b8c-bd72-bfa25b418e5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6803","nonce":1659412949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6805","nonce":1659412949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6809","nonce":1659412949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6807","nonce":1659412949}]},"public_addr":"172.21.15.162:6803/1659412949","cluster_addr":"172.21.15.162:6805/1659412949","heartbeat_back_addr":"172.21.15.162:6809/1659412949","heartbeat_front_addr":"172.21.15.162:6807/1659412949","state":["exists","up"]},{"osd":8,"uuid":"ebc6e462-8368-4d64-b242-9c8735ac672c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6804","nonce":3389807042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6808","nonce":3389807042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6815","nonce":3389807042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6812","nonce":3389807042}]},"public_addr":"172.21.15.181:6804/3389807042","cluster_addr":"172.21.15.181:6808/3389807042","heartbeat_back_addr":"172.21.15.181:6815/3389807042","heartbeat_front_addr":"172.21.15.181:6812/3389807042","state":["exists","up"]},{"osd":9,"uuid":"72af1b02-b965-4d6a-8964-527ec24c4daa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6825","nonce":4055669590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6827","nonce":4055669590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6831","nonce":4055669590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6829","nonce":4055669590}]},"public_addr":"172.21.15.99:6825/4055669590","cluster_addr":"172.21.15.99:6827/4055669590","heartbeat_back_addr":"172.21.15.99:6831/4055669590","heartbeat_front_addr":"172.21.15.99:6829/4055669590","state":["exists","up"]},{"osd":10,"uuid":"adb5cb06-6453-41e4-b847-d7c78bbb7d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6819","nonce":1421879617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6821","nonce":1421879617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6825","nonce":1421879617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6823","nonce":1421879617}]},"public_addr":"172.21.15.162:6819/1421879617","cluster_addr":"172.21.15.162:6821/1421879617","heartbeat_back_addr":"172.21.15.162:6825/1421879617","heartbeat_front_addr":"172.21.15.162:6823/1421879617","state":["exists","up"]},{"osd":11,"uuid":"118563d9-1e8f-4dc7-a92c-2f4c4dc3e20f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6817","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6819","nonce":3219928272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6824","nonce":3219928272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6831","nonce":3219928272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6828","nonce":3219928272}]},"public_addr":"172.21.15.181:6819/3219928272","cluster_addr":"172.21.15.181:6824/3219928272","heartbeat_back_addr":"172.21.15.181:6831/3219928272","heartbeat_front_addr":"172.21.15.181:6828/3219928272","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.651219+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.549859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.529659+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.591004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.440836+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.414250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.630130+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.411954+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.439371+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.428173+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.511203+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.482806+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T23:01:10.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.735+0000 7f305ba00640 1 -- 172.21.15.99:0/1059176210 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f303409ed60 msgr2=0x7f30340a1220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:10.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.735+0000 7f305ba00640 1 --2- 172.21.15.99:0/1059176210 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f303409ed60 0x7f30340a1220 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3040036000 tx=0x7f304003b040 comp rx=0 tx=0).stop 2024-02-21T23:01:10.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.735+0000 7f305ba00640 1 -- 172.21.15.99:0/1059176210 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3054186b90 msgr2=0x7f305417c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:10.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.735+0000 7f305ba00640 1 --2- 172.21.15.99:0/1059176210 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3054186b90 0x7f305417c430 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f304800c390 tx=0x7f304800c850 comp rx=0 tx=0).stop 2024-02-21T23:01:10.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.735+0000 7f305ba00640 1 -- 172.21.15.99:0/1059176210 shutdown_connections 2024-02-21T23:01:10.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.735+0000 7f305ba00640 1 --2- 172.21.15.99:0/1059176210 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f303409ed60 0x7f30340a1220 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:10.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.735+0000 7f305ba00640 1 --2- 172.21.15.99:0/1059176210 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f305418a930 0x7f3054189040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:10.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.735+0000 7f305ba00640 1 --2- 172.21.15.99:0/1059176210 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3054187680 0x7f3054188b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:10.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.735+0000 7f305ba00640 1 --2- 172.21.15.99:0/1059176210 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3054186b90 0x7f305417c430 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:10.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.735+0000 7f305ba00640 1 -- 172.21.15.99:0/1059176210 >> 172.21.15.99:0/1059176210 conn(0x7f30540ce5f0 msgr2=0x7f3054068e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:10.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.735+0000 7f305ba00640 1 -- 172.21.15.99:0/1059176210 shutdown_connections 2024-02-21T23:01:10.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:10.735+0000 7f305ba00640 1 -- 172.21.15.99:0/1059176210 wait complete. 2024-02-21T23:01:11.954 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-02-21T23:01:02.656130+0000', 'modified': '2024-02-21T23:01:07.722827+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4355}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4355': {'gid': 4355, 'name': 'j', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.99:6839/4239008786', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.99:6838', 'nonce': 4239008786}, {'type': 'v1', 'addr': '172.21.15.99:6839', 'nonce': 4239008786}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2024-02-21T23:01:11.954 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-02-21T23:01:11.955 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.j status 2024-02-21T23:01:12.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.180+0000 7f64d3a00640 1 Processor -- start 2024-02-21T23:01:12.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.180+0000 7f64d3a00640 1 -- start start 2024-02-21T23:01:12.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.182+0000 7f64d3a00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64cc17d980 con 0x7f64cc187680 2024-02-21T23:01:12.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.182+0000 7f64d3a00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64cc185950 con 0x7f64cc18ab00 2024-02-21T23:01:12.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.182+0000 7f64d3a00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64cc185c30 con 0x7f64cc186b90 2024-02-21T23:01:12.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.183+0000 7f64d1000640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f64cc186b90 0x7f64cc186f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:37276/0 (socket says 172.21.15.99:37276) 2024-02-21T23:01:12.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.183+0000 7f64d1000640 1 -- 172.21.15.99:0/2658795332 learned_addr learned my addr 172.21.15.99:0/2658795332 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:01:12.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.183+0000 7f64cbe00640 1 -- 172.21.15.99:0/2658795332 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1428117160 0 0) 0x7f64cc185c30 con 0x7f64cc186b90 2024-02-21T23:01:12.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.183+0000 7f64cbe00640 1 -- 172.21.15.99:0/2658795332 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64b0003520 con 0x7f64cc186b90 2024-02-21T23:01:12.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.183+0000 7f64cbe00640 1 -- 172.21.15.99:0/2658795332 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2467619692 0 0) 0x7f64cc185950 con 0x7f64cc18ab00 2024-02-21T23:01:12.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.183+0000 7f64cbe00640 1 -- 172.21.15.99:0/2658795332 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64cc185c30 con 0x7f64cc18ab00 2024-02-21T23:01:12.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.183+0000 7f64cbe00640 1 -- 172.21.15.99:0/2658795332 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3055054738 0 0) 0x7f64cc17d980 con 0x7f64cc187680 2024-02-21T23:01:12.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.183+0000 7f64cbe00640 1 -- 172.21.15.99:0/2658795332 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64cc185950 con 0x7f64cc187680 2024-02-21T23:01:12.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.183+0000 7f64cbe00640 1 -- 172.21.15.99:0/2658795332 <== mon.2 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 648245848 0 0) 0x7f64b0003520 con 0x7f64cc186b90 2024-02-21T23:01:12.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.183+0000 7f64cbe00640 1 -- 172.21.15.99:0/2658795332 >> v1:172.21.15.162:6789/0 conn(0x7f64cc18ab00 legacy=0x7f64cc184a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:12.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.183+0000 7f64cbe00640 1 -- 172.21.15.99:0/2658795332 >> v1:172.21.15.99:6789/0 conn(0x7f64cc187680 legacy=0x7f64cc18a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:12.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.183+0000 7f64cbe00640 1 -- 172.21.15.99:0/2658795332 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64cc185f10 con 0x7f64cc186b90 2024-02-21T23:01:12.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.183+0000 7f64cbe00640 1 -- 172.21.15.99:0/2658795332 <== mon.2 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2069890144 0 0) 0x7f64bc001670 con 0x7f64cc186b90 2024-02-21T23:01:12.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.184+0000 7f64cbe00640 1 -- 172.21.15.99:0/2658795332 >> v1:172.21.15.181:6789/0 conn(0x7f64cc186b90 legacy=0x7f64cc186f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:12.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.184+0000 7f64cbe00640 1 --2- 172.21.15.99:0/2658795332 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f64b0003d70 0x7f64b0004150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:12.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.184+0000 7f64cbe00640 1 --2- 172.21.15.99:0/2658795332 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f64b0004850 0x7f64b0004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:12.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.184+0000 7f64cbe00640 1 --2- 172.21.15.99:0/2658795332 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f64b0005300 0x7f64b000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:12.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.184+0000 7f64cbe00640 1 -- 172.21.15.99:0/2658795332 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64b000c220 con 0x7f64b0004850 2024-02-21T23:01:12.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.184+0000 7f64cbe00640 1 -- 172.21.15.99:0/2658795332 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64b000c3d0 con 0x7f64b0003d70 2024-02-21T23:01:12.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.184+0000 7f64cbe00640 1 -- 172.21.15.99:0/2658795332 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64b000c5d0 con 0x7f64b0005300 2024-02-21T23:01:12.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.184+0000 7f64d1a00640 1 --2- 172.21.15.99:0/2658795332 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f64b0005300 0x7f64b000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:12.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.184+0000 7f64d1000640 1 --2- 172.21.15.99:0/2658795332 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f64b0003d70 0x7f64b0004150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:12.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.184+0000 7f64c3e00640 1 --2- 172.21.15.99:0/2658795332 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f64b0004850 0x7f64b0004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:12.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.184+0000 7f64d1a00640 1 -- 172.21.15.99:0/2658795332 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f64b0003d70 msgr2=0x7f64b0004150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:12.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.184+0000 7f64d1a00640 1 --2- 172.21.15.99:0/2658795332 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f64b0003d70 0x7f64b0004150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:12.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.184+0000 7f64d1a00640 1 -- 172.21.15.99:0/2658795332 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f64b0004850 msgr2=0x7f64b0004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:12.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.184+0000 7f64d1a00640 1 --2- 172.21.15.99:0/2658795332 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f64b0004850 0x7f64b0004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:12.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.184+0000 7f64d1a00640 1 -- 172.21.15.99:0/2658795332 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64b0003520 con 0x7f64b0005300 2024-02-21T23:01:12.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.186+0000 7f64d1a00640 1 -- 172.21.15.99:0/2658795332 reap_dead start 2024-02-21T23:01:12.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.186+0000 7f64d1a00640 1 --2- 172.21.15.99:0/2658795332 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f64b0005300 0x7f64b000b9c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f64c4001fa0 tx=0x7f64b0005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=727805ac819aa706 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:12.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.186+0000 7f64cbe00640 1 -- 172.21.15.99:0/2658795332 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c4001bc0 con 0x7f64b0005300 2024-02-21T23:01:12.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.186+0000 7f64cbe00640 1 -- 172.21.15.99:0/2658795332 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64c4003b70 con 0x7f64b0005300 2024-02-21T23:01:12.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.186+0000 7f64cbe00640 1 -- 172.21.15.99:0/2658795332 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c40050d0 con 0x7f64b0005300 2024-02-21T23:01:12.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.187+0000 7f64d3a00640 1 -- 172.21.15.99:0/2658795332 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f64b0005300 msgr2=0x7f64b000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:12.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.187+0000 7f64d3a00640 1 --2- 172.21.15.99:0/2658795332 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f64b0005300 0x7f64b000b9c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f64c4001fa0 tx=0x7f64b0005830 comp rx=0 tx=0).stop 2024-02-21T23:01:12.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.187+0000 7f64d3a00640 1 -- 172.21.15.99:0/2658795332 shutdown_connections 2024-02-21T23:01:12.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.187+0000 7f64d3a00640 1 --2- 172.21.15.99:0/2658795332 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f64b0005300 0x7f64b000b9c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:12.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.187+0000 7f64d3a00640 1 -- 172.21.15.99:0/2658795332 >> 172.21.15.99:0/2658795332 conn(0x7f64cc0ce5f0 msgr2=0x7f64cc0cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:12.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.187+0000 7f64d3a00640 1 -- 172.21.15.99:0/2658795332 shutdown_connections 2024-02-21T23:01:12.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.187+0000 7f64d3a00640 1 -- 172.21.15.99:0/2658795332 wait complete. 2024-02-21T23:01:12.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.191+0000 7f64d3a00640 1 Processor -- start 2024-02-21T23:01:12.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.191+0000 7f64d3a00640 1 -- start start 2024-02-21T23:01:12.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.193+0000 7f64d3a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f64b0005300 0x7f64cc17b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:12.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.193+0000 7f64d3a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f64cc17b790 0x7f64cc0f8370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:12.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.193+0000 7f64d3a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f64cc0f88b0 0x7f64cc168790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:12.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.193+0000 7f64d3a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64cc1867b0 con 0x7f64cc0f88b0 2024-02-21T23:01:12.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.193+0000 7f64d3a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64cc1864d0 con 0x7f64b0005300 2024-02-21T23:01:12.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.193+0000 7f64d3a00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64cc18af10 con 0x7f64cc17b790 2024-02-21T23:01:12.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.193+0000 7f64d1000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f64b0005300 0x7f64cc17b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:12.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.193+0000 7f64d1a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f64cc0f88b0 0x7f64cc168790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:12.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.193+0000 7f64d1000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f64b0005300 0x7f64cc17b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:59284/0 (socket says 172.21.15.99:59284) 2024-02-21T23:01:12.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.193+0000 7f64d1000640 1 -- 172.21.15.99:0/2619273723 learned_addr learned my addr 172.21.15.99:0/2619273723 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:12.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.193+0000 7f64c3e00640 1 --2- 172.21.15.99:0/2619273723 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f64cc17b790 0x7f64cc0f8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:12.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.194+0000 7f64d1000640 1 -- 172.21.15.99:0/2619273723 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f64cc17b790 msgr2=0x7f64cc0f8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:12.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.194+0000 7f64d1000640 1 --2- 172.21.15.99:0/2619273723 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f64cc17b790 0x7f64cc0f8370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:12.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.194+0000 7f64d1000640 1 -- 172.21.15.99:0/2619273723 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f64cc0f88b0 msgr2=0x7f64cc168790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:12.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.194+0000 7f64d1000640 1 --2- 172.21.15.99:0/2619273723 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f64cc0f88b0 0x7f64cc168790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:12.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.194+0000 7f64d1000640 1 -- 172.21.15.99:0/2619273723 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64cc0f8d30 con 0x7f64b0005300 2024-02-21T23:01:12.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.194+0000 7f64d1000640 1 --2- 172.21.15.99:0/2619273723 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f64b0005300 0x7f64cc17b250 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f64bc004e40 tx=0x7f64bc007430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:12.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.194+0000 7f64c9600640 1 -- 172.21.15.99:0/2619273723 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64bc00f7b0 con 0x7f64b0005300 2024-02-21T23:01:12.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.194+0000 7f64c9600640 1 -- 172.21.15.99:0/2619273723 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64bc018070 con 0x7f64b0005300 2024-02-21T23:01:12.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.194+0000 7f64d3a00640 1 -- 172.21.15.99:0/2619273723 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64cc17be30 con 0x7f64b0005300 2024-02-21T23:01:12.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.194+0000 7f64c9600640 1 -- 172.21.15.99:0/2619273723 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64bc00fb90 con 0x7f64b0005300 2024-02-21T23:01:12.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.195+0000 7f64d3a00640 1 -- 172.21.15.99:0/2619273723 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64cc17c3f0 con 0x7f64b0005300 2024-02-21T23:01:12.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.199+0000 7f64c9600640 1 -- 172.21.15.99:0/2619273723 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 134356+0+0 (secure 0 0 0) 0x7f64bc00fd30 con 0x7f64b0005300 2024-02-21T23:01:12.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.200+0000 7f64d6983740 1 Processor -- start 2024-02-21T23:01:12.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.200+0000 7f64d6983740 1 -- start start 2024-02-21T23:01:12.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.201+0000 7f64d6983740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559da2b6c850 0x559da2b6cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:12.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.201+0000 7f64d6983740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559da2b6d170 0x559da2ba79e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:12.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.201+0000 7f64c9600640 1 --2- 172.21.15.99:0/2619273723 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f64a809ed90 0x7f64a80a1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:12.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.201+0000 7f64d6983740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559da2ba7f20 0x559da2ba8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:12.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.201+0000 7f64d6983740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x559da2a95470 con 0x559da2ba7f20 2024-02-21T23:01:12.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.201+0000 7f64d6983740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x559da2a3eaf0 con 0x559da2b6c850 2024-02-21T23:01:12.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.201+0000 7f64d6983740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x559da2a91510 con 0x559da2b6d170 2024-02-21T23:01:12.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.201+0000 7f64c9600640 1 -- 172.21.15.99:0/2619273723 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f64bc0c98a0 con 0x7f64b0005300 2024-02-21T23:01:12.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.201+0000 7f64d1a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559da2ba7f20 0x559da2ba8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:12.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.201+0000 7f64d1000640 1 --2- 172.21.15.99:0/2619273723 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f64a809ed90 0x7f64a80a1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:12.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.201+0000 7f64d1a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559da2ba7f20 0x559da2ba8cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:57696/0 (socket says 172.21.15.99:57696) 2024-02-21T23:01:12.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.201+0000 7f64d1a00640 1 -- 172.21.15.99:0/2922469272 learned_addr learned my addr 172.21.15.99:0/2922469272 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:12.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.202+0000 7f64c3e00640 1 --2- 172.21.15.99:0/2922469272 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559da2b6d170 0x559da2ba79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:12.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.202+0000 7f64d1a00640 1 --2- 172.21.15.99:0/2922469272 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559da2b6c850 0x559da2b6cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:12.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.202+0000 7f64d1a00640 1 -- 172.21.15.99:0/2922469272 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559da2b6d170 msgr2=0x559da2ba79e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:12.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.202+0000 7f64d1a00640 1 --2- 172.21.15.99:0/2922469272 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559da2b6d170 0x559da2ba79e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:12.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.202+0000 7f64d1a00640 1 -- 172.21.15.99:0/2922469272 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559da2b6c850 msgr2=0x559da2b6cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:12.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.202+0000 7f64d1a00640 1 --2- 172.21.15.99:0/2922469272 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559da2b6c850 0x559da2b6cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:12.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.202+0000 7f64d1a00640 1 -- 172.21.15.99:0/2922469272 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559da2a45d90 con 0x559da2ba7f20 2024-02-21T23:01:12.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.202+0000 7f64d1000640 1 --2- 172.21.15.99:0/2619273723 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f64a809ed90 0x7f64a80a1250 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f64bc00f5a0 tx=0x7f64bc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:12.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.202+0000 7f64d1a00640 1 --2- 172.21.15.99:0/2922469272 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559da2ba7f20 0x559da2ba8cb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f64c40012e0 tx=0x7f64c4036040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c8f661742b2ff3f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:12.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.203+0000 7f64c1600640 1 -- 172.21.15.99:0/2922469272 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c4006b50 con 0x559da2ba7f20 2024-02-21T23:01:12.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.203+0000 7f64c1600640 1 -- 172.21.15.99:0/2922469272 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64c4006cf0 con 0x559da2ba7f20 2024-02-21T23:01:12.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.203+0000 7f64c1600640 1 -- 172.21.15.99:0/2922469272 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c40052d0 con 0x559da2ba7f20 2024-02-21T23:01:12.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.203+0000 7f64d6983740 1 -- 172.21.15.99:0/2922469272 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559da2ba7f20 msgr2=0x559da2ba8cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:12.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.203+0000 7f64d6983740 1 --2- 172.21.15.99:0/2922469272 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559da2ba7f20 0x559da2ba8cb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f64c40012e0 tx=0x7f64c4036040 comp rx=0 tx=0).stop 2024-02-21T23:01:12.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.203+0000 7f64d6983740 1 -- 172.21.15.99:0/2922469272 shutdown_connections 2024-02-21T23:01:12.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.203+0000 7f64d6983740 1 --2- 172.21.15.99:0/2922469272 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559da2ba7f20 0x559da2ba8cb0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:12.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.203+0000 7f64d6983740 1 --2- 172.21.15.99:0/2922469272 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559da2b6d170 0x559da2ba79e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:12.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.203+0000 7f64d6983740 1 --2- 172.21.15.99:0/2922469272 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559da2b6c850 0x559da2b6cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:12.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.203+0000 7f64d6983740 1 -- 172.21.15.99:0/2922469272 >> 172.21.15.99:0/2922469272 conn(0x559da2b2ee20 msgr2=0x559da2b2fea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:12.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.204+0000 7f64d6983740 1 -- 172.21.15.99:0/2922469272 shutdown_connections 2024-02-21T23:01:12.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.204+0000 7f64d6983740 1 -- 172.21.15.99:0/2922469272 wait complete. 2024-02-21T23:01:12.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.205+0000 7f64d6983740 1 -- start start 2024-02-21T23:01:12.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.205+0000 7f64d6983740 1 Processor -- start 2024-02-21T23:01:12.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.207+0000 7f64d6983740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559da2b6d170 0x559da2b66660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:12.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.207+0000 7f64d6983740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559da2ba7f20 0x559da2b61350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:12.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.207+0000 7f64d6983740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559da2b2bef0 0x559da2b5dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:12.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.207+0000 7f64d6983740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x559da2ba6400 con 0x559da2ba7f20 2024-02-21T23:01:12.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.207+0000 7f64d6983740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x559da2a34040 con 0x559da2b6d170 2024-02-21T23:01:12.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.207+0000 7f64d6983740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x559da2ba66e0 con 0x559da2b2bef0 2024-02-21T23:01:12.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.208+0000 7f64d6983740 10 client.0 _ll_register_callbacks cb 0x559da2a51920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:01:12.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.208+0000 7f64c3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559da2ba7f20 0x559da2b61350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:12.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.208+0000 7f64c3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559da2ba7f20 0x559da2b61350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:57712/0 (socket says 172.21.15.99:57712) 2024-02-21T23:01:12.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.208+0000 7f64c3e00640 1 -- 172.21.15.99:0/717956184 learned_addr learned my addr 172.21.15.99:0/717956184 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:12.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.208+0000 7f64d1a00640 1 --2- 172.21.15.99:0/717956184 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559da2b6d170 0x559da2b66660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:12.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.208+0000 7f64d1a00640 1 --2- 172.21.15.99:0/717956184 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559da2b2bef0 0x559da2b5dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:12.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.208+0000 7f64c3e00640 1 -- 172.21.15.99:0/717956184 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559da2b2bef0 msgr2=0x559da2b5dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:12.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.208+0000 7f64c3e00640 1 --2- 172.21.15.99:0/717956184 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559da2b2bef0 0x559da2b5dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:12.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.208+0000 7f64c3e00640 1 -- 172.21.15.99:0/717956184 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559da2b6d170 msgr2=0x559da2b66660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:12.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.208+0000 7f64c3e00640 1 --2- 172.21.15.99:0/717956184 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559da2b6d170 0x559da2b66660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:12.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.208+0000 7f64c3e00640 1 -- 172.21.15.99:0/717956184 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559da2a53aa0 con 0x559da2ba7f20 2024-02-21T23:01:12.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.208+0000 7f64c3e00640 1 --2- 172.21.15.99:0/717956184 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559da2ba7f20 0x559da2b61350 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f64b4015650 tx=0x7f64b4015b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2751b2ccac1d003e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:12.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.208+0000 7f64ba000640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:01:12.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.209+0000 7f64ba000640 1 -- 172.21.15.99:0/717956184 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b4005110 con 0x559da2ba7f20 2024-02-21T23:01:12.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.209+0000 7f64ba000640 1 -- 172.21.15.99:0/717956184 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f64b40052b0 con 0x559da2ba7f20 2024-02-21T23:01:12.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.209+0000 7f64d6983740 1 -- 172.21.15.99:0/717956184 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f64c4006cf0 con 0x559da2ba7f20 2024-02-21T23:01:12.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.209+0000 7f64ba000640 1 -- 172.21.15.99:0/717956184 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f64b40054b0 con 0x559da2ba7f20 2024-02-21T23:01:12.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.209+0000 7f64d6983740 10 client.4365 fetch_fsmap learned FSMap version 7 2024-02-21T23:01:12.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.209+0000 7f64d6983740 1 -- 172.21.15.99:0/717956184 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x559da27aa2d0 con 0x559da2ba7f20 2024-02-21T23:01:12.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.209+0000 7f64ba000640 1 -- 172.21.15.99:0/717956184 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64c4006cf0 con 0x559da2ba7f20 2024-02-21T23:01:12.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.209+0000 7f64ba000640 1 -- 172.21.15.99:0/717956184 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 7) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f64b4013890 con 0x559da2ba7f20 2024-02-21T23:01:12.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.209+0000 7f64d6983740 10 client.4365 fetch_fsmap finished waiting for FSMap version 7 2024-02-21T23:01:12.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.209+0000 7f64d6983740 10 client.4365 resolve_mds: resolved name 'j' to daemon mds.j 2024-02-21T23:01:12.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.210+0000 7f64d6983740 20 client.4365 populate_metadata read hostname 'smithi099' 2024-02-21T23:01:12.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.210+0000 7f64d6983740 1 --2- 172.21.15.99:0/717956184 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x559da2ba56c0 0x559da2bbe220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:12.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.210+0000 7f64d6983740 4 client.4365 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:01:12.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.210+0000 7f64d6983740 1 -- 172.21.15.99:0/717956184 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559da2aa29b0 con 0x559da2ba56c0 2024-02-21T23:01:12.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.210+0000 7f64d1a00640 1 --2- 172.21.15.99:0/717956184 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x559da2ba56c0 0x559da2bbe220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:12.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.210+0000 7f64d1a00640 1 --2- 172.21.15.99:0/717956184 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x559da2ba56c0 0x559da2bbe220 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f357a980b317ce09 server_cookie=d5624f2a7cf10d27 in_seq=0 out_seq=0 2024-02-21T23:01:12.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.210+0000 7f64ba000640 10 client.4365 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:01:12.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.211+0000 7f64ba000640 1 -- 172.21.15.99:0/717956184 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x559da2aa29b0 con 0x559da2ba56c0 2024-02-21T23:01:12.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.211+0000 7f64ba000640 10 client.4365 handle_command_reply: tid=0 2024-02-21T23:01:12.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.211+0000 7f64d6983740 1 client.4365 shutdown 2024-02-21T23:01:12.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.211+0000 7f64d6983740 1 -- 172.21.15.99:0/717956184 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559da2ba7f20 msgr2=0x559da2b61350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:12.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.211+0000 7f64d6983740 1 --2- 172.21.15.99:0/717956184 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559da2ba7f20 0x559da2b61350 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f64b4015650 tx=0x7f64b4015b10 comp rx=0 tx=0).stop 2024-02-21T23:01:12.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.212+0000 7f64d6983740 1 -- 172.21.15.99:0/717956184 shutdown_connections 2024-02-21T23:01:12.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.212+0000 7f64d6983740 1 --2- 172.21.15.99:0/717956184 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x559da2ba56c0 0x559da2bbe220 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:12.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.212+0000 7f64d6983740 1 --2- 172.21.15.99:0/717956184 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559da2b2bef0 0x559da2b5dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:12.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.212+0000 7f64d6983740 1 --2- 172.21.15.99:0/717956184 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559da2ba7f20 0x559da2b61350 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:12.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.212+0000 7f64d6983740 1 --2- 172.21.15.99:0/717956184 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559da2b6d170 0x559da2b66660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:12.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.212+0000 7f64ba000640 0 client.4365 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:01:12.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.212+0000 7f64d6983740 1 -- 172.21.15.99:0/717956184 >> 172.21.15.99:0/717956184 conn(0x559da2b6c850 msgr2=0x559da2b30890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:12.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.212+0000 7f64d6983740 1 -- 172.21.15.99:0/717956184 shutdown_connections 2024-02-21T23:01:12.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.212+0000 7f64d6983740 1 -- 172.21.15.99:0/717956184 wait complete. 2024-02-21T23:01:12.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.212+0000 7f64d6983740 20 client.4365 trim_cache size 0 max 16384 2024-02-21T23:01:12.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.248+0000 7f64d6983740 1 Processor -- start 2024-02-21T23:01:12.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.248+0000 7f64d6983740 1 -- start start 2024-02-21T23:01:12.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.250+0000 7f64d6983740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559da2b2bef0 0x559da2b65a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:12.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.250+0000 7f64d6983740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559da2b6d170 0x559da2b65fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:12.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.250+0000 7f64d6983740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559da2ba7f20 0x559da2b66510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:12.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.250+0000 7f64d6983740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x559da2ba5ae0 con 0x559da2b2bef0 2024-02-21T23:01:12.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.250+0000 7f64d6983740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x559da2bb4850 con 0x559da2ba7f20 2024-02-21T23:01:12.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.250+0000 7f64d6983740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x559da2bb4eb0 con 0x559da2b6d170 2024-02-21T23:01:12.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.251+0000 7f64d1a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559da2b2bef0 0x559da2b65a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:12.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.251+0000 7f64d1a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559da2b2bef0 0x559da2b65a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:57726/0 (socket says 172.21.15.99:57726) 2024-02-21T23:01:12.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.251+0000 7f64d1a00640 1 -- 172.21.15.99:0/380498321 learned_addr learned my addr 172.21.15.99:0/380498321 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:12.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.251+0000 7f64c3e00640 1 --2- 172.21.15.99:0/380498321 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559da2b6d170 0x559da2b65fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:12.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.251+0000 7f64d1a00640 1 --2- 172.21.15.99:0/380498321 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559da2ba7f20 0x559da2b66510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:12.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.251+0000 7f64d1a00640 1 -- 172.21.15.99:0/380498321 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559da2b6d170 msgr2=0x559da2b65fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:12.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.251+0000 7f64d1a00640 1 --2- 172.21.15.99:0/380498321 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559da2b6d170 0x559da2b65fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:12.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.251+0000 7f64d1a00640 1 -- 172.21.15.99:0/380498321 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559da2ba7f20 msgr2=0x559da2b66510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:12.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.251+0000 7f64d1a00640 1 --2- 172.21.15.99:0/380498321 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559da2ba7f20 0x559da2b66510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:12.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.251+0000 7f64d1a00640 1 -- 172.21.15.99:0/380498321 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559da28746b0 con 0x559da2b2bef0 2024-02-21T23:01:12.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.251+0000 7f64d1a00640 1 --2- 172.21.15.99:0/380498321 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559da2b2bef0 0x559da2b65a90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f64c4002090 tx=0x7f64c4030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7482f2c4b04e617 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:12.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.251+0000 7f64c0c00640 1 -- 172.21.15.99:0/380498321 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c40051b0 con 0x559da2b2bef0 2024-02-21T23:01:12.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.252+0000 7f64c0c00640 1 -- 172.21.15.99:0/380498321 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64c4005350 con 0x559da2b2bef0 2024-02-21T23:01:12.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.252+0000 7f64c0c00640 1 -- 172.21.15.99:0/380498321 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c4005700 con 0x559da2b2bef0 2024-02-21T23:01:12.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.252+0000 7f64d6983740 1 -- 172.21.15.99:0/380498321 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559da2b2bef0 msgr2=0x559da2b65a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:12.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.252+0000 7f64d6983740 1 --2- 172.21.15.99:0/380498321 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559da2b2bef0 0x559da2b65a90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f64c4002090 tx=0x7f64c4030000 comp rx=0 tx=0).stop 2024-02-21T23:01:12.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.252+0000 7f64d6983740 1 -- 172.21.15.99:0/380498321 shutdown_connections 2024-02-21T23:01:12.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.252+0000 7f64d6983740 1 --2- 172.21.15.99:0/380498321 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559da2ba7f20 0x559da2b66510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:12.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.252+0000 7f64d6983740 1 --2- 172.21.15.99:0/380498321 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559da2b6d170 0x559da2b65fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:12.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.252+0000 7f64d6983740 1 --2- 172.21.15.99:0/380498321 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559da2b2bef0 0x559da2b65a90 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:12.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.252+0000 7f64d6983740 1 -- 172.21.15.99:0/380498321 >> 172.21.15.99:0/380498321 conn(0x559da2b6c850 msgr2=0x559da2b70d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:12.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.253+0000 7f64d6983740 1 -- 172.21.15.99:0/380498321 shutdown_connections 2024-02-21T23:01:12.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.253+0000 7f64d6983740 1 -- 172.21.15.99:0/380498321 wait complete. 2024-02-21T23:01:12.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.254+0000 7f64d6983740 1 -- start start 2024-02-21T23:01:12.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.254+0000 7f64d6983740 1 Processor -- start 2024-02-21T23:01:12.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.256+0000 7f64d6983740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559da2b2bef0 0x559da2c0db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:12.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.256+0000 7f64d6983740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559da2b6d170 0x559da2ba3460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:12.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.256+0000 7f64d6983740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559da2ba7f20 0x559da2ba39a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:12.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.256+0000 7f64d6983740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x559da2bb1620 con 0x559da2ba7f20 2024-02-21T23:01:12.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.256+0000 7f64d6983740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x559da2bb0fc0 con 0x559da2b2bef0 2024-02-21T23:01:12.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.256+0000 7f64d6983740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x559da2bb1c80 con 0x559da2b6d170 2024-02-21T23:01:12.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.256+0000 7f64d6983740 10 client.0 _ll_register_callbacks cb 0x7f64b4001d80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:01:12.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.257+0000 7f64d1a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559da2ba7f20 0x559da2ba39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:12.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.257+0000 7f64c3e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559da2b6d170 0x559da2ba3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:12.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.257+0000 7f64d1a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559da2b2bef0 0x559da2c0db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:12.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.257+0000 7f64d1a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559da2b2bef0 0x559da2c0db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:59320/0 (socket says 172.21.15.99:59320) 2024-02-21T23:01:12.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.257+0000 7f64d1a00640 1 -- 172.21.15.99:0/3604054938 learned_addr learned my addr 172.21.15.99:0/3604054938 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:12.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.257+0000 7f64c3e00640 1 -- 172.21.15.99:0/3604054938 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559da2b2bef0 msgr2=0x559da2c0db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:12.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.257+0000 7f64c3e00640 1 --2- 172.21.15.99:0/3604054938 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559da2b2bef0 0x559da2c0db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:12.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.257+0000 7f64c3e00640 1 -- 172.21.15.99:0/3604054938 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559da2ba7f20 msgr2=0x559da2ba39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:12.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.257+0000 7f64c3e00640 1 --2- 172.21.15.99:0/3604054938 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559da2ba7f20 0x559da2ba39a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:12.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.257+0000 7f64c3e00640 1 -- 172.21.15.99:0/3604054938 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559da2b2da30 con 0x559da2b6d170 2024-02-21T23:01:12.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.257+0000 7f64d1a00640 1 --2- 172.21.15.99:0/3604054938 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559da2ba7f20 0x559da2ba39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:01:12.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.257+0000 7f64c3e00640 1 --2- 172.21.15.99:0/3604054938 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559da2b6d170 0x559da2ba3460 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x559da2b2b320 tx=0x7f64b4018070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ce9655e4a580eb8 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:12.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.257+0000 7f64ba000640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-02-21T23:01:12.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.257+0000 7f64ba000640 1 -- 172.21.15.99:0/3604054938 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b402f060 con 0x559da2b6d170 2024-02-21T23:01:12.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.258+0000 7f64d6983740 1 -- 172.21.15.99:0/3604054938 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f64c4005350 con 0x559da2b6d170 2024-02-21T23:01:12.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.258+0000 7f64ba000640 1 -- 172.21.15.99:0/3604054938 <== mon.2 v2:172.21.15.181:3300/0 2 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f64b4005250 con 0x559da2b6d170 2024-02-21T23:01:12.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.258+0000 7f64ba000640 1 -- 172.21.15.99:0/3604054938 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f64b4007030 con 0x559da2b6d170 2024-02-21T23:01:12.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.258+0000 7f64d6983740 10 client.4475 fetch_fsmap learned FSMap version 7 2024-02-21T23:01:12.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.258+0000 7f64d6983740 1 -- 172.21.15.99:0/3604054938 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x559da2b9cb10 con 0x559da2b6d170 2024-02-21T23:01:12.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.258+0000 7f64ba000640 1 -- 172.21.15.99:0/3604054938 <== mon.2 v2:172.21.15.181:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64c4005350 con 0x559da2b6d170 2024-02-21T23:01:12.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.258+0000 7f64ba000640 1 -- 172.21.15.99:0/3604054938 <== mon.2 v2:172.21.15.181:3300/0 5 ==== fsmap(e 7) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f64b40071d0 con 0x559da2b6d170 2024-02-21T23:01:12.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.258+0000 7f64d6983740 10 client.4475 fetch_fsmap finished waiting for FSMap version 7 2024-02-21T23:01:12.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.259+0000 7f64d6983740 10 client.4475 resolve_mds: resolved name 'j' to daemon mds.j 2024-02-21T23:01:12.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.259+0000 7f64d6983740 20 client.4475 populate_metadata read hostname 'smithi099' 2024-02-21T23:01:12.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.259+0000 7f64d6983740 1 --2- 172.21.15.99:0/3604054938 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x559da2c18f40 0x559da2c1b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:12.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.259+0000 7f64d6983740 4 client.4475 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "status"}] 2024-02-21T23:01:12.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.259+0000 7f64d6983740 1 -- 172.21.15.99:0/3604054938 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "status"}) v1 -- 0x559da2a9cd00 con 0x559da2c18f40 2024-02-21T23:01:12.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.259+0000 7f64d1a00640 1 --2- 172.21.15.99:0/3604054938 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x559da2c18f40 0x559da2c1b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:12.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.259+0000 7f64d1a00640 1 --2- 172.21.15.99:0/3604054938 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x559da2c18f40 0x559da2c1b330 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f54df955cf27318 server_cookie=f9b9775417b04c92 in_seq=0 out_seq=0 2024-02-21T23:01:12.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.259+0000 7f64ba000640 10 client.4475 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:01:12.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.260+0000 7f64ba000640 1 -- 172.21.15.99:0/3604054938 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x559da2a9cd00 con 0x559da2c18f40 2024-02-21T23:01:12.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.260+0000 7f64ba000640 10 client.4475 handle_command_reply: tid=0 2024-02-21T23:01:12.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.260+0000 7f64d6983740 1 client.4475 shutdown 2024-02-21T23:01:12.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.260+0000 7f64d6983740 1 -- 172.21.15.99:0/3604054938 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559da2b6d170 msgr2=0x559da2ba3460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:12.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.260+0000 7f64d6983740 1 --2- 172.21.15.99:0/3604054938 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559da2b6d170 0x559da2ba3460 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x559da2b2b320 tx=0x7f64b4018070 comp rx=0 tx=0).stop 2024-02-21T23:01:12.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.260+0000 7f64d6983740 1 -- 172.21.15.99:0/3604054938 shutdown_connections 2024-02-21T23:01:12.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.260+0000 7f64d6983740 1 --2- 172.21.15.99:0/3604054938 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x559da2c18f40 0x559da2c1b330 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:12.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.260+0000 7f64d6983740 1 --2- 172.21.15.99:0/3604054938 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559da2ba7f20 0x559da2ba39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:12.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.260+0000 7f64d6983740 1 --2- 172.21.15.99:0/3604054938 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559da2b6d170 0x559da2ba3460 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:12.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.260+0000 7f64ba000640 0 client.4475 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:01:12.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.260+0000 7f64d6983740 1 --2- 172.21.15.99:0/3604054938 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559da2b2bef0 0x559da2c0db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:12.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.260+0000 7f64d6983740 1 -- 172.21.15.99:0/3604054938 >> 172.21.15.99:0/3604054938 conn(0x559da2b6c850 msgr2=0x559da2b30890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:12.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.260+0000 7f64d6983740 1 -- 172.21.15.99:0/3604054938 shutdown_connections 2024-02-21T23:01:12.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.260+0000 7f64d6983740 1 -- 172.21.15.99:0/3604054938 wait complete. 2024-02-21T23:01:12.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.260+0000 7f64d6983740 20 client.4475 trim_cache size 0 max 16384 2024-02-21T23:01:12.252 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-02-21T23:01:12.252 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_fsid": "e8af98cd-45a1-425f-96a7-f24da8ee4efb", 2024-02-21T23:01:12.252 INFO:teuthology.orchestra.run.smithi099.stdout: "whoami": 0, 2024-02-21T23:01:12.253 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 4355, 2024-02-21T23:01:12.253 INFO:teuthology.orchestra.run.smithi099.stdout: "want_state": "up:active", 2024-02-21T23:01:12.253 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "up:active", 2024-02-21T23:01:12.253 INFO:teuthology.orchestra.run.smithi099.stdout: "fs_name": "cephfs", 2024-02-21T23:01:12.253 INFO:teuthology.orchestra.run.smithi099.stdout: "rank_uptime": 9.0664848070000001, 2024-02-21T23:01:12.253 INFO:teuthology.orchestra.run.smithi099.stdout: "mdsmap_epoch": 7, 2024-02-21T23:01:12.253 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_epoch": 29, 2024-02-21T23:01:12.253 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_epoch_barrier": 29, 2024-02-21T23:01:12.253 INFO:teuthology.orchestra.run.smithi099.stdout: "uptime": 14.109623539999999 2024-02-21T23:01:12.253 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-02-21T23:01:12.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.261+0000 7f64d3a00640 1 -- 172.21.15.99:0/2619273723 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f64a809ed90 msgr2=0x7f64a80a1250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:12.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.261+0000 7f64d3a00640 1 --2- 172.21.15.99:0/2619273723 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f64a809ed90 0x7f64a80a1250 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f64bc00f5a0 tx=0x7f64bc009040 comp rx=0 tx=0).stop 2024-02-21T23:01:12.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.261+0000 7f64d3a00640 1 -- 172.21.15.99:0/2619273723 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f64b0005300 msgr2=0x7f64cc17b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:12.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.261+0000 7f64d3a00640 1 --2- 172.21.15.99:0/2619273723 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f64b0005300 0x7f64cc17b250 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f64bc004e40 tx=0x7f64bc007430 comp rx=0 tx=0).stop 2024-02-21T23:01:12.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.261+0000 7f64d3a00640 1 -- 172.21.15.99:0/2619273723 shutdown_connections 2024-02-21T23:01:12.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.261+0000 7f64d3a00640 1 --2- 172.21.15.99:0/2619273723 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f64a809ed90 0x7f64a80a1250 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:12.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.261+0000 7f64d3a00640 1 --2- 172.21.15.99:0/2619273723 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f64cc0f88b0 0x7f64cc168790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:12.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.261+0000 7f64d3a00640 1 --2- 172.21.15.99:0/2619273723 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f64cc17b790 0x7f64cc0f8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:12.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.261+0000 7f64d3a00640 1 --2- 172.21.15.99:0/2619273723 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f64b0005300 0x7f64cc17b250 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:12.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.261+0000 7f64d3a00640 1 -- 172.21.15.99:0/2619273723 >> 172.21.15.99:0/2619273723 conn(0x7f64cc0ce5f0 msgr2=0x7f64cc173430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:12.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.261+0000 7f64d3a00640 1 -- 172.21.15.99:0/2619273723 shutdown_connections 2024-02-21T23:01:12.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.261+0000 7f64d3a00640 1 -- 172.21.15.99:0/2619273723 wait complete. 2024-02-21T23:01:12.266 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-02-21T23:01:12.266 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-02-21T23:01:12.267 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-02-21T23:01:12.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.479+0000 7fe6e6200640 1 Processor -- start 2024-02-21T23:01:12.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.479+0000 7fe6e6200640 1 -- start start 2024-02-21T23:01:12.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.481+0000 7fe6e6200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe6e017f5b0 0x7fe6e0187b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:12.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.481+0000 7fe6e6200640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fe6e0188550 0x7fe6e018c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:12.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.482+0000 7fe6e6200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6e0186b20 con 0x7fe6e01880c0 2024-02-21T23:01:12.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.482+0000 7fe6e6200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6e018be10 con 0x7fe6e017f5b0 2024-02-21T23:01:12.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.482+0000 7fe6e6200640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6e017f990 con 0x7fe6e0188550 2024-02-21T23:01:12.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.482+0000 7fe6e4e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe6e017f5b0 0x7fe6e0187b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:12.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.482+0000 7fe6e4e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe6e017f5b0 0x7fe6e0187b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:57744/0 (socket says 172.21.15.99:57744) 2024-02-21T23:01:12.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.482+0000 7fe6e4e00640 1 -- 172.21.15.99:0/2635743860 learned_addr learned my addr 172.21.15.99:0/2635743860 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:12.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.482+0000 7fe6e5800640 1 --2- 172.21.15.99:0/2635743860 >> v2:172.21.15.181:3300/0 conn(0x7fe6e0188550 0x7fe6e018c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:12.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.482+0000 7fe6e4e00640 1 -- 172.21.15.99:0/2635743860 >> v2:172.21.15.181:3300/0 conn(0x7fe6e0188550 msgr2=0x7fe6e018c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:12.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.482+0000 7fe6e4e00640 1 --2- 172.21.15.99:0/2635743860 >> v2:172.21.15.181:3300/0 conn(0x7fe6e0188550 0x7fe6e018c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:12.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.482+0000 7fe6e4e00640 1 -- 172.21.15.99:0/2635743860 >> v1:172.21.15.162:6789/0 conn(0x7fe6e01880c0 legacy=0x7fe6e018c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:12.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.482+0000 7fe6e4e00640 1 -- 172.21.15.99:0/2635743860 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e0186dc0 con 0x7fe6e017f5b0 2024-02-21T23:01:12.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.482+0000 7fe6e5800640 1 --2- 172.21.15.99:0/2635743860 >> v2:172.21.15.181:3300/0 conn(0x7fe6e0188550 0x7fe6e018c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T23:01:12.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.484+0000 7fe6e4e00640 1 --2- 172.21.15.99:0/2635743860 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe6e017f5b0 0x7fe6e0187b80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe6e00d04f0 tx=0x7fe6d402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bed39603eef03a16 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:12.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.484+0000 7fe6df400640 1 -- 172.21.15.99:0/2635743860 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d4034070 con 0x7fe6e017f5b0 2024-02-21T23:01:12.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.484+0000 7fe6df400640 1 -- 172.21.15.99:0/2635743860 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6d4030860 con 0x7fe6e017f5b0 2024-02-21T23:01:12.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.484+0000 7fe6df400640 1 -- 172.21.15.99:0/2635743860 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d4030c30 con 0x7fe6e017f5b0 2024-02-21T23:01:12.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.485+0000 7fe6e6200640 1 -- 172.21.15.99:0/2635743860 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe6e017f5b0 msgr2=0x7fe6e0187b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:12.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.485+0000 7fe6e6200640 1 --2- 172.21.15.99:0/2635743860 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe6e017f5b0 0x7fe6e0187b80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe6e00d04f0 tx=0x7fe6d402b9a0 comp rx=0 tx=0).stop 2024-02-21T23:01:12.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.485+0000 7fe6e6200640 1 -- 172.21.15.99:0/2635743860 shutdown_connections 2024-02-21T23:01:12.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.485+0000 7fe6e6200640 1 --2- 172.21.15.99:0/2635743860 >> v2:172.21.15.181:3300/0 conn(0x7fe6e0188550 0x7fe6e018c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:12.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.485+0000 7fe6e6200640 1 --2- 172.21.15.99:0/2635743860 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe6e017f5b0 0x7fe6e0187b80 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:12.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.485+0000 7fe6e6200640 1 -- 172.21.15.99:0/2635743860 >> 172.21.15.99:0/2635743860 conn(0x7fe6e0066c60 msgr2=0x7fe6e0067070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:12.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.485+0000 7fe6e6200640 1 -- 172.21.15.99:0/2635743860 shutdown_connections 2024-02-21T23:01:12.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.485+0000 7fe6e6200640 1 -- 172.21.15.99:0/2635743860 wait complete. 2024-02-21T23:01:12.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.488+0000 7fe6e6200640 1 Processor -- start 2024-02-21T23:01:12.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.488+0000 7fe6e6200640 1 -- start start 2024-02-21T23:01:12.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.490+0000 7fe6e6200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe6e017f5b0 0x7fe6e0173420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:12.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.490+0000 7fe6e6200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe6e01880c0 0x7fe6e02214b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:12.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.490+0000 7fe6e6200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe6e0188550 0x7fe6e0161460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:12.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.491+0000 7fe6e6200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e0187660 con 0x7fe6e017f5b0 2024-02-21T23:01:12.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.491+0000 7fe6e6200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e0187380 con 0x7fe6e01880c0 2024-02-21T23:01:12.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.491+0000 7fe6e6200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e018cce0 con 0x7fe6e0188550 2024-02-21T23:01:12.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.491+0000 7fe6e4e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe6e017f5b0 0x7fe6e0173420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:12.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.491+0000 7fe6e4e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe6e017f5b0 0x7fe6e0173420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:57752/0 (socket says 172.21.15.99:57752) 2024-02-21T23:01:12.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.491+0000 7fe6e4e00640 1 -- 172.21.15.99:0/2201704652 learned_addr learned my addr 172.21.15.99:0/2201704652 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:12.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.491+0000 7fe6e5800640 1 --2- 172.21.15.99:0/2201704652 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe6e0188550 0x7fe6e0161460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:12.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.491+0000 7fe6dfe00640 1 --2- 172.21.15.99:0/2201704652 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe6e01880c0 0x7fe6e02214b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:12.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.491+0000 7fe6e4e00640 1 -- 172.21.15.99:0/2201704652 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe6e0188550 msgr2=0x7fe6e0161460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:12.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.491+0000 7fe6e4e00640 1 --2- 172.21.15.99:0/2201704652 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe6e0188550 0x7fe6e0161460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:12.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.491+0000 7fe6e4e00640 1 -- 172.21.15.99:0/2201704652 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe6e01880c0 msgr2=0x7fe6e02214b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:12.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.491+0000 7fe6e4e00640 1 --2- 172.21.15.99:0/2201704652 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe6e01880c0 0x7fe6e02214b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:12.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.491+0000 7fe6e4e00640 1 -- 172.21.15.99:0/2201704652 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e021fe50 con 0x7fe6e017f5b0 2024-02-21T23:01:12.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.491+0000 7fe6e5800640 1 --2- 172.21.15.99:0/2201704652 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe6e0188550 0x7fe6e0161460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:01:12.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.491+0000 7fe6e4e00640 1 --2- 172.21.15.99:0/2201704652 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe6e017f5b0 0x7fe6e0173420 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe6d4000c00 tx=0x7fe6d4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:12.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.492+0000 7fe6dcc00640 1 -- 172.21.15.99:0/2201704652 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d4048070 con 0x7fe6e017f5b0 2024-02-21T23:01:12.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.492+0000 7fe6dcc00640 1 -- 172.21.15.99:0/2201704652 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6d4039d90 con 0x7fe6e017f5b0 2024-02-21T23:01:12.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.492+0000 7fe6e6200640 1 -- 172.21.15.99:0/2201704652 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6e0220130 con 0x7fe6e017f5b0 2024-02-21T23:01:12.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.492+0000 7fe6dcc00640 1 -- 172.21.15.99:0/2201704652 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d4034040 con 0x7fe6e017f5b0 2024-02-21T23:01:12.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.492+0000 7fe6e6200640 1 -- 172.21.15.99:0/2201704652 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6e02206f0 con 0x7fe6e017f5b0 2024-02-21T23:01:12.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.493+0000 7fe6e6200640 1 -- 172.21.15.99:0/2201704652 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6e0068280 con 0x7fe6e017f5b0 2024-02-21T23:01:12.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.495+0000 7fe6dcc00640 1 -- 172.21.15.99:0/2201704652 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 134356+0+0 (secure 0 0 0) 0x7fe6d404b070 con 0x7fe6e017f5b0 2024-02-21T23:01:12.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.497+0000 7fe6dcc00640 1 --2- 172.21.15.99:0/2201704652 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fe6c009ed90 0x7fe6c00a1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:12.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.497+0000 7fe6dcc00640 1 -- 172.21.15.99:0/2201704652 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fe6d40ebe20 con 0x7fe6e017f5b0 2024-02-21T23:01:12.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.497+0000 7fe6dfe00640 1 --2- 172.21.15.99:0/2201704652 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fe6c009ed90 0x7fe6c00a1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:12.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.498+0000 7fe6dfe00640 1 --2- 172.21.15.99:0/2201704652 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fe6c009ed90 0x7fe6c00a1250 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe6e01654b0 tx=0x7fe6cc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:12.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.500+0000 7fe6dcc00640 1 -- 172.21.15.99:0/2201704652 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fe6d40ba070 con 0x7fe6e017f5b0 2024-02-21T23:01:12.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.734+0000 7fe6e6200640 1 -- 172.21.15.99:0/2201704652 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe6e00d2030 con 0x7fe6e017f5b0 2024-02-21T23:01:12.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.735+0000 7fe6dcc00640 1 -- 172.21.15.99:0/2201704652 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7fe6d40b9970 con 0x7fe6e017f5b0 2024-02-21T23:01:12.724 INFO:teuthology.orchestra.run.smithi099.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-02-21T23:01:12.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.738+0000 7fe6e6200640 1 -- 172.21.15.99:0/2201704652 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fe6c009ed90 msgr2=0x7fe6c00a1250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:12.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.738+0000 7fe6e6200640 1 --2- 172.21.15.99:0/2201704652 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fe6c009ed90 0x7fe6c00a1250 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe6e01654b0 tx=0x7fe6cc009040 comp rx=0 tx=0).stop 2024-02-21T23:01:12.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.738+0000 7fe6e6200640 1 -- 172.21.15.99:0/2201704652 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe6e017f5b0 msgr2=0x7fe6e0173420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:12.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.738+0000 7fe6e6200640 1 --2- 172.21.15.99:0/2201704652 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe6e017f5b0 0x7fe6e0173420 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe6d4000c00 tx=0x7fe6d4004730 comp rx=0 tx=0).stop 2024-02-21T23:01:12.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.738+0000 7fe6e6200640 1 -- 172.21.15.99:0/2201704652 shutdown_connections 2024-02-21T23:01:12.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.738+0000 7fe6e6200640 1 --2- 172.21.15.99:0/2201704652 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fe6c009ed90 0x7fe6c00a1250 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:12.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.738+0000 7fe6e6200640 1 --2- 172.21.15.99:0/2201704652 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe6e0188550 0x7fe6e0161460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:12.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.738+0000 7fe6e6200640 1 --2- 172.21.15.99:0/2201704652 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe6e01880c0 0x7fe6e02214b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:12.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.738+0000 7fe6e6200640 1 --2- 172.21.15.99:0/2201704652 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe6e017f5b0 0x7fe6e0173420 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:12.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.738+0000 7fe6e6200640 1 -- 172.21.15.99:0/2201704652 >> 172.21.15.99:0/2201704652 conn(0x7fe6e0066c60 msgr2=0x7fe6e0067040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:12.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.738+0000 7fe6e6200640 1 -- 172.21.15.99:0/2201704652 shutdown_connections 2024-02-21T23:01:12.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:12.738+0000 7fe6e6200640 1 -- 172.21.15.99:0/2201704652 wait complete. 2024-02-21T23:01:12.753 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-02-21T23:01:12.754 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-02-21T23:01:12.754 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi099.front.sepia.ceph.com 2024-02-21T23:01:12.754 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-02-21T23:01:12.754 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-02-21T23:01:12.754 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-02-21T23:01:12.754 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-02-21T23:01:12.754 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-02-21T23:01:12.754 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-02-21T23:01:12.754 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T23:01:12.754 DEBUG:teuthology.orchestra.run.smithi099:> ip addr 2024-02-21T23:01:12.802 INFO:teuthology.orchestra.run.smithi099.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-21T23:01:12.802 INFO:teuthology.orchestra.run.smithi099.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-21T23:01:12.803 INFO:teuthology.orchestra.run.smithi099.stdout: inet 127.0.0.1/8 scope host lo 2024-02-21T23:01:12.803 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-02-21T23:01:12.803 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 ::1/128 scope host 2024-02-21T23:01:12.803 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-02-21T23:01:12.803 INFO:teuthology.orchestra.run.smithi099.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-21T23:01:12.803 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:d8:a2:10 brd ff:ff:ff:ff:ff:ff 2024-02-21T23:01:12.803 INFO:teuthology.orchestra.run.smithi099.stdout: altname enp7s0f0 2024-02-21T23:01:12.803 INFO:teuthology.orchestra.run.smithi099.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-21T23:01:12.803 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:d8:a2:11 brd ff:ff:ff:ff:ff:ff 2024-02-21T23:01:12.803 INFO:teuthology.orchestra.run.smithi099.stdout: altname enp7s0f1 2024-02-21T23:01:12.803 INFO:teuthology.orchestra.run.smithi099.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-21T23:01:12.803 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:8f:d8:02 brd ff:ff:ff:ff:ff:ff 2024-02-21T23:01:12.803 INFO:teuthology.orchestra.run.smithi099.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-02-21T23:01:12.804 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:8f:d8:03 brd ff:ff:ff:ff:ff:ff 2024-02-21T23:01:12.804 INFO:teuthology.orchestra.run.smithi099.stdout: inet 172.21.15.99/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-02-21T23:01:12.804 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft 42584sec preferred_lft 42584sec 2024-02-21T23:01:12.804 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 fe80::ec4:7aff:fe8f:d803/64 scope link 2024-02-21T23:01:12.804 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-02-21T23:01:12.805 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-02-21T23:01:12.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T23:01:12.806 DEBUG:teuthology.orchestra.run.smithi099:> (cd / && exec bash -c ' 2024-02-21T23:01:12.806 DEBUG:teuthology.orchestra.run.smithi099:> set -e 2024-02-21T23:01:12.806 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link add name ceph-brx type bridge 2024-02-21T23:01:12.806 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip addr flush dev ceph-brx 2024-02-21T23:01:12.806 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link set ceph-brx up 2024-02-21T23:01:12.806 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-02-21T23:01:12.806 DEBUG:teuthology.orchestra.run.smithi099:> ') 2024-02-21T23:01:13.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T23:01:13.244 DEBUG:teuthology.orchestra.run.smithi099:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-02-21T23:01:13.319 INFO:teuthology.orchestra.run.smithi099.stdout:1 2024-02-21T23:01:13.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T23:01:13.322 DEBUG:teuthology.orchestra.run.smithi099:> route 2024-02-21T23:01:13.379 INFO:teuthology.orchestra.run.smithi099.stdout:Kernel IP routing table 2024-02-21T23:01:13.379 INFO:teuthology.orchestra.run.smithi099.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-02-21T23:01:13.379 INFO:teuthology.orchestra.run.smithi099.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-02-21T23:01:13.379 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-02-21T23:01:13.379 INFO:teuthology.orchestra.run.smithi099.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-02-21T23:01:13.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T23:01:13.380 DEBUG:teuthology.orchestra.run.smithi099:> (cd / && exec bash -c ' 2024-02-21T23:01:13.380 DEBUG:teuthology.orchestra.run.smithi099:> set -e 2024-02-21T23:01:13.380 DEBUG:teuthology.orchestra.run.smithi099:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-02-21T23:01:13.380 DEBUG:teuthology.orchestra.run.smithi099:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-02-21T23:01:13.381 DEBUG:teuthology.orchestra.run.smithi099:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-02-21T23:01:13.381 DEBUG:teuthology.orchestra.run.smithi099:> ') 2024-02-21T23:01:14.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T23:01:14.077 DEBUG:teuthology.orchestra.run.smithi099:> ip netns list 2024-02-21T23:01:14.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T23:01:14.130 DEBUG:teuthology.orchestra.run.smithi099:> ip netns list-id 2024-02-21T23:01:14.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T23:01:14.177 DEBUG:teuthology.orchestra.run.smithi099:> (cd / && exec bash -c ' 2024-02-21T23:01:14.177 DEBUG:teuthology.orchestra.run.smithi099:> set -e 2024-02-21T23:01:14.177 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-02-21T23:01:14.177 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-02-21T23:01:14.178 DEBUG:teuthology.orchestra.run.smithi099:> ') 2024-02-21T23:01:14.310 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-02-21T23:01:14.310 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T23:01:14.310 DEBUG:teuthology.orchestra.run.smithi099:> (cd / && exec bash -c ' 2024-02-21T23:01:14.310 DEBUG:teuthology.orchestra.run.smithi099:> set -e 2024-02-21T23:01:14.310 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-02-21T23:01:14.310 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-02-21T23:01:14.310 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-02-21T23:01:14.311 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-02-21T23:01:14.311 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-02-21T23:01:14.311 DEBUG:teuthology.orchestra.run.smithi099:> ') 2024-02-21T23:01:14.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T23:01:14.592 DEBUG:teuthology.orchestra.run.smithi099:> (cd / && exec bash -c ' 2024-02-21T23:01:14.592 DEBUG:teuthology.orchestra.run.smithi099:> set -e 2024-02-21T23:01:14.592 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link set brx.0 up 2024-02-21T23:01:14.592 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link set dev brx.0 master ceph-brx 2024-02-21T23:01:14.592 DEBUG:teuthology.orchestra.run.smithi099:> ') 2024-02-21T23:01:14.754 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-02-21T23:01:14.754 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-21T23:01:14.755 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-02-21T23:01:14.801 INFO:teuthology.orchestra.run.smithi099.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-02-21T23:01:14.801 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-21T23:01:14.801 DEBUG:teuthology.orchestra.run.smithi099:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-02-21T23:01:14.893 DEBUG:teuthology.orchestra.run.smithi099:> sudo modprobe fuse 2024-02-21T23:01:14.981 DEBUG:teuthology.orchestra.run.smithi099:> cat /proc/self/mounts | awk '{print $2}' 2024-02-21T23:01:15.028 INFO:teuthology.orchestra.run.smithi099.stdout:/proc 2024-02-21T23:01:15.028 INFO:teuthology.orchestra.run.smithi099.stdout:/sys 2024-02-21T23:01:15.028 INFO:teuthology.orchestra.run.smithi099.stdout:/dev 2024-02-21T23:01:15.028 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/kernel/security 2024-02-21T23:01:15.028 INFO:teuthology.orchestra.run.smithi099.stdout:/dev/shm 2024-02-21T23:01:15.028 INFO:teuthology.orchestra.run.smithi099.stdout:/dev/pts 2024-02-21T23:01:15.028 INFO:teuthology.orchestra.run.smithi099.stdout:/run 2024-02-21T23:01:15.028 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/fs/cgroup 2024-02-21T23:01:15.028 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/fs/pstore 2024-02-21T23:01:15.028 INFO:teuthology.orchestra.run.smithi099.stdout:/ 2024-02-21T23:01:15.029 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/fs/selinux 2024-02-21T23:01:15.029 INFO:teuthology.orchestra.run.smithi099.stdout:/proc/sys/fs/binfmt_misc 2024-02-21T23:01:15.029 INFO:teuthology.orchestra.run.smithi099.stdout:/dev/hugepages 2024-02-21T23:01:15.029 INFO:teuthology.orchestra.run.smithi099.stdout:/dev/mqueue 2024-02-21T23:01:15.029 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/kernel/debug 2024-02-21T23:01:15.029 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/kernel/tracing 2024-02-21T23:01:15.029 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/fs/fuse/connections 2024-02-21T23:01:15.029 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/kernel/config 2024-02-21T23:01:15.029 INFO:teuthology.orchestra.run.smithi099.stdout:/run/credentials/systemd-sysctl.service 2024-02-21T23:01:15.029 INFO:teuthology.orchestra.run.smithi099.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-02-21T23:01:15.029 INFO:teuthology.orchestra.run.smithi099.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-02-21T23:01:15.029 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/nfs/rpc_pipefs 2024-02-21T23:01:15.029 INFO:teuthology.orchestra.run.smithi099.stdout:/run/user/1000 2024-02-21T23:01:15.029 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/ceph 2024-02-21T23:01:15.029 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/ceph/osd/ceph-0 2024-02-21T23:01:15.030 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/ceph/osd/ceph-3 2024-02-21T23:01:15.030 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/ceph/osd/ceph-6 2024-02-21T23:01:15.030 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/ceph/osd/ceph-9 2024-02-21T23:01:15.030 INFO:teuthology.orchestra.run.smithi099.stdout:/run/netns 2024-02-21T23:01:15.030 INFO:teuthology.orchestra.run.smithi099.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-02-21T23:01:15.030 INFO:teuthology.orchestra.run.smithi099.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-02-21T23:01:15.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T23:01:15.031 DEBUG:teuthology.orchestra.run.smithi099:> ls /sys/fs/fuse/connections 2024-02-21T23:01:15.120 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-02-21T23:01:15.120 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-02-21T23:01:15.124 DEBUG:teuthology.orchestra.run.smithi099:> sudo modprobe fuse 2024-02-21T23:01:15.201 DEBUG:teuthology.orchestra.run.smithi099:> cat /proc/self/mounts | awk '{print $2}' 2024-02-21T23:01:15.244 INFO:teuthology.orchestra.run.smithi099.stdout:/proc 2024-02-21T23:01:15.244 INFO:teuthology.orchestra.run.smithi099.stdout:/sys 2024-02-21T23:01:15.244 INFO:teuthology.orchestra.run.smithi099.stdout:/dev 2024-02-21T23:01:15.244 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/kernel/security 2024-02-21T23:01:15.244 INFO:teuthology.orchestra.run.smithi099.stdout:/dev/shm 2024-02-21T23:01:15.244 INFO:teuthology.orchestra.run.smithi099.stdout:/dev/pts 2024-02-21T23:01:15.244 INFO:teuthology.orchestra.run.smithi099.stdout:/run 2024-02-21T23:01:15.244 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/fs/cgroup 2024-02-21T23:01:15.245 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/fs/pstore 2024-02-21T23:01:15.245 INFO:teuthology.orchestra.run.smithi099.stdout:/ 2024-02-21T23:01:15.245 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/fs/selinux 2024-02-21T23:01:15.245 INFO:teuthology.orchestra.run.smithi099.stdout:/proc/sys/fs/binfmt_misc 2024-02-21T23:01:15.245 INFO:teuthology.orchestra.run.smithi099.stdout:/dev/hugepages 2024-02-21T23:01:15.245 INFO:teuthology.orchestra.run.smithi099.stdout:/dev/mqueue 2024-02-21T23:01:15.245 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/kernel/debug 2024-02-21T23:01:15.245 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/kernel/tracing 2024-02-21T23:01:15.245 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/fs/fuse/connections 2024-02-21T23:01:15.245 INFO:teuthology.orchestra.run.smithi099.stdout:/sys/kernel/config 2024-02-21T23:01:15.245 INFO:teuthology.orchestra.run.smithi099.stdout:/run/credentials/systemd-sysctl.service 2024-02-21T23:01:15.245 INFO:teuthology.orchestra.run.smithi099.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-02-21T23:01:15.245 INFO:teuthology.orchestra.run.smithi099.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-02-21T23:01:15.245 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/nfs/rpc_pipefs 2024-02-21T23:01:15.245 INFO:teuthology.orchestra.run.smithi099.stdout:/run/user/1000 2024-02-21T23:01:15.246 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/ceph 2024-02-21T23:01:15.246 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/ceph/osd/ceph-0 2024-02-21T23:01:15.246 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/ceph/osd/ceph-3 2024-02-21T23:01:15.246 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/ceph/osd/ceph-6 2024-02-21T23:01:15.246 INFO:teuthology.orchestra.run.smithi099.stdout:/var/lib/ceph/osd/ceph-9 2024-02-21T23:01:15.246 INFO:teuthology.orchestra.run.smithi099.stdout:/run/netns 2024-02-21T23:01:15.246 INFO:teuthology.orchestra.run.smithi099.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-02-21T23:01:15.246 INFO:teuthology.orchestra.run.smithi099.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-02-21T23:01:15.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T23:01:15.247 DEBUG:teuthology.orchestra.run.smithi099:> ls /sys/fs/fuse/connections 2024-02-21T23:01:15.315 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi099.stderr:2024-02-21T23:01:15.326+0000 7f0f6f445480 -1 init, newargv = 0x560bbea20d80 newargc=15 2024-02-21T23:01:15.315 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi099.stderr:ceph-fuse[42246]: starting ceph client 2024-02-21T23:01:15.327 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi099.stderr:ceph-fuse[42246]: starting fuse 2024-02-21T23:01:15.333 INFO:teuthology.orchestra.run.smithi099.stdout:39 2024-02-21T23:01:15.334 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [39] 2024-02-21T23:01:15.334 DEBUG:teuthology.orchestra.run.smithi099:> sudo stdin-killer -- python3 -c ' 2024-02-21T23:01:15.334 DEBUG:teuthology.orchestra.run.smithi099:> import glob 2024-02-21T23:01:15.334 DEBUG:teuthology.orchestra.run.smithi099:> import re 2024-02-21T23:01:15.334 DEBUG:teuthology.orchestra.run.smithi099:> import os 2024-02-21T23:01:15.334 DEBUG:teuthology.orchestra.run.smithi099:> import subprocess 2024-02-21T23:01:15.335 DEBUG:teuthology.orchestra.run.smithi099:> 2024-02-21T23:01:15.335 DEBUG:teuthology.orchestra.run.smithi099:> def _find_admin_socket(client_name): 2024-02-21T23:01:15.335 DEBUG:teuthology.orchestra.run.smithi099:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-02-21T23:01:15.335 DEBUG:teuthology.orchestra.run.smithi099:> files = glob.glob(asok_path) 2024-02-21T23:01:15.335 DEBUG:teuthology.orchestra.run.smithi099:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-02-21T23:01:15.335 DEBUG:teuthology.orchestra.run.smithi099:> 2024-02-21T23:01:15.335 DEBUG:teuthology.orchestra.run.smithi099:> # Given a non-glob path, it better be there 2024-02-21T23:01:15.335 DEBUG:teuthology.orchestra.run.smithi099:> if "*" not in asok_path: 2024-02-21T23:01:15.335 DEBUG:teuthology.orchestra.run.smithi099:> assert(len(files) == 1) 2024-02-21T23:01:15.335 DEBUG:teuthology.orchestra.run.smithi099:> return files[0] 2024-02-21T23:01:15.335 DEBUG:teuthology.orchestra.run.smithi099:> 2024-02-21T23:01:15.335 DEBUG:teuthology.orchestra.run.smithi099:> for f in files: 2024-02-21T23:01:15.335 DEBUG:teuthology.orchestra.run.smithi099:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-02-21T23:01:15.335 DEBUG:teuthology.orchestra.run.smithi099:> if os.path.exists("/proc/{0}".format(pid)): 2024-02-21T23:01:15.336 DEBUG:teuthology.orchestra.run.smithi099:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-02-21T23:01:15.336 DEBUG:teuthology.orchestra.run.smithi099:> contents = proc_f.read() 2024-02-21T23:01:15.336 DEBUG:teuthology.orchestra.run.smithi099:> if mountpoint in contents: 2024-02-21T23:01:15.336 DEBUG:teuthology.orchestra.run.smithi099:> return f 2024-02-21T23:01:15.336 DEBUG:teuthology.orchestra.run.smithi099:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-02-21T23:01:15.336 DEBUG:teuthology.orchestra.run.smithi099:> 2024-02-21T23:01:15.336 DEBUG:teuthology.orchestra.run.smithi099:> print(_find_admin_socket("client.admin")) 2024-02-21T23:01:15.336 DEBUG:teuthology.orchestra.run.smithi099:> ' 2024-02-21T23:01:15.524 INFO:teuthology.orchestra.run.smithi099.stdout:/var/run/ceph/ceph-client.admin.42246.asok 2024-02-21T23:01:15.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-02-21T23:01:15.540 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.42246.asok 2024-02-21T23:01:15.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T23:01:15.541 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.42246.asok status 2024-02-21T23:01:15.767 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-02-21T23:01:15.767 INFO:teuthology.orchestra.run.smithi099.stdout: "metadata": { 2024-02-21T23:01:15.767 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_sha1": "3bfc837d7b45ce8e095d92fa9c342964cea5e95f", 2024-02-21T23:01:15.768 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_version": "ceph version 19.0.0-1643-g3bfc837d (3bfc837d7b45ce8e095d92fa9c342964cea5e95f) squid (dev)", 2024-02-21T23:01:15.768 INFO:teuthology.orchestra.run.smithi099.stdout: "entity_id": "admin", 2024-02-21T23:01:15.768 INFO:teuthology.orchestra.run.smithi099.stdout: "hostname": "smithi099", 2024-02-21T23:01:15.768 INFO:teuthology.orchestra.run.smithi099.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-02-21T23:01:15.768 INFO:teuthology.orchestra.run.smithi099.stdout: "pid": "42246", 2024-02-21T23:01:15.768 INFO:teuthology.orchestra.run.smithi099.stdout: "root": "/" 2024-02-21T23:01:15.768 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:01:15.768 INFO:teuthology.orchestra.run.smithi099.stdout: "dentry_count": 0, 2024-02-21T23:01:15.768 INFO:teuthology.orchestra.run.smithi099.stdout: "dentry_pinned_count": 0, 2024-02-21T23:01:15.768 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 4484, 2024-02-21T23:01:15.768 INFO:teuthology.orchestra.run.smithi099.stdout: "inst": { 2024-02-21T23:01:15.768 INFO:teuthology.orchestra.run.smithi099.stdout: "name": { 2024-02-21T23:01:15.769 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "client", 2024-02-21T23:01:15.769 INFO:teuthology.orchestra.run.smithi099.stdout: "num": 4484 2024-02-21T23:01:15.769 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:01:15.769 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": { 2024-02-21T23:01:15.769 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-02-21T23:01:15.769 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:0", 2024-02-21T23:01:15.769 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2174142442 2024-02-21T23:01:15.769 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:01:15.769 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:01:15.769 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": { 2024-02-21T23:01:15.769 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-02-21T23:01:15.769 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:0", 2024-02-21T23:01:15.769 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2174142442 2024-02-21T23:01:15.769 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:01:15.769 INFO:teuthology.orchestra.run.smithi099.stdout: "inst_str": "client.4484 172.21.15.99:0/2174142442", 2024-02-21T23:01:15.770 INFO:teuthology.orchestra.run.smithi099.stdout: "addr_str": "172.21.15.99:0/2174142442", 2024-02-21T23:01:15.770 INFO:teuthology.orchestra.run.smithi099.stdout: "inode_count": 1, 2024-02-21T23:01:15.770 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_epoch": 7, 2024-02-21T23:01:15.770 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_epoch": 29, 2024-02-21T23:01:15.770 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_epoch_barrier": 0, 2024-02-21T23:01:15.770 INFO:teuthology.orchestra.run.smithi099.stdout: "blocklisted": false, 2024-02-21T23:01:15.770 INFO:teuthology.orchestra.run.smithi099.stdout: "fs_name": "cephfs" 2024-02-21T23:01:15.770 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-02-21T23:01:15.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T23:01:15.783 DEBUG:teuthology.orchestra.run.smithi099:> stat --file-system '--printf=%T 2024-02-21T23:01:15.783 DEBUG:teuthology.orchestra.run.smithi099:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-02-21T23:01:15.832 INFO:teuthology.orchestra.run.smithi099.stdout:fuseblk 2024-02-21T23:01:15.832 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-02-21T23:01:15.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T23:01:15.832 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-02-21T23:01:15.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T23:01:15.910 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-02-21T23:01:15.992 INFO:teuthology.orchestra.run.smithi099.stdout:# file: . 2024-02-21T23:01:15.992 INFO:teuthology.orchestra.run.smithi099.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-02-21T23:01:15.992 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T23:01:15.993 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-02-21T23:01:15.993 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-21T23:01:16.039 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T23:01:16.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.295+0000 7fb59c200640 1 Processor -- start 2024-02-21T23:01:16.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.296+0000 7fb59c200640 1 -- start start 2024-02-21T23:01:16.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.298+0000 7fb59c200640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fb59418c140 0x7fb594188530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:16.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.298+0000 7fb59c200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb59418cc30 0x7fb594070890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:16.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.298+0000 7fb59c200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb594186ed0 con 0x7fb5940fa230 2024-02-21T23:01:16.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.298+0000 7fb59c200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb59418d060 con 0x7fb59418cc30 2024-02-21T23:01:16.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.298+0000 7fb59c200640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5941871b0 con 0x7fb59418c140 2024-02-21T23:01:16.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.299+0000 7fb599800640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fb59418c140 0x7fb594188530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:16.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.299+0000 7fb599800640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fb59418c140 0x7fb594188530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:59868/0 (socket says 172.21.15.99:59868) 2024-02-21T23:01:16.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.299+0000 7fb599800640 1 -- 172.21.15.99:0/1626925899 learned_addr learned my addr 172.21.15.99:0/1626925899 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:16.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.299+0000 7fb59a200640 1 --2- 172.21.15.99:0/1626925899 >> v2:172.21.15.162:3300/0 conn(0x7fb59418cc30 0x7fb594070890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:16.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.299+0000 7fb599800640 1 -- 172.21.15.99:0/1626925899 >> v2:172.21.15.162:3300/0 conn(0x7fb59418cc30 msgr2=0x7fb594070890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:16.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.299+0000 7fb599800640 1 --2- 172.21.15.99:0/1626925899 >> v2:172.21.15.162:3300/0 conn(0x7fb59418cc30 0x7fb594070890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:16.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.299+0000 7fb599800640 1 -- 172.21.15.99:0/1626925899 >> v1:172.21.15.162:6789/0 conn(0x7fb5940fa230 legacy=0x7fb59418c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:16.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.299+0000 7fb599800640 1 -- 172.21.15.99:0/1626925899 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb594187490 con 0x7fb59418c140 2024-02-21T23:01:16.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.300+0000 7fb599800640 1 --2- 172.21.15.99:0/1626925899 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb59418c140 0x7fb594188530 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb5940d18c0 tx=0x7fb58802b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80858d5dfdf4468c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:16.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.301+0000 7fb593e00640 1 -- 172.21.15.99:0/1626925899 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb588035020 con 0x7fb59418c140 2024-02-21T23:01:16.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.301+0000 7fb593e00640 1 -- 172.21.15.99:0/1626925899 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb588031800 con 0x7fb59418c140 2024-02-21T23:01:16.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.301+0000 7fb593e00640 1 -- 172.21.15.99:0/1626925899 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb588031bd0 con 0x7fb59418c140 2024-02-21T23:01:16.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.301+0000 7fb59c200640 1 -- 172.21.15.99:0/1626925899 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb59418c140 msgr2=0x7fb594188530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:16.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.301+0000 7fb59c200640 1 --2- 172.21.15.99:0/1626925899 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb59418c140 0x7fb594188530 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb5940d18c0 tx=0x7fb58802b8a0 comp rx=0 tx=0).stop 2024-02-21T23:01:16.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.302+0000 7fb59c200640 1 -- 172.21.15.99:0/1626925899 shutdown_connections 2024-02-21T23:01:16.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.302+0000 7fb59c200640 1 --2- 172.21.15.99:0/1626925899 >> v2:172.21.15.162:3300/0 conn(0x7fb59418cc30 0x7fb594070890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:16.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.302+0000 7fb59c200640 1 --2- 172.21.15.99:0/1626925899 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb59418c140 0x7fb594188530 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:16.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.302+0000 7fb59c200640 1 -- 172.21.15.99:0/1626925899 >> 172.21.15.99:0/1626925899 conn(0x7fb5940f8db0 msgr2=0x7fb5940f9190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:16.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.302+0000 7fb59c200640 1 -- 172.21.15.99:0/1626925899 shutdown_connections 2024-02-21T23:01:16.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.302+0000 7fb59c200640 1 -- 172.21.15.99:0/1626925899 wait complete. 2024-02-21T23:01:16.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.304+0000 7fb59c200640 1 Processor -- start 2024-02-21T23:01:16.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.304+0000 7fb59c200640 1 -- start start 2024-02-21T23:01:16.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.305+0000 7fb59c200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb5940fa230 0x7fb5941588c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:16.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.305+0000 7fb59c200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb59418c140 0x7fb5940f7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:16.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.305+0000 7fb59c200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb59418cc30 0x7fb5940f7a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:16.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.305+0000 7fb59c200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb594187d30 con 0x7fb59418cc30 2024-02-21T23:01:16.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.305+0000 7fb59c200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb594187a50 con 0x7fb59418c140 2024-02-21T23:01:16.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.305+0000 7fb59c200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb594186ac0 con 0x7fb5940fa230 2024-02-21T23:01:16.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.305+0000 7fb59a200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb59418cc30 0x7fb5940f7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:16.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.305+0000 7fb598e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb59418c140 0x7fb5940f7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:16.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.305+0000 7fb59a200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb59418cc30 0x7fb5940f7a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:57768/0 (socket says 172.21.15.99:57768) 2024-02-21T23:01:16.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.305+0000 7fb59a200640 1 -- 172.21.15.99:0/3843309702 learned_addr learned my addr 172.21.15.99:0/3843309702 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:16.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.305+0000 7fb599800640 1 --2- 172.21.15.99:0/3843309702 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb5940fa230 0x7fb5941588c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:16.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.306+0000 7fb59a200640 1 -- 172.21.15.99:0/3843309702 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb5940fa230 msgr2=0x7fb5941588c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:16.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.306+0000 7fb59a200640 1 --2- 172.21.15.99:0/3843309702 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb5940fa230 0x7fb5941588c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:16.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.306+0000 7fb59a200640 1 -- 172.21.15.99:0/3843309702 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb59418c140 msgr2=0x7fb5940f7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:16.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.306+0000 7fb59a200640 1 --2- 172.21.15.99:0/3843309702 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb59418c140 0x7fb5940f7500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:16.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.306+0000 7fb59a200640 1 -- 172.21.15.99:0/3843309702 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb594178db0 con 0x7fb59418cc30 2024-02-21T23:01:16.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.306+0000 7fb598e00640 1 --2- 172.21.15.99:0/3843309702 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb59418c140 0x7fb5940f7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:01:16.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.306+0000 7fb59a200640 1 --2- 172.21.15.99:0/3843309702 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb59418cc30 0x7fb5940f7a40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb58c009dd0 tx=0x7fb58c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:16.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.306+0000 7fb591600640 1 -- 172.21.15.99:0/3843309702 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58c018020 con 0x7fb59418cc30 2024-02-21T23:01:16.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.306+0000 7fb591600640 1 -- 172.21.15.99:0/3843309702 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb58c014480 con 0x7fb59418cc30 2024-02-21T23:01:16.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.306+0000 7fb591600640 1 -- 172.21.15.99:0/3843309702 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58c014870 con 0x7fb59418cc30 2024-02-21T23:01:16.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.306+0000 7fb59c200640 1 -- 172.21.15.99:0/3843309702 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb594179700 con 0x7fb59418cc30 2024-02-21T23:01:16.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.307+0000 7fb59c200640 1 -- 172.21.15.99:0/3843309702 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb594179cc0 con 0x7fb59418cc30 2024-02-21T23:01:16.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.308+0000 7fb59c200640 1 -- 172.21.15.99:0/3843309702 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5940672b0 con 0x7fb59418cc30 2024-02-21T23:01:16.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.309+0000 7fb591600640 1 -- 172.21.15.99:0/3843309702 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 134356+0+0 (secure 0 0 0) 0x7fb58c005d10 con 0x7fb59418cc30 2024-02-21T23:01:16.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.311+0000 7fb591600640 1 --2- 172.21.15.99:0/3843309702 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fb57409ed60 0x7fb5740a1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:16.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.311+0000 7fb591600640 1 -- 172.21.15.99:0/3843309702 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fb58c0ca8c0 con 0x7fb59418cc30 2024-02-21T23:01:16.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.311+0000 7fb599800640 1 --2- 172.21.15.99:0/3843309702 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fb57409ed60 0x7fb5740a1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:16.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.312+0000 7fb599800640 1 --2- 172.21.15.99:0/3843309702 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fb57409ed60 0x7fb5740a1220 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb588036000 tx=0x7fb58803c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:16.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.315+0000 7fb591600640 1 -- 172.21.15.99:0/3843309702 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fb58c022030 con 0x7fb59418cc30 2024-02-21T23:01:16.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.512+0000 7fb59c200640 1 -- 172.21.15.99:0/3843309702 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb594072030 con 0x7fb59418cc30 2024-02-21T23:01:16.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.514+0000 7fb591600640 1 -- 172.21.15.99:0/3843309702 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+23570 (secure 0 0 0) 0x7fb58c010040 con 0x7fb59418cc30 2024-02-21T23:01:16.504 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T23:01:16.504 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":29,"fsid":"e8af98cd-45a1-425f-96a7-f24da8ee4efb","created":"2024-02-21T23:00:44.699708+0000","modified":"2024-02-21T23:01:07.722511+0000","last_up_change":"2024-02-21T23:00:55.749829+0000","last_in_change":"2024-02-21T23:00:48.332297+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T23:00:57.020557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":11.760000228881836,"score_stable":11.760000228881836,"optimal_score":0.17000000178813934,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-21T23:01:01.124398+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-21T23:01:01.684258+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-21T23:01:05.290089+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c49de9b2-dc53-4882-b14c-7059ed40bf59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6809","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6811","nonce":1026112937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6813","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6815","nonce":1026112937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6823","nonce":1026112937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6819","nonce":1026112937}]},"public_addr":"172.21.15.99:6811/1026112937","cluster_addr":"172.21.15.99:6815/1026112937","heartbeat_back_addr":"172.21.15.99:6823/1026112937","heartbeat_front_addr":"172.21.15.99:6819/1026112937","state":["exists","up"]},{"osd":1,"uuid":"58398292-2fe5-4291-94fd-03a0ca29d49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6827","nonce":3030871566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6829","nonce":3030871566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6833","nonce":3030871566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6831","nonce":3030871566}]},"public_addr":"172.21.15.162:6827/3030871566","cluster_addr":"172.21.15.162:6829/3030871566","heartbeat_back_addr":"172.21.15.162:6833/3030871566","heartbeat_front_addr":"172.21.15.162:6831/3030871566","state":["exists","up"]},{"osd":2,"uuid":"94cddec1-e08f-438d-a7c8-48a0e47d71a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6818","nonce":2782386148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6821","nonce":2782386148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6827","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6829","nonce":2782386148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6823","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6825","nonce":2782386148}]},"public_addr":"172.21.15.181:6818/2782386148","cluster_addr":"172.21.15.181:6821/2782386148","heartbeat_back_addr":"172.21.15.181:6829/2782386148","heartbeat_front_addr":"172.21.15.181:6825/2782386148","state":["exists","up"]},{"osd":3,"uuid":"d29abb74-9b89-4fd7-88b1-7c2eb8231189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6801","nonce":2316185310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6803","nonce":2316185310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6807","nonce":2316185310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6805","nonce":2316185310}]},"public_addr":"172.21.15.99:6801/2316185310","cluster_addr":"172.21.15.99:6803/2316185310","heartbeat_back_addr":"172.21.15.99:6807/2316185310","heartbeat_front_addr":"172.21.15.99:6805/2316185310","state":["exists","up"]},{"osd":4,"uuid":"0d8c9ea3-880a-4d69-9dcb-cf7d35abd449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6811","nonce":3137681258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6813","nonce":3137681258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6817","nonce":3137681258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6815","nonce":3137681258}]},"public_addr":"172.21.15.162:6811/3137681258","cluster_addr":"172.21.15.162:6813/3137681258","heartbeat_back_addr":"172.21.15.162:6817/3137681258","heartbeat_front_addr":"172.21.15.162:6815/3137681258","state":["exists","up"]},{"osd":5,"uuid":"2e3a9340-6fd0-4d7a-8e00-fe305649296e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6801","nonce":2011264527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6803","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6805","nonce":2011264527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6811","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6813","nonce":2011264527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6807","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6809","nonce":2011264527}]},"public_addr":"172.21.15.181:6801/2011264527","cluster_addr":"172.21.15.181:6805/2011264527","heartbeat_back_addr":"172.21.15.181:6813/2011264527","heartbeat_front_addr":"172.21.15.181:6809/2011264527","state":["exists","up"]},{"osd":6,"uuid":"d9e37ce7-1b0e-4019-8f2e-b670403abf7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6810","nonce":753870050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6814","nonce":753870050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6822","nonce":753870050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6818","nonce":753870050}]},"public_addr":"172.21.15.99:6810/753870050","cluster_addr":"172.21.15.99:6814/753870050","heartbeat_back_addr":"172.21.15.99:6822/753870050","heartbeat_front_addr":"172.21.15.99:6818/753870050","state":["exists","up"]},{"osd":7,"uuid":"49988754-232e-4b8c-bd72-bfa25b418e5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6803","nonce":1659412949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6805","nonce":1659412949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6809","nonce":1659412949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6807","nonce":1659412949}]},"public_addr":"172.21.15.162:6803/1659412949","cluster_addr":"172.21.15.162:6805/1659412949","heartbeat_back_addr":"172.21.15.162:6809/1659412949","heartbeat_front_addr":"172.21.15.162:6807/1659412949","state":["exists","up"]},{"osd":8,"uuid":"ebc6e462-8368-4d64-b242-9c8735ac672c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6804","nonce":3389807042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6808","nonce":3389807042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6815","nonce":3389807042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6812","nonce":3389807042}]},"public_addr":"172.21.15.181:6804/3389807042","cluster_addr":"172.21.15.181:6808/3389807042","heartbeat_back_addr":"172.21.15.181:6815/3389807042","heartbeat_front_addr":"172.21.15.181:6812/3389807042","state":["exists","up"]},{"osd":9,"uuid":"72af1b02-b965-4d6a-8964-527ec24c4daa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6825","nonce":4055669590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6827","nonce":4055669590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6831","nonce":4055669590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6829","nonce":4055669590}]},"public_addr":"172.21.15.99:6825/4055669590","cluster_addr":"172.21.15.99:6827/4055669590","heartbeat_back_addr":"172.21.15.99:6831/4055669590","heartbeat_front_addr":"172.21.15.99:6829/4055669590","state":["exists","up"]},{"osd":10,"uuid":"adb5cb06-6453-41e4-b847-d7c78bbb7d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6819","nonce":1421879617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6821","nonce":1421879617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6825","nonce":1421879617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6823","nonce":1421879617}]},"public_addr":"172.21.15.162:6819/1421879617","cluster_addr":"172.21.15.162:6821/1421879617","heartbeat_back_addr":"172.21.15.162:6825/1421879617","heartbeat_front_addr":"172.21.15.162:6823/1421879617","state":["exists","up"]},{"osd":11,"uuid":"118563d9-1e8f-4dc7-a92c-2f4c4dc3e20f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6817","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6819","nonce":3219928272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6824","nonce":3219928272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6831","nonce":3219928272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6828","nonce":3219928272}]},"public_addr":"172.21.15.181:6819/3219928272","cluster_addr":"172.21.15.181:6824/3219928272","heartbeat_back_addr":"172.21.15.181:6831/3219928272","heartbeat_front_addr":"172.21.15.181:6828/3219928272","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.651219+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.549859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.529659+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.591004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.440836+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.414250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.630130+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.411954+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.439371+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.428173+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.511203+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.482806+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T23:01:16.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.517+0000 7fb59c200640 1 -- 172.21.15.99:0/3843309702 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fb57409ed60 msgr2=0x7fb5740a1220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:16.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.517+0000 7fb59c200640 1 --2- 172.21.15.99:0/3843309702 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fb57409ed60 0x7fb5740a1220 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb588036000 tx=0x7fb58803c040 comp rx=0 tx=0).stop 2024-02-21T23:01:16.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.517+0000 7fb59c200640 1 -- 172.21.15.99:0/3843309702 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb59418cc30 msgr2=0x7fb5940f7a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:16.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.517+0000 7fb59c200640 1 --2- 172.21.15.99:0/3843309702 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb59418cc30 0x7fb5940f7a40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb58c009dd0 tx=0x7fb58c00c490 comp rx=0 tx=0).stop 2024-02-21T23:01:16.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.517+0000 7fb59c200640 1 -- 172.21.15.99:0/3843309702 shutdown_connections 2024-02-21T23:01:16.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.517+0000 7fb59c200640 1 --2- 172.21.15.99:0/3843309702 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fb57409ed60 0x7fb5740a1220 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:16.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.517+0000 7fb59c200640 1 --2- 172.21.15.99:0/3843309702 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb59418cc30 0x7fb5940f7a40 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:16.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.517+0000 7fb59c200640 1 --2- 172.21.15.99:0/3843309702 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb59418c140 0x7fb5940f7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:16.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.517+0000 7fb59c200640 1 --2- 172.21.15.99:0/3843309702 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb5940fa230 0x7fb5941588c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:16.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.517+0000 7fb59c200640 1 -- 172.21.15.99:0/3843309702 >> 172.21.15.99:0/3843309702 conn(0x7fb5940f8db0 msgr2=0x7fb594185700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:16.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.517+0000 7fb59c200640 1 -- 172.21.15.99:0/3843309702 shutdown_connections 2024-02-21T23:01:16.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.517+0000 7fb59c200640 1 -- 172.21.15.99:0/3843309702 wait complete. 2024-02-21T23:01:16.526 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-21T23:00:57.020557+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 11.760000228881836, 'score_stable': 11.760000228881836, 'optimal_score': 0.17000000178813934, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-21T23:01:01.124398+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-21T23:01:01.684258+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-02-21T23:01:05.290089+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-02-21T23:01:16.527 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-21T23:01:16.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.746+0000 7f697ca00640 1 Processor -- start 2024-02-21T23:01:16.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.746+0000 7f697ca00640 1 -- start start 2024-02-21T23:01:16.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.748+0000 7f697ca00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6978186400 0x7f6978187ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:16.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.748+0000 7f697ca00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f69780d4320 0x7f69780d4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:16.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.748+0000 7f697ca00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6978188720 con 0x7f69781867e0 2024-02-21T23:01:16.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.748+0000 7f697ca00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6978187640 con 0x7f6978186400 2024-02-21T23:01:16.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.748+0000 7f697ca00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69780cf820 con 0x7f69780d4320 2024-02-21T23:01:16.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.748+0000 7f6975e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6978186400 0x7f6978187ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:16.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.748+0000 7f6975400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f69781867e0 0x7f6978188010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:36104/0 (socket says 172.21.15.99:36104) 2024-02-21T23:01:16.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.748+0000 7f6975400640 1 -- 172.21.15.99:0/2139116671 learned_addr learned my addr 172.21.15.99:0/2139116671 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:01:16.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.748+0000 7f6976800640 1 --2- 172.21.15.99:0/2139116671 >> v2:172.21.15.162:3300/0 conn(0x7f69780d4320 0x7f69780d4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:16.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.749+0000 7f6975e00640 1 -- 172.21.15.99:0/2139116671 >> v2:172.21.15.162:3300/0 conn(0x7f69780d4320 msgr2=0x7f69780d4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:16.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.749+0000 7f6975e00640 1 --2- 172.21.15.99:0/2139116671 >> v2:172.21.15.162:3300/0 conn(0x7f69780d4320 0x7f69780d4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:16.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.749+0000 7f6975e00640 1 -- 172.21.15.99:0/2139116671 >> v1:172.21.15.99:6789/0 conn(0x7f69781867e0 legacy=0x7f6978188010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:16.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.749+0000 7f6975e00640 1 -- 172.21.15.99:0/2139116671 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69780cfb00 con 0x7f6978186400 2024-02-21T23:01:16.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.750+0000 7f6975e00640 1 --2- 172.21.15.99:0/2139116671 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6978186400 0x7f6978187ad0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f69780d2d90 tx=0x7f696802b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e423f71659e2e78 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:16.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.750+0000 7f6974a00640 1 -- 172.21.15.99:0/2139116671 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6968038070 con 0x7f6978186400 2024-02-21T23:01:16.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.750+0000 7f6974a00640 1 -- 172.21.15.99:0/2139116671 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6968031520 con 0x7f6978186400 2024-02-21T23:01:16.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.750+0000 7f6974a00640 1 -- 172.21.15.99:0/2139116671 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69680318f0 con 0x7f6978186400 2024-02-21T23:01:16.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.751+0000 7f697ca00640 1 -- 172.21.15.99:0/2139116671 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6978186400 msgr2=0x7f6978187ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:16.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.751+0000 7f697ca00640 1 --2- 172.21.15.99:0/2139116671 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6978186400 0x7f6978187ad0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f69780d2d90 tx=0x7f696802b7c0 comp rx=0 tx=0).stop 2024-02-21T23:01:16.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.751+0000 7f697ca00640 1 -- 172.21.15.99:0/2139116671 shutdown_connections 2024-02-21T23:01:16.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.751+0000 7f697ca00640 1 --2- 172.21.15.99:0/2139116671 >> v2:172.21.15.162:3300/0 conn(0x7f69780d4320 0x7f69780d4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:16.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.751+0000 7f697ca00640 1 --2- 172.21.15.99:0/2139116671 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6978186400 0x7f6978187ad0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:16.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.751+0000 7f697ca00640 1 -- 172.21.15.99:0/2139116671 >> 172.21.15.99:0/2139116671 conn(0x7f69780d6af0 msgr2=0x7f69780740b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:16.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.751+0000 7f697ca00640 1 -- 172.21.15.99:0/2139116671 shutdown_connections 2024-02-21T23:01:16.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.751+0000 7f697ca00640 1 -- 172.21.15.99:0/2139116671 wait complete. 2024-02-21T23:01:16.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.753+0000 7f697ca00640 1 Processor -- start 2024-02-21T23:01:16.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.753+0000 7f697ca00640 1 -- start start 2024-02-21T23:01:16.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.754+0000 7f697ca00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f69780d4320 0x7f6978090e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:16.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.754+0000 7f697ca00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6978186400 0x7f6978184950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:16.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.754+0000 7f697ca00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f69781867e0 0x7f697816b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:16.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.754+0000 7f697ca00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69781872d0 con 0x7f69781867e0 2024-02-21T23:01:16.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.754+0000 7f697ca00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6978186ff0 con 0x7f6978186400 2024-02-21T23:01:16.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.754+0000 7f697ca00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69780d4c90 con 0x7f69780d4320 2024-02-21T23:01:16.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.755+0000 7f6976800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f69781867e0 0x7f697816b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:16.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.755+0000 7f6975400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6978186400 0x7f6978184950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:16.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.755+0000 7f6976800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f69781867e0 0x7f697816b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:57778/0 (socket says 172.21.15.99:57778) 2024-02-21T23:01:16.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.755+0000 7f6976800640 1 -- 172.21.15.99:0/4015987615 learned_addr learned my addr 172.21.15.99:0/4015987615 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:16.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.755+0000 7f6975e00640 1 --2- 172.21.15.99:0/4015987615 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f69780d4320 0x7f6978090e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:16.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.755+0000 7f6976800640 1 -- 172.21.15.99:0/4015987615 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f69780d4320 msgr2=0x7f6978090e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:16.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.755+0000 7f6976800640 1 --2- 172.21.15.99:0/4015987615 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f69780d4320 0x7f6978090e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:16.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.755+0000 7f6976800640 1 -- 172.21.15.99:0/4015987615 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6978186400 msgr2=0x7f6978184950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:16.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.755+0000 7f6976800640 1 --2- 172.21.15.99:0/4015987615 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6978186400 0x7f6978184950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:16.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.755+0000 7f6976800640 1 -- 172.21.15.99:0/4015987615 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6978184fb0 con 0x7f69781867e0 2024-02-21T23:01:16.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.755+0000 7f6975400640 1 --2- 172.21.15.99:0/4015987615 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6978186400 0x7f6978184950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:01:16.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.755+0000 7f6976800640 1 --2- 172.21.15.99:0/4015987615 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f69781867e0 0x7f697816b550 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f697000efc0 tx=0x7f697000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:16.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.756+0000 7f696e000640 1 -- 172.21.15.99:0/4015987615 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6970018020 con 0x7f69781867e0 2024-02-21T23:01:16.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.756+0000 7f696e000640 1 -- 172.21.15.99:0/4015987615 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6970014480 con 0x7f69781867e0 2024-02-21T23:01:16.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.756+0000 7f696e000640 1 -- 172.21.15.99:0/4015987615 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6970014870 con 0x7f69781867e0 2024-02-21T23:01:16.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.756+0000 7f697ca00640 1 -- 172.21.15.99:0/4015987615 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6978185290 con 0x7f69781867e0 2024-02-21T23:01:16.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.756+0000 7f697ca00640 1 -- 172.21.15.99:0/4015987615 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6978185850 con 0x7f69781867e0 2024-02-21T23:01:16.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.757+0000 7f697ca00640 1 -- 172.21.15.99:0/4015987615 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6978068780 con 0x7f69781867e0 2024-02-21T23:01:16.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.759+0000 7f696e000640 1 -- 172.21.15.99:0/4015987615 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 134356+0+0 (secure 0 0 0) 0x7f6970005d10 con 0x7f69781867e0 2024-02-21T23:01:16.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.760+0000 7f696e000640 1 --2- 172.21.15.99:0/4015987615 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f695809ed60 0x7f69580a1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:16.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.760+0000 7f696e000640 1 -- 172.21.15.99:0/4015987615 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f69700ca8f0 con 0x7f69781867e0 2024-02-21T23:01:16.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.761+0000 7f6975e00640 1 --2- 172.21.15.99:0/4015987615 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f695809ed60 0x7f69580a1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:16.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.761+0000 7f6975e00640 1 --2- 172.21.15.99:0/4015987615 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f695809ed60 0x7f69580a1220 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6968035000 tx=0x7f6968030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:16.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.764+0000 7f696e000640 1 -- 172.21.15.99:0/4015987615 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f6970022030 con 0x7f69781867e0 2024-02-21T23:01:16.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.961+0000 7f697ca00640 1 -- 172.21.15.99:0/4015987615 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f69780d49c0 con 0x7f69781867e0 2024-02-21T23:01:16.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.961+0000 7f696e000640 1 -- 172.21.15.99:0/4015987615 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6970010040 con 0x7f69781867e0 2024-02-21T23:01:16.951 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 1 2024-02-21T23:01:16.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.965+0000 7f697ca00640 1 -- 172.21.15.99:0/4015987615 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f695809ed60 msgr2=0x7f69580a1220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:16.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.965+0000 7f697ca00640 1 --2- 172.21.15.99:0/4015987615 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f695809ed60 0x7f69580a1220 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6968035000 tx=0x7f6968030000 comp rx=0 tx=0).stop 2024-02-21T23:01:16.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.965+0000 7f697ca00640 1 -- 172.21.15.99:0/4015987615 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f69781867e0 msgr2=0x7f697816b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:16.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.965+0000 7f697ca00640 1 --2- 172.21.15.99:0/4015987615 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f69781867e0 0x7f697816b550 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f697000efc0 tx=0x7f697000c490 comp rx=0 tx=0).stop 2024-02-21T23:01:16.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.965+0000 7f697ca00640 1 -- 172.21.15.99:0/4015987615 shutdown_connections 2024-02-21T23:01:16.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.965+0000 7f697ca00640 1 --2- 172.21.15.99:0/4015987615 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f695809ed60 0x7f69580a1220 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:16.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.965+0000 7f697ca00640 1 --2- 172.21.15.99:0/4015987615 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f69781867e0 0x7f697816b550 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:16.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.965+0000 7f697ca00640 1 --2- 172.21.15.99:0/4015987615 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6978186400 0x7f6978184950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:16.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.965+0000 7f697ca00640 1 --2- 172.21.15.99:0/4015987615 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f69780d4320 0x7f6978090e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:16.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.965+0000 7f697ca00640 1 -- 172.21.15.99:0/4015987615 >> 172.21.15.99:0/4015987615 conn(0x7f69780d6af0 msgr2=0x7f69780d51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:16.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.966+0000 7f697ca00640 1 -- 172.21.15.99:0/4015987615 shutdown_connections 2024-02-21T23:01:16.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:16.966+0000 7f697ca00640 1 -- 172.21.15.99:0/4015987615 wait complete. 2024-02-21T23:01:16.972 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-21T23:01:17.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.194+0000 7fe41b600640 1 Processor -- start 2024-02-21T23:01:17.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.194+0000 7fe41b600640 1 -- start start 2024-02-21T23:01:17.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.196+0000 7fe41b600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe41417f7b0 0x7fe4140f8f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:17.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.197+0000 7fe41b600640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fe41418ac70 0x7fe4140cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:17.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.197+0000 7fe41b600640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4140f9540 con 0x7fe4140facd0 2024-02-21T23:01:17.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.197+0000 7fe41b600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4140f9820 con 0x7fe41417f7b0 2024-02-21T23:01:17.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.197+0000 7fe41b600640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4140f9b00 con 0x7fe41418ac70 2024-02-21T23:01:17.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.197+0000 7fe418c00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe41417f7b0 0x7fe4140f8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:17.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.197+0000 7fe419600640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fe41418ac70 0x7fe4140cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:17.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.197+0000 7fe418c00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe41417f7b0 0x7fe4140f8f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35530/0 (socket says 172.21.15.99:35530) 2024-02-21T23:01:17.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.197+0000 7fe413e00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fe4140facd0 0x7fe41418a560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:59032/0 (socket says 172.21.15.99:59032) 2024-02-21T23:01:17.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.197+0000 7fe418c00640 1 -- 172.21.15.99:0/2588215242 learned_addr learned my addr 172.21.15.99:0/2588215242 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:17.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.198+0000 7fe413400640 1 -- 172.21.15.99:0/2588215242 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3070785597 0 0) 0x7fe4140f9540 con 0x7fe4140facd0 2024-02-21T23:01:17.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.198+0000 7fe419600640 1 -- 172.21.15.99:0/2588215242 >> v2:172.21.15.99:3300/0 conn(0x7fe41417f7b0 msgr2=0x7fe4140f8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:17.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.198+0000 7fe419600640 1 --2- 172.21.15.99:0/2588215242 >> v2:172.21.15.99:3300/0 conn(0x7fe41417f7b0 0x7fe4140f8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:17.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.198+0000 7fe419600640 1 -- 172.21.15.99:0/2588215242 >> v1:172.21.15.99:6789/0 conn(0x7fe4140facd0 legacy=0x7fe41418a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:17.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.198+0000 7fe419600640 1 -- 172.21.15.99:0/2588215242 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4140f9de0 con 0x7fe41418ac70 2024-02-21T23:01:17.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.198+0000 7fe418c00640 1 --2- 172.21.15.99:0/2588215242 >> v2:172.21.15.99:3300/0 conn(0x7fe41417f7b0 0x7fe4140f8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:01:17.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.199+0000 7fe419600640 1 --2- 172.21.15.99:0/2588215242 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe41418ac70 0x7fe4140cef30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe414093020 tx=0x7fe40c02bec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c4deb152dd263d0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:17.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.199+0000 7fe413400640 1 -- 172.21.15.99:0/2588215242 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40c039070 con 0x7fe41418ac70 2024-02-21T23:01:17.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.200+0000 7fe413400640 1 -- 172.21.15.99:0/2588215242 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe40c02cc70 con 0x7fe41418ac70 2024-02-21T23:01:17.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.200+0000 7fe413400640 1 -- 172.21.15.99:0/2588215242 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40c034660 con 0x7fe41418ac70 2024-02-21T23:01:17.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.200+0000 7fe41b600640 1 -- 172.21.15.99:0/2588215242 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe41418ac70 msgr2=0x7fe4140cef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:17.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.200+0000 7fe41b600640 1 --2- 172.21.15.99:0/2588215242 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe41418ac70 0x7fe4140cef30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe414093020 tx=0x7fe40c02bec0 comp rx=0 tx=0).stop 2024-02-21T23:01:17.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.200+0000 7fe41b600640 1 -- 172.21.15.99:0/2588215242 shutdown_connections 2024-02-21T23:01:17.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.200+0000 7fe41b600640 1 --2- 172.21.15.99:0/2588215242 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe41418ac70 0x7fe4140cef30 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:17.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.200+0000 7fe41b600640 1 --2- 172.21.15.99:0/2588215242 >> v2:172.21.15.99:3300/0 conn(0x7fe41417f7b0 0x7fe4140f8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:17.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.200+0000 7fe41b600640 1 -- 172.21.15.99:0/2588215242 >> 172.21.15.99:0/2588215242 conn(0x7fe4140740b0 msgr2=0x7fe4140744c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:17.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.200+0000 7fe41b600640 1 -- 172.21.15.99:0/2588215242 shutdown_connections 2024-02-21T23:01:17.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.200+0000 7fe41b600640 1 -- 172.21.15.99:0/2588215242 wait complete. 2024-02-21T23:01:17.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.202+0000 7fe41b600640 1 Processor -- start 2024-02-21T23:01:17.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.202+0000 7fe41b600640 1 -- start start 2024-02-21T23:01:17.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.204+0000 7fe41b600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe4140facd0 0x7fe41421ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:17.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.204+0000 7fe41b600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe41417f7b0 0x7fe414171d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:17.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.204+0000 7fe41b600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe41418ac70 0x7fe4141745d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:17.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.204+0000 7fe41b600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4140fb150 con 0x7fe4140facd0 2024-02-21T23:01:17.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.204+0000 7fe41b600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe41418a040 con 0x7fe41418ac70 2024-02-21T23:01:17.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.204+0000 7fe41b600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4140fb2d0 con 0x7fe41417f7b0 2024-02-21T23:01:17.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.204+0000 7fe418c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe4140facd0 0x7fe41421ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:17.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.204+0000 7fe418c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe4140facd0 0x7fe41421ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35538/0 (socket says 172.21.15.99:35538) 2024-02-21T23:01:17.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.204+0000 7fe418c00640 1 -- 172.21.15.99:0/3285322184 learned_addr learned my addr 172.21.15.99:0/3285322184 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:17.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.204+0000 7fe419600640 1 --2- 172.21.15.99:0/3285322184 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe41418ac70 0x7fe4141745d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:17.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.204+0000 7fe413e00640 1 --2- 172.21.15.99:0/3285322184 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe41417f7b0 0x7fe414171d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:17.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.204+0000 7fe419600640 1 -- 172.21.15.99:0/3285322184 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe41417f7b0 msgr2=0x7fe414171d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:17.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.204+0000 7fe419600640 1 --2- 172.21.15.99:0/3285322184 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe41417f7b0 0x7fe414171d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:17.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.205+0000 7fe419600640 1 -- 172.21.15.99:0/3285322184 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe4140facd0 msgr2=0x7fe41421ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:17.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.205+0000 7fe419600640 1 --2- 172.21.15.99:0/3285322184 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe4140facd0 0x7fe41421ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:17.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.205+0000 7fe419600640 1 -- 172.21.15.99:0/3285322184 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe414173250 con 0x7fe41418ac70 2024-02-21T23:01:17.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.205+0000 7fe418c00640 1 --2- 172.21.15.99:0/3285322184 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe4140facd0 0x7fe41421ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:01:17.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.205+0000 7fe413e00640 1 --2- 172.21.15.99:0/3285322184 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe41417f7b0 0x7fe414171d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:01:17.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.205+0000 7fe419600640 1 --2- 172.21.15.99:0/3285322184 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe41418ac70 0x7fe4141745d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe4140f9c80 tx=0x7fe40c004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:17.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.205+0000 7fe410c00640 1 -- 172.21.15.99:0/3285322184 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40c044020 con 0x7fe41418ac70 2024-02-21T23:01:17.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.205+0000 7fe41b600640 1 -- 172.21.15.99:0/3285322184 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe414173530 con 0x7fe41418ac70 2024-02-21T23:01:17.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.205+0000 7fe410c00640 1 -- 172.21.15.99:0/3285322184 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe40c03a040 con 0x7fe41418ac70 2024-02-21T23:01:17.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.205+0000 7fe410c00640 1 -- 172.21.15.99:0/3285322184 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40c039050 con 0x7fe41418ac70 2024-02-21T23:01:17.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.205+0000 7fe41b600640 1 -- 172.21.15.99:0/3285322184 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe414173af0 con 0x7fe41418ac70 2024-02-21T23:01:17.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.207+0000 7fe41b600640 1 -- 172.21.15.99:0/3285322184 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe414068780 con 0x7fe41418ac70 2024-02-21T23:01:17.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.208+0000 7fe410c00640 1 -- 172.21.15.99:0/3285322184 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 134356+0+0 (secure 0 0 0) 0x7fe40c003b90 con 0x7fe41418ac70 2024-02-21T23:01:17.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.210+0000 7fe410c00640 1 --2- 172.21.15.99:0/3285322184 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fe3f409ece0 0x7fe3f40a11a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:17.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.210+0000 7fe410c00640 1 -- 172.21.15.99:0/3285322184 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fe40c0ec1a0 con 0x7fe41418ac70 2024-02-21T23:01:17.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.210+0000 7fe418c00640 1 --2- 172.21.15.99:0/3285322184 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fe3f409ece0 0x7fe3f40a11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:17.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.211+0000 7fe418c00640 1 --2- 172.21.15.99:0/3285322184 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fe3f409ece0 0x7fe3f40a11a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe4080113d0 tx=0x7fe408009240 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:17.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.214+0000 7fe410c00640 1 -- 172.21.15.99:0/3285322184 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fe40c04e020 con 0x7fe41418ac70 2024-02-21T23:01:17.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.459+0000 7fe41b600640 1 -- 172.21.15.99:0/3285322184 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe41417ad30 con 0x7fe41418ac70 2024-02-21T23:01:17.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.459+0000 7fe410c00640 1 -- 172.21.15.99:0/3285322184 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe40c02ce20 con 0x7fe41418ac70 2024-02-21T23:01:17.450 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 32 2024-02-21T23:01:17.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.462+0000 7fe41b600640 1 -- 172.21.15.99:0/3285322184 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fe3f409ece0 msgr2=0x7fe3f40a11a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:17.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.462+0000 7fe41b600640 1 --2- 172.21.15.99:0/3285322184 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fe3f409ece0 0x7fe3f40a11a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe4080113d0 tx=0x7fe408009240 comp rx=0 tx=0).stop 2024-02-21T23:01:17.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.462+0000 7fe41b600640 1 -- 172.21.15.99:0/3285322184 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe41418ac70 msgr2=0x7fe4141745d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:17.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.462+0000 7fe41b600640 1 --2- 172.21.15.99:0/3285322184 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe41418ac70 0x7fe4141745d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe4140f9c80 tx=0x7fe40c004a40 comp rx=0 tx=0).stop 2024-02-21T23:01:17.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.462+0000 7fe41b600640 1 -- 172.21.15.99:0/3285322184 shutdown_connections 2024-02-21T23:01:17.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.462+0000 7fe41b600640 1 --2- 172.21.15.99:0/3285322184 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fe3f409ece0 0x7fe3f40a11a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:17.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.462+0000 7fe41b600640 1 --2- 172.21.15.99:0/3285322184 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe41418ac70 0x7fe4141745d0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:17.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.462+0000 7fe41b600640 1 --2- 172.21.15.99:0/3285322184 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe41417f7b0 0x7fe414171d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:17.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.462+0000 7fe41b600640 1 --2- 172.21.15.99:0/3285322184 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe4140facd0 0x7fe41421ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:17.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.462+0000 7fe41b600640 1 -- 172.21.15.99:0/3285322184 >> 172.21.15.99:0/3285322184 conn(0x7fe4140740b0 msgr2=0x7fe41418b080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:17.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.462+0000 7fe41b600640 1 -- 172.21.15.99:0/3285322184 shutdown_connections 2024-02-21T23:01:17.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.462+0000 7fe41b600640 1 -- 172.21.15.99:0/3285322184 wait complete. 2024-02-21T23:01:17.468 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-21T23:01:17.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.684+0000 7fb92c200640 1 Processor -- start 2024-02-21T23:01:17.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.684+0000 7fb92c200640 1 -- start start 2024-02-21T23:01:17.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.686+0000 7fb92c200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb924180c80 0x7fb924187f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:17.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.686+0000 7fb92c200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb92406e910 0x7fb9240cb420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:17.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.686+0000 7fb92c200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb92406ee40 con 0x7fb924188440 2024-02-21T23:01:17.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.686+0000 7fb92c200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb92406f120 con 0x7fb924180c80 2024-02-21T23:01:17.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.686+0000 7fb92c200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb92406f400 con 0x7fb92406e910 2024-02-21T23:01:17.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.687+0000 7fb928e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb92406e910 0x7fb9240cb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:17.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.687+0000 7fb929800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb924180c80 0x7fb924187f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:17.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.687+0000 7fb928e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb92406e910 0x7fb9240cb420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:55006/0 (socket says 172.21.15.99:55006) 2024-02-21T23:01:17.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.687+0000 7fb928e00640 1 -- 172.21.15.99:0/4012335112 learned_addr learned my addr 172.21.15.99:0/4012335112 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:17.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.687+0000 7fb928e00640 1 -- 172.21.15.99:0/4012335112 >> v2:172.21.15.99:3300/0 conn(0x7fb924180c80 msgr2=0x7fb924187f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:17.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.687+0000 7fb928e00640 1 --2- 172.21.15.99:0/4012335112 >> v2:172.21.15.99:3300/0 conn(0x7fb924180c80 0x7fb924187f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:17.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.687+0000 7fb928e00640 1 -- 172.21.15.99:0/4012335112 >> v1:172.21.15.99:6789/0 conn(0x7fb924188440 legacy=0x7fb9240cb960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:17.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.687+0000 7fb928e00640 1 -- 172.21.15.99:0/4012335112 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb92406f6e0 con 0x7fb92406e910 2024-02-21T23:01:17.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.688+0000 7fb928e00640 1 --2- 172.21.15.99:0/4012335112 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb92406e910 0x7fb9240cb420 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb924184600 tx=0x7fb91002b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a828d17f7f17460 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:17.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.689+0000 7fb923e00640 1 -- 172.21.15.99:0/4012335112 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb910035020 con 0x7fb92406e910 2024-02-21T23:01:17.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.689+0000 7fb923e00640 1 -- 172.21.15.99:0/4012335112 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb910031870 con 0x7fb92406e910 2024-02-21T23:01:17.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.689+0000 7fb923e00640 1 -- 172.21.15.99:0/4012335112 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb910031c40 con 0x7fb92406e910 2024-02-21T23:01:17.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.689+0000 7fb92c200640 1 -- 172.21.15.99:0/4012335112 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb92406e910 msgr2=0x7fb9240cb420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:17.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.689+0000 7fb92c200640 1 --2- 172.21.15.99:0/4012335112 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb92406e910 0x7fb9240cb420 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb924184600 tx=0x7fb91002b910 comp rx=0 tx=0).stop 2024-02-21T23:01:17.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.689+0000 7fb92c200640 1 -- 172.21.15.99:0/4012335112 shutdown_connections 2024-02-21T23:01:17.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.689+0000 7fb92c200640 1 --2- 172.21.15.99:0/4012335112 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb92406e910 0x7fb9240cb420 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:17.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.689+0000 7fb92c200640 1 --2- 172.21.15.99:0/4012335112 >> v2:172.21.15.99:3300/0 conn(0x7fb924180c80 0x7fb924187f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:17.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.689+0000 7fb92c200640 1 -- 172.21.15.99:0/4012335112 >> 172.21.15.99:0/4012335112 conn(0x7fb9240ce5f0 msgr2=0x7fb9240cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:17.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.690+0000 7fb92c200640 1 -- 172.21.15.99:0/4012335112 shutdown_connections 2024-02-21T23:01:17.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.690+0000 7fb92c200640 1 -- 172.21.15.99:0/4012335112 wait complete. 2024-02-21T23:01:17.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.693+0000 7fb92c200640 1 Processor -- start 2024-02-21T23:01:17.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.693+0000 7fb92c200640 1 -- start start 2024-02-21T23:01:17.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.695+0000 7fb92c200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb92406e910 0x7fb924168870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:17.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.695+0000 7fb92c200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb924180c80 0x7fb9240f4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:17.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.695+0000 7fb92c200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb924188440 0x7fb9240f50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:17.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.695+0000 7fb92c200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9240701c0 con 0x7fb92406e910 2024-02-21T23:01:17.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.695+0000 7fb92c200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb92406fca0 con 0x7fb924180c80 2024-02-21T23:01:17.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.695+0000 7fb92c200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb924070340 con 0x7fb924188440 2024-02-21T23:01:17.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.695+0000 7fb929800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb92406e910 0x7fb924168870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:17.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.695+0000 7fb929800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb92406e910 0x7fb924168870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35554/0 (socket says 172.21.15.99:35554) 2024-02-21T23:01:17.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.695+0000 7fb929800640 1 -- 172.21.15.99:0/74696884 learned_addr learned my addr 172.21.15.99:0/74696884 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:17.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.695+0000 7fb928e00640 1 --2- 172.21.15.99:0/74696884 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb924180c80 0x7fb9240f4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:17.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.696+0000 7fb92a200640 1 --2- 172.21.15.99:0/74696884 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb924188440 0x7fb9240f50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:17.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.696+0000 7fb929800640 1 -- 172.21.15.99:0/74696884 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb924188440 msgr2=0x7fb9240f50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:17.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.696+0000 7fb929800640 1 --2- 172.21.15.99:0/74696884 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb924188440 0x7fb9240f50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:17.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.696+0000 7fb929800640 1 -- 172.21.15.99:0/74696884 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb924180c80 msgr2=0x7fb9240f4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:17.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.696+0000 7fb929800640 1 --2- 172.21.15.99:0/74696884 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb924180c80 0x7fb9240f4ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:17.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.696+0000 7fb929800640 1 -- 172.21.15.99:0/74696884 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9240cce20 con 0x7fb92406e910 2024-02-21T23:01:17.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.696+0000 7fb929800640 1 --2- 172.21.15.99:0/74696884 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb92406e910 0x7fb924168870 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb91800e870 tx=0x7fb91800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:17.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.696+0000 7fb921600640 1 -- 172.21.15.99:0/74696884 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb918017070 con 0x7fb92406e910 2024-02-21T23:01:17.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.696+0000 7fb921600640 1 -- 172.21.15.99:0/74696884 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb91800c8e0 con 0x7fb92406e910 2024-02-21T23:01:17.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.696+0000 7fb92c200640 1 -- 172.21.15.99:0/74696884 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9240cd0e0 con 0x7fb92406e910 2024-02-21T23:01:17.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.696+0000 7fb921600640 1 -- 172.21.15.99:0/74696884 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb91800ccd0 con 0x7fb92406e910 2024-02-21T23:01:17.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.696+0000 7fb92c200640 1 -- 172.21.15.99:0/74696884 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9240cd6a0 con 0x7fb92406e910 2024-02-21T23:01:17.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.698+0000 7fb92c200640 1 -- 172.21.15.99:0/74696884 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb924068780 con 0x7fb92406e910 2024-02-21T23:01:17.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.699+0000 7fb921600640 1 -- 172.21.15.99:0/74696884 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 134356+0+0 (secure 0 0 0) 0x7fb91801a070 con 0x7fb92406e910 2024-02-21T23:01:17.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.702+0000 7fb921600640 1 --2- 172.21.15.99:0/74696884 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fb90409ed60 0x7fb9040a1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:17.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.702+0000 7fb921600640 1 -- 172.21.15.99:0/74696884 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fb9180c9da0 con 0x7fb92406e910 2024-02-21T23:01:17.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.702+0000 7fb928e00640 1 --2- 172.21.15.99:0/74696884 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fb90409ed60 0x7fb9040a1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:17.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.703+0000 7fb928e00640 1 --2- 172.21.15.99:0/74696884 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fb90409ed60 0x7fb9040a1220 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb910036000 tx=0x7fb91003c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:17.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.705+0000 7fb921600640 1 -- 172.21.15.99:0/74696884 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fb918097ff0 con 0x7fb92406e910 2024-02-21T23:01:17.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.921+0000 7fb92c200640 1 -- 172.21.15.99:0/74696884 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb924073190 con 0x7fb92406e910 2024-02-21T23:01:17.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.922+0000 7fb921600640 1 -- 172.21.15.99:0/74696884 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb9180978f0 con 0x7fb92406e910 2024-02-21T23:01:17.912 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 64 2024-02-21T23:01:17.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.925+0000 7fb92c200640 1 -- 172.21.15.99:0/74696884 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fb90409ed60 msgr2=0x7fb9040a1220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:17.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.925+0000 7fb92c200640 1 --2- 172.21.15.99:0/74696884 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fb90409ed60 0x7fb9040a1220 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb910036000 tx=0x7fb91003c040 comp rx=0 tx=0).stop 2024-02-21T23:01:17.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.925+0000 7fb92c200640 1 -- 172.21.15.99:0/74696884 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb92406e910 msgr2=0x7fb924168870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:17.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.925+0000 7fb92c200640 1 --2- 172.21.15.99:0/74696884 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb92406e910 0x7fb924168870 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb91800e870 tx=0x7fb91800ed30 comp rx=0 tx=0).stop 2024-02-21T23:01:17.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.925+0000 7fb92c200640 1 -- 172.21.15.99:0/74696884 shutdown_connections 2024-02-21T23:01:17.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.925+0000 7fb92c200640 1 --2- 172.21.15.99:0/74696884 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fb90409ed60 0x7fb9040a1220 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:17.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.925+0000 7fb92c200640 1 --2- 172.21.15.99:0/74696884 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb924188440 0x7fb9240f50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:17.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.925+0000 7fb92c200640 1 --2- 172.21.15.99:0/74696884 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb924180c80 0x7fb9240f4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:17.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.925+0000 7fb92c200640 1 --2- 172.21.15.99:0/74696884 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb92406e910 0x7fb924168870 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:17.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.925+0000 7fb92c200640 1 -- 172.21.15.99:0/74696884 >> 172.21.15.99:0/74696884 conn(0x7fb9240ce5f0 msgr2=0x7fb924172070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:17.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.926+0000 7fb92c200640 1 -- 172.21.15.99:0/74696884 shutdown_connections 2024-02-21T23:01:17.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:17.926+0000 7fb92c200640 1 -- 172.21.15.99:0/74696884 wait complete. 2024-02-21T23:01:17.933 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-02-21T23:01:18.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.154+0000 7fe36e800640 1 Processor -- start 2024-02-21T23:01:18.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.155+0000 7fe36e800640 1 -- start start 2024-02-21T23:01:18.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.158+0000 7fe36e800640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fe3680d5330 0x7fe3680cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:18.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.158+0000 7fe36e800640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3680d5730 con 0x7fe3681867e0 2024-02-21T23:01:18.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.158+0000 7fe36e800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3680cf820 con 0x7fe368186400 2024-02-21T23:01:18.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.158+0000 7fe36e800640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe368187640 con 0x7fe3680d5330 2024-02-21T23:01:18.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.158+0000 7fe366a00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fe3681867e0 0x7fe3681881e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:59058/0 (socket says 172.21.15.99:59058) 2024-02-21T23:01:18.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.158+0000 7fe367400640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fe368186400 0x7fe368187ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.99:49562/0 (socket says 172.21.15.99:49562) 2024-02-21T23:01:18.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.158+0000 7fe366a00640 1 -- 172.21.15.99:0/1413073277 learned_addr learned my addr 172.21.15.99:0/1413073277 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:01:18.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.158+0000 7fe367e00640 1 --2- 172.21.15.99:0/1413073277 >> v2:172.21.15.181:3300/0 conn(0x7fe3680d5330 0x7fe3680cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:18.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.158+0000 7fe366000640 1 -- 172.21.15.99:0/1413073277 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 571042995 0 0) 0x7fe3680d5730 con 0x7fe3681867e0 2024-02-21T23:01:18.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.158+0000 7fe367e00640 1 -- 172.21.15.99:0/1413073277 >> v1:172.21.15.162:6789/0 conn(0x7fe368186400 legacy=0x7fe368187ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:18.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.159+0000 7fe367e00640 1 -- 172.21.15.99:0/1413073277 >> v1:172.21.15.99:6789/0 conn(0x7fe3681867e0 legacy=0x7fe3681881e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:18.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.159+0000 7fe367e00640 1 -- 172.21.15.99:0/1413073277 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3680cfb00 con 0x7fe3680d5330 2024-02-21T23:01:18.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.160+0000 7fe367e00640 1 --2- 172.21.15.99:0/1413073277 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe3680d5330 0x7fe3680cdea0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe360009720 tx=0x7fe36002b620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eaebf431a62dadea server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:18.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.160+0000 7fe366000640 1 -- 172.21.15.99:0/1413073277 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe360037070 con 0x7fe3680d5330 2024-02-21T23:01:18.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.160+0000 7fe366000640 1 -- 172.21.15.99:0/1413073277 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe360030710 con 0x7fe3680d5330 2024-02-21T23:01:18.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.160+0000 7fe366000640 1 -- 172.21.15.99:0/1413073277 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe360030ae0 con 0x7fe3680d5330 2024-02-21T23:01:18.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.161+0000 7fe36e800640 1 -- 172.21.15.99:0/1413073277 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe3680d5330 msgr2=0x7fe3680cdea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:18.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.161+0000 7fe36e800640 1 --2- 172.21.15.99:0/1413073277 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe3680d5330 0x7fe3680cdea0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe360009720 tx=0x7fe36002b620 comp rx=0 tx=0).stop 2024-02-21T23:01:18.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.161+0000 7fe36e800640 1 -- 172.21.15.99:0/1413073277 shutdown_connections 2024-02-21T23:01:18.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.161+0000 7fe36e800640 1 --2- 172.21.15.99:0/1413073277 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe3680d5330 0x7fe3680cdea0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:18.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.161+0000 7fe36e800640 1 -- 172.21.15.99:0/1413073277 >> 172.21.15.99:0/1413073277 conn(0x7fe3680d6af0 msgr2=0x7fe3680740b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:18.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.161+0000 7fe36e800640 1 -- 172.21.15.99:0/1413073277 shutdown_connections 2024-02-21T23:01:18.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.161+0000 7fe36e800640 1 -- 172.21.15.99:0/1413073277 wait complete. 2024-02-21T23:01:18.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.163+0000 7fe36e800640 1 Processor -- start 2024-02-21T23:01:18.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.163+0000 7fe36e800640 1 -- start start 2024-02-21T23:01:18.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.164+0000 7fe36e800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe3680d5330 0x7fe368178db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:18.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.164+0000 7fe36e800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe368186400 0x7fe36821d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:18.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.164+0000 7fe36e800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe3681867e0 0x7fe36821d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:18.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.164+0000 7fe36e800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3681872d0 con 0x7fe3681867e0 2024-02-21T23:01:18.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.164+0000 7fe36e800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe368186ff0 con 0x7fe3680d5330 2024-02-21T23:01:18.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.164+0000 7fe36e800640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3680ce3e0 con 0x7fe368186400 2024-02-21T23:01:18.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.164+0000 7fe367e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe3681867e0 0x7fe36821d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:18.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.164+0000 7fe367e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe3681867e0 0x7fe36821d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35570/0 (socket says 172.21.15.99:35570) 2024-02-21T23:01:18.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.164+0000 7fe367e00640 1 -- 172.21.15.99:0/4192593619 learned_addr learned my addr 172.21.15.99:0/4192593619 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:18.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.164+0000 7fe366a00640 1 --2- 172.21.15.99:0/4192593619 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe368186400 0x7fe36821d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:18.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.164+0000 7fe367400640 1 --2- 172.21.15.99:0/4192593619 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe3680d5330 0x7fe368178db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:18.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.165+0000 7fe367e00640 1 -- 172.21.15.99:0/4192593619 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe368186400 msgr2=0x7fe36821d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:18.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.165+0000 7fe367e00640 1 --2- 172.21.15.99:0/4192593619 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe368186400 0x7fe36821d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:18.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.165+0000 7fe367e00640 1 -- 172.21.15.99:0/4192593619 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe3680d5330 msgr2=0x7fe368178db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:18.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.165+0000 7fe367e00640 1 --2- 172.21.15.99:0/4192593619 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe3680d5330 0x7fe368178db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:18.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.165+0000 7fe367e00640 1 -- 172.21.15.99:0/4192593619 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe368221bb0 con 0x7fe3681867e0 2024-02-21T23:01:18.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.165+0000 7fe367e00640 1 --2- 172.21.15.99:0/4192593619 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe3681867e0 0x7fe36821d630 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe360009840 tx=0x7fe3600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:18.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.165+0000 7fe35f400640 1 -- 172.21.15.99:0/4192593619 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe360042070 con 0x7fe3681867e0 2024-02-21T23:01:18.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.165+0000 7fe35f400640 1 -- 172.21.15.99:0/4192593619 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3600329c0 con 0x7fe3681867e0 2024-02-21T23:01:18.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.165+0000 7fe35f400640 1 -- 172.21.15.99:0/4192593619 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe360037040 con 0x7fe3681867e0 2024-02-21T23:01:18.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.166+0000 7fe36e800640 1 -- 172.21.15.99:0/4192593619 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe368221310 con 0x7fe3681867e0 2024-02-21T23:01:18.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.166+0000 7fe36e800640 1 -- 172.21.15.99:0/4192593619 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3682218d0 con 0x7fe3681867e0 2024-02-21T23:01:18.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.167+0000 7fe36e800640 1 -- 172.21.15.99:0/4192593619 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3680694d0 con 0x7fe3681867e0 2024-02-21T23:01:18.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.169+0000 7fe35f400640 1 -- 172.21.15.99:0/4192593619 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 134356+0+0 (secure 0 0 0) 0x7fe360045070 con 0x7fe3681867e0 2024-02-21T23:01:18.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.171+0000 7fe35f400640 1 --2- 172.21.15.99:0/4192593619 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fe34409ed60 0x7fe3440a1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:18.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.171+0000 7fe35f400640 1 -- 172.21.15.99:0/4192593619 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fe3600ebb50 con 0x7fe3681867e0 2024-02-21T23:01:18.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.171+0000 7fe367400640 1 --2- 172.21.15.99:0/4192593619 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fe34409ed60 0x7fe3440a1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:18.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.172+0000 7fe367400640 1 --2- 172.21.15.99:0/4192593619 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fe34409ed60 0x7fe3440a1220 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe350007fd0 tx=0x7fe350007de0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:18.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.174+0000 7fe35f400640 1 -- 172.21.15.99:0/4192593619 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fe3600b9870 con 0x7fe3681867e0 2024-02-21T23:01:18.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.384+0000 7fe36e800640 1 -- 172.21.15.99:0/4192593619 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe3680d5be0 con 0x7fe3681867e0 2024-02-21T23:01:18.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.385+0000 7fe35f400640 1 -- 172.21.15.99:0/4192593619 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe3600bd910 con 0x7fe3681867e0 2024-02-21T23:01:18.375 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 32 2024-02-21T23:01:18.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.388+0000 7fe36e800640 1 -- 172.21.15.99:0/4192593619 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fe34409ed60 msgr2=0x7fe3440a1220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:18.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.388+0000 7fe36e800640 1 --2- 172.21.15.99:0/4192593619 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fe34409ed60 0x7fe3440a1220 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe350007fd0 tx=0x7fe350007de0 comp rx=0 tx=0).stop 2024-02-21T23:01:18.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.388+0000 7fe36e800640 1 -- 172.21.15.99:0/4192593619 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe3681867e0 msgr2=0x7fe36821d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:18.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.388+0000 7fe36e800640 1 --2- 172.21.15.99:0/4192593619 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe3681867e0 0x7fe36821d630 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe360009840 tx=0x7fe3600046c0 comp rx=0 tx=0).stop 2024-02-21T23:01:18.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.388+0000 7fe36e800640 1 -- 172.21.15.99:0/4192593619 shutdown_connections 2024-02-21T23:01:18.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.388+0000 7fe36e800640 1 --2- 172.21.15.99:0/4192593619 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fe34409ed60 0x7fe3440a1220 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:18.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.388+0000 7fe36e800640 1 --2- 172.21.15.99:0/4192593619 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe3681867e0 0x7fe36821d630 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:18.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.388+0000 7fe36e800640 1 --2- 172.21.15.99:0/4192593619 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe368186400 0x7fe36821d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:18.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.388+0000 7fe36e800640 1 --2- 172.21.15.99:0/4192593619 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe3680d5330 0x7fe368178db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:18.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.388+0000 7fe36e800640 1 -- 172.21.15.99:0/4192593619 >> 172.21.15.99:0/4192593619 conn(0x7fe3680d6af0 msgr2=0x7fe3680d4800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:18.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.388+0000 7fe36e800640 1 -- 172.21.15.99:0/4192593619 shutdown_connections 2024-02-21T23:01:18.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.388+0000 7fe36e800640 1 -- 172.21.15.99:0/4192593619 wait complete. 2024-02-21T23:01:18.396 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-21T23:01:18.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.617+0000 7f7f03600640 1 Processor -- start 2024-02-21T23:01:18.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.617+0000 7f7f03600640 1 -- start start 2024-02-21T23:01:18.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.619+0000 7f7f03600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7efc1865c0 0x7f7efc188190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:18.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.619+0000 7f7f03600640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7efc186a50 con 0x7f7efc0d4300 2024-02-21T23:01:18.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.620+0000 7f7f03600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7efc1886d0 con 0x7f7efc1861e0 2024-02-21T23:01:18.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.620+0000 7f7f03600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7efc186d50 con 0x7f7efc1865c0 2024-02-21T23:01:18.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.620+0000 7f7f01600640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f7efc0d4300 0x7f7efc0d4700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:59070/0 (socket says 172.21.15.99:59070) 2024-02-21T23:01:18.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.620+0000 7f7f01600640 1 -- 172.21.15.99:0/1105980493 learned_addr learned my addr 172.21.15.99:0/1105980493 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:01:18.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.620+0000 7f7f00c00640 1 --1- 172.21.15.99:0/1105980493 >> v1:172.21.15.162:6789/0 conn(0x7f7efc1861e0 0x7f7efc187a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.99:49574/0 (socket says 172.21.15.99:49574) 2024-02-21T23:01:18.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.620+0000 7f7ef3e00640 1 --2- 172.21.15.99:0/1105980493 >> v2:172.21.15.99:3300/0 conn(0x7f7efc1865c0 0x7f7efc188190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:18.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.620+0000 7f7efbe00640 1 -- 172.21.15.99:0/1105980493 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3372343632 0 0) 0x7f7efc1886d0 con 0x7f7efc1861e0 2024-02-21T23:01:18.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.620+0000 7f7efbe00640 1 -- 172.21.15.99:0/1105980493 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ee0003520 con 0x7f7efc1861e0 2024-02-21T23:01:18.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.620+0000 7f7efbe00640 1 -- 172.21.15.99:0/1105980493 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3871291513 0 0) 0x7f7efc186a50 con 0x7f7efc0d4300 2024-02-21T23:01:18.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.620+0000 7f7efbe00640 1 -- 172.21.15.99:0/1105980493 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7efc1886d0 con 0x7f7efc0d4300 2024-02-21T23:01:18.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.620+0000 7f7ef3e00640 1 -- 172.21.15.99:0/1105980493 >> v1:172.21.15.162:6789/0 conn(0x7f7efc1861e0 legacy=0x7f7efc187a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:18.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.620+0000 7f7ef3e00640 1 -- 172.21.15.99:0/1105980493 >> v1:172.21.15.99:6789/0 conn(0x7f7efc0d4300 legacy=0x7f7efc0d4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:18.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.621+0000 7f7ef3e00640 1 -- 172.21.15.99:0/1105980493 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7efc0cf7e0 con 0x7f7efc1865c0 2024-02-21T23:01:18.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.622+0000 7f7ef3e00640 1 --2- 172.21.15.99:0/1105980493 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7efc1865c0 0x7f7efc188190 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7ee40097a0 tx=0x7f7ee402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97c953abe6059af5 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:18.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.622+0000 7f7efbe00640 1 -- 172.21.15.99:0/1105980493 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee4035020 con 0x7f7efc1865c0 2024-02-21T23:01:18.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.622+0000 7f7efbe00640 1 -- 172.21.15.99:0/1105980493 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ee4031830 con 0x7f7efc1865c0 2024-02-21T23:01:18.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.622+0000 7f7efbe00640 1 -- 172.21.15.99:0/1105980493 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee4031be0 con 0x7f7efc1865c0 2024-02-21T23:01:18.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.622+0000 7f7f03600640 1 -- 172.21.15.99:0/1105980493 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7efc1865c0 msgr2=0x7f7efc188190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:18.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.622+0000 7f7f03600640 1 --2- 172.21.15.99:0/1105980493 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7efc1865c0 0x7f7efc188190 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7ee40097a0 tx=0x7f7ee402b8d0 comp rx=0 tx=0).stop 2024-02-21T23:01:18.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.623+0000 7f7f03600640 1 -- 172.21.15.99:0/1105980493 shutdown_connections 2024-02-21T23:01:18.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.623+0000 7f7f03600640 1 --2- 172.21.15.99:0/1105980493 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7efc1865c0 0x7f7efc188190 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:18.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.623+0000 7f7f03600640 1 -- 172.21.15.99:0/1105980493 >> 172.21.15.99:0/1105980493 conn(0x7f7efc0d6ac0 msgr2=0x7f7efc0740b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:18.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.623+0000 7f7f03600640 1 -- 172.21.15.99:0/1105980493 shutdown_connections 2024-02-21T23:01:18.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.623+0000 7f7f03600640 1 -- 172.21.15.99:0/1105980493 wait complete. 2024-02-21T23:01:18.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.625+0000 7f7f03600640 1 Processor -- start 2024-02-21T23:01:18.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.625+0000 7f7f03600640 1 -- start start 2024-02-21T23:01:18.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.626+0000 7f7f03600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7efc0d4300 0x7f7efc1729a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:18.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.626+0000 7f7f03600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7efc1861e0 0x7f7efc172ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:18.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.626+0000 7f7f03600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7efc1865c0 0x7f7efc0fe080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:18.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.626+0000 7f7f03600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7efc186fa0 con 0x7f7efc0d4300 2024-02-21T23:01:18.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.626+0000 7f7f03600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7efc1875f0 con 0x7f7efc1865c0 2024-02-21T23:01:18.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.626+0000 7f7f03600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7efc187280 con 0x7f7efc1861e0 2024-02-21T23:01:18.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.626+0000 7f7f00c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7efc0d4300 0x7f7efc1729a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:18.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.626+0000 7f7f01600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7efc1865c0 0x7f7efc0fe080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:18.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.626+0000 7f7f00c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7efc0d4300 0x7f7efc1729a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35600/0 (socket says 172.21.15.99:35600) 2024-02-21T23:01:18.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.626+0000 7f7f00c00640 1 -- 172.21.15.99:0/2205292507 learned_addr learned my addr 172.21.15.99:0/2205292507 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:18.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.626+0000 7f7ef3e00640 1 --2- 172.21.15.99:0/2205292507 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7efc1861e0 0x7f7efc172ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:18.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.627+0000 7f7f00c00640 1 -- 172.21.15.99:0/2205292507 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7efc1861e0 msgr2=0x7f7efc172ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:18.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.627+0000 7f7f00c00640 1 --2- 172.21.15.99:0/2205292507 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7efc1861e0 0x7f7efc172ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:18.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.627+0000 7f7f00c00640 1 -- 172.21.15.99:0/2205292507 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7efc1865c0 msgr2=0x7f7efc0fe080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:18.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.627+0000 7f7f00c00640 1 --2- 172.21.15.99:0/2205292507 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7efc1865c0 0x7f7efc0fe080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:18.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.627+0000 7f7f00c00640 1 -- 172.21.15.99:0/2205292507 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7efc173420 con 0x7f7efc0d4300 2024-02-21T23:01:18.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.627+0000 7f7f01600640 1 --2- 172.21.15.99:0/2205292507 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7efc1865c0 0x7f7efc0fe080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:01:18.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.627+0000 7f7f00c00640 1 --2- 172.21.15.99:0/2205292507 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7efc0d4300 0x7f7efc1729a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7eec00c3c0 tx=0x7f7eec00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:18.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.627+0000 7f7ef9600640 1 -- 172.21.15.99:0/2205292507 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eec0074e0 con 0x7f7efc0d4300 2024-02-21T23:01:18.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.627+0000 7f7ef9600640 1 -- 172.21.15.99:0/2205292507 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eec007680 con 0x7f7efc0d4300 2024-02-21T23:01:18.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.627+0000 7f7ef9600640 1 -- 172.21.15.99:0/2205292507 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eec0049e0 con 0x7f7efc0d4300 2024-02-21T23:01:18.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.627+0000 7f7f03600640 1 -- 172.21.15.99:0/2205292507 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7efc221d00 con 0x7f7efc0d4300 2024-02-21T23:01:18.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.627+0000 7f7f03600640 1 -- 172.21.15.99:0/2205292507 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7efc2222c0 con 0x7f7efc0d4300 2024-02-21T23:01:18.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.629+0000 7f7f03600640 1 -- 172.21.15.99:0/2205292507 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7efc189940 con 0x7f7efc0d4300 2024-02-21T23:01:18.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.632+0000 7f7ef9600640 1 -- 172.21.15.99:0/2205292507 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 134356+0+0 (secure 0 0 0) 0x7f7eec01a020 con 0x7f7efc0d4300 2024-02-21T23:01:18.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.633+0000 7f7ef9600640 1 --2- 172.21.15.99:0/2205292507 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f7ed809ed60 0x7f7ed80a1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:18.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.633+0000 7f7ef9600640 1 -- 172.21.15.99:0/2205292507 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f7eec0c92a0 con 0x7f7efc0d4300 2024-02-21T23:01:18.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.634+0000 7f7ef3e00640 1 --2- 172.21.15.99:0/2205292507 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f7ed809ed60 0x7f7ed80a1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:18.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.634+0000 7f7ef3e00640 1 --2- 172.21.15.99:0/2205292507 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f7ed809ed60 0x7f7ed80a1220 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7ee4036000 tx=0x7f7ee4008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:18.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.642+0000 7f7ef9600640 1 -- 172.21.15.99:0/2205292507 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f7eec0974f0 con 0x7f7efc0d4300 2024-02-21T23:01:18.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.877+0000 7f7f03600640 1 -- 172.21.15.99:0/2205292507 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7efc189660 con 0x7f7efc0d4300 2024-02-21T23:01:18.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.878+0000 7f7ef9600640 1 -- 172.21.15.99:0/2205292507 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7eec096df0 con 0x7f7efc0d4300 2024-02-21T23:01:18.867 INFO:teuthology.orchestra.run.smithi099.stderr:listed 0 entries 2024-02-21T23:01:18.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.880+0000 7f7f03600640 1 -- 172.21.15.99:0/2205292507 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f7ed809ed60 msgr2=0x7f7ed80a1220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:18.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.880+0000 7f7f03600640 1 --2- 172.21.15.99:0/2205292507 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f7ed809ed60 0x7f7ed80a1220 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7ee4036000 tx=0x7f7ee4008030 comp rx=0 tx=0).stop 2024-02-21T23:01:18.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.880+0000 7f7f03600640 1 -- 172.21.15.99:0/2205292507 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7efc0d4300 msgr2=0x7f7efc1729a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:18.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.880+0000 7f7f03600640 1 --2- 172.21.15.99:0/2205292507 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7efc0d4300 0x7f7efc1729a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7eec00c3c0 tx=0x7f7eec00c880 comp rx=0 tx=0).stop 2024-02-21T23:01:18.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.880+0000 7f7f03600640 1 -- 172.21.15.99:0/2205292507 shutdown_connections 2024-02-21T23:01:18.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.880+0000 7f7f03600640 1 --2- 172.21.15.99:0/2205292507 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f7ed809ed60 0x7f7ed80a1220 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:18.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.880+0000 7f7f03600640 1 --2- 172.21.15.99:0/2205292507 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7efc1865c0 0x7f7efc0fe080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:18.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.880+0000 7f7f03600640 1 --2- 172.21.15.99:0/2205292507 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7efc1861e0 0x7f7efc172ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:18.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.880+0000 7f7f03600640 1 --2- 172.21.15.99:0/2205292507 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7efc0d4300 0x7f7efc1729a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:18.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.880+0000 7f7f03600640 1 -- 172.21.15.99:0/2205292507 >> 172.21.15.99:0/2205292507 conn(0x7f7efc0d6ac0 msgr2=0x7f7efc0fb040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:18.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.880+0000 7f7f03600640 1 -- 172.21.15.99:0/2205292507 shutdown_connections 2024-02-21T23:01:18.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:18.880+0000 7f7f03600640 1 -- 172.21.15.99:0/2205292507 wait complete. 2024-02-21T23:01:18.888 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-02-21T23:01:18.888 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-21T23:01:18.934 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T23:01:19.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.186+0000 7fa239a00640 1 Processor -- start 2024-02-21T23:01:19.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.186+0000 7fa239a00640 1 -- start start 2024-02-21T23:01:19.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.188+0000 7fa239a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa234186b90 0x7fa234186f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:19.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.188+0000 7fa239a00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fa23418ab00 0x7fa234184a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:19.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.188+0000 7fa239a00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa23417d980 con 0x7fa2341874b0 2024-02-21T23:01:19.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.188+0000 7fa239a00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa234185950 con 0x7fa234186b90 2024-02-21T23:01:19.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.188+0000 7fa239a00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa234185c30 con 0x7fa23418ab00 2024-02-21T23:01:19.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.188+0000 7fa233400640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fa23418ab00 0x7fa234184a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:19.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.188+0000 7fa233400640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fa23418ab00 0x7fa234184a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:49224/0 (socket says 172.21.15.99:49224) 2024-02-21T23:01:19.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.188+0000 7fa233400640 1 -- 172.21.15.99:0/2936402149 learned_addr learned my addr 172.21.15.99:0/2936402149 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:19.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.188+0000 7fa232a00640 1 --2- 172.21.15.99:0/2936402149 >> v2:172.21.15.162:3300/0 conn(0x7fa234186b90 0x7fa234186f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:19.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.189+0000 7fa232a00640 1 -- 172.21.15.99:0/2936402149 >> v2:172.21.15.181:3300/0 conn(0x7fa23418ab00 msgr2=0x7fa234184a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:19.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.189+0000 7fa232a00640 1 --2- 172.21.15.99:0/2936402149 >> v2:172.21.15.181:3300/0 conn(0x7fa23418ab00 0x7fa234184a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:19.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.189+0000 7fa232a00640 1 -- 172.21.15.99:0/2936402149 >> v1:172.21.15.162:6789/0 conn(0x7fa2341874b0 legacy=0x7fa23418a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:19.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.189+0000 7fa232a00640 1 -- 172.21.15.99:0/2936402149 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa234185f10 con 0x7fa234186b90 2024-02-21T23:01:19.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.189+0000 7fa231600640 1 -- 172.21.15.99:0/2936402149 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2000512781 0 0) 0x7fa23417d980 con 0x7fa2341874b0 2024-02-21T23:01:19.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.190+0000 7fa232a00640 1 --2- 172.21.15.99:0/2936402149 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa234186b90 0x7fa234186f70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa2340f4700 tx=0x7fa22402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5031b9ff208e9991 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:19.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.190+0000 7fa231600640 1 -- 172.21.15.99:0/2936402149 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa224035020 con 0x7fa234186b90 2024-02-21T23:01:19.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.190+0000 7fa231600640 1 -- 172.21.15.99:0/2936402149 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa224031830 con 0x7fa234186b90 2024-02-21T23:01:19.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.190+0000 7fa231600640 1 -- 172.21.15.99:0/2936402149 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa224031c00 con 0x7fa234186b90 2024-02-21T23:01:19.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.191+0000 7fa239a00640 1 -- 172.21.15.99:0/2936402149 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa234186b90 msgr2=0x7fa234186f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:19.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.191+0000 7fa239a00640 1 --2- 172.21.15.99:0/2936402149 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa234186b90 0x7fa234186f70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa2340f4700 tx=0x7fa22402b8d0 comp rx=0 tx=0).stop 2024-02-21T23:01:19.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.191+0000 7fa239a00640 1 -- 172.21.15.99:0/2936402149 shutdown_connections 2024-02-21T23:01:19.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.191+0000 7fa239a00640 1 --2- 172.21.15.99:0/2936402149 >> v2:172.21.15.181:3300/0 conn(0x7fa23418ab00 0x7fa234184a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:19.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.191+0000 7fa239a00640 1 --2- 172.21.15.99:0/2936402149 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa234186b90 0x7fa234186f70 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:19.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.191+0000 7fa239a00640 1 -- 172.21.15.99:0/2936402149 >> 172.21.15.99:0/2936402149 conn(0x7fa2340ce5f0 msgr2=0x7fa2340cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:19.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.191+0000 7fa239a00640 1 -- 172.21.15.99:0/2936402149 shutdown_connections 2024-02-21T23:01:19.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.191+0000 7fa239a00640 1 -- 172.21.15.99:0/2936402149 wait complete. 2024-02-21T23:01:19.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.194+0000 7fa239a00640 1 Processor -- start 2024-02-21T23:01:19.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.194+0000 7fa239a00640 1 -- start start 2024-02-21T23:01:19.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.196+0000 7fa239a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa234186b90 0x7fa234220570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:19.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.196+0000 7fa239a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa2341874b0 0x7fa234072170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:19.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.196+0000 7fa239a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa23418ab00 0x7fa23421f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:19.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.196+0000 7fa239a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2341867b0 con 0x7fa23418ab00 2024-02-21T23:01:19.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.196+0000 7fa239a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2341864d0 con 0x7fa234186b90 2024-02-21T23:01:19.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.196+0000 7fa239a00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2340cbf20 con 0x7fa2341874b0 2024-02-21T23:01:19.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.197+0000 7fa232000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa2341874b0 0x7fa234072170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:19.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.197+0000 7fa233400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa23418ab00 0x7fa23421f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:19.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.197+0000 7fa232a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa234186b90 0x7fa234220570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:19.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.197+0000 7fa232000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa2341874b0 0x7fa234072170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:49230/0 (socket says 172.21.15.99:49230) 2024-02-21T23:01:19.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.197+0000 7fa232000640 1 -- 172.21.15.99:0/1765379961 learned_addr learned my addr 172.21.15.99:0/1765379961 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:19.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.197+0000 7fa233400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa23418ab00 0x7fa23421f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35604/0 (socket says 172.21.15.99:35604) 2024-02-21T23:01:19.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.197+0000 7fa232000640 1 -- 172.21.15.99:0/1765379961 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa234186b90 msgr2=0x7fa234220570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:19.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.197+0000 7fa232000640 1 --2- 172.21.15.99:0/1765379961 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa234186b90 0x7fa234220570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:19.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.197+0000 7fa232000640 1 -- 172.21.15.99:0/1765379961 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa23418ab00 msgr2=0x7fa23421f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:19.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.197+0000 7fa232000640 1 --2- 172.21.15.99:0/1765379961 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa23418ab00 0x7fa23421f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:19.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.197+0000 7fa232000640 1 -- 172.21.15.99:0/1765379961 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa234070df0 con 0x7fa2341874b0 2024-02-21T23:01:19.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.197+0000 7fa232a00640 1 --2- 172.21.15.99:0/1765379961 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa234186b90 0x7fa234220570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:01:19.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.198+0000 7fa232000640 1 --2- 172.21.15.99:0/1765379961 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa2341874b0 0x7fa234072170 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa22000c3c0 tx=0x7fa22000c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:19.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.198+0000 7fa22aa00640 1 -- 172.21.15.99:0/1765379961 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa220017070 con 0x7fa2341874b0 2024-02-21T23:01:19.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.198+0000 7fa22aa00640 1 -- 172.21.15.99:0/1765379961 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2200035f0 con 0x7fa2341874b0 2024-02-21T23:01:19.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.198+0000 7fa239a00640 1 -- 172.21.15.99:0/1765379961 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2340710d0 con 0x7fa2341874b0 2024-02-21T23:01:19.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.198+0000 7fa22aa00640 1 -- 172.21.15.99:0/1765379961 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2200039e0 con 0x7fa2341874b0 2024-02-21T23:01:19.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.198+0000 7fa239a00640 1 -- 172.21.15.99:0/1765379961 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa234071690 con 0x7fa2341874b0 2024-02-21T23:01:19.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.199+0000 7fa239a00640 1 -- 172.21.15.99:0/1765379961 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2340ca4c0 con 0x7fa2341874b0 2024-02-21T23:01:19.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.201+0000 7fa22aa00640 1 -- 172.21.15.99:0/1765379961 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) v1 ==== 134356+0+0 (secure 0 0 0) 0x7fa22001a070 con 0x7fa2341874b0 2024-02-21T23:01:19.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.202+0000 7fa22aa00640 1 --2- 172.21.15.99:0/1765379961 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fa21409ed60 0x7fa2140a1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:19.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.202+0000 7fa22aa00640 1 -- 172.21.15.99:0/1765379961 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fa2200c8e30 con 0x7fa2341874b0 2024-02-21T23:01:19.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.203+0000 7fa232a00640 1 --2- 172.21.15.99:0/1765379961 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fa21409ed60 0x7fa2140a1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:19.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.203+0000 7fa232a00640 1 --2- 172.21.15.99:0/1765379961 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fa21409ed60 0x7fa2140a1220 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa224036000 tx=0x7fa22403c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:19.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.207+0000 7fa22aa00640 1 -- 172.21.15.99:0/1765379961 <== mon.2 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fa2340ca4c0 con 0x7fa2341874b0 2024-02-21T23:01:19.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.416+0000 7fa239a00640 1 -- 172.21.15.99:0/1765379961 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa2340cc1c0 con 0x7fa2341874b0 2024-02-21T23:01:19.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.418+0000 7fa22aa00640 1 -- 172.21.15.99:0/1765379961 <== mon.2 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+23570 (secure 0 0 0) 0x7fa220096a30 con 0x7fa2341874b0 2024-02-21T23:01:19.407 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T23:01:19.408 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":29,"fsid":"e8af98cd-45a1-425f-96a7-f24da8ee4efb","created":"2024-02-21T23:00:44.699708+0000","modified":"2024-02-21T23:01:07.722511+0000","last_up_change":"2024-02-21T23:00:55.749829+0000","last_in_change":"2024-02-21T23:00:48.332297+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T23:00:57.020557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":11.760000228881836,"score_stable":11.760000228881836,"optimal_score":0.17000000178813934,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-21T23:01:01.124398+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-21T23:01:01.684258+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-21T23:01:05.290089+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c49de9b2-dc53-4882-b14c-7059ed40bf59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6809","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6811","nonce":1026112937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6813","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6815","nonce":1026112937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6823","nonce":1026112937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6819","nonce":1026112937}]},"public_addr":"172.21.15.99:6811/1026112937","cluster_addr":"172.21.15.99:6815/1026112937","heartbeat_back_addr":"172.21.15.99:6823/1026112937","heartbeat_front_addr":"172.21.15.99:6819/1026112937","state":["exists","up"]},{"osd":1,"uuid":"58398292-2fe5-4291-94fd-03a0ca29d49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6827","nonce":3030871566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6829","nonce":3030871566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6833","nonce":3030871566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6831","nonce":3030871566}]},"public_addr":"172.21.15.162:6827/3030871566","cluster_addr":"172.21.15.162:6829/3030871566","heartbeat_back_addr":"172.21.15.162:6833/3030871566","heartbeat_front_addr":"172.21.15.162:6831/3030871566","state":["exists","up"]},{"osd":2,"uuid":"94cddec1-e08f-438d-a7c8-48a0e47d71a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6818","nonce":2782386148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6821","nonce":2782386148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6827","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6829","nonce":2782386148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6823","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6825","nonce":2782386148}]},"public_addr":"172.21.15.181:6818/2782386148","cluster_addr":"172.21.15.181:6821/2782386148","heartbeat_back_addr":"172.21.15.181:6829/2782386148","heartbeat_front_addr":"172.21.15.181:6825/2782386148","state":["exists","up"]},{"osd":3,"uuid":"d29abb74-9b89-4fd7-88b1-7c2eb8231189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6801","nonce":2316185310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6803","nonce":2316185310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6807","nonce":2316185310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6805","nonce":2316185310}]},"public_addr":"172.21.15.99:6801/2316185310","cluster_addr":"172.21.15.99:6803/2316185310","heartbeat_back_addr":"172.21.15.99:6807/2316185310","heartbeat_front_addr":"172.21.15.99:6805/2316185310","state":["exists","up"]},{"osd":4,"uuid":"0d8c9ea3-880a-4d69-9dcb-cf7d35abd449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6811","nonce":3137681258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6813","nonce":3137681258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6817","nonce":3137681258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6815","nonce":3137681258}]},"public_addr":"172.21.15.162:6811/3137681258","cluster_addr":"172.21.15.162:6813/3137681258","heartbeat_back_addr":"172.21.15.162:6817/3137681258","heartbeat_front_addr":"172.21.15.162:6815/3137681258","state":["exists","up"]},{"osd":5,"uuid":"2e3a9340-6fd0-4d7a-8e00-fe305649296e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6801","nonce":2011264527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6803","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6805","nonce":2011264527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6811","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6813","nonce":2011264527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6807","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6809","nonce":2011264527}]},"public_addr":"172.21.15.181:6801/2011264527","cluster_addr":"172.21.15.181:6805/2011264527","heartbeat_back_addr":"172.21.15.181:6813/2011264527","heartbeat_front_addr":"172.21.15.181:6809/2011264527","state":["exists","up"]},{"osd":6,"uuid":"d9e37ce7-1b0e-4019-8f2e-b670403abf7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6810","nonce":753870050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6814","nonce":753870050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6822","nonce":753870050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6818","nonce":753870050}]},"public_addr":"172.21.15.99:6810/753870050","cluster_addr":"172.21.15.99:6814/753870050","heartbeat_back_addr":"172.21.15.99:6822/753870050","heartbeat_front_addr":"172.21.15.99:6818/753870050","state":["exists","up"]},{"osd":7,"uuid":"49988754-232e-4b8c-bd72-bfa25b418e5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6803","nonce":1659412949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6805","nonce":1659412949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6809","nonce":1659412949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6807","nonce":1659412949}]},"public_addr":"172.21.15.162:6803/1659412949","cluster_addr":"172.21.15.162:6805/1659412949","heartbeat_back_addr":"172.21.15.162:6809/1659412949","heartbeat_front_addr":"172.21.15.162:6807/1659412949","state":["exists","up"]},{"osd":8,"uuid":"ebc6e462-8368-4d64-b242-9c8735ac672c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6804","nonce":3389807042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6808","nonce":3389807042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6815","nonce":3389807042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6812","nonce":3389807042}]},"public_addr":"172.21.15.181:6804/3389807042","cluster_addr":"172.21.15.181:6808/3389807042","heartbeat_back_addr":"172.21.15.181:6815/3389807042","heartbeat_front_addr":"172.21.15.181:6812/3389807042","state":["exists","up"]},{"osd":9,"uuid":"72af1b02-b965-4d6a-8964-527ec24c4daa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6825","nonce":4055669590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6827","nonce":4055669590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6831","nonce":4055669590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6829","nonce":4055669590}]},"public_addr":"172.21.15.99:6825/4055669590","cluster_addr":"172.21.15.99:6827/4055669590","heartbeat_back_addr":"172.21.15.99:6831/4055669590","heartbeat_front_addr":"172.21.15.99:6829/4055669590","state":["exists","up"]},{"osd":10,"uuid":"adb5cb06-6453-41e4-b847-d7c78bbb7d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6819","nonce":1421879617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6821","nonce":1421879617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6825","nonce":1421879617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6823","nonce":1421879617}]},"public_addr":"172.21.15.162:6819/1421879617","cluster_addr":"172.21.15.162:6821/1421879617","heartbeat_back_addr":"172.21.15.162:6825/1421879617","heartbeat_front_addr":"172.21.15.162:6823/1421879617","state":["exists","up"]},{"osd":11,"uuid":"118563d9-1e8f-4dc7-a92c-2f4c4dc3e20f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6817","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6819","nonce":3219928272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6824","nonce":3219928272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6831","nonce":3219928272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6828","nonce":3219928272}]},"public_addr":"172.21.15.181:6819/3219928272","cluster_addr":"172.21.15.181:6824/3219928272","heartbeat_back_addr":"172.21.15.181:6831/3219928272","heartbeat_front_addr":"172.21.15.181:6828/3219928272","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.651219+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.549859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.529659+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.591004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.440836+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.414250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.630130+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.411954+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.439371+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.428173+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.511203+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.482806+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T23:01:19.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.421+0000 7fa239a00640 1 -- 172.21.15.99:0/1765379961 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fa21409ed60 msgr2=0x7fa2140a1220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:19.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.421+0000 7fa239a00640 1 --2- 172.21.15.99:0/1765379961 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fa21409ed60 0x7fa2140a1220 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa224036000 tx=0x7fa22403c040 comp rx=0 tx=0).stop 2024-02-21T23:01:19.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.421+0000 7fa239a00640 1 -- 172.21.15.99:0/1765379961 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa2341874b0 msgr2=0x7fa234072170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:19.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.421+0000 7fa239a00640 1 --2- 172.21.15.99:0/1765379961 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa2341874b0 0x7fa234072170 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa22000c3c0 tx=0x7fa22000c880 comp rx=0 tx=0).stop 2024-02-21T23:01:19.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.421+0000 7fa239a00640 1 -- 172.21.15.99:0/1765379961 shutdown_connections 2024-02-21T23:01:19.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.421+0000 7fa239a00640 1 --2- 172.21.15.99:0/1765379961 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fa21409ed60 0x7fa2140a1220 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:19.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.421+0000 7fa239a00640 1 --2- 172.21.15.99:0/1765379961 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa23418ab00 0x7fa23421f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:19.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.421+0000 7fa239a00640 1 --2- 172.21.15.99:0/1765379961 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa2341874b0 0x7fa234072170 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:19.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.421+0000 7fa239a00640 1 --2- 172.21.15.99:0/1765379961 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa234186b90 0x7fa234220570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:19.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.421+0000 7fa239a00640 1 -- 172.21.15.99:0/1765379961 >> 172.21.15.99:0/1765379961 conn(0x7fa2340ce5f0 msgr2=0x7fa2340ceb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:19.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.421+0000 7fa239a00640 1 -- 172.21.15.99:0/1765379961 shutdown_connections 2024-02-21T23:01:19.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.421+0000 7fa239a00640 1 -- 172.21.15.99:0/1765379961 wait complete. 2024-02-21T23:01:19.430 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-21T23:00:57.020557+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 11.760000228881836, 'score_stable': 11.760000228881836, 'optimal_score': 0.17000000178813934, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-21T23:01:01.124398+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-21T23:01:01.684258+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-02-21T23:01:05.290089+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-02-21T23:01:19.431 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-21T23:01:19.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.711+0000 7fa2ffe00640 1 Processor -- start 2024-02-21T23:01:19.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.711+0000 7fa2ffe00640 1 -- start start 2024-02-21T23:01:19.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.713+0000 7fa2ffe00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa3001648c0 0x7fa3000fce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:19.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.713+0000 7fa2ffe00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fa3000fb9e0 0x7fa30018f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:19.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.713+0000 7fa2ffe00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3000fd490 con 0x7fa300186d30 2024-02-21T23:01:19.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.713+0000 7fa2ffe00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3000fbe70 con 0x7fa3001648c0 2024-02-21T23:01:19.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.713+0000 7fa2ffe00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3000fd770 con 0x7fa3000fb9e0 2024-02-21T23:01:19.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.714+0000 7fa2fea00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa3001648c0 0x7fa3000fce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:19.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.714+0000 7fa2f7e00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fa300186d30 0x7fa300187190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.99:49586/0 (socket says 172.21.15.99:49586) 2024-02-21T23:01:19.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.714+0000 7fa2f7e00640 1 -- 172.21.15.99:0/1539710020 learned_addr learned my addr 172.21.15.99:0/1539710020 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:01:19.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.714+0000 7fa2ff400640 1 --2- 172.21.15.99:0/1539710020 >> v2:172.21.15.181:3300/0 conn(0x7fa3000fb9e0 0x7fa30018f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:19.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.714+0000 7fa2ff400640 1 -- 172.21.15.99:0/1539710020 >> v2:172.21.15.162:3300/0 conn(0x7fa3001648c0 msgr2=0x7fa3000fce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:19.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.714+0000 7fa2ff400640 1 --2- 172.21.15.99:0/1539710020 >> v2:172.21.15.162:3300/0 conn(0x7fa3001648c0 0x7fa3000fce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:19.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.714+0000 7fa2ff400640 1 -- 172.21.15.99:0/1539710020 >> v1:172.21.15.162:6789/0 conn(0x7fa300186d30 legacy=0x7fa300187190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:19.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.714+0000 7fa2ff400640 1 -- 172.21.15.99:0/1539710020 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3000fda50 con 0x7fa3000fb9e0 2024-02-21T23:01:19.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.714+0000 7fa2fe000640 1 -- 172.21.15.99:0/1539710020 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3556484399 0 0) 0x7fa3000fd490 con 0x7fa300186d30 2024-02-21T23:01:19.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.715+0000 7fa2ff400640 1 --2- 172.21.15.99:0/1539710020 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa3000fb9e0 0x7fa30018f340 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa3000f54f0 tx=0x7fa2f802bec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26f400419eaa42b0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:19.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.715+0000 7fa2fe000640 1 -- 172.21.15.99:0/1539710020 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f8039070 con 0x7fa3000fb9e0 2024-02-21T23:01:19.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.715+0000 7fa2fe000640 1 -- 172.21.15.99:0/1539710020 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2f802cc70 con 0x7fa3000fb9e0 2024-02-21T23:01:19.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.715+0000 7fa2fe000640 1 -- 172.21.15.99:0/1539710020 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f8034660 con 0x7fa3000fb9e0 2024-02-21T23:01:19.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.716+0000 7fa2ffe00640 1 -- 172.21.15.99:0/1539710020 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa3000fb9e0 msgr2=0x7fa30018f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:19.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.716+0000 7fa2ffe00640 1 --2- 172.21.15.99:0/1539710020 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa3000fb9e0 0x7fa30018f340 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa3000f54f0 tx=0x7fa2f802bec0 comp rx=0 tx=0).stop 2024-02-21T23:01:19.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.716+0000 7fa2ffe00640 1 -- 172.21.15.99:0/1539710020 shutdown_connections 2024-02-21T23:01:19.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.716+0000 7fa2ffe00640 1 --2- 172.21.15.99:0/1539710020 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa3000fb9e0 0x7fa30018f340 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:19.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.716+0000 7fa2ffe00640 1 --2- 172.21.15.99:0/1539710020 >> v2:172.21.15.162:3300/0 conn(0x7fa3001648c0 0x7fa3000fce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:19.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.716+0000 7fa2ffe00640 1 -- 172.21.15.99:0/1539710020 >> 172.21.15.99:0/1539710020 conn(0x7fa3000d29c0 msgr2=0x7fa3000d2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:19.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.716+0000 7fa2ffe00640 1 -- 172.21.15.99:0/1539710020 shutdown_connections 2024-02-21T23:01:19.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.716+0000 7fa2ffe00640 1 -- 172.21.15.99:0/1539710020 wait complete. 2024-02-21T23:01:19.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.718+0000 7fa2ffe00640 1 Processor -- start 2024-02-21T23:01:19.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.718+0000 7fa2ffe00640 1 -- start start 2024-02-21T23:01:19.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.719+0000 7fa2ffe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3000fb9e0 0x7fa30017dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:19.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.719+0000 7fa2ffe00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa3001648c0 0x7fa30017e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:19.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.719+0000 7fa2ffe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa300186d30 0x7fa300163420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:19.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.719+0000 7fa2ffe00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa300072920 con 0x7fa3000fb9e0 2024-02-21T23:01:19.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.719+0000 7fa2ffe00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3000fe010 con 0x7fa300186d30 2024-02-21T23:01:19.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.719+0000 7fa2ffe00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3001878a0 con 0x7fa3001648c0 2024-02-21T23:01:19.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.720+0000 7fa2ff400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa300186d30 0x7fa300163420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:19.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.720+0000 7fa2fea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3000fb9e0 0x7fa30017dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:19.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.720+0000 7fa2ff400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa300186d30 0x7fa300163420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:55092/0 (socket says 172.21.15.99:55092) 2024-02-21T23:01:19.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.720+0000 7fa2ff400640 1 -- 172.21.15.99:0/2620222582 learned_addr learned my addr 172.21.15.99:0/2620222582 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:19.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.720+0000 7fa2f7e00640 1 --2- 172.21.15.99:0/2620222582 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa3001648c0 0x7fa30017e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:19.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.720+0000 7fa2ff400640 1 -- 172.21.15.99:0/2620222582 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa3001648c0 msgr2=0x7fa30017e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:19.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.720+0000 7fa2ff400640 1 --2- 172.21.15.99:0/2620222582 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa3001648c0 0x7fa30017e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:19.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.720+0000 7fa2ff400640 1 -- 172.21.15.99:0/2620222582 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3000fb9e0 msgr2=0x7fa30017dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:19.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.720+0000 7fa2ff400640 1 --2- 172.21.15.99:0/2620222582 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3000fb9e0 0x7fa30017dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:19.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.720+0000 7fa2ff400640 1 -- 172.21.15.99:0/2620222582 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3000d5160 con 0x7fa300186d30 2024-02-21T23:01:19.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.720+0000 7fa2f7e00640 1 --2- 172.21.15.99:0/2620222582 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa3001648c0 0x7fa30017e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:01:19.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.721+0000 7fa2ff400640 1 --2- 172.21.15.99:0/2620222582 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa300186d30 0x7fa300163420 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa2f8009e80 tx=0x7fa2f8004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:19.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.721+0000 7fa2f6a00640 1 -- 172.21.15.99:0/2620222582 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f8039050 con 0x7fa300186d30 2024-02-21T23:01:19.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.721+0000 7fa2f6a00640 1 -- 172.21.15.99:0/2620222582 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2f8045070 con 0x7fa300186d30 2024-02-21T23:01:19.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.721+0000 7fa2f6a00640 1 -- 172.21.15.99:0/2620222582 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f8009450 con 0x7fa300186d30 2024-02-21T23:01:19.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.721+0000 7fa2ffe00640 1 -- 172.21.15.99:0/2620222582 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3000d5440 con 0x7fa300186d30 2024-02-21T23:01:19.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.721+0000 7fa2ffe00640 1 -- 172.21.15.99:0/2620222582 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa30021ce50 con 0x7fa300186d30 2024-02-21T23:01:19.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.722+0000 7fa2ffe00640 1 -- 172.21.15.99:0/2620222582 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3000d69d0 con 0x7fa300186d30 2024-02-21T23:01:19.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.724+0000 7fa2f6a00640 1 -- 172.21.15.99:0/2620222582 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 134356+0+0 (secure 0 0 0) 0x7fa2f803e850 con 0x7fa300186d30 2024-02-21T23:01:19.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.726+0000 7fa2f6a00640 1 --2- 172.21.15.99:0/2620222582 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fa2dc09ed60 0x7fa2dc0a1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:19.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.726+0000 7fa2f6a00640 1 -- 172.21.15.99:0/2620222582 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fa2f80eca10 con 0x7fa300186d30 2024-02-21T23:01:19.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.727+0000 7fa2fea00640 1 --2- 172.21.15.99:0/2620222582 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fa2dc09ed60 0x7fa2dc0a1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:19.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.727+0000 7fa2fea00640 1 --2- 172.21.15.99:0/2620222582 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fa2dc09ed60 0x7fa2dc0a1220 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa2f0009aa0 tx=0x7fa2f0009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:19.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.729+0000 7fa2f6a00640 1 -- 172.21.15.99:0/2620222582 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fa2f802ce20 con 0x7fa300186d30 2024-02-21T23:01:19.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.925+0000 7fa2ffe00640 1 -- 172.21.15.99:0/2620222582 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa300068300 con 0x7fa300186d30 2024-02-21T23:01:19.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.925+0000 7fa2f6a00640 1 -- 172.21.15.99:0/2620222582 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa2f80bad80 con 0x7fa300186d30 2024-02-21T23:01:19.915 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 1 2024-02-21T23:01:19.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.928+0000 7fa2ffe00640 1 -- 172.21.15.99:0/2620222582 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fa2dc09ed60 msgr2=0x7fa2dc0a1220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:19.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.928+0000 7fa2ffe00640 1 --2- 172.21.15.99:0/2620222582 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fa2dc09ed60 0x7fa2dc0a1220 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa2f0009aa0 tx=0x7fa2f0009190 comp rx=0 tx=0).stop 2024-02-21T23:01:19.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.928+0000 7fa2ffe00640 1 -- 172.21.15.99:0/2620222582 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa300186d30 msgr2=0x7fa300163420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:19.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.928+0000 7fa2ffe00640 1 --2- 172.21.15.99:0/2620222582 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa300186d30 0x7fa300163420 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa2f8009e80 tx=0x7fa2f8004a40 comp rx=0 tx=0).stop 2024-02-21T23:01:19.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.929+0000 7fa2ffe00640 1 -- 172.21.15.99:0/2620222582 shutdown_connections 2024-02-21T23:01:19.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.929+0000 7fa2ffe00640 1 --2- 172.21.15.99:0/2620222582 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fa2dc09ed60 0x7fa2dc0a1220 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:19.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.929+0000 7fa2ffe00640 1 --2- 172.21.15.99:0/2620222582 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa300186d30 0x7fa300163420 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:19.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.929+0000 7fa2ffe00640 1 --2- 172.21.15.99:0/2620222582 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa3001648c0 0x7fa30017e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:19.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.929+0000 7fa2ffe00640 1 --2- 172.21.15.99:0/2620222582 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3000fb9e0 0x7fa30017dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:19.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.929+0000 7fa2ffe00640 1 -- 172.21.15.99:0/2620222582 >> 172.21.15.99:0/2620222582 conn(0x7fa3000d29c0 msgr2=0x7fa3000d2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:19.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.929+0000 7fa2ffe00640 1 -- 172.21.15.99:0/2620222582 shutdown_connections 2024-02-21T23:01:19.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:19.929+0000 7fa2ffe00640 1 -- 172.21.15.99:0/2620222582 wait complete. 2024-02-21T23:01:19.935 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-21T23:01:20.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.138+0000 7f3534400640 1 Processor -- start 2024-02-21T23:01:20.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.138+0000 7f3534400640 1 -- start start 2024-02-21T23:01:20.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.140+0000 7f3534400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f352c06e910 0x7f352c0cb420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:20.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.140+0000 7f3534400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f352c0701c0 0x7f352c0cb960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:20.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.140+0000 7f3534400640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f352c06ee40 con 0x7f352c180c80 2024-02-21T23:01:20.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.140+0000 7f3534400640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f352c06f120 con 0x7f352c0701c0 2024-02-21T23:01:20.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.140+0000 7f3534400640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f352c06f400 con 0x7f352c06e910 2024-02-21T23:01:20.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.140+0000 7f3531000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f352c06e910 0x7f352c0cb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:20.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.140+0000 7f3532400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f352c0701c0 0x7f352c0cb960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:20.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.140+0000 7f3531000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f352c06e910 0x7f352c0cb420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:55104/0 (socket says 172.21.15.99:55104) 2024-02-21T23:01:20.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.140+0000 7f3531000640 1 -- 172.21.15.99:0/2494419672 learned_addr learned my addr 172.21.15.99:0/2494419672 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:20.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.140+0000 7f3531a00640 1 --1- 172.21.15.99:0/2494419672 >> v1:172.21.15.181:6789/0 conn(0x7f352c180c80 0x7f352c187f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:48026/0 (socket says 172.21.15.99:48026) 2024-02-21T23:01:20.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.141+0000 7f352be00640 1 -- 172.21.15.99:0/2494419672 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2563998879 0 0) 0x7f352c06ee40 con 0x7f352c180c80 2024-02-21T23:01:20.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.141+0000 7f3532400640 1 -- 172.21.15.99:0/2494419672 >> v2:172.21.15.162:3300/0 conn(0x7f352c06e910 msgr2=0x7f352c0cb420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:20.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.141+0000 7f3532400640 1 --2- 172.21.15.99:0/2494419672 >> v2:172.21.15.162:3300/0 conn(0x7f352c06e910 0x7f352c0cb420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:20.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.141+0000 7f3532400640 1 -- 172.21.15.99:0/2494419672 >> v1:172.21.15.181:6789/0 conn(0x7f352c180c80 legacy=0x7f352c187f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:20.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.141+0000 7f3532400640 1 -- 172.21.15.99:0/2494419672 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f352c06f6e0 con 0x7f352c0701c0 2024-02-21T23:01:20.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.141+0000 7f3531000640 1 --2- 172.21.15.99:0/2494419672 >> v2:172.21.15.162:3300/0 conn(0x7f352c06e910 0x7f352c0cb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:01:20.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.142+0000 7f3532400640 1 --2- 172.21.15.99:0/2494419672 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f352c0701c0 0x7f352c0cb960 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f352c184600 tx=0x7f352402be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d43776a7b9e7124 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:20.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.142+0000 7f352be00640 1 -- 172.21.15.99:0/2494419672 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3524039070 con 0x7f352c0701c0 2024-02-21T23:01:20.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.142+0000 7f352be00640 1 -- 172.21.15.99:0/2494419672 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f352402cbe0 con 0x7f352c0701c0 2024-02-21T23:01:20.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.143+0000 7f352be00640 1 -- 172.21.15.99:0/2494419672 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3524034440 con 0x7f352c0701c0 2024-02-21T23:01:20.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.143+0000 7f3534400640 1 -- 172.21.15.99:0/2494419672 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f352c0701c0 msgr2=0x7f352c0cb960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:20.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.143+0000 7f3534400640 1 --2- 172.21.15.99:0/2494419672 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f352c0701c0 0x7f352c0cb960 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f352c184600 tx=0x7f352402be30 comp rx=0 tx=0).stop 2024-02-21T23:01:20.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.143+0000 7f3534400640 1 -- 172.21.15.99:0/2494419672 shutdown_connections 2024-02-21T23:01:20.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.143+0000 7f3534400640 1 --2- 172.21.15.99:0/2494419672 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f352c0701c0 0x7f352c0cb960 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:20.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.143+0000 7f3534400640 1 --2- 172.21.15.99:0/2494419672 >> v2:172.21.15.162:3300/0 conn(0x7f352c06e910 0x7f352c0cb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:20.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.143+0000 7f3534400640 1 -- 172.21.15.99:0/2494419672 >> 172.21.15.99:0/2494419672 conn(0x7f352c0ce5f0 msgr2=0x7f352c0cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:20.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.143+0000 7f3534400640 1 -- 172.21.15.99:0/2494419672 shutdown_connections 2024-02-21T23:01:20.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.143+0000 7f3534400640 1 -- 172.21.15.99:0/2494419672 wait complete. 2024-02-21T23:01:20.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.145+0000 7f3534400640 1 Processor -- start 2024-02-21T23:01:20.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.145+0000 7f3534400640 1 -- start start 2024-02-21T23:01:20.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.147+0000 7f3534400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f352c06e910 0x7f352c16f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:20.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.147+0000 7f3534400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f352c0701c0 0x7f352c220cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:20.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.147+0000 7f3534400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f352c180c80 0x7f352c17f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:20.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.147+0000 7f3534400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f352c188610 con 0x7f352c180c80 2024-02-21T23:01:20.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.147+0000 7f3534400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f352c06fca0 con 0x7f352c0701c0 2024-02-21T23:01:20.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.147+0000 7f3534400640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f352c0cbea0 con 0x7f352c06e910 2024-02-21T23:01:20.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.147+0000 7f3532400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f352c180c80 0x7f352c17f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:20.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.147+0000 7f3532400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f352c180c80 0x7f352c17f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35630/0 (socket says 172.21.15.99:35630) 2024-02-21T23:01:20.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.147+0000 7f3532400640 1 -- 172.21.15.99:0/1325232075 learned_addr learned my addr 172.21.15.99:0/1325232075 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:20.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.147+0000 7f3531a00640 1 --2- 172.21.15.99:0/1325232075 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f352c06e910 0x7f352c16f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:20.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.147+0000 7f3531000640 1 --2- 172.21.15.99:0/1325232075 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f352c0701c0 0x7f352c220cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:20.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.147+0000 7f3532400640 1 -- 172.21.15.99:0/1325232075 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f352c06e910 msgr2=0x7f352c16f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:20.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.147+0000 7f3532400640 1 --2- 172.21.15.99:0/1325232075 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f352c06e910 0x7f352c16f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:20.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.147+0000 7f3532400640 1 -- 172.21.15.99:0/1325232075 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f352c0701c0 msgr2=0x7f352c220cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:20.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.147+0000 7f3532400640 1 --2- 172.21.15.99:0/1325232075 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f352c0701c0 0x7f352c220cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:20.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.147+0000 7f3532400640 1 -- 172.21.15.99:0/1325232075 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f352c17e640 con 0x7f352c180c80 2024-02-21T23:01:20.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.147+0000 7f3531a00640 1 --2- 172.21.15.99:0/1325232075 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f352c06e910 0x7f352c16f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:01:20.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.148+0000 7f3532400640 1 --2- 172.21.15.99:0/1325232075 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f352c180c80 0x7f352c17f6e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3524009e80 tx=0x7f3524004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:20.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.148+0000 7f3529600640 1 -- 172.21.15.99:0/1325232075 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3524039050 con 0x7f352c180c80 2024-02-21T23:01:20.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.148+0000 7f3529600640 1 -- 172.21.15.99:0/1325232075 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3524045070 con 0x7f352c180c80 2024-02-21T23:01:20.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.148+0000 7f3529600640 1 -- 172.21.15.99:0/1325232075 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3524009450 con 0x7f352c180c80 2024-02-21T23:01:20.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.148+0000 7f3534400640 1 -- 172.21.15.99:0/1325232075 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f352c17e920 con 0x7f352c180c80 2024-02-21T23:01:20.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.148+0000 7f3534400640 1 -- 172.21.15.99:0/1325232075 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f352c17eee0 con 0x7f352c180c80 2024-02-21T23:01:20.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.149+0000 7f3534400640 1 -- 172.21.15.99:0/1325232075 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f352c068780 con 0x7f352c180c80 2024-02-21T23:01:20.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.151+0000 7f3529600640 1 -- 172.21.15.99:0/1325232075 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 134356+0+0 (secure 0 0 0) 0x7f352403e850 con 0x7f352c180c80 2024-02-21T23:01:20.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.152+0000 7f3529600640 1 --2- 172.21.15.99:0/1325232075 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f350c09ed60 0x7f350c0a1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:20.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.153+0000 7f3529600640 1 -- 172.21.15.99:0/1325232075 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f35240ecaf0 con 0x7f352c180c80 2024-02-21T23:01:20.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.153+0000 7f3531a00640 1 --2- 172.21.15.99:0/1325232075 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f350c09ed60 0x7f350c0a1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:20.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.153+0000 7f3531a00640 1 --2- 172.21.15.99:0/1325232075 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f350c09ed60 0x7f350c0a1220 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f351c000f60 tx=0x7f351c007240 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:20.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.162+0000 7f3529600640 1 -- 172.21.15.99:0/1325232075 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f35240bae60 con 0x7f352c180c80 2024-02-21T23:01:20.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.356+0000 7f3534400640 1 -- 172.21.15.99:0/1325232075 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f352c0d2aa0 con 0x7f352c180c80 2024-02-21T23:01:20.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.357+0000 7f3529600640 1 -- 172.21.15.99:0/1325232075 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f35240ba760 con 0x7f352c180c80 2024-02-21T23:01:20.346 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 32 2024-02-21T23:01:20.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.360+0000 7f3534400640 1 -- 172.21.15.99:0/1325232075 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f350c09ed60 msgr2=0x7f350c0a1220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:20.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.360+0000 7f3534400640 1 --2- 172.21.15.99:0/1325232075 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f350c09ed60 0x7f350c0a1220 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f351c000f60 tx=0x7f351c007240 comp rx=0 tx=0).stop 2024-02-21T23:01:20.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.360+0000 7f3534400640 1 -- 172.21.15.99:0/1325232075 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f352c180c80 msgr2=0x7f352c17f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:20.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.360+0000 7f3534400640 1 --2- 172.21.15.99:0/1325232075 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f352c180c80 0x7f352c17f6e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3524009e80 tx=0x7f3524004a40 comp rx=0 tx=0).stop 2024-02-21T23:01:20.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.360+0000 7f3534400640 1 -- 172.21.15.99:0/1325232075 shutdown_connections 2024-02-21T23:01:20.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.360+0000 7f3534400640 1 --2- 172.21.15.99:0/1325232075 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f350c09ed60 0x7f350c0a1220 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:20.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.360+0000 7f3534400640 1 --2- 172.21.15.99:0/1325232075 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f352c180c80 0x7f352c17f6e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:20.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.360+0000 7f3534400640 1 --2- 172.21.15.99:0/1325232075 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f352c0701c0 0x7f352c220cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:20.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.360+0000 7f3534400640 1 --2- 172.21.15.99:0/1325232075 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f352c06e910 0x7f352c16f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:20.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.360+0000 7f3534400640 1 -- 172.21.15.99:0/1325232075 >> 172.21.15.99:0/1325232075 conn(0x7f352c0ce5f0 msgr2=0x7f352c0f7cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:20.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.360+0000 7f3534400640 1 -- 172.21.15.99:0/1325232075 shutdown_connections 2024-02-21T23:01:20.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.360+0000 7f3534400640 1 -- 172.21.15.99:0/1325232075 wait complete. 2024-02-21T23:01:20.372 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-21T23:01:20.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.582+0000 7fbb31800640 1 Processor -- start 2024-02-21T23:01:20.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.582+0000 7fbb31800640 1 -- start start 2024-02-21T23:01:20.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.584+0000 7fbb31800640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb2c0d5730 con 0x7fbb2c0d5330 2024-02-21T23:01:20.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.584+0000 7fbb31800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb2c0cf820 con 0x7fbb2c186400 2024-02-21T23:01:20.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.585+0000 7fbb31800640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb2c0cfb00 con 0x7fbb2c1867e0 2024-02-21T23:01:20.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.585+0000 7fbb2aa00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fbb2c186400 0x7fbb2c187ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.99:49590/0 (socket says 172.21.15.99:49590) 2024-02-21T23:01:20.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.585+0000 7fbb2b400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fbb2c0d5330 0x7fbb2c0cdea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:59078/0 (socket says 172.21.15.99:59078) 2024-02-21T23:01:20.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.585+0000 7fbb2aa00640 1 -- 172.21.15.99:0/1859510510 learned_addr learned my addr 172.21.15.99:0/1859510510 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:01:20.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.585+0000 7fbb2a000640 1 -- 172.21.15.99:0/1859510510 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3098301422 0 0) 0x7fbb2c0cfb00 con 0x7fbb2c1867e0 2024-02-21T23:01:20.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.585+0000 7fbb2a000640 1 -- 172.21.15.99:0/1859510510 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb10003520 con 0x7fbb2c1867e0 2024-02-21T23:01:20.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.585+0000 7fbb2a000640 1 -- 172.21.15.99:0/1859510510 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4039994786 0 0) 0x7fbb2c0cf820 con 0x7fbb2c186400 2024-02-21T23:01:20.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.586+0000 7fbb2a000640 1 -- 172.21.15.99:0/1859510510 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb2c0cfb00 con 0x7fbb2c186400 2024-02-21T23:01:20.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.586+0000 7fbb2a000640 1 -- 172.21.15.99:0/1859510510 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 594607869 0 0) 0x7fbb2c0d5730 con 0x7fbb2c0d5330 2024-02-21T23:01:20.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.586+0000 7fbb2a000640 1 -- 172.21.15.99:0/1859510510 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb2c0cf820 con 0x7fbb2c0d5330 2024-02-21T23:01:20.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.586+0000 7fbb2a000640 1 -- 172.21.15.99:0/1859510510 <== mon.2 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1615009710 0 0) 0x7fbb10003520 con 0x7fbb2c1867e0 2024-02-21T23:01:20.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.586+0000 7fbb2a000640 1 -- 172.21.15.99:0/1859510510 >> v1:172.21.15.162:6789/0 conn(0x7fbb2c186400 legacy=0x7fbb2c187ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:20.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.586+0000 7fbb2a000640 1 -- 172.21.15.99:0/1859510510 >> v1:172.21.15.99:6789/0 conn(0x7fbb2c0d5330 legacy=0x7fbb2c0cdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:20.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.586+0000 7fbb2a000640 1 -- 172.21.15.99:0/1859510510 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb2c186d10 con 0x7fbb2c1867e0 2024-02-21T23:01:20.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.586+0000 7fbb2a000640 1 -- 172.21.15.99:0/1859510510 <== mon.2 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2069890144 0 0) 0x7fbb14001670 con 0x7fbb2c1867e0 2024-02-21T23:01:20.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.586+0000 7fbb2a000640 1 -- 172.21.15.99:0/1859510510 >> v1:172.21.15.181:6789/0 conn(0x7fbb2c1867e0 legacy=0x7fbb2c1881e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:20.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.586+0000 7fbb2a000640 1 --2- 172.21.15.99:0/1859510510 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb10004d80 0x7fbb10005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:20.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.586+0000 7fbb2a000640 1 --2- 172.21.15.99:0/1859510510 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbb10003810 0x7fbb10003c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:20.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.586+0000 7fbb2a000640 1 --2- 172.21.15.99:0/1859510510 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbb100043a0 0x7fbb1000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:20.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.586+0000 7fbb2a000640 1 -- 172.21.15.99:0/1859510510 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1000c310 con 0x7fbb10004d80 2024-02-21T23:01:20.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.586+0000 7fbb2a000640 1 -- 172.21.15.99:0/1859510510 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1000c4c0 con 0x7fbb10003810 2024-02-21T23:01:20.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.586+0000 7fbb2a000640 1 -- 172.21.15.99:0/1859510510 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1000c6c0 con 0x7fbb100043a0 2024-02-21T23:01:20.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.586+0000 7fbb2aa00640 1 --2- 172.21.15.99:0/1859510510 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb10004d80 0x7fbb10005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:20.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.586+0000 7fbb23e00640 1 --2- 172.21.15.99:0/1859510510 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbb10003810 0x7fbb10003c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:20.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.586+0000 7fbb2b400640 1 --2- 172.21.15.99:0/1859510510 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbb100043a0 0x7fbb1000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:20.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.587+0000 7fbb2aa00640 1 -- 172.21.15.99:0/1859510510 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbb100043a0 msgr2=0x7fbb1000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:20.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.587+0000 7fbb2aa00640 1 --2- 172.21.15.99:0/1859510510 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbb100043a0 0x7fbb1000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:20.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.587+0000 7fbb2aa00640 1 -- 172.21.15.99:0/1859510510 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbb10003810 msgr2=0x7fbb10003c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:20.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.587+0000 7fbb2aa00640 1 --2- 172.21.15.99:0/1859510510 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbb10003810 0x7fbb10003c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:20.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.587+0000 7fbb2aa00640 1 -- 172.21.15.99:0/1859510510 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb10003520 con 0x7fbb10004d80 2024-02-21T23:01:20.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.587+0000 7fbb2b400640 1 -- 172.21.15.99:0/1859510510 reap_dead start 2024-02-21T23:01:20.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.588+0000 7fbb2aa00640 1 --2- 172.21.15.99:0/1859510510 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb10004d80 0x7fbb10005160 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c001960 tx=0x7fbb10005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca8f78f8f863c33e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:20.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.588+0000 7fbb2a000640 1 -- 172.21.15.99:0/1859510510 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb1c037070 con 0x7fbb10004d80 2024-02-21T23:01:20.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.588+0000 7fbb2a000640 1 -- 172.21.15.99:0/1859510510 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb1c004aa0 con 0x7fbb10004d80 2024-02-21T23:01:20.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.588+0000 7fbb2a000640 1 -- 172.21.15.99:0/1859510510 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb1c0015b0 con 0x7fbb10004d80 2024-02-21T23:01:20.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.589+0000 7fbb31800640 1 -- 172.21.15.99:0/1859510510 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb10004d80 msgr2=0x7fbb10005160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:20.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.589+0000 7fbb31800640 1 --2- 172.21.15.99:0/1859510510 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb10004d80 0x7fbb10005160 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c001960 tx=0x7fbb10005830 comp rx=0 tx=0).stop 2024-02-21T23:01:20.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.589+0000 7fbb31800640 1 -- 172.21.15.99:0/1859510510 shutdown_connections 2024-02-21T23:01:20.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.589+0000 7fbb31800640 1 --2- 172.21.15.99:0/1859510510 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb10004d80 0x7fbb10005160 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:20.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.589+0000 7fbb31800640 1 -- 172.21.15.99:0/1859510510 >> 172.21.15.99:0/1859510510 conn(0x7fbb2c0d6af0 msgr2=0x7fbb2c0740b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:20.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.589+0000 7fbb31800640 1 -- 172.21.15.99:0/1859510510 shutdown_connections 2024-02-21T23:01:20.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.589+0000 7fbb31800640 1 -- 172.21.15.99:0/1859510510 wait complete. 2024-02-21T23:01:20.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.592+0000 7fbb31800640 1 Processor -- start 2024-02-21T23:01:20.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.593+0000 7fbb31800640 1 -- start start 2024-02-21T23:01:20.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.595+0000 7fbb31800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb10004d80 0x7fbb2c0f9250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:20.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.595+0000 7fbb31800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbb2c222410 0x7fbb2c153e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:20.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.595+0000 7fbb31800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbb2c17c4d0 0x7fbb2c17c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:20.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.595+0000 7fbb31800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2c1872d0 con 0x7fbb10004d80 2024-02-21T23:01:20.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.595+0000 7fbb31800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2c187640 con 0x7fbb2c222410 2024-02-21T23:01:20.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.595+0000 7fbb31800640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2c187ad0 con 0x7fbb2c17c4d0 2024-02-21T23:01:20.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.595+0000 7fbb2aa00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb10004d80 0x7fbb2c0f9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:20.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.595+0000 7fbb2aa00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb10004d80 0x7fbb2c0f9250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35644/0 (socket says 172.21.15.99:35644) 2024-02-21T23:01:20.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.595+0000 7fbb2aa00640 1 -- 172.21.15.99:0/1598508021 learned_addr learned my addr 172.21.15.99:0/1598508021 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:20.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.595+0000 7fbb2b400640 1 --2- 172.21.15.99:0/1598508021 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbb2c17c4d0 0x7fbb2c17c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:20.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.595+0000 7fbb23e00640 1 --2- 172.21.15.99:0/1598508021 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbb2c222410 0x7fbb2c153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:20.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.596+0000 7fbb2aa00640 1 -- 172.21.15.99:0/1598508021 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbb2c17c4d0 msgr2=0x7fbb2c17c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:20.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.596+0000 7fbb2aa00640 1 --2- 172.21.15.99:0/1598508021 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbb2c17c4d0 0x7fbb2c17c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:20.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.596+0000 7fbb2aa00640 1 -- 172.21.15.99:0/1598508021 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbb2c222410 msgr2=0x7fbb2c153e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:20.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.596+0000 7fbb2aa00640 1 --2- 172.21.15.99:0/1598508021 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbb2c222410 0x7fbb2c153e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:20.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.596+0000 7fbb2aa00640 1 -- 172.21.15.99:0/1598508021 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb2c1543d0 con 0x7fbb10004d80 2024-02-21T23:01:20.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.596+0000 7fbb2aa00640 1 --2- 172.21.15.99:0/1598508021 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb10004d80 0x7fbb2c0f9250 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c035040 tx=0x7fbb1c0012b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:20.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.596+0000 7fbb22a00640 1 -- 172.21.15.99:0/1598508021 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb1c042020 con 0x7fbb10004d80 2024-02-21T23:01:20.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.596+0000 7fbb22a00640 1 -- 172.21.15.99:0/1598508021 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb1c0076b0 con 0x7fbb10004d80 2024-02-21T23:01:20.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.596+0000 7fbb22a00640 1 -- 172.21.15.99:0/1598508021 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb1c037030 con 0x7fbb10004d80 2024-02-21T23:01:20.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.596+0000 7fbb31800640 1 -- 172.21.15.99:0/1598508021 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb2c17ce90 con 0x7fbb10004d80 2024-02-21T23:01:20.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.596+0000 7fbb31800640 1 -- 172.21.15.99:0/1598508021 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb2c0f9c90 con 0x7fbb10004d80 2024-02-21T23:01:20.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.598+0000 7fbb31800640 1 -- 172.21.15.99:0/1598508021 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb2c068780 con 0x7fbb10004d80 2024-02-21T23:01:20.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.600+0000 7fbb22a00640 1 -- 172.21.15.99:0/1598508021 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 134356+0+0 (secure 0 0 0) 0x7fbb1c045020 con 0x7fbb10004d80 2024-02-21T23:01:20.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.602+0000 7fbb22a00640 1 --2- 172.21.15.99:0/1598508021 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fbb0809ed90 0x7fbb080a1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:20.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.602+0000 7fbb22a00640 1 -- 172.21.15.99:0/1598508021 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fbb1c0eb960 con 0x7fbb10004d80 2024-02-21T23:01:20.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.602+0000 7fbb23e00640 1 --2- 172.21.15.99:0/1598508021 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fbb0809ed90 0x7fbb080a1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:20.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.603+0000 7fbb23e00640 1 --2- 172.21.15.99:0/1598508021 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fbb0809ed90 0x7fbb080a1250 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbb14001cb0 tx=0x7fbb14009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:20.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.604+0000 7fbb22a00640 1 -- 172.21.15.99:0/1598508021 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fbb1c02e070 con 0x7fbb10004d80 2024-02-21T23:01:20.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.800+0000 7fbb31800640 1 -- 172.21.15.99:0/1598508021 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbb2c18ba70 con 0x7fbb10004d80 2024-02-21T23:01:20.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.801+0000 7fbb22a00640 1 -- 172.21.15.99:0/1598508021 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbb1c0b9560 con 0x7fbb10004d80 2024-02-21T23:01:20.790 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 64 2024-02-21T23:01:20.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.803+0000 7fbb31800640 1 -- 172.21.15.99:0/1598508021 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fbb0809ed90 msgr2=0x7fbb080a1250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:20.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.803+0000 7fbb31800640 1 --2- 172.21.15.99:0/1598508021 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fbb0809ed90 0x7fbb080a1250 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbb14001cb0 tx=0x7fbb14009040 comp rx=0 tx=0).stop 2024-02-21T23:01:20.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.803+0000 7fbb31800640 1 -- 172.21.15.99:0/1598508021 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb10004d80 msgr2=0x7fbb2c0f9250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:20.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.803+0000 7fbb31800640 1 --2- 172.21.15.99:0/1598508021 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb10004d80 0x7fbb2c0f9250 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c035040 tx=0x7fbb1c0012b0 comp rx=0 tx=0).stop 2024-02-21T23:01:20.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.804+0000 7fbb31800640 1 -- 172.21.15.99:0/1598508021 shutdown_connections 2024-02-21T23:01:20.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.804+0000 7fbb31800640 1 --2- 172.21.15.99:0/1598508021 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fbb0809ed90 0x7fbb080a1250 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:20.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.804+0000 7fbb31800640 1 --2- 172.21.15.99:0/1598508021 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbb2c17c4d0 0x7fbb2c17c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:20.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.804+0000 7fbb31800640 1 --2- 172.21.15.99:0/1598508021 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbb2c222410 0x7fbb2c153e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:20.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.804+0000 7fbb31800640 1 --2- 172.21.15.99:0/1598508021 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbb10004d80 0x7fbb2c0f9250 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:20.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.804+0000 7fbb31800640 1 -- 172.21.15.99:0/1598508021 >> 172.21.15.99:0/1598508021 conn(0x7fbb2c0d6af0 msgr2=0x7fbb2c188200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:20.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.804+0000 7fbb31800640 1 -- 172.21.15.99:0/1598508021 shutdown_connections 2024-02-21T23:01:20.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:20.804+0000 7fbb31800640 1 -- 172.21.15.99:0/1598508021 wait complete. 2024-02-21T23:01:20.811 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-02-21T23:01:21.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.033+0000 7f507e000640 1 Processor -- start 2024-02-21T23:01:21.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.033+0000 7f507e000640 1 -- start start 2024-02-21T23:01:21.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.034+0000 7f507e000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50780f5330 con 0x7f50780eed70 2024-02-21T23:01:21.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.034+0000 7f507e000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50780f5610 con 0x7f5078180960 2024-02-21T23:01:21.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.034+0000 7f507e000640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50780f58f0 con 0x7f50781867e0 2024-02-21T23:01:21.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.035+0000 7f5077e00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f50780eed70 0x7f50780ef1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:59092/0 (socket says 172.21.15.99:59092) 2024-02-21T23:01:21.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.035+0000 7f5077e00640 1 -- 172.21.15.99:0/1884952592 learned_addr learned my addr 172.21.15.99:0/1884952592 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:01:21.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.035+0000 7f507d600640 1 --1- 172.21.15.99:0/1884952592 >> v1:172.21.15.181:6789/0 conn(0x7f50781867e0 0x7f5078186c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:48044/0 (socket says 172.21.15.99:48044) 2024-02-21T23:01:21.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.035+0000 7f5077400640 1 -- 172.21.15.99:0/1884952592 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3342986644 0 0) 0x7f50780f58f0 con 0x7f50781867e0 2024-02-21T23:01:21.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.035+0000 7f5077400640 1 -- 172.21.15.99:0/1884952592 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f505c003520 con 0x7f50781867e0 2024-02-21T23:01:21.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.035+0000 7f5077400640 1 -- 172.21.15.99:0/1884952592 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1986525474 0 0) 0x7f50780f5610 con 0x7f5078180960 2024-02-21T23:01:21.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.035+0000 7f5077400640 1 -- 172.21.15.99:0/1884952592 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50780f58f0 con 0x7f5078180960 2024-02-21T23:01:21.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.035+0000 7f5077400640 1 -- 172.21.15.99:0/1884952592 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 36158158 0 0) 0x7f50780f5330 con 0x7f50780eed70 2024-02-21T23:01:21.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.035+0000 7f5077400640 1 -- 172.21.15.99:0/1884952592 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50780f5610 con 0x7f50780eed70 2024-02-21T23:01:21.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.035+0000 7f5077400640 1 -- 172.21.15.99:0/1884952592 <== mon.2 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1772544621 0 0) 0x7f505c003520 con 0x7f50781867e0 2024-02-21T23:01:21.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.035+0000 7f5077400640 1 -- 172.21.15.99:0/1884952592 >> v1:172.21.15.162:6789/0 conn(0x7f5078180960 legacy=0x7f50780f48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:21.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.035+0000 7f5077400640 1 -- 172.21.15.99:0/1884952592 >> v1:172.21.15.99:6789/0 conn(0x7f50780eed70 legacy=0x7f50780ef1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:21.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.036+0000 7f5077400640 1 -- 172.21.15.99:0/1884952592 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50780f5bd0 con 0x7f50781867e0 2024-02-21T23:01:21.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.036+0000 7f5077400640 1 -- 172.21.15.99:0/1884952592 <== mon.2 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2069890144 0 0) 0x7f50700019f0 con 0x7f50781867e0 2024-02-21T23:01:21.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.036+0000 7f5077400640 1 -- 172.21.15.99:0/1884952592 >> v1:172.21.15.181:6789/0 conn(0x7f50781867e0 legacy=0x7f5078186c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:21.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.036+0000 7f5077400640 1 --2- 172.21.15.99:0/1884952592 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f505c004dd0 0x7f505c0051b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:21.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.036+0000 7f5077400640 1 --2- 172.21.15.99:0/1884952592 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f505c003860 0x7f505c003ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:21.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.036+0000 7f5077400640 1 --2- 172.21.15.99:0/1884952592 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f505c0099b0 0x7f505c00bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:21.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.036+0000 7f5077400640 1 -- 172.21.15.99:0/1884952592 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f505c00c390 con 0x7f505c0099b0 2024-02-21T23:01:21.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.036+0000 7f5077400640 1 -- 172.21.15.99:0/1884952592 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f505c00c510 con 0x7f505c004dd0 2024-02-21T23:01:21.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.036+0000 7f5077400640 1 -- 172.21.15.99:0/1884952592 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f505c00c710 con 0x7f505c003860 2024-02-21T23:01:21.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.036+0000 7f507cc00640 1 --2- 172.21.15.99:0/1884952592 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f505c004dd0 0x7f505c0051b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:21.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.036+0000 7f507d600640 1 --2- 172.21.15.99:0/1884952592 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f505c0099b0 0x7f505c00bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:21.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.036+0000 7f5077e00640 1 --2- 172.21.15.99:0/1884952592 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f505c003860 0x7f505c003ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:21.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.036+0000 7f507d600640 1 -- 172.21.15.99:0/1884952592 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f505c003860 msgr2=0x7f505c003ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:21.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.036+0000 7f507d600640 1 --2- 172.21.15.99:0/1884952592 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f505c003860 0x7f505c003ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:21.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.036+0000 7f507d600640 1 -- 172.21.15.99:0/1884952592 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f505c004dd0 msgr2=0x7f505c0051b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:21.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.036+0000 7f507d600640 1 --2- 172.21.15.99:0/1884952592 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f505c004dd0 0x7f505c0051b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:21.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.037+0000 7f507d600640 1 -- 172.21.15.99:0/1884952592 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f505c003520 con 0x7f505c0099b0 2024-02-21T23:01:21.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.037+0000 7f507d600640 1 -- 172.21.15.99:0/1884952592 reap_dead start 2024-02-21T23:01:21.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.038+0000 7f507d600640 1 --2- 172.21.15.99:0/1884952592 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f505c0099b0 0x7f505c00bda0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f507000c4c0 tx=0x7f505c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc6111133fcf0a9f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:21.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.038+0000 7f5077400640 1 -- 172.21.15.99:0/1884952592 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f507000c0e0 con 0x7f505c0099b0 2024-02-21T23:01:21.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.038+0000 7f5077400640 1 -- 172.21.15.99:0/1884952592 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5070030070 con 0x7f505c0099b0 2024-02-21T23:01:21.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.038+0000 7f5077400640 1 -- 172.21.15.99:0/1884952592 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f507002ca80 con 0x7f505c0099b0 2024-02-21T23:01:21.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.038+0000 7f507e000640 1 -- 172.21.15.99:0/1884952592 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f505c0099b0 msgr2=0x7f505c00bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:21.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.038+0000 7f507e000640 1 --2- 172.21.15.99:0/1884952592 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f505c0099b0 0x7f505c00bda0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f507000c4c0 tx=0x7f505c005830 comp rx=0 tx=0).stop 2024-02-21T23:01:21.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.039+0000 7f507e000640 1 -- 172.21.15.99:0/1884952592 shutdown_connections 2024-02-21T23:01:21.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.039+0000 7f507e000640 1 --2- 172.21.15.99:0/1884952592 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f505c0099b0 0x7f505c00bda0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:21.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.039+0000 7f507e000640 1 -- 172.21.15.99:0/1884952592 >> 172.21.15.99:0/1884952592 conn(0x7f50780ce440 msgr2=0x7f50780ce850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:21.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.039+0000 7f507e000640 1 -- 172.21.15.99:0/1884952592 shutdown_connections 2024-02-21T23:01:21.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.039+0000 7f507e000640 1 -- 172.21.15.99:0/1884952592 wait complete. 2024-02-21T23:01:21.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.041+0000 7f507e000640 1 Processor -- start 2024-02-21T23:01:21.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.041+0000 7f507e000640 1 -- start start 2024-02-21T23:01:21.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.042+0000 7f507e000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f505c0099b0 0x7f5078185f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:21.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.042+0000 7f507e000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5078222ca0 0x7f507816a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:21.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.042+0000 7f507e000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5078184650 0x7f507821ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:21.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.042+0000 7f507e000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50780cbc60 con 0x7f5078222ca0 2024-02-21T23:01:21.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.042+0000 7f507e000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50780ee850 con 0x7f505c0099b0 2024-02-21T23:01:21.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.042+0000 7f507e000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50780cbde0 con 0x7f5078184650 2024-02-21T23:01:21.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.042+0000 7f5077e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5078222ca0 0x7f507816a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:21.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.042+0000 7f5077e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5078222ca0 0x7f507816a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35662/0 (socket says 172.21.15.99:35662) 2024-02-21T23:01:21.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.042+0000 7f5077e00640 1 -- 172.21.15.99:0/716630435 learned_addr learned my addr 172.21.15.99:0/716630435 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:21.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.042+0000 7f507cc00640 1 --2- 172.21.15.99:0/716630435 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f505c0099b0 0x7f5078185f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:21.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.043+0000 7f507d600640 1 --2- 172.21.15.99:0/716630435 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5078184650 0x7f507821ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:21.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.043+0000 7f5077e00640 1 -- 172.21.15.99:0/716630435 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5078184650 msgr2=0x7f507821ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:21.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.043+0000 7f5077e00640 1 --2- 172.21.15.99:0/716630435 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5078184650 0x7f507821ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:21.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.043+0000 7f5077e00640 1 -- 172.21.15.99:0/716630435 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f505c0099b0 msgr2=0x7f5078185f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:21.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.043+0000 7f5077e00640 1 --2- 172.21.15.99:0/716630435 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f505c0099b0 0x7f5078185f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:21.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.043+0000 7f5077e00640 1 -- 172.21.15.99:0/716630435 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5078184c10 con 0x7f5078222ca0 2024-02-21T23:01:21.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.043+0000 7f507d600640 1 --2- 172.21.15.99:0/716630435 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5078184650 0x7f507821ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:01:21.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.043+0000 7f507cc00640 1 --2- 172.21.15.99:0/716630435 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f505c0099b0 0x7f5078185f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:01:21.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.043+0000 7f5077e00640 1 --2- 172.21.15.99:0/716630435 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5078222ca0 0x7f507816a3a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5060004f80 tx=0x7f5060001830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:21.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.043+0000 7f5074c00640 1 -- 172.21.15.99:0/716630435 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5060019070 con 0x7f5078222ca0 2024-02-21T23:01:21.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.044+0000 7f5074c00640 1 -- 172.21.15.99:0/716630435 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5060011580 con 0x7f5078222ca0 2024-02-21T23:01:21.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.044+0000 7f507e000640 1 -- 172.21.15.99:0/716630435 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5078184ef0 con 0x7f5078222ca0 2024-02-21T23:01:21.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.044+0000 7f5074c00640 1 -- 172.21.15.99:0/716630435 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5060011970 con 0x7f5078222ca0 2024-02-21T23:01:21.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.044+0000 7f507e000640 1 -- 172.21.15.99:0/716630435 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50781854b0 con 0x7f5078222ca0 2024-02-21T23:01:21.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.045+0000 7f507e000640 1 -- 172.21.15.99:0/716630435 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50780f48f0 con 0x7f5078222ca0 2024-02-21T23:01:21.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.046+0000 7f5074c00640 1 -- 172.21.15.99:0/716630435 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 134356+0+0 (secure 0 0 0) 0x7f506001c070 con 0x7f5078222ca0 2024-02-21T23:01:21.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.048+0000 7f5074c00640 1 --2- 172.21.15.99:0/716630435 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f505409ed60 0x7f50540a1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:21.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.048+0000 7f5074c00640 1 -- 172.21.15.99:0/716630435 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f50600c93d0 con 0x7f5078222ca0 2024-02-21T23:01:21.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.048+0000 7f507cc00640 1 --2- 172.21.15.99:0/716630435 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f505409ed60 0x7f50540a1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:21.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.049+0000 7f507cc00640 1 --2- 172.21.15.99:0/716630435 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f505409ed60 0x7f50540a1220 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5068001b70 tx=0x7f5068009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:21.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.052+0000 7f5074c00640 1 -- 172.21.15.99:0/716630435 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f50780f48f0 con 0x7f5078222ca0 2024-02-21T23:01:21.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.249+0000 7f507e000640 1 -- 172.21.15.99:0/716630435 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f5078068320 con 0x7f5078222ca0 2024-02-21T23:01:21.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.250+0000 7f5074c00640 1 -- 172.21.15.99:0/716630435 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f5060097680 con 0x7f5078222ca0 2024-02-21T23:01:21.239 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 32 2024-02-21T23:01:21.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.253+0000 7f507e000640 1 -- 172.21.15.99:0/716630435 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f505409ed60 msgr2=0x7f50540a1220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:21.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.253+0000 7f507e000640 1 --2- 172.21.15.99:0/716630435 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f505409ed60 0x7f50540a1220 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5068001b70 tx=0x7f5068009040 comp rx=0 tx=0).stop 2024-02-21T23:01:21.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.253+0000 7f507e000640 1 -- 172.21.15.99:0/716630435 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5078222ca0 msgr2=0x7f507816a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:21.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.253+0000 7f507e000640 1 --2- 172.21.15.99:0/716630435 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5078222ca0 0x7f507816a3a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5060004f80 tx=0x7f5060001830 comp rx=0 tx=0).stop 2024-02-21T23:01:21.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.253+0000 7f507e000640 1 -- 172.21.15.99:0/716630435 shutdown_connections 2024-02-21T23:01:21.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.253+0000 7f507e000640 1 --2- 172.21.15.99:0/716630435 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f505409ed60 0x7f50540a1220 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:21.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.253+0000 7f507e000640 1 --2- 172.21.15.99:0/716630435 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5078184650 0x7f507821ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:21.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.253+0000 7f507e000640 1 --2- 172.21.15.99:0/716630435 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5078222ca0 0x7f507816a3a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:21.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.253+0000 7f507e000640 1 --2- 172.21.15.99:0/716630435 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f505c0099b0 0x7f5078185f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:21.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.253+0000 7f507e000640 1 -- 172.21.15.99:0/716630435 >> 172.21.15.99:0/716630435 conn(0x7f50780ce440 msgr2=0x7f50781763e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:21.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.254+0000 7f507e000640 1 -- 172.21.15.99:0/716630435 shutdown_connections 2024-02-21T23:01:21.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.254+0000 7f507e000640 1 -- 172.21.15.99:0/716630435 wait complete. 2024-02-21T23:01:21.261 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-21T23:01:21.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.481+0000 7fa784400640 1 Processor -- start 2024-02-21T23:01:21.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.481+0000 7fa784400640 1 -- start start 2024-02-21T23:01:21.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.483+0000 7fa784400640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fa77c1865c0 0x7fa77c188190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:21.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.483+0000 7fa784400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa77c0d4300 0x7fa77c0d4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:21.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.483+0000 7fa784400640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa77c186a50 con 0x7fa77c1861e0 2024-02-21T23:01:21.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.483+0000 7fa784400640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa77c186d50 con 0x7fa77c0d4300 2024-02-21T23:01:21.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.483+0000 7fa784400640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa77c1875f0 con 0x7fa77c1865c0 2024-02-21T23:01:21.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.483+0000 7fa781a00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fa77c1861e0 0x7fa77c187a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:59106/0 (socket says 172.21.15.99:59106) 2024-02-21T23:01:21.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.483+0000 7fa781a00640 1 -- 172.21.15.99:0/1306314933 learned_addr learned my addr 172.21.15.99:0/1306314933 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:01:21.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.484+0000 7fa781000640 1 --2- 172.21.15.99:0/1306314933 >> v2:172.21.15.181:3300/0 conn(0x7fa77c1865c0 0x7fa77c188190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:21.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.484+0000 7fa782400640 1 --2- 172.21.15.99:0/1306314933 >> v2:172.21.15.162:3300/0 conn(0x7fa77c0d4300 0x7fa77c0d4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:21.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.484+0000 7fa77be00640 1 -- 172.21.15.99:0/1306314933 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3610430928 0 0) 0x7fa77c186a50 con 0x7fa77c1861e0 2024-02-21T23:01:21.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.484+0000 7fa781000640 1 -- 172.21.15.99:0/1306314933 >> v2:172.21.15.162:3300/0 conn(0x7fa77c0d4300 msgr2=0x7fa77c0d4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:21.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.484+0000 7fa781000640 1 --2- 172.21.15.99:0/1306314933 >> v2:172.21.15.162:3300/0 conn(0x7fa77c0d4300 0x7fa77c0d4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:21.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.484+0000 7fa781000640 1 -- 172.21.15.99:0/1306314933 >> v1:172.21.15.99:6789/0 conn(0x7fa77c1861e0 legacy=0x7fa77c187a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:21.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.484+0000 7fa781000640 1 -- 172.21.15.99:0/1306314933 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa77c1886d0 con 0x7fa77c1865c0 2024-02-21T23:01:21.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.485+0000 7fa781000640 1 --2- 172.21.15.99:0/1306314933 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa77c1865c0 0x7fa77c188190 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa77c0cdb70 tx=0x7fa76802b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34108dd5055db746 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:21.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.485+0000 7fa77be00640 1 -- 172.21.15.99:0/1306314933 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7680315a0 con 0x7fa77c1865c0 2024-02-21T23:01:21.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.486+0000 7fa77be00640 1 -- 172.21.15.99:0/1306314933 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa768037070 con 0x7fa77c1865c0 2024-02-21T23:01:21.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.486+0000 7fa77be00640 1 -- 172.21.15.99:0/1306314933 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa768031960 con 0x7fa77c1865c0 2024-02-21T23:01:21.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.486+0000 7fa784400640 1 -- 172.21.15.99:0/1306314933 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa77c1865c0 msgr2=0x7fa77c188190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:21.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.486+0000 7fa784400640 1 --2- 172.21.15.99:0/1306314933 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa77c1865c0 0x7fa77c188190 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa77c0cdb70 tx=0x7fa76802b840 comp rx=0 tx=0).stop 2024-02-21T23:01:21.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.486+0000 7fa784400640 1 -- 172.21.15.99:0/1306314933 shutdown_connections 2024-02-21T23:01:21.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.486+0000 7fa784400640 1 --2- 172.21.15.99:0/1306314933 >> v2:172.21.15.162:3300/0 conn(0x7fa77c0d4300 0x7fa77c0d4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:21.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.486+0000 7fa784400640 1 --2- 172.21.15.99:0/1306314933 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa77c1865c0 0x7fa77c188190 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:21.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.486+0000 7fa784400640 1 -- 172.21.15.99:0/1306314933 >> 172.21.15.99:0/1306314933 conn(0x7fa77c0d6ac0 msgr2=0x7fa77c0740b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:21.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.486+0000 7fa784400640 1 -- 172.21.15.99:0/1306314933 shutdown_connections 2024-02-21T23:01:21.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.486+0000 7fa784400640 1 -- 172.21.15.99:0/1306314933 wait complete. 2024-02-21T23:01:21.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.488+0000 7fa784400640 1 Processor -- start 2024-02-21T23:01:21.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.489+0000 7fa784400640 1 -- start start 2024-02-21T23:01:21.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.490+0000 7fa784400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa77c0d4300 0x7fa77c172d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:21.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.490+0000 7fa784400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa77c1861e0 0x7fa77c171a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:21.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.490+0000 7fa784400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa77c1865c0 0x7fa77c179d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:21.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.490+0000 7fa784400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa77c186fa0 con 0x7fa77c0d4300 2024-02-21T23:01:21.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.490+0000 7fa784400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa77c0cfac0 con 0x7fa77c1861e0 2024-02-21T23:01:21.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.490+0000 7fa784400640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa77c187280 con 0x7fa77c1865c0 2024-02-21T23:01:21.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.490+0000 7fa781a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa77c0d4300 0x7fa77c172d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:21.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.490+0000 7fa781a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa77c0d4300 0x7fa77c172d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35676/0 (socket says 172.21.15.99:35676) 2024-02-21T23:01:21.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.490+0000 7fa781a00640 1 -- 172.21.15.99:0/556571361 learned_addr learned my addr 172.21.15.99:0/556571361 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:21.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.490+0000 7fa782400640 1 --2- 172.21.15.99:0/556571361 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa77c1865c0 0x7fa77c179d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:21.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.490+0000 7fa781000640 1 --2- 172.21.15.99:0/556571361 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa77c1861e0 0x7fa77c171a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:21.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.490+0000 7fa781a00640 1 -- 172.21.15.99:0/556571361 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa77c1865c0 msgr2=0x7fa77c179d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:21.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.490+0000 7fa781a00640 1 --2- 172.21.15.99:0/556571361 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa77c1865c0 0x7fa77c179d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:21.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.490+0000 7fa781a00640 1 -- 172.21.15.99:0/556571361 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa77c1861e0 msgr2=0x7fa77c171a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:21.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.490+0000 7fa781a00640 1 --2- 172.21.15.99:0/556571361 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa77c1861e0 0x7fa77c171a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:21.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.491+0000 7fa781a00640 1 -- 172.21.15.99:0/556571361 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa77c178a10 con 0x7fa77c0d4300 2024-02-21T23:01:21.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.491+0000 7fa782400640 1 --2- 172.21.15.99:0/556571361 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa77c1865c0 0x7fa77c179d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:01:21.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.491+0000 7fa781000640 1 --2- 172.21.15.99:0/556571361 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa77c1861e0 0x7fa77c171a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:01:21.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.491+0000 7fa781a00640 1 --2- 172.21.15.99:0/556571361 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa77c0d4300 0x7fa77c172d40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa77000c420 tx=0x7fa77000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:21.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.491+0000 7fa779600640 1 -- 172.21.15.99:0/556571361 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7700074e0 con 0x7fa77c0d4300 2024-02-21T23:01:21.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.491+0000 7fa779600640 1 -- 172.21.15.99:0/556571361 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7700047e0 con 0x7fa77c0d4300 2024-02-21T23:01:21.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.491+0000 7fa784400640 1 -- 172.21.15.99:0/556571361 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa77c178cb0 con 0x7fa77c0d4300 2024-02-21T23:01:21.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.491+0000 7fa779600640 1 -- 172.21.15.99:0/556571361 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa770004c10 con 0x7fa77c0d4300 2024-02-21T23:01:21.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.491+0000 7fa784400640 1 -- 172.21.15.99:0/556571361 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa77c179270 con 0x7fa77c0d4300 2024-02-21T23:01:21.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.493+0000 7fa784400640 1 -- 172.21.15.99:0/556571361 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa77c0d0aa0 con 0x7fa77c0d4300 2024-02-21T23:01:21.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.494+0000 7fa779600640 1 -- 172.21.15.99:0/556571361 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 134356+0+0 (secure 0 0 0) 0x7fa770011070 con 0x7fa77c0d4300 2024-02-21T23:01:21.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.496+0000 7fa779600640 1 --2- 172.21.15.99:0/556571361 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fa75c09ed60 0x7fa75c0a1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:21.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.496+0000 7fa779600640 1 -- 172.21.15.99:0/556571361 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fa7700c95a0 con 0x7fa77c0d4300 2024-02-21T23:01:21.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.496+0000 7fa781000640 1 --2- 172.21.15.99:0/556571361 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fa75c09ed60 0x7fa75c0a1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:21.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.497+0000 7fa781000640 1 --2- 172.21.15.99:0/556571361 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fa75c09ed60 0x7fa75c0a1220 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa768036000 tx=0x7fa76803d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:21.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.499+0000 7fa779600640 1 -- 172.21.15.99:0/556571361 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fa770097880 con 0x7fa77c0d4300 2024-02-21T23:01:21.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.708+0000 7fa784400640 1 -- 172.21.15.99:0/556571361 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa77c0ce550 con 0x7fa77c0d4300 2024-02-21T23:01:21.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.709+0000 7fa779600640 1 -- 172.21.15.99:0/556571361 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa770097180 con 0x7fa77c0d4300 2024-02-21T23:01:21.698 INFO:teuthology.orchestra.run.smithi099.stderr:listed 0 entries 2024-02-21T23:01:21.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.711+0000 7fa784400640 1 -- 172.21.15.99:0/556571361 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fa75c09ed60 msgr2=0x7fa75c0a1220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:21.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.711+0000 7fa784400640 1 --2- 172.21.15.99:0/556571361 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fa75c09ed60 0x7fa75c0a1220 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa768036000 tx=0x7fa76803d040 comp rx=0 tx=0).stop 2024-02-21T23:01:21.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.711+0000 7fa784400640 1 -- 172.21.15.99:0/556571361 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa77c0d4300 msgr2=0x7fa77c172d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:21.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.711+0000 7fa784400640 1 --2- 172.21.15.99:0/556571361 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa77c0d4300 0x7fa77c172d40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa77000c420 tx=0x7fa77000c8e0 comp rx=0 tx=0).stop 2024-02-21T23:01:21.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.711+0000 7fa784400640 1 -- 172.21.15.99:0/556571361 shutdown_connections 2024-02-21T23:01:21.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.711+0000 7fa784400640 1 --2- 172.21.15.99:0/556571361 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fa75c09ed60 0x7fa75c0a1220 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:21.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.711+0000 7fa784400640 1 --2- 172.21.15.99:0/556571361 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa77c1865c0 0x7fa77c179d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:21.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.711+0000 7fa784400640 1 --2- 172.21.15.99:0/556571361 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa77c1861e0 0x7fa77c171a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:21.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.711+0000 7fa784400640 1 --2- 172.21.15.99:0/556571361 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa77c0d4300 0x7fa77c172d40 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:21.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.711+0000 7fa784400640 1 -- 172.21.15.99:0/556571361 >> 172.21.15.99:0/556571361 conn(0x7fa77c0d6ac0 msgr2=0x7fa77c0cf030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:21.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.712+0000 7fa784400640 1 -- 172.21.15.99:0/556571361 shutdown_connections 2024-02-21T23:01:21.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:21.712+0000 7fa784400640 1 -- 172.21.15.99:0/556571361 wait complete. 2024-02-21T23:01:21.717 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi099.front.sepia.ceph.com... 2024-02-21T23:01:21.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T23:01:21.718 DEBUG:teuthology.orchestra.run.smithi099:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-02-21T23:01:21.791 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi099.stderr:ceph-fuse[42246]: fuse finished with error 0 and tester_r 0 2024-02-21T23:01:21.796 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T23:01:27.898 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi099.front.sepia.ceph.com 2024-02-21T23:01:27.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T23:01:27.898 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-02-21T23:01:27.964 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T23:01:28.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.210+0000 7fc763c00640 1 Processor -- start 2024-02-21T23:01:28.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.210+0000 7fc763c00640 1 -- start start 2024-02-21T23:01:28.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.212+0000 7fc763c00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fc75c184cd0 0x7fc75c06e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:28.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.212+0000 7fc763c00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc75c0f8c40 con 0x7fc75c0f8730 2024-02-21T23:01:28.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.212+0000 7fc763c00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc75c0f8f20 con 0x7fc75c1833f0 2024-02-21T23:01:28.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.212+0000 7fc763c00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc75c186a10 con 0x7fc75c184cd0 2024-02-21T23:01:28.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.212+0000 7fc75be00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fc75c0f8730 0x7fc75c1845c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:47298/0 (socket says 172.21.15.99:47298) 2024-02-21T23:01:28.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.212+0000 7fc75be00640 1 -- 172.21.15.99:0/4218860629 learned_addr learned my addr 172.21.15.99:0/4218860629 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:01:28.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.212+0000 7fc761c00640 1 --2- 172.21.15.99:0/4218860629 >> v2:172.21.15.181:3300/0 conn(0x7fc75c184cd0 0x7fc75c06e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:28.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.213+0000 7fc75b400640 1 -- 172.21.15.99:0/4218860629 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4064356419 0 0) 0x7fc75c0f8f20 con 0x7fc75c1833f0 2024-02-21T23:01:28.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.213+0000 7fc75b400640 1 -- 172.21.15.99:0/4218860629 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc744003520 con 0x7fc75c1833f0 2024-02-21T23:01:28.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.213+0000 7fc761c00640 1 -- 172.21.15.99:0/4218860629 >> v1:172.21.15.181:6789/0 conn(0x7fc75c1833f0 legacy=0x7fc75c0f8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:28.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.213+0000 7fc761c00640 1 -- 172.21.15.99:0/4218860629 >> v1:172.21.15.99:6789/0 conn(0x7fc75c0f8730 legacy=0x7fc75c1845c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:28.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.213+0000 7fc761c00640 1 -- 172.21.15.99:0/4218860629 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc75c183ae0 con 0x7fc75c184cd0 2024-02-21T23:01:28.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.213+0000 7fc75b400640 1 -- 172.21.15.99:0/4218860629 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1922802242 0 0) 0x7fc75c0f8c40 con 0x7fc75c0f8730 2024-02-21T23:01:28.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.214+0000 7fc761c00640 1 --2- 172.21.15.99:0/4218860629 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc75c184cd0 0x7fc75c06e310 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc754009d90 tx=0x7fc75402beb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce8c1051e0da120f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:28.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.214+0000 7fc75b400640 1 -- 172.21.15.99:0/4218860629 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc754039070 con 0x7fc75c184cd0 2024-02-21T23:01:28.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.215+0000 7fc75b400640 1 -- 172.21.15.99:0/4218860629 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc75402cc60 con 0x7fc75c184cd0 2024-02-21T23:01:28.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.215+0000 7fc75b400640 1 -- 172.21.15.99:0/4218860629 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc754034660 con 0x7fc75c184cd0 2024-02-21T23:01:28.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.215+0000 7fc763c00640 1 -- 172.21.15.99:0/4218860629 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc75c184cd0 msgr2=0x7fc75c06e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:28.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.215+0000 7fc763c00640 1 --2- 172.21.15.99:0/4218860629 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc75c184cd0 0x7fc75c06e310 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc754009d90 tx=0x7fc75402beb0 comp rx=0 tx=0).stop 2024-02-21T23:01:28.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.215+0000 7fc763c00640 1 -- 172.21.15.99:0/4218860629 shutdown_connections 2024-02-21T23:01:28.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.215+0000 7fc763c00640 1 --2- 172.21.15.99:0/4218860629 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc75c184cd0 0x7fc75c06e310 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:28.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.215+0000 7fc763c00640 1 -- 172.21.15.99:0/4218860629 >> 172.21.15.99:0/4218860629 conn(0x7fc75c0ce5f0 msgr2=0x7fc75c0cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:28.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.215+0000 7fc763c00640 1 -- 172.21.15.99:0/4218860629 shutdown_connections 2024-02-21T23:01:28.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.215+0000 7fc763c00640 1 -- 172.21.15.99:0/4218860629 wait complete. 2024-02-21T23:01:28.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.217+0000 7fc763c00640 1 Processor -- start 2024-02-21T23:01:28.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.217+0000 7fc763c00640 1 -- start start 2024-02-21T23:01:28.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.219+0000 7fc763c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc75c0f8730 0x7fc75c1827a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:28.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.219+0000 7fc763c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc75c1833f0 0x7fc75c0ca710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:28.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.219+0000 7fc763c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc75c184cd0 0x7fc75c21f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:28.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.219+0000 7fc763c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc75c185160 con 0x7fc75c184cd0 2024-02-21T23:01:28.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.219+0000 7fc763c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc75c1840a0 con 0x7fc75c0f8730 2024-02-21T23:01:28.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.219+0000 7fc763c00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc75c06e850 con 0x7fc75c1833f0 2024-02-21T23:01:28.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.219+0000 7fc761c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc75c184cd0 0x7fc75c21f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:28.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.219+0000 7fc761c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc75c184cd0 0x7fc75c21f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:43232/0 (socket says 172.21.15.99:43232) 2024-02-21T23:01:28.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.219+0000 7fc761c00640 1 -- 172.21.15.99:0/1823351613 learned_addr learned my addr 172.21.15.99:0/1823351613 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:28.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.219+0000 7fc75be00640 1 --2- 172.21.15.99:0/1823351613 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc75c1833f0 0x7fc75c0ca710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:28.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.219+0000 7fc761200640 1 --2- 172.21.15.99:0/1823351613 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc75c0f8730 0x7fc75c1827a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:28.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.219+0000 7fc761c00640 1 -- 172.21.15.99:0/1823351613 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc75c1833f0 msgr2=0x7fc75c0ca710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:28.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.219+0000 7fc761c00640 1 --2- 172.21.15.99:0/1823351613 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc75c1833f0 0x7fc75c0ca710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:28.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.219+0000 7fc761c00640 1 -- 172.21.15.99:0/1823351613 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc75c0f8730 msgr2=0x7fc75c1827a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:28.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.219+0000 7fc761c00640 1 --2- 172.21.15.99:0/1823351613 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc75c0f8730 0x7fc75c1827a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:28.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.219+0000 7fc761c00640 1 -- 172.21.15.99:0/1823351613 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc75c181740 con 0x7fc75c184cd0 2024-02-21T23:01:28.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.220+0000 7fc761c00640 1 --2- 172.21.15.99:0/1823351613 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc75c184cd0 0x7fc75c21f510 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc754009d90 tx=0x7fc754004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:28.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.220+0000 7fc758c00640 1 -- 172.21.15.99:0/1823351613 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc754039050 con 0x7fc75c184cd0 2024-02-21T23:01:28.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.220+0000 7fc758c00640 1 -- 172.21.15.99:0/1823351613 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc75403a040 con 0x7fc75c184cd0 2024-02-21T23:01:28.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.220+0000 7fc758c00640 1 -- 172.21.15.99:0/1823351613 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc754009450 con 0x7fc75c184cd0 2024-02-21T23:01:28.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.220+0000 7fc763c00640 1 -- 172.21.15.99:0/1823351613 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc75c16fea0 con 0x7fc75c184cd0 2024-02-21T23:01:28.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.220+0000 7fc763c00640 1 -- 172.21.15.99:0/1823351613 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc75c181cc0 con 0x7fc75c184cd0 2024-02-21T23:01:28.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.222+0000 7fc763c00640 1 -- 172.21.15.99:0/1823351613 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc75c0d2aa0 con 0x7fc75c184cd0 2024-02-21T23:01:28.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.223+0000 7fc758c00640 1 -- 172.21.15.99:0/1823351613 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 134356+0+0 (secure 0 0 0) 0x7fc754047020 con 0x7fc75c184cd0 2024-02-21T23:01:28.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.224+0000 7fc758c00640 1 --2- 172.21.15.99:0/1823351613 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fc73c09ed60 0x7fc73c0a1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:28.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.225+0000 7fc758c00640 1 -- 172.21.15.99:0/1823351613 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fc7540ebda0 con 0x7fc75c184cd0 2024-02-21T23:01:28.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.225+0000 7fc761200640 1 --2- 172.21.15.99:0/1823351613 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fc73c09ed60 0x7fc73c0a1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:28.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.226+0000 7fc761200640 1 --2- 172.21.15.99:0/1823351613 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fc73c09ed60 0x7fc73c0a1220 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc7500011e0 tx=0x7fc750009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:28.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.233+0000 7fc758c00640 1 -- 172.21.15.99:0/1823351613 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fc75404e020 con 0x7fc75c184cd0 2024-02-21T23:01:28.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.432+0000 7fc763c00640 1 -- 172.21.15.99:0/1823351613 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc75c0fafd0 con 0x7fc75c184cd0 2024-02-21T23:01:28.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.434+0000 7fc758c00640 1 -- 172.21.15.99:0/1823351613 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+23570 (secure 0 0 0) 0x7fc7540b9ff0 con 0x7fc75c184cd0 2024-02-21T23:01:28.424 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T23:01:28.424 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":29,"fsid":"e8af98cd-45a1-425f-96a7-f24da8ee4efb","created":"2024-02-21T23:00:44.699708+0000","modified":"2024-02-21T23:01:07.722511+0000","last_up_change":"2024-02-21T23:00:55.749829+0000","last_in_change":"2024-02-21T23:00:48.332297+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T23:00:57.020557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":11.760000228881836,"score_stable":11.760000228881836,"optimal_score":0.17000000178813934,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-21T23:01:01.124398+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-21T23:01:01.684258+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-21T23:01:05.290089+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c49de9b2-dc53-4882-b14c-7059ed40bf59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6809","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6811","nonce":1026112937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6813","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6815","nonce":1026112937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6823","nonce":1026112937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6819","nonce":1026112937}]},"public_addr":"172.21.15.99:6811/1026112937","cluster_addr":"172.21.15.99:6815/1026112937","heartbeat_back_addr":"172.21.15.99:6823/1026112937","heartbeat_front_addr":"172.21.15.99:6819/1026112937","state":["exists","up"]},{"osd":1,"uuid":"58398292-2fe5-4291-94fd-03a0ca29d49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6827","nonce":3030871566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6829","nonce":3030871566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6833","nonce":3030871566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6831","nonce":3030871566}]},"public_addr":"172.21.15.162:6827/3030871566","cluster_addr":"172.21.15.162:6829/3030871566","heartbeat_back_addr":"172.21.15.162:6833/3030871566","heartbeat_front_addr":"172.21.15.162:6831/3030871566","state":["exists","up"]},{"osd":2,"uuid":"94cddec1-e08f-438d-a7c8-48a0e47d71a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6818","nonce":2782386148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6821","nonce":2782386148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6827","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6829","nonce":2782386148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6823","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6825","nonce":2782386148}]},"public_addr":"172.21.15.181:6818/2782386148","cluster_addr":"172.21.15.181:6821/2782386148","heartbeat_back_addr":"172.21.15.181:6829/2782386148","heartbeat_front_addr":"172.21.15.181:6825/2782386148","state":["exists","up"]},{"osd":3,"uuid":"d29abb74-9b89-4fd7-88b1-7c2eb8231189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6801","nonce":2316185310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6803","nonce":2316185310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6807","nonce":2316185310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6805","nonce":2316185310}]},"public_addr":"172.21.15.99:6801/2316185310","cluster_addr":"172.21.15.99:6803/2316185310","heartbeat_back_addr":"172.21.15.99:6807/2316185310","heartbeat_front_addr":"172.21.15.99:6805/2316185310","state":["exists","up"]},{"osd":4,"uuid":"0d8c9ea3-880a-4d69-9dcb-cf7d35abd449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6811","nonce":3137681258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6813","nonce":3137681258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6817","nonce":3137681258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6815","nonce":3137681258}]},"public_addr":"172.21.15.162:6811/3137681258","cluster_addr":"172.21.15.162:6813/3137681258","heartbeat_back_addr":"172.21.15.162:6817/3137681258","heartbeat_front_addr":"172.21.15.162:6815/3137681258","state":["exists","up"]},{"osd":5,"uuid":"2e3a9340-6fd0-4d7a-8e00-fe305649296e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6801","nonce":2011264527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6803","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6805","nonce":2011264527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6811","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6813","nonce":2011264527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6807","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6809","nonce":2011264527}]},"public_addr":"172.21.15.181:6801/2011264527","cluster_addr":"172.21.15.181:6805/2011264527","heartbeat_back_addr":"172.21.15.181:6813/2011264527","heartbeat_front_addr":"172.21.15.181:6809/2011264527","state":["exists","up"]},{"osd":6,"uuid":"d9e37ce7-1b0e-4019-8f2e-b670403abf7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6810","nonce":753870050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6814","nonce":753870050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6822","nonce":753870050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6818","nonce":753870050}]},"public_addr":"172.21.15.99:6810/753870050","cluster_addr":"172.21.15.99:6814/753870050","heartbeat_back_addr":"172.21.15.99:6822/753870050","heartbeat_front_addr":"172.21.15.99:6818/753870050","state":["exists","up"]},{"osd":7,"uuid":"49988754-232e-4b8c-bd72-bfa25b418e5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6803","nonce":1659412949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6805","nonce":1659412949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6809","nonce":1659412949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6807","nonce":1659412949}]},"public_addr":"172.21.15.162:6803/1659412949","cluster_addr":"172.21.15.162:6805/1659412949","heartbeat_back_addr":"172.21.15.162:6809/1659412949","heartbeat_front_addr":"172.21.15.162:6807/1659412949","state":["exists","up"]},{"osd":8,"uuid":"ebc6e462-8368-4d64-b242-9c8735ac672c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6804","nonce":3389807042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6808","nonce":3389807042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6815","nonce":3389807042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6812","nonce":3389807042}]},"public_addr":"172.21.15.181:6804/3389807042","cluster_addr":"172.21.15.181:6808/3389807042","heartbeat_back_addr":"172.21.15.181:6815/3389807042","heartbeat_front_addr":"172.21.15.181:6812/3389807042","state":["exists","up"]},{"osd":9,"uuid":"72af1b02-b965-4d6a-8964-527ec24c4daa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6825","nonce":4055669590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6827","nonce":4055669590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6831","nonce":4055669590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6829","nonce":4055669590}]},"public_addr":"172.21.15.99:6825/4055669590","cluster_addr":"172.21.15.99:6827/4055669590","heartbeat_back_addr":"172.21.15.99:6831/4055669590","heartbeat_front_addr":"172.21.15.99:6829/4055669590","state":["exists","up"]},{"osd":10,"uuid":"adb5cb06-6453-41e4-b847-d7c78bbb7d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6819","nonce":1421879617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6821","nonce":1421879617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6825","nonce":1421879617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6823","nonce":1421879617}]},"public_addr":"172.21.15.162:6819/1421879617","cluster_addr":"172.21.15.162:6821/1421879617","heartbeat_back_addr":"172.21.15.162:6825/1421879617","heartbeat_front_addr":"172.21.15.162:6823/1421879617","state":["exists","up"]},{"osd":11,"uuid":"118563d9-1e8f-4dc7-a92c-2f4c4dc3e20f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6817","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6819","nonce":3219928272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6824","nonce":3219928272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6831","nonce":3219928272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6828","nonce":3219928272}]},"public_addr":"172.21.15.181:6819/3219928272","cluster_addr":"172.21.15.181:6824/3219928272","heartbeat_back_addr":"172.21.15.181:6831/3219928272","heartbeat_front_addr":"172.21.15.181:6828/3219928272","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.651219+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.549859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.529659+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.591004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.440836+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.414250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.630130+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.411954+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.439371+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.428173+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.511203+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.482806+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T23:01:28.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.437+0000 7fc763c00640 1 -- 172.21.15.99:0/1823351613 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fc73c09ed60 msgr2=0x7fc73c0a1220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:28.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.437+0000 7fc763c00640 1 --2- 172.21.15.99:0/1823351613 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fc73c09ed60 0x7fc73c0a1220 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc7500011e0 tx=0x7fc750009040 comp rx=0 tx=0).stop 2024-02-21T23:01:28.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.437+0000 7fc763c00640 1 -- 172.21.15.99:0/1823351613 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc75c184cd0 msgr2=0x7fc75c21f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:28.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.437+0000 7fc763c00640 1 --2- 172.21.15.99:0/1823351613 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc75c184cd0 0x7fc75c21f510 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc754009d90 tx=0x7fc754004a40 comp rx=0 tx=0).stop 2024-02-21T23:01:28.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.437+0000 7fc763c00640 1 -- 172.21.15.99:0/1823351613 shutdown_connections 2024-02-21T23:01:28.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.437+0000 7fc763c00640 1 --2- 172.21.15.99:0/1823351613 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fc73c09ed60 0x7fc73c0a1220 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:28.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.437+0000 7fc763c00640 1 --2- 172.21.15.99:0/1823351613 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc75c184cd0 0x7fc75c21f510 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:28.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.437+0000 7fc763c00640 1 --2- 172.21.15.99:0/1823351613 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc75c1833f0 0x7fc75c0ca710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:28.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.437+0000 7fc763c00640 1 --2- 172.21.15.99:0/1823351613 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc75c0f8730 0x7fc75c1827a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:28.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.437+0000 7fc763c00640 1 -- 172.21.15.99:0/1823351613 >> 172.21.15.99:0/1823351613 conn(0x7fc75c0ce5f0 msgr2=0x7fc75c0ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:28.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.438+0000 7fc763c00640 1 -- 172.21.15.99:0/1823351613 shutdown_connections 2024-02-21T23:01:28.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.438+0000 7fc763c00640 1 -- 172.21.15.99:0/1823351613 wait complete. 2024-02-21T23:01:28.444 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T23:01:28.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.658+0000 7fb60ca00640 1 Processor -- start 2024-02-21T23:01:28.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.658+0000 7fb60ca00640 1 -- start start 2024-02-21T23:01:28.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.661+0000 7fb60ca00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb608186b90 0x7fb608186f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:28.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.662+0000 7fb60ca00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb6081874b0 0x7fb60818a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:28.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.662+0000 7fb60ca00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb60817d980 con 0x7fb60818a930 2024-02-21T23:01:28.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.662+0000 7fb60ca00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb608185950 con 0x7fb6081874b0 2024-02-21T23:01:28.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.662+0000 7fb60ca00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb608185c30 con 0x7fb608186b90 2024-02-21T23:01:28.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.662+0000 7fb605400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb6081874b0 0x7fb60818a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:28.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.662+0000 7fb605e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb608186b90 0x7fb608186f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:28.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.662+0000 7fb605e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb608186b90 0x7fb608186f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:56924/0 (socket says 172.21.15.99:56924) 2024-02-21T23:01:28.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.662+0000 7fb605e00640 1 -- 172.21.15.99:0/720190470 learned_addr learned my addr 172.21.15.99:0/720190470 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:28.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.662+0000 7fb605400640 1 -- 172.21.15.99:0/720190470 >> v2:172.21.15.162:3300/0 conn(0x7fb608186b90 msgr2=0x7fb608186f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:28.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.662+0000 7fb605400640 1 --2- 172.21.15.99:0/720190470 >> v2:172.21.15.162:3300/0 conn(0x7fb608186b90 0x7fb608186f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:28.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.663+0000 7fb605400640 1 -- 172.21.15.99:0/720190470 >> v1:172.21.15.181:6789/0 conn(0x7fb60818a930 legacy=0x7fb608184a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:28.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.663+0000 7fb605400640 1 -- 172.21.15.99:0/720190470 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb608185f10 con 0x7fb6081874b0 2024-02-21T23:01:28.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.663+0000 7fb604a00640 1 -- 172.21.15.99:0/720190470 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2847237984 0 0) 0x7fb60817d980 con 0x7fb60818a930 2024-02-21T23:01:28.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.664+0000 7fb605400640 1 --2- 172.21.15.99:0/720190470 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb6081874b0 0x7fb60818a3f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb6080670d0 tx=0x7fb5f402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0273d6e3fcab372 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:28.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.664+0000 7fb604a00640 1 -- 172.21.15.99:0/720190470 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f4035020 con 0x7fb6081874b0 2024-02-21T23:01:28.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.664+0000 7fb604a00640 1 -- 172.21.15.99:0/720190470 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5f4031830 con 0x7fb6081874b0 2024-02-21T23:01:28.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.664+0000 7fb604a00640 1 -- 172.21.15.99:0/720190470 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f4031c00 con 0x7fb6081874b0 2024-02-21T23:01:28.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.665+0000 7fb60ca00640 1 -- 172.21.15.99:0/720190470 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb6081874b0 msgr2=0x7fb60818a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:28.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.665+0000 7fb60ca00640 1 --2- 172.21.15.99:0/720190470 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb6081874b0 0x7fb60818a3f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb6080670d0 tx=0x7fb5f402b8d0 comp rx=0 tx=0).stop 2024-02-21T23:01:28.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.665+0000 7fb60ca00640 1 -- 172.21.15.99:0/720190470 shutdown_connections 2024-02-21T23:01:28.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.665+0000 7fb60ca00640 1 --2- 172.21.15.99:0/720190470 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb6081874b0 0x7fb60818a3f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:28.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.665+0000 7fb60ca00640 1 --2- 172.21.15.99:0/720190470 >> v2:172.21.15.162:3300/0 conn(0x7fb608186b90 0x7fb608186f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:28.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.665+0000 7fb60ca00640 1 -- 172.21.15.99:0/720190470 >> 172.21.15.99:0/720190470 conn(0x7fb6080ce5f0 msgr2=0x7fb6080cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:28.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.665+0000 7fb60ca00640 1 -- 172.21.15.99:0/720190470 shutdown_connections 2024-02-21T23:01:28.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.665+0000 7fb60ca00640 1 -- 172.21.15.99:0/720190470 wait complete. 2024-02-21T23:01:28.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.667+0000 7fb60ca00640 1 Processor -- start 2024-02-21T23:01:28.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.667+0000 7fb60ca00640 1 -- start start 2024-02-21T23:01:28.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.668+0000 7fb60ca00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb608186b90 0x7fb60817be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:28.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.668+0000 7fb60ca00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6081874b0 0x7fb608166dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:28.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.668+0000 7fb60ca00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb60818a930 0x7fb608167310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:28.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.668+0000 7fb60ca00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6081867b0 con 0x7fb60818a930 2024-02-21T23:01:28.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.668+0000 7fb60ca00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6081864d0 con 0x7fb6081874b0 2024-02-21T23:01:28.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.668+0000 7fb60ca00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6080cbf20 con 0x7fb608186b90 2024-02-21T23:01:28.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.669+0000 7fb606800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb60818a930 0x7fb608167310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:28.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.669+0000 7fb605400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6081874b0 0x7fb608166dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:28.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.669+0000 7fb605e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb608186b90 0x7fb60817be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:28.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.669+0000 7fb605e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb608186b90 0x7fb60817be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:50006/0 (socket says 172.21.15.99:50006) 2024-02-21T23:01:28.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.669+0000 7fb605400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6081874b0 0x7fb608166dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:56926/0 (socket says 172.21.15.99:56926) 2024-02-21T23:01:28.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.669+0000 7fb606800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb60818a930 0x7fb608167310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:43250/0 (socket says 172.21.15.99:43250) 2024-02-21T23:01:28.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.669+0000 7fb605e00640 1 -- 172.21.15.99:0/3419890221 learned_addr learned my addr 172.21.15.99:0/3419890221 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:28.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.669+0000 7fb606800640 1 -- 172.21.15.99:0/3419890221 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb608186b90 msgr2=0x7fb60817be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:28.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.669+0000 7fb606800640 1 --2- 172.21.15.99:0/3419890221 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb608186b90 0x7fb60817be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:28.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.669+0000 7fb606800640 1 -- 172.21.15.99:0/3419890221 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6081874b0 msgr2=0x7fb608166dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:28.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.669+0000 7fb606800640 1 --2- 172.21.15.99:0/3419890221 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6081874b0 0x7fb608166dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:28.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.669+0000 7fb606800640 1 -- 172.21.15.99:0/3419890221 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6082204c0 con 0x7fb60818a930 2024-02-21T23:01:28.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.669+0000 7fb605e00640 1 --2- 172.21.15.99:0/3419890221 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb608186b90 0x7fb60817be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:01:28.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.669+0000 7fb605400640 1 --2- 172.21.15.99:0/3419890221 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6081874b0 0x7fb608166dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:01:28.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.669+0000 7fb606800640 1 --2- 172.21.15.99:0/3419890221 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb60818a930 0x7fb608167310 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb60000c6a0 tx=0x7fb60000cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:28.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.670+0000 7fb5fe000640 1 -- 172.21.15.99:0/3419890221 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb600003b70 con 0x7fb60818a930 2024-02-21T23:01:28.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.670+0000 7fb5fe000640 1 -- 172.21.15.99:0/3419890221 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb600003d30 con 0x7fb60818a930 2024-02-21T23:01:28.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.670+0000 7fb60ca00640 1 -- 172.21.15.99:0/3419890221 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb60816e370 con 0x7fb60818a930 2024-02-21T23:01:28.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.670+0000 7fb5fe000640 1 -- 172.21.15.99:0/3419890221 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6000052b0 con 0x7fb60818a930 2024-02-21T23:01:28.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.670+0000 7fb60ca00640 1 -- 172.21.15.99:0/3419890221 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb60816e930 con 0x7fb60818a930 2024-02-21T23:01:28.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.671+0000 7fb60ca00640 1 -- 172.21.15.99:0/3419890221 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6080cc1c0 con 0x7fb60818a930 2024-02-21T23:01:28.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.673+0000 7fb5fe000640 1 -- 172.21.15.99:0/3419890221 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 134356+0+0 (secure 0 0 0) 0x7fb600005450 con 0x7fb60818a930 2024-02-21T23:01:28.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.674+0000 7fb5fe000640 1 --2- 172.21.15.99:0/3419890221 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fb5e809ed60 0x7fb5e80a1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:28.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.674+0000 7fb5fe000640 1 -- 172.21.15.99:0/3419890221 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fb6000c98f0 con 0x7fb60818a930 2024-02-21T23:01:28.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.675+0000 7fb605e00640 1 --2- 172.21.15.99:0/3419890221 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fb5e809ed60 0x7fb5e80a1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:28.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.675+0000 7fb605e00640 1 --2- 172.21.15.99:0/3419890221 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fb5e809ed60 0x7fb5e80a1220 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8006f40 tx=0x7fb5f8009240 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:28.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.678+0000 7fb5fe000640 1 -- 172.21.15.99:0/3419890221 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fb600097b40 con 0x7fb60818a930 2024-02-21T23:01:28.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.874+0000 7fb60ca00640 1 -- 172.21.15.99:0/3419890221 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb608072ad0 con 0x7fb60818a930 2024-02-21T23:01:28.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.877+0000 7fb5fe000640 1 -- 172.21.15.99:0/3419890221 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+23570 (secure 0 0 0) 0x7fb600097440 con 0x7fb60818a930 2024-02-21T23:01:28.866 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T23:01:28.866 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":29,"fsid":"e8af98cd-45a1-425f-96a7-f24da8ee4efb","created":"2024-02-21T23:00:44.699708+0000","modified":"2024-02-21T23:01:07.722511+0000","last_up_change":"2024-02-21T23:00:55.749829+0000","last_in_change":"2024-02-21T23:00:48.332297+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T23:00:57.020557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":11.760000228881836,"score_stable":11.760000228881836,"optimal_score":0.17000000178813934,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-21T23:01:01.124398+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-21T23:01:01.684258+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-21T23:01:05.290089+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c49de9b2-dc53-4882-b14c-7059ed40bf59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6809","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6811","nonce":1026112937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6813","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6815","nonce":1026112937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6823","nonce":1026112937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6819","nonce":1026112937}]},"public_addr":"172.21.15.99:6811/1026112937","cluster_addr":"172.21.15.99:6815/1026112937","heartbeat_back_addr":"172.21.15.99:6823/1026112937","heartbeat_front_addr":"172.21.15.99:6819/1026112937","state":["exists","up"]},{"osd":1,"uuid":"58398292-2fe5-4291-94fd-03a0ca29d49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6827","nonce":3030871566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6829","nonce":3030871566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6833","nonce":3030871566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6831","nonce":3030871566}]},"public_addr":"172.21.15.162:6827/3030871566","cluster_addr":"172.21.15.162:6829/3030871566","heartbeat_back_addr":"172.21.15.162:6833/3030871566","heartbeat_front_addr":"172.21.15.162:6831/3030871566","state":["exists","up"]},{"osd":2,"uuid":"94cddec1-e08f-438d-a7c8-48a0e47d71a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6818","nonce":2782386148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6821","nonce":2782386148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6827","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6829","nonce":2782386148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6823","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6825","nonce":2782386148}]},"public_addr":"172.21.15.181:6818/2782386148","cluster_addr":"172.21.15.181:6821/2782386148","heartbeat_back_addr":"172.21.15.181:6829/2782386148","heartbeat_front_addr":"172.21.15.181:6825/2782386148","state":["exists","up"]},{"osd":3,"uuid":"d29abb74-9b89-4fd7-88b1-7c2eb8231189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6801","nonce":2316185310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6803","nonce":2316185310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6807","nonce":2316185310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6805","nonce":2316185310}]},"public_addr":"172.21.15.99:6801/2316185310","cluster_addr":"172.21.15.99:6803/2316185310","heartbeat_back_addr":"172.21.15.99:6807/2316185310","heartbeat_front_addr":"172.21.15.99:6805/2316185310","state":["exists","up"]},{"osd":4,"uuid":"0d8c9ea3-880a-4d69-9dcb-cf7d35abd449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6811","nonce":3137681258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6813","nonce":3137681258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6817","nonce":3137681258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6815","nonce":3137681258}]},"public_addr":"172.21.15.162:6811/3137681258","cluster_addr":"172.21.15.162:6813/3137681258","heartbeat_back_addr":"172.21.15.162:6817/3137681258","heartbeat_front_addr":"172.21.15.162:6815/3137681258","state":["exists","up"]},{"osd":5,"uuid":"2e3a9340-6fd0-4d7a-8e00-fe305649296e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6801","nonce":2011264527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6803","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6805","nonce":2011264527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6811","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6813","nonce":2011264527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6807","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6809","nonce":2011264527}]},"public_addr":"172.21.15.181:6801/2011264527","cluster_addr":"172.21.15.181:6805/2011264527","heartbeat_back_addr":"172.21.15.181:6813/2011264527","heartbeat_front_addr":"172.21.15.181:6809/2011264527","state":["exists","up"]},{"osd":6,"uuid":"d9e37ce7-1b0e-4019-8f2e-b670403abf7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6810","nonce":753870050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6814","nonce":753870050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6822","nonce":753870050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6818","nonce":753870050}]},"public_addr":"172.21.15.99:6810/753870050","cluster_addr":"172.21.15.99:6814/753870050","heartbeat_back_addr":"172.21.15.99:6822/753870050","heartbeat_front_addr":"172.21.15.99:6818/753870050","state":["exists","up"]},{"osd":7,"uuid":"49988754-232e-4b8c-bd72-bfa25b418e5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6803","nonce":1659412949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6805","nonce":1659412949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6809","nonce":1659412949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6807","nonce":1659412949}]},"public_addr":"172.21.15.162:6803/1659412949","cluster_addr":"172.21.15.162:6805/1659412949","heartbeat_back_addr":"172.21.15.162:6809/1659412949","heartbeat_front_addr":"172.21.15.162:6807/1659412949","state":["exists","up"]},{"osd":8,"uuid":"ebc6e462-8368-4d64-b242-9c8735ac672c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6804","nonce":3389807042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6808","nonce":3389807042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6815","nonce":3389807042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6812","nonce":3389807042}]},"public_addr":"172.21.15.181:6804/3389807042","cluster_addr":"172.21.15.181:6808/3389807042","heartbeat_back_addr":"172.21.15.181:6815/3389807042","heartbeat_front_addr":"172.21.15.181:6812/3389807042","state":["exists","up"]},{"osd":9,"uuid":"72af1b02-b965-4d6a-8964-527ec24c4daa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6825","nonce":4055669590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6827","nonce":4055669590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6831","nonce":4055669590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6829","nonce":4055669590}]},"public_addr":"172.21.15.99:6825/4055669590","cluster_addr":"172.21.15.99:6827/4055669590","heartbeat_back_addr":"172.21.15.99:6831/4055669590","heartbeat_front_addr":"172.21.15.99:6829/4055669590","state":["exists","up"]},{"osd":10,"uuid":"adb5cb06-6453-41e4-b847-d7c78bbb7d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6819","nonce":1421879617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6821","nonce":1421879617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6825","nonce":1421879617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6823","nonce":1421879617}]},"public_addr":"172.21.15.162:6819/1421879617","cluster_addr":"172.21.15.162:6821/1421879617","heartbeat_back_addr":"172.21.15.162:6825/1421879617","heartbeat_front_addr":"172.21.15.162:6823/1421879617","state":["exists","up"]},{"osd":11,"uuid":"118563d9-1e8f-4dc7-a92c-2f4c4dc3e20f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6817","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6819","nonce":3219928272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6824","nonce":3219928272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6831","nonce":3219928272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6828","nonce":3219928272}]},"public_addr":"172.21.15.181:6819/3219928272","cluster_addr":"172.21.15.181:6824/3219928272","heartbeat_back_addr":"172.21.15.181:6831/3219928272","heartbeat_front_addr":"172.21.15.181:6828/3219928272","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.651219+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.549859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.529659+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.591004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.440836+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.414250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.630130+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.411954+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.439371+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.428173+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.511203+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.482806+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T23:01:28.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.879+0000 7fb60ca00640 1 -- 172.21.15.99:0/3419890221 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fb5e809ed60 msgr2=0x7fb5e80a1220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:28.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.879+0000 7fb60ca00640 1 --2- 172.21.15.99:0/3419890221 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fb5e809ed60 0x7fb5e80a1220 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8006f40 tx=0x7fb5f8009240 comp rx=0 tx=0).stop 2024-02-21T23:01:28.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.879+0000 7fb60ca00640 1 -- 172.21.15.99:0/3419890221 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb60818a930 msgr2=0x7fb608167310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:28.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.879+0000 7fb60ca00640 1 --2- 172.21.15.99:0/3419890221 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb60818a930 0x7fb608167310 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb60000c6a0 tx=0x7fb60000cb60 comp rx=0 tx=0).stop 2024-02-21T23:01:28.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.879+0000 7fb60ca00640 1 -- 172.21.15.99:0/3419890221 shutdown_connections 2024-02-21T23:01:28.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.879+0000 7fb60ca00640 1 --2- 172.21.15.99:0/3419890221 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fb5e809ed60 0x7fb5e80a1220 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:28.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.879+0000 7fb60ca00640 1 --2- 172.21.15.99:0/3419890221 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb60818a930 0x7fb608167310 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:28.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.879+0000 7fb60ca00640 1 --2- 172.21.15.99:0/3419890221 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6081874b0 0x7fb608166dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:28.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.879+0000 7fb60ca00640 1 --2- 172.21.15.99:0/3419890221 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb608186b90 0x7fb60817be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:28.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.879+0000 7fb60ca00640 1 -- 172.21.15.99:0/3419890221 >> 172.21.15.99:0/3419890221 conn(0x7fb6080ce5f0 msgr2=0x7fb6080ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:28.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.879+0000 7fb60ca00640 1 -- 172.21.15.99:0/3419890221 shutdown_connections 2024-02-21T23:01:28.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:28.880+0000 7fb60ca00640 1 -- 172.21.15.99:0/3419890221 wait complete. 2024-02-21T23:01:28.886 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-02-21T23:01:29.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:29.098+0000 7f281e200640 1 Processor -- start 2024-02-21T23:01:29.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:29.098+0000 7f281e200640 1 -- start start 2024-02-21T23:01:29.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:29.100+0000 7f281e200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f28180d3740 0x7f28180f90f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:29.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:29.100+0000 7f281e200640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f28180f9630 0x7f2818187050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:29.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:29.100+0000 7f281e200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28180f9f30 con 0x7f2818182dd0 2024-02-21T23:01:29.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:29.100+0000 7f281e200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28180fa210 con 0x7f28180d3740 2024-02-21T23:01:29.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:29.100+0000 7f281e200640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28180fa4f0 con 0x7f28180f9630 2024-02-21T23:01:29.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:29.100+0000 7f2817e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f28180d3740 0x7f28180f90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:29.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:29.101+0000 7f281ce00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f2818182dd0 0x7f28180d3030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.99:41990/0 (socket says 172.21.15.99:41990) 2024-02-21T23:01:29.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:29.101+0000 7f281ce00640 1 -- 172.21.15.99:0/484215812 learned_addr learned my addr 172.21.15.99:0/484215812 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:01:29.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:29.101+0000 7f281d800640 1 --2- 172.21.15.99:0/484215812 >> v2:172.21.15.181:3300/0 conn(0x7f28180f9630 0x7f2818187050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:29.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:29.101+0000 7f2817e00640 1 -- 172.21.15.99:0/484215812 >> v2:172.21.15.181:3300/0 conn(0x7f28180f9630 msgr2=0x7f2818187050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:29.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:29.101+0000 7f2817e00640 1 --2- 172.21.15.99:0/484215812 >> v2:172.21.15.181:3300/0 conn(0x7f28180f9630 0x7f2818187050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:29.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:29.101+0000 7f2817e00640 1 -- 172.21.15.99:0/484215812 >> v1:172.21.15.162:6789/0 conn(0x7f2818182dd0 legacy=0x7f28180d3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:29.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:29.101+0000 7f2817e00640 1 -- 172.21.15.99:0/484215812 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28180fa7d0 con 0x7f28180d3740 2024-02-21T23:01:29.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:29.101+0000 7f2817400640 1 -- 172.21.15.99:0/484215812 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1309256021 0 0) 0x7f28180f9f30 con 0x7f2818182dd0 2024-02-21T23:01:29.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:29.102+0000 7f2817e00640 1 --2- 172.21.15.99:0/484215812 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28180d3740 0x7f28180f90f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f28180f5400 tx=0x7f280402b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b594a17b0b9b6600 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:29.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:29.102+0000 7f2817400640 1 -- 172.21.15.99:0/484215812 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2804038070 con 0x7f28180d3740 2024-02-21T23:01:29.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:29.102+0000 7f2817400640 1 -- 172.21.15.99:0/484215812 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2804031520 con 0x7f28180d3740 2024-02-21T23:01:29.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:29.102+0000 7f2817400640 1 -- 172.21.15.99:0/484215812 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28040318f0 con 0x7f28180d3740 2024-02-21T23:01:29.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:29.103+0000 7f281e200640 1 -- 172.21.15.99:0/484215812 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28180d3740 msgr2=0x7f28180f90f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:29.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:29.103+0000 7f281e200640 1 --2- 172.21.15.99:0/484215812 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28180d3740 0x7f28180f90f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f28180f5400 tx=0x7f280402b7c0 comp rx=0 tx=0).stop 2024-02-21T23:01:29.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:29.103+0000 7f281e200640 1 -- 172.21.15.99:0/484215812 shutdown_connections 2024-02-21T23:01:29.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:29.103+0000 7f281e200640 1 --2- 172.21.15.99:0/484215812 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28180d3740 0x7f28180f90f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:29.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:29.103+0000 7f281e200640 1 --2- 172.21.15.99:0/484215812 >> v2:172.21.15.181:3300/0 conn(0x7f28180f9630 0x7f2818187050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:29.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:29.103+0000 7f281e200640 1 -- 172.21.15.99:0/484215812 >> 172.21.15.99:0/484215812 conn(0x7f281808cfd0 msgr2=0x7f281808d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:29.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:29.103+0000 7f281e200640 1 -- 172.21.15.99:0/484215812 shutdown_connections 2024-02-21T23:01:29.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:29.103+0000 7f281e200640 1 -- 172.21.15.99:0/484215812 wait complete. 2024-02-21T23:01:29.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:29.105+0000 7f281e200640 1 Processor -- start 2024-02-21T23:01:29.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:29.105+0000 7f281e200640 1 -- start start 2024-02-21T23:01:29.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:29.106+0000 7f281e200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f28180d3740 0x7f28181602b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:29.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:29.106+0000 7f281e200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28180f9630 0x7f28182212c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:29.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:29.106+0000 7f281e200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28181607f0 0x7f2818221800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:29.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:29.106+0000 7f281e200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28180f9a60 con 0x7f28181607f0 2024-02-21T23:01:29.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:29.106+0000 7f281e200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2818186b30 con 0x7f28180f9630 2024-02-21T23:01:29.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:29.106+0000 7f281e200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28180f9be0 con 0x7f28180d3740 2024-02-21T23:01:29.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:29.107+0000 7f281d800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28181607f0 0x7f2818221800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:29.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:29.107+0000 7f281ce00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f28180d3740 0x7f28181602b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:29.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:29.107+0000 7f2817e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28180f9630 0x7f28182212c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:29.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:29.107+0000 7f281d800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28181607f0 0x7f2818221800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:43274/0 (socket says 172.21.15.99:43274) 2024-02-21T23:01:29.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:29.107+0000 7f281d800640 1 -- 172.21.15.99:0/2323870264 learned_addr learned my addr 172.21.15.99:0/2323870264 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:29.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:29.107+0000 7f281ce00640 1 -- 172.21.15.99:0/2323870264 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28180f9630 msgr2=0x7f28182212c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:29.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:29.107+0000 7f281ce00640 1 --2- 172.21.15.99:0/2323870264 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28180f9630 0x7f28182212c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:29.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:29.107+0000 7f281ce00640 1 -- 172.21.15.99:0/2323870264 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28181607f0 msgr2=0x7f2818221800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:29.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:29.107+0000 7f281ce00640 1 --2- 172.21.15.99:0/2323870264 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28181607f0 0x7f2818221800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:29.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:29.107+0000 7f281ce00640 1 -- 172.21.15.99:0/2323870264 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2818220220 con 0x7f28180d3740 2024-02-21T23:01:29.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:29.107+0000 7f281d800640 1 --2- 172.21.15.99:0/2323870264 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28181607f0 0x7f2818221800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:01:29.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:29.108+0000 7f281ce00640 1 --2- 172.21.15.99:0/2323870264 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f28180d3740 0x7f28181602b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f280c00c3e0 tx=0x7f280c00c8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:29.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:29.108+0000 7f2814c00640 1 -- 172.21.15.99:0/2323870264 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f280c0074e0 con 0x7f28180d3740 2024-02-21T23:01:29.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:29.108+0000 7f2814c00640 1 -- 172.21.15.99:0/2323870264 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f280c007680 con 0x7f28180d3740 2024-02-21T23:01:29.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:29.108+0000 7f2814c00640 1 -- 172.21.15.99:0/2323870264 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f280c004a20 con 0x7f28180d3740 2024-02-21T23:01:29.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:29.108+0000 7f281e200640 1 -- 172.21.15.99:0/2323870264 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2818220500 con 0x7f28180d3740 2024-02-21T23:01:29.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:29.108+0000 7f281e200640 1 -- 172.21.15.99:0/2323870264 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2818220ac0 con 0x7f28180d3740 2024-02-21T23:01:29.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:29.109+0000 7f281e200640 1 -- 172.21.15.99:0/2323870264 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2818068320 con 0x7f28180d3740 2024-02-21T23:01:29.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:29.111+0000 7f2814c00640 1 -- 172.21.15.99:0/2323870264 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) v1 ==== 134356+0+0 (secure 0 0 0) 0x7f280c011070 con 0x7f28180d3740 2024-02-21T23:01:29.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:29.112+0000 7f2814c00640 1 --2- 172.21.15.99:0/2323870264 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f27f809ed60 0x7f27f80a1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:29.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:29.113+0000 7f2814c00640 1 -- 172.21.15.99:0/2323870264 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f280c0c9c80 con 0x7f28180d3740 2024-02-21T23:01:29.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:29.113+0000 7f2817e00640 1 --2- 172.21.15.99:0/2323870264 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f27f809ed60 0x7f27f80a1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:29.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:29.113+0000 7f2817e00640 1 --2- 172.21.15.99:0/2323870264 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f27f809ed60 0x7f27f80a1220 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2804035000 tx=0x7f2804030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:29.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:29.115+0000 7f2814c00640 1 -- 172.21.15.99:0/2323870264 <== mon.2 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f280c097ed0 con 0x7f28180d3740 2024-02-21T23:01:29.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:29.349+0000 7f281e200640 1 -- 172.21.15.99:0/2323870264 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f28180680b0 con 0x7f28180d3740 2024-02-21T23:01:30.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.347+0000 7f2814c00640 1 -- 172.21.15.99:0/2323870264 <== mon.2 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7f280c0977d0 con 0x7f28180d3740 2024-02-21T23:01:30.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.350+0000 7f281e200640 1 -- 172.21.15.99:0/2323870264 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f27f809ed60 msgr2=0x7f27f80a1220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:30.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.350+0000 7f281e200640 1 --2- 172.21.15.99:0/2323870264 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f27f809ed60 0x7f27f80a1220 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2804035000 tx=0x7f2804030000 comp rx=0 tx=0).stop 2024-02-21T23:01:30.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.350+0000 7f281e200640 1 -- 172.21.15.99:0/2323870264 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f28180d3740 msgr2=0x7f28181602b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:30.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.350+0000 7f281e200640 1 --2- 172.21.15.99:0/2323870264 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f28180d3740 0x7f28181602b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f280c00c3e0 tx=0x7f280c00c8a0 comp rx=0 tx=0).stop 2024-02-21T23:01:30.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.350+0000 7f281e200640 1 -- 172.21.15.99:0/2323870264 shutdown_connections 2024-02-21T23:01:30.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.350+0000 7f281e200640 1 --2- 172.21.15.99:0/2323870264 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f27f809ed60 0x7f27f80a1220 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:30.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.350+0000 7f281e200640 1 --2- 172.21.15.99:0/2323870264 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28181607f0 0x7f2818221800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:30.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.350+0000 7f281e200640 1 --2- 172.21.15.99:0/2323870264 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28180f9630 0x7f28182212c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:30.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.350+0000 7f281e200640 1 --2- 172.21.15.99:0/2323870264 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f28180d3740 0x7f28181602b0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:30.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.350+0000 7f281e200640 1 -- 172.21.15.99:0/2323870264 >> 172.21.15.99:0/2323870264 conn(0x7f281808cfd0 msgr2=0x7f28181820b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:30.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.350+0000 7f281e200640 1 -- 172.21.15.99:0/2323870264 shutdown_connections 2024-02-21T23:01:30.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.350+0000 7f281e200640 1 -- 172.21.15.99:0/2323870264 wait complete. 2024-02-21T23:01:30.359 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-02-21T23:01:30.359 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2024-02-21T23:01:30.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.572+0000 7f8f60800640 1 Processor -- start 2024-02-21T23:01:30.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.572+0000 7f8f60800640 1 -- start start 2024-02-21T23:01:30.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.574+0000 7f8f60800640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f580d5730 con 0x7f8f580d5330 2024-02-21T23:01:30.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.574+0000 7f8f60800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f580cf820 con 0x7f8f581867e0 2024-02-21T23:01:30.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.574+0000 7f8f60800640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f580cfb00 con 0x7f8f58186400 2024-02-21T23:01:30.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.575+0000 7f8f5e800640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f8f580d5330 0x7f8f580cdea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:47304/0 (socket says 172.21.15.99:47304) 2024-02-21T23:01:30.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.575+0000 7f8f5e800640 1 -- 172.21.15.99:0/415440162 learned_addr learned my addr 172.21.15.99:0/415440162 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:01:30.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.575+0000 7f8f5de00640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f8f58186400 0x7f8f58187ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:41370/0 (socket says 172.21.15.99:41370) 2024-02-21T23:01:30.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.575+0000 7f8f5ca00640 1 -- 172.21.15.99:0/415440162 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3533625435 0 0) 0x7f8f580cf820 con 0x7f8f581867e0 2024-02-21T23:01:30.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.575+0000 7f8f5ca00640 1 -- 172.21.15.99:0/415440162 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f40003520 con 0x7f8f581867e0 2024-02-21T23:01:30.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.575+0000 7f8f5ca00640 1 -- 172.21.15.99:0/415440162 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1949856164 0 0) 0x7f8f580cfb00 con 0x7f8f58186400 2024-02-21T23:01:30.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.575+0000 7f8f5ca00640 1 -- 172.21.15.99:0/415440162 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f580cf820 con 0x7f8f58186400 2024-02-21T23:01:30.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.575+0000 7f8f5ca00640 1 -- 172.21.15.99:0/415440162 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1366190084 0 0) 0x7f8f580d5730 con 0x7f8f580d5330 2024-02-21T23:01:30.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.575+0000 7f8f5ca00640 1 -- 172.21.15.99:0/415440162 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f580cfb00 con 0x7f8f580d5330 2024-02-21T23:01:30.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.576+0000 7f8f5ca00640 1 -- 172.21.15.99:0/415440162 <== mon.1 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2288142228 0 0) 0x7f8f40003520 con 0x7f8f581867e0 2024-02-21T23:01:30.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.576+0000 7f8f5ca00640 1 -- 172.21.15.99:0/415440162 >> v1:172.21.15.181:6789/0 conn(0x7f8f58186400 legacy=0x7f8f58187ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:30.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.576+0000 7f8f5ca00640 1 -- 172.21.15.99:0/415440162 >> v1:172.21.15.99:6789/0 conn(0x7f8f580d5330 legacy=0x7f8f580cdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:30.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.576+0000 7f8f5ca00640 1 -- 172.21.15.99:0/415440162 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f58186d10 con 0x7f8f581867e0 2024-02-21T23:01:30.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.576+0000 7f8f5ca00640 1 -- 172.21.15.99:0/415440162 <== mon.1 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2069890144 0 0) 0x7f8f44001670 con 0x7f8f581867e0 2024-02-21T23:01:30.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.576+0000 7f8f5ca00640 1 -- 172.21.15.99:0/415440162 >> v1:172.21.15.162:6789/0 conn(0x7f8f581867e0 legacy=0x7f8f581881e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:30.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.576+0000 7f8f5ca00640 1 --2- 172.21.15.99:0/415440162 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f40004e00 0x7f8f400051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:30.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.576+0000 7f8f5ca00640 1 --2- 172.21.15.99:0/415440162 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8f400038b0 0x7f8f40003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:30.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.576+0000 7f8f5ca00640 1 --2- 172.21.15.99:0/415440162 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8f400099b0 0x7f8f4000bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:30.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.576+0000 7f8f5ca00640 1 -- 172.21.15.99:0/415440162 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4000c390 con 0x7f8f400099b0 2024-02-21T23:01:30.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.576+0000 7f8f5ca00640 1 -- 172.21.15.99:0/415440162 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4000c540 con 0x7f8f40004e00 2024-02-21T23:01:30.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.576+0000 7f8f5ca00640 1 -- 172.21.15.99:0/415440162 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4000c740 con 0x7f8f400038b0 2024-02-21T23:01:30.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.576+0000 7f8f5e800640 1 --2- 172.21.15.99:0/415440162 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8f400099b0 0x7f8f4000bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:30.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.576+0000 7f8f5de00640 1 --2- 172.21.15.99:0/415440162 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f40004e00 0x7f8f400051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:30.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.576+0000 7f8f5d400640 1 --2- 172.21.15.99:0/415440162 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8f400038b0 0x7f8f40003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:30.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.577+0000 7f8f5e800640 1 -- 172.21.15.99:0/415440162 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8f400038b0 msgr2=0x7f8f40003d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:30.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.577+0000 7f8f5e800640 1 --2- 172.21.15.99:0/415440162 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8f400038b0 0x7f8f40003d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:30.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.577+0000 7f8f5e800640 1 -- 172.21.15.99:0/415440162 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f40004e00 msgr2=0x7f8f400051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:30.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.577+0000 7f8f5e800640 1 --2- 172.21.15.99:0/415440162 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f40004e00 0x7f8f400051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:30.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.577+0000 7f8f5e800640 1 -- 172.21.15.99:0/415440162 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f40003520 con 0x7f8f400099b0 2024-02-21T23:01:30.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.577+0000 7f8f5e800640 1 -- 172.21.15.99:0/415440162 reap_dead start 2024-02-21T23:01:30.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.578+0000 7f8f5e800640 1 --2- 172.21.15.99:0/415440162 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8f400099b0 0x7f8f4000bda0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8f5400c240 tx=0x7f8f40005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b492f38ee51f5ac0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:30.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.578+0000 7f8f5ca00640 1 -- 172.21.15.99:0/415440162 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f54001fa0 con 0x7f8f400099b0 2024-02-21T23:01:30.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.578+0000 7f8f5ca00640 1 -- 172.21.15.99:0/415440162 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f54030070 con 0x7f8f400099b0 2024-02-21T23:01:30.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.578+0000 7f8f5ca00640 1 -- 172.21.15.99:0/415440162 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f5402cd30 con 0x7f8f400099b0 2024-02-21T23:01:30.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.578+0000 7f8f60800640 1 -- 172.21.15.99:0/415440162 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8f400099b0 msgr2=0x7f8f4000bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:30.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.578+0000 7f8f60800640 1 --2- 172.21.15.99:0/415440162 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8f400099b0 0x7f8f4000bda0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8f5400c240 tx=0x7f8f40005830 comp rx=0 tx=0).stop 2024-02-21T23:01:30.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.579+0000 7f8f60800640 1 -- 172.21.15.99:0/415440162 shutdown_connections 2024-02-21T23:01:30.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.579+0000 7f8f60800640 1 --2- 172.21.15.99:0/415440162 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8f400099b0 0x7f8f4000bda0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:30.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.579+0000 7f8f60800640 1 -- 172.21.15.99:0/415440162 >> 172.21.15.99:0/415440162 conn(0x7f8f580d6af0 msgr2=0x7f8f580740b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:30.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.579+0000 7f8f60800640 1 -- 172.21.15.99:0/415440162 shutdown_connections 2024-02-21T23:01:30.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.579+0000 7f8f60800640 1 -- 172.21.15.99:0/415440162 wait complete. 2024-02-21T23:01:30.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.581+0000 7f8f60800640 1 Processor -- start 2024-02-21T23:01:30.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.581+0000 7f8f60800640 1 -- start start 2024-02-21T23:01:30.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.582+0000 7f8f60800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f400099b0 0x7f8f5821f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:30.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.582+0000 7f8f60800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8f581712f0 0x7f8f58171770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:30.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.582+0000 7f8f60800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8f58171d50 0x7f8f58172200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:30.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.582+0000 7f8f60800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f581872d0 con 0x7f8f58171d50 2024-02-21T23:01:30.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.582+0000 7f8f60800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f58187640 con 0x7f8f400099b0 2024-02-21T23:01:30.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.582+0000 7f8f60800640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f58187ad0 con 0x7f8f581712f0 2024-02-21T23:01:30.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.582+0000 7f8f5d400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8f581712f0 0x7f8f58171770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:30.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.582+0000 7f8f5d400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8f581712f0 0x7f8f58171770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:50032/0 (socket says 172.21.15.99:50032) 2024-02-21T23:01:30.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.583+0000 7f8f5d400640 1 -- 172.21.15.99:0/4042191920 learned_addr learned my addr 172.21.15.99:0/4042191920 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:30.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.583+0000 7f8f5de00640 1 --2- 172.21.15.99:0/4042191920 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f400099b0 0x7f8f5821f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:30.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.583+0000 7f8f5e800640 1 --2- 172.21.15.99:0/4042191920 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8f58171d50 0x7f8f58172200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:30.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.583+0000 7f8f5d400640 1 -- 172.21.15.99:0/4042191920 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f400099b0 msgr2=0x7f8f5821f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:30.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.583+0000 7f8f5d400640 1 --2- 172.21.15.99:0/4042191920 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f400099b0 0x7f8f5821f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:30.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.583+0000 7f8f5d400640 1 -- 172.21.15.99:0/4042191920 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8f58171d50 msgr2=0x7f8f58172200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:30.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.583+0000 7f8f5d400640 1 --2- 172.21.15.99:0/4042191920 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8f58171d50 0x7f8f58172200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:30.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.583+0000 7f8f5d400640 1 -- 172.21.15.99:0/4042191920 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f5821d180 con 0x7f8f581712f0 2024-02-21T23:01:30.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.583+0000 7f8f5d400640 1 --2- 172.21.15.99:0/4042191920 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8f581712f0 0x7f8f58171770 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8f4400f7a0 tx=0x7f8f4400fba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:30.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.583+0000 7f8f52000640 1 -- 172.21.15.99:0/4042191920 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f440050d0 con 0x7f8f581712f0 2024-02-21T23:01:30.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.584+0000 7f8f52000640 1 -- 172.21.15.99:0/4042191920 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f44018070 con 0x7f8f581712f0 2024-02-21T23:01:30.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.584+0000 7f8f52000640 1 -- 172.21.15.99:0/4042191920 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f4400d6d0 con 0x7f8f581712f0 2024-02-21T23:01:30.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.584+0000 7f8f60800640 1 -- 172.21.15.99:0/4042191920 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f5821d460 con 0x7f8f581712f0 2024-02-21T23:01:30.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.584+0000 7f8f60800640 1 -- 172.21.15.99:0/4042191920 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f5821da20 con 0x7f8f581712f0 2024-02-21T23:01:30.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.585+0000 7f8f60800640 1 -- 172.21.15.99:0/4042191920 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f58068780 con 0x7f8f581712f0 2024-02-21T23:01:30.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.587+0000 7f8f52000640 1 -- 172.21.15.99:0/4042191920 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 5) v1 ==== 134356+0+0 (secure 0 0 0) 0x7f8f4400d870 con 0x7f8f581712f0 2024-02-21T23:01:30.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.588+0000 7f8f52000640 1 --2- 172.21.15.99:0/4042191920 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f8f3809ed90 0x7f8f380a1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:30.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.588+0000 7f8f52000640 1 -- 172.21.15.99:0/4042191920 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f8f440c9940 con 0x7f8f581712f0 2024-02-21T23:01:30.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.588+0000 7f8f5de00640 1 --2- 172.21.15.99:0/4042191920 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f8f3809ed90 0x7f8f380a1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:30.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.589+0000 7f8f5de00640 1 --2- 172.21.15.99:0/4042191920 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f8f3809ed90 0x7f8f380a1250 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c000c00 tx=0x7f8f4c007c70 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:30.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.592+0000 7f8f52000640 1 -- 172.21.15.99:0/4042191920 <== mon.2 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f8f44097b90 con 0x7f8f581712f0 2024-02-21T23:01:30.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:30.866+0000 7f8f60800640 1 -- 172.21.15.99:0/4042191920 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) v1 -- 0x7f8f58184180 con 0x7f8f581712f0 2024-02-21T23:01:31.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:31.365+0000 7f8f52000640 1 -- 172.21.15.99:0/4042191920 <== mon.2 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v9) v1 ==== 105+0+0 (secure 0 0 0) 0x7f8f44097490 con 0x7f8f581712f0 2024-02-21T23:01:31.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:31.369+0000 7f8f60800640 1 -- 172.21.15.99:0/4042191920 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f8f3809ed90 msgr2=0x7f8f380a1250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:31.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:31.369+0000 7f8f60800640 1 --2- 172.21.15.99:0/4042191920 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f8f3809ed90 0x7f8f380a1250 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c000c00 tx=0x7f8f4c007c70 comp rx=0 tx=0).stop 2024-02-21T23:01:31.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:31.369+0000 7f8f60800640 1 -- 172.21.15.99:0/4042191920 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8f581712f0 msgr2=0x7f8f58171770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:31.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:31.369+0000 7f8f60800640 1 --2- 172.21.15.99:0/4042191920 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8f581712f0 0x7f8f58171770 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8f4400f7a0 tx=0x7f8f4400fba0 comp rx=0 tx=0).stop 2024-02-21T23:01:31.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:31.369+0000 7f8f60800640 1 -- 172.21.15.99:0/4042191920 shutdown_connections 2024-02-21T23:01:31.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:31.369+0000 7f8f60800640 1 --2- 172.21.15.99:0/4042191920 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f8f3809ed90 0x7f8f380a1250 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:31.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:31.369+0000 7f8f60800640 1 --2- 172.21.15.99:0/4042191920 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8f58171d50 0x7f8f58172200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:31.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:31.369+0000 7f8f60800640 1 --2- 172.21.15.99:0/4042191920 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8f581712f0 0x7f8f58171770 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:31.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:31.369+0000 7f8f60800640 1 --2- 172.21.15.99:0/4042191920 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f400099b0 0x7f8f5821f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:31.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:31.369+0000 7f8f60800640 1 -- 172.21.15.99:0/4042191920 >> 172.21.15.99:0/4042191920 conn(0x7f8f580d6af0 msgr2=0x7f8f5818b570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:31.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:31.369+0000 7f8f60800640 1 -- 172.21.15.99:0/4042191920 shutdown_connections 2024-02-21T23:01:31.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:31.369+0000 7f8f60800640 1 -- 172.21.15.99:0/4042191920 wait complete. 2024-02-21T23:01:31.382 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2024-02-21T23:01:31.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:31.582+0000 7f6dd5800640 1 Processor -- start 2024-02-21T23:01:31.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:31.582+0000 7f6dd5800640 1 -- start start 2024-02-21T23:01:31.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:31.584+0000 7f6dd5800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6dd018a9b0 0x7f6dd018ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:31.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:31.584+0000 7f6dd5800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f6dd0190610 0x7f6dd0190a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:31.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:31.584+0000 7f6dd5800640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dd018ec00 con 0x7f6dd018e510 2024-02-21T23:01:31.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:31.584+0000 7f6dd5800640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dd018e9a0 con 0x7f6dd018a9b0 2024-02-21T23:01:31.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:31.584+0000 7f6dd5800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dd018eee0 con 0x7f6dd0190610 2024-02-21T23:01:31.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:31.584+0000 7f6dcea00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6dd018a9b0 0x7f6dd018ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:31.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:31.584+0000 7f6dcea00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6dd018a9b0 0x7f6dd018ff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:43308/0 (socket says 172.21.15.99:43308) 2024-02-21T23:01:31.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:31.584+0000 7f6dcea00640 1 -- 172.21.15.99:0/3742828791 learned_addr learned my addr 172.21.15.99:0/3742828791 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:31.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:31.585+0000 7f6dcf400640 1 --2- 172.21.15.99:0/3742828791 >> v2:172.21.15.162:3300/0 conn(0x7f6dd0190610 0x7f6dd0190a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:31.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:31.585+0000 7f6dcea00640 1 -- 172.21.15.99:0/3742828791 >> v2:172.21.15.162:3300/0 conn(0x7f6dd0190610 msgr2=0x7f6dd0190a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:31.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:31.585+0000 7f6dcea00640 1 --2- 172.21.15.99:0/3742828791 >> v2:172.21.15.162:3300/0 conn(0x7f6dd0190610 0x7f6dd0190a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:31.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:31.585+0000 7f6dcea00640 1 -- 172.21.15.99:0/3742828791 >> v1:172.21.15.99:6789/0 conn(0x7f6dd018e510 legacy=0x7f6dd018af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:31.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:31.585+0000 7f6dcea00640 1 -- 172.21.15.99:0/3742828791 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd018f1c0 con 0x7f6dd018a9b0 2024-02-21T23:01:31.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:31.585+0000 7f6dcd600640 1 -- 172.21.15.99:0/3742828791 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3592115181 0 0) 0x7f6dd018ec00 con 0x7f6dd018e510 2024-02-21T23:01:31.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:31.585+0000 7f6dcf400640 1 --2- 172.21.15.99:0/3742828791 >> v2:172.21.15.162:3300/0 conn(0x7f6dd0190610 0x7f6dd0190a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:01:31.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:31.586+0000 7f6dcea00640 1 --2- 172.21.15.99:0/3742828791 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6dd018a9b0 0x7f6dd018ff80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6dd0072f60 tx=0x7f6db802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=174cee049a09745a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:31.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:31.586+0000 7f6dcd600640 1 -- 172.21.15.99:0/3742828791 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db802e070 con 0x7f6dd018a9b0 2024-02-21T23:01:31.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:31.586+0000 7f6dcd600640 1 -- 172.21.15.99:0/3742828791 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6db8037070 con 0x7f6dd018a9b0 2024-02-21T23:01:31.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:31.586+0000 7f6dcd600640 1 -- 172.21.15.99:0/3742828791 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db8031a00 con 0x7f6dd018a9b0 2024-02-21T23:01:31.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:31.587+0000 7f6dd5800640 1 -- 172.21.15.99:0/3742828791 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6dd018a9b0 msgr2=0x7f6dd018ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:31.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:31.587+0000 7f6dd5800640 1 --2- 172.21.15.99:0/3742828791 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6dd018a9b0 0x7f6dd018ff80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6dd0072f60 tx=0x7f6db802b880 comp rx=0 tx=0).stop 2024-02-21T23:01:31.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:31.587+0000 7f6dd5800640 1 -- 172.21.15.99:0/3742828791 shutdown_connections 2024-02-21T23:01:31.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:31.587+0000 7f6dd5800640 1 --2- 172.21.15.99:0/3742828791 >> v2:172.21.15.162:3300/0 conn(0x7f6dd0190610 0x7f6dd0190a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:31.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:31.587+0000 7f6dd5800640 1 --2- 172.21.15.99:0/3742828791 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6dd018a9b0 0x7f6dd018ff80 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:31.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:31.587+0000 7f6dd5800640 1 -- 172.21.15.99:0/3742828791 >> 172.21.15.99:0/3742828791 conn(0x7f6dd00ce5f0 msgr2=0x7f6dd00cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:31.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:31.587+0000 7f6dd5800640 1 -- 172.21.15.99:0/3742828791 shutdown_connections 2024-02-21T23:01:31.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:31.587+0000 7f6dd5800640 1 -- 172.21.15.99:0/3742828791 wait complete. 2024-02-21T23:01:31.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:31.589+0000 7f6dd5800640 1 Processor -- start 2024-02-21T23:01:31.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:31.590+0000 7f6dd5800640 1 -- start start 2024-02-21T23:01:31.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:31.591+0000 7f6dd5800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6dd018a9b0 0x7f6dd006bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:31.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:31.591+0000 7f6dd5800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6dd018e510 0x7f6dd0170b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:31.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:31.591+0000 7f6dd5800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6dd0190610 0x7f6dd0225280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:31.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:31.591+0000 7f6dd5800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd018fa60 con 0x7f6dd018e510 2024-02-21T23:01:31.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:31.591+0000 7f6dd5800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd018f780 con 0x7f6dd018a9b0 2024-02-21T23:01:31.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:31.591+0000 7f6dd5800640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd0190fc0 con 0x7f6dd0190610 2024-02-21T23:01:31.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:31.591+0000 7f6dce000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6dd018e510 0x7f6dd0170b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:31.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:31.591+0000 7f6dcea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6dd018a9b0 0x7f6dd006bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:31.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:31.591+0000 7f6dce000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6dd018e510 0x7f6dd0170b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:43320/0 (socket says 172.21.15.99:43320) 2024-02-21T23:01:31.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:31.591+0000 7f6dce000640 1 -- 172.21.15.99:0/547961435 learned_addr learned my addr 172.21.15.99:0/547961435 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:31.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:31.591+0000 7f6dcf400640 1 --2- 172.21.15.99:0/547961435 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6dd0190610 0x7f6dd0225280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:31.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:31.592+0000 7f6dce000640 1 -- 172.21.15.99:0/547961435 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6dd0190610 msgr2=0x7f6dd0225280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:31.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:31.592+0000 7f6dce000640 1 --2- 172.21.15.99:0/547961435 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6dd0190610 0x7f6dd0225280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:31.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:31.592+0000 7f6dce000640 1 -- 172.21.15.99:0/547961435 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6dd018a9b0 msgr2=0x7f6dd006bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:31.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:31.592+0000 7f6dce000640 1 --2- 172.21.15.99:0/547961435 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6dd018a9b0 0x7f6dd006bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:31.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:31.592+0000 7f6dce000640 1 -- 172.21.15.99:0/547961435 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd02247e0 con 0x7f6dd018e510 2024-02-21T23:01:31.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:31.592+0000 7f6dce000640 1 --2- 172.21.15.99:0/547961435 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6dd018e510 0x7f6dd0170b60 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6dc000c460 tx=0x7f6dc000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:31.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:31.592+0000 7f6dc6a00640 1 -- 172.21.15.99:0/547961435 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc0005480 con 0x7f6dd018e510 2024-02-21T23:01:31.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:31.592+0000 7f6dc6a00640 1 -- 172.21.15.99:0/547961435 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dc00035f0 con 0x7f6dd018e510 2024-02-21T23:01:31.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:31.592+0000 7f6dd5800640 1 -- 172.21.15.99:0/547961435 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dd00f97f0 con 0x7f6dd018e510 2024-02-21T23:01:31.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:31.592+0000 7f6dc6a00640 1 -- 172.21.15.99:0/547961435 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc0003a00 con 0x7f6dd018e510 2024-02-21T23:01:31.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:31.592+0000 7f6dd5800640 1 -- 172.21.15.99:0/547961435 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dd0224a80 con 0x7f6dd018e510 2024-02-21T23:01:31.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:31.594+0000 7f6dd5800640 1 -- 172.21.15.99:0/547961435 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dd0068780 con 0x7f6dd018e510 2024-02-21T23:01:31.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:31.595+0000 7f6dc6a00640 1 -- 172.21.15.99:0/547961435 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 134356+0+0 (secure 0 0 0) 0x7f6dc0003ba0 con 0x7f6dd018e510 2024-02-21T23:01:31.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:31.597+0000 7f6dc6a00640 1 --2- 172.21.15.99:0/547961435 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f6dac09ef00 0x7f6dac0a13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:31.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:31.598+0000 7f6dc6a00640 1 -- 172.21.15.99:0/547961435 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f6dc00c97e0 con 0x7f6dd018e510 2024-02-21T23:01:31.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:31.598+0000 7f6dcea00640 1 --2- 172.21.15.99:0/547961435 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f6dac09ef00 0x7f6dac0a13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:31.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:31.599+0000 7f6dcea00640 1 --2- 172.21.15.99:0/547961435 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f6dac09ef00 0x7f6dac0a13c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6db8036000 tx=0x7f6db803d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:31.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:31.603+0000 7f6dc6a00640 1 -- 172.21.15.99:0/547961435 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f6dc0097a30 con 0x7f6dd018e510 2024-02-21T23:01:31.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:31.859+0000 7f6dd5800640 1 -- 172.21.15.99:0/547961435 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7f6dd00d2a80 con 0x7f6dd018e510 2024-02-21T23:01:32.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:32.374+0000 7f6dc6a00640 1 -- 172.21.15.99:0/547961435 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v11) v1 ==== 121+0+0 (secure 0 0 0) 0x7f6dc0097330 con 0x7f6dd018e510 2024-02-21T23:01:32.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:32.379+0000 7f6dd5800640 1 -- 172.21.15.99:0/547961435 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f6dac09ef00 msgr2=0x7f6dac0a13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:32.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:32.379+0000 7f6dd5800640 1 --2- 172.21.15.99:0/547961435 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f6dac09ef00 0x7f6dac0a13c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6db8036000 tx=0x7f6db803d040 comp rx=0 tx=0).stop 2024-02-21T23:01:32.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:32.379+0000 7f6dd5800640 1 -- 172.21.15.99:0/547961435 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6dd018e510 msgr2=0x7f6dd0170b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:32.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:32.379+0000 7f6dd5800640 1 --2- 172.21.15.99:0/547961435 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6dd018e510 0x7f6dd0170b60 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6dc000c460 tx=0x7f6dc000c920 comp rx=0 tx=0).stop 2024-02-21T23:01:32.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:32.379+0000 7f6dd5800640 1 -- 172.21.15.99:0/547961435 shutdown_connections 2024-02-21T23:01:32.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:32.379+0000 7f6dd5800640 1 --2- 172.21.15.99:0/547961435 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f6dac09ef00 0x7f6dac0a13c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:32.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:32.379+0000 7f6dd5800640 1 --2- 172.21.15.99:0/547961435 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6dd0190610 0x7f6dd0225280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:32.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:32.379+0000 7f6dd5800640 1 --2- 172.21.15.99:0/547961435 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6dd018e510 0x7f6dd0170b60 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:32.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:32.379+0000 7f6dd5800640 1 --2- 172.21.15.99:0/547961435 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6dd018a9b0 0x7f6dd006bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:32.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:32.379+0000 7f6dd5800640 1 -- 172.21.15.99:0/547961435 >> 172.21.15.99:0/547961435 conn(0x7f6dd00ce5f0 msgr2=0x7f6dd006c810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:32.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:32.379+0000 7f6dd5800640 1 -- 172.21.15.99:0/547961435 shutdown_connections 2024-02-21T23:01:32.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:32.380+0000 7f6dd5800640 1 -- 172.21.15.99:0/547961435 wait complete. 2024-02-21T23:01:32.399 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-02-21T23:01:32.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:32.587+0000 7f5393e00640 1 Processor -- start 2024-02-21T23:01:32.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:32.588+0000 7f5393e00640 1 -- start start 2024-02-21T23:01:32.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:32.591+0000 7f5393e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f53940fb9e0 0x7f5394190350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:32.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:32.591+0000 7f5393e00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53940fd490 con 0x7f53941648c0 2024-02-21T23:01:32.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:32.591+0000 7f5393e00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53940fd770 con 0x7f53940fce30 2024-02-21T23:01:32.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:32.591+0000 7f5393e00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53940fbe70 con 0x7f53940fb9e0 2024-02-21T23:01:32.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:32.591+0000 7f5392a00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f53941648c0 0x7f5394186d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:47324/0 (socket says 172.21.15.99:47324) 2024-02-21T23:01:32.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:32.591+0000 7f5392a00640 1 -- 172.21.15.99:0/3822379686 learned_addr learned my addr 172.21.15.99:0/3822379686 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:01:32.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:32.592+0000 7f5393400640 1 --2- 172.21.15.99:0/3822379686 >> v2:172.21.15.162:3300/0 conn(0x7f53940fb9e0 0x7f5394190350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:32.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:32.592+0000 7f5391600640 1 -- 172.21.15.99:0/3822379686 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2049050232 0 0) 0x7f53940fd770 con 0x7f53940fce30 2024-02-21T23:01:32.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:32.592+0000 7f5391600640 1 -- 172.21.15.99:0/3822379686 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5378003520 con 0x7f53940fce30 2024-02-21T23:01:32.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:32.592+0000 7f5391600640 1 -- 172.21.15.99:0/3822379686 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2067530898 0 0) 0x7f53940fd490 con 0x7f53941648c0 2024-02-21T23:01:32.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:32.592+0000 7f5391600640 1 -- 172.21.15.99:0/3822379686 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53940fd770 con 0x7f53941648c0 2024-02-21T23:01:32.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:32.592+0000 7f5393400640 1 -- 172.21.15.99:0/3822379686 >> v1:172.21.15.181:6789/0 conn(0x7f53940fce30 legacy=0x7f5394187440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:32.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:32.592+0000 7f5393400640 1 -- 172.21.15.99:0/3822379686 >> v1:172.21.15.99:6789/0 conn(0x7f53941648c0 legacy=0x7f5394186d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:32.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:32.592+0000 7f5393400640 1 -- 172.21.15.99:0/3822379686 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53940fda50 con 0x7f53940fb9e0 2024-02-21T23:01:32.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:32.593+0000 7f5393400640 1 --2- 172.21.15.99:0/3822379686 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f53940fb9e0 0x7f5394190350 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f538c009d90 tx=0x7f538c02bf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c54af056e0a9175d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:32.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:32.594+0000 7f5391600640 1 -- 172.21.15.99:0/3822379686 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f538c039070 con 0x7f53940fb9e0 2024-02-21T23:01:32.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:32.594+0000 7f5391600640 1 -- 172.21.15.99:0/3822379686 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f538c02cd00 con 0x7f53940fb9e0 2024-02-21T23:01:32.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:32.594+0000 7f5391600640 1 -- 172.21.15.99:0/3822379686 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f538c034640 con 0x7f53940fb9e0 2024-02-21T23:01:32.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:32.594+0000 7f5393e00640 1 -- 172.21.15.99:0/3822379686 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f53940fb9e0 msgr2=0x7f5394190350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:32.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:32.594+0000 7f5393e00640 1 --2- 172.21.15.99:0/3822379686 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f53940fb9e0 0x7f5394190350 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f538c009d90 tx=0x7f538c02bf50 comp rx=0 tx=0).stop 2024-02-21T23:01:32.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:32.594+0000 7f5393e00640 1 -- 172.21.15.99:0/3822379686 shutdown_connections 2024-02-21T23:01:32.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:32.594+0000 7f5393e00640 1 --2- 172.21.15.99:0/3822379686 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f53940fb9e0 0x7f5394190350 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:32.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:32.594+0000 7f5393e00640 1 -- 172.21.15.99:0/3822379686 >> 172.21.15.99:0/3822379686 conn(0x7f53940d29c0 msgr2=0x7f53940d2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:32.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:32.595+0000 7f5393e00640 1 -- 172.21.15.99:0/3822379686 shutdown_connections 2024-02-21T23:01:32.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:32.595+0000 7f5393e00640 1 -- 172.21.15.99:0/3822379686 wait complete. 2024-02-21T23:01:32.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:32.596+0000 7f5393e00640 1 Processor -- start 2024-02-21T23:01:32.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:32.597+0000 7f5393e00640 1 -- start start 2024-02-21T23:01:32.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:32.598+0000 7f5393e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f53940fb9e0 0x7f53941613e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:32.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:32.598+0000 7f5393e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f53940fce30 0x7f5394161920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:32.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:32.598+0000 7f5393e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f53941648c0 0x7f539417d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:32.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:32.598+0000 7f5393e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5394072920 con 0x7f53941648c0 2024-02-21T23:01:32.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:32.598+0000 7f5393e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53940fe010 con 0x7f53940fb9e0 2024-02-21T23:01:32.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:32.598+0000 7f5393e00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5394190890 con 0x7f53940fce30 2024-02-21T23:01:32.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:32.598+0000 7f5392a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f53940fb9e0 0x7f53941613e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:32.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:32.598+0000 7f5392000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f53940fce30 0x7f5394161920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:32.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:32.598+0000 7f5393400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f53941648c0 0x7f539417d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:32.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:32.598+0000 7f5392a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f53940fb9e0 0x7f53941613e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:56974/0 (socket says 172.21.15.99:56974) 2024-02-21T23:01:32.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:32.598+0000 7f5392000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f53940fce30 0x7f5394161920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:50050/0 (socket says 172.21.15.99:50050) 2024-02-21T23:01:32.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:32.598+0000 7f5392a00640 1 -- 172.21.15.99:0/2366730533 learned_addr learned my addr 172.21.15.99:0/2366730533 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:32.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:32.599+0000 7f5393400640 1 -- 172.21.15.99:0/2366730533 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f53940fce30 msgr2=0x7f5394161920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:32.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:32.599+0000 7f5393400640 1 --2- 172.21.15.99:0/2366730533 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f53940fce30 0x7f5394161920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:32.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:32.599+0000 7f5393400640 1 -- 172.21.15.99:0/2366730533 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f53940fb9e0 msgr2=0x7f53941613e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:32.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:32.599+0000 7f5393400640 1 --2- 172.21.15.99:0/2366730533 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f53940fb9e0 0x7f53941613e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:32.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:32.599+0000 7f5393400640 1 -- 172.21.15.99:0/2366730533 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5394221c50 con 0x7f53941648c0 2024-02-21T23:01:32.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:32.599+0000 7f5392a00640 1 --2- 172.21.15.99:0/2366730533 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f53940fb9e0 0x7f53941613e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:01:32.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:32.599+0000 7f5393400640 1 --2- 172.21.15.99:0/2366730533 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f53941648c0 0x7f539417d930 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f538c033000 tx=0x7f538c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:32.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:32.599+0000 7f538aa00640 1 -- 172.21.15.99:0/2366730533 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f538c044030 con 0x7f53941648c0 2024-02-21T23:01:32.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:32.599+0000 7f538aa00640 1 -- 172.21.15.99:0/2366730533 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f538c02cb00 con 0x7f53941648c0 2024-02-21T23:01:32.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:32.599+0000 7f5393e00640 1 -- 172.21.15.99:0/2366730533 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f539417cb70 con 0x7f53941648c0 2024-02-21T23:01:32.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:32.599+0000 7f538aa00640 1 -- 172.21.15.99:0/2366730533 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f538c039040 con 0x7f53941648c0 2024-02-21T23:01:32.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:32.599+0000 7f5393e00640 1 -- 172.21.15.99:0/2366730533 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f539417d130 con 0x7f53941648c0 2024-02-21T23:01:32.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:32.600+0000 7f5393e00640 1 -- 172.21.15.99:0/2366730533 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5394068320 con 0x7f53941648c0 2024-02-21T23:01:32.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:32.604+0000 7f538aa00640 1 -- 172.21.15.99:0/2366730533 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 134356+0+0 (secure 0 0 0) 0x7f538c047070 con 0x7f53941648c0 2024-02-21T23:01:32.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:32.606+0000 7f538aa00640 1 --2- 172.21.15.99:0/2366730533 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f537409ed60 0x7f53740a1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:32.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:32.607+0000 7f538aa00640 1 -- 172.21.15.99:0/2366730533 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f538c0ec820 con 0x7f53941648c0 2024-02-21T23:01:32.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:32.607+0000 7f5392a00640 1 --2- 172.21.15.99:0/2366730533 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f537409ed60 0x7f53740a1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:32.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:32.607+0000 7f538aa00640 1 -- 172.21.15.99:0/2366730533 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f538c04e070 con 0x7f53941648c0 2024-02-21T23:01:32.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:32.607+0000 7f5392a00640 1 --2- 172.21.15.99:0/2366730533 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f537409ed60 0x7f53740a1220 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5384000f60 tx=0x7f5384009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:32.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:32.832+0000 7f5393e00640 1 -- 172.21.15.99:0/2366730533 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7f53940fcc10 con 0x7f53941648c0 2024-02-21T23:01:33.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:33.384+0000 7f538aa00640 1 -- 172.21.15.99:0/2366730533 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v13) v1 ==== 115+0+0 (secure 0 0 0) 0x7f538c0baa70 con 0x7f53941648c0 2024-02-21T23:01:33.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:33.387+0000 7f5393e00640 1 -- 172.21.15.99:0/2366730533 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f537409ed60 msgr2=0x7f53740a1220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:33.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:33.387+0000 7f5393e00640 1 --2- 172.21.15.99:0/2366730533 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f537409ed60 0x7f53740a1220 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5384000f60 tx=0x7f5384009040 comp rx=0 tx=0).stop 2024-02-21T23:01:33.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:33.387+0000 7f5393e00640 1 -- 172.21.15.99:0/2366730533 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f53941648c0 msgr2=0x7f539417d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:33.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:33.387+0000 7f5393e00640 1 --2- 172.21.15.99:0/2366730533 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f53941648c0 0x7f539417d930 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f538c033000 tx=0x7f538c004a40 comp rx=0 tx=0).stop 2024-02-21T23:01:33.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:33.387+0000 7f5393e00640 1 -- 172.21.15.99:0/2366730533 shutdown_connections 2024-02-21T23:01:33.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:33.387+0000 7f5393e00640 1 --2- 172.21.15.99:0/2366730533 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f537409ed60 0x7f53740a1220 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:33.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:33.387+0000 7f5393e00640 1 --2- 172.21.15.99:0/2366730533 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f53941648c0 0x7f539417d930 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:33.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:33.387+0000 7f5393e00640 1 --2- 172.21.15.99:0/2366730533 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f53940fce30 0x7f5394161920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:33.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:33.387+0000 7f5393e00640 1 --2- 172.21.15.99:0/2366730533 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f53940fb9e0 0x7f53941613e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:33.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:33.387+0000 7f5393e00640 1 -- 172.21.15.99:0/2366730533 >> 172.21.15.99:0/2366730533 conn(0x7f53940d29c0 msgr2=0x7f5394163320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:33.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:33.387+0000 7f5393e00640 1 -- 172.21.15.99:0/2366730533 shutdown_connections 2024-02-21T23:01:33.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:33.387+0000 7f5393e00640 1 -- 172.21.15.99:0/2366730533 wait complete. 2024-02-21T23:01:33.403 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--size 25000000000'} subvols for filesystem 'cephfs' 2024-02-21T23:01:33.403 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create cephfs qa 2024-02-21T23:01:33.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:33.593+0000 7fce86200640 1 Processor -- start 2024-02-21T23:01:33.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:33.593+0000 7fce86200640 1 -- start start 2024-02-21T23:01:33.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:33.595+0000 7fce86200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fce80180d80 0x7fce800f5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:33.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:33.595+0000 7fce86200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce800f6500 con 0x7fce8006f4b0 2024-02-21T23:01:33.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:33.595+0000 7fce86200640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce800f67e0 con 0x7fce800728f0 2024-02-21T23:01:33.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:33.595+0000 7fce86200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce800f6ac0 con 0x7fce80180d80 2024-02-21T23:01:33.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:33.595+0000 7fce7f400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fce80180d80 0x7fce800f5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:33.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:33.595+0000 7fce7f400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fce80180d80 0x7fce800f5ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:43336/0 (socket says 172.21.15.99:43336) 2024-02-21T23:01:33.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:33.595+0000 7fce7f400640 1 -- 172.21.15.99:0/3344765884 learned_addr learned my addr 172.21.15.99:0/3344765884 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:33.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:33.596+0000 7fce7f400640 1 -- 172.21.15.99:0/3344765884 >> v1:172.21.15.181:6789/0 conn(0x7fce800728f0 legacy=0x7fce80072d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:33.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:33.596+0000 7fce7f400640 1 -- 172.21.15.99:0/3344765884 >> v1:172.21.15.162:6789/0 conn(0x7fce8006f4b0 legacy=0x7fce8006f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:33.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:33.596+0000 7fce7e000640 1 -- 172.21.15.99:0/3344765884 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1643066652 0 0) 0x7fce800f6500 con 0x7fce8006f4b0 2024-02-21T23:01:33.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:33.596+0000 7fce7f400640 1 -- 172.21.15.99:0/3344765884 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce800f6da0 con 0x7fce80180d80 2024-02-21T23:01:33.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:33.597+0000 7fce7f400640 1 --2- 172.21.15.99:0/3344765884 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce80180d80 0x7fce800f5ca0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fce70009870 tx=0x7fce7002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f29e4ee9242ec1e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:33.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:33.597+0000 7fce7e000640 1 -- 172.21.15.99:0/3344765884 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce70035020 con 0x7fce80180d80 2024-02-21T23:01:33.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:33.597+0000 7fce7e000640 1 -- 172.21.15.99:0/3344765884 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce70031870 con 0x7fce80180d80 2024-02-21T23:01:33.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:33.597+0000 7fce7e000640 1 -- 172.21.15.99:0/3344765884 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce70031c40 con 0x7fce80180d80 2024-02-21T23:01:33.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:33.597+0000 7fce86200640 1 -- 172.21.15.99:0/3344765884 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce80180d80 msgr2=0x7fce800f5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:33.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:33.597+0000 7fce86200640 1 --2- 172.21.15.99:0/3344765884 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce80180d80 0x7fce800f5ca0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fce70009870 tx=0x7fce7002b910 comp rx=0 tx=0).stop 2024-02-21T23:01:33.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:33.598+0000 7fce86200640 1 -- 172.21.15.99:0/3344765884 shutdown_connections 2024-02-21T23:01:33.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:33.598+0000 7fce86200640 1 --2- 172.21.15.99:0/3344765884 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce80180d80 0x7fce800f5ca0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:33.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:33.598+0000 7fce86200640 1 -- 172.21.15.99:0/3344765884 >> 172.21.15.99:0/3344765884 conn(0x7fce800cf7f0 msgr2=0x7fce800cfc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:33.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:33.598+0000 7fce86200640 1 -- 172.21.15.99:0/3344765884 shutdown_connections 2024-02-21T23:01:33.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:33.598+0000 7fce86200640 1 -- 172.21.15.99:0/3344765884 wait complete. 2024-02-21T23:01:33.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:33.600+0000 7fce86200640 1 Processor -- start 2024-02-21T23:01:33.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:33.600+0000 7fce86200640 1 -- start start 2024-02-21T23:01:33.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:33.602+0000 7fce86200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce8006f4b0 0x7fce8016b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:33.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:33.602+0000 7fce86200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce800728f0 0x7fce801823b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:33.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:33.602+0000 7fce86200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fce80180d80 0x7fce801828f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:33.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:33.602+0000 7fce86200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce800f61e0 con 0x7fce8006f4b0 2024-02-21T23:01:33.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:33.602+0000 7fce86200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce800f7360 con 0x7fce800728f0 2024-02-21T23:01:33.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:33.602+0000 7fce86200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce80070040 con 0x7fce80180d80 2024-02-21T23:01:33.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:33.603+0000 7fce7f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce8006f4b0 0x7fce8016b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:33.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:33.603+0000 7fce7f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce8006f4b0 0x7fce8016b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:43338/0 (socket says 172.21.15.99:43338) 2024-02-21T23:01:33.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:33.603+0000 7fce7f400640 1 -- 172.21.15.99:0/338310021 learned_addr learned my addr 172.21.15.99:0/338310021 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:33.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:33.603+0000 7fce7ea00640 1 --2- 172.21.15.99:0/338310021 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce800728f0 0x7fce801823b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:33.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:33.603+0000 7fce7fe00640 1 --2- 172.21.15.99:0/338310021 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fce80180d80 0x7fce801828f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:33.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:33.603+0000 7fce7f400640 1 -- 172.21.15.99:0/338310021 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fce80180d80 msgr2=0x7fce801828f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:33.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:33.603+0000 7fce7f400640 1 --2- 172.21.15.99:0/338310021 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fce80180d80 0x7fce801828f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:33.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:33.603+0000 7fce7f400640 1 -- 172.21.15.99:0/338310021 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce800728f0 msgr2=0x7fce801823b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:33.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:33.603+0000 7fce7f400640 1 --2- 172.21.15.99:0/338310021 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce800728f0 0x7fce801823b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:33.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:33.603+0000 7fce7f400640 1 -- 172.21.15.99:0/338310021 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce800cb4d0 con 0x7fce8006f4b0 2024-02-21T23:01:33.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:33.603+0000 7fce7fe00640 1 --2- 172.21.15.99:0/338310021 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fce80180d80 0x7fce801828f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:01:33.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:33.603+0000 7fce7f400640 1 --2- 172.21.15.99:0/338310021 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce8006f4b0 0x7fce8016b380 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fce70009870 tx=0x7fce700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:33.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:33.604+0000 7fce77400640 1 -- 172.21.15.99:0/338310021 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce70040070 con 0x7fce8006f4b0 2024-02-21T23:01:33.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:33.604+0000 7fce77400640 1 -- 172.21.15.99:0/338310021 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce7003a420 con 0x7fce8006f4b0 2024-02-21T23:01:33.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:33.604+0000 7fce77400640 1 -- 172.21.15.99:0/338310021 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce70035040 con 0x7fce8006f4b0 2024-02-21T23:01:33.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:33.604+0000 7fce86200640 1 -- 172.21.15.99:0/338310021 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce800cb7b0 con 0x7fce8006f4b0 2024-02-21T23:01:33.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:33.604+0000 7fce86200640 1 -- 172.21.15.99:0/338310021 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce80181bb0 con 0x7fce8006f4b0 2024-02-21T23:01:33.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:33.605+0000 7fce86200640 1 -- 172.21.15.99:0/338310021 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce80066c60 con 0x7fce8006f4b0 2024-02-21T23:01:33.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:33.609+0000 7fce77400640 1 -- 172.21.15.99:0/338310021 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 134356+0+0 (secure 0 0 0) 0x7fce7004b060 con 0x7fce8006f4b0 2024-02-21T23:01:33.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:33.610+0000 7fce77400640 1 --2- 172.21.15.99:0/338310021 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fce6009ed60 0x7fce600a1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:33.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:33.610+0000 7fce77400640 1 -- 172.21.15.99:0/338310021 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fce700ec090 con 0x7fce8006f4b0 2024-02-21T23:01:33.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:33.610+0000 7fce7ea00640 1 --2- 172.21.15.99:0/338310021 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fce6009ed60 0x7fce600a1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:33.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:33.611+0000 7fce7ea00640 1 --2- 172.21.15.99:0/338310021 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fce6009ed60 0x7fce600a1220 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fce8008e280 tx=0x7fce6c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:33.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:33.615+0000 7fce77400640 1 -- 172.21.15.99:0/338310021 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fce700ba2e0 con 0x7fce8006f4b0 2024-02-21T23:01:33.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:33.841+0000 7fce86200640 1 -- 172.21.15.99:0/338310021 --> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) v1 -- 0x7fce8008dcf0 con 0x7fce6009ed60 2024-02-21T23:01:33.836 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-02-21T23:01:33.847+0000 7fd9f9256640 -1 client.0 error registering admin socket command: (17) File exists 2024-02-21T23:01:33.836 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-02-21T23:01:33.847+0000 7fd9f9256640 -1 client.0 error registering admin socket command: (17) File exists 2024-02-21T23:01:33.836 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-02-21T23:01:33.847+0000 7fd9f9256640 -1 client.0 error registering admin socket command: (17) File exists 2024-02-21T23:01:33.836 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-02-21T23:01:33.847+0000 7fd9f9256640 -1 client.0 error registering admin socket command: (17) File exists 2024-02-21T23:01:33.837 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-02-21T23:01:33.847+0000 7fd9f9256640 -1 client.0 error registering admin socket command: (17) File exists 2024-02-21T23:01:33.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:33.871+0000 7fce77400640 1 -- 172.21.15.99:0/338310021 <== mgr.4106 v2:172.21.15.162:6800/1717094936 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fce8008dcf0 con 0x7fce6009ed60 2024-02-21T23:01:33.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:33.874+0000 7fce86200640 1 -- 172.21.15.99:0/338310021 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fce6009ed60 msgr2=0x7fce600a1220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:33.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:33.874+0000 7fce86200640 1 --2- 172.21.15.99:0/338310021 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fce6009ed60 0x7fce600a1220 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fce8008e280 tx=0x7fce6c009040 comp rx=0 tx=0).stop 2024-02-21T23:01:33.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:33.874+0000 7fce86200640 1 -- 172.21.15.99:0/338310021 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce8006f4b0 msgr2=0x7fce8016b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:33.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:33.874+0000 7fce86200640 1 --2- 172.21.15.99:0/338310021 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce8006f4b0 0x7fce8016b380 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fce70009870 tx=0x7fce700046c0 comp rx=0 tx=0).stop 2024-02-21T23:01:33.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:33.874+0000 7fce86200640 1 -- 172.21.15.99:0/338310021 shutdown_connections 2024-02-21T23:01:33.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:33.874+0000 7fce86200640 1 --2- 172.21.15.99:0/338310021 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fce6009ed60 0x7fce600a1220 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:33.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:33.874+0000 7fce86200640 1 --2- 172.21.15.99:0/338310021 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fce80180d80 0x7fce801828f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:33.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:33.874+0000 7fce86200640 1 --2- 172.21.15.99:0/338310021 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce800728f0 0x7fce801823b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:33.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:33.874+0000 7fce86200640 1 --2- 172.21.15.99:0/338310021 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce8006f4b0 0x7fce8016b380 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:33.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:33.874+0000 7fce86200640 1 -- 172.21.15.99:0/338310021 >> 172.21.15.99:0/338310021 conn(0x7fce800cf7f0 msgr2=0x7fce800702e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:33.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:33.874+0000 7fce86200640 1 -- 172.21.15.99:0/338310021 shutdown_connections 2024-02-21T23:01:33.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:33.874+0000 7fce86200640 1 -- 172.21.15.99:0/338310021 wait complete. 2024-02-21T23:01:33.879 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_0 --group_name qa 2024-02-21T23:01:34.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.076+0000 7f468b200640 1 Processor -- start 2024-02-21T23:01:34.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.076+0000 7f468b200640 1 -- start start 2024-02-21T23:01:34.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.078+0000 7f468b200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f4684072540 0x7f4684187580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:34.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.078+0000 7f468b200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46840cfeb0 con 0x7f4684187ac0 2024-02-21T23:01:34.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.078+0000 7f468b200640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46840d0190 con 0x7f468417f5e0 2024-02-21T23:01:34.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.078+0000 7f468b200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4684186b30 con 0x7f4684072540 2024-02-21T23:01:34.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.078+0000 7f4683400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f4684072540 0x7f4684187580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:34.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.078+0000 7f4683e00640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f468417f5e0 0x7f4684071e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:41386/0 (socket says 172.21.15.99:41386) 2024-02-21T23:01:34.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.078+0000 7f4683e00640 1 -- 172.21.15.99:0/1227644100 learned_addr learned my addr 172.21.15.99:0/1227644100 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:01:34.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.079+0000 7f4682a00640 1 -- 172.21.15.99:0/1227644100 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3361889116 0 0) 0x7f46840d0190 con 0x7f468417f5e0 2024-02-21T23:01:34.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.079+0000 7f4682a00640 1 -- 172.21.15.99:0/1227644100 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4668003520 con 0x7f468417f5e0 2024-02-21T23:01:34.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.079+0000 7f4683400640 1 -- 172.21.15.99:0/1227644100 >> v1:172.21.15.181:6789/0 conn(0x7f468417f5e0 legacy=0x7f4684071e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:34.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.079+0000 7f4683400640 1 -- 172.21.15.99:0/1227644100 >> v1:172.21.15.99:6789/0 conn(0x7f4684187ac0 legacy=0x7f46840cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:34.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.079+0000 7f4683400640 1 -- 172.21.15.99:0/1227644100 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46840d0470 con 0x7f4684072540 2024-02-21T23:01:34.069 INFO:tasks.ceph.mds.j.smithi099.stderr:2024-02-21T23:01:34.079+0000 7f1e1aa00640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-02-21T23:01:34.069 INFO:tasks.ceph.mds.j.smithi099.stderr:2024-02-21T23:01:34.079+0000 7f1e1aa00640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-02-21T23:01:34.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.081+0000 7f4683400640 1 --2- 172.21.15.99:0/1227644100 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4684072540 0x7f4684187580 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f46700097a0 tx=0x7f467002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=309090c803e47e1 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:34.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.081+0000 7f4682a00640 1 -- 172.21.15.99:0/1227644100 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4670035020 con 0x7f4684072540 2024-02-21T23:01:34.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.081+0000 7f4682a00640 1 -- 172.21.15.99:0/1227644100 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4670031830 con 0x7f4684072540 2024-02-21T23:01:34.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.081+0000 7f4682a00640 1 -- 172.21.15.99:0/1227644100 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4670031c00 con 0x7f4684072540 2024-02-21T23:01:34.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.082+0000 7f468b200640 1 -- 172.21.15.99:0/1227644100 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4684072540 msgr2=0x7f4684187580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:34.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.082+0000 7f468b200640 1 --2- 172.21.15.99:0/1227644100 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4684072540 0x7f4684187580 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f46700097a0 tx=0x7f467002b8d0 comp rx=0 tx=0).stop 2024-02-21T23:01:34.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.082+0000 7f468b200640 1 -- 172.21.15.99:0/1227644100 shutdown_connections 2024-02-21T23:01:34.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.082+0000 7f468b200640 1 --2- 172.21.15.99:0/1227644100 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4684072540 0x7f4684187580 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:34.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.082+0000 7f468b200640 1 -- 172.21.15.99:0/1227644100 >> 172.21.15.99:0/1227644100 conn(0x7f46840fe610 msgr2=0x7f46840fea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:34.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.082+0000 7f468b200640 1 -- 172.21.15.99:0/1227644100 shutdown_connections 2024-02-21T23:01:34.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.082+0000 7f468b200640 1 -- 172.21.15.99:0/1227644100 wait complete. 2024-02-21T23:01:34.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.085+0000 7f468b200640 1 Processor -- start 2024-02-21T23:01:34.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.085+0000 7f468b200640 1 -- start start 2024-02-21T23:01:34.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.087+0000 7f468b200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4684072540 0x7f468416b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:34.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.087+0000 7f468b200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f468417f5e0 0x7f468421cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:34.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.087+0000 7f468b200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4684187ac0 0x7f468421d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:34.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.087+0000 7f468b200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f468417f9c0 con 0x7f4684187ac0 2024-02-21T23:01:34.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.087+0000 7f468b200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4684187060 con 0x7f4684072540 2024-02-21T23:01:34.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.087+0000 7f468b200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46840fd520 con 0x7f468417f5e0 2024-02-21T23:01:34.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.087+0000 7f4689200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4684187ac0 0x7f468421d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:34.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.087+0000 7f4683e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4684072540 0x7f468416b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:34.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.087+0000 7f4683e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4684072540 0x7f468416b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:56982/0 (socket says 172.21.15.99:56982) 2024-02-21T23:01:34.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.087+0000 7f4683e00640 1 -- 172.21.15.99:0/2598714953 learned_addr learned my addr 172.21.15.99:0/2598714953 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:34.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.087+0000 7f4683400640 1 --2- 172.21.15.99:0/2598714953 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f468417f5e0 0x7f468421cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:34.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.088+0000 7f4683e00640 1 -- 172.21.15.99:0/2598714953 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f468417f5e0 msgr2=0x7f468421cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:34.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.088+0000 7f4683e00640 1 --2- 172.21.15.99:0/2598714953 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f468417f5e0 0x7f468421cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:34.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.088+0000 7f4683e00640 1 -- 172.21.15.99:0/2598714953 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4684187ac0 msgr2=0x7f468421d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:34.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.088+0000 7f4683e00640 1 --2- 172.21.15.99:0/2598714953 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4684187ac0 0x7f468421d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:34.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.088+0000 7f4683e00640 1 -- 172.21.15.99:0/2598714953 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4684220f40 con 0x7f4684072540 2024-02-21T23:01:34.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.088+0000 7f4683400640 1 --2- 172.21.15.99:0/2598714953 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f468417f5e0 0x7f468421cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:01:34.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.088+0000 7f4683e00640 1 --2- 172.21.15.99:0/2598714953 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4684072540 0x7f468416b6e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f467400c390 tx=0x7f467400c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:34.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.089+0000 7f467be00640 1 -- 172.21.15.99:0/2598714953 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4674017070 con 0x7f4684072540 2024-02-21T23:01:34.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.089+0000 7f467be00640 1 -- 172.21.15.99:0/2598714953 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4674005ce0 con 0x7f4684072540 2024-02-21T23:01:34.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.089+0000 7f467be00640 1 -- 172.21.15.99:0/2598714953 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46740072f0 con 0x7f4684072540 2024-02-21T23:01:34.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.089+0000 7f468b200640 1 -- 172.21.15.99:0/2598714953 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4684221220 con 0x7f4684072540 2024-02-21T23:01:34.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.089+0000 7f468b200640 1 -- 172.21.15.99:0/2598714953 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46842217e0 con 0x7f4684072540 2024-02-21T23:01:34.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.090+0000 7f468b200640 1 -- 172.21.15.99:0/2598714953 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46840ce150 con 0x7f4684072540 2024-02-21T23:01:34.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.092+0000 7f467be00640 1 -- 172.21.15.99:0/2598714953 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) v1 ==== 134356+0+0 (secure 0 0 0) 0x7f467401a070 con 0x7f4684072540 2024-02-21T23:01:34.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.094+0000 7f467be00640 1 --2- 172.21.15.99:0/2598714953 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f466409ed60 0x7f46640a1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:34.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.095+0000 7f467be00640 1 -- 172.21.15.99:0/2598714953 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f46740c91f0 con 0x7f4684072540 2024-02-21T23:01:34.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.095+0000 7f4683400640 1 --2- 172.21.15.99:0/2598714953 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f466409ed60 0x7f46640a1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:34.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.095+0000 7f4683400640 1 --2- 172.21.15.99:0/2598714953 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f466409ed60 0x7f46640a1220 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4670036000 tx=0x7f467003c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:34.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.096+0000 7f467be00640 1 -- 172.21.15.99:0/2598714953 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f46840ce150 con 0x7f4684072540 2024-02-21T23:01:34.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.361+0000 7f468b200640 1 -- 172.21.15.99:0/2598714953 --> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) v1 -- 0x7f46840683c0 con 0x7f466409ed60 2024-02-21T23:01:34.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.393+0000 7f467be00640 1 -- 172.21.15.99:0/2598714953 <== mgr.4106 v2:172.21.15.162:6800/1717094936 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f46840683c0 con 0x7f466409ed60 2024-02-21T23:01:34.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.396+0000 7f468b200640 1 -- 172.21.15.99:0/2598714953 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f466409ed60 msgr2=0x7f46640a1220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:34.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.396+0000 7f468b200640 1 --2- 172.21.15.99:0/2598714953 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f466409ed60 0x7f46640a1220 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4670036000 tx=0x7f467003c040 comp rx=0 tx=0).stop 2024-02-21T23:01:34.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.396+0000 7f468b200640 1 -- 172.21.15.99:0/2598714953 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4684072540 msgr2=0x7f468416b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:34.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.396+0000 7f468b200640 1 --2- 172.21.15.99:0/2598714953 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4684072540 0x7f468416b6e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f467400c390 tx=0x7f467400c850 comp rx=0 tx=0).stop 2024-02-21T23:01:34.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.396+0000 7f468b200640 1 -- 172.21.15.99:0/2598714953 shutdown_connections 2024-02-21T23:01:34.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.396+0000 7f468b200640 1 --2- 172.21.15.99:0/2598714953 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f466409ed60 0x7f46640a1220 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:34.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.396+0000 7f468b200640 1 --2- 172.21.15.99:0/2598714953 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4684187ac0 0x7f468421d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:34.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.396+0000 7f468b200640 1 --2- 172.21.15.99:0/2598714953 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f468417f5e0 0x7f468421cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:34.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.396+0000 7f468b200640 1 --2- 172.21.15.99:0/2598714953 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4684072540 0x7f468416b6e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:34.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.396+0000 7f468b200640 1 -- 172.21.15.99:0/2598714953 >> 172.21.15.99:0/2598714953 conn(0x7f46840fe610 msgr2=0x7f46840fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:34.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.396+0000 7f468b200640 1 -- 172.21.15.99:0/2598714953 shutdown_connections 2024-02-21T23:01:34.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.396+0000 7f468b200640 1 -- 172.21.15.99:0/2598714953 wait complete. 2024-02-21T23:01:34.407 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-02-21T23:01:34.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.640+0000 7ff213200640 1 Processor -- start 2024-02-21T23:01:34.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.640+0000 7ff213200640 1 -- start start 2024-02-21T23:01:34.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.641+0000 7ff213200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff21417f710 0x7ff214189f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:34.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.642+0000 7ff213200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff21418b920 0x7ff21415e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:34.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.642+0000 7ff213200640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff21418a5a0 con 0x7ff214071c20 2024-02-21T23:01:34.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.642+0000 7ff213200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff21418bda0 con 0x7ff21418b920 2024-02-21T23:01:34.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.642+0000 7ff213200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff21418a880 con 0x7ff21417f710 2024-02-21T23:01:34.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.642+0000 7ff211400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff21418b920 0x7ff21415e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:34.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.642+0000 7ff211e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff21417f710 0x7ff214189f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:34.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.642+0000 7ff211400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff21418b920 0x7ff21415e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:43360/0 (socket says 172.21.15.99:43360) 2024-02-21T23:01:34.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.642+0000 7ff211400640 1 -- 172.21.15.99:0/2147510072 learned_addr learned my addr 172.21.15.99:0/2147510072 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:34.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.642+0000 7ff211400640 1 -- 172.21.15.99:0/2147510072 >> v2:172.21.15.162:3300/0 conn(0x7ff21417f710 msgr2=0x7ff214189f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:34.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.642+0000 7ff211400640 1 --2- 172.21.15.99:0/2147510072 >> v2:172.21.15.162:3300/0 conn(0x7ff21417f710 0x7ff214189f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:34.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.642+0000 7ff211400640 1 -- 172.21.15.99:0/2147510072 >> v1:172.21.15.181:6789/0 conn(0x7ff214071c20 legacy=0x7ff214188a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:34.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.642+0000 7ff211400640 1 -- 172.21.15.99:0/2147510072 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff21418ab60 con 0x7ff21418b920 2024-02-21T23:01:34.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.644+0000 7ff211400640 1 --2- 172.21.15.99:0/2147510072 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff21418b920 0x7ff21415e490 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff2140fbe00 tx=0x7ff20002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aacd221257be0d3d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:34.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.645+0000 7ff210a00640 1 -- 172.21.15.99:0/2147510072 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff200034070 con 0x7ff21418b920 2024-02-21T23:01:34.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.645+0000 7ff210a00640 1 -- 172.21.15.99:0/2147510072 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff200030860 con 0x7ff21418b920 2024-02-21T23:01:34.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.645+0000 7ff210a00640 1 -- 172.21.15.99:0/2147510072 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff200030c30 con 0x7ff21418b920 2024-02-21T23:01:34.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.645+0000 7ff213200640 1 -- 172.21.15.99:0/2147510072 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff21418b920 msgr2=0x7ff21415e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:34.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.645+0000 7ff213200640 1 --2- 172.21.15.99:0/2147510072 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff21418b920 0x7ff21415e490 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff2140fbe00 tx=0x7ff20002b9a0 comp rx=0 tx=0).stop 2024-02-21T23:01:34.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.645+0000 7ff213200640 1 -- 172.21.15.99:0/2147510072 shutdown_connections 2024-02-21T23:01:34.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.645+0000 7ff213200640 1 --2- 172.21.15.99:0/2147510072 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff21418b920 0x7ff21415e490 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:34.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.645+0000 7ff213200640 1 --2- 172.21.15.99:0/2147510072 >> v2:172.21.15.162:3300/0 conn(0x7ff21417f710 0x7ff214189f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:34.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.645+0000 7ff213200640 1 -- 172.21.15.99:0/2147510072 >> 172.21.15.99:0/2147510072 conn(0x7ff2140fe310 msgr2=0x7ff2140fe720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:34.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.645+0000 7ff213200640 1 -- 172.21.15.99:0/2147510072 shutdown_connections 2024-02-21T23:01:34.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.646+0000 7ff213200640 1 -- 172.21.15.99:0/2147510072 wait complete. 2024-02-21T23:01:34.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.649+0000 7ff213200640 1 Processor -- start 2024-02-21T23:01:34.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.649+0000 7ff213200640 1 -- start start 2024-02-21T23:01:34.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.651+0000 7ff213200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff214071c20 0x7ff2142218e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:34.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.651+0000 7ff213200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff21417f710 0x7ff214221e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:34.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.651+0000 7ff213200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff21418b920 0x7ff21415a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:34.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.651+0000 7ff213200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff21415e9d0 con 0x7ff21418b920 2024-02-21T23:01:34.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.651+0000 7ff213200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff21418b120 con 0x7ff214071c20 2024-02-21T23:01:34.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.651+0000 7ff213200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff21415eb50 con 0x7ff21417f710 2024-02-21T23:01:34.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.651+0000 7ff212800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff21418b920 0x7ff21415a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:34.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.651+0000 7ff212800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff21418b920 0x7ff21415a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:43364/0 (socket says 172.21.15.99:43364) 2024-02-21T23:01:34.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.651+0000 7ff212800640 1 -- 172.21.15.99:0/1248550754 learned_addr learned my addr 172.21.15.99:0/1248550754 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:34.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.652+0000 7ff212800640 1 -- 172.21.15.99:0/1248550754 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff21417f710 msgr2=0x7ff214221e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:34.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.652+0000 7ff212800640 1 --2- 172.21.15.99:0/1248550754 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff21417f710 0x7ff214221e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:34.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.652+0000 7ff212800640 1 -- 172.21.15.99:0/1248550754 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff214071c20 msgr2=0x7ff2142218e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:34.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.652+0000 7ff212800640 1 --2- 172.21.15.99:0/1248550754 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff214071c20 0x7ff2142218e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:34.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.652+0000 7ff212800640 1 -- 172.21.15.99:0/1248550754 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff214220560 con 0x7ff21418b920 2024-02-21T23:01:34.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.652+0000 7ff212800640 1 --2- 172.21.15.99:0/1248550754 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff21418b920 0x7ff21415a110 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff20c00c6b0 tx=0x7ff20c00cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:34.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.652+0000 7ff20a000640 1 -- 172.21.15.99:0/1248550754 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20c003b70 con 0x7ff21418b920 2024-02-21T23:01:34.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.652+0000 7ff20a000640 1 -- 172.21.15.99:0/1248550754 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff20c003d30 con 0x7ff21418b920 2024-02-21T23:01:34.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.652+0000 7ff213200640 1 -- 172.21.15.99:0/1248550754 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff214220840 con 0x7ff21418b920 2024-02-21T23:01:34.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.652+0000 7ff20a000640 1 -- 172.21.15.99:0/1248550754 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20c005310 con 0x7ff21418b920 2024-02-21T23:01:34.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.652+0000 7ff213200640 1 -- 172.21.15.99:0/1248550754 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff214220e00 con 0x7ff21418b920 2024-02-21T23:01:34.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.654+0000 7ff213200640 1 -- 172.21.15.99:0/1248550754 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2140682b0 con 0x7ff21418b920 2024-02-21T23:01:34.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.657+0000 7ff20a000640 1 -- 172.21.15.99:0/1248550754 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 134356+0+0 (secure 0 0 0) 0x7ff20c0054b0 con 0x7ff21418b920 2024-02-21T23:01:34.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.658+0000 7ff20a000640 1 --2- 172.21.15.99:0/1248550754 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7ff1f409ed60 0x7ff1f40a1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:34.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.658+0000 7ff20a000640 1 -- 172.21.15.99:0/1248550754 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7ff20c0c9aa0 con 0x7ff21418b920 2024-02-21T23:01:34.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.658+0000 7ff211e00640 1 --2- 172.21.15.99:0/1248550754 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7ff1f409ed60 0x7ff1f40a1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:34.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.659+0000 7ff211e00640 1 --2- 172.21.15.99:0/1248550754 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7ff1f409ed60 0x7ff1f40a1220 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff204006a90 tx=0x7ff204006a20 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:34.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.667+0000 7ff20a000640 1 -- 172.21.15.99:0/1248550754 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7ff20c097cf0 con 0x7ff21418b920 2024-02-21T23:01:34.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.908+0000 7ff213200640 1 -- 172.21.15.99:0/1248550754 --> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) v1 -- 0x7ff2140d4170 con 0x7ff1f409ed60 2024-02-21T23:01:34.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.913+0000 7ff20a000640 1 -- 172.21.15.99:0/1248550754 <== mgr.4106 v2:172.21.15.162:6800/1717094936 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+54 (secure 0 0 0) 0x7ff2140d4170 con 0x7ff1f409ed60 2024-02-21T23:01:34.902 INFO:teuthology.orchestra.run.smithi099.stdout:/volumes/qa/sv_0/20ec734f-984b-4a19-adba-09834beedd13 2024-02-21T23:01:34.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.916+0000 7ff213200640 1 -- 172.21.15.99:0/1248550754 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7ff1f409ed60 msgr2=0x7ff1f40a1220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:34.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.916+0000 7ff213200640 1 --2- 172.21.15.99:0/1248550754 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7ff1f409ed60 0x7ff1f40a1220 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff204006a90 tx=0x7ff204006a20 comp rx=0 tx=0).stop 2024-02-21T23:01:34.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.916+0000 7ff213200640 1 -- 172.21.15.99:0/1248550754 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff21418b920 msgr2=0x7ff21415a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:34.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.916+0000 7ff213200640 1 --2- 172.21.15.99:0/1248550754 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff21418b920 0x7ff21415a110 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff20c00c6b0 tx=0x7ff20c00cb70 comp rx=0 tx=0).stop 2024-02-21T23:01:34.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.916+0000 7ff213200640 1 -- 172.21.15.99:0/1248550754 shutdown_connections 2024-02-21T23:01:34.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.916+0000 7ff213200640 1 --2- 172.21.15.99:0/1248550754 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7ff1f409ed60 0x7ff1f40a1220 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:34.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.916+0000 7ff213200640 1 --2- 172.21.15.99:0/1248550754 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff21418b920 0x7ff21415a110 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:34.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.916+0000 7ff213200640 1 --2- 172.21.15.99:0/1248550754 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff21417f710 0x7ff214221e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:34.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.916+0000 7ff213200640 1 --2- 172.21.15.99:0/1248550754 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff214071c20 0x7ff2142218e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:34.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.916+0000 7ff213200640 1 -- 172.21.15.99:0/1248550754 >> 172.21.15.99:0/1248550754 conn(0x7ff2140fe310 msgr2=0x7ff21418c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:34.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.916+0000 7ff213200640 1 -- 172.21.15.99:0/1248550754 shutdown_connections 2024-02-21T23:01:34.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:34.916+0000 7ff213200640 1 -- 172.21.15.99:0/1248550754 wait complete. 2024-02-21T23:01:34.922 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_1 --group_name qa 2024-02-21T23:01:35.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.138+0000 7f3dc4a00640 1 Processor -- start 2024-02-21T23:01:35.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.138+0000 7f3dc4a00640 1 -- start start 2024-02-21T23:01:35.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.140+0000 7f3dc4a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3dc0189f40 0x7f3dc018b920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:35.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.140+0000 7f3dc4a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f3dc0071c20 0x7f3dc0072080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:35.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.140+0000 7f3dc4a00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dc018a5a0 con 0x7f3dc017f710 2024-02-21T23:01:35.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.140+0000 7f3dc4a00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dc018a880 con 0x7f3dc0071c20 2024-02-21T23:01:35.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.140+0000 7f3dc4a00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dc018ab60 con 0x7f3dc0189f40 2024-02-21T23:01:35.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.140+0000 7f3dbf200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f3dc0071c20 0x7f3dc0072080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:35.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.140+0000 7f3dbde00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3dc0189f40 0x7f3dc018b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:35.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.140+0000 7f3dbe800640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f3dc017f710 0x7f3dc015e490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:41408/0 (socket says 172.21.15.99:41408) 2024-02-21T23:01:35.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.140+0000 7f3dbde00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3dc0189f40 0x7f3dc018b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:57022/0 (socket says 172.21.15.99:57022) 2024-02-21T23:01:35.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.140+0000 7f3dbe800640 1 -- 172.21.15.99:0/3489950535 learned_addr learned my addr 172.21.15.99:0/3489950535 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:01:35.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.140+0000 7f3dbd400640 1 -- 172.21.15.99:0/3489950535 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1949275326 0 0) 0x7f3dc018a5a0 con 0x7f3dc017f710 2024-02-21T23:01:35.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.141+0000 7f3dbd400640 1 -- 172.21.15.99:0/3489950535 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3da4003520 con 0x7f3dc017f710 2024-02-21T23:01:35.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.141+0000 7f3dbde00640 1 -- 172.21.15.99:0/3489950535 >> v2:172.21.15.99:3300/0 conn(0x7f3dc0071c20 msgr2=0x7f3dc0072080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:35.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.141+0000 7f3dbde00640 1 --2- 172.21.15.99:0/3489950535 >> v2:172.21.15.99:3300/0 conn(0x7f3dc0071c20 0x7f3dc0072080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:35.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.141+0000 7f3dbde00640 1 -- 172.21.15.99:0/3489950535 >> v1:172.21.15.181:6789/0 conn(0x7f3dc017f710 legacy=0x7f3dc015e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:35.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.141+0000 7f3dbde00640 1 -- 172.21.15.99:0/3489950535 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dc018ae40 con 0x7f3dc0189f40 2024-02-21T23:01:35.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.141+0000 7f3dbf200640 1 --2- 172.21.15.99:0/3489950535 >> v2:172.21.15.99:3300/0 conn(0x7f3dc0071c20 0x7f3dc0072080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:01:35.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.142+0000 7f3dbde00640 1 --2- 172.21.15.99:0/3489950535 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3dc0189f40 0x7f3dc018b920 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3dc00d0390 tx=0x7f3dac02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5adcc6a73d7a86b8 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:35.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.142+0000 7f3dbd400640 1 -- 172.21.15.99:0/3489950535 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dac035020 con 0x7f3dc0189f40 2024-02-21T23:01:35.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.142+0000 7f3dbd400640 1 -- 172.21.15.99:0/3489950535 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dac031830 con 0x7f3dc0189f40 2024-02-21T23:01:35.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.142+0000 7f3dbd400640 1 -- 172.21.15.99:0/3489950535 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dac031c00 con 0x7f3dc0189f40 2024-02-21T23:01:35.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.143+0000 7f3dc4a00640 1 -- 172.21.15.99:0/3489950535 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3dc0189f40 msgr2=0x7f3dc018b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:35.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.143+0000 7f3dc4a00640 1 --2- 172.21.15.99:0/3489950535 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3dc0189f40 0x7f3dc018b920 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3dc00d0390 tx=0x7f3dac02b8d0 comp rx=0 tx=0).stop 2024-02-21T23:01:35.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.143+0000 7f3dc4a00640 1 -- 172.21.15.99:0/3489950535 shutdown_connections 2024-02-21T23:01:35.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.143+0000 7f3dc4a00640 1 --2- 172.21.15.99:0/3489950535 >> v2:172.21.15.99:3300/0 conn(0x7f3dc0071c20 0x7f3dc0072080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:35.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.143+0000 7f3dc4a00640 1 --2- 172.21.15.99:0/3489950535 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3dc0189f40 0x7f3dc018b920 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:35.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.143+0000 7f3dc4a00640 1 -- 172.21.15.99:0/3489950535 >> 172.21.15.99:0/3489950535 conn(0x7f3dc00fe310 msgr2=0x7f3dc00fe720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:35.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.143+0000 7f3dc4a00640 1 -- 172.21.15.99:0/3489950535 shutdown_connections 2024-02-21T23:01:35.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.143+0000 7f3dc4a00640 1 -- 172.21.15.99:0/3489950535 wait complete. 2024-02-21T23:01:35.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.147+0000 7f3dc4a00640 1 Processor -- start 2024-02-21T23:01:35.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.147+0000 7f3dc4a00640 1 -- start start 2024-02-21T23:01:35.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.149+0000 7f3dc4a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3dc0071c20 0x7f3dc0174a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:35.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.149+0000 7f3dc4a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3dc017f710 0x7f3dc0176de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:35.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.149+0000 7f3dc4a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3dc0189f40 0x7f3dc0222210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:35.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.149+0000 7f3dc4a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc00d5170 con 0x7f3dc0189f40 2024-02-21T23:01:35.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.149+0000 7f3dc4a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc00d4ff0 con 0x7f3dc017f710 2024-02-21T23:01:35.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.149+0000 7f3dc4a00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc00d52f0 con 0x7f3dc0071c20 2024-02-21T23:01:35.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.149+0000 7f3dbf200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3dc0189f40 0x7f3dc0222210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:35.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.149+0000 7f3dbf200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3dc0189f40 0x7f3dc0222210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:43374/0 (socket says 172.21.15.99:43374) 2024-02-21T23:01:35.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.149+0000 7f3dbf200640 1 -- 172.21.15.99:0/234770977 learned_addr learned my addr 172.21.15.99:0/234770977 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:35.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.149+0000 7f3dbe800640 1 --2- 172.21.15.99:0/234770977 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3dc0071c20 0x7f3dc0174a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:35.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.149+0000 7f3dbde00640 1 --2- 172.21.15.99:0/234770977 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3dc017f710 0x7f3dc0176de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:35.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.150+0000 7f3dbf200640 1 -- 172.21.15.99:0/234770977 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3dc0071c20 msgr2=0x7f3dc0174a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:35.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.150+0000 7f3dbf200640 1 --2- 172.21.15.99:0/234770977 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3dc0071c20 0x7f3dc0174a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:35.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.150+0000 7f3dbf200640 1 -- 172.21.15.99:0/234770977 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3dc017f710 msgr2=0x7f3dc0176de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:35.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.150+0000 7f3dbf200640 1 --2- 172.21.15.99:0/234770977 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3dc017f710 0x7f3dc0176de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:35.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.150+0000 7f3dbf200640 1 -- 172.21.15.99:0/234770977 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dc01739f0 con 0x7f3dc0189f40 2024-02-21T23:01:35.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.150+0000 7f3dbe800640 1 --2- 172.21.15.99:0/234770977 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3dc0071c20 0x7f3dc0174a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:01:35.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.150+0000 7f3dbf200640 1 --2- 172.21.15.99:0/234770977 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3dc0189f40 0x7f3dc0222210 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3db8009f00 tx=0x7f3db800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:35.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.150+0000 7f3db6a00640 1 -- 172.21.15.99:0/234770977 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db8018030 con 0x7f3dc0189f40 2024-02-21T23:01:35.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.150+0000 7f3db6a00640 1 -- 172.21.15.99:0/234770977 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3db800ce50 con 0x7f3dc0189f40 2024-02-21T23:01:35.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.150+0000 7f3dc4a00640 1 -- 172.21.15.99:0/234770977 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dc0173cd0 con 0x7f3dc0189f40 2024-02-21T23:01:35.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.150+0000 7f3db6a00640 1 -- 172.21.15.99:0/234770977 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db8003bb0 con 0x7f3dc0189f40 2024-02-21T23:01:35.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.151+0000 7f3dc4a00640 1 -- 172.21.15.99:0/234770977 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dc0174290 con 0x7f3dc0189f40 2024-02-21T23:01:35.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.152+0000 7f3dc4a00640 1 -- 172.21.15.99:0/234770977 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dc00682b0 con 0x7f3dc0189f40 2024-02-21T23:01:35.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.155+0000 7f3db6a00640 1 -- 172.21.15.99:0/234770977 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 5) v1 ==== 134356+0+0 (secure 0 0 0) 0x7f3db801b070 con 0x7f3dc0189f40 2024-02-21T23:01:35.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.157+0000 7f3db6a00640 1 --2- 172.21.15.99:0/234770977 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f3da009ed60 0x7f3da00a1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:35.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.157+0000 7f3db6a00640 1 -- 172.21.15.99:0/234770977 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f3db80ca4a0 con 0x7f3dc0189f40 2024-02-21T23:01:35.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.157+0000 7f3dbe800640 1 --2- 172.21.15.99:0/234770977 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f3da009ed60 0x7f3da00a1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:35.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.158+0000 7f3dbe800640 1 --2- 172.21.15.99:0/234770977 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f3da009ed60 0x7f3da00a1220 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3db0005880 tx=0x7f3db0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:35.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.165+0000 7f3db6a00640 1 -- 172.21.15.99:0/234770977 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f3db8010040 con 0x7f3dc0189f40 2024-02-21T23:01:35.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.406+0000 7f3db6a00640 1 -- 172.21.15.99:0/234770977 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mgrmap(e 6) v1 ==== 134407+0+0 (secure 0 0 0) 0x7f3db8012050 con 0x7f3dc0189f40 2024-02-21T23:01:35.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.428+0000 7f3dc4a00640 1 -- 172.21.15.99:0/234770977 --> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) v1 -- 0x7f3dc01737a0 con 0x7f3da009ed60 2024-02-21T23:01:35.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.455+0000 7f3db6a00640 1 -- 172.21.15.99:0/234770977 <== mgr.4106 v2:172.21.15.162:6800/1717094936 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f3dc01737a0 con 0x7f3da009ed60 2024-02-21T23:01:35.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.458+0000 7f3dc4a00640 1 -- 172.21.15.99:0/234770977 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f3da009ed60 msgr2=0x7f3da00a1220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:35.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.458+0000 7f3dc4a00640 1 --2- 172.21.15.99:0/234770977 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f3da009ed60 0x7f3da00a1220 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3db0005880 tx=0x7f3db0009040 comp rx=0 tx=0).stop 2024-02-21T23:01:35.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.458+0000 7f3dc4a00640 1 -- 172.21.15.99:0/234770977 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3dc0189f40 msgr2=0x7f3dc0222210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:35.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.458+0000 7f3dc4a00640 1 --2- 172.21.15.99:0/234770977 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3dc0189f40 0x7f3dc0222210 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3db8009f00 tx=0x7f3db800c490 comp rx=0 tx=0).stop 2024-02-21T23:01:35.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.458+0000 7f3dc4a00640 1 -- 172.21.15.99:0/234770977 shutdown_connections 2024-02-21T23:01:35.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.458+0000 7f3dc4a00640 1 --2- 172.21.15.99:0/234770977 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f3da009ed60 0x7f3da00a1220 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:35.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.458+0000 7f3dc4a00640 1 --2- 172.21.15.99:0/234770977 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3dc0189f40 0x7f3dc0222210 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:35.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.458+0000 7f3dc4a00640 1 --2- 172.21.15.99:0/234770977 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3dc017f710 0x7f3dc0176de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:35.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.459+0000 7f3dc4a00640 1 --2- 172.21.15.99:0/234770977 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3dc0071c20 0x7f3dc0174a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:35.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.459+0000 7f3dc4a00640 1 -- 172.21.15.99:0/234770977 >> 172.21.15.99:0/234770977 conn(0x7f3dc00fe310 msgr2=0x7f3dc00d04f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:35.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.459+0000 7f3dc4a00640 1 -- 172.21.15.99:0/234770977 shutdown_connections 2024-02-21T23:01:35.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.459+0000 7f3dc4a00640 1 -- 172.21.15.99:0/234770977 wait complete. 2024-02-21T23:01:35.466 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-02-21T23:01:35.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.696+0000 7ff33fe00640 1 Processor -- start 2024-02-21T23:01:35.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.696+0000 7ff33fe00640 1 -- start start 2024-02-21T23:01:35.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.698+0000 7ff33fe00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7ff34018c3b0 0x7ff34018c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:35.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.698+0000 7ff33fe00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff340186650 con 0x7ff340189ed0 2024-02-21T23:01:35.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.698+0000 7ff33fe00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff34018aa70 con 0x7ff34018bfd0 2024-02-21T23:01:35.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.698+0000 7ff33fe00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff340071b10 con 0x7ff34018c3b0 2024-02-21T23:01:35.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.698+0000 7ff33f400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7ff340189ed0 0x7ff34018a360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:47354/0 (socket says 172.21.15.99:47354) 2024-02-21T23:01:35.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.698+0000 7ff33f400640 1 -- 172.21.15.99:0/2864055798 learned_addr learned my addr 172.21.15.99:0/2864055798 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:01:35.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.698+0000 7ff33e000640 1 --2- 172.21.15.99:0/2864055798 >> v2:172.21.15.181:3300/0 conn(0x7ff34018c3b0 0x7ff34018c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:35.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.699+0000 7ff33d600640 1 -- 172.21.15.99:0/2864055798 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 763403737 0 0) 0x7ff340186650 con 0x7ff340189ed0 2024-02-21T23:01:35.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.699+0000 7ff33e000640 1 -- 172.21.15.99:0/2864055798 >> v1:172.21.15.181:6789/0 conn(0x7ff34018bfd0 legacy=0x7ff3401890b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:35.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.699+0000 7ff33e000640 1 -- 172.21.15.99:0/2864055798 >> v1:172.21.15.99:6789/0 conn(0x7ff340189ed0 legacy=0x7ff34018a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:35.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.699+0000 7ff33e000640 1 -- 172.21.15.99:0/2864055798 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff340071df0 con 0x7ff34018c3b0 2024-02-21T23:01:35.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.700+0000 7ff33e000640 1 --2- 172.21.15.99:0/2864055798 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff34018c3b0 0x7ff34018c830 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff32c0097a0 tx=0x7ff32c02b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d3c3fcfe81293d3 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:35.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.701+0000 7ff33d600640 1 -- 172.21.15.99:0/2864055798 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff32c034070 con 0x7ff34018c3b0 2024-02-21T23:01:35.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.701+0000 7ff33d600640 1 -- 172.21.15.99:0/2864055798 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff32c030610 con 0x7ff34018c3b0 2024-02-21T23:01:35.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.701+0000 7ff33d600640 1 -- 172.21.15.99:0/2864055798 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff32c0309e0 con 0x7ff34018c3b0 2024-02-21T23:01:35.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.702+0000 7ff33fe00640 1 -- 172.21.15.99:0/2864055798 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff34018c3b0 msgr2=0x7ff34018c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:35.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.702+0000 7ff33fe00640 1 --2- 172.21.15.99:0/2864055798 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff34018c3b0 0x7ff34018c830 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff32c0097a0 tx=0x7ff32c02b960 comp rx=0 tx=0).stop 2024-02-21T23:01:35.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.702+0000 7ff33fe00640 1 -- 172.21.15.99:0/2864055798 shutdown_connections 2024-02-21T23:01:35.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.702+0000 7ff33fe00640 1 --2- 172.21.15.99:0/2864055798 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff34018c3b0 0x7ff34018c830 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:35.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.702+0000 7ff33fe00640 1 -- 172.21.15.99:0/2864055798 >> 172.21.15.99:0/2864055798 conn(0x7ff34006e210 msgr2=0x7ff34006e620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:35.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.702+0000 7ff33fe00640 1 -- 172.21.15.99:0/2864055798 shutdown_connections 2024-02-21T23:01:35.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.702+0000 7ff33fe00640 1 -- 172.21.15.99:0/2864055798 wait complete. 2024-02-21T23:01:35.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.704+0000 7ff33fe00640 1 Processor -- start 2024-02-21T23:01:35.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.704+0000 7ff33fe00640 1 -- start start 2024-02-21T23:01:35.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.705+0000 7ff33fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff340189ed0 0x7ff3401697f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:35.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.705+0000 7ff33fe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff34018bfd0 0x7ff340074690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:35.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.705+0000 7ff33fe00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff34018c3b0 0x7ff340074bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:35.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.705+0000 7ff33fe00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff340072690 con 0x7ff340189ed0 2024-02-21T23:01:35.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.705+0000 7ff33fe00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3400723b0 con 0x7ff34018bfd0 2024-02-21T23:01:35.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.705+0000 7ff33fe00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff340072970 con 0x7ff34018c3b0 2024-02-21T23:01:35.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.705+0000 7ff33ea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff340189ed0 0x7ff3401697f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:35.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.705+0000 7ff33f400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff34018c3b0 0x7ff340074bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:35.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.705+0000 7ff33e000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff34018bfd0 0x7ff340074690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:35.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.705+0000 7ff33ea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff340189ed0 0x7ff3401697f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:43380/0 (socket says 172.21.15.99:43380) 2024-02-21T23:01:35.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.705+0000 7ff33ea00640 1 -- 172.21.15.99:0/3743291087 learned_addr learned my addr 172.21.15.99:0/3743291087 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:35.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.706+0000 7ff33f400640 1 -- 172.21.15.99:0/3743291087 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff34018bfd0 msgr2=0x7ff340074690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:35.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.706+0000 7ff33f400640 1 --2- 172.21.15.99:0/3743291087 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff34018bfd0 0x7ff340074690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:35.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.706+0000 7ff33f400640 1 -- 172.21.15.99:0/3743291087 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff340189ed0 msgr2=0x7ff3401697f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:35.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.706+0000 7ff33f400640 1 --2- 172.21.15.99:0/3743291087 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff340189ed0 0x7ff3401697f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:35.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.706+0000 7ff33f400640 1 -- 172.21.15.99:0/3743291087 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3400f71f0 con 0x7ff34018c3b0 2024-02-21T23:01:35.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.706+0000 7ff33ea00640 1 --2- 172.21.15.99:0/3743291087 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff340189ed0 0x7ff3401697f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:01:35.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.706+0000 7ff33f400640 1 --2- 172.21.15.99:0/3743291087 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff34018c3b0 0x7ff340074bd0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff33800c780 tx=0x7ff33800cc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:35.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.707+0000 7ff336a00640 1 -- 172.21.15.99:0/3743291087 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff338018070 con 0x7ff34018c3b0 2024-02-21T23:01:35.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.707+0000 7ff336a00640 1 -- 172.21.15.99:0/3743291087 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff338004d60 con 0x7ff34018c3b0 2024-02-21T23:01:35.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.707+0000 7ff336a00640 1 -- 172.21.15.99:0/3743291087 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33800a880 con 0x7ff34018c3b0 2024-02-21T23:01:35.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.707+0000 7ff33fe00640 1 -- 172.21.15.99:0/3743291087 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3400f74d0 con 0x7ff34018c3b0 2024-02-21T23:01:35.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.707+0000 7ff33fe00640 1 -- 172.21.15.99:0/3743291087 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3401808f0 con 0x7ff34018c3b0 2024-02-21T23:01:35.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.708+0000 7ff33fe00640 1 -- 172.21.15.99:0/3743291087 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3400682b0 con 0x7ff34018c3b0 2024-02-21T23:01:35.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.710+0000 7ff336a00640 1 -- 172.21.15.99:0/3743291087 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 6) v1 ==== 134407+0+0 (secure 0 0 0) 0x7ff33801b070 con 0x7ff34018c3b0 2024-02-21T23:01:35.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.711+0000 7ff336a00640 1 --2- 172.21.15.99:0/3743291087 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7ff32009edf0 0x7ff3200a12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:35.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.711+0000 7ff336a00640 1 -- 172.21.15.99:0/3743291087 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7ff3380c8f10 con 0x7ff34018c3b0 2024-02-21T23:01:35.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.712+0000 7ff33ea00640 1 --2- 172.21.15.99:0/3743291087 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7ff32009edf0 0x7ff3200a12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:35.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.712+0000 7ff33ea00640 1 --2- 172.21.15.99:0/3743291087 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7ff32009edf0 0x7ff3200a12b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff340188620 tx=0x7ff330009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:35.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.715+0000 7ff336a00640 1 -- 172.21.15.99:0/3743291087 <== mon.2 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7ff338096b50 con 0x7ff34018c3b0 2024-02-21T23:01:35.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.944+0000 7ff33fe00640 1 -- 172.21.15.99:0/3743291087 --> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7ff340169d30 con 0x7ff32009edf0 2024-02-21T23:01:35.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.948+0000 7ff336a00640 1 -- 172.21.15.99:0/3743291087 <== mgr.4106 v2:172.21.15.162:6800/1717094936 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+54 (secure 0 0 0) 0x7ff33000fcb0 con 0x7ff32009edf0 2024-02-21T23:01:35.937 INFO:teuthology.orchestra.run.smithi099.stdout:/volumes/qa/sv_1/dff04ef9-9382-46fe-8a52-35eae211921b 2024-02-21T23:01:35.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.951+0000 7ff33fe00640 1 -- 172.21.15.99:0/3743291087 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7ff32009edf0 msgr2=0x7ff3200a12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:35.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.951+0000 7ff33fe00640 1 --2- 172.21.15.99:0/3743291087 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7ff32009edf0 0x7ff3200a12b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff340188620 tx=0x7ff330009040 comp rx=0 tx=0).stop 2024-02-21T23:01:35.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.951+0000 7ff33fe00640 1 -- 172.21.15.99:0/3743291087 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff34018c3b0 msgr2=0x7ff340074bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:35.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.951+0000 7ff33fe00640 1 --2- 172.21.15.99:0/3743291087 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff34018c3b0 0x7ff340074bd0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff33800c780 tx=0x7ff33800cc40 comp rx=0 tx=0).stop 2024-02-21T23:01:35.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.951+0000 7ff33fe00640 1 -- 172.21.15.99:0/3743291087 shutdown_connections 2024-02-21T23:01:35.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.951+0000 7ff33fe00640 1 --2- 172.21.15.99:0/3743291087 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7ff32009edf0 0x7ff3200a12b0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:35.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.951+0000 7ff33fe00640 1 --2- 172.21.15.99:0/3743291087 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff34018c3b0 0x7ff340074bd0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:35.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.951+0000 7ff33fe00640 1 --2- 172.21.15.99:0/3743291087 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff34018bfd0 0x7ff340074690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:35.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.951+0000 7ff33fe00640 1 --2- 172.21.15.99:0/3743291087 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff340189ed0 0x7ff3401697f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:35.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.951+0000 7ff33fe00640 1 -- 172.21.15.99:0/3743291087 >> 172.21.15.99:0/3743291087 conn(0x7ff34006e210 msgr2=0x7ff34018c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:35.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.951+0000 7ff33fe00640 1 -- 172.21.15.99:0/3743291087 shutdown_connections 2024-02-21T23:01:35.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:35.951+0000 7ff33fe00640 1 -- 172.21.15.99:0/3743291087 wait complete. 2024-02-21T23:01:35.959 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T23:01:36.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.162+0000 7f8b49400640 1 Processor -- start 2024-02-21T23:01:36.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.162+0000 7f8b49400640 1 -- start start 2024-02-21T23:01:36.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.165+0000 7f8b49400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f8b4418a3d0 0x7f8b4418a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:36.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.165+0000 7f8b49400640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f8b440717d0 0x7f8b44071c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:36.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.165+0000 7f8b49400640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b44070380 con 0x7f8b441809a0 2024-02-21T23:01:36.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.165+0000 7f8b49400640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b4418ad90 con 0x7f8b4418a3d0 2024-02-21T23:01:36.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.165+0000 7f8b49400640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b44070150 con 0x7f8b440717d0 2024-02-21T23:01:36.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.166+0000 7f8b48a00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f8b440717d0 0x7f8b44071c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:36.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.166+0000 7f8b43e00640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f8b441809a0 0x7f8b4406fa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:41434/0 (socket says 172.21.15.99:41434) 2024-02-21T23:01:36.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.166+0000 7f8b48a00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f8b440717d0 0x7f8b44071c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:50116/0 (socket says 172.21.15.99:50116) 2024-02-21T23:01:36.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.166+0000 7f8b43e00640 1 -- 172.21.15.99:0/3464155093 learned_addr learned my addr 172.21.15.99:0/3464155093 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:01:36.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.166+0000 7f8b43400640 1 --2- 172.21.15.99:0/3464155093 >> v2:172.21.15.162:3300/0 conn(0x7f8b4418a3d0 0x7f8b4418a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:36.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.166+0000 7f8b48a00640 1 -- 172.21.15.99:0/3464155093 >> v2:172.21.15.162:3300/0 conn(0x7f8b4418a3d0 msgr2=0x7f8b4418a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:36.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.166+0000 7f8b48a00640 1 --2- 172.21.15.99:0/3464155093 >> v2:172.21.15.162:3300/0 conn(0x7f8b4418a3d0 0x7f8b4418a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:36.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.166+0000 7f8b48a00640 1 -- 172.21.15.99:0/3464155093 >> v1:172.21.15.181:6789/0 conn(0x7f8b441809a0 legacy=0x7f8b4406fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:36.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.166+0000 7f8b48a00640 1 -- 172.21.15.99:0/3464155093 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b44070660 con 0x7f8b440717d0 2024-02-21T23:01:36.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.167+0000 7f8b48a00640 1 --2- 172.21.15.99:0/3464155093 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8b440717d0 0x7f8b44071c20 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8b44162ac0 tx=0x7f8b3c02bda0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2dcbfcd71f59cd6c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:36.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.168+0000 7f8b42a00640 1 -- 172.21.15.99:0/3464155093 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c039070 con 0x7f8b440717d0 2024-02-21T23:01:36.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.168+0000 7f8b42a00640 1 -- 172.21.15.99:0/3464155093 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b3c02cb50 con 0x7f8b440717d0 2024-02-21T23:01:36.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.168+0000 7f8b42a00640 1 -- 172.21.15.99:0/3464155093 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c034440 con 0x7f8b440717d0 2024-02-21T23:01:36.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.168+0000 7f8b49400640 1 -- 172.21.15.99:0/3464155093 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8b440717d0 msgr2=0x7f8b44071c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:36.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.168+0000 7f8b49400640 1 --2- 172.21.15.99:0/3464155093 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8b440717d0 0x7f8b44071c20 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8b44162ac0 tx=0x7f8b3c02bda0 comp rx=0 tx=0).stop 2024-02-21T23:01:36.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.168+0000 7f8b49400640 1 -- 172.21.15.99:0/3464155093 shutdown_connections 2024-02-21T23:01:36.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.168+0000 7f8b49400640 1 --2- 172.21.15.99:0/3464155093 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8b440717d0 0x7f8b44071c20 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:36.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.168+0000 7f8b49400640 1 --2- 172.21.15.99:0/3464155093 >> v2:172.21.15.162:3300/0 conn(0x7f8b4418a3d0 0x7f8b4418a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:36.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.169+0000 7f8b49400640 1 -- 172.21.15.99:0/3464155093 >> 172.21.15.99:0/3464155093 conn(0x7f8b4406e210 msgr2=0x7f8b4406e620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:36.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.169+0000 7f8b49400640 1 -- 172.21.15.99:0/3464155093 shutdown_connections 2024-02-21T23:01:36.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.169+0000 7f8b49400640 1 -- 172.21.15.99:0/3464155093 wait complete. 2024-02-21T23:01:36.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.171+0000 7f8b49400640 1 Processor -- start 2024-02-21T23:01:36.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.171+0000 7f8b49400640 1 -- start start 2024-02-21T23:01:36.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.173+0000 7f8b49400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8b440717d0 0x7f8b4416a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:36.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.173+0000 7f8b49400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8b441809a0 0x7f8b44179d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:36.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.173+0000 7f8b49400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b4418a3d0 0x7f8b440f9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:36.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.173+0000 7f8b49400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b44070c20 con 0x7f8b441809a0 2024-02-21T23:01:36.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.173+0000 7f8b49400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b44071270 con 0x7f8b4418a3d0 2024-02-21T23:01:36.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.173+0000 7f8b49400640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b44070f00 con 0x7f8b440717d0 2024-02-21T23:01:36.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.173+0000 7f8b43400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8b441809a0 0x7f8b44179d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:36.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.173+0000 7f8b48a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b4418a3d0 0x7f8b440f9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:36.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.173+0000 7f8b43e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8b440717d0 0x7f8b4416a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:36.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.173+0000 7f8b48a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b4418a3d0 0x7f8b440f9450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:57058/0 (socket says 172.21.15.99:57058) 2024-02-21T23:01:36.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.173+0000 7f8b48a00640 1 -- 172.21.15.99:0/3441918603 learned_addr learned my addr 172.21.15.99:0/3441918603 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:36.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.173+0000 7f8b43400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8b441809a0 0x7f8b44179d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:43384/0 (socket says 172.21.15.99:43384) 2024-02-21T23:01:36.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.174+0000 7f8b48a00640 1 -- 172.21.15.99:0/3441918603 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8b440717d0 msgr2=0x7f8b4416a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:36.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.174+0000 7f8b48a00640 1 --2- 172.21.15.99:0/3441918603 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8b440717d0 0x7f8b4416a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:36.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.174+0000 7f8b48a00640 1 -- 172.21.15.99:0/3441918603 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8b441809a0 msgr2=0x7f8b44179d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:36.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.174+0000 7f8b48a00640 1 --2- 172.21.15.99:0/3441918603 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8b441809a0 0x7f8b44179d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:36.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.174+0000 7f8b48a00640 1 -- 172.21.15.99:0/3441918603 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b440d1a80 con 0x7f8b4418a3d0 2024-02-21T23:01:36.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.174+0000 7f8b43400640 1 --2- 172.21.15.99:0/3441918603 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8b441809a0 0x7f8b44179d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:01:36.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.174+0000 7f8b43e00640 1 --2- 172.21.15.99:0/3441918603 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8b440717d0 0x7f8b4416a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:01:36.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.174+0000 7f8b48a00640 1 --2- 172.21.15.99:0/3441918603 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b4418a3d0 0x7f8b440f9450 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c009e80 tx=0x7f8b3c004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:36.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.175+0000 7f8b3be00640 1 -- 172.21.15.99:0/3441918603 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c039050 con 0x7f8b4418a3d0 2024-02-21T23:01:36.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.175+0000 7f8b3be00640 1 -- 172.21.15.99:0/3441918603 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b3c045070 con 0x7f8b4418a3d0 2024-02-21T23:01:36.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.175+0000 7f8b49400640 1 -- 172.21.15.99:0/3441918603 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b440d1d60 con 0x7f8b4418a3d0 2024-02-21T23:01:36.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.175+0000 7f8b3be00640 1 -- 172.21.15.99:0/3441918603 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c009450 con 0x7f8b4418a3d0 2024-02-21T23:01:36.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.175+0000 7f8b49400640 1 -- 172.21.15.99:0/3441918603 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b440d2320 con 0x7f8b4418a3d0 2024-02-21T23:01:36.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.176+0000 7f8b39600640 1 -- 172.21.15.99:0/3441918603 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b44068320 con 0x7f8b4418a3d0 2024-02-21T23:01:36.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.180+0000 7f8b3be00640 1 -- 172.21.15.99:0/3441918603 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 6) v1 ==== 134407+0+0 (secure 0 0 0) 0x7f8b3c03e850 con 0x7f8b4418a3d0 2024-02-21T23:01:36.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.182+0000 7f8b3be00640 1 --2- 172.21.15.99:0/3441918603 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f8b2409edf0 0x7f8b240a12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:36.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.182+0000 7f8b3be00640 1 -- 172.21.15.99:0/3441918603 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f8b3c0ed190 con 0x7f8b4418a3d0 2024-02-21T23:01:36.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.182+0000 7f8b43e00640 1 --2- 172.21.15.99:0/3441918603 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f8b2409edf0 0x7f8b240a12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:36.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.183+0000 7f8b3be00640 1 -- 172.21.15.99:0/3441918603 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f8b3c0bb3f0 con 0x7f8b4418a3d0 2024-02-21T23:01:36.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.183+0000 7f8b43e00640 1 --2- 172.21.15.99:0/3441918603 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f8b2409edf0 0x7f8b240a12b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8b34007fd0 tx=0x7f8b34007e80 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:36.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.424+0000 7f8b39600640 1 -- 172.21.15.99:0/3441918603 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8b4416d1f0 con 0x7f8b4418a3d0 2024-02-21T23:01:36.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.425+0000 7f8b3be00640 1 -- 172.21.15.99:0/3441918603 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+11335 (secure 0 0 0) 0x7f8b3c0bacf0 con 0x7f8b4418a3d0 2024-02-21T23:01:36.414 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T23:01:36.414 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4307,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/3514452812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3514452812},{"type":"v1","addr":"172.21.15.162:6836","nonce":3514452812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4312,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6838/2169982089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":2169982089},{"type":"v1","addr":"172.21.15.162:6838","nonce":2169982089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4315,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6839/3335972724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6837","nonce":3335972724},{"type":"v1","addr":"172.21.15.162:6839","nonce":3335972724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4318,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6841/2135456697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6840","nonce":2135456697},{"type":"v1","addr":"172.21.15.162:6841","nonce":2135456697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4325,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2452242758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2452242758},{"type":"v1","addr":"172.21.15.181:6833","nonce":2452242758}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4328,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6836/2751486400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":2751486400},{"type":"v1","addr":"172.21.15.181:6836","nonce":2751486400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":14,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-21T23:01:02.656130+0000","modified":"2024-02-21T23:01:33.387960+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4355,"mds_1":4352,"mds_2":4348},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4331":{"gid":4331,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6838/3728901330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6835","nonce":3728901330},{"type":"v1","addr":"172.21.15.181:6838","nonce":3728901330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4339":{"gid":4339,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6839/3357929641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6837","nonce":3357929641},{"type":"v1","addr":"172.21.15.181:6839","nonce":3357929641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4343":{"gid":4343,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6833/2793485078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":2793485078},{"type":"v1","addr":"172.21.15.99:6833","nonce":2793485078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4348":{"gid":4348,"name":"d","rank":2,"incarnation":12,"state":"up:active","state_seq":10,"addr":"172.21.15.99:6835/2243461688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2243461688},{"type":"v1","addr":"172.21.15.99:6835","nonce":2243461688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4352":{"gid":4352,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.99:6837/1676159950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":1676159950},{"type":"v1","addr":"172.21.15.99:6837","nonce":1676159950}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4355":{"gid":4355,"name":"j","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6839/4239008786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":4239008786},{"type":"v1","addr":"172.21.15.99:6839","nonce":4239008786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-21T23:01:36.414 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 14 2024-02-21T23:01:36.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.428+0000 7f8b39600640 1 -- 172.21.15.99:0/3441918603 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f8b2409edf0 msgr2=0x7f8b240a12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:36.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.428+0000 7f8b39600640 1 --2- 172.21.15.99:0/3441918603 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f8b2409edf0 0x7f8b240a12b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8b34007fd0 tx=0x7f8b34007e80 comp rx=0 tx=0).stop 2024-02-21T23:01:36.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.429+0000 7f8b39600640 1 -- 172.21.15.99:0/3441918603 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b4418a3d0 msgr2=0x7f8b440f9450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:36.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.429+0000 7f8b39600640 1 --2- 172.21.15.99:0/3441918603 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b4418a3d0 0x7f8b440f9450 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c009e80 tx=0x7f8b3c004a40 comp rx=0 tx=0).stop 2024-02-21T23:01:36.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.429+0000 7f8b39600640 1 -- 172.21.15.99:0/3441918603 shutdown_connections 2024-02-21T23:01:36.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.429+0000 7f8b39600640 1 --2- 172.21.15.99:0/3441918603 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f8b2409edf0 0x7f8b240a12b0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:36.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.429+0000 7f8b39600640 1 --2- 172.21.15.99:0/3441918603 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8b4418a3d0 0x7f8b440f9450 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:36.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.429+0000 7f8b39600640 1 --2- 172.21.15.99:0/3441918603 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8b441809a0 0x7f8b44179d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:36.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.429+0000 7f8b39600640 1 --2- 172.21.15.99:0/3441918603 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8b440717d0 0x7f8b4416a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:36.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.429+0000 7f8b39600640 1 -- 172.21.15.99:0/3441918603 >> 172.21.15.99:0/3441918603 conn(0x7f8b4406e210 msgr2=0x7f8b44071bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:36.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.429+0000 7f8b39600640 1 -- 172.21.15.99:0/3441918603 shutdown_connections 2024-02-21T23:01:36.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.429+0000 7f8b39600640 1 -- 172.21.15.99:0/3441918603 wait complete. 2024-02-21T23:01:36.435 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T23:01:36.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.650+0000 7fb8bbe00640 1 Processor -- start 2024-02-21T23:01:36.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.650+0000 7fb8bbe00640 1 -- start start 2024-02-21T23:01:36.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.652+0000 7fb8bbe00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fb8bc18a010 0x7fb8bc18b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:36.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.652+0000 7fb8bbe00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb8bc0719b0 0x7fb8bc071e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:36.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.652+0000 7fb8bbe00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8bc18a600 con 0x7fb8bc182a80 2024-02-21T23:01:36.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.652+0000 7fb8bbe00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8bc18bec0 con 0x7fb8bc0719b0 2024-02-21T23:01:36.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.652+0000 7fb8bbe00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8bc18a8e0 con 0x7fb8bc18a010 2024-02-21T23:01:36.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.652+0000 7fb8bb400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb8bc0719b0 0x7fb8bc071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:36.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.653+0000 7fb8ba000640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fb8bc18a010 0x7fb8bc18b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:36.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.653+0000 7fb8baa00640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fb8bc182a80 0x7fb8bc186a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:41442/0 (socket says 172.21.15.99:41442) 2024-02-21T23:01:36.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.653+0000 7fb8baa00640 1 -- 172.21.15.99:0/1155988908 learned_addr learned my addr 172.21.15.99:0/1155988908 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:01:36.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.653+0000 7fb8bb400640 1 -- 172.21.15.99:0/1155988908 >> v2:172.21.15.181:3300/0 conn(0x7fb8bc18a010 msgr2=0x7fb8bc18b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:36.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.653+0000 7fb8bb400640 1 --2- 172.21.15.99:0/1155988908 >> v2:172.21.15.181:3300/0 conn(0x7fb8bc18a010 0x7fb8bc18b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:36.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.653+0000 7fb8bb400640 1 -- 172.21.15.99:0/1155988908 >> v1:172.21.15.181:6789/0 conn(0x7fb8bc182a80 legacy=0x7fb8bc186a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:36.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.653+0000 7fb8b9600640 1 -- 172.21.15.99:0/1155988908 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3150294331 0 0) 0x7fb8bc18a600 con 0x7fb8bc182a80 2024-02-21T23:01:36.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.653+0000 7fb8bb400640 1 -- 172.21.15.99:0/1155988908 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8bc18abc0 con 0x7fb8bc0719b0 2024-02-21T23:01:36.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.655+0000 7fb8bb400640 1 --2- 172.21.15.99:0/1155988908 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb8bc0719b0 0x7fb8bc071e40 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc15afe0 tx=0x7fb8b402bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81b169794643b88d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:36.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.655+0000 7fb8b9600640 1 -- 172.21.15.99:0/1155988908 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b4039070 con 0x7fb8bc0719b0 2024-02-21T23:01:36.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.655+0000 7fb8b9600640 1 -- 172.21.15.99:0/1155988908 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8b402cb50 con 0x7fb8bc0719b0 2024-02-21T23:01:36.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.655+0000 7fb8b9600640 1 -- 172.21.15.99:0/1155988908 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b4034440 con 0x7fb8bc0719b0 2024-02-21T23:01:36.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.656+0000 7fb8bbe00640 1 -- 172.21.15.99:0/1155988908 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb8bc0719b0 msgr2=0x7fb8bc071e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:36.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.656+0000 7fb8bbe00640 1 --2- 172.21.15.99:0/1155988908 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb8bc0719b0 0x7fb8bc071e40 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc15afe0 tx=0x7fb8b402bda0 comp rx=0 tx=0).stop 2024-02-21T23:01:36.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.656+0000 7fb8bbe00640 1 -- 172.21.15.99:0/1155988908 shutdown_connections 2024-02-21T23:01:36.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.656+0000 7fb8bbe00640 1 --2- 172.21.15.99:0/1155988908 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb8bc0719b0 0x7fb8bc071e40 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:36.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.656+0000 7fb8bbe00640 1 --2- 172.21.15.99:0/1155988908 >> v2:172.21.15.181:3300/0 conn(0x7fb8bc18a010 0x7fb8bc18b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:36.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.656+0000 7fb8bbe00640 1 -- 172.21.15.99:0/1155988908 >> 172.21.15.99:0/1155988908 conn(0x7fb8bc0d29f0 msgr2=0x7fb8bc0d2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:36.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.656+0000 7fb8bbe00640 1 -- 172.21.15.99:0/1155988908 shutdown_connections 2024-02-21T23:01:36.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.656+0000 7fb8bbe00640 1 -- 172.21.15.99:0/1155988908 wait complete. 2024-02-21T23:01:36.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.658+0000 7fb8bbe00640 1 Processor -- start 2024-02-21T23:01:36.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.658+0000 7fb8bbe00640 1 -- start start 2024-02-21T23:01:36.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.659+0000 7fb8bbe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8bc0719b0 0x7fb8bc21f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:36.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.659+0000 7fb8bbe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb8bc182a80 0x7fb8bc17c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:36.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.659+0000 7fb8bbe00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb8bc18a010 0x7fb8bc17d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:36.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.659+0000 7fb8bbe00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8bc18b460 con 0x7fb8bc182a80 2024-02-21T23:01:36.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.659+0000 7fb8bbe00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8bc18b180 con 0x7fb8bc0719b0 2024-02-21T23:01:36.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.659+0000 7fb8bbe00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8bc182e60 con 0x7fb8bc18a010 2024-02-21T23:01:36.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.659+0000 7fb8ba000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb8bc182a80 0x7fb8bc17c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:36.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.659+0000 7fb8ba000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb8bc182a80 0x7fb8bc17c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:43406/0 (socket says 172.21.15.99:43406) 2024-02-21T23:01:36.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.659+0000 7fb8ba000640 1 -- 172.21.15.99:0/3660923000 learned_addr learned my addr 172.21.15.99:0/3660923000 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:36.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.660+0000 7fb8baa00640 1 --2- 172.21.15.99:0/3660923000 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8bc0719b0 0x7fb8bc21f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:36.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.660+0000 7fb8bb400640 1 --2- 172.21.15.99:0/3660923000 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb8bc18a010 0x7fb8bc17d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:36.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.660+0000 7fb8ba000640 1 -- 172.21.15.99:0/3660923000 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb8bc18a010 msgr2=0x7fb8bc17d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:36.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.660+0000 7fb8ba000640 1 --2- 172.21.15.99:0/3660923000 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb8bc18a010 0x7fb8bc17d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:36.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.660+0000 7fb8ba000640 1 -- 172.21.15.99:0/3660923000 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8bc0719b0 msgr2=0x7fb8bc21f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:36.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.660+0000 7fb8ba000640 1 --2- 172.21.15.99:0/3660923000 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8bc0719b0 0x7fb8bc21f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:36.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.660+0000 7fb8ba000640 1 -- 172.21.15.99:0/3660923000 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8bc21dfe0 con 0x7fb8bc182a80 2024-02-21T23:01:36.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.660+0000 7fb8ba000640 1 --2- 172.21.15.99:0/3660923000 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb8bc182a80 0x7fb8bc17c390 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb8a800e900 tx=0x7fb8a800edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:36.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.661+0000 7fb8b2a00640 1 -- 172.21.15.99:0/3660923000 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a8017070 con 0x7fb8bc182a80 2024-02-21T23:01:36.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.661+0000 7fb8b2a00640 1 -- 172.21.15.99:0/3660923000 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a800ca00 con 0x7fb8bc182a80 2024-02-21T23:01:36.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.661+0000 7fb8bbe00640 1 -- 172.21.15.99:0/3660923000 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8bc21e2c0 con 0x7fb8bc182a80 2024-02-21T23:01:36.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.661+0000 7fb8b2a00640 1 -- 172.21.15.99:0/3660923000 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a800cdb0 con 0x7fb8bc182a80 2024-02-21T23:01:36.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.661+0000 7fb8bbe00640 1 -- 172.21.15.99:0/3660923000 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8bc17d160 con 0x7fb8bc182a80 2024-02-21T23:01:36.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.662+0000 7fb8bbe00640 1 -- 172.21.15.99:0/3660923000 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8bc068320 con 0x7fb8bc182a80 2024-02-21T23:01:36.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.664+0000 7fb8b2a00640 1 -- 172.21.15.99:0/3660923000 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 6) v1 ==== 134407+0+0 (secure 0 0 0) 0x7fb8a801a070 con 0x7fb8bc182a80 2024-02-21T23:01:36.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.665+0000 7fb8b2a00640 1 --2- 172.21.15.99:0/3660923000 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fb89c09edf0 0x7fb89c0a12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:36.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.665+0000 7fb8b2a00640 1 -- 172.21.15.99:0/3660923000 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fb8a80c9f00 con 0x7fb8bc182a80 2024-02-21T23:01:36.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.666+0000 7fb8baa00640 1 --2- 172.21.15.99:0/3660923000 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fb89c09edf0 0x7fb89c0a12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:36.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.666+0000 7fb8baa00640 1 --2- 172.21.15.99:0/3660923000 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fb89c09edf0 0x7fb89c0a12b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac000f60 tx=0x7fb8ac007e40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:36.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.674+0000 7fb8b2a00640 1 -- 172.21.15.99:0/3660923000 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fb8a8097ab0 con 0x7fb8bc182a80 2024-02-21T23:01:36.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.917+0000 7fb8bbe00640 1 -- 172.21.15.99:0/3660923000 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb8bc0fcc10 con 0x7fb8bc182a80 2024-02-21T23:01:36.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.918+0000 7fb8b2a00640 1 -- 172.21.15.99:0/3660923000 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+23570 (secure 0 0 0) 0x7fb8a809bb50 con 0x7fb8bc182a80 2024-02-21T23:01:36.908 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T23:01:36.908 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":29,"fsid":"e8af98cd-45a1-425f-96a7-f24da8ee4efb","created":"2024-02-21T23:00:44.699708+0000","modified":"2024-02-21T23:01:07.722511+0000","last_up_change":"2024-02-21T23:00:55.749829+0000","last_in_change":"2024-02-21T23:00:48.332297+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T23:00:57.020557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":11.760000228881836,"score_stable":11.760000228881836,"optimal_score":0.17000000178813934,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-21T23:01:01.124398+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-21T23:01:01.684258+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-21T23:01:05.290089+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c49de9b2-dc53-4882-b14c-7059ed40bf59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6809","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6811","nonce":1026112937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6813","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6815","nonce":1026112937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6823","nonce":1026112937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6819","nonce":1026112937}]},"public_addr":"172.21.15.99:6811/1026112937","cluster_addr":"172.21.15.99:6815/1026112937","heartbeat_back_addr":"172.21.15.99:6823/1026112937","heartbeat_front_addr":"172.21.15.99:6819/1026112937","state":["exists","up"]},{"osd":1,"uuid":"58398292-2fe5-4291-94fd-03a0ca29d49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6827","nonce":3030871566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6829","nonce":3030871566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6833","nonce":3030871566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6831","nonce":3030871566}]},"public_addr":"172.21.15.162:6827/3030871566","cluster_addr":"172.21.15.162:6829/3030871566","heartbeat_back_addr":"172.21.15.162:6833/3030871566","heartbeat_front_addr":"172.21.15.162:6831/3030871566","state":["exists","up"]},{"osd":2,"uuid":"94cddec1-e08f-438d-a7c8-48a0e47d71a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6818","nonce":2782386148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6821","nonce":2782386148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6827","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6829","nonce":2782386148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6823","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6825","nonce":2782386148}]},"public_addr":"172.21.15.181:6818/2782386148","cluster_addr":"172.21.15.181:6821/2782386148","heartbeat_back_addr":"172.21.15.181:6829/2782386148","heartbeat_front_addr":"172.21.15.181:6825/2782386148","state":["exists","up"]},{"osd":3,"uuid":"d29abb74-9b89-4fd7-88b1-7c2eb8231189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6801","nonce":2316185310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6803","nonce":2316185310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6807","nonce":2316185310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6805","nonce":2316185310}]},"public_addr":"172.21.15.99:6801/2316185310","cluster_addr":"172.21.15.99:6803/2316185310","heartbeat_back_addr":"172.21.15.99:6807/2316185310","heartbeat_front_addr":"172.21.15.99:6805/2316185310","state":["exists","up"]},{"osd":4,"uuid":"0d8c9ea3-880a-4d69-9dcb-cf7d35abd449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6811","nonce":3137681258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6813","nonce":3137681258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6817","nonce":3137681258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6815","nonce":3137681258}]},"public_addr":"172.21.15.162:6811/3137681258","cluster_addr":"172.21.15.162:6813/3137681258","heartbeat_back_addr":"172.21.15.162:6817/3137681258","heartbeat_front_addr":"172.21.15.162:6815/3137681258","state":["exists","up"]},{"osd":5,"uuid":"2e3a9340-6fd0-4d7a-8e00-fe305649296e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6801","nonce":2011264527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6803","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6805","nonce":2011264527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6811","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6813","nonce":2011264527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6807","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6809","nonce":2011264527}]},"public_addr":"172.21.15.181:6801/2011264527","cluster_addr":"172.21.15.181:6805/2011264527","heartbeat_back_addr":"172.21.15.181:6813/2011264527","heartbeat_front_addr":"172.21.15.181:6809/2011264527","state":["exists","up"]},{"osd":6,"uuid":"d9e37ce7-1b0e-4019-8f2e-b670403abf7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6810","nonce":753870050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6814","nonce":753870050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6822","nonce":753870050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6818","nonce":753870050}]},"public_addr":"172.21.15.99:6810/753870050","cluster_addr":"172.21.15.99:6814/753870050","heartbeat_back_addr":"172.21.15.99:6822/753870050","heartbeat_front_addr":"172.21.15.99:6818/753870050","state":["exists","up"]},{"osd":7,"uuid":"49988754-232e-4b8c-bd72-bfa25b418e5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6803","nonce":1659412949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6805","nonce":1659412949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6809","nonce":1659412949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6807","nonce":1659412949}]},"public_addr":"172.21.15.162:6803/1659412949","cluster_addr":"172.21.15.162:6805/1659412949","heartbeat_back_addr":"172.21.15.162:6809/1659412949","heartbeat_front_addr":"172.21.15.162:6807/1659412949","state":["exists","up"]},{"osd":8,"uuid":"ebc6e462-8368-4d64-b242-9c8735ac672c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6804","nonce":3389807042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6808","nonce":3389807042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6815","nonce":3389807042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6812","nonce":3389807042}]},"public_addr":"172.21.15.181:6804/3389807042","cluster_addr":"172.21.15.181:6808/3389807042","heartbeat_back_addr":"172.21.15.181:6815/3389807042","heartbeat_front_addr":"172.21.15.181:6812/3389807042","state":["exists","up"]},{"osd":9,"uuid":"72af1b02-b965-4d6a-8964-527ec24c4daa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6825","nonce":4055669590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6827","nonce":4055669590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6831","nonce":4055669590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6829","nonce":4055669590}]},"public_addr":"172.21.15.99:6825/4055669590","cluster_addr":"172.21.15.99:6827/4055669590","heartbeat_back_addr":"172.21.15.99:6831/4055669590","heartbeat_front_addr":"172.21.15.99:6829/4055669590","state":["exists","up"]},{"osd":10,"uuid":"adb5cb06-6453-41e4-b847-d7c78bbb7d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6819","nonce":1421879617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6821","nonce":1421879617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6825","nonce":1421879617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6823","nonce":1421879617}]},"public_addr":"172.21.15.162:6819/1421879617","cluster_addr":"172.21.15.162:6821/1421879617","heartbeat_back_addr":"172.21.15.162:6825/1421879617","heartbeat_front_addr":"172.21.15.162:6823/1421879617","state":["exists","up"]},{"osd":11,"uuid":"118563d9-1e8f-4dc7-a92c-2f4c4dc3e20f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6817","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6819","nonce":3219928272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6824","nonce":3219928272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6831","nonce":3219928272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6828","nonce":3219928272}]},"public_addr":"172.21.15.181:6819/3219928272","cluster_addr":"172.21.15.181:6824/3219928272","heartbeat_back_addr":"172.21.15.181:6831/3219928272","heartbeat_front_addr":"172.21.15.181:6828/3219928272","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.651219+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.549859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.529659+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.591004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.440836+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.414250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.630130+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.411954+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.439371+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.428173+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.511203+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.482806+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T23:01:36.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.921+0000 7fb8bbe00640 1 -- 172.21.15.99:0/3660923000 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fb89c09edf0 msgr2=0x7fb89c0a12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:36.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.921+0000 7fb8bbe00640 1 --2- 172.21.15.99:0/3660923000 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fb89c09edf0 0x7fb89c0a12b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac000f60 tx=0x7fb8ac007e40 comp rx=0 tx=0).stop 2024-02-21T23:01:36.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.921+0000 7fb8bbe00640 1 -- 172.21.15.99:0/3660923000 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb8bc182a80 msgr2=0x7fb8bc17c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:36.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.921+0000 7fb8bbe00640 1 --2- 172.21.15.99:0/3660923000 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb8bc182a80 0x7fb8bc17c390 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb8a800e900 tx=0x7fb8a800edc0 comp rx=0 tx=0).stop 2024-02-21T23:01:36.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.921+0000 7fb8bbe00640 1 -- 172.21.15.99:0/3660923000 shutdown_connections 2024-02-21T23:01:36.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.921+0000 7fb8bbe00640 1 --2- 172.21.15.99:0/3660923000 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fb89c09edf0 0x7fb89c0a12b0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:36.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.921+0000 7fb8bbe00640 1 --2- 172.21.15.99:0/3660923000 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb8bc18a010 0x7fb8bc17d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:36.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.921+0000 7fb8bbe00640 1 --2- 172.21.15.99:0/3660923000 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb8bc182a80 0x7fb8bc17c390 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:36.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.921+0000 7fb8bbe00640 1 --2- 172.21.15.99:0/3660923000 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8bc0719b0 0x7fb8bc21f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:36.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.921+0000 7fb8bbe00640 1 -- 172.21.15.99:0/3660923000 >> 172.21.15.99:0/3660923000 conn(0x7fb8bc0d29f0 msgr2=0x7fb8bc1801c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:36.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.921+0000 7fb8bbe00640 1 -- 172.21.15.99:0/3660923000 shutdown_connections 2024-02-21T23:01:36.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:36.921+0000 7fb8bbe00640 1 -- 172.21.15.99:0/3660923000 wait complete. 2024-02-21T23:01:36.935 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-02-21T23:01:36.935 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-21T23:01:37.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.141+0000 7f97bf200640 1 Processor -- start 2024-02-21T23:01:37.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.141+0000 7f97bf200640 1 -- start start 2024-02-21T23:01:37.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.144+0000 7f97bf200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f97b8182a80 0x7f97b818a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:37.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.144+0000 7f97bf200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f97b80719b0 0x7f97b8071e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:37.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.144+0000 7f97bf200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97b818a600 con 0x7f97b818b980 2024-02-21T23:01:37.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.144+0000 7f97bf200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97b818a8e0 con 0x7f97b80719b0 2024-02-21T23:01:37.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.144+0000 7f97bf200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97b818abc0 con 0x7f97b8182a80 2024-02-21T23:01:37.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.144+0000 7f97bde00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f97b8182a80 0x7f97b818a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:37.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.144+0000 7f97be800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f97b80719b0 0x7f97b8071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:37.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.144+0000 7f97bde00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f97b8182a80 0x7f97b818a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:40428/0 (socket says 172.21.15.99:40428) 2024-02-21T23:01:37.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.144+0000 7f97bd400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f97b818b980 0x7f97b8186a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:52542/0 (socket says 172.21.15.99:52542) 2024-02-21T23:01:37.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.144+0000 7f97bde00640 1 -- 172.21.15.99:0/2676249850 learned_addr learned my addr 172.21.15.99:0/2676249850 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:37.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.144+0000 7f97be800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f97b80719b0 0x7f97b8071e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59352/0 (socket says 172.21.15.99:59352) 2024-02-21T23:01:37.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.145+0000 7f97bde00640 1 -- 172.21.15.99:0/2676249850 >> v2:172.21.15.99:3300/0 conn(0x7f97b80719b0 msgr2=0x7f97b8071e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:37.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.145+0000 7f97bde00640 1 --2- 172.21.15.99:0/2676249850 >> v2:172.21.15.99:3300/0 conn(0x7f97b80719b0 0x7f97b8071e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:37.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.145+0000 7f97bde00640 1 -- 172.21.15.99:0/2676249850 >> v1:172.21.15.99:6789/0 conn(0x7f97b818b980 legacy=0x7f97b8186a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:37.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.145+0000 7f97bde00640 1 -- 172.21.15.99:0/2676249850 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97b818aea0 con 0x7f97b8182a80 2024-02-21T23:01:37.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.145+0000 7f97be800640 1 --2- 172.21.15.99:0/2676249850 >> v2:172.21.15.99:3300/0 conn(0x7f97b80719b0 0x7f97b8071e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:01:37.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.145+0000 7f97bca00640 1 -- 172.21.15.99:0/2676249850 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 151572228 0 0) 0x7f97b818a600 con 0x7f97b818b980 2024-02-21T23:01:37.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.146+0000 7f97bde00640 1 --2- 172.21.15.99:0/2676249850 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97b8182a80 0x7f97b818a010 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f97b80926e0 tx=0x7f97ac02b880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1994099c25b638a1 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:37.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.146+0000 7f97bca00640 1 -- 172.21.15.99:0/2676249850 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97ac02e070 con 0x7f97b8182a80 2024-02-21T23:01:37.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.147+0000 7f97bca00640 1 -- 172.21.15.99:0/2676249850 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97ac037070 con 0x7f97b8182a80 2024-02-21T23:01:37.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.147+0000 7f97bca00640 1 -- 172.21.15.99:0/2676249850 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97ac031a00 con 0x7f97b8182a80 2024-02-21T23:01:37.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.147+0000 7f97bf200640 1 -- 172.21.15.99:0/2676249850 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97b8182a80 msgr2=0x7f97b818a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:37.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.147+0000 7f97bf200640 1 --2- 172.21.15.99:0/2676249850 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97b8182a80 0x7f97b818a010 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f97b80926e0 tx=0x7f97ac02b880 comp rx=0 tx=0).stop 2024-02-21T23:01:37.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.147+0000 7f97bf200640 1 -- 172.21.15.99:0/2676249850 shutdown_connections 2024-02-21T23:01:37.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.147+0000 7f97bf200640 1 --2- 172.21.15.99:0/2676249850 >> v2:172.21.15.99:3300/0 conn(0x7f97b80719b0 0x7f97b8071e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:37.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.147+0000 7f97bf200640 1 --2- 172.21.15.99:0/2676249850 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97b8182a80 0x7f97b818a010 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:37.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.147+0000 7f97bf200640 1 -- 172.21.15.99:0/2676249850 >> 172.21.15.99:0/2676249850 conn(0x7f97b80d29f0 msgr2=0x7f97b80d2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:37.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.147+0000 7f97bf200640 1 -- 172.21.15.99:0/2676249850 shutdown_connections 2024-02-21T23:01:37.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.147+0000 7f97bf200640 1 -- 172.21.15.99:0/2676249850 wait complete. 2024-02-21T23:01:37.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.151+0000 7f97bf200640 1 Processor -- start 2024-02-21T23:01:37.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.151+0000 7f97bf200640 1 -- start start 2024-02-21T23:01:37.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.153+0000 7f97bf200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97b80719b0 0x7f97b8178c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:37.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.153+0000 7f97bf200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f97b8182a80 0x7f97b80fe740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:37.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.153+0000 7f97bf200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f97b818b980 0x7f97b80fec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:37.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.153+0000 7f97bf200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97b818be00 con 0x7f97b818b980 2024-02-21T23:01:37.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.153+0000 7f97bf200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97b818b460 con 0x7f97b80719b0 2024-02-21T23:01:37.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.153+0000 7f97bf200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97b8182e60 con 0x7f97b8182a80 2024-02-21T23:01:37.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.153+0000 7f97be800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f97b818b980 0x7f97b80fec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:37.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.153+0000 7f97be800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f97b818b980 0x7f97b80fec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59354/0 (socket says 172.21.15.99:59354) 2024-02-21T23:01:37.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.153+0000 7f97be800640 1 -- 172.21.15.99:0/249957396 learned_addr learned my addr 172.21.15.99:0/249957396 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:37.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.153+0000 7f97bde00640 1 --2- 172.21.15.99:0/249957396 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97b80719b0 0x7f97b8178c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:37.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.153+0000 7f97bd400640 1 --2- 172.21.15.99:0/249957396 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f97b8182a80 0x7f97b80fe740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:37.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.154+0000 7f97be800640 1 -- 172.21.15.99:0/249957396 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f97b8182a80 msgr2=0x7f97b80fe740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:37.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.154+0000 7f97be800640 1 --2- 172.21.15.99:0/249957396 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f97b8182a80 0x7f97b80fe740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:37.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.154+0000 7f97be800640 1 -- 172.21.15.99:0/249957396 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97b80719b0 msgr2=0x7f97b8178c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:37.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.154+0000 7f97be800640 1 --2- 172.21.15.99:0/249957396 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97b80719b0 0x7f97b8178c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:37.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.154+0000 7f97be800640 1 -- 172.21.15.99:0/249957396 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97b80f2410 con 0x7f97b818b980 2024-02-21T23:01:37.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.154+0000 7f97bde00640 1 --2- 172.21.15.99:0/249957396 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97b80719b0 0x7f97b8178c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:01:37.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.154+0000 7f97be800640 1 --2- 172.21.15.99:0/249957396 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f97b818b980 0x7f97b80fec80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f97b400efc0 tx=0x7f97b400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:37.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.154+0000 7f97b2000640 1 -- 172.21.15.99:0/249957396 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b4018030 con 0x7f97b818b980 2024-02-21T23:01:37.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.154+0000 7f97b2000640 1 -- 172.21.15.99:0/249957396 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97b400cdf0 con 0x7f97b818b980 2024-02-21T23:01:37.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.154+0000 7f97bf200640 1 -- 172.21.15.99:0/249957396 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97b8180e60 con 0x7f97b818b980 2024-02-21T23:01:37.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.154+0000 7f97b2000640 1 -- 172.21.15.99:0/249957396 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b4003bb0 con 0x7f97b818b980 2024-02-21T23:01:37.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.154+0000 7f97bf200640 1 -- 172.21.15.99:0/249957396 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97b80fdc60 con 0x7f97b818b980 2024-02-21T23:01:37.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.155+0000 7f97bf200640 1 -- 172.21.15.99:0/249957396 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97b8068320 con 0x7f97b818b980 2024-02-21T23:01:37.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.157+0000 7f97b2000640 1 -- 172.21.15.99:0/249957396 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 6) v1 ==== 134407+0+0 (secure 0 0 0) 0x7f97b4005d10 con 0x7f97b818b980 2024-02-21T23:01:37.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.159+0000 7f97b2000640 1 --2- 172.21.15.99:0/249957396 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f979c09edf0 0x7f979c0a12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:37.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.160+0000 7f97b2000640 1 -- 172.21.15.99:0/249957396 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f97b40ca680 con 0x7f97b818b980 2024-02-21T23:01:37.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.160+0000 7f97bde00640 1 --2- 172.21.15.99:0/249957396 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f979c09edf0 0x7f979c0a12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:37.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.161+0000 7f97bde00640 1 --2- 172.21.15.99:0/249957396 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f979c09edf0 0x7f979c0a12b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f97ac036000 tx=0x7f97ac03d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:37.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.162+0000 7f97b2000640 1 -- 172.21.15.99:0/249957396 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f97b4022070 con 0x7f97b818b980 2024-02-21T23:01:37.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.482+0000 7f97bf200640 1 -- 172.21.15.99:0/249957396 --> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f97b80d2060 con 0x7f979c09edf0 2024-02-21T23:01:37.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.492+0000 7f97b2000640 1 -- 172.21.15.99:0/249957396 <== mgr.4106 v2:172.21.15.162:6800/1717094936 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+338811 (secure 0 0 0) 0x7f97b80d2060 con 0x7f979c09edf0 2024-02-21T23:01:37.487 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T23:01:37.489 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-02-21T23:01:37.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.501+0000 7f97bf200640 1 -- 172.21.15.99:0/249957396 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f979c09edf0 msgr2=0x7f979c0a12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:37.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.501+0000 7f97bf200640 1 --2- 172.21.15.99:0/249957396 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f979c09edf0 0x7f979c0a12b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f97ac036000 tx=0x7f97ac03d040 comp rx=0 tx=0).stop 2024-02-21T23:01:37.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.501+0000 7f97bf200640 1 -- 172.21.15.99:0/249957396 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f97b818b980 msgr2=0x7f97b80fec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:37.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.501+0000 7f97bf200640 1 --2- 172.21.15.99:0/249957396 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f97b818b980 0x7f97b80fec80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f97b400efc0 tx=0x7f97b400c490 comp rx=0 tx=0).stop 2024-02-21T23:01:37.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.501+0000 7f97bf200640 1 -- 172.21.15.99:0/249957396 shutdown_connections 2024-02-21T23:01:37.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.501+0000 7f97bf200640 1 --2- 172.21.15.99:0/249957396 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f979c09edf0 0x7f979c0a12b0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:37.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.501+0000 7f97bf200640 1 --2- 172.21.15.99:0/249957396 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f97b818b980 0x7f97b80fec80 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:37.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.501+0000 7f97bf200640 1 --2- 172.21.15.99:0/249957396 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f97b8182a80 0x7f97b80fe740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:37.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.501+0000 7f97bf200640 1 --2- 172.21.15.99:0/249957396 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97b80719b0 0x7f97b8178c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:37.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.501+0000 7f97bf200640 1 -- 172.21.15.99:0/249957396 >> 172.21.15.99:0/249957396 conn(0x7f97b80d29f0 msgr2=0x7f97b8189af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:37.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.501+0000 7f97bf200640 1 -- 172.21.15.99:0/249957396 shutdown_connections 2024-02-21T23:01:37.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.501+0000 7f97bf200640 1 -- 172.21.15.99:0/249957396 wait complete. 2024-02-21T23:01:37.513 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2024-02-21T23:01:36.951014+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":636517,"num_objects":64,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":176,"num_read_kb":171,"num_write":328,"num_write_kb":3028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":266,"ondisk_log_size":266,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1132462080,"kb_used":328128,"kb_used_data":3936,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1132133952,"statfs":{"total":1159641169920,"available":1159305166848,"internally_reserved":0,"allocated":4030464,"data_stored":2991170,"data_compressed":171314,"data_compressed_allocated":245760,"data_compressed_original":1458176,"omap_allocated":19138,"internal_metadata":331855166},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":41650,"num_objects":40,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":40,"num_read_kb":52,"num_write":100,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003233"},"pg_stats":[{"pgid":"2.1f","version":"29'9","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:32.400697+0000","last_change":"2024-02-21T23:01:02.208441+0000","last_active":"2024-02-21T23:01:32.400697+0000","last_peered":"2024-02-21T23:01:32.400697+0000","last_clean":"2024-02-21T23:01:32.400697+0000","last_became_active":"2024-02-21T23:01:02.208124+0000","last_became_peered":"2024-02-21T23:01:02.208124+0000","last_unstale":"2024-02-21T23:01:32.400697+0000","last_undegraded":"2024-02-21T23:01:32.400697+0000","last_fullsized":"2024-02-21T23:01:32.400697+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:21:29.919968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7],"acting":[9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788787+0000","last_change":"2024-02-21T23:01:03.215149+0000","last_active":"2024-02-21T23:01:08.788787+0000","last_peered":"2024-02-21T23:01:08.788787+0000","last_clean":"2024-02-21T23:01:08.788787+0000","last_became_active":"2024-02-21T23:01:03.214170+0000","last_became_peered":"2024-02-21T23:01:03.214170+0000","last_unstale":"2024-02-21T23:01:08.788787+0000","last_undegraded":"2024-02-21T23:01:08.788787+0000","last_fullsized":"2024-02-21T23:01:08.788787+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:40:26.325368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787271+0000","last_change":"2024-02-21T23:01:07.276484+0000","last_active":"2024-02-21T23:01:08.787271+0000","last_peered":"2024-02-21T23:01:08.787271+0000","last_clean":"2024-02-21T23:01:08.787271+0000","last_became_active":"2024-02-21T23:01:07.276192+0000","last_became_peered":"2024-02-21T23:01:07.276192+0000","last_unstale":"2024-02-21T23:01:08.787271+0000","last_undegraded":"2024-02-21T23:01:08.787271+0000","last_fullsized":"2024-02-21T23:01:08.787271+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:20:59.894677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"29'2","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.789060+0000","last_change":"2024-02-21T23:01:02.221231+0000","last_active":"2024-02-21T23:01:08.789060+0000","last_peered":"2024-02-21T23:01:08.789060+0000","last_clean":"2024-02-21T23:01:08.789060+0000","last_became_active":"2024-02-21T23:01:02.220941+0000","last_became_peered":"2024-02-21T23:01:02.220941+0000","last_unstale":"2024-02-21T23:01:08.789060+0000","last_undegraded":"2024-02-21T23:01:08.789060+0000","last_fullsized":"2024-02-21T23:01:08.789060+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:17:06.353018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.790823+0000","last_change":"2024-02-21T23:01:03.219579+0000","last_active":"2024-02-21T23:01:08.790823+0000","last_peered":"2024-02-21T23:01:08.790823+0000","last_clean":"2024-02-21T23:01:08.790823+0000","last_became_active":"2024-02-21T23:01:03.219221+0000","last_became_peered":"2024-02-21T23:01:03.219221+0000","last_unstale":"2024-02-21T23:01:08.790823+0000","last_undegraded":"2024-02-21T23:01:08.790823+0000","last_fullsized":"2024-02-21T23:01:08.790823+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:41:55.485351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.260372+0000","last_change":"2024-02-21T23:01:07.268590+0000","last_active":"2024-02-21T23:01:08.260372+0000","last_peered":"2024-02-21T23:01:08.260372+0000","last_clean":"2024-02-21T23:01:08.260372+0000","last_became_active":"2024-02-21T23:01:07.268179+0000","last_became_peered":"2024-02-21T23:01:07.268179+0000","last_unstale":"2024-02-21T23:01:08.260372+0000","last_undegraded":"2024-02-21T23:01:08.260372+0000","last_fullsized":"2024-02-21T23:01:08.260372+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:20:59.894677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"29'4","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:32.393628+0000","last_change":"2024-02-21T23:01:02.208687+0000","last_active":"2024-02-21T23:01:32.393628+0000","last_peered":"2024-02-21T23:01:32.393628+0000","last_clean":"2024-02-21T23:01:32.393628+0000","last_became_active":"2024-02-21T23:01:02.208393+0000","last_became_peered":"2024-02-21T23:01:02.208393+0000","last_unstale":"2024-02-21T23:01:32.393628+0000","last_undegraded":"2024-02-21T23:01:32.393628+0000","last_fullsized":"2024-02-21T23:01:32.393628+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:41:54.477462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788050+0000","last_change":"2024-02-21T23:01:03.215676+0000","last_active":"2024-02-21T23:01:08.788050+0000","last_peered":"2024-02-21T23:01:08.788050+0000","last_clean":"2024-02-21T23:01:08.788050+0000","last_became_active":"2024-02-21T23:01:03.214733+0000","last_became_peered":"2024-02-21T23:01:03.214733+0000","last_unstale":"2024-02-21T23:01:08.788050+0000","last_undegraded":"2024-02-21T23:01:08.788050+0000","last_fullsized":"2024-02-21T23:01:08.788050+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:16.946152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.260361+0000","last_change":"2024-02-21T23:01:07.279763+0000","last_active":"2024-02-21T23:01:08.260361+0000","last_peered":"2024-02-21T23:01:08.260361+0000","last_clean":"2024-02-21T23:01:08.260361+0000","last_became_active":"2024-02-21T23:01:07.279360+0000","last_became_peered":"2024-02-21T23:01:07.279360+0000","last_unstale":"2024-02-21T23:01:08.260361+0000","last_undegraded":"2024-02-21T23:01:08.260361+0000","last_fullsized":"2024-02-21T23:01:08.260361+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:40:30.373445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.261319+0000","last_change":"2024-02-21T23:01:02.204774+0000","last_active":"2024-02-21T23:01:08.261319+0000","last_peered":"2024-02-21T23:01:08.261319+0000","last_clean":"2024-02-21T23:01:08.261319+0000","last_became_active":"2024-02-21T23:01:02.203992+0000","last_became_peered":"2024-02-21T23:01:02.203992+0000","last_unstale":"2024-02-21T23:01:08.261319+0000","last_undegraded":"2024-02-21T23:01:08.261319+0000","last_fullsized":"2024-02-21T23:01:08.261319+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:27:54.333439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1],"acting":[8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788339+0000","last_change":"2024-02-21T23:01:03.213022+0000","last_active":"2024-02-21T23:01:08.788339+0000","last_peered":"2024-02-21T23:01:08.788339+0000","last_clean":"2024-02-21T23:01:08.788339+0000","last_became_active":"2024-02-21T23:01:03.212702+0000","last_became_peered":"2024-02-21T23:01:03.212702+0000","last_unstale":"2024-02-21T23:01:08.788339+0000","last_undegraded":"2024-02-21T23:01:08.788339+0000","last_fullsized":"2024-02-21T23:01:08.788339+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:19:01.584139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.260441+0000","last_change":"2024-02-21T23:01:07.268800+0000","last_active":"2024-02-21T23:01:08.260441+0000","last_peered":"2024-02-21T23:01:08.260441+0000","last_clean":"2024-02-21T23:01:08.260441+0000","last_became_active":"2024-02-21T23:01:07.268357+0000","last_became_peered":"2024-02-21T23:01:07.268357+0000","last_unstale":"2024-02-21T23:01:08.260441+0000","last_undegraded":"2024-02-21T23:01:08.260441+0000","last_fullsized":"2024-02-21T23:01:08.260441+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:39:03.021559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787642+0000","last_change":"2024-02-21T23:01:03.213517+0000","last_active":"2024-02-21T23:01:08.787642+0000","last_peered":"2024-02-21T23:01:08.787642+0000","last_clean":"2024-02-21T23:01:08.787642+0000","last_became_active":"2024-02-21T23:01:03.213186+0000","last_became_peered":"2024-02-21T23:01:03.213186+0000","last_unstale":"2024-02-21T23:01:08.787642+0000","last_undegraded":"2024-02-21T23:01:08.787642+0000","last_fullsized":"2024-02-21T23:01:08.787642+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:40:26.325368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"29'4","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:31.383302+0000","last_change":"2024-02-21T23:01:02.208608+0000","last_active":"2024-02-21T23:01:31.383302+0000","last_peered":"2024-02-21T23:01:31.383302+0000","last_clean":"2024-02-21T23:01:31.383302+0000","last_became_active":"2024-02-21T23:01:02.208293+0000","last_became_peered":"2024-02-21T23:01:02.208293+0000","last_unstale":"2024-02-21T23:01:31.383302+0000","last_undegraded":"2024-02-21T23:01:31.383302+0000","last_fullsized":"2024-02-21T23:01:31.383302+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:58:23.554457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.260663+0000","last_change":"2024-02-21T23:01:07.651717+0000","last_active":"2024-02-21T23:01:08.260663+0000","last_peered":"2024-02-21T23:01:08.260663+0000","last_clean":"2024-02-21T23:01:08.260663+0000","last_became_active":"2024-02-21T23:01:07.651241+0000","last_became_peered":"2024-02-21T23:01:07.651241+0000","last_unstale":"2024-02-21T23:01:08.260663+0000","last_undegraded":"2024-02-21T23:01:08.260663+0000","last_fullsized":"2024-02-21T23:01:08.260663+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:54:44.380302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.791024+0000","last_change":"2024-02-21T23:01:03.221678+0000","last_active":"2024-02-21T23:01:08.791024+0000","last_peered":"2024-02-21T23:01:08.791024+0000","last_clean":"2024-02-21T23:01:08.791024+0000","last_became_active":"2024-02-21T23:01:03.219898+0000","last_became_peered":"2024-02-21T23:01:03.219898+0000","last_unstale":"2024-02-21T23:01:08.791024+0000","last_undegraded":"2024-02-21T23:01:08.791024+0000","last_fullsized":"2024-02-21T23:01:08.791024+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:47:19.366266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"29'1","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788675+0000","last_change":"2024-02-21T23:01:02.202866+0000","last_active":"2024-02-21T23:01:08.788675+0000","last_peered":"2024-02-21T23:01:08.788675+0000","last_clean":"2024-02-21T23:01:08.788675+0000","last_became_active":"2024-02-21T23:01:02.202585+0000","last_became_peered":"2024-02-21T23:01:02.202585+0000","last_unstale":"2024-02-21T23:01:08.788675+0000","last_undegraded":"2024-02-21T23:01:08.788675+0000","last_fullsized":"2024-02-21T23:01:08.788675+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:26:49.911102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"29'1","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:10.770295+0000","last_change":"2024-02-21T23:01:07.277000+0000","last_active":"2024-02-21T23:01:10.770295+0000","last_peered":"2024-02-21T23:01:10.770295+0000","last_clean":"2024-02-21T23:01:10.770295+0000","last_became_active":"2024-02-21T23:01:07.276577+0000","last_became_peered":"2024-02-21T23:01:07.276577+0000","last_unstale":"2024-02-21T23:01:10.770295+0000","last_undegraded":"2024-02-21T23:01:10.770295+0000","last_fullsized":"2024-02-21T23:01:10.770295+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:15:20.572234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787437+0000","last_change":"2024-02-21T23:01:03.219045+0000","last_active":"2024-02-21T23:01:08.787437+0000","last_peered":"2024-02-21T23:01:08.787437+0000","last_clean":"2024-02-21T23:01:08.787437+0000","last_became_active":"2024-02-21T23:01:03.218706+0000","last_became_peered":"2024-02-21T23:01:03.218706+0000","last_unstale":"2024-02-21T23:01:08.787437+0000","last_undegraded":"2024-02-21T23:01:08.787437+0000","last_fullsized":"2024-02-21T23:01:08.787437+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:41:55.485351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"29'3","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:31.386013+0000","last_change":"2024-02-21T23:01:02.208912+0000","last_active":"2024-02-21T23:01:31.386013+0000","last_peered":"2024-02-21T23:01:31.386013+0000","last_clean":"2024-02-21T23:01:31.386013+0000","last_became_active":"2024-02-21T23:01:02.208542+0000","last_became_peered":"2024-02-21T23:01:02.208542+0000","last_unstale":"2024-02-21T23:01:31.386013+0000","last_undegraded":"2024-02-21T23:01:31.386013+0000","last_fullsized":"2024-02-21T23:01:31.386013+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:02:11.724233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9],"acting":[3,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788774+0000","last_change":"2024-02-21T23:01:07.282882+0000","last_active":"2024-02-21T23:01:08.788774+0000","last_peered":"2024-02-21T23:01:08.788774+0000","last_clean":"2024-02-21T23:01:08.788774+0000","last_became_active":"2024-02-21T23:01:07.282506+0000","last_became_peered":"2024-02-21T23:01:07.282506+0000","last_unstale":"2024-02-21T23:01:08.788774+0000","last_undegraded":"2024-02-21T23:01:08.788774+0000","last_fullsized":"2024-02-21T23:01:08.788774+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:19:05.632217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.260935+0000","last_change":"2024-02-21T23:01:03.212206+0000","last_active":"2024-02-21T23:01:08.260935+0000","last_peered":"2024-02-21T23:01:08.260935+0000","last_clean":"2024-02-21T23:01:08.260935+0000","last_became_active":"2024-02-21T23:01:03.211919+0000","last_became_peered":"2024-02-21T23:01:03.211919+0000","last_unstale":"2024-02-21T23:01:08.260935+0000","last_undegraded":"2024-02-21T23:01:08.260935+0000","last_fullsized":"2024-02-21T23:01:08.260935+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:20:55.846599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"29'2","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:31.383055+0000","last_change":"2024-02-21T23:01:02.204071+0000","last_active":"2024-02-21T23:01:31.383055+0000","last_peered":"2024-02-21T23:01:31.383055+0000","last_clean":"2024-02-21T23:01:31.383055+0000","last_became_active":"2024-02-21T23:01:02.203761+0000","last_became_peered":"2024-02-21T23:01:02.203761+0000","last_unstale":"2024-02-21T23:01:31.383055+0000","last_undegraded":"2024-02-21T23:01:31.383055+0000","last_fullsized":"2024-02-21T23:01:31.383055+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:58:34.737670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.260696+0000","last_change":"2024-02-21T23:01:07.654580+0000","last_active":"2024-02-21T23:01:08.260696+0000","last_peered":"2024-02-21T23:01:08.260696+0000","last_clean":"2024-02-21T23:01:08.260696+0000","last_became_active":"2024-02-21T23:01:07.654124+0000","last_became_peered":"2024-02-21T23:01:07.654124+0000","last_unstale":"2024-02-21T23:01:08.260696+0000","last_undegraded":"2024-02-21T23:01:08.260696+0000","last_fullsized":"2024-02-21T23:01:08.260696+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:44:43.960074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.790389+0000","last_change":"2024-02-21T23:01:03.230134+0000","last_active":"2024-02-21T23:01:08.790389+0000","last_peered":"2024-02-21T23:01:08.790389+0000","last_clean":"2024-02-21T23:01:08.790389+0000","last_became_active":"2024-02-21T23:01:03.229873+0000","last_became_peered":"2024-02-21T23:01:03.229873+0000","last_unstale":"2024-02-21T23:01:08.790389+0000","last_undegraded":"2024-02-21T23:01:08.790389+0000","last_fullsized":"2024-02-21T23:01:08.790389+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:16.946152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"29'4","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:31.382861+0000","last_change":"2024-02-21T23:01:02.206586+0000","last_active":"2024-02-21T23:01:31.382861+0000","last_peered":"2024-02-21T23:01:31.382861+0000","last_clean":"2024-02-21T23:01:31.382861+0000","last_became_active":"2024-02-21T23:01:02.206230+0000","last_became_peered":"2024-02-21T23:01:02.206230+0000","last_unstale":"2024-02-21T23:01:31.382861+0000","last_undegraded":"2024-02-21T23:01:31.382861+0000","last_fullsized":"2024-02-21T23:01:31.382861+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:21:29.919968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11],"acting":[4,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788500+0000","last_change":"2024-02-21T23:01:07.252255+0000","last_active":"2024-02-21T23:01:08.788500+0000","last_peered":"2024-02-21T23:01:08.788500+0000","last_clean":"2024-02-21T23:01:08.788500+0000","last_became_active":"2024-02-21T23:01:07.251670+0000","last_became_peered":"2024-02-21T23:01:07.251670+0000","last_unstale":"2024-02-21T23:01:08.788500+0000","last_undegraded":"2024-02-21T23:01:08.788500+0000","last_fullsized":"2024-02-21T23:01:08.788500+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:39:03.021559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.789113+0000","last_change":"2024-02-21T23:01:03.207156+0000","last_active":"2024-02-21T23:01:08.789113+0000","last_peered":"2024-02-21T23:01:08.789113+0000","last_clean":"2024-02-21T23:01:08.789113+0000","last_became_active":"2024-02-21T23:01:03.206892+0000","last_became_peered":"2024-02-21T23:01:03.206892+0000","last_unstale":"2024-02-21T23:01:08.789113+0000","last_undegraded":"2024-02-21T23:01:08.789113+0000","last_fullsized":"2024-02-21T23:01:08.789113+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:19:01.584139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"29'5","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:34.216217+0000","last_change":"2024-02-21T23:01:02.209850+0000","last_active":"2024-02-21T23:01:34.216217+0000","last_peered":"2024-02-21T23:01:34.216217+0000","last_clean":"2024-02-21T23:01:34.216217+0000","last_became_active":"2024-02-21T23:01:02.209601+0000","last_became_peered":"2024-02-21T23:01:02.209601+0000","last_unstale":"2024-02-21T23:01:34.216217+0000","last_undegraded":"2024-02-21T23:01:34.216217+0000","last_fullsized":"2024-02-21T23:01:34.216217+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:36:44.497886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.789246+0000","last_change":"2024-02-21T23:01:07.651884+0000","last_active":"2024-02-21T23:01:08.789246+0000","last_peered":"2024-02-21T23:01:08.789246+0000","last_clean":"2024-02-21T23:01:08.789246+0000","last_became_active":"2024-02-21T23:01:07.651431+0000","last_became_peered":"2024-02-21T23:01:07.651431+0000","last_unstale":"2024-02-21T23:01:08.789246+0000","last_undegraded":"2024-02-21T23:01:08.789246+0000","last_fullsized":"2024-02-21T23:01:08.789246+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:37:06.063756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.263969+0000","last_change":"2024-02-21T23:01:03.221696+0000","last_active":"2024-02-21T23:01:08.263969+0000","last_peered":"2024-02-21T23:01:08.263969+0000","last_clean":"2024-02-21T23:01:08.263969+0000","last_became_active":"2024-02-21T23:01:03.221405+0000","last_became_peered":"2024-02-21T23:01:03.221405+0000","last_unstale":"2024-02-21T23:01:08.263969+0000","last_undegraded":"2024-02-21T23:01:08.263969+0000","last_fullsized":"2024-02-21T23:01:08.263969+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:45:29.610700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"29'1","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:31.383443+0000","last_change":"2024-02-21T23:01:02.221218+0000","last_active":"2024-02-21T23:01:31.383443+0000","last_peered":"2024-02-21T23:01:31.383443+0000","last_clean":"2024-02-21T23:01:31.383443+0000","last_became_active":"2024-02-21T23:01:02.220923+0000","last_became_peered":"2024-02-21T23:01:02.220923+0000","last_unstale":"2024-02-21T23:01:31.383443+0000","last_undegraded":"2024-02-21T23:01:31.383443+0000","last_fullsized":"2024-02-21T23:01:31.383443+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:15.938263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787672+0000","last_change":"2024-02-21T23:01:07.268952+0000","last_active":"2024-02-21T23:01:08.787672+0000","last_peered":"2024-02-21T23:01:08.787672+0000","last_clean":"2024-02-21T23:01:08.787672+0000","last_became_active":"2024-02-21T23:01:07.268210+0000","last_became_peered":"2024-02-21T23:01:07.268210+0000","last_unstale":"2024-02-21T23:01:08.787672+0000","last_undegraded":"2024-02-21T23:01:08.787672+0000","last_fullsized":"2024-02-21T23:01:08.787672+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:40:30.373445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.790112+0000","last_change":"2024-02-21T23:01:03.218386+0000","last_active":"2024-02-21T23:01:08.790112+0000","last_peered":"2024-02-21T23:01:08.790112+0000","last_clean":"2024-02-21T23:01:08.790112+0000","last_became_active":"2024-02-21T23:01:03.218081+0000","last_became_peered":"2024-02-21T23:01:03.218081+0000","last_unstale":"2024-02-21T23:01:08.790112+0000","last_undegraded":"2024-02-21T23:01:08.790112+0000","last_fullsized":"2024-02-21T23:01:08.790112+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:35:24.590398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788427+0000","last_change":"2024-02-21T23:01:02.207826+0000","last_active":"2024-02-21T23:01:08.788427+0000","last_peered":"2024-02-21T23:01:08.788427+0000","last_clean":"2024-02-21T23:01:08.788427+0000","last_became_active":"2024-02-21T23:01:02.206426+0000","last_became_peered":"2024-02-21T23:01:02.206426+0000","last_unstale":"2024-02-21T23:01:08.788427+0000","last_undegraded":"2024-02-21T23:01:08.788427+0000","last_fullsized":"2024-02-21T23:01:08.788427+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:17:06.353018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2],"acting":[9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.261110+0000","last_change":"2024-02-21T23:01:07.651876+0000","last_active":"2024-02-21T23:01:08.261110+0000","last_peered":"2024-02-21T23:01:08.261110+0000","last_clean":"2024-02-21T23:01:08.261110+0000","last_became_active":"2024-02-21T23:01:07.651384+0000","last_became_peered":"2024-02-21T23:01:07.651384+0000","last_unstale":"2024-02-21T23:01:08.261110+0000","last_undegraded":"2024-02-21T23:01:08.261110+0000","last_fullsized":"2024-02-21T23:01:08.261110+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:15:20.572234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.789861+0000","last_change":"2024-02-21T23:01:03.210500+0000","last_active":"2024-02-21T23:01:08.789861+0000","last_peered":"2024-02-21T23:01:08.789861+0000","last_clean":"2024-02-21T23:01:08.789861+0000","last_became_active":"2024-02-21T23:01:03.210123+0000","last_became_peered":"2024-02-21T23:01:03.210123+0000","last_unstale":"2024-02-21T23:01:08.789861+0000","last_undegraded":"2024-02-21T23:01:08.789861+0000","last_fullsized":"2024-02-21T23:01:08.789861+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:16.946152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4],"acting":[10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"29'1","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787791+0000","last_change":"2024-02-21T23:01:02.217455+0000","last_active":"2024-02-21T23:01:08.787791+0000","last_peered":"2024-02-21T23:01:08.787791+0000","last_clean":"2024-02-21T23:01:08.787791+0000","last_became_active":"2024-02-21T23:01:02.217128+0000","last_became_peered":"2024-02-21T23:01:02.217128+0000","last_unstale":"2024-02-21T23:01:08.787791+0000","last_undegraded":"2024-02-21T23:01:08.787791+0000","last_fullsized":"2024-02-21T23:01:08.787791+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:23:41.295647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.264021+0000","last_change":"2024-02-21T23:01:07.266837+0000","last_active":"2024-02-21T23:01:08.264021+0000","last_peered":"2024-02-21T23:01:08.264021+0000","last_clean":"2024-02-21T23:01:08.264021+0000","last_became_active":"2024-02-21T23:01:07.266376+0000","last_became_peered":"2024-02-21T23:01:07.266376+0000","last_unstale":"2024-02-21T23:01:08.264021+0000","last_undegraded":"2024-02-21T23:01:08.264021+0000","last_fullsized":"2024-02-21T23:01:08.264021+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:15:20.572234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787245+0000","last_change":"2024-02-21T23:01:03.212345+0000","last_active":"2024-02-21T23:01:08.787245+0000","last_peered":"2024-02-21T23:01:08.787245+0000","last_clean":"2024-02-21T23:01:08.787245+0000","last_became_active":"2024-02-21T23:01:03.212019+0000","last_became_peered":"2024-02-21T23:01:03.212019+0000","last_unstale":"2024-02-21T23:01:08.787245+0000","last_undegraded":"2024-02-21T23:01:08.787245+0000","last_fullsized":"2024-02-21T23:01:08.787245+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:20:55.846599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"29'4","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:34.401788+0000","last_change":"2024-02-21T23:01:02.219033+0000","last_active":"2024-02-21T23:01:34.401788+0000","last_peered":"2024-02-21T23:01:34.401788+0000","last_clean":"2024-02-21T23:01:34.401788+0000","last_became_active":"2024-02-21T23:01:02.218570+0000","last_became_peered":"2024-02-21T23:01:02.218570+0000","last_unstale":"2024-02-21T23:01:34.401788+0000","last_undegraded":"2024-02-21T23:01:34.401788+0000","last_fullsized":"2024-02-21T23:01:34.401788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:21:29.919968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.264680+0000","last_change":"2024-02-21T23:01:07.654407+0000","last_active":"2024-02-21T23:01:08.264680+0000","last_peered":"2024-02-21T23:01:08.264680+0000","last_clean":"2024-02-21T23:01:08.264680+0000","last_became_active":"2024-02-21T23:01:07.653745+0000","last_became_peered":"2024-02-21T23:01:07.653745+0000","last_unstale":"2024-02-21T23:01:08.264680+0000","last_undegraded":"2024-02-21T23:01:08.264680+0000","last_fullsized":"2024-02-21T23:01:08.264680+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:54:44.380302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.262891+0000","last_change":"2024-02-21T23:01:03.226352+0000","last_active":"2024-02-21T23:01:08.262891+0000","last_peered":"2024-02-21T23:01:08.262891+0000","last_clean":"2024-02-21T23:01:08.262891+0000","last_became_active":"2024-02-21T23:01:03.219834+0000","last_became_peered":"2024-02-21T23:01:03.219834+0000","last_unstale":"2024-02-21T23:01:08.262891+0000","last_undegraded":"2024-02-21T23:01:08.262891+0000","last_fullsized":"2024-02-21T23:01:08.262891+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:16.946152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"29'3","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:32.400219+0000","last_change":"2024-02-21T23:01:02.207052+0000","last_active":"2024-02-21T23:01:32.400219+0000","last_peered":"2024-02-21T23:01:32.400219+0000","last_clean":"2024-02-21T23:01:32.400219+0000","last_became_active":"2024-02-21T23:01:02.206146+0000","last_became_peered":"2024-02-21T23:01:02.206146+0000","last_unstale":"2024-02-21T23:01:32.400219+0000","last_undegraded":"2024-02-21T23:01:32.400219+0000","last_fullsized":"2024-02-21T23:01:32.400219+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:26:49.911102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788291+0000","last_change":"2024-02-21T23:01:07.654449+0000","last_active":"2024-02-21T23:01:08.788291+0000","last_peered":"2024-02-21T23:01:08.788291+0000","last_clean":"2024-02-21T23:01:08.788291+0000","last_became_active":"2024-02-21T23:01:07.654106+0000","last_became_peered":"2024-02-21T23:01:07.654106+0000","last_unstale":"2024-02-21T23:01:08.788291+0000","last_undegraded":"2024-02-21T23:01:08.788291+0000","last_fullsized":"2024-02-21T23:01:08.788291+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:13:22.732077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788911+0000","last_change":"2024-02-21T23:01:03.209260+0000","last_active":"2024-02-21T23:01:08.788911+0000","last_peered":"2024-02-21T23:01:08.788911+0000","last_clean":"2024-02-21T23:01:08.788911+0000","last_became_active":"2024-02-21T23:01:03.209007+0000","last_became_peered":"2024-02-21T23:01:03.209007+0000","last_unstale":"2024-02-21T23:01:08.788911+0000","last_undegraded":"2024-02-21T23:01:08.788911+0000","last_fullsized":"2024-02-21T23:01:08.788911+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:54:32.196725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"29'3","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:33.394582+0000","last_change":"2024-02-21T23:01:02.203395+0000","last_active":"2024-02-21T23:01:33.394582+0000","last_peered":"2024-02-21T23:01:33.394582+0000","last_clean":"2024-02-21T23:01:33.394582+0000","last_became_active":"2024-02-21T23:01:02.203066+0000","last_became_peered":"2024-02-21T23:01:02.203066+0000","last_unstale":"2024-02-21T23:01:33.394582+0000","last_undegraded":"2024-02-21T23:01:33.394582+0000","last_fullsized":"2024-02-21T23:01:33.394582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:26:49.911102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":211,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787659+0000","last_change":"2024-02-21T23:00:58.830752+0000","last_active":"2024-02-21T23:01:08.787659+0000","last_peered":"2024-02-21T23:01:08.787659+0000","last_clean":"2024-02-21T23:01:08.787659+0000","last_became_active":"2024-02-21T23:00:58.830472+0000","last_became_peered":"2024-02-21T23:00:58.830472+0000","last_unstale":"2024-02-21T23:01:08.787659+0000","last_undegraded":"2024-02-21T23:01:08.787659+0000","last_fullsized":"2024-02-21T23:01:08.787659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:00:57.811198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:00:57.811198+0000","last_clean_scrub_stamp":"2024-02-21T23:00:57.811198+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:58:31.374266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"29'1","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:10.774025+0000","last_change":"2024-02-21T23:01:07.276992+0000","last_active":"2024-02-21T23:01:10.774025+0000","last_peered":"2024-02-21T23:01:10.774025+0000","last_clean":"2024-02-21T23:01:10.774025+0000","last_became_active":"2024-02-21T23:01:07.276489+0000","last_became_peered":"2024-02-21T23:01:07.276489+0000","last_unstale":"2024-02-21T23:01:10.774025+0000","last_undegraded":"2024-02-21T23:01:10.774025+0000","last_fullsized":"2024-02-21T23:01:10.774025+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:02:35.072200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788021+0000","last_change":"2024-02-21T23:01:03.216192+0000","last_active":"2024-02-21T23:01:08.788021+0000","last_peered":"2024-02-21T23:01:08.788021+0000","last_clean":"2024-02-21T23:01:08.788021+0000","last_became_active":"2024-02-21T23:01:03.215904+0000","last_became_peered":"2024-02-21T23:01:03.215904+0000","last_unstale":"2024-02-21T23:01:08.788021+0000","last_undegraded":"2024-02-21T23:01:08.788021+0000","last_fullsized":"2024-02-21T23:01:08.788021+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:15:16.524157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"29'3","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:32.394144+0000","last_change":"2024-02-21T23:01:02.207406+0000","last_active":"2024-02-21T23:01:32.394144+0000","last_peered":"2024-02-21T23:01:32.394144+0000","last_clean":"2024-02-21T23:01:32.394144+0000","last_became_active":"2024-02-21T23:01:02.206219+0000","last_became_peered":"2024-02-21T23:01:02.206219+0000","last_unstale":"2024-02-21T23:01:32.394144+0000","last_undegraded":"2024-02-21T23:01:32.394144+0000","last_fullsized":"2024-02-21T23:01:32.394144+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:21:29.919968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11],"acting":[2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787626+0000","last_change":"2024-02-21T23:01:07.265822+0000","last_active":"2024-02-21T23:01:08.787626+0000","last_peered":"2024-02-21T23:01:08.787626+0000","last_clean":"2024-02-21T23:01:08.787626+0000","last_became_active":"2024-02-21T23:01:07.265401+0000","last_became_peered":"2024-02-21T23:01:07.265401+0000","last_unstale":"2024-02-21T23:01:08.787626+0000","last_undegraded":"2024-02-21T23:01:08.787626+0000","last_fullsized":"2024-02-21T23:01:08.787626+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:47:23.414344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787838+0000","last_change":"2024-02-21T23:01:03.220586+0000","last_active":"2024-02-21T23:01:08.787838+0000","last_peered":"2024-02-21T23:01:08.787838+0000","last_clean":"2024-02-21T23:01:08.787838+0000","last_became_active":"2024-02-21T23:01:03.220349+0000","last_became_peered":"2024-02-21T23:01:03.220349+0000","last_unstale":"2024-02-21T23:01:08.787838+0000","last_undegraded":"2024-02-21T23:01:08.787838+0000","last_fullsized":"2024-02-21T23:01:08.787838+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:20:55.846599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788533+0000","last_change":"2024-02-21T23:01:02.206319+0000","last_active":"2024-02-21T23:01:08.788533+0000","last_peered":"2024-02-21T23:01:08.788533+0000","last_clean":"2024-02-21T23:01:08.788533+0000","last_became_active":"2024-02-21T23:01:02.205747+0000","last_became_peered":"2024-02-21T23:01:02.205747+0000","last_unstale":"2024-02-21T23:01:08.788533+0000","last_undegraded":"2024-02-21T23:01:08.788533+0000","last_fullsized":"2024-02-21T23:01:08.788533+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:10:09.680115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10],"acting":[5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.789983+0000","last_change":"2024-02-21T23:01:07.280592+0000","last_active":"2024-02-21T23:01:08.789983+0000","last_peered":"2024-02-21T23:01:08.789983+0000","last_clean":"2024-02-21T23:01:08.789983+0000","last_became_active":"2024-02-21T23:01:07.280193+0000","last_became_peered":"2024-02-21T23:01:07.280193+0000","last_unstale":"2024-02-21T23:01:08.789983+0000","last_undegraded":"2024-02-21T23:01:08.789983+0000","last_fullsized":"2024-02-21T23:01:08.789983+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:40:30.373445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788267+0000","last_change":"2024-02-21T23:01:03.216834+0000","last_active":"2024-02-21T23:01:08.788267+0000","last_peered":"2024-02-21T23:01:08.788267+0000","last_clean":"2024-02-21T23:01:08.788267+0000","last_became_active":"2024-02-21T23:01:03.216578+0000","last_became_peered":"2024-02-21T23:01:03.216578+0000","last_unstale":"2024-02-21T23:01:08.788267+0000","last_undegraded":"2024-02-21T23:01:08.788267+0000","last_fullsized":"2024-02-21T23:01:08.788267+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:37:02.015678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.264532+0000","last_change":"2024-02-21T23:01:02.220913+0000","last_active":"2024-02-21T23:01:08.264532+0000","last_peered":"2024-02-21T23:01:08.264532+0000","last_clean":"2024-02-21T23:01:08.264532+0000","last_became_active":"2024-02-21T23:01:02.220554+0000","last_became_peered":"2024-02-21T23:01:02.220554+0000","last_unstale":"2024-02-21T23:01:08.264532+0000","last_undegraded":"2024-02-21T23:01:08.264532+0000","last_fullsized":"2024-02-21T23:01:08.264532+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:36:44.497886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787182+0000","last_change":"2024-02-21T23:01:07.257431+0000","last_active":"2024-02-21T23:01:08.787182+0000","last_peered":"2024-02-21T23:01:08.787182+0000","last_clean":"2024-02-21T23:01:08.787182+0000","last_became_active":"2024-02-21T23:01:07.257011+0000","last_became_peered":"2024-02-21T23:01:07.257011+0000","last_unstale":"2024-02-21T23:01:08.787182+0000","last_undegraded":"2024-02-21T23:01:08.787182+0000","last_fullsized":"2024-02-21T23:01:08.787182+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:44:43.960074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787848+0000","last_change":"2024-02-21T23:01:03.211792+0000","last_active":"2024-02-21T23:01:08.787848+0000","last_peered":"2024-02-21T23:01:08.787848+0000","last_clean":"2024-02-21T23:01:08.787848+0000","last_became_active":"2024-02-21T23:01:03.211467+0000","last_became_peered":"2024-02-21T23:01:03.211467+0000","last_unstale":"2024-02-21T23:01:08.787848+0000","last_undegraded":"2024-02-21T23:01:08.787848+0000","last_fullsized":"2024-02-21T23:01:08.787848+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:54:32.196725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"29'2","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:33.392458+0000","last_change":"2024-02-21T23:01:02.211763+0000","last_active":"2024-02-21T23:01:33.392458+0000","last_peered":"2024-02-21T23:01:33.392458+0000","last_clean":"2024-02-21T23:01:33.392458+0000","last_became_active":"2024-02-21T23:01:02.211470+0000","last_became_peered":"2024-02-21T23:01:02.211470+0000","last_unstale":"2024-02-21T23:01:33.392458+0000","last_undegraded":"2024-02-21T23:01:33.392458+0000","last_fullsized":"2024-02-21T23:01:33.392458+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:23:41.295647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5],"acting":[8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787817+0000","last_change":"2024-02-21T23:01:07.269076+0000","last_active":"2024-02-21T23:01:08.787817+0000","last_peered":"2024-02-21T23:01:08.787817+0000","last_clean":"2024-02-21T23:01:08.787817+0000","last_became_active":"2024-02-21T23:01:07.268681+0000","last_became_peered":"2024-02-21T23:01:07.268681+0000","last_unstale":"2024-02-21T23:01:08.787817+0000","last_undegraded":"2024-02-21T23:01:08.787817+0000","last_fullsized":"2024-02-21T23:01:08.787817+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:02:35.072200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787945+0000","last_change":"2024-02-21T23:01:03.212943+0000","last_active":"2024-02-21T23:01:08.787945+0000","last_peered":"2024-02-21T23:01:08.787945+0000","last_clean":"2024-02-21T23:01:08.787945+0000","last_became_active":"2024-02-21T23:01:03.212634+0000","last_became_peered":"2024-02-21T23:01:03.212634+0000","last_unstale":"2024-02-21T23:01:08.787945+0000","last_undegraded":"2024-02-21T23:01:08.787945+0000","last_fullsized":"2024-02-21T23:01:08.787945+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:07:50.626867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"29'15","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:32.399647+0000","last_change":"2024-02-21T23:01:02.221957+0000","last_active":"2024-02-21T23:01:32.399647+0000","last_peered":"2024-02-21T23:01:32.399647+0000","last_clean":"2024-02-21T23:01:32.399647+0000","last_became_active":"2024-02-21T23:01:02.221642+0000","last_became_peered":"2024-02-21T23:01:02.221642+0000","last_unstale":"2024-02-21T23:01:32.399647+0000","last_undegraded":"2024-02-21T23:01:32.399647+0000","last_fullsized":"2024-02-21T23:01:32.399647+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:10:09.680115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.264659+0000","last_change":"2024-02-21T23:01:07.268330+0000","last_active":"2024-02-21T23:01:08.264659+0000","last_peered":"2024-02-21T23:01:08.264659+0000","last_clean":"2024-02-21T23:01:08.264659+0000","last_became_active":"2024-02-21T23:01:07.267874+0000","last_became_peered":"2024-02-21T23:01:07.267874+0000","last_unstale":"2024-02-21T23:01:08.264659+0000","last_undegraded":"2024-02-21T23:01:08.264659+0000","last_fullsized":"2024-02-21T23:01:08.264659+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:37:06.063756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787335+0000","last_change":"2024-02-21T23:01:03.216774+0000","last_active":"2024-02-21T23:01:08.787335+0000","last_peered":"2024-02-21T23:01:08.787335+0000","last_clean":"2024-02-21T23:01:08.787335+0000","last_became_active":"2024-02-21T23:01:03.216466+0000","last_became_peered":"2024-02-21T23:01:03.216466+0000","last_unstale":"2024-02-21T23:01:08.787335+0000","last_undegraded":"2024-02-21T23:01:08.787335+0000","last_fullsized":"2024-02-21T23:01:08.787335+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:07:50.626867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"29'3","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:34.402391+0000","last_change":"2024-02-21T23:01:02.199060+0000","last_active":"2024-02-21T23:01:34.402391+0000","last_peered":"2024-02-21T23:01:34.402391+0000","last_clean":"2024-02-21T23:01:34.402391+0000","last_became_active":"2024-02-21T23:01:02.198709+0000","last_became_peered":"2024-02-21T23:01:02.198709+0000","last_unstale":"2024-02-21T23:01:34.402391+0000","last_undegraded":"2024-02-21T23:01:34.402391+0000","last_fullsized":"2024-02-21T23:01:34.402391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:36:44.497886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788751+0000","last_change":"2024-02-21T23:01:07.278031+0000","last_active":"2024-02-21T23:01:08.788751+0000","last_peered":"2024-02-21T23:01:08.788751+0000","last_clean":"2024-02-21T23:01:08.788751+0000","last_became_active":"2024-02-21T23:01:07.277289+0000","last_became_peered":"2024-02-21T23:01:07.277289+0000","last_unstale":"2024-02-21T23:01:08.788751+0000","last_undegraded":"2024-02-21T23:01:08.788751+0000","last_fullsized":"2024-02-21T23:01:08.788751+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:07:54.674944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787653+0000","last_change":"2024-02-21T23:01:03.214805+0000","last_active":"2024-02-21T23:01:08.787653+0000","last_peered":"2024-02-21T23:01:08.787653+0000","last_clean":"2024-02-21T23:01:08.787653+0000","last_became_active":"2024-02-21T23:01:03.214507+0000","last_became_peered":"2024-02-21T23:01:03.214507+0000","last_unstale":"2024-02-21T23:01:08.787653+0000","last_undegraded":"2024-02-21T23:01:08.787653+0000","last_fullsized":"2024-02-21T23:01:08.787653+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:38:58.973481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"29'3","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:31.386164+0000","last_change":"2024-02-21T23:01:02.209351+0000","last_active":"2024-02-21T23:01:31.386164+0000","last_peered":"2024-02-21T23:01:31.386164+0000","last_clean":"2024-02-21T23:01:31.386164+0000","last_became_active":"2024-02-21T23:01:02.208990+0000","last_became_peered":"2024-02-21T23:01:02.208990+0000","last_unstale":"2024-02-21T23:01:31.386164+0000","last_undegraded":"2024-02-21T23:01:31.386164+0000","last_fullsized":"2024-02-21T23:01:31.386164+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:36:44.497886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787720+0000","last_change":"2024-02-21T23:01:07.280069+0000","last_active":"2024-02-21T23:01:08.787720+0000","last_peered":"2024-02-21T23:01:08.787720+0000","last_clean":"2024-02-21T23:01:08.787720+0000","last_became_active":"2024-02-21T23:01:07.279657+0000","last_became_peered":"2024-02-21T23:01:07.279657+0000","last_unstale":"2024-02-21T23:01:08.787720+0000","last_undegraded":"2024-02-21T23:01:08.787720+0000","last_fullsized":"2024-02-21T23:01:08.787720+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:19:05.632217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.263316+0000","last_change":"2024-02-21T23:01:03.226321+0000","last_active":"2024-02-21T23:01:08.263316+0000","last_peered":"2024-02-21T23:01:08.263316+0000","last_clean":"2024-02-21T23:01:08.263316+0000","last_became_active":"2024-02-21T23:01:03.224451+0000","last_became_peered":"2024-02-21T23:01:03.224451+0000","last_unstale":"2024-02-21T23:01:08.263316+0000","last_undegraded":"2024-02-21T23:01:08.263316+0000","last_fullsized":"2024-02-21T23:01:08.263316+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:35:24.590398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"29'6","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:32.393944+0000","last_change":"2024-02-21T23:01:02.203410+0000","last_active":"2024-02-21T23:01:32.393944+0000","last_peered":"2024-02-21T23:01:32.393944+0000","last_clean":"2024-02-21T23:01:32.393944+0000","last_became_active":"2024-02-21T23:01:02.203081+0000","last_became_peered":"2024-02-21T23:01:02.203081+0000","last_unstale":"2024-02-21T23:01:32.393944+0000","last_undegraded":"2024-02-21T23:01:32.393944+0000","last_fullsized":"2024-02-21T23:01:32.393944+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:36:44.497886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10],"acting":[2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788275+0000","last_change":"2024-02-21T23:01:07.268810+0000","last_active":"2024-02-21T23:01:08.788275+0000","last_peered":"2024-02-21T23:01:08.788275+0000","last_clean":"2024-02-21T23:01:08.788275+0000","last_became_active":"2024-02-21T23:01:07.268436+0000","last_became_peered":"2024-02-21T23:01:07.268436+0000","last_unstale":"2024-02-21T23:01:08.788275+0000","last_undegraded":"2024-02-21T23:01:08.788275+0000","last_fullsized":"2024-02-21T23:01:08.788275+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:10:53.452033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.261462+0000","last_change":"2024-02-21T23:01:03.216176+0000","last_active":"2024-02-21T23:01:08.261462+0000","last_peered":"2024-02-21T23:01:08.261462+0000","last_clean":"2024-02-21T23:01:08.261462+0000","last_became_active":"2024-02-21T23:01:03.215888+0000","last_became_peered":"2024-02-21T23:01:03.215888+0000","last_unstale":"2024-02-21T23:01:08.261462+0000","last_undegraded":"2024-02-21T23:01:08.261462+0000","last_fullsized":"2024-02-21T23:01:08.261462+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:07:50.626867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"29'23","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:35.444056+0000","last_change":"2024-02-21T23:01:02.204595+0000","last_active":"2024-02-21T23:01:35.444056+0000","last_peered":"2024-02-21T23:01:35.444056+0000","last_clean":"2024-02-21T23:01:35.444056+0000","last_became_active":"2024-02-21T23:01:02.204123+0000","last_became_peered":"2024-02-21T23:01:02.204123+0000","last_unstale":"2024-02-21T23:01:35.444056+0000","last_undegraded":"2024-02-21T23:01:35.444056+0000","last_fullsized":"2024-02-21T23:01:35.444056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:36:44.497886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41910,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":9,"num_read_kb":27,"num_write":24,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1],"acting":[10,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788601+0000","last_change":"2024-02-21T23:01:07.275187+0000","last_active":"2024-02-21T23:01:08.788601+0000","last_peered":"2024-02-21T23:01:08.788601+0000","last_clean":"2024-02-21T23:01:08.788601+0000","last_became_active":"2024-02-21T23:01:07.265618+0000","last_became_peered":"2024-02-21T23:01:07.265618+0000","last_unstale":"2024-02-21T23:01:08.788601+0000","last_undegraded":"2024-02-21T23:01:08.788601+0000","last_fullsized":"2024-02-21T23:01:08.788601+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:47:23.414344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788154+0000","last_change":"2024-02-21T23:01:03.216300+0000","last_active":"2024-02-21T23:01:08.788154+0000","last_peered":"2024-02-21T23:01:08.788154+0000","last_clean":"2024-02-21T23:01:08.788154+0000","last_became_active":"2024-02-21T23:01:03.214580+0000","last_became_peered":"2024-02-21T23:01:03.214580+0000","last_unstale":"2024-02-21T23:01:08.788154+0000","last_undegraded":"2024-02-21T23:01:08.788154+0000","last_fullsized":"2024-02-21T23:01:08.788154+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:41:55.485351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8],"acting":[1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"29'4","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:31.383505+0000","last_change":"2024-02-21T23:01:02.222064+0000","last_active":"2024-02-21T23:01:31.383505+0000","last_peered":"2024-02-21T23:01:31.383505+0000","last_clean":"2024-02-21T23:01:31.383505+0000","last_became_active":"2024-02-21T23:01:02.221735+0000","last_became_peered":"2024-02-21T23:01:02.221735+0000","last_unstale":"2024-02-21T23:01:31.383505+0000","last_undegraded":"2024-02-21T23:01:31.383505+0000","last_fullsized":"2024-02-21T23:01:31.383505+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:23:41.295647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.260510+0000","last_change":"2024-02-21T23:01:07.276469+0000","last_active":"2024-02-21T23:01:08.260510+0000","last_peered":"2024-02-21T23:01:08.260510+0000","last_clean":"2024-02-21T23:01:08.260510+0000","last_became_active":"2024-02-21T23:01:07.275982+0000","last_became_peered":"2024-02-21T23:01:07.275982+0000","last_unstale":"2024-02-21T23:01:08.260510+0000","last_undegraded":"2024-02-21T23:01:08.260510+0000","last_fullsized":"2024-02-21T23:01:08.260510+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:37:06.063756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.790923+0000","last_change":"2024-02-21T23:01:03.229449+0000","last_active":"2024-02-21T23:01:08.790923+0000","last_peered":"2024-02-21T23:01:08.790923+0000","last_clean":"2024-02-21T23:01:08.790923+0000","last_became_active":"2024-02-21T23:01:03.229193+0000","last_became_peered":"2024-02-21T23:01:03.229193+0000","last_unstale":"2024-02-21T23:01:08.790923+0000","last_undegraded":"2024-02-21T23:01:08.790923+0000","last_fullsized":"2024-02-21T23:01:08.790923+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:35:24.590398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"29'2","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:31.382240+0000","last_change":"2024-02-21T23:01:02.197598+0000","last_active":"2024-02-21T23:01:31.382240+0000","last_peered":"2024-02-21T23:01:31.382240+0000","last_clean":"2024-02-21T23:01:31.382240+0000","last_became_active":"2024-02-21T23:01:02.197275+0000","last_became_peered":"2024-02-21T23:01:02.197275+0000","last_unstale":"2024-02-21T23:01:31.382240+0000","last_undegraded":"2024-02-21T23:01:31.382240+0000","last_fullsized":"2024-02-21T23:01:31.382240+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:36:44.497886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788046+0000","last_change":"2024-02-21T23:01:07.278576+0000","last_active":"2024-02-21T23:01:08.788046+0000","last_peered":"2024-02-21T23:01:08.788046+0000","last_clean":"2024-02-21T23:01:08.788046+0000","last_became_active":"2024-02-21T23:01:07.276078+0000","last_became_peered":"2024-02-21T23:01:07.276078+0000","last_unstale":"2024-02-21T23:01:08.788046+0000","last_undegraded":"2024-02-21T23:01:08.788046+0000","last_fullsized":"2024-02-21T23:01:08.788046+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:45:33.658778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788387+0000","last_change":"2024-02-21T23:01:03.215454+0000","last_active":"2024-02-21T23:01:08.788387+0000","last_peered":"2024-02-21T23:01:08.788387+0000","last_clean":"2024-02-21T23:01:08.788387+0000","last_became_active":"2024-02-21T23:01:03.215004+0000","last_became_peered":"2024-02-21T23:01:03.215004+0000","last_unstale":"2024-02-21T23:01:08.788387+0000","last_undegraded":"2024-02-21T23:01:08.788387+0000","last_fullsized":"2024-02-21T23:01:08.788387+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:27:55.341328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"29'3","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:34.398547+0000","last_change":"2024-02-21T23:01:02.207663+0000","last_active":"2024-02-21T23:01:34.398547+0000","last_peered":"2024-02-21T23:01:34.398547+0000","last_clean":"2024-02-21T23:01:34.398547+0000","last_became_active":"2024-02-21T23:01:02.207349+0000","last_became_peered":"2024-02-21T23:01:02.207349+0000","last_unstale":"2024-02-21T23:01:34.398547+0000","last_undegraded":"2024-02-21T23:01:34.398547+0000","last_fullsized":"2024-02-21T23:01:34.398547+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:21:29.919968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5],"acting":[10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.790535+0000","last_change":"2024-02-21T23:01:07.268655+0000","last_active":"2024-02-21T23:01:08.790535+0000","last_peered":"2024-02-21T23:01:08.790535+0000","last_clean":"2024-02-21T23:01:08.790535+0000","last_became_active":"2024-02-21T23:01:07.268193+0000","last_became_peered":"2024-02-21T23:01:07.268193+0000","last_unstale":"2024-02-21T23:01:08.790535+0000","last_undegraded":"2024-02-21T23:01:08.790535+0000","last_fullsized":"2024-02-21T23:01:08.790535+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:54:44.380302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.790242+0000","last_change":"2024-02-21T23:01:07.271441+0000","last_active":"2024-02-21T23:01:08.790242+0000","last_peered":"2024-02-21T23:01:08.790242+0000","last_clean":"2024-02-21T23:01:08.790242+0000","last_became_active":"2024-02-21T23:01:07.271175+0000","last_became_peered":"2024-02-21T23:01:07.271175+0000","last_unstale":"2024-02-21T23:01:08.790242+0000","last_undegraded":"2024-02-21T23:01:08.790242+0000","last_fullsized":"2024-02-21T23:01:08.790242+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:20:59.894677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788169+0000","last_change":"2024-02-21T23:01:03.210855+0000","last_active":"2024-02-21T23:01:08.788169+0000","last_peered":"2024-02-21T23:01:08.788169+0000","last_clean":"2024-02-21T23:01:08.788169+0000","last_became_active":"2024-02-21T23:01:03.210599+0000","last_became_peered":"2024-02-21T23:01:03.210599+0000","last_unstale":"2024-02-21T23:01:08.788169+0000","last_undegraded":"2024-02-21T23:01:08.788169+0000","last_fullsized":"2024-02-21T23:01:08.788169+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:27:55.341328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"29'1","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788133+0000","last_change":"2024-02-21T23:01:02.204603+0000","last_active":"2024-02-21T23:01:08.788133+0000","last_peered":"2024-02-21T23:01:08.788133+0000","last_clean":"2024-02-21T23:01:08.788133+0000","last_became_active":"2024-02-21T23:01:02.204304+0000","last_became_peered":"2024-02-21T23:01:02.204304+0000","last_unstale":"2024-02-21T23:01:08.788133+0000","last_undegraded":"2024-02-21T23:01:08.788133+0000","last_fullsized":"2024-02-21T23:01:08.788133+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:58:23.554457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787929+0000","last_change":"2024-02-21T23:01:07.284000+0000","last_active":"2024-02-21T23:01:08.787929+0000","last_peered":"2024-02-21T23:01:08.787929+0000","last_clean":"2024-02-21T23:01:08.787929+0000","last_became_active":"2024-02-21T23:01:07.283568+0000","last_became_peered":"2024-02-21T23:01:07.283568+0000","last_unstale":"2024-02-21T23:01:08.787929+0000","last_undegraded":"2024-02-21T23:01:08.787929+0000","last_fullsized":"2024-02-21T23:01:08.787929+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:20:59.894677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.789445+0000","last_change":"2024-02-21T23:01:03.208483+0000","last_active":"2024-02-21T23:01:08.789445+0000","last_peered":"2024-02-21T23:01:08.789445+0000","last_clean":"2024-02-21T23:01:08.789445+0000","last_became_active":"2024-02-21T23:01:03.208141+0000","last_became_peered":"2024-02-21T23:01:03.208141+0000","last_unstale":"2024-02-21T23:01:08.789445+0000","last_undegraded":"2024-02-21T23:01:08.789445+0000","last_fullsized":"2024-02-21T23:01:08.789445+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:35:24.590398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"29'2","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:32.395096+0000","last_change":"2024-02-21T23:01:02.218826+0000","last_active":"2024-02-21T23:01:32.395096+0000","last_peered":"2024-02-21T23:01:32.395096+0000","last_clean":"2024-02-21T23:01:32.395096+0000","last_became_active":"2024-02-21T23:01:02.218499+0000","last_became_peered":"2024-02-21T23:01:02.218499+0000","last_unstale":"2024-02-21T23:01:32.395096+0000","last_undegraded":"2024-02-21T23:01:32.395096+0000","last_fullsized":"2024-02-21T23:01:32.395096+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:17:06.353018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"29'3","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:32.398649+0000","last_change":"2024-02-21T23:01:02.209061+0000","last_active":"2024-02-21T23:01:32.398649+0000","last_peered":"2024-02-21T23:01:32.398649+0000","last_clean":"2024-02-21T23:01:32.398649+0000","last_became_active":"2024-02-21T23:01:02.208779+0000","last_became_peered":"2024-02-21T23:01:02.208779+0000","last_unstale":"2024-02-21T23:01:32.398649+0000","last_undegraded":"2024-02-21T23:01:32.398649+0000","last_fullsized":"2024-02-21T23:01:32.398649+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:17:06.353018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8],"acting":[10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787944+0000","last_change":"2024-02-21T23:01:03.212873+0000","last_active":"2024-02-21T23:01:08.787944+0000","last_peered":"2024-02-21T23:01:08.787944+0000","last_clean":"2024-02-21T23:01:08.787944+0000","last_became_active":"2024-02-21T23:01:03.212560+0000","last_became_peered":"2024-02-21T23:01:03.212560+0000","last_unstale":"2024-02-21T23:01:08.787944+0000","last_undegraded":"2024-02-21T23:01:08.787944+0000","last_fullsized":"2024-02-21T23:01:08.787944+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:47:19.366266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788832+0000","last_change":"2024-02-21T23:01:07.269266+0000","last_active":"2024-02-21T23:01:08.788832+0000","last_peered":"2024-02-21T23:01:08.788832+0000","last_clean":"2024-02-21T23:01:08.788832+0000","last_became_active":"2024-02-21T23:01:07.267796+0000","last_became_peered":"2024-02-21T23:01:07.267796+0000","last_unstale":"2024-02-21T23:01:08.788832+0000","last_undegraded":"2024-02-21T23:01:08.788832+0000","last_fullsized":"2024-02-21T23:01:08.788832+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:37:06.063756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"29'6","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:34.399654+0000","last_change":"2024-02-21T23:01:02.206398+0000","last_active":"2024-02-21T23:01:34.399654+0000","last_peered":"2024-02-21T23:01:34.399654+0000","last_clean":"2024-02-21T23:01:34.399654+0000","last_became_active":"2024-02-21T23:01:02.206069+0000","last_became_peered":"2024-02-21T23:01:02.206069+0000","last_unstale":"2024-02-21T23:01:34.399654+0000","last_undegraded":"2024-02-21T23:01:34.399654+0000","last_fullsized":"2024-02-21T23:01:34.399654+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:26:49.911102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1017,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.261164+0000","last_change":"2024-02-21T23:01:03.221228+0000","last_active":"2024-02-21T23:01:08.261164+0000","last_peered":"2024-02-21T23:01:08.261164+0000","last_clean":"2024-02-21T23:01:08.261164+0000","last_became_active":"2024-02-21T23:01:03.220900+0000","last_became_peered":"2024-02-21T23:01:03.220900+0000","last_unstale":"2024-02-21T23:01:08.261164+0000","last_undegraded":"2024-02-21T23:01:08.261164+0000","last_fullsized":"2024-02-21T23:01:08.261164+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:40:26.325368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9],"acting":[8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788794+0000","last_change":"2024-02-21T23:01:07.257004+0000","last_active":"2024-02-21T23:01:08.788794+0000","last_peered":"2024-02-21T23:01:08.788794+0000","last_clean":"2024-02-21T23:01:08.788794+0000","last_became_active":"2024-02-21T23:01:07.256474+0000","last_became_peered":"2024-02-21T23:01:07.256474+0000","last_unstale":"2024-02-21T23:01:08.788794+0000","last_undegraded":"2024-02-21T23:01:08.788794+0000","last_fullsized":"2024-02-21T23:01:08.788794+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:15:20.572234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787395+0000","last_change":"2024-02-21T23:01:03.215942+0000","last_active":"2024-02-21T23:01:08.787395+0000","last_peered":"2024-02-21T23:01:08.787395+0000","last_clean":"2024-02-21T23:01:08.787395+0000","last_became_active":"2024-02-21T23:01:03.215461+0000","last_became_peered":"2024-02-21T23:01:03.215461+0000","last_unstale":"2024-02-21T23:01:08.787395+0000","last_undegraded":"2024-02-21T23:01:08.787395+0000","last_fullsized":"2024-02-21T23:01:08.787395+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:27:55.341328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788755+0000","last_change":"2024-02-21T23:01:03.215959+0000","last_active":"2024-02-21T23:01:08.788755+0000","last_peered":"2024-02-21T23:01:08.788755+0000","last_clean":"2024-02-21T23:01:08.788755+0000","last_became_active":"2024-02-21T23:01:03.215639+0000","last_became_peered":"2024-02-21T23:01:03.215639+0000","last_unstale":"2024-02-21T23:01:08.788755+0000","last_undegraded":"2024-02-21T23:01:08.788755+0000","last_fullsized":"2024-02-21T23:01:08.788755+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:16.946152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787323+0000","last_change":"2024-02-21T23:01:03.218687+0000","last_active":"2024-02-21T23:01:08.787323+0000","last_peered":"2024-02-21T23:01:08.787323+0000","last_clean":"2024-02-21T23:01:08.787323+0000","last_became_active":"2024-02-21T23:01:03.218377+0000","last_became_peered":"2024-02-21T23:01:03.218377+0000","last_unstale":"2024-02-21T23:01:08.787323+0000","last_undegraded":"2024-02-21T23:01:08.787323+0000","last_fullsized":"2024-02-21T23:01:08.787323+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:41:55.485351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.790033+0000","last_change":"2024-02-21T23:01:03.225342+0000","last_active":"2024-02-21T23:01:08.790033+0000","last_peered":"2024-02-21T23:01:08.790033+0000","last_clean":"2024-02-21T23:01:08.790033+0000","last_became_active":"2024-02-21T23:01:03.225085+0000","last_became_peered":"2024-02-21T23:01:03.225085+0000","last_unstale":"2024-02-21T23:01:08.790033+0000","last_undegraded":"2024-02-21T23:01:08.790033+0000","last_fullsized":"2024-02-21T23:01:08.790033+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:54:32.196725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.263829+0000","last_change":"2024-02-21T23:01:03.226259+0000","last_active":"2024-02-21T23:01:08.263829+0000","last_peered":"2024-02-21T23:01:08.263829+0000","last_clean":"2024-02-21T23:01:08.263829+0000","last_became_active":"2024-02-21T23:01:03.225925+0000","last_became_peered":"2024-02-21T23:01:03.225925+0000","last_unstale":"2024-02-21T23:01:08.263829+0000","last_undegraded":"2024-02-21T23:01:08.263829+0000","last_fullsized":"2024-02-21T23:01:08.263829+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:54:32.196725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788416+0000","last_change":"2024-02-21T23:01:03.215186+0000","last_active":"2024-02-21T23:01:08.788416+0000","last_peered":"2024-02-21T23:01:08.788416+0000","last_clean":"2024-02-21T23:01:08.788416+0000","last_became_active":"2024-02-21T23:01:03.214488+0000","last_became_peered":"2024-02-21T23:01:03.214488+0000","last_unstale":"2024-02-21T23:01:08.788416+0000","last_undegraded":"2024-02-21T23:01:08.788416+0000","last_fullsized":"2024-02-21T23:01:08.788416+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:58:24.562346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8],"acting":[11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788754+0000","last_change":"2024-02-21T23:01:03.208734+0000","last_active":"2024-02-21T23:01:08.788754+0000","last_peered":"2024-02-21T23:01:08.788754+0000","last_clean":"2024-02-21T23:01:08.788754+0000","last_became_active":"2024-02-21T23:01:03.208458+0000","last_became_peered":"2024-02-21T23:01:03.208458+0000","last_unstale":"2024-02-21T23:01:08.788754+0000","last_undegraded":"2024-02-21T23:01:08.788754+0000","last_fullsized":"2024-02-21T23:01:08.788754+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:54:32.196725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8],"acting":[2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788958+0000","last_change":"2024-02-21T23:01:03.206669+0000","last_active":"2024-02-21T23:01:08.788958+0000","last_peered":"2024-02-21T23:01:08.788958+0000","last_clean":"2024-02-21T23:01:08.788958+0000","last_became_active":"2024-02-21T23:01:03.206376+0000","last_became_peered":"2024-02-21T23:01:03.206376+0000","last_unstale":"2024-02-21T23:01:08.788958+0000","last_undegraded":"2024-02-21T23:01:08.788958+0000","last_fullsized":"2024-02-21T23:01:08.788958+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:07:50.626867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787194+0000","last_change":"2024-02-21T23:01:03.215459+0000","last_active":"2024-02-21T23:01:08.787194+0000","last_peered":"2024-02-21T23:01:08.787194+0000","last_clean":"2024-02-21T23:01:08.787194+0000","last_became_active":"2024-02-21T23:01:03.214922+0000","last_became_peered":"2024-02-21T23:01:03.214922+0000","last_unstale":"2024-02-21T23:01:08.787194+0000","last_undegraded":"2024-02-21T23:01:08.787194+0000","last_fullsized":"2024-02-21T23:01:08.787194+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:40:26.325368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.790310+0000","last_change":"2024-02-21T23:01:03.213687+0000","last_active":"2024-02-21T23:01:08.790310+0000","last_peered":"2024-02-21T23:01:08.790310+0000","last_clean":"2024-02-21T23:01:08.790310+0000","last_became_active":"2024-02-21T23:01:03.213428+0000","last_became_peered":"2024-02-21T23:01:03.213428+0000","last_unstale":"2024-02-21T23:01:08.790310+0000","last_undegraded":"2024-02-21T23:01:08.790310+0000","last_fullsized":"2024-02-21T23:01:08.790310+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:45:29.610700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787556+0000","last_change":"2024-02-21T23:01:03.215983+0000","last_active":"2024-02-21T23:01:08.787556+0000","last_peered":"2024-02-21T23:01:08.787556+0000","last_clean":"2024-02-21T23:01:08.787556+0000","last_became_active":"2024-02-21T23:01:03.215580+0000","last_became_peered":"2024-02-21T23:01:03.215580+0000","last_unstale":"2024-02-21T23:01:08.787556+0000","last_undegraded":"2024-02-21T23:01:08.787556+0000","last_fullsized":"2024-02-21T23:01:08.787556+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:58:24.562346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.263660+0000","last_change":"2024-02-21T23:01:03.226514+0000","last_active":"2024-02-21T23:01:08.263660+0000","last_peered":"2024-02-21T23:01:08.263660+0000","last_clean":"2024-02-21T23:01:08.263660+0000","last_became_active":"2024-02-21T23:01:03.223861+0000","last_became_peered":"2024-02-21T23:01:03.223861+0000","last_unstale":"2024-02-21T23:01:08.263660+0000","last_undegraded":"2024-02-21T23:01:08.263660+0000","last_fullsized":"2024-02-21T23:01:08.263660+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:07:50.626867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787787+0000","last_change":"2024-02-21T23:01:03.212993+0000","last_active":"2024-02-21T23:01:08.787787+0000","last_peered":"2024-02-21T23:01:08.787787+0000","last_clean":"2024-02-21T23:01:08.787787+0000","last_became_active":"2024-02-21T23:01:03.212691+0000","last_became_peered":"2024-02-21T23:01:03.212691+0000","last_unstale":"2024-02-21T23:01:08.787787+0000","last_undegraded":"2024-02-21T23:01:08.787787+0000","last_fullsized":"2024-02-21T23:01:08.787787+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:10:10.688004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788992+0000","last_change":"2024-02-21T23:01:03.217962+0000","last_active":"2024-02-21T23:01:08.788992+0000","last_peered":"2024-02-21T23:01:08.788992+0000","last_clean":"2024-02-21T23:01:08.788992+0000","last_became_active":"2024-02-21T23:01:03.217613+0000","last_became_peered":"2024-02-21T23:01:03.217613+0000","last_unstale":"2024-02-21T23:01:08.788992+0000","last_undegraded":"2024-02-21T23:01:08.788992+0000","last_fullsized":"2024-02-21T23:01:08.788992+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:35:24.590398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788983+0000","last_change":"2024-02-21T23:01:03.214531+0000","last_active":"2024-02-21T23:01:08.788983+0000","last_peered":"2024-02-21T23:01:08.788983+0000","last_clean":"2024-02-21T23:01:08.788983+0000","last_became_active":"2024-02-21T23:01:03.214165+0000","last_became_peered":"2024-02-21T23:01:03.214165+0000","last_unstale":"2024-02-21T23:01:08.788983+0000","last_undegraded":"2024-02-21T23:01:08.788983+0000","last_fullsized":"2024-02-21T23:01:08.788983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:58:24.562346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1],"acting":[9,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788210+0000","last_change":"2024-02-21T23:01:03.214286+0000","last_active":"2024-02-21T23:01:08.788210+0000","last_peered":"2024-02-21T23:01:08.788210+0000","last_clean":"2024-02-21T23:01:08.788210+0000","last_became_active":"2024-02-21T23:01:03.213755+0000","last_became_peered":"2024-02-21T23:01:03.213755+0000","last_unstale":"2024-02-21T23:01:08.788210+0000","last_undegraded":"2024-02-21T23:01:08.788210+0000","last_fullsized":"2024-02-21T23:01:08.788210+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:35:24.590398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787471+0000","last_change":"2024-02-21T23:01:03.216623+0000","last_active":"2024-02-21T23:01:08.787471+0000","last_peered":"2024-02-21T23:01:08.787471+0000","last_clean":"2024-02-21T23:01:08.787471+0000","last_became_active":"2024-02-21T23:01:03.216345+0000","last_became_peered":"2024-02-21T23:01:03.216345+0000","last_unstale":"2024-02-21T23:01:08.787471+0000","last_undegraded":"2024-02-21T23:01:08.787471+0000","last_fullsized":"2024-02-21T23:01:08.787471+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:10:10.688004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.790273+0000","last_change":"2024-02-21T23:01:03.226262+0000","last_active":"2024-02-21T23:01:08.790273+0000","last_peered":"2024-02-21T23:01:08.790273+0000","last_clean":"2024-02-21T23:01:08.790273+0000","last_became_active":"2024-02-21T23:01:03.225574+0000","last_became_peered":"2024-02-21T23:01:03.225574+0000","last_unstale":"2024-02-21T23:01:08.790273+0000","last_undegraded":"2024-02-21T23:01:08.790273+0000","last_fullsized":"2024-02-21T23:01:08.790273+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:10:10.688004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.789940+0000","last_change":"2024-02-21T23:01:03.225898+0000","last_active":"2024-02-21T23:01:08.789940+0000","last_peered":"2024-02-21T23:01:08.789940+0000","last_clean":"2024-02-21T23:01:08.789940+0000","last_became_active":"2024-02-21T23:01:03.217938+0000","last_became_peered":"2024-02-21T23:01:03.217938+0000","last_unstale":"2024-02-21T23:01:08.789940+0000","last_undegraded":"2024-02-21T23:01:08.789940+0000","last_fullsized":"2024-02-21T23:01:08.789940+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:58:24.562346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8],"acting":[0,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.263526+0000","last_change":"2024-02-21T23:01:03.225830+0000","last_active":"2024-02-21T23:01:08.263526+0000","last_peered":"2024-02-21T23:01:08.263526+0000","last_clean":"2024-02-21T23:01:08.263526+0000","last_became_active":"2024-02-21T23:01:03.225449+0000","last_became_peered":"2024-02-21T23:01:03.225449+0000","last_unstale":"2024-02-21T23:01:08.263526+0000","last_undegraded":"2024-02-21T23:01:08.263526+0000","last_fullsized":"2024-02-21T23:01:08.263526+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:47:19.366266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10],"acting":[6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.260717+0000","last_change":"2024-02-21T23:01:03.208746+0000","last_active":"2024-02-21T23:01:08.260717+0000","last_peered":"2024-02-21T23:01:08.260717+0000","last_clean":"2024-02-21T23:01:08.260717+0000","last_became_active":"2024-02-21T23:01:03.208446+0000","last_became_peered":"2024-02-21T23:01:03.208446+0000","last_unstale":"2024-02-21T23:01:08.260717+0000","last_undegraded":"2024-02-21T23:01:08.260717+0000","last_fullsized":"2024-02-21T23:01:08.260717+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:58:24.562346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787941+0000","last_change":"2024-02-21T23:01:03.218981+0000","last_active":"2024-02-21T23:01:08.787941+0000","last_peered":"2024-02-21T23:01:08.787941+0000","last_clean":"2024-02-21T23:01:08.787941+0000","last_became_active":"2024-02-21T23:01:03.217925+0000","last_became_peered":"2024-02-21T23:01:03.217925+0000","last_unstale":"2024-02-21T23:01:08.787941+0000","last_undegraded":"2024-02-21T23:01:08.787941+0000","last_fullsized":"2024-02-21T23:01:08.787941+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:54:40.332224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8],"acting":[7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.790183+0000","last_change":"2024-02-21T23:01:03.212233+0000","last_active":"2024-02-21T23:01:08.790183+0000","last_peered":"2024-02-21T23:01:08.790183+0000","last_clean":"2024-02-21T23:01:08.790183+0000","last_became_active":"2024-02-21T23:01:03.211921+0000","last_became_peered":"2024-02-21T23:01:03.211921+0000","last_unstale":"2024-02-21T23:01:08.790183+0000","last_undegraded":"2024-02-21T23:01:08.790183+0000","last_fullsized":"2024-02-21T23:01:08.790183+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:54:32.196725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2],"acting":[10,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788443+0000","last_change":"2024-02-21T23:01:03.216861+0000","last_active":"2024-02-21T23:01:08.788443+0000","last_peered":"2024-02-21T23:01:08.788443+0000","last_clean":"2024-02-21T23:01:08.788443+0000","last_became_active":"2024-02-21T23:01:03.216580+0000","last_became_peered":"2024-02-21T23:01:03.216580+0000","last_unstale":"2024-02-21T23:01:08.788443+0000","last_undegraded":"2024-02-21T23:01:08.788443+0000","last_fullsized":"2024-02-21T23:01:08.788443+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:35:24.590398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.789320+0000","last_change":"2024-02-21T23:01:03.212164+0000","last_active":"2024-02-21T23:01:08.789320+0000","last_peered":"2024-02-21T23:01:08.789320+0000","last_clean":"2024-02-21T23:01:08.789320+0000","last_became_active":"2024-02-21T23:01:03.211811+0000","last_became_peered":"2024-02-21T23:01:03.211811+0000","last_unstale":"2024-02-21T23:01:08.789320+0000","last_undegraded":"2024-02-21T23:01:08.789320+0000","last_fullsized":"2024-02-21T23:01:08.789320+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:16.946152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787878+0000","last_change":"2024-02-21T23:01:03.223537+0000","last_active":"2024-02-21T23:01:08.787878+0000","last_peered":"2024-02-21T23:01:08.787878+0000","last_clean":"2024-02-21T23:01:08.787878+0000","last_became_active":"2024-02-21T23:01:03.223255+0000","last_became_peered":"2024-02-21T23:01:03.223255+0000","last_unstale":"2024-02-21T23:01:08.787878+0000","last_undegraded":"2024-02-21T23:01:08.787878+0000","last_fullsized":"2024-02-21T23:01:08.787878+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:19:01.584139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9],"acting":[7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.789780+0000","last_change":"2024-02-21T23:01:03.210441+0000","last_active":"2024-02-21T23:01:08.789780+0000","last_peered":"2024-02-21T23:01:08.789780+0000","last_clean":"2024-02-21T23:01:08.789780+0000","last_became_active":"2024-02-21T23:01:03.209569+0000","last_became_peered":"2024-02-21T23:01:03.209569+0000","last_unstale":"2024-02-21T23:01:08.789780+0000","last_undegraded":"2024-02-21T23:01:08.789780+0000","last_fullsized":"2024-02-21T23:01:08.789780+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:41:55.485351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9],"acting":[10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.261019+0000","last_change":"2024-02-21T23:01:03.214234+0000","last_active":"2024-02-21T23:01:08.261019+0000","last_peered":"2024-02-21T23:01:08.261019+0000","last_clean":"2024-02-21T23:01:08.261019+0000","last_became_active":"2024-02-21T23:01:03.213941+0000","last_became_peered":"2024-02-21T23:01:03.213941+0000","last_unstale":"2024-02-21T23:01:08.261019+0000","last_undegraded":"2024-02-21T23:01:08.261019+0000","last_fullsized":"2024-02-21T23:01:08.261019+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:19:01.584139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3],"acting":[8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.260625+0000","last_change":"2024-02-21T23:01:03.207972+0000","last_active":"2024-02-21T23:01:08.260625+0000","last_peered":"2024-02-21T23:01:08.260625+0000","last_clean":"2024-02-21T23:01:08.260625+0000","last_became_active":"2024-02-21T23:01:03.206762+0000","last_became_peered":"2024-02-21T23:01:03.206762+0000","last_unstale":"2024-02-21T23:01:08.260625+0000","last_undegraded":"2024-02-21T23:01:08.260625+0000","last_fullsized":"2024-02-21T23:01:08.260625+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:27:55.341328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8],"acting":[4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.790823+0000","last_change":"2024-02-21T23:01:03.221959+0000","last_active":"2024-02-21T23:01:08.790823+0000","last_peered":"2024-02-21T23:01:08.790823+0000","last_clean":"2024-02-21T23:01:08.790823+0000","last_became_active":"2024-02-21T23:01:03.221672+0000","last_became_peered":"2024-02-21T23:01:03.221672+0000","last_unstale":"2024-02-21T23:01:08.790823+0000","last_undegraded":"2024-02-21T23:01:08.790823+0000","last_fullsized":"2024-02-21T23:01:08.790823+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:45:29.610700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.790294+0000","last_change":"2024-02-21T23:01:03.219660+0000","last_active":"2024-02-21T23:01:08.790294+0000","last_peered":"2024-02-21T23:01:08.790294+0000","last_clean":"2024-02-21T23:01:08.790294+0000","last_became_active":"2024-02-21T23:01:03.219379+0000","last_became_peered":"2024-02-21T23:01:03.219379+0000","last_unstale":"2024-02-21T23:01:08.790294+0000","last_undegraded":"2024-02-21T23:01:08.790294+0000","last_fullsized":"2024-02-21T23:01:08.790294+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:27:55.341328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11],"acting":[0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788114+0000","last_change":"2024-02-21T23:01:03.213287+0000","last_active":"2024-02-21T23:01:08.788114+0000","last_peered":"2024-02-21T23:01:08.788114+0000","last_clean":"2024-02-21T23:01:08.788114+0000","last_became_active":"2024-02-21T23:01:03.212878+0000","last_became_peered":"2024-02-21T23:01:03.212878+0000","last_unstale":"2024-02-21T23:01:08.788114+0000","last_undegraded":"2024-02-21T23:01:08.788114+0000","last_fullsized":"2024-02-21T23:01:08.788114+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:16.946152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":45915,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":40,"num_read_kb":52,"num_write":145,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":237568,"data_stored":91830,"data_compressed":3672,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":0,"internal_metadata":0},"log_size":127,"ondisk_log_size":127,"up":64,"acting":64,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66458,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":11,"up_from":17,"seq":73014444042,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":145847,"data_compressed":8432,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":17,"seq":73014444041,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":368640,"data_stored":183307,"data_compressed":10268,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":17,"seq":73014444042,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":150033,"data_compressed":8432,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":17,"seq":73014444041,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":141325,"data_compressed":8432,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":17,"seq":73014444042,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":380928,"data_stored":736803,"data_compressed":41661,"data_compressed_allocated":57344,"data_compressed_original":598016,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":17,"seq":73014444041,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":141259,"data_compressed":8432,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":17,"seq":73014444042,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":401408,"data_stored":737504,"data_compressed":41661,"data_compressed_allocated":57344,"data_compressed_original":598016,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":17,"seq":73014444042,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":315392,"data_stored":145887,"data_compressed":8432,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":17,"seq":73014444042,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":141349,"data_compressed":8432,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444042,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":142802,"data_compressed":8432,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":17,"seq":73014444042,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":352256,"data_stored":183079,"data_compressed":10268,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":17,"seq":73014444042,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":323584,"data_stored":141975,"data_compressed":8432,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33229,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33229,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":41910,"data_compressed":1836,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":42138,"data_compressed":1836,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-21T23:01:37.519 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-21T23:01:37.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.753+0000 7fa38ae00640 1 Processor -- start 2024-02-21T23:01:37.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.753+0000 7fa38ae00640 1 -- start start 2024-02-21T23:01:37.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.756+0000 7fa38ae00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa38418a600 con 0x7fa384182a80 2024-02-21T23:01:37.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.756+0000 7fa38ae00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa38418a8e0 con 0x7fa3840fde40 2024-02-21T23:01:37.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.756+0000 7fa38ae00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa38418abc0 con 0x7fa38418a010 2024-02-21T23:01:37.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.756+0000 7fa389a00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fa384182a80 0x7fa384186a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:52544/0 (socket says 172.21.15.99:52544) 2024-02-21T23:01:37.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.756+0000 7fa389a00640 1 -- 172.21.15.99:0/2133584555 learned_addr learned my addr 172.21.15.99:0/2133584555 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:01:37.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.757+0000 7fa383e00640 1 -- 172.21.15.99:0/2133584555 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4101426431 0 0) 0x7fa38418a8e0 con 0x7fa3840fde40 2024-02-21T23:01:37.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.757+0000 7fa383e00640 1 -- 172.21.15.99:0/2133584555 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa36c003520 con 0x7fa3840fde40 2024-02-21T23:01:37.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.757+0000 7fa383e00640 1 -- 172.21.15.99:0/2133584555 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1247055266 0 0) 0x7fa38418abc0 con 0x7fa38418a010 2024-02-21T23:01:37.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.757+0000 7fa383e00640 1 -- 172.21.15.99:0/2133584555 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa38418a8e0 con 0x7fa38418a010 2024-02-21T23:01:37.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.757+0000 7fa383e00640 1 -- 172.21.15.99:0/2133584555 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4194379376 0 0) 0x7fa38418a600 con 0x7fa384182a80 2024-02-21T23:01:37.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.757+0000 7fa383e00640 1 -- 172.21.15.99:0/2133584555 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa38418abc0 con 0x7fa384182a80 2024-02-21T23:01:37.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.757+0000 7fa383e00640 1 -- 172.21.15.99:0/2133584555 <== mon.1 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3104769668 0 0) 0x7fa36c003520 con 0x7fa3840fde40 2024-02-21T23:01:37.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.757+0000 7fa383e00640 1 -- 172.21.15.99:0/2133584555 >> v1:172.21.15.181:6789/0 conn(0x7fa38418a010 legacy=0x7fa3840719b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:37.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.757+0000 7fa383e00640 1 -- 172.21.15.99:0/2133584555 >> v1:172.21.15.99:6789/0 conn(0x7fa384182a80 legacy=0x7fa384186a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:37.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.757+0000 7fa383e00640 1 -- 172.21.15.99:0/2133584555 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa38418aea0 con 0x7fa3840fde40 2024-02-21T23:01:37.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.757+0000 7fa383e00640 1 -- 172.21.15.99:0/2133584555 <== mon.1 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2069890144 0 0) 0x7fa37c0019f0 con 0x7fa3840fde40 2024-02-21T23:01:37.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.757+0000 7fa383e00640 1 -- 172.21.15.99:0/2133584555 >> v1:172.21.15.162:6789/0 conn(0x7fa3840fde40 legacy=0x7fa3840720c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:37.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.757+0000 7fa383e00640 1 --2- 172.21.15.99:0/2133584555 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa36c004d60 0x7fa36c005140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:37.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.757+0000 7fa383e00640 1 --2- 172.21.15.99:0/2133584555 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa36c0037a0 0x7fa36c003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:37.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.757+0000 7fa383e00640 1 --2- 172.21.15.99:0/2133584555 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa36c004380 0x7fa36c00ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:37.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.757+0000 7fa383e00640 1 -- 172.21.15.99:0/2133584555 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa36c00c2f0 con 0x7fa36c004d60 2024-02-21T23:01:37.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.757+0000 7fa383e00640 1 -- 172.21.15.99:0/2133584555 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa36c00c4a0 con 0x7fa36c0037a0 2024-02-21T23:01:37.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.757+0000 7fa383e00640 1 -- 172.21.15.99:0/2133584555 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa36c00c6a0 con 0x7fa36c004380 2024-02-21T23:01:37.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.757+0000 7fa389000640 1 --2- 172.21.15.99:0/2133584555 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa36c0037a0 0x7fa36c003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:37.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.758+0000 7fa389a00640 1 --2- 172.21.15.99:0/2133584555 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa36c004d60 0x7fa36c005140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:37.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.758+0000 7fa38a400640 1 --2- 172.21.15.99:0/2133584555 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa36c004380 0x7fa36c00ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:37.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.758+0000 7fa389000640 1 -- 172.21.15.99:0/2133584555 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa36c004380 msgr2=0x7fa36c00ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:37.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.758+0000 7fa389000640 1 --2- 172.21.15.99:0/2133584555 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa36c004380 0x7fa36c00ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:37.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.758+0000 7fa389000640 1 -- 172.21.15.99:0/2133584555 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa36c004d60 msgr2=0x7fa36c005140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:37.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.758+0000 7fa389000640 1 --2- 172.21.15.99:0/2133584555 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa36c004d60 0x7fa36c005140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:37.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.758+0000 7fa389000640 1 -- 172.21.15.99:0/2133584555 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa38418aea0 con 0x7fa36c0037a0 2024-02-21T23:01:37.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.758+0000 7fa389a00640 1 --2- 172.21.15.99:0/2133584555 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa36c004d60 0x7fa36c005140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:01:37.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.758+0000 7fa38a400640 1 -- 172.21.15.99:0/2133584555 reap_dead start 2024-02-21T23:01:37.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.759+0000 7fa389000640 1 --2- 172.21.15.99:0/2133584555 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa36c0037a0 0x7fa36c003c20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa370001870 tx=0x7fa36c005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f02228bae4c1257 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:37.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.759+0000 7fa383e00640 1 -- 172.21.15.99:0/2133584555 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa370001490 con 0x7fa36c0037a0 2024-02-21T23:01:37.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.759+0000 7fa383e00640 1 -- 172.21.15.99:0/2133584555 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3700052d0 con 0x7fa36c0037a0 2024-02-21T23:01:37.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.759+0000 7fa383e00640 1 -- 172.21.15.99:0/2133584555 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa370005500 con 0x7fa36c0037a0 2024-02-21T23:01:37.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.760+0000 7fa38ae00640 1 -- 172.21.15.99:0/2133584555 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa36c0037a0 msgr2=0x7fa36c003c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:37.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.760+0000 7fa38ae00640 1 --2- 172.21.15.99:0/2133584555 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa36c0037a0 0x7fa36c003c20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa370001870 tx=0x7fa36c005830 comp rx=0 tx=0).stop 2024-02-21T23:01:37.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.760+0000 7fa38ae00640 1 -- 172.21.15.99:0/2133584555 shutdown_connections 2024-02-21T23:01:37.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.760+0000 7fa38ae00640 1 --2- 172.21.15.99:0/2133584555 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa36c0037a0 0x7fa36c003c20 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:37.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.760+0000 7fa38ae00640 1 -- 172.21.15.99:0/2133584555 >> 172.21.15.99:0/2133584555 conn(0x7fa3840d29f0 msgr2=0x7fa3840d2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:37.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.761+0000 7fa38ae00640 1 -- 172.21.15.99:0/2133584555 shutdown_connections 2024-02-21T23:01:37.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.761+0000 7fa38ae00640 1 -- 172.21.15.99:0/2133584555 wait complete. 2024-02-21T23:01:37.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.764+0000 7fa38ae00640 1 Processor -- start 2024-02-21T23:01:37.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.764+0000 7fa38ae00640 1 -- start start 2024-02-21T23:01:37.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.766+0000 7fa38ae00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa36c0037a0 0x7fa3840d1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:37.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.766+0000 7fa38ae00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3840d4090 0x7fa384222390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:37.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.766+0000 7fa38ae00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3840d1980 0x7fa3842228d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:37.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.766+0000 7fa38ae00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa384182e60 con 0x7fa3840d1980 2024-02-21T23:01:37.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.766+0000 7fa38ae00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa38418b460 con 0x7fa3840d4090 2024-02-21T23:01:37.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.766+0000 7fa38ae00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa384182fe0 con 0x7fa36c0037a0 2024-02-21T23:01:37.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.766+0000 7fa389a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa36c0037a0 0x7fa3840d1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:37.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.766+0000 7fa389000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3840d4090 0x7fa384222390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:37.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.766+0000 7fa389a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa36c0037a0 0x7fa3840d1440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:43528/0 (socket says 172.21.15.99:43528) 2024-02-21T23:01:37.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.766+0000 7fa38a400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3840d1980 0x7fa3842228d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:37.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.766+0000 7fa389a00640 1 -- 172.21.15.99:0/2053035169 learned_addr learned my addr 172.21.15.99:0/2053035169 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:37.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.767+0000 7fa389a00640 1 -- 172.21.15.99:0/2053035169 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3840d4090 msgr2=0x7fa384222390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:37.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.767+0000 7fa389a00640 1 --2- 172.21.15.99:0/2053035169 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3840d4090 0x7fa384222390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:37.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.767+0000 7fa389a00640 1 -- 172.21.15.99:0/2053035169 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3840d1980 msgr2=0x7fa3842228d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:37.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.767+0000 7fa389a00640 1 --2- 172.21.15.99:0/2053035169 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3840d1980 0x7fa3842228d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:37.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.767+0000 7fa389a00640 1 -- 172.21.15.99:0/2053035169 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3840fb1f0 con 0x7fa36c0037a0 2024-02-21T23:01:37.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.767+0000 7fa389a00640 1 --2- 172.21.15.99:0/2053035169 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa36c0037a0 0x7fa3840d1440 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa378007370 tx=0x7fa378007770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:37.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.767+0000 7fa381600640 1 -- 172.21.15.99:0/2053035169 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37801a070 con 0x7fa36c0037a0 2024-02-21T23:01:37.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.768+0000 7fa381600640 1 -- 172.21.15.99:0/2053035169 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa37800f960 con 0x7fa36c0037a0 2024-02-21T23:01:37.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.768+0000 7fa38ae00640 1 -- 172.21.15.99:0/2053035169 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3840faf10 con 0x7fa36c0037a0 2024-02-21T23:01:37.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.768+0000 7fa381600640 1 -- 172.21.15.99:0/2053035169 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37800fd10 con 0x7fa36c0037a0 2024-02-21T23:01:37.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.768+0000 7fa38ae00640 1 -- 172.21.15.99:0/2053035169 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3840d0960 con 0x7fa36c0037a0 2024-02-21T23:01:37.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.769+0000 7fa38ae00640 1 -- 172.21.15.99:0/2053035169 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa384068320 con 0x7fa36c0037a0 2024-02-21T23:01:37.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.772+0000 7fa381600640 1 -- 172.21.15.99:0/2053035169 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 6) v1 ==== 134407+0+0 (secure 0 0 0) 0x7fa37801d070 con 0x7fa36c0037a0 2024-02-21T23:01:37.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.774+0000 7fa381600640 1 --2- 172.21.15.99:0/2053035169 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fa36409ee20 0x7fa3640a12e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:37.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.775+0000 7fa381600640 1 -- 172.21.15.99:0/2053035169 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fa3780c9470 con 0x7fa36c0037a0 2024-02-21T23:01:37.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.775+0000 7fa389000640 1 --2- 172.21.15.99:0/2053035169 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fa36409ee20 0x7fa3640a12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:37.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.776+0000 7fa389000640 1 --2- 172.21.15.99:0/2053035169 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fa36409ee20 0x7fa3640a12e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa370001840 tx=0x7fa370009030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:37.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:37.778+0000 7fa381600640 1 -- 172.21.15.99:0/2053035169 <== mon.2 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fa378097760 con 0x7fa36c0037a0 2024-02-21T23:01:38.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.021+0000 7fa38ae00640 1 -- 172.21.15.99:0/2053035169 --> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa3840d3680 con 0x7fa36409ee20 2024-02-21T23:01:38.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.031+0000 7fa381600640 1 -- 172.21.15.99:0/2053035169 <== mgr.4106 v2:172.21.15.162:6800/1717094936 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+338811 (secure 0 0 0) 0x7fa3840d3680 con 0x7fa36409ee20 2024-02-21T23:01:38.024 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T23:01:38.026 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-02-21T23:01:38.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.036+0000 7fa38ae00640 1 -- 172.21.15.99:0/2053035169 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fa36409ee20 msgr2=0x7fa3640a12e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:38.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.036+0000 7fa38ae00640 1 --2- 172.21.15.99:0/2053035169 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fa36409ee20 0x7fa3640a12e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa370001840 tx=0x7fa370009030 comp rx=0 tx=0).stop 2024-02-21T23:01:38.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.036+0000 7fa38ae00640 1 -- 172.21.15.99:0/2053035169 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa36c0037a0 msgr2=0x7fa3840d1440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:38.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.036+0000 7fa38ae00640 1 --2- 172.21.15.99:0/2053035169 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa36c0037a0 0x7fa3840d1440 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa378007370 tx=0x7fa378007770 comp rx=0 tx=0).stop 2024-02-21T23:01:38.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.036+0000 7fa38ae00640 1 -- 172.21.15.99:0/2053035169 shutdown_connections 2024-02-21T23:01:38.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.036+0000 7fa38ae00640 1 --2- 172.21.15.99:0/2053035169 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fa36409ee20 0x7fa3640a12e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:38.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.036+0000 7fa38ae00640 1 --2- 172.21.15.99:0/2053035169 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3840d1980 0x7fa3842228d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:38.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.036+0000 7fa38ae00640 1 --2- 172.21.15.99:0/2053035169 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3840d4090 0x7fa384222390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:38.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.036+0000 7fa38ae00640 1 --2- 172.21.15.99:0/2053035169 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa36c0037a0 0x7fa3840d1440 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:38.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.036+0000 7fa38ae00640 1 -- 172.21.15.99:0/2053035169 >> 172.21.15.99:0/2053035169 conn(0x7fa3840d29f0 msgr2=0x7fa3840d2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:38.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.037+0000 7fa38ae00640 1 -- 172.21.15.99:0/2053035169 shutdown_connections 2024-02-21T23:01:38.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.037+0000 7fa38ae00640 1 -- 172.21.15.99:0/2053035169 wait complete. 2024-02-21T23:01:38.053 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2024-02-21T23:01:36.951014+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":636517,"num_objects":64,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":176,"num_read_kb":171,"num_write":328,"num_write_kb":3028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":266,"ondisk_log_size":266,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1132462080,"kb_used":328128,"kb_used_data":3936,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1132133952,"statfs":{"total":1159641169920,"available":1159305166848,"internally_reserved":0,"allocated":4030464,"data_stored":2991170,"data_compressed":171314,"data_compressed_allocated":245760,"data_compressed_original":1458176,"omap_allocated":19138,"internal_metadata":331855166},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":41650,"num_objects":40,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":40,"num_read_kb":52,"num_write":100,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003233"},"pg_stats":[{"pgid":"2.1f","version":"29'9","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:32.400697+0000","last_change":"2024-02-21T23:01:02.208441+0000","last_active":"2024-02-21T23:01:32.400697+0000","last_peered":"2024-02-21T23:01:32.400697+0000","last_clean":"2024-02-21T23:01:32.400697+0000","last_became_active":"2024-02-21T23:01:02.208124+0000","last_became_peered":"2024-02-21T23:01:02.208124+0000","last_unstale":"2024-02-21T23:01:32.400697+0000","last_undegraded":"2024-02-21T23:01:32.400697+0000","last_fullsized":"2024-02-21T23:01:32.400697+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:21:29.919968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7],"acting":[9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788787+0000","last_change":"2024-02-21T23:01:03.215149+0000","last_active":"2024-02-21T23:01:08.788787+0000","last_peered":"2024-02-21T23:01:08.788787+0000","last_clean":"2024-02-21T23:01:08.788787+0000","last_became_active":"2024-02-21T23:01:03.214170+0000","last_became_peered":"2024-02-21T23:01:03.214170+0000","last_unstale":"2024-02-21T23:01:08.788787+0000","last_undegraded":"2024-02-21T23:01:08.788787+0000","last_fullsized":"2024-02-21T23:01:08.788787+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:40:26.325368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787271+0000","last_change":"2024-02-21T23:01:07.276484+0000","last_active":"2024-02-21T23:01:08.787271+0000","last_peered":"2024-02-21T23:01:08.787271+0000","last_clean":"2024-02-21T23:01:08.787271+0000","last_became_active":"2024-02-21T23:01:07.276192+0000","last_became_peered":"2024-02-21T23:01:07.276192+0000","last_unstale":"2024-02-21T23:01:08.787271+0000","last_undegraded":"2024-02-21T23:01:08.787271+0000","last_fullsized":"2024-02-21T23:01:08.787271+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:20:59.894677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"29'2","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.789060+0000","last_change":"2024-02-21T23:01:02.221231+0000","last_active":"2024-02-21T23:01:08.789060+0000","last_peered":"2024-02-21T23:01:08.789060+0000","last_clean":"2024-02-21T23:01:08.789060+0000","last_became_active":"2024-02-21T23:01:02.220941+0000","last_became_peered":"2024-02-21T23:01:02.220941+0000","last_unstale":"2024-02-21T23:01:08.789060+0000","last_undegraded":"2024-02-21T23:01:08.789060+0000","last_fullsized":"2024-02-21T23:01:08.789060+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:17:06.353018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.790823+0000","last_change":"2024-02-21T23:01:03.219579+0000","last_active":"2024-02-21T23:01:08.790823+0000","last_peered":"2024-02-21T23:01:08.790823+0000","last_clean":"2024-02-21T23:01:08.790823+0000","last_became_active":"2024-02-21T23:01:03.219221+0000","last_became_peered":"2024-02-21T23:01:03.219221+0000","last_unstale":"2024-02-21T23:01:08.790823+0000","last_undegraded":"2024-02-21T23:01:08.790823+0000","last_fullsized":"2024-02-21T23:01:08.790823+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:41:55.485351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.260372+0000","last_change":"2024-02-21T23:01:07.268590+0000","last_active":"2024-02-21T23:01:08.260372+0000","last_peered":"2024-02-21T23:01:08.260372+0000","last_clean":"2024-02-21T23:01:08.260372+0000","last_became_active":"2024-02-21T23:01:07.268179+0000","last_became_peered":"2024-02-21T23:01:07.268179+0000","last_unstale":"2024-02-21T23:01:08.260372+0000","last_undegraded":"2024-02-21T23:01:08.260372+0000","last_fullsized":"2024-02-21T23:01:08.260372+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:20:59.894677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"29'4","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:32.393628+0000","last_change":"2024-02-21T23:01:02.208687+0000","last_active":"2024-02-21T23:01:32.393628+0000","last_peered":"2024-02-21T23:01:32.393628+0000","last_clean":"2024-02-21T23:01:32.393628+0000","last_became_active":"2024-02-21T23:01:02.208393+0000","last_became_peered":"2024-02-21T23:01:02.208393+0000","last_unstale":"2024-02-21T23:01:32.393628+0000","last_undegraded":"2024-02-21T23:01:32.393628+0000","last_fullsized":"2024-02-21T23:01:32.393628+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:41:54.477462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788050+0000","last_change":"2024-02-21T23:01:03.215676+0000","last_active":"2024-02-21T23:01:08.788050+0000","last_peered":"2024-02-21T23:01:08.788050+0000","last_clean":"2024-02-21T23:01:08.788050+0000","last_became_active":"2024-02-21T23:01:03.214733+0000","last_became_peered":"2024-02-21T23:01:03.214733+0000","last_unstale":"2024-02-21T23:01:08.788050+0000","last_undegraded":"2024-02-21T23:01:08.788050+0000","last_fullsized":"2024-02-21T23:01:08.788050+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:16.946152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.260361+0000","last_change":"2024-02-21T23:01:07.279763+0000","last_active":"2024-02-21T23:01:08.260361+0000","last_peered":"2024-02-21T23:01:08.260361+0000","last_clean":"2024-02-21T23:01:08.260361+0000","last_became_active":"2024-02-21T23:01:07.279360+0000","last_became_peered":"2024-02-21T23:01:07.279360+0000","last_unstale":"2024-02-21T23:01:08.260361+0000","last_undegraded":"2024-02-21T23:01:08.260361+0000","last_fullsized":"2024-02-21T23:01:08.260361+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:40:30.373445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.261319+0000","last_change":"2024-02-21T23:01:02.204774+0000","last_active":"2024-02-21T23:01:08.261319+0000","last_peered":"2024-02-21T23:01:08.261319+0000","last_clean":"2024-02-21T23:01:08.261319+0000","last_became_active":"2024-02-21T23:01:02.203992+0000","last_became_peered":"2024-02-21T23:01:02.203992+0000","last_unstale":"2024-02-21T23:01:08.261319+0000","last_undegraded":"2024-02-21T23:01:08.261319+0000","last_fullsized":"2024-02-21T23:01:08.261319+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:27:54.333439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1],"acting":[8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788339+0000","last_change":"2024-02-21T23:01:03.213022+0000","last_active":"2024-02-21T23:01:08.788339+0000","last_peered":"2024-02-21T23:01:08.788339+0000","last_clean":"2024-02-21T23:01:08.788339+0000","last_became_active":"2024-02-21T23:01:03.212702+0000","last_became_peered":"2024-02-21T23:01:03.212702+0000","last_unstale":"2024-02-21T23:01:08.788339+0000","last_undegraded":"2024-02-21T23:01:08.788339+0000","last_fullsized":"2024-02-21T23:01:08.788339+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:19:01.584139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.260441+0000","last_change":"2024-02-21T23:01:07.268800+0000","last_active":"2024-02-21T23:01:08.260441+0000","last_peered":"2024-02-21T23:01:08.260441+0000","last_clean":"2024-02-21T23:01:08.260441+0000","last_became_active":"2024-02-21T23:01:07.268357+0000","last_became_peered":"2024-02-21T23:01:07.268357+0000","last_unstale":"2024-02-21T23:01:08.260441+0000","last_undegraded":"2024-02-21T23:01:08.260441+0000","last_fullsized":"2024-02-21T23:01:08.260441+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:39:03.021559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787642+0000","last_change":"2024-02-21T23:01:03.213517+0000","last_active":"2024-02-21T23:01:08.787642+0000","last_peered":"2024-02-21T23:01:08.787642+0000","last_clean":"2024-02-21T23:01:08.787642+0000","last_became_active":"2024-02-21T23:01:03.213186+0000","last_became_peered":"2024-02-21T23:01:03.213186+0000","last_unstale":"2024-02-21T23:01:08.787642+0000","last_undegraded":"2024-02-21T23:01:08.787642+0000","last_fullsized":"2024-02-21T23:01:08.787642+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:40:26.325368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"29'4","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:31.383302+0000","last_change":"2024-02-21T23:01:02.208608+0000","last_active":"2024-02-21T23:01:31.383302+0000","last_peered":"2024-02-21T23:01:31.383302+0000","last_clean":"2024-02-21T23:01:31.383302+0000","last_became_active":"2024-02-21T23:01:02.208293+0000","last_became_peered":"2024-02-21T23:01:02.208293+0000","last_unstale":"2024-02-21T23:01:31.383302+0000","last_undegraded":"2024-02-21T23:01:31.383302+0000","last_fullsized":"2024-02-21T23:01:31.383302+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:58:23.554457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.260663+0000","last_change":"2024-02-21T23:01:07.651717+0000","last_active":"2024-02-21T23:01:08.260663+0000","last_peered":"2024-02-21T23:01:08.260663+0000","last_clean":"2024-02-21T23:01:08.260663+0000","last_became_active":"2024-02-21T23:01:07.651241+0000","last_became_peered":"2024-02-21T23:01:07.651241+0000","last_unstale":"2024-02-21T23:01:08.260663+0000","last_undegraded":"2024-02-21T23:01:08.260663+0000","last_fullsized":"2024-02-21T23:01:08.260663+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:54:44.380302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.791024+0000","last_change":"2024-02-21T23:01:03.221678+0000","last_active":"2024-02-21T23:01:08.791024+0000","last_peered":"2024-02-21T23:01:08.791024+0000","last_clean":"2024-02-21T23:01:08.791024+0000","last_became_active":"2024-02-21T23:01:03.219898+0000","last_became_peered":"2024-02-21T23:01:03.219898+0000","last_unstale":"2024-02-21T23:01:08.791024+0000","last_undegraded":"2024-02-21T23:01:08.791024+0000","last_fullsized":"2024-02-21T23:01:08.791024+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:47:19.366266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"29'1","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788675+0000","last_change":"2024-02-21T23:01:02.202866+0000","last_active":"2024-02-21T23:01:08.788675+0000","last_peered":"2024-02-21T23:01:08.788675+0000","last_clean":"2024-02-21T23:01:08.788675+0000","last_became_active":"2024-02-21T23:01:02.202585+0000","last_became_peered":"2024-02-21T23:01:02.202585+0000","last_unstale":"2024-02-21T23:01:08.788675+0000","last_undegraded":"2024-02-21T23:01:08.788675+0000","last_fullsized":"2024-02-21T23:01:08.788675+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:26:49.911102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"29'1","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:10.770295+0000","last_change":"2024-02-21T23:01:07.277000+0000","last_active":"2024-02-21T23:01:10.770295+0000","last_peered":"2024-02-21T23:01:10.770295+0000","last_clean":"2024-02-21T23:01:10.770295+0000","last_became_active":"2024-02-21T23:01:07.276577+0000","last_became_peered":"2024-02-21T23:01:07.276577+0000","last_unstale":"2024-02-21T23:01:10.770295+0000","last_undegraded":"2024-02-21T23:01:10.770295+0000","last_fullsized":"2024-02-21T23:01:10.770295+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:15:20.572234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787437+0000","last_change":"2024-02-21T23:01:03.219045+0000","last_active":"2024-02-21T23:01:08.787437+0000","last_peered":"2024-02-21T23:01:08.787437+0000","last_clean":"2024-02-21T23:01:08.787437+0000","last_became_active":"2024-02-21T23:01:03.218706+0000","last_became_peered":"2024-02-21T23:01:03.218706+0000","last_unstale":"2024-02-21T23:01:08.787437+0000","last_undegraded":"2024-02-21T23:01:08.787437+0000","last_fullsized":"2024-02-21T23:01:08.787437+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:41:55.485351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"29'3","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:31.386013+0000","last_change":"2024-02-21T23:01:02.208912+0000","last_active":"2024-02-21T23:01:31.386013+0000","last_peered":"2024-02-21T23:01:31.386013+0000","last_clean":"2024-02-21T23:01:31.386013+0000","last_became_active":"2024-02-21T23:01:02.208542+0000","last_became_peered":"2024-02-21T23:01:02.208542+0000","last_unstale":"2024-02-21T23:01:31.386013+0000","last_undegraded":"2024-02-21T23:01:31.386013+0000","last_fullsized":"2024-02-21T23:01:31.386013+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:02:11.724233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9],"acting":[3,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788774+0000","last_change":"2024-02-21T23:01:07.282882+0000","last_active":"2024-02-21T23:01:08.788774+0000","last_peered":"2024-02-21T23:01:08.788774+0000","last_clean":"2024-02-21T23:01:08.788774+0000","last_became_active":"2024-02-21T23:01:07.282506+0000","last_became_peered":"2024-02-21T23:01:07.282506+0000","last_unstale":"2024-02-21T23:01:08.788774+0000","last_undegraded":"2024-02-21T23:01:08.788774+0000","last_fullsized":"2024-02-21T23:01:08.788774+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:19:05.632217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.260935+0000","last_change":"2024-02-21T23:01:03.212206+0000","last_active":"2024-02-21T23:01:08.260935+0000","last_peered":"2024-02-21T23:01:08.260935+0000","last_clean":"2024-02-21T23:01:08.260935+0000","last_became_active":"2024-02-21T23:01:03.211919+0000","last_became_peered":"2024-02-21T23:01:03.211919+0000","last_unstale":"2024-02-21T23:01:08.260935+0000","last_undegraded":"2024-02-21T23:01:08.260935+0000","last_fullsized":"2024-02-21T23:01:08.260935+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:20:55.846599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"29'2","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:31.383055+0000","last_change":"2024-02-21T23:01:02.204071+0000","last_active":"2024-02-21T23:01:31.383055+0000","last_peered":"2024-02-21T23:01:31.383055+0000","last_clean":"2024-02-21T23:01:31.383055+0000","last_became_active":"2024-02-21T23:01:02.203761+0000","last_became_peered":"2024-02-21T23:01:02.203761+0000","last_unstale":"2024-02-21T23:01:31.383055+0000","last_undegraded":"2024-02-21T23:01:31.383055+0000","last_fullsized":"2024-02-21T23:01:31.383055+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:58:34.737670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.260696+0000","last_change":"2024-02-21T23:01:07.654580+0000","last_active":"2024-02-21T23:01:08.260696+0000","last_peered":"2024-02-21T23:01:08.260696+0000","last_clean":"2024-02-21T23:01:08.260696+0000","last_became_active":"2024-02-21T23:01:07.654124+0000","last_became_peered":"2024-02-21T23:01:07.654124+0000","last_unstale":"2024-02-21T23:01:08.260696+0000","last_undegraded":"2024-02-21T23:01:08.260696+0000","last_fullsized":"2024-02-21T23:01:08.260696+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:44:43.960074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.790389+0000","last_change":"2024-02-21T23:01:03.230134+0000","last_active":"2024-02-21T23:01:08.790389+0000","last_peered":"2024-02-21T23:01:08.790389+0000","last_clean":"2024-02-21T23:01:08.790389+0000","last_became_active":"2024-02-21T23:01:03.229873+0000","last_became_peered":"2024-02-21T23:01:03.229873+0000","last_unstale":"2024-02-21T23:01:08.790389+0000","last_undegraded":"2024-02-21T23:01:08.790389+0000","last_fullsized":"2024-02-21T23:01:08.790389+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:16.946152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"29'4","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:31.382861+0000","last_change":"2024-02-21T23:01:02.206586+0000","last_active":"2024-02-21T23:01:31.382861+0000","last_peered":"2024-02-21T23:01:31.382861+0000","last_clean":"2024-02-21T23:01:31.382861+0000","last_became_active":"2024-02-21T23:01:02.206230+0000","last_became_peered":"2024-02-21T23:01:02.206230+0000","last_unstale":"2024-02-21T23:01:31.382861+0000","last_undegraded":"2024-02-21T23:01:31.382861+0000","last_fullsized":"2024-02-21T23:01:31.382861+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:21:29.919968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11],"acting":[4,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788500+0000","last_change":"2024-02-21T23:01:07.252255+0000","last_active":"2024-02-21T23:01:08.788500+0000","last_peered":"2024-02-21T23:01:08.788500+0000","last_clean":"2024-02-21T23:01:08.788500+0000","last_became_active":"2024-02-21T23:01:07.251670+0000","last_became_peered":"2024-02-21T23:01:07.251670+0000","last_unstale":"2024-02-21T23:01:08.788500+0000","last_undegraded":"2024-02-21T23:01:08.788500+0000","last_fullsized":"2024-02-21T23:01:08.788500+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:39:03.021559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.789113+0000","last_change":"2024-02-21T23:01:03.207156+0000","last_active":"2024-02-21T23:01:08.789113+0000","last_peered":"2024-02-21T23:01:08.789113+0000","last_clean":"2024-02-21T23:01:08.789113+0000","last_became_active":"2024-02-21T23:01:03.206892+0000","last_became_peered":"2024-02-21T23:01:03.206892+0000","last_unstale":"2024-02-21T23:01:08.789113+0000","last_undegraded":"2024-02-21T23:01:08.789113+0000","last_fullsized":"2024-02-21T23:01:08.789113+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:19:01.584139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"29'5","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:34.216217+0000","last_change":"2024-02-21T23:01:02.209850+0000","last_active":"2024-02-21T23:01:34.216217+0000","last_peered":"2024-02-21T23:01:34.216217+0000","last_clean":"2024-02-21T23:01:34.216217+0000","last_became_active":"2024-02-21T23:01:02.209601+0000","last_became_peered":"2024-02-21T23:01:02.209601+0000","last_unstale":"2024-02-21T23:01:34.216217+0000","last_undegraded":"2024-02-21T23:01:34.216217+0000","last_fullsized":"2024-02-21T23:01:34.216217+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:36:44.497886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.789246+0000","last_change":"2024-02-21T23:01:07.651884+0000","last_active":"2024-02-21T23:01:08.789246+0000","last_peered":"2024-02-21T23:01:08.789246+0000","last_clean":"2024-02-21T23:01:08.789246+0000","last_became_active":"2024-02-21T23:01:07.651431+0000","last_became_peered":"2024-02-21T23:01:07.651431+0000","last_unstale":"2024-02-21T23:01:08.789246+0000","last_undegraded":"2024-02-21T23:01:08.789246+0000","last_fullsized":"2024-02-21T23:01:08.789246+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:37:06.063756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.263969+0000","last_change":"2024-02-21T23:01:03.221696+0000","last_active":"2024-02-21T23:01:08.263969+0000","last_peered":"2024-02-21T23:01:08.263969+0000","last_clean":"2024-02-21T23:01:08.263969+0000","last_became_active":"2024-02-21T23:01:03.221405+0000","last_became_peered":"2024-02-21T23:01:03.221405+0000","last_unstale":"2024-02-21T23:01:08.263969+0000","last_undegraded":"2024-02-21T23:01:08.263969+0000","last_fullsized":"2024-02-21T23:01:08.263969+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:45:29.610700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"29'1","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:31.383443+0000","last_change":"2024-02-21T23:01:02.221218+0000","last_active":"2024-02-21T23:01:31.383443+0000","last_peered":"2024-02-21T23:01:31.383443+0000","last_clean":"2024-02-21T23:01:31.383443+0000","last_became_active":"2024-02-21T23:01:02.220923+0000","last_became_peered":"2024-02-21T23:01:02.220923+0000","last_unstale":"2024-02-21T23:01:31.383443+0000","last_undegraded":"2024-02-21T23:01:31.383443+0000","last_fullsized":"2024-02-21T23:01:31.383443+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:15.938263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787672+0000","last_change":"2024-02-21T23:01:07.268952+0000","last_active":"2024-02-21T23:01:08.787672+0000","last_peered":"2024-02-21T23:01:08.787672+0000","last_clean":"2024-02-21T23:01:08.787672+0000","last_became_active":"2024-02-21T23:01:07.268210+0000","last_became_peered":"2024-02-21T23:01:07.268210+0000","last_unstale":"2024-02-21T23:01:08.787672+0000","last_undegraded":"2024-02-21T23:01:08.787672+0000","last_fullsized":"2024-02-21T23:01:08.787672+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:40:30.373445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.790112+0000","last_change":"2024-02-21T23:01:03.218386+0000","last_active":"2024-02-21T23:01:08.790112+0000","last_peered":"2024-02-21T23:01:08.790112+0000","last_clean":"2024-02-21T23:01:08.790112+0000","last_became_active":"2024-02-21T23:01:03.218081+0000","last_became_peered":"2024-02-21T23:01:03.218081+0000","last_unstale":"2024-02-21T23:01:08.790112+0000","last_undegraded":"2024-02-21T23:01:08.790112+0000","last_fullsized":"2024-02-21T23:01:08.790112+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:35:24.590398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788427+0000","last_change":"2024-02-21T23:01:02.207826+0000","last_active":"2024-02-21T23:01:08.788427+0000","last_peered":"2024-02-21T23:01:08.788427+0000","last_clean":"2024-02-21T23:01:08.788427+0000","last_became_active":"2024-02-21T23:01:02.206426+0000","last_became_peered":"2024-02-21T23:01:02.206426+0000","last_unstale":"2024-02-21T23:01:08.788427+0000","last_undegraded":"2024-02-21T23:01:08.788427+0000","last_fullsized":"2024-02-21T23:01:08.788427+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:17:06.353018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2],"acting":[9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.261110+0000","last_change":"2024-02-21T23:01:07.651876+0000","last_active":"2024-02-21T23:01:08.261110+0000","last_peered":"2024-02-21T23:01:08.261110+0000","last_clean":"2024-02-21T23:01:08.261110+0000","last_became_active":"2024-02-21T23:01:07.651384+0000","last_became_peered":"2024-02-21T23:01:07.651384+0000","last_unstale":"2024-02-21T23:01:08.261110+0000","last_undegraded":"2024-02-21T23:01:08.261110+0000","last_fullsized":"2024-02-21T23:01:08.261110+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:15:20.572234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.789861+0000","last_change":"2024-02-21T23:01:03.210500+0000","last_active":"2024-02-21T23:01:08.789861+0000","last_peered":"2024-02-21T23:01:08.789861+0000","last_clean":"2024-02-21T23:01:08.789861+0000","last_became_active":"2024-02-21T23:01:03.210123+0000","last_became_peered":"2024-02-21T23:01:03.210123+0000","last_unstale":"2024-02-21T23:01:08.789861+0000","last_undegraded":"2024-02-21T23:01:08.789861+0000","last_fullsized":"2024-02-21T23:01:08.789861+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:16.946152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4],"acting":[10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"29'1","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787791+0000","last_change":"2024-02-21T23:01:02.217455+0000","last_active":"2024-02-21T23:01:08.787791+0000","last_peered":"2024-02-21T23:01:08.787791+0000","last_clean":"2024-02-21T23:01:08.787791+0000","last_became_active":"2024-02-21T23:01:02.217128+0000","last_became_peered":"2024-02-21T23:01:02.217128+0000","last_unstale":"2024-02-21T23:01:08.787791+0000","last_undegraded":"2024-02-21T23:01:08.787791+0000","last_fullsized":"2024-02-21T23:01:08.787791+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:23:41.295647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.264021+0000","last_change":"2024-02-21T23:01:07.266837+0000","last_active":"2024-02-21T23:01:08.264021+0000","last_peered":"2024-02-21T23:01:08.264021+0000","last_clean":"2024-02-21T23:01:08.264021+0000","last_became_active":"2024-02-21T23:01:07.266376+0000","last_became_peered":"2024-02-21T23:01:07.266376+0000","last_unstale":"2024-02-21T23:01:08.264021+0000","last_undegraded":"2024-02-21T23:01:08.264021+0000","last_fullsized":"2024-02-21T23:01:08.264021+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:15:20.572234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787245+0000","last_change":"2024-02-21T23:01:03.212345+0000","last_active":"2024-02-21T23:01:08.787245+0000","last_peered":"2024-02-21T23:01:08.787245+0000","last_clean":"2024-02-21T23:01:08.787245+0000","last_became_active":"2024-02-21T23:01:03.212019+0000","last_became_peered":"2024-02-21T23:01:03.212019+0000","last_unstale":"2024-02-21T23:01:08.787245+0000","last_undegraded":"2024-02-21T23:01:08.787245+0000","last_fullsized":"2024-02-21T23:01:08.787245+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:20:55.846599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"29'4","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:34.401788+0000","last_change":"2024-02-21T23:01:02.219033+0000","last_active":"2024-02-21T23:01:34.401788+0000","last_peered":"2024-02-21T23:01:34.401788+0000","last_clean":"2024-02-21T23:01:34.401788+0000","last_became_active":"2024-02-21T23:01:02.218570+0000","last_became_peered":"2024-02-21T23:01:02.218570+0000","last_unstale":"2024-02-21T23:01:34.401788+0000","last_undegraded":"2024-02-21T23:01:34.401788+0000","last_fullsized":"2024-02-21T23:01:34.401788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:21:29.919968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.264680+0000","last_change":"2024-02-21T23:01:07.654407+0000","last_active":"2024-02-21T23:01:08.264680+0000","last_peered":"2024-02-21T23:01:08.264680+0000","last_clean":"2024-02-21T23:01:08.264680+0000","last_became_active":"2024-02-21T23:01:07.653745+0000","last_became_peered":"2024-02-21T23:01:07.653745+0000","last_unstale":"2024-02-21T23:01:08.264680+0000","last_undegraded":"2024-02-21T23:01:08.264680+0000","last_fullsized":"2024-02-21T23:01:08.264680+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:54:44.380302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.262891+0000","last_change":"2024-02-21T23:01:03.226352+0000","last_active":"2024-02-21T23:01:08.262891+0000","last_peered":"2024-02-21T23:01:08.262891+0000","last_clean":"2024-02-21T23:01:08.262891+0000","last_became_active":"2024-02-21T23:01:03.219834+0000","last_became_peered":"2024-02-21T23:01:03.219834+0000","last_unstale":"2024-02-21T23:01:08.262891+0000","last_undegraded":"2024-02-21T23:01:08.262891+0000","last_fullsized":"2024-02-21T23:01:08.262891+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:16.946152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"29'3","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:32.400219+0000","last_change":"2024-02-21T23:01:02.207052+0000","last_active":"2024-02-21T23:01:32.400219+0000","last_peered":"2024-02-21T23:01:32.400219+0000","last_clean":"2024-02-21T23:01:32.400219+0000","last_became_active":"2024-02-21T23:01:02.206146+0000","last_became_peered":"2024-02-21T23:01:02.206146+0000","last_unstale":"2024-02-21T23:01:32.400219+0000","last_undegraded":"2024-02-21T23:01:32.400219+0000","last_fullsized":"2024-02-21T23:01:32.400219+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:26:49.911102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788291+0000","last_change":"2024-02-21T23:01:07.654449+0000","last_active":"2024-02-21T23:01:08.788291+0000","last_peered":"2024-02-21T23:01:08.788291+0000","last_clean":"2024-02-21T23:01:08.788291+0000","last_became_active":"2024-02-21T23:01:07.654106+0000","last_became_peered":"2024-02-21T23:01:07.654106+0000","last_unstale":"2024-02-21T23:01:08.788291+0000","last_undegraded":"2024-02-21T23:01:08.788291+0000","last_fullsized":"2024-02-21T23:01:08.788291+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:13:22.732077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788911+0000","last_change":"2024-02-21T23:01:03.209260+0000","last_active":"2024-02-21T23:01:08.788911+0000","last_peered":"2024-02-21T23:01:08.788911+0000","last_clean":"2024-02-21T23:01:08.788911+0000","last_became_active":"2024-02-21T23:01:03.209007+0000","last_became_peered":"2024-02-21T23:01:03.209007+0000","last_unstale":"2024-02-21T23:01:08.788911+0000","last_undegraded":"2024-02-21T23:01:08.788911+0000","last_fullsized":"2024-02-21T23:01:08.788911+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:54:32.196725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"29'3","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:33.394582+0000","last_change":"2024-02-21T23:01:02.203395+0000","last_active":"2024-02-21T23:01:33.394582+0000","last_peered":"2024-02-21T23:01:33.394582+0000","last_clean":"2024-02-21T23:01:33.394582+0000","last_became_active":"2024-02-21T23:01:02.203066+0000","last_became_peered":"2024-02-21T23:01:02.203066+0000","last_unstale":"2024-02-21T23:01:33.394582+0000","last_undegraded":"2024-02-21T23:01:33.394582+0000","last_fullsized":"2024-02-21T23:01:33.394582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:26:49.911102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":211,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787659+0000","last_change":"2024-02-21T23:00:58.830752+0000","last_active":"2024-02-21T23:01:08.787659+0000","last_peered":"2024-02-21T23:01:08.787659+0000","last_clean":"2024-02-21T23:01:08.787659+0000","last_became_active":"2024-02-21T23:00:58.830472+0000","last_became_peered":"2024-02-21T23:00:58.830472+0000","last_unstale":"2024-02-21T23:01:08.787659+0000","last_undegraded":"2024-02-21T23:01:08.787659+0000","last_fullsized":"2024-02-21T23:01:08.787659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:00:57.811198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:00:57.811198+0000","last_clean_scrub_stamp":"2024-02-21T23:00:57.811198+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:58:31.374266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"29'1","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:10.774025+0000","last_change":"2024-02-21T23:01:07.276992+0000","last_active":"2024-02-21T23:01:10.774025+0000","last_peered":"2024-02-21T23:01:10.774025+0000","last_clean":"2024-02-21T23:01:10.774025+0000","last_became_active":"2024-02-21T23:01:07.276489+0000","last_became_peered":"2024-02-21T23:01:07.276489+0000","last_unstale":"2024-02-21T23:01:10.774025+0000","last_undegraded":"2024-02-21T23:01:10.774025+0000","last_fullsized":"2024-02-21T23:01:10.774025+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:02:35.072200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788021+0000","last_change":"2024-02-21T23:01:03.216192+0000","last_active":"2024-02-21T23:01:08.788021+0000","last_peered":"2024-02-21T23:01:08.788021+0000","last_clean":"2024-02-21T23:01:08.788021+0000","last_became_active":"2024-02-21T23:01:03.215904+0000","last_became_peered":"2024-02-21T23:01:03.215904+0000","last_unstale":"2024-02-21T23:01:08.788021+0000","last_undegraded":"2024-02-21T23:01:08.788021+0000","last_fullsized":"2024-02-21T23:01:08.788021+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:15:16.524157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"29'3","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:32.394144+0000","last_change":"2024-02-21T23:01:02.207406+0000","last_active":"2024-02-21T23:01:32.394144+0000","last_peered":"2024-02-21T23:01:32.394144+0000","last_clean":"2024-02-21T23:01:32.394144+0000","last_became_active":"2024-02-21T23:01:02.206219+0000","last_became_peered":"2024-02-21T23:01:02.206219+0000","last_unstale":"2024-02-21T23:01:32.394144+0000","last_undegraded":"2024-02-21T23:01:32.394144+0000","last_fullsized":"2024-02-21T23:01:32.394144+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:21:29.919968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11],"acting":[2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787626+0000","last_change":"2024-02-21T23:01:07.265822+0000","last_active":"2024-02-21T23:01:08.787626+0000","last_peered":"2024-02-21T23:01:08.787626+0000","last_clean":"2024-02-21T23:01:08.787626+0000","last_became_active":"2024-02-21T23:01:07.265401+0000","last_became_peered":"2024-02-21T23:01:07.265401+0000","last_unstale":"2024-02-21T23:01:08.787626+0000","last_undegraded":"2024-02-21T23:01:08.787626+0000","last_fullsized":"2024-02-21T23:01:08.787626+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:47:23.414344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787838+0000","last_change":"2024-02-21T23:01:03.220586+0000","last_active":"2024-02-21T23:01:08.787838+0000","last_peered":"2024-02-21T23:01:08.787838+0000","last_clean":"2024-02-21T23:01:08.787838+0000","last_became_active":"2024-02-21T23:01:03.220349+0000","last_became_peered":"2024-02-21T23:01:03.220349+0000","last_unstale":"2024-02-21T23:01:08.787838+0000","last_undegraded":"2024-02-21T23:01:08.787838+0000","last_fullsized":"2024-02-21T23:01:08.787838+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:20:55.846599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788533+0000","last_change":"2024-02-21T23:01:02.206319+0000","last_active":"2024-02-21T23:01:08.788533+0000","last_peered":"2024-02-21T23:01:08.788533+0000","last_clean":"2024-02-21T23:01:08.788533+0000","last_became_active":"2024-02-21T23:01:02.205747+0000","last_became_peered":"2024-02-21T23:01:02.205747+0000","last_unstale":"2024-02-21T23:01:08.788533+0000","last_undegraded":"2024-02-21T23:01:08.788533+0000","last_fullsized":"2024-02-21T23:01:08.788533+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:10:09.680115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10],"acting":[5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.789983+0000","last_change":"2024-02-21T23:01:07.280592+0000","last_active":"2024-02-21T23:01:08.789983+0000","last_peered":"2024-02-21T23:01:08.789983+0000","last_clean":"2024-02-21T23:01:08.789983+0000","last_became_active":"2024-02-21T23:01:07.280193+0000","last_became_peered":"2024-02-21T23:01:07.280193+0000","last_unstale":"2024-02-21T23:01:08.789983+0000","last_undegraded":"2024-02-21T23:01:08.789983+0000","last_fullsized":"2024-02-21T23:01:08.789983+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:40:30.373445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788267+0000","last_change":"2024-02-21T23:01:03.216834+0000","last_active":"2024-02-21T23:01:08.788267+0000","last_peered":"2024-02-21T23:01:08.788267+0000","last_clean":"2024-02-21T23:01:08.788267+0000","last_became_active":"2024-02-21T23:01:03.216578+0000","last_became_peered":"2024-02-21T23:01:03.216578+0000","last_unstale":"2024-02-21T23:01:08.788267+0000","last_undegraded":"2024-02-21T23:01:08.788267+0000","last_fullsized":"2024-02-21T23:01:08.788267+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:37:02.015678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.264532+0000","last_change":"2024-02-21T23:01:02.220913+0000","last_active":"2024-02-21T23:01:08.264532+0000","last_peered":"2024-02-21T23:01:08.264532+0000","last_clean":"2024-02-21T23:01:08.264532+0000","last_became_active":"2024-02-21T23:01:02.220554+0000","last_became_peered":"2024-02-21T23:01:02.220554+0000","last_unstale":"2024-02-21T23:01:08.264532+0000","last_undegraded":"2024-02-21T23:01:08.264532+0000","last_fullsized":"2024-02-21T23:01:08.264532+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:36:44.497886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787182+0000","last_change":"2024-02-21T23:01:07.257431+0000","last_active":"2024-02-21T23:01:08.787182+0000","last_peered":"2024-02-21T23:01:08.787182+0000","last_clean":"2024-02-21T23:01:08.787182+0000","last_became_active":"2024-02-21T23:01:07.257011+0000","last_became_peered":"2024-02-21T23:01:07.257011+0000","last_unstale":"2024-02-21T23:01:08.787182+0000","last_undegraded":"2024-02-21T23:01:08.787182+0000","last_fullsized":"2024-02-21T23:01:08.787182+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:44:43.960074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787848+0000","last_change":"2024-02-21T23:01:03.211792+0000","last_active":"2024-02-21T23:01:08.787848+0000","last_peered":"2024-02-21T23:01:08.787848+0000","last_clean":"2024-02-21T23:01:08.787848+0000","last_became_active":"2024-02-21T23:01:03.211467+0000","last_became_peered":"2024-02-21T23:01:03.211467+0000","last_unstale":"2024-02-21T23:01:08.787848+0000","last_undegraded":"2024-02-21T23:01:08.787848+0000","last_fullsized":"2024-02-21T23:01:08.787848+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:54:32.196725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"29'2","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:33.392458+0000","last_change":"2024-02-21T23:01:02.211763+0000","last_active":"2024-02-21T23:01:33.392458+0000","last_peered":"2024-02-21T23:01:33.392458+0000","last_clean":"2024-02-21T23:01:33.392458+0000","last_became_active":"2024-02-21T23:01:02.211470+0000","last_became_peered":"2024-02-21T23:01:02.211470+0000","last_unstale":"2024-02-21T23:01:33.392458+0000","last_undegraded":"2024-02-21T23:01:33.392458+0000","last_fullsized":"2024-02-21T23:01:33.392458+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:23:41.295647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5],"acting":[8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787817+0000","last_change":"2024-02-21T23:01:07.269076+0000","last_active":"2024-02-21T23:01:08.787817+0000","last_peered":"2024-02-21T23:01:08.787817+0000","last_clean":"2024-02-21T23:01:08.787817+0000","last_became_active":"2024-02-21T23:01:07.268681+0000","last_became_peered":"2024-02-21T23:01:07.268681+0000","last_unstale":"2024-02-21T23:01:08.787817+0000","last_undegraded":"2024-02-21T23:01:08.787817+0000","last_fullsized":"2024-02-21T23:01:08.787817+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:02:35.072200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787945+0000","last_change":"2024-02-21T23:01:03.212943+0000","last_active":"2024-02-21T23:01:08.787945+0000","last_peered":"2024-02-21T23:01:08.787945+0000","last_clean":"2024-02-21T23:01:08.787945+0000","last_became_active":"2024-02-21T23:01:03.212634+0000","last_became_peered":"2024-02-21T23:01:03.212634+0000","last_unstale":"2024-02-21T23:01:08.787945+0000","last_undegraded":"2024-02-21T23:01:08.787945+0000","last_fullsized":"2024-02-21T23:01:08.787945+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:07:50.626867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"29'15","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:32.399647+0000","last_change":"2024-02-21T23:01:02.221957+0000","last_active":"2024-02-21T23:01:32.399647+0000","last_peered":"2024-02-21T23:01:32.399647+0000","last_clean":"2024-02-21T23:01:32.399647+0000","last_became_active":"2024-02-21T23:01:02.221642+0000","last_became_peered":"2024-02-21T23:01:02.221642+0000","last_unstale":"2024-02-21T23:01:32.399647+0000","last_undegraded":"2024-02-21T23:01:32.399647+0000","last_fullsized":"2024-02-21T23:01:32.399647+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:10:09.680115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.264659+0000","last_change":"2024-02-21T23:01:07.268330+0000","last_active":"2024-02-21T23:01:08.264659+0000","last_peered":"2024-02-21T23:01:08.264659+0000","last_clean":"2024-02-21T23:01:08.264659+0000","last_became_active":"2024-02-21T23:01:07.267874+0000","last_became_peered":"2024-02-21T23:01:07.267874+0000","last_unstale":"2024-02-21T23:01:08.264659+0000","last_undegraded":"2024-02-21T23:01:08.264659+0000","last_fullsized":"2024-02-21T23:01:08.264659+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:37:06.063756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787335+0000","last_change":"2024-02-21T23:01:03.216774+0000","last_active":"2024-02-21T23:01:08.787335+0000","last_peered":"2024-02-21T23:01:08.787335+0000","last_clean":"2024-02-21T23:01:08.787335+0000","last_became_active":"2024-02-21T23:01:03.216466+0000","last_became_peered":"2024-02-21T23:01:03.216466+0000","last_unstale":"2024-02-21T23:01:08.787335+0000","last_undegraded":"2024-02-21T23:01:08.787335+0000","last_fullsized":"2024-02-21T23:01:08.787335+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:07:50.626867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"29'3","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:34.402391+0000","last_change":"2024-02-21T23:01:02.199060+0000","last_active":"2024-02-21T23:01:34.402391+0000","last_peered":"2024-02-21T23:01:34.402391+0000","last_clean":"2024-02-21T23:01:34.402391+0000","last_became_active":"2024-02-21T23:01:02.198709+0000","last_became_peered":"2024-02-21T23:01:02.198709+0000","last_unstale":"2024-02-21T23:01:34.402391+0000","last_undegraded":"2024-02-21T23:01:34.402391+0000","last_fullsized":"2024-02-21T23:01:34.402391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:36:44.497886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788751+0000","last_change":"2024-02-21T23:01:07.278031+0000","last_active":"2024-02-21T23:01:08.788751+0000","last_peered":"2024-02-21T23:01:08.788751+0000","last_clean":"2024-02-21T23:01:08.788751+0000","last_became_active":"2024-02-21T23:01:07.277289+0000","last_became_peered":"2024-02-21T23:01:07.277289+0000","last_unstale":"2024-02-21T23:01:08.788751+0000","last_undegraded":"2024-02-21T23:01:08.788751+0000","last_fullsized":"2024-02-21T23:01:08.788751+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:07:54.674944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787653+0000","last_change":"2024-02-21T23:01:03.214805+0000","last_active":"2024-02-21T23:01:08.787653+0000","last_peered":"2024-02-21T23:01:08.787653+0000","last_clean":"2024-02-21T23:01:08.787653+0000","last_became_active":"2024-02-21T23:01:03.214507+0000","last_became_peered":"2024-02-21T23:01:03.214507+0000","last_unstale":"2024-02-21T23:01:08.787653+0000","last_undegraded":"2024-02-21T23:01:08.787653+0000","last_fullsized":"2024-02-21T23:01:08.787653+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:38:58.973481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"29'3","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:31.386164+0000","last_change":"2024-02-21T23:01:02.209351+0000","last_active":"2024-02-21T23:01:31.386164+0000","last_peered":"2024-02-21T23:01:31.386164+0000","last_clean":"2024-02-21T23:01:31.386164+0000","last_became_active":"2024-02-21T23:01:02.208990+0000","last_became_peered":"2024-02-21T23:01:02.208990+0000","last_unstale":"2024-02-21T23:01:31.386164+0000","last_undegraded":"2024-02-21T23:01:31.386164+0000","last_fullsized":"2024-02-21T23:01:31.386164+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:36:44.497886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787720+0000","last_change":"2024-02-21T23:01:07.280069+0000","last_active":"2024-02-21T23:01:08.787720+0000","last_peered":"2024-02-21T23:01:08.787720+0000","last_clean":"2024-02-21T23:01:08.787720+0000","last_became_active":"2024-02-21T23:01:07.279657+0000","last_became_peered":"2024-02-21T23:01:07.279657+0000","last_unstale":"2024-02-21T23:01:08.787720+0000","last_undegraded":"2024-02-21T23:01:08.787720+0000","last_fullsized":"2024-02-21T23:01:08.787720+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:19:05.632217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.263316+0000","last_change":"2024-02-21T23:01:03.226321+0000","last_active":"2024-02-21T23:01:08.263316+0000","last_peered":"2024-02-21T23:01:08.263316+0000","last_clean":"2024-02-21T23:01:08.263316+0000","last_became_active":"2024-02-21T23:01:03.224451+0000","last_became_peered":"2024-02-21T23:01:03.224451+0000","last_unstale":"2024-02-21T23:01:08.263316+0000","last_undegraded":"2024-02-21T23:01:08.263316+0000","last_fullsized":"2024-02-21T23:01:08.263316+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:35:24.590398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"29'6","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:32.393944+0000","last_change":"2024-02-21T23:01:02.203410+0000","last_active":"2024-02-21T23:01:32.393944+0000","last_peered":"2024-02-21T23:01:32.393944+0000","last_clean":"2024-02-21T23:01:32.393944+0000","last_became_active":"2024-02-21T23:01:02.203081+0000","last_became_peered":"2024-02-21T23:01:02.203081+0000","last_unstale":"2024-02-21T23:01:32.393944+0000","last_undegraded":"2024-02-21T23:01:32.393944+0000","last_fullsized":"2024-02-21T23:01:32.393944+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:36:44.497886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10],"acting":[2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788275+0000","last_change":"2024-02-21T23:01:07.268810+0000","last_active":"2024-02-21T23:01:08.788275+0000","last_peered":"2024-02-21T23:01:08.788275+0000","last_clean":"2024-02-21T23:01:08.788275+0000","last_became_active":"2024-02-21T23:01:07.268436+0000","last_became_peered":"2024-02-21T23:01:07.268436+0000","last_unstale":"2024-02-21T23:01:08.788275+0000","last_undegraded":"2024-02-21T23:01:08.788275+0000","last_fullsized":"2024-02-21T23:01:08.788275+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:10:53.452033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.261462+0000","last_change":"2024-02-21T23:01:03.216176+0000","last_active":"2024-02-21T23:01:08.261462+0000","last_peered":"2024-02-21T23:01:08.261462+0000","last_clean":"2024-02-21T23:01:08.261462+0000","last_became_active":"2024-02-21T23:01:03.215888+0000","last_became_peered":"2024-02-21T23:01:03.215888+0000","last_unstale":"2024-02-21T23:01:08.261462+0000","last_undegraded":"2024-02-21T23:01:08.261462+0000","last_fullsized":"2024-02-21T23:01:08.261462+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:07:50.626867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"29'23","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:35.444056+0000","last_change":"2024-02-21T23:01:02.204595+0000","last_active":"2024-02-21T23:01:35.444056+0000","last_peered":"2024-02-21T23:01:35.444056+0000","last_clean":"2024-02-21T23:01:35.444056+0000","last_became_active":"2024-02-21T23:01:02.204123+0000","last_became_peered":"2024-02-21T23:01:02.204123+0000","last_unstale":"2024-02-21T23:01:35.444056+0000","last_undegraded":"2024-02-21T23:01:35.444056+0000","last_fullsized":"2024-02-21T23:01:35.444056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:36:44.497886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41910,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":9,"num_read_kb":27,"num_write":24,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1],"acting":[10,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788601+0000","last_change":"2024-02-21T23:01:07.275187+0000","last_active":"2024-02-21T23:01:08.788601+0000","last_peered":"2024-02-21T23:01:08.788601+0000","last_clean":"2024-02-21T23:01:08.788601+0000","last_became_active":"2024-02-21T23:01:07.265618+0000","last_became_peered":"2024-02-21T23:01:07.265618+0000","last_unstale":"2024-02-21T23:01:08.788601+0000","last_undegraded":"2024-02-21T23:01:08.788601+0000","last_fullsized":"2024-02-21T23:01:08.788601+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:47:23.414344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788154+0000","last_change":"2024-02-21T23:01:03.216300+0000","last_active":"2024-02-21T23:01:08.788154+0000","last_peered":"2024-02-21T23:01:08.788154+0000","last_clean":"2024-02-21T23:01:08.788154+0000","last_became_active":"2024-02-21T23:01:03.214580+0000","last_became_peered":"2024-02-21T23:01:03.214580+0000","last_unstale":"2024-02-21T23:01:08.788154+0000","last_undegraded":"2024-02-21T23:01:08.788154+0000","last_fullsized":"2024-02-21T23:01:08.788154+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:41:55.485351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8],"acting":[1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"29'4","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:31.383505+0000","last_change":"2024-02-21T23:01:02.222064+0000","last_active":"2024-02-21T23:01:31.383505+0000","last_peered":"2024-02-21T23:01:31.383505+0000","last_clean":"2024-02-21T23:01:31.383505+0000","last_became_active":"2024-02-21T23:01:02.221735+0000","last_became_peered":"2024-02-21T23:01:02.221735+0000","last_unstale":"2024-02-21T23:01:31.383505+0000","last_undegraded":"2024-02-21T23:01:31.383505+0000","last_fullsized":"2024-02-21T23:01:31.383505+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:23:41.295647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.260510+0000","last_change":"2024-02-21T23:01:07.276469+0000","last_active":"2024-02-21T23:01:08.260510+0000","last_peered":"2024-02-21T23:01:08.260510+0000","last_clean":"2024-02-21T23:01:08.260510+0000","last_became_active":"2024-02-21T23:01:07.275982+0000","last_became_peered":"2024-02-21T23:01:07.275982+0000","last_unstale":"2024-02-21T23:01:08.260510+0000","last_undegraded":"2024-02-21T23:01:08.260510+0000","last_fullsized":"2024-02-21T23:01:08.260510+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:37:06.063756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.790923+0000","last_change":"2024-02-21T23:01:03.229449+0000","last_active":"2024-02-21T23:01:08.790923+0000","last_peered":"2024-02-21T23:01:08.790923+0000","last_clean":"2024-02-21T23:01:08.790923+0000","last_became_active":"2024-02-21T23:01:03.229193+0000","last_became_peered":"2024-02-21T23:01:03.229193+0000","last_unstale":"2024-02-21T23:01:08.790923+0000","last_undegraded":"2024-02-21T23:01:08.790923+0000","last_fullsized":"2024-02-21T23:01:08.790923+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:35:24.590398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"29'2","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:31.382240+0000","last_change":"2024-02-21T23:01:02.197598+0000","last_active":"2024-02-21T23:01:31.382240+0000","last_peered":"2024-02-21T23:01:31.382240+0000","last_clean":"2024-02-21T23:01:31.382240+0000","last_became_active":"2024-02-21T23:01:02.197275+0000","last_became_peered":"2024-02-21T23:01:02.197275+0000","last_unstale":"2024-02-21T23:01:31.382240+0000","last_undegraded":"2024-02-21T23:01:31.382240+0000","last_fullsized":"2024-02-21T23:01:31.382240+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:36:44.497886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788046+0000","last_change":"2024-02-21T23:01:07.278576+0000","last_active":"2024-02-21T23:01:08.788046+0000","last_peered":"2024-02-21T23:01:08.788046+0000","last_clean":"2024-02-21T23:01:08.788046+0000","last_became_active":"2024-02-21T23:01:07.276078+0000","last_became_peered":"2024-02-21T23:01:07.276078+0000","last_unstale":"2024-02-21T23:01:08.788046+0000","last_undegraded":"2024-02-21T23:01:08.788046+0000","last_fullsized":"2024-02-21T23:01:08.788046+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:45:33.658778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788387+0000","last_change":"2024-02-21T23:01:03.215454+0000","last_active":"2024-02-21T23:01:08.788387+0000","last_peered":"2024-02-21T23:01:08.788387+0000","last_clean":"2024-02-21T23:01:08.788387+0000","last_became_active":"2024-02-21T23:01:03.215004+0000","last_became_peered":"2024-02-21T23:01:03.215004+0000","last_unstale":"2024-02-21T23:01:08.788387+0000","last_undegraded":"2024-02-21T23:01:08.788387+0000","last_fullsized":"2024-02-21T23:01:08.788387+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:27:55.341328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"29'3","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:34.398547+0000","last_change":"2024-02-21T23:01:02.207663+0000","last_active":"2024-02-21T23:01:34.398547+0000","last_peered":"2024-02-21T23:01:34.398547+0000","last_clean":"2024-02-21T23:01:34.398547+0000","last_became_active":"2024-02-21T23:01:02.207349+0000","last_became_peered":"2024-02-21T23:01:02.207349+0000","last_unstale":"2024-02-21T23:01:34.398547+0000","last_undegraded":"2024-02-21T23:01:34.398547+0000","last_fullsized":"2024-02-21T23:01:34.398547+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:21:29.919968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5],"acting":[10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.790535+0000","last_change":"2024-02-21T23:01:07.268655+0000","last_active":"2024-02-21T23:01:08.790535+0000","last_peered":"2024-02-21T23:01:08.790535+0000","last_clean":"2024-02-21T23:01:08.790535+0000","last_became_active":"2024-02-21T23:01:07.268193+0000","last_became_peered":"2024-02-21T23:01:07.268193+0000","last_unstale":"2024-02-21T23:01:08.790535+0000","last_undegraded":"2024-02-21T23:01:08.790535+0000","last_fullsized":"2024-02-21T23:01:08.790535+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:54:44.380302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.790242+0000","last_change":"2024-02-21T23:01:07.271441+0000","last_active":"2024-02-21T23:01:08.790242+0000","last_peered":"2024-02-21T23:01:08.790242+0000","last_clean":"2024-02-21T23:01:08.790242+0000","last_became_active":"2024-02-21T23:01:07.271175+0000","last_became_peered":"2024-02-21T23:01:07.271175+0000","last_unstale":"2024-02-21T23:01:08.790242+0000","last_undegraded":"2024-02-21T23:01:08.790242+0000","last_fullsized":"2024-02-21T23:01:08.790242+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:20:59.894677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788169+0000","last_change":"2024-02-21T23:01:03.210855+0000","last_active":"2024-02-21T23:01:08.788169+0000","last_peered":"2024-02-21T23:01:08.788169+0000","last_clean":"2024-02-21T23:01:08.788169+0000","last_became_active":"2024-02-21T23:01:03.210599+0000","last_became_peered":"2024-02-21T23:01:03.210599+0000","last_unstale":"2024-02-21T23:01:08.788169+0000","last_undegraded":"2024-02-21T23:01:08.788169+0000","last_fullsized":"2024-02-21T23:01:08.788169+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:27:55.341328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"29'1","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788133+0000","last_change":"2024-02-21T23:01:02.204603+0000","last_active":"2024-02-21T23:01:08.788133+0000","last_peered":"2024-02-21T23:01:08.788133+0000","last_clean":"2024-02-21T23:01:08.788133+0000","last_became_active":"2024-02-21T23:01:02.204304+0000","last_became_peered":"2024-02-21T23:01:02.204304+0000","last_unstale":"2024-02-21T23:01:08.788133+0000","last_undegraded":"2024-02-21T23:01:08.788133+0000","last_fullsized":"2024-02-21T23:01:08.788133+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:58:23.554457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787929+0000","last_change":"2024-02-21T23:01:07.284000+0000","last_active":"2024-02-21T23:01:08.787929+0000","last_peered":"2024-02-21T23:01:08.787929+0000","last_clean":"2024-02-21T23:01:08.787929+0000","last_became_active":"2024-02-21T23:01:07.283568+0000","last_became_peered":"2024-02-21T23:01:07.283568+0000","last_unstale":"2024-02-21T23:01:08.787929+0000","last_undegraded":"2024-02-21T23:01:08.787929+0000","last_fullsized":"2024-02-21T23:01:08.787929+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:20:59.894677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.789445+0000","last_change":"2024-02-21T23:01:03.208483+0000","last_active":"2024-02-21T23:01:08.789445+0000","last_peered":"2024-02-21T23:01:08.789445+0000","last_clean":"2024-02-21T23:01:08.789445+0000","last_became_active":"2024-02-21T23:01:03.208141+0000","last_became_peered":"2024-02-21T23:01:03.208141+0000","last_unstale":"2024-02-21T23:01:08.789445+0000","last_undegraded":"2024-02-21T23:01:08.789445+0000","last_fullsized":"2024-02-21T23:01:08.789445+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:35:24.590398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"29'2","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:32.395096+0000","last_change":"2024-02-21T23:01:02.218826+0000","last_active":"2024-02-21T23:01:32.395096+0000","last_peered":"2024-02-21T23:01:32.395096+0000","last_clean":"2024-02-21T23:01:32.395096+0000","last_became_active":"2024-02-21T23:01:02.218499+0000","last_became_peered":"2024-02-21T23:01:02.218499+0000","last_unstale":"2024-02-21T23:01:32.395096+0000","last_undegraded":"2024-02-21T23:01:32.395096+0000","last_fullsized":"2024-02-21T23:01:32.395096+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:17:06.353018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"29'3","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:32.398649+0000","last_change":"2024-02-21T23:01:02.209061+0000","last_active":"2024-02-21T23:01:32.398649+0000","last_peered":"2024-02-21T23:01:32.398649+0000","last_clean":"2024-02-21T23:01:32.398649+0000","last_became_active":"2024-02-21T23:01:02.208779+0000","last_became_peered":"2024-02-21T23:01:02.208779+0000","last_unstale":"2024-02-21T23:01:32.398649+0000","last_undegraded":"2024-02-21T23:01:32.398649+0000","last_fullsized":"2024-02-21T23:01:32.398649+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:17:06.353018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8],"acting":[10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787944+0000","last_change":"2024-02-21T23:01:03.212873+0000","last_active":"2024-02-21T23:01:08.787944+0000","last_peered":"2024-02-21T23:01:08.787944+0000","last_clean":"2024-02-21T23:01:08.787944+0000","last_became_active":"2024-02-21T23:01:03.212560+0000","last_became_peered":"2024-02-21T23:01:03.212560+0000","last_unstale":"2024-02-21T23:01:08.787944+0000","last_undegraded":"2024-02-21T23:01:08.787944+0000","last_fullsized":"2024-02-21T23:01:08.787944+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:47:19.366266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788832+0000","last_change":"2024-02-21T23:01:07.269266+0000","last_active":"2024-02-21T23:01:08.788832+0000","last_peered":"2024-02-21T23:01:08.788832+0000","last_clean":"2024-02-21T23:01:08.788832+0000","last_became_active":"2024-02-21T23:01:07.267796+0000","last_became_peered":"2024-02-21T23:01:07.267796+0000","last_unstale":"2024-02-21T23:01:08.788832+0000","last_undegraded":"2024-02-21T23:01:08.788832+0000","last_fullsized":"2024-02-21T23:01:08.788832+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:37:06.063756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"29'6","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:34.399654+0000","last_change":"2024-02-21T23:01:02.206398+0000","last_active":"2024-02-21T23:01:34.399654+0000","last_peered":"2024-02-21T23:01:34.399654+0000","last_clean":"2024-02-21T23:01:34.399654+0000","last_became_active":"2024-02-21T23:01:02.206069+0000","last_became_peered":"2024-02-21T23:01:02.206069+0000","last_unstale":"2024-02-21T23:01:34.399654+0000","last_undegraded":"2024-02-21T23:01:34.399654+0000","last_fullsized":"2024-02-21T23:01:34.399654+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:26:49.911102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1017,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.261164+0000","last_change":"2024-02-21T23:01:03.221228+0000","last_active":"2024-02-21T23:01:08.261164+0000","last_peered":"2024-02-21T23:01:08.261164+0000","last_clean":"2024-02-21T23:01:08.261164+0000","last_became_active":"2024-02-21T23:01:03.220900+0000","last_became_peered":"2024-02-21T23:01:03.220900+0000","last_unstale":"2024-02-21T23:01:08.261164+0000","last_undegraded":"2024-02-21T23:01:08.261164+0000","last_fullsized":"2024-02-21T23:01:08.261164+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:40:26.325368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9],"acting":[8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788794+0000","last_change":"2024-02-21T23:01:07.257004+0000","last_active":"2024-02-21T23:01:08.788794+0000","last_peered":"2024-02-21T23:01:08.788794+0000","last_clean":"2024-02-21T23:01:08.788794+0000","last_became_active":"2024-02-21T23:01:07.256474+0000","last_became_peered":"2024-02-21T23:01:07.256474+0000","last_unstale":"2024-02-21T23:01:08.788794+0000","last_undegraded":"2024-02-21T23:01:08.788794+0000","last_fullsized":"2024-02-21T23:01:08.788794+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:15:20.572234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787395+0000","last_change":"2024-02-21T23:01:03.215942+0000","last_active":"2024-02-21T23:01:08.787395+0000","last_peered":"2024-02-21T23:01:08.787395+0000","last_clean":"2024-02-21T23:01:08.787395+0000","last_became_active":"2024-02-21T23:01:03.215461+0000","last_became_peered":"2024-02-21T23:01:03.215461+0000","last_unstale":"2024-02-21T23:01:08.787395+0000","last_undegraded":"2024-02-21T23:01:08.787395+0000","last_fullsized":"2024-02-21T23:01:08.787395+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:27:55.341328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788755+0000","last_change":"2024-02-21T23:01:03.215959+0000","last_active":"2024-02-21T23:01:08.788755+0000","last_peered":"2024-02-21T23:01:08.788755+0000","last_clean":"2024-02-21T23:01:08.788755+0000","last_became_active":"2024-02-21T23:01:03.215639+0000","last_became_peered":"2024-02-21T23:01:03.215639+0000","last_unstale":"2024-02-21T23:01:08.788755+0000","last_undegraded":"2024-02-21T23:01:08.788755+0000","last_fullsized":"2024-02-21T23:01:08.788755+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:16.946152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787323+0000","last_change":"2024-02-21T23:01:03.218687+0000","last_active":"2024-02-21T23:01:08.787323+0000","last_peered":"2024-02-21T23:01:08.787323+0000","last_clean":"2024-02-21T23:01:08.787323+0000","last_became_active":"2024-02-21T23:01:03.218377+0000","last_became_peered":"2024-02-21T23:01:03.218377+0000","last_unstale":"2024-02-21T23:01:08.787323+0000","last_undegraded":"2024-02-21T23:01:08.787323+0000","last_fullsized":"2024-02-21T23:01:08.787323+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:41:55.485351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.790033+0000","last_change":"2024-02-21T23:01:03.225342+0000","last_active":"2024-02-21T23:01:08.790033+0000","last_peered":"2024-02-21T23:01:08.790033+0000","last_clean":"2024-02-21T23:01:08.790033+0000","last_became_active":"2024-02-21T23:01:03.225085+0000","last_became_peered":"2024-02-21T23:01:03.225085+0000","last_unstale":"2024-02-21T23:01:08.790033+0000","last_undegraded":"2024-02-21T23:01:08.790033+0000","last_fullsized":"2024-02-21T23:01:08.790033+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:54:32.196725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.263829+0000","last_change":"2024-02-21T23:01:03.226259+0000","last_active":"2024-02-21T23:01:08.263829+0000","last_peered":"2024-02-21T23:01:08.263829+0000","last_clean":"2024-02-21T23:01:08.263829+0000","last_became_active":"2024-02-21T23:01:03.225925+0000","last_became_peered":"2024-02-21T23:01:03.225925+0000","last_unstale":"2024-02-21T23:01:08.263829+0000","last_undegraded":"2024-02-21T23:01:08.263829+0000","last_fullsized":"2024-02-21T23:01:08.263829+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:54:32.196725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788416+0000","last_change":"2024-02-21T23:01:03.215186+0000","last_active":"2024-02-21T23:01:08.788416+0000","last_peered":"2024-02-21T23:01:08.788416+0000","last_clean":"2024-02-21T23:01:08.788416+0000","last_became_active":"2024-02-21T23:01:03.214488+0000","last_became_peered":"2024-02-21T23:01:03.214488+0000","last_unstale":"2024-02-21T23:01:08.788416+0000","last_undegraded":"2024-02-21T23:01:08.788416+0000","last_fullsized":"2024-02-21T23:01:08.788416+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:58:24.562346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8],"acting":[11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788754+0000","last_change":"2024-02-21T23:01:03.208734+0000","last_active":"2024-02-21T23:01:08.788754+0000","last_peered":"2024-02-21T23:01:08.788754+0000","last_clean":"2024-02-21T23:01:08.788754+0000","last_became_active":"2024-02-21T23:01:03.208458+0000","last_became_peered":"2024-02-21T23:01:03.208458+0000","last_unstale":"2024-02-21T23:01:08.788754+0000","last_undegraded":"2024-02-21T23:01:08.788754+0000","last_fullsized":"2024-02-21T23:01:08.788754+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:54:32.196725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8],"acting":[2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788958+0000","last_change":"2024-02-21T23:01:03.206669+0000","last_active":"2024-02-21T23:01:08.788958+0000","last_peered":"2024-02-21T23:01:08.788958+0000","last_clean":"2024-02-21T23:01:08.788958+0000","last_became_active":"2024-02-21T23:01:03.206376+0000","last_became_peered":"2024-02-21T23:01:03.206376+0000","last_unstale":"2024-02-21T23:01:08.788958+0000","last_undegraded":"2024-02-21T23:01:08.788958+0000","last_fullsized":"2024-02-21T23:01:08.788958+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:07:50.626867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787194+0000","last_change":"2024-02-21T23:01:03.215459+0000","last_active":"2024-02-21T23:01:08.787194+0000","last_peered":"2024-02-21T23:01:08.787194+0000","last_clean":"2024-02-21T23:01:08.787194+0000","last_became_active":"2024-02-21T23:01:03.214922+0000","last_became_peered":"2024-02-21T23:01:03.214922+0000","last_unstale":"2024-02-21T23:01:08.787194+0000","last_undegraded":"2024-02-21T23:01:08.787194+0000","last_fullsized":"2024-02-21T23:01:08.787194+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:40:26.325368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.790310+0000","last_change":"2024-02-21T23:01:03.213687+0000","last_active":"2024-02-21T23:01:08.790310+0000","last_peered":"2024-02-21T23:01:08.790310+0000","last_clean":"2024-02-21T23:01:08.790310+0000","last_became_active":"2024-02-21T23:01:03.213428+0000","last_became_peered":"2024-02-21T23:01:03.213428+0000","last_unstale":"2024-02-21T23:01:08.790310+0000","last_undegraded":"2024-02-21T23:01:08.790310+0000","last_fullsized":"2024-02-21T23:01:08.790310+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:45:29.610700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787556+0000","last_change":"2024-02-21T23:01:03.215983+0000","last_active":"2024-02-21T23:01:08.787556+0000","last_peered":"2024-02-21T23:01:08.787556+0000","last_clean":"2024-02-21T23:01:08.787556+0000","last_became_active":"2024-02-21T23:01:03.215580+0000","last_became_peered":"2024-02-21T23:01:03.215580+0000","last_unstale":"2024-02-21T23:01:08.787556+0000","last_undegraded":"2024-02-21T23:01:08.787556+0000","last_fullsized":"2024-02-21T23:01:08.787556+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:58:24.562346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.263660+0000","last_change":"2024-02-21T23:01:03.226514+0000","last_active":"2024-02-21T23:01:08.263660+0000","last_peered":"2024-02-21T23:01:08.263660+0000","last_clean":"2024-02-21T23:01:08.263660+0000","last_became_active":"2024-02-21T23:01:03.223861+0000","last_became_peered":"2024-02-21T23:01:03.223861+0000","last_unstale":"2024-02-21T23:01:08.263660+0000","last_undegraded":"2024-02-21T23:01:08.263660+0000","last_fullsized":"2024-02-21T23:01:08.263660+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:07:50.626867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787787+0000","last_change":"2024-02-21T23:01:03.212993+0000","last_active":"2024-02-21T23:01:08.787787+0000","last_peered":"2024-02-21T23:01:08.787787+0000","last_clean":"2024-02-21T23:01:08.787787+0000","last_became_active":"2024-02-21T23:01:03.212691+0000","last_became_peered":"2024-02-21T23:01:03.212691+0000","last_unstale":"2024-02-21T23:01:08.787787+0000","last_undegraded":"2024-02-21T23:01:08.787787+0000","last_fullsized":"2024-02-21T23:01:08.787787+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:10:10.688004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788992+0000","last_change":"2024-02-21T23:01:03.217962+0000","last_active":"2024-02-21T23:01:08.788992+0000","last_peered":"2024-02-21T23:01:08.788992+0000","last_clean":"2024-02-21T23:01:08.788992+0000","last_became_active":"2024-02-21T23:01:03.217613+0000","last_became_peered":"2024-02-21T23:01:03.217613+0000","last_unstale":"2024-02-21T23:01:08.788992+0000","last_undegraded":"2024-02-21T23:01:08.788992+0000","last_fullsized":"2024-02-21T23:01:08.788992+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:35:24.590398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788983+0000","last_change":"2024-02-21T23:01:03.214531+0000","last_active":"2024-02-21T23:01:08.788983+0000","last_peered":"2024-02-21T23:01:08.788983+0000","last_clean":"2024-02-21T23:01:08.788983+0000","last_became_active":"2024-02-21T23:01:03.214165+0000","last_became_peered":"2024-02-21T23:01:03.214165+0000","last_unstale":"2024-02-21T23:01:08.788983+0000","last_undegraded":"2024-02-21T23:01:08.788983+0000","last_fullsized":"2024-02-21T23:01:08.788983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:58:24.562346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1],"acting":[9,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788210+0000","last_change":"2024-02-21T23:01:03.214286+0000","last_active":"2024-02-21T23:01:08.788210+0000","last_peered":"2024-02-21T23:01:08.788210+0000","last_clean":"2024-02-21T23:01:08.788210+0000","last_became_active":"2024-02-21T23:01:03.213755+0000","last_became_peered":"2024-02-21T23:01:03.213755+0000","last_unstale":"2024-02-21T23:01:08.788210+0000","last_undegraded":"2024-02-21T23:01:08.788210+0000","last_fullsized":"2024-02-21T23:01:08.788210+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:35:24.590398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787471+0000","last_change":"2024-02-21T23:01:03.216623+0000","last_active":"2024-02-21T23:01:08.787471+0000","last_peered":"2024-02-21T23:01:08.787471+0000","last_clean":"2024-02-21T23:01:08.787471+0000","last_became_active":"2024-02-21T23:01:03.216345+0000","last_became_peered":"2024-02-21T23:01:03.216345+0000","last_unstale":"2024-02-21T23:01:08.787471+0000","last_undegraded":"2024-02-21T23:01:08.787471+0000","last_fullsized":"2024-02-21T23:01:08.787471+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:10:10.688004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.790273+0000","last_change":"2024-02-21T23:01:03.226262+0000","last_active":"2024-02-21T23:01:08.790273+0000","last_peered":"2024-02-21T23:01:08.790273+0000","last_clean":"2024-02-21T23:01:08.790273+0000","last_became_active":"2024-02-21T23:01:03.225574+0000","last_became_peered":"2024-02-21T23:01:03.225574+0000","last_unstale":"2024-02-21T23:01:08.790273+0000","last_undegraded":"2024-02-21T23:01:08.790273+0000","last_fullsized":"2024-02-21T23:01:08.790273+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:10:10.688004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.789940+0000","last_change":"2024-02-21T23:01:03.225898+0000","last_active":"2024-02-21T23:01:08.789940+0000","last_peered":"2024-02-21T23:01:08.789940+0000","last_clean":"2024-02-21T23:01:08.789940+0000","last_became_active":"2024-02-21T23:01:03.217938+0000","last_became_peered":"2024-02-21T23:01:03.217938+0000","last_unstale":"2024-02-21T23:01:08.789940+0000","last_undegraded":"2024-02-21T23:01:08.789940+0000","last_fullsized":"2024-02-21T23:01:08.789940+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:58:24.562346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8],"acting":[0,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.263526+0000","last_change":"2024-02-21T23:01:03.225830+0000","last_active":"2024-02-21T23:01:08.263526+0000","last_peered":"2024-02-21T23:01:08.263526+0000","last_clean":"2024-02-21T23:01:08.263526+0000","last_became_active":"2024-02-21T23:01:03.225449+0000","last_became_peered":"2024-02-21T23:01:03.225449+0000","last_unstale":"2024-02-21T23:01:08.263526+0000","last_undegraded":"2024-02-21T23:01:08.263526+0000","last_fullsized":"2024-02-21T23:01:08.263526+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:47:19.366266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10],"acting":[6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.260717+0000","last_change":"2024-02-21T23:01:03.208746+0000","last_active":"2024-02-21T23:01:08.260717+0000","last_peered":"2024-02-21T23:01:08.260717+0000","last_clean":"2024-02-21T23:01:08.260717+0000","last_became_active":"2024-02-21T23:01:03.208446+0000","last_became_peered":"2024-02-21T23:01:03.208446+0000","last_unstale":"2024-02-21T23:01:08.260717+0000","last_undegraded":"2024-02-21T23:01:08.260717+0000","last_fullsized":"2024-02-21T23:01:08.260717+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:58:24.562346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787941+0000","last_change":"2024-02-21T23:01:03.218981+0000","last_active":"2024-02-21T23:01:08.787941+0000","last_peered":"2024-02-21T23:01:08.787941+0000","last_clean":"2024-02-21T23:01:08.787941+0000","last_became_active":"2024-02-21T23:01:03.217925+0000","last_became_peered":"2024-02-21T23:01:03.217925+0000","last_unstale":"2024-02-21T23:01:08.787941+0000","last_undegraded":"2024-02-21T23:01:08.787941+0000","last_fullsized":"2024-02-21T23:01:08.787941+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:54:40.332224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8],"acting":[7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.790183+0000","last_change":"2024-02-21T23:01:03.212233+0000","last_active":"2024-02-21T23:01:08.790183+0000","last_peered":"2024-02-21T23:01:08.790183+0000","last_clean":"2024-02-21T23:01:08.790183+0000","last_became_active":"2024-02-21T23:01:03.211921+0000","last_became_peered":"2024-02-21T23:01:03.211921+0000","last_unstale":"2024-02-21T23:01:08.790183+0000","last_undegraded":"2024-02-21T23:01:08.790183+0000","last_fullsized":"2024-02-21T23:01:08.790183+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:54:32.196725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2],"acting":[10,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788443+0000","last_change":"2024-02-21T23:01:03.216861+0000","last_active":"2024-02-21T23:01:08.788443+0000","last_peered":"2024-02-21T23:01:08.788443+0000","last_clean":"2024-02-21T23:01:08.788443+0000","last_became_active":"2024-02-21T23:01:03.216580+0000","last_became_peered":"2024-02-21T23:01:03.216580+0000","last_unstale":"2024-02-21T23:01:08.788443+0000","last_undegraded":"2024-02-21T23:01:08.788443+0000","last_fullsized":"2024-02-21T23:01:08.788443+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:35:24.590398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.789320+0000","last_change":"2024-02-21T23:01:03.212164+0000","last_active":"2024-02-21T23:01:08.789320+0000","last_peered":"2024-02-21T23:01:08.789320+0000","last_clean":"2024-02-21T23:01:08.789320+0000","last_became_active":"2024-02-21T23:01:03.211811+0000","last_became_peered":"2024-02-21T23:01:03.211811+0000","last_unstale":"2024-02-21T23:01:08.789320+0000","last_undegraded":"2024-02-21T23:01:08.789320+0000","last_fullsized":"2024-02-21T23:01:08.789320+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:16.946152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787878+0000","last_change":"2024-02-21T23:01:03.223537+0000","last_active":"2024-02-21T23:01:08.787878+0000","last_peered":"2024-02-21T23:01:08.787878+0000","last_clean":"2024-02-21T23:01:08.787878+0000","last_became_active":"2024-02-21T23:01:03.223255+0000","last_became_peered":"2024-02-21T23:01:03.223255+0000","last_unstale":"2024-02-21T23:01:08.787878+0000","last_undegraded":"2024-02-21T23:01:08.787878+0000","last_fullsized":"2024-02-21T23:01:08.787878+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:19:01.584139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9],"acting":[7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.789780+0000","last_change":"2024-02-21T23:01:03.210441+0000","last_active":"2024-02-21T23:01:08.789780+0000","last_peered":"2024-02-21T23:01:08.789780+0000","last_clean":"2024-02-21T23:01:08.789780+0000","last_became_active":"2024-02-21T23:01:03.209569+0000","last_became_peered":"2024-02-21T23:01:03.209569+0000","last_unstale":"2024-02-21T23:01:08.789780+0000","last_undegraded":"2024-02-21T23:01:08.789780+0000","last_fullsized":"2024-02-21T23:01:08.789780+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:41:55.485351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9],"acting":[10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.261019+0000","last_change":"2024-02-21T23:01:03.214234+0000","last_active":"2024-02-21T23:01:08.261019+0000","last_peered":"2024-02-21T23:01:08.261019+0000","last_clean":"2024-02-21T23:01:08.261019+0000","last_became_active":"2024-02-21T23:01:03.213941+0000","last_became_peered":"2024-02-21T23:01:03.213941+0000","last_unstale":"2024-02-21T23:01:08.261019+0000","last_undegraded":"2024-02-21T23:01:08.261019+0000","last_fullsized":"2024-02-21T23:01:08.261019+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:19:01.584139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3],"acting":[8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.260625+0000","last_change":"2024-02-21T23:01:03.207972+0000","last_active":"2024-02-21T23:01:08.260625+0000","last_peered":"2024-02-21T23:01:08.260625+0000","last_clean":"2024-02-21T23:01:08.260625+0000","last_became_active":"2024-02-21T23:01:03.206762+0000","last_became_peered":"2024-02-21T23:01:03.206762+0000","last_unstale":"2024-02-21T23:01:08.260625+0000","last_undegraded":"2024-02-21T23:01:08.260625+0000","last_fullsized":"2024-02-21T23:01:08.260625+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:27:55.341328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8],"acting":[4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.790823+0000","last_change":"2024-02-21T23:01:03.221959+0000","last_active":"2024-02-21T23:01:08.790823+0000","last_peered":"2024-02-21T23:01:08.790823+0000","last_clean":"2024-02-21T23:01:08.790823+0000","last_became_active":"2024-02-21T23:01:03.221672+0000","last_became_peered":"2024-02-21T23:01:03.221672+0000","last_unstale":"2024-02-21T23:01:08.790823+0000","last_undegraded":"2024-02-21T23:01:08.790823+0000","last_fullsized":"2024-02-21T23:01:08.790823+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:45:29.610700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.790294+0000","last_change":"2024-02-21T23:01:03.219660+0000","last_active":"2024-02-21T23:01:08.790294+0000","last_peered":"2024-02-21T23:01:08.790294+0000","last_clean":"2024-02-21T23:01:08.790294+0000","last_became_active":"2024-02-21T23:01:03.219379+0000","last_became_peered":"2024-02-21T23:01:03.219379+0000","last_unstale":"2024-02-21T23:01:08.790294+0000","last_undegraded":"2024-02-21T23:01:08.790294+0000","last_fullsized":"2024-02-21T23:01:08.790294+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:27:55.341328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11],"acting":[0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788114+0000","last_change":"2024-02-21T23:01:03.213287+0000","last_active":"2024-02-21T23:01:08.788114+0000","last_peered":"2024-02-21T23:01:08.788114+0000","last_clean":"2024-02-21T23:01:08.788114+0000","last_became_active":"2024-02-21T23:01:03.212878+0000","last_became_peered":"2024-02-21T23:01:03.212878+0000","last_unstale":"2024-02-21T23:01:08.788114+0000","last_undegraded":"2024-02-21T23:01:08.788114+0000","last_fullsized":"2024-02-21T23:01:08.788114+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:16.946152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":45915,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":40,"num_read_kb":52,"num_write":145,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":237568,"data_stored":91830,"data_compressed":3672,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":0,"internal_metadata":0},"log_size":127,"ondisk_log_size":127,"up":64,"acting":64,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66458,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":11,"up_from":17,"seq":73014444042,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":145847,"data_compressed":8432,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":17,"seq":73014444041,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":368640,"data_stored":183307,"data_compressed":10268,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":17,"seq":73014444042,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":150033,"data_compressed":8432,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":17,"seq":73014444041,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":141325,"data_compressed":8432,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":17,"seq":73014444042,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":380928,"data_stored":736803,"data_compressed":41661,"data_compressed_allocated":57344,"data_compressed_original":598016,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":17,"seq":73014444041,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":141259,"data_compressed":8432,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":17,"seq":73014444042,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":401408,"data_stored":737504,"data_compressed":41661,"data_compressed_allocated":57344,"data_compressed_original":598016,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":17,"seq":73014444042,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":315392,"data_stored":145887,"data_compressed":8432,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":17,"seq":73014444042,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":141349,"data_compressed":8432,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444042,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":142802,"data_compressed":8432,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":17,"seq":73014444042,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":352256,"data_stored":183079,"data_compressed":10268,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":17,"seq":73014444042,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":323584,"data_stored":141975,"data_compressed":8432,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33229,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33229,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":41910,"data_compressed":1836,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":42138,"data_compressed":1836,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-21T23:01:38.059 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-02-21T23:01:38.059 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-02-21T23:01:38.059 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-02-21T23:01:38.059 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-02-21T23:01:38.060 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-02-21T23:01:38.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.350+0000 7f9b82000640 1 Processor -- start 2024-02-21T23:01:38.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.350+0000 7f9b82000640 1 -- start start 2024-02-21T23:01:38.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.353+0000 7f9b82000640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f9b7c0d5310 0x7f9b7c0cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:38.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.353+0000 7f9b82000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b7c186a50 con 0x7f9b7c1861e0 2024-02-21T23:01:38.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.353+0000 7f9b82000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b7c0d5740 con 0x7f9b7c1865c0 2024-02-21T23:01:38.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.353+0000 7f9b82000640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b7c186d50 con 0x7f9b7c0d5310 2024-02-21T23:01:38.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.353+0000 7f9b7b400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f9b7c1861e0 0x7f9b7c187a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:52546/0 (socket says 172.21.15.99:52546) 2024-02-21T23:01:38.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.353+0000 7f9b7b400640 1 -- 172.21.15.99:0/3340533175 learned_addr learned my addr 172.21.15.99:0/3340533175 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:01:38.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.353+0000 7f9b7be00640 1 --2- 172.21.15.99:0/3340533175 >> v2:172.21.15.181:3300/0 conn(0x7f9b7c0d5310 0x7f9b7c0cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:38.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.353+0000 7f9b7a000640 1 -- 172.21.15.99:0/3340533175 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2175398200 0 0) 0x7f9b7c0d5740 con 0x7f9b7c1865c0 2024-02-21T23:01:38.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.353+0000 7f9b7be00640 1 -- 172.21.15.99:0/3340533175 >> v1:172.21.15.162:6789/0 conn(0x7f9b7c1865c0 legacy=0x7f9b7c188190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:38.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.354+0000 7f9b7be00640 1 -- 172.21.15.99:0/3340533175 >> v1:172.21.15.99:6789/0 conn(0x7f9b7c1861e0 legacy=0x7f9b7c187a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:38.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.354+0000 7f9b7be00640 1 -- 172.21.15.99:0/3340533175 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b7c0cf7e0 con 0x7f9b7c0d5310 2024-02-21T23:01:38.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.355+0000 7f9b7be00640 1 --2- 172.21.15.99:0/3340533175 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9b7c0d5310 0x7f9b7c0cdea0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c186ed0 tx=0x7f9b7402bce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e0abba9ed2406ac server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:38.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.355+0000 7f9b7a000640 1 -- 172.21.15.99:0/3340533175 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b74039070 con 0x7f9b7c0d5310 2024-02-21T23:01:38.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.355+0000 7f9b7a000640 1 -- 172.21.15.99:0/3340533175 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b7402ca10 con 0x7f9b7c0d5310 2024-02-21T23:01:38.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.355+0000 7f9b7a000640 1 -- 172.21.15.99:0/3340533175 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b7402cde0 con 0x7f9b7c0d5310 2024-02-21T23:01:38.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.356+0000 7f9b82000640 1 -- 172.21.15.99:0/3340533175 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9b7c0d5310 msgr2=0x7f9b7c0cdea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:38.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.356+0000 7f9b82000640 1 --2- 172.21.15.99:0/3340533175 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9b7c0d5310 0x7f9b7c0cdea0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c186ed0 tx=0x7f9b7402bce0 comp rx=0 tx=0).stop 2024-02-21T23:01:38.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.356+0000 7f9b82000640 1 -- 172.21.15.99:0/3340533175 shutdown_connections 2024-02-21T23:01:38.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.356+0000 7f9b82000640 1 --2- 172.21.15.99:0/3340533175 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9b7c0d5310 0x7f9b7c0cdea0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:38.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.356+0000 7f9b82000640 1 -- 172.21.15.99:0/3340533175 >> 172.21.15.99:0/3340533175 conn(0x7f9b7c0d6ac0 msgr2=0x7f9b7c0740b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:38.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.356+0000 7f9b82000640 1 -- 172.21.15.99:0/3340533175 shutdown_connections 2024-02-21T23:01:38.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.356+0000 7f9b82000640 1 -- 172.21.15.99:0/3340533175 wait complete. 2024-02-21T23:01:38.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.359+0000 7f9b82000640 1 Processor -- start 2024-02-21T23:01:38.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.359+0000 7f9b82000640 1 -- start start 2024-02-21T23:01:38.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.361+0000 7f9b82000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9b7c0d5310 0x7f9b7c171b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:38.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.361+0000 7f9b82000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9b7c1861e0 0x7f9b7c221320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:38.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.361+0000 7f9b82000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b7c1865c0 0x7f9b7c221860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:38.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.361+0000 7f9b82000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b7c186fa0 con 0x7f9b7c1865c0 2024-02-21T23:01:38.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.361+0000 7f9b82000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b7c1875f0 con 0x7f9b7c1861e0 2024-02-21T23:01:38.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.361+0000 7f9b82000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b7c187280 con 0x7f9b7c0d5310 2024-02-21T23:01:38.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.361+0000 7f9b7b400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9b7c0d5310 0x7f9b7c171b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:38.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.361+0000 7f9b7be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b7c1865c0 0x7f9b7c221860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:38.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.361+0000 7f9b7aa00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9b7c1861e0 0x7f9b7c221320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:38.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.361+0000 7f9b7b400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9b7c0d5310 0x7f9b7c171b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:43538/0 (socket says 172.21.15.99:43538) 2024-02-21T23:01:38.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.361+0000 7f9b7b400640 1 -- 172.21.15.99:0/1428060496 learned_addr learned my addr 172.21.15.99:0/1428060496 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:38.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.362+0000 7f9b7b400640 1 -- 172.21.15.99:0/1428060496 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9b7c1861e0 msgr2=0x7f9b7c221320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:38.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.362+0000 7f9b7b400640 1 --2- 172.21.15.99:0/1428060496 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9b7c1861e0 0x7f9b7c221320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:38.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.362+0000 7f9b7b400640 1 -- 172.21.15.99:0/1428060496 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b7c1865c0 msgr2=0x7f9b7c221860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:38.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.362+0000 7f9b7b400640 1 --2- 172.21.15.99:0/1428060496 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b7c1865c0 0x7f9b7c221860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:38.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.362+0000 7f9b7b400640 1 -- 172.21.15.99:0/1428060496 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b7c21ffa0 con 0x7f9b7c0d5310 2024-02-21T23:01:38.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.362+0000 7f9b7b400640 1 --2- 172.21.15.99:0/1428060496 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9b7c0d5310 0x7f9b7c171b90 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c00c7b0 tx=0x7f9b6c00cc70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:38.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.362+0000 7f9b73400640 1 -- 172.21.15.99:0/1428060496 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b6c017070 con 0x7f9b7c0d5310 2024-02-21T23:01:38.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.362+0000 7f9b73400640 1 -- 172.21.15.99:0/1428060496 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b6c005a90 con 0x7f9b7c0d5310 2024-02-21T23:01:38.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.362+0000 7f9b73400640 1 -- 172.21.15.99:0/1428060496 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b6c007070 con 0x7f9b7c0d5310 2024-02-21T23:01:38.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.363+0000 7f9b82000640 1 -- 172.21.15.99:0/1428060496 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b7c220280 con 0x7f9b7c0d5310 2024-02-21T23:01:38.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.363+0000 7f9b82000640 1 -- 172.21.15.99:0/1428060496 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b7c220840 con 0x7f9b7c0d5310 2024-02-21T23:01:38.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.364+0000 7f9b82000640 1 -- 172.21.15.99:0/1428060496 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b7c17d580 con 0x7f9b7c0d5310 2024-02-21T23:01:38.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.366+0000 7f9b73400640 1 -- 172.21.15.99:0/1428060496 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 6) v1 ==== 134407+0+0 (secure 0 0 0) 0x7f9b6c01a070 con 0x7f9b7c0d5310 2024-02-21T23:01:38.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.367+0000 7f9b73400640 1 --2- 172.21.15.99:0/1428060496 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f9b5c09edf0 0x7f9b5c0a12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:38.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.367+0000 7f9b73400640 1 -- 172.21.15.99:0/1428060496 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f9b6c0c8f70 con 0x7f9b7c0d5310 2024-02-21T23:01:38.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.367+0000 7f9b7aa00640 1 --2- 172.21.15.99:0/1428060496 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f9b5c09edf0 0x7f9b5c0a12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:38.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.368+0000 7f9b7aa00640 1 --2- 172.21.15.99:0/1428060496 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f9b5c09edf0 0x7f9b5c0a12b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c0cf0b0 tx=0x7f9b68009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:38.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.371+0000 7f9b73400640 1 -- 172.21.15.99:0/1428060496 <== mon.2 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f9b6c096bb0 con 0x7f9b7c0d5310 2024-02-21T23:01:38.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.622+0000 7f9b82000640 1 -- 172.21.15.99:0/1428060496 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f9b7c17d2a0 con 0x7f9b7c0d5310 2024-02-21T23:01:38.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.627+0000 7f9b73400640 1 -- 172.21.15.99:0/1428060496 <== mon.2 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v6) v1 ==== 74+0+257041 (secure 0 0 0) 0x7f9b6c09ac50 con 0x7f9b7c0d5310 2024-02-21T23:01:38.620 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T23:01:38.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.632+0000 7f9b82000640 1 -- 172.21.15.99:0/1428060496 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f9b5c09edf0 msgr2=0x7f9b5c0a12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:38.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.632+0000 7f9b82000640 1 --2- 172.21.15.99:0/1428060496 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f9b5c09edf0 0x7f9b5c0a12b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c0cf0b0 tx=0x7f9b68009040 comp rx=0 tx=0).stop 2024-02-21T23:01:38.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.632+0000 7f9b82000640 1 -- 172.21.15.99:0/1428060496 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9b7c0d5310 msgr2=0x7f9b7c171b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:38.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.632+0000 7f9b82000640 1 --2- 172.21.15.99:0/1428060496 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9b7c0d5310 0x7f9b7c171b90 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c00c7b0 tx=0x7f9b6c00cc70 comp rx=0 tx=0).stop 2024-02-21T23:01:38.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.632+0000 7f9b82000640 1 -- 172.21.15.99:0/1428060496 shutdown_connections 2024-02-21T23:01:38.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.632+0000 7f9b82000640 1 --2- 172.21.15.99:0/1428060496 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f9b5c09edf0 0x7f9b5c0a12b0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:38.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.632+0000 7f9b82000640 1 --2- 172.21.15.99:0/1428060496 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b7c1865c0 0x7f9b7c221860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:38.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.632+0000 7f9b82000640 1 --2- 172.21.15.99:0/1428060496 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9b7c1861e0 0x7f9b7c221320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:38.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.632+0000 7f9b82000640 1 --2- 172.21.15.99:0/1428060496 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9b7c0d5310 0x7f9b7c171b90 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:38.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.632+0000 7f9b82000640 1 -- 172.21.15.99:0/1428060496 >> 172.21.15.99:0/1428060496 conn(0x7f9b7c0d6ac0 msgr2=0x7f9b7c0740b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:38.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.632+0000 7f9b82000640 1 -- 172.21.15.99:0/1428060496 shutdown_connections 2024-02-21T23:01:38.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.632+0000 7f9b82000640 1 -- 172.21.15.99:0/1428060496 wait complete. 2024-02-21T23:01:38.639 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":6,"flags":0,"active_gid":4106,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":1717094936},{"type":"v1","addr":"172.21.15.162:6801","nonce":1717094936}]},"active_addr":"172.21.15.162:6801/1717094936","active_change":"2024-02-21T23:00:48.932080+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4112,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":4114,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.162:0","nonce":612025202}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.162:0","nonce":3695581546}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.162:0","nonce":1516346096}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.162:0","nonce":328516024}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.162:0","nonce":506228072}]}]} 2024-02-21T23:01:38.644 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-02-21T23:01:38.644 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-02-21T23:01:38.644 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T23:01:38.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.886+0000 7ff4cca00640 1 Processor -- start 2024-02-21T23:01:38.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.886+0000 7ff4cca00640 1 -- start start 2024-02-21T23:01:38.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.889+0000 7ff4cca00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff4c8182e60 0x7ff4c818a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:38.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.889+0000 7ff4cca00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff4c818c290 0x7ff4c818c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:38.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.889+0000 7ff4cca00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4c818a7f0 con 0x7ff4c818bb70 2024-02-21T23:01:38.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.889+0000 7ff4cca00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4c818b6e0 con 0x7ff4c8182e60 2024-02-21T23:01:38.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.889+0000 7ff4cca00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4c818aad0 con 0x7ff4c818c290 2024-02-21T23:01:38.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.890+0000 7ff4c5e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff4c8182e60 0x7ff4c818a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:38.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.890+0000 7ff4c5400640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7ff4c818bb70 0x7ff4c8186c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:48520/0 (socket says 172.21.15.99:48520) 2024-02-21T23:01:38.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.890+0000 7ff4c5400640 1 -- 172.21.15.99:0/2433202506 learned_addr learned my addr 172.21.15.99:0/2433202506 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:01:38.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.890+0000 7ff4c5e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff4c8182e60 0x7ff4c818a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59398/0 (socket says 172.21.15.99:59398) 2024-02-21T23:01:38.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.890+0000 7ff4c6800640 1 --2- 172.21.15.99:0/2433202506 >> v2:172.21.15.162:3300/0 conn(0x7ff4c818c290 0x7ff4c818c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:38.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.890+0000 7ff4c5e00640 1 -- 172.21.15.99:0/2433202506 >> v2:172.21.15.162:3300/0 conn(0x7ff4c818c290 msgr2=0x7ff4c818c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:38.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.890+0000 7ff4c5e00640 1 --2- 172.21.15.99:0/2433202506 >> v2:172.21.15.162:3300/0 conn(0x7ff4c818c290 0x7ff4c818c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:38.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.890+0000 7ff4c5e00640 1 -- 172.21.15.99:0/2433202506 >> v1:172.21.15.181:6789/0 conn(0x7ff4c818bb70 legacy=0x7ff4c8186c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:38.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.890+0000 7ff4c5e00640 1 -- 172.21.15.99:0/2433202506 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4c818adb0 con 0x7ff4c8182e60 2024-02-21T23:01:38.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.890+0000 7ff4c4a00640 1 -- 172.21.15.99:0/2433202506 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3728068443 0 0) 0x7ff4c818a7f0 con 0x7ff4c818bb70 2024-02-21T23:01:38.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.892+0000 7ff4c5e00640 1 --2- 172.21.15.99:0/2433202506 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4c8182e60 0x7ff4c818a190 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff4c80fd470 tx=0x7ff4b802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1304ac35e379bec5 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:38.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.892+0000 7ff4c4a00640 1 -- 172.21.15.99:0/2433202506 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b80315a0 con 0x7ff4c8182e60 2024-02-21T23:01:38.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.892+0000 7ff4c4a00640 1 -- 172.21.15.99:0/2433202506 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4b8037070 con 0x7ff4c8182e60 2024-02-21T23:01:38.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.892+0000 7ff4c4a00640 1 -- 172.21.15.99:0/2433202506 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b8031960 con 0x7ff4c8182e60 2024-02-21T23:01:38.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.893+0000 7ff4cca00640 1 -- 172.21.15.99:0/2433202506 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4c8182e60 msgr2=0x7ff4c818a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:38.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.893+0000 7ff4cca00640 1 --2- 172.21.15.99:0/2433202506 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4c8182e60 0x7ff4c818a190 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff4c80fd470 tx=0x7ff4b802b840 comp rx=0 tx=0).stop 2024-02-21T23:01:38.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.893+0000 7ff4cca00640 1 -- 172.21.15.99:0/2433202506 shutdown_connections 2024-02-21T23:01:38.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.893+0000 7ff4cca00640 1 --2- 172.21.15.99:0/2433202506 >> v2:172.21.15.162:3300/0 conn(0x7ff4c818c290 0x7ff4c818c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:38.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.893+0000 7ff4cca00640 1 --2- 172.21.15.99:0/2433202506 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4c8182e60 0x7ff4c818a190 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:38.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.893+0000 7ff4cca00640 1 -- 172.21.15.99:0/2433202506 >> 172.21.15.99:0/2433202506 conn(0x7ff4c80f8e10 msgr2=0x7ff4c80f9220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:38.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.893+0000 7ff4cca00640 1 -- 172.21.15.99:0/2433202506 shutdown_connections 2024-02-21T23:01:38.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.893+0000 7ff4cca00640 1 -- 172.21.15.99:0/2433202506 wait complete. 2024-02-21T23:01:38.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.896+0000 7ff4cca00640 1 Processor -- start 2024-02-21T23:01:38.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.896+0000 7ff4cca00640 1 -- start start 2024-02-21T23:01:38.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.897+0000 7ff4cca00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4c818bb70 0x7ff4c8180810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:38.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.897+0000 7ff4cca00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff4c818c290 0x7ff4c80f8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:38.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.897+0000 7ff4cca00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4c8171250 0x7ff4c817bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:38.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.897+0000 7ff4cca00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c8189a50 con 0x7ff4c8171250 2024-02-21T23:01:38.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.897+0000 7ff4cca00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c818b370 con 0x7ff4c818bb70 2024-02-21T23:01:38.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.897+0000 7ff4cca00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c8189bd0 con 0x7ff4c818c290 2024-02-21T23:01:38.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.898+0000 7ff4c6800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4c8171250 0x7ff4c817bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:38.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.898+0000 7ff4c6800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4c8171250 0x7ff4c817bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59400/0 (socket says 172.21.15.99:59400) 2024-02-21T23:01:38.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.898+0000 7ff4c6800640 1 -- 172.21.15.99:0/478148011 learned_addr learned my addr 172.21.15.99:0/478148011 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:38.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.898+0000 7ff4c5e00640 1 --2- 172.21.15.99:0/478148011 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4c818bb70 0x7ff4c8180810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:38.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.898+0000 7ff4c5400640 1 --2- 172.21.15.99:0/478148011 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff4c818c290 0x7ff4c80f8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:38.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.899+0000 7ff4c6800640 1 -- 172.21.15.99:0/478148011 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff4c818c290 msgr2=0x7ff4c80f8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:38.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.899+0000 7ff4c6800640 1 --2- 172.21.15.99:0/478148011 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff4c818c290 0x7ff4c80f8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:38.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.899+0000 7ff4c6800640 1 -- 172.21.15.99:0/478148011 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4c818bb70 msgr2=0x7ff4c8180810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:38.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.899+0000 7ff4c6800640 1 --2- 172.21.15.99:0/478148011 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4c818bb70 0x7ff4c8180810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:38.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.899+0000 7ff4c6800640 1 -- 172.21.15.99:0/478148011 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4c8216380 con 0x7ff4c8171250 2024-02-21T23:01:38.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.899+0000 7ff4c5e00640 1 --2- 172.21.15.99:0/478148011 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4c818bb70 0x7ff4c8180810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:01:38.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.899+0000 7ff4c6800640 1 --2- 172.21.15.99:0/478148011 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4c8171250 0x7ff4c817bf40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff4c000efc0 tx=0x7ff4c000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:38.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.899+0000 7ff4be000640 1 -- 172.21.15.99:0/478148011 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c0018020 con 0x7ff4c8171250 2024-02-21T23:01:38.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.899+0000 7ff4be000640 1 -- 172.21.15.99:0/478148011 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4c0014480 con 0x7ff4c8171250 2024-02-21T23:01:38.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.899+0000 7ff4be000640 1 -- 172.21.15.99:0/478148011 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c0014870 con 0x7ff4c8171250 2024-02-21T23:01:38.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.900+0000 7ff4cca00640 1 -- 172.21.15.99:0/478148011 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4c82160a0 con 0x7ff4c8171250 2024-02-21T23:01:38.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.900+0000 7ff4cca00640 1 -- 172.21.15.99:0/478148011 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4c8170770 con 0x7ff4c8171250 2024-02-21T23:01:38.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.901+0000 7ff4cca00640 1 -- 172.21.15.99:0/478148011 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4c80ce430 con 0x7ff4c8171250 2024-02-21T23:01:38.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.904+0000 7ff4be000640 1 -- 172.21.15.99:0/478148011 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 6) v1 ==== 134407+0+0 (secure 0 0 0) 0x7ff4c0005d10 con 0x7ff4c8171250 2024-02-21T23:01:38.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.905+0000 7ff4be000640 1 --2- 172.21.15.99:0/478148011 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7ff4a809edf0 0x7ff4a80a12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:38.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.906+0000 7ff4be000640 1 -- 172.21.15.99:0/478148011 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7ff4c00ca960 con 0x7ff4c8171250 2024-02-21T23:01:38.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.906+0000 7ff4c5e00640 1 --2- 172.21.15.99:0/478148011 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7ff4a809edf0 0x7ff4a80a12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:38.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.906+0000 7ff4c5e00640 1 --2- 172.21.15.99:0/478148011 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7ff4a809edf0 0x7ff4a80a12b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff4b8036000 tx=0x7ff4b8008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:38.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:38.914+0000 7ff4be000640 1 -- 172.21.15.99:0/478148011 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7ff4c0022030 con 0x7ff4c8171250 2024-02-21T23:01:39.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.149+0000 7ff4cca00640 1 -- 172.21.15.99:0/478148011 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff4c80cdcc0 con 0x7ff4c8171250 2024-02-21T23:01:39.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.151+0000 7ff4be000640 1 -- 172.21.15.99:0/478148011 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+23570 (secure 0 0 0) 0x7ff4c0010040 con 0x7ff4c8171250 2024-02-21T23:01:39.140 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T23:01:39.141 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":29,"fsid":"e8af98cd-45a1-425f-96a7-f24da8ee4efb","created":"2024-02-21T23:00:44.699708+0000","modified":"2024-02-21T23:01:07.722511+0000","last_up_change":"2024-02-21T23:00:55.749829+0000","last_in_change":"2024-02-21T23:00:48.332297+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T23:00:57.020557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":11.760000228881836,"score_stable":11.760000228881836,"optimal_score":0.17000000178813934,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-21T23:01:01.124398+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-21T23:01:01.684258+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-21T23:01:05.290089+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c49de9b2-dc53-4882-b14c-7059ed40bf59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6809","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6811","nonce":1026112937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6813","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6815","nonce":1026112937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6823","nonce":1026112937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6819","nonce":1026112937}]},"public_addr":"172.21.15.99:6811/1026112937","cluster_addr":"172.21.15.99:6815/1026112937","heartbeat_back_addr":"172.21.15.99:6823/1026112937","heartbeat_front_addr":"172.21.15.99:6819/1026112937","state":["exists","up"]},{"osd":1,"uuid":"58398292-2fe5-4291-94fd-03a0ca29d49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6827","nonce":3030871566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6829","nonce":3030871566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6833","nonce":3030871566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6831","nonce":3030871566}]},"public_addr":"172.21.15.162:6827/3030871566","cluster_addr":"172.21.15.162:6829/3030871566","heartbeat_back_addr":"172.21.15.162:6833/3030871566","heartbeat_front_addr":"172.21.15.162:6831/3030871566","state":["exists","up"]},{"osd":2,"uuid":"94cddec1-e08f-438d-a7c8-48a0e47d71a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6818","nonce":2782386148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6821","nonce":2782386148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6827","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6829","nonce":2782386148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6823","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6825","nonce":2782386148}]},"public_addr":"172.21.15.181:6818/2782386148","cluster_addr":"172.21.15.181:6821/2782386148","heartbeat_back_addr":"172.21.15.181:6829/2782386148","heartbeat_front_addr":"172.21.15.181:6825/2782386148","state":["exists","up"]},{"osd":3,"uuid":"d29abb74-9b89-4fd7-88b1-7c2eb8231189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6801","nonce":2316185310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6803","nonce":2316185310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6807","nonce":2316185310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6805","nonce":2316185310}]},"public_addr":"172.21.15.99:6801/2316185310","cluster_addr":"172.21.15.99:6803/2316185310","heartbeat_back_addr":"172.21.15.99:6807/2316185310","heartbeat_front_addr":"172.21.15.99:6805/2316185310","state":["exists","up"]},{"osd":4,"uuid":"0d8c9ea3-880a-4d69-9dcb-cf7d35abd449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6811","nonce":3137681258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6813","nonce":3137681258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6817","nonce":3137681258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6815","nonce":3137681258}]},"public_addr":"172.21.15.162:6811/3137681258","cluster_addr":"172.21.15.162:6813/3137681258","heartbeat_back_addr":"172.21.15.162:6817/3137681258","heartbeat_front_addr":"172.21.15.162:6815/3137681258","state":["exists","up"]},{"osd":5,"uuid":"2e3a9340-6fd0-4d7a-8e00-fe305649296e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6801","nonce":2011264527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6803","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6805","nonce":2011264527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6811","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6813","nonce":2011264527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6807","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6809","nonce":2011264527}]},"public_addr":"172.21.15.181:6801/2011264527","cluster_addr":"172.21.15.181:6805/2011264527","heartbeat_back_addr":"172.21.15.181:6813/2011264527","heartbeat_front_addr":"172.21.15.181:6809/2011264527","state":["exists","up"]},{"osd":6,"uuid":"d9e37ce7-1b0e-4019-8f2e-b670403abf7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6810","nonce":753870050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6814","nonce":753870050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6822","nonce":753870050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6818","nonce":753870050}]},"public_addr":"172.21.15.99:6810/753870050","cluster_addr":"172.21.15.99:6814/753870050","heartbeat_back_addr":"172.21.15.99:6822/753870050","heartbeat_front_addr":"172.21.15.99:6818/753870050","state":["exists","up"]},{"osd":7,"uuid":"49988754-232e-4b8c-bd72-bfa25b418e5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6803","nonce":1659412949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6805","nonce":1659412949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6809","nonce":1659412949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6807","nonce":1659412949}]},"public_addr":"172.21.15.162:6803/1659412949","cluster_addr":"172.21.15.162:6805/1659412949","heartbeat_back_addr":"172.21.15.162:6809/1659412949","heartbeat_front_addr":"172.21.15.162:6807/1659412949","state":["exists","up"]},{"osd":8,"uuid":"ebc6e462-8368-4d64-b242-9c8735ac672c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6804","nonce":3389807042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6808","nonce":3389807042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6815","nonce":3389807042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6812","nonce":3389807042}]},"public_addr":"172.21.15.181:6804/3389807042","cluster_addr":"172.21.15.181:6808/3389807042","heartbeat_back_addr":"172.21.15.181:6815/3389807042","heartbeat_front_addr":"172.21.15.181:6812/3389807042","state":["exists","up"]},{"osd":9,"uuid":"72af1b02-b965-4d6a-8964-527ec24c4daa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6825","nonce":4055669590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6827","nonce":4055669590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6831","nonce":4055669590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6829","nonce":4055669590}]},"public_addr":"172.21.15.99:6825/4055669590","cluster_addr":"172.21.15.99:6827/4055669590","heartbeat_back_addr":"172.21.15.99:6831/4055669590","heartbeat_front_addr":"172.21.15.99:6829/4055669590","state":["exists","up"]},{"osd":10,"uuid":"adb5cb06-6453-41e4-b847-d7c78bbb7d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6819","nonce":1421879617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6821","nonce":1421879617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6825","nonce":1421879617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6823","nonce":1421879617}]},"public_addr":"172.21.15.162:6819/1421879617","cluster_addr":"172.21.15.162:6821/1421879617","heartbeat_back_addr":"172.21.15.162:6825/1421879617","heartbeat_front_addr":"172.21.15.162:6823/1421879617","state":["exists","up"]},{"osd":11,"uuid":"118563d9-1e8f-4dc7-a92c-2f4c4dc3e20f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6817","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6819","nonce":3219928272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6824","nonce":3219928272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6831","nonce":3219928272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6828","nonce":3219928272}]},"public_addr":"172.21.15.181:6819/3219928272","cluster_addr":"172.21.15.181:6824/3219928272","heartbeat_back_addr":"172.21.15.181:6831/3219928272","heartbeat_front_addr":"172.21.15.181:6828/3219928272","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.651219+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.549859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.529659+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.591004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.440836+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.414250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.630130+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.411954+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.439371+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.428173+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.511203+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.482806+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T23:01:39.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.154+0000 7ff4cca00640 1 -- 172.21.15.99:0/478148011 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7ff4a809edf0 msgr2=0x7ff4a80a12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:39.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.154+0000 7ff4cca00640 1 --2- 172.21.15.99:0/478148011 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7ff4a809edf0 0x7ff4a80a12b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff4b8036000 tx=0x7ff4b8008030 comp rx=0 tx=0).stop 2024-02-21T23:01:39.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.154+0000 7ff4cca00640 1 -- 172.21.15.99:0/478148011 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4c8171250 msgr2=0x7ff4c817bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:39.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.154+0000 7ff4cca00640 1 --2- 172.21.15.99:0/478148011 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4c8171250 0x7ff4c817bf40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff4c000efc0 tx=0x7ff4c000c490 comp rx=0 tx=0).stop 2024-02-21T23:01:39.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.154+0000 7ff4cca00640 1 -- 172.21.15.99:0/478148011 shutdown_connections 2024-02-21T23:01:39.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.154+0000 7ff4cca00640 1 --2- 172.21.15.99:0/478148011 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7ff4a809edf0 0x7ff4a80a12b0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:39.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.154+0000 7ff4cca00640 1 --2- 172.21.15.99:0/478148011 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff4c8171250 0x7ff4c817bf40 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:39.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.154+0000 7ff4cca00640 1 --2- 172.21.15.99:0/478148011 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff4c818c290 0x7ff4c80f8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:39.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.154+0000 7ff4cca00640 1 --2- 172.21.15.99:0/478148011 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4c818bb70 0x7ff4c8180810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:39.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.154+0000 7ff4cca00640 1 -- 172.21.15.99:0/478148011 >> 172.21.15.99:0/478148011 conn(0x7ff4c80f8e10 msgr2=0x7ff4c80f91f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:39.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.154+0000 7ff4cca00640 1 -- 172.21.15.99:0/478148011 shutdown_connections 2024-02-21T23:01:39.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.154+0000 7ff4cca00640 1 -- 172.21.15.99:0/478148011 wait complete. 2024-02-21T23:01:39.161 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-02-21T23:01:39.162 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T23:01:39.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.367+0000 7f7606600640 1 Processor -- start 2024-02-21T23:01:39.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.368+0000 7f7606600640 1 -- start start 2024-02-21T23:01:39.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.370+0000 7f7606600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f7600184f00 0x7f76000fa030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:39.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.371+0000 7f7606600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76001854f0 con 0x7f7600180b40 2024-02-21T23:01:39.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.371+0000 7f7606600640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76001857d0 con 0x7f76000fa570 2024-02-21T23:01:39.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.371+0000 7f7606600640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76001863e0 con 0x7f7600184f00 2024-02-21T23:01:39.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.371+0000 7f7605200640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f7600180b40 0x7f76001847f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.99:46952/0 (socket says 172.21.15.99:46952) 2024-02-21T23:01:39.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.371+0000 7f7605200640 1 -- 172.21.15.99:0/1548657193 learned_addr learned my addr 172.21.15.99:0/1548657193 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:01:39.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.371+0000 7f75ffe00640 1 --2- 172.21.15.99:0/1548657193 >> v2:172.21.15.162:3300/0 conn(0x7f7600184f00 0x7f76000fa030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:39.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.371+0000 7f75ff400640 1 -- 172.21.15.99:0/1548657193 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3528731405 0 0) 0x7f76001854f0 con 0x7f7600180b40 2024-02-21T23:01:39.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.371+0000 7f75ff400640 1 -- 172.21.15.99:0/1548657193 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75e8003520 con 0x7f7600180b40 2024-02-21T23:01:39.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.371+0000 7f75ff400640 1 -- 172.21.15.99:0/1548657193 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1760635176 0 0) 0x7f76001857d0 con 0x7f76000fa570 2024-02-21T23:01:39.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.371+0000 7f75ff400640 1 -- 172.21.15.99:0/1548657193 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76001854f0 con 0x7f76000fa570 2024-02-21T23:01:39.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.371+0000 7f75ffe00640 1 -- 172.21.15.99:0/1548657193 >> v1:172.21.15.181:6789/0 conn(0x7f76000fa570 legacy=0x7f760006f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:39.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.371+0000 7f75ffe00640 1 -- 172.21.15.99:0/1548657193 >> v1:172.21.15.162:6789/0 conn(0x7f7600180b40 legacy=0x7f76001847f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:39.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.371+0000 7f75ffe00640 1 -- 172.21.15.99:0/1548657193 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7600185ab0 con 0x7f7600184f00 2024-02-21T23:01:39.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.373+0000 7f75ffe00640 1 --2- 172.21.15.99:0/1548657193 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7600184f00 0x7f76000fa030 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f75ec0097a0 tx=0x7f75ec02b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2471afb835c89bde server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:39.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.373+0000 7f75ff400640 1 -- 172.21.15.99:0/1548657193 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ec0315a0 con 0x7f7600184f00 2024-02-21T23:01:39.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.374+0000 7f75ff400640 1 -- 172.21.15.99:0/1548657193 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75ec037070 con 0x7f7600184f00 2024-02-21T23:01:39.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.374+0000 7f75ff400640 1 -- 172.21.15.99:0/1548657193 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ec031960 con 0x7f7600184f00 2024-02-21T23:01:39.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.374+0000 7f7606600640 1 -- 172.21.15.99:0/1548657193 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7600184f00 msgr2=0x7f76000fa030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:39.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.374+0000 7f7606600640 1 --2- 172.21.15.99:0/1548657193 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7600184f00 0x7f76000fa030 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f75ec0097a0 tx=0x7f75ec02b840 comp rx=0 tx=0).stop 2024-02-21T23:01:39.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.374+0000 7f7606600640 1 -- 172.21.15.99:0/1548657193 shutdown_connections 2024-02-21T23:01:39.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.374+0000 7f7606600640 1 --2- 172.21.15.99:0/1548657193 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7600184f00 0x7f76000fa030 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:39.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.374+0000 7f7606600640 1 -- 172.21.15.99:0/1548657193 >> 172.21.15.99:0/1548657193 conn(0x7f76000f8bb0 msgr2=0x7f76000f8fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:39.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.375+0000 7f7606600640 1 -- 172.21.15.99:0/1548657193 shutdown_connections 2024-02-21T23:01:39.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.375+0000 7f7606600640 1 -- 172.21.15.99:0/1548657193 wait complete. 2024-02-21T23:01:39.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.378+0000 7f7606600640 1 Processor -- start 2024-02-21T23:01:39.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.378+0000 7f7606600640 1 -- start start 2024-02-21T23:01:39.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.380+0000 7f7606600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f76000fa570 0x7f76001781a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:39.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.380+0000 7f7606600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7600180b40 0x7f76000f84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:39.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.380+0000 7f7606600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7600184f00 0x7f760016f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:39.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.380+0000 7f7606600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76000faa00 con 0x7f7600180b40 2024-02-21T23:01:39.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.380+0000 7f7606600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7600186070 con 0x7f7600184f00 2024-02-21T23:01:39.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.380+0000 7f7606600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76000fab80 con 0x7f76000fa570 2024-02-21T23:01:39.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.380+0000 7f75ffe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7600180b40 0x7f76000f84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:39.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.380+0000 7f75ffe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7600180b40 0x7f76000f84f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59416/0 (socket says 172.21.15.99:59416) 2024-02-21T23:01:39.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.380+0000 7f75ffe00640 1 -- 172.21.15.99:0/1568452346 learned_addr learned my addr 172.21.15.99:0/1568452346 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:39.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.380+0000 7f7605c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7600184f00 0x7f760016f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:39.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.380+0000 7f7605200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f76000fa570 0x7f76001781a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:39.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.381+0000 7f7605c00640 1 -- 172.21.15.99:0/1568452346 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f76000fa570 msgr2=0x7f76001781a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:39.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.381+0000 7f7605c00640 1 --2- 172.21.15.99:0/1568452346 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f76000fa570 0x7f76001781a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:39.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.381+0000 7f7605c00640 1 -- 172.21.15.99:0/1568452346 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7600180b40 msgr2=0x7f76000f84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:39.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.381+0000 7f7605c00640 1 --2- 172.21.15.99:0/1568452346 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7600180b40 0x7f76000f84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:39.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.381+0000 7f7605c00640 1 -- 172.21.15.99:0/1568452346 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7600178850 con 0x7f7600184f00 2024-02-21T23:01:39.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.381+0000 7f7605200640 1 --2- 172.21.15.99:0/1568452346 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f76000fa570 0x7f76001781a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:01:39.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.381+0000 7f7605c00640 1 --2- 172.21.15.99:0/1568452346 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7600184f00 0x7f760016f480 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f75f800c760 tx=0x7f75f800cc20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:39.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.382+0000 7f75fcc00640 1 -- 172.21.15.99:0/1568452346 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f8003b70 con 0x7f7600184f00 2024-02-21T23:01:39.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.382+0000 7f75fcc00640 1 -- 172.21.15.99:0/1568452346 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75f8003d30 con 0x7f7600184f00 2024-02-21T23:01:39.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.382+0000 7f7606600640 1 -- 172.21.15.99:0/1568452346 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7600178b30 con 0x7f7600184f00 2024-02-21T23:01:39.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.382+0000 7f75fcc00640 1 -- 172.21.15.99:0/1568452346 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f800aa90 con 0x7f7600184f00 2024-02-21T23:01:39.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.382+0000 7f7606600640 1 -- 172.21.15.99:0/1568452346 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76001790f0 con 0x7f7600184f00 2024-02-21T23:01:39.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.383+0000 7f7606600640 1 -- 172.21.15.99:0/1568452346 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7600068320 con 0x7f7600184f00 2024-02-21T23:01:39.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.387+0000 7f75fcc00640 1 -- 172.21.15.99:0/1568452346 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 6) v1 ==== 134407+0+0 (secure 0 0 0) 0x7f75f800ac30 con 0x7f7600184f00 2024-02-21T23:01:39.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.388+0000 7f75fcc00640 1 --2- 172.21.15.99:0/1568452346 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f75e009edf0 0x7f75e00a12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:39.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.388+0000 7f75fcc00640 1 -- 172.21.15.99:0/1568452346 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f75f80ca450 con 0x7f7600184f00 2024-02-21T23:01:39.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.388+0000 7f7605200640 1 --2- 172.21.15.99:0/1568452346 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f75e009edf0 0x7f75e00a12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:39.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.388+0000 7f75fcc00640 1 -- 172.21.15.99:0/1568452346 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f75f8098650 con 0x7f7600184f00 2024-02-21T23:01:39.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.389+0000 7f7605200640 1 --2- 172.21.15.99:0/1568452346 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f75e009edf0 0x7f75e00a12b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f75f4000f60 tx=0x7f75f4007d50 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:39.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.595+0000 7f7606600640 1 -- 172.21.15.99:0/1568452346 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f76000fa1e0 con 0x7f7600184f00 2024-02-21T23:01:39.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.596+0000 7f75fcc00640 1 -- 172.21.15.99:0/1568452346 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+23570 (secure 0 0 0) 0x7f75f8097f50 con 0x7f7600184f00 2024-02-21T23:01:39.586 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T23:01:39.586 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":29,"fsid":"e8af98cd-45a1-425f-96a7-f24da8ee4efb","created":"2024-02-21T23:00:44.699708+0000","modified":"2024-02-21T23:01:07.722511+0000","last_up_change":"2024-02-21T23:00:55.749829+0000","last_in_change":"2024-02-21T23:00:48.332297+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T23:00:57.020557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":11.760000228881836,"score_stable":11.760000228881836,"optimal_score":0.17000000178813934,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-21T23:01:01.124398+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-21T23:01:01.684258+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-21T23:01:05.290089+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c49de9b2-dc53-4882-b14c-7059ed40bf59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6809","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6811","nonce":1026112937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6813","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6815","nonce":1026112937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6823","nonce":1026112937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6819","nonce":1026112937}]},"public_addr":"172.21.15.99:6811/1026112937","cluster_addr":"172.21.15.99:6815/1026112937","heartbeat_back_addr":"172.21.15.99:6823/1026112937","heartbeat_front_addr":"172.21.15.99:6819/1026112937","state":["exists","up"]},{"osd":1,"uuid":"58398292-2fe5-4291-94fd-03a0ca29d49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6827","nonce":3030871566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6829","nonce":3030871566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6833","nonce":3030871566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6831","nonce":3030871566}]},"public_addr":"172.21.15.162:6827/3030871566","cluster_addr":"172.21.15.162:6829/3030871566","heartbeat_back_addr":"172.21.15.162:6833/3030871566","heartbeat_front_addr":"172.21.15.162:6831/3030871566","state":["exists","up"]},{"osd":2,"uuid":"94cddec1-e08f-438d-a7c8-48a0e47d71a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6818","nonce":2782386148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6821","nonce":2782386148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6827","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6829","nonce":2782386148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6823","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6825","nonce":2782386148}]},"public_addr":"172.21.15.181:6818/2782386148","cluster_addr":"172.21.15.181:6821/2782386148","heartbeat_back_addr":"172.21.15.181:6829/2782386148","heartbeat_front_addr":"172.21.15.181:6825/2782386148","state":["exists","up"]},{"osd":3,"uuid":"d29abb74-9b89-4fd7-88b1-7c2eb8231189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6801","nonce":2316185310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6803","nonce":2316185310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6807","nonce":2316185310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6805","nonce":2316185310}]},"public_addr":"172.21.15.99:6801/2316185310","cluster_addr":"172.21.15.99:6803/2316185310","heartbeat_back_addr":"172.21.15.99:6807/2316185310","heartbeat_front_addr":"172.21.15.99:6805/2316185310","state":["exists","up"]},{"osd":4,"uuid":"0d8c9ea3-880a-4d69-9dcb-cf7d35abd449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6811","nonce":3137681258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6813","nonce":3137681258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6817","nonce":3137681258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6815","nonce":3137681258}]},"public_addr":"172.21.15.162:6811/3137681258","cluster_addr":"172.21.15.162:6813/3137681258","heartbeat_back_addr":"172.21.15.162:6817/3137681258","heartbeat_front_addr":"172.21.15.162:6815/3137681258","state":["exists","up"]},{"osd":5,"uuid":"2e3a9340-6fd0-4d7a-8e00-fe305649296e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6801","nonce":2011264527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6803","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6805","nonce":2011264527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6811","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6813","nonce":2011264527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6807","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6809","nonce":2011264527}]},"public_addr":"172.21.15.181:6801/2011264527","cluster_addr":"172.21.15.181:6805/2011264527","heartbeat_back_addr":"172.21.15.181:6813/2011264527","heartbeat_front_addr":"172.21.15.181:6809/2011264527","state":["exists","up"]},{"osd":6,"uuid":"d9e37ce7-1b0e-4019-8f2e-b670403abf7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6810","nonce":753870050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6814","nonce":753870050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6822","nonce":753870050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6818","nonce":753870050}]},"public_addr":"172.21.15.99:6810/753870050","cluster_addr":"172.21.15.99:6814/753870050","heartbeat_back_addr":"172.21.15.99:6822/753870050","heartbeat_front_addr":"172.21.15.99:6818/753870050","state":["exists","up"]},{"osd":7,"uuid":"49988754-232e-4b8c-bd72-bfa25b418e5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6803","nonce":1659412949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6805","nonce":1659412949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6809","nonce":1659412949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6807","nonce":1659412949}]},"public_addr":"172.21.15.162:6803/1659412949","cluster_addr":"172.21.15.162:6805/1659412949","heartbeat_back_addr":"172.21.15.162:6809/1659412949","heartbeat_front_addr":"172.21.15.162:6807/1659412949","state":["exists","up"]},{"osd":8,"uuid":"ebc6e462-8368-4d64-b242-9c8735ac672c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6804","nonce":3389807042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6808","nonce":3389807042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6815","nonce":3389807042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6812","nonce":3389807042}]},"public_addr":"172.21.15.181:6804/3389807042","cluster_addr":"172.21.15.181:6808/3389807042","heartbeat_back_addr":"172.21.15.181:6815/3389807042","heartbeat_front_addr":"172.21.15.181:6812/3389807042","state":["exists","up"]},{"osd":9,"uuid":"72af1b02-b965-4d6a-8964-527ec24c4daa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6825","nonce":4055669590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6827","nonce":4055669590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6831","nonce":4055669590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6829","nonce":4055669590}]},"public_addr":"172.21.15.99:6825/4055669590","cluster_addr":"172.21.15.99:6827/4055669590","heartbeat_back_addr":"172.21.15.99:6831/4055669590","heartbeat_front_addr":"172.21.15.99:6829/4055669590","state":["exists","up"]},{"osd":10,"uuid":"adb5cb06-6453-41e4-b847-d7c78bbb7d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6819","nonce":1421879617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6821","nonce":1421879617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6825","nonce":1421879617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6823","nonce":1421879617}]},"public_addr":"172.21.15.162:6819/1421879617","cluster_addr":"172.21.15.162:6821/1421879617","heartbeat_back_addr":"172.21.15.162:6825/1421879617","heartbeat_front_addr":"172.21.15.162:6823/1421879617","state":["exists","up"]},{"osd":11,"uuid":"118563d9-1e8f-4dc7-a92c-2f4c4dc3e20f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6817","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6819","nonce":3219928272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6824","nonce":3219928272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6831","nonce":3219928272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6828","nonce":3219928272}]},"public_addr":"172.21.15.181:6819/3219928272","cluster_addr":"172.21.15.181:6824/3219928272","heartbeat_back_addr":"172.21.15.181:6831/3219928272","heartbeat_front_addr":"172.21.15.181:6828/3219928272","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.651219+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.549859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.529659+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.591004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.440836+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.414250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.630130+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.411954+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.439371+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.428173+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.511203+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.482806+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T23:01:39.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.599+0000 7f7606600640 1 -- 172.21.15.99:0/1568452346 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f75e009edf0 msgr2=0x7f75e00a12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:39.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.599+0000 7f7606600640 1 --2- 172.21.15.99:0/1568452346 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f75e009edf0 0x7f75e00a12b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f75f4000f60 tx=0x7f75f4007d50 comp rx=0 tx=0).stop 2024-02-21T23:01:39.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.599+0000 7f7606600640 1 -- 172.21.15.99:0/1568452346 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7600184f00 msgr2=0x7f760016f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:39.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.599+0000 7f7606600640 1 --2- 172.21.15.99:0/1568452346 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7600184f00 0x7f760016f480 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f75f800c760 tx=0x7f75f800cc20 comp rx=0 tx=0).stop 2024-02-21T23:01:39.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.599+0000 7f7606600640 1 -- 172.21.15.99:0/1568452346 shutdown_connections 2024-02-21T23:01:39.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.599+0000 7f7606600640 1 --2- 172.21.15.99:0/1568452346 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f75e009edf0 0x7f75e00a12b0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:39.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.599+0000 7f7606600640 1 --2- 172.21.15.99:0/1568452346 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7600184f00 0x7f760016f480 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:39.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.599+0000 7f7606600640 1 --2- 172.21.15.99:0/1568452346 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7600180b40 0x7f76000f84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:39.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.599+0000 7f7606600640 1 --2- 172.21.15.99:0/1568452346 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f76000fa570 0x7f76001781a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:39.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.599+0000 7f7606600640 1 -- 172.21.15.99:0/1568452346 >> 172.21.15.99:0/1568452346 conn(0x7f76000f8bb0 msgr2=0x7f76000f8f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:39.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.600+0000 7f7606600640 1 -- 172.21.15.99:0/1568452346 shutdown_connections 2024-02-21T23:01:39.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:39.600+0000 7f7606600640 1 -- 172.21.15.99:0/1568452346 wait complete. 2024-02-21T23:01:39.608 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-02-21T23:01:39.608 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-02-21T23:01:39.609 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-02-21T23:01:39.609 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-02-21T23:01:39.609 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-02-21T23:01:39.610 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-02-21T23:01:39.610 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-02-21T23:01:39.610 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-02-21T23:01:39.611 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.8 flush_pg_stats 2024-02-21T23:01:39.611 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.9 flush_pg_stats 2024-02-21T23:01:39.612 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.10 flush_pg_stats 2024-02-21T23:01:39.612 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.11 flush_pg_stats 2024-02-21T23:01:39.964 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:01:39.981 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:01:39.983 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:01:40.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.060+0000 7f2120800640 1 Processor -- start 2024-02-21T23:01:40.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.060+0000 7f2120800640 1 -- start start 2024-02-21T23:01:40.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.063+0000 7f2120800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f211407d6f0 0x7f211407db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.063+0000 7f2120800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f211407e0b0 0x7f211407e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.063+0000 7f2120800640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2114059410 con 0x7f2114107850 2024-02-21T23:01:40.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.063+0000 7f2120800640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f211410b650 con 0x7f211407e0b0 2024-02-21T23:01:40.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.063+0000 7f2120800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f211410b930 con 0x7f211407d6f0 2024-02-21T23:01:40.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.065+0000 7f211d400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f211407d6f0 0x7f211407db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.065+0000 7f211d400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f211407d6f0 0x7f211407db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:40528/0 (socket says 172.21.15.99:40528) 2024-02-21T23:01:40.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.065+0000 7f211d400640 1 -- 172.21.15.99:0/1391159350 learned_addr learned my addr 172.21.15.99:0/1391159350 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:40.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.065+0000 7f211e800640 1 --2- 172.21.15.99:0/1391159350 >> v2:172.21.15.99:3300/0 conn(0x7f211407e0b0 0x7f211407e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.067+0000 7f211e800640 1 -- 172.21.15.99:0/1391159350 >> v2:172.21.15.162:3300/0 conn(0x7f211407d6f0 msgr2=0x7f211407db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:40.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.067+0000 7f211e800640 1 --2- 172.21.15.99:0/1391159350 >> v2:172.21.15.162:3300/0 conn(0x7f211407d6f0 0x7f211407db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.067+0000 7f211e800640 1 -- 172.21.15.99:0/1391159350 >> v1:172.21.15.99:6789/0 conn(0x7f2114107850 legacy=0x7f2114058d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.067+0000 7f211e800640 1 -- 172.21.15.99:0/1391159350 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f211410bc10 con 0x7f211407e0b0 2024-02-21T23:01:40.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.069+0000 7f211e800640 1 --2- 172.21.15.99:0/1391159350 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f211407e0b0 0x7f211407e540 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2118050500 tx=0x7f21180a7510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0627a740124175c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:40.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.070+0000 7f211ca00640 1 -- 172.21.15.99:0/1391159350 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21180ae600 con 0x7f211407e0b0 2024-02-21T23:01:40.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.070+0000 7f211ca00640 1 -- 172.21.15.99:0/1391159350 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21180ae7a0 con 0x7f211407e0b0 2024-02-21T23:01:40.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.070+0000 7f211ca00640 1 -- 172.21.15.99:0/1391159350 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21180aec10 con 0x7f211407e0b0 2024-02-21T23:01:40.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.072+0000 7f2120800640 1 -- 172.21.15.99:0/1391159350 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f211407e0b0 msgr2=0x7f211407e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.072+0000 7fb762e00640 1 Processor -- start 2024-02-21T23:01:40.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.072+0000 7fb762e00640 1 -- start start 2024-02-21T23:01:40.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.072+0000 7f2120800640 1 --2- 172.21.15.99:0/1391159350 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f211407e0b0 0x7f211407e540 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2118050500 tx=0x7f21180a7510 comp rx=0 tx=0).stop 2024-02-21T23:01:40.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.073+0000 7f2120800640 1 -- 172.21.15.99:0/1391159350 shutdown_connections 2024-02-21T23:01:40.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.073+0000 7f2120800640 1 --2- 172.21.15.99:0/1391159350 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f211407e0b0 0x7f211407e540 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.073+0000 7f2120800640 1 --2- 172.21.15.99:0/1391159350 >> v2:172.21.15.162:3300/0 conn(0x7f211407d6f0 0x7f211407db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.073+0000 7f2120800640 1 -- 172.21.15.99:0/1391159350 >> 172.21.15.99:0/1391159350 conn(0x7f2114057240 msgr2=0x7f2114057650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:40.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.073+0000 7f2120800640 1 -- 172.21.15.99:0/1391159350 shutdown_connections 2024-02-21T23:01:40.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.073+0000 7f2120800640 1 -- 172.21.15.99:0/1391159350 wait complete. 2024-02-21T23:01:40.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.076+0000 7fb762e00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fb75c165630 0x7fb75c0fd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.077+0000 7fb75be00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fb75c165630 0x7fb75c0fd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.077+0000 7fb75be00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fb75c165630 0x7fb75c0fd8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:43566/0 (socket says 172.21.15.99:43566) 2024-02-21T23:01:40.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.078+0000 7fb760e00640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fb75c0d02f0 0x7fb75c1936f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:48532/0 (socket says 172.21.15.99:48532) 2024-02-21T23:01:40.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.078+0000 7fb75be00640 1 -- 172.21.15.99:0/3672419870 learned_addr learned my addr 172.21.15.99:0/3672419870 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:40.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.078+0000 7fb762e00640 1 -- 172.21.15.99:0/3672419870 --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb75c0fc280 con 0x7fb75c0fde20 2024-02-21T23:01:40.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.078+0000 7fb762e00640 1 -- 172.21.15.99:0/3672419870 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb75c0fc560 con 0x7fb75c0d02f0 2024-02-21T23:01:40.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.079+0000 7fb762e00640 1 -- 172.21.15.99:0/3672419870 --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb75c165a10 con 0x7fb75c165630 2024-02-21T23:01:40.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.080+0000 7f2120800640 1 Processor -- start 2024-02-21T23:01:40.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.081+0000 7f2120800640 1 -- start start 2024-02-21T23:01:40.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.083+0000 7fb75aa00640 1 -- 172.21.15.99:0/3672419870 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1120482297 0 0) 0x7fb75c0fc560 con 0x7fb75c0d02f0 2024-02-21T23:01:40.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.083+0000 7fb75aa00640 1 -- 172.21.15.99:0/3672419870 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb744003520 con 0x7fb75c0d02f0 2024-02-21T23:01:40.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.083+0000 7fb75be00640 1 -- 172.21.15.99:0/3672419870 >> v1:172.21.15.181:6789/0 conn(0x7fb75c0d02f0 legacy=0x7fb75c1936f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.083+0000 7fb75be00640 1 -- 172.21.15.99:0/3672419870 >> v1:172.21.15.162:6789/0 conn(0x7fb75c0fde20 legacy=0x7fb75c0cfbe0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T23:01:40.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.083+0000 7fb75be00640 1 -- 172.21.15.99:0/3672419870 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb75c0fc840 con 0x7fb75c165630 2024-02-21T23:01:40.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.084+0000 7f2120800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f211407d6f0 0x7f21140f3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.085+0000 7fb75be00640 1 --2- 172.21.15.99:0/3672419870 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb75c165630 0x7fb75c0fd8e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb748009870 tx=0x7fb74802b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4caf525c61d4797f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:40.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.085+0000 7fb75aa00640 1 -- 172.21.15.99:0/3672419870 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb748035020 con 0x7fb75c165630 2024-02-21T23:01:40.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.085+0000 7fb75aa00640 1 -- 172.21.15.99:0/3672419870 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb748031890 con 0x7fb75c165630 2024-02-21T23:01:40.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.085+0000 7fb75aa00640 1 -- 172.21.15.99:0/3672419870 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb748031ca0 con 0x7fb75c165630 2024-02-21T23:01:40.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.085+0000 7f2120800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f211407e0b0 0x7f2114057b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.087+0000 7f2120800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2114107850 0x7f2114078540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.087+0000 7fb762e00640 1 -- 172.21.15.99:0/3672419870 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb75c165630 msgr2=0x7fb75c0fd8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.087+0000 7fb762e00640 1 --2- 172.21.15.99:0/3672419870 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb75c165630 0x7fb75c0fd8e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb748009870 tx=0x7fb74802b930 comp rx=0 tx=0).stop 2024-02-21T23:01:40.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.088+0000 7f211e800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2114107850 0x7f2114078540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.088+0000 7f211e800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2114107850 0x7f2114078540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:43574/0 (socket says 172.21.15.99:43574) 2024-02-21T23:01:40.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.088+0000 7f211e800640 1 -- 172.21.15.99:0/2369439812 learned_addr learned my addr 172.21.15.99:0/2369439812 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:40.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.088+0000 7fb762e00640 1 -- 172.21.15.99:0/3672419870 shutdown_connections 2024-02-21T23:01:40.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.088+0000 7fb762e00640 1 --2- 172.21.15.99:0/3672419870 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb75c165630 0x7fb75c0fd8e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.088+0000 7fb762e00640 1 -- 172.21.15.99:0/3672419870 >> 172.21.15.99:0/3672419870 conn(0x7fb75c0fae00 msgr2=0x7fb75c0fb1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:40.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.089+0000 7f2120800640 1 -- 172.21.15.99:0/2369439812 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f211410c4b0 con 0x7f211407d6f0 2024-02-21T23:01:40.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.089+0000 7f2120800640 1 -- 172.21.15.99:0/2369439812 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f211410c1d0 con 0x7f211407e0b0 2024-02-21T23:01:40.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.089+0000 7f2120800640 1 -- 172.21.15.99:0/2369439812 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2114006350 con 0x7f2114107850 2024-02-21T23:01:40.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.090+0000 7f211d400640 1 --2- 172.21.15.99:0/2369439812 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f211407e0b0 0x7f2114057b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.090+0000 7f211de00640 1 --2- 172.21.15.99:0/2369439812 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f211407d6f0 0x7f21140f3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.091+0000 7f211e800640 1 -- 172.21.15.99:0/2369439812 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f211407e0b0 msgr2=0x7f2114057b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.091+0000 7f211e800640 1 --2- 172.21.15.99:0/2369439812 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f211407e0b0 0x7f2114057b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.091+0000 7f211e800640 1 -- 172.21.15.99:0/2369439812 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f211407d6f0 msgr2=0x7f21140f3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.091+0000 7f211e800640 1 --2- 172.21.15.99:0/2369439812 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f211407d6f0 0x7f21140f3a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.091+0000 7f211e800640 1 -- 172.21.15.99:0/2369439812 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2114078f60 con 0x7f2114107850 2024-02-21T23:01:40.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.106+0000 7f211e800640 1 --2- 172.21.15.99:0/2369439812 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2114107850 0x7f2114078540 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f211807bb10 tx=0x7f21180a9000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:40.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.106+0000 7f2112000640 1 -- 172.21.15.99:0/2369439812 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21180bd070 con 0x7f2114107850 2024-02-21T23:01:40.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.107+0000 7f2112000640 1 -- 172.21.15.99:0/2369439812 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21180acd00 con 0x7f2114107850 2024-02-21T23:01:40.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.108+0000 7f2112000640 1 -- 172.21.15.99:0/2369439812 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21180bd070 con 0x7f2114107850 2024-02-21T23:01:40.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.111+0000 7f2120800640 1 -- 172.21.15.99:0/2369439812 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2114079240 con 0x7f2114107850 2024-02-21T23:01:40.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.111+0000 7f2120800640 1 -- 172.21.15.99:0/2369439812 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2114079800 con 0x7f2114107850 2024-02-21T23:01:40.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.112+0000 7f2120800640 1 -- 172.21.15.99:0/2369439812 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f21141a5b40 con 0x7f2114107850 2024-02-21T23:01:40.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.120+0000 7f5d3fe00640 1 Processor -- start 2024-02-21T23:01:40.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.120+0000 7f5d3fe00640 1 -- start start 2024-02-21T23:01:40.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.123+0000 7f5d3fe00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f5d40182a80 0x7f5d4018a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.123+0000 7f5d3fe00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5d400719b0 0x7f5d40071e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.123+0000 7f5d3ea00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f5d40182a80 0x7f5d4018a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.123+0000 7f5d3ea00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f5d40182a80 0x7f5d4018a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:43590/0 (socket says 172.21.15.99:43590) 2024-02-21T23:01:40.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.124+0000 7f5d3f400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5d400719b0 0x7f5d40071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.124+0000 7f5d3f400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5d400719b0 0x7f5d40071e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:40538/0 (socket says 172.21.15.99:40538) 2024-02-21T23:01:40.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.124+0000 7f5d3e000640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f5d4018b980 0x7f5d40186a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:48544/0 (socket says 172.21.15.99:48544) 2024-02-21T23:01:40.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.125+0000 7f5d3ea00640 1 -- 172.21.15.99:0/2841596539 learned_addr learned my addr 172.21.15.99:0/2841596539 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:40.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.125+0000 7f5d3fe00640 1 -- 172.21.15.99:0/2841596539 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d4018a600 con 0x7f5d4018b980 2024-02-21T23:01:40.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.125+0000 7f5d3fe00640 1 -- 172.21.15.99:0/2841596539 --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d4018a8e0 con 0x7f5d400719b0 2024-02-21T23:01:40.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.125+0000 7f5d3d600640 1 -- 172.21.15.99:0/2841596539 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3651263687 0 0) 0x7f5d4018a600 con 0x7f5d4018b980 2024-02-21T23:01:40.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.125+0000 7f5d3fe00640 1 -- 172.21.15.99:0/2841596539 --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d4018abc0 con 0x7f5d40182a80 2024-02-21T23:01:40.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.127+0000 7f5d3d600640 1 -- 172.21.15.99:0/2841596539 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d24003520 con 0x7f5d4018b980 2024-02-21T23:01:40.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.130+0000 7f5d3ea00640 1 -- 172.21.15.99:0/2841596539 >> v2:172.21.15.162:3300/0 conn(0x7f5d400719b0 msgr2=0x7f5d40071e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:40.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.130+0000 7f5d3ea00640 1 --2- 172.21.15.99:0/2841596539 >> v2:172.21.15.162:3300/0 conn(0x7f5d400719b0 0x7f5d40071e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.130+0000 7f5d3ea00640 1 -- 172.21.15.99:0/2841596539 >> v1:172.21.15.181:6789/0 conn(0x7f5d4018b980 legacy=0x7f5d40186a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.131+0000 7f5d3ea00640 1 -- 172.21.15.99:0/2841596539 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d4018aea0 con 0x7f5d40182a80 2024-02-21T23:01:40.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.133+0000 7fb762e00640 1 -- 172.21.15.99:0/3672419870 shutdown_connections 2024-02-21T23:01:40.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.133+0000 7fb762e00640 1 -- 172.21.15.99:0/3672419870 wait complete. 2024-02-21T23:01:40.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.138+0000 7f5d3ea00640 1 --2- 172.21.15.99:0/2841596539 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5d40182a80 0x7f5d4018a010 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5d400926e0 tx=0x7f5d3802be90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8fa3c7cb54974235 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:40.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.139+0000 7f5d3d600640 1 -- 172.21.15.99:0/2841596539 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d3802ca30 con 0x7f5d40182a80 2024-02-21T23:01:40.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.140+0000 7fb762e00640 1 Processor -- start 2024-02-21T23:01:40.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.144+0000 7f5d3d600640 1 -- 172.21.15.99:0/2841596539 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d3802cbd0 con 0x7f5d40182a80 2024-02-21T23:01:40.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.144+0000 7f5d3d600640 1 -- 172.21.15.99:0/2841596539 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d380343f0 con 0x7f5d40182a80 2024-02-21T23:01:40.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.149+0000 7f5d3fe00640 1 -- 172.21.15.99:0/2841596539 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5d40182a80 msgr2=0x7f5d4018a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.149+0000 7f5d3fe00640 1 --2- 172.21.15.99:0/2841596539 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5d40182a80 0x7f5d4018a010 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5d400926e0 tx=0x7f5d3802be90 comp rx=0 tx=0).stop 2024-02-21T23:01:40.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.153+0000 7f5d3fe00640 1 -- 172.21.15.99:0/2841596539 shutdown_connections 2024-02-21T23:01:40.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.153+0000 7f5d3fe00640 1 --2- 172.21.15.99:0/2841596539 >> v2:172.21.15.162:3300/0 conn(0x7f5d400719b0 0x7f5d40071e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.153+0000 7f5d3fe00640 1 --2- 172.21.15.99:0/2841596539 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5d40182a80 0x7f5d4018a010 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.153+0000 7f5d3fe00640 1 -- 172.21.15.99:0/2841596539 >> 172.21.15.99:0/2841596539 conn(0x7f5d400d29f0 msgr2=0x7f5d400d2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:40.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.154+0000 7f5d3fe00640 1 -- 172.21.15.99:0/2841596539 shutdown_connections 2024-02-21T23:01:40.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.154+0000 7f5d3fe00640 1 -- 172.21.15.99:0/2841596539 wait complete. 2024-02-21T23:01:40.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.151+0000 7f2112000640 1 -- 172.21.15.99:0/2369439812 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 6) v1 ==== 134407+0+0 (secure 0 0 0) 0x7f21180cb410 con 0x7f2114107850 2024-02-21T23:01:40.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.148+0000 7fb762e00640 1 -- start start 2024-02-21T23:01:40.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.150+0000 7fb762e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb75c0d02f0 0x7fb75c17f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.150+0000 7fb762e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb75c165630 0x7fb75c0d0e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.150+0000 7fb762e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb75c17fc00 0x7fb75c0d5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.150+0000 7fb762e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb75c0fd0e0 con 0x7fb75c0d02f0 2024-02-21T23:01:40.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.150+0000 7fb762e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb75c0fce00 con 0x7fb75c165630 2024-02-21T23:01:40.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.150+0000 7fb762e00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb75c0fd3c0 con 0x7fb75c17fc00 2024-02-21T23:01:40.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.166+0000 7f2112000640 1 --2- 172.21.15.99:0/2369439812 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f20fc09f070 0x7f20fc0a1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.166+0000 7fb75b400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb75c165630 0x7fb75c0d0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.166+0000 7fb75be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb75c0d02f0 0x7fb75c17f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.166+0000 7fb75b400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb75c165630 0x7fb75c0d0e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:40550/0 (socket says 172.21.15.99:40550) 2024-02-21T23:01:40.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.166+0000 7fb75b400640 1 -- 172.21.15.99:0/1707536192 learned_addr learned my addr 172.21.15.99:0/1707536192 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:40.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.166+0000 7fb760e00640 1 --2- 172.21.15.99:0/1707536192 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb75c17fc00 0x7fb75c0d5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.166+0000 7f2112000640 1 -- 172.21.15.99:0/2369439812 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f2118167610 con 0x7f2114107850 2024-02-21T23:01:40.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.167+0000 7f2112000640 1 --2- 172.21.15.99:0/2369439812 >> [v2:172.21.15.99:6800/2316185310,v1:172.21.15.99:6801/2316185310] conn(0x7f20fc0a9a00 0x7f20fc0abe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.168+0000 7f2112000640 1 -- 172.21.15.99:0/2369439812 --> [v2:172.21.15.99:6800/2316185310,v1:172.21.15.99:6801/2316185310] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f21180c9ec0 con 0x7f20fc0a9a00 2024-02-21T23:01:40.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.168+0000 7f2112000640 1 -- 172.21.15.99:0/2369439812 <== mon.2 v2:172.21.15.181:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2118167a00 con 0x7f2114107850 2024-02-21T23:01:40.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.170+0000 7fb760e00640 1 -- 172.21.15.99:0/1707536192 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb75c165630 msgr2=0x7fb75c0d0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.170+0000 7fb760e00640 1 --2- 172.21.15.99:0/1707536192 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb75c165630 0x7fb75c0d0e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.170+0000 7fb760e00640 1 -- 172.21.15.99:0/1707536192 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb75c0d02f0 msgr2=0x7fb75c17f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.170+0000 7fb760e00640 1 --2- 172.21.15.99:0/1707536192 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb75c0d02f0 0x7fb75c17f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.170+0000 7fb760e00640 1 -- 172.21.15.99:0/1707536192 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb75c0d1980 con 0x7fb75c17fc00 2024-02-21T23:01:40.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.171+0000 7fb760e00640 1 --2- 172.21.15.99:0/1707536192 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb75c17fc00 0x7fb75c0d5600 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb75000c3c0 tx=0x7fb750001e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:40.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.171+0000 7fb74fe00640 1 -- 172.21.15.99:0/1707536192 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7500074e0 con 0x7fb75c17fc00 2024-02-21T23:01:40.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.175+0000 7fb74fe00640 1 -- 172.21.15.99:0/1707536192 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb750007680 con 0x7fb75c17fc00 2024-02-21T23:01:40.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.175+0000 7fb74fe00640 1 -- 172.21.15.99:0/1707536192 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb750004a00 con 0x7fb75c17fc00 2024-02-21T23:01:40.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.175+0000 7f211de00640 1 --2- 172.21.15.99:0/2369439812 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f20fc09f070 0x7f20fc0a1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.177+0000 7f589a200640 1 Processor -- start 2024-02-21T23:01:40.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.177+0000 7f589a200640 1 -- start start 2024-02-21T23:01:40.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.176+0000 7f211d400640 1 --2- 172.21.15.99:0/2369439812 >> [v2:172.21.15.99:6800/2316185310,v1:172.21.15.99:6801/2316185310] conn(0x7f20fc0a9a00 0x7f20fc0abe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.178+0000 7fb762e00640 1 -- 172.21.15.99:0/1707536192 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb75c0d1c60 con 0x7fb75c17fc00 2024-02-21T23:01:40.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.178+0000 7fb762e00640 1 -- 172.21.15.99:0/1707536192 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb75c0d4e00 con 0x7fb75c17fc00 2024-02-21T23:01:40.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.179+0000 7f74d7600640 1 Processor -- start 2024-02-21T23:01:40.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.179+0000 7f74d7600640 1 -- start start 2024-02-21T23:01:40.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.183+0000 7f211d400640 1 --2- 172.21.15.99:0/2369439812 >> [v2:172.21.15.99:6800/2316185310,v1:172.21.15.99:6801/2316185310] conn(0x7f20fc0a9a00 0x7f20fc0abe40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:40.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.183+0000 7f74d7600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f74d006fb80 0x7f74d0191160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.184+0000 7f74d7600640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74d018ad00 con 0x7f74d006e310 2024-02-21T23:01:40.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.184+0000 7f74d5600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f74d006fb80 0x7f74d0191160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.184+0000 7f74d5600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f74d006fb80 0x7f74d0191160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:40566/0 (socket says 172.21.15.99:40566) 2024-02-21T23:01:40.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.184+0000 7f74d5600640 1 -- 172.21.15.99:0/1632192746 learned_addr learned my addr 172.21.15.99:0/1632192746 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:40.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.184+0000 7f74d7600640 1 -- 172.21.15.99:0/1632192746 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74d006e800 con 0x7f74d0190670 2024-02-21T23:01:40.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.184+0000 7f74d7600640 1 -- 172.21.15.99:0/1632192746 --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74d006eae0 con 0x7f74d006fb80 2024-02-21T23:01:40.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.186+0000 7f2112000640 1 -- 172.21.15.99:0/2369439812 <== osd.3 v2:172.21.15.99:6800/2316185310 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f21180c9ec0 con 0x7f20fc0a9a00 2024-02-21T23:01:40.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.186+0000 7f74d5600640 1 -- 172.21.15.99:0/1632192746 >> v1:172.21.15.181:6789/0 conn(0x7f74d0190670 legacy=0x7f74d018aff0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T23:01:40.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.186+0000 7f74d5600640 1 -- 172.21.15.99:0/1632192746 >> v1:172.21.15.99:6789/0 conn(0x7f74d006e310 legacy=0x7f74d0190a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.186+0000 7f74d5600640 1 -- 172.21.15.99:0/1632192746 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74d006edc0 con 0x7f74d006fb80 2024-02-21T23:01:40.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.185+0000 7f5d3fe00640 1 Processor -- start 2024-02-21T23:01:40.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.181+0000 7f0531a00640 1 Processor -- start 2024-02-21T23:01:40.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.181+0000 7f0531a00640 1 -- start start 2024-02-21T23:01:40.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.180+0000 7f589a200640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f5894180930 0x7f5894188ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.180+0000 7f589a200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5894189710 con 0x7f58940cc210 2024-02-21T23:01:40.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.180+0000 7f589a200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58940f63a0 con 0x7f5894187590 2024-02-21T23:01:40.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.180+0000 7f589a200640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5894187d90 con 0x7f5894180930 2024-02-21T23:01:40.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.183+0000 7f5899800640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f58940cc210 0x7f58940cc6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:52564/0 (socket says 172.21.15.99:52564) 2024-02-21T23:01:40.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.183+0000 7f5899800640 1 -- 172.21.15.99:0/4118775882 learned_addr learned my addr 172.21.15.99:0/4118775882 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:01:40.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.189+0000 7f74d5600640 1 --2- 172.21.15.99:0/1632192746 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74d006fb80 0x7f74d0191160 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f74c0009870 tx=0x7f74c002b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81dcf6b41c1fbcc8 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:40.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.189+0000 7f5d3fe00640 1 -- start start 2024-02-21T23:01:40.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.189+0000 7f0531a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f052c0f6560 0x7f052c190f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.190+0000 7f0531a00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f052c0f51e0 con 0x7f052c0f4d60 2024-02-21T23:01:40.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.190+0000 7fb762e00640 1 -- 172.21.15.99:0/1707536192 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb75c0ce930 con 0x7fb75c17fc00 2024-02-21T23:01:40.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.188+0000 7f211de00640 1 --2- 172.21.15.99:0/2369439812 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f20fc09f070 0x7f20fc0a1530 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f210c0016e0 tx=0x7f210c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:40.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.190+0000 7f74cf400640 1 -- 172.21.15.99:0/1632192746 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c0035020 con 0x7f74d006fb80 2024-02-21T23:01:40.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.190+0000 7f74cf400640 1 -- 172.21.15.99:0/1632192746 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74c0031870 con 0x7f74d006fb80 2024-02-21T23:01:40.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.190+0000 7f74cf400640 1 -- 172.21.15.99:0/1632192746 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c0031c40 con 0x7f74d006fb80 2024-02-21T23:01:40.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.190+0000 7f0531a00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f052c0f54c0 con 0x7f052c190450 2024-02-21T23:01:40.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.191+0000 7f0531a00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f052c0f57a0 con 0x7f052c0f6560 2024-02-21T23:01:40.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.191+0000 7f052be00640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f052c190450 0x7f052c18e350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:48562/0 (socket says 172.21.15.99:48562) 2024-02-21T23:01:40.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.191+0000 7f052be00640 1 -- 172.21.15.99:0/2158214128 learned_addr learned my addr 172.21.15.99:0/2158214128 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:01:40.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.191+0000 7f052aa00640 1 -- 172.21.15.99:0/2158214128 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1929387464 0 0) 0x7f052c0f54c0 con 0x7f052c190450 2024-02-21T23:01:40.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.191+0000 7f052aa00640 1 -- 172.21.15.99:0/2158214128 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0510003520 con 0x7f052c190450 2024-02-21T23:01:40.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.190+0000 7f052b400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f052c0f4d60 0x7f052c190830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:52594/0 (socket says 172.21.15.99:52594) 2024-02-21T23:01:40.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.192+0000 7f74d7600640 1 -- 172.21.15.99:0/1632192746 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74d006fb80 msgr2=0x7f74d0191160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.192+0000 7f74d7600640 1 --2- 172.21.15.99:0/1632192746 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74d006fb80 0x7f74d0191160 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f74c0009870 tx=0x7f74c002b910 comp rx=0 tx=0).stop 2024-02-21T23:01:40.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.192+0000 7f74d7600640 1 -- 172.21.15.99:0/1632192746 shutdown_connections 2024-02-21T23:01:40.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.192+0000 7f74d7600640 1 --2- 172.21.15.99:0/1632192746 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74d006fb80 0x7f74d0191160 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.192+0000 7f74d7600640 1 -- 172.21.15.99:0/1632192746 >> 172.21.15.99:0/1632192746 conn(0x7f74d00ce5f0 msgr2=0x7f74d00cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:40.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.191+0000 7f0531000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f052c0f6560 0x7f052c190f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.193+0000 7f5898e00640 1 --2- 172.21.15.99:0/4118775882 >> v2:172.21.15.181:3300/0 conn(0x7f5894180930 0x7f5894188ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.193+0000 7f052aa00640 1 -- 172.21.15.99:0/2158214128 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 958318265 0 0) 0x7f052c0f51e0 con 0x7f052c0f4d60 2024-02-21T23:01:40.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.193+0000 7f052aa00640 1 -- 172.21.15.99:0/2158214128 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f052c0f54c0 con 0x7f052c0f4d60 2024-02-21T23:01:40.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.193+0000 7f0531000640 1 -- 172.21.15.99:0/2158214128 >> v1:172.21.15.181:6789/0 conn(0x7f052c190450 legacy=0x7f052c18e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.194+0000 7f5893400640 1 -- 172.21.15.99:0/4118775882 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 645870503 0 0) 0x7f58940f63a0 con 0x7f5894187590 2024-02-21T23:01:40.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.194+0000 7f5893400640 1 -- 172.21.15.99:0/4118775882 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f587c003520 con 0x7f5894187590 2024-02-21T23:01:40.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.194+0000 7f5898e00640 1 -- 172.21.15.99:0/4118775882 >> v1:172.21.15.162:6789/0 conn(0x7f5894187590 legacy=0x7f5894189000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.194+0000 7f5898e00640 1 -- 172.21.15.99:0/4118775882 >> v1:172.21.15.99:6789/0 conn(0x7f58940cc210 legacy=0x7f58940cc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.194+0000 7f5893400640 1 -- 172.21.15.99:0/4118775882 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 126053638 0 0) 0x7f5894189710 con 0x7f58940cc210 2024-02-21T23:01:40.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.194+0000 7f5898e00640 1 -- 172.21.15.99:0/4118775882 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58940cae60 con 0x7f5894180930 2024-02-21T23:01:40.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.193+0000 7f0531000640 1 -- 172.21.15.99:0/2158214128 >> v1:172.21.15.99:6789/0 conn(0x7f052c0f4d60 legacy=0x7f052c190830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.193+0000 7f0531000640 1 -- 172.21.15.99:0/2158214128 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f052c0f5a80 con 0x7f052c0f6560 2024-02-21T23:01:40.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.193+0000 7f052aa00640 1 -- 172.21.15.99:0/2158214128 <== mon.2 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1752463904 0 0) 0x7f0510003520 con 0x7f052c190450 2024-02-21T23:01:40.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.197+0000 7f56baa00640 1 Processor -- start 2024-02-21T23:01:40.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.197+0000 7f56baa00640 1 -- start start 2024-02-21T23:01:40.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.198+0000 7f74d7600640 1 -- 172.21.15.99:0/1632192746 shutdown_connections 2024-02-21T23:01:40.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.198+0000 7f74d7600640 1 -- 172.21.15.99:0/1632192746 wait complete. 2024-02-21T23:01:40.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.200+0000 7f5898e00640 1 --2- 172.21.15.99:0/4118775882 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5894180930 0x7f5894188ac0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f58880097d0 tx=0x7f588802b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7114cef6562286a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:40.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.200+0000 7f0531000640 1 --2- 172.21.15.99:0/2158214128 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f052c0f6560 0x7f052c190f40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f051c009720 tx=0x7f051c02b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68f86b4576b54682 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:40.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.200+0000 7f052aa00640 1 -- 172.21.15.99:0/2158214128 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f051c038070 con 0x7f052c0f6560 2024-02-21T23:01:40.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.201+0000 7f052aa00640 1 -- 172.21.15.99:0/2158214128 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f051c031520 con 0x7f052c0f6560 2024-02-21T23:01:40.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.201+0000 7f052aa00640 1 -- 172.21.15.99:0/2158214128 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05240019f0 con 0x7f052c0f6560 2024-02-21T23:01:40.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.201+0000 7f74d7600640 1 Processor -- start 2024-02-21T23:01:40.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.201+0000 7f5893400640 1 -- 172.21.15.99:0/4118775882 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58880315a0 con 0x7f5894180930 2024-02-21T23:01:40.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.202+0000 7fb74fe00640 1 -- 172.21.15.99:0/1707536192 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 6) v1 ==== 134407+0+0 (secure 0 0 0) 0x7fb75001a020 con 0x7fb75c17fc00 2024-02-21T23:01:40.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.202+0000 7f74d7600640 1 -- start start 2024-02-21T23:01:40.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.203+0000 7f2e3f000640 1 Processor -- start 2024-02-21T23:01:40.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.202+0000 7f0531a00640 1 -- 172.21.15.99:0/2158214128 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f052c0f6560 msgr2=0x7f052c190f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.202+0000 7f0531a00640 1 --2- 172.21.15.99:0/2158214128 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f052c0f6560 0x7f052c190f40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f051c009720 tx=0x7f051c02b7c0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.204+0000 7f2e3f000640 1 -- start start 2024-02-21T23:01:40.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.204+0000 7f0531a00640 1 -- 172.21.15.99:0/2158214128 shutdown_connections 2024-02-21T23:01:40.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.204+0000 7f0531a00640 1 --2- 172.21.15.99:0/2158214128 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f052c0f6560 0x7f052c190f40 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.204+0000 7f0531a00640 1 -- 172.21.15.99:0/2158214128 >> 172.21.15.99:0/2158214128 conn(0x7f052c0ce430 msgr2=0x7f052c0ce840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:40.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.204+0000 7fc01bc00640 1 Processor -- start 2024-02-21T23:01:40.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.204+0000 7fc01bc00640 1 -- start start 2024-02-21T23:01:40.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.204+0000 7f56baa00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f56b41898b0 0x7f56b418cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.204+0000 7f5893400640 1 -- 172.21.15.99:0/4118775882 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5888037070 con 0x7f5894180930 2024-02-21T23:01:40.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.204+0000 7f5893400640 1 -- 172.21.15.99:0/4118775882 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5888031960 con 0x7f5894180930 2024-02-21T23:01:40.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.204+0000 7f56baa00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56b40f65b0 con 0x7f56b406f0d0 2024-02-21T23:01:40.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.205+0000 7f56baa00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56b40f6890 con 0x7f56b418c290 2024-02-21T23:01:40.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.205+0000 7f56baa00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56b406ec40 con 0x7f56b41898b0 2024-02-21T23:01:40.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.205+0000 7f0531a00640 1 -- 172.21.15.99:0/2158214128 shutdown_connections 2024-02-21T23:01:40.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.205+0000 7f0531a00640 1 -- 172.21.15.99:0/2158214128 wait complete. 2024-02-21T23:01:40.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.205+0000 7f74d7600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f74d006e310 0x7f74d01730b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.205+0000 7f74d7600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74d006fb80 0x7f74d01736e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.205+0000 7f74d7600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f74d0173c20 0x7f74d0217790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.206+0000 7f589a200640 1 -- 172.21.15.99:0/4118775882 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5894180930 msgr2=0x7f5894188ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.206+0000 7f74d7600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74d006f660 con 0x7f74d0173c20 2024-02-21T23:01:40.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.206+0000 7f74d7600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74d006f380 con 0x7f74d006fb80 2024-02-21T23:01:40.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.206+0000 7f74d7600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74d018b700 con 0x7f74d006e310 2024-02-21T23:01:40.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.206+0000 7f74cfe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74d006fb80 0x7f74d01736e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.207+0000 7f589a200640 1 --2- 172.21.15.99:0/4118775882 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5894180930 0x7f5894188ac0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f58880097d0 tx=0x7f588802b840 comp rx=0 tx=0).stop 2024-02-21T23:01:40.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.207+0000 7f2e3f000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2e3818ab00 0x7f2e38184a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.207+0000 7f2e3f000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e3817d980 con 0x7f2e38186b90 2024-02-21T23:01:40.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.207+0000 7f2e3f000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e38185950 con 0x7f2e38187680 2024-02-21T23:01:40.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.207+0000 7f2e3f000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e38185c30 con 0x7f2e3818ab00 2024-02-21T23:01:40.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.207+0000 7f74cfe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74d006fb80 0x7f74d01736e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:40576/0 (socket says 172.21.15.99:40576) 2024-02-21T23:01:40.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.207+0000 7f74cfe00640 1 -- 172.21.15.99:0/460668298 learned_addr learned my addr 172.21.15.99:0/460668298 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:40.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.207+0000 7f74d5600640 1 --2- 172.21.15.99:0/460668298 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f74d0173c20 0x7f74d0217790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.207+0000 7f56b3400640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f56b41898b0 0x7f56b418cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.207+0000 7f56b3400640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f56b41898b0 0x7f56b418cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:43610/0 (socket says 172.21.15.99:43610) 2024-02-21T23:01:40.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.207+0000 7f56b3400640 1 -- 172.21.15.99:0/291813722 learned_addr learned my addr 172.21.15.99:0/291813722 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:40.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.208+0000 7f56b3400640 1 -- 172.21.15.99:0/291813722 >> v1:172.21.15.181:6789/0 conn(0x7f56b418c290 legacy=0x7f56b418c670 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T23:01:40.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.208+0000 7f56b3400640 1 -- 172.21.15.99:0/291813722 >> v1:172.21.15.99:6789/0 conn(0x7f56b406f0d0 legacy=0x7f56b406f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.209+0000 7f74cfe00640 1 -- 172.21.15.99:0/460668298 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f74d006e310 msgr2=0x7f74d01730b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-21T23:01:40.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.209+0000 7f74cfe00640 1 --2- 172.21.15.99:0/460668298 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f74d006e310 0x7f74d01730b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.209+0000 7f74cfe00640 1 -- 172.21.15.99:0/460668298 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f74d0173c20 msgr2=0x7f74d0217790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.209+0000 7f74cfe00640 1 --2- 172.21.15.99:0/460668298 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f74d0173c20 0x7f74d0217790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.209+0000 7f74cfe00640 1 -- 172.21.15.99:0/460668298 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74d01741d0 con 0x7f74d006fb80 2024-02-21T23:01:40.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.209+0000 7f2e3d000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2e3818ab00 0x7f2e38184a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.209+0000 7f2e37400640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f2e38187680 0x7f2e3818a3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.99:46960/0 (socket says 172.21.15.99:46960) 2024-02-21T23:01:40.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.209+0000 7f2e37400640 1 -- 172.21.15.99:0/1599375029 learned_addr learned my addr 172.21.15.99:0/1599375029 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:01:40.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.210+0000 7fc01bc00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc014182630 0x7fc01406e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.210+0000 7f2e36a00640 1 -- 172.21.15.99:0/1599375029 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 162444676 0 0) 0x7f2e38185950 con 0x7f2e38187680 2024-02-21T23:01:40.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.210+0000 7f2e36a00640 1 -- 172.21.15.99:0/1599375029 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e1c003520 con 0x7f2e38187680 2024-02-21T23:01:40.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.210+0000 7f2e3d000640 1 -- 172.21.15.99:0/1599375029 >> v1:172.21.15.162:6789/0 conn(0x7f2e38187680 legacy=0x7f2e3818a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.210+0000 7f2e3d000640 1 -- 172.21.15.99:0/1599375029 >> v1:172.21.15.99:6789/0 conn(0x7f2e38186b90 legacy=0x7f2e38186f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.210+0000 7f2e3d000640 1 -- 172.21.15.99:0/1599375029 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e38185f10 con 0x7f2e3818ab00 2024-02-21T23:01:40.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.211+0000 7fc013e00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fc0140708c0 0x7fc0141882a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.99:46966/0 (socket says 172.21.15.99:46966) 2024-02-21T23:01:40.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.211+0000 7f5d3fe00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5d400719b0 0x7f5d4017c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.211+0000 7f5d3fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d40182a80 0x7f5d4017e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.211+0000 7f5d3fe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d4018b980 0x7f5d4017ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.211+0000 7f5d3fe00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4018be00 con 0x7f5d40182a80 2024-02-21T23:01:40.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.211+0000 7f5d3fe00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4018b460 con 0x7f5d4018b980 2024-02-21T23:01:40.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.211+0000 7f5d3fe00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d40182e60 con 0x7f5d400719b0 2024-02-21T23:01:40.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.212+0000 7f5d3e000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d40182a80 0x7f5d4017e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.212+0000 7f5d3e000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d40182a80 0x7f5d4017e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59482/0 (socket says 172.21.15.99:59482) 2024-02-21T23:01:40.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.211+0000 7fc013e00640 1 -- 172.21.15.99:0/4285537137 learned_addr learned my addr 172.21.15.99:0/4285537137 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:01:40.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.211+0000 7fc01bc00640 1 -- 172.21.15.99:0/4285537137 --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc01406ed00 con 0x7fc0140708c0 2024-02-21T23:01:40.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.211+0000 7fc019200640 1 --2- 172.21.15.99:0/4285537137 >> v2:172.21.15.99:3300/0 conn(0x7fc014182630 0x7fc01406e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.212+0000 7fc01bc00640 1 -- 172.21.15.99:0/4285537137 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0140f69c0 con 0x7fc01406e850 2024-02-21T23:01:40.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.207+0000 7f589a200640 1 -- 172.21.15.99:0/4118775882 shutdown_connections 2024-02-21T23:01:40.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.207+0000 7f589a200640 1 --2- 172.21.15.99:0/4118775882 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5894180930 0x7f5894188ac0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.207+0000 7f589a200640 1 -- 172.21.15.99:0/4118775882 >> 172.21.15.99:0/4118775882 conn(0x7f58940ce430 msgr2=0x7f58940ce840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:40.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.211+0000 7f589a200640 1 -- 172.21.15.99:0/4118775882 shutdown_connections 2024-02-21T23:01:40.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.211+0000 7f589a200640 1 -- 172.21.15.99:0/4118775882 wait complete. 2024-02-21T23:01:40.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.212+0000 7fc01bc00640 1 -- 172.21.15.99:0/4285537137 --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc014071ce0 con 0x7fc014182630 2024-02-21T23:01:40.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.212+0000 7f5d3e000640 1 -- 172.21.15.99:0/236543284 learned_addr learned my addr 172.21.15.99:0/236543284 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:40.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.208+0000 7f56b3400640 1 -- 172.21.15.99:0/291813722 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56b406e310 con 0x7f56b41898b0 2024-02-21T23:01:40.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.213+0000 7f0531a00640 1 Processor -- start 2024-02-21T23:01:40.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.212+0000 7f2e3d000640 1 --2- 172.21.15.99:0/1599375029 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e3818ab00 0x7f2e38184a90 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2e30009d90 tx=0x7f2e3002beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e10b98ecfc9f347c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:40.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.213+0000 7f5d3e000640 1 -- 172.21.15.99:0/236543284 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5d400719b0 msgr2=0x7f5d4017c6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-21T23:01:40.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.213+0000 7f5d3e000640 1 --2- 172.21.15.99:0/236543284 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5d400719b0 0x7f5d4017c6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.213+0000 7f5d3e000640 1 -- 172.21.15.99:0/236543284 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d4018b980 msgr2=0x7f5d4017ebe0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-21T23:01:40.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.213+0000 7f2e36a00640 1 -- 172.21.15.99:0/1599375029 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e30039070 con 0x7f2e3818ab00 2024-02-21T23:01:40.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.213+0000 7f5d3e000640 1 --2- 172.21.15.99:0/236543284 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d4018b980 0x7f5d4017ebe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.213+0000 7f5d3e000640 1 -- 172.21.15.99:0/236543284 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d400f9230 con 0x7f5d40182a80 2024-02-21T23:01:40.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.213+0000 7f0531a00640 1 -- start start 2024-02-21T23:01:40.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.213+0000 7fc013400640 1 -- 172.21.15.99:0/4285537137 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4163080330 0 0) 0x7fc01406ed00 con 0x7fc0140708c0 2024-02-21T23:01:40.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.213+0000 7f74cfe00640 1 --2- 172.21.15.99:0/460668298 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74d006fb80 0x7f74d01736e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f74c800c760 tx=0x7f74c800cc20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:40.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.213+0000 7f2e36a00640 1 -- 172.21.15.99:0/1599375029 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e3002cc60 con 0x7f2e3818ab00 2024-02-21T23:01:40.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.213+0000 7fc019200640 1 -- 172.21.15.99:0/4285537137 >> v1:172.21.15.181:6789/0 conn(0x7fc01406e850 legacy=0x7fc0141889b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.213+0000 7fc019200640 1 -- 172.21.15.99:0/4285537137 >> v1:172.21.15.162:6789/0 conn(0x7fc0140708c0 legacy=0x7fc0141882a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.213+0000 7f2e36a00640 1 -- 172.21.15.99:0/1599375029 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e30034660 con 0x7f2e3818ab00 2024-02-21T23:01:40.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.214+0000 7f5d3e000640 1 --2- 172.21.15.99:0/236543284 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d40182a80 0x7f5d4017e6a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5d3000c450 tx=0x7f5d3000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:40.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.214+0000 7fc019200640 1 -- 172.21.15.99:0/4285537137 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc014070df0 con 0x7fc014182630 2024-02-21T23:01:40.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.214+0000 7f56b3400640 1 --2- 172.21.15.99:0/291813722 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f56b41898b0 0x7f56b418cd80 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f56a0009870 tx=0x7f56a002b900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e943345e513cfe93 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:40.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.214+0000 7f56b2a00640 1 -- 172.21.15.99:0/291813722 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a0035020 con 0x7f56b41898b0 2024-02-21T23:01:40.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.214+0000 7f56b2a00640 1 -- 172.21.15.99:0/291813722 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56a002d040 con 0x7f56b41898b0 2024-02-21T23:01:40.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.214+0000 7f56b2a00640 1 -- 172.21.15.99:0/291813722 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a0031a80 con 0x7f56b41898b0 2024-02-21T23:01:40.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.216+0000 7fc019200640 1 --2- 172.21.15.99:0/4285537137 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc014182630 0x7fc01406e310 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc0040081e0 tx=0x7fc00402dc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=175f705c9817b3d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:40.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.216+0000 7f2e3f000640 1 -- 172.21.15.99:0/1599375029 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e3818ab00 msgr2=0x7f2e38184a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.216+0000 7f2e3f000640 1 --2- 172.21.15.99:0/1599375029 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e3818ab00 0x7f2e38184a90 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2e30009d90 tx=0x7f2e3002beb0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.215+0000 7f74ccc00640 1 -- 172.21.15.99:0/460668298 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c8003b70 con 0x7f74d006fb80 2024-02-21T23:01:40.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.215+0000 7f74ccc00640 1 -- 172.21.15.99:0/460668298 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74c8003d10 con 0x7f74d006fb80 2024-02-21T23:01:40.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.215+0000 7f74d7600640 1 -- 172.21.15.99:0/460668298 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74d01744b0 con 0x7f74d006fb80 2024-02-21T23:01:40.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.215+0000 7f74d7600640 1 -- 172.21.15.99:0/460668298 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74d0174a70 con 0x7f74d006fb80 2024-02-21T23:01:40.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.216+0000 7fc013400640 1 -- 172.21.15.99:0/4285537137 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc004008df0 con 0x7fc014182630 2024-02-21T23:01:40.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.216+0000 7f74ccc00640 1 -- 172.21.15.99:0/460668298 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c8003b70 con 0x7f74d006fb80 2024-02-21T23:01:40.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.217+0000 7fc013400640 1 -- 172.21.15.99:0/4285537137 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc00400a0d0 con 0x7fc014182630 2024-02-21T23:01:40.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.217+0000 7f56baa00640 1 -- 172.21.15.99:0/291813722 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f56b41898b0 msgr2=0x7f56b418cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.217+0000 7f56baa00640 1 --2- 172.21.15.99:0/291813722 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f56b41898b0 0x7f56b418cd80 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f56a0009870 tx=0x7f56a002b900 comp rx=0 tx=0).stop 2024-02-21T23:01:40.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.217+0000 7f2e3f000640 1 -- 172.21.15.99:0/1599375029 shutdown_connections 2024-02-21T23:01:40.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.217+0000 7f2e3f000640 1 --2- 172.21.15.99:0/1599375029 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e3818ab00 0x7f2e38184a90 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.217+0000 7f2e3f000640 1 -- 172.21.15.99:0/1599375029 >> 172.21.15.99:0/1599375029 conn(0x7f2e380ce5f0 msgr2=0x7f2e380cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:40.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.215+0000 7f0531a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f052c0f4d60 0x7f052c175350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.218+0000 7f2e3f000640 1 -- 172.21.15.99:0/1599375029 shutdown_connections 2024-02-21T23:01:40.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.218+0000 7fc01bc00640 1 -- 172.21.15.99:0/4285537137 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc014182630 msgr2=0x7fc01406e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.218+0000 7fc013400640 1 -- 172.21.15.99:0/4285537137 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc004008df0 con 0x7fc014182630 2024-02-21T23:01:40.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.218+0000 7fc01bc00640 1 --2- 172.21.15.99:0/4285537137 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc014182630 0x7fc01406e310 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc0040081e0 tx=0x7fc00402dc70 comp rx=0 tx=0).stop 2024-02-21T23:01:40.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.219+0000 7f5d36a00640 1 -- 172.21.15.99:0/236543284 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d30017070 con 0x7f5d40182a80 2024-02-21T23:01:40.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.219+0000 7f5d36a00640 1 -- 172.21.15.99:0/236543284 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d300074a0 con 0x7f5d40182a80 2024-02-21T23:01:40.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.219+0000 7f5d36a00640 1 -- 172.21.15.99:0/236543284 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d30005a30 con 0x7f5d40182a80 2024-02-21T23:01:40.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.219+0000 7f5d3fe00640 1 -- 172.21.15.99:0/236543284 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d400f9510 con 0x7f5d40182a80 2024-02-21T23:01:40.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.218+0000 7f052be00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f052c0f4d60 0x7f052c175350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.218+0000 7f052be00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f052c0f4d60 0x7f052c175350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:43642/0 (socket says 172.21.15.99:43642) 2024-02-21T23:01:40.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.218+0000 7f0531a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f052c0f6560 0x7f052c17acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.219+0000 7f052be00640 1 -- 172.21.15.99:0/2762730665 learned_addr learned my addr 172.21.15.99:0/2762730665 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:40.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.219+0000 7f0531a00640 1 --2- 172.21.15.99:0/2762730665 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f052c190450 0x7f052c180460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.219+0000 7f052b400640 1 --2- 172.21.15.99:0/2762730665 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f052c0f6560 0x7f052c17acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.204+0000 7fb74fe00640 1 --2- 172.21.15.99:0/1707536192 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fb73c09eea0 0x7fb73c0a1360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.204+0000 7fb74fe00640 1 -- 172.21.15.99:0/1707536192 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fb7500c9230 con 0x7fb75c17fc00 2024-02-21T23:01:40.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.204+0000 7fb74fe00640 1 --2- 172.21.15.99:0/1707536192 >> [v2:172.21.15.181:6816/2782386148,v1:172.21.15.181:6818/2782386148] conn(0x7fb73c0a9830 0x7fb73c0abc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.204+0000 7fb74fe00640 1 -- 172.21.15.99:0/1707536192 --> [v2:172.21.15.181:6816/2782386148,v1:172.21.15.181:6818/2782386148] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb75001be70 con 0x7fb73c0a9830 2024-02-21T23:01:40.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.204+0000 7fb74fe00640 1 -- 172.21.15.99:0/1707536192 <== mon.2 v2:172.21.15.181:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb7500d0050 con 0x7fb75c17fc00 2024-02-21T23:01:40.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.207+0000 7fb75b400640 1 --2- 172.21.15.99:0/1707536192 >> [v2:172.21.15.181:6816/2782386148,v1:172.21.15.181:6818/2782386148] conn(0x7fb73c0a9830 0x7fb73c0abc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.218+0000 7f2e3f000640 1 -- 172.21.15.99:0/1599375029 wait complete. 2024-02-21T23:01:40.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.219+0000 7f0531a00640 1 -- 172.21.15.99:0/2762730665 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f052c18ea60 con 0x7f052c190450 2024-02-21T23:01:40.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.219+0000 7f0531a00640 1 -- 172.21.15.99:0/2762730665 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f052c0f6040 con 0x7f052c0f6560 2024-02-21T23:01:40.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.219+0000 7f0531a00640 1 -- 172.21.15.99:0/2762730665 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f052c18ebe0 con 0x7f052c0f4d60 2024-02-21T23:01:40.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.219+0000 7fc01bc00640 1 -- 172.21.15.99:0/4285537137 shutdown_connections 2024-02-21T23:01:40.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.219+0000 7fc01bc00640 1 --2- 172.21.15.99:0/4285537137 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc014182630 0x7fc01406e310 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.219+0000 7fb75be00640 1 --2- 172.21.15.99:0/1707536192 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fb73c09eea0 0x7fb73c0a1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.220+0000 7fc01bc00640 1 -- 172.21.15.99:0/4285537137 >> 172.21.15.99:0/4285537137 conn(0x7fc0140ce5f0 msgr2=0x7fc0140cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:40.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.220+0000 7f0531000640 1 --2- 172.21.15.99:0/2762730665 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f052c190450 0x7f052c180460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.220+0000 7f052b400640 1 -- 172.21.15.99:0/2762730665 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f052c0f4d60 msgr2=0x7f052c175350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.220+0000 7f052b400640 1 --2- 172.21.15.99:0/2762730665 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f052c0f4d60 0x7f052c175350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.220+0000 7f052b400640 1 -- 172.21.15.99:0/2762730665 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f052c190450 msgr2=0x7f052c180460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.220+0000 7f052b400640 1 --2- 172.21.15.99:0/2762730665 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f052c190450 0x7f052c180460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.220+0000 7f74d7600640 1 -- 172.21.15.99:0/460668298 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f74a8001030 con 0x7f74d006fb80 2024-02-21T23:01:40.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.221+0000 7fc01bc00640 1 -- 172.21.15.99:0/4285537137 shutdown_connections 2024-02-21T23:01:40.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.222+0000 7fc01bc00640 1 -- 172.21.15.99:0/4285537137 wait complete. 2024-02-21T23:01:40.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.222+0000 7f052b400640 1 -- 172.21.15.99:0/2762730665 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f052c17b660 con 0x7f052c0f6560 2024-02-21T23:01:40.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.223+0000 7f052b400640 1 --2- 172.21.15.99:0/2762730665 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f052c0f6560 0x7f052c17acb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f051800c460 tx=0x7f051800c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:40.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.223+0000 7f56baa00640 1 -- 172.21.15.99:0/291813722 shutdown_connections 2024-02-21T23:01:40.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.220+0000 7f5d3fe00640 1 -- 172.21.15.99:0/236543284 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d400f9ad0 con 0x7f5d40182a80 2024-02-21T23:01:40.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.221+0000 7f5d3fe00640 1 -- 172.21.15.99:0/236543284 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5d400ff290 con 0x7f5d40182a80 2024-02-21T23:01:40.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.223+0000 7f56baa00640 1 --2- 172.21.15.99:0/291813722 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f56b41898b0 0x7f56b418cd80 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.223+0000 7f56baa00640 1 -- 172.21.15.99:0/291813722 >> 172.21.15.99:0/291813722 conn(0x7f56b40ce5f0 msgr2=0x7f56b40cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:40.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.225+0000 7fb75be00640 1 --2- 172.21.15.99:0/1707536192 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fb73c09eea0 0x7fb73c0a1360 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb748036000 tx=0x7fb74803c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:40.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.225+0000 7fb75b400640 1 --2- 172.21.15.99:0/1707536192 >> [v2:172.21.15.181:6816/2782386148,v1:172.21.15.181:6818/2782386148] conn(0x7fb73c0a9830 0x7fb73c0abc70 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:40.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.225+0000 7f74ccc00640 1 -- 172.21.15.99:0/460668298 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 6) v1 ==== 134407+0+0 (secure 0 0 0) 0x7f74c800a850 con 0x7f74d006fb80 2024-02-21T23:01:40.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.225+0000 7f589a200640 1 Processor -- start 2024-02-21T23:01:40.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.223+0000 7f0523e00640 1 -- 172.21.15.99:0/2762730665 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05180074e0 con 0x7f052c0f6560 2024-02-21T23:01:40.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.226+0000 7f0523e00640 1 -- 172.21.15.99:0/2762730665 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0518007680 con 0x7f052c0f6560 2024-02-21T23:01:40.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.226+0000 7f589a200640 1 -- start start 2024-02-21T23:01:40.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.226+0000 7f0531a00640 1 -- 172.21.15.99:0/2762730665 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f052c17b940 con 0x7f052c0f6560 2024-02-21T23:01:40.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.226+0000 7f0531a00640 1 -- 172.21.15.99:0/2762730665 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f052c17bf00 con 0x7f052c0f6560 2024-02-21T23:01:40.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.227+0000 7f0521600640 1 -- 172.21.15.99:0/2762730665 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0504001030 con 0x7f052c0f6560 2024-02-21T23:01:40.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.226+0000 7fb74fe00640 1 -- 172.21.15.99:0/1707536192 <== osd.2 v2:172.21.15.181:6816/2782386148 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fb75001be70 con 0x7fb73c0a9830 2024-02-21T23:01:40.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.226+0000 7f2e3f000640 1 Processor -- start 2024-02-21T23:01:40.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.226+0000 7f2e3f000640 1 -- start start 2024-02-21T23:01:40.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.230+0000 7f0523e00640 1 -- 172.21.15.99:0/2762730665 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0518004a00 con 0x7f052c0f6560 2024-02-21T23:01:40.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.230+0000 7f74ccc00640 1 --2- 172.21.15.99:0/460668298 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f74b009f070 0x7f74b00a1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.230+0000 7f74ccc00640 1 -- 172.21.15.99:0/460668298 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f74c80c9690 con 0x7f74d006fb80 2024-02-21T23:01:40.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.231+0000 7fc01bc00640 1 Processor -- start 2024-02-21T23:01:40.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.231+0000 7fc01bc00640 1 -- start start 2024-02-21T23:01:40.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.231+0000 7f74ccc00640 1 --2- 172.21.15.99:0/460668298 >> [v2:172.21.15.162:6810/3137681258,v1:172.21.15.162:6811/3137681258] conn(0x7f74b00a9a00 0x7f74b00abe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.231+0000 7f74ccc00640 1 -- 172.21.15.99:0/460668298 --> [v2:172.21.15.162:6810/3137681258,v1:172.21.15.162:6811/3137681258] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f74c801ce50 con 0x7f74b00a9a00 2024-02-21T23:01:40.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.231+0000 7f74ccc00640 1 -- 172.21.15.99:0/460668298 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f74c80d0050 con 0x7f74d006fb80 2024-02-21T23:01:40.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.232+0000 7f2e3f000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2e38186b90 0x7f2e38071d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.232+0000 7f74d5600640 1 --2- 172.21.15.99:0/460668298 >> [v2:172.21.15.162:6810/3137681258,v1:172.21.15.162:6811/3137681258] conn(0x7f74b00a9a00 0x7f74b00abe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.233+0000 7f74d5600640 1 --2- 172.21.15.99:0/460668298 >> [v2:172.21.15.162:6810/3137681258,v1:172.21.15.162:6811/3137681258] conn(0x7f74b00a9a00 0x7f74b00abe40 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:40.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.234+0000 7fc01bc00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc01406e850 0x7fc0140f2700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.234+0000 7fc01bc00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc0140708c0 0x7fc0141558b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.232+0000 7f2e3f000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2e38187680 0x7f2e38072290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.232+0000 7f2e3f000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e3818ab00 0x7f2e380ccf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.232+0000 7f2e37e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2e38186b90 0x7f2e38071d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.232+0000 7f2e37e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2e38186b90 0x7f2e38071d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:43646/0 (socket says 172.21.15.99:43646) 2024-02-21T23:01:40.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.232+0000 7f2e3f000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e381867b0 con 0x7f2e38187680 2024-02-21T23:01:40.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.232+0000 7f2e3f000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e381864d0 con 0x7f2e3818ab00 2024-02-21T23:01:40.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.232+0000 7f2e3f000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e380cbf20 con 0x7f2e38186b90 2024-02-21T23:01:40.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.233+0000 7f2e37e00640 1 -- 172.21.15.99:0/687643593 learned_addr learned my addr 172.21.15.99:0/687643593 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:40.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.233+0000 7f2e3d000640 1 --2- 172.21.15.99:0/687643593 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e3818ab00 0x7f2e380ccf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.233+0000 7f2e37e00640 1 -- 172.21.15.99:0/687643593 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e3818ab00 msgr2=0x7f2e380ccf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.233+0000 7f2e37e00640 1 --2- 172.21.15.99:0/687643593 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e3818ab00 0x7f2e380ccf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.233+0000 7f2e37e00640 1 -- 172.21.15.99:0/687643593 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2e38187680 msgr2=0x7f2e38072290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.233+0000 7f2e37e00640 1 --2- 172.21.15.99:0/687643593 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2e38187680 0x7f2e38072290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.233+0000 7f2e37e00640 1 -- 172.21.15.99:0/687643593 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e380cdd90 con 0x7f2e38186b90 2024-02-21T23:01:40.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.232+0000 7f5d36a00640 1 -- 172.21.15.99:0/236543284 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 6) v1 ==== 134407+0+0 (secure 0 0 0) 0x7f5d3001a070 con 0x7f5d40182a80 2024-02-21T23:01:40.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.234+0000 7f5d36a00640 1 --2- 172.21.15.99:0/236543284 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f5d2009ef40 0x7f5d200a1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.234+0000 7f5d36a00640 1 -- 172.21.15.99:0/236543284 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f5d300cd060 con 0x7f5d40182a80 2024-02-21T23:01:40.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.235+0000 7f5d36a00640 1 --2- 172.21.15.99:0/236543284 >> [v2:172.21.15.99:6809/1026112937,v1:172.21.15.99:6811/1026112937] conn(0x7f5d200a98d0 0x7f5d200abd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.235+0000 7f5d36a00640 1 -- 172.21.15.99:0/236543284 --> [v2:172.21.15.99:6809/1026112937,v1:172.21.15.99:6811/1026112937] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5d30015e70 con 0x7f5d200a98d0 2024-02-21T23:01:40.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.235+0000 7f5d36a00640 1 -- 172.21.15.99:0/236543284 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5d300d1540 con 0x7f5d40182a80 2024-02-21T23:01:40.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.235+0000 7fc019200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc01406e850 0x7fc0140f2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.235+0000 7fc019200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc01406e850 0x7fc0140f2700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:43652/0 (socket says 172.21.15.99:43652) 2024-02-21T23:01:40.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.235+0000 7f74ccc00640 1 -- 172.21.15.99:0/460668298 <== osd.4 v2:172.21.15.162:6810/3137681258 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f74c801ce50 con 0x7f74b00a9a00 2024-02-21T23:01:40.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.235+0000 7fc019200640 1 -- 172.21.15.99:0/1820175833 learned_addr learned my addr 172.21.15.99:0/1820175833 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:40.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.236+0000 7fc013e00640 1 --2- 172.21.15.99:0/1820175833 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc0140708c0 0x7fc0141558b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.236+0000 7fc01bc00640 1 --2- 172.21.15.99:0/1820175833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc014182630 0x7fc0141704b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.236+0000 7fc01bc00640 1 -- 172.21.15.99:0/1820175833 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc014071690 con 0x7fc0140708c0 2024-02-21T23:01:40.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.236+0000 7fc01bc00640 1 -- 172.21.15.99:0/1820175833 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0140713b0 con 0x7fc014182630 2024-02-21T23:01:40.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.236+0000 7fc01bc00640 1 -- 172.21.15.99:0/1820175833 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc014071970 con 0x7fc01406e850 2024-02-21T23:01:40.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.237+0000 7f589a200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f58940cc210 0x7f5894174270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.237+0000 7f589a200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5894180930 0x7f58941686f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.238+0000 7fc013e00640 1 -- 172.21.15.99:0/1820175833 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc01406e850 msgr2=0x7fc0140f2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.238+0000 7fc013e00640 1 --2- 172.21.15.99:0/1820175833 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc01406e850 0x7fc0140f2700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.238+0000 7fc013e00640 1 -- 172.21.15.99:0/1820175833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc014182630 msgr2=0x7fc0141704b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-21T23:01:40.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.238+0000 7fc013e00640 1 --2- 172.21.15.99:0/1820175833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc014182630 0x7fc0141704b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.238+0000 7fc013e00640 1 -- 172.21.15.99:0/1820175833 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0140f2d60 con 0x7fc0140708c0 2024-02-21T23:01:40.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.236+0000 7f0523e00640 1 -- 172.21.15.99:0/2762730665 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 6) v1 ==== 134407+0+0 (secure 0 0 0) 0x7f051801a020 con 0x7f052c0f6560 2024-02-21T23:01:40.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.238+0000 7f0523e00640 1 --2- 172.21.15.99:0/2762730665 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f050c09edf0 0x7f050c0a12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.238+0000 7f0523e00640 1 -- 172.21.15.99:0/2762730665 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f05180c9770 con 0x7f052c0f6560 2024-02-21T23:01:40.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.238+0000 7f0523e00640 1 --2- 172.21.15.99:0/2762730665 >> [v2:172.21.15.162:6826/3030871566,v1:172.21.15.162:6827/3030871566] conn(0x7f050c0a9780 0x7f050c0abbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.238+0000 7f0523e00640 1 -- 172.21.15.99:0/2762730665 --> [v2:172.21.15.162:6826/3030871566,v1:172.21.15.162:6827/3030871566] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0518043ea0 con 0x7f050c0a9780 2024-02-21T23:01:40.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.238+0000 7f0523e00640 1 -- 172.21.15.99:0/2762730665 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f05180c9b80 con 0x7f052c0f6560 2024-02-21T23:01:40.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.233+0000 7f56baa00640 1 -- 172.21.15.99:0/291813722 shutdown_connections 2024-02-21T23:01:40.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.238+0000 7fc019200640 1 --2- 172.21.15.99:0/1820175833 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc01406e850 0x7fc0140f2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:01:40.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.239+0000 7fc013e00640 1 --2- 172.21.15.99:0/1820175833 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc0140708c0 0x7fc0141558b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc00000c450 tx=0x7fc00000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:40.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.240+0000 7fc010c00640 1 -- 172.21.15.99:0/1820175833 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc000018070 con 0x7fc0140708c0 2024-02-21T23:01:40.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.240+0000 7fc010c00640 1 -- 172.21.15.99:0/1820175833 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0000074e0 con 0x7fc0140708c0 2024-02-21T23:01:40.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.237+0000 7f5898e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f58940cc210 0x7f5894174270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.238+0000 7f5898e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f58940cc210 0x7f5894174270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59524/0 (socket says 172.21.15.99:59524) 2024-02-21T23:01:40.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.238+0000 7f5898e00640 1 -- 172.21.15.99:0/2316071641 learned_addr learned my addr 172.21.15.99:0/2316071641 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:40.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.241+0000 7f589a200640 1 --2- 172.21.15.99:0/2316071641 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5894187590 0x7f5894168c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.241+0000 7f589a200640 1 -- 172.21.15.99:0/2316071641 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58941882c0 con 0x7f58940cc210 2024-02-21T23:01:40.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.241+0000 7f589a200640 1 -- 172.21.15.99:0/2316071641 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5894187fe0 con 0x7f5894187590 2024-02-21T23:01:40.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.241+0000 7f589a200640 1 -- 172.21.15.99:0/2316071641 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58941885a0 con 0x7f5894180930 2024-02-21T23:01:40.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.241+0000 7fc01bc00640 1 -- 172.21.15.99:0/1820175833 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0140f3040 con 0x7fc0140708c0 2024-02-21T23:01:40.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.243+0000 7f052be00640 1 --2- 172.21.15.99:0/2762730665 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f050c09edf0 0x7f050c0a12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.243+0000 7f0531000640 1 --2- 172.21.15.99:0/2762730665 >> [v2:172.21.15.162:6826/3030871566,v1:172.21.15.162:6827/3030871566] conn(0x7f050c0a9780 0x7f050c0abbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.243+0000 7f74d4c00640 1 --2- 172.21.15.99:0/460668298 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f74b009f070 0x7f74b00a1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.239+0000 7f56baa00640 1 -- 172.21.15.99:0/291813722 wait complete. 2024-02-21T23:01:40.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.242+0000 7f56baa00640 1 Processor -- start 2024-02-21T23:01:40.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.242+0000 7f5898e00640 1 -- 172.21.15.99:0/2316071641 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5894180930 msgr2=0x7f58941686f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-21T23:01:40.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.242+0000 7f5898e00640 1 --2- 172.21.15.99:0/2316071641 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5894180930 0x7f58941686f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.242+0000 7f5898e00640 1 -- 172.21.15.99:0/2316071641 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5894187590 msgr2=0x7f5894168c30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-21T23:01:40.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.242+0000 7f5898e00640 1 --2- 172.21.15.99:0/2316071641 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5894187590 0x7f5894168c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.242+0000 7f5898e00640 1 -- 172.21.15.99:0/2316071641 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f589406c180 con 0x7f58940cc210 2024-02-21T23:01:40.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.244+0000 7f052be00640 1 --2- 172.21.15.99:0/2762730665 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f050c09edf0 0x7f050c0a12b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0524005fd0 tx=0x7f05240019d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:40.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.244+0000 7f0531000640 1 --2- 172.21.15.99:0/2762730665 >> [v2:172.21.15.162:6826/3030871566,v1:172.21.15.162:6827/3030871566] conn(0x7f050c0a9780 0x7f050c0abbc0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:40.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.245+0000 7f0523e00640 1 -- 172.21.15.99:0/2762730665 <== osd.1 v2:172.21.15.162:6826/3030871566 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f0518043ea0 con 0x7f050c0a9780 2024-02-21T23:01:40.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.246+0000 7f56baa00640 1 -- start start 2024-02-21T23:01:40.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.246+0000 7f5898e00640 1 --2- 172.21.15.99:0/2316071641 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f58940cc210 0x7f5894174270 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5888000c00 tx=0x7f58880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:40.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.246+0000 7fc01bc00640 1 -- 172.21.15.99:0/1820175833 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0140f3600 con 0x7fc0140708c0 2024-02-21T23:01:40.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.247+0000 7fc010c00640 1 -- 172.21.15.99:0/1820175833 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc000007690 con 0x7fc0140708c0 2024-02-21T23:01:40.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.247+0000 7f74d4c00640 1 --2- 172.21.15.99:0/460668298 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f74b009f070 0x7f74b00a1530 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f74d00f7ca0 tx=0x7f74bc006bd0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:40.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.243+0000 7f5d3f400640 1 --2- 172.21.15.99:0/236543284 >> [v2:172.21.15.99:6809/1026112937,v1:172.21.15.99:6811/1026112937] conn(0x7f5d200a98d0 0x7f5d200abd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.244+0000 7f5d3f400640 1 --2- 172.21.15.99:0/236543284 >> [v2:172.21.15.99:6809/1026112937,v1:172.21.15.99:6811/1026112937] conn(0x7f5d200a98d0 0x7f5d200abd10 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:40.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.246+0000 7f5d36a00640 1 -- 172.21.15.99:0/236543284 <== osd.0 v2:172.21.15.99:6809/1026112937 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f5d30015e70 con 0x7f5d200a98d0 2024-02-21T23:01:40.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.246+0000 7f5d3ea00640 1 --2- 172.21.15.99:0/236543284 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f5d2009ef40 0x7f5d200a1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.247+0000 7f5d3ea00640 1 --2- 172.21.15.99:0/236543284 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f5d2009ef40 0x7f5d200a1400 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5d38035000 tx=0x7f5d38030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:40.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.248+0000 7f56baa00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f56b406f0d0 0x7f56b418a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.249+0000 7f56baa00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56b41898b0 0x7f56b416cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.249+0000 7f56baa00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f56b418c290 0x7f56b42208d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.249+0000 7f56baa00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56b4183060 con 0x7f56b406f0d0 2024-02-21T23:01:40.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.249+0000 7f56b3400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56b41898b0 0x7f56b416cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.249+0000 7f56baa00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56b406e8d0 con 0x7f56b41898b0 2024-02-21T23:01:40.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.249+0000 7f56b3400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56b41898b0 0x7f56b416cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:40634/0 (socket says 172.21.15.99:40634) 2024-02-21T23:01:40.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.249+0000 7f56baa00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56b41831e0 con 0x7f56b418c290 2024-02-21T23:01:40.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.249+0000 7f56b3400640 1 -- 172.21.15.99:0/1834525160 learned_addr learned my addr 172.21.15.99:0/1834525160 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:40.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.249+0000 7f56b8a00640 1 --2- 172.21.15.99:0/1834525160 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f56b418c290 0x7f56b42208d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.249+0000 7f56b3e00640 1 --2- 172.21.15.99:0/1834525160 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f56b406f0d0 0x7f56b418a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.250+0000 7f56b8a00640 1 -- 172.21.15.99:0/1834525160 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56b41898b0 msgr2=0x7f56b416cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.250+0000 7f56b8a00640 1 --2- 172.21.15.99:0/1834525160 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56b41898b0 0x7f56b416cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.250+0000 7f56b8a00640 1 -- 172.21.15.99:0/1834525160 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f56b406f0d0 msgr2=0x7f56b418a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.250+0000 7f56b8a00640 1 --2- 172.21.15.99:0/1834525160 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f56b406f0d0 0x7f56b418a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.250+0000 7f56b8a00640 1 -- 172.21.15.99:0/1834525160 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56b418bf80 con 0x7f56b418c290 2024-02-21T23:01:40.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.250+0000 7f56b3400640 1 --2- 172.21.15.99:0/1834525160 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56b41898b0 0x7f56b416cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:01:40.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.251+0000 7fc010c00640 1 -- 172.21.15.99:0/1820175833 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 6) v1 ==== 134407+0+0 (secure 0 0 0) 0x7fc00001b070 con 0x7fc0140708c0 2024-02-21T23:01:40.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.251+0000 7f5890c00640 1 -- 172.21.15.99:0/2316071641 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5888032630 con 0x7f58940cc210 2024-02-21T23:01:40.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.251+0000 7f589a200640 1 -- 172.21.15.99:0/2316071641 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f589406c460 con 0x7f58940cc210 2024-02-21T23:01:40.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.251+0000 7f589a200640 1 -- 172.21.15.99:0/2316071641 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5894175440 con 0x7f58940cc210 2024-02-21T23:01:40.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.253+0000 7f5886000640 1 -- 172.21.15.99:0/2316071641 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5870001030 con 0x7f58940cc210 2024-02-21T23:01:40.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.254+0000 7fc010c00640 1 --2- 172.21.15.99:0/1820175833 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fbff409edf0 0x7fbff40a12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.254+0000 7f5890c00640 1 -- 172.21.15.99:0/2316071641 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58880327d0 con 0x7f58940cc210 2024-02-21T23:01:40.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.254+0000 7f5890c00640 1 -- 172.21.15.99:0/2316071641 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5888032630 con 0x7f58940cc210 2024-02-21T23:01:40.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.255+0000 7fc289600640 1 Processor -- start 2024-02-21T23:01:40.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.255+0000 7fc010c00640 1 -- 172.21.15.99:0/1820175833 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fc000094bb0 con 0x7fc0140708c0 2024-02-21T23:01:40.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.256+0000 7fc01bc00640 1 -- 172.21.15.99:0/1820175833 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbfec001030 con 0x7fc0140708c0 2024-02-21T23:01:40.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.256+0000 7f2e37e00640 1 --2- 172.21.15.99:0/687643593 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2e38186b90 0x7f2e38071d50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2e2800c400 tx=0x7f2e2800c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:40.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.257+0000 7fc010c00640 1 --2- 172.21.15.99:0/1820175833 >> [v2:172.21.15.99:6808/753870050,v1:172.21.15.99:6810/753870050] conn(0x7fbff40a9710 0x7fbff40abb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.256+0000 7fc289600640 1 -- start start 2024-02-21T23:01:40.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.257+0000 7fc010c00640 1 -- 172.21.15.99:0/1820175833 --> [v2:172.21.15.99:6808/753870050,v1:172.21.15.99:6810/753870050] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc000006e50 con 0x7fbff40a9710 2024-02-21T23:01:40.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.257+0000 7fc010c00640 1 -- 172.21.15.99:0/1820175833 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc0000cd060 con 0x7fc0140708c0 2024-02-21T23:01:40.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.257+0000 7fc019200640 1 --2- 172.21.15.99:0/1820175833 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fbff409edf0 0x7fbff40a12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.257+0000 7fc019c00640 1 --2- 172.21.15.99:0/1820175833 >> [v2:172.21.15.99:6808/753870050,v1:172.21.15.99:6810/753870050] conn(0x7fbff40a9710 0x7fbff40abb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.259+0000 7fc019c00640 1 --2- 172.21.15.99:0/1820175833 >> [v2:172.21.15.99:6808/753870050,v1:172.21.15.99:6810/753870050] conn(0x7fbff40a9710 0x7fbff40abb50 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:40.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.259+0000 7fc019200640 1 --2- 172.21.15.99:0/1820175833 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fbff409edf0 0x7fbff40a12b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc004000c00 tx=0x7fc00400c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:40.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.261+0000 7fc010c00640 1 -- 172.21.15.99:0/1820175833 <== osd.6 v2:172.21.15.99:6808/753870050 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fc000006e50 con 0x7fbff40a9710 2024-02-21T23:01:40.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.263+0000 7f2e2fe00640 1 -- 172.21.15.99:0/687643593 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e28017070 con 0x7f2e38186b90 2024-02-21T23:01:40.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.263+0000 7f2e2fe00640 1 -- 172.21.15.99:0/687643593 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e280052d0 con 0x7f2e38186b90 2024-02-21T23:01:40.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.263+0000 7fc289600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc2840f9500 0x7fc28406d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.263+0000 7fc289600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc28406db40 0x7fc2841883a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.263+0000 7fc289600640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc284071140 con 0x7fc28406d220 2024-02-21T23:01:40.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.264+0000 7fc289600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc284070f10 con 0x7fc2840f9500 2024-02-21T23:01:40.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.264+0000 7fc289600640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc284071fa0 con 0x7fc28406db40 2024-02-21T23:01:40.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.263+0000 7f2e2fe00640 1 -- 172.21.15.99:0/687643593 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e28017070 con 0x7f2e38186b90 2024-02-21T23:01:40.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.255+0000 7f56b3e00640 1 --2- 172.21.15.99:0/1834525160 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f56b406f0d0 0x7f56b418a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:01:40.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.264+0000 7fc281600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc2840f9500 0x7fc28406d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.264+0000 7fc281600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc2840f9500 0x7fc28406d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59548/0 (socket says 172.21.15.99:59548) 2024-02-21T23:01:40.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.264+0000 7fc281600640 1 -- 172.21.15.99:0/3711293159 learned_addr learned my addr 172.21.15.99:0/3711293159 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:40.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.264+0000 7f2e3f000640 1 -- 172.21.15.99:0/687643593 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e380ce070 con 0x7f2e38186b90 2024-02-21T23:01:40.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.264+0000 7f2e3f000640 1 -- 172.21.15.99:0/687643593 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e381620d0 con 0x7f2e38186b90 2024-02-21T23:01:40.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.265+0000 7f2120800640 1 -- 172.21.15.99:0/2369439812 --> [v2:172.21.15.99:6800/2316185310,v1:172.21.15.99:6801/2316185310] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2114005890 con 0x7f20fc0a9a00 2024-02-21T23:01:40.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.266+0000 7f2112000640 1 -- 172.21.15.99:0/2369439812 <== osd.3 v2:172.21.15.99:6800/2316185310 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2114005890 con 0x7f20fc0a9a00 2024-02-21T23:01:40.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.255+0000 7f56b8a00640 1 --2- 172.21.15.99:0/1834525160 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f56b418c290 0x7f56b42208d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f56ac00c760 tx=0x7f56ac00cc20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:40.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.266+0000 7f56abe00640 1 -- 172.21.15.99:0/1834525160 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56ac016020 con 0x7f56b418c290 2024-02-21T23:01:40.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.266+0000 7f56abe00640 1 -- 172.21.15.99:0/1834525160 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56ac006d50 con 0x7f56b418c290 2024-02-21T23:01:40.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.265+0000 7fc281600640 1 -- 172.21.15.99:0/3711293159 >> v2:172.21.15.162:3300/0 conn(0x7fc28406db40 msgr2=0x7fc2841883a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T23:01:40.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.265+0000 7fc281600640 1 --2- 172.21.15.99:0/3711293159 >> v2:172.21.15.162:3300/0 conn(0x7fc28406db40 0x7fc2841883a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.265+0000 7fc281600640 1 -- 172.21.15.99:0/3711293159 >> v1:172.21.15.99:6789/0 conn(0x7fc28406d220 legacy=0x7fc284070800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.265+0000 7fc281600640 1 -- 172.21.15.99:0/3711293159 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc284071420 con 0x7fc2840f9500 2024-02-21T23:01:40.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.266+0000 7f56abe00640 1 -- 172.21.15.99:0/1834525160 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56ac003b90 con 0x7f56b418c290 2024-02-21T23:01:40.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.266+0000 7f56baa00640 1 -- 172.21.15.99:0/1834525160 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56b418ae50 con 0x7f56b418c290 2024-02-21T23:01:40.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.267+0000 7f56baa00640 1 -- 172.21.15.99:0/1834525160 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56b418b400 con 0x7f56b418c290 2024-02-21T23:01:40.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.271+0000 7fc281600640 1 --2- 172.21.15.99:0/3711293159 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2840f9500 0x7fc28406d600 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc2840f47b0 tx=0x7fc27402deb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd440278c2f0156e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:40.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.272+0000 7fc283e00640 1 -- 172.21.15.99:0/3711293159 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc274034070 con 0x7fc2840f9500 2024-02-21T23:01:40.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.272+0000 7f2e2d600640 1 -- 172.21.15.99:0/687643593 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2e380cc1c0 con 0x7f2e38186b90 2024-02-21T23:01:40.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.266+0000 7f5890c00640 1 -- 172.21.15.99:0/2316071641 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 6) v1 ==== 134407+0+0 (secure 0 0 0) 0x7f5888032980 con 0x7f58940cc210 2024-02-21T23:01:40.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.269+0000 7f5890c00640 1 --2- 172.21.15.99:0/2316071641 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f587409f070 0x7f58740a1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.269+0000 7f5890c00640 1 -- 172.21.15.99:0/2316071641 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f5888032430 con 0x7f58940cc210 2024-02-21T23:01:40.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.269+0000 7f5890c00640 1 --2- 172.21.15.99:0/2316071641 >> [v2:172.21.15.181:6817/3219928272,v1:172.21.15.181:6819/3219928272] conn(0x7f58740a9a10 0x7f58740abe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.269+0000 7f5890c00640 1 -- 172.21.15.99:0/2316071641 --> [v2:172.21.15.181:6817/3219928272,v1:172.21.15.181:6819/3219928272] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f588804be80 con 0x7f58740a9a10 2024-02-21T23:01:40.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.269+0000 7f5890c00640 1 -- 172.21.15.99:0/2316071641 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f58880ebb10 con 0x7f58940cc210 2024-02-21T23:01:40.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.270+0000 7f5893e00640 1 --2- 172.21.15.99:0/2316071641 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f587409f070 0x7f58740a1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.270+0000 7f5899800640 1 --2- 172.21.15.99:0/2316071641 >> [v2:172.21.15.181:6817/3219928272,v1:172.21.15.181:6819/3219928272] conn(0x7f58740a9a10 0x7f58740abe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.271+0000 7f5893e00640 1 --2- 172.21.15.99:0/2316071641 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f587409f070 0x7f58740a1530 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f589417ff50 tx=0x7f58800078a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:40.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.271+0000 7f5899800640 1 --2- 172.21.15.99:0/2316071641 >> [v2:172.21.15.181:6817/3219928272,v1:172.21.15.181:6819/3219928272] conn(0x7f58740a9a10 0x7f58740abe50 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:40.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.272+0000 7f5890c00640 1 -- 172.21.15.99:0/2316071641 <== osd.11 v2:172.21.15.181:6817/3219928272 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f588804be80 con 0x7f58740a9a10 2024-02-21T23:01:40.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.272+0000 7fc283e00640 1 -- 172.21.15.99:0/3711293159 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc27402ec60 con 0x7fc2840f9500 2024-02-21T23:01:40.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.272+0000 7fc283e00640 1 -- 172.21.15.99:0/3711293159 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc274038620 con 0x7fc2840f9500 2024-02-21T23:01:40.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.271+0000 7f56baa00640 1 -- 172.21.15.99:0/1834525160 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f568c001030 con 0x7f56b418c290 2024-02-21T23:01:40.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.273+0000 7f2120800640 1 -- 172.21.15.99:0/2369439812 >> [v2:172.21.15.99:6800/2316185310,v1:172.21.15.99:6801/2316185310] conn(0x7f20fc0a9a00 msgr2=0x7f20fc0abe40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.273+0000 7f2120800640 1 --2- 172.21.15.99:0/2369439812 >> [v2:172.21.15.99:6800/2316185310,v1:172.21.15.99:6801/2316185310] conn(0x7f20fc0a9a00 0x7f20fc0abe40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.273+0000 7f2120800640 1 -- 172.21.15.99:0/2369439812 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f20fc09f070 msgr2=0x7f20fc0a1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.273+0000 7f2120800640 1 --2- 172.21.15.99:0/2369439812 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f20fc09f070 0x7f20fc0a1530 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f210c0016e0 tx=0x7f210c009040 comp rx=0 tx=0).stop 2024-02-21T23:01:40.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.273+0000 7f2120800640 1 -- 172.21.15.99:0/2369439812 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2114107850 msgr2=0x7f2114078540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.274+0000 7f2120800640 1 --2- 172.21.15.99:0/2369439812 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2114107850 0x7f2114078540 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f211807bb10 tx=0x7f21180a9000 comp rx=0 tx=0).stop 2024-02-21T23:01:40.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.274+0000 7f211e800640 1 -- 172.21.15.99:0/2369439812 reap_dead start 2024-02-21T23:01:40.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.274+0000 7f2120800640 1 -- 172.21.15.99:0/2369439812 shutdown_connections 2024-02-21T23:01:40.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.274+0000 7f2120800640 1 -- 172.21.15.99:0/2369439812 >> 172.21.15.99:0/2369439812 conn(0x7f2114057240 msgr2=0x7f211405b390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:40.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.281+0000 7f2120800640 1 -- 172.21.15.99:0/2369439812 shutdown_connections 2024-02-21T23:01:40.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.281+0000 7f2120800640 1 -- 172.21.15.99:0/2369439812 wait complete. 2024-02-21T23:01:40.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.281+0000 7f2e2fe00640 1 -- 172.21.15.99:0/687643593 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 6) v1 ==== 134407+0+0 (secure 0 0 0) 0x7f2e2801a070 con 0x7f2e38186b90 2024-02-21T23:01:40.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.277+0000 7fc289600640 1 -- 172.21.15.99:0/3711293159 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2840f9500 msgr2=0x7fc28406d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.277+0000 7fc289600640 1 --2- 172.21.15.99:0/3711293159 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2840f9500 0x7fc28406d600 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc2840f47b0 tx=0x7fc27402deb0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.283+0000 7fc289600640 1 -- 172.21.15.99:0/3711293159 shutdown_connections 2024-02-21T23:01:40.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.283+0000 7fc289600640 1 --2- 172.21.15.99:0/3711293159 >> v2:172.21.15.162:3300/0 conn(0x7fc28406db40 0x7fc2841883a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.283+0000 7fc289600640 1 --2- 172.21.15.99:0/3711293159 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc2840f9500 0x7fc28406d600 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.283+0000 7fc289600640 1 -- 172.21.15.99:0/3711293159 >> 172.21.15.99:0/3711293159 conn(0x7fc2840f6c50 msgr2=0x7fc2840f7060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:40.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.285+0000 7f74d7600640 1 -- 172.21.15.99:0/460668298 --> [v2:172.21.15.162:6810/3137681258,v1:172.21.15.162:6811/3137681258] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f74a8002dd0 con 0x7f74b00a9a00 2024-02-21T23:01:40.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.283+0000 7f56abe00640 1 -- 172.21.15.99:0/1834525160 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 6) v1 ==== 134407+0+0 (secure 0 0 0) 0x7f56ac0050d0 con 0x7f56b418c290 2024-02-21T23:01:40.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.285+0000 7fc289600640 1 -- 172.21.15.99:0/3711293159 shutdown_connections 2024-02-21T23:01:40.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.286+0000 7f56abe00640 1 --2- 172.21.15.99:0/1834525160 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f569409eea0 0x7f56940a1360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.286+0000 7f74ccc00640 1 -- 172.21.15.99:0/460668298 <== osd.4 v2:172.21.15.162:6810/3137681258 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f74a8002dd0 con 0x7f74b00a9a00 2024-02-21T23:01:40.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.286+0000 7f5d3fe00640 1 -- 172.21.15.99:0/236543284 --> [v2:172.21.15.99:6809/1026112937,v1:172.21.15.99:6811/1026112937] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5d40068320 con 0x7f5d200a98d0 2024-02-21T23:01:40.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.287+0000 7f2e2fe00640 1 --2- 172.21.15.99:0/687643593 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f2e1809f1f0 0x7f2e180a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.287+0000 7f56abe00640 1 -- 172.21.15.99:0/1834525160 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f56ac0c9660 con 0x7f56b418c290 2024-02-21T23:01:40.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.287+0000 7f56abe00640 1 --2- 172.21.15.99:0/1834525160 >> [v2:172.21.15.181:6800/2011264527,v1:172.21.15.181:6801/2011264527] conn(0x7f56940a9830 0x7f56940abc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.287+0000 7f56abe00640 1 -- 172.21.15.99:0/1834525160 --> [v2:172.21.15.181:6800/2011264527,v1:172.21.15.181:6801/2011264527] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f56ac01eec0 con 0x7f56940a9830 2024-02-21T23:01:40.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.287+0000 7f56abe00640 1 -- 172.21.15.99:0/1834525160 <== mon.2 v2:172.21.15.181:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f56ac0d0050 con 0x7f56b418c290 2024-02-21T23:01:40.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.287+0000 7f2e37400640 1 --2- 172.21.15.99:0/687643593 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f2e1809f1f0 0x7f2e180a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.288+0000 7f2e2fe00640 1 -- 172.21.15.99:0/687643593 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f2e280050d0 con 0x7f2e38186b90 2024-02-21T23:01:40.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.288+0000 7f56b3400640 1 --2- 172.21.15.99:0/1834525160 >> [v2:172.21.15.181:6800/2011264527,v1:172.21.15.181:6801/2011264527] conn(0x7f56940a9830 0x7f56940abc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.289+0000 7f5d36a00640 1 -- 172.21.15.99:0/236543284 <== osd.0 v2:172.21.15.99:6809/1026112937 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5d40068320 con 0x7f5d200a98d0 2024-02-21T23:01:40.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.288+0000 7f2e2fe00640 1 --2- 172.21.15.99:0/687643593 >> [v2:172.21.15.99:6824/4055669590,v1:172.21.15.99:6825/4055669590] conn(0x7f2e180a9b90 0x7f2e180abfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.288+0000 7f2e2fe00640 1 -- 172.21.15.99:0/687643593 --> [v2:172.21.15.99:6824/4055669590,v1:172.21.15.99:6825/4055669590] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2e180ac6a0 con 0x7f2e180a9b90 2024-02-21T23:01:40.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.289+0000 7f2e2fe00640 1 -- 172.21.15.99:0/687643593 <== mon.2 v2:172.21.15.181:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2e280c9350 con 0x7f2e38186b90 2024-02-21T23:01:40.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.289+0000 7f2e3d000640 1 --2- 172.21.15.99:0/687643593 >> [v2:172.21.15.99:6824/4055669590,v1:172.21.15.99:6825/4055669590] conn(0x7f2e180a9b90 0x7f2e180abfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.285+0000 7fc289600640 1 -- 172.21.15.99:0/3711293159 wait complete. 2024-02-21T23:01:40.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.290+0000 7f5d3fe00640 1 -- 172.21.15.99:0/236543284 >> [v2:172.21.15.99:6809/1026112937,v1:172.21.15.99:6811/1026112937] conn(0x7f5d200a98d0 msgr2=0x7f5d200abd10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.290+0000 7f5d3fe00640 1 --2- 172.21.15.99:0/236543284 >> [v2:172.21.15.99:6809/1026112937,v1:172.21.15.99:6811/1026112937] conn(0x7f5d200a98d0 0x7f5d200abd10 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.290+0000 7fc289600640 1 Processor -- start 2024-02-21T23:01:40.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.290+0000 7f74d7600640 1 -- 172.21.15.99:0/460668298 >> [v2:172.21.15.162:6810/3137681258,v1:172.21.15.162:6811/3137681258] conn(0x7f74b00a9a00 msgr2=0x7f74b00abe40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.290+0000 7f74d7600640 1 --2- 172.21.15.99:0/460668298 >> [v2:172.21.15.162:6810/3137681258,v1:172.21.15.162:6811/3137681258] conn(0x7f74b00a9a00 0x7f74b00abe40 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.291+0000 7fc289600640 1 -- start start 2024-02-21T23:01:40.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.291+0000 7f5d3fe00640 1 -- 172.21.15.99:0/236543284 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f5d2009ef40 msgr2=0x7f5d200a1400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.291+0000 7f74d7600640 1 -- 172.21.15.99:0/460668298 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f74b009f070 msgr2=0x7f74b00a1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.291+0000 7f74d7600640 1 --2- 172.21.15.99:0/460668298 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f74b009f070 0x7f74b00a1530 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f74d00f7ca0 tx=0x7f74bc006bd0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.291+0000 7f74d7600640 1 -- 172.21.15.99:0/460668298 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74d006fb80 msgr2=0x7f74d01736e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.291+0000 7f74d7600640 1 --2- 172.21.15.99:0/460668298 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74d006fb80 0x7f74d01736e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f74c800c760 tx=0x7f74c800cc20 comp rx=0 tx=0).stop 2024-02-21T23:01:40.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.291+0000 7f5d3fe00640 1 --2- 172.21.15.99:0/236543284 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f5d2009ef40 0x7f5d200a1400 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5d38035000 tx=0x7f5d38030000 comp rx=0 tx=0).stop 2024-02-21T23:01:40.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.291+0000 7f2e3d000640 1 --2- 172.21.15.99:0/687643593 >> [v2:172.21.15.99:6824/4055669590,v1:172.21.15.99:6825/4055669590] conn(0x7f2e180a9b90 0x7f2e180abfd0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:40.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.291+0000 7f5d3fe00640 1 -- 172.21.15.99:0/236543284 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d40182a80 msgr2=0x7f5d4017e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.291+0000 7f5d3fe00640 1 --2- 172.21.15.99:0/236543284 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5d40182a80 0x7f5d4017e6a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5d3000c450 tx=0x7f5d3000c910 comp rx=0 tx=0).stop 2024-02-21T23:01:40.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.291+0000 7f5d3f400640 1 -- 172.21.15.99:0/236543284 reap_dead start 2024-02-21T23:01:40.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.291+0000 7f74d5600640 1 -- 172.21.15.99:0/460668298 reap_dead start 2024-02-21T23:01:40.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.292+0000 7f74d7600640 1 -- 172.21.15.99:0/460668298 shutdown_connections 2024-02-21T23:01:40.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.292+0000 7f74d7600640 1 -- 172.21.15.99:0/460668298 >> 172.21.15.99:0/460668298 conn(0x7f74d00ce5f0 msgr2=0x7f74d017a060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:40.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.292+0000 7f5d3fe00640 1 -- 172.21.15.99:0/236543284 shutdown_connections 2024-02-21T23:01:40.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.292+0000 7f5d3fe00640 1 -- 172.21.15.99:0/236543284 >> 172.21.15.99:0/236543284 conn(0x7f5d400d29f0 msgr2=0x7f5d4018bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:40.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.292+0000 7f2e37400640 1 --2- 172.21.15.99:0/687643593 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f2e1809f1f0 0x7f2e180a16b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2e24005880 tx=0x7f2e24007990 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:40.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.293+0000 7f5d3fe00640 1 -- 172.21.15.99:0/236543284 shutdown_connections 2024-02-21T23:01:40.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.294+0000 7f56b3e00640 1 --2- 172.21.15.99:0/1834525160 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f569409eea0 0x7f56940a1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.293+0000 7f5d3fe00640 1 -- 172.21.15.99:0/236543284 wait complete. 2024-02-21T23:01:40.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.295+0000 7f2e2fe00640 1 -- 172.21.15.99:0/687643593 <== osd.9 v2:172.21.15.99:6824/4055669590 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f2e180ac6a0 con 0x7f2e180a9b90 2024-02-21T23:01:40.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.295+0000 7f56b3e00640 1 --2- 172.21.15.99:0/1834525160 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f569409eea0 0x7f56940a1360 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f56a4006fd0 tx=0x7f56a4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:40.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.296+0000 7f74d7600640 1 -- 172.21.15.99:0/460668298 shutdown_connections 2024-02-21T23:01:40.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.296+0000 7f74d7600640 1 -- 172.21.15.99:0/460668298 wait complete. 2024-02-21T23:01:40.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.297+0000 7fc289600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc28406d220 0x7fc28417c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.297+0000 7fb762e00640 1 -- 172.21.15.99:0/1707536192 --> [v2:172.21.15.181:6816/2782386148,v1:172.21.15.181:6818/2782386148] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb75c0682e0 con 0x7fb73c0a9830 2024-02-21T23:01:40.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.298+0000 7f56b3400640 1 --2- 172.21.15.99:0/1834525160 >> [v2:172.21.15.181:6800/2011264527,v1:172.21.15.181:6801/2011264527] conn(0x7f56940a9830 0x7f56940abc70 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:40.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.298+0000 7fc289600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc28406db40 0x7fc28422e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.298+0000 7fb74fe00640 1 -- 172.21.15.99:0/1707536192 <== osd.2 v2:172.21.15.181:6816/2782386148 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb75c0682e0 con 0x7fb73c0a9830 2024-02-21T23:01:40.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.297+0000 7f0521600640 1 -- 172.21.15.99:0/2762730665 --> [v2:172.21.15.162:6826/3030871566,v1:172.21.15.162:6827/3030871566] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0504002dd0 con 0x7f050c0a9780 2024-02-21T23:01:40.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.299+0000 7fc01bc00640 1 -- 172.21.15.99:0/1820175833 --> [v2:172.21.15.99:6808/753870050,v1:172.21.15.99:6810/753870050] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbfec002dd0 con 0x7fbff40a9710 2024-02-21T23:01:40.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.300+0000 7fc010c00640 1 -- 172.21.15.99:0/1820175833 <== osd.6 v2:172.21.15.99:6808/753870050 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbfec002dd0 con 0x7fbff40a9710 2024-02-21T23:01:40.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.299+0000 7fc289600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc2840f9500 0x7fc2841711c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.300+0000 7f56abe00640 1 -- 172.21.15.99:0/1834525160 <== osd.5 v2:172.21.15.181:6800/2011264527 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f56ac01eec0 con 0x7f56940a9830 2024-02-21T23:01:40.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.301+0000 7fc01bc00640 1 -- 172.21.15.99:0/1820175833 >> [v2:172.21.15.99:6808/753870050,v1:172.21.15.99:6810/753870050] conn(0x7fbff40a9710 msgr2=0x7fbff40abb50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.301+0000 7fc01bc00640 1 --2- 172.21.15.99:0/1820175833 >> [v2:172.21.15.99:6808/753870050,v1:172.21.15.99:6810/753870050] conn(0x7fbff40a9710 0x7fbff40abb50 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.300+0000 7fc289600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc284071cc0 con 0x7fc28406db40 2024-02-21T23:01:40.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.300+0000 7fc289600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2840719e0 con 0x7fc28406d220 2024-02-21T23:01:40.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.300+0000 7fc289600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc28406df70 con 0x7fc2840f9500 2024-02-21T23:01:40.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.300+0000 7fc281600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc28406db40 0x7fc28422e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.300+0000 7fc281600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc28406db40 0x7fc28422e720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59564/0 (socket says 172.21.15.99:59564) 2024-02-21T23:01:40.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.300+0000 7fc281600640 1 -- 172.21.15.99:0/1883730632 learned_addr learned my addr 172.21.15.99:0/1883730632 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:40.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.301+0000 7fc281600640 1 -- 172.21.15.99:0/1883730632 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc2840f9500 msgr2=0x7fc2841711c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-21T23:01:40.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.301+0000 7fc281600640 1 --2- 172.21.15.99:0/1883730632 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc2840f9500 0x7fc2841711c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.301+0000 7fc281600640 1 -- 172.21.15.99:0/1883730632 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc28406d220 msgr2=0x7fc28417c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.300+0000 7fc282000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc28406d220 0x7fc28417c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.301+0000 7f0523e00640 1 -- 172.21.15.99:0/2762730665 <== osd.1 v2:172.21.15.162:6826/3030871566 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0504002dd0 con 0x7f050c0a9780 2024-02-21T23:01:40.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.301+0000 7fc01bc00640 1 -- 172.21.15.99:0/1820175833 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fbff409edf0 msgr2=0x7fbff40a12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.301+0000 7fc01bc00640 1 --2- 172.21.15.99:0/1820175833 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fbff409edf0 0x7fbff40a12b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc004000c00 tx=0x7fc00400c040 comp rx=0 tx=0).stop 2024-02-21T23:01:40.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.301+0000 7fc01bc00640 1 -- 172.21.15.99:0/1820175833 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc0140708c0 msgr2=0x7fc0141558b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.301+0000 7fc01bc00640 1 --2- 172.21.15.99:0/1820175833 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc0140708c0 0x7fc0141558b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc00000c450 tx=0x7fc00000c910 comp rx=0 tx=0).stop 2024-02-21T23:01:40.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.302+0000 7fc019c00640 1 -- 172.21.15.99:0/1820175833 reap_dead start 2024-02-21T23:01:40.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.302+0000 7fc01bc00640 1 -- 172.21.15.99:0/1820175833 shutdown_connections 2024-02-21T23:01:40.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.302+0000 7fc01bc00640 1 -- 172.21.15.99:0/1820175833 >> 172.21.15.99:0/1820175833 conn(0x7fc0140ce5f0 msgr2=0x7fc01406ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:40.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.307+0000 7fc01bc00640 1 -- 172.21.15.99:0/1820175833 shutdown_connections 2024-02-21T23:01:40.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.307+0000 7fc01bc00640 1 -- 172.21.15.99:0/1820175833 wait complete. 2024-02-21T23:01:40.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.308+0000 7fb74d600640 1 -- 172.21.15.99:0/1707536192 >> [v2:172.21.15.181:6816/2782386148,v1:172.21.15.181:6818/2782386148] conn(0x7fb73c0a9830 msgr2=0x7fb73c0abc70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.308+0000 7fb74d600640 1 --2- 172.21.15.99:0/1707536192 >> [v2:172.21.15.181:6816/2782386148,v1:172.21.15.181:6818/2782386148] conn(0x7fb73c0a9830 0x7fb73c0abc70 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.308+0000 7f0521600640 1 -- 172.21.15.99:0/2762730665 >> [v2:172.21.15.162:6826/3030871566,v1:172.21.15.162:6827/3030871566] conn(0x7f050c0a9780 msgr2=0x7f050c0abbc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.308+0000 7f0521600640 1 --2- 172.21.15.99:0/2762730665 >> [v2:172.21.15.162:6826/3030871566,v1:172.21.15.162:6827/3030871566] conn(0x7f050c0a9780 0x7f050c0abbc0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.309+0000 7f0521600640 1 -- 172.21.15.99:0/2762730665 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f050c09edf0 msgr2=0x7f050c0a12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.309+0000 7f0521600640 1 --2- 172.21.15.99:0/2762730665 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f050c09edf0 0x7f050c0a12b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0524005fd0 tx=0x7f05240019d0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.309+0000 7fc281600640 1 --2- 172.21.15.99:0/1883730632 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc28406d220 0x7fc28417c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.309+0000 7fc281600640 1 -- 172.21.15.99:0/1883730632 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc28422d3a0 con 0x7fc28406db40 2024-02-21T23:01:40.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.309+0000 7fc282000640 1 --2- 172.21.15.99:0/1883730632 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc28406d220 0x7fc28417c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T23:01:40.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.310+0000 7f0521600640 1 -- 172.21.15.99:0/2762730665 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f052c0f6560 msgr2=0x7f052c17acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.310+0000 7f0521600640 1 --2- 172.21.15.99:0/2762730665 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f052c0f6560 0x7f052c17acb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f051800c460 tx=0x7f051800c920 comp rx=0 tx=0).stop 2024-02-21T23:01:40.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.310+0000 7f0531000640 1 -- 172.21.15.99:0/2762730665 reap_dead start 2024-02-21T23:01:40.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.310+0000 7fc281600640 1 --2- 172.21.15.99:0/1883730632 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc28406db40 0x7fc28422e720 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc274008960 tx=0x7fc274004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:40.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.310+0000 7f0521600640 1 -- 172.21.15.99:0/2762730665 shutdown_connections 2024-02-21T23:01:40.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.310+0000 7f0521600640 1 -- 172.21.15.99:0/2762730665 >> 172.21.15.99:0/2762730665 conn(0x7f052c0ce430 msgr2=0x7f052c0cfa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:40.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.311+0000 7fc27aa00640 1 -- 172.21.15.99:0/1883730632 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc274038d40 con 0x7fc28406db40 2024-02-21T23:01:40.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.311+0000 7fc27aa00640 1 -- 172.21.15.99:0/1883730632 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc27400b150 con 0x7fc28406db40 2024-02-21T23:01:40.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.314+0000 7f60a4200640 1 Processor -- start 2024-02-21T23:01:40.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.314+0000 7fb74d600640 1 -- 172.21.15.99:0/1707536192 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fb73c09eea0 msgr2=0x7fb73c0a1360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.314+0000 7fb74d600640 1 --2- 172.21.15.99:0/1707536192 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fb73c09eea0 0x7fb73c0a1360 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb748036000 tx=0x7fb74803c040 comp rx=0 tx=0).stop 2024-02-21T23:01:40.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.314+0000 7fb74d600640 1 -- 172.21.15.99:0/1707536192 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb75c17fc00 msgr2=0x7fb75c0d5600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.314+0000 7fb74d600640 1 --2- 172.21.15.99:0/1707536192 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb75c17fc00 0x7fb75c0d5600 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb75000c3c0 tx=0x7fb750001e70 comp rx=0 tx=0).stop 2024-02-21T23:01:40.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.314+0000 7f60a4200640 1 -- start start 2024-02-21T23:01:40.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.312+0000 7fc289600640 1 -- 172.21.15.99:0/1883730632 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc28422d680 con 0x7fc28406db40 2024-02-21T23:01:40.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.312+0000 7fc27aa00640 1 -- 172.21.15.99:0/1883730632 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc27400b540 con 0x7fc28406db40 2024-02-21T23:01:40.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.315+0000 7fc289600640 1 -- 172.21.15.99:0/1883730632 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc28422dc40 con 0x7fc28406db40 2024-02-21T23:01:40.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.318+0000 7fb760e00640 1 -- 172.21.15.99:0/1707536192 reap_dead start 2024-02-21T23:01:40.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.319+0000 7fb74d600640 1 -- 172.21.15.99:0/1707536192 shutdown_connections 2024-02-21T23:01:40.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.319+0000 7fb74d600640 1 -- 172.21.15.99:0/1707536192 >> 172.21.15.99:0/1707536192 conn(0x7fb75c0fae00 msgr2=0x7fb75c18bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:40.312 INFO:teuthology.orchestra.run.smithi099.stdout:73014444043 2024-02-21T23:01:40.312 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-02-21T23:01:40.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.317+0000 7f60a4200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f609c15ca80 0x7f609c15ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.328+0000 7f0521600640 1 -- 172.21.15.99:0/2762730665 shutdown_connections 2024-02-21T23:01:40.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.328+0000 7f0521600640 1 -- 172.21.15.99:0/2762730665 wait complete. 2024-02-21T23:01:40.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.325+0000 7fc27aa00640 1 -- 172.21.15.99:0/1883730632 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 6) v1 ==== 134407+0+0 (secure 0 0 0) 0x7fc27400b6e0 con 0x7fc28406db40 2024-02-21T23:01:40.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.318+0000 7f60a4200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f609c17f1c0 con 0x7f609c06f630 2024-02-21T23:01:40.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.318+0000 7f60a4200640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f609c071c20 con 0x7f609c15d3a0 2024-02-21T23:01:40.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.318+0000 7f60a4200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f609c0721e0 con 0x7f609c15ca80 2024-02-21T23:01:40.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.318+0000 7f60a0e00640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f609c15d3a0 0x7f609c06ef20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:48588/0 (socket says 172.21.15.99:48588) 2024-02-21T23:01:40.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.318+0000 7f60a0e00640 1 -- 172.21.15.99:0/3284662633 learned_addr learned my addr 172.21.15.99:0/3284662633 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:01:40.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.322+0000 7f60a1800640 1 --2- 172.21.15.99:0/3284662633 >> v2:172.21.15.99:3300/0 conn(0x7f609c15ca80 0x7f609c15ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.323+0000 7f60a1800640 1 -- 172.21.15.99:0/3284662633 >> v1:172.21.15.181:6789/0 conn(0x7f609c15d3a0 legacy=0x7f609c06ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.323+0000 7f60a1800640 1 -- 172.21.15.99:0/3284662633 >> v1:172.21.15.99:6789/0 conn(0x7f609c06f630 legacy=0x7f609c0f8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.323+0000 7f60a1800640 1 -- 172.21.15.99:0/3284662633 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f609c071f00 con 0x7f609c15ca80 2024-02-21T23:01:40.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.335+0000 7fb74d600640 1 -- 172.21.15.99:0/1707536192 shutdown_connections 2024-02-21T23:01:40.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.336+0000 7fb74d600640 1 -- 172.21.15.99:0/1707536192 wait complete. 2024-02-21T23:01:40.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.331+0000 7fc289600640 1 -- 172.21.15.99:0/1883730632 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc28417e8d0 con 0x7fc28406db40 2024-02-21T23:01:40.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.335+0000 7fc27aa00640 1 --2- 172.21.15.99:0/1883730632 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fc26409eec0 0x7fc2640a1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.335+0000 7fc27aa00640 1 -- 172.21.15.99:0/1883730632 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fc2740eb4f0 con 0x7fc28406db40 2024-02-21T23:01:40.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.336+0000 7fc282000640 1 --2- 172.21.15.99:0/1883730632 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fc26409eec0 0x7fc2640a1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.330+0000 7f60a1800640 1 --2- 172.21.15.99:0/3284662633 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f609c15ca80 0x7f609c15ce60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f60900097a0 tx=0x7f609002b570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a174912d51feb0cf server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:40.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.333+0000 7f609be00640 1 -- 172.21.15.99:0/3284662633 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6090037070 con 0x7f609c15ca80 2024-02-21T23:01:40.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.333+0000 7f609be00640 1 -- 172.21.15.99:0/3284662633 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6090030710 con 0x7f609c15ca80 2024-02-21T23:01:40.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.333+0000 7f609be00640 1 -- 172.21.15.99:0/3284662633 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6090030ae0 con 0x7f609c15ca80 2024-02-21T23:01:40.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.335+0000 7f60a4200640 1 -- 172.21.15.99:0/3284662633 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f609c15ca80 msgr2=0x7f609c15ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.335+0000 7f60a4200640 1 --2- 172.21.15.99:0/3284662633 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f609c15ca80 0x7f609c15ce60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f60900097a0 tx=0x7f609002b570 comp rx=0 tx=0).stop 2024-02-21T23:01:40.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.338+0000 7f2e2d600640 1 -- 172.21.15.99:0/687643593 --> [v2:172.21.15.99:6824/4055669590,v1:172.21.15.99:6825/4055669590] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2e38072ad0 con 0x7f2e180a9b90 2024-02-21T23:01:40.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.339+0000 7f2e2fe00640 1 -- 172.21.15.99:0/687643593 <== osd.9 v2:172.21.15.99:6824/4055669590 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2e38072ad0 con 0x7f2e180a9b90 2024-02-21T23:01:40.330 INFO:teuthology.orchestra.run.smithi099.stdout:73014444043 2024-02-21T23:01:40.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.339+0000 7f60a4200640 1 -- 172.21.15.99:0/3284662633 shutdown_connections 2024-02-21T23:01:40.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.339+0000 7f60a4200640 1 --2- 172.21.15.99:0/3284662633 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f609c15ca80 0x7f609c15ce60 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.339+0000 7f60a4200640 1 -- 172.21.15.99:0/3284662633 >> 172.21.15.99:0/3284662633 conn(0x7f609c0ce5f0 msgr2=0x7f609c0cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:40.331 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-02-21T23:01:40.332 INFO:teuthology.orchestra.run.smithi099.stdout:73014444043 2024-02-21T23:01:40.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.337+0000 7fc27aa00640 1 --2- 172.21.15.99:0/1883730632 >> [v2:172.21.15.162:6802/1659412949,v1:172.21.15.162:6803/1659412949] conn(0x7fc2640a97d0 0x7fc2640abc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.341+0000 7fc27aa00640 1 -- 172.21.15.99:0/1883730632 --> [v2:172.21.15.162:6802/1659412949,v1:172.21.15.162:6803/1659412949] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc27400b150 con 0x7fc2640a97d0 2024-02-21T23:01:40.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.341+0000 7fc27aa00640 1 -- 172.21.15.99:0/1883730632 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc2740b5260 con 0x7fc28406db40 2024-02-21T23:01:40.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.341+0000 7fc282000640 1 --2- 172.21.15.99:0/1883730632 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fc26409eec0 0x7fc2640a1380 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc27c001120 tx=0x7fc27c0081c0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:40.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.341+0000 7f60a4200640 1 -- 172.21.15.99:0/3284662633 shutdown_connections 2024-02-21T23:01:40.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.343+0000 7fc282a00640 1 --2- 172.21.15.99:0/1883730632 >> [v2:172.21.15.162:6802/1659412949,v1:172.21.15.162:6803/1659412949] conn(0x7fc2640a97d0 0x7fc2640abc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.341+0000 7f60a4200640 1 -- 172.21.15.99:0/3284662633 wait complete. 2024-02-21T23:01:40.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.343+0000 7f5886000640 1 -- 172.21.15.99:0/2316071641 --> [v2:172.21.15.181:6817/3219928272,v1:172.21.15.181:6819/3219928272] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5870002dd0 con 0x7f58740a9a10 2024-02-21T23:01:40.335 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-02-21T23:01:40.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.343+0000 7f3c1ca00640 1 Processor -- start 2024-02-21T23:01:40.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.344+0000 7f60a4200640 1 Processor -- start 2024-02-21T23:01:40.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.344+0000 7f3c1ca00640 1 -- start start 2024-02-21T23:01:40.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.345+0000 7f60a4200640 1 -- start start 2024-02-21T23:01:40.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.345+0000 7f5890c00640 1 -- 172.21.15.99:0/2316071641 <== osd.11 v2:172.21.15.181:6817/3219928272 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5870002dd0 con 0x7f58740a9a10 2024-02-21T23:01:40.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.344+0000 7fc282a00640 1 --2- 172.21.15.99:0/1883730632 >> [v2:172.21.15.162:6802/1659412949,v1:172.21.15.162:6803/1659412949] conn(0x7fc2640a97d0 0x7fc2640abc10 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:40.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.346+0000 7f5886000640 1 -- 172.21.15.99:0/2316071641 >> [v2:172.21.15.181:6817/3219928272,v1:172.21.15.181:6819/3219928272] conn(0x7f58740a9a10 msgr2=0x7f58740abe50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.346+0000 7f5886000640 1 --2- 172.21.15.99:0/2316071641 >> [v2:172.21.15.181:6817/3219928272,v1:172.21.15.181:6819/3219928272] conn(0x7f58740a9a10 0x7f58740abe50 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.346+0000 7f3c1ca00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f3c18182190 0x7f3c18183fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.346+0000 7f60a4200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f609c06f630 0x7f609c15b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.347+0000 7fc27aa00640 1 -- 172.21.15.99:0/1883730632 <== osd.7 v2:172.21.15.162:6802/1659412949 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fc27400b150 con 0x7fc2640a97d0 2024-02-21T23:01:40.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.347+0000 7f60a1800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f609c06f630 0x7f609c15b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.348+0000 7f60a1800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f609c06f630 0x7f609c15b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:43670/0 (socket says 172.21.15.99:43670) 2024-02-21T23:01:40.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.348+0000 7f60a4200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f609c15ca80 0x7f609c0f0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.348+0000 7f60a4200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f609c15d3a0 0x7f609c15c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.348+0000 7f60a4200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f609c06ea00 con 0x7f609c15ca80 2024-02-21T23:01:40.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.348+0000 7f60a4200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f609c06e720 con 0x7f609c15d3a0 2024-02-21T23:01:40.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.348+0000 7f60a4200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f609c0718d0 con 0x7f609c06f630 2024-02-21T23:01:40.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.348+0000 7f60a1800640 1 -- 172.21.15.99:0/2287303315 learned_addr learned my addr 172.21.15.99:0/2287303315 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:40.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.349+0000 7f60a0e00640 1 --2- 172.21.15.99:0/2287303315 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f609c15ca80 0x7f609c0f0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.350+0000 7f60a0e00640 1 -- 172.21.15.99:0/2287303315 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f609c06f630 msgr2=0x7f609c15b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.350+0000 7f60a0e00640 1 --2- 172.21.15.99:0/2287303315 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f609c06f630 0x7f609c15b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.351+0000 7f60a0e00640 1 -- 172.21.15.99:0/2287303315 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f609c15d3a0 msgr2=0x7f609c15c0f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-21T23:01:40.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.351+0000 7f60a2200640 1 --2- 172.21.15.99:0/2287303315 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f609c15d3a0 0x7f609c15c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.351+0000 7f60a0e00640 1 --2- 172.21.15.99:0/2287303315 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f609c15d3a0 0x7f609c15c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.351+0000 7f60a0e00640 1 -- 172.21.15.99:0/2287303315 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f609c224570 con 0x7f609c15ca80 2024-02-21T23:01:40.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.351+0000 7f60a1800640 1 --2- 172.21.15.99:0/2287303315 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f609c06f630 0x7f609c15b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:01:40.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.351+0000 7f60a2200640 1 --2- 172.21.15.99:0/2287303315 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f609c15d3a0 0x7f609c15c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T23:01:40.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.351+0000 7f60a0e00640 1 --2- 172.21.15.99:0/2287303315 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f609c15ca80 0x7f609c0f0300 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f608800c7c0 tx=0x7f608800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:40.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.347+0000 7f3c1ca00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c180f5880 con 0x7f3c181854f0 2024-02-21T23:01:40.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.347+0000 7f3c1ca00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c181825a0 con 0x7f3c180ceee0 2024-02-21T23:01:40.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.347+0000 7f3c1ca00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c181828a0 con 0x7f3c18182190 2024-02-21T23:01:40.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.348+0000 7f3c17200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f3c18182190 0x7f3c18183fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.348+0000 7f3c17200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f3c18182190 0x7f3c18183fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59584/0 (socket says 172.21.15.99:59584) 2024-02-21T23:01:40.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.348+0000 7f3c17200640 1 -- 172.21.15.99:0/4194207618 learned_addr learned my addr 172.21.15.99:0/4194207618 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:40.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.348+0000 7f3c17200640 1 -- 172.21.15.99:0/4194207618 >> v1:172.21.15.181:6789/0 conn(0x7f3c180ceee0 legacy=0x7f3c18184de0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T23:01:40.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.348+0000 7f3c17200640 1 -- 172.21.15.99:0/4194207618 >> v1:172.21.15.162:6789/0 conn(0x7f3c181854f0 legacy=0x7f3c181838b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.348+0000 7f3c17200640 1 -- 172.21.15.99:0/4194207618 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c18184500 con 0x7f3c18182190 2024-02-21T23:01:40.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.351+0000 7f3c17200640 1 --2- 172.21.15.99:0/4194207618 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3c18182190 0x7f3c18183fc0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3c18182a20 tx=0x7f3c1002c140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a906944239c75ba5 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:40.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.347+0000 7f5886000640 1 -- 172.21.15.99:0/2316071641 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f587409f070 msgr2=0x7f58740a1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.348+0000 7f5886000640 1 --2- 172.21.15.99:0/2316071641 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f587409f070 0x7f58740a1530 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f589417ff50 tx=0x7f58800078a0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.348+0000 7f5886000640 1 -- 172.21.15.99:0/2316071641 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f58940cc210 msgr2=0x7f5894174270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.348+0000 7f5886000640 1 --2- 172.21.15.99:0/2316071641 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f58940cc210 0x7f5894174270 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5888000c00 tx=0x7f58880046c0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.348+0000 7f5899800640 1 -- 172.21.15.99:0/2316071641 reap_dead start 2024-02-21T23:01:40.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.348+0000 7f5886000640 1 -- 172.21.15.99:0/2316071641 shutdown_connections 2024-02-21T23:01:40.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.348+0000 7f5886000640 1 -- 172.21.15.99:0/2316071641 >> 172.21.15.99:0/2316071641 conn(0x7f58940ce430 msgr2=0x7f58940cb530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:40.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.350+0000 7f5886000640 1 -- 172.21.15.99:0/2316071641 shutdown_connections 2024-02-21T23:01:40.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.351+0000 7f5886000640 1 -- 172.21.15.99:0/2316071641 wait complete. 2024-02-21T23:01:40.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.352+0000 7f6099600640 1 -- 172.21.15.99:0/2287303315 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6088018070 con 0x7f609c15ca80 2024-02-21T23:01:40.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.352+0000 7f60a4200640 1 -- 172.21.15.99:0/2287303315 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f609c224850 con 0x7f609c15ca80 2024-02-21T23:01:40.349 INFO:teuthology.orchestra.run.smithi099.stdout:73014444043 2024-02-21T23:01:40.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.349+0000 7f2e2d600640 1 -- 172.21.15.99:0/687643593 >> [v2:172.21.15.99:6824/4055669590,v1:172.21.15.99:6825/4055669590] conn(0x7f2e180a9b90 msgr2=0x7f2e180abfd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.349+0000 7f2e2d600640 1 --2- 172.21.15.99:0/687643593 >> [v2:172.21.15.99:6824/4055669590,v1:172.21.15.99:6825/4055669590] conn(0x7f2e180a9b90 0x7f2e180abfd0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.354+0000 7f2e2d600640 1 -- 172.21.15.99:0/687643593 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f2e1809f1f0 msgr2=0x7f2e180a16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.354+0000 7f2e2d600640 1 --2- 172.21.15.99:0/687643593 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f2e1809f1f0 0x7f2e180a16b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2e24005880 tx=0x7f2e24007990 comp rx=0 tx=0).stop 2024-02-21T23:01:40.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.354+0000 7f2e2d600640 1 -- 172.21.15.99:0/687643593 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2e38186b90 msgr2=0x7f2e38071d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.354+0000 7f2e2d600640 1 --2- 172.21.15.99:0/687643593 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2e38186b90 0x7f2e38071d50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2e2800c400 tx=0x7f2e2800c8c0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.354+0000 7f2e3d000640 1 -- 172.21.15.99:0/687643593 reap_dead start 2024-02-21T23:01:40.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.353+0000 7f3c15400640 1 -- 172.21.15.99:0/4194207618 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c1002cae0 con 0x7f3c18182190 2024-02-21T23:01:40.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.353+0000 7f3c15400640 1 -- 172.21.15.99:0/4194207618 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c1002cc80 con 0x7f3c18182190 2024-02-21T23:01:40.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.353+0000 7f3c15400640 1 -- 172.21.15.99:0/4194207618 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c10034610 con 0x7f3c18182190 2024-02-21T23:01:40.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.354+0000 7f3c1ca00640 1 -- 172.21.15.99:0/4194207618 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3c18182190 msgr2=0x7f3c18183fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.354+0000 7f3c1ca00640 1 --2- 172.21.15.99:0/4194207618 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3c18182190 0x7f3c18183fc0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3c18182a20 tx=0x7f3c1002c140 comp rx=0 tx=0).stop 2024-02-21T23:01:40.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.354+0000 7f3c1ca00640 1 -- 172.21.15.99:0/4194207618 shutdown_connections 2024-02-21T23:01:40.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.358+0000 7f3c1ca00640 1 --2- 172.21.15.99:0/4194207618 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3c18182190 0x7f3c18183fc0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.358+0000 7f3c1ca00640 1 -- 172.21.15.99:0/4194207618 >> 172.21.15.99:0/4194207618 conn(0x7f3c180ce3c0 msgr2=0x7f3c180ce7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:40.351 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-02-21T23:01:40.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.352+0000 7f60a4200640 1 -- 172.21.15.99:0/2287303315 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f609c0c96e0 con 0x7f609c15ca80 2024-02-21T23:01:40.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.352+0000 7f6099600640 1 -- 172.21.15.99:0/2287303315 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60880072d0 con 0x7f609c15ca80 2024-02-21T23:01:40.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.352+0000 7f6099600640 1 -- 172.21.15.99:0/2287303315 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60880047e0 con 0x7f609c15ca80 2024-02-21T23:01:40.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.362+0000 7f3c1ca00640 1 -- 172.21.15.99:0/4194207618 shutdown_connections 2024-02-21T23:01:40.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.356+0000 7f60a4200640 1 -- 172.21.15.99:0/2287303315 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6078001030 con 0x7f609c15ca80 2024-02-21T23:01:40.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.362+0000 7f3c1ca00640 1 -- 172.21.15.99:0/4194207618 wait complete. 2024-02-21T23:01:40.354 INFO:teuthology.orchestra.run.smithi099.stdout:73014444042 2024-02-21T23:01:40.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.362+0000 7f6099600640 1 -- 172.21.15.99:0/2287303315 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 6) v1 ==== 134407+0+0 (secure 0 0 0) 0x7f6088004980 con 0x7f609c15ca80 2024-02-21T23:01:40.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.365+0000 7f6099600640 1 --2- 172.21.15.99:0/2287303315 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f607c09ee70 0x7f607c0a1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.365+0000 7f6099600640 1 -- 172.21.15.99:0/2287303315 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f60880c94f0 con 0x7f609c15ca80 2024-02-21T23:01:40.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.359+0000 7f2e2d600640 1 -- 172.21.15.99:0/687643593 shutdown_connections 2024-02-21T23:01:40.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.359+0000 7f2e2d600640 1 -- 172.21.15.99:0/687643593 >> 172.21.15.99:0/687643593 conn(0x7f2e380ce5f0 msgr2=0x7f2e38169be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:40.356 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-02-21T23:01:40.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.365+0000 7f60a1800640 1 --2- 172.21.15.99:0/2287303315 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f607c09ee70 0x7f607c0a1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.366+0000 7f6099600640 1 --2- 172.21.15.99:0/2287303315 >> [v2:172.21.15.181:6802/3389807042,v1:172.21.15.181:6804/3389807042] conn(0x7f607c0a9800 0x7f607c0abc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.366+0000 7f6099600640 1 -- 172.21.15.99:0/2287303315 --> [v2:172.21.15.181:6802/3389807042,v1:172.21.15.181:6804/3389807042] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6088015ec0 con 0x7f607c0a9800 2024-02-21T23:01:40.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.366+0000 7f6099600640 1 -- 172.21.15.99:0/2287303315 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f60880c98e0 con 0x7f609c15ca80 2024-02-21T23:01:40.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.367+0000 7f60a1800640 1 --2- 172.21.15.99:0/2287303315 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f607c09ee70 0x7f607c0a1330 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f609c221900 tx=0x7f6090008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:40.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.367+0000 7f60a2200640 1 --2- 172.21.15.99:0/2287303315 >> [v2:172.21.15.181:6802/3389807042,v1:172.21.15.181:6804/3389807042] conn(0x7f607c0a9800 0x7f607c0abc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.367+0000 7f60a2200640 1 --2- 172.21.15.99:0/2287303315 >> [v2:172.21.15.181:6802/3389807042,v1:172.21.15.181:6804/3389807042] conn(0x7f607c0a9800 0x7f607c0abc40 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:40.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.368+0000 7f6099600640 1 -- 172.21.15.99:0/2287303315 <== osd.8 v2:172.21.15.181:6802/3389807042 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f6088015ec0 con 0x7f607c0a9800 2024-02-21T23:01:40.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.366+0000 7f2e2d600640 1 -- 172.21.15.99:0/687643593 shutdown_connections 2024-02-21T23:01:40.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.367+0000 7f2e2d600640 1 -- 172.21.15.99:0/687643593 wait complete. 2024-02-21T23:01:40.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.371+0000 7f3c1ca00640 1 Processor -- start 2024-02-21T23:01:40.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.371+0000 7f3c1ca00640 1 -- start start 2024-02-21T23:01:40.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.373+0000 7f3c1ca00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3c180ceee0 0x7f3c1816e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.374+0000 7f3c1ca00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c18182190 0x7f3c18183a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.374+0000 7f3c1ca00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3c181854f0 0x7f3c18224780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.374+0000 7f3c17200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3c181854f0 0x7f3c18224780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.374+0000 7f3c17200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3c181854f0 0x7f3c18224780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59596/0 (socket says 172.21.15.99:59596) 2024-02-21T23:01:40.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.375+0000 7f3c15e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c18182190 0x7f3c18183a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.375+0000 7f3c17200640 1 -- 172.21.15.99:0/1088581512 learned_addr learned my addr 172.21.15.99:0/1088581512 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:40.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.375+0000 7f3c1ca00640 1 -- 172.21.15.99:0/1088581512 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c18182dd0 con 0x7f3c181854f0 2024-02-21T23:01:40.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.375+0000 7f3c1ca00640 1 -- 172.21.15.99:0/1088581512 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c18183420 con 0x7f3c18182190 2024-02-21T23:01:40.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.375+0000 7f3c1ca00640 1 -- 172.21.15.99:0/1088581512 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c181830b0 con 0x7f3c180ceee0 2024-02-21T23:01:40.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.376+0000 7f3c17200640 1 -- 172.21.15.99:0/1088581512 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3c180ceee0 msgr2=0x7f3c1816e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.376+0000 7f3c17200640 1 --2- 172.21.15.99:0/1088581512 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3c180ceee0 0x7f3c1816e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.376+0000 7f3c17200640 1 -- 172.21.15.99:0/1088581512 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c18182190 msgr2=0x7f3c18183a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.377 INFO:teuthology.orchestra.run.smithi099.stdout:73014444043 2024-02-21T23:01:40.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.376+0000 7f3c17200640 1 --2- 172.21.15.99:0/1088581512 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c18182190 0x7f3c18183a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.376+0000 7f3c17200640 1 -- 172.21.15.99:0/1088581512 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c18221fb0 con 0x7f3c181854f0 2024-02-21T23:01:40.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.377+0000 7f3c17200640 1 --2- 172.21.15.99:0/1088581512 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3c181854f0 0x7f3c18224780 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3c1002c680 tx=0x7f3c10004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:40.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.378+0000 7f3c0ea00640 1 -- 172.21.15.99:0/1088581512 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c10042020 con 0x7f3c181854f0 2024-02-21T23:01:40.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.378+0000 7f3c0ea00640 1 -- 172.21.15.99:0/1088581512 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c10004670 con 0x7f3c181854f0 2024-02-21T23:01:40.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.380+0000 7f3c0ea00640 1 -- 172.21.15.99:0/1088581512 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c1002cae0 con 0x7f3c181854f0 2024-02-21T23:01:40.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.380+0000 7f3c1ca00640 1 -- 172.21.15.99:0/1088581512 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c18222290 con 0x7f3c181854f0 2024-02-21T23:01:40.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.385+0000 7f3c1ca00640 1 -- 172.21.15.99:0/1088581512 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c18222850 con 0x7f3c181854f0 2024-02-21T23:01:40.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.387+0000 7f3c03e00640 1 -- 172.21.15.99:0/1088581512 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3c18224050 con 0x7f3c181854f0 2024-02-21T23:01:40.378 INFO:teuthology.orchestra.run.smithi099.stdout:73014444043 2024-02-21T23:01:40.378 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-02-21T23:01:40.379 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.11 2024-02-21T23:01:40.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.393+0000 7f3c0ea00640 1 -- 172.21.15.99:0/1088581512 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 6) v1 ==== 134407+0+0 (secure 0 0 0) 0x7f3c10045020 con 0x7f3c181854f0 2024-02-21T23:01:40.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.397+0000 7f3c0ea00640 1 --2- 172.21.15.99:0/1088581512 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f3bf809ef70 0x7f3bf80a1430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.400+0000 7f56baa00640 1 -- 172.21.15.99:0/1834525160 --> [v2:172.21.15.181:6800/2011264527,v1:172.21.15.181:6801/2011264527] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f568c002dd0 con 0x7f56940a9830 2024-02-21T23:01:40.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.401+0000 7f56abe00640 1 -- 172.21.15.99:0/1834525160 <== osd.5 v2:172.21.15.181:6800/2011264527 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f568c002dd0 con 0x7f56940a9830 2024-02-21T23:01:40.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.403+0000 7f56baa00640 1 -- 172.21.15.99:0/1834525160 >> [v2:172.21.15.181:6800/2011264527,v1:172.21.15.181:6801/2011264527] conn(0x7f56940a9830 msgr2=0x7f56940abc70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.397+0000 7f3c0ea00640 1 -- 172.21.15.99:0/1088581512 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f3c100ec560 con 0x7f3c181854f0 2024-02-21T23:01:40.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.398+0000 7f3c16800640 1 --2- 172.21.15.99:0/1088581512 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f3bf809ef70 0x7f3bf80a1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.398+0000 7f3c0ea00640 1 --2- 172.21.15.99:0/1088581512 >> [v2:172.21.15.162:6818/1421879617,v1:172.21.15.162:6819/1421879617] conn(0x7f3bf80a9900 0x7f3bf80abd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.398+0000 7f3c0ea00640 1 -- 172.21.15.99:0/1088581512 --> [v2:172.21.15.162:6818/1421879617,v1:172.21.15.162:6819/1421879617] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3c1002ee50 con 0x7f3bf80a9900 2024-02-21T23:01:40.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.398+0000 7f3c0ea00640 1 -- 172.21.15.99:0/1088581512 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3c100ec950 con 0x7f3c181854f0 2024-02-21T23:01:40.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.399+0000 7f3c15e00640 1 --2- 172.21.15.99:0/1088581512 >> [v2:172.21.15.162:6818/1421879617,v1:172.21.15.162:6819/1421879617] conn(0x7f3bf80a9900 0x7f3bf80abd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.400+0000 7f3c15e00640 1 --2- 172.21.15.99:0/1088581512 >> [v2:172.21.15.162:6818/1421879617,v1:172.21.15.162:6819/1421879617] conn(0x7f3bf80a9900 0x7f3bf80abd40 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:40.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.403+0000 7f3c0ea00640 1 -- 172.21.15.99:0/1088581512 <== osd.10 v2:172.21.15.162:6818/1421879617 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f3c1002ee50 con 0x7f3bf80a9900 2024-02-21T23:01:40.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.404+0000 7f56baa00640 1 --2- 172.21.15.99:0/1834525160 >> [v2:172.21.15.181:6800/2011264527,v1:172.21.15.181:6801/2011264527] conn(0x7f56940a9830 0x7f56940abc70 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.405+0000 7f56baa00640 1 -- 172.21.15.99:0/1834525160 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f569409eea0 msgr2=0x7f56940a1360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.405+0000 7f56baa00640 1 --2- 172.21.15.99:0/1834525160 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f569409eea0 0x7f56940a1360 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f56a4006fd0 tx=0x7f56a4008040 comp rx=0 tx=0).stop 2024-02-21T23:01:40.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.405+0000 7f56baa00640 1 -- 172.21.15.99:0/1834525160 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f56b418c290 msgr2=0x7f56b42208d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.405+0000 7f56baa00640 1 --2- 172.21.15.99:0/1834525160 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f56b418c290 0x7f56b42208d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f56ac00c760 tx=0x7f56ac00cc20 comp rx=0 tx=0).stop 2024-02-21T23:01:40.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.405+0000 7f56b8a00640 1 -- 172.21.15.99:0/1834525160 reap_dead start 2024-02-21T23:01:40.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.407+0000 7f56baa00640 1 -- 172.21.15.99:0/1834525160 shutdown_connections 2024-02-21T23:01:40.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.407+0000 7f56baa00640 1 -- 172.21.15.99:0/1834525160 >> 172.21.15.99:0/1834525160 conn(0x7f56b40ce5f0 msgr2=0x7f56b4172210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:40.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.407+0000 7f56baa00640 1 -- 172.21.15.99:0/1834525160 shutdown_connections 2024-02-21T23:01:40.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.407+0000 7f56baa00640 1 -- 172.21.15.99:0/1834525160 wait complete. 2024-02-21T23:01:40.402 INFO:teuthology.orchestra.run.smithi099.stdout:73014444043 2024-02-21T23:01:40.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.410+0000 7f3c16800640 1 --2- 172.21.15.99:0/1088581512 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f3bf809ef70 0x7f3bf80a1430 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3c08009650 tx=0x7f3c08006ba0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:40.403 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.9 2024-02-21T23:01:40.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.429+0000 7f60a4200640 1 -- 172.21.15.99:0/2287303315 --> [v2:172.21.15.181:6802/3389807042,v1:172.21.15.181:6804/3389807042] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6078002dd0 con 0x7f607c0a9800 2024-02-21T23:01:40.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.435+0000 7fc289600640 1 -- 172.21.15.99:0/1883730632 --> [v2:172.21.15.162:6802/1659412949,v1:172.21.15.162:6803/1659412949] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc28417e8d0 con 0x7fc2640a97d0 2024-02-21T23:01:40.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.431+0000 7f6099600640 1 -- 172.21.15.99:0/2287303315 <== osd.8 v2:172.21.15.181:6802/3389807042 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6078002dd0 con 0x7f607c0a9800 2024-02-21T23:01:40.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.436+0000 7fc27aa00640 1 -- 172.21.15.99:0/1883730632 <== osd.7 v2:172.21.15.162:6802/1659412949 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc28417e8d0 con 0x7fc2640a97d0 2024-02-21T23:01:40.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.439+0000 7fc289600640 1 -- 172.21.15.99:0/1883730632 >> [v2:172.21.15.162:6802/1659412949,v1:172.21.15.162:6803/1659412949] conn(0x7fc2640a97d0 msgr2=0x7fc2640abc10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.439+0000 7fc289600640 1 --2- 172.21.15.99:0/1883730632 >> [v2:172.21.15.162:6802/1659412949,v1:172.21.15.162:6803/1659412949] conn(0x7fc2640a97d0 0x7fc2640abc10 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.441+0000 7fc289600640 1 -- 172.21.15.99:0/1883730632 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fc26409eec0 msgr2=0x7fc2640a1380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.441+0000 7fc289600640 1 --2- 172.21.15.99:0/1883730632 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fc26409eec0 0x7fc2640a1380 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc27c001120 tx=0x7fc27c0081c0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.441+0000 7fc289600640 1 -- 172.21.15.99:0/1883730632 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc28406db40 msgr2=0x7fc28422e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.441+0000 7fc289600640 1 --2- 172.21.15.99:0/1883730632 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc28406db40 0x7fc28422e720 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc274008960 tx=0x7fc274004730 comp rx=0 tx=0).stop 2024-02-21T23:01:40.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.436+0000 7f60a4200640 1 -- 172.21.15.99:0/2287303315 >> [v2:172.21.15.181:6802/3389807042,v1:172.21.15.181:6804/3389807042] conn(0x7f607c0a9800 msgr2=0x7f607c0abc40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.436+0000 7f60a4200640 1 --2- 172.21.15.99:0/2287303315 >> [v2:172.21.15.181:6802/3389807042,v1:172.21.15.181:6804/3389807042] conn(0x7f607c0a9800 0x7f607c0abc40 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.440+0000 7f60a4200640 1 -- 172.21.15.99:0/2287303315 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f607c09ee70 msgr2=0x7f607c0a1330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.440+0000 7f60a4200640 1 --2- 172.21.15.99:0/2287303315 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f607c09ee70 0x7f607c0a1330 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f609c221900 tx=0x7f6090008030 comp rx=0 tx=0).stop 2024-02-21T23:01:40.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.440+0000 7f60a4200640 1 -- 172.21.15.99:0/2287303315 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f609c15ca80 msgr2=0x7f609c0f0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.440+0000 7f60a4200640 1 --2- 172.21.15.99:0/2287303315 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f609c15ca80 0x7f609c0f0300 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f608800c7c0 tx=0x7f608800cc80 comp rx=0 tx=0).stop 2024-02-21T23:01:40.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.439+0000 7f3c03e00640 1 -- 172.21.15.99:0/1088581512 --> [v2:172.21.15.162:6818/1421879617,v1:172.21.15.162:6819/1421879617] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3c18068320 con 0x7f3bf80a9900 2024-02-21T23:01:40.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.440+0000 7f3c0ea00640 1 -- 172.21.15.99:0/1088581512 <== osd.10 v2:172.21.15.162:6818/1421879617 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3c18068320 con 0x7f3bf80a9900 2024-02-21T23:01:40.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.441+0000 7f3c03e00640 1 -- 172.21.15.99:0/1088581512 >> [v2:172.21.15.162:6818/1421879617,v1:172.21.15.162:6819/1421879617] conn(0x7f3bf80a9900 msgr2=0x7f3bf80abd40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.441+0000 7f3c03e00640 1 --2- 172.21.15.99:0/1088581512 >> [v2:172.21.15.162:6818/1421879617,v1:172.21.15.162:6819/1421879617] conn(0x7f3bf80a9900 0x7f3bf80abd40 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.442+0000 7fc282a00640 1 -- 172.21.15.99:0/1883730632 reap_dead start 2024-02-21T23:01:40.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.443+0000 7fc289600640 1 -- 172.21.15.99:0/1883730632 shutdown_connections 2024-02-21T23:01:40.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.443+0000 7fc289600640 1 -- 172.21.15.99:0/1883730632 >> 172.21.15.99:0/1883730632 conn(0x7fc2840f6c50 msgr2=0x7fc2840f7030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:40.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.441+0000 7f60a2200640 1 -- 172.21.15.99:0/2287303315 reap_dead start 2024-02-21T23:01:40.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.443+0000 7f60a4200640 1 -- 172.21.15.99:0/2287303315 shutdown_connections 2024-02-21T23:01:40.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.443+0000 7f60a4200640 1 -- 172.21.15.99:0/2287303315 >> 172.21.15.99:0/2287303315 conn(0x7f609c0ce5f0 msgr2=0x7f609c188b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:40.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.445+0000 7fc289600640 1 -- 172.21.15.99:0/1883730632 shutdown_connections 2024-02-21T23:01:40.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.445+0000 7f3c03e00640 1 -- 172.21.15.99:0/1088581512 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f3bf809ef70 msgr2=0x7f3bf80a1430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.445+0000 7fc289600640 1 -- 172.21.15.99:0/1883730632 wait complete. 2024-02-21T23:01:40.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.445+0000 7f3c03e00640 1 --2- 172.21.15.99:0/1088581512 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f3bf809ef70 0x7f3bf80a1430 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3c08009650 tx=0x7f3c08006ba0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.445+0000 7f3c03e00640 1 -- 172.21.15.99:0/1088581512 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3c181854f0 msgr2=0x7f3c18224780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.445+0000 7f3c03e00640 1 --2- 172.21.15.99:0/1088581512 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3c181854f0 0x7f3c18224780 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3c1002c680 tx=0x7f3c10004a40 comp rx=0 tx=0).stop 2024-02-21T23:01:40.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.445+0000 7f3c17200640 1 -- 172.21.15.99:0/1088581512 reap_dead start 2024-02-21T23:01:40.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.445+0000 7f3c03e00640 1 -- 172.21.15.99:0/1088581512 shutdown_connections 2024-02-21T23:01:40.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.445+0000 7f3c03e00640 1 -- 172.21.15.99:0/1088581512 >> 172.21.15.99:0/1088581512 conn(0x7f3c180ce3c0 msgr2=0x7f3c18184de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:40.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.446+0000 7f60a4200640 1 -- 172.21.15.99:0/2287303315 shutdown_connections 2024-02-21T23:01:40.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.446+0000 7f60a4200640 1 -- 172.21.15.99:0/2287303315 wait complete. 2024-02-21T23:01:40.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.451+0000 7f3c03e00640 1 -- 172.21.15.99:0/1088581512 shutdown_connections 2024-02-21T23:01:40.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.451+0000 7f3c03e00640 1 -- 172.21.15.99:0/1088581512 wait complete. 2024-02-21T23:01:40.445 INFO:teuthology.orchestra.run.smithi099.stdout:73014444043 2024-02-21T23:01:40.446 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-02-21T23:01:40.483 INFO:teuthology.orchestra.run.smithi099.stdout:73014444042 2024-02-21T23:01:40.483 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.8 2024-02-21T23:01:40.487 INFO:teuthology.orchestra.run.smithi099.stdout:73014444043 2024-02-21T23:01:40.487 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-02-21T23:01:40.501 INFO:teuthology.orchestra.run.smithi099.stdout:73014444042 2024-02-21T23:01:40.501 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.10 2024-02-21T23:01:40.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.785+0000 7f62ffe00640 1 Processor -- start 2024-02-21T23:01:40.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.785+0000 7f62ffe00640 1 -- start start 2024-02-21T23:01:40.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.793+0000 7f62ffe00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f62f810f280 0x7f62f807bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.793+0000 7f62ffe00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f62f810fef0 0x7f62f8110360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.793+0000 7f62ffe00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62f807d380 con 0x7f62f81108a0 2024-02-21T23:01:40.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.793+0000 7f62ffe00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62f810f660 con 0x7f62f810fef0 2024-02-21T23:01:40.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.793+0000 7f62ffe00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62f8112980 con 0x7f62f810f280 2024-02-21T23:01:40.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.795+0000 7f62fe000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f62f810fef0 0x7f62f8110360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.795+0000 7f62ff400640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f62f81108a0 0x7f62f807ea80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:48596/0 (socket says 172.21.15.99:48596) 2024-02-21T23:01:40.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.795+0000 7f62ff400640 1 -- 172.21.15.99:0/3837720759 learned_addr learned my addr 172.21.15.99:0/3837720759 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:01:40.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.795+0000 7f62fea00640 1 --2- 172.21.15.99:0/3837720759 >> v2:172.21.15.181:3300/0 conn(0x7f62f810f280 0x7f62f807bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.796+0000 7f62fea00640 1 -- 172.21.15.99:0/3837720759 >> v2:172.21.15.162:3300/0 conn(0x7f62f810fef0 msgr2=0x7f62f8110360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:40.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.796+0000 7f62fea00640 1 --2- 172.21.15.99:0/3837720759 >> v2:172.21.15.162:3300/0 conn(0x7f62f810fef0 0x7f62f8110360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.799+0000 7f62fd600640 1 -- 172.21.15.99:0/3837720759 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 978857203 0 0) 0x7f62f807d380 con 0x7f62f81108a0 2024-02-21T23:01:40.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.799+0000 7f62fea00640 1 -- 172.21.15.99:0/3837720759 >> v1:172.21.15.181:6789/0 conn(0x7f62f81108a0 legacy=0x7f62f807ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.799+0000 7f62fea00640 1 -- 172.21.15.99:0/3837720759 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62f807c530 con 0x7f62f810f280 2024-02-21T23:01:40.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.804+0000 7f62fea00640 1 --2- 172.21.15.99:0/3837720759 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62f810f280 0x7f62f807bff0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f62f807b260 tx=0x7f62f002b7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1d8f955705196d5 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:40.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.805+0000 7f62fd600640 1 -- 172.21.15.99:0/3837720759 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f0038070 con 0x7f62f810f280 2024-02-21T23:01:40.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.805+0000 7f62fd600640 1 -- 172.21.15.99:0/3837720759 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62f0031740 con 0x7f62f810f280 2024-02-21T23:01:40.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.806+0000 7f62ffe00640 1 -- 172.21.15.99:0/3837720759 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62f810f280 msgr2=0x7f62f807bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.806+0000 7f62fd600640 1 -- 172.21.15.99:0/3837720759 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f0038070 con 0x7f62f810f280 2024-02-21T23:01:40.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.806+0000 7f62ffe00640 1 --2- 172.21.15.99:0/3837720759 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62f810f280 0x7f62f807bff0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f62f807b260 tx=0x7f62f002b7e0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.806+0000 7f62ffe00640 1 -- 172.21.15.99:0/3837720759 shutdown_connections 2024-02-21T23:01:40.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.806+0000 7f62ffe00640 1 --2- 172.21.15.99:0/3837720759 >> v2:172.21.15.162:3300/0 conn(0x7f62f810fef0 0x7f62f8110360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.806+0000 7f62ffe00640 1 --2- 172.21.15.99:0/3837720759 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62f810f280 0x7f62f807bff0 secure :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f62f807b260 tx=0x7f62f002b7e0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.806+0000 7f62ffe00640 1 -- 172.21.15.99:0/3837720759 >> 172.21.15.99:0/3837720759 conn(0x7f62f8006360 msgr2=0x7f62f8006770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:40.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.806+0000 7f62ffe00640 1 -- 172.21.15.99:0/3837720759 shutdown_connections 2024-02-21T23:01:40.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.807+0000 7f62ffe00640 1 -- 172.21.15.99:0/3837720759 wait complete. 2024-02-21T23:01:40.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.810+0000 7f62ffe00640 1 Processor -- start 2024-02-21T23:01:40.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.835+0000 7f62ffe00640 1 -- start start 2024-02-21T23:01:40.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.845+0000 7f62ffe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62f810fef0 0x7f62f807a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.851+0000 7f62ffe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62f81108a0 0x7f62f81a5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.854+0000 7f62fe000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62f81108a0 0x7f62f81a5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.854+0000 7f62fe000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62f81108a0 0x7f62f81a5a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59608/0 (socket says 172.21.15.99:59608) 2024-02-21T23:01:40.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.854+0000 7f62ffe00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62f80fd840 0x7f62f81ab000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.855+0000 7f62fe000640 1 -- 172.21.15.99:0/1189533897 learned_addr learned my addr 172.21.15.99:0/1189533897 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:40.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.855+0000 7f62ff400640 1 --2- 172.21.15.99:0/1189533897 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62f80fd840 0x7f62f81ab000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.859+0000 7f62ffe00640 1 -- 172.21.15.99:0/1189533897 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f807cdc0 con 0x7f62f81108a0 2024-02-21T23:01:40.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.859+0000 7f62fea00640 1 --2- 172.21.15.99:0/1189533897 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62f810fef0 0x7f62f807a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.859+0000 7f62ffe00640 1 -- 172.21.15.99:0/1189533897 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f807cae0 con 0x7f62f810fef0 2024-02-21T23:01:40.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.859+0000 7f62ffe00640 1 -- 172.21.15.99:0/1189533897 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f807d0a0 con 0x7f62f80fd840 2024-02-21T23:01:40.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.861+0000 7f62fe000640 1 -- 172.21.15.99:0/1189533897 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62f80fd840 msgr2=0x7f62f81ab000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.861+0000 7f62fe000640 1 --2- 172.21.15.99:0/1189533897 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62f80fd840 0x7f62f81ab000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.861+0000 7f62fe000640 1 -- 172.21.15.99:0/1189533897 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62f810fef0 msgr2=0x7f62f807a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.861+0000 7f62fe000640 1 --2- 172.21.15.99:0/1189533897 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62f810fef0 0x7f62f807a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.861+0000 7f62fe000640 1 -- 172.21.15.99:0/1189533897 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62f80776b0 con 0x7f62f81108a0 2024-02-21T23:01:40.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.865+0000 7f62ff400640 1 --2- 172.21.15.99:0/1189533897 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62f80fd840 0x7f62f81ab000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:01:40.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.865+0000 7f62fea00640 1 --2- 172.21.15.99:0/1189533897 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62f810fef0 0x7f62f807a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:01:40.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.866+0000 7f62fe000640 1 --2- 172.21.15.99:0/1189533897 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62f81108a0 0x7f62f81a5a00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f62ec00eb70 tx=0x7f62ec00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:40.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.867+0000 7f62f6a00640 1 -- 172.21.15.99:0/1189533897 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ec017070 con 0x7f62f81108a0 2024-02-21T23:01:40.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.867+0000 7f62f6a00640 1 -- 172.21.15.99:0/1189533897 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62ec00ed80 con 0x7f62f81108a0 2024-02-21T23:01:40.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.867+0000 7f62ffe00640 1 -- 172.21.15.99:0/1189533897 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62f8079490 con 0x7f62f81108a0 2024-02-21T23:01:40.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.867+0000 7f62ffe00640 1 -- 172.21.15.99:0/1189533897 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62f8079a50 con 0x7f62f81108a0 2024-02-21T23:01:40.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.868+0000 7f62ffe00640 1 -- 172.21.15.99:0/1189533897 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62f80058a0 con 0x7f62f81108a0 2024-02-21T23:01:40.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.869+0000 7f62f6a00640 1 -- 172.21.15.99:0/1189533897 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ec013470 con 0x7f62f81108a0 2024-02-21T23:01:40.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.872+0000 7f6176200640 1 Processor -- start 2024-02-21T23:01:40.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.878+0000 7fe45fe00640 1 Processor -- start 2024-02-21T23:01:40.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.872+0000 7f6176200640 1 -- start start 2024-02-21T23:01:40.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.879+0000 7fe45fe00640 1 -- start start 2024-02-21T23:01:40.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.882+0000 7f6176200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f617006f980 0x7f61700718d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.882+0000 7fe45fe00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe458079470 0x7fe4580e1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.882+0000 7f6176200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61700f9820 con 0x7f61700c9000 2024-02-21T23:01:40.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.882+0000 7f6176200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f617006e4b0 con 0x7f61701965f0 2024-02-21T23:01:40.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.882+0000 7f6176200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61700f9b00 con 0x7f617006f980 2024-02-21T23:01:40.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.883+0000 7f616fe00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f617006f980 0x7f61700718d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.883+0000 7f616fe00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f617006f980 0x7f61700718d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:40694/0 (socket says 172.21.15.99:40694) 2024-02-21T23:01:40.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.883+0000 7f616fe00640 1 -- 172.21.15.99:0/3648373100 learned_addr learned my addr 172.21.15.99:0/3648373100 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:40.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.883+0000 7fe45fe00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe45810b350 0x7fe458079850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.883+0000 7fe45fe00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4580e2200 con 0x7fe4580e1a90 2024-02-21T23:01:40.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.884+0000 7fe45ea00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe458079470 0x7fe4580e1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.884+0000 7fe45ea00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe458079470 0x7fe4580e1550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:40686/0 (socket says 172.21.15.99:40686) 2024-02-21T23:01:40.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.884+0000 7f616fe00640 1 -- 172.21.15.99:0/3648373100 >> v1:172.21.15.162:6789/0 conn(0x7f61701965f0 legacy=0x7f617006f270 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T23:01:40.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.884+0000 7f616fe00640 1 -- 172.21.15.99:0/3648373100 >> v1:172.21.15.99:6789/0 conn(0x7f61700c9000 legacy=0x7f61700f84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.884+0000 7fe45ea00640 1 -- 172.21.15.99:0/1119702975 learned_addr learned my addr 172.21.15.99:0/1119702975 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:40.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.884+0000 7fe45fe00640 1 -- 172.21.15.99:0/1119702975 --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe458057500 con 0x7fe45810b350 2024-02-21T23:01:40.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.884+0000 7fe45fe00640 1 -- 172.21.15.99:0/1119702975 --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4580544e0 con 0x7fe458079470 2024-02-21T23:01:40.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.885+0000 7fa132400640 1 Processor -- start 2024-02-21T23:01:40.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.885+0000 7fe465600640 1 --2- 172.21.15.99:0/1119702975 >> v2:172.21.15.99:3300/0 conn(0x7fe45810b350 0x7fe458079850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.885+0000 7fa132400640 1 -- start start 2024-02-21T23:01:40.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.887+0000 7fe465600640 1 -- 172.21.15.99:0/1119702975 >> v2:172.21.15.162:3300/0 conn(0x7fe458079470 msgr2=0x7fe4580e1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:40.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.887+0000 7fe465600640 1 --2- 172.21.15.99:0/1119702975 >> v2:172.21.15.162:3300/0 conn(0x7fe458079470 0x7fe4580e1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.887+0000 7fe465600640 1 -- 172.21.15.99:0/1119702975 >> v1:172.21.15.99:6789/0 conn(0x7fe4580e1a90 legacy=0x7fe45810ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.888+0000 7fe465600640 1 -- 172.21.15.99:0/1119702975 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4580547c0 con 0x7fe45810b350 2024-02-21T23:01:40.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.888+0000 7f616fe00640 1 -- 172.21.15.99:0/3648373100 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f617006e790 con 0x7f617006f980 2024-02-21T23:01:40.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.889+0000 7fe465600640 1 --2- 172.21.15.99:0/1119702975 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe45810b350 0x7fe458079850 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe460050500 tx=0x7fe4600a7290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=366cb6535cba29c3 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:40.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.890+0000 7fa132400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa12c0f9500 0x7fa12c06d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.890+0000 7fa132400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa12c06db40 0x7fa12c188320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.890+0000 7fa132400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa12c0710a0 con 0x7fa12c06d220 2024-02-21T23:01:40.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.890+0000 7fa132400640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa12c071380 con 0x7fa12c06db40 2024-02-21T23:01:40.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.890+0000 7fa132400640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa12c071660 con 0x7fa12c0f9500 2024-02-21T23:01:40.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.891+0000 7fa12b400640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fa12c06d220 0x7fa12c070800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.99:46992/0 (socket says 172.21.15.99:46992) 2024-02-21T23:01:40.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.891+0000 7fa12b400640 1 -- 172.21.15.99:0/1473767471 learned_addr learned my addr 172.21.15.99:0/1473767471 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:01:40.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.891+0000 7fa130e00640 1 --2- 172.21.15.99:0/1473767471 >> v2:172.21.15.99:3300/0 conn(0x7fa12c06db40 0x7fa12c188320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.892+0000 7fa12aa00640 1 --2- 172.21.15.99:0/1473767471 >> v2:172.21.15.162:3300/0 conn(0x7fa12c0f9500 0x7fa12c06d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.889+0000 7f616fe00640 1 --2- 172.21.15.99:0/3648373100 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f617006f980 0x7f61700718d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6168009e50 tx=0x7f616802be50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f698cf8dfa657821 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:40.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.892+0000 7f7423200640 1 Processor -- start 2024-02-21T23:01:40.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.893+0000 7f7423200640 1 -- start start 2024-02-21T23:01:40.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.893+0000 7f616e000640 1 -- 172.21.15.99:0/3648373100 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f616802c9f0 con 0x7f617006f980 2024-02-21T23:01:40.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.893+0000 7f616e000640 1 -- 172.21.15.99:0/3648373100 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f616802cb90 con 0x7f617006f980 2024-02-21T23:01:40.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.893+0000 7f616e000640 1 -- 172.21.15.99:0/3648373100 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61680343f0 con 0x7f617006f980 2024-02-21T23:01:40.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.893+0000 7fa12a000640 1 -- 172.21.15.99:0/1473767471 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1877497551 0 0) 0x7fa12c0710a0 con 0x7fa12c06d220 2024-02-21T23:01:40.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.893+0000 7fa130e00640 1 -- 172.21.15.99:0/1473767471 >> v2:172.21.15.162:3300/0 conn(0x7fa12c0f9500 msgr2=0x7fa12c06d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:40.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.893+0000 7fa130e00640 1 --2- 172.21.15.99:0/1473767471 >> v2:172.21.15.162:3300/0 conn(0x7fa12c0f9500 0x7fa12c06d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.893+0000 7fa130e00640 1 -- 172.21.15.99:0/1473767471 >> v1:172.21.15.162:6789/0 conn(0x7fa12c06d220 legacy=0x7fa12c070800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.893+0000 7fa130e00640 1 -- 172.21.15.99:0/1473767471 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa12c071940 con 0x7fa12c06db40 2024-02-21T23:01:40.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.894+0000 7f6176200640 1 -- 172.21.15.99:0/3648373100 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f617006f980 msgr2=0x7f61700718d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.894+0000 7f6176200640 1 --2- 172.21.15.99:0/3648373100 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f617006f980 0x7f61700718d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6168009e50 tx=0x7f616802be50 comp rx=0 tx=0).stop 2024-02-21T23:01:40.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.895+0000 7f6176200640 1 -- 172.21.15.99:0/3648373100 shutdown_connections 2024-02-21T23:01:40.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.895+0000 7f6176200640 1 --2- 172.21.15.99:0/3648373100 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f617006f980 0x7f61700718d0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.896+0000 7f6176200640 1 -- 172.21.15.99:0/3648373100 >> 172.21.15.99:0/3648373100 conn(0x7f61700ce5f0 msgr2=0x7f61700cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:40.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.896+0000 7f62f6a00640 1 -- 172.21.15.99:0/1189533897 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 6) v1 ==== 134407+0+0 (secure 0 0 0) 0x7f62ec01a070 con 0x7f62f81108a0 2024-02-21T23:01:40.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.895+0000 7f7423200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7424182a80 0x7f742418a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.895+0000 7f7423200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f742418a600 con 0x7f74240719b0 2024-02-21T23:01:40.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.896+0000 7f7423200640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f742418a8e0 con 0x7f742418b980 2024-02-21T23:01:40.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.897+0000 7f7423200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f742418abc0 con 0x7f7424182a80 2024-02-21T23:01:40.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.897+0000 7f7422800640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f74240719b0 0x7f7424071e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:52638/0 (socket says 172.21.15.99:52638) 2024-02-21T23:01:40.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.897+0000 7f7422800640 1 -- 172.21.15.99:0/1992730474 learned_addr learned my addr 172.21.15.99:0/1992730474 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:01:40.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.897+0000 7fa130e00640 1 --2- 172.21.15.99:0/1473767471 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa12c06db40 0x7fa12c188320 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa12c182670 tx=0x7fa12402d0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=213fc4473ddfb6ed server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:40.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.897+0000 7f7421e00640 1 --2- 172.21.15.99:0/1992730474 >> v2:172.21.15.99:3300/0 conn(0x7f7424182a80 0x7f742418a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.898+0000 7f6176200640 1 -- 172.21.15.99:0/3648373100 shutdown_connections 2024-02-21T23:01:40.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.899+0000 7f6176200640 1 -- 172.21.15.99:0/3648373100 wait complete. 2024-02-21T23:01:40.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.899+0000 7fe45d600640 1 -- 172.21.15.99:0/1119702975 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4600b4070 con 0x7fe45810b350 2024-02-21T23:01:40.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.899+0000 7fe45d600640 1 -- 172.21.15.99:0/1119702975 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4600af640 con 0x7fe45810b350 2024-02-21T23:01:40.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.898+0000 7f7420a00640 1 -- 172.21.15.99:0/1992730474 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1928302404 0 0) 0x7f742418a600 con 0x7f74240719b0 2024-02-21T23:01:40.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.900+0000 7fe45fe00640 1 -- 172.21.15.99:0/1119702975 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe45810b350 msgr2=0x7fe458079850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.900+0000 7fe45fe00640 1 --2- 172.21.15.99:0/1119702975 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe45810b350 0x7fe458079850 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe460050500 tx=0x7fe4600a7290 comp rx=0 tx=0).stop 2024-02-21T23:01:40.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.901+0000 7fe45fe00640 1 -- 172.21.15.99:0/1119702975 shutdown_connections 2024-02-21T23:01:40.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.901+0000 7fe45fe00640 1 --2- 172.21.15.99:0/1119702975 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe45810b350 0x7fe458079850 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.901+0000 7f7420a00640 1 -- 172.21.15.99:0/1992730474 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7408003520 con 0x7f74240719b0 2024-02-21T23:01:40.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.901+0000 7fe45fe00640 1 --2- 172.21.15.99:0/1119702975 >> v2:172.21.15.162:3300/0 conn(0x7fe458079470 0x7fe4580e1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.901+0000 7fe45fe00640 1 -- 172.21.15.99:0/1119702975 >> 172.21.15.99:0/1119702975 conn(0x7fe458052fc0 msgr2=0x7fe4580533d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:40.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.901+0000 7fe45fe00640 1 -- 172.21.15.99:0/1119702975 shutdown_connections 2024-02-21T23:01:40.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.901+0000 7fe45fe00640 1 -- 172.21.15.99:0/1119702975 wait complete. 2024-02-21T23:01:40.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.902+0000 7fa12a000640 1 -- 172.21.15.99:0/1473767471 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa12403a070 con 0x7fa12c06db40 2024-02-21T23:01:40.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.902+0000 7fa12a000640 1 -- 172.21.15.99:0/1473767471 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa12402dc80 con 0x7fa12c06db40 2024-02-21T23:01:40.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.902+0000 7fa12a000640 1 -- 172.21.15.99:0/1473767471 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa124035660 con 0x7fa12c06db40 2024-02-21T23:01:40.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.904+0000 7f6176200640 1 Processor -- start 2024-02-21T23:01:40.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.904+0000 7f6176200640 1 -- start start 2024-02-21T23:01:40.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.905+0000 7fe45fe00640 1 Processor -- start 2024-02-21T23:01:40.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.906+0000 7fa132400640 1 -- 172.21.15.99:0/1473767471 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa12c06db40 msgr2=0x7fa12c188320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.906+0000 7fa132400640 1 --2- 172.21.15.99:0/1473767471 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa12c06db40 0x7fa12c188320 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa12c182670 tx=0x7fa12402d0e0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.906+0000 7fe45fe00640 1 -- start start 2024-02-21T23:01:40.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.899+0000 7f62f6a00640 1 --2- 172.21.15.99:0/1189533897 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f62e009eec0 0x7f62e00a1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.900+0000 7f62f6a00640 1 -- 172.21.15.99:0/1189533897 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f62ec0ca260 con 0x7f62f81108a0 2024-02-21T23:01:40.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.907+0000 7f62f6a00640 1 -- 172.21.15.99:0/1189533897 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f62ec0985d0 con 0x7f62f81108a0 2024-02-21T23:01:40.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.907+0000 7f6176200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f617006f980 0x7f61700cc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.907+0000 7fa132400640 1 -- 172.21.15.99:0/1473767471 shutdown_connections 2024-02-21T23:01:40.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.907+0000 7fa132400640 1 --2- 172.21.15.99:0/1473767471 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa12c06db40 0x7fa12c188320 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.907+0000 7fa132400640 1 --2- 172.21.15.99:0/1473767471 >> v2:172.21.15.162:3300/0 conn(0x7fa12c0f9500 0x7fa12c06d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.907+0000 7fa132400640 1 -- 172.21.15.99:0/1473767471 >> 172.21.15.99:0/1473767471 conn(0x7fa12c0f6c50 msgr2=0x7fa12c0f7060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:40.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.908+0000 7f6176200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61700c9000 0x7f61700cdd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.908+0000 7f6176200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f61701965f0 0x7f617017f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.908+0000 7fa132400640 1 -- 172.21.15.99:0/1473767471 shutdown_connections 2024-02-21T23:01:40.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.908+0000 7f6176200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6170193810 con 0x7f617006f980 2024-02-21T23:01:40.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.909+0000 7f6176200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f617006ede0 con 0x7f61700c9000 2024-02-21T23:01:40.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.909+0000 7f6176200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6170071e10 con 0x7f61701965f0 2024-02-21T23:01:40.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.909+0000 7f616ea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61700c9000 0x7f61700cdd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.910+0000 7fe45fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe458079470 0x7fe458101720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.901+0000 7f7421e00640 1 -- 172.21.15.99:0/1992730474 >> v1:172.21.15.181:6789/0 conn(0x7f742418b980 legacy=0x7f7424186a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:40.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.901+0000 7f7421e00640 1 -- 172.21.15.99:0/1992730474 >> v1:172.21.15.99:6789/0 conn(0x7f74240719b0 legacy=0x7f7424071e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.901+0000 7f7421e00640 1 -- 172.21.15.99:0/1992730474 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f742418aea0 con 0x7f7424182a80 2024-02-21T23:01:40.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.910+0000 7fe45fe00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe4580e1a90 0x7fe4580fd260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.907+0000 7f62fea00640 1 --2- 172.21.15.99:0/1189533897 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f62e009eec0 0x7f62e00a1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.910+0000 7fe45fe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe45810b350 0x7fe4580d9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.910+0000 7fe45ea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe458079470 0x7fe458101720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.910+0000 7fe45ea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe458079470 0x7fe458101720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59646/0 (socket says 172.21.15.99:59646) 2024-02-21T23:01:40.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.911+0000 7fe45ea00640 1 -- 172.21.15.99:0/1308113303 learned_addr learned my addr 172.21.15.99:0/1308113303 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:40.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.910+0000 7fa132400640 1 -- 172.21.15.99:0/1473767471 wait complete. 2024-02-21T23:01:40.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.911+0000 7fe45fe00640 1 -- 172.21.15.99:0/1308113303 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4580e1f20 con 0x7fe458079470 2024-02-21T23:01:40.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.911+0000 7fe45fe00640 1 -- 172.21.15.99:0/1308113303 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe458054d80 con 0x7fe45810b350 2024-02-21T23:01:40.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.911+0000 7fe45fe00640 1 -- 172.21.15.99:0/1308113303 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4580552a0 con 0x7fe4580e1a90 2024-02-21T23:01:40.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.911+0000 7f7421e00640 1 --2- 172.21.15.99:0/1992730474 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7424182a80 0x7f742418a010 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f741c009d90 tx=0x7f741c02bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64ea9dbbba8a3a75 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:40.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.912+0000 7fe45ea00640 1 -- 172.21.15.99:0/1308113303 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe4580e1a90 msgr2=0x7fe4580fd260 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-21T23:01:40.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.912+0000 7fe45ea00640 1 --2- 172.21.15.99:0/1308113303 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe4580e1a90 0x7fe4580fd260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.912+0000 7fe45ea00640 1 -- 172.21.15.99:0/1308113303 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe45810b350 msgr2=0x7fe4580d9fe0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-21T23:01:40.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.912+0000 7fe45ea00640 1 --2- 172.21.15.99:0/1308113303 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe45810b350 0x7fe4580d9fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.912+0000 7fe45ea00640 1 -- 172.21.15.99:0/1308113303 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4581a0760 con 0x7fe458079470 2024-02-21T23:01:40.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.912+0000 7f7420a00640 1 -- 172.21.15.99:0/1992730474 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f741c039070 con 0x7f7424182a80 2024-02-21T23:01:40.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.912+0000 7f7420a00640 1 -- 172.21.15.99:0/1992730474 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f741c02cb60 con 0x7f7424182a80 2024-02-21T23:01:40.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.912+0000 7f7420a00640 1 -- 172.21.15.99:0/1992730474 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f741c034440 con 0x7f7424182a80 2024-02-21T23:01:40.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.913+0000 7fe45ea00640 1 --2- 172.21.15.99:0/1308113303 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe458079470 0x7fe458101720 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe45000e870 tx=0x7fe45000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:40.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.913+0000 7fe456a00640 1 -- 172.21.15.99:0/1308113303 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe450017070 con 0x7fe458079470 2024-02-21T23:01:40.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.914+0000 7fe456a00640 1 -- 172.21.15.99:0/1308113303 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe45000ee60 con 0x7fe458079470 2024-02-21T23:01:40.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.914+0000 7fe45fe00640 1 -- 172.21.15.99:0/1308113303 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4581a3cb0 con 0x7fe458079470 2024-02-21T23:01:40.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.914+0000 7fe45fe00640 1 -- 172.21.15.99:0/1308113303 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe458101c60 con 0x7fe458079470 2024-02-21T23:01:40.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.915+0000 7fa132400640 1 Processor -- start 2024-02-21T23:01:40.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.910+0000 7f616f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f617006f980 0x7f61700cc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.913+0000 7f616fe00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f61701965f0 0x7f617017f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.914+0000 7f616f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f617006f980 0x7f61700cc3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59630/0 (socket says 172.21.15.99:59630) 2024-02-21T23:01:40.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.914+0000 7f616f400640 1 -- 172.21.15.99:0/862286926 learned_addr learned my addr 172.21.15.99:0/862286926 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:40.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.914+0000 7f616ea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61700c9000 0x7f61700cdd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:40708/0 (socket says 172.21.15.99:40708) 2024-02-21T23:01:40.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.912+0000 7f62fea00640 1 --2- 172.21.15.99:0/1189533897 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f62e009eec0 0x7f62e00a1380 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f62f0035000 tx=0x7f62f0008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:40.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.917+0000 7f616f400640 1 -- 172.21.15.99:0/862286926 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f61701965f0 msgr2=0x7f617017f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.917+0000 7f616f400640 1 --2- 172.21.15.99:0/862286926 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f61701965f0 0x7f617017f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.917+0000 7f616f400640 1 -- 172.21.15.99:0/862286926 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61700c9000 msgr2=0x7f61700cdd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.914+0000 7f7423200640 1 -- 172.21.15.99:0/1992730474 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7424182a80 msgr2=0x7f742418a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.914+0000 7f7423200640 1 --2- 172.21.15.99:0/1992730474 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7424182a80 0x7f742418a010 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f741c009d90 tx=0x7f741c02bdb0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.917+0000 7f616f400640 1 --2- 172.21.15.99:0/862286926 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61700c9000 0x7f61700cdd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.917+0000 7f7423200640 1 -- 172.21.15.99:0/1992730474 shutdown_connections 2024-02-21T23:01:40.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.917+0000 7f7423200640 1 --2- 172.21.15.99:0/1992730474 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7424182a80 0x7f742418a010 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.918+0000 7f7423200640 1 -- 172.21.15.99:0/1992730474 >> 172.21.15.99:0/1992730474 conn(0x7f74240d29f0 msgr2=0x7f74240d2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:40.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.917+0000 7f616f400640 1 -- 172.21.15.99:0/862286926 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61700ce240 con 0x7f617006f980 2024-02-21T23:01:40.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.918+0000 7fe44be00640 1 -- 172.21.15.99:0/1308113303 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe438005290 con 0x7fe458079470 2024-02-21T23:01:40.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.918+0000 7fa132400640 1 -- start start 2024-02-21T23:01:40.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.918+0000 7f7423200640 1 -- 172.21.15.99:0/1992730474 shutdown_connections 2024-02-21T23:01:40.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.918+0000 7f616f400640 1 --2- 172.21.15.99:0/862286926 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f617006f980 0x7f61700cc3d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f616000b410 tx=0x7f616000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:40.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.919+0000 7fe456a00640 1 -- 172.21.15.99:0/1308113303 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe45000cb40 con 0x7fe458079470 2024-02-21T23:01:40.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.922+0000 7f6167400640 1 -- 172.21.15.99:0/862286926 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6160015020 con 0x7f617006f980 2024-02-21T23:01:40.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.922+0000 7f6176200640 1 -- 172.21.15.99:0/862286926 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61700cca30 con 0x7f617006f980 2024-02-21T23:01:40.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.922+0000 7f6167400640 1 -- 172.21.15.99:0/862286926 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6160011830 con 0x7f617006f980 2024-02-21T23:01:40.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.928+0000 7fa132400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa12c06d220 0x7fa12c21f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.929+0000 7fa132400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa12c06db40 0x7fa12c21f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.929+0000 7f6167400640 1 -- 172.21.15.99:0/862286926 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6160015020 con 0x7f617006f980 2024-02-21T23:01:40.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.929+0000 7fe456a00640 1 -- 172.21.15.99:0/1308113303 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 6) v1 ==== 134407+0+0 (secure 0 0 0) 0x7fe45001a070 con 0x7fe458079470 2024-02-21T23:01:40.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.929+0000 7f7423200640 1 -- 172.21.15.99:0/1992730474 wait complete. 2024-02-21T23:01:40.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.934+0000 7f7423200640 1 Processor -- start 2024-02-21T23:01:40.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.934+0000 7f7423200640 1 -- start start 2024-02-21T23:01:40.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.936+0000 7fa132400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa12c0f9500 0x7fa12c1720e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.937+0000 7f7423200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f74240719b0 0x7f74240fce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.937+0000 7f7423200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7424182a80 0x7f742417c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.937+0000 7f7423200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f742418b980 0x7f742417d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.938+0000 7f7423200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f742418be00 con 0x7f74240719b0 2024-02-21T23:01:40.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.938+0000 7f7423200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f742418b460 con 0x7f742418b980 2024-02-21T23:01:40.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.938+0000 7f7421e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f74240719b0 0x7f74240fce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.939+0000 7f7421e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f74240719b0 0x7f74240fce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59656/0 (socket says 172.21.15.99:59656) 2024-02-21T23:01:40.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.939+0000 7f7421e00640 1 -- 172.21.15.99:0/737490207 learned_addr learned my addr 172.21.15.99:0/737490207 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:40.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.939+0000 7f7423200640 1 -- 172.21.15.99:0/737490207 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7424182e60 con 0x7f7424182a80 2024-02-21T23:01:40.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.939+0000 7f6176200640 1 -- 172.21.15.99:0/862286926 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61700ccff0 con 0x7f617006f980 2024-02-21T23:01:40.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.939+0000 7f7421400640 1 --2- 172.21.15.99:0/737490207 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7424182a80 0x7f742417c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.940+0000 7f7421e00640 1 -- 172.21.15.99:0/737490207 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7424182a80 msgr2=0x7f742417c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.941+0000 7f7421e00640 1 --2- 172.21.15.99:0/737490207 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7424182a80 0x7f742417c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.941+0000 7f7421e00640 1 -- 172.21.15.99:0/737490207 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f742418b980 msgr2=0x7f742417d470 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-21T23:01:40.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.941+0000 7f7421e00640 1 --2- 172.21.15.99:0/737490207 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f742418b980 0x7f742417d470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.941+0000 7f7421e00640 1 -- 172.21.15.99:0/737490207 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74240fea50 con 0x7f74240719b0 2024-02-21T23:01:40.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.942+0000 7f7421e00640 1 --2- 172.21.15.99:0/737490207 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f74240719b0 0x7f74240fce30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f741c037040 tx=0x7f741c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:40.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.938+0000 7fe456a00640 1 --2- 172.21.15.99:0/1308113303 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fe44009ee70 0x7fe4400a1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.939+0000 7fe456a00640 1 -- 172.21.15.99:0/1308113303 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fe4500c9e10 con 0x7fe458079470 2024-02-21T23:01:40.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.936+0000 7fa12b400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa12c06d220 0x7fa12c21f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.936+0000 7fa12b400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa12c06d220 0x7fa12c21f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59652/0 (socket says 172.21.15.99:59652) 2024-02-21T23:01:40.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.944+0000 7fa132400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa12c06dfd0 con 0x7fa12c06d220 2024-02-21T23:01:40.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.944+0000 7fa132400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa12c072000 con 0x7fa12c06db40 2024-02-21T23:01:40.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.944+0000 7fa132400640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa12c17ee00 con 0x7fa12c0f9500 2024-02-21T23:01:40.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.944+0000 7fa130e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa12c0f9500 0x7fa12c1720e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.944+0000 7fa12aa00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa12c06db40 0x7fa12c21f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.944+0000 7fa12b400640 1 -- 172.21.15.99:0/2120613652 learned_addr learned my addr 172.21.15.99:0/2120613652 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:40.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.944+0000 7fe45e000640 1 --2- 172.21.15.99:0/1308113303 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fe44009ee70 0x7fe4400a1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.944+0000 7f6176200640 1 -- 172.21.15.99:0/862286926 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61700cd990 con 0x7f617006f980 2024-02-21T23:01:40.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.945+0000 7fa12b400640 1 -- 172.21.15.99:0/2120613652 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa12c0f9500 msgr2=0x7fa12c1720e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.945+0000 7fa12b400640 1 --2- 172.21.15.99:0/2120613652 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa12c0f9500 0x7fa12c1720e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.945+0000 7fa12b400640 1 -- 172.21.15.99:0/2120613652 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa12c06db40 msgr2=0x7fa12c21f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.945+0000 7fa12b400640 1 --2- 172.21.15.99:0/2120613652 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa12c06db40 0x7fa12c21f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.945+0000 7fa12b400640 1 -- 172.21.15.99:0/2120613652 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa12c186fb0 con 0x7fa12c06d220 2024-02-21T23:01:40.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.945+0000 7fa130e00640 1 --2- 172.21.15.99:0/2120613652 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa12c0f9500 0x7fa12c1720e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:01:40.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.945+0000 7fa12b400640 1 --2- 172.21.15.99:0/2120613652 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa12c06d220 0x7fa12c21f2f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa12000b480 tx=0x7fa12000b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:40.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.948+0000 7f741a000640 1 -- 172.21.15.99:0/737490207 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f741c044020 con 0x7f74240719b0 2024-02-21T23:01:40.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.948+0000 7f741a000640 1 -- 172.21.15.99:0/737490207 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f741c03f670 con 0x7f74240719b0 2024-02-21T23:01:40.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.948+0000 7f7423200640 1 -- 172.21.15.99:0/737490207 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74240fd6d0 con 0x7f74240719b0 2024-02-21T23:01:40.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.949+0000 7f7423200640 1 -- 172.21.15.99:0/737490207 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74240fdc90 con 0x7f74240719b0 2024-02-21T23:01:40.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.949+0000 7fa11f400640 1 -- 172.21.15.99:0/2120613652 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa120004e30 con 0x7fa12c06d220 2024-02-21T23:01:40.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.949+0000 7fa11f400640 1 -- 172.21.15.99:0/2120613652 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa120015070 con 0x7fa12c06d220 2024-02-21T23:01:40.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.949+0000 7fa132400640 1 -- 172.21.15.99:0/2120613652 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa12c187290 con 0x7fa12c06d220 2024-02-21T23:01:40.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.949+0000 7fa132400640 1 -- 172.21.15.99:0/2120613652 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa12c0cca60 con 0x7fa12c06d220 2024-02-21T23:01:40.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.949+0000 7fa11f400640 1 -- 172.21.15.99:0/2120613652 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa120004e30 con 0x7fa12c06d220 2024-02-21T23:01:40.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.952+0000 7fa132400640 1 -- 172.21.15.99:0/2120613652 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa12c068780 con 0x7fa12c06d220 2024-02-21T23:01:40.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.945+0000 7fe45e000640 1 --2- 172.21.15.99:0/1308113303 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fe44009ee70 0x7fe4400a1330 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe458078d60 tx=0x7fe44c0079d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:40.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.955+0000 7fe456a00640 1 -- 172.21.15.99:0/1308113303 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fe450098010 con 0x7fe458079470 2024-02-21T23:01:40.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.956+0000 7fb776400640 1 Processor -- start 2024-02-21T23:01:40.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.950+0000 7f741a000640 1 -- 172.21.15.99:0/737490207 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f741c039040 con 0x7f74240719b0 2024-02-21T23:01:40.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.956+0000 7f6167400640 1 -- 172.21.15.99:0/862286926 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 6) v1 ==== 134407+0+0 (secure 0 0 0) 0x7f6160018020 con 0x7f617006f980 2024-02-21T23:01:40.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.956+0000 7fb776400640 1 -- start start 2024-02-21T23:01:40.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.960+0000 7fb776400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb77018a9e0 0x7fb770102120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.960+0000 7fb776400640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb77018df90 con 0x7fb77018b660 2024-02-21T23:01:40.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.960+0000 7fb76ea00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fb77006f6c0 0x7fb77018af50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.99:47002/0 (socket says 172.21.15.99:47002) 2024-02-21T23:01:40.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.961+0000 7fb76ea00640 1 -- 172.21.15.99:0/2027344763 learned_addr learned my addr 172.21.15.99:0/2027344763 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:01:40.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.961+0000 7fb76f400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb77018a9e0 0x7fb770102120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.961+0000 7fb776400640 1 -- 172.21.15.99:0/2027344763 --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb77006fdb0 con 0x7fb77006f6c0 2024-02-21T23:01:40.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.962+0000 7fb776400640 1 -- 172.21.15.99:0/2027344763 --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb77006fb70 con 0x7fb77018a9e0 2024-02-21T23:01:40.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.962+0000 7fb76e000640 1 -- 172.21.15.99:0/2027344763 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4008204385 0 0) 0x7fb77006fdb0 con 0x7fb77006f6c0 2024-02-21T23:01:40.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.962+0000 7fb76e000640 1 -- 172.21.15.99:0/2027344763 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb754003520 con 0x7fb77006f6c0 2024-02-21T23:01:40.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.963+0000 7fb76e000640 1 -- 172.21.15.99:0/2027344763 <== mon.1 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3360920304 0 0) 0x7fb754003520 con 0x7fb77006f6c0 2024-02-21T23:01:40.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.963+0000 7fb76e000640 1 -- 172.21.15.99:0/2027344763 >> v2:172.21.15.162:3300/0 conn(0x7fb77018a9e0 msgr2=0x7fb770102120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:40.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.964+0000 7fb76e000640 1 --2- 172.21.15.99:0/2027344763 >> v2:172.21.15.162:3300/0 conn(0x7fb77018a9e0 0x7fb770102120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.964+0000 7fb76e000640 1 -- 172.21.15.99:0/2027344763 >> v1:172.21.15.99:6789/0 conn(0x7fb77018b660 legacy=0x7fb7701905d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:40.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.964+0000 7fb76e000640 1 -- 172.21.15.99:0/2027344763 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb770070090 con 0x7fb77006f6c0 2024-02-21T23:01:40.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.964+0000 7fb76e000640 1 -- 172.21.15.99:0/2027344763 <== mon.1 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2069890144 0 0) 0x7fb75c001650 con 0x7fb77006f6c0 2024-02-21T23:01:40.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.964+0000 7fb76e000640 1 -- 172.21.15.99:0/2027344763 >> v1:172.21.15.162:6789/0 conn(0x7fb77006f6c0 legacy=0x7fb77018af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.964+0000 7fb76e000640 1 --2- 172.21.15.99:0/2027344763 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb754003a20 0x7fb754003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.964+0000 7fb76e000640 1 --2- 172.21.15.99:0/2027344763 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb754004800 0x7fb754004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.965+0000 7fb76e000640 1 --2- 172.21.15.99:0/2027344763 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb7540052e0 0x7fb75400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.965+0000 7fb76f400640 1 --2- 172.21.15.99:0/2027344763 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb754003a20 0x7fb754003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.966+0000 7fb76e000640 1 -- 172.21.15.99:0/2027344763 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb77006fb70 con 0x7fb754004800 2024-02-21T23:01:40.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.965+0000 7fa11f400640 1 -- 172.21.15.99:0/2120613652 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 6) v1 ==== 134407+0+0 (secure 0 0 0) 0x7fa120006070 con 0x7fa12c06d220 2024-02-21T23:01:40.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.966+0000 7fb76fe00640 1 --2- 172.21.15.99:0/2027344763 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb7540052e0 0x7fb75400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.961+0000 7f7423200640 1 -- 172.21.15.99:0/737490207 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73fc005290 con 0x7f74240719b0 2024-02-21T23:01:40.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.968+0000 7f741a000640 1 -- 172.21.15.99:0/737490207 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 6) v1 ==== 134407+0+0 (secure 0 0 0) 0x7f741c047020 con 0x7f74240719b0 2024-02-21T23:01:40.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.966+0000 7fb76ea00640 1 --2- 172.21.15.99:0/2027344763 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb754004800 0x7fb754004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.968+0000 7fb76e000640 1 -- 172.21.15.99:0/2027344763 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb75400c230 con 0x7fb7540052e0 2024-02-21T23:01:40.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.968+0000 7fb76e000640 1 -- 172.21.15.99:0/2027344763 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb75400c430 con 0x7fb754003a20 2024-02-21T23:01:40.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.969+0000 7fb76ea00640 1 -- 172.21.15.99:0/2027344763 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb754003a20 msgr2=0x7fb754003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:40.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.969+0000 7fb76ea00640 1 --2- 172.21.15.99:0/2027344763 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb754003a20 0x7fb754003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.969+0000 7fb76ea00640 1 -- 172.21.15.99:0/2027344763 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb7540052e0 msgr2=0x7fb75400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:40.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.970+0000 7fb76ea00640 1 --2- 172.21.15.99:0/2027344763 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb7540052e0 0x7fb75400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.970+0000 7fb76f400640 1 --2- 172.21.15.99:0/2027344763 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb754003a20 0x7fb754003e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T23:01:40.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.970+0000 7fb76ea00640 1 -- 172.21.15.99:0/2027344763 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb75400c6f0 con 0x7fb754004800 2024-02-21T23:01:40.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.970+0000 7fb76fe00640 1 --2- 172.21.15.99:0/2027344763 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb7540052e0 0x7fb75400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:01:40.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.970+0000 7fb76fe00640 1 -- 172.21.15.99:0/2027344763 reap_dead start 2024-02-21T23:01:40.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.972+0000 7fa11f400640 1 --2- 172.21.15.99:0/2120613652 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fa10c09f070 0x7fa10c0a1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.969+0000 7f6167400640 1 --2- 172.21.15.99:0/862286926 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f615009efb0 0x7f61500a1470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.974+0000 7f5ef4a00640 1 Processor -- start 2024-02-21T23:01:40.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.974+0000 7fb76ea00640 1 --2- 172.21.15.99:0/2027344763 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb754004800 0x7fb754004c80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb75c001eb0 tx=0x7fb754005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2052659301cc39f2 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:40.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.974+0000 7f5ef4a00640 1 -- start start 2024-02-21T23:01:40.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.972+0000 7fa11f400640 1 -- 172.21.15.99:0/2120613652 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fa1200c9f70 con 0x7fa12c06d220 2024-02-21T23:01:40.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.976+0000 7fa12aa00640 1 --2- 172.21.15.99:0/2120613652 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fa10c09f070 0x7fa10c0a1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.976+0000 7f6167400640 1 -- 172.21.15.99:0/862286926 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f61600948e0 con 0x7f617006f980 2024-02-21T23:01:40.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.977+0000 7fa11f400640 1 -- 172.21.15.99:0/2120613652 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fa120098200 con 0x7fa12c06d220 2024-02-21T23:01:40.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.978+0000 7f616ea00640 1 --2- 172.21.15.99:0/862286926 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f615009efb0 0x7f61500a1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.978+0000 7f741a000640 1 --2- 172.21.15.99:0/737490207 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f740409edf0 0x7f74040a12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.979+0000 7fa12aa00640 1 --2- 172.21.15.99:0/2120613652 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fa10c09f070 0x7fa10c0a1530 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa12c177280 tx=0x7fa118009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:40.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.980+0000 7f5ef4a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f5ef00d5310 0x7f5ef00cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.980+0000 7f5ef4a00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ef0186a50 con 0x7f5ef01861e0 2024-02-21T23:01:40.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.980+0000 7f5ef4a00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ef00d5740 con 0x7f5ef01865c0 2024-02-21T23:01:40.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.980+0000 7f5ef4a00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ef0186d50 con 0x7f5ef00d5310 2024-02-21T23:01:40.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.979+0000 7f741a000640 1 -- 172.21.15.99:0/737490207 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f741c0ec890 con 0x7f74240719b0 2024-02-21T23:01:40.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.981+0000 7f616ea00640 1 --2- 172.21.15.99:0/862286926 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f615009efb0 0x7f61500a1470 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f61700f91d0 tx=0x7f615c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:40.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.981+0000 7f7421400640 1 --2- 172.21.15.99:0/737490207 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f740409edf0 0x7f74040a12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.983+0000 7f5eede00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f5ef01861e0 0x7f5ef0187a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:52650/0 (socket says 172.21.15.99:52650) 2024-02-21T23:01:40.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.983+0000 7f5eede00640 1 -- 172.21.15.99:0/1430905359 learned_addr learned my addr 172.21.15.99:0/1430905359 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:01:40.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.984+0000 7f6167400640 1 -- 172.21.15.99:0/862286926 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f616004bdc0 con 0x7f617006f980 2024-02-21T23:01:40.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.984+0000 7fb76e000640 1 -- 172.21.15.99:0/2027344763 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb75c007ce0 con 0x7fb754004800 2024-02-21T23:01:40.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.984+0000 7f5eeca00640 1 -- 172.21.15.99:0/1430905359 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3516787819 0 0) 0x7f5ef0186a50 con 0x7f5ef01861e0 2024-02-21T23:01:40.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.984+0000 7f5eeca00640 1 -- 172.21.15.99:0/1430905359 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ed4003520 con 0x7f5ef01861e0 2024-02-21T23:01:40.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.984+0000 7f5eee800640 1 --2- 172.21.15.99:0/1430905359 >> v2:172.21.15.99:3300/0 conn(0x7f5ef00d5310 0x7f5ef00cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.984+0000 7f5eeca00640 1 -- 172.21.15.99:0/1430905359 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4082276543 0 0) 0x7f5ef00d5740 con 0x7f5ef01865c0 2024-02-21T23:01:40.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.985+0000 7f5eeca00640 1 -- 172.21.15.99:0/1430905359 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ef0186a50 con 0x7f5ef01865c0 2024-02-21T23:01:40.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.985+0000 7f7421400640 1 --2- 172.21.15.99:0/737490207 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f740409edf0 0x7f74040a12b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f74240d0cf0 tx=0x7f7410009060 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:40.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.985+0000 7f5eeca00640 1 -- 172.21.15.99:0/1430905359 <== mon.2 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3272376659 0 0) 0x7f5ef0186a50 con 0x7f5ef01865c0 2024-02-21T23:01:40.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.985+0000 7f5eeca00640 1 -- 172.21.15.99:0/1430905359 >> v2:172.21.15.99:3300/0 conn(0x7f5ef00d5310 msgr2=0x7f5ef00cdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:40.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.985+0000 7f5eeca00640 1 --2- 172.21.15.99:0/1430905359 >> v2:172.21.15.99:3300/0 conn(0x7f5ef00d5310 0x7f5ef00cdea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.985+0000 7f5eeca00640 1 -- 172.21.15.99:0/1430905359 >> v1:172.21.15.99:6789/0 conn(0x7f5ef01861e0 legacy=0x7f5ef0187a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.985+0000 7f5eeca00640 1 -- 172.21.15.99:0/1430905359 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ef00cf7e0 con 0x7f5ef01865c0 2024-02-21T23:01:40.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.985+0000 7f5eeca00640 1 -- 172.21.15.99:0/1430905359 <== mon.2 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2069890144 0 0) 0x7f5edc001670 con 0x7f5ef01865c0 2024-02-21T23:01:40.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.985+0000 7f5eeca00640 1 -- 172.21.15.99:0/1430905359 >> v1:172.21.15.181:6789/0 conn(0x7f5ef01865c0 legacy=0x7f5ef0188190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.985+0000 7f5eeca00640 1 --2- 172.21.15.99:0/1430905359 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5ed4003b90 0x7f5ed4003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.985+0000 7f5eeca00640 1 --2- 172.21.15.99:0/1430905359 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5ed4004800 0x7f5ed4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.985+0000 7f5eeca00640 1 --2- 172.21.15.99:0/1430905359 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ed4005210 0x7f5ed40141d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.985+0000 7f5eeca00640 1 -- 172.21.15.99:0/1430905359 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef0186d50 con 0x7f5ed4003b90 2024-02-21T23:01:40.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.985+0000 7f5eeca00640 1 -- 172.21.15.99:0/1430905359 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed4014970 con 0x7f5ed4005210 2024-02-21T23:01:40.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.985+0000 7f5eeca00640 1 -- 172.21.15.99:0/1430905359 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed4014b70 con 0x7f5ed4004800 2024-02-21T23:01:40.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.989+0000 7f5eed400640 1 --2- 172.21.15.99:0/1430905359 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5ed4004800 0x7f5ed4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.989+0000 7f5eee800640 1 --2- 172.21.15.99:0/1430905359 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ed4005210 0x7f5ed40141d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.989+0000 7f5eede00640 1 --2- 172.21.15.99:0/1430905359 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5ed4003b90 0x7f5ed4003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.989+0000 7f5eed400640 1 -- 172.21.15.99:0/1430905359 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ed4005210 msgr2=0x7f5ed40141d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:40.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.989+0000 7f5eed400640 1 --2- 172.21.15.99:0/1430905359 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ed4005210 0x7f5ed40141d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.989+0000 7f5eed400640 1 -- 172.21.15.99:0/1430905359 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5ed4003b90 msgr2=0x7f5ed4003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:40.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.989+0000 7f5eed400640 1 --2- 172.21.15.99:0/1430905359 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5ed4003b90 0x7f5ed4003fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.989+0000 7f5eed400640 1 -- 172.21.15.99:0/1430905359 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ef00cf7e0 con 0x7f5ed4004800 2024-02-21T23:01:40.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.989+0000 7f5eee800640 1 --2- 172.21.15.99:0/1430905359 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ed4005210 0x7f5ed40141d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:01:40.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.990+0000 7f5eee800640 1 -- 172.21.15.99:0/1430905359 reap_dead start 2024-02-21T23:01:40.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.997+0000 7f5eed400640 1 --2- 172.21.15.99:0/1430905359 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5ed4004800 0x7f5ed4004c80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5edc001eb0 tx=0x7f5ed4005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78c88756873a26a4 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:40.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.997+0000 7f03a7000640 1 Processor -- start 2024-02-21T23:01:40.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.997+0000 7f03a7000640 1 -- start start 2024-02-21T23:01:40.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.001+0000 7f03a7000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f03a00708c0 0x7f03a00f59b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:40.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.001+0000 7f03a7000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03a0070df0 con 0x7f03a006ea20 2024-02-21T23:01:40.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.001+0000 7f03a7000640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03a00710d0 con 0x7f03a0182630 2024-02-21T23:01:40.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.001+0000 7f03a7000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03a0071ce0 con 0x7f03a00708c0 2024-02-21T23:01:40.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.998+0000 7f741a000640 1 -- 172.21.15.99:0/737490207 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f741c04e030 con 0x7f74240719b0 2024-02-21T23:01:40.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.998+0000 7f5eeca00640 1 -- 172.21.15.99:0/1430905359 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5edc039070 con 0x7f5ed4004800 2024-02-21T23:01:40.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.998+0000 7f5eeca00640 1 -- 172.21.15.99:0/1430905359 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5edc02c920 con 0x7f5ed4004800 2024-02-21T23:01:40.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.998+0000 7f5eeca00640 1 -- 172.21.15.99:0/1430905359 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5edc007c20 con 0x7f5ed4004800 2024-02-21T23:01:40.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.001+0000 7fb76e000640 1 -- 172.21.15.99:0/2027344763 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb75c030070 con 0x7fb754004800 2024-02-21T23:01:40.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.001+0000 7f039f400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f03a00708c0 0x7f03a00f59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:40.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.002+0000 7f039f400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f03a00708c0 0x7f03a00f59b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:40772/0 (socket says 172.21.15.99:40772) 2024-02-21T23:01:40.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.002+0000 7f039f400640 1 -- 172.21.15.99:0/43494734 learned_addr learned my addr 172.21.15.99:0/43494734 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:40.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.002+0000 7f039ea00640 1 -- 172.21.15.99:0/43494734 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4208929938 0 0) 0x7f03a0070df0 con 0x7f03a006ea20 2024-02-21T23:01:40.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.002+0000 7f039ea00640 1 -- 172.21.15.99:0/43494734 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0384003520 con 0x7f03a006ea20 2024-02-21T23:01:40.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.003+0000 7fb76e000640 1 -- 172.21.15.99:0/2027344763 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb75c005d10 con 0x7fb754004800 2024-02-21T23:01:40.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.003+0000 7f039ea00640 1 -- 172.21.15.99:0/43494734 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 983361522 0 0) 0x7f03a00710d0 con 0x7f03a0182630 2024-02-21T23:01:40.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.003+0000 7f039ea00640 1 -- 172.21.15.99:0/43494734 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03a0070df0 con 0x7f03a0182630 2024-02-21T23:01:40.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.003+0000 7fb776400640 1 -- 172.21.15.99:0/2027344763 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb754004800 msgr2=0x7fb754004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.003+0000 7fb776400640 1 --2- 172.21.15.99:0/2027344763 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb754004800 0x7fb754004c80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb75c001eb0 tx=0x7fb754005830 comp rx=0 tx=0).stop 2024-02-21T23:01:40.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.004+0000 7fb776400640 1 -- 172.21.15.99:0/2027344763 shutdown_connections 2024-02-21T23:01:40.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.004+0000 7fb776400640 1 --2- 172.21.15.99:0/2027344763 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb754004800 0x7fb754004c80 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.004+0000 7f039ea00640 1 -- 172.21.15.99:0/43494734 <== mon.1 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 466265337 0 0) 0x7f0384003520 con 0x7f03a006ea20 2024-02-21T23:01:40.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.004+0000 7f039ea00640 1 -- 172.21.15.99:0/43494734 >> v2:172.21.15.162:3300/0 conn(0x7f03a00708c0 msgr2=0x7f03a00f59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:40.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.999+0000 7f5ef4a00640 1 -- 172.21.15.99:0/1430905359 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5ed4004800 msgr2=0x7f5ed4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:40.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:40.999+0000 7f5ef4a00640 1 --2- 172.21.15.99:0/1430905359 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5ed4004800 0x7f5ed4004c80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5edc001eb0 tx=0x7f5ed4005830 comp rx=0 tx=0).stop 2024-02-21T23:01:40.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.001+0000 7f5ef4a00640 1 -- 172.21.15.99:0/1430905359 shutdown_connections 2024-02-21T23:01:40.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.001+0000 7f5ef4a00640 1 --2- 172.21.15.99:0/1430905359 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5ed4004800 0x7f5ed4004c80 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:40.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.001+0000 7f5ef4a00640 1 -- 172.21.15.99:0/1430905359 >> 172.21.15.99:0/1430905359 conn(0x7f5ef00d6ac0 msgr2=0x7f5ef00740b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:40.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.004+0000 7fb776400640 1 -- 172.21.15.99:0/2027344763 >> 172.21.15.99:0/2027344763 conn(0x7fb7700d6d60 msgr2=0x7fb7700d7170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:40.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.006+0000 7f5ef4a00640 1 -- 172.21.15.99:0/1430905359 shutdown_connections 2024-02-21T23:01:41.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.006+0000 7f5ef4a00640 1 -- 172.21.15.99:0/1430905359 wait complete. 2024-02-21T23:01:41.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.005+0000 7f039ea00640 1 --2- 172.21.15.99:0/43494734 >> v2:172.21.15.162:3300/0 conn(0x7f03a00708c0 0x7f03a00f59b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.005+0000 7f039ea00640 1 -- 172.21.15.99:0/43494734 >> v1:172.21.15.181:6789/0 conn(0x7f03a0182630 legacy=0x7f03a006e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:41.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.005+0000 7f039ea00640 1 -- 172.21.15.99:0/43494734 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03a00713b0 con 0x7f03a006ea20 2024-02-21T23:01:41.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.005+0000 7f039ea00640 1 -- 172.21.15.99:0/43494734 <== mon.1 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2069890144 0 0) 0x7f0390001670 con 0x7f03a006ea20 2024-02-21T23:01:41.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.005+0000 7f039f400640 1 --2- 172.21.15.99:0/43494734 >> v2:172.21.15.162:3300/0 conn(0x7f03a00708c0 0x7f03a00f59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:01:41.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.005+0000 7f039ea00640 1 -- 172.21.15.99:0/43494734 >> v1:172.21.15.162:6789/0 conn(0x7f03a006ea20 legacy=0x7f03a00f5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:41.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.005+0000 7f039ea00640 1 --2- 172.21.15.99:0/43494734 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0384003b70 0x7f0384003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:41.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.005+0000 7f039ea00640 1 --2- 172.21.15.99:0/43494734 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0384004800 0x7f0384004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:41.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.005+0000 7f039ea00640 1 --2- 172.21.15.99:0/43494734 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f03840051c0 0x7f038400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:41.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.005+0000 7f039ea00640 1 -- 172.21.15.99:0/43494734 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a0071ce0 con 0x7f0384003b70 2024-02-21T23:01:41.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.005+0000 7f039ea00640 1 -- 172.21.15.99:0/43494734 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f038400c040 con 0x7f0384004800 2024-02-21T23:01:41.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.005+0000 7f039ea00640 1 -- 172.21.15.99:0/43494734 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f038400c240 con 0x7f03840051c0 2024-02-21T23:01:41.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.009+0000 7f039fe00640 1 --2- 172.21.15.99:0/43494734 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0384003b70 0x7f0384003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:41.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.010+0000 7f039fe00640 1 -- 172.21.15.99:0/43494734 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f03840051c0 msgr2=0x7f038400b9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T23:01:41.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.010+0000 7f039fe00640 1 --2- 172.21.15.99:0/43494734 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f03840051c0 0x7f038400b9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.010+0000 7f039fe00640 1 -- 172.21.15.99:0/43494734 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0384004800 msgr2=0x7f0384004c80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T23:01:41.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.010+0000 7f039fe00640 1 --2- 172.21.15.99:0/43494734 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0384004800 0x7f0384004c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.010+0000 7f039fe00640 1 -- 172.21.15.99:0/43494734 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03a00713b0 con 0x7f0384003b70 2024-02-21T23:01:41.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.013+0000 7f03a5000640 1 -- 172.21.15.99:0/43494734 reap_dead start 2024-02-21T23:01:41.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.013+0000 7f039fe00640 1 --2- 172.21.15.99:0/43494734 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0384003b70 0x7f0384003f50 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f039800c370 tx=0x7f0384005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3f6f97ae710d458 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:41.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.008+0000 7fb776400640 1 -- 172.21.15.99:0/2027344763 shutdown_connections 2024-02-21T23:01:41.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.008+0000 7fb776400640 1 -- 172.21.15.99:0/2027344763 wait complete. 2024-02-21T23:01:41.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.017+0000 7f039ea00640 1 -- 172.21.15.99:0/43494734 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f039802cc80 con 0x7f0384003b70 2024-02-21T23:01:41.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.017+0000 7f039ea00640 1 -- 172.21.15.99:0/43494734 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0398030070 con 0x7f0384003b70 2024-02-21T23:01:41.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.017+0000 7f039ea00640 1 -- 172.21.15.99:0/43494734 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0398003bb0 con 0x7f0384003b70 2024-02-21T23:01:41.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.018+0000 7f03a7000640 1 -- 172.21.15.99:0/43494734 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0384003b70 msgr2=0x7f0384003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:41.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.018+0000 7f03a7000640 1 --2- 172.21.15.99:0/43494734 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0384003b70 0x7f0384003f50 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f039800c370 tx=0x7f0384005830 comp rx=0 tx=0).stop 2024-02-21T23:01:41.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.017+0000 7f5ef4a00640 1 Processor -- start 2024-02-21T23:01:41.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.017+0000 7f5ef4a00640 1 -- start start 2024-02-21T23:01:41.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.018+0000 7fb776400640 1 Processor -- start 2024-02-21T23:01:41.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.018+0000 7fb776400640 1 -- start start 2024-02-21T23:01:41.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.019+0000 7f03a7000640 1 -- 172.21.15.99:0/43494734 shutdown_connections 2024-02-21T23:01:41.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.019+0000 7f03a7000640 1 --2- 172.21.15.99:0/43494734 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0384003b70 0x7f0384003f50 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.019+0000 7f03a7000640 1 -- 172.21.15.99:0/43494734 >> 172.21.15.99:0/43494734 conn(0x7f03a00ce5f0 msgr2=0x7f03a00cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:41.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.019+0000 7f03a7000640 1 -- 172.21.15.99:0/43494734 shutdown_connections 2024-02-21T23:01:41.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.019+0000 7f03a7000640 1 -- 172.21.15.99:0/43494734 wait complete. 2024-02-21T23:01:41.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.025+0000 7f5ef4a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ed4004800 0x7f5ef0177e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:41.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.020+0000 7fb776400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb770174660 0x7fb770174a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:41.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.020+0000 7fb776400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb7701858c0 0x7fb77018e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:41.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.020+0000 7fb776400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb77018e840 0x7fb7700fe1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:41.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.020+0000 7fb776400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb770070930 con 0x7fb77018e840 2024-02-21T23:01:41.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.020+0000 7fb776400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb770070650 con 0x7fb770174660 2024-02-21T23:01:41.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.020+0000 7fb776400640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb770070c10 con 0x7fb7701858c0 2024-02-21T23:01:41.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.024+0000 7fb76f400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb770174660 0x7fb770174a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:41.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.024+0000 7fb76f400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb770174660 0x7fb770174a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:40800/0 (socket says 172.21.15.99:40800) 2024-02-21T23:01:41.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.024+0000 7fb76f400640 1 -- 172.21.15.99:0/721162878 learned_addr learned my addr 172.21.15.99:0/721162878 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:41.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.026+0000 7f5ef4a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5ef022c330 0x7f5ef0177670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:41.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.026+0000 7f5eede00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ed4004800 0x7f5ef0177e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:41.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.026+0000 7f5eede00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ed4004800 0x7f5ef0177e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:40806/0 (socket says 172.21.15.99:40806) 2024-02-21T23:01:41.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.026+0000 7f5eede00640 1 -- 172.21.15.99:0/513936168 learned_addr learned my addr 172.21.15.99:0/513936168 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:41.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.026+0000 7f5ef4a00640 1 --2- 172.21.15.99:0/513936168 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5ef017dd60 0x7f5ef0179ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:41.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.026+0000 7f5eed400640 1 --2- 172.21.15.99:0/513936168 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5ef022c330 0x7f5ef0177670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:41.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.025+0000 7fb76ea00640 1 --2- 172.21.15.99:0/721162878 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb7701858c0 0x7fb77018e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:41.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.026+0000 7fb76fe00640 1 --2- 172.21.15.99:0/721162878 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb77018e840 0x7fb7700fe1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:41.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.027+0000 7f5ef4a00640 1 -- 172.21.15.99:0/513936168 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef0186fa0 con 0x7f5ef017dd60 2024-02-21T23:01:41.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.027+0000 7f5ef4a00640 1 -- 172.21.15.99:0/513936168 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef01875f0 con 0x7f5ed4004800 2024-02-21T23:01:41.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.027+0000 7f5ef4a00640 1 -- 172.21.15.99:0/513936168 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef0187280 con 0x7f5ef022c330 2024-02-21T23:01:41.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.027+0000 7f5eede00640 1 -- 172.21.15.99:0/513936168 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5ef022c330 msgr2=0x7f5ef0177670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:41.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.027+0000 7f5eede00640 1 --2- 172.21.15.99:0/513936168 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5ef022c330 0x7f5ef0177670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.028+0000 7f5eede00640 1 -- 172.21.15.99:0/513936168 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5ef017dd60 msgr2=0x7f5ef0179ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:41.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.028+0000 7f5eede00640 1 --2- 172.21.15.99:0/513936168 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5ef017dd60 0x7f5ef0179ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.028+0000 7f5eede00640 1 -- 172.21.15.99:0/513936168 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ef017c9e0 con 0x7f5ed4004800 2024-02-21T23:01:41.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.029+0000 7f5eede00640 1 --2- 172.21.15.99:0/513936168 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ed4004800 0x7f5ef0177e50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5ee8001460 tx=0x7f5ee800b0d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:41.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.029+0000 7f5ee6000640 1 -- 172.21.15.99:0/513936168 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee800bd10 con 0x7f5ed4004800 2024-02-21T23:01:41.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.030+0000 7f5ef4a00640 1 -- 172.21.15.99:0/513936168 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ef017ccc0 con 0x7f5ed4004800 2024-02-21T23:01:41.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.030+0000 7f5ef4a00640 1 -- 172.21.15.99:0/513936168 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ef017d280 con 0x7f5ed4004800 2024-02-21T23:01:41.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.028+0000 7f03a7000640 1 Processor -- start 2024-02-21T23:01:41.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.031+0000 7f03a7000640 1 -- start start 2024-02-21T23:01:41.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.031+0000 7fb76fe00640 1 -- 172.21.15.99:0/721162878 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb7701858c0 msgr2=0x7fb77018e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:41.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.031+0000 7fb76fe00640 1 --2- 172.21.15.99:0/721162878 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb7701858c0 0x7fb77018e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.031+0000 7fb76fe00640 1 -- 172.21.15.99:0/721162878 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb770174660 msgr2=0x7fb770174a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:41.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.031+0000 7fb76fe00640 1 --2- 172.21.15.99:0/721162878 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb770174660 0x7fb770174a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.030+0000 7f5ee6000640 1 -- 172.21.15.99:0/513936168 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ee8017070 con 0x7f5ed4004800 2024-02-21T23:01:41.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.030+0000 7f5ee6000640 1 -- 172.21.15.99:0/513936168 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee800bd10 con 0x7f5ed4004800 2024-02-21T23:01:41.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.033+0000 7f1509600640 1 Processor -- start 2024-02-21T23:01:41.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.033+0000 7f03a7000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0384003b70 0x7f03a0180930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:41.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.033+0000 7f1509600640 1 -- start start 2024-02-21T23:01:41.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.033+0000 7f5ef4a00640 1 -- 172.21.15.99:0/513936168 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ec8005290 con 0x7f5ed4004800 2024-02-21T23:01:41.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.034+0000 7f03a7000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f03a0156c00 0x7f03a0157080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:41.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.034+0000 7f03a7000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03a01575c0 0x7f03a015dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:41.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.034+0000 7f039f400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f03a0156c00 0x7f03a0157080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:41.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.035+0000 7f039f400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f03a0156c00 0x7f03a0157080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:43814/0 (socket says 172.21.15.99:43814) 2024-02-21T23:01:41.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.035+0000 7f039f400640 1 -- 172.21.15.99:0/3741753844 learned_addr learned my addr 172.21.15.99:0/3741753844 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:41.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.034+0000 7f039fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0384003b70 0x7f03a0180930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:41.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.036+0000 7fb76fe00640 1 -- 172.21.15.99:0/721162878 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7700d5840 con 0x7fb77018e840 2024-02-21T23:01:41.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.034+0000 7fad24a00640 1 Processor -- start 2024-02-21T23:01:41.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.034+0000 7fad24a00640 1 -- start start 2024-02-21T23:01:41.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.034+0000 7f03a5000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03a01575c0 0x7f03a015dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:41.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.038+0000 7f03a7000640 1 -- 172.21.15.99:0/3741753844 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a0072170 con 0x7f0384003b70 2024-02-21T23:01:41.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.038+0000 7f03a7000640 1 -- 172.21.15.99:0/3741753844 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a0071970 con 0x7f03a01575c0 2024-02-21T23:01:41.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.038+0000 7f03a7000640 1 -- 172.21.15.99:0/3741753844 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a00722f0 con 0x7f03a0156c00 2024-02-21T23:01:41.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.039+0000 7f03a5000640 1 -- 172.21.15.99:0/3741753844 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f03a0156c00 msgr2=0x7f03a0157080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:41.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.039+0000 7f03a5000640 1 --2- 172.21.15.99:0/3741753844 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f03a0156c00 0x7f03a0157080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.039+0000 7f03a5000640 1 -- 172.21.15.99:0/3741753844 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0384003b70 msgr2=0x7f03a0180930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:41.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.039+0000 7f03a5000640 1 --2- 172.21.15.99:0/3741753844 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0384003b70 0x7f03a0180930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.039+0000 7f03a5000640 1 -- 172.21.15.99:0/3741753844 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03a00ca480 con 0x7f03a01575c0 2024-02-21T23:01:41.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.038+0000 7fad24a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fad2006e310 0x7fad20190a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:41.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.038+0000 7fad24a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fad2006fb80 0x7fad20190f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:41.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.038+0000 7fad24a00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad2018ad00 con 0x7fad20190670 2024-02-21T23:01:41.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.038+0000 7fad24a00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad2006e800 con 0x7fad2006fb80 2024-02-21T23:01:41.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.038+0000 7fad24a00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad2006eae0 con 0x7fad2006e310 2024-02-21T23:01:41.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.038+0000 7fad1de00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fad20190670 0x7fad2018aff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.99:47018/0 (socket says 172.21.15.99:47018) 2024-02-21T23:01:41.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.038+0000 7fad1de00640 1 -- 172.21.15.99:0/2798553609 learned_addr learned my addr 172.21.15.99:0/2798553609 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:01:41.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.038+0000 7fad1e800640 1 --2- 172.21.15.99:0/2798553609 >> v2:172.21.15.99:3300/0 conn(0x7fad2006fb80 0x7fad20190f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:41.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.039+0000 7fad1e800640 1 -- 172.21.15.99:0/2798553609 >> v2:172.21.15.162:3300/0 conn(0x7fad2006e310 msgr2=0x7fad20190a50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T23:01:41.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.040+0000 7f03a5000640 1 --2- 172.21.15.99:0/3741753844 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03a01575c0 0x7f03a015dcc0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f03a0070650 tx=0x7f039000c820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:41.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.040+0000 7f1509600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f15040708c0 0x7f15040f59b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:41.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.040+0000 7f1509600640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1504070df0 con 0x7f1504182630 2024-02-21T23:01:41.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.040+0000 7f1509600640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15040710d0 con 0x7f150406ea20 2024-02-21T23:01:41.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.041+0000 7f1509600640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1504071ce0 con 0x7f15040708c0 2024-02-21T23:01:41.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.041+0000 7f1503400640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f150406ea20 0x7f15040f5ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:48626/0 (socket says 172.21.15.99:48626) 2024-02-21T23:01:41.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.040+0000 7f1502000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f15040708c0 0x7f15040f59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:41.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.041+0000 7f1502000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f15040708c0 0x7f15040f59b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:40826/0 (socket says 172.21.15.99:40826) 2024-02-21T23:01:41.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.041+0000 7f1502000640 1 -- 172.21.15.99:0/2945449639 learned_addr learned my addr 172.21.15.99:0/2945449639 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:41.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.041+0000 7f1502000640 1 -- 172.21.15.99:0/2945449639 >> v1:172.21.15.181:6789/0 conn(0x7f150406ea20 legacy=0x7f15040f5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:41.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.042+0000 7f1502000640 1 -- 172.21.15.99:0/2945449639 >> v1:172.21.15.99:6789/0 conn(0x7f1504182630 legacy=0x7f150406e310 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T23:01:41.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.042+0000 7f1502000640 1 -- 172.21.15.99:0/2945449639 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15040713b0 con 0x7f15040708c0 2024-02-21T23:01:41.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.044+0000 7fad1d400640 1 --2- 172.21.15.99:0/2798553609 >> v2:172.21.15.162:3300/0 conn(0x7fad2006e310 0x7fad20190a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:41.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.042+0000 7f7466800640 1 Processor -- start 2024-02-21T23:01:41.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.042+0000 7f7466800640 1 -- start start 2024-02-21T23:01:41.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.045+0000 7f7466800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7460070f10 0x7f74600f8c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:41.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.046+0000 7f745ea00640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f7460192e40 0x7f7460070800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:48632/0 (socket says 172.21.15.99:48632) 2024-02-21T23:01:41.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.046+0000 7f745ea00640 1 -- 172.21.15.99:0/500154239 learned_addr learned my addr 172.21.15.99:0/500154239 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:01:41.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.047+0000 7f0397e00640 1 -- 172.21.15.99:0/3741753844 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0390007480 con 0x7f03a01575c0 2024-02-21T23:01:41.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.047+0000 7f0397e00640 1 -- 172.21.15.99:0/3741753844 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0390004020 con 0x7f03a01575c0 2024-02-21T23:01:41.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.047+0000 7f7466800640 1 -- 172.21.15.99:0/500154239 --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7460196630 con 0x7f74600f9150 2024-02-21T23:01:41.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.048+0000 7f7466800640 1 -- 172.21.15.99:0/500154239 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74600f8170 con 0x7f7460192e40 2024-02-21T23:01:41.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.048+0000 7f7465200640 1 -- 172.21.15.99:0/500154239 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4058974226 0 0) 0x7f7460196630 con 0x7f74600f9150 2024-02-21T23:01:41.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.048+0000 7f7466800640 1 -- 172.21.15.99:0/500154239 --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74600715b0 con 0x7f7460070f10 2024-02-21T23:01:41.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.047+0000 7fb76fe00640 1 --2- 172.21.15.99:0/721162878 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb77018e840 0x7fb7700fe1c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb770102840 tx=0x7fb76800e960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:41.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.048+0000 7f7465200640 1 -- 172.21.15.99:0/500154239 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7448003520 con 0x7f74600f9150 2024-02-21T23:01:41.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.045+0000 7fad1e800640 1 --2- 172.21.15.99:0/2798553609 >> v2:172.21.15.162:3300/0 conn(0x7fad2006e310 0x7fad20190a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.045+0000 7fad1e800640 1 -- 172.21.15.99:0/2798553609 >> v1:172.21.15.162:6789/0 conn(0x7fad20190670 legacy=0x7fad2018aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:41.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.045+0000 7fad1e800640 1 -- 172.21.15.99:0/2798553609 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad2006edc0 con 0x7fad2006fb80 2024-02-21T23:01:41.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.050+0000 7fad1e800640 1 --2- 172.21.15.99:0/2798553609 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad2006fb80 0x7fad20190f90 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fad20067840 tx=0x7fad1802be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f44a9aaecabc104e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:41.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.048+0000 7f7465200640 1 -- 172.21.15.99:0/500154239 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1207174217 0 0) 0x7f74600f8170 con 0x7f7460192e40 2024-02-21T23:01:41.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.048+0000 7f7465200640 1 -- 172.21.15.99:0/500154239 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7460196630 con 0x7f7460192e40 2024-02-21T23:01:41.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.049+0000 7f7465200640 1 -- 172.21.15.99:0/500154239 <== mon.1 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2678959934 0 0) 0x7f7448003520 con 0x7f74600f9150 2024-02-21T23:01:41.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.049+0000 7f7465200640 1 -- 172.21.15.99:0/500154239 >> v2:172.21.15.99:3300/0 conn(0x7f7460070f10 msgr2=0x7f74600f8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:41.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.049+0000 7f7465200640 1 --2- 172.21.15.99:0/500154239 >> v2:172.21.15.99:3300/0 conn(0x7f7460070f10 0x7f74600f8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.049+0000 7f7465200640 1 -- 172.21.15.99:0/500154239 >> v1:172.21.15.181:6789/0 conn(0x7f7460192e40 legacy=0x7f7460070800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:41.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.049+0000 7f7465200640 1 -- 172.21.15.99:0/500154239 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7460071890 con 0x7f74600f9150 2024-02-21T23:01:41.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.049+0000 7f7465200640 1 -- 172.21.15.99:0/500154239 <== mon.1 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2069890144 0 0) 0x7f7458001130 con 0x7f74600f9150 2024-02-21T23:01:41.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.049+0000 7f7465200640 1 -- 172.21.15.99:0/500154239 >> v1:172.21.15.162:6789/0 conn(0x7f74600f9150 legacy=0x7f7460198e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:41.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.049+0000 7f7465200640 1 --2- 172.21.15.99:0/500154239 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7448003b90 0x7f7448003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:41.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.049+0000 7f7465200640 1 --2- 172.21.15.99:0/500154239 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7448004800 0x7f7448004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:41.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.049+0000 7f7465200640 1 --2- 172.21.15.99:0/500154239 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7448005410 0x7f744800ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:41.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.049+0000 7f7465200640 1 -- 172.21.15.99:0/500154239 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74600715b0 con 0x7f7448005410 2024-02-21T23:01:41.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.049+0000 7f7465200640 1 -- 172.21.15.99:0/500154239 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f744800c350 con 0x7f7448003b90 2024-02-21T23:01:41.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.049+0000 7f7465200640 1 -- 172.21.15.99:0/500154239 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f744800c550 con 0x7f7448004800 2024-02-21T23:01:41.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.050+0000 7f745ea00640 1 --2- 172.21.15.99:0/500154239 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7448003b90 0x7f7448003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:41.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.050+0000 7f745f400640 1 --2- 172.21.15.99:0/500154239 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7448005410 0x7f744800ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:41.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.050+0000 7f745ea00640 1 -- 172.21.15.99:0/500154239 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7448004800 msgr2=0x7f7448004c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T23:01:41.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.050+0000 7f745ea00640 1 --2- 172.21.15.99:0/500154239 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7448004800 0x7f7448004c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.050+0000 7f745ea00640 1 -- 172.21.15.99:0/500154239 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7448005410 msgr2=0x7f744800ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:41.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.050+0000 7f745ea00640 1 --2- 172.21.15.99:0/500154239 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7448005410 0x7f744800ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.050+0000 7f745ea00640 1 -- 172.21.15.99:0/500154239 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7460071890 con 0x7f7448003b90 2024-02-21T23:01:41.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.050+0000 7f745f400640 1 -- 172.21.15.99:0/500154239 reap_dead start 2024-02-21T23:01:41.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.052+0000 7f745ea00640 1 --2- 172.21.15.99:0/500154239 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7448003b90 0x7f7448003f90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7454001cb0 tx=0x7f7448005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=53b936f6faaba4e0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:41.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.053+0000 7f7465200640 1 -- 172.21.15.99:0/500154239 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7454001cf0 con 0x7f7448003b90 2024-02-21T23:01:41.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.053+0000 7f7465200640 1 -- 172.21.15.99:0/500154239 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7454032070 con 0x7f7448003b90 2024-02-21T23:01:41.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.047+0000 7f03a7000640 1 -- 172.21.15.99:0/3741753844 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03a015cc20 con 0x7f03a01575c0 2024-02-21T23:01:41.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.047+0000 7f03a7000640 1 -- 172.21.15.99:0/3741753844 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03a015d1e0 con 0x7f03a01575c0 2024-02-21T23:01:41.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.052+0000 7f0397e00640 1 -- 172.21.15.99:0/3741753844 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0390007640 con 0x7f03a01575c0 2024-02-21T23:01:41.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.054+0000 7f7465200640 1 -- 172.21.15.99:0/500154239 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f745402ec10 con 0x7f7448003b90 2024-02-21T23:01:41.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.054+0000 7f7466800640 1 -- 172.21.15.99:0/500154239 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7448003b90 msgr2=0x7f7448003f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:41.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.054+0000 7f7466800640 1 --2- 172.21.15.99:0/500154239 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7448003b90 0x7f7448003f90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7454001cb0 tx=0x7f7448005830 comp rx=0 tx=0).stop 2024-02-21T23:01:41.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.055+0000 7f7466800640 1 -- 172.21.15.99:0/500154239 shutdown_connections 2024-02-21T23:01:41.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.055+0000 7f7466800640 1 --2- 172.21.15.99:0/500154239 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7448003b90 0x7f7448003f90 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.055+0000 7f7466800640 1 -- 172.21.15.99:0/500154239 >> 172.21.15.99:0/500154239 conn(0x7f74600f6c50 msgr2=0x7f74600f7060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:41.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.054+0000 7fad1ca00640 1 -- 172.21.15.99:0/2798553609 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad18039070 con 0x7fad2006fb80 2024-02-21T23:01:41.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.048+0000 7f1502000640 1 --2- 172.21.15.99:0/2945449639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f15040708c0 0x7f15040f59b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f14f0008870 tx=0x7f14f002dfa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d63aa2bdee50ab3 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:41.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.049+0000 7f1501600640 1 -- 172.21.15.99:0/2945449639 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14f0034070 con 0x7f15040708c0 2024-02-21T23:01:41.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.049+0000 7f1501600640 1 -- 172.21.15.99:0/2945449639 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14f002ed50 con 0x7f15040708c0 2024-02-21T23:01:41.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.049+0000 7f1501600640 1 -- 172.21.15.99:0/2945449639 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14f0038620 con 0x7f15040708c0 2024-02-21T23:01:41.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.054+0000 7f1509600640 1 -- 172.21.15.99:0/2945449639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f15040708c0 msgr2=0x7f15040f59b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:41.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.054+0000 7f1509600640 1 --2- 172.21.15.99:0/2945449639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f15040708c0 0x7f15040f59b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f14f0008870 tx=0x7f14f002dfa0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.055+0000 7f1509600640 1 -- 172.21.15.99:0/2945449639 shutdown_connections 2024-02-21T23:01:41.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.055+0000 7f1509600640 1 --2- 172.21.15.99:0/2945449639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f15040708c0 0x7f15040f59b0 secure :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f14f0008870 tx=0x7f14f002dfa0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.055+0000 7f1509600640 1 -- 172.21.15.99:0/2945449639 >> 172.21.15.99:0/2945449639 conn(0x7f15040ce5f0 msgr2=0x7f15040cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:41.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.054+0000 7f5ee6000640 1 -- 172.21.15.99:0/513936168 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 6) v1 ==== 134407+0+0 (secure 0 0 0) 0x7f5ee801c460 con 0x7f5ed4004800 2024-02-21T23:01:41.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.056+0000 7fad1ca00640 1 -- 172.21.15.99:0/2798553609 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad1802cc20 con 0x7fad2006fb80 2024-02-21T23:01:41.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.056+0000 7fad1ca00640 1 -- 172.21.15.99:0/2798553609 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad18034660 con 0x7fad2006fb80 2024-02-21T23:01:41.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.057+0000 7f7466800640 1 -- 172.21.15.99:0/500154239 shutdown_connections 2024-02-21T23:01:41.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.057+0000 7f7466800640 1 -- 172.21.15.99:0/500154239 wait complete. 2024-02-21T23:01:41.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.058+0000 7f1509600640 1 -- 172.21.15.99:0/2945449639 shutdown_connections 2024-02-21T23:01:41.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.058+0000 7fad24a00640 1 -- 172.21.15.99:0/2798553609 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad2006fb80 msgr2=0x7fad20190f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:41.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.058+0000 7fad24a00640 1 --2- 172.21.15.99:0/2798553609 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad2006fb80 0x7fad20190f90 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fad20067840 tx=0x7fad1802be70 comp rx=0 tx=0).stop 2024-02-21T23:01:41.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.058+0000 7f1509600640 1 -- 172.21.15.99:0/2945449639 wait complete. 2024-02-21T23:01:41.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.058+0000 7f5ee6000640 1 --2- 172.21.15.99:0/513936168 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f5ed009f0a0 0x7f5ed00a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:41.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.058+0000 7f5ee6000640 1 -- 172.21.15.99:0/513936168 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f5ee80ca2b0 con 0x7f5ed4004800 2024-02-21T23:01:41.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.059+0000 7f5eed400640 1 --2- 172.21.15.99:0/513936168 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f5ed009f0a0 0x7f5ed00a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:41.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.059+0000 7fad24a00640 1 -- 172.21.15.99:0/2798553609 shutdown_connections 2024-02-21T23:01:41.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.059+0000 7fad24a00640 1 --2- 172.21.15.99:0/2798553609 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad2006fb80 0x7fad20190f90 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.059+0000 7fad24a00640 1 --2- 172.21.15.99:0/2798553609 >> v2:172.21.15.162:3300/0 conn(0x7fad2006e310 0x7fad20190a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.059+0000 7f5ee6000640 1 -- 172.21.15.99:0/513936168 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f5ee80ca770 con 0x7f5ed4004800 2024-02-21T23:01:41.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.060+0000 7f7466800640 1 Processor -- start 2024-02-21T23:01:41.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.060+0000 7fad24a00640 1 -- 172.21.15.99:0/2798553609 >> 172.21.15.99:0/2798553609 conn(0x7fad200ce5f0 msgr2=0x7fad200cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:41.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.061+0000 7f7466800640 1 -- start start 2024-02-21T23:01:41.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.061+0000 7fb767400640 1 -- 172.21.15.99:0/721162878 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb768019070 con 0x7fb77018e840 2024-02-21T23:01:41.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.061+0000 7fb767400640 1 -- 172.21.15.99:0/721162878 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb768003b80 con 0x7fb77018e840 2024-02-21T23:01:41.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.061+0000 7fb767400640 1 -- 172.21.15.99:0/721162878 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7680050d0 con 0x7fb77018e840 2024-02-21T23:01:41.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.062+0000 7fb776400640 1 -- 172.21.15.99:0/721162878 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7700d5b20 con 0x7fb77018e840 2024-02-21T23:01:41.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.062+0000 7fb776400640 1 -- 172.21.15.99:0/721162878 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7700d60e0 con 0x7fb77018e840 2024-02-21T23:01:41.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.061+0000 7f5eed400640 1 --2- 172.21.15.99:0/513936168 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f5ed009f0a0 0x7f5ed00a1560 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5edc036000 tx=0x7f5edc009030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:41.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.063+0000 7f7466800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7448003b90 0x7f7460181d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:41.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.064+0000 7f7466800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f746022dcd0 0x7f746022e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:41.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.064+0000 7f7466800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f746022e670 0x7f74600edf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:41.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.065+0000 7f7466800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7460193220 con 0x7f7448003b90 2024-02-21T23:01:41.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.065+0000 7f7466800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74600f86f0 con 0x7f746022dcd0 2024-02-21T23:01:41.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.065+0000 7f745e000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f746022dcd0 0x7f746022e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:41.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.065+0000 7f745e000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f746022dcd0 0x7f746022e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:40836/0 (socket says 172.21.15.99:40836) 2024-02-21T23:01:41.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.065+0000 7f745e000640 1 -- 172.21.15.99:0/2424036688 learned_addr learned my addr 172.21.15.99:0/2424036688 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:41.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.065+0000 7f7466800640 1 -- 172.21.15.99:0/2424036688 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7460071b70 con 0x7f746022e670 2024-02-21T23:01:41.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.065+0000 7f745ea00640 1 --2- 172.21.15.99:0/2424036688 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7448003b90 0x7f7460181d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:41.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.067+0000 7f745ea00640 1 -- 172.21.15.99:0/2424036688 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f746022e670 msgr2=0x7f74600edf20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-21T23:01:41.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.067+0000 7f745ea00640 1 --2- 172.21.15.99:0/2424036688 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f746022e670 0x7f74600edf20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.067+0000 7f745ea00640 1 -- 172.21.15.99:0/2424036688 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f746022dcd0 msgr2=0x7f746022e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:41.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.067+0000 7f745ea00640 1 --2- 172.21.15.99:0/2424036688 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f746022dcd0 0x7f746022e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.067+0000 7f745ea00640 1 -- 172.21.15.99:0/2424036688 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f746022cc30 con 0x7f7448003b90 2024-02-21T23:01:41.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.065+0000 7f0395600640 1 -- 172.21.15.99:0/3741753844 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0374005290 con 0x7f03a01575c0 2024-02-21T23:01:41.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.067+0000 7f745ea00640 1 --2- 172.21.15.99:0/2424036688 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7448003b90 0x7f7460181d70 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7454033000 tx=0x7f74540012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:41.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.068+0000 7fb776400640 1 -- 172.21.15.99:0/721162878 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7700682e0 con 0x7fb77018e840 2024-02-21T23:01:41.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.062+0000 7f1509600640 1 Processor -- start 2024-02-21T23:01:41.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.068+0000 7f7453400640 1 -- 172.21.15.99:0/2424036688 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7454001cf0 con 0x7f7448003b90 2024-02-21T23:01:41.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.069+0000 7fad24a00640 1 -- 172.21.15.99:0/2798553609 shutdown_connections 2024-02-21T23:01:41.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.069+0000 7fad24a00640 1 -- 172.21.15.99:0/2798553609 wait complete. 2024-02-21T23:01:41.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.068+0000 7f7466800640 1 -- 172.21.15.99:0/2424036688 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f746022cf10 con 0x7f7448003b90 2024-02-21T23:01:41.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.072+0000 7f1509600640 1 -- start start 2024-02-21T23:01:41.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.070+0000 7f7466800640 1 -- 172.21.15.99:0/2424036688 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f746022d4d0 con 0x7f7448003b90 2024-02-21T23:01:41.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.070+0000 7f7453400640 1 -- 172.21.15.99:0/2424036688 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7454046070 con 0x7f7448003b90 2024-02-21T23:01:41.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.070+0000 7f7453400640 1 -- 172.21.15.99:0/2424036688 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7454001cf0 con 0x7f7448003b90 2024-02-21T23:01:41.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.072+0000 7f7450c00640 1 -- 172.21.15.99:0/2424036688 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7434005290 con 0x7f7448003b90 2024-02-21T23:01:41.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.076+0000 7f7453400640 1 -- 172.21.15.99:0/2424036688 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 6) v1 ==== 134407+0+0 (secure 0 0 0) 0x7f7454038c80 con 0x7f7448003b90 2024-02-21T23:01:41.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.079+0000 7fad24a00640 1 Processor -- start 2024-02-21T23:01:41.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.079+0000 7fad24a00640 1 -- start start 2024-02-21T23:01:41.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.078+0000 7f7453400640 1 --2- 172.21.15.99:0/2424036688 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f744009eff0 0x7f74400a14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:41.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.085+0000 7f1509600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f150406ea20 0x7f150417ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:41.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.082+0000 7f7453400640 1 -- 172.21.15.99:0/2424036688 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f74540b9870 con 0x7f7448003b90 2024-02-21T23:01:41.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.085+0000 7f1509600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1504182630 0x7f150422ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:41.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.085+0000 7fad24a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad2006e310 0x7fad20170f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:41.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.085+0000 7f1509600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f150422a030 0x7f150422f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:41.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.085+0000 7f1509600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1504072170 con 0x7f150422a030 2024-02-21T23:01:41.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.085+0000 7f1509600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1504071970 con 0x7f1504182630 2024-02-21T23:01:41.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.085+0000 7f1509600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15040722f0 con 0x7f150406ea20 2024-02-21T23:01:41.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.085+0000 7f1502a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f150406ea20 0x7f150417ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:41.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.086+0000 7f1502a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f150406ea20 0x7f150417ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:43836/0 (socket says 172.21.15.99:43836) 2024-02-21T23:01:41.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.086+0000 7f1502000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1504182630 0x7f150422ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:41.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.086+0000 7f1502a00640 1 -- 172.21.15.99:0/1996700427 learned_addr learned my addr 172.21.15.99:0/1996700427 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:41.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.086+0000 7f745e000640 1 --2- 172.21.15.99:0/2424036688 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f744009eff0 0x7f74400a14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:41.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.086+0000 7fad24a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad2006fb80 0x7fad200cc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:41.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.087+0000 7f1503400640 1 --2- 172.21.15.99:0/1996700427 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f150422a030 0x7f150422f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:41.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.087+0000 7fad1d400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad2006fb80 0x7fad200cc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:41.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.087+0000 7fad1d400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad2006fb80 0x7fad200cc3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:40844/0 (socket says 172.21.15.99:40844) 2024-02-21T23:01:41.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.088+0000 7fad1d400640 1 -- 172.21.15.99:0/3046171807 learned_addr learned my addr 172.21.15.99:0/3046171807 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:41.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.088+0000 7f1502a00640 1 -- 172.21.15.99:0/1996700427 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1504182630 msgr2=0x7f150422ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:41.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.088+0000 7f7453400640 1 -- 172.21.15.99:0/2424036688 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f74540bbed0 con 0x7f7448003b90 2024-02-21T23:01:41.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.089+0000 7f1502a00640 1 --2- 172.21.15.99:0/1996700427 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1504182630 0x7f150422ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.089+0000 7f1502a00640 1 -- 172.21.15.99:0/1996700427 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f150422a030 msgr2=0x7f150422f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:41.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.089+0000 7fad24a00640 1 --2- 172.21.15.99:0/3046171807 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fad20190670 0x7fad200cc910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:41.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.088+0000 7fb767400640 1 -- 172.21.15.99:0/721162878 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 6) v1 ==== 134407+0+0 (secure 0 0 0) 0x7fb76801c070 con 0x7fb77018e840 2024-02-21T23:01:41.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.092+0000 7fad24a00640 1 -- 172.21.15.99:0/3046171807 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad2006f660 con 0x7fad2006e310 2024-02-21T23:01:41.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.092+0000 7fad24a00640 1 -- 172.21.15.99:0/3046171807 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad2006f380 con 0x7fad2006fb80 2024-02-21T23:01:41.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.092+0000 7fad24a00640 1 -- 172.21.15.99:0/3046171807 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad201914d0 con 0x7fad20190670 2024-02-21T23:01:41.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.092+0000 7fad1de00640 1 --2- 172.21.15.99:0/3046171807 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad2006e310 0x7fad20170f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:41.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.092+0000 7f745e000640 1 --2- 172.21.15.99:0/2424036688 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f744009eff0 0x7f74400a14b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f74600d2b20 tx=0x7f744c0090e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:41.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.093+0000 7fad1e800640 1 --2- 172.21.15.99:0/3046171807 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fad20190670 0x7fad200cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:41.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.094+0000 7fad1d400640 1 -- 172.21.15.99:0/3046171807 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fad20190670 msgr2=0x7fad200cc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:41.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.094+0000 7fad1d400640 1 --2- 172.21.15.99:0/3046171807 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fad20190670 0x7fad200cc910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.094+0000 7fad1d400640 1 -- 172.21.15.99:0/3046171807 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad2006e310 msgr2=0x7fad20170f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:41.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.089+0000 7f1502a00640 1 --2- 172.21.15.99:0/1996700427 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f150422a030 0x7f150422f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.095+0000 7f1502a00640 1 -- 172.21.15.99:0/1996700427 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f150422d930 con 0x7f150406ea20 2024-02-21T23:01:41.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.095+0000 7fad1d400640 1 --2- 172.21.15.99:0/3046171807 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad2006e310 0x7fad20170f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.095+0000 7f1503400640 1 --2- 172.21.15.99:0/1996700427 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f150422a030 0x7f150422f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:01:41.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.096+0000 7fad1d400640 1 -- 172.21.15.99:0/3046171807 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad20224920 con 0x7fad2006fb80 2024-02-21T23:01:41.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.096+0000 7f0397e00640 1 -- 172.21.15.99:0/3741753844 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 6) v1 ==== 134407+0+0 (secure 0 0 0) 0x7f0390011070 con 0x7f03a01575c0 2024-02-21T23:01:41.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.096+0000 7fad1de00640 1 --2- 172.21.15.99:0/3046171807 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad2006e310 0x7fad20170f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:01:41.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.096+0000 7f1502a00640 1 --2- 172.21.15.99:0/1996700427 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f150406ea20 0x7f150417ba00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f14f400b450 tx=0x7f14f400b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:41.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.097+0000 7fad1d400640 1 --2- 172.21.15.99:0/3046171807 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad2006fb80 0x7fad200cc3d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fad1000c7c0 tx=0x7fad1000cc80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:41.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.096+0000 7f14faa00640 1 -- 172.21.15.99:0/1996700427 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14f4015020 con 0x7f150406ea20 2024-02-21T23:01:41.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.096+0000 7f14faa00640 1 -- 172.21.15.99:0/1996700427 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14f4011850 con 0x7f150406ea20 2024-02-21T23:01:41.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.097+0000 7f14faa00640 1 -- 172.21.15.99:0/1996700427 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14f4011c40 con 0x7f150406ea20 2024-02-21T23:01:41.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.098+0000 7fad16000640 1 -- 172.21.15.99:0/3046171807 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad10015070 con 0x7fad2006fb80 2024-02-21T23:01:41.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.098+0000 7fad16000640 1 -- 172.21.15.99:0/3046171807 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad10007820 con 0x7fad2006fb80 2024-02-21T23:01:41.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.098+0000 7fad16000640 1 -- 172.21.15.99:0/3046171807 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad10007bd0 con 0x7fad2006fb80 2024-02-21T23:01:41.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.098+0000 7fad24a00640 1 -- 172.21.15.99:0/3046171807 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad200ccff0 con 0x7fad2006fb80 2024-02-21T23:01:41.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.098+0000 7fad24a00640 1 -- 172.21.15.99:0/3046171807 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad20224bc0 con 0x7fad2006fb80 2024-02-21T23:01:41.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.100+0000 7fad0f400640 1 -- 172.21.15.99:0/3046171807 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facf0005290 con 0x7fad2006fb80 2024-02-21T23:01:41.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.097+0000 7f1509600640 1 -- 172.21.15.99:0/1996700427 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f150422dc10 con 0x7f150406ea20 2024-02-21T23:01:41.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.098+0000 7f1509600640 1 -- 172.21.15.99:0/1996700427 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f150422e1d0 con 0x7f150406ea20 2024-02-21T23:01:41.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.101+0000 7fb767400640 1 --2- 172.21.15.99:0/721162878 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fb75009eec0 0x7fb7500a1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:41.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.105+0000 7fb767400640 1 -- 172.21.15.99:0/721162878 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fb768094f80 con 0x7fb77018e840 2024-02-21T23:01:41.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.106+0000 7f1509600640 1 -- 172.21.15.99:0/1996700427 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14dc005290 con 0x7f150406ea20 2024-02-21T23:01:41.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.109+0000 7f0397e00640 1 --2- 172.21.15.99:0/3741753844 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f038009ee70 0x7f03800a1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:41.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.109+0000 7f039fe00640 1 --2- 172.21.15.99:0/3741753844 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f038009ee70 0x7f03800a1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:41.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.109+0000 7f0397e00640 1 -- 172.21.15.99:0/3741753844 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f03900c87b0 con 0x7f03a01575c0 2024-02-21T23:01:41.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.109+0000 7f0397e00640 1 -- 172.21.15.99:0/3741753844 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f039001a070 con 0x7f03a01575c0 2024-02-21T23:01:41.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.110+0000 7f039fe00640 1 --2- 172.21.15.99:0/3741753844 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f038009ee70 0x7f03800a1330 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0398034000 tx=0x7f0398009030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:41.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.113+0000 7fb76f400640 1 --2- 172.21.15.99:0/721162878 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fb75009eec0 0x7fb7500a1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:41.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.113+0000 7f14faa00640 1 -- 172.21.15.99:0/1996700427 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 6) v1 ==== 134407+0+0 (secure 0 0 0) 0x7f14f4018020 con 0x7f150406ea20 2024-02-21T23:01:41.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.118+0000 7f14faa00640 1 --2- 172.21.15.99:0/1996700427 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f14e409ef40 0x7f14e40a1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:41.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.119+0000 7f14faa00640 1 -- 172.21.15.99:0/1996700427 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f14f40c97d0 con 0x7f150406ea20 2024-02-21T23:01:41.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.122+0000 7f14faa00640 1 -- 172.21.15.99:0/1996700427 <== mon.2 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f14f401f030 con 0x7f150406ea20 2024-02-21T23:01:41.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.123+0000 7f1502000640 1 --2- 172.21.15.99:0/1996700427 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f14e409ef40 0x7f14e40a1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:41.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.124+0000 7fb767400640 1 -- 172.21.15.99:0/721162878 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fb768096c80 con 0x7fb77018e840 2024-02-21T23:01:41.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.124+0000 7f1502000640 1 --2- 172.21.15.99:0/1996700427 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f14e409ef40 0x7f14e40a1400 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f14f0039000 tx=0x7f14f0034000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:41.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.124+0000 7fb76f400640 1 --2- 172.21.15.99:0/721162878 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fb75009eec0 0x7fb7500a1380 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb760009c90 tx=0x7fb760008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:41.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.128+0000 7fad16000640 1 -- 172.21.15.99:0/3046171807 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 6) v1 ==== 134407+0+0 (secure 0 0 0) 0x7fad10018070 con 0x7fad2006fb80 2024-02-21T23:01:41.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.132+0000 7fad16000640 1 --2- 172.21.15.99:0/3046171807 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7facfc09ef40 0x7facfc0a1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:41.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.132+0000 7fad16000640 1 -- 172.21.15.99:0/3046171807 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fad100c9e50 con 0x7fad2006fb80 2024-02-21T23:01:41.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.136+0000 7fad16000640 1 -- 172.21.15.99:0/3046171807 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fad100ca310 con 0x7fad2006fb80 2024-02-21T23:01:41.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.151+0000 7fad1de00640 1 --2- 172.21.15.99:0/3046171807 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7facfc09ef40 0x7facfc0a1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:41.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.152+0000 7fad1de00640 1 --2- 172.21.15.99:0/3046171807 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7facfc09ef40 0x7facfc0a1400 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fad08007fd0 tx=0x7fad08007e80 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:41.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.182+0000 7fba49000640 1 Processor -- start 2024-02-21T23:01:41.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.182+0000 7fba49000640 1 -- start start 2024-02-21T23:01:41.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.186+0000 7fba41e00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fba441861e0 0x7fba44187a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.99:47046/0 (socket says 172.21.15.99:47046) 2024-02-21T23:01:41.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.197+0000 7fba41e00640 1 -- 172.21.15.99:0/378443455 learned_addr learned my addr 172.21.15.99:0/378443455 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:01:41.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.197+0000 7fba49000640 1 --2- 172.21.15.99:0/378443455 >> v2:172.21.15.99:3300/0 conn(0x7fba440d5310 0x7fba440cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:41.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.197+0000 7fba49000640 1 -- 172.21.15.99:0/378443455 --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba44186a50 con 0x7fba441865c0 2024-02-21T23:01:41.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.197+0000 7fba49000640 1 -- 172.21.15.99:0/378443455 --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba440d5740 con 0x7fba441861e0 2024-02-21T23:01:41.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.197+0000 7fba49000640 1 -- 172.21.15.99:0/378443455 --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba44186d50 con 0x7fba440d5310 2024-02-21T23:01:41.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.198+0000 7fba42800640 1 --2- 172.21.15.99:0/378443455 >> v2:172.21.15.99:3300/0 conn(0x7fba440d5310 0x7fba440cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:41.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.198+0000 7fba40a00640 1 -- 172.21.15.99:0/378443455 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1004365017 0 0) 0x7fba44186a50 con 0x7fba441865c0 2024-02-21T23:01:41.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.198+0000 7fba40a00640 1 -- 172.21.15.99:0/378443455 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba28003520 con 0x7fba441865c0 2024-02-21T23:01:41.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.198+0000 7fba40a00640 1 -- 172.21.15.99:0/378443455 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3684905940 0 0) 0x7fba440d5740 con 0x7fba441861e0 2024-02-21T23:01:41.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.198+0000 7fba40a00640 1 -- 172.21.15.99:0/378443455 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba44186a50 con 0x7fba441861e0 2024-02-21T23:01:41.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.199+0000 7fba40a00640 1 -- 172.21.15.99:0/378443455 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3153168422 0 0) 0x7fba28003520 con 0x7fba441865c0 2024-02-21T23:01:41.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.199+0000 7fba40a00640 1 -- 172.21.15.99:0/378443455 >> v2:172.21.15.99:3300/0 conn(0x7fba440d5310 msgr2=0x7fba440cdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:41.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.199+0000 7fba40a00640 1 --2- 172.21.15.99:0/378443455 >> v2:172.21.15.99:3300/0 conn(0x7fba440d5310 0x7fba440cdea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.199+0000 7fba40a00640 1 -- 172.21.15.99:0/378443455 >> v1:172.21.15.162:6789/0 conn(0x7fba441861e0 legacy=0x7fba44187a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:41.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.199+0000 7fba40a00640 1 -- 172.21.15.99:0/378443455 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba440cf7e0 con 0x7fba441865c0 2024-02-21T23:01:41.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.199+0000 7fba40a00640 1 -- 172.21.15.99:0/378443455 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2069890144 0 0) 0x7fba30001690 con 0x7fba441865c0 2024-02-21T23:01:41.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.199+0000 7fba40a00640 1 -- 172.21.15.99:0/378443455 >> v1:172.21.15.99:6789/0 conn(0x7fba441865c0 legacy=0x7fba44188190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:41.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.199+0000 7fba40a00640 1 --2- 172.21.15.99:0/378443455 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fba28003be0 0x7fba28004000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:41.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.199+0000 7fba40a00640 1 --2- 172.21.15.99:0/378443455 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba28004800 0x7fba28004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:41.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.199+0000 7fba40a00640 1 --2- 172.21.15.99:0/378443455 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fba28005330 0x7fba280141d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:41.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.199+0000 7fba40a00640 1 -- 172.21.15.99:0/378443455 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba44186d50 con 0x7fba28005330 2024-02-21T23:01:41.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.199+0000 7fba40a00640 1 -- 172.21.15.99:0/378443455 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba28014a60 con 0x7fba28004800 2024-02-21T23:01:41.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.199+0000 7fba40a00640 1 -- 172.21.15.99:0/378443455 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba28014c60 con 0x7fba28003be0 2024-02-21T23:01:41.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.199+0000 7fba42800640 1 --2- 172.21.15.99:0/378443455 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fba28005330 0x7fba280141d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:41.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.200+0000 7fba41400640 1 --2- 172.21.15.99:0/378443455 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba28004800 0x7fba28004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:41.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.200+0000 7fba41400640 1 -- 172.21.15.99:0/378443455 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fba28003be0 msgr2=0x7fba28004000 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T23:01:41.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.200+0000 7fba41400640 1 --2- 172.21.15.99:0/378443455 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fba28003be0 0x7fba28004000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.200+0000 7fba41400640 1 -- 172.21.15.99:0/378443455 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fba28005330 msgr2=0x7fba280141d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:41.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.200+0000 7fba41400640 1 --2- 172.21.15.99:0/378443455 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fba28005330 0x7fba280141d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.200+0000 7fba41400640 1 -- 172.21.15.99:0/378443455 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba28003520 con 0x7fba28004800 2024-02-21T23:01:41.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.208+0000 7fba42800640 1 --2- 172.21.15.99:0/378443455 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fba28005330 0x7fba280141d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:01:41.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.208+0000 7fba42800640 1 -- 172.21.15.99:0/378443455 reap_dead start 2024-02-21T23:01:41.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.208+0000 7fba41400640 1 --2- 172.21.15.99:0/378443455 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba28004800 0x7fba28004c80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fba30007ee0 tx=0x7fba28005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=19935b44cc4d0cd5 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:41.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.208+0000 7fba40a00640 1 -- 172.21.15.99:0/378443455 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba30039070 con 0x7fba28004800 2024-02-21T23:01:41.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.208+0000 7fba40a00640 1 -- 172.21.15.99:0/378443455 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba3002c8b0 con 0x7fba28004800 2024-02-21T23:01:41.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.209+0000 7fba49000640 1 -- 172.21.15.99:0/378443455 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba28004800 msgr2=0x7fba28004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:41.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.209+0000 7fba49000640 1 --2- 172.21.15.99:0/378443455 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba28004800 0x7fba28004c80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fba30007ee0 tx=0x7fba28005830 comp rx=0 tx=0).stop 2024-02-21T23:01:41.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.212+0000 7fba49000640 1 -- 172.21.15.99:0/378443455 shutdown_connections 2024-02-21T23:01:41.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.212+0000 7fba49000640 1 --2- 172.21.15.99:0/378443455 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba28004800 0x7fba28004c80 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.212+0000 7fba49000640 1 -- 172.21.15.99:0/378443455 >> 172.21.15.99:0/378443455 conn(0x7fba440d6ac0 msgr2=0x7fba440740b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:41.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.212+0000 7fba49000640 1 -- 172.21.15.99:0/378443455 shutdown_connections 2024-02-21T23:01:41.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.213+0000 7fba49000640 1 -- 172.21.15.99:0/378443455 wait complete. 2024-02-21T23:01:41.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.221+0000 7fba49000640 1 Processor -- start 2024-02-21T23:01:41.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.221+0000 7fba49000640 1 -- start start 2024-02-21T23:01:41.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.227+0000 7fba49000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fba28004800 0x7fba4422f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:41.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.228+0000 7fba49000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fba4422fd80 0x7fba4422e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:41.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.228+0000 7fba49000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba4422e9e0 0x7fba44188e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:41.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.228+0000 7fba49000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba44186fa0 con 0x7fba28004800 2024-02-21T23:01:41.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.228+0000 7fba49000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba441875f0 con 0x7fba4422e9e0 2024-02-21T23:01:41.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.228+0000 7fba49000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba44187280 con 0x7fba4422fd80 2024-02-21T23:01:41.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.228+0000 7fba41400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fba4422fd80 0x7fba4422e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:41.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.229+0000 7fba41400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fba4422fd80 0x7fba4422e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:43874/0 (socket says 172.21.15.99:43874) 2024-02-21T23:01:41.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.229+0000 7fba41400640 1 -- 172.21.15.99:0/4278369907 learned_addr learned my addr 172.21.15.99:0/4278369907 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:41.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.229+0000 7fba41e00640 1 --2- 172.21.15.99:0/4278369907 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fba28004800 0x7fba4422f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:41.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.241+0000 7fba41400640 1 -- 172.21.15.99:0/4278369907 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba4422e9e0 msgr2=0x7fba44188e50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-21T23:01:41.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.249+0000 7fba41400640 1 --2- 172.21.15.99:0/4278369907 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba4422e9e0 0x7fba44188e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.249+0000 7fba41400640 1 -- 172.21.15.99:0/4278369907 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fba28004800 msgr2=0x7fba4422f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:41.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.249+0000 7fba41400640 1 --2- 172.21.15.99:0/4278369907 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fba28004800 0x7fba4422f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.249+0000 7fba41400640 1 -- 172.21.15.99:0/4278369907 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba4422ee70 con 0x7fba4422fd80 2024-02-21T23:01:41.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.249+0000 7fba41e00640 1 --2- 172.21.15.99:0/4278369907 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fba28004800 0x7fba4422f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:01:41.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.249+0000 7fba41400640 1 --2- 172.21.15.99:0/4278369907 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fba4422fd80 0x7fba4422e4a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fba3002c320 tx=0x7fba440cf9b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:41.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.250+0000 7fba3a000640 1 -- 172.21.15.99:0/4278369907 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba30042020 con 0x7fba4422fd80 2024-02-21T23:01:41.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.250+0000 7fba3a000640 1 -- 172.21.15.99:0/4278369907 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba30001490 con 0x7fba4422fd80 2024-02-21T23:01:41.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.250+0000 7fba3a000640 1 -- 172.21.15.99:0/4278369907 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba30039040 con 0x7fba4422fd80 2024-02-21T23:01:41.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.250+0000 7fba49000640 1 -- 172.21.15.99:0/4278369907 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba4422d120 con 0x7fba4422fd80 2024-02-21T23:01:41.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.250+0000 7fba49000640 1 -- 172.21.15.99:0/4278369907 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba4422d6e0 con 0x7fba4422fd80 2024-02-21T23:01:41.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.253+0000 7fba49000640 1 -- 172.21.15.99:0/4278369907 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba440d0aa0 con 0x7fba4422fd80 2024-02-21T23:01:41.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.264+0000 7fba3a000640 1 -- 172.21.15.99:0/4278369907 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 6) v1 ==== 134407+0+0 (secure 0 0 0) 0x7fba30045020 con 0x7fba4422fd80 2024-02-21T23:01:41.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.274+0000 7fba3a000640 1 --2- 172.21.15.99:0/4278369907 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fba2409edf0 0x7fba240a12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:41.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.274+0000 7fba3a000640 1 -- 172.21.15.99:0/4278369907 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fba300ebca0 con 0x7fba4422fd80 2024-02-21T23:01:41.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.274+0000 7fba3a000640 1 -- 172.21.15.99:0/4278369907 <== mon.2 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fba3004c020 con 0x7fba4422fd80 2024-02-21T23:01:41.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.279+0000 7fba41e00640 1 --2- 172.21.15.99:0/4278369907 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fba2409edf0 0x7fba240a12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:41.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.280+0000 7fba41e00640 1 --2- 172.21.15.99:0/4278369907 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fba2409edf0 0x7fba240a12b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fba34007fd0 tx=0x7fba34007de0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:41.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.558+0000 7f6176200640 1 -- 172.21.15.99:0/862286926 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f61700f7a80 con 0x7f617006f980 2024-02-21T23:01:41.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.559+0000 7f6167400640 1 -- 172.21.15.99:0/862286926 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f61700cd990 con 0x7f617006f980 2024-02-21T23:01:41.548 INFO:teuthology.orchestra.run.smithi099.stdout:73014444044 2024-02-21T23:01:41.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.560+0000 7fa132400640 1 -- 172.21.15.99:0/2120613652 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa12c0f0d30 con 0x7fa12c06d220 2024-02-21T23:01:41.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.561+0000 7fa11f400640 1 -- 172.21.15.99:0/2120613652 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa120097b00 con 0x7fa12c06d220 2024-02-21T23:01:41.550 INFO:teuthology.orchestra.run.smithi099.stdout:73014444044 2024-02-21T23:01:41.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.565+0000 7fa132400640 1 -- 172.21.15.99:0/2120613652 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fa10c09f070 msgr2=0x7fa10c0a1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:41.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.565+0000 7fa132400640 1 --2- 172.21.15.99:0/2120613652 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fa10c09f070 0x7fa10c0a1530 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa12c177280 tx=0x7fa118009190 comp rx=0 tx=0).stop 2024-02-21T23:01:41.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.565+0000 7fa132400640 1 -- 172.21.15.99:0/2120613652 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa12c06d220 msgr2=0x7fa12c21f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:41.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.565+0000 7fa132400640 1 --2- 172.21.15.99:0/2120613652 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa12c06d220 0x7fa12c21f2f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa12000b480 tx=0x7fa12000b940 comp rx=0 tx=0).stop 2024-02-21T23:01:41.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.566+0000 7fa132400640 1 -- 172.21.15.99:0/2120613652 shutdown_connections 2024-02-21T23:01:41.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.566+0000 7fa132400640 1 --2- 172.21.15.99:0/2120613652 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fa10c09f070 0x7fa10c0a1530 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.566+0000 7fa132400640 1 --2- 172.21.15.99:0/2120613652 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa12c0f9500 0x7fa12c1720e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.566+0000 7fa132400640 1 --2- 172.21.15.99:0/2120613652 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa12c06db40 0x7fa12c21f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.566+0000 7fa132400640 1 --2- 172.21.15.99:0/2120613652 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa12c06d220 0x7fa12c21f2f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.566+0000 7fa132400640 1 -- 172.21.15.99:0/2120613652 >> 172.21.15.99:0/2120613652 conn(0x7fa12c0f6c50 msgr2=0x7fa12c20d480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:41.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.567+0000 7fa132400640 1 -- 172.21.15.99:0/2120613652 shutdown_connections 2024-02-21T23:01:41.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.567+0000 7fa132400640 1 -- 172.21.15.99:0/2120613652 wait complete. 2024-02-21T23:01:41.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.569+0000 7f6176200640 1 -- 172.21.15.99:0/862286926 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f615009efb0 msgr2=0x7f61500a1470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:41.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.569+0000 7f6176200640 1 --2- 172.21.15.99:0/862286926 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f615009efb0 0x7f61500a1470 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f61700f91d0 tx=0x7f615c009040 comp rx=0 tx=0).stop 2024-02-21T23:01:41.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.569+0000 7f6176200640 1 -- 172.21.15.99:0/862286926 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f617006f980 msgr2=0x7f61700cc3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:41.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.569+0000 7f6176200640 1 --2- 172.21.15.99:0/862286926 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f617006f980 0x7f61700cc3d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f616000b410 tx=0x7f616000b8d0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.570+0000 7f6176200640 1 -- 172.21.15.99:0/862286926 shutdown_connections 2024-02-21T23:01:41.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.570+0000 7f6176200640 1 --2- 172.21.15.99:0/862286926 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f615009efb0 0x7f61500a1470 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.570+0000 7f6176200640 1 --2- 172.21.15.99:0/862286926 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f61701965f0 0x7f617017f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.570+0000 7f6176200640 1 --2- 172.21.15.99:0/862286926 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61700c9000 0x7f61700cdd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.570+0000 7f6176200640 1 --2- 172.21.15.99:0/862286926 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f617006f980 0x7f61700cc3d0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.570+0000 7f6176200640 1 -- 172.21.15.99:0/862286926 >> 172.21.15.99:0/862286926 conn(0x7f61700ce5f0 msgr2=0x7f617006f270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:41.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.571+0000 7f6176200640 1 -- 172.21.15.99:0/862286926 shutdown_connections 2024-02-21T23:01:41.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.571+0000 7f6176200640 1 -- 172.21.15.99:0/862286926 wait complete. 2024-02-21T23:01:41.588 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444043 got 73014444044 for osd.2 2024-02-21T23:01:41.589 DEBUG:teuthology.parallel:result is None 2024-02-21T23:01:41.619 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444043 got 73014444044 for osd.1 2024-02-21T23:01:41.619 DEBUG:teuthology.parallel:result is None 2024-02-21T23:01:41.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.634+0000 7f5ef4a00640 1 -- 172.21.15.99:0/513936168 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) v1 -- 0x7f5ec8005850 con 0x7f5ed4004800 2024-02-21T23:01:41.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.638+0000 7f5ee6000640 1 -- 172.21.15.99:0/513936168 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5ee80983a0 con 0x7f5ed4004800 2024-02-21T23:01:41.628 INFO:teuthology.orchestra.run.smithi099.stdout:73014444043 2024-02-21T23:01:41.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.646+0000 7f5ef4a00640 1 -- 172.21.15.99:0/513936168 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f5ed009f0a0 msgr2=0x7f5ed00a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:41.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.646+0000 7f5ef4a00640 1 --2- 172.21.15.99:0/513936168 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f5ed009f0a0 0x7f5ed00a1560 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5edc036000 tx=0x7f5edc009030 comp rx=0 tx=0).stop 2024-02-21T23:01:41.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.646+0000 7f5ef4a00640 1 -- 172.21.15.99:0/513936168 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ed4004800 msgr2=0x7f5ef0177e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:41.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.646+0000 7f5ef4a00640 1 --2- 172.21.15.99:0/513936168 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ed4004800 0x7f5ef0177e50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5ee8001460 tx=0x7f5ee800b0d0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.646+0000 7f5ef4a00640 1 -- 172.21.15.99:0/513936168 shutdown_connections 2024-02-21T23:01:41.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.646+0000 7f5ef4a00640 1 --2- 172.21.15.99:0/513936168 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f5ed009f0a0 0x7f5ed00a1560 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.650+0000 7f5ef4a00640 1 --2- 172.21.15.99:0/513936168 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5ef017dd60 0x7f5ef0179ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.650+0000 7f5ef4a00640 1 --2- 172.21.15.99:0/513936168 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5ef022c330 0x7f5ef0177670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.650+0000 7f5ef4a00640 1 --2- 172.21.15.99:0/513936168 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ed4004800 0x7f5ef0177e50 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.650+0000 7f5ef4a00640 1 -- 172.21.15.99:0/513936168 >> 172.21.15.99:0/513936168 conn(0x7f5ef00d6ac0 msgr2=0x7f5ef00740b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:41.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.650+0000 7f5ef4a00640 1 -- 172.21.15.99:0/513936168 shutdown_connections 2024-02-21T23:01:41.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.650+0000 7f5ef4a00640 1 -- 172.21.15.99:0/513936168 wait complete. 2024-02-21T23:01:41.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.697+0000 7f0395600640 1 -- 172.21.15.99:0/3741753844 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0374005850 con 0x7f03a01575c0 2024-02-21T23:01:41.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.701+0000 7f0397e00640 1 -- 172.21.15.99:0/3741753844 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0390096a30 con 0x7f03a01575c0 2024-02-21T23:01:41.693 INFO:teuthology.orchestra.run.smithi099.stdout:73014444044 2024-02-21T23:01:41.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.707+0000 7f0395600640 1 -- 172.21.15.99:0/3741753844 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f038009ee70 msgr2=0x7f03800a1330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:41.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.707+0000 7f0395600640 1 --2- 172.21.15.99:0/3741753844 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f038009ee70 0x7f03800a1330 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0398034000 tx=0x7f0398009030 comp rx=0 tx=0).stop 2024-02-21T23:01:41.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.707+0000 7f0395600640 1 -- 172.21.15.99:0/3741753844 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03a01575c0 msgr2=0x7f03a015dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:41.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.707+0000 7f0395600640 1 --2- 172.21.15.99:0/3741753844 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03a01575c0 0x7f03a015dcc0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f03a0070650 tx=0x7f039000c820 comp rx=0 tx=0).stop 2024-02-21T23:01:41.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.707+0000 7f0395600640 1 -- 172.21.15.99:0/3741753844 shutdown_connections 2024-02-21T23:01:41.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.707+0000 7f0395600640 1 --2- 172.21.15.99:0/3741753844 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f038009ee70 0x7f03800a1330 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.707+0000 7f0395600640 1 --2- 172.21.15.99:0/3741753844 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03a01575c0 0x7f03a015dcc0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.707+0000 7f0395600640 1 --2- 172.21.15.99:0/3741753844 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f03a0156c00 0x7f03a0157080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.707+0000 7f0395600640 1 --2- 172.21.15.99:0/3741753844 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0384003b70 0x7f03a0180930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.707+0000 7f0395600640 1 -- 172.21.15.99:0/3741753844 >> 172.21.15.99:0/3741753844 conn(0x7f03a00ce5f0 msgr2=0x7f03a006ee90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:41.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.708+0000 7f0395600640 1 -- 172.21.15.99:0/3741753844 shutdown_connections 2024-02-21T23:01:41.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.708+0000 7f0395600640 1 -- 172.21.15.99:0/3741753844 wait complete. 2024-02-21T23:01:41.709 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444042 got 73014444043 for osd.8 2024-02-21T23:01:41.709 DEBUG:teuthology.parallel:result is None 2024-02-21T23:01:41.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.740+0000 7f62ffe00640 1 -- 172.21.15.99:0/1189533897 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f62f807fdd0 con 0x7f62f81108a0 2024-02-21T23:01:41.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.741+0000 7f62f6a00640 1 -- 172.21.15.99:0/1189533897 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f62ec097ed0 con 0x7f62f81108a0 2024-02-21T23:01:41.731 INFO:teuthology.orchestra.run.smithi099.stdout:73014444044 2024-02-21T23:01:41.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.745+0000 7f62ffe00640 1 -- 172.21.15.99:0/1189533897 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f62e009eec0 msgr2=0x7f62e00a1380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:41.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.745+0000 7f62ffe00640 1 --2- 172.21.15.99:0/1189533897 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f62e009eec0 0x7f62e00a1380 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f62f0035000 tx=0x7f62f0008030 comp rx=0 tx=0).stop 2024-02-21T23:01:41.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.745+0000 7f62ffe00640 1 -- 172.21.15.99:0/1189533897 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62f81108a0 msgr2=0x7f62f81a5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:41.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.745+0000 7f62ffe00640 1 --2- 172.21.15.99:0/1189533897 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62f81108a0 0x7f62f81a5a00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f62ec00eb70 tx=0x7f62ec00c520 comp rx=0 tx=0).stop 2024-02-21T23:01:41.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.746+0000 7f62ffe00640 1 -- 172.21.15.99:0/1189533897 shutdown_connections 2024-02-21T23:01:41.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.746+0000 7f62ffe00640 1 --2- 172.21.15.99:0/1189533897 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f62e009eec0 0x7f62e00a1380 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.746+0000 7f62ffe00640 1 --2- 172.21.15.99:0/1189533897 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62f80fd840 0x7f62f81ab000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.746+0000 7f62ffe00640 1 --2- 172.21.15.99:0/1189533897 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62f81108a0 0x7f62f81a5a00 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.746+0000 7f62ffe00640 1 --2- 172.21.15.99:0/1189533897 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62f810fef0 0x7f62f807a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.747+0000 7f62ffe00640 1 -- 172.21.15.99:0/1189533897 >> 172.21.15.99:0/1189533897 conn(0x7f62f8006360 msgr2=0x7f62f81092a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:41.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.747+0000 7f62ffe00640 1 -- 172.21.15.99:0/1189533897 shutdown_connections 2024-02-21T23:01:41.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.747+0000 7f62ffe00640 1 -- 172.21.15.99:0/1189533897 wait complete. 2024-02-21T23:01:41.765 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444043 got 73014444044 for osd.0 2024-02-21T23:01:41.765 DEBUG:teuthology.parallel:result is None 2024-02-21T23:01:41.777 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444043 got 73014444044 for osd.3 2024-02-21T23:01:41.777 DEBUG:teuthology.parallel:result is None 2024-02-21T23:01:41.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.792+0000 7fe44be00640 1 -- 172.21.15.99:0/1308113303 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fe438005850 con 0x7fe458079470 2024-02-21T23:01:41.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.792+0000 7fe456a00640 1 -- 172.21.15.99:0/1308113303 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe450097910 con 0x7fe458079470 2024-02-21T23:01:41.781 INFO:teuthology.orchestra.run.smithi099.stdout:73014444043 2024-02-21T23:01:41.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.796+0000 7fe44be00640 1 -- 172.21.15.99:0/1308113303 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fe44009ee70 msgr2=0x7fe4400a1330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:41.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.796+0000 7fe44be00640 1 --2- 172.21.15.99:0/1308113303 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fe44009ee70 0x7fe4400a1330 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe458078d60 tx=0x7fe44c0079d0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.796+0000 7fe44be00640 1 -- 172.21.15.99:0/1308113303 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe458079470 msgr2=0x7fe458101720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:41.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.796+0000 7fe44be00640 1 --2- 172.21.15.99:0/1308113303 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe458079470 0x7fe458101720 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe45000e870 tx=0x7fe45000ed30 comp rx=0 tx=0).stop 2024-02-21T23:01:41.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.797+0000 7fe44be00640 1 -- 172.21.15.99:0/1308113303 shutdown_connections 2024-02-21T23:01:41.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.797+0000 7fe44be00640 1 --2- 172.21.15.99:0/1308113303 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fe44009ee70 0x7fe4400a1330 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.797+0000 7fe44be00640 1 --2- 172.21.15.99:0/1308113303 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe45810b350 0x7fe4580d9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.797+0000 7fe44be00640 1 --2- 172.21.15.99:0/1308113303 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe4580e1a90 0x7fe4580fd260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.797+0000 7fe44be00640 1 --2- 172.21.15.99:0/1308113303 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe458079470 0x7fe458101720 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.797+0000 7fe44be00640 1 -- 172.21.15.99:0/1308113303 >> 172.21.15.99:0/1308113303 conn(0x7fe458052fc0 msgr2=0x7fe4580533a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:41.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.797+0000 7fe44be00640 1 -- 172.21.15.99:0/1308113303 shutdown_connections 2024-02-21T23:01:41.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.798+0000 7fe44be00640 1 -- 172.21.15.99:0/1308113303 wait complete. 2024-02-21T23:01:41.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.801+0000 7f7423200640 1 -- 172.21.15.99:0/737490207 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f73fc005850 con 0x7f74240719b0 2024-02-21T23:01:41.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.803+0000 7f741a000640 1 -- 172.21.15.99:0/737490207 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f741c0baaf0 con 0x7f74240719b0 2024-02-21T23:01:41.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.805+0000 7fad0f400640 1 -- 172.21.15.99:0/3046171807 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) v1 -- 0x7facf0005850 con 0x7fad2006fb80 2024-02-21T23:01:41.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.806+0000 7fad16000640 1 -- 172.21.15.99:0/3046171807 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fad10097fc0 con 0x7fad2006fb80 2024-02-21T23:01:41.795 INFO:teuthology.orchestra.run.smithi099.stdout:73014444044 2024-02-21T23:01:41.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.809+0000 7fad0f400640 1 -- 172.21.15.99:0/3046171807 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7facfc09ef40 msgr2=0x7facfc0a1400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:41.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.810+0000 7fad0f400640 1 --2- 172.21.15.99:0/3046171807 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7facfc09ef40 0x7facfc0a1400 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fad08007fd0 tx=0x7fad08007e80 comp rx=0 tx=0).stop 2024-02-21T23:01:41.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.810+0000 7fad0f400640 1 -- 172.21.15.99:0/3046171807 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad2006fb80 msgr2=0x7fad200cc3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:41.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.810+0000 7fad0f400640 1 --2- 172.21.15.99:0/3046171807 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad2006fb80 0x7fad200cc3d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fad1000c7c0 tx=0x7fad1000cc80 comp rx=0 tx=0).stop 2024-02-21T23:01:41.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.810+0000 7fad0f400640 1 -- 172.21.15.99:0/3046171807 shutdown_connections 2024-02-21T23:01:41.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.810+0000 7fad0f400640 1 --2- 172.21.15.99:0/3046171807 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7facfc09ef40 0x7facfc0a1400 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.810+0000 7fad0f400640 1 --2- 172.21.15.99:0/3046171807 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fad20190670 0x7fad200cc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.811+0000 7fad0f400640 1 --2- 172.21.15.99:0/3046171807 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad2006fb80 0x7fad200cc3d0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.811+0000 7fad0f400640 1 --2- 172.21.15.99:0/3046171807 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fad2006e310 0x7fad20170f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.811+0000 7fad0f400640 1 -- 172.21.15.99:0/3046171807 >> 172.21.15.99:0/3046171807 conn(0x7fad200ce5f0 msgr2=0x7fad200ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:41.801 INFO:teuthology.orchestra.run.smithi099.stdout:73014444044 2024-02-21T23:01:41.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.811+0000 7fad0f400640 1 -- 172.21.15.99:0/3046171807 shutdown_connections 2024-02-21T23:01:41.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.811+0000 7fad0f400640 1 -- 172.21.15.99:0/3046171807 wait complete. 2024-02-21T23:01:41.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.815+0000 7f7423200640 1 -- 172.21.15.99:0/737490207 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f740409edf0 msgr2=0x7f74040a12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:41.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.815+0000 7f7423200640 1 --2- 172.21.15.99:0/737490207 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f740409edf0 0x7f74040a12b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f74240d0cf0 tx=0x7f7410009060 comp rx=0 tx=0).stop 2024-02-21T23:01:41.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.815+0000 7f7423200640 1 -- 172.21.15.99:0/737490207 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f74240719b0 msgr2=0x7f74240fce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:41.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.815+0000 7f7423200640 1 --2- 172.21.15.99:0/737490207 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f74240719b0 0x7f74240fce30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f741c037040 tx=0x7f741c004a40 comp rx=0 tx=0).stop 2024-02-21T23:01:41.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.816+0000 7f7423200640 1 -- 172.21.15.99:0/737490207 shutdown_connections 2024-02-21T23:01:41.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.816+0000 7f7423200640 1 --2- 172.21.15.99:0/737490207 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f740409edf0 0x7f74040a12b0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.816+0000 7f7423200640 1 --2- 172.21.15.99:0/737490207 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f742418b980 0x7f742417d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.816+0000 7f7423200640 1 --2- 172.21.15.99:0/737490207 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7424182a80 0x7f742417c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.816+0000 7f7423200640 1 --2- 172.21.15.99:0/737490207 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f74240719b0 0x7f74240fce30 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.816+0000 7f7423200640 1 -- 172.21.15.99:0/737490207 >> 172.21.15.99:0/737490207 conn(0x7f74240d29f0 msgr2=0x7f74240d2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:41.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.816+0000 7f7423200640 1 -- 172.21.15.99:0/737490207 shutdown_connections 2024-02-21T23:01:41.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.817+0000 7f7423200640 1 -- 172.21.15.99:0/737490207 wait complete. 2024-02-21T23:01:41.814 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444042 got 73014444043 for osd.6 2024-02-21T23:01:41.814 DEBUG:teuthology.parallel:result is None 2024-02-21T23:01:41.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.830+0000 7f7450c00640 1 -- 172.21.15.99:0/2424036688 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f7434005850 con 0x7f7448003b90 2024-02-21T23:01:41.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.837+0000 7f7453400640 1 -- 172.21.15.99:0/2424036688 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f74540bb7d0 con 0x7f7448003b90 2024-02-21T23:01:41.827 INFO:teuthology.orchestra.run.smithi099.stdout:73014444044 2024-02-21T23:01:41.833 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444043 got 73014444044 for osd.4 2024-02-21T23:01:41.833 DEBUG:teuthology.parallel:result is None 2024-02-21T23:01:41.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.843+0000 7f7450c00640 1 -- 172.21.15.99:0/2424036688 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f744009eff0 msgr2=0x7f74400a14b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:41.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.843+0000 7f7450c00640 1 --2- 172.21.15.99:0/2424036688 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f744009eff0 0x7f74400a14b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f74600d2b20 tx=0x7f744c0090e0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.843+0000 7f7450c00640 1 -- 172.21.15.99:0/2424036688 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7448003b90 msgr2=0x7f7460181d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:41.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.843+0000 7f7450c00640 1 --2- 172.21.15.99:0/2424036688 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7448003b90 0x7f7460181d70 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7454033000 tx=0x7f74540012d0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.843+0000 7f7450c00640 1 -- 172.21.15.99:0/2424036688 shutdown_connections 2024-02-21T23:01:41.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.843+0000 7f7450c00640 1 --2- 172.21.15.99:0/2424036688 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f744009eff0 0x7f74400a14b0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.843+0000 7f7450c00640 1 --2- 172.21.15.99:0/2424036688 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f746022e670 0x7f74600edf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.843+0000 7f7450c00640 1 --2- 172.21.15.99:0/2424036688 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f746022dcd0 0x7f746022e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.843+0000 7f7450c00640 1 --2- 172.21.15.99:0/2424036688 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7448003b90 0x7f7460181d70 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.843+0000 7f7450c00640 1 -- 172.21.15.99:0/2424036688 >> 172.21.15.99:0/2424036688 conn(0x7f74600f6c50 msgr2=0x7f746006fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:41.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.843+0000 7f7450c00640 1 -- 172.21.15.99:0/2424036688 shutdown_connections 2024-02-21T23:01:41.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.843+0000 7f7450c00640 1 -- 172.21.15.99:0/2424036688 wait complete. 2024-02-21T23:01:41.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.853+0000 7f1509600640 1 -- 172.21.15.99:0/1996700427 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f14dc005850 con 0x7f150406ea20 2024-02-21T23:01:41.843 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444043 got 73014444044 for osd.9 2024-02-21T23:01:41.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.854+0000 7f14faa00640 1 -- 172.21.15.99:0/1996700427 <== mon.2 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f14f40979d0 con 0x7f150406ea20 2024-02-21T23:01:41.843 DEBUG:teuthology.parallel:result is None 2024-02-21T23:01:41.845 INFO:teuthology.orchestra.run.smithi099.stdout:73014444044 2024-02-21T23:01:41.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.860+0000 7f1509600640 1 -- 172.21.15.99:0/1996700427 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f14e409ef40 msgr2=0x7f14e40a1400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:41.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.860+0000 7f1509600640 1 --2- 172.21.15.99:0/1996700427 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f14e409ef40 0x7f14e40a1400 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f14f0039000 tx=0x7f14f0034000 comp rx=0 tx=0).stop 2024-02-21T23:01:41.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.860+0000 7f1509600640 1 -- 172.21.15.99:0/1996700427 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f150406ea20 msgr2=0x7f150417ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:41.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.860+0000 7f1509600640 1 --2- 172.21.15.99:0/1996700427 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f150406ea20 0x7f150417ba00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f14f400b450 tx=0x7f14f400b910 comp rx=0 tx=0).stop 2024-02-21T23:01:41.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.860+0000 7f1509600640 1 -- 172.21.15.99:0/1996700427 shutdown_connections 2024-02-21T23:01:41.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.860+0000 7f1509600640 1 --2- 172.21.15.99:0/1996700427 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f14e409ef40 0x7f14e40a1400 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.860+0000 7f1509600640 1 --2- 172.21.15.99:0/1996700427 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f150422a030 0x7f150422f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.860+0000 7f1509600640 1 --2- 172.21.15.99:0/1996700427 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1504182630 0x7f150422ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.860+0000 7f1509600640 1 --2- 172.21.15.99:0/1996700427 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f150406ea20 0x7f150417ba00 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.860+0000 7f1509600640 1 -- 172.21.15.99:0/1996700427 >> 172.21.15.99:0/1996700427 conn(0x7f15040ce5f0 msgr2=0x7f1504180840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:41.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.860+0000 7f1509600640 1 -- 172.21.15.99:0/1996700427 shutdown_connections 2024-02-21T23:01:41.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.860+0000 7f1509600640 1 -- 172.21.15.99:0/1996700427 wait complete. 2024-02-21T23:01:41.858 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444043 got 73014444044 for osd.7 2024-02-21T23:01:41.858 DEBUG:teuthology.parallel:result is None 2024-02-21T23:01:41.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.872+0000 7fba49000640 1 -- 172.21.15.99:0/4278369907 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) v1 -- 0x7fba440ceaa0 con 0x7fba4422fd80 2024-02-21T23:01:41.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.873+0000 7fba3a000640 1 -- 172.21.15.99:0/4278369907 <== mon.2 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) v1 ==== 75+0+12 (secure 0 0 0) 0x7fba300b9f90 con 0x7fba4422fd80 2024-02-21T23:01:41.862 INFO:teuthology.orchestra.run.smithi099.stdout:73014444043 2024-02-21T23:01:41.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.876+0000 7fba49000640 1 -- 172.21.15.99:0/4278369907 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fba2409edf0 msgr2=0x7fba240a12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:41.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.876+0000 7fba49000640 1 --2- 172.21.15.99:0/4278369907 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fba2409edf0 0x7fba240a12b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fba34007fd0 tx=0x7fba34007de0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.876+0000 7fba49000640 1 -- 172.21.15.99:0/4278369907 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fba4422fd80 msgr2=0x7fba4422e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:41.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.876+0000 7fba49000640 1 --2- 172.21.15.99:0/4278369907 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fba4422fd80 0x7fba4422e4a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fba3002c320 tx=0x7fba440cf9b0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.876+0000 7fba49000640 1 -- 172.21.15.99:0/4278369907 shutdown_connections 2024-02-21T23:01:41.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.876+0000 7fba49000640 1 --2- 172.21.15.99:0/4278369907 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fba2409edf0 0x7fba240a12b0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.876+0000 7fba49000640 1 --2- 172.21.15.99:0/4278369907 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba4422e9e0 0x7fba44188e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.876+0000 7fba49000640 1 --2- 172.21.15.99:0/4278369907 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fba4422fd80 0x7fba4422e4a0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.876+0000 7fba49000640 1 --2- 172.21.15.99:0/4278369907 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fba28004800 0x7fba4422f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.876+0000 7fba49000640 1 -- 172.21.15.99:0/4278369907 >> 172.21.15.99:0/4278369907 conn(0x7fba440d6ac0 msgr2=0x7fba44187a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:41.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.876+0000 7fba49000640 1 -- 172.21.15.99:0/4278369907 shutdown_connections 2024-02-21T23:01:41.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.876+0000 7fba49000640 1 -- 172.21.15.99:0/4278369907 wait complete. 2024-02-21T23:01:41.871 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444043 got 73014444044 for osd.5 2024-02-21T23:01:41.872 DEBUG:teuthology.parallel:result is None 2024-02-21T23:01:41.885 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444042 got 73014444043 for osd.10 2024-02-21T23:01:41.886 DEBUG:teuthology.parallel:result is None 2024-02-21T23:01:41.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.971+0000 7fb776400640 1 -- 172.21.15.99:0/721162878 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) v1 -- 0x7fb770101b20 con 0x7fb77018e840 2024-02-21T23:01:41.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.972+0000 7fb767400640 1 -- 172.21.15.99:0/721162878 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) v1 ==== 75+0+12 (secure 0 0 0) 0x7fb76809ad20 con 0x7fb77018e840 2024-02-21T23:01:41.961 INFO:teuthology.orchestra.run.smithi099.stdout:73014444044 2024-02-21T23:01:41.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.974+0000 7fb776400640 1 -- 172.21.15.99:0/721162878 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fb75009eec0 msgr2=0x7fb7500a1380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:41.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.974+0000 7fb776400640 1 --2- 172.21.15.99:0/721162878 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fb75009eec0 0x7fb7500a1380 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb760009c90 tx=0x7fb760008040 comp rx=0 tx=0).stop 2024-02-21T23:01:41.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.974+0000 7fb776400640 1 -- 172.21.15.99:0/721162878 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb77018e840 msgr2=0x7fb7700fe1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:41.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.974+0000 7fb776400640 1 --2- 172.21.15.99:0/721162878 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb77018e840 0x7fb7700fe1c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb770102840 tx=0x7fb76800e960 comp rx=0 tx=0).stop 2024-02-21T23:01:41.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.974+0000 7fb776400640 1 -- 172.21.15.99:0/721162878 shutdown_connections 2024-02-21T23:01:41.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.974+0000 7fb776400640 1 --2- 172.21.15.99:0/721162878 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fb75009eec0 0x7fb7500a1380 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.974+0000 7fb776400640 1 --2- 172.21.15.99:0/721162878 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb77018e840 0x7fb7700fe1c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.974+0000 7fb776400640 1 --2- 172.21.15.99:0/721162878 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb7701858c0 0x7fb77018e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.974+0000 7fb776400640 1 --2- 172.21.15.99:0/721162878 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb770174660 0x7fb770174a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:41.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.974+0000 7fb776400640 1 -- 172.21.15.99:0/721162878 >> 172.21.15.99:0/721162878 conn(0x7fb7700d6d60 msgr2=0x7fb77006e110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:41.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.974+0000 7fb776400640 1 -- 172.21.15.99:0/721162878 shutdown_connections 2024-02-21T23:01:41.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:41.974+0000 7fb776400640 1 -- 172.21.15.99:0/721162878 wait complete. 2024-02-21T23:01:41.981 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444043 got 73014444044 for osd.11 2024-02-21T23:01:41.982 DEBUG:teuthology.parallel:result is None 2024-02-21T23:01:41.982 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-02-21T23:01:41.982 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-21T23:01:42.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.175+0000 7fd135400640 1 Processor -- start 2024-02-21T23:01:42.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.175+0000 7fd135400640 1 -- start start 2024-02-21T23:01:42.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.178+0000 7fd135400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd130182a80 0x7fd13018a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:42.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.179+0000 7fd135400640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fd13018b980 0x7fd130186a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:42.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.179+0000 7fd135400640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1300729c0 con 0x7fd1301606a0 2024-02-21T23:01:42.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.179+0000 7fd135400640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd13018a600 con 0x7fd130182a80 2024-02-21T23:01:42.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.179+0000 7fd135400640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd13018a8e0 con 0x7fd13018b980 2024-02-21T23:01:42.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.179+0000 7fd12fe00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd130182a80 0x7fd13018a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:42.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.179+0000 7fd134a00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fd1301606a0 0x7fd130160b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:52674/0 (socket says 172.21.15.99:52674) 2024-02-21T23:01:42.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.179+0000 7fd134a00640 1 -- 172.21.15.99:0/2678620419 learned_addr learned my addr 172.21.15.99:0/2678620419 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:01:42.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.179+0000 7fd12f400640 1 --2- 172.21.15.99:0/2678620419 >> v2:172.21.15.181:3300/0 conn(0x7fd13018b980 0x7fd130186a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:42.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.180+0000 7fd12f400640 1 -- 172.21.15.99:0/2678620419 >> v2:172.21.15.99:3300/0 conn(0x7fd130182a80 msgr2=0x7fd13018a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:42.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.180+0000 7fd12f400640 1 --2- 172.21.15.99:0/2678620419 >> v2:172.21.15.99:3300/0 conn(0x7fd130182a80 0x7fd13018a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:42.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.180+0000 7fd12f400640 1 -- 172.21.15.99:0/2678620419 >> v1:172.21.15.99:6789/0 conn(0x7fd1301606a0 legacy=0x7fd130160b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:42.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.180+0000 7fd12f400640 1 -- 172.21.15.99:0/2678620419 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd13018abc0 con 0x7fd13018b980 2024-02-21T23:01:42.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.180+0000 7fd12ea00640 1 -- 172.21.15.99:0/2678620419 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2102215010 0 0) 0x7fd1300729c0 con 0x7fd1301606a0 2024-02-21T23:01:42.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.181+0000 7fd12f400640 1 --2- 172.21.15.99:0/2678620419 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd13018b980 0x7fd130186a90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd13015afe0 tx=0x7fd11c02b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e505c92c29a0a2e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:42.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.182+0000 7fd12ea00640 1 -- 172.21.15.99:0/2678620419 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11c0315a0 con 0x7fd13018b980 2024-02-21T23:01:42.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.182+0000 7fd12ea00640 1 -- 172.21.15.99:0/2678620419 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd11c037070 con 0x7fd13018b980 2024-02-21T23:01:42.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.182+0000 7fd12ea00640 1 -- 172.21.15.99:0/2678620419 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11c031960 con 0x7fd13018b980 2024-02-21T23:01:42.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.182+0000 7fd135400640 1 -- 172.21.15.99:0/2678620419 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd13018b980 msgr2=0x7fd130186a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:42.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.182+0000 7fd135400640 1 --2- 172.21.15.99:0/2678620419 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd13018b980 0x7fd130186a90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd13015afe0 tx=0x7fd11c02b840 comp rx=0 tx=0).stop 2024-02-21T23:01:42.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.182+0000 7fd135400640 1 -- 172.21.15.99:0/2678620419 shutdown_connections 2024-02-21T23:01:42.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.182+0000 7fd135400640 1 --2- 172.21.15.99:0/2678620419 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd13018b980 0x7fd130186a90 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:42.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.182+0000 7fd135400640 1 --2- 172.21.15.99:0/2678620419 >> v2:172.21.15.99:3300/0 conn(0x7fd130182a80 0x7fd13018a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:42.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.182+0000 7fd135400640 1 -- 172.21.15.99:0/2678620419 >> 172.21.15.99:0/2678620419 conn(0x7fd1300d29f0 msgr2=0x7fd1300d2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:42.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.182+0000 7fd135400640 1 -- 172.21.15.99:0/2678620419 shutdown_connections 2024-02-21T23:01:42.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.182+0000 7fd135400640 1 -- 172.21.15.99:0/2678620419 wait complete. 2024-02-21T23:01:42.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.186+0000 7fd135400640 1 Processor -- start 2024-02-21T23:01:42.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.186+0000 7fd135400640 1 -- start start 2024-02-21T23:01:42.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.188+0000 7fd135400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd1301606a0 0x7fd13017c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:42.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.188+0000 7fd135400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd130182a80 0x7fd1300f54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:42.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.188+0000 7fd135400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd13018b980 0x7fd1302203b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:42.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.188+0000 7fd135400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd13018b460 con 0x7fd130182a80 2024-02-21T23:01:42.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.188+0000 7fd135400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd13018b180 con 0x7fd13018b980 2024-02-21T23:01:42.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.188+0000 7fd135400640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd13018be00 con 0x7fd1301606a0 2024-02-21T23:01:42.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.188+0000 7fd12f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd130182a80 0x7fd1300f54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:42.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.188+0000 7fd12fe00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd1301606a0 0x7fd13017c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:42.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.188+0000 7fd12f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd130182a80 0x7fd1300f54f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59806/0 (socket says 172.21.15.99:59806) 2024-02-21T23:01:42.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.188+0000 7fd12f400640 1 -- 172.21.15.99:0/2098277355 learned_addr learned my addr 172.21.15.99:0/2098277355 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:42.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.188+0000 7fd134a00640 1 --2- 172.21.15.99:0/2098277355 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd13018b980 0x7fd1302203b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:42.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.189+0000 7fd12fe00640 1 -- 172.21.15.99:0/2098277355 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd13018b980 msgr2=0x7fd1302203b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:42.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.189+0000 7fd12fe00640 1 --2- 172.21.15.99:0/2098277355 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd13018b980 0x7fd1302203b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:42.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.189+0000 7fd12fe00640 1 -- 172.21.15.99:0/2098277355 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd130182a80 msgr2=0x7fd1300f54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:42.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.189+0000 7fd12fe00640 1 --2- 172.21.15.99:0/2098277355 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd130182a80 0x7fd1300f54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:42.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.189+0000 7fd12fe00640 1 -- 172.21.15.99:0/2098277355 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1300f5f30 con 0x7fd1301606a0 2024-02-21T23:01:42.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.189+0000 7fd134a00640 1 --2- 172.21.15.99:0/2098277355 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd13018b980 0x7fd1302203b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:01:42.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.189+0000 7fd12fe00640 1 --2- 172.21.15.99:0/2098277355 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd1301606a0 0x7fd13017c950 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd12000e870 tx=0x7fd12000ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:42.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.189+0000 7fd127e00640 1 -- 172.21.15.99:0/2098277355 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd120017070 con 0x7fd1301606a0 2024-02-21T23:01:42.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.189+0000 7fd127e00640 1 -- 172.21.15.99:0/2098277355 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd12000ee60 con 0x7fd1301606a0 2024-02-21T23:01:42.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.189+0000 7fd127e00640 1 -- 172.21.15.99:0/2098277355 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12000cb60 con 0x7fd1301606a0 2024-02-21T23:01:42.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.189+0000 7fd135400640 1 -- 172.21.15.99:0/2098277355 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1300f6210 con 0x7fd1301606a0 2024-02-21T23:01:42.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.189+0000 7fd135400640 1 -- 172.21.15.99:0/2098277355 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1300f67d0 con 0x7fd1301606a0 2024-02-21T23:01:42.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.191+0000 7fd135400640 1 -- 172.21.15.99:0/2098277355 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd130068960 con 0x7fd1301606a0 2024-02-21T23:01:42.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.192+0000 7fd127e00640 1 -- 172.21.15.99:0/2098277355 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 6) v1 ==== 134407+0+0 (secure 0 0 0) 0x7fd12001a070 con 0x7fd1301606a0 2024-02-21T23:01:42.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.193+0000 7fd127e00640 1 --2- 172.21.15.99:0/2098277355 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fd11009edf0 0x7fd1100a12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:42.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.194+0000 7fd127e00640 1 -- 172.21.15.99:0/2098277355 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fd1200c9cc0 con 0x7fd1301606a0 2024-02-21T23:01:42.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.194+0000 7fd12f400640 1 --2- 172.21.15.99:0/2098277355 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fd11009edf0 0x7fd1100a12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:42.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.194+0000 7fd12f400640 1 --2- 172.21.15.99:0/2098277355 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fd11009edf0 0x7fd1100a12b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd13015fec0 tx=0x7fd11c008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:42.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.198+0000 7fd127e00640 1 -- 172.21.15.99:0/2098277355 <== mon.2 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fd130068960 con 0x7fd1301606a0 2024-02-21T23:01:42.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.433+0000 7fd135400640 1 -- 172.21.15.99:0/2098277355 --> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd13017ce90 con 0x7fd11009edf0 2024-02-21T23:01:42.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.443+0000 7fd127e00640 1 -- 172.21.15.99:0/2098277355 <== mgr.4106 v2:172.21.15.162:6800/1717094936 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+338704 (secure 0 0 0) 0x7fd11c037050 con 0x7fd11009edf0 2024-02-21T23:01:42.436 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T23:01:42.438 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-02-21T23:01:42.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.449+0000 7fd135400640 1 -- 172.21.15.99:0/2098277355 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fd11009edf0 msgr2=0x7fd1100a12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:42.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.449+0000 7fd135400640 1 --2- 172.21.15.99:0/2098277355 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fd11009edf0 0x7fd1100a12b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd13015fec0 tx=0x7fd11c008030 comp rx=0 tx=0).stop 2024-02-21T23:01:42.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.449+0000 7fd135400640 1 -- 172.21.15.99:0/2098277355 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd1301606a0 msgr2=0x7fd13017c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:42.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.449+0000 7fd135400640 1 --2- 172.21.15.99:0/2098277355 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd1301606a0 0x7fd13017c950 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd12000e870 tx=0x7fd12000ed30 comp rx=0 tx=0).stop 2024-02-21T23:01:42.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.449+0000 7fd135400640 1 -- 172.21.15.99:0/2098277355 shutdown_connections 2024-02-21T23:01:42.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.449+0000 7fd135400640 1 --2- 172.21.15.99:0/2098277355 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fd11009edf0 0x7fd1100a12b0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:42.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.449+0000 7fd135400640 1 --2- 172.21.15.99:0/2098277355 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd13018b980 0x7fd1302203b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:42.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.449+0000 7fd135400640 1 --2- 172.21.15.99:0/2098277355 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd130182a80 0x7fd1300f54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:42.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.449+0000 7fd135400640 1 --2- 172.21.15.99:0/2098277355 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd1301606a0 0x7fd13017c950 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:42.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.449+0000 7fd135400640 1 -- 172.21.15.99:0/2098277355 >> 172.21.15.99:0/2098277355 conn(0x7fd1300d29f0 msgr2=0x7fd1300d2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:42.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.449+0000 7fd135400640 1 -- 172.21.15.99:0/2098277355 shutdown_connections 2024-02-21T23:01:42.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.449+0000 7fd135400640 1 -- 172.21.15.99:0/2098277355 wait complete. 2024-02-21T23:01:42.454 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2024-02-21T23:01:40.952163+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":641132,"num_objects":64,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":208,"num_read_kb":210,"num_write":336,"num_write_kb":3036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1132462080,"kb_used":328144,"kb_used_data":3952,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1132133936,"statfs":{"total":1159641169920,"available":1159305150464,"internally_reserved":0,"allocated":4046848,"data_stored":3008592,"data_compressed":171314,"data_compressed_allocated":245760,"data_compressed_original":1458176,"omap_allocated":19138,"internal_metadata":331855166},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":46124,"num_objects":40,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":72,"num_read_kb":91,"num_write":106,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003211"},"pg_stats":[{"pgid":"2.1f","version":"29'9","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:32.400697+0000","last_change":"2024-02-21T23:01:02.208441+0000","last_active":"2024-02-21T23:01:32.400697+0000","last_peered":"2024-02-21T23:01:32.400697+0000","last_clean":"2024-02-21T23:01:32.400697+0000","last_became_active":"2024-02-21T23:01:02.208124+0000","last_became_peered":"2024-02-21T23:01:02.208124+0000","last_unstale":"2024-02-21T23:01:32.400697+0000","last_undegraded":"2024-02-21T23:01:32.400697+0000","last_fullsized":"2024-02-21T23:01:32.400697+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:21:29.919968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7],"acting":[9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788787+0000","last_change":"2024-02-21T23:01:03.215149+0000","last_active":"2024-02-21T23:01:08.788787+0000","last_peered":"2024-02-21T23:01:08.788787+0000","last_clean":"2024-02-21T23:01:08.788787+0000","last_became_active":"2024-02-21T23:01:03.214170+0000","last_became_peered":"2024-02-21T23:01:03.214170+0000","last_unstale":"2024-02-21T23:01:08.788787+0000","last_undegraded":"2024-02-21T23:01:08.788787+0000","last_fullsized":"2024-02-21T23:01:08.788787+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:40:26.325368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787271+0000","last_change":"2024-02-21T23:01:07.276484+0000","last_active":"2024-02-21T23:01:08.787271+0000","last_peered":"2024-02-21T23:01:08.787271+0000","last_clean":"2024-02-21T23:01:08.787271+0000","last_became_active":"2024-02-21T23:01:07.276192+0000","last_became_peered":"2024-02-21T23:01:07.276192+0000","last_unstale":"2024-02-21T23:01:08.787271+0000","last_undegraded":"2024-02-21T23:01:08.787271+0000","last_fullsized":"2024-02-21T23:01:08.787271+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:20:59.894677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"29'2","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.789060+0000","last_change":"2024-02-21T23:01:02.221231+0000","last_active":"2024-02-21T23:01:08.789060+0000","last_peered":"2024-02-21T23:01:08.789060+0000","last_clean":"2024-02-21T23:01:08.789060+0000","last_became_active":"2024-02-21T23:01:02.220941+0000","last_became_peered":"2024-02-21T23:01:02.220941+0000","last_unstale":"2024-02-21T23:01:08.789060+0000","last_undegraded":"2024-02-21T23:01:08.789060+0000","last_fullsized":"2024-02-21T23:01:08.789060+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:17:06.353018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.790823+0000","last_change":"2024-02-21T23:01:03.219579+0000","last_active":"2024-02-21T23:01:08.790823+0000","last_peered":"2024-02-21T23:01:08.790823+0000","last_clean":"2024-02-21T23:01:08.790823+0000","last_became_active":"2024-02-21T23:01:03.219221+0000","last_became_peered":"2024-02-21T23:01:03.219221+0000","last_unstale":"2024-02-21T23:01:08.790823+0000","last_undegraded":"2024-02-21T23:01:08.790823+0000","last_fullsized":"2024-02-21T23:01:08.790823+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:41:55.485351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.260372+0000","last_change":"2024-02-21T23:01:07.268590+0000","last_active":"2024-02-21T23:01:08.260372+0000","last_peered":"2024-02-21T23:01:08.260372+0000","last_clean":"2024-02-21T23:01:08.260372+0000","last_became_active":"2024-02-21T23:01:07.268179+0000","last_became_peered":"2024-02-21T23:01:07.268179+0000","last_unstale":"2024-02-21T23:01:08.260372+0000","last_undegraded":"2024-02-21T23:01:08.260372+0000","last_fullsized":"2024-02-21T23:01:08.260372+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:20:59.894677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"29'4","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:32.393628+0000","last_change":"2024-02-21T23:01:02.208687+0000","last_active":"2024-02-21T23:01:32.393628+0000","last_peered":"2024-02-21T23:01:32.393628+0000","last_clean":"2024-02-21T23:01:32.393628+0000","last_became_active":"2024-02-21T23:01:02.208393+0000","last_became_peered":"2024-02-21T23:01:02.208393+0000","last_unstale":"2024-02-21T23:01:32.393628+0000","last_undegraded":"2024-02-21T23:01:32.393628+0000","last_fullsized":"2024-02-21T23:01:32.393628+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:41:54.477462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788050+0000","last_change":"2024-02-21T23:01:03.215676+0000","last_active":"2024-02-21T23:01:08.788050+0000","last_peered":"2024-02-21T23:01:08.788050+0000","last_clean":"2024-02-21T23:01:08.788050+0000","last_became_active":"2024-02-21T23:01:03.214733+0000","last_became_peered":"2024-02-21T23:01:03.214733+0000","last_unstale":"2024-02-21T23:01:08.788050+0000","last_undegraded":"2024-02-21T23:01:08.788050+0000","last_fullsized":"2024-02-21T23:01:08.788050+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:16.946152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.260361+0000","last_change":"2024-02-21T23:01:07.279763+0000","last_active":"2024-02-21T23:01:08.260361+0000","last_peered":"2024-02-21T23:01:08.260361+0000","last_clean":"2024-02-21T23:01:08.260361+0000","last_became_active":"2024-02-21T23:01:07.279360+0000","last_became_peered":"2024-02-21T23:01:07.279360+0000","last_unstale":"2024-02-21T23:01:08.260361+0000","last_undegraded":"2024-02-21T23:01:08.260361+0000","last_fullsized":"2024-02-21T23:01:08.260361+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:40:30.373445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.261319+0000","last_change":"2024-02-21T23:01:02.204774+0000","last_active":"2024-02-21T23:01:08.261319+0000","last_peered":"2024-02-21T23:01:08.261319+0000","last_clean":"2024-02-21T23:01:08.261319+0000","last_became_active":"2024-02-21T23:01:02.203992+0000","last_became_peered":"2024-02-21T23:01:02.203992+0000","last_unstale":"2024-02-21T23:01:08.261319+0000","last_undegraded":"2024-02-21T23:01:08.261319+0000","last_fullsized":"2024-02-21T23:01:08.261319+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:27:54.333439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1],"acting":[8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788339+0000","last_change":"2024-02-21T23:01:03.213022+0000","last_active":"2024-02-21T23:01:08.788339+0000","last_peered":"2024-02-21T23:01:08.788339+0000","last_clean":"2024-02-21T23:01:08.788339+0000","last_became_active":"2024-02-21T23:01:03.212702+0000","last_became_peered":"2024-02-21T23:01:03.212702+0000","last_unstale":"2024-02-21T23:01:08.788339+0000","last_undegraded":"2024-02-21T23:01:08.788339+0000","last_fullsized":"2024-02-21T23:01:08.788339+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:19:01.584139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.260441+0000","last_change":"2024-02-21T23:01:07.268800+0000","last_active":"2024-02-21T23:01:08.260441+0000","last_peered":"2024-02-21T23:01:08.260441+0000","last_clean":"2024-02-21T23:01:08.260441+0000","last_became_active":"2024-02-21T23:01:07.268357+0000","last_became_peered":"2024-02-21T23:01:07.268357+0000","last_unstale":"2024-02-21T23:01:08.260441+0000","last_undegraded":"2024-02-21T23:01:08.260441+0000","last_fullsized":"2024-02-21T23:01:08.260441+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:39:03.021559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787642+0000","last_change":"2024-02-21T23:01:03.213517+0000","last_active":"2024-02-21T23:01:08.787642+0000","last_peered":"2024-02-21T23:01:08.787642+0000","last_clean":"2024-02-21T23:01:08.787642+0000","last_became_active":"2024-02-21T23:01:03.213186+0000","last_became_peered":"2024-02-21T23:01:03.213186+0000","last_unstale":"2024-02-21T23:01:08.787642+0000","last_undegraded":"2024-02-21T23:01:08.787642+0000","last_fullsized":"2024-02-21T23:01:08.787642+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:40:26.325368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"29'4","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:31.383302+0000","last_change":"2024-02-21T23:01:02.208608+0000","last_active":"2024-02-21T23:01:31.383302+0000","last_peered":"2024-02-21T23:01:31.383302+0000","last_clean":"2024-02-21T23:01:31.383302+0000","last_became_active":"2024-02-21T23:01:02.208293+0000","last_became_peered":"2024-02-21T23:01:02.208293+0000","last_unstale":"2024-02-21T23:01:31.383302+0000","last_undegraded":"2024-02-21T23:01:31.383302+0000","last_fullsized":"2024-02-21T23:01:31.383302+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:58:23.554457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.260663+0000","last_change":"2024-02-21T23:01:07.651717+0000","last_active":"2024-02-21T23:01:08.260663+0000","last_peered":"2024-02-21T23:01:08.260663+0000","last_clean":"2024-02-21T23:01:08.260663+0000","last_became_active":"2024-02-21T23:01:07.651241+0000","last_became_peered":"2024-02-21T23:01:07.651241+0000","last_unstale":"2024-02-21T23:01:08.260663+0000","last_undegraded":"2024-02-21T23:01:08.260663+0000","last_fullsized":"2024-02-21T23:01:08.260663+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:54:44.380302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.791024+0000","last_change":"2024-02-21T23:01:03.221678+0000","last_active":"2024-02-21T23:01:08.791024+0000","last_peered":"2024-02-21T23:01:08.791024+0000","last_clean":"2024-02-21T23:01:08.791024+0000","last_became_active":"2024-02-21T23:01:03.219898+0000","last_became_peered":"2024-02-21T23:01:03.219898+0000","last_unstale":"2024-02-21T23:01:08.791024+0000","last_undegraded":"2024-02-21T23:01:08.791024+0000","last_fullsized":"2024-02-21T23:01:08.791024+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:47:19.366266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"29'1","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788675+0000","last_change":"2024-02-21T23:01:02.202866+0000","last_active":"2024-02-21T23:01:08.788675+0000","last_peered":"2024-02-21T23:01:08.788675+0000","last_clean":"2024-02-21T23:01:08.788675+0000","last_became_active":"2024-02-21T23:01:02.202585+0000","last_became_peered":"2024-02-21T23:01:02.202585+0000","last_unstale":"2024-02-21T23:01:08.788675+0000","last_undegraded":"2024-02-21T23:01:08.788675+0000","last_fullsized":"2024-02-21T23:01:08.788675+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:26:49.911102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"29'1","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:10.770295+0000","last_change":"2024-02-21T23:01:07.277000+0000","last_active":"2024-02-21T23:01:10.770295+0000","last_peered":"2024-02-21T23:01:10.770295+0000","last_clean":"2024-02-21T23:01:10.770295+0000","last_became_active":"2024-02-21T23:01:07.276577+0000","last_became_peered":"2024-02-21T23:01:07.276577+0000","last_unstale":"2024-02-21T23:01:10.770295+0000","last_undegraded":"2024-02-21T23:01:10.770295+0000","last_fullsized":"2024-02-21T23:01:10.770295+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:15:20.572234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787437+0000","last_change":"2024-02-21T23:01:03.219045+0000","last_active":"2024-02-21T23:01:08.787437+0000","last_peered":"2024-02-21T23:01:08.787437+0000","last_clean":"2024-02-21T23:01:08.787437+0000","last_became_active":"2024-02-21T23:01:03.218706+0000","last_became_peered":"2024-02-21T23:01:03.218706+0000","last_unstale":"2024-02-21T23:01:08.787437+0000","last_undegraded":"2024-02-21T23:01:08.787437+0000","last_fullsized":"2024-02-21T23:01:08.787437+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:41:55.485351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"29'3","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:31.386013+0000","last_change":"2024-02-21T23:01:02.208912+0000","last_active":"2024-02-21T23:01:31.386013+0000","last_peered":"2024-02-21T23:01:31.386013+0000","last_clean":"2024-02-21T23:01:31.386013+0000","last_became_active":"2024-02-21T23:01:02.208542+0000","last_became_peered":"2024-02-21T23:01:02.208542+0000","last_unstale":"2024-02-21T23:01:31.386013+0000","last_undegraded":"2024-02-21T23:01:31.386013+0000","last_fullsized":"2024-02-21T23:01:31.386013+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:02:11.724233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9],"acting":[3,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788774+0000","last_change":"2024-02-21T23:01:07.282882+0000","last_active":"2024-02-21T23:01:08.788774+0000","last_peered":"2024-02-21T23:01:08.788774+0000","last_clean":"2024-02-21T23:01:08.788774+0000","last_became_active":"2024-02-21T23:01:07.282506+0000","last_became_peered":"2024-02-21T23:01:07.282506+0000","last_unstale":"2024-02-21T23:01:08.788774+0000","last_undegraded":"2024-02-21T23:01:08.788774+0000","last_fullsized":"2024-02-21T23:01:08.788774+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:19:05.632217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.260935+0000","last_change":"2024-02-21T23:01:03.212206+0000","last_active":"2024-02-21T23:01:08.260935+0000","last_peered":"2024-02-21T23:01:08.260935+0000","last_clean":"2024-02-21T23:01:08.260935+0000","last_became_active":"2024-02-21T23:01:03.211919+0000","last_became_peered":"2024-02-21T23:01:03.211919+0000","last_unstale":"2024-02-21T23:01:08.260935+0000","last_undegraded":"2024-02-21T23:01:08.260935+0000","last_fullsized":"2024-02-21T23:01:08.260935+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:20:55.846599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"29'2","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:31.383055+0000","last_change":"2024-02-21T23:01:02.204071+0000","last_active":"2024-02-21T23:01:31.383055+0000","last_peered":"2024-02-21T23:01:31.383055+0000","last_clean":"2024-02-21T23:01:31.383055+0000","last_became_active":"2024-02-21T23:01:02.203761+0000","last_became_peered":"2024-02-21T23:01:02.203761+0000","last_unstale":"2024-02-21T23:01:31.383055+0000","last_undegraded":"2024-02-21T23:01:31.383055+0000","last_fullsized":"2024-02-21T23:01:31.383055+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:58:34.737670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.260696+0000","last_change":"2024-02-21T23:01:07.654580+0000","last_active":"2024-02-21T23:01:08.260696+0000","last_peered":"2024-02-21T23:01:08.260696+0000","last_clean":"2024-02-21T23:01:08.260696+0000","last_became_active":"2024-02-21T23:01:07.654124+0000","last_became_peered":"2024-02-21T23:01:07.654124+0000","last_unstale":"2024-02-21T23:01:08.260696+0000","last_undegraded":"2024-02-21T23:01:08.260696+0000","last_fullsized":"2024-02-21T23:01:08.260696+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:44:43.960074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.790389+0000","last_change":"2024-02-21T23:01:03.230134+0000","last_active":"2024-02-21T23:01:08.790389+0000","last_peered":"2024-02-21T23:01:08.790389+0000","last_clean":"2024-02-21T23:01:08.790389+0000","last_became_active":"2024-02-21T23:01:03.229873+0000","last_became_peered":"2024-02-21T23:01:03.229873+0000","last_unstale":"2024-02-21T23:01:08.790389+0000","last_undegraded":"2024-02-21T23:01:08.790389+0000","last_fullsized":"2024-02-21T23:01:08.790389+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:16.946152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"29'4","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:31.382861+0000","last_change":"2024-02-21T23:01:02.206586+0000","last_active":"2024-02-21T23:01:31.382861+0000","last_peered":"2024-02-21T23:01:31.382861+0000","last_clean":"2024-02-21T23:01:31.382861+0000","last_became_active":"2024-02-21T23:01:02.206230+0000","last_became_peered":"2024-02-21T23:01:02.206230+0000","last_unstale":"2024-02-21T23:01:31.382861+0000","last_undegraded":"2024-02-21T23:01:31.382861+0000","last_fullsized":"2024-02-21T23:01:31.382861+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:21:29.919968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11],"acting":[4,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788500+0000","last_change":"2024-02-21T23:01:07.252255+0000","last_active":"2024-02-21T23:01:08.788500+0000","last_peered":"2024-02-21T23:01:08.788500+0000","last_clean":"2024-02-21T23:01:08.788500+0000","last_became_active":"2024-02-21T23:01:07.251670+0000","last_became_peered":"2024-02-21T23:01:07.251670+0000","last_unstale":"2024-02-21T23:01:08.788500+0000","last_undegraded":"2024-02-21T23:01:08.788500+0000","last_fullsized":"2024-02-21T23:01:08.788500+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:39:03.021559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.789113+0000","last_change":"2024-02-21T23:01:03.207156+0000","last_active":"2024-02-21T23:01:08.789113+0000","last_peered":"2024-02-21T23:01:08.789113+0000","last_clean":"2024-02-21T23:01:08.789113+0000","last_became_active":"2024-02-21T23:01:03.206892+0000","last_became_peered":"2024-02-21T23:01:03.206892+0000","last_unstale":"2024-02-21T23:01:08.789113+0000","last_undegraded":"2024-02-21T23:01:08.789113+0000","last_fullsized":"2024-02-21T23:01:08.789113+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:19:01.584139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"29'8","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:38.217145+0000","last_change":"2024-02-21T23:01:02.209850+0000","last_active":"2024-02-21T23:01:38.217145+0000","last_peered":"2024-02-21T23:01:38.217145+0000","last_clean":"2024-02-21T23:01:38.217145+0000","last_became_active":"2024-02-21T23:01:02.209601+0000","last_became_peered":"2024-02-21T23:01:02.209601+0000","last_unstale":"2024-02-21T23:01:38.217145+0000","last_undegraded":"2024-02-21T23:01:38.217145+0000","last_fullsized":"2024-02-21T23:01:38.217145+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:36:44.497886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.789246+0000","last_change":"2024-02-21T23:01:07.651884+0000","last_active":"2024-02-21T23:01:08.789246+0000","last_peered":"2024-02-21T23:01:08.789246+0000","last_clean":"2024-02-21T23:01:08.789246+0000","last_became_active":"2024-02-21T23:01:07.651431+0000","last_became_peered":"2024-02-21T23:01:07.651431+0000","last_unstale":"2024-02-21T23:01:08.789246+0000","last_undegraded":"2024-02-21T23:01:08.789246+0000","last_fullsized":"2024-02-21T23:01:08.789246+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:37:06.063756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.263969+0000","last_change":"2024-02-21T23:01:03.221696+0000","last_active":"2024-02-21T23:01:08.263969+0000","last_peered":"2024-02-21T23:01:08.263969+0000","last_clean":"2024-02-21T23:01:08.263969+0000","last_became_active":"2024-02-21T23:01:03.221405+0000","last_became_peered":"2024-02-21T23:01:03.221405+0000","last_unstale":"2024-02-21T23:01:08.263969+0000","last_undegraded":"2024-02-21T23:01:08.263969+0000","last_fullsized":"2024-02-21T23:01:08.263969+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:45:29.610700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"29'1","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:31.383443+0000","last_change":"2024-02-21T23:01:02.221218+0000","last_active":"2024-02-21T23:01:31.383443+0000","last_peered":"2024-02-21T23:01:31.383443+0000","last_clean":"2024-02-21T23:01:31.383443+0000","last_became_active":"2024-02-21T23:01:02.220923+0000","last_became_peered":"2024-02-21T23:01:02.220923+0000","last_unstale":"2024-02-21T23:01:31.383443+0000","last_undegraded":"2024-02-21T23:01:31.383443+0000","last_fullsized":"2024-02-21T23:01:31.383443+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:15.938263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787672+0000","last_change":"2024-02-21T23:01:07.268952+0000","last_active":"2024-02-21T23:01:08.787672+0000","last_peered":"2024-02-21T23:01:08.787672+0000","last_clean":"2024-02-21T23:01:08.787672+0000","last_became_active":"2024-02-21T23:01:07.268210+0000","last_became_peered":"2024-02-21T23:01:07.268210+0000","last_unstale":"2024-02-21T23:01:08.787672+0000","last_undegraded":"2024-02-21T23:01:08.787672+0000","last_fullsized":"2024-02-21T23:01:08.787672+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:40:30.373445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.790112+0000","last_change":"2024-02-21T23:01:03.218386+0000","last_active":"2024-02-21T23:01:08.790112+0000","last_peered":"2024-02-21T23:01:08.790112+0000","last_clean":"2024-02-21T23:01:08.790112+0000","last_became_active":"2024-02-21T23:01:03.218081+0000","last_became_peered":"2024-02-21T23:01:03.218081+0000","last_unstale":"2024-02-21T23:01:08.790112+0000","last_undegraded":"2024-02-21T23:01:08.790112+0000","last_fullsized":"2024-02-21T23:01:08.790112+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:35:24.590398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788427+0000","last_change":"2024-02-21T23:01:02.207826+0000","last_active":"2024-02-21T23:01:08.788427+0000","last_peered":"2024-02-21T23:01:08.788427+0000","last_clean":"2024-02-21T23:01:08.788427+0000","last_became_active":"2024-02-21T23:01:02.206426+0000","last_became_peered":"2024-02-21T23:01:02.206426+0000","last_unstale":"2024-02-21T23:01:08.788427+0000","last_undegraded":"2024-02-21T23:01:08.788427+0000","last_fullsized":"2024-02-21T23:01:08.788427+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:17:06.353018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2],"acting":[9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.261110+0000","last_change":"2024-02-21T23:01:07.651876+0000","last_active":"2024-02-21T23:01:08.261110+0000","last_peered":"2024-02-21T23:01:08.261110+0000","last_clean":"2024-02-21T23:01:08.261110+0000","last_became_active":"2024-02-21T23:01:07.651384+0000","last_became_peered":"2024-02-21T23:01:07.651384+0000","last_unstale":"2024-02-21T23:01:08.261110+0000","last_undegraded":"2024-02-21T23:01:08.261110+0000","last_fullsized":"2024-02-21T23:01:08.261110+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:15:20.572234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.789861+0000","last_change":"2024-02-21T23:01:03.210500+0000","last_active":"2024-02-21T23:01:08.789861+0000","last_peered":"2024-02-21T23:01:08.789861+0000","last_clean":"2024-02-21T23:01:08.789861+0000","last_became_active":"2024-02-21T23:01:03.210123+0000","last_became_peered":"2024-02-21T23:01:03.210123+0000","last_unstale":"2024-02-21T23:01:08.789861+0000","last_undegraded":"2024-02-21T23:01:08.789861+0000","last_fullsized":"2024-02-21T23:01:08.789861+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:16.946152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4],"acting":[10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"29'1","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787791+0000","last_change":"2024-02-21T23:01:02.217455+0000","last_active":"2024-02-21T23:01:08.787791+0000","last_peered":"2024-02-21T23:01:08.787791+0000","last_clean":"2024-02-21T23:01:08.787791+0000","last_became_active":"2024-02-21T23:01:02.217128+0000","last_became_peered":"2024-02-21T23:01:02.217128+0000","last_unstale":"2024-02-21T23:01:08.787791+0000","last_undegraded":"2024-02-21T23:01:08.787791+0000","last_fullsized":"2024-02-21T23:01:08.787791+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:23:41.295647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.264021+0000","last_change":"2024-02-21T23:01:07.266837+0000","last_active":"2024-02-21T23:01:08.264021+0000","last_peered":"2024-02-21T23:01:08.264021+0000","last_clean":"2024-02-21T23:01:08.264021+0000","last_became_active":"2024-02-21T23:01:07.266376+0000","last_became_peered":"2024-02-21T23:01:07.266376+0000","last_unstale":"2024-02-21T23:01:08.264021+0000","last_undegraded":"2024-02-21T23:01:08.264021+0000","last_fullsized":"2024-02-21T23:01:08.264021+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:15:20.572234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787245+0000","last_change":"2024-02-21T23:01:03.212345+0000","last_active":"2024-02-21T23:01:08.787245+0000","last_peered":"2024-02-21T23:01:08.787245+0000","last_clean":"2024-02-21T23:01:08.787245+0000","last_became_active":"2024-02-21T23:01:03.212019+0000","last_became_peered":"2024-02-21T23:01:03.212019+0000","last_unstale":"2024-02-21T23:01:08.787245+0000","last_undegraded":"2024-02-21T23:01:08.787245+0000","last_fullsized":"2024-02-21T23:01:08.787245+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:20:55.846599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"29'4","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:39.409952+0000","last_change":"2024-02-21T23:01:02.219033+0000","last_active":"2024-02-21T23:01:39.409952+0000","last_peered":"2024-02-21T23:01:39.409952+0000","last_clean":"2024-02-21T23:01:39.409952+0000","last_became_active":"2024-02-21T23:01:02.218570+0000","last_became_peered":"2024-02-21T23:01:02.218570+0000","last_unstale":"2024-02-21T23:01:39.409952+0000","last_undegraded":"2024-02-21T23:01:39.409952+0000","last_fullsized":"2024-02-21T23:01:39.409952+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:21:29.919968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.264680+0000","last_change":"2024-02-21T23:01:07.654407+0000","last_active":"2024-02-21T23:01:08.264680+0000","last_peered":"2024-02-21T23:01:08.264680+0000","last_clean":"2024-02-21T23:01:08.264680+0000","last_became_active":"2024-02-21T23:01:07.653745+0000","last_became_peered":"2024-02-21T23:01:07.653745+0000","last_unstale":"2024-02-21T23:01:08.264680+0000","last_undegraded":"2024-02-21T23:01:08.264680+0000","last_fullsized":"2024-02-21T23:01:08.264680+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:54:44.380302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.262891+0000","last_change":"2024-02-21T23:01:03.226352+0000","last_active":"2024-02-21T23:01:08.262891+0000","last_peered":"2024-02-21T23:01:08.262891+0000","last_clean":"2024-02-21T23:01:08.262891+0000","last_became_active":"2024-02-21T23:01:03.219834+0000","last_became_peered":"2024-02-21T23:01:03.219834+0000","last_unstale":"2024-02-21T23:01:08.262891+0000","last_undegraded":"2024-02-21T23:01:08.262891+0000","last_fullsized":"2024-02-21T23:01:08.262891+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:16.946152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"29'3","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:32.400219+0000","last_change":"2024-02-21T23:01:02.207052+0000","last_active":"2024-02-21T23:01:32.400219+0000","last_peered":"2024-02-21T23:01:32.400219+0000","last_clean":"2024-02-21T23:01:32.400219+0000","last_became_active":"2024-02-21T23:01:02.206146+0000","last_became_peered":"2024-02-21T23:01:02.206146+0000","last_unstale":"2024-02-21T23:01:32.400219+0000","last_undegraded":"2024-02-21T23:01:32.400219+0000","last_fullsized":"2024-02-21T23:01:32.400219+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:26:49.911102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788291+0000","last_change":"2024-02-21T23:01:07.654449+0000","last_active":"2024-02-21T23:01:08.788291+0000","last_peered":"2024-02-21T23:01:08.788291+0000","last_clean":"2024-02-21T23:01:08.788291+0000","last_became_active":"2024-02-21T23:01:07.654106+0000","last_became_peered":"2024-02-21T23:01:07.654106+0000","last_unstale":"2024-02-21T23:01:08.788291+0000","last_undegraded":"2024-02-21T23:01:08.788291+0000","last_fullsized":"2024-02-21T23:01:08.788291+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:13:22.732077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788911+0000","last_change":"2024-02-21T23:01:03.209260+0000","last_active":"2024-02-21T23:01:08.788911+0000","last_peered":"2024-02-21T23:01:08.788911+0000","last_clean":"2024-02-21T23:01:08.788911+0000","last_became_active":"2024-02-21T23:01:03.209007+0000","last_became_peered":"2024-02-21T23:01:03.209007+0000","last_unstale":"2024-02-21T23:01:08.788911+0000","last_undegraded":"2024-02-21T23:01:08.788911+0000","last_fullsized":"2024-02-21T23:01:08.788911+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:54:32.196725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"29'3","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:33.394582+0000","last_change":"2024-02-21T23:01:02.203395+0000","last_active":"2024-02-21T23:01:33.394582+0000","last_peered":"2024-02-21T23:01:33.394582+0000","last_clean":"2024-02-21T23:01:33.394582+0000","last_became_active":"2024-02-21T23:01:02.203066+0000","last_became_peered":"2024-02-21T23:01:02.203066+0000","last_unstale":"2024-02-21T23:01:33.394582+0000","last_undegraded":"2024-02-21T23:01:33.394582+0000","last_fullsized":"2024-02-21T23:01:33.394582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:26:49.911102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":211,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787659+0000","last_change":"2024-02-21T23:00:58.830752+0000","last_active":"2024-02-21T23:01:08.787659+0000","last_peered":"2024-02-21T23:01:08.787659+0000","last_clean":"2024-02-21T23:01:08.787659+0000","last_became_active":"2024-02-21T23:00:58.830472+0000","last_became_peered":"2024-02-21T23:00:58.830472+0000","last_unstale":"2024-02-21T23:01:08.787659+0000","last_undegraded":"2024-02-21T23:01:08.787659+0000","last_fullsized":"2024-02-21T23:01:08.787659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:00:57.811198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:00:57.811198+0000","last_clean_scrub_stamp":"2024-02-21T23:00:57.811198+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:58:31.374266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"29'1","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:10.774025+0000","last_change":"2024-02-21T23:01:07.276992+0000","last_active":"2024-02-21T23:01:10.774025+0000","last_peered":"2024-02-21T23:01:10.774025+0000","last_clean":"2024-02-21T23:01:10.774025+0000","last_became_active":"2024-02-21T23:01:07.276489+0000","last_became_peered":"2024-02-21T23:01:07.276489+0000","last_unstale":"2024-02-21T23:01:10.774025+0000","last_undegraded":"2024-02-21T23:01:10.774025+0000","last_fullsized":"2024-02-21T23:01:10.774025+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:02:35.072200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788021+0000","last_change":"2024-02-21T23:01:03.216192+0000","last_active":"2024-02-21T23:01:08.788021+0000","last_peered":"2024-02-21T23:01:08.788021+0000","last_clean":"2024-02-21T23:01:08.788021+0000","last_became_active":"2024-02-21T23:01:03.215904+0000","last_became_peered":"2024-02-21T23:01:03.215904+0000","last_unstale":"2024-02-21T23:01:08.788021+0000","last_undegraded":"2024-02-21T23:01:08.788021+0000","last_fullsized":"2024-02-21T23:01:08.788021+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:15:16.524157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"29'3","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:32.394144+0000","last_change":"2024-02-21T23:01:02.207406+0000","last_active":"2024-02-21T23:01:32.394144+0000","last_peered":"2024-02-21T23:01:32.394144+0000","last_clean":"2024-02-21T23:01:32.394144+0000","last_became_active":"2024-02-21T23:01:02.206219+0000","last_became_peered":"2024-02-21T23:01:02.206219+0000","last_unstale":"2024-02-21T23:01:32.394144+0000","last_undegraded":"2024-02-21T23:01:32.394144+0000","last_fullsized":"2024-02-21T23:01:32.394144+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:21:29.919968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11],"acting":[2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787626+0000","last_change":"2024-02-21T23:01:07.265822+0000","last_active":"2024-02-21T23:01:08.787626+0000","last_peered":"2024-02-21T23:01:08.787626+0000","last_clean":"2024-02-21T23:01:08.787626+0000","last_became_active":"2024-02-21T23:01:07.265401+0000","last_became_peered":"2024-02-21T23:01:07.265401+0000","last_unstale":"2024-02-21T23:01:08.787626+0000","last_undegraded":"2024-02-21T23:01:08.787626+0000","last_fullsized":"2024-02-21T23:01:08.787626+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:47:23.414344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787838+0000","last_change":"2024-02-21T23:01:03.220586+0000","last_active":"2024-02-21T23:01:08.787838+0000","last_peered":"2024-02-21T23:01:08.787838+0000","last_clean":"2024-02-21T23:01:08.787838+0000","last_became_active":"2024-02-21T23:01:03.220349+0000","last_became_peered":"2024-02-21T23:01:03.220349+0000","last_unstale":"2024-02-21T23:01:08.787838+0000","last_undegraded":"2024-02-21T23:01:08.787838+0000","last_fullsized":"2024-02-21T23:01:08.787838+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:20:55.846599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788533+0000","last_change":"2024-02-21T23:01:02.206319+0000","last_active":"2024-02-21T23:01:08.788533+0000","last_peered":"2024-02-21T23:01:08.788533+0000","last_clean":"2024-02-21T23:01:08.788533+0000","last_became_active":"2024-02-21T23:01:02.205747+0000","last_became_peered":"2024-02-21T23:01:02.205747+0000","last_unstale":"2024-02-21T23:01:08.788533+0000","last_undegraded":"2024-02-21T23:01:08.788533+0000","last_fullsized":"2024-02-21T23:01:08.788533+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:10:09.680115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10],"acting":[5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.789983+0000","last_change":"2024-02-21T23:01:07.280592+0000","last_active":"2024-02-21T23:01:08.789983+0000","last_peered":"2024-02-21T23:01:08.789983+0000","last_clean":"2024-02-21T23:01:08.789983+0000","last_became_active":"2024-02-21T23:01:07.280193+0000","last_became_peered":"2024-02-21T23:01:07.280193+0000","last_unstale":"2024-02-21T23:01:08.789983+0000","last_undegraded":"2024-02-21T23:01:08.789983+0000","last_fullsized":"2024-02-21T23:01:08.789983+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:40:30.373445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788267+0000","last_change":"2024-02-21T23:01:03.216834+0000","last_active":"2024-02-21T23:01:08.788267+0000","last_peered":"2024-02-21T23:01:08.788267+0000","last_clean":"2024-02-21T23:01:08.788267+0000","last_became_active":"2024-02-21T23:01:03.216578+0000","last_became_peered":"2024-02-21T23:01:03.216578+0000","last_unstale":"2024-02-21T23:01:08.788267+0000","last_undegraded":"2024-02-21T23:01:08.788267+0000","last_fullsized":"2024-02-21T23:01:08.788267+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:37:02.015678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.264532+0000","last_change":"2024-02-21T23:01:02.220913+0000","last_active":"2024-02-21T23:01:08.264532+0000","last_peered":"2024-02-21T23:01:08.264532+0000","last_clean":"2024-02-21T23:01:08.264532+0000","last_became_active":"2024-02-21T23:01:02.220554+0000","last_became_peered":"2024-02-21T23:01:02.220554+0000","last_unstale":"2024-02-21T23:01:08.264532+0000","last_undegraded":"2024-02-21T23:01:08.264532+0000","last_fullsized":"2024-02-21T23:01:08.264532+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:36:44.497886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787182+0000","last_change":"2024-02-21T23:01:07.257431+0000","last_active":"2024-02-21T23:01:08.787182+0000","last_peered":"2024-02-21T23:01:08.787182+0000","last_clean":"2024-02-21T23:01:08.787182+0000","last_became_active":"2024-02-21T23:01:07.257011+0000","last_became_peered":"2024-02-21T23:01:07.257011+0000","last_unstale":"2024-02-21T23:01:08.787182+0000","last_undegraded":"2024-02-21T23:01:08.787182+0000","last_fullsized":"2024-02-21T23:01:08.787182+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:44:43.960074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787848+0000","last_change":"2024-02-21T23:01:03.211792+0000","last_active":"2024-02-21T23:01:08.787848+0000","last_peered":"2024-02-21T23:01:08.787848+0000","last_clean":"2024-02-21T23:01:08.787848+0000","last_became_active":"2024-02-21T23:01:03.211467+0000","last_became_peered":"2024-02-21T23:01:03.211467+0000","last_unstale":"2024-02-21T23:01:08.787848+0000","last_undegraded":"2024-02-21T23:01:08.787848+0000","last_fullsized":"2024-02-21T23:01:08.787848+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:54:32.196725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"29'2","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:33.392458+0000","last_change":"2024-02-21T23:01:02.211763+0000","last_active":"2024-02-21T23:01:33.392458+0000","last_peered":"2024-02-21T23:01:33.392458+0000","last_clean":"2024-02-21T23:01:33.392458+0000","last_became_active":"2024-02-21T23:01:02.211470+0000","last_became_peered":"2024-02-21T23:01:02.211470+0000","last_unstale":"2024-02-21T23:01:33.392458+0000","last_undegraded":"2024-02-21T23:01:33.392458+0000","last_fullsized":"2024-02-21T23:01:33.392458+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:23:41.295647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5],"acting":[8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787817+0000","last_change":"2024-02-21T23:01:07.269076+0000","last_active":"2024-02-21T23:01:08.787817+0000","last_peered":"2024-02-21T23:01:08.787817+0000","last_clean":"2024-02-21T23:01:08.787817+0000","last_became_active":"2024-02-21T23:01:07.268681+0000","last_became_peered":"2024-02-21T23:01:07.268681+0000","last_unstale":"2024-02-21T23:01:08.787817+0000","last_undegraded":"2024-02-21T23:01:08.787817+0000","last_fullsized":"2024-02-21T23:01:08.787817+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:02:35.072200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787945+0000","last_change":"2024-02-21T23:01:03.212943+0000","last_active":"2024-02-21T23:01:08.787945+0000","last_peered":"2024-02-21T23:01:08.787945+0000","last_clean":"2024-02-21T23:01:08.787945+0000","last_became_active":"2024-02-21T23:01:03.212634+0000","last_became_peered":"2024-02-21T23:01:03.212634+0000","last_unstale":"2024-02-21T23:01:08.787945+0000","last_undegraded":"2024-02-21T23:01:08.787945+0000","last_fullsized":"2024-02-21T23:01:08.787945+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:07:50.626867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"29'15","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:32.399647+0000","last_change":"2024-02-21T23:01:02.221957+0000","last_active":"2024-02-21T23:01:32.399647+0000","last_peered":"2024-02-21T23:01:32.399647+0000","last_clean":"2024-02-21T23:01:32.399647+0000","last_became_active":"2024-02-21T23:01:02.221642+0000","last_became_peered":"2024-02-21T23:01:02.221642+0000","last_unstale":"2024-02-21T23:01:32.399647+0000","last_undegraded":"2024-02-21T23:01:32.399647+0000","last_fullsized":"2024-02-21T23:01:32.399647+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:10:09.680115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.264659+0000","last_change":"2024-02-21T23:01:07.268330+0000","last_active":"2024-02-21T23:01:08.264659+0000","last_peered":"2024-02-21T23:01:08.264659+0000","last_clean":"2024-02-21T23:01:08.264659+0000","last_became_active":"2024-02-21T23:01:07.267874+0000","last_became_peered":"2024-02-21T23:01:07.267874+0000","last_unstale":"2024-02-21T23:01:08.264659+0000","last_undegraded":"2024-02-21T23:01:08.264659+0000","last_fullsized":"2024-02-21T23:01:08.264659+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:37:06.063756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787335+0000","last_change":"2024-02-21T23:01:03.216774+0000","last_active":"2024-02-21T23:01:08.787335+0000","last_peered":"2024-02-21T23:01:08.787335+0000","last_clean":"2024-02-21T23:01:08.787335+0000","last_became_active":"2024-02-21T23:01:03.216466+0000","last_became_peered":"2024-02-21T23:01:03.216466+0000","last_unstale":"2024-02-21T23:01:08.787335+0000","last_undegraded":"2024-02-21T23:01:08.787335+0000","last_fullsized":"2024-02-21T23:01:08.787335+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:07:50.626867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"29'3","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:39.410484+0000","last_change":"2024-02-21T23:01:02.199060+0000","last_active":"2024-02-21T23:01:39.410484+0000","last_peered":"2024-02-21T23:01:39.410484+0000","last_clean":"2024-02-21T23:01:39.410484+0000","last_became_active":"2024-02-21T23:01:02.198709+0000","last_became_peered":"2024-02-21T23:01:02.198709+0000","last_unstale":"2024-02-21T23:01:39.410484+0000","last_undegraded":"2024-02-21T23:01:39.410484+0000","last_fullsized":"2024-02-21T23:01:39.410484+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:36:44.497886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788751+0000","last_change":"2024-02-21T23:01:07.278031+0000","last_active":"2024-02-21T23:01:08.788751+0000","last_peered":"2024-02-21T23:01:08.788751+0000","last_clean":"2024-02-21T23:01:08.788751+0000","last_became_active":"2024-02-21T23:01:07.277289+0000","last_became_peered":"2024-02-21T23:01:07.277289+0000","last_unstale":"2024-02-21T23:01:08.788751+0000","last_undegraded":"2024-02-21T23:01:08.788751+0000","last_fullsized":"2024-02-21T23:01:08.788751+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:07:54.674944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787653+0000","last_change":"2024-02-21T23:01:03.214805+0000","last_active":"2024-02-21T23:01:08.787653+0000","last_peered":"2024-02-21T23:01:08.787653+0000","last_clean":"2024-02-21T23:01:08.787653+0000","last_became_active":"2024-02-21T23:01:03.214507+0000","last_became_peered":"2024-02-21T23:01:03.214507+0000","last_unstale":"2024-02-21T23:01:08.787653+0000","last_undegraded":"2024-02-21T23:01:08.787653+0000","last_fullsized":"2024-02-21T23:01:08.787653+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:38:58.973481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"29'3","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:31.386164+0000","last_change":"2024-02-21T23:01:02.209351+0000","last_active":"2024-02-21T23:01:31.386164+0000","last_peered":"2024-02-21T23:01:31.386164+0000","last_clean":"2024-02-21T23:01:31.386164+0000","last_became_active":"2024-02-21T23:01:02.208990+0000","last_became_peered":"2024-02-21T23:01:02.208990+0000","last_unstale":"2024-02-21T23:01:31.386164+0000","last_undegraded":"2024-02-21T23:01:31.386164+0000","last_fullsized":"2024-02-21T23:01:31.386164+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:36:44.497886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787720+0000","last_change":"2024-02-21T23:01:07.280069+0000","last_active":"2024-02-21T23:01:08.787720+0000","last_peered":"2024-02-21T23:01:08.787720+0000","last_clean":"2024-02-21T23:01:08.787720+0000","last_became_active":"2024-02-21T23:01:07.279657+0000","last_became_peered":"2024-02-21T23:01:07.279657+0000","last_unstale":"2024-02-21T23:01:08.787720+0000","last_undegraded":"2024-02-21T23:01:08.787720+0000","last_fullsized":"2024-02-21T23:01:08.787720+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:19:05.632217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.263316+0000","last_change":"2024-02-21T23:01:03.226321+0000","last_active":"2024-02-21T23:01:08.263316+0000","last_peered":"2024-02-21T23:01:08.263316+0000","last_clean":"2024-02-21T23:01:08.263316+0000","last_became_active":"2024-02-21T23:01:03.224451+0000","last_became_peered":"2024-02-21T23:01:03.224451+0000","last_unstale":"2024-02-21T23:01:08.263316+0000","last_undegraded":"2024-02-21T23:01:08.263316+0000","last_fullsized":"2024-02-21T23:01:08.263316+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:35:24.590398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"29'6","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:32.393944+0000","last_change":"2024-02-21T23:01:02.203410+0000","last_active":"2024-02-21T23:01:32.393944+0000","last_peered":"2024-02-21T23:01:32.393944+0000","last_clean":"2024-02-21T23:01:32.393944+0000","last_became_active":"2024-02-21T23:01:02.203081+0000","last_became_peered":"2024-02-21T23:01:02.203081+0000","last_unstale":"2024-02-21T23:01:32.393944+0000","last_undegraded":"2024-02-21T23:01:32.393944+0000","last_fullsized":"2024-02-21T23:01:32.393944+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:36:44.497886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10],"acting":[2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788275+0000","last_change":"2024-02-21T23:01:07.268810+0000","last_active":"2024-02-21T23:01:08.788275+0000","last_peered":"2024-02-21T23:01:08.788275+0000","last_clean":"2024-02-21T23:01:08.788275+0000","last_became_active":"2024-02-21T23:01:07.268436+0000","last_became_peered":"2024-02-21T23:01:07.268436+0000","last_unstale":"2024-02-21T23:01:08.788275+0000","last_undegraded":"2024-02-21T23:01:08.788275+0000","last_fullsized":"2024-02-21T23:01:08.788275+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:10:53.452033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.261462+0000","last_change":"2024-02-21T23:01:03.216176+0000","last_active":"2024-02-21T23:01:08.261462+0000","last_peered":"2024-02-21T23:01:08.261462+0000","last_clean":"2024-02-21T23:01:08.261462+0000","last_became_active":"2024-02-21T23:01:03.215888+0000","last_became_peered":"2024-02-21T23:01:03.215888+0000","last_unstale":"2024-02-21T23:01:08.261462+0000","last_undegraded":"2024-02-21T23:01:08.261462+0000","last_fullsized":"2024-02-21T23:01:08.261462+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:07:50.626867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"29'25","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:40.419249+0000","last_change":"2024-02-21T23:01:02.204595+0000","last_active":"2024-02-21T23:01:40.419249+0000","last_peered":"2024-02-21T23:01:40.419249+0000","last_clean":"2024-02-21T23:01:40.419249+0000","last_became_active":"2024-02-21T23:01:02.204123+0000","last_became_peered":"2024-02-21T23:01:02.204123+0000","last_unstale":"2024-02-21T23:01:40.419249+0000","last_undegraded":"2024-02-21T23:01:40.419249+0000","last_fullsized":"2024-02-21T23:01:40.419249+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:36:44.497886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46525,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":21,"num_read_kb":56,"num_write":26,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1],"acting":[10,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788601+0000","last_change":"2024-02-21T23:01:07.275187+0000","last_active":"2024-02-21T23:01:08.788601+0000","last_peered":"2024-02-21T23:01:08.788601+0000","last_clean":"2024-02-21T23:01:08.788601+0000","last_became_active":"2024-02-21T23:01:07.265618+0000","last_became_peered":"2024-02-21T23:01:07.265618+0000","last_unstale":"2024-02-21T23:01:08.788601+0000","last_undegraded":"2024-02-21T23:01:08.788601+0000","last_fullsized":"2024-02-21T23:01:08.788601+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:47:23.414344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788154+0000","last_change":"2024-02-21T23:01:03.216300+0000","last_active":"2024-02-21T23:01:08.788154+0000","last_peered":"2024-02-21T23:01:08.788154+0000","last_clean":"2024-02-21T23:01:08.788154+0000","last_became_active":"2024-02-21T23:01:03.214580+0000","last_became_peered":"2024-02-21T23:01:03.214580+0000","last_unstale":"2024-02-21T23:01:08.788154+0000","last_undegraded":"2024-02-21T23:01:08.788154+0000","last_fullsized":"2024-02-21T23:01:08.788154+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:41:55.485351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8],"acting":[1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"29'4","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:31.383505+0000","last_change":"2024-02-21T23:01:02.222064+0000","last_active":"2024-02-21T23:01:31.383505+0000","last_peered":"2024-02-21T23:01:31.383505+0000","last_clean":"2024-02-21T23:01:31.383505+0000","last_became_active":"2024-02-21T23:01:02.221735+0000","last_became_peered":"2024-02-21T23:01:02.221735+0000","last_unstale":"2024-02-21T23:01:31.383505+0000","last_undegraded":"2024-02-21T23:01:31.383505+0000","last_fullsized":"2024-02-21T23:01:31.383505+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:23:41.295647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.260510+0000","last_change":"2024-02-21T23:01:07.276469+0000","last_active":"2024-02-21T23:01:08.260510+0000","last_peered":"2024-02-21T23:01:08.260510+0000","last_clean":"2024-02-21T23:01:08.260510+0000","last_became_active":"2024-02-21T23:01:07.275982+0000","last_became_peered":"2024-02-21T23:01:07.275982+0000","last_unstale":"2024-02-21T23:01:08.260510+0000","last_undegraded":"2024-02-21T23:01:08.260510+0000","last_fullsized":"2024-02-21T23:01:08.260510+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:37:06.063756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.790923+0000","last_change":"2024-02-21T23:01:03.229449+0000","last_active":"2024-02-21T23:01:08.790923+0000","last_peered":"2024-02-21T23:01:08.790923+0000","last_clean":"2024-02-21T23:01:08.790923+0000","last_became_active":"2024-02-21T23:01:03.229193+0000","last_became_peered":"2024-02-21T23:01:03.229193+0000","last_unstale":"2024-02-21T23:01:08.790923+0000","last_undegraded":"2024-02-21T23:01:08.790923+0000","last_fullsized":"2024-02-21T23:01:08.790923+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:35:24.590398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"29'2","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:31.382240+0000","last_change":"2024-02-21T23:01:02.197598+0000","last_active":"2024-02-21T23:01:31.382240+0000","last_peered":"2024-02-21T23:01:31.382240+0000","last_clean":"2024-02-21T23:01:31.382240+0000","last_became_active":"2024-02-21T23:01:02.197275+0000","last_became_peered":"2024-02-21T23:01:02.197275+0000","last_unstale":"2024-02-21T23:01:31.382240+0000","last_undegraded":"2024-02-21T23:01:31.382240+0000","last_fullsized":"2024-02-21T23:01:31.382240+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:36:44.497886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788046+0000","last_change":"2024-02-21T23:01:07.278576+0000","last_active":"2024-02-21T23:01:08.788046+0000","last_peered":"2024-02-21T23:01:08.788046+0000","last_clean":"2024-02-21T23:01:08.788046+0000","last_became_active":"2024-02-21T23:01:07.276078+0000","last_became_peered":"2024-02-21T23:01:07.276078+0000","last_unstale":"2024-02-21T23:01:08.788046+0000","last_undegraded":"2024-02-21T23:01:08.788046+0000","last_fullsized":"2024-02-21T23:01:08.788046+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:45:33.658778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788387+0000","last_change":"2024-02-21T23:01:03.215454+0000","last_active":"2024-02-21T23:01:08.788387+0000","last_peered":"2024-02-21T23:01:08.788387+0000","last_clean":"2024-02-21T23:01:08.788387+0000","last_became_active":"2024-02-21T23:01:03.215004+0000","last_became_peered":"2024-02-21T23:01:03.215004+0000","last_unstale":"2024-02-21T23:01:08.788387+0000","last_undegraded":"2024-02-21T23:01:08.788387+0000","last_fullsized":"2024-02-21T23:01:08.788387+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:27:55.341328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"29'3","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:39.405642+0000","last_change":"2024-02-21T23:01:02.207663+0000","last_active":"2024-02-21T23:01:39.405642+0000","last_peered":"2024-02-21T23:01:39.405642+0000","last_clean":"2024-02-21T23:01:39.405642+0000","last_became_active":"2024-02-21T23:01:02.207349+0000","last_became_peered":"2024-02-21T23:01:02.207349+0000","last_unstale":"2024-02-21T23:01:39.405642+0000","last_undegraded":"2024-02-21T23:01:39.405642+0000","last_fullsized":"2024-02-21T23:01:39.405642+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:21:29.919968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5],"acting":[10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.790535+0000","last_change":"2024-02-21T23:01:07.268655+0000","last_active":"2024-02-21T23:01:08.790535+0000","last_peered":"2024-02-21T23:01:08.790535+0000","last_clean":"2024-02-21T23:01:08.790535+0000","last_became_active":"2024-02-21T23:01:07.268193+0000","last_became_peered":"2024-02-21T23:01:07.268193+0000","last_unstale":"2024-02-21T23:01:08.790535+0000","last_undegraded":"2024-02-21T23:01:08.790535+0000","last_fullsized":"2024-02-21T23:01:08.790535+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:54:44.380302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.790242+0000","last_change":"2024-02-21T23:01:07.271441+0000","last_active":"2024-02-21T23:01:08.790242+0000","last_peered":"2024-02-21T23:01:08.790242+0000","last_clean":"2024-02-21T23:01:08.790242+0000","last_became_active":"2024-02-21T23:01:07.271175+0000","last_became_peered":"2024-02-21T23:01:07.271175+0000","last_unstale":"2024-02-21T23:01:08.790242+0000","last_undegraded":"2024-02-21T23:01:08.790242+0000","last_fullsized":"2024-02-21T23:01:08.790242+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:20:59.894677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788169+0000","last_change":"2024-02-21T23:01:03.210855+0000","last_active":"2024-02-21T23:01:08.788169+0000","last_peered":"2024-02-21T23:01:08.788169+0000","last_clean":"2024-02-21T23:01:08.788169+0000","last_became_active":"2024-02-21T23:01:03.210599+0000","last_became_peered":"2024-02-21T23:01:03.210599+0000","last_unstale":"2024-02-21T23:01:08.788169+0000","last_undegraded":"2024-02-21T23:01:08.788169+0000","last_fullsized":"2024-02-21T23:01:08.788169+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:27:55.341328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"29'1","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788133+0000","last_change":"2024-02-21T23:01:02.204603+0000","last_active":"2024-02-21T23:01:08.788133+0000","last_peered":"2024-02-21T23:01:08.788133+0000","last_clean":"2024-02-21T23:01:08.788133+0000","last_became_active":"2024-02-21T23:01:02.204304+0000","last_became_peered":"2024-02-21T23:01:02.204304+0000","last_unstale":"2024-02-21T23:01:08.788133+0000","last_undegraded":"2024-02-21T23:01:08.788133+0000","last_fullsized":"2024-02-21T23:01:08.788133+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:58:23.554457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787929+0000","last_change":"2024-02-21T23:01:07.284000+0000","last_active":"2024-02-21T23:01:08.787929+0000","last_peered":"2024-02-21T23:01:08.787929+0000","last_clean":"2024-02-21T23:01:08.787929+0000","last_became_active":"2024-02-21T23:01:07.283568+0000","last_became_peered":"2024-02-21T23:01:07.283568+0000","last_unstale":"2024-02-21T23:01:08.787929+0000","last_undegraded":"2024-02-21T23:01:08.787929+0000","last_fullsized":"2024-02-21T23:01:08.787929+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:20:59.894677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.789445+0000","last_change":"2024-02-21T23:01:03.208483+0000","last_active":"2024-02-21T23:01:08.789445+0000","last_peered":"2024-02-21T23:01:08.789445+0000","last_clean":"2024-02-21T23:01:08.789445+0000","last_became_active":"2024-02-21T23:01:03.208141+0000","last_became_peered":"2024-02-21T23:01:03.208141+0000","last_unstale":"2024-02-21T23:01:08.789445+0000","last_undegraded":"2024-02-21T23:01:08.789445+0000","last_fullsized":"2024-02-21T23:01:08.789445+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:35:24.590398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"29'2","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:32.395096+0000","last_change":"2024-02-21T23:01:02.218826+0000","last_active":"2024-02-21T23:01:32.395096+0000","last_peered":"2024-02-21T23:01:32.395096+0000","last_clean":"2024-02-21T23:01:32.395096+0000","last_became_active":"2024-02-21T23:01:02.218499+0000","last_became_peered":"2024-02-21T23:01:02.218499+0000","last_unstale":"2024-02-21T23:01:32.395096+0000","last_undegraded":"2024-02-21T23:01:32.395096+0000","last_fullsized":"2024-02-21T23:01:32.395096+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:17:06.353018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"29'3","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:32.398649+0000","last_change":"2024-02-21T23:01:02.209061+0000","last_active":"2024-02-21T23:01:32.398649+0000","last_peered":"2024-02-21T23:01:32.398649+0000","last_clean":"2024-02-21T23:01:32.398649+0000","last_became_active":"2024-02-21T23:01:02.208779+0000","last_became_peered":"2024-02-21T23:01:02.208779+0000","last_unstale":"2024-02-21T23:01:32.398649+0000","last_undegraded":"2024-02-21T23:01:32.398649+0000","last_fullsized":"2024-02-21T23:01:32.398649+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:17:06.353018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8],"acting":[10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787944+0000","last_change":"2024-02-21T23:01:03.212873+0000","last_active":"2024-02-21T23:01:08.787944+0000","last_peered":"2024-02-21T23:01:08.787944+0000","last_clean":"2024-02-21T23:01:08.787944+0000","last_became_active":"2024-02-21T23:01:03.212560+0000","last_became_peered":"2024-02-21T23:01:03.212560+0000","last_unstale":"2024-02-21T23:01:08.787944+0000","last_undegraded":"2024-02-21T23:01:08.787944+0000","last_fullsized":"2024-02-21T23:01:08.787944+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:47:19.366266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788832+0000","last_change":"2024-02-21T23:01:07.269266+0000","last_active":"2024-02-21T23:01:08.788832+0000","last_peered":"2024-02-21T23:01:08.788832+0000","last_clean":"2024-02-21T23:01:08.788832+0000","last_became_active":"2024-02-21T23:01:07.267796+0000","last_became_peered":"2024-02-21T23:01:07.267796+0000","last_unstale":"2024-02-21T23:01:08.788832+0000","last_undegraded":"2024-02-21T23:01:08.788832+0000","last_fullsized":"2024-02-21T23:01:08.788832+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:37:06.063756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"29'6","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:39.406449+0000","last_change":"2024-02-21T23:01:02.206398+0000","last_active":"2024-02-21T23:01:39.406449+0000","last_peered":"2024-02-21T23:01:39.406449+0000","last_clean":"2024-02-21T23:01:39.406449+0000","last_became_active":"2024-02-21T23:01:02.206069+0000","last_became_peered":"2024-02-21T23:01:02.206069+0000","last_unstale":"2024-02-21T23:01:39.406449+0000","last_undegraded":"2024-02-21T23:01:39.406449+0000","last_fullsized":"2024-02-21T23:01:39.406449+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:26:49.911102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1017,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.261164+0000","last_change":"2024-02-21T23:01:03.221228+0000","last_active":"2024-02-21T23:01:08.261164+0000","last_peered":"2024-02-21T23:01:08.261164+0000","last_clean":"2024-02-21T23:01:08.261164+0000","last_became_active":"2024-02-21T23:01:03.220900+0000","last_became_peered":"2024-02-21T23:01:03.220900+0000","last_unstale":"2024-02-21T23:01:08.261164+0000","last_undegraded":"2024-02-21T23:01:08.261164+0000","last_fullsized":"2024-02-21T23:01:08.261164+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:40:26.325368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9],"acting":[8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788794+0000","last_change":"2024-02-21T23:01:07.257004+0000","last_active":"2024-02-21T23:01:08.788794+0000","last_peered":"2024-02-21T23:01:08.788794+0000","last_clean":"2024-02-21T23:01:08.788794+0000","last_became_active":"2024-02-21T23:01:07.256474+0000","last_became_peered":"2024-02-21T23:01:07.256474+0000","last_unstale":"2024-02-21T23:01:08.788794+0000","last_undegraded":"2024-02-21T23:01:08.788794+0000","last_fullsized":"2024-02-21T23:01:08.788794+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:15:20.572234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787395+0000","last_change":"2024-02-21T23:01:03.215942+0000","last_active":"2024-02-21T23:01:08.787395+0000","last_peered":"2024-02-21T23:01:08.787395+0000","last_clean":"2024-02-21T23:01:08.787395+0000","last_became_active":"2024-02-21T23:01:03.215461+0000","last_became_peered":"2024-02-21T23:01:03.215461+0000","last_unstale":"2024-02-21T23:01:08.787395+0000","last_undegraded":"2024-02-21T23:01:08.787395+0000","last_fullsized":"2024-02-21T23:01:08.787395+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:27:55.341328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788755+0000","last_change":"2024-02-21T23:01:03.215959+0000","last_active":"2024-02-21T23:01:08.788755+0000","last_peered":"2024-02-21T23:01:08.788755+0000","last_clean":"2024-02-21T23:01:08.788755+0000","last_became_active":"2024-02-21T23:01:03.215639+0000","last_became_peered":"2024-02-21T23:01:03.215639+0000","last_unstale":"2024-02-21T23:01:08.788755+0000","last_undegraded":"2024-02-21T23:01:08.788755+0000","last_fullsized":"2024-02-21T23:01:08.788755+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:16.946152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787323+0000","last_change":"2024-02-21T23:01:03.218687+0000","last_active":"2024-02-21T23:01:08.787323+0000","last_peered":"2024-02-21T23:01:08.787323+0000","last_clean":"2024-02-21T23:01:08.787323+0000","last_became_active":"2024-02-21T23:01:03.218377+0000","last_became_peered":"2024-02-21T23:01:03.218377+0000","last_unstale":"2024-02-21T23:01:08.787323+0000","last_undegraded":"2024-02-21T23:01:08.787323+0000","last_fullsized":"2024-02-21T23:01:08.787323+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:41:55.485351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.790033+0000","last_change":"2024-02-21T23:01:03.225342+0000","last_active":"2024-02-21T23:01:08.790033+0000","last_peered":"2024-02-21T23:01:08.790033+0000","last_clean":"2024-02-21T23:01:08.790033+0000","last_became_active":"2024-02-21T23:01:03.225085+0000","last_became_peered":"2024-02-21T23:01:03.225085+0000","last_unstale":"2024-02-21T23:01:08.790033+0000","last_undegraded":"2024-02-21T23:01:08.790033+0000","last_fullsized":"2024-02-21T23:01:08.790033+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:54:32.196725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.263829+0000","last_change":"2024-02-21T23:01:03.226259+0000","last_active":"2024-02-21T23:01:08.263829+0000","last_peered":"2024-02-21T23:01:08.263829+0000","last_clean":"2024-02-21T23:01:08.263829+0000","last_became_active":"2024-02-21T23:01:03.225925+0000","last_became_peered":"2024-02-21T23:01:03.225925+0000","last_unstale":"2024-02-21T23:01:08.263829+0000","last_undegraded":"2024-02-21T23:01:08.263829+0000","last_fullsized":"2024-02-21T23:01:08.263829+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:54:32.196725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788416+0000","last_change":"2024-02-21T23:01:03.215186+0000","last_active":"2024-02-21T23:01:08.788416+0000","last_peered":"2024-02-21T23:01:08.788416+0000","last_clean":"2024-02-21T23:01:08.788416+0000","last_became_active":"2024-02-21T23:01:03.214488+0000","last_became_peered":"2024-02-21T23:01:03.214488+0000","last_unstale":"2024-02-21T23:01:08.788416+0000","last_undegraded":"2024-02-21T23:01:08.788416+0000","last_fullsized":"2024-02-21T23:01:08.788416+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:58:24.562346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8],"acting":[11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788754+0000","last_change":"2024-02-21T23:01:03.208734+0000","last_active":"2024-02-21T23:01:08.788754+0000","last_peered":"2024-02-21T23:01:08.788754+0000","last_clean":"2024-02-21T23:01:08.788754+0000","last_became_active":"2024-02-21T23:01:03.208458+0000","last_became_peered":"2024-02-21T23:01:03.208458+0000","last_unstale":"2024-02-21T23:01:08.788754+0000","last_undegraded":"2024-02-21T23:01:08.788754+0000","last_fullsized":"2024-02-21T23:01:08.788754+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:54:32.196725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8],"acting":[2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788958+0000","last_change":"2024-02-21T23:01:03.206669+0000","last_active":"2024-02-21T23:01:08.788958+0000","last_peered":"2024-02-21T23:01:08.788958+0000","last_clean":"2024-02-21T23:01:08.788958+0000","last_became_active":"2024-02-21T23:01:03.206376+0000","last_became_peered":"2024-02-21T23:01:03.206376+0000","last_unstale":"2024-02-21T23:01:08.788958+0000","last_undegraded":"2024-02-21T23:01:08.788958+0000","last_fullsized":"2024-02-21T23:01:08.788958+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:07:50.626867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787194+0000","last_change":"2024-02-21T23:01:03.215459+0000","last_active":"2024-02-21T23:01:08.787194+0000","last_peered":"2024-02-21T23:01:08.787194+0000","last_clean":"2024-02-21T23:01:08.787194+0000","last_became_active":"2024-02-21T23:01:03.214922+0000","last_became_peered":"2024-02-21T23:01:03.214922+0000","last_unstale":"2024-02-21T23:01:08.787194+0000","last_undegraded":"2024-02-21T23:01:08.787194+0000","last_fullsized":"2024-02-21T23:01:08.787194+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:40:26.325368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.790310+0000","last_change":"2024-02-21T23:01:03.213687+0000","last_active":"2024-02-21T23:01:08.790310+0000","last_peered":"2024-02-21T23:01:08.790310+0000","last_clean":"2024-02-21T23:01:08.790310+0000","last_became_active":"2024-02-21T23:01:03.213428+0000","last_became_peered":"2024-02-21T23:01:03.213428+0000","last_unstale":"2024-02-21T23:01:08.790310+0000","last_undegraded":"2024-02-21T23:01:08.790310+0000","last_fullsized":"2024-02-21T23:01:08.790310+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:45:29.610700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787556+0000","last_change":"2024-02-21T23:01:03.215983+0000","last_active":"2024-02-21T23:01:08.787556+0000","last_peered":"2024-02-21T23:01:08.787556+0000","last_clean":"2024-02-21T23:01:08.787556+0000","last_became_active":"2024-02-21T23:01:03.215580+0000","last_became_peered":"2024-02-21T23:01:03.215580+0000","last_unstale":"2024-02-21T23:01:08.787556+0000","last_undegraded":"2024-02-21T23:01:08.787556+0000","last_fullsized":"2024-02-21T23:01:08.787556+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:58:24.562346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.263660+0000","last_change":"2024-02-21T23:01:03.226514+0000","last_active":"2024-02-21T23:01:08.263660+0000","last_peered":"2024-02-21T23:01:08.263660+0000","last_clean":"2024-02-21T23:01:08.263660+0000","last_became_active":"2024-02-21T23:01:03.223861+0000","last_became_peered":"2024-02-21T23:01:03.223861+0000","last_unstale":"2024-02-21T23:01:08.263660+0000","last_undegraded":"2024-02-21T23:01:08.263660+0000","last_fullsized":"2024-02-21T23:01:08.263660+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:07:50.626867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787787+0000","last_change":"2024-02-21T23:01:03.212993+0000","last_active":"2024-02-21T23:01:08.787787+0000","last_peered":"2024-02-21T23:01:08.787787+0000","last_clean":"2024-02-21T23:01:08.787787+0000","last_became_active":"2024-02-21T23:01:03.212691+0000","last_became_peered":"2024-02-21T23:01:03.212691+0000","last_unstale":"2024-02-21T23:01:08.787787+0000","last_undegraded":"2024-02-21T23:01:08.787787+0000","last_fullsized":"2024-02-21T23:01:08.787787+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:10:10.688004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788992+0000","last_change":"2024-02-21T23:01:03.217962+0000","last_active":"2024-02-21T23:01:08.788992+0000","last_peered":"2024-02-21T23:01:08.788992+0000","last_clean":"2024-02-21T23:01:08.788992+0000","last_became_active":"2024-02-21T23:01:03.217613+0000","last_became_peered":"2024-02-21T23:01:03.217613+0000","last_unstale":"2024-02-21T23:01:08.788992+0000","last_undegraded":"2024-02-21T23:01:08.788992+0000","last_fullsized":"2024-02-21T23:01:08.788992+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:35:24.590398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788983+0000","last_change":"2024-02-21T23:01:03.214531+0000","last_active":"2024-02-21T23:01:08.788983+0000","last_peered":"2024-02-21T23:01:08.788983+0000","last_clean":"2024-02-21T23:01:08.788983+0000","last_became_active":"2024-02-21T23:01:03.214165+0000","last_became_peered":"2024-02-21T23:01:03.214165+0000","last_unstale":"2024-02-21T23:01:08.788983+0000","last_undegraded":"2024-02-21T23:01:08.788983+0000","last_fullsized":"2024-02-21T23:01:08.788983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:58:24.562346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1],"acting":[9,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788210+0000","last_change":"2024-02-21T23:01:03.214286+0000","last_active":"2024-02-21T23:01:08.788210+0000","last_peered":"2024-02-21T23:01:08.788210+0000","last_clean":"2024-02-21T23:01:08.788210+0000","last_became_active":"2024-02-21T23:01:03.213755+0000","last_became_peered":"2024-02-21T23:01:03.213755+0000","last_unstale":"2024-02-21T23:01:08.788210+0000","last_undegraded":"2024-02-21T23:01:08.788210+0000","last_fullsized":"2024-02-21T23:01:08.788210+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:35:24.590398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787471+0000","last_change":"2024-02-21T23:01:03.216623+0000","last_active":"2024-02-21T23:01:08.787471+0000","last_peered":"2024-02-21T23:01:08.787471+0000","last_clean":"2024-02-21T23:01:08.787471+0000","last_became_active":"2024-02-21T23:01:03.216345+0000","last_became_peered":"2024-02-21T23:01:03.216345+0000","last_unstale":"2024-02-21T23:01:08.787471+0000","last_undegraded":"2024-02-21T23:01:08.787471+0000","last_fullsized":"2024-02-21T23:01:08.787471+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:10:10.688004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.790273+0000","last_change":"2024-02-21T23:01:03.226262+0000","last_active":"2024-02-21T23:01:08.790273+0000","last_peered":"2024-02-21T23:01:08.790273+0000","last_clean":"2024-02-21T23:01:08.790273+0000","last_became_active":"2024-02-21T23:01:03.225574+0000","last_became_peered":"2024-02-21T23:01:03.225574+0000","last_unstale":"2024-02-21T23:01:08.790273+0000","last_undegraded":"2024-02-21T23:01:08.790273+0000","last_fullsized":"2024-02-21T23:01:08.790273+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:10:10.688004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.789940+0000","last_change":"2024-02-21T23:01:03.225898+0000","last_active":"2024-02-21T23:01:08.789940+0000","last_peered":"2024-02-21T23:01:08.789940+0000","last_clean":"2024-02-21T23:01:08.789940+0000","last_became_active":"2024-02-21T23:01:03.217938+0000","last_became_peered":"2024-02-21T23:01:03.217938+0000","last_unstale":"2024-02-21T23:01:08.789940+0000","last_undegraded":"2024-02-21T23:01:08.789940+0000","last_fullsized":"2024-02-21T23:01:08.789940+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:58:24.562346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8],"acting":[0,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.263526+0000","last_change":"2024-02-21T23:01:03.225830+0000","last_active":"2024-02-21T23:01:08.263526+0000","last_peered":"2024-02-21T23:01:08.263526+0000","last_clean":"2024-02-21T23:01:08.263526+0000","last_became_active":"2024-02-21T23:01:03.225449+0000","last_became_peered":"2024-02-21T23:01:03.225449+0000","last_unstale":"2024-02-21T23:01:08.263526+0000","last_undegraded":"2024-02-21T23:01:08.263526+0000","last_fullsized":"2024-02-21T23:01:08.263526+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:47:19.366266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10],"acting":[6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.260717+0000","last_change":"2024-02-21T23:01:03.208746+0000","last_active":"2024-02-21T23:01:08.260717+0000","last_peered":"2024-02-21T23:01:08.260717+0000","last_clean":"2024-02-21T23:01:08.260717+0000","last_became_active":"2024-02-21T23:01:03.208446+0000","last_became_peered":"2024-02-21T23:01:03.208446+0000","last_unstale":"2024-02-21T23:01:08.260717+0000","last_undegraded":"2024-02-21T23:01:08.260717+0000","last_fullsized":"2024-02-21T23:01:08.260717+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:58:24.562346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787941+0000","last_change":"2024-02-21T23:01:03.218981+0000","last_active":"2024-02-21T23:01:08.787941+0000","last_peered":"2024-02-21T23:01:08.787941+0000","last_clean":"2024-02-21T23:01:08.787941+0000","last_became_active":"2024-02-21T23:01:03.217925+0000","last_became_peered":"2024-02-21T23:01:03.217925+0000","last_unstale":"2024-02-21T23:01:08.787941+0000","last_undegraded":"2024-02-21T23:01:08.787941+0000","last_fullsized":"2024-02-21T23:01:08.787941+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:54:40.332224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8],"acting":[7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.790183+0000","last_change":"2024-02-21T23:01:03.212233+0000","last_active":"2024-02-21T23:01:08.790183+0000","last_peered":"2024-02-21T23:01:08.790183+0000","last_clean":"2024-02-21T23:01:08.790183+0000","last_became_active":"2024-02-21T23:01:03.211921+0000","last_became_peered":"2024-02-21T23:01:03.211921+0000","last_unstale":"2024-02-21T23:01:08.790183+0000","last_undegraded":"2024-02-21T23:01:08.790183+0000","last_fullsized":"2024-02-21T23:01:08.790183+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:54:32.196725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2],"acting":[10,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788443+0000","last_change":"2024-02-21T23:01:03.216861+0000","last_active":"2024-02-21T23:01:08.788443+0000","last_peered":"2024-02-21T23:01:08.788443+0000","last_clean":"2024-02-21T23:01:08.788443+0000","last_became_active":"2024-02-21T23:01:03.216580+0000","last_became_peered":"2024-02-21T23:01:03.216580+0000","last_unstale":"2024-02-21T23:01:08.788443+0000","last_undegraded":"2024-02-21T23:01:08.788443+0000","last_fullsized":"2024-02-21T23:01:08.788443+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:35:24.590398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.789320+0000","last_change":"2024-02-21T23:01:03.212164+0000","last_active":"2024-02-21T23:01:08.789320+0000","last_peered":"2024-02-21T23:01:08.789320+0000","last_clean":"2024-02-21T23:01:08.789320+0000","last_became_active":"2024-02-21T23:01:03.211811+0000","last_became_peered":"2024-02-21T23:01:03.211811+0000","last_unstale":"2024-02-21T23:01:08.789320+0000","last_undegraded":"2024-02-21T23:01:08.789320+0000","last_fullsized":"2024-02-21T23:01:08.789320+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:16.946152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787878+0000","last_change":"2024-02-21T23:01:03.223537+0000","last_active":"2024-02-21T23:01:08.787878+0000","last_peered":"2024-02-21T23:01:08.787878+0000","last_clean":"2024-02-21T23:01:08.787878+0000","last_became_active":"2024-02-21T23:01:03.223255+0000","last_became_peered":"2024-02-21T23:01:03.223255+0000","last_unstale":"2024-02-21T23:01:08.787878+0000","last_undegraded":"2024-02-21T23:01:08.787878+0000","last_fullsized":"2024-02-21T23:01:08.787878+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:19:01.584139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9],"acting":[7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.789780+0000","last_change":"2024-02-21T23:01:03.210441+0000","last_active":"2024-02-21T23:01:08.789780+0000","last_peered":"2024-02-21T23:01:08.789780+0000","last_clean":"2024-02-21T23:01:08.789780+0000","last_became_active":"2024-02-21T23:01:03.209569+0000","last_became_peered":"2024-02-21T23:01:03.209569+0000","last_unstale":"2024-02-21T23:01:08.789780+0000","last_undegraded":"2024-02-21T23:01:08.789780+0000","last_fullsized":"2024-02-21T23:01:08.789780+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:41:55.485351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9],"acting":[10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.261019+0000","last_change":"2024-02-21T23:01:03.214234+0000","last_active":"2024-02-21T23:01:08.261019+0000","last_peered":"2024-02-21T23:01:08.261019+0000","last_clean":"2024-02-21T23:01:08.261019+0000","last_became_active":"2024-02-21T23:01:03.213941+0000","last_became_peered":"2024-02-21T23:01:03.213941+0000","last_unstale":"2024-02-21T23:01:08.261019+0000","last_undegraded":"2024-02-21T23:01:08.261019+0000","last_fullsized":"2024-02-21T23:01:08.261019+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:19:01.584139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3],"acting":[8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.260625+0000","last_change":"2024-02-21T23:01:03.207972+0000","last_active":"2024-02-21T23:01:08.260625+0000","last_peered":"2024-02-21T23:01:08.260625+0000","last_clean":"2024-02-21T23:01:08.260625+0000","last_became_active":"2024-02-21T23:01:03.206762+0000","last_became_peered":"2024-02-21T23:01:03.206762+0000","last_unstale":"2024-02-21T23:01:08.260625+0000","last_undegraded":"2024-02-21T23:01:08.260625+0000","last_fullsized":"2024-02-21T23:01:08.260625+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:27:55.341328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8],"acting":[4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.790823+0000","last_change":"2024-02-21T23:01:03.221959+0000","last_active":"2024-02-21T23:01:08.790823+0000","last_peered":"2024-02-21T23:01:08.790823+0000","last_clean":"2024-02-21T23:01:08.790823+0000","last_became_active":"2024-02-21T23:01:03.221672+0000","last_became_peered":"2024-02-21T23:01:03.221672+0000","last_unstale":"2024-02-21T23:01:08.790823+0000","last_undegraded":"2024-02-21T23:01:08.790823+0000","last_fullsized":"2024-02-21T23:01:08.790823+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:45:29.610700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.790294+0000","last_change":"2024-02-21T23:01:03.219660+0000","last_active":"2024-02-21T23:01:08.790294+0000","last_peered":"2024-02-21T23:01:08.790294+0000","last_clean":"2024-02-21T23:01:08.790294+0000","last_became_active":"2024-02-21T23:01:03.219379+0000","last_became_peered":"2024-02-21T23:01:03.219379+0000","last_unstale":"2024-02-21T23:01:08.790294+0000","last_undegraded":"2024-02-21T23:01:08.790294+0000","last_fullsized":"2024-02-21T23:01:08.790294+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:27:55.341328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11],"acting":[0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788114+0000","last_change":"2024-02-21T23:01:03.213287+0000","last_active":"2024-02-21T23:01:08.788114+0000","last_peered":"2024-02-21T23:01:08.788114+0000","last_clean":"2024-02-21T23:01:08.788114+0000","last_became_active":"2024-02-21T23:01:03.212878+0000","last_became_peered":"2024-02-21T23:01:03.212878+0000","last_unstale":"2024-02-21T23:01:08.788114+0000","last_undegraded":"2024-02-21T23:01:08.788114+0000","last_fullsized":"2024-02-21T23:01:08.788114+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:16.946152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":50530,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":72,"num_read_kb":91,"num_write":153,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":245760,"data_stored":101060,"data_compressed":3672,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":64,"acting":64,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66458,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":11,"up_from":17,"seq":73014444044,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":145847,"data_compressed":8432,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":17,"seq":73014444043,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":372736,"data_stored":187922,"data_compressed":10268,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":17,"seq":73014444044,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":150033,"data_compressed":8432,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":17,"seq":73014444043,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":323584,"data_stored":145421,"data_compressed":8432,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":17,"seq":73014444044,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":385024,"data_stored":740899,"data_compressed":41661,"data_compressed_allocated":57344,"data_compressed_original":598016,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":17,"seq":73014444043,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":141259,"data_compressed":8432,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":17,"seq":73014444044,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":401408,"data_stored":737504,"data_compressed":41661,"data_compressed_allocated":57344,"data_compressed_original":598016,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":17,"seq":73014444044,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":315392,"data_stored":145887,"data_compressed":8432,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":17,"seq":73014444044,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":141349,"data_compressed":8432,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444044,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":142802,"data_compressed":8432,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":17,"seq":73014444044,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":356352,"data_stored":187694,"data_compressed":10268,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":17,"seq":73014444044,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":323584,"data_stored":141975,"data_compressed":8432,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33229,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33229,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":46525,"data_compressed":1836,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":46753,"data_compressed":1836,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-21T23:01:42.460 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-21T23:01:42.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.723+0000 7fb416e00640 1 Processor -- start 2024-02-21T23:01:42.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.723+0000 7fb416e00640 1 -- start start 2024-02-21T23:01:42.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.727+0000 7fb416e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb41017f6d0 0x7fb4100f79f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:42.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.727+0000 7fb416e00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fb4100f7f30 0x7fb41018c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:42.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.727+0000 7fb416e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb41018c770 0x7fb4100ccd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:42.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.727+0000 7fb416e00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb410189f10 con 0x7fb41017f6d0 2024-02-21T23:01:42.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.727+0000 7fb416e00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4100cddc0 con 0x7fb41018c770 2024-02-21T23:01:42.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.727+0000 7fb416e00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4100f6c30 con 0x7fb4100f7f30 2024-02-21T23:01:42.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.727+0000 7fb415a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb41017f6d0 0x7fb4100f79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:42.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.727+0000 7fb415000640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fb4100f7f30 0x7fb41018c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:42.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.727+0000 7fb415a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb41017f6d0 0x7fb4100f79f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59810/0 (socket says 172.21.15.99:59810) 2024-02-21T23:01:42.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.727+0000 7fb415a00640 1 -- 172.21.15.99:0/112261478 learned_addr learned my addr 172.21.15.99:0/112261478 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:42.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.727+0000 7fb416400640 1 --2- 172.21.15.99:0/112261478 >> v2:172.21.15.162:3300/0 conn(0x7fb41018c770 0x7fb4100ccd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:42.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.728+0000 7fb415000640 1 -- 172.21.15.99:0/112261478 >> v2:172.21.15.162:3300/0 conn(0x7fb41018c770 msgr2=0x7fb4100ccd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:42.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.728+0000 7fb415000640 1 --2- 172.21.15.99:0/112261478 >> v2:172.21.15.162:3300/0 conn(0x7fb41018c770 0x7fb4100ccd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:42.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.728+0000 7fb415000640 1 -- 172.21.15.99:0/112261478 >> v2:172.21.15.99:3300/0 conn(0x7fb41017f6d0 msgr2=0x7fb4100f79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:42.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.728+0000 7fb415000640 1 --2- 172.21.15.99:0/112261478 >> v2:172.21.15.99:3300/0 conn(0x7fb41017f6d0 0x7fb4100f79f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:42.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.728+0000 7fb415000640 1 -- 172.21.15.99:0/112261478 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4100f6f10 con 0x7fb4100f7f30 2024-02-21T23:01:42.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.729+0000 7fb415000640 1 --2- 172.21.15.99:0/112261478 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb4100f7f30 0x7fb41018c230 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb4100efbf0 tx=0x7fb3fc02b7c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e906e9b1e5aa0fd server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:42.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.730+0000 7fb40fe00640 1 -- 172.21.15.99:0/112261478 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3fc038070 con 0x7fb4100f7f30 2024-02-21T23:01:42.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.730+0000 7fb40fe00640 1 -- 172.21.15.99:0/112261478 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3fc031520 con 0x7fb4100f7f30 2024-02-21T23:01:42.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.730+0000 7fb40fe00640 1 -- 172.21.15.99:0/112261478 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3fc0318f0 con 0x7fb4100f7f30 2024-02-21T23:01:42.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.730+0000 7fb416e00640 1 -- 172.21.15.99:0/112261478 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb4100f7f30 msgr2=0x7fb41018c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:42.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.730+0000 7fb416e00640 1 --2- 172.21.15.99:0/112261478 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb4100f7f30 0x7fb41018c230 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb4100efbf0 tx=0x7fb3fc02b7c0 comp rx=0 tx=0).stop 2024-02-21T23:01:42.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.730+0000 7fb416e00640 1 -- 172.21.15.99:0/112261478 shutdown_connections 2024-02-21T23:01:42.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.730+0000 7fb416e00640 1 --2- 172.21.15.99:0/112261478 >> v2:172.21.15.162:3300/0 conn(0x7fb41018c770 0x7fb4100ccd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:42.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.730+0000 7fb416e00640 1 --2- 172.21.15.99:0/112261478 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb4100f7f30 0x7fb41018c230 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:42.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.730+0000 7fb416e00640 1 --2- 172.21.15.99:0/112261478 >> v2:172.21.15.99:3300/0 conn(0x7fb41017f6d0 0x7fb4100f79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:42.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.730+0000 7fb416e00640 1 -- 172.21.15.99:0/112261478 >> 172.21.15.99:0/112261478 conn(0x7fb4100d05e0 msgr2=0x7fb4100d09f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:42.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.731+0000 7fb416e00640 1 -- 172.21.15.99:0/112261478 shutdown_connections 2024-02-21T23:01:42.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.731+0000 7fb416e00640 1 -- 172.21.15.99:0/112261478 wait complete. 2024-02-21T23:01:42.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.734+0000 7fb416e00640 1 Processor -- start 2024-02-21T23:01:42.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.734+0000 7fb416e00640 1 -- start start 2024-02-21T23:01:42.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.736+0000 7fb416e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4100f7f30 0x7fb41016e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:42.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.736+0000 7fb416e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb41017f6d0 0x7fb4100cf900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:42.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.736+0000 7fb416e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb41018c770 0x7fb4100cfe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:42.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.736+0000 7fb416e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4100f83b0 con 0x7fb4100f7f30 2024-02-21T23:01:42.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.736+0000 7fb416e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4100f74d0 con 0x7fb41018c770 2024-02-21T23:01:42.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.736+0000 7fb416e00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb41018cc00 con 0x7fb41017f6d0 2024-02-21T23:01:42.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.736+0000 7fb415a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4100f7f30 0x7fb41016e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:42.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.736+0000 7fb416400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb41018c770 0x7fb4100cfe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:42.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.736+0000 7fb415a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4100f7f30 0x7fb41016e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59814/0 (socket says 172.21.15.99:59814) 2024-02-21T23:01:42.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.736+0000 7fb415a00640 1 -- 172.21.15.99:0/1803906678 learned_addr learned my addr 172.21.15.99:0/1803906678 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:42.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.736+0000 7fb415000640 1 --2- 172.21.15.99:0/1803906678 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb41017f6d0 0x7fb4100cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:42.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.737+0000 7fb415a00640 1 -- 172.21.15.99:0/1803906678 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb41017f6d0 msgr2=0x7fb4100cf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:42.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.737+0000 7fb415a00640 1 --2- 172.21.15.99:0/1803906678 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb41017f6d0 0x7fb4100cf900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:42.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.737+0000 7fb415a00640 1 -- 172.21.15.99:0/1803906678 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb41018c770 msgr2=0x7fb4100cfe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:42.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.737+0000 7fb415a00640 1 --2- 172.21.15.99:0/1803906678 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb41018c770 0x7fb4100cfe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:42.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.737+0000 7fb415a00640 1 -- 172.21.15.99:0/1803906678 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb41021cb40 con 0x7fb4100f7f30 2024-02-21T23:01:42.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.737+0000 7fb415a00640 1 --2- 172.21.15.99:0/1803906678 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4100f7f30 0x7fb41016e100 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb40400e8d0 tx=0x7fb40400ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:42.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.737+0000 7fb40d600640 1 -- 172.21.15.99:0/1803906678 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb404017070 con 0x7fb4100f7f30 2024-02-21T23:01:42.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.737+0000 7fb40d600640 1 -- 172.21.15.99:0/1803906678 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb40400c940 con 0x7fb4100f7f30 2024-02-21T23:01:42.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.737+0000 7fb416e00640 1 -- 172.21.15.99:0/1803906678 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb41021ce20 con 0x7fb4100f7f30 2024-02-21T23:01:42.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.737+0000 7fb40d600640 1 -- 172.21.15.99:0/1803906678 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb40400ccf0 con 0x7fb4100f7f30 2024-02-21T23:01:42.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.737+0000 7fb416e00640 1 -- 172.21.15.99:0/1803906678 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb41021d3e0 con 0x7fb4100f7f30 2024-02-21T23:01:42.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.738+0000 7fb416e00640 1 -- 172.21.15.99:0/1803906678 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb410068320 con 0x7fb4100f7f30 2024-02-21T23:01:42.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.742+0000 7fb40d600640 1 -- 172.21.15.99:0/1803906678 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 6) v1 ==== 134407+0+0 (secure 0 0 0) 0x7fb40401a070 con 0x7fb4100f7f30 2024-02-21T23:01:42.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.744+0000 7fb40d600640 1 --2- 172.21.15.99:0/1803906678 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fb3f009edf0 0x7fb3f00a12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:42.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.744+0000 7fb40d600640 1 -- 172.21.15.99:0/1803906678 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fb4040ca310 con 0x7fb4100f7f30 2024-02-21T23:01:42.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.745+0000 7fb415000640 1 --2- 172.21.15.99:0/1803906678 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fb3f009edf0 0x7fb3f00a12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:42.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.746+0000 7fb415000640 1 --2- 172.21.15.99:0/1803906678 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fb3f009edf0 0x7fb3f00a12b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc035000 tx=0x7fb3fc030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:42.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.746+0000 7fb40d600640 1 -- 172.21.15.99:0/1803906678 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fb404097ec0 con 0x7fb4100f7f30 2024-02-21T23:01:42.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.939+0000 7fb416e00640 1 -- 172.21.15.99:0/1803906678 --> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb4100d0380 con 0x7fb3f009edf0 2024-02-21T23:01:42.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.949+0000 7fb40d600640 1 -- 172.21.15.99:0/1803906678 <== mgr.4106 v2:172.21.15.162:6800/1717094936 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+338704 (secure 0 0 0) 0x7fb3fc0316a0 con 0x7fb3f009edf0 2024-02-21T23:01:42.942 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T23:01:42.944 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-02-21T23:01:42.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.954+0000 7fb416e00640 1 -- 172.21.15.99:0/1803906678 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fb3f009edf0 msgr2=0x7fb3f00a12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:42.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.954+0000 7fb416e00640 1 --2- 172.21.15.99:0/1803906678 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fb3f009edf0 0x7fb3f00a12b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc035000 tx=0x7fb3fc030000 comp rx=0 tx=0).stop 2024-02-21T23:01:42.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.954+0000 7fb416e00640 1 -- 172.21.15.99:0/1803906678 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4100f7f30 msgr2=0x7fb41016e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:42.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.954+0000 7fb416e00640 1 --2- 172.21.15.99:0/1803906678 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4100f7f30 0x7fb41016e100 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb40400e8d0 tx=0x7fb40400ed90 comp rx=0 tx=0).stop 2024-02-21T23:01:42.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.954+0000 7fb416e00640 1 -- 172.21.15.99:0/1803906678 shutdown_connections 2024-02-21T23:01:42.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.954+0000 7fb416e00640 1 --2- 172.21.15.99:0/1803906678 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fb3f009edf0 0x7fb3f00a12b0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:42.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.954+0000 7fb416e00640 1 --2- 172.21.15.99:0/1803906678 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb41018c770 0x7fb4100cfe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:42.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.954+0000 7fb416e00640 1 --2- 172.21.15.99:0/1803906678 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb41017f6d0 0x7fb4100cf900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:42.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.954+0000 7fb416e00640 1 --2- 172.21.15.99:0/1803906678 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4100f7f30 0x7fb41016e100 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:42.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.954+0000 7fb416e00640 1 -- 172.21.15.99:0/1803906678 >> 172.21.15.99:0/1803906678 conn(0x7fb4100d05e0 msgr2=0x7fb41017dfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:42.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.954+0000 7fb416e00640 1 -- 172.21.15.99:0/1803906678 shutdown_connections 2024-02-21T23:01:42.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:42.954+0000 7fb416e00640 1 -- 172.21.15.99:0/1803906678 wait complete. 2024-02-21T23:01:42.965 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2024-02-21T23:01:40.952163+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":641132,"num_objects":64,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":208,"num_read_kb":210,"num_write":336,"num_write_kb":3036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1132462080,"kb_used":328144,"kb_used_data":3952,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1132133936,"statfs":{"total":1159641169920,"available":1159305150464,"internally_reserved":0,"allocated":4046848,"data_stored":3008592,"data_compressed":171314,"data_compressed_allocated":245760,"data_compressed_original":1458176,"omap_allocated":19138,"internal_metadata":331855166},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":46124,"num_objects":40,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":72,"num_read_kb":91,"num_write":106,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003211"},"pg_stats":[{"pgid":"2.1f","version":"29'9","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:32.400697+0000","last_change":"2024-02-21T23:01:02.208441+0000","last_active":"2024-02-21T23:01:32.400697+0000","last_peered":"2024-02-21T23:01:32.400697+0000","last_clean":"2024-02-21T23:01:32.400697+0000","last_became_active":"2024-02-21T23:01:02.208124+0000","last_became_peered":"2024-02-21T23:01:02.208124+0000","last_unstale":"2024-02-21T23:01:32.400697+0000","last_undegraded":"2024-02-21T23:01:32.400697+0000","last_fullsized":"2024-02-21T23:01:32.400697+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:21:29.919968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7],"acting":[9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788787+0000","last_change":"2024-02-21T23:01:03.215149+0000","last_active":"2024-02-21T23:01:08.788787+0000","last_peered":"2024-02-21T23:01:08.788787+0000","last_clean":"2024-02-21T23:01:08.788787+0000","last_became_active":"2024-02-21T23:01:03.214170+0000","last_became_peered":"2024-02-21T23:01:03.214170+0000","last_unstale":"2024-02-21T23:01:08.788787+0000","last_undegraded":"2024-02-21T23:01:08.788787+0000","last_fullsized":"2024-02-21T23:01:08.788787+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:40:26.325368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787271+0000","last_change":"2024-02-21T23:01:07.276484+0000","last_active":"2024-02-21T23:01:08.787271+0000","last_peered":"2024-02-21T23:01:08.787271+0000","last_clean":"2024-02-21T23:01:08.787271+0000","last_became_active":"2024-02-21T23:01:07.276192+0000","last_became_peered":"2024-02-21T23:01:07.276192+0000","last_unstale":"2024-02-21T23:01:08.787271+0000","last_undegraded":"2024-02-21T23:01:08.787271+0000","last_fullsized":"2024-02-21T23:01:08.787271+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:20:59.894677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"29'2","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.789060+0000","last_change":"2024-02-21T23:01:02.221231+0000","last_active":"2024-02-21T23:01:08.789060+0000","last_peered":"2024-02-21T23:01:08.789060+0000","last_clean":"2024-02-21T23:01:08.789060+0000","last_became_active":"2024-02-21T23:01:02.220941+0000","last_became_peered":"2024-02-21T23:01:02.220941+0000","last_unstale":"2024-02-21T23:01:08.789060+0000","last_undegraded":"2024-02-21T23:01:08.789060+0000","last_fullsized":"2024-02-21T23:01:08.789060+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:17:06.353018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.790823+0000","last_change":"2024-02-21T23:01:03.219579+0000","last_active":"2024-02-21T23:01:08.790823+0000","last_peered":"2024-02-21T23:01:08.790823+0000","last_clean":"2024-02-21T23:01:08.790823+0000","last_became_active":"2024-02-21T23:01:03.219221+0000","last_became_peered":"2024-02-21T23:01:03.219221+0000","last_unstale":"2024-02-21T23:01:08.790823+0000","last_undegraded":"2024-02-21T23:01:08.790823+0000","last_fullsized":"2024-02-21T23:01:08.790823+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:41:55.485351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.260372+0000","last_change":"2024-02-21T23:01:07.268590+0000","last_active":"2024-02-21T23:01:08.260372+0000","last_peered":"2024-02-21T23:01:08.260372+0000","last_clean":"2024-02-21T23:01:08.260372+0000","last_became_active":"2024-02-21T23:01:07.268179+0000","last_became_peered":"2024-02-21T23:01:07.268179+0000","last_unstale":"2024-02-21T23:01:08.260372+0000","last_undegraded":"2024-02-21T23:01:08.260372+0000","last_fullsized":"2024-02-21T23:01:08.260372+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:20:59.894677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"29'4","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:32.393628+0000","last_change":"2024-02-21T23:01:02.208687+0000","last_active":"2024-02-21T23:01:32.393628+0000","last_peered":"2024-02-21T23:01:32.393628+0000","last_clean":"2024-02-21T23:01:32.393628+0000","last_became_active":"2024-02-21T23:01:02.208393+0000","last_became_peered":"2024-02-21T23:01:02.208393+0000","last_unstale":"2024-02-21T23:01:32.393628+0000","last_undegraded":"2024-02-21T23:01:32.393628+0000","last_fullsized":"2024-02-21T23:01:32.393628+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:41:54.477462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788050+0000","last_change":"2024-02-21T23:01:03.215676+0000","last_active":"2024-02-21T23:01:08.788050+0000","last_peered":"2024-02-21T23:01:08.788050+0000","last_clean":"2024-02-21T23:01:08.788050+0000","last_became_active":"2024-02-21T23:01:03.214733+0000","last_became_peered":"2024-02-21T23:01:03.214733+0000","last_unstale":"2024-02-21T23:01:08.788050+0000","last_undegraded":"2024-02-21T23:01:08.788050+0000","last_fullsized":"2024-02-21T23:01:08.788050+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:16.946152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.260361+0000","last_change":"2024-02-21T23:01:07.279763+0000","last_active":"2024-02-21T23:01:08.260361+0000","last_peered":"2024-02-21T23:01:08.260361+0000","last_clean":"2024-02-21T23:01:08.260361+0000","last_became_active":"2024-02-21T23:01:07.279360+0000","last_became_peered":"2024-02-21T23:01:07.279360+0000","last_unstale":"2024-02-21T23:01:08.260361+0000","last_undegraded":"2024-02-21T23:01:08.260361+0000","last_fullsized":"2024-02-21T23:01:08.260361+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:40:30.373445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.261319+0000","last_change":"2024-02-21T23:01:02.204774+0000","last_active":"2024-02-21T23:01:08.261319+0000","last_peered":"2024-02-21T23:01:08.261319+0000","last_clean":"2024-02-21T23:01:08.261319+0000","last_became_active":"2024-02-21T23:01:02.203992+0000","last_became_peered":"2024-02-21T23:01:02.203992+0000","last_unstale":"2024-02-21T23:01:08.261319+0000","last_undegraded":"2024-02-21T23:01:08.261319+0000","last_fullsized":"2024-02-21T23:01:08.261319+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:27:54.333439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1],"acting":[8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788339+0000","last_change":"2024-02-21T23:01:03.213022+0000","last_active":"2024-02-21T23:01:08.788339+0000","last_peered":"2024-02-21T23:01:08.788339+0000","last_clean":"2024-02-21T23:01:08.788339+0000","last_became_active":"2024-02-21T23:01:03.212702+0000","last_became_peered":"2024-02-21T23:01:03.212702+0000","last_unstale":"2024-02-21T23:01:08.788339+0000","last_undegraded":"2024-02-21T23:01:08.788339+0000","last_fullsized":"2024-02-21T23:01:08.788339+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:19:01.584139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.260441+0000","last_change":"2024-02-21T23:01:07.268800+0000","last_active":"2024-02-21T23:01:08.260441+0000","last_peered":"2024-02-21T23:01:08.260441+0000","last_clean":"2024-02-21T23:01:08.260441+0000","last_became_active":"2024-02-21T23:01:07.268357+0000","last_became_peered":"2024-02-21T23:01:07.268357+0000","last_unstale":"2024-02-21T23:01:08.260441+0000","last_undegraded":"2024-02-21T23:01:08.260441+0000","last_fullsized":"2024-02-21T23:01:08.260441+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:39:03.021559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787642+0000","last_change":"2024-02-21T23:01:03.213517+0000","last_active":"2024-02-21T23:01:08.787642+0000","last_peered":"2024-02-21T23:01:08.787642+0000","last_clean":"2024-02-21T23:01:08.787642+0000","last_became_active":"2024-02-21T23:01:03.213186+0000","last_became_peered":"2024-02-21T23:01:03.213186+0000","last_unstale":"2024-02-21T23:01:08.787642+0000","last_undegraded":"2024-02-21T23:01:08.787642+0000","last_fullsized":"2024-02-21T23:01:08.787642+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:40:26.325368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"29'4","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:31.383302+0000","last_change":"2024-02-21T23:01:02.208608+0000","last_active":"2024-02-21T23:01:31.383302+0000","last_peered":"2024-02-21T23:01:31.383302+0000","last_clean":"2024-02-21T23:01:31.383302+0000","last_became_active":"2024-02-21T23:01:02.208293+0000","last_became_peered":"2024-02-21T23:01:02.208293+0000","last_unstale":"2024-02-21T23:01:31.383302+0000","last_undegraded":"2024-02-21T23:01:31.383302+0000","last_fullsized":"2024-02-21T23:01:31.383302+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:58:23.554457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.260663+0000","last_change":"2024-02-21T23:01:07.651717+0000","last_active":"2024-02-21T23:01:08.260663+0000","last_peered":"2024-02-21T23:01:08.260663+0000","last_clean":"2024-02-21T23:01:08.260663+0000","last_became_active":"2024-02-21T23:01:07.651241+0000","last_became_peered":"2024-02-21T23:01:07.651241+0000","last_unstale":"2024-02-21T23:01:08.260663+0000","last_undegraded":"2024-02-21T23:01:08.260663+0000","last_fullsized":"2024-02-21T23:01:08.260663+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:54:44.380302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.791024+0000","last_change":"2024-02-21T23:01:03.221678+0000","last_active":"2024-02-21T23:01:08.791024+0000","last_peered":"2024-02-21T23:01:08.791024+0000","last_clean":"2024-02-21T23:01:08.791024+0000","last_became_active":"2024-02-21T23:01:03.219898+0000","last_became_peered":"2024-02-21T23:01:03.219898+0000","last_unstale":"2024-02-21T23:01:08.791024+0000","last_undegraded":"2024-02-21T23:01:08.791024+0000","last_fullsized":"2024-02-21T23:01:08.791024+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:47:19.366266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"29'1","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788675+0000","last_change":"2024-02-21T23:01:02.202866+0000","last_active":"2024-02-21T23:01:08.788675+0000","last_peered":"2024-02-21T23:01:08.788675+0000","last_clean":"2024-02-21T23:01:08.788675+0000","last_became_active":"2024-02-21T23:01:02.202585+0000","last_became_peered":"2024-02-21T23:01:02.202585+0000","last_unstale":"2024-02-21T23:01:08.788675+0000","last_undegraded":"2024-02-21T23:01:08.788675+0000","last_fullsized":"2024-02-21T23:01:08.788675+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:26:49.911102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"29'1","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:10.770295+0000","last_change":"2024-02-21T23:01:07.277000+0000","last_active":"2024-02-21T23:01:10.770295+0000","last_peered":"2024-02-21T23:01:10.770295+0000","last_clean":"2024-02-21T23:01:10.770295+0000","last_became_active":"2024-02-21T23:01:07.276577+0000","last_became_peered":"2024-02-21T23:01:07.276577+0000","last_unstale":"2024-02-21T23:01:10.770295+0000","last_undegraded":"2024-02-21T23:01:10.770295+0000","last_fullsized":"2024-02-21T23:01:10.770295+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:15:20.572234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787437+0000","last_change":"2024-02-21T23:01:03.219045+0000","last_active":"2024-02-21T23:01:08.787437+0000","last_peered":"2024-02-21T23:01:08.787437+0000","last_clean":"2024-02-21T23:01:08.787437+0000","last_became_active":"2024-02-21T23:01:03.218706+0000","last_became_peered":"2024-02-21T23:01:03.218706+0000","last_unstale":"2024-02-21T23:01:08.787437+0000","last_undegraded":"2024-02-21T23:01:08.787437+0000","last_fullsized":"2024-02-21T23:01:08.787437+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:41:55.485351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"29'3","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:31.386013+0000","last_change":"2024-02-21T23:01:02.208912+0000","last_active":"2024-02-21T23:01:31.386013+0000","last_peered":"2024-02-21T23:01:31.386013+0000","last_clean":"2024-02-21T23:01:31.386013+0000","last_became_active":"2024-02-21T23:01:02.208542+0000","last_became_peered":"2024-02-21T23:01:02.208542+0000","last_unstale":"2024-02-21T23:01:31.386013+0000","last_undegraded":"2024-02-21T23:01:31.386013+0000","last_fullsized":"2024-02-21T23:01:31.386013+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:02:11.724233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9],"acting":[3,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788774+0000","last_change":"2024-02-21T23:01:07.282882+0000","last_active":"2024-02-21T23:01:08.788774+0000","last_peered":"2024-02-21T23:01:08.788774+0000","last_clean":"2024-02-21T23:01:08.788774+0000","last_became_active":"2024-02-21T23:01:07.282506+0000","last_became_peered":"2024-02-21T23:01:07.282506+0000","last_unstale":"2024-02-21T23:01:08.788774+0000","last_undegraded":"2024-02-21T23:01:08.788774+0000","last_fullsized":"2024-02-21T23:01:08.788774+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:19:05.632217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.260935+0000","last_change":"2024-02-21T23:01:03.212206+0000","last_active":"2024-02-21T23:01:08.260935+0000","last_peered":"2024-02-21T23:01:08.260935+0000","last_clean":"2024-02-21T23:01:08.260935+0000","last_became_active":"2024-02-21T23:01:03.211919+0000","last_became_peered":"2024-02-21T23:01:03.211919+0000","last_unstale":"2024-02-21T23:01:08.260935+0000","last_undegraded":"2024-02-21T23:01:08.260935+0000","last_fullsized":"2024-02-21T23:01:08.260935+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:20:55.846599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"29'2","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:31.383055+0000","last_change":"2024-02-21T23:01:02.204071+0000","last_active":"2024-02-21T23:01:31.383055+0000","last_peered":"2024-02-21T23:01:31.383055+0000","last_clean":"2024-02-21T23:01:31.383055+0000","last_became_active":"2024-02-21T23:01:02.203761+0000","last_became_peered":"2024-02-21T23:01:02.203761+0000","last_unstale":"2024-02-21T23:01:31.383055+0000","last_undegraded":"2024-02-21T23:01:31.383055+0000","last_fullsized":"2024-02-21T23:01:31.383055+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:58:34.737670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.260696+0000","last_change":"2024-02-21T23:01:07.654580+0000","last_active":"2024-02-21T23:01:08.260696+0000","last_peered":"2024-02-21T23:01:08.260696+0000","last_clean":"2024-02-21T23:01:08.260696+0000","last_became_active":"2024-02-21T23:01:07.654124+0000","last_became_peered":"2024-02-21T23:01:07.654124+0000","last_unstale":"2024-02-21T23:01:08.260696+0000","last_undegraded":"2024-02-21T23:01:08.260696+0000","last_fullsized":"2024-02-21T23:01:08.260696+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:44:43.960074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.790389+0000","last_change":"2024-02-21T23:01:03.230134+0000","last_active":"2024-02-21T23:01:08.790389+0000","last_peered":"2024-02-21T23:01:08.790389+0000","last_clean":"2024-02-21T23:01:08.790389+0000","last_became_active":"2024-02-21T23:01:03.229873+0000","last_became_peered":"2024-02-21T23:01:03.229873+0000","last_unstale":"2024-02-21T23:01:08.790389+0000","last_undegraded":"2024-02-21T23:01:08.790389+0000","last_fullsized":"2024-02-21T23:01:08.790389+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:16.946152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"29'4","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:31.382861+0000","last_change":"2024-02-21T23:01:02.206586+0000","last_active":"2024-02-21T23:01:31.382861+0000","last_peered":"2024-02-21T23:01:31.382861+0000","last_clean":"2024-02-21T23:01:31.382861+0000","last_became_active":"2024-02-21T23:01:02.206230+0000","last_became_peered":"2024-02-21T23:01:02.206230+0000","last_unstale":"2024-02-21T23:01:31.382861+0000","last_undegraded":"2024-02-21T23:01:31.382861+0000","last_fullsized":"2024-02-21T23:01:31.382861+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:21:29.919968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11],"acting":[4,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788500+0000","last_change":"2024-02-21T23:01:07.252255+0000","last_active":"2024-02-21T23:01:08.788500+0000","last_peered":"2024-02-21T23:01:08.788500+0000","last_clean":"2024-02-21T23:01:08.788500+0000","last_became_active":"2024-02-21T23:01:07.251670+0000","last_became_peered":"2024-02-21T23:01:07.251670+0000","last_unstale":"2024-02-21T23:01:08.788500+0000","last_undegraded":"2024-02-21T23:01:08.788500+0000","last_fullsized":"2024-02-21T23:01:08.788500+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:39:03.021559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.789113+0000","last_change":"2024-02-21T23:01:03.207156+0000","last_active":"2024-02-21T23:01:08.789113+0000","last_peered":"2024-02-21T23:01:08.789113+0000","last_clean":"2024-02-21T23:01:08.789113+0000","last_became_active":"2024-02-21T23:01:03.206892+0000","last_became_peered":"2024-02-21T23:01:03.206892+0000","last_unstale":"2024-02-21T23:01:08.789113+0000","last_undegraded":"2024-02-21T23:01:08.789113+0000","last_fullsized":"2024-02-21T23:01:08.789113+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:19:01.584139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"29'8","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:38.217145+0000","last_change":"2024-02-21T23:01:02.209850+0000","last_active":"2024-02-21T23:01:38.217145+0000","last_peered":"2024-02-21T23:01:38.217145+0000","last_clean":"2024-02-21T23:01:38.217145+0000","last_became_active":"2024-02-21T23:01:02.209601+0000","last_became_peered":"2024-02-21T23:01:02.209601+0000","last_unstale":"2024-02-21T23:01:38.217145+0000","last_undegraded":"2024-02-21T23:01:38.217145+0000","last_fullsized":"2024-02-21T23:01:38.217145+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:36:44.497886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.789246+0000","last_change":"2024-02-21T23:01:07.651884+0000","last_active":"2024-02-21T23:01:08.789246+0000","last_peered":"2024-02-21T23:01:08.789246+0000","last_clean":"2024-02-21T23:01:08.789246+0000","last_became_active":"2024-02-21T23:01:07.651431+0000","last_became_peered":"2024-02-21T23:01:07.651431+0000","last_unstale":"2024-02-21T23:01:08.789246+0000","last_undegraded":"2024-02-21T23:01:08.789246+0000","last_fullsized":"2024-02-21T23:01:08.789246+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:37:06.063756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.263969+0000","last_change":"2024-02-21T23:01:03.221696+0000","last_active":"2024-02-21T23:01:08.263969+0000","last_peered":"2024-02-21T23:01:08.263969+0000","last_clean":"2024-02-21T23:01:08.263969+0000","last_became_active":"2024-02-21T23:01:03.221405+0000","last_became_peered":"2024-02-21T23:01:03.221405+0000","last_unstale":"2024-02-21T23:01:08.263969+0000","last_undegraded":"2024-02-21T23:01:08.263969+0000","last_fullsized":"2024-02-21T23:01:08.263969+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:45:29.610700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"29'1","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:31.383443+0000","last_change":"2024-02-21T23:01:02.221218+0000","last_active":"2024-02-21T23:01:31.383443+0000","last_peered":"2024-02-21T23:01:31.383443+0000","last_clean":"2024-02-21T23:01:31.383443+0000","last_became_active":"2024-02-21T23:01:02.220923+0000","last_became_peered":"2024-02-21T23:01:02.220923+0000","last_unstale":"2024-02-21T23:01:31.383443+0000","last_undegraded":"2024-02-21T23:01:31.383443+0000","last_fullsized":"2024-02-21T23:01:31.383443+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:15.938263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787672+0000","last_change":"2024-02-21T23:01:07.268952+0000","last_active":"2024-02-21T23:01:08.787672+0000","last_peered":"2024-02-21T23:01:08.787672+0000","last_clean":"2024-02-21T23:01:08.787672+0000","last_became_active":"2024-02-21T23:01:07.268210+0000","last_became_peered":"2024-02-21T23:01:07.268210+0000","last_unstale":"2024-02-21T23:01:08.787672+0000","last_undegraded":"2024-02-21T23:01:08.787672+0000","last_fullsized":"2024-02-21T23:01:08.787672+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:40:30.373445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.790112+0000","last_change":"2024-02-21T23:01:03.218386+0000","last_active":"2024-02-21T23:01:08.790112+0000","last_peered":"2024-02-21T23:01:08.790112+0000","last_clean":"2024-02-21T23:01:08.790112+0000","last_became_active":"2024-02-21T23:01:03.218081+0000","last_became_peered":"2024-02-21T23:01:03.218081+0000","last_unstale":"2024-02-21T23:01:08.790112+0000","last_undegraded":"2024-02-21T23:01:08.790112+0000","last_fullsized":"2024-02-21T23:01:08.790112+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:35:24.590398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788427+0000","last_change":"2024-02-21T23:01:02.207826+0000","last_active":"2024-02-21T23:01:08.788427+0000","last_peered":"2024-02-21T23:01:08.788427+0000","last_clean":"2024-02-21T23:01:08.788427+0000","last_became_active":"2024-02-21T23:01:02.206426+0000","last_became_peered":"2024-02-21T23:01:02.206426+0000","last_unstale":"2024-02-21T23:01:08.788427+0000","last_undegraded":"2024-02-21T23:01:08.788427+0000","last_fullsized":"2024-02-21T23:01:08.788427+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:17:06.353018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2],"acting":[9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.261110+0000","last_change":"2024-02-21T23:01:07.651876+0000","last_active":"2024-02-21T23:01:08.261110+0000","last_peered":"2024-02-21T23:01:08.261110+0000","last_clean":"2024-02-21T23:01:08.261110+0000","last_became_active":"2024-02-21T23:01:07.651384+0000","last_became_peered":"2024-02-21T23:01:07.651384+0000","last_unstale":"2024-02-21T23:01:08.261110+0000","last_undegraded":"2024-02-21T23:01:08.261110+0000","last_fullsized":"2024-02-21T23:01:08.261110+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:15:20.572234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.789861+0000","last_change":"2024-02-21T23:01:03.210500+0000","last_active":"2024-02-21T23:01:08.789861+0000","last_peered":"2024-02-21T23:01:08.789861+0000","last_clean":"2024-02-21T23:01:08.789861+0000","last_became_active":"2024-02-21T23:01:03.210123+0000","last_became_peered":"2024-02-21T23:01:03.210123+0000","last_unstale":"2024-02-21T23:01:08.789861+0000","last_undegraded":"2024-02-21T23:01:08.789861+0000","last_fullsized":"2024-02-21T23:01:08.789861+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:16.946152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4],"acting":[10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"29'1","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787791+0000","last_change":"2024-02-21T23:01:02.217455+0000","last_active":"2024-02-21T23:01:08.787791+0000","last_peered":"2024-02-21T23:01:08.787791+0000","last_clean":"2024-02-21T23:01:08.787791+0000","last_became_active":"2024-02-21T23:01:02.217128+0000","last_became_peered":"2024-02-21T23:01:02.217128+0000","last_unstale":"2024-02-21T23:01:08.787791+0000","last_undegraded":"2024-02-21T23:01:08.787791+0000","last_fullsized":"2024-02-21T23:01:08.787791+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:23:41.295647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.264021+0000","last_change":"2024-02-21T23:01:07.266837+0000","last_active":"2024-02-21T23:01:08.264021+0000","last_peered":"2024-02-21T23:01:08.264021+0000","last_clean":"2024-02-21T23:01:08.264021+0000","last_became_active":"2024-02-21T23:01:07.266376+0000","last_became_peered":"2024-02-21T23:01:07.266376+0000","last_unstale":"2024-02-21T23:01:08.264021+0000","last_undegraded":"2024-02-21T23:01:08.264021+0000","last_fullsized":"2024-02-21T23:01:08.264021+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:15:20.572234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787245+0000","last_change":"2024-02-21T23:01:03.212345+0000","last_active":"2024-02-21T23:01:08.787245+0000","last_peered":"2024-02-21T23:01:08.787245+0000","last_clean":"2024-02-21T23:01:08.787245+0000","last_became_active":"2024-02-21T23:01:03.212019+0000","last_became_peered":"2024-02-21T23:01:03.212019+0000","last_unstale":"2024-02-21T23:01:08.787245+0000","last_undegraded":"2024-02-21T23:01:08.787245+0000","last_fullsized":"2024-02-21T23:01:08.787245+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:20:55.846599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"29'4","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:39.409952+0000","last_change":"2024-02-21T23:01:02.219033+0000","last_active":"2024-02-21T23:01:39.409952+0000","last_peered":"2024-02-21T23:01:39.409952+0000","last_clean":"2024-02-21T23:01:39.409952+0000","last_became_active":"2024-02-21T23:01:02.218570+0000","last_became_peered":"2024-02-21T23:01:02.218570+0000","last_unstale":"2024-02-21T23:01:39.409952+0000","last_undegraded":"2024-02-21T23:01:39.409952+0000","last_fullsized":"2024-02-21T23:01:39.409952+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:21:29.919968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.264680+0000","last_change":"2024-02-21T23:01:07.654407+0000","last_active":"2024-02-21T23:01:08.264680+0000","last_peered":"2024-02-21T23:01:08.264680+0000","last_clean":"2024-02-21T23:01:08.264680+0000","last_became_active":"2024-02-21T23:01:07.653745+0000","last_became_peered":"2024-02-21T23:01:07.653745+0000","last_unstale":"2024-02-21T23:01:08.264680+0000","last_undegraded":"2024-02-21T23:01:08.264680+0000","last_fullsized":"2024-02-21T23:01:08.264680+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:54:44.380302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.262891+0000","last_change":"2024-02-21T23:01:03.226352+0000","last_active":"2024-02-21T23:01:08.262891+0000","last_peered":"2024-02-21T23:01:08.262891+0000","last_clean":"2024-02-21T23:01:08.262891+0000","last_became_active":"2024-02-21T23:01:03.219834+0000","last_became_peered":"2024-02-21T23:01:03.219834+0000","last_unstale":"2024-02-21T23:01:08.262891+0000","last_undegraded":"2024-02-21T23:01:08.262891+0000","last_fullsized":"2024-02-21T23:01:08.262891+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:16.946152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"29'3","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:32.400219+0000","last_change":"2024-02-21T23:01:02.207052+0000","last_active":"2024-02-21T23:01:32.400219+0000","last_peered":"2024-02-21T23:01:32.400219+0000","last_clean":"2024-02-21T23:01:32.400219+0000","last_became_active":"2024-02-21T23:01:02.206146+0000","last_became_peered":"2024-02-21T23:01:02.206146+0000","last_unstale":"2024-02-21T23:01:32.400219+0000","last_undegraded":"2024-02-21T23:01:32.400219+0000","last_fullsized":"2024-02-21T23:01:32.400219+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:26:49.911102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788291+0000","last_change":"2024-02-21T23:01:07.654449+0000","last_active":"2024-02-21T23:01:08.788291+0000","last_peered":"2024-02-21T23:01:08.788291+0000","last_clean":"2024-02-21T23:01:08.788291+0000","last_became_active":"2024-02-21T23:01:07.654106+0000","last_became_peered":"2024-02-21T23:01:07.654106+0000","last_unstale":"2024-02-21T23:01:08.788291+0000","last_undegraded":"2024-02-21T23:01:08.788291+0000","last_fullsized":"2024-02-21T23:01:08.788291+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:13:22.732077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788911+0000","last_change":"2024-02-21T23:01:03.209260+0000","last_active":"2024-02-21T23:01:08.788911+0000","last_peered":"2024-02-21T23:01:08.788911+0000","last_clean":"2024-02-21T23:01:08.788911+0000","last_became_active":"2024-02-21T23:01:03.209007+0000","last_became_peered":"2024-02-21T23:01:03.209007+0000","last_unstale":"2024-02-21T23:01:08.788911+0000","last_undegraded":"2024-02-21T23:01:08.788911+0000","last_fullsized":"2024-02-21T23:01:08.788911+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:54:32.196725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"29'3","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:33.394582+0000","last_change":"2024-02-21T23:01:02.203395+0000","last_active":"2024-02-21T23:01:33.394582+0000","last_peered":"2024-02-21T23:01:33.394582+0000","last_clean":"2024-02-21T23:01:33.394582+0000","last_became_active":"2024-02-21T23:01:02.203066+0000","last_became_peered":"2024-02-21T23:01:02.203066+0000","last_unstale":"2024-02-21T23:01:33.394582+0000","last_undegraded":"2024-02-21T23:01:33.394582+0000","last_fullsized":"2024-02-21T23:01:33.394582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:26:49.911102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":211,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787659+0000","last_change":"2024-02-21T23:00:58.830752+0000","last_active":"2024-02-21T23:01:08.787659+0000","last_peered":"2024-02-21T23:01:08.787659+0000","last_clean":"2024-02-21T23:01:08.787659+0000","last_became_active":"2024-02-21T23:00:58.830472+0000","last_became_peered":"2024-02-21T23:00:58.830472+0000","last_unstale":"2024-02-21T23:01:08.787659+0000","last_undegraded":"2024-02-21T23:01:08.787659+0000","last_fullsized":"2024-02-21T23:01:08.787659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:00:57.811198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:00:57.811198+0000","last_clean_scrub_stamp":"2024-02-21T23:00:57.811198+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:58:31.374266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"29'1","reported_seq":15,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:10.774025+0000","last_change":"2024-02-21T23:01:07.276992+0000","last_active":"2024-02-21T23:01:10.774025+0000","last_peered":"2024-02-21T23:01:10.774025+0000","last_clean":"2024-02-21T23:01:10.774025+0000","last_became_active":"2024-02-21T23:01:07.276489+0000","last_became_peered":"2024-02-21T23:01:07.276489+0000","last_unstale":"2024-02-21T23:01:10.774025+0000","last_undegraded":"2024-02-21T23:01:10.774025+0000","last_fullsized":"2024-02-21T23:01:10.774025+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:02:35.072200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788021+0000","last_change":"2024-02-21T23:01:03.216192+0000","last_active":"2024-02-21T23:01:08.788021+0000","last_peered":"2024-02-21T23:01:08.788021+0000","last_clean":"2024-02-21T23:01:08.788021+0000","last_became_active":"2024-02-21T23:01:03.215904+0000","last_became_peered":"2024-02-21T23:01:03.215904+0000","last_unstale":"2024-02-21T23:01:08.788021+0000","last_undegraded":"2024-02-21T23:01:08.788021+0000","last_fullsized":"2024-02-21T23:01:08.788021+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:15:16.524157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"29'3","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:32.394144+0000","last_change":"2024-02-21T23:01:02.207406+0000","last_active":"2024-02-21T23:01:32.394144+0000","last_peered":"2024-02-21T23:01:32.394144+0000","last_clean":"2024-02-21T23:01:32.394144+0000","last_became_active":"2024-02-21T23:01:02.206219+0000","last_became_peered":"2024-02-21T23:01:02.206219+0000","last_unstale":"2024-02-21T23:01:32.394144+0000","last_undegraded":"2024-02-21T23:01:32.394144+0000","last_fullsized":"2024-02-21T23:01:32.394144+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:21:29.919968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11],"acting":[2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787626+0000","last_change":"2024-02-21T23:01:07.265822+0000","last_active":"2024-02-21T23:01:08.787626+0000","last_peered":"2024-02-21T23:01:08.787626+0000","last_clean":"2024-02-21T23:01:08.787626+0000","last_became_active":"2024-02-21T23:01:07.265401+0000","last_became_peered":"2024-02-21T23:01:07.265401+0000","last_unstale":"2024-02-21T23:01:08.787626+0000","last_undegraded":"2024-02-21T23:01:08.787626+0000","last_fullsized":"2024-02-21T23:01:08.787626+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:47:23.414344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787838+0000","last_change":"2024-02-21T23:01:03.220586+0000","last_active":"2024-02-21T23:01:08.787838+0000","last_peered":"2024-02-21T23:01:08.787838+0000","last_clean":"2024-02-21T23:01:08.787838+0000","last_became_active":"2024-02-21T23:01:03.220349+0000","last_became_peered":"2024-02-21T23:01:03.220349+0000","last_unstale":"2024-02-21T23:01:08.787838+0000","last_undegraded":"2024-02-21T23:01:08.787838+0000","last_fullsized":"2024-02-21T23:01:08.787838+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:20:55.846599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788533+0000","last_change":"2024-02-21T23:01:02.206319+0000","last_active":"2024-02-21T23:01:08.788533+0000","last_peered":"2024-02-21T23:01:08.788533+0000","last_clean":"2024-02-21T23:01:08.788533+0000","last_became_active":"2024-02-21T23:01:02.205747+0000","last_became_peered":"2024-02-21T23:01:02.205747+0000","last_unstale":"2024-02-21T23:01:08.788533+0000","last_undegraded":"2024-02-21T23:01:08.788533+0000","last_fullsized":"2024-02-21T23:01:08.788533+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:10:09.680115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10],"acting":[5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.789983+0000","last_change":"2024-02-21T23:01:07.280592+0000","last_active":"2024-02-21T23:01:08.789983+0000","last_peered":"2024-02-21T23:01:08.789983+0000","last_clean":"2024-02-21T23:01:08.789983+0000","last_became_active":"2024-02-21T23:01:07.280193+0000","last_became_peered":"2024-02-21T23:01:07.280193+0000","last_unstale":"2024-02-21T23:01:08.789983+0000","last_undegraded":"2024-02-21T23:01:08.789983+0000","last_fullsized":"2024-02-21T23:01:08.789983+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:40:30.373445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788267+0000","last_change":"2024-02-21T23:01:03.216834+0000","last_active":"2024-02-21T23:01:08.788267+0000","last_peered":"2024-02-21T23:01:08.788267+0000","last_clean":"2024-02-21T23:01:08.788267+0000","last_became_active":"2024-02-21T23:01:03.216578+0000","last_became_peered":"2024-02-21T23:01:03.216578+0000","last_unstale":"2024-02-21T23:01:08.788267+0000","last_undegraded":"2024-02-21T23:01:08.788267+0000","last_fullsized":"2024-02-21T23:01:08.788267+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:37:02.015678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.264532+0000","last_change":"2024-02-21T23:01:02.220913+0000","last_active":"2024-02-21T23:01:08.264532+0000","last_peered":"2024-02-21T23:01:08.264532+0000","last_clean":"2024-02-21T23:01:08.264532+0000","last_became_active":"2024-02-21T23:01:02.220554+0000","last_became_peered":"2024-02-21T23:01:02.220554+0000","last_unstale":"2024-02-21T23:01:08.264532+0000","last_undegraded":"2024-02-21T23:01:08.264532+0000","last_fullsized":"2024-02-21T23:01:08.264532+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:36:44.497886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787182+0000","last_change":"2024-02-21T23:01:07.257431+0000","last_active":"2024-02-21T23:01:08.787182+0000","last_peered":"2024-02-21T23:01:08.787182+0000","last_clean":"2024-02-21T23:01:08.787182+0000","last_became_active":"2024-02-21T23:01:07.257011+0000","last_became_peered":"2024-02-21T23:01:07.257011+0000","last_unstale":"2024-02-21T23:01:08.787182+0000","last_undegraded":"2024-02-21T23:01:08.787182+0000","last_fullsized":"2024-02-21T23:01:08.787182+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:44:43.960074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787848+0000","last_change":"2024-02-21T23:01:03.211792+0000","last_active":"2024-02-21T23:01:08.787848+0000","last_peered":"2024-02-21T23:01:08.787848+0000","last_clean":"2024-02-21T23:01:08.787848+0000","last_became_active":"2024-02-21T23:01:03.211467+0000","last_became_peered":"2024-02-21T23:01:03.211467+0000","last_unstale":"2024-02-21T23:01:08.787848+0000","last_undegraded":"2024-02-21T23:01:08.787848+0000","last_fullsized":"2024-02-21T23:01:08.787848+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:54:32.196725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"29'2","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:33.392458+0000","last_change":"2024-02-21T23:01:02.211763+0000","last_active":"2024-02-21T23:01:33.392458+0000","last_peered":"2024-02-21T23:01:33.392458+0000","last_clean":"2024-02-21T23:01:33.392458+0000","last_became_active":"2024-02-21T23:01:02.211470+0000","last_became_peered":"2024-02-21T23:01:02.211470+0000","last_unstale":"2024-02-21T23:01:33.392458+0000","last_undegraded":"2024-02-21T23:01:33.392458+0000","last_fullsized":"2024-02-21T23:01:33.392458+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:23:41.295647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5],"acting":[8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787817+0000","last_change":"2024-02-21T23:01:07.269076+0000","last_active":"2024-02-21T23:01:08.787817+0000","last_peered":"2024-02-21T23:01:08.787817+0000","last_clean":"2024-02-21T23:01:08.787817+0000","last_became_active":"2024-02-21T23:01:07.268681+0000","last_became_peered":"2024-02-21T23:01:07.268681+0000","last_unstale":"2024-02-21T23:01:08.787817+0000","last_undegraded":"2024-02-21T23:01:08.787817+0000","last_fullsized":"2024-02-21T23:01:08.787817+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:02:35.072200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787945+0000","last_change":"2024-02-21T23:01:03.212943+0000","last_active":"2024-02-21T23:01:08.787945+0000","last_peered":"2024-02-21T23:01:08.787945+0000","last_clean":"2024-02-21T23:01:08.787945+0000","last_became_active":"2024-02-21T23:01:03.212634+0000","last_became_peered":"2024-02-21T23:01:03.212634+0000","last_unstale":"2024-02-21T23:01:08.787945+0000","last_undegraded":"2024-02-21T23:01:08.787945+0000","last_fullsized":"2024-02-21T23:01:08.787945+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:07:50.626867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"29'15","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:32.399647+0000","last_change":"2024-02-21T23:01:02.221957+0000","last_active":"2024-02-21T23:01:32.399647+0000","last_peered":"2024-02-21T23:01:32.399647+0000","last_clean":"2024-02-21T23:01:32.399647+0000","last_became_active":"2024-02-21T23:01:02.221642+0000","last_became_peered":"2024-02-21T23:01:02.221642+0000","last_unstale":"2024-02-21T23:01:32.399647+0000","last_undegraded":"2024-02-21T23:01:32.399647+0000","last_fullsized":"2024-02-21T23:01:32.399647+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:10:09.680115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.264659+0000","last_change":"2024-02-21T23:01:07.268330+0000","last_active":"2024-02-21T23:01:08.264659+0000","last_peered":"2024-02-21T23:01:08.264659+0000","last_clean":"2024-02-21T23:01:08.264659+0000","last_became_active":"2024-02-21T23:01:07.267874+0000","last_became_peered":"2024-02-21T23:01:07.267874+0000","last_unstale":"2024-02-21T23:01:08.264659+0000","last_undegraded":"2024-02-21T23:01:08.264659+0000","last_fullsized":"2024-02-21T23:01:08.264659+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:37:06.063756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787335+0000","last_change":"2024-02-21T23:01:03.216774+0000","last_active":"2024-02-21T23:01:08.787335+0000","last_peered":"2024-02-21T23:01:08.787335+0000","last_clean":"2024-02-21T23:01:08.787335+0000","last_became_active":"2024-02-21T23:01:03.216466+0000","last_became_peered":"2024-02-21T23:01:03.216466+0000","last_unstale":"2024-02-21T23:01:08.787335+0000","last_undegraded":"2024-02-21T23:01:08.787335+0000","last_fullsized":"2024-02-21T23:01:08.787335+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:07:50.626867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"29'3","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:39.410484+0000","last_change":"2024-02-21T23:01:02.199060+0000","last_active":"2024-02-21T23:01:39.410484+0000","last_peered":"2024-02-21T23:01:39.410484+0000","last_clean":"2024-02-21T23:01:39.410484+0000","last_became_active":"2024-02-21T23:01:02.198709+0000","last_became_peered":"2024-02-21T23:01:02.198709+0000","last_unstale":"2024-02-21T23:01:39.410484+0000","last_undegraded":"2024-02-21T23:01:39.410484+0000","last_fullsized":"2024-02-21T23:01:39.410484+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:36:44.497886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788751+0000","last_change":"2024-02-21T23:01:07.278031+0000","last_active":"2024-02-21T23:01:08.788751+0000","last_peered":"2024-02-21T23:01:08.788751+0000","last_clean":"2024-02-21T23:01:08.788751+0000","last_became_active":"2024-02-21T23:01:07.277289+0000","last_became_peered":"2024-02-21T23:01:07.277289+0000","last_unstale":"2024-02-21T23:01:08.788751+0000","last_undegraded":"2024-02-21T23:01:08.788751+0000","last_fullsized":"2024-02-21T23:01:08.788751+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:07:54.674944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787653+0000","last_change":"2024-02-21T23:01:03.214805+0000","last_active":"2024-02-21T23:01:08.787653+0000","last_peered":"2024-02-21T23:01:08.787653+0000","last_clean":"2024-02-21T23:01:08.787653+0000","last_became_active":"2024-02-21T23:01:03.214507+0000","last_became_peered":"2024-02-21T23:01:03.214507+0000","last_unstale":"2024-02-21T23:01:08.787653+0000","last_undegraded":"2024-02-21T23:01:08.787653+0000","last_fullsized":"2024-02-21T23:01:08.787653+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:38:58.973481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"29'3","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:31.386164+0000","last_change":"2024-02-21T23:01:02.209351+0000","last_active":"2024-02-21T23:01:31.386164+0000","last_peered":"2024-02-21T23:01:31.386164+0000","last_clean":"2024-02-21T23:01:31.386164+0000","last_became_active":"2024-02-21T23:01:02.208990+0000","last_became_peered":"2024-02-21T23:01:02.208990+0000","last_unstale":"2024-02-21T23:01:31.386164+0000","last_undegraded":"2024-02-21T23:01:31.386164+0000","last_fullsized":"2024-02-21T23:01:31.386164+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:36:44.497886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787720+0000","last_change":"2024-02-21T23:01:07.280069+0000","last_active":"2024-02-21T23:01:08.787720+0000","last_peered":"2024-02-21T23:01:08.787720+0000","last_clean":"2024-02-21T23:01:08.787720+0000","last_became_active":"2024-02-21T23:01:07.279657+0000","last_became_peered":"2024-02-21T23:01:07.279657+0000","last_unstale":"2024-02-21T23:01:08.787720+0000","last_undegraded":"2024-02-21T23:01:08.787720+0000","last_fullsized":"2024-02-21T23:01:08.787720+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:19:05.632217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.263316+0000","last_change":"2024-02-21T23:01:03.226321+0000","last_active":"2024-02-21T23:01:08.263316+0000","last_peered":"2024-02-21T23:01:08.263316+0000","last_clean":"2024-02-21T23:01:08.263316+0000","last_became_active":"2024-02-21T23:01:03.224451+0000","last_became_peered":"2024-02-21T23:01:03.224451+0000","last_unstale":"2024-02-21T23:01:08.263316+0000","last_undegraded":"2024-02-21T23:01:08.263316+0000","last_fullsized":"2024-02-21T23:01:08.263316+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:35:24.590398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"29'6","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:32.393944+0000","last_change":"2024-02-21T23:01:02.203410+0000","last_active":"2024-02-21T23:01:32.393944+0000","last_peered":"2024-02-21T23:01:32.393944+0000","last_clean":"2024-02-21T23:01:32.393944+0000","last_became_active":"2024-02-21T23:01:02.203081+0000","last_became_peered":"2024-02-21T23:01:02.203081+0000","last_unstale":"2024-02-21T23:01:32.393944+0000","last_undegraded":"2024-02-21T23:01:32.393944+0000","last_fullsized":"2024-02-21T23:01:32.393944+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:36:44.497886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10],"acting":[2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788275+0000","last_change":"2024-02-21T23:01:07.268810+0000","last_active":"2024-02-21T23:01:08.788275+0000","last_peered":"2024-02-21T23:01:08.788275+0000","last_clean":"2024-02-21T23:01:08.788275+0000","last_became_active":"2024-02-21T23:01:07.268436+0000","last_became_peered":"2024-02-21T23:01:07.268436+0000","last_unstale":"2024-02-21T23:01:08.788275+0000","last_undegraded":"2024-02-21T23:01:08.788275+0000","last_fullsized":"2024-02-21T23:01:08.788275+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:10:53.452033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.261462+0000","last_change":"2024-02-21T23:01:03.216176+0000","last_active":"2024-02-21T23:01:08.261462+0000","last_peered":"2024-02-21T23:01:08.261462+0000","last_clean":"2024-02-21T23:01:08.261462+0000","last_became_active":"2024-02-21T23:01:03.215888+0000","last_became_peered":"2024-02-21T23:01:03.215888+0000","last_unstale":"2024-02-21T23:01:08.261462+0000","last_undegraded":"2024-02-21T23:01:08.261462+0000","last_fullsized":"2024-02-21T23:01:08.261462+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:07:50.626867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"29'25","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:40.419249+0000","last_change":"2024-02-21T23:01:02.204595+0000","last_active":"2024-02-21T23:01:40.419249+0000","last_peered":"2024-02-21T23:01:40.419249+0000","last_clean":"2024-02-21T23:01:40.419249+0000","last_became_active":"2024-02-21T23:01:02.204123+0000","last_became_peered":"2024-02-21T23:01:02.204123+0000","last_unstale":"2024-02-21T23:01:40.419249+0000","last_undegraded":"2024-02-21T23:01:40.419249+0000","last_fullsized":"2024-02-21T23:01:40.419249+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:36:44.497886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46525,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":21,"num_read_kb":56,"num_write":26,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1],"acting":[10,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788601+0000","last_change":"2024-02-21T23:01:07.275187+0000","last_active":"2024-02-21T23:01:08.788601+0000","last_peered":"2024-02-21T23:01:08.788601+0000","last_clean":"2024-02-21T23:01:08.788601+0000","last_became_active":"2024-02-21T23:01:07.265618+0000","last_became_peered":"2024-02-21T23:01:07.265618+0000","last_unstale":"2024-02-21T23:01:08.788601+0000","last_undegraded":"2024-02-21T23:01:08.788601+0000","last_fullsized":"2024-02-21T23:01:08.788601+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:47:23.414344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788154+0000","last_change":"2024-02-21T23:01:03.216300+0000","last_active":"2024-02-21T23:01:08.788154+0000","last_peered":"2024-02-21T23:01:08.788154+0000","last_clean":"2024-02-21T23:01:08.788154+0000","last_became_active":"2024-02-21T23:01:03.214580+0000","last_became_peered":"2024-02-21T23:01:03.214580+0000","last_unstale":"2024-02-21T23:01:08.788154+0000","last_undegraded":"2024-02-21T23:01:08.788154+0000","last_fullsized":"2024-02-21T23:01:08.788154+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:41:55.485351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8],"acting":[1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"29'4","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:31.383505+0000","last_change":"2024-02-21T23:01:02.222064+0000","last_active":"2024-02-21T23:01:31.383505+0000","last_peered":"2024-02-21T23:01:31.383505+0000","last_clean":"2024-02-21T23:01:31.383505+0000","last_became_active":"2024-02-21T23:01:02.221735+0000","last_became_peered":"2024-02-21T23:01:02.221735+0000","last_unstale":"2024-02-21T23:01:31.383505+0000","last_undegraded":"2024-02-21T23:01:31.383505+0000","last_fullsized":"2024-02-21T23:01:31.383505+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:23:41.295647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.260510+0000","last_change":"2024-02-21T23:01:07.276469+0000","last_active":"2024-02-21T23:01:08.260510+0000","last_peered":"2024-02-21T23:01:08.260510+0000","last_clean":"2024-02-21T23:01:08.260510+0000","last_became_active":"2024-02-21T23:01:07.275982+0000","last_became_peered":"2024-02-21T23:01:07.275982+0000","last_unstale":"2024-02-21T23:01:08.260510+0000","last_undegraded":"2024-02-21T23:01:08.260510+0000","last_fullsized":"2024-02-21T23:01:08.260510+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:37:06.063756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.790923+0000","last_change":"2024-02-21T23:01:03.229449+0000","last_active":"2024-02-21T23:01:08.790923+0000","last_peered":"2024-02-21T23:01:08.790923+0000","last_clean":"2024-02-21T23:01:08.790923+0000","last_became_active":"2024-02-21T23:01:03.229193+0000","last_became_peered":"2024-02-21T23:01:03.229193+0000","last_unstale":"2024-02-21T23:01:08.790923+0000","last_undegraded":"2024-02-21T23:01:08.790923+0000","last_fullsized":"2024-02-21T23:01:08.790923+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:35:24.590398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"29'2","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:31.382240+0000","last_change":"2024-02-21T23:01:02.197598+0000","last_active":"2024-02-21T23:01:31.382240+0000","last_peered":"2024-02-21T23:01:31.382240+0000","last_clean":"2024-02-21T23:01:31.382240+0000","last_became_active":"2024-02-21T23:01:02.197275+0000","last_became_peered":"2024-02-21T23:01:02.197275+0000","last_unstale":"2024-02-21T23:01:31.382240+0000","last_undegraded":"2024-02-21T23:01:31.382240+0000","last_fullsized":"2024-02-21T23:01:31.382240+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:36:44.497886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788046+0000","last_change":"2024-02-21T23:01:07.278576+0000","last_active":"2024-02-21T23:01:08.788046+0000","last_peered":"2024-02-21T23:01:08.788046+0000","last_clean":"2024-02-21T23:01:08.788046+0000","last_became_active":"2024-02-21T23:01:07.276078+0000","last_became_peered":"2024-02-21T23:01:07.276078+0000","last_unstale":"2024-02-21T23:01:08.788046+0000","last_undegraded":"2024-02-21T23:01:08.788046+0000","last_fullsized":"2024-02-21T23:01:08.788046+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:45:33.658778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788387+0000","last_change":"2024-02-21T23:01:03.215454+0000","last_active":"2024-02-21T23:01:08.788387+0000","last_peered":"2024-02-21T23:01:08.788387+0000","last_clean":"2024-02-21T23:01:08.788387+0000","last_became_active":"2024-02-21T23:01:03.215004+0000","last_became_peered":"2024-02-21T23:01:03.215004+0000","last_unstale":"2024-02-21T23:01:08.788387+0000","last_undegraded":"2024-02-21T23:01:08.788387+0000","last_fullsized":"2024-02-21T23:01:08.788387+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:27:55.341328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"29'3","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:39.405642+0000","last_change":"2024-02-21T23:01:02.207663+0000","last_active":"2024-02-21T23:01:39.405642+0000","last_peered":"2024-02-21T23:01:39.405642+0000","last_clean":"2024-02-21T23:01:39.405642+0000","last_became_active":"2024-02-21T23:01:02.207349+0000","last_became_peered":"2024-02-21T23:01:02.207349+0000","last_unstale":"2024-02-21T23:01:39.405642+0000","last_undegraded":"2024-02-21T23:01:39.405642+0000","last_fullsized":"2024-02-21T23:01:39.405642+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:21:29.919968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5],"acting":[10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.790535+0000","last_change":"2024-02-21T23:01:07.268655+0000","last_active":"2024-02-21T23:01:08.790535+0000","last_peered":"2024-02-21T23:01:08.790535+0000","last_clean":"2024-02-21T23:01:08.790535+0000","last_became_active":"2024-02-21T23:01:07.268193+0000","last_became_peered":"2024-02-21T23:01:07.268193+0000","last_unstale":"2024-02-21T23:01:08.790535+0000","last_undegraded":"2024-02-21T23:01:08.790535+0000","last_fullsized":"2024-02-21T23:01:08.790535+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:54:44.380302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.790242+0000","last_change":"2024-02-21T23:01:07.271441+0000","last_active":"2024-02-21T23:01:08.790242+0000","last_peered":"2024-02-21T23:01:08.790242+0000","last_clean":"2024-02-21T23:01:08.790242+0000","last_became_active":"2024-02-21T23:01:07.271175+0000","last_became_peered":"2024-02-21T23:01:07.271175+0000","last_unstale":"2024-02-21T23:01:08.790242+0000","last_undegraded":"2024-02-21T23:01:08.790242+0000","last_fullsized":"2024-02-21T23:01:08.790242+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:20:59.894677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788169+0000","last_change":"2024-02-21T23:01:03.210855+0000","last_active":"2024-02-21T23:01:08.788169+0000","last_peered":"2024-02-21T23:01:08.788169+0000","last_clean":"2024-02-21T23:01:08.788169+0000","last_became_active":"2024-02-21T23:01:03.210599+0000","last_became_peered":"2024-02-21T23:01:03.210599+0000","last_unstale":"2024-02-21T23:01:08.788169+0000","last_undegraded":"2024-02-21T23:01:08.788169+0000","last_fullsized":"2024-02-21T23:01:08.788169+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:27:55.341328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"29'1","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788133+0000","last_change":"2024-02-21T23:01:02.204603+0000","last_active":"2024-02-21T23:01:08.788133+0000","last_peered":"2024-02-21T23:01:08.788133+0000","last_clean":"2024-02-21T23:01:08.788133+0000","last_became_active":"2024-02-21T23:01:02.204304+0000","last_became_peered":"2024-02-21T23:01:02.204304+0000","last_unstale":"2024-02-21T23:01:08.788133+0000","last_undegraded":"2024-02-21T23:01:08.788133+0000","last_fullsized":"2024-02-21T23:01:08.788133+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:58:23.554457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787929+0000","last_change":"2024-02-21T23:01:07.284000+0000","last_active":"2024-02-21T23:01:08.787929+0000","last_peered":"2024-02-21T23:01:08.787929+0000","last_clean":"2024-02-21T23:01:08.787929+0000","last_became_active":"2024-02-21T23:01:07.283568+0000","last_became_peered":"2024-02-21T23:01:07.283568+0000","last_unstale":"2024-02-21T23:01:08.787929+0000","last_undegraded":"2024-02-21T23:01:08.787929+0000","last_fullsized":"2024-02-21T23:01:08.787929+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:20:59.894677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.789445+0000","last_change":"2024-02-21T23:01:03.208483+0000","last_active":"2024-02-21T23:01:08.789445+0000","last_peered":"2024-02-21T23:01:08.789445+0000","last_clean":"2024-02-21T23:01:08.789445+0000","last_became_active":"2024-02-21T23:01:03.208141+0000","last_became_peered":"2024-02-21T23:01:03.208141+0000","last_unstale":"2024-02-21T23:01:08.789445+0000","last_undegraded":"2024-02-21T23:01:08.789445+0000","last_fullsized":"2024-02-21T23:01:08.789445+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:35:24.590398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"29'2","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:32.395096+0000","last_change":"2024-02-21T23:01:02.218826+0000","last_active":"2024-02-21T23:01:32.395096+0000","last_peered":"2024-02-21T23:01:32.395096+0000","last_clean":"2024-02-21T23:01:32.395096+0000","last_became_active":"2024-02-21T23:01:02.218499+0000","last_became_peered":"2024-02-21T23:01:02.218499+0000","last_unstale":"2024-02-21T23:01:32.395096+0000","last_undegraded":"2024-02-21T23:01:32.395096+0000","last_fullsized":"2024-02-21T23:01:32.395096+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:17:06.353018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"29'3","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:32.398649+0000","last_change":"2024-02-21T23:01:02.209061+0000","last_active":"2024-02-21T23:01:32.398649+0000","last_peered":"2024-02-21T23:01:32.398649+0000","last_clean":"2024-02-21T23:01:32.398649+0000","last_became_active":"2024-02-21T23:01:02.208779+0000","last_became_peered":"2024-02-21T23:01:02.208779+0000","last_unstale":"2024-02-21T23:01:32.398649+0000","last_undegraded":"2024-02-21T23:01:32.398649+0000","last_fullsized":"2024-02-21T23:01:32.398649+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:17:06.353018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8],"acting":[10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787944+0000","last_change":"2024-02-21T23:01:03.212873+0000","last_active":"2024-02-21T23:01:08.787944+0000","last_peered":"2024-02-21T23:01:08.787944+0000","last_clean":"2024-02-21T23:01:08.787944+0000","last_became_active":"2024-02-21T23:01:03.212560+0000","last_became_peered":"2024-02-21T23:01:03.212560+0000","last_unstale":"2024-02-21T23:01:08.787944+0000","last_undegraded":"2024-02-21T23:01:08.787944+0000","last_fullsized":"2024-02-21T23:01:08.787944+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:47:19.366266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788832+0000","last_change":"2024-02-21T23:01:07.269266+0000","last_active":"2024-02-21T23:01:08.788832+0000","last_peered":"2024-02-21T23:01:08.788832+0000","last_clean":"2024-02-21T23:01:08.788832+0000","last_became_active":"2024-02-21T23:01:07.267796+0000","last_became_peered":"2024-02-21T23:01:07.267796+0000","last_unstale":"2024-02-21T23:01:08.788832+0000","last_undegraded":"2024-02-21T23:01:08.788832+0000","last_fullsized":"2024-02-21T23:01:08.788832+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:37:06.063756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"29'6","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:39.406449+0000","last_change":"2024-02-21T23:01:02.206398+0000","last_active":"2024-02-21T23:01:39.406449+0000","last_peered":"2024-02-21T23:01:39.406449+0000","last_clean":"2024-02-21T23:01:39.406449+0000","last_became_active":"2024-02-21T23:01:02.206069+0000","last_became_peered":"2024-02-21T23:01:02.206069+0000","last_unstale":"2024-02-21T23:01:39.406449+0000","last_undegraded":"2024-02-21T23:01:39.406449+0000","last_fullsized":"2024-02-21T23:01:39.406449+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:26:49.911102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1017,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.261164+0000","last_change":"2024-02-21T23:01:03.221228+0000","last_active":"2024-02-21T23:01:08.261164+0000","last_peered":"2024-02-21T23:01:08.261164+0000","last_clean":"2024-02-21T23:01:08.261164+0000","last_became_active":"2024-02-21T23:01:03.220900+0000","last_became_peered":"2024-02-21T23:01:03.220900+0000","last_unstale":"2024-02-21T23:01:08.261164+0000","last_undegraded":"2024-02-21T23:01:08.261164+0000","last_fullsized":"2024-02-21T23:01:08.261164+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:40:26.325368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9],"acting":[8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788794+0000","last_change":"2024-02-21T23:01:07.257004+0000","last_active":"2024-02-21T23:01:08.788794+0000","last_peered":"2024-02-21T23:01:08.788794+0000","last_clean":"2024-02-21T23:01:08.788794+0000","last_became_active":"2024-02-21T23:01:07.256474+0000","last_became_peered":"2024-02-21T23:01:07.256474+0000","last_unstale":"2024-02-21T23:01:08.788794+0000","last_undegraded":"2024-02-21T23:01:08.788794+0000","last_fullsized":"2024-02-21T23:01:08.788794+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:15:20.572234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787395+0000","last_change":"2024-02-21T23:01:03.215942+0000","last_active":"2024-02-21T23:01:08.787395+0000","last_peered":"2024-02-21T23:01:08.787395+0000","last_clean":"2024-02-21T23:01:08.787395+0000","last_became_active":"2024-02-21T23:01:03.215461+0000","last_became_peered":"2024-02-21T23:01:03.215461+0000","last_unstale":"2024-02-21T23:01:08.787395+0000","last_undegraded":"2024-02-21T23:01:08.787395+0000","last_fullsized":"2024-02-21T23:01:08.787395+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:27:55.341328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788755+0000","last_change":"2024-02-21T23:01:03.215959+0000","last_active":"2024-02-21T23:01:08.788755+0000","last_peered":"2024-02-21T23:01:08.788755+0000","last_clean":"2024-02-21T23:01:08.788755+0000","last_became_active":"2024-02-21T23:01:03.215639+0000","last_became_peered":"2024-02-21T23:01:03.215639+0000","last_unstale":"2024-02-21T23:01:08.788755+0000","last_undegraded":"2024-02-21T23:01:08.788755+0000","last_fullsized":"2024-02-21T23:01:08.788755+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:16.946152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787323+0000","last_change":"2024-02-21T23:01:03.218687+0000","last_active":"2024-02-21T23:01:08.787323+0000","last_peered":"2024-02-21T23:01:08.787323+0000","last_clean":"2024-02-21T23:01:08.787323+0000","last_became_active":"2024-02-21T23:01:03.218377+0000","last_became_peered":"2024-02-21T23:01:03.218377+0000","last_unstale":"2024-02-21T23:01:08.787323+0000","last_undegraded":"2024-02-21T23:01:08.787323+0000","last_fullsized":"2024-02-21T23:01:08.787323+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:41:55.485351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.790033+0000","last_change":"2024-02-21T23:01:03.225342+0000","last_active":"2024-02-21T23:01:08.790033+0000","last_peered":"2024-02-21T23:01:08.790033+0000","last_clean":"2024-02-21T23:01:08.790033+0000","last_became_active":"2024-02-21T23:01:03.225085+0000","last_became_peered":"2024-02-21T23:01:03.225085+0000","last_unstale":"2024-02-21T23:01:08.790033+0000","last_undegraded":"2024-02-21T23:01:08.790033+0000","last_fullsized":"2024-02-21T23:01:08.790033+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:54:32.196725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.263829+0000","last_change":"2024-02-21T23:01:03.226259+0000","last_active":"2024-02-21T23:01:08.263829+0000","last_peered":"2024-02-21T23:01:08.263829+0000","last_clean":"2024-02-21T23:01:08.263829+0000","last_became_active":"2024-02-21T23:01:03.225925+0000","last_became_peered":"2024-02-21T23:01:03.225925+0000","last_unstale":"2024-02-21T23:01:08.263829+0000","last_undegraded":"2024-02-21T23:01:08.263829+0000","last_fullsized":"2024-02-21T23:01:08.263829+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:54:32.196725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788416+0000","last_change":"2024-02-21T23:01:03.215186+0000","last_active":"2024-02-21T23:01:08.788416+0000","last_peered":"2024-02-21T23:01:08.788416+0000","last_clean":"2024-02-21T23:01:08.788416+0000","last_became_active":"2024-02-21T23:01:03.214488+0000","last_became_peered":"2024-02-21T23:01:03.214488+0000","last_unstale":"2024-02-21T23:01:08.788416+0000","last_undegraded":"2024-02-21T23:01:08.788416+0000","last_fullsized":"2024-02-21T23:01:08.788416+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:58:24.562346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8],"acting":[11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788754+0000","last_change":"2024-02-21T23:01:03.208734+0000","last_active":"2024-02-21T23:01:08.788754+0000","last_peered":"2024-02-21T23:01:08.788754+0000","last_clean":"2024-02-21T23:01:08.788754+0000","last_became_active":"2024-02-21T23:01:03.208458+0000","last_became_peered":"2024-02-21T23:01:03.208458+0000","last_unstale":"2024-02-21T23:01:08.788754+0000","last_undegraded":"2024-02-21T23:01:08.788754+0000","last_fullsized":"2024-02-21T23:01:08.788754+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:54:32.196725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8],"acting":[2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788958+0000","last_change":"2024-02-21T23:01:03.206669+0000","last_active":"2024-02-21T23:01:08.788958+0000","last_peered":"2024-02-21T23:01:08.788958+0000","last_clean":"2024-02-21T23:01:08.788958+0000","last_became_active":"2024-02-21T23:01:03.206376+0000","last_became_peered":"2024-02-21T23:01:03.206376+0000","last_unstale":"2024-02-21T23:01:08.788958+0000","last_undegraded":"2024-02-21T23:01:08.788958+0000","last_fullsized":"2024-02-21T23:01:08.788958+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:07:50.626867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787194+0000","last_change":"2024-02-21T23:01:03.215459+0000","last_active":"2024-02-21T23:01:08.787194+0000","last_peered":"2024-02-21T23:01:08.787194+0000","last_clean":"2024-02-21T23:01:08.787194+0000","last_became_active":"2024-02-21T23:01:03.214922+0000","last_became_peered":"2024-02-21T23:01:03.214922+0000","last_unstale":"2024-02-21T23:01:08.787194+0000","last_undegraded":"2024-02-21T23:01:08.787194+0000","last_fullsized":"2024-02-21T23:01:08.787194+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:40:26.325368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.790310+0000","last_change":"2024-02-21T23:01:03.213687+0000","last_active":"2024-02-21T23:01:08.790310+0000","last_peered":"2024-02-21T23:01:08.790310+0000","last_clean":"2024-02-21T23:01:08.790310+0000","last_became_active":"2024-02-21T23:01:03.213428+0000","last_became_peered":"2024-02-21T23:01:03.213428+0000","last_unstale":"2024-02-21T23:01:08.790310+0000","last_undegraded":"2024-02-21T23:01:08.790310+0000","last_fullsized":"2024-02-21T23:01:08.790310+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:45:29.610700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787556+0000","last_change":"2024-02-21T23:01:03.215983+0000","last_active":"2024-02-21T23:01:08.787556+0000","last_peered":"2024-02-21T23:01:08.787556+0000","last_clean":"2024-02-21T23:01:08.787556+0000","last_became_active":"2024-02-21T23:01:03.215580+0000","last_became_peered":"2024-02-21T23:01:03.215580+0000","last_unstale":"2024-02-21T23:01:08.787556+0000","last_undegraded":"2024-02-21T23:01:08.787556+0000","last_fullsized":"2024-02-21T23:01:08.787556+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:58:24.562346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.263660+0000","last_change":"2024-02-21T23:01:03.226514+0000","last_active":"2024-02-21T23:01:08.263660+0000","last_peered":"2024-02-21T23:01:08.263660+0000","last_clean":"2024-02-21T23:01:08.263660+0000","last_became_active":"2024-02-21T23:01:03.223861+0000","last_became_peered":"2024-02-21T23:01:03.223861+0000","last_unstale":"2024-02-21T23:01:08.263660+0000","last_undegraded":"2024-02-21T23:01:08.263660+0000","last_fullsized":"2024-02-21T23:01:08.263660+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:07:50.626867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787787+0000","last_change":"2024-02-21T23:01:03.212993+0000","last_active":"2024-02-21T23:01:08.787787+0000","last_peered":"2024-02-21T23:01:08.787787+0000","last_clean":"2024-02-21T23:01:08.787787+0000","last_became_active":"2024-02-21T23:01:03.212691+0000","last_became_peered":"2024-02-21T23:01:03.212691+0000","last_unstale":"2024-02-21T23:01:08.787787+0000","last_undegraded":"2024-02-21T23:01:08.787787+0000","last_fullsized":"2024-02-21T23:01:08.787787+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:10:10.688004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788992+0000","last_change":"2024-02-21T23:01:03.217962+0000","last_active":"2024-02-21T23:01:08.788992+0000","last_peered":"2024-02-21T23:01:08.788992+0000","last_clean":"2024-02-21T23:01:08.788992+0000","last_became_active":"2024-02-21T23:01:03.217613+0000","last_became_peered":"2024-02-21T23:01:03.217613+0000","last_unstale":"2024-02-21T23:01:08.788992+0000","last_undegraded":"2024-02-21T23:01:08.788992+0000","last_fullsized":"2024-02-21T23:01:08.788992+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:35:24.590398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788983+0000","last_change":"2024-02-21T23:01:03.214531+0000","last_active":"2024-02-21T23:01:08.788983+0000","last_peered":"2024-02-21T23:01:08.788983+0000","last_clean":"2024-02-21T23:01:08.788983+0000","last_became_active":"2024-02-21T23:01:03.214165+0000","last_became_peered":"2024-02-21T23:01:03.214165+0000","last_unstale":"2024-02-21T23:01:08.788983+0000","last_undegraded":"2024-02-21T23:01:08.788983+0000","last_fullsized":"2024-02-21T23:01:08.788983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:58:24.562346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1],"acting":[9,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788210+0000","last_change":"2024-02-21T23:01:03.214286+0000","last_active":"2024-02-21T23:01:08.788210+0000","last_peered":"2024-02-21T23:01:08.788210+0000","last_clean":"2024-02-21T23:01:08.788210+0000","last_became_active":"2024-02-21T23:01:03.213755+0000","last_became_peered":"2024-02-21T23:01:03.213755+0000","last_unstale":"2024-02-21T23:01:08.788210+0000","last_undegraded":"2024-02-21T23:01:08.788210+0000","last_fullsized":"2024-02-21T23:01:08.788210+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:35:24.590398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787471+0000","last_change":"2024-02-21T23:01:03.216623+0000","last_active":"2024-02-21T23:01:08.787471+0000","last_peered":"2024-02-21T23:01:08.787471+0000","last_clean":"2024-02-21T23:01:08.787471+0000","last_became_active":"2024-02-21T23:01:03.216345+0000","last_became_peered":"2024-02-21T23:01:03.216345+0000","last_unstale":"2024-02-21T23:01:08.787471+0000","last_undegraded":"2024-02-21T23:01:08.787471+0000","last_fullsized":"2024-02-21T23:01:08.787471+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:10:10.688004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.790273+0000","last_change":"2024-02-21T23:01:03.226262+0000","last_active":"2024-02-21T23:01:08.790273+0000","last_peered":"2024-02-21T23:01:08.790273+0000","last_clean":"2024-02-21T23:01:08.790273+0000","last_became_active":"2024-02-21T23:01:03.225574+0000","last_became_peered":"2024-02-21T23:01:03.225574+0000","last_unstale":"2024-02-21T23:01:08.790273+0000","last_undegraded":"2024-02-21T23:01:08.790273+0000","last_fullsized":"2024-02-21T23:01:08.790273+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:10:10.688004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.789940+0000","last_change":"2024-02-21T23:01:03.225898+0000","last_active":"2024-02-21T23:01:08.789940+0000","last_peered":"2024-02-21T23:01:08.789940+0000","last_clean":"2024-02-21T23:01:08.789940+0000","last_became_active":"2024-02-21T23:01:03.217938+0000","last_became_peered":"2024-02-21T23:01:03.217938+0000","last_unstale":"2024-02-21T23:01:08.789940+0000","last_undegraded":"2024-02-21T23:01:08.789940+0000","last_fullsized":"2024-02-21T23:01:08.789940+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:58:24.562346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8],"acting":[0,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.263526+0000","last_change":"2024-02-21T23:01:03.225830+0000","last_active":"2024-02-21T23:01:08.263526+0000","last_peered":"2024-02-21T23:01:08.263526+0000","last_clean":"2024-02-21T23:01:08.263526+0000","last_became_active":"2024-02-21T23:01:03.225449+0000","last_became_peered":"2024-02-21T23:01:03.225449+0000","last_unstale":"2024-02-21T23:01:08.263526+0000","last_undegraded":"2024-02-21T23:01:08.263526+0000","last_fullsized":"2024-02-21T23:01:08.263526+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:47:19.366266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10],"acting":[6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.260717+0000","last_change":"2024-02-21T23:01:03.208746+0000","last_active":"2024-02-21T23:01:08.260717+0000","last_peered":"2024-02-21T23:01:08.260717+0000","last_clean":"2024-02-21T23:01:08.260717+0000","last_became_active":"2024-02-21T23:01:03.208446+0000","last_became_peered":"2024-02-21T23:01:03.208446+0000","last_unstale":"2024-02-21T23:01:08.260717+0000","last_undegraded":"2024-02-21T23:01:08.260717+0000","last_fullsized":"2024-02-21T23:01:08.260717+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:58:24.562346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787941+0000","last_change":"2024-02-21T23:01:03.218981+0000","last_active":"2024-02-21T23:01:08.787941+0000","last_peered":"2024-02-21T23:01:08.787941+0000","last_clean":"2024-02-21T23:01:08.787941+0000","last_became_active":"2024-02-21T23:01:03.217925+0000","last_became_peered":"2024-02-21T23:01:03.217925+0000","last_unstale":"2024-02-21T23:01:08.787941+0000","last_undegraded":"2024-02-21T23:01:08.787941+0000","last_fullsized":"2024-02-21T23:01:08.787941+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:54:40.332224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8],"acting":[7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.790183+0000","last_change":"2024-02-21T23:01:03.212233+0000","last_active":"2024-02-21T23:01:08.790183+0000","last_peered":"2024-02-21T23:01:08.790183+0000","last_clean":"2024-02-21T23:01:08.790183+0000","last_became_active":"2024-02-21T23:01:03.211921+0000","last_became_peered":"2024-02-21T23:01:03.211921+0000","last_unstale":"2024-02-21T23:01:08.790183+0000","last_undegraded":"2024-02-21T23:01:08.790183+0000","last_fullsized":"2024-02-21T23:01:08.790183+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:54:32.196725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2],"acting":[10,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788443+0000","last_change":"2024-02-21T23:01:03.216861+0000","last_active":"2024-02-21T23:01:08.788443+0000","last_peered":"2024-02-21T23:01:08.788443+0000","last_clean":"2024-02-21T23:01:08.788443+0000","last_became_active":"2024-02-21T23:01:03.216580+0000","last_became_peered":"2024-02-21T23:01:03.216580+0000","last_unstale":"2024-02-21T23:01:08.788443+0000","last_undegraded":"2024-02-21T23:01:08.788443+0000","last_fullsized":"2024-02-21T23:01:08.788443+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:35:24.590398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.789320+0000","last_change":"2024-02-21T23:01:03.212164+0000","last_active":"2024-02-21T23:01:08.789320+0000","last_peered":"2024-02-21T23:01:08.789320+0000","last_clean":"2024-02-21T23:01:08.789320+0000","last_became_active":"2024-02-21T23:01:03.211811+0000","last_became_peered":"2024-02-21T23:01:03.211811+0000","last_unstale":"2024-02-21T23:01:08.789320+0000","last_undegraded":"2024-02-21T23:01:08.789320+0000","last_fullsized":"2024-02-21T23:01:08.789320+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:16.946152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.787878+0000","last_change":"2024-02-21T23:01:03.223537+0000","last_active":"2024-02-21T23:01:08.787878+0000","last_peered":"2024-02-21T23:01:08.787878+0000","last_clean":"2024-02-21T23:01:08.787878+0000","last_became_active":"2024-02-21T23:01:03.223255+0000","last_became_peered":"2024-02-21T23:01:03.223255+0000","last_unstale":"2024-02-21T23:01:08.787878+0000","last_undegraded":"2024-02-21T23:01:08.787878+0000","last_fullsized":"2024-02-21T23:01:08.787878+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:19:01.584139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9],"acting":[7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.789780+0000","last_change":"2024-02-21T23:01:03.210441+0000","last_active":"2024-02-21T23:01:08.789780+0000","last_peered":"2024-02-21T23:01:08.789780+0000","last_clean":"2024-02-21T23:01:08.789780+0000","last_became_active":"2024-02-21T23:01:03.209569+0000","last_became_peered":"2024-02-21T23:01:03.209569+0000","last_unstale":"2024-02-21T23:01:08.789780+0000","last_undegraded":"2024-02-21T23:01:08.789780+0000","last_fullsized":"2024-02-21T23:01:08.789780+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:41:55.485351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9],"acting":[10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.261019+0000","last_change":"2024-02-21T23:01:03.214234+0000","last_active":"2024-02-21T23:01:08.261019+0000","last_peered":"2024-02-21T23:01:08.261019+0000","last_clean":"2024-02-21T23:01:08.261019+0000","last_became_active":"2024-02-21T23:01:03.213941+0000","last_became_peered":"2024-02-21T23:01:03.213941+0000","last_unstale":"2024-02-21T23:01:08.261019+0000","last_undegraded":"2024-02-21T23:01:08.261019+0000","last_fullsized":"2024-02-21T23:01:08.261019+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:19:01.584139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3],"acting":[8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.260625+0000","last_change":"2024-02-21T23:01:03.207972+0000","last_active":"2024-02-21T23:01:08.260625+0000","last_peered":"2024-02-21T23:01:08.260625+0000","last_clean":"2024-02-21T23:01:08.260625+0000","last_became_active":"2024-02-21T23:01:03.206762+0000","last_became_peered":"2024-02-21T23:01:03.206762+0000","last_unstale":"2024-02-21T23:01:08.260625+0000","last_undegraded":"2024-02-21T23:01:08.260625+0000","last_fullsized":"2024-02-21T23:01:08.260625+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:27:55.341328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8],"acting":[4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.790823+0000","last_change":"2024-02-21T23:01:03.221959+0000","last_active":"2024-02-21T23:01:08.790823+0000","last_peered":"2024-02-21T23:01:08.790823+0000","last_clean":"2024-02-21T23:01:08.790823+0000","last_became_active":"2024-02-21T23:01:03.221672+0000","last_became_peered":"2024-02-21T23:01:03.221672+0000","last_unstale":"2024-02-21T23:01:08.790823+0000","last_undegraded":"2024-02-21T23:01:08.790823+0000","last_fullsized":"2024-02-21T23:01:08.790823+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:45:29.610700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.790294+0000","last_change":"2024-02-21T23:01:03.219660+0000","last_active":"2024-02-21T23:01:08.790294+0000","last_peered":"2024-02-21T23:01:08.790294+0000","last_clean":"2024-02-21T23:01:08.790294+0000","last_became_active":"2024-02-21T23:01:03.219379+0000","last_became_peered":"2024-02-21T23:01:03.219379+0000","last_unstale":"2024-02-21T23:01:08.790294+0000","last_undegraded":"2024-02-21T23:01:08.790294+0000","last_fullsized":"2024-02-21T23:01:08.790294+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:27:55.341328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11],"acting":[0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-02-21T23:01:08.788114+0000","last_change":"2024-02-21T23:01:03.213287+0000","last_active":"2024-02-21T23:01:08.788114+0000","last_peered":"2024-02-21T23:01:08.788114+0000","last_clean":"2024-02-21T23:01:08.788114+0000","last_became_active":"2024-02-21T23:01:03.212878+0000","last_became_peered":"2024-02-21T23:01:03.212878+0000","last_unstale":"2024-02-21T23:01:08.788114+0000","last_undegraded":"2024-02-21T23:01:08.788114+0000","last_fullsized":"2024-02-21T23:01:08.788114+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:16.946152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":50530,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":72,"num_read_kb":91,"num_write":153,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":245760,"data_stored":101060,"data_compressed":3672,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":64,"acting":64,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66458,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":11,"up_from":17,"seq":73014444044,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":145847,"data_compressed":8432,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":17,"seq":73014444043,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":372736,"data_stored":187922,"data_compressed":10268,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":17,"seq":73014444044,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":150033,"data_compressed":8432,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":17,"seq":73014444043,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":323584,"data_stored":145421,"data_compressed":8432,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":17,"seq":73014444044,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":385024,"data_stored":740899,"data_compressed":41661,"data_compressed_allocated":57344,"data_compressed_original":598016,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":17,"seq":73014444043,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":141259,"data_compressed":8432,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":17,"seq":73014444044,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":401408,"data_stored":737504,"data_compressed":41661,"data_compressed_allocated":57344,"data_compressed_original":598016,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":17,"seq":73014444044,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":315392,"data_stored":145887,"data_compressed":8432,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":17,"seq":73014444044,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":141349,"data_compressed":8432,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444044,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":319488,"data_stored":142802,"data_compressed":8432,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":17,"seq":73014444044,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":356352,"data_stored":187694,"data_compressed":10268,"data_compressed_allocated":16384,"data_compressed_original":32768,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":17,"seq":73014444044,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":323584,"data_stored":141975,"data_compressed":8432,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33229,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33229,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":46525,"data_compressed":1836,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":46753,"data_compressed":1836,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-21T23:01:42.970 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-02-21T23:01:42.970 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-02-21T23:01:42.970 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-02-21T23:01:42.970 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-02-21T23:01:43.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.233+0000 7f2ac0c00640 1 Processor -- start 2024-02-21T23:01:43.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.233+0000 7f2ac0c00640 1 -- start start 2024-02-21T23:01:43.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.236+0000 7f2ac0c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2abc071630 0x7f2abc18ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:43.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.236+0000 7f2ac0c00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2abc189b90 con 0x7f2abc071a10 2024-02-21T23:01:43.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.236+0000 7f2ac0c00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2abc0fdd10 con 0x7f2abc187c90 2024-02-21T23:01:43.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.236+0000 7f2ac0c00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2abc186bf0 con 0x7f2abc071630 2024-02-21T23:01:43.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.237+0000 7f2ab9400640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f2abc071a10 0x7f2abc071e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.99:47056/0 (socket says 172.21.15.99:47056) 2024-02-21T23:01:43.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.237+0000 7f2ab9400640 1 -- 172.21.15.99:0/34341039 learned_addr learned my addr 172.21.15.99:0/34341039 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:01:43.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.237+0000 7f2ab9e00640 1 --2- 172.21.15.99:0/34341039 >> v2:172.21.15.162:3300/0 conn(0x7f2abc071630 0x7f2abc18ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:43.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.237+0000 7f2ab8a00640 1 -- 172.21.15.99:0/34341039 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1889587252 0 0) 0x7f2aa8001110 con 0x7f2abc071a10 2024-02-21T23:01:43.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.237+0000 7f2ab8a00640 1 -- 172.21.15.99:0/34341039 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2aa0003520 con 0x7f2abc071a10 2024-02-21T23:01:43.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.237+0000 7f2ab9e00640 1 -- 172.21.15.99:0/34341039 >> v1:172.21.15.181:6789/0 conn(0x7f2abc187c90 legacy=0x7f2abc188100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:43.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.237+0000 7f2ab8a00640 1 -- 172.21.15.99:0/34341039 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 506723409 0 0) 0x7f2abc0fdd10 con 0x7f2abc187c90 2024-02-21T23:01:43.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.237+0000 7f2ab9e00640 1 -- 172.21.15.99:0/34341039 >> v1:172.21.15.162:6789/0 conn(0x7f2abc071a10 legacy=0x7f2abc071e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:43.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.237+0000 7f2ab9e00640 1 -- 172.21.15.99:0/34341039 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2abc186ed0 con 0x7f2abc071630 2024-02-21T23:01:43.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.238+0000 7f2ab9e00640 1 --2- 172.21.15.99:0/34341039 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2abc071630 0x7f2abc18ccf0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2aac0097a0 tx=0x7f2aac02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f07e5ea12ef7865c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:43.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.238+0000 7f2ab8a00640 1 -- 172.21.15.99:0/34341039 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aac035020 con 0x7f2abc071630 2024-02-21T23:01:43.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.239+0000 7f2ab8a00640 1 -- 172.21.15.99:0/34341039 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aac031830 con 0x7f2abc071630 2024-02-21T23:01:43.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.239+0000 7f2ab8a00640 1 -- 172.21.15.99:0/34341039 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aac031c00 con 0x7f2abc071630 2024-02-21T23:01:43.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.239+0000 7f2ac0c00640 1 -- 172.21.15.99:0/34341039 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2abc071630 msgr2=0x7f2abc18ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:43.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.239+0000 7f2ac0c00640 1 --2- 172.21.15.99:0/34341039 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2abc071630 0x7f2abc18ccf0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2aac0097a0 tx=0x7f2aac02b8d0 comp rx=0 tx=0).stop 2024-02-21T23:01:43.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.239+0000 7f2ac0c00640 1 -- 172.21.15.99:0/34341039 shutdown_connections 2024-02-21T23:01:43.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.239+0000 7f2ac0c00640 1 --2- 172.21.15.99:0/34341039 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2abc071630 0x7f2abc18ccf0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:43.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.239+0000 7f2ac0c00640 1 -- 172.21.15.99:0/34341039 >> 172.21.15.99:0/34341039 conn(0x7f2abc0fe580 msgr2=0x7f2abc0fe990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:43.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.239+0000 7f2ac0c00640 1 -- 172.21.15.99:0/34341039 shutdown_connections 2024-02-21T23:01:43.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.239+0000 7f2ac0c00640 1 -- 172.21.15.99:0/34341039 wait complete. 2024-02-21T23:01:43.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.242+0000 7f2ac0c00640 1 Processor -- start 2024-02-21T23:01:43.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.242+0000 7f2ac0c00640 1 -- start start 2024-02-21T23:01:43.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.244+0000 7f2ac0c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2abc071630 0x7f2abc0d2320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:43.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.244+0000 7f2ac0c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2abc071a10 0x7f2abc177560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:43.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.244+0000 7f2ac0c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2abc187c90 0x7f2abc184c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:43.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.244+0000 7f2ac0c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2abc187770 con 0x7f2abc071630 2024-02-21T23:01:43.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.244+0000 7f2ac0c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2abc187490 con 0x7f2abc187c90 2024-02-21T23:01:43.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.244+0000 7f2ac0c00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2abc188810 con 0x7f2abc071a10 2024-02-21T23:01:43.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.245+0000 7f2ab9e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2abc071630 0x7f2abc0d2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:43.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.245+0000 7f2ab9e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2abc071630 0x7f2abc0d2320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59820/0 (socket says 172.21.15.99:59820) 2024-02-21T23:01:43.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.245+0000 7f2ab9e00640 1 -- 172.21.15.99:0/605706322 learned_addr learned my addr 172.21.15.99:0/605706322 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:43.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.245+0000 7f2ab9400640 1 --2- 172.21.15.99:0/605706322 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2abc071a10 0x7f2abc177560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:43.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.245+0000 7f2aba800640 1 --2- 172.21.15.99:0/605706322 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2abc187c90 0x7f2abc184c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:43.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.245+0000 7f2ab9e00640 1 -- 172.21.15.99:0/605706322 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2abc071a10 msgr2=0x7f2abc177560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:43.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.245+0000 7f2ab9e00640 1 --2- 172.21.15.99:0/605706322 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2abc071a10 0x7f2abc177560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:43.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.245+0000 7f2ab9e00640 1 -- 172.21.15.99:0/605706322 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2abc187c90 msgr2=0x7f2abc184c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:43.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.245+0000 7f2ab9e00640 1 --2- 172.21.15.99:0/605706322 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2abc187c90 0x7f2abc184c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:43.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.245+0000 7f2ab9e00640 1 -- 172.21.15.99:0/605706322 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2abc0fa140 con 0x7f2abc071630 2024-02-21T23:01:43.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.245+0000 7f2ab9e00640 1 --2- 172.21.15.99:0/605706322 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2abc071630 0x7f2abc0d2320 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2aac034040 tx=0x7f2aac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:43.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.246+0000 7f2ab2000640 1 -- 172.21.15.99:0/605706322 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aac040070 con 0x7f2abc071630 2024-02-21T23:01:43.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.246+0000 7f2ab2000640 1 -- 172.21.15.99:0/605706322 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aac03a830 con 0x7f2abc071630 2024-02-21T23:01:43.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.246+0000 7f2ac0c00640 1 -- 172.21.15.99:0/605706322 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2abc0fa420 con 0x7f2abc071630 2024-02-21T23:01:43.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.246+0000 7f2ab2000640 1 -- 172.21.15.99:0/605706322 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aac035040 con 0x7f2abc071630 2024-02-21T23:01:43.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.246+0000 7f2ac0c00640 1 -- 172.21.15.99:0/605706322 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2abc184430 con 0x7f2abc071630 2024-02-21T23:01:43.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.247+0000 7f2ac0c00640 1 -- 172.21.15.99:0/605706322 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2abc068390 con 0x7f2abc071630 2024-02-21T23:01:43.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.249+0000 7f2ab2000640 1 -- 172.21.15.99:0/605706322 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 6) v1 ==== 134407+0+0 (secure 0 0 0) 0x7f2aac04b060 con 0x7f2abc071630 2024-02-21T23:01:43.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.251+0000 7f2ab2000640 1 --2- 172.21.15.99:0/605706322 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f2a9c09edf0 0x7f2a9c0a12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:43.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.251+0000 7f2ab2000640 1 -- 172.21.15.99:0/605706322 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f2aac0eb3c0 con 0x7f2abc071630 2024-02-21T23:01:43.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.252+0000 7f2ab9400640 1 --2- 172.21.15.99:0/605706322 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f2a9c09edf0 0x7f2a9c0a12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:43.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.252+0000 7f2ab9400640 1 --2- 172.21.15.99:0/605706322 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f2a9c09edf0 0x7f2a9c0a12b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2abc0fd3c0 tx=0x7f2aa8007b70 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:43.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.256+0000 7f2ab2000640 1 -- 172.21.15.99:0/605706322 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f2aac0b95c0 con 0x7f2abc071630 2024-02-21T23:01:43.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.637+0000 7f2ac0c00640 1 -- 172.21.15.99:0/605706322 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f2abc0f1e60 con 0x7f2abc071630 2024-02-21T23:01:43.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.637+0000 7f2ab2000640 1 -- 172.21.15.99:0/605706322 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f2aac0b8ec0 con 0x7f2abc071630 2024-02-21T23:01:43.627 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T23:01:43.627 INFO:teuthology.orchestra.run.smithi099.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-02-21T23:01:43.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.639+0000 7f2ac0c00640 1 -- 172.21.15.99:0/605706322 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f2a9c09edf0 msgr2=0x7f2a9c0a12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:43.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.639+0000 7f2ac0c00640 1 --2- 172.21.15.99:0/605706322 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f2a9c09edf0 0x7f2a9c0a12b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2abc0fd3c0 tx=0x7f2aa8007b70 comp rx=0 tx=0).stop 2024-02-21T23:01:43.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.639+0000 7f2ac0c00640 1 -- 172.21.15.99:0/605706322 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2abc071630 msgr2=0x7f2abc0d2320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:43.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.639+0000 7f2ac0c00640 1 --2- 172.21.15.99:0/605706322 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2abc071630 0x7f2abc0d2320 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2aac034040 tx=0x7f2aac0046c0 comp rx=0 tx=0).stop 2024-02-21T23:01:43.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.639+0000 7f2ac0c00640 1 -- 172.21.15.99:0/605706322 shutdown_connections 2024-02-21T23:01:43.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.639+0000 7f2ac0c00640 1 --2- 172.21.15.99:0/605706322 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f2a9c09edf0 0x7f2a9c0a12b0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:43.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.639+0000 7f2ac0c00640 1 --2- 172.21.15.99:0/605706322 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2abc187c90 0x7f2abc184c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:43.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.639+0000 7f2ac0c00640 1 --2- 172.21.15.99:0/605706322 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2abc071a10 0x7f2abc177560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:43.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.639+0000 7f2ac0c00640 1 --2- 172.21.15.99:0/605706322 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2abc071630 0x7f2abc0d2320 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:43.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.639+0000 7f2ac0c00640 1 -- 172.21.15.99:0/605706322 >> 172.21.15.99:0/605706322 conn(0x7f2abc0fe580 msgr2=0x7f2abc214020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:43.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.640+0000 7f2ac0c00640 1 -- 172.21.15.99:0/605706322 shutdown_connections 2024-02-21T23:01:43.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.640+0000 7f2ac0c00640 1 -- 172.21.15.99:0/605706322 wait complete. 2024-02-21T23:01:43.648 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-02-21T23:01:43.648 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T23:01:43.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.899+0000 7f2890c00640 1 Processor -- start 2024-02-21T23:01:43.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.899+0000 7f2890c00640 1 -- start start 2024-02-21T23:01:43.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.903+0000 7f2890c00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f288c0f5d90 0x7f288c0d0be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:43.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.903+0000 7f2890c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f288c0d1120 0x7f288c184e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:43.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.903+0000 7f2890c00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f288c182ae0 con 0x7f288c182700 2024-02-21T23:01:43.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.903+0000 7f2890c00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f288c0f5900 con 0x7f288c0d1120 2024-02-21T23:01:43.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.903+0000 7f2890c00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f288c0f4a10 con 0x7f288c0f5d90 2024-02-21T23:01:43.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.903+0000 7f2883e00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f288c0f5d90 0x7f288c0d0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:43.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.903+0000 7f288be00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f288c0d1120 0x7f288c184e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:43.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.903+0000 7f2883e00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f288c0f5d90 0x7f288c0d0be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:43908/0 (socket says 172.21.15.99:43908) 2024-02-21T23:01:43.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.903+0000 7f2883e00640 1 -- 172.21.15.99:0/2119801971 learned_addr learned my addr 172.21.15.99:0/2119801971 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:43.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.904+0000 7f288be00640 1 -- 172.21.15.99:0/2119801971 >> v2:172.21.15.181:3300/0 conn(0x7f288c0f5d90 msgr2=0x7f288c0d0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:43.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.904+0000 7f288be00640 1 --2- 172.21.15.99:0/2119801971 >> v2:172.21.15.181:3300/0 conn(0x7f288c0f5d90 0x7f288c0d0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:43.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.904+0000 7f288be00640 1 -- 172.21.15.99:0/2119801971 >> v1:172.21.15.162:6789/0 conn(0x7f288c182700 legacy=0x7f288c0cff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:43.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.904+0000 7f288be00640 1 -- 172.21.15.99:0/2119801971 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f288c0f4cf0 con 0x7f288c0d1120 2024-02-21T23:01:43.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.905+0000 7f288be00640 1 --2- 172.21.15.99:0/2119801971 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f288c0d1120 0x7f288c184e50 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f288c0d2a60 tx=0x7f288402bbe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d8a5ca47767a710 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:43.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.906+0000 7f288aa00640 1 -- 172.21.15.99:0/2119801971 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288402d920 con 0x7f288c0d1120 2024-02-21T23:01:43.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.906+0000 7f288aa00640 1 -- 172.21.15.99:0/2119801971 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f288402dac0 con 0x7f288c0d1120 2024-02-21T23:01:43.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.906+0000 7f288aa00640 1 -- 172.21.15.99:0/2119801971 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288402c440 con 0x7f288c0d1120 2024-02-21T23:01:43.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.906+0000 7f2890c00640 1 -- 172.21.15.99:0/2119801971 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f288c0d1120 msgr2=0x7f288c184e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:43.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.906+0000 7f2890c00640 1 --2- 172.21.15.99:0/2119801971 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f288c0d1120 0x7f288c184e50 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f288c0d2a60 tx=0x7f288402bbe0 comp rx=0 tx=0).stop 2024-02-21T23:01:43.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.906+0000 7f2890c00640 1 -- 172.21.15.99:0/2119801971 shutdown_connections 2024-02-21T23:01:43.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.906+0000 7f2890c00640 1 --2- 172.21.15.99:0/2119801971 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f288c0d1120 0x7f288c184e50 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:43.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.906+0000 7f2890c00640 1 --2- 172.21.15.99:0/2119801971 >> v2:172.21.15.181:3300/0 conn(0x7f288c0f5d90 0x7f288c0d0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:43.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.906+0000 7f2890c00640 1 -- 172.21.15.99:0/2119801971 >> 172.21.15.99:0/2119801971 conn(0x7f288c0ce3c0 msgr2=0x7f288c0ce7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:43.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.906+0000 7f2890c00640 1 -- 172.21.15.99:0/2119801971 shutdown_connections 2024-02-21T23:01:43.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.907+0000 7f2890c00640 1 -- 172.21.15.99:0/2119801971 wait complete. 2024-02-21T23:01:43.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.910+0000 7f2890c00640 1 Processor -- start 2024-02-21T23:01:43.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.910+0000 7f2890c00640 1 -- start start 2024-02-21T23:01:43.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.912+0000 7f2890c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f288c0d1120 0x7f288c15e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:43.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.912+0000 7f2890c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f288c0f5d90 0x7f288c0cfd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:43.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.912+0000 7f2890c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f288c182700 0x7f288c0d0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:43.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.912+0000 7f2890c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f288c0f5590 con 0x7f288c182700 2024-02-21T23:01:43.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.912+0000 7f2890c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f288c0f52b0 con 0x7f288c0f5d90 2024-02-21T23:01:43.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.912+0000 7f2890c00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f288c0f8e00 con 0x7f288c0d1120 2024-02-21T23:01:43.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.912+0000 7f288be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f288c182700 0x7f288c0d0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:43.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.912+0000 7f288b400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f288c0d1120 0x7f288c15e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:43.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.912+0000 7f288b400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f288c0d1120 0x7f288c15e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:43914/0 (socket says 172.21.15.99:43914) 2024-02-21T23:01:43.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.912+0000 7f288be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f288c182700 0x7f288c0d0290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59832/0 (socket says 172.21.15.99:59832) 2024-02-21T23:01:43.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.912+0000 7f288b400640 1 -- 172.21.15.99:0/1521807787 learned_addr learned my addr 172.21.15.99:0/1521807787 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:43.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.912+0000 7f2883e00640 1 --2- 172.21.15.99:0/1521807787 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f288c0f5d90 0x7f288c0cfd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:43.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.913+0000 7f288b400640 1 -- 172.21.15.99:0/1521807787 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f288c0f5d90 msgr2=0x7f288c0cfd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:43.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.913+0000 7f288b400640 1 --2- 172.21.15.99:0/1521807787 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f288c0f5d90 0x7f288c0cfd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:43.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.913+0000 7f288b400640 1 -- 172.21.15.99:0/1521807787 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f288c182700 msgr2=0x7f288c0d0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:43.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.913+0000 7f288b400640 1 --2- 172.21.15.99:0/1521807787 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f288c182700 0x7f288c0d0290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:43.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.913+0000 7f288b400640 1 -- 172.21.15.99:0/1521807787 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f288c181020 con 0x7f288c0d1120 2024-02-21T23:01:43.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.913+0000 7f288b400640 1 --2- 172.21.15.99:0/1521807787 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f288c0d1120 0x7f288c15e450 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f287c00c820 tx=0x7f287c00cce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:43.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.913+0000 7f2883400640 1 -- 172.21.15.99:0/1521807787 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287c017070 con 0x7f288c0d1120 2024-02-21T23:01:43.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.913+0000 7f2890c00640 1 -- 172.21.15.99:0/1521807787 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f288c181300 con 0x7f288c0d1120 2024-02-21T23:01:43.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.913+0000 7f2883400640 1 -- 172.21.15.99:0/1521807787 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f287c0035f0 con 0x7f288c0d1120 2024-02-21T23:01:43.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.913+0000 7f2883400640 1 -- 172.21.15.99:0/1521807787 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287c0039e0 con 0x7f288c0d1120 2024-02-21T23:01:43.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.913+0000 7f2890c00640 1 -- 172.21.15.99:0/1521807787 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f288c1818c0 con 0x7f288c0d1120 2024-02-21T23:01:43.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.915+0000 7f2890c00640 1 -- 172.21.15.99:0/1521807787 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f288c068320 con 0x7f288c0d1120 2024-02-21T23:01:43.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.918+0000 7f2883400640 1 -- 172.21.15.99:0/1521807787 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 6) v1 ==== 134407+0+0 (secure 0 0 0) 0x7f287c01a070 con 0x7f288c0d1120 2024-02-21T23:01:43.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.919+0000 7f2883400640 1 --2- 172.21.15.99:0/1521807787 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f286809ed70 0x7f28680a1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:43.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.919+0000 7f2883400640 1 -- 172.21.15.99:0/1521807787 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f287c0c9370 con 0x7f288c0d1120 2024-02-21T23:01:43.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.920+0000 7f2883e00640 1 --2- 172.21.15.99:0/1521807787 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f286809ed70 0x7f28680a1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:43.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.920+0000 7f2883400640 1 -- 172.21.15.99:0/1521807787 <== mon.2 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f288c182ae0 con 0x7f288c0d1120 2024-02-21T23:01:43.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:43.920+0000 7f2883e00640 1 --2- 172.21.15.99:0/1521807787 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f286809ed70 0x7f28680a1230 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f288c17fd50 tx=0x7f2874009240 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:44.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.139+0000 7f2890c00640 1 -- 172.21.15.99:0/1521807787 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f288c0730b0 con 0x7f288c0d1120 2024-02-21T23:01:44.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.141+0000 7f2883400640 1 -- 172.21.15.99:0/1521807787 <== mon.2 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+23570 (secure 0 0 0) 0x7f287c096f80 con 0x7f288c0d1120 2024-02-21T23:01:44.132 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T23:01:44.132 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":29,"fsid":"e8af98cd-45a1-425f-96a7-f24da8ee4efb","created":"2024-02-21T23:00:44.699708+0000","modified":"2024-02-21T23:01:07.722511+0000","last_up_change":"2024-02-21T23:00:55.749829+0000","last_in_change":"2024-02-21T23:00:48.332297+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T23:00:57.020557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":11.760000228881836,"score_stable":11.760000228881836,"optimal_score":0.17000000178813934,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-21T23:01:01.124398+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-21T23:01:01.684258+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-21T23:01:05.290089+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c49de9b2-dc53-4882-b14c-7059ed40bf59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6809","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6811","nonce":1026112937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6813","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6815","nonce":1026112937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6823","nonce":1026112937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6819","nonce":1026112937}]},"public_addr":"172.21.15.99:6811/1026112937","cluster_addr":"172.21.15.99:6815/1026112937","heartbeat_back_addr":"172.21.15.99:6823/1026112937","heartbeat_front_addr":"172.21.15.99:6819/1026112937","state":["exists","up"]},{"osd":1,"uuid":"58398292-2fe5-4291-94fd-03a0ca29d49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6827","nonce":3030871566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6829","nonce":3030871566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6833","nonce":3030871566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6831","nonce":3030871566}]},"public_addr":"172.21.15.162:6827/3030871566","cluster_addr":"172.21.15.162:6829/3030871566","heartbeat_back_addr":"172.21.15.162:6833/3030871566","heartbeat_front_addr":"172.21.15.162:6831/3030871566","state":["exists","up"]},{"osd":2,"uuid":"94cddec1-e08f-438d-a7c8-48a0e47d71a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6818","nonce":2782386148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6821","nonce":2782386148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6827","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6829","nonce":2782386148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6823","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6825","nonce":2782386148}]},"public_addr":"172.21.15.181:6818/2782386148","cluster_addr":"172.21.15.181:6821/2782386148","heartbeat_back_addr":"172.21.15.181:6829/2782386148","heartbeat_front_addr":"172.21.15.181:6825/2782386148","state":["exists","up"]},{"osd":3,"uuid":"d29abb74-9b89-4fd7-88b1-7c2eb8231189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6801","nonce":2316185310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6803","nonce":2316185310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6807","nonce":2316185310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6805","nonce":2316185310}]},"public_addr":"172.21.15.99:6801/2316185310","cluster_addr":"172.21.15.99:6803/2316185310","heartbeat_back_addr":"172.21.15.99:6807/2316185310","heartbeat_front_addr":"172.21.15.99:6805/2316185310","state":["exists","up"]},{"osd":4,"uuid":"0d8c9ea3-880a-4d69-9dcb-cf7d35abd449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6811","nonce":3137681258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6813","nonce":3137681258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6817","nonce":3137681258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6815","nonce":3137681258}]},"public_addr":"172.21.15.162:6811/3137681258","cluster_addr":"172.21.15.162:6813/3137681258","heartbeat_back_addr":"172.21.15.162:6817/3137681258","heartbeat_front_addr":"172.21.15.162:6815/3137681258","state":["exists","up"]},{"osd":5,"uuid":"2e3a9340-6fd0-4d7a-8e00-fe305649296e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6801","nonce":2011264527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6803","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6805","nonce":2011264527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6811","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6813","nonce":2011264527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6807","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6809","nonce":2011264527}]},"public_addr":"172.21.15.181:6801/2011264527","cluster_addr":"172.21.15.181:6805/2011264527","heartbeat_back_addr":"172.21.15.181:6813/2011264527","heartbeat_front_addr":"172.21.15.181:6809/2011264527","state":["exists","up"]},{"osd":6,"uuid":"d9e37ce7-1b0e-4019-8f2e-b670403abf7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6810","nonce":753870050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6814","nonce":753870050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6822","nonce":753870050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6818","nonce":753870050}]},"public_addr":"172.21.15.99:6810/753870050","cluster_addr":"172.21.15.99:6814/753870050","heartbeat_back_addr":"172.21.15.99:6822/753870050","heartbeat_front_addr":"172.21.15.99:6818/753870050","state":["exists","up"]},{"osd":7,"uuid":"49988754-232e-4b8c-bd72-bfa25b418e5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6803","nonce":1659412949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6805","nonce":1659412949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6809","nonce":1659412949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6807","nonce":1659412949}]},"public_addr":"172.21.15.162:6803/1659412949","cluster_addr":"172.21.15.162:6805/1659412949","heartbeat_back_addr":"172.21.15.162:6809/1659412949","heartbeat_front_addr":"172.21.15.162:6807/1659412949","state":["exists","up"]},{"osd":8,"uuid":"ebc6e462-8368-4d64-b242-9c8735ac672c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6804","nonce":3389807042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6808","nonce":3389807042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6815","nonce":3389807042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6812","nonce":3389807042}]},"public_addr":"172.21.15.181:6804/3389807042","cluster_addr":"172.21.15.181:6808/3389807042","heartbeat_back_addr":"172.21.15.181:6815/3389807042","heartbeat_front_addr":"172.21.15.181:6812/3389807042","state":["exists","up"]},{"osd":9,"uuid":"72af1b02-b965-4d6a-8964-527ec24c4daa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6825","nonce":4055669590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6827","nonce":4055669590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6831","nonce":4055669590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6829","nonce":4055669590}]},"public_addr":"172.21.15.99:6825/4055669590","cluster_addr":"172.21.15.99:6827/4055669590","heartbeat_back_addr":"172.21.15.99:6831/4055669590","heartbeat_front_addr":"172.21.15.99:6829/4055669590","state":["exists","up"]},{"osd":10,"uuid":"adb5cb06-6453-41e4-b847-d7c78bbb7d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6819","nonce":1421879617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6821","nonce":1421879617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6825","nonce":1421879617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6823","nonce":1421879617}]},"public_addr":"172.21.15.162:6819/1421879617","cluster_addr":"172.21.15.162:6821/1421879617","heartbeat_back_addr":"172.21.15.162:6825/1421879617","heartbeat_front_addr":"172.21.15.162:6823/1421879617","state":["exists","up"]},{"osd":11,"uuid":"118563d9-1e8f-4dc7-a92c-2f4c4dc3e20f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6817","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6819","nonce":3219928272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6824","nonce":3219928272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6831","nonce":3219928272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6828","nonce":3219928272}]},"public_addr":"172.21.15.181:6819/3219928272","cluster_addr":"172.21.15.181:6824/3219928272","heartbeat_back_addr":"172.21.15.181:6831/3219928272","heartbeat_front_addr":"172.21.15.181:6828/3219928272","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.651219+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.549859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.529659+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.591004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.440836+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.414250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.630130+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.411954+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.439371+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.428173+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.511203+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.482806+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T23:01:44.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.143+0000 7f2890c00640 1 -- 172.21.15.99:0/1521807787 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f286809ed70 msgr2=0x7f28680a1230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:44.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.143+0000 7f2890c00640 1 --2- 172.21.15.99:0/1521807787 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f286809ed70 0x7f28680a1230 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f288c17fd50 tx=0x7f2874009240 comp rx=0 tx=0).stop 2024-02-21T23:01:44.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.143+0000 7f2890c00640 1 -- 172.21.15.99:0/1521807787 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f288c0d1120 msgr2=0x7f288c15e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:44.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.143+0000 7f2890c00640 1 --2- 172.21.15.99:0/1521807787 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f288c0d1120 0x7f288c15e450 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f287c00c820 tx=0x7f287c00cce0 comp rx=0 tx=0).stop 2024-02-21T23:01:44.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.143+0000 7f2890c00640 1 -- 172.21.15.99:0/1521807787 shutdown_connections 2024-02-21T23:01:44.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.143+0000 7f2890c00640 1 --2- 172.21.15.99:0/1521807787 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f286809ed70 0x7f28680a1230 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:44.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.143+0000 7f2890c00640 1 --2- 172.21.15.99:0/1521807787 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f288c182700 0x7f288c0d0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:44.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.143+0000 7f2890c00640 1 --2- 172.21.15.99:0/1521807787 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f288c0f5d90 0x7f288c0cfd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:44.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.143+0000 7f2890c00640 1 --2- 172.21.15.99:0/1521807787 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f288c0d1120 0x7f288c15e450 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:44.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.143+0000 7f2890c00640 1 -- 172.21.15.99:0/1521807787 >> 172.21.15.99:0/1521807787 conn(0x7f288c0ce3c0 msgr2=0x7f288c0f9190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:44.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.144+0000 7f2890c00640 1 -- 172.21.15.99:0/1521807787 shutdown_connections 2024-02-21T23:01:44.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.144+0000 7f2890c00640 1 -- 172.21.15.99:0/1521807787 wait complete. 2024-02-21T23:01:44.153 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-21T23:00:57.020557+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 11.760000228881836, 'score_stable': 11.760000228881836, 'optimal_score': 0.17000000178813934, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-21T23:01:01.124398+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-21T23:01:01.684258+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-02-21T23:01:05.290089+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-02-21T23:01:44.154 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-21T23:01:44.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.347+0000 7f613da00640 1 Processor -- start 2024-02-21T23:01:44.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.348+0000 7f613da00640 1 -- start start 2024-02-21T23:01:44.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.349+0000 7f613da00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f61381866f0 0x7f6138188480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:44.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.349+0000 7f613da00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f61380cf2c0 0x7f61380cf6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:44.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.349+0000 7f613da00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61381889c0 con 0x7f6138186310 2024-02-21T23:01:44.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.349+0000 7f613da00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61380fafa0 con 0x7f61380cf2c0 2024-02-21T23:01:44.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.349+0000 7f613da00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6138186cd0 con 0x7f61381866f0 2024-02-21T23:01:44.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.350+0000 7f6136a00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f6138186310 0x7f6138187d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:52684/0 (socket says 172.21.15.99:52684) 2024-02-21T23:01:44.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.350+0000 7f6136a00640 1 -- 172.21.15.99:0/3089904460 learned_addr learned my addr 172.21.15.99:0/3089904460 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:01:44.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.350+0000 7f6137400640 1 --2- 172.21.15.99:0/3089904460 >> v2:172.21.15.99:3300/0 conn(0x7f61380cf2c0 0x7f61380cf6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:44.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.350+0000 7f612e000640 1 --2- 172.21.15.99:0/3089904460 >> v2:172.21.15.181:3300/0 conn(0x7f61381866f0 0x7f6138188480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:44.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.350+0000 7f6137400640 1 -- 172.21.15.99:0/3089904460 >> v2:172.21.15.181:3300/0 conn(0x7f61381866f0 msgr2=0x7f6138188480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:44.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.350+0000 7f6137400640 1 --2- 172.21.15.99:0/3089904460 >> v2:172.21.15.181:3300/0 conn(0x7f61381866f0 0x7f6138188480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:44.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.350+0000 7f6137400640 1 -- 172.21.15.99:0/3089904460 >> v1:172.21.15.99:6789/0 conn(0x7f6138186310 legacy=0x7f6138187d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:44.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.350+0000 7f6137400640 1 -- 172.21.15.99:0/3089904460 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6138186fb0 con 0x7f61380cf2c0 2024-02-21T23:01:44.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.350+0000 7f6136000640 1 -- 172.21.15.99:0/3089904460 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3937726893 0 0) 0x7f61381889c0 con 0x7f6138186310 2024-02-21T23:01:44.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.352+0000 7f6137400640 1 --2- 172.21.15.99:0/3089904460 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f61380cf2c0 0x7f61380cf6d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f61380d6820 tx=0x7f613002b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21a5c4700d70be30 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:44.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.352+0000 7f6136000640 1 -- 172.21.15.99:0/3089904460 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6130038070 con 0x7f61380cf2c0 2024-02-21T23:01:44.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.352+0000 7f6136000640 1 -- 172.21.15.99:0/3089904460 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6130031520 con 0x7f61380cf2c0 2024-02-21T23:01:44.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.352+0000 7f6136000640 1 -- 172.21.15.99:0/3089904460 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61300318f0 con 0x7f61380cf2c0 2024-02-21T23:01:44.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.353+0000 7f613da00640 1 -- 172.21.15.99:0/3089904460 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f61380cf2c0 msgr2=0x7f61380cf6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:44.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.353+0000 7f613da00640 1 --2- 172.21.15.99:0/3089904460 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f61380cf2c0 0x7f61380cf6d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f61380d6820 tx=0x7f613002b7c0 comp rx=0 tx=0).stop 2024-02-21T23:01:44.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.353+0000 7f613da00640 1 -- 172.21.15.99:0/3089904460 shutdown_connections 2024-02-21T23:01:44.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.353+0000 7f613da00640 1 --2- 172.21.15.99:0/3089904460 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f61380cf2c0 0x7f61380cf6d0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:44.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.353+0000 7f613da00640 1 --2- 172.21.15.99:0/3089904460 >> v2:172.21.15.181:3300/0 conn(0x7f61381866f0 0x7f6138188480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:44.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.353+0000 7f613da00640 1 -- 172.21.15.99:0/3089904460 >> 172.21.15.99:0/3089904460 conn(0x7f61380740b0 msgr2=0x7f61380744c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:44.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.353+0000 7f613da00640 1 -- 172.21.15.99:0/3089904460 shutdown_connections 2024-02-21T23:01:44.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.353+0000 7f613da00640 1 -- 172.21.15.99:0/3089904460 wait complete. 2024-02-21T23:01:44.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.356+0000 7f613da00640 1 Processor -- start 2024-02-21T23:01:44.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.356+0000 7f613da00640 1 -- start start 2024-02-21T23:01:44.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.358+0000 7f613da00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f61380cf2c0 0x7f613817ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:44.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.358+0000 7f613da00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6138186310 0x7f61380d25e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:44.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.358+0000 7f613da00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61381866f0 0x7f613821f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:44.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.358+0000 7f613da00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6138187850 con 0x7f61380cf2c0 2024-02-21T23:01:44.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.358+0000 7f613da00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6138187570 con 0x7f61381866f0 2024-02-21T23:01:44.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.358+0000 7f613da00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61380cfc10 con 0x7f6138186310 2024-02-21T23:01:44.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.358+0000 7f6136a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f61380cf2c0 0x7f613817ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:44.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.358+0000 7f6136a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f61380cf2c0 0x7f613817ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59854/0 (socket says 172.21.15.99:59854) 2024-02-21T23:01:44.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.358+0000 7f6136a00640 1 -- 172.21.15.99:0/1585941621 learned_addr learned my addr 172.21.15.99:0/1585941621 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:44.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.359+0000 7f612e000640 1 --2- 172.21.15.99:0/1585941621 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6138186310 0x7f61380d25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:44.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.359+0000 7f6137400640 1 --2- 172.21.15.99:0/1585941621 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61381866f0 0x7f613821f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:44.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.359+0000 7f6136a00640 1 -- 172.21.15.99:0/1585941621 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6138186310 msgr2=0x7f61380d25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:44.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.359+0000 7f6136a00640 1 --2- 172.21.15.99:0/1585941621 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6138186310 0x7f61380d25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:44.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.359+0000 7f6136a00640 1 -- 172.21.15.99:0/1585941621 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61381866f0 msgr2=0x7f613821f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:44.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.359+0000 7f6136a00640 1 --2- 172.21.15.99:0/1585941621 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61381866f0 0x7f613821f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:44.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.359+0000 7f6136a00640 1 -- 172.21.15.99:0/1585941621 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f613817d340 con 0x7f61380cf2c0 2024-02-21T23:01:44.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.359+0000 7f6137400640 1 --2- 172.21.15.99:0/1585941621 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61381866f0 0x7f613821f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:01:44.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.359+0000 7f6136a00640 1 --2- 172.21.15.99:0/1585941621 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f61380cf2c0 0x7f613817ce00 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f612800c4d0 tx=0x7f612800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:44.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.359+0000 7f612f400640 1 -- 172.21.15.99:0/1585941621 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6128018070 con 0x7f61380cf2c0 2024-02-21T23:01:44.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.360+0000 7f612f400640 1 -- 172.21.15.99:0/1585941621 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61280074e0 con 0x7f61380cf2c0 2024-02-21T23:01:44.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.360+0000 7f613da00640 1 -- 172.21.15.99:0/1585941621 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61380d2b20 con 0x7f61380cf2c0 2024-02-21T23:01:44.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.360+0000 7f612f400640 1 -- 172.21.15.99:0/1585941621 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6128004a20 con 0x7f61380cf2c0 2024-02-21T23:01:44.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.360+0000 7f613da00640 1 -- 172.21.15.99:0/1585941621 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61380d1820 con 0x7f61380cf2c0 2024-02-21T23:01:44.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.361+0000 7f613da00640 1 -- 172.21.15.99:0/1585941621 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6138068780 con 0x7f61380cf2c0 2024-02-21T23:01:44.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.364+0000 7f612f400640 1 -- 172.21.15.99:0/1585941621 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 6) v1 ==== 134407+0+0 (secure 0 0 0) 0x7f612801b070 con 0x7f61380cf2c0 2024-02-21T23:01:44.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.366+0000 7f612f400640 1 --2- 172.21.15.99:0/1585941621 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f611409edf0 0x7f61140a12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:44.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.366+0000 7f612f400640 1 -- 172.21.15.99:0/1585941621 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f61280c8ee0 con 0x7f61380cf2c0 2024-02-21T23:01:44.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.366+0000 7f612e000640 1 --2- 172.21.15.99:0/1585941621 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f611409edf0 0x7f61140a12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:44.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.367+0000 7f612e000640 1 --2- 172.21.15.99:0/1585941621 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f611409edf0 0x7f61140a12b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f61381769b0 tx=0x7f612000b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:44.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.370+0000 7f612f400640 1 -- 172.21.15.99:0/1585941621 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f6128097140 con 0x7f61380cf2c0 2024-02-21T23:01:44.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.661+0000 7f613da00640 1 -- 172.21.15.99:0/1585941621 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f61380912a0 con 0x7f61380cf2c0 2024-02-21T23:01:44.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.662+0000 7f612f400640 1 -- 172.21.15.99:0/1585941621 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6128096a40 con 0x7f61380cf2c0 2024-02-21T23:01:44.652 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 1 2024-02-21T23:01:44.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.664+0000 7f613da00640 1 -- 172.21.15.99:0/1585941621 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f611409edf0 msgr2=0x7f61140a12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:44.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.664+0000 7f613da00640 1 --2- 172.21.15.99:0/1585941621 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f611409edf0 0x7f61140a12b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f61381769b0 tx=0x7f612000b040 comp rx=0 tx=0).stop 2024-02-21T23:01:44.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.664+0000 7f613da00640 1 -- 172.21.15.99:0/1585941621 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f61380cf2c0 msgr2=0x7f613817ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:44.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.664+0000 7f613da00640 1 --2- 172.21.15.99:0/1585941621 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f61380cf2c0 0x7f613817ce00 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f612800c4d0 tx=0x7f612800c990 comp rx=0 tx=0).stop 2024-02-21T23:01:44.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.664+0000 7f613da00640 1 -- 172.21.15.99:0/1585941621 shutdown_connections 2024-02-21T23:01:44.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.664+0000 7f613da00640 1 --2- 172.21.15.99:0/1585941621 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f611409edf0 0x7f61140a12b0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:44.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.664+0000 7f613da00640 1 --2- 172.21.15.99:0/1585941621 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61381866f0 0x7f613821f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:44.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.664+0000 7f613da00640 1 --2- 172.21.15.99:0/1585941621 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6138186310 0x7f61380d25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:44.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.664+0000 7f613da00640 1 --2- 172.21.15.99:0/1585941621 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f61380cf2c0 0x7f613817ce00 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:44.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.664+0000 7f613da00640 1 -- 172.21.15.99:0/1585941621 >> 172.21.15.99:0/1585941621 conn(0x7f61380740b0 msgr2=0x7f61381790b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:44.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.664+0000 7f613da00640 1 -- 172.21.15.99:0/1585941621 shutdown_connections 2024-02-21T23:01:44.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.664+0000 7f613da00640 1 -- 172.21.15.99:0/1585941621 wait complete. 2024-02-21T23:01:44.673 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-21T23:01:44.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.877+0000 7f73ba400640 1 Processor -- start 2024-02-21T23:01:44.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.877+0000 7f73ba400640 1 -- start start 2024-02-21T23:01:44.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.879+0000 7f73ba400640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f73b40701c0 0x7f73b40cbb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:44.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.879+0000 7f73ba400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73b406ee40 con 0x7f73b4180c80 2024-02-21T23:01:44.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.879+0000 7f73ba400640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73b406f120 con 0x7f73b406e910 2024-02-21T23:01:44.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.879+0000 7f73ba400640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73b406f400 con 0x7f73b40701c0 2024-02-21T23:01:44.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.879+0000 7f73b3400640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f73b4180c80 0x7f73b4187f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.99:47068/0 (socket says 172.21.15.99:47068) 2024-02-21T23:01:44.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.879+0000 7f73b3400640 1 -- 172.21.15.99:0/248908048 learned_addr learned my addr 172.21.15.99:0/248908048 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:01:44.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.879+0000 7f73b3e00640 1 --2- 172.21.15.99:0/248908048 >> v2:172.21.15.181:3300/0 conn(0x7f73b40701c0 0x7f73b40cbb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:44.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.880+0000 7f73b2a00640 1 -- 172.21.15.99:0/248908048 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1400619269 0 0) 0x7f73b406ee40 con 0x7f73b4180c80 2024-02-21T23:01:44.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.880+0000 7f73b2a00640 1 -- 172.21.15.99:0/248908048 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7398003520 con 0x7f73b4180c80 2024-02-21T23:01:44.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.880+0000 7f73b2a00640 1 -- 172.21.15.99:0/248908048 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 957280953 0 0) 0x7f73b406f120 con 0x7f73b406e910 2024-02-21T23:01:44.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.880+0000 7f73b2a00640 1 -- 172.21.15.99:0/248908048 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73b406ee40 con 0x7f73b406e910 2024-02-21T23:01:44.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.880+0000 7f73b3e00640 1 -- 172.21.15.99:0/248908048 >> v1:172.21.15.181:6789/0 conn(0x7f73b406e910 legacy=0x7f73b40cb420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:44.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.880+0000 7f73b3e00640 1 -- 172.21.15.99:0/248908048 >> v1:172.21.15.162:6789/0 conn(0x7f73b4180c80 legacy=0x7f73b4187f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:44.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.880+0000 7f73b3e00640 1 -- 172.21.15.99:0/248908048 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73b406f6e0 con 0x7f73b40701c0 2024-02-21T23:01:44.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.881+0000 7f73b3e00640 1 --2- 172.21.15.99:0/248908048 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f73b40701c0 0x7f73b40cbb30 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f73ac009d90 tx=0x7f73ac02beb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=110005686cc65ccc server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:44.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.882+0000 7f73b2a00640 1 -- 172.21.15.99:0/248908048 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73ac039070 con 0x7f73b40701c0 2024-02-21T23:01:44.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.882+0000 7f73b2a00640 1 -- 172.21.15.99:0/248908048 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73ac02cc60 con 0x7f73b40701c0 2024-02-21T23:01:44.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.882+0000 7f73b2a00640 1 -- 172.21.15.99:0/248908048 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73ac034660 con 0x7f73b40701c0 2024-02-21T23:01:44.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.883+0000 7f73ba400640 1 -- 172.21.15.99:0/248908048 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f73b40701c0 msgr2=0x7f73b40cbb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:44.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.883+0000 7f73ba400640 1 --2- 172.21.15.99:0/248908048 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f73b40701c0 0x7f73b40cbb30 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f73ac009d90 tx=0x7f73ac02beb0 comp rx=0 tx=0).stop 2024-02-21T23:01:44.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.883+0000 7f73ba400640 1 -- 172.21.15.99:0/248908048 shutdown_connections 2024-02-21T23:01:44.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.883+0000 7f73ba400640 1 --2- 172.21.15.99:0/248908048 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f73b40701c0 0x7f73b40cbb30 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:44.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.883+0000 7f73ba400640 1 -- 172.21.15.99:0/248908048 >> 172.21.15.99:0/248908048 conn(0x7f73b40ce5f0 msgr2=0x7f73b40cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:44.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.883+0000 7f73ba400640 1 -- 172.21.15.99:0/248908048 shutdown_connections 2024-02-21T23:01:44.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.883+0000 7f73ba400640 1 -- 172.21.15.99:0/248908048 wait complete. 2024-02-21T23:01:44.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.885+0000 7f73ba400640 1 Processor -- start 2024-02-21T23:01:44.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.885+0000 7f73ba400640 1 -- start start 2024-02-21T23:01:44.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.886+0000 7f73ba400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f73b406e910 0x7f73b4166fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:44.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.886+0000 7f73ba400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f73b40701c0 0x7f73b40d1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:44.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.886+0000 7f73ba400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73b4180c80 0x7f73b417b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:44.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.886+0000 7f73ba400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73b4188610 con 0x7f73b40701c0 2024-02-21T23:01:44.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.886+0000 7f73ba400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73b406fca0 con 0x7f73b4180c80 2024-02-21T23:01:44.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.886+0000 7f73ba400640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73b40f5f50 con 0x7f73b406e910 2024-02-21T23:01:44.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.887+0000 7f73abe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f73b40701c0 0x7f73b40d1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:44.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.887+0000 7f73abe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f73b40701c0 0x7f73b40d1fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59868/0 (socket says 172.21.15.99:59868) 2024-02-21T23:01:44.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.887+0000 7f73abe00640 1 -- 172.21.15.99:0/3371223717 learned_addr learned my addr 172.21.15.99:0/3371223717 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:44.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.887+0000 7f73b3e00640 1 --2- 172.21.15.99:0/3371223717 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73b4180c80 0x7f73b417b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:44.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.887+0000 7f73b3400640 1 --2- 172.21.15.99:0/3371223717 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f73b406e910 0x7f73b4166fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:44.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.887+0000 7f73abe00640 1 -- 172.21.15.99:0/3371223717 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f73b406e910 msgr2=0x7f73b4166fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:44.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.887+0000 7f73abe00640 1 --2- 172.21.15.99:0/3371223717 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f73b406e910 0x7f73b4166fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:44.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.887+0000 7f73abe00640 1 -- 172.21.15.99:0/3371223717 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73b4180c80 msgr2=0x7f73b417b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:44.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.887+0000 7f73abe00640 1 --2- 172.21.15.99:0/3371223717 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73b4180c80 0x7f73b417b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:44.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.887+0000 7f73abe00640 1 -- 172.21.15.99:0/3371223717 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73b417ca00 con 0x7f73b40701c0 2024-02-21T23:01:44.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.888+0000 7f73abe00640 1 --2- 172.21.15.99:0/3371223717 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f73b40701c0 0x7f73b40d1fc0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f739c00c400 tx=0x7f739c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:44.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.888+0000 7f73ab400640 1 -- 172.21.15.99:0/3371223717 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f739c017070 con 0x7f73b40701c0 2024-02-21T23:01:44.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.888+0000 7f73ab400640 1 -- 172.21.15.99:0/3371223717 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f739c0052d0 con 0x7f73b40701c0 2024-02-21T23:01:44.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.888+0000 7f73ab400640 1 -- 172.21.15.99:0/3371223717 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f739c003810 con 0x7f73b40701c0 2024-02-21T23:01:44.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.888+0000 7f73ba400640 1 -- 172.21.15.99:0/3371223717 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73b417cce0 con 0x7f73b40701c0 2024-02-21T23:01:44.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.888+0000 7f73ba400640 1 -- 172.21.15.99:0/3371223717 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73b417d2a0 con 0x7f73b40701c0 2024-02-21T23:01:44.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.890+0000 7f73ba400640 1 -- 172.21.15.99:0/3371223717 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73b40cbf60 con 0x7f73b40701c0 2024-02-21T23:01:44.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.891+0000 7f73ab400640 1 -- 172.21.15.99:0/3371223717 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 6) v1 ==== 134407+0+0 (secure 0 0 0) 0x7f739c01a070 con 0x7f73b40701c0 2024-02-21T23:01:44.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.892+0000 7f73ab400640 1 --2- 172.21.15.99:0/3371223717 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f739009edf0 0x7f73900a12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:44.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.893+0000 7f73ab400640 1 -- 172.21.15.99:0/3371223717 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f739c0c8fd0 con 0x7f73b40701c0 2024-02-21T23:01:44.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.893+0000 7f73b3400640 1 --2- 172.21.15.99:0/3371223717 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f739009edf0 0x7f73900a12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:44.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.893+0000 7f73b3400640 1 --2- 172.21.15.99:0/3371223717 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f739009edf0 0x7f73900a12b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f73a4005880 tx=0x7f73a4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:44.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:44.902+0000 7f73ab400640 1 -- 172.21.15.99:0/3371223717 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f73b40cbf60 con 0x7f73b40701c0 2024-02-21T23:01:45.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.145+0000 7f73ba400640 1 -- 172.21.15.99:0/3371223717 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f73b4068780 con 0x7f73b40701c0 2024-02-21T23:01:45.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.145+0000 7f73ab400640 1 -- 172.21.15.99:0/3371223717 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f739c096b80 con 0x7f73b40701c0 2024-02-21T23:01:45.136 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 32 2024-02-21T23:01:45.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.148+0000 7f73ba400640 1 -- 172.21.15.99:0/3371223717 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f739009edf0 msgr2=0x7f73900a12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:45.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.148+0000 7f73ba400640 1 --2- 172.21.15.99:0/3371223717 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f739009edf0 0x7f73900a12b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f73a4005880 tx=0x7f73a4009040 comp rx=0 tx=0).stop 2024-02-21T23:01:45.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.148+0000 7f73ba400640 1 -- 172.21.15.99:0/3371223717 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f73b40701c0 msgr2=0x7f73b40d1fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:45.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.148+0000 7f73ba400640 1 --2- 172.21.15.99:0/3371223717 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f73b40701c0 0x7f73b40d1fc0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f739c00c400 tx=0x7f739c00c8c0 comp rx=0 tx=0).stop 2024-02-21T23:01:45.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.148+0000 7f73ba400640 1 -- 172.21.15.99:0/3371223717 shutdown_connections 2024-02-21T23:01:45.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.148+0000 7f73ba400640 1 --2- 172.21.15.99:0/3371223717 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f739009edf0 0x7f73900a12b0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:45.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.148+0000 7f73ba400640 1 --2- 172.21.15.99:0/3371223717 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73b4180c80 0x7f73b417b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:45.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.148+0000 7f73ba400640 1 --2- 172.21.15.99:0/3371223717 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f73b40701c0 0x7f73b40d1fc0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:45.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.148+0000 7f73ba400640 1 --2- 172.21.15.99:0/3371223717 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f73b406e910 0x7f73b4166fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:45.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.148+0000 7f73ba400640 1 -- 172.21.15.99:0/3371223717 >> 172.21.15.99:0/3371223717 conn(0x7f73b40ce5f0 msgr2=0x7f73b4171d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:45.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.148+0000 7f73ba400640 1 -- 172.21.15.99:0/3371223717 shutdown_connections 2024-02-21T23:01:45.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.148+0000 7f73ba400640 1 -- 172.21.15.99:0/3371223717 wait complete. 2024-02-21T23:01:45.155 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-21T23:01:45.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.369+0000 7f160a400640 1 Processor -- start 2024-02-21T23:01:45.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.370+0000 7f160a400640 1 -- start start 2024-02-21T23:01:45.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.372+0000 7f160a400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f16040fe4f0 0x7f160418cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:45.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.373+0000 7f160a400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f16040fe8d0 0x7f16040fed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:45.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.373+0000 7f160a400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16040f9f10 con 0x7f160406c540 2024-02-21T23:01:45.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.373+0000 7f160a400640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f160406c0b0 con 0x7f16040fe8d0 2024-02-21T23:01:45.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.373+0000 7f160a400640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16040d06b0 con 0x7f16040fe4f0 2024-02-21T23:01:45.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.373+0000 7f1603e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f16040fe8d0 0x7f16040fed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:45.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.373+0000 7f1603e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f16040fe8d0 0x7f16040fed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59870/0 (socket says 172.21.15.99:59870) 2024-02-21T23:01:45.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.373+0000 7f1603e00640 1 -- 172.21.15.99:0/338484492 learned_addr learned my addr 172.21.15.99:0/338484492 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:45.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.373+0000 7f1603400640 1 --2- 172.21.15.99:0/338484492 >> v2:172.21.15.162:3300/0 conn(0x7f16040fe4f0 0x7f160418cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:45.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.373+0000 7f1603e00640 1 -- 172.21.15.99:0/338484492 >> v2:172.21.15.162:3300/0 conn(0x7f16040fe4f0 msgr2=0x7f160418cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:45.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.373+0000 7f1603e00640 1 --2- 172.21.15.99:0/338484492 >> v2:172.21.15.162:3300/0 conn(0x7f16040fe4f0 0x7f160418cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:45.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.373+0000 7f1603e00640 1 -- 172.21.15.99:0/338484492 >> v1:172.21.15.162:6789/0 conn(0x7f160406c540 legacy=0x7f160406c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:45.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.373+0000 7f1602000640 1 -- 172.21.15.99:0/338484492 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2021657544 0 0) 0x7f16040f9f10 con 0x7f160406c540 2024-02-21T23:01:45.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.374+0000 7f1603e00640 1 -- 172.21.15.99:0/338484492 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16040d03d0 con 0x7f16040fe8d0 2024-02-21T23:01:45.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.375+0000 7f1603e00640 1 --2- 172.21.15.99:0/338484492 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f16040fe8d0 0x7f16040fed60 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1604186b00 tx=0x7f15fc02bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b42a4bbe38ff2690 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:45.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.375+0000 7f1602000640 1 -- 172.21.15.99:0/338484492 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15fc02cb20 con 0x7f16040fe8d0 2024-02-21T23:01:45.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.376+0000 7f1602000640 1 -- 172.21.15.99:0/338484492 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15fc02ccc0 con 0x7f16040fe8d0 2024-02-21T23:01:45.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.376+0000 7f1602000640 1 -- 172.21.15.99:0/338484492 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15fc034610 con 0x7f16040fe8d0 2024-02-21T23:01:45.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.376+0000 7f160a400640 1 -- 172.21.15.99:0/338484492 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f16040fe8d0 msgr2=0x7f16040fed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:45.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.376+0000 7f160a400640 1 --2- 172.21.15.99:0/338484492 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f16040fe8d0 0x7f16040fed60 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1604186b00 tx=0x7f15fc02bf80 comp rx=0 tx=0).stop 2024-02-21T23:01:45.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.376+0000 7f160a400640 1 -- 172.21.15.99:0/338484492 shutdown_connections 2024-02-21T23:01:45.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.376+0000 7f160a400640 1 --2- 172.21.15.99:0/338484492 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f16040fe8d0 0x7f16040fed60 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:45.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.376+0000 7f160a400640 1 --2- 172.21.15.99:0/338484492 >> v2:172.21.15.162:3300/0 conn(0x7f16040fe4f0 0x7f160418cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:45.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.376+0000 7f160a400640 1 -- 172.21.15.99:0/338484492 >> 172.21.15.99:0/338484492 conn(0x7f16040d6bc0 msgr2=0x7f1604072620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:45.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.376+0000 7f160a400640 1 -- 172.21.15.99:0/338484492 shutdown_connections 2024-02-21T23:01:45.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.376+0000 7f160a400640 1 -- 172.21.15.99:0/338484492 wait complete. 2024-02-21T23:01:45.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.380+0000 7f160a400640 1 Processor -- start 2024-02-21T23:01:45.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.380+0000 7f160a400640 1 -- start start 2024-02-21T23:01:45.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.382+0000 7f160a400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f160406c540 0x7f160421eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:45.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.382+0000 7f160a400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16040fe4f0 0x7f160417d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:45.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.382+0000 7f160a400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f16040fe8d0 0x7f1604173d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:45.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.382+0000 7f160a400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f160406bd40 con 0x7f160406c540 2024-02-21T23:01:45.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.382+0000 7f160a400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f160406ba60 con 0x7f16040fe4f0 2024-02-21T23:01:45.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.382+0000 7f160a400640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f160418a1b0 con 0x7f16040fe8d0 2024-02-21T23:01:45.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.382+0000 7f1603400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f160406c540 0x7f160421eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:45.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.382+0000 7f1603400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f160406c540 0x7f160421eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59880/0 (socket says 172.21.15.99:59880) 2024-02-21T23:01:45.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.382+0000 7f1603400640 1 -- 172.21.15.99:0/171001827 learned_addr learned my addr 172.21.15.99:0/171001827 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:45.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.382+0000 7f1602a00640 1 --2- 172.21.15.99:0/171001827 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16040fe4f0 0x7f160417d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:45.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.382+0000 7f1603e00640 1 --2- 172.21.15.99:0/171001827 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f16040fe8d0 0x7f1604173d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:45.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.383+0000 7f1603400640 1 -- 172.21.15.99:0/171001827 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f16040fe8d0 msgr2=0x7f1604173d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:45.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.383+0000 7f1603400640 1 --2- 172.21.15.99:0/171001827 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f16040fe8d0 0x7f1604173d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:45.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.383+0000 7f1603400640 1 -- 172.21.15.99:0/171001827 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16040fe4f0 msgr2=0x7f160417d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:45.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.383+0000 7f1603400640 1 --2- 172.21.15.99:0/171001827 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16040fe4f0 0x7f160417d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:45.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.383+0000 7f1603400640 1 -- 172.21.15.99:0/171001827 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f160421fae0 con 0x7f160406c540 2024-02-21T23:01:45.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.383+0000 7f1603400640 1 --2- 172.21.15.99:0/171001827 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f160406c540 0x7f160421eb70 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f15f400e870 tx=0x7f15f400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:45.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.383+0000 7f15fb400640 1 -- 172.21.15.99:0/171001827 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f4017070 con 0x7f160406c540 2024-02-21T23:01:45.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.384+0000 7f15fb400640 1 -- 172.21.15.99:0/171001827 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15f400c940 con 0x7f160406c540 2024-02-21T23:01:45.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.384+0000 7f160a400640 1 -- 172.21.15.99:0/171001827 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1604186c20 con 0x7f160406c540 2024-02-21T23:01:45.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.384+0000 7f15fb400640 1 -- 172.21.15.99:0/171001827 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f400cd30 con 0x7f160406c540 2024-02-21T23:01:45.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.384+0000 7f160a400640 1 -- 172.21.15.99:0/171001827 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f160421f520 con 0x7f160406c540 2024-02-21T23:01:45.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.385+0000 7f160a400640 1 -- 172.21.15.99:0/171001827 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f160421f860 con 0x7f160406c540 2024-02-21T23:01:45.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.387+0000 7f15fb400640 1 -- 172.21.15.99:0/171001827 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 6) v1 ==== 134407+0+0 (secure 0 0 0) 0x7f15f401a070 con 0x7f160406c540 2024-02-21T23:01:45.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.389+0000 7f15fb400640 1 --2- 172.21.15.99:0/171001827 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f15e409edf0 0x7f15e40a12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:45.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.389+0000 7f15fb400640 1 -- 172.21.15.99:0/171001827 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f15f40ca110 con 0x7f160406c540 2024-02-21T23:01:45.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.390+0000 7f1602a00640 1 --2- 172.21.15.99:0/171001827 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f15e409edf0 0x7f15e40a12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:45.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.390+0000 7f1602a00640 1 --2- 172.21.15.99:0/171001827 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f15e409edf0 0x7f15e40a12b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1604188ae0 tx=0x7f15f0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:45.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.394+0000 7f15fb400640 1 -- 172.21.15.99:0/171001827 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f160421f860 con 0x7f160406c540 2024-02-21T23:01:45.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.611+0000 7f160a400640 1 -- 172.21.15.99:0/171001827 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f16040fed70 con 0x7f160406c540 2024-02-21T23:01:45.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.611+0000 7f15fb400640 1 -- 172.21.15.99:0/171001827 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f15f4097cc0 con 0x7f160406c540 2024-02-21T23:01:45.601 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 64 2024-02-21T23:01:45.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.614+0000 7f160a400640 1 -- 172.21.15.99:0/171001827 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f15e409edf0 msgr2=0x7f15e40a12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:45.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.614+0000 7f160a400640 1 --2- 172.21.15.99:0/171001827 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f15e409edf0 0x7f15e40a12b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1604188ae0 tx=0x7f15f0009040 comp rx=0 tx=0).stop 2024-02-21T23:01:45.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.614+0000 7f160a400640 1 -- 172.21.15.99:0/171001827 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f160406c540 msgr2=0x7f160421eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:45.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.614+0000 7f160a400640 1 --2- 172.21.15.99:0/171001827 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f160406c540 0x7f160421eb70 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f15f400e870 tx=0x7f15f400ed30 comp rx=0 tx=0).stop 2024-02-21T23:01:45.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.615+0000 7f160a400640 1 -- 172.21.15.99:0/171001827 shutdown_connections 2024-02-21T23:01:45.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.615+0000 7f160a400640 1 --2- 172.21.15.99:0/171001827 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f15e409edf0 0x7f15e40a12b0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:45.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.615+0000 7f160a400640 1 --2- 172.21.15.99:0/171001827 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f16040fe8d0 0x7f1604173d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:45.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.615+0000 7f160a400640 1 --2- 172.21.15.99:0/171001827 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16040fe4f0 0x7f160417d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:45.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.615+0000 7f160a400640 1 --2- 172.21.15.99:0/171001827 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f160406c540 0x7f160421eb70 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:45.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.615+0000 7f160a400640 1 -- 172.21.15.99:0/171001827 >> 172.21.15.99:0/171001827 conn(0x7f16040d6bc0 msgr2=0x7f16040cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:45.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.615+0000 7f160a400640 1 -- 172.21.15.99:0/171001827 shutdown_connections 2024-02-21T23:01:45.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.615+0000 7f160a400640 1 -- 172.21.15.99:0/171001827 wait complete. 2024-02-21T23:01:45.623 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-02-21T23:01:45.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.855+0000 7f28d9c00640 1 Processor -- start 2024-02-21T23:01:45.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.855+0000 7f28d9c00640 1 -- start start 2024-02-21T23:01:45.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.859+0000 7f28d9c00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f28d4186380 0x7f28d4072350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:45.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.859+0000 7f28d9c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f28d40ccc00 0x7f28d418bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:45.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.859+0000 7f28d9c00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28d4072890 con 0x7f28d4070420 2024-02-21T23:01:45.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.859+0000 7f28d9c00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28d4189e90 con 0x7f28d40ccc00 2024-02-21T23:01:45.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.859+0000 7f28d9c00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28d41899b0 con 0x7f28d4186380 2024-02-21T23:01:45.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.859+0000 7f28d9200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f28d40ccc00 0x7f28d418bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:45.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.859+0000 7f28d3400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f28d4070420 0x7f28d40cc4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:52696/0 (socket says 172.21.15.99:52696) 2024-02-21T23:01:45.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.859+0000 7f28d3e00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f28d4186380 0x7f28d4072350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:45.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.859+0000 7f28d3400640 1 -- 172.21.15.99:0/3232310471 learned_addr learned my addr 172.21.15.99:0/3232310471 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:01:45.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.860+0000 7f28d9200640 1 -- 172.21.15.99:0/3232310471 >> v2:172.21.15.181:3300/0 conn(0x7f28d4186380 msgr2=0x7f28d4072350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:45.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.860+0000 7f28d9200640 1 --2- 172.21.15.99:0/3232310471 >> v2:172.21.15.181:3300/0 conn(0x7f28d4186380 0x7f28d4072350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:45.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.860+0000 7f28d9200640 1 -- 172.21.15.99:0/3232310471 >> v1:172.21.15.99:6789/0 conn(0x7f28d4070420 legacy=0x7f28d40cc4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:45.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.860+0000 7f28d9200640 1 -- 172.21.15.99:0/3232310471 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28d4072b60 con 0x7f28d40ccc00 2024-02-21T23:01:45.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.860+0000 7f28d2a00640 1 -- 172.21.15.99:0/3232310471 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 498723982 0 0) 0x7f28d4072890 con 0x7f28d4070420 2024-02-21T23:01:45.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.861+0000 7f28d9200640 1 --2- 172.21.15.99:0/3232310471 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28d40ccc00 0x7f28d418bf90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f28d4067680 tx=0x7f28cc02be50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=13b5a253a49409c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:45.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.861+0000 7f28d2a00640 1 -- 172.21.15.99:0/3232310471 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28cc039070 con 0x7f28d40ccc00 2024-02-21T23:01:45.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.861+0000 7f28d2a00640 1 -- 172.21.15.99:0/3232310471 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28cc02cc00 con 0x7f28d40ccc00 2024-02-21T23:01:45.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.861+0000 7f28d2a00640 1 -- 172.21.15.99:0/3232310471 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28cc034440 con 0x7f28d40ccc00 2024-02-21T23:01:45.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.862+0000 7f28d9c00640 1 -- 172.21.15.99:0/3232310471 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28d40ccc00 msgr2=0x7f28d418bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:45.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.862+0000 7f28d9c00640 1 --2- 172.21.15.99:0/3232310471 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28d40ccc00 0x7f28d418bf90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f28d4067680 tx=0x7f28cc02be50 comp rx=0 tx=0).stop 2024-02-21T23:01:45.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.862+0000 7f28d9c00640 1 -- 172.21.15.99:0/3232310471 shutdown_connections 2024-02-21T23:01:45.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.862+0000 7f28d9c00640 1 --2- 172.21.15.99:0/3232310471 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28d40ccc00 0x7f28d418bf90 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:45.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.862+0000 7f28d9c00640 1 --2- 172.21.15.99:0/3232310471 >> v2:172.21.15.181:3300/0 conn(0x7f28d4186380 0x7f28d4072350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:45.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.862+0000 7f28d9c00640 1 -- 172.21.15.99:0/3232310471 >> 172.21.15.99:0/3232310471 conn(0x7f28d406e210 msgr2=0x7f28d406e620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:45.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.862+0000 7f28d9c00640 1 -- 172.21.15.99:0/3232310471 shutdown_connections 2024-02-21T23:01:45.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.862+0000 7f28d9c00640 1 -- 172.21.15.99:0/3232310471 wait complete. 2024-02-21T23:01:45.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.865+0000 7f28d9c00640 1 Processor -- start 2024-02-21T23:01:45.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.866+0000 7f28d9c00640 1 -- start start 2024-02-21T23:01:45.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.868+0000 7f28d9c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28d4070420 0x7f28d4174d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:45.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.868+0000 7f28d9c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28d40ccc00 0x7f28d40f7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:45.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.868+0000 7f28d9c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f28d4186380 0x7f28d421ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:45.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.868+0000 7f28d9c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d4073400 con 0x7f28d40ccc00 2024-02-21T23:01:45.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.868+0000 7f28d9c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d4073120 con 0x7f28d4070420 2024-02-21T23:01:45.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.868+0000 7f28d9c00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d40cbcf0 con 0x7f28d4186380 2024-02-21T23:01:45.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.868+0000 7f28d3400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28d40ccc00 0x7f28d40f7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:45.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.868+0000 7f28d3400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28d40ccc00 0x7f28d40f7080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59884/0 (socket says 172.21.15.99:59884) 2024-02-21T23:01:45.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.868+0000 7f28d9200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f28d4186380 0x7f28d421ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:45.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.868+0000 7f28d3400640 1 -- 172.21.15.99:0/3976953565 learned_addr learned my addr 172.21.15.99:0/3976953565 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:45.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.868+0000 7f28d3e00640 1 --2- 172.21.15.99:0/3976953565 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28d4070420 0x7f28d4174d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:45.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.868+0000 7f28d9200640 1 -- 172.21.15.99:0/3976953565 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28d4070420 msgr2=0x7f28d4174d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:45.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.869+0000 7f28d9200640 1 --2- 172.21.15.99:0/3976953565 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28d4070420 0x7f28d4174d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:45.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.869+0000 7f28d9200640 1 -- 172.21.15.99:0/3976953565 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28d40ccc00 msgr2=0x7f28d40f7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:45.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.869+0000 7f28d9200640 1 --2- 172.21.15.99:0/3976953565 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28d40ccc00 0x7f28d40f7080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:45.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.869+0000 7f28d9200640 1 -- 172.21.15.99:0/3976953565 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28d421d790 con 0x7f28d4186380 2024-02-21T23:01:45.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.869+0000 7f28d3400640 1 --2- 172.21.15.99:0/3976953565 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28d40ccc00 0x7f28d40f7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:01:45.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.869+0000 7f28d9200640 1 --2- 172.21.15.99:0/3976953565 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f28d4186380 0x7f28d421ff60 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f28cc033000 tx=0x7f28cc004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:45.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.869+0000 7f28cbe00640 1 -- 172.21.15.99:0/3976953565 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28cc039050 con 0x7f28d4186380 2024-02-21T23:01:45.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.869+0000 7f28cbe00640 1 -- 172.21.15.99:0/3976953565 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28cc045070 con 0x7f28d4186380 2024-02-21T23:01:45.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.870+0000 7f28cbe00640 1 -- 172.21.15.99:0/3976953565 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28cc03e850 con 0x7f28d4186380 2024-02-21T23:01:45.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.870+0000 7f28d9c00640 1 -- 172.21.15.99:0/3976953565 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28d421da70 con 0x7f28d4186380 2024-02-21T23:01:45.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.870+0000 7f28d9c00640 1 -- 172.21.15.99:0/3976953565 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28d421e030 con 0x7f28d4186380 2024-02-21T23:01:45.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.871+0000 7f28d9c00640 1 -- 172.21.15.99:0/3976953565 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28d4068320 con 0x7f28d4186380 2024-02-21T23:01:45.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.873+0000 7f28cbe00640 1 -- 172.21.15.99:0/3976953565 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 6) v1 ==== 134407+0+0 (secure 0 0 0) 0x7f28cc03e9f0 con 0x7f28d4186380 2024-02-21T23:01:45.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.874+0000 7f28cbe00640 1 --2- 172.21.15.99:0/3976953565 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f28b409ee20 0x7f28b40a12e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:45.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.874+0000 7f28cbe00640 1 -- 172.21.15.99:0/3976953565 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f28cc0ec2b0 con 0x7f28d4186380 2024-02-21T23:01:45.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.874+0000 7f28d3e00640 1 --2- 172.21.15.99:0/3976953565 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f28b409ee20 0x7f28b40a12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:45.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.875+0000 7f28d3e00640 1 --2- 172.21.15.99:0/3976953565 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f28b409ee20 0x7f28b40a12e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f28d40f1f60 tx=0x7f28c4009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:45.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:45.877+0000 7f28cbe00640 1 -- 172.21.15.99:0/3976953565 <== mon.2 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f28cc04e020 con 0x7f28d4186380 2024-02-21T23:01:46.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.112+0000 7f28d9c00640 1 -- 172.21.15.99:0/3976953565 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f28d40708c0 con 0x7f28d4186380 2024-02-21T23:01:46.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.113+0000 7f28cbe00640 1 -- 172.21.15.99:0/3976953565 <== mon.2 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f28cc0ba4b0 con 0x7f28d4186380 2024-02-21T23:01:46.103 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 32 2024-02-21T23:01:46.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.116+0000 7f28d9c00640 1 -- 172.21.15.99:0/3976953565 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f28b409ee20 msgr2=0x7f28b40a12e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:46.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.116+0000 7f28d9c00640 1 --2- 172.21.15.99:0/3976953565 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f28b409ee20 0x7f28b40a12e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f28d40f1f60 tx=0x7f28c4009190 comp rx=0 tx=0).stop 2024-02-21T23:01:46.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.116+0000 7f28d9c00640 1 -- 172.21.15.99:0/3976953565 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f28d4186380 msgr2=0x7f28d421ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:46.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.116+0000 7f28d9c00640 1 --2- 172.21.15.99:0/3976953565 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f28d4186380 0x7f28d421ff60 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f28cc033000 tx=0x7f28cc004a40 comp rx=0 tx=0).stop 2024-02-21T23:01:46.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.116+0000 7f28d9c00640 1 -- 172.21.15.99:0/3976953565 shutdown_connections 2024-02-21T23:01:46.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.116+0000 7f28d9c00640 1 --2- 172.21.15.99:0/3976953565 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f28b409ee20 0x7f28b40a12e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:46.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.116+0000 7f28d9c00640 1 --2- 172.21.15.99:0/3976953565 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f28d4186380 0x7f28d421ff60 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:46.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.116+0000 7f28d9c00640 1 --2- 172.21.15.99:0/3976953565 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f28d40ccc00 0x7f28d40f7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:46.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.116+0000 7f28d9c00640 1 --2- 172.21.15.99:0/3976953565 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28d4070420 0x7f28d4174d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:46.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.116+0000 7f28d9c00640 1 -- 172.21.15.99:0/3976953565 >> 172.21.15.99:0/3976953565 conn(0x7f28d406e210 msgr2=0x7f28d406fcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:46.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.116+0000 7f28d9c00640 1 -- 172.21.15.99:0/3976953565 shutdown_connections 2024-02-21T23:01:46.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.116+0000 7f28d9c00640 1 -- 172.21.15.99:0/3976953565 wait complete. 2024-02-21T23:01:46.125 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T23:01:46.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.340+0000 7fb11a400640 1 Processor -- start 2024-02-21T23:01:46.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.341+0000 7fb11a400640 1 -- start start 2024-02-21T23:01:46.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.342+0000 7fb11a400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb1141833f0 0x7fb1140f8020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:46.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.342+0000 7fb11a400640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1140f89a0 con 0x7fb114184cd0 2024-02-21T23:01:46.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.342+0000 7fb11a400640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1140f8c40 con 0x7fb1140f8560 2024-02-21T23:01:46.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.342+0000 7fb11a400640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb114186a10 con 0x7fb1141833f0 2024-02-21T23:01:46.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.343+0000 7fb113e00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fb114184cd0 0x7fb11406e310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:52710/0 (socket says 172.21.15.99:52710) 2024-02-21T23:01:46.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.343+0000 7fb10be00640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fb1140f8560 0x7fb1141845c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:48654/0 (socket says 172.21.15.99:48654) 2024-02-21T23:01:46.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.343+0000 7fb113e00640 1 -- 172.21.15.99:0/2730713423 learned_addr learned my addr 172.21.15.99:0/2730713423 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:01:46.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.343+0000 7fb113400640 1 --2- 172.21.15.99:0/2730713423 >> v2:172.21.15.99:3300/0 conn(0x7fb1141833f0 0x7fb1140f8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:46.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.343+0000 7fb112a00640 1 -- 172.21.15.99:0/2730713423 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 911739498 0 0) 0x7fb1140f8c40 con 0x7fb1140f8560 2024-02-21T23:01:46.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.343+0000 7fb112a00640 1 -- 172.21.15.99:0/2730713423 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0f8003520 con 0x7fb1140f8560 2024-02-21T23:01:46.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.343+0000 7fb112a00640 1 -- 172.21.15.99:0/2730713423 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1865219483 0 0) 0x7fb1140f89a0 con 0x7fb114184cd0 2024-02-21T23:01:46.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.343+0000 7fb113400640 1 -- 172.21.15.99:0/2730713423 >> v1:172.21.15.181:6789/0 conn(0x7fb1140f8560 legacy=0x7fb1141845c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:46.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.343+0000 7fb113400640 1 -- 172.21.15.99:0/2730713423 >> v1:172.21.15.99:6789/0 conn(0x7fb114184cd0 legacy=0x7fb11406e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:46.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.343+0000 7fb113400640 1 -- 172.21.15.99:0/2730713423 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1140f8f20 con 0x7fb1141833f0 2024-02-21T23:01:46.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.345+0000 7fb113400640 1 --2- 172.21.15.99:0/2730713423 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb1141833f0 0x7fb1140f8020 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb10400ba40 tx=0x7fb10402e0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aa22f74112c6d47 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:46.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.345+0000 7fb112a00640 1 -- 172.21.15.99:0/2730713423 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb10403b070 con 0x7fb1141833f0 2024-02-21T23:01:46.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.346+0000 7fb112a00640 1 -- 172.21.15.99:0/2730713423 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb10402ee50 con 0x7fb1141833f0 2024-02-21T23:01:46.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.346+0000 7fb112a00640 1 -- 172.21.15.99:0/2730713423 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb104036660 con 0x7fb1141833f0 2024-02-21T23:01:46.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.346+0000 7fb11a400640 1 -- 172.21.15.99:0/2730713423 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb1141833f0 msgr2=0x7fb1140f8020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:46.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.346+0000 7fb11a400640 1 --2- 172.21.15.99:0/2730713423 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb1141833f0 0x7fb1140f8020 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb10400ba40 tx=0x7fb10402e0a0 comp rx=0 tx=0).stop 2024-02-21T23:01:46.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.346+0000 7fb11a400640 1 -- 172.21.15.99:0/2730713423 shutdown_connections 2024-02-21T23:01:46.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.346+0000 7fb11a400640 1 --2- 172.21.15.99:0/2730713423 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb1141833f0 0x7fb1140f8020 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:46.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.346+0000 7fb11a400640 1 -- 172.21.15.99:0/2730713423 >> 172.21.15.99:0/2730713423 conn(0x7fb1140ce5f0 msgr2=0x7fb1140cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:46.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.346+0000 7fb11a400640 1 -- 172.21.15.99:0/2730713423 shutdown_connections 2024-02-21T23:01:46.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.346+0000 7fb11a400640 1 -- 172.21.15.99:0/2730713423 wait complete. 2024-02-21T23:01:46.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.348+0000 7fb11a400640 1 Processor -- start 2024-02-21T23:01:46.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.348+0000 7fb11a400640 1 -- start start 2024-02-21T23:01:46.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.350+0000 7fb11a400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb1140f8560 0x7fb11415e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:46.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.350+0000 7fb11a400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb1141833f0 0x7fb1140718d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:46.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.350+0000 7fb11a400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb114184cd0 0x7fb114071e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:46.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.350+0000 7fb11a400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1141840a0 con 0x7fb114184cd0 2024-02-21T23:01:46.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.350+0000 7fb11a400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb114183dc0 con 0x7fb1141833f0 2024-02-21T23:01:46.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.350+0000 7fb11a400640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb114185120 con 0x7fb1140f8560 2024-02-21T23:01:46.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.350+0000 7fb113e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb114184cd0 0x7fb114071e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:46.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.350+0000 7fb113e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb114184cd0 0x7fb114071e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59902/0 (socket says 172.21.15.99:59902) 2024-02-21T23:01:46.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.350+0000 7fb113e00640 1 -- 172.21.15.99:0/2737150713 learned_addr learned my addr 172.21.15.99:0/2737150713 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:46.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.350+0000 7fb113400640 1 --2- 172.21.15.99:0/2737150713 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb1140f8560 0x7fb11415e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:46.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.350+0000 7fb10be00640 1 --2- 172.21.15.99:0/2737150713 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb1141833f0 0x7fb1140718d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:46.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.351+0000 7fb113400640 1 -- 172.21.15.99:0/2737150713 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb1141833f0 msgr2=0x7fb1140718d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:46.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.351+0000 7fb113400640 1 --2- 172.21.15.99:0/2737150713 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb1141833f0 0x7fb1140718d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:46.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.351+0000 7fb113400640 1 -- 172.21.15.99:0/2737150713 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb114184cd0 msgr2=0x7fb114071e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:46.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.351+0000 7fb113400640 1 --2- 172.21.15.99:0/2737150713 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb114184cd0 0x7fb114071e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:46.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.351+0000 7fb113400640 1 -- 172.21.15.99:0/2737150713 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1141822d0 con 0x7fb1140f8560 2024-02-21T23:01:46.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.351+0000 7fb113e00640 1 --2- 172.21.15.99:0/2737150713 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb114184cd0 0x7fb114071e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:01:46.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.351+0000 7fb113400640 1 --2- 172.21.15.99:0/2737150713 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb1140f8560 0x7fb11415e2f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb114067130 tx=0x7fb1040046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:46.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.351+0000 7fb10b400640 1 -- 172.21.15.99:0/2737150713 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb104046070 con 0x7fb1140f8560 2024-02-21T23:01:46.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.351+0000 7fb10b400640 1 -- 172.21.15.99:0/2737150713 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb104004030 con 0x7fb1140f8560 2024-02-21T23:01:46.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.351+0000 7fb11a400640 1 -- 172.21.15.99:0/2737150713 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb114070b10 con 0x7fb1140f8560 2024-02-21T23:01:46.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.351+0000 7fb10b400640 1 -- 172.21.15.99:0/2737150713 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb10403b040 con 0x7fb1140f8560 2024-02-21T23:01:46.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.352+0000 7fb11a400640 1 -- 172.21.15.99:0/2737150713 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1140710d0 con 0x7fb1140f8560 2024-02-21T23:01:46.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.352+0000 7fb11a400640 1 -- 172.21.15.99:0/2737150713 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb11417f3f0 con 0x7fb1140f8560 2024-02-21T23:01:46.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.354+0000 7fb10b400640 1 -- 172.21.15.99:0/2737150713 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 6) v1 ==== 134407+0+0 (secure 0 0 0) 0x7fb104049070 con 0x7fb1140f8560 2024-02-21T23:01:46.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.356+0000 7fb10b400640 1 --2- 172.21.15.99:0/2737150713 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fb0f009ee20 0x7fb0f00a12e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:46.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.356+0000 7fb10b400640 1 -- 172.21.15.99:0/2737150713 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fb1040eb840 con 0x7fb1140f8560 2024-02-21T23:01:46.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.356+0000 7fb10be00640 1 --2- 172.21.15.99:0/2737150713 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fb0f009ee20 0x7fb0f00a12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:46.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.357+0000 7fb10be00640 1 --2- 172.21.15.99:0/2737150713 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fb0f009ee20 0x7fb0f00a12e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb1140f5cd0 tx=0x7fb0fc007d30 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:46.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.358+0000 7fb10b400640 1 -- 172.21.15.99:0/2737150713 <== mon.2 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fb1040b93f0 con 0x7fb1140f8560 2024-02-21T23:01:46.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.759+0000 7fb11a400640 1 -- 172.21.15.99:0/2737150713 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb1140d2aa0 con 0x7fb1140f8560 2024-02-21T23:01:46.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.760+0000 7fb10b400640 1 -- 172.21.15.99:0/2737150713 <== mon.2 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+11335 (secure 0 0 0) 0x7fb1040bd490 con 0x7fb1140f8560 2024-02-21T23:01:46.751 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T23:01:46.751 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4307,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/3514452812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3514452812},{"type":"v1","addr":"172.21.15.162:6836","nonce":3514452812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4312,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6838/2169982089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":2169982089},{"type":"v1","addr":"172.21.15.162:6838","nonce":2169982089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4315,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6839/3335972724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6837","nonce":3335972724},{"type":"v1","addr":"172.21.15.162:6839","nonce":3335972724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4318,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6841/2135456697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6840","nonce":2135456697},{"type":"v1","addr":"172.21.15.162:6841","nonce":2135456697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4325,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2452242758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2452242758},{"type":"v1","addr":"172.21.15.181:6833","nonce":2452242758}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4328,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6836/2751486400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":2751486400},{"type":"v1","addr":"172.21.15.181:6836","nonce":2751486400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":14,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-21T23:01:02.656130+0000","modified":"2024-02-21T23:01:33.387960+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4355,"mds_1":4352,"mds_2":4348},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4331":{"gid":4331,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6838/3728901330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6835","nonce":3728901330},{"type":"v1","addr":"172.21.15.181:6838","nonce":3728901330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4339":{"gid":4339,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6839/3357929641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6837","nonce":3357929641},{"type":"v1","addr":"172.21.15.181:6839","nonce":3357929641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4343":{"gid":4343,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6833/2793485078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":2793485078},{"type":"v1","addr":"172.21.15.99:6833","nonce":2793485078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4348":{"gid":4348,"name":"d","rank":2,"incarnation":12,"state":"up:active","state_seq":10,"addr":"172.21.15.99:6835/2243461688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2243461688},{"type":"v1","addr":"172.21.15.99:6835","nonce":2243461688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4352":{"gid":4352,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.99:6837/1676159950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":1676159950},{"type":"v1","addr":"172.21.15.99:6837","nonce":1676159950}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4355":{"gid":4355,"name":"j","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6839/4239008786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":4239008786},{"type":"v1","addr":"172.21.15.99:6839","nonce":4239008786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-21T23:01:46.751 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 14 2024-02-21T23:01:46.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.764+0000 7fb11a400640 1 -- 172.21.15.99:0/2737150713 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fb0f009ee20 msgr2=0x7fb0f00a12e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:46.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.764+0000 7fb11a400640 1 --2- 172.21.15.99:0/2737150713 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fb0f009ee20 0x7fb0f00a12e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb1140f5cd0 tx=0x7fb0fc007d30 comp rx=0 tx=0).stop 2024-02-21T23:01:46.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.764+0000 7fb11a400640 1 -- 172.21.15.99:0/2737150713 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb1140f8560 msgr2=0x7fb11415e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:46.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.764+0000 7fb11a400640 1 --2- 172.21.15.99:0/2737150713 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb1140f8560 0x7fb11415e2f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb114067130 tx=0x7fb1040046c0 comp rx=0 tx=0).stop 2024-02-21T23:01:46.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.764+0000 7fb11a400640 1 -- 172.21.15.99:0/2737150713 shutdown_connections 2024-02-21T23:01:46.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.764+0000 7fb11a400640 1 --2- 172.21.15.99:0/2737150713 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fb0f009ee20 0x7fb0f00a12e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:46.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.764+0000 7fb11a400640 1 --2- 172.21.15.99:0/2737150713 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb114184cd0 0x7fb114071e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:46.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.764+0000 7fb11a400640 1 --2- 172.21.15.99:0/2737150713 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb1141833f0 0x7fb1140718d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:46.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.764+0000 7fb11a400640 1 --2- 172.21.15.99:0/2737150713 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb1140f8560 0x7fb11415e2f0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:46.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.764+0000 7fb11a400640 1 -- 172.21.15.99:0/2737150713 >> 172.21.15.99:0/2737150713 conn(0x7fb1140ce5f0 msgr2=0x7fb114068e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:46.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.764+0000 7fb11a400640 1 -- 172.21.15.99:0/2737150713 shutdown_connections 2024-02-21T23:01:46.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.764+0000 7fb11a400640 1 -- 172.21.15.99:0/2737150713 wait complete. 2024-02-21T23:01:46.772 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T23:01:46.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.972+0000 7fe76a600640 1 Processor -- start 2024-02-21T23:01:46.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.972+0000 7fe76a600640 1 -- start start 2024-02-21T23:01:46.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.974+0000 7fe76a600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe76418ab00 0x7fe764184a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:46.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.974+0000 7fe76a600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe76417d980 con 0x7fe764187680 2024-02-21T23:01:46.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.974+0000 7fe76a600640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe764185950 con 0x7fe764186b90 2024-02-21T23:01:46.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.974+0000 7fe76a600640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe764185c30 con 0x7fe76418ab00 2024-02-21T23:01:46.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.974+0000 7fe763e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe76418ab00 0x7fe764184a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:46.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.974+0000 7fe763400640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fe764186b90 0x7fe764186f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:53258/0 (socket says 172.21.15.99:53258) 2024-02-21T23:01:46.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.974+0000 7fe763400640 1 -- 172.21.15.99:0/952787032 learned_addr learned my addr 172.21.15.99:0/952787032 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:01:46.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.974+0000 7fe762a00640 1 --1- 172.21.15.99:0/952787032 >> v1:172.21.15.162:6789/0 conn(0x7fe764187680 0x7fe76418a3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.99:39016/0 (socket says 172.21.15.99:39016) 2024-02-21T23:01:46.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.975+0000 7fe762000640 1 -- 172.21.15.99:0/952787032 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2171716829 0 0) 0x7fe76417d980 con 0x7fe764187680 2024-02-21T23:01:46.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.975+0000 7fe762000640 1 -- 172.21.15.99:0/952787032 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe748003520 con 0x7fe764187680 2024-02-21T23:01:46.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.975+0000 7fe762000640 1 -- 172.21.15.99:0/952787032 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1672137260 0 0) 0x7fe764185950 con 0x7fe764186b90 2024-02-21T23:01:46.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.975+0000 7fe763e00640 1 -- 172.21.15.99:0/952787032 >> v1:172.21.15.181:6789/0 conn(0x7fe764186b90 legacy=0x7fe764186f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:46.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.975+0000 7fe763e00640 1 -- 172.21.15.99:0/952787032 >> v1:172.21.15.162:6789/0 conn(0x7fe764187680 legacy=0x7fe76418a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:46.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.975+0000 7fe763e00640 1 -- 172.21.15.99:0/952787032 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe764185f10 con 0x7fe76418ab00 2024-02-21T23:01:46.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.976+0000 7fe763e00640 1 --2- 172.21.15.99:0/952787032 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe76418ab00 0x7fe764184a90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe75c009d90 tx=0x7fe75c02bf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6822fce10185ef1a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:46.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.977+0000 7fe762000640 1 -- 172.21.15.99:0/952787032 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75c039070 con 0x7fe76418ab00 2024-02-21T23:01:46.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.977+0000 7fe762000640 1 -- 172.21.15.99:0/952787032 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe75c02cd00 con 0x7fe76418ab00 2024-02-21T23:01:46.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.977+0000 7fe762000640 1 -- 172.21.15.99:0/952787032 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75c034660 con 0x7fe76418ab00 2024-02-21T23:01:46.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.977+0000 7fe76a600640 1 -- 172.21.15.99:0/952787032 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe76418ab00 msgr2=0x7fe764184a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:46.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.977+0000 7fe76a600640 1 --2- 172.21.15.99:0/952787032 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe76418ab00 0x7fe764184a90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe75c009d90 tx=0x7fe75c02bf50 comp rx=0 tx=0).stop 2024-02-21T23:01:46.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.977+0000 7fe76a600640 1 -- 172.21.15.99:0/952787032 shutdown_connections 2024-02-21T23:01:46.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.977+0000 7fe76a600640 1 --2- 172.21.15.99:0/952787032 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe76418ab00 0x7fe764184a90 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:46.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.977+0000 7fe76a600640 1 -- 172.21.15.99:0/952787032 >> 172.21.15.99:0/952787032 conn(0x7fe7640ce5f0 msgr2=0x7fe7640cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:46.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.977+0000 7fe76a600640 1 -- 172.21.15.99:0/952787032 shutdown_connections 2024-02-21T23:01:46.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.978+0000 7fe76a600640 1 -- 172.21.15.99:0/952787032 wait complete. 2024-02-21T23:01:46.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.981+0000 7fe76a600640 1 Processor -- start 2024-02-21T23:01:46.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.981+0000 7fe76a600640 1 -- start start 2024-02-21T23:01:46.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.982+0000 7fe76a600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe764186b90 0x7fe764160310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:46.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.982+0000 7fe76a600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe764187680 0x7fe764164b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:46.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.982+0000 7fe76a600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe76418ab00 0x7fe764165040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:46.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.982+0000 7fe76a600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7641867b0 con 0x7fe764186b90 2024-02-21T23:01:46.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.982+0000 7fe76a600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7641864d0 con 0x7fe76418ab00 2024-02-21T23:01:46.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.982+0000 7fe76a600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7640cbf20 con 0x7fe764187680 2024-02-21T23:01:46.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.982+0000 7fe763400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe764186b90 0x7fe764160310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:46.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.982+0000 7fe763e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe76418ab00 0x7fe764165040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:46.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.982+0000 7fe763400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe764186b90 0x7fe764160310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54342/0 (socket says 172.21.15.99:54342) 2024-02-21T23:01:46.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.982+0000 7fe763e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe76418ab00 0x7fe764165040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:34472/0 (socket says 172.21.15.99:34472) 2024-02-21T23:01:46.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.982+0000 7fe763400640 1 -- 172.21.15.99:0/3836262195 learned_addr learned my addr 172.21.15.99:0/3836262195 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:46.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.982+0000 7fe762a00640 1 --2- 172.21.15.99:0/3836262195 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe764187680 0x7fe764164b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:46.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.983+0000 7fe763e00640 1 -- 172.21.15.99:0/3836262195 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe764187680 msgr2=0x7fe764164b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:46.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.983+0000 7fe763e00640 1 --2- 172.21.15.99:0/3836262195 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe764187680 0x7fe764164b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:46.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.983+0000 7fe763e00640 1 -- 172.21.15.99:0/3836262195 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe764186b90 msgr2=0x7fe764160310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:46.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.983+0000 7fe763e00640 1 --2- 172.21.15.99:0/3836262195 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe764186b90 0x7fe764160310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:46.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.983+0000 7fe763e00640 1 -- 172.21.15.99:0/3836262195 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe764168d20 con 0x7fe76418ab00 2024-02-21T23:01:46.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.983+0000 7fe763e00640 1 --2- 172.21.15.99:0/3836262195 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe76418ab00 0x7fe764165040 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe764067130 tx=0x7fe75c004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:46.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.983+0000 7fe75b400640 1 -- 172.21.15.99:0/3836262195 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75c039050 con 0x7fe76418ab00 2024-02-21T23:01:46.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.983+0000 7fe75b400640 1 -- 172.21.15.99:0/3836262195 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe75c03a040 con 0x7fe76418ab00 2024-02-21T23:01:46.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.983+0000 7fe75b400640 1 -- 172.21.15.99:0/3836262195 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75c009450 con 0x7fe76418ab00 2024-02-21T23:01:46.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.983+0000 7fe76a600640 1 -- 172.21.15.99:0/3836262195 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe764169000 con 0x7fe76418ab00 2024-02-21T23:01:46.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.984+0000 7fe76a600640 1 -- 172.21.15.99:0/3836262195 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7640ccd00 con 0x7fe76418ab00 2024-02-21T23:01:46.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.985+0000 7fe76a600640 1 -- 172.21.15.99:0/3836262195 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7640cc1c0 con 0x7fe76418ab00 2024-02-21T23:01:46.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.986+0000 7fe75b400640 1 -- 172.21.15.99:0/3836262195 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 6) v1 ==== 134407+0+0 (secure 0 0 0) 0x7fe75c047020 con 0x7fe76418ab00 2024-02-21T23:01:46.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.988+0000 7fe75b400640 1 --2- 172.21.15.99:0/3836262195 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fe74409edf0 0x7fe7440a12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:46.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.988+0000 7fe75b400640 1 -- 172.21.15.99:0/3836262195 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7fe75c0ebfd0 con 0x7fe76418ab00 2024-02-21T23:01:46.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.988+0000 7fe763400640 1 --2- 172.21.15.99:0/3836262195 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fe74409edf0 0x7fe7440a12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:46.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.989+0000 7fe763400640 1 --2- 172.21.15.99:0/3836262195 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fe74409edf0 0x7fe7440a12b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe754000f60 tx=0x7fe754007ed0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:46.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:46.992+0000 7fe75b400640 1 -- 172.21.15.99:0/3836262195 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fe75c0ba1d0 con 0x7fe76418ab00 2024-02-21T23:01:47.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.280+0000 7fe76a600640 1 -- 172.21.15.99:0/3836262195 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe76417bbe0 con 0x7fe76418ab00 2024-02-21T23:01:47.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.281+0000 7fe75b400640 1 -- 172.21.15.99:0/3836262195 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+23570 (secure 0 0 0) 0x7fe75c0b9ad0 con 0x7fe76418ab00 2024-02-21T23:01:47.272 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T23:01:47.272 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":29,"fsid":"e8af98cd-45a1-425f-96a7-f24da8ee4efb","created":"2024-02-21T23:00:44.699708+0000","modified":"2024-02-21T23:01:07.722511+0000","last_up_change":"2024-02-21T23:00:55.749829+0000","last_in_change":"2024-02-21T23:00:48.332297+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T23:00:57.020557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":11.760000228881836,"score_stable":11.760000228881836,"optimal_score":0.17000000178813934,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-21T23:01:01.124398+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-21T23:01:01.684258+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-21T23:01:05.290089+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c49de9b2-dc53-4882-b14c-7059ed40bf59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6809","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6811","nonce":1026112937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6813","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6815","nonce":1026112937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6823","nonce":1026112937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6819","nonce":1026112937}]},"public_addr":"172.21.15.99:6811/1026112937","cluster_addr":"172.21.15.99:6815/1026112937","heartbeat_back_addr":"172.21.15.99:6823/1026112937","heartbeat_front_addr":"172.21.15.99:6819/1026112937","state":["exists","up"]},{"osd":1,"uuid":"58398292-2fe5-4291-94fd-03a0ca29d49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6827","nonce":3030871566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6829","nonce":3030871566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6833","nonce":3030871566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6831","nonce":3030871566}]},"public_addr":"172.21.15.162:6827/3030871566","cluster_addr":"172.21.15.162:6829/3030871566","heartbeat_back_addr":"172.21.15.162:6833/3030871566","heartbeat_front_addr":"172.21.15.162:6831/3030871566","state":["exists","up"]},{"osd":2,"uuid":"94cddec1-e08f-438d-a7c8-48a0e47d71a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6818","nonce":2782386148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6821","nonce":2782386148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6827","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6829","nonce":2782386148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6823","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6825","nonce":2782386148}]},"public_addr":"172.21.15.181:6818/2782386148","cluster_addr":"172.21.15.181:6821/2782386148","heartbeat_back_addr":"172.21.15.181:6829/2782386148","heartbeat_front_addr":"172.21.15.181:6825/2782386148","state":["exists","up"]},{"osd":3,"uuid":"d29abb74-9b89-4fd7-88b1-7c2eb8231189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6801","nonce":2316185310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6803","nonce":2316185310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6807","nonce":2316185310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6805","nonce":2316185310}]},"public_addr":"172.21.15.99:6801/2316185310","cluster_addr":"172.21.15.99:6803/2316185310","heartbeat_back_addr":"172.21.15.99:6807/2316185310","heartbeat_front_addr":"172.21.15.99:6805/2316185310","state":["exists","up"]},{"osd":4,"uuid":"0d8c9ea3-880a-4d69-9dcb-cf7d35abd449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6811","nonce":3137681258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6813","nonce":3137681258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6817","nonce":3137681258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6815","nonce":3137681258}]},"public_addr":"172.21.15.162:6811/3137681258","cluster_addr":"172.21.15.162:6813/3137681258","heartbeat_back_addr":"172.21.15.162:6817/3137681258","heartbeat_front_addr":"172.21.15.162:6815/3137681258","state":["exists","up"]},{"osd":5,"uuid":"2e3a9340-6fd0-4d7a-8e00-fe305649296e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6801","nonce":2011264527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6803","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6805","nonce":2011264527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6811","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6813","nonce":2011264527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6807","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6809","nonce":2011264527}]},"public_addr":"172.21.15.181:6801/2011264527","cluster_addr":"172.21.15.181:6805/2011264527","heartbeat_back_addr":"172.21.15.181:6813/2011264527","heartbeat_front_addr":"172.21.15.181:6809/2011264527","state":["exists","up"]},{"osd":6,"uuid":"d9e37ce7-1b0e-4019-8f2e-b670403abf7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6810","nonce":753870050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6814","nonce":753870050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6822","nonce":753870050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6818","nonce":753870050}]},"public_addr":"172.21.15.99:6810/753870050","cluster_addr":"172.21.15.99:6814/753870050","heartbeat_back_addr":"172.21.15.99:6822/753870050","heartbeat_front_addr":"172.21.15.99:6818/753870050","state":["exists","up"]},{"osd":7,"uuid":"49988754-232e-4b8c-bd72-bfa25b418e5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6803","nonce":1659412949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6805","nonce":1659412949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6809","nonce":1659412949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6807","nonce":1659412949}]},"public_addr":"172.21.15.162:6803/1659412949","cluster_addr":"172.21.15.162:6805/1659412949","heartbeat_back_addr":"172.21.15.162:6809/1659412949","heartbeat_front_addr":"172.21.15.162:6807/1659412949","state":["exists","up"]},{"osd":8,"uuid":"ebc6e462-8368-4d64-b242-9c8735ac672c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6804","nonce":3389807042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6808","nonce":3389807042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6815","nonce":3389807042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6812","nonce":3389807042}]},"public_addr":"172.21.15.181:6804/3389807042","cluster_addr":"172.21.15.181:6808/3389807042","heartbeat_back_addr":"172.21.15.181:6815/3389807042","heartbeat_front_addr":"172.21.15.181:6812/3389807042","state":["exists","up"]},{"osd":9,"uuid":"72af1b02-b965-4d6a-8964-527ec24c4daa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6825","nonce":4055669590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6827","nonce":4055669590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6831","nonce":4055669590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6829","nonce":4055669590}]},"public_addr":"172.21.15.99:6825/4055669590","cluster_addr":"172.21.15.99:6827/4055669590","heartbeat_back_addr":"172.21.15.99:6831/4055669590","heartbeat_front_addr":"172.21.15.99:6829/4055669590","state":["exists","up"]},{"osd":10,"uuid":"adb5cb06-6453-41e4-b847-d7c78bbb7d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6819","nonce":1421879617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6821","nonce":1421879617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6825","nonce":1421879617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6823","nonce":1421879617}]},"public_addr":"172.21.15.162:6819/1421879617","cluster_addr":"172.21.15.162:6821/1421879617","heartbeat_back_addr":"172.21.15.162:6825/1421879617","heartbeat_front_addr":"172.21.15.162:6823/1421879617","state":["exists","up"]},{"osd":11,"uuid":"118563d9-1e8f-4dc7-a92c-2f4c4dc3e20f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6817","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6819","nonce":3219928272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6824","nonce":3219928272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6831","nonce":3219928272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6828","nonce":3219928272}]},"public_addr":"172.21.15.181:6819/3219928272","cluster_addr":"172.21.15.181:6824/3219928272","heartbeat_back_addr":"172.21.15.181:6831/3219928272","heartbeat_front_addr":"172.21.15.181:6828/3219928272","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.651219+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.549859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.529659+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.591004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.440836+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.414250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.630130+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.411954+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.439371+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.428173+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.511203+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.482806+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T23:01:47.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.284+0000 7fe76a600640 1 -- 172.21.15.99:0/3836262195 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fe74409edf0 msgr2=0x7fe7440a12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:47.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.284+0000 7fe76a600640 1 --2- 172.21.15.99:0/3836262195 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fe74409edf0 0x7fe7440a12b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe754000f60 tx=0x7fe754007ed0 comp rx=0 tx=0).stop 2024-02-21T23:01:47.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.284+0000 7fe76a600640 1 -- 172.21.15.99:0/3836262195 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe76418ab00 msgr2=0x7fe764165040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:47.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.284+0000 7fe76a600640 1 --2- 172.21.15.99:0/3836262195 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe76418ab00 0x7fe764165040 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe764067130 tx=0x7fe75c004a40 comp rx=0 tx=0).stop 2024-02-21T23:01:47.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.284+0000 7fe76a600640 1 -- 172.21.15.99:0/3836262195 shutdown_connections 2024-02-21T23:01:47.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.284+0000 7fe76a600640 1 --2- 172.21.15.99:0/3836262195 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fe74409edf0 0x7fe7440a12b0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:47.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.284+0000 7fe76a600640 1 --2- 172.21.15.99:0/3836262195 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe76418ab00 0x7fe764165040 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:47.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.284+0000 7fe76a600640 1 --2- 172.21.15.99:0/3836262195 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe764187680 0x7fe764164b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:47.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.284+0000 7fe76a600640 1 --2- 172.21.15.99:0/3836262195 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe764186b90 0x7fe764160310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:47.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.285+0000 7fe76a600640 1 -- 172.21.15.99:0/3836262195 >> 172.21.15.99:0/3836262195 conn(0x7fe7640ce5f0 msgr2=0x7fe76418a0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:47.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.285+0000 7fe76a600640 1 -- 172.21.15.99:0/3836262195 shutdown_connections 2024-02-21T23:01:47.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.285+0000 7fe76a600640 1 -- 172.21.15.99:0/3836262195 wait complete. 2024-02-21T23:01:47.291 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-21T23:00:57.020557+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 11.760000228881836, 'score_stable': 11.760000228881836, 'optimal_score': 0.17000000178813934, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-21T23:01:01.124398+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-21T23:01:01.684258+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-02-21T23:01:05.290089+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-02-21T23:01:47.291 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-21T23:01:47.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.516+0000 7f69e8200640 1 Processor -- start 2024-02-21T23:01:47.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.516+0000 7f69e8200640 1 -- start start 2024-02-21T23:01:47.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.519+0000 7f69e8200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f69e008dc10 0x7f69e01871a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:47.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.519+0000 7f69e8200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69e00f8290 con 0x7f69e01876e0 2024-02-21T23:01:47.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.519+0000 7f69e8200640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69e00f8570 con 0x7f69e0186dc0 2024-02-21T23:01:47.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.519+0000 7f69e8200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69e00f8850 con 0x7f69e008dc10 2024-02-21T23:01:47.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.519+0000 7f69e6200640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f69e01876e0 0x7f69e00f73b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:57380/0 (socket says 172.21.15.99:57380) 2024-02-21T23:01:47.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.519+0000 7f69e4e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f69e008dc10 0x7f69e01871a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:47.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.519+0000 7f69e6200640 1 -- 172.21.15.99:0/914472067 learned_addr learned my addr 172.21.15.99:0/914472067 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:01:47.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.520+0000 7f69dfe00640 1 -- 172.21.15.99:0/914472067 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2313945068 0 0) 0x7f69e00f8570 con 0x7f69e0186dc0 2024-02-21T23:01:47.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.520+0000 7f69dfe00640 1 -- 172.21.15.99:0/914472067 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69c8003520 con 0x7f69e0186dc0 2024-02-21T23:01:47.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.520+0000 7f69e4e00640 1 -- 172.21.15.99:0/914472067 >> v1:172.21.15.181:6789/0 conn(0x7f69e0186dc0 legacy=0x7f69e008d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:47.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.520+0000 7f69e4e00640 1 -- 172.21.15.99:0/914472067 >> v1:172.21.15.99:6789/0 conn(0x7f69e01876e0 legacy=0x7f69e00f73b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:47.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.520+0000 7f69dfe00640 1 -- 172.21.15.99:0/914472067 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3398622676 0 0) 0x7f69e00f8290 con 0x7f69e01876e0 2024-02-21T23:01:47.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.520+0000 7f69e4e00640 1 -- 172.21.15.99:0/914472067 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69e0188350 con 0x7f69e008dc10 2024-02-21T23:01:47.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.521+0000 7f69e4e00640 1 --2- 172.21.15.99:0/914472067 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f69e008dc10 0x7f69e01871a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f69cc0097a0 tx=0x7f69cc02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7dd5b82abd0706c0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:47.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.522+0000 7f69dfe00640 1 -- 172.21.15.99:0/914472067 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69cc035020 con 0x7f69e008dc10 2024-02-21T23:01:47.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.522+0000 7f69dfe00640 1 -- 172.21.15.99:0/914472067 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69cc031830 con 0x7f69e008dc10 2024-02-21T23:01:47.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.522+0000 7f69dfe00640 1 -- 172.21.15.99:0/914472067 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69cc031c00 con 0x7f69e008dc10 2024-02-21T23:01:47.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.522+0000 7f69e8200640 1 -- 172.21.15.99:0/914472067 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f69e008dc10 msgr2=0x7f69e01871a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:47.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.522+0000 7f69e8200640 1 --2- 172.21.15.99:0/914472067 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f69e008dc10 0x7f69e01871a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f69cc0097a0 tx=0x7f69cc02b8d0 comp rx=0 tx=0).stop 2024-02-21T23:01:47.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.523+0000 7f69e8200640 1 -- 172.21.15.99:0/914472067 shutdown_connections 2024-02-21T23:01:47.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.523+0000 7f69e8200640 1 --2- 172.21.15.99:0/914472067 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f69e008dc10 0x7f69e01871a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:47.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.523+0000 7f69e8200640 1 -- 172.21.15.99:0/914472067 >> 172.21.15.99:0/914472067 conn(0x7f69e00f8e30 msgr2=0x7f69e00f9240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:47.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.523+0000 7f69e8200640 1 -- 172.21.15.99:0/914472067 shutdown_connections 2024-02-21T23:01:47.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.523+0000 7f69e8200640 1 -- 172.21.15.99:0/914472067 wait complete. 2024-02-21T23:01:47.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.525+0000 7f69e8200640 1 Processor -- start 2024-02-21T23:01:47.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.525+0000 7f69e8200640 1 -- start start 2024-02-21T23:01:47.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.526+0000 7f69e8200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f69e008dc10 0x7f69e0222250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:47.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.526+0000 7f69e8200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f69e0186dc0 0x7f69e0220150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:47.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.526+0000 7f69e8200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f69e01876e0 0x7f69e021f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:47.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.526+0000 7f69e8200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e0187b70 con 0x7f69e008dc10 2024-02-21T23:01:47.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.526+0000 7f69e8200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e017da20 con 0x7f69e01876e0 2024-02-21T23:01:47.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.526+0000 7f69e8200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e0223150 con 0x7f69e0186dc0 2024-02-21T23:01:47.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.526+0000 7f69e5800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f69e008dc10 0x7f69e0222250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:47.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.526+0000 7f69e4e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f69e0186dc0 0x7f69e0220150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:47.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.526+0000 7f69e5800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f69e008dc10 0x7f69e0222250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54358/0 (socket says 172.21.15.99:54358) 2024-02-21T23:01:47.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.526+0000 7f69e4e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f69e0186dc0 0x7f69e0220150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:59104/0 (socket says 172.21.15.99:59104) 2024-02-21T23:01:47.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.526+0000 7f69e5800640 1 -- 172.21.15.99:0/3343797497 learned_addr learned my addr 172.21.15.99:0/3343797497 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:47.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.527+0000 7f69e6200640 1 --2- 172.21.15.99:0/3343797497 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f69e01876e0 0x7f69e021f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:47.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.527+0000 7f69e4e00640 1 -- 172.21.15.99:0/3343797497 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f69e01876e0 msgr2=0x7f69e021f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:47.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.527+0000 7f69e4e00640 1 --2- 172.21.15.99:0/3343797497 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f69e01876e0 0x7f69e021f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:47.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.527+0000 7f69e4e00640 1 -- 172.21.15.99:0/3343797497 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f69e008dc10 msgr2=0x7f69e0222250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:47.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.527+0000 7f69e4e00640 1 --2- 172.21.15.99:0/3343797497 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f69e008dc10 0x7f69e0222250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:47.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.527+0000 7f69e4e00640 1 -- 172.21.15.99:0/3343797497 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69e021ee80 con 0x7f69e0186dc0 2024-02-21T23:01:47.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.527+0000 7f69e5800640 1 --2- 172.21.15.99:0/3343797497 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f69e008dc10 0x7f69e0222250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:01:47.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.527+0000 7f69e4e00640 1 --2- 172.21.15.99:0/3343797497 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f69e0186dc0 0x7f69e0220150 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f69e0070b90 tx=0x7f69cc0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:47.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.528+0000 7f69dd600640 1 -- 172.21.15.99:0/3343797497 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69cc035040 con 0x7f69e0186dc0 2024-02-21T23:01:47.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.528+0000 7f69dd600640 1 -- 172.21.15.99:0/3343797497 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69cc03a840 con 0x7f69e0186dc0 2024-02-21T23:01:47.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.528+0000 7f69e8200640 1 -- 172.21.15.99:0/3343797497 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69e02228b0 con 0x7f69e0186dc0 2024-02-21T23:01:47.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.528+0000 7f69dd600640 1 -- 172.21.15.99:0/3343797497 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69cc03ac10 con 0x7f69e0186dc0 2024-02-21T23:01:47.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.528+0000 7f69e8200640 1 -- 172.21.15.99:0/3343797497 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69e0222e70 con 0x7f69e0186dc0 2024-02-21T23:01:47.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.529+0000 7f69e8200640 1 -- 172.21.15.99:0/3343797497 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69e0066c60 con 0x7f69e0186dc0 2024-02-21T23:01:47.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.532+0000 7f69dd600640 1 -- 172.21.15.99:0/3343797497 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 6) v1 ==== 134407+0+0 (secure 0 0 0) 0x7f69cc038020 con 0x7f69e0186dc0 2024-02-21T23:01:47.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.534+0000 7f69dd600640 1 --2- 172.21.15.99:0/3343797497 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f69c009edf0 0x7f69c00a12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:47.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.535+0000 7f69dd600640 1 -- 172.21.15.99:0/3343797497 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f69cc0ebbd0 con 0x7f69e0186dc0 2024-02-21T23:01:47.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.535+0000 7f69e5800640 1 --2- 172.21.15.99:0/3343797497 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f69c009edf0 0x7f69c00a12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:47.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.536+0000 7f69e5800640 1 --2- 172.21.15.99:0/3343797497 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f69c009edf0 0x7f69c00a12b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f69d4000f60 tx=0x7f69d4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:47.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.538+0000 7f69dd600640 1 -- 172.21.15.99:0/3343797497 <== mon.2 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f69cc0b9e30 con 0x7f69e0186dc0 2024-02-21T23:01:47.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.848+0000 7f69e8200640 1 -- 172.21.15.99:0/3343797497 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f69e00d4d30 con 0x7f69e0186dc0 2024-02-21T23:01:47.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.849+0000 7f69dd600640 1 -- 172.21.15.99:0/3343797497 <== mon.2 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f69cc0b9730 con 0x7f69e0186dc0 2024-02-21T23:01:47.839 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 1 2024-02-21T23:01:47.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.853+0000 7f69e8200640 1 -- 172.21.15.99:0/3343797497 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f69c009edf0 msgr2=0x7f69c00a12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:47.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.853+0000 7f69e8200640 1 --2- 172.21.15.99:0/3343797497 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f69c009edf0 0x7f69c00a12b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f69d4000f60 tx=0x7f69d4009040 comp rx=0 tx=0).stop 2024-02-21T23:01:47.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.853+0000 7f69e8200640 1 -- 172.21.15.99:0/3343797497 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f69e0186dc0 msgr2=0x7f69e0220150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:47.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.853+0000 7f69e8200640 1 --2- 172.21.15.99:0/3343797497 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f69e0186dc0 0x7f69e0220150 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f69e0070b90 tx=0x7f69cc0046c0 comp rx=0 tx=0).stop 2024-02-21T23:01:47.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.853+0000 7f69e8200640 1 -- 172.21.15.99:0/3343797497 shutdown_connections 2024-02-21T23:01:47.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.853+0000 7f69e8200640 1 --2- 172.21.15.99:0/3343797497 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f69c009edf0 0x7f69c00a12b0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:47.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.853+0000 7f69e8200640 1 --2- 172.21.15.99:0/3343797497 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f69e01876e0 0x7f69e021f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:47.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.853+0000 7f69e8200640 1 --2- 172.21.15.99:0/3343797497 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f69e0186dc0 0x7f69e0220150 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:47.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.853+0000 7f69e8200640 1 --2- 172.21.15.99:0/3343797497 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f69e008dc10 0x7f69e0222250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:47.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.853+0000 7f69e8200640 1 -- 172.21.15.99:0/3343797497 >> 172.21.15.99:0/3343797497 conn(0x7f69e00f8e30 msgr2=0x7f69e017ccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:47.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.853+0000 7f69e8200640 1 -- 172.21.15.99:0/3343797497 shutdown_connections 2024-02-21T23:01:47.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:47.853+0000 7f69e8200640 1 -- 172.21.15.99:0/3343797497 wait complete. 2024-02-21T23:01:47.868 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-21T23:01:48.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.080+0000 7eff3ec00640 1 Processor -- start 2024-02-21T23:01:48.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.081+0000 7eff3ec00640 1 -- start start 2024-02-21T23:01:48.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.083+0000 7eff3ec00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7eff38189560 0x7eff380f8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:48.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.083+0000 7eff3ec00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7eff380f8940 0x7eff38187d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:48.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.083+0000 7eff3ec00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff38189b70 con 0x7eff380f8020 2024-02-21T23:01:48.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.083+0000 7eff3ec00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff38186d50 con 0x7eff38189560 2024-02-21T23:01:48.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.083+0000 7eff3ec00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff381878d0 con 0x7eff380f8940 2024-02-21T23:01:48.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.084+0000 7eff37e00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7eff380f8020 0x7eff38188e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:57392/0 (socket says 172.21.15.99:57392) 2024-02-21T23:01:48.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.084+0000 7eff37e00640 1 -- 172.21.15.99:0/566036345 learned_addr learned my addr 172.21.15.99:0/566036345 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:01:48.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.084+0000 7eff37400640 1 --2- 172.21.15.99:0/566036345 >> v2:172.21.15.162:3300/0 conn(0x7eff38189560 0x7eff380f8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:48.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.084+0000 7eff3cc00640 1 --2- 172.21.15.99:0/566036345 >> v2:172.21.15.181:3300/0 conn(0x7eff380f8940 0x7eff38187d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:48.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.084+0000 7eff3cc00640 1 -- 172.21.15.99:0/566036345 >> v2:172.21.15.162:3300/0 conn(0x7eff38189560 msgr2=0x7eff380f8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:48.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.084+0000 7eff3cc00640 1 --2- 172.21.15.99:0/566036345 >> v2:172.21.15.162:3300/0 conn(0x7eff38189560 0x7eff380f8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:48.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.084+0000 7eff3cc00640 1 -- 172.21.15.99:0/566036345 >> v1:172.21.15.99:6789/0 conn(0x7eff380f8020 legacy=0x7eff38188e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:48.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.084+0000 7eff3cc00640 1 -- 172.21.15.99:0/566036345 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff38186fa0 con 0x7eff380f8940 2024-02-21T23:01:48.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.084+0000 7eff36a00640 1 -- 172.21.15.99:0/566036345 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3102710345 0 0) 0x7eff38189b70 con 0x7eff380f8020 2024-02-21T23:01:48.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.086+0000 7eff3cc00640 1 --2- 172.21.15.99:0/566036345 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff380f8940 0x7eff38187d60 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7eff3808e100 tx=0x7eff3002be40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd9a01741d46df72 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:48.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.086+0000 7eff36a00640 1 -- 172.21.15.99:0/566036345 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff30039070 con 0x7eff380f8940 2024-02-21T23:01:48.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.086+0000 7eff36a00640 1 -- 172.21.15.99:0/566036345 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff3002cbf0 con 0x7eff380f8940 2024-02-21T23:01:48.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.086+0000 7eff36a00640 1 -- 172.21.15.99:0/566036345 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff30034440 con 0x7eff380f8940 2024-02-21T23:01:48.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.086+0000 7eff3ec00640 1 -- 172.21.15.99:0/566036345 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff380f8940 msgr2=0x7eff38187d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:48.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.086+0000 7eff3ec00640 1 --2- 172.21.15.99:0/566036345 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff380f8940 0x7eff38187d60 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7eff3808e100 tx=0x7eff3002be40 comp rx=0 tx=0).stop 2024-02-21T23:01:48.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.087+0000 7eff3ec00640 1 -- 172.21.15.99:0/566036345 shutdown_connections 2024-02-21T23:01:48.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.087+0000 7eff3ec00640 1 --2- 172.21.15.99:0/566036345 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff380f8940 0x7eff38187d60 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:48.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.087+0000 7eff3ec00640 1 --2- 172.21.15.99:0/566036345 >> v2:172.21.15.162:3300/0 conn(0x7eff38189560 0x7eff380f8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:48.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.087+0000 7eff3ec00640 1 -- 172.21.15.99:0/566036345 >> 172.21.15.99:0/566036345 conn(0x7eff380ce5f0 msgr2=0x7eff380cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:48.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.087+0000 7eff3ec00640 1 -- 172.21.15.99:0/566036345 shutdown_connections 2024-02-21T23:01:48.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.087+0000 7eff3ec00640 1 -- 172.21.15.99:0/566036345 wait complete. 2024-02-21T23:01:48.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.089+0000 7eff3ec00640 1 Processor -- start 2024-02-21T23:01:48.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.089+0000 7eff3ec00640 1 -- start start 2024-02-21T23:01:48.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.090+0000 7eff3ec00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff380f8020 0x7eff3815d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:48.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.090+0000 7eff3ec00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff380f8940 0x7eff3817afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:48.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.090+0000 7eff3ec00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff38189560 0x7eff38163c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:48.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.090+0000 7eff3ec00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff38187560 con 0x7eff38189560 2024-02-21T23:01:48.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.090+0000 7eff3ec00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff380f9f60 con 0x7eff380f8020 2024-02-21T23:01:48.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.090+0000 7eff3ec00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff3817c660 con 0x7eff380f8940 2024-02-21T23:01:48.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.090+0000 7eff37e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff380f8020 0x7eff3815d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:48.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.090+0000 7eff37400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff380f8940 0x7eff3817afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:48.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.090+0000 7eff3cc00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff38189560 0x7eff38163c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:48.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.090+0000 7eff37400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff380f8940 0x7eff3817afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:59114/0 (socket says 172.21.15.99:59114) 2024-02-21T23:01:48.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.090+0000 7eff37e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff380f8020 0x7eff3815d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:34498/0 (socket says 172.21.15.99:34498) 2024-02-21T23:01:48.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.090+0000 7eff37400640 1 -- 172.21.15.99:0/1226230384 learned_addr learned my addr 172.21.15.99:0/1226230384 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:48.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.091+0000 7eff37400640 1 -- 172.21.15.99:0/1226230384 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff380f8020 msgr2=0x7eff3815d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:48.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.091+0000 7eff37400640 1 --2- 172.21.15.99:0/1226230384 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff380f8020 0x7eff3815d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:48.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.091+0000 7eff37400640 1 -- 172.21.15.99:0/1226230384 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff38189560 msgr2=0x7eff38163c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:48.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.091+0000 7eff37400640 1 --2- 172.21.15.99:0/1226230384 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff38189560 0x7eff38163c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:48.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.091+0000 7eff37400640 1 -- 172.21.15.99:0/1226230384 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff38166990 con 0x7eff380f8940 2024-02-21T23:01:48.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.091+0000 7eff37400640 1 --2- 172.21.15.99:0/1226230384 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff380f8940 0x7eff3817afc0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7eff2000ea10 tx=0x7eff2000eed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:48.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.092+0000 7eff2fe00640 1 -- 172.21.15.99:0/1226230384 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff20017070 con 0x7eff380f8940 2024-02-21T23:01:48.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.092+0000 7eff2fe00640 1 -- 172.21.15.99:0/1226230384 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff2000ca00 con 0x7eff380f8940 2024-02-21T23:01:48.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.092+0000 7eff2fe00640 1 -- 172.21.15.99:0/1226230384 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2000cdf0 con 0x7eff380f8940 2024-02-21T23:01:48.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.092+0000 7eff3ec00640 1 -- 172.21.15.99:0/1226230384 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff3821f640 con 0x7eff380f8940 2024-02-21T23:01:48.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.092+0000 7eff3ec00640 1 -- 172.21.15.99:0/1226230384 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff38166c30 con 0x7eff380f8940 2024-02-21T23:01:48.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.093+0000 7eff3ec00640 1 -- 172.21.15.99:0/1226230384 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff38068780 con 0x7eff380f8940 2024-02-21T23:01:48.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.095+0000 7eff2fe00640 1 -- 172.21.15.99:0/1226230384 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 6) v1 ==== 134407+0+0 (secure 0 0 0) 0x7eff2001a070 con 0x7eff380f8940 2024-02-21T23:01:48.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.097+0000 7eff2fe00640 1 --2- 172.21.15.99:0/1226230384 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7eff1409edf0 0x7eff140a12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:48.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.097+0000 7eff2fe00640 1 -- 172.21.15.99:0/1226230384 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7eff200ca330 con 0x7eff380f8940 2024-02-21T23:01:48.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.097+0000 7eff37e00640 1 --2- 172.21.15.99:0/1226230384 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7eff1409edf0 0x7eff140a12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:48.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.098+0000 7eff2fe00640 1 -- 172.21.15.99:0/1226230384 <== mon.2 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7eff20097ee0 con 0x7eff380f8940 2024-02-21T23:01:48.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.099+0000 7eff37e00640 1 --2- 172.21.15.99:0/1226230384 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7eff1409edf0 0x7eff140a12b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7eff28000f60 tx=0x7eff28007e40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:48.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.300+0000 7eff3ec00640 1 -- 172.21.15.99:0/1226230384 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7eff380f90c0 con 0x7eff380f8940 2024-02-21T23:01:48.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.301+0000 7eff2fe00640 1 -- 172.21.15.99:0/1226230384 <== mon.2 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7eff2009bf80 con 0x7eff380f8940 2024-02-21T23:01:48.291 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 32 2024-02-21T23:01:48.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.304+0000 7eff3ec00640 1 -- 172.21.15.99:0/1226230384 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7eff1409edf0 msgr2=0x7eff140a12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:48.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.304+0000 7eff3ec00640 1 --2- 172.21.15.99:0/1226230384 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7eff1409edf0 0x7eff140a12b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7eff28000f60 tx=0x7eff28007e40 comp rx=0 tx=0).stop 2024-02-21T23:01:48.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.304+0000 7eff3ec00640 1 -- 172.21.15.99:0/1226230384 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff380f8940 msgr2=0x7eff3817afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:48.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.304+0000 7eff3ec00640 1 --2- 172.21.15.99:0/1226230384 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff380f8940 0x7eff3817afc0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7eff2000ea10 tx=0x7eff2000eed0 comp rx=0 tx=0).stop 2024-02-21T23:01:48.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.304+0000 7eff3ec00640 1 -- 172.21.15.99:0/1226230384 shutdown_connections 2024-02-21T23:01:48.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.304+0000 7eff3ec00640 1 --2- 172.21.15.99:0/1226230384 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7eff1409edf0 0x7eff140a12b0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:48.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.304+0000 7eff3ec00640 1 --2- 172.21.15.99:0/1226230384 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7eff38189560 0x7eff38163c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:48.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.304+0000 7eff3ec00640 1 --2- 172.21.15.99:0/1226230384 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7eff380f8940 0x7eff3817afc0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:48.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.304+0000 7eff3ec00640 1 --2- 172.21.15.99:0/1226230384 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff380f8020 0x7eff3815d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:48.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.304+0000 7eff3ec00640 1 -- 172.21.15.99:0/1226230384 >> 172.21.15.99:0/1226230384 conn(0x7eff380ce5f0 msgr2=0x7eff380cd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:48.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.304+0000 7eff3ec00640 1 -- 172.21.15.99:0/1226230384 shutdown_connections 2024-02-21T23:01:48.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.304+0000 7eff3ec00640 1 -- 172.21.15.99:0/1226230384 wait complete. 2024-02-21T23:01:48.315 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-21T23:01:48.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.543+0000 7f11a7000640 1 Processor -- start 2024-02-21T23:01:48.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.544+0000 7f11a7000640 1 -- start start 2024-02-21T23:01:48.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.548+0000 7f11a7000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f11a0189560 0x7f11a00f8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:48.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.548+0000 7f11a7000640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f11a00f8940 0x7f11a0187d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:48.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.548+0000 7f11a7000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11a0189b70 con 0x7f11a00f8020 2024-02-21T23:01:48.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.548+0000 7f11a7000640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11a0186d50 con 0x7f11a0189560 2024-02-21T23:01:48.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.548+0000 7f11a7000640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11a01878d0 con 0x7f11a00f8940 2024-02-21T23:01:48.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.548+0000 7f1197e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f11a0189560 0x7f11a00f8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:48.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.548+0000 7f11a5000640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f11a00f8940 0x7f11a0187d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:48.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.548+0000 7f119fe00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f11a00f8020 0x7f11a0188e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:57398/0 (socket says 172.21.15.99:57398) 2024-02-21T23:01:48.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.548+0000 7f119fe00640 1 -- 172.21.15.99:0/2530635244 learned_addr learned my addr 172.21.15.99:0/2530635244 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:01:48.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.549+0000 7f11a5000640 1 -- 172.21.15.99:0/2530635244 >> v2:172.21.15.99:3300/0 conn(0x7f11a0189560 msgr2=0x7f11a00f8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:48.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.549+0000 7f11a5000640 1 --2- 172.21.15.99:0/2530635244 >> v2:172.21.15.99:3300/0 conn(0x7f11a0189560 0x7f11a00f8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:48.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.549+0000 7f11a5000640 1 -- 172.21.15.99:0/2530635244 >> v1:172.21.15.99:6789/0 conn(0x7f11a00f8020 legacy=0x7f11a0188e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:48.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.549+0000 7f11a5000640 1 -- 172.21.15.99:0/2530635244 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11a0186fa0 con 0x7f11a00f8940 2024-02-21T23:01:48.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.550+0000 7f11a5000640 1 --2- 172.21.15.99:0/2530635244 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11a00f8940 0x7f11a0187d60 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f11a008e100 tx=0x7f119802be30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e24ca502a2a1dc1 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:48.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.550+0000 7f119f400640 1 -- 172.21.15.99:0/2530635244 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1198039070 con 0x7f11a00f8940 2024-02-21T23:01:48.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.550+0000 7f119f400640 1 -- 172.21.15.99:0/2530635244 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f119802cbe0 con 0x7f11a00f8940 2024-02-21T23:01:48.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.550+0000 7f119f400640 1 -- 172.21.15.99:0/2530635244 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1198034440 con 0x7f11a00f8940 2024-02-21T23:01:48.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.551+0000 7f11a7000640 1 -- 172.21.15.99:0/2530635244 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11a00f8940 msgr2=0x7f11a0187d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:48.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.551+0000 7f11a7000640 1 --2- 172.21.15.99:0/2530635244 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11a00f8940 0x7f11a0187d60 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f11a008e100 tx=0x7f119802be30 comp rx=0 tx=0).stop 2024-02-21T23:01:48.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.551+0000 7f11a7000640 1 -- 172.21.15.99:0/2530635244 shutdown_connections 2024-02-21T23:01:48.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.551+0000 7f11a7000640 1 --2- 172.21.15.99:0/2530635244 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11a00f8940 0x7f11a0187d60 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:48.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.551+0000 7f11a7000640 1 --2- 172.21.15.99:0/2530635244 >> v2:172.21.15.99:3300/0 conn(0x7f11a0189560 0x7f11a00f8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:48.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.551+0000 7f11a7000640 1 -- 172.21.15.99:0/2530635244 >> 172.21.15.99:0/2530635244 conn(0x7f11a00ce5f0 msgr2=0x7f11a00cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:48.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.551+0000 7f11a7000640 1 -- 172.21.15.99:0/2530635244 shutdown_connections 2024-02-21T23:01:48.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.551+0000 7f11a7000640 1 -- 172.21.15.99:0/2530635244 wait complete. 2024-02-21T23:01:48.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.553+0000 7f11a7000640 1 Processor -- start 2024-02-21T23:01:48.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.553+0000 7f11a7000640 1 -- start start 2024-02-21T23:01:48.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.554+0000 7f11a7000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11a00f8020 0x7f11a0160200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:48.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.554+0000 7f11a7000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f11a00f8940 0x7f11a00c9df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:48.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.554+0000 7f11a7000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11a0189560 0x7f11a00ca330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:48.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.554+0000 7f11a7000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11a0187560 con 0x7f11a0189560 2024-02-21T23:01:48.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.554+0000 7f11a7000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11a00f9f60 con 0x7f11a00f8940 2024-02-21T23:01:48.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.554+0000 7f11a7000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11a017c660 con 0x7f11a00f8020 2024-02-21T23:01:48.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.555+0000 7f11a5000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11a0189560 0x7f11a00ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:48.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.555+0000 7f119fe00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11a00f8020 0x7f11a0160200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:48.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.555+0000 7f11a5000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11a0189560 0x7f11a00ca330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54390/0 (socket says 172.21.15.99:54390) 2024-02-21T23:01:48.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.555+0000 7f11a5000640 1 -- 172.21.15.99:0/1216864514 learned_addr learned my addr 172.21.15.99:0/1216864514 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:48.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.555+0000 7f1197e00640 1 --2- 172.21.15.99:0/1216864514 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f11a00f8940 0x7f11a00c9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:48.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.555+0000 7f11a5000640 1 -- 172.21.15.99:0/1216864514 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11a00f8020 msgr2=0x7f11a0160200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:48.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.555+0000 7f11a5000640 1 --2- 172.21.15.99:0/1216864514 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11a00f8020 0x7f11a0160200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:48.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.555+0000 7f11a5000640 1 -- 172.21.15.99:0/1216864514 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f11a00f8940 msgr2=0x7f11a00c9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:48.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.555+0000 7f11a5000640 1 --2- 172.21.15.99:0/1216864514 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f11a00f8940 0x7f11a00c9df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:48.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.555+0000 7f11a5000640 1 -- 172.21.15.99:0/1216864514 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11a00ce340 con 0x7f11a0189560 2024-02-21T23:01:48.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.556+0000 7f11a5000640 1 --2- 172.21.15.99:0/1216864514 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11a0189560 0x7f11a00ca330 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1198009e80 tx=0x7f1198004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:48.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.556+0000 7f119cc00640 1 -- 172.21.15.99:0/1216864514 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1198039050 con 0x7f11a0189560 2024-02-21T23:01:48.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.556+0000 7f119cc00640 1 -- 172.21.15.99:0/1216864514 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1198045070 con 0x7f11a0189560 2024-02-21T23:01:48.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.556+0000 7f119cc00640 1 -- 172.21.15.99:0/1216864514 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1198009450 con 0x7f11a0189560 2024-02-21T23:01:48.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.556+0000 7f11a7000640 1 -- 172.21.15.99:0/1216864514 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11a00cd7c0 con 0x7f11a0189560 2024-02-21T23:01:48.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.556+0000 7f11a7000640 1 -- 172.21.15.99:0/1216864514 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11a00cdd80 con 0x7f11a0189560 2024-02-21T23:01:48.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.558+0000 7f11a7000640 1 -- 172.21.15.99:0/1216864514 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11a017c1a0 con 0x7f11a0189560 2024-02-21T23:01:48.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.560+0000 7f119cc00640 1 -- 172.21.15.99:0/1216864514 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 6) v1 ==== 134407+0+0 (secure 0 0 0) 0x7f119803e850 con 0x7f11a0189560 2024-02-21T23:01:48.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.561+0000 7f119cc00640 1 --2- 172.21.15.99:0/1216864514 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f117c09edf0 0x7f117c0a12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:48.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.561+0000 7f119cc00640 1 -- 172.21.15.99:0/1216864514 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f11980ecaa0 con 0x7f11a0189560 2024-02-21T23:01:48.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.561+0000 7f119fe00640 1 --2- 172.21.15.99:0/1216864514 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f117c09edf0 0x7f117c0a12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:48.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.562+0000 7f119fe00640 1 --2- 172.21.15.99:0/1216864514 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f117c09edf0 0x7f117c0a12b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1190007fd0 tx=0x7f1190007e80 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:48.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.569+0000 7f119cc00640 1 -- 172.21.15.99:0/1216864514 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f11980badc0 con 0x7f11a0189560 2024-02-21T23:01:48.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.790+0000 7f11a7000640 1 -- 172.21.15.99:0/1216864514 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f11a0182e10 con 0x7f11a0189560 2024-02-21T23:01:48.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.791+0000 7f119cc00640 1 -- 172.21.15.99:0/1216864514 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f11980ba6c0 con 0x7f11a0189560 2024-02-21T23:01:48.781 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 64 2024-02-21T23:01:48.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.794+0000 7f11a7000640 1 -- 172.21.15.99:0/1216864514 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f117c09edf0 msgr2=0x7f117c0a12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:48.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.794+0000 7f11a7000640 1 --2- 172.21.15.99:0/1216864514 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f117c09edf0 0x7f117c0a12b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1190007fd0 tx=0x7f1190007e80 comp rx=0 tx=0).stop 2024-02-21T23:01:48.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.794+0000 7f11a7000640 1 -- 172.21.15.99:0/1216864514 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11a0189560 msgr2=0x7f11a00ca330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:48.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.794+0000 7f11a7000640 1 --2- 172.21.15.99:0/1216864514 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11a0189560 0x7f11a00ca330 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1198009e80 tx=0x7f1198004a40 comp rx=0 tx=0).stop 2024-02-21T23:01:48.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.795+0000 7f11a7000640 1 -- 172.21.15.99:0/1216864514 shutdown_connections 2024-02-21T23:01:48.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.795+0000 7f11a7000640 1 --2- 172.21.15.99:0/1216864514 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f117c09edf0 0x7f117c0a12b0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:48.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.795+0000 7f11a7000640 1 --2- 172.21.15.99:0/1216864514 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11a0189560 0x7f11a00ca330 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:48.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.795+0000 7f11a7000640 1 --2- 172.21.15.99:0/1216864514 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f11a00f8940 0x7f11a00c9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:48.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.795+0000 7f11a7000640 1 --2- 172.21.15.99:0/1216864514 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11a00f8020 0x7f11a0160200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:48.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.795+0000 7f11a7000640 1 -- 172.21.15.99:0/1216864514 >> 172.21.15.99:0/1216864514 conn(0x7f11a00ce5f0 msgr2=0x7f11a00ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:48.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.795+0000 7f11a7000640 1 -- 172.21.15.99:0/1216864514 shutdown_connections 2024-02-21T23:01:48.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:48.795+0000 7f11a7000640 1 -- 172.21.15.99:0/1216864514 wait complete. 2024-02-21T23:01:48.802 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-02-21T23:01:49.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.029+0000 7f6303200640 1 Processor -- start 2024-02-21T23:01:49.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.030+0000 7f6303200640 1 -- start start 2024-02-21T23:01:49.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.031+0000 7f6303200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63040fd490 con 0x7f63040fb9e0 2024-02-21T23:01:49.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.031+0000 7f6303200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63040fd770 con 0x7f63041648c0 2024-02-21T23:01:49.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.031+0000 7f6303200640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63040fda50 con 0x7f63040fce30 2024-02-21T23:01:49.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.032+0000 7f6301e00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f63041648c0 0x7f6304186d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.99:39030/0 (socket says 172.21.15.99:39030) 2024-02-21T23:01:49.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.032+0000 7f6301e00640 1 -- 172.21.15.99:0/2351801368 learned_addr learned my addr 172.21.15.99:0/2351801368 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:01:49.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.032+0000 7f6300a00640 1 -- 172.21.15.99:0/2351801368 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2161961425 0 0) 0x7f63040fd770 con 0x7f63041648c0 2024-02-21T23:01:49.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.032+0000 7f6300a00640 1 -- 172.21.15.99:0/2351801368 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62e8003520 con 0x7f63041648c0 2024-02-21T23:01:49.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.032+0000 7f6300a00640 1 -- 172.21.15.99:0/2351801368 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3818386255 0 0) 0x7f63040fda50 con 0x7f63040fce30 2024-02-21T23:01:49.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.032+0000 7f6300a00640 1 -- 172.21.15.99:0/2351801368 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63040fd770 con 0x7f63040fce30 2024-02-21T23:01:49.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.032+0000 7f6300a00640 1 -- 172.21.15.99:0/2351801368 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2651384871 0 0) 0x7f63040fd490 con 0x7f63040fb9e0 2024-02-21T23:01:49.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.032+0000 7f6300a00640 1 -- 172.21.15.99:0/2351801368 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63040fda50 con 0x7f63040fb9e0 2024-02-21T23:01:49.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.032+0000 7f6300a00640 1 -- 172.21.15.99:0/2351801368 <== mon.2 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 473037638 0 0) 0x7f63040fd770 con 0x7f63040fce30 2024-02-21T23:01:49.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.032+0000 7f6300a00640 1 -- 172.21.15.99:0/2351801368 >> v1:172.21.15.162:6789/0 conn(0x7f63041648c0 legacy=0x7f6304186d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:49.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.032+0000 7f6300a00640 1 -- 172.21.15.99:0/2351801368 >> v1:172.21.15.99:6789/0 conn(0x7f63040fb9e0 legacy=0x7f6304190350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:49.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.032+0000 7f6300a00640 1 -- 172.21.15.99:0/2351801368 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63040fdd30 con 0x7f63040fce30 2024-02-21T23:01:49.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.032+0000 7f6300a00640 1 -- 172.21.15.99:0/2351801368 <== mon.2 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2069890144 0 0) 0x7f62f0001650 con 0x7f63040fce30 2024-02-21T23:01:49.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.033+0000 7f6300a00640 1 -- 172.21.15.99:0/2351801368 >> v1:172.21.15.181:6789/0 conn(0x7f63040fce30 legacy=0x7f6304187440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:49.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.033+0000 7f6300a00640 1 --2- 172.21.15.99:0/2351801368 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62e8004d60 0x7f62e8005140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:49.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.033+0000 7f6300a00640 1 --2- 172.21.15.99:0/2351801368 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62e80037a0 0x7f62e8003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:49.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.033+0000 7f6300a00640 1 --2- 172.21.15.99:0/2351801368 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62e8004270 0x7f62e800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:49.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.033+0000 7f6300a00640 1 -- 172.21.15.99:0/2351801368 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e800c1b0 con 0x7f62e8004d60 2024-02-21T23:01:49.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.033+0000 7f6300a00640 1 -- 172.21.15.99:0/2351801368 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e800c360 con 0x7f62e80037a0 2024-02-21T23:01:49.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.033+0000 7f6300a00640 1 -- 172.21.15.99:0/2351801368 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e800c560 con 0x7f62e8004270 2024-02-21T23:01:49.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.033+0000 7f6301e00640 1 --2- 172.21.15.99:0/2351801368 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62e8004d60 0x7f62e8005140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:49.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.033+0000 7f6302800640 1 --2- 172.21.15.99:0/2351801368 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62e8004270 0x7f62e800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:49.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.033+0000 7f6301400640 1 --2- 172.21.15.99:0/2351801368 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62e80037a0 0x7f62e8003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:49.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.033+0000 7f6301e00640 1 -- 172.21.15.99:0/2351801368 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62e8004270 msgr2=0x7f62e800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:49.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.033+0000 7f6301e00640 1 --2- 172.21.15.99:0/2351801368 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f62e8004270 0x7f62e800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:49.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.033+0000 7f6301e00640 1 -- 172.21.15.99:0/2351801368 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62e80037a0 msgr2=0x7f62e8003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:49.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.033+0000 7f6301e00640 1 --2- 172.21.15.99:0/2351801368 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62e80037a0 0x7f62e8003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:49.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.034+0000 7f6301e00640 1 -- 172.21.15.99:0/2351801368 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63040fdd30 con 0x7f62e8004d60 2024-02-21T23:01:49.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.034+0000 7f6302800640 1 -- 172.21.15.99:0/2351801368 reap_dead start 2024-02-21T23:01:49.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.035+0000 7f6301e00640 1 --2- 172.21.15.99:0/2351801368 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62e8004d60 0x7f62e8005140 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f62f400a780 tx=0x7f62e8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=521ce4970554b379 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:49.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.035+0000 7f6300a00640 1 -- 172.21.15.99:0/2351801368 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f400a350 con 0x7f62e8004d60 2024-02-21T23:01:49.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.035+0000 7f6300a00640 1 -- 172.21.15.99:0/2351801368 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62f40072d0 con 0x7f62e8004d60 2024-02-21T23:01:49.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.035+0000 7f6300a00640 1 -- 172.21.15.99:0/2351801368 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f4007700 con 0x7f62e8004d60 2024-02-21T23:01:49.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.036+0000 7f6303200640 1 -- 172.21.15.99:0/2351801368 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62e8004d60 msgr2=0x7f62e8005140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:49.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.036+0000 7f6303200640 1 --2- 172.21.15.99:0/2351801368 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62e8004d60 0x7f62e8005140 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f62f400a780 tx=0x7f62e8005830 comp rx=0 tx=0).stop 2024-02-21T23:01:49.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.036+0000 7f6303200640 1 -- 172.21.15.99:0/2351801368 shutdown_connections 2024-02-21T23:01:49.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.036+0000 7f6303200640 1 --2- 172.21.15.99:0/2351801368 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f62e8004d60 0x7f62e8005140 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:49.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.036+0000 7f6303200640 1 -- 172.21.15.99:0/2351801368 >> 172.21.15.99:0/2351801368 conn(0x7f63040d29c0 msgr2=0x7f63040d2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:49.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.036+0000 7f6303200640 1 -- 172.21.15.99:0/2351801368 shutdown_connections 2024-02-21T23:01:49.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.036+0000 7f6303200640 1 -- 172.21.15.99:0/2351801368 wait complete. 2024-02-21T23:01:49.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.038+0000 7f6303200640 1 Processor -- start 2024-02-21T23:01:49.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.038+0000 7f6303200640 1 -- start start 2024-02-21T23:01:49.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.039+0000 7f6303200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62e8004d60 0x7f630408dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:49.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.039+0000 7f6303200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6304161640 0x7f6304161ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:49.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.039+0000 7f6303200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6304162000 0x7f63040d4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:49.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.039+0000 7f6303200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6304072920 con 0x7f6304162000 2024-02-21T23:01:49.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.039+0000 7f6303200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63040fbe70 con 0x7f62e8004d60 2024-02-21T23:01:49.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.039+0000 7f6303200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6304186d30 con 0x7f6304161640 2024-02-21T23:01:49.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.040+0000 7f6302800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6304162000 0x7f63040d4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:49.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.040+0000 7f6302800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6304162000 0x7f63040d4530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54410/0 (socket says 172.21.15.99:54410) 2024-02-21T23:01:49.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.040+0000 7f6302800640 1 -- 172.21.15.99:0/1234624713 learned_addr learned my addr 172.21.15.99:0/1234624713 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:49.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.040+0000 7f6301e00640 1 --2- 172.21.15.99:0/1234624713 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62e8004d60 0x7f630408dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:49.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.040+0000 7f6301400640 1 --2- 172.21.15.99:0/1234624713 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6304161640 0x7f6304161ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:49.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.040+0000 7f6302800640 1 -- 172.21.15.99:0/1234624713 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6304161640 msgr2=0x7f6304161ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:49.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.040+0000 7f6302800640 1 --2- 172.21.15.99:0/1234624713 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6304161640 0x7f6304161ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:49.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.040+0000 7f6302800640 1 -- 172.21.15.99:0/1234624713 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62e8004d60 msgr2=0x7f630408dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:49.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.040+0000 7f6302800640 1 --2- 172.21.15.99:0/1234624713 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62e8004d60 0x7f630408dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:49.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.040+0000 7f6302800640 1 -- 172.21.15.99:0/1234624713 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f630408e690 con 0x7f6304162000 2024-02-21T23:01:49.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.040+0000 7f6301e00640 1 --2- 172.21.15.99:0/1234624713 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62e8004d60 0x7f630408dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:01:49.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.041+0000 7f6302800640 1 --2- 172.21.15.99:0/1234624713 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6304162000 0x7f63040d4530 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f63040cf4a0 tx=0x7f62fc00f9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:49.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.041+0000 7f62fa000640 1 -- 172.21.15.99:0/1234624713 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62fc0052e0 con 0x7f6304162000 2024-02-21T23:01:49.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.041+0000 7f62fa000640 1 -- 172.21.15.99:0/1234624713 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62fc018070 con 0x7f6304162000 2024-02-21T23:01:49.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.041+0000 7f6303200640 1 -- 172.21.15.99:0/1234624713 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f630408e970 con 0x7f6304162000 2024-02-21T23:01:49.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.041+0000 7f62fa000640 1 -- 172.21.15.99:0/1234624713 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62fc003830 con 0x7f6304162000 2024-02-21T23:01:49.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.041+0000 7f6303200640 1 -- 172.21.15.99:0/1234624713 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f630408ef30 con 0x7f6304162000 2024-02-21T23:01:49.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.043+0000 7f6303200640 1 -- 172.21.15.99:0/1234624713 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6304068320 con 0x7f6304162000 2024-02-21T23:01:49.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.044+0000 7f62fa000640 1 -- 172.21.15.99:0/1234624713 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 6) v1 ==== 134407+0+0 (secure 0 0 0) 0x7f62fc0039d0 con 0x7f6304162000 2024-02-21T23:01:49.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.046+0000 7f62fa000640 1 --2- 172.21.15.99:0/1234624713 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f62e409ee20 0x7f62e40a12e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:49.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.046+0000 7f62fa000640 1 -- 172.21.15.99:0/1234624713 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 8372+0+0 (secure 0 0 0) 0x7f62fc0c94c0 con 0x7f6304162000 2024-02-21T23:01:49.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.047+0000 7f6301e00640 1 --2- 172.21.15.99:0/1234624713 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f62e409ee20 0x7f62e40a12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:49.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.048+0000 7f6301e00640 1 --2- 172.21.15.99:0/1234624713 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f62e409ee20 0x7f62e40a12e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f62f400a750 tx=0x7f62f4009000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:49.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.049+0000 7f62fa000640 1 -- 172.21.15.99:0/1234624713 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f62fc0977b0 con 0x7f6304162000 2024-02-21T23:01:49.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.246+0000 7f6303200640 1 -- 172.21.15.99:0/1234624713 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f6304186400 con 0x7f6304162000 2024-02-21T23:01:49.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.247+0000 7f62fa000640 1 -- 172.21.15.99:0/1234624713 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f62fc0970b0 con 0x7f6304162000 2024-02-21T23:01:49.237 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 32 2024-02-21T23:01:49.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.250+0000 7f6303200640 1 -- 172.21.15.99:0/1234624713 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f62e409ee20 msgr2=0x7f62e40a12e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:49.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.250+0000 7f6303200640 1 --2- 172.21.15.99:0/1234624713 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f62e409ee20 0x7f62e40a12e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f62f400a750 tx=0x7f62f4009000 comp rx=0 tx=0).stop 2024-02-21T23:01:49.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.250+0000 7f6303200640 1 -- 172.21.15.99:0/1234624713 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6304162000 msgr2=0x7f63040d4530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:49.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.250+0000 7f6303200640 1 --2- 172.21.15.99:0/1234624713 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6304162000 0x7f63040d4530 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f63040cf4a0 tx=0x7f62fc00f9d0 comp rx=0 tx=0).stop 2024-02-21T23:01:49.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.250+0000 7f6303200640 1 -- 172.21.15.99:0/1234624713 shutdown_connections 2024-02-21T23:01:49.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.250+0000 7f6303200640 1 --2- 172.21.15.99:0/1234624713 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f62e409ee20 0x7f62e40a12e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:49.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.250+0000 7f6303200640 1 --2- 172.21.15.99:0/1234624713 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6304162000 0x7f63040d4530 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:49.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.250+0000 7f6303200640 1 --2- 172.21.15.99:0/1234624713 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6304161640 0x7f6304161ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:49.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.250+0000 7f6303200640 1 --2- 172.21.15.99:0/1234624713 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62e8004d60 0x7f630408dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:49.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.250+0000 7f6303200640 1 -- 172.21.15.99:0/1234624713 >> 172.21.15.99:0/1234624713 conn(0x7f63040d29c0 msgr2=0x7f6304071b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:49.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.250+0000 7f6303200640 1 -- 172.21.15.99:0/1234624713 shutdown_connections 2024-02-21T23:01:49.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.251+0000 7f6303200640 1 -- 172.21.15.99:0/1234624713 wait complete. 2024-02-21T23:01:49.259 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T23:01:49.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.478+0000 7fdc8b200640 1 Processor -- start 2024-02-21T23:01:49.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.478+0000 7fdc8b200640 1 -- start start 2024-02-21T23:01:49.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.480+0000 7fdc8b200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fdc8c182a80 0x7fdc8c18a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:49.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.480+0000 7fdc8b200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fdc8c18b980 0x7fdc8c186a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:49.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.480+0000 7fdc8b200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc8c0729c0 con 0x7fdc8c1606a0 2024-02-21T23:01:49.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.480+0000 7fdc8b200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc8c18a600 con 0x7fdc8c18b980 2024-02-21T23:01:49.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.480+0000 7fdc8b200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc8c18a8e0 con 0x7fdc8c182a80 2024-02-21T23:01:49.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.480+0000 7fdc89e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fdc8c182a80 0x7fdc8c18a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:49.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.480+0000 7fdc8a800640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fdc8c1606a0 0x7fdc8c160b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:57402/0 (socket says 172.21.15.99:57402) 2024-02-21T23:01:49.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.480+0000 7fdc8a800640 1 -- 172.21.15.99:0/759570758 learned_addr learned my addr 172.21.15.99:0/759570758 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:01:49.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.481+0000 7fdc83e00640 1 --2- 172.21.15.99:0/759570758 >> v2:172.21.15.99:3300/0 conn(0x7fdc8c18b980 0x7fdc8c186a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:49.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.481+0000 7fdc89e00640 1 -- 172.21.15.99:0/759570758 >> v2:172.21.15.99:3300/0 conn(0x7fdc8c18b980 msgr2=0x7fdc8c186a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:49.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.481+0000 7fdc89e00640 1 --2- 172.21.15.99:0/759570758 >> v2:172.21.15.99:3300/0 conn(0x7fdc8c18b980 0x7fdc8c186a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:49.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.481+0000 7fdc89e00640 1 -- 172.21.15.99:0/759570758 >> v1:172.21.15.99:6789/0 conn(0x7fdc8c1606a0 legacy=0x7fdc8c160b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:49.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.481+0000 7fdc89e00640 1 -- 172.21.15.99:0/759570758 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc8c18abc0 con 0x7fdc8c182a80 2024-02-21T23:01:49.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.482+0000 7fdc89e00640 1 --2- 172.21.15.99:0/759570758 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc8c182a80 0x7fdc8c18a010 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c0926e0 tx=0x7fdc7c02b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ec3a65da2b1a963 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:49.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.482+0000 7fdc89400640 1 -- 172.21.15.99:0/759570758 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc7c0315a0 con 0x7fdc8c182a80 2024-02-21T23:01:49.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.482+0000 7fdc89400640 1 -- 172.21.15.99:0/759570758 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc7c037070 con 0x7fdc8c182a80 2024-02-21T23:01:49.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.482+0000 7fdc89400640 1 -- 172.21.15.99:0/759570758 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc7c031960 con 0x7fdc8c182a80 2024-02-21T23:01:49.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.483+0000 7fdc8b200640 1 -- 172.21.15.99:0/759570758 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc8c182a80 msgr2=0x7fdc8c18a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:49.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.483+0000 7fdc8b200640 1 --2- 172.21.15.99:0/759570758 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc8c182a80 0x7fdc8c18a010 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c0926e0 tx=0x7fdc7c02b840 comp rx=0 tx=0).stop 2024-02-21T23:01:49.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.483+0000 7fdc8b200640 1 -- 172.21.15.99:0/759570758 shutdown_connections 2024-02-21T23:01:49.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.483+0000 7fdc8b200640 1 --2- 172.21.15.99:0/759570758 >> v2:172.21.15.99:3300/0 conn(0x7fdc8c18b980 0x7fdc8c186a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:49.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.483+0000 7fdc8b200640 1 --2- 172.21.15.99:0/759570758 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc8c182a80 0x7fdc8c18a010 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:49.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.483+0000 7fdc8b200640 1 -- 172.21.15.99:0/759570758 >> 172.21.15.99:0/759570758 conn(0x7fdc8c0d29f0 msgr2=0x7fdc8c0d2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:49.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.484+0000 7fdc8b200640 1 -- 172.21.15.99:0/759570758 shutdown_connections 2024-02-21T23:01:49.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.484+0000 7fdc8b200640 1 -- 172.21.15.99:0/759570758 wait complete. 2024-02-21T23:01:49.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.486+0000 7fdc8b200640 1 Processor -- start 2024-02-21T23:01:49.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.486+0000 7fdc8b200640 1 -- start start 2024-02-21T23:01:49.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.487+0000 7fdc8b200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdc8c1606a0 0x7fdc8c21fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:49.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.487+0000 7fdc8b200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc8c182a80 0x7fdc8c0fe390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:49.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.487+0000 7fdc8b200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdc8c18b980 0x7fdc8c17bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:49.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.487+0000 7fdc8b200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc8c18b460 con 0x7fdc8c1606a0 2024-02-21T23:01:49.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.487+0000 7fdc8b200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc8c18b180 con 0x7fdc8c182a80 2024-02-21T23:01:49.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.487+0000 7fdc8b200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc8c18be00 con 0x7fdc8c18b980 2024-02-21T23:01:49.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.488+0000 7fdc89e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdc8c1606a0 0x7fdc8c21fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:49.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.488+0000 7fdc89e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdc8c1606a0 0x7fdc8c21fe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54426/0 (socket says 172.21.15.99:54426) 2024-02-21T23:01:49.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.488+0000 7fdc89e00640 1 -- 172.21.15.99:0/3377799134 learned_addr learned my addr 172.21.15.99:0/3377799134 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:49.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.488+0000 7fdc83e00640 1 --2- 172.21.15.99:0/3377799134 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc8c182a80 0x7fdc8c0fe390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:49.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.488+0000 7fdc8a800640 1 --2- 172.21.15.99:0/3377799134 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdc8c18b980 0x7fdc8c17bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:49.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.488+0000 7fdc89e00640 1 -- 172.21.15.99:0/3377799134 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdc8c18b980 msgr2=0x7fdc8c17bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:49.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.488+0000 7fdc89e00640 1 --2- 172.21.15.99:0/3377799134 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdc8c18b980 0x7fdc8c17bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:49.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.488+0000 7fdc89e00640 1 -- 172.21.15.99:0/3377799134 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc8c182a80 msgr2=0x7fdc8c0fe390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:49.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.488+0000 7fdc89e00640 1 --2- 172.21.15.99:0/3377799134 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc8c182a80 0x7fdc8c0fe390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:49.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.488+0000 7fdc89e00640 1 -- 172.21.15.99:0/3377799134 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc8c0fe8d0 con 0x7fdc8c1606a0 2024-02-21T23:01:49.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.489+0000 7fdc89e00640 1 --2- 172.21.15.99:0/3377799134 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdc8c1606a0 0x7fdc8c21fe40 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c000c00 tx=0x7fdc7c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:49.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.489+0000 7fdc82000640 1 -- 172.21.15.99:0/3377799134 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc7c032630 con 0x7fdc8c1606a0 2024-02-21T23:01:49.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.489+0000 7fdc82000640 1 -- 172.21.15.99:0/3377799134 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc7c0327f0 con 0x7fdc8c1606a0 2024-02-21T23:01:49.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.489+0000 7fdc8b200640 1 -- 172.21.15.99:0/3377799134 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc8c2209d0 con 0x7fdc8c1606a0 2024-02-21T23:01:49.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.489+0000 7fdc82000640 1 -- 172.21.15.99:0/3377799134 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc7c032be0 con 0x7fdc8c1606a0 2024-02-21T23:01:49.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.489+0000 7fdc8b200640 1 -- 172.21.15.99:0/3377799134 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc8c220f90 con 0x7fdc8c1606a0 2024-02-21T23:01:49.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.491+0000 7fdc8b200640 1 -- 172.21.15.99:0/3377799134 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc8c0d05e0 con 0x7fdc8c1606a0 2024-02-21T23:01:49.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.493+0000 7fdc82000640 1 -- 172.21.15.99:0/3377799134 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 6) v1 ==== 134407+0+0 (secure 0 0 0) 0x7fdc7c03b3f0 con 0x7fdc8c1606a0 2024-02-21T23:01:49.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.495+0000 7fdc82000640 1 --2- 172.21.15.99:0/3377799134 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fdc6809ee20 0x7fdc680a12e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:49.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.495+0000 7fdc82000640 1 -- 172.21.15.99:0/3377799134 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fdc7c02f030 con 0x7fdc8c1606a0 2024-02-21T23:01:49.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.496+0000 7fdc83e00640 1 --2- 172.21.15.99:0/3377799134 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fdc6809ee20 0x7fdc680a12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:49.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.496+0000 7fdc83e00640 1 --2- 172.21.15.99:0/3377799134 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fdc6809ee20 0x7fdc680a12e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c0fb1a0 tx=0x7fdc74009110 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:49.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.502+0000 7fdc82000640 1 -- 172.21.15.99:0/3377799134 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fdc8c0d05e0 con 0x7fdc8c1606a0 2024-02-21T23:01:49.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.864+0000 7fdc8b200640 1 -- 172.21.15.99:0/3377799134 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdc8c068320 con 0x7fdc8c1606a0 2024-02-21T23:01:49.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.865+0000 7fdc82000640 1 -- 172.21.15.99:0/3377799134 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+11335 (secure 0 0 0) 0x7fdc7c040070 con 0x7fdc8c1606a0 2024-02-21T23:01:49.856 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T23:01:49.856 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4307,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/3514452812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3514452812},{"type":"v1","addr":"172.21.15.162:6836","nonce":3514452812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4312,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6838/2169982089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":2169982089},{"type":"v1","addr":"172.21.15.162:6838","nonce":2169982089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4315,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6839/3335972724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6837","nonce":3335972724},{"type":"v1","addr":"172.21.15.162:6839","nonce":3335972724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4318,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6841/2135456697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6840","nonce":2135456697},{"type":"v1","addr":"172.21.15.162:6841","nonce":2135456697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4325,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2452242758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2452242758},{"type":"v1","addr":"172.21.15.181:6833","nonce":2452242758}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4328,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6836/2751486400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":2751486400},{"type":"v1","addr":"172.21.15.181:6836","nonce":2751486400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":14,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-21T23:01:02.656130+0000","modified":"2024-02-21T23:01:33.387960+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4355,"mds_1":4352,"mds_2":4348},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4331":{"gid":4331,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6838/3728901330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6835","nonce":3728901330},{"type":"v1","addr":"172.21.15.181:6838","nonce":3728901330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4339":{"gid":4339,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6839/3357929641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6837","nonce":3357929641},{"type":"v1","addr":"172.21.15.181:6839","nonce":3357929641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4343":{"gid":4343,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6833/2793485078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":2793485078},{"type":"v1","addr":"172.21.15.99:6833","nonce":2793485078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4348":{"gid":4348,"name":"d","rank":2,"incarnation":12,"state":"up:active","state_seq":10,"addr":"172.21.15.99:6835/2243461688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2243461688},{"type":"v1","addr":"172.21.15.99:6835","nonce":2243461688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4352":{"gid":4352,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.99:6837/1676159950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":1676159950},{"type":"v1","addr":"172.21.15.99:6837","nonce":1676159950}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4355":{"gid":4355,"name":"j","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6839/4239008786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":4239008786},{"type":"v1","addr":"172.21.15.99:6839","nonce":4239008786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-21T23:01:49.856 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 14 2024-02-21T23:01:49.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.868+0000 7fdc8b200640 1 -- 172.21.15.99:0/3377799134 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fdc6809ee20 msgr2=0x7fdc680a12e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:49.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.868+0000 7fdc8b200640 1 --2- 172.21.15.99:0/3377799134 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fdc6809ee20 0x7fdc680a12e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c0fb1a0 tx=0x7fdc74009110 comp rx=0 tx=0).stop 2024-02-21T23:01:49.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.868+0000 7fdc8b200640 1 -- 172.21.15.99:0/3377799134 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdc8c1606a0 msgr2=0x7fdc8c21fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:49.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.868+0000 7fdc8b200640 1 --2- 172.21.15.99:0/3377799134 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdc8c1606a0 0x7fdc8c21fe40 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c000c00 tx=0x7fdc7c0046c0 comp rx=0 tx=0).stop 2024-02-21T23:01:49.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.869+0000 7fdc8b200640 1 -- 172.21.15.99:0/3377799134 shutdown_connections 2024-02-21T23:01:49.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.869+0000 7fdc8b200640 1 --2- 172.21.15.99:0/3377799134 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fdc6809ee20 0x7fdc680a12e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:49.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.869+0000 7fdc8b200640 1 --2- 172.21.15.99:0/3377799134 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdc8c18b980 0x7fdc8c17bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:49.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.869+0000 7fdc8b200640 1 --2- 172.21.15.99:0/3377799134 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc8c182a80 0x7fdc8c0fe390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:49.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.869+0000 7fdc8b200640 1 --2- 172.21.15.99:0/3377799134 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdc8c1606a0 0x7fdc8c21fe40 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:49.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.869+0000 7fdc8b200640 1 -- 172.21.15.99:0/3377799134 >> 172.21.15.99:0/3377799134 conn(0x7fdc8c0d29f0 msgr2=0x7fdc8c0cf2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:49.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.869+0000 7fdc8b200640 1 -- 172.21.15.99:0/3377799134 shutdown_connections 2024-02-21T23:01:49.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:49.869+0000 7fdc8b200640 1 -- 172.21.15.99:0/3377799134 wait complete. 2024-02-21T23:01:49.882 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T23:01:50.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.135+0000 7fb5a2200640 1 Processor -- start 2024-02-21T23:01:50.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.135+0000 7fb5a2200640 1 -- start start 2024-02-21T23:01:50.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.138+0000 7fb5a2200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb59c0d5310 0x7fb59c0cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:50.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.138+0000 7fb5a2200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb59c186a50 con 0x7fb59c1861e0 2024-02-21T23:01:50.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.138+0000 7fb5a2200640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb59c0d5740 con 0x7fb59c1865c0 2024-02-21T23:01:50.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.138+0000 7fb5a2200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb59c186d50 con 0x7fb59c0d5310 2024-02-21T23:01:50.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.138+0000 7fb59aa00640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fb59c1865c0 0x7fb59c188190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:53278/0 (socket says 172.21.15.99:53278) 2024-02-21T23:01:50.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.138+0000 7fb59b400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fb59c1861e0 0x7fb59c187a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:57404/0 (socket says 172.21.15.99:57404) 2024-02-21T23:01:50.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.138+0000 7fb59aa00640 1 -- 172.21.15.99:0/443297115 learned_addr learned my addr 172.21.15.99:0/443297115 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:01:50.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.138+0000 7fb59be00640 1 --2- 172.21.15.99:0/443297115 >> v2:172.21.15.162:3300/0 conn(0x7fb59c0d5310 0x7fb59c0cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:50.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.138+0000 7fb59a000640 1 -- 172.21.15.99:0/443297115 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3568526752 0 0) 0x7fb59c0d5740 con 0x7fb59c1865c0 2024-02-21T23:01:50.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.139+0000 7fb59a000640 1 -- 172.21.15.99:0/443297115 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb580003520 con 0x7fb59c1865c0 2024-02-21T23:01:50.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.139+0000 7fb59a000640 1 -- 172.21.15.99:0/443297115 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2854056091 0 0) 0x7fb59c186a50 con 0x7fb59c1861e0 2024-02-21T23:01:50.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.139+0000 7fb59a000640 1 -- 172.21.15.99:0/443297115 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb59c0d5740 con 0x7fb59c1861e0 2024-02-21T23:01:50.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.139+0000 7fb59be00640 1 -- 172.21.15.99:0/443297115 >> v1:172.21.15.181:6789/0 conn(0x7fb59c1865c0 legacy=0x7fb59c188190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:50.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.139+0000 7fb59be00640 1 -- 172.21.15.99:0/443297115 >> v1:172.21.15.99:6789/0 conn(0x7fb59c1861e0 legacy=0x7fb59c187a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:50.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.139+0000 7fb59be00640 1 -- 172.21.15.99:0/443297115 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb59c0cf7e0 con 0x7fb59c0d5310 2024-02-21T23:01:50.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.140+0000 7fb59be00640 1 --2- 172.21.15.99:0/443297115 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb59c0d5310 0x7fb59c0cdea0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb59c186ed0 tx=0x7fb59402bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ad130ae4c62c1b2 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:50.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.141+0000 7fb59a000640 1 -- 172.21.15.99:0/443297115 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb594039070 con 0x7fb59c0d5310 2024-02-21T23:01:50.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.141+0000 7fb59a000640 1 -- 172.21.15.99:0/443297115 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb59402cc80 con 0x7fb59c0d5310 2024-02-21T23:01:50.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.141+0000 7fb59a000640 1 -- 172.21.15.99:0/443297115 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb594034660 con 0x7fb59c0d5310 2024-02-21T23:01:50.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.141+0000 7fb5a2200640 1 -- 172.21.15.99:0/443297115 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb59c0d5310 msgr2=0x7fb59c0cdea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:50.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.141+0000 7fb5a2200640 1 --2- 172.21.15.99:0/443297115 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb59c0d5310 0x7fb59c0cdea0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb59c186ed0 tx=0x7fb59402bed0 comp rx=0 tx=0).stop 2024-02-21T23:01:50.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.141+0000 7fb5a2200640 1 -- 172.21.15.99:0/443297115 shutdown_connections 2024-02-21T23:01:50.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.142+0000 7fb5a2200640 1 --2- 172.21.15.99:0/443297115 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb59c0d5310 0x7fb59c0cdea0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:50.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.142+0000 7fb5a2200640 1 -- 172.21.15.99:0/443297115 >> 172.21.15.99:0/443297115 conn(0x7fb59c0d6ac0 msgr2=0x7fb59c0740b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:50.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.142+0000 7fb5a2200640 1 -- 172.21.15.99:0/443297115 shutdown_connections 2024-02-21T23:01:50.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.142+0000 7fb5a2200640 1 -- 172.21.15.99:0/443297115 wait complete. 2024-02-21T23:01:50.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.145+0000 7fb5a2200640 1 Processor -- start 2024-02-21T23:01:50.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.145+0000 7fb5a2200640 1 -- start start 2024-02-21T23:01:50.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.147+0000 7fb5a2200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb59c0d5310 0x7fb59c15cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:50.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.147+0000 7fb5a2200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb59c1861e0 0x7fb59c2218a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:50.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.147+0000 7fb5a2200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb59c1865c0 0x7fb59c221de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:50.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.147+0000 7fb5a2200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb59c186fa0 con 0x7fb59c0d5310 2024-02-21T23:01:50.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.147+0000 7fb5a2200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb59c1875f0 con 0x7fb59c1861e0 2024-02-21T23:01:50.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.147+0000 7fb5a2200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb59c187280 con 0x7fb59c1865c0 2024-02-21T23:01:50.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.147+0000 7fb59b400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb59c0d5310 0x7fb59c15cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:50.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.147+0000 7fb59b400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb59c0d5310 0x7fb59c15cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54434/0 (socket says 172.21.15.99:54434) 2024-02-21T23:01:50.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.147+0000 7fb59b400640 1 -- 172.21.15.99:0/1304071908 learned_addr learned my addr 172.21.15.99:0/1304071908 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:50.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.147+0000 7fb59aa00640 1 --2- 172.21.15.99:0/1304071908 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb59c1861e0 0x7fb59c2218a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:50.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.148+0000 7fb59be00640 1 --2- 172.21.15.99:0/1304071908 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb59c1865c0 0x7fb59c221de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:50.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.148+0000 7fb59b400640 1 -- 172.21.15.99:0/1304071908 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb59c1865c0 msgr2=0x7fb59c221de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:50.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.148+0000 7fb59b400640 1 --2- 172.21.15.99:0/1304071908 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb59c1865c0 0x7fb59c221de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:50.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.148+0000 7fb59b400640 1 -- 172.21.15.99:0/1304071908 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb59c1861e0 msgr2=0x7fb59c2218a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:50.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.148+0000 7fb59b400640 1 --2- 172.21.15.99:0/1304071908 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb59c1861e0 0x7fb59c2218a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:50.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.148+0000 7fb59b400640 1 -- 172.21.15.99:0/1304071908 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb59c220520 con 0x7fb59c0d5310 2024-02-21T23:01:50.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.148+0000 7fb59b400640 1 --2- 172.21.15.99:0/1304071908 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb59c0d5310 0x7fb59c15cf90 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb58c00c410 tx=0x7fb58c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:50.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.148+0000 7fb593400640 1 -- 172.21.15.99:0/1304071908 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58c0074e0 con 0x7fb59c0d5310 2024-02-21T23:01:50.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.148+0000 7fb593400640 1 -- 172.21.15.99:0/1304071908 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb58c007680 con 0x7fb59c0d5310 2024-02-21T23:01:50.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.148+0000 7fb5a2200640 1 -- 172.21.15.99:0/1304071908 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb59c220800 con 0x7fb59c0d5310 2024-02-21T23:01:50.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.148+0000 7fb593400640 1 -- 172.21.15.99:0/1304071908 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58c004a00 con 0x7fb59c0d5310 2024-02-21T23:01:50.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.149+0000 7fb5a2200640 1 -- 172.21.15.99:0/1304071908 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb59c220dc0 con 0x7fb59c0d5310 2024-02-21T23:01:50.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.150+0000 7fb5a2200640 1 -- 172.21.15.99:0/1304071908 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb59c17d5b0 con 0x7fb59c0d5310 2024-02-21T23:01:50.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.152+0000 7fb593400640 1 -- 172.21.15.99:0/1304071908 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 6) v1 ==== 134407+0+0 (secure 0 0 0) 0x7fb58c01a020 con 0x7fb59c0d5310 2024-02-21T23:01:50.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.154+0000 7fb593400640 1 --2- 172.21.15.99:0/1304071908 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fb57809edf0 0x7fb5780a12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:50.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.154+0000 7fb593400640 1 -- 172.21.15.99:0/1304071908 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fb58c0c9490 con 0x7fb59c0d5310 2024-02-21T23:01:50.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.154+0000 7fb59aa00640 1 --2- 172.21.15.99:0/1304071908 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fb57809edf0 0x7fb5780a12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:50.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.155+0000 7fb59aa00640 1 --2- 172.21.15.99:0/1304071908 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fb57809edf0 0x7fb5780a12b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb59c0cf5a0 tx=0x7fb584009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:50.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.157+0000 7fb593400640 1 -- 172.21.15.99:0/1304071908 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fb58c097620 con 0x7fb59c0d5310 2024-02-21T23:01:50.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.370+0000 7fb5a2200640 1 -- 172.21.15.99:0/1304071908 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb59c17d2d0 con 0x7fb59c0d5310 2024-02-21T23:01:50.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.371+0000 7fb593400640 1 -- 172.21.15.99:0/1304071908 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+23759 (secure 0 0 0) 0x7fb58c096f20 con 0x7fb59c0d5310 2024-02-21T23:01:50.362 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T23:01:50.362 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":30,"fsid":"e8af98cd-45a1-425f-96a7-f24da8ee4efb","created":"2024-02-21T23:00:44.699708+0000","modified":"2024-02-21T23:01:49.449656+0000","last_up_change":"2024-02-21T23:00:55.749829+0000","last_in_change":"2024-02-21T23:00:48.332297+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T23:00:57.020557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":11.760000228881836,"score_stable":11.760000228881836,"optimal_score":0.17000000178813934,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-21T23:01:01.124398+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-21T23:01:01.684258+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-21T23:01:05.290089+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c49de9b2-dc53-4882-b14c-7059ed40bf59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6809","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6811","nonce":1026112937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6813","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6815","nonce":1026112937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6823","nonce":1026112937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6819","nonce":1026112937}]},"public_addr":"172.21.15.99:6811/1026112937","cluster_addr":"172.21.15.99:6815/1026112937","heartbeat_back_addr":"172.21.15.99:6823/1026112937","heartbeat_front_addr":"172.21.15.99:6819/1026112937","state":["exists","up"]},{"osd":1,"uuid":"58398292-2fe5-4291-94fd-03a0ca29d49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6827","nonce":3030871566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6829","nonce":3030871566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6833","nonce":3030871566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6831","nonce":3030871566}]},"public_addr":"172.21.15.162:6827/3030871566","cluster_addr":"172.21.15.162:6829/3030871566","heartbeat_back_addr":"172.21.15.162:6833/3030871566","heartbeat_front_addr":"172.21.15.162:6831/3030871566","state":["exists","up"]},{"osd":2,"uuid":"94cddec1-e08f-438d-a7c8-48a0e47d71a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6818","nonce":2782386148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6821","nonce":2782386148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6827","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6829","nonce":2782386148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6823","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6825","nonce":2782386148}]},"public_addr":"172.21.15.181:6818/2782386148","cluster_addr":"172.21.15.181:6821/2782386148","heartbeat_back_addr":"172.21.15.181:6829/2782386148","heartbeat_front_addr":"172.21.15.181:6825/2782386148","state":["exists","up"]},{"osd":3,"uuid":"d29abb74-9b89-4fd7-88b1-7c2eb8231189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6801","nonce":2316185310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6803","nonce":2316185310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6807","nonce":2316185310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6805","nonce":2316185310}]},"public_addr":"172.21.15.99:6801/2316185310","cluster_addr":"172.21.15.99:6803/2316185310","heartbeat_back_addr":"172.21.15.99:6807/2316185310","heartbeat_front_addr":"172.21.15.99:6805/2316185310","state":["exists","up"]},{"osd":4,"uuid":"0d8c9ea3-880a-4d69-9dcb-cf7d35abd449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6811","nonce":3137681258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6813","nonce":3137681258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6817","nonce":3137681258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6815","nonce":3137681258}]},"public_addr":"172.21.15.162:6811/3137681258","cluster_addr":"172.21.15.162:6813/3137681258","heartbeat_back_addr":"172.21.15.162:6817/3137681258","heartbeat_front_addr":"172.21.15.162:6815/3137681258","state":["exists","up"]},{"osd":5,"uuid":"2e3a9340-6fd0-4d7a-8e00-fe305649296e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6801","nonce":2011264527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6803","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6805","nonce":2011264527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6811","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6813","nonce":2011264527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6807","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6809","nonce":2011264527}]},"public_addr":"172.21.15.181:6801/2011264527","cluster_addr":"172.21.15.181:6805/2011264527","heartbeat_back_addr":"172.21.15.181:6813/2011264527","heartbeat_front_addr":"172.21.15.181:6809/2011264527","state":["exists","up"]},{"osd":6,"uuid":"d9e37ce7-1b0e-4019-8f2e-b670403abf7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6810","nonce":753870050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6814","nonce":753870050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6822","nonce":753870050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6818","nonce":753870050}]},"public_addr":"172.21.15.99:6810/753870050","cluster_addr":"172.21.15.99:6814/753870050","heartbeat_back_addr":"172.21.15.99:6822/753870050","heartbeat_front_addr":"172.21.15.99:6818/753870050","state":["exists","up"]},{"osd":7,"uuid":"49988754-232e-4b8c-bd72-bfa25b418e5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6803","nonce":1659412949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6805","nonce":1659412949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6809","nonce":1659412949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6807","nonce":1659412949}]},"public_addr":"172.21.15.162:6803/1659412949","cluster_addr":"172.21.15.162:6805/1659412949","heartbeat_back_addr":"172.21.15.162:6809/1659412949","heartbeat_front_addr":"172.21.15.162:6807/1659412949","state":["exists","up"]},{"osd":8,"uuid":"ebc6e462-8368-4d64-b242-9c8735ac672c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6804","nonce":3389807042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6808","nonce":3389807042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6815","nonce":3389807042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6812","nonce":3389807042}]},"public_addr":"172.21.15.181:6804/3389807042","cluster_addr":"172.21.15.181:6808/3389807042","heartbeat_back_addr":"172.21.15.181:6815/3389807042","heartbeat_front_addr":"172.21.15.181:6812/3389807042","state":["exists","up"]},{"osd":9,"uuid":"72af1b02-b965-4d6a-8964-527ec24c4daa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6825","nonce":4055669590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6827","nonce":4055669590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6831","nonce":4055669590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6829","nonce":4055669590}]},"public_addr":"172.21.15.99:6825/4055669590","cluster_addr":"172.21.15.99:6827/4055669590","heartbeat_back_addr":"172.21.15.99:6831/4055669590","heartbeat_front_addr":"172.21.15.99:6829/4055669590","state":["exists","up"]},{"osd":10,"uuid":"adb5cb06-6453-41e4-b847-d7c78bbb7d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6819","nonce":1421879617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6821","nonce":1421879617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6825","nonce":1421879617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6823","nonce":1421879617}]},"public_addr":"172.21.15.162:6819/1421879617","cluster_addr":"172.21.15.162:6821/1421879617","heartbeat_back_addr":"172.21.15.162:6825/1421879617","heartbeat_front_addr":"172.21.15.162:6823/1421879617","state":["exists","up"]},{"osd":11,"uuid":"118563d9-1e8f-4dc7-a92c-2f4c4dc3e20f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6817","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6819","nonce":3219928272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6824","nonce":3219928272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6831","nonce":3219928272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6828","nonce":3219928272}]},"public_addr":"172.21.15.181:6819/3219928272","cluster_addr":"172.21.15.181:6824/3219928272","heartbeat_back_addr":"172.21.15.181:6831/3219928272","heartbeat_front_addr":"172.21.15.181:6828/3219928272","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.651219+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.549859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.529659+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.591004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.440836+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.414250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.630130+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.411954+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.439371+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.428173+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.511203+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.482806+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.6","mappings":[{"from":9,"to":11}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.14","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T23:01:50.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.373+0000 7fb5a2200640 1 -- 172.21.15.99:0/1304071908 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fb57809edf0 msgr2=0x7fb5780a12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:50.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.373+0000 7fb5a2200640 1 --2- 172.21.15.99:0/1304071908 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fb57809edf0 0x7fb5780a12b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb59c0cf5a0 tx=0x7fb584009040 comp rx=0 tx=0).stop 2024-02-21T23:01:50.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.373+0000 7fb5a2200640 1 -- 172.21.15.99:0/1304071908 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb59c0d5310 msgr2=0x7fb59c15cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:50.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.373+0000 7fb5a2200640 1 --2- 172.21.15.99:0/1304071908 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb59c0d5310 0x7fb59c15cf90 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb58c00c410 tx=0x7fb58c00c8d0 comp rx=0 tx=0).stop 2024-02-21T23:01:50.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.374+0000 7fb5a2200640 1 -- 172.21.15.99:0/1304071908 shutdown_connections 2024-02-21T23:01:50.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.374+0000 7fb5a2200640 1 --2- 172.21.15.99:0/1304071908 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fb57809edf0 0x7fb5780a12b0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:50.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.374+0000 7fb5a2200640 1 --2- 172.21.15.99:0/1304071908 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb59c1865c0 0x7fb59c221de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:50.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.374+0000 7fb5a2200640 1 --2- 172.21.15.99:0/1304071908 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb59c1861e0 0x7fb59c2218a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:50.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.374+0000 7fb5a2200640 1 --2- 172.21.15.99:0/1304071908 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb59c0d5310 0x7fb59c15cf90 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:50.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.374+0000 7fb5a2200640 1 -- 172.21.15.99:0/1304071908 >> 172.21.15.99:0/1304071908 conn(0x7fb59c0d6ac0 msgr2=0x7fb59c17ecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:50.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.374+0000 7fb5a2200640 1 -- 172.21.15.99:0/1304071908 shutdown_connections 2024-02-21T23:01:50.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.374+0000 7fb5a2200640 1 -- 172.21.15.99:0/1304071908 wait complete. 2024-02-21T23:01:50.381 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T23:01:50.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.600+0000 7f5148c00640 1 Processor -- start 2024-02-21T23:01:50.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.601+0000 7f5148c00640 1 -- start start 2024-02-21T23:01:50.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.604+0000 7f5148c00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f514417d530 0x7f51440cafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:50.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.604+0000 7f5148c00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f514406d990 con 0x7f51440cb4f0 2024-02-21T23:01:50.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.604+0000 7f5148c00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f514406dc70 con 0x7f51440704b0 2024-02-21T23:01:50.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.604+0000 7f5148c00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f514406e880 con 0x7f514417d530 2024-02-21T23:01:50.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.604+0000 7f5143400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f514417d530 0x7f51440cafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:50.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.604+0000 7f5143400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f514417d530 0x7f51440cafb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54436/0 (socket says 172.21.15.99:54436) 2024-02-21T23:01:50.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.604+0000 7f5143400640 1 -- 172.21.15.99:0/3467712694 learned_addr learned my addr 172.21.15.99:0/3467712694 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:50.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.605+0000 7f5143400640 1 -- 172.21.15.99:0/3467712694 >> v1:172.21.15.162:6789/0 conn(0x7f51440704b0 legacy=0x7f5144186890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:50.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.605+0000 7f5143400640 1 -- 172.21.15.99:0/3467712694 >> v1:172.21.15.99:6789/0 conn(0x7f51440cb4f0 legacy=0x7f514406fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:50.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.605+0000 7f5143400640 1 -- 172.21.15.99:0/3467712694 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f514406df50 con 0x7f514417d530 2024-02-21T23:01:50.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.605+0000 7f5142000640 1 -- 172.21.15.99:0/3467712694 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3655506453 0 0) 0x7f514406dc70 con 0x7f51440704b0 2024-02-21T23:01:50.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.606+0000 7f5143400640 1 --2- 172.21.15.99:0/3467712694 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f514417d530 0x7f51440cafb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5134009870 tx=0x7f513402b740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39184e53f11c5e25 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:50.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.607+0000 7f5142000640 1 -- 172.21.15.99:0/3467712694 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5134037070 con 0x7f514417d530 2024-02-21T23:01:50.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.607+0000 7f5142000640 1 -- 172.21.15.99:0/3467712694 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5134030710 con 0x7f514417d530 2024-02-21T23:01:50.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.607+0000 7f5142000640 1 -- 172.21.15.99:0/3467712694 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5134030ae0 con 0x7f514417d530 2024-02-21T23:01:50.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.608+0000 7f5148c00640 1 -- 172.21.15.99:0/3467712694 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f514417d530 msgr2=0x7f51440cafb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:50.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.608+0000 7f5148c00640 1 --2- 172.21.15.99:0/3467712694 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f514417d530 0x7f51440cafb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5134009870 tx=0x7f513402b740 comp rx=0 tx=0).stop 2024-02-21T23:01:50.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.608+0000 7f5148c00640 1 -- 172.21.15.99:0/3467712694 shutdown_connections 2024-02-21T23:01:50.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.608+0000 7f5148c00640 1 --2- 172.21.15.99:0/3467712694 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f514417d530 0x7f51440cafb0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:50.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.608+0000 7f5148c00640 1 -- 172.21.15.99:0/3467712694 >> 172.21.15.99:0/3467712694 conn(0x7f51440f7300 msgr2=0x7f51440f7710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:50.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.608+0000 7f5148c00640 1 -- 172.21.15.99:0/3467712694 shutdown_connections 2024-02-21T23:01:50.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.608+0000 7f5148c00640 1 -- 172.21.15.99:0/3467712694 wait complete. 2024-02-21T23:01:50.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.611+0000 7f5148c00640 1 Processor -- start 2024-02-21T23:01:50.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.611+0000 7f5148c00640 1 -- start start 2024-02-21T23:01:50.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.613+0000 7f5148c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51440704b0 0x7f514417c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:50.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.613+0000 7f5148c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f51440cb4f0 0x7f514421fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:50.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.613+0000 7f5148c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f514417d530 0x7f514418a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:50.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.613+0000 7f5148c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5144070940 con 0x7f514417d530 2024-02-21T23:01:50.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.613+0000 7f5148c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f514406e510 con 0x7f51440704b0 2024-02-21T23:01:50.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.613+0000 7f5148c00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51440cb970 con 0x7f51440cb4f0 2024-02-21T23:01:50.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.614+0000 7f5143e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f514417d530 0x7f514418a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:50.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.614+0000 7f5143400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51440704b0 0x7f514417c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:50.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.614+0000 7f5143e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f514417d530 0x7f514418a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54444/0 (socket says 172.21.15.99:54444) 2024-02-21T23:01:50.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.614+0000 7f5143e00640 1 -- 172.21.15.99:0/2449074990 learned_addr learned my addr 172.21.15.99:0/2449074990 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:50.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.614+0000 7f5142a00640 1 --2- 172.21.15.99:0/2449074990 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f51440cb4f0 0x7f514421fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:50.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.614+0000 7f5143e00640 1 -- 172.21.15.99:0/2449074990 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f51440cb4f0 msgr2=0x7f514421fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:50.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.614+0000 7f5143e00640 1 --2- 172.21.15.99:0/2449074990 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f51440cb4f0 0x7f514421fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:50.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.614+0000 7f5143e00640 1 -- 172.21.15.99:0/2449074990 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51440704b0 msgr2=0x7f514417c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:50.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.614+0000 7f5143e00640 1 --2- 172.21.15.99:0/2449074990 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51440704b0 0x7f514417c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:50.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.614+0000 7f5143e00640 1 -- 172.21.15.99:0/2449074990 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51441668d0 con 0x7f514417d530 2024-02-21T23:01:50.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.615+0000 7f5143e00640 1 --2- 172.21.15.99:0/2449074990 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f514417d530 0x7f514418a6a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f513c00c750 tx=0x7f513c00cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:50.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.615+0000 7f513b400640 1 -- 172.21.15.99:0/2449074990 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513c00ce60 con 0x7f514417d530 2024-02-21T23:01:50.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.615+0000 7f513b400640 1 -- 172.21.15.99:0/2449074990 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f513c003da0 con 0x7f514417d530 2024-02-21T23:01:50.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.615+0000 7f513b400640 1 -- 172.21.15.99:0/2449074990 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513c005290 con 0x7f514417d530 2024-02-21T23:01:50.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.615+0000 7f5148c00640 1 -- 172.21.15.99:0/2449074990 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5144166b40 con 0x7f514417d530 2024-02-21T23:01:50.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.615+0000 7f5148c00640 1 -- 172.21.15.99:0/2449074990 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5144167100 con 0x7f514417d530 2024-02-21T23:01:50.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.617+0000 7f5148c00640 1 -- 172.21.15.99:0/2449074990 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5144068320 con 0x7f514417d530 2024-02-21T23:01:50.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.618+0000 7f513b400640 1 -- 172.21.15.99:0/2449074990 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 6) v1 ==== 134407+0+0 (secure 0 0 0) 0x7f513c005430 con 0x7f514417d530 2024-02-21T23:01:50.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.620+0000 7f513b400640 1 --2- 172.21.15.99:0/2449074990 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f512409edf0 0x7f51240a12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:50.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.621+0000 7f513b400640 1 -- 172.21.15.99:0/2449074990 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f513c0c9a20 con 0x7f514417d530 2024-02-21T23:01:50.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.621+0000 7f5143400640 1 --2- 172.21.15.99:0/2449074990 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f512409edf0 0x7f51240a12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:50.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.622+0000 7f5143400640 1 --2- 172.21.15.99:0/2449074990 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f512409edf0 0x7f51240a12b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5134034000 tx=0x7f5134008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:50.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.625+0000 7f513b400640 1 -- 172.21.15.99:0/2449074990 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f513c097c10 con 0x7f514417d530 2024-02-21T23:01:50.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.901+0000 7f5148c00640 1 -- 172.21.15.99:0/2449074990 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f514421e2c0 con 0x7f514417d530 2024-02-21T23:01:50.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.902+0000 7f513b400640 1 -- 172.21.15.99:0/2449074990 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+11335 (secure 0 0 0) 0x7f513c097510 con 0x7f514417d530 2024-02-21T23:01:50.892 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T23:01:50.892 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4307,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/3514452812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3514452812},{"type":"v1","addr":"172.21.15.162:6836","nonce":3514452812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4312,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6838/2169982089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":2169982089},{"type":"v1","addr":"172.21.15.162:6838","nonce":2169982089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4315,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6839/3335972724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6837","nonce":3335972724},{"type":"v1","addr":"172.21.15.162:6839","nonce":3335972724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4318,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6841/2135456697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6840","nonce":2135456697},{"type":"v1","addr":"172.21.15.162:6841","nonce":2135456697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4325,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2452242758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2452242758},{"type":"v1","addr":"172.21.15.181:6833","nonce":2452242758}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4328,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6836/2751486400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":2751486400},{"type":"v1","addr":"172.21.15.181:6836","nonce":2751486400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":14,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-21T23:01:02.656130+0000","modified":"2024-02-21T23:01:33.387960+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4355,"mds_1":4352,"mds_2":4348},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4331":{"gid":4331,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6838/3728901330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6835","nonce":3728901330},{"type":"v1","addr":"172.21.15.181:6838","nonce":3728901330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4339":{"gid":4339,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6839/3357929641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6837","nonce":3357929641},{"type":"v1","addr":"172.21.15.181:6839","nonce":3357929641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4343":{"gid":4343,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6833/2793485078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":2793485078},{"type":"v1","addr":"172.21.15.99:6833","nonce":2793485078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4348":{"gid":4348,"name":"d","rank":2,"incarnation":12,"state":"up:active","state_seq":10,"addr":"172.21.15.99:6835/2243461688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2243461688},{"type":"v1","addr":"172.21.15.99:6835","nonce":2243461688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4352":{"gid":4352,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.99:6837/1676159950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":1676159950},{"type":"v1","addr":"172.21.15.99:6837","nonce":1676159950}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4355":{"gid":4355,"name":"j","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6839/4239008786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":4239008786},{"type":"v1","addr":"172.21.15.99:6839","nonce":4239008786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-21T23:01:50.892 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 14 2024-02-21T23:01:50.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.904+0000 7f5148c00640 1 -- 172.21.15.99:0/2449074990 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f512409edf0 msgr2=0x7f51240a12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:50.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.904+0000 7f5148c00640 1 --2- 172.21.15.99:0/2449074990 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f512409edf0 0x7f51240a12b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5134034000 tx=0x7f5134008030 comp rx=0 tx=0).stop 2024-02-21T23:01:50.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.904+0000 7f5148c00640 1 -- 172.21.15.99:0/2449074990 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f514417d530 msgr2=0x7f514418a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:50.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.904+0000 7f5148c00640 1 --2- 172.21.15.99:0/2449074990 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f514417d530 0x7f514418a6a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f513c00c750 tx=0x7f513c00cc10 comp rx=0 tx=0).stop 2024-02-21T23:01:50.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.904+0000 7f5148c00640 1 -- 172.21.15.99:0/2449074990 shutdown_connections 2024-02-21T23:01:50.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.904+0000 7f5148c00640 1 --2- 172.21.15.99:0/2449074990 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f512409edf0 0x7f51240a12b0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:50.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.904+0000 7f5148c00640 1 --2- 172.21.15.99:0/2449074990 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f514417d530 0x7f514418a6a0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:50.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.904+0000 7f5148c00640 1 --2- 172.21.15.99:0/2449074990 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f51440cb4f0 0x7f514421fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:50.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.904+0000 7f5148c00640 1 --2- 172.21.15.99:0/2449074990 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51440704b0 0x7f514417c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:50.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.904+0000 7f5148c00640 1 -- 172.21.15.99:0/2449074990 >> 172.21.15.99:0/2449074990 conn(0x7f51440f7300 msgr2=0x7f51440f76e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:50.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.904+0000 7f5148c00640 1 -- 172.21.15.99:0/2449074990 shutdown_connections 2024-02-21T23:01:50.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:50.904+0000 7f5148c00640 1 -- 172.21.15.99:0/2449074990 wait complete. 2024-02-21T23:01:52.124 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 14, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-02-21T23:01:02.656130+0000', 'modified': '2024-02-21T23:01:33.387960+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 4355, 'mds_1': 4352, 'mds_2': 4348}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4331': {'gid': 4331, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.181:6838/3728901330', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6835', 'nonce': 3728901330}, {'type': 'v1', 'addr': '172.21.15.181:6838', 'nonce': 3728901330}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_4339': {'gid': 4339, 'name': 'i', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.181:6839/3357929641', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.181:6837', 'nonce': 3357929641}, {'type': 'v1', 'addr': '172.21.15.181:6839', 'nonce': 3357929641}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_4343': {'gid': 4343, 'name': 'g', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.99:6833/2793485078', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.99:6832', 'nonce': 2793485078}, {'type': 'v1', 'addr': '172.21.15.99:6833', 'nonce': 2793485078}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_4348': {'gid': 4348, 'name': 'd', 'rank': 2, 'incarnation': 12, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.99:6835/2243461688', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.99:6834', 'nonce': 2243461688}, {'type': 'v1', 'addr': '172.21.15.99:6835', 'nonce': 2243461688}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_4352': {'gid': 4352, 'name': 'a', 'rank': 1, 'incarnation': 10, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.99:6837/1676159950', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.99:6836', 'nonce': 1676159950}, {'type': 'v1', 'addr': '172.21.15.99:6837', 'nonce': 1676159950}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_4355': {'gid': 4355, 'name': 'j', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.99:6839/4239008786', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.99:6838', 'nonce': 4239008786}, {'type': 'v1', 'addr': '172.21.15.99:6839', 'nonce': 4239008786}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-02-21T23:01:52.124 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-02-21T23:01:52.124 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-02-21T23:01:52.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.346+0000 7f0314c00640 1 Processor -- start 2024-02-21T23:01:52.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.346+0000 7f0314c00640 1 -- start start 2024-02-21T23:01:52.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.348+0000 7f0314c00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f0310186b90 0x7f0310186f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:52.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.348+0000 7f0314c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f031018ab00 0x7f0310184a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:52.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.348+0000 7f0314c00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f031017d980 con 0x7f03101874b0 2024-02-21T23:01:52.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.348+0000 7f0314c00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0310185950 con 0x7f0310186b90 2024-02-21T23:01:52.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.348+0000 7f0314c00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0310185c30 con 0x7f031018ab00 2024-02-21T23:01:52.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.348+0000 7f030de00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f0310186b90 0x7f0310186f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:52.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.348+0000 7f030de00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f0310186b90 0x7f0310186f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54448/0 (socket says 172.21.15.99:54448) 2024-02-21T23:01:52.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.348+0000 7f030de00640 1 -- 172.21.15.99:0/1856028896 learned_addr learned my addr 172.21.15.99:0/1856028896 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:52.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.348+0000 7f030e800640 1 --2- 172.21.15.99:0/1856028896 >> v2:172.21.15.162:3300/0 conn(0x7f031018ab00 0x7f0310184a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:52.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.349+0000 7f030de00640 1 -- 172.21.15.99:0/1856028896 >> v2:172.21.15.162:3300/0 conn(0x7f031018ab00 msgr2=0x7f0310184a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:52.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.349+0000 7f030de00640 1 --2- 172.21.15.99:0/1856028896 >> v2:172.21.15.162:3300/0 conn(0x7f031018ab00 0x7f0310184a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:52.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.349+0000 7f030de00640 1 -- 172.21.15.99:0/1856028896 >> v1:172.21.15.99:6789/0 conn(0x7f03101874b0 legacy=0x7f031018a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:52.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.349+0000 7f030de00640 1 -- 172.21.15.99:0/1856028896 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0310185f10 con 0x7f0310186b90 2024-02-21T23:01:52.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.350+0000 7f030de00640 1 --2- 172.21.15.99:0/1856028896 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0310186b90 0x7f0310186f70 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f03100f4700 tx=0x7f030002bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9526b07fe9b77b8 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:52.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.350+0000 7f030d400640 1 -- 172.21.15.99:0/1856028896 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f030002cb10 con 0x7f0310186b90 2024-02-21T23:01:52.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.350+0000 7f030d400640 1 -- 172.21.15.99:0/1856028896 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f030002ccb0 con 0x7f0310186b90 2024-02-21T23:01:52.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.350+0000 7f030d400640 1 -- 172.21.15.99:0/1856028896 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f030002ce60 con 0x7f0310186b90 2024-02-21T23:01:52.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.351+0000 7f0314c00640 1 -- 172.21.15.99:0/1856028896 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0310186b90 msgr2=0x7f0310186f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:52.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.351+0000 7f0314c00640 1 --2- 172.21.15.99:0/1856028896 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0310186b90 0x7f0310186f70 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f03100f4700 tx=0x7f030002bf70 comp rx=0 tx=0).stop 2024-02-21T23:01:52.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.351+0000 7f0314c00640 1 -- 172.21.15.99:0/1856028896 shutdown_connections 2024-02-21T23:01:52.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.351+0000 7f0314c00640 1 --2- 172.21.15.99:0/1856028896 >> v2:172.21.15.162:3300/0 conn(0x7f031018ab00 0x7f0310184a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:52.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.351+0000 7f0314c00640 1 --2- 172.21.15.99:0/1856028896 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0310186b90 0x7f0310186f70 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:52.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.351+0000 7f0314c00640 1 -- 172.21.15.99:0/1856028896 >> 172.21.15.99:0/1856028896 conn(0x7f03100ce5f0 msgr2=0x7f03100cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:52.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.351+0000 7f0314c00640 1 -- 172.21.15.99:0/1856028896 shutdown_connections 2024-02-21T23:01:52.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.351+0000 7f0314c00640 1 -- 172.21.15.99:0/1856028896 wait complete. 2024-02-21T23:01:52.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.354+0000 7f0314c00640 1 Processor -- start 2024-02-21T23:01:52.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.354+0000 7f0314c00640 1 -- start start 2024-02-21T23:01:52.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.355+0000 7f0314c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0310186b90 0x7f0310167270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:52.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.355+0000 7f0314c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03101874b0 0x7f03101677b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:52.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.355+0000 7f0314c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f031018ab00 0x7f0310170aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:52.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.355+0000 7f0314c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03101867b0 con 0x7f031018ab00 2024-02-21T23:01:52.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.355+0000 7f0314c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03101864d0 con 0x7f03101874b0 2024-02-21T23:01:52.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.355+0000 7f0314c00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03100cbf20 con 0x7f0310186b90 2024-02-21T23:01:52.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.356+0000 7f030e800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f031018ab00 0x7f0310170aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:52.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.356+0000 7f030e800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f031018ab00 0x7f0310170aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54464/0 (socket says 172.21.15.99:54464) 2024-02-21T23:01:52.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.356+0000 7f030e800640 1 -- 172.21.15.99:0/3647620924 learned_addr learned my addr 172.21.15.99:0/3647620924 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:52.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.356+0000 7f030de00640 1 --2- 172.21.15.99:0/3647620924 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0310186b90 0x7f0310167270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:52.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.356+0000 7f0305400640 1 --2- 172.21.15.99:0/3647620924 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03101874b0 0x7f03101677b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:52.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.356+0000 7f030e800640 1 -- 172.21.15.99:0/3647620924 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0310186b90 msgr2=0x7f0310167270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:52.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.356+0000 7f030e800640 1 --2- 172.21.15.99:0/3647620924 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0310186b90 0x7f0310167270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:52.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.356+0000 7f030e800640 1 -- 172.21.15.99:0/3647620924 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03101874b0 msgr2=0x7f03101677b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:52.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.356+0000 7f030e800640 1 --2- 172.21.15.99:0/3647620924 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03101874b0 0x7f03101677b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:52.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.356+0000 7f030e800640 1 -- 172.21.15.99:0/3647620924 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0310171870 con 0x7f031018ab00 2024-02-21T23:01:52.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.357+0000 7f030e800640 1 --2- 172.21.15.99:0/3647620924 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f031018ab00 0x7f0310170aa0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f030800e960 tx=0x7f030800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:52.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.357+0000 7f0306a00640 1 -- 172.21.15.99:0/3647620924 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0308017070 con 0x7f031018ab00 2024-02-21T23:01:52.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.357+0000 7f0306a00640 1 -- 172.21.15.99:0/3647620924 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f030800c980 con 0x7f031018ab00 2024-02-21T23:01:52.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.357+0000 7f0314c00640 1 -- 172.21.15.99:0/3647620924 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03101664b0 con 0x7f031018ab00 2024-02-21T23:01:52.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.357+0000 7f0306a00640 1 -- 172.21.15.99:0/3647620924 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f030800cd70 con 0x7f031018ab00 2024-02-21T23:01:52.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.357+0000 7f0314c00640 1 -- 172.21.15.99:0/3647620924 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0310166a70 con 0x7f031018ab00 2024-02-21T23:01:52.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.361+0000 7f0317b66740 1 Processor -- start 2024-02-21T23:01:52.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.362+0000 7f0306a00640 1 -- 172.21.15.99:0/3647620924 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 6) v1 ==== 134407+0+0 (secure 0 0 0) 0x7f030801a070 con 0x7f031018ab00 2024-02-21T23:01:52.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.362+0000 7f0317b66740 1 -- start start 2024-02-21T23:01:52.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.363+0000 7f0317b66740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5557bb915850 0x5557bb915c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:52.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.363+0000 7f0317b66740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5557bb916170 0x5557bb9509e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:52.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.363+0000 7f0317b66740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5557bb950f20 0x5557bb951cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:52.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.363+0000 7f0317b66740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557bb83e470 con 0x5557bb915850 2024-02-21T23:01:52.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.363+0000 7f0317b66740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557bb7e7af0 con 0x5557bb916170 2024-02-21T23:01:52.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.363+0000 7f0317b66740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557bb83a510 con 0x5557bb950f20 2024-02-21T23:01:52.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.364+0000 7f0305400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5557bb915850 0x5557bb915c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:52.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.364+0000 7f0305400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5557bb915850 0x5557bb915c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54476/0 (socket says 172.21.15.99:54476) 2024-02-21T23:01:52.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.364+0000 7f0305400640 1 -- 172.21.15.99:0/4268214613 learned_addr learned my addr 172.21.15.99:0/4268214613 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:52.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.364+0000 7f030de00640 1 --2- 172.21.15.99:0/4268214613 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5557bb916170 0x5557bb9509e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:52.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.364+0000 7f0305400640 1 --2- 172.21.15.99:0/4268214613 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5557bb950f20 0x5557bb951cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:52.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.364+0000 7f0305400640 1 -- 172.21.15.99:0/4268214613 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5557bb950f20 msgr2=0x5557bb951cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:52.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.364+0000 7f0305400640 1 --2- 172.21.15.99:0/4268214613 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5557bb950f20 0x5557bb951cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:52.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.364+0000 7f0305400640 1 -- 172.21.15.99:0/4268214613 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5557bb916170 msgr2=0x5557bb9509e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:52.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.364+0000 7f0305400640 1 --2- 172.21.15.99:0/4268214613 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5557bb916170 0x5557bb9509e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:52.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.364+0000 7f0305400640 1 -- 172.21.15.99:0/4268214613 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5557bb7eed90 con 0x5557bb915850 2024-02-21T23:01:52.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.364+0000 7f0306a00640 1 --2- 172.21.15.99:0/3647620924 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f02ec09ee20 0x7f02ec0a12e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:52.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.364+0000 7f0306a00640 1 -- 172.21.15.99:0/3647620924 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f03080c9db0 con 0x7f031018ab00 2024-02-21T23:01:52.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.365+0000 7f0305400640 1 --2- 172.21.15.99:0/4268214613 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5557bb915850 0x5557bb915c30 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f02f8001b70 tx=0x7f02f8007e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bddd404899dcc00c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:52.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.365+0000 7f0305400640 1 --2- 172.21.15.99:0/3647620924 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f02ec09ee20 0x7f02ec0a12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:52.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.365+0000 7f02fe600640 1 -- 172.21.15.99:0/4268214613 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f801f070 con 0x5557bb915850 2024-02-21T23:01:52.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.365+0000 7f02fe600640 1 -- 172.21.15.99:0/4268214613 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02f8005110 con 0x5557bb915850 2024-02-21T23:01:52.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.365+0000 7f02fe600640 1 -- 172.21.15.99:0/4268214613 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f8007050 con 0x5557bb915850 2024-02-21T23:01:52.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.366+0000 7f0305400640 1 --2- 172.21.15.99:0/3647620924 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f02ec09ee20 0x7f02ec0a12e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f02f8005620 tx=0x7f02f800c000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:52.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.366+0000 7f0317b66740 1 -- 172.21.15.99:0/4268214613 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5557bb915850 msgr2=0x5557bb915c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:52.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.366+0000 7f0317b66740 1 --2- 172.21.15.99:0/4268214613 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5557bb915850 0x5557bb915c30 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f02f8001b70 tx=0x7f02f8007e50 comp rx=0 tx=0).stop 2024-02-21T23:01:52.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.366+0000 7f0317b66740 1 -- 172.21.15.99:0/4268214613 shutdown_connections 2024-02-21T23:01:52.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.366+0000 7f0317b66740 1 --2- 172.21.15.99:0/4268214613 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5557bb950f20 0x5557bb951cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:52.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.366+0000 7f0317b66740 1 --2- 172.21.15.99:0/4268214613 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5557bb916170 0x5557bb9509e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:52.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.366+0000 7f0317b66740 1 --2- 172.21.15.99:0/4268214613 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5557bb915850 0x5557bb915c30 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:52.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.366+0000 7f0317b66740 1 -- 172.21.15.99:0/4268214613 >> 172.21.15.99:0/4268214613 conn(0x5557bb8d7e20 msgr2=0x5557bb8d8ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:52.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.366+0000 7f0317b66740 1 -- 172.21.15.99:0/4268214613 shutdown_connections 2024-02-21T23:01:52.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.366+0000 7f0317b66740 1 -- 172.21.15.99:0/4268214613 wait complete. 2024-02-21T23:01:52.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.368+0000 7f0317b66740 1 -- start start 2024-02-21T23:01:52.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.368+0000 7f0317b66740 1 Processor -- start 2024-02-21T23:01:52.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.370+0000 7f0317b66740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5557bb916170 0x5557bb943740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:52.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.370+0000 7f0317b66740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5557bb950f20 0x5557bb90be90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:52.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.370+0000 7f0317b66740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5557bb8d4ff0 0x5557bb907300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:52.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.370+0000 7f0317b66740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557bb94f400 con 0x5557bb950f20 2024-02-21T23:01:52.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.370+0000 7f0317b66740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557bb7dd040 con 0x5557bb8d4ff0 2024-02-21T23:01:52.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.370+0000 7f0317b66740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557bb94f6e0 con 0x5557bb916170 2024-02-21T23:01:52.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.370+0000 7f0317b66740 10 client.0 _ll_register_callbacks cb 0x5557bb7fa920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:01:52.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.371+0000 7f030de00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5557bb916170 0x5557bb943740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:52.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.371+0000 7f030de00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5557bb916170 0x5557bb943740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:59212/0 (socket says 172.21.15.99:59212) 2024-02-21T23:01:52.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.371+0000 7f030de00640 1 -- 172.21.15.99:0/4121433498 learned_addr learned my addr 172.21.15.99:0/4121433498 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:52.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.371+0000 7f0305400640 1 --2- 172.21.15.99:0/4121433498 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5557bb950f20 0x5557bb90be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:52.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.371+0000 7f030e800640 1 --2- 172.21.15.99:0/4121433498 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5557bb8d4ff0 0x5557bb907300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:52.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.371+0000 7f030de00640 1 -- 172.21.15.99:0/4121433498 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5557bb8d4ff0 msgr2=0x5557bb907300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:52.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.371+0000 7f030de00640 1 --2- 172.21.15.99:0/4121433498 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5557bb8d4ff0 0x5557bb907300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:52.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.371+0000 7f030de00640 1 -- 172.21.15.99:0/4121433498 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5557bb950f20 msgr2=0x5557bb90be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:52.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.371+0000 7f030de00640 1 --2- 172.21.15.99:0/4121433498 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5557bb950f20 0x5557bb90be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:52.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.371+0000 7f030de00640 1 -- 172.21.15.99:0/4121433498 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5557bb7fcaa0 con 0x5557bb916170 2024-02-21T23:01:52.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.371+0000 7f0305400640 1 --2- 172.21.15.99:0/4121433498 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5557bb950f20 0x5557bb90be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T23:01:52.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.371+0000 7f030e800640 1 --2- 172.21.15.99:0/4121433498 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5557bb8d4ff0 0x5557bb907300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:01:52.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.371+0000 7f030de00640 1 --2- 172.21.15.99:0/4121433498 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5557bb916170 0x5557bb943740 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0300036040 tx=0x7f0300004ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=815606ab6849bea3 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:52.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.371+0000 7f02f2a00640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-02-21T23:01:52.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.372+0000 7f02f2a00640 1 -- 172.21.15.99:0/4121433498 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f030002ce60 con 0x5557bb916170 2024-02-21T23:01:52.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.372+0000 7f0317b66740 1 -- 172.21.15.99:0/4121433498 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f02f8005110 con 0x5557bb916170 2024-02-21T23:01:52.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.372+0000 7f02f2a00640 1 -- 172.21.15.99:0/4121433498 <== mon.2 v2:172.21.15.181:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f03000349b0 con 0x5557bb916170 2024-02-21T23:01:52.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.372+0000 7f02f2a00640 1 -- 172.21.15.99:0/4121433498 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0300009510 con 0x5557bb916170 2024-02-21T23:01:52.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.372+0000 7f0317b66740 10 client.4865 fetch_fsmap learned FSMap version 14 2024-02-21T23:01:52.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.372+0000 7f0317b66740 1 -- 172.21.15.99:0/4121433498 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x5557bb5532d0 con 0x5557bb916170 2024-02-21T23:01:52.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.373+0000 7f02f2a00640 1 -- 172.21.15.99:0/4121433498 <== mon.2 v2:172.21.15.181:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02f8005110 con 0x5557bb916170 2024-02-21T23:01:52.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.373+0000 7f02f2a00640 1 -- 172.21.15.99:0/4121433498 <== mon.2 v2:172.21.15.181:3300/0 5 ==== fsmap(e 14) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f0300034bb0 con 0x5557bb916170 2024-02-21T23:01:52.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.373+0000 7f0317b66740 10 client.4865 fetch_fsmap finished waiting for FSMap version 14 2024-02-21T23:01:52.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.373+0000 7f0317b66740 10 client.4865 resolve_mds: resolved name 'd' to daemon mds.d 2024-02-21T23:01:52.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.373+0000 7f0317b66740 20 client.4865 populate_metadata read hostname 'smithi099' 2024-02-21T23:01:52.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.373+0000 7f0317b66740 1 --2- 172.21.15.99:0/4121433498 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x5557bb9117a0 0x5557bb95dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:52.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.373+0000 7f0317b66740 4 client.4865 mds_command: new command op to 4348 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:01:52.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.373+0000 7f0317b66740 1 -- 172.21.15.99:0/4121433498 --> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5557bb84b9b0 con 0x5557bb9117a0 2024-02-21T23:01:52.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.374+0000 7f0305400640 1 --2- 172.21.15.99:0/4121433498 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x5557bb9117a0 0x5557bb95dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:52.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.374+0000 7f02f2a00640 10 client.4865 ms_handle_connect on v2:172.21.15.99:6834/2243461688 2024-02-21T23:01:52.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.374+0000 7f0305400640 1 --2- 172.21.15.99:0/4121433498 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x5557bb9117a0 0x5557bb95dbb0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3e40a03310a96c8b server_cookie=39518d3d4cda0a5f in_seq=0 out_seq=0 2024-02-21T23:01:52.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.376+0000 7f02f2a00640 1 -- 172.21.15.99:0/4121433498 <== mds.2 v2:172.21.15.99:6834/2243461688 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x5557bb84b9b0 con 0x5557bb9117a0 2024-02-21T23:01:52.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.376+0000 7f02f2a00640 10 client.4865 handle_command_reply: tid=0 2024-02-21T23:01:52.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.376+0000 7f0317b66740 1 client.4865 shutdown 2024-02-21T23:01:52.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.376+0000 7f0317b66740 1 -- 172.21.15.99:0/4121433498 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5557bb916170 msgr2=0x5557bb943740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:52.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.376+0000 7f0317b66740 1 --2- 172.21.15.99:0/4121433498 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5557bb916170 0x5557bb943740 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0300036040 tx=0x7f0300004ab0 comp rx=0 tx=0).stop 2024-02-21T23:01:52.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.376+0000 7f0317b66740 1 -- 172.21.15.99:0/4121433498 shutdown_connections 2024-02-21T23:01:52.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.376+0000 7f0317b66740 1 --2- 172.21.15.99:0/4121433498 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x5557bb9117a0 0x5557bb95dbb0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:52.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.376+0000 7f0317b66740 1 --2- 172.21.15.99:0/4121433498 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5557bb8d4ff0 0x5557bb907300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:52.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.376+0000 7f0317b66740 1 --2- 172.21.15.99:0/4121433498 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5557bb950f20 0x5557bb90be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:52.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.376+0000 7f0317b66740 1 --2- 172.21.15.99:0/4121433498 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5557bb916170 0x5557bb943740 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:52.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.376+0000 7f0317b66740 1 -- 172.21.15.99:0/4121433498 >> 172.21.15.99:0/4121433498 conn(0x5557bb915850 msgr2=0x5557bb94fe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:52.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.376+0000 7f02f2a00640 0 client.4865 ms_handle_reset on v2:172.21.15.99:6834/2243461688 2024-02-21T23:01:52.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.376+0000 7f0317b66740 1 -- 172.21.15.99:0/4121433498 shutdown_connections 2024-02-21T23:01:52.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.376+0000 7f0317b66740 1 -- 172.21.15.99:0/4121433498 wait complete. 2024-02-21T23:01:52.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.377+0000 7f0317b66740 20 client.4865 trim_cache size 0 max 16384 2024-02-21T23:01:52.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.410+0000 7f0317b66740 1 Processor -- start 2024-02-21T23:01:52.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.410+0000 7f0317b66740 1 -- start start 2024-02-21T23:01:52.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.411+0000 7f0317b66740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5557bb8d4ff0 0x5557bb8d6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:52.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.411+0000 7f0317b66740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5557bb916170 0x5557bb8fd680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:52.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.411+0000 7f0317b66740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5557bb950f20 0x5557bb94f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:52.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.411+0000 7f0317b66740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557bb911620 con 0x5557bb8d4ff0 2024-02-21T23:01:52.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.411+0000 7f0317b66740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557bb95d3d0 con 0x5557bb916170 2024-02-21T23:01:52.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.411+0000 7f0317b66740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557bb95da30 con 0x5557bb950f20 2024-02-21T23:01:52.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.411+0000 7f030de00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5557bb8d4ff0 0x5557bb8d6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:52.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.411+0000 7f030de00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5557bb8d4ff0 0x5557bb8d6f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54490/0 (socket says 172.21.15.99:54490) 2024-02-21T23:01:52.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.411+0000 7f030de00640 1 -- 172.21.15.99:0/154635314 learned_addr learned my addr 172.21.15.99:0/154635314 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:52.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.412+0000 7f030e800640 1 --2- 172.21.15.99:0/154635314 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5557bb950f20 0x5557bb94f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:52.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.412+0000 7f0305400640 1 --2- 172.21.15.99:0/154635314 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5557bb916170 0x5557bb8fd680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:52.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.412+0000 7f030de00640 1 -- 172.21.15.99:0/154635314 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5557bb950f20 msgr2=0x5557bb94f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:52.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.412+0000 7f030de00640 1 --2- 172.21.15.99:0/154635314 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5557bb950f20 0x5557bb94f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:52.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.412+0000 7f030de00640 1 -- 172.21.15.99:0/154635314 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5557bb916170 msgr2=0x5557bb8fd680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:52.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.412+0000 7f030de00640 1 --2- 172.21.15.99:0/154635314 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5557bb916170 0x5557bb8fd680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:52.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.412+0000 7f030de00640 1 -- 172.21.15.99:0/154635314 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5557bb61d6b0 con 0x5557bb8d4ff0 2024-02-21T23:01:52.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.412+0000 7f030de00640 1 --2- 172.21.15.99:0/154635314 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5557bb8d4ff0 0x5557bb8d6f00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f030002c540 tx=0x7f0300042070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=674e8fe01056e8f6 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:52.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.412+0000 7f02fdc00640 1 -- 172.21.15.99:0/154635314 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0300034600 con 0x5557bb8d4ff0 2024-02-21T23:01:52.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.413+0000 7f02fdc00640 1 -- 172.21.15.99:0/154635314 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03000349b0 con 0x5557bb8d4ff0 2024-02-21T23:01:52.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.413+0000 7f02fdc00640 1 -- 172.21.15.99:0/154635314 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0300003990 con 0x5557bb8d4ff0 2024-02-21T23:01:52.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.413+0000 7f0317b66740 1 -- 172.21.15.99:0/154635314 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5557bb8d4ff0 msgr2=0x5557bb8d6f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:52.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.413+0000 7f0317b66740 1 --2- 172.21.15.99:0/154635314 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5557bb8d4ff0 0x5557bb8d6f00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f030002c540 tx=0x7f0300042070 comp rx=0 tx=0).stop 2024-02-21T23:01:52.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.413+0000 7f0317b66740 1 -- 172.21.15.99:0/154635314 shutdown_connections 2024-02-21T23:01:52.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.413+0000 7f0317b66740 1 --2- 172.21.15.99:0/154635314 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5557bb950f20 0x5557bb94f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:52.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.413+0000 7f0317b66740 1 --2- 172.21.15.99:0/154635314 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5557bb916170 0x5557bb8fd680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:52.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.413+0000 7f0317b66740 1 --2- 172.21.15.99:0/154635314 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5557bb8d4ff0 0x5557bb8d6f00 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:52.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.413+0000 7f0317b66740 1 -- 172.21.15.99:0/154635314 >> 172.21.15.99:0/154635314 conn(0x5557bb915850 msgr2=0x5557bb8d9890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:52.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.413+0000 7f0317b66740 1 -- 172.21.15.99:0/154635314 shutdown_connections 2024-02-21T23:01:52.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.414+0000 7f0317b66740 1 -- 172.21.15.99:0/154635314 wait complete. 2024-02-21T23:01:52.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.415+0000 7f0317b66740 1 -- start start 2024-02-21T23:01:52.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.415+0000 7f0317b66740 1 Processor -- start 2024-02-21T23:01:52.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.417+0000 7f0317b66740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5557bb8d4ff0 0x5557bb9b6e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:52.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.417+0000 7f0317b66740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5557bb916170 0x5557bb9002f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:52.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.417+0000 7f0317b66740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5557bb950f20 0x5557bb9bcb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:52.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.417+0000 7f0317b66740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557bb962bc0 con 0x5557bb8d4ff0 2024-02-21T23:01:52.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.417+0000 7f0317b66740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557bb9626f0 con 0x5557bb950f20 2024-02-21T23:01:52.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.417+0000 7f0317b66740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557bb963220 con 0x5557bb916170 2024-02-21T23:01:52.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.417+0000 7f0317b66740 10 client.0 _ll_register_callbacks cb 0x5557bb7fa920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:01:52.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.418+0000 7f030de00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5557bb8d4ff0 0x5557bb9b6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:52.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.418+0000 7f030de00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5557bb8d4ff0 0x5557bb9b6e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54496/0 (socket says 172.21.15.99:54496) 2024-02-21T23:01:52.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.418+0000 7f030de00640 1 -- 172.21.15.99:0/1554924622 learned_addr learned my addr 172.21.15.99:0/1554924622 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:52.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.418+0000 7f030e800640 1 --2- 172.21.15.99:0/1554924622 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5557bb950f20 0x5557bb9bcb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:52.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.418+0000 7f0305400640 1 --2- 172.21.15.99:0/1554924622 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5557bb916170 0x5557bb9002f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:52.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.418+0000 7f030de00640 1 -- 172.21.15.99:0/1554924622 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5557bb916170 msgr2=0x5557bb9002f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:52.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.418+0000 7f030de00640 1 --2- 172.21.15.99:0/1554924622 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5557bb916170 0x5557bb9002f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:52.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.418+0000 7f030de00640 1 -- 172.21.15.99:0/1554924622 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5557bb950f20 msgr2=0x5557bb9bcb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:52.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.418+0000 7f030de00640 1 --2- 172.21.15.99:0/1554924622 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5557bb950f20 0x5557bb9bcb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:52.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.418+0000 7f030de00640 1 -- 172.21.15.99:0/1554924622 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5557bb903c40 con 0x5557bb8d4ff0 2024-02-21T23:01:52.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.419+0000 7f030de00640 1 --2- 172.21.15.99:0/1554924622 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5557bb8d4ff0 0x5557bb9b6e90 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0300007020 tx=0x7f0300009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17d501aee36f63af server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:52.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.419+0000 7f02f2a00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:01:52.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.419+0000 7f02f2a00640 1 -- 172.21.15.99:0/1554924622 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0300003b90 con 0x5557bb8d4ff0 2024-02-21T23:01:52.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.419+0000 7f02f2a00640 1 -- 172.21.15.99:0/1554924622 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f0300003d30 con 0x5557bb8d4ff0 2024-02-21T23:01:52.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.419+0000 7f0317b66740 1 -- 172.21.15.99:0/1554924622 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f03000349b0 con 0x5557bb8d4ff0 2024-02-21T23:01:52.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.419+0000 7f02f2a00640 1 -- 172.21.15.99:0/1554924622 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7f030006c050 con 0x5557bb8d4ff0 2024-02-21T23:01:52.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.419+0000 7f0317b66740 10 client.4815 fetch_fsmap learned FSMap version 14 2024-02-21T23:01:52.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.419+0000 7f0317b66740 1 -- 172.21.15.99:0/1554924622 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x5557bb903960 con 0x5557bb8d4ff0 2024-02-21T23:01:52.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.420+0000 7f02f2a00640 1 -- 172.21.15.99:0/1554924622 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03000349b0 con 0x5557bb8d4ff0 2024-02-21T23:01:52.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.420+0000 7f02f2a00640 1 -- 172.21.15.99:0/1554924622 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 14) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f0300063070 con 0x5557bb8d4ff0 2024-02-21T23:01:52.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.420+0000 7f0317b66740 10 client.4815 fetch_fsmap finished waiting for FSMap version 14 2024-02-21T23:01:52.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.420+0000 7f0317b66740 10 client.4815 resolve_mds: resolved name 'd' to daemon mds.d 2024-02-21T23:01:52.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.420+0000 7f0317b66740 20 client.4815 populate_metadata read hostname 'smithi099' 2024-02-21T23:01:52.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.420+0000 7f0317b66740 1 --2- 172.21.15.99:0/1554924622 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x5557bb9c1ed0 0x5557bb9c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:52.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.420+0000 7f0317b66740 4 client.4815 mds_command: new command op to 4348 tid=0 multi_id=0 [{"prefix": "status"}] 2024-02-21T23:01:52.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.420+0000 7f0317b66740 1 -- 172.21.15.99:0/1554924622 --> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5557bb845d00 con 0x5557bb9c1ed0 2024-02-21T23:01:52.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.420+0000 7f0305400640 1 --2- 172.21.15.99:0/1554924622 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x5557bb9c1ed0 0x5557bb9c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:52.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.421+0000 7f0305400640 1 --2- 172.21.15.99:0/1554924622 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x5557bb9c1ed0 0x5557bb9c42c0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7a689657e72c433e server_cookie=f403a1e0e4e6ba79 in_seq=0 out_seq=0 2024-02-21T23:01:52.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.421+0000 7f02f2a00640 10 client.4815 ms_handle_connect on v2:172.21.15.99:6834/2243461688 2024-02-21T23:01:52.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.421+0000 7f02f2a00640 1 -- 172.21.15.99:0/1554924622 <== mds.2 v2:172.21.15.99:6834/2243461688 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x5557bb845d00 con 0x5557bb9c1ed0 2024-02-21T23:01:52.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.421+0000 7f02f2a00640 10 client.4815 handle_command_reply: tid=0 2024-02-21T23:01:52.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.421+0000 7f0317b66740 1 client.4815 shutdown 2024-02-21T23:01:52.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.422+0000 7f0317b66740 1 -- 172.21.15.99:0/1554924622 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5557bb8d4ff0 msgr2=0x5557bb9b6e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:52.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.422+0000 7f0317b66740 1 --2- 172.21.15.99:0/1554924622 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5557bb8d4ff0 0x5557bb9b6e90 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0300007020 tx=0x7f0300009810 comp rx=0 tx=0).stop 2024-02-21T23:01:52.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.422+0000 7f0317b66740 1 -- 172.21.15.99:0/1554924622 shutdown_connections 2024-02-21T23:01:52.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.422+0000 7f0317b66740 1 --2- 172.21.15.99:0/1554924622 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x5557bb9c1ed0 0x5557bb9c42c0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:52.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.422+0000 7f0317b66740 1 --2- 172.21.15.99:0/1554924622 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5557bb950f20 0x5557bb9bcb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:52.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.422+0000 7f0317b66740 1 --2- 172.21.15.99:0/1554924622 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5557bb916170 0x5557bb9002f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:52.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.422+0000 7f0317b66740 1 --2- 172.21.15.99:0/1554924622 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5557bb8d4ff0 0x5557bb9b6e90 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:52.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.422+0000 7f0317b66740 1 -- 172.21.15.99:0/1554924622 >> 172.21.15.99:0/1554924622 conn(0x5557bb915850 msgr2=0x5557bb961e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:52.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.422+0000 7f02f2a00640 0 client.4815 ms_handle_reset on v2:172.21.15.99:6834/2243461688 2024-02-21T23:01:52.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.422+0000 7f0317b66740 1 -- 172.21.15.99:0/1554924622 shutdown_connections 2024-02-21T23:01:52.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.422+0000 7f0317b66740 1 -- 172.21.15.99:0/1554924622 wait complete. 2024-02-21T23:01:52.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.422+0000 7f0317b66740 20 client.4815 trim_cache size 0 max 16384 2024-02-21T23:01:52.418 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-02-21T23:01:52.418 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_fsid": "e8af98cd-45a1-425f-96a7-f24da8ee4efb", 2024-02-21T23:01:52.418 INFO:teuthology.orchestra.run.smithi099.stdout: "whoami": 2, 2024-02-21T23:01:52.419 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 4348, 2024-02-21T23:01:52.419 INFO:teuthology.orchestra.run.smithi099.stdout: "want_state": "up:active", 2024-02-21T23:01:52.419 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "up:active", 2024-02-21T23:01:52.419 INFO:teuthology.orchestra.run.smithi099.stdout: "fs_name": "cephfs", 2024-02-21T23:01:52.419 INFO:teuthology.orchestra.run.smithi099.stdout: "rank_uptime": 20.039192221, 2024-02-21T23:01:52.419 INFO:teuthology.orchestra.run.smithi099.stdout: "mdsmap_epoch": 14, 2024-02-21T23:01:52.419 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_epoch": 31, 2024-02-21T23:01:52.419 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_epoch_barrier": 29, 2024-02-21T23:01:52.419 INFO:teuthology.orchestra.run.smithi099.stdout: "uptime": 54.290035037000003 2024-02-21T23:01:52.419 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-02-21T23:01:52.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.423+0000 7f0314c00640 1 -- 172.21.15.99:0/3647620924 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f02ec09ee20 msgr2=0x7f02ec0a12e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:52.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.423+0000 7f0314c00640 1 --2- 172.21.15.99:0/3647620924 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f02ec09ee20 0x7f02ec0a12e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f02f8005620 tx=0x7f02f800c000 comp rx=0 tx=0).stop 2024-02-21T23:01:52.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.423+0000 7f0314c00640 1 -- 172.21.15.99:0/3647620924 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f031018ab00 msgr2=0x7f0310170aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:52.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.423+0000 7f0314c00640 1 --2- 172.21.15.99:0/3647620924 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f031018ab00 0x7f0310170aa0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f030800e960 tx=0x7f030800ee20 comp rx=0 tx=0).stop 2024-02-21T23:01:52.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.423+0000 7f0314c00640 1 -- 172.21.15.99:0/3647620924 shutdown_connections 2024-02-21T23:01:52.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.423+0000 7f0314c00640 1 --2- 172.21.15.99:0/3647620924 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f02ec09ee20 0x7f02ec0a12e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:52.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.423+0000 7f0314c00640 1 --2- 172.21.15.99:0/3647620924 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f031018ab00 0x7f0310170aa0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:52.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.423+0000 7f0314c00640 1 --2- 172.21.15.99:0/3647620924 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03101874b0 0x7f03101677b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:52.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.423+0000 7f0314c00640 1 --2- 172.21.15.99:0/3647620924 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0310186b90 0x7f0310167270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:52.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.423+0000 7f0314c00640 1 -- 172.21.15.99:0/3647620924 >> 172.21.15.99:0/3647620924 conn(0x7f03100ce5f0 msgr2=0x7f03101694c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:52.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.424+0000 7f0314c00640 1 -- 172.21.15.99:0/3647620924 shutdown_connections 2024-02-21T23:01:52.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.424+0000 7f0314c00640 1 -- 172.21.15.99:0/3647620924 wait complete. 2024-02-21T23:01:52.439 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-02-21T23:01:52.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.658+0000 7f0a67200640 1 Processor -- start 2024-02-21T23:01:52.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.659+0000 7f0a67200640 1 -- start start 2024-02-21T23:01:52.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.660+0000 7f0a67200640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f0a6818a010 0x7f0a6818b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:52.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.660+0000 7f0a67200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f0a680719b0 0x7f0a68071e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:52.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.660+0000 7f0a67200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a6818a600 con 0x7f0a68182a80 2024-02-21T23:01:52.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.660+0000 7f0a67200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a6818bec0 con 0x7f0a680719b0 2024-02-21T23:01:52.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.660+0000 7f0a67200640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a6818a8e0 con 0x7f0a6818a010 2024-02-21T23:01:52.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.661+0000 7f0a65e00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f0a68182a80 0x7f0a68186a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:57426/0 (socket says 172.21.15.99:57426) 2024-02-21T23:01:52.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.661+0000 7f0a65e00640 1 -- 172.21.15.99:0/1295658882 learned_addr learned my addr 172.21.15.99:0/1295658882 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:01:52.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.661+0000 7f0a65400640 1 --2- 172.21.15.99:0/1295658882 >> v2:172.21.15.181:3300/0 conn(0x7f0a6818a010 0x7f0a6818b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:52.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.661+0000 7f0a66800640 1 --2- 172.21.15.99:0/1295658882 >> v2:172.21.15.162:3300/0 conn(0x7f0a680719b0 0x7f0a68071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:52.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.661+0000 7f0a65400640 1 -- 172.21.15.99:0/1295658882 >> v2:172.21.15.162:3300/0 conn(0x7f0a680719b0 msgr2=0x7f0a68071e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:52.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.661+0000 7f0a65400640 1 --2- 172.21.15.99:0/1295658882 >> v2:172.21.15.162:3300/0 conn(0x7f0a680719b0 0x7f0a68071e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:52.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.661+0000 7f0a65400640 1 -- 172.21.15.99:0/1295658882 >> v1:172.21.15.99:6789/0 conn(0x7f0a68182a80 legacy=0x7f0a68186a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:52.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.661+0000 7f0a64a00640 1 -- 172.21.15.99:0/1295658882 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4266898247 0 0) 0x7f0a6818a600 con 0x7f0a68182a80 2024-02-21T23:01:52.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.661+0000 7f0a65400640 1 -- 172.21.15.99:0/1295658882 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a6818abc0 con 0x7f0a6818a010 2024-02-21T23:01:52.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.663+0000 7f0a65400640 1 --2- 172.21.15.99:0/1295658882 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0a6818a010 0x7f0a6818b980 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0a6815afe0 tx=0x7f0a5402b7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=385907485876f18e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:52.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.663+0000 7f0a64a00640 1 -- 172.21.15.99:0/1295658882 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a54038070 con 0x7f0a6818a010 2024-02-21T23:01:52.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.663+0000 7f0a64a00640 1 -- 172.21.15.99:0/1295658882 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a54031700 con 0x7f0a6818a010 2024-02-21T23:01:52.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.663+0000 7f0a64a00640 1 -- 172.21.15.99:0/1295658882 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a54031ad0 con 0x7f0a6818a010 2024-02-21T23:01:52.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.663+0000 7f0a67200640 1 -- 172.21.15.99:0/1295658882 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0a6818a010 msgr2=0x7f0a6818b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:52.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.663+0000 7f0a67200640 1 --2- 172.21.15.99:0/1295658882 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0a6818a010 0x7f0a6818b980 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0a6815afe0 tx=0x7f0a5402b7a0 comp rx=0 tx=0).stop 2024-02-21T23:01:52.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.663+0000 7f0a67200640 1 -- 172.21.15.99:0/1295658882 shutdown_connections 2024-02-21T23:01:52.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.663+0000 7f0a67200640 1 --2- 172.21.15.99:0/1295658882 >> v2:172.21.15.162:3300/0 conn(0x7f0a680719b0 0x7f0a68071e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:52.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.663+0000 7f0a67200640 1 --2- 172.21.15.99:0/1295658882 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0a6818a010 0x7f0a6818b980 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:52.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.663+0000 7f0a67200640 1 -- 172.21.15.99:0/1295658882 >> 172.21.15.99:0/1295658882 conn(0x7f0a680d29f0 msgr2=0x7f0a680d2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:52.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.664+0000 7f0a67200640 1 -- 172.21.15.99:0/1295658882 shutdown_connections 2024-02-21T23:01:52.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.664+0000 7f0a67200640 1 -- 172.21.15.99:0/1295658882 wait complete. 2024-02-21T23:01:52.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.667+0000 7f0a67200640 1 Processor -- start 2024-02-21T23:01:52.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.667+0000 7f0a67200640 1 -- start start 2024-02-21T23:01:52.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.669+0000 7f0a67200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a680719b0 0x7f0a68214b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:52.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.669+0000 7f0a67200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a68182a80 0x7f0a68179480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:52.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.669+0000 7f0a67200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0a6818a010 0x7f0a6821d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:52.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.669+0000 7f0a67200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6818b460 con 0x7f0a68182a80 2024-02-21T23:01:52.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.669+0000 7f0a67200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6818b180 con 0x7f0a680719b0 2024-02-21T23:01:52.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.669+0000 7f0a67200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a68182e60 con 0x7f0a6818a010 2024-02-21T23:01:52.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.669+0000 7f0a65e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a680719b0 0x7f0a68214b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:52.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.669+0000 7f0a65400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a68182a80 0x7f0a68179480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:52.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.669+0000 7f0a65e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a680719b0 0x7f0a68214b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:34642/0 (socket says 172.21.15.99:34642) 2024-02-21T23:01:52.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.669+0000 7f0a65400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a68182a80 0x7f0a68179480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54498/0 (socket says 172.21.15.99:54498) 2024-02-21T23:01:52.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.669+0000 7f0a65e00640 1 -- 172.21.15.99:0/3421753285 learned_addr learned my addr 172.21.15.99:0/3421753285 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:52.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.670+0000 7f0a66800640 1 --2- 172.21.15.99:0/3421753285 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0a6818a010 0x7f0a6821d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:52.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.670+0000 7f0a65e00640 1 -- 172.21.15.99:0/3421753285 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0a6818a010 msgr2=0x7f0a6821d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:52.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.670+0000 7f0a65e00640 1 --2- 172.21.15.99:0/3421753285 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0a6818a010 0x7f0a6821d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:52.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.670+0000 7f0a65e00640 1 -- 172.21.15.99:0/3421753285 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a68182a80 msgr2=0x7f0a68179480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:52.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.670+0000 7f0a65e00640 1 --2- 172.21.15.99:0/3421753285 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a68182a80 0x7f0a68179480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:52.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.670+0000 7f0a65e00640 1 -- 172.21.15.99:0/3421753285 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a68215fd0 con 0x7f0a680719b0 2024-02-21T23:01:52.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.670+0000 7f0a65400640 1 --2- 172.21.15.99:0/3421753285 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a68182a80 0x7f0a68179480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:01:52.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.670+0000 7f0a66800640 1 --2- 172.21.15.99:0/3421753285 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0a6818a010 0x7f0a6821d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T23:01:52.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.671+0000 7f0a65e00640 1 --2- 172.21.15.99:0/3421753285 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a680719b0 0x7f0a68214b10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0a5800c3f0 tx=0x7f0a5800c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:52.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.671+0000 7f0a5e000640 1 -- 172.21.15.99:0/3421753285 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a580074e0 con 0x7f0a680719b0 2024-02-21T23:01:52.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.671+0000 7f0a5e000640 1 -- 172.21.15.99:0/3421753285 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a580047e0 con 0x7f0a680719b0 2024-02-21T23:01:52.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.671+0000 7f0a5e000640 1 -- 172.21.15.99:0/3421753285 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a58004c10 con 0x7f0a680719b0 2024-02-21T23:01:52.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.671+0000 7f0a67200640 1 -- 172.21.15.99:0/3421753285 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a68215170 con 0x7f0a680719b0 2024-02-21T23:01:52.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.671+0000 7f0a67200640 1 -- 172.21.15.99:0/3421753285 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a68215730 con 0x7f0a680719b0 2024-02-21T23:01:52.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.674+0000 7f0a5e000640 1 -- 172.21.15.99:0/3421753285 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 6) v1 ==== 134407+0+0 (secure 0 0 0) 0x7f0a58011070 con 0x7f0a680719b0 2024-02-21T23:01:52.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.676+0000 7f0a5e000640 1 --2- 172.21.15.99:0/3421753285 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f0a4809edf0 0x7f0a480a12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:52.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.676+0000 7f0a5e000640 1 -- 172.21.15.99:0/3421753285 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f0a580c97c0 con 0x7f0a680719b0 2024-02-21T23:01:52.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.676+0000 7f0a65400640 1 --2- 172.21.15.99:0/3421753285 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f0a4809edf0 0x7f0a480a12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:52.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.677+0000 7f0a6fa6a740 1 Processor -- start 2024-02-21T23:01:52.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.677+0000 7f0a65400640 1 --2- 172.21.15.99:0/3421753285 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f0a4809edf0 0x7f0a480a12b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0a54035000 tx=0x7f0a54008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:52.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.677+0000 7f0a6fa6a740 1 -- start start 2024-02-21T23:01:52.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.679+0000 7f0a6fa6a740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c5f5ea5a30 0x55c5f5ea5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:52.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.679+0000 7f0a6fa6a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c5f5ea6350 0x55c5f5ee0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:52.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.679+0000 7f0a6fa6a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c5f5ee1100 0x55c5f5ee1e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:52.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.679+0000 7f0a6fa6a740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5f5dce470 con 0x55c5f5ea5a30 2024-02-21T23:01:52.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.679+0000 7f0a6fa6a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5f5d77af0 con 0x55c5f5ea6350 2024-02-21T23:01:52.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.679+0000 7f0a6fa6a740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5f5dca510 con 0x55c5f5ee1100 2024-02-21T23:01:52.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.680+0000 7f0a65e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c5f5ea5a30 0x55c5f5ea5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:52.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.680+0000 7f0a65400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c5f5ea6350 0x55c5f5ee0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:52.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.680+0000 7f0a65e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c5f5ea5a30 0x55c5f5ea5e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54504/0 (socket says 172.21.15.99:54504) 2024-02-21T23:01:52.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.680+0000 7f0a65e00640 1 -- 172.21.15.99:0/2844526132 learned_addr learned my addr 172.21.15.99:0/2844526132 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:52.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.680+0000 7f0a66800640 1 --2- 172.21.15.99:0/2844526132 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c5f5ee1100 0x55c5f5ee1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:52.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.680+0000 7f0a65400640 1 -- 172.21.15.99:0/2844526132 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c5f5ee1100 msgr2=0x55c5f5ee1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:52.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.680+0000 7f0a65400640 1 --2- 172.21.15.99:0/2844526132 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c5f5ee1100 0x55c5f5ee1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:52.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.680+0000 7f0a65400640 1 -- 172.21.15.99:0/2844526132 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c5f5ea5a30 msgr2=0x55c5f5ea5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:52.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.680+0000 7f0a65400640 1 --2- 172.21.15.99:0/2844526132 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c5f5ea5a30 0x55c5f5ea5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:52.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.680+0000 7f0a65400640 1 -- 172.21.15.99:0/2844526132 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c5f5d7ed90 con 0x55c5f5ea6350 2024-02-21T23:01:52.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.681+0000 7f0a65400640 1 --2- 172.21.15.99:0/2844526132 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c5f5ea6350 0x55c5f5ee0bc0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0a6818aa60 tx=0x7f0a54030000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99aec56f5b8f89ea server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:52.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.681+0000 7f0a52600640 1 -- 172.21.15.99:0/2844526132 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5404d030 con 0x55c5f5ea6350 2024-02-21T23:01:52.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.681+0000 7f0a52600640 1 -- 172.21.15.99:0/2844526132 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a5403da20 con 0x55c5f5ea6350 2024-02-21T23:01:52.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.681+0000 7f0a52600640 1 -- 172.21.15.99:0/2844526132 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a54038040 con 0x55c5f5ea6350 2024-02-21T23:01:52.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.681+0000 7f0a6fa6a740 1 -- 172.21.15.99:0/2844526132 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c5f5ea6350 msgr2=0x55c5f5ee0bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:52.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.681+0000 7f0a6fa6a740 1 --2- 172.21.15.99:0/2844526132 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c5f5ea6350 0x55c5f5ee0bc0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0a6818aa60 tx=0x7f0a54030000 comp rx=0 tx=0).stop 2024-02-21T23:01:52.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.682+0000 7f0a6fa6a740 1 -- 172.21.15.99:0/2844526132 shutdown_connections 2024-02-21T23:01:52.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.682+0000 7f0a6fa6a740 1 --2- 172.21.15.99:0/2844526132 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c5f5ee1100 0x55c5f5ee1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:52.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.682+0000 7f0a6fa6a740 1 --2- 172.21.15.99:0/2844526132 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c5f5ea6350 0x55c5f5ee0bc0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:52.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.682+0000 7f0a6fa6a740 1 --2- 172.21.15.99:0/2844526132 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c5f5ea5a30 0x55c5f5ea5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:52.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.682+0000 7f0a6fa6a740 1 -- 172.21.15.99:0/2844526132 >> 172.21.15.99:0/2844526132 conn(0x55c5f5e68000 msgr2=0x55c5f5e69080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:52.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.682+0000 7f0a6fa6a740 1 -- 172.21.15.99:0/2844526132 shutdown_connections 2024-02-21T23:01:52.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.682+0000 7f0a6fa6a740 1 -- 172.21.15.99:0/2844526132 wait complete. 2024-02-21T23:01:52.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.683+0000 7f0a6fa6a740 1 -- start start 2024-02-21T23:01:52.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.683+0000 7f0a6fa6a740 1 Processor -- start 2024-02-21T23:01:52.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.684+0000 7f0a6fa6a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c5f5ea6350 0x55c5f5e97200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:52.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.684+0000 7f0a6fa6a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c5f5ee1100 0x55c5f5e664f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:52.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.684+0000 7f0a6fa6a740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c5f5eaa2a0 0x55c5f5e9a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:52.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.684+0000 7f0a6fa6a740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5f5edf5e0 con 0x55c5f5eaa2a0 2024-02-21T23:01:52.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.684+0000 7f0a6fa6a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5f5d6d040 con 0x55c5f5ee1100 2024-02-21T23:01:52.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.684+0000 7f0a6fa6a740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5f5edf8c0 con 0x55c5f5ea6350 2024-02-21T23:01:52.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.684+0000 7f0a6fa6a740 10 client.0 _ll_register_callbacks cb 0x55c5f5d8a920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:01:52.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.684+0000 7f0a65400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c5f5ee1100 0x55c5f5e664f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:52.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.684+0000 7f0a65e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c5f5ea6350 0x55c5f5e97200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:52.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.684+0000 7f0a65400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c5f5ee1100 0x55c5f5e664f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:34648/0 (socket says 172.21.15.99:34648) 2024-02-21T23:01:52.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.684+0000 7f0a65400640 1 -- 172.21.15.99:0/4093100392 learned_addr learned my addr 172.21.15.99:0/4093100392 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:52.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.684+0000 7f0a66800640 1 --2- 172.21.15.99:0/4093100392 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c5f5eaa2a0 0x55c5f5e9a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:52.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.685+0000 7f0a65400640 1 -- 172.21.15.99:0/4093100392 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c5f5ea6350 msgr2=0x55c5f5e97200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:52.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.685+0000 7f0a65400640 1 --2- 172.21.15.99:0/4093100392 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c5f5ea6350 0x55c5f5e97200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:52.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.685+0000 7f0a65400640 1 -- 172.21.15.99:0/4093100392 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c5f5eaa2a0 msgr2=0x55c5f5e9a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:52.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.685+0000 7f0a65400640 1 --2- 172.21.15.99:0/4093100392 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c5f5eaa2a0 0x55c5f5e9a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:52.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.685+0000 7f0a65400640 1 -- 172.21.15.99:0/4093100392 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c5f5d8caa0 con 0x55c5f5ee1100 2024-02-21T23:01:52.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.685+0000 7f0a65e00640 1 --2- 172.21.15.99:0/4093100392 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c5f5ea6350 0x55c5f5e97200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:01:52.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.685+0000 7f0a65400640 1 --2- 172.21.15.99:0/4093100392 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c5f5ee1100 0x55c5f5e664f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0a54009880 tx=0x7f0a54004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb06a5e2f6d1e9a6 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:52.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.685+0000 7f0a46a00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-02-21T23:01:52.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.686+0000 7f0a46a00640 1 -- 172.21.15.99:0/4093100392 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a54004030 con 0x55c5f5ee1100 2024-02-21T23:01:52.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.686+0000 7f0a6fa6a740 1 -- 172.21.15.99:0/4093100392 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0a5403da20 con 0x55c5f5ee1100 2024-02-21T23:01:52.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.686+0000 7f0a46a00640 1 -- 172.21.15.99:0/4093100392 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f0a540041d0 con 0x55c5f5ee1100 2024-02-21T23:01:52.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.686+0000 7f0a46a00640 1 -- 172.21.15.99:0/4093100392 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0a540043d0 con 0x55c5f5ee1100 2024-02-21T23:01:52.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.686+0000 7f0a6fa6a740 10 client.4936 fetch_fsmap learned FSMap version 14 2024-02-21T23:01:52.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.686+0000 7f0a6fa6a740 1 -- 172.21.15.99:0/4093100392 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x55c5f5ae32d0 con 0x55c5f5ee1100 2024-02-21T23:01:52.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.686+0000 7f0a46a00640 1 -- 172.21.15.99:0/4093100392 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a5403da20 con 0x55c5f5ee1100 2024-02-21T23:01:52.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.687+0000 7f0a46a00640 1 -- 172.21.15.99:0/4093100392 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 14) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f0a54062020 con 0x55c5f5ee1100 2024-02-21T23:01:52.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.687+0000 7f0a6fa6a740 10 client.4936 fetch_fsmap finished waiting for FSMap version 14 2024-02-21T23:01:52.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.687+0000 7f0a6fa6a740 10 client.4936 resolve_mds: resolved name 'a' to daemon mds.a 2024-02-21T23:01:52.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.687+0000 7f0a6fa6a740 20 client.4936 populate_metadata read hostname 'smithi099' 2024-02-21T23:01:52.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.687+0000 7f0a6fa6a740 1 --2- 172.21.15.99:0/4093100392 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x55c5f5e9aff0 0x55c5f5ef6b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:52.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.687+0000 7f0a6fa6a740 4 client.4936 mds_command: new command op to 4352 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:01:52.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.687+0000 7f0a6fa6a740 1 -- 172.21.15.99:0/4093100392 --> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c5f5ddb9b0 con 0x55c5f5e9aff0 2024-02-21T23:01:52.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.687+0000 7f0a65e00640 1 --2- 172.21.15.99:0/4093100392 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x55c5f5e9aff0 0x55c5f5ef6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:52.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.688+0000 7f0a65e00640 1 --2- 172.21.15.99:0/4093100392 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x55c5f5e9aff0 0x55c5f5ef6b60 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9f00f87ef573405a server_cookie=4c22706c217d17e9 in_seq=0 out_seq=0 2024-02-21T23:01:52.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.688+0000 7f0a46a00640 10 client.4936 ms_handle_connect on v2:172.21.15.99:6836/1676159950 2024-02-21T23:01:52.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.689+0000 7f0a46a00640 1 -- 172.21.15.99:0/4093100392 <== mds.1 v2:172.21.15.99:6836/1676159950 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55c5f5ddb9b0 con 0x55c5f5e9aff0 2024-02-21T23:01:52.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.689+0000 7f0a46a00640 10 client.4936 handle_command_reply: tid=0 2024-02-21T23:01:52.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.689+0000 7f0a6fa6a740 1 client.4936 shutdown 2024-02-21T23:01:52.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.689+0000 7f0a6fa6a740 1 -- 172.21.15.99:0/4093100392 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c5f5ee1100 msgr2=0x55c5f5e664f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:52.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.689+0000 7f0a6fa6a740 1 --2- 172.21.15.99:0/4093100392 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c5f5ee1100 0x55c5f5e664f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0a54009880 tx=0x7f0a54004730 comp rx=0 tx=0).stop 2024-02-21T23:01:52.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.690+0000 7f0a6fa6a740 1 -- 172.21.15.99:0/4093100392 shutdown_connections 2024-02-21T23:01:52.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.690+0000 7f0a6fa6a740 1 --2- 172.21.15.99:0/4093100392 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x55c5f5e9aff0 0x55c5f5ef6b60 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:52.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.690+0000 7f0a6fa6a740 1 --2- 172.21.15.99:0/4093100392 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c5f5eaa2a0 0x55c5f5e9a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:52.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.690+0000 7f0a6fa6a740 1 --2- 172.21.15.99:0/4093100392 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c5f5ee1100 0x55c5f5e664f0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:52.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.690+0000 7f0a6fa6a740 1 --2- 172.21.15.99:0/4093100392 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c5f5ea6350 0x55c5f5e97200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:52.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.690+0000 7f0a46a00640 0 client.4936 ms_handle_reset on v2:172.21.15.99:6836/1676159950 2024-02-21T23:01:52.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.690+0000 7f0a6fa6a740 1 -- 172.21.15.99:0/4093100392 >> 172.21.15.99:0/4093100392 conn(0x55c5f5ea5a30 msgr2=0x55c5f5edee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:52.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.690+0000 7f0a6fa6a740 1 -- 172.21.15.99:0/4093100392 shutdown_connections 2024-02-21T23:01:52.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.690+0000 7f0a6fa6a740 1 -- 172.21.15.99:0/4093100392 wait complete. 2024-02-21T23:01:52.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.690+0000 7f0a6fa6a740 20 client.4936 trim_cache size 0 max 16384 2024-02-21T23:01:52.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.718+0000 7f0a6fa6a740 1 Processor -- start 2024-02-21T23:01:52.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.718+0000 7f0a6fa6a740 1 -- start start 2024-02-21T23:01:52.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.720+0000 7f0a6fa6a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c5f5ea6350 0x55c5f5e69a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:52.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.720+0000 7f0a6fa6a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c5f5eaa2a0 0x55c5f5ecea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:52.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.720+0000 7f0a6fa6a740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c5f5ee1100 0x55c5f5e9ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:52.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.720+0000 7f0a6fa6a740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5f5dce470 con 0x55c5f5ee1100 2024-02-21T23:01:52.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.720+0000 7f0a6fa6a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5f5eaa810 con 0x55c5f5eaa2a0 2024-02-21T23:01:52.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.720+0000 7f0a6fa6a740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5f5e64c10 con 0x55c5f5ea6350 2024-02-21T23:01:52.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.720+0000 7f0a66800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c5f5ee1100 0x55c5f5e9ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:52.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.720+0000 7f0a66800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c5f5ee1100 0x55c5f5e9ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54532/0 (socket says 172.21.15.99:54532) 2024-02-21T23:01:52.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.720+0000 7f0a66800640 1 -- 172.21.15.99:0/936447386 learned_addr learned my addr 172.21.15.99:0/936447386 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:52.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.720+0000 7f0a65e00640 1 --2- 172.21.15.99:0/936447386 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c5f5ea6350 0x55c5f5e69a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:52.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.720+0000 7f0a65400640 1 --2- 172.21.15.99:0/936447386 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c5f5eaa2a0 0x55c5f5ecea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:52.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.720+0000 7f0a65e00640 1 -- 172.21.15.99:0/936447386 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c5f5eaa2a0 msgr2=0x55c5f5ecea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:52.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.720+0000 7f0a65e00640 1 --2- 172.21.15.99:0/936447386 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c5f5eaa2a0 0x55c5f5ecea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:52.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.720+0000 7f0a65e00640 1 -- 172.21.15.99:0/936447386 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c5f5ee1100 msgr2=0x55c5f5e9ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:52.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.720+0000 7f0a65e00640 1 --2- 172.21.15.99:0/936447386 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c5f5ee1100 0x55c5f5e9ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:52.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.720+0000 7f0a65e00640 1 -- 172.21.15.99:0/936447386 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c5f5bad6b0 con 0x55c5f5ea6350 2024-02-21T23:01:52.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.721+0000 7f0a65e00640 1 --2- 172.21.15.99:0/936447386 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c5f5ea6350 0x55c5f5e69a70 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0a580c7150 tx=0x7f0a58093620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b60d314f6032dfe server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:52.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.721+0000 7f0a51c00640 1 -- 172.21.15.99:0/936447386 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a58004db0 con 0x55c5f5ea6350 2024-02-21T23:01:52.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.721+0000 7f0a51c00640 1 -- 172.21.15.99:0/936447386 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a58095550 con 0x55c5f5ea6350 2024-02-21T23:01:52.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.721+0000 7f0a51c00640 1 -- 172.21.15.99:0/936447386 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a580c7260 con 0x55c5f5ea6350 2024-02-21T23:01:52.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.722+0000 7f0a6fa6a740 1 -- 172.21.15.99:0/936447386 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c5f5ea6350 msgr2=0x55c5f5e69a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:52.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.722+0000 7f0a6fa6a740 1 --2- 172.21.15.99:0/936447386 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c5f5ea6350 0x55c5f5e69a70 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0a580c7150 tx=0x7f0a58093620 comp rx=0 tx=0).stop 2024-02-21T23:01:52.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.722+0000 7f0a6fa6a740 1 -- 172.21.15.99:0/936447386 shutdown_connections 2024-02-21T23:01:52.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.722+0000 7f0a6fa6a740 1 --2- 172.21.15.99:0/936447386 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c5f5ee1100 0x55c5f5e9ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:52.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.722+0000 7f0a6fa6a740 1 --2- 172.21.15.99:0/936447386 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c5f5eaa2a0 0x55c5f5ecea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:52.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.722+0000 7f0a6fa6a740 1 --2- 172.21.15.99:0/936447386 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c5f5ea6350 0x55c5f5e69a70 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:52.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.722+0000 7f0a6fa6a740 1 -- 172.21.15.99:0/936447386 >> 172.21.15.99:0/936447386 conn(0x55c5f5ea5a30 msgr2=0x55c5f5e60020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:52.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.722+0000 7f0a6fa6a740 1 -- 172.21.15.99:0/936447386 shutdown_connections 2024-02-21T23:01:52.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.722+0000 7f0a6fa6a740 1 -- 172.21.15.99:0/936447386 wait complete. 2024-02-21T23:01:52.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.723+0000 7f0a6fa6a740 1 -- start start 2024-02-21T23:01:52.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.724+0000 7f0a6fa6a740 1 Processor -- start 2024-02-21T23:01:52.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.726+0000 7f0a6fa6a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c5f5ea6350 0x55c5f5e89ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:52.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.726+0000 7f0a6fa6a740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c5f5eaa2a0 0x55c5f5eb02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:52.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.726+0000 7f0a6fa6a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c5f5ee1100 0x55c5f5eb0830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:52.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.726+0000 7f0a6fa6a740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5f5eed300 con 0x55c5f5eaa2a0 2024-02-21T23:01:52.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.726+0000 7f0a6fa6a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5f5e65270 con 0x55c5f5ee1100 2024-02-21T23:01:52.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.726+0000 7f0a6fa6a740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c5f5eed960 con 0x55c5f5ea6350 2024-02-21T23:01:52.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.726+0000 7f0a6fa6a740 10 client.0 _ll_register_callbacks cb 0x7f0a600095f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:01:52.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.726+0000 7f0a65400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c5f5eaa2a0 0x55c5f5eb02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:52.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.726+0000 7f0a65400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c5f5eaa2a0 0x55c5f5eb02f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54542/0 (socket says 172.21.15.99:54542) 2024-02-21T23:01:52.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.726+0000 7f0a65400640 1 -- 172.21.15.99:0/560865676 learned_addr learned my addr 172.21.15.99:0/560865676 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:52.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.726+0000 7f0a65e00640 1 --2- 172.21.15.99:0/560865676 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c5f5ea6350 0x55c5f5e89ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:52.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.726+0000 7f0a66800640 1 --2- 172.21.15.99:0/560865676 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c5f5ee1100 0x55c5f5eb0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:52.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.726+0000 7f0a65e00640 1 -- 172.21.15.99:0/560865676 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c5f5ee1100 msgr2=0x55c5f5eb0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:52.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.726+0000 7f0a65e00640 1 --2- 172.21.15.99:0/560865676 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c5f5ee1100 0x55c5f5eb0830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:52.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.727+0000 7f0a65e00640 1 -- 172.21.15.99:0/560865676 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c5f5eaa2a0 msgr2=0x55c5f5eb02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:52.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.727+0000 7f0a65e00640 1 --2- 172.21.15.99:0/560865676 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c5f5eaa2a0 0x55c5f5eb02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:52.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.727+0000 7f0a65e00640 1 -- 172.21.15.99:0/560865676 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c5f5efc340 con 0x55c5f5ea6350 2024-02-21T23:01:52.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.727+0000 7f0a65400640 1 --2- 172.21.15.99:0/560865676 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c5f5eaa2a0 0x55c5f5eb02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:01:52.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.727+0000 7f0a65e00640 1 --2- 172.21.15.99:0/560865676 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c5f5ea6350 0x55c5f5e89ff0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0a5800cdb0 tx=0x7f0a5801f040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a00486a2925d7cc server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:52.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.727+0000 7f0a46a00640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-02-21T23:01:52.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.727+0000 7f0a46a00640 1 -- 172.21.15.99:0/560865676 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a580c7260 con 0x55c5f5ea6350 2024-02-21T23:01:52.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.727+0000 7f0a46a00640 1 -- 172.21.15.99:0/560865676 <== mon.2 v2:172.21.15.181:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f0a580966a0 con 0x55c5f5ea6350 2024-02-21T23:01:52.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.727+0000 7f0a6fa6a740 1 -- 172.21.15.99:0/560865676 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0a58095550 con 0x55c5f5ea6350 2024-02-21T23:01:52.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.727+0000 7f0a46a00640 1 -- 172.21.15.99:0/560865676 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0a580c7400 con 0x55c5f5ea6350 2024-02-21T23:01:52.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.727+0000 7f0a6fa6a740 10 client.4886 fetch_fsmap learned FSMap version 14 2024-02-21T23:01:52.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.727+0000 7f0a6fa6a740 1 -- 172.21.15.99:0/560865676 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x55c5f5efc060 con 0x55c5f5ea6350 2024-02-21T23:01:52.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.728+0000 7f0a46a00640 1 -- 172.21.15.99:0/560865676 <== mon.2 v2:172.21.15.181:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a58095550 con 0x55c5f5ea6350 2024-02-21T23:01:52.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.728+0000 7f0a46a00640 1 -- 172.21.15.99:0/560865676 <== mon.2 v2:172.21.15.181:3300/0 5 ==== fsmap(e 14) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f0a58092fa0 con 0x55c5f5ea6350 2024-02-21T23:01:52.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.728+0000 7f0a6fa6a740 10 client.4886 fetch_fsmap finished waiting for FSMap version 14 2024-02-21T23:01:52.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.728+0000 7f0a6fa6a740 10 client.4886 resolve_mds: resolved name 'a' to daemon mds.a 2024-02-21T23:01:52.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.728+0000 7f0a6fa6a740 20 client.4886 populate_metadata read hostname 'smithi099' 2024-02-21T23:01:52.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.728+0000 7f0a6fa6a740 1 --2- 172.21.15.99:0/560865676 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x55c5f5f515f0 0x55c5f5f539e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:52.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.728+0000 7f0a6fa6a740 4 client.4886 mds_command: new command op to 4352 tid=0 multi_id=0 [{"prefix": "status"}] 2024-02-21T23:01:52.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.728+0000 7f0a6fa6a740 1 -- 172.21.15.99:0/560865676 --> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c5f5dd5d00 con 0x55c5f5f515f0 2024-02-21T23:01:52.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.728+0000 7f0a65400640 1 --2- 172.21.15.99:0/560865676 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x55c5f5f515f0 0x55c5f5f539e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:52.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.729+0000 7f0a65400640 1 --2- 172.21.15.99:0/560865676 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x55c5f5f515f0 0x55c5f5f539e0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c5a177a040e6cf75 server_cookie=84e44998bba8a370 in_seq=0 out_seq=0 2024-02-21T23:01:52.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.729+0000 7f0a46a00640 10 client.4886 ms_handle_connect on v2:172.21.15.99:6836/1676159950 2024-02-21T23:01:52.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.729+0000 7f0a46a00640 1 -- 172.21.15.99:0/560865676 <== mds.1 v2:172.21.15.99:6836/1676159950 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55c5f5dd5d00 con 0x55c5f5f515f0 2024-02-21T23:01:52.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.729+0000 7f0a46a00640 10 client.4886 handle_command_reply: tid=0 2024-02-21T23:01:52.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.729+0000 7f0a6fa6a740 1 client.4886 shutdown 2024-02-21T23:01:52.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.729+0000 7f0a6fa6a740 1 -- 172.21.15.99:0/560865676 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c5f5ea6350 msgr2=0x55c5f5e89ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:52.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.729+0000 7f0a6fa6a740 1 --2- 172.21.15.99:0/560865676 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c5f5ea6350 0x55c5f5e89ff0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0a5800cdb0 tx=0x7f0a5801f040 comp rx=0 tx=0).stop 2024-02-21T23:01:52.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.729+0000 7f0a6fa6a740 1 -- 172.21.15.99:0/560865676 shutdown_connections 2024-02-21T23:01:52.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.729+0000 7f0a6fa6a740 1 --2- 172.21.15.99:0/560865676 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x55c5f5f515f0 0x55c5f5f539e0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:52.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.729+0000 7f0a6fa6a740 1 --2- 172.21.15.99:0/560865676 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c5f5ee1100 0x55c5f5eb0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:52.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.729+0000 7f0a6fa6a740 1 --2- 172.21.15.99:0/560865676 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c5f5eaa2a0 0x55c5f5eb02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:52.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.729+0000 7f0a46a00640 0 client.4886 ms_handle_reset on v2:172.21.15.99:6836/1676159950 2024-02-21T23:01:52.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.729+0000 7f0a6fa6a740 1 --2- 172.21.15.99:0/560865676 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c5f5ea6350 0x55c5f5e89ff0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:52.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.729+0000 7f0a6fa6a740 1 -- 172.21.15.99:0/560865676 >> 172.21.15.99:0/560865676 conn(0x55c5f5ea5a30 msgr2=0x55c5f5e66210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:52.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.730+0000 7f0a6fa6a740 1 -- 172.21.15.99:0/560865676 shutdown_connections 2024-02-21T23:01:52.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.730+0000 7f0a6fa6a740 1 -- 172.21.15.99:0/560865676 wait complete. 2024-02-21T23:01:52.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.730+0000 7f0a6fa6a740 20 client.4886 trim_cache size 0 max 16384 2024-02-21T23:01:52.724 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-02-21T23:01:52.724 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_fsid": "e8af98cd-45a1-425f-96a7-f24da8ee4efb", 2024-02-21T23:01:52.724 INFO:teuthology.orchestra.run.smithi099.stdout: "whoami": 1, 2024-02-21T23:01:52.724 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 4352, 2024-02-21T23:01:52.724 INFO:teuthology.orchestra.run.smithi099.stdout: "want_state": "up:active", 2024-02-21T23:01:52.724 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "up:active", 2024-02-21T23:01:52.724 INFO:teuthology.orchestra.run.smithi099.stdout: "fs_name": "cephfs", 2024-02-21T23:01:52.724 INFO:teuthology.orchestra.run.smithi099.stdout: "rank_uptime": 21.356788408, 2024-02-21T23:01:52.724 INFO:teuthology.orchestra.run.smithi099.stdout: "mdsmap_epoch": 14, 2024-02-21T23:01:52.724 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_epoch": 31, 2024-02-21T23:01:52.724 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_epoch_barrier": 29, 2024-02-21T23:01:52.724 INFO:teuthology.orchestra.run.smithi099.stdout: "uptime": 54.583711047000001 2024-02-21T23:01:52.724 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-02-21T23:01:52.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.730+0000 7f0a67200640 1 -- 172.21.15.99:0/3421753285 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f0a4809edf0 msgr2=0x7f0a480a12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:52.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.730+0000 7f0a67200640 1 --2- 172.21.15.99:0/3421753285 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f0a4809edf0 0x7f0a480a12b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0a54035000 tx=0x7f0a54008030 comp rx=0 tx=0).stop 2024-02-21T23:01:52.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.730+0000 7f0a67200640 1 -- 172.21.15.99:0/3421753285 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a680719b0 msgr2=0x7f0a68214b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:52.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.730+0000 7f0a67200640 1 --2- 172.21.15.99:0/3421753285 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a680719b0 0x7f0a68214b10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0a5800c3f0 tx=0x7f0a5800c8b0 comp rx=0 tx=0).stop 2024-02-21T23:01:52.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.731+0000 7f0a67200640 1 -- 172.21.15.99:0/3421753285 shutdown_connections 2024-02-21T23:01:52.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.731+0000 7f0a67200640 1 --2- 172.21.15.99:0/3421753285 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f0a4809edf0 0x7f0a480a12b0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:52.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.731+0000 7f0a67200640 1 --2- 172.21.15.99:0/3421753285 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0a6818a010 0x7f0a6821d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:52.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.731+0000 7f0a67200640 1 --2- 172.21.15.99:0/3421753285 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0a68182a80 0x7f0a68179480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:52.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.731+0000 7f0a67200640 1 --2- 172.21.15.99:0/3421753285 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a680719b0 0x7f0a68214b10 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:52.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.731+0000 7f0a67200640 1 -- 172.21.15.99:0/3421753285 >> 172.21.15.99:0/3421753285 conn(0x7f0a680d29f0 msgr2=0x7f0a68071e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:52.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.731+0000 7f0a67200640 1 -- 172.21.15.99:0/3421753285 shutdown_connections 2024-02-21T23:01:52.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.731+0000 7f0a67200640 1 -- 172.21.15.99:0/3421753285 wait complete. 2024-02-21T23:01:52.739 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.j status 2024-02-21T23:01:52.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.963+0000 7faa3f200640 1 Processor -- start 2024-02-21T23:01:52.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.963+0000 7faa3f200640 1 -- start start 2024-02-21T23:01:52.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.965+0000 7faa3f200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7faa381865c0 0x7faa38188190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:52.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.965+0000 7faa3f200640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7faa380d4300 0x7faa380d4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:52.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.965+0000 7faa3f200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa38186a50 con 0x7faa381861e0 2024-02-21T23:01:52.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.965+0000 7faa3f200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa38186d50 con 0x7faa381865c0 2024-02-21T23:01:52.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.965+0000 7faa3f200640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa381875f0 con 0x7faa380d4300 2024-02-21T23:01:52.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.966+0000 7faa37e00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7faa381861e0 0x7faa38187a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:57440/0 (socket says 172.21.15.99:57440) 2024-02-21T23:01:52.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.966+0000 7faa37e00640 1 -- 172.21.15.99:0/2915259836 learned_addr learned my addr 172.21.15.99:0/2915259836 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:01:52.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.966+0000 7faa37400640 1 --2- 172.21.15.99:0/2915259836 >> v2:172.21.15.99:3300/0 conn(0x7faa381865c0 0x7faa38188190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:52.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.966+0000 7faa3d200640 1 --2- 172.21.15.99:0/2915259836 >> v2:172.21.15.181:3300/0 conn(0x7faa380d4300 0x7faa380d4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:52.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.966+0000 7faa36a00640 1 -- 172.21.15.99:0/2915259836 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3020825727 0 0) 0x7faa38186a50 con 0x7faa381861e0 2024-02-21T23:01:52.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.966+0000 7faa37400640 1 -- 172.21.15.99:0/2915259836 >> v2:172.21.15.181:3300/0 conn(0x7faa380d4300 msgr2=0x7faa380d4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:52.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.966+0000 7faa37400640 1 --2- 172.21.15.99:0/2915259836 >> v2:172.21.15.181:3300/0 conn(0x7faa380d4300 0x7faa380d4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:52.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.966+0000 7faa37400640 1 -- 172.21.15.99:0/2915259836 >> v1:172.21.15.99:6789/0 conn(0x7faa381861e0 legacy=0x7faa38187a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:52.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.966+0000 7faa37400640 1 -- 172.21.15.99:0/2915259836 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa381886d0 con 0x7faa381865c0 2024-02-21T23:01:52.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.968+0000 7faa37400640 1 --2- 172.21.15.99:0/2915259836 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa381865c0 0x7faa38188190 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7faa380ff770 tx=0x7faa2402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b368cfacfe94543a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:52.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.968+0000 7faa36a00640 1 -- 172.21.15.99:0/2915259836 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa240315a0 con 0x7faa381865c0 2024-02-21T23:01:52.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.968+0000 7faa36a00640 1 -- 172.21.15.99:0/2915259836 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa24037070 con 0x7faa381865c0 2024-02-21T23:01:52.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.968+0000 7faa36a00640 1 -- 172.21.15.99:0/2915259836 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa24031960 con 0x7faa381865c0 2024-02-21T23:01:52.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.969+0000 7faa3f200640 1 -- 172.21.15.99:0/2915259836 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa381865c0 msgr2=0x7faa38188190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:52.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.969+0000 7faa3f200640 1 --2- 172.21.15.99:0/2915259836 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa381865c0 0x7faa38188190 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7faa380ff770 tx=0x7faa2402b840 comp rx=0 tx=0).stop 2024-02-21T23:01:52.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.969+0000 7faa3f200640 1 -- 172.21.15.99:0/2915259836 shutdown_connections 2024-02-21T23:01:52.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.969+0000 7faa3f200640 1 --2- 172.21.15.99:0/2915259836 >> v2:172.21.15.181:3300/0 conn(0x7faa380d4300 0x7faa380d4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:52.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.969+0000 7faa3f200640 1 --2- 172.21.15.99:0/2915259836 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa381865c0 0x7faa38188190 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:52.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.969+0000 7faa3f200640 1 -- 172.21.15.99:0/2915259836 >> 172.21.15.99:0/2915259836 conn(0x7faa380d6ac0 msgr2=0x7faa380740b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:52.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.969+0000 7faa3f200640 1 -- 172.21.15.99:0/2915259836 shutdown_connections 2024-02-21T23:01:52.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.969+0000 7faa3f200640 1 -- 172.21.15.99:0/2915259836 wait complete. 2024-02-21T23:01:52.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.972+0000 7faa3f200640 1 Processor -- start 2024-02-21T23:01:52.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.972+0000 7faa3f200640 1 -- start start 2024-02-21T23:01:52.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.974+0000 7faa3f200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa380d4300 0x7faa3808eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:52.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.974+0000 7faa3f200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faa381861e0 0x7faa3817ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:52.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.974+0000 7faa3f200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa381865c0 0x7faa3816b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:52.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.974+0000 7faa3f200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa38186fa0 con 0x7faa381865c0 2024-02-21T23:01:52.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.974+0000 7faa3f200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa380cfac0 con 0x7faa380d4300 2024-02-21T23:01:52.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.974+0000 7faa3f200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa38187280 con 0x7faa381861e0 2024-02-21T23:01:52.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.975+0000 7faa3d200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa381865c0 0x7faa3816b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:52.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.975+0000 7faa37e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa380d4300 0x7faa3808eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:52.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.975+0000 7faa3d200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa381865c0 0x7faa3816b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54568/0 (socket says 172.21.15.99:54568) 2024-02-21T23:01:52.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.975+0000 7faa3d200640 1 -- 172.21.15.99:0/3523158323 learned_addr learned my addr 172.21.15.99:0/3523158323 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:52.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.975+0000 7faa37400640 1 --2- 172.21.15.99:0/3523158323 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faa381861e0 0x7faa3817ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:52.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.975+0000 7faa3d200640 1 -- 172.21.15.99:0/3523158323 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faa381861e0 msgr2=0x7faa3817ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:52.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.975+0000 7faa3d200640 1 --2- 172.21.15.99:0/3523158323 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faa381861e0 0x7faa3817ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:52.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.975+0000 7faa3d200640 1 -- 172.21.15.99:0/3523158323 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa380d4300 msgr2=0x7faa3808eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:52.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.975+0000 7faa3d200640 1 --2- 172.21.15.99:0/3523158323 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa380d4300 0x7faa3808eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:52.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.975+0000 7faa3d200640 1 -- 172.21.15.99:0/3523158323 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa38223380 con 0x7faa381865c0 2024-02-21T23:01:52.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.976+0000 7faa3d200640 1 --2- 172.21.15.99:0/3523158323 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa381865c0 0x7faa3816b090 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7faa30009d30 tx=0x7faa3000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:52.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.976+0000 7faa2fe00640 1 -- 172.21.15.99:0/3523158323 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa30018020 con 0x7faa381865c0 2024-02-21T23:01:52.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.976+0000 7faa2fe00640 1 -- 172.21.15.99:0/3523158323 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa30014480 con 0x7faa381865c0 2024-02-21T23:01:52.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.976+0000 7faa3f200640 1 -- 172.21.15.99:0/3523158323 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa3817d390 con 0x7faa381865c0 2024-02-21T23:01:52.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.976+0000 7faa2fe00640 1 -- 172.21.15.99:0/3523158323 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa30014870 con 0x7faa381865c0 2024-02-21T23:01:52.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.976+0000 7faa3f200640 1 -- 172.21.15.99:0/3523158323 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa382230a0 con 0x7faa381865c0 2024-02-21T23:01:52.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.981+0000 7faa2fe00640 1 -- 172.21.15.99:0/3523158323 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 6) v1 ==== 134407+0+0 (secure 0 0 0) 0x7faa30005d10 con 0x7faa381865c0 2024-02-21T23:01:52.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.982+0000 7faa421a8740 1 Processor -- start 2024-02-21T23:01:52.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.982+0000 7faa421a8740 1 -- start start 2024-02-21T23:01:52.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.984+0000 7faa2fe00640 1 --2- 172.21.15.99:0/3523158323 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7faa1809edf0 0x7faa180a12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:52.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.984+0000 7faa421a8740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca8a306850 0x55ca8a306c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:52.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.984+0000 7faa421a8740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ca8a307170 0x55ca8a3419e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:52.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.984+0000 7faa421a8740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ca8a341f20 0x55ca8a342cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:52.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.984+0000 7faa421a8740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca8a22f470 con 0x55ca8a341f20 2024-02-21T23:01:52.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.984+0000 7faa421a8740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca8a1d8af0 con 0x55ca8a306850 2024-02-21T23:01:52.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.984+0000 7faa421a8740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca8a22b510 con 0x55ca8a307170 2024-02-21T23:01:52.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.984+0000 7faa2fe00640 1 -- 172.21.15.99:0/3523158323 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7faa300ca6f0 con 0x7faa381865c0 2024-02-21T23:01:52.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.984+0000 7faa37400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ca8a307170 0x55ca8a3419e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:52.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.984+0000 7faa37e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca8a306850 0x55ca8a306c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:52.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.984+0000 7faa37400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ca8a307170 0x55ca8a3419e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:59334/0 (socket says 172.21.15.99:59334) 2024-02-21T23:01:52.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.984+0000 7faa37400640 1 -- 172.21.15.99:0/229423632 learned_addr learned my addr 172.21.15.99:0/229423632 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:52.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.984+0000 7faa3d200640 1 --2- 172.21.15.99:0/229423632 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ca8a341f20 0x55ca8a342cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:52.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.984+0000 7faa37400640 1 --2- 172.21.15.99:0/3523158323 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7faa1809edf0 0x7faa180a12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:52.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.985+0000 7faa37e00640 1 -- 172.21.15.99:0/229423632 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ca8a307170 msgr2=0x55ca8a3419e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:52.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.985+0000 7faa37e00640 1 --2- 172.21.15.99:0/229423632 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ca8a307170 0x55ca8a3419e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:52.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.985+0000 7faa37e00640 1 -- 172.21.15.99:0/229423632 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ca8a341f20 msgr2=0x55ca8a342cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:52.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.985+0000 7faa37e00640 1 --2- 172.21.15.99:0/229423632 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ca8a341f20 0x55ca8a342cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:52.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.985+0000 7faa37e00640 1 -- 172.21.15.99:0/229423632 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ca8a1dfd90 con 0x55ca8a306850 2024-02-21T23:01:52.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.985+0000 7faa37400640 1 --2- 172.21.15.99:0/229423632 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ca8a307170 0x55ca8a3419e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:01:52.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.985+0000 7faa37e00640 1 --2- 172.21.15.99:0/229423632 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca8a306850 0x55ca8a306c30 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7faa28007650 tx=0x7faa28004bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fec1f365e3a164f0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:52.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.985+0000 7faa2cc00640 1 -- 172.21.15.99:0/229423632 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa2801a070 con 0x55ca8a306850 2024-02-21T23:01:52.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.985+0000 7faa2cc00640 1 -- 172.21.15.99:0/229423632 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa280017e0 con 0x55ca8a306850 2024-02-21T23:01:52.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.985+0000 7faa2cc00640 1 -- 172.21.15.99:0/229423632 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa28001bd0 con 0x55ca8a306850 2024-02-21T23:01:52.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.986+0000 7faa421a8740 1 -- 172.21.15.99:0/229423632 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca8a306850 msgr2=0x55ca8a306c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:52.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.986+0000 7faa37400640 1 --2- 172.21.15.99:0/3523158323 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7faa1809edf0 0x7faa180a12b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7faa2402b880 tx=0x7faa24008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:52.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.986+0000 7faa421a8740 1 --2- 172.21.15.99:0/229423632 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca8a306850 0x55ca8a306c30 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7faa28007650 tx=0x7faa28004bb0 comp rx=0 tx=0).stop 2024-02-21T23:01:52.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.986+0000 7faa421a8740 1 -- 172.21.15.99:0/229423632 shutdown_connections 2024-02-21T23:01:52.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.986+0000 7faa421a8740 1 --2- 172.21.15.99:0/229423632 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ca8a341f20 0x55ca8a342cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:52.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.986+0000 7faa421a8740 1 --2- 172.21.15.99:0/229423632 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ca8a307170 0x55ca8a3419e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:52.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.986+0000 7faa421a8740 1 --2- 172.21.15.99:0/229423632 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca8a306850 0x55ca8a306c30 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:52.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.986+0000 7faa421a8740 1 -- 172.21.15.99:0/229423632 >> 172.21.15.99:0/229423632 conn(0x55ca8a2c8e20 msgr2=0x55ca8a2c9ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:52.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.986+0000 7faa421a8740 1 -- 172.21.15.99:0/229423632 shutdown_connections 2024-02-21T23:01:52.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.987+0000 7faa421a8740 1 -- 172.21.15.99:0/229423632 wait complete. 2024-02-21T23:01:52.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.988+0000 7faa421a8740 1 -- start start 2024-02-21T23:01:52.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.988+0000 7faa421a8740 1 Processor -- start 2024-02-21T23:01:52.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.990+0000 7faa421a8740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca8a307170 0x55ca8a337250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:52.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.990+0000 7faa421a8740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ca8a341f20 0x55ca8a34e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:52.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.990+0000 7faa421a8740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ca8a3043b0 0x55ca8a2f8100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:52.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.990+0000 7faa421a8740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca8a340400 con 0x55ca8a341f20 2024-02-21T23:01:52.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.990+0000 7faa421a8740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca8a1ce040 con 0x55ca8a307170 2024-02-21T23:01:52.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.991+0000 7faa421a8740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca8a3406e0 con 0x55ca8a3043b0 2024-02-21T23:01:52.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.991+0000 7faa421a8740 10 client.0 _ll_register_callbacks cb 0x55ca8a1eb920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:01:52.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.991+0000 7faa37e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca8a307170 0x55ca8a337250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:52.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.991+0000 7faa37400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ca8a341f20 0x55ca8a34e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:52.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.991+0000 7faa37e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca8a307170 0x55ca8a337250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:34702/0 (socket says 172.21.15.99:34702) 2024-02-21T23:01:52.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.991+0000 7faa37e00640 1 -- 172.21.15.99:0/3432727123 learned_addr learned my addr 172.21.15.99:0/3432727123 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:52.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.991+0000 7faa3d200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ca8a3043b0 0x55ca8a2f8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:52.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.991+0000 7faa37e00640 1 -- 172.21.15.99:0/3432727123 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ca8a3043b0 msgr2=0x55ca8a2f8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:52.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.992+0000 7faa37e00640 1 --2- 172.21.15.99:0/3432727123 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ca8a3043b0 0x55ca8a2f8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:52.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.992+0000 7faa37e00640 1 -- 172.21.15.99:0/3432727123 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ca8a341f20 msgr2=0x55ca8a34e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:52.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.992+0000 7faa37e00640 1 --2- 172.21.15.99:0/3432727123 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ca8a341f20 0x55ca8a34e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:52.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.992+0000 7faa37e00640 1 -- 172.21.15.99:0/3432727123 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ca8a1edaa0 con 0x55ca8a307170 2024-02-21T23:01:52.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.992+0000 7faa37400640 1 --2- 172.21.15.99:0/3432727123 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ca8a341f20 0x55ca8a34e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:01:52.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.992+0000 7faa37e00640 1 --2- 172.21.15.99:0/3432727123 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca8a307170 0x55ca8a337250 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7faa280015d0 tx=0x7faa28000ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df1cc8bcb90e32fb server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:52.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.992+0000 7faa21600640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-02-21T23:01:52.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.992+0000 7faa21600640 1 -- 172.21.15.99:0/3432727123 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa2801a030 con 0x55ca8a307170 2024-02-21T23:01:52.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.992+0000 7faa21600640 1 -- 172.21.15.99:0/3432727123 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7faa28015a50 con 0x55ca8a307170 2024-02-21T23:01:52.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.992+0000 7faa421a8740 1 -- 172.21.15.99:0/3432727123 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7faa280017e0 con 0x55ca8a307170 2024-02-21T23:01:52.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.993+0000 7faa21600640 1 -- 172.21.15.99:0/3432727123 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7faa28007b00 con 0x55ca8a307170 2024-02-21T23:01:52.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.993+0000 7faa421a8740 10 client.4951 fetch_fsmap learned FSMap version 14 2024-02-21T23:01:52.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.993+0000 7faa421a8740 1 -- 172.21.15.99:0/3432727123 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x55ca89f442d0 con 0x55ca8a307170 2024-02-21T23:01:52.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.993+0000 7faa21600640 1 -- 172.21.15.99:0/3432727123 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa280017e0 con 0x55ca8a307170 2024-02-21T23:01:52.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.993+0000 7faa21600640 1 -- 172.21.15.99:0/3432727123 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 14) v1 ==== 7890+0+0 (secure 0 0 0) 0x7faa28027020 con 0x55ca8a307170 2024-02-21T23:01:52.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.993+0000 7faa421a8740 10 client.4951 fetch_fsmap finished waiting for FSMap version 14 2024-02-21T23:01:52.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.993+0000 7faa421a8740 10 client.4951 resolve_mds: resolved name 'j' to daemon mds.j 2024-02-21T23:01:52.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.993+0000 7faa421a8740 20 client.4951 populate_metadata read hostname 'smithi099' 2024-02-21T23:01:52.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.993+0000 7faa421a8740 1 --2- 172.21.15.99:0/3432727123 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55ca8a3033b0 0x55ca8a357bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:52.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.993+0000 7faa421a8740 4 client.4951 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:01:52.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.993+0000 7faa421a8740 1 -- 172.21.15.99:0/3432727123 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ca8a23c9b0 con 0x55ca8a3033b0 2024-02-21T23:01:52.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.994+0000 7faa37400640 1 --2- 172.21.15.99:0/3432727123 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55ca8a3033b0 0x55ca8a357bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:52.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.994+0000 7faa37400640 1 --2- 172.21.15.99:0/3432727123 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55ca8a3033b0 0x55ca8a357bf0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c77221110dec9efc server_cookie=2d0b396a43a08824 in_seq=0 out_seq=0 2024-02-21T23:01:52.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.994+0000 7faa21600640 10 client.4951 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:01:52.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.995+0000 7faa21600640 1 -- 172.21.15.99:0/3432727123 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55ca8a23c9b0 con 0x55ca8a3033b0 2024-02-21T23:01:52.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.996+0000 7faa21600640 10 client.4951 handle_command_reply: tid=0 2024-02-21T23:01:52.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.996+0000 7faa421a8740 1 client.4951 shutdown 2024-02-21T23:01:52.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.996+0000 7faa421a8740 1 -- 172.21.15.99:0/3432727123 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca8a307170 msgr2=0x55ca8a337250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:52.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.996+0000 7faa421a8740 1 --2- 172.21.15.99:0/3432727123 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca8a307170 0x55ca8a337250 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7faa280015d0 tx=0x7faa28000ed0 comp rx=0 tx=0).stop 2024-02-21T23:01:52.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.996+0000 7faa421a8740 1 -- 172.21.15.99:0/3432727123 shutdown_connections 2024-02-21T23:01:52.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.996+0000 7faa421a8740 1 --2- 172.21.15.99:0/3432727123 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55ca8a3033b0 0x55ca8a357bf0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:52.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.996+0000 7faa421a8740 1 --2- 172.21.15.99:0/3432727123 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ca8a3043b0 0x55ca8a2f8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:52.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.996+0000 7faa421a8740 1 --2- 172.21.15.99:0/3432727123 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ca8a341f20 0x55ca8a34e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:52.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.996+0000 7faa21600640 0 client.4951 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:01:52.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.996+0000 7faa421a8740 1 --2- 172.21.15.99:0/3432727123 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca8a307170 0x55ca8a337250 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:52.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.996+0000 7faa421a8740 1 -- 172.21.15.99:0/3432727123 >> 172.21.15.99:0/3432727123 conn(0x55ca8a306850 msgr2=0x55ca8a2ca890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:52.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.996+0000 7faa421a8740 1 -- 172.21.15.99:0/3432727123 shutdown_connections 2024-02-21T23:01:52.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.996+0000 7faa421a8740 1 -- 172.21.15.99:0/3432727123 wait complete. 2024-02-21T23:01:52.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:52.996+0000 7faa421a8740 20 client.4951 trim_cache size 0 max 16384 2024-02-21T23:01:53.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.014+0000 7faa421a8740 1 Processor -- start 2024-02-21T23:01:53.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.015+0000 7faa421a8740 1 -- start start 2024-02-21T23:01:53.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.016+0000 7faa421a8740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ca8a3043b0 0x55ca8a34e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:53.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.016+0000 7faa421a8740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ca8a307170 0x55ca8a340920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:53.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.016+0000 7faa421a8740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca8a341f20 0x55ca8a337030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:53.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.016+0000 7faa421a8740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca8a2c4730 con 0x55ca8a3043b0 2024-02-21T23:01:53.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.016+0000 7faa421a8740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca8a2c4d90 con 0x55ca8a341f20 2024-02-21T23:01:53.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.016+0000 7faa421a8740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca8a303230 con 0x55ca8a307170 2024-02-21T23:01:53.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.016+0000 7faa37e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ca8a3043b0 0x55ca8a34e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:53.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.016+0000 7faa37e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ca8a3043b0 0x55ca8a34e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54594/0 (socket says 172.21.15.99:54594) 2024-02-21T23:01:53.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.016+0000 7faa37e00640 1 -- 172.21.15.99:0/3634313923 learned_addr learned my addr 172.21.15.99:0/3634313923 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:53.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.016+0000 7faa37400640 1 --2- 172.21.15.99:0/3634313923 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ca8a307170 0x55ca8a340920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:53.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.016+0000 7faa3d200640 1 --2- 172.21.15.99:0/3634313923 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca8a341f20 0x55ca8a337030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:53.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.016+0000 7faa37e00640 1 -- 172.21.15.99:0/3634313923 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ca8a307170 msgr2=0x55ca8a340920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:53.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.016+0000 7faa37e00640 1 --2- 172.21.15.99:0/3634313923 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ca8a307170 0x55ca8a340920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:53.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.016+0000 7faa37e00640 1 -- 172.21.15.99:0/3634313923 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca8a341f20 msgr2=0x55ca8a337030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:53.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.016+0000 7faa37e00640 1 --2- 172.21.15.99:0/3634313923 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca8a341f20 0x55ca8a337030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:53.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.016+0000 7faa37e00640 1 -- 172.21.15.99:0/3634313923 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ca8a00e6b0 con 0x55ca8a3043b0 2024-02-21T23:01:53.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.016+0000 7faa3d200640 1 --2- 172.21.15.99:0/3634313923 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca8a341f20 0x55ca8a337030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T23:01:53.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.017+0000 7faa37e00640 1 --2- 172.21.15.99:0/3634313923 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ca8a3043b0 0x55ca8a34e270 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7faa28000fb0 tx=0x7faa2801c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ed84a2cb87ae9b6 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:53.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.017+0000 7faa23e00640 1 -- 172.21.15.99:0/3634313923 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa2801a040 con 0x55ca8a3043b0 2024-02-21T23:01:53.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.017+0000 7faa23e00640 1 -- 172.21.15.99:0/3634313923 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa2801b040 con 0x55ca8a3043b0 2024-02-21T23:01:53.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.017+0000 7faa23e00640 1 -- 172.21.15.99:0/3634313923 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa28015670 con 0x55ca8a3043b0 2024-02-21T23:01:53.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.018+0000 7faa421a8740 1 -- 172.21.15.99:0/3634313923 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ca8a3043b0 msgr2=0x55ca8a34e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:53.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.018+0000 7faa421a8740 1 --2- 172.21.15.99:0/3634313923 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ca8a3043b0 0x55ca8a34e270 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7faa28000fb0 tx=0x7faa2801c000 comp rx=0 tx=0).stop 2024-02-21T23:01:53.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.018+0000 7faa421a8740 1 -- 172.21.15.99:0/3634313923 shutdown_connections 2024-02-21T23:01:53.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.018+0000 7faa421a8740 1 --2- 172.21.15.99:0/3634313923 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca8a341f20 0x55ca8a337030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:53.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.018+0000 7faa421a8740 1 --2- 172.21.15.99:0/3634313923 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ca8a307170 0x55ca8a340920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:53.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.018+0000 7faa421a8740 1 --2- 172.21.15.99:0/3634313923 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ca8a3043b0 0x55ca8a34e270 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:53.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.018+0000 7faa421a8740 1 -- 172.21.15.99:0/3634313923 >> 172.21.15.99:0/3634313923 conn(0x55ca8a306850 msgr2=0x55ca8a2c7750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:53.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.018+0000 7faa421a8740 1 -- 172.21.15.99:0/3634313923 shutdown_connections 2024-02-21T23:01:53.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.018+0000 7faa421a8740 1 -- 172.21.15.99:0/3634313923 wait complete. 2024-02-21T23:01:53.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.019+0000 7faa421a8740 1 -- start start 2024-02-21T23:01:53.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.019+0000 7faa421a8740 1 Processor -- start 2024-02-21T23:01:53.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.021+0000 7faa421a8740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca8a3043b0 0x55ca8a2c8690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:53.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.021+0000 7faa421a8740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ca8a307170 0x55ca8a34b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:53.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.021+0000 7faa421a8740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ca8a341f20 0x55ca8a33f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:53.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.021+0000 7faa421a8740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca8a2fa4c0 con 0x55ca8a307170 2024-02-21T23:01:53.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.021+0000 7faa421a8740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca8a303890 con 0x55ca8a3043b0 2024-02-21T23:01:53.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.021+0000 7faa421a8740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca8a2fab20 con 0x55ca8a341f20 2024-02-21T23:01:53.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.021+0000 7faa421a8740 10 client.0 _ll_register_callbacks cb 0x7faa28018070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:01:53.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.021+0000 7faa37e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca8a3043b0 0x55ca8a2c8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:53.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.021+0000 7faa37400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ca8a307170 0x55ca8a34b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:53.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.021+0000 7faa37e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca8a3043b0 0x55ca8a2c8690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:34722/0 (socket says 172.21.15.99:34722) 2024-02-21T23:01:53.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.021+0000 7faa37e00640 1 -- 172.21.15.99:0/2652356056 learned_addr learned my addr 172.21.15.99:0/2652356056 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:53.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.022+0000 7faa3d200640 1 --2- 172.21.15.99:0/2652356056 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ca8a341f20 0x55ca8a33f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:53.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.022+0000 7faa37400640 1 -- 172.21.15.99:0/2652356056 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ca8a341f20 msgr2=0x55ca8a33f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:53.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.022+0000 7faa37400640 1 --2- 172.21.15.99:0/2652356056 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ca8a341f20 0x55ca8a33f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:53.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.022+0000 7faa37400640 1 -- 172.21.15.99:0/2652356056 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca8a3043b0 msgr2=0x55ca8a2c8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:53.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.022+0000 7faa37400640 1 --2- 172.21.15.99:0/2652356056 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca8a3043b0 0x55ca8a2c8690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:53.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.022+0000 7faa37400640 1 -- 172.21.15.99:0/2652356056 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ca8a340da0 con 0x55ca8a307170 2024-02-21T23:01:53.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.022+0000 7faa37e00640 1 --2- 172.21.15.99:0/2652356056 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca8a3043b0 0x55ca8a2c8690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:01:53.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.022+0000 7faa37400640 1 --2- 172.21.15.99:0/2652356056 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ca8a307170 0x55ca8a34b9b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7faa24034040 tx=0x7faa2402e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9c99b167ea6b77a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:53.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.022+0000 7faa21600640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:01:53.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.023+0000 7faa21600640 1 -- 172.21.15.99:0/2652356056 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa2405b060 con 0x55ca8a307170 2024-02-21T23:01:53.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.023+0000 7faa21600640 1 -- 172.21.15.99:0/2652356056 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7faa240560d0 con 0x55ca8a307170 2024-02-21T23:01:53.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.023+0000 7faa421a8740 1 -- 172.21.15.99:0/2652356056 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7faa2801b040 con 0x55ca8a307170 2024-02-21T23:01:53.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.023+0000 7faa21600640 1 -- 172.21.15.99:0/2652356056 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7faa240562d0 con 0x55ca8a307170 2024-02-21T23:01:53.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.023+0000 7faa421a8740 10 client.4854 fetch_fsmap learned FSMap version 14 2024-02-21T23:01:53.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.023+0000 7faa421a8740 1 -- 172.21.15.99:0/2652356056 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x55ca8a33e8c0 con 0x55ca8a307170 2024-02-21T23:01:53.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.023+0000 7faa21600640 1 -- 172.21.15.99:0/2652356056 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa2801b040 con 0x55ca8a307170 2024-02-21T23:01:53.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.023+0000 7faa21600640 1 -- 172.21.15.99:0/2652356056 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 14) v1 ==== 7890+0+0 (secure 0 0 0) 0x7faa24053040 con 0x55ca8a307170 2024-02-21T23:01:53.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.023+0000 7faa421a8740 10 client.4854 fetch_fsmap finished waiting for FSMap version 14 2024-02-21T23:01:53.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.023+0000 7faa421a8740 10 client.4854 resolve_mds: resolved name 'j' to daemon mds.j 2024-02-21T23:01:53.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.023+0000 7faa421a8740 20 client.4854 populate_metadata read hostname 'smithi099' 2024-02-21T23:01:53.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.023+0000 7faa421a8740 1 --2- 172.21.15.99:0/2652356056 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55ca8a3b2860 0x55ca8a3b4c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:53.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.024+0000 7faa421a8740 4 client.4854 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "status"}] 2024-02-21T23:01:53.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.024+0000 7faa421a8740 1 -- 172.21.15.99:0/2652356056 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55ca8a236d00 con 0x55ca8a3b2860 2024-02-21T23:01:53.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.024+0000 7faa37e00640 1 --2- 172.21.15.99:0/2652356056 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55ca8a3b2860 0x55ca8a3b4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:53.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.024+0000 7faa37e00640 1 --2- 172.21.15.99:0/2652356056 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55ca8a3b2860 0x55ca8a3b4c50 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18b5d717b1a1cff0 server_cookie=c69d9d9c913a00f5 in_seq=0 out_seq=0 2024-02-21T23:01:53.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.024+0000 7faa21600640 10 client.4854 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:01:53.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.025+0000 7faa21600640 1 -- 172.21.15.99:0/2652356056 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+319 (crc 0 0 0) 0x55ca8a236d00 con 0x55ca8a3b2860 2024-02-21T23:01:53.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.025+0000 7faa21600640 10 client.4854 handle_command_reply: tid=0 2024-02-21T23:01:53.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.025+0000 7faa421a8740 1 client.4854 shutdown 2024-02-21T23:01:53.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.025+0000 7faa421a8740 1 -- 172.21.15.99:0/2652356056 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ca8a307170 msgr2=0x55ca8a34b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:53.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.025+0000 7faa421a8740 1 --2- 172.21.15.99:0/2652356056 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ca8a307170 0x55ca8a34b9b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7faa24034040 tx=0x7faa2402e000 comp rx=0 tx=0).stop 2024-02-21T23:01:53.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.025+0000 7faa421a8740 1 -- 172.21.15.99:0/2652356056 shutdown_connections 2024-02-21T23:01:53.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.025+0000 7faa421a8740 1 --2- 172.21.15.99:0/2652356056 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55ca8a3b2860 0x55ca8a3b4c50 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:53.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.025+0000 7faa421a8740 1 --2- 172.21.15.99:0/2652356056 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ca8a341f20 0x55ca8a33f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:53.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.025+0000 7faa421a8740 1 --2- 172.21.15.99:0/2652356056 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ca8a307170 0x55ca8a34b9b0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:53.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.025+0000 7faa421a8740 1 --2- 172.21.15.99:0/2652356056 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ca8a3043b0 0x55ca8a2c8690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:53.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.025+0000 7faa421a8740 1 -- 172.21.15.99:0/2652356056 >> 172.21.15.99:0/2652356056 conn(0x55ca8a306850 msgr2=0x55ca8a2c7650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:53.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.025+0000 7faa21600640 0 client.4854 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:01:53.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.025+0000 7faa421a8740 1 -- 172.21.15.99:0/2652356056 shutdown_connections 2024-02-21T23:01:53.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.025+0000 7faa421a8740 1 -- 172.21.15.99:0/2652356056 wait complete. 2024-02-21T23:01:53.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.025+0000 7faa421a8740 20 client.4854 trim_cache size 0 max 16384 2024-02-21T23:01:53.021 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-02-21T23:01:53.021 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_fsid": "e8af98cd-45a1-425f-96a7-f24da8ee4efb", 2024-02-21T23:01:53.021 INFO:teuthology.orchestra.run.smithi099.stdout: "whoami": 0, 2024-02-21T23:01:53.021 INFO:teuthology.orchestra.run.smithi099.stdout: "id": 4355, 2024-02-21T23:01:53.021 INFO:teuthology.orchestra.run.smithi099.stdout: "want_state": "up:active", 2024-02-21T23:01:53.021 INFO:teuthology.orchestra.run.smithi099.stdout: "state": "up:active", 2024-02-21T23:01:53.021 INFO:teuthology.orchestra.run.smithi099.stdout: "fs_name": "cephfs", 2024-02-21T23:01:53.021 INFO:teuthology.orchestra.run.smithi099.stdout: "rank_uptime": 49.832521604, 2024-02-21T23:01:53.022 INFO:teuthology.orchestra.run.smithi099.stdout: "mdsmap_epoch": 14, 2024-02-21T23:01:53.022 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_epoch": 31, 2024-02-21T23:01:53.022 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_epoch_barrier": 29, 2024-02-21T23:01:53.022 INFO:teuthology.orchestra.run.smithi099.stdout: "uptime": 54.875660689 2024-02-21T23:01:53.022 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-02-21T23:01:53.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.026+0000 7faa3f200640 1 -- 172.21.15.99:0/3523158323 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7faa1809edf0 msgr2=0x7faa180a12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:53.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.026+0000 7faa3f200640 1 --2- 172.21.15.99:0/3523158323 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7faa1809edf0 0x7faa180a12b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7faa2402b880 tx=0x7faa24008030 comp rx=0 tx=0).stop 2024-02-21T23:01:53.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.026+0000 7faa3f200640 1 -- 172.21.15.99:0/3523158323 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa381865c0 msgr2=0x7faa3816b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:53.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.026+0000 7faa3f200640 1 --2- 172.21.15.99:0/3523158323 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa381865c0 0x7faa3816b090 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7faa30009d30 tx=0x7faa3000c490 comp rx=0 tx=0).stop 2024-02-21T23:01:53.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.026+0000 7faa3f200640 1 -- 172.21.15.99:0/3523158323 shutdown_connections 2024-02-21T23:01:53.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.026+0000 7faa3f200640 1 --2- 172.21.15.99:0/3523158323 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7faa1809edf0 0x7faa180a12b0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:53.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.026+0000 7faa3f200640 1 --2- 172.21.15.99:0/3523158323 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa381865c0 0x7faa3816b090 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:53.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.026+0000 7faa3f200640 1 --2- 172.21.15.99:0/3523158323 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faa381861e0 0x7faa3817ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:53.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.026+0000 7faa3f200640 1 --2- 172.21.15.99:0/3523158323 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa380d4300 0x7faa3808eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:53.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.026+0000 7faa3f200640 1 -- 172.21.15.99:0/3523158323 >> 172.21.15.99:0/3523158323 conn(0x7faa380d6ac0 msgr2=0x7faa380d02c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:53.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.026+0000 7faa3f200640 1 -- 172.21.15.99:0/3523158323 shutdown_connections 2024-02-21T23:01:53.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.026+0000 7faa3f200640 1 -- 172.21.15.99:0/3523158323 wait complete. 2024-02-21T23:01:53.033 INFO:teuthology.run_tasks:Running task kclient... 2024-02-21T23:01:53.048 INFO:tasks.kclient:Mounting kernel clients... 2024-02-21T23:01:53.048 INFO:tasks.kclient:config is {'client.0': {}} 2024-02-21T23:01:53.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T23:01:53.049 DEBUG:teuthology.orchestra.run.smithi099:> ip netns list 2024-02-21T23:01:53.089 INFO:teuthology.orchestra.run.smithi099.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-02-21T23:01:53.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T23:01:53.091 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-02-21T23:01:53.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T23:01:53.214 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link delete ceph-brx 2024-02-21T23:01:53.325 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=legacy', 'nowsync'], 'syntax': 'v1', 'mount_subvol_num': 1} 2024-02-21T23:01:53.325 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-02-21T23:01:53.325 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-02-21T23:01:53.325 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-02-21T23:01:53.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.542+0000 7feeb9400640 1 Processor -- start 2024-02-21T23:01:53.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.542+0000 7feeb9400640 1 -- start start 2024-02-21T23:01:53.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.544+0000 7feeb9400640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7feeb417f9c0 0x7feeb40f8000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:53.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.544+0000 7feeb9400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7feeb40f8540 0x7feeb4184390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:53.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.544+0000 7feeb9400640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeb4183920 con 0x7feeb41848d0 2024-02-21T23:01:53.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.544+0000 7feeb9400640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feeb41868f0 con 0x7feeb40f8540 2024-02-21T23:01:53.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.544+0000 7feeb9400640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feeb417fda0 con 0x7feeb417f9c0 2024-02-21T23:01:53.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.544+0000 7feeb1e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7feeb40f8540 0x7feeb4184390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:53.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.544+0000 7feeb2800640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7feeb417f9c0 0x7feeb40f8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:53.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.544+0000 7feeb3200640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7feeb41848d0 0x7feeb406e310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:53282/0 (socket says 172.21.15.99:53282) 2024-02-21T23:01:53.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.544+0000 7feeb3200640 1 -- 172.21.15.99:0/820840540 learned_addr learned my addr 172.21.15.99:0/820840540 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:01:53.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.544+0000 7feeb2800640 1 -- 172.21.15.99:0/820840540 >> v2:172.21.15.99:3300/0 conn(0x7feeb40f8540 msgr2=0x7feeb4184390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:53.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.544+0000 7feeb2800640 1 --2- 172.21.15.99:0/820840540 >> v2:172.21.15.99:3300/0 conn(0x7feeb40f8540 0x7feeb4184390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:53.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.544+0000 7feeb2800640 1 -- 172.21.15.99:0/820840540 >> v1:172.21.15.181:6789/0 conn(0x7feeb41848d0 legacy=0x7feeb406e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:53.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.544+0000 7feeb1400640 1 -- 172.21.15.99:0/820840540 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4024136851 0 0) 0x7feeb4183920 con 0x7feeb41848d0 2024-02-21T23:01:53.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.544+0000 7feeb2800640 1 -- 172.21.15.99:0/820840540 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb40f8ab0 con 0x7feeb417f9c0 2024-02-21T23:01:53.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.546+0000 7feeb2800640 1 --2- 172.21.15.99:0/820840540 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feeb417f9c0 0x7feeb40f8000 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7feeb4067e20 tx=0x7feea402b7c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee4afe3ac1c932f9 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:53.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.546+0000 7feeb1400640 1 -- 172.21.15.99:0/820840540 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea4038070 con 0x7feeb417f9c0 2024-02-21T23:01:53.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.546+0000 7feeb1400640 1 -- 172.21.15.99:0/820840540 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feea4031520 con 0x7feeb417f9c0 2024-02-21T23:01:53.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.546+0000 7feeb1400640 1 -- 172.21.15.99:0/820840540 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea40318f0 con 0x7feeb417f9c0 2024-02-21T23:01:53.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.547+0000 7feeb9400640 1 -- 172.21.15.99:0/820840540 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feeb417f9c0 msgr2=0x7feeb40f8000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:53.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.547+0000 7feeb9400640 1 --2- 172.21.15.99:0/820840540 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feeb417f9c0 0x7feeb40f8000 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7feeb4067e20 tx=0x7feea402b7c0 comp rx=0 tx=0).stop 2024-02-21T23:01:53.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.547+0000 7feeb9400640 1 -- 172.21.15.99:0/820840540 shutdown_connections 2024-02-21T23:01:53.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.547+0000 7feeb9400640 1 --2- 172.21.15.99:0/820840540 >> v2:172.21.15.99:3300/0 conn(0x7feeb40f8540 0x7feeb4184390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:53.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.547+0000 7feeb9400640 1 --2- 172.21.15.99:0/820840540 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feeb417f9c0 0x7feeb40f8000 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:53.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.547+0000 7feeb9400640 1 -- 172.21.15.99:0/820840540 >> 172.21.15.99:0/820840540 conn(0x7feeb40ce5d0 msgr2=0x7feeb40ce9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:53.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.547+0000 7feeb9400640 1 -- 172.21.15.99:0/820840540 shutdown_connections 2024-02-21T23:01:53.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.547+0000 7feeb9400640 1 -- 172.21.15.99:0/820840540 wait complete. 2024-02-21T23:01:53.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.550+0000 7feeb9400640 1 Processor -- start 2024-02-21T23:01:53.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.550+0000 7feeb9400640 1 -- start start 2024-02-21T23:01:53.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.552+0000 7feeb9400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feeb40f8540 0x7feeb4188190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:53.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.552+0000 7feeb9400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feeb417f9c0 0x7feeb41886d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:53.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.552+0000 7feeb9400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feeb41848d0 0x7feeb416c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:53.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.552+0000 7feeb9400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb4183e70 con 0x7feeb40f8540 2024-02-21T23:01:53.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.552+0000 7feeb9400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb4183b90 con 0x7feeb417f9c0 2024-02-21T23:01:53.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.552+0000 7feeb9400640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb40f5df0 con 0x7feeb41848d0 2024-02-21T23:01:53.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.553+0000 7feeb2800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feeb40f8540 0x7feeb4188190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:53.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.553+0000 7feeb2800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feeb40f8540 0x7feeb4188190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54622/0 (socket says 172.21.15.99:54622) 2024-02-21T23:01:53.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.553+0000 7feeb2800640 1 -- 172.21.15.99:0/399935366 learned_addr learned my addr 172.21.15.99:0/399935366 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:53.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.553+0000 7feeb3200640 1 --2- 172.21.15.99:0/399935366 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feeb41848d0 0x7feeb416c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:53.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.553+0000 7feeb1e00640 1 --2- 172.21.15.99:0/399935366 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feeb417f9c0 0x7feeb41886d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:53.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.554+0000 7feeb2800640 1 -- 172.21.15.99:0/399935366 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feeb41848d0 msgr2=0x7feeb416c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:53.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.554+0000 7feeb2800640 1 --2- 172.21.15.99:0/399935366 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feeb41848d0 0x7feeb416c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:53.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.554+0000 7feeb2800640 1 -- 172.21.15.99:0/399935366 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feeb417f9c0 msgr2=0x7feeb41886d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:53.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.554+0000 7feeb2800640 1 --2- 172.21.15.99:0/399935366 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feeb417f9c0 0x7feeb41886d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:53.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.554+0000 7feeb2800640 1 -- 172.21.15.99:0/399935366 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb4188c10 con 0x7feeb40f8540 2024-02-21T23:01:53.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.554+0000 7feeb1e00640 1 --2- 172.21.15.99:0/399935366 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feeb417f9c0 0x7feeb41886d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:01:53.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.554+0000 7feeb3200640 1 --2- 172.21.15.99:0/399935366 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feeb41848d0 0x7feeb416c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:01:53.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.555+0000 7feeb2800640 1 --2- 172.21.15.99:0/399935366 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feeb40f8540 0x7feeb4188190 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7feea4000c00 tx=0x7feea40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:53.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.555+0000 7feeaaa00640 1 -- 172.21.15.99:0/399935366 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea4043070 con 0x7feeb40f8540 2024-02-21T23:01:53.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.555+0000 7feeaaa00640 1 -- 172.21.15.99:0/399935366 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feea403f890 con 0x7feeb40f8540 2024-02-21T23:01:53.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.555+0000 7feeb9400640 1 -- 172.21.15.99:0/399935366 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feeb4210f50 con 0x7feeb40f8540 2024-02-21T23:01:53.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.555+0000 7feeaaa00640 1 -- 172.21.15.99:0/399935366 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea4038040 con 0x7feeb40f8540 2024-02-21T23:01:53.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.555+0000 7feeb9400640 1 -- 172.21.15.99:0/399935366 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeb4211510 con 0x7feeb40f8540 2024-02-21T23:01:53.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.556+0000 7feeb9400640 1 -- 172.21.15.99:0/399935366 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feeb4068390 con 0x7feeb40f8540 2024-02-21T23:01:53.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.560+0000 7feeaaa00640 1 -- 172.21.15.99:0/399935366 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 6) v1 ==== 134407+0+0 (secure 0 0 0) 0x7feea4046070 con 0x7feeb40f8540 2024-02-21T23:01:53.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.563+0000 7feeaaa00640 1 --2- 172.21.15.99:0/399935366 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fee9409ee20 0x7fee940a12e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:53.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.563+0000 7feeaaa00640 1 -- 172.21.15.99:0/399935366 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7feea40ebbf0 con 0x7feeb40f8540 2024-02-21T23:01:53.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.563+0000 7feeb1e00640 1 --2- 172.21.15.99:0/399935366 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fee9409ee20 0x7fee940a12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:53.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.563+0000 7feeaaa00640 1 -- 172.21.15.99:0/399935366 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7feea40b9620 con 0x7feeb40f8540 2024-02-21T23:01:53.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.563+0000 7feeb1e00640 1 --2- 172.21.15.99:0/399935366 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fee9409ee20 0x7fee940a12e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7feeb4175a20 tx=0x7feea000b3a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:53.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.900+0000 7feeb9400640 1 -- 172.21.15.99:0/399935366 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7feeb417dbe0 con 0x7feeb40f8540 2024-02-21T23:01:53.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.900+0000 7feeaaa00640 1 -- 172.21.15.99:0/399935366 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) v1 ==== 53+0+88 (secure 0 0 0) 0x7feea40bd6c0 con 0x7feeb40f8540 2024-02-21T23:01:53.890 INFO:teuthology.orchestra.run.smithi099.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-02-21T23:01:53.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.903+0000 7feeb9400640 1 -- 172.21.15.99:0/399935366 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fee9409ee20 msgr2=0x7fee940a12e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:53.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.903+0000 7feeb9400640 1 --2- 172.21.15.99:0/399935366 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fee9409ee20 0x7fee940a12e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7feeb4175a20 tx=0x7feea000b3a0 comp rx=0 tx=0).stop 2024-02-21T23:01:53.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.903+0000 7feeb9400640 1 -- 172.21.15.99:0/399935366 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feeb40f8540 msgr2=0x7feeb4188190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:53.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.903+0000 7feeb9400640 1 --2- 172.21.15.99:0/399935366 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feeb40f8540 0x7feeb4188190 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7feea4000c00 tx=0x7feea40046c0 comp rx=0 tx=0).stop 2024-02-21T23:01:53.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.903+0000 7feeb9400640 1 -- 172.21.15.99:0/399935366 shutdown_connections 2024-02-21T23:01:53.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.903+0000 7feeb9400640 1 --2- 172.21.15.99:0/399935366 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fee9409ee20 0x7fee940a12e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:53.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.903+0000 7feeb9400640 1 --2- 172.21.15.99:0/399935366 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7feeb41848d0 0x7feeb416c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:53.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.903+0000 7feeb9400640 1 --2- 172.21.15.99:0/399935366 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feeb417f9c0 0x7feeb41886d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:53.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.903+0000 7feeb9400640 1 --2- 172.21.15.99:0/399935366 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7feeb40f8540 0x7feeb4188190 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:53.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.903+0000 7feeb9400640 1 -- 172.21.15.99:0/399935366 >> 172.21.15.99:0/399935366 conn(0x7feeb40ce5d0 msgr2=0x7feeb40f7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:53.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.904+0000 7feeb9400640 1 -- 172.21.15.99:0/399935366 shutdown_connections 2024-02-21T23:01:53.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:53.904+0000 7feeb9400640 1 -- 172.21.15.99:0/399935366 wait complete. 2024-02-21T23:01:53.909 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-02-21T23:01:53.909 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-02-21T23:01:53.910 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi099.front.sepia.ceph.com 2024-02-21T23:01:53.910 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-02-21T23:01:53.910 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-02-21T23:01:53.910 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-02-21T23:01:53.910 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-02-21T23:01:53.910 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-02-21T23:01:53.910 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-02-21T23:01:53.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T23:01:53.910 DEBUG:teuthology.orchestra.run.smithi099:> ip addr 2024-02-21T23:01:53.952 INFO:teuthology.orchestra.run.smithi099.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-21T23:01:53.952 INFO:teuthology.orchestra.run.smithi099.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-21T23:01:53.953 INFO:teuthology.orchestra.run.smithi099.stdout: inet 127.0.0.1/8 scope host lo 2024-02-21T23:01:53.953 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-02-21T23:01:53.953 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 ::1/128 scope host 2024-02-21T23:01:53.953 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-02-21T23:01:53.953 INFO:teuthology.orchestra.run.smithi099.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-21T23:01:53.953 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:d8:a2:10 brd ff:ff:ff:ff:ff:ff 2024-02-21T23:01:53.953 INFO:teuthology.orchestra.run.smithi099.stdout: altname enp7s0f0 2024-02-21T23:01:53.953 INFO:teuthology.orchestra.run.smithi099.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-21T23:01:53.953 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:d8:a2:11 brd ff:ff:ff:ff:ff:ff 2024-02-21T23:01:53.954 INFO:teuthology.orchestra.run.smithi099.stdout: altname enp7s0f1 2024-02-21T23:01:53.954 INFO:teuthology.orchestra.run.smithi099.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-21T23:01:53.954 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:8f:d8:02 brd ff:ff:ff:ff:ff:ff 2024-02-21T23:01:53.954 INFO:teuthology.orchestra.run.smithi099.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-02-21T23:01:53.954 INFO:teuthology.orchestra.run.smithi099.stdout: link/ether 0c:c4:7a:8f:d8:03 brd ff:ff:ff:ff:ff:ff 2024-02-21T23:01:53.954 INFO:teuthology.orchestra.run.smithi099.stdout: inet 172.21.15.99/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-02-21T23:01:53.954 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft 42543sec preferred_lft 42543sec 2024-02-21T23:01:53.954 INFO:teuthology.orchestra.run.smithi099.stdout: inet6 fe80::ec4:7aff:fe8f:d803/64 scope link 2024-02-21T23:01:53.954 INFO:teuthology.orchestra.run.smithi099.stdout: valid_lft forever preferred_lft forever 2024-02-21T23:01:53.955 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-02-21T23:01:53.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T23:01:53.955 DEBUG:teuthology.orchestra.run.smithi099:> (cd / && exec bash -c ' 2024-02-21T23:01:53.955 DEBUG:teuthology.orchestra.run.smithi099:> set -e 2024-02-21T23:01:53.955 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link add name ceph-brx type bridge 2024-02-21T23:01:53.955 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip addr flush dev ceph-brx 2024-02-21T23:01:53.955 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link set ceph-brx up 2024-02-21T23:01:53.955 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-02-21T23:01:53.956 DEBUG:teuthology.orchestra.run.smithi099:> ') 2024-02-21T23:01:54.209 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T23:01:54.209 DEBUG:teuthology.orchestra.run.smithi099:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-02-21T23:01:54.283 INFO:teuthology.orchestra.run.smithi099.stdout:1 2024-02-21T23:01:54.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T23:01:54.286 DEBUG:teuthology.orchestra.run.smithi099:> route 2024-02-21T23:01:54.323 INFO:teuthology.orchestra.run.smithi099.stdout:Kernel IP routing table 2024-02-21T23:01:54.323 INFO:teuthology.orchestra.run.smithi099.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-02-21T23:01:54.324 INFO:teuthology.orchestra.run.smithi099.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-02-21T23:01:54.324 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-02-21T23:01:54.324 INFO:teuthology.orchestra.run.smithi099.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-02-21T23:01:54.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T23:01:54.324 DEBUG:teuthology.orchestra.run.smithi099:> (cd / && exec bash -c ' 2024-02-21T23:01:54.324 DEBUG:teuthology.orchestra.run.smithi099:> set -e 2024-02-21T23:01:54.324 DEBUG:teuthology.orchestra.run.smithi099:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-02-21T23:01:54.324 DEBUG:teuthology.orchestra.run.smithi099:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-02-21T23:01:54.324 DEBUG:teuthology.orchestra.run.smithi099:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-02-21T23:01:54.324 DEBUG:teuthology.orchestra.run.smithi099:> ') 2024-02-21T23:01:54.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T23:01:54.533 DEBUG:teuthology.orchestra.run.smithi099:> ip netns list 2024-02-21T23:01:54.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T23:01:54.575 DEBUG:teuthology.orchestra.run.smithi099:> ip netns list-id 2024-02-21T23:01:54.657 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T23:01:54.657 DEBUG:teuthology.orchestra.run.smithi099:> (cd / && exec bash -c ' 2024-02-21T23:01:54.657 DEBUG:teuthology.orchestra.run.smithi099:> set -e 2024-02-21T23:01:54.657 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-21T23:01:54.657 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-02-21T23:01:54.657 DEBUG:teuthology.orchestra.run.smithi099:> ') 2024-02-21T23:01:54.812 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-02-21T23:01:54.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T23:01:54.812 DEBUG:teuthology.orchestra.run.smithi099:> (cd / && exec bash -c ' 2024-02-21T23:01:54.812 DEBUG:teuthology.orchestra.run.smithi099:> set -e 2024-02-21T23:01:54.812 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-02-21T23:01:54.813 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-02-21T23:01:54.813 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-02-21T23:01:54.813 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-02-21T23:01:54.813 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-02-21T23:01:54.813 DEBUG:teuthology.orchestra.run.smithi099:> ') 2024-02-21T23:01:55.086 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T23:01:55.086 DEBUG:teuthology.orchestra.run.smithi099:> (cd / && exec bash -c ' 2024-02-21T23:01:55.086 DEBUG:teuthology.orchestra.run.smithi099:> set -e 2024-02-21T23:01:55.086 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link set brx.0 up 2024-02-21T23:01:55.086 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link set dev brx.0 master ceph-brx 2024-02-21T23:01:55.086 DEBUG:teuthology.orchestra.run.smithi099:> ') 2024-02-21T23:01:55.231 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-21T23:01:55.231 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-02-21T23:01:55.277 INFO:teuthology.orchestra.run.smithi099.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-02-21T23:01:55.277 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-21T23:01:55.277 DEBUG:teuthology.orchestra.run.smithi099:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-02-21T23:01:55.359 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-02-21T23:01:55.359 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-02-21T23:01:55.359 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/qa/sv_1/dff04ef9-9382-46fe-8a52-35eae211921b 2024-02-21T23:01:55.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T23:01:55.359 DEBUG:teuthology.orchestra.run.smithi099:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/qa/sv_1/dff04ef9-9382-46fe-8a52-35eae211921b /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync 2024-02-21T23:01:55.533 INFO:teuthology.orchestra.run.smithi099.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync 2024-02-21T23:01:55.534 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync". 2024-02-21T23:01:55.534 INFO:teuthology.orchestra.run.smithi099.stdout:invalid new device string format 2024-02-21T23:01:56.136 INFO:teuthology.orchestra.run.smithi099.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync 2024-02-21T23:01:56.136 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync". 2024-02-21T23:01:56.136 INFO:teuthology.orchestra.run.smithi099.stdout:invalid new device string format 2024-02-21T23:01:56.137 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: resolved to: "172.21.15.99:6789,172.21.15.162:6789,172.21.15.181:6789" 2024-02-21T23:01:56.137 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.99:6789,172.21.15.162:6789,172.21.15.181:6789:/volumes/qa/sv_1/dff04ef9-9382-46fe-8a52-35eae211921b 2024-02-21T23:01:56.137 INFO:teuthology.orchestra.run.smithi099.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync,key=0,fsid=e8af98cd-45a1-425f-96a7-f24da8ee4efb" will pass to kernel 2024-02-21T23:01:56.140 INFO:teuthology.orchestra.run.smithi099.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-02-21T23:01:56.140 INFO:teuthology.orchestra.run.smithi099.stdout: You just mounted a file system that supports labels which does not 2024-02-21T23:01:56.140 INFO:teuthology.orchestra.run.smithi099.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-02-21T23:01:56.140 INFO:teuthology.orchestra.run.smithi099.stdout: applications will generate AVC messages and not be allowed access to 2024-02-21T23:01:56.140 INFO:teuthology.orchestra.run.smithi099.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-02-21T23:01:56.143 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-02-21T23:01:56.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T23:01:56.144 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-02-21T23:01:56.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T23:01:56.225 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-21T23:01:56.277 INFO:teuthology.orchestra.run.smithi099.stdout:client4863 2024-02-21T23:01:56.277 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-02-21T23:01:56.277 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-21T23:01:56.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T23:01:56.315 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-21T23:01:56.409 INFO:teuthology.orchestra.run.smithi099.stdout:client4863 2024-02-21T23:01:56.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T23:01:56.410 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-21T23:01:56.465 INFO:teuthology.orchestra.run.smithi099.stdout:client4863 2024-02-21T23:01:56.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T23:01:56.465 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/e8af98cd-45a1-425f-96a7-f24da8ee4efb.client4863/status') 2024-02-21T23:01:56.543 INFO:teuthology.orchestra.run.smithi099.stdout:instance: client.4863 (3)192.168.0.1:0/1282968718 2024-02-21T23:01:56.543 INFO:teuthology.orchestra.run.smithi099.stdout:blocklisted: false 2024-02-21T23:01:56.544 INFO:teuthology.orchestra.run.smithi099.stderr:0+1 records in 2024-02-21T23:01:56.544 INFO:teuthology.orchestra.run.smithi099.stderr:0+1 records out 2024-02-21T23:01:56.544 INFO:teuthology.orchestra.run.smithi099.stderr:69 bytes copied, 9.6938e-05 s, 712 kB/s 2024-02-21T23:01:56.549 INFO:teuthology.run_tasks:Running task exec... 2024-02-21T23:01:56.564 INFO:teuthology.task.exec:Executing custom commands... 2024-02-21T23:01:56.565 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi099.front.sepia.ceph.com 2024-02-21T23:01:56.565 DEBUG:teuthology.orchestra.run.smithi099:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate false' 2024-02-21T23:01:56.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:56.799+0000 7faac2600640 1 Processor -- start 2024-02-21T23:01:56.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:56.800+0000 7faac2600640 1 -- start start 2024-02-21T23:01:56.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:56.802+0000 7faac2600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7faabc183b30 0x7faabc066e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:56.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:56.802+0000 7faac2600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7faabc0cfff0 0x7faabc0d03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:56.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:56.802+0000 7faac2600640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faabc0d09f0 con 0x7faabc183f10 2024-02-21T23:01:56.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:56.802+0000 7faac2600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faabc1843c0 con 0x7faabc0cfff0 2024-02-21T23:01:56.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:56.802+0000 7faac2600640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faabc0d0cd0 con 0x7faabc183b30 2024-02-21T23:01:56.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:56.803+0000 7faac1200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7faabc183b30 0x7faabc066e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:56.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:56.803+0000 7faabbe00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7faabc183f10 0x7faabc0706b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:57448/0 (socket says 172.21.15.99:57448) 2024-02-21T23:01:56.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:56.803+0000 7faabbe00640 1 -- 172.21.15.99:0/892813152 learned_addr learned my addr 172.21.15.99:0/892813152 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:01:56.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:56.803+0000 7faac1c00640 1 --2- 172.21.15.99:0/892813152 >> v2:172.21.15.99:3300/0 conn(0x7faabc0cfff0 0x7faabc0d03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:56.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:56.803+0000 7faac1200640 1 -- 172.21.15.99:0/892813152 >> v2:172.21.15.99:3300/0 conn(0x7faabc0cfff0 msgr2=0x7faabc0d03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:56.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:56.803+0000 7faac1200640 1 --2- 172.21.15.99:0/892813152 >> v2:172.21.15.99:3300/0 conn(0x7faabc0cfff0 0x7faabc0d03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:56.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:56.803+0000 7faac1200640 1 -- 172.21.15.99:0/892813152 >> v1:172.21.15.99:6789/0 conn(0x7faabc183f10 legacy=0x7faabc0706b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:56.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:56.803+0000 7faac1200640 1 -- 172.21.15.99:0/892813152 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faabc0d0fb0 con 0x7faabc183b30 2024-02-21T23:01:56.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:56.805+0000 7faac1200640 1 --2- 172.21.15.99:0/892813152 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faabc183b30 0x7faabc066e30 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7faabc08df50 tx=0x7faab002b600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fee01962d9c8d731 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:56.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:56.805+0000 7faabb400640 1 -- 172.21.15.99:0/892813152 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab0037070 con 0x7faabc183b30 2024-02-21T23:01:56.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:56.805+0000 7faabb400640 1 -- 172.21.15.99:0/892813152 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faab0030510 con 0x7faabc183b30 2024-02-21T23:01:56.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:56.805+0000 7faabb400640 1 -- 172.21.15.99:0/892813152 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab00308e0 con 0x7faabc183b30 2024-02-21T23:01:56.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:56.806+0000 7faac2600640 1 -- 172.21.15.99:0/892813152 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faabc183b30 msgr2=0x7faabc066e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:56.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:56.806+0000 7faac2600640 1 --2- 172.21.15.99:0/892813152 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faabc183b30 0x7faabc066e30 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7faabc08df50 tx=0x7faab002b600 comp rx=0 tx=0).stop 2024-02-21T23:01:56.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:56.806+0000 7faac2600640 1 -- 172.21.15.99:0/892813152 shutdown_connections 2024-02-21T23:01:56.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:56.806+0000 7faac2600640 1 --2- 172.21.15.99:0/892813152 >> v2:172.21.15.99:3300/0 conn(0x7faabc0cfff0 0x7faabc0d03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:56.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:56.806+0000 7faac2600640 1 --2- 172.21.15.99:0/892813152 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faabc183b30 0x7faabc066e30 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:56.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:56.806+0000 7faac2600640 1 -- 172.21.15.99:0/892813152 >> 172.21.15.99:0/892813152 conn(0x7faabc0cec70 msgr2=0x7faabc0cf080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:56.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:56.806+0000 7faac2600640 1 -- 172.21.15.99:0/892813152 shutdown_connections 2024-02-21T23:01:56.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:56.806+0000 7faac2600640 1 -- 172.21.15.99:0/892813152 wait complete. 2024-02-21T23:01:56.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:56.808+0000 7faac2600640 1 Processor -- start 2024-02-21T23:01:56.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:56.808+0000 7faac2600640 1 -- start start 2024-02-21T23:01:56.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:56.810+0000 7faac2600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faabc0cfff0 0x7faabc16c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:56.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:56.810+0000 7faac2600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faabc183b30 0x7faabc0cab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:56.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:56.811+0000 7faac2600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faabc183f10 0x7faabc1886c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:56.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:56.811+0000 7faac2600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faabc187e10 con 0x7faabc183b30 2024-02-21T23:01:56.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:56.811+0000 7faac2600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faabc0d1570 con 0x7faabc183f10 2024-02-21T23:01:56.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:56.811+0000 7faac2600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faabc1880f0 con 0x7faabc0cfff0 2024-02-21T23:01:56.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:56.811+0000 7faabbe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faabc183b30 0x7faabc0cab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:56.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:56.811+0000 7faac1200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faabc0cfff0 0x7faabc16c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:56.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:56.811+0000 7faabbe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faabc183b30 0x7faabc0cab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54632/0 (socket says 172.21.15.99:54632) 2024-02-21T23:01:56.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:56.811+0000 7faabbe00640 1 -- 172.21.15.99:0/3910288461 learned_addr learned my addr 172.21.15.99:0/3910288461 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:56.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:56.811+0000 7faac1c00640 1 --2- 172.21.15.99:0/3910288461 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faabc183f10 0x7faabc1886c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:56.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:56.811+0000 7faac1200640 1 -- 172.21.15.99:0/3910288461 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faabc183f10 msgr2=0x7faabc1886c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:56.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:56.811+0000 7faac1200640 1 --2- 172.21.15.99:0/3910288461 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faabc183f10 0x7faabc1886c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:56.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:56.811+0000 7faac1200640 1 -- 172.21.15.99:0/3910288461 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faabc183b30 msgr2=0x7faabc0cab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:56.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:56.811+0000 7faac1200640 1 --2- 172.21.15.99:0/3910288461 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faabc183b30 0x7faabc0cab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:56.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:56.811+0000 7faac1200640 1 -- 172.21.15.99:0/3910288461 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faabc0cb5c0 con 0x7faabc0cfff0 2024-02-21T23:01:56.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:56.811+0000 7faabbe00640 1 --2- 172.21.15.99:0/3910288461 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faabc183b30 0x7faabc0cab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:01:56.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:56.812+0000 7faac1200640 1 --2- 172.21.15.99:0/3910288461 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faabc0cfff0 0x7faabc16c920 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7faabc0d0e50 tx=0x7faab00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:56.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:56.812+0000 7faab8c00640 1 -- 172.21.15.99:0/3910288461 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab0041030 con 0x7faabc0cfff0 2024-02-21T23:01:56.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:56.812+0000 7faab8c00640 1 -- 172.21.15.99:0/3910288461 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faab003c460 con 0x7faabc0cfff0 2024-02-21T23:01:56.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:56.812+0000 7faab8c00640 1 -- 172.21.15.99:0/3910288461 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab0037040 con 0x7faabc0cfff0 2024-02-21T23:01:56.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:56.812+0000 7faac2600640 1 -- 172.21.15.99:0/3910288461 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faabc0cb8a0 con 0x7faabc0cfff0 2024-02-21T23:01:56.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:56.812+0000 7faac2600640 1 -- 172.21.15.99:0/3910288461 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faabc0cbe60 con 0x7faabc0cfff0 2024-02-21T23:01:56.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:56.814+0000 7faaae000640 1 -- 172.21.15.99:0/3910288461 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faabc0758b0 con 0x7faabc0cfff0 2024-02-21T23:01:56.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:56.817+0000 7faab8c00640 1 -- 172.21.15.99:0/3910288461 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 6) v1 ==== 134407+0+0 (secure 0 0 0) 0x7faab0044070 con 0x7faabc0cfff0 2024-02-21T23:01:56.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:56.819+0000 7faab8c00640 1 --2- 172.21.15.99:0/3910288461 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7faa9c09edf0 0x7faa9c0a12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:56.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:56.819+0000 7faab8c00640 1 -- 172.21.15.99:0/3910288461 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7faab00eb400 con 0x7faabc0cfff0 2024-02-21T23:01:56.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:56.819+0000 7faabbe00640 1 --2- 172.21.15.99:0/3910288461 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7faa9c09edf0 0x7faa9c0a12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:56.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:56.820+0000 7faabbe00640 1 --2- 172.21.15.99:0/3910288461 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7faa9c09edf0 0x7faa9c0a12b0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7faabc184800 tx=0x7faaa8000bc0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:56.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:56.822+0000 7faab8c00640 1 -- 172.21.15.99:0/3910288461 <== mon.2 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7faab00b94e0 con 0x7faabc0cfff0 2024-02-21T23:01:57.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:57.189+0000 7faaae000640 1 -- 172.21.15.99:0/3910288461 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} v 0) v1 -- 0x7faabc0f9120 con 0x7faabc0cfff0 2024-02-21T23:01:57.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:57.490+0000 7faab8c00640 1 -- 172.21.15.99:0/3910288461 <== mon.2 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7faab00b8de0 con 0x7faabc0cfff0 2024-02-21T23:01:57.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:57.494+0000 7faaae000640 1 -- 172.21.15.99:0/3910288461 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7faa9c09edf0 msgr2=0x7faa9c0a12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:57.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:57.494+0000 7faaae000640 1 --2- 172.21.15.99:0/3910288461 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7faa9c09edf0 0x7faa9c0a12b0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7faabc184800 tx=0x7faaa8000bc0 comp rx=0 tx=0).stop 2024-02-21T23:01:57.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:57.494+0000 7faaae000640 1 -- 172.21.15.99:0/3910288461 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faabc0cfff0 msgr2=0x7faabc16c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:57.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:57.494+0000 7faaae000640 1 --2- 172.21.15.99:0/3910288461 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faabc0cfff0 0x7faabc16c920 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7faabc0d0e50 tx=0x7faab00046c0 comp rx=0 tx=0).stop 2024-02-21T23:01:57.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:57.494+0000 7faaae000640 1 -- 172.21.15.99:0/3910288461 shutdown_connections 2024-02-21T23:01:57.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:57.494+0000 7faaae000640 1 --2- 172.21.15.99:0/3910288461 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7faa9c09edf0 0x7faa9c0a12b0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:57.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:57.494+0000 7faaae000640 1 --2- 172.21.15.99:0/3910288461 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faabc183f10 0x7faabc1886c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:57.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:57.494+0000 7faaae000640 1 --2- 172.21.15.99:0/3910288461 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faabc183b30 0x7faabc0cab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:57.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:57.494+0000 7faaae000640 1 --2- 172.21.15.99:0/3910288461 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faabc0cfff0 0x7faabc16c920 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:57.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:57.494+0000 7faaae000640 1 -- 172.21.15.99:0/3910288461 >> 172.21.15.99:0/3910288461 conn(0x7faabc0cec70 msgr2=0x7faabc0cf050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:57.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:57.494+0000 7faaae000640 1 -- 172.21.15.99:0/3910288461 shutdown_connections 2024-02-21T23:01:57.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:57.494+0000 7faaae000640 1 -- 172.21.15.99:0/3910288461 wait complete. 2024-02-21T23:01:57.503 DEBUG:teuthology.orchestra.run.smithi099:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs subvolumegroup pin cephfs qa random 0.10' 2024-02-21T23:01:57.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:57.722+0000 7fd27ae00640 1 Processor -- start 2024-02-21T23:01:57.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:57.722+0000 7fd27ae00640 1 -- start start 2024-02-21T23:01:57.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:57.723+0000 7fd27ae00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd27417f280 0x7fd2740fc370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:57.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:57.723+0000 7fd27ae00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2740fc8b0 con 0x7fd274187280 2024-02-21T23:01:57.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:57.723+0000 7fd27ae00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2740fcb80 con 0x7fd27417f660 2024-02-21T23:01:57.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:57.724+0000 7fd27ae00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2740fce60 con 0x7fd27417f280 2024-02-21T23:01:57.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:57.724+0000 7fd27a400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fd274187280 0x7fd2740fe650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:36392/0 (socket says 172.21.15.99:36392) 2024-02-21T23:01:57.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:57.724+0000 7fd279a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fd27417f280 0x7fd2740fc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:57.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:57.724+0000 7fd279000640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fd27417f660 0x7fd274186b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:47016/0 (socket says 172.21.15.99:47016) 2024-02-21T23:01:57.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:57.724+0000 7fd27a400640 1 -- 172.21.15.99:0/4210279686 learned_addr learned my addr 172.21.15.99:0/4210279686 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:01:57.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:57.724+0000 7fd273e00640 1 -- 172.21.15.99:0/4210279686 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3136781008 0 0) 0x7fd2740fcb80 con 0x7fd27417f660 2024-02-21T23:01:57.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:57.724+0000 7fd273e00640 1 -- 172.21.15.99:0/4210279686 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd25c003520 con 0x7fd27417f660 2024-02-21T23:01:57.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:57.724+0000 7fd273e00640 1 -- 172.21.15.99:0/4210279686 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 71639435 0 0) 0x7fd2740fc8b0 con 0x7fd274187280 2024-02-21T23:01:57.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:57.724+0000 7fd279a00640 1 -- 172.21.15.99:0/4210279686 >> v1:172.21.15.181:6789/0 conn(0x7fd27417f660 legacy=0x7fd274186b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:57.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:57.724+0000 7fd279a00640 1 -- 172.21.15.99:0/4210279686 >> v1:172.21.15.99:6789/0 conn(0x7fd274187280 legacy=0x7fd2740fe650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:57.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:57.725+0000 7fd279a00640 1 -- 172.21.15.99:0/4210279686 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2740fd140 con 0x7fd27417f280 2024-02-21T23:01:57.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:57.726+0000 7fd279a00640 1 --2- 172.21.15.99:0/4210279686 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd27417f280 0x7fd2740fc370 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd2680097a0 tx=0x7fd26802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=430e47a030c8dfa1 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:57.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:57.726+0000 7fd273e00640 1 -- 172.21.15.99:0/4210279686 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd268034070 con 0x7fd27417f280 2024-02-21T23:01:57.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:57.726+0000 7fd273e00640 1 -- 172.21.15.99:0/4210279686 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd268030610 con 0x7fd27417f280 2024-02-21T23:01:57.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:57.726+0000 7fd273e00640 1 -- 172.21.15.99:0/4210279686 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2680309e0 con 0x7fd27417f280 2024-02-21T23:01:57.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:57.727+0000 7fd27ae00640 1 -- 172.21.15.99:0/4210279686 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd27417f280 msgr2=0x7fd2740fc370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:57.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:57.727+0000 7fd27ae00640 1 --2- 172.21.15.99:0/4210279686 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd27417f280 0x7fd2740fc370 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd2680097a0 tx=0x7fd26802b960 comp rx=0 tx=0).stop 2024-02-21T23:01:57.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:57.727+0000 7fd27ae00640 1 -- 172.21.15.99:0/4210279686 shutdown_connections 2024-02-21T23:01:57.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:57.727+0000 7fd27ae00640 1 --2- 172.21.15.99:0/4210279686 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd27417f280 0x7fd2740fc370 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:57.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:57.727+0000 7fd27ae00640 1 -- 172.21.15.99:0/4210279686 >> 172.21.15.99:0/4210279686 conn(0x7fd27408cfa0 msgr2=0x7fd27408d380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:57.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:57.727+0000 7fd27ae00640 1 -- 172.21.15.99:0/4210279686 shutdown_connections 2024-02-21T23:01:57.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:57.727+0000 7fd27ae00640 1 -- 172.21.15.99:0/4210279686 wait complete. 2024-02-21T23:01:57.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:57.729+0000 7fd27ae00640 1 Processor -- start 2024-02-21T23:01:57.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:57.729+0000 7fd27ae00640 1 -- start start 2024-02-21T23:01:57.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:57.730+0000 7fd27ae00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd27417f280 0x7fd27416dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:57.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:57.730+0000 7fd27ae00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd27417f660 0x7fd2741700b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:57.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:57.730+0000 7fd27ae00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd274187280 0x7fd2741705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:57.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:57.730+0000 7fd27ae00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2741876f0 con 0x7fd27417f280 2024-02-21T23:01:57.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:57.730+0000 7fd27ae00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2740fd700 con 0x7fd274187280 2024-02-21T23:01:57.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:57.730+0000 7fd27ae00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2740fed60 con 0x7fd27417f660 2024-02-21T23:01:57.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:57.730+0000 7fd279a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd27417f280 0x7fd27416dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:57.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:57.730+0000 7fd279a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd27417f280 0x7fd27416dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50092/0 (socket says 172.21.15.99:50092) 2024-02-21T23:01:57.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:57.730+0000 7fd279a00640 1 -- 172.21.15.99:0/3015963326 learned_addr learned my addr 172.21.15.99:0/3015963326 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:57.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:57.731+0000 7fd279000640 1 --2- 172.21.15.99:0/3015963326 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd27417f660 0x7fd2741700b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:57.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:57.731+0000 7fd27a400640 1 --2- 172.21.15.99:0/3015963326 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd274187280 0x7fd2741705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:57.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:57.731+0000 7fd279a00640 1 -- 172.21.15.99:0/3015963326 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd27417f660 msgr2=0x7fd2741700b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:57.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:57.731+0000 7fd279a00640 1 --2- 172.21.15.99:0/3015963326 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd27417f660 0x7fd2741700b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:57.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:57.731+0000 7fd279a00640 1 -- 172.21.15.99:0/3015963326 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd274187280 msgr2=0x7fd2741705f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:57.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:57.731+0000 7fd279a00640 1 --2- 172.21.15.99:0/3015963326 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd274187280 0x7fd2741705f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:57.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:57.731+0000 7fd279a00640 1 -- 172.21.15.99:0/3015963326 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd27421fc50 con 0x7fd27417f280 2024-02-21T23:01:57.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:57.731+0000 7fd279a00640 1 --2- 172.21.15.99:0/3015963326 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd27417f280 0x7fd27416dd70 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd26802bf70 tx=0x7fd2680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:57.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:57.732+0000 7fd271600640 1 -- 172.21.15.99:0/3015963326 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd268049070 con 0x7fd27417f280 2024-02-21T23:01:57.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:57.732+0000 7fd271600640 1 -- 172.21.15.99:0/3015963326 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd268030410 con 0x7fd27417f280 2024-02-21T23:01:57.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:57.732+0000 7fd27ae00640 1 -- 172.21.15.99:0/3015963326 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd27421ff30 con 0x7fd27417f280 2024-02-21T23:01:57.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:57.732+0000 7fd271600640 1 -- 172.21.15.99:0/3015963326 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd268034040 con 0x7fd27417f280 2024-02-21T23:01:57.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:57.732+0000 7fd27ae00640 1 -- 172.21.15.99:0/3015963326 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2742204f0 con 0x7fd27417f280 2024-02-21T23:01:57.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:57.733+0000 7fd27ae00640 1 -- 172.21.15.99:0/3015963326 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd274069440 con 0x7fd27417f280 2024-02-21T23:01:57.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:57.736+0000 7fd271600640 1 -- 172.21.15.99:0/3015963326 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 6) v1 ==== 134407+0+0 (secure 0 0 0) 0x7fd26804c070 con 0x7fd27417f280 2024-02-21T23:01:57.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:57.737+0000 7fd271600640 1 --2- 172.21.15.99:0/3015963326 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fd25409edf0 0x7fd2540a12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:57.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:57.738+0000 7fd271600640 1 -- 172.21.15.99:0/3015963326 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fd2680eb920 con 0x7fd27417f280 2024-02-21T23:01:57.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:57.738+0000 7fd279000640 1 --2- 172.21.15.99:0/3015963326 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fd25409edf0 0x7fd2540a12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:57.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:57.739+0000 7fd279000640 1 --2- 172.21.15.99:0/3015963326 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fd25409edf0 0x7fd2540a12b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd27417e130 tx=0x7fd260007d30 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:57.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:57.742+0000 7fd271600640 1 -- 172.21.15.99:0/3015963326 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fd26807fdc0 con 0x7fd27417f280 2024-02-21T23:01:57.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.005+0000 7fd27ae00640 1 -- 172.21.15.99:0/3015963326 --> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}) v1 -- 0x7fd27417de80 con 0x7fd25409edf0 2024-02-21T23:01:58.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.011+0000 7fd271600640 1 -- 172.21.15.99:0/3015963326 <== mgr.4106 v2:172.21.15.162:6800/1717094936 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3 (secure 0 0 0) 0x7fd27417de80 con 0x7fd25409edf0 2024-02-21T23:01:58.000 INFO:teuthology.orchestra.run.smithi099.stdout:{} 2024-02-21T23:01:58.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.013+0000 7fd27ae00640 1 -- 172.21.15.99:0/3015963326 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fd25409edf0 msgr2=0x7fd2540a12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:58.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.013+0000 7fd27ae00640 1 --2- 172.21.15.99:0/3015963326 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fd25409edf0 0x7fd2540a12b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd27417e130 tx=0x7fd260007d30 comp rx=0 tx=0).stop 2024-02-21T23:01:58.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.013+0000 7fd27ae00640 1 -- 172.21.15.99:0/3015963326 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd27417f280 msgr2=0x7fd27416dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:58.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.013+0000 7fd27ae00640 1 --2- 172.21.15.99:0/3015963326 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd27417f280 0x7fd27416dd70 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd26802bf70 tx=0x7fd2680046c0 comp rx=0 tx=0).stop 2024-02-21T23:01:58.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.013+0000 7fd27ae00640 1 -- 172.21.15.99:0/3015963326 shutdown_connections 2024-02-21T23:01:58.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.013+0000 7fd27ae00640 1 --2- 172.21.15.99:0/3015963326 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fd25409edf0 0x7fd2540a12b0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:58.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.014+0000 7fd27ae00640 1 --2- 172.21.15.99:0/3015963326 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd274187280 0x7fd2741705f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:58.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.014+0000 7fd27ae00640 1 --2- 172.21.15.99:0/3015963326 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd27417f660 0x7fd2741700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:58.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.014+0000 7fd27ae00640 1 --2- 172.21.15.99:0/3015963326 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd27417f280 0x7fd27416dd70 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:58.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.014+0000 7fd27ae00640 1 -- 172.21.15.99:0/3015963326 >> 172.21.15.99:0/3015963326 conn(0x7fd27408cfa0 msgr2=0x7fd2740d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:58.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.014+0000 7fd27ae00640 1 -- 172.21.15.99:0/3015963326 shutdown_connections 2024-02-21T23:01:58.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.014+0000 7fd27ae00640 1 -- 172.21.15.99:0/3015963326 wait complete. 2024-02-21T23:01:58.021 INFO:teuthology.run_tasks:Running task check-counter... 2024-02-21T23:01:58.031 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-02-21T23:01:58.073 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T23:01:58.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.338+0000 7f8a7ca00640 1 Processor -- start 2024-02-21T23:01:58.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.338+0000 7f8a7ca00640 1 -- start start 2024-02-21T23:01:58.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.340+0000 7f8a7ca00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f8a7808cfd0 0x7f8a7808d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:58.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.340+0000 7f8a7ca00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a78187220 con 0x7f8a7817f5f0 2024-02-21T23:01:58.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.340+0000 7f8a7ca00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a78187500 con 0x7f8a780fb000 2024-02-21T23:01:58.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.340+0000 7f8a7ca00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a78186ff0 con 0x7f8a7808cfd0 2024-02-21T23:01:58.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.340+0000 7f8a77400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f8a7817f5f0 0x7f8a781868e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:36394/0 (socket says 172.21.15.99:36394) 2024-02-21T23:01:58.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.340+0000 7f8a77400640 1 -- 172.21.15.99:0/3790674367 learned_addr learned my addr 172.21.15.99:0/3790674367 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:01:58.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.340+0000 7f8a76a00640 1 --2- 172.21.15.99:0/3790674367 >> v2:172.21.15.162:3300/0 conn(0x7f8a7808cfd0 0x7f8a7808d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:58.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.341+0000 7f8a76000640 1 -- 172.21.15.99:0/3790674367 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 383838011 0 0) 0x7f8a78187220 con 0x7f8a7817f5f0 2024-02-21T23:01:58.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.341+0000 7f8a76a00640 1 -- 172.21.15.99:0/3790674367 >> v1:172.21.15.181:6789/0 conn(0x7f8a780fb000 legacy=0x7f8a780fb490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:58.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.341+0000 7f8a76a00640 1 -- 172.21.15.99:0/3790674367 >> v1:172.21.15.99:6789/0 conn(0x7f8a7817f5f0 legacy=0x7f8a781868e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:58.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.341+0000 7f8a76a00640 1 -- 172.21.15.99:0/3790674367 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a781877e0 con 0x7f8a7808cfd0 2024-02-21T23:01:58.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.342+0000 7f8a76a00640 1 --2- 172.21.15.99:0/3790674367 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a7808cfd0 0x7f8a7808d430 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8a64009720 tx=0x7f8a6402b6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7eb52ab6d53bc81d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:58.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.342+0000 7f8a76000640 1 -- 172.21.15.99:0/3790674367 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a64037070 con 0x7f8a7808cfd0 2024-02-21T23:01:58.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.342+0000 7f8a76000640 1 -- 172.21.15.99:0/3790674367 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a64030710 con 0x7f8a7808cfd0 2024-02-21T23:01:58.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.342+0000 7f8a76000640 1 -- 172.21.15.99:0/3790674367 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a64030ae0 con 0x7f8a7808cfd0 2024-02-21T23:01:58.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.343+0000 7f8a7ca00640 1 -- 172.21.15.99:0/3790674367 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a7808cfd0 msgr2=0x7f8a7808d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:58.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.343+0000 7f8a7ca00640 1 --2- 172.21.15.99:0/3790674367 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a7808cfd0 0x7f8a7808d430 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8a64009720 tx=0x7f8a6402b6a0 comp rx=0 tx=0).stop 2024-02-21T23:01:58.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.343+0000 7f8a7ca00640 1 -- 172.21.15.99:0/3790674367 shutdown_connections 2024-02-21T23:01:58.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.343+0000 7f8a7ca00640 1 --2- 172.21.15.99:0/3790674367 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a7808cfd0 0x7f8a7808d430 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:58.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.343+0000 7f8a7ca00640 1 -- 172.21.15.99:0/3790674367 >> 172.21.15.99:0/3790674367 conn(0x7f8a780740b0 msgr2=0x7f8a780744c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:58.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.343+0000 7f8a7ca00640 1 -- 172.21.15.99:0/3790674367 shutdown_connections 2024-02-21T23:01:58.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.343+0000 7f8a7ca00640 1 -- 172.21.15.99:0/3790674367 wait complete. 2024-02-21T23:01:58.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.345+0000 7f8a7ca00640 1 Processor -- start 2024-02-21T23:01:58.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.345+0000 7f8a7ca00640 1 -- start start 2024-02-21T23:01:58.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.347+0000 7f8a7ca00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a7808cfd0 0x7f8a78175af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:58.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.347+0000 7f8a7ca00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a780fb000 0x7f8a780caed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:58.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.347+0000 7f8a7ca00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8a7817f5f0 0x7f8a780d24f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:58.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.347+0000 7f8a7ca00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a78187da0 con 0x7f8a780fb000 2024-02-21T23:01:58.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.347+0000 7f8a7ca00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a78188110 con 0x7f8a7808cfd0 2024-02-21T23:01:58.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.347+0000 7f8a7ca00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a7818ccc0 con 0x7f8a7817f5f0 2024-02-21T23:01:58.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.347+0000 7f8a76a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a780fb000 0x7f8a780caed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:58.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.347+0000 7f8a76a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a780fb000 0x7f8a780caed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50106/0 (socket says 172.21.15.99:50106) 2024-02-21T23:01:58.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.347+0000 7f8a76a00640 1 -- 172.21.15.99:0/2462460801 learned_addr learned my addr 172.21.15.99:0/2462460801 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:58.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.347+0000 7f8a77e00640 1 --2- 172.21.15.99:0/2462460801 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8a7817f5f0 0x7f8a780d24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:58.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.347+0000 7f8a77400640 1 --2- 172.21.15.99:0/2462460801 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a7808cfd0 0x7f8a78175af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:58.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.348+0000 7f8a76a00640 1 -- 172.21.15.99:0/2462460801 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8a7817f5f0 msgr2=0x7f8a780d24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:58.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.348+0000 7f8a76a00640 1 --2- 172.21.15.99:0/2462460801 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8a7817f5f0 0x7f8a780d24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:58.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.348+0000 7f8a76a00640 1 -- 172.21.15.99:0/2462460801 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a7808cfd0 msgr2=0x7f8a78175af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:58.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.348+0000 7f8a76a00640 1 --2- 172.21.15.99:0/2462460801 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a7808cfd0 0x7f8a78175af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:58.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.348+0000 7f8a76a00640 1 -- 172.21.15.99:0/2462460801 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a7821f610 con 0x7f8a780fb000 2024-02-21T23:01:58.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.348+0000 7f8a76a00640 1 --2- 172.21.15.99:0/2462460801 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a780fb000 0x7f8a780caed0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8a64009840 tx=0x7f8a640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:58.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.348+0000 7f8a6f400640 1 -- 172.21.15.99:0/2462460801 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a64041020 con 0x7f8a780fb000 2024-02-21T23:01:58.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.348+0000 7f8a6f400640 1 -- 172.21.15.99:0/2462460801 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a64032a40 con 0x7f8a780fb000 2024-02-21T23:01:58.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.348+0000 7f8a7ca00640 1 -- 172.21.15.99:0/2462460801 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a780ce590 con 0x7f8a780fb000 2024-02-21T23:01:58.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.348+0000 7f8a6f400640 1 -- 172.21.15.99:0/2462460801 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a64037040 con 0x7f8a780fb000 2024-02-21T23:01:58.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.349+0000 7f8a7ca00640 1 -- 172.21.15.99:0/2462460801 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a780ceb50 con 0x7f8a780fb000 2024-02-21T23:01:58.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.350+0000 7f8a7ca00640 1 -- 172.21.15.99:0/2462460801 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a78068320 con 0x7f8a780fb000 2024-02-21T23:01:58.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.352+0000 7f8a6f400640 1 -- 172.21.15.99:0/2462460801 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 6) v1 ==== 134407+0+0 (secure 0 0 0) 0x7f8a64044020 con 0x7f8a780fb000 2024-02-21T23:01:58.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.354+0000 7f8a6f400640 1 --2- 172.21.15.99:0/2462460801 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f8a5809ed70 0x7f8a580a1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:58.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.354+0000 7f8a6f400640 1 -- 172.21.15.99:0/2462460801 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f8a640ebcb0 con 0x7f8a780fb000 2024-02-21T23:01:58.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.354+0000 7f8a77400640 1 --2- 172.21.15.99:0/2462460801 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f8a5809ed70 0x7f8a580a1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:58.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.355+0000 7f8a77400640 1 --2- 172.21.15.99:0/2462460801 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f8a5809ed70 0x7f8a580a1230 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8a68007b30 tx=0x7f8a68007c40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:58.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.356+0000 7f8a6f400640 1 -- 172.21.15.99:0/2462460801 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f8a6404b030 con 0x7f8a780fb000 2024-02-21T23:01:58.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.555+0000 7f8a7ca00640 1 -- 172.21.15.99:0/2462460801 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8a78188920 con 0x7f8a780fb000 2024-02-21T23:01:58.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.557+0000 7f8a6f400640 1 -- 172.21.15.99:0/2462460801 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+23759 (secure 0 0 0) 0x7f8a640b9d30 con 0x7f8a780fb000 2024-02-21T23:01:58.547 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T23:01:58.547 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":31,"fsid":"e8af98cd-45a1-425f-96a7-f24da8ee4efb","created":"2024-02-21T23:00:44.699708+0000","modified":"2024-02-21T23:01:50.451929+0000","last_up_change":"2024-02-21T23:00:55.749829+0000","last_in_change":"2024-02-21T23:00:48.332297+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T23:00:57.020557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":11.760000228881836,"score_stable":11.760000228881836,"optimal_score":0.17000000178813934,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-21T23:01:01.124398+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-21T23:01:01.684258+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-21T23:01:05.290089+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c49de9b2-dc53-4882-b14c-7059ed40bf59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6809","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6811","nonce":1026112937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6813","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6815","nonce":1026112937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6823","nonce":1026112937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6819","nonce":1026112937}]},"public_addr":"172.21.15.99:6811/1026112937","cluster_addr":"172.21.15.99:6815/1026112937","heartbeat_back_addr":"172.21.15.99:6823/1026112937","heartbeat_front_addr":"172.21.15.99:6819/1026112937","state":["exists","up"]},{"osd":1,"uuid":"58398292-2fe5-4291-94fd-03a0ca29d49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6827","nonce":3030871566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6829","nonce":3030871566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6833","nonce":3030871566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6831","nonce":3030871566}]},"public_addr":"172.21.15.162:6827/3030871566","cluster_addr":"172.21.15.162:6829/3030871566","heartbeat_back_addr":"172.21.15.162:6833/3030871566","heartbeat_front_addr":"172.21.15.162:6831/3030871566","state":["exists","up"]},{"osd":2,"uuid":"94cddec1-e08f-438d-a7c8-48a0e47d71a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6818","nonce":2782386148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6821","nonce":2782386148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6827","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6829","nonce":2782386148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6823","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6825","nonce":2782386148}]},"public_addr":"172.21.15.181:6818/2782386148","cluster_addr":"172.21.15.181:6821/2782386148","heartbeat_back_addr":"172.21.15.181:6829/2782386148","heartbeat_front_addr":"172.21.15.181:6825/2782386148","state":["exists","up"]},{"osd":3,"uuid":"d29abb74-9b89-4fd7-88b1-7c2eb8231189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6801","nonce":2316185310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6803","nonce":2316185310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6807","nonce":2316185310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6805","nonce":2316185310}]},"public_addr":"172.21.15.99:6801/2316185310","cluster_addr":"172.21.15.99:6803/2316185310","heartbeat_back_addr":"172.21.15.99:6807/2316185310","heartbeat_front_addr":"172.21.15.99:6805/2316185310","state":["exists","up"]},{"osd":4,"uuid":"0d8c9ea3-880a-4d69-9dcb-cf7d35abd449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6811","nonce":3137681258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6813","nonce":3137681258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6817","nonce":3137681258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6815","nonce":3137681258}]},"public_addr":"172.21.15.162:6811/3137681258","cluster_addr":"172.21.15.162:6813/3137681258","heartbeat_back_addr":"172.21.15.162:6817/3137681258","heartbeat_front_addr":"172.21.15.162:6815/3137681258","state":["exists","up"]},{"osd":5,"uuid":"2e3a9340-6fd0-4d7a-8e00-fe305649296e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6801","nonce":2011264527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6803","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6805","nonce":2011264527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6811","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6813","nonce":2011264527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6807","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6809","nonce":2011264527}]},"public_addr":"172.21.15.181:6801/2011264527","cluster_addr":"172.21.15.181:6805/2011264527","heartbeat_back_addr":"172.21.15.181:6813/2011264527","heartbeat_front_addr":"172.21.15.181:6809/2011264527","state":["exists","up"]},{"osd":6,"uuid":"d9e37ce7-1b0e-4019-8f2e-b670403abf7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6810","nonce":753870050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6814","nonce":753870050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6822","nonce":753870050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6818","nonce":753870050}]},"public_addr":"172.21.15.99:6810/753870050","cluster_addr":"172.21.15.99:6814/753870050","heartbeat_back_addr":"172.21.15.99:6822/753870050","heartbeat_front_addr":"172.21.15.99:6818/753870050","state":["exists","up"]},{"osd":7,"uuid":"49988754-232e-4b8c-bd72-bfa25b418e5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6803","nonce":1659412949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6805","nonce":1659412949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6809","nonce":1659412949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6807","nonce":1659412949}]},"public_addr":"172.21.15.162:6803/1659412949","cluster_addr":"172.21.15.162:6805/1659412949","heartbeat_back_addr":"172.21.15.162:6809/1659412949","heartbeat_front_addr":"172.21.15.162:6807/1659412949","state":["exists","up"]},{"osd":8,"uuid":"ebc6e462-8368-4d64-b242-9c8735ac672c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6804","nonce":3389807042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6808","nonce":3389807042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6815","nonce":3389807042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6812","nonce":3389807042}]},"public_addr":"172.21.15.181:6804/3389807042","cluster_addr":"172.21.15.181:6808/3389807042","heartbeat_back_addr":"172.21.15.181:6815/3389807042","heartbeat_front_addr":"172.21.15.181:6812/3389807042","state":["exists","up"]},{"osd":9,"uuid":"72af1b02-b965-4d6a-8964-527ec24c4daa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6825","nonce":4055669590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6827","nonce":4055669590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6831","nonce":4055669590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6829","nonce":4055669590}]},"public_addr":"172.21.15.99:6825/4055669590","cluster_addr":"172.21.15.99:6827/4055669590","heartbeat_back_addr":"172.21.15.99:6831/4055669590","heartbeat_front_addr":"172.21.15.99:6829/4055669590","state":["exists","up"]},{"osd":10,"uuid":"adb5cb06-6453-41e4-b847-d7c78bbb7d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6819","nonce":1421879617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6821","nonce":1421879617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6825","nonce":1421879617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6823","nonce":1421879617}]},"public_addr":"172.21.15.162:6819/1421879617","cluster_addr":"172.21.15.162:6821/1421879617","heartbeat_back_addr":"172.21.15.162:6825/1421879617","heartbeat_front_addr":"172.21.15.162:6823/1421879617","state":["exists","up"]},{"osd":11,"uuid":"118563d9-1e8f-4dc7-a92c-2f4c4dc3e20f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6817","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6819","nonce":3219928272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6824","nonce":3219928272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6831","nonce":3219928272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6828","nonce":3219928272}]},"public_addr":"172.21.15.181:6819/3219928272","cluster_addr":"172.21.15.181:6824/3219928272","heartbeat_back_addr":"172.21.15.181:6831/3219928272","heartbeat_front_addr":"172.21.15.181:6828/3219928272","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.651219+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.549859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.529659+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.591004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.440836+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.414250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.630130+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.411954+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.439371+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.428173+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.511203+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.482806+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.6","mappings":[{"from":9,"to":11}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.14","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T23:01:58.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.560+0000 7f8a7ca00640 1 -- 172.21.15.99:0/2462460801 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f8a5809ed70 msgr2=0x7f8a580a1230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:58.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.560+0000 7f8a7ca00640 1 --2- 172.21.15.99:0/2462460801 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f8a5809ed70 0x7f8a580a1230 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8a68007b30 tx=0x7f8a68007c40 comp rx=0 tx=0).stop 2024-02-21T23:01:58.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.560+0000 7f8a7ca00640 1 -- 172.21.15.99:0/2462460801 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a780fb000 msgr2=0x7f8a780caed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:58.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.560+0000 7f8a7ca00640 1 --2- 172.21.15.99:0/2462460801 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a780fb000 0x7f8a780caed0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8a64009840 tx=0x7f8a640046c0 comp rx=0 tx=0).stop 2024-02-21T23:01:58.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.560+0000 7f8a7ca00640 1 -- 172.21.15.99:0/2462460801 shutdown_connections 2024-02-21T23:01:58.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.560+0000 7f8a7ca00640 1 --2- 172.21.15.99:0/2462460801 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f8a5809ed70 0x7f8a580a1230 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:58.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.560+0000 7f8a7ca00640 1 --2- 172.21.15.99:0/2462460801 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8a7817f5f0 0x7f8a780d24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:58.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.560+0000 7f8a7ca00640 1 --2- 172.21.15.99:0/2462460801 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8a780fb000 0x7f8a780caed0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:58.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.560+0000 7f8a7ca00640 1 --2- 172.21.15.99:0/2462460801 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a7808cfd0 0x7f8a78175af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:58.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.560+0000 7f8a7ca00640 1 -- 172.21.15.99:0/2462460801 >> 172.21.15.99:0/2462460801 conn(0x7f8a780740b0 msgr2=0x7f8a781867e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:58.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.560+0000 7f8a7ca00640 1 -- 172.21.15.99:0/2462460801 shutdown_connections 2024-02-21T23:01:58.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.560+0000 7f8a7ca00640 1 -- 172.21.15.99:0/2462460801 wait complete. 2024-02-21T23:01:58.567 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-21T23:00:57.020557+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 11.760000228881836, 'score_stable': 11.760000228881836, 'optimal_score': 0.17000000178813934, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-21T23:01:01.124398+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-21T23:01:01.684258+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-02-21T23:01:05.290089+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-02-21T23:01:58.568 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-21T23:01:58.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.771+0000 7f7bb5e00640 1 Processor -- start 2024-02-21T23:01:58.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.771+0000 7f7bb5e00640 1 -- start start 2024-02-21T23:01:58.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.773+0000 7f7bb5e00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f7bb0186390 0x7f7bb0070cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:58.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.773+0000 7f7bb5e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f7bb00711f0 0x7f7bb0189120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:58.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.773+0000 7f7bb5e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7bb0189660 0x7f7bb018a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:58.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.773+0000 7f7bb5e00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bb0072570 con 0x7f7bb0189660 2024-02-21T23:01:58.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.773+0000 7f7bb5e00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bb0071680 con 0x7f7bb00711f0 2024-02-21T23:01:58.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.773+0000 7f7bb5e00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bb0071960 con 0x7f7bb0186390 2024-02-21T23:01:58.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.773+0000 7f7baf400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7bb0189660 0x7f7bb018a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:58.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.773+0000 7f7baea00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f7bb0186390 0x7f7bb0070cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:58.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.774+0000 7f7bae000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f7bb00711f0 0x7f7bb0189120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:58.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.774+0000 7f7baf400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7bb0189660 0x7f7bb018a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50108/0 (socket says 172.21.15.99:50108) 2024-02-21T23:01:58.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.774+0000 7f7baf400640 1 -- 172.21.15.99:0/3830102000 learned_addr learned my addr 172.21.15.99:0/3830102000 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:58.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.774+0000 7f7baf400640 1 -- 172.21.15.99:0/3830102000 >> v2:172.21.15.181:3300/0 conn(0x7f7bb0186390 msgr2=0x7f7bb0070cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:58.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.774+0000 7f7baf400640 1 --2- 172.21.15.99:0/3830102000 >> v2:172.21.15.181:3300/0 conn(0x7f7bb0186390 0x7f7bb0070cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:58.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.774+0000 7f7baf400640 1 -- 172.21.15.99:0/3830102000 >> v2:172.21.15.162:3300/0 conn(0x7f7bb00711f0 msgr2=0x7f7bb0189120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:58.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.774+0000 7f7baf400640 1 --2- 172.21.15.99:0/3830102000 >> v2:172.21.15.162:3300/0 conn(0x7f7bb00711f0 0x7f7bb0189120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:58.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.774+0000 7f7baf400640 1 -- 172.21.15.99:0/3830102000 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bb0071c40 con 0x7f7bb0189660 2024-02-21T23:01:58.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.774+0000 7f7bae000640 1 --2- 172.21.15.99:0/3830102000 >> v2:172.21.15.162:3300/0 conn(0x7f7bb00711f0 0x7f7bb0189120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:01:58.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.775+0000 7f7baf400640 1 --2- 172.21.15.99:0/3830102000 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7bb0189660 0x7f7bb018a3a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7bb00eff20 tx=0x7f7ba802be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be853d0ac0c316cc server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:58.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.775+0000 7f7bad600640 1 -- 172.21.15.99:0/3830102000 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba802ca10 con 0x7f7bb0189660 2024-02-21T23:01:58.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.776+0000 7f7bad600640 1 -- 172.21.15.99:0/3830102000 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ba802cbb0 con 0x7f7bb0189660 2024-02-21T23:01:58.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.776+0000 7f7bad600640 1 -- 172.21.15.99:0/3830102000 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba80343f0 con 0x7f7bb0189660 2024-02-21T23:01:58.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.776+0000 7f7bb5e00640 1 -- 172.21.15.99:0/3830102000 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7bb0189660 msgr2=0x7f7bb018a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:58.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.776+0000 7f7bb5e00640 1 --2- 172.21.15.99:0/3830102000 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7bb0189660 0x7f7bb018a3a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7bb00eff20 tx=0x7f7ba802be70 comp rx=0 tx=0).stop 2024-02-21T23:01:58.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.776+0000 7f7bb5e00640 1 -- 172.21.15.99:0/3830102000 shutdown_connections 2024-02-21T23:01:58.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.776+0000 7f7bb5e00640 1 --2- 172.21.15.99:0/3830102000 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7bb0189660 0x7f7bb018a3a0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:58.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.776+0000 7f7bb5e00640 1 --2- 172.21.15.99:0/3830102000 >> v2:172.21.15.162:3300/0 conn(0x7f7bb00711f0 0x7f7bb0189120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:58.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.776+0000 7f7bb5e00640 1 --2- 172.21.15.99:0/3830102000 >> v2:172.21.15.181:3300/0 conn(0x7f7bb0186390 0x7f7bb0070cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:58.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.776+0000 7f7bb5e00640 1 -- 172.21.15.99:0/3830102000 >> 172.21.15.99:0/3830102000 conn(0x7f7bb00f8ea0 msgr2=0x7f7bb00f92b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:58.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.777+0000 7f7bb5e00640 1 -- 172.21.15.99:0/3830102000 shutdown_connections 2024-02-21T23:01:58.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.777+0000 7f7bb5e00640 1 -- 172.21.15.99:0/3830102000 wait complete. 2024-02-21T23:01:58.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.780+0000 7f7bb5e00640 1 Processor -- start 2024-02-21T23:01:58.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.780+0000 7f7bb5e00640 1 -- start start 2024-02-21T23:01:58.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.782+0000 7f7bb5e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7bb0186390 0x7f7bb00d3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:58.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.782+0000 7f7bb5e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7bb0189660 0x7f7bb008d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:58.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.782+0000 7f7bb5e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7bb008dd20 0x7f7bb0172180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:58.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.782+0000 7f7bb5e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb0186770 con 0x7f7bb0186390 2024-02-21T23:01:58.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.782+0000 7f7bb5e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb0072200 con 0x7f7bb008dd20 2024-02-21T23:01:58.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.782+0000 7f7bb5e00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb0189ab0 con 0x7f7bb0189660 2024-02-21T23:01:58.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.782+0000 7f7baea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7bb0186390 0x7f7bb00d3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:58.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.782+0000 7f7bae000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7bb0189660 0x7f7bb008d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:58.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.782+0000 7f7baea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7bb0186390 0x7f7bb00d3540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50116/0 (socket says 172.21.15.99:50116) 2024-02-21T23:01:58.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.782+0000 7f7baea00640 1 -- 172.21.15.99:0/3040324298 learned_addr learned my addr 172.21.15.99:0/3040324298 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:58.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.782+0000 7f7bae000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7bb0189660 0x7f7bb008d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:34880/0 (socket says 172.21.15.99:34880) 2024-02-21T23:01:58.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.782+0000 7f7baf400640 1 --2- 172.21.15.99:0/3040324298 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7bb008dd20 0x7f7bb0172180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:58.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.783+0000 7f7baf400640 1 -- 172.21.15.99:0/3040324298 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7bb0189660 msgr2=0x7f7bb008d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:58.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.783+0000 7f7baf400640 1 --2- 172.21.15.99:0/3040324298 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7bb0189660 0x7f7bb008d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:58.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.783+0000 7f7baf400640 1 -- 172.21.15.99:0/3040324298 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7bb0186390 msgr2=0x7f7bb00d3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:58.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.783+0000 7f7baf400640 1 --2- 172.21.15.99:0/3040324298 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7bb0186390 0x7f7bb00d3540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:58.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.783+0000 7f7baf400640 1 -- 172.21.15.99:0/3040324298 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bb008e1d0 con 0x7f7bb008dd20 2024-02-21T23:01:58.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.783+0000 7f7baea00640 1 --2- 172.21.15.99:0/3040324298 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7bb0186390 0x7f7bb00d3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:01:58.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.783+0000 7f7baf400640 1 --2- 172.21.15.99:0/3040324298 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7bb008dd20 0x7f7bb0172180 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7ba8032000 tx=0x7f7ba8004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:58.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.783+0000 7f7ba7400640 1 -- 172.21.15.99:0/3040324298 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba8043020 con 0x7f7bb008dd20 2024-02-21T23:01:58.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.784+0000 7f7ba7400640 1 -- 172.21.15.99:0/3040324298 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ba803e450 con 0x7f7bb008dd20 2024-02-21T23:01:58.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.784+0000 7f7ba7400640 1 -- 172.21.15.99:0/3040324298 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba8009510 con 0x7f7bb008dd20 2024-02-21T23:01:58.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.784+0000 7f7bb5e00640 1 -- 172.21.15.99:0/3040324298 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bb0183b90 con 0x7f7bb008dd20 2024-02-21T23:01:58.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.784+0000 7f7bb5e00640 1 -- 172.21.15.99:0/3040324298 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bb0184150 con 0x7f7bb008dd20 2024-02-21T23:01:58.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.786+0000 7f7bb5e00640 1 -- 172.21.15.99:0/3040324298 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bb0066c60 con 0x7f7bb008dd20 2024-02-21T23:01:58.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.787+0000 7f7ba7400640 1 -- 172.21.15.99:0/3040324298 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 6) v1 ==== 134407+0+0 (secure 0 0 0) 0x7f7ba8046020 con 0x7f7bb008dd20 2024-02-21T23:01:58.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.788+0000 7f7ba7400640 1 --2- 172.21.15.99:0/3040324298 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f7b9009edf0 0x7f7b900a12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:58.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.788+0000 7f7ba7400640 1 -- 172.21.15.99:0/3040324298 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f7ba80ec2c0 con 0x7f7bb008dd20 2024-02-21T23:01:58.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.788+0000 7f7baea00640 1 --2- 172.21.15.99:0/3040324298 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f7b9009edf0 0x7f7b900a12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:58.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.789+0000 7f7baea00640 1 --2- 172.21.15.99:0/3040324298 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f7b9009edf0 0x7f7b900a12b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7ba00112c0 tx=0x7f7ba0009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:58.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.792+0000 7f7ba7400640 1 -- 172.21.15.99:0/3040324298 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f7ba804d030 con 0x7f7bb008dd20 2024-02-21T23:01:58.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.991+0000 7f7bb5e00640 1 -- 172.21.15.99:0/3040324298 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7bb00f7510 con 0x7f7bb008dd20 2024-02-21T23:01:58.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.992+0000 7f7ba7400640 1 -- 172.21.15.99:0/3040324298 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7ba80ba450 con 0x7f7bb008dd20 2024-02-21T23:01:58.981 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 1 2024-02-21T23:01:58.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.995+0000 7f7bb5e00640 1 -- 172.21.15.99:0/3040324298 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f7b9009edf0 msgr2=0x7f7b900a12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:58.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.995+0000 7f7bb5e00640 1 --2- 172.21.15.99:0/3040324298 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f7b9009edf0 0x7f7b900a12b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7ba00112c0 tx=0x7f7ba0009190 comp rx=0 tx=0).stop 2024-02-21T23:01:58.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.995+0000 7f7bb5e00640 1 -- 172.21.15.99:0/3040324298 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7bb008dd20 msgr2=0x7f7bb0172180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:58.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.995+0000 7f7bb5e00640 1 --2- 172.21.15.99:0/3040324298 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7bb008dd20 0x7f7bb0172180 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7ba8032000 tx=0x7f7ba8004a40 comp rx=0 tx=0).stop 2024-02-21T23:01:58.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.995+0000 7f7bb5e00640 1 -- 172.21.15.99:0/3040324298 shutdown_connections 2024-02-21T23:01:58.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.995+0000 7f7bb5e00640 1 --2- 172.21.15.99:0/3040324298 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f7b9009edf0 0x7f7b900a12b0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:58.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.995+0000 7f7bb5e00640 1 --2- 172.21.15.99:0/3040324298 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7bb008dd20 0x7f7bb0172180 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:58.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.995+0000 7f7bb5e00640 1 --2- 172.21.15.99:0/3040324298 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7bb0189660 0x7f7bb008d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:58.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.995+0000 7f7bb5e00640 1 --2- 172.21.15.99:0/3040324298 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7bb0186390 0x7f7bb00d3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:58.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.995+0000 7f7bb5e00640 1 -- 172.21.15.99:0/3040324298 >> 172.21.15.99:0/3040324298 conn(0x7f7bb00f8ea0 msgr2=0x7f7bb00f7730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:58.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.995+0000 7f7bb5e00640 1 -- 172.21.15.99:0/3040324298 shutdown_connections 2024-02-21T23:01:58.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:58.995+0000 7f7bb5e00640 1 -- 172.21.15.99:0/3040324298 wait complete. 2024-02-21T23:01:59.003 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-21T23:01:59.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.217+0000 7fe96ae00640 1 Processor -- start 2024-02-21T23:01:59.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.218+0000 7fe96ae00640 1 -- start start 2024-02-21T23:01:59.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.220+0000 7fe96ae00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe9641648c0 0x7fe9640fce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:59.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.220+0000 7fe96ae00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9640fd490 con 0x7fe9640fb9e0 2024-02-21T23:01:59.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.220+0000 7fe96ae00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9640fd770 con 0x7fe964186d30 2024-02-21T23:01:59.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.220+0000 7fe96ae00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9640fbe70 con 0x7fe9641648c0 2024-02-21T23:01:59.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.220+0000 7fe96a400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fe9640fb9e0 0x7fe96418f340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:36402/0 (socket says 172.21.15.99:36402) 2024-02-21T23:01:59.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.220+0000 7fe96a400640 1 -- 172.21.15.99:0/966579287 learned_addr learned my addr 172.21.15.99:0/966579287 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:01:59.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.220+0000 7fe969a00640 1 --2- 172.21.15.99:0/966579287 >> v2:172.21.15.162:3300/0 conn(0x7fe9641648c0 0x7fe9640fce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:59.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.221+0000 7fe969a00640 1 -- 172.21.15.99:0/966579287 >> v1:172.21.15.181:6789/0 conn(0x7fe964186d30 legacy=0x7fe964187190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:59.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.221+0000 7fe963e00640 1 -- 172.21.15.99:0/966579287 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2623700799 0 0) 0x7fe9640fd770 con 0x7fe964186d30 2024-02-21T23:01:59.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.221+0000 7fe969a00640 1 -- 172.21.15.99:0/966579287 >> v1:172.21.15.99:6789/0 conn(0x7fe9640fb9e0 legacy=0x7fe96418f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:59.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.221+0000 7fe969a00640 1 -- 172.21.15.99:0/966579287 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9640fda50 con 0x7fe9641648c0 2024-02-21T23:01:59.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.223+0000 7fe969a00640 1 --2- 172.21.15.99:0/966579287 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe9641648c0 0x7fe9640fce30 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe9580097a0 tx=0x7fe95802b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32adab1d84c50b5 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:59.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.223+0000 7fe963e00640 1 -- 172.21.15.99:0/966579287 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe958037070 con 0x7fe9641648c0 2024-02-21T23:01:59.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.223+0000 7fe963e00640 1 -- 172.21.15.99:0/966579287 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe958030710 con 0x7fe9641648c0 2024-02-21T23:01:59.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.223+0000 7fe963e00640 1 -- 172.21.15.99:0/966579287 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe958030ae0 con 0x7fe9641648c0 2024-02-21T23:01:59.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.224+0000 7fe96ae00640 1 -- 172.21.15.99:0/966579287 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe9641648c0 msgr2=0x7fe9640fce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:59.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.224+0000 7fe96ae00640 1 --2- 172.21.15.99:0/966579287 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe9641648c0 0x7fe9640fce30 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe9580097a0 tx=0x7fe95802b790 comp rx=0 tx=0).stop 2024-02-21T23:01:59.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.224+0000 7fe96ae00640 1 -- 172.21.15.99:0/966579287 shutdown_connections 2024-02-21T23:01:59.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.224+0000 7fe96ae00640 1 --2- 172.21.15.99:0/966579287 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe9641648c0 0x7fe9640fce30 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:59.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.224+0000 7fe96ae00640 1 -- 172.21.15.99:0/966579287 >> 172.21.15.99:0/966579287 conn(0x7fe9640d29c0 msgr2=0x7fe9640d2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:59.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.224+0000 7fe96ae00640 1 -- 172.21.15.99:0/966579287 shutdown_connections 2024-02-21T23:01:59.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.224+0000 7fe96ae00640 1 -- 172.21.15.99:0/966579287 wait complete. 2024-02-21T23:01:59.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.227+0000 7fe96ae00640 1 Processor -- start 2024-02-21T23:01:59.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.227+0000 7fe96ae00640 1 -- start start 2024-02-21T23:01:59.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.229+0000 7fe96ae00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe9640fb9e0 0x7fe964162a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:59.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.229+0000 7fe96ae00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9641648c0 0x7fe964162f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:59.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.229+0000 7fe96ae00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe964186d30 0x7fe964211df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:59.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.229+0000 7fe96ae00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe964072920 con 0x7fe9641648c0 2024-02-21T23:01:59.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.229+0000 7fe96ae00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9640fe010 con 0x7fe964186d30 2024-02-21T23:01:59.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.229+0000 7fe96ae00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9641878a0 con 0x7fe9640fb9e0 2024-02-21T23:01:59.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.229+0000 7fe969a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe9640fb9e0 0x7fe964162a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:59.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.229+0000 7fe969a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe9640fb9e0 0x7fe964162a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:34896/0 (socket says 172.21.15.99:34896) 2024-02-21T23:01:59.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.229+0000 7fe969a00640 1 -- 172.21.15.99:0/2725203882 learned_addr learned my addr 172.21.15.99:0/2725203882 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:59.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.229+0000 7fe96a400640 1 --2- 172.21.15.99:0/2725203882 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe964186d30 0x7fe964211df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:59.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.229+0000 7fe969000640 1 --2- 172.21.15.99:0/2725203882 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9641648c0 0x7fe964162f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:59.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.230+0000 7fe969a00640 1 -- 172.21.15.99:0/2725203882 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe964186d30 msgr2=0x7fe964211df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:59.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.230+0000 7fe969a00640 1 --2- 172.21.15.99:0/2725203882 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe964186d30 0x7fe964211df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:59.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.230+0000 7fe969a00640 1 -- 172.21.15.99:0/2725203882 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9641648c0 msgr2=0x7fe964162f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:59.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.230+0000 7fe969a00640 1 --2- 172.21.15.99:0/2725203882 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9641648c0 0x7fe964162f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:59.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.230+0000 7fe969a00640 1 -- 172.21.15.99:0/2725203882 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe964212970 con 0x7fe9640fb9e0 2024-02-21T23:01:59.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.230+0000 7fe969000640 1 --2- 172.21.15.99:0/2725203882 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9641648c0 0x7fe964162f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:01:59.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.230+0000 7fe969a00640 1 --2- 172.21.15.99:0/2725203882 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe9640fb9e0 0x7fe964162a10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe9580098c0 tx=0x7fe9580046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:59.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.230+0000 7fe961600640 1 -- 172.21.15.99:0/2725203882 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe958041020 con 0x7fe9640fb9e0 2024-02-21T23:01:59.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.231+0000 7fe961600640 1 -- 172.21.15.99:0/2725203882 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe958032a40 con 0x7fe9640fb9e0 2024-02-21T23:01:59.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.231+0000 7fe96ae00640 1 -- 172.21.15.99:0/2725203882 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe964212c50 con 0x7fe9640fb9e0 2024-02-21T23:01:59.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.231+0000 7fe961600640 1 -- 172.21.15.99:0/2725203882 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe958037040 con 0x7fe9640fb9e0 2024-02-21T23:01:59.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.231+0000 7fe96ae00640 1 -- 172.21.15.99:0/2725203882 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe964220000 con 0x7fe9640fb9e0 2024-02-21T23:01:59.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.232+0000 7fe96ae00640 1 -- 172.21.15.99:0/2725203882 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe964068320 con 0x7fe9640fb9e0 2024-02-21T23:01:59.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.235+0000 7fe961600640 1 -- 172.21.15.99:0/2725203882 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 6) v1 ==== 134407+0+0 (secure 0 0 0) 0x7fe958044020 con 0x7fe9640fb9e0 2024-02-21T23:01:59.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.236+0000 7fe961600640 1 --2- 172.21.15.99:0/2725203882 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fe94409edf0 0x7fe9440a12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:59.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.237+0000 7fe961600640 1 -- 172.21.15.99:0/2725203882 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fe9580eb880 con 0x7fe9640fb9e0 2024-02-21T23:01:59.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.237+0000 7fe969000640 1 --2- 172.21.15.99:0/2725203882 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fe94409edf0 0x7fe9440a12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:59.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.238+0000 7fe969000640 1 --2- 172.21.15.99:0/2725203882 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fe94409edf0 0x7fe9440a12b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe964221c70 tx=0x7fe950009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:59.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.241+0000 7fe961600640 1 -- 172.21.15.99:0/2725203882 <== mon.2 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fe95804b030 con 0x7fe9640fb9e0 2024-02-21T23:01:59.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.599+0000 7fe96ae00640 1 -- 172.21.15.99:0/2725203882 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe9641824c0 con 0x7fe9640fb9e0 2024-02-21T23:01:59.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.599+0000 7fe961600640 1 -- 172.21.15.99:0/2725203882 <== mon.2 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe9580b9900 con 0x7fe9640fb9e0 2024-02-21T23:01:59.588 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 32 2024-02-21T23:01:59.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.602+0000 7fe96ae00640 1 -- 172.21.15.99:0/2725203882 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fe94409edf0 msgr2=0x7fe9440a12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:59.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.602+0000 7fe96ae00640 1 --2- 172.21.15.99:0/2725203882 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fe94409edf0 0x7fe9440a12b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe964221c70 tx=0x7fe950009040 comp rx=0 tx=0).stop 2024-02-21T23:01:59.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.602+0000 7fe96ae00640 1 -- 172.21.15.99:0/2725203882 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe9640fb9e0 msgr2=0x7fe964162a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:59.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.602+0000 7fe96ae00640 1 --2- 172.21.15.99:0/2725203882 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe9640fb9e0 0x7fe964162a10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe9580098c0 tx=0x7fe9580046c0 comp rx=0 tx=0).stop 2024-02-21T23:01:59.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.602+0000 7fe96ae00640 1 -- 172.21.15.99:0/2725203882 shutdown_connections 2024-02-21T23:01:59.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.602+0000 7fe96ae00640 1 --2- 172.21.15.99:0/2725203882 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fe94409edf0 0x7fe9440a12b0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:59.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.602+0000 7fe96ae00640 1 --2- 172.21.15.99:0/2725203882 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe964186d30 0x7fe964211df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:59.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.602+0000 7fe96ae00640 1 --2- 172.21.15.99:0/2725203882 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe9641648c0 0x7fe964162f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:59.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.602+0000 7fe96ae00640 1 --2- 172.21.15.99:0/2725203882 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe9640fb9e0 0x7fe964162a10 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:59.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.602+0000 7fe96ae00640 1 -- 172.21.15.99:0/2725203882 >> 172.21.15.99:0/2725203882 conn(0x7fe9640d29c0 msgr2=0x7fe964187190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:59.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.602+0000 7fe96ae00640 1 -- 172.21.15.99:0/2725203882 shutdown_connections 2024-02-21T23:01:59.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.602+0000 7fe96ae00640 1 -- 172.21.15.99:0/2725203882 wait complete. 2024-02-21T23:01:59.611 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-21T23:01:59.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.831+0000 7f4f8d400640 1 Processor -- start 2024-02-21T23:01:59.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.832+0000 7f4f8d400640 1 -- start start 2024-02-21T23:01:59.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.833+0000 7f4f8d400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f4f880fcf20 0x7f4f880f8de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:59.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.833+0000 7f4f8d400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4f88189140 0x7f4f881895d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:59.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.833+0000 7f4f8d400640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f88186db0 con 0x7f4f88182ac0 2024-02-21T23:01:59.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.833+0000 7f4f8d400640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f88182ea0 con 0x7f4f880fcf20 2024-02-21T23:01:59.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.833+0000 7f4f8d400640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f88187090 con 0x7f4f88189140 2024-02-21T23:01:59.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.834+0000 7f4f87e00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f4f88182ac0 0x7f4f880fc810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:36416/0 (socket says 172.21.15.99:36416) 2024-02-21T23:01:59.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.834+0000 7f4f87e00640 1 -- 172.21.15.99:0/3808076583 learned_addr learned my addr 172.21.15.99:0/3808076583 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:01:59.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.834+0000 7f4f7fe00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f4f880fcf20 0x7f4f880f8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:59.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.834+0000 7f4f8ca00640 1 --2- 172.21.15.99:0/3808076583 >> v2:172.21.15.162:3300/0 conn(0x7f4f88189140 0x7f4f881895d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:59.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.834+0000 7f4f7fe00640 1 -- 172.21.15.99:0/3808076583 >> v2:172.21.15.162:3300/0 conn(0x7f4f88189140 msgr2=0x7f4f881895d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:01:59.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.834+0000 7f4f7fe00640 1 --2- 172.21.15.99:0/3808076583 >> v2:172.21.15.162:3300/0 conn(0x7f4f88189140 0x7f4f881895d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:59.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.834+0000 7f4f7fe00640 1 -- 172.21.15.99:0/3808076583 >> v1:172.21.15.99:6789/0 conn(0x7f4f88182ac0 legacy=0x7f4f880fc810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:59.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.834+0000 7f4f7fe00640 1 -- 172.21.15.99:0/3808076583 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f88187370 con 0x7f4f880fcf20 2024-02-21T23:01:59.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.836+0000 7f4f7fe00640 1 --2- 172.21.15.99:0/3808076583 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4f880fcf20 0x7f4f880f8de0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4f88092700 tx=0x7f4f7002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32b29ece8ee64a7e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:59.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.836+0000 7f4f87400640 1 -- 172.21.15.99:0/3808076583 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f70035020 con 0x7f4f880fcf20 2024-02-21T23:01:59.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.836+0000 7f4f87400640 1 -- 172.21.15.99:0/3808076583 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f70031830 con 0x7f4f880fcf20 2024-02-21T23:01:59.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.836+0000 7f4f87400640 1 -- 172.21.15.99:0/3808076583 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f70031c00 con 0x7f4f880fcf20 2024-02-21T23:01:59.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.836+0000 7f4f8d400640 1 -- 172.21.15.99:0/3808076583 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4f880fcf20 msgr2=0x7f4f880f8de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:59.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.836+0000 7f4f8d400640 1 --2- 172.21.15.99:0/3808076583 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4f880fcf20 0x7f4f880f8de0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4f88092700 tx=0x7f4f7002b8d0 comp rx=0 tx=0).stop 2024-02-21T23:01:59.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.837+0000 7f4f8d400640 1 -- 172.21.15.99:0/3808076583 shutdown_connections 2024-02-21T23:01:59.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.837+0000 7f4f8d400640 1 --2- 172.21.15.99:0/3808076583 >> v2:172.21.15.162:3300/0 conn(0x7f4f88189140 0x7f4f881895d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:59.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.837+0000 7f4f8d400640 1 --2- 172.21.15.99:0/3808076583 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4f880fcf20 0x7f4f880f8de0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:59.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.837+0000 7f4f8d400640 1 -- 172.21.15.99:0/3808076583 >> 172.21.15.99:0/3808076583 conn(0x7f4f880fe460 msgr2=0x7f4f880fe870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:01:59.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.837+0000 7f4f8d400640 1 -- 172.21.15.99:0/3808076583 shutdown_connections 2024-02-21T23:01:59.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.837+0000 7f4f8d400640 1 -- 172.21.15.99:0/3808076583 wait complete. 2024-02-21T23:01:59.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.839+0000 7f4f8d400640 1 Processor -- start 2024-02-21T23:01:59.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.839+0000 7f4f8d400640 1 -- start start 2024-02-21T23:01:59.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.840+0000 7f4f8d400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4f880fcf20 0x7f4f88170c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:59.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.840+0000 7f4f8d400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4f88182ac0 0x7f4f8816d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:59.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.840+0000 7f4f8d400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f88189140 0x7f4f880f9900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:59.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.840+0000 7f4f8d400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f881869a0 con 0x7f4f880fcf20 2024-02-21T23:01:59.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.840+0000 7f4f8d400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f88187930 con 0x7f4f88189140 2024-02-21T23:01:59.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.840+0000 7f4f8d400640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f88186b20 con 0x7f4f88182ac0 2024-02-21T23:01:59.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.840+0000 7f4f87e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4f880fcf20 0x7f4f88170c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:59.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.840+0000 7f4f8ca00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f88189140 0x7f4f880f9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:59.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.840+0000 7f4f8ca00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f88189140 0x7f4f880f9900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:40640/0 (socket says 172.21.15.99:40640) 2024-02-21T23:01:59.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.840+0000 7f4f8ca00640 1 -- 172.21.15.99:0/2425405934 learned_addr learned my addr 172.21.15.99:0/2425405934 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:01:59.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.840+0000 7f4f87e00640 1 --2- 172.21.15.99:0/2425405934 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4f880fcf20 0x7f4f88170c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50144/0 (socket says 172.21.15.99:50144) 2024-02-21T23:01:59.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.840+0000 7f4f7fe00640 1 --2- 172.21.15.99:0/2425405934 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4f88182ac0 0x7f4f8816d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:59.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.841+0000 7f4f8ca00640 1 -- 172.21.15.99:0/2425405934 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4f88182ac0 msgr2=0x7f4f8816d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:59.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.841+0000 7f4f8ca00640 1 --2- 172.21.15.99:0/2425405934 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4f88182ac0 0x7f4f8816d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:59.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.841+0000 7f4f8ca00640 1 -- 172.21.15.99:0/2425405934 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4f880fcf20 msgr2=0x7f4f88170c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:01:59.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.841+0000 7f4f8ca00640 1 --2- 172.21.15.99:0/2425405934 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4f880fcf20 0x7f4f88170c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:01:59.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.841+0000 7f4f8ca00640 1 -- 172.21.15.99:0/2425405934 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f88171160 con 0x7f4f88189140 2024-02-21T23:01:59.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.841+0000 7f4f87e00640 1 --2- 172.21.15.99:0/2425405934 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4f880fcf20 0x7f4f88170c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:01:59.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.841+0000 7f4f8ca00640 1 --2- 172.21.15.99:0/2425405934 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f88189140 0x7f4f880f9900 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4f8000efc0 tx=0x7f4f8000c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:01:59.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.841+0000 7f4f84c00640 1 -- 172.21.15.99:0/2425405934 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f80018020 con 0x7f4f88189140 2024-02-21T23:01:59.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.841+0000 7f4f84c00640 1 -- 172.21.15.99:0/2425405934 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f80014480 con 0x7f4f88189140 2024-02-21T23:01:59.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.841+0000 7f4f8d400640 1 -- 172.21.15.99:0/2425405934 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f8816f400 con 0x7f4f88189140 2024-02-21T23:01:59.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.842+0000 7f4f84c00640 1 -- 172.21.15.99:0/2425405934 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f80014870 con 0x7f4f88189140 2024-02-21T23:01:59.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.842+0000 7f4f8d400640 1 -- 172.21.15.99:0/2425405934 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f8816f9c0 con 0x7f4f88189140 2024-02-21T23:01:59.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.843+0000 7f4f8d400640 1 -- 172.21.15.99:0/2425405934 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f88068320 con 0x7f4f88189140 2024-02-21T23:01:59.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.846+0000 7f4f84c00640 1 -- 172.21.15.99:0/2425405934 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 6) v1 ==== 134407+0+0 (secure 0 0 0) 0x7f4f80005d10 con 0x7f4f88189140 2024-02-21T23:01:59.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.848+0000 7f4f84c00640 1 --2- 172.21.15.99:0/2425405934 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f4f6409edf0 0x7f4f640a12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:01:59.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.849+0000 7f4f84c00640 1 -- 172.21.15.99:0/2425405934 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f4f800cae40 con 0x7f4f88189140 2024-02-21T23:01:59.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.849+0000 7f4f87e00640 1 --2- 172.21.15.99:0/2425405934 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f4f6409edf0 0x7f4f640a12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:01:59.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.849+0000 7f4f84c00640 1 -- 172.21.15.99:0/2425405934 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f4f80022070 con 0x7f4f88189140 2024-02-21T23:01:59.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:01:59.850+0000 7f4f87e00640 1 --2- 172.21.15.99:0/2425405934 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f4f6409edf0 0x7f4f640a12b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4f78007fd0 tx=0x7f4f78007e80 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:00.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.111+0000 7f4f8d400640 1 -- 172.21.15.99:0/2425405934 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4f88181bb0 con 0x7f4f88189140 2024-02-21T23:02:00.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.112+0000 7f4f84c00640 1 -- 172.21.15.99:0/2425405934 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4f80010040 con 0x7f4f88189140 2024-02-21T23:02:00.101 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 64 2024-02-21T23:02:00.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.116+0000 7f4f8d400640 1 -- 172.21.15.99:0/2425405934 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f4f6409edf0 msgr2=0x7f4f640a12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:00.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.116+0000 7f4f8d400640 1 --2- 172.21.15.99:0/2425405934 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f4f6409edf0 0x7f4f640a12b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4f78007fd0 tx=0x7f4f78007e80 comp rx=0 tx=0).stop 2024-02-21T23:02:00.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.116+0000 7f4f8d400640 1 -- 172.21.15.99:0/2425405934 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f88189140 msgr2=0x7f4f880f9900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:00.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.116+0000 7f4f8d400640 1 --2- 172.21.15.99:0/2425405934 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f88189140 0x7f4f880f9900 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4f8000efc0 tx=0x7f4f8000c490 comp rx=0 tx=0).stop 2024-02-21T23:02:00.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.116+0000 7f4f8d400640 1 -- 172.21.15.99:0/2425405934 shutdown_connections 2024-02-21T23:02:00.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.116+0000 7f4f8d400640 1 --2- 172.21.15.99:0/2425405934 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f4f6409edf0 0x7f4f640a12b0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:00.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.116+0000 7f4f8d400640 1 --2- 172.21.15.99:0/2425405934 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f88189140 0x7f4f880f9900 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:00.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.116+0000 7f4f8d400640 1 --2- 172.21.15.99:0/2425405934 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4f88182ac0 0x7f4f8816d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:00.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.116+0000 7f4f8d400640 1 --2- 172.21.15.99:0/2425405934 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4f880fcf20 0x7f4f88170c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:00.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.116+0000 7f4f8d400640 1 -- 172.21.15.99:0/2425405934 >> 172.21.15.99:0/2425405934 conn(0x7f4f880fe460 msgr2=0x7f4f88172b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:00.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.116+0000 7f4f8d400640 1 -- 172.21.15.99:0/2425405934 shutdown_connections 2024-02-21T23:02:00.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.116+0000 7f4f8d400640 1 -- 172.21.15.99:0/2425405934 wait complete. 2024-02-21T23:02:00.126 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-02-21T23:02:00.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.333+0000 7f077cc00640 1 Processor -- start 2024-02-21T23:02:00.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.333+0000 7f077cc00640 1 -- start start 2024-02-21T23:02:00.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.337+0000 7f077cc00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f07781867e0 0x7f07781881e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:00.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.337+0000 7f077cc00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0778188720 con 0x7f07780d4320 2024-02-21T23:02:00.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.337+0000 7f077cc00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07780cf820 con 0x7f0778186400 2024-02-21T23:02:00.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.337+0000 7f077cc00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0778187640 con 0x7f07781867e0 2024-02-21T23:02:00.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.337+0000 7f0775400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f07781867e0 0x7f07781881e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:00.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.337+0000 7f0775e00640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f0778186400 0x7f0778187ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:47048/0 (socket says 172.21.15.99:47048) 2024-02-21T23:02:00.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.337+0000 7f0775e00640 1 -- 172.21.15.99:0/287789042 learned_addr learned my addr 172.21.15.99:0/287789042 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:02:00.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.337+0000 7f0776800640 1 --1- 172.21.15.99:0/287789042 >> v1:172.21.15.162:6789/0 conn(0x7f07780d4320 0x7f07780d4750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.99:58864/0 (socket says 172.21.15.99:58864) 2024-02-21T23:02:00.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.338+0000 7f0774a00640 1 -- 172.21.15.99:0/287789042 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1268760832 0 0) 0x7f0778188720 con 0x7f07780d4320 2024-02-21T23:02:00.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.338+0000 7f0774a00640 1 -- 172.21.15.99:0/287789042 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f075c003520 con 0x7f07780d4320 2024-02-21T23:02:00.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.338+0000 7f0774a00640 1 -- 172.21.15.99:0/287789042 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 696668998 0 0) 0x7f07780cf820 con 0x7f0778186400 2024-02-21T23:02:00.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.338+0000 7f0774a00640 1 -- 172.21.15.99:0/287789042 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0778188720 con 0x7f0778186400 2024-02-21T23:02:00.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.338+0000 7f0775400640 1 -- 172.21.15.99:0/287789042 >> v1:172.21.15.181:6789/0 conn(0x7f0778186400 legacy=0x7f0778187ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:00.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.338+0000 7f0775400640 1 -- 172.21.15.99:0/287789042 >> v1:172.21.15.162:6789/0 conn(0x7f07780d4320 legacy=0x7f07780d4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:00.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.338+0000 7f0775400640 1 -- 172.21.15.99:0/287789042 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07780cfb00 con 0x7f07781867e0 2024-02-21T23:02:00.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.339+0000 7f0775400640 1 --2- 172.21.15.99:0/287789042 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f07781867e0 0x7f07781881e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f07640097a0 tx=0x7f076402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d656486c1c1385d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:00.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.339+0000 7f0774a00640 1 -- 172.21.15.99:0/287789042 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07640315a0 con 0x7f07781867e0 2024-02-21T23:02:00.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.340+0000 7f0774a00640 1 -- 172.21.15.99:0/287789042 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0764037070 con 0x7f07781867e0 2024-02-21T23:02:00.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.340+0000 7f0774a00640 1 -- 172.21.15.99:0/287789042 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0764031960 con 0x7f07781867e0 2024-02-21T23:02:00.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.340+0000 7f077cc00640 1 -- 172.21.15.99:0/287789042 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f07781867e0 msgr2=0x7f07781881e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:00.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.340+0000 7f077cc00640 1 --2- 172.21.15.99:0/287789042 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f07781867e0 0x7f07781881e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f07640097a0 tx=0x7f076402b840 comp rx=0 tx=0).stop 2024-02-21T23:02:00.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.340+0000 7f077cc00640 1 -- 172.21.15.99:0/287789042 shutdown_connections 2024-02-21T23:02:00.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.340+0000 7f077cc00640 1 --2- 172.21.15.99:0/287789042 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f07781867e0 0x7f07781881e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:00.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.340+0000 7f077cc00640 1 -- 172.21.15.99:0/287789042 >> 172.21.15.99:0/287789042 conn(0x7f07780d6af0 msgr2=0x7f07780740b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:00.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.340+0000 7f077cc00640 1 -- 172.21.15.99:0/287789042 shutdown_connections 2024-02-21T23:02:00.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.341+0000 7f077cc00640 1 -- 172.21.15.99:0/287789042 wait complete. 2024-02-21T23:02:00.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.344+0000 7f077cc00640 1 Processor -- start 2024-02-21T23:02:00.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.344+0000 7f077cc00640 1 -- start start 2024-02-21T23:02:00.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.346+0000 7f077cc00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07780d4320 0x7f077815a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:00.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.346+0000 7f077cc00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0778186400 0x7f0778160120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:00.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.346+0000 7f077cc00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f07781867e0 0x7f0778220e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:00.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.346+0000 7f077cc00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07781872d0 con 0x7f07781867e0 2024-02-21T23:02:00.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.346+0000 7f077cc00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0778186ff0 con 0x7f07780d4320 2024-02-21T23:02:00.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.346+0000 7f077cc00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07780ceeb0 con 0x7f0778186400 2024-02-21T23:02:00.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.346+0000 7f0775e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07780d4320 0x7f077815a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:00.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.346+0000 7f0775e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07780d4320 0x7f077815a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:40652/0 (socket says 172.21.15.99:40652) 2024-02-21T23:02:00.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.346+0000 7f0775e00640 1 -- 172.21.15.99:0/2729404516 learned_addr learned my addr 172.21.15.99:0/2729404516 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:00.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.346+0000 7f0775400640 1 --2- 172.21.15.99:0/2729404516 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0778186400 0x7f0778160120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:00.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.346+0000 7f0776800640 1 --2- 172.21.15.99:0/2729404516 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f07781867e0 0x7f0778220e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:00.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.347+0000 7f0775400640 1 -- 172.21.15.99:0/2729404516 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07780d4320 msgr2=0x7f077815a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:00.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.347+0000 7f0775400640 1 --2- 172.21.15.99:0/2729404516 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07780d4320 0x7f077815a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:00.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.347+0000 7f0775400640 1 -- 172.21.15.99:0/2729404516 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f07781867e0 msgr2=0x7f0778220e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:00.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.347+0000 7f0775400640 1 --2- 172.21.15.99:0/2729404516 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f07781867e0 0x7f0778220e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:00.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.347+0000 7f0775400640 1 -- 172.21.15.99:0/2729404516 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0778223110 con 0x7f0778186400 2024-02-21T23:02:00.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.347+0000 7f0775400640 1 --2- 172.21.15.99:0/2729404516 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0778186400 0x7f0778160120 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0764033000 tx=0x7f07640046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:00.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.348+0000 7f076e000640 1 -- 172.21.15.99:0/2729404516 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0764032430 con 0x7f0778186400 2024-02-21T23:02:00.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.348+0000 7f076e000640 1 -- 172.21.15.99:0/2729404516 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07640325f0 con 0x7f0778186400 2024-02-21T23:02:00.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.348+0000 7f077cc00640 1 -- 172.21.15.99:0/2729404516 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0778160c10 con 0x7f0778186400 2024-02-21T23:02:00.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.348+0000 7f076e000640 1 -- 172.21.15.99:0/2729404516 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07640329e0 con 0x7f0778186400 2024-02-21T23:02:00.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.348+0000 7f077cc00640 1 -- 172.21.15.99:0/2729404516 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0778220360 con 0x7f0778186400 2024-02-21T23:02:00.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.349+0000 7f077cc00640 1 -- 172.21.15.99:0/2729404516 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0778068780 con 0x7f0778186400 2024-02-21T23:02:00.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.351+0000 7f076e000640 1 -- 172.21.15.99:0/2729404516 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 6) v1 ==== 134407+0+0 (secure 0 0 0) 0x7f0764032b80 con 0x7f0778186400 2024-02-21T23:02:00.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.352+0000 7f076e000640 1 --2- 172.21.15.99:0/2729404516 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f075809edf0 0x7f07580a12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:00.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.352+0000 7f076e000640 1 -- 172.21.15.99:0/2729404516 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f076402f030 con 0x7f0778186400 2024-02-21T23:02:00.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.353+0000 7f0775e00640 1 --2- 172.21.15.99:0/2729404516 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f075809edf0 0x7f07580a12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:00.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.353+0000 7f0775e00640 1 --2- 172.21.15.99:0/2729404516 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f075809edf0 0x7f07580a12b0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0768005880 tx=0x7f0768009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:00.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.354+0000 7f076e000640 1 -- 172.21.15.99:0/2729404516 <== mon.2 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f0764040070 con 0x7f0778186400 2024-02-21T23:02:00.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.565+0000 7f077cc00640 1 -- 172.21.15.99:0/2729404516 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f07780d4000 con 0x7f0778186400 2024-02-21T23:02:00.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.566+0000 7f076e000640 1 -- 172.21.15.99:0/2729404516 <== mon.2 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) v1 ==== 103+0+11 (secure 0 0 0) 0x7f07640b9de0 con 0x7f0778186400 2024-02-21T23:02:00.555 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 32 2024-02-21T23:02:00.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.569+0000 7f077cc00640 1 -- 172.21.15.99:0/2729404516 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f075809edf0 msgr2=0x7f07580a12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:00.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.569+0000 7f077cc00640 1 --2- 172.21.15.99:0/2729404516 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f075809edf0 0x7f07580a12b0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0768005880 tx=0x7f0768009040 comp rx=0 tx=0).stop 2024-02-21T23:02:00.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.569+0000 7f077cc00640 1 -- 172.21.15.99:0/2729404516 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0778186400 msgr2=0x7f0778160120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:00.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.569+0000 7f077cc00640 1 --2- 172.21.15.99:0/2729404516 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0778186400 0x7f0778160120 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0764033000 tx=0x7f07640046c0 comp rx=0 tx=0).stop 2024-02-21T23:02:00.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.569+0000 7f077cc00640 1 -- 172.21.15.99:0/2729404516 shutdown_connections 2024-02-21T23:02:00.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.569+0000 7f077cc00640 1 --2- 172.21.15.99:0/2729404516 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f075809edf0 0x7f07580a12b0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:00.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.569+0000 7f077cc00640 1 --2- 172.21.15.99:0/2729404516 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f07781867e0 0x7f0778220e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:00.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.569+0000 7f077cc00640 1 --2- 172.21.15.99:0/2729404516 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0778186400 0x7f0778160120 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:00.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.569+0000 7f077cc00640 1 --2- 172.21.15.99:0/2729404516 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07780d4320 0x7f077815a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:00.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.569+0000 7f077cc00640 1 -- 172.21.15.99:0/2729404516 >> 172.21.15.99:0/2729404516 conn(0x7f07780d6af0 msgr2=0x7f0778068e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:00.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.569+0000 7f077cc00640 1 -- 172.21.15.99:0/2729404516 shutdown_connections 2024-02-21T23:02:00.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.569+0000 7f077cc00640 1 -- 172.21.15.99:0/2729404516 wait complete. 2024-02-21T23:02:00.581 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T23:02:00.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.778+0000 7f9a3ce00640 1 Processor -- start 2024-02-21T23:02:00.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.778+0000 7f9a3ce00640 1 -- start start 2024-02-21T23:02:00.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.780+0000 7f9a3ce00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f9a3815dc20 0x7f9a3818b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:00.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.780+0000 7f9a3ce00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a3818a350 con 0x7f9a38189ed0 2024-02-21T23:02:00.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.780+0000 7f9a3ce00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a3818a5c0 con 0x7f9a380d2c80 2024-02-21T23:02:00.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.780+0000 7f9a3ce00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a3818b4b0 con 0x7f9a3815dc20 2024-02-21T23:02:00.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.780+0000 7f9a36a00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f9a38189ed0 0x7f9a38186950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.99:58876/0 (socket says 172.21.15.99:58876) 2024-02-21T23:02:00.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.780+0000 7f9a37400640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f9a3815dc20 0x7f9a3818b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:00.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.780+0000 7f9a36a00640 1 -- 172.21.15.99:0/2356198642 learned_addr learned my addr 172.21.15.99:0/2356198642 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:02:00.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.781+0000 7f9a37400640 1 -- 172.21.15.99:0/2356198642 >> v1:172.21.15.181:6789/0 conn(0x7f9a380d2c80 legacy=0x7f9a380d30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:00.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.781+0000 7f9a37400640 1 -- 172.21.15.99:0/2356198642 >> v1:172.21.15.162:6789/0 conn(0x7f9a38189ed0 legacy=0x7f9a38186950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:00.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.781+0000 7f9a37400640 1 -- 172.21.15.99:0/2356198642 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a3818a8a0 con 0x7f9a3815dc20 2024-02-21T23:02:00.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.781+0000 7f9a36000640 1 -- 172.21.15.99:0/2356198642 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1048243705 0 0) 0x7f9a3818a5c0 con 0x7f9a380d2c80 2024-02-21T23:02:00.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.782+0000 7f9a37400640 1 --2- 172.21.15.99:0/2356198642 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9a3815dc20 0x7f9a3818b940 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9a280097a0 tx=0x7f9a2802b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95e9ebcb8949b0a4 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:00.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.783+0000 7f9a36000640 1 -- 172.21.15.99:0/2356198642 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a28034070 con 0x7f9a3815dc20 2024-02-21T23:02:00.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.783+0000 7f9a36000640 1 -- 172.21.15.99:0/2356198642 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a28030610 con 0x7f9a3815dc20 2024-02-21T23:02:00.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.783+0000 7f9a36000640 1 -- 172.21.15.99:0/2356198642 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a280309e0 con 0x7f9a3815dc20 2024-02-21T23:02:00.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.783+0000 7f9a3ce00640 1 -- 172.21.15.99:0/2356198642 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9a3815dc20 msgr2=0x7f9a3818b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:00.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.783+0000 7f9a3ce00640 1 --2- 172.21.15.99:0/2356198642 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9a3815dc20 0x7f9a3818b940 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9a280097a0 tx=0x7f9a2802b960 comp rx=0 tx=0).stop 2024-02-21T23:02:00.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.784+0000 7f9a3ce00640 1 -- 172.21.15.99:0/2356198642 shutdown_connections 2024-02-21T23:02:00.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.784+0000 7f9a3ce00640 1 --2- 172.21.15.99:0/2356198642 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9a3815dc20 0x7f9a3818b940 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:00.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.784+0000 7f9a3ce00640 1 -- 172.21.15.99:0/2356198642 >> 172.21.15.99:0/2356198642 conn(0x7f9a38072210 msgr2=0x7f9a3808cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:00.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.784+0000 7f9a3ce00640 1 -- 172.21.15.99:0/2356198642 shutdown_connections 2024-02-21T23:02:00.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.784+0000 7f9a3ce00640 1 -- 172.21.15.99:0/2356198642 wait complete. 2024-02-21T23:02:00.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.787+0000 7f9a3ce00640 1 Processor -- start 2024-02-21T23:02:00.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.787+0000 7f9a3ce00640 1 -- start start 2024-02-21T23:02:00.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.789+0000 7f9a3ce00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9a380d2c80 0x7f9a3817c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:00.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.789+0000 7f9a3ce00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9a3815dc20 0x7f9a3817ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:00.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.789+0000 7f9a3ce00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a38189ed0 0x7f9a381548c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:00.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.789+0000 7f9a3ce00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3818b140 con 0x7f9a3815dc20 2024-02-21T23:02:00.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.789+0000 7f9a3ce00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3818ae60 con 0x7f9a38189ed0 2024-02-21T23:02:00.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.789+0000 7f9a3ce00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3815e000 con 0x7f9a380d2c80 2024-02-21T23:02:00.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.789+0000 7f9a37400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9a380d2c80 0x7f9a3817c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:00.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.790+0000 7f9a36a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9a3815dc20 0x7f9a3817ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:00.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.790+0000 7f9a37400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9a380d2c80 0x7f9a3817c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:34942/0 (socket says 172.21.15.99:34942) 2024-02-21T23:02:00.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.790+0000 7f9a37400640 1 -- 172.21.15.99:0/3146998212 learned_addr learned my addr 172.21.15.99:0/3146998212 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:00.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.790+0000 7f9a37e00640 1 --2- 172.21.15.99:0/3146998212 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a38189ed0 0x7f9a381548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:00.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.790+0000 7f9a36a00640 1 -- 172.21.15.99:0/3146998212 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9a380d2c80 msgr2=0x7f9a3817c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:00.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.790+0000 7f9a36a00640 1 --2- 172.21.15.99:0/3146998212 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9a380d2c80 0x7f9a3817c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:00.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.790+0000 7f9a36a00640 1 -- 172.21.15.99:0/3146998212 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a38189ed0 msgr2=0x7f9a381548c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:00.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.790+0000 7f9a36a00640 1 --2- 172.21.15.99:0/3146998212 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a38189ed0 0x7f9a381548c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:00.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.790+0000 7f9a36a00640 1 -- 172.21.15.99:0/3146998212 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a3817d1d0 con 0x7f9a3815dc20 2024-02-21T23:02:00.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.790+0000 7f9a36a00640 1 --2- 172.21.15.99:0/3146998212 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9a3815dc20 0x7f9a3817ca30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9a24000f60 tx=0x7f9a2400c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:00.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.791+0000 7f9a2f400640 1 -- 172.21.15.99:0/3146998212 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a24017070 con 0x7f9a3815dc20 2024-02-21T23:02:00.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.791+0000 7f9a2f400640 1 -- 172.21.15.99:0/3146998212 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a24005ce0 con 0x7f9a3815dc20 2024-02-21T23:02:00.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.791+0000 7f9a2f400640 1 -- 172.21.15.99:0/3146998212 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a24007310 con 0x7f9a3815dc20 2024-02-21T23:02:00.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.791+0000 7f9a3ce00640 1 -- 172.21.15.99:0/3146998212 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a3817d4b0 con 0x7f9a3815dc20 2024-02-21T23:02:00.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.791+0000 7f9a3ce00640 1 -- 172.21.15.99:0/3146998212 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a3821fc10 con 0x7f9a3815dc20 2024-02-21T23:02:00.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.792+0000 7f9a3ce00640 1 -- 172.21.15.99:0/3146998212 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a3821fa00 con 0x7f9a3815dc20 2024-02-21T23:02:00.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.796+0000 7f9a2f400640 1 -- 172.21.15.99:0/3146998212 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 6) v1 ==== 134407+0+0 (secure 0 0 0) 0x7f9a2401a070 con 0x7f9a3815dc20 2024-02-21T23:02:00.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.797+0000 7f9a2f400640 1 --2- 172.21.15.99:0/3146998212 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f9a1809edf0 0x7f9a180a12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:00.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.798+0000 7f9a2f400640 1 -- 172.21.15.99:0/3146998212 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f9a240c9210 con 0x7f9a3815dc20 2024-02-21T23:02:00.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.798+0000 7f9a37400640 1 --2- 172.21.15.99:0/3146998212 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f9a1809edf0 0x7f9a180a12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:00.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.799+0000 7f9a37400640 1 --2- 172.21.15.99:0/3146998212 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f9a1809edf0 0x7f9a180a12b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9a28009560 tx=0x7f9a2803b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:00.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:00.803+0000 7f9a2f400640 1 -- 172.21.15.99:0/3146998212 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f9a24021020 con 0x7f9a3815dc20 2024-02-21T23:02:00.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.002+0000 7f9a3ce00640 1 -- 172.21.15.99:0/3146998212 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9a38068320 con 0x7f9a3815dc20 2024-02-21T23:02:00.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.004+0000 7f9a2f400640 1 -- 172.21.15.99:0/3146998212 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+23759 (secure 0 0 0) 0x7f9a24096db0 con 0x7f9a3815dc20 2024-02-21T23:02:00.993 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T23:02:00.993 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":31,"fsid":"e8af98cd-45a1-425f-96a7-f24da8ee4efb","created":"2024-02-21T23:00:44.699708+0000","modified":"2024-02-21T23:01:50.451929+0000","last_up_change":"2024-02-21T23:00:55.749829+0000","last_in_change":"2024-02-21T23:00:48.332297+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T23:00:57.020557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":11.760000228881836,"score_stable":11.760000228881836,"optimal_score":0.17000000178813934,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-21T23:01:01.124398+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-21T23:01:01.684258+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-21T23:01:05.290089+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c49de9b2-dc53-4882-b14c-7059ed40bf59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6809","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6811","nonce":1026112937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6813","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6815","nonce":1026112937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6823","nonce":1026112937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6819","nonce":1026112937}]},"public_addr":"172.21.15.99:6811/1026112937","cluster_addr":"172.21.15.99:6815/1026112937","heartbeat_back_addr":"172.21.15.99:6823/1026112937","heartbeat_front_addr":"172.21.15.99:6819/1026112937","state":["exists","up"]},{"osd":1,"uuid":"58398292-2fe5-4291-94fd-03a0ca29d49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6827","nonce":3030871566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6829","nonce":3030871566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6833","nonce":3030871566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6831","nonce":3030871566}]},"public_addr":"172.21.15.162:6827/3030871566","cluster_addr":"172.21.15.162:6829/3030871566","heartbeat_back_addr":"172.21.15.162:6833/3030871566","heartbeat_front_addr":"172.21.15.162:6831/3030871566","state":["exists","up"]},{"osd":2,"uuid":"94cddec1-e08f-438d-a7c8-48a0e47d71a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6818","nonce":2782386148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6821","nonce":2782386148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6827","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6829","nonce":2782386148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6823","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6825","nonce":2782386148}]},"public_addr":"172.21.15.181:6818/2782386148","cluster_addr":"172.21.15.181:6821/2782386148","heartbeat_back_addr":"172.21.15.181:6829/2782386148","heartbeat_front_addr":"172.21.15.181:6825/2782386148","state":["exists","up"]},{"osd":3,"uuid":"d29abb74-9b89-4fd7-88b1-7c2eb8231189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6801","nonce":2316185310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6803","nonce":2316185310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6807","nonce":2316185310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6805","nonce":2316185310}]},"public_addr":"172.21.15.99:6801/2316185310","cluster_addr":"172.21.15.99:6803/2316185310","heartbeat_back_addr":"172.21.15.99:6807/2316185310","heartbeat_front_addr":"172.21.15.99:6805/2316185310","state":["exists","up"]},{"osd":4,"uuid":"0d8c9ea3-880a-4d69-9dcb-cf7d35abd449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6811","nonce":3137681258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6813","nonce":3137681258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6817","nonce":3137681258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6815","nonce":3137681258}]},"public_addr":"172.21.15.162:6811/3137681258","cluster_addr":"172.21.15.162:6813/3137681258","heartbeat_back_addr":"172.21.15.162:6817/3137681258","heartbeat_front_addr":"172.21.15.162:6815/3137681258","state":["exists","up"]},{"osd":5,"uuid":"2e3a9340-6fd0-4d7a-8e00-fe305649296e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6801","nonce":2011264527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6803","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6805","nonce":2011264527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6811","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6813","nonce":2011264527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6807","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6809","nonce":2011264527}]},"public_addr":"172.21.15.181:6801/2011264527","cluster_addr":"172.21.15.181:6805/2011264527","heartbeat_back_addr":"172.21.15.181:6813/2011264527","heartbeat_front_addr":"172.21.15.181:6809/2011264527","state":["exists","up"]},{"osd":6,"uuid":"d9e37ce7-1b0e-4019-8f2e-b670403abf7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6810","nonce":753870050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6814","nonce":753870050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6822","nonce":753870050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6818","nonce":753870050}]},"public_addr":"172.21.15.99:6810/753870050","cluster_addr":"172.21.15.99:6814/753870050","heartbeat_back_addr":"172.21.15.99:6822/753870050","heartbeat_front_addr":"172.21.15.99:6818/753870050","state":["exists","up"]},{"osd":7,"uuid":"49988754-232e-4b8c-bd72-bfa25b418e5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6803","nonce":1659412949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6805","nonce":1659412949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6809","nonce":1659412949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6807","nonce":1659412949}]},"public_addr":"172.21.15.162:6803/1659412949","cluster_addr":"172.21.15.162:6805/1659412949","heartbeat_back_addr":"172.21.15.162:6809/1659412949","heartbeat_front_addr":"172.21.15.162:6807/1659412949","state":["exists","up"]},{"osd":8,"uuid":"ebc6e462-8368-4d64-b242-9c8735ac672c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6804","nonce":3389807042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6808","nonce":3389807042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6815","nonce":3389807042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6812","nonce":3389807042}]},"public_addr":"172.21.15.181:6804/3389807042","cluster_addr":"172.21.15.181:6808/3389807042","heartbeat_back_addr":"172.21.15.181:6815/3389807042","heartbeat_front_addr":"172.21.15.181:6812/3389807042","state":["exists","up"]},{"osd":9,"uuid":"72af1b02-b965-4d6a-8964-527ec24c4daa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6825","nonce":4055669590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6827","nonce":4055669590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6831","nonce":4055669590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6829","nonce":4055669590}]},"public_addr":"172.21.15.99:6825/4055669590","cluster_addr":"172.21.15.99:6827/4055669590","heartbeat_back_addr":"172.21.15.99:6831/4055669590","heartbeat_front_addr":"172.21.15.99:6829/4055669590","state":["exists","up"]},{"osd":10,"uuid":"adb5cb06-6453-41e4-b847-d7c78bbb7d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6819","nonce":1421879617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6821","nonce":1421879617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6825","nonce":1421879617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6823","nonce":1421879617}]},"public_addr":"172.21.15.162:6819/1421879617","cluster_addr":"172.21.15.162:6821/1421879617","heartbeat_back_addr":"172.21.15.162:6825/1421879617","heartbeat_front_addr":"172.21.15.162:6823/1421879617","state":["exists","up"]},{"osd":11,"uuid":"118563d9-1e8f-4dc7-a92c-2f4c4dc3e20f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6817","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6819","nonce":3219928272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6824","nonce":3219928272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6831","nonce":3219928272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6828","nonce":3219928272}]},"public_addr":"172.21.15.181:6819/3219928272","cluster_addr":"172.21.15.181:6824/3219928272","heartbeat_back_addr":"172.21.15.181:6831/3219928272","heartbeat_front_addr":"172.21.15.181:6828/3219928272","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.651219+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.549859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.529659+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.591004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.440836+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.414250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.630130+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.411954+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.439371+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.428173+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.511203+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.482806+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.6","mappings":[{"from":9,"to":11}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.14","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T23:02:00.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.008+0000 7f9a3ce00640 1 -- 172.21.15.99:0/3146998212 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f9a1809edf0 msgr2=0x7f9a180a12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:00.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.008+0000 7f9a3ce00640 1 --2- 172.21.15.99:0/3146998212 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f9a1809edf0 0x7f9a180a12b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9a28009560 tx=0x7f9a2803b040 comp rx=0 tx=0).stop 2024-02-21T23:02:00.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.008+0000 7f9a3ce00640 1 -- 172.21.15.99:0/3146998212 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9a3815dc20 msgr2=0x7f9a3817ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:00.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.008+0000 7f9a3ce00640 1 --2- 172.21.15.99:0/3146998212 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9a3815dc20 0x7f9a3817ca30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9a24000f60 tx=0x7f9a2400c800 comp rx=0 tx=0).stop 2024-02-21T23:02:00.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.008+0000 7f9a3ce00640 1 -- 172.21.15.99:0/3146998212 shutdown_connections 2024-02-21T23:02:00.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.008+0000 7f9a3ce00640 1 --2- 172.21.15.99:0/3146998212 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f9a1809edf0 0x7f9a180a12b0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:00.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.008+0000 7f9a3ce00640 1 --2- 172.21.15.99:0/3146998212 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a38189ed0 0x7f9a381548c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:00.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.008+0000 7f9a3ce00640 1 --2- 172.21.15.99:0/3146998212 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9a3815dc20 0x7f9a3817ca30 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:00.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.008+0000 7f9a3ce00640 1 --2- 172.21.15.99:0/3146998212 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9a380d2c80 0x7f9a3817c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:00.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.008+0000 7f9a3ce00640 1 -- 172.21.15.99:0/3146998212 >> 172.21.15.99:0/3146998212 conn(0x7f9a38072210 msgr2=0x7f9a3815cd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:00.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.008+0000 7f9a3ce00640 1 -- 172.21.15.99:0/3146998212 shutdown_connections 2024-02-21T23:02:00.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.008+0000 7f9a3ce00640 1 -- 172.21.15.99:0/3146998212 wait complete. 2024-02-21T23:02:01.022 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-21T23:00:57.020557+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 11.760000228881836, 'score_stable': 11.760000228881836, 'optimal_score': 0.17000000178813934, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-21T23:01:01.124398+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-21T23:01:01.684258+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-02-21T23:01:05.290089+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-02-21T23:02:01.023 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-21T23:02:01.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.232+0000 7f6f16600640 1 Processor -- start 2024-02-21T23:02:01.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.232+0000 7f6f16600640 1 -- start start 2024-02-21T23:02:01.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.234+0000 7f6f16600640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f6f10186400 0x7f6f10187ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:01.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.234+0000 7f6f16600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6f101867e0 0x7f6f10188010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:01.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.234+0000 7f6f16600640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f100cf820 con 0x7f6f10188550 2024-02-21T23:02:01.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.234+0000 7f6f16600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f10187640 con 0x7f6f101867e0 2024-02-21T23:02:01.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.234+0000 7f6f16600640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f100cfb00 con 0x7f6f10186400 2024-02-21T23:02:01.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.235+0000 7f6f0ea00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6f101867e0 0x7f6f10188010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:01.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.235+0000 7f6f0f400640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f6f10186400 0x7f6f10187ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:01.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.235+0000 7f6f0f400640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f6f10186400 0x7f6f10187ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:34950/0 (socket says 172.21.15.99:34950) 2024-02-21T23:02:01.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.235+0000 7f6f0f400640 1 -- 172.21.15.99:0/3524707267 learned_addr learned my addr 172.21.15.99:0/3524707267 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:01.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.235+0000 7f6f0ea00640 1 -- 172.21.15.99:0/3524707267 >> v2:172.21.15.181:3300/0 conn(0x7f6f10186400 msgr2=0x7f6f10187ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:01.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.235+0000 7f6f0ea00640 1 --2- 172.21.15.99:0/3524707267 >> v2:172.21.15.181:3300/0 conn(0x7f6f10186400 0x7f6f10187ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:01.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.235+0000 7f6f0ea00640 1 -- 172.21.15.99:0/3524707267 >> v1:172.21.15.99:6789/0 conn(0x7f6f10188550 legacy=0x7f6f1018c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:01.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.235+0000 7f6f0ea00640 1 -- 172.21.15.99:0/3524707267 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f10186d10 con 0x7f6f101867e0 2024-02-21T23:02:01.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.235+0000 7f6f0e000640 1 -- 172.21.15.99:0/3524707267 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2879270031 0 0) 0x7f6f100cf820 con 0x7f6f10188550 2024-02-21T23:02:01.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.235+0000 7f6f0f400640 1 --2- 172.21.15.99:0/3524707267 >> v2:172.21.15.181:3300/0 conn(0x7f6f10186400 0x7f6f10187ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:02:01.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.237+0000 7f6f0ea00640 1 --2- 172.21.15.99:0/3524707267 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f101867e0 0x7f6f10188010 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6f100d3f70 tx=0x7f6ef802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6523916e6fb8dc9 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:01.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.237+0000 7f6f0e000640 1 -- 172.21.15.99:0/3524707267 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef80315a0 con 0x7f6f101867e0 2024-02-21T23:02:01.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.237+0000 7f6f0e000640 1 -- 172.21.15.99:0/3524707267 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ef8037070 con 0x7f6f101867e0 2024-02-21T23:02:01.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.237+0000 7f6f0e000640 1 -- 172.21.15.99:0/3524707267 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef8031960 con 0x7f6f101867e0 2024-02-21T23:02:01.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.238+0000 7f6f16600640 1 -- 172.21.15.99:0/3524707267 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f101867e0 msgr2=0x7f6f10188010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:01.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.238+0000 7f6f16600640 1 --2- 172.21.15.99:0/3524707267 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f101867e0 0x7f6f10188010 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6f100d3f70 tx=0x7f6ef802b840 comp rx=0 tx=0).stop 2024-02-21T23:02:01.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.238+0000 7f6f16600640 1 -- 172.21.15.99:0/3524707267 shutdown_connections 2024-02-21T23:02:01.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.238+0000 7f6f16600640 1 --2- 172.21.15.99:0/3524707267 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f101867e0 0x7f6f10188010 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:01.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.238+0000 7f6f16600640 1 --2- 172.21.15.99:0/3524707267 >> v2:172.21.15.181:3300/0 conn(0x7f6f10186400 0x7f6f10187ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:01.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.238+0000 7f6f16600640 1 -- 172.21.15.99:0/3524707267 >> 172.21.15.99:0/3524707267 conn(0x7f6f100d6af0 msgr2=0x7f6f100740b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:01.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.238+0000 7f6f16600640 1 -- 172.21.15.99:0/3524707267 shutdown_connections 2024-02-21T23:02:01.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.238+0000 7f6f16600640 1 -- 172.21.15.99:0/3524707267 wait complete. 2024-02-21T23:02:01.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.240+0000 7f6f16600640 1 Processor -- start 2024-02-21T23:02:01.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.240+0000 7f6f16600640 1 -- start start 2024-02-21T23:02:01.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.242+0000 7f6f16600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f10186400 0x7f6f1021f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:01.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.242+0000 7f6f16600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f101867e0 0x7f6f10181e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:01.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.242+0000 7f6f16600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f10188550 0x7f6f1015d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:01.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.243+0000 7f6f16600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f100d5330 con 0x7f6f10186400 2024-02-21T23:02:01.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.243+0000 7f6f16600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f101872d0 con 0x7f6f10188550 2024-02-21T23:02:01.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.243+0000 7f6f16600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f100d54b0 con 0x7f6f101867e0 2024-02-21T23:02:01.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.243+0000 7f6f0f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f10186400 0x7f6f1021f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:01.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.243+0000 7f6f0f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f10186400 0x7f6f1021f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50196/0 (socket says 172.21.15.99:50196) 2024-02-21T23:02:01.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.243+0000 7f6f0f400640 1 -- 172.21.15.99:0/559747315 learned_addr learned my addr 172.21.15.99:0/559747315 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:01.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.243+0000 7f6f0ea00640 1 --2- 172.21.15.99:0/559747315 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f101867e0 0x7f6f10181e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:01.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.243+0000 7f6f0fe00640 1 --2- 172.21.15.99:0/559747315 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f10188550 0x7f6f1015d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:01.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.243+0000 7f6f0f400640 1 -- 172.21.15.99:0/559747315 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f101867e0 msgr2=0x7f6f10181e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:01.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.243+0000 7f6f0f400640 1 --2- 172.21.15.99:0/559747315 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f101867e0 0x7f6f10181e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:01.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.243+0000 7f6f0f400640 1 -- 172.21.15.99:0/559747315 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f10188550 msgr2=0x7f6f1015d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:01.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.243+0000 7f6f0f400640 1 --2- 172.21.15.99:0/559747315 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f10188550 0x7f6f1015d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:01.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.243+0000 7f6f0f400640 1 -- 172.21.15.99:0/559747315 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f1008f7a0 con 0x7f6f10186400 2024-02-21T23:02:01.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.244+0000 7f6f0f400640 1 --2- 172.21.15.99:0/559747315 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f10186400 0x7f6f1021f120 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6f0000efc0 tx=0x7f6f0000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:01.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.244+0000 7f6f07400640 1 -- 172.21.15.99:0/559747315 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f00014480 con 0x7f6f10186400 2024-02-21T23:02:01.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.244+0000 7f6f07400640 1 -- 172.21.15.99:0/559747315 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f00019070 con 0x7f6f10186400 2024-02-21T23:02:01.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.244+0000 7f6f07400640 1 -- 172.21.15.99:0/559747315 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f00014820 con 0x7f6f10186400 2024-02-21T23:02:01.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.244+0000 7f6f16600640 1 -- 172.21.15.99:0/559747315 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f101810d0 con 0x7f6f10186400 2024-02-21T23:02:01.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.244+0000 7f6f16600640 1 -- 172.21.15.99:0/559747315 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f10181690 con 0x7f6f10186400 2024-02-21T23:02:01.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.245+0000 7f6f16600640 1 -- 172.21.15.99:0/559747315 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f10068780 con 0x7f6f10186400 2024-02-21T23:02:01.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.250+0000 7f6f07400640 1 -- 172.21.15.99:0/559747315 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 6) v1 ==== 134407+0+0 (secure 0 0 0) 0x7f6f00005d10 con 0x7f6f10186400 2024-02-21T23:02:01.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.251+0000 7f6f07400640 1 --2- 172.21.15.99:0/559747315 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f6eec09edf0 0x7f6eec0a12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:01.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.251+0000 7f6f07400640 1 -- 172.21.15.99:0/559747315 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f6f000cad20 con 0x7f6f10186400 2024-02-21T23:02:01.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.251+0000 7f6f0ea00640 1 --2- 172.21.15.99:0/559747315 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f6eec09edf0 0x7f6eec0a12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:01.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.252+0000 7f6f0ea00640 1 --2- 172.21.15.99:0/559747315 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f6eec09edf0 0x7f6eec0a12b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6ef8036000 tx=0x7f6ef8008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:01.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.256+0000 7f6f07400640 1 -- 172.21.15.99:0/559747315 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f6f00010040 con 0x7f6f10186400 2024-02-21T23:02:01.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.495+0000 7f6f16600640 1 -- 172.21.15.99:0/559747315 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6f100d3d20 con 0x7f6f10186400 2024-02-21T23:02:01.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.496+0000 7f6f07400640 1 -- 172.21.15.99:0/559747315 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6f00098da0 con 0x7f6f10186400 2024-02-21T23:02:01.485 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 1 2024-02-21T23:02:01.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.499+0000 7f6f16600640 1 -- 172.21.15.99:0/559747315 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f6eec09edf0 msgr2=0x7f6eec0a12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:01.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.499+0000 7f6f16600640 1 --2- 172.21.15.99:0/559747315 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f6eec09edf0 0x7f6eec0a12b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6ef8036000 tx=0x7f6ef8008030 comp rx=0 tx=0).stop 2024-02-21T23:02:01.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.499+0000 7f6f16600640 1 -- 172.21.15.99:0/559747315 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f10186400 msgr2=0x7f6f1021f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:01.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.499+0000 7f6f16600640 1 --2- 172.21.15.99:0/559747315 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f10186400 0x7f6f1021f120 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6f0000efc0 tx=0x7f6f0000c490 comp rx=0 tx=0).stop 2024-02-21T23:02:01.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.499+0000 7f6f16600640 1 -- 172.21.15.99:0/559747315 shutdown_connections 2024-02-21T23:02:01.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.499+0000 7f6f16600640 1 --2- 172.21.15.99:0/559747315 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f6eec09edf0 0x7f6eec0a12b0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:01.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.499+0000 7f6f16600640 1 --2- 172.21.15.99:0/559747315 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f10188550 0x7f6f1015d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:01.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.499+0000 7f6f16600640 1 --2- 172.21.15.99:0/559747315 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f101867e0 0x7f6f10181e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:01.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.499+0000 7f6f16600640 1 --2- 172.21.15.99:0/559747315 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f10186400 0x7f6f1021f120 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:01.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.499+0000 7f6f16600640 1 -- 172.21.15.99:0/559747315 >> 172.21.15.99:0/559747315 conn(0x7f6f100d6af0 msgr2=0x7f6f100d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:01.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.499+0000 7f6f16600640 1 -- 172.21.15.99:0/559747315 shutdown_connections 2024-02-21T23:02:01.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.499+0000 7f6f16600640 1 -- 172.21.15.99:0/559747315 wait complete. 2024-02-21T23:02:01.512 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-21T23:02:01.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.728+0000 7f490e800640 1 Processor -- start 2024-02-21T23:02:01.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.729+0000 7f490e800640 1 -- start start 2024-02-21T23:02:01.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.732+0000 7f490e800640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f490817f7b0 0x7f49080f8f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:01.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.732+0000 7f490e800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f49080facd0 0x7f490818a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:01.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.732+0000 7f490e800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f490818aaa0 0x7f490818c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:01.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.732+0000 7f490e800640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49080f9540 con 0x7f490818aaa0 2024-02-21T23:02:01.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.732+0000 7f490e800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49080f9820 con 0x7f49080facd0 2024-02-21T23:02:01.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.732+0000 7f490e800640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49080f9b00 con 0x7f490817f7b0 2024-02-21T23:02:01.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.733+0000 7f4907400640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f490817f7b0 0x7f49080f8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:01.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.733+0000 7f4907e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f490818aaa0 0x7f490818c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:01.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.733+0000 7f4907400640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f490817f7b0 0x7f49080f8f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:34964/0 (socket says 172.21.15.99:34964) 2024-02-21T23:02:01.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.733+0000 7f4907400640 1 -- 172.21.15.99:0/2150896144 learned_addr learned my addr 172.21.15.99:0/2150896144 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:01.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.733+0000 7f48ffe00640 1 --2- 172.21.15.99:0/2150896144 >> v2:172.21.15.162:3300/0 conn(0x7f49080facd0 0x7f490818a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:01.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.733+0000 7f4907e00640 1 -- 172.21.15.99:0/2150896144 >> v2:172.21.15.181:3300/0 conn(0x7f490817f7b0 msgr2=0x7f49080f8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:01.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.733+0000 7f4907e00640 1 --2- 172.21.15.99:0/2150896144 >> v2:172.21.15.181:3300/0 conn(0x7f490817f7b0 0x7f49080f8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:01.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.733+0000 7f4907e00640 1 -- 172.21.15.99:0/2150896144 >> v2:172.21.15.162:3300/0 conn(0x7f49080facd0 msgr2=0x7f490818a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:01.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.733+0000 7f4907e00640 1 --2- 172.21.15.99:0/2150896144 >> v2:172.21.15.162:3300/0 conn(0x7f49080facd0 0x7f490818a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:01.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.733+0000 7f4907e00640 1 -- 172.21.15.99:0/2150896144 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49080f9de0 con 0x7f490818aaa0 2024-02-21T23:02:01.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.733+0000 7f4907400640 1 --2- 172.21.15.99:0/2150896144 >> v2:172.21.15.181:3300/0 conn(0x7f490817f7b0 0x7f49080f8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:02:01.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.733+0000 7f48ffe00640 1 --2- 172.21.15.99:0/2150896144 >> v2:172.21.15.162:3300/0 conn(0x7f49080facd0 0x7f490818a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:02:01.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.734+0000 7f4907e00640 1 --2- 172.21.15.99:0/2150896144 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f490818aaa0 0x7f490818c140 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f49080d6580 tx=0x7f490002be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c537e8b09e3eef4e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:01.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.735+0000 7f4906a00640 1 -- 172.21.15.99:0/2150896144 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4900039070 con 0x7f490818aaa0 2024-02-21T23:02:01.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.735+0000 7f4906a00640 1 -- 172.21.15.99:0/2150896144 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f490002cc00 con 0x7f490818aaa0 2024-02-21T23:02:01.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.735+0000 7f4906a00640 1 -- 172.21.15.99:0/2150896144 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4900034440 con 0x7f490818aaa0 2024-02-21T23:02:01.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.735+0000 7f490e800640 1 -- 172.21.15.99:0/2150896144 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f490818aaa0 msgr2=0x7f490818c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:01.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.735+0000 7f490e800640 1 --2- 172.21.15.99:0/2150896144 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f490818aaa0 0x7f490818c140 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f49080d6580 tx=0x7f490002be50 comp rx=0 tx=0).stop 2024-02-21T23:02:01.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.735+0000 7f490e800640 1 -- 172.21.15.99:0/2150896144 shutdown_connections 2024-02-21T23:02:01.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.735+0000 7f490e800640 1 --2- 172.21.15.99:0/2150896144 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f490818aaa0 0x7f490818c140 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:01.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.735+0000 7f490e800640 1 --2- 172.21.15.99:0/2150896144 >> v2:172.21.15.162:3300/0 conn(0x7f49080facd0 0x7f490818a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:01.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.735+0000 7f490e800640 1 --2- 172.21.15.99:0/2150896144 >> v2:172.21.15.181:3300/0 conn(0x7f490817f7b0 0x7f49080f8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:01.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.735+0000 7f490e800640 1 -- 172.21.15.99:0/2150896144 >> 172.21.15.99:0/2150896144 conn(0x7f49080740b0 msgr2=0x7f49080744c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:01.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.736+0000 7f490e800640 1 -- 172.21.15.99:0/2150896144 shutdown_connections 2024-02-21T23:02:01.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.736+0000 7f490e800640 1 -- 172.21.15.99:0/2150896144 wait complete. 2024-02-21T23:02:01.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.738+0000 7f490e800640 1 Processor -- start 2024-02-21T23:02:01.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.738+0000 7f490e800640 1 -- start start 2024-02-21T23:02:01.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.740+0000 7f490e800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f49080facd0 0x7f490806ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:01.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.740+0000 7f490e800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f490817f7b0 0x7f490817b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:01.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.740+0000 7f490e800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f490818aaa0 0x7f490821c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:01.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.740+0000 7f490e800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49080fb150 con 0x7f49080facd0 2024-02-21T23:02:01.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.740+0000 7f490e800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f490818a040 con 0x7f490817f7b0 2024-02-21T23:02:01.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.740+0000 7f490e800640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49080fb2d0 con 0x7f490818aaa0 2024-02-21T23:02:01.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.741+0000 7f4907400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f49080facd0 0x7f490806ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:01.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.741+0000 7f48ffe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f490817f7b0 0x7f490817b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:01.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.741+0000 7f4907400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f49080facd0 0x7f490806ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50212/0 (socket says 172.21.15.99:50212) 2024-02-21T23:02:01.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.741+0000 7f4907400640 1 -- 172.21.15.99:0/2349792305 learned_addr learned my addr 172.21.15.99:0/2349792305 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:01.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.741+0000 7f4907e00640 1 --2- 172.21.15.99:0/2349792305 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f490818aaa0 0x7f490821c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:01.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.741+0000 7f4907400640 1 -- 172.21.15.99:0/2349792305 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f490818aaa0 msgr2=0x7f490821c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:01.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.741+0000 7f4907400640 1 --2- 172.21.15.99:0/2349792305 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f490818aaa0 0x7f490821c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:01.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.741+0000 7f4907400640 1 -- 172.21.15.99:0/2349792305 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f490817f7b0 msgr2=0x7f490817b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:01.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.741+0000 7f4907400640 1 --2- 172.21.15.99:0/2349792305 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f490817f7b0 0x7f490817b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:01.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.741+0000 7f4907400640 1 -- 172.21.15.99:0/2349792305 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f490821f810 con 0x7f49080facd0 2024-02-21T23:02:01.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.741+0000 7f48ffe00640 1 --2- 172.21.15.99:0/2349792305 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f490817f7b0 0x7f490817b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:02:01.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.742+0000 7f4907400640 1 --2- 172.21.15.99:0/2349792305 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f49080facd0 0x7f490806ba30 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f48f800e9e0 tx=0x7f48f800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:01.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.742+0000 7f48ff400640 1 -- 172.21.15.99:0/2349792305 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f8017070 con 0x7f49080facd0 2024-02-21T23:02:01.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.742+0000 7f48ff400640 1 -- 172.21.15.99:0/2349792305 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48f800c9d0 con 0x7f49080facd0 2024-02-21T23:02:01.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.742+0000 7f490e800640 1 -- 172.21.15.99:0/2349792305 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f490806af90 con 0x7f49080facd0 2024-02-21T23:02:01.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.742+0000 7f48ff400640 1 -- 172.21.15.99:0/2349792305 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f800cd80 con 0x7f49080facd0 2024-02-21T23:02:01.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.742+0000 7f490e800640 1 -- 172.21.15.99:0/2349792305 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f490821f530 con 0x7f49080facd0 2024-02-21T23:02:01.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.744+0000 7f490e800640 1 -- 172.21.15.99:0/2349792305 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4908068780 con 0x7f49080facd0 2024-02-21T23:02:01.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.747+0000 7f48ff400640 1 -- 172.21.15.99:0/2349792305 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 6) v1 ==== 134407+0+0 (secure 0 0 0) 0x7f48f801a070 con 0x7f49080facd0 2024-02-21T23:02:01.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.749+0000 7f48ff400640 1 --2- 172.21.15.99:0/2349792305 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f48e409edf0 0x7f48e40a12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:01.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.749+0000 7f48ff400640 1 -- 172.21.15.99:0/2349792305 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f48f80c9990 con 0x7f49080facd0 2024-02-21T23:02:01.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.749+0000 7f48ffe00640 1 --2- 172.21.15.99:0/2349792305 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f48e409edf0 0x7f48e40a12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:01.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.750+0000 7f48ffe00640 1 --2- 172.21.15.99:0/2349792305 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f48e409edf0 0x7f48e40a12b0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f48f0009580 tx=0x7f48f0009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:01.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:01.756+0000 7f48ff400640 1 -- 172.21.15.99:0/2349792305 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f48f80975c0 con 0x7f49080facd0 2024-02-21T23:02:02.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.036+0000 7f490e800640 1 -- 172.21.15.99:0/2349792305 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f49080fd420 con 0x7f49080facd0 2024-02-21T23:02:02.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.036+0000 7f48ff400640 1 -- 172.21.15.99:0/2349792305 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7f48f809b660 con 0x7f49080facd0 2024-02-21T23:02:02.025 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 32 2024-02-21T23:02:02.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.039+0000 7f490e800640 1 -- 172.21.15.99:0/2349792305 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f48e409edf0 msgr2=0x7f48e40a12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:02.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.039+0000 7f490e800640 1 --2- 172.21.15.99:0/2349792305 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f48e409edf0 0x7f48e40a12b0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f48f0009580 tx=0x7f48f0009190 comp rx=0 tx=0).stop 2024-02-21T23:02:02.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.039+0000 7f490e800640 1 -- 172.21.15.99:0/2349792305 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f49080facd0 msgr2=0x7f490806ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:02.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.039+0000 7f490e800640 1 --2- 172.21.15.99:0/2349792305 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f49080facd0 0x7f490806ba30 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f48f800e9e0 tx=0x7f48f800eea0 comp rx=0 tx=0).stop 2024-02-21T23:02:02.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.039+0000 7f490e800640 1 -- 172.21.15.99:0/2349792305 shutdown_connections 2024-02-21T23:02:02.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.039+0000 7f490e800640 1 --2- 172.21.15.99:0/2349792305 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f48e409edf0 0x7f48e40a12b0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:02.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.039+0000 7f490e800640 1 --2- 172.21.15.99:0/2349792305 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f490818aaa0 0x7f490821c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:02.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.039+0000 7f490e800640 1 --2- 172.21.15.99:0/2349792305 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f490817f7b0 0x7f490817b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:02.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.039+0000 7f490e800640 1 --2- 172.21.15.99:0/2349792305 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f49080facd0 0x7f490806ba30 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:02.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.039+0000 7f490e800640 1 -- 172.21.15.99:0/2349792305 >> 172.21.15.99:0/2349792305 conn(0x7f49080740b0 msgr2=0x7f4908074490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:02.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.039+0000 7f490e800640 1 -- 172.21.15.99:0/2349792305 shutdown_connections 2024-02-21T23:02:02.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.039+0000 7f490e800640 1 -- 172.21.15.99:0/2349792305 wait complete. 2024-02-21T23:02:02.052 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-21T23:02:02.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.249+0000 7fe7e6400640 1 Processor -- start 2024-02-21T23:02:02.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.249+0000 7fe7e6400640 1 -- start start 2024-02-21T23:02:02.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.251+0000 7fe7e6400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe7e00fb9e0 0x7fe7e0190350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:02.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.251+0000 7fe7e6400640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7e00fd490 con 0x7fe7e01648c0 2024-02-21T23:02:02.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.251+0000 7fe7e6400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7e00fd770 con 0x7fe7e00fce30 2024-02-21T23:02:02.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.251+0000 7fe7e6400640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7e00fbe70 con 0x7fe7e00fb9e0 2024-02-21T23:02:02.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.251+0000 7fe7e5000640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fe7e01648c0 0x7fe7e0186d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:36432/0 (socket says 172.21.15.99:36432) 2024-02-21T23:02:02.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.251+0000 7fe7dfe00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fe7e00fce30 0x7fe7e0187440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.99:58882/0 (socket says 172.21.15.99:58882) 2024-02-21T23:02:02.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.251+0000 7fe7e5000640 1 -- 172.21.15.99:0/811010558 learned_addr learned my addr 172.21.15.99:0/811010558 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:02:02.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.252+0000 7fe7e5a00640 1 --2- 172.21.15.99:0/811010558 >> v2:172.21.15.162:3300/0 conn(0x7fe7e00fb9e0 0x7fe7e0190350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:02.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.252+0000 7fe7df400640 1 -- 172.21.15.99:0/811010558 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2745402556 0 0) 0x7fe7e00fd770 con 0x7fe7e00fce30 2024-02-21T23:02:02.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.252+0000 7fe7df400640 1 -- 172.21.15.99:0/811010558 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7c8003520 con 0x7fe7e00fce30 2024-02-21T23:02:02.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.252+0000 7fe7df400640 1 -- 172.21.15.99:0/811010558 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4037135333 0 0) 0x7fe7e00fd490 con 0x7fe7e01648c0 2024-02-21T23:02:02.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.252+0000 7fe7df400640 1 -- 172.21.15.99:0/811010558 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7e00fd770 con 0x7fe7e01648c0 2024-02-21T23:02:02.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.252+0000 7fe7e5a00640 1 -- 172.21.15.99:0/811010558 >> v1:172.21.15.162:6789/0 conn(0x7fe7e00fce30 legacy=0x7fe7e0187440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:02.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.252+0000 7fe7e5a00640 1 -- 172.21.15.99:0/811010558 >> v1:172.21.15.99:6789/0 conn(0x7fe7e01648c0 legacy=0x7fe7e0186d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:02.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.252+0000 7fe7e5a00640 1 -- 172.21.15.99:0/811010558 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7e00fda50 con 0x7fe7e00fb9e0 2024-02-21T23:02:02.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.254+0000 7fe7e5a00640 1 --2- 172.21.15.99:0/811010558 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7e00fb9e0 0x7fe7e0190350 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe7d8009d90 tx=0x7fe7d802bf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c1be99068969e69a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:02.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.254+0000 7fe7df400640 1 -- 172.21.15.99:0/811010558 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d8039070 con 0x7fe7e00fb9e0 2024-02-21T23:02:02.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.254+0000 7fe7df400640 1 -- 172.21.15.99:0/811010558 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7d802cd00 con 0x7fe7e00fb9e0 2024-02-21T23:02:02.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.254+0000 7fe7df400640 1 -- 172.21.15.99:0/811010558 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d8034660 con 0x7fe7e00fb9e0 2024-02-21T23:02:02.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.255+0000 7fe7e6400640 1 -- 172.21.15.99:0/811010558 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7e00fb9e0 msgr2=0x7fe7e0190350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:02.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.255+0000 7fe7e6400640 1 --2- 172.21.15.99:0/811010558 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7e00fb9e0 0x7fe7e0190350 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe7d8009d90 tx=0x7fe7d802bf50 comp rx=0 tx=0).stop 2024-02-21T23:02:02.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.255+0000 7fe7e6400640 1 -- 172.21.15.99:0/811010558 shutdown_connections 2024-02-21T23:02:02.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.255+0000 7fe7e6400640 1 --2- 172.21.15.99:0/811010558 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7e00fb9e0 0x7fe7e0190350 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:02.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.255+0000 7fe7e6400640 1 -- 172.21.15.99:0/811010558 >> 172.21.15.99:0/811010558 conn(0x7fe7e00d29c0 msgr2=0x7fe7e00d2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:02.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.255+0000 7fe7e6400640 1 -- 172.21.15.99:0/811010558 shutdown_connections 2024-02-21T23:02:02.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.255+0000 7fe7e6400640 1 -- 172.21.15.99:0/811010558 wait complete. 2024-02-21T23:02:02.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.257+0000 7fe7e6400640 1 Processor -- start 2024-02-21T23:02:02.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.257+0000 7fe7e6400640 1 -- start start 2024-02-21T23:02:02.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.259+0000 7fe7e6400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7e00fb9e0 0x7fe7e0161040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:02.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.259+0000 7fe7e6400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe7e00fce30 0x7fe7e0161580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:02.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.259+0000 7fe7e6400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7e01648c0 0x7fe7e00fa600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:02.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.259+0000 7fe7e6400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e0072920 con 0x7fe7e01648c0 2024-02-21T23:02:02.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.259+0000 7fe7e6400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e00fe010 con 0x7fe7e00fb9e0 2024-02-21T23:02:02.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.259+0000 7fe7e6400640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e0190890 con 0x7fe7e00fce30 2024-02-21T23:02:02.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.259+0000 7fe7e5a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7e01648c0 0x7fe7e00fa600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:02.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.259+0000 7fe7dfe00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe7e00fce30 0x7fe7e0161580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:02.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.259+0000 7fe7e5a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7e01648c0 0x7fe7e00fa600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50216/0 (socket says 172.21.15.99:50216) 2024-02-21T23:02:02.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.259+0000 7fe7e5a00640 1 -- 172.21.15.99:0/3108550768 learned_addr learned my addr 172.21.15.99:0/3108550768 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:02.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.259+0000 7fe7e5000640 1 --2- 172.21.15.99:0/3108550768 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7e00fb9e0 0x7fe7e0161040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:02.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.259+0000 7fe7e5a00640 1 -- 172.21.15.99:0/3108550768 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe7e00fce30 msgr2=0x7fe7e0161580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:02.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.259+0000 7fe7e5a00640 1 --2- 172.21.15.99:0/3108550768 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe7e00fce30 0x7fe7e0161580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:02.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.259+0000 7fe7e5a00640 1 -- 172.21.15.99:0/3108550768 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7e00fb9e0 msgr2=0x7fe7e0161040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:02.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.259+0000 7fe7e5a00640 1 --2- 172.21.15.99:0/3108550768 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7e00fb9e0 0x7fe7e0161040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:02.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.260+0000 7fe7e5a00640 1 -- 172.21.15.99:0/3108550768 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7e017ddc0 con 0x7fe7e01648c0 2024-02-21T23:02:02.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.260+0000 7fe7e5a00640 1 --2- 172.21.15.99:0/3108550768 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7e01648c0 0x7fe7e00fa600 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe7d8009eb0 tx=0x7fe7d8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:02.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.260+0000 7fe7dcc00640 1 -- 172.21.15.99:0/3108550768 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d8044020 con 0x7fe7e01648c0 2024-02-21T23:02:02.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.260+0000 7fe7dcc00640 1 -- 172.21.15.99:0/3108550768 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7d803f470 con 0x7fe7e01648c0 2024-02-21T23:02:02.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.260+0000 7fe7e6400640 1 -- 172.21.15.99:0/3108550768 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7e00f9840 con 0x7fe7e01648c0 2024-02-21T23:02:02.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.261+0000 7fe7dcc00640 1 -- 172.21.15.99:0/3108550768 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d8039040 con 0x7fe7e01648c0 2024-02-21T23:02:02.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.261+0000 7fe7e6400640 1 -- 172.21.15.99:0/3108550768 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7e00f9e00 con 0x7fe7e01648c0 2024-02-21T23:02:02.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.263+0000 7fe7e6400640 1 -- 172.21.15.99:0/3108550768 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7e00cfb30 con 0x7fe7e01648c0 2024-02-21T23:02:02.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.264+0000 7fe7dcc00640 1 -- 172.21.15.99:0/3108550768 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 6) v1 ==== 134407+0+0 (secure 0 0 0) 0x7fe7d8047020 con 0x7fe7e01648c0 2024-02-21T23:02:02.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.265+0000 7fe7dcc00640 1 --2- 172.21.15.99:0/3108550768 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fe7c009eef0 0x7fe7c00a13b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:02.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.265+0000 7fe7dcc00640 1 -- 172.21.15.99:0/3108550768 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fe7d80ec570 con 0x7fe7e01648c0 2024-02-21T23:02:02.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.266+0000 7fe7e5000640 1 --2- 172.21.15.99:0/3108550768 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fe7c009eef0 0x7fe7c00a13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:02.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.266+0000 7fe7e5000640 1 --2- 172.21.15.99:0/3108550768 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fe7c009eef0 0x7fe7c00a13b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe7d4005880 tx=0x7fe7d4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:02.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.274+0000 7fe7dcc00640 1 -- 172.21.15.99:0/3108550768 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fe7e00cfb30 con 0x7fe7e01648c0 2024-02-21T23:02:02.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.515+0000 7fe7e6400640 1 -- 172.21.15.99:0/3108550768 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe7e0068320 con 0x7fe7e01648c0 2024-02-21T23:02:02.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.515+0000 7fe7dcc00640 1 -- 172.21.15.99:0/3108550768 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe7d804e030 con 0x7fe7e01648c0 2024-02-21T23:02:02.504 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 64 2024-02-21T23:02:02.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.519+0000 7fe7e6400640 1 -- 172.21.15.99:0/3108550768 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fe7c009eef0 msgr2=0x7fe7c00a13b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:02.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.519+0000 7fe7e6400640 1 --2- 172.21.15.99:0/3108550768 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fe7c009eef0 0x7fe7c00a13b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe7d4005880 tx=0x7fe7d4009040 comp rx=0 tx=0).stop 2024-02-21T23:02:02.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.519+0000 7fe7e6400640 1 -- 172.21.15.99:0/3108550768 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7e01648c0 msgr2=0x7fe7e00fa600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:02.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.519+0000 7fe7e6400640 1 --2- 172.21.15.99:0/3108550768 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7e01648c0 0x7fe7e00fa600 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe7d8009eb0 tx=0x7fe7d8004a40 comp rx=0 tx=0).stop 2024-02-21T23:02:02.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.519+0000 7fe7e6400640 1 -- 172.21.15.99:0/3108550768 shutdown_connections 2024-02-21T23:02:02.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.519+0000 7fe7e6400640 1 --2- 172.21.15.99:0/3108550768 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fe7c009eef0 0x7fe7c00a13b0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:02.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.519+0000 7fe7e6400640 1 --2- 172.21.15.99:0/3108550768 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe7e01648c0 0x7fe7e00fa600 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:02.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.519+0000 7fe7e6400640 1 --2- 172.21.15.99:0/3108550768 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe7e00fce30 0x7fe7e0161580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:02.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.519+0000 7fe7e6400640 1 --2- 172.21.15.99:0/3108550768 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7e00fb9e0 0x7fe7e0161040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:02.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.519+0000 7fe7e6400640 1 -- 172.21.15.99:0/3108550768 >> 172.21.15.99:0/3108550768 conn(0x7fe7e00d29c0 msgr2=0x7fe7e00d2160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:02.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.519+0000 7fe7e6400640 1 -- 172.21.15.99:0/3108550768 shutdown_connections 2024-02-21T23:02:02.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.519+0000 7fe7e6400640 1 -- 172.21.15.99:0/3108550768 wait complete. 2024-02-21T23:02:02.533 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-02-21T23:02:02.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.772+0000 7f7b1a000640 1 Processor -- start 2024-02-21T23:02:02.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.772+0000 7f7b1a000640 1 -- start start 2024-02-21T23:02:02.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.775+0000 7f7b1a000640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f7b1417ee70 0x7f7b14187df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:02.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.775+0000 7f7b1a000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f7b14186380 0x7f7b14182e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:02.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.776+0000 7f7b1a000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b14186800 con 0x7f7b14188480 2024-02-21T23:02:02.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.776+0000 7f7b1a000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b14185e40 con 0x7f7b14186380 2024-02-21T23:02:02.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.776+0000 7f7b1a000640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b14186a70 con 0x7f7b1417ee70 2024-02-21T23:02:02.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.776+0000 7f7b18c00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f7b1417ee70 0x7f7b14187df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:02.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.776+0000 7f7b18c00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f7b1417ee70 0x7f7b14187df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:34996/0 (socket says 172.21.15.99:34996) 2024-02-21T23:02:02.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.776+0000 7f7b18c00640 1 -- 172.21.15.99:0/491958775 learned_addr learned my addr 172.21.15.99:0/491958775 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:02.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.776+0000 7f7b13e00640 1 --2- 172.21.15.99:0/491958775 >> v2:172.21.15.162:3300/0 conn(0x7f7b14186380 0x7f7b14182e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:02.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.776+0000 7f7b18c00640 1 -- 172.21.15.99:0/491958775 >> v2:172.21.15.162:3300/0 conn(0x7f7b14186380 msgr2=0x7f7b14182e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:02.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.776+0000 7f7b18c00640 1 --2- 172.21.15.99:0/491958775 >> v2:172.21.15.162:3300/0 conn(0x7f7b14186380 0x7f7b14182e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:02.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.776+0000 7f7b18c00640 1 -- 172.21.15.99:0/491958775 >> v1:172.21.15.99:6789/0 conn(0x7f7b14188480 legacy=0x7f7b14188910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:02.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.776+0000 7f7b18c00640 1 -- 172.21.15.99:0/491958775 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b14186d50 con 0x7f7b1417ee70 2024-02-21T23:02:02.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.776+0000 7f7b13e00640 1 --2- 172.21.15.99:0/491958775 >> v2:172.21.15.162:3300/0 conn(0x7f7b14186380 0x7f7b14182e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:02:02.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.778+0000 7f7b18c00640 1 --2- 172.21.15.99:0/491958775 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7b1417ee70 0x7f7b14187df0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7b1408d880 tx=0x7f7b0802cdf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e32d1cb6c0bf6b6a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:02.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.778+0000 7f7b13400640 1 -- 172.21.15.99:0/491958775 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b0803a070 con 0x7f7b1417ee70 2024-02-21T23:02:02.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.778+0000 7f7b13400640 1 -- 172.21.15.99:0/491958775 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b0802dba0 con 0x7f7b1417ee70 2024-02-21T23:02:02.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.778+0000 7f7b13400640 1 -- 172.21.15.99:0/491958775 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b0800b040 con 0x7f7b1417ee70 2024-02-21T23:02:02.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.779+0000 7f7b1a000640 1 -- 172.21.15.99:0/491958775 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7b1417ee70 msgr2=0x7f7b14187df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:02.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.779+0000 7f7b1a000640 1 --2- 172.21.15.99:0/491958775 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7b1417ee70 0x7f7b14187df0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7b1408d880 tx=0x7f7b0802cdf0 comp rx=0 tx=0).stop 2024-02-21T23:02:02.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.779+0000 7f7b1a000640 1 -- 172.21.15.99:0/491958775 shutdown_connections 2024-02-21T23:02:02.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.779+0000 7f7b1a000640 1 --2- 172.21.15.99:0/491958775 >> v2:172.21.15.162:3300/0 conn(0x7f7b14186380 0x7f7b14182e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:02.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.779+0000 7f7b1a000640 1 --2- 172.21.15.99:0/491958775 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7b1417ee70 0x7f7b14187df0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:02.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.779+0000 7f7b1a000640 1 -- 172.21.15.99:0/491958775 >> 172.21.15.99:0/491958775 conn(0x7f7b140ce440 msgr2=0x7f7b140ce850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:02.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.779+0000 7f7b1a000640 1 -- 172.21.15.99:0/491958775 shutdown_connections 2024-02-21T23:02:02.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.779+0000 7f7b1a000640 1 -- 172.21.15.99:0/491958775 wait complete. 2024-02-21T23:02:02.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.783+0000 7f7b1a000640 1 Processor -- start 2024-02-21T23:02:02.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.783+0000 7f7b1a000640 1 -- start start 2024-02-21T23:02:02.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.785+0000 7f7b1a000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b1417ee70 0x7f7b141852c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:02.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.785+0000 7f7b1a000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b14186380 0x7f7b14185800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:02.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.785+0000 7f7b1a000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7b14188480 0x7f7b1417a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:02.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.785+0000 7f7b1a000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b141875f0 con 0x7f7b1417ee70 2024-02-21T23:02:02.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.785+0000 7f7b1a000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b14187310 con 0x7f7b14186380 2024-02-21T23:02:02.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.785+0000 7f7b1a000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b141878d0 con 0x7f7b14188480 2024-02-21T23:02:02.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.785+0000 7f7b18c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b1417ee70 0x7f7b141852c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:02.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.785+0000 7f7b18c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b1417ee70 0x7f7b141852c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50222/0 (socket says 172.21.15.99:50222) 2024-02-21T23:02:02.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.785+0000 7f7b18c00640 1 -- 172.21.15.99:0/4155259603 learned_addr learned my addr 172.21.15.99:0/4155259603 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:02.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.785+0000 7f7b13e00640 1 --2- 172.21.15.99:0/4155259603 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b14186380 0x7f7b14185800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:02.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.785+0000 7f7b19600640 1 --2- 172.21.15.99:0/4155259603 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7b14188480 0x7f7b1417a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:02.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.786+0000 7f7b18c00640 1 -- 172.21.15.99:0/4155259603 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7b14188480 msgr2=0x7f7b1417a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:02.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.786+0000 7f7b18c00640 1 --2- 172.21.15.99:0/4155259603 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7b14188480 0x7f7b1417a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:02.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.786+0000 7f7b18c00640 1 -- 172.21.15.99:0/4155259603 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b14186380 msgr2=0x7f7b14185800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:02.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.786+0000 7f7b18c00640 1 --2- 172.21.15.99:0/4155259603 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b14186380 0x7f7b14185800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:02.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.786+0000 7f7b18c00640 1 -- 172.21.15.99:0/4155259603 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b14184220 con 0x7f7b1417ee70 2024-02-21T23:02:02.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.786+0000 7f7b18c00640 1 --2- 172.21.15.99:0/4155259603 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b1417ee70 0x7f7b141852c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7b08038040 tx=0x7f7b08004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:02.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.786+0000 7f7b10c00640 1 -- 172.21.15.99:0/4155259603 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b0803a030 con 0x7f7b1417ee70 2024-02-21T23:02:02.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.787+0000 7f7b10c00640 1 -- 172.21.15.99:0/4155259603 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b0803c070 con 0x7f7b1417ee70 2024-02-21T23:02:02.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.787+0000 7f7b10c00640 1 -- 172.21.15.99:0/4155259603 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b08033550 con 0x7f7b1417ee70 2024-02-21T23:02:02.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.787+0000 7f7b1a000640 1 -- 172.21.15.99:0/4155259603 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b14184500 con 0x7f7b1417ee70 2024-02-21T23:02:02.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.787+0000 7f7b1a000640 1 -- 172.21.15.99:0/4155259603 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b14184ac0 con 0x7f7b1417ee70 2024-02-21T23:02:02.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.789+0000 7f7b1a000640 1 -- 172.21.15.99:0/4155259603 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b14068320 con 0x7f7b1417ee70 2024-02-21T23:02:02.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.792+0000 7f7b10c00640 1 -- 172.21.15.99:0/4155259603 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 6) v1 ==== 134407+0+0 (secure 0 0 0) 0x7f7b0803e030 con 0x7f7b1417ee70 2024-02-21T23:02:02.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.794+0000 7f7b10c00640 1 --2- 172.21.15.99:0/4155259603 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f7af409ee70 0x7f7af40a1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:02.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.794+0000 7f7b10c00640 1 -- 172.21.15.99:0/4155259603 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f7b080eb110 con 0x7f7b1417ee70 2024-02-21T23:02:02.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.795+0000 7f7b13e00640 1 --2- 172.21.15.99:0/4155259603 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f7af409ee70 0x7f7af40a1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:02.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.795+0000 7f7b13e00640 1 --2- 172.21.15.99:0/4155259603 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f7af409ee70 0x7f7af40a1330 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7b14182a60 tx=0x7f7b00008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:02.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:02.802+0000 7f7b10c00640 1 -- 172.21.15.99:0/4155259603 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f7b080b92a0 con 0x7f7b1417ee70 2024-02-21T23:02:03.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.060+0000 7f7b1a000640 1 -- 172.21.15.99:0/4155259603 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f7b140f23b0 con 0x7f7b1417ee70 2024-02-21T23:02:03.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.061+0000 7f7b10c00640 1 -- 172.21.15.99:0/4155259603 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) v1 ==== 103+0+11 (secure 0 0 0) 0x7f7b080b8ba0 con 0x7f7b1417ee70 2024-02-21T23:02:03.050 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 32 2024-02-21T23:02:03.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.064+0000 7f7b1a000640 1 -- 172.21.15.99:0/4155259603 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f7af409ee70 msgr2=0x7f7af40a1330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:03.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.064+0000 7f7b1a000640 1 --2- 172.21.15.99:0/4155259603 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f7af409ee70 0x7f7af40a1330 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7b14182a60 tx=0x7f7b00008040 comp rx=0 tx=0).stop 2024-02-21T23:02:03.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.064+0000 7f7b1a000640 1 -- 172.21.15.99:0/4155259603 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b1417ee70 msgr2=0x7f7b141852c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:03.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.064+0000 7f7b1a000640 1 --2- 172.21.15.99:0/4155259603 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b1417ee70 0x7f7b141852c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7b08038040 tx=0x7f7b08004730 comp rx=0 tx=0).stop 2024-02-21T23:02:03.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.064+0000 7f7b1a000640 1 -- 172.21.15.99:0/4155259603 shutdown_connections 2024-02-21T23:02:03.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.064+0000 7f7b1a000640 1 --2- 172.21.15.99:0/4155259603 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f7af409ee70 0x7f7af40a1330 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:03.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.064+0000 7f7b1a000640 1 --2- 172.21.15.99:0/4155259603 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7b14188480 0x7f7b1417a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:03.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.064+0000 7f7b1a000640 1 --2- 172.21.15.99:0/4155259603 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b14186380 0x7f7b14185800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:03.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.064+0000 7f7b1a000640 1 --2- 172.21.15.99:0/4155259603 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7b1417ee70 0x7f7b141852c0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:03.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.064+0000 7f7b1a000640 1 -- 172.21.15.99:0/4155259603 >> 172.21.15.99:0/4155259603 conn(0x7f7b140ce440 msgr2=0x7f7b140f3e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:03.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.064+0000 7f7b1a000640 1 -- 172.21.15.99:0/4155259603 shutdown_connections 2024-02-21T23:02:03.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.064+0000 7f7b1a000640 1 -- 172.21.15.99:0/4155259603 wait complete. 2024-02-21T23:02:03.075 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-02-21T23:02:03.075 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T23:02:03.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.280+0000 7fb35d000640 1 Processor -- start 2024-02-21T23:02:03.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.280+0000 7fb35d000640 1 -- start start 2024-02-21T23:02:03.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.282+0000 7fb35d000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb35818a010 0x7fb35818b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:03.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.282+0000 7fb35d000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb35818a600 con 0x7fb358182a80 2024-02-21T23:02:03.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.282+0000 7fb35d000640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb35818a8e0 con 0x7fb3580719b0 2024-02-21T23:02:03.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.282+0000 7fb35d000640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb35818bec0 con 0x7fb35818a010 2024-02-21T23:02:03.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.283+0000 7fb357400640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fb358182a80 0x7fb358186a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.99:58884/0 (socket says 172.21.15.99:58884) 2024-02-21T23:02:03.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.283+0000 7fb357400640 1 -- 172.21.15.99:0/258889656 learned_addr learned my addr 172.21.15.99:0/258889656 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:02:03.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.283+0000 7fb356a00640 1 --2- 172.21.15.99:0/258889656 >> v2:172.21.15.99:3300/0 conn(0x7fb35818a010 0x7fb35818b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:03.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.283+0000 7fb356000640 1 -- 172.21.15.99:0/258889656 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 496861536 0 0) 0x7fb35818a600 con 0x7fb358182a80 2024-02-21T23:02:03.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.283+0000 7fb356000640 1 -- 172.21.15.99:0/258889656 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb33c003520 con 0x7fb358182a80 2024-02-21T23:02:03.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.284+0000 7fb356000640 1 -- 172.21.15.99:0/258889656 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4220724602 0 0) 0x7fb35818a8e0 con 0x7fb3580719b0 2024-02-21T23:02:03.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.284+0000 7fb356000640 1 -- 172.21.15.99:0/258889656 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb35818a600 con 0x7fb3580719b0 2024-02-21T23:02:03.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.284+0000 7fb356000640 1 -- 172.21.15.99:0/258889656 <== mon.1 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3389596635 0 0) 0x7fb33c003520 con 0x7fb358182a80 2024-02-21T23:02:03.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.284+0000 7fb356000640 1 -- 172.21.15.99:0/258889656 >> v2:172.21.15.99:3300/0 conn(0x7fb35818a010 msgr2=0x7fb35818b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:03.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.284+0000 7fb356000640 1 --2- 172.21.15.99:0/258889656 >> v2:172.21.15.99:3300/0 conn(0x7fb35818a010 0x7fb35818b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:03.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.284+0000 7fb356000640 1 -- 172.21.15.99:0/258889656 >> v1:172.21.15.181:6789/0 conn(0x7fb3580719b0 legacy=0x7fb358071e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:03.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.284+0000 7fb356000640 1 -- 172.21.15.99:0/258889656 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb35818abc0 con 0x7fb358182a80 2024-02-21T23:02:03.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.284+0000 7fb356000640 1 -- 172.21.15.99:0/258889656 <== mon.1 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2069890144 0 0) 0x7fb348001670 con 0x7fb358182a80 2024-02-21T23:02:03.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.284+0000 7fb356000640 1 -- 172.21.15.99:0/258889656 >> v1:172.21.15.162:6789/0 conn(0x7fb358182a80 legacy=0x7fb358186a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:03.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.284+0000 7fb356000640 1 --2- 172.21.15.99:0/258889656 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb33c003b90 0x7fb33c003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:03.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.284+0000 7fb356000640 1 --2- 172.21.15.99:0/258889656 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb33c004800 0x7fb33c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:03.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.284+0000 7fb356000640 1 --2- 172.21.15.99:0/258889656 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb33c005280 0x7fb33c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:03.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.284+0000 7fb356000640 1 -- 172.21.15.99:0/258889656 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb35818bec0 con 0x7fb33c004800 2024-02-21T23:02:03.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.284+0000 7fb356000640 1 -- 172.21.15.99:0/258889656 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb33c00c1c0 con 0x7fb33c005280 2024-02-21T23:02:03.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.284+0000 7fb356000640 1 -- 172.21.15.99:0/258889656 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb33c00c3c0 con 0x7fb33c003b90 2024-02-21T23:02:03.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.284+0000 7fb356a00640 1 --2- 172.21.15.99:0/258889656 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb33c004800 0x7fb33c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:03.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.284+0000 7fb357400640 1 --2- 172.21.15.99:0/258889656 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb33c003b90 0x7fb33c003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:03.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.284+0000 7fb357e00640 1 --2- 172.21.15.99:0/258889656 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb33c005280 0x7fb33c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:03.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.285+0000 7fb357400640 1 -- 172.21.15.99:0/258889656 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb33c005280 msgr2=0x7fb33c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:03.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.285+0000 7fb357400640 1 --2- 172.21.15.99:0/258889656 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb33c005280 0x7fb33c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:03.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.285+0000 7fb357400640 1 -- 172.21.15.99:0/258889656 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb33c004800 msgr2=0x7fb33c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:03.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.285+0000 7fb357400640 1 --2- 172.21.15.99:0/258889656 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb33c004800 0x7fb33c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:03.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.285+0000 7fb357400640 1 -- 172.21.15.99:0/258889656 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb35818abc0 con 0x7fb33c003b90 2024-02-21T23:02:03.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.285+0000 7fb357e00640 1 -- 172.21.15.99:0/258889656 reap_dead start 2024-02-21T23:02:03.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.286+0000 7fb357400640 1 --2- 172.21.15.99:0/258889656 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb33c003b90 0x7fb33c003f90 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb34800c240 tx=0x7fb33c005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d6b6abf78ad39af server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:03.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.286+0000 7fb356000640 1 -- 172.21.15.99:0/258889656 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb348007d30 con 0x7fb33c003b90 2024-02-21T23:02:03.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.286+0000 7fb356000640 1 -- 172.21.15.99:0/258889656 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb348030070 con 0x7fb33c003b90 2024-02-21T23:02:03.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.286+0000 7fb356000640 1 -- 172.21.15.99:0/258889656 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb348005d10 con 0x7fb33c003b90 2024-02-21T23:02:03.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.287+0000 7fb35d000640 1 -- 172.21.15.99:0/258889656 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb33c003b90 msgr2=0x7fb33c003f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:03.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.287+0000 7fb35d000640 1 --2- 172.21.15.99:0/258889656 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb33c003b90 0x7fb33c003f90 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb34800c240 tx=0x7fb33c005830 comp rx=0 tx=0).stop 2024-02-21T23:02:03.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.287+0000 7fb35d000640 1 -- 172.21.15.99:0/258889656 shutdown_connections 2024-02-21T23:02:03.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.287+0000 7fb35d000640 1 --2- 172.21.15.99:0/258889656 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb33c003b90 0x7fb33c003f90 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:03.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.287+0000 7fb35d000640 1 -- 172.21.15.99:0/258889656 >> 172.21.15.99:0/258889656 conn(0x7fb3580d29f0 msgr2=0x7fb3580d2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:03.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.287+0000 7fb35d000640 1 -- 172.21.15.99:0/258889656 shutdown_connections 2024-02-21T23:02:03.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.287+0000 7fb35d000640 1 -- 172.21.15.99:0/258889656 wait complete. 2024-02-21T23:02:03.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.290+0000 7fb35d000640 1 Processor -- start 2024-02-21T23:02:03.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.290+0000 7fb35d000640 1 -- start start 2024-02-21T23:02:03.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.292+0000 7fb35d000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb33c003b90 0x7fb35817bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:03.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.292+0000 7fb35d000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb35817c460 0x7fb3580d5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:03.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.292+0000 7fb35d000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb35817c8e0 0x7fb3580d56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:03.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.292+0000 7fb35d000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb35818b460 con 0x7fb33c003b90 2024-02-21T23:02:03.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.292+0000 7fb35d000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb35818b180 con 0x7fb35817c460 2024-02-21T23:02:03.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.292+0000 7fb35d000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb358182e60 con 0x7fb35817c8e0 2024-02-21T23:02:03.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.292+0000 7fb356a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb35817c460 0x7fb3580d5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:03.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.292+0000 7fb357400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb33c003b90 0x7fb35817bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:03.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.292+0000 7fb356a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb35817c460 0x7fb3580d5190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:40730/0 (socket says 172.21.15.99:40730) 2024-02-21T23:02:03.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.292+0000 7fb356a00640 1 -- 172.21.15.99:0/2912775550 learned_addr learned my addr 172.21.15.99:0/2912775550 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:03.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.292+0000 7fb357e00640 1 --2- 172.21.15.99:0/2912775550 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb35817c8e0 0x7fb3580d56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:03.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.293+0000 7fb356a00640 1 -- 172.21.15.99:0/2912775550 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb35817c8e0 msgr2=0x7fb3580d56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:03.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.293+0000 7fb356a00640 1 --2- 172.21.15.99:0/2912775550 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb35817c8e0 0x7fb3580d56d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:03.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.293+0000 7fb356a00640 1 -- 172.21.15.99:0/2912775550 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb33c003b90 msgr2=0x7fb35817bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:03.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.293+0000 7fb356a00640 1 --2- 172.21.15.99:0/2912775550 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb33c003b90 0x7fb35817bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:03.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.293+0000 7fb356a00640 1 -- 172.21.15.99:0/2912775550 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3580d4130 con 0x7fb35817c460 2024-02-21T23:02:03.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.293+0000 7fb357400640 1 --2- 172.21.15.99:0/2912775550 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb33c003b90 0x7fb35817bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:02:03.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.293+0000 7fb356a00640 1 --2- 172.21.15.99:0/2912775550 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb35817c460 0x7fb3580d5190 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb344011890 tx=0x7fb344011d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:03.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.294+0000 7fb34f400640 1 -- 172.21.15.99:0/2912775550 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb344019070 con 0x7fb35817c460 2024-02-21T23:02:03.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.294+0000 7fb34f400640 1 -- 172.21.15.99:0/2912775550 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb344004240 con 0x7fb35817c460 2024-02-21T23:02:03.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.294+0000 7fb35d000640 1 -- 172.21.15.99:0/2912775550 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3580d43d0 con 0x7fb35817c460 2024-02-21T23:02:03.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.294+0000 7fb34f400640 1 -- 172.21.15.99:0/2912775550 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb34400f820 con 0x7fb35817c460 2024-02-21T23:02:03.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.294+0000 7fb35d000640 1 -- 172.21.15.99:0/2912775550 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3580d4990 con 0x7fb35817c460 2024-02-21T23:02:03.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.295+0000 7fb35d000640 1 -- 172.21.15.99:0/2912775550 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb358068320 con 0x7fb35817c460 2024-02-21T23:02:03.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.297+0000 7fb34f400640 1 -- 172.21.15.99:0/2912775550 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 6) v1 ==== 134407+0+0 (secure 0 0 0) 0x7fb34401c070 con 0x7fb35817c460 2024-02-21T23:02:03.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.298+0000 7fb34f400640 1 --2- 172.21.15.99:0/2912775550 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fb33809edf0 0x7fb3380a12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:03.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.299+0000 7fb34f400640 1 -- 172.21.15.99:0/2912775550 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fb3440ca490 con 0x7fb35817c460 2024-02-21T23:02:03.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.299+0000 7fb357400640 1 --2- 172.21.15.99:0/2912775550 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fb33809edf0 0x7fb3380a12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:03.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.299+0000 7fb357400640 1 --2- 172.21.15.99:0/2912775550 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fb33809edf0 0x7fb3380a12b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb348034000 tx=0x7fb348009030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:03.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.300+0000 7fb34f400640 1 -- 172.21.15.99:0/2912775550 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fb344097fd0 con 0x7fb35817c460 2024-02-21T23:02:03.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.631+0000 7fb35d000640 1 -- 172.21.15.99:0/2912775550 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb3580fcc10 con 0x7fb35817c460 2024-02-21T23:02:03.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.632+0000 7fb34f400640 1 -- 172.21.15.99:0/2912775550 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+11335 (secure 0 0 0) 0x7fb34409c070 con 0x7fb35817c460 2024-02-21T23:02:03.622 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T23:02:03.622 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4307,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/3514452812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3514452812},{"type":"v1","addr":"172.21.15.162:6836","nonce":3514452812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4312,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6838/2169982089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":2169982089},{"type":"v1","addr":"172.21.15.162:6838","nonce":2169982089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4315,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6839/3335972724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6837","nonce":3335972724},{"type":"v1","addr":"172.21.15.162:6839","nonce":3335972724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4318,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6841/2135456697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6840","nonce":2135456697},{"type":"v1","addr":"172.21.15.162:6841","nonce":2135456697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4325,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2452242758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2452242758},{"type":"v1","addr":"172.21.15.181:6833","nonce":2452242758}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4328,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6836/2751486400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":2751486400},{"type":"v1","addr":"172.21.15.181:6836","nonce":2751486400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":15,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-21T23:01:02.656130+0000","modified":"2024-02-21T23:01:57.191106+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4355,"mds_1":4352,"mds_2":4348},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4331":{"gid":4331,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6838/3728901330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6835","nonce":3728901330},{"type":"v1","addr":"172.21.15.181:6838","nonce":3728901330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4339":{"gid":4339,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6839/3357929641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6837","nonce":3357929641},{"type":"v1","addr":"172.21.15.181:6839","nonce":3357929641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4343":{"gid":4343,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6833/2793485078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":2793485078},{"type":"v1","addr":"172.21.15.99:6833","nonce":2793485078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4348":{"gid":4348,"name":"d","rank":2,"incarnation":12,"state":"up:active","state_seq":10,"addr":"172.21.15.99:6835/2243461688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2243461688},{"type":"v1","addr":"172.21.15.99:6835","nonce":2243461688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4352":{"gid":4352,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.99:6837/1676159950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":1676159950},{"type":"v1","addr":"172.21.15.99:6837","nonce":1676159950}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4355":{"gid":4355,"name":"j","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6839/4239008786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":4239008786},{"type":"v1","addr":"172.21.15.99:6839","nonce":4239008786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-21T23:02:03.622 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 15 2024-02-21T23:02:03.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.635+0000 7fb35d000640 1 -- 172.21.15.99:0/2912775550 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fb33809edf0 msgr2=0x7fb3380a12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:03.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.635+0000 7fb35d000640 1 --2- 172.21.15.99:0/2912775550 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fb33809edf0 0x7fb3380a12b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb348034000 tx=0x7fb348009030 comp rx=0 tx=0).stop 2024-02-21T23:02:03.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.635+0000 7fb35d000640 1 -- 172.21.15.99:0/2912775550 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb35817c460 msgr2=0x7fb3580d5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:03.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.635+0000 7fb35d000640 1 --2- 172.21.15.99:0/2912775550 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb35817c460 0x7fb3580d5190 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb344011890 tx=0x7fb344011d50 comp rx=0 tx=0).stop 2024-02-21T23:02:03.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.636+0000 7fb35d000640 1 -- 172.21.15.99:0/2912775550 shutdown_connections 2024-02-21T23:02:03.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.636+0000 7fb35d000640 1 --2- 172.21.15.99:0/2912775550 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fb33809edf0 0x7fb3380a12b0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:03.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.636+0000 7fb35d000640 1 --2- 172.21.15.99:0/2912775550 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb35817c8e0 0x7fb3580d56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:03.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.636+0000 7fb35d000640 1 --2- 172.21.15.99:0/2912775550 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb35817c460 0x7fb3580d5190 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:03.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.636+0000 7fb35d000640 1 --2- 172.21.15.99:0/2912775550 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb33c003b90 0x7fb35817bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:03.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.636+0000 7fb35d000640 1 -- 172.21.15.99:0/2912775550 >> 172.21.15.99:0/2912775550 conn(0x7fb3580d29f0 msgr2=0x7fb3580d2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:03.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.636+0000 7fb35d000640 1 -- 172.21.15.99:0/2912775550 shutdown_connections 2024-02-21T23:02:03.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.636+0000 7fb35d000640 1 -- 172.21.15.99:0/2912775550 wait complete. 2024-02-21T23:02:03.648 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-02-21T23:02:03.649 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-02-21T23:02:03.649 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-21T23:02:03.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.867+0000 7f1e54e00640 1 Processor -- start 2024-02-21T23:02:03.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.867+0000 7f1e54e00640 1 -- start start 2024-02-21T23:02:03.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.868+0000 7f1e54e00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f1e501861e0 0x7f1e501865c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:03.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.868+0000 7f1e54e00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e500cf7e0 con 0x7f1e500d4300 2024-02-21T23:02:03.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.868+0000 7f1e54e00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e500cfac0 con 0x7f1e50187a80 2024-02-21T23:02:03.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.868+0000 7f1e54e00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e50186d50 con 0x7f1e501861e0 2024-02-21T23:02:03.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.869+0000 7f1e4e800640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f1e500d4300 0x7f1e500d4700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:36442/0 (socket says 172.21.15.99:36442) 2024-02-21T23:02:03.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.869+0000 7f1e4e800640 1 -- 172.21.15.99:0/2565331109 learned_addr learned my addr 172.21.15.99:0/2565331109 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:02:03.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.869+0000 7f1e4de00640 1 --2- 172.21.15.99:0/2565331109 >> v2:172.21.15.181:3300/0 conn(0x7f1e501861e0 0x7f1e501865c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:03.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.869+0000 7f1e4de00640 1 -- 172.21.15.99:0/2565331109 >> v1:172.21.15.181:6789/0 conn(0x7f1e50187a80 legacy=0x7f1e50187f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:03.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.869+0000 7f1e4de00640 1 -- 172.21.15.99:0/2565331109 >> v1:172.21.15.99:6789/0 conn(0x7f1e500d4300 legacy=0x7f1e500d4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:03.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.869+0000 7f1e4ca00640 1 -- 172.21.15.99:0/2565331109 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1524896792 0 0) 0x7f1e500cf7e0 con 0x7f1e500d4300 2024-02-21T23:02:03.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.869+0000 7f1e4de00640 1 -- 172.21.15.99:0/2565331109 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e50186fa0 con 0x7f1e501861e0 2024-02-21T23:02:03.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.871+0000 7f1e4de00640 1 --2- 172.21.15.99:0/2565331109 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1e501861e0 0x7f1e501865c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1e400097a0 tx=0x7f1e4002b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d62cd0195774a00d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:03.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.871+0000 7f1e4ca00640 1 -- 172.21.15.99:0/2565331109 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e40035020 con 0x7f1e501861e0 2024-02-21T23:02:03.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.871+0000 7f1e4ca00640 1 -- 172.21.15.99:0/2565331109 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e40031830 con 0x7f1e501861e0 2024-02-21T23:02:03.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.871+0000 7f1e4ca00640 1 -- 172.21.15.99:0/2565331109 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e40031c00 con 0x7f1e501861e0 2024-02-21T23:02:03.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.872+0000 7f1e54e00640 1 -- 172.21.15.99:0/2565331109 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1e501861e0 msgr2=0x7f1e501865c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:03.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.872+0000 7f1e54e00640 1 --2- 172.21.15.99:0/2565331109 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1e501861e0 0x7f1e501865c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1e400097a0 tx=0x7f1e4002b8d0 comp rx=0 tx=0).stop 2024-02-21T23:02:03.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.872+0000 7f1e54e00640 1 -- 172.21.15.99:0/2565331109 shutdown_connections 2024-02-21T23:02:03.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.872+0000 7f1e54e00640 1 --2- 172.21.15.99:0/2565331109 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1e501861e0 0x7f1e501865c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:03.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.872+0000 7f1e54e00640 1 -- 172.21.15.99:0/2565331109 >> 172.21.15.99:0/2565331109 conn(0x7f1e500d6ac0 msgr2=0x7f1e500740b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:03.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.872+0000 7f1e54e00640 1 -- 172.21.15.99:0/2565331109 shutdown_connections 2024-02-21T23:02:03.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.872+0000 7f1e54e00640 1 -- 172.21.15.99:0/2565331109 wait complete. 2024-02-21T23:02:03.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.875+0000 7f1e54e00640 1 Processor -- start 2024-02-21T23:02:03.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.875+0000 7f1e54e00640 1 -- start start 2024-02-21T23:02:03.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.877+0000 7f1e54e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e500d4300 0x7f1e5016ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:03.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.877+0000 7f1e54e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e501861e0 0x7f1e5021ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:03.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.877+0000 7f1e54e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1e50187a80 0x7f1e5021f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:03.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.877+0000 7f1e54e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e50188620 con 0x7f1e500d4300 2024-02-21T23:02:03.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.877+0000 7f1e54e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e501875f0 con 0x7f1e501861e0 2024-02-21T23:02:03.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.877+0000 7f1e54e00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e500ceeb0 con 0x7f1e50187a80 2024-02-21T23:02:03.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.877+0000 7f1e4de00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e500d4300 0x7f1e5016ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:03.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.877+0000 7f1e4de00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e500d4300 0x7f1e5016ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50264/0 (socket says 172.21.15.99:50264) 2024-02-21T23:02:03.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.877+0000 7f1e4de00640 1 -- 172.21.15.99:0/4131526362 learned_addr learned my addr 172.21.15.99:0/4131526362 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:03.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.877+0000 7f1e4d400640 1 --2- 172.21.15.99:0/4131526362 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e501861e0 0x7f1e5021ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:03.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.878+0000 7f1e4e800640 1 --2- 172.21.15.99:0/4131526362 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1e50187a80 0x7f1e5021f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:03.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.878+0000 7f1e4de00640 1 -- 172.21.15.99:0/4131526362 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1e50187a80 msgr2=0x7f1e5021f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:03.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.878+0000 7f1e4de00640 1 --2- 172.21.15.99:0/4131526362 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1e50187a80 0x7f1e5021f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:03.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.878+0000 7f1e4de00640 1 -- 172.21.15.99:0/4131526362 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e501861e0 msgr2=0x7f1e5021ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:03.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.878+0000 7f1e4de00640 1 --2- 172.21.15.99:0/4131526362 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e501861e0 0x7f1e5021ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:03.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.878+0000 7f1e4de00640 1 -- 172.21.15.99:0/4131526362 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e50173d60 con 0x7f1e500d4300 2024-02-21T23:02:03.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.878+0000 7f1e4de00640 1 --2- 172.21.15.99:0/4131526362 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e500d4300 0x7f1e5016ae60 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1e4002bee0 tx=0x7f1e400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:03.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.878+0000 7f1e46000640 1 -- 172.21.15.99:0/4131526362 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e40041070 con 0x7f1e500d4300 2024-02-21T23:02:03.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.879+0000 7f1e46000640 1 -- 172.21.15.99:0/4131526362 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e4003aa30 con 0x7f1e500d4300 2024-02-21T23:02:03.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.879+0000 7f1e46000640 1 -- 172.21.15.99:0/4131526362 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e40035040 con 0x7f1e500d4300 2024-02-21T23:02:03.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.879+0000 7f1e54e00640 1 -- 172.21.15.99:0/4131526362 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e50174040 con 0x7f1e500d4300 2024-02-21T23:02:03.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.879+0000 7f1e54e00640 1 -- 172.21.15.99:0/4131526362 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e5021c970 con 0x7f1e500d4300 2024-02-21T23:02:03.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.880+0000 7f1e54e00640 1 -- 172.21.15.99:0/4131526362 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e500d3e90 con 0x7f1e500d4300 2024-02-21T23:02:03.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.882+0000 7f1e46000640 1 -- 172.21.15.99:0/4131526362 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 6) v1 ==== 134407+0+0 (secure 0 0 0) 0x7f1e40038020 con 0x7f1e500d4300 2024-02-21T23:02:03.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.883+0000 7f1e46000640 1 --2- 172.21.15.99:0/4131526362 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f1e3009edf0 0x7f1e300a12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:03.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.883+0000 7f1e46000640 1 -- 172.21.15.99:0/4131526362 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f1e400eb620 con 0x7f1e500d4300 2024-02-21T23:02:03.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.883+0000 7f1e4d400640 1 --2- 172.21.15.99:0/4131526362 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f1e3009edf0 0x7f1e300a12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:03.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.884+0000 7f1e4d400640 1 --2- 172.21.15.99:0/4131526362 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f1e3009edf0 0x7f1e300a12b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1e500d75f0 tx=0x7f1e3c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:03.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:03.887+0000 7f1e46000640 1 -- 172.21.15.99:0/4131526362 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f1e400b9840 con 0x7f1e500d4300 2024-02-21T23:02:04.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.192+0000 7f1e54e00640 1 -- 172.21.15.99:0/4131526362 --> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1e500d38d0 con 0x7f1e3009edf0 2024-02-21T23:02:04.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.202+0000 7f1e46000640 1 -- 172.21.15.99:0/4131526362 <== mgr.4106 v2:172.21.15.162:6800/1717094936 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+338721 (secure 0 0 0) 0x7f1e500d38d0 con 0x7f1e3009edf0 2024-02-21T23:02:04.196 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T23:02:04.198 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-02-21T23:02:04.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.207+0000 7f1e54e00640 1 -- 172.21.15.99:0/4131526362 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f1e3009edf0 msgr2=0x7f1e300a12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:04.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.207+0000 7f1e54e00640 1 --2- 172.21.15.99:0/4131526362 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f1e3009edf0 0x7f1e300a12b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1e500d75f0 tx=0x7f1e3c009040 comp rx=0 tx=0).stop 2024-02-21T23:02:04.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.207+0000 7f1e54e00640 1 -- 172.21.15.99:0/4131526362 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e500d4300 msgr2=0x7f1e5016ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:04.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.207+0000 7f1e54e00640 1 --2- 172.21.15.99:0/4131526362 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e500d4300 0x7f1e5016ae60 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1e4002bee0 tx=0x7f1e400046c0 comp rx=0 tx=0).stop 2024-02-21T23:02:04.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.207+0000 7f1e54e00640 1 -- 172.21.15.99:0/4131526362 shutdown_connections 2024-02-21T23:02:04.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.207+0000 7f1e54e00640 1 --2- 172.21.15.99:0/4131526362 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f1e3009edf0 0x7f1e300a12b0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:04.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.207+0000 7f1e54e00640 1 --2- 172.21.15.99:0/4131526362 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1e50187a80 0x7f1e5021f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:04.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.207+0000 7f1e54e00640 1 --2- 172.21.15.99:0/4131526362 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e501861e0 0x7f1e5021ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:04.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.207+0000 7f1e54e00640 1 --2- 172.21.15.99:0/4131526362 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e500d4300 0x7f1e5016ae60 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:04.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.207+0000 7f1e54e00640 1 -- 172.21.15.99:0/4131526362 >> 172.21.15.99:0/4131526362 conn(0x7f1e500d6ac0 msgr2=0x7f1e500740b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:04.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.207+0000 7f1e54e00640 1 -- 172.21.15.99:0/4131526362 shutdown_connections 2024-02-21T23:02:04.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.207+0000 7f1e54e00640 1 -- 172.21.15.99:0/4131526362 wait complete. 2024-02-21T23:02:04.220 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":54,"stamp":"2024-02-21T23:02:02.958358+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":661476,"num_objects":64,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":332,"num_read_kb":292,"num_write":349,"num_write_kb":3062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":282,"ondisk_log_size":282,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1132462080,"kb_used":328548,"kb_used_data":4280,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1132133532,"statfs":{"total":1159641169920,"available":1159304736768,"internally_reserved":0,"allocated":4382720,"data_stored":3259568,"data_compressed":239174,"data_compressed_allocated":344064,"data_compressed_original":1654784,"omap_allocated":19138,"internal_metadata":331855166},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":9641,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":41,"num_write":5,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003586"},"pg_stats":[{"pgid":"2.1f","version":"29'9","reported_seq":36,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.536641+0000","last_change":"2024-02-21T23:01:02.208441+0000","last_active":"2024-02-21T23:01:50.536641+0000","last_peered":"2024-02-21T23:01:50.536641+0000","last_clean":"2024-02-21T23:01:50.536641+0000","last_became_active":"2024-02-21T23:01:02.208124+0000","last_became_peered":"2024-02-21T23:01:02.208124+0000","last_unstale":"2024-02-21T23:01:50.536641+0000","last_undegraded":"2024-02-21T23:01:50.536641+0000","last_fullsized":"2024-02-21T23:01:50.536641+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:21:29.919968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7],"acting":[9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.570488+0000","last_change":"2024-02-21T23:01:03.215149+0000","last_active":"2024-02-21T23:01:50.570488+0000","last_peered":"2024-02-21T23:01:50.570488+0000","last_clean":"2024-02-21T23:01:50.570488+0000","last_became_active":"2024-02-21T23:01:03.214170+0000","last_became_peered":"2024-02-21T23:01:03.214170+0000","last_unstale":"2024-02-21T23:01:50.570488+0000","last_undegraded":"2024-02-21T23:01:50.570488+0000","last_fullsized":"2024-02-21T23:01:50.570488+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:40:26.325368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.553465+0000","last_change":"2024-02-21T23:01:07.276484+0000","last_active":"2024-02-21T23:01:50.553465+0000","last_peered":"2024-02-21T23:01:50.553465+0000","last_clean":"2024-02-21T23:01:50.553465+0000","last_became_active":"2024-02-21T23:01:07.276192+0000","last_became_peered":"2024-02-21T23:01:07.276192+0000","last_unstale":"2024-02-21T23:01:50.553465+0000","last_undegraded":"2024-02-21T23:01:50.553465+0000","last_fullsized":"2024-02-21T23:01:50.553465+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:20:59.894677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"29'2","reported_seq":28,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.570585+0000","last_change":"2024-02-21T23:01:02.221231+0000","last_active":"2024-02-21T23:01:50.570585+0000","last_peered":"2024-02-21T23:01:50.570585+0000","last_clean":"2024-02-21T23:01:50.570585+0000","last_became_active":"2024-02-21T23:01:02.220941+0000","last_became_peered":"2024-02-21T23:01:02.220941+0000","last_unstale":"2024-02-21T23:01:50.570585+0000","last_undegraded":"2024-02-21T23:01:50.570585+0000","last_fullsized":"2024-02-21T23:01:50.570585+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:17:06.353018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.457808+0000","last_change":"2024-02-21T23:01:03.219579+0000","last_active":"2024-02-21T23:01:50.457808+0000","last_peered":"2024-02-21T23:01:50.457808+0000","last_clean":"2024-02-21T23:01:50.457808+0000","last_became_active":"2024-02-21T23:01:03.219221+0000","last_became_peered":"2024-02-21T23:01:03.219221+0000","last_unstale":"2024-02-21T23:01:50.457808+0000","last_undegraded":"2024-02-21T23:01:50.457808+0000","last_fullsized":"2024-02-21T23:01:50.457808+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:41:55.485351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.456345+0000","last_change":"2024-02-21T23:01:07.268590+0000","last_active":"2024-02-21T23:01:50.456345+0000","last_peered":"2024-02-21T23:01:50.456345+0000","last_clean":"2024-02-21T23:01:50.456345+0000","last_became_active":"2024-02-21T23:01:07.268179+0000","last_became_peered":"2024-02-21T23:01:07.268179+0000","last_unstale":"2024-02-21T23:01:50.456345+0000","last_undegraded":"2024-02-21T23:01:50.456345+0000","last_fullsized":"2024-02-21T23:01:50.456345+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:20:59.894677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"29'4","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.459566+0000","last_change":"2024-02-21T23:01:02.208687+0000","last_active":"2024-02-21T23:01:50.459566+0000","last_peered":"2024-02-21T23:01:50.459566+0000","last_clean":"2024-02-21T23:01:50.459566+0000","last_became_active":"2024-02-21T23:01:02.208393+0000","last_became_peered":"2024-02-21T23:01:02.208393+0000","last_unstale":"2024-02-21T23:01:50.459566+0000","last_undegraded":"2024-02-21T23:01:50.459566+0000","last_fullsized":"2024-02-21T23:01:50.459566+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:41:54.477462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.568757+0000","last_change":"2024-02-21T23:01:03.215676+0000","last_active":"2024-02-21T23:01:50.568757+0000","last_peered":"2024-02-21T23:01:50.568757+0000","last_clean":"2024-02-21T23:01:50.568757+0000","last_became_active":"2024-02-21T23:01:03.214733+0000","last_became_peered":"2024-02-21T23:01:03.214733+0000","last_unstale":"2024-02-21T23:01:50.568757+0000","last_undegraded":"2024-02-21T23:01:50.568757+0000","last_fullsized":"2024-02-21T23:01:50.568757+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:16.946152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.456507+0000","last_change":"2024-02-21T23:01:07.279763+0000","last_active":"2024-02-21T23:01:50.456507+0000","last_peered":"2024-02-21T23:01:50.456507+0000","last_clean":"2024-02-21T23:01:50.456507+0000","last_became_active":"2024-02-21T23:01:07.279360+0000","last_became_peered":"2024-02-21T23:01:07.279360+0000","last_unstale":"2024-02-21T23:01:50.456507+0000","last_undegraded":"2024-02-21T23:01:50.456507+0000","last_fullsized":"2024-02-21T23:01:50.456507+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:40:30.373445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":28,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.459570+0000","last_change":"2024-02-21T23:01:02.204774+0000","last_active":"2024-02-21T23:01:50.459570+0000","last_peered":"2024-02-21T23:01:50.459570+0000","last_clean":"2024-02-21T23:01:50.459570+0000","last_became_active":"2024-02-21T23:01:02.203992+0000","last_became_peered":"2024-02-21T23:01:02.203992+0000","last_unstale":"2024-02-21T23:01:50.459570+0000","last_undegraded":"2024-02-21T23:01:50.459570+0000","last_fullsized":"2024-02-21T23:01:50.459570+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:27:54.333439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1],"acting":[8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.461361+0000","last_change":"2024-02-21T23:01:03.213022+0000","last_active":"2024-02-21T23:01:50.461361+0000","last_peered":"2024-02-21T23:01:50.461361+0000","last_clean":"2024-02-21T23:01:50.461361+0000","last_became_active":"2024-02-21T23:01:03.212702+0000","last_became_peered":"2024-02-21T23:01:03.212702+0000","last_unstale":"2024-02-21T23:01:50.461361+0000","last_undegraded":"2024-02-21T23:01:50.461361+0000","last_fullsized":"2024-02-21T23:01:50.461361+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:19:01.584139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.456449+0000","last_change":"2024-02-21T23:01:07.268800+0000","last_active":"2024-02-21T23:01:50.456449+0000","last_peered":"2024-02-21T23:01:50.456449+0000","last_clean":"2024-02-21T23:01:50.456449+0000","last_became_active":"2024-02-21T23:01:07.268357+0000","last_became_peered":"2024-02-21T23:01:07.268357+0000","last_unstale":"2024-02-21T23:01:50.456449+0000","last_undegraded":"2024-02-21T23:01:50.456449+0000","last_fullsized":"2024-02-21T23:01:50.456449+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:39:03.021559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.543257+0000","last_change":"2024-02-21T23:01:03.213517+0000","last_active":"2024-02-21T23:01:50.543257+0000","last_peered":"2024-02-21T23:01:50.543257+0000","last_clean":"2024-02-21T23:01:50.543257+0000","last_became_active":"2024-02-21T23:01:03.213186+0000","last_became_peered":"2024-02-21T23:01:03.213186+0000","last_unstale":"2024-02-21T23:01:50.543257+0000","last_undegraded":"2024-02-21T23:01:50.543257+0000","last_fullsized":"2024-02-21T23:01:50.543257+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:40:26.325368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"29'4","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.459125+0000","last_change":"2024-02-21T23:01:02.208608+0000","last_active":"2024-02-21T23:01:50.459125+0000","last_peered":"2024-02-21T23:01:50.459125+0000","last_clean":"2024-02-21T23:01:50.459125+0000","last_became_active":"2024-02-21T23:01:02.208293+0000","last_became_peered":"2024-02-21T23:01:02.208293+0000","last_unstale":"2024-02-21T23:01:50.459125+0000","last_undegraded":"2024-02-21T23:01:50.459125+0000","last_fullsized":"2024-02-21T23:01:50.459125+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:58:23.554457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.456577+0000","last_change":"2024-02-21T23:01:07.651717+0000","last_active":"2024-02-21T23:01:50.456577+0000","last_peered":"2024-02-21T23:01:50.456577+0000","last_clean":"2024-02-21T23:01:50.456577+0000","last_became_active":"2024-02-21T23:01:07.651241+0000","last_became_peered":"2024-02-21T23:01:07.651241+0000","last_unstale":"2024-02-21T23:01:50.456577+0000","last_undegraded":"2024-02-21T23:01:50.456577+0000","last_fullsized":"2024-02-21T23:01:50.456577+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:54:44.380302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.570374+0000","last_change":"2024-02-21T23:01:03.221678+0000","last_active":"2024-02-21T23:01:50.570374+0000","last_peered":"2024-02-21T23:01:50.570374+0000","last_clean":"2024-02-21T23:01:50.570374+0000","last_became_active":"2024-02-21T23:01:03.219898+0000","last_became_peered":"2024-02-21T23:01:03.219898+0000","last_unstale":"2024-02-21T23:01:50.570374+0000","last_undegraded":"2024-02-21T23:01:50.570374+0000","last_fullsized":"2024-02-21T23:01:50.570374+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:47:19.366266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"29'1","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.553488+0000","last_change":"2024-02-21T23:01:02.202866+0000","last_active":"2024-02-21T23:01:50.553488+0000","last_peered":"2024-02-21T23:01:50.553488+0000","last_clean":"2024-02-21T23:01:50.553488+0000","last_became_active":"2024-02-21T23:01:02.202585+0000","last_became_peered":"2024-02-21T23:01:02.202585+0000","last_unstale":"2024-02-21T23:01:50.553488+0000","last_undegraded":"2024-02-21T23:01:50.553488+0000","last_fullsized":"2024-02-21T23:01:50.553488+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:26:49.911102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"29'1","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.456781+0000","last_change":"2024-02-21T23:01:07.277000+0000","last_active":"2024-02-21T23:01:50.456781+0000","last_peered":"2024-02-21T23:01:50.456781+0000","last_clean":"2024-02-21T23:01:50.456781+0000","last_became_active":"2024-02-21T23:01:07.276577+0000","last_became_peered":"2024-02-21T23:01:07.276577+0000","last_unstale":"2024-02-21T23:01:50.456781+0000","last_undegraded":"2024-02-21T23:01:50.456781+0000","last_fullsized":"2024-02-21T23:01:50.456781+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:15:20.572234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.456430+0000","last_change":"2024-02-21T23:01:03.219045+0000","last_active":"2024-02-21T23:01:50.456430+0000","last_peered":"2024-02-21T23:01:50.456430+0000","last_clean":"2024-02-21T23:01:50.456430+0000","last_became_active":"2024-02-21T23:01:03.218706+0000","last_became_peered":"2024-02-21T23:01:03.218706+0000","last_unstale":"2024-02-21T23:01:50.456430+0000","last_undegraded":"2024-02-21T23:01:50.456430+0000","last_fullsized":"2024-02-21T23:01:50.456430+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:41:55.485351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"29'3","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.570338+0000","last_change":"2024-02-21T23:01:02.208912+0000","last_active":"2024-02-21T23:01:50.570338+0000","last_peered":"2024-02-21T23:01:50.570338+0000","last_clean":"2024-02-21T23:01:50.570338+0000","last_became_active":"2024-02-21T23:01:02.208542+0000","last_became_peered":"2024-02-21T23:01:02.208542+0000","last_unstale":"2024-02-21T23:01:50.570338+0000","last_undegraded":"2024-02-21T23:01:50.570338+0000","last_fullsized":"2024-02-21T23:01:50.570338+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:02:11.724233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9],"acting":[3,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.536531+0000","last_change":"2024-02-21T23:01:07.282882+0000","last_active":"2024-02-21T23:01:50.536531+0000","last_peered":"2024-02-21T23:01:50.536531+0000","last_clean":"2024-02-21T23:01:50.536531+0000","last_became_active":"2024-02-21T23:01:07.282506+0000","last_became_peered":"2024-02-21T23:01:07.282506+0000","last_unstale":"2024-02-21T23:01:50.536531+0000","last_undegraded":"2024-02-21T23:01:50.536531+0000","last_fullsized":"2024-02-21T23:01:50.536531+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:19:05.632217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.458945+0000","last_change":"2024-02-21T23:01:03.212206+0000","last_active":"2024-02-21T23:01:50.458945+0000","last_peered":"2024-02-21T23:01:50.458945+0000","last_clean":"2024-02-21T23:01:50.458945+0000","last_became_active":"2024-02-21T23:01:03.211919+0000","last_became_peered":"2024-02-21T23:01:03.211919+0000","last_unstale":"2024-02-21T23:01:50.458945+0000","last_undegraded":"2024-02-21T23:01:50.458945+0000","last_fullsized":"2024-02-21T23:01:50.458945+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:20:55.846599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"29'2","reported_seq":28,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.568682+0000","last_change":"2024-02-21T23:01:02.204071+0000","last_active":"2024-02-21T23:01:50.568682+0000","last_peered":"2024-02-21T23:01:50.568682+0000","last_clean":"2024-02-21T23:01:50.568682+0000","last_became_active":"2024-02-21T23:01:02.203761+0000","last_became_peered":"2024-02-21T23:01:02.203761+0000","last_unstale":"2024-02-21T23:01:50.568682+0000","last_undegraded":"2024-02-21T23:01:50.568682+0000","last_fullsized":"2024-02-21T23:01:50.568682+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:58:34.737670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.571522+0000","last_change":"2024-02-21T23:01:50.571522+0000","last_active":"2024-02-21T23:01:50.571522+0000","last_peered":"2024-02-21T23:01:50.571522+0000","last_clean":"2024-02-21T23:01:50.571522+0000","last_became_active":"2024-02-21T23:01:50.570965+0000","last_became_peered":"2024-02-21T23:01:50.570965+0000","last_unstale":"2024-02-21T23:01:50.571522+0000","last_undegraded":"2024-02-21T23:01:50.571522+0000","last_fullsized":"2024-02-21T23:01:50.571522+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:34:39.124645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,10,9],"acting":[4,8,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.457441+0000","last_change":"2024-02-21T23:01:03.230134+0000","last_active":"2024-02-21T23:01:50.457441+0000","last_peered":"2024-02-21T23:01:50.457441+0000","last_clean":"2024-02-21T23:01:50.457441+0000","last_became_active":"2024-02-21T23:01:03.229873+0000","last_became_peered":"2024-02-21T23:01:03.229873+0000","last_unstale":"2024-02-21T23:01:50.457441+0000","last_undegraded":"2024-02-21T23:01:50.457441+0000","last_fullsized":"2024-02-21T23:01:50.457441+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:16.946152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"29'4","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.456824+0000","last_change":"2024-02-21T23:01:02.206586+0000","last_active":"2024-02-21T23:01:50.456824+0000","last_peered":"2024-02-21T23:01:50.456824+0000","last_clean":"2024-02-21T23:01:50.456824+0000","last_became_active":"2024-02-21T23:01:02.206230+0000","last_became_peered":"2024-02-21T23:01:02.206230+0000","last_unstale":"2024-02-21T23:01:50.456824+0000","last_undegraded":"2024-02-21T23:01:50.456824+0000","last_fullsized":"2024-02-21T23:01:50.456824+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:21:29.919968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11],"acting":[4,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.553472+0000","last_change":"2024-02-21T23:01:07.252255+0000","last_active":"2024-02-21T23:01:50.553472+0000","last_peered":"2024-02-21T23:01:50.553472+0000","last_clean":"2024-02-21T23:01:50.553472+0000","last_became_active":"2024-02-21T23:01:07.251670+0000","last_became_peered":"2024-02-21T23:01:07.251670+0000","last_unstale":"2024-02-21T23:01:50.553472+0000","last_undegraded":"2024-02-21T23:01:50.553472+0000","last_fullsized":"2024-02-21T23:01:50.553472+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:39:03.021559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.570587+0000","last_change":"2024-02-21T23:01:03.207156+0000","last_active":"2024-02-21T23:01:50.570587+0000","last_peered":"2024-02-21T23:01:50.570587+0000","last_clean":"2024-02-21T23:01:50.570587+0000","last_became_active":"2024-02-21T23:01:03.206892+0000","last_became_peered":"2024-02-21T23:01:03.206892+0000","last_unstale":"2024-02-21T23:01:50.570587+0000","last_undegraded":"2024-02-21T23:01:50.570587+0000","last_fullsized":"2024-02-21T23:01:50.570587+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:19:01.584139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"29'10","reported_seq":36,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.536839+0000","last_change":"2024-02-21T23:01:02.209850+0000","last_active":"2024-02-21T23:01:50.536839+0000","last_peered":"2024-02-21T23:01:50.536839+0000","last_clean":"2024-02-21T23:01:50.536839+0000","last_became_active":"2024-02-21T23:01:02.209601+0000","last_became_peered":"2024-02-21T23:01:02.209601+0000","last_unstale":"2024-02-21T23:01:50.536839+0000","last_undegraded":"2024-02-21T23:01:50.536839+0000","last_fullsized":"2024-02-21T23:01:50.536839+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:36:44.497886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.569723+0000","last_change":"2024-02-21T23:01:07.651884+0000","last_active":"2024-02-21T23:01:50.569723+0000","last_peered":"2024-02-21T23:01:50.569723+0000","last_clean":"2024-02-21T23:01:50.569723+0000","last_became_active":"2024-02-21T23:01:07.651431+0000","last_became_peered":"2024-02-21T23:01:07.651431+0000","last_unstale":"2024-02-21T23:01:50.569723+0000","last_undegraded":"2024-02-21T23:01:50.569723+0000","last_fullsized":"2024-02-21T23:01:50.569723+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:37:06.063756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.645777+0000","last_change":"2024-02-21T23:01:03.221696+0000","last_active":"2024-02-21T23:01:50.645777+0000","last_peered":"2024-02-21T23:01:50.645777+0000","last_clean":"2024-02-21T23:01:50.645777+0000","last_became_active":"2024-02-21T23:01:03.221405+0000","last_became_peered":"2024-02-21T23:01:03.221405+0000","last_unstale":"2024-02-21T23:01:50.645777+0000","last_undegraded":"2024-02-21T23:01:50.645777+0000","last_fullsized":"2024-02-21T23:01:50.645777+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:45:29.610700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"29'1","reported_seq":28,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.459716+0000","last_change":"2024-02-21T23:01:02.221218+0000","last_active":"2024-02-21T23:01:50.459716+0000","last_peered":"2024-02-21T23:01:50.459716+0000","last_clean":"2024-02-21T23:01:50.459716+0000","last_became_active":"2024-02-21T23:01:02.220923+0000","last_became_peered":"2024-02-21T23:01:02.220923+0000","last_unstale":"2024-02-21T23:01:50.459716+0000","last_undegraded":"2024-02-21T23:01:50.459716+0000","last_fullsized":"2024-02-21T23:01:50.459716+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:15.938263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.456354+0000","last_change":"2024-02-21T23:01:07.268952+0000","last_active":"2024-02-21T23:01:50.456354+0000","last_peered":"2024-02-21T23:01:50.456354+0000","last_clean":"2024-02-21T23:01:50.456354+0000","last_became_active":"2024-02-21T23:01:07.268210+0000","last_became_peered":"2024-02-21T23:01:07.268210+0000","last_unstale":"2024-02-21T23:01:50.456354+0000","last_undegraded":"2024-02-21T23:01:50.456354+0000","last_fullsized":"2024-02-21T23:01:50.456354+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:40:30.373445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.569686+0000","last_change":"2024-02-21T23:01:03.218386+0000","last_active":"2024-02-21T23:01:50.569686+0000","last_peered":"2024-02-21T23:01:50.569686+0000","last_clean":"2024-02-21T23:01:50.569686+0000","last_became_active":"2024-02-21T23:01:03.218081+0000","last_became_peered":"2024-02-21T23:01:03.218081+0000","last_unstale":"2024-02-21T23:01:50.569686+0000","last_undegraded":"2024-02-21T23:01:50.569686+0000","last_fullsized":"2024-02-21T23:01:50.569686+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:35:24.590398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.536357+0000","last_change":"2024-02-21T23:01:02.207826+0000","last_active":"2024-02-21T23:01:50.536357+0000","last_peered":"2024-02-21T23:01:50.536357+0000","last_clean":"2024-02-21T23:01:50.536357+0000","last_became_active":"2024-02-21T23:01:02.206426+0000","last_became_peered":"2024-02-21T23:01:02.206426+0000","last_unstale":"2024-02-21T23:01:50.536357+0000","last_undegraded":"2024-02-21T23:01:50.536357+0000","last_fullsized":"2024-02-21T23:01:50.536357+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:17:06.353018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2],"acting":[9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.459005+0000","last_change":"2024-02-21T23:01:07.651876+0000","last_active":"2024-02-21T23:01:50.459005+0000","last_peered":"2024-02-21T23:01:50.459005+0000","last_clean":"2024-02-21T23:01:50.459005+0000","last_became_active":"2024-02-21T23:01:07.651384+0000","last_became_peered":"2024-02-21T23:01:07.651384+0000","last_unstale":"2024-02-21T23:01:50.459005+0000","last_undegraded":"2024-02-21T23:01:50.459005+0000","last_fullsized":"2024-02-21T23:01:50.459005+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:15:20.572234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.569459+0000","last_change":"2024-02-21T23:01:03.210500+0000","last_active":"2024-02-21T23:01:50.569459+0000","last_peered":"2024-02-21T23:01:50.569459+0000","last_clean":"2024-02-21T23:01:50.569459+0000","last_became_active":"2024-02-21T23:01:03.210123+0000","last_became_peered":"2024-02-21T23:01:03.210123+0000","last_unstale":"2024-02-21T23:01:50.569459+0000","last_undegraded":"2024-02-21T23:01:50.569459+0000","last_fullsized":"2024-02-21T23:01:50.569459+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:16.946152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4],"acting":[10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"29'1","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.543234+0000","last_change":"2024-02-21T23:01:02.217455+0000","last_active":"2024-02-21T23:01:50.543234+0000","last_peered":"2024-02-21T23:01:50.543234+0000","last_clean":"2024-02-21T23:01:50.543234+0000","last_became_active":"2024-02-21T23:01:02.217128+0000","last_became_peered":"2024-02-21T23:01:02.217128+0000","last_unstale":"2024-02-21T23:01:50.543234+0000","last_undegraded":"2024-02-21T23:01:50.543234+0000","last_fullsized":"2024-02-21T23:01:50.543234+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:23:41.295647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.645572+0000","last_change":"2024-02-21T23:01:07.266837+0000","last_active":"2024-02-21T23:01:50.645572+0000","last_peered":"2024-02-21T23:01:50.645572+0000","last_clean":"2024-02-21T23:01:50.645572+0000","last_became_active":"2024-02-21T23:01:07.266376+0000","last_became_peered":"2024-02-21T23:01:07.266376+0000","last_unstale":"2024-02-21T23:01:50.645572+0000","last_undegraded":"2024-02-21T23:01:50.645572+0000","last_fullsized":"2024-02-21T23:01:50.645572+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:15:20.572234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.461040+0000","last_change":"2024-02-21T23:01:03.212345+0000","last_active":"2024-02-21T23:01:50.461040+0000","last_peered":"2024-02-21T23:01:50.461040+0000","last_clean":"2024-02-21T23:01:50.461040+0000","last_became_active":"2024-02-21T23:01:03.212019+0000","last_became_peered":"2024-02-21T23:01:03.212019+0000","last_unstale":"2024-02-21T23:01:50.461040+0000","last_undegraded":"2024-02-21T23:01:50.461040+0000","last_fullsized":"2024-02-21T23:01:50.461040+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:20:55.846599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"29'4","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:59.448223+0000","last_change":"2024-02-21T23:01:02.219033+0000","last_active":"2024-02-21T23:01:59.448223+0000","last_peered":"2024-02-21T23:01:59.448223+0000","last_clean":"2024-02-21T23:01:59.448223+0000","last_became_active":"2024-02-21T23:01:02.218570+0000","last_became_peered":"2024-02-21T23:01:02.218570+0000","last_unstale":"2024-02-21T23:01:59.448223+0000","last_undegraded":"2024-02-21T23:01:59.448223+0000","last_fullsized":"2024-02-21T23:01:59.448223+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:21:29.919968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.645861+0000","last_change":"2024-02-21T23:01:07.654407+0000","last_active":"2024-02-21T23:01:50.645861+0000","last_peered":"2024-02-21T23:01:50.645861+0000","last_clean":"2024-02-21T23:01:50.645861+0000","last_became_active":"2024-02-21T23:01:07.653745+0000","last_became_peered":"2024-02-21T23:01:07.653745+0000","last_unstale":"2024-02-21T23:01:50.645861+0000","last_undegraded":"2024-02-21T23:01:50.645861+0000","last_fullsized":"2024-02-21T23:01:50.645861+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:54:44.380302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.645142+0000","last_change":"2024-02-21T23:01:03.226352+0000","last_active":"2024-02-21T23:01:50.645142+0000","last_peered":"2024-02-21T23:01:50.645142+0000","last_clean":"2024-02-21T23:01:50.645142+0000","last_became_active":"2024-02-21T23:01:03.219834+0000","last_became_peered":"2024-02-21T23:01:03.219834+0000","last_unstale":"2024-02-21T23:01:50.645142+0000","last_undegraded":"2024-02-21T23:01:50.645142+0000","last_fullsized":"2024-02-21T23:01:50.645142+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:16.946152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"29'3","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.542965+0000","last_change":"2024-02-21T23:01:02.207052+0000","last_active":"2024-02-21T23:01:50.542965+0000","last_peered":"2024-02-21T23:01:50.542965+0000","last_clean":"2024-02-21T23:01:50.542965+0000","last_became_active":"2024-02-21T23:01:02.206146+0000","last_became_peered":"2024-02-21T23:01:02.206146+0000","last_unstale":"2024-02-21T23:01:50.542965+0000","last_undegraded":"2024-02-21T23:01:50.542965+0000","last_fullsized":"2024-02-21T23:01:50.542965+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:26:49.911102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.649817+0000","last_change":"2024-02-21T23:01:50.649817+0000","last_active":"2024-02-21T23:01:50.649817+0000","last_peered":"2024-02-21T23:01:50.649817+0000","last_clean":"2024-02-21T23:01:50.649817+0000","last_became_active":"2024-02-21T23:01:50.649190+0000","last_became_peered":"2024-02-21T23:01:50.649190+0000","last_unstale":"2024-02-21T23:01:50.649817+0000","last_undegraded":"2024-02-21T23:01:50.649817+0000","last_fullsized":"2024-02-21T23:01:50.649817+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:01:32.283462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,11,6,10],"acting":[5,11,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.570082+0000","last_change":"2024-02-21T23:01:03.209260+0000","last_active":"2024-02-21T23:01:50.570082+0000","last_peered":"2024-02-21T23:01:50.570082+0000","last_clean":"2024-02-21T23:01:50.570082+0000","last_became_active":"2024-02-21T23:01:03.209007+0000","last_became_peered":"2024-02-21T23:01:03.209007+0000","last_unstale":"2024-02-21T23:01:50.570082+0000","last_undegraded":"2024-02-21T23:01:50.570082+0000","last_fullsized":"2024-02-21T23:01:50.570082+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:54:32.196725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"29'3","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.457089+0000","last_change":"2024-02-21T23:01:02.203395+0000","last_active":"2024-02-21T23:01:50.457089+0000","last_peered":"2024-02-21T23:01:50.457089+0000","last_clean":"2024-02-21T23:01:50.457089+0000","last_became_active":"2024-02-21T23:01:02.203066+0000","last_became_peered":"2024-02-21T23:01:02.203066+0000","last_unstale":"2024-02-21T23:01:50.457089+0000","last_undegraded":"2024-02-21T23:01:50.457089+0000","last_fullsized":"2024-02-21T23:01:50.457089+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:26:49.911102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":215,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.543142+0000","last_change":"2024-02-21T23:00:58.830752+0000","last_active":"2024-02-21T23:01:50.543142+0000","last_peered":"2024-02-21T23:01:50.543142+0000","last_clean":"2024-02-21T23:01:50.543142+0000","last_became_active":"2024-02-21T23:00:58.830472+0000","last_became_peered":"2024-02-21T23:00:58.830472+0000","last_unstale":"2024-02-21T23:01:50.543142+0000","last_undegraded":"2024-02-21T23:01:50.543142+0000","last_fullsized":"2024-02-21T23:01:50.543142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:00:57.811198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:00:57.811198+0000","last_clean_scrub_stamp":"2024-02-21T23:00:57.811198+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:58:31.374266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"29'1","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.543366+0000","last_change":"2024-02-21T23:01:07.276992+0000","last_active":"2024-02-21T23:01:50.543366+0000","last_peered":"2024-02-21T23:01:50.543366+0000","last_clean":"2024-02-21T23:01:50.543366+0000","last_became_active":"2024-02-21T23:01:07.276489+0000","last_became_peered":"2024-02-21T23:01:07.276489+0000","last_unstale":"2024-02-21T23:01:50.543366+0000","last_undegraded":"2024-02-21T23:01:50.543366+0000","last_fullsized":"2024-02-21T23:01:50.543366+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:02:35.072200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.543478+0000","last_change":"2024-02-21T23:01:03.216192+0000","last_active":"2024-02-21T23:01:50.543478+0000","last_peered":"2024-02-21T23:01:50.543478+0000","last_clean":"2024-02-21T23:01:50.543478+0000","last_became_active":"2024-02-21T23:01:03.215904+0000","last_became_peered":"2024-02-21T23:01:03.215904+0000","last_unstale":"2024-02-21T23:01:50.543478+0000","last_undegraded":"2024-02-21T23:01:50.543478+0000","last_fullsized":"2024-02-21T23:01:50.543478+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:15:16.524157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"29'3","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.553915+0000","last_change":"2024-02-21T23:01:02.207406+0000","last_active":"2024-02-21T23:01:50.553915+0000","last_peered":"2024-02-21T23:01:50.553915+0000","last_clean":"2024-02-21T23:01:50.553915+0000","last_became_active":"2024-02-21T23:01:02.206219+0000","last_became_peered":"2024-02-21T23:01:02.206219+0000","last_unstale":"2024-02-21T23:01:50.553915+0000","last_undegraded":"2024-02-21T23:01:50.553915+0000","last_fullsized":"2024-02-21T23:01:50.553915+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:21:29.919968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11],"acting":[2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.568656+0000","last_change":"2024-02-21T23:01:07.265822+0000","last_active":"2024-02-21T23:01:50.568656+0000","last_peered":"2024-02-21T23:01:50.568656+0000","last_clean":"2024-02-21T23:01:50.568656+0000","last_became_active":"2024-02-21T23:01:07.265401+0000","last_became_peered":"2024-02-21T23:01:07.265401+0000","last_unstale":"2024-02-21T23:01:50.568656+0000","last_undegraded":"2024-02-21T23:01:50.568656+0000","last_fullsized":"2024-02-21T23:01:50.568656+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:47:23.414344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.543296+0000","last_change":"2024-02-21T23:01:03.220586+0000","last_active":"2024-02-21T23:01:50.543296+0000","last_peered":"2024-02-21T23:01:50.543296+0000","last_clean":"2024-02-21T23:01:50.543296+0000","last_became_active":"2024-02-21T23:01:03.220349+0000","last_became_peered":"2024-02-21T23:01:03.220349+0000","last_unstale":"2024-02-21T23:01:50.543296+0000","last_undegraded":"2024-02-21T23:01:50.543296+0000","last_fullsized":"2024-02-21T23:01:50.543296+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:20:55.846599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":28,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.461582+0000","last_change":"2024-02-21T23:01:02.206319+0000","last_active":"2024-02-21T23:01:50.461582+0000","last_peered":"2024-02-21T23:01:50.461582+0000","last_clean":"2024-02-21T23:01:50.461582+0000","last_became_active":"2024-02-21T23:01:02.205747+0000","last_became_peered":"2024-02-21T23:01:02.205747+0000","last_unstale":"2024-02-21T23:01:50.461582+0000","last_undegraded":"2024-02-21T23:01:50.461582+0000","last_fullsized":"2024-02-21T23:01:50.461582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:10:09.680115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10],"acting":[5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.457099+0000","last_change":"2024-02-21T23:01:07.280592+0000","last_active":"2024-02-21T23:01:50.457099+0000","last_peered":"2024-02-21T23:01:50.457099+0000","last_clean":"2024-02-21T23:01:50.457099+0000","last_became_active":"2024-02-21T23:01:07.280193+0000","last_became_peered":"2024-02-21T23:01:07.280193+0000","last_unstale":"2024-02-21T23:01:50.457099+0000","last_undegraded":"2024-02-21T23:01:50.457099+0000","last_fullsized":"2024-02-21T23:01:50.457099+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:40:30.373445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.543523+0000","last_change":"2024-02-21T23:01:03.216834+0000","last_active":"2024-02-21T23:01:50.543523+0000","last_peered":"2024-02-21T23:01:50.543523+0000","last_clean":"2024-02-21T23:01:50.543523+0000","last_became_active":"2024-02-21T23:01:03.216578+0000","last_became_peered":"2024-02-21T23:01:03.216578+0000","last_unstale":"2024-02-21T23:01:50.543523+0000","last_undegraded":"2024-02-21T23:01:50.543523+0000","last_fullsized":"2024-02-21T23:01:50.543523+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:37:02.015678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":28,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.645911+0000","last_change":"2024-02-21T23:01:02.220913+0000","last_active":"2024-02-21T23:01:50.645911+0000","last_peered":"2024-02-21T23:01:50.645911+0000","last_clean":"2024-02-21T23:01:50.645911+0000","last_became_active":"2024-02-21T23:01:02.220554+0000","last_became_peered":"2024-02-21T23:01:02.220554+0000","last_unstale":"2024-02-21T23:01:50.645911+0000","last_undegraded":"2024-02-21T23:01:50.645911+0000","last_fullsized":"2024-02-21T23:01:50.645911+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:36:44.497886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.460856+0000","last_change":"2024-02-21T23:01:07.257431+0000","last_active":"2024-02-21T23:01:50.460856+0000","last_peered":"2024-02-21T23:01:50.460856+0000","last_clean":"2024-02-21T23:01:50.460856+0000","last_became_active":"2024-02-21T23:01:07.257011+0000","last_became_peered":"2024-02-21T23:01:07.257011+0000","last_unstale":"2024-02-21T23:01:50.460856+0000","last_undegraded":"2024-02-21T23:01:50.460856+0000","last_fullsized":"2024-02-21T23:01:50.460856+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:44:43.960074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.456680+0000","last_change":"2024-02-21T23:01:03.211792+0000","last_active":"2024-02-21T23:01:50.456680+0000","last_peered":"2024-02-21T23:01:50.456680+0000","last_clean":"2024-02-21T23:01:50.456680+0000","last_became_active":"2024-02-21T23:01:03.211467+0000","last_became_peered":"2024-02-21T23:01:03.211467+0000","last_unstale":"2024-02-21T23:01:50.456680+0000","last_undegraded":"2024-02-21T23:01:50.456680+0000","last_fullsized":"2024-02-21T23:01:50.456680+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:54:32.196725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"29'2","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.459328+0000","last_change":"2024-02-21T23:01:02.211763+0000","last_active":"2024-02-21T23:01:50.459328+0000","last_peered":"2024-02-21T23:01:50.459328+0000","last_clean":"2024-02-21T23:01:50.459328+0000","last_became_active":"2024-02-21T23:01:02.211470+0000","last_became_peered":"2024-02-21T23:01:02.211470+0000","last_unstale":"2024-02-21T23:01:50.459328+0000","last_undegraded":"2024-02-21T23:01:50.459328+0000","last_fullsized":"2024-02-21T23:01:50.459328+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:23:41.295647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5],"acting":[8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.460967+0000","last_change":"2024-02-21T23:01:07.269076+0000","last_active":"2024-02-21T23:01:50.460967+0000","last_peered":"2024-02-21T23:01:50.460967+0000","last_clean":"2024-02-21T23:01:50.460967+0000","last_became_active":"2024-02-21T23:01:07.268681+0000","last_became_peered":"2024-02-21T23:01:07.268681+0000","last_unstale":"2024-02-21T23:01:50.460967+0000","last_undegraded":"2024-02-21T23:01:50.460967+0000","last_fullsized":"2024-02-21T23:01:50.460967+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:02:35.072200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.461133+0000","last_change":"2024-02-21T23:01:03.212943+0000","last_active":"2024-02-21T23:01:50.461133+0000","last_peered":"2024-02-21T23:01:50.461133+0000","last_clean":"2024-02-21T23:01:50.461133+0000","last_became_active":"2024-02-21T23:01:03.212634+0000","last_became_peered":"2024-02-21T23:01:03.212634+0000","last_unstale":"2024-02-21T23:01:50.461133+0000","last_undegraded":"2024-02-21T23:01:50.461133+0000","last_fullsized":"2024-02-21T23:01:50.461133+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:07:50.626867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"29'15","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.458942+0000","last_change":"2024-02-21T23:01:02.221957+0000","last_active":"2024-02-21T23:01:50.458942+0000","last_peered":"2024-02-21T23:01:50.458942+0000","last_clean":"2024-02-21T23:01:50.458942+0000","last_became_active":"2024-02-21T23:01:02.221642+0000","last_became_peered":"2024-02-21T23:01:02.221642+0000","last_unstale":"2024-02-21T23:01:50.458942+0000","last_undegraded":"2024-02-21T23:01:50.458942+0000","last_fullsized":"2024-02-21T23:01:50.458942+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:10:09.680115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.645802+0000","last_change":"2024-02-21T23:01:07.268330+0000","last_active":"2024-02-21T23:01:50.645802+0000","last_peered":"2024-02-21T23:01:50.645802+0000","last_clean":"2024-02-21T23:01:50.645802+0000","last_became_active":"2024-02-21T23:01:07.267874+0000","last_became_peered":"2024-02-21T23:01:07.267874+0000","last_unstale":"2024-02-21T23:01:50.645802+0000","last_undegraded":"2024-02-21T23:01:50.645802+0000","last_fullsized":"2024-02-21T23:01:50.645802+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:37:06.063756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.542962+0000","last_change":"2024-02-21T23:01:03.216774+0000","last_active":"2024-02-21T23:01:50.542962+0000","last_peered":"2024-02-21T23:01:50.542962+0000","last_clean":"2024-02-21T23:01:50.542962+0000","last_became_active":"2024-02-21T23:01:03.216466+0000","last_became_peered":"2024-02-21T23:01:03.216466+0000","last_unstale":"2024-02-21T23:01:50.542962+0000","last_undegraded":"2024-02-21T23:01:50.542962+0000","last_fullsized":"2024-02-21T23:01:50.542962+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:07:50.626867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"29'3","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:59.448983+0000","last_change":"2024-02-21T23:01:02.199060+0000","last_active":"2024-02-21T23:01:59.448983+0000","last_peered":"2024-02-21T23:01:59.448983+0000","last_clean":"2024-02-21T23:01:59.448983+0000","last_became_active":"2024-02-21T23:01:02.198709+0000","last_became_peered":"2024-02-21T23:01:02.198709+0000","last_unstale":"2024-02-21T23:01:59.448983+0000","last_undegraded":"2024-02-21T23:01:59.448983+0000","last_fullsized":"2024-02-21T23:01:59.448983+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:36:44.497886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":31,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.536405+0000","last_change":"2024-02-21T23:01:07.278031+0000","last_active":"2024-02-21T23:01:50.536405+0000","last_peered":"2024-02-21T23:01:50.536405+0000","last_clean":"2024-02-21T23:01:50.536405+0000","last_became_active":"2024-02-21T23:01:07.277289+0000","last_became_peered":"2024-02-21T23:01:07.277289+0000","last_unstale":"2024-02-21T23:01:50.536405+0000","last_undegraded":"2024-02-21T23:01:50.536405+0000","last_fullsized":"2024-02-21T23:01:50.536405+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:07:54.674944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.543265+0000","last_change":"2024-02-21T23:01:03.214805+0000","last_active":"2024-02-21T23:01:50.543265+0000","last_peered":"2024-02-21T23:01:50.543265+0000","last_clean":"2024-02-21T23:01:50.543265+0000","last_became_active":"2024-02-21T23:01:03.214507+0000","last_became_peered":"2024-02-21T23:01:03.214507+0000","last_unstale":"2024-02-21T23:01:50.543265+0000","last_undegraded":"2024-02-21T23:01:50.543265+0000","last_fullsized":"2024-02-21T23:01:50.543265+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:38:58.973481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"29'3","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.461175+0000","last_change":"2024-02-21T23:01:02.209351+0000","last_active":"2024-02-21T23:01:50.461175+0000","last_peered":"2024-02-21T23:01:50.461175+0000","last_clean":"2024-02-21T23:01:50.461175+0000","last_became_active":"2024-02-21T23:01:02.208990+0000","last_became_peered":"2024-02-21T23:01:02.208990+0000","last_unstale":"2024-02-21T23:01:50.461175+0000","last_undegraded":"2024-02-21T23:01:50.461175+0000","last_fullsized":"2024-02-21T23:01:50.461175+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:36:44.497886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.649737+0000","last_change":"2024-02-21T23:01:50.649737+0000","last_active":"2024-02-21T23:01:50.649737+0000","last_peered":"2024-02-21T23:01:50.649737+0000","last_clean":"2024-02-21T23:01:50.649737+0000","last_became_active":"2024-02-21T23:01:50.649153+0000","last_became_peered":"2024-02-21T23:01:50.649153+0000","last_unstale":"2024-02-21T23:01:50.649737+0000","last_undegraded":"2024-02-21T23:01:50.649737+0000","last_fullsized":"2024-02-21T23:01:50.649737+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:03:35.497925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,7,6],"acting":[11,8,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.645704+0000","last_change":"2024-02-21T23:01:03.226321+0000","last_active":"2024-02-21T23:01:50.645704+0000","last_peered":"2024-02-21T23:01:50.645704+0000","last_clean":"2024-02-21T23:01:50.645704+0000","last_became_active":"2024-02-21T23:01:03.224451+0000","last_became_peered":"2024-02-21T23:01:03.224451+0000","last_unstale":"2024-02-21T23:01:50.645704+0000","last_undegraded":"2024-02-21T23:01:50.645704+0000","last_fullsized":"2024-02-21T23:01:50.645704+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:35:24.590398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"29'6","reported_seq":33,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.553663+0000","last_change":"2024-02-21T23:01:02.203410+0000","last_active":"2024-02-21T23:01:50.553663+0000","last_peered":"2024-02-21T23:01:50.553663+0000","last_clean":"2024-02-21T23:01:50.553663+0000","last_became_active":"2024-02-21T23:01:02.203081+0000","last_became_peered":"2024-02-21T23:01:02.203081+0000","last_unstale":"2024-02-21T23:01:50.553663+0000","last_undegraded":"2024-02-21T23:01:50.553663+0000","last_fullsized":"2024-02-21T23:01:50.553663+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:36:44.497886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10],"acting":[2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.461334+0000","last_change":"2024-02-21T23:01:07.268810+0000","last_active":"2024-02-21T23:01:50.461334+0000","last_peered":"2024-02-21T23:01:50.461334+0000","last_clean":"2024-02-21T23:01:50.461334+0000","last_became_active":"2024-02-21T23:01:07.268436+0000","last_became_peered":"2024-02-21T23:01:07.268436+0000","last_unstale":"2024-02-21T23:01:50.461334+0000","last_undegraded":"2024-02-21T23:01:50.461334+0000","last_fullsized":"2024-02-21T23:01:50.461334+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:10:53.452033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.459605+0000","last_change":"2024-02-21T23:01:03.216176+0000","last_active":"2024-02-21T23:01:50.459605+0000","last_peered":"2024-02-21T23:01:50.459605+0000","last_clean":"2024-02-21T23:01:50.459605+0000","last_became_active":"2024-02-21T23:01:03.215888+0000","last_became_peered":"2024-02-21T23:01:03.215888+0000","last_unstale":"2024-02-21T23:01:50.459605+0000","last_undegraded":"2024-02-21T23:01:50.459605+0000","last_fullsized":"2024-02-21T23:01:50.459605+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:07:50.626867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"31'34","reported_seq":125,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:02:00.466414+0000","last_change":"2024-02-21T23:01:02.204595+0000","last_active":"2024-02-21T23:02:00.466414+0000","last_peered":"2024-02-21T23:02:00.466414+0000","last_clean":"2024-02-21T23:02:00.466414+0000","last_became_active":"2024-02-21T23:01:02.204123+0000","last_became_peered":"2024-02-21T23:01:02.204123+0000","last_unstale":"2024-02-21T23:02:00.466414+0000","last_undegraded":"2024-02-21T23:02:00.466414+0000","last_fullsized":"2024-02-21T23:02:00.466414+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:36:44.497886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66869,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":65,"num_read_kb":98,"num_write":35,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1],"acting":[10,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.536537+0000","last_change":"2024-02-21T23:01:07.275187+0000","last_active":"2024-02-21T23:01:50.536537+0000","last_peered":"2024-02-21T23:01:50.536537+0000","last_clean":"2024-02-21T23:01:50.536537+0000","last_became_active":"2024-02-21T23:01:07.265618+0000","last_became_peered":"2024-02-21T23:01:07.265618+0000","last_unstale":"2024-02-21T23:01:50.536537+0000","last_undegraded":"2024-02-21T23:01:50.536537+0000","last_fullsized":"2024-02-21T23:01:50.536537+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:47:23.414344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.568849+0000","last_change":"2024-02-21T23:01:03.216300+0000","last_active":"2024-02-21T23:01:50.568849+0000","last_peered":"2024-02-21T23:01:50.568849+0000","last_clean":"2024-02-21T23:01:50.568849+0000","last_became_active":"2024-02-21T23:01:03.214580+0000","last_became_peered":"2024-02-21T23:01:03.214580+0000","last_unstale":"2024-02-21T23:01:50.568849+0000","last_undegraded":"2024-02-21T23:01:50.568849+0000","last_fullsized":"2024-02-21T23:01:50.568849+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:41:55.485351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8],"acting":[1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"29'4","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.461514+0000","last_change":"2024-02-21T23:01:02.222064+0000","last_active":"2024-02-21T23:01:50.461514+0000","last_peered":"2024-02-21T23:01:50.461514+0000","last_clean":"2024-02-21T23:01:50.461514+0000","last_became_active":"2024-02-21T23:01:02.221735+0000","last_became_peered":"2024-02-21T23:01:02.221735+0000","last_unstale":"2024-02-21T23:01:50.461514+0000","last_undegraded":"2024-02-21T23:01:50.461514+0000","last_fullsized":"2024-02-21T23:01:50.461514+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:23:41.295647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.456728+0000","last_change":"2024-02-21T23:01:07.276469+0000","last_active":"2024-02-21T23:01:50.456728+0000","last_peered":"2024-02-21T23:01:50.456728+0000","last_clean":"2024-02-21T23:01:50.456728+0000","last_became_active":"2024-02-21T23:01:07.275982+0000","last_became_peered":"2024-02-21T23:01:07.275982+0000","last_unstale":"2024-02-21T23:01:50.456728+0000","last_undegraded":"2024-02-21T23:01:50.456728+0000","last_fullsized":"2024-02-21T23:01:50.456728+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:37:06.063756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.457882+0000","last_change":"2024-02-21T23:01:03.229449+0000","last_active":"2024-02-21T23:01:50.457882+0000","last_peered":"2024-02-21T23:01:50.457882+0000","last_clean":"2024-02-21T23:01:50.457882+0000","last_became_active":"2024-02-21T23:01:03.229193+0000","last_became_peered":"2024-02-21T23:01:03.229193+0000","last_unstale":"2024-02-21T23:01:50.457882+0000","last_undegraded":"2024-02-21T23:01:50.457882+0000","last_fullsized":"2024-02-21T23:01:50.457882+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:35:24.590398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"29'2","reported_seq":28,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.543465+0000","last_change":"2024-02-21T23:01:02.197598+0000","last_active":"2024-02-21T23:01:50.543465+0000","last_peered":"2024-02-21T23:01:50.543465+0000","last_clean":"2024-02-21T23:01:50.543465+0000","last_became_active":"2024-02-21T23:01:02.197275+0000","last_became_peered":"2024-02-21T23:01:02.197275+0000","last_unstale":"2024-02-21T23:01:50.543465+0000","last_undegraded":"2024-02-21T23:01:50.543465+0000","last_fullsized":"2024-02-21T23:01:50.543465+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:36:44.497886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.556351+0000","last_change":"2024-02-21T23:01:50.555061+0000","last_active":"2024-02-21T23:01:50.556351+0000","last_peered":"2024-02-21T23:01:50.556351+0000","last_clean":"2024-02-21T23:01:50.556351+0000","last_became_active":"2024-02-21T23:01:50.554591+0000","last_became_peered":"2024-02-21T23:01:50.554591+0000","last_unstale":"2024-02-21T23:01:50.556351+0000","last_undegraded":"2024-02-21T23:01:50.556351+0000","last_fullsized":"2024-02-21T23:01:50.556351+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:11:41.919040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2,4],"acting":[8,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.568757+0000","last_change":"2024-02-21T23:01:03.215454+0000","last_active":"2024-02-21T23:01:50.568757+0000","last_peered":"2024-02-21T23:01:50.568757+0000","last_clean":"2024-02-21T23:01:50.568757+0000","last_became_active":"2024-02-21T23:01:03.215004+0000","last_became_peered":"2024-02-21T23:01:03.215004+0000","last_unstale":"2024-02-21T23:01:50.568757+0000","last_undegraded":"2024-02-21T23:01:50.568757+0000","last_fullsized":"2024-02-21T23:01:50.568757+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:27:55.341328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"29'3","reported_seq":57,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:59.437861+0000","last_change":"2024-02-21T23:01:02.207663+0000","last_active":"2024-02-21T23:01:59.437861+0000","last_peered":"2024-02-21T23:01:59.437861+0000","last_clean":"2024-02-21T23:01:59.437861+0000","last_became_active":"2024-02-21T23:01:02.207349+0000","last_became_peered":"2024-02-21T23:01:02.207349+0000","last_unstale":"2024-02-21T23:01:59.437861+0000","last_undegraded":"2024-02-21T23:01:59.437861+0000","last_fullsized":"2024-02-21T23:01:59.437861+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:21:29.919968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5],"acting":[10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.570456+0000","last_change":"2024-02-21T23:01:07.268655+0000","last_active":"2024-02-21T23:01:50.570456+0000","last_peered":"2024-02-21T23:01:50.570456+0000","last_clean":"2024-02-21T23:01:50.570456+0000","last_became_active":"2024-02-21T23:01:07.268193+0000","last_became_peered":"2024-02-21T23:01:07.268193+0000","last_unstale":"2024-02-21T23:01:50.570456+0000","last_undegraded":"2024-02-21T23:01:50.570456+0000","last_fullsized":"2024-02-21T23:01:50.570456+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:54:44.380302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.457242+0000","last_change":"2024-02-21T23:01:07.271441+0000","last_active":"2024-02-21T23:01:50.457242+0000","last_peered":"2024-02-21T23:01:50.457242+0000","last_clean":"2024-02-21T23:01:50.457242+0000","last_became_active":"2024-02-21T23:01:07.271175+0000","last_became_peered":"2024-02-21T23:01:07.271175+0000","last_unstale":"2024-02-21T23:01:50.457242+0000","last_undegraded":"2024-02-21T23:01:50.457242+0000","last_fullsized":"2024-02-21T23:01:50.457242+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:20:59.894677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.536245+0000","last_change":"2024-02-21T23:01:03.210855+0000","last_active":"2024-02-21T23:01:50.536245+0000","last_peered":"2024-02-21T23:01:50.536245+0000","last_clean":"2024-02-21T23:01:50.536245+0000","last_became_active":"2024-02-21T23:01:03.210599+0000","last_became_peered":"2024-02-21T23:01:03.210599+0000","last_unstale":"2024-02-21T23:01:50.536245+0000","last_undegraded":"2024-02-21T23:01:50.536245+0000","last_fullsized":"2024-02-21T23:01:50.536245+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:27:55.341328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"29'1","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.461249+0000","last_change":"2024-02-21T23:01:02.204603+0000","last_active":"2024-02-21T23:01:50.461249+0000","last_peered":"2024-02-21T23:01:50.461249+0000","last_clean":"2024-02-21T23:01:50.461249+0000","last_became_active":"2024-02-21T23:01:02.204304+0000","last_became_peered":"2024-02-21T23:01:02.204304+0000","last_unstale":"2024-02-21T23:01:50.461249+0000","last_undegraded":"2024-02-21T23:01:50.461249+0000","last_fullsized":"2024-02-21T23:01:50.461249+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:58:23.554457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.456616+0000","last_change":"2024-02-21T23:01:07.284000+0000","last_active":"2024-02-21T23:01:50.456616+0000","last_peered":"2024-02-21T23:01:50.456616+0000","last_clean":"2024-02-21T23:01:50.456616+0000","last_became_active":"2024-02-21T23:01:07.283568+0000","last_became_peered":"2024-02-21T23:01:07.283568+0000","last_unstale":"2024-02-21T23:01:50.456616+0000","last_undegraded":"2024-02-21T23:01:50.456616+0000","last_fullsized":"2024-02-21T23:01:50.456616+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:20:59.894677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.569859+0000","last_change":"2024-02-21T23:01:03.208483+0000","last_active":"2024-02-21T23:01:50.569859+0000","last_peered":"2024-02-21T23:01:50.569859+0000","last_clean":"2024-02-21T23:01:50.569859+0000","last_became_active":"2024-02-21T23:01:03.208141+0000","last_became_peered":"2024-02-21T23:01:03.208141+0000","last_unstale":"2024-02-21T23:01:50.569859+0000","last_undegraded":"2024-02-21T23:01:50.569859+0000","last_fullsized":"2024-02-21T23:01:50.569859+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:35:24.590398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"29'2","reported_seq":28,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.645919+0000","last_change":"2024-02-21T23:01:02.218826+0000","last_active":"2024-02-21T23:01:50.645919+0000","last_peered":"2024-02-21T23:01:50.645919+0000","last_clean":"2024-02-21T23:01:50.645919+0000","last_became_active":"2024-02-21T23:01:02.218499+0000","last_became_peered":"2024-02-21T23:01:02.218499+0000","last_unstale":"2024-02-21T23:01:50.645919+0000","last_undegraded":"2024-02-21T23:01:50.645919+0000","last_fullsized":"2024-02-21T23:01:50.645919+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:17:06.353018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"29'3","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.569474+0000","last_change":"2024-02-21T23:01:02.209061+0000","last_active":"2024-02-21T23:01:50.569474+0000","last_peered":"2024-02-21T23:01:50.569474+0000","last_clean":"2024-02-21T23:01:50.569474+0000","last_became_active":"2024-02-21T23:01:02.208779+0000","last_became_peered":"2024-02-21T23:01:02.208779+0000","last_unstale":"2024-02-21T23:01:50.569474+0000","last_undegraded":"2024-02-21T23:01:50.569474+0000","last_fullsized":"2024-02-21T23:01:50.569474+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:17:06.353018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8],"acting":[10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.461232+0000","last_change":"2024-02-21T23:01:03.212873+0000","last_active":"2024-02-21T23:01:50.461232+0000","last_peered":"2024-02-21T23:01:50.461232+0000","last_clean":"2024-02-21T23:01:50.461232+0000","last_became_active":"2024-02-21T23:01:03.212560+0000","last_became_peered":"2024-02-21T23:01:03.212560+0000","last_unstale":"2024-02-21T23:01:50.461232+0000","last_undegraded":"2024-02-21T23:01:50.461232+0000","last_fullsized":"2024-02-21T23:01:50.461232+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:47:19.366266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.553666+0000","last_change":"2024-02-21T23:01:07.269266+0000","last_active":"2024-02-21T23:01:50.553666+0000","last_peered":"2024-02-21T23:01:50.553666+0000","last_clean":"2024-02-21T23:01:50.553666+0000","last_became_active":"2024-02-21T23:01:07.267796+0000","last_became_peered":"2024-02-21T23:01:07.267796+0000","last_unstale":"2024-02-21T23:01:50.553666+0000","last_undegraded":"2024-02-21T23:01:50.553666+0000","last_fullsized":"2024-02-21T23:01:50.553666+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:37:06.063756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"29'6","reported_seq":63,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:59.438527+0000","last_change":"2024-02-21T23:01:02.206398+0000","last_active":"2024-02-21T23:01:59.438527+0000","last_peered":"2024-02-21T23:01:59.438527+0000","last_clean":"2024-02-21T23:01:59.438527+0000","last_became_active":"2024-02-21T23:01:02.206069+0000","last_became_peered":"2024-02-21T23:01:02.206069+0000","last_unstale":"2024-02-21T23:01:59.438527+0000","last_undegraded":"2024-02-21T23:01:59.438527+0000","last_fullsized":"2024-02-21T23:01:59.438527+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:26:49.911102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1017,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":31,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.459331+0000","last_change":"2024-02-21T23:01:03.221228+0000","last_active":"2024-02-21T23:01:50.459331+0000","last_peered":"2024-02-21T23:01:50.459331+0000","last_clean":"2024-02-21T23:01:50.459331+0000","last_became_active":"2024-02-21T23:01:03.220900+0000","last_became_peered":"2024-02-21T23:01:03.220900+0000","last_unstale":"2024-02-21T23:01:50.459331+0000","last_undegraded":"2024-02-21T23:01:50.459331+0000","last_fullsized":"2024-02-21T23:01:50.459331+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:40:26.325368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9],"acting":[8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.553914+0000","last_change":"2024-02-21T23:01:07.257004+0000","last_active":"2024-02-21T23:01:50.553914+0000","last_peered":"2024-02-21T23:01:50.553914+0000","last_clean":"2024-02-21T23:01:50.553914+0000","last_became_active":"2024-02-21T23:01:07.256474+0000","last_became_peered":"2024-02-21T23:01:07.256474+0000","last_unstale":"2024-02-21T23:01:50.553914+0000","last_undegraded":"2024-02-21T23:01:50.553914+0000","last_fullsized":"2024-02-21T23:01:50.553914+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:15:20.572234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.456324+0000","last_change":"2024-02-21T23:01:03.215942+0000","last_active":"2024-02-21T23:01:50.456324+0000","last_peered":"2024-02-21T23:01:50.456324+0000","last_clean":"2024-02-21T23:01:50.456324+0000","last_became_active":"2024-02-21T23:01:03.215461+0000","last_became_peered":"2024-02-21T23:01:03.215461+0000","last_unstale":"2024-02-21T23:01:50.456324+0000","last_undegraded":"2024-02-21T23:01:50.456324+0000","last_fullsized":"2024-02-21T23:01:50.456324+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:27:55.341328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.553647+0000","last_change":"2024-02-21T23:01:03.215959+0000","last_active":"2024-02-21T23:01:50.553647+0000","last_peered":"2024-02-21T23:01:50.553647+0000","last_clean":"2024-02-21T23:01:50.553647+0000","last_became_active":"2024-02-21T23:01:03.215639+0000","last_became_peered":"2024-02-21T23:01:03.215639+0000","last_unstale":"2024-02-21T23:01:50.553647+0000","last_undegraded":"2024-02-21T23:01:50.553647+0000","last_fullsized":"2024-02-21T23:01:50.553647+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:16.946152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.553477+0000","last_change":"2024-02-21T23:01:03.218687+0000","last_active":"2024-02-21T23:01:50.553477+0000","last_peered":"2024-02-21T23:01:50.553477+0000","last_clean":"2024-02-21T23:01:50.553477+0000","last_became_active":"2024-02-21T23:01:03.218377+0000","last_became_peered":"2024-02-21T23:01:03.218377+0000","last_unstale":"2024-02-21T23:01:50.553477+0000","last_undegraded":"2024-02-21T23:01:50.553477+0000","last_fullsized":"2024-02-21T23:01:50.553477+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:41:55.485351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.457235+0000","last_change":"2024-02-21T23:01:03.225342+0000","last_active":"2024-02-21T23:01:50.457235+0000","last_peered":"2024-02-21T23:01:50.457235+0000","last_clean":"2024-02-21T23:01:50.457235+0000","last_became_active":"2024-02-21T23:01:03.225085+0000","last_became_peered":"2024-02-21T23:01:03.225085+0000","last_unstale":"2024-02-21T23:01:50.457235+0000","last_undegraded":"2024-02-21T23:01:50.457235+0000","last_fullsized":"2024-02-21T23:01:50.457235+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:54:32.196725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.645600+0000","last_change":"2024-02-21T23:01:03.226259+0000","last_active":"2024-02-21T23:01:50.645600+0000","last_peered":"2024-02-21T23:01:50.645600+0000","last_clean":"2024-02-21T23:01:50.645600+0000","last_became_active":"2024-02-21T23:01:03.225925+0000","last_became_peered":"2024-02-21T23:01:03.225925+0000","last_unstale":"2024-02-21T23:01:50.645600+0000","last_undegraded":"2024-02-21T23:01:50.645600+0000","last_fullsized":"2024-02-21T23:01:50.645600+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:54:32.196725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.456563+0000","last_change":"2024-02-21T23:01:03.215186+0000","last_active":"2024-02-21T23:01:50.456563+0000","last_peered":"2024-02-21T23:01:50.456563+0000","last_clean":"2024-02-21T23:01:50.456563+0000","last_became_active":"2024-02-21T23:01:03.214488+0000","last_became_peered":"2024-02-21T23:01:03.214488+0000","last_unstale":"2024-02-21T23:01:50.456563+0000","last_undegraded":"2024-02-21T23:01:50.456563+0000","last_fullsized":"2024-02-21T23:01:50.456563+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:58:24.562346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8],"acting":[11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.554068+0000","last_change":"2024-02-21T23:01:03.208734+0000","last_active":"2024-02-21T23:01:50.554068+0000","last_peered":"2024-02-21T23:01:50.554068+0000","last_clean":"2024-02-21T23:01:50.554068+0000","last_became_active":"2024-02-21T23:01:03.208458+0000","last_became_peered":"2024-02-21T23:01:03.208458+0000","last_unstale":"2024-02-21T23:01:50.554068+0000","last_undegraded":"2024-02-21T23:01:50.554068+0000","last_fullsized":"2024-02-21T23:01:50.554068+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:54:32.196725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8],"acting":[2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.570484+0000","last_change":"2024-02-21T23:01:03.206669+0000","last_active":"2024-02-21T23:01:50.570484+0000","last_peered":"2024-02-21T23:01:50.570484+0000","last_clean":"2024-02-21T23:01:50.570484+0000","last_became_active":"2024-02-21T23:01:03.206376+0000","last_became_peered":"2024-02-21T23:01:03.206376+0000","last_unstale":"2024-02-21T23:01:50.570484+0000","last_undegraded":"2024-02-21T23:01:50.570484+0000","last_fullsized":"2024-02-21T23:01:50.570484+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:07:50.626867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.460976+0000","last_change":"2024-02-21T23:01:03.215459+0000","last_active":"2024-02-21T23:01:50.460976+0000","last_peered":"2024-02-21T23:01:50.460976+0000","last_clean":"2024-02-21T23:01:50.460976+0000","last_became_active":"2024-02-21T23:01:03.214922+0000","last_became_peered":"2024-02-21T23:01:03.214922+0000","last_unstale":"2024-02-21T23:01:50.460976+0000","last_undegraded":"2024-02-21T23:01:50.460976+0000","last_fullsized":"2024-02-21T23:01:50.460976+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:40:26.325368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.570084+0000","last_change":"2024-02-21T23:01:03.213687+0000","last_active":"2024-02-21T23:01:50.570084+0000","last_peered":"2024-02-21T23:01:50.570084+0000","last_clean":"2024-02-21T23:01:50.570084+0000","last_became_active":"2024-02-21T23:01:03.213428+0000","last_became_peered":"2024-02-21T23:01:03.213428+0000","last_unstale":"2024-02-21T23:01:50.570084+0000","last_undegraded":"2024-02-21T23:01:50.570084+0000","last_fullsized":"2024-02-21T23:01:50.570084+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:45:29.610700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.568724+0000","last_change":"2024-02-21T23:01:03.215983+0000","last_active":"2024-02-21T23:01:50.568724+0000","last_peered":"2024-02-21T23:01:50.568724+0000","last_clean":"2024-02-21T23:01:50.568724+0000","last_became_active":"2024-02-21T23:01:03.215580+0000","last_became_peered":"2024-02-21T23:01:03.215580+0000","last_unstale":"2024-02-21T23:01:50.568724+0000","last_undegraded":"2024-02-21T23:01:50.568724+0000","last_fullsized":"2024-02-21T23:01:50.568724+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:58:24.562346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.646827+0000","last_change":"2024-02-21T23:01:03.226514+0000","last_active":"2024-02-21T23:01:50.646827+0000","last_peered":"2024-02-21T23:01:50.646827+0000","last_clean":"2024-02-21T23:01:50.646827+0000","last_became_active":"2024-02-21T23:01:03.223861+0000","last_became_peered":"2024-02-21T23:01:03.223861+0000","last_unstale":"2024-02-21T23:01:50.646827+0000","last_undegraded":"2024-02-21T23:01:50.646827+0000","last_fullsized":"2024-02-21T23:01:50.646827+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:07:50.626867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.456544+0000","last_change":"2024-02-21T23:01:03.212993+0000","last_active":"2024-02-21T23:01:50.456544+0000","last_peered":"2024-02-21T23:01:50.456544+0000","last_clean":"2024-02-21T23:01:50.456544+0000","last_became_active":"2024-02-21T23:01:03.212691+0000","last_became_peered":"2024-02-21T23:01:03.212691+0000","last_unstale":"2024-02-21T23:01:50.456544+0000","last_undegraded":"2024-02-21T23:01:50.456544+0000","last_fullsized":"2024-02-21T23:01:50.456544+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:10:10.688004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.554112+0000","last_change":"2024-02-21T23:01:03.217962+0000","last_active":"2024-02-21T23:01:50.554112+0000","last_peered":"2024-02-21T23:01:50.554112+0000","last_clean":"2024-02-21T23:01:50.554112+0000","last_became_active":"2024-02-21T23:01:03.217613+0000","last_became_peered":"2024-02-21T23:01:03.217613+0000","last_unstale":"2024-02-21T23:01:50.554112+0000","last_undegraded":"2024-02-21T23:01:50.554112+0000","last_fullsized":"2024-02-21T23:01:50.554112+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:35:24.590398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.536790+0000","last_change":"2024-02-21T23:01:03.214531+0000","last_active":"2024-02-21T23:01:50.536790+0000","last_peered":"2024-02-21T23:01:50.536790+0000","last_clean":"2024-02-21T23:01:50.536790+0000","last_became_active":"2024-02-21T23:01:03.214165+0000","last_became_peered":"2024-02-21T23:01:03.214165+0000","last_unstale":"2024-02-21T23:01:50.536790+0000","last_undegraded":"2024-02-21T23:01:50.536790+0000","last_fullsized":"2024-02-21T23:01:50.536790+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:58:24.562346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1],"acting":[9,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.456840+0000","last_change":"2024-02-21T23:01:03.214286+0000","last_active":"2024-02-21T23:01:50.456840+0000","last_peered":"2024-02-21T23:01:50.456840+0000","last_clean":"2024-02-21T23:01:50.456840+0000","last_became_active":"2024-02-21T23:01:03.213755+0000","last_became_peered":"2024-02-21T23:01:03.213755+0000","last_unstale":"2024-02-21T23:01:50.456840+0000","last_undegraded":"2024-02-21T23:01:50.456840+0000","last_fullsized":"2024-02-21T23:01:50.456840+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:35:24.590398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.568509+0000","last_change":"2024-02-21T23:01:03.216623+0000","last_active":"2024-02-21T23:01:50.568509+0000","last_peered":"2024-02-21T23:01:50.568509+0000","last_clean":"2024-02-21T23:01:50.568509+0000","last_became_active":"2024-02-21T23:01:03.216345+0000","last_became_peered":"2024-02-21T23:01:03.216345+0000","last_unstale":"2024-02-21T23:01:50.568509+0000","last_undegraded":"2024-02-21T23:01:50.568509+0000","last_fullsized":"2024-02-21T23:01:50.568509+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:10:10.688004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.457666+0000","last_change":"2024-02-21T23:01:03.226262+0000","last_active":"2024-02-21T23:01:50.457666+0000","last_peered":"2024-02-21T23:01:50.457666+0000","last_clean":"2024-02-21T23:01:50.457666+0000","last_became_active":"2024-02-21T23:01:03.225574+0000","last_became_peered":"2024-02-21T23:01:03.225574+0000","last_unstale":"2024-02-21T23:01:50.457666+0000","last_undegraded":"2024-02-21T23:01:50.457666+0000","last_fullsized":"2024-02-21T23:01:50.457666+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:10:10.688004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.457036+0000","last_change":"2024-02-21T23:01:03.225898+0000","last_active":"2024-02-21T23:01:50.457036+0000","last_peered":"2024-02-21T23:01:50.457036+0000","last_clean":"2024-02-21T23:01:50.457036+0000","last_became_active":"2024-02-21T23:01:03.217938+0000","last_became_peered":"2024-02-21T23:01:03.217938+0000","last_unstale":"2024-02-21T23:01:50.457036+0000","last_undegraded":"2024-02-21T23:01:50.457036+0000","last_fullsized":"2024-02-21T23:01:50.457036+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:58:24.562346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8],"acting":[0,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.645608+0000","last_change":"2024-02-21T23:01:03.225830+0000","last_active":"2024-02-21T23:01:50.645608+0000","last_peered":"2024-02-21T23:01:50.645608+0000","last_clean":"2024-02-21T23:01:50.645608+0000","last_became_active":"2024-02-21T23:01:03.225449+0000","last_became_peered":"2024-02-21T23:01:03.225449+0000","last_unstale":"2024-02-21T23:01:50.645608+0000","last_undegraded":"2024-02-21T23:01:50.645608+0000","last_fullsized":"2024-02-21T23:01:50.645608+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:47:19.366266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10],"acting":[6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.456810+0000","last_change":"2024-02-21T23:01:03.208746+0000","last_active":"2024-02-21T23:01:50.456810+0000","last_peered":"2024-02-21T23:01:50.456810+0000","last_clean":"2024-02-21T23:01:50.456810+0000","last_became_active":"2024-02-21T23:01:03.208446+0000","last_became_peered":"2024-02-21T23:01:03.208446+0000","last_unstale":"2024-02-21T23:01:50.456810+0000","last_undegraded":"2024-02-21T23:01:50.456810+0000","last_fullsized":"2024-02-21T23:01:50.456810+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:58:24.562346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.543442+0000","last_change":"2024-02-21T23:01:03.218981+0000","last_active":"2024-02-21T23:01:50.543442+0000","last_peered":"2024-02-21T23:01:50.543442+0000","last_clean":"2024-02-21T23:01:50.543442+0000","last_became_active":"2024-02-21T23:01:03.217925+0000","last_became_peered":"2024-02-21T23:01:03.217925+0000","last_unstale":"2024-02-21T23:01:50.543442+0000","last_undegraded":"2024-02-21T23:01:50.543442+0000","last_fullsized":"2024-02-21T23:01:50.543442+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:54:40.332224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8],"acting":[7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.569907+0000","last_change":"2024-02-21T23:01:03.212233+0000","last_active":"2024-02-21T23:01:50.569907+0000","last_peered":"2024-02-21T23:01:50.569907+0000","last_clean":"2024-02-21T23:01:50.569907+0000","last_became_active":"2024-02-21T23:01:03.211921+0000","last_became_peered":"2024-02-21T23:01:03.211921+0000","last_unstale":"2024-02-21T23:01:50.569907+0000","last_undegraded":"2024-02-21T23:01:50.569907+0000","last_fullsized":"2024-02-21T23:01:50.569907+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:54:32.196725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2],"acting":[10,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.569007+0000","last_change":"2024-02-21T23:01:03.216861+0000","last_active":"2024-02-21T23:01:50.569007+0000","last_peered":"2024-02-21T23:01:50.569007+0000","last_clean":"2024-02-21T23:01:50.569007+0000","last_became_active":"2024-02-21T23:01:03.216580+0000","last_became_peered":"2024-02-21T23:01:03.216580+0000","last_unstale":"2024-02-21T23:01:50.569007+0000","last_undegraded":"2024-02-21T23:01:50.569007+0000","last_fullsized":"2024-02-21T23:01:50.569007+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:35:24.590398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.569807+0000","last_change":"2024-02-21T23:01:03.212164+0000","last_active":"2024-02-21T23:01:50.569807+0000","last_peered":"2024-02-21T23:01:50.569807+0000","last_clean":"2024-02-21T23:01:50.569807+0000","last_became_active":"2024-02-21T23:01:03.211811+0000","last_became_peered":"2024-02-21T23:01:03.211811+0000","last_unstale":"2024-02-21T23:01:50.569807+0000","last_undegraded":"2024-02-21T23:01:50.569807+0000","last_fullsized":"2024-02-21T23:01:50.569807+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:16.946152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.543002+0000","last_change":"2024-02-21T23:01:03.223537+0000","last_active":"2024-02-21T23:01:50.543002+0000","last_peered":"2024-02-21T23:01:50.543002+0000","last_clean":"2024-02-21T23:01:50.543002+0000","last_became_active":"2024-02-21T23:01:03.223255+0000","last_became_peered":"2024-02-21T23:01:03.223255+0000","last_unstale":"2024-02-21T23:01:50.543002+0000","last_undegraded":"2024-02-21T23:01:50.543002+0000","last_fullsized":"2024-02-21T23:01:50.543002+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:19:01.584139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9],"acting":[7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.569406+0000","last_change":"2024-02-21T23:01:03.210441+0000","last_active":"2024-02-21T23:01:50.569406+0000","last_peered":"2024-02-21T23:01:50.569406+0000","last_clean":"2024-02-21T23:01:50.569406+0000","last_became_active":"2024-02-21T23:01:03.209569+0000","last_became_peered":"2024-02-21T23:01:03.209569+0000","last_unstale":"2024-02-21T23:01:50.569406+0000","last_undegraded":"2024-02-21T23:01:50.569406+0000","last_fullsized":"2024-02-21T23:01:50.569406+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:41:55.485351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9],"acting":[10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.459113+0000","last_change":"2024-02-21T23:01:03.214234+0000","last_active":"2024-02-21T23:01:50.459113+0000","last_peered":"2024-02-21T23:01:50.459113+0000","last_clean":"2024-02-21T23:01:50.459113+0000","last_became_active":"2024-02-21T23:01:03.213941+0000","last_became_peered":"2024-02-21T23:01:03.213941+0000","last_unstale":"2024-02-21T23:01:50.459113+0000","last_undegraded":"2024-02-21T23:01:50.459113+0000","last_fullsized":"2024-02-21T23:01:50.459113+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:19:01.584139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3],"acting":[8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.456669+0000","last_change":"2024-02-21T23:01:03.207972+0000","last_active":"2024-02-21T23:01:50.456669+0000","last_peered":"2024-02-21T23:01:50.456669+0000","last_clean":"2024-02-21T23:01:50.456669+0000","last_became_active":"2024-02-21T23:01:03.206762+0000","last_became_peered":"2024-02-21T23:01:03.206762+0000","last_unstale":"2024-02-21T23:01:50.456669+0000","last_undegraded":"2024-02-21T23:01:50.456669+0000","last_fullsized":"2024-02-21T23:01:50.456669+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:27:55.341328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8],"acting":[4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.457409+0000","last_change":"2024-02-21T23:01:03.221959+0000","last_active":"2024-02-21T23:01:50.457409+0000","last_peered":"2024-02-21T23:01:50.457409+0000","last_clean":"2024-02-21T23:01:50.457409+0000","last_became_active":"2024-02-21T23:01:03.221672+0000","last_became_peered":"2024-02-21T23:01:03.221672+0000","last_unstale":"2024-02-21T23:01:50.457409+0000","last_undegraded":"2024-02-21T23:01:50.457409+0000","last_fullsized":"2024-02-21T23:01:50.457409+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:45:29.610700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.457345+0000","last_change":"2024-02-21T23:01:03.219660+0000","last_active":"2024-02-21T23:01:50.457345+0000","last_peered":"2024-02-21T23:01:50.457345+0000","last_clean":"2024-02-21T23:01:50.457345+0000","last_became_active":"2024-02-21T23:01:03.219379+0000","last_became_peered":"2024-02-21T23:01:03.219379+0000","last_unstale":"2024-02-21T23:01:50.457345+0000","last_undegraded":"2024-02-21T23:01:50.457345+0000","last_fullsized":"2024-02-21T23:01:50.457345+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:27:55.341328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11],"acting":[0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.456858+0000","last_change":"2024-02-21T23:01:03.213287+0000","last_active":"2024-02-21T23:01:50.456858+0000","last_peered":"2024-02-21T23:01:50.456858+0000","last_clean":"2024-02-21T23:01:50.456858+0000","last_became_active":"2024-02-21T23:01:03.212878+0000","last_became_peered":"2024-02-21T23:01:03.212878+0000","last_unstale":"2024-02-21T23:01:50.456858+0000","last_undegraded":"2024-02-21T23:01:50.456858+0000","last_fullsized":"2024-02-21T23:01:50.456858+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:16.946152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70874,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":196,"num_read_kb":173,"num_write":166,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":141748,"data_compressed":3672,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":0,"internal_metadata":0},"log_size":143,"ondisk_log_size":143,"up":64,"acting":64,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66458,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":11,"up_from":17,"seq":73014444048,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":335872,"data_stored":163371,"data_compressed":14087,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":17,"seq":73014444047,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":417792,"data_stored":225790,"data_compressed":15923,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":17,"seq":73014444048,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":344064,"data_stored":167557,"data_compressed":14087,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":17,"seq":73014444047,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":348160,"data_stored":162945,"data_compressed":14087,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":17,"seq":73014444048,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":409600,"data_stored":758423,"data_compressed":47316,"data_compressed_allocated":65536,"data_compressed_original":614400,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":17,"seq":73014444047,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":331776,"data_stored":158783,"data_compressed":14087,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":17,"seq":73014444048,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":755028,"data_compressed":47316,"data_compressed_allocated":65536,"data_compressed_original":614400,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":17,"seq":73014444048,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":339968,"data_stored":163411,"data_compressed":14087,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":17,"seq":73014444048,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":335872,"data_stored":158873,"data_compressed":14087,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444048,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":344064,"data_stored":160326,"data_compressed":14087,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":17,"seq":73014444048,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":401408,"data_stored":225562,"data_compressed":15923,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":17,"seq":73014444048,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":348160,"data_stored":159499,"data_compressed":14087,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33229,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33229,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":66869,"data_compressed":1836,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":67097,"data_compressed":1836,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-21T23:02:04.226 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-21T23:02:04.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.480+0000 7f1f3b400640 1 Processor -- start 2024-02-21T23:02:04.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.480+0000 7f1f3b400640 1 -- start start 2024-02-21T23:02:04.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.483+0000 7f1f3b400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f1f3418a140 0x7f1f340ed570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:04.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.483+0000 7f1f3b400640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f3406e560 con 0x7f1f34188c70 2024-02-21T23:02:04.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.483+0000 7f1f3b400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f3406e840 con 0x7f1f34189050 2024-02-21T23:02:04.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.483+0000 7f1f3b400640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f340edab0 con 0x7f1f3418a140 2024-02-21T23:02:04.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.484+0000 7f1f38a00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f1f34188c70 0x7f1f3406f600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:36458/0 (socket says 172.21.15.99:36458) 2024-02-21T23:02:04.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.484+0000 7f1f38a00640 1 -- 172.21.15.99:0/3850404026 learned_addr learned my addr 172.21.15.99:0/3850404026 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:02:04.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.484+0000 7f1f33e00640 1 --2- 172.21.15.99:0/3850404026 >> v2:172.21.15.162:3300/0 conn(0x7f1f3418a140 0x7f1f340ed570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:04.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.484+0000 7f1f33400640 1 -- 172.21.15.99:0/3850404026 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 200504491 0 0) 0x7f1f3406e560 con 0x7f1f34188c70 2024-02-21T23:02:04.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.484+0000 7f1f33400640 1 -- 172.21.15.99:0/3850404026 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f1c003520 con 0x7f1f34188c70 2024-02-21T23:02:04.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.484+0000 7f1f33400640 1 -- 172.21.15.99:0/3850404026 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 491452215 0 0) 0x7f1f3406e840 con 0x7f1f34189050 2024-02-21T23:02:04.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.484+0000 7f1f33400640 1 -- 172.21.15.99:0/3850404026 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f3406e560 con 0x7f1f34189050 2024-02-21T23:02:04.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.484+0000 7f1f33e00640 1 -- 172.21.15.99:0/3850404026 >> v1:172.21.15.162:6789/0 conn(0x7f1f34189050 legacy=0x7f1f34189500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:04.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.484+0000 7f1f33e00640 1 -- 172.21.15.99:0/3850404026 >> v1:172.21.15.99:6789/0 conn(0x7f1f34188c70 legacy=0x7f1f3406f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:04.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.484+0000 7f1f33e00640 1 -- 172.21.15.99:0/3850404026 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f3406eb20 con 0x7f1f3418a140 2024-02-21T23:02:04.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.486+0000 7f1f33e00640 1 --2- 172.21.15.99:0/3850404026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1f3418a140 0x7f1f340ed570 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1f200097a0 tx=0x7f1f2002b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2361b62b3aa15f6 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:04.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.486+0000 7f1f33400640 1 -- 172.21.15.99:0/3850404026 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f20034070 con 0x7f1f3418a140 2024-02-21T23:02:04.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.487+0000 7f1f33400640 1 -- 172.21.15.99:0/3850404026 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f20030610 con 0x7f1f3418a140 2024-02-21T23:02:04.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.487+0000 7f1f33400640 1 -- 172.21.15.99:0/3850404026 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f200309e0 con 0x7f1f3418a140 2024-02-21T23:02:04.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.487+0000 7f1f3b400640 1 -- 172.21.15.99:0/3850404026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1f3418a140 msgr2=0x7f1f340ed570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:04.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.487+0000 7f1f3b400640 1 --2- 172.21.15.99:0/3850404026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1f3418a140 0x7f1f340ed570 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1f200097a0 tx=0x7f1f2002b960 comp rx=0 tx=0).stop 2024-02-21T23:02:04.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.487+0000 7f1f3b400640 1 -- 172.21.15.99:0/3850404026 shutdown_connections 2024-02-21T23:02:04.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.487+0000 7f1f3b400640 1 --2- 172.21.15.99:0/3850404026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1f3418a140 0x7f1f340ed570 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:04.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.487+0000 7f1f3b400640 1 -- 172.21.15.99:0/3850404026 >> 172.21.15.99:0/3850404026 conn(0x7f1f340ce5f0 msgr2=0x7f1f340cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:04.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.487+0000 7f1f3b400640 1 -- 172.21.15.99:0/3850404026 shutdown_connections 2024-02-21T23:02:04.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.487+0000 7f1f3b400640 1 -- 172.21.15.99:0/3850404026 wait complete. 2024-02-21T23:02:04.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.491+0000 7f1f3b400640 1 Processor -- start 2024-02-21T23:02:04.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.491+0000 7f1f3b400640 1 -- start start 2024-02-21T23:02:04.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.493+0000 7f1f3b400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1f34188c70 0x7f1f3416cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:04.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.493+0000 7f1f3b400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1f34189050 0x7f1f34220500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:04.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.493+0000 7f1f3b400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f3418a140 0x7f1f3421d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:04.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.493+0000 7f1f3b400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3406f0e0 con 0x7f1f3418a140 2024-02-21T23:02:04.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.493+0000 7f1f3b400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3406e310 con 0x7f1f34188c70 2024-02-21T23:02:04.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.493+0000 7f1f3b400640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3406fd10 con 0x7f1f34189050 2024-02-21T23:02:04.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.493+0000 7f1f38a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1f34188c70 0x7f1f3416cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:04.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.493+0000 7f1f39400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f3418a140 0x7f1f3421d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:04.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.493+0000 7f1f38a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1f34188c70 0x7f1f3416cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:40760/0 (socket says 172.21.15.99:40760) 2024-02-21T23:02:04.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.493+0000 7f1f38a00640 1 -- 172.21.15.99:0/2867158151 learned_addr learned my addr 172.21.15.99:0/2867158151 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:04.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.493+0000 7f1f33e00640 1 --2- 172.21.15.99:0/2867158151 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1f34189050 0x7f1f34220500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:04.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.494+0000 7f1f38a00640 1 -- 172.21.15.99:0/2867158151 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1f34189050 msgr2=0x7f1f34220500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:04.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.494+0000 7f1f38a00640 1 --2- 172.21.15.99:0/2867158151 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1f34189050 0x7f1f34220500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:04.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.494+0000 7f1f38a00640 1 -- 172.21.15.99:0/2867158151 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f3418a140 msgr2=0x7f1f3421d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:04.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.494+0000 7f1f38a00640 1 --2- 172.21.15.99:0/2867158151 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f3418a140 0x7f1f3421d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:04.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.494+0000 7f1f38a00640 1 -- 172.21.15.99:0/2867158151 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f34220f40 con 0x7f1f34188c70 2024-02-21T23:02:04.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.494+0000 7f1f38a00640 1 --2- 172.21.15.99:0/2867158151 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1f34188c70 0x7f1f3416cf90 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1f2800c450 tx=0x7f1f2800c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:04.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.494+0000 7f1f30c00640 1 -- 172.21.15.99:0/2867158151 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f28017070 con 0x7f1f34188c70 2024-02-21T23:02:04.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.495+0000 7f1f30c00640 1 -- 172.21.15.99:0/2867158151 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f28005ce0 con 0x7f1f34188c70 2024-02-21T23:02:04.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.495+0000 7f1f3b400640 1 -- 172.21.15.99:0/2867158151 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f34221220 con 0x7f1f34188c70 2024-02-21T23:02:04.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.495+0000 7f1f30c00640 1 -- 172.21.15.99:0/2867158151 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f280072b0 con 0x7f1f34188c70 2024-02-21T23:02:04.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.495+0000 7f1f3b400640 1 -- 172.21.15.99:0/2867158151 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f342217e0 con 0x7f1f34188c70 2024-02-21T23:02:04.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.496+0000 7f1f3b400640 1 -- 172.21.15.99:0/2867158151 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f340ed8d0 con 0x7f1f34188c70 2024-02-21T23:02:04.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.500+0000 7f1f30c00640 1 -- 172.21.15.99:0/2867158151 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 6) v1 ==== 134407+0+0 (secure 0 0 0) 0x7f1f2801a070 con 0x7f1f34188c70 2024-02-21T23:02:04.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.501+0000 7f1f30c00640 1 --2- 172.21.15.99:0/2867158151 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f1f1409edf0 0x7f1f140a12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:04.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.501+0000 7f1f30c00640 1 -- 172.21.15.99:0/2867158151 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f1f280c9310 con 0x7f1f34188c70 2024-02-21T23:02:04.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.501+0000 7f1f33e00640 1 --2- 172.21.15.99:0/2867158151 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f1f1409edf0 0x7f1f140a12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:04.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.501+0000 7f1f30c00640 1 -- 172.21.15.99:0/2867158151 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f1f340ed8d0 con 0x7f1f34188c70 2024-02-21T23:02:04.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.502+0000 7f1f33e00640 1 --2- 172.21.15.99:0/2867158151 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f1f1409edf0 0x7f1f140a12b0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1f20036000 tx=0x7f1f2003b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:04.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.710+0000 7f1f3b400640 1 -- 172.21.15.99:0/2867158151 --> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1f34070070 con 0x7f1f1409edf0 2024-02-21T23:02:04.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.719+0000 7f1f30c00640 1 -- 172.21.15.99:0/2867158151 <== mgr.4106 v2:172.21.15.162:6800/1717094936 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+338721 (secure 0 0 0) 0x7f1f2009ab40 con 0x7f1f1409edf0 2024-02-21T23:02:04.713 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T23:02:04.715 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-02-21T23:02:04.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.726+0000 7f1f3b400640 1 -- 172.21.15.99:0/2867158151 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f1f1409edf0 msgr2=0x7f1f140a12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:04.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.726+0000 7f1f3b400640 1 --2- 172.21.15.99:0/2867158151 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f1f1409edf0 0x7f1f140a12b0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1f20036000 tx=0x7f1f2003b040 comp rx=0 tx=0).stop 2024-02-21T23:02:04.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.726+0000 7f1f3b400640 1 -- 172.21.15.99:0/2867158151 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1f34188c70 msgr2=0x7f1f3416cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:04.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.726+0000 7f1f3b400640 1 --2- 172.21.15.99:0/2867158151 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1f34188c70 0x7f1f3416cf90 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1f2800c450 tx=0x7f1f2800c910 comp rx=0 tx=0).stop 2024-02-21T23:02:04.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.726+0000 7f1f3b400640 1 -- 172.21.15.99:0/2867158151 shutdown_connections 2024-02-21T23:02:04.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.726+0000 7f1f3b400640 1 --2- 172.21.15.99:0/2867158151 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f1f1409edf0 0x7f1f140a12b0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:04.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.726+0000 7f1f3b400640 1 --2- 172.21.15.99:0/2867158151 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1f3418a140 0x7f1f3421d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:04.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.726+0000 7f1f3b400640 1 --2- 172.21.15.99:0/2867158151 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1f34189050 0x7f1f34220500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:04.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.726+0000 7f1f3b400640 1 --2- 172.21.15.99:0/2867158151 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1f34188c70 0x7f1f3416cf90 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:04.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.726+0000 7f1f3b400640 1 -- 172.21.15.99:0/2867158151 >> 172.21.15.99:0/2867158151 conn(0x7f1f340ce5f0 msgr2=0x7f1f340f82b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:04.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.726+0000 7f1f3b400640 1 -- 172.21.15.99:0/2867158151 shutdown_connections 2024-02-21T23:02:04.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.726+0000 7f1f3b400640 1 -- 172.21.15.99:0/2867158151 wait complete. 2024-02-21T23:02:04.739 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":54,"stamp":"2024-02-21T23:02:02.958358+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":661476,"num_objects":64,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":332,"num_read_kb":292,"num_write":349,"num_write_kb":3062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":282,"ondisk_log_size":282,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1132462080,"kb_used":328548,"kb_used_data":4280,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1132133532,"statfs":{"total":1159641169920,"available":1159304736768,"internally_reserved":0,"allocated":4382720,"data_stored":3259568,"data_compressed":239174,"data_compressed_allocated":344064,"data_compressed_original":1654784,"omap_allocated":19138,"internal_metadata":331855166},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":9641,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":41,"num_write":5,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003586"},"pg_stats":[{"pgid":"2.1f","version":"29'9","reported_seq":36,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.536641+0000","last_change":"2024-02-21T23:01:02.208441+0000","last_active":"2024-02-21T23:01:50.536641+0000","last_peered":"2024-02-21T23:01:50.536641+0000","last_clean":"2024-02-21T23:01:50.536641+0000","last_became_active":"2024-02-21T23:01:02.208124+0000","last_became_peered":"2024-02-21T23:01:02.208124+0000","last_unstale":"2024-02-21T23:01:50.536641+0000","last_undegraded":"2024-02-21T23:01:50.536641+0000","last_fullsized":"2024-02-21T23:01:50.536641+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:21:29.919968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7],"acting":[9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.570488+0000","last_change":"2024-02-21T23:01:03.215149+0000","last_active":"2024-02-21T23:01:50.570488+0000","last_peered":"2024-02-21T23:01:50.570488+0000","last_clean":"2024-02-21T23:01:50.570488+0000","last_became_active":"2024-02-21T23:01:03.214170+0000","last_became_peered":"2024-02-21T23:01:03.214170+0000","last_unstale":"2024-02-21T23:01:50.570488+0000","last_undegraded":"2024-02-21T23:01:50.570488+0000","last_fullsized":"2024-02-21T23:01:50.570488+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:40:26.325368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.553465+0000","last_change":"2024-02-21T23:01:07.276484+0000","last_active":"2024-02-21T23:01:50.553465+0000","last_peered":"2024-02-21T23:01:50.553465+0000","last_clean":"2024-02-21T23:01:50.553465+0000","last_became_active":"2024-02-21T23:01:07.276192+0000","last_became_peered":"2024-02-21T23:01:07.276192+0000","last_unstale":"2024-02-21T23:01:50.553465+0000","last_undegraded":"2024-02-21T23:01:50.553465+0000","last_fullsized":"2024-02-21T23:01:50.553465+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:20:59.894677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"29'2","reported_seq":28,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.570585+0000","last_change":"2024-02-21T23:01:02.221231+0000","last_active":"2024-02-21T23:01:50.570585+0000","last_peered":"2024-02-21T23:01:50.570585+0000","last_clean":"2024-02-21T23:01:50.570585+0000","last_became_active":"2024-02-21T23:01:02.220941+0000","last_became_peered":"2024-02-21T23:01:02.220941+0000","last_unstale":"2024-02-21T23:01:50.570585+0000","last_undegraded":"2024-02-21T23:01:50.570585+0000","last_fullsized":"2024-02-21T23:01:50.570585+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:17:06.353018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.457808+0000","last_change":"2024-02-21T23:01:03.219579+0000","last_active":"2024-02-21T23:01:50.457808+0000","last_peered":"2024-02-21T23:01:50.457808+0000","last_clean":"2024-02-21T23:01:50.457808+0000","last_became_active":"2024-02-21T23:01:03.219221+0000","last_became_peered":"2024-02-21T23:01:03.219221+0000","last_unstale":"2024-02-21T23:01:50.457808+0000","last_undegraded":"2024-02-21T23:01:50.457808+0000","last_fullsized":"2024-02-21T23:01:50.457808+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:41:55.485351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.456345+0000","last_change":"2024-02-21T23:01:07.268590+0000","last_active":"2024-02-21T23:01:50.456345+0000","last_peered":"2024-02-21T23:01:50.456345+0000","last_clean":"2024-02-21T23:01:50.456345+0000","last_became_active":"2024-02-21T23:01:07.268179+0000","last_became_peered":"2024-02-21T23:01:07.268179+0000","last_unstale":"2024-02-21T23:01:50.456345+0000","last_undegraded":"2024-02-21T23:01:50.456345+0000","last_fullsized":"2024-02-21T23:01:50.456345+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:20:59.894677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"29'4","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.459566+0000","last_change":"2024-02-21T23:01:02.208687+0000","last_active":"2024-02-21T23:01:50.459566+0000","last_peered":"2024-02-21T23:01:50.459566+0000","last_clean":"2024-02-21T23:01:50.459566+0000","last_became_active":"2024-02-21T23:01:02.208393+0000","last_became_peered":"2024-02-21T23:01:02.208393+0000","last_unstale":"2024-02-21T23:01:50.459566+0000","last_undegraded":"2024-02-21T23:01:50.459566+0000","last_fullsized":"2024-02-21T23:01:50.459566+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:41:54.477462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.568757+0000","last_change":"2024-02-21T23:01:03.215676+0000","last_active":"2024-02-21T23:01:50.568757+0000","last_peered":"2024-02-21T23:01:50.568757+0000","last_clean":"2024-02-21T23:01:50.568757+0000","last_became_active":"2024-02-21T23:01:03.214733+0000","last_became_peered":"2024-02-21T23:01:03.214733+0000","last_unstale":"2024-02-21T23:01:50.568757+0000","last_undegraded":"2024-02-21T23:01:50.568757+0000","last_fullsized":"2024-02-21T23:01:50.568757+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:16.946152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.456507+0000","last_change":"2024-02-21T23:01:07.279763+0000","last_active":"2024-02-21T23:01:50.456507+0000","last_peered":"2024-02-21T23:01:50.456507+0000","last_clean":"2024-02-21T23:01:50.456507+0000","last_became_active":"2024-02-21T23:01:07.279360+0000","last_became_peered":"2024-02-21T23:01:07.279360+0000","last_unstale":"2024-02-21T23:01:50.456507+0000","last_undegraded":"2024-02-21T23:01:50.456507+0000","last_fullsized":"2024-02-21T23:01:50.456507+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:40:30.373445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":28,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.459570+0000","last_change":"2024-02-21T23:01:02.204774+0000","last_active":"2024-02-21T23:01:50.459570+0000","last_peered":"2024-02-21T23:01:50.459570+0000","last_clean":"2024-02-21T23:01:50.459570+0000","last_became_active":"2024-02-21T23:01:02.203992+0000","last_became_peered":"2024-02-21T23:01:02.203992+0000","last_unstale":"2024-02-21T23:01:50.459570+0000","last_undegraded":"2024-02-21T23:01:50.459570+0000","last_fullsized":"2024-02-21T23:01:50.459570+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:27:54.333439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1],"acting":[8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.461361+0000","last_change":"2024-02-21T23:01:03.213022+0000","last_active":"2024-02-21T23:01:50.461361+0000","last_peered":"2024-02-21T23:01:50.461361+0000","last_clean":"2024-02-21T23:01:50.461361+0000","last_became_active":"2024-02-21T23:01:03.212702+0000","last_became_peered":"2024-02-21T23:01:03.212702+0000","last_unstale":"2024-02-21T23:01:50.461361+0000","last_undegraded":"2024-02-21T23:01:50.461361+0000","last_fullsized":"2024-02-21T23:01:50.461361+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:19:01.584139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.456449+0000","last_change":"2024-02-21T23:01:07.268800+0000","last_active":"2024-02-21T23:01:50.456449+0000","last_peered":"2024-02-21T23:01:50.456449+0000","last_clean":"2024-02-21T23:01:50.456449+0000","last_became_active":"2024-02-21T23:01:07.268357+0000","last_became_peered":"2024-02-21T23:01:07.268357+0000","last_unstale":"2024-02-21T23:01:50.456449+0000","last_undegraded":"2024-02-21T23:01:50.456449+0000","last_fullsized":"2024-02-21T23:01:50.456449+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:39:03.021559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.543257+0000","last_change":"2024-02-21T23:01:03.213517+0000","last_active":"2024-02-21T23:01:50.543257+0000","last_peered":"2024-02-21T23:01:50.543257+0000","last_clean":"2024-02-21T23:01:50.543257+0000","last_became_active":"2024-02-21T23:01:03.213186+0000","last_became_peered":"2024-02-21T23:01:03.213186+0000","last_unstale":"2024-02-21T23:01:50.543257+0000","last_undegraded":"2024-02-21T23:01:50.543257+0000","last_fullsized":"2024-02-21T23:01:50.543257+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:40:26.325368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"29'4","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.459125+0000","last_change":"2024-02-21T23:01:02.208608+0000","last_active":"2024-02-21T23:01:50.459125+0000","last_peered":"2024-02-21T23:01:50.459125+0000","last_clean":"2024-02-21T23:01:50.459125+0000","last_became_active":"2024-02-21T23:01:02.208293+0000","last_became_peered":"2024-02-21T23:01:02.208293+0000","last_unstale":"2024-02-21T23:01:50.459125+0000","last_undegraded":"2024-02-21T23:01:50.459125+0000","last_fullsized":"2024-02-21T23:01:50.459125+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:58:23.554457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.456577+0000","last_change":"2024-02-21T23:01:07.651717+0000","last_active":"2024-02-21T23:01:50.456577+0000","last_peered":"2024-02-21T23:01:50.456577+0000","last_clean":"2024-02-21T23:01:50.456577+0000","last_became_active":"2024-02-21T23:01:07.651241+0000","last_became_peered":"2024-02-21T23:01:07.651241+0000","last_unstale":"2024-02-21T23:01:50.456577+0000","last_undegraded":"2024-02-21T23:01:50.456577+0000","last_fullsized":"2024-02-21T23:01:50.456577+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:54:44.380302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.570374+0000","last_change":"2024-02-21T23:01:03.221678+0000","last_active":"2024-02-21T23:01:50.570374+0000","last_peered":"2024-02-21T23:01:50.570374+0000","last_clean":"2024-02-21T23:01:50.570374+0000","last_became_active":"2024-02-21T23:01:03.219898+0000","last_became_peered":"2024-02-21T23:01:03.219898+0000","last_unstale":"2024-02-21T23:01:50.570374+0000","last_undegraded":"2024-02-21T23:01:50.570374+0000","last_fullsized":"2024-02-21T23:01:50.570374+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:47:19.366266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"29'1","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.553488+0000","last_change":"2024-02-21T23:01:02.202866+0000","last_active":"2024-02-21T23:01:50.553488+0000","last_peered":"2024-02-21T23:01:50.553488+0000","last_clean":"2024-02-21T23:01:50.553488+0000","last_became_active":"2024-02-21T23:01:02.202585+0000","last_became_peered":"2024-02-21T23:01:02.202585+0000","last_unstale":"2024-02-21T23:01:50.553488+0000","last_undegraded":"2024-02-21T23:01:50.553488+0000","last_fullsized":"2024-02-21T23:01:50.553488+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:26:49.911102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"29'1","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.456781+0000","last_change":"2024-02-21T23:01:07.277000+0000","last_active":"2024-02-21T23:01:50.456781+0000","last_peered":"2024-02-21T23:01:50.456781+0000","last_clean":"2024-02-21T23:01:50.456781+0000","last_became_active":"2024-02-21T23:01:07.276577+0000","last_became_peered":"2024-02-21T23:01:07.276577+0000","last_unstale":"2024-02-21T23:01:50.456781+0000","last_undegraded":"2024-02-21T23:01:50.456781+0000","last_fullsized":"2024-02-21T23:01:50.456781+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:15:20.572234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.456430+0000","last_change":"2024-02-21T23:01:03.219045+0000","last_active":"2024-02-21T23:01:50.456430+0000","last_peered":"2024-02-21T23:01:50.456430+0000","last_clean":"2024-02-21T23:01:50.456430+0000","last_became_active":"2024-02-21T23:01:03.218706+0000","last_became_peered":"2024-02-21T23:01:03.218706+0000","last_unstale":"2024-02-21T23:01:50.456430+0000","last_undegraded":"2024-02-21T23:01:50.456430+0000","last_fullsized":"2024-02-21T23:01:50.456430+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:41:55.485351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"29'3","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.570338+0000","last_change":"2024-02-21T23:01:02.208912+0000","last_active":"2024-02-21T23:01:50.570338+0000","last_peered":"2024-02-21T23:01:50.570338+0000","last_clean":"2024-02-21T23:01:50.570338+0000","last_became_active":"2024-02-21T23:01:02.208542+0000","last_became_peered":"2024-02-21T23:01:02.208542+0000","last_unstale":"2024-02-21T23:01:50.570338+0000","last_undegraded":"2024-02-21T23:01:50.570338+0000","last_fullsized":"2024-02-21T23:01:50.570338+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:02:11.724233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9],"acting":[3,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.536531+0000","last_change":"2024-02-21T23:01:07.282882+0000","last_active":"2024-02-21T23:01:50.536531+0000","last_peered":"2024-02-21T23:01:50.536531+0000","last_clean":"2024-02-21T23:01:50.536531+0000","last_became_active":"2024-02-21T23:01:07.282506+0000","last_became_peered":"2024-02-21T23:01:07.282506+0000","last_unstale":"2024-02-21T23:01:50.536531+0000","last_undegraded":"2024-02-21T23:01:50.536531+0000","last_fullsized":"2024-02-21T23:01:50.536531+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:19:05.632217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.458945+0000","last_change":"2024-02-21T23:01:03.212206+0000","last_active":"2024-02-21T23:01:50.458945+0000","last_peered":"2024-02-21T23:01:50.458945+0000","last_clean":"2024-02-21T23:01:50.458945+0000","last_became_active":"2024-02-21T23:01:03.211919+0000","last_became_peered":"2024-02-21T23:01:03.211919+0000","last_unstale":"2024-02-21T23:01:50.458945+0000","last_undegraded":"2024-02-21T23:01:50.458945+0000","last_fullsized":"2024-02-21T23:01:50.458945+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:20:55.846599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"29'2","reported_seq":28,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.568682+0000","last_change":"2024-02-21T23:01:02.204071+0000","last_active":"2024-02-21T23:01:50.568682+0000","last_peered":"2024-02-21T23:01:50.568682+0000","last_clean":"2024-02-21T23:01:50.568682+0000","last_became_active":"2024-02-21T23:01:02.203761+0000","last_became_peered":"2024-02-21T23:01:02.203761+0000","last_unstale":"2024-02-21T23:01:50.568682+0000","last_undegraded":"2024-02-21T23:01:50.568682+0000","last_fullsized":"2024-02-21T23:01:50.568682+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:58:34.737670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.571522+0000","last_change":"2024-02-21T23:01:50.571522+0000","last_active":"2024-02-21T23:01:50.571522+0000","last_peered":"2024-02-21T23:01:50.571522+0000","last_clean":"2024-02-21T23:01:50.571522+0000","last_became_active":"2024-02-21T23:01:50.570965+0000","last_became_peered":"2024-02-21T23:01:50.570965+0000","last_unstale":"2024-02-21T23:01:50.571522+0000","last_undegraded":"2024-02-21T23:01:50.571522+0000","last_fullsized":"2024-02-21T23:01:50.571522+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:34:39.124645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,10,9],"acting":[4,8,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.457441+0000","last_change":"2024-02-21T23:01:03.230134+0000","last_active":"2024-02-21T23:01:50.457441+0000","last_peered":"2024-02-21T23:01:50.457441+0000","last_clean":"2024-02-21T23:01:50.457441+0000","last_became_active":"2024-02-21T23:01:03.229873+0000","last_became_peered":"2024-02-21T23:01:03.229873+0000","last_unstale":"2024-02-21T23:01:50.457441+0000","last_undegraded":"2024-02-21T23:01:50.457441+0000","last_fullsized":"2024-02-21T23:01:50.457441+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:16.946152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"29'4","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.456824+0000","last_change":"2024-02-21T23:01:02.206586+0000","last_active":"2024-02-21T23:01:50.456824+0000","last_peered":"2024-02-21T23:01:50.456824+0000","last_clean":"2024-02-21T23:01:50.456824+0000","last_became_active":"2024-02-21T23:01:02.206230+0000","last_became_peered":"2024-02-21T23:01:02.206230+0000","last_unstale":"2024-02-21T23:01:50.456824+0000","last_undegraded":"2024-02-21T23:01:50.456824+0000","last_fullsized":"2024-02-21T23:01:50.456824+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:21:29.919968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11],"acting":[4,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.553472+0000","last_change":"2024-02-21T23:01:07.252255+0000","last_active":"2024-02-21T23:01:50.553472+0000","last_peered":"2024-02-21T23:01:50.553472+0000","last_clean":"2024-02-21T23:01:50.553472+0000","last_became_active":"2024-02-21T23:01:07.251670+0000","last_became_peered":"2024-02-21T23:01:07.251670+0000","last_unstale":"2024-02-21T23:01:50.553472+0000","last_undegraded":"2024-02-21T23:01:50.553472+0000","last_fullsized":"2024-02-21T23:01:50.553472+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:39:03.021559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.570587+0000","last_change":"2024-02-21T23:01:03.207156+0000","last_active":"2024-02-21T23:01:50.570587+0000","last_peered":"2024-02-21T23:01:50.570587+0000","last_clean":"2024-02-21T23:01:50.570587+0000","last_became_active":"2024-02-21T23:01:03.206892+0000","last_became_peered":"2024-02-21T23:01:03.206892+0000","last_unstale":"2024-02-21T23:01:50.570587+0000","last_undegraded":"2024-02-21T23:01:50.570587+0000","last_fullsized":"2024-02-21T23:01:50.570587+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:19:01.584139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"29'10","reported_seq":36,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.536839+0000","last_change":"2024-02-21T23:01:02.209850+0000","last_active":"2024-02-21T23:01:50.536839+0000","last_peered":"2024-02-21T23:01:50.536839+0000","last_clean":"2024-02-21T23:01:50.536839+0000","last_became_active":"2024-02-21T23:01:02.209601+0000","last_became_peered":"2024-02-21T23:01:02.209601+0000","last_unstale":"2024-02-21T23:01:50.536839+0000","last_undegraded":"2024-02-21T23:01:50.536839+0000","last_fullsized":"2024-02-21T23:01:50.536839+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:36:44.497886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.569723+0000","last_change":"2024-02-21T23:01:07.651884+0000","last_active":"2024-02-21T23:01:50.569723+0000","last_peered":"2024-02-21T23:01:50.569723+0000","last_clean":"2024-02-21T23:01:50.569723+0000","last_became_active":"2024-02-21T23:01:07.651431+0000","last_became_peered":"2024-02-21T23:01:07.651431+0000","last_unstale":"2024-02-21T23:01:50.569723+0000","last_undegraded":"2024-02-21T23:01:50.569723+0000","last_fullsized":"2024-02-21T23:01:50.569723+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:37:06.063756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.645777+0000","last_change":"2024-02-21T23:01:03.221696+0000","last_active":"2024-02-21T23:01:50.645777+0000","last_peered":"2024-02-21T23:01:50.645777+0000","last_clean":"2024-02-21T23:01:50.645777+0000","last_became_active":"2024-02-21T23:01:03.221405+0000","last_became_peered":"2024-02-21T23:01:03.221405+0000","last_unstale":"2024-02-21T23:01:50.645777+0000","last_undegraded":"2024-02-21T23:01:50.645777+0000","last_fullsized":"2024-02-21T23:01:50.645777+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:45:29.610700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"29'1","reported_seq":28,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.459716+0000","last_change":"2024-02-21T23:01:02.221218+0000","last_active":"2024-02-21T23:01:50.459716+0000","last_peered":"2024-02-21T23:01:50.459716+0000","last_clean":"2024-02-21T23:01:50.459716+0000","last_became_active":"2024-02-21T23:01:02.220923+0000","last_became_peered":"2024-02-21T23:01:02.220923+0000","last_unstale":"2024-02-21T23:01:50.459716+0000","last_undegraded":"2024-02-21T23:01:50.459716+0000","last_fullsized":"2024-02-21T23:01:50.459716+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:15.938263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.456354+0000","last_change":"2024-02-21T23:01:07.268952+0000","last_active":"2024-02-21T23:01:50.456354+0000","last_peered":"2024-02-21T23:01:50.456354+0000","last_clean":"2024-02-21T23:01:50.456354+0000","last_became_active":"2024-02-21T23:01:07.268210+0000","last_became_peered":"2024-02-21T23:01:07.268210+0000","last_unstale":"2024-02-21T23:01:50.456354+0000","last_undegraded":"2024-02-21T23:01:50.456354+0000","last_fullsized":"2024-02-21T23:01:50.456354+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:40:30.373445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.569686+0000","last_change":"2024-02-21T23:01:03.218386+0000","last_active":"2024-02-21T23:01:50.569686+0000","last_peered":"2024-02-21T23:01:50.569686+0000","last_clean":"2024-02-21T23:01:50.569686+0000","last_became_active":"2024-02-21T23:01:03.218081+0000","last_became_peered":"2024-02-21T23:01:03.218081+0000","last_unstale":"2024-02-21T23:01:50.569686+0000","last_undegraded":"2024-02-21T23:01:50.569686+0000","last_fullsized":"2024-02-21T23:01:50.569686+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:35:24.590398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.536357+0000","last_change":"2024-02-21T23:01:02.207826+0000","last_active":"2024-02-21T23:01:50.536357+0000","last_peered":"2024-02-21T23:01:50.536357+0000","last_clean":"2024-02-21T23:01:50.536357+0000","last_became_active":"2024-02-21T23:01:02.206426+0000","last_became_peered":"2024-02-21T23:01:02.206426+0000","last_unstale":"2024-02-21T23:01:50.536357+0000","last_undegraded":"2024-02-21T23:01:50.536357+0000","last_fullsized":"2024-02-21T23:01:50.536357+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:17:06.353018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2],"acting":[9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.459005+0000","last_change":"2024-02-21T23:01:07.651876+0000","last_active":"2024-02-21T23:01:50.459005+0000","last_peered":"2024-02-21T23:01:50.459005+0000","last_clean":"2024-02-21T23:01:50.459005+0000","last_became_active":"2024-02-21T23:01:07.651384+0000","last_became_peered":"2024-02-21T23:01:07.651384+0000","last_unstale":"2024-02-21T23:01:50.459005+0000","last_undegraded":"2024-02-21T23:01:50.459005+0000","last_fullsized":"2024-02-21T23:01:50.459005+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:15:20.572234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.569459+0000","last_change":"2024-02-21T23:01:03.210500+0000","last_active":"2024-02-21T23:01:50.569459+0000","last_peered":"2024-02-21T23:01:50.569459+0000","last_clean":"2024-02-21T23:01:50.569459+0000","last_became_active":"2024-02-21T23:01:03.210123+0000","last_became_peered":"2024-02-21T23:01:03.210123+0000","last_unstale":"2024-02-21T23:01:50.569459+0000","last_undegraded":"2024-02-21T23:01:50.569459+0000","last_fullsized":"2024-02-21T23:01:50.569459+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:16.946152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4],"acting":[10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"29'1","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.543234+0000","last_change":"2024-02-21T23:01:02.217455+0000","last_active":"2024-02-21T23:01:50.543234+0000","last_peered":"2024-02-21T23:01:50.543234+0000","last_clean":"2024-02-21T23:01:50.543234+0000","last_became_active":"2024-02-21T23:01:02.217128+0000","last_became_peered":"2024-02-21T23:01:02.217128+0000","last_unstale":"2024-02-21T23:01:50.543234+0000","last_undegraded":"2024-02-21T23:01:50.543234+0000","last_fullsized":"2024-02-21T23:01:50.543234+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:23:41.295647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.645572+0000","last_change":"2024-02-21T23:01:07.266837+0000","last_active":"2024-02-21T23:01:50.645572+0000","last_peered":"2024-02-21T23:01:50.645572+0000","last_clean":"2024-02-21T23:01:50.645572+0000","last_became_active":"2024-02-21T23:01:07.266376+0000","last_became_peered":"2024-02-21T23:01:07.266376+0000","last_unstale":"2024-02-21T23:01:50.645572+0000","last_undegraded":"2024-02-21T23:01:50.645572+0000","last_fullsized":"2024-02-21T23:01:50.645572+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:15:20.572234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.461040+0000","last_change":"2024-02-21T23:01:03.212345+0000","last_active":"2024-02-21T23:01:50.461040+0000","last_peered":"2024-02-21T23:01:50.461040+0000","last_clean":"2024-02-21T23:01:50.461040+0000","last_became_active":"2024-02-21T23:01:03.212019+0000","last_became_peered":"2024-02-21T23:01:03.212019+0000","last_unstale":"2024-02-21T23:01:50.461040+0000","last_undegraded":"2024-02-21T23:01:50.461040+0000","last_fullsized":"2024-02-21T23:01:50.461040+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:20:55.846599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"29'4","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:59.448223+0000","last_change":"2024-02-21T23:01:02.219033+0000","last_active":"2024-02-21T23:01:59.448223+0000","last_peered":"2024-02-21T23:01:59.448223+0000","last_clean":"2024-02-21T23:01:59.448223+0000","last_became_active":"2024-02-21T23:01:02.218570+0000","last_became_peered":"2024-02-21T23:01:02.218570+0000","last_unstale":"2024-02-21T23:01:59.448223+0000","last_undegraded":"2024-02-21T23:01:59.448223+0000","last_fullsized":"2024-02-21T23:01:59.448223+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:21:29.919968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.645861+0000","last_change":"2024-02-21T23:01:07.654407+0000","last_active":"2024-02-21T23:01:50.645861+0000","last_peered":"2024-02-21T23:01:50.645861+0000","last_clean":"2024-02-21T23:01:50.645861+0000","last_became_active":"2024-02-21T23:01:07.653745+0000","last_became_peered":"2024-02-21T23:01:07.653745+0000","last_unstale":"2024-02-21T23:01:50.645861+0000","last_undegraded":"2024-02-21T23:01:50.645861+0000","last_fullsized":"2024-02-21T23:01:50.645861+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:54:44.380302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.645142+0000","last_change":"2024-02-21T23:01:03.226352+0000","last_active":"2024-02-21T23:01:50.645142+0000","last_peered":"2024-02-21T23:01:50.645142+0000","last_clean":"2024-02-21T23:01:50.645142+0000","last_became_active":"2024-02-21T23:01:03.219834+0000","last_became_peered":"2024-02-21T23:01:03.219834+0000","last_unstale":"2024-02-21T23:01:50.645142+0000","last_undegraded":"2024-02-21T23:01:50.645142+0000","last_fullsized":"2024-02-21T23:01:50.645142+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:16.946152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"29'3","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.542965+0000","last_change":"2024-02-21T23:01:02.207052+0000","last_active":"2024-02-21T23:01:50.542965+0000","last_peered":"2024-02-21T23:01:50.542965+0000","last_clean":"2024-02-21T23:01:50.542965+0000","last_became_active":"2024-02-21T23:01:02.206146+0000","last_became_peered":"2024-02-21T23:01:02.206146+0000","last_unstale":"2024-02-21T23:01:50.542965+0000","last_undegraded":"2024-02-21T23:01:50.542965+0000","last_fullsized":"2024-02-21T23:01:50.542965+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:26:49.911102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.649817+0000","last_change":"2024-02-21T23:01:50.649817+0000","last_active":"2024-02-21T23:01:50.649817+0000","last_peered":"2024-02-21T23:01:50.649817+0000","last_clean":"2024-02-21T23:01:50.649817+0000","last_became_active":"2024-02-21T23:01:50.649190+0000","last_became_peered":"2024-02-21T23:01:50.649190+0000","last_unstale":"2024-02-21T23:01:50.649817+0000","last_undegraded":"2024-02-21T23:01:50.649817+0000","last_fullsized":"2024-02-21T23:01:50.649817+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:01:32.283462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,11,6,10],"acting":[5,11,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.570082+0000","last_change":"2024-02-21T23:01:03.209260+0000","last_active":"2024-02-21T23:01:50.570082+0000","last_peered":"2024-02-21T23:01:50.570082+0000","last_clean":"2024-02-21T23:01:50.570082+0000","last_became_active":"2024-02-21T23:01:03.209007+0000","last_became_peered":"2024-02-21T23:01:03.209007+0000","last_unstale":"2024-02-21T23:01:50.570082+0000","last_undegraded":"2024-02-21T23:01:50.570082+0000","last_fullsized":"2024-02-21T23:01:50.570082+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:54:32.196725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"29'3","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.457089+0000","last_change":"2024-02-21T23:01:02.203395+0000","last_active":"2024-02-21T23:01:50.457089+0000","last_peered":"2024-02-21T23:01:50.457089+0000","last_clean":"2024-02-21T23:01:50.457089+0000","last_became_active":"2024-02-21T23:01:02.203066+0000","last_became_peered":"2024-02-21T23:01:02.203066+0000","last_unstale":"2024-02-21T23:01:50.457089+0000","last_undegraded":"2024-02-21T23:01:50.457089+0000","last_fullsized":"2024-02-21T23:01:50.457089+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:26:49.911102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":215,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.543142+0000","last_change":"2024-02-21T23:00:58.830752+0000","last_active":"2024-02-21T23:01:50.543142+0000","last_peered":"2024-02-21T23:01:50.543142+0000","last_clean":"2024-02-21T23:01:50.543142+0000","last_became_active":"2024-02-21T23:00:58.830472+0000","last_became_peered":"2024-02-21T23:00:58.830472+0000","last_unstale":"2024-02-21T23:01:50.543142+0000","last_undegraded":"2024-02-21T23:01:50.543142+0000","last_fullsized":"2024-02-21T23:01:50.543142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:00:57.811198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:00:57.811198+0000","last_clean_scrub_stamp":"2024-02-21T23:00:57.811198+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:58:31.374266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"29'1","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.543366+0000","last_change":"2024-02-21T23:01:07.276992+0000","last_active":"2024-02-21T23:01:50.543366+0000","last_peered":"2024-02-21T23:01:50.543366+0000","last_clean":"2024-02-21T23:01:50.543366+0000","last_became_active":"2024-02-21T23:01:07.276489+0000","last_became_peered":"2024-02-21T23:01:07.276489+0000","last_unstale":"2024-02-21T23:01:50.543366+0000","last_undegraded":"2024-02-21T23:01:50.543366+0000","last_fullsized":"2024-02-21T23:01:50.543366+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:02:35.072200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.543478+0000","last_change":"2024-02-21T23:01:03.216192+0000","last_active":"2024-02-21T23:01:50.543478+0000","last_peered":"2024-02-21T23:01:50.543478+0000","last_clean":"2024-02-21T23:01:50.543478+0000","last_became_active":"2024-02-21T23:01:03.215904+0000","last_became_peered":"2024-02-21T23:01:03.215904+0000","last_unstale":"2024-02-21T23:01:50.543478+0000","last_undegraded":"2024-02-21T23:01:50.543478+0000","last_fullsized":"2024-02-21T23:01:50.543478+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:15:16.524157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"29'3","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.553915+0000","last_change":"2024-02-21T23:01:02.207406+0000","last_active":"2024-02-21T23:01:50.553915+0000","last_peered":"2024-02-21T23:01:50.553915+0000","last_clean":"2024-02-21T23:01:50.553915+0000","last_became_active":"2024-02-21T23:01:02.206219+0000","last_became_peered":"2024-02-21T23:01:02.206219+0000","last_unstale":"2024-02-21T23:01:50.553915+0000","last_undegraded":"2024-02-21T23:01:50.553915+0000","last_fullsized":"2024-02-21T23:01:50.553915+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:21:29.919968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11],"acting":[2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.568656+0000","last_change":"2024-02-21T23:01:07.265822+0000","last_active":"2024-02-21T23:01:50.568656+0000","last_peered":"2024-02-21T23:01:50.568656+0000","last_clean":"2024-02-21T23:01:50.568656+0000","last_became_active":"2024-02-21T23:01:07.265401+0000","last_became_peered":"2024-02-21T23:01:07.265401+0000","last_unstale":"2024-02-21T23:01:50.568656+0000","last_undegraded":"2024-02-21T23:01:50.568656+0000","last_fullsized":"2024-02-21T23:01:50.568656+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:47:23.414344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.543296+0000","last_change":"2024-02-21T23:01:03.220586+0000","last_active":"2024-02-21T23:01:50.543296+0000","last_peered":"2024-02-21T23:01:50.543296+0000","last_clean":"2024-02-21T23:01:50.543296+0000","last_became_active":"2024-02-21T23:01:03.220349+0000","last_became_peered":"2024-02-21T23:01:03.220349+0000","last_unstale":"2024-02-21T23:01:50.543296+0000","last_undegraded":"2024-02-21T23:01:50.543296+0000","last_fullsized":"2024-02-21T23:01:50.543296+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:20:55.846599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":28,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.461582+0000","last_change":"2024-02-21T23:01:02.206319+0000","last_active":"2024-02-21T23:01:50.461582+0000","last_peered":"2024-02-21T23:01:50.461582+0000","last_clean":"2024-02-21T23:01:50.461582+0000","last_became_active":"2024-02-21T23:01:02.205747+0000","last_became_peered":"2024-02-21T23:01:02.205747+0000","last_unstale":"2024-02-21T23:01:50.461582+0000","last_undegraded":"2024-02-21T23:01:50.461582+0000","last_fullsized":"2024-02-21T23:01:50.461582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:10:09.680115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10],"acting":[5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.457099+0000","last_change":"2024-02-21T23:01:07.280592+0000","last_active":"2024-02-21T23:01:50.457099+0000","last_peered":"2024-02-21T23:01:50.457099+0000","last_clean":"2024-02-21T23:01:50.457099+0000","last_became_active":"2024-02-21T23:01:07.280193+0000","last_became_peered":"2024-02-21T23:01:07.280193+0000","last_unstale":"2024-02-21T23:01:50.457099+0000","last_undegraded":"2024-02-21T23:01:50.457099+0000","last_fullsized":"2024-02-21T23:01:50.457099+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:40:30.373445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.543523+0000","last_change":"2024-02-21T23:01:03.216834+0000","last_active":"2024-02-21T23:01:50.543523+0000","last_peered":"2024-02-21T23:01:50.543523+0000","last_clean":"2024-02-21T23:01:50.543523+0000","last_became_active":"2024-02-21T23:01:03.216578+0000","last_became_peered":"2024-02-21T23:01:03.216578+0000","last_unstale":"2024-02-21T23:01:50.543523+0000","last_undegraded":"2024-02-21T23:01:50.543523+0000","last_fullsized":"2024-02-21T23:01:50.543523+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:37:02.015678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":28,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.645911+0000","last_change":"2024-02-21T23:01:02.220913+0000","last_active":"2024-02-21T23:01:50.645911+0000","last_peered":"2024-02-21T23:01:50.645911+0000","last_clean":"2024-02-21T23:01:50.645911+0000","last_became_active":"2024-02-21T23:01:02.220554+0000","last_became_peered":"2024-02-21T23:01:02.220554+0000","last_unstale":"2024-02-21T23:01:50.645911+0000","last_undegraded":"2024-02-21T23:01:50.645911+0000","last_fullsized":"2024-02-21T23:01:50.645911+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:36:44.497886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.460856+0000","last_change":"2024-02-21T23:01:07.257431+0000","last_active":"2024-02-21T23:01:50.460856+0000","last_peered":"2024-02-21T23:01:50.460856+0000","last_clean":"2024-02-21T23:01:50.460856+0000","last_became_active":"2024-02-21T23:01:07.257011+0000","last_became_peered":"2024-02-21T23:01:07.257011+0000","last_unstale":"2024-02-21T23:01:50.460856+0000","last_undegraded":"2024-02-21T23:01:50.460856+0000","last_fullsized":"2024-02-21T23:01:50.460856+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:44:43.960074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.456680+0000","last_change":"2024-02-21T23:01:03.211792+0000","last_active":"2024-02-21T23:01:50.456680+0000","last_peered":"2024-02-21T23:01:50.456680+0000","last_clean":"2024-02-21T23:01:50.456680+0000","last_became_active":"2024-02-21T23:01:03.211467+0000","last_became_peered":"2024-02-21T23:01:03.211467+0000","last_unstale":"2024-02-21T23:01:50.456680+0000","last_undegraded":"2024-02-21T23:01:50.456680+0000","last_fullsized":"2024-02-21T23:01:50.456680+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:54:32.196725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"29'2","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.459328+0000","last_change":"2024-02-21T23:01:02.211763+0000","last_active":"2024-02-21T23:01:50.459328+0000","last_peered":"2024-02-21T23:01:50.459328+0000","last_clean":"2024-02-21T23:01:50.459328+0000","last_became_active":"2024-02-21T23:01:02.211470+0000","last_became_peered":"2024-02-21T23:01:02.211470+0000","last_unstale":"2024-02-21T23:01:50.459328+0000","last_undegraded":"2024-02-21T23:01:50.459328+0000","last_fullsized":"2024-02-21T23:01:50.459328+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:23:41.295647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5],"acting":[8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.460967+0000","last_change":"2024-02-21T23:01:07.269076+0000","last_active":"2024-02-21T23:01:50.460967+0000","last_peered":"2024-02-21T23:01:50.460967+0000","last_clean":"2024-02-21T23:01:50.460967+0000","last_became_active":"2024-02-21T23:01:07.268681+0000","last_became_peered":"2024-02-21T23:01:07.268681+0000","last_unstale":"2024-02-21T23:01:50.460967+0000","last_undegraded":"2024-02-21T23:01:50.460967+0000","last_fullsized":"2024-02-21T23:01:50.460967+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:02:35.072200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.461133+0000","last_change":"2024-02-21T23:01:03.212943+0000","last_active":"2024-02-21T23:01:50.461133+0000","last_peered":"2024-02-21T23:01:50.461133+0000","last_clean":"2024-02-21T23:01:50.461133+0000","last_became_active":"2024-02-21T23:01:03.212634+0000","last_became_peered":"2024-02-21T23:01:03.212634+0000","last_unstale":"2024-02-21T23:01:50.461133+0000","last_undegraded":"2024-02-21T23:01:50.461133+0000","last_fullsized":"2024-02-21T23:01:50.461133+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:07:50.626867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"29'15","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.458942+0000","last_change":"2024-02-21T23:01:02.221957+0000","last_active":"2024-02-21T23:01:50.458942+0000","last_peered":"2024-02-21T23:01:50.458942+0000","last_clean":"2024-02-21T23:01:50.458942+0000","last_became_active":"2024-02-21T23:01:02.221642+0000","last_became_peered":"2024-02-21T23:01:02.221642+0000","last_unstale":"2024-02-21T23:01:50.458942+0000","last_undegraded":"2024-02-21T23:01:50.458942+0000","last_fullsized":"2024-02-21T23:01:50.458942+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:10:09.680115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.645802+0000","last_change":"2024-02-21T23:01:07.268330+0000","last_active":"2024-02-21T23:01:50.645802+0000","last_peered":"2024-02-21T23:01:50.645802+0000","last_clean":"2024-02-21T23:01:50.645802+0000","last_became_active":"2024-02-21T23:01:07.267874+0000","last_became_peered":"2024-02-21T23:01:07.267874+0000","last_unstale":"2024-02-21T23:01:50.645802+0000","last_undegraded":"2024-02-21T23:01:50.645802+0000","last_fullsized":"2024-02-21T23:01:50.645802+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:37:06.063756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.542962+0000","last_change":"2024-02-21T23:01:03.216774+0000","last_active":"2024-02-21T23:01:50.542962+0000","last_peered":"2024-02-21T23:01:50.542962+0000","last_clean":"2024-02-21T23:01:50.542962+0000","last_became_active":"2024-02-21T23:01:03.216466+0000","last_became_peered":"2024-02-21T23:01:03.216466+0000","last_unstale":"2024-02-21T23:01:50.542962+0000","last_undegraded":"2024-02-21T23:01:50.542962+0000","last_fullsized":"2024-02-21T23:01:50.542962+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:07:50.626867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"29'3","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:59.448983+0000","last_change":"2024-02-21T23:01:02.199060+0000","last_active":"2024-02-21T23:01:59.448983+0000","last_peered":"2024-02-21T23:01:59.448983+0000","last_clean":"2024-02-21T23:01:59.448983+0000","last_became_active":"2024-02-21T23:01:02.198709+0000","last_became_peered":"2024-02-21T23:01:02.198709+0000","last_unstale":"2024-02-21T23:01:59.448983+0000","last_undegraded":"2024-02-21T23:01:59.448983+0000","last_fullsized":"2024-02-21T23:01:59.448983+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:36:44.497886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":31,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.536405+0000","last_change":"2024-02-21T23:01:07.278031+0000","last_active":"2024-02-21T23:01:50.536405+0000","last_peered":"2024-02-21T23:01:50.536405+0000","last_clean":"2024-02-21T23:01:50.536405+0000","last_became_active":"2024-02-21T23:01:07.277289+0000","last_became_peered":"2024-02-21T23:01:07.277289+0000","last_unstale":"2024-02-21T23:01:50.536405+0000","last_undegraded":"2024-02-21T23:01:50.536405+0000","last_fullsized":"2024-02-21T23:01:50.536405+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:07:54.674944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.543265+0000","last_change":"2024-02-21T23:01:03.214805+0000","last_active":"2024-02-21T23:01:50.543265+0000","last_peered":"2024-02-21T23:01:50.543265+0000","last_clean":"2024-02-21T23:01:50.543265+0000","last_became_active":"2024-02-21T23:01:03.214507+0000","last_became_peered":"2024-02-21T23:01:03.214507+0000","last_unstale":"2024-02-21T23:01:50.543265+0000","last_undegraded":"2024-02-21T23:01:50.543265+0000","last_fullsized":"2024-02-21T23:01:50.543265+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:38:58.973481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"29'3","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.461175+0000","last_change":"2024-02-21T23:01:02.209351+0000","last_active":"2024-02-21T23:01:50.461175+0000","last_peered":"2024-02-21T23:01:50.461175+0000","last_clean":"2024-02-21T23:01:50.461175+0000","last_became_active":"2024-02-21T23:01:02.208990+0000","last_became_peered":"2024-02-21T23:01:02.208990+0000","last_unstale":"2024-02-21T23:01:50.461175+0000","last_undegraded":"2024-02-21T23:01:50.461175+0000","last_fullsized":"2024-02-21T23:01:50.461175+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:36:44.497886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.649737+0000","last_change":"2024-02-21T23:01:50.649737+0000","last_active":"2024-02-21T23:01:50.649737+0000","last_peered":"2024-02-21T23:01:50.649737+0000","last_clean":"2024-02-21T23:01:50.649737+0000","last_became_active":"2024-02-21T23:01:50.649153+0000","last_became_peered":"2024-02-21T23:01:50.649153+0000","last_unstale":"2024-02-21T23:01:50.649737+0000","last_undegraded":"2024-02-21T23:01:50.649737+0000","last_fullsized":"2024-02-21T23:01:50.649737+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:03:35.497925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,7,6],"acting":[11,8,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.645704+0000","last_change":"2024-02-21T23:01:03.226321+0000","last_active":"2024-02-21T23:01:50.645704+0000","last_peered":"2024-02-21T23:01:50.645704+0000","last_clean":"2024-02-21T23:01:50.645704+0000","last_became_active":"2024-02-21T23:01:03.224451+0000","last_became_peered":"2024-02-21T23:01:03.224451+0000","last_unstale":"2024-02-21T23:01:50.645704+0000","last_undegraded":"2024-02-21T23:01:50.645704+0000","last_fullsized":"2024-02-21T23:01:50.645704+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:35:24.590398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"29'6","reported_seq":33,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.553663+0000","last_change":"2024-02-21T23:01:02.203410+0000","last_active":"2024-02-21T23:01:50.553663+0000","last_peered":"2024-02-21T23:01:50.553663+0000","last_clean":"2024-02-21T23:01:50.553663+0000","last_became_active":"2024-02-21T23:01:02.203081+0000","last_became_peered":"2024-02-21T23:01:02.203081+0000","last_unstale":"2024-02-21T23:01:50.553663+0000","last_undegraded":"2024-02-21T23:01:50.553663+0000","last_fullsized":"2024-02-21T23:01:50.553663+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:36:44.497886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10],"acting":[2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.461334+0000","last_change":"2024-02-21T23:01:07.268810+0000","last_active":"2024-02-21T23:01:50.461334+0000","last_peered":"2024-02-21T23:01:50.461334+0000","last_clean":"2024-02-21T23:01:50.461334+0000","last_became_active":"2024-02-21T23:01:07.268436+0000","last_became_peered":"2024-02-21T23:01:07.268436+0000","last_unstale":"2024-02-21T23:01:50.461334+0000","last_undegraded":"2024-02-21T23:01:50.461334+0000","last_fullsized":"2024-02-21T23:01:50.461334+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:10:53.452033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.459605+0000","last_change":"2024-02-21T23:01:03.216176+0000","last_active":"2024-02-21T23:01:50.459605+0000","last_peered":"2024-02-21T23:01:50.459605+0000","last_clean":"2024-02-21T23:01:50.459605+0000","last_became_active":"2024-02-21T23:01:03.215888+0000","last_became_peered":"2024-02-21T23:01:03.215888+0000","last_unstale":"2024-02-21T23:01:50.459605+0000","last_undegraded":"2024-02-21T23:01:50.459605+0000","last_fullsized":"2024-02-21T23:01:50.459605+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:07:50.626867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"31'34","reported_seq":125,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:02:00.466414+0000","last_change":"2024-02-21T23:01:02.204595+0000","last_active":"2024-02-21T23:02:00.466414+0000","last_peered":"2024-02-21T23:02:00.466414+0000","last_clean":"2024-02-21T23:02:00.466414+0000","last_became_active":"2024-02-21T23:01:02.204123+0000","last_became_peered":"2024-02-21T23:01:02.204123+0000","last_unstale":"2024-02-21T23:02:00.466414+0000","last_undegraded":"2024-02-21T23:02:00.466414+0000","last_fullsized":"2024-02-21T23:02:00.466414+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:36:44.497886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66869,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":65,"num_read_kb":98,"num_write":35,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1],"acting":[10,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.536537+0000","last_change":"2024-02-21T23:01:07.275187+0000","last_active":"2024-02-21T23:01:50.536537+0000","last_peered":"2024-02-21T23:01:50.536537+0000","last_clean":"2024-02-21T23:01:50.536537+0000","last_became_active":"2024-02-21T23:01:07.265618+0000","last_became_peered":"2024-02-21T23:01:07.265618+0000","last_unstale":"2024-02-21T23:01:50.536537+0000","last_undegraded":"2024-02-21T23:01:50.536537+0000","last_fullsized":"2024-02-21T23:01:50.536537+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:47:23.414344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.568849+0000","last_change":"2024-02-21T23:01:03.216300+0000","last_active":"2024-02-21T23:01:50.568849+0000","last_peered":"2024-02-21T23:01:50.568849+0000","last_clean":"2024-02-21T23:01:50.568849+0000","last_became_active":"2024-02-21T23:01:03.214580+0000","last_became_peered":"2024-02-21T23:01:03.214580+0000","last_unstale":"2024-02-21T23:01:50.568849+0000","last_undegraded":"2024-02-21T23:01:50.568849+0000","last_fullsized":"2024-02-21T23:01:50.568849+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:41:55.485351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8],"acting":[1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"29'4","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.461514+0000","last_change":"2024-02-21T23:01:02.222064+0000","last_active":"2024-02-21T23:01:50.461514+0000","last_peered":"2024-02-21T23:01:50.461514+0000","last_clean":"2024-02-21T23:01:50.461514+0000","last_became_active":"2024-02-21T23:01:02.221735+0000","last_became_peered":"2024-02-21T23:01:02.221735+0000","last_unstale":"2024-02-21T23:01:50.461514+0000","last_undegraded":"2024-02-21T23:01:50.461514+0000","last_fullsized":"2024-02-21T23:01:50.461514+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:23:41.295647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.456728+0000","last_change":"2024-02-21T23:01:07.276469+0000","last_active":"2024-02-21T23:01:50.456728+0000","last_peered":"2024-02-21T23:01:50.456728+0000","last_clean":"2024-02-21T23:01:50.456728+0000","last_became_active":"2024-02-21T23:01:07.275982+0000","last_became_peered":"2024-02-21T23:01:07.275982+0000","last_unstale":"2024-02-21T23:01:50.456728+0000","last_undegraded":"2024-02-21T23:01:50.456728+0000","last_fullsized":"2024-02-21T23:01:50.456728+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:37:06.063756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.457882+0000","last_change":"2024-02-21T23:01:03.229449+0000","last_active":"2024-02-21T23:01:50.457882+0000","last_peered":"2024-02-21T23:01:50.457882+0000","last_clean":"2024-02-21T23:01:50.457882+0000","last_became_active":"2024-02-21T23:01:03.229193+0000","last_became_peered":"2024-02-21T23:01:03.229193+0000","last_unstale":"2024-02-21T23:01:50.457882+0000","last_undegraded":"2024-02-21T23:01:50.457882+0000","last_fullsized":"2024-02-21T23:01:50.457882+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:35:24.590398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"29'2","reported_seq":28,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.543465+0000","last_change":"2024-02-21T23:01:02.197598+0000","last_active":"2024-02-21T23:01:50.543465+0000","last_peered":"2024-02-21T23:01:50.543465+0000","last_clean":"2024-02-21T23:01:50.543465+0000","last_became_active":"2024-02-21T23:01:02.197275+0000","last_became_peered":"2024-02-21T23:01:02.197275+0000","last_unstale":"2024-02-21T23:01:50.543465+0000","last_undegraded":"2024-02-21T23:01:50.543465+0000","last_fullsized":"2024-02-21T23:01:50.543465+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:36:44.497886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.556351+0000","last_change":"2024-02-21T23:01:50.555061+0000","last_active":"2024-02-21T23:01:50.556351+0000","last_peered":"2024-02-21T23:01:50.556351+0000","last_clean":"2024-02-21T23:01:50.556351+0000","last_became_active":"2024-02-21T23:01:50.554591+0000","last_became_peered":"2024-02-21T23:01:50.554591+0000","last_unstale":"2024-02-21T23:01:50.556351+0000","last_undegraded":"2024-02-21T23:01:50.556351+0000","last_fullsized":"2024-02-21T23:01:50.556351+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:11:41.919040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2,4],"acting":[8,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.568757+0000","last_change":"2024-02-21T23:01:03.215454+0000","last_active":"2024-02-21T23:01:50.568757+0000","last_peered":"2024-02-21T23:01:50.568757+0000","last_clean":"2024-02-21T23:01:50.568757+0000","last_became_active":"2024-02-21T23:01:03.215004+0000","last_became_peered":"2024-02-21T23:01:03.215004+0000","last_unstale":"2024-02-21T23:01:50.568757+0000","last_undegraded":"2024-02-21T23:01:50.568757+0000","last_fullsized":"2024-02-21T23:01:50.568757+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:27:55.341328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"29'3","reported_seq":57,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:59.437861+0000","last_change":"2024-02-21T23:01:02.207663+0000","last_active":"2024-02-21T23:01:59.437861+0000","last_peered":"2024-02-21T23:01:59.437861+0000","last_clean":"2024-02-21T23:01:59.437861+0000","last_became_active":"2024-02-21T23:01:02.207349+0000","last_became_peered":"2024-02-21T23:01:02.207349+0000","last_unstale":"2024-02-21T23:01:59.437861+0000","last_undegraded":"2024-02-21T23:01:59.437861+0000","last_fullsized":"2024-02-21T23:01:59.437861+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:21:29.919968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5],"acting":[10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.570456+0000","last_change":"2024-02-21T23:01:07.268655+0000","last_active":"2024-02-21T23:01:50.570456+0000","last_peered":"2024-02-21T23:01:50.570456+0000","last_clean":"2024-02-21T23:01:50.570456+0000","last_became_active":"2024-02-21T23:01:07.268193+0000","last_became_peered":"2024-02-21T23:01:07.268193+0000","last_unstale":"2024-02-21T23:01:50.570456+0000","last_undegraded":"2024-02-21T23:01:50.570456+0000","last_fullsized":"2024-02-21T23:01:50.570456+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:54:44.380302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.457242+0000","last_change":"2024-02-21T23:01:07.271441+0000","last_active":"2024-02-21T23:01:50.457242+0000","last_peered":"2024-02-21T23:01:50.457242+0000","last_clean":"2024-02-21T23:01:50.457242+0000","last_became_active":"2024-02-21T23:01:07.271175+0000","last_became_peered":"2024-02-21T23:01:07.271175+0000","last_unstale":"2024-02-21T23:01:50.457242+0000","last_undegraded":"2024-02-21T23:01:50.457242+0000","last_fullsized":"2024-02-21T23:01:50.457242+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:20:59.894677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.536245+0000","last_change":"2024-02-21T23:01:03.210855+0000","last_active":"2024-02-21T23:01:50.536245+0000","last_peered":"2024-02-21T23:01:50.536245+0000","last_clean":"2024-02-21T23:01:50.536245+0000","last_became_active":"2024-02-21T23:01:03.210599+0000","last_became_peered":"2024-02-21T23:01:03.210599+0000","last_unstale":"2024-02-21T23:01:50.536245+0000","last_undegraded":"2024-02-21T23:01:50.536245+0000","last_fullsized":"2024-02-21T23:01:50.536245+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:27:55.341328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"29'1","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.461249+0000","last_change":"2024-02-21T23:01:02.204603+0000","last_active":"2024-02-21T23:01:50.461249+0000","last_peered":"2024-02-21T23:01:50.461249+0000","last_clean":"2024-02-21T23:01:50.461249+0000","last_became_active":"2024-02-21T23:01:02.204304+0000","last_became_peered":"2024-02-21T23:01:02.204304+0000","last_unstale":"2024-02-21T23:01:50.461249+0000","last_undegraded":"2024-02-21T23:01:50.461249+0000","last_fullsized":"2024-02-21T23:01:50.461249+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:58:23.554457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.456616+0000","last_change":"2024-02-21T23:01:07.284000+0000","last_active":"2024-02-21T23:01:50.456616+0000","last_peered":"2024-02-21T23:01:50.456616+0000","last_clean":"2024-02-21T23:01:50.456616+0000","last_became_active":"2024-02-21T23:01:07.283568+0000","last_became_peered":"2024-02-21T23:01:07.283568+0000","last_unstale":"2024-02-21T23:01:50.456616+0000","last_undegraded":"2024-02-21T23:01:50.456616+0000","last_fullsized":"2024-02-21T23:01:50.456616+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:20:59.894677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.569859+0000","last_change":"2024-02-21T23:01:03.208483+0000","last_active":"2024-02-21T23:01:50.569859+0000","last_peered":"2024-02-21T23:01:50.569859+0000","last_clean":"2024-02-21T23:01:50.569859+0000","last_became_active":"2024-02-21T23:01:03.208141+0000","last_became_peered":"2024-02-21T23:01:03.208141+0000","last_unstale":"2024-02-21T23:01:50.569859+0000","last_undegraded":"2024-02-21T23:01:50.569859+0000","last_fullsized":"2024-02-21T23:01:50.569859+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:35:24.590398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"29'2","reported_seq":28,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.645919+0000","last_change":"2024-02-21T23:01:02.218826+0000","last_active":"2024-02-21T23:01:50.645919+0000","last_peered":"2024-02-21T23:01:50.645919+0000","last_clean":"2024-02-21T23:01:50.645919+0000","last_became_active":"2024-02-21T23:01:02.218499+0000","last_became_peered":"2024-02-21T23:01:02.218499+0000","last_unstale":"2024-02-21T23:01:50.645919+0000","last_undegraded":"2024-02-21T23:01:50.645919+0000","last_fullsized":"2024-02-21T23:01:50.645919+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:17:06.353018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"29'3","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.569474+0000","last_change":"2024-02-21T23:01:02.209061+0000","last_active":"2024-02-21T23:01:50.569474+0000","last_peered":"2024-02-21T23:01:50.569474+0000","last_clean":"2024-02-21T23:01:50.569474+0000","last_became_active":"2024-02-21T23:01:02.208779+0000","last_became_peered":"2024-02-21T23:01:02.208779+0000","last_unstale":"2024-02-21T23:01:50.569474+0000","last_undegraded":"2024-02-21T23:01:50.569474+0000","last_fullsized":"2024-02-21T23:01:50.569474+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:17:06.353018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8],"acting":[10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.461232+0000","last_change":"2024-02-21T23:01:03.212873+0000","last_active":"2024-02-21T23:01:50.461232+0000","last_peered":"2024-02-21T23:01:50.461232+0000","last_clean":"2024-02-21T23:01:50.461232+0000","last_became_active":"2024-02-21T23:01:03.212560+0000","last_became_peered":"2024-02-21T23:01:03.212560+0000","last_unstale":"2024-02-21T23:01:50.461232+0000","last_undegraded":"2024-02-21T23:01:50.461232+0000","last_fullsized":"2024-02-21T23:01:50.461232+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:47:19.366266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.553666+0000","last_change":"2024-02-21T23:01:07.269266+0000","last_active":"2024-02-21T23:01:50.553666+0000","last_peered":"2024-02-21T23:01:50.553666+0000","last_clean":"2024-02-21T23:01:50.553666+0000","last_became_active":"2024-02-21T23:01:07.267796+0000","last_became_peered":"2024-02-21T23:01:07.267796+0000","last_unstale":"2024-02-21T23:01:50.553666+0000","last_undegraded":"2024-02-21T23:01:50.553666+0000","last_fullsized":"2024-02-21T23:01:50.553666+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:37:06.063756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"29'6","reported_seq":63,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:59.438527+0000","last_change":"2024-02-21T23:01:02.206398+0000","last_active":"2024-02-21T23:01:59.438527+0000","last_peered":"2024-02-21T23:01:59.438527+0000","last_clean":"2024-02-21T23:01:59.438527+0000","last_became_active":"2024-02-21T23:01:02.206069+0000","last_became_peered":"2024-02-21T23:01:02.206069+0000","last_unstale":"2024-02-21T23:01:59.438527+0000","last_undegraded":"2024-02-21T23:01:59.438527+0000","last_fullsized":"2024-02-21T23:01:59.438527+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:26:49.911102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1017,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":31,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.459331+0000","last_change":"2024-02-21T23:01:03.221228+0000","last_active":"2024-02-21T23:01:50.459331+0000","last_peered":"2024-02-21T23:01:50.459331+0000","last_clean":"2024-02-21T23:01:50.459331+0000","last_became_active":"2024-02-21T23:01:03.220900+0000","last_became_peered":"2024-02-21T23:01:03.220900+0000","last_unstale":"2024-02-21T23:01:50.459331+0000","last_undegraded":"2024-02-21T23:01:50.459331+0000","last_fullsized":"2024-02-21T23:01:50.459331+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:40:26.325368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9],"acting":[8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.553914+0000","last_change":"2024-02-21T23:01:07.257004+0000","last_active":"2024-02-21T23:01:50.553914+0000","last_peered":"2024-02-21T23:01:50.553914+0000","last_clean":"2024-02-21T23:01:50.553914+0000","last_became_active":"2024-02-21T23:01:07.256474+0000","last_became_peered":"2024-02-21T23:01:07.256474+0000","last_unstale":"2024-02-21T23:01:50.553914+0000","last_undegraded":"2024-02-21T23:01:50.553914+0000","last_fullsized":"2024-02-21T23:01:50.553914+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:15:20.572234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.456324+0000","last_change":"2024-02-21T23:01:03.215942+0000","last_active":"2024-02-21T23:01:50.456324+0000","last_peered":"2024-02-21T23:01:50.456324+0000","last_clean":"2024-02-21T23:01:50.456324+0000","last_became_active":"2024-02-21T23:01:03.215461+0000","last_became_peered":"2024-02-21T23:01:03.215461+0000","last_unstale":"2024-02-21T23:01:50.456324+0000","last_undegraded":"2024-02-21T23:01:50.456324+0000","last_fullsized":"2024-02-21T23:01:50.456324+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:27:55.341328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.553647+0000","last_change":"2024-02-21T23:01:03.215959+0000","last_active":"2024-02-21T23:01:50.553647+0000","last_peered":"2024-02-21T23:01:50.553647+0000","last_clean":"2024-02-21T23:01:50.553647+0000","last_became_active":"2024-02-21T23:01:03.215639+0000","last_became_peered":"2024-02-21T23:01:03.215639+0000","last_unstale":"2024-02-21T23:01:50.553647+0000","last_undegraded":"2024-02-21T23:01:50.553647+0000","last_fullsized":"2024-02-21T23:01:50.553647+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:16.946152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.553477+0000","last_change":"2024-02-21T23:01:03.218687+0000","last_active":"2024-02-21T23:01:50.553477+0000","last_peered":"2024-02-21T23:01:50.553477+0000","last_clean":"2024-02-21T23:01:50.553477+0000","last_became_active":"2024-02-21T23:01:03.218377+0000","last_became_peered":"2024-02-21T23:01:03.218377+0000","last_unstale":"2024-02-21T23:01:50.553477+0000","last_undegraded":"2024-02-21T23:01:50.553477+0000","last_fullsized":"2024-02-21T23:01:50.553477+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:41:55.485351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.457235+0000","last_change":"2024-02-21T23:01:03.225342+0000","last_active":"2024-02-21T23:01:50.457235+0000","last_peered":"2024-02-21T23:01:50.457235+0000","last_clean":"2024-02-21T23:01:50.457235+0000","last_became_active":"2024-02-21T23:01:03.225085+0000","last_became_peered":"2024-02-21T23:01:03.225085+0000","last_unstale":"2024-02-21T23:01:50.457235+0000","last_undegraded":"2024-02-21T23:01:50.457235+0000","last_fullsized":"2024-02-21T23:01:50.457235+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:54:32.196725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.645600+0000","last_change":"2024-02-21T23:01:03.226259+0000","last_active":"2024-02-21T23:01:50.645600+0000","last_peered":"2024-02-21T23:01:50.645600+0000","last_clean":"2024-02-21T23:01:50.645600+0000","last_became_active":"2024-02-21T23:01:03.225925+0000","last_became_peered":"2024-02-21T23:01:03.225925+0000","last_unstale":"2024-02-21T23:01:50.645600+0000","last_undegraded":"2024-02-21T23:01:50.645600+0000","last_fullsized":"2024-02-21T23:01:50.645600+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:54:32.196725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.456563+0000","last_change":"2024-02-21T23:01:03.215186+0000","last_active":"2024-02-21T23:01:50.456563+0000","last_peered":"2024-02-21T23:01:50.456563+0000","last_clean":"2024-02-21T23:01:50.456563+0000","last_became_active":"2024-02-21T23:01:03.214488+0000","last_became_peered":"2024-02-21T23:01:03.214488+0000","last_unstale":"2024-02-21T23:01:50.456563+0000","last_undegraded":"2024-02-21T23:01:50.456563+0000","last_fullsized":"2024-02-21T23:01:50.456563+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:58:24.562346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8],"acting":[11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.554068+0000","last_change":"2024-02-21T23:01:03.208734+0000","last_active":"2024-02-21T23:01:50.554068+0000","last_peered":"2024-02-21T23:01:50.554068+0000","last_clean":"2024-02-21T23:01:50.554068+0000","last_became_active":"2024-02-21T23:01:03.208458+0000","last_became_peered":"2024-02-21T23:01:03.208458+0000","last_unstale":"2024-02-21T23:01:50.554068+0000","last_undegraded":"2024-02-21T23:01:50.554068+0000","last_fullsized":"2024-02-21T23:01:50.554068+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:54:32.196725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8],"acting":[2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.570484+0000","last_change":"2024-02-21T23:01:03.206669+0000","last_active":"2024-02-21T23:01:50.570484+0000","last_peered":"2024-02-21T23:01:50.570484+0000","last_clean":"2024-02-21T23:01:50.570484+0000","last_became_active":"2024-02-21T23:01:03.206376+0000","last_became_peered":"2024-02-21T23:01:03.206376+0000","last_unstale":"2024-02-21T23:01:50.570484+0000","last_undegraded":"2024-02-21T23:01:50.570484+0000","last_fullsized":"2024-02-21T23:01:50.570484+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:07:50.626867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.460976+0000","last_change":"2024-02-21T23:01:03.215459+0000","last_active":"2024-02-21T23:01:50.460976+0000","last_peered":"2024-02-21T23:01:50.460976+0000","last_clean":"2024-02-21T23:01:50.460976+0000","last_became_active":"2024-02-21T23:01:03.214922+0000","last_became_peered":"2024-02-21T23:01:03.214922+0000","last_unstale":"2024-02-21T23:01:50.460976+0000","last_undegraded":"2024-02-21T23:01:50.460976+0000","last_fullsized":"2024-02-21T23:01:50.460976+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:40:26.325368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.570084+0000","last_change":"2024-02-21T23:01:03.213687+0000","last_active":"2024-02-21T23:01:50.570084+0000","last_peered":"2024-02-21T23:01:50.570084+0000","last_clean":"2024-02-21T23:01:50.570084+0000","last_became_active":"2024-02-21T23:01:03.213428+0000","last_became_peered":"2024-02-21T23:01:03.213428+0000","last_unstale":"2024-02-21T23:01:50.570084+0000","last_undegraded":"2024-02-21T23:01:50.570084+0000","last_fullsized":"2024-02-21T23:01:50.570084+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:45:29.610700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.568724+0000","last_change":"2024-02-21T23:01:03.215983+0000","last_active":"2024-02-21T23:01:50.568724+0000","last_peered":"2024-02-21T23:01:50.568724+0000","last_clean":"2024-02-21T23:01:50.568724+0000","last_became_active":"2024-02-21T23:01:03.215580+0000","last_became_peered":"2024-02-21T23:01:03.215580+0000","last_unstale":"2024-02-21T23:01:50.568724+0000","last_undegraded":"2024-02-21T23:01:50.568724+0000","last_fullsized":"2024-02-21T23:01:50.568724+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:58:24.562346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.646827+0000","last_change":"2024-02-21T23:01:03.226514+0000","last_active":"2024-02-21T23:01:50.646827+0000","last_peered":"2024-02-21T23:01:50.646827+0000","last_clean":"2024-02-21T23:01:50.646827+0000","last_became_active":"2024-02-21T23:01:03.223861+0000","last_became_peered":"2024-02-21T23:01:03.223861+0000","last_unstale":"2024-02-21T23:01:50.646827+0000","last_undegraded":"2024-02-21T23:01:50.646827+0000","last_fullsized":"2024-02-21T23:01:50.646827+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:07:50.626867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.456544+0000","last_change":"2024-02-21T23:01:03.212993+0000","last_active":"2024-02-21T23:01:50.456544+0000","last_peered":"2024-02-21T23:01:50.456544+0000","last_clean":"2024-02-21T23:01:50.456544+0000","last_became_active":"2024-02-21T23:01:03.212691+0000","last_became_peered":"2024-02-21T23:01:03.212691+0000","last_unstale":"2024-02-21T23:01:50.456544+0000","last_undegraded":"2024-02-21T23:01:50.456544+0000","last_fullsized":"2024-02-21T23:01:50.456544+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:10:10.688004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.554112+0000","last_change":"2024-02-21T23:01:03.217962+0000","last_active":"2024-02-21T23:01:50.554112+0000","last_peered":"2024-02-21T23:01:50.554112+0000","last_clean":"2024-02-21T23:01:50.554112+0000","last_became_active":"2024-02-21T23:01:03.217613+0000","last_became_peered":"2024-02-21T23:01:03.217613+0000","last_unstale":"2024-02-21T23:01:50.554112+0000","last_undegraded":"2024-02-21T23:01:50.554112+0000","last_fullsized":"2024-02-21T23:01:50.554112+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:35:24.590398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.536790+0000","last_change":"2024-02-21T23:01:03.214531+0000","last_active":"2024-02-21T23:01:50.536790+0000","last_peered":"2024-02-21T23:01:50.536790+0000","last_clean":"2024-02-21T23:01:50.536790+0000","last_became_active":"2024-02-21T23:01:03.214165+0000","last_became_peered":"2024-02-21T23:01:03.214165+0000","last_unstale":"2024-02-21T23:01:50.536790+0000","last_undegraded":"2024-02-21T23:01:50.536790+0000","last_fullsized":"2024-02-21T23:01:50.536790+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:58:24.562346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1],"acting":[9,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.456840+0000","last_change":"2024-02-21T23:01:03.214286+0000","last_active":"2024-02-21T23:01:50.456840+0000","last_peered":"2024-02-21T23:01:50.456840+0000","last_clean":"2024-02-21T23:01:50.456840+0000","last_became_active":"2024-02-21T23:01:03.213755+0000","last_became_peered":"2024-02-21T23:01:03.213755+0000","last_unstale":"2024-02-21T23:01:50.456840+0000","last_undegraded":"2024-02-21T23:01:50.456840+0000","last_fullsized":"2024-02-21T23:01:50.456840+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:35:24.590398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.568509+0000","last_change":"2024-02-21T23:01:03.216623+0000","last_active":"2024-02-21T23:01:50.568509+0000","last_peered":"2024-02-21T23:01:50.568509+0000","last_clean":"2024-02-21T23:01:50.568509+0000","last_became_active":"2024-02-21T23:01:03.216345+0000","last_became_peered":"2024-02-21T23:01:03.216345+0000","last_unstale":"2024-02-21T23:01:50.568509+0000","last_undegraded":"2024-02-21T23:01:50.568509+0000","last_fullsized":"2024-02-21T23:01:50.568509+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:10:10.688004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.457666+0000","last_change":"2024-02-21T23:01:03.226262+0000","last_active":"2024-02-21T23:01:50.457666+0000","last_peered":"2024-02-21T23:01:50.457666+0000","last_clean":"2024-02-21T23:01:50.457666+0000","last_became_active":"2024-02-21T23:01:03.225574+0000","last_became_peered":"2024-02-21T23:01:03.225574+0000","last_unstale":"2024-02-21T23:01:50.457666+0000","last_undegraded":"2024-02-21T23:01:50.457666+0000","last_fullsized":"2024-02-21T23:01:50.457666+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:10:10.688004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.457036+0000","last_change":"2024-02-21T23:01:03.225898+0000","last_active":"2024-02-21T23:01:50.457036+0000","last_peered":"2024-02-21T23:01:50.457036+0000","last_clean":"2024-02-21T23:01:50.457036+0000","last_became_active":"2024-02-21T23:01:03.217938+0000","last_became_peered":"2024-02-21T23:01:03.217938+0000","last_unstale":"2024-02-21T23:01:50.457036+0000","last_undegraded":"2024-02-21T23:01:50.457036+0000","last_fullsized":"2024-02-21T23:01:50.457036+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:58:24.562346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8],"acting":[0,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.645608+0000","last_change":"2024-02-21T23:01:03.225830+0000","last_active":"2024-02-21T23:01:50.645608+0000","last_peered":"2024-02-21T23:01:50.645608+0000","last_clean":"2024-02-21T23:01:50.645608+0000","last_became_active":"2024-02-21T23:01:03.225449+0000","last_became_peered":"2024-02-21T23:01:03.225449+0000","last_unstale":"2024-02-21T23:01:50.645608+0000","last_undegraded":"2024-02-21T23:01:50.645608+0000","last_fullsized":"2024-02-21T23:01:50.645608+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:47:19.366266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10],"acting":[6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.456810+0000","last_change":"2024-02-21T23:01:03.208746+0000","last_active":"2024-02-21T23:01:50.456810+0000","last_peered":"2024-02-21T23:01:50.456810+0000","last_clean":"2024-02-21T23:01:50.456810+0000","last_became_active":"2024-02-21T23:01:03.208446+0000","last_became_peered":"2024-02-21T23:01:03.208446+0000","last_unstale":"2024-02-21T23:01:50.456810+0000","last_undegraded":"2024-02-21T23:01:50.456810+0000","last_fullsized":"2024-02-21T23:01:50.456810+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:58:24.562346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.543442+0000","last_change":"2024-02-21T23:01:03.218981+0000","last_active":"2024-02-21T23:01:50.543442+0000","last_peered":"2024-02-21T23:01:50.543442+0000","last_clean":"2024-02-21T23:01:50.543442+0000","last_became_active":"2024-02-21T23:01:03.217925+0000","last_became_peered":"2024-02-21T23:01:03.217925+0000","last_unstale":"2024-02-21T23:01:50.543442+0000","last_undegraded":"2024-02-21T23:01:50.543442+0000","last_fullsized":"2024-02-21T23:01:50.543442+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:54:40.332224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8],"acting":[7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.569907+0000","last_change":"2024-02-21T23:01:03.212233+0000","last_active":"2024-02-21T23:01:50.569907+0000","last_peered":"2024-02-21T23:01:50.569907+0000","last_clean":"2024-02-21T23:01:50.569907+0000","last_became_active":"2024-02-21T23:01:03.211921+0000","last_became_peered":"2024-02-21T23:01:03.211921+0000","last_unstale":"2024-02-21T23:01:50.569907+0000","last_undegraded":"2024-02-21T23:01:50.569907+0000","last_fullsized":"2024-02-21T23:01:50.569907+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:54:32.196725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2],"acting":[10,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.569007+0000","last_change":"2024-02-21T23:01:03.216861+0000","last_active":"2024-02-21T23:01:50.569007+0000","last_peered":"2024-02-21T23:01:50.569007+0000","last_clean":"2024-02-21T23:01:50.569007+0000","last_became_active":"2024-02-21T23:01:03.216580+0000","last_became_peered":"2024-02-21T23:01:03.216580+0000","last_unstale":"2024-02-21T23:01:50.569007+0000","last_undegraded":"2024-02-21T23:01:50.569007+0000","last_fullsized":"2024-02-21T23:01:50.569007+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:35:24.590398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.569807+0000","last_change":"2024-02-21T23:01:03.212164+0000","last_active":"2024-02-21T23:01:50.569807+0000","last_peered":"2024-02-21T23:01:50.569807+0000","last_clean":"2024-02-21T23:01:50.569807+0000","last_became_active":"2024-02-21T23:01:03.211811+0000","last_became_peered":"2024-02-21T23:01:03.211811+0000","last_unstale":"2024-02-21T23:01:50.569807+0000","last_undegraded":"2024-02-21T23:01:50.569807+0000","last_fullsized":"2024-02-21T23:01:50.569807+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:16.946152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.543002+0000","last_change":"2024-02-21T23:01:03.223537+0000","last_active":"2024-02-21T23:01:50.543002+0000","last_peered":"2024-02-21T23:01:50.543002+0000","last_clean":"2024-02-21T23:01:50.543002+0000","last_became_active":"2024-02-21T23:01:03.223255+0000","last_became_peered":"2024-02-21T23:01:03.223255+0000","last_unstale":"2024-02-21T23:01:50.543002+0000","last_undegraded":"2024-02-21T23:01:50.543002+0000","last_fullsized":"2024-02-21T23:01:50.543002+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:19:01.584139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9],"acting":[7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.569406+0000","last_change":"2024-02-21T23:01:03.210441+0000","last_active":"2024-02-21T23:01:50.569406+0000","last_peered":"2024-02-21T23:01:50.569406+0000","last_clean":"2024-02-21T23:01:50.569406+0000","last_became_active":"2024-02-21T23:01:03.209569+0000","last_became_peered":"2024-02-21T23:01:03.209569+0000","last_unstale":"2024-02-21T23:01:50.569406+0000","last_undegraded":"2024-02-21T23:01:50.569406+0000","last_fullsized":"2024-02-21T23:01:50.569406+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:41:55.485351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9],"acting":[10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.459113+0000","last_change":"2024-02-21T23:01:03.214234+0000","last_active":"2024-02-21T23:01:50.459113+0000","last_peered":"2024-02-21T23:01:50.459113+0000","last_clean":"2024-02-21T23:01:50.459113+0000","last_became_active":"2024-02-21T23:01:03.213941+0000","last_became_peered":"2024-02-21T23:01:03.213941+0000","last_unstale":"2024-02-21T23:01:50.459113+0000","last_undegraded":"2024-02-21T23:01:50.459113+0000","last_fullsized":"2024-02-21T23:01:50.459113+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:19:01.584139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3],"acting":[8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.456669+0000","last_change":"2024-02-21T23:01:03.207972+0000","last_active":"2024-02-21T23:01:50.456669+0000","last_peered":"2024-02-21T23:01:50.456669+0000","last_clean":"2024-02-21T23:01:50.456669+0000","last_became_active":"2024-02-21T23:01:03.206762+0000","last_became_peered":"2024-02-21T23:01:03.206762+0000","last_unstale":"2024-02-21T23:01:50.456669+0000","last_undegraded":"2024-02-21T23:01:50.456669+0000","last_fullsized":"2024-02-21T23:01:50.456669+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:27:55.341328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8],"acting":[4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.457409+0000","last_change":"2024-02-21T23:01:03.221959+0000","last_active":"2024-02-21T23:01:50.457409+0000","last_peered":"2024-02-21T23:01:50.457409+0000","last_clean":"2024-02-21T23:01:50.457409+0000","last_became_active":"2024-02-21T23:01:03.221672+0000","last_became_peered":"2024-02-21T23:01:03.221672+0000","last_unstale":"2024-02-21T23:01:50.457409+0000","last_undegraded":"2024-02-21T23:01:50.457409+0000","last_fullsized":"2024-02-21T23:01:50.457409+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:45:29.610700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.457345+0000","last_change":"2024-02-21T23:01:03.219660+0000","last_active":"2024-02-21T23:01:50.457345+0000","last_peered":"2024-02-21T23:01:50.457345+0000","last_clean":"2024-02-21T23:01:50.457345+0000","last_became_active":"2024-02-21T23:01:03.219379+0000","last_became_peered":"2024-02-21T23:01:03.219379+0000","last_unstale":"2024-02-21T23:01:50.457345+0000","last_undegraded":"2024-02-21T23:01:50.457345+0000","last_fullsized":"2024-02-21T23:01:50.457345+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:27:55.341328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11],"acting":[0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.456858+0000","last_change":"2024-02-21T23:01:03.213287+0000","last_active":"2024-02-21T23:01:50.456858+0000","last_peered":"2024-02-21T23:01:50.456858+0000","last_clean":"2024-02-21T23:01:50.456858+0000","last_became_active":"2024-02-21T23:01:03.212878+0000","last_became_peered":"2024-02-21T23:01:03.212878+0000","last_unstale":"2024-02-21T23:01:50.456858+0000","last_undegraded":"2024-02-21T23:01:50.456858+0000","last_fullsized":"2024-02-21T23:01:50.456858+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:16.946152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70874,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":196,"num_read_kb":173,"num_write":166,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":141748,"data_compressed":3672,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":0,"internal_metadata":0},"log_size":143,"ondisk_log_size":143,"up":64,"acting":64,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66458,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":11,"up_from":17,"seq":73014444048,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":335872,"data_stored":163371,"data_compressed":14087,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":17,"seq":73014444047,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":417792,"data_stored":225790,"data_compressed":15923,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":17,"seq":73014444048,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":344064,"data_stored":167557,"data_compressed":14087,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":17,"seq":73014444047,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":348160,"data_stored":162945,"data_compressed":14087,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":17,"seq":73014444048,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":409600,"data_stored":758423,"data_compressed":47316,"data_compressed_allocated":65536,"data_compressed_original":614400,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":17,"seq":73014444047,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":331776,"data_stored":158783,"data_compressed":14087,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":17,"seq":73014444048,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":755028,"data_compressed":47316,"data_compressed_allocated":65536,"data_compressed_original":614400,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":17,"seq":73014444048,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":339968,"data_stored":163411,"data_compressed":14087,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":17,"seq":73014444048,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":335872,"data_stored":158873,"data_compressed":14087,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444048,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":344064,"data_stored":160326,"data_compressed":14087,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":17,"seq":73014444048,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":401408,"data_stored":225562,"data_compressed":15923,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":17,"seq":73014444048,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":348160,"data_stored":159499,"data_compressed":14087,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33229,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33229,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":66869,"data_compressed":1836,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":67097,"data_compressed":1836,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-21T23:02:04.745 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-02-21T23:02:04.745 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-21T23:02:04.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.986+0000 7f614ae00640 1 Processor -- start 2024-02-21T23:02:04.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.986+0000 7f614ae00640 1 -- start start 2024-02-21T23:02:04.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.990+0000 7f614ae00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f61441861e0 0x7f61441865c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:04.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.990+0000 7f614ae00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61440cf7e0 con 0x7f61440d4300 2024-02-21T23:02:04.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.990+0000 7f614ae00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61440cfac0 con 0x7f6144187a80 2024-02-21T23:02:04.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.990+0000 7f614ae00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6144186d50 con 0x7f61441861e0 2024-02-21T23:02:04.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.990+0000 7f6148e00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f61440d4300 0x7f61440d4700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:36462/0 (socket says 172.21.15.99:36462) 2024-02-21T23:02:04.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.990+0000 7f6148e00640 1 -- 172.21.15.99:0/4293540040 learned_addr learned my addr 172.21.15.99:0/4293540040 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:02:04.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.990+0000 7f6143e00640 1 --2- 172.21.15.99:0/4293540040 >> v2:172.21.15.181:3300/0 conn(0x7f61441861e0 0x7f61441865c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:04.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.991+0000 7f6143400640 1 -- 172.21.15.99:0/4293540040 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 713723508 0 0) 0x7f61440cfac0 con 0x7f6144187a80 2024-02-21T23:02:04.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.991+0000 7f6143e00640 1 -- 172.21.15.99:0/4293540040 >> v1:172.21.15.181:6789/0 conn(0x7f6144187a80 legacy=0x7f6144187f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:04.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.991+0000 7f6143e00640 1 -- 172.21.15.99:0/4293540040 >> v1:172.21.15.99:6789/0 conn(0x7f61440d4300 legacy=0x7f61440d4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:04.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.991+0000 7f6143e00640 1 -- 172.21.15.99:0/4293540040 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6144186fa0 con 0x7f61441861e0 2024-02-21T23:02:04.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.992+0000 7f6143e00640 1 --2- 172.21.15.99:0/4293540040 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f61441861e0 0x7f61441865c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f61340097a0 tx=0x7f613402b710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63bfebe80b3669d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:04.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.993+0000 7f6143400640 1 -- 172.21.15.99:0/4293540040 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6134037070 con 0x7f61441861e0 2024-02-21T23:02:04.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.993+0000 7f6143400640 1 -- 172.21.15.99:0/4293540040 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6134030710 con 0x7f61441861e0 2024-02-21T23:02:04.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.993+0000 7f6143400640 1 -- 172.21.15.99:0/4293540040 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6134030ae0 con 0x7f61441861e0 2024-02-21T23:02:04.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.993+0000 7f614ae00640 1 -- 172.21.15.99:0/4293540040 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f61441861e0 msgr2=0x7f61441865c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:04.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.993+0000 7f614ae00640 1 --2- 172.21.15.99:0/4293540040 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f61441861e0 0x7f61441865c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f61340097a0 tx=0x7f613402b710 comp rx=0 tx=0).stop 2024-02-21T23:02:04.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.994+0000 7f614ae00640 1 -- 172.21.15.99:0/4293540040 shutdown_connections 2024-02-21T23:02:04.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.994+0000 7f614ae00640 1 --2- 172.21.15.99:0/4293540040 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f61441861e0 0x7f61441865c0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:04.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.994+0000 7f614ae00640 1 -- 172.21.15.99:0/4293540040 >> 172.21.15.99:0/4293540040 conn(0x7f61440d6ac0 msgr2=0x7f61440740b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:04.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.994+0000 7f614ae00640 1 -- 172.21.15.99:0/4293540040 shutdown_connections 2024-02-21T23:02:04.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.994+0000 7f614ae00640 1 -- 172.21.15.99:0/4293540040 wait complete. 2024-02-21T23:02:04.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.996+0000 7f614ae00640 1 Processor -- start 2024-02-21T23:02:04.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.996+0000 7f614ae00640 1 -- start start 2024-02-21T23:02:04.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.997+0000 7f614ae00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f61440d4300 0x7f614416f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:04.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.997+0000 7f614ae00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61441861e0 0x7f614416b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:04.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.997+0000 7f614ae00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6144187a80 0x7f6144221220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:04.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.997+0000 7f614ae00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6144188620 con 0x7f61440d4300 2024-02-21T23:02:04.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.997+0000 7f614ae00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61441875f0 con 0x7f61441861e0 2024-02-21T23:02:04.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.997+0000 7f614ae00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61440ceeb0 con 0x7f6144187a80 2024-02-21T23:02:04.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.997+0000 7f6143e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f61440d4300 0x7f614416f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:04.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.997+0000 7f6143e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f61440d4300 0x7f614416f340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50286/0 (socket says 172.21.15.99:50286) 2024-02-21T23:02:04.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.997+0000 7f6143e00640 1 -- 172.21.15.99:0/411867390 learned_addr learned my addr 172.21.15.99:0/411867390 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:04.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.997+0000 7f613be00640 1 --2- 172.21.15.99:0/411867390 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61441861e0 0x7f614416b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:04.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.998+0000 7f6148e00640 1 --2- 172.21.15.99:0/411867390 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6144187a80 0x7f6144221220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:04.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.998+0000 7f6143e00640 1 -- 172.21.15.99:0/411867390 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6144187a80 msgr2=0x7f6144221220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:04.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.998+0000 7f6143e00640 1 --2- 172.21.15.99:0/411867390 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6144187a80 0x7f6144221220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:04.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.998+0000 7f6143e00640 1 -- 172.21.15.99:0/411867390 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61441861e0 msgr2=0x7f614416b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:04.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.998+0000 7f6143e00640 1 --2- 172.21.15.99:0/411867390 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61441861e0 0x7f614416b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:04.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.998+0000 7f6143e00640 1 -- 172.21.15.99:0/411867390 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f614421fea0 con 0x7f61440d4300 2024-02-21T23:02:04.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.998+0000 7f6143e00640 1 --2- 172.21.15.99:0/411867390 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f61440d4300 0x7f614416f340 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f61340097a0 tx=0x7f61340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:04.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.999+0000 7f6140c00640 1 -- 172.21.15.99:0/411867390 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6134037040 con 0x7f61440d4300 2024-02-21T23:02:04.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.999+0000 7f6140c00640 1 -- 172.21.15.99:0/411867390 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61340329c0 con 0x7f61440d4300 2024-02-21T23:02:04.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.999+0000 7f614ae00640 1 -- 172.21.15.99:0/411867390 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6144220180 con 0x7f61440d4300 2024-02-21T23:02:04.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.999+0000 7f6140c00640 1 -- 172.21.15.99:0/411867390 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6134032d90 con 0x7f61440d4300 2024-02-21T23:02:04.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:04.999+0000 7f614ae00640 1 -- 172.21.15.99:0/411867390 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6144220740 con 0x7f61440d4300 2024-02-21T23:02:04.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:05.000+0000 7f614ae00640 1 -- 172.21.15.99:0/411867390 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61440d2f50 con 0x7f61440d4300 2024-02-21T23:02:04.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:05.002+0000 7f6140c00640 1 -- 172.21.15.99:0/411867390 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 6) v1 ==== 134407+0+0 (secure 0 0 0) 0x7f6134004030 con 0x7f61440d4300 2024-02-21T23:02:04.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:05.004+0000 7f6140c00640 1 --2- 172.21.15.99:0/411867390 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f612009edf0 0x7f61200a12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:04.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:05.004+0000 7f6140c00640 1 -- 172.21.15.99:0/411867390 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f61340ebe30 con 0x7f61440d4300 2024-02-21T23:02:04.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:05.005+0000 7f613be00640 1 --2- 172.21.15.99:0/411867390 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f612009edf0 0x7f61200a12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:04.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:05.005+0000 7f613be00640 1 --2- 172.21.15.99:0/411867390 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f612009edf0 0x7f61200a12b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f61440d42d0 tx=0x7f612c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:04.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:05.007+0000 7f6140c00640 1 -- 172.21.15.99:0/411867390 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f6134042020 con 0x7f61440d4300 2024-02-21T23:02:05.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:05.316+0000 7f614ae00640 1 -- 172.21.15.99:0/411867390 --> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f614418be50 con 0x7f612009edf0 2024-02-21T23:02:05.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:05.325+0000 7f6140c00640 1 -- 172.21.15.99:0/411867390 <== mgr.4106 v2:172.21.15.162:6800/1717094936 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+338721 (secure 0 0 0) 0x7f614418be50 con 0x7f612009edf0 2024-02-21T23:02:05.319 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T23:02:05.321 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-02-21T23:02:05.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:05.332+0000 7f614ae00640 1 -- 172.21.15.99:0/411867390 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f612009edf0 msgr2=0x7f61200a12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:05.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:05.332+0000 7f614ae00640 1 --2- 172.21.15.99:0/411867390 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f612009edf0 0x7f61200a12b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f61440d42d0 tx=0x7f612c009040 comp rx=0 tx=0).stop 2024-02-21T23:02:05.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:05.332+0000 7f614ae00640 1 -- 172.21.15.99:0/411867390 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f61440d4300 msgr2=0x7f614416f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:05.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:05.332+0000 7f614ae00640 1 --2- 172.21.15.99:0/411867390 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f61440d4300 0x7f614416f340 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f61340097a0 tx=0x7f61340046c0 comp rx=0 tx=0).stop 2024-02-21T23:02:05.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:05.333+0000 7f614ae00640 1 -- 172.21.15.99:0/411867390 shutdown_connections 2024-02-21T23:02:05.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:05.333+0000 7f614ae00640 1 --2- 172.21.15.99:0/411867390 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f612009edf0 0x7f61200a12b0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:05.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:05.333+0000 7f614ae00640 1 --2- 172.21.15.99:0/411867390 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6144187a80 0x7f6144221220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:05.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:05.333+0000 7f614ae00640 1 --2- 172.21.15.99:0/411867390 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61441861e0 0x7f614416b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:05.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:05.333+0000 7f614ae00640 1 --2- 172.21.15.99:0/411867390 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f61440d4300 0x7f614416f340 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:05.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:05.333+0000 7f614ae00640 1 -- 172.21.15.99:0/411867390 >> 172.21.15.99:0/411867390 conn(0x7f61440d6ac0 msgr2=0x7f61440740b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:05.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:05.333+0000 7f614ae00640 1 -- 172.21.15.99:0/411867390 shutdown_connections 2024-02-21T23:02:05.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:05.333+0000 7f614ae00640 1 -- 172.21.15.99:0/411867390 wait complete. 2024-02-21T23:02:05.349 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2024-02-21T23:02:04.958911+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":661476,"num_objects":64,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":332,"num_read_kb":292,"num_write":349,"num_write_kb":3062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":282,"ondisk_log_size":282,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1132462080,"kb_used":328548,"kb_used_data":4280,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1132133532,"statfs":{"total":1159641169920,"available":1159304736768,"internally_reserved":0,"allocated":4382720,"data_stored":3259568,"data_compressed":239174,"data_compressed_allocated":344064,"data_compressed_original":1654784,"omap_allocated":19138,"internal_metadata":331855166},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":9641,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":41,"num_write":5,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003487"},"pg_stats":[{"pgid":"2.1f","version":"29'9","reported_seq":36,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.536641+0000","last_change":"2024-02-21T23:01:02.208441+0000","last_active":"2024-02-21T23:01:50.536641+0000","last_peered":"2024-02-21T23:01:50.536641+0000","last_clean":"2024-02-21T23:01:50.536641+0000","last_became_active":"2024-02-21T23:01:02.208124+0000","last_became_peered":"2024-02-21T23:01:02.208124+0000","last_unstale":"2024-02-21T23:01:50.536641+0000","last_undegraded":"2024-02-21T23:01:50.536641+0000","last_fullsized":"2024-02-21T23:01:50.536641+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:21:29.919968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7],"acting":[9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.570488+0000","last_change":"2024-02-21T23:01:03.215149+0000","last_active":"2024-02-21T23:01:50.570488+0000","last_peered":"2024-02-21T23:01:50.570488+0000","last_clean":"2024-02-21T23:01:50.570488+0000","last_became_active":"2024-02-21T23:01:03.214170+0000","last_became_peered":"2024-02-21T23:01:03.214170+0000","last_unstale":"2024-02-21T23:01:50.570488+0000","last_undegraded":"2024-02-21T23:01:50.570488+0000","last_fullsized":"2024-02-21T23:01:50.570488+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:40:26.325368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.553465+0000","last_change":"2024-02-21T23:01:07.276484+0000","last_active":"2024-02-21T23:01:50.553465+0000","last_peered":"2024-02-21T23:01:50.553465+0000","last_clean":"2024-02-21T23:01:50.553465+0000","last_became_active":"2024-02-21T23:01:07.276192+0000","last_became_peered":"2024-02-21T23:01:07.276192+0000","last_unstale":"2024-02-21T23:01:50.553465+0000","last_undegraded":"2024-02-21T23:01:50.553465+0000","last_fullsized":"2024-02-21T23:01:50.553465+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:20:59.894677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"29'2","reported_seq":28,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.570585+0000","last_change":"2024-02-21T23:01:02.221231+0000","last_active":"2024-02-21T23:01:50.570585+0000","last_peered":"2024-02-21T23:01:50.570585+0000","last_clean":"2024-02-21T23:01:50.570585+0000","last_became_active":"2024-02-21T23:01:02.220941+0000","last_became_peered":"2024-02-21T23:01:02.220941+0000","last_unstale":"2024-02-21T23:01:50.570585+0000","last_undegraded":"2024-02-21T23:01:50.570585+0000","last_fullsized":"2024-02-21T23:01:50.570585+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:17:06.353018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.457808+0000","last_change":"2024-02-21T23:01:03.219579+0000","last_active":"2024-02-21T23:01:50.457808+0000","last_peered":"2024-02-21T23:01:50.457808+0000","last_clean":"2024-02-21T23:01:50.457808+0000","last_became_active":"2024-02-21T23:01:03.219221+0000","last_became_peered":"2024-02-21T23:01:03.219221+0000","last_unstale":"2024-02-21T23:01:50.457808+0000","last_undegraded":"2024-02-21T23:01:50.457808+0000","last_fullsized":"2024-02-21T23:01:50.457808+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:41:55.485351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.456345+0000","last_change":"2024-02-21T23:01:07.268590+0000","last_active":"2024-02-21T23:01:50.456345+0000","last_peered":"2024-02-21T23:01:50.456345+0000","last_clean":"2024-02-21T23:01:50.456345+0000","last_became_active":"2024-02-21T23:01:07.268179+0000","last_became_peered":"2024-02-21T23:01:07.268179+0000","last_unstale":"2024-02-21T23:01:50.456345+0000","last_undegraded":"2024-02-21T23:01:50.456345+0000","last_fullsized":"2024-02-21T23:01:50.456345+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:20:59.894677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"29'4","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.459566+0000","last_change":"2024-02-21T23:01:02.208687+0000","last_active":"2024-02-21T23:01:50.459566+0000","last_peered":"2024-02-21T23:01:50.459566+0000","last_clean":"2024-02-21T23:01:50.459566+0000","last_became_active":"2024-02-21T23:01:02.208393+0000","last_became_peered":"2024-02-21T23:01:02.208393+0000","last_unstale":"2024-02-21T23:01:50.459566+0000","last_undegraded":"2024-02-21T23:01:50.459566+0000","last_fullsized":"2024-02-21T23:01:50.459566+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:41:54.477462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.568757+0000","last_change":"2024-02-21T23:01:03.215676+0000","last_active":"2024-02-21T23:01:50.568757+0000","last_peered":"2024-02-21T23:01:50.568757+0000","last_clean":"2024-02-21T23:01:50.568757+0000","last_became_active":"2024-02-21T23:01:03.214733+0000","last_became_peered":"2024-02-21T23:01:03.214733+0000","last_unstale":"2024-02-21T23:01:50.568757+0000","last_undegraded":"2024-02-21T23:01:50.568757+0000","last_fullsized":"2024-02-21T23:01:50.568757+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:16.946152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.456507+0000","last_change":"2024-02-21T23:01:07.279763+0000","last_active":"2024-02-21T23:01:50.456507+0000","last_peered":"2024-02-21T23:01:50.456507+0000","last_clean":"2024-02-21T23:01:50.456507+0000","last_became_active":"2024-02-21T23:01:07.279360+0000","last_became_peered":"2024-02-21T23:01:07.279360+0000","last_unstale":"2024-02-21T23:01:50.456507+0000","last_undegraded":"2024-02-21T23:01:50.456507+0000","last_fullsized":"2024-02-21T23:01:50.456507+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:40:30.373445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":28,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.459570+0000","last_change":"2024-02-21T23:01:02.204774+0000","last_active":"2024-02-21T23:01:50.459570+0000","last_peered":"2024-02-21T23:01:50.459570+0000","last_clean":"2024-02-21T23:01:50.459570+0000","last_became_active":"2024-02-21T23:01:02.203992+0000","last_became_peered":"2024-02-21T23:01:02.203992+0000","last_unstale":"2024-02-21T23:01:50.459570+0000","last_undegraded":"2024-02-21T23:01:50.459570+0000","last_fullsized":"2024-02-21T23:01:50.459570+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:27:54.333439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1],"acting":[8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.461361+0000","last_change":"2024-02-21T23:01:03.213022+0000","last_active":"2024-02-21T23:01:50.461361+0000","last_peered":"2024-02-21T23:01:50.461361+0000","last_clean":"2024-02-21T23:01:50.461361+0000","last_became_active":"2024-02-21T23:01:03.212702+0000","last_became_peered":"2024-02-21T23:01:03.212702+0000","last_unstale":"2024-02-21T23:01:50.461361+0000","last_undegraded":"2024-02-21T23:01:50.461361+0000","last_fullsized":"2024-02-21T23:01:50.461361+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:19:01.584139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.456449+0000","last_change":"2024-02-21T23:01:07.268800+0000","last_active":"2024-02-21T23:01:50.456449+0000","last_peered":"2024-02-21T23:01:50.456449+0000","last_clean":"2024-02-21T23:01:50.456449+0000","last_became_active":"2024-02-21T23:01:07.268357+0000","last_became_peered":"2024-02-21T23:01:07.268357+0000","last_unstale":"2024-02-21T23:01:50.456449+0000","last_undegraded":"2024-02-21T23:01:50.456449+0000","last_fullsized":"2024-02-21T23:01:50.456449+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:39:03.021559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.543257+0000","last_change":"2024-02-21T23:01:03.213517+0000","last_active":"2024-02-21T23:01:50.543257+0000","last_peered":"2024-02-21T23:01:50.543257+0000","last_clean":"2024-02-21T23:01:50.543257+0000","last_became_active":"2024-02-21T23:01:03.213186+0000","last_became_peered":"2024-02-21T23:01:03.213186+0000","last_unstale":"2024-02-21T23:01:50.543257+0000","last_undegraded":"2024-02-21T23:01:50.543257+0000","last_fullsized":"2024-02-21T23:01:50.543257+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:40:26.325368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"29'4","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.459125+0000","last_change":"2024-02-21T23:01:02.208608+0000","last_active":"2024-02-21T23:01:50.459125+0000","last_peered":"2024-02-21T23:01:50.459125+0000","last_clean":"2024-02-21T23:01:50.459125+0000","last_became_active":"2024-02-21T23:01:02.208293+0000","last_became_peered":"2024-02-21T23:01:02.208293+0000","last_unstale":"2024-02-21T23:01:50.459125+0000","last_undegraded":"2024-02-21T23:01:50.459125+0000","last_fullsized":"2024-02-21T23:01:50.459125+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:58:23.554457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.456577+0000","last_change":"2024-02-21T23:01:07.651717+0000","last_active":"2024-02-21T23:01:50.456577+0000","last_peered":"2024-02-21T23:01:50.456577+0000","last_clean":"2024-02-21T23:01:50.456577+0000","last_became_active":"2024-02-21T23:01:07.651241+0000","last_became_peered":"2024-02-21T23:01:07.651241+0000","last_unstale":"2024-02-21T23:01:50.456577+0000","last_undegraded":"2024-02-21T23:01:50.456577+0000","last_fullsized":"2024-02-21T23:01:50.456577+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:54:44.380302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.570374+0000","last_change":"2024-02-21T23:01:03.221678+0000","last_active":"2024-02-21T23:01:50.570374+0000","last_peered":"2024-02-21T23:01:50.570374+0000","last_clean":"2024-02-21T23:01:50.570374+0000","last_became_active":"2024-02-21T23:01:03.219898+0000","last_became_peered":"2024-02-21T23:01:03.219898+0000","last_unstale":"2024-02-21T23:01:50.570374+0000","last_undegraded":"2024-02-21T23:01:50.570374+0000","last_fullsized":"2024-02-21T23:01:50.570374+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:47:19.366266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"29'1","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.553488+0000","last_change":"2024-02-21T23:01:02.202866+0000","last_active":"2024-02-21T23:01:50.553488+0000","last_peered":"2024-02-21T23:01:50.553488+0000","last_clean":"2024-02-21T23:01:50.553488+0000","last_became_active":"2024-02-21T23:01:02.202585+0000","last_became_peered":"2024-02-21T23:01:02.202585+0000","last_unstale":"2024-02-21T23:01:50.553488+0000","last_undegraded":"2024-02-21T23:01:50.553488+0000","last_fullsized":"2024-02-21T23:01:50.553488+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:26:49.911102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"29'1","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.456781+0000","last_change":"2024-02-21T23:01:07.277000+0000","last_active":"2024-02-21T23:01:50.456781+0000","last_peered":"2024-02-21T23:01:50.456781+0000","last_clean":"2024-02-21T23:01:50.456781+0000","last_became_active":"2024-02-21T23:01:07.276577+0000","last_became_peered":"2024-02-21T23:01:07.276577+0000","last_unstale":"2024-02-21T23:01:50.456781+0000","last_undegraded":"2024-02-21T23:01:50.456781+0000","last_fullsized":"2024-02-21T23:01:50.456781+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:15:20.572234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.456430+0000","last_change":"2024-02-21T23:01:03.219045+0000","last_active":"2024-02-21T23:01:50.456430+0000","last_peered":"2024-02-21T23:01:50.456430+0000","last_clean":"2024-02-21T23:01:50.456430+0000","last_became_active":"2024-02-21T23:01:03.218706+0000","last_became_peered":"2024-02-21T23:01:03.218706+0000","last_unstale":"2024-02-21T23:01:50.456430+0000","last_undegraded":"2024-02-21T23:01:50.456430+0000","last_fullsized":"2024-02-21T23:01:50.456430+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:41:55.485351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"29'3","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.570338+0000","last_change":"2024-02-21T23:01:02.208912+0000","last_active":"2024-02-21T23:01:50.570338+0000","last_peered":"2024-02-21T23:01:50.570338+0000","last_clean":"2024-02-21T23:01:50.570338+0000","last_became_active":"2024-02-21T23:01:02.208542+0000","last_became_peered":"2024-02-21T23:01:02.208542+0000","last_unstale":"2024-02-21T23:01:50.570338+0000","last_undegraded":"2024-02-21T23:01:50.570338+0000","last_fullsized":"2024-02-21T23:01:50.570338+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:02:11.724233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9],"acting":[3,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.536531+0000","last_change":"2024-02-21T23:01:07.282882+0000","last_active":"2024-02-21T23:01:50.536531+0000","last_peered":"2024-02-21T23:01:50.536531+0000","last_clean":"2024-02-21T23:01:50.536531+0000","last_became_active":"2024-02-21T23:01:07.282506+0000","last_became_peered":"2024-02-21T23:01:07.282506+0000","last_unstale":"2024-02-21T23:01:50.536531+0000","last_undegraded":"2024-02-21T23:01:50.536531+0000","last_fullsized":"2024-02-21T23:01:50.536531+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:19:05.632217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.458945+0000","last_change":"2024-02-21T23:01:03.212206+0000","last_active":"2024-02-21T23:01:50.458945+0000","last_peered":"2024-02-21T23:01:50.458945+0000","last_clean":"2024-02-21T23:01:50.458945+0000","last_became_active":"2024-02-21T23:01:03.211919+0000","last_became_peered":"2024-02-21T23:01:03.211919+0000","last_unstale":"2024-02-21T23:01:50.458945+0000","last_undegraded":"2024-02-21T23:01:50.458945+0000","last_fullsized":"2024-02-21T23:01:50.458945+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:20:55.846599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"29'2","reported_seq":28,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.568682+0000","last_change":"2024-02-21T23:01:02.204071+0000","last_active":"2024-02-21T23:01:50.568682+0000","last_peered":"2024-02-21T23:01:50.568682+0000","last_clean":"2024-02-21T23:01:50.568682+0000","last_became_active":"2024-02-21T23:01:02.203761+0000","last_became_peered":"2024-02-21T23:01:02.203761+0000","last_unstale":"2024-02-21T23:01:50.568682+0000","last_undegraded":"2024-02-21T23:01:50.568682+0000","last_fullsized":"2024-02-21T23:01:50.568682+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:58:34.737670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.571522+0000","last_change":"2024-02-21T23:01:50.571522+0000","last_active":"2024-02-21T23:01:50.571522+0000","last_peered":"2024-02-21T23:01:50.571522+0000","last_clean":"2024-02-21T23:01:50.571522+0000","last_became_active":"2024-02-21T23:01:50.570965+0000","last_became_peered":"2024-02-21T23:01:50.570965+0000","last_unstale":"2024-02-21T23:01:50.571522+0000","last_undegraded":"2024-02-21T23:01:50.571522+0000","last_fullsized":"2024-02-21T23:01:50.571522+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:34:39.124645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,10,9],"acting":[4,8,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.457441+0000","last_change":"2024-02-21T23:01:03.230134+0000","last_active":"2024-02-21T23:01:50.457441+0000","last_peered":"2024-02-21T23:01:50.457441+0000","last_clean":"2024-02-21T23:01:50.457441+0000","last_became_active":"2024-02-21T23:01:03.229873+0000","last_became_peered":"2024-02-21T23:01:03.229873+0000","last_unstale":"2024-02-21T23:01:50.457441+0000","last_undegraded":"2024-02-21T23:01:50.457441+0000","last_fullsized":"2024-02-21T23:01:50.457441+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:16.946152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"29'4","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.456824+0000","last_change":"2024-02-21T23:01:02.206586+0000","last_active":"2024-02-21T23:01:50.456824+0000","last_peered":"2024-02-21T23:01:50.456824+0000","last_clean":"2024-02-21T23:01:50.456824+0000","last_became_active":"2024-02-21T23:01:02.206230+0000","last_became_peered":"2024-02-21T23:01:02.206230+0000","last_unstale":"2024-02-21T23:01:50.456824+0000","last_undegraded":"2024-02-21T23:01:50.456824+0000","last_fullsized":"2024-02-21T23:01:50.456824+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:21:29.919968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11],"acting":[4,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.553472+0000","last_change":"2024-02-21T23:01:07.252255+0000","last_active":"2024-02-21T23:01:50.553472+0000","last_peered":"2024-02-21T23:01:50.553472+0000","last_clean":"2024-02-21T23:01:50.553472+0000","last_became_active":"2024-02-21T23:01:07.251670+0000","last_became_peered":"2024-02-21T23:01:07.251670+0000","last_unstale":"2024-02-21T23:01:50.553472+0000","last_undegraded":"2024-02-21T23:01:50.553472+0000","last_fullsized":"2024-02-21T23:01:50.553472+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:39:03.021559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.570587+0000","last_change":"2024-02-21T23:01:03.207156+0000","last_active":"2024-02-21T23:01:50.570587+0000","last_peered":"2024-02-21T23:01:50.570587+0000","last_clean":"2024-02-21T23:01:50.570587+0000","last_became_active":"2024-02-21T23:01:03.206892+0000","last_became_peered":"2024-02-21T23:01:03.206892+0000","last_unstale":"2024-02-21T23:01:50.570587+0000","last_undegraded":"2024-02-21T23:01:50.570587+0000","last_fullsized":"2024-02-21T23:01:50.570587+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:19:01.584139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"29'10","reported_seq":36,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.536839+0000","last_change":"2024-02-21T23:01:02.209850+0000","last_active":"2024-02-21T23:01:50.536839+0000","last_peered":"2024-02-21T23:01:50.536839+0000","last_clean":"2024-02-21T23:01:50.536839+0000","last_became_active":"2024-02-21T23:01:02.209601+0000","last_became_peered":"2024-02-21T23:01:02.209601+0000","last_unstale":"2024-02-21T23:01:50.536839+0000","last_undegraded":"2024-02-21T23:01:50.536839+0000","last_fullsized":"2024-02-21T23:01:50.536839+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:36:44.497886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.569723+0000","last_change":"2024-02-21T23:01:07.651884+0000","last_active":"2024-02-21T23:01:50.569723+0000","last_peered":"2024-02-21T23:01:50.569723+0000","last_clean":"2024-02-21T23:01:50.569723+0000","last_became_active":"2024-02-21T23:01:07.651431+0000","last_became_peered":"2024-02-21T23:01:07.651431+0000","last_unstale":"2024-02-21T23:01:50.569723+0000","last_undegraded":"2024-02-21T23:01:50.569723+0000","last_fullsized":"2024-02-21T23:01:50.569723+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:37:06.063756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.645777+0000","last_change":"2024-02-21T23:01:03.221696+0000","last_active":"2024-02-21T23:01:50.645777+0000","last_peered":"2024-02-21T23:01:50.645777+0000","last_clean":"2024-02-21T23:01:50.645777+0000","last_became_active":"2024-02-21T23:01:03.221405+0000","last_became_peered":"2024-02-21T23:01:03.221405+0000","last_unstale":"2024-02-21T23:01:50.645777+0000","last_undegraded":"2024-02-21T23:01:50.645777+0000","last_fullsized":"2024-02-21T23:01:50.645777+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:45:29.610700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"29'1","reported_seq":28,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.459716+0000","last_change":"2024-02-21T23:01:02.221218+0000","last_active":"2024-02-21T23:01:50.459716+0000","last_peered":"2024-02-21T23:01:50.459716+0000","last_clean":"2024-02-21T23:01:50.459716+0000","last_became_active":"2024-02-21T23:01:02.220923+0000","last_became_peered":"2024-02-21T23:01:02.220923+0000","last_unstale":"2024-02-21T23:01:50.459716+0000","last_undegraded":"2024-02-21T23:01:50.459716+0000","last_fullsized":"2024-02-21T23:01:50.459716+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:15.938263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.456354+0000","last_change":"2024-02-21T23:01:07.268952+0000","last_active":"2024-02-21T23:01:50.456354+0000","last_peered":"2024-02-21T23:01:50.456354+0000","last_clean":"2024-02-21T23:01:50.456354+0000","last_became_active":"2024-02-21T23:01:07.268210+0000","last_became_peered":"2024-02-21T23:01:07.268210+0000","last_unstale":"2024-02-21T23:01:50.456354+0000","last_undegraded":"2024-02-21T23:01:50.456354+0000","last_fullsized":"2024-02-21T23:01:50.456354+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:40:30.373445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.569686+0000","last_change":"2024-02-21T23:01:03.218386+0000","last_active":"2024-02-21T23:01:50.569686+0000","last_peered":"2024-02-21T23:01:50.569686+0000","last_clean":"2024-02-21T23:01:50.569686+0000","last_became_active":"2024-02-21T23:01:03.218081+0000","last_became_peered":"2024-02-21T23:01:03.218081+0000","last_unstale":"2024-02-21T23:01:50.569686+0000","last_undegraded":"2024-02-21T23:01:50.569686+0000","last_fullsized":"2024-02-21T23:01:50.569686+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:35:24.590398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.536357+0000","last_change":"2024-02-21T23:01:02.207826+0000","last_active":"2024-02-21T23:01:50.536357+0000","last_peered":"2024-02-21T23:01:50.536357+0000","last_clean":"2024-02-21T23:01:50.536357+0000","last_became_active":"2024-02-21T23:01:02.206426+0000","last_became_peered":"2024-02-21T23:01:02.206426+0000","last_unstale":"2024-02-21T23:01:50.536357+0000","last_undegraded":"2024-02-21T23:01:50.536357+0000","last_fullsized":"2024-02-21T23:01:50.536357+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:17:06.353018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2],"acting":[9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.459005+0000","last_change":"2024-02-21T23:01:07.651876+0000","last_active":"2024-02-21T23:01:50.459005+0000","last_peered":"2024-02-21T23:01:50.459005+0000","last_clean":"2024-02-21T23:01:50.459005+0000","last_became_active":"2024-02-21T23:01:07.651384+0000","last_became_peered":"2024-02-21T23:01:07.651384+0000","last_unstale":"2024-02-21T23:01:50.459005+0000","last_undegraded":"2024-02-21T23:01:50.459005+0000","last_fullsized":"2024-02-21T23:01:50.459005+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:15:20.572234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.569459+0000","last_change":"2024-02-21T23:01:03.210500+0000","last_active":"2024-02-21T23:01:50.569459+0000","last_peered":"2024-02-21T23:01:50.569459+0000","last_clean":"2024-02-21T23:01:50.569459+0000","last_became_active":"2024-02-21T23:01:03.210123+0000","last_became_peered":"2024-02-21T23:01:03.210123+0000","last_unstale":"2024-02-21T23:01:50.569459+0000","last_undegraded":"2024-02-21T23:01:50.569459+0000","last_fullsized":"2024-02-21T23:01:50.569459+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:16.946152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4],"acting":[10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"29'1","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.543234+0000","last_change":"2024-02-21T23:01:02.217455+0000","last_active":"2024-02-21T23:01:50.543234+0000","last_peered":"2024-02-21T23:01:50.543234+0000","last_clean":"2024-02-21T23:01:50.543234+0000","last_became_active":"2024-02-21T23:01:02.217128+0000","last_became_peered":"2024-02-21T23:01:02.217128+0000","last_unstale":"2024-02-21T23:01:50.543234+0000","last_undegraded":"2024-02-21T23:01:50.543234+0000","last_fullsized":"2024-02-21T23:01:50.543234+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:23:41.295647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.645572+0000","last_change":"2024-02-21T23:01:07.266837+0000","last_active":"2024-02-21T23:01:50.645572+0000","last_peered":"2024-02-21T23:01:50.645572+0000","last_clean":"2024-02-21T23:01:50.645572+0000","last_became_active":"2024-02-21T23:01:07.266376+0000","last_became_peered":"2024-02-21T23:01:07.266376+0000","last_unstale":"2024-02-21T23:01:50.645572+0000","last_undegraded":"2024-02-21T23:01:50.645572+0000","last_fullsized":"2024-02-21T23:01:50.645572+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:15:20.572234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.461040+0000","last_change":"2024-02-21T23:01:03.212345+0000","last_active":"2024-02-21T23:01:50.461040+0000","last_peered":"2024-02-21T23:01:50.461040+0000","last_clean":"2024-02-21T23:01:50.461040+0000","last_became_active":"2024-02-21T23:01:03.212019+0000","last_became_peered":"2024-02-21T23:01:03.212019+0000","last_unstale":"2024-02-21T23:01:50.461040+0000","last_undegraded":"2024-02-21T23:01:50.461040+0000","last_fullsized":"2024-02-21T23:01:50.461040+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:20:55.846599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"29'4","reported_seq":58,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:59.448223+0000","last_change":"2024-02-21T23:01:02.219033+0000","last_active":"2024-02-21T23:01:59.448223+0000","last_peered":"2024-02-21T23:01:59.448223+0000","last_clean":"2024-02-21T23:01:59.448223+0000","last_became_active":"2024-02-21T23:01:02.218570+0000","last_became_peered":"2024-02-21T23:01:02.218570+0000","last_unstale":"2024-02-21T23:01:59.448223+0000","last_undegraded":"2024-02-21T23:01:59.448223+0000","last_fullsized":"2024-02-21T23:01:59.448223+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:21:29.919968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.645861+0000","last_change":"2024-02-21T23:01:07.654407+0000","last_active":"2024-02-21T23:01:50.645861+0000","last_peered":"2024-02-21T23:01:50.645861+0000","last_clean":"2024-02-21T23:01:50.645861+0000","last_became_active":"2024-02-21T23:01:07.653745+0000","last_became_peered":"2024-02-21T23:01:07.653745+0000","last_unstale":"2024-02-21T23:01:50.645861+0000","last_undegraded":"2024-02-21T23:01:50.645861+0000","last_fullsized":"2024-02-21T23:01:50.645861+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:54:44.380302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.645142+0000","last_change":"2024-02-21T23:01:03.226352+0000","last_active":"2024-02-21T23:01:50.645142+0000","last_peered":"2024-02-21T23:01:50.645142+0000","last_clean":"2024-02-21T23:01:50.645142+0000","last_became_active":"2024-02-21T23:01:03.219834+0000","last_became_peered":"2024-02-21T23:01:03.219834+0000","last_unstale":"2024-02-21T23:01:50.645142+0000","last_undegraded":"2024-02-21T23:01:50.645142+0000","last_fullsized":"2024-02-21T23:01:50.645142+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:16.946152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"29'3","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.542965+0000","last_change":"2024-02-21T23:01:02.207052+0000","last_active":"2024-02-21T23:01:50.542965+0000","last_peered":"2024-02-21T23:01:50.542965+0000","last_clean":"2024-02-21T23:01:50.542965+0000","last_became_active":"2024-02-21T23:01:02.206146+0000","last_became_peered":"2024-02-21T23:01:02.206146+0000","last_unstale":"2024-02-21T23:01:50.542965+0000","last_undegraded":"2024-02-21T23:01:50.542965+0000","last_fullsized":"2024-02-21T23:01:50.542965+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:26:49.911102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.649817+0000","last_change":"2024-02-21T23:01:50.649817+0000","last_active":"2024-02-21T23:01:50.649817+0000","last_peered":"2024-02-21T23:01:50.649817+0000","last_clean":"2024-02-21T23:01:50.649817+0000","last_became_active":"2024-02-21T23:01:50.649190+0000","last_became_peered":"2024-02-21T23:01:50.649190+0000","last_unstale":"2024-02-21T23:01:50.649817+0000","last_undegraded":"2024-02-21T23:01:50.649817+0000","last_fullsized":"2024-02-21T23:01:50.649817+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:01:32.283462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,11,6,10],"acting":[5,11,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.570082+0000","last_change":"2024-02-21T23:01:03.209260+0000","last_active":"2024-02-21T23:01:50.570082+0000","last_peered":"2024-02-21T23:01:50.570082+0000","last_clean":"2024-02-21T23:01:50.570082+0000","last_became_active":"2024-02-21T23:01:03.209007+0000","last_became_peered":"2024-02-21T23:01:03.209007+0000","last_unstale":"2024-02-21T23:01:50.570082+0000","last_undegraded":"2024-02-21T23:01:50.570082+0000","last_fullsized":"2024-02-21T23:01:50.570082+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:54:32.196725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"29'3","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.457089+0000","last_change":"2024-02-21T23:01:02.203395+0000","last_active":"2024-02-21T23:01:50.457089+0000","last_peered":"2024-02-21T23:01:50.457089+0000","last_clean":"2024-02-21T23:01:50.457089+0000","last_became_active":"2024-02-21T23:01:02.203066+0000","last_became_peered":"2024-02-21T23:01:02.203066+0000","last_unstale":"2024-02-21T23:01:50.457089+0000","last_undegraded":"2024-02-21T23:01:50.457089+0000","last_fullsized":"2024-02-21T23:01:50.457089+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:26:49.911102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":215,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.543142+0000","last_change":"2024-02-21T23:00:58.830752+0000","last_active":"2024-02-21T23:01:50.543142+0000","last_peered":"2024-02-21T23:01:50.543142+0000","last_clean":"2024-02-21T23:01:50.543142+0000","last_became_active":"2024-02-21T23:00:58.830472+0000","last_became_peered":"2024-02-21T23:00:58.830472+0000","last_unstale":"2024-02-21T23:01:50.543142+0000","last_undegraded":"2024-02-21T23:01:50.543142+0000","last_fullsized":"2024-02-21T23:01:50.543142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:00:57.811198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:00:57.811198+0000","last_clean_scrub_stamp":"2024-02-21T23:00:57.811198+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:58:31.374266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"29'1","reported_seq":19,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.543366+0000","last_change":"2024-02-21T23:01:07.276992+0000","last_active":"2024-02-21T23:01:50.543366+0000","last_peered":"2024-02-21T23:01:50.543366+0000","last_clean":"2024-02-21T23:01:50.543366+0000","last_became_active":"2024-02-21T23:01:07.276489+0000","last_became_peered":"2024-02-21T23:01:07.276489+0000","last_unstale":"2024-02-21T23:01:50.543366+0000","last_undegraded":"2024-02-21T23:01:50.543366+0000","last_fullsized":"2024-02-21T23:01:50.543366+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:02:35.072200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.543478+0000","last_change":"2024-02-21T23:01:03.216192+0000","last_active":"2024-02-21T23:01:50.543478+0000","last_peered":"2024-02-21T23:01:50.543478+0000","last_clean":"2024-02-21T23:01:50.543478+0000","last_became_active":"2024-02-21T23:01:03.215904+0000","last_became_peered":"2024-02-21T23:01:03.215904+0000","last_unstale":"2024-02-21T23:01:50.543478+0000","last_undegraded":"2024-02-21T23:01:50.543478+0000","last_fullsized":"2024-02-21T23:01:50.543478+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:15:16.524157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"29'3","reported_seq":30,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.553915+0000","last_change":"2024-02-21T23:01:02.207406+0000","last_active":"2024-02-21T23:01:50.553915+0000","last_peered":"2024-02-21T23:01:50.553915+0000","last_clean":"2024-02-21T23:01:50.553915+0000","last_became_active":"2024-02-21T23:01:02.206219+0000","last_became_peered":"2024-02-21T23:01:02.206219+0000","last_unstale":"2024-02-21T23:01:50.553915+0000","last_undegraded":"2024-02-21T23:01:50.553915+0000","last_fullsized":"2024-02-21T23:01:50.553915+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:21:29.919968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11],"acting":[2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.568656+0000","last_change":"2024-02-21T23:01:07.265822+0000","last_active":"2024-02-21T23:01:50.568656+0000","last_peered":"2024-02-21T23:01:50.568656+0000","last_clean":"2024-02-21T23:01:50.568656+0000","last_became_active":"2024-02-21T23:01:07.265401+0000","last_became_peered":"2024-02-21T23:01:07.265401+0000","last_unstale":"2024-02-21T23:01:50.568656+0000","last_undegraded":"2024-02-21T23:01:50.568656+0000","last_fullsized":"2024-02-21T23:01:50.568656+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:47:23.414344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.543296+0000","last_change":"2024-02-21T23:01:03.220586+0000","last_active":"2024-02-21T23:01:50.543296+0000","last_peered":"2024-02-21T23:01:50.543296+0000","last_clean":"2024-02-21T23:01:50.543296+0000","last_became_active":"2024-02-21T23:01:03.220349+0000","last_became_peered":"2024-02-21T23:01:03.220349+0000","last_unstale":"2024-02-21T23:01:50.543296+0000","last_undegraded":"2024-02-21T23:01:50.543296+0000","last_fullsized":"2024-02-21T23:01:50.543296+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:20:55.846599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":28,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.461582+0000","last_change":"2024-02-21T23:01:02.206319+0000","last_active":"2024-02-21T23:01:50.461582+0000","last_peered":"2024-02-21T23:01:50.461582+0000","last_clean":"2024-02-21T23:01:50.461582+0000","last_became_active":"2024-02-21T23:01:02.205747+0000","last_became_peered":"2024-02-21T23:01:02.205747+0000","last_unstale":"2024-02-21T23:01:50.461582+0000","last_undegraded":"2024-02-21T23:01:50.461582+0000","last_fullsized":"2024-02-21T23:01:50.461582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:10:09.680115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10],"acting":[5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.457099+0000","last_change":"2024-02-21T23:01:07.280592+0000","last_active":"2024-02-21T23:01:50.457099+0000","last_peered":"2024-02-21T23:01:50.457099+0000","last_clean":"2024-02-21T23:01:50.457099+0000","last_became_active":"2024-02-21T23:01:07.280193+0000","last_became_peered":"2024-02-21T23:01:07.280193+0000","last_unstale":"2024-02-21T23:01:50.457099+0000","last_undegraded":"2024-02-21T23:01:50.457099+0000","last_fullsized":"2024-02-21T23:01:50.457099+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:40:30.373445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.543523+0000","last_change":"2024-02-21T23:01:03.216834+0000","last_active":"2024-02-21T23:01:50.543523+0000","last_peered":"2024-02-21T23:01:50.543523+0000","last_clean":"2024-02-21T23:01:50.543523+0000","last_became_active":"2024-02-21T23:01:03.216578+0000","last_became_peered":"2024-02-21T23:01:03.216578+0000","last_unstale":"2024-02-21T23:01:50.543523+0000","last_undegraded":"2024-02-21T23:01:50.543523+0000","last_fullsized":"2024-02-21T23:01:50.543523+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:37:02.015678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":28,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.645911+0000","last_change":"2024-02-21T23:01:02.220913+0000","last_active":"2024-02-21T23:01:50.645911+0000","last_peered":"2024-02-21T23:01:50.645911+0000","last_clean":"2024-02-21T23:01:50.645911+0000","last_became_active":"2024-02-21T23:01:02.220554+0000","last_became_peered":"2024-02-21T23:01:02.220554+0000","last_unstale":"2024-02-21T23:01:50.645911+0000","last_undegraded":"2024-02-21T23:01:50.645911+0000","last_fullsized":"2024-02-21T23:01:50.645911+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:36:44.497886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.460856+0000","last_change":"2024-02-21T23:01:07.257431+0000","last_active":"2024-02-21T23:01:50.460856+0000","last_peered":"2024-02-21T23:01:50.460856+0000","last_clean":"2024-02-21T23:01:50.460856+0000","last_became_active":"2024-02-21T23:01:07.257011+0000","last_became_peered":"2024-02-21T23:01:07.257011+0000","last_unstale":"2024-02-21T23:01:50.460856+0000","last_undegraded":"2024-02-21T23:01:50.460856+0000","last_fullsized":"2024-02-21T23:01:50.460856+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:44:43.960074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.456680+0000","last_change":"2024-02-21T23:01:03.211792+0000","last_active":"2024-02-21T23:01:50.456680+0000","last_peered":"2024-02-21T23:01:50.456680+0000","last_clean":"2024-02-21T23:01:50.456680+0000","last_became_active":"2024-02-21T23:01:03.211467+0000","last_became_peered":"2024-02-21T23:01:03.211467+0000","last_unstale":"2024-02-21T23:01:50.456680+0000","last_undegraded":"2024-02-21T23:01:50.456680+0000","last_fullsized":"2024-02-21T23:01:50.456680+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:54:32.196725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"29'2","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.459328+0000","last_change":"2024-02-21T23:01:02.211763+0000","last_active":"2024-02-21T23:01:50.459328+0000","last_peered":"2024-02-21T23:01:50.459328+0000","last_clean":"2024-02-21T23:01:50.459328+0000","last_became_active":"2024-02-21T23:01:02.211470+0000","last_became_peered":"2024-02-21T23:01:02.211470+0000","last_unstale":"2024-02-21T23:01:50.459328+0000","last_undegraded":"2024-02-21T23:01:50.459328+0000","last_fullsized":"2024-02-21T23:01:50.459328+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:23:41.295647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5],"acting":[8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.460967+0000","last_change":"2024-02-21T23:01:07.269076+0000","last_active":"2024-02-21T23:01:50.460967+0000","last_peered":"2024-02-21T23:01:50.460967+0000","last_clean":"2024-02-21T23:01:50.460967+0000","last_became_active":"2024-02-21T23:01:07.268681+0000","last_became_peered":"2024-02-21T23:01:07.268681+0000","last_unstale":"2024-02-21T23:01:50.460967+0000","last_undegraded":"2024-02-21T23:01:50.460967+0000","last_fullsized":"2024-02-21T23:01:50.460967+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:02:35.072200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.461133+0000","last_change":"2024-02-21T23:01:03.212943+0000","last_active":"2024-02-21T23:01:50.461133+0000","last_peered":"2024-02-21T23:01:50.461133+0000","last_clean":"2024-02-21T23:01:50.461133+0000","last_became_active":"2024-02-21T23:01:03.212634+0000","last_became_peered":"2024-02-21T23:01:03.212634+0000","last_unstale":"2024-02-21T23:01:50.461133+0000","last_undegraded":"2024-02-21T23:01:50.461133+0000","last_fullsized":"2024-02-21T23:01:50.461133+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:07:50.626867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"29'15","reported_seq":42,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.458942+0000","last_change":"2024-02-21T23:01:02.221957+0000","last_active":"2024-02-21T23:01:50.458942+0000","last_peered":"2024-02-21T23:01:50.458942+0000","last_clean":"2024-02-21T23:01:50.458942+0000","last_became_active":"2024-02-21T23:01:02.221642+0000","last_became_peered":"2024-02-21T23:01:02.221642+0000","last_unstale":"2024-02-21T23:01:50.458942+0000","last_undegraded":"2024-02-21T23:01:50.458942+0000","last_fullsized":"2024-02-21T23:01:50.458942+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:10:09.680115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.645802+0000","last_change":"2024-02-21T23:01:07.268330+0000","last_active":"2024-02-21T23:01:50.645802+0000","last_peered":"2024-02-21T23:01:50.645802+0000","last_clean":"2024-02-21T23:01:50.645802+0000","last_became_active":"2024-02-21T23:01:07.267874+0000","last_became_peered":"2024-02-21T23:01:07.267874+0000","last_unstale":"2024-02-21T23:01:50.645802+0000","last_undegraded":"2024-02-21T23:01:50.645802+0000","last_fullsized":"2024-02-21T23:01:50.645802+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:37:06.063756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.542962+0000","last_change":"2024-02-21T23:01:03.216774+0000","last_active":"2024-02-21T23:01:50.542962+0000","last_peered":"2024-02-21T23:01:50.542962+0000","last_clean":"2024-02-21T23:01:50.542962+0000","last_became_active":"2024-02-21T23:01:03.216466+0000","last_became_peered":"2024-02-21T23:01:03.216466+0000","last_unstale":"2024-02-21T23:01:50.542962+0000","last_undegraded":"2024-02-21T23:01:50.542962+0000","last_fullsized":"2024-02-21T23:01:50.542962+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:07:50.626867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"29'3","reported_seq":59,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:59.448983+0000","last_change":"2024-02-21T23:01:02.199060+0000","last_active":"2024-02-21T23:01:59.448983+0000","last_peered":"2024-02-21T23:01:59.448983+0000","last_clean":"2024-02-21T23:01:59.448983+0000","last_became_active":"2024-02-21T23:01:02.198709+0000","last_became_peered":"2024-02-21T23:01:02.198709+0000","last_unstale":"2024-02-21T23:01:59.448983+0000","last_undegraded":"2024-02-21T23:01:59.448983+0000","last_fullsized":"2024-02-21T23:01:59.448983+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:36:44.497886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":31,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.536405+0000","last_change":"2024-02-21T23:01:07.278031+0000","last_active":"2024-02-21T23:01:50.536405+0000","last_peered":"2024-02-21T23:01:50.536405+0000","last_clean":"2024-02-21T23:01:50.536405+0000","last_became_active":"2024-02-21T23:01:07.277289+0000","last_became_peered":"2024-02-21T23:01:07.277289+0000","last_unstale":"2024-02-21T23:01:50.536405+0000","last_undegraded":"2024-02-21T23:01:50.536405+0000","last_fullsized":"2024-02-21T23:01:50.536405+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:07:54.674944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.543265+0000","last_change":"2024-02-21T23:01:03.214805+0000","last_active":"2024-02-21T23:01:50.543265+0000","last_peered":"2024-02-21T23:01:50.543265+0000","last_clean":"2024-02-21T23:01:50.543265+0000","last_became_active":"2024-02-21T23:01:03.214507+0000","last_became_peered":"2024-02-21T23:01:03.214507+0000","last_unstale":"2024-02-21T23:01:50.543265+0000","last_undegraded":"2024-02-21T23:01:50.543265+0000","last_fullsized":"2024-02-21T23:01:50.543265+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:38:58.973481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"29'3","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.461175+0000","last_change":"2024-02-21T23:01:02.209351+0000","last_active":"2024-02-21T23:01:50.461175+0000","last_peered":"2024-02-21T23:01:50.461175+0000","last_clean":"2024-02-21T23:01:50.461175+0000","last_became_active":"2024-02-21T23:01:02.208990+0000","last_became_peered":"2024-02-21T23:01:02.208990+0000","last_unstale":"2024-02-21T23:01:50.461175+0000","last_undegraded":"2024-02-21T23:01:50.461175+0000","last_fullsized":"2024-02-21T23:01:50.461175+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:36:44.497886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":25,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.649737+0000","last_change":"2024-02-21T23:01:50.649737+0000","last_active":"2024-02-21T23:01:50.649737+0000","last_peered":"2024-02-21T23:01:50.649737+0000","last_clean":"2024-02-21T23:01:50.649737+0000","last_became_active":"2024-02-21T23:01:50.649153+0000","last_became_peered":"2024-02-21T23:01:50.649153+0000","last_unstale":"2024-02-21T23:01:50.649737+0000","last_undegraded":"2024-02-21T23:01:50.649737+0000","last_fullsized":"2024-02-21T23:01:50.649737+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:03:35.497925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,7,6],"acting":[11,8,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.645704+0000","last_change":"2024-02-21T23:01:03.226321+0000","last_active":"2024-02-21T23:01:50.645704+0000","last_peered":"2024-02-21T23:01:50.645704+0000","last_clean":"2024-02-21T23:01:50.645704+0000","last_became_active":"2024-02-21T23:01:03.224451+0000","last_became_peered":"2024-02-21T23:01:03.224451+0000","last_unstale":"2024-02-21T23:01:50.645704+0000","last_undegraded":"2024-02-21T23:01:50.645704+0000","last_fullsized":"2024-02-21T23:01:50.645704+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:35:24.590398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"29'6","reported_seq":33,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.553663+0000","last_change":"2024-02-21T23:01:02.203410+0000","last_active":"2024-02-21T23:01:50.553663+0000","last_peered":"2024-02-21T23:01:50.553663+0000","last_clean":"2024-02-21T23:01:50.553663+0000","last_became_active":"2024-02-21T23:01:02.203081+0000","last_became_peered":"2024-02-21T23:01:02.203081+0000","last_unstale":"2024-02-21T23:01:50.553663+0000","last_undegraded":"2024-02-21T23:01:50.553663+0000","last_fullsized":"2024-02-21T23:01:50.553663+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:36:44.497886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10],"acting":[2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.461334+0000","last_change":"2024-02-21T23:01:07.268810+0000","last_active":"2024-02-21T23:01:50.461334+0000","last_peered":"2024-02-21T23:01:50.461334+0000","last_clean":"2024-02-21T23:01:50.461334+0000","last_became_active":"2024-02-21T23:01:07.268436+0000","last_became_peered":"2024-02-21T23:01:07.268436+0000","last_unstale":"2024-02-21T23:01:50.461334+0000","last_undegraded":"2024-02-21T23:01:50.461334+0000","last_fullsized":"2024-02-21T23:01:50.461334+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:10:53.452033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.459605+0000","last_change":"2024-02-21T23:01:03.216176+0000","last_active":"2024-02-21T23:01:50.459605+0000","last_peered":"2024-02-21T23:01:50.459605+0000","last_clean":"2024-02-21T23:01:50.459605+0000","last_became_active":"2024-02-21T23:01:03.215888+0000","last_became_peered":"2024-02-21T23:01:03.215888+0000","last_unstale":"2024-02-21T23:01:50.459605+0000","last_undegraded":"2024-02-21T23:01:50.459605+0000","last_fullsized":"2024-02-21T23:01:50.459605+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:07:50.626867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"31'34","reported_seq":125,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:02:00.466414+0000","last_change":"2024-02-21T23:01:02.204595+0000","last_active":"2024-02-21T23:02:00.466414+0000","last_peered":"2024-02-21T23:02:00.466414+0000","last_clean":"2024-02-21T23:02:00.466414+0000","last_became_active":"2024-02-21T23:01:02.204123+0000","last_became_peered":"2024-02-21T23:01:02.204123+0000","last_unstale":"2024-02-21T23:02:00.466414+0000","last_undegraded":"2024-02-21T23:02:00.466414+0000","last_fullsized":"2024-02-21T23:02:00.466414+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:36:44.497886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66869,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":65,"num_read_kb":98,"num_write":35,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1],"acting":[10,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.536537+0000","last_change":"2024-02-21T23:01:07.275187+0000","last_active":"2024-02-21T23:01:50.536537+0000","last_peered":"2024-02-21T23:01:50.536537+0000","last_clean":"2024-02-21T23:01:50.536537+0000","last_became_active":"2024-02-21T23:01:07.265618+0000","last_became_peered":"2024-02-21T23:01:07.265618+0000","last_unstale":"2024-02-21T23:01:50.536537+0000","last_undegraded":"2024-02-21T23:01:50.536537+0000","last_fullsized":"2024-02-21T23:01:50.536537+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:47:23.414344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.568849+0000","last_change":"2024-02-21T23:01:03.216300+0000","last_active":"2024-02-21T23:01:50.568849+0000","last_peered":"2024-02-21T23:01:50.568849+0000","last_clean":"2024-02-21T23:01:50.568849+0000","last_became_active":"2024-02-21T23:01:03.214580+0000","last_became_peered":"2024-02-21T23:01:03.214580+0000","last_unstale":"2024-02-21T23:01:50.568849+0000","last_undegraded":"2024-02-21T23:01:50.568849+0000","last_fullsized":"2024-02-21T23:01:50.568849+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:41:55.485351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8],"acting":[1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"29'4","reported_seq":31,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.461514+0000","last_change":"2024-02-21T23:01:02.222064+0000","last_active":"2024-02-21T23:01:50.461514+0000","last_peered":"2024-02-21T23:01:50.461514+0000","last_clean":"2024-02-21T23:01:50.461514+0000","last_became_active":"2024-02-21T23:01:02.221735+0000","last_became_peered":"2024-02-21T23:01:02.221735+0000","last_unstale":"2024-02-21T23:01:50.461514+0000","last_undegraded":"2024-02-21T23:01:50.461514+0000","last_fullsized":"2024-02-21T23:01:50.461514+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:23:41.295647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.456728+0000","last_change":"2024-02-21T23:01:07.276469+0000","last_active":"2024-02-21T23:01:50.456728+0000","last_peered":"2024-02-21T23:01:50.456728+0000","last_clean":"2024-02-21T23:01:50.456728+0000","last_became_active":"2024-02-21T23:01:07.275982+0000","last_became_peered":"2024-02-21T23:01:07.275982+0000","last_unstale":"2024-02-21T23:01:50.456728+0000","last_undegraded":"2024-02-21T23:01:50.456728+0000","last_fullsized":"2024-02-21T23:01:50.456728+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:37:06.063756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.457882+0000","last_change":"2024-02-21T23:01:03.229449+0000","last_active":"2024-02-21T23:01:50.457882+0000","last_peered":"2024-02-21T23:01:50.457882+0000","last_clean":"2024-02-21T23:01:50.457882+0000","last_became_active":"2024-02-21T23:01:03.229193+0000","last_became_peered":"2024-02-21T23:01:03.229193+0000","last_unstale":"2024-02-21T23:01:50.457882+0000","last_undegraded":"2024-02-21T23:01:50.457882+0000","last_fullsized":"2024-02-21T23:01:50.457882+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:35:24.590398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"29'2","reported_seq":28,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.543465+0000","last_change":"2024-02-21T23:01:02.197598+0000","last_active":"2024-02-21T23:01:50.543465+0000","last_peered":"2024-02-21T23:01:50.543465+0000","last_clean":"2024-02-21T23:01:50.543465+0000","last_became_active":"2024-02-21T23:01:02.197275+0000","last_became_peered":"2024-02-21T23:01:02.197275+0000","last_unstale":"2024-02-21T23:01:50.543465+0000","last_undegraded":"2024-02-21T23:01:50.543465+0000","last_fullsized":"2024-02-21T23:01:50.543465+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:36:44.497886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.556351+0000","last_change":"2024-02-21T23:01:50.555061+0000","last_active":"2024-02-21T23:01:50.556351+0000","last_peered":"2024-02-21T23:01:50.556351+0000","last_clean":"2024-02-21T23:01:50.556351+0000","last_became_active":"2024-02-21T23:01:50.554591+0000","last_became_peered":"2024-02-21T23:01:50.554591+0000","last_unstale":"2024-02-21T23:01:50.556351+0000","last_undegraded":"2024-02-21T23:01:50.556351+0000","last_fullsized":"2024-02-21T23:01:50.556351+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:11:41.919040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2,4],"acting":[8,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.568757+0000","last_change":"2024-02-21T23:01:03.215454+0000","last_active":"2024-02-21T23:01:50.568757+0000","last_peered":"2024-02-21T23:01:50.568757+0000","last_clean":"2024-02-21T23:01:50.568757+0000","last_became_active":"2024-02-21T23:01:03.215004+0000","last_became_peered":"2024-02-21T23:01:03.215004+0000","last_unstale":"2024-02-21T23:01:50.568757+0000","last_undegraded":"2024-02-21T23:01:50.568757+0000","last_fullsized":"2024-02-21T23:01:50.568757+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:27:55.341328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"29'3","reported_seq":57,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:59.437861+0000","last_change":"2024-02-21T23:01:02.207663+0000","last_active":"2024-02-21T23:01:59.437861+0000","last_peered":"2024-02-21T23:01:59.437861+0000","last_clean":"2024-02-21T23:01:59.437861+0000","last_became_active":"2024-02-21T23:01:02.207349+0000","last_became_peered":"2024-02-21T23:01:02.207349+0000","last_unstale":"2024-02-21T23:01:59.437861+0000","last_undegraded":"2024-02-21T23:01:59.437861+0000","last_fullsized":"2024-02-21T23:01:59.437861+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:21:29.919968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5],"acting":[10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.570456+0000","last_change":"2024-02-21T23:01:07.268655+0000","last_active":"2024-02-21T23:01:50.570456+0000","last_peered":"2024-02-21T23:01:50.570456+0000","last_clean":"2024-02-21T23:01:50.570456+0000","last_became_active":"2024-02-21T23:01:07.268193+0000","last_became_peered":"2024-02-21T23:01:07.268193+0000","last_unstale":"2024-02-21T23:01:50.570456+0000","last_undegraded":"2024-02-21T23:01:50.570456+0000","last_fullsized":"2024-02-21T23:01:50.570456+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:54:44.380302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.457242+0000","last_change":"2024-02-21T23:01:07.271441+0000","last_active":"2024-02-21T23:01:50.457242+0000","last_peered":"2024-02-21T23:01:50.457242+0000","last_clean":"2024-02-21T23:01:50.457242+0000","last_became_active":"2024-02-21T23:01:07.271175+0000","last_became_peered":"2024-02-21T23:01:07.271175+0000","last_unstale":"2024-02-21T23:01:50.457242+0000","last_undegraded":"2024-02-21T23:01:50.457242+0000","last_fullsized":"2024-02-21T23:01:50.457242+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:20:59.894677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.536245+0000","last_change":"2024-02-21T23:01:03.210855+0000","last_active":"2024-02-21T23:01:50.536245+0000","last_peered":"2024-02-21T23:01:50.536245+0000","last_clean":"2024-02-21T23:01:50.536245+0000","last_became_active":"2024-02-21T23:01:03.210599+0000","last_became_peered":"2024-02-21T23:01:03.210599+0000","last_unstale":"2024-02-21T23:01:50.536245+0000","last_undegraded":"2024-02-21T23:01:50.536245+0000","last_fullsized":"2024-02-21T23:01:50.536245+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:27:55.341328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"29'1","reported_seq":27,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.461249+0000","last_change":"2024-02-21T23:01:02.204603+0000","last_active":"2024-02-21T23:01:50.461249+0000","last_peered":"2024-02-21T23:01:50.461249+0000","last_clean":"2024-02-21T23:01:50.461249+0000","last_became_active":"2024-02-21T23:01:02.204304+0000","last_became_peered":"2024-02-21T23:01:02.204304+0000","last_unstale":"2024-02-21T23:01:50.461249+0000","last_undegraded":"2024-02-21T23:01:50.461249+0000","last_fullsized":"2024-02-21T23:01:50.461249+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:58:23.554457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.456616+0000","last_change":"2024-02-21T23:01:07.284000+0000","last_active":"2024-02-21T23:01:50.456616+0000","last_peered":"2024-02-21T23:01:50.456616+0000","last_clean":"2024-02-21T23:01:50.456616+0000","last_became_active":"2024-02-21T23:01:07.283568+0000","last_became_peered":"2024-02-21T23:01:07.283568+0000","last_unstale":"2024-02-21T23:01:50.456616+0000","last_undegraded":"2024-02-21T23:01:50.456616+0000","last_fullsized":"2024-02-21T23:01:50.456616+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:20:59.894677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.569859+0000","last_change":"2024-02-21T23:01:03.208483+0000","last_active":"2024-02-21T23:01:50.569859+0000","last_peered":"2024-02-21T23:01:50.569859+0000","last_clean":"2024-02-21T23:01:50.569859+0000","last_became_active":"2024-02-21T23:01:03.208141+0000","last_became_peered":"2024-02-21T23:01:03.208141+0000","last_unstale":"2024-02-21T23:01:50.569859+0000","last_undegraded":"2024-02-21T23:01:50.569859+0000","last_fullsized":"2024-02-21T23:01:50.569859+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:35:24.590398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"29'2","reported_seq":28,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.645919+0000","last_change":"2024-02-21T23:01:02.218826+0000","last_active":"2024-02-21T23:01:50.645919+0000","last_peered":"2024-02-21T23:01:50.645919+0000","last_clean":"2024-02-21T23:01:50.645919+0000","last_became_active":"2024-02-21T23:01:02.218499+0000","last_became_peered":"2024-02-21T23:01:02.218499+0000","last_unstale":"2024-02-21T23:01:50.645919+0000","last_undegraded":"2024-02-21T23:01:50.645919+0000","last_fullsized":"2024-02-21T23:01:50.645919+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:17:06.353018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"29'3","reported_seq":29,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.569474+0000","last_change":"2024-02-21T23:01:02.209061+0000","last_active":"2024-02-21T23:01:50.569474+0000","last_peered":"2024-02-21T23:01:50.569474+0000","last_clean":"2024-02-21T23:01:50.569474+0000","last_became_active":"2024-02-21T23:01:02.208779+0000","last_became_peered":"2024-02-21T23:01:02.208779+0000","last_unstale":"2024-02-21T23:01:50.569474+0000","last_undegraded":"2024-02-21T23:01:50.569474+0000","last_fullsized":"2024-02-21T23:01:50.569474+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:17:06.353018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8],"acting":[10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.461232+0000","last_change":"2024-02-21T23:01:03.212873+0000","last_active":"2024-02-21T23:01:50.461232+0000","last_peered":"2024-02-21T23:01:50.461232+0000","last_clean":"2024-02-21T23:01:50.461232+0000","last_became_active":"2024-02-21T23:01:03.212560+0000","last_became_peered":"2024-02-21T23:01:03.212560+0000","last_unstale":"2024-02-21T23:01:50.461232+0000","last_undegraded":"2024-02-21T23:01:50.461232+0000","last_fullsized":"2024-02-21T23:01:50.461232+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:47:19.366266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.553666+0000","last_change":"2024-02-21T23:01:07.269266+0000","last_active":"2024-02-21T23:01:50.553666+0000","last_peered":"2024-02-21T23:01:50.553666+0000","last_clean":"2024-02-21T23:01:50.553666+0000","last_became_active":"2024-02-21T23:01:07.267796+0000","last_became_peered":"2024-02-21T23:01:07.267796+0000","last_unstale":"2024-02-21T23:01:50.553666+0000","last_undegraded":"2024-02-21T23:01:50.553666+0000","last_fullsized":"2024-02-21T23:01:50.553666+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:37:06.063756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"29'6","reported_seq":63,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:59.438527+0000","last_change":"2024-02-21T23:01:02.206398+0000","last_active":"2024-02-21T23:01:59.438527+0000","last_peered":"2024-02-21T23:01:59.438527+0000","last_clean":"2024-02-21T23:01:59.438527+0000","last_became_active":"2024-02-21T23:01:02.206069+0000","last_became_peered":"2024-02-21T23:01:02.206069+0000","last_unstale":"2024-02-21T23:01:59.438527+0000","last_undegraded":"2024-02-21T23:01:59.438527+0000","last_fullsized":"2024-02-21T23:01:59.438527+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:26:49.911102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1017,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":31,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.459331+0000","last_change":"2024-02-21T23:01:03.221228+0000","last_active":"2024-02-21T23:01:50.459331+0000","last_peered":"2024-02-21T23:01:50.459331+0000","last_clean":"2024-02-21T23:01:50.459331+0000","last_became_active":"2024-02-21T23:01:03.220900+0000","last_became_peered":"2024-02-21T23:01:03.220900+0000","last_unstale":"2024-02-21T23:01:50.459331+0000","last_undegraded":"2024-02-21T23:01:50.459331+0000","last_fullsized":"2024-02-21T23:01:50.459331+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:40:26.325368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9],"acting":[8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.553914+0000","last_change":"2024-02-21T23:01:07.257004+0000","last_active":"2024-02-21T23:01:50.553914+0000","last_peered":"2024-02-21T23:01:50.553914+0000","last_clean":"2024-02-21T23:01:50.553914+0000","last_became_active":"2024-02-21T23:01:07.256474+0000","last_became_peered":"2024-02-21T23:01:07.256474+0000","last_unstale":"2024-02-21T23:01:50.553914+0000","last_undegraded":"2024-02-21T23:01:50.553914+0000","last_fullsized":"2024-02-21T23:01:50.553914+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:15:20.572234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.456324+0000","last_change":"2024-02-21T23:01:03.215942+0000","last_active":"2024-02-21T23:01:50.456324+0000","last_peered":"2024-02-21T23:01:50.456324+0000","last_clean":"2024-02-21T23:01:50.456324+0000","last_became_active":"2024-02-21T23:01:03.215461+0000","last_became_peered":"2024-02-21T23:01:03.215461+0000","last_unstale":"2024-02-21T23:01:50.456324+0000","last_undegraded":"2024-02-21T23:01:50.456324+0000","last_fullsized":"2024-02-21T23:01:50.456324+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:27:55.341328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.553647+0000","last_change":"2024-02-21T23:01:03.215959+0000","last_active":"2024-02-21T23:01:50.553647+0000","last_peered":"2024-02-21T23:01:50.553647+0000","last_clean":"2024-02-21T23:01:50.553647+0000","last_became_active":"2024-02-21T23:01:03.215639+0000","last_became_peered":"2024-02-21T23:01:03.215639+0000","last_unstale":"2024-02-21T23:01:50.553647+0000","last_undegraded":"2024-02-21T23:01:50.553647+0000","last_fullsized":"2024-02-21T23:01:50.553647+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:16.946152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.553477+0000","last_change":"2024-02-21T23:01:03.218687+0000","last_active":"2024-02-21T23:01:50.553477+0000","last_peered":"2024-02-21T23:01:50.553477+0000","last_clean":"2024-02-21T23:01:50.553477+0000","last_became_active":"2024-02-21T23:01:03.218377+0000","last_became_peered":"2024-02-21T23:01:03.218377+0000","last_unstale":"2024-02-21T23:01:50.553477+0000","last_undegraded":"2024-02-21T23:01:50.553477+0000","last_fullsized":"2024-02-21T23:01:50.553477+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:41:55.485351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.457235+0000","last_change":"2024-02-21T23:01:03.225342+0000","last_active":"2024-02-21T23:01:50.457235+0000","last_peered":"2024-02-21T23:01:50.457235+0000","last_clean":"2024-02-21T23:01:50.457235+0000","last_became_active":"2024-02-21T23:01:03.225085+0000","last_became_peered":"2024-02-21T23:01:03.225085+0000","last_unstale":"2024-02-21T23:01:50.457235+0000","last_undegraded":"2024-02-21T23:01:50.457235+0000","last_fullsized":"2024-02-21T23:01:50.457235+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:54:32.196725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.645600+0000","last_change":"2024-02-21T23:01:03.226259+0000","last_active":"2024-02-21T23:01:50.645600+0000","last_peered":"2024-02-21T23:01:50.645600+0000","last_clean":"2024-02-21T23:01:50.645600+0000","last_became_active":"2024-02-21T23:01:03.225925+0000","last_became_peered":"2024-02-21T23:01:03.225925+0000","last_unstale":"2024-02-21T23:01:50.645600+0000","last_undegraded":"2024-02-21T23:01:50.645600+0000","last_fullsized":"2024-02-21T23:01:50.645600+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:54:32.196725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.456563+0000","last_change":"2024-02-21T23:01:03.215186+0000","last_active":"2024-02-21T23:01:50.456563+0000","last_peered":"2024-02-21T23:01:50.456563+0000","last_clean":"2024-02-21T23:01:50.456563+0000","last_became_active":"2024-02-21T23:01:03.214488+0000","last_became_peered":"2024-02-21T23:01:03.214488+0000","last_unstale":"2024-02-21T23:01:50.456563+0000","last_undegraded":"2024-02-21T23:01:50.456563+0000","last_fullsized":"2024-02-21T23:01:50.456563+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:58:24.562346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8],"acting":[11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.554068+0000","last_change":"2024-02-21T23:01:03.208734+0000","last_active":"2024-02-21T23:01:50.554068+0000","last_peered":"2024-02-21T23:01:50.554068+0000","last_clean":"2024-02-21T23:01:50.554068+0000","last_became_active":"2024-02-21T23:01:03.208458+0000","last_became_peered":"2024-02-21T23:01:03.208458+0000","last_unstale":"2024-02-21T23:01:50.554068+0000","last_undegraded":"2024-02-21T23:01:50.554068+0000","last_fullsized":"2024-02-21T23:01:50.554068+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:54:32.196725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8],"acting":[2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.570484+0000","last_change":"2024-02-21T23:01:03.206669+0000","last_active":"2024-02-21T23:01:50.570484+0000","last_peered":"2024-02-21T23:01:50.570484+0000","last_clean":"2024-02-21T23:01:50.570484+0000","last_became_active":"2024-02-21T23:01:03.206376+0000","last_became_peered":"2024-02-21T23:01:03.206376+0000","last_unstale":"2024-02-21T23:01:50.570484+0000","last_undegraded":"2024-02-21T23:01:50.570484+0000","last_fullsized":"2024-02-21T23:01:50.570484+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:07:50.626867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.460976+0000","last_change":"2024-02-21T23:01:03.215459+0000","last_active":"2024-02-21T23:01:50.460976+0000","last_peered":"2024-02-21T23:01:50.460976+0000","last_clean":"2024-02-21T23:01:50.460976+0000","last_became_active":"2024-02-21T23:01:03.214922+0000","last_became_peered":"2024-02-21T23:01:03.214922+0000","last_unstale":"2024-02-21T23:01:50.460976+0000","last_undegraded":"2024-02-21T23:01:50.460976+0000","last_fullsized":"2024-02-21T23:01:50.460976+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:40:26.325368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.570084+0000","last_change":"2024-02-21T23:01:03.213687+0000","last_active":"2024-02-21T23:01:50.570084+0000","last_peered":"2024-02-21T23:01:50.570084+0000","last_clean":"2024-02-21T23:01:50.570084+0000","last_became_active":"2024-02-21T23:01:03.213428+0000","last_became_peered":"2024-02-21T23:01:03.213428+0000","last_unstale":"2024-02-21T23:01:50.570084+0000","last_undegraded":"2024-02-21T23:01:50.570084+0000","last_fullsized":"2024-02-21T23:01:50.570084+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:45:29.610700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.568724+0000","last_change":"2024-02-21T23:01:03.215983+0000","last_active":"2024-02-21T23:01:50.568724+0000","last_peered":"2024-02-21T23:01:50.568724+0000","last_clean":"2024-02-21T23:01:50.568724+0000","last_became_active":"2024-02-21T23:01:03.215580+0000","last_became_peered":"2024-02-21T23:01:03.215580+0000","last_unstale":"2024-02-21T23:01:50.568724+0000","last_undegraded":"2024-02-21T23:01:50.568724+0000","last_fullsized":"2024-02-21T23:01:50.568724+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:58:24.562346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.646827+0000","last_change":"2024-02-21T23:01:03.226514+0000","last_active":"2024-02-21T23:01:50.646827+0000","last_peered":"2024-02-21T23:01:50.646827+0000","last_clean":"2024-02-21T23:01:50.646827+0000","last_became_active":"2024-02-21T23:01:03.223861+0000","last_became_peered":"2024-02-21T23:01:03.223861+0000","last_unstale":"2024-02-21T23:01:50.646827+0000","last_undegraded":"2024-02-21T23:01:50.646827+0000","last_fullsized":"2024-02-21T23:01:50.646827+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:07:50.626867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.456544+0000","last_change":"2024-02-21T23:01:03.212993+0000","last_active":"2024-02-21T23:01:50.456544+0000","last_peered":"2024-02-21T23:01:50.456544+0000","last_clean":"2024-02-21T23:01:50.456544+0000","last_became_active":"2024-02-21T23:01:03.212691+0000","last_became_peered":"2024-02-21T23:01:03.212691+0000","last_unstale":"2024-02-21T23:01:50.456544+0000","last_undegraded":"2024-02-21T23:01:50.456544+0000","last_fullsized":"2024-02-21T23:01:50.456544+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:10:10.688004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.554112+0000","last_change":"2024-02-21T23:01:03.217962+0000","last_active":"2024-02-21T23:01:50.554112+0000","last_peered":"2024-02-21T23:01:50.554112+0000","last_clean":"2024-02-21T23:01:50.554112+0000","last_became_active":"2024-02-21T23:01:03.217613+0000","last_became_peered":"2024-02-21T23:01:03.217613+0000","last_unstale":"2024-02-21T23:01:50.554112+0000","last_undegraded":"2024-02-21T23:01:50.554112+0000","last_fullsized":"2024-02-21T23:01:50.554112+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:35:24.590398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.536790+0000","last_change":"2024-02-21T23:01:03.214531+0000","last_active":"2024-02-21T23:01:50.536790+0000","last_peered":"2024-02-21T23:01:50.536790+0000","last_clean":"2024-02-21T23:01:50.536790+0000","last_became_active":"2024-02-21T23:01:03.214165+0000","last_became_peered":"2024-02-21T23:01:03.214165+0000","last_unstale":"2024-02-21T23:01:50.536790+0000","last_undegraded":"2024-02-21T23:01:50.536790+0000","last_fullsized":"2024-02-21T23:01:50.536790+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:58:24.562346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1],"acting":[9,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.456840+0000","last_change":"2024-02-21T23:01:03.214286+0000","last_active":"2024-02-21T23:01:50.456840+0000","last_peered":"2024-02-21T23:01:50.456840+0000","last_clean":"2024-02-21T23:01:50.456840+0000","last_became_active":"2024-02-21T23:01:03.213755+0000","last_became_peered":"2024-02-21T23:01:03.213755+0000","last_unstale":"2024-02-21T23:01:50.456840+0000","last_undegraded":"2024-02-21T23:01:50.456840+0000","last_fullsized":"2024-02-21T23:01:50.456840+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:35:24.590398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.568509+0000","last_change":"2024-02-21T23:01:03.216623+0000","last_active":"2024-02-21T23:01:50.568509+0000","last_peered":"2024-02-21T23:01:50.568509+0000","last_clean":"2024-02-21T23:01:50.568509+0000","last_became_active":"2024-02-21T23:01:03.216345+0000","last_became_peered":"2024-02-21T23:01:03.216345+0000","last_unstale":"2024-02-21T23:01:50.568509+0000","last_undegraded":"2024-02-21T23:01:50.568509+0000","last_fullsized":"2024-02-21T23:01:50.568509+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:10:10.688004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.457666+0000","last_change":"2024-02-21T23:01:03.226262+0000","last_active":"2024-02-21T23:01:50.457666+0000","last_peered":"2024-02-21T23:01:50.457666+0000","last_clean":"2024-02-21T23:01:50.457666+0000","last_became_active":"2024-02-21T23:01:03.225574+0000","last_became_peered":"2024-02-21T23:01:03.225574+0000","last_unstale":"2024-02-21T23:01:50.457666+0000","last_undegraded":"2024-02-21T23:01:50.457666+0000","last_fullsized":"2024-02-21T23:01:50.457666+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:10:10.688004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.457036+0000","last_change":"2024-02-21T23:01:03.225898+0000","last_active":"2024-02-21T23:01:50.457036+0000","last_peered":"2024-02-21T23:01:50.457036+0000","last_clean":"2024-02-21T23:01:50.457036+0000","last_became_active":"2024-02-21T23:01:03.217938+0000","last_became_peered":"2024-02-21T23:01:03.217938+0000","last_unstale":"2024-02-21T23:01:50.457036+0000","last_undegraded":"2024-02-21T23:01:50.457036+0000","last_fullsized":"2024-02-21T23:01:50.457036+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:58:24.562346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8],"acting":[0,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.645608+0000","last_change":"2024-02-21T23:01:03.225830+0000","last_active":"2024-02-21T23:01:50.645608+0000","last_peered":"2024-02-21T23:01:50.645608+0000","last_clean":"2024-02-21T23:01:50.645608+0000","last_became_active":"2024-02-21T23:01:03.225449+0000","last_became_peered":"2024-02-21T23:01:03.225449+0000","last_unstale":"2024-02-21T23:01:50.645608+0000","last_undegraded":"2024-02-21T23:01:50.645608+0000","last_fullsized":"2024-02-21T23:01:50.645608+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:47:19.366266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10],"acting":[6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.456810+0000","last_change":"2024-02-21T23:01:03.208746+0000","last_active":"2024-02-21T23:01:50.456810+0000","last_peered":"2024-02-21T23:01:50.456810+0000","last_clean":"2024-02-21T23:01:50.456810+0000","last_became_active":"2024-02-21T23:01:03.208446+0000","last_became_peered":"2024-02-21T23:01:03.208446+0000","last_unstale":"2024-02-21T23:01:50.456810+0000","last_undegraded":"2024-02-21T23:01:50.456810+0000","last_fullsized":"2024-02-21T23:01:50.456810+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:58:24.562346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.543442+0000","last_change":"2024-02-21T23:01:03.218981+0000","last_active":"2024-02-21T23:01:50.543442+0000","last_peered":"2024-02-21T23:01:50.543442+0000","last_clean":"2024-02-21T23:01:50.543442+0000","last_became_active":"2024-02-21T23:01:03.217925+0000","last_became_peered":"2024-02-21T23:01:03.217925+0000","last_unstale":"2024-02-21T23:01:50.543442+0000","last_undegraded":"2024-02-21T23:01:50.543442+0000","last_fullsized":"2024-02-21T23:01:50.543442+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:54:40.332224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8],"acting":[7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.569907+0000","last_change":"2024-02-21T23:01:03.212233+0000","last_active":"2024-02-21T23:01:50.569907+0000","last_peered":"2024-02-21T23:01:50.569907+0000","last_clean":"2024-02-21T23:01:50.569907+0000","last_became_active":"2024-02-21T23:01:03.211921+0000","last_became_peered":"2024-02-21T23:01:03.211921+0000","last_unstale":"2024-02-21T23:01:50.569907+0000","last_undegraded":"2024-02-21T23:01:50.569907+0000","last_fullsized":"2024-02-21T23:01:50.569907+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:54:32.196725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2],"acting":[10,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.569007+0000","last_change":"2024-02-21T23:01:03.216861+0000","last_active":"2024-02-21T23:01:50.569007+0000","last_peered":"2024-02-21T23:01:50.569007+0000","last_clean":"2024-02-21T23:01:50.569007+0000","last_became_active":"2024-02-21T23:01:03.216580+0000","last_became_peered":"2024-02-21T23:01:03.216580+0000","last_unstale":"2024-02-21T23:01:50.569007+0000","last_undegraded":"2024-02-21T23:01:50.569007+0000","last_fullsized":"2024-02-21T23:01:50.569007+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:35:24.590398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.569807+0000","last_change":"2024-02-21T23:01:03.212164+0000","last_active":"2024-02-21T23:01:50.569807+0000","last_peered":"2024-02-21T23:01:50.569807+0000","last_clean":"2024-02-21T23:01:50.569807+0000","last_became_active":"2024-02-21T23:01:03.211811+0000","last_became_peered":"2024-02-21T23:01:03.211811+0000","last_unstale":"2024-02-21T23:01:50.569807+0000","last_undegraded":"2024-02-21T23:01:50.569807+0000","last_fullsized":"2024-02-21T23:01:50.569807+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:16.946152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.543002+0000","last_change":"2024-02-21T23:01:03.223537+0000","last_active":"2024-02-21T23:01:50.543002+0000","last_peered":"2024-02-21T23:01:50.543002+0000","last_clean":"2024-02-21T23:01:50.543002+0000","last_became_active":"2024-02-21T23:01:03.223255+0000","last_became_peered":"2024-02-21T23:01:03.223255+0000","last_unstale":"2024-02-21T23:01:50.543002+0000","last_undegraded":"2024-02-21T23:01:50.543002+0000","last_fullsized":"2024-02-21T23:01:50.543002+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:19:01.584139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9],"acting":[7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.569406+0000","last_change":"2024-02-21T23:01:03.210441+0000","last_active":"2024-02-21T23:01:50.569406+0000","last_peered":"2024-02-21T23:01:50.569406+0000","last_clean":"2024-02-21T23:01:50.569406+0000","last_became_active":"2024-02-21T23:01:03.209569+0000","last_became_peered":"2024-02-21T23:01:03.209569+0000","last_unstale":"2024-02-21T23:01:50.569406+0000","last_undegraded":"2024-02-21T23:01:50.569406+0000","last_fullsized":"2024-02-21T23:01:50.569406+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:41:55.485351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9],"acting":[10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.459113+0000","last_change":"2024-02-21T23:01:03.214234+0000","last_active":"2024-02-21T23:01:50.459113+0000","last_peered":"2024-02-21T23:01:50.459113+0000","last_clean":"2024-02-21T23:01:50.459113+0000","last_became_active":"2024-02-21T23:01:03.213941+0000","last_became_peered":"2024-02-21T23:01:03.213941+0000","last_unstale":"2024-02-21T23:01:50.459113+0000","last_undegraded":"2024-02-21T23:01:50.459113+0000","last_fullsized":"2024-02-21T23:01:50.459113+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:19:01.584139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3],"acting":[8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.456669+0000","last_change":"2024-02-21T23:01:03.207972+0000","last_active":"2024-02-21T23:01:50.456669+0000","last_peered":"2024-02-21T23:01:50.456669+0000","last_clean":"2024-02-21T23:01:50.456669+0000","last_became_active":"2024-02-21T23:01:03.206762+0000","last_became_peered":"2024-02-21T23:01:03.206762+0000","last_unstale":"2024-02-21T23:01:50.456669+0000","last_undegraded":"2024-02-21T23:01:50.456669+0000","last_fullsized":"2024-02-21T23:01:50.456669+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:27:55.341328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8],"acting":[4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.457409+0000","last_change":"2024-02-21T23:01:03.221959+0000","last_active":"2024-02-21T23:01:50.457409+0000","last_peered":"2024-02-21T23:01:50.457409+0000","last_clean":"2024-02-21T23:01:50.457409+0000","last_became_active":"2024-02-21T23:01:03.221672+0000","last_became_peered":"2024-02-21T23:01:03.221672+0000","last_unstale":"2024-02-21T23:01:50.457409+0000","last_undegraded":"2024-02-21T23:01:50.457409+0000","last_fullsized":"2024-02-21T23:01:50.457409+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:45:29.610700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.457345+0000","last_change":"2024-02-21T23:01:03.219660+0000","last_active":"2024-02-21T23:01:50.457345+0000","last_peered":"2024-02-21T23:01:50.457345+0000","last_clean":"2024-02-21T23:01:50.457345+0000","last_became_active":"2024-02-21T23:01:03.219379+0000","last_became_peered":"2024-02-21T23:01:03.219379+0000","last_unstale":"2024-02-21T23:01:50.457345+0000","last_undegraded":"2024-02-21T23:01:50.457345+0000","last_fullsized":"2024-02-21T23:01:50.457345+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:27:55.341328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11],"acting":[0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-02-21T23:01:50.456858+0000","last_change":"2024-02-21T23:01:03.213287+0000","last_active":"2024-02-21T23:01:50.456858+0000","last_peered":"2024-02-21T23:01:50.456858+0000","last_clean":"2024-02-21T23:01:50.456858+0000","last_became_active":"2024-02-21T23:01:03.212878+0000","last_became_peered":"2024-02-21T23:01:03.212878+0000","last_unstale":"2024-02-21T23:01:50.456858+0000","last_undegraded":"2024-02-21T23:01:50.456858+0000","last_fullsized":"2024-02-21T23:01:50.456858+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:16.946152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70874,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":196,"num_read_kb":173,"num_write":166,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":141748,"data_compressed":3672,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":0,"internal_metadata":0},"log_size":143,"ondisk_log_size":143,"up":64,"acting":64,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66458,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":11,"up_from":17,"seq":73014444048,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":335872,"data_stored":163371,"data_compressed":14087,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":17,"seq":73014444047,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":417792,"data_stored":225790,"data_compressed":15923,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":17,"seq":73014444048,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":344064,"data_stored":167557,"data_compressed":14087,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":17,"seq":73014444047,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":348160,"data_stored":162945,"data_compressed":14087,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":17,"seq":73014444048,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":409600,"data_stored":758423,"data_compressed":47316,"data_compressed_allocated":65536,"data_compressed_original":614400,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":17,"seq":73014444047,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":331776,"data_stored":158783,"data_compressed":14087,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":17,"seq":73014444048,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":755028,"data_compressed":47316,"data_compressed_allocated":65536,"data_compressed_original":614400,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":17,"seq":73014444048,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":339968,"data_stored":163411,"data_compressed":14087,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":17,"seq":73014444048,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":335872,"data_stored":158873,"data_compressed":14087,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444048,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":344064,"data_stored":160326,"data_compressed":14087,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":17,"seq":73014444048,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":401408,"data_stored":225562,"data_compressed":15923,"data_compressed_allocated":24576,"data_compressed_original":49152,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":17,"seq":73014444048,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":348160,"data_stored":159499,"data_compressed":14087,"data_compressed_allocated":20480,"data_compressed_original":40960,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33229,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33229,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":66869,"data_compressed":1836,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":67097,"data_compressed":1836,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-21T23:02:05.354 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T23:02:05.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:05.639+0000 7f5ced000640 1 Processor -- start 2024-02-21T23:02:05.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:05.639+0000 7f5ced000640 1 -- start start 2024-02-21T23:02:05.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:05.642+0000 7f5ced000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5ce8182a80 0x7f5ce818a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:05.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:05.642+0000 7f5ced000640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f5ce818b980 0x7f5ce8186a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:05.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:05.642+0000 7f5ced000640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ce80729c0 con 0x7f5ce81606a0 2024-02-21T23:02:05.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:05.642+0000 7f5ced000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ce818a600 con 0x7f5ce8182a80 2024-02-21T23:02:05.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:05.642+0000 7f5ced000640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ce818a8e0 con 0x7f5ce818b980 2024-02-21T23:02:05.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:05.643+0000 7f5ce7400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5ce8182a80 0x7f5ce818a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:05.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:05.643+0000 7f5ce7400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5ce8182a80 0x7f5ce818a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:40788/0 (socket says 172.21.15.99:40788) 2024-02-21T23:02:05.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:05.643+0000 7f5ce7400640 1 -- 172.21.15.99:0/3824414030 learned_addr learned my addr 172.21.15.99:0/3824414030 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:05.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:05.643+0000 7f5ce6a00640 1 --2- 172.21.15.99:0/3824414030 >> v2:172.21.15.181:3300/0 conn(0x7f5ce818b980 0x7f5ce8186a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:05.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:05.643+0000 7f5ce7400640 1 -- 172.21.15.99:0/3824414030 >> v2:172.21.15.181:3300/0 conn(0x7f5ce818b980 msgr2=0x7f5ce8186a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:05.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:05.643+0000 7f5ce7400640 1 --2- 172.21.15.99:0/3824414030 >> v2:172.21.15.181:3300/0 conn(0x7f5ce818b980 0x7f5ce8186a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:05.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:05.643+0000 7f5ce7400640 1 -- 172.21.15.99:0/3824414030 >> v1:172.21.15.181:6789/0 conn(0x7f5ce81606a0 legacy=0x7f5ce8160b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:05.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:05.643+0000 7f5ce7400640 1 -- 172.21.15.99:0/3824414030 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ce818abc0 con 0x7f5ce8182a80 2024-02-21T23:02:05.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:05.644+0000 7f5ce7400640 1 --2- 172.21.15.99:0/3824414030 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ce8182a80 0x7f5ce818a010 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5ce815afe0 tx=0x7f5cd802b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8a7b28e50dba55b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:05.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:05.644+0000 7f5ce6000640 1 -- 172.21.15.99:0/3824414030 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd8035020 con 0x7f5ce8182a80 2024-02-21T23:02:05.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:05.644+0000 7f5ce6000640 1 -- 172.21.15.99:0/3824414030 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cd8031870 con 0x7f5ce8182a80 2024-02-21T23:02:05.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:05.644+0000 7f5ce6000640 1 -- 172.21.15.99:0/3824414030 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd8031c40 con 0x7f5ce8182a80 2024-02-21T23:02:05.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:05.645+0000 7f5ced000640 1 -- 172.21.15.99:0/3824414030 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ce8182a80 msgr2=0x7f5ce818a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:05.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:05.645+0000 7f5ced000640 1 --2- 172.21.15.99:0/3824414030 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ce8182a80 0x7f5ce818a010 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5ce815afe0 tx=0x7f5cd802b910 comp rx=0 tx=0).stop 2024-02-21T23:02:05.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:05.645+0000 7f5ced000640 1 -- 172.21.15.99:0/3824414030 shutdown_connections 2024-02-21T23:02:05.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:05.645+0000 7f5ced000640 1 --2- 172.21.15.99:0/3824414030 >> v2:172.21.15.181:3300/0 conn(0x7f5ce818b980 0x7f5ce8186a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:05.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:05.645+0000 7f5ced000640 1 --2- 172.21.15.99:0/3824414030 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ce8182a80 0x7f5ce818a010 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:05.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:05.645+0000 7f5ced000640 1 -- 172.21.15.99:0/3824414030 >> 172.21.15.99:0/3824414030 conn(0x7f5ce80d29f0 msgr2=0x7f5ce80d2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:05.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:05.646+0000 7f5ced000640 1 -- 172.21.15.99:0/3824414030 shutdown_connections 2024-02-21T23:02:05.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:05.646+0000 7f5ced000640 1 -- 172.21.15.99:0/3824414030 wait complete. 2024-02-21T23:02:05.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:05.648+0000 7f5ced000640 1 Processor -- start 2024-02-21T23:02:05.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:05.648+0000 7f5ced000640 1 -- start start 2024-02-21T23:02:05.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:05.649+0000 7f5ced000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ce81606a0 0x7f5ce8189370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:05.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:05.649+0000 7f5ced000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5ce8182a80 0x7f5ce817cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:05.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:05.649+0000 7f5ced000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5ce818b980 0x7f5ce8220920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:05.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:05.649+0000 7f5ced000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce818b460 con 0x7f5ce8182a80 2024-02-21T23:02:05.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:05.649+0000 7f5ced000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce818b180 con 0x7f5ce81606a0 2024-02-21T23:02:05.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:05.649+0000 7f5ced000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce818be00 con 0x7f5ce818b980 2024-02-21T23:02:05.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:05.649+0000 7f5ce7400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ce81606a0 0x7f5ce8189370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:05.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:05.649+0000 7f5ce7400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ce81606a0 0x7f5ce8189370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:40792/0 (socket says 172.21.15.99:40792) 2024-02-21T23:02:05.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:05.649+0000 7f5ce7400640 1 -- 172.21.15.99:0/2792830176 learned_addr learned my addr 172.21.15.99:0/2792830176 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:05.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:05.649+0000 7f5ce6a00640 1 --2- 172.21.15.99:0/2792830176 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5ce8182a80 0x7f5ce817cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:05.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:05.650+0000 7f5ce7e00640 1 --2- 172.21.15.99:0/2792830176 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5ce818b980 0x7f5ce8220920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:05.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:05.650+0000 7f5ce7400640 1 -- 172.21.15.99:0/2792830176 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5ce818b980 msgr2=0x7f5ce8220920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:05.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:05.650+0000 7f5ce7400640 1 --2- 172.21.15.99:0/2792830176 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5ce818b980 0x7f5ce8220920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:05.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:05.650+0000 7f5ce7400640 1 -- 172.21.15.99:0/2792830176 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5ce8182a80 msgr2=0x7f5ce817cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:05.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:05.650+0000 7f5ce7400640 1 --2- 172.21.15.99:0/2792830176 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5ce8182a80 0x7f5ce817cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:05.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:05.650+0000 7f5ce7400640 1 -- 172.21.15.99:0/2792830176 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ce81898b0 con 0x7f5ce81606a0 2024-02-21T23:02:05.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:05.650+0000 7f5ce7400640 1 --2- 172.21.15.99:0/2792830176 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ce81606a0 0x7f5ce8189370 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5cd802b950 tx=0x7f5cd80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:05.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:05.650+0000 7f5cdf400640 1 -- 172.21.15.99:0/2792830176 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd8040070 con 0x7f5ce81606a0 2024-02-21T23:02:05.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:05.650+0000 7f5cdf400640 1 -- 172.21.15.99:0/2792830176 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cd8030d00 con 0x7f5ce81606a0 2024-02-21T23:02:05.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:05.650+0000 7f5cdf400640 1 -- 172.21.15.99:0/2792830176 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd8035040 con 0x7f5ce81606a0 2024-02-21T23:02:05.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:05.650+0000 7f5ced000640 1 -- 172.21.15.99:0/2792830176 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ce8220160 con 0x7f5ce81606a0 2024-02-21T23:02:05.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:05.651+0000 7f5ced000640 1 -- 172.21.15.99:0/2792830176 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ce80fa990 con 0x7f5ce81606a0 2024-02-21T23:02:05.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:05.652+0000 7f5ced000640 1 -- 172.21.15.99:0/2792830176 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ce80917e0 con 0x7f5ce81606a0 2024-02-21T23:02:05.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:05.653+0000 7f5cdf400640 1 -- 172.21.15.99:0/2792830176 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 6) v1 ==== 134407+0+0 (secure 0 0 0) 0x7f5cd804b060 con 0x7f5ce81606a0 2024-02-21T23:02:05.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:05.655+0000 7f5cdf400640 1 --2- 172.21.15.99:0/2792830176 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f5cc809edf0 0x7f5cc80a12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:05.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:05.656+0000 7f5cdf400640 1 -- 172.21.15.99:0/2792830176 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f5cd80eba10 con 0x7f5ce81606a0 2024-02-21T23:02:05.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:05.656+0000 7f5ce6a00640 1 --2- 172.21.15.99:0/2792830176 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f5cc809edf0 0x7f5cc80a12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:05.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:05.656+0000 7f5ce6a00640 1 --2- 172.21.15.99:0/2792830176 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f5cc809edf0 0x7f5cc80a12b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5ce8189b10 tx=0x7f5cd4009110 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:05.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:05.658+0000 7f5cdf400640 1 -- 172.21.15.99:0/2792830176 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f5ce81898b0 con 0x7f5ce81606a0 2024-02-21T23:02:05.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.000+0000 7f5ced000640 1 -- 172.21.15.99:0/2792830176 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5ce80fb2d0 con 0x7f5ce81606a0 2024-02-21T23:02:05.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.002+0000 7f5cdf400640 1 -- 172.21.15.99:0/2792830176 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+23759 (secure 0 0 0) 0x7f5cd80b9ba0 con 0x7f5ce81606a0 2024-02-21T23:02:05.991 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T23:02:05.991 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":31,"fsid":"e8af98cd-45a1-425f-96a7-f24da8ee4efb","created":"2024-02-21T23:00:44.699708+0000","modified":"2024-02-21T23:01:50.451929+0000","last_up_change":"2024-02-21T23:00:55.749829+0000","last_in_change":"2024-02-21T23:00:48.332297+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T23:00:57.020557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":11.760000228881836,"score_stable":11.760000228881836,"optimal_score":0.17000000178813934,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-21T23:01:01.124398+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-21T23:01:01.684258+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-21T23:01:05.290089+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c49de9b2-dc53-4882-b14c-7059ed40bf59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6809","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6811","nonce":1026112937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6813","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6815","nonce":1026112937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6823","nonce":1026112937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6819","nonce":1026112937}]},"public_addr":"172.21.15.99:6811/1026112937","cluster_addr":"172.21.15.99:6815/1026112937","heartbeat_back_addr":"172.21.15.99:6823/1026112937","heartbeat_front_addr":"172.21.15.99:6819/1026112937","state":["exists","up"]},{"osd":1,"uuid":"58398292-2fe5-4291-94fd-03a0ca29d49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6827","nonce":3030871566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6829","nonce":3030871566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6833","nonce":3030871566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6831","nonce":3030871566}]},"public_addr":"172.21.15.162:6827/3030871566","cluster_addr":"172.21.15.162:6829/3030871566","heartbeat_back_addr":"172.21.15.162:6833/3030871566","heartbeat_front_addr":"172.21.15.162:6831/3030871566","state":["exists","up"]},{"osd":2,"uuid":"94cddec1-e08f-438d-a7c8-48a0e47d71a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6818","nonce":2782386148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6821","nonce":2782386148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6827","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6829","nonce":2782386148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6823","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6825","nonce":2782386148}]},"public_addr":"172.21.15.181:6818/2782386148","cluster_addr":"172.21.15.181:6821/2782386148","heartbeat_back_addr":"172.21.15.181:6829/2782386148","heartbeat_front_addr":"172.21.15.181:6825/2782386148","state":["exists","up"]},{"osd":3,"uuid":"d29abb74-9b89-4fd7-88b1-7c2eb8231189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6801","nonce":2316185310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6803","nonce":2316185310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6807","nonce":2316185310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6805","nonce":2316185310}]},"public_addr":"172.21.15.99:6801/2316185310","cluster_addr":"172.21.15.99:6803/2316185310","heartbeat_back_addr":"172.21.15.99:6807/2316185310","heartbeat_front_addr":"172.21.15.99:6805/2316185310","state":["exists","up"]},{"osd":4,"uuid":"0d8c9ea3-880a-4d69-9dcb-cf7d35abd449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6811","nonce":3137681258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6813","nonce":3137681258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6817","nonce":3137681258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6815","nonce":3137681258}]},"public_addr":"172.21.15.162:6811/3137681258","cluster_addr":"172.21.15.162:6813/3137681258","heartbeat_back_addr":"172.21.15.162:6817/3137681258","heartbeat_front_addr":"172.21.15.162:6815/3137681258","state":["exists","up"]},{"osd":5,"uuid":"2e3a9340-6fd0-4d7a-8e00-fe305649296e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6801","nonce":2011264527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6803","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6805","nonce":2011264527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6811","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6813","nonce":2011264527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6807","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6809","nonce":2011264527}]},"public_addr":"172.21.15.181:6801/2011264527","cluster_addr":"172.21.15.181:6805/2011264527","heartbeat_back_addr":"172.21.15.181:6813/2011264527","heartbeat_front_addr":"172.21.15.181:6809/2011264527","state":["exists","up"]},{"osd":6,"uuid":"d9e37ce7-1b0e-4019-8f2e-b670403abf7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6810","nonce":753870050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6814","nonce":753870050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6822","nonce":753870050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6818","nonce":753870050}]},"public_addr":"172.21.15.99:6810/753870050","cluster_addr":"172.21.15.99:6814/753870050","heartbeat_back_addr":"172.21.15.99:6822/753870050","heartbeat_front_addr":"172.21.15.99:6818/753870050","state":["exists","up"]},{"osd":7,"uuid":"49988754-232e-4b8c-bd72-bfa25b418e5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6803","nonce":1659412949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6805","nonce":1659412949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6809","nonce":1659412949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6807","nonce":1659412949}]},"public_addr":"172.21.15.162:6803/1659412949","cluster_addr":"172.21.15.162:6805/1659412949","heartbeat_back_addr":"172.21.15.162:6809/1659412949","heartbeat_front_addr":"172.21.15.162:6807/1659412949","state":["exists","up"]},{"osd":8,"uuid":"ebc6e462-8368-4d64-b242-9c8735ac672c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6804","nonce":3389807042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6808","nonce":3389807042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6815","nonce":3389807042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6812","nonce":3389807042}]},"public_addr":"172.21.15.181:6804/3389807042","cluster_addr":"172.21.15.181:6808/3389807042","heartbeat_back_addr":"172.21.15.181:6815/3389807042","heartbeat_front_addr":"172.21.15.181:6812/3389807042","state":["exists","up"]},{"osd":9,"uuid":"72af1b02-b965-4d6a-8964-527ec24c4daa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6825","nonce":4055669590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6827","nonce":4055669590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6831","nonce":4055669590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6829","nonce":4055669590}]},"public_addr":"172.21.15.99:6825/4055669590","cluster_addr":"172.21.15.99:6827/4055669590","heartbeat_back_addr":"172.21.15.99:6831/4055669590","heartbeat_front_addr":"172.21.15.99:6829/4055669590","state":["exists","up"]},{"osd":10,"uuid":"adb5cb06-6453-41e4-b847-d7c78bbb7d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6819","nonce":1421879617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6821","nonce":1421879617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6825","nonce":1421879617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6823","nonce":1421879617}]},"public_addr":"172.21.15.162:6819/1421879617","cluster_addr":"172.21.15.162:6821/1421879617","heartbeat_back_addr":"172.21.15.162:6825/1421879617","heartbeat_front_addr":"172.21.15.162:6823/1421879617","state":["exists","up"]},{"osd":11,"uuid":"118563d9-1e8f-4dc7-a92c-2f4c4dc3e20f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6817","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6819","nonce":3219928272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6824","nonce":3219928272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6831","nonce":3219928272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6828","nonce":3219928272}]},"public_addr":"172.21.15.181:6819/3219928272","cluster_addr":"172.21.15.181:6824/3219928272","heartbeat_back_addr":"172.21.15.181:6831/3219928272","heartbeat_front_addr":"172.21.15.181:6828/3219928272","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.651219+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.549859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.529659+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.591004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.440836+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.414250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.630130+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.411954+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.439371+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.428173+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.511203+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.482806+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.6","mappings":[{"from":9,"to":11}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.14","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T23:02:05.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.005+0000 7f5ced000640 1 -- 172.21.15.99:0/2792830176 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f5cc809edf0 msgr2=0x7f5cc80a12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:05.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.005+0000 7f5ced000640 1 --2- 172.21.15.99:0/2792830176 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f5cc809edf0 0x7f5cc80a12b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5ce8189b10 tx=0x7f5cd4009110 comp rx=0 tx=0).stop 2024-02-21T23:02:05.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.005+0000 7f5ced000640 1 -- 172.21.15.99:0/2792830176 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ce81606a0 msgr2=0x7f5ce8189370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:05.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.005+0000 7f5ced000640 1 --2- 172.21.15.99:0/2792830176 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ce81606a0 0x7f5ce8189370 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5cd802b950 tx=0x7f5cd80046c0 comp rx=0 tx=0).stop 2024-02-21T23:02:05.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.005+0000 7f5ced000640 1 -- 172.21.15.99:0/2792830176 shutdown_connections 2024-02-21T23:02:05.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.005+0000 7f5ced000640 1 --2- 172.21.15.99:0/2792830176 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f5cc809edf0 0x7f5cc80a12b0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:05.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.005+0000 7f5ced000640 1 --2- 172.21.15.99:0/2792830176 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5ce818b980 0x7f5ce8220920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:05.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.005+0000 7f5ced000640 1 --2- 172.21.15.99:0/2792830176 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5ce8182a80 0x7f5ce817cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:05.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.005+0000 7f5ced000640 1 --2- 172.21.15.99:0/2792830176 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ce81606a0 0x7f5ce8189370 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:05.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.005+0000 7f5ced000640 1 -- 172.21.15.99:0/2792830176 >> 172.21.15.99:0/2792830176 conn(0x7f5ce80d29f0 msgr2=0x7f5ce80d2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:05.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.005+0000 7f5ced000640 1 -- 172.21.15.99:0/2792830176 shutdown_connections 2024-02-21T23:02:05.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.006+0000 7f5ced000640 1 -- 172.21.15.99:0/2792830176 wait complete. 2024-02-21T23:02:06.013 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-21T23:00:57.020557+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 11.760000228881836, 'score_stable': 11.760000228881836, 'optimal_score': 0.17000000178813934, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-21T23:01:01.124398+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-21T23:01:01.684258+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-02-21T23:01:05.290089+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-02-21T23:02:06.014 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-21T23:02:06.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.247+0000 7fdd6b000640 1 Processor -- start 2024-02-21T23:02:06.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.247+0000 7fdd6b000640 1 -- start start 2024-02-21T23:02:06.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.250+0000 7fdd6b000640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fdd641867e0 0x7fdd641881e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:06.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.250+0000 7fdd6b000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd64188720 con 0x7fdd640d4320 2024-02-21T23:02:06.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.250+0000 7fdd6b000640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd640cf820 con 0x7fdd64186400 2024-02-21T23:02:06.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.250+0000 7fdd6b000640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd64187640 con 0x7fdd641867e0 2024-02-21T23:02:06.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.251+0000 7fdd63400640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fdd641867e0 0x7fdd641881e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:06.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.251+0000 7fdd63e00640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fdd64186400 0x7fdd64187ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:47078/0 (socket says 172.21.15.99:47078) 2024-02-21T23:02:06.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.251+0000 7fdd63e00640 1 -- 172.21.15.99:0/4025773090 learned_addr learned my addr 172.21.15.99:0/4025773090 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:02:06.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.251+0000 7fdd63400640 1 -- 172.21.15.99:0/4025773090 >> v1:172.21.15.181:6789/0 conn(0x7fdd64186400 legacy=0x7fdd64187ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:06.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.251+0000 7fdd63400640 1 -- 172.21.15.99:0/4025773090 >> v1:172.21.15.162:6789/0 conn(0x7fdd640d4320 legacy=0x7fdd640d4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:06.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.251+0000 7fdd63400640 1 -- 172.21.15.99:0/4025773090 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd640cfb00 con 0x7fdd641867e0 2024-02-21T23:02:06.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.253+0000 7fdd63400640 1 --2- 172.21.15.99:0/4025773090 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdd641867e0 0x7fdd641881e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fdd500097a0 tx=0x7fdd5002b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=98703616fc1fcf8e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:06.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.253+0000 7fdd62a00640 1 -- 172.21.15.99:0/4025773090 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd500315a0 con 0x7fdd641867e0 2024-02-21T23:02:06.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.253+0000 7fdd62a00640 1 -- 172.21.15.99:0/4025773090 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd50037070 con 0x7fdd641867e0 2024-02-21T23:02:06.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.253+0000 7fdd62a00640 1 -- 172.21.15.99:0/4025773090 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd50031960 con 0x7fdd641867e0 2024-02-21T23:02:06.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.254+0000 7fdd6b000640 1 -- 172.21.15.99:0/4025773090 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdd641867e0 msgr2=0x7fdd641881e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:06.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.254+0000 7fdd6b000640 1 --2- 172.21.15.99:0/4025773090 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdd641867e0 0x7fdd641881e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fdd500097a0 tx=0x7fdd5002b840 comp rx=0 tx=0).stop 2024-02-21T23:02:06.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.254+0000 7fdd6b000640 1 -- 172.21.15.99:0/4025773090 shutdown_connections 2024-02-21T23:02:06.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.254+0000 7fdd6b000640 1 --2- 172.21.15.99:0/4025773090 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdd641867e0 0x7fdd641881e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:06.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.254+0000 7fdd6b000640 1 -- 172.21.15.99:0/4025773090 >> 172.21.15.99:0/4025773090 conn(0x7fdd640d6af0 msgr2=0x7fdd640740b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:06.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.254+0000 7fdd6b000640 1 -- 172.21.15.99:0/4025773090 shutdown_connections 2024-02-21T23:02:06.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.254+0000 7fdd6b000640 1 -- 172.21.15.99:0/4025773090 wait complete. 2024-02-21T23:02:06.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.257+0000 7fdd6b000640 1 Processor -- start 2024-02-21T23:02:06.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.257+0000 7fdd6b000640 1 -- start start 2024-02-21T23:02:06.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.259+0000 7fdd6b000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdd640d4320 0x7fdd6416ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:06.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.259+0000 7fdd6b000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdd64186400 0x7fdd640d2250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:06.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.259+0000 7fdd6b000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdd641867e0 0x7fdd640d2790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:06.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.259+0000 7fdd6b000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd641872d0 con 0x7fdd640d4320 2024-02-21T23:02:06.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.259+0000 7fdd6b000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd64186ff0 con 0x7fdd64186400 2024-02-21T23:02:06.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.259+0000 7fdd6b000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd640ceeb0 con 0x7fdd641867e0 2024-02-21T23:02:06.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.259+0000 7fdd63e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdd640d4320 0x7fdd6416ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:06.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.259+0000 7fdd63e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdd640d4320 0x7fdd6416ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50296/0 (socket says 172.21.15.99:50296) 2024-02-21T23:02:06.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.259+0000 7fdd63e00640 1 -- 172.21.15.99:0/1570075145 learned_addr learned my addr 172.21.15.99:0/1570075145 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:06.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.259+0000 7fdd63400640 1 --2- 172.21.15.99:0/1570075145 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdd64186400 0x7fdd640d2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:06.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.259+0000 7fdd69000640 1 --2- 172.21.15.99:0/1570075145 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdd641867e0 0x7fdd640d2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:06.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.260+0000 7fdd63e00640 1 -- 172.21.15.99:0/1570075145 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdd641867e0 msgr2=0x7fdd640d2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:06.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.260+0000 7fdd63e00640 1 --2- 172.21.15.99:0/1570075145 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdd641867e0 0x7fdd640d2790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:06.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.260+0000 7fdd63e00640 1 -- 172.21.15.99:0/1570075145 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdd64186400 msgr2=0x7fdd640d2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:06.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.260+0000 7fdd63e00640 1 --2- 172.21.15.99:0/1570075145 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdd64186400 0x7fdd640d2250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:06.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.260+0000 7fdd63e00640 1 -- 172.21.15.99:0/1570075145 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd6408f500 con 0x7fdd640d4320 2024-02-21T23:02:06.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.260+0000 7fdd63e00640 1 --2- 172.21.15.99:0/1570075145 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdd640d4320 0x7fdd6416ae60 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fdd5400c4d0 tx=0x7fdd5400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:06.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.260+0000 7fdd5be00640 1 -- 172.21.15.99:0/1570075145 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd54017070 con 0x7fdd640d4320 2024-02-21T23:02:06.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.261+0000 7fdd5be00640 1 -- 172.21.15.99:0/1570075145 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd54005ce0 con 0x7fdd640d4320 2024-02-21T23:02:06.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.261+0000 7fdd6b000640 1 -- 172.21.15.99:0/1570075145 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd640d1490 con 0x7fdd640d4320 2024-02-21T23:02:06.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.261+0000 7fdd5be00640 1 -- 172.21.15.99:0/1570075145 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd54007270 con 0x7fdd640d4320 2024-02-21T23:02:06.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.261+0000 7fdd6b000640 1 -- 172.21.15.99:0/1570075145 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd640d1a50 con 0x7fdd640d4320 2024-02-21T23:02:06.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.262+0000 7fdd6b000640 1 -- 172.21.15.99:0/1570075145 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd64068780 con 0x7fdd640d4320 2024-02-21T23:02:06.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.264+0000 7fdd5be00640 1 -- 172.21.15.99:0/1570075145 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 6) v1 ==== 134407+0+0 (secure 0 0 0) 0x7fdd5401a070 con 0x7fdd640d4320 2024-02-21T23:02:06.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.266+0000 7fdd5be00640 1 --2- 172.21.15.99:0/1570075145 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fdd4409edf0 0x7fdd440a12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:06.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.266+0000 7fdd5be00640 1 -- 172.21.15.99:0/1570075145 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fdd540c8e40 con 0x7fdd640d4320 2024-02-21T23:02:06.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.266+0000 7fdd63400640 1 --2- 172.21.15.99:0/1570075145 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fdd4409edf0 0x7fdd440a12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:06.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.267+0000 7fdd63400640 1 --2- 172.21.15.99:0/1570075145 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fdd4409edf0 0x7fdd440a12b0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fdd50036000 tx=0x7fdd5003d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:06.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.272+0000 7fdd5be00640 1 -- 172.21.15.99:0/1570075145 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fdd54096980 con 0x7fdd640d4320 2024-02-21T23:02:06.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.498+0000 7fdd6b000640 1 -- 172.21.15.99:0/1570075145 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdd640d5690 con 0x7fdd640d4320 2024-02-21T23:02:06.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.499+0000 7fdd5be00640 1 -- 172.21.15.99:0/1570075145 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdd5409aa20 con 0x7fdd640d4320 2024-02-21T23:02:06.489 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 1 2024-02-21T23:02:06.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.502+0000 7fdd6b000640 1 -- 172.21.15.99:0/1570075145 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fdd4409edf0 msgr2=0x7fdd440a12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:06.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.502+0000 7fdd6b000640 1 --2- 172.21.15.99:0/1570075145 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fdd4409edf0 0x7fdd440a12b0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fdd50036000 tx=0x7fdd5003d040 comp rx=0 tx=0).stop 2024-02-21T23:02:06.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.502+0000 7fdd6b000640 1 -- 172.21.15.99:0/1570075145 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdd640d4320 msgr2=0x7fdd6416ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:06.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.502+0000 7fdd6b000640 1 --2- 172.21.15.99:0/1570075145 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdd640d4320 0x7fdd6416ae60 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fdd5400c4d0 tx=0x7fdd5400c990 comp rx=0 tx=0).stop 2024-02-21T23:02:06.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.502+0000 7fdd6b000640 1 -- 172.21.15.99:0/1570075145 shutdown_connections 2024-02-21T23:02:06.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.502+0000 7fdd6b000640 1 --2- 172.21.15.99:0/1570075145 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fdd4409edf0 0x7fdd440a12b0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:06.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.502+0000 7fdd6b000640 1 --2- 172.21.15.99:0/1570075145 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdd641867e0 0x7fdd640d2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:06.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.502+0000 7fdd6b000640 1 --2- 172.21.15.99:0/1570075145 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdd64186400 0x7fdd640d2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:06.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.502+0000 7fdd6b000640 1 --2- 172.21.15.99:0/1570075145 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdd640d4320 0x7fdd6416ae60 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:06.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.502+0000 7fdd6b000640 1 -- 172.21.15.99:0/1570075145 >> 172.21.15.99:0/1570075145 conn(0x7fdd640d6af0 msgr2=0x7fdd64068f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:06.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.502+0000 7fdd6b000640 1 -- 172.21.15.99:0/1570075145 shutdown_connections 2024-02-21T23:02:06.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.503+0000 7fdd6b000640 1 -- 172.21.15.99:0/1570075145 wait complete. 2024-02-21T23:02:06.518 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-21T23:02:06.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.727+0000 7f541be00640 1 Processor -- start 2024-02-21T23:02:06.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.727+0000 7f541be00640 1 -- start start 2024-02-21T23:02:06.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.729+0000 7f541be00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f541c1867e0 0x7f541c186c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:06.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.729+0000 7f541be00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f541c0f5330 con 0x7f541c180960 2024-02-21T23:02:06.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.729+0000 7f541be00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f541c0f5610 con 0x7f541c0eed70 2024-02-21T23:02:06.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.729+0000 7f541be00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f541c0f58f0 con 0x7f541c1867e0 2024-02-21T23:02:06.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.729+0000 7f541b400640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f541c1867e0 0x7f541c186c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:06.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.729+0000 7f5412000640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f541c0eed70 0x7f541c0ef1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:47092/0 (socket says 172.21.15.99:47092) 2024-02-21T23:02:06.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.729+0000 7f5412000640 1 -- 172.21.15.99:0/2163250858 learned_addr learned my addr 172.21.15.99:0/2163250858 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:02:06.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.729+0000 7f541aa00640 1 --1- 172.21.15.99:0/2163250858 >> v1:172.21.15.162:6789/0 conn(0x7f541c180960 0x7f541c0f48f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.99:58898/0 (socket says 172.21.15.99:58898) 2024-02-21T23:02:06.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.730+0000 7f541b400640 1 -- 172.21.15.99:0/2163250858 >> v1:172.21.15.181:6789/0 conn(0x7f541c0eed70 legacy=0x7f541c0ef1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:06.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.730+0000 7f541b400640 1 -- 172.21.15.99:0/2163250858 >> v1:172.21.15.162:6789/0 conn(0x7f541c180960 legacy=0x7f541c0f48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:06.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.730+0000 7f541a000640 1 -- 172.21.15.99:0/2163250858 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3708979256 0 0) 0x7f541c0f5330 con 0x7f541c180960 2024-02-21T23:02:06.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.730+0000 7f541b400640 1 -- 172.21.15.99:0/2163250858 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f541c0f5bd0 con 0x7f541c1867e0 2024-02-21T23:02:06.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.731+0000 7f541b400640 1 --2- 172.21.15.99:0/2163250858 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f541c1867e0 0x7f541c186c30 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f54140097a0 tx=0x7f541402b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73068f2d9b2b69e2 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:06.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.731+0000 7f541a000640 1 -- 172.21.15.99:0/2163250858 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54140315a0 con 0x7f541c1867e0 2024-02-21T23:02:06.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.731+0000 7f541a000640 1 -- 172.21.15.99:0/2163250858 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5414037070 con 0x7f541c1867e0 2024-02-21T23:02:06.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.731+0000 7f541a000640 1 -- 172.21.15.99:0/2163250858 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5414031960 con 0x7f541c1867e0 2024-02-21T23:02:06.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.732+0000 7f541be00640 1 -- 172.21.15.99:0/2163250858 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f541c1867e0 msgr2=0x7f541c186c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:06.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.732+0000 7f541be00640 1 --2- 172.21.15.99:0/2163250858 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f541c1867e0 0x7f541c186c30 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f54140097a0 tx=0x7f541402b840 comp rx=0 tx=0).stop 2024-02-21T23:02:06.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.732+0000 7f541be00640 1 -- 172.21.15.99:0/2163250858 shutdown_connections 2024-02-21T23:02:06.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.732+0000 7f541be00640 1 --2- 172.21.15.99:0/2163250858 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f541c1867e0 0x7f541c186c30 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:06.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.732+0000 7f541be00640 1 -- 172.21.15.99:0/2163250858 >> 172.21.15.99:0/2163250858 conn(0x7f541c0ce440 msgr2=0x7f541c0ce850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:06.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.732+0000 7f541be00640 1 -- 172.21.15.99:0/2163250858 shutdown_connections 2024-02-21T23:02:06.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.732+0000 7f541be00640 1 -- 172.21.15.99:0/2163250858 wait complete. 2024-02-21T23:02:06.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.734+0000 7f541be00640 1 Processor -- start 2024-02-21T23:02:06.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.734+0000 7f541be00640 1 -- start start 2024-02-21T23:02:06.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.735+0000 7f541be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f541c0eed70 0x7f541c1855d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:06.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.735+0000 7f541be00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f541c180960 0x7f541c1734b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:06.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.735+0000 7f541be00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f541c1867e0 0x7f541c175600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:06.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.735+0000 7f541be00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f541c0f5000 con 0x7f541c0eed70 2024-02-21T23:02:06.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.736+0000 7f541be00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f541c0ee850 con 0x7f541c1867e0 2024-02-21T23:02:06.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.736+0000 7f541be00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f541c0ef900 con 0x7f541c180960 2024-02-21T23:02:06.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.736+0000 7f541aa00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f541c0eed70 0x7f541c1855d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:06.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.736+0000 7f5412000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f541c180960 0x7f541c1734b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:06.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.736+0000 7f541aa00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f541c0eed70 0x7f541c1855d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:50302/0 (socket says 172.21.15.99:50302) 2024-02-21T23:02:06.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.736+0000 7f541aa00640 1 -- 172.21.15.99:0/507049955 learned_addr learned my addr 172.21.15.99:0/507049955 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:06.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.736+0000 7f541b400640 1 --2- 172.21.15.99:0/507049955 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f541c1867e0 0x7f541c175600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:06.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.736+0000 7f541aa00640 1 -- 172.21.15.99:0/507049955 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f541c180960 msgr2=0x7f541c1734b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:06.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.736+0000 7f541aa00640 1 --2- 172.21.15.99:0/507049955 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f541c180960 0x7f541c1734b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:06.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.736+0000 7f541aa00640 1 -- 172.21.15.99:0/507049955 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f541c1867e0 msgr2=0x7f541c175600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:06.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.736+0000 7f541aa00640 1 --2- 172.21.15.99:0/507049955 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f541c1867e0 0x7f541c175600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:06.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.736+0000 7f541aa00640 1 -- 172.21.15.99:0/507049955 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f541c1865b0 con 0x7f541c0eed70 2024-02-21T23:02:06.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.736+0000 7f5412000640 1 --2- 172.21.15.99:0/507049955 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f541c180960 0x7f541c1734b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:02:06.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.737+0000 7f541aa00640 1 --2- 172.21.15.99:0/507049955 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f541c0eed70 0x7f541c1855d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f540c00c760 tx=0x7f540c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:06.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.737+0000 7f5413400640 1 -- 172.21.15.99:0/507049955 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f540c018070 con 0x7f541c0eed70 2024-02-21T23:02:06.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.737+0000 7f5413400640 1 -- 172.21.15.99:0/507049955 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f540c00a640 con 0x7f541c0eed70 2024-02-21T23:02:06.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.737+0000 7f541be00640 1 -- 172.21.15.99:0/507049955 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f541c185d10 con 0x7f541c0eed70 2024-02-21T23:02:06.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.737+0000 7f5413400640 1 -- 172.21.15.99:0/507049955 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f540c00aa30 con 0x7f541c0eed70 2024-02-21T23:02:06.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.737+0000 7f541be00640 1 -- 172.21.15.99:0/507049955 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f541c1862d0 con 0x7f541c0eed70 2024-02-21T23:02:06.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.738+0000 7f541be00640 1 -- 172.21.15.99:0/507049955 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f541c1804a0 con 0x7f541c0eed70 2024-02-21T23:02:06.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.742+0000 7f5413400640 1 -- 172.21.15.99:0/507049955 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 6) v1 ==== 134407+0+0 (secure 0 0 0) 0x7f540c01b070 con 0x7f541c0eed70 2024-02-21T23:02:06.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.745+0000 7f5413400640 1 --2- 172.21.15.99:0/507049955 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f53f809edf0 0x7f53f80a12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:06.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.745+0000 7f5413400640 1 -- 172.21.15.99:0/507049955 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f540c0c9420 con 0x7f541c0eed70 2024-02-21T23:02:06.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.745+0000 7f5412000640 1 --2- 172.21.15.99:0/507049955 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f53f809edf0 0x7f53f80a12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:06.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.745+0000 7f5413400640 1 -- 172.21.15.99:0/507049955 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f540c0c98a0 con 0x7f541c0eed70 2024-02-21T23:02:06.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:06.746+0000 7f5412000640 1 --2- 172.21.15.99:0/507049955 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f53f809edf0 0x7f53f80a12b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f541c1772e0 tx=0x7f5404009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:07.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.050+0000 7f541be00640 1 -- 172.21.15.99:0/507049955 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f541c068320 con 0x7f541c0eed70 2024-02-21T23:02:07.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.051+0000 7f5413400640 1 -- 172.21.15.99:0/507049955 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7f540c096f60 con 0x7f541c0eed70 2024-02-21T23:02:07.040 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 32 2024-02-21T23:02:07.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.053+0000 7f541be00640 1 -- 172.21.15.99:0/507049955 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f53f809edf0 msgr2=0x7f53f80a12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:07.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.053+0000 7f541be00640 1 --2- 172.21.15.99:0/507049955 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f53f809edf0 0x7f53f80a12b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f541c1772e0 tx=0x7f5404009040 comp rx=0 tx=0).stop 2024-02-21T23:02:07.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.053+0000 7f541be00640 1 -- 172.21.15.99:0/507049955 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f541c0eed70 msgr2=0x7f541c1855d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:07.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.053+0000 7f541be00640 1 --2- 172.21.15.99:0/507049955 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f541c0eed70 0x7f541c1855d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f540c00c760 tx=0x7f540c00cc20 comp rx=0 tx=0).stop 2024-02-21T23:02:07.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.053+0000 7f541be00640 1 -- 172.21.15.99:0/507049955 shutdown_connections 2024-02-21T23:02:07.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.053+0000 7f541be00640 1 --2- 172.21.15.99:0/507049955 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f53f809edf0 0x7f53f80a12b0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:07.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.053+0000 7f541be00640 1 --2- 172.21.15.99:0/507049955 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f541c1867e0 0x7f541c175600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:07.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.053+0000 7f541be00640 1 --2- 172.21.15.99:0/507049955 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f541c180960 0x7f541c1734b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:07.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.053+0000 7f541be00640 1 --2- 172.21.15.99:0/507049955 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f541c0eed70 0x7f541c1855d0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:07.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.053+0000 7f541be00640 1 -- 172.21.15.99:0/507049955 >> 172.21.15.99:0/507049955 conn(0x7f541c0ce440 msgr2=0x7f541c17aab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:07.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.054+0000 7f541be00640 1 -- 172.21.15.99:0/507049955 shutdown_connections 2024-02-21T23:02:07.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.054+0000 7f541be00640 1 -- 172.21.15.99:0/507049955 wait complete. 2024-02-21T23:02:07.064 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-21T23:02:07.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.287+0000 7fee7ee00640 1 Processor -- start 2024-02-21T23:02:07.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.288+0000 7fee7ee00640 1 -- start start 2024-02-21T23:02:07.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.289+0000 7fee7ee00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fee78182dd0 0x7fee780ef580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:07.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.289+0000 7fee7ee00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fee7818c3e0 0x7fee7818c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:07.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.289+0000 7fee7ee00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee780f6e60 con 0x7fee7818a2e0 2024-02-21T23:02:07.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.289+0000 7fee7ee00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee780f7d50 con 0x7fee7818c3e0 2024-02-21T23:02:07.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.289+0000 7fee7ee00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee780f7140 con 0x7fee78182dd0 2024-02-21T23:02:07.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.289+0000 7fee7ce00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fee7818c3e0 0x7fee7818c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:07.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.289+0000 7fee77e00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fee78182dd0 0x7fee780ef580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:07.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.290+0000 7fee7ce00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fee7818c3e0 0x7fee7818c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60244/0 (socket says 172.21.15.99:60244) 2024-02-21T23:02:07.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.290+0000 7fee7ce00640 1 -- 172.21.15.99:0/1825428524 learned_addr learned my addr 172.21.15.99:0/1825428524 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:07.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.290+0000 7fee6fe00640 1 --1- 172.21.15.99:0/1825428524 >> v1:172.21.15.181:6789/0 conn(0x7fee7818a2e0 0x7fee780f81e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:40710/0 (socket says 172.21.15.99:40710) 2024-02-21T23:02:07.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.290+0000 7fee7ce00640 1 -- 172.21.15.99:0/1825428524 >> v2:172.21.15.181:3300/0 conn(0x7fee78182dd0 msgr2=0x7fee780ef580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:07.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.290+0000 7fee7ce00640 1 --2- 172.21.15.99:0/1825428524 >> v2:172.21.15.181:3300/0 conn(0x7fee78182dd0 0x7fee780ef580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:07.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.290+0000 7fee7ce00640 1 -- 172.21.15.99:0/1825428524 >> v1:172.21.15.181:6789/0 conn(0x7fee7818a2e0 legacy=0x7fee780f81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:07.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.290+0000 7fee7ce00640 1 -- 172.21.15.99:0/1825428524 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee780f7420 con 0x7fee7818c3e0 2024-02-21T23:02:07.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.291+0000 7fee7ce00640 1 --2- 172.21.15.99:0/1825428524 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fee7818c3e0 0x7fee7818c830 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fee780904c0 tx=0x7fee7002be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70839bbbdebdf400 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:07.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.291+0000 7fee77400640 1 -- 172.21.15.99:0/1825428524 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee7002c9f0 con 0x7fee7818c3e0 2024-02-21T23:02:07.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.291+0000 7fee77400640 1 -- 172.21.15.99:0/1825428524 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee7002cb90 con 0x7fee7818c3e0 2024-02-21T23:02:07.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.292+0000 7fee77400640 1 -- 172.21.15.99:0/1825428524 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee700343f0 con 0x7fee7818c3e0 2024-02-21T23:02:07.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.292+0000 7fee7ee00640 1 -- 172.21.15.99:0/1825428524 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fee7818c3e0 msgr2=0x7fee7818c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:07.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.292+0000 7fee7ee00640 1 --2- 172.21.15.99:0/1825428524 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fee7818c3e0 0x7fee7818c830 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fee780904c0 tx=0x7fee7002be50 comp rx=0 tx=0).stop 2024-02-21T23:02:07.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.292+0000 7fee7ee00640 1 -- 172.21.15.99:0/1825428524 shutdown_connections 2024-02-21T23:02:07.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.292+0000 7fee7ee00640 1 --2- 172.21.15.99:0/1825428524 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fee7818c3e0 0x7fee7818c830 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:07.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.292+0000 7fee7ee00640 1 --2- 172.21.15.99:0/1825428524 >> v2:172.21.15.181:3300/0 conn(0x7fee78182dd0 0x7fee780ef580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:07.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.292+0000 7fee7ee00640 1 -- 172.21.15.99:0/1825428524 >> 172.21.15.99:0/1825428524 conn(0x7fee780f8e30 msgr2=0x7fee780f9240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:07.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.292+0000 7fee7ee00640 1 -- 172.21.15.99:0/1825428524 shutdown_connections 2024-02-21T23:02:07.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.292+0000 7fee7ee00640 1 -- 172.21.15.99:0/1825428524 wait complete. 2024-02-21T23:02:07.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.294+0000 7fee7ee00640 1 Processor -- start 2024-02-21T23:02:07.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.295+0000 7fee7ee00640 1 -- start start 2024-02-21T23:02:07.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.296+0000 7fee7ee00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee78182dd0 0x7fee781713d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:07.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.296+0000 7fee7ee00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fee7818a2e0 0x7fee780f5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:07.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.296+0000 7fee7ee00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fee7818c3e0 0x7fee78221820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:07.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.296+0000 7fee7ee00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee781831b0 con 0x7fee7818a2e0 2024-02-21T23:02:07.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.296+0000 7fee7ee00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee780f79e0 con 0x7fee78182dd0 2024-02-21T23:02:07.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.296+0000 7fee7ee00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee78183330 con 0x7fee7818c3e0 2024-02-21T23:02:07.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.296+0000 7fee6fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fee7818a2e0 0x7fee780f5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:07.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.296+0000 7fee77e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee78182dd0 0x7fee781713d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:07.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.296+0000 7fee77e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee78182dd0 0x7fee781713d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:59806/0 (socket says 172.21.15.99:59806) 2024-02-21T23:02:07.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.296+0000 7fee77e00640 1 -- 172.21.15.99:0/1789594940 learned_addr learned my addr 172.21.15.99:0/1789594940 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:07.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.296+0000 7fee7ce00640 1 --2- 172.21.15.99:0/1789594940 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fee7818c3e0 0x7fee78221820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:07.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.297+0000 7fee6fe00640 1 -- 172.21.15.99:0/1789594940 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fee7818c3e0 msgr2=0x7fee78221820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:07.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.297+0000 7fee6fe00640 1 --2- 172.21.15.99:0/1789594940 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fee7818c3e0 0x7fee78221820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:07.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.297+0000 7fee6fe00640 1 -- 172.21.15.99:0/1789594940 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee78182dd0 msgr2=0x7fee781713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:07.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.297+0000 7fee6fe00640 1 --2- 172.21.15.99:0/1789594940 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee78182dd0 0x7fee781713d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:07.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.297+0000 7fee6fe00640 1 -- 172.21.15.99:0/1789594940 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee782204a0 con 0x7fee7818a2e0 2024-02-21T23:02:07.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.297+0000 7fee6fe00640 1 --2- 172.21.15.99:0/1789594940 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fee7818a2e0 0x7fee780f5bd0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fee7818a6c0 tx=0x7fee6000c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:07.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.297+0000 7fee74c00640 1 -- 172.21.15.99:0/1789594940 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee600074e0 con 0x7fee7818a2e0 2024-02-21T23:02:07.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.297+0000 7fee74c00640 1 -- 172.21.15.99:0/1789594940 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee600047e0 con 0x7fee7818a2e0 2024-02-21T23:02:07.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.297+0000 7fee74c00640 1 -- 172.21.15.99:0/1789594940 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee60004bd0 con 0x7fee7818a2e0 2024-02-21T23:02:07.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.297+0000 7fee7ee00640 1 -- 172.21.15.99:0/1789594940 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee78220780 con 0x7fee7818a2e0 2024-02-21T23:02:07.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.298+0000 7fee7ee00640 1 -- 172.21.15.99:0/1789594940 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee78220d40 con 0x7fee7818a2e0 2024-02-21T23:02:07.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.299+0000 7fee7ee00640 1 -- 172.21.15.99:0/1789594940 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee78068780 con 0x7fee7818a2e0 2024-02-21T23:02:07.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.302+0000 7fee74c00640 1 -- 172.21.15.99:0/1789594940 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 6) v1 ==== 134407+0+0 (secure 0 0 0) 0x7fee6001a020 con 0x7fee7818a2e0 2024-02-21T23:02:07.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.304+0000 7fee74c00640 1 --2- 172.21.15.99:0/1789594940 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fee5409ee20 0x7fee540a12e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:07.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.305+0000 7fee74c00640 1 -- 172.21.15.99:0/1789594940 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fee600c9240 con 0x7fee7818a2e0 2024-02-21T23:02:07.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.305+0000 7fee77e00640 1 --2- 172.21.15.99:0/1789594940 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fee5409ee20 0x7fee540a12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:07.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.306+0000 7fee77e00640 1 --2- 172.21.15.99:0/1789594940 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fee5409ee20 0x7fee540a12e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fee68009b60 tx=0x7fee68009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:07.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.312+0000 7fee74c00640 1 -- 172.21.15.99:0/1789594940 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fee60097430 con 0x7fee7818a2e0 2024-02-21T23:02:07.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.564+0000 7fee7ee00640 1 -- 172.21.15.99:0/1789594940 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fee78071ba0 con 0x7fee7818a2e0 2024-02-21T23:02:07.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.565+0000 7fee74c00640 1 -- 172.21.15.99:0/1789594940 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7fee60096d30 con 0x7fee7818a2e0 2024-02-21T23:02:07.554 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 64 2024-02-21T23:02:07.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.567+0000 7fee7ee00640 1 -- 172.21.15.99:0/1789594940 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fee5409ee20 msgr2=0x7fee540a12e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:07.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.567+0000 7fee7ee00640 1 --2- 172.21.15.99:0/1789594940 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fee5409ee20 0x7fee540a12e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fee68009b60 tx=0x7fee68009190 comp rx=0 tx=0).stop 2024-02-21T23:02:07.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.567+0000 7fee7ee00640 1 -- 172.21.15.99:0/1789594940 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fee7818a2e0 msgr2=0x7fee780f5bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:07.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.567+0000 7fee7ee00640 1 --2- 172.21.15.99:0/1789594940 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fee7818a2e0 0x7fee780f5bd0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fee7818a6c0 tx=0x7fee6000c760 comp rx=0 tx=0).stop 2024-02-21T23:02:07.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.567+0000 7fee7ee00640 1 -- 172.21.15.99:0/1789594940 shutdown_connections 2024-02-21T23:02:07.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.567+0000 7fee7ee00640 1 --2- 172.21.15.99:0/1789594940 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fee5409ee20 0x7fee540a12e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:07.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.567+0000 7fee7ee00640 1 --2- 172.21.15.99:0/1789594940 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fee7818c3e0 0x7fee78221820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:07.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.567+0000 7fee7ee00640 1 --2- 172.21.15.99:0/1789594940 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fee7818a2e0 0x7fee780f5bd0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:07.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.567+0000 7fee7ee00640 1 --2- 172.21.15.99:0/1789594940 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee78182dd0 0x7fee781713d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:07.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.568+0000 7fee7ee00640 1 -- 172.21.15.99:0/1789594940 >> 172.21.15.99:0/1789594940 conn(0x7fee780f8e30 msgr2=0x7fee78189b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:07.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.568+0000 7fee7ee00640 1 -- 172.21.15.99:0/1789594940 shutdown_connections 2024-02-21T23:02:07.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.568+0000 7fee7ee00640 1 -- 172.21.15.99:0/1789594940 wait complete. 2024-02-21T23:02:07.578 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-02-21T23:02:07.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.834+0000 7f0ad3200640 1 Processor -- start 2024-02-21T23:02:07.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.834+0000 7f0ad3200640 1 -- start start 2024-02-21T23:02:07.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.836+0000 7f0ad3200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f0ad4182f00 0x7f0ad40704b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:07.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.836+0000 7f0ad3200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f0ad41887e0 0x7f0ad4186c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:07.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.836+0000 7f0ad3200640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f0ad41836d0 0x7f0ad4188d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:07.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.836+0000 7f0ad3200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ad40709f0 con 0x7f0ad4182f00 2024-02-21T23:02:07.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.836+0000 7f0ad3200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ad4187190 con 0x7f0ad41887e0 2024-02-21T23:02:07.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.836+0000 7f0ad3200640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ad4187460 con 0x7f0ad41836d0 2024-02-21T23:02:07.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.837+0000 7f0ad1e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f0ad4182f00 0x7f0ad40704b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:07.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.837+0000 7f0ad1e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f0ad4182f00 0x7f0ad40704b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60254/0 (socket says 172.21.15.99:60254) 2024-02-21T23:02:07.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.837+0000 7f0ad1e00640 1 -- 172.21.15.99:0/642308325 learned_addr learned my addr 172.21.15.99:0/642308325 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:07.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.837+0000 7f0ad1400640 1 --2- 172.21.15.99:0/642308325 >> v2:172.21.15.162:3300/0 conn(0x7f0ad41887e0 0x7f0ad4186c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:07.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.837+0000 7f0ad2800640 1 --2- 172.21.15.99:0/642308325 >> v2:172.21.15.181:3300/0 conn(0x7f0ad41836d0 0x7f0ad4188d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:07.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.837+0000 7f0ad1e00640 1 -- 172.21.15.99:0/642308325 >> v2:172.21.15.181:3300/0 conn(0x7f0ad41836d0 msgr2=0x7f0ad4188d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:07.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.837+0000 7f0ad1e00640 1 --2- 172.21.15.99:0/642308325 >> v2:172.21.15.181:3300/0 conn(0x7f0ad41836d0 0x7f0ad4188d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:07.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.837+0000 7f0ad1e00640 1 -- 172.21.15.99:0/642308325 >> v2:172.21.15.162:3300/0 conn(0x7f0ad41887e0 msgr2=0x7f0ad4186c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:07.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.837+0000 7f0ad1e00640 1 --2- 172.21.15.99:0/642308325 >> v2:172.21.15.162:3300/0 conn(0x7f0ad41887e0 0x7f0ad4186c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:07.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.837+0000 7f0ad1e00640 1 -- 172.21.15.99:0/642308325 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ad4187740 con 0x7f0ad4182f00 2024-02-21T23:02:07.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.839+0000 7f0ad1e00640 1 --2- 172.21.15.99:0/642308325 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0ad4182f00 0x7f0ad40704b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f0ad40eec00 tx=0x7f0ac402e060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dee79e7c7510fa9f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:07.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.839+0000 7f0ad0a00640 1 -- 172.21.15.99:0/642308325 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac403b070 con 0x7f0ad4182f00 2024-02-21T23:02:07.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.839+0000 7f0ad0a00640 1 -- 172.21.15.99:0/642308325 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ac402ee10 con 0x7f0ad4182f00 2024-02-21T23:02:07.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.839+0000 7f0ad0a00640 1 -- 172.21.15.99:0/642308325 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac4036660 con 0x7f0ad4182f00 2024-02-21T23:02:07.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.839+0000 7f0ad3200640 1 -- 172.21.15.99:0/642308325 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0ad4182f00 msgr2=0x7f0ad40704b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:07.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.839+0000 7f0ad3200640 1 --2- 172.21.15.99:0/642308325 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0ad4182f00 0x7f0ad40704b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f0ad40eec00 tx=0x7f0ac402e060 comp rx=0 tx=0).stop 2024-02-21T23:02:07.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.840+0000 7f0ad3200640 1 -- 172.21.15.99:0/642308325 shutdown_connections 2024-02-21T23:02:07.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.840+0000 7f0ad3200640 1 --2- 172.21.15.99:0/642308325 >> v2:172.21.15.181:3300/0 conn(0x7f0ad41836d0 0x7f0ad4188d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:07.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.840+0000 7f0ad3200640 1 --2- 172.21.15.99:0/642308325 >> v2:172.21.15.162:3300/0 conn(0x7f0ad41887e0 0x7f0ad4186c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:07.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.840+0000 7f0ad3200640 1 --2- 172.21.15.99:0/642308325 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0ad4182f00 0x7f0ad40704b0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:07.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.840+0000 7f0ad3200640 1 -- 172.21.15.99:0/642308325 >> 172.21.15.99:0/642308325 conn(0x7f0ad406e210 msgr2=0x7f0ad406e620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:07.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.840+0000 7f0ad3200640 1 -- 172.21.15.99:0/642308325 shutdown_connections 2024-02-21T23:02:07.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.840+0000 7f0ad3200640 1 -- 172.21.15.99:0/642308325 wait complete. 2024-02-21T23:02:07.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.843+0000 7f0ad3200640 1 Processor -- start 2024-02-21T23:02:07.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.843+0000 7f0ad3200640 1 -- start start 2024-02-21T23:02:07.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.845+0000 7f0ad3200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0ad4182f00 0x7f0ad416d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:07.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.845+0000 7f0ad3200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ad41836d0 0x7f0ad4181b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:07.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.845+0000 7f0ad3200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0ad41887e0 0x7f0ad4182050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:07.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.846+0000 7f0ad3200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad4187fe0 con 0x7f0ad41887e0 2024-02-21T23:02:07.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.846+0000 7f0ad3200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad4187d00 con 0x7f0ad41836d0 2024-02-21T23:02:07.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.846+0000 7f0ad3200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad41882c0 con 0x7f0ad4182f00 2024-02-21T23:02:07.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.846+0000 7f0ad2800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0ad41887e0 0x7f0ad4182050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:07.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.846+0000 7f0ad1e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0ad4182f00 0x7f0ad416d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:07.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.846+0000 7f0ad1e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0ad4182f00 0x7f0ad416d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:50886/0 (socket says 172.21.15.99:50886) 2024-02-21T23:02:07.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.846+0000 7f0ad2800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0ad41887e0 0x7f0ad4182050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60258/0 (socket says 172.21.15.99:60258) 2024-02-21T23:02:07.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.846+0000 7f0ad1e00640 1 -- 172.21.15.99:0/3045875755 learned_addr learned my addr 172.21.15.99:0/3045875755 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:07.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.846+0000 7f0ad1400640 1 --2- 172.21.15.99:0/3045875755 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ad41836d0 0x7f0ad4181b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:07.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.846+0000 7f0ad1e00640 1 -- 172.21.15.99:0/3045875755 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ad41836d0 msgr2=0x7f0ad4181b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:07.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.846+0000 7f0ad1e00640 1 --2- 172.21.15.99:0/3045875755 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ad41836d0 0x7f0ad4181b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:07.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.846+0000 7f0ad1e00640 1 -- 172.21.15.99:0/3045875755 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0ad41887e0 msgr2=0x7f0ad4182050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:07.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.846+0000 7f0ad1e00640 1 --2- 172.21.15.99:0/3045875755 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0ad41887e0 0x7f0ad4182050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:07.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.846+0000 7f0ad1e00640 1 -- 172.21.15.99:0/3045875755 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ad4186fa0 con 0x7f0ad4182f00 2024-02-21T23:02:07.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.847+0000 7f0ad1e00640 1 --2- 172.21.15.99:0/3045875755 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0ad4182f00 0x7f0ad416d660 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0ac402e0a0 tx=0x7f0ac4004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:07.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.847+0000 7f0aca000640 1 -- 172.21.15.99:0/3045875755 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac4046070 con 0x7f0ad4182f00 2024-02-21T23:02:07.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.847+0000 7f0aca000640 1 -- 172.21.15.99:0/3045875755 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ac403f550 con 0x7f0ad4182f00 2024-02-21T23:02:07.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.847+0000 7f0ad3200640 1 -- 172.21.15.99:0/3045875755 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ad41700b0 con 0x7f0ad4182f00 2024-02-21T23:02:07.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.847+0000 7f0aca000640 1 -- 172.21.15.99:0/3045875755 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac403b070 con 0x7f0ad4182f00 2024-02-21T23:02:07.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.847+0000 7f0ad3200640 1 -- 172.21.15.99:0/3045875755 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ad4170630 con 0x7f0ad4182f00 2024-02-21T23:02:07.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.848+0000 7f0ad3200640 1 -- 172.21.15.99:0/3045875755 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ad4068320 con 0x7f0ad4182f00 2024-02-21T23:02:07.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.850+0000 7f0aca000640 1 -- 172.21.15.99:0/3045875755 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 6) v1 ==== 134407+0+0 (secure 0 0 0) 0x7f0ac4049070 con 0x7f0ad4182f00 2024-02-21T23:02:07.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.851+0000 7f0aca000640 1 --2- 172.21.15.99:0/3045875755 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f0ab409edf0 0x7f0ab40a12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:07.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.852+0000 7f0aca000640 1 -- 172.21.15.99:0/3045875755 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f0ac40eb7d0 con 0x7f0ad4182f00 2024-02-21T23:02:07.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.852+0000 7f0ad1400640 1 --2- 172.21.15.99:0/3045875755 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f0ab409edf0 0x7f0ab40a12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:07.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.853+0000 7f0ad1400640 1 --2- 172.21.15.99:0/3045875755 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f0ab409edf0 0x7f0ab40a12b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0ad406dfd0 tx=0x7f0ac0009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:07.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:07.855+0000 7f0aca000640 1 -- 172.21.15.99:0/3045875755 <== mon.2 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f0ac40b93a0 con 0x7f0ad4182f00 2024-02-21T23:02:08.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.048+0000 7f0ad3200640 1 -- 172.21.15.99:0/3045875755 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f0ad4185000 con 0x7f0ad4182f00 2024-02-21T23:02:08.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.049+0000 7f0aca000640 1 -- 172.21.15.99:0/3045875755 <== mon.2 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v31) v1 ==== 103+0+11 (secure 0 0 0) 0x7f0ac40bd440 con 0x7f0ad4182f00 2024-02-21T23:02:08.038 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 32 2024-02-21T23:02:08.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.052+0000 7f0ad3200640 1 -- 172.21.15.99:0/3045875755 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f0ab409edf0 msgr2=0x7f0ab40a12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:08.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.052+0000 7f0ad3200640 1 --2- 172.21.15.99:0/3045875755 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f0ab409edf0 0x7f0ab40a12b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0ad406dfd0 tx=0x7f0ac0009190 comp rx=0 tx=0).stop 2024-02-21T23:02:08.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.052+0000 7f0ad3200640 1 -- 172.21.15.99:0/3045875755 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0ad4182f00 msgr2=0x7f0ad416d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:08.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.052+0000 7f0ad3200640 1 --2- 172.21.15.99:0/3045875755 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0ad4182f00 0x7f0ad416d660 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0ac402e0a0 tx=0x7f0ac4004730 comp rx=0 tx=0).stop 2024-02-21T23:02:08.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.052+0000 7f0ad3200640 1 -- 172.21.15.99:0/3045875755 shutdown_connections 2024-02-21T23:02:08.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.052+0000 7f0ad3200640 1 --2- 172.21.15.99:0/3045875755 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f0ab409edf0 0x7f0ab40a12b0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:08.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.052+0000 7f0ad3200640 1 --2- 172.21.15.99:0/3045875755 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0ad41887e0 0x7f0ad4182050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:08.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.052+0000 7f0ad3200640 1 --2- 172.21.15.99:0/3045875755 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ad41836d0 0x7f0ad4181b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:08.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.052+0000 7f0ad3200640 1 --2- 172.21.15.99:0/3045875755 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0ad4182f00 0x7f0ad416d660 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:08.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.052+0000 7f0ad3200640 1 -- 172.21.15.99:0/3045875755 >> 172.21.15.99:0/3045875755 conn(0x7f0ad406e210 msgr2=0x7f0ad406e5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:08.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.052+0000 7f0ad3200640 1 -- 172.21.15.99:0/3045875755 shutdown_connections 2024-02-21T23:02:08.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.052+0000 7f0ad3200640 1 -- 172.21.15.99:0/3045875755 wait complete. 2024-02-21T23:02:08.061 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T23:02:08.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.330+0000 7fc5aee00640 1 Processor -- start 2024-02-21T23:02:08.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.330+0000 7fc5aee00640 1 -- start start 2024-02-21T23:02:08.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.333+0000 7fc5aee00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fc5a806f1c0 0x7fc5a806f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:08.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.333+0000 7fc5aee00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5a80fa160 con 0x7fc5a806b690 2024-02-21T23:02:08.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.333+0000 7fc5aee00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5a80fa440 con 0x7fc5a806fae0 2024-02-21T23:02:08.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.334+0000 7fc5aee00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5a80fad70 con 0x7fc5a806f1c0 2024-02-21T23:02:08.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.334+0000 7fc5ada00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fc5a806f1c0 0x7fc5a806f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:08.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.334+0000 7fc5ad000640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fc5a806fae0 0x7fc5a806af80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:40718/0 (socket says 172.21.15.99:40718) 2024-02-21T23:02:08.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.334+0000 7fc5ad000640 1 -- 172.21.15.99:0/1198975715 learned_addr learned my addr 172.21.15.99:0/1198975715 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:02:08.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.334+0000 7fc5ada00640 1 -- 172.21.15.99:0/1198975715 >> v1:172.21.15.181:6789/0 conn(0x7fc5a806fae0 legacy=0x7fc5a806af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:08.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.334+0000 7fc5ada00640 1 -- 172.21.15.99:0/1198975715 >> v1:172.21.15.162:6789/0 conn(0x7fc5a806b690 legacy=0x7fc5a8186a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:08.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.334+0000 7fc5ada00640 1 -- 172.21.15.99:0/1198975715 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5a80fa720 con 0x7fc5a806f1c0 2024-02-21T23:02:08.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.335+0000 7fc5ada00640 1 --2- 172.21.15.99:0/1198975715 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc5a806f1c0 0x7fc5a806f5a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc59c0097a0 tx=0x7fc59c02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29c7d3c5d521f5be server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:08.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.336+0000 7fc5a7e00640 1 -- 172.21.15.99:0/1198975715 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc59c035020 con 0x7fc5a806f1c0 2024-02-21T23:02:08.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.336+0000 7fc5a7e00640 1 -- 172.21.15.99:0/1198975715 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc59c031830 con 0x7fc5a806f1c0 2024-02-21T23:02:08.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.336+0000 7fc5a7e00640 1 -- 172.21.15.99:0/1198975715 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc59c031c00 con 0x7fc5a806f1c0 2024-02-21T23:02:08.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.336+0000 7fc5aee00640 1 -- 172.21.15.99:0/1198975715 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc5a806f1c0 msgr2=0x7fc5a806f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:08.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.336+0000 7fc5aee00640 1 --2- 172.21.15.99:0/1198975715 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc5a806f1c0 0x7fc5a806f5a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc59c0097a0 tx=0x7fc59c02b8d0 comp rx=0 tx=0).stop 2024-02-21T23:02:08.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.336+0000 7fc5aee00640 1 -- 172.21.15.99:0/1198975715 shutdown_connections 2024-02-21T23:02:08.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.336+0000 7fc5aee00640 1 --2- 172.21.15.99:0/1198975715 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc5a806f1c0 0x7fc5a806f5a0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:08.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.336+0000 7fc5aee00640 1 -- 172.21.15.99:0/1198975715 >> 172.21.15.99:0/1198975715 conn(0x7fc5a80f8bb0 msgr2=0x7fc5a80f8fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:08.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.336+0000 7fc5aee00640 1 -- 172.21.15.99:0/1198975715 shutdown_connections 2024-02-21T23:02:08.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.337+0000 7fc5aee00640 1 -- 172.21.15.99:0/1198975715 wait complete. 2024-02-21T23:02:08.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.339+0000 7fc5aee00640 1 Processor -- start 2024-02-21T23:02:08.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.339+0000 7fc5aee00640 1 -- start start 2024-02-21T23:02:08.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.340+0000 7fc5aee00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5a806b690 0x7fc5a8171650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:08.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.340+0000 7fc5aee00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc5a806f1c0 0x7fc5a821f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:08.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.340+0000 7fc5aee00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5a806fae0 0x7fc5a821f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:08.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.340+0000 7fc5aee00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a806bb20 con 0x7fc5a806b690 2024-02-21T23:02:08.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.340+0000 7fc5aee00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a8189a60 con 0x7fc5a806fae0 2024-02-21T23:02:08.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.340+0000 7fc5aee00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5a8186640 con 0x7fc5a806f1c0 2024-02-21T23:02:08.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.340+0000 7fc5ada00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5a806b690 0x7fc5a8171650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:08.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.340+0000 7fc5ad000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc5a806f1c0 0x7fc5a821f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:08.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.340+0000 7fc5ad000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc5a806f1c0 0x7fc5a821f130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:50902/0 (socket says 172.21.15.99:50902) 2024-02-21T23:02:08.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.340+0000 7fc5ad000640 1 -- 172.21.15.99:0/3609898575 learned_addr learned my addr 172.21.15.99:0/3609898575 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:08.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.340+0000 7fc5ae400640 1 --2- 172.21.15.99:0/3609898575 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5a806fae0 0x7fc5a821f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:08.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.341+0000 7fc5ad000640 1 -- 172.21.15.99:0/3609898575 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5a806fae0 msgr2=0x7fc5a821f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:08.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.341+0000 7fc5ad000640 1 --2- 172.21.15.99:0/3609898575 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5a806fae0 0x7fc5a821f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:08.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.341+0000 7fc5ad000640 1 -- 172.21.15.99:0/3609898575 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5a806b690 msgr2=0x7fc5a8171650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:08.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.341+0000 7fc5ad000640 1 --2- 172.21.15.99:0/3609898575 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5a806b690 0x7fc5a8171650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:08.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.341+0000 7fc5ad000640 1 -- 172.21.15.99:0/3609898575 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5a818b850 con 0x7fc5a806f1c0 2024-02-21T23:02:08.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.341+0000 7fc5ada00640 1 --2- 172.21.15.99:0/3609898575 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5a806b690 0x7fc5a8171650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:02:08.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.341+0000 7fc5ae400640 1 --2- 172.21.15.99:0/3609898575 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5a806fae0 0x7fc5a821f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:02:08.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.341+0000 7fc5ad000640 1 --2- 172.21.15.99:0/3609898575 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc5a806f1c0 0x7fc5a821f130 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc59400c4e0 tx=0x7fc59400c9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:08.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.341+0000 7fc5a5600640 1 -- 172.21.15.99:0/3609898575 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc594017070 con 0x7fc5a806f1c0 2024-02-21T23:02:08.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.341+0000 7fc5a5600640 1 -- 172.21.15.99:0/3609898575 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc594005ce0 con 0x7fc5a806f1c0 2024-02-21T23:02:08.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.341+0000 7fc5aee00640 1 -- 172.21.15.99:0/3609898575 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5a818bb30 con 0x7fc5a806f1c0 2024-02-21T23:02:08.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.342+0000 7fc5a5600640 1 -- 172.21.15.99:0/3609898575 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc594007270 con 0x7fc5a806f1c0 2024-02-21T23:02:08.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.342+0000 7fc5aee00640 1 -- 172.21.15.99:0/3609898575 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5a808ded0 con 0x7fc5a806f1c0 2024-02-21T23:02:08.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.343+0000 7fc5aee00640 1 -- 172.21.15.99:0/3609898575 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5a8068320 con 0x7fc5a806f1c0 2024-02-21T23:02:08.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.346+0000 7fc5a5600640 1 -- 172.21.15.99:0/3609898575 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 6) v1 ==== 134407+0+0 (secure 0 0 0) 0x7fc59401a070 con 0x7fc5a806f1c0 2024-02-21T23:02:08.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.348+0000 7fc5a5600640 1 --2- 172.21.15.99:0/3609898575 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fc58809ee20 0x7fc5880a12e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:08.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.349+0000 7fc5a5600640 1 -- 172.21.15.99:0/3609898575 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fc5940c8d60 con 0x7fc5a806f1c0 2024-02-21T23:02:08.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.349+0000 7fc5ada00640 1 --2- 172.21.15.99:0/3609898575 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fc58809ee20 0x7fc5880a12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:08.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.350+0000 7fc5ada00640 1 --2- 172.21.15.99:0/3609898575 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fc58809ee20 0x7fc5880a12e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc59c036000 tx=0x7fc59c03c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:08.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.352+0000 7fc5a5600640 1 -- 172.21.15.99:0/3609898575 <== mon.2 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fc594096900 con 0x7fc5a806f1c0 2024-02-21T23:02:08.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.640+0000 7fc5aee00640 1 -- 172.21.15.99:0/3609898575 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc5a8071cf0 con 0x7fc5a806f1c0 2024-02-21T23:02:08.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.641+0000 7fc5a5600640 1 -- 172.21.15.99:0/3609898575 <== mon.2 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+11335 (secure 0 0 0) 0x7fc59409a9a0 con 0x7fc5a806f1c0 2024-02-21T23:02:08.630 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T23:02:08.630 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4307,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/3514452812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3514452812},{"type":"v1","addr":"172.21.15.162:6836","nonce":3514452812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4312,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6838/2169982089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":2169982089},{"type":"v1","addr":"172.21.15.162:6838","nonce":2169982089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4315,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6839/3335972724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6837","nonce":3335972724},{"type":"v1","addr":"172.21.15.162:6839","nonce":3335972724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4318,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6841/2135456697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6840","nonce":2135456697},{"type":"v1","addr":"172.21.15.162:6841","nonce":2135456697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4325,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2452242758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2452242758},{"type":"v1","addr":"172.21.15.181:6833","nonce":2452242758}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4328,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6836/2751486400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":2751486400},{"type":"v1","addr":"172.21.15.181:6836","nonce":2751486400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":15,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-21T23:01:02.656130+0000","modified":"2024-02-21T23:01:57.191106+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4355,"mds_1":4352,"mds_2":4348},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4331":{"gid":4331,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6838/3728901330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6835","nonce":3728901330},{"type":"v1","addr":"172.21.15.181:6838","nonce":3728901330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4339":{"gid":4339,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6839/3357929641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6837","nonce":3357929641},{"type":"v1","addr":"172.21.15.181:6839","nonce":3357929641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4343":{"gid":4343,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6833/2793485078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":2793485078},{"type":"v1","addr":"172.21.15.99:6833","nonce":2793485078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4348":{"gid":4348,"name":"d","rank":2,"incarnation":12,"state":"up:active","state_seq":10,"addr":"172.21.15.99:6835/2243461688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2243461688},{"type":"v1","addr":"172.21.15.99:6835","nonce":2243461688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4352":{"gid":4352,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.99:6837/1676159950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":1676159950},{"type":"v1","addr":"172.21.15.99:6837","nonce":1676159950}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4355":{"gid":4355,"name":"j","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6839/4239008786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":4239008786},{"type":"v1","addr":"172.21.15.99:6839","nonce":4239008786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-21T23:02:08.630 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 15 2024-02-21T23:02:08.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.644+0000 7fc5aee00640 1 -- 172.21.15.99:0/3609898575 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fc58809ee20 msgr2=0x7fc5880a12e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:08.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.644+0000 7fc5aee00640 1 --2- 172.21.15.99:0/3609898575 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fc58809ee20 0x7fc5880a12e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc59c036000 tx=0x7fc59c03c040 comp rx=0 tx=0).stop 2024-02-21T23:02:08.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.644+0000 7fc5aee00640 1 -- 172.21.15.99:0/3609898575 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc5a806f1c0 msgr2=0x7fc5a821f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:08.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.644+0000 7fc5aee00640 1 --2- 172.21.15.99:0/3609898575 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc5a806f1c0 0x7fc5a821f130 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc59400c4e0 tx=0x7fc59400c9a0 comp rx=0 tx=0).stop 2024-02-21T23:02:08.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.644+0000 7fc5aee00640 1 -- 172.21.15.99:0/3609898575 shutdown_connections 2024-02-21T23:02:08.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.644+0000 7fc5aee00640 1 --2- 172.21.15.99:0/3609898575 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fc58809ee20 0x7fc5880a12e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:08.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.644+0000 7fc5aee00640 1 --2- 172.21.15.99:0/3609898575 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5a806fae0 0x7fc5a821f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:08.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.644+0000 7fc5aee00640 1 --2- 172.21.15.99:0/3609898575 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc5a806f1c0 0x7fc5a821f130 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:08.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.644+0000 7fc5aee00640 1 --2- 172.21.15.99:0/3609898575 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5a806b690 0x7fc5a8171650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:08.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.644+0000 7fc5aee00640 1 -- 172.21.15.99:0/3609898575 >> 172.21.15.99:0/3609898575 conn(0x7fc5a80f8bb0 msgr2=0x7fc5a8066c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:08.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.644+0000 7fc5aee00640 1 -- 172.21.15.99:0/3609898575 shutdown_connections 2024-02-21T23:02:08.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.644+0000 7fc5aee00640 1 -- 172.21.15.99:0/3609898575 wait complete. 2024-02-21T23:02:08.651 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T23:02:08.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.905+0000 7fc834200640 1 Processor -- start 2024-02-21T23:02:08.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.905+0000 7fc834200640 1 -- start start 2024-02-21T23:02:08.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.906+0000 7fc834200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc82c0f8730 0x7fc82c1845c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:08.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.906+0000 7fc834200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc82c0f8c40 con 0x7fc82c184b00 2024-02-21T23:02:08.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.906+0000 7fc834200640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc82c0f8f20 con 0x7fc82c1833f0 2024-02-21T23:02:08.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.906+0000 7fc834200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc82c186a10 con 0x7fc82c0f8730 2024-02-21T23:02:08.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.907+0000 7fc832200640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fc82c184b00 0x7fc82c06e310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:51686/0 (socket says 172.21.15.99:51686) 2024-02-21T23:02:08.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.907+0000 7fc831800640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fc82c1833f0 0x7fc82c0f8020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:40732/0 (socket says 172.21.15.99:40732) 2024-02-21T23:02:08.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.907+0000 7fc832200640 1 -- 172.21.15.99:0/2503683803 learned_addr learned my addr 172.21.15.99:0/2503683803 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:02:08.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.907+0000 7fc830e00640 1 --2- 172.21.15.99:0/2503683803 >> v2:172.21.15.99:3300/0 conn(0x7fc82c0f8730 0x7fc82c1845c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:08.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.907+0000 7fc82be00640 1 -- 172.21.15.99:0/2503683803 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1869766584 0 0) 0x7fc82c0f8f20 con 0x7fc82c1833f0 2024-02-21T23:02:08.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.907+0000 7fc82be00640 1 -- 172.21.15.99:0/2503683803 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc814003520 con 0x7fc82c1833f0 2024-02-21T23:02:08.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.907+0000 7fc82be00640 1 -- 172.21.15.99:0/2503683803 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 635152516 0 0) 0x7fc82c0f8c40 con 0x7fc82c184b00 2024-02-21T23:02:08.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.907+0000 7fc82be00640 1 -- 172.21.15.99:0/2503683803 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc82c0f8f20 con 0x7fc82c184b00 2024-02-21T23:02:08.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.907+0000 7fc830e00640 1 -- 172.21.15.99:0/2503683803 >> v1:172.21.15.181:6789/0 conn(0x7fc82c1833f0 legacy=0x7fc82c0f8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:08.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.907+0000 7fc830e00640 1 -- 172.21.15.99:0/2503683803 >> v1:172.21.15.99:6789/0 conn(0x7fc82c184b00 legacy=0x7fc82c06e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:08.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.908+0000 7fc830e00640 1 -- 172.21.15.99:0/2503683803 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc82c183ae0 con 0x7fc82c0f8730 2024-02-21T23:02:08.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.909+0000 7fc830e00640 1 --2- 172.21.15.99:0/2503683803 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc82c0f8730 0x7fc82c1845c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc8180097a0 tx=0x7fc81802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6adf1e7891182e33 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:08.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.909+0000 7fc82be00640 1 -- 172.21.15.99:0/2503683803 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc818035020 con 0x7fc82c0f8730 2024-02-21T23:02:08.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.910+0000 7fc82be00640 1 -- 172.21.15.99:0/2503683803 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc818031830 con 0x7fc82c0f8730 2024-02-21T23:02:08.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.910+0000 7fc82be00640 1 -- 172.21.15.99:0/2503683803 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc818031be0 con 0x7fc82c0f8730 2024-02-21T23:02:08.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.910+0000 7fc834200640 1 -- 172.21.15.99:0/2503683803 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc82c0f8730 msgr2=0x7fc82c1845c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:08.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.910+0000 7fc834200640 1 --2- 172.21.15.99:0/2503683803 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc82c0f8730 0x7fc82c1845c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc8180097a0 tx=0x7fc81802b8d0 comp rx=0 tx=0).stop 2024-02-21T23:02:08.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.910+0000 7fc834200640 1 -- 172.21.15.99:0/2503683803 shutdown_connections 2024-02-21T23:02:08.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.910+0000 7fc834200640 1 --2- 172.21.15.99:0/2503683803 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc82c0f8730 0x7fc82c1845c0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:08.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.910+0000 7fc834200640 1 -- 172.21.15.99:0/2503683803 >> 172.21.15.99:0/2503683803 conn(0x7fc82c0ce5f0 msgr2=0x7fc82c0cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:08.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.910+0000 7fc834200640 1 -- 172.21.15.99:0/2503683803 shutdown_connections 2024-02-21T23:02:08.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.910+0000 7fc834200640 1 -- 172.21.15.99:0/2503683803 wait complete. 2024-02-21T23:02:08.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.912+0000 7fc834200640 1 Processor -- start 2024-02-21T23:02:08.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.912+0000 7fc834200640 1 -- start start 2024-02-21T23:02:08.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.913+0000 7fc834200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc82c0f8730 0x7fc82c1625e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:08.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.914+0000 7fc834200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc82c1833f0 0x7fc82c1756c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:08.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.914+0000 7fc834200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc82c184b00 0x7fc82c175c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:08.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.914+0000 7fc834200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc82c184f90 con 0x7fc82c1833f0 2024-02-21T23:02:08.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.914+0000 7fc834200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc82c1840a0 con 0x7fc82c184b00 2024-02-21T23:02:08.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.914+0000 7fc834200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc82c185110 con 0x7fc82c0f8730 2024-02-21T23:02:08.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.914+0000 7fc830e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc82c1833f0 0x7fc82c1756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:08.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.914+0000 7fc830e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc82c1833f0 0x7fc82c1756c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60284/0 (socket says 172.21.15.99:60284) 2024-02-21T23:02:08.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.914+0000 7fc830e00640 1 -- 172.21.15.99:0/132771590 learned_addr learned my addr 172.21.15.99:0/132771590 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:08.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.914+0000 7fc831800640 1 --2- 172.21.15.99:0/132771590 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc82c0f8730 0x7fc82c1625e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:08.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.914+0000 7fc832200640 1 --2- 172.21.15.99:0/132771590 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc82c184b00 0x7fc82c175c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:08.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.914+0000 7fc830e00640 1 -- 172.21.15.99:0/132771590 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc82c0f8730 msgr2=0x7fc82c1625e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:08.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.914+0000 7fc830e00640 1 --2- 172.21.15.99:0/132771590 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc82c0f8730 0x7fc82c1625e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:08.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.914+0000 7fc830e00640 1 -- 172.21.15.99:0/132771590 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc82c184b00 msgr2=0x7fc82c175c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:08.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.914+0000 7fc830e00640 1 --2- 172.21.15.99:0/132771590 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc82c184b00 0x7fc82c175c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:08.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.914+0000 7fc830e00640 1 -- 172.21.15.99:0/132771590 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc82c0cf730 con 0x7fc82c1833f0 2024-02-21T23:02:08.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.915+0000 7fc830e00640 1 --2- 172.21.15.99:0/132771590 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc82c1833f0 0x7fc82c1756c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc818034040 tx=0x7fc8180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:08.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.915+0000 7fc829600640 1 -- 172.21.15.99:0/132771590 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc818040070 con 0x7fc82c1833f0 2024-02-21T23:02:08.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.915+0000 7fc829600640 1 -- 172.21.15.99:0/132771590 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc81803a850 con 0x7fc82c1833f0 2024-02-21T23:02:08.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.915+0000 7fc834200640 1 -- 172.21.15.99:0/132771590 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc82c0cfa10 con 0x7fc82c1833f0 2024-02-21T23:02:08.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.915+0000 7fc829600640 1 -- 172.21.15.99:0/132771590 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc818035040 con 0x7fc82c1833f0 2024-02-21T23:02:08.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.915+0000 7fc834200640 1 -- 172.21.15.99:0/132771590 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc82c0cffd0 con 0x7fc82c1833f0 2024-02-21T23:02:08.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.917+0000 7fc834200640 1 -- 172.21.15.99:0/132771590 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc82c08d240 con 0x7fc82c1833f0 2024-02-21T23:02:08.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.920+0000 7fc829600640 1 -- 172.21.15.99:0/132771590 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 6) v1 ==== 134407+0+0 (secure 0 0 0) 0x7fc81804b060 con 0x7fc82c1833f0 2024-02-21T23:02:08.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.921+0000 7fc829600640 1 --2- 172.21.15.99:0/132771590 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fc80c09edf0 0x7fc80c0a12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:08.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.921+0000 7fc829600640 1 -- 172.21.15.99:0/132771590 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fc8180eb900 con 0x7fc82c1833f0 2024-02-21T23:02:08.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.921+0000 7fc831800640 1 --2- 172.21.15.99:0/132771590 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fc80c09edf0 0x7fc80c0a12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:08.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.922+0000 7fc831800640 1 --2- 172.21.15.99:0/132771590 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fc80c09edf0 0x7fc80c0a12b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc820000f60 tx=0x7fc820007b70 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:08.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:08.925+0000 7fc829600640 1 -- 172.21.15.99:0/132771590 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fc82c08d240 con 0x7fc82c1833f0 2024-02-21T23:02:09.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.173+0000 7fc834200640 1 -- 172.21.15.99:0/132771590 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc82c181190 con 0x7fc82c1833f0 2024-02-21T23:02:09.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.174+0000 7fc829600640 1 -- 172.21.15.99:0/132771590 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+23759 (secure 0 0 0) 0x7fc818031800 con 0x7fc82c1833f0 2024-02-21T23:02:09.165 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T23:02:09.165 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":31,"fsid":"e8af98cd-45a1-425f-96a7-f24da8ee4efb","created":"2024-02-21T23:00:44.699708+0000","modified":"2024-02-21T23:01:50.451929+0000","last_up_change":"2024-02-21T23:00:55.749829+0000","last_in_change":"2024-02-21T23:00:48.332297+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T23:00:57.020557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":11.760000228881836,"score_stable":11.760000228881836,"optimal_score":0.17000000178813934,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-21T23:01:01.124398+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-21T23:01:01.684258+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-21T23:01:05.290089+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c49de9b2-dc53-4882-b14c-7059ed40bf59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6809","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6811","nonce":1026112937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6813","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6815","nonce":1026112937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6823","nonce":1026112937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6819","nonce":1026112937}]},"public_addr":"172.21.15.99:6811/1026112937","cluster_addr":"172.21.15.99:6815/1026112937","heartbeat_back_addr":"172.21.15.99:6823/1026112937","heartbeat_front_addr":"172.21.15.99:6819/1026112937","state":["exists","up"]},{"osd":1,"uuid":"58398292-2fe5-4291-94fd-03a0ca29d49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6827","nonce":3030871566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6829","nonce":3030871566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6833","nonce":3030871566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6831","nonce":3030871566}]},"public_addr":"172.21.15.162:6827/3030871566","cluster_addr":"172.21.15.162:6829/3030871566","heartbeat_back_addr":"172.21.15.162:6833/3030871566","heartbeat_front_addr":"172.21.15.162:6831/3030871566","state":["exists","up"]},{"osd":2,"uuid":"94cddec1-e08f-438d-a7c8-48a0e47d71a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6818","nonce":2782386148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6821","nonce":2782386148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6827","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6829","nonce":2782386148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6823","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6825","nonce":2782386148}]},"public_addr":"172.21.15.181:6818/2782386148","cluster_addr":"172.21.15.181:6821/2782386148","heartbeat_back_addr":"172.21.15.181:6829/2782386148","heartbeat_front_addr":"172.21.15.181:6825/2782386148","state":["exists","up"]},{"osd":3,"uuid":"d29abb74-9b89-4fd7-88b1-7c2eb8231189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6801","nonce":2316185310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6803","nonce":2316185310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6807","nonce":2316185310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6805","nonce":2316185310}]},"public_addr":"172.21.15.99:6801/2316185310","cluster_addr":"172.21.15.99:6803/2316185310","heartbeat_back_addr":"172.21.15.99:6807/2316185310","heartbeat_front_addr":"172.21.15.99:6805/2316185310","state":["exists","up"]},{"osd":4,"uuid":"0d8c9ea3-880a-4d69-9dcb-cf7d35abd449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6811","nonce":3137681258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6813","nonce":3137681258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6817","nonce":3137681258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6815","nonce":3137681258}]},"public_addr":"172.21.15.162:6811/3137681258","cluster_addr":"172.21.15.162:6813/3137681258","heartbeat_back_addr":"172.21.15.162:6817/3137681258","heartbeat_front_addr":"172.21.15.162:6815/3137681258","state":["exists","up"]},{"osd":5,"uuid":"2e3a9340-6fd0-4d7a-8e00-fe305649296e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6801","nonce":2011264527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6803","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6805","nonce":2011264527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6811","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6813","nonce":2011264527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6807","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6809","nonce":2011264527}]},"public_addr":"172.21.15.181:6801/2011264527","cluster_addr":"172.21.15.181:6805/2011264527","heartbeat_back_addr":"172.21.15.181:6813/2011264527","heartbeat_front_addr":"172.21.15.181:6809/2011264527","state":["exists","up"]},{"osd":6,"uuid":"d9e37ce7-1b0e-4019-8f2e-b670403abf7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6810","nonce":753870050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6814","nonce":753870050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6822","nonce":753870050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6818","nonce":753870050}]},"public_addr":"172.21.15.99:6810/753870050","cluster_addr":"172.21.15.99:6814/753870050","heartbeat_back_addr":"172.21.15.99:6822/753870050","heartbeat_front_addr":"172.21.15.99:6818/753870050","state":["exists","up"]},{"osd":7,"uuid":"49988754-232e-4b8c-bd72-bfa25b418e5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6803","nonce":1659412949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6805","nonce":1659412949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6809","nonce":1659412949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6807","nonce":1659412949}]},"public_addr":"172.21.15.162:6803/1659412949","cluster_addr":"172.21.15.162:6805/1659412949","heartbeat_back_addr":"172.21.15.162:6809/1659412949","heartbeat_front_addr":"172.21.15.162:6807/1659412949","state":["exists","up"]},{"osd":8,"uuid":"ebc6e462-8368-4d64-b242-9c8735ac672c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6804","nonce":3389807042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6808","nonce":3389807042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6815","nonce":3389807042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6812","nonce":3389807042}]},"public_addr":"172.21.15.181:6804/3389807042","cluster_addr":"172.21.15.181:6808/3389807042","heartbeat_back_addr":"172.21.15.181:6815/3389807042","heartbeat_front_addr":"172.21.15.181:6812/3389807042","state":["exists","up"]},{"osd":9,"uuid":"72af1b02-b965-4d6a-8964-527ec24c4daa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6825","nonce":4055669590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6827","nonce":4055669590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6831","nonce":4055669590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6829","nonce":4055669590}]},"public_addr":"172.21.15.99:6825/4055669590","cluster_addr":"172.21.15.99:6827/4055669590","heartbeat_back_addr":"172.21.15.99:6831/4055669590","heartbeat_front_addr":"172.21.15.99:6829/4055669590","state":["exists","up"]},{"osd":10,"uuid":"adb5cb06-6453-41e4-b847-d7c78bbb7d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6819","nonce":1421879617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6821","nonce":1421879617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6825","nonce":1421879617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6823","nonce":1421879617}]},"public_addr":"172.21.15.162:6819/1421879617","cluster_addr":"172.21.15.162:6821/1421879617","heartbeat_back_addr":"172.21.15.162:6825/1421879617","heartbeat_front_addr":"172.21.15.162:6823/1421879617","state":["exists","up"]},{"osd":11,"uuid":"118563d9-1e8f-4dc7-a92c-2f4c4dc3e20f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6817","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6819","nonce":3219928272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6824","nonce":3219928272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6831","nonce":3219928272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6828","nonce":3219928272}]},"public_addr":"172.21.15.181:6819/3219928272","cluster_addr":"172.21.15.181:6824/3219928272","heartbeat_back_addr":"172.21.15.181:6831/3219928272","heartbeat_front_addr":"172.21.15.181:6828/3219928272","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.651219+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.549859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.529659+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.591004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.440836+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.414250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.630130+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.411954+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.439371+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.428173+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.511203+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.482806+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.6","mappings":[{"from":9,"to":11}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.14","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T23:02:09.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.177+0000 7fc834200640 1 -- 172.21.15.99:0/132771590 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fc80c09edf0 msgr2=0x7fc80c0a12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:09.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.177+0000 7fc834200640 1 --2- 172.21.15.99:0/132771590 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fc80c09edf0 0x7fc80c0a12b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc820000f60 tx=0x7fc820007b70 comp rx=0 tx=0).stop 2024-02-21T23:02:09.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.177+0000 7fc834200640 1 -- 172.21.15.99:0/132771590 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc82c1833f0 msgr2=0x7fc82c1756c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:09.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.177+0000 7fc834200640 1 --2- 172.21.15.99:0/132771590 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc82c1833f0 0x7fc82c1756c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc818034040 tx=0x7fc8180046c0 comp rx=0 tx=0).stop 2024-02-21T23:02:09.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.177+0000 7fc834200640 1 -- 172.21.15.99:0/132771590 shutdown_connections 2024-02-21T23:02:09.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.177+0000 7fc834200640 1 --2- 172.21.15.99:0/132771590 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fc80c09edf0 0x7fc80c0a12b0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:09.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.177+0000 7fc834200640 1 --2- 172.21.15.99:0/132771590 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc82c184b00 0x7fc82c175c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:09.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.177+0000 7fc834200640 1 --2- 172.21.15.99:0/132771590 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc82c1833f0 0x7fc82c1756c0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:09.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.177+0000 7fc834200640 1 --2- 172.21.15.99:0/132771590 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc82c0f8730 0x7fc82c1625e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:09.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.177+0000 7fc834200640 1 -- 172.21.15.99:0/132771590 >> 172.21.15.99:0/132771590 conn(0x7fc82c0ce5f0 msgr2=0x7fc82c188700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:09.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.177+0000 7fc834200640 1 -- 172.21.15.99:0/132771590 shutdown_connections 2024-02-21T23:02:09.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.177+0000 7fc834200640 1 -- 172.21.15.99:0/132771590 wait complete. 2024-02-21T23:02:09.188 DEBUG:tasks.fwd_scrub:Yielding 2024-02-21T23:02:09.188 INFO:teuthology.run_tasks:Running task exec... 2024-02-21T23:02:09.196 INFO:teuthology.task.exec:Executing custom commands... 2024-02-21T23:02:09.196 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi099.front.sepia.ceph.com 2024-02-21T23:02:09.196 DEBUG:teuthology.orchestra.run.smithi099:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph mgr module enable snap_schedule' 2024-02-21T23:02:09.197 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-02-21T23:02:09.197 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-02-21T23:02:09.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T23:02:09.197 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-02-21T23:02:09.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.427+0000 7f9198200640 1 Processor -- start 2024-02-21T23:02:09.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.427+0000 7f9198200640 1 -- start start 2024-02-21T23:02:09.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.430+0000 7f9198200640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f9190186ec0 0x7f9190187330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:09.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.430+0000 7f9198200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9190184700 con 0x7f9190070600 2024-02-21T23:02:09.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.430+0000 7f9198200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9190070a60 con 0x7f9190186ae0 2024-02-21T23:02:09.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.430+0000 7f9198200640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f919006f8f0 con 0x7f9190186ec0 2024-02-21T23:02:09.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.431+0000 7f9196200640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f9190186ec0 0x7f9190187330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:09.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.431+0000 7f9195800640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f9190186ae0 0x7f9190071ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.99:56780/0 (socket says 172.21.15.99:56780) 2024-02-21T23:02:09.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.431+0000 7f9195800640 1 -- 172.21.15.99:0/2936389581 learned_addr learned my addr 172.21.15.99:0/2936389581 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:02:09.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.431+0000 7f918fe00640 1 -- 172.21.15.99:0/2936389581 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1597476843 0 0) 0x7f9190070a60 con 0x7f9190186ae0 2024-02-21T23:02:09.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.431+0000 7f918fe00640 1 -- 172.21.15.99:0/2936389581 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9178003520 con 0x7f9190186ae0 2024-02-21T23:02:09.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.431+0000 7f918fe00640 1 -- 172.21.15.99:0/2936389581 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 421349860 0 0) 0x7f917c001110 con 0x7f9190070600 2024-02-21T23:02:09.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.431+0000 7f9196200640 1 -- 172.21.15.99:0/2936389581 >> v1:172.21.15.162:6789/0 conn(0x7f9190186ae0 legacy=0x7f9190071ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:09.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.431+0000 7f9196200640 1 -- 172.21.15.99:0/2936389581 >> v1:172.21.15.99:6789/0 conn(0x7f9190070600 legacy=0x7f919008d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:09.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.432+0000 7f9196200640 1 -- 172.21.15.99:0/2936389581 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f919008e050 con 0x7f9190186ec0 2024-02-21T23:02:09.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.433+0000 7f9196200640 1 --2- 172.21.15.99:0/2936389581 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9190186ec0 0x7f9190187330 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9188009d90 tx=0x7f918802beb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=539d3f7e22f330c9 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:09.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.433+0000 7f918fe00640 1 -- 172.21.15.99:0/2936389581 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9188039070 con 0x7f9190186ec0 2024-02-21T23:02:09.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.433+0000 7f918fe00640 1 -- 172.21.15.99:0/2936389581 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f918802cc60 con 0x7f9190186ec0 2024-02-21T23:02:09.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.433+0000 7f918fe00640 1 -- 172.21.15.99:0/2936389581 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9188034660 con 0x7f9190186ec0 2024-02-21T23:02:09.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.434+0000 7f9198200640 1 -- 172.21.15.99:0/2936389581 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9190186ec0 msgr2=0x7f9190187330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:09.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.434+0000 7f9198200640 1 --2- 172.21.15.99:0/2936389581 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9190186ec0 0x7f9190187330 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9188009d90 tx=0x7f918802beb0 comp rx=0 tx=0).stop 2024-02-21T23:02:09.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.434+0000 7f9198200640 1 -- 172.21.15.99:0/2936389581 shutdown_connections 2024-02-21T23:02:09.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.434+0000 7f9198200640 1 --2- 172.21.15.99:0/2936389581 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9190186ec0 0x7f9190187330 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:09.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.434+0000 7f9198200640 1 -- 172.21.15.99:0/2936389581 >> 172.21.15.99:0/2936389581 conn(0x7f91900cf740 msgr2=0x7f91900cfb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:09.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.435+0000 7f9198200640 1 -- 172.21.15.99:0/2936389581 shutdown_connections 2024-02-21T23:02:09.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.435+0000 7f9198200640 1 -- 172.21.15.99:0/2936389581 wait complete. 2024-02-21T23:02:09.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.435+0000 7f9873e00640 1 Processor -- start 2024-02-21T23:02:09.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.435+0000 7f9873e00640 1 -- start start 2024-02-21T23:02:09.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.437+0000 7f9873e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f986c15de70 0x7f986c18a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:09.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.437+0000 7f9873e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f986c18a970 con 0x7f986c18bcf0 2024-02-21T23:02:09.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.437+0000 7f9873e00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f986c18ac50 con 0x7f986c15e250 2024-02-21T23:02:09.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.437+0000 7f9873e00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f986c18c180 con 0x7f986c15de70 2024-02-21T23:02:09.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.437+0000 7f9871400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f986c15de70 0x7f986c18a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:09.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.437+0000 7f9871e00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f986c18bcf0 0x7f986c18c410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.99:56786/0 (socket says 172.21.15.99:56786) 2024-02-21T23:02:09.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.437+0000 7f9871e00640 1 -- 172.21.15.99:0/2830220933 learned_addr learned my addr 172.21.15.99:0/2830220933 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:02:09.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.437+0000 7f9871400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f986c15de70 0x7f986c18a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60288/0 (socket says 172.21.15.99:60288) 2024-02-21T23:02:09.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.438+0000 7f986be00640 1 -- 172.21.15.99:0/2830220933 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3139103117 0 0) 0x7f986c18a970 con 0x7f986c18bcf0 2024-02-21T23:02:09.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.438+0000 7f986be00640 1 -- 172.21.15.99:0/2830220933 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9854003520 con 0x7f986c18bcf0 2024-02-21T23:02:09.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.438+0000 7f9198200640 1 Processor -- start 2024-02-21T23:02:09.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.438+0000 7f9871400640 1 -- 172.21.15.99:0/2830220933 >> v1:172.21.15.181:6789/0 conn(0x7f986c15e250 legacy=0x7f986c186d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:09.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.438+0000 7f9871400640 1 -- 172.21.15.99:0/2830220933 >> v1:172.21.15.162:6789/0 conn(0x7f986c18bcf0 legacy=0x7f986c18c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:09.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.438+0000 7f9871400640 1 -- 172.21.15.99:0/2830220933 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f986c18af30 con 0x7f986c15de70 2024-02-21T23:02:09.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.438+0000 7f9198200640 1 -- start start 2024-02-21T23:02:09.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.439+0000 7f9871400640 1 --2- 172.21.15.99:0/2830220933 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f986c15de70 0x7f986c18a310 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9860009d90 tx=0x7f986002be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a42c30b411b4e59f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:09.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.439+0000 7f986be00640 1 -- 172.21.15.99:0/2830220933 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9860039070 con 0x7f986c15de70 2024-02-21T23:02:09.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.439+0000 7f986be00640 1 -- 172.21.15.99:0/2830220933 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f986002cbd0 con 0x7f986c15de70 2024-02-21T23:02:09.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.439+0000 7f986be00640 1 -- 172.21.15.99:0/2830220933 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9860034440 con 0x7f986c15de70 2024-02-21T23:02:09.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.440+0000 7f9873e00640 1 -- 172.21.15.99:0/2830220933 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f986c15de70 msgr2=0x7f986c18a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:09.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.440+0000 7f9873e00640 1 --2- 172.21.15.99:0/2830220933 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f986c15de70 0x7f986c18a310 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9860009d90 tx=0x7f986002be20 comp rx=0 tx=0).stop 2024-02-21T23:02:09.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.440+0000 7f9873e00640 1 -- 172.21.15.99:0/2830220933 shutdown_connections 2024-02-21T23:02:09.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.440+0000 7f9873e00640 1 --2- 172.21.15.99:0/2830220933 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f986c15de70 0x7f986c18a310 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:09.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.440+0000 7f9873e00640 1 -- 172.21.15.99:0/2830220933 >> 172.21.15.99:0/2830220933 conn(0x7f986c0740b0 msgr2=0x7f986c0744c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:09.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.440+0000 7f9198200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9190070600 0x7f91900f5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:09.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.440+0000 7f9198200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9190186ae0 0x7f9190176a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:09.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.440+0000 7f9873e00640 1 -- 172.21.15.99:0/2830220933 shutdown_connections 2024-02-21T23:02:09.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.440+0000 7f9873e00640 1 -- 172.21.15.99:0/2830220933 wait complete. 2024-02-21T23:02:09.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.440+0000 7f9198200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9190186ec0 0x7f9190224880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:09.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.440+0000 7f9198200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f919006fe00 con 0x7f9190186ec0 2024-02-21T23:02:09.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.440+0000 7f9198200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f919006fb20 con 0x7f9190186ae0 2024-02-21T23:02:09.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.440+0000 7f9198200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91900700e0 con 0x7f9190070600 2024-02-21T23:02:09.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.441+0000 7f9195800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9190070600 0x7f91900f5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:09.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.441+0000 7f9195800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9190070600 0x7f91900f5af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:50934/0 (socket says 172.21.15.99:50934) 2024-02-21T23:02:09.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.441+0000 7f9195800640 1 -- 172.21.15.99:0/656864663 learned_addr learned my addr 172.21.15.99:0/656864663 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:09.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.441+0000 7f9194e00640 1 --2- 172.21.15.99:0/656864663 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9190186ae0 0x7f9190176a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:09.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.441+0000 7f9196200640 1 --2- 172.21.15.99:0/656864663 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9190186ec0 0x7f9190224880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:09.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.441+0000 7f9195800640 1 -- 172.21.15.99:0/656864663 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9190186ae0 msgr2=0x7f9190176a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:09.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.441+0000 7f9195800640 1 --2- 172.21.15.99:0/656864663 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9190186ae0 0x7f9190176a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:09.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.441+0000 7f9195800640 1 -- 172.21.15.99:0/656864663 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9190186ec0 msgr2=0x7f9190224880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:09.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.441+0000 7f9195800640 1 --2- 172.21.15.99:0/656864663 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9190186ec0 0x7f9190224880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:09.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.441+0000 7f9195800640 1 -- 172.21.15.99:0/656864663 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9190224100 con 0x7f9190070600 2024-02-21T23:02:09.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.442+0000 7f9194e00640 1 --2- 172.21.15.99:0/656864663 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9190186ae0 0x7f9190176a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:02:09.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.442+0000 7f9196200640 1 --2- 172.21.15.99:0/656864663 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9190186ec0 0x7f9190224880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T23:02:09.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.442+0000 7f9195800640 1 --2- 172.21.15.99:0/656864663 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9190070600 0x7f91900f5af0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f918400c440 tx=0x7f918400c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:09.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.442+0000 7f918d600640 1 -- 172.21.15.99:0/656864663 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9184017070 con 0x7f9190070600 2024-02-21T23:02:09.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.442+0000 7f918d600640 1 -- 172.21.15.99:0/656864663 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9184005ce0 con 0x7f9190070600 2024-02-21T23:02:09.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.442+0000 7f9198200640 1 -- 172.21.15.99:0/656864663 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9190161b90 con 0x7f9190070600 2024-02-21T23:02:09.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.442+0000 7f918d600640 1 -- 172.21.15.99:0/656864663 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91840072b0 con 0x7f9190070600 2024-02-21T23:02:09.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.443+0000 7f9198200640 1 -- 172.21.15.99:0/656864663 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9190162150 con 0x7f9190070600 2024-02-21T23:02:09.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.443+0000 7f9873e00640 1 Processor -- start 2024-02-21T23:02:09.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.444+0000 7f9873e00640 1 -- start start 2024-02-21T23:02:09.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.445+0000 7f9873e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f986c15de70 0x7f986c156eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:09.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.445+0000 7f9873e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f986c18bcf0 0x7f986c2256d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:09.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.445+0000 7f9873e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f986c220b70 0x7f986c187d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:09.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.445+0000 7f9873e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f986c18b4f0 con 0x7f986c15de70 2024-02-21T23:02:09.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.445+0000 7f9873e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f986c18b860 con 0x7f986c220b70 2024-02-21T23:02:09.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.445+0000 7f9873e00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f986c189d50 con 0x7f986c18bcf0 2024-02-21T23:02:09.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.445+0000 7f9871400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f986c15de70 0x7f986c156eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:09.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.445+0000 7f9871e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f986c220b70 0x7f986c187d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:09.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.445+0000 7f9870a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f986c18bcf0 0x7f986c2256d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:09.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.445+0000 7f9871e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f986c220b70 0x7f986c187d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:59858/0 (socket says 172.21.15.99:59858) 2024-02-21T23:02:09.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.445+0000 7f9871e00640 1 -- 172.21.15.99:0/605076620 learned_addr learned my addr 172.21.15.99:0/605076620 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:09.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.446+0000 7f9871e00640 1 -- 172.21.15.99:0/605076620 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f986c18bcf0 msgr2=0x7f986c2256d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:09.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.446+0000 7f9871e00640 1 --2- 172.21.15.99:0/605076620 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f986c18bcf0 0x7f986c2256d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:09.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.446+0000 7f9871e00640 1 -- 172.21.15.99:0/605076620 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f986c15de70 msgr2=0x7f986c156eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:09.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.446+0000 7f9871e00640 1 --2- 172.21.15.99:0/605076620 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f986c15de70 0x7f986c156eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:09.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.446+0000 7f9871e00640 1 -- 172.21.15.99:0/605076620 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f986c224070 con 0x7f986c220b70 2024-02-21T23:02:09.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.446+0000 7f9871e00640 1 --2- 172.21.15.99:0/605076620 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f986c220b70 0x7f986c187d10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f986400c390 tx=0x7f986400c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:09.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.447+0000 7f9869600640 1 -- 172.21.15.99:0/605076620 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9864017070 con 0x7f986c220b70 2024-02-21T23:02:09.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.447+0000 7f9869600640 1 -- 172.21.15.99:0/605076620 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9864005ce0 con 0x7f986c220b70 2024-02-21T23:02:09.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.447+0000 7f9869600640 1 -- 172.21.15.99:0/605076620 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9864007310 con 0x7f986c220b70 2024-02-21T23:02:09.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.447+0000 7f9873e00640 1 -- 172.21.15.99:0/605076620 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f986c224350 con 0x7f986c220b70 2024-02-21T23:02:09.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.447+0000 7f9873e00640 1 -- 172.21.15.99:0/605076620 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f986c224910 con 0x7f986c220b70 2024-02-21T23:02:09.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.447+0000 7f918d600640 1 -- 172.21.15.99:0/656864663 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 6) v1 ==== 134407+0+0 (secure 0 0 0) 0x7f918401a070 con 0x7f9190070600 2024-02-21T23:02:09.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.447+0000 7f9198200640 1 -- 172.21.15.99:0/656864663 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f916c005290 con 0x7f9190070600 2024-02-21T23:02:09.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.449+0000 7f918d600640 1 --2- 172.21.15.99:0/656864663 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f917009edf0 0x7f91700a12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:09.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.449+0000 7f918d600640 1 -- 172.21.15.99:0/656864663 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f91840c8f80 con 0x7f9190070600 2024-02-21T23:02:09.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.449+0000 7f9194e00640 1 --2- 172.21.15.99:0/656864663 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f917009edf0 0x7f91700a12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:09.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.450+0000 7f9194e00640 1 --2- 172.21.15.99:0/656864663 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f917009edf0 0x7f91700a12b0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f91900f6d90 tx=0x7f917c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:09.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.452+0000 7f9869600640 1 -- 172.21.15.99:0/605076620 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 6) v1 ==== 134407+0+0 (secure 0 0 0) 0x7f986401a070 con 0x7f986c220b70 2024-02-21T23:02:09.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.452+0000 7f9876d6f740 1 Processor -- start 2024-02-21T23:02:09.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.452+0000 7f9876d6f740 1 -- start start 2024-02-21T23:02:09.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.453+0000 7f918d600640 1 -- 172.21.15.99:0/656864663 <== mon.2 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f9184097170 con 0x7f9190070600 2024-02-21T23:02:09.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.453+0000 7f9869600640 1 --2- 172.21.15.99:0/605076620 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f984c09edf0 0x7f984c0a12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:09.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.453+0000 7f9869600640 1 -- 172.21.15.99:0/605076620 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f98640c8fc0 con 0x7f986c220b70 2024-02-21T23:02:09.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.454+0000 7f9870a00640 1 --2- 172.21.15.99:0/605076620 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f984c09edf0 0x7f984c0a12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:09.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.454+0000 7f9870a00640 1 --2- 172.21.15.99:0/605076620 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f984c09edf0 0x7f984c0a12b0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f986c1581e0 tx=0x7f9858009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:09.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.454+0000 7f9876d6f740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557dff15b2f0 0x557dff15b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:09.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.454+0000 7f9876d6f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557dff15bc10 0x557dff196480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:09.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.454+0000 7f9876d6f740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557dff1969c0 0x557dff197750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:09.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.454+0000 7f9876d6f740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x557dff083790 con 0x557dff15b2f0 2024-02-21T23:02:09.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.454+0000 7f9876d6f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x557dff02cbf0 con 0x557dff15bc10 2024-02-21T23:02:09.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.454+0000 7f9876d6f740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x557dff07f830 con 0x557dff1969c0 2024-02-21T23:02:09.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.455+0000 7f9870a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557dff15bc10 0x557dff196480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:09.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.455+0000 7f9870a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557dff15bc10 0x557dff196480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:59860/0 (socket says 172.21.15.99:59860) 2024-02-21T23:02:09.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.455+0000 7f9870a00640 1 -- 172.21.15.99:0/3208999033 learned_addr learned my addr 172.21.15.99:0/3208999033 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:09.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.455+0000 7f9871400640 1 --2- 172.21.15.99:0/3208999033 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557dff15b2f0 0x557dff15b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:09.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.455+0000 7f9871e00640 1 --2- 172.21.15.99:0/3208999033 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557dff1969c0 0x557dff197750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:09.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.455+0000 7f9870a00640 1 -- 172.21.15.99:0/3208999033 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557dff1969c0 msgr2=0x557dff197750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:09.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.455+0000 7f9870a00640 1 --2- 172.21.15.99:0/3208999033 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557dff1969c0 0x557dff197750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:09.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.455+0000 7f9870a00640 1 -- 172.21.15.99:0/3208999033 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557dff15b2f0 msgr2=0x557dff15b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:09.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.455+0000 7f9870a00640 1 --2- 172.21.15.99:0/3208999033 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557dff15b2f0 0x557dff15b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:09.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.455+0000 7f9870a00640 1 -- 172.21.15.99:0/3208999033 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557dff04ac40 con 0x557dff15bc10 2024-02-21T23:02:09.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.455+0000 7f9871e00640 1 --2- 172.21.15.99:0/3208999033 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557dff1969c0 0x557dff197750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:02:09.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.455+0000 7f9871400640 1 --2- 172.21.15.99:0/3208999033 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557dff15b2f0 0x557dff15b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:02:09.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.456+0000 7f9870a00640 1 --2- 172.21.15.99:0/3208999033 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557dff15bc10 0x557dff196480 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f985800f9b0 tx=0x7f9858012000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af0ccdaba6f4f6d2 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:09.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.456+0000 7f985dc00640 1 -- 172.21.15.99:0/3208999033 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9858025070 con 0x557dff15bc10 2024-02-21T23:02:09.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.456+0000 7f985dc00640 1 -- 172.21.15.99:0/3208999033 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f985801b050 con 0x557dff15bc10 2024-02-21T23:02:09.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.456+0000 7f985dc00640 1 -- 172.21.15.99:0/3208999033 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9858014de0 con 0x557dff15bc10 2024-02-21T23:02:09.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.457+0000 7f9876d6f740 1 -- 172.21.15.99:0/3208999033 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557dff15bc10 msgr2=0x557dff196480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:09.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.457+0000 7f9876d6f740 1 --2- 172.21.15.99:0/3208999033 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557dff15bc10 0x557dff196480 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f985800f9b0 tx=0x7f9858012000 comp rx=0 tx=0).stop 2024-02-21T23:02:09.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.457+0000 7f9876d6f740 1 -- 172.21.15.99:0/3208999033 shutdown_connections 2024-02-21T23:02:09.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.457+0000 7f9876d6f740 1 --2- 172.21.15.99:0/3208999033 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557dff1969c0 0x557dff197750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:09.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.457+0000 7f9876d6f740 1 --2- 172.21.15.99:0/3208999033 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557dff15bc10 0x557dff196480 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:09.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.457+0000 7f9876d6f740 1 --2- 172.21.15.99:0/3208999033 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557dff15b2f0 0x557dff15b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:09.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.457+0000 7f9876d6f740 1 -- 172.21.15.99:0/3208999033 >> 172.21.15.99:0/3208999033 conn(0x557dff11d8c0 msgr2=0x557dff11e940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:09.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.457+0000 7f9876d6f740 1 -- 172.21.15.99:0/3208999033 shutdown_connections 2024-02-21T23:02:09.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.458+0000 7f9876d6f740 1 -- 172.21.15.99:0/3208999033 wait complete. 2024-02-21T23:02:09.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.459+0000 7f9876d6f740 1 -- start start 2024-02-21T23:02:09.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.459+0000 7f9876d6f740 1 Processor -- start 2024-02-21T23:02:09.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.461+0000 7f9876d6f740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557dff15bc10 0x557dff151ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:09.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.461+0000 7f9876d6f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557dff1969c0 0x557dff119ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:09.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.461+0000 7f9876d6f740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557dff1a0e70 0x557dff149ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:09.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.461+0000 7f9876d6f740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x557dff194ea0 con 0x557dff15bc10 2024-02-21T23:02:09.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.461+0000 7f9876d6f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x557dff0221d0 con 0x557dff1969c0 2024-02-21T23:02:09.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.461+0000 7f9876d6f740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x557dff195180 con 0x557dff1a0e70 2024-02-21T23:02:09.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.462+0000 7f9876d6f740 10 client.0 _ll_register_callbacks cb 0x557dfed97c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:02:09.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.462+0000 7f9871400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557dff15bc10 0x557dff151ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:09.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.462+0000 7f9871400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557dff15bc10 0x557dff151ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60330/0 (socket says 172.21.15.99:60330) 2024-02-21T23:02:09.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.462+0000 7f9871400640 1 -- 172.21.15.99:0/399971415 learned_addr learned my addr 172.21.15.99:0/399971415 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:09.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.462+0000 7f9870a00640 1 --2- 172.21.15.99:0/399971415 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557dff1969c0 0x557dff119ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:09.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.462+0000 7f9871e00640 1 --2- 172.21.15.99:0/399971415 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557dff1a0e70 0x557dff149ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:09.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.462+0000 7f9871400640 1 -- 172.21.15.99:0/399971415 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557dff1a0e70 msgr2=0x557dff149ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:09.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.462+0000 7f9871400640 1 --2- 172.21.15.99:0/399971415 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557dff1a0e70 0x557dff149ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:09.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.462+0000 7f9871400640 1 -- 172.21.15.99:0/399971415 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557dff1969c0 msgr2=0x557dff119ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:09.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.462+0000 7f9871400640 1 --2- 172.21.15.99:0/399971415 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557dff1969c0 0x557dff119ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:09.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.462+0000 7f9871400640 1 -- 172.21.15.99:0/399971415 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557dfee607e0 con 0x557dff15bc10 2024-02-21T23:02:09.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.463+0000 7f9871400640 1 --2- 172.21.15.99:0/399971415 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557dff15bc10 0x557dff151ad0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9860009e80 tx=0x7f9860004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddf01330013a9004 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:09.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.463+0000 7f9852000640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:02:09.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.463+0000 7f9852000640 1 -- 172.21.15.99:0/399971415 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9860046070 con 0x557dff15bc10 2024-02-21T23:02:09.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.463+0000 7f9852000640 1 -- 172.21.15.99:0/399971415 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f9860040870 con 0x557dff15bc10 2024-02-21T23:02:09.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.463+0000 7f9876d6f740 1 -- 172.21.15.99:0/399971415 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f985801b050 con 0x557dff15bc10 2024-02-21T23:02:09.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.464+0000 7f9852000640 1 -- 172.21.15.99:0/399971415 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9860052050 con 0x557dff15bc10 2024-02-21T23:02:09.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.464+0000 7f9876d6f740 10 client.5013 fetch_fsmap learned FSMap version 15 2024-02-21T23:02:09.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.464+0000 7f9876d6f740 1 -- 172.21.15.99:0/399971415 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x557dfeec0f70 con 0x557dff15bc10 2024-02-21T23:02:09.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.464+0000 7f9852000640 1 -- 172.21.15.99:0/399971415 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f985801b050 con 0x557dff15bc10 2024-02-21T23:02:09.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.464+0000 7f9852000640 1 -- 172.21.15.99:0/399971415 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 15) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f9860040a70 con 0x557dff15bc10 2024-02-21T23:02:09.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.464+0000 7f9876d6f740 10 client.5013 fetch_fsmap finished waiting for FSMap version 15 2024-02-21T23:02:09.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.464+0000 7f9876d6f740 10 client.5013 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:02:09.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.464+0000 7f9876d6f740 20 client.5013 populate_metadata read hostname 'smithi099' 2024-02-21T23:02:09.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.464+0000 7f9876d6f740 1 --2- 172.21.15.99:0/399971415 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x557dff1a33b0 0x557dff1a3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:09.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.464+0000 7f9876d6f740 4 client.5013 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:02:09.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.464+0000 7f9876d6f740 1 -- 172.21.15.99:0/399971415 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557dff090cd0 con 0x557dff1a33b0 2024-02-21T23:02:09.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.465+0000 7f9870a00640 1 --2- 172.21.15.99:0/399971415 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x557dff1a33b0 0x557dff1a3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:09.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.466+0000 7f9870a00640 1 --2- 172.21.15.99:0/399971415 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x557dff1a33b0 0x557dff1a3790 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=939950e31eb7ed8f server_cookie=66662b22619c8f1b in_seq=0 out_seq=0 2024-02-21T23:02:09.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.466+0000 7f9852000640 10 client.5013 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:02:09.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.467+0000 7f9852000640 1 -- 172.21.15.99:0/399971415 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x557dff090cd0 con 0x557dff1a33b0 2024-02-21T23:02:09.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.467+0000 7f9852000640 10 client.5013 handle_command_reply: tid=0 2024-02-21T23:02:09.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.467+0000 7f9876d6f740 1 client.5013 shutdown 2024-02-21T23:02:09.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.467+0000 7f9876d6f740 1 -- 172.21.15.99:0/399971415 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557dff15bc10 msgr2=0x557dff151ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:09.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.467+0000 7f9876d6f740 1 --2- 172.21.15.99:0/399971415 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557dff15bc10 0x557dff151ad0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9860009e80 tx=0x7f9860004ab0 comp rx=0 tx=0).stop 2024-02-21T23:02:09.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.467+0000 7f9876d6f740 1 -- 172.21.15.99:0/399971415 shutdown_connections 2024-02-21T23:02:09.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.467+0000 7f9876d6f740 1 --2- 172.21.15.99:0/399971415 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x557dff1a33b0 0x557dff1a3790 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:09.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.467+0000 7f9876d6f740 1 --2- 172.21.15.99:0/399971415 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557dff1a0e70 0x557dff149ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:09.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.467+0000 7f9876d6f740 1 --2- 172.21.15.99:0/399971415 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557dff1969c0 0x557dff119ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:09.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.467+0000 7f9876d6f740 1 --2- 172.21.15.99:0/399971415 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557dff15bc10 0x557dff151ad0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:09.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.467+0000 7f9852000640 0 client.5013 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:02:09.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.467+0000 7f9876d6f740 1 -- 172.21.15.99:0/399971415 >> 172.21.15.99:0/399971415 conn(0x557dff15b2f0 msgr2=0x557dff11f330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:09.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.468+0000 7f9876d6f740 1 -- 172.21.15.99:0/399971415 shutdown_connections 2024-02-21T23:02:09.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.468+0000 7f9876d6f740 1 -- 172.21.15.99:0/399971415 wait complete. 2024-02-21T23:02:09.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.468+0000 7f9876d6f740 20 client.5013 trim_cache size 0 max 16384 2024-02-21T23:02:09.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.501+0000 7f9876d6f740 1 Processor -- start 2024-02-21T23:02:09.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.501+0000 7f9876d6f740 1 -- start start 2024-02-21T23:02:09.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.503+0000 7f9876d6f740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557dff15bc10 0x557dff14d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:09.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.503+0000 7f9876d6f740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557dff1969c0 0x557dff194370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:09.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.503+0000 7f9876d6f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557dff1a0e70 0x557dff1948b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:09.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.503+0000 7f9876d6f740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f986c230770 con 0x557dff15bc10 2024-02-21T23:02:09.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.503+0000 7f9876d6f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f986c22e310 con 0x557dff1a0e70 2024-02-21T23:02:09.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.503+0000 7f9876d6f740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f986c0d2b20 con 0x557dff1969c0 2024-02-21T23:02:09.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.503+0000 7f9871400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557dff15bc10 0x557dff14d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:09.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.503+0000 7f9871400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557dff15bc10 0x557dff14d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60340/0 (socket says 172.21.15.99:60340) 2024-02-21T23:02:09.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.503+0000 7f9871400640 1 -- 172.21.15.99:0/1215043064 learned_addr learned my addr 172.21.15.99:0/1215043064 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:09.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.503+0000 7f9870a00640 1 --2- 172.21.15.99:0/1215043064 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557dff1969c0 0x557dff194370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:09.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.504+0000 7f9871e00640 1 --2- 172.21.15.99:0/1215043064 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557dff1a0e70 0x557dff1948b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:09.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.504+0000 7f9871400640 1 -- 172.21.15.99:0/1215043064 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557dff1969c0 msgr2=0x557dff194370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:09.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.504+0000 7f9871400640 1 --2- 172.21.15.99:0/1215043064 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557dff1969c0 0x557dff194370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:09.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.504+0000 7f9871400640 1 -- 172.21.15.99:0/1215043064 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557dff1a0e70 msgr2=0x557dff1948b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:09.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.504+0000 7f9871400640 1 --2- 172.21.15.99:0/1215043064 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557dff1a0e70 0x557dff1948b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:09.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.504+0000 7f9871400640 1 -- 172.21.15.99:0/1215043064 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557dfed58170 con 0x557dff15bc10 2024-02-21T23:02:09.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.504+0000 7f9871e00640 1 --2- 172.21.15.99:0/1215043064 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557dff1a0e70 0x557dff1948b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T23:02:09.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.504+0000 7f9871400640 1 --2- 172.21.15.99:0/1215043064 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557dff15bc10 0x557dff14d600 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9860050040 tx=0x7f9860040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c08a341c60d488 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:09.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.504+0000 7f985d200640 1 -- 172.21.15.99:0/1215043064 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9860046070 con 0x557dff15bc10 2024-02-21T23:02:09.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.504+0000 7f985d200640 1 -- 172.21.15.99:0/1215043064 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9860003b90 con 0x557dff15bc10 2024-02-21T23:02:09.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.504+0000 7f985d200640 1 -- 172.21.15.99:0/1215043064 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9860039040 con 0x557dff15bc10 2024-02-21T23:02:09.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.505+0000 7f9876d6f740 1 -- 172.21.15.99:0/1215043064 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557dff15bc10 msgr2=0x557dff14d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:09.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.505+0000 7f9876d6f740 1 --2- 172.21.15.99:0/1215043064 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557dff15bc10 0x557dff14d600 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9860050040 tx=0x7f9860040000 comp rx=0 tx=0).stop 2024-02-21T23:02:09.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.505+0000 7f9876d6f740 1 -- 172.21.15.99:0/1215043064 shutdown_connections 2024-02-21T23:02:09.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.505+0000 7f9876d6f740 1 --2- 172.21.15.99:0/1215043064 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557dff1a0e70 0x557dff1948b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:09.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.505+0000 7f9876d6f740 1 --2- 172.21.15.99:0/1215043064 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557dff1969c0 0x557dff194370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:09.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.505+0000 7f9876d6f740 1 --2- 172.21.15.99:0/1215043064 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557dff15bc10 0x557dff14d600 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:09.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.505+0000 7f9876d6f740 1 -- 172.21.15.99:0/1215043064 >> 172.21.15.99:0/1215043064 conn(0x557dff15b2f0 msgr2=0x557dff11f330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:09.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.506+0000 7f9876d6f740 1 -- 172.21.15.99:0/1215043064 shutdown_connections 2024-02-21T23:02:09.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.506+0000 7f9876d6f740 1 -- 172.21.15.99:0/1215043064 wait complete. 2024-02-21T23:02:09.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.507+0000 7f9876d6f740 1 -- start start 2024-02-21T23:02:09.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.507+0000 7f9876d6f740 1 Processor -- start 2024-02-21T23:02:09.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.509+0000 7f9876d6f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557dff15bc10 0x557dff119ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:09.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.510+0000 7f9876d6f740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557dff1969c0 0x557dff151b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:09.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.510+0000 7f9876d6f740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557dff1a0e70 0x557dff166aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:09.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.510+0000 7f9876d6f740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f986c22cad0 con 0x557dff1a0e70 2024-02-21T23:02:09.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.510+0000 7f9876d6f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f986c22dcd0 con 0x557dff15bc10 2024-02-21T23:02:09.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.510+0000 7f9876d6f740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f986c22d0d0 con 0x557dff1969c0 2024-02-21T23:02:09.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.510+0000 7f9876d6f740 10 client.0 _ll_register_callbacks cb 0x7f98540036f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:02:09.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.510+0000 7f9870a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557dff1969c0 0x557dff151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:09.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.510+0000 7f9871400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557dff15bc10 0x557dff119ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:09.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.510+0000 7f9870a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557dff1969c0 0x557dff151b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:51008/0 (socket says 172.21.15.99:51008) 2024-02-21T23:02:09.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.510+0000 7f9870a00640 1 -- 172.21.15.99:0/641039249 learned_addr learned my addr 172.21.15.99:0/641039249 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:09.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.510+0000 7f9871e00640 1 --2- 172.21.15.99:0/641039249 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557dff1a0e70 0x557dff166aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:09.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.510+0000 7f9871400640 1 -- 172.21.15.99:0/641039249 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557dff1969c0 msgr2=0x557dff151b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:09.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.510+0000 7f9871400640 1 --2- 172.21.15.99:0/641039249 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557dff1969c0 0x557dff151b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:09.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.510+0000 7f9871400640 1 -- 172.21.15.99:0/641039249 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557dff1a0e70 msgr2=0x557dff166aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:09.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.510+0000 7f9871400640 1 --2- 172.21.15.99:0/641039249 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557dff1a0e70 0x557dff166aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:09.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.510+0000 7f9871400640 1 -- 172.21.15.99:0/641039249 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557dff1b13a0 con 0x557dff15bc10 2024-02-21T23:02:09.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.511+0000 7f9871e00640 1 --2- 172.21.15.99:0/641039249 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557dff1a0e70 0x557dff166aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:02:09.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.511+0000 7f9870a00640 1 --2- 172.21.15.99:0/641039249 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557dff1969c0 0x557dff151b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:02:09.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.511+0000 7f9871400640 1 --2- 172.21.15.99:0/641039249 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557dff15bc10 0x557dff119ff0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9860035000 tx=0x7f9860009750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84678c3042ad693b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:09.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.511+0000 7f9852000640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-02-21T23:02:09.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.511+0000 7f9852000640 1 -- 172.21.15.99:0/641039249 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9860039050 con 0x557dff15bc10 2024-02-21T23:02:09.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.511+0000 7f9876d6f740 1 -- 172.21.15.99:0/641039249 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9860003b90 con 0x557dff15bc10 2024-02-21T23:02:09.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.511+0000 7f9852000640 1 -- 172.21.15.99:0/641039249 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f9860034440 con 0x557dff15bc10 2024-02-21T23:02:09.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.512+0000 7f9852000640 1 -- 172.21.15.99:0/641039249 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9860046040 con 0x557dff15bc10 2024-02-21T23:02:09.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.512+0000 7f9876d6f740 10 client.5104 fetch_fsmap learned FSMap version 15 2024-02-21T23:02:09.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.512+0000 7f9876d6f740 1 -- 172.21.15.99:0/641039249 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x557dff194740 con 0x557dff15bc10 2024-02-21T23:02:09.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.512+0000 7f9852000640 1 -- 172.21.15.99:0/641039249 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9860003b90 con 0x557dff15bc10 2024-02-21T23:02:09.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.512+0000 7f9852000640 1 -- 172.21.15.99:0/641039249 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 15) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f9860066030 con 0x557dff15bc10 2024-02-21T23:02:09.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.512+0000 7f9876d6f740 10 client.5104 fetch_fsmap finished waiting for FSMap version 15 2024-02-21T23:02:09.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.512+0000 7f9876d6f740 10 client.5104 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:02:09.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.512+0000 7f9876d6f740 20 client.5104 populate_metadata read hostname 'smithi099' 2024-02-21T23:02:09.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.512+0000 7f9876d6f740 1 --2- 172.21.15.99:0/641039249 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x557dff188d10 0x557dff1fc790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:09.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.512+0000 7f9876d6f740 4 client.5104 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-02-21T23:02:09.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.512+0000 7f9876d6f740 1 -- 172.21.15.99:0/641039249 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x557dff08b020 con 0x557dff188d10 2024-02-21T23:02:09.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.513+0000 7f9870a00640 1 --2- 172.21.15.99:0/641039249 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x557dff188d10 0x557dff1fc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:09.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.514+0000 7f9852000640 10 client.5104 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:02:09.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.514+0000 7f9870a00640 1 --2- 172.21.15.99:0/641039249 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x557dff188d10 0x557dff1fc790 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25096bbd06db84ec server_cookie=c60e289e7ee434f6 in_seq=0 out_seq=0 2024-02-21T23:02:09.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.515+0000 7f9852000640 1 -- 172.21.15.99:0/641039249 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x557dff08b020 con 0x557dff188d10 2024-02-21T23:02:09.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.515+0000 7f9852000640 10 client.5104 handle_command_reply: tid=0 2024-02-21T23:02:09.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.515+0000 7f9876d6f740 1 client.5104 shutdown 2024-02-21T23:02:09.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.516+0000 7f9876d6f740 1 -- 172.21.15.99:0/641039249 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557dff15bc10 msgr2=0x557dff119ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:09.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.516+0000 7f9876d6f740 1 --2- 172.21.15.99:0/641039249 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557dff15bc10 0x557dff119ff0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9860035000 tx=0x7f9860009750 comp rx=0 tx=0).stop 2024-02-21T23:02:09.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.516+0000 7f9876d6f740 1 -- 172.21.15.99:0/641039249 shutdown_connections 2024-02-21T23:02:09.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.516+0000 7f9876d6f740 1 --2- 172.21.15.99:0/641039249 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x557dff188d10 0x557dff1fc790 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:09.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.516+0000 7f9876d6f740 1 --2- 172.21.15.99:0/641039249 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x557dff1a0e70 0x557dff166aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:09.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.516+0000 7f9876d6f740 1 --2- 172.21.15.99:0/641039249 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x557dff1969c0 0x557dff151b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:09.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.516+0000 7f9876d6f740 1 --2- 172.21.15.99:0/641039249 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557dff15bc10 0x557dff119ff0 secure :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9860035000 tx=0x7f9860009750 comp rx=0 tx=0).stop 2024-02-21T23:02:09.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.516+0000 7f9876d6f740 1 -- 172.21.15.99:0/641039249 >> 172.21.15.99:0/641039249 conn(0x557dff15b2f0 msgr2=0x557dff11f330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:09.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.516+0000 7f9852000640 0 client.5104 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:02:09.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.517+0000 7f9876d6f740 1 -- 172.21.15.99:0/641039249 shutdown_connections 2024-02-21T23:02:09.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.517+0000 7f9876d6f740 1 -- 172.21.15.99:0/641039249 wait complete. 2024-02-21T23:02:09.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.517+0000 7f9876d6f740 20 client.5104 trim_cache size 0 max 16384 2024-02-21T23:02:09.507 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-02-21T23:02:09.507 INFO:teuthology.orchestra.run.smithi099.stdout: "return_code": 0, 2024-02-21T23:02:09.507 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_tag": "0d0cc31b-8de0-426e-b754-853e4f0b5c30", 2024-02-21T23:02:09.507 INFO:teuthology.orchestra.run.smithi099.stdout: "mode": "asynchronous" 2024-02-21T23:02:09.507 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-02-21T23:02:09.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.518+0000 7f9873e00640 1 -- 172.21.15.99:0/605076620 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f984c09edf0 msgr2=0x7f984c0a12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:09.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.518+0000 7f9873e00640 1 --2- 172.21.15.99:0/605076620 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f984c09edf0 0x7f984c0a12b0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f986c1581e0 tx=0x7f9858009040 comp rx=0 tx=0).stop 2024-02-21T23:02:09.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.519+0000 7f9873e00640 1 -- 172.21.15.99:0/605076620 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f986c220b70 msgr2=0x7f986c187d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:09.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.519+0000 7f9873e00640 1 --2- 172.21.15.99:0/605076620 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f986c220b70 0x7f986c187d10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f986400c390 tx=0x7f986400c850 comp rx=0 tx=0).stop 2024-02-21T23:02:09.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.519+0000 7f9873e00640 1 -- 172.21.15.99:0/605076620 shutdown_connections 2024-02-21T23:02:09.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.519+0000 7f9873e00640 1 --2- 172.21.15.99:0/605076620 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f984c09edf0 0x7f984c0a12b0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:09.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.519+0000 7f9873e00640 1 --2- 172.21.15.99:0/605076620 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f986c220b70 0x7f986c187d10 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:09.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.519+0000 7f9873e00640 1 --2- 172.21.15.99:0/605076620 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f986c18bcf0 0x7f986c2256d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:09.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.519+0000 7f9873e00640 1 --2- 172.21.15.99:0/605076620 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f986c15de70 0x7f986c156eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:09.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.519+0000 7f9873e00640 1 -- 172.21.15.99:0/605076620 >> 172.21.15.99:0/605076620 conn(0x7f986c0740b0 msgr2=0x7f986c074490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:09.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.519+0000 7f9873e00640 1 -- 172.21.15.99:0/605076620 shutdown_connections 2024-02-21T23:02:09.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.519+0000 7f9873e00640 1 -- 172.21.15.99:0/605076620 wait complete. 2024-02-21T23:02:09.528 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T23:02:09.528 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T23:02:09.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.733+0000 7fd48e000640 1 Processor -- start 2024-02-21T23:02:09.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.733+0000 7fd48e000640 1 -- start start 2024-02-21T23:02:09.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.737+0000 7fd48e000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd488182d10 0x7fd4880d22d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:09.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.737+0000 7fd48e000640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fd4880d2810 0x7fd4880d4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:09.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.737+0000 7fd48e000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4880d2cc0 con 0x7fd4880d54f0 2024-02-21T23:02:09.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.737+0000 7fd48e000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4880d0f50 con 0x7fd488182d10 2024-02-21T23:02:09.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.737+0000 7fd48e000640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4880d1230 con 0x7fd4880d2810 2024-02-21T23:02:09.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.737+0000 7fd486a00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fd4880d2810 0x7fd4880d4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:09.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.737+0000 7fd487e00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fd4880d54f0 0x7fd48818c2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:51704/0 (socket says 172.21.15.99:51704) 2024-02-21T23:02:09.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.737+0000 7fd487e00640 1 -- 172.21.15.99:0/298808423 learned_addr learned my addr 172.21.15.99:0/298808423 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:02:09.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.737+0000 7fd487400640 1 --2- 172.21.15.99:0/298808423 >> v2:172.21.15.162:3300/0 conn(0x7fd488182d10 0x7fd4880d22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:09.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.738+0000 7fd486a00640 1 -- 172.21.15.99:0/298808423 >> v2:172.21.15.162:3300/0 conn(0x7fd488182d10 msgr2=0x7fd4880d22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:09.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.738+0000 7fd486a00640 1 --2- 172.21.15.99:0/298808423 >> v2:172.21.15.162:3300/0 conn(0x7fd488182d10 0x7fd4880d22d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:09.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.738+0000 7fd486a00640 1 -- 172.21.15.99:0/298808423 >> v1:172.21.15.99:6789/0 conn(0x7fd4880d54f0 legacy=0x7fd48818c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:09.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.738+0000 7fd486a00640 1 -- 172.21.15.99:0/298808423 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4880d1510 con 0x7fd4880d2810 2024-02-21T23:02:09.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.739+0000 7fd486a00640 1 --2- 172.21.15.99:0/298808423 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd4880d2810 0x7fd4880d4fb0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd4880f8f10 tx=0x7fd47402b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77af809d678d890a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:09.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.740+0000 7fd486000640 1 -- 172.21.15.99:0/298808423 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4740315a0 con 0x7fd4880d2810 2024-02-21T23:02:09.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.740+0000 7fd486000640 1 -- 172.21.15.99:0/298808423 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd474037070 con 0x7fd4880d2810 2024-02-21T23:02:09.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.740+0000 7fd486000640 1 -- 172.21.15.99:0/298808423 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd474031960 con 0x7fd4880d2810 2024-02-21T23:02:09.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.740+0000 7fd48e000640 1 -- 172.21.15.99:0/298808423 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd4880d2810 msgr2=0x7fd4880d4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:09.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.740+0000 7fd48e000640 1 --2- 172.21.15.99:0/298808423 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd4880d2810 0x7fd4880d4fb0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd4880f8f10 tx=0x7fd47402b840 comp rx=0 tx=0).stop 2024-02-21T23:02:09.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.740+0000 7fd48e000640 1 -- 172.21.15.99:0/298808423 shutdown_connections 2024-02-21T23:02:09.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.741+0000 7fd48e000640 1 --2- 172.21.15.99:0/298808423 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd4880d2810 0x7fd4880d4fb0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:09.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.741+0000 7fd48e000640 1 --2- 172.21.15.99:0/298808423 >> v2:172.21.15.162:3300/0 conn(0x7fd488182d10 0x7fd4880d22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:09.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.741+0000 7fd48e000640 1 -- 172.21.15.99:0/298808423 >> 172.21.15.99:0/298808423 conn(0x7fd4880740b0 msgr2=0x7fd4880744c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:09.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.741+0000 7fd48e000640 1 -- 172.21.15.99:0/298808423 shutdown_connections 2024-02-21T23:02:09.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.741+0000 7fd48e000640 1 -- 172.21.15.99:0/298808423 wait complete. 2024-02-21T23:02:09.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.743+0000 7fd48e000640 1 Processor -- start 2024-02-21T23:02:09.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.743+0000 7fd48e000640 1 -- start start 2024-02-21T23:02:09.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.745+0000 7fd48e000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd4880d2810 0x7fd48816ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:09.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.745+0000 7fd48e000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd4880d54f0 0x7fd488220690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:09.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.745+0000 7fd48e000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd488182d10 0x7fd488222790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:09.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.745+0000 7fd48e000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4880d1db0 con 0x7fd4880d2810 2024-02-21T23:02:09.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.745+0000 7fd48e000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4880d1ad0 con 0x7fd488182d10 2024-02-21T23:02:09.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.745+0000 7fd48e000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4881830f0 con 0x7fd4880d54f0 2024-02-21T23:02:09.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.745+0000 7fd487400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd4880d2810 0x7fd48816ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:09.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.745+0000 7fd487400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd4880d2810 0x7fd48816ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60358/0 (socket says 172.21.15.99:60358) 2024-02-21T23:02:09.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.745+0000 7fd487400640 1 -- 172.21.15.99:0/433518645 learned_addr learned my addr 172.21.15.99:0/433518645 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:09.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.746+0000 7fd487e00640 1 --2- 172.21.15.99:0/433518645 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd488182d10 0x7fd488222790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:09.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.746+0000 7fd486a00640 1 --2- 172.21.15.99:0/433518645 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd4880d54f0 0x7fd488220690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:09.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.746+0000 7fd487400640 1 -- 172.21.15.99:0/433518645 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd4880d54f0 msgr2=0x7fd488220690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:09.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.746+0000 7fd487400640 1 --2- 172.21.15.99:0/433518645 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd4880d54f0 0x7fd488220690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:09.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.746+0000 7fd487400640 1 -- 172.21.15.99:0/433518645 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd488182d10 msgr2=0x7fd488222790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:09.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.746+0000 7fd487400640 1 --2- 172.21.15.99:0/433518645 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd488182d10 0x7fd488222790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:09.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.746+0000 7fd487400640 1 -- 172.21.15.99:0/433518645 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4880f94b0 con 0x7fd4880d2810 2024-02-21T23:02:09.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.746+0000 7fd487400640 1 --2- 172.21.15.99:0/433518645 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd4880d2810 0x7fd48816ab00 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd47800e9b0 tx=0x7fd47800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:09.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.747+0000 7fd47f400640 1 -- 172.21.15.99:0/433518645 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd478017070 con 0x7fd4880d2810 2024-02-21T23:02:09.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.747+0000 7fd47f400640 1 -- 172.21.15.99:0/433518645 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd47800c9a0 con 0x7fd4880d2810 2024-02-21T23:02:09.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.747+0000 7fd47f400640 1 -- 172.21.15.99:0/433518645 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd47800cd90 con 0x7fd4880d2810 2024-02-21T23:02:09.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.747+0000 7fd48e000640 1 -- 172.21.15.99:0/433518645 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4880f9790 con 0x7fd4880d2810 2024-02-21T23:02:09.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.747+0000 7fd48e000640 1 -- 172.21.15.99:0/433518645 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4880f9d50 con 0x7fd4880d2810 2024-02-21T23:02:09.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.750+0000 7fd47f400640 1 -- 172.21.15.99:0/433518645 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 6) v1 ==== 134407+0+0 (secure 0 0 0) 0x7fd47801a070 con 0x7fd4880d2810 2024-02-21T23:02:09.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.752+0000 7fd47f400640 1 --2- 172.21.15.99:0/433518645 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fd46809edf0 0x7fd4680a12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:09.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.752+0000 7fd47f400640 1 -- 172.21.15.99:0/433518645 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fd4780c9e40 con 0x7fd4880d2810 2024-02-21T23:02:09.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.753+0000 7fd490ff6740 1 Processor -- start 2024-02-21T23:02:09.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.753+0000 7fd486a00640 1 --2- 172.21.15.99:0/433518645 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fd46809edf0 0x7fd4680a12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:09.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.753+0000 7fd490ff6740 1 -- start start 2024-02-21T23:02:09.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.754+0000 7fd486a00640 1 --2- 172.21.15.99:0/433518645 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fd46809edf0 0x7fd4680a12b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd474036000 tx=0x7fd47403d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:09.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.755+0000 7fd490ff6740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a78340d0d0 0x55a783442b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:09.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.755+0000 7fd490ff6740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a783443090 0x55a78340d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:09.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.755+0000 7fd490ff6740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a78340d9f0 0x55a7833d0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:09.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.755+0000 7fd490ff6740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a783339a90 con 0x55a783443090 2024-02-21T23:02:09.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.755+0000 7fd490ff6740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7832e2b10 con 0x55a78340d9f0 2024-02-21T23:02:09.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.755+0000 7fd490ff6740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a783335b30 con 0x55a78340d0d0 2024-02-21T23:02:09.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.755+0000 7fd487400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a78340d0d0 0x55a783442b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:09.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.755+0000 7fd486a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a783443090 0x55a78340d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:09.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.755+0000 7fd487e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a78340d9f0 0x55a7833d0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:09.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.755+0000 7fd487400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a78340d0d0 0x55a783442b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:51040/0 (socket says 172.21.15.99:51040) 2024-02-21T23:02:09.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.755+0000 7fd487400640 1 -- 172.21.15.99:0/929507603 learned_addr learned my addr 172.21.15.99:0/929507603 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:09.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.756+0000 7fd487400640 1 -- 172.21.15.99:0/929507603 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a78340d9f0 msgr2=0x55a7833d0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:09.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.756+0000 7fd487400640 1 --2- 172.21.15.99:0/929507603 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a78340d9f0 0x55a7833d0000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:09.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.756+0000 7fd487400640 1 -- 172.21.15.99:0/929507603 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a783443090 msgr2=0x55a78340d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:09.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.756+0000 7fd487400640 1 --2- 172.21.15.99:0/929507603 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a783443090 0x55a78340d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:09.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.756+0000 7fd487400640 1 -- 172.21.15.99:0/929507603 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a7831187d0 con 0x55a78340d0d0 2024-02-21T23:02:09.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.756+0000 7fd487400640 1 --2- 172.21.15.99:0/929507603 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a78340d0d0 0x55a783442b50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd47809fb40 tx=0x7fd478097680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8db33c8cadcdc301 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:09.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.756+0000 7fd473400640 1 -- 172.21.15.99:0/929507603 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd478021070 con 0x55a78340d0d0 2024-02-21T23:02:09.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.756+0000 7fd473400640 1 -- 172.21.15.99:0/929507603 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4780c78e0 con 0x55a78340d0d0 2024-02-21T23:02:09.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.756+0000 7fd473400640 1 -- 172.21.15.99:0/929507603 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd478096e60 con 0x55a78340d0d0 2024-02-21T23:02:09.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.757+0000 7fd490ff6740 1 -- 172.21.15.99:0/929507603 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a78340d0d0 msgr2=0x55a783442b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:09.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.757+0000 7fd490ff6740 1 --2- 172.21.15.99:0/929507603 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a78340d0d0 0x55a783442b50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd47809fb40 tx=0x7fd478097680 comp rx=0 tx=0).stop 2024-02-21T23:02:09.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.757+0000 7fd490ff6740 1 -- 172.21.15.99:0/929507603 shutdown_connections 2024-02-21T23:02:09.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.757+0000 7fd490ff6740 1 --2- 172.21.15.99:0/929507603 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a78340d9f0 0x55a7833d0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:09.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.757+0000 7fd490ff6740 1 --2- 172.21.15.99:0/929507603 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a783443090 0x55a78340d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:09.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.757+0000 7fd490ff6740 1 --2- 172.21.15.99:0/929507603 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a78340d0d0 0x55a783442b50 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:09.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.757+0000 7fd490ff6740 1 -- 172.21.15.99:0/929507603 >> 172.21.15.99:0/929507603 conn(0x55a78339c6b0 msgr2=0x55a7833d3fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:09.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.758+0000 7fd490ff6740 1 -- 172.21.15.99:0/929507603 shutdown_connections 2024-02-21T23:02:09.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.758+0000 7fd490ff6740 1 -- 172.21.15.99:0/929507603 wait complete. 2024-02-21T23:02:09.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.759+0000 7fd490ff6740 1 -- start start 2024-02-21T23:02:09.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.759+0000 7fd490ff6740 1 Processor -- start 2024-02-21T23:02:09.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.760+0000 7fd490ff6740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a78340d0d0 0x55a783453030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:09.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.760+0000 7fd490ff6740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a78340d9f0 0x55a783402ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:09.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.760+0000 7fd490ff6740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a783443090 0x55a783405760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:09.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.761+0000 7fd490ff6740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7833dbd60 con 0x55a78340d9f0 2024-02-21T23:02:09.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.761+0000 7fd490ff6740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7832d81c0 con 0x55a783443090 2024-02-21T23:02:09.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.761+0000 7fd490ff6740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a783444760 con 0x55a78340d0d0 2024-02-21T23:02:09.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.761+0000 7fd490ff6740 10 client.0 _ll_register_callbacks cb 0x55a7832f5930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:02:09.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.761+0000 7fd486a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a78340d9f0 0x55a783402ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:09.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.761+0000 7fd487e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a783443090 0x55a783405760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:09.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.761+0000 7fd486a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a78340d9f0 0x55a783402ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60384/0 (socket says 172.21.15.99:60384) 2024-02-21T23:02:09.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.761+0000 7fd486a00640 1 -- 172.21.15.99:0/2869762704 learned_addr learned my addr 172.21.15.99:0/2869762704 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:09.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.761+0000 7fd487400640 1 --2- 172.21.15.99:0/2869762704 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a78340d0d0 0x55a783453030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:09.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.761+0000 7fd486a00640 1 -- 172.21.15.99:0/2869762704 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a78340d0d0 msgr2=0x55a783453030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:09.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.761+0000 7fd486a00640 1 --2- 172.21.15.99:0/2869762704 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a78340d0d0 0x55a783453030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:09.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.761+0000 7fd486a00640 1 -- 172.21.15.99:0/2869762704 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a783443090 msgr2=0x55a783405760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:09.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.761+0000 7fd486a00640 1 --2- 172.21.15.99:0/2869762704 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a783443090 0x55a783405760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:09.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.761+0000 7fd486a00640 1 -- 172.21.15.99:0/2869762704 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a78304e3f0 con 0x55a78340d9f0 2024-02-21T23:02:09.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.761+0000 7fd487e00640 1 --2- 172.21.15.99:0/2869762704 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a783443090 0x55a783405760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:02:09.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.762+0000 7fd486a00640 1 --2- 172.21.15.99:0/2869762704 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a78340d9f0 0x55a783402ee0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd474009860 tx=0x7fd47402e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab15dddc24dc7246 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:09.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.762+0000 7fd467e00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:02:09.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.762+0000 7fd467e00640 1 -- 172.21.15.99:0/2869762704 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd474045630 con 0x55a78340d9f0 2024-02-21T23:02:09.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.762+0000 7fd467e00640 1 -- 172.21.15.99:0/2869762704 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fd4740457d0 con 0x55a78340d9f0 2024-02-21T23:02:09.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.762+0000 7fd490ff6740 1 -- 172.21.15.99:0/2869762704 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd4780c78e0 con 0x55a78340d9f0 2024-02-21T23:02:09.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.762+0000 7fd467e00640 1 -- 172.21.15.99:0/2869762704 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd4740459d0 con 0x55a78340d9f0 2024-02-21T23:02:09.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.762+0000 7fd490ff6740 10 client.5031 fetch_fsmap learned FSMap version 15 2024-02-21T23:02:09.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.762+0000 7fd490ff6740 1 -- 172.21.15.99:0/2869762704 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x55a78300e0f0 con 0x55a78340d9f0 2024-02-21T23:02:09.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.763+0000 7fd467e00640 1 -- 172.21.15.99:0/2869762704 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4780c78e0 con 0x55a78340d9f0 2024-02-21T23:02:09.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.763+0000 7fd467e00640 1 -- 172.21.15.99:0/2869762704 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 15) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fd474057030 con 0x55a78340d9f0 2024-02-21T23:02:09.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.763+0000 7fd490ff6740 10 client.5031 fetch_fsmap finished waiting for FSMap version 15 2024-02-21T23:02:09.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.763+0000 7fd490ff6740 10 client.5031 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:02:09.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.763+0000 7fd490ff6740 20 client.5031 populate_metadata read hostname 'smithi099' 2024-02-21T23:02:09.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.763+0000 7fd490ff6740 1 --2- 172.21.15.99:0/2869762704 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55a783405280 0x55a783443d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:09.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.763+0000 7fd490ff6740 4 client.5031 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:02:09.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.763+0000 7fd490ff6740 1 -- 172.21.15.99:0/2869762704 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a783346fd0 con 0x55a783405280 2024-02-21T23:02:09.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.763+0000 7fd487400640 1 --2- 172.21.15.99:0/2869762704 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55a783405280 0x55a783443d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:09.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.764+0000 7fd487400640 1 --2- 172.21.15.99:0/2869762704 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55a783405280 0x55a783443d80 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51f921492e0d54c8 server_cookie=20d442e39b96653c in_seq=0 out_seq=0 2024-02-21T23:02:09.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.764+0000 7fd467e00640 10 client.5031 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:02:09.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.764+0000 7fd467e00640 1 -- 172.21.15.99:0/2869762704 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55a783346fd0 con 0x55a783405280 2024-02-21T23:02:09.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.764+0000 7fd467e00640 10 client.5031 handle_command_reply: tid=0 2024-02-21T23:02:09.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.765+0000 7fd490ff6740 1 client.5031 shutdown 2024-02-21T23:02:09.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.765+0000 7fd490ff6740 1 -- 172.21.15.99:0/2869762704 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a78340d9f0 msgr2=0x55a783402ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:09.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.765+0000 7fd490ff6740 1 --2- 172.21.15.99:0/2869762704 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a78340d9f0 0x55a783402ee0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd474009860 tx=0x7fd47402e000 comp rx=0 tx=0).stop 2024-02-21T23:02:09.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.765+0000 7fd490ff6740 1 -- 172.21.15.99:0/2869762704 shutdown_connections 2024-02-21T23:02:09.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.765+0000 7fd490ff6740 1 --2- 172.21.15.99:0/2869762704 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55a783405280 0x55a783443d80 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:09.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.765+0000 7fd467e00640 0 client.5031 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:02:09.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.765+0000 7fd490ff6740 1 --2- 172.21.15.99:0/2869762704 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a783443090 0x55a783405760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:09.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.765+0000 7fd490ff6740 1 --2- 172.21.15.99:0/2869762704 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a78340d9f0 0x55a783402ee0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:09.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.765+0000 7fd490ff6740 1 --2- 172.21.15.99:0/2869762704 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a78340d0d0 0x55a783453030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:09.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.765+0000 7fd490ff6740 1 -- 172.21.15.99:0/2869762704 >> 172.21.15.99:0/2869762704 conn(0x55a78339c6b0 msgr2=0x55a7833d49b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:09.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.765+0000 7fd490ff6740 1 -- 172.21.15.99:0/2869762704 shutdown_connections 2024-02-21T23:02:09.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.765+0000 7fd490ff6740 1 -- 172.21.15.99:0/2869762704 wait complete. 2024-02-21T23:02:09.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.765+0000 7fd490ff6740 20 client.5031 trim_cache size 0 max 16384 2024-02-21T23:02:09.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.794+0000 7fd490ff6740 1 Processor -- start 2024-02-21T23:02:09.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.794+0000 7fd490ff6740 1 -- start start 2024-02-21T23:02:09.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.795+0000 7fd490ff6740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a783405280 0x55a783453010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:09.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.795+0000 7fd490ff6740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a78340d0d0 0x55a7833d2f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:09.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.795+0000 7fd490ff6740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a78340d9f0 0x55a78343f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:09.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.795+0000 7fd490ff6740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd488228460 con 0x55a78340d0d0 2024-02-21T23:02:09.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.795+0000 7fd490ff6740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd48806fbb0 con 0x55a783405280 2024-02-21T23:02:09.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.795+0000 7fd490ff6740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd48821fc80 con 0x55a78340d9f0 2024-02-21T23:02:09.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.795+0000 7fd487400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a783405280 0x55a783453010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:09.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.795+0000 7fd486a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a78340d0d0 0x55a7833d2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:09.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.795+0000 7fd486a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a78340d0d0 0x55a7833d2f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60390/0 (socket says 172.21.15.99:60390) 2024-02-21T23:02:09.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.795+0000 7fd486a00640 1 -- 172.21.15.99:0/1578961 learned_addr learned my addr 172.21.15.99:0/1578961 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:09.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.795+0000 7fd487400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a783405280 0x55a783453010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:59936/0 (socket says 172.21.15.99:59936) 2024-02-21T23:02:09.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.796+0000 7fd487e00640 1 --2- 172.21.15.99:0/1578961 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a78340d9f0 0x55a78343f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:09.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.796+0000 7fd486a00640 1 -- 172.21.15.99:0/1578961 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a78340d9f0 msgr2=0x55a78343f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:09.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.796+0000 7fd486a00640 1 --2- 172.21.15.99:0/1578961 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a78340d9f0 0x55a78343f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:09.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.796+0000 7fd486a00640 1 -- 172.21.15.99:0/1578961 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a783405280 msgr2=0x55a783453010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:09.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.796+0000 7fd486a00640 1 --2- 172.21.15.99:0/1578961 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a783405280 0x55a783453010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:09.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.796+0000 7fd486a00640 1 -- 172.21.15.99:0/1578961 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a78340d820 con 0x55a78340d0d0 2024-02-21T23:02:09.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.796+0000 7fd487400640 1 --2- 172.21.15.99:0/1578961 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a783405280 0x55a783453010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:02:09.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.796+0000 7fd486a00640 1 --2- 172.21.15.99:0/1578961 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a78340d0d0 0x55a7833d2f40 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd4740316f0 tx=0x7fd474009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60bc08f92ef3ae72 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:09.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.796+0000 7fd472a00640 1 -- 172.21.15.99:0/1578961 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd474045630 con 0x55a78340d0d0 2024-02-21T23:02:09.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.796+0000 7fd472a00640 1 -- 172.21.15.99:0/1578961 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd474037040 con 0x55a78340d0d0 2024-02-21T23:02:09.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.796+0000 7fd472a00640 1 -- 172.21.15.99:0/1578961 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd474050420 con 0x55a78340d0d0 2024-02-21T23:02:09.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.797+0000 7fd490ff6740 1 -- 172.21.15.99:0/1578961 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a78340d0d0 msgr2=0x55a7833d2f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:09.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.797+0000 7fd490ff6740 1 --2- 172.21.15.99:0/1578961 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a78340d0d0 0x55a7833d2f40 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd4740316f0 tx=0x7fd474009190 comp rx=0 tx=0).stop 2024-02-21T23:02:09.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.797+0000 7fd490ff6740 1 -- 172.21.15.99:0/1578961 shutdown_connections 2024-02-21T23:02:09.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.797+0000 7fd490ff6740 1 --2- 172.21.15.99:0/1578961 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a78340d9f0 0x55a78343f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:09.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.797+0000 7fd490ff6740 1 --2- 172.21.15.99:0/1578961 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a78340d0d0 0x55a7833d2f40 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:09.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.797+0000 7fd490ff6740 1 --2- 172.21.15.99:0/1578961 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a783405280 0x55a783453010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:09.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.797+0000 7fd490ff6740 1 -- 172.21.15.99:0/1578961 >> 172.21.15.99:0/1578961 conn(0x55a78339c6b0 msgr2=0x55a7833caf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:09.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.797+0000 7fd490ff6740 1 -- 172.21.15.99:0/1578961 shutdown_connections 2024-02-21T23:02:09.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.798+0000 7fd490ff6740 1 -- 172.21.15.99:0/1578961 wait complete. 2024-02-21T23:02:09.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.799+0000 7fd490ff6740 1 -- start start 2024-02-21T23:02:09.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.799+0000 7fd490ff6740 1 Processor -- start 2024-02-21T23:02:09.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.801+0000 7fd490ff6740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a783405280 0x55a7833f82d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:09.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.801+0000 7fd490ff6740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a78340d0d0 0x55a7834a9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:09.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.801+0000 7fd490ff6740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a78340d9f0 0x55a7834a9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:09.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.801+0000 7fd490ff6740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd48806e310 con 0x55a78340d0d0 2024-02-21T23:02:09.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.801+0000 7fd490ff6740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd48806f550 con 0x55a78340d9f0 2024-02-21T23:02:09.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.801+0000 7fd490ff6740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd48806e910 con 0x55a783405280 2024-02-21T23:02:09.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.801+0000 7fd490ff6740 10 client.0 _ll_register_callbacks cb 0x7fd474031c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:02:09.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.801+0000 7fd486a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a78340d0d0 0x55a7834a9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:09.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.802+0000 7fd487400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a783405280 0x55a7833f82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:09.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.802+0000 7fd486a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a78340d0d0 0x55a7834a9760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60406/0 (socket says 172.21.15.99:60406) 2024-02-21T23:02:09.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.802+0000 7fd486a00640 1 -- 172.21.15.99:0/3343872094 learned_addr learned my addr 172.21.15.99:0/3343872094 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:09.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.802+0000 7fd487e00640 1 --2- 172.21.15.99:0/3343872094 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a78340d9f0 0x55a7834a9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:09.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.802+0000 7fd487400640 1 -- 172.21.15.99:0/3343872094 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a78340d9f0 msgr2=0x55a7834a9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:09.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.802+0000 7fd487400640 1 --2- 172.21.15.99:0/3343872094 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a78340d9f0 0x55a7834a9ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:09.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.802+0000 7fd487400640 1 -- 172.21.15.99:0/3343872094 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a78340d0d0 msgr2=0x55a7834a9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:09.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.802+0000 7fd487400640 1 --2- 172.21.15.99:0/3343872094 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a78340d0d0 0x55a7834a9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:09.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.802+0000 7fd487400640 1 -- 172.21.15.99:0/3343872094 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a7833d47b0 con 0x55a783405280 2024-02-21T23:02:09.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.802+0000 7fd486a00640 1 --2- 172.21.15.99:0/3343872094 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a78340d0d0 0x55a7834a9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:02:09.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.802+0000 7fd487400640 1 --2- 172.21.15.99:0/3343872094 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a783405280 0x55a7833f82d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd4780c77d0 tx=0x7fd478009f60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35309b37bf7b400c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:09.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.802+0000 7fd467e00640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-02-21T23:02:09.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.803+0000 7fd467e00640 1 -- 172.21.15.99:0/3343872094 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4780c78e0 con 0x55a783405280 2024-02-21T23:02:09.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.803+0000 7fd467e00640 1 -- 172.21.15.99:0/3343872094 <== mon.2 v2:172.21.15.181:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7fd478096e60 con 0x55a783405280 2024-02-21T23:02:09.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.803+0000 7fd490ff6740 1 -- 172.21.15.99:0/3343872094 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd474037040 con 0x55a783405280 2024-02-21T23:02:09.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.803+0000 7fd467e00640 1 -- 172.21.15.99:0/3343872094 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd478097060 con 0x55a783405280 2024-02-21T23:02:09.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.803+0000 7fd490ff6740 10 client.5105 fetch_fsmap learned FSMap version 15 2024-02-21T23:02:09.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.803+0000 7fd490ff6740 1 -- 172.21.15.99:0/3343872094 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x55a7834aa1e0 con 0x55a783405280 2024-02-21T23:02:09.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.803+0000 7fd467e00640 1 -- 172.21.15.99:0/3343872094 <== mon.2 v2:172.21.15.181:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4780c3030 con 0x55a783405280 2024-02-21T23:02:09.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.803+0000 7fd467e00640 1 -- 172.21.15.99:0/3343872094 <== mon.2 v2:172.21.15.181:3300/0 5 ==== fsmap(e 15) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fd478093760 con 0x55a783405280 2024-02-21T23:02:09.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.803+0000 7fd490ff6740 10 client.5105 fetch_fsmap finished waiting for FSMap version 15 2024-02-21T23:02:09.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.803+0000 7fd490ff6740 10 client.5105 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:02:09.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.803+0000 7fd490ff6740 20 client.5105 populate_metadata read hostname 'smithi099' 2024-02-21T23:02:09.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.803+0000 7fd490ff6740 1 --2- 172.21.15.99:0/3343872094 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55a783443090 0x55a7834bfbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:09.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.803+0000 7fd490ff6740 4 client.5105 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T23:02:09.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.803+0000 7fd490ff6740 1 -- 172.21.15.99:0/3343872094 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55a783341320 con 0x55a783443090 2024-02-21T23:02:09.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.804+0000 7fd486a00640 1 --2- 172.21.15.99:0/3343872094 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55a783443090 0x55a7834bfbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:09.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.805+0000 7fd486a00640 1 --2- 172.21.15.99:0/3343872094 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55a783443090 0x55a7834bfbb0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3fa07f9905b13370 server_cookie=8e7970e153e0635f in_seq=0 out_seq=0 2024-02-21T23:02:09.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.805+0000 7fd467e00640 10 client.5105 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:02:09.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.805+0000 7fd467e00640 1 -- 172.21.15.99:0/3343872094 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55a783341320 con 0x55a783443090 2024-02-21T23:02:09.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.805+0000 7fd467e00640 10 client.5105 handle_command_reply: tid=0 2024-02-21T23:02:09.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.805+0000 7fd490ff6740 1 client.5105 shutdown 2024-02-21T23:02:09.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.805+0000 7fd490ff6740 1 -- 172.21.15.99:0/3343872094 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a783405280 msgr2=0x55a7833f82d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:09.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.806+0000 7fd490ff6740 1 --2- 172.21.15.99:0/3343872094 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a783405280 0x55a7833f82d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd4780c77d0 tx=0x7fd478009f60 comp rx=0 tx=0).stop 2024-02-21T23:02:09.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.806+0000 7fd490ff6740 1 -- 172.21.15.99:0/3343872094 shutdown_connections 2024-02-21T23:02:09.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.806+0000 7fd490ff6740 1 --2- 172.21.15.99:0/3343872094 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55a783443090 0x55a7834bfbb0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:09.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.806+0000 7fd467e00640 0 client.5105 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:02:09.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.806+0000 7fd490ff6740 1 --2- 172.21.15.99:0/3343872094 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a78340d9f0 0x55a7834a9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:09.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.806+0000 7fd490ff6740 1 --2- 172.21.15.99:0/3343872094 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a78340d0d0 0x55a7834a9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:09.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.806+0000 7fd490ff6740 1 --2- 172.21.15.99:0/3343872094 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a783405280 0x55a7833f82d0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:09.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.806+0000 7fd490ff6740 1 -- 172.21.15.99:0/3343872094 >> 172.21.15.99:0/3343872094 conn(0x55a78339c6b0 msgr2=0x55a78343f350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:09.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.806+0000 7fd490ff6740 1 -- 172.21.15.99:0/3343872094 shutdown_connections 2024-02-21T23:02:09.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.806+0000 7fd490ff6740 1 -- 172.21.15.99:0/3343872094 wait complete. 2024-02-21T23:02:09.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.806+0000 7fd490ff6740 20 client.5105 trim_cache size 0 max 16384 2024-02-21T23:02:09.798 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-02-21T23:02:09.798 INFO:teuthology.orchestra.run.smithi099.stdout: "status": "IDLE (waiting for more scrubs)", 2024-02-21T23:02:09.798 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubs": { 2024-02-21T23:02:09.798 INFO:teuthology.orchestra.run.smithi099.stdout: "0d0cc31b-8de0-426e-b754-853e4f0b5c30": { 2024-02-21T23:02:09.798 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/", 2024-02-21T23:02:09.798 INFO:teuthology.orchestra.run.smithi099.stdout: "tag": "0d0cc31b-8de0-426e-b754-853e4f0b5c30", 2024-02-21T23:02:09.798 INFO:teuthology.orchestra.run.smithi099.stdout: "options": "recursive,force" 2024-02-21T23:02:09.799 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:02:09.799 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:02:09.799 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-02-21T23:02:09.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.807+0000 7fd48e000640 1 -- 172.21.15.99:0/433518645 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fd46809edf0 msgr2=0x7fd4680a12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:09.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.807+0000 7fd48e000640 1 --2- 172.21.15.99:0/433518645 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fd46809edf0 0x7fd4680a12b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd474036000 tx=0x7fd47403d040 comp rx=0 tx=0).stop 2024-02-21T23:02:09.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.807+0000 7fd48e000640 1 -- 172.21.15.99:0/433518645 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd4880d2810 msgr2=0x7fd48816ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:09.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.807+0000 7fd48e000640 1 --2- 172.21.15.99:0/433518645 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd4880d2810 0x7fd48816ab00 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd47800e9b0 tx=0x7fd47800ee70 comp rx=0 tx=0).stop 2024-02-21T23:02:09.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.807+0000 7fd48e000640 1 -- 172.21.15.99:0/433518645 shutdown_connections 2024-02-21T23:02:09.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.807+0000 7fd48e000640 1 --2- 172.21.15.99:0/433518645 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7fd46809edf0 0x7fd4680a12b0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:09.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.807+0000 7fd48e000640 1 --2- 172.21.15.99:0/433518645 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd488182d10 0x7fd488222790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:09.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.807+0000 7fd48e000640 1 --2- 172.21.15.99:0/433518645 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd4880d54f0 0x7fd488220690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:09.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.807+0000 7fd48e000640 1 --2- 172.21.15.99:0/433518645 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd4880d2810 0x7fd48816ab00 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:09.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.807+0000 7fd48e000640 1 -- 172.21.15.99:0/433518645 >> 172.21.15.99:0/433518645 conn(0x7fd4880740b0 msgr2=0x7fd48817d590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:09.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.807+0000 7fd48e000640 1 -- 172.21.15.99:0/433518645 shutdown_connections 2024-02-21T23:02:09.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.807+0000 7fd48e000640 1 -- 172.21.15.99:0/433518645 wait complete. 2024-02-21T23:02:09.813 INFO:tasks.cephfs.filesystem:scrub status for tag:0d0cc31b-8de0-426e-b754-853e4f0b5c30 - {'path': '/', 'tag': '0d0cc31b-8de0-426e-b754-853e4f0b5c30', 'options': 'recursive,force'} 2024-02-21T23:02:09.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:09.869+0000 7f9198200640 1 -- 172.21.15.99:0/656864663 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f916c005850 con 0x7f9190070600 2024-02-21T23:02:10.230 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:02:10.235 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:02:10.237 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:02:10.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:10.561+0000 7f918d600640 1 -- 172.21.15.99:0/656864663 <== mon.2 v2:172.21.15.181:3300/0 7 ==== mgrmap(e 7) v1 ==== 134424+0+0 (secure 0 0 0) 0x7f9184093050 con 0x7f9190070600 2024-02-21T23:02:10.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:10.562+0000 7f918d600640 1 -- 172.21.15.99:0/656864663 <== mon.2 v2:172.21.15.181:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v7) v1 ==== 92+0+0 (secure 0 0 0) 0x7f918404adf0 con 0x7f9190070600 2024-02-21T23:02:10.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:10.567+0000 7f9198200640 1 -- 172.21.15.99:0/656864663 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f917009edf0 msgr2=0x7f91700a12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:10.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:10.567+0000 7f9198200640 1 --2- 172.21.15.99:0/656864663 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f917009edf0 0x7f91700a12b0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f91900f6d90 tx=0x7f917c009040 comp rx=0 tx=0).stop 2024-02-21T23:02:10.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:10.567+0000 7f9198200640 1 -- 172.21.15.99:0/656864663 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9190070600 msgr2=0x7f91900f5af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:10.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:10.567+0000 7f9198200640 1 --2- 172.21.15.99:0/656864663 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9190070600 0x7f91900f5af0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f918400c440 tx=0x7f918400c900 comp rx=0 tx=0).stop 2024-02-21T23:02:10.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:10.567+0000 7f9198200640 1 -- 172.21.15.99:0/656864663 shutdown_connections 2024-02-21T23:02:10.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:10.567+0000 7f9198200640 1 --2- 172.21.15.99:0/656864663 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f917009edf0 0x7f91700a12b0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:10.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:10.567+0000 7f9198200640 1 --2- 172.21.15.99:0/656864663 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9190186ec0 0x7f9190224880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:10.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:10.567+0000 7f9198200640 1 --2- 172.21.15.99:0/656864663 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9190186ae0 0x7f9190176a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:10.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:10.567+0000 7f9198200640 1 --2- 172.21.15.99:0/656864663 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9190070600 0x7f91900f5af0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:10.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:10.567+0000 7f9198200640 1 -- 172.21.15.99:0/656864663 >> 172.21.15.99:0/656864663 conn(0x7f91900cf740 msgr2=0x7f919015a430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:10.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:10.567+0000 7f9198200640 1 -- 172.21.15.99:0/656864663 shutdown_connections 2024-02-21T23:02:10.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:10.567+0000 7f9198200640 1 -- 172.21.15.99:0/656864663 wait complete. 2024-02-21T23:02:10.581 DEBUG:teuthology.orchestra.run.smithi099:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/allow_m_granularity true' 2024-02-21T23:02:10.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:10.814+0000 7f0411a00640 1 Processor -- start 2024-02-21T23:02:10.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:10.814+0000 7f0411a00640 1 -- start start 2024-02-21T23:02:10.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:10.816+0000 7f0411a00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f040c188e70 0x7f040c0f5650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:10.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:10.817+0000 7f0411a00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f040c183900 con 0x7f040c0f5b90 2024-02-21T23:02:10.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:10.817+0000 7f0411a00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f040c0f8f20 con 0x7f040c06ec30 2024-02-21T23:02:10.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:10.817+0000 7f0411a00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f040c183bc0 con 0x7f040c188e70 2024-02-21T23:02:10.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:10.817+0000 7f040aa00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f040c188e70 0x7f040c0f5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:10.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:10.817+0000 7f040b400640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f040c06ec30 0x7f040c0f6200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:40738/0 (socket says 172.21.15.99:40738) 2024-02-21T23:02:10.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:10.817+0000 7f040b400640 1 -- 172.21.15.99:0/1968161853 learned_addr learned my addr 172.21.15.99:0/1968161853 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:02:10.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:10.817+0000 7f040a000640 1 -- 172.21.15.99:0/1968161853 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2835314156 0 0) 0x7f040c0f8f20 con 0x7f040c06ec30 2024-02-21T23:02:10.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:10.817+0000 7f040aa00640 1 -- 172.21.15.99:0/1968161853 >> v1:172.21.15.181:6789/0 conn(0x7f040c06ec30 legacy=0x7f040c0f6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:10.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:10.817+0000 7f040aa00640 1 -- 172.21.15.99:0/1968161853 >> v1:172.21.15.99:6789/0 conn(0x7f040c0f5b90 legacy=0x7f040c06f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:10.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:10.817+0000 7f040aa00640 1 -- 172.21.15.99:0/1968161853 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f040c183ea0 con 0x7f040c188e70 2024-02-21T23:02:10.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:10.819+0000 7f040aa00640 1 --2- 172.21.15.99:0/1968161853 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f040c188e70 0x7f040c0f5650 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f03fc0097a0 tx=0x7f03fc02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fffc2415855d8913 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:10.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:10.819+0000 7f040a000640 1 -- 172.21.15.99:0/1968161853 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03fc035020 con 0x7f040c188e70 2024-02-21T23:02:10.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:10.819+0000 7f040a000640 1 -- 172.21.15.99:0/1968161853 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03fc031830 con 0x7f040c188e70 2024-02-21T23:02:10.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:10.819+0000 7f040a000640 1 -- 172.21.15.99:0/1968161853 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03fc031c00 con 0x7f040c188e70 2024-02-21T23:02:10.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:10.820+0000 7f0411a00640 1 -- 172.21.15.99:0/1968161853 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f040c188e70 msgr2=0x7f040c0f5650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:10.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:10.820+0000 7f0411a00640 1 --2- 172.21.15.99:0/1968161853 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f040c188e70 0x7f040c0f5650 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f03fc0097a0 tx=0x7f03fc02b8d0 comp rx=0 tx=0).stop 2024-02-21T23:02:10.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:10.820+0000 7f0411a00640 1 -- 172.21.15.99:0/1968161853 shutdown_connections 2024-02-21T23:02:10.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:10.820+0000 7f0411a00640 1 --2- 172.21.15.99:0/1968161853 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f040c188e70 0x7f040c0f5650 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:10.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:10.820+0000 7f0411a00640 1 -- 172.21.15.99:0/1968161853 >> 172.21.15.99:0/1968161853 conn(0x7f040c0ce610 msgr2=0x7f040c0cea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:10.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:10.820+0000 7f0411a00640 1 -- 172.21.15.99:0/1968161853 shutdown_connections 2024-02-21T23:02:10.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:10.820+0000 7f0411a00640 1 -- 172.21.15.99:0/1968161853 wait complete. 2024-02-21T23:02:10.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:10.823+0000 7f0411a00640 1 Processor -- start 2024-02-21T23:02:10.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:10.823+0000 7f0411a00640 1 -- start start 2024-02-21T23:02:10.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:10.825+0000 7f0411a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f040c06ec30 0x7f040c06c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:10.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:10.825+0000 7f0411a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f040c188e70 0x7f040c15e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:10.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:10.825+0000 7f0411a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f040c15e6d0 0x7f040c220d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:10.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:10.825+0000 7f0411a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f040c189250 con 0x7f040c188e70 2024-02-21T23:02:10.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:10.825+0000 7f0411a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f040c0f6910 con 0x7f040c15e6d0 2024-02-21T23:02:10.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:10.825+0000 7f0411a00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f040c1893d0 con 0x7f040c06ec30 2024-02-21T23:02:10.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:10.826+0000 7f040aa00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f040c06ec30 0x7f040c06c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:10.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:10.826+0000 7f0403e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f040c188e70 0x7f040c15e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:10.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:10.826+0000 7f040aa00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f040c06ec30 0x7f040c06c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:51100/0 (socket says 172.21.15.99:51100) 2024-02-21T23:02:10.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:10.826+0000 7f040aa00640 1 -- 172.21.15.99:0/1195778986 learned_addr learned my addr 172.21.15.99:0/1195778986 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:10.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:10.826+0000 7f040b400640 1 --2- 172.21.15.99:0/1195778986 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f040c15e6d0 0x7f040c220d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:10.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:10.826+0000 7f040aa00640 1 -- 172.21.15.99:0/1195778986 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f040c15e6d0 msgr2=0x7f040c220d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:10.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:10.826+0000 7f040aa00640 1 --2- 172.21.15.99:0/1195778986 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f040c15e6d0 0x7f040c220d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:10.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:10.826+0000 7f040aa00640 1 -- 172.21.15.99:0/1195778986 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f040c188e70 msgr2=0x7f040c15e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:10.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:10.826+0000 7f040aa00640 1 --2- 172.21.15.99:0/1195778986 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f040c188e70 0x7f040c15e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:10.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:10.826+0000 7f040aa00640 1 -- 172.21.15.99:0/1195778986 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f040c167440 con 0x7f040c06ec30 2024-02-21T23:02:10.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:10.827+0000 7f040aa00640 1 --2- 172.21.15.99:0/1195778986 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f040c06ec30 0x7f040c06c910 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f03fc0098c0 tx=0x7f03fc0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:10.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:10.827+0000 7f0402a00640 1 -- 172.21.15.99:0/1195778986 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03fc040070 con 0x7f040c06ec30 2024-02-21T23:02:10.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:10.827+0000 7f0402a00640 1 -- 172.21.15.99:0/1195778986 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03fc039a00 con 0x7f040c06ec30 2024-02-21T23:02:10.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:10.827+0000 7f0411a00640 1 -- 172.21.15.99:0/1195778986 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f040c167720 con 0x7f040c06ec30 2024-02-21T23:02:10.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:10.827+0000 7f0402a00640 1 -- 172.21.15.99:0/1195778986 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03fc035040 con 0x7f040c06ec30 2024-02-21T23:02:10.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:10.827+0000 7f0411a00640 1 -- 172.21.15.99:0/1195778986 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f040c220510 con 0x7f040c06ec30 2024-02-21T23:02:10.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:10.829+0000 7f0411a00640 1 -- 172.21.15.99:0/1195778986 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f040c069440 con 0x7f040c06ec30 2024-02-21T23:02:10.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:10.830+0000 7f0402a00640 1 -- 172.21.15.99:0/1195778986 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 7) v1 ==== 134424+0+0 (secure 0 0 0) 0x7f03fc038020 con 0x7f040c06ec30 2024-02-21T23:02:10.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:10.832+0000 7f0402a00640 1 --2- 172.21.15.99:0/1195778986 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f03e809ee40 0x7f03e80a1300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:10.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:10.833+0000 7f0402a00640 1 -- 172.21.15.99:0/1195778986 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f03fc0eb6a0 con 0x7f040c06ec30 2024-02-21T23:02:10.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:10.833+0000 7f0403e00640 1 -- 172.21.15.99:0/1195778986 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f03e809ee40 msgr2=0x7f03e80a1300 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.162:6800/1717094936 2024-02-21T23:02:10.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:10.833+0000 7f0403e00640 1 --2- 172.21.15.99:0/1195778986 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f03e809ee40 0x7f03e80a1300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T23:02:10.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:10.836+0000 7f0402a00640 1 -- 172.21.15.99:0/1195778986 <== mon.2 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f03fc0b9830 con 0x7f040c06ec30 2024-02-21T23:02:10.936 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-02-21T23:02:10.947+0000 7f1503a2e040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-02-21T23:02:10.938 INFO:tasks.ceph.mgr.z.smithi181.stderr:2024-02-21T23:02:10.948+0000 7f6fb8a41040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-02-21T23:02:10.982 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-02-21T23:02:10.993+0000 7f1503a2e040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-21T23:02:10.985 INFO:tasks.ceph.mgr.z.smithi181.stderr:2024-02-21T23:02:10.995+0000 7f6fb8a41040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-21T23:02:11.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.034+0000 7f0403e00640 1 -- 172.21.15.99:0/1195778986 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f03e809ee40 msgr2=0x7f03e80a1300 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.162:6800/1717094936 2024-02-21T23:02:11.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.034+0000 7f0403e00640 1 --2- 172.21.15.99:0/1195778986 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f03e809ee40 0x7f03e80a1300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T23:02:11.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.089+0000 7f0411a00640 1 -- 172.21.15.99:0/1195778986 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f040c0ce9f0 con 0x7f040c06ec30 2024-02-21T23:02:11.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.095+0000 7f0402a00640 1 -- 172.21.15.99:0/1195778986 <== mon.2 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v14)=0 v14) v1 ==== 138+0+0 (secure 0 0 0) 0x7f03fc0b9130 con 0x7f040c06ec30 2024-02-21T23:02:11.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.098+0000 7f0411a00640 1 -- 172.21.15.99:0/1195778986 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f03e809ee40 msgr2=0x7f03e80a1300 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-21T23:02:11.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.098+0000 7f0411a00640 1 --2- 172.21.15.99:0/1195778986 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f03e809ee40 0x7f03e80a1300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:11.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.098+0000 7f0411a00640 1 -- 172.21.15.99:0/1195778986 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f040c06ec30 msgr2=0x7f040c06c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:11.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.098+0000 7f0411a00640 1 --2- 172.21.15.99:0/1195778986 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f040c06ec30 0x7f040c06c910 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f03fc0098c0 tx=0x7f03fc0046c0 comp rx=0 tx=0).stop 2024-02-21T23:02:11.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.098+0000 7f0411a00640 1 -- 172.21.15.99:0/1195778986 shutdown_connections 2024-02-21T23:02:11.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.098+0000 7f0411a00640 1 --2- 172.21.15.99:0/1195778986 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f03e809ee40 0x7f03e80a1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:11.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.098+0000 7f0411a00640 1 --2- 172.21.15.99:0/1195778986 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f040c15e6d0 0x7f040c220d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:11.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.098+0000 7f0411a00640 1 --2- 172.21.15.99:0/1195778986 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f040c188e70 0x7f040c15e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:11.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.098+0000 7f0411a00640 1 --2- 172.21.15.99:0/1195778986 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f040c06ec30 0x7f040c06c910 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:11.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.098+0000 7f0411a00640 1 -- 172.21.15.99:0/1195778986 >> 172.21.15.99:0/1195778986 conn(0x7f040c0ce610 msgr2=0x7f040c182760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:11.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.098+0000 7f0411a00640 1 -- 172.21.15.99:0/1195778986 shutdown_connections 2024-02-21T23:02:11.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.099+0000 7f0411a00640 1 -- 172.21.15.99:0/1195778986 wait complete. 2024-02-21T23:02:11.113 DEBUG:teuthology.orchestra.run.smithi099:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/dump_on_update true' 2024-02-21T23:02:11.285 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-02-21T23:02:11.296+0000 7fe5fd8d3040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-02-21T23:02:11.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.325+0000 7f229d200640 1 Processor -- start 2024-02-21T23:02:11.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.326+0000 7f229d200640 1 -- start start 2024-02-21T23:02:11.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.329+0000 7f229d200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f229818a860 0x7f22980f97c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:11.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.329+0000 7f229d200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22980d1440 con 0x7f2298189760 2024-02-21T23:02:11.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.329+0000 7f229d200640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22980d1720 con 0x7f2298186530 2024-02-21T23:02:11.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.329+0000 7f229d200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2298186910 con 0x7f229818a860 2024-02-21T23:02:11.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.329+0000 7f2297400640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f2298186530 0x7f22980d0970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:40742/0 (socket says 172.21.15.99:40742) 2024-02-21T23:02:11.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.329+0000 7f2297400640 1 -- 172.21.15.99:0/1565918240 learned_addr learned my addr 172.21.15.99:0/1565918240 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:02:11.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.329+0000 7f2297e00640 1 --2- 172.21.15.99:0/1565918240 >> v2:172.21.15.99:3300/0 conn(0x7f229818a860 0x7f22980f97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:11.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.330+0000 7f2296000640 1 -- 172.21.15.99:0/1565918240 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 590798130 0 0) 0x7f22980d1720 con 0x7f2298186530 2024-02-21T23:02:11.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.330+0000 7f2296000640 1 -- 172.21.15.99:0/1565918240 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f227c003520 con 0x7f2298186530 2024-02-21T23:02:11.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.330+0000 7f2297e00640 1 -- 172.21.15.99:0/1565918240 >> v1:172.21.15.181:6789/0 conn(0x7f2298186530 legacy=0x7f22980d0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:11.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.330+0000 7f2297e00640 1 -- 172.21.15.99:0/1565918240 >> v1:172.21.15.99:6789/0 conn(0x7f2298189760 legacy=0x7f229818a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:11.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.330+0000 7f2297e00640 1 -- 172.21.15.99:0/1565918240 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22980d1a00 con 0x7f229818a860 2024-02-21T23:02:11.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.331+0000 7f2297e00640 1 --2- 172.21.15.99:0/1565918240 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f229818a860 0x7f22980f97c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2290009d90 tx=0x7f229002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8512d8779c3a0d16 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:11.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.331+0000 7f2296000640 1 -- 172.21.15.99:0/1565918240 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2290039070 con 0x7f229818a860 2024-02-21T23:02:11.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.331+0000 7f2296000640 1 -- 172.21.15.99:0/1565918240 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f229002cc60 con 0x7f229818a860 2024-02-21T23:02:11.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.331+0000 7f2296000640 1 -- 172.21.15.99:0/1565918240 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2290034660 con 0x7f229818a860 2024-02-21T23:02:11.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.332+0000 7f229d200640 1 -- 172.21.15.99:0/1565918240 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f229818a860 msgr2=0x7f22980f97c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:11.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.332+0000 7f229d200640 1 --2- 172.21.15.99:0/1565918240 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f229818a860 0x7f22980f97c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2290009d90 tx=0x7f229002beb0 comp rx=0 tx=0).stop 2024-02-21T23:02:11.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.332+0000 7f229d200640 1 -- 172.21.15.99:0/1565918240 shutdown_connections 2024-02-21T23:02:11.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.333+0000 7f229d200640 1 --2- 172.21.15.99:0/1565918240 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f229818a860 0x7f22980f97c0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:11.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.333+0000 7f229d200640 1 -- 172.21.15.99:0/1565918240 >> 172.21.15.99:0/1565918240 conn(0x7f22980f7330 msgr2=0x7f22980f7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:11.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.333+0000 7f229d200640 1 -- 172.21.15.99:0/1565918240 shutdown_connections 2024-02-21T23:02:11.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.333+0000 7f229d200640 1 -- 172.21.15.99:0/1565918240 wait complete. 2024-02-21T23:02:11.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.335+0000 7f229d200640 1 Processor -- start 2024-02-21T23:02:11.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.335+0000 7f229d200640 1 -- start start 2024-02-21T23:02:11.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.337+0000 7f229d200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2298186530 0x7f2298221330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:11.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.337+0000 7f229d200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2298189760 0x7f229816bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:11.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.337+0000 7f229d200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f229818a860 0x7f2298182320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:11.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.337+0000 7f229d200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22980d22a0 con 0x7f2298186530 2024-02-21T23:02:11.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.337+0000 7f229d200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22980d1fc0 con 0x7f2298189760 2024-02-21T23:02:11.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.337+0000 7f229d200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2298189bc0 con 0x7f229818a860 2024-02-21T23:02:11.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.337+0000 7f2297400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2298186530 0x7f2298221330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:11.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.337+0000 7f2296a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2298189760 0x7f229816bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:11.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.337+0000 7f2296a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2298189760 0x7f229816bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:59972/0 (socket says 172.21.15.99:59972) 2024-02-21T23:02:11.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.337+0000 7f2296a00640 1 -- 172.21.15.99:0/3768981389 learned_addr learned my addr 172.21.15.99:0/3768981389 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:11.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.337+0000 7f2297400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2298186530 0x7f2298221330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60458/0 (socket says 172.21.15.99:60458) 2024-02-21T23:02:11.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.337+0000 7f2297e00640 1 --2- 172.21.15.99:0/3768981389 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f229818a860 0x7f2298182320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:11.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.338+0000 7f2297e00640 1 -- 172.21.15.99:0/3768981389 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2298189760 msgr2=0x7f229816bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:11.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.338+0000 7f2297e00640 1 --2- 172.21.15.99:0/3768981389 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2298189760 0x7f229816bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:11.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.338+0000 7f2297e00640 1 -- 172.21.15.99:0/3768981389 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2298186530 msgr2=0x7f2298221330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:11.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.338+0000 7f2297e00640 1 --2- 172.21.15.99:0/3768981389 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2298186530 0x7f2298221330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:11.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.338+0000 7f2297e00640 1 -- 172.21.15.99:0/3768981389 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f229816c2f0 con 0x7f229818a860 2024-02-21T23:02:11.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.338+0000 7f2297e00640 1 --2- 172.21.15.99:0/3768981389 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f229818a860 0x7f2298182320 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2290033000 tx=0x7f2290004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:11.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.338+0000 7f228f400640 1 -- 172.21.15.99:0/3768981389 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2290039050 con 0x7f229818a860 2024-02-21T23:02:11.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.338+0000 7f228f400640 1 -- 172.21.15.99:0/3768981389 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2290045070 con 0x7f229818a860 2024-02-21T23:02:11.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.338+0000 7f228f400640 1 -- 172.21.15.99:0/3768981389 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2290009450 con 0x7f229818a860 2024-02-21T23:02:11.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.338+0000 7f229d200640 1 -- 172.21.15.99:0/3768981389 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f229816c5d0 con 0x7f229818a860 2024-02-21T23:02:11.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.338+0000 7f229d200640 1 -- 172.21.15.99:0/3768981389 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f229816cb90 con 0x7f229818a860 2024-02-21T23:02:11.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.340+0000 7f229d200640 1 -- 172.21.15.99:0/3768981389 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22980758b0 con 0x7f229818a860 2024-02-21T23:02:11.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.343+0000 7f228f400640 1 -- 172.21.15.99:0/3768981389 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 7) v1 ==== 134424+0+0 (secure 0 0 0) 0x7f229003e850 con 0x7f229818a860 2024-02-21T23:02:11.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.344+0000 7f228f400640 1 --2- 172.21.15.99:0/3768981389 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f227809ee70 0x7f22780a1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:11.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.344+0000 7f2297400640 1 -- 172.21.15.99:0/3768981389 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f227809ee70 msgr2=0x7f22780a1330 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.162:6800/1717094936 2024-02-21T23:02:11.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.344+0000 7f228f400640 1 -- 172.21.15.99:0/3768981389 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f22900ec810 con 0x7f229818a860 2024-02-21T23:02:11.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.344+0000 7f2297400640 1 --2- 172.21.15.99:0/3768981389 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f227809ee70 0x7f22780a1330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T23:02:11.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.348+0000 7f228f400640 1 -- 172.21.15.99:0/3768981389 <== mon.2 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f22900bab20 con 0x7f229818a860 2024-02-21T23:02:11.366 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-02-21T23:02:11.377+0000 7fe5fd8d3040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-21T23:02:11.369 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-02-21T23:02:11.380+0000 7f1503a2e040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-21T23:02:11.375 INFO:tasks.ceph.mgr.z.smithi181.stderr:2024-02-21T23:02:11.385+0000 7f6fb8a41040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-21T23:02:11.412 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-02-21T23:02:11.423+0000 7f1503a2e040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-21T23:02:11.420 INFO:tasks.ceph.mgr.z.smithi181.stderr:2024-02-21T23:02:11.430+0000 7f6fb8a41040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-21T23:02:11.455 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-02-21T23:02:11.466+0000 7f1503a2e040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-21T23:02:11.463 INFO:tasks.ceph.mgr.z.smithi181.stderr:2024-02-21T23:02:11.473+0000 7f6fb8a41040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-21T23:02:11.507 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-02-21T23:02:11.518+0000 7f1503a2e040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-21T23:02:11.515 INFO:tasks.ceph.mgr.z.smithi181.stderr:2024-02-21T23:02:11.525+0000 7f6fb8a41040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-21T23:02:11.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.545+0000 7f2297400640 1 -- 172.21.15.99:0/3768981389 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f227809ee70 msgr2=0x7f22780a1330 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.162:6800/1717094936 2024-02-21T23:02:11.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.545+0000 7f2297400640 1 --2- 172.21.15.99:0/3768981389 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f227809ee70 0x7f22780a1330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T23:02:11.549 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-02-21T23:02:11.560+0000 7f1503a2e040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-21T23:02:11.557 INFO:tasks.ceph.mgr.z.smithi181.stderr:2024-02-21T23:02:11.567+0000 7f6fb8a41040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-21T23:02:11.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.612+0000 7f229d200640 1 -- 172.21.15.99:0/3768981389 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f22980ee180 con 0x7f229818a860 2024-02-21T23:02:11.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.617+0000 7f228f400640 1 -- 172.21.15.99:0/3768981389 <== mon.2 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v15)=0 v15) v1 ==== 133+0+0 (secure 0 0 0) 0x7f22900ba420 con 0x7f229818a860 2024-02-21T23:02:11.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.621+0000 7f229d200640 1 -- 172.21.15.99:0/3768981389 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f227809ee70 msgr2=0x7f22780a1330 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-21T23:02:11.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.621+0000 7f229d200640 1 --2- 172.21.15.99:0/3768981389 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f227809ee70 0x7f22780a1330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:11.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.621+0000 7f229d200640 1 -- 172.21.15.99:0/3768981389 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f229818a860 msgr2=0x7f2298182320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:11.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.621+0000 7f229d200640 1 --2- 172.21.15.99:0/3768981389 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f229818a860 0x7f2298182320 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2290033000 tx=0x7f2290004a40 comp rx=0 tx=0).stop 2024-02-21T23:02:11.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.621+0000 7f229d200640 1 -- 172.21.15.99:0/3768981389 shutdown_connections 2024-02-21T23:02:11.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.621+0000 7f229d200640 1 --2- 172.21.15.99:0/3768981389 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f227809ee70 0x7f22780a1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:11.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.621+0000 7f229d200640 1 --2- 172.21.15.99:0/3768981389 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f229818a860 0x7f2298182320 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:11.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.621+0000 7f229d200640 1 --2- 172.21.15.99:0/3768981389 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2298189760 0x7f229816bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:11.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.621+0000 7f229d200640 1 --2- 172.21.15.99:0/3768981389 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2298186530 0x7f2298221330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:11.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.621+0000 7f229d200640 1 -- 172.21.15.99:0/3768981389 >> 172.21.15.99:0/3768981389 conn(0x7f22980f7330 msgr2=0x7f229818a020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:11.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.621+0000 7f229d200640 1 -- 172.21.15.99:0/3768981389 shutdown_connections 2024-02-21T23:02:11.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.621+0000 7f229d200640 1 -- 172.21.15.99:0/3768981389 wait complete. 2024-02-21T23:02:11.636 DEBUG:teuthology.orchestra.run.smithi099:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-02-21T23:02:11.662 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-02-21T23:02:11.673+0000 7f1503a2e040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-02-21T23:02:11.673 INFO:tasks.ceph.mgr.z.smithi181.stderr:2024-02-21T23:02:11.683+0000 7f6fb8a41040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-02-21T23:02:11.715 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-02-21T23:02:11.726+0000 7f1503a2e040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-21T23:02:11.726 INFO:tasks.ceph.mgr.z.smithi181.stderr:2024-02-21T23:02:11.736+0000 7f6fb8a41040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-21T23:02:11.757 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-02-21T23:02:11.768+0000 7f1503a2e040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-21T23:02:11.769 INFO:tasks.ceph.mgr.z.smithi181.stderr:2024-02-21T23:02:11.779+0000 7f6fb8a41040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-21T23:02:11.806 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-02-21T23:02:11.817+0000 7f1503a2e040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-21T23:02:11.818 INFO:tasks.ceph.mgr.z.smithi181.stderr:2024-02-21T23:02:11.828+0000 7f6fb8a41040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-21T23:02:11.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.839+0000 7f3a4e200640 1 Processor -- start 2024-02-21T23:02:11.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.839+0000 7f3a4e200640 1 -- start start 2024-02-21T23:02:11.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.841+0000 7f3a4e200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3a4817f120 0x7f3a4817f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:11.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.841+0000 7f3a4e200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f3a480d43a0 0x7f3a480d47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:11.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.841+0000 7f3a4e200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a481869a0 con 0x7f3a48187a00 2024-02-21T23:02:11.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.842+0000 7f3a4e200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a480cf710 con 0x7f3a480d43a0 2024-02-21T23:02:11.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.842+0000 7f3a4e200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a48186c40 con 0x7f3a4817f120 2024-02-21T23:02:11.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.842+0000 7f3a4ce00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3a4817f120 0x7f3a4817f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:11.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.842+0000 7f3a4d800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f3a480d43a0 0x7f3a480d47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:11.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.842+0000 7f3a4ce00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3a4817f120 0x7f3a4817f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:59978/0 (socket says 172.21.15.99:59978) 2024-02-21T23:02:11.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.842+0000 7f3a4ce00640 1 -- 172.21.15.99:0/1840243830 learned_addr learned my addr 172.21.15.99:0/1840243830 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:11.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.842+0000 7f3a4d800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f3a480d43a0 0x7f3a480d47e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60470/0 (socket says 172.21.15.99:60470) 2024-02-21T23:02:11.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.842+0000 7f3a4ce00640 1 -- 172.21.15.99:0/1840243830 >> v2:172.21.15.99:3300/0 conn(0x7f3a480d43a0 msgr2=0x7f3a480d47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:11.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.842+0000 7f3a4ce00640 1 --2- 172.21.15.99:0/1840243830 >> v2:172.21.15.99:3300/0 conn(0x7f3a480d43a0 0x7f3a480d47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:11.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.842+0000 7f3a4ce00640 1 -- 172.21.15.99:0/1840243830 >> v1:172.21.15.99:6789/0 conn(0x7f3a48187a00 legacy=0x7f3a48187e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:11.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.842+0000 7f3a4ce00640 1 -- 172.21.15.99:0/1840243830 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a48186f20 con 0x7f3a4817f120 2024-02-21T23:02:11.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.843+0000 7f3a4ce00640 1 --2- 172.21.15.99:0/1840243830 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a4817f120 0x7f3a4817f500 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3a48067ca0 tx=0x7f3a3c02b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d22ea13b1dff3423 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:11.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.844+0000 7f3a47400640 1 -- 172.21.15.99:0/1840243830 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3c034070 con 0x7f3a4817f120 2024-02-21T23:02:11.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.844+0000 7f3a47400640 1 -- 172.21.15.99:0/1840243830 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a3c030860 con 0x7f3a4817f120 2024-02-21T23:02:11.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.844+0000 7f3a47400640 1 -- 172.21.15.99:0/1840243830 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3c030c30 con 0x7f3a4817f120 2024-02-21T23:02:11.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.844+0000 7f3a4e200640 1 -- 172.21.15.99:0/1840243830 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a4817f120 msgr2=0x7f3a4817f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:11.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.844+0000 7f3a4e200640 1 --2- 172.21.15.99:0/1840243830 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a4817f120 0x7f3a4817f500 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3a48067ca0 tx=0x7f3a3c02b9a0 comp rx=0 tx=0).stop 2024-02-21T23:02:11.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.845+0000 7f3a4e200640 1 -- 172.21.15.99:0/1840243830 shutdown_connections 2024-02-21T23:02:11.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.845+0000 7f3a4e200640 1 --2- 172.21.15.99:0/1840243830 >> v2:172.21.15.99:3300/0 conn(0x7f3a480d43a0 0x7f3a480d47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:11.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.845+0000 7f3a4e200640 1 --2- 172.21.15.99:0/1840243830 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a4817f120 0x7f3a4817f500 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:11.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.845+0000 7f3a4e200640 1 -- 172.21.15.99:0/1840243830 >> 172.21.15.99:0/1840243830 conn(0x7f3a4808cfa0 msgr2=0x7f3a4808d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:11.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.845+0000 7f3a4e200640 1 -- 172.21.15.99:0/1840243830 shutdown_connections 2024-02-21T23:02:11.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.845+0000 7f3a4e200640 1 -- 172.21.15.99:0/1840243830 wait complete. 2024-02-21T23:02:11.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.848+0000 7f3a4e200640 1 Processor -- start 2024-02-21T23:02:11.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.848+0000 7f3a4e200640 1 -- start start 2024-02-21T23:02:11.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.850+0000 7f3a4e200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a480d43a0 0x7f3a48172130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:11.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.850+0000 7f3a4e200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3a4817f120 0x7f3a480ce840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:11.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.850+0000 7f3a4e200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3a48187a00 0x7f3a480ced80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:11.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.850+0000 7f3a4e200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a481885a0 con 0x7f3a4817f120 2024-02-21T23:02:11.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.850+0000 7f3a4e200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a481874e0 con 0x7f3a480d43a0 2024-02-21T23:02:11.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.850+0000 7f3a4e200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a480d4d20 con 0x7f3a48187a00 2024-02-21T23:02:11.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.850+0000 7f3a4ce00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a480d43a0 0x7f3a48172130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:11.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.850+0000 7f3a4ce00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a480d43a0 0x7f3a48172130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:59994/0 (socket says 172.21.15.99:59994) 2024-02-21T23:02:11.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.850+0000 7f3a4ce00640 1 -- 172.21.15.99:0/3330618338 learned_addr learned my addr 172.21.15.99:0/3330618338 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:11.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.850+0000 7f3a4d800640 1 --2- 172.21.15.99:0/3330618338 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3a48187a00 0x7f3a480ced80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:11.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.850+0000 7f3a47e00640 1 --2- 172.21.15.99:0/3330618338 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3a4817f120 0x7f3a480ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:11.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.851+0000 7f3a4ce00640 1 -- 172.21.15.99:0/3330618338 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3a48187a00 msgr2=0x7f3a480ced80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:11.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.851+0000 7f3a4ce00640 1 --2- 172.21.15.99:0/3330618338 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3a48187a00 0x7f3a480ced80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:11.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.851+0000 7f3a4ce00640 1 -- 172.21.15.99:0/3330618338 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3a4817f120 msgr2=0x7f3a480ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:11.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.851+0000 7f3a4ce00640 1 --2- 172.21.15.99:0/3330618338 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3a4817f120 0x7f3a480ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:11.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.851+0000 7f3a4ce00640 1 -- 172.21.15.99:0/3330618338 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a4821ebb0 con 0x7f3a480d43a0 2024-02-21T23:02:11.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.851+0000 7f3a47e00640 1 --2- 172.21.15.99:0/3330618338 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3a4817f120 0x7f3a480ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:02:11.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.851+0000 7f3a4ce00640 1 --2- 172.21.15.99:0/3330618338 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a480d43a0 0x7f3a48172130 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c02b9e0 tx=0x7f3a3c004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:11.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.851+0000 7f3a44c00640 1 -- 172.21.15.99:0/3330618338 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3c048070 con 0x7f3a480d43a0 2024-02-21T23:02:11.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.851+0000 7f3a44c00640 1 -- 172.21.15.99:0/3330618338 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a3c030660 con 0x7f3a480d43a0 2024-02-21T23:02:11.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.851+0000 7f3a44c00640 1 -- 172.21.15.99:0/3330618338 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3c034040 con 0x7f3a480d43a0 2024-02-21T23:02:11.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.851+0000 7f3a4e200640 1 -- 172.21.15.99:0/3330618338 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a4821ee90 con 0x7f3a480d43a0 2024-02-21T23:02:11.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.852+0000 7f3a4e200640 1 -- 172.21.15.99:0/3330618338 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a4821f450 con 0x7f3a480d43a0 2024-02-21T23:02:11.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.853+0000 7f3a4e200640 1 -- 172.21.15.99:0/3330618338 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a48068230 con 0x7f3a480d43a0 2024-02-21T23:02:11.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.856+0000 7f3a44c00640 1 -- 172.21.15.99:0/3330618338 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 7) v1 ==== 134424+0+0 (secure 0 0 0) 0x7f3a3c037070 con 0x7f3a480d43a0 2024-02-21T23:02:11.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.857+0000 7f3a44c00640 1 --2- 172.21.15.99:0/3330618338 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f3a2809ee70 0x7f3a280a1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:11.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.857+0000 7f3a44c00640 1 -- 172.21.15.99:0/3330618338 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 8488+0+0 (secure 0 0 0) 0x7f3a3c0eb9e0 con 0x7f3a480d43a0 2024-02-21T23:02:11.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.857+0000 7f3a47e00640 1 -- 172.21.15.99:0/3330618338 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f3a2809ee70 msgr2=0x7f3a280a1330 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.162:6800/1717094936 2024-02-21T23:02:11.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.857+0000 7f3a47e00640 1 --2- 172.21.15.99:0/3330618338 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f3a2809ee70 0x7f3a280a1330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-21T23:02:11.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:11.861+0000 7f3a44c00640 1 -- 172.21.15.99:0/3330618338 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f3a3c07ddc0 con 0x7f3a480d43a0 2024-02-21T23:02:11.850 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-02-21T23:02:11.860+0000 7f1503a2e040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-02-21T23:02:11.862 INFO:tasks.ceph.mgr.z.smithi181.stderr:2024-02-21T23:02:11.872+0000 7f6fb8a41040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-02-21T23:02:12.006 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-02-21T23:02:12.017+0000 7fe5fd8d3040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-21T23:02:12.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:12.058+0000 7f3a47e00640 1 -- 172.21.15.99:0/3330618338 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f3a2809ee70 msgr2=0x7f3a280a1330 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.162:6800/1717094936 2024-02-21T23:02:12.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:12.058+0000 7f3a47e00640 1 --2- 172.21.15.99:0/3330618338 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f3a2809ee70 0x7f3a280a1330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-21T23:02:12.098 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-02-21T23:02:12.110+0000 7fe5fd8d3040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-21T23:02:12.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:12.146+0000 7f3a4e200640 1 -- 172.21.15.99:0/3330618338 --> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) v1 -- 0x7f3a480ce320 con 0x7f3a2809ee70 2024-02-21T23:02:12.166 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-02-21T23:02:12.177+0000 7f1503a2e040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-21T23:02:12.181 INFO:tasks.ceph.mgr.z.smithi181.stderr:2024-02-21T23:02:12.191+0000 7f6fb8a41040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-21T23:02:12.187 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-02-21T23:02:12.198+0000 7fe5fd8d3040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-21T23:02:12.295 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-02-21T23:02:12.306+0000 7fe5fd8d3040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-21T23:02:12.296 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-02-21T23:02:12.307+0000 7f1503a2e040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-21T23:02:12.312 INFO:tasks.ceph.mgr.z.smithi181.stderr:2024-02-21T23:02:12.322+0000 7f6fb8a41040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-21T23:02:12.359 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-02-21T23:02:12.370+0000 7fe5fd8d3040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-21T23:02:12.387 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-02-21T23:02:12.398+0000 7f1503a2e040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-21T23:02:12.405 INFO:tasks.ceph.mgr.z.smithi181.stderr:2024-02-21T23:02:12.415+0000 7f6fb8a41040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-21T23:02:12.429 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-02-21T23:02:12.440+0000 7f1503a2e040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-21T23:02:12.447 INFO:tasks.ceph.mgr.z.smithi181.stderr:2024-02-21T23:02:12.457+0000 7f6fb8a41040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-21T23:02:12.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:12.459+0000 7f3a47e00640 1 -- 172.21.15.99:0/3330618338 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f3a2809ee70 msgr2=0x7f3a280a1330 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.162:6800/1717094936 2024-02-21T23:02:12.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:12.459+0000 7f3a47e00640 1 --2- 172.21.15.99:0/3330618338 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f3a2809ee70 0x7f3a280a1330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-21T23:02:12.539 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-02-21T23:02:12.550+0000 7f1503a2e040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-21T23:02:12.556 INFO:tasks.ceph.mgr.z.smithi181.stderr:2024-02-21T23:02:12.566+0000 7f6fb8a41040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-21T23:02:12.589 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-02-21T23:02:12.600+0000 7fe5fd8d3040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-02-21T23:02:12.630 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-02-21T23:02:12.641+0000 7f1503a2e040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-21T23:02:12.649 INFO:tasks.ceph.mgr.z.smithi181.stderr:2024-02-21T23:02:12.659+0000 7f6fb8a41040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-21T23:02:12.696 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-02-21T23:02:12.707+0000 7fe5fd8d3040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-21T23:02:12.781 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-02-21T23:02:12.791+0000 7f1503a2e040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-21T23:02:12.781 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-02-21T23:02:12.792+0000 7fe5fd8d3040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-21T23:02:12.801 INFO:tasks.ceph.mgr.z.smithi181.stderr:2024-02-21T23:02:12.811+0000 7f6fb8a41040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-21T23:02:12.822 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-02-21T23:02:12.833+0000 7f1503a2e040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-21T23:02:12.841 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-02-21T23:02:12.852+0000 7fe5fd8d3040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-21T23:02:12.843 INFO:tasks.ceph.mgr.z.smithi181.stderr:2024-02-21T23:02:12.853+0000 7f6fb8a41040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-21T23:02:12.894 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-02-21T23:02:12.905+0000 7fe5fd8d3040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-02-21T23:02:12.941 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-02-21T23:02:12.951+0000 7f1503a2e040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-21T23:02:12.964 INFO:tasks.ceph.mgr.z.smithi181.stderr:2024-02-21T23:02:12.974+0000 7f6fb8a41040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-21T23:02:13.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:13.260+0000 7f3a47e00640 1 -- 172.21.15.99:0/3330618338 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f3a2809ee70 msgr2=0x7f3a280a1330 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.162:6800/1717094936 2024-02-21T23:02:13.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:13.260+0000 7f3a47e00640 1 --2- 172.21.15.99:0/3330618338 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f3a2809ee70 0x7f3a280a1330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-21T23:02:13.303 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-02-21T23:02:13.314+0000 7fe5fd8d3040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-21T23:02:13.473 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-02-21T23:02:13.484+0000 7fe5fd8d3040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-21T23:02:13.554 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-02-21T23:02:13.565+0000 7f1503a2e040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-21T23:02:13.581 INFO:tasks.ceph.mgr.z.smithi181.stderr:2024-02-21T23:02:13.593+0000 7f6fb8a41040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-21T23:02:13.652 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-02-21T23:02:13.663+0000 7fe5fd8d3040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-21T23:02:13.732 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-02-21T23:02:13.743+0000 7fe5fd8d3040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-21T23:02:13.820 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-02-21T23:02:13.831+0000 7f1503a2e040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-21T23:02:13.849 INFO:tasks.ceph.mgr.z.smithi181.stderr:2024-02-21T23:02:13.860+0000 7f6fb8a41040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-21T23:02:13.868 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-02-21T23:02:13.879+0000 7f1503a2e040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-21T23:02:13.883 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-02-21T23:02:13.894+0000 7fe5fd8d3040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-21T23:02:13.898 INFO:tasks.ceph.mgr.z.smithi181.stderr:2024-02-21T23:02:13.909+0000 7f6fb8a41040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-21T23:02:13.983 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-02-21T23:02:13.993+0000 7f1503a2e040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-21T23:02:14.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:14.025+0000 7f3a44c00640 1 -- 172.21.15.99:0/3330618338 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mgrmap(e 8) v1 ==== 134084+0+0 (secure 0 0 0) 0x7f3a3c0e94e0 con 0x7f3a480d43a0 2024-02-21T23:02:14.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:14.028+0000 7f3a44c00640 1 -- 172.21.15.99:0/3330618338 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f3a2809ee70 msgr2=0x7f3a280a1330 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-21T23:02:14.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:14.028+0000 7f3a44c00640 1 --2- 172.21.15.99:0/3330618338 >> [v2:172.21.15.162:6800/1717094936,v1:172.21.15.162:6801/1717094936] conn(0x7f3a2809ee70 0x7f3a280a1330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:14.025 INFO:tasks.ceph.mgr.z.smithi181.stderr:2024-02-21T23:02:14.036+0000 7f6fb8a41040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-21T23:02:14.048 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-02-21T23:02:14.058+0000 7fe5fd8d3040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-21T23:02:14.228 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-02-21T23:02:14.236+0000 7f14824e9640 -1 client.0 error registering admin socket command: (17) File exists 2024-02-21T23:02:14.228 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-02-21T23:02:14.236+0000 7f14824e9640 -1 client.0 error registering admin socket command: (17) File exists 2024-02-21T23:02:14.230 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-02-21T23:02:14.236+0000 7f147f4e3640 -1 client.0 error registering admin socket command: (17) File exists 2024-02-21T23:02:14.230 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-02-21T23:02:14.236+0000 7f14824e9640 -1 client.0 error registering admin socket command: (17) File exists 2024-02-21T23:02:14.230 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-02-21T23:02:14.236+0000 7f147f4e3640 -1 client.0 error registering admin socket command: (17) File exists 2024-02-21T23:02:14.231 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-02-21T23:02:14.236+0000 7f147f4e3640 -1 client.0 error registering admin socket command: (17) File exists 2024-02-21T23:02:14.231 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-02-21T23:02:14.236+0000 7f147f4e3640 -1 client.0 error registering admin socket command: (17) File exists 2024-02-21T23:02:14.231 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-02-21T23:02:14.236+0000 7f147f4e3640 -1 client.0 error registering admin socket command: (17) File exists 2024-02-21T23:02:14.231 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-02-21T23:02:14.236+0000 7f14824e9640 -1 client.0 error registering admin socket command: (17) File exists 2024-02-21T23:02:14.231 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-02-21T23:02:14.236+0000 7f14824e9640 -1 client.0 error registering admin socket command: (17) File exists 2024-02-21T23:02:14.299 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-02-21T23:02:14.310+0000 7fe5fd8d3040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-21T23:02:14.350 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-02-21T23:02:14.361+0000 7fe5fd8d3040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-21T23:02:14.518 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-02-21T23:02:14.529+0000 7fe5fd8d3040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-21T23:02:15.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.035+0000 7f3a44c00640 1 -- 172.21.15.99:0/3330618338 <== mon.1 v2:172.21.15.162:3300/0 8 ==== mgrmap(e 9) v1 ==== 134211+0+0 (secure 0 0 0) 0x7f3a3c0b5a30 con 0x7f3a480d43a0 2024-02-21T23:02:15.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.036+0000 7f3a44c00640 1 --2- 172.21.15.99:0/3330618338 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f3a2804ff70 0x7f3a28050350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:15.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.036+0000 7f3a44c00640 1 -- 172.21.15.99:0/3330618338 --> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) v1 -- 0x7f3a3c0cd1a0 con 0x7f3a2804ff70 2024-02-21T23:02:15.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.038+0000 7f3a47e00640 1 --2- 172.21.15.99:0/3330618338 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f3a2804ff70 0x7f3a28050350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:15.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.039+0000 7f3a47e00640 1 --2- 172.21.15.99:0/3330618338 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f3a2804ff70 0x7f3a28050350 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3a4821c7e0 tx=0x7f3a340010e0 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:15.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.140+0000 7f3a44c00640 1 -- 172.21.15.99:0/3330618338 <== mgr.5131 v2:172.21.15.162:6800/631076050 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f3a3c0cd1a0 con 0x7f3a2804ff70 2024-02-21T23:02:15.129 INFO:teuthology.orchestra.run.smithi099.stdout:Schedule set for path / 2024-02-21T23:02:15.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.143+0000 7f3a4e200640 1 -- 172.21.15.99:0/3330618338 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f3a2804ff70 msgr2=0x7f3a28050350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:15.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.143+0000 7f3a4e200640 1 --2- 172.21.15.99:0/3330618338 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f3a2804ff70 0x7f3a28050350 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3a4821c7e0 tx=0x7f3a340010e0 comp rx=0 tx=0).stop 2024-02-21T23:02:15.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.143+0000 7f3a4e200640 1 -- 172.21.15.99:0/3330618338 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a480d43a0 msgr2=0x7f3a48172130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:15.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.143+0000 7f3a4e200640 1 --2- 172.21.15.99:0/3330618338 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a480d43a0 0x7f3a48172130 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c02b9e0 tx=0x7f3a3c004730 comp rx=0 tx=0).stop 2024-02-21T23:02:15.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.143+0000 7f3a4d800640 1 -- 172.21.15.99:0/3330618338 reap_dead start 2024-02-21T23:02:15.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.143+0000 7f3a4e200640 1 -- 172.21.15.99:0/3330618338 shutdown_connections 2024-02-21T23:02:15.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.143+0000 7f3a4e200640 1 -- 172.21.15.99:0/3330618338 >> 172.21.15.99:0/3330618338 conn(0x7f3a4808cfa0 msgr2=0x7f3a4808d380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:15.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.143+0000 7f3a4e200640 1 -- 172.21.15.99:0/3330618338 shutdown_connections 2024-02-21T23:02:15.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.143+0000 7f3a4e200640 1 -- 172.21.15.99:0/3330618338 wait complete. 2024-02-21T23:02:15.156 DEBUG:teuthology.orchestra.run.smithi099:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-02-21T23:02:15.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.408+0000 7f19dc000640 1 Processor -- start 2024-02-21T23:02:15.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.409+0000 7f19dc000640 1 -- start start 2024-02-21T23:02:15.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.410+0000 7f19dc000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f19d40f9600 0x7f19d40fcf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:15.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.410+0000 7f19dc000640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f19d40fd470 0x7f19d4188e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:15.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.410+0000 7f19dc000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19d40f9b10 con 0x7f19d4186520 2024-02-21T23:02:15.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.410+0000 7f19dc000640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19d40d6650 con 0x7f19d40f9600 2024-02-21T23:02:15.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.410+0000 7f19dc000640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19d40f9df0 con 0x7f19d40fd470 2024-02-21T23:02:15.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.411+0000 7f19d9600640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f19d4186520 0x7f19d40f8ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:51750/0 (socket says 172.21.15.99:51750) 2024-02-21T23:02:15.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.411+0000 7f19d9600640 1 -- 172.21.15.99:0/4122082748 learned_addr learned my addr 172.21.15.99:0/4122082748 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:02:15.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.411+0000 7f19d8c00640 1 --2- 172.21.15.99:0/4122082748 >> v2:172.21.15.99:3300/0 conn(0x7f19d40f9600 0x7f19d40fcf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:15.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.411+0000 7f19da000640 1 --2- 172.21.15.99:0/4122082748 >> v2:172.21.15.181:3300/0 conn(0x7f19d40fd470 0x7f19d4188e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:15.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.411+0000 7f19da000640 1 -- 172.21.15.99:0/4122082748 >> v2:172.21.15.99:3300/0 conn(0x7f19d40f9600 msgr2=0x7f19d40fcf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:15.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.411+0000 7f19da000640 1 --2- 172.21.15.99:0/4122082748 >> v2:172.21.15.99:3300/0 conn(0x7f19d40f9600 0x7f19d40fcf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:15.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.411+0000 7f19da000640 1 -- 172.21.15.99:0/4122082748 >> v1:172.21.15.99:6789/0 conn(0x7f19d4186520 legacy=0x7f19d40f8ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:15.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.411+0000 7f19da000640 1 -- 172.21.15.99:0/4122082748 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19d40fa0d0 con 0x7f19d40fd470 2024-02-21T23:02:15.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.411+0000 7f19d3e00640 1 -- 172.21.15.99:0/4122082748 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3466228115 0 0) 0x7f19d40f9b10 con 0x7f19d4186520 2024-02-21T23:02:15.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.413+0000 7f19da000640 1 --2- 172.21.15.99:0/4122082748 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f19d40fd470 0x7f19d4188e60 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f19d4092ea0 tx=0x7f19cc02be30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c32b42bf8dae6e2 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:15.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.413+0000 7f19d3e00640 1 -- 172.21.15.99:0/4122082748 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19cc039070 con 0x7f19d40fd470 2024-02-21T23:02:15.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.413+0000 7f19d3e00640 1 -- 172.21.15.99:0/4122082748 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19cc02cbe0 con 0x7f19d40fd470 2024-02-21T23:02:15.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.413+0000 7f19d3e00640 1 -- 172.21.15.99:0/4122082748 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19cc034440 con 0x7f19d40fd470 2024-02-21T23:02:15.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.414+0000 7f19dc000640 1 -- 172.21.15.99:0/4122082748 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f19d40fd470 msgr2=0x7f19d4188e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:15.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.414+0000 7f19dc000640 1 --2- 172.21.15.99:0/4122082748 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f19d40fd470 0x7f19d4188e60 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f19d4092ea0 tx=0x7f19cc02be30 comp rx=0 tx=0).stop 2024-02-21T23:02:15.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.414+0000 7f19dc000640 1 -- 172.21.15.99:0/4122082748 shutdown_connections 2024-02-21T23:02:15.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.414+0000 7f19dc000640 1 --2- 172.21.15.99:0/4122082748 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f19d40fd470 0x7f19d4188e60 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:15.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.414+0000 7f19dc000640 1 --2- 172.21.15.99:0/4122082748 >> v2:172.21.15.99:3300/0 conn(0x7f19d40f9600 0x7f19d40fcf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:15.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.414+0000 7f19dc000640 1 -- 172.21.15.99:0/4122082748 >> 172.21.15.99:0/4122082748 conn(0x7f19d40d2d20 msgr2=0x7f19d40d3100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:15.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.414+0000 7f19dc000640 1 -- 172.21.15.99:0/4122082748 shutdown_connections 2024-02-21T23:02:15.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.414+0000 7f19dc000640 1 -- 172.21.15.99:0/4122082748 wait complete. 2024-02-21T23:02:15.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.417+0000 7f19dc000640 1 Processor -- start 2024-02-21T23:02:15.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.417+0000 7f19dc000640 1 -- start start 2024-02-21T23:02:15.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.419+0000 7f19dc000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f19d40f9600 0x7f19d40cc530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:15.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.419+0000 7f19dc000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f19d40fd470 0x7f19d417b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:15.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.419+0000 7f19dc000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f19d4186520 0x7f19d417b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:15.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.419+0000 7f19dc000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d4186900 con 0x7f19d40f9600 2024-02-21T23:02:15.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.419+0000 7f19dc000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d40fca10 con 0x7f19d4186520 2024-02-21T23:02:15.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.419+0000 7f19dc000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d40fd900 con 0x7f19d40fd470 2024-02-21T23:02:15.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.419+0000 7f19d9600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f19d40f9600 0x7f19d40cc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:15.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.419+0000 7f19d8c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f19d40fd470 0x7f19d417b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:15.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.419+0000 7f19d9600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f19d40f9600 0x7f19d40cc530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60488/0 (socket says 172.21.15.99:60488) 2024-02-21T23:02:15.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.419+0000 7f19d9600640 1 -- 172.21.15.99:0/1099612808 learned_addr learned my addr 172.21.15.99:0/1099612808 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:15.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.420+0000 7f19da000640 1 --2- 172.21.15.99:0/1099612808 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f19d4186520 0x7f19d417b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:15.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.420+0000 7f19d8c00640 1 -- 172.21.15.99:0/1099612808 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f19d4186520 msgr2=0x7f19d417b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:15.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.420+0000 7f19d8c00640 1 --2- 172.21.15.99:0/1099612808 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f19d4186520 0x7f19d417b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:15.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.420+0000 7f19d8c00640 1 -- 172.21.15.99:0/1099612808 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f19d40f9600 msgr2=0x7f19d40cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:15.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.420+0000 7f19d8c00640 1 --2- 172.21.15.99:0/1099612808 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f19d40f9600 0x7f19d40cc530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:15.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.420+0000 7f19d8c00640 1 -- 172.21.15.99:0/1099612808 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19d417bfc0 con 0x7f19d40fd470 2024-02-21T23:02:15.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.420+0000 7f19d8c00640 1 --2- 172.21.15.99:0/1099612808 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f19d40fd470 0x7f19d417b440 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f19c000e850 tx=0x7f19c000ed10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:15.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.420+0000 7f19d1600640 1 -- 172.21.15.99:0/1099612808 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c0017070 con 0x7f19d40fd470 2024-02-21T23:02:15.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.421+0000 7f19dc000640 1 -- 172.21.15.99:0/1099612808 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19d417c2a0 con 0x7f19d40fd470 2024-02-21T23:02:15.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.421+0000 7f19dc000640 1 -- 172.21.15.99:0/1099612808 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19d417c860 con 0x7f19d40fd470 2024-02-21T23:02:15.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.421+0000 7f19d1600640 1 -- 172.21.15.99:0/1099612808 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19c000c8e0 con 0x7f19d40fd470 2024-02-21T23:02:15.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.421+0000 7f19d1600640 1 -- 172.21.15.99:0/1099612808 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c000ccb0 con 0x7f19d40fd470 2024-02-21T23:02:15.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.422+0000 7f19dc000640 1 -- 172.21.15.99:0/1099612808 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19b0005290 con 0x7f19d40fd470 2024-02-21T23:02:15.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.425+0000 7f19d1600640 1 -- 172.21.15.99:0/1099612808 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 9) v1 ==== 134211+0+0 (secure 0 0 0) 0x7f19c001a070 con 0x7f19d40fd470 2024-02-21T23:02:15.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.428+0000 7f19d1600640 1 --2- 172.21.15.99:0/1099612808 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f19b409ed50 0x7f19b40a1210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:15.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.428+0000 7f19d1600640 1 -- 172.21.15.99:0/1099612808 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f19c00c9bd0 con 0x7f19d40fd470 2024-02-21T23:02:15.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.428+0000 7f19d9600640 1 --2- 172.21.15.99:0/1099612808 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f19b409ed50 0x7f19b40a1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:15.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.429+0000 7f19d9600640 1 --2- 172.21.15.99:0/1099612808 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f19b409ed50 0x7f19b40a1210 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f19c8000f60 tx=0x7f19c8007240 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:15.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.431+0000 7f19d1600640 1 -- 172.21.15.99:0/1099612808 <== mon.2 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f19c0097f90 con 0x7f19d40fd470 2024-02-21T23:02:15.572 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-02-21T23:02:15.583+0000 7fe5fd8d3040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-21T23:02:15.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.795+0000 7f19dc000640 1 -- 172.21.15.99:0/1099612808 --> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) v1 -- 0x7f19b0000c60 con 0x7f19b409ed50 2024-02-21T23:02:15.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.905+0000 7f19d1600640 1 -- 172.21.15.99:0/1099612808 <== mgr.5131 v2:172.21.15.162:6800/631076050 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7f19b0000c60 con 0x7f19b409ed50 2024-02-21T23:02:15.894 INFO:teuthology.orchestra.run.smithi099.stdout:Retention added to path / 2024-02-21T23:02:15.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.908+0000 7f19dc000640 1 -- 172.21.15.99:0/1099612808 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f19b409ed50 msgr2=0x7f19b40a1210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:15.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.908+0000 7f19dc000640 1 --2- 172.21.15.99:0/1099612808 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f19b409ed50 0x7f19b40a1210 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f19c8000f60 tx=0x7f19c8007240 comp rx=0 tx=0).stop 2024-02-21T23:02:15.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.908+0000 7f19dc000640 1 -- 172.21.15.99:0/1099612808 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f19d40fd470 msgr2=0x7f19d417b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:15.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.908+0000 7f19dc000640 1 --2- 172.21.15.99:0/1099612808 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f19d40fd470 0x7f19d417b440 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f19c000e850 tx=0x7f19c000ed10 comp rx=0 tx=0).stop 2024-02-21T23:02:15.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.908+0000 7f19dc000640 1 -- 172.21.15.99:0/1099612808 shutdown_connections 2024-02-21T23:02:15.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.908+0000 7f19dc000640 1 --2- 172.21.15.99:0/1099612808 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f19b409ed50 0x7f19b40a1210 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:15.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.908+0000 7f19dc000640 1 --2- 172.21.15.99:0/1099612808 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f19d4186520 0x7f19d417b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:15.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.908+0000 7f19dc000640 1 --2- 172.21.15.99:0/1099612808 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f19d40fd470 0x7f19d417b440 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:15.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.908+0000 7f19dc000640 1 --2- 172.21.15.99:0/1099612808 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f19d40f9600 0x7f19d40cc530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:15.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.908+0000 7f19dc000640 1 -- 172.21.15.99:0/1099612808 >> 172.21.15.99:0/1099612808 conn(0x7f19d40d2d20 msgr2=0x7f19d4072e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:15.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.908+0000 7f19dc000640 1 -- 172.21.15.99:0/1099612808 shutdown_connections 2024-02-21T23:02:15.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:15.908+0000 7f19dc000640 1 -- 172.21.15.99:0/1099612808 wait complete. 2024-02-21T23:02:15.921 DEBUG:teuthology.orchestra.run.smithi099:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-02-21T23:02:15.997 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-02-21T23:02:16.008+0000 7fe5fd8d3040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-21T23:02:16.084 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-02-21T23:02:16.095+0000 7fe5fd8d3040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-21T23:02:16.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.165+0000 7fe096a00640 1 Processor -- start 2024-02-21T23:02:16.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.165+0000 7fe096a00640 1 -- start start 2024-02-21T23:02:16.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.167+0000 7fe096a00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fe090189380 0x7fe09018af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:16.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.167+0000 7fe096a00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe090186b30 con 0x7fe0901882a0 2024-02-21T23:02:16.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.167+0000 7fe096a00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe090186dd0 con 0x7fe090182c80 2024-02-21T23:02:16.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.167+0000 7fe096a00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe09018be20 con 0x7fe090189380 2024-02-21T23:02:16.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.167+0000 7fe095600640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fe090182c80 0x7fe090187b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.99:56808/0 (socket says 172.21.15.99:56808) 2024-02-21T23:02:16.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.167+0000 7fe095600640 1 -- 172.21.15.99:0/953229358 learned_addr learned my addr 172.21.15.99:0/953229358 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:02:16.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.167+0000 7fe096000640 1 --2- 172.21.15.99:0/953229358 >> v2:172.21.15.181:3300/0 conn(0x7fe090189380 0x7fe09018af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:16.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.167+0000 7fe08fe00640 1 -- 172.21.15.99:0/953229358 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 472374760 0 0) 0x7fe090186dd0 con 0x7fe090182c80 2024-02-21T23:02:16.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.168+0000 7fe08fe00640 1 -- 172.21.15.99:0/953229358 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe078003520 con 0x7fe090182c80 2024-02-21T23:02:16.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.168+0000 7fe08fe00640 1 -- 172.21.15.99:0/953229358 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3792405876 0 0) 0x7fe090186b30 con 0x7fe0901882a0 2024-02-21T23:02:16.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.168+0000 7fe08fe00640 1 -- 172.21.15.99:0/953229358 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe090186dd0 con 0x7fe0901882a0 2024-02-21T23:02:16.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.168+0000 7fe096000640 1 -- 172.21.15.99:0/953229358 >> v1:172.21.15.162:6789/0 conn(0x7fe090182c80 legacy=0x7fe090187b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:16.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.168+0000 7fe096000640 1 -- 172.21.15.99:0/953229358 >> v1:172.21.15.99:6789/0 conn(0x7fe0901882a0 legacy=0x7fe090188c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:16.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.168+0000 7fe096000640 1 -- 172.21.15.99:0/953229358 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0901870b0 con 0x7fe090189380 2024-02-21T23:02:16.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.169+0000 7fe096000640 1 --2- 172.21.15.99:0/953229358 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe090189380 0x7fe09018af20 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe088009d90 tx=0x7fe08802be30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e2dbd1600fd47be server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:16.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.169+0000 7fe08fe00640 1 -- 172.21.15.99:0/953229358 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe088039070 con 0x7fe090189380 2024-02-21T23:02:16.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.170+0000 7fe08fe00640 1 -- 172.21.15.99:0/953229358 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe08802cbe0 con 0x7fe090189380 2024-02-21T23:02:16.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.170+0000 7fe08fe00640 1 -- 172.21.15.99:0/953229358 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe088034440 con 0x7fe090189380 2024-02-21T23:02:16.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.170+0000 7fe096a00640 1 -- 172.21.15.99:0/953229358 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe090189380 msgr2=0x7fe09018af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:16.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.170+0000 7fe096a00640 1 --2- 172.21.15.99:0/953229358 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe090189380 0x7fe09018af20 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe088009d90 tx=0x7fe08802be30 comp rx=0 tx=0).stop 2024-02-21T23:02:16.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.170+0000 7fe096a00640 1 -- 172.21.15.99:0/953229358 shutdown_connections 2024-02-21T23:02:16.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.170+0000 7fe096a00640 1 --2- 172.21.15.99:0/953229358 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe090189380 0x7fe09018af20 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:16.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.170+0000 7fe096a00640 1 -- 172.21.15.99:0/953229358 >> 172.21.15.99:0/953229358 conn(0x7fe090066c70 msgr2=0x7fe090067080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:16.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.170+0000 7fe096a00640 1 -- 172.21.15.99:0/953229358 shutdown_connections 2024-02-21T23:02:16.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.170+0000 7fe096a00640 1 -- 172.21.15.99:0/953229358 wait complete. 2024-02-21T23:02:16.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.174+0000 7fe096a00640 1 Processor -- start 2024-02-21T23:02:16.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.174+0000 7fe096a00640 1 -- start start 2024-02-21T23:02:16.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.175+0000 7fe096a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe090182c80 0x7fe09016c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:16.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.175+0000 7fe096a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe0901882a0 0x7fe09021fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:16.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.175+0000 7fe096a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe090189380 0x7fe09021da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:16.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.175+0000 7fe096a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe090188720 con 0x7fe090189380 2024-02-21T23:02:16.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.175+0000 7fe096a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe090187670 con 0x7fe0901882a0 2024-02-21T23:02:16.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.175+0000 7fe096a00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe090189810 con 0x7fe090182c80 2024-02-21T23:02:16.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.175+0000 7fe096000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe090189380 0x7fe09021da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:16.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.175+0000 7fe094c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe0901882a0 0x7fe09021fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:16.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.175+0000 7fe095600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe090182c80 0x7fe09016c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:16.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.175+0000 7fe094c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe0901882a0 0x7fe09021fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:59998/0 (socket says 172.21.15.99:59998) 2024-02-21T23:02:16.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.175+0000 7fe094c00640 1 -- 172.21.15.99:0/3650531053 learned_addr learned my addr 172.21.15.99:0/3650531053 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:16.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.176+0000 7fe094c00640 1 -- 172.21.15.99:0/3650531053 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe090182c80 msgr2=0x7fe09016c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:16.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.176+0000 7fe094c00640 1 --2- 172.21.15.99:0/3650531053 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe090182c80 0x7fe09016c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:16.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.176+0000 7fe094c00640 1 -- 172.21.15.99:0/3650531053 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe090189380 msgr2=0x7fe09021da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:16.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.176+0000 7fe094c00640 1 --2- 172.21.15.99:0/3650531053 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe090189380 0x7fe09021da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:16.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.176+0000 7fe094c00640 1 -- 172.21.15.99:0/3650531053 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe090221cc0 con 0x7fe0901882a0 2024-02-21T23:02:16.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.176+0000 7fe094c00640 1 --2- 172.21.15.99:0/3650531053 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe0901882a0 0x7fe09021fc30 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe07c00c430 tx=0x7fe07c00c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:16.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.177+0000 7fe08d600640 1 -- 172.21.15.99:0/3650531053 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe07c017070 con 0x7fe0901882a0 2024-02-21T23:02:16.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.177+0000 7fe08d600640 1 -- 172.21.15.99:0/3650531053 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe07c0052f0 con 0x7fe0901882a0 2024-02-21T23:02:16.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.177+0000 7fe08d600640 1 -- 172.21.15.99:0/3650531053 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe07c011890 con 0x7fe0901882a0 2024-02-21T23:02:16.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.177+0000 7fe096a00640 1 -- 172.21.15.99:0/3650531053 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe090221fa0 con 0x7fe0901882a0 2024-02-21T23:02:16.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.178+0000 7fe096a00640 1 -- 172.21.15.99:0/3650531053 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe090222560 con 0x7fe0901882a0 2024-02-21T23:02:16.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.179+0000 7fe096a00640 1 -- 172.21.15.99:0/3650531053 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0900ce070 con 0x7fe0901882a0 2024-02-21T23:02:16.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.182+0000 7fe08d600640 1 -- 172.21.15.99:0/3650531053 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 10) v1 ==== 134476+0+0 (secure 0 0 0) 0x7fe07c01a070 con 0x7fe0901882a0 2024-02-21T23:02:16.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.185+0000 7fe08d600640 1 --2- 172.21.15.99:0/3650531053 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fe07009eed0 0x7fe0700a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:16.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.185+0000 7fe08d600640 1 -- 172.21.15.99:0/3650531053 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7fe07c0c9180 con 0x7fe0901882a0 2024-02-21T23:02:16.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.185+0000 7fe095600640 1 --2- 172.21.15.99:0/3650531053 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fe07009eed0 0x7fe0700a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:16.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.186+0000 7fe095600640 1 --2- 172.21.15.99:0/3650531053 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fe07009eed0 0x7fe0700a1390 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe084000f60 tx=0x7fe084009040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:16.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.188+0000 7fe08d600640 1 -- 172.21.15.99:0/3650531053 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fe07c096b30 con 0x7fe0901882a0 2024-02-21T23:02:16.242 INFO:tasks.ceph.mgr.x.smithi099.stderr:2024-02-21T23:02:16.253+0000 7fe5fd8d3040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-21T23:02:16.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.492+0000 7fe096a00640 1 -- 172.21.15.99:0/3650531053 --> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) v1 -- 0x7fe090222760 con 0x7fe07009eed0 2024-02-21T23:02:16.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.502+0000 7fe08d600640 1 -- 172.21.15.99:0/3650531053 <== mgr.5131 v2:172.21.15.162:6800/631076050 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+298 (secure 0 0 0) 0x7fe090222760 con 0x7fe07009eed0 2024-02-21T23:02:16.491 INFO:teuthology.orchestra.run.smithi099.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-02-21T00:00:00", "created": "2024-02-21T23:02:15", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-02-21T23:02:16.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.505+0000 7fe096a00640 1 -- 172.21.15.99:0/3650531053 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fe07009eed0 msgr2=0x7fe0700a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:16.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.505+0000 7fe096a00640 1 --2- 172.21.15.99:0/3650531053 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fe07009eed0 0x7fe0700a1390 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe084000f60 tx=0x7fe084009040 comp rx=0 tx=0).stop 2024-02-21T23:02:16.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.505+0000 7fe096a00640 1 -- 172.21.15.99:0/3650531053 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe0901882a0 msgr2=0x7fe09021fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:16.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.505+0000 7fe096a00640 1 --2- 172.21.15.99:0/3650531053 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe0901882a0 0x7fe09021fc30 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe07c00c430 tx=0x7fe07c00c8f0 comp rx=0 tx=0).stop 2024-02-21T23:02:16.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.505+0000 7fe096a00640 1 -- 172.21.15.99:0/3650531053 shutdown_connections 2024-02-21T23:02:16.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.505+0000 7fe096a00640 1 --2- 172.21.15.99:0/3650531053 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fe07009eed0 0x7fe0700a1390 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:16.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.505+0000 7fe096a00640 1 --2- 172.21.15.99:0/3650531053 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe090189380 0x7fe09021da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:16.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.505+0000 7fe096a00640 1 --2- 172.21.15.99:0/3650531053 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe0901882a0 0x7fe09021fc30 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:16.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.505+0000 7fe096a00640 1 --2- 172.21.15.99:0/3650531053 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe090182c80 0x7fe09016c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:16.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.505+0000 7fe096a00640 1 -- 172.21.15.99:0/3650531053 >> 172.21.15.99:0/3650531053 conn(0x7fe090066c70 msgr2=0x7fe0901809d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:16.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.505+0000 7fe096a00640 1 -- 172.21.15.99:0/3650531053 shutdown_connections 2024-02-21T23:02:16.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.505+0000 7fe096a00640 1 -- 172.21.15.99:0/3650531053 wait complete. 2024-02-21T23:02:16.517 DEBUG:teuthology.orchestra.run.smithi099:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-02-21T23:02:16.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.739+0000 7f3ce8200640 1 Processor -- start 2024-02-21T23:02:16.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.739+0000 7f3ce8200640 1 -- start start 2024-02-21T23:02:16.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.742+0000 7f3ce8200640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f3ce0180ec0 0x7f3ce00712c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:16.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.742+0000 7f3ce8200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3ce0071800 0x7f3ce018a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:16.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.742+0000 7f3ce8200640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ce006e380 con 0x7f3ce006f700 2024-02-21T23:02:16.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.742+0000 7f3ce8200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ce006f270 con 0x7f3ce0071800 2024-02-21T23:02:16.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.742+0000 7f3ce8200640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ce0071c60 con 0x7f3ce0180ec0 2024-02-21T23:02:16.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.742+0000 7f3ce5800640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f3ce0180ec0 0x7f3ce00712c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:16.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.742+0000 7f3ce6200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3ce0071800 0x7f3ce018a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:16.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.742+0000 7f3ce4e00640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f3ce006f700 0x7f3ce018a280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:40758/0 (socket says 172.21.15.99:40758) 2024-02-21T23:02:16.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.742+0000 7f3ce4e00640 1 -- 172.21.15.99:0/2139082993 learned_addr learned my addr 172.21.15.99:0/2139082993 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:02:16.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.743+0000 7f3ce5800640 1 -- 172.21.15.99:0/2139082993 >> v2:172.21.15.162:3300/0 conn(0x7f3ce0071800 msgr2=0x7f3ce018a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:16.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.743+0000 7f3ce5800640 1 --2- 172.21.15.99:0/2139082993 >> v2:172.21.15.162:3300/0 conn(0x7f3ce0071800 0x7f3ce018a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:16.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.743+0000 7f3ce5800640 1 -- 172.21.15.99:0/2139082993 >> v1:172.21.15.181:6789/0 conn(0x7f3ce006f700 legacy=0x7f3ce018a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:16.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.743+0000 7f3ce5800640 1 -- 172.21.15.99:0/2139082993 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ce006e660 con 0x7f3ce0180ec0 2024-02-21T23:02:16.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.743+0000 7f3cdfe00640 1 -- 172.21.15.99:0/2139082993 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4245593018 0 0) 0x7f3ce006e380 con 0x7f3ce006f700 2024-02-21T23:02:16.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.744+0000 7f3ce5800640 1 --2- 172.21.15.99:0/2139082993 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3ce0180ec0 0x7f3ce00712c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3ce0071250 tx=0x7f3cd402b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a7da83315666d38 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:16.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.744+0000 7f3cdfe00640 1 -- 172.21.15.99:0/2139082993 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd40315a0 con 0x7f3ce0180ec0 2024-02-21T23:02:16.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.744+0000 7f3cdfe00640 1 -- 172.21.15.99:0/2139082993 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cd4037070 con 0x7f3ce0180ec0 2024-02-21T23:02:16.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.744+0000 7f3cdfe00640 1 -- 172.21.15.99:0/2139082993 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd4031960 con 0x7f3ce0180ec0 2024-02-21T23:02:16.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.745+0000 7f3ce8200640 1 -- 172.21.15.99:0/2139082993 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3ce0180ec0 msgr2=0x7f3ce00712c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:16.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.745+0000 7f3ce8200640 1 --2- 172.21.15.99:0/2139082993 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3ce0180ec0 0x7f3ce00712c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3ce0071250 tx=0x7f3cd402b840 comp rx=0 tx=0).stop 2024-02-21T23:02:16.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.745+0000 7f3ce8200640 1 -- 172.21.15.99:0/2139082993 shutdown_connections 2024-02-21T23:02:16.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.745+0000 7f3ce8200640 1 --2- 172.21.15.99:0/2139082993 >> v2:172.21.15.162:3300/0 conn(0x7f3ce0071800 0x7f3ce018a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:16.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.745+0000 7f3ce8200640 1 --2- 172.21.15.99:0/2139082993 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3ce0180ec0 0x7f3ce00712c0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:16.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.745+0000 7f3ce8200640 1 -- 172.21.15.99:0/2139082993 >> 172.21.15.99:0/2139082993 conn(0x7f3ce00f8e10 msgr2=0x7f3ce00f9220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:16.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.745+0000 7f3ce8200640 1 -- 172.21.15.99:0/2139082993 shutdown_connections 2024-02-21T23:02:16.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.745+0000 7f3ce8200640 1 -- 172.21.15.99:0/2139082993 wait complete. 2024-02-21T23:02:16.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.748+0000 7f3ce8200640 1 Processor -- start 2024-02-21T23:02:16.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.748+0000 7f3ce8200640 1 -- start start 2024-02-21T23:02:16.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.750+0000 7f3ce8200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3ce006f700 0x7f3ce00d1260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:16.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.750+0000 7f3ce8200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ce0071800 0x7f3ce006d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:16.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.750+0000 7f3ce8200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ce0180ec0 0x7f3ce0187380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:16.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.750+0000 7f3ce8200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce006ef00 con 0x7f3ce0071800 2024-02-21T23:02:16.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.750+0000 7f3ce8200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce006ec20 con 0x7f3ce0180ec0 2024-02-21T23:02:16.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.750+0000 7f3ce8200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce00f8a40 con 0x7f3ce006f700 2024-02-21T23:02:16.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.751+0000 7f3ce4e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ce0071800 0x7f3ce006d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:16.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.751+0000 7f3ce5800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3ce006f700 0x7f3ce00d1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:16.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.751+0000 7f3ce4e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ce0071800 0x7f3ce006d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60506/0 (socket says 172.21.15.99:60506) 2024-02-21T23:02:16.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.751+0000 7f3ce4e00640 1 -- 172.21.15.99:0/374417251 learned_addr learned my addr 172.21.15.99:0/374417251 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:16.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.751+0000 7f3ce6200640 1 --2- 172.21.15.99:0/374417251 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ce0180ec0 0x7f3ce0187380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:16.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.751+0000 7f3ce4e00640 1 -- 172.21.15.99:0/374417251 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3ce006f700 msgr2=0x7f3ce00d1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:16.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.751+0000 7f3ce4e00640 1 --2- 172.21.15.99:0/374417251 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3ce006f700 0x7f3ce00d1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:16.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.751+0000 7f3ce4e00640 1 -- 172.21.15.99:0/374417251 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ce0180ec0 msgr2=0x7f3ce0187380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:16.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.751+0000 7f3ce4e00640 1 --2- 172.21.15.99:0/374417251 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ce0180ec0 0x7f3ce0187380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:16.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.751+0000 7f3ce4e00640 1 -- 172.21.15.99:0/374417251 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ce017d280 con 0x7f3ce0071800 2024-02-21T23:02:16.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.751+0000 7f3ce5800640 1 --2- 172.21.15.99:0/374417251 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3ce006f700 0x7f3ce00d1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:02:16.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.751+0000 7f3ce4e00640 1 --2- 172.21.15.99:0/374417251 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ce0071800 0x7f3ce006d8a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc00c460 tx=0x7f3ccc00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:16.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.752+0000 7f3cdd600640 1 -- 172.21.15.99:0/374417251 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ccc018070 con 0x7f3ce0071800 2024-02-21T23:02:16.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.752+0000 7f3cdd600640 1 -- 172.21.15.99:0/374417251 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ccc007520 con 0x7f3ce0071800 2024-02-21T23:02:16.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.752+0000 7f3ce8200640 1 -- 172.21.15.99:0/374417251 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ce01865c0 con 0x7f3ce0071800 2024-02-21T23:02:16.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.752+0000 7f3cdd600640 1 -- 172.21.15.99:0/374417251 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ccc004a20 con 0x7f3ce0071800 2024-02-21T23:02:16.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.752+0000 7f3ce8200640 1 -- 172.21.15.99:0/374417251 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ce0186b80 con 0x7f3ce0071800 2024-02-21T23:02:16.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.753+0000 7f3ce8200640 1 -- 172.21.15.99:0/374417251 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ce017ea50 con 0x7f3ce0071800 2024-02-21T23:02:16.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.756+0000 7f3cdd600640 1 -- 172.21.15.99:0/374417251 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 10) v1 ==== 134476+0+0 (secure 0 0 0) 0x7f3ccc01b070 con 0x7f3ce0071800 2024-02-21T23:02:16.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.758+0000 7f3cdd600640 1 --2- 172.21.15.99:0/374417251 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f3cc009eed0 0x7f3cc00a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:16.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.758+0000 7f3cdd600640 1 -- 172.21.15.99:0/374417251 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f3ccc0c9160 con 0x7f3ce0071800 2024-02-21T23:02:16.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.758+0000 7f3ce5800640 1 --2- 172.21.15.99:0/374417251 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f3cc009eed0 0x7f3cc00a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:16.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.759+0000 7f3ce5800640 1 --2- 172.21.15.99:0/374417251 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f3cc009eed0 0x7f3cc00a1390 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3cd4036000 tx=0x7f3cd403d040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:16.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:16.766+0000 7f3cdd600640 1 -- 172.21.15.99:0/374417251 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f3ce017ea50 con 0x7f3ce0071800 2024-02-21T23:02:17.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:17.093+0000 7f3cdd600640 1 -- 172.21.15.99:0/374417251 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mgrmap(e 11) v1 ==== 134476+0+0 (secure 0 0 0) 0x7f3ccc093120 con 0x7f3ce0071800 2024-02-21T23:02:17.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:17.123+0000 7f3ce8200640 1 -- 172.21.15.99:0/374417251 --> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f3ce0186ed0 con 0x7f3cc009eed0 2024-02-21T23:02:17.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:17.132+0000 7f3cdd600640 1 -- 172.21.15.99:0/374417251 <== mgr.5131 v2:172.21.15.162:6800/631076050 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+10 (secure 0 0 0) 0x7f3ce0186ed0 con 0x7f3cc009eed0 2024-02-21T23:02:17.121 INFO:teuthology.orchestra.run.smithi099.stdout:/ 1m 6m3h 2024-02-21T23:02:17.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:17.135+0000 7f3ce8200640 1 -- 172.21.15.99:0/374417251 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f3cc009eed0 msgr2=0x7f3cc00a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:17.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:17.135+0000 7f3ce8200640 1 --2- 172.21.15.99:0/374417251 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f3cc009eed0 0x7f3cc00a1390 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3cd4036000 tx=0x7f3cd403d040 comp rx=0 tx=0).stop 2024-02-21T23:02:17.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:17.135+0000 7f3ce8200640 1 -- 172.21.15.99:0/374417251 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ce0071800 msgr2=0x7f3ce006d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:17.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:17.135+0000 7f3ce8200640 1 --2- 172.21.15.99:0/374417251 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ce0071800 0x7f3ce006d8a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc00c460 tx=0x7f3ccc00c920 comp rx=0 tx=0).stop 2024-02-21T23:02:17.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:17.135+0000 7f3ce8200640 1 -- 172.21.15.99:0/374417251 shutdown_connections 2024-02-21T23:02:17.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:17.135+0000 7f3ce8200640 1 --2- 172.21.15.99:0/374417251 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f3cc009eed0 0x7f3cc00a1390 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:17.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:17.135+0000 7f3ce8200640 1 --2- 172.21.15.99:0/374417251 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ce0180ec0 0x7f3ce0187380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:17.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:17.135+0000 7f3ce8200640 1 --2- 172.21.15.99:0/374417251 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ce0071800 0x7f3ce006d8a0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:17.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:17.135+0000 7f3ce8200640 1 --2- 172.21.15.99:0/374417251 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3ce006f700 0x7f3ce00d1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:17.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:17.135+0000 7f3ce8200640 1 -- 172.21.15.99:0/374417251 >> 172.21.15.99:0/374417251 conn(0x7f3ce00f8e10 msgr2=0x7f3ce0074340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:17.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:17.135+0000 7f3ce8200640 1 -- 172.21.15.99:0/374417251 shutdown_connections 2024-02-21T23:02:17.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:17.135+0000 7f3ce8200640 1 -- 172.21.15.99:0/374417251 wait complete. 2024-02-21T23:02:17.146 DEBUG:teuthology.orchestra.run.smithi099:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-02-21T23:02:17.226 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-02-21T23:02:17.236 INFO:teuthology.run_tasks:Running task workunit... 2024-02-21T23:02:17.290 INFO:tasks.workunit:Pulling workunits from ref 3bfc837d7b45ce8e095d92fa9c342964cea5e95f 2024-02-21T23:02:17.290 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-02-21T23:02:17.290 INFO:tasks.workunit:timeout=3h 2024-02-21T23:02:17.290 INFO:tasks.workunit:cleanup=True 2024-02-21T23:02:17.291 DEBUG:teuthology.orchestra.run.smithi099:> stat -- /home/ubuntu/cephtest/mnt.0 2024-02-21T23:02:17.340 INFO:teuthology.orchestra.run.smithi099.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-02-21T23:02:17.340 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-02-21T23:02:17.340 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 27h/39d Inode: 1099511628283 Links: 2 2024-02-21T23:02:17.340 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-21T23:02:17.340 INFO:teuthology.orchestra.run.smithi099.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-02-21T23:02:17.340 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2024-02-21 23:01:35.433220425 +0000 2024-02-21T23:02:17.340 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2024-02-21 23:01:35.433220425 +0000 2024-02-21T23:02:17.340 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2024-02-21 23:01:56.230702677 +0000 2024-02-21T23:02:17.341 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: 2024-02-21 23:01:35.433220425 +0000 2024-02-21T23:02:17.341 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-02-21T23:02:17.341 DEBUG:teuthology.orchestra.run.smithi099:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-02-21T23:02:17.430 DEBUG:teuthology.orchestra.run.smithi099:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 3bfc837d7b45ce8e095d92fa9c342964cea5e95f 2024-02-21T23:02:17.472 INFO:tasks.workunit.client.0.smithi099.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-02-21T23:02:39.815 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T23:02:39.815 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T23:02:40.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.055+0000 7fc532a00640 1 Processor -- start 2024-02-21T23:02:40.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.056+0000 7fc532a00640 1 -- start start 2024-02-21T23:02:40.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.058+0000 7fc532a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc52c17f490 0x7fc52c18ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:40.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.059+0000 7fc532a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc52c18b060 0x7fc52c188a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:40.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.059+0000 7fc532a00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fc52c18b4f0 0x7fc52c188f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:40.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.059+0000 7fc532a00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc52c0d6dd0 con 0x7fc52c17f490 2024-02-21T23:02:40.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.059+0000 7fc532a00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc52c1614c0 con 0x7fc52c18b060 2024-02-21T23:02:40.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.059+0000 7fc532a00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc52c0d6810 con 0x7fc52c18b4f0 2024-02-21T23:02:40.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.059+0000 7fc531600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc52c17f490 0x7fc52c18ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:40.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.059+0000 7fc531600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc52c17f490 0x7fc52c18ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59070/0 (socket says 172.21.15.99:59070) 2024-02-21T23:02:40.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.059+0000 7fc531600640 1 -- 172.21.15.99:0/3869268238 learned_addr learned my addr 172.21.15.99:0/3869268238 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:40.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.059+0000 7fc532000640 1 --2- 172.21.15.99:0/3869268238 >> v2:172.21.15.181:3300/0 conn(0x7fc52c18b4f0 0x7fc52c188f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:40.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.059+0000 7fc530c00640 1 --2- 172.21.15.99:0/3869268238 >> v2:172.21.15.162:3300/0 conn(0x7fc52c18b060 0x7fc52c188a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:40.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.060+0000 7fc531600640 1 -- 172.21.15.99:0/3869268238 >> v2:172.21.15.181:3300/0 conn(0x7fc52c18b4f0 msgr2=0x7fc52c188f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:40.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.060+0000 7fc531600640 1 --2- 172.21.15.99:0/3869268238 >> v2:172.21.15.181:3300/0 conn(0x7fc52c18b4f0 0x7fc52c188f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:40.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.060+0000 7fc531600640 1 -- 172.21.15.99:0/3869268238 >> v2:172.21.15.162:3300/0 conn(0x7fc52c18b060 msgr2=0x7fc52c188a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:40.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.060+0000 7fc531600640 1 --2- 172.21.15.99:0/3869268238 >> v2:172.21.15.162:3300/0 conn(0x7fc52c18b060 0x7fc52c188a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:40.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.060+0000 7fc531600640 1 -- 172.21.15.99:0/3869268238 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc52c0d6af0 con 0x7fc52c17f490 2024-02-21T23:02:40.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.061+0000 7fc531600640 1 --2- 172.21.15.99:0/3869268238 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc52c17f490 0x7fc52c18ab20 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc52c186880 tx=0x7fc52002b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcdac23888a1dcbd server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:40.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.061+0000 7fc52be00640 1 -- 172.21.15.99:0/3869268238 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc520034070 con 0x7fc52c17f490 2024-02-21T23:02:40.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.061+0000 7fc52be00640 1 -- 172.21.15.99:0/3869268238 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc520030800 con 0x7fc52c17f490 2024-02-21T23:02:40.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.061+0000 7fc52be00640 1 -- 172.21.15.99:0/3869268238 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc520030bd0 con 0x7fc52c17f490 2024-02-21T23:02:40.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.062+0000 7fc532a00640 1 -- 172.21.15.99:0/3869268238 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc52c17f490 msgr2=0x7fc52c18ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:40.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.062+0000 7fc532a00640 1 --2- 172.21.15.99:0/3869268238 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc52c17f490 0x7fc52c18ab20 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc52c186880 tx=0x7fc52002b940 comp rx=0 tx=0).stop 2024-02-21T23:02:40.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.062+0000 7fc532a00640 1 -- 172.21.15.99:0/3869268238 shutdown_connections 2024-02-21T23:02:40.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.062+0000 7fc532a00640 1 --2- 172.21.15.99:0/3869268238 >> v2:172.21.15.181:3300/0 conn(0x7fc52c18b4f0 0x7fc52c188f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:40.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.062+0000 7fc532a00640 1 --2- 172.21.15.99:0/3869268238 >> v2:172.21.15.162:3300/0 conn(0x7fc52c18b060 0x7fc52c188a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:40.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.062+0000 7fc532a00640 1 --2- 172.21.15.99:0/3869268238 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc52c17f490 0x7fc52c18ab20 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:40.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.062+0000 7fc532a00640 1 -- 172.21.15.99:0/3869268238 >> 172.21.15.99:0/3869268238 conn(0x7fc52c0d29b0 msgr2=0x7fc52c0d2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:40.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.062+0000 7fc532a00640 1 -- 172.21.15.99:0/3869268238 shutdown_connections 2024-02-21T23:02:40.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.062+0000 7fc532a00640 1 -- 172.21.15.99:0/3869268238 wait complete. 2024-02-21T23:02:40.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.064+0000 7fc532a00640 1 Processor -- start 2024-02-21T23:02:40.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.064+0000 7fc532a00640 1 -- start start 2024-02-21T23:02:40.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.065+0000 7fc532a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc52c17f490 0x7fc52c15df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:40.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.065+0000 7fc532a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc52c18b060 0x7fc52c15e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:40.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.065+0000 7fc532a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc52c18b4f0 0x7fc52c21f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:40.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.065+0000 7fc532a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc52c18a600 con 0x7fc52c17f490 2024-02-21T23:02:40.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.065+0000 7fc532a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc52c18a320 con 0x7fc52c18b060 2024-02-21T23:02:40.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.065+0000 7fc532a00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc52c17f870 con 0x7fc52c18b4f0 2024-02-21T23:02:40.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.065+0000 7fc531600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc52c17f490 0x7fc52c15df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:40.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.066+0000 7fc531600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc52c17f490 0x7fc52c15df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59084/0 (socket says 172.21.15.99:59084) 2024-02-21T23:02:40.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.066+0000 7fc531600640 1 -- 172.21.15.99:0/738221673 learned_addr learned my addr 172.21.15.99:0/738221673 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:40.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.066+0000 7fc530c00640 1 --2- 172.21.15.99:0/738221673 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc52c18b060 0x7fc52c15e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:40.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.066+0000 7fc532000640 1 --2- 172.21.15.99:0/738221673 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc52c18b4f0 0x7fc52c21f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:40.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.066+0000 7fc531600640 1 -- 172.21.15.99:0/738221673 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc52c18b4f0 msgr2=0x7fc52c21f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:40.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.066+0000 7fc531600640 1 --2- 172.21.15.99:0/738221673 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc52c18b4f0 0x7fc52c21f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:40.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.066+0000 7fc531600640 1 -- 172.21.15.99:0/738221673 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc52c18b060 msgr2=0x7fc52c15e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:40.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.066+0000 7fc531600640 1 --2- 172.21.15.99:0/738221673 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc52c18b060 0x7fc52c15e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:40.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.066+0000 7fc531600640 1 -- 172.21.15.99:0/738221673 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc52c0d1e70 con 0x7fc52c17f490 2024-02-21T23:02:40.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.066+0000 7fc531600640 1 --2- 172.21.15.99:0/738221673 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc52c17f490 0x7fc52c15df80 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc520000c00 tx=0x7fc5200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:40.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.067+0000 7fc529600640 1 -- 172.21.15.99:0/738221673 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc520034040 con 0x7fc52c17f490 2024-02-21T23:02:40.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.067+0000 7fc529600640 1 -- 172.21.15.99:0/738221673 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc520030e50 con 0x7fc52c17f490 2024-02-21T23:02:40.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.067+0000 7fc529600640 1 -- 172.21.15.99:0/738221673 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5200433f0 con 0x7fc52c17f490 2024-02-21T23:02:40.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.067+0000 7fc532a00640 1 -- 172.21.15.99:0/738221673 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc52c0d2150 con 0x7fc52c17f490 2024-02-21T23:02:40.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.067+0000 7fc532a00640 1 -- 172.21.15.99:0/738221673 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc52c21d110 con 0x7fc52c17f490 2024-02-21T23:02:40.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.071+0000 7fc529600640 1 -- 172.21.15.99:0/738221673 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 12) v1 ==== 134532+0+0 (secure 0 0 0) 0x7fc520037070 con 0x7fc52c17f490 2024-02-21T23:02:40.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.071+0000 7fc536f8a740 1 Processor -- start 2024-02-21T23:02:40.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.072+0000 7fc536f8a740 1 -- start start 2024-02-21T23:02:40.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.073+0000 7fc529600640 1 --2- 172.21.15.99:0/738221673 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fc50c09f030 0x7fc50c0a14f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:40.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.073+0000 7fc529600640 1 -- 172.21.15.99:0/738221673 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7fc5200ebee0 con 0x7fc52c17f490 2024-02-21T23:02:40.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.073+0000 7fc532000640 1 --2- 172.21.15.99:0/738221673 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fc50c09f030 0x7fc50c0a14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:40.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.073+0000 7fc536f8a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563f000442a0 0x563f00079d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:40.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.073+0000 7fc536f8a740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563f0007a260 0x563f00044680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:40.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.073+0000 7fc536f8a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563f00044bc0 0x563f000071d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:40.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.074+0000 7fc536f8a740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x563efff70a90 con 0x563f0007a260 2024-02-21T23:02:40.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.074+0000 7fc536f8a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x563efff19b10 con 0x563f00044bc0 2024-02-21T23:02:40.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.074+0000 7fc536f8a740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x563efff6cb30 con 0x563f000442a0 2024-02-21T23:02:40.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.074+0000 7fc530c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563f0007a260 0x563f00044680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:40.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.074+0000 7fc532000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563f00044bc0 0x563f000071d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:40.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.074+0000 7fc530c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563f0007a260 0x563f00044680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59096/0 (socket says 172.21.15.99:59096) 2024-02-21T23:02:40.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.074+0000 7fc530c00640 1 -- 172.21.15.99:0/3978392246 learned_addr learned my addr 172.21.15.99:0/3978392246 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:40.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.074+0000 7fc531600640 1 --2- 172.21.15.99:0/3978392246 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563f000442a0 0x563f00079d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:40.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.074+0000 7fc532000640 1 --2- 172.21.15.99:0/738221673 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fc50c09f030 0x7fc50c0a14f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc524011430 tx=0x7fc52400b040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:40.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.074+0000 7fc532000640 1 -- 172.21.15.99:0/3978392246 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563f000442a0 msgr2=0x563f00079d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:40.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.074+0000 7fc532000640 1 --2- 172.21.15.99:0/3978392246 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563f000442a0 0x563f00079d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:40.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.074+0000 7fc532000640 1 -- 172.21.15.99:0/3978392246 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563f0007a260 msgr2=0x563f00044680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:40.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.074+0000 7fc532000640 1 --2- 172.21.15.99:0/3978392246 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563f0007a260 0x563f00044680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:40.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.074+0000 7fc532000640 1 -- 172.21.15.99:0/3978392246 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563effd4f7d0 con 0x563f00044bc0 2024-02-21T23:02:40.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.074+0000 7fc530c00640 1 --2- 172.21.15.99:0/3978392246 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563f0007a260 0x563f00044680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:02:40.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.075+0000 7fc532000640 1 --2- 172.21.15.99:0/3978392246 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563f00044bc0 0x563f000071d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc524011cc0 tx=0x7fc52401c000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=731cf18895f86947 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:40.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.075+0000 7fc51dc00640 1 -- 172.21.15.99:0/3978392246 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc524026070 con 0x563f00044bc0 2024-02-21T23:02:40.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.075+0000 7fc51dc00640 1 -- 172.21.15.99:0/3978392246 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc524016bb0 con 0x563f00044bc0 2024-02-21T23:02:40.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.075+0000 7fc51dc00640 1 -- 172.21.15.99:0/3978392246 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc524020410 con 0x563f00044bc0 2024-02-21T23:02:40.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.076+0000 7fc536f8a740 1 -- 172.21.15.99:0/3978392246 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563f00044bc0 msgr2=0x563f000071d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:40.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.076+0000 7fc536f8a740 1 --2- 172.21.15.99:0/3978392246 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563f00044bc0 0x563f000071d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc524011cc0 tx=0x7fc52401c000 comp rx=0 tx=0).stop 2024-02-21T23:02:40.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.076+0000 7fc536f8a740 1 -- 172.21.15.99:0/3978392246 shutdown_connections 2024-02-21T23:02:40.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.076+0000 7fc536f8a740 1 --2- 172.21.15.99:0/3978392246 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563f00044bc0 0x563f000071d0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:40.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.076+0000 7fc536f8a740 1 --2- 172.21.15.99:0/3978392246 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563f0007a260 0x563f00044680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:40.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.076+0000 7fc536f8a740 1 --2- 172.21.15.99:0/3978392246 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563f000442a0 0x563f00079d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:40.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.076+0000 7fc536f8a740 1 -- 172.21.15.99:0/3978392246 >> 172.21.15.99:0/3978392246 conn(0x563efffd36b0 msgr2=0x563f0000b190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:40.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.076+0000 7fc536f8a740 1 -- 172.21.15.99:0/3978392246 shutdown_connections 2024-02-21T23:02:40.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.076+0000 7fc536f8a740 1 -- 172.21.15.99:0/3978392246 wait complete. 2024-02-21T23:02:40.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.077+0000 7fc536f8a740 1 -- start start 2024-02-21T23:02:40.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.078+0000 7fc536f8a740 1 Processor -- start 2024-02-21T23:02:40.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.080+0000 7fc536f8a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563f000442a0 0x563f0008bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:40.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.080+0000 7fc536f8a740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563f00044bc0 0x563f0000c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:40.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.080+0000 7fc536f8a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563f0007a260 0x563f000079e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:40.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.080+0000 7fc536f8a740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f00012f30 con 0x563f00044bc0 2024-02-21T23:02:40.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.080+0000 7fc536f8a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x563efff0f1c0 con 0x563f000442a0 2024-02-21T23:02:40.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.080+0000 7fc536f8a740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f0007b930 con 0x563f0007a260 2024-02-21T23:02:40.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.080+0000 7fc536f8a740 10 client.0 _ll_register_callbacks cb 0x563efff2c930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:02:40.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.080+0000 7fc530c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563f00044bc0 0x563f0000c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:40.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.080+0000 7fc531600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563f000442a0 0x563f0008bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:40.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.080+0000 7fc530c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563f00044bc0 0x563f0000c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59102/0 (socket says 172.21.15.99:59102) 2024-02-21T23:02:40.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.080+0000 7fc530c00640 1 -- 172.21.15.99:0/3939839231 learned_addr learned my addr 172.21.15.99:0/3939839231 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:40.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.081+0000 7fc532000640 1 --2- 172.21.15.99:0/3939839231 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563f0007a260 0x563f000079e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:40.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.081+0000 7fc531600640 1 -- 172.21.15.99:0/3939839231 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563f0007a260 msgr2=0x563f000079e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:40.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.081+0000 7fc531600640 1 --2- 172.21.15.99:0/3939839231 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563f0007a260 0x563f000079e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:40.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.081+0000 7fc531600640 1 -- 172.21.15.99:0/3939839231 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563f00044bc0 msgr2=0x563f0000c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:40.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.081+0000 7fc531600640 1 --2- 172.21.15.99:0/3939839231 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563f00044bc0 0x563f0000c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:40.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.081+0000 7fc531600640 1 -- 172.21.15.99:0/3939839231 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563effc853f0 con 0x563f000442a0 2024-02-21T23:02:40.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.081+0000 7fc532000640 1 --2- 172.21.15.99:0/3939839231 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563f0007a260 0x563f000079e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T23:02:40.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.081+0000 7fc531600640 1 --2- 172.21.15.99:0/3939839231 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563f000442a0 0x563f0008bb50 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc5200e9400 tx=0x7fc5200b95b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a8ec52c1c2bd5cb server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:40.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.081+0000 7fc512000640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-02-21T23:02:40.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.081+0000 7fc512000640 1 -- 172.21.15.99:0/3939839231 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5200e98b0 con 0x563f000442a0 2024-02-21T23:02:40.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.081+0000 7fc536f8a740 1 -- 172.21.15.99:0/3939839231 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc524016bb0 con 0x563f000442a0 2024-02-21T23:02:40.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.081+0000 7fc512000640 1 -- 172.21.15.99:0/3939839231 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7fc5200c1810 con 0x563f000442a0 2024-02-21T23:02:40.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.081+0000 7fc512000640 1 -- 172.21.15.99:0/3939839231 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc5200e9050 con 0x563f000442a0 2024-02-21T23:02:40.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.081+0000 7fc536f8a740 10 client.5218 fetch_fsmap learned FSMap version 15 2024-02-21T23:02:40.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.081+0000 7fc536f8a740 1 -- 172.21.15.99:0/3939839231 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x563effc450f0 con 0x563f000442a0 2024-02-21T23:02:40.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.082+0000 7fc512000640 1 -- 172.21.15.99:0/3939839231 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc524016bb0 con 0x563f000442a0 2024-02-21T23:02:40.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.082+0000 7fc512000640 1 -- 172.21.15.99:0/3939839231 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 15) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fc5200bd170 con 0x563f000442a0 2024-02-21T23:02:40.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.082+0000 7fc536f8a740 10 client.5218 fetch_fsmap finished waiting for FSMap version 15 2024-02-21T23:02:40.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.082+0000 7fc536f8a740 10 client.5218 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:02:40.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.082+0000 7fc536f8a740 20 client.5218 populate_metadata read hostname 'smithi099' 2024-02-21T23:02:40.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.082+0000 7fc536f8a740 1 --2- 172.21.15.99:0/3939839231 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x563f0008fdd0 0x563f0008f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:40.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.082+0000 7fc536f8a740 4 client.5218 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:02:40.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.082+0000 7fc536f8a740 1 -- 172.21.15.99:0/3939839231 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563efff7dfd0 con 0x563f0008fdd0 2024-02-21T23:02:40.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.082+0000 7fc530c00640 1 --2- 172.21.15.99:0/3939839231 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x563f0008fdd0 0x563f0008f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:40.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.083+0000 7fc530c00640 1 --2- 172.21.15.99:0/3939839231 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x563f0008fdd0 0x563f0008f0c0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8981e18835f621e7 server_cookie=899366ccb238b546 in_seq=0 out_seq=0 2024-02-21T23:02:40.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.083+0000 7fc512000640 10 client.5218 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:02:40.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.084+0000 7fc512000640 1 -- 172.21.15.99:0/3939839231 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x563efff7dfd0 con 0x563f0008fdd0 2024-02-21T23:02:40.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.084+0000 7fc512000640 10 client.5218 handle_command_reply: tid=0 2024-02-21T23:02:40.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.084+0000 7fc536f8a740 1 client.5218 shutdown 2024-02-21T23:02:40.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.084+0000 7fc536f8a740 1 -- 172.21.15.99:0/3939839231 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563f000442a0 msgr2=0x563f0008bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:40.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.084+0000 7fc536f8a740 1 --2- 172.21.15.99:0/3939839231 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563f000442a0 0x563f0008bb50 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc5200e9400 tx=0x7fc5200b95b0 comp rx=0 tx=0).stop 2024-02-21T23:02:40.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.084+0000 7fc536f8a740 1 -- 172.21.15.99:0/3939839231 shutdown_connections 2024-02-21T23:02:40.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.084+0000 7fc536f8a740 1 --2- 172.21.15.99:0/3939839231 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x563f0008fdd0 0x563f0008f0c0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:40.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.084+0000 7fc536f8a740 1 --2- 172.21.15.99:0/3939839231 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563f0007a260 0x563f000079e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:40.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.084+0000 7fc536f8a740 1 --2- 172.21.15.99:0/3939839231 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563f00044bc0 0x563f0000c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:40.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.084+0000 7fc536f8a740 1 --2- 172.21.15.99:0/3939839231 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563f000442a0 0x563f0008bb50 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:40.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.084+0000 7fc512000640 0 client.5218 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:02:40.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.084+0000 7fc536f8a740 1 -- 172.21.15.99:0/3939839231 >> 172.21.15.99:0/3939839231 conn(0x563efffd36b0 msgr2=0x563f0007e950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:40.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.085+0000 7fc536f8a740 1 -- 172.21.15.99:0/3939839231 shutdown_connections 2024-02-21T23:02:40.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.085+0000 7fc536f8a740 1 -- 172.21.15.99:0/3939839231 wait complete. 2024-02-21T23:02:40.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.085+0000 7fc536f8a740 20 client.5218 trim_cache size 0 max 16384 2024-02-21T23:02:40.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.119+0000 7fc536f8a740 1 Processor -- start 2024-02-21T23:02:40.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.119+0000 7fc536f8a740 1 -- start start 2024-02-21T23:02:40.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.121+0000 7fc536f8a740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563f000442a0 0x563f00050470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:40.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.121+0000 7fc536f8a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563f00044bc0 0x563f000892d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:40.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.121+0000 7fc536f8a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563f0007a260 0x563f0007f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:40.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.121+0000 7fc536f8a740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc52c22c8b0 con 0x563f000442a0 2024-02-21T23:02:40.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.121+0000 7fc536f8a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc52c22a450 con 0x563f00044bc0 2024-02-21T23:02:40.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.121+0000 7fc536f8a740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc52c228510 con 0x563f0007a260 2024-02-21T23:02:40.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.122+0000 7fc531600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563f000442a0 0x563f00050470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:40.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.122+0000 7fc531600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563f000442a0 0x563f00050470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59106/0 (socket says 172.21.15.99:59106) 2024-02-21T23:02:40.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.122+0000 7fc531600640 1 -- 172.21.15.99:0/2581934867 learned_addr learned my addr 172.21.15.99:0/2581934867 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:40.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.122+0000 7fc532000640 1 --2- 172.21.15.99:0/2581934867 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563f0007a260 0x563f0007f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:40.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.122+0000 7fc530c00640 1 --2- 172.21.15.99:0/2581934867 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563f00044bc0 0x563f000892d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:40.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.122+0000 7fc531600640 1 -- 172.21.15.99:0/2581934867 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563f0007a260 msgr2=0x563f0007f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:40.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.122+0000 7fc531600640 1 --2- 172.21.15.99:0/2581934867 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563f0007a260 0x563f0007f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:40.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.122+0000 7fc531600640 1 -- 172.21.15.99:0/2581934867 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563f00044bc0 msgr2=0x563f000892d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:40.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.122+0000 7fc531600640 1 --2- 172.21.15.99:0/2581934867 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563f00044bc0 0x563f000892d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:40.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.122+0000 7fc531600640 1 -- 172.21.15.99:0/2581934867 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563f0004d0a0 con 0x563f000442a0 2024-02-21T23:02:40.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.122+0000 7fc531600640 1 --2- 172.21.15.99:0/2581934867 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563f000442a0 0x563f00050470 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc5200b92b0 tx=0x7fc520045000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ada71326b11dce2 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:40.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.123+0000 7fc51d200640 1 -- 172.21.15.99:0/2581934867 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5200c1ca0 con 0x563f000442a0 2024-02-21T23:02:40.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.123+0000 7fc51d200640 1 -- 172.21.15.99:0/2581934867 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5200c1810 con 0x563f000442a0 2024-02-21T23:02:40.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.123+0000 7fc51d200640 1 -- 172.21.15.99:0/2581934867 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5200e96b0 con 0x563f000442a0 2024-02-21T23:02:40.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.123+0000 7fc536f8a740 1 -- 172.21.15.99:0/2581934867 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563f000442a0 msgr2=0x563f00050470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:40.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.123+0000 7fc536f8a740 1 --2- 172.21.15.99:0/2581934867 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563f000442a0 0x563f00050470 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc5200b92b0 tx=0x7fc520045000 comp rx=0 tx=0).stop 2024-02-21T23:02:40.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.123+0000 7fc536f8a740 1 -- 172.21.15.99:0/2581934867 shutdown_connections 2024-02-21T23:02:40.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.123+0000 7fc536f8a740 1 --2- 172.21.15.99:0/2581934867 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563f0007a260 0x563f0007f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:40.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.123+0000 7fc536f8a740 1 --2- 172.21.15.99:0/2581934867 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563f00044bc0 0x563f000892d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:40.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.123+0000 7fc536f8a740 1 --2- 172.21.15.99:0/2581934867 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563f000442a0 0x563f00050470 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:40.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.123+0000 7fc536f8a740 1 -- 172.21.15.99:0/2581934867 >> 172.21.15.99:0/2581934867 conn(0x563efffd36b0 msgr2=0x563f0004aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:40.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.124+0000 7fc536f8a740 1 -- 172.21.15.99:0/2581934867 shutdown_connections 2024-02-21T23:02:40.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.124+0000 7fc536f8a740 1 -- 172.21.15.99:0/2581934867 wait complete. 2024-02-21T23:02:40.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.124+0000 7fc536f8a740 1 -- start start 2024-02-21T23:02:40.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.125+0000 7fc536f8a740 1 Processor -- start 2024-02-21T23:02:40.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.126+0000 7fc536f8a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563f000442a0 0x563f000893d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:40.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.126+0000 7fc536f8a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563f00044bc0 0x563f000e8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:40.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.126+0000 7fc536f8a740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563f0007a260 0x563f000799d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:40.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.126+0000 7fc536f8a740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc52c228b10 con 0x563f0007a260 2024-02-21T23:02:40.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.126+0000 7fc536f8a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc52c229df0 con 0x563f00044bc0 2024-02-21T23:02:40.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.126+0000 7fc536f8a740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc52c229130 con 0x563f000442a0 2024-02-21T23:02:40.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.126+0000 7fc536f8a740 10 client.0 _ll_register_callbacks cb 0x7fc5200b91c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:02:40.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.126+0000 7fc532000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563f0007a260 0x563f000799d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:40.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.126+0000 7fc531600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563f000442a0 0x563f000893d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:40.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.126+0000 7fc532000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563f0007a260 0x563f000799d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59120/0 (socket says 172.21.15.99:59120) 2024-02-21T23:02:40.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.126+0000 7fc532000640 1 -- 172.21.15.99:0/2145038523 learned_addr learned my addr 172.21.15.99:0/2145038523 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:40.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.126+0000 7fc530c00640 1 --2- 172.21.15.99:0/2145038523 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563f00044bc0 0x563f000e8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:40.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.127+0000 7fc531600640 1 -- 172.21.15.99:0/2145038523 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563f00044bc0 msgr2=0x563f000e8bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:40.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.127+0000 7fc531600640 1 --2- 172.21.15.99:0/2145038523 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563f00044bc0 0x563f000e8bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:40.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.127+0000 7fc531600640 1 -- 172.21.15.99:0/2145038523 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563f0007a260 msgr2=0x563f000799d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:40.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.127+0000 7fc531600640 1 --2- 172.21.15.99:0/2145038523 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563f0007a260 0x563f000799d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:40.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.127+0000 7fc531600640 1 -- 172.21.15.99:0/2145038523 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563f00036f50 con 0x563f000442a0 2024-02-21T23:02:40.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.127+0000 7fc532000640 1 --2- 172.21.15.99:0/2145038523 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563f0007a260 0x563f000799d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:02:40.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.127+0000 7fc531600640 1 --2- 172.21.15.99:0/2145038523 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563f000442a0 0x563f000893d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc5200b95f0 tx=0x7fc520006ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bca03b6004b6186c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:40.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.127+0000 7fc512000640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-02-21T23:02:40.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.127+0000 7fc512000640 1 -- 172.21.15.99:0/2145038523 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5200e98b0 con 0x563f000442a0 2024-02-21T23:02:40.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.127+0000 7fc512000640 1 -- 172.21.15.99:0/2145038523 <== mon.2 v2:172.21.15.181:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7fc5200b8a00 con 0x563f000442a0 2024-02-21T23:02:40.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.127+0000 7fc536f8a740 1 -- 172.21.15.99:0/2145038523 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc5200c1810 con 0x563f000442a0 2024-02-21T23:02:40.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.128+0000 7fc512000640 1 -- 172.21.15.99:0/2145038523 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc5200c1ca0 con 0x563f000442a0 2024-02-21T23:02:40.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.128+0000 7fc536f8a740 10 client.5213 fetch_fsmap learned FSMap version 15 2024-02-21T23:02:40.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.128+0000 7fc536f8a740 1 -- 172.21.15.99:0/2145038523 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x563f0008bd80 con 0x563f000442a0 2024-02-21T23:02:40.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.128+0000 7fc512000640 1 -- 172.21.15.99:0/2145038523 <== mon.2 v2:172.21.15.181:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5200c1810 con 0x563f000442a0 2024-02-21T23:02:40.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.128+0000 7fc512000640 1 -- 172.21.15.99:0/2145038523 <== mon.2 v2:172.21.15.181:3300/0 5 ==== fsmap(e 15) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fc5200b5300 con 0x563f000442a0 2024-02-21T23:02:40.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.128+0000 7fc536f8a740 10 client.5213 fetch_fsmap finished waiting for FSMap version 15 2024-02-21T23:02:40.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.128+0000 7fc536f8a740 10 client.5213 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:02:40.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.128+0000 7fc536f8a740 20 client.5213 populate_metadata read hostname 'smithi099' 2024-02-21T23:02:40.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.128+0000 7fc536f8a740 1 --2- 172.21.15.99:0/2145038523 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x563f00009b40 0x563f000126b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:40.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.128+0000 7fc536f8a740 4 client.5213 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T23:02:40.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.128+0000 7fc536f8a740 1 -- 172.21.15.99:0/2145038523 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x563efff78320 con 0x563f00009b40 2024-02-21T23:02:40.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.128+0000 7fc530c00640 1 --2- 172.21.15.99:0/2145038523 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x563f00009b40 0x563f000126b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:40.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.129+0000 7fc512000640 10 client.5213 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:02:40.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.129+0000 7fc530c00640 1 --2- 172.21.15.99:0/2145038523 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x563f00009b40 0x563f000126b0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=79d432594d1c1f95 server_cookie=cda9ddea5fac88bc in_seq=0 out_seq=0 2024-02-21T23:02:40.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.129+0000 7fc512000640 1 -- 172.21.15.99:0/2145038523 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x563efff78320 con 0x563f00009b40 2024-02-21T23:02:40.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.129+0000 7fc512000640 10 client.5213 handle_command_reply: tid=0 2024-02-21T23:02:40.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.129+0000 7fc536f8a740 1 client.5213 shutdown 2024-02-21T23:02:40.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.129+0000 7fc536f8a740 1 -- 172.21.15.99:0/2145038523 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563f000442a0 msgr2=0x563f000893d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:40.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.129+0000 7fc536f8a740 1 --2- 172.21.15.99:0/2145038523 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563f000442a0 0x563f000893d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc5200b95f0 tx=0x7fc520006ed0 comp rx=0 tx=0).stop 2024-02-21T23:02:40.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.130+0000 7fc536f8a740 1 -- 172.21.15.99:0/2145038523 shutdown_connections 2024-02-21T23:02:40.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.130+0000 7fc536f8a740 1 --2- 172.21.15.99:0/2145038523 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x563f00009b40 0x563f000126b0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:40.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.130+0000 7fc536f8a740 1 --2- 172.21.15.99:0/2145038523 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563f0007a260 0x563f000799d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:40.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.130+0000 7fc536f8a740 1 --2- 172.21.15.99:0/2145038523 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563f00044bc0 0x563f000e8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:40.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.130+0000 7fc536f8a740 1 --2- 172.21.15.99:0/2145038523 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563f000442a0 0x563f000893d0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:40.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.130+0000 7fc536f8a740 1 -- 172.21.15.99:0/2145038523 >> 172.21.15.99:0/2145038523 conn(0x563efffd36b0 msgr2=0x563f0007e110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:40.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.130+0000 7fc512000640 0 client.5213 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:02:40.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.130+0000 7fc536f8a740 1 -- 172.21.15.99:0/2145038523 shutdown_connections 2024-02-21T23:02:40.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.130+0000 7fc536f8a740 1 -- 172.21.15.99:0/2145038523 wait complete. 2024-02-21T23:02:40.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.130+0000 7fc536f8a740 20 client.5213 trim_cache size 0 max 16384 2024-02-21T23:02:40.122 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-02-21T23:02:40.122 INFO:teuthology.orchestra.run.smithi099.stdout: "status": "no active scrubs running", 2024-02-21T23:02:40.122 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubs": {} 2024-02-21T23:02:40.122 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-02-21T23:02:40.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.131+0000 7fc532a00640 1 -- 172.21.15.99:0/738221673 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fc50c09f030 msgr2=0x7fc50c0a14f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:40.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.131+0000 7fc532a00640 1 --2- 172.21.15.99:0/738221673 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fc50c09f030 0x7fc50c0a14f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc524011430 tx=0x7fc52400b040 comp rx=0 tx=0).stop 2024-02-21T23:02:40.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.131+0000 7fc532a00640 1 -- 172.21.15.99:0/738221673 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc52c17f490 msgr2=0x7fc52c15df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:40.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.131+0000 7fc532a00640 1 --2- 172.21.15.99:0/738221673 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc52c17f490 0x7fc52c15df80 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc520000c00 tx=0x7fc5200046c0 comp rx=0 tx=0).stop 2024-02-21T23:02:40.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.131+0000 7fc532a00640 1 -- 172.21.15.99:0/738221673 shutdown_connections 2024-02-21T23:02:40.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.131+0000 7fc532a00640 1 --2- 172.21.15.99:0/738221673 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fc50c09f030 0x7fc50c0a14f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:40.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.131+0000 7fc532a00640 1 --2- 172.21.15.99:0/738221673 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc52c18b4f0 0x7fc52c21f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:40.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.131+0000 7fc532a00640 1 --2- 172.21.15.99:0/738221673 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc52c18b060 0x7fc52c15e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:40.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.131+0000 7fc532a00640 1 --2- 172.21.15.99:0/738221673 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc52c17f490 0x7fc52c15df80 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:40.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.131+0000 7fc532a00640 1 -- 172.21.15.99:0/738221673 >> 172.21.15.99:0/738221673 conn(0x7fc52c0d29b0 msgr2=0x7fc52c18bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:40.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.131+0000 7fc532a00640 1 -- 172.21.15.99:0/738221673 shutdown_connections 2024-02-21T23:02:40.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.131+0000 7fc532a00640 1 -- 172.21.15.99:0/738221673 wait complete. 2024-02-21T23:02:40.138 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-02-21T23:02:40.138 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T23:02:40.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.353+0000 7fa5a2200640 1 Processor -- start 2024-02-21T23:02:40.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.353+0000 7fa5a2200640 1 -- start start 2024-02-21T23:02:40.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.355+0000 7fa5a2200640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fa59c1865c0 0x7fa59c188190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:40.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.355+0000 7fa5a2200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa59c186a50 con 0x7fa59c0d4300 2024-02-21T23:02:40.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.355+0000 7fa5a2200640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa59c1886d0 con 0x7fa59c1861e0 2024-02-21T23:02:40.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.355+0000 7fa5a2200640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa59c186d50 con 0x7fa59c1865c0 2024-02-21T23:02:40.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.355+0000 7fa59aa00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fa59c1865c0 0x7fa59c188190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:40.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.355+0000 7fa59be00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fa59c0d4300 0x7fa59c0d4700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.99:42262/0 (socket says 172.21.15.99:42262) 2024-02-21T23:02:40.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.355+0000 7fa59be00640 1 -- 172.21.15.99:0/1325235989 learned_addr learned my addr 172.21.15.99:0/1325235989 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:02:40.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.356+0000 7fa59a000640 1 -- 172.21.15.99:0/1325235989 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 287786170 0 0) 0x7fa59c186a50 con 0x7fa59c0d4300 2024-02-21T23:02:40.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.356+0000 7fa59a000640 1 -- 172.21.15.99:0/1325235989 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa580003520 con 0x7fa59c0d4300 2024-02-21T23:02:40.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.356+0000 7fa59a000640 1 -- 172.21.15.99:0/1325235989 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3227794917 0 0) 0x7fa59c1886d0 con 0x7fa59c1861e0 2024-02-21T23:02:40.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.356+0000 7fa59aa00640 1 -- 172.21.15.99:0/1325235989 >> v1:172.21.15.181:6789/0 conn(0x7fa59c1861e0 legacy=0x7fa59c187a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:40.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.356+0000 7fa59aa00640 1 -- 172.21.15.99:0/1325235989 >> v1:172.21.15.162:6789/0 conn(0x7fa59c0d4300 legacy=0x7fa59c0d4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:40.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.356+0000 7fa59aa00640 1 -- 172.21.15.99:0/1325235989 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa59c0cf7e0 con 0x7fa59c1865c0 2024-02-21T23:02:40.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.357+0000 7fa59aa00640 1 --2- 172.21.15.99:0/1325235989 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa59c1865c0 0x7fa59c188190 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa5880097a0 tx=0x7fa58802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8dc35317edfda9e5 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:40.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.357+0000 7fa59a000640 1 -- 172.21.15.99:0/1325235989 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa588035020 con 0x7fa59c1865c0 2024-02-21T23:02:40.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.357+0000 7fa59a000640 1 -- 172.21.15.99:0/1325235989 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa588031830 con 0x7fa59c1865c0 2024-02-21T23:02:40.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.357+0000 7fa59a000640 1 -- 172.21.15.99:0/1325235989 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa588031c00 con 0x7fa59c1865c0 2024-02-21T23:02:40.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.358+0000 7fa5a2200640 1 -- 172.21.15.99:0/1325235989 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa59c1865c0 msgr2=0x7fa59c188190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:40.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.358+0000 7fa5a2200640 1 --2- 172.21.15.99:0/1325235989 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa59c1865c0 0x7fa59c188190 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa5880097a0 tx=0x7fa58802b8d0 comp rx=0 tx=0).stop 2024-02-21T23:02:40.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.358+0000 7fa5a2200640 1 -- 172.21.15.99:0/1325235989 shutdown_connections 2024-02-21T23:02:40.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.358+0000 7fa5a2200640 1 --2- 172.21.15.99:0/1325235989 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa59c1865c0 0x7fa59c188190 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:40.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.358+0000 7fa5a2200640 1 -- 172.21.15.99:0/1325235989 >> 172.21.15.99:0/1325235989 conn(0x7fa59c0d6ac0 msgr2=0x7fa59c0740b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:40.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.358+0000 7fa5a2200640 1 -- 172.21.15.99:0/1325235989 shutdown_connections 2024-02-21T23:02:40.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.358+0000 7fa5a2200640 1 -- 172.21.15.99:0/1325235989 wait complete. 2024-02-21T23:02:40.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.360+0000 7fa5a2200640 1 Processor -- start 2024-02-21T23:02:40.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.360+0000 7fa5a2200640 1 -- start start 2024-02-21T23:02:40.350 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:02:40.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.362+0000 7fa5a2200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa59c0d4300 0x7fa59c090280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:40.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.362+0000 7fa5a2200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa59c1861e0 0x7fa59c0cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:40.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.362+0000 7fa5a2200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa59c1865c0 0x7fa59c171a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:40.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.362+0000 7fa5a2200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa59c186fa0 con 0x7fa59c0d4300 2024-02-21T23:02:40.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.362+0000 7fa5a2200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa59c1875f0 con 0x7fa59c1865c0 2024-02-21T23:02:40.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.362+0000 7fa5a2200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa59c187280 con 0x7fa59c1861e0 2024-02-21T23:02:40.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.362+0000 7fa59b400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa59c0d4300 0x7fa59c090280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:40.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.362+0000 7fa59be00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa59c1865c0 0x7fa59c171a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:40.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.362+0000 7fa59b400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa59c0d4300 0x7fa59c090280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59136/0 (socket says 172.21.15.99:59136) 2024-02-21T23:02:40.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.362+0000 7fa59aa00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa59c1861e0 0x7fa59c0cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:40.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.362+0000 7fa59b400640 1 -- 172.21.15.99:0/1973895202 learned_addr learned my addr 172.21.15.99:0/1973895202 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:40.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.363+0000 7fa59aa00640 1 -- 172.21.15.99:0/1973895202 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa59c1865c0 msgr2=0x7fa59c171a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:40.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.363+0000 7fa59aa00640 1 --2- 172.21.15.99:0/1973895202 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa59c1865c0 0x7fa59c171a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:40.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.363+0000 7fa59aa00640 1 -- 172.21.15.99:0/1973895202 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa59c0d4300 msgr2=0x7fa59c090280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:40.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.363+0000 7fa59aa00640 1 --2- 172.21.15.99:0/1973895202 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa59c0d4300 0x7fa59c090280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:40.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.363+0000 7fa59aa00640 1 -- 172.21.15.99:0/1973895202 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa59c0ce450 con 0x7fa59c1861e0 2024-02-21T23:02:40.355 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:02:40.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.363+0000 7fa59aa00640 1 --2- 172.21.15.99:0/1973895202 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa59c1861e0 0x7fa59c0cddf0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa588033000 tx=0x7fa5880046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:40.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.364+0000 7fa593400640 1 -- 172.21.15.99:0/1973895202 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa588048070 con 0x7fa59c1861e0 2024-02-21T23:02:40.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.364+0000 7fa593400640 1 -- 172.21.15.99:0/1973895202 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa58803a8f0 con 0x7fa59c1861e0 2024-02-21T23:02:40.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.364+0000 7fa5a2200640 1 -- 172.21.15.99:0/1973895202 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa59c0ce730 con 0x7fa59c1861e0 2024-02-21T23:02:40.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.364+0000 7fa593400640 1 -- 172.21.15.99:0/1973895202 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa588035070 con 0x7fa59c1861e0 2024-02-21T23:02:40.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.364+0000 7fa5a2200640 1 -- 172.21.15.99:0/1973895202 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa59c0cecf0 con 0x7fa59c1861e0 2024-02-21T23:02:40.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.365+0000 7fa5a2200640 1 -- 172.21.15.99:0/1973895202 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa59c18b800 con 0x7fa59c1861e0 2024-02-21T23:02:40.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.368+0000 7fa593400640 1 -- 172.21.15.99:0/1973895202 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 12) v1 ==== 134532+0+0 (secure 0 0 0) 0x7fa58804b070 con 0x7fa59c1861e0 2024-02-21T23:02:40.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.370+0000 7fa593400640 1 --2- 172.21.15.99:0/1973895202 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa57c09ef90 0x7fa57c0a1450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:40.360 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:02:40.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.370+0000 7fa593400640 1 -- 172.21.15.99:0/1973895202 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7fa5880eb9b0 con 0x7fa59c1861e0 2024-02-21T23:02:40.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.370+0000 7fa59b400640 1 --2- 172.21.15.99:0/1973895202 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa57c09ef90 0x7fa57c0a1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:40.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.371+0000 7fa59b400640 1 --2- 172.21.15.99:0/1973895202 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa57c09ef90 0x7fa57c0a1450 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa58c007fd0 tx=0x7fa58c009040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:40.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.374+0000 7fa593400640 1 -- 172.21.15.99:0/1973895202 <== mon.2 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fa588040070 con 0x7fa59c1861e0 2024-02-21T23:02:40.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.727+0000 7fa5a2200640 1 -- 172.21.15.99:0/1973895202 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa59c18b240 con 0x7fa59c1861e0 2024-02-21T23:02:40.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.728+0000 7fa593400640 1 -- 172.21.15.99:0/1973895202 <== mon.2 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+11335 (secure 0 0 0) 0x7fa5880b9080 con 0x7fa59c1861e0 2024-02-21T23:02:40.718 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T23:02:40.718 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4307,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/3514452812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3514452812},{"type":"v1","addr":"172.21.15.162:6836","nonce":3514452812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4312,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6838/2169982089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":2169982089},{"type":"v1","addr":"172.21.15.162:6838","nonce":2169982089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4315,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6839/3335972724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6837","nonce":3335972724},{"type":"v1","addr":"172.21.15.162:6839","nonce":3335972724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4318,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6841/2135456697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6840","nonce":2135456697},{"type":"v1","addr":"172.21.15.162:6841","nonce":2135456697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4325,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2452242758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2452242758},{"type":"v1","addr":"172.21.15.181:6833","nonce":2452242758}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4328,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6836/2751486400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":2751486400},{"type":"v1","addr":"172.21.15.181:6836","nonce":2751486400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":15,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-21T23:01:02.656130+0000","modified":"2024-02-21T23:01:57.191106+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4355,"mds_1":4352,"mds_2":4348},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4331":{"gid":4331,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6838/3728901330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6835","nonce":3728901330},{"type":"v1","addr":"172.21.15.181:6838","nonce":3728901330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4339":{"gid":4339,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6839/3357929641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6837","nonce":3357929641},{"type":"v1","addr":"172.21.15.181:6839","nonce":3357929641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4343":{"gid":4343,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6833/2793485078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":2793485078},{"type":"v1","addr":"172.21.15.99:6833","nonce":2793485078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4348":{"gid":4348,"name":"d","rank":2,"incarnation":12,"state":"up:active","state_seq":10,"addr":"172.21.15.99:6835/2243461688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2243461688},{"type":"v1","addr":"172.21.15.99:6835","nonce":2243461688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4352":{"gid":4352,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.99:6837/1676159950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":1676159950},{"type":"v1","addr":"172.21.15.99:6837","nonce":1676159950}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4355":{"gid":4355,"name":"j","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6839/4239008786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":4239008786},{"type":"v1","addr":"172.21.15.99:6839","nonce":4239008786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-21T23:02:40.718 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 15 2024-02-21T23:02:40.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.732+0000 7fa5a2200640 1 -- 172.21.15.99:0/1973895202 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa57c09ef90 msgr2=0x7fa57c0a1450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:40.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.732+0000 7fa5a2200640 1 --2- 172.21.15.99:0/1973895202 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa57c09ef90 0x7fa57c0a1450 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa58c007fd0 tx=0x7fa58c009040 comp rx=0 tx=0).stop 2024-02-21T23:02:40.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.732+0000 7fa5a2200640 1 -- 172.21.15.99:0/1973895202 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa59c1861e0 msgr2=0x7fa59c0cddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:40.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.732+0000 7fa5a2200640 1 --2- 172.21.15.99:0/1973895202 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa59c1861e0 0x7fa59c0cddf0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa588033000 tx=0x7fa5880046c0 comp rx=0 tx=0).stop 2024-02-21T23:02:40.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.732+0000 7fa5a2200640 1 -- 172.21.15.99:0/1973895202 shutdown_connections 2024-02-21T23:02:40.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.732+0000 7fa5a2200640 1 --2- 172.21.15.99:0/1973895202 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa57c09ef90 0x7fa57c0a1450 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:40.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.732+0000 7fa5a2200640 1 --2- 172.21.15.99:0/1973895202 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa59c1865c0 0x7fa59c171a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:40.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.732+0000 7fa5a2200640 1 --2- 172.21.15.99:0/1973895202 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa59c1861e0 0x7fa59c0cddf0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:40.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.732+0000 7fa5a2200640 1 --2- 172.21.15.99:0/1973895202 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa59c0d4300 0x7fa59c090280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:40.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.732+0000 7fa5a2200640 1 -- 172.21.15.99:0/1973895202 >> 172.21.15.99:0/1973895202 conn(0x7fa59c0d6ac0 msgr2=0x7fa59c0faff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:40.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.732+0000 7fa5a2200640 1 -- 172.21.15.99:0/1973895202 shutdown_connections 2024-02-21T23:02:40.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.732+0000 7fa5a2200640 1 -- 172.21.15.99:0/1973895202 wait complete. 2024-02-21T23:02:40.744 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T23:02:40.744 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-02-21T23:02:40.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.996+0000 7f43a2600640 1 Processor -- start 2024-02-21T23:02:40.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.996+0000 7f43a2600640 1 -- start start 2024-02-21T23:02:40.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.998+0000 7f43a2600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f439c17f490 0x7f439c18ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:40.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.999+0000 7f43a2600640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f439c18b060 0x7f439c188a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:40.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.999+0000 7f43a2600640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f439c0d6dd0 con 0x7f439c18b4f0 2024-02-21T23:02:40.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.999+0000 7f43a2600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f439c1614c0 con 0x7f439c17f490 2024-02-21T23:02:40.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.999+0000 7f43a2600640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f439c0d6810 con 0x7f439c18b060 2024-02-21T23:02:40.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.999+0000 7f43a1200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f439c17f490 0x7f439c18ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:40.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.999+0000 7f43a1200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f439c17f490 0x7f439c18ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59148/0 (socket says 172.21.15.99:59148) 2024-02-21T23:02:40.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.999+0000 7f43a1200640 1 -- 172.21.15.99:0/946346588 learned_addr learned my addr 172.21.15.99:0/946346588 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:40.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.999+0000 7f439be00640 1 --2- 172.21.15.99:0/946346588 >> v2:172.21.15.181:3300/0 conn(0x7f439c18b060 0x7f439c188a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:40.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.999+0000 7f43a1200640 1 -- 172.21.15.99:0/946346588 >> v2:172.21.15.181:3300/0 conn(0x7f439c18b060 msgr2=0x7f439c188a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:40.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.999+0000 7f43a1200640 1 --2- 172.21.15.99:0/946346588 >> v2:172.21.15.181:3300/0 conn(0x7f439c18b060 0x7f439c188a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:40.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.999+0000 7f43a1200640 1 -- 172.21.15.99:0/946346588 >> v1:172.21.15.181:6789/0 conn(0x7f439c18b4f0 legacy=0x7f439c188f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:40.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:40.999+0000 7f43a1200640 1 -- 172.21.15.99:0/946346588 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f439c0d6af0 con 0x7f439c17f490 2024-02-21T23:02:40.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.001+0000 7f43a1200640 1 --2- 172.21.15.99:0/946346588 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f439c17f490 0x7f439c18ab20 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f439c186880 tx=0x7f439002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=416c6c1d64abe47 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:40.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.001+0000 7f439b400640 1 -- 172.21.15.99:0/946346588 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4390034070 con 0x7f439c17f490 2024-02-21T23:02:40.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.001+0000 7f439b400640 1 -- 172.21.15.99:0/946346588 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4390030860 con 0x7f439c17f490 2024-02-21T23:02:40.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.001+0000 7f439b400640 1 -- 172.21.15.99:0/946346588 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4390030c30 con 0x7f439c17f490 2024-02-21T23:02:40.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.002+0000 7f43a2600640 1 -- 172.21.15.99:0/946346588 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f439c17f490 msgr2=0x7f439c18ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:40.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.002+0000 7f43a2600640 1 --2- 172.21.15.99:0/946346588 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f439c17f490 0x7f439c18ab20 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f439c186880 tx=0x7f439002b9a0 comp rx=0 tx=0).stop 2024-02-21T23:02:40.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.002+0000 7f43a2600640 1 -- 172.21.15.99:0/946346588 shutdown_connections 2024-02-21T23:02:40.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.002+0000 7f43a2600640 1 --2- 172.21.15.99:0/946346588 >> v2:172.21.15.181:3300/0 conn(0x7f439c18b060 0x7f439c188a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:40.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.002+0000 7f43a2600640 1 --2- 172.21.15.99:0/946346588 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f439c17f490 0x7f439c18ab20 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:40.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.002+0000 7f43a2600640 1 -- 172.21.15.99:0/946346588 >> 172.21.15.99:0/946346588 conn(0x7f439c0d29b0 msgr2=0x7f439c0d2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:40.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.002+0000 7f43a2600640 1 -- 172.21.15.99:0/946346588 shutdown_connections 2024-02-21T23:02:40.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.002+0000 7f43a2600640 1 -- 172.21.15.99:0/946346588 wait complete. 2024-02-21T23:02:40.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.005+0000 7f43a2600640 1 Processor -- start 2024-02-21T23:02:40.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.005+0000 7f43a2600640 1 -- start start 2024-02-21T23:02:41.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.007+0000 7f43a2600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f439c17f490 0x7f439c21fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:41.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.007+0000 7f43a2600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f439c18b060 0x7f439c17fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:41.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.007+0000 7f43a2600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f439c18b4f0 0x7f439c180290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:41.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.007+0000 7f43a2600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f439c18a600 con 0x7f439c17f490 2024-02-21T23:02:41.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.007+0000 7f43a2600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f439c18a320 con 0x7f439c18b4f0 2024-02-21T23:02:41.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.007+0000 7f43a2600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f439c17f870 con 0x7f439c18b060 2024-02-21T23:02:41.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.008+0000 7f43a1200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f439c17f490 0x7f439c21fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:41.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.008+0000 7f43a1200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f439c17f490 0x7f439c21fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59160/0 (socket says 172.21.15.99:59160) 2024-02-21T23:02:41.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.008+0000 7f43a1200640 1 -- 172.21.15.99:0/3722582304 learned_addr learned my addr 172.21.15.99:0/3722582304 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:41.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.008+0000 7f439be00640 1 --2- 172.21.15.99:0/3722582304 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f439c18b060 0x7f439c17fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:41.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.008+0000 7f43a1c00640 1 --2- 172.21.15.99:0/3722582304 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f439c18b4f0 0x7f439c180290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:41.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.008+0000 7f43a1200640 1 -- 172.21.15.99:0/3722582304 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f439c18b060 msgr2=0x7f439c17fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:41.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.008+0000 7f43a1200640 1 --2- 172.21.15.99:0/3722582304 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f439c18b060 0x7f439c17fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.008+0000 7f43a1200640 1 -- 172.21.15.99:0/3722582304 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f439c18b4f0 msgr2=0x7f439c180290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:41.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.008+0000 7f43a1200640 1 --2- 172.21.15.99:0/3722582304 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f439c18b4f0 0x7f439c180290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.008+0000 7f43a1200640 1 -- 172.21.15.99:0/3722582304 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f439c21d0a0 con 0x7f439c17f490 2024-02-21T23:02:41.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.008+0000 7f43a1c00640 1 --2- 172.21.15.99:0/3722582304 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f439c18b4f0 0x7f439c180290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:02:41.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.009+0000 7f43a1200640 1 --2- 172.21.15.99:0/3722582304 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f439c17f490 0x7f439c21fc40 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4390000c00 tx=0x7f43900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:41.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.009+0000 7f4398c00640 1 -- 172.21.15.99:0/3722582304 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4390034040 con 0x7f439c17f490 2024-02-21T23:02:41.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.009+0000 7f4398c00640 1 -- 172.21.15.99:0/3722582304 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4390039d90 con 0x7f439c17f490 2024-02-21T23:02:41.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.009+0000 7f4398c00640 1 -- 172.21.15.99:0/3722582304 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4390043610 con 0x7f439c17f490 2024-02-21T23:02:41.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.009+0000 7f43a2600640 1 -- 172.21.15.99:0/3722582304 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f439c182c10 con 0x7f439c17f490 2024-02-21T23:02:41.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.009+0000 7f43a2600640 1 -- 172.21.15.99:0/3722582304 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f439c182370 con 0x7f439c17f490 2024-02-21T23:02:41.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.012+0000 7f4398c00640 1 -- 172.21.15.99:0/3722582304 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 12) v1 ==== 134532+0+0 (secure 0 0 0) 0x7f4390037070 con 0x7f439c17f490 2024-02-21T23:02:41.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.014+0000 7f4398c00640 1 --2- 172.21.15.99:0/3722582304 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f437c09ef60 0x7f437c0a1420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:41.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.014+0000 7f4398c00640 1 -- 172.21.15.99:0/3722582304 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f43900ec390 con 0x7f439c17f490 2024-02-21T23:02:41.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.014+0000 7f439be00640 1 --2- 172.21.15.99:0/3722582304 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f437c09ef60 0x7f437c0a1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:41.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.015+0000 7f439be00640 1 --2- 172.21.15.99:0/3722582304 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f437c09ef60 0x7f437c0a1420 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f439c21cf70 tx=0x7f4388008040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:41.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.016+0000 7f43a6bd2740 1 Processor -- start 2024-02-21T23:02:41.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.016+0000 7f43a6bd2740 1 -- start start 2024-02-21T23:02:41.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.017+0000 7f43a6bd2740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5572d0325660 0x5572d0325a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:41.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.017+0000 7f43a6bd2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5572d0360330 0x5572d03607b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:41.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.017+0000 7f43a6bd2740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5572d0360cf0 0x5572d0361560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:41.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.017+0000 7f43a6bd2740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572d024db50 con 0x5572d0360cf0 2024-02-21T23:02:41.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.017+0000 7f43a6bd2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572d01f6da0 con 0x5572d0360330 2024-02-21T23:02:41.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.017+0000 7f43a6bd2740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572d0249bf0 con 0x5572d0325660 2024-02-21T23:02:41.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.017+0000 7f43a1200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5572d0325660 0x5572d0325a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:41.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.017+0000 7f43a1200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5572d0325660 0x5572d0325a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:51274/0 (socket says 172.21.15.99:51274) 2024-02-21T23:02:41.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.017+0000 7f43a1200640 1 -- 172.21.15.99:0/3729389309 learned_addr learned my addr 172.21.15.99:0/3729389309 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:41.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.017+0000 7f43a1c00640 1 --2- 172.21.15.99:0/3729389309 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5572d0360cf0 0x5572d0361560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:41.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.017+0000 7f439be00640 1 --2- 172.21.15.99:0/3729389309 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5572d0360330 0x5572d03607b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:41.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.018+0000 7f43a1200640 1 -- 172.21.15.99:0/3729389309 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5572d0360330 msgr2=0x5572d03607b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:41.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.018+0000 7f43a1200640 1 --2- 172.21.15.99:0/3729389309 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5572d0360330 0x5572d03607b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.018+0000 7f43a1200640 1 -- 172.21.15.99:0/3729389309 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5572d0360cf0 msgr2=0x5572d0361560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:41.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.018+0000 7f43a1200640 1 --2- 172.21.15.99:0/3729389309 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5572d0360cf0 0x5572d0361560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.018+0000 7f43a1200640 1 -- 172.21.15.99:0/3729389309 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5572d0219f80 con 0x5572d0325660 2024-02-21T23:02:41.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.018+0000 7f43a1200640 1 --2- 172.21.15.99:0/3729389309 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5572d0325660 0x5572d0325a40 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f43900b7a30 tx=0x7f43900b9570 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5960b50d529ba0ae server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:41.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.019+0000 7f438d600640 1 -- 172.21.15.99:0/3729389309 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4390030860 con 0x5572d0325660 2024-02-21T23:02:41.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.019+0000 7f438d600640 1 -- 172.21.15.99:0/3729389309 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f439004eeb0 con 0x5572d0325660 2024-02-21T23:02:41.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.019+0000 7f438d600640 1 -- 172.21.15.99:0/3729389309 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43900e9da0 con 0x5572d0325660 2024-02-21T23:02:41.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.019+0000 7f43a6bd2740 1 -- 172.21.15.99:0/3729389309 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5572d0325660 msgr2=0x5572d0325a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:41.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.019+0000 7f43a6bd2740 1 --2- 172.21.15.99:0/3729389309 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5572d0325660 0x5572d0325a40 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f43900b7a30 tx=0x7f43900b9570 comp rx=0 tx=0).stop 2024-02-21T23:02:41.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.019+0000 7f43a6bd2740 1 -- 172.21.15.99:0/3729389309 shutdown_connections 2024-02-21T23:02:41.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.019+0000 7f43a6bd2740 1 --2- 172.21.15.99:0/3729389309 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5572d0360cf0 0x5572d0361560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.019+0000 7f43a6bd2740 1 --2- 172.21.15.99:0/3729389309 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5572d0360330 0x5572d03607b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.019+0000 7f43a6bd2740 1 --2- 172.21.15.99:0/3729389309 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5572d0325660 0x5572d0325a40 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.019+0000 7f43a6bd2740 1 -- 172.21.15.99:0/3729389309 >> 172.21.15.99:0/3729389309 conn(0x5572d02e76d0 msgr2=0x5572d02e8750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:41.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.020+0000 7f43a6bd2740 1 -- 172.21.15.99:0/3729389309 shutdown_connections 2024-02-21T23:02:41.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.020+0000 7f43a6bd2740 1 -- 172.21.15.99:0/3729389309 wait complete. 2024-02-21T23:02:41.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.021+0000 7f43a6bd2740 1 -- start start 2024-02-21T23:02:41.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.021+0000 7f43a6bd2740 1 Processor -- start 2024-02-21T23:02:41.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.023+0000 7f43a6bd2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5572d0360330 0x5572d036a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:41.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.023+0000 7f43a6bd2740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5572d0360cf0 0x5572d032f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:41.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.023+0000 7f43a6bd2740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5572d0361e20 0x5572d031a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:41.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.023+0000 7f43a6bd2740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572d024db50 con 0x5572d0361e20 2024-02-21T23:02:41.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.023+0000 7f43a6bd2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572d01ec380 con 0x5572d0360330 2024-02-21T23:02:41.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.023+0000 7f43a6bd2740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572d0249bf0 con 0x5572d0360cf0 2024-02-21T23:02:41.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.023+0000 7f43a1200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5572d0360330 0x5572d036a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:41.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.023+0000 7f43a1200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5572d0360330 0x5572d036a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:38504/0 (socket says 172.21.15.99:38504) 2024-02-21T23:02:41.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.023+0000 7f43a1200640 1 -- 172.21.15.99:0/856631576 learned_addr learned my addr 172.21.15.99:0/856631576 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:41.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.023+0000 7f43a6bd2740 10 client.0 _ll_register_callbacks cb 0x5572d0245280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:02:41.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.023+0000 7f439be00640 1 --2- 172.21.15.99:0/856631576 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5572d0360cf0 0x5572d032f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:41.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.024+0000 7f43a1c00640 1 --2- 172.21.15.99:0/856631576 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5572d0361e20 0x5572d031a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:41.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.024+0000 7f43a1200640 1 -- 172.21.15.99:0/856631576 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5572d0360cf0 msgr2=0x5572d032f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:41.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.024+0000 7f43a1200640 1 --2- 172.21.15.99:0/856631576 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5572d0360cf0 0x5572d032f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.024+0000 7f43a1200640 1 -- 172.21.15.99:0/856631576 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5572d0361e20 msgr2=0x5572d031a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:41.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.024+0000 7f43a1200640 1 --2- 172.21.15.99:0/856631576 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5572d0361e20 0x5572d031a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.024+0000 7f43a1200640 1 -- 172.21.15.99:0/856631576 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5572d0214c20 con 0x5572d0360330 2024-02-21T23:02:41.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.024+0000 7f43a1c00640 1 --2- 172.21.15.99:0/856631576 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5572d0361e20 0x5572d031a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T23:02:41.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.024+0000 7f43a1200640 1 --2- 172.21.15.99:0/856631576 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5572d0360330 0x5572d036a5d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f43900b96b0 tx=0x7f43900eb000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b87a5d4c711fe808 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:41.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.024+0000 7f4382000640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-02-21T23:02:41.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.024+0000 7f4382000640 1 -- 172.21.15.99:0/856631576 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4390030860 con 0x5572d0360330 2024-02-21T23:02:41.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.024+0000 7f43a6bd2740 1 -- 172.21.15.99:0/856631576 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5572d025b090 con 0x5572d0360330 2024-02-21T23:02:41.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.024+0000 7f4382000640 1 -- 172.21.15.99:0/856631576 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f43900e9d70 con 0x5572d0360330 2024-02-21T23:02:41.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.025+0000 7f4382000640 1 -- 172.21.15.99:0/856631576 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f43900ba0b0 con 0x5572d0360330 2024-02-21T23:02:41.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.025+0000 7f43a6bd2740 10 client.5239 fetch_fsmap learned FSMap version 15 2024-02-21T23:02:41.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.025+0000 7f43a6bd2740 1 -- 172.21.15.99:0/856631576 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x5572cff623f0 con 0x5572d0360330 2024-02-21T23:02:41.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.025+0000 7f4382000640 1 -- 172.21.15.99:0/856631576 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5572d025b090 con 0x5572d0360330 2024-02-21T23:02:41.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.025+0000 7f4382000640 1 -- 172.21.15.99:0/856631576 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 15) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f43900bace0 con 0x5572d0360330 2024-02-21T23:02:41.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.025+0000 7f43a6bd2740 10 client.5239 fetch_fsmap finished waiting for FSMap version 15 2024-02-21T23:02:41.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.025+0000 7f43a6bd2740 10 client.5239 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.d 2024-02-21T23:02:41.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.025+0000 7f43a6bd2740 20 client.5239 populate_metadata read hostname 'smithi099' 2024-02-21T23:02:41.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.025+0000 7f43a6bd2740 1 --2- 172.21.15.99:0/856631576 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x5572d03146a0 0x5572d036d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:41.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.025+0000 7f43a6bd2740 4 client.5239 mds_command: new command op to 4348 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:02:41.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.025+0000 7f43a6bd2740 1 -- 172.21.15.99:0/856631576 --> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5572d02553e0 con 0x5572d03146a0 2024-02-21T23:02:41.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.026+0000 7f439be00640 1 --2- 172.21.15.99:0/856631576 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x5572d03146a0 0x5572d036d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:41.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.026+0000 7f439be00640 1 --2- 172.21.15.99:0/856631576 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x5572d03146a0 0x5572d036d0c0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=cb87db5eda8a67b9 server_cookie=342a13ec9c5c80ab in_seq=0 out_seq=0 2024-02-21T23:02:41.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.026+0000 7f4382000640 10 client.5239 ms_handle_connect on v2:172.21.15.99:6834/2243461688 2024-02-21T23:02:41.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.027+0000 7f4382000640 1 -- 172.21.15.99:0/856631576 <== mds.2 v2:172.21.15.99:6834/2243461688 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x5572d02553e0 con 0x5572d03146a0 2024-02-21T23:02:41.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.027+0000 7f4382000640 10 client.5239 handle_command_reply: tid=0 2024-02-21T23:02:41.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.028+0000 7f43a6bd2740 1 client.5239 shutdown 2024-02-21T23:02:41.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.028+0000 7f43a6bd2740 1 -- 172.21.15.99:0/856631576 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5572d0360330 msgr2=0x5572d036a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:41.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.028+0000 7f43a6bd2740 1 --2- 172.21.15.99:0/856631576 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5572d0360330 0x5572d036a5d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f43900b96b0 tx=0x7f43900eb000 comp rx=0 tx=0).stop 2024-02-21T23:02:41.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.028+0000 7f43a6bd2740 1 -- 172.21.15.99:0/856631576 shutdown_connections 2024-02-21T23:02:41.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.028+0000 7f43a6bd2740 1 --2- 172.21.15.99:0/856631576 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x5572d03146a0 0x5572d036d0c0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.028+0000 7f43a6bd2740 1 --2- 172.21.15.99:0/856631576 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5572d0361e20 0x5572d031a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.028+0000 7f43a6bd2740 1 --2- 172.21.15.99:0/856631576 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5572d0360cf0 0x5572d032f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.028+0000 7f43a6bd2740 1 --2- 172.21.15.99:0/856631576 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5572d0360330 0x5572d036a5d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.028+0000 7f4382000640 0 client.5239 ms_handle_reset on v2:172.21.15.99:6834/2243461688 2024-02-21T23:02:41.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.028+0000 7f43a6bd2740 1 -- 172.21.15.99:0/856631576 >> 172.21.15.99:0/856631576 conn(0x5572d0325660 msgr2=0x5572d0330e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:41.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.028+0000 7f43a6bd2740 1 -- 172.21.15.99:0/856631576 shutdown_connections 2024-02-21T23:02:41.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.028+0000 7f43a6bd2740 1 -- 172.21.15.99:0/856631576 wait complete. 2024-02-21T23:02:41.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.028+0000 7f43a6bd2740 20 client.5239 trim_cache size 0 max 16384 2024-02-21T23:02:41.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.042+0000 7f43a6bd2740 1 Processor -- start 2024-02-21T23:02:41.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.042+0000 7f43a6bd2740 1 -- start start 2024-02-21T23:02:41.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.044+0000 7f43a6bd2740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5572d0360330 0x5572d030e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:41.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.044+0000 7f43a6bd2740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5572d0360cf0 0x5572d0329a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:41.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.044+0000 7f43a6bd2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5572d0361e20 0x5572d0318a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:41.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.044+0000 7f43a6bd2740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f439c22cb10 con 0x5572d0360330 2024-02-21T23:02:41.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.044+0000 7f43a6bd2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f439c22a6b0 con 0x5572d0361e20 2024-02-21T23:02:41.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.044+0000 7f43a6bd2740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f439c2234d0 con 0x5572d0360cf0 2024-02-21T23:02:41.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.044+0000 7f43a1200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5572d0360330 0x5572d030e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:41.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.044+0000 7f43a1200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5572d0360330 0x5572d030e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59190/0 (socket says 172.21.15.99:59190) 2024-02-21T23:02:41.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.044+0000 7f43a1200640 1 -- 172.21.15.99:0/2497630662 learned_addr learned my addr 172.21.15.99:0/2497630662 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:41.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.044+0000 7f439be00640 1 --2- 172.21.15.99:0/2497630662 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5572d0360cf0 0x5572d0329a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:41.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.045+0000 7f43a1c00640 1 --2- 172.21.15.99:0/2497630662 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5572d0361e20 0x5572d0318a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:41.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.045+0000 7f43a1200640 1 -- 172.21.15.99:0/2497630662 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5572d0360cf0 msgr2=0x5572d0329a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:41.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.045+0000 7f43a1200640 1 --2- 172.21.15.99:0/2497630662 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5572d0360cf0 0x5572d0329a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.045+0000 7f43a1200640 1 -- 172.21.15.99:0/2497630662 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5572d0361e20 msgr2=0x5572d0318a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:41.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.045+0000 7f43a1200640 1 --2- 172.21.15.99:0/2497630662 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5572d0361e20 0x5572d0318a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.045+0000 7f43a1200640 1 -- 172.21.15.99:0/2497630662 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5572d002c7d0 con 0x5572d0360330 2024-02-21T23:02:41.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.045+0000 7f43a1200640 1 --2- 172.21.15.99:0/2497630662 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5572d0360330 0x5572d030e0e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4390006da0 tx=0x7f4390045000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=395719592526de7d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:41.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.045+0000 7f438cc00640 1 -- 172.21.15.99:0/2497630662 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43900bdb50 con 0x5572d0360330 2024-02-21T23:02:41.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.045+0000 7f438cc00640 1 -- 172.21.15.99:0/2497630662 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4390030860 con 0x5572d0360330 2024-02-21T23:02:41.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.045+0000 7f438cc00640 1 -- 172.21.15.99:0/2497630662 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43900c1f50 con 0x5572d0360330 2024-02-21T23:02:41.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.046+0000 7f43a6bd2740 1 -- 172.21.15.99:0/2497630662 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5572d0360330 msgr2=0x5572d030e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:41.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.046+0000 7f43a6bd2740 1 --2- 172.21.15.99:0/2497630662 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5572d0360330 0x5572d030e0e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4390006da0 tx=0x7f4390045000 comp rx=0 tx=0).stop 2024-02-21T23:02:41.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.046+0000 7f43a6bd2740 1 -- 172.21.15.99:0/2497630662 shutdown_connections 2024-02-21T23:02:41.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.046+0000 7f43a6bd2740 1 --2- 172.21.15.99:0/2497630662 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5572d0361e20 0x5572d0318a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.046+0000 7f43a6bd2740 1 --2- 172.21.15.99:0/2497630662 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5572d0360cf0 0x5572d0329a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.046+0000 7f43a6bd2740 1 --2- 172.21.15.99:0/2497630662 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5572d0360330 0x5572d030e0e0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.046+0000 7f43a6bd2740 1 -- 172.21.15.99:0/2497630662 >> 172.21.15.99:0/2497630662 conn(0x5572d0325660 msgr2=0x5572d02ee410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:41.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.046+0000 7f43a6bd2740 1 -- 172.21.15.99:0/2497630662 shutdown_connections 2024-02-21T23:02:41.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.046+0000 7f43a6bd2740 1 -- 172.21.15.99:0/2497630662 wait complete. 2024-02-21T23:02:41.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.047+0000 7f43a6bd2740 1 -- start start 2024-02-21T23:02:41.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.047+0000 7f43a6bd2740 1 Processor -- start 2024-02-21T23:02:41.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.049+0000 7f43a6bd2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5572d0360330 0x5572d02e8710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:41.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.049+0000 7f43a6bd2740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5572d0360cf0 0x5572d0333fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:41.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.049+0000 7f43a6bd2740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5572d0361e20 0x5572d02e4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:41.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.049+0000 7f43a6bd2740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f439c0d1ac0 con 0x5572d0360cf0 2024-02-21T23:02:41.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.049+0000 7f43a6bd2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f439c22a050 con 0x5572d0360330 2024-02-21T23:02:41.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.049+0000 7f43a6bd2740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f439c2293b0 con 0x5572d0361e20 2024-02-21T23:02:41.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.049+0000 7f43a6bd2740 10 client.0 _ll_register_callbacks cb 0x7f4394001740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:02:41.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.049+0000 7f439be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5572d0360cf0 0x5572d0333fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:41.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.049+0000 7f439be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5572d0360cf0 0x5572d0333fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59196/0 (socket says 172.21.15.99:59196) 2024-02-21T23:02:41.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.049+0000 7f439be00640 1 -- 172.21.15.99:0/37452700 learned_addr learned my addr 172.21.15.99:0/37452700 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:41.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.049+0000 7f43a1200640 1 --2- 172.21.15.99:0/37452700 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5572d0360330 0x5572d02e8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:41.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.049+0000 7f43a1c00640 1 --2- 172.21.15.99:0/37452700 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5572d0361e20 0x5572d02e4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:41.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.049+0000 7f439be00640 1 -- 172.21.15.99:0/37452700 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5572d0361e20 msgr2=0x5572d02e4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:41.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.049+0000 7f439be00640 1 --2- 172.21.15.99:0/37452700 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5572d0361e20 0x5572d02e4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.049+0000 7f439be00640 1 -- 172.21.15.99:0/37452700 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5572d0360330 msgr2=0x5572d02e8710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:41.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.049+0000 7f439be00640 1 --2- 172.21.15.99:0/37452700 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5572d0360330 0x5572d02e8710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.049+0000 7f439be00640 1 -- 172.21.15.99:0/37452700 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5572d02e5410 con 0x5572d0360cf0 2024-02-21T23:02:41.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.049+0000 7f43a1200640 1 --2- 172.21.15.99:0/37452700 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5572d0360330 0x5572d02e8710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:02:41.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.050+0000 7f439be00640 1 --2- 172.21.15.99:0/37452700 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5572d0360cf0 0x5572d0333fc0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f4388011ba0 tx=0x7f43880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f939355050f7463 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:41.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.050+0000 7f4382000640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:02:41.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.050+0000 7f4382000640 1 -- 172.21.15.99:0/37452700 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f438802be20 con 0x5572d0360cf0 2024-02-21T23:02:41.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.050+0000 7f4382000640 1 -- 172.21.15.99:0/37452700 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f4388015650 con 0x5572d0360cf0 2024-02-21T23:02:41.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.050+0000 7f43a6bd2740 1 -- 172.21.15.99:0/37452700 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4390030860 con 0x5572d0360cf0 2024-02-21T23:02:41.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.050+0000 7f4382000640 1 -- 172.21.15.99:0/37452700 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f438803b050 con 0x5572d0360cf0 2024-02-21T23:02:41.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.050+0000 7f43a6bd2740 10 client.5154 fetch_fsmap learned FSMap version 15 2024-02-21T23:02:41.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.050+0000 7f43a6bd2740 1 -- 172.21.15.99:0/37452700 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x5572d031e9f0 con 0x5572d0360cf0 2024-02-21T23:02:41.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.051+0000 7f4382000640 1 -- 172.21.15.99:0/37452700 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4390030860 con 0x5572d0360cf0 2024-02-21T23:02:41.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.051+0000 7f4382000640 1 -- 172.21.15.99:0/37452700 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 15) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f4388015850 con 0x5572d0360cf0 2024-02-21T23:02:41.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.051+0000 7f43a6bd2740 10 client.5154 fetch_fsmap finished waiting for FSMap version 15 2024-02-21T23:02:41.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.051+0000 7f43a6bd2740 10 client.5154 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.d 2024-02-21T23:02:41.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.051+0000 7f43a6bd2740 20 client.5154 populate_metadata read hostname 'smithi099' 2024-02-21T23:02:41.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.051+0000 7f43a6bd2740 1 --2- 172.21.15.99:0/37452700 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x5572d0319a60 0x5572d035be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:41.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.051+0000 7f43a6bd2740 4 client.5154 mds_command: new command op to 4348 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T23:02:41.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.051+0000 7f43a6bd2740 1 -- 172.21.15.99:0/37452700 --> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5572d01d34d0 con 0x5572d0319a60 2024-02-21T23:02:41.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.051+0000 7f43a1200640 1 --2- 172.21.15.99:0/37452700 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x5572d0319a60 0x5572d035be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:41.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.052+0000 7f43a1200640 1 --2- 172.21.15.99:0/37452700 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x5572d0319a60 0x5572d035be50 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=824fff529ac9568f server_cookie=f33f5fd5be600182 in_seq=0 out_seq=0 2024-02-21T23:02:41.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.052+0000 7f4382000640 10 client.5154 ms_handle_connect on v2:172.21.15.99:6834/2243461688 2024-02-21T23:02:41.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.053+0000 7f4382000640 1 -- 172.21.15.99:0/37452700 <== mds.2 v2:172.21.15.99:6834/2243461688 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5572d01d34d0 con 0x5572d0319a60 2024-02-21T23:02:41.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.053+0000 7f4382000640 10 client.5154 handle_command_reply: tid=0 2024-02-21T23:02:41.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.053+0000 7f43a6bd2740 1 client.5154 shutdown 2024-02-21T23:02:41.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.053+0000 7f43a6bd2740 1 -- 172.21.15.99:0/37452700 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5572d0360cf0 msgr2=0x5572d0333fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:41.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.053+0000 7f43a6bd2740 1 --2- 172.21.15.99:0/37452700 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5572d0360cf0 0x5572d0333fc0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f4388011ba0 tx=0x7f43880046c0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.053+0000 7f43a6bd2740 1 -- 172.21.15.99:0/37452700 shutdown_connections 2024-02-21T23:02:41.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.053+0000 7f43a6bd2740 1 --2- 172.21.15.99:0/37452700 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x5572d0319a60 0x5572d035be50 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.053+0000 7f43a6bd2740 1 --2- 172.21.15.99:0/37452700 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5572d0361e20 0x5572d02e4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.053+0000 7f43a6bd2740 1 --2- 172.21.15.99:0/37452700 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5572d0360cf0 0x5572d0333fc0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.053+0000 7f43a6bd2740 1 --2- 172.21.15.99:0/37452700 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5572d0360330 0x5572d02e8710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.053+0000 7f43a6bd2740 1 -- 172.21.15.99:0/37452700 >> 172.21.15.99:0/37452700 conn(0x5572d0325660 msgr2=0x5572d0329a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:41.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.053+0000 7f4382000640 0 client.5154 ms_handle_reset on v2:172.21.15.99:6834/2243461688 2024-02-21T23:02:41.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.053+0000 7f43a6bd2740 1 -- 172.21.15.99:0/37452700 shutdown_connections 2024-02-21T23:02:41.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.053+0000 7f43a6bd2740 1 -- 172.21.15.99:0/37452700 wait complete. 2024-02-21T23:02:41.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.053+0000 7f43a6bd2740 20 client.5154 trim_cache size 0 max 16384 2024-02-21T23:02:41.047 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-02-21T23:02:41.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.054+0000 7f43a2600640 1 -- 172.21.15.99:0/3722582304 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f437c09ef60 msgr2=0x7f437c0a1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:41.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.054+0000 7f43a2600640 1 --2- 172.21.15.99:0/3722582304 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f437c09ef60 0x7f437c0a1420 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f439c21cf70 tx=0x7f4388008040 comp rx=0 tx=0).stop 2024-02-21T23:02:41.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.054+0000 7f43a2600640 1 -- 172.21.15.99:0/3722582304 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f439c17f490 msgr2=0x7f439c21fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:41.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.054+0000 7f43a2600640 1 --2- 172.21.15.99:0/3722582304 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f439c17f490 0x7f439c21fc40 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4390000c00 tx=0x7f43900046c0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.054+0000 7f43a2600640 1 -- 172.21.15.99:0/3722582304 shutdown_connections 2024-02-21T23:02:41.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.054+0000 7f43a2600640 1 --2- 172.21.15.99:0/3722582304 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f437c09ef60 0x7f437c0a1420 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.054+0000 7f43a2600640 1 --2- 172.21.15.99:0/3722582304 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f439c18b4f0 0x7f439c180290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.054+0000 7f43a2600640 1 --2- 172.21.15.99:0/3722582304 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f439c18b060 0x7f439c17fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.054+0000 7f43a2600640 1 --2- 172.21.15.99:0/3722582304 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f439c17f490 0x7f439c21fc40 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.054+0000 7f43a2600640 1 -- 172.21.15.99:0/3722582304 >> 172.21.15.99:0/3722582304 conn(0x7f439c0d29b0 msgr2=0x7f439c15f3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:41.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.054+0000 7f43a2600640 1 -- 172.21.15.99:0/3722582304 shutdown_connections 2024-02-21T23:02:41.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.055+0000 7f43a2600640 1 -- 172.21.15.99:0/3722582304 wait complete. 2024-02-21T23:02:41.061 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T23:02:41.061 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-02-21T23:02:41.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.302+0000 7f0d25c00640 1 Processor -- start 2024-02-21T23:02:41.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.302+0000 7f0d25c00640 1 -- start start 2024-02-21T23:02:41.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.304+0000 7f0d25c00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f0d20186400 0x7f0d20187ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:41.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.304+0000 7f0d25c00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f0d201867e0 0x7f0d20188010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:41.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.304+0000 7f0d25c00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d200cf820 con 0x7f0d20188550 2024-02-21T23:02:41.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.304+0000 7f0d25c00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d20187640 con 0x7f0d20186400 2024-02-21T23:02:41.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.304+0000 7f0d25c00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d200cfb00 con 0x7f0d201867e0 2024-02-21T23:02:41.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.305+0000 7f0d1ea00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f0d20186400 0x7f0d20187ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:41.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.305+0000 7f0d1ea00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f0d20186400 0x7f0d20187ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59200/0 (socket says 172.21.15.99:59200) 2024-02-21T23:02:41.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.305+0000 7f0d1ea00640 1 -- 172.21.15.99:0/3069619254 learned_addr learned my addr 172.21.15.99:0/3069619254 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:41.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.305+0000 7f0d1e000640 1 --2- 172.21.15.99:0/3069619254 >> v2:172.21.15.181:3300/0 conn(0x7f0d201867e0 0x7f0d20188010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:41.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.305+0000 7f0d1ea00640 1 -- 172.21.15.99:0/3069619254 >> v2:172.21.15.181:3300/0 conn(0x7f0d201867e0 msgr2=0x7f0d20188010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:41.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.305+0000 7f0d1ea00640 1 --2- 172.21.15.99:0/3069619254 >> v2:172.21.15.181:3300/0 conn(0x7f0d201867e0 0x7f0d20188010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.305+0000 7f0d1ea00640 1 -- 172.21.15.99:0/3069619254 >> v1:172.21.15.181:6789/0 conn(0x7f0d20188550 legacy=0x7f0d2018c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:41.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.305+0000 7f0d1d600640 1 -- 172.21.15.99:0/3069619254 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1567429290 0 0) 0x7f0d200cf820 con 0x7f0d20188550 2024-02-21T23:02:41.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.305+0000 7f0d1ea00640 1 -- 172.21.15.99:0/3069619254 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d20186d10 con 0x7f0d20186400 2024-02-21T23:02:41.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.307+0000 7f0d1ea00640 1 --2- 172.21.15.99:0/3069619254 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d20186400 0x7f0d20187ad0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0d20092ea0 tx=0x7f0d1002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4e14f4a14b796b6 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:41.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.307+0000 7f0d1d600640 1 -- 172.21.15.99:0/3069619254 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d10035020 con 0x7f0d20186400 2024-02-21T23:02:41.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.307+0000 7f0d1d600640 1 -- 172.21.15.99:0/3069619254 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d10031870 con 0x7f0d20186400 2024-02-21T23:02:41.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.307+0000 7f0d1d600640 1 -- 172.21.15.99:0/3069619254 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d10031c40 con 0x7f0d20186400 2024-02-21T23:02:41.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.308+0000 7f0d25c00640 1 -- 172.21.15.99:0/3069619254 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d20186400 msgr2=0x7f0d20187ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:41.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.308+0000 7f0d25c00640 1 --2- 172.21.15.99:0/3069619254 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d20186400 0x7f0d20187ad0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0d20092ea0 tx=0x7f0d1002b910 comp rx=0 tx=0).stop 2024-02-21T23:02:41.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.308+0000 7f0d25c00640 1 -- 172.21.15.99:0/3069619254 shutdown_connections 2024-02-21T23:02:41.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.308+0000 7f0d25c00640 1 --2- 172.21.15.99:0/3069619254 >> v2:172.21.15.181:3300/0 conn(0x7f0d201867e0 0x7f0d20188010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.308+0000 7f0d25c00640 1 --2- 172.21.15.99:0/3069619254 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d20186400 0x7f0d20187ad0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.308+0000 7f0d25c00640 1 -- 172.21.15.99:0/3069619254 >> 172.21.15.99:0/3069619254 conn(0x7f0d200d6af0 msgr2=0x7f0d200740b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:41.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.308+0000 7f0d25c00640 1 -- 172.21.15.99:0/3069619254 shutdown_connections 2024-02-21T23:02:41.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.308+0000 7f0d25c00640 1 -- 172.21.15.99:0/3069619254 wait complete. 2024-02-21T23:02:41.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.310+0000 7f0d25c00640 1 Processor -- start 2024-02-21T23:02:41.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.310+0000 7f0d25c00640 1 -- start start 2024-02-21T23:02:41.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.312+0000 7f0d25c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d20186400 0x7f0d20174370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:41.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.312+0000 7f0d25c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d201867e0 0x7f0d20220d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:41.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.312+0000 7f0d25c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0d20188550 0x7f0d20221260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:41.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.312+0000 7f0d25c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d200d5330 con 0x7f0d201867e0 2024-02-21T23:02:41.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.312+0000 7f0d25c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d201872d0 con 0x7f0d20186400 2024-02-21T23:02:41.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.312+0000 7f0d25c00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d200d54b0 con 0x7f0d20188550 2024-02-21T23:02:41.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.312+0000 7f0d1e000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d201867e0 0x7f0d20220d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:41.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.312+0000 7f0d1e000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d201867e0 0x7f0d20220d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59208/0 (socket says 172.21.15.99:59208) 2024-02-21T23:02:41.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.312+0000 7f0d1e000640 1 -- 172.21.15.99:0/4082614682 learned_addr learned my addr 172.21.15.99:0/4082614682 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:41.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.312+0000 7f0d1f400640 1 --2- 172.21.15.99:0/4082614682 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0d20188550 0x7f0d20221260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:41.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.312+0000 7f0d1ea00640 1 --2- 172.21.15.99:0/4082614682 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d20186400 0x7f0d20174370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:41.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.312+0000 7f0d1e000640 1 -- 172.21.15.99:0/4082614682 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0d20188550 msgr2=0x7f0d20221260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:41.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.312+0000 7f0d1e000640 1 --2- 172.21.15.99:0/4082614682 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0d20188550 0x7f0d20221260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.312+0000 7f0d1e000640 1 -- 172.21.15.99:0/4082614682 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d20186400 msgr2=0x7f0d20174370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:41.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.312+0000 7f0d1e000640 1 --2- 172.21.15.99:0/4082614682 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d20186400 0x7f0d20174370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.312+0000 7f0d1e000640 1 -- 172.21.15.99:0/4082614682 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d200fad10 con 0x7f0d201867e0 2024-02-21T23:02:41.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.313+0000 7f0d1e000640 1 --2- 172.21.15.99:0/4082614682 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d201867e0 0x7f0d20220d20 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c00e980 tx=0x7f0d0c00ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:41.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.313+0000 7f0d16a00640 1 -- 172.21.15.99:0/4082614682 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d0c017070 con 0x7f0d201867e0 2024-02-21T23:02:41.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.313+0000 7f0d16a00640 1 -- 172.21.15.99:0/4082614682 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d0c00ca00 con 0x7f0d201867e0 2024-02-21T23:02:41.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.313+0000 7f0d16a00640 1 -- 172.21.15.99:0/4082614682 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d0c00cdd0 con 0x7f0d201867e0 2024-02-21T23:02:41.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.313+0000 7f0d25c00640 1 -- 172.21.15.99:0/4082614682 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d2021f9a0 con 0x7f0d201867e0 2024-02-21T23:02:41.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.313+0000 7f0d25c00640 1 -- 172.21.15.99:0/4082614682 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d2021ff60 con 0x7f0d201867e0 2024-02-21T23:02:41.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.317+0000 7f0d16a00640 1 -- 172.21.15.99:0/4082614682 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 12) v1 ==== 134532+0+0 (secure 0 0 0) 0x7f0d0c01a070 con 0x7f0d201867e0 2024-02-21T23:02:41.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.318+0000 7f0d16a00640 1 --2- 172.21.15.99:0/4082614682 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f0d0009ef60 0x7f0d000a1420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:41.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.318+0000 7f0d16a00640 1 -- 172.21.15.99:0/4082614682 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f0d0c0ca490 con 0x7f0d201867e0 2024-02-21T23:02:41.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.318+0000 7f0d1ea00640 1 --2- 172.21.15.99:0/4082614682 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f0d0009ef60 0x7f0d000a1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:41.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.318+0000 7f0d28bfb740 1 Processor -- start 2024-02-21T23:02:41.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.319+0000 7f0d28bfb740 1 -- start start 2024-02-21T23:02:41.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.319+0000 7f0d1ea00640 1 --2- 172.21.15.99:0/4082614682 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f0d0009ef60 0x7f0d000a1420 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0d10036000 tx=0x7f0d1003c040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:41.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.320+0000 7f0d28bfb740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bce41c14b0 0x55bce41c1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:41.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.320+0000 7f0d28bfb740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bce41fc180 0x55bce41fc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:41.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.320+0000 7f0d28bfb740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bce41fcb40 0x55bce41fd3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:41.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.320+0000 7f0d28bfb740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bce40e9b50 con 0x55bce41fcb40 2024-02-21T23:02:41.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.320+0000 7f0d28bfb740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bce4092da0 con 0x55bce41c14b0 2024-02-21T23:02:41.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.320+0000 7f0d28bfb740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bce40e5bf0 con 0x55bce41fc180 2024-02-21T23:02:41.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.320+0000 7f0d1f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bce41fcb40 0x55bce41fd3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:41.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.321+0000 7f0d1f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bce41fcb40 0x55bce41fd3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59212/0 (socket says 172.21.15.99:59212) 2024-02-21T23:02:41.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.321+0000 7f0d1f400640 1 -- 172.21.15.99:0/1774938217 learned_addr learned my addr 172.21.15.99:0/1774938217 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:41.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.321+0000 7f0d1ea00640 1 --2- 172.21.15.99:0/1774938217 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bce41c14b0 0x55bce41c1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:41.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.321+0000 7f0d1e000640 1 --2- 172.21.15.99:0/1774938217 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bce41fc180 0x55bce41fc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:41.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.321+0000 7f0d1f400640 1 -- 172.21.15.99:0/1774938217 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bce41fc180 msgr2=0x55bce41fc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:41.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.321+0000 7f0d1f400640 1 --2- 172.21.15.99:0/1774938217 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bce41fc180 0x55bce41fc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.321+0000 7f0d1f400640 1 -- 172.21.15.99:0/1774938217 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bce41c14b0 msgr2=0x55bce41c1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:41.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.321+0000 7f0d1f400640 1 --2- 172.21.15.99:0/1774938217 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bce41c14b0 0x55bce41c1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.321+0000 7f0d1f400640 1 -- 172.21.15.99:0/1774938217 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bce40b5f80 con 0x55bce41fcb40 2024-02-21T23:02:41.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.321+0000 7f0d1f400640 1 --2- 172.21.15.99:0/1774938217 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bce41fcb40 0x55bce41fd3b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0d18001e70 tx=0x7f0d1800f5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1104cf8661bda16 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:41.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.322+0000 7f0d0b400640 1 -- 172.21.15.99:0/1774938217 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d18002080 con 0x55bce41fcb40 2024-02-21T23:02:41.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.322+0000 7f0d0b400640 1 -- 172.21.15.99:0/1774938217 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d18018070 con 0x55bce41fcb40 2024-02-21T23:02:41.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.322+0000 7f0d0b400640 1 -- 172.21.15.99:0/1774938217 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d18003b90 con 0x55bce41fcb40 2024-02-21T23:02:41.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.322+0000 7f0d28bfb740 1 -- 172.21.15.99:0/1774938217 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bce41fcb40 msgr2=0x55bce41fd3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:41.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.322+0000 7f0d28bfb740 1 --2- 172.21.15.99:0/1774938217 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bce41fcb40 0x55bce41fd3b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0d18001e70 tx=0x7f0d1800f5a0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.323+0000 7f0d28bfb740 1 -- 172.21.15.99:0/1774938217 shutdown_connections 2024-02-21T23:02:41.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.323+0000 7f0d28bfb740 1 --2- 172.21.15.99:0/1774938217 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bce41fcb40 0x55bce41fd3b0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.323+0000 7f0d28bfb740 1 --2- 172.21.15.99:0/1774938217 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bce41fc180 0x55bce41fc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.323+0000 7f0d28bfb740 1 --2- 172.21.15.99:0/1774938217 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bce41c14b0 0x55bce41c1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.323+0000 7f0d28bfb740 1 -- 172.21.15.99:0/1774938217 >> 172.21.15.99:0/1774938217 conn(0x55bce4183520 msgr2=0x55bce41845a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:41.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.323+0000 7f0d28bfb740 1 -- 172.21.15.99:0/1774938217 shutdown_connections 2024-02-21T23:02:41.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.323+0000 7f0d28bfb740 1 -- 172.21.15.99:0/1774938217 wait complete. 2024-02-21T23:02:41.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.324+0000 7f0d28bfb740 1 -- start start 2024-02-21T23:02:41.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.324+0000 7f0d28bfb740 1 Processor -- start 2024-02-21T23:02:41.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.326+0000 7f0d28bfb740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bce41fc180 0x55bce41c9310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:41.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.327+0000 7f0d28bfb740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bce41fcb40 0x55bce42034a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:41.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.327+0000 7f0d28bfb740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bce4204e80 0x55bce41b6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:41.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.327+0000 7f0d28bfb740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bce41faef0 con 0x55bce41fcb40 2024-02-21T23:02:41.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.327+0000 7f0d28bfb740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bce4088380 con 0x55bce41fc180 2024-02-21T23:02:41.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.327+0000 7f0d28bfb740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bce41fac10 con 0x55bce4204e80 2024-02-21T23:02:41.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.327+0000 7f0d28bfb740 10 client.0 _ll_register_callbacks cb 0x55bce40e1280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:02:41.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.327+0000 7f0d1e000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bce41fcb40 0x55bce42034a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:41.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.327+0000 7f0d1ea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bce41fc180 0x55bce41c9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:41.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.327+0000 7f0d1e000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bce41fcb40 0x55bce42034a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59216/0 (socket says 172.21.15.99:59216) 2024-02-21T23:02:41.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.327+0000 7f0d1e000640 1 -- 172.21.15.99:0/2688151112 learned_addr learned my addr 172.21.15.99:0/2688151112 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:41.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.327+0000 7f0d1f400640 1 --2- 172.21.15.99:0/2688151112 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bce4204e80 0x55bce41b6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:41.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.327+0000 7f0d1e000640 1 -- 172.21.15.99:0/2688151112 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bce4204e80 msgr2=0x55bce41b6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:41.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.327+0000 7f0d1e000640 1 --2- 172.21.15.99:0/2688151112 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bce4204e80 0x55bce41b6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.327+0000 7f0d1e000640 1 -- 172.21.15.99:0/2688151112 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bce41fc180 msgr2=0x55bce41c9310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:41.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.327+0000 7f0d1e000640 1 --2- 172.21.15.99:0/2688151112 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bce41fc180 0x55bce41c9310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.327+0000 7f0d1e000640 1 -- 172.21.15.99:0/2688151112 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bce40b0c20 con 0x55bce41fcb40 2024-02-21T23:02:41.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.327+0000 7f0d1f400640 1 --2- 172.21.15.99:0/2688151112 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bce4204e80 0x55bce41b6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:02:41.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.328+0000 7f0d1e000640 1 --2- 172.21.15.99:0/2688151112 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bce41fcb40 0x55bce42034a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c0978c0 tx=0x7f0d0c095d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=496bb9bd5930b98a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:41.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.328+0000 7f0cffe00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:02:41.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.328+0000 7f0cffe00640 1 -- 172.21.15.99:0/2688151112 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d0c0af020 con 0x55bce41fcb40 2024-02-21T23:02:41.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.328+0000 7f0cffe00640 1 -- 172.21.15.99:0/2688151112 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f0d0c097220 con 0x55bce41fcb40 2024-02-21T23:02:41.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.328+0000 7f0d28bfb740 1 -- 172.21.15.99:0/2688151112 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0d18018070 con 0x55bce41fcb40 2024-02-21T23:02:41.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.328+0000 7f0cffe00640 1 -- 172.21.15.99:0/2688151112 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0d0c021040 con 0x55bce41fcb40 2024-02-21T23:02:41.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.328+0000 7f0d28bfb740 10 client.5166 fetch_fsmap learned FSMap version 15 2024-02-21T23:02:41.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.328+0000 7f0d28bfb740 1 -- 172.21.15.99:0/2688151112 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x55bce3dfe3f0 con 0x55bce41fcb40 2024-02-21T23:02:41.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.329+0000 7f0cffe00640 1 -- 172.21.15.99:0/2688151112 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d18018070 con 0x55bce41fcb40 2024-02-21T23:02:41.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.329+0000 7f0cffe00640 1 -- 172.21.15.99:0/2688151112 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 15) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f0d0c093880 con 0x55bce41fcb40 2024-02-21T23:02:41.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.329+0000 7f0d28bfb740 10 client.5166 fetch_fsmap finished waiting for FSMap version 15 2024-02-21T23:02:41.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.329+0000 7f0d28bfb740 10 client.5166 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2024-02-21T23:02:41.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.329+0000 7f0d28bfb740 20 client.5166 populate_metadata read hostname 'smithi099' 2024-02-21T23:02:41.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.329+0000 7f0d28bfb740 1 --2- 172.21.15.99:0/2688151112 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x55bce41ca630 0x55bce4208b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:41.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.329+0000 7f0d28bfb740 4 client.5166 mds_command: new command op to 4352 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:02:41.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.329+0000 7f0d28bfb740 1 -- 172.21.15.99:0/2688151112 --> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bce40f7090 con 0x55bce41ca630 2024-02-21T23:02:41.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.329+0000 7f0d1ea00640 1 --2- 172.21.15.99:0/2688151112 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x55bce41ca630 0x55bce4208b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:41.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.330+0000 7f0d1ea00640 1 --2- 172.21.15.99:0/2688151112 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x55bce41ca630 0x55bce4208b20 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=531cc6363fc08b1b server_cookie=11af44174c820916 in_seq=0 out_seq=0 2024-02-21T23:02:41.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.330+0000 7f0cffe00640 10 client.5166 ms_handle_connect on v2:172.21.15.99:6836/1676159950 2024-02-21T23:02:41.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.331+0000 7f0cffe00640 1 -- 172.21.15.99:0/2688151112 <== mds.1 v2:172.21.15.99:6836/1676159950 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55bce40f7090 con 0x55bce41ca630 2024-02-21T23:02:41.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.331+0000 7f0cffe00640 10 client.5166 handle_command_reply: tid=0 2024-02-21T23:02:41.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.331+0000 7f0d28bfb740 1 client.5166 shutdown 2024-02-21T23:02:41.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.331+0000 7f0d28bfb740 1 -- 172.21.15.99:0/2688151112 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bce41fcb40 msgr2=0x55bce42034a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:41.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.331+0000 7f0d28bfb740 1 --2- 172.21.15.99:0/2688151112 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bce41fcb40 0x55bce42034a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c0978c0 tx=0x7f0d0c095d00 comp rx=0 tx=0).stop 2024-02-21T23:02:41.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.332+0000 7f0d28bfb740 1 -- 172.21.15.99:0/2688151112 shutdown_connections 2024-02-21T23:02:41.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.332+0000 7f0d28bfb740 1 --2- 172.21.15.99:0/2688151112 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x55bce41ca630 0x55bce4208b20 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.332+0000 7f0d28bfb740 1 --2- 172.21.15.99:0/2688151112 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bce4204e80 0x55bce41b6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.332+0000 7f0d28bfb740 1 --2- 172.21.15.99:0/2688151112 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bce41fcb40 0x55bce42034a0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.332+0000 7f0d28bfb740 1 --2- 172.21.15.99:0/2688151112 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bce41fc180 0x55bce41c9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.332+0000 7f0cffe00640 0 client.5166 ms_handle_reset on v2:172.21.15.99:6836/1676159950 2024-02-21T23:02:41.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.332+0000 7f0d28bfb740 1 -- 172.21.15.99:0/2688151112 >> 172.21.15.99:0/2688151112 conn(0x55bce41c14b0 msgr2=0x55bce41ccc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:41.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.332+0000 7f0d28bfb740 1 -- 172.21.15.99:0/2688151112 shutdown_connections 2024-02-21T23:02:41.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.332+0000 7f0d28bfb740 1 -- 172.21.15.99:0/2688151112 wait complete. 2024-02-21T23:02:41.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.332+0000 7f0d28bfb740 20 client.5166 trim_cache size 0 max 16384 2024-02-21T23:02:41.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.354+0000 7f0d28bfb740 1 Processor -- start 2024-02-21T23:02:41.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.355+0000 7f0d28bfb740 1 -- start start 2024-02-21T23:02:41.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.356+0000 7f0d28bfb740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bce41fc180 0x55bce41c9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:41.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.356+0000 7f0d28bfb740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bce41fcb40 0x55bce41eb2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:41.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.356+0000 7f0d28bfb740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bce4204e80 0x55bce4258ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:41.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.356+0000 7f0d28bfb740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2022c8f0 con 0x55bce41fc180 2024-02-21T23:02:41.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.356+0000 7f0d28bfb740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2022a490 con 0x55bce4204e80 2024-02-21T23:02:41.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.356+0000 7f0d28bfb740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d20228690 con 0x55bce41fcb40 2024-02-21T23:02:41.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.357+0000 7f0d1ea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bce41fc180 0x55bce41c9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:41.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.357+0000 7f0d1ea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bce41fc180 0x55bce41c9aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59224/0 (socket says 172.21.15.99:59224) 2024-02-21T23:02:41.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.357+0000 7f0d1ea00640 1 -- 172.21.15.99:0/148768150 learned_addr learned my addr 172.21.15.99:0/148768150 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:41.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.357+0000 7f0d1e000640 1 --2- 172.21.15.99:0/148768150 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bce41fcb40 0x55bce41eb2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:41.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.357+0000 7f0d1f400640 1 --2- 172.21.15.99:0/148768150 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bce4204e80 0x55bce4258ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:41.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.357+0000 7f0d1ea00640 1 -- 172.21.15.99:0/148768150 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bce41fcb40 msgr2=0x55bce41eb2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:41.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.357+0000 7f0d1ea00640 1 --2- 172.21.15.99:0/148768150 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bce41fcb40 0x55bce41eb2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.357+0000 7f0d1ea00640 1 -- 172.21.15.99:0/148768150 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bce4204e80 msgr2=0x55bce4258ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:41.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.357+0000 7f0d1ea00640 1 --2- 172.21.15.99:0/148768150 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bce4204e80 0x55bce4258ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.357+0000 7f0d1ea00640 1 -- 172.21.15.99:0/148768150 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bce3ec87d0 con 0x55bce41fc180 2024-02-21T23:02:41.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.358+0000 7f0d1ea00640 1 --2- 172.21.15.99:0/148768150 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bce41fc180 0x55bce41c9aa0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0d10009280 tx=0x7f0d10030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94ccb7e3c5493815 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:41.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.358+0000 7f0d0aa00640 1 -- 172.21.15.99:0/148768150 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d10057070 con 0x55bce41fc180 2024-02-21T23:02:41.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.358+0000 7f0d0aa00640 1 -- 172.21.15.99:0/148768150 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d10053760 con 0x55bce41fc180 2024-02-21T23:02:41.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.358+0000 7f0d0aa00640 1 -- 172.21.15.99:0/148768150 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d10035040 con 0x55bce41fc180 2024-02-21T23:02:41.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.359+0000 7f0d28bfb740 1 -- 172.21.15.99:0/148768150 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bce41fc180 msgr2=0x55bce41c9aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:41.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.359+0000 7f0d28bfb740 1 --2- 172.21.15.99:0/148768150 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bce41fc180 0x55bce41c9aa0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0d10009280 tx=0x7f0d10030000 comp rx=0 tx=0).stop 2024-02-21T23:02:41.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.359+0000 7f0d28bfb740 1 -- 172.21.15.99:0/148768150 shutdown_connections 2024-02-21T23:02:41.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.359+0000 7f0d28bfb740 1 --2- 172.21.15.99:0/148768150 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bce4204e80 0x55bce4258ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.359+0000 7f0d28bfb740 1 --2- 172.21.15.99:0/148768150 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bce41fcb40 0x55bce41eb2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.359+0000 7f0d28bfb740 1 --2- 172.21.15.99:0/148768150 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bce41fc180 0x55bce41c9aa0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.359+0000 7f0d28bfb740 1 -- 172.21.15.99:0/148768150 >> 172.21.15.99:0/148768150 conn(0x55bce41c14b0 msgr2=0x55bce41b6dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:41.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.359+0000 7f0d28bfb740 1 -- 172.21.15.99:0/148768150 shutdown_connections 2024-02-21T23:02:41.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.359+0000 7f0d28bfb740 1 -- 172.21.15.99:0/148768150 wait complete. 2024-02-21T23:02:41.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.360+0000 7f0d28bfb740 1 -- start start 2024-02-21T23:02:41.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.360+0000 7f0d28bfb740 1 Processor -- start 2024-02-21T23:02:41.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.361+0000 7f0d28bfb740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bce41fc180 0x55bce41cf5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:41.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.361+0000 7f0d28bfb740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bce41fcb40 0x55bce4249290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:41.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.361+0000 7f0d28bfb740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bce4204e80 0x55bce41b31d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:41.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.361+0000 7f0d28bfb740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d20228bf0 con 0x55bce4204e80 2024-02-21T23:02:41.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.361+0000 7f0d28bfb740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d20229e30 con 0x55bce41fcb40 2024-02-21T23:02:41.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.361+0000 7f0d28bfb740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d202291f0 con 0x55bce41fc180 2024-02-21T23:02:41.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.361+0000 7f0d28bfb740 10 client.0 _ll_register_callbacks cb 0x7f0d0c00ef70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:02:41.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.362+0000 7f0d1f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bce4204e80 0x55bce41b31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:41.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.362+0000 7f0d1f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bce4204e80 0x55bce41b31d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59238/0 (socket says 172.21.15.99:59238) 2024-02-21T23:02:41.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.362+0000 7f0d1f400640 1 -- 172.21.15.99:0/2866105816 learned_addr learned my addr 172.21.15.99:0/2866105816 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:41.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.362+0000 7f0d1ea00640 1 --2- 172.21.15.99:0/2866105816 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bce41fc180 0x55bce41cf5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:41.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.362+0000 7f0d1e000640 1 --2- 172.21.15.99:0/2866105816 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bce41fcb40 0x55bce4249290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:41.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.362+0000 7f0d1ea00640 1 -- 172.21.15.99:0/2866105816 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bce41fcb40 msgr2=0x55bce4249290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:41.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.362+0000 7f0d1ea00640 1 --2- 172.21.15.99:0/2866105816 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bce41fcb40 0x55bce4249290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.362+0000 7f0d1ea00640 1 -- 172.21.15.99:0/2866105816 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bce4204e80 msgr2=0x55bce41b31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:41.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.362+0000 7f0d1ea00640 1 --2- 172.21.15.99:0/2866105816 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bce4204e80 0x55bce41b31d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.362+0000 7f0d1ea00640 1 -- 172.21.15.99:0/2866105816 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bce41b3db0 con 0x55bce41fc180 2024-02-21T23:02:41.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.362+0000 7f0d1e000640 1 --2- 172.21.15.99:0/2866105816 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bce41fcb40 0x55bce4249290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:02:41.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.362+0000 7f0d1f400640 1 --2- 172.21.15.99:0/2866105816 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bce4204e80 0x55bce41b31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:02:41.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.363+0000 7f0d1ea00640 1 --2- 172.21.15.99:0/2866105816 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bce41fc180 0x55bce41cf5d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0d10031b80 tx=0x7f0d10004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81aee89b7d992004 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:41.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.363+0000 7f0cffe00640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-02-21T23:02:41.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.363+0000 7f0cffe00640 1 -- 172.21.15.99:0/2866105816 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d10060060 con 0x55bce41fc180 2024-02-21T23:02:41.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.363+0000 7f0d28bfb740 1 -- 172.21.15.99:0/2866105816 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0d10053760 con 0x55bce41fc180 2024-02-21T23:02:41.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.363+0000 7f0cffe00640 1 -- 172.21.15.99:0/2866105816 <== mon.2 v2:172.21.15.181:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f0d10053d20 con 0x55bce41fc180 2024-02-21T23:02:41.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.364+0000 7f0cffe00640 1 -- 172.21.15.99:0/2866105816 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0d10067050 con 0x55bce41fc180 2024-02-21T23:02:41.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.364+0000 7f0d28bfb740 10 client.5264 fetch_fsmap learned FSMap version 15 2024-02-21T23:02:41.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.364+0000 7f0d28bfb740 1 -- 172.21.15.99:0/2866105816 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x55bce42558e0 con 0x55bce41fc180 2024-02-21T23:02:41.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.364+0000 7f0cffe00640 1 -- 172.21.15.99:0/2866105816 <== mon.2 v2:172.21.15.181:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d10053760 con 0x55bce41fc180 2024-02-21T23:02:41.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.364+0000 7f0cffe00640 1 -- 172.21.15.99:0/2866105816 <== mon.2 v2:172.21.15.181:3300/0 5 ==== fsmap(e 15) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f0d1004f050 con 0x55bce41fc180 2024-02-21T23:02:41.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.364+0000 7f0d28bfb740 10 client.5264 fetch_fsmap finished waiting for FSMap version 15 2024-02-21T23:02:41.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.364+0000 7f0d28bfb740 10 client.5264 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2024-02-21T23:02:41.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.364+0000 7f0d28bfb740 20 client.5264 populate_metadata read hostname 'smithi099' 2024-02-21T23:02:41.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.364+0000 7f0d28bfb740 1 --2- 172.21.15.99:0/2866105816 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x55bce41c0e80 0x55bce41b3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:41.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.364+0000 7f0d28bfb740 4 client.5264 mds_command: new command op to 4352 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T23:02:41.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.364+0000 7f0d28bfb740 1 -- 172.21.15.99:0/2866105816 --> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55bce40f13e0 con 0x55bce41c0e80 2024-02-21T23:02:41.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.365+0000 7f0d1e000640 1 --2- 172.21.15.99:0/2866105816 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x55bce41c0e80 0x55bce41b3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:41.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.365+0000 7f0d1e000640 1 --2- 172.21.15.99:0/2866105816 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x55bce41c0e80 0x55bce41b3710 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6fd1e48b3aa0ec1f server_cookie=39d5abdd8eb6c526 in_seq=0 out_seq=0 2024-02-21T23:02:41.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.365+0000 7f0cffe00640 10 client.5264 ms_handle_connect on v2:172.21.15.99:6836/1676159950 2024-02-21T23:02:41.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.366+0000 7f0cffe00640 1 -- 172.21.15.99:0/2866105816 <== mds.1 v2:172.21.15.99:6836/1676159950 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55bce40f13e0 con 0x55bce41c0e80 2024-02-21T23:02:41.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.366+0000 7f0cffe00640 10 client.5264 handle_command_reply: tid=0 2024-02-21T23:02:41.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.366+0000 7f0d28bfb740 1 client.5264 shutdown 2024-02-21T23:02:41.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.366+0000 7f0d28bfb740 1 -- 172.21.15.99:0/2866105816 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bce41fc180 msgr2=0x55bce41cf5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:41.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.366+0000 7f0d28bfb740 1 --2- 172.21.15.99:0/2866105816 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bce41fc180 0x55bce41cf5d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0d10031b80 tx=0x7f0d10004730 comp rx=0 tx=0).stop 2024-02-21T23:02:41.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.366+0000 7f0d28bfb740 1 -- 172.21.15.99:0/2866105816 shutdown_connections 2024-02-21T23:02:41.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.366+0000 7f0d28bfb740 1 --2- 172.21.15.99:0/2866105816 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x55bce41c0e80 0x55bce41b3710 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.366+0000 7f0d28bfb740 1 --2- 172.21.15.99:0/2866105816 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bce4204e80 0x55bce41b31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.366+0000 7f0d28bfb740 1 --2- 172.21.15.99:0/2866105816 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bce41fcb40 0x55bce4249290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.366+0000 7f0d28bfb740 1 --2- 172.21.15.99:0/2866105816 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bce41fc180 0x55bce41cf5d0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.366+0000 7f0cffe00640 0 client.5264 ms_handle_reset on v2:172.21.15.99:6836/1676159950 2024-02-21T23:02:41.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.366+0000 7f0d28bfb740 1 -- 172.21.15.99:0/2866105816 >> 172.21.15.99:0/2866105816 conn(0x55bce41c14b0 msgr2=0x55bce41caa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:41.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.366+0000 7f0d28bfb740 1 -- 172.21.15.99:0/2866105816 shutdown_connections 2024-02-21T23:02:41.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.366+0000 7f0d28bfb740 1 -- 172.21.15.99:0/2866105816 wait complete. 2024-02-21T23:02:41.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.366+0000 7f0d28bfb740 20 client.5264 trim_cache size 0 max 16384 2024-02-21T23:02:41.358 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-02-21T23:02:41.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.367+0000 7f0d25c00640 1 -- 172.21.15.99:0/4082614682 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f0d0009ef60 msgr2=0x7f0d000a1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:41.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.367+0000 7f0d25c00640 1 --2- 172.21.15.99:0/4082614682 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f0d0009ef60 0x7f0d000a1420 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0d10036000 tx=0x7f0d1003c040 comp rx=0 tx=0).stop 2024-02-21T23:02:41.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.367+0000 7f0d25c00640 1 -- 172.21.15.99:0/4082614682 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d201867e0 msgr2=0x7f0d20220d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:41.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.367+0000 7f0d25c00640 1 --2- 172.21.15.99:0/4082614682 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d201867e0 0x7f0d20220d20 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c00e980 tx=0x7f0d0c00ee40 comp rx=0 tx=0).stop 2024-02-21T23:02:41.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.367+0000 7f0d25c00640 1 -- 172.21.15.99:0/4082614682 shutdown_connections 2024-02-21T23:02:41.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.367+0000 7f0d25c00640 1 --2- 172.21.15.99:0/4082614682 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f0d0009ef60 0x7f0d000a1420 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.367+0000 7f0d25c00640 1 --2- 172.21.15.99:0/4082614682 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0d20188550 0x7f0d20221260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.367+0000 7f0d25c00640 1 --2- 172.21.15.99:0/4082614682 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d201867e0 0x7f0d20220d20 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.367+0000 7f0d25c00640 1 --2- 172.21.15.99:0/4082614682 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d20186400 0x7f0d20174370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.367+0000 7f0d25c00640 1 -- 172.21.15.99:0/4082614682 >> 172.21.15.99:0/4082614682 conn(0x7f0d200d6af0 msgr2=0x7f0d200740b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:41.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.367+0000 7f0d25c00640 1 -- 172.21.15.99:0/4082614682 shutdown_connections 2024-02-21T23:02:41.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.367+0000 7f0d25c00640 1 -- 172.21.15.99:0/4082614682 wait complete. 2024-02-21T23:02:41.375 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T23:02:41.375 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-02-21T23:02:41.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.622+0000 7f1a13e00640 1 Processor -- start 2024-02-21T23:02:41.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.623+0000 7f1a13e00640 1 -- start start 2024-02-21T23:02:41.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.624+0000 7f1a13e00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f1a140d60b0 0x7f1a140fc990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:41.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.624+0000 7f1a13e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a140d6dd0 con 0x7f1a1417f490 2024-02-21T23:02:41.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.624+0000 7f1a13e00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a141614c0 con 0x7f1a1418b230 2024-02-21T23:02:41.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.624+0000 7f1a13e00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a140d6810 con 0x7f1a140d60b0 2024-02-21T23:02:41.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.625+0000 7f1a12a00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f1a1417f490 0x7f1a1418ab20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.99:42274/0 (socket says 172.21.15.99:42274) 2024-02-21T23:02:41.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.625+0000 7f1a12a00640 1 -- 172.21.15.99:0/3952720074 learned_addr learned my addr 172.21.15.99:0/3952720074 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:02:41.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.625+0000 7f1a13400640 1 --2- 172.21.15.99:0/3952720074 >> v2:172.21.15.181:3300/0 conn(0x7f1a140d60b0 0x7f1a140fc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:41.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.625+0000 7f1a12000640 1 -- 172.21.15.99:0/3952720074 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1060254022 0 0) 0x7f1a141614c0 con 0x7f1a1418b230 2024-02-21T23:02:41.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.625+0000 7f1a13400640 1 -- 172.21.15.99:0/3952720074 >> v1:172.21.15.181:6789/0 conn(0x7f1a1418b230 legacy=0x7f1a140fc280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:41.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.625+0000 7f1a13400640 1 -- 172.21.15.99:0/3952720074 >> v1:172.21.15.162:6789/0 conn(0x7f1a1417f490 legacy=0x7f1a1418ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:41.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.625+0000 7f1a13400640 1 -- 172.21.15.99:0/3952720074 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a140d6af0 con 0x7f1a140d60b0 2024-02-21T23:02:41.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.627+0000 7f1a13400640 1 --2- 172.21.15.99:0/3952720074 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1a140d60b0 0x7f1a140fc990 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c009d90 tx=0x7f1a0c02bd80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dad4550068e34499 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:41.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.627+0000 7f1a12000640 1 -- 172.21.15.99:0/3952720074 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a0c039070 con 0x7f1a140d60b0 2024-02-21T23:02:41.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.627+0000 7f1a12000640 1 -- 172.21.15.99:0/3952720074 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a0c02cab0 con 0x7f1a140d60b0 2024-02-21T23:02:41.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.627+0000 7f1a12000640 1 -- 172.21.15.99:0/3952720074 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a0c034440 con 0x7f1a140d60b0 2024-02-21T23:02:41.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.628+0000 7f1a13e00640 1 -- 172.21.15.99:0/3952720074 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1a140d60b0 msgr2=0x7f1a140fc990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:41.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.628+0000 7f1a13e00640 1 --2- 172.21.15.99:0/3952720074 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1a140d60b0 0x7f1a140fc990 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c009d90 tx=0x7f1a0c02bd80 comp rx=0 tx=0).stop 2024-02-21T23:02:41.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.628+0000 7f1a13e00640 1 -- 172.21.15.99:0/3952720074 shutdown_connections 2024-02-21T23:02:41.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.628+0000 7f1a13e00640 1 --2- 172.21.15.99:0/3952720074 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1a140d60b0 0x7f1a140fc990 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.628+0000 7f1a13e00640 1 -- 172.21.15.99:0/3952720074 >> 172.21.15.99:0/3952720074 conn(0x7f1a140d29b0 msgr2=0x7f1a140d2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:41.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.628+0000 7f1a13e00640 1 -- 172.21.15.99:0/3952720074 shutdown_connections 2024-02-21T23:02:41.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.628+0000 7f1a13e00640 1 -- 172.21.15.99:0/3952720074 wait complete. 2024-02-21T23:02:41.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.632+0000 7f1a13e00640 1 Processor -- start 2024-02-21T23:02:41.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.632+0000 7f1a13e00640 1 -- start start 2024-02-21T23:02:41.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.634+0000 7f1a13e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a140d60b0 0x7f1a14171fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:41.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.634+0000 7f1a13e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1a1417f490 0x7f1a1421d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:41.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.634+0000 7f1a13e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1a1418b230 0x7f1a1421dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:41.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.634+0000 7f1a13e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1418a600 con 0x7f1a140d60b0 2024-02-21T23:02:41.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.634+0000 7f1a13e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1418a320 con 0x7f1a1417f490 2024-02-21T23:02:41.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.634+0000 7f1a13e00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a140d6500 con 0x7f1a1418b230 2024-02-21T23:02:41.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.634+0000 7f1a12a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a140d60b0 0x7f1a14171fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:41.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.634+0000 7f1a0be00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1a1417f490 0x7f1a1421d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:41.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.634+0000 7f1a12a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a140d60b0 0x7f1a14171fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59248/0 (socket says 172.21.15.99:59248) 2024-02-21T23:02:41.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.634+0000 7f1a12a00640 1 -- 172.21.15.99:0/1052918488 learned_addr learned my addr 172.21.15.99:0/1052918488 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:41.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.634+0000 7f1a13400640 1 --2- 172.21.15.99:0/1052918488 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1a1418b230 0x7f1a1421dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:41.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.635+0000 7f1a0be00640 1 -- 172.21.15.99:0/1052918488 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1a1418b230 msgr2=0x7f1a1421dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:41.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.635+0000 7f1a0be00640 1 --2- 172.21.15.99:0/1052918488 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1a1418b230 0x7f1a1421dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.635+0000 7f1a0be00640 1 -- 172.21.15.99:0/1052918488 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a140d60b0 msgr2=0x7f1a14171fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:41.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.635+0000 7f1a0be00640 1 --2- 172.21.15.99:0/1052918488 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a140d60b0 0x7f1a14171fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.635+0000 7f1a0be00640 1 -- 172.21.15.99:0/1052918488 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a14221950 con 0x7f1a1417f490 2024-02-21T23:02:41.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.635+0000 7f1a13400640 1 --2- 172.21.15.99:0/1052918488 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1a1418b230 0x7f1a1421dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:02:41.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.635+0000 7f1a0be00640 1 --2- 172.21.15.99:0/1052918488 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1a1417f490 0x7f1a1421d790 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f19fc00c440 tx=0x7f19fc00c900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:41.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.635+0000 7f1a0aa00640 1 -- 172.21.15.99:0/1052918488 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19fc017070 con 0x7f1a1417f490 2024-02-21T23:02:41.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.635+0000 7f1a0aa00640 1 -- 172.21.15.99:0/1052918488 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19fc0035f0 con 0x7f1a1417f490 2024-02-21T23:02:41.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.635+0000 7f1a13e00640 1 -- 172.21.15.99:0/1052918488 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a14221c30 con 0x7f1a1417f490 2024-02-21T23:02:41.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.635+0000 7f1a0aa00640 1 -- 172.21.15.99:0/1052918488 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19fc0039e0 con 0x7f1a1417f490 2024-02-21T23:02:41.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.636+0000 7f1a13e00640 1 -- 172.21.15.99:0/1052918488 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a1421ccb0 con 0x7f1a1417f490 2024-02-21T23:02:41.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.640+0000 7f1a0aa00640 1 -- 172.21.15.99:0/1052918488 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 12) v1 ==== 134532+0+0 (secure 0 0 0) 0x7f19fc01a070 con 0x7f1a1417f490 2024-02-21T23:02:41.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.641+0000 7f1a1c651740 1 Processor -- start 2024-02-21T23:02:41.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.641+0000 7f1a1c651740 1 -- start start 2024-02-21T23:02:41.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.641+0000 7f1a0aa00640 1 --2- 172.21.15.99:0/1052918488 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f19f009ef60 0x7f19f00a1420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:41.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.642+0000 7f1a0aa00640 1 -- 172.21.15.99:0/1052918488 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f19fc0c92a0 con 0x7f1a1417f490 2024-02-21T23:02:41.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.642+0000 7f1a13400640 1 --2- 172.21.15.99:0/1052918488 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f19f009ef60 0x7f19f00a1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:41.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.643+0000 7f1a13400640 1 --2- 172.21.15.99:0/1052918488 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f19f009ef60 0x7f19f00a1420 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c036000 tx=0x7f1a0c030000 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:41.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.643+0000 7f1a1c651740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56104906f660 0x56104906fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:41.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.643+0000 7f1a1c651740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5610490aa330 0x5610490aa7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:41.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.643+0000 7f1a1c651740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5610490aacf0 0x5610490ab560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:41.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.643+0000 7f1a1c651740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x561048f97b50 con 0x56104906f660 2024-02-21T23:02:41.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.643+0000 7f1a1c651740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x561048f40da0 con 0x5610490aacf0 2024-02-21T23:02:41.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.643+0000 7f1a1c651740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x561048f93bf0 con 0x5610490aa330 2024-02-21T23:02:41.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.643+0000 7f1a12a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56104906f660 0x56104906fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:41.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.643+0000 7f1a0be00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5610490aa330 0x5610490aa7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:41.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.643+0000 7f1a12a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56104906f660 0x56104906fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59258/0 (socket says 172.21.15.99:59258) 2024-02-21T23:02:41.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.643+0000 7f1a12a00640 1 -- 172.21.15.99:0/865860460 learned_addr learned my addr 172.21.15.99:0/865860460 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:41.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.643+0000 7f1a13400640 1 --2- 172.21.15.99:0/865860460 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5610490aacf0 0x5610490ab560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:41.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.643+0000 7f1a0be00640 1 -- 172.21.15.99:0/865860460 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5610490aacf0 msgr2=0x5610490ab560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:41.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.643+0000 7f1a0be00640 1 --2- 172.21.15.99:0/865860460 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5610490aacf0 0x5610490ab560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.643+0000 7f1a0be00640 1 -- 172.21.15.99:0/865860460 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56104906f660 msgr2=0x56104906fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:41.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.643+0000 7f1a0be00640 1 --2- 172.21.15.99:0/865860460 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56104906f660 0x56104906fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.643+0000 7f1a0be00640 1 -- 172.21.15.99:0/865860460 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561048f63f80 con 0x5610490aa330 2024-02-21T23:02:41.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.644+0000 7f1a0be00640 1 --2- 172.21.15.99:0/865860460 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5610490aa330 0x5610490aa7b0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f19fc0c68a0 tx=0x7f19fc096940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a593c7e57c04efdf server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:41.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.644+0000 7f1a03400640 1 -- 172.21.15.99:0/865860460 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19fc09f170 con 0x5610490aa330 2024-02-21T23:02:41.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.644+0000 7f1a03400640 1 -- 172.21.15.99:0/865860460 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19fc0930d0 con 0x5610490aa330 2024-02-21T23:02:41.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.644+0000 7f1a03400640 1 -- 172.21.15.99:0/865860460 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19fc0c6c70 con 0x5610490aa330 2024-02-21T23:02:41.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.645+0000 7f1a1c651740 1 -- 172.21.15.99:0/865860460 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5610490aa330 msgr2=0x5610490aa7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:41.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.645+0000 7f1a1c651740 1 --2- 172.21.15.99:0/865860460 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5610490aa330 0x5610490aa7b0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f19fc0c68a0 tx=0x7f19fc096940 comp rx=0 tx=0).stop 2024-02-21T23:02:41.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.645+0000 7f1a1c651740 1 -- 172.21.15.99:0/865860460 shutdown_connections 2024-02-21T23:02:41.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.645+0000 7f1a1c651740 1 --2- 172.21.15.99:0/865860460 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5610490aacf0 0x5610490ab560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.645+0000 7f1a1c651740 1 --2- 172.21.15.99:0/865860460 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5610490aa330 0x5610490aa7b0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.645+0000 7f1a1c651740 1 --2- 172.21.15.99:0/865860460 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56104906f660 0x56104906fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.645+0000 7f1a1c651740 1 -- 172.21.15.99:0/865860460 >> 172.21.15.99:0/865860460 conn(0x5610490316d0 msgr2=0x561049032750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:41.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.645+0000 7f1a1c651740 1 -- 172.21.15.99:0/865860460 shutdown_connections 2024-02-21T23:02:41.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.645+0000 7f1a1c651740 1 -- 172.21.15.99:0/865860460 wait complete. 2024-02-21T23:02:41.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.646+0000 7f1a1c651740 1 -- start start 2024-02-21T23:02:41.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.647+0000 7f1a1c651740 1 Processor -- start 2024-02-21T23:02:41.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.649+0000 7f1a1c651740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5610490aa330 0x5610490b2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:41.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.649+0000 7f1a1c651740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5610490aacf0 0x56104905ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:41.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.649+0000 7f1a1c651740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56104905a440 0x56104905a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:41.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.649+0000 7f1a1c651740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610490a90a0 con 0x56104905a440 2024-02-21T23:02:41.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.649+0000 7f1a1c651740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x561048f36380 con 0x5610490aa330 2024-02-21T23:02:41.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.649+0000 7f1a1c651740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610490a8dc0 con 0x5610490aacf0 2024-02-21T23:02:41.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.649+0000 7f1a1c651740 10 client.0 _ll_register_callbacks cb 0x561048f8f280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:02:41.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.649+0000 7f1a13400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56104905a440 0x56104905a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:41.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.649+0000 7f1a12a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5610490aa330 0x5610490b2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:41.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.649+0000 7f1a13400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56104905a440 0x56104905a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59268/0 (socket says 172.21.15.99:59268) 2024-02-21T23:02:41.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.649+0000 7f1a13400640 1 -- 172.21.15.99:0/688499894 learned_addr learned my addr 172.21.15.99:0/688499894 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:41.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.650+0000 7f1a0be00640 1 --2- 172.21.15.99:0/688499894 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5610490aacf0 0x56104905ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:41.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.650+0000 7f1a12a00640 1 -- 172.21.15.99:0/688499894 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5610490aacf0 msgr2=0x56104905ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:41.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.650+0000 7f1a12a00640 1 --2- 172.21.15.99:0/688499894 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5610490aacf0 0x56104905ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.650+0000 7f1a12a00640 1 -- 172.21.15.99:0/688499894 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56104905a440 msgr2=0x56104905a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:41.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.650+0000 7f1a12a00640 1 --2- 172.21.15.99:0/688499894 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56104905a440 0x56104905a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.650+0000 7f1a12a00640 1 -- 172.21.15.99:0/688499894 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561048f5ec20 con 0x5610490aa330 2024-02-21T23:02:41.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.650+0000 7f1a12a00640 1 --2- 172.21.15.99:0/688499894 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5610490aa330 0x5610490b2050 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1a04004f20 tx=0x7f1a040019b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3b5d5c55ef755a7 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:41.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.650+0000 7f19f7e00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-02-21T23:02:41.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.650+0000 7f19f7e00640 1 -- 172.21.15.99:0/688499894 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a04014670 con 0x5610490aa330 2024-02-21T23:02:41.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.651+0000 7f1a1c651740 1 -- 172.21.15.99:0/688499894 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f19fc0930d0 con 0x5610490aa330 2024-02-21T23:02:41.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.651+0000 7f19f7e00640 1 -- 172.21.15.99:0/688499894 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f1a04014810 con 0x5610490aa330 2024-02-21T23:02:41.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.651+0000 7f19f7e00640 1 -- 172.21.15.99:0/688499894 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1a04023050 con 0x5610490aa330 2024-02-21T23:02:41.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.651+0000 7f1a1c651740 10 client.5272 fetch_fsmap learned FSMap version 15 2024-02-21T23:02:41.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.651+0000 7f1a1c651740 1 -- 172.21.15.99:0/688499894 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x561048cac3f0 con 0x5610490aa330 2024-02-21T23:02:41.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.651+0000 7f19f7e00640 1 -- 172.21.15.99:0/688499894 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19fc0930d0 con 0x5610490aa330 2024-02-21T23:02:41.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.651+0000 7f19f7e00640 1 -- 172.21.15.99:0/688499894 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 15) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f1a04014a10 con 0x5610490aa330 2024-02-21T23:02:41.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.651+0000 7f1a1c651740 10 client.5272 fetch_fsmap finished waiting for FSMap version 15 2024-02-21T23:02:41.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.651+0000 7f1a1c651740 10 client.5272 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:02:41.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.651+0000 7f1a1c651740 20 client.5272 populate_metadata read hostname 'smithi099' 2024-02-21T23:02:41.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.651+0000 7f1a1c651740 1 --2- 172.21.15.99:0/688499894 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x561049061240 0x5610490616b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:41.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.651+0000 7f1a1c651740 4 client.5272 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:02:41.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.651+0000 7f1a1c651740 1 -- 172.21.15.99:0/688499894 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561048fa5090 con 0x561049061240 2024-02-21T23:02:41.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.652+0000 7f1a0be00640 1 --2- 172.21.15.99:0/688499894 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x561049061240 0x5610490616b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:41.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.652+0000 7f1a0be00640 1 --2- 172.21.15.99:0/688499894 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x561049061240 0x5610490616b0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=916b3712662ec38e server_cookie=c7b50f066109c712 in_seq=0 out_seq=0 2024-02-21T23:02:41.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.652+0000 7f19f7e00640 10 client.5272 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:02:41.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.653+0000 7f19f7e00640 1 -- 172.21.15.99:0/688499894 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x561048fa5090 con 0x561049061240 2024-02-21T23:02:41.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.653+0000 7f19f7e00640 10 client.5272 handle_command_reply: tid=0 2024-02-21T23:02:41.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.653+0000 7f1a1c651740 1 client.5272 shutdown 2024-02-21T23:02:41.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.653+0000 7f1a1c651740 1 -- 172.21.15.99:0/688499894 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5610490aa330 msgr2=0x5610490b2050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:41.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.653+0000 7f1a1c651740 1 --2- 172.21.15.99:0/688499894 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5610490aa330 0x5610490b2050 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1a04004f20 tx=0x7f1a040019b0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.653+0000 7f1a1c651740 1 -- 172.21.15.99:0/688499894 shutdown_connections 2024-02-21T23:02:41.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.653+0000 7f1a1c651740 1 --2- 172.21.15.99:0/688499894 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x561049061240 0x5610490616b0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.653+0000 7f1a1c651740 1 --2- 172.21.15.99:0/688499894 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56104905a440 0x56104905a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.653+0000 7f1a1c651740 1 --2- 172.21.15.99:0/688499894 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5610490aacf0 0x56104905ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.653+0000 7f1a1c651740 1 --2- 172.21.15.99:0/688499894 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5610490aa330 0x5610490b2050 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.653+0000 7f19f7e00640 0 client.5272 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:02:41.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.653+0000 7f1a1c651740 1 -- 172.21.15.99:0/688499894 >> 172.21.15.99:0/688499894 conn(0x56104906f660 msgr2=0x5610490a8680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:41.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.654+0000 7f1a1c651740 1 -- 172.21.15.99:0/688499894 shutdown_connections 2024-02-21T23:02:41.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.654+0000 7f1a1c651740 1 -- 172.21.15.99:0/688499894 wait complete. 2024-02-21T23:02:41.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.654+0000 7f1a1c651740 20 client.5272 trim_cache size 0 max 16384 2024-02-21T23:02:41.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.669+0000 7f1a1c651740 1 Processor -- start 2024-02-21T23:02:41.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.669+0000 7f1a1c651740 1 -- start start 2024-02-21T23:02:41.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.671+0000 7f1a1c651740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56104905a440 0x561049061620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:41.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.671+0000 7f1a1c651740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5610490aa330 0x56104910dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:41.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.671+0000 7f1a1c651740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5610490aacf0 0x5610490295e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:41.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.671+0000 7f1a1c651740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1422c7a0 con 0x5610490aa330 2024-02-21T23:02:41.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.671+0000 7f1a1c651740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1422a340 con 0x5610490aacf0 2024-02-21T23:02:41.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.671+0000 7f1a1c651740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a142215b0 con 0x56104905a440 2024-02-21T23:02:41.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.672+0000 7f1a0be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5610490aa330 0x56104910dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:41.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.672+0000 7f1a0be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5610490aa330 0x56104910dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59270/0 (socket says 172.21.15.99:59270) 2024-02-21T23:02:41.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.672+0000 7f1a12a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56104905a440 0x561049061620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:41.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.672+0000 7f1a0be00640 1 -- 172.21.15.99:0/3181520450 learned_addr learned my addr 172.21.15.99:0/3181520450 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:41.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.672+0000 7f1a13400640 1 --2- 172.21.15.99:0/3181520450 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5610490aacf0 0x5610490295e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:41.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.672+0000 7f1a0be00640 1 -- 172.21.15.99:0/3181520450 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56104905a440 msgr2=0x561049061620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:41.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.672+0000 7f1a0be00640 1 --2- 172.21.15.99:0/3181520450 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56104905a440 0x561049061620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.672+0000 7f1a0be00640 1 -- 172.21.15.99:0/3181520450 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5610490aacf0 msgr2=0x5610490295e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:41.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.672+0000 7f1a0be00640 1 --2- 172.21.15.99:0/3181520450 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5610490aacf0 0x5610490295e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.672+0000 7f1a0be00640 1 -- 172.21.15.99:0/3181520450 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561048d767d0 con 0x5610490aa330 2024-02-21T23:02:41.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.672+0000 7f1a12a00640 1 --2- 172.21.15.99:0/3181520450 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56104905a440 0x561049061620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:02:41.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.672+0000 7f1a0be00640 1 --2- 172.21.15.99:0/3181520450 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5610490aa330 0x56104910dce0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f19fc0969f0 tx=0x7f19fc014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb0702c9a6780005 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:41.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.673+0000 7f1a02a00640 1 -- 172.21.15.99:0/3181520450 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19fc0930d0 con 0x5610490aa330 2024-02-21T23:02:41.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.673+0000 7f1a02a00640 1 -- 172.21.15.99:0/3181520450 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19fc09f170 con 0x5610490aa330 2024-02-21T23:02:41.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.673+0000 7f1a02a00640 1 -- 172.21.15.99:0/3181520450 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19fc003d80 con 0x5610490aa330 2024-02-21T23:02:41.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.673+0000 7f1a1c651740 1 -- 172.21.15.99:0/3181520450 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5610490aa330 msgr2=0x56104910dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:41.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.673+0000 7f1a1c651740 1 --2- 172.21.15.99:0/3181520450 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5610490aa330 0x56104910dce0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f19fc0969f0 tx=0x7f19fc014000 comp rx=0 tx=0).stop 2024-02-21T23:02:41.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.673+0000 7f1a1c651740 1 -- 172.21.15.99:0/3181520450 shutdown_connections 2024-02-21T23:02:41.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.673+0000 7f1a1c651740 1 --2- 172.21.15.99:0/3181520450 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5610490aacf0 0x5610490295e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.673+0000 7f1a1c651740 1 --2- 172.21.15.99:0/3181520450 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5610490aa330 0x56104910dce0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.673+0000 7f1a1c651740 1 --2- 172.21.15.99:0/3181520450 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56104905a440 0x561049061620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.673+0000 7f1a1c651740 1 -- 172.21.15.99:0/3181520450 >> 172.21.15.99:0/3181520450 conn(0x56104906f660 msgr2=0x5610490a90a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:41.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.673+0000 7f1a1c651740 1 -- 172.21.15.99:0/3181520450 shutdown_connections 2024-02-21T23:02:41.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.674+0000 7f1a1c651740 1 -- 172.21.15.99:0/3181520450 wait complete. 2024-02-21T23:02:41.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.675+0000 7f1a1c651740 1 -- start start 2024-02-21T23:02:41.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.675+0000 7f1a1c651740 1 Processor -- start 2024-02-21T23:02:41.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.677+0000 7f1a1c651740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56104905a440 0x561049038920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:41.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.677+0000 7f1a1c651740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5610490aa330 0x56104910aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:41.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.677+0000 7f1a1c651740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5610490aacf0 0x561049037160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:41.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.677+0000 7f1a1c651740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a14228a40 con 0x5610490aa330 2024-02-21T23:02:41.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.677+0000 7f1a1c651740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a14229ce0 con 0x5610490aacf0 2024-02-21T23:02:41.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.677+0000 7f1a1c651740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a14229040 con 0x56104905a440 2024-02-21T23:02:41.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.677+0000 7f1a1c651740 10 client.0 _ll_register_callbacks cb 0x7f1a040072f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:02:41.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.678+0000 7f1a0be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5610490aa330 0x56104910aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:41.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.678+0000 7f1a0be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5610490aa330 0x56104910aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59282/0 (socket says 172.21.15.99:59282) 2024-02-21T23:02:41.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.678+0000 7f1a0be00640 1 -- 172.21.15.99:0/2916835286 learned_addr learned my addr 172.21.15.99:0/2916835286 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:41.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.678+0000 7f1a12a00640 1 --2- 172.21.15.99:0/2916835286 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56104905a440 0x561049038920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:41.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.678+0000 7f1a13400640 1 --2- 172.21.15.99:0/2916835286 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5610490aacf0 0x561049037160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:41.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.678+0000 7f1a0be00640 1 -- 172.21.15.99:0/2916835286 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56104905a440 msgr2=0x561049038920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:41.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.678+0000 7f1a0be00640 1 --2- 172.21.15.99:0/2916835286 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56104905a440 0x561049038920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.678+0000 7f1a0be00640 1 -- 172.21.15.99:0/2916835286 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5610490aacf0 msgr2=0x561049037160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:41.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.678+0000 7f1a0be00640 1 --2- 172.21.15.99:0/2916835286 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5610490aacf0 0x561049037160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.678+0000 7f1a0be00640 1 -- 172.21.15.99:0/2916835286 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56104906c720 con 0x5610490aa330 2024-02-21T23:02:41.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.678+0000 7f1a0be00640 1 --2- 172.21.15.99:0/2916835286 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5610490aa330 0x56104910aea0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f19fc0c9210 tx=0x7f19fc0c8040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfb2df1791e0e8d4 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:41.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.678+0000 7f19f7e00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:02:41.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.679+0000 7f19f7e00640 1 -- 172.21.15.99:0/2916835286 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19fc07c060 con 0x5610490aa330 2024-02-21T23:02:41.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.679+0000 7f19f7e00640 1 -- 172.21.15.99:0/2916835286 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f19fc003d80 con 0x5610490aa330 2024-02-21T23:02:41.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.679+0000 7f1a1c651740 1 -- 172.21.15.99:0/2916835286 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f19fc09f170 con 0x5610490aa330 2024-02-21T23:02:41.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.679+0000 7f19f7e00640 1 -- 172.21.15.99:0/2916835286 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f19fc0930d0 con 0x5610490aa330 2024-02-21T23:02:41.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.679+0000 7f1a1c651740 10 client.5187 fetch_fsmap learned FSMap version 15 2024-02-21T23:02:41.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.679+0000 7f1a1c651740 1 -- 172.21.15.99:0/2916835286 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x561049038e60 con 0x5610490aa330 2024-02-21T23:02:41.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.679+0000 7f19f7e00640 1 -- 172.21.15.99:0/2916835286 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19fc09f170 con 0x5610490aa330 2024-02-21T23:02:41.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.679+0000 7f19f7e00640 1 -- 172.21.15.99:0/2916835286 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 15) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f19fc0c3020 con 0x5610490aa330 2024-02-21T23:02:41.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.679+0000 7f1a1c651740 10 client.5187 fetch_fsmap finished waiting for FSMap version 15 2024-02-21T23:02:41.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.679+0000 7f1a1c651740 10 client.5187 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:02:41.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.679+0000 7f1a1c651740 20 client.5187 populate_metadata read hostname 'smithi099' 2024-02-21T23:02:41.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.679+0000 7f1a1c651740 1 --2- 172.21.15.99:0/2916835286 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x561049039100 0x5610490376a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:41.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.680+0000 7f1a1c651740 4 client.5187 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T23:02:41.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.680+0000 7f1a1c651740 1 -- 172.21.15.99:0/2916835286 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x561048f9f3e0 con 0x561049039100 2024-02-21T23:02:41.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.680+0000 7f1a12a00640 1 --2- 172.21.15.99:0/2916835286 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x561049039100 0x5610490376a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:41.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.680+0000 7f1a12a00640 1 --2- 172.21.15.99:0/2916835286 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x561049039100 0x5610490376a0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cbbd6c65d33ce8f6 server_cookie=a6588220e02ef6b6 in_seq=0 out_seq=0 2024-02-21T23:02:41.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.680+0000 7f19f7e00640 10 client.5187 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:02:41.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.681+0000 7f19f7e00640 1 -- 172.21.15.99:0/2916835286 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x561048f9f3e0 con 0x561049039100 2024-02-21T23:02:41.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.681+0000 7f19f7e00640 10 client.5187 handle_command_reply: tid=0 2024-02-21T23:02:41.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.681+0000 7f1a1c651740 1 client.5187 shutdown 2024-02-21T23:02:41.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.681+0000 7f1a1c651740 1 -- 172.21.15.99:0/2916835286 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5610490aa330 msgr2=0x56104910aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:41.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.681+0000 7f1a1c651740 1 --2- 172.21.15.99:0/2916835286 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5610490aa330 0x56104910aea0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f19fc0c9210 tx=0x7f19fc0c8040 comp rx=0 tx=0).stop 2024-02-21T23:02:41.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.681+0000 7f1a1c651740 1 -- 172.21.15.99:0/2916835286 shutdown_connections 2024-02-21T23:02:41.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.681+0000 7f1a1c651740 1 --2- 172.21.15.99:0/2916835286 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x561049039100 0x5610490376a0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.681+0000 7f1a1c651740 1 --2- 172.21.15.99:0/2916835286 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5610490aacf0 0x561049037160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.681+0000 7f1a1c651740 1 --2- 172.21.15.99:0/2916835286 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5610490aa330 0x56104910aea0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.681+0000 7f1a1c651740 1 --2- 172.21.15.99:0/2916835286 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56104905a440 0x561049038920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.681+0000 7f1a1c651740 1 -- 172.21.15.99:0/2916835286 >> 172.21.15.99:0/2916835286 conn(0x56104906f660 msgr2=0x5610490b1f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:41.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.681+0000 7f19f7e00640 0 client.5187 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:02:41.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.681+0000 7f1a1c651740 1 -- 172.21.15.99:0/2916835286 shutdown_connections 2024-02-21T23:02:41.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.681+0000 7f1a1c651740 1 -- 172.21.15.99:0/2916835286 wait complete. 2024-02-21T23:02:41.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.681+0000 7f1a1c651740 20 client.5187 trim_cache size 0 max 16384 2024-02-21T23:02:41.678 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-02-21T23:02:41.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.682+0000 7f1a13e00640 1 -- 172.21.15.99:0/1052918488 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f19f009ef60 msgr2=0x7f19f00a1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:41.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.682+0000 7f1a13e00640 1 --2- 172.21.15.99:0/1052918488 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f19f009ef60 0x7f19f00a1420 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c036000 tx=0x7f1a0c030000 comp rx=0 tx=0).stop 2024-02-21T23:02:41.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.682+0000 7f1a13e00640 1 -- 172.21.15.99:0/1052918488 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1a1417f490 msgr2=0x7f1a1421d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:41.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.682+0000 7f1a13e00640 1 --2- 172.21.15.99:0/1052918488 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1a1417f490 0x7f1a1421d790 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f19fc00c440 tx=0x7f19fc00c900 comp rx=0 tx=0).stop 2024-02-21T23:02:41.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.682+0000 7f1a13e00640 1 -- 172.21.15.99:0/1052918488 shutdown_connections 2024-02-21T23:02:41.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.682+0000 7f1a13e00640 1 --2- 172.21.15.99:0/1052918488 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f19f009ef60 0x7f19f00a1420 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.682+0000 7f1a13e00640 1 --2- 172.21.15.99:0/1052918488 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1a1418b230 0x7f1a1421dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.682+0000 7f1a13e00640 1 --2- 172.21.15.99:0/1052918488 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1a1417f490 0x7f1a1421d790 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.682+0000 7f1a13e00640 1 --2- 172.21.15.99:0/1052918488 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1a140d60b0 0x7f1a14171fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:41.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.682+0000 7f1a13e00640 1 -- 172.21.15.99:0/1052918488 >> 172.21.15.99:0/1052918488 conn(0x7f1a140d29b0 msgr2=0x7f1a140d5880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:41.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.682+0000 7f1a13e00640 1 -- 172.21.15.99:0/1052918488 shutdown_connections 2024-02-21T23:02:41.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:41.682+0000 7f1a13e00640 1 -- 172.21.15.99:0/1052918488 wait complete. 2024-02-21T23:02:42.691 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-02-21T23:02:42.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T23:02:42.691 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-02-21T23:02:42.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.908+0000 7fb3daa00640 1 Processor -- start 2024-02-21T23:02:42.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.908+0000 7fb3daa00640 1 -- start start 2024-02-21T23:02:42.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.912+0000 7fb3daa00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fb3d4189f40 0x7fb3d418b920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:42.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.912+0000 7fb3daa00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3d418a5a0 con 0x7fb3d417f710 2024-02-21T23:02:42.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.912+0000 7fb3daa00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3d418a880 con 0x7fb3d4071c20 2024-02-21T23:02:42.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.912+0000 7fb3daa00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3d418ab60 con 0x7fb3d4189f40 2024-02-21T23:02:42.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.913+0000 7fb3d8c00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fb3d4189f40 0x7fb3d418b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:42.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.913+0000 7fb3d8c00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fb3d4189f40 0x7fb3d418b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:51438/0 (socket says 172.21.15.99:51438) 2024-02-21T23:02:42.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.913+0000 7fb3d9600640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fb3d417f710 0x7fb3d415e490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.99:42288/0 (socket says 172.21.15.99:42288) 2024-02-21T23:02:42.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.913+0000 7fb3d8c00640 1 -- 172.21.15.99:0/750696848 learned_addr learned my addr 172.21.15.99:0/750696848 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:42.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.913+0000 7fb3d8c00640 1 -- 172.21.15.99:0/750696848 >> v1:172.21.15.181:6789/0 conn(0x7fb3d4071c20 legacy=0x7fb3d40d4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:42.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.913+0000 7fb3d8c00640 1 -- 172.21.15.99:0/750696848 >> v1:172.21.15.162:6789/0 conn(0x7fb3d417f710 legacy=0x7fb3d415e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:42.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.913+0000 7fb3d8c00640 1 -- 172.21.15.99:0/750696848 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3d418ae40 con 0x7fb3d4189f40 2024-02-21T23:02:42.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.914+0000 7fb3d8c00640 1 --2- 172.21.15.99:0/750696848 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb3d4189f40 0x7fb3d418b920 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb3c4009870 tx=0x7fb3c402ba20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7c43adec8dc8f46 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:42.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.914+0000 7fb3d3e00640 1 -- 172.21.15.99:0/750696848 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c402f840 con 0x7fb3d4189f40 2024-02-21T23:02:42.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.915+0000 7fb3d3e00640 1 -- 172.21.15.99:0/750696848 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3c402f9e0 con 0x7fb3d4189f40 2024-02-21T23:02:42.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.915+0000 7fb3d3e00640 1 -- 172.21.15.99:0/750696848 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c402fdb0 con 0x7fb3d4189f40 2024-02-21T23:02:42.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.915+0000 7fb3daa00640 1 -- 172.21.15.99:0/750696848 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb3d4189f40 msgr2=0x7fb3d418b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:42.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.915+0000 7fb3daa00640 1 --2- 172.21.15.99:0/750696848 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb3d4189f40 0x7fb3d418b920 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb3c4009870 tx=0x7fb3c402ba20 comp rx=0 tx=0).stop 2024-02-21T23:02:42.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.915+0000 7fb3daa00640 1 -- 172.21.15.99:0/750696848 shutdown_connections 2024-02-21T23:02:42.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.915+0000 7fb3daa00640 1 --2- 172.21.15.99:0/750696848 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb3d4189f40 0x7fb3d418b920 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:42.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.916+0000 7fb3daa00640 1 -- 172.21.15.99:0/750696848 >> 172.21.15.99:0/750696848 conn(0x7fb3d40fe310 msgr2=0x7fb3d40fe720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:42.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.916+0000 7fb3daa00640 1 -- 172.21.15.99:0/750696848 shutdown_connections 2024-02-21T23:02:42.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.916+0000 7fb3daa00640 1 -- 172.21.15.99:0/750696848 wait complete. 2024-02-21T23:02:42.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.918+0000 7fb3daa00640 1 Processor -- start 2024-02-21T23:02:42.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.918+0000 7fb3daa00640 1 -- start start 2024-02-21T23:02:42.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.920+0000 7fb3daa00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb3d4071c20 0x7fb3d40f8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:42.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.920+0000 7fb3daa00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb3d417f710 0x7fb3d40fd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:42.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.920+0000 7fb3daa00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb3d4189f40 0x7fb3d4222ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:42.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.920+0000 7fb3daa00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d4072200 con 0x7fb3d4189f40 2024-02-21T23:02:42.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.920+0000 7fb3daa00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d4072080 con 0x7fb3d417f710 2024-02-21T23:02:42.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.920+0000 7fb3daa00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d4072380 con 0x7fb3d4071c20 2024-02-21T23:02:42.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.920+0000 7fb3d9600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb3d4071c20 0x7fb3d40f8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:42.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.920+0000 7fb3d8c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb3d417f710 0x7fb3d40fd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:42.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.920+0000 7fb3d9600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb3d4071c20 0x7fb3d40f8b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:51450/0 (socket says 172.21.15.99:51450) 2024-02-21T23:02:42.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.920+0000 7fb3da000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb3d4189f40 0x7fb3d4222ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:42.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.920+0000 7fb3d9600640 1 -- 172.21.15.99:0/365510212 learned_addr learned my addr 172.21.15.99:0/365510212 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:42.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.921+0000 7fb3d9600640 1 -- 172.21.15.99:0/365510212 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb3d417f710 msgr2=0x7fb3d40fd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:42.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.921+0000 7fb3d9600640 1 --2- 172.21.15.99:0/365510212 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb3d417f710 0x7fb3d40fd8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:42.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.921+0000 7fb3d9600640 1 -- 172.21.15.99:0/365510212 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb3d4189f40 msgr2=0x7fb3d4222ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:42.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.921+0000 7fb3d9600640 1 --2- 172.21.15.99:0/365510212 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb3d4189f40 0x7fb3d4222ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:42.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.921+0000 7fb3d9600640 1 -- 172.21.15.99:0/365510212 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3d40fc880 con 0x7fb3d4071c20 2024-02-21T23:02:42.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.921+0000 7fb3d9600640 1 --2- 172.21.15.99:0/365510212 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb3d4071c20 0x7fb3d40f8b90 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb3c800c3e0 tx=0x7fb3c800c8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:42.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.921+0000 7fb3d1600640 1 -- 172.21.15.99:0/365510212 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c80074e0 con 0x7fb3d4071c20 2024-02-21T23:02:42.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.921+0000 7fb3d1600640 1 -- 172.21.15.99:0/365510212 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3c8007680 con 0x7fb3d4071c20 2024-02-21T23:02:42.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.921+0000 7fb3d1600640 1 -- 172.21.15.99:0/365510212 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c80049e0 con 0x7fb3d4071c20 2024-02-21T23:02:42.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.921+0000 7fb3daa00640 1 -- 172.21.15.99:0/365510212 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3d4187d80 con 0x7fb3d4071c20 2024-02-21T23:02:42.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.922+0000 7fb3daa00640 1 -- 172.21.15.99:0/365510212 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3d40fce00 con 0x7fb3d4071c20 2024-02-21T23:02:42.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.926+0000 7fb3d1600640 1 -- 172.21.15.99:0/365510212 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 12) v1 ==== 134532+0+0 (secure 0 0 0) 0x7fb3c801a020 con 0x7fb3d4071c20 2024-02-21T23:02:42.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.927+0000 7fb3defa4740 1 Processor -- start 2024-02-21T23:02:42.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.927+0000 7fb3defa4740 1 -- start start 2024-02-21T23:02:42.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.927+0000 7fb3d1600640 1 --2- 172.21.15.99:0/365510212 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fb3b809ef60 0x7fb3b80a1420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:42.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.927+0000 7fb3d1600640 1 -- 172.21.15.99:0/365510212 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7fb3c80c97c0 con 0x7fb3d4071c20 2024-02-21T23:02:42.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.928+0000 7fb3da000640 1 --2- 172.21.15.99:0/365510212 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fb3b809ef60 0x7fb3b80a1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:42.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.928+0000 7fb3defa4740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56387b4ca4c0 0x56387b4ca8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:42.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.928+0000 7fb3defa4740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56387b4cade0 0x56387b505650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:42.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.928+0000 7fb3defa4740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56387b505b90 0x56387b506920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:42.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.928+0000 7fb3defa4740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x56387b3f2790 con 0x56387b505b90 2024-02-21T23:02:42.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.928+0000 7fb3defa4740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x56387b39bbf0 con 0x56387b4ca4c0 2024-02-21T23:02:42.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.928+0000 7fb3defa4740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x56387b3ee830 con 0x56387b4cade0 2024-02-21T23:02:42.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.928+0000 7fb3da000640 1 --2- 172.21.15.99:0/365510212 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fb3b809ef60 0x7fb3b80a1420 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc0012e0 tx=0x7fb3cc009040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:42.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.928+0000 7fb3da000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56387b505b90 0x56387b506920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:42.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.929+0000 7fb3da000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56387b505b90 0x56387b506920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59302/0 (socket says 172.21.15.99:59302) 2024-02-21T23:02:42.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.929+0000 7fb3da000640 1 -- 172.21.15.99:0/1181857344 learned_addr learned my addr 172.21.15.99:0/1181857344 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:42.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.929+0000 7fb3d9600640 1 --2- 172.21.15.99:0/1181857344 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56387b4ca4c0 0x56387b4ca8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:42.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.929+0000 7fb3d8c00640 1 --2- 172.21.15.99:0/1181857344 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56387b4cade0 0x56387b505650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:42.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.929+0000 7fb3d9600640 1 -- 172.21.15.99:0/1181857344 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56387b4cade0 msgr2=0x56387b505650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:42.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.929+0000 7fb3d9600640 1 --2- 172.21.15.99:0/1181857344 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56387b4cade0 0x56387b505650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:42.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.929+0000 7fb3d9600640 1 -- 172.21.15.99:0/1181857344 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56387b505b90 msgr2=0x56387b506920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:42.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.929+0000 7fb3d9600640 1 --2- 172.21.15.99:0/1181857344 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56387b505b90 0x56387b506920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:42.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.929+0000 7fb3d9600640 1 -- 172.21.15.99:0/1181857344 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56387b3b9c40 con 0x56387b4ca4c0 2024-02-21T23:02:42.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.929+0000 7fb3d8c00640 1 --2- 172.21.15.99:0/1181857344 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56387b4cade0 0x56387b505650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:02:42.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.929+0000 7fb3da000640 1 --2- 172.21.15.99:0/1181857344 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56387b505b90 0x56387b506920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:02:42.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.929+0000 7fb3d9600640 1 --2- 172.21.15.99:0/1181857344 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56387b4ca4c0 0x56387b4ca8a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb3c80c6dc0 tx=0x7fb3c8097730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0ef832ad55e002d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:42.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.930+0000 7fb3c1c00640 1 -- 172.21.15.99:0/1181857344 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c8093560 con 0x56387b4ca4c0 2024-02-21T23:02:42.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.930+0000 7fb3c1c00640 1 -- 172.21.15.99:0/1181857344 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3c80c6f90 con 0x56387b4ca4c0 2024-02-21T23:02:42.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.930+0000 7fb3c1c00640 1 -- 172.21.15.99:0/1181857344 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c8093700 con 0x56387b4ca4c0 2024-02-21T23:02:42.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.930+0000 7fb3defa4740 1 -- 172.21.15.99:0/1181857344 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56387b4ca4c0 msgr2=0x56387b4ca8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:42.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.930+0000 7fb3defa4740 1 --2- 172.21.15.99:0/1181857344 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56387b4ca4c0 0x56387b4ca8a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb3c80c6dc0 tx=0x7fb3c8097730 comp rx=0 tx=0).stop 2024-02-21T23:02:42.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.931+0000 7fb3defa4740 1 -- 172.21.15.99:0/1181857344 shutdown_connections 2024-02-21T23:02:42.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.931+0000 7fb3defa4740 1 --2- 172.21.15.99:0/1181857344 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56387b505b90 0x56387b506920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:42.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.931+0000 7fb3defa4740 1 --2- 172.21.15.99:0/1181857344 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56387b4cade0 0x56387b505650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:42.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.931+0000 7fb3defa4740 1 --2- 172.21.15.99:0/1181857344 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56387b4ca4c0 0x56387b4ca8a0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:42.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.931+0000 7fb3defa4740 1 -- 172.21.15.99:0/1181857344 >> 172.21.15.99:0/1181857344 conn(0x56387b48ca90 msgr2=0x56387b48db10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:42.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.931+0000 7fb3defa4740 1 -- 172.21.15.99:0/1181857344 shutdown_connections 2024-02-21T23:02:42.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.931+0000 7fb3defa4740 1 -- 172.21.15.99:0/1181857344 wait complete. 2024-02-21T23:02:42.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.932+0000 7fb3defa4740 1 -- start start 2024-02-21T23:02:42.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.932+0000 7fb3defa4740 1 Processor -- start 2024-02-21T23:02:42.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.933+0000 7fb3defa4740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56387b4cade0 0x56387b48a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:42.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.933+0000 7fb3defa4740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56387b505b90 0x56387b4bc000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:42.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.933+0000 7fb3defa4740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56387b510020 0x56387b510750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:42.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.933+0000 7fb3defa4740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x56387b504070 con 0x56387b505b90 2024-02-21T23:02:42.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.933+0000 7fb3defa4740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x56387b3911d0 con 0x56387b510020 2024-02-21T23:02:42.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.933+0000 7fb3defa4740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x56387b504350 con 0x56387b4cade0 2024-02-21T23:02:42.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.934+0000 7fb3defa4740 10 client.0 _ll_register_callbacks cb 0x56387b106c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:02:42.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.934+0000 7fb3d8c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56387b505b90 0x56387b4bc000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:42.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.934+0000 7fb3d8c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56387b505b90 0x56387b4bc000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59318/0 (socket says 172.21.15.99:59318) 2024-02-21T23:02:42.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.934+0000 7fb3d8c00640 1 -- 172.21.15.99:0/957951439 learned_addr learned my addr 172.21.15.99:0/957951439 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:42.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.934+0000 7fb3da000640 1 --2- 172.21.15.99:0/957951439 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56387b510020 0x56387b510750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:42.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.934+0000 7fb3d9600640 1 --2- 172.21.15.99:0/957951439 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56387b4cade0 0x56387b48a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:42.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.934+0000 7fb3da000640 1 -- 172.21.15.99:0/957951439 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56387b4cade0 msgr2=0x56387b48a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:42.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.934+0000 7fb3da000640 1 --2- 172.21.15.99:0/957951439 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56387b4cade0 0x56387b48a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:42.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.934+0000 7fb3da000640 1 -- 172.21.15.99:0/957951439 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56387b505b90 msgr2=0x56387b4bc000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:42.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.934+0000 7fb3da000640 1 --2- 172.21.15.99:0/957951439 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56387b505b90 0x56387b4bc000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:42.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.934+0000 7fb3da000640 1 -- 172.21.15.99:0/957951439 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56387b1cf7e0 con 0x56387b510020 2024-02-21T23:02:42.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.935+0000 7fb3da000640 1 --2- 172.21.15.99:0/957951439 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56387b510020 0x56387b510750 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc0147c0 tx=0x7fb3cc001400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=28614a3375187a1b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:42.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.935+0000 7fb3b6000640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-02-21T23:02:42.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.935+0000 7fb3b6000640 1 -- 172.21.15.99:0/957951439 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc025020 con 0x56387b510020 2024-02-21T23:02:42.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.935+0000 7fb3defa4740 1 -- 172.21.15.99:0/957951439 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb3c80c6f90 con 0x56387b510020 2024-02-21T23:02:42.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.935+0000 7fb3b6000640 1 -- 172.21.15.99:0/957951439 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7fb3cc013930 con 0x56387b510020 2024-02-21T23:02:42.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.935+0000 7fb3b6000640 1 -- 172.21.15.99:0/957951439 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb3cc030050 con 0x56387b510020 2024-02-21T23:02:42.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.936+0000 7fb3defa4740 10 client.5290 fetch_fsmap learned FSMap version 15 2024-02-21T23:02:42.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.936+0000 7fb3defa4740 1 -- 172.21.15.99:0/957951439 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x56387b22ff70 con 0x56387b510020 2024-02-21T23:02:42.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.936+0000 7fb3b6000640 1 -- 172.21.15.99:0/957951439 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3c80c6f90 con 0x56387b510020 2024-02-21T23:02:42.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.936+0000 7fb3b6000640 1 -- 172.21.15.99:0/957951439 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 15) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fb3cc020040 con 0x56387b510020 2024-02-21T23:02:42.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.936+0000 7fb3defa4740 10 client.5290 fetch_fsmap finished waiting for FSMap version 15 2024-02-21T23:02:42.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.936+0000 7fb3defa4740 10 client.5290 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:02:42.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.936+0000 7fb3defa4740 20 client.5290 populate_metadata read hostname 'smithi099' 2024-02-21T23:02:42.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.936+0000 7fb3defa4740 1 --2- 172.21.15.99:0/957951439 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x56387b5125f0 0x56387b512a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:42.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.936+0000 7fb3defa4740 4 client.5290 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:02:42.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.936+0000 7fb3defa4740 1 -- 172.21.15.99:0/957951439 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56387b3ffcd0 con 0x56387b5125f0 2024-02-21T23:02:42.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.937+0000 7fb3d9600640 1 --2- 172.21.15.99:0/957951439 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x56387b5125f0 0x56387b512a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:42.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.937+0000 7fb3d9600640 1 --2- 172.21.15.99:0/957951439 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x56387b5125f0 0x56387b512a00 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6030a9cb34f5a097 server_cookie=6e3f6bb452743902 in_seq=0 out_seq=0 2024-02-21T23:02:42.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.937+0000 7fb3b6000640 10 client.5290 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:02:42.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.938+0000 7fb3b6000640 1 -- 172.21.15.99:0/957951439 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x56387b3ffcd0 con 0x56387b5125f0 2024-02-21T23:02:42.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.938+0000 7fb3b6000640 10 client.5290 handle_command_reply: tid=0 2024-02-21T23:02:42.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.938+0000 7fb3defa4740 1 client.5290 shutdown 2024-02-21T23:02:42.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.938+0000 7fb3defa4740 1 -- 172.21.15.99:0/957951439 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56387b510020 msgr2=0x56387b510750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:42.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.938+0000 7fb3defa4740 1 --2- 172.21.15.99:0/957951439 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56387b510020 0x56387b510750 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc0147c0 tx=0x7fb3cc001400 comp rx=0 tx=0).stop 2024-02-21T23:02:42.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.938+0000 7fb3defa4740 1 -- 172.21.15.99:0/957951439 shutdown_connections 2024-02-21T23:02:42.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.938+0000 7fb3defa4740 1 --2- 172.21.15.99:0/957951439 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x56387b5125f0 0x56387b512a00 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:42.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.938+0000 7fb3defa4740 1 --2- 172.21.15.99:0/957951439 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56387b510020 0x56387b510750 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:42.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.938+0000 7fb3defa4740 1 --2- 172.21.15.99:0/957951439 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56387b505b90 0x56387b4bc000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:42.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.939+0000 7fb3defa4740 1 --2- 172.21.15.99:0/957951439 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56387b4cade0 0x56387b48a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:42.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.939+0000 7fb3b6000640 0 client.5290 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:02:42.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.939+0000 7fb3defa4740 1 -- 172.21.15.99:0/957951439 >> 172.21.15.99:0/957951439 conn(0x56387b4ca4c0 msgr2=0x56387b48e500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:42.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.939+0000 7fb3defa4740 1 -- 172.21.15.99:0/957951439 shutdown_connections 2024-02-21T23:02:42.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.939+0000 7fb3defa4740 1 -- 172.21.15.99:0/957951439 wait complete. 2024-02-21T23:02:42.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.939+0000 7fb3defa4740 20 client.5290 trim_cache size 0 max 16384 2024-02-21T23:02:42.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.956+0000 7fb3defa4740 1 Processor -- start 2024-02-21T23:02:42.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.957+0000 7fb3defa4740 1 -- start start 2024-02-21T23:02:42.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.958+0000 7fb3defa4740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56387b4cade0 0x56387b48a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:42.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.958+0000 7fb3defa4740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56387b505b90 0x56387b50e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:42.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.958+0000 7fb3defa4740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56387b510020 0x56387b565540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:42.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.958+0000 7fb3defa4740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d422cbf0 con 0x56387b510020 2024-02-21T23:02:42.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.958+0000 7fb3defa4740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d422a790 con 0x56387b4cade0 2024-02-21T23:02:42.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.958+0000 7fb3defa4740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d421fd40 con 0x56387b505b90 2024-02-21T23:02:42.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.958+0000 7fb3d8c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56387b505b90 0x56387b50e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:42.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.958+0000 7fb3d8c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56387b505b90 0x56387b50e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:51480/0 (socket says 172.21.15.99:51480) 2024-02-21T23:02:42.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.958+0000 7fb3d8c00640 1 -- 172.21.15.99:0/2532224215 learned_addr learned my addr 172.21.15.99:0/2532224215 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:42.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.958+0000 7fb3da000640 1 --2- 172.21.15.99:0/2532224215 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56387b510020 0x56387b565540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:42.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.958+0000 7fb3d9600640 1 --2- 172.21.15.99:0/2532224215 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56387b4cade0 0x56387b48a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:42.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.958+0000 7fb3d8c00640 1 -- 172.21.15.99:0/2532224215 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56387b4cade0 msgr2=0x56387b48a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:42.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.958+0000 7fb3d8c00640 1 --2- 172.21.15.99:0/2532224215 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56387b4cade0 0x56387b48a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:42.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.958+0000 7fb3d8c00640 1 -- 172.21.15.99:0/2532224215 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56387b510020 msgr2=0x56387b565540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:42.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.958+0000 7fb3d8c00640 1 --2- 172.21.15.99:0/2532224215 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56387b510020 0x56387b565540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:42.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.958+0000 7fb3d8c00640 1 -- 172.21.15.99:0/2532224215 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56387b0c7170 con 0x56387b505b90 2024-02-21T23:02:42.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.959+0000 7fb3d8c00640 1 --2- 172.21.15.99:0/2532224215 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56387b505b90 0x56387b50e040 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb3c4009960 tx=0x7fb3c4030000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a07797d99548e329 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:42.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.959+0000 7fb3c1200640 1 -- 172.21.15.99:0/2532224215 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c402fc30 con 0x56387b505b90 2024-02-21T23:02:42.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.959+0000 7fb3c1200640 1 -- 172.21.15.99:0/2532224215 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3c402fdd0 con 0x56387b505b90 2024-02-21T23:02:42.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.959+0000 7fb3c1200640 1 -- 172.21.15.99:0/2532224215 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c4041660 con 0x56387b505b90 2024-02-21T23:02:42.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.960+0000 7fb3defa4740 1 -- 172.21.15.99:0/2532224215 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56387b505b90 msgr2=0x56387b50e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:42.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.960+0000 7fb3defa4740 1 --2- 172.21.15.99:0/2532224215 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56387b505b90 0x56387b50e040 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb3c4009960 tx=0x7fb3c4030000 comp rx=0 tx=0).stop 2024-02-21T23:02:42.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.960+0000 7fb3defa4740 1 -- 172.21.15.99:0/2532224215 shutdown_connections 2024-02-21T23:02:42.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.960+0000 7fb3defa4740 1 --2- 172.21.15.99:0/2532224215 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56387b510020 0x56387b565540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:42.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.960+0000 7fb3defa4740 1 --2- 172.21.15.99:0/2532224215 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56387b505b90 0x56387b50e040 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:42.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.960+0000 7fb3defa4740 1 --2- 172.21.15.99:0/2532224215 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56387b4cade0 0x56387b48a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:42.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.960+0000 7fb3defa4740 1 -- 172.21.15.99:0/2532224215 >> 172.21.15.99:0/2532224215 conn(0x56387b4ca4c0 msgr2=0x56387b48e500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:42.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.960+0000 7fb3defa4740 1 -- 172.21.15.99:0/2532224215 shutdown_connections 2024-02-21T23:02:42.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.960+0000 7fb3defa4740 1 -- 172.21.15.99:0/2532224215 wait complete. 2024-02-21T23:02:42.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.961+0000 7fb3defa4740 1 -- start start 2024-02-21T23:02:42.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.961+0000 7fb3defa4740 1 Processor -- start 2024-02-21T23:02:42.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.962+0000 7fb3defa4740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56387b4cade0 0x56387b560cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:42.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.962+0000 7fb3defa4740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56387b505b90 0x56387b500e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:42.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.962+0000 7fb3defa4740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56387b510020 0x56387b5013a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:42.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.962+0000 7fb3defa4740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d4228e90 con 0x56387b510020 2024-02-21T23:02:42.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.962+0000 7fb3defa4740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d422a130 con 0x56387b4cade0 2024-02-21T23:02:42.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.962+0000 7fb3defa4740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d4229490 con 0x56387b505b90 2024-02-21T23:02:42.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.962+0000 7fb3defa4740 10 client.0 _ll_register_callbacks cb 0x7fb3cc001880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:02:42.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.963+0000 7fb3da000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56387b510020 0x56387b5013a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:42.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.963+0000 7fb3da000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56387b510020 0x56387b5013a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59344/0 (socket says 172.21.15.99:59344) 2024-02-21T23:02:42.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.963+0000 7fb3da000640 1 -- 172.21.15.99:0/668958676 learned_addr learned my addr 172.21.15.99:0/668958676 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:42.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.963+0000 7fb3d9600640 1 --2- 172.21.15.99:0/668958676 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56387b4cade0 0x56387b560cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:42.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.963+0000 7fb3d8c00640 1 --2- 172.21.15.99:0/668958676 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56387b505b90 0x56387b500e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:42.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.963+0000 7fb3da000640 1 -- 172.21.15.99:0/668958676 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56387b505b90 msgr2=0x56387b500e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:42.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.963+0000 7fb3da000640 1 --2- 172.21.15.99:0/668958676 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56387b505b90 0x56387b500e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:42.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.963+0000 7fb3da000640 1 -- 172.21.15.99:0/668958676 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56387b4cade0 msgr2=0x56387b560cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:42.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.963+0000 7fb3da000640 1 --2- 172.21.15.99:0/668958676 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56387b4cade0 0x56387b560cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:42.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.963+0000 7fb3da000640 1 -- 172.21.15.99:0/668958676 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56387b4d0260 con 0x56387b510020 2024-02-21T23:02:42.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.963+0000 7fb3d9600640 1 --2- 172.21.15.99:0/668958676 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56387b4cade0 0x56387b560cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:02:42.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.963+0000 7fb3da000640 1 --2- 172.21.15.99:0/668958676 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56387b510020 0x56387b5013a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc000f80 tx=0x7fb3cc014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c59a4af913216cc server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:42.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.963+0000 7fb3b6000640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:02:42.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.964+0000 7fb3b6000640 1 -- 172.21.15.99:0/668958676 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc025040 con 0x56387b510020 2024-02-21T23:02:42.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.964+0000 7fb3b6000640 1 -- 172.21.15.99:0/668958676 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7fb3cc034600 con 0x56387b510020 2024-02-21T23:02:42.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.964+0000 7fb3defa4740 1 -- 172.21.15.99:0/668958676 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb3c402fdd0 con 0x56387b510020 2024-02-21T23:02:42.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.964+0000 7fb3b6000640 1 -- 172.21.15.99:0/668958676 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb3cc043050 con 0x56387b510020 2024-02-21T23:02:42.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.964+0000 7fb3defa4740 10 client.5202 fetch_fsmap learned FSMap version 15 2024-02-21T23:02:42.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.964+0000 7fb3defa4740 1 -- 172.21.15.99:0/668958676 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x56387b488270 con 0x56387b510020 2024-02-21T23:02:42.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.964+0000 7fb3b6000640 1 -- 172.21.15.99:0/668958676 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3c402fdd0 con 0x56387b510020 2024-02-21T23:02:42.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.965+0000 7fb3b6000640 1 -- 172.21.15.99:0/668958676 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 15) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fb3cc020040 con 0x56387b510020 2024-02-21T23:02:42.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.965+0000 7fb3defa4740 10 client.5202 fetch_fsmap finished waiting for FSMap version 15 2024-02-21T23:02:42.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.965+0000 7fb3defa4740 10 client.5202 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:02:42.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.965+0000 7fb3defa4740 20 client.5202 populate_metadata read hostname 'smithi099' 2024-02-21T23:02:42.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.965+0000 7fb3defa4740 1 --2- 172.21.15.99:0/668958676 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x56387b489dd0 0x56387b5018e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:42.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.965+0000 7fb3defa4740 4 client.5202 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-02-21T23:02:42.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.965+0000 7fb3defa4740 1 -- 172.21.15.99:0/668958676 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x56387b3fa020 con 0x56387b489dd0 2024-02-21T23:02:42.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.965+0000 7fb3d9600640 1 --2- 172.21.15.99:0/668958676 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x56387b489dd0 0x56387b5018e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:42.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.965+0000 7fb3d9600640 1 --2- 172.21.15.99:0/668958676 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x56387b489dd0 0x56387b5018e0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54511d42e16d1b74 server_cookie=c340066eb3cfc035 in_seq=0 out_seq=0 2024-02-21T23:02:42.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.965+0000 7fb3b6000640 10 client.5202 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:02:42.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.967+0000 7fb3b6000640 1 -- 172.21.15.99:0/668958676 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x56387b3fa020 con 0x56387b489dd0 2024-02-21T23:02:42.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.967+0000 7fb3b6000640 10 client.5202 handle_command_reply: tid=0 2024-02-21T23:02:42.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.967+0000 7fb3defa4740 1 client.5202 shutdown 2024-02-21T23:02:42.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.967+0000 7fb3defa4740 1 -- 172.21.15.99:0/668958676 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56387b510020 msgr2=0x56387b5013a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:42.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.967+0000 7fb3defa4740 1 --2- 172.21.15.99:0/668958676 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56387b510020 0x56387b5013a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc000f80 tx=0x7fb3cc014000 comp rx=0 tx=0).stop 2024-02-21T23:02:42.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.968+0000 7fb3defa4740 1 -- 172.21.15.99:0/668958676 shutdown_connections 2024-02-21T23:02:42.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.968+0000 7fb3defa4740 1 --2- 172.21.15.99:0/668958676 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x56387b489dd0 0x56387b5018e0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:42.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.968+0000 7fb3defa4740 1 --2- 172.21.15.99:0/668958676 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56387b510020 0x56387b5013a0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:42.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.968+0000 7fb3defa4740 1 --2- 172.21.15.99:0/668958676 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56387b505b90 0x56387b500e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:42.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.968+0000 7fb3defa4740 1 --2- 172.21.15.99:0/668958676 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56387b4cade0 0x56387b560cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:42.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.968+0000 7fb3b6000640 0 client.5202 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:02:42.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.968+0000 7fb3defa4740 1 -- 172.21.15.99:0/668958676 >> 172.21.15.99:0/668958676 conn(0x56387b4ca4c0 msgr2=0x56387b48e500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:42.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.969+0000 7fb3defa4740 1 -- 172.21.15.99:0/668958676 shutdown_connections 2024-02-21T23:02:42.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.969+0000 7fb3defa4740 1 -- 172.21.15.99:0/668958676 wait complete. 2024-02-21T23:02:42.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.969+0000 7fb3defa4740 20 client.5202 trim_cache size 0 max 16384 2024-02-21T23:02:42.959 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-02-21T23:02:42.959 INFO:teuthology.orchestra.run.smithi099.stdout: "return_code": 0, 2024-02-21T23:02:42.959 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_tag": "42a98e8d-a35e-4da5-b3a2-828addd9a64e", 2024-02-21T23:02:42.959 INFO:teuthology.orchestra.run.smithi099.stdout: "mode": "asynchronous" 2024-02-21T23:02:42.959 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-02-21T23:02:42.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.970+0000 7fb3daa00640 1 -- 172.21.15.99:0/365510212 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fb3b809ef60 msgr2=0x7fb3b80a1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:42.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.970+0000 7fb3daa00640 1 --2- 172.21.15.99:0/365510212 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fb3b809ef60 0x7fb3b80a1420 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc0012e0 tx=0x7fb3cc009040 comp rx=0 tx=0).stop 2024-02-21T23:02:42.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.970+0000 7fb3daa00640 1 -- 172.21.15.99:0/365510212 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb3d4071c20 msgr2=0x7fb3d40f8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:42.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.970+0000 7fb3daa00640 1 --2- 172.21.15.99:0/365510212 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb3d4071c20 0x7fb3d40f8b90 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb3c800c3e0 tx=0x7fb3c800c8a0 comp rx=0 tx=0).stop 2024-02-21T23:02:42.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.970+0000 7fb3daa00640 1 -- 172.21.15.99:0/365510212 shutdown_connections 2024-02-21T23:02:42.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.970+0000 7fb3daa00640 1 --2- 172.21.15.99:0/365510212 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fb3b809ef60 0x7fb3b80a1420 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:42.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.970+0000 7fb3daa00640 1 --2- 172.21.15.99:0/365510212 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb3d4189f40 0x7fb3d4222ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:42.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.970+0000 7fb3daa00640 1 --2- 172.21.15.99:0/365510212 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb3d417f710 0x7fb3d40fd8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:42.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.970+0000 7fb3daa00640 1 --2- 172.21.15.99:0/365510212 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb3d4071c20 0x7fb3d40f8b90 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:42.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.970+0000 7fb3daa00640 1 -- 172.21.15.99:0/365510212 >> 172.21.15.99:0/365510212 conn(0x7fb3d40fe310 msgr2=0x7fb3d417d580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:42.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.970+0000 7fb3daa00640 1 -- 172.21.15.99:0/365510212 shutdown_connections 2024-02-21T23:02:42.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:42.970+0000 7fb3daa00640 1 -- 172.21.15.99:0/365510212 wait complete. 2024-02-21T23:02:42.979 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T23:02:42.979 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T23:02:43.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.179+0000 7f3d86c00640 1 Processor -- start 2024-02-21T23:02:43.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.179+0000 7f3d86c00640 1 -- start start 2024-02-21T23:02:43.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.181+0000 7f3d86c00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d800cd270 con 0x7f3d8018b3f0 2024-02-21T23:02:43.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.181+0000 7f3d86c00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d800cd550 con 0x7f3d800f6320 2024-02-21T23:02:43.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.181+0000 7f3d86c00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d8018a200 con 0x7f3d80182cb0 2024-02-21T23:02:43.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.182+0000 7f3d85800640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f3d80182cb0 0x7f3d800f5c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:42086/0 (socket says 172.21.15.99:42086) 2024-02-21T23:02:43.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.182+0000 7f3d84e00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f3d800f6320 0x7f3d8018ace0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.99:42290/0 (socket says 172.21.15.99:42290) 2024-02-21T23:02:43.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.182+0000 7f3d85800640 1 -- 172.21.15.99:0/1543253663 learned_addr learned my addr 172.21.15.99:0/1543253663 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:02:43.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.182+0000 7f3d86200640 1 --1- 172.21.15.99:0/1543253663 >> v1:172.21.15.99:6789/0 conn(0x7f3d8018b3f0 0x7f3d800cc2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:48620/0 (socket says 172.21.15.99:48620) 2024-02-21T23:02:43.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.182+0000 7f3d7fe00640 1 -- 172.21.15.99:0/1543253663 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3544035915 0 0) 0x7f3d8018a200 con 0x7f3d80182cb0 2024-02-21T23:02:43.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.182+0000 7f3d7fe00640 1 -- 172.21.15.99:0/1543253663 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d68003520 con 0x7f3d80182cb0 2024-02-21T23:02:43.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.182+0000 7f3d7fe00640 1 -- 172.21.15.99:0/1543253663 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3765836930 0 0) 0x7f3d800cd550 con 0x7f3d800f6320 2024-02-21T23:02:43.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.182+0000 7f3d7fe00640 1 -- 172.21.15.99:0/1543253663 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d8018a200 con 0x7f3d800f6320 2024-02-21T23:02:43.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.182+0000 7f3d7fe00640 1 -- 172.21.15.99:0/1543253663 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3003313431 0 0) 0x7f3d800cd270 con 0x7f3d8018b3f0 2024-02-21T23:02:43.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.182+0000 7f3d7fe00640 1 -- 172.21.15.99:0/1543253663 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d800cd550 con 0x7f3d8018b3f0 2024-02-21T23:02:43.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.182+0000 7f3d7fe00640 1 -- 172.21.15.99:0/1543253663 <== mon.2 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1405446507 0 0) 0x7f3d68003520 con 0x7f3d80182cb0 2024-02-21T23:02:43.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.182+0000 7f3d7fe00640 1 -- 172.21.15.99:0/1543253663 >> v1:172.21.15.162:6789/0 conn(0x7f3d800f6320 legacy=0x7f3d8018ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:43.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.182+0000 7f3d7fe00640 1 -- 172.21.15.99:0/1543253663 >> v1:172.21.15.99:6789/0 conn(0x7f3d8018b3f0 legacy=0x7f3d800cc2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:43.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.182+0000 7f3d7fe00640 1 -- 172.21.15.99:0/1543253663 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d8018a4e0 con 0x7f3d80182cb0 2024-02-21T23:02:43.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.182+0000 7f3d7fe00640 1 -- 172.21.15.99:0/1543253663 <== mon.2 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2069890144 0 0) 0x7f3d74001670 con 0x7f3d80182cb0 2024-02-21T23:02:43.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.182+0000 7f3d7fe00640 1 -- 172.21.15.99:0/1543253663 >> v1:172.21.15.181:6789/0 conn(0x7f3d80182cb0 legacy=0x7f3d800f5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:43.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.182+0000 7f3d7fe00640 1 --2- 172.21.15.99:0/1543253663 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d68004e70 0x7f3d68005270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:43.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.183+0000 7f3d7fe00640 1 --2- 172.21.15.99:0/1543253663 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3d68003970 0x7f3d68003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:43.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.183+0000 7f3d7fe00640 1 --2- 172.21.15.99:0/1543253663 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3d680099b0 0x7f3d6800bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:43.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.183+0000 7f3d7fe00640 1 -- 172.21.15.99:0/1543253663 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6800c470 con 0x7f3d680099b0 2024-02-21T23:02:43.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.183+0000 7f3d7fe00640 1 -- 172.21.15.99:0/1543253663 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6800c5f0 con 0x7f3d68004e70 2024-02-21T23:02:43.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.183+0000 7f3d7fe00640 1 -- 172.21.15.99:0/1543253663 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6800c7f0 con 0x7f3d68003970 2024-02-21T23:02:43.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.183+0000 7f3d85800640 1 --2- 172.21.15.99:0/1543253663 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d68004e70 0x7f3d68005270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:43.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.183+0000 7f3d84e00640 1 --2- 172.21.15.99:0/1543253663 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3d68003970 0x7f3d68003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:43.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.183+0000 7f3d86200640 1 --2- 172.21.15.99:0/1543253663 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3d680099b0 0x7f3d6800bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:43.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.183+0000 7f3d85800640 1 -- 172.21.15.99:0/1543253663 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3d68003970 msgr2=0x7f3d68003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:43.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.183+0000 7f3d85800640 1 --2- 172.21.15.99:0/1543253663 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3d68003970 0x7f3d68003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:43.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.183+0000 7f3d85800640 1 -- 172.21.15.99:0/1543253663 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3d680099b0 msgr2=0x7f3d6800bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:43.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.183+0000 7f3d85800640 1 --2- 172.21.15.99:0/1543253663 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3d680099b0 0x7f3d6800bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:43.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.183+0000 7f3d85800640 1 -- 172.21.15.99:0/1543253663 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d68003520 con 0x7f3d68004e70 2024-02-21T23:02:43.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.183+0000 7f3d86200640 1 --2- 172.21.15.99:0/1543253663 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3d680099b0 0x7f3d6800bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T23:02:43.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.183+0000 7f3d86200640 1 -- 172.21.15.99:0/1543253663 reap_dead start 2024-02-21T23:02:43.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.185+0000 7f3d85800640 1 --2- 172.21.15.99:0/1543253663 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d68004e70 0x7f3d68005270 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3d74007fa0 tx=0x7f3d68005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26c764493df5032d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:43.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.185+0000 7f3d7fe00640 1 -- 172.21.15.99:0/1543253663 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d74007bc0 con 0x7f3d68004e70 2024-02-21T23:02:43.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.185+0000 7f3d7fe00640 1 -- 172.21.15.99:0/1543253663 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d74030070 con 0x7f3d68004e70 2024-02-21T23:02:43.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.185+0000 7f3d7fe00640 1 -- 172.21.15.99:0/1543253663 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d74005d30 con 0x7f3d68004e70 2024-02-21T23:02:43.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.185+0000 7f3d86c00640 1 -- 172.21.15.99:0/1543253663 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d68004e70 msgr2=0x7f3d68005270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:43.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.185+0000 7f3d86c00640 1 --2- 172.21.15.99:0/1543253663 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d68004e70 0x7f3d68005270 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3d74007fa0 tx=0x7f3d68005830 comp rx=0 tx=0).stop 2024-02-21T23:02:43.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.186+0000 7f3d86c00640 1 -- 172.21.15.99:0/1543253663 shutdown_connections 2024-02-21T23:02:43.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.186+0000 7f3d86c00640 1 --2- 172.21.15.99:0/1543253663 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d68004e70 0x7f3d68005270 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:43.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.186+0000 7f3d86c00640 1 -- 172.21.15.99:0/1543253663 >> 172.21.15.99:0/1543253663 conn(0x7f3d800ce4b0 msgr2=0x7f3d800ce8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:43.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.186+0000 7f3d86c00640 1 -- 172.21.15.99:0/1543253663 shutdown_connections 2024-02-21T23:02:43.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.186+0000 7f3d86c00640 1 -- 172.21.15.99:0/1543253663 wait complete. 2024-02-21T23:02:43.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.188+0000 7f3d86c00640 1 Processor -- start 2024-02-21T23:02:43.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.188+0000 7f3d86c00640 1 -- start start 2024-02-21T23:02:43.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.189+0000 7f3d86c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3d68004e70 0x7f3d80169fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:43.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.189+0000 7f3d86c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3d8017e500 0x7f3d8017e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:43.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.189+0000 7f3d86c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d8021c240 0x7f3d8021c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:43.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.189+0000 7f3d86c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d800f67a0 con 0x7f3d68004e70 2024-02-21T23:02:43.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.189+0000 7f3d86c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d80189fb0 con 0x7f3d8021c240 2024-02-21T23:02:43.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.189+0000 7f3d86c00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8018b860 con 0x7f3d8017e500 2024-02-21T23:02:43.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.189+0000 7f3d85800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3d68004e70 0x7f3d80169fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:43.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.189+0000 7f3d84e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3d8017e500 0x7f3d8017e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:43.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.189+0000 7f3d84e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3d8017e500 0x7f3d8017e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:51496/0 (socket says 172.21.15.99:51496) 2024-02-21T23:02:43.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.189+0000 7f3d85800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3d68004e70 0x7f3d80169fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59356/0 (socket says 172.21.15.99:59356) 2024-02-21T23:02:43.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.189+0000 7f3d84e00640 1 -- 172.21.15.99:0/1000979435 learned_addr learned my addr 172.21.15.99:0/1000979435 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:43.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.190+0000 7f3d86200640 1 --2- 172.21.15.99:0/1000979435 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d8021c240 0x7f3d8021c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:43.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.190+0000 7f3d84e00640 1 -- 172.21.15.99:0/1000979435 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d8021c240 msgr2=0x7f3d8021c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:43.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.190+0000 7f3d84e00640 1 --2- 172.21.15.99:0/1000979435 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d8021c240 0x7f3d8021c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:43.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.190+0000 7f3d84e00640 1 -- 172.21.15.99:0/1000979435 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3d68004e70 msgr2=0x7f3d80169fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:43.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.190+0000 7f3d84e00640 1 --2- 172.21.15.99:0/1000979435 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3d68004e70 0x7f3d80169fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:43.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.190+0000 7f3d84e00640 1 -- 172.21.15.99:0/1000979435 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d8016a510 con 0x7f3d8017e500 2024-02-21T23:02:43.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.190+0000 7f3d84e00640 1 --2- 172.21.15.99:0/1000979435 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3d8017e500 0x7f3d8017e980 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c0015b0 tx=0x7f3d6c001a70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:43.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.191+0000 7f3d7d600640 1 -- 172.21.15.99:0/1000979435 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d6c00f7b0 con 0x7f3d8017e500 2024-02-21T23:02:43.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.191+0000 7f3d7d600640 1 -- 172.21.15.99:0/1000979435 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d6c018070 con 0x7f3d8017e500 2024-02-21T23:02:43.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.191+0000 7f3d86c00640 1 -- 172.21.15.99:0/1000979435 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d8017f020 con 0x7f3d8017e500 2024-02-21T23:02:43.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.191+0000 7f3d7d600640 1 -- 172.21.15.99:0/1000979435 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d6c00fb50 con 0x7f3d8017e500 2024-02-21T23:02:43.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.191+0000 7f3d86c00640 1 -- 172.21.15.99:0/1000979435 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d8017f5e0 con 0x7f3d8017e500 2024-02-21T23:02:43.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.196+0000 7f3d7d600640 1 -- 172.21.15.99:0/1000979435 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 12) v1 ==== 134532+0+0 (secure 0 0 0) 0x7f3d6c00fcf0 con 0x7f3d8017e500 2024-02-21T23:02:43.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.197+0000 7f3d8b227740 1 Processor -- start 2024-02-21T23:02:43.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.197+0000 7f3d8b227740 1 -- start start 2024-02-21T23:02:43.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.198+0000 7f3d7d600640 1 --2- 172.21.15.99:0/1000979435 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f3d6009ef60 0x7f3d600a1420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:43.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.198+0000 7f3d7d600640 1 -- 172.21.15.99:0/1000979435 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f3d6c0c9e50 con 0x7f3d8017e500 2024-02-21T23:02:43.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.198+0000 7f3d8b227740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55606df3c2a0 0x55606df71d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:43.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.198+0000 7f3d8b227740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55606df72260 0x55606df3c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:43.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.198+0000 7f3d8b227740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55606df3cbc0 0x55606deff1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:43.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.198+0000 7f3d8b227740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55606de68a90 con 0x55606df3cbc0 2024-02-21T23:02:43.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.198+0000 7f3d8b227740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55606de11b10 con 0x55606df3c2a0 2024-02-21T23:02:43.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.198+0000 7f3d8b227740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55606de64b30 con 0x55606df72260 2024-02-21T23:02:43.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.198+0000 7f3d86200640 1 --2- 172.21.15.99:0/1000979435 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f3d6009ef60 0x7f3d600a1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:43.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.199+0000 7f3d85800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55606df3c2a0 0x55606df71d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:43.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.199+0000 7f3d85800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55606df3c2a0 0x55606df71d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:38668/0 (socket says 172.21.15.99:38668) 2024-02-21T23:02:43.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.199+0000 7f3d85800640 1 -- 172.21.15.99:0/2709769852 learned_addr learned my addr 172.21.15.99:0/2709769852 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:43.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.199+0000 7f3d84e00640 1 --2- 172.21.15.99:0/2709769852 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55606df72260 0x55606df3c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:43.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.199+0000 7f3d85800640 1 -- 172.21.15.99:0/2709769852 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55606df72260 msgr2=0x55606df3c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:43.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.199+0000 7f3d85800640 1 --2- 172.21.15.99:0/2709769852 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55606df72260 0x55606df3c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:43.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.199+0000 7f3d85800640 1 -- 172.21.15.99:0/2709769852 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55606df3cbc0 msgr2=0x55606deff1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:43.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.199+0000 7f3d85800640 1 --2- 172.21.15.99:0/2709769852 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55606df3cbc0 0x55606deff1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:43.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.199+0000 7f3d85800640 1 -- 172.21.15.99:0/2709769852 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55606dc477d0 con 0x55606df3c2a0 2024-02-21T23:02:43.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.199+0000 7f3d84e00640 1 --2- 172.21.15.99:0/2709769852 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55606df72260 0x55606df3c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:02:43.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.199+0000 7f3d85800640 1 --2- 172.21.15.99:0/2709769852 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55606df3c2a0 0x55606df71d20 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3d7400c1a0 tx=0x7f3d7402e000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea2e799279a8de32 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:43.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.200+0000 7f3d86200640 1 --2- 172.21.15.99:0/1000979435 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f3d6009ef60 0x7f3d600a1420 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3d80186900 tx=0x7f3d78010640 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:43.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.200+0000 7f3d72000640 1 -- 172.21.15.99:0/2709769852 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d74047070 con 0x55606df3c2a0 2024-02-21T23:02:43.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.200+0000 7f3d72000640 1 -- 172.21.15.99:0/2709769852 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d74030030 con 0x55606df3c2a0 2024-02-21T23:02:43.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.200+0000 7f3d72000640 1 -- 172.21.15.99:0/2709769852 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d740049e0 con 0x55606df3c2a0 2024-02-21T23:02:43.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.200+0000 7f3d8b227740 1 -- 172.21.15.99:0/2709769852 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55606df3c2a0 msgr2=0x55606df71d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:43.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.200+0000 7f3d8b227740 1 --2- 172.21.15.99:0/2709769852 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55606df3c2a0 0x55606df71d20 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3d7400c1a0 tx=0x7f3d7402e000 comp rx=0 tx=0).stop 2024-02-21T23:02:43.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.201+0000 7f3d8b227740 1 -- 172.21.15.99:0/2709769852 shutdown_connections 2024-02-21T23:02:43.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.201+0000 7f3d8b227740 1 --2- 172.21.15.99:0/2709769852 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55606df3cbc0 0x55606deff1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:43.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.201+0000 7f3d8b227740 1 --2- 172.21.15.99:0/2709769852 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55606df72260 0x55606df3c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:43.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.201+0000 7f3d8b227740 1 --2- 172.21.15.99:0/2709769852 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55606df3c2a0 0x55606df71d20 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:43.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.201+0000 7f3d8b227740 1 -- 172.21.15.99:0/2709769852 >> 172.21.15.99:0/2709769852 conn(0x55606decb6b0 msgr2=0x55606df03190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:43.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.201+0000 7f3d8b227740 1 -- 172.21.15.99:0/2709769852 shutdown_connections 2024-02-21T23:02:43.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.201+0000 7f3d8b227740 1 -- 172.21.15.99:0/2709769852 wait complete. 2024-02-21T23:02:43.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.202+0000 7f3d8b227740 1 -- start start 2024-02-21T23:02:43.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.202+0000 7f3d8b227740 1 Processor -- start 2024-02-21T23:02:43.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.203+0000 7f3d8b227740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55606df3c2a0 0x55606df77170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:43.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.203+0000 7f3d8b227740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55606df3cbc0 0x55606df83b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:43.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.203+0000 7f3d8b227740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55606df72260 0x55606df31940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:43.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.203+0000 7f3d8b227740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55606df0af30 con 0x55606df72260 2024-02-21T23:02:43.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.203+0000 7f3d8b227740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55606de071c0 con 0x55606df3cbc0 2024-02-21T23:02:43.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.203+0000 7f3d8b227740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55606df73930 con 0x55606df3c2a0 2024-02-21T23:02:43.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.203+0000 7f3d8b227740 10 client.0 _ll_register_callbacks cb 0x55606de24930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:02:43.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.203+0000 7f3d85800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55606df3c2a0 0x55606df77170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:43.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.203+0000 7f3d85800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55606df3c2a0 0x55606df77170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:51516/0 (socket says 172.21.15.99:51516) 2024-02-21T23:02:43.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.203+0000 7f3d85800640 1 -- 172.21.15.99:0/1633736144 learned_addr learned my addr 172.21.15.99:0/1633736144 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:43.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.203+0000 7f3d86200640 1 --2- 172.21.15.99:0/1633736144 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55606df72260 0x55606df31940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:43.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.204+0000 7f3d84e00640 1 --2- 172.21.15.99:0/1633736144 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55606df3cbc0 0x55606df83b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:43.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.204+0000 7f3d85800640 1 -- 172.21.15.99:0/1633736144 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55606df3cbc0 msgr2=0x55606df83b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:43.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.204+0000 7f3d85800640 1 --2- 172.21.15.99:0/1633736144 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55606df3cbc0 0x55606df83b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:43.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.204+0000 7f3d85800640 1 -- 172.21.15.99:0/1633736144 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55606df72260 msgr2=0x55606df31940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:43.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.204+0000 7f3d85800640 1 --2- 172.21.15.99:0/1633736144 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55606df72260 0x55606df31940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:43.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.204+0000 7f3d85800640 1 -- 172.21.15.99:0/1633736144 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55606db7d3f0 con 0x55606df3c2a0 2024-02-21T23:02:43.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.204+0000 7f3d86200640 1 --2- 172.21.15.99:0/1633736144 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55606df72260 0x55606df31940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:02:43.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.205+0000 7f3d85800640 1 --2- 172.21.15.99:0/1633736144 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55606df3c2a0 0x55606df77170 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3d740010e0 tx=0x7f3d800cd440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34b123cae085f307 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:43.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.205+0000 7f3d66a00640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-02-21T23:02:43.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.205+0000 7f3d66a00640 1 -- 172.21.15.99:0/1633736144 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d74051060 con 0x55606df3c2a0 2024-02-21T23:02:43.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.205+0000 7f3d66a00640 1 -- 172.21.15.99:0/1633736144 <== mon.2 v2:172.21.15.181:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f3d74007070 con 0x55606df3c2a0 2024-02-21T23:02:43.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.205+0000 7f3d8b227740 1 -- 172.21.15.99:0/1633736144 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3d74030030 con 0x55606df3c2a0 2024-02-21T23:02:43.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.205+0000 7f3d66a00640 1 -- 172.21.15.99:0/1633736144 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3d74058050 con 0x55606df3c2a0 2024-02-21T23:02:43.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.205+0000 7f3d8b227740 10 client.5318 fetch_fsmap learned FSMap version 15 2024-02-21T23:02:43.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.205+0000 7f3d8b227740 1 -- 172.21.15.99:0/1633736144 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x55606db3d0f0 con 0x55606df3c2a0 2024-02-21T23:02:43.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.206+0000 7f3d66a00640 1 -- 172.21.15.99:0/1633736144 <== mon.2 v2:172.21.15.181:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d74030030 con 0x55606df3c2a0 2024-02-21T23:02:43.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.206+0000 7f3d66a00640 1 -- 172.21.15.99:0/1633736144 <== mon.2 v2:172.21.15.181:3300/0 5 ==== fsmap(e 15) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f3d74007270 con 0x55606df3c2a0 2024-02-21T23:02:43.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.206+0000 7f3d8b227740 10 client.5318 fetch_fsmap finished waiting for FSMap version 15 2024-02-21T23:02:43.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.206+0000 7f3d8b227740 10 client.5318 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:02:43.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.206+0000 7f3d8b227740 20 client.5318 populate_metadata read hostname 'smithi099' 2024-02-21T23:02:43.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.206+0000 7f3d8b227740 1 --2- 172.21.15.99:0/1633736144 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55606df34a80 0x55606df44450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:43.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.206+0000 7f3d8b227740 4 client.5318 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:02:43.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.206+0000 7f3d8b227740 1 -- 172.21.15.99:0/1633736144 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55606de75fd0 con 0x55606df34a80 2024-02-21T23:02:43.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.206+0000 7f3d84e00640 1 --2- 172.21.15.99:0/1633736144 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55606df34a80 0x55606df44450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:43.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.207+0000 7f3d84e00640 1 --2- 172.21.15.99:0/1633736144 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55606df34a80 0x55606df44450 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=30aae10d028f69fa server_cookie=5b3c3f1233b3e2a in_seq=0 out_seq=0 2024-02-21T23:02:43.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.207+0000 7f3d66a00640 10 client.5318 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:02:43.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.208+0000 7f3d66a00640 1 -- 172.21.15.99:0/1633736144 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55606de75fd0 con 0x55606df34a80 2024-02-21T23:02:43.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.208+0000 7f3d66a00640 10 client.5318 handle_command_reply: tid=0 2024-02-21T23:02:43.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.208+0000 7f3d8b227740 1 client.5318 shutdown 2024-02-21T23:02:43.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.208+0000 7f3d8b227740 1 -- 172.21.15.99:0/1633736144 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55606df3c2a0 msgr2=0x55606df77170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:43.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.208+0000 7f3d8b227740 1 --2- 172.21.15.99:0/1633736144 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55606df3c2a0 0x55606df77170 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3d740010e0 tx=0x7f3d800cd440 comp rx=0 tx=0).stop 2024-02-21T23:02:43.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.208+0000 7f3d8b227740 1 -- 172.21.15.99:0/1633736144 shutdown_connections 2024-02-21T23:02:43.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.208+0000 7f3d8b227740 1 --2- 172.21.15.99:0/1633736144 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55606df34a80 0x55606df44450 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:43.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.208+0000 7f3d8b227740 1 --2- 172.21.15.99:0/1633736144 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55606df72260 0x55606df31940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:43.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.208+0000 7f3d8b227740 1 --2- 172.21.15.99:0/1633736144 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55606df3cbc0 0x55606df83b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:43.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.208+0000 7f3d8b227740 1 --2- 172.21.15.99:0/1633736144 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55606df3c2a0 0x55606df77170 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:43.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.208+0000 7f3d66a00640 0 client.5318 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:02:43.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.208+0000 7f3d8b227740 1 -- 172.21.15.99:0/1633736144 >> 172.21.15.99:0/1633736144 conn(0x55606decb6b0 msgr2=0x55606df71b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:43.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.208+0000 7f3d8b227740 1 -- 172.21.15.99:0/1633736144 shutdown_connections 2024-02-21T23:02:43.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.208+0000 7f3d8b227740 1 -- 172.21.15.99:0/1633736144 wait complete. 2024-02-21T23:02:43.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.208+0000 7f3d8b227740 20 client.5318 trim_cache size 0 max 16384 2024-02-21T23:02:43.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.231+0000 7f3d8b227740 1 Processor -- start 2024-02-21T23:02:43.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.231+0000 7f3d8b227740 1 -- start start 2024-02-21T23:02:43.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.233+0000 7f3d8b227740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55606df3c2a0 0x55606df02110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:43.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.233+0000 7f3d8b227740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55606df3cbc0 0x55606dfd5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:43.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.233+0000 7f3d8b227740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55606df72260 0x55606dfd6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:43.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.233+0000 7f3d8b227740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d80228bd0 con 0x55606df3c2a0 2024-02-21T23:02:43.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.233+0000 7f3d8b227740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d80226770 con 0x55606df72260 2024-02-21T23:02:43.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.233+0000 7f3d8b227740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d80224980 con 0x55606df3cbc0 2024-02-21T23:02:43.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.234+0000 7f3d85800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55606df3c2a0 0x55606df02110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:43.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.234+0000 7f3d85800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55606df3c2a0 0x55606df02110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59384/0 (socket says 172.21.15.99:59384) 2024-02-21T23:02:43.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.234+0000 7f3d85800640 1 -- 172.21.15.99:0/372192844 learned_addr learned my addr 172.21.15.99:0/372192844 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:43.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.234+0000 7f3d84e00640 1 --2- 172.21.15.99:0/372192844 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55606df3cbc0 0x55606dfd5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:43.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.234+0000 7f3d86200640 1 --2- 172.21.15.99:0/372192844 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55606df72260 0x55606dfd6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:43.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.234+0000 7f3d84e00640 1 -- 172.21.15.99:0/372192844 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55606df72260 msgr2=0x55606dfd6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:43.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.234+0000 7f3d84e00640 1 --2- 172.21.15.99:0/372192844 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55606df72260 0x55606dfd6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:43.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.234+0000 7f3d84e00640 1 -- 172.21.15.99:0/372192844 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55606df3c2a0 msgr2=0x55606df02110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:43.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.234+0000 7f3d84e00640 1 --2- 172.21.15.99:0/372192844 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55606df3c2a0 0x55606df02110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:43.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.234+0000 7f3d84e00640 1 -- 172.21.15.99:0/372192844 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55606df3c7b0 con 0x55606df3cbc0 2024-02-21T23:02:43.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.235+0000 7f3d84e00640 1 --2- 172.21.15.99:0/372192844 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55606df3cbc0 0x55606dfd5ac0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c0c74e0 tx=0x7f3d6c007ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2221bb5ba0a0a142 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:43.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.235+0000 7f3d71600640 1 -- 172.21.15.99:0/372192844 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d6c09b730 con 0x55606df3cbc0 2024-02-21T23:02:43.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.235+0000 7f3d71600640 1 -- 172.21.15.99:0/372192844 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d6c09fd80 con 0x55606df3cbc0 2024-02-21T23:02:43.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.235+0000 7f3d71600640 1 -- 172.21.15.99:0/372192844 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d6c0958e0 con 0x55606df3cbc0 2024-02-21T23:02:43.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.236+0000 7f3d8b227740 1 -- 172.21.15.99:0/372192844 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55606df3cbc0 msgr2=0x55606dfd5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:43.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.236+0000 7f3d8b227740 1 --2- 172.21.15.99:0/372192844 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55606df3cbc0 0x55606dfd5ac0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c0c74e0 tx=0x7f3d6c007ef0 comp rx=0 tx=0).stop 2024-02-21T23:02:43.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.236+0000 7f3d8b227740 1 -- 172.21.15.99:0/372192844 shutdown_connections 2024-02-21T23:02:43.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.236+0000 7f3d8b227740 1 --2- 172.21.15.99:0/372192844 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55606df72260 0x55606dfd6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:43.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.236+0000 7f3d8b227740 1 --2- 172.21.15.99:0/372192844 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55606df3cbc0 0x55606dfd5ac0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:43.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.236+0000 7f3d8b227740 1 --2- 172.21.15.99:0/372192844 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55606df3c2a0 0x55606df02110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:43.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.236+0000 7f3d8b227740 1 -- 172.21.15.99:0/372192844 >> 172.21.15.99:0/372192844 conn(0x55606decb6b0 msgr2=0x55606df0a800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:43.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.236+0000 7f3d8b227740 1 -- 172.21.15.99:0/372192844 shutdown_connections 2024-02-21T23:02:43.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.236+0000 7f3d8b227740 1 -- 172.21.15.99:0/372192844 wait complete. 2024-02-21T23:02:43.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.237+0000 7f3d8b227740 1 -- start start 2024-02-21T23:02:43.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.237+0000 7f3d8b227740 1 Processor -- start 2024-02-21T23:02:43.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.239+0000 7f3d8b227740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55606df3c2a0 0x55606df71bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:43.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.240+0000 7f3d8b227740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55606df3cbc0 0x55606dfe5860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:43.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.240+0000 7f3d8b227740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55606df72260 0x55606df331a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:43.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.240+0000 7f3d8b227740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d80224f30 con 0x55606df72260 2024-02-21T23:02:43.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.240+0000 7f3d8b227740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d80226130 con 0x55606df3cbc0 2024-02-21T23:02:43.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.240+0000 7f3d8b227740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d80225530 con 0x55606df3c2a0 2024-02-21T23:02:43.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.240+0000 7f3d8b227740 10 client.0 _ll_register_callbacks cb 0x7f3d74007e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:02:43.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.240+0000 7f3d86200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55606df72260 0x55606df331a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:43.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.240+0000 7f3d86200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55606df72260 0x55606df331a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59394/0 (socket says 172.21.15.99:59394) 2024-02-21T23:02:43.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.240+0000 7f3d85800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55606df3c2a0 0x55606df71bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:43.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.240+0000 7f3d86200640 1 -- 172.21.15.99:0/2166505723 learned_addr learned my addr 172.21.15.99:0/2166505723 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:43.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.240+0000 7f3d84e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55606df3cbc0 0x55606dfe5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:43.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.240+0000 7f3d85800640 1 -- 172.21.15.99:0/2166505723 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55606df3cbc0 msgr2=0x55606dfe5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:43.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.240+0000 7f3d85800640 1 --2- 172.21.15.99:0/2166505723 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55606df3cbc0 0x55606dfe5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:43.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.240+0000 7f3d85800640 1 -- 172.21.15.99:0/2166505723 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55606df72260 msgr2=0x55606df331a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:43.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.240+0000 7f3d85800640 1 --2- 172.21.15.99:0/2166505723 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55606df72260 0x55606df331a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:43.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.240+0000 7f3d85800640 1 -- 172.21.15.99:0/2166505723 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55606dfe5da0 con 0x55606df3c2a0 2024-02-21T23:02:43.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.241+0000 7f3d85800640 1 --2- 172.21.15.99:0/2166505723 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55606df3c2a0 0x55606df71bd0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3d74007c50 tx=0x7f3d74007000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a2b7e13f21862ee server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:43.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.241+0000 7f3d66a00640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-02-21T23:02:43.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.241+0000 7f3d66a00640 1 -- 172.21.15.99:0/2166505723 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d74051040 con 0x55606df3c2a0 2024-02-21T23:02:43.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.241+0000 7f3d66a00640 1 -- 172.21.15.99:0/2166505723 <== mon.2 v2:172.21.15.181:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f3d74007270 con 0x55606df3c2a0 2024-02-21T23:02:43.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.241+0000 7f3d8b227740 1 -- 172.21.15.99:0/2166505723 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3d6c09fd80 con 0x55606df3c2a0 2024-02-21T23:02:43.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.241+0000 7f3d66a00640 1 -- 172.21.15.99:0/2166505723 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3d74047070 con 0x55606df3c2a0 2024-02-21T23:02:43.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.241+0000 7f3d8b227740 10 client.5324 fetch_fsmap learned FSMap version 15 2024-02-21T23:02:43.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.241+0000 7f3d8b227740 1 -- 172.21.15.99:0/2166505723 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x55606df743f0 con 0x55606df3c2a0 2024-02-21T23:02:43.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.242+0000 7f3d66a00640 1 -- 172.21.15.99:0/2166505723 <== mon.2 v2:172.21.15.181:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d6c09fd80 con 0x55606df3c2a0 2024-02-21T23:02:43.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.242+0000 7f3d66a00640 1 -- 172.21.15.99:0/2166505723 <== mon.2 v2:172.21.15.181:3300/0 5 ==== fsmap(e 15) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f3d7404c440 con 0x55606df3c2a0 2024-02-21T23:02:43.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.242+0000 7f3d8b227740 10 client.5324 fetch_fsmap finished waiting for FSMap version 15 2024-02-21T23:02:43.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.242+0000 7f3d8b227740 10 client.5324 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:02:43.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.242+0000 7f3d8b227740 20 client.5324 populate_metadata read hostname 'smithi099' 2024-02-21T23:02:43.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.242+0000 7f3d8b227740 1 --2- 172.21.15.99:0/2166505723 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55606dfe1ca0 0x55606dfcef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:43.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.242+0000 7f3d8b227740 4 client.5324 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T23:02:43.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.242+0000 7f3d8b227740 1 -- 172.21.15.99:0/2166505723 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55606df34330 con 0x55606dfe1ca0 2024-02-21T23:02:43.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.242+0000 7f3d84e00640 1 --2- 172.21.15.99:0/2166505723 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55606dfe1ca0 0x55606dfcef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:43.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.243+0000 7f3d66a00640 10 client.5324 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:02:43.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.243+0000 7f3d84e00640 1 --2- 172.21.15.99:0/2166505723 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55606dfe1ca0 0x55606dfcef20 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed8b5a24796c81d9 server_cookie=909e5a3455f15090 in_seq=0 out_seq=0 2024-02-21T23:02:43.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.243+0000 7f3d66a00640 1 -- 172.21.15.99:0/2166505723 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55606df34330 con 0x55606dfe1ca0 2024-02-21T23:02:43.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.243+0000 7f3d66a00640 10 client.5324 handle_command_reply: tid=0 2024-02-21T23:02:43.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.243+0000 7f3d8b227740 1 client.5324 shutdown 2024-02-21T23:02:43.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.243+0000 7f3d8b227740 1 -- 172.21.15.99:0/2166505723 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55606df3c2a0 msgr2=0x55606df71bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:43.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.243+0000 7f3d8b227740 1 --2- 172.21.15.99:0/2166505723 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55606df3c2a0 0x55606df71bd0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3d74007c50 tx=0x7f3d74007000 comp rx=0 tx=0).stop 2024-02-21T23:02:43.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.244+0000 7f3d8b227740 1 -- 172.21.15.99:0/2166505723 shutdown_connections 2024-02-21T23:02:43.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.244+0000 7f3d8b227740 1 --2- 172.21.15.99:0/2166505723 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55606dfe1ca0 0x55606dfcef20 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:43.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.244+0000 7f3d8b227740 1 --2- 172.21.15.99:0/2166505723 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55606df72260 0x55606df331a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:43.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.244+0000 7f3d8b227740 1 --2- 172.21.15.99:0/2166505723 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55606df3cbc0 0x55606dfe5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:43.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.244+0000 7f3d66a00640 0 client.5324 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:02:43.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.244+0000 7f3d8b227740 1 --2- 172.21.15.99:0/2166505723 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55606df3c2a0 0x55606df71bd0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:43.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.244+0000 7f3d8b227740 1 -- 172.21.15.99:0/2166505723 >> 172.21.15.99:0/2166505723 conn(0x55606decb6b0 msgr2=0x55606df00940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:43.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.244+0000 7f3d8b227740 1 -- 172.21.15.99:0/2166505723 shutdown_connections 2024-02-21T23:02:43.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.244+0000 7f3d8b227740 1 -- 172.21.15.99:0/2166505723 wait complete. 2024-02-21T23:02:43.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.244+0000 7f3d8b227740 20 client.5324 trim_cache size 0 max 16384 2024-02-21T23:02:43.236 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-02-21T23:02:43.236 INFO:teuthology.orchestra.run.smithi099.stdout: "status": "no active scrubs running", 2024-02-21T23:02:43.236 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubs": {} 2024-02-21T23:02:43.236 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-02-21T23:02:43.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.245+0000 7f3d86c00640 1 -- 172.21.15.99:0/1000979435 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f3d6009ef60 msgr2=0x7f3d600a1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:43.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.245+0000 7f3d86c00640 1 --2- 172.21.15.99:0/1000979435 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f3d6009ef60 0x7f3d600a1420 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3d80186900 tx=0x7f3d78010640 comp rx=0 tx=0).stop 2024-02-21T23:02:43.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.245+0000 7f3d86c00640 1 -- 172.21.15.99:0/1000979435 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3d8017e500 msgr2=0x7f3d8017e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:43.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.245+0000 7f3d86c00640 1 --2- 172.21.15.99:0/1000979435 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3d8017e500 0x7f3d8017e980 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c0015b0 tx=0x7f3d6c001a70 comp rx=0 tx=0).stop 2024-02-21T23:02:43.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.245+0000 7f3d86c00640 1 -- 172.21.15.99:0/1000979435 shutdown_connections 2024-02-21T23:02:43.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.245+0000 7f3d86c00640 1 --2- 172.21.15.99:0/1000979435 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f3d6009ef60 0x7f3d600a1420 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:43.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.245+0000 7f3d86c00640 1 --2- 172.21.15.99:0/1000979435 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d8021c240 0x7f3d8021c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:43.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.245+0000 7f3d86c00640 1 --2- 172.21.15.99:0/1000979435 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3d8017e500 0x7f3d8017e980 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:43.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.245+0000 7f3d86c00640 1 --2- 172.21.15.99:0/1000979435 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3d68004e70 0x7f3d80169fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:43.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.245+0000 7f3d86c00640 1 -- 172.21.15.99:0/1000979435 >> 172.21.15.99:0/1000979435 conn(0x7f3d800ce4b0 msgr2=0x7f3d800cdb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:43.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.245+0000 7f3d86c00640 1 -- 172.21.15.99:0/1000979435 shutdown_connections 2024-02-21T23:02:43.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.245+0000 7f3d86c00640 1 -- 172.21.15.99:0/1000979435 wait complete. 2024-02-21T23:02:43.252 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-02-21T23:02:43.252 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T23:02:43.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.461+0000 7f1bcec00640 1 Processor -- start 2024-02-21T23:02:43.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.462+0000 7f1bcec00640 1 -- start start 2024-02-21T23:02:43.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.464+0000 7f1bcec00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f1bc80f0fc0 0x7f1bc80f1450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:43.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.464+0000 7f1bcec00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bc8182ae0 con 0x7f1bc80f5d90 2024-02-21T23:02:43.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.464+0000 7f1bcec00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bc80d12f0 con 0x7f1bc8182700 2024-02-21T23:02:43.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.464+0000 7f1bcec00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bc8185e60 con 0x7f1bc80f0fc0 2024-02-21T23:02:43.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.464+0000 7f1bce200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f1bc80f0fc0 0x7f1bc80f1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:43.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.464+0000 7f1bcd800640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f1bc8182700 0x7f1bc80cff40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:42096/0 (socket says 172.21.15.99:42096) 2024-02-21T23:02:43.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.464+0000 7f1bcd800640 1 -- 172.21.15.99:0/1452025374 learned_addr learned my addr 172.21.15.99:0/1452025374 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:02:43.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.465+0000 7f1bc7e00640 1 -- 172.21.15.99:0/1452025374 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 381052860 0 0) 0x7f1bc80d12f0 con 0x7f1bc8182700 2024-02-21T23:02:43.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.465+0000 7f1bce200640 1 -- 172.21.15.99:0/1452025374 >> v1:172.21.15.181:6789/0 conn(0x7f1bc8182700 legacy=0x7f1bc80cff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:43.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.465+0000 7f1bce200640 1 -- 172.21.15.99:0/1452025374 >> v1:172.21.15.162:6789/0 conn(0x7f1bc80f5d90 legacy=0x7f1bc80d0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:43.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.465+0000 7f1bce200640 1 -- 172.21.15.99:0/1452025374 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bc80f4a10 con 0x7f1bc80f0fc0 2024-02-21T23:02:43.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.466+0000 7f1bce200640 1 --2- 172.21.15.99:0/1452025374 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1bc80f0fc0 0x7f1bc80f1450 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f1bc0009d90 tx=0x7f1bc002de70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f76fc1c53679e389 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:43.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.467+0000 7f1bc7e00640 1 -- 172.21.15.99:0/1452025374 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc003b070 con 0x7f1bc80f0fc0 2024-02-21T23:02:43.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.467+0000 7f1bc7e00640 1 -- 172.21.15.99:0/1452025374 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bc002eba0 con 0x7f1bc80f0fc0 2024-02-21T23:02:43.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.467+0000 7f1bc7e00640 1 -- 172.21.15.99:0/1452025374 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc0036440 con 0x7f1bc80f0fc0 2024-02-21T23:02:43.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.467+0000 7f1bcec00640 1 -- 172.21.15.99:0/1452025374 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1bc80f0fc0 msgr2=0x7f1bc80f1450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:43.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.467+0000 7f1bcec00640 1 --2- 172.21.15.99:0/1452025374 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1bc80f0fc0 0x7f1bc80f1450 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f1bc0009d90 tx=0x7f1bc002de70 comp rx=0 tx=0).stop 2024-02-21T23:02:43.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.468+0000 7f1bcec00640 1 -- 172.21.15.99:0/1452025374 shutdown_connections 2024-02-21T23:02:43.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.468+0000 7f1bcec00640 1 --2- 172.21.15.99:0/1452025374 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1bc80f0fc0 0x7f1bc80f1450 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:43.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.468+0000 7f1bcec00640 1 -- 172.21.15.99:0/1452025374 >> 172.21.15.99:0/1452025374 conn(0x7f1bc80ce3c0 msgr2=0x7f1bc80ce7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:43.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.468+0000 7f1bcec00640 1 -- 172.21.15.99:0/1452025374 shutdown_connections 2024-02-21T23:02:43.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.468+0000 7f1bcec00640 1 -- 172.21.15.99:0/1452025374 wait complete. 2024-02-21T23:02:43.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.470+0000 7f1bcec00640 1 Processor -- start 2024-02-21T23:02:43.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.470+0000 7f1bcec00640 1 -- start start 2024-02-21T23:02:43.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.471+0000 7f1bcec00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1bc80f0fc0 0x7f1bc80cce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:43.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.471+0000 7f1bcec00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1bc80f5d90 0x7f1bc8169200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:43.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.471+0000 7f1bcec00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1bc8182700 0x7f1bc80d0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:43.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.471+0000 7f1bcec00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc80f4fd0 con 0x7f1bc8182700 2024-02-21T23:02:43.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.471+0000 7f1bcec00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc80f5900 con 0x7f1bc80f0fc0 2024-02-21T23:02:43.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.471+0000 7f1bcec00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc80f52b0 con 0x7f1bc80f5d90 2024-02-21T23:02:43.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.471+0000 7f1bcd800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1bc80f0fc0 0x7f1bc80cce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:43.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.471+0000 7f1bce200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1bc8182700 0x7f1bc80d0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:43.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.471+0000 7f1bcd800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1bc80f0fc0 0x7f1bc80cce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:38694/0 (socket says 172.21.15.99:38694) 2024-02-21T23:02:43.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.471+0000 7f1bcd800640 1 -- 172.21.15.99:0/2100580712 learned_addr learned my addr 172.21.15.99:0/2100580712 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:43.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.471+0000 7f1bcce00640 1 --2- 172.21.15.99:0/2100580712 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1bc80f5d90 0x7f1bc8169200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:43.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.472+0000 7f1bcd800640 1 -- 172.21.15.99:0/2100580712 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1bc80f5d90 msgr2=0x7f1bc8169200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:43.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.472+0000 7f1bcd800640 1 --2- 172.21.15.99:0/2100580712 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1bc80f5d90 0x7f1bc8169200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:43.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.472+0000 7f1bcd800640 1 -- 172.21.15.99:0/2100580712 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1bc8182700 msgr2=0x7f1bc80d0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:43.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.472+0000 7f1bcd800640 1 --2- 172.21.15.99:0/2100580712 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1bc8182700 0x7f1bc80d0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:43.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.472+0000 7f1bcd800640 1 -- 172.21.15.99:0/2100580712 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bc80ce190 con 0x7f1bc80f0fc0 2024-02-21T23:02:43.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.472+0000 7f1bcd800640 1 --2- 172.21.15.99:0/2100580712 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1bc80f0fc0 0x7f1bc80cce40 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc00c4a0 tx=0x7f1bbc00c960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:43.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.472+0000 7f1bc5600640 1 -- 172.21.15.99:0/2100580712 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bbc018070 con 0x7f1bc80f0fc0 2024-02-21T23:02:43.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.473+0000 7f1bc5600640 1 -- 172.21.15.99:0/2100580712 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bbc0074e0 con 0x7f1bc80f0fc0 2024-02-21T23:02:43.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.473+0000 7f1bcec00640 1 -- 172.21.15.99:0/2100580712 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bc80cd380 con 0x7f1bc80f0fc0 2024-02-21T23:02:43.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.473+0000 7f1bc5600640 1 -- 172.21.15.99:0/2100580712 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bbc004a20 con 0x7f1bc80f0fc0 2024-02-21T23:02:43.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.473+0000 7f1bcec00640 1 -- 172.21.15.99:0/2100580712 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bc80cd610 con 0x7f1bc80f0fc0 2024-02-21T23:02:43.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.474+0000 7f1bcec00640 1 -- 172.21.15.99:0/2100580712 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bc80cd950 con 0x7f1bc80f0fc0 2024-02-21T23:02:43.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.477+0000 7f1bc5600640 1 -- 172.21.15.99:0/2100580712 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 12) v1 ==== 134532+0+0 (secure 0 0 0) 0x7f1bbc01b070 con 0x7f1bc80f0fc0 2024-02-21T23:02:43.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.479+0000 7f1bc5600640 1 --2- 172.21.15.99:0/2100580712 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f1ba809ef60 0x7f1ba80a1420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:43.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.479+0000 7f1bc5600640 1 -- 172.21.15.99:0/2100580712 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f1bbc0c9250 con 0x7f1bc80f0fc0 2024-02-21T23:02:43.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.479+0000 7f1bcce00640 1 --2- 172.21.15.99:0/2100580712 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f1ba809ef60 0x7f1ba80a1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:43.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.480+0000 7f1bcce00640 1 --2- 172.21.15.99:0/2100580712 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f1ba809ef60 0x7f1ba80a1420 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1bc80736f0 tx=0x7f1bb4009040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:43.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.480+0000 7f1bc5600640 1 -- 172.21.15.99:0/2100580712 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f1bc80cd950 con 0x7f1bc80f0fc0 2024-02-21T23:02:43.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.808+0000 7f1bcec00640 1 -- 172.21.15.99:0/2100580712 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1bc8068320 con 0x7f1bc80f0fc0 2024-02-21T23:02:43.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.810+0000 7f1bc5600640 1 -- 172.21.15.99:0/2100580712 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+11335 (secure 0 0 0) 0x7f1bbc096ad0 con 0x7f1bc80f0fc0 2024-02-21T23:02:43.799 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T23:02:43.799 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4307,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/3514452812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3514452812},{"type":"v1","addr":"172.21.15.162:6836","nonce":3514452812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4312,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6838/2169982089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":2169982089},{"type":"v1","addr":"172.21.15.162:6838","nonce":2169982089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4315,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6839/3335972724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6837","nonce":3335972724},{"type":"v1","addr":"172.21.15.162:6839","nonce":3335972724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4318,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6841/2135456697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6840","nonce":2135456697},{"type":"v1","addr":"172.21.15.162:6841","nonce":2135456697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4325,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2452242758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2452242758},{"type":"v1","addr":"172.21.15.181:6833","nonce":2452242758}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4328,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6836/2751486400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":2751486400},{"type":"v1","addr":"172.21.15.181:6836","nonce":2751486400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":15,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-21T23:01:02.656130+0000","modified":"2024-02-21T23:01:57.191106+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4355,"mds_1":4352,"mds_2":4348},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4331":{"gid":4331,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6838/3728901330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6835","nonce":3728901330},{"type":"v1","addr":"172.21.15.181:6838","nonce":3728901330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4339":{"gid":4339,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6839/3357929641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6837","nonce":3357929641},{"type":"v1","addr":"172.21.15.181:6839","nonce":3357929641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4343":{"gid":4343,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6833/2793485078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":2793485078},{"type":"v1","addr":"172.21.15.99:6833","nonce":2793485078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4348":{"gid":4348,"name":"d","rank":2,"incarnation":12,"state":"up:active","state_seq":10,"addr":"172.21.15.99:6835/2243461688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2243461688},{"type":"v1","addr":"172.21.15.99:6835","nonce":2243461688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4352":{"gid":4352,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.99:6837/1676159950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":1676159950},{"type":"v1","addr":"172.21.15.99:6837","nonce":1676159950}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4355":{"gid":4355,"name":"j","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6839/4239008786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":4239008786},{"type":"v1","addr":"172.21.15.99:6839","nonce":4239008786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-21T23:02:43.799 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 15 2024-02-21T23:02:43.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.812+0000 7f1bcec00640 1 -- 172.21.15.99:0/2100580712 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f1ba809ef60 msgr2=0x7f1ba80a1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:43.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.812+0000 7f1bcec00640 1 --2- 172.21.15.99:0/2100580712 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f1ba809ef60 0x7f1ba80a1420 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1bc80736f0 tx=0x7f1bb4009040 comp rx=0 tx=0).stop 2024-02-21T23:02:43.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.812+0000 7f1bcec00640 1 -- 172.21.15.99:0/2100580712 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1bc80f0fc0 msgr2=0x7f1bc80cce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:43.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.812+0000 7f1bcec00640 1 --2- 172.21.15.99:0/2100580712 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1bc80f0fc0 0x7f1bc80cce40 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc00c4a0 tx=0x7f1bbc00c960 comp rx=0 tx=0).stop 2024-02-21T23:02:43.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.812+0000 7f1bcec00640 1 -- 172.21.15.99:0/2100580712 shutdown_connections 2024-02-21T23:02:43.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.812+0000 7f1bcec00640 1 --2- 172.21.15.99:0/2100580712 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f1ba809ef60 0x7f1ba80a1420 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:43.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.812+0000 7f1bcec00640 1 --2- 172.21.15.99:0/2100580712 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1bc8182700 0x7f1bc80d0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:43.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.812+0000 7f1bcec00640 1 --2- 172.21.15.99:0/2100580712 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1bc80f5d90 0x7f1bc8169200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:43.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.812+0000 7f1bcec00640 1 --2- 172.21.15.99:0/2100580712 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1bc80f0fc0 0x7f1bc80cce40 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:43.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.812+0000 7f1bcec00640 1 -- 172.21.15.99:0/2100580712 >> 172.21.15.99:0/2100580712 conn(0x7f1bc80ce3c0 msgr2=0x7f1bc80f8c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:43.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.813+0000 7f1bcec00640 1 -- 172.21.15.99:0/2100580712 shutdown_connections 2024-02-21T23:02:43.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:43.813+0000 7f1bcec00640 1 -- 172.21.15.99:0/2100580712 wait complete. 2024-02-21T23:02:43.829 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T23:02:43.830 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-02-21T23:02:44.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.038+0000 7fa6fa800640 1 Processor -- start 2024-02-21T23:02:44.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.038+0000 7fa6fa800640 1 -- start start 2024-02-21T23:02:44.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.040+0000 7fa6fa800640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fa6f417f490 0x7fa6f418ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:44.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.040+0000 7fa6fa800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa6f418b060 0x7fa6f4188a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:44.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.040+0000 7fa6fa800640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6f40d6dd0 con 0x7fa6f418b4f0 2024-02-21T23:02:44.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.040+0000 7fa6fa800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6f41614c0 con 0x7fa6f418b060 2024-02-21T23:02:44.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.040+0000 7fa6fa800640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6f40d6810 con 0x7fa6f417f490 2024-02-21T23:02:44.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.040+0000 7fa6f9400640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fa6f417f490 0x7fa6f418ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:44.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.040+0000 7fa6f9e00640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fa6f418b4f0 0x7fa6f4188f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:42102/0 (socket says 172.21.15.99:42102) 2024-02-21T23:02:44.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.040+0000 7fa6f9e00640 1 -- 172.21.15.99:0/2303535700 learned_addr learned my addr 172.21.15.99:0/2303535700 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:02:44.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.040+0000 7fa6f8a00640 1 --2- 172.21.15.99:0/2303535700 >> v2:172.21.15.162:3300/0 conn(0x7fa6f418b060 0x7fa6f4188a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:44.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.041+0000 7fa6f3e00640 1 -- 172.21.15.99:0/2303535700 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2236686375 0 0) 0x7fa6f40d6dd0 con 0x7fa6f418b4f0 2024-02-21T23:02:44.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.041+0000 7fa6f3e00640 1 -- 172.21.15.99:0/2303535700 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6dc003520 con 0x7fa6f418b4f0 2024-02-21T23:02:44.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.041+0000 7fa6f9400640 1 -- 172.21.15.99:0/2303535700 >> v2:172.21.15.162:3300/0 conn(0x7fa6f418b060 msgr2=0x7fa6f4188a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:44.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.041+0000 7fa6f9400640 1 --2- 172.21.15.99:0/2303535700 >> v2:172.21.15.162:3300/0 conn(0x7fa6f418b060 0x7fa6f4188a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.041+0000 7fa6f9400640 1 -- 172.21.15.99:0/2303535700 >> v1:172.21.15.181:6789/0 conn(0x7fa6f418b4f0 legacy=0x7fa6f4188f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:44.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.041+0000 7fa6f9400640 1 -- 172.21.15.99:0/2303535700 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f40d6af0 con 0x7fa6f417f490 2024-02-21T23:02:44.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.042+0000 7fa6f9400640 1 --2- 172.21.15.99:0/2303535700 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa6f417f490 0x7fa6f418ab20 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa6f4067c30 tx=0x7fa6e802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af0c0a3042b4429e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:44.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.043+0000 7fa6f3e00640 1 -- 172.21.15.99:0/2303535700 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e8035020 con 0x7fa6f417f490 2024-02-21T23:02:44.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.043+0000 7fa6f3e00640 1 -- 172.21.15.99:0/2303535700 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6e8031830 con 0x7fa6f417f490 2024-02-21T23:02:44.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.043+0000 7fa6f3e00640 1 -- 172.21.15.99:0/2303535700 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e8031c00 con 0x7fa6f417f490 2024-02-21T23:02:44.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.043+0000 7fa6fa800640 1 -- 172.21.15.99:0/2303535700 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa6f417f490 msgr2=0x7fa6f418ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:44.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.043+0000 7fa6fa800640 1 --2- 172.21.15.99:0/2303535700 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa6f417f490 0x7fa6f418ab20 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa6f4067c30 tx=0x7fa6e802b8d0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.044+0000 7fa6fa800640 1 -- 172.21.15.99:0/2303535700 shutdown_connections 2024-02-21T23:02:44.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.044+0000 7fa6fa800640 1 --2- 172.21.15.99:0/2303535700 >> v2:172.21.15.162:3300/0 conn(0x7fa6f418b060 0x7fa6f4188a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.044+0000 7fa6fa800640 1 --2- 172.21.15.99:0/2303535700 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa6f417f490 0x7fa6f418ab20 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.044+0000 7fa6fa800640 1 -- 172.21.15.99:0/2303535700 >> 172.21.15.99:0/2303535700 conn(0x7fa6f40d29b0 msgr2=0x7fa6f40d2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:44.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.044+0000 7fa6fa800640 1 -- 172.21.15.99:0/2303535700 shutdown_connections 2024-02-21T23:02:44.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.044+0000 7fa6fa800640 1 -- 172.21.15.99:0/2303535700 wait complete. 2024-02-21T23:02:44.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.047+0000 7fa6fa800640 1 Processor -- start 2024-02-21T23:02:44.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.047+0000 7fa6fa800640 1 -- start start 2024-02-21T23:02:44.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.049+0000 7fa6fa800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa6f417f490 0x7fa6f40cf320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:44.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.049+0000 7fa6fa800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa6f418b060 0x7fa6f4173c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:44.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.049+0000 7fa6fa800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6f418b4f0 0x7fa6f41741b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:44.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.049+0000 7fa6fa800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f418a600 con 0x7fa6f418b060 2024-02-21T23:02:44.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.049+0000 7fa6fa800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f418a320 con 0x7fa6f418b4f0 2024-02-21T23:02:44.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.049+0000 7fa6fa800640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f417f870 con 0x7fa6f417f490 2024-02-21T23:02:44.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.050+0000 7fa6f8a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa6f418b060 0x7fa6f4173c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:44.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.050+0000 7fa6f9400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa6f417f490 0x7fa6f40cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:44.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.050+0000 7fa6f9400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa6f417f490 0x7fa6f40cf320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:51542/0 (socket says 172.21.15.99:51542) 2024-02-21T23:02:44.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.050+0000 7fa6f9e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6f418b4f0 0x7fa6f41741b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:44.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.050+0000 7fa6f9400640 1 -- 172.21.15.99:0/494368314 learned_addr learned my addr 172.21.15.99:0/494368314 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:44.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.050+0000 7fa6f9400640 1 -- 172.21.15.99:0/494368314 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6f418b4f0 msgr2=0x7fa6f41741b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:44.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.050+0000 7fa6f9400640 1 --2- 172.21.15.99:0/494368314 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6f418b4f0 0x7fa6f41741b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.050+0000 7fa6f9400640 1 -- 172.21.15.99:0/494368314 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa6f418b060 msgr2=0x7fa6f4173c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:44.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.050+0000 7fa6f9400640 1 --2- 172.21.15.99:0/494368314 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa6f418b060 0x7fa6f4173c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.050+0000 7fa6f9400640 1 -- 172.21.15.99:0/494368314 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f421d960 con 0x7fa6f417f490 2024-02-21T23:02:44.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.050+0000 7fa6f8a00640 1 --2- 172.21.15.99:0/494368314 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa6f418b060 0x7fa6f4173c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:02:44.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.050+0000 7fa6f9400640 1 --2- 172.21.15.99:0/494368314 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa6f417f490 0x7fa6f40cf320 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa6e8009890 tx=0x7fa6e80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:44.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.051+0000 7fa6f1600640 1 -- 172.21.15.99:0/494368314 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e8040070 con 0x7fa6f417f490 2024-02-21T23:02:44.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.051+0000 7fa6f1600640 1 -- 172.21.15.99:0/494368314 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6e803e070 con 0x7fa6f417f490 2024-02-21T23:02:44.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.051+0000 7fa6f1600640 1 -- 172.21.15.99:0/494368314 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e8035040 con 0x7fa6f417f490 2024-02-21T23:02:44.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.051+0000 7fa6fa800640 1 -- 172.21.15.99:0/494368314 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6f421dc40 con 0x7fa6f417f490 2024-02-21T23:02:44.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.051+0000 7fa6fa800640 1 -- 172.21.15.99:0/494368314 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6f421e200 con 0x7fa6f417f490 2024-02-21T23:02:44.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.056+0000 7fa6f1600640 1 -- 172.21.15.99:0/494368314 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 12) v1 ==== 134532+0+0 (secure 0 0 0) 0x7fa6e8038020 con 0x7fa6f417f490 2024-02-21T23:02:44.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.057+0000 7fa6fec2c740 1 Processor -- start 2024-02-21T23:02:44.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.057+0000 7fa6fec2c740 1 -- start start 2024-02-21T23:02:44.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.058+0000 7fa6fec2c740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5558fcaed660 0x5558fcaeda40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:44.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.058+0000 7fa6fec2c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5558fcb28330 0x5558fcb287b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:44.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.058+0000 7fa6f1600640 1 --2- 172.21.15.99:0/494368314 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa6d409ef60 0x7fa6d40a1420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:44.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.058+0000 7fa6fec2c740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5558fcb28cf0 0x5558fcb29560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:44.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.058+0000 7fa6fec2c740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558fca15b50 con 0x5558fcaed660 2024-02-21T23:02:44.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.058+0000 7fa6fec2c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558fc9beda0 con 0x5558fcb28330 2024-02-21T23:02:44.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.058+0000 7fa6fec2c740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558fca11bf0 con 0x5558fcb28cf0 2024-02-21T23:02:44.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.058+0000 7fa6f1600640 1 -- 172.21.15.99:0/494368314 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7fa6e80eb7a0 con 0x7fa6f417f490 2024-02-21T23:02:44.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.058+0000 7fa6f9e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5558fcaed660 0x5558fcaeda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:44.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.059+0000 7fa6f9e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5558fcaed660 0x5558fcaeda40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59414/0 (socket says 172.21.15.99:59414) 2024-02-21T23:02:44.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.059+0000 7fa6f9e00640 1 -- 172.21.15.99:0/1070260411 learned_addr learned my addr 172.21.15.99:0/1070260411 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:44.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.059+0000 7fa6f8a00640 1 --2- 172.21.15.99:0/1070260411 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5558fcb28330 0x5558fcb287b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:44.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.059+0000 7fa6f9e00640 1 --2- 172.21.15.99:0/1070260411 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5558fcb28cf0 0x5558fcb29560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:44.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.059+0000 7fa6f9400640 1 --2- 172.21.15.99:0/494368314 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa6d409ef60 0x7fa6d40a1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:44.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.059+0000 7fa6f8a00640 1 -- 172.21.15.99:0/1070260411 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5558fcb28cf0 msgr2=0x5558fcb29560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:44.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.059+0000 7fa6f8a00640 1 --2- 172.21.15.99:0/1070260411 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5558fcb28cf0 0x5558fcb29560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.059+0000 7fa6f8a00640 1 -- 172.21.15.99:0/1070260411 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5558fcaed660 msgr2=0x5558fcaeda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:44.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.059+0000 7fa6f8a00640 1 --2- 172.21.15.99:0/1070260411 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5558fcaed660 0x5558fcaeda40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.059+0000 7fa6f8a00640 1 -- 172.21.15.99:0/1070260411 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5558fc9e1f80 con 0x5558fcb28330 2024-02-21T23:02:44.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.059+0000 7fa6f9e00640 1 --2- 172.21.15.99:0/1070260411 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5558fcaed660 0x5558fcaeda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:02:44.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.059+0000 7fa6f9400640 1 --2- 172.21.15.99:0/494368314 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa6d409ef60 0x7fa6d40a1420 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa6e80e8e30 tx=0x7fa6e80bf040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:44.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.059+0000 7fa6f8a00640 1 --2- 172.21.15.99:0/1070260411 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5558fcb28330 0x5558fcb287b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa6f40d3240 tx=0x7fa6e0011690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5fbd54230ec9e591 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:44.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.060+0000 7fa6e5c00640 1 -- 172.21.15.99:0/1070260411 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e0019070 con 0x5558fcb28330 2024-02-21T23:02:44.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.060+0000 7fa6e5c00640 1 -- 172.21.15.99:0/1070260411 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6e0004240 con 0x5558fcb28330 2024-02-21T23:02:44.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.060+0000 7fa6e5c00640 1 -- 172.21.15.99:0/1070260411 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e0003610 con 0x5558fcb28330 2024-02-21T23:02:44.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.061+0000 7fa6fec2c740 1 -- 172.21.15.99:0/1070260411 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5558fcb28330 msgr2=0x5558fcb287b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:44.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.061+0000 7fa6fec2c740 1 --2- 172.21.15.99:0/1070260411 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5558fcb28330 0x5558fcb287b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa6f40d3240 tx=0x7fa6e0011690 comp rx=0 tx=0).stop 2024-02-21T23:02:44.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.061+0000 7fa6fec2c740 1 -- 172.21.15.99:0/1070260411 shutdown_connections 2024-02-21T23:02:44.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.061+0000 7fa6fec2c740 1 --2- 172.21.15.99:0/1070260411 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5558fcb28cf0 0x5558fcb29560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.061+0000 7fa6fec2c740 1 --2- 172.21.15.99:0/1070260411 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5558fcb28330 0x5558fcb287b0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.061+0000 7fa6fec2c740 1 --2- 172.21.15.99:0/1070260411 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5558fcaed660 0x5558fcaeda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.061+0000 7fa6fec2c740 1 -- 172.21.15.99:0/1070260411 >> 172.21.15.99:0/1070260411 conn(0x5558fcaaf6d0 msgr2=0x5558fcab0750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:44.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.061+0000 7fa6fec2c740 1 -- 172.21.15.99:0/1070260411 shutdown_connections 2024-02-21T23:02:44.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.061+0000 7fa6fec2c740 1 -- 172.21.15.99:0/1070260411 wait complete. 2024-02-21T23:02:44.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.062+0000 7fa6fec2c740 1 -- start start 2024-02-21T23:02:44.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.063+0000 7fa6fec2c740 1 Processor -- start 2024-02-21T23:02:44.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.065+0000 7fa6fec2c740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5558fcb28330 0x5558fcaf5620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:44.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.065+0000 7fa6fec2c740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5558fcb28cf0 0x5558fcae32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:44.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.065+0000 7fa6fec2c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5558fcaf6da0 0x5558fcaf6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:44.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.065+0000 7fa6fec2c740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558fcb270a0 con 0x5558fcb28330 2024-02-21T23:02:44.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.065+0000 7fa6fec2c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558fc9b4380 con 0x5558fcaf6da0 2024-02-21T23:02:44.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.065+0000 7fa6fec2c740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558fcb26dc0 con 0x5558fcb28cf0 2024-02-21T23:02:44.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.065+0000 7fa6fec2c740 10 client.0 _ll_register_callbacks cb 0x5558fca0d280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:02:44.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.065+0000 7fa6f9e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5558fcb28330 0x5558fcaf5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:44.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.065+0000 7fa6f9e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5558fcb28330 0x5558fcaf5620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59428/0 (socket says 172.21.15.99:59428) 2024-02-21T23:02:44.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.065+0000 7fa6f9e00640 1 -- 172.21.15.99:0/1950381327 learned_addr learned my addr 172.21.15.99:0/1950381327 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:44.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.065+0000 7fa6f8a00640 1 --2- 172.21.15.99:0/1950381327 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5558fcb28cf0 0x5558fcae32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:44.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.065+0000 7fa6f9e00640 1 --2- 172.21.15.99:0/1950381327 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5558fcaf6da0 0x5558fcaf6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:44.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.065+0000 7fa6f9e00640 1 -- 172.21.15.99:0/1950381327 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5558fcb28cf0 msgr2=0x5558fcae32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:44.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.065+0000 7fa6f9e00640 1 --2- 172.21.15.99:0/1950381327 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5558fcb28cf0 0x5558fcae32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.065+0000 7fa6f9e00640 1 -- 172.21.15.99:0/1950381327 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5558fcaf6da0 msgr2=0x5558fcaf6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:44.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.065+0000 7fa6f9e00640 1 --2- 172.21.15.99:0/1950381327 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5558fcaf6da0 0x5558fcaf6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.065+0000 7fa6f9e00640 1 -- 172.21.15.99:0/1950381327 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5558fc9dcc20 con 0x5558fcb28330 2024-02-21T23:02:44.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.066+0000 7fa6f9e00640 1 --2- 172.21.15.99:0/1950381327 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5558fcb28330 0x5558fcaf5620 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec001c00 tx=0x7fa6ec009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=302bd30959a991f5 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:44.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.066+0000 7fa6da000640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:02:44.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.066+0000 7fa6da000640 1 -- 172.21.15.99:0/1950381327 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6ec01f020 con 0x5558fcb28330 2024-02-21T23:02:44.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.066+0000 7fa6da000640 1 -- 172.21.15.99:0/1950381327 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7fa6ec018780 con 0x5558fcb28330 2024-02-21T23:02:44.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.066+0000 7fa6fec2c740 1 -- 172.21.15.99:0/1950381327 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa6e0004240 con 0x5558fcb28330 2024-02-21T23:02:44.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.066+0000 7fa6da000640 1 -- 172.21.15.99:0/1950381327 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa6ec02a050 con 0x5558fcb28330 2024-02-21T23:02:44.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.066+0000 7fa6fec2c740 10 client.5229 fetch_fsmap learned FSMap version 15 2024-02-21T23:02:44.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.066+0000 7fa6fec2c740 1 -- 172.21.15.99:0/1950381327 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x5558fc72a3f0 con 0x5558fcb28330 2024-02-21T23:02:44.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.067+0000 7fa6da000640 1 -- 172.21.15.99:0/1950381327 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6e0004240 con 0x5558fcb28330 2024-02-21T23:02:44.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.067+0000 7fa6da000640 1 -- 172.21.15.99:0/1950381327 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 15) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fa6ec016050 con 0x5558fcb28330 2024-02-21T23:02:44.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.067+0000 7fa6fec2c740 10 client.5229 fetch_fsmap finished waiting for FSMap version 15 2024-02-21T23:02:44.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.067+0000 7fa6fec2c740 10 client.5229 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.d 2024-02-21T23:02:44.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.067+0000 7fa6fec2c740 20 client.5229 populate_metadata read hostname 'smithi099' 2024-02-21T23:02:44.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.067+0000 7fa6fec2c740 1 --2- 172.21.15.99:0/1950381327 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x5558fcaf7220 0x5558fcb267e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:44.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.067+0000 7fa6fec2c740 4 client.5229 mds_command: new command op to 4348 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:02:44.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.067+0000 7fa6fec2c740 1 -- 172.21.15.99:0/1950381327 --> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5558fca23090 con 0x5558fcaf7220 2024-02-21T23:02:44.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.067+0000 7fa6f8a00640 1 --2- 172.21.15.99:0/1950381327 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x5558fcaf7220 0x5558fcb267e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:44.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.068+0000 7fa6f8a00640 1 --2- 172.21.15.99:0/1950381327 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x5558fcaf7220 0x5558fcb267e0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4558d36dffdfb587 server_cookie=52d4d00757f9543b in_seq=0 out_seq=0 2024-02-21T23:02:44.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.068+0000 7fa6da000640 10 client.5229 ms_handle_connect on v2:172.21.15.99:6834/2243461688 2024-02-21T23:02:44.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.068+0000 7fa6da000640 1 -- 172.21.15.99:0/1950381327 <== mds.2 v2:172.21.15.99:6834/2243461688 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x5558fca23090 con 0x5558fcaf7220 2024-02-21T23:02:44.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.068+0000 7fa6da000640 10 client.5229 handle_command_reply: tid=0 2024-02-21T23:02:44.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.069+0000 7fa6fec2c740 1 client.5229 shutdown 2024-02-21T23:02:44.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.069+0000 7fa6fec2c740 1 -- 172.21.15.99:0/1950381327 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5558fcb28330 msgr2=0x5558fcaf5620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:44.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.069+0000 7fa6fec2c740 1 --2- 172.21.15.99:0/1950381327 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5558fcb28330 0x5558fcaf5620 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec001c00 tx=0x7fa6ec009040 comp rx=0 tx=0).stop 2024-02-21T23:02:44.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.069+0000 7fa6fec2c740 1 -- 172.21.15.99:0/1950381327 shutdown_connections 2024-02-21T23:02:44.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.069+0000 7fa6fec2c740 1 --2- 172.21.15.99:0/1950381327 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x5558fcaf7220 0x5558fcb267e0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.069+0000 7fa6fec2c740 1 --2- 172.21.15.99:0/1950381327 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5558fcaf6da0 0x5558fcaf6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.069+0000 7fa6fec2c740 1 --2- 172.21.15.99:0/1950381327 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5558fcb28cf0 0x5558fcae32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.069+0000 7fa6fec2c740 1 --2- 172.21.15.99:0/1950381327 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5558fcb28330 0x5558fcaf5620 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.069+0000 7fa6fec2c740 1 -- 172.21.15.99:0/1950381327 >> 172.21.15.99:0/1950381327 conn(0x5558fcaed660 msgr2=0x5558fcaf1870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:44.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.069+0000 7fa6da000640 0 client.5229 ms_handle_reset on v2:172.21.15.99:6834/2243461688 2024-02-21T23:02:44.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.069+0000 7fa6fec2c740 1 -- 172.21.15.99:0/1950381327 shutdown_connections 2024-02-21T23:02:44.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.069+0000 7fa6fec2c740 1 -- 172.21.15.99:0/1950381327 wait complete. 2024-02-21T23:02:44.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.069+0000 7fa6fec2c740 20 client.5229 trim_cache size 0 max 16384 2024-02-21T23:02:44.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.095+0000 7fa6fec2c740 1 Processor -- start 2024-02-21T23:02:44.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.095+0000 7fa6fec2c740 1 -- start start 2024-02-21T23:02:44.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.096+0000 7fa6fec2c740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5558fcaf6da0 0x5558fcaf5600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:44.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.096+0000 7fa6fec2c740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5558fcb28330 0x5558fcab57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:44.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.096+0000 7fa6fec2c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5558fcb28cf0 0x5558fcae62c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:44.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.096+0000 7fa6fec2c740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f422c7b0 con 0x5558fcb28330 2024-02-21T23:02:44.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.096+0000 7fa6fec2c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f422a350 con 0x5558fcb28cf0 2024-02-21T23:02:44.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.096+0000 7fa6fec2c740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f42284d0 con 0x5558fcaf6da0 2024-02-21T23:02:44.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.097+0000 7fa6f9e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5558fcaf6da0 0x5558fcaf5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:44.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.097+0000 7fa6f9e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5558fcaf6da0 0x5558fcaf5600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:51582/0 (socket says 172.21.15.99:51582) 2024-02-21T23:02:44.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.097+0000 7fa6f9e00640 1 -- 172.21.15.99:0/3558233572 learned_addr learned my addr 172.21.15.99:0/3558233572 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:44.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.097+0000 7fa6f9e00640 1 --2- 172.21.15.99:0/3558233572 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5558fcb28cf0 0x5558fcae62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:44.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.097+0000 7fa6f8a00640 1 --2- 172.21.15.99:0/3558233572 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5558fcb28330 0x5558fcab57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:44.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.097+0000 7fa6f9e00640 1 -- 172.21.15.99:0/3558233572 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5558fcb28cf0 msgr2=0x5558fcae62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:44.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.097+0000 7fa6f9e00640 1 --2- 172.21.15.99:0/3558233572 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5558fcb28cf0 0x5558fcae62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.097+0000 7fa6f9e00640 1 -- 172.21.15.99:0/3558233572 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5558fcb28330 msgr2=0x5558fcab57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:44.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.097+0000 7fa6f9e00640 1 --2- 172.21.15.99:0/3558233572 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5558fcb28330 0x5558fcab57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.097+0000 7fa6f9e00640 1 -- 172.21.15.99:0/3558233572 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5558fc7f47d0 con 0x5558fcaf6da0 2024-02-21T23:02:44.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.097+0000 7fa6f8a00640 1 --2- 172.21.15.99:0/3558233572 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5558fcb28330 0x5558fcab57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T23:02:44.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.098+0000 7fa6f9e00640 1 --2- 172.21.15.99:0/3558233572 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5558fcaf6da0 0x5558fcaf5600 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec022550 tx=0x7fa6ec01b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21e7a005d3d7b82a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:44.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.098+0000 7fa6e5200640 1 -- 172.21.15.99:0/3558233572 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6ec01f070 con 0x5558fcaf6da0 2024-02-21T23:02:44.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.098+0000 7fa6e5200640 1 -- 172.21.15.99:0/3558233572 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6ec018980 con 0x5558fcaf6da0 2024-02-21T23:02:44.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.098+0000 7fa6e5200640 1 -- 172.21.15.99:0/3558233572 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6ec0227f0 con 0x5558fcaf6da0 2024-02-21T23:02:44.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.098+0000 7fa6fec2c740 1 -- 172.21.15.99:0/3558233572 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5558fcaf6da0 msgr2=0x5558fcaf5600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:44.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.098+0000 7fa6fec2c740 1 --2- 172.21.15.99:0/3558233572 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5558fcaf6da0 0x5558fcaf5600 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec022550 tx=0x7fa6ec01b040 comp rx=0 tx=0).stop 2024-02-21T23:02:44.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.098+0000 7fa6fec2c740 1 -- 172.21.15.99:0/3558233572 shutdown_connections 2024-02-21T23:02:44.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.098+0000 7fa6fec2c740 1 --2- 172.21.15.99:0/3558233572 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5558fcb28cf0 0x5558fcae62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.098+0000 7fa6fec2c740 1 --2- 172.21.15.99:0/3558233572 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5558fcb28330 0x5558fcab57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.098+0000 7fa6fec2c740 1 --2- 172.21.15.99:0/3558233572 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5558fcaf6da0 0x5558fcaf5600 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.098+0000 7fa6fec2c740 1 -- 172.21.15.99:0/3558233572 >> 172.21.15.99:0/3558233572 conn(0x5558fcaed660 msgr2=0x5558fcaf6490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:44.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.099+0000 7fa6fec2c740 1 -- 172.21.15.99:0/3558233572 shutdown_connections 2024-02-21T23:02:44.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.099+0000 7fa6fec2c740 1 -- 172.21.15.99:0/3558233572 wait complete. 2024-02-21T23:02:44.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.099+0000 7fa6fec2c740 1 -- start start 2024-02-21T23:02:44.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.100+0000 7fa6fec2c740 1 Processor -- start 2024-02-21T23:02:44.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.101+0000 7fa6fec2c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5558fcaf6da0 0x5558fcb88860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:44.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.101+0000 7fa6fec2c740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5558fcb28330 0x5558fcaf5520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:44.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.101+0000 7fa6fec2c740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5558fcb28cf0 0x5558fcb41f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:44.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.101+0000 7fa6fec2c740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f4228ad0 con 0x5558fcb28330 2024-02-21T23:02:44.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.101+0000 7fa6fec2c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f4229cf0 con 0x5558fcaf6da0 2024-02-21T23:02:44.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.101+0000 7fa6fec2c740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f42290d0 con 0x5558fcb28cf0 2024-02-21T23:02:44.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.101+0000 7fa6fec2c740 10 client.0 _ll_register_callbacks cb 0x7fa6ec014f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:02:44.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.101+0000 7fa6f8a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5558fcb28330 0x5558fcaf5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:44.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.101+0000 7fa6f8a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5558fcb28330 0x5558fcaf5520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59452/0 (socket says 172.21.15.99:59452) 2024-02-21T23:02:44.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.101+0000 7fa6f8a00640 1 -- 172.21.15.99:0/2482792715 learned_addr learned my addr 172.21.15.99:0/2482792715 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:44.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.101+0000 7fa6f9e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5558fcaf6da0 0x5558fcb88860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:44.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.101+0000 7fa6f9e00640 1 --2- 172.21.15.99:0/2482792715 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5558fcb28cf0 0x5558fcb41f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:44.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.101+0000 7fa6f8a00640 1 -- 172.21.15.99:0/2482792715 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5558fcb28cf0 msgr2=0x5558fcb41f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:44.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.102+0000 7fa6f8a00640 1 --2- 172.21.15.99:0/2482792715 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5558fcb28cf0 0x5558fcb41f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.102+0000 7fa6f8a00640 1 -- 172.21.15.99:0/2482792715 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5558fcaf6da0 msgr2=0x5558fcb88860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:44.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.102+0000 7fa6f8a00640 1 --2- 172.21.15.99:0/2482792715 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5558fcaf6da0 0x5558fcb88860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.102+0000 7fa6f8a00640 1 -- 172.21.15.99:0/2482792715 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5558fcaf7d80 con 0x5558fcb28330 2024-02-21T23:02:44.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.102+0000 7fa6f9e00640 1 --2- 172.21.15.99:0/2482792715 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5558fcaf6da0 0x5558fcb88860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:02:44.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.102+0000 7fa6f8a00640 1 --2- 172.21.15.99:0/2482792715 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5558fcb28330 0x5558fcaf5520 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa6f40d0f60 tx=0x7fa6e0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5541b46f445494c8 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:44.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.102+0000 7fa6da000640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:02:44.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.102+0000 7fa6da000640 1 -- 172.21.15.99:0/2482792715 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e0019040 con 0x5558fcb28330 2024-02-21T23:02:44.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.102+0000 7fa6da000640 1 -- 172.21.15.99:0/2482792715 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7fa6e002c0f0 con 0x5558fcb28330 2024-02-21T23:02:44.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.102+0000 7fa6fec2c740 1 -- 172.21.15.99:0/2482792715 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa6ec018980 con 0x5558fcb28330 2024-02-21T23:02:44.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.102+0000 7fa6da000640 1 -- 172.21.15.99:0/2482792715 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa6e0011e90 con 0x5558fcb28330 2024-02-21T23:02:44.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.102+0000 7fa6fec2c740 10 client.5232 fetch_fsmap learned FSMap version 15 2024-02-21T23:02:44.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.102+0000 7fa6fec2c740 1 -- 172.21.15.99:0/2482792715 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x5558fcae9bb0 con 0x5558fcb28330 2024-02-21T23:02:44.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.103+0000 7fa6da000640 1 -- 172.21.15.99:0/2482792715 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6ec018980 con 0x5558fcb28330 2024-02-21T23:02:44.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.103+0000 7fa6da000640 1 -- 172.21.15.99:0/2482792715 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 15) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fa6e002c770 con 0x5558fcb28330 2024-02-21T23:02:44.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.103+0000 7fa6fec2c740 10 client.5232 fetch_fsmap finished waiting for FSMap version 15 2024-02-21T23:02:44.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.103+0000 7fa6fec2c740 10 client.5232 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.d 2024-02-21T23:02:44.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.103+0000 7fa6fec2c740 20 client.5232 populate_metadata read hostname 'smithi099' 2024-02-21T23:02:44.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.103+0000 7fa6fec2c740 1 --2- 172.21.15.99:0/2482792715 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x5558fcaf7fc0 0x5558fcb87bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:44.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.103+0000 7fa6fec2c740 4 client.5232 mds_command: new command op to 4348 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T23:02:44.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.103+0000 7fa6fec2c740 1 -- 172.21.15.99:0/2482792715 --> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5558fca1d3e0 con 0x5558fcaf7fc0 2024-02-21T23:02:44.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.103+0000 7fa6f9e00640 1 --2- 172.21.15.99:0/2482792715 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x5558fcaf7fc0 0x5558fcb87bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:44.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.104+0000 7fa6da000640 10 client.5232 ms_handle_connect on v2:172.21.15.99:6834/2243461688 2024-02-21T23:02:44.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.104+0000 7fa6f9e00640 1 --2- 172.21.15.99:0/2482792715 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x5558fcaf7fc0 0x5558fcb87bc0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4374f04556c20ebc server_cookie=fc09df7ce83b65cc in_seq=0 out_seq=0 2024-02-21T23:02:44.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.104+0000 7fa6da000640 1 -- 172.21.15.99:0/2482792715 <== mds.2 v2:172.21.15.99:6834/2243461688 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5558fca1d3e0 con 0x5558fcaf7fc0 2024-02-21T23:02:44.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.104+0000 7fa6da000640 10 client.5232 handle_command_reply: tid=0 2024-02-21T23:02:44.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.104+0000 7fa6fec2c740 1 client.5232 shutdown 2024-02-21T23:02:44.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.104+0000 7fa6fec2c740 1 -- 172.21.15.99:0/2482792715 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5558fcb28330 msgr2=0x5558fcaf5520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:44.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.104+0000 7fa6fec2c740 1 --2- 172.21.15.99:0/2482792715 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5558fcb28330 0x5558fcaf5520 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa6f40d0f60 tx=0x7fa6e0004730 comp rx=0 tx=0).stop 2024-02-21T23:02:44.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.104+0000 7fa6fec2c740 1 -- 172.21.15.99:0/2482792715 shutdown_connections 2024-02-21T23:02:44.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.104+0000 7fa6fec2c740 1 --2- 172.21.15.99:0/2482792715 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x5558fcaf7fc0 0x5558fcb87bc0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.104+0000 7fa6fec2c740 1 --2- 172.21.15.99:0/2482792715 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5558fcb28cf0 0x5558fcb41f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.104+0000 7fa6fec2c740 1 --2- 172.21.15.99:0/2482792715 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5558fcb28330 0x5558fcaf5520 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.104+0000 7fa6fec2c740 1 --2- 172.21.15.99:0/2482792715 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5558fcaf6da0 0x5558fcb88860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.104+0000 7fa6da000640 0 client.5232 ms_handle_reset on v2:172.21.15.99:6834/2243461688 2024-02-21T23:02:44.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.104+0000 7fa6fec2c740 1 -- 172.21.15.99:0/2482792715 >> 172.21.15.99:0/2482792715 conn(0x5558fcaed660 msgr2=0x5558fcab0710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:44.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.105+0000 7fa6fec2c740 1 -- 172.21.15.99:0/2482792715 shutdown_connections 2024-02-21T23:02:44.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.105+0000 7fa6fec2c740 1 -- 172.21.15.99:0/2482792715 wait complete. 2024-02-21T23:02:44.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.105+0000 7fa6fec2c740 20 client.5232 trim_cache size 0 max 16384 2024-02-21T23:02:44.097 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-02-21T23:02:44.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.105+0000 7fa6fa800640 1 -- 172.21.15.99:0/494368314 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa6d409ef60 msgr2=0x7fa6d40a1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:44.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.105+0000 7fa6fa800640 1 --2- 172.21.15.99:0/494368314 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa6d409ef60 0x7fa6d40a1420 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa6e80e8e30 tx=0x7fa6e80bf040 comp rx=0 tx=0).stop 2024-02-21T23:02:44.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.105+0000 7fa6fa800640 1 -- 172.21.15.99:0/494368314 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa6f417f490 msgr2=0x7fa6f40cf320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:44.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.105+0000 7fa6fa800640 1 --2- 172.21.15.99:0/494368314 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa6f417f490 0x7fa6f40cf320 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa6e8009890 tx=0x7fa6e80046c0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.106+0000 7fa6fa800640 1 -- 172.21.15.99:0/494368314 shutdown_connections 2024-02-21T23:02:44.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.106+0000 7fa6fa800640 1 --2- 172.21.15.99:0/494368314 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa6d409ef60 0x7fa6d40a1420 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.106+0000 7fa6fa800640 1 --2- 172.21.15.99:0/494368314 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6f418b4f0 0x7fa6f41741b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.106+0000 7fa6fa800640 1 --2- 172.21.15.99:0/494368314 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa6f418b060 0x7fa6f4173c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.106+0000 7fa6fa800640 1 --2- 172.21.15.99:0/494368314 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa6f417f490 0x7fa6f40cf320 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.106+0000 7fa6fa800640 1 -- 172.21.15.99:0/494368314 >> 172.21.15.99:0/494368314 conn(0x7fa6f40d29b0 msgr2=0x7fa6f40fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:44.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.106+0000 7fa6fa800640 1 -- 172.21.15.99:0/494368314 shutdown_connections 2024-02-21T23:02:44.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.106+0000 7fa6fa800640 1 -- 172.21.15.99:0/494368314 wait complete. 2024-02-21T23:02:44.116 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T23:02:44.116 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-02-21T23:02:44.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.326+0000 7fa165400640 1 Processor -- start 2024-02-21T23:02:44.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.326+0000 7fa165400640 1 -- start start 2024-02-21T23:02:44.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.330+0000 7fa165400640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fa1600fd4d0 0x7fa1600fd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:44.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.330+0000 7fa165400640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1601830b0 con 0x7fa1600f8e20 2024-02-21T23:02:44.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.330+0000 7fa165400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa160186f40 con 0x7fa160182cd0 2024-02-21T23:02:44.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.330+0000 7fa165400640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa160187e30 con 0x7fa1600fd4d0 2024-02-21T23:02:44.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.331+0000 7fa15fe00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fa160182cd0 0x7fa1601882c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.99:42310/0 (socket says 172.21.15.99:42310) 2024-02-21T23:02:44.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.331+0000 7fa15fe00640 1 -- 172.21.15.99:0/1991229658 learned_addr learned my addr 172.21.15.99:0/1991229658 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:02:44.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.331+0000 7fa164a00640 1 --2- 172.21.15.99:0/1991229658 >> v2:172.21.15.181:3300/0 conn(0x7fa1600fd4d0 0x7fa1600fd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:44.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.331+0000 7fa15ea00640 1 -- 172.21.15.99:0/1991229658 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4047106671 0 0) 0x7fa160186f40 con 0x7fa160182cd0 2024-02-21T23:02:44.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.331+0000 7fa15ea00640 1 -- 172.21.15.99:0/1991229658 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa144003520 con 0x7fa160182cd0 2024-02-21T23:02:44.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.331+0000 7fa164a00640 1 -- 172.21.15.99:0/1991229658 >> v1:172.21.15.162:6789/0 conn(0x7fa160182cd0 legacy=0x7fa1601882c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:44.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.331+0000 7fa164a00640 1 -- 172.21.15.99:0/1991229658 >> v1:172.21.15.99:6789/0 conn(0x7fa1600f8e20 legacy=0x7fa16018c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:44.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.331+0000 7fa164a00640 1 -- 172.21.15.99:0/1991229658 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa160187220 con 0x7fa1600fd4d0 2024-02-21T23:02:44.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.332+0000 7fa164a00640 1 --2- 172.21.15.99:0/1991229658 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa1600fd4d0 0x7fa1600fd940 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa158009d90 tx=0x7fa15802be20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=932d31c7ab8bdcad server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:44.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.333+0000 7fa15ea00640 1 -- 172.21.15.99:0/1991229658 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa158039070 con 0x7fa1600fd4d0 2024-02-21T23:02:44.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.333+0000 7fa15ea00640 1 -- 172.21.15.99:0/1991229658 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa15802cbd0 con 0x7fa1600fd4d0 2024-02-21T23:02:44.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.333+0000 7fa15ea00640 1 -- 172.21.15.99:0/1991229658 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa158034440 con 0x7fa1600fd4d0 2024-02-21T23:02:44.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.333+0000 7fa165400640 1 -- 172.21.15.99:0/1991229658 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa1600fd4d0 msgr2=0x7fa1600fd940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:44.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.333+0000 7fa165400640 1 --2- 172.21.15.99:0/1991229658 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa1600fd4d0 0x7fa1600fd940 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa158009d90 tx=0x7fa15802be20 comp rx=0 tx=0).stop 2024-02-21T23:02:44.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.333+0000 7fa165400640 1 -- 172.21.15.99:0/1991229658 shutdown_connections 2024-02-21T23:02:44.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.333+0000 7fa165400640 1 --2- 172.21.15.99:0/1991229658 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa1600fd4d0 0x7fa1600fd940 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.333+0000 7fa165400640 1 -- 172.21.15.99:0/1991229658 >> 172.21.15.99:0/1991229658 conn(0x7fa1600fe4a0 msgr2=0x7fa1600fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:44.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.333+0000 7fa165400640 1 -- 172.21.15.99:0/1991229658 shutdown_connections 2024-02-21T23:02:44.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.333+0000 7fa165400640 1 -- 172.21.15.99:0/1991229658 wait complete. 2024-02-21T23:02:44.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.337+0000 7fa165400640 1 Processor -- start 2024-02-21T23:02:44.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.337+0000 7fa165400640 1 -- start start 2024-02-21T23:02:44.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.339+0000 7fa165400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa1600f8e20 0x7fa1602129e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:44.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.339+0000 7fa165400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa1600fd4d0 0x7fa16016e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:44.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.339+0000 7fa165400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa160182cd0 0x7fa16021ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:44.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.339+0000 7fa165400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa160187ac0 con 0x7fa1600fd4d0 2024-02-21T23:02:44.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.339+0000 7fa165400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1601877e0 con 0x7fa1600f8e20 2024-02-21T23:02:44.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.339+0000 7fa165400640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1601889d0 con 0x7fa160182cd0 2024-02-21T23:02:44.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.339+0000 7fa15f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa1600fd4d0 0x7fa16016e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:44.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.339+0000 7fa15f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa1600fd4d0 0x7fa16016e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59464/0 (socket says 172.21.15.99:59464) 2024-02-21T23:02:44.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.339+0000 7fa15f400640 1 -- 172.21.15.99:0/1640170471 learned_addr learned my addr 172.21.15.99:0/1640170471 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:44.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.339+0000 7fa15fe00640 1 --2- 172.21.15.99:0/1640170471 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa1600f8e20 0x7fa1602129e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:44.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.339+0000 7fa164a00640 1 --2- 172.21.15.99:0/1640170471 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa160182cd0 0x7fa16021ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:44.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.340+0000 7fa15f400640 1 -- 172.21.15.99:0/1640170471 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa160182cd0 msgr2=0x7fa16021ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:44.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.340+0000 7fa15f400640 1 --2- 172.21.15.99:0/1640170471 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa160182cd0 0x7fa16021ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.340+0000 7fa15f400640 1 -- 172.21.15.99:0/1640170471 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa1600f8e20 msgr2=0x7fa1602129e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:44.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.340+0000 7fa15f400640 1 --2- 172.21.15.99:0/1640170471 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa1600f8e20 0x7fa1602129e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.340+0000 7fa15f400640 1 -- 172.21.15.99:0/1640170471 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa16016e5f0 con 0x7fa1600fd4d0 2024-02-21T23:02:44.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.340+0000 7fa164a00640 1 --2- 172.21.15.99:0/1640170471 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa160182cd0 0x7fa16021ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:02:44.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.340+0000 7fa15f400640 1 --2- 172.21.15.99:0/1640170471 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa1600fd4d0 0x7fa16016e0b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa14c00c3c0 tx=0x7fa14c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:44.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.340+0000 7fa157e00640 1 -- 172.21.15.99:0/1640170471 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14c0052d0 con 0x7fa1600fd4d0 2024-02-21T23:02:44.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.340+0000 7fa157e00640 1 -- 172.21.15.99:0/1640170471 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa14c005490 con 0x7fa1600fd4d0 2024-02-21T23:02:44.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.340+0000 7fa157e00640 1 -- 172.21.15.99:0/1640170471 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14c007260 con 0x7fa1600fd4d0 2024-02-21T23:02:44.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.340+0000 7fa165400640 1 -- 172.21.15.99:0/1640170471 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa16021f630 con 0x7fa1600fd4d0 2024-02-21T23:02:44.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.340+0000 7fa165400640 1 -- 172.21.15.99:0/1640170471 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa160211f00 con 0x7fa1600fd4d0 2024-02-21T23:02:44.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.343+0000 7fa157e00640 1 -- 172.21.15.99:0/1640170471 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 12) v1 ==== 134532+0+0 (secure 0 0 0) 0x7fa14c007400 con 0x7fa1600fd4d0 2024-02-21T23:02:44.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.344+0000 7fa169871740 1 Processor -- start 2024-02-21T23:02:44.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.345+0000 7fa169871740 1 -- start start 2024-02-21T23:02:44.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.346+0000 7fa157e00640 1 --2- 172.21.15.99:0/1640170471 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa14009ef60 0x7fa1400a1420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:44.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.346+0000 7fa157e00640 1 -- 172.21.15.99:0/1640170471 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7fa14c0c9540 con 0x7fa1600fd4d0 2024-02-21T23:02:44.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.346+0000 7fa164a00640 1 --2- 172.21.15.99:0/1640170471 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa14009ef60 0x7fa1400a1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:44.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.347+0000 7fa169871740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556eb30ee660 0x556eb30eea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:44.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.347+0000 7fa169871740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556eb3129330 0x556eb31297b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:44.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.347+0000 7fa169871740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556eb3129cf0 0x556eb312a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:44.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.347+0000 7fa169871740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x556eb3016b50 con 0x556eb3129cf0 2024-02-21T23:02:44.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.347+0000 7fa169871740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x556eb2fbfda0 con 0x556eb30ee660 2024-02-21T23:02:44.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.347+0000 7fa169871740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x556eb3012bf0 con 0x556eb3129330 2024-02-21T23:02:44.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.347+0000 7fa15fe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556eb30ee660 0x556eb30eea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:44.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.347+0000 7fa15fe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556eb30ee660 0x556eb30eea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:38760/0 (socket says 172.21.15.99:38760) 2024-02-21T23:02:44.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.347+0000 7fa15fe00640 1 -- 172.21.15.99:0/3169106647 learned_addr learned my addr 172.21.15.99:0/3169106647 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:44.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.347+0000 7fa164a00640 1 --2- 172.21.15.99:0/1640170471 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa14009ef60 0x7fa1400a1420 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa158036000 tx=0x7fa158030000 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:44.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.347+0000 7fa15f400640 1 --2- 172.21.15.99:0/3169106647 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556eb3129330 0x556eb31297b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:44.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.347+0000 7fa164a00640 1 --2- 172.21.15.99:0/3169106647 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556eb3129cf0 0x556eb312a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:44.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.347+0000 7fa15fe00640 1 -- 172.21.15.99:0/3169106647 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556eb3129330 msgr2=0x556eb31297b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:44.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.347+0000 7fa15fe00640 1 --2- 172.21.15.99:0/3169106647 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556eb3129330 0x556eb31297b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.347+0000 7fa15fe00640 1 -- 172.21.15.99:0/3169106647 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556eb3129cf0 msgr2=0x556eb312a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:44.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.347+0000 7fa15fe00640 1 --2- 172.21.15.99:0/3169106647 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556eb3129cf0 0x556eb312a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.347+0000 7fa15fe00640 1 -- 172.21.15.99:0/3169106647 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556eb2fe2f80 con 0x556eb30ee660 2024-02-21T23:02:44.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.347+0000 7fa15f400640 1 --2- 172.21.15.99:0/3169106647 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556eb3129330 0x556eb31297b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:02:44.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.349+0000 7fa15fe00640 1 --2- 172.21.15.99:0/3169106647 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556eb30ee660 0x556eb30eea40 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa150001960 tx=0x7fa150000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60f63d8c88ae5bd1 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:44.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.349+0000 7fa14be00640 1 -- 172.21.15.99:0/3169106647 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa150005ac0 con 0x556eb30ee660 2024-02-21T23:02:44.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.349+0000 7fa14be00640 1 -- 172.21.15.99:0/3169106647 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa150018070 con 0x556eb30ee660 2024-02-21T23:02:44.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.349+0000 7fa14be00640 1 -- 172.21.15.99:0/3169106647 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa15000f8d0 con 0x556eb30ee660 2024-02-21T23:02:44.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.350+0000 7fa169871740 1 -- 172.21.15.99:0/3169106647 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556eb30ee660 msgr2=0x556eb30eea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:44.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.350+0000 7fa169871740 1 --2- 172.21.15.99:0/3169106647 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556eb30ee660 0x556eb30eea40 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa150001960 tx=0x7fa150000bc0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.350+0000 7fa169871740 1 -- 172.21.15.99:0/3169106647 shutdown_connections 2024-02-21T23:02:44.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.350+0000 7fa169871740 1 --2- 172.21.15.99:0/3169106647 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556eb3129cf0 0x556eb312a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.350+0000 7fa169871740 1 --2- 172.21.15.99:0/3169106647 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556eb3129330 0x556eb31297b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.350+0000 7fa169871740 1 --2- 172.21.15.99:0/3169106647 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556eb30ee660 0x556eb30eea40 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.350+0000 7fa169871740 1 -- 172.21.15.99:0/3169106647 >> 172.21.15.99:0/3169106647 conn(0x556eb30b06d0 msgr2=0x556eb30b1750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:44.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.350+0000 7fa169871740 1 -- 172.21.15.99:0/3169106647 shutdown_connections 2024-02-21T23:02:44.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.350+0000 7fa169871740 1 -- 172.21.15.99:0/3169106647 wait complete. 2024-02-21T23:02:44.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.351+0000 7fa169871740 1 -- start start 2024-02-21T23:02:44.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.351+0000 7fa169871740 1 Processor -- start 2024-02-21T23:02:44.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.352+0000 7fa169871740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556eb3129330 0x556eb31239c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:44.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.352+0000 7fa169871740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556eb3129cf0 0x556eb3120a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:44.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.352+0000 7fa169871740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556eb30e72b0 0x556eb311fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:44.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.352+0000 7fa169871740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x556eb31280a0 con 0x556eb3129cf0 2024-02-21T23:02:44.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.352+0000 7fa169871740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x556eb2fb5380 con 0x556eb3129330 2024-02-21T23:02:44.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.352+0000 7fa169871740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x556eb3127dc0 con 0x556eb30e72b0 2024-02-21T23:02:44.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.352+0000 7fa169871740 10 client.0 _ll_register_callbacks cb 0x556eb300e280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:02:44.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.353+0000 7fa15fe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556eb3129330 0x556eb31239c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:44.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.353+0000 7fa15fe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556eb3129330 0x556eb31239c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:38772/0 (socket says 172.21.15.99:38772) 2024-02-21T23:02:44.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.353+0000 7fa15fe00640 1 -- 172.21.15.99:0/68749228 learned_addr learned my addr 172.21.15.99:0/68749228 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:44.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.353+0000 7fa15f400640 1 --2- 172.21.15.99:0/68749228 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556eb3129cf0 0x556eb3120a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:44.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.353+0000 7fa164a00640 1 --2- 172.21.15.99:0/68749228 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556eb30e72b0 0x556eb311fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:44.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.353+0000 7fa15fe00640 1 -- 172.21.15.99:0/68749228 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556eb30e72b0 msgr2=0x556eb311fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:44.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.353+0000 7fa15fe00640 1 --2- 172.21.15.99:0/68749228 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556eb30e72b0 0x556eb311fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.353+0000 7fa15fe00640 1 -- 172.21.15.99:0/68749228 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556eb3129cf0 msgr2=0x556eb3120a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:44.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.354+0000 7fa15fe00640 1 --2- 172.21.15.99:0/68749228 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556eb3129cf0 0x556eb3120a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.354+0000 7fa15fe00640 1 -- 172.21.15.99:0/68749228 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556eb2fddc20 con 0x556eb3129330 2024-02-21T23:02:44.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.354+0000 7fa164a00640 1 --2- 172.21.15.99:0/68749228 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556eb30e72b0 0x556eb311fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:02:44.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.354+0000 7fa15f400640 1 --2- 172.21.15.99:0/68749228 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556eb3129cf0 0x556eb3120a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:02:44.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.354+0000 7fa15fe00640 1 --2- 172.21.15.99:0/68749228 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556eb3129330 0x556eb31239c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa150015040 tx=0x7fa1500010a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4643ebfd1165fcce server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:44.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.354+0000 7fa148c00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-02-21T23:02:44.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.354+0000 7fa148c00640 1 -- 172.21.15.99:0/68749228 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa150010e90 con 0x556eb3129330 2024-02-21T23:02:44.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.354+0000 7fa169871740 1 -- 172.21.15.99:0/68749228 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa150018070 con 0x556eb3129330 2024-02-21T23:02:44.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.354+0000 7fa148c00640 1 -- 172.21.15.99:0/68749228 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7fa1500070d0 con 0x556eb3129330 2024-02-21T23:02:44.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.355+0000 7fa148c00640 1 -- 172.21.15.99:0/68749228 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa150001520 con 0x556eb3129330 2024-02-21T23:02:44.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.355+0000 7fa169871740 10 client.5353 fetch_fsmap learned FSMap version 15 2024-02-21T23:02:44.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.355+0000 7fa169871740 1 -- 172.21.15.99:0/68749228 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x556eb2d2b3f0 con 0x556eb3129330 2024-02-21T23:02:44.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.355+0000 7fa148c00640 1 -- 172.21.15.99:0/68749228 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa150018070 con 0x556eb3129330 2024-02-21T23:02:44.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.355+0000 7fa148c00640 1 -- 172.21.15.99:0/68749228 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 15) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fa1500072d0 con 0x556eb3129330 2024-02-21T23:02:44.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.355+0000 7fa169871740 10 client.5353 fetch_fsmap finished waiting for FSMap version 15 2024-02-21T23:02:44.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.355+0000 7fa169871740 10 client.5353 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2024-02-21T23:02:44.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.355+0000 7fa169871740 20 client.5353 populate_metadata read hostname 'smithi099' 2024-02-21T23:02:44.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.355+0000 7fa169871740 1 --2- 172.21.15.99:0/68749228 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x556eb30e7690 0x556eb30f8810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:44.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.355+0000 7fa169871740 4 client.5353 mds_command: new command op to 4352 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:02:44.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.355+0000 7fa169871740 1 -- 172.21.15.99:0/68749228 --> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556eb3024090 con 0x556eb30e7690 2024-02-21T23:02:44.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.356+0000 7fa15f400640 1 --2- 172.21.15.99:0/68749228 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x556eb30e7690 0x556eb30f8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:44.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.356+0000 7fa15f400640 1 --2- 172.21.15.99:0/68749228 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x556eb30e7690 0x556eb30f8810 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5716300b870125c0 server_cookie=3ac3ce7faf45f094 in_seq=0 out_seq=0 2024-02-21T23:02:44.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.356+0000 7fa148c00640 10 client.5353 ms_handle_connect on v2:172.21.15.99:6836/1676159950 2024-02-21T23:02:44.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.357+0000 7fa148c00640 1 -- 172.21.15.99:0/68749228 <== mds.1 v2:172.21.15.99:6836/1676159950 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x556eb3024090 con 0x556eb30e7690 2024-02-21T23:02:44.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.357+0000 7fa148c00640 10 client.5353 handle_command_reply: tid=0 2024-02-21T23:02:44.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.357+0000 7fa169871740 1 client.5353 shutdown 2024-02-21T23:02:44.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.357+0000 7fa169871740 1 -- 172.21.15.99:0/68749228 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556eb3129330 msgr2=0x556eb31239c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:44.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.357+0000 7fa169871740 1 --2- 172.21.15.99:0/68749228 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556eb3129330 0x556eb31239c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa150015040 tx=0x7fa1500010a0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.357+0000 7fa169871740 1 -- 172.21.15.99:0/68749228 shutdown_connections 2024-02-21T23:02:44.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.357+0000 7fa169871740 1 --2- 172.21.15.99:0/68749228 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x556eb30e7690 0x556eb30f8810 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.357+0000 7fa169871740 1 --2- 172.21.15.99:0/68749228 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556eb30e72b0 0x556eb311fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.357+0000 7fa169871740 1 --2- 172.21.15.99:0/68749228 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556eb3129cf0 0x556eb3120a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.357+0000 7fa169871740 1 --2- 172.21.15.99:0/68749228 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556eb3129330 0x556eb31239c0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.357+0000 7fa148c00640 0 client.5353 ms_handle_reset on v2:172.21.15.99:6836/1676159950 2024-02-21T23:02:44.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.358+0000 7fa169871740 1 -- 172.21.15.99:0/68749228 >> 172.21.15.99:0/68749228 conn(0x556eb30ee660 msgr2=0x556eb31287b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:44.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.358+0000 7fa169871740 1 -- 172.21.15.99:0/68749228 shutdown_connections 2024-02-21T23:02:44.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.358+0000 7fa169871740 1 -- 172.21.15.99:0/68749228 wait complete. 2024-02-21T23:02:44.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.358+0000 7fa169871740 20 client.5353 trim_cache size 0 max 16384 2024-02-21T23:02:44.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.371+0000 7fa169871740 1 Processor -- start 2024-02-21T23:02:44.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.372+0000 7fa169871740 1 -- start start 2024-02-21T23:02:44.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.373+0000 7fa169871740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556eb30e72b0 0x556eb30f9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:44.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.373+0000 7fa169871740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556eb3129330 0x556eb30b8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:44.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.373+0000 7fa169871740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556eb3129cf0 0x556eb3187400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:44.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.373+0000 7fa169871740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa16022cb10 con 0x556eb30e72b0 2024-02-21T23:02:44.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.373+0000 7fa169871740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa16022a6b0 con 0x556eb3129cf0 2024-02-21T23:02:44.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.373+0000 7fa169871740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa160222ba0 con 0x556eb3129330 2024-02-21T23:02:44.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.373+0000 7fa15fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556eb30e72b0 0x556eb30f9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:44.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.373+0000 7fa15fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556eb30e72b0 0x556eb30f9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59500/0 (socket says 172.21.15.99:59500) 2024-02-21T23:02:44.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.373+0000 7fa15fe00640 1 -- 172.21.15.99:0/133979692 learned_addr learned my addr 172.21.15.99:0/133979692 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:44.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.373+0000 7fa164a00640 1 --2- 172.21.15.99:0/133979692 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556eb3129cf0 0x556eb3187400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:44.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.373+0000 7fa15f400640 1 --2- 172.21.15.99:0/133979692 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556eb3129330 0x556eb30b8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:44.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.373+0000 7fa15fe00640 1 -- 172.21.15.99:0/133979692 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556eb3129330 msgr2=0x556eb30b8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:44.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.373+0000 7fa15fe00640 1 --2- 172.21.15.99:0/133979692 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556eb3129330 0x556eb30b8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.373+0000 7fa15fe00640 1 -- 172.21.15.99:0/133979692 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556eb3129cf0 msgr2=0x556eb3187400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:44.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.373+0000 7fa15fe00640 1 --2- 172.21.15.99:0/133979692 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556eb3129cf0 0x556eb3187400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.373+0000 7fa15fe00640 1 -- 172.21.15.99:0/133979692 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556eb2df57d0 con 0x556eb30e72b0 2024-02-21T23:02:44.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.373+0000 7fa164a00640 1 --2- 172.21.15.99:0/133979692 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556eb3129cf0 0x556eb3187400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:02:44.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.374+0000 7fa15fe00640 1 --2- 172.21.15.99:0/133979692 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556eb30e72b0 0x556eb30f9180 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa1500016e0 tx=0x7fa15001f070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3764241ec16f0a14 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:44.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.374+0000 7fa14b400640 1 -- 172.21.15.99:0/133979692 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa150010cf0 con 0x556eb30e72b0 2024-02-21T23:02:44.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.374+0000 7fa14b400640 1 -- 172.21.15.99:0/133979692 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa150018040 con 0x556eb30e72b0 2024-02-21T23:02:44.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.374+0000 7fa14b400640 1 -- 172.21.15.99:0/133979692 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1500072b0 con 0x556eb30e72b0 2024-02-21T23:02:44.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.374+0000 7fa169871740 1 -- 172.21.15.99:0/133979692 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556eb30e72b0 msgr2=0x556eb30f9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:44.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.374+0000 7fa169871740 1 --2- 172.21.15.99:0/133979692 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556eb30e72b0 0x556eb30f9180 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa1500016e0 tx=0x7fa15001f070 comp rx=0 tx=0).stop 2024-02-21T23:02:44.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.375+0000 7fa169871740 1 -- 172.21.15.99:0/133979692 shutdown_connections 2024-02-21T23:02:44.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.375+0000 7fa169871740 1 --2- 172.21.15.99:0/133979692 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556eb3129cf0 0x556eb3187400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.375+0000 7fa169871740 1 --2- 172.21.15.99:0/133979692 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556eb3129330 0x556eb30b8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.375+0000 7fa169871740 1 --2- 172.21.15.99:0/133979692 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556eb30e72b0 0x556eb30f9180 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.375+0000 7fa169871740 1 -- 172.21.15.99:0/133979692 >> 172.21.15.99:0/133979692 conn(0x556eb30ee660 msgr2=0x556eb30b8dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:44.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.375+0000 7fa169871740 1 -- 172.21.15.99:0/133979692 shutdown_connections 2024-02-21T23:02:44.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.375+0000 7fa169871740 1 -- 172.21.15.99:0/133979692 wait complete. 2024-02-21T23:02:44.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.375+0000 7fa169871740 1 -- start start 2024-02-21T23:02:44.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.376+0000 7fa169871740 1 Processor -- start 2024-02-21T23:02:44.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.377+0000 7fa169871740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556eb3129330 0x556eb30e0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:44.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.377+0000 7fa169871740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556eb3129cf0 0x556eb30aded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:44.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.377+0000 7fa169871740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556eb30b7310 0x556eb30b7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:44.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.377+0000 7fa169871740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1602231a0 con 0x556eb3129330 2024-02-21T23:02:44.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.377+0000 7fa169871740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa16022a050 con 0x556eb30b7310 2024-02-21T23:02:44.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.377+0000 7fa169871740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1602293d0 con 0x556eb3129cf0 2024-02-21T23:02:44.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.377+0000 7fa169871740 10 client.0 _ll_register_callbacks cb 0x7fa1500017a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:02:44.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.377+0000 7fa15f400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556eb3129cf0 0x556eb30aded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:44.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.377+0000 7fa164a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556eb30b7310 0x556eb30b7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:44.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.377+0000 7fa15fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556eb3129330 0x556eb30e0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:44.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.377+0000 7fa164a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556eb30b7310 0x556eb30b7fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:38798/0 (socket says 172.21.15.99:38798) 2024-02-21T23:02:44.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.377+0000 7fa15f400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556eb3129cf0 0x556eb30aded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:51644/0 (socket says 172.21.15.99:51644) 2024-02-21T23:02:44.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.377+0000 7fa164a00640 1 -- 172.21.15.99:0/1257665204 learned_addr learned my addr 172.21.15.99:0/1257665204 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:44.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.378+0000 7fa15f400640 1 -- 172.21.15.99:0/1257665204 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556eb30b7310 msgr2=0x556eb30b7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:44.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.378+0000 7fa15f400640 1 --2- 172.21.15.99:0/1257665204 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556eb30b7310 0x556eb30b7fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.378+0000 7fa15f400640 1 -- 172.21.15.99:0/1257665204 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556eb3129330 msgr2=0x556eb30e0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:44.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.378+0000 7fa15f400640 1 --2- 172.21.15.99:0/1257665204 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556eb3129330 0x556eb30e0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.378+0000 7fa15f400640 1 -- 172.21.15.99:0/1257665204 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556eb30e1290 con 0x556eb3129cf0 2024-02-21T23:02:44.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.378+0000 7fa15f400640 1 --2- 172.21.15.99:0/1257665204 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556eb3129cf0 0x556eb30aded0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa14c0c6b40 tx=0x7fa14c00a000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe99ea915b8a19da server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:44.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.378+0000 7fa148c00640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-02-21T23:02:44.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.378+0000 7fa148c00640 1 -- 172.21.15.99:0/1257665204 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14c0c6f10 con 0x556eb3129cf0 2024-02-21T23:02:44.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.378+0000 7fa169871740 1 -- 172.21.15.99:0/1257665204 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa150018040 con 0x556eb3129cf0 2024-02-21T23:02:44.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.378+0000 7fa148c00640 1 -- 172.21.15.99:0/1257665204 <== mon.2 v2:172.21.15.181:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7fa14c096170 con 0x556eb3129cf0 2024-02-21T23:02:44.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.378+0000 7fa148c00640 1 -- 172.21.15.99:0/1257665204 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa14c0b4270 con 0x556eb3129cf0 2024-02-21T23:02:44.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.378+0000 7fa169871740 10 client.5369 fetch_fsmap learned FSMap version 15 2024-02-21T23:02:44.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.378+0000 7fa169871740 1 -- 172.21.15.99:0/1257665204 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x556eb30ecb00 con 0x556eb3129cf0 2024-02-21T23:02:44.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.379+0000 7fa148c00640 1 -- 172.21.15.99:0/1257665204 <== mon.2 v2:172.21.15.181:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa150018040 con 0x556eb3129cf0 2024-02-21T23:02:44.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.379+0000 7fa148c00640 1 -- 172.21.15.99:0/1257665204 <== mon.2 v2:172.21.15.181:3300/0 5 ==== fsmap(e 15) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fa14c076b80 con 0x556eb3129cf0 2024-02-21T23:02:44.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.379+0000 7fa169871740 10 client.5369 fetch_fsmap finished waiting for FSMap version 15 2024-02-21T23:02:44.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.379+0000 7fa169871740 10 client.5369 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2024-02-21T23:02:44.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.379+0000 7fa169871740 20 client.5369 populate_metadata read hostname 'smithi099' 2024-02-21T23:02:44.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.379+0000 7fa169871740 1 --2- 172.21.15.99:0/1257665204 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x556eb3128610 0x556eb311e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:44.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.379+0000 7fa169871740 4 client.5369 mds_command: new command op to 4352 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T23:02:44.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.379+0000 7fa169871740 1 -- 172.21.15.99:0/1257665204 --> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x556eb301e3e0 con 0x556eb3128610 2024-02-21T23:02:44.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.379+0000 7fa15fe00640 1 --2- 172.21.15.99:0/1257665204 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x556eb3128610 0x556eb311e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:44.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.380+0000 7fa148c00640 10 client.5369 ms_handle_connect on v2:172.21.15.99:6836/1676159950 2024-02-21T23:02:44.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.380+0000 7fa15fe00640 1 --2- 172.21.15.99:0/1257665204 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x556eb3128610 0x556eb311e760 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=71f5715d89f75aaa server_cookie=c956e57faa91f45e in_seq=0 out_seq=0 2024-02-21T23:02:44.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.380+0000 7fa148c00640 1 -- 172.21.15.99:0/1257665204 <== mds.1 v2:172.21.15.99:6836/1676159950 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x556eb301e3e0 con 0x556eb3128610 2024-02-21T23:02:44.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.380+0000 7fa148c00640 10 client.5369 handle_command_reply: tid=0 2024-02-21T23:02:44.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.380+0000 7fa169871740 1 client.5369 shutdown 2024-02-21T23:02:44.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.380+0000 7fa169871740 1 -- 172.21.15.99:0/1257665204 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556eb3129cf0 msgr2=0x556eb30aded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:44.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.380+0000 7fa169871740 1 --2- 172.21.15.99:0/1257665204 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556eb3129cf0 0x556eb30aded0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa14c0c6b40 tx=0x7fa14c00a000 comp rx=0 tx=0).stop 2024-02-21T23:02:44.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.380+0000 7fa169871740 1 -- 172.21.15.99:0/1257665204 shutdown_connections 2024-02-21T23:02:44.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.380+0000 7fa169871740 1 --2- 172.21.15.99:0/1257665204 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x556eb3128610 0x556eb311e760 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.380+0000 7fa169871740 1 --2- 172.21.15.99:0/1257665204 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556eb30b7310 0x556eb30b7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.380+0000 7fa169871740 1 --2- 172.21.15.99:0/1257665204 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556eb3129cf0 0x556eb30aded0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.380+0000 7fa169871740 1 --2- 172.21.15.99:0/1257665204 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556eb3129330 0x556eb30e0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.380+0000 7fa169871740 1 -- 172.21.15.99:0/1257665204 >> 172.21.15.99:0/1257665204 conn(0x556eb30ee660 msgr2=0x556eb30f6ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:44.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.381+0000 7fa148c00640 0 client.5369 ms_handle_reset on v2:172.21.15.99:6836/1676159950 2024-02-21T23:02:44.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.381+0000 7fa169871740 1 -- 172.21.15.99:0/1257665204 shutdown_connections 2024-02-21T23:02:44.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.381+0000 7fa169871740 1 -- 172.21.15.99:0/1257665204 wait complete. 2024-02-21T23:02:44.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.381+0000 7fa169871740 20 client.5369 trim_cache size 0 max 16384 2024-02-21T23:02:44.374 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-02-21T23:02:44.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.382+0000 7fa165400640 1 -- 172.21.15.99:0/1640170471 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa14009ef60 msgr2=0x7fa1400a1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:44.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.382+0000 7fa165400640 1 --2- 172.21.15.99:0/1640170471 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa14009ef60 0x7fa1400a1420 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa158036000 tx=0x7fa158030000 comp rx=0 tx=0).stop 2024-02-21T23:02:44.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.382+0000 7fa165400640 1 -- 172.21.15.99:0/1640170471 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa1600fd4d0 msgr2=0x7fa16016e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:44.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.382+0000 7fa165400640 1 --2- 172.21.15.99:0/1640170471 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa1600fd4d0 0x7fa16016e0b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa14c00c3c0 tx=0x7fa14c00c880 comp rx=0 tx=0).stop 2024-02-21T23:02:44.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.382+0000 7fa165400640 1 -- 172.21.15.99:0/1640170471 shutdown_connections 2024-02-21T23:02:44.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.382+0000 7fa165400640 1 --2- 172.21.15.99:0/1640170471 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa14009ef60 0x7fa1400a1420 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.382+0000 7fa165400640 1 --2- 172.21.15.99:0/1640170471 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa160182cd0 0x7fa16021ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.382+0000 7fa165400640 1 --2- 172.21.15.99:0/1640170471 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa1600fd4d0 0x7fa16016e0b0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.382+0000 7fa165400640 1 --2- 172.21.15.99:0/1640170471 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa1600f8e20 0x7fa1602129e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.382+0000 7fa165400640 1 -- 172.21.15.99:0/1640170471 >> 172.21.15.99:0/1640170471 conn(0x7fa1600fe4a0 msgr2=0x7fa160189d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:44.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.382+0000 7fa165400640 1 -- 172.21.15.99:0/1640170471 shutdown_connections 2024-02-21T23:02:44.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.382+0000 7fa165400640 1 -- 172.21.15.99:0/1640170471 wait complete. 2024-02-21T23:02:44.392 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T23:02:44.392 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-02-21T23:02:44.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.603+0000 7fde89a00640 1 Processor -- start 2024-02-21T23:02:44.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.603+0000 7fde89a00640 1 -- start start 2024-02-21T23:02:44.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.606+0000 7fde89a00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fde8417f490 0x7fde8418ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:44.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.606+0000 7fde89a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fde8418b4f0 0x7fde840fd290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:44.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.606+0000 7fde89a00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde840d6dd0 con 0x7fde8418b060 2024-02-21T23:02:44.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.606+0000 7fde89a00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde841614c0 con 0x7fde8418b4f0 2024-02-21T23:02:44.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.606+0000 7fde89a00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde840d6810 con 0x7fde8417f490 2024-02-21T23:02:44.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.607+0000 7fde83400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fde8418b060 0x7fde84188a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:48642/0 (socket says 172.21.15.99:48642) 2024-02-21T23:02:44.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.607+0000 7fde83400640 1 -- 172.21.15.99:0/547756774 learned_addr learned my addr 172.21.15.99:0/547756774 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:02:44.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.607+0000 7fde83e00640 1 --2- 172.21.15.99:0/547756774 >> v2:172.21.15.181:3300/0 conn(0x7fde8417f490 0x7fde8418ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:44.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.607+0000 7fde89000640 1 --2- 172.21.15.99:0/547756774 >> v2:172.21.15.162:3300/0 conn(0x7fde8418b4f0 0x7fde840fd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:44.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.607+0000 7fde83e00640 1 -- 172.21.15.99:0/547756774 >> v2:172.21.15.162:3300/0 conn(0x7fde8418b4f0 msgr2=0x7fde840fd290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:44.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.607+0000 7fde83e00640 1 --2- 172.21.15.99:0/547756774 >> v2:172.21.15.162:3300/0 conn(0x7fde8418b4f0 0x7fde840fd290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.607+0000 7fde83e00640 1 -- 172.21.15.99:0/547756774 >> v1:172.21.15.99:6789/0 conn(0x7fde8418b060 legacy=0x7fde84188a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:44.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.607+0000 7fde83e00640 1 -- 172.21.15.99:0/547756774 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde840d6af0 con 0x7fde8417f490 2024-02-21T23:02:44.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.609+0000 7fde83e00640 1 --2- 172.21.15.99:0/547756774 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fde8417f490 0x7fde8418ab20 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fde84067c30 tx=0x7fde7402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a3226b87c51606b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:44.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.609+0000 7fde82a00640 1 -- 172.21.15.99:0/547756774 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde74035020 con 0x7fde8417f490 2024-02-21T23:02:44.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.609+0000 7fde82a00640 1 -- 172.21.15.99:0/547756774 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde74031830 con 0x7fde8417f490 2024-02-21T23:02:44.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.609+0000 7fde82a00640 1 -- 172.21.15.99:0/547756774 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde74031c00 con 0x7fde8417f490 2024-02-21T23:02:44.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.610+0000 7fde89a00640 1 -- 172.21.15.99:0/547756774 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fde8417f490 msgr2=0x7fde8418ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:44.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.610+0000 7fde89a00640 1 --2- 172.21.15.99:0/547756774 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fde8417f490 0x7fde8418ab20 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fde84067c30 tx=0x7fde7402b8d0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.610+0000 7fde89a00640 1 -- 172.21.15.99:0/547756774 shutdown_connections 2024-02-21T23:02:44.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.610+0000 7fde89a00640 1 --2- 172.21.15.99:0/547756774 >> v2:172.21.15.162:3300/0 conn(0x7fde8418b4f0 0x7fde840fd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.610+0000 7fde89a00640 1 --2- 172.21.15.99:0/547756774 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fde8417f490 0x7fde8418ab20 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.610+0000 7fde89a00640 1 -- 172.21.15.99:0/547756774 >> 172.21.15.99:0/547756774 conn(0x7fde840d29b0 msgr2=0x7fde840d2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:44.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.610+0000 7fde89a00640 1 -- 172.21.15.99:0/547756774 shutdown_connections 2024-02-21T23:02:44.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.610+0000 7fde89a00640 1 -- 172.21.15.99:0/547756774 wait complete. 2024-02-21T23:02:44.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.612+0000 7fde89a00640 1 Processor -- start 2024-02-21T23:02:44.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.612+0000 7fde89a00640 1 -- start start 2024-02-21T23:02:44.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.613+0000 7fde89a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fde8417f490 0x7fde8417ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:44.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.613+0000 7fde89a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fde8418b060 0x7fde84222a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:44.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.613+0000 7fde89a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde8418b4f0 0x7fde8415cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:44.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.613+0000 7fde89a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde8418a600 con 0x7fde8417f490 2024-02-21T23:02:44.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.613+0000 7fde89a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde8418a320 con 0x7fde8418b4f0 2024-02-21T23:02:44.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.613+0000 7fde89a00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde8417f870 con 0x7fde8418b060 2024-02-21T23:02:44.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.614+0000 7fde83e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fde8417f490 0x7fde8417ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:44.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.614+0000 7fde83e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fde8417f490 0x7fde8417ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59518/0 (socket says 172.21.15.99:59518) 2024-02-21T23:02:44.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.614+0000 7fde83e00640 1 -- 172.21.15.99:0/4037082031 learned_addr learned my addr 172.21.15.99:0/4037082031 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:44.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.614+0000 7fde89000640 1 --2- 172.21.15.99:0/4037082031 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde8418b4f0 0x7fde8415cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:44.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.614+0000 7fde83400640 1 --2- 172.21.15.99:0/4037082031 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fde8418b060 0x7fde84222a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:44.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.614+0000 7fde83e00640 1 -- 172.21.15.99:0/4037082031 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fde8418b060 msgr2=0x7fde84222a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:44.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.614+0000 7fde83e00640 1 --2- 172.21.15.99:0/4037082031 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fde8418b060 0x7fde84222a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.614+0000 7fde83e00640 1 -- 172.21.15.99:0/4037082031 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde8418b4f0 msgr2=0x7fde8415cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:44.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.614+0000 7fde83e00640 1 --2- 172.21.15.99:0/4037082031 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde8418b4f0 0x7fde8415cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.614+0000 7fde83e00640 1 -- 172.21.15.99:0/4037082031 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde8417d310 con 0x7fde8417f490 2024-02-21T23:02:44.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.614+0000 7fde89000640 1 --2- 172.21.15.99:0/4037082031 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde8418b4f0 0x7fde8415cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:02:44.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.615+0000 7fde83e00640 1 --2- 172.21.15.99:0/4037082031 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fde8417f490 0x7fde8417ccb0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fde74000c00 tx=0x7fde740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:44.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.615+0000 7fde7be00640 1 -- 172.21.15.99:0/4037082031 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde74040070 con 0x7fde8417f490 2024-02-21T23:02:44.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.615+0000 7fde7be00640 1 -- 172.21.15.99:0/4037082031 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde7403a910 con 0x7fde8417f490 2024-02-21T23:02:44.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.615+0000 7fde89a00640 1 -- 172.21.15.99:0/4037082031 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde8417d5f0 con 0x7fde8417f490 2024-02-21T23:02:44.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.615+0000 7fde7be00640 1 -- 172.21.15.99:0/4037082031 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde74035040 con 0x7fde8417f490 2024-02-21T23:02:44.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.615+0000 7fde89a00640 1 -- 172.21.15.99:0/4037082031 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde8417dbb0 con 0x7fde8417f490 2024-02-21T23:02:44.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.620+0000 7fde7be00640 1 -- 172.21.15.99:0/4037082031 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 12) v1 ==== 134532+0+0 (secure 0 0 0) 0x7fde7404b060 con 0x7fde8417f490 2024-02-21T23:02:44.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.621+0000 7fde8ddfc740 1 Processor -- start 2024-02-21T23:02:44.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.621+0000 7fde8ddfc740 1 -- start start 2024-02-21T23:02:44.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.622+0000 7fde7be00640 1 --2- 172.21.15.99:0/4037082031 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fde6409ef60 0x7fde640a1420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:44.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.622+0000 7fde7be00640 1 -- 172.21.15.99:0/4037082031 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7fde740eb980 con 0x7fde8417f490 2024-02-21T23:02:44.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.622+0000 7fde89000640 1 --2- 172.21.15.99:0/4037082031 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fde6409ef60 0x7fde640a1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:44.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.623+0000 7fde8ddfc740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f24a05f660 0x55f24a05fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:44.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.623+0000 7fde8ddfc740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f24a09a330 0x55f24a09a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:44.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.623+0000 7fde8ddfc740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f24a09acf0 0x55f24a09b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:44.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.623+0000 7fde8ddfc740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f249f87b50 con 0x55f24a09acf0 2024-02-21T23:02:44.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.623+0000 7fde8ddfc740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f249f30da0 con 0x55f24a05f660 2024-02-21T23:02:44.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.623+0000 7fde8ddfc740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f249f83bf0 con 0x55f24a09a330 2024-02-21T23:02:44.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.623+0000 7fde83e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f24a05f660 0x55f24a05fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:44.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.623+0000 7fde83e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f24a05f660 0x55f24a05fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:38820/0 (socket says 172.21.15.99:38820) 2024-02-21T23:02:44.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.623+0000 7fde83e00640 1 -- 172.21.15.99:0/1458082875 learned_addr learned my addr 172.21.15.99:0/1458082875 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:44.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.623+0000 7fde89000640 1 --2- 172.21.15.99:0/4037082031 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fde6409ef60 0x7fde640a1420 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fde7c0074c0 tx=0x7fde7c00b040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:44.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.624+0000 7fde89000640 1 --2- 172.21.15.99:0/1458082875 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f24a09acf0 0x55f24a09b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:44.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.624+0000 7fde83400640 1 --2- 172.21.15.99:0/1458082875 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f24a09a330 0x55f24a09a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:44.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.624+0000 7fde83e00640 1 -- 172.21.15.99:0/1458082875 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f24a09a330 msgr2=0x55f24a09a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:44.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.624+0000 7fde83e00640 1 --2- 172.21.15.99:0/1458082875 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f24a09a330 0x55f24a09a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.624+0000 7fde83e00640 1 -- 172.21.15.99:0/1458082875 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f24a09acf0 msgr2=0x55f24a09b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:44.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.624+0000 7fde83e00640 1 --2- 172.21.15.99:0/1458082875 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f24a09acf0 0x55f24a09b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.624+0000 7fde83e00640 1 -- 172.21.15.99:0/1458082875 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f249f53f80 con 0x55f24a05f660 2024-02-21T23:02:44.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.624+0000 7fde83e00640 1 --2- 172.21.15.99:0/1458082875 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f24a05f660 0x55f24a05fa40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fde7402b910 tx=0x7fde74009190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f9fb67a9e8c751e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:44.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.624+0000 7fde78c00640 1 -- 172.21.15.99:0/1458082875 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde740b90b0 con 0x55f24a05f660 2024-02-21T23:02:44.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.624+0000 7fde78c00640 1 -- 172.21.15.99:0/1458082875 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde740bd200 con 0x55f24a05f660 2024-02-21T23:02:44.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.624+0000 7fde78c00640 1 -- 172.21.15.99:0/1458082875 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde740c1850 con 0x55f24a05f660 2024-02-21T23:02:44.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.625+0000 7fde8ddfc740 1 -- 172.21.15.99:0/1458082875 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f24a05f660 msgr2=0x55f24a05fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:44.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.625+0000 7fde8ddfc740 1 --2- 172.21.15.99:0/1458082875 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f24a05f660 0x55f24a05fa40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fde7402b910 tx=0x7fde74009190 comp rx=0 tx=0).stop 2024-02-21T23:02:44.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.625+0000 7fde8ddfc740 1 -- 172.21.15.99:0/1458082875 shutdown_connections 2024-02-21T23:02:44.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.625+0000 7fde8ddfc740 1 --2- 172.21.15.99:0/1458082875 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f24a09acf0 0x55f24a09b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.625+0000 7fde8ddfc740 1 --2- 172.21.15.99:0/1458082875 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f24a09a330 0x55f24a09a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.625+0000 7fde8ddfc740 1 --2- 172.21.15.99:0/1458082875 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f24a05f660 0x55f24a05fa40 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.625+0000 7fde8ddfc740 1 -- 172.21.15.99:0/1458082875 >> 172.21.15.99:0/1458082875 conn(0x55f24a0216d0 msgr2=0x55f24a022750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:44.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.625+0000 7fde8ddfc740 1 -- 172.21.15.99:0/1458082875 shutdown_connections 2024-02-21T23:02:44.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.625+0000 7fde8ddfc740 1 -- 172.21.15.99:0/1458082875 wait complete. 2024-02-21T23:02:44.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.627+0000 7fde8ddfc740 1 -- start start 2024-02-21T23:02:44.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.627+0000 7fde8ddfc740 1 Processor -- start 2024-02-21T23:02:44.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.629+0000 7fde8ddfc740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f24a09a330 0x55f24a068a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:44.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.629+0000 7fde8ddfc740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f24a09acf0 0x55f24a04f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:44.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.629+0000 7fde8ddfc740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f24a0946b0 0x55f24a093d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:44.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.629+0000 7fde8ddfc740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f249f87b50 con 0x55f24a09acf0 2024-02-21T23:02:44.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.629+0000 7fde8ddfc740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f249f26380 con 0x55f24a0946b0 2024-02-21T23:02:44.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.629+0000 7fde8ddfc740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f249f30da0 con 0x55f24a09a330 2024-02-21T23:02:44.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.629+0000 7fde8ddfc740 10 client.0 _ll_register_callbacks cb 0x55f249f7f280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:02:44.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.629+0000 7fde83e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f24a09a330 0x55f24a068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:44.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.629+0000 7fde83e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f24a09a330 0x55f24a068a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:51666/0 (socket says 172.21.15.99:51666) 2024-02-21T23:02:44.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.629+0000 7fde83e00640 1 -- 172.21.15.99:0/514916802 learned_addr learned my addr 172.21.15.99:0/514916802 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:44.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.629+0000 7fde83400640 1 --2- 172.21.15.99:0/514916802 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f24a09acf0 0x55f24a04f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:44.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.630+0000 7fde89000640 1 --2- 172.21.15.99:0/514916802 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f24a0946b0 0x55f24a093d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:44.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.630+0000 7fde83e00640 1 -- 172.21.15.99:0/514916802 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f24a0946b0 msgr2=0x55f24a093d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:44.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.630+0000 7fde83e00640 1 --2- 172.21.15.99:0/514916802 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f24a0946b0 0x55f24a093d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.630+0000 7fde83e00640 1 -- 172.21.15.99:0/514916802 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f24a09acf0 msgr2=0x55f24a04f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:44.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.630+0000 7fde83e00640 1 --2- 172.21.15.99:0/514916802 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f24a09acf0 0x55f24a04f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.630+0000 7fde83e00640 1 -- 172.21.15.99:0/514916802 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f249f4ec20 con 0x55f24a09a330 2024-02-21T23:02:44.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.630+0000 7fde83e00640 1 --2- 172.21.15.99:0/514916802 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f24a09a330 0x55f24a068a10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fde740b8db0 tx=0x7fde7402bdf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dfe9256d0792228 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:44.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.630+0000 7fde6d600640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-02-21T23:02:44.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.630+0000 7fde6d600640 1 -- 172.21.15.99:0/514916802 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7409d060 con 0x55f24a09a330 2024-02-21T23:02:44.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.630+0000 7fde6d600640 1 -- 172.21.15.99:0/514916802 <== mon.2 v2:172.21.15.181:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7fde740e90c0 con 0x55f24a09a330 2024-02-21T23:02:44.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.630+0000 7fde8ddfc740 1 -- 172.21.15.99:0/514916802 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fde740bd200 con 0x55f24a09a330 2024-02-21T23:02:44.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.631+0000 7fde6d600640 1 -- 172.21.15.99:0/514916802 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7fde740b90b0 con 0x55f24a09a330 2024-02-21T23:02:44.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.631+0000 7fde8ddfc740 10 client.5381 fetch_fsmap learned FSMap version 15 2024-02-21T23:02:44.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.631+0000 7fde8ddfc740 1 -- 172.21.15.99:0/514916802 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x55f249c9c3f0 con 0x55f24a09a330 2024-02-21T23:02:44.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.631+0000 7fde6d600640 1 -- 172.21.15.99:0/514916802 <== mon.2 v2:172.21.15.181:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde740bd200 con 0x55f24a09a330 2024-02-21T23:02:44.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.631+0000 7fde6d600640 1 -- 172.21.15.99:0/514916802 <== mon.2 v2:172.21.15.181:3300/0 5 ==== fsmap(e 15) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fde740b8500 con 0x55f24a09a330 2024-02-21T23:02:44.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.631+0000 7fde8ddfc740 10 client.5381 fetch_fsmap finished waiting for FSMap version 15 2024-02-21T23:02:44.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.631+0000 7fde8ddfc740 10 client.5381 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:02:44.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.631+0000 7fde8ddfc740 20 client.5381 populate_metadata read hostname 'smithi099' 2024-02-21T23:02:44.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.631+0000 7fde8ddfc740 1 --2- 172.21.15.99:0/514916802 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55f24a094280 0x55f24a063eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:44.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.631+0000 7fde8ddfc740 4 client.5381 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:02:44.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.631+0000 7fde8ddfc740 1 -- 172.21.15.99:0/514916802 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f249f95090 con 0x55f24a094280 2024-02-21T23:02:44.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.632+0000 7fde83400640 1 --2- 172.21.15.99:0/514916802 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55f24a094280 0x55f24a063eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:44.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.632+0000 7fde83400640 1 --2- 172.21.15.99:0/514916802 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55f24a094280 0x55f24a063eb0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55460bfd7e638dd8 server_cookie=262662d0aba9ec33 in_seq=0 out_seq=0 2024-02-21T23:02:44.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.632+0000 7fde6d600640 10 client.5381 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:02:44.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.633+0000 7fde6d600640 1 -- 172.21.15.99:0/514916802 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55f249f95090 con 0x55f24a094280 2024-02-21T23:02:44.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.633+0000 7fde6d600640 10 client.5381 handle_command_reply: tid=0 2024-02-21T23:02:44.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.633+0000 7fde8ddfc740 1 client.5381 shutdown 2024-02-21T23:02:44.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.634+0000 7fde8ddfc740 1 -- 172.21.15.99:0/514916802 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f24a09a330 msgr2=0x55f24a068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:44.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.634+0000 7fde8ddfc740 1 --2- 172.21.15.99:0/514916802 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f24a09a330 0x55f24a068a10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fde740b8db0 tx=0x7fde7402bdf0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.634+0000 7fde8ddfc740 1 -- 172.21.15.99:0/514916802 shutdown_connections 2024-02-21T23:02:44.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.634+0000 7fde8ddfc740 1 --2- 172.21.15.99:0/514916802 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55f24a094280 0x55f24a063eb0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.634+0000 7fde8ddfc740 1 --2- 172.21.15.99:0/514916802 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f24a0946b0 0x55f24a093d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.634+0000 7fde8ddfc740 1 --2- 172.21.15.99:0/514916802 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f24a09acf0 0x55f24a04f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.634+0000 7fde6d600640 0 client.5381 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:02:44.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.634+0000 7fde8ddfc740 1 --2- 172.21.15.99:0/514916802 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f24a09a330 0x55f24a068a10 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.634+0000 7fde8ddfc740 1 -- 172.21.15.99:0/514916802 >> 172.21.15.99:0/514916802 conn(0x55f24a05f660 msgr2=0x55f24a09be10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:44.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.634+0000 7fde8ddfc740 1 -- 172.21.15.99:0/514916802 shutdown_connections 2024-02-21T23:02:44.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.634+0000 7fde8ddfc740 1 -- 172.21.15.99:0/514916802 wait complete. 2024-02-21T23:02:44.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.634+0000 7fde8ddfc740 20 client.5381 trim_cache size 0 max 16384 2024-02-21T23:02:44.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.648+0000 7fde8ddfc740 1 Processor -- start 2024-02-21T23:02:44.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.648+0000 7fde8ddfc740 1 -- start start 2024-02-21T23:02:44.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.649+0000 7fde8ddfc740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f24a0946b0 0x55f24a063eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:44.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.649+0000 7fde8ddfc740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f24a09a330 0x55f24a09a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:44.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.649+0000 7fde8ddfc740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f24a09acf0 0x55f24a0196c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:44.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.649+0000 7fde8ddfc740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde8422c9f0 con 0x55f24a09a330 2024-02-21T23:02:44.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.649+0000 7fde8ddfc740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde8422a590 con 0x55f24a09acf0 2024-02-21T23:02:44.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.649+0000 7fde8ddfc740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde84228690 con 0x55f24a0946b0 2024-02-21T23:02:44.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.649+0000 7fde83400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f24a09a330 0x55f24a09a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:44.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.649+0000 7fde83400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f24a09a330 0x55f24a09a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59534/0 (socket says 172.21.15.99:59534) 2024-02-21T23:02:44.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.649+0000 7fde83400640 1 -- 172.21.15.99:0/1074539876 learned_addr learned my addr 172.21.15.99:0/1074539876 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:44.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.649+0000 7fde83e00640 1 --2- 172.21.15.99:0/1074539876 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f24a0946b0 0x55f24a063eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:44.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.649+0000 7fde89000640 1 --2- 172.21.15.99:0/1074539876 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f24a09acf0 0x55f24a0196c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:44.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.650+0000 7fde83400640 1 -- 172.21.15.99:0/1074539876 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f24a0946b0 msgr2=0x55f24a063eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:44.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.650+0000 7fde83400640 1 --2- 172.21.15.99:0/1074539876 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f24a0946b0 0x55f24a063eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.650+0000 7fde83400640 1 -- 172.21.15.99:0/1074539876 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f24a09acf0 msgr2=0x55f24a0196c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:44.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.650+0000 7fde83400640 1 --2- 172.21.15.99:0/1074539876 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f24a09acf0 0x55f24a0196c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.650+0000 7fde83400640 1 -- 172.21.15.99:0/1074539876 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f249d667d0 con 0x55f24a09a330 2024-02-21T23:02:44.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.650+0000 7fde83400640 1 --2- 172.21.15.99:0/1074539876 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f24a09a330 0x55f24a09a710 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fde8417b7d0 tx=0x7fde70007570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c5d0909ce8519a3 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:44.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.650+0000 7fde6fe00640 1 -- 172.21.15.99:0/1074539876 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde700076a0 con 0x55f24a09a330 2024-02-21T23:02:44.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.650+0000 7fde6fe00640 1 -- 172.21.15.99:0/1074539876 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde70018110 con 0x55f24a09a330 2024-02-21T23:02:44.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.650+0000 7fde6fe00640 1 -- 172.21.15.99:0/1074539876 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde70018ad0 con 0x55f24a09a330 2024-02-21T23:02:44.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.651+0000 7fde8ddfc740 1 -- 172.21.15.99:0/1074539876 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f24a09a330 msgr2=0x55f24a09a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:44.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.651+0000 7fde8ddfc740 1 --2- 172.21.15.99:0/1074539876 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f24a09a330 0x55f24a09a710 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fde8417b7d0 tx=0x7fde70007570 comp rx=0 tx=0).stop 2024-02-21T23:02:44.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.651+0000 7fde8ddfc740 1 -- 172.21.15.99:0/1074539876 shutdown_connections 2024-02-21T23:02:44.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.651+0000 7fde8ddfc740 1 --2- 172.21.15.99:0/1074539876 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f24a09acf0 0x55f24a0196c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.651+0000 7fde8ddfc740 1 --2- 172.21.15.99:0/1074539876 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f24a09a330 0x55f24a09a710 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.651+0000 7fde8ddfc740 1 --2- 172.21.15.99:0/1074539876 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f24a0946b0 0x55f24a063eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.651+0000 7fde8ddfc740 1 -- 172.21.15.99:0/1074539876 >> 172.21.15.99:0/1074539876 conn(0x55f24a05f660 msgr2=0x55f24a04f6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:44.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.651+0000 7fde8ddfc740 1 -- 172.21.15.99:0/1074539876 shutdown_connections 2024-02-21T23:02:44.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.651+0000 7fde8ddfc740 1 -- 172.21.15.99:0/1074539876 wait complete. 2024-02-21T23:02:44.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.652+0000 7fde8ddfc740 1 -- start start 2024-02-21T23:02:44.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.653+0000 7fde8ddfc740 1 Processor -- start 2024-02-21T23:02:44.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.655+0000 7fde8ddfc740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f24a0946b0 0x55f24a0f1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:44.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.655+0000 7fde8ddfc740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f24a09a330 0x55f24a0e96d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:44.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.655+0000 7fde8ddfc740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f24a09acf0 0x55f24a062790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:44.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.655+0000 7fde8ddfc740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde84228c90 con 0x55f24a09acf0 2024-02-21T23:02:44.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.655+0000 7fde8ddfc740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde84229f30 con 0x55f24a09a330 2024-02-21T23:02:44.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.655+0000 7fde8ddfc740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde84229290 con 0x55f24a0946b0 2024-02-21T23:02:44.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.655+0000 7fde8ddfc740 10 client.0 _ll_register_callbacks cb 0x7fde740b8c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:02:44.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.655+0000 7fde89000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f24a09acf0 0x55f24a062790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:44.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.655+0000 7fde83e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f24a0946b0 0x55f24a0f1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:44.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.655+0000 7fde89000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f24a09acf0 0x55f24a062790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59540/0 (socket says 172.21.15.99:59540) 2024-02-21T23:02:44.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.655+0000 7fde83e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f24a0946b0 0x55f24a0f1f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:51682/0 (socket says 172.21.15.99:51682) 2024-02-21T23:02:44.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.655+0000 7fde89000640 1 -- 172.21.15.99:0/1598305941 learned_addr learned my addr 172.21.15.99:0/1598305941 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:44.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.655+0000 7fde83400640 1 --2- 172.21.15.99:0/1598305941 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f24a09a330 0x55f24a0e96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:44.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.655+0000 7fde83e00640 1 -- 172.21.15.99:0/1598305941 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f24a09a330 msgr2=0x55f24a0e96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:44.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.655+0000 7fde83e00640 1 --2- 172.21.15.99:0/1598305941 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f24a09a330 0x55f24a0e96d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.655+0000 7fde83e00640 1 -- 172.21.15.99:0/1598305941 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f24a09acf0 msgr2=0x55f24a062790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:44.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.655+0000 7fde83e00640 1 --2- 172.21.15.99:0/1598305941 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f24a09acf0 0x55f24a062790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.655+0000 7fde83e00640 1 -- 172.21.15.99:0/1598305941 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f24a0f2460 con 0x55f24a0946b0 2024-02-21T23:02:44.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.655+0000 7fde89000640 1 --2- 172.21.15.99:0/1598305941 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f24a09acf0 0x55f24a062790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:02:44.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.656+0000 7fde83e00640 1 --2- 172.21.15.99:0/1598305941 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f24a0946b0 0x55f24a0f1f20 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fde740b7360 tx=0x7fde7403c040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe0e7e265ac2015d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:44.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.656+0000 7fde6d600640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-02-21T23:02:44.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.656+0000 7fde6d600640 1 -- 172.21.15.99:0/1598305941 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7409d040 con 0x55f24a0946b0 2024-02-21T23:02:44.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.656+0000 7fde6d600640 1 -- 172.21.15.99:0/1598305941 <== mon.2 v2:172.21.15.181:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7fde740a2490 con 0x55f24a0946b0 2024-02-21T23:02:44.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.656+0000 7fde8ddfc740 1 -- 172.21.15.99:0/1598305941 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fde70018110 con 0x55f24a0946b0 2024-02-21T23:02:44.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.656+0000 7fde6d600640 1 -- 172.21.15.99:0/1598305941 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7fde740b5350 con 0x55f24a0946b0 2024-02-21T23:02:44.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.656+0000 7fde8ddfc740 10 client.5387 fetch_fsmap learned FSMap version 15 2024-02-21T23:02:44.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.656+0000 7fde8ddfc740 1 -- 172.21.15.99:0/1598305941 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x55f24a0f2460 con 0x55f24a0946b0 2024-02-21T23:02:44.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.656+0000 7fde6d600640 1 -- 172.21.15.99:0/1598305941 <== mon.2 v2:172.21.15.181:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde70018110 con 0x55f24a0946b0 2024-02-21T23:02:44.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.657+0000 7fde6d600640 1 -- 172.21.15.99:0/1598305941 <== mon.2 v2:172.21.15.181:3300/0 5 ==== fsmap(e 15) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fde740e90c0 con 0x55f24a0946b0 2024-02-21T23:02:44.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.657+0000 7fde8ddfc740 10 client.5387 fetch_fsmap finished waiting for FSMap version 15 2024-02-21T23:02:44.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.657+0000 7fde8ddfc740 10 client.5387 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:02:44.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.657+0000 7fde8ddfc740 20 client.5387 populate_metadata read hostname 'smithi099' 2024-02-21T23:02:44.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.657+0000 7fde8ddfc740 1 --2- 172.21.15.99:0/1598305941 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55f24a0546d0 0x55f24a106880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:44.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.657+0000 7fde8ddfc740 4 client.5387 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T23:02:44.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.657+0000 7fde8ddfc740 1 -- 172.21.15.99:0/1598305941 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55f24a021e30 con 0x55f24a0546d0 2024-02-21T23:02:44.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.657+0000 7fde83400640 1 --2- 172.21.15.99:0/1598305941 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55f24a0546d0 0x55f24a106880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:44.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.658+0000 7fde83400640 1 --2- 172.21.15.99:0/1598305941 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55f24a0546d0 0x55f24a106880 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2dcb8b1c653902d server_cookie=71848e1525078dc1 in_seq=0 out_seq=0 2024-02-21T23:02:44.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.658+0000 7fde6d600640 10 client.5387 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:02:44.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.658+0000 7fde6d600640 1 -- 172.21.15.99:0/1598305941 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55f24a021e30 con 0x55f24a0546d0 2024-02-21T23:02:44.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.658+0000 7fde6d600640 10 client.5387 handle_command_reply: tid=0 2024-02-21T23:02:44.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.658+0000 7fde8ddfc740 1 client.5387 shutdown 2024-02-21T23:02:44.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.658+0000 7fde8ddfc740 1 -- 172.21.15.99:0/1598305941 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f24a0946b0 msgr2=0x55f24a0f1f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:44.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.658+0000 7fde8ddfc740 1 --2- 172.21.15.99:0/1598305941 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f24a0946b0 0x55f24a0f1f20 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fde740b7360 tx=0x7fde7403c040 comp rx=0 tx=0).stop 2024-02-21T23:02:44.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.658+0000 7fde8ddfc740 1 -- 172.21.15.99:0/1598305941 shutdown_connections 2024-02-21T23:02:44.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.658+0000 7fde8ddfc740 1 --2- 172.21.15.99:0/1598305941 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55f24a0546d0 0x55f24a106880 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.658+0000 7fde8ddfc740 1 --2- 172.21.15.99:0/1598305941 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f24a09acf0 0x55f24a062790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.658+0000 7fde8ddfc740 1 --2- 172.21.15.99:0/1598305941 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f24a09a330 0x55f24a0e96d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.658+0000 7fde8ddfc740 1 --2- 172.21.15.99:0/1598305941 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f24a0946b0 0x55f24a0f1f20 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.658+0000 7fde8ddfc740 1 -- 172.21.15.99:0/1598305941 >> 172.21.15.99:0/1598305941 conn(0x55f24a05f660 msgr2=0x55f24a0980a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:44.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.658+0000 7fde6d600640 0 client.5387 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:02:44.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.659+0000 7fde8ddfc740 1 -- 172.21.15.99:0/1598305941 shutdown_connections 2024-02-21T23:02:44.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.659+0000 7fde8ddfc740 1 -- 172.21.15.99:0/1598305941 wait complete. 2024-02-21T23:02:44.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.659+0000 7fde8ddfc740 20 client.5387 trim_cache size 0 max 16384 2024-02-21T23:02:44.651 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-02-21T23:02:44.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.660+0000 7fde89a00640 1 -- 172.21.15.99:0/4037082031 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fde6409ef60 msgr2=0x7fde640a1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:44.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.660+0000 7fde89a00640 1 --2- 172.21.15.99:0/4037082031 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fde6409ef60 0x7fde640a1420 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fde7c0074c0 tx=0x7fde7c00b040 comp rx=0 tx=0).stop 2024-02-21T23:02:44.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.660+0000 7fde89a00640 1 -- 172.21.15.99:0/4037082031 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fde8417f490 msgr2=0x7fde8417ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:44.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.660+0000 7fde89a00640 1 --2- 172.21.15.99:0/4037082031 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fde8417f490 0x7fde8417ccb0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fde74000c00 tx=0x7fde740046c0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.660+0000 7fde89a00640 1 -- 172.21.15.99:0/4037082031 shutdown_connections 2024-02-21T23:02:44.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.660+0000 7fde89a00640 1 --2- 172.21.15.99:0/4037082031 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fde6409ef60 0x7fde640a1420 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.660+0000 7fde89a00640 1 --2- 172.21.15.99:0/4037082031 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde8418b4f0 0x7fde8415cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.660+0000 7fde89a00640 1 --2- 172.21.15.99:0/4037082031 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fde8418b060 0x7fde84222a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.660+0000 7fde89a00640 1 --2- 172.21.15.99:0/4037082031 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fde8417f490 0x7fde8417ccb0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:44.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.660+0000 7fde89a00640 1 -- 172.21.15.99:0/4037082031 >> 172.21.15.99:0/4037082031 conn(0x7fde840d29b0 msgr2=0x7fde840d08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:44.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.660+0000 7fde89a00640 1 -- 172.21.15.99:0/4037082031 shutdown_connections 2024-02-21T23:02:44.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:44.660+0000 7fde89a00640 1 -- 172.21.15.99:0/4037082031 wait complete. 2024-02-21T23:02:45.673 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-02-21T23:02:45.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T23:02:45.673 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-02-21T23:02:45.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.897+0000 7ff38d000640 1 Processor -- start 2024-02-21T23:02:45.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.897+0000 7ff38d000640 1 -- start start 2024-02-21T23:02:45.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.900+0000 7ff38d000640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7ff388184130 0x7ff388187340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:45.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.900+0000 7ff38d000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3880725a0 con 0x7ff388071760 2024-02-21T23:02:45.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.900+0000 7ff38d000640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff388072880 con 0x7ff388187e50 2024-02-21T23:02:45.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.900+0000 7ff38d000640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff388072b60 con 0x7ff388184130 2024-02-21T23:02:45.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.901+0000 7ff387400640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7ff388184130 0x7ff388187340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:45.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.901+0000 7ff386a00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7ff388071760 0x7ff388071ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:48644/0 (socket says 172.21.15.99:48644) 2024-02-21T23:02:45.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.901+0000 7ff386a00640 1 -- 172.21.15.99:0/3874051034 learned_addr learned my addr 172.21.15.99:0/3874051034 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:02:45.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.901+0000 7ff387e00640 1 --1- 172.21.15.99:0/3874051034 >> v1:172.21.15.181:6789/0 conn(0x7ff388187e50 0x7ff3881882a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:42118/0 (socket says 172.21.15.99:42118) 2024-02-21T23:02:45.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.901+0000 7ff386000640 1 -- 172.21.15.99:0/3874051034 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3224734243 0 0) 0x7ff388072880 con 0x7ff388187e50 2024-02-21T23:02:45.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.901+0000 7ff386000640 1 -- 172.21.15.99:0/3874051034 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff36c003520 con 0x7ff388187e50 2024-02-21T23:02:45.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.901+0000 7ff387400640 1 -- 172.21.15.99:0/3874051034 >> v1:172.21.15.181:6789/0 conn(0x7ff388187e50 legacy=0x7ff3881882a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:45.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.901+0000 7ff387400640 1 -- 172.21.15.99:0/3874051034 >> v1:172.21.15.99:6789/0 conn(0x7ff388071760 legacy=0x7ff388071ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:45.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.901+0000 7ff386000640 1 -- 172.21.15.99:0/3874051034 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 682975669 0 0) 0x7ff3880725a0 con 0x7ff388071760 2024-02-21T23:02:45.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.901+0000 7ff387400640 1 -- 172.21.15.99:0/3874051034 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff388072e40 con 0x7ff388184130 2024-02-21T23:02:45.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.903+0000 7ff387400640 1 --2- 172.21.15.99:0/3874051034 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff388184130 0x7ff388187340 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ff3780097a0 tx=0x7ff37802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5ccf2b14d727804 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:45.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.903+0000 7ff386000640 1 -- 172.21.15.99:0/3874051034 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff378035020 con 0x7ff388184130 2024-02-21T23:02:45.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.904+0000 7ff386000640 1 -- 172.21.15.99:0/3874051034 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff378031830 con 0x7ff388184130 2024-02-21T23:02:45.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.904+0000 7ff386000640 1 -- 172.21.15.99:0/3874051034 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff378031c00 con 0x7ff388184130 2024-02-21T23:02:45.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.904+0000 7ff38d000640 1 -- 172.21.15.99:0/3874051034 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff388184130 msgr2=0x7ff388187340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:45.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.904+0000 7ff38d000640 1 --2- 172.21.15.99:0/3874051034 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff388184130 0x7ff388187340 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ff3780097a0 tx=0x7ff37802b8d0 comp rx=0 tx=0).stop 2024-02-21T23:02:45.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.904+0000 7ff38d000640 1 -- 172.21.15.99:0/3874051034 shutdown_connections 2024-02-21T23:02:45.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.904+0000 7ff38d000640 1 --2- 172.21.15.99:0/3874051034 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff388184130 0x7ff388187340 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:45.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.904+0000 7ff38d000640 1 -- 172.21.15.99:0/3874051034 >> 172.21.15.99:0/3874051034 conn(0x7ff38808cfd0 msgr2=0x7ff38808d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:45.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.904+0000 7ff38d000640 1 -- 172.21.15.99:0/3874051034 shutdown_connections 2024-02-21T23:02:45.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.904+0000 7ff38d000640 1 -- 172.21.15.99:0/3874051034 wait complete. 2024-02-21T23:02:45.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.906+0000 7ff38d000640 1 Processor -- start 2024-02-21T23:02:45.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.907+0000 7ff38d000640 1 -- start start 2024-02-21T23:02:45.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.908+0000 7ff38d000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff388071760 0x7ff38806b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:45.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.908+0000 7ff38d000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff388184130 0x7ff388179640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:45.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.908+0000 7ff38d000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff388187e50 0x7ff3881705e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:45.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.908+0000 7ff38d000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3881889b0 con 0x7ff388187e50 2024-02-21T23:02:45.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.908+0000 7ff38d000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3880722b0 con 0x7ff388184130 2024-02-21T23:02:45.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.908+0000 7ff38d000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff388188b30 con 0x7ff388071760 2024-02-21T23:02:45.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.908+0000 7ff387e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff388187e50 0x7ff3881705e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:45.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.908+0000 7ff386a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff388184130 0x7ff388179640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:45.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.908+0000 7ff387400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff388071760 0x7ff38806b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:45.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.908+0000 7ff387e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff388187e50 0x7ff3881705e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59550/0 (socket says 172.21.15.99:59550) 2024-02-21T23:02:45.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.908+0000 7ff387e00640 1 -- 172.21.15.99:0/3403183502 learned_addr learned my addr 172.21.15.99:0/3403183502 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:45.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.909+0000 7ff386a00640 1 -- 172.21.15.99:0/3403183502 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff388071760 msgr2=0x7ff38806b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:45.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.909+0000 7ff386a00640 1 --2- 172.21.15.99:0/3403183502 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff388071760 0x7ff38806b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:45.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.909+0000 7ff386a00640 1 -- 172.21.15.99:0/3403183502 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff388187e50 msgr2=0x7ff3881705e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:45.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.909+0000 7ff386a00640 1 --2- 172.21.15.99:0/3403183502 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff388187e50 0x7ff3881705e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:45.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.909+0000 7ff386a00640 1 -- 172.21.15.99:0/3403183502 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3881864b0 con 0x7ff388184130 2024-02-21T23:02:45.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.909+0000 7ff386a00640 1 --2- 172.21.15.99:0/3403183502 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff388184130 0x7ff388179640 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff37400c3e0 tx=0x7ff37400c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:45.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.909+0000 7ff37f400640 1 -- 172.21.15.99:0/3403183502 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3740074e0 con 0x7ff388184130 2024-02-21T23:02:45.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.909+0000 7ff37f400640 1 -- 172.21.15.99:0/3403183502 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3740047e0 con 0x7ff388184130 2024-02-21T23:02:45.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.909+0000 7ff37f400640 1 -- 172.21.15.99:0/3403183502 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff374004c10 con 0x7ff388184130 2024-02-21T23:02:45.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.909+0000 7ff38d000640 1 -- 172.21.15.99:0/3403183502 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff388185ef0 con 0x7ff388184130 2024-02-21T23:02:45.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.910+0000 7ff38d000640 1 -- 172.21.15.99:0/3403183502 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff388174850 con 0x7ff388184130 2024-02-21T23:02:45.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.913+0000 7ff37f400640 1 -- 172.21.15.99:0/3403183502 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 12) v1 ==== 134532+0+0 (secure 0 0 0) 0x7ff374011070 con 0x7ff388184130 2024-02-21T23:02:45.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.914+0000 7ff391591740 1 Processor -- start 2024-02-21T23:02:45.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.914+0000 7ff391591740 1 -- start start 2024-02-21T23:02:45.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.915+0000 7ff37f400640 1 --2- 172.21.15.99:0/3403183502 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7ff36809ef60 0x7ff3680a1420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:45.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.915+0000 7ff37f400640 1 -- 172.21.15.99:0/3403183502 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7ff3740c9a70 con 0x7ff388184130 2024-02-21T23:02:45.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.915+0000 7ff391591740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560445d5e4c0 0x560445d5e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:45.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.915+0000 7ff391591740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560445d5ede0 0x560445d99650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:45.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.915+0000 7ff391591740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560445d99b90 0x560445d9a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:45.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.915+0000 7ff391591740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x560445c86790 con 0x560445d5ede0 2024-02-21T23:02:45.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.915+0000 7ff391591740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x560445c2fbf0 con 0x560445d5e4c0 2024-02-21T23:02:45.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.915+0000 7ff391591740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x560445c82830 con 0x560445d99b90 2024-02-21T23:02:45.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.915+0000 7ff387e00640 1 --2- 172.21.15.99:0/3403183502 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7ff36809ef60 0x7ff3680a1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:45.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.916+0000 7ff387400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560445d5e4c0 0x560445d5e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:45.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.916+0000 7ff387400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560445d5e4c0 0x560445d5e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:38850/0 (socket says 172.21.15.99:38850) 2024-02-21T23:02:45.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.916+0000 7ff387400640 1 -- 172.21.15.99:0/460923372 learned_addr learned my addr 172.21.15.99:0/460923372 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:45.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.916+0000 7ff386a00640 1 --2- 172.21.15.99:0/460923372 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560445d5ede0 0x560445d99650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:45.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.916+0000 7ff387e00640 1 --2- 172.21.15.99:0/460923372 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560445d99b90 0x560445d9a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:45.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.916+0000 7ff387400640 1 -- 172.21.15.99:0/460923372 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560445d99b90 msgr2=0x560445d9a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:45.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.916+0000 7ff387400640 1 --2- 172.21.15.99:0/460923372 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560445d99b90 0x560445d9a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:45.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.916+0000 7ff387400640 1 -- 172.21.15.99:0/460923372 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560445d5ede0 msgr2=0x560445d99650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:45.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.916+0000 7ff387400640 1 --2- 172.21.15.99:0/460923372 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560445d5ede0 0x560445d99650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:45.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.916+0000 7ff387400640 1 -- 172.21.15.99:0/460923372 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560445c4dc40 con 0x560445d5e4c0 2024-02-21T23:02:45.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.916+0000 7ff386a00640 1 --2- 172.21.15.99:0/460923372 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560445d5ede0 0x560445d99650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:02:45.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.916+0000 7ff387e00640 1 --2- 172.21.15.99:0/3403183502 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7ff36809ef60 0x7ff3680a1420 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff380001560 tx=0x7ff380001f10 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:45.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.916+0000 7ff387400640 1 --2- 172.21.15.99:0/460923372 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560445d5e4c0 0x560445d5e8a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff3780098c0 tx=0x7ff378030000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d166e1fcad64efc5 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:45.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.917+0000 7ff373e00640 1 -- 172.21.15.99:0/460923372 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff378049070 con 0x560445d5e4c0 2024-02-21T23:02:45.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.917+0000 7ff373e00640 1 -- 172.21.15.99:0/460923372 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3780042b0 con 0x560445d5e4c0 2024-02-21T23:02:45.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.917+0000 7ff373e00640 1 -- 172.21.15.99:0/460923372 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff378035040 con 0x560445d5e4c0 2024-02-21T23:02:45.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.917+0000 7ff391591740 1 -- 172.21.15.99:0/460923372 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560445d5e4c0 msgr2=0x560445d5e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:45.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.917+0000 7ff391591740 1 --2- 172.21.15.99:0/460923372 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560445d5e4c0 0x560445d5e8a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff3780098c0 tx=0x7ff378030000 comp rx=0 tx=0).stop 2024-02-21T23:02:45.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.918+0000 7ff391591740 1 -- 172.21.15.99:0/460923372 shutdown_connections 2024-02-21T23:02:45.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.918+0000 7ff391591740 1 --2- 172.21.15.99:0/460923372 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560445d99b90 0x560445d9a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:45.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.918+0000 7ff391591740 1 --2- 172.21.15.99:0/460923372 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560445d5ede0 0x560445d99650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:45.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.918+0000 7ff391591740 1 --2- 172.21.15.99:0/460923372 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560445d5e4c0 0x560445d5e8a0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:45.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.918+0000 7ff391591740 1 -- 172.21.15.99:0/460923372 >> 172.21.15.99:0/460923372 conn(0x560445d20a90 msgr2=0x560445d21b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:45.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.918+0000 7ff391591740 1 -- 172.21.15.99:0/460923372 shutdown_connections 2024-02-21T23:02:45.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.918+0000 7ff391591740 1 -- 172.21.15.99:0/460923372 wait complete. 2024-02-21T23:02:45.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.919+0000 7ff391591740 1 -- start start 2024-02-21T23:02:45.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.919+0000 7ff391591740 1 Processor -- start 2024-02-21T23:02:45.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.920+0000 7ff391591740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560445d5ede0 0x560445d1f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:45.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.920+0000 7ff391591740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560445d99b90 0x560445d503c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:45.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.920+0000 7ff391591740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560445d5c020 0x560445d5c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:45.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.920+0000 7ff391591740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x560445d98070 con 0x560445d5c020 2024-02-21T23:02:45.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.920+0000 7ff391591740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x560445c251d0 con 0x560445d5ede0 2024-02-21T23:02:45.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.920+0000 7ff391591740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x560445d98350 con 0x560445d99b90 2024-02-21T23:02:45.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.920+0000 7ff391591740 10 client.0 _ll_register_callbacks cb 0x56044599ac60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:02:45.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.920+0000 7ff387400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560445d5ede0 0x560445d1f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:45.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.920+0000 7ff387400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560445d5ede0 0x560445d1f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:38866/0 (socket says 172.21.15.99:38866) 2024-02-21T23:02:45.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.920+0000 7ff387400640 1 -- 172.21.15.99:0/2687953388 learned_addr learned my addr 172.21.15.99:0/2687953388 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:45.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.920+0000 7ff386a00640 1 --2- 172.21.15.99:0/2687953388 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560445d99b90 0x560445d503c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:45.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.920+0000 7ff387e00640 1 --2- 172.21.15.99:0/2687953388 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560445d5c020 0x560445d5c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:45.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.921+0000 7ff387400640 1 -- 172.21.15.99:0/2687953388 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560445d99b90 msgr2=0x560445d503c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:45.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.921+0000 7ff387400640 1 --2- 172.21.15.99:0/2687953388 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560445d99b90 0x560445d503c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:45.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.921+0000 7ff387400640 1 -- 172.21.15.99:0/2687953388 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560445d5c020 msgr2=0x560445d5c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:45.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.921+0000 7ff387400640 1 --2- 172.21.15.99:0/2687953388 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560445d5c020 0x560445d5c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:45.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.921+0000 7ff387400640 1 -- 172.21.15.99:0/2687953388 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560445a637e0 con 0x560445d5ede0 2024-02-21T23:02:45.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.922+0000 7ff386a00640 1 --2- 172.21.15.99:0/2687953388 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560445d99b90 0x560445d503c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:02:45.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.922+0000 7ff387e00640 1 --2- 172.21.15.99:0/2687953388 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560445d5c020 0x560445d5c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:02:45.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.922+0000 7ff387400640 1 --2- 172.21.15.99:0/2687953388 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560445d5ede0 0x560445d1f320 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff37802bee0 tx=0x7ff378004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16a9f96c87c4f7c3 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:45.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.922+0000 7ff370c00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-02-21T23:02:45.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.922+0000 7ff370c00640 1 -- 172.21.15.99:0/2687953388 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff378049030 con 0x560445d5ede0 2024-02-21T23:02:45.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.922+0000 7ff391591740 1 -- 172.21.15.99:0/2687953388 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff3780042b0 con 0x560445d5ede0 2024-02-21T23:02:45.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.922+0000 7ff370c00640 1 -- 172.21.15.99:0/2687953388 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7ff378041040 con 0x560445d5ede0 2024-02-21T23:02:45.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.923+0000 7ff370c00640 1 -- 172.21.15.99:0/2687953388 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff378035040 con 0x560445d5ede0 2024-02-21T23:02:45.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.923+0000 7ff391591740 10 client.5386 fetch_fsmap learned FSMap version 15 2024-02-21T23:02:45.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.923+0000 7ff391591740 1 -- 172.21.15.99:0/2687953388 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x560445ac3f70 con 0x560445d5ede0 2024-02-21T23:02:45.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.923+0000 7ff370c00640 1 -- 172.21.15.99:0/2687953388 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3780042b0 con 0x560445d5ede0 2024-02-21T23:02:45.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.923+0000 7ff370c00640 1 -- 172.21.15.99:0/2687953388 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 15) v1 ==== 7890+0+0 (secure 0 0 0) 0x7ff378005990 con 0x560445d5ede0 2024-02-21T23:02:45.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.923+0000 7ff391591740 10 client.5386 fetch_fsmap finished waiting for FSMap version 15 2024-02-21T23:02:45.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.923+0000 7ff391591740 10 client.5386 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:02:45.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.923+0000 7ff391591740 20 client.5386 populate_metadata read hostname 'smithi099' 2024-02-21T23:02:45.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.923+0000 7ff391591740 1 --2- 172.21.15.99:0/2687953388 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x560445da68b0 0x560445da6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:45.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.923+0000 7ff391591740 4 client.5386 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:02:45.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.923+0000 7ff391591740 1 -- 172.21.15.99:0/2687953388 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560445c93cd0 con 0x560445da68b0 2024-02-21T23:02:45.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.924+0000 7ff386a00640 1 --2- 172.21.15.99:0/2687953388 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x560445da68b0 0x560445da6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:45.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.924+0000 7ff370c00640 10 client.5386 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:02:45.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.924+0000 7ff386a00640 1 --2- 172.21.15.99:0/2687953388 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x560445da68b0 0x560445da6cc0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb39b09f04122e61 server_cookie=53dcf766507a53c0 in_seq=0 out_seq=0 2024-02-21T23:02:45.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.925+0000 7ff370c00640 1 -- 172.21.15.99:0/2687953388 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x560445c93cd0 con 0x560445da68b0 2024-02-21T23:02:45.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.925+0000 7ff370c00640 10 client.5386 handle_command_reply: tid=0 2024-02-21T23:02:45.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.925+0000 7ff391591740 1 client.5386 shutdown 2024-02-21T23:02:45.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.925+0000 7ff391591740 1 -- 172.21.15.99:0/2687953388 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560445d5ede0 msgr2=0x560445d1f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:45.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.925+0000 7ff391591740 1 --2- 172.21.15.99:0/2687953388 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560445d5ede0 0x560445d1f320 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff37802bee0 tx=0x7ff378004730 comp rx=0 tx=0).stop 2024-02-21T23:02:45.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.925+0000 7ff391591740 1 -- 172.21.15.99:0/2687953388 shutdown_connections 2024-02-21T23:02:45.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.925+0000 7ff391591740 1 --2- 172.21.15.99:0/2687953388 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x560445da68b0 0x560445da6cc0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:45.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.925+0000 7ff391591740 1 --2- 172.21.15.99:0/2687953388 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560445d5c020 0x560445d5c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:45.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.925+0000 7ff391591740 1 --2- 172.21.15.99:0/2687953388 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560445d99b90 0x560445d503c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:45.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.925+0000 7ff391591740 1 --2- 172.21.15.99:0/2687953388 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560445d5ede0 0x560445d1f320 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:45.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.925+0000 7ff370c00640 0 client.5386 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:02:45.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.925+0000 7ff391591740 1 -- 172.21.15.99:0/2687953388 >> 172.21.15.99:0/2687953388 conn(0x560445d5e4c0 msgr2=0x560445d22500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:45.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.926+0000 7ff391591740 1 -- 172.21.15.99:0/2687953388 shutdown_connections 2024-02-21T23:02:45.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.926+0000 7ff391591740 1 -- 172.21.15.99:0/2687953388 wait complete. 2024-02-21T23:02:45.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.926+0000 7ff391591740 20 client.5386 trim_cache size 0 max 16384 2024-02-21T23:02:45.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.944+0000 7ff391591740 1 Processor -- start 2024-02-21T23:02:45.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.944+0000 7ff391591740 1 -- start start 2024-02-21T23:02:45.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.946+0000 7ff391591740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560445d5c020 0x560445da6c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:45.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.946+0000 7ff391591740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560445d5ede0 0x560445d98280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:45.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.946+0000 7ff391591740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560445d99b90 0x560445d987c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:45.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.946+0000 7ff391591740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff388228170 con 0x560445d5c020 2024-02-21T23:02:45.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.946+0000 7ff391591740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3880e5d10 con 0x560445d99b90 2024-02-21T23:02:45.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.946+0000 7ff391591740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff388178920 con 0x560445d5ede0 2024-02-21T23:02:45.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.946+0000 7ff387400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560445d5c020 0x560445da6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:45.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.946+0000 7ff387400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560445d5c020 0x560445da6c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59570/0 (socket says 172.21.15.99:59570) 2024-02-21T23:02:45.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.946+0000 7ff387400640 1 -- 172.21.15.99:0/2735379887 learned_addr learned my addr 172.21.15.99:0/2735379887 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:45.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.946+0000 7ff387e00640 1 --2- 172.21.15.99:0/2735379887 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560445d99b90 0x560445d987c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:45.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.946+0000 7ff386a00640 1 --2- 172.21.15.99:0/2735379887 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560445d5ede0 0x560445d98280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:45.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.947+0000 7ff387400640 1 -- 172.21.15.99:0/2735379887 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560445d5ede0 msgr2=0x560445d98280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:45.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.947+0000 7ff387400640 1 --2- 172.21.15.99:0/2735379887 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560445d5ede0 0x560445d98280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:45.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.947+0000 7ff387400640 1 -- 172.21.15.99:0/2735379887 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560445d99b90 msgr2=0x560445d987c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:45.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.947+0000 7ff387400640 1 --2- 172.21.15.99:0/2735379887 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560445d99b90 0x560445d987c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:45.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.947+0000 7ff387400640 1 -- 172.21.15.99:0/2735379887 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56044595b170 con 0x560445d5c020 2024-02-21T23:02:45.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.947+0000 7ff386a00640 1 --2- 172.21.15.99:0/2735379887 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560445d5ede0 0x560445d98280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:02:45.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.947+0000 7ff387400640 1 --2- 172.21.15.99:0/2735379887 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560445d5c020 0x560445da6c90 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff37802b910 tx=0x7ff37803e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cb6146ab9156981 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:45.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.947+0000 7ff373400640 1 -- 172.21.15.99:0/2735379887 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff378063070 con 0x560445d5c020 2024-02-21T23:02:45.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.947+0000 7ff373400640 1 -- 172.21.15.99:0/2735379887 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff37804b050 con 0x560445d5c020 2024-02-21T23:02:45.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.947+0000 7ff373400640 1 -- 172.21.15.99:0/2735379887 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff378049040 con 0x560445d5c020 2024-02-21T23:02:45.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.948+0000 7ff391591740 1 -- 172.21.15.99:0/2735379887 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560445d5c020 msgr2=0x560445da6c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:45.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.948+0000 7ff391591740 1 --2- 172.21.15.99:0/2735379887 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560445d5c020 0x560445da6c90 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff37802b910 tx=0x7ff37803e000 comp rx=0 tx=0).stop 2024-02-21T23:02:45.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.948+0000 7ff391591740 1 -- 172.21.15.99:0/2735379887 shutdown_connections 2024-02-21T23:02:45.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.948+0000 7ff391591740 1 --2- 172.21.15.99:0/2735379887 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560445d99b90 0x560445d987c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:45.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.948+0000 7ff391591740 1 --2- 172.21.15.99:0/2735379887 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560445d5ede0 0x560445d98280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:45.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.948+0000 7ff391591740 1 --2- 172.21.15.99:0/2735379887 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560445d5c020 0x560445da6c90 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:45.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.948+0000 7ff391591740 1 -- 172.21.15.99:0/2735379887 >> 172.21.15.99:0/2735379887 conn(0x560445d5e4c0 msgr2=0x560445d22500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:45.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.948+0000 7ff391591740 1 -- 172.21.15.99:0/2735379887 shutdown_connections 2024-02-21T23:02:45.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.948+0000 7ff391591740 1 -- 172.21.15.99:0/2735379887 wait complete. 2024-02-21T23:02:45.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.949+0000 7ff391591740 1 -- start start 2024-02-21T23:02:45.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.949+0000 7ff391591740 1 Processor -- start 2024-02-21T23:02:45.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.950+0000 7ff391591740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560445d5c020 0x560445d4ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:45.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.950+0000 7ff391591740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560445d5ede0 0x560445d27340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:45.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.950+0000 7ff391591740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560445d99b90 0x560445d54990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:45.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.950+0000 7ff391591740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3880e4450 con 0x560445d5c020 2024-02-21T23:02:45.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.950+0000 7ff391591740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3880e56b0 con 0x560445d99b90 2024-02-21T23:02:45.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.950+0000 7ff391591740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3880e4a50 con 0x560445d5ede0 2024-02-21T23:02:45.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.950+0000 7ff391591740 10 client.0 _ll_register_callbacks cb 0x7ff378047070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:02:45.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.950+0000 7ff387400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560445d5c020 0x560445d4ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:45.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.951+0000 7ff387400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560445d5c020 0x560445d4ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59586/0 (socket says 172.21.15.99:59586) 2024-02-21T23:02:45.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.951+0000 7ff387400640 1 -- 172.21.15.99:0/2882200607 learned_addr learned my addr 172.21.15.99:0/2882200607 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:45.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.951+0000 7ff387e00640 1 --2- 172.21.15.99:0/2882200607 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560445d99b90 0x560445d54990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:45.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.951+0000 7ff386a00640 1 --2- 172.21.15.99:0/2882200607 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560445d5ede0 0x560445d27340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:45.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.951+0000 7ff387400640 1 -- 172.21.15.99:0/2882200607 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560445d5ede0 msgr2=0x560445d27340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:45.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.951+0000 7ff387400640 1 --2- 172.21.15.99:0/2882200607 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560445d5ede0 0x560445d27340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:45.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.951+0000 7ff387400640 1 -- 172.21.15.99:0/2882200607 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560445d99b90 msgr2=0x560445d54990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:45.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.951+0000 7ff387400640 1 --2- 172.21.15.99:0/2882200607 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560445d99b90 0x560445d54990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:45.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.951+0000 7ff387400640 1 -- 172.21.15.99:0/2882200607 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560445e0d840 con 0x560445d5c020 2024-02-21T23:02:45.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.951+0000 7ff387e00640 1 --2- 172.21.15.99:0/2882200607 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560445d99b90 0x560445d54990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:02:45.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.951+0000 7ff387400640 1 --2- 172.21.15.99:0/2882200607 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560445d5c020 0x560445d4ffc0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff37802bee0 tx=0x7ff378008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9330757e58596b8 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:45.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.951+0000 7ff370c00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:02:45.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.952+0000 7ff370c00640 1 -- 172.21.15.99:0/2882200607 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff378063070 con 0x560445d5c020 2024-02-21T23:02:45.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.952+0000 7ff370c00640 1 -- 172.21.15.99:0/2882200607 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7ff37805e690 con 0x560445d5c020 2024-02-21T23:02:45.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.952+0000 7ff391591740 1 -- 172.21.15.99:0/2882200607 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff37804b050 con 0x560445d5c020 2024-02-21T23:02:45.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.952+0000 7ff370c00640 1 -- 172.21.15.99:0/2882200607 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff378049040 con 0x560445d5c020 2024-02-21T23:02:45.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.952+0000 7ff391591740 10 client.5286 fetch_fsmap learned FSMap version 15 2024-02-21T23:02:45.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.952+0000 7ff391591740 1 -- 172.21.15.99:0/2882200607 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x560445d579b0 con 0x560445d5c020 2024-02-21T23:02:45.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.952+0000 7ff370c00640 1 -- 172.21.15.99:0/2882200607 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff37804b050 con 0x560445d5c020 2024-02-21T23:02:45.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.953+0000 7ff370c00640 1 -- 172.21.15.99:0/2882200607 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 15) v1 ==== 7890+0+0 (secure 0 0 0) 0x7ff37805e890 con 0x560445d5c020 2024-02-21T23:02:45.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.953+0000 7ff391591740 10 client.5286 fetch_fsmap finished waiting for FSMap version 15 2024-02-21T23:02:45.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.953+0000 7ff391591740 10 client.5286 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:02:45.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.953+0000 7ff391591740 20 client.5286 populate_metadata read hostname 'smithi099' 2024-02-21T23:02:45.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.953+0000 7ff391591740 1 --2- 172.21.15.99:0/2882200607 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x560445d5e940 0x560445d1fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:45.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.953+0000 7ff391591740 4 client.5286 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-02-21T23:02:45.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.953+0000 7ff391591740 1 -- 172.21.15.99:0/2882200607 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x560445c8e020 con 0x560445d5e940 2024-02-21T23:02:45.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.953+0000 7ff386a00640 1 --2- 172.21.15.99:0/2882200607 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x560445d5e940 0x560445d1fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:45.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.954+0000 7ff370c00640 10 client.5286 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:02:45.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.954+0000 7ff386a00640 1 --2- 172.21.15.99:0/2882200607 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x560445d5e940 0x560445d1fb70 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4de990098a39d5c3 server_cookie=d7997e455dff7e3b in_seq=0 out_seq=0 2024-02-21T23:02:45.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.955+0000 7ff370c00640 1 -- 172.21.15.99:0/2882200607 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x560445c8e020 con 0x560445d5e940 2024-02-21T23:02:45.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.955+0000 7ff370c00640 10 client.5286 handle_command_reply: tid=0 2024-02-21T23:02:45.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.955+0000 7ff391591740 1 client.5286 shutdown 2024-02-21T23:02:45.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.955+0000 7ff391591740 1 -- 172.21.15.99:0/2882200607 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560445d5c020 msgr2=0x560445d4ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:45.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.955+0000 7ff391591740 1 --2- 172.21.15.99:0/2882200607 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560445d5c020 0x560445d4ffc0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff37802bee0 tx=0x7ff378008030 comp rx=0 tx=0).stop 2024-02-21T23:02:45.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.955+0000 7ff391591740 1 -- 172.21.15.99:0/2882200607 shutdown_connections 2024-02-21T23:02:45.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.955+0000 7ff391591740 1 --2- 172.21.15.99:0/2882200607 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x560445d5e940 0x560445d1fb70 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:45.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.955+0000 7ff391591740 1 --2- 172.21.15.99:0/2882200607 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560445d99b90 0x560445d54990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:45.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.955+0000 7ff391591740 1 --2- 172.21.15.99:0/2882200607 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560445d5ede0 0x560445d27340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:45.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.955+0000 7ff391591740 1 --2- 172.21.15.99:0/2882200607 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560445d5c020 0x560445d4ffc0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:45.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.955+0000 7ff391591740 1 -- 172.21.15.99:0/2882200607 >> 172.21.15.99:0/2882200607 conn(0x560445d5e4c0 msgr2=0x560445d22500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:45.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.955+0000 7ff370c00640 0 client.5286 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:02:45.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.956+0000 7ff391591740 1 -- 172.21.15.99:0/2882200607 shutdown_connections 2024-02-21T23:02:45.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.956+0000 7ff391591740 1 -- 172.21.15.99:0/2882200607 wait complete. 2024-02-21T23:02:45.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.956+0000 7ff391591740 20 client.5286 trim_cache size 0 max 16384 2024-02-21T23:02:45.947 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-02-21T23:02:45.948 INFO:teuthology.orchestra.run.smithi099.stdout: "return_code": 0, 2024-02-21T23:02:45.948 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_tag": "04e54ecc-e7ac-4741-a370-47fa8a157847", 2024-02-21T23:02:45.948 INFO:teuthology.orchestra.run.smithi099.stdout: "mode": "asynchronous" 2024-02-21T23:02:45.948 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-02-21T23:02:45.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.957+0000 7ff38d000640 1 -- 172.21.15.99:0/3403183502 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7ff36809ef60 msgr2=0x7ff3680a1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:45.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.957+0000 7ff38d000640 1 --2- 172.21.15.99:0/3403183502 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7ff36809ef60 0x7ff3680a1420 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff380001560 tx=0x7ff380001f10 comp rx=0 tx=0).stop 2024-02-21T23:02:45.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.957+0000 7ff38d000640 1 -- 172.21.15.99:0/3403183502 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff388184130 msgr2=0x7ff388179640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:45.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.957+0000 7ff38d000640 1 --2- 172.21.15.99:0/3403183502 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff388184130 0x7ff388179640 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff37400c3e0 tx=0x7ff37400c8a0 comp rx=0 tx=0).stop 2024-02-21T23:02:45.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.957+0000 7ff38d000640 1 -- 172.21.15.99:0/3403183502 shutdown_connections 2024-02-21T23:02:45.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.957+0000 7ff38d000640 1 --2- 172.21.15.99:0/3403183502 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7ff36809ef60 0x7ff3680a1420 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:45.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.957+0000 7ff38d000640 1 --2- 172.21.15.99:0/3403183502 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff388187e50 0x7ff3881705e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:45.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.957+0000 7ff38d000640 1 --2- 172.21.15.99:0/3403183502 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff388184130 0x7ff388179640 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:45.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.957+0000 7ff38d000640 1 --2- 172.21.15.99:0/3403183502 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff388071760 0x7ff38806b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:45.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.957+0000 7ff38d000640 1 -- 172.21.15.99:0/3403183502 >> 172.21.15.99:0/3403183502 conn(0x7ff38808cfd0 msgr2=0x7ff388183180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:45.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.958+0000 7ff38d000640 1 -- 172.21.15.99:0/3403183502 shutdown_connections 2024-02-21T23:02:45.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:45.958+0000 7ff38d000640 1 -- 172.21.15.99:0/3403183502 wait complete. 2024-02-21T23:02:45.964 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T23:02:45.965 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T23:02:46.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.193+0000 7f70fee00640 1 Processor -- start 2024-02-21T23:02:46.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.193+0000 7f70fee00640 1 -- start start 2024-02-21T23:02:46.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.195+0000 7f70fee00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f70f808cfd0 0x7f70f80fa4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:46.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.195+0000 7f70fee00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70f808d450 con 0x7f70f81870f0 2024-02-21T23:02:46.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.195+0000 7f70fee00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70f808d730 con 0x7f70f80fa100 2024-02-21T23:02:46.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.195+0000 7f70fee00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70f808da10 con 0x7f70f808cfd0 2024-02-21T23:02:46.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.195+0000 7f70fd000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f70f808cfd0 0x7f70f80fa4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:46.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.195+0000 7f70fda00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f70f80fa100 0x7f70f81869e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.99:42324/0 (socket says 172.21.15.99:42324) 2024-02-21T23:02:46.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.195+0000 7f70fda00640 1 -- 172.21.15.99:0/306950831 learned_addr learned my addr 172.21.15.99:0/306950831 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:02:46.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.196+0000 7f70f7e00640 1 -- 172.21.15.99:0/306950831 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 949552198 0 0) 0x7f70f808d730 con 0x7f70f80fa100 2024-02-21T23:02:46.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.196+0000 7f70f7e00640 1 -- 172.21.15.99:0/306950831 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70e0003520 con 0x7f70f80fa100 2024-02-21T23:02:46.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.196+0000 7f70fd000640 1 -- 172.21.15.99:0/306950831 >> v1:172.21.15.162:6789/0 conn(0x7f70f80fa100 legacy=0x7f70f81869e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:46.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.196+0000 7f70fd000640 1 -- 172.21.15.99:0/306950831 >> v1:172.21.15.99:6789/0 conn(0x7f70f81870f0 legacy=0x7f70f80faa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:46.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.196+0000 7f70fd000640 1 -- 172.21.15.99:0/306950831 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70f808dcf0 con 0x7f70f808cfd0 2024-02-21T23:02:46.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.197+0000 7f70fd000640 1 --2- 172.21.15.99:0/306950831 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f70f808cfd0 0x7f70f80fa4e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f70e40097a0 tx=0x7f70e402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=565b9714d4caca40 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:46.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.198+0000 7f70f7e00640 1 -- 172.21.15.99:0/306950831 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e40315a0 con 0x7f70f808cfd0 2024-02-21T23:02:46.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.198+0000 7f70f7e00640 1 -- 172.21.15.99:0/306950831 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70e4037070 con 0x7f70f808cfd0 2024-02-21T23:02:46.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.198+0000 7f70f7e00640 1 -- 172.21.15.99:0/306950831 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e4031960 con 0x7f70f808cfd0 2024-02-21T23:02:46.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.198+0000 7f70fee00640 1 -- 172.21.15.99:0/306950831 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f70f808cfd0 msgr2=0x7f70f80fa4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:46.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.198+0000 7f70fee00640 1 --2- 172.21.15.99:0/306950831 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f70f808cfd0 0x7f70f80fa4e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f70e40097a0 tx=0x7f70e402b840 comp rx=0 tx=0).stop 2024-02-21T23:02:46.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.198+0000 7f70fee00640 1 -- 172.21.15.99:0/306950831 shutdown_connections 2024-02-21T23:02:46.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.198+0000 7f70fee00640 1 --2- 172.21.15.99:0/306950831 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f70f808cfd0 0x7f70f80fa4e0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:46.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.198+0000 7f70fee00640 1 -- 172.21.15.99:0/306950831 >> 172.21.15.99:0/306950831 conn(0x7f70f80d06d0 msgr2=0x7f70f80d0ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:46.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.199+0000 7f70fee00640 1 -- 172.21.15.99:0/306950831 shutdown_connections 2024-02-21T23:02:46.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.199+0000 7f70fee00640 1 -- 172.21.15.99:0/306950831 wait complete. 2024-02-21T23:02:46.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.202+0000 7f70fee00640 1 Processor -- start 2024-02-21T23:02:46.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.202+0000 7f70fee00640 1 -- start start 2024-02-21T23:02:46.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.204+0000 7f70fee00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f70f808cfd0 0x7f70f8223010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:46.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.204+0000 7f70fee00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f70f80fa100 0x7f70f8071800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:46.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.204+0000 7f70fee00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f70f81870f0 0x7f70f8176360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:46.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.204+0000 7f70fee00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f8182df0 con 0x7f70f80fa100 2024-02-21T23:02:46.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.204+0000 7f70fee00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f808e2b0 con 0x7f70f808cfd0 2024-02-21T23:02:46.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.204+0000 7f70fee00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f8182f70 con 0x7f70f81870f0 2024-02-21T23:02:46.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.204+0000 7f70fda00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f70f808cfd0 0x7f70f8223010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:46.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.204+0000 7f70fd000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f70f80fa100 0x7f70f8071800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:46.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.204+0000 7f70fda00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f70f808cfd0 0x7f70f8223010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:38886/0 (socket says 172.21.15.99:38886) 2024-02-21T23:02:46.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.204+0000 7f70fda00640 1 -- 172.21.15.99:0/95729566 learned_addr learned my addr 172.21.15.99:0/95729566 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:46.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.204+0000 7f70fe400640 1 --2- 172.21.15.99:0/95729566 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f70f81870f0 0x7f70f8176360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:46.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.205+0000 7f70fd000640 1 -- 172.21.15.99:0/95729566 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f70f81870f0 msgr2=0x7f70f8176360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:46.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.205+0000 7f70fd000640 1 --2- 172.21.15.99:0/95729566 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f70f81870f0 0x7f70f8176360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:46.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.205+0000 7f70fd000640 1 -- 172.21.15.99:0/95729566 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f70f808cfd0 msgr2=0x7f70f8223010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:46.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.205+0000 7f70fd000640 1 --2- 172.21.15.99:0/95729566 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f70f808cfd0 0x7f70f8223010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:46.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.205+0000 7f70fd000640 1 -- 172.21.15.99:0/95729566 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70f8223550 con 0x7f70f80fa100 2024-02-21T23:02:46.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.205+0000 7f70fd000640 1 --2- 172.21.15.99:0/95729566 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f70f80fa100 0x7f70f8071800 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f70e4033000 tx=0x7f70e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:46.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.205+0000 7f70f5600640 1 -- 172.21.15.99:0/95729566 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e4032840 con 0x7f70f80fa100 2024-02-21T23:02:46.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.205+0000 7f70f5600640 1 -- 172.21.15.99:0/95729566 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70e4031ec0 con 0x7f70f80fa100 2024-02-21T23:02:46.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.205+0000 7f70f5600640 1 -- 172.21.15.99:0/95729566 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e4032c40 con 0x7f70f80fa100 2024-02-21T23:02:46.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.205+0000 7f70fee00640 1 -- 172.21.15.99:0/95729566 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70f81730e0 con 0x7f70f80fa100 2024-02-21T23:02:46.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.206+0000 7f70fee00640 1 -- 172.21.15.99:0/95729566 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70f81736a0 con 0x7f70f80fa100 2024-02-21T23:02:46.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.209+0000 7f70f5600640 1 -- 172.21.15.99:0/95729566 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 12) v1 ==== 134532+0+0 (secure 0 0 0) 0x7f70e404e430 con 0x7f70f80fa100 2024-02-21T23:02:46.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.212+0000 7f70f5600640 1 --2- 172.21.15.99:0/95729566 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f70d809ef90 0x7f70d80a1450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:46.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.212+0000 7f710342b740 1 Processor -- start 2024-02-21T23:02:46.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.212+0000 7f70f5600640 1 -- 172.21.15.99:0/95729566 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f70e402f030 con 0x7f70f80fa100 2024-02-21T23:02:46.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.212+0000 7f710342b740 1 -- start start 2024-02-21T23:02:46.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.212+0000 7f70fda00640 1 --2- 172.21.15.99:0/95729566 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f70d809ef90 0x7f70d80a1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:46.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.213+0000 7f70fda00640 1 --2- 172.21.15.99:0/95729566 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f70d809ef90 0x7f70d80a1450 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f70ec001560 tx=0x7f70ec009040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:46.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.213+0000 7f710342b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56181f1092a0 0x56181f13ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:46.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.213+0000 7f710342b740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56181f13f260 0x56181f109680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:46.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.213+0000 7f710342b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56181f109bc0 0x56181f0cc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:46.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.213+0000 7f710342b740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x56181f035a90 con 0x56181f13f260 2024-02-21T23:02:46.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.213+0000 7f710342b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x56181efdeb10 con 0x56181f109bc0 2024-02-21T23:02:46.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.213+0000 7f710342b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x56181f031b30 con 0x56181f1092a0 2024-02-21T23:02:46.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.214+0000 7f70fda00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56181f1092a0 0x56181f13ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:46.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.214+0000 7f70fda00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56181f1092a0 0x56181f13ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:51726/0 (socket says 172.21.15.99:51726) 2024-02-21T23:02:46.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.214+0000 7f70fda00640 1 -- 172.21.15.99:0/1774469446 learned_addr learned my addr 172.21.15.99:0/1774469446 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:46.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.214+0000 7f70fd000640 1 --2- 172.21.15.99:0/1774469446 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56181f13f260 0x56181f109680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:46.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.214+0000 7f70fe400640 1 --2- 172.21.15.99:0/1774469446 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56181f109bc0 0x56181f0cc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:46.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.214+0000 7f70fda00640 1 -- 172.21.15.99:0/1774469446 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56181f109bc0 msgr2=0x56181f0cc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:46.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.214+0000 7f70fda00640 1 --2- 172.21.15.99:0/1774469446 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56181f109bc0 0x56181f0cc1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:46.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.214+0000 7f70fda00640 1 -- 172.21.15.99:0/1774469446 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56181f13f260 msgr2=0x56181f109680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:46.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.214+0000 7f70fda00640 1 --2- 172.21.15.99:0/1774469446 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56181f13f260 0x56181f109680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:46.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.214+0000 7f70fda00640 1 -- 172.21.15.99:0/1774469446 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56181ee147d0 con 0x56181f1092a0 2024-02-21T23:02:46.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.214+0000 7f70fe400640 1 --2- 172.21.15.99:0/1774469446 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56181f109bc0 0x56181f0cc1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:02:46.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.214+0000 7f70fd000640 1 --2- 172.21.15.99:0/1774469446 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56181f13f260 0x56181f109680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:02:46.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.214+0000 7f70fda00640 1 --2- 172.21.15.99:0/1774469446 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56181f1092a0 0x56181f13ed20 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f70ec0147d0 tx=0x7f70ec012000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8194c712970f757 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:46.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.215+0000 7f70ea000640 1 -- 172.21.15.99:0/1774469446 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ec025070 con 0x56181f1092a0 2024-02-21T23:02:46.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.215+0000 7f70ea000640 1 -- 172.21.15.99:0/1774469446 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70ec01b050 con 0x56181f1092a0 2024-02-21T23:02:46.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.215+0000 7f70ea000640 1 -- 172.21.15.99:0/1774469446 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ec013b30 con 0x56181f1092a0 2024-02-21T23:02:46.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.215+0000 7f710342b740 1 -- 172.21.15.99:0/1774469446 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56181f1092a0 msgr2=0x56181f13ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:46.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.215+0000 7f710342b740 1 --2- 172.21.15.99:0/1774469446 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56181f1092a0 0x56181f13ed20 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f70ec0147d0 tx=0x7f70ec012000 comp rx=0 tx=0).stop 2024-02-21T23:02:46.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.216+0000 7f710342b740 1 -- 172.21.15.99:0/1774469446 shutdown_connections 2024-02-21T23:02:46.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.216+0000 7f710342b740 1 --2- 172.21.15.99:0/1774469446 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56181f109bc0 0x56181f0cc1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:46.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.216+0000 7f710342b740 1 --2- 172.21.15.99:0/1774469446 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56181f13f260 0x56181f109680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:46.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.216+0000 7f710342b740 1 --2- 172.21.15.99:0/1774469446 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56181f1092a0 0x56181f13ed20 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:46.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.216+0000 7f710342b740 1 -- 172.21.15.99:0/1774469446 >> 172.21.15.99:0/1774469446 conn(0x56181f0986b0 msgr2=0x56181f0d0190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:46.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.216+0000 7f710342b740 1 -- 172.21.15.99:0/1774469446 shutdown_connections 2024-02-21T23:02:46.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.216+0000 7f710342b740 1 -- 172.21.15.99:0/1774469446 wait complete. 2024-02-21T23:02:46.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.216+0000 7f710342b740 1 -- start start 2024-02-21T23:02:46.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.217+0000 7f710342b740 1 Processor -- start 2024-02-21T23:02:46.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.219+0000 7f710342b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56181f1092a0 0x56181f1060d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:46.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.219+0000 7f710342b740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56181f109bc0 0x56181f135c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:46.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.219+0000 7f710342b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56181f13f260 0x56181f13ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:46.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.219+0000 7f710342b740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x56181f0d7f30 con 0x56181f109bc0 2024-02-21T23:02:46.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.219+0000 7f710342b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x56181efd41c0 con 0x56181f1092a0 2024-02-21T23:02:46.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.219+0000 7f710342b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x56181f140930 con 0x56181f13f260 2024-02-21T23:02:46.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.219+0000 7f710342b740 10 client.0 _ll_register_callbacks cb 0x56181eff1930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:02:46.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.219+0000 7f70fd000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56181f109bc0 0x56181f135c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:46.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.219+0000 7f70fd000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56181f109bc0 0x56181f135c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59612/0 (socket says 172.21.15.99:59612) 2024-02-21T23:02:46.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.219+0000 7f70fd000640 1 -- 172.21.15.99:0/2439524859 learned_addr learned my addr 172.21.15.99:0/2439524859 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:46.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.219+0000 7f70fe400640 1 --2- 172.21.15.99:0/2439524859 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56181f13f260 0x56181f13ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:46.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.219+0000 7f70fda00640 1 --2- 172.21.15.99:0/2439524859 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56181f1092a0 0x56181f1060d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:46.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.219+0000 7f70fd000640 1 -- 172.21.15.99:0/2439524859 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56181f13f260 msgr2=0x56181f13ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:46.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.219+0000 7f70fd000640 1 --2- 172.21.15.99:0/2439524859 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56181f13f260 0x56181f13ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:46.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.219+0000 7f70fd000640 1 -- 172.21.15.99:0/2439524859 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56181f1092a0 msgr2=0x56181f1060d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:46.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.219+0000 7f70fd000640 1 --2- 172.21.15.99:0/2439524859 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56181f1092a0 0x56181f1060d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:46.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.219+0000 7f70fd000640 1 -- 172.21.15.99:0/2439524859 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56181ed4a3f0 con 0x56181f109bc0 2024-02-21T23:02:46.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.220+0000 7f70fe400640 1 --2- 172.21.15.99:0/2439524859 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56181f13f260 0x56181f13ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:02:46.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.220+0000 7f70fd000640 1 --2- 172.21.15.99:0/2439524859 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56181f109bc0 0x56181f135c10 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f70e40097a0 tx=0x7f70e40b9120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edd199f280615dad server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:46.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.220+0000 7f70dea00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:02:46.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.220+0000 7f70dea00640 1 -- 172.21.15.99:0/2439524859 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e40bd850 con 0x56181f109bc0 2024-02-21T23:02:46.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.220+0000 7f70dea00640 1 -- 172.21.15.99:0/2439524859 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f70e40d1180 con 0x56181f109bc0 2024-02-21T23:02:46.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.220+0000 7f710342b740 1 -- 172.21.15.99:0/2439524859 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f70ec01b050 con 0x56181f109bc0 2024-02-21T23:02:46.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.221+0000 7f70dea00640 1 -- 172.21.15.99:0/2439524859 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f70e40c1ea0 con 0x56181f109bc0 2024-02-21T23:02:46.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.221+0000 7f710342b740 10 client.5301 fetch_fsmap learned FSMap version 15 2024-02-21T23:02:46.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.221+0000 7f710342b740 1 -- 172.21.15.99:0/2439524859 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x56181ed0a0f0 con 0x56181f109bc0 2024-02-21T23:02:46.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.221+0000 7f70dea00640 1 -- 172.21.15.99:0/2439524859 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70ec01b050 con 0x56181f109bc0 2024-02-21T23:02:46.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.221+0000 7f70dea00640 1 -- 172.21.15.99:0/2439524859 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 15) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f70e4031070 con 0x56181f109bc0 2024-02-21T23:02:46.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.221+0000 7f710342b740 10 client.5301 fetch_fsmap finished waiting for FSMap version 15 2024-02-21T23:02:46.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.221+0000 7f710342b740 10 client.5301 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:02:46.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.221+0000 7f710342b740 20 client.5301 populate_metadata read hostname 'smithi099' 2024-02-21T23:02:46.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.221+0000 7f710342b740 1 --2- 172.21.15.99:0/2439524859 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x56181f107b40 0x56181f153f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:46.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.221+0000 7f710342b740 4 client.5301 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:02:46.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.221+0000 7f710342b740 1 -- 172.21.15.99:0/2439524859 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56181f042fd0 con 0x56181f107b40 2024-02-21T23:02:46.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.222+0000 7f70fda00640 1 --2- 172.21.15.99:0/2439524859 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x56181f107b40 0x56181f153f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:46.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.223+0000 7f70fda00640 1 --2- 172.21.15.99:0/2439524859 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x56181f107b40 0x56181f153f20 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6bf02f5d1babfed8 server_cookie=7c201a724ed2042a in_seq=0 out_seq=0 2024-02-21T23:02:46.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.223+0000 7f70dea00640 10 client.5301 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:02:46.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.224+0000 7f70dea00640 1 -- 172.21.15.99:0/2439524859 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x56181f042fd0 con 0x56181f107b40 2024-02-21T23:02:46.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.224+0000 7f70dea00640 10 client.5301 handle_command_reply: tid=0 2024-02-21T23:02:46.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.224+0000 7f710342b740 1 client.5301 shutdown 2024-02-21T23:02:46.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.224+0000 7f710342b740 1 -- 172.21.15.99:0/2439524859 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56181f109bc0 msgr2=0x56181f135c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:46.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.224+0000 7f710342b740 1 --2- 172.21.15.99:0/2439524859 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56181f109bc0 0x56181f135c10 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f70e40097a0 tx=0x7f70e40b9120 comp rx=0 tx=0).stop 2024-02-21T23:02:46.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.224+0000 7f710342b740 1 -- 172.21.15.99:0/2439524859 shutdown_connections 2024-02-21T23:02:46.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.224+0000 7f710342b740 1 --2- 172.21.15.99:0/2439524859 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x56181f107b40 0x56181f153f20 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:46.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.224+0000 7f710342b740 1 --2- 172.21.15.99:0/2439524859 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56181f13f260 0x56181f13ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:46.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.224+0000 7f710342b740 1 --2- 172.21.15.99:0/2439524859 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56181f109bc0 0x56181f135c10 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:46.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.224+0000 7f710342b740 1 --2- 172.21.15.99:0/2439524859 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56181f1092a0 0x56181f1060d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:46.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.224+0000 7f710342b740 1 -- 172.21.15.99:0/2439524859 >> 172.21.15.99:0/2439524859 conn(0x56181f0986b0 msgr2=0x56181f140c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:46.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.224+0000 7f70dea00640 0 client.5301 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:02:46.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.224+0000 7f710342b740 1 -- 172.21.15.99:0/2439524859 shutdown_connections 2024-02-21T23:02:46.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.224+0000 7f710342b740 1 -- 172.21.15.99:0/2439524859 wait complete. 2024-02-21T23:02:46.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.225+0000 7f710342b740 20 client.5301 trim_cache size 0 max 16384 2024-02-21T23:02:46.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.241+0000 7f710342b740 1 Processor -- start 2024-02-21T23:02:46.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.241+0000 7f710342b740 1 -- start start 2024-02-21T23:02:46.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.242+0000 7f710342b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56181f1092a0 0x56181f0d02e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:46.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.242+0000 7f710342b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56181f109bc0 0x56181f0c6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:46.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.242+0000 7f710342b740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56181f13f260 0x56181f1a7900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:46.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.242+0000 7f710342b740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f82282c0 con 0x56181f13f260 2024-02-21T23:02:46.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.242+0000 7f710342b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f80e6090 con 0x56181f1092a0 2024-02-21T23:02:46.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.242+0000 7f710342b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f8188380 con 0x56181f109bc0 2024-02-21T23:02:46.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.243+0000 7f70fe400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56181f13f260 0x56181f1a7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:46.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.243+0000 7f70fe400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56181f13f260 0x56181f1a7900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59614/0 (socket says 172.21.15.99:59614) 2024-02-21T23:02:46.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.243+0000 7f70fe400640 1 -- 172.21.15.99:0/1666081093 learned_addr learned my addr 172.21.15.99:0/1666081093 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:46.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.243+0000 7f70fd000640 1 --2- 172.21.15.99:0/1666081093 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56181f109bc0 0x56181f0c6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:46.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.243+0000 7f70fda00640 1 --2- 172.21.15.99:0/1666081093 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56181f1092a0 0x56181f0d02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:46.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.243+0000 7f70fd000640 1 -- 172.21.15.99:0/1666081093 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56181f1092a0 msgr2=0x56181f0d02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:46.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.243+0000 7f70fd000640 1 --2- 172.21.15.99:0/1666081093 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56181f1092a0 0x56181f0d02e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:46.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.243+0000 7f70fd000640 1 -- 172.21.15.99:0/1666081093 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56181f13f260 msgr2=0x56181f1a7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:46.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.243+0000 7f70fd000640 1 --2- 172.21.15.99:0/1666081093 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56181f13f260 0x56181f1a7900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:46.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.243+0000 7f70fd000640 1 -- 172.21.15.99:0/1666081093 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56181f106440 con 0x56181f109bc0 2024-02-21T23:02:46.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.243+0000 7f70fe400640 1 --2- 172.21.15.99:0/1666081093 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56181f13f260 0x56181f1a7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:02:46.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.243+0000 7f70fd000640 1 --2- 172.21.15.99:0/1666081093 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56181f109bc0 0x56181f0c6dd0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f70e4031c50 tx=0x7f70e40bc000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aadb119f7d89e5 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:46.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.244+0000 7f70e9600640 1 -- 172.21.15.99:0/1666081093 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e40bd850 con 0x56181f109bc0 2024-02-21T23:02:46.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.244+0000 7f70e9600640 1 -- 172.21.15.99:0/1666081093 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70e4037040 con 0x56181f109bc0 2024-02-21T23:02:46.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.244+0000 7f70e9600640 1 -- 172.21.15.99:0/1666081093 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e40b53c0 con 0x56181f109bc0 2024-02-21T23:02:46.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.245+0000 7f710342b740 1 -- 172.21.15.99:0/1666081093 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56181f109bc0 msgr2=0x56181f0c6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:46.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.245+0000 7f710342b740 1 --2- 172.21.15.99:0/1666081093 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56181f109bc0 0x56181f0c6dd0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f70e4031c50 tx=0x7f70e40bc000 comp rx=0 tx=0).stop 2024-02-21T23:02:46.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.245+0000 7f710342b740 1 -- 172.21.15.99:0/1666081093 shutdown_connections 2024-02-21T23:02:46.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.245+0000 7f710342b740 1 --2- 172.21.15.99:0/1666081093 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56181f13f260 0x56181f1a7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:46.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.245+0000 7f710342b740 1 --2- 172.21.15.99:0/1666081093 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56181f109bc0 0x56181f0c6dd0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:46.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.245+0000 7f710342b740 1 --2- 172.21.15.99:0/1666081093 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56181f1092a0 0x56181f0d02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:46.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.245+0000 7f710342b740 1 -- 172.21.15.99:0/1666081093 >> 172.21.15.99:0/1666081093 conn(0x56181f0986b0 msgr2=0x56181f135a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:46.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.245+0000 7f710342b740 1 -- 172.21.15.99:0/1666081093 shutdown_connections 2024-02-21T23:02:46.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.245+0000 7f710342b740 1 -- 172.21.15.99:0/1666081093 wait complete. 2024-02-21T23:02:46.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.246+0000 7f710342b740 1 -- start start 2024-02-21T23:02:46.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.246+0000 7f710342b740 1 Processor -- start 2024-02-21T23:02:46.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.249+0000 7f710342b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56181f1092a0 0x56181f1432a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:46.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.249+0000 7f710342b740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56181f109bc0 0x56181f0e7130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:46.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.249+0000 7f710342b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56181f13f260 0x56181f143a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:46.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.249+0000 7f710342b740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f821fd60 con 0x56181f109bc0 2024-02-21T23:02:46.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.249+0000 7f710342b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f80e5a30 con 0x56181f1092a0 2024-02-21T23:02:46.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.249+0000 7f710342b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f80e4d70 con 0x56181f13f260 2024-02-21T23:02:46.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.249+0000 7f710342b740 10 client.0 _ll_register_callbacks cb 0x7f70e40b9240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:02:46.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.249+0000 7f70fd000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56181f109bc0 0x56181f0e7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:46.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.249+0000 7f70fd000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56181f109bc0 0x56181f0e7130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:59626/0 (socket says 172.21.15.99:59626) 2024-02-21T23:02:46.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.249+0000 7f70fd000640 1 -- 172.21.15.99:0/1600387037 learned_addr learned my addr 172.21.15.99:0/1600387037 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:02:46.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.249+0000 7f70fda00640 1 --2- 172.21.15.99:0/1600387037 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56181f1092a0 0x56181f1432a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:46.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.249+0000 7f70fe400640 1 --2- 172.21.15.99:0/1600387037 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56181f13f260 0x56181f143a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:46.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.249+0000 7f70fd000640 1 -- 172.21.15.99:0/1600387037 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56181f13f260 msgr2=0x56181f143a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:46.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.249+0000 7f70fd000640 1 --2- 172.21.15.99:0/1600387037 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56181f13f260 0x56181f143a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:46.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.249+0000 7f70fd000640 1 -- 172.21.15.99:0/1600387037 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56181f1092a0 msgr2=0x56181f1432a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:02:46.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.249+0000 7f70fd000640 1 --2- 172.21.15.99:0/1600387037 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56181f1092a0 0x56181f1432a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:46.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.249+0000 7f70fd000640 1 -- 172.21.15.99:0/1600387037 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56181f13e930 con 0x56181f109bc0 2024-02-21T23:02:46.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.250+0000 7f70fd000640 1 --2- 172.21.15.99:0/1600387037 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56181f109bc0 0x56181f0e7130 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f70e402bdd0 tx=0x7f70e402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de99e31b17b62d46 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:02:46.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.250+0000 7f70dea00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:02:46.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.250+0000 7f70dea00640 1 -- 172.21.15.99:0/1600387037 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e40bd850 con 0x56181f109bc0 2024-02-21T23:02:46.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.250+0000 7f70dea00640 1 -- 172.21.15.99:0/1600387037 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f70e40c1a10 con 0x56181f109bc0 2024-02-21T23:02:46.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.250+0000 7f710342b740 1 -- 172.21.15.99:0/1600387037 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f70e4037040 con 0x56181f109bc0 2024-02-21T23:02:46.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.250+0000 7f70dea00640 1 -- 172.21.15.99:0/1600387037 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f70e40c1c10 con 0x56181f109bc0 2024-02-21T23:02:46.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.250+0000 7f710342b740 10 client.5307 fetch_fsmap learned FSMap version 15 2024-02-21T23:02:46.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.250+0000 7f710342b740 1 -- 172.21.15.99:0/1600387037 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x56181f13e930 con 0x56181f109bc0 2024-02-21T23:02:46.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.250+0000 7f70dea00640 1 -- 172.21.15.99:0/1600387037 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70e4037040 con 0x56181f109bc0 2024-02-21T23:02:46.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.251+0000 7f70dea00640 1 -- 172.21.15.99:0/1600387037 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 15) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f70e40e9020 con 0x56181f109bc0 2024-02-21T23:02:46.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.251+0000 7f710342b740 10 client.5307 fetch_fsmap finished waiting for FSMap version 15 2024-02-21T23:02:46.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.251+0000 7f710342b740 10 client.5307 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:02:46.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.251+0000 7f710342b740 20 client.5307 populate_metadata read hostname 'smithi099' 2024-02-21T23:02:46.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.251+0000 7f710342b740 1 --2- 172.21.15.99:0/1600387037 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x56181f151550 0x56181f1a6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:02:46.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.251+0000 7f710342b740 4 client.5307 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T23:02:46.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.251+0000 7f710342b740 1 -- 172.21.15.99:0/1600387037 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56181f03d320 con 0x56181f151550 2024-02-21T23:02:46.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.251+0000 7f70fda00640 1 --2- 172.21.15.99:0/1600387037 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x56181f151550 0x56181f1a6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:02:46.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.252+0000 7f70fda00640 1 --2- 172.21.15.99:0/1600387037 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x56181f151550 0x56181f1a6aa0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e87e0267afb31a8 server_cookie=b06a3a835aa8f6a9 in_seq=0 out_seq=0 2024-02-21T23:02:46.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.252+0000 7f70dea00640 10 client.5307 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:02:46.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.252+0000 7f70dea00640 1 -- 172.21.15.99:0/1600387037 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x56181f03d320 con 0x56181f151550 2024-02-21T23:02:46.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.252+0000 7f70dea00640 10 client.5307 handle_command_reply: tid=0 2024-02-21T23:02:46.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.252+0000 7f710342b740 1 client.5307 shutdown 2024-02-21T23:02:46.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.252+0000 7f710342b740 1 -- 172.21.15.99:0/1600387037 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56181f109bc0 msgr2=0x56181f0e7130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:46.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.252+0000 7f710342b740 1 --2- 172.21.15.99:0/1600387037 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56181f109bc0 0x56181f0e7130 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f70e402bdd0 tx=0x7f70e402b840 comp rx=0 tx=0).stop 2024-02-21T23:02:46.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.252+0000 7f710342b740 1 -- 172.21.15.99:0/1600387037 shutdown_connections 2024-02-21T23:02:46.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.252+0000 7f710342b740 1 --2- 172.21.15.99:0/1600387037 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x56181f151550 0x56181f1a6aa0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:46.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.253+0000 7f710342b740 1 --2- 172.21.15.99:0/1600387037 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56181f13f260 0x56181f143a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:46.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.253+0000 7f710342b740 1 --2- 172.21.15.99:0/1600387037 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56181f109bc0 0x56181f0e7130 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:46.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.253+0000 7f70dea00640 0 client.5307 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:02:46.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.253+0000 7f710342b740 1 --2- 172.21.15.99:0/1600387037 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56181f1092a0 0x56181f1432a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:46.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.253+0000 7f710342b740 1 -- 172.21.15.99:0/1600387037 >> 172.21.15.99:0/1600387037 conn(0x56181f0986b0 msgr2=0x56181f0cd8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:46.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.253+0000 7f710342b740 1 -- 172.21.15.99:0/1600387037 shutdown_connections 2024-02-21T23:02:46.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.253+0000 7f710342b740 1 -- 172.21.15.99:0/1600387037 wait complete. 2024-02-21T23:02:46.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.253+0000 7f710342b740 20 client.5307 trim_cache size 0 max 16384 2024-02-21T23:02:46.245 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-02-21T23:02:46.245 INFO:teuthology.orchestra.run.smithi099.stdout: "status": "IDLE (waiting for more scrubs)", 2024-02-21T23:02:46.245 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubs": { 2024-02-21T23:02:46.245 INFO:teuthology.orchestra.run.smithi099.stdout: "04e54ecc-e7ac-4741-a370-47fa8a157847": { 2024-02-21T23:02:46.245 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/", 2024-02-21T23:02:46.245 INFO:teuthology.orchestra.run.smithi099.stdout: "tag": "04e54ecc-e7ac-4741-a370-47fa8a157847", 2024-02-21T23:02:46.245 INFO:teuthology.orchestra.run.smithi099.stdout: "options": "recursive,force" 2024-02-21T23:02:46.245 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:02:46.245 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:02:46.246 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-02-21T23:02:46.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.254+0000 7f70fee00640 1 -- 172.21.15.99:0/95729566 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f70d809ef90 msgr2=0x7f70d80a1450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:46.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.254+0000 7f70fee00640 1 --2- 172.21.15.99:0/95729566 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f70d809ef90 0x7f70d80a1450 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f70ec001560 tx=0x7f70ec009040 comp rx=0 tx=0).stop 2024-02-21T23:02:46.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.254+0000 7f70fee00640 1 -- 172.21.15.99:0/95729566 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f70f80fa100 msgr2=0x7f70f8071800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:02:46.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.254+0000 7f70fee00640 1 --2- 172.21.15.99:0/95729566 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f70f80fa100 0x7f70f8071800 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f70e4033000 tx=0x7f70e40046c0 comp rx=0 tx=0).stop 2024-02-21T23:02:46.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.254+0000 7f70fee00640 1 -- 172.21.15.99:0/95729566 shutdown_connections 2024-02-21T23:02:46.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.254+0000 7f70fee00640 1 --2- 172.21.15.99:0/95729566 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f70d809ef90 0x7f70d80a1450 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:46.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.254+0000 7f70fee00640 1 --2- 172.21.15.99:0/95729566 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f70f81870f0 0x7f70f8176360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:46.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.254+0000 7f70fee00640 1 --2- 172.21.15.99:0/95729566 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f70f80fa100 0x7f70f8071800 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:46.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.254+0000 7f70fee00640 1 --2- 172.21.15.99:0/95729566 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f70f808cfd0 0x7f70f8223010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:02:46.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.254+0000 7f70fee00640 1 -- 172.21.15.99:0/95729566 >> 172.21.15.99:0/95729566 conn(0x7f70f80d06d0 msgr2=0x7f70f81868e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:02:46.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.254+0000 7f70fee00640 1 -- 172.21.15.99:0/95729566 shutdown_connections 2024-02-21T23:02:46.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:02:46.254+0000 7f70fee00640 1 -- 172.21.15.99:0/95729566 wait complete. 2024-02-21T23:02:46.259 INFO:tasks.cephfs.filesystem:scrub status for tag:04e54ecc-e7ac-4741-a370-47fa8a157847 - {'path': '/', 'tag': '04e54ecc-e7ac-4741-a370-47fa8a157847', 'options': 'recursive,force'} 2024-02-21T23:03:00.906 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-02-21T23:03:00.916+0000 7f14714c7640 -1 client.0 error registering admin socket command: (17) File exists 2024-02-21T23:03:00.906 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-02-21T23:03:00.916+0000 7f14714c7640 -1 client.0 error registering admin socket command: (17) File exists 2024-02-21T23:03:00.906 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-02-21T23:03:00.916+0000 7f14714c7640 -1 client.0 error registering admin socket command: (17) File exists 2024-02-21T23:03:00.906 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-02-21T23:03:00.916+0000 7f14714c7640 -1 client.0 error registering admin socket command: (17) File exists 2024-02-21T23:03:00.906 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-02-21T23:03:00.916+0000 7f14714c7640 -1 client.0 error registering admin socket command: (17) File exists 2024-02-21T23:03:10.522 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:03:10.528 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:03:10.535 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:03:16.260 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T23:03:16.260 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T23:03:16.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.546+0000 7f25c6800640 1 Processor -- start 2024-02-21T23:03:16.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.547+0000 7f25c6800640 1 -- start start 2024-02-21T23:03:16.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.549+0000 7f25c6800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f25c017f490 0x7f25c018ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:16.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.549+0000 7f25c6800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25c00d6dd0 con 0x7f25c018b4f0 2024-02-21T23:03:16.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.550+0000 7f25c6800640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25c01614c0 con 0x7f25c018b060 2024-02-21T23:03:16.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.550+0000 7f25c6800640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25c00d6810 con 0x7f25c017f490 2024-02-21T23:03:16.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.551+0000 7f25c5400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f25c017f490 0x7f25c018ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:16.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.551+0000 7f25c5400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f25c017f490 0x7f25c018ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:36918/0 (socket says 172.21.15.99:36918) 2024-02-21T23:03:16.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.551+0000 7f25c5400640 1 -- 172.21.15.99:0/2118018347 learned_addr learned my addr 172.21.15.99:0/2118018347 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:03:16.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.551+0000 7f25c5400640 1 -- 172.21.15.99:0/2118018347 >> v1:172.21.15.181:6789/0 conn(0x7f25c018b060 legacy=0x7f25c0188a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:16.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.551+0000 7f25c5400640 1 -- 172.21.15.99:0/2118018347 >> v1:172.21.15.162:6789/0 conn(0x7f25c018b4f0 legacy=0x7f25c0189150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:16.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.551+0000 7f25c5400640 1 -- 172.21.15.99:0/2118018347 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25c00d6af0 con 0x7f25c017f490 2024-02-21T23:03:16.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.554+0000 7f25c5400640 1 --2- 172.21.15.99:0/2118018347 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f25c017f490 0x7f25c018ab20 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f25b4009870 tx=0x7f25b402b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88a2aafabc86fa4 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:16.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.555+0000 7f25bfe00640 1 -- 172.21.15.99:0/2118018347 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b4037070 con 0x7f25c017f490 2024-02-21T23:03:16.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.555+0000 7f25bfe00640 1 -- 172.21.15.99:0/2118018347 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b4004230 con 0x7f25c017f490 2024-02-21T23:03:16.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.555+0000 7f25bfe00640 1 -- 172.21.15.99:0/2118018347 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b4003610 con 0x7f25c017f490 2024-02-21T23:03:16.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.556+0000 7f25c6800640 1 -- 172.21.15.99:0/2118018347 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f25c017f490 msgr2=0x7f25c018ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:16.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.556+0000 7f25c6800640 1 --2- 172.21.15.99:0/2118018347 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f25c017f490 0x7f25c018ab20 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f25b4009870 tx=0x7f25b402b7e0 comp rx=0 tx=0).stop 2024-02-21T23:03:16.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.557+0000 7f25c6800640 1 -- 172.21.15.99:0/2118018347 shutdown_connections 2024-02-21T23:03:16.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.557+0000 7f25c6800640 1 --2- 172.21.15.99:0/2118018347 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f25c017f490 0x7f25c018ab20 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:16.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.557+0000 7f25c6800640 1 -- 172.21.15.99:0/2118018347 >> 172.21.15.99:0/2118018347 conn(0x7f25c00d29b0 msgr2=0x7f25c00d2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:03:16.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.558+0000 7f25c6800640 1 -- 172.21.15.99:0/2118018347 shutdown_connections 2024-02-21T23:03:16.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.558+0000 7f25c6800640 1 -- 172.21.15.99:0/2118018347 wait complete. 2024-02-21T23:03:16.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.562+0000 7f25c6800640 1 Processor -- start 2024-02-21T23:03:16.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.563+0000 7f25c6800640 1 -- start start 2024-02-21T23:03:16.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.566+0000 7f25c6800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f25c017f490 0x7f25c00f1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:16.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.566+0000 7f25c6800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f25c018b060 0x7f25c00f23f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:16.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.566+0000 7f25c6800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f25c018b4f0 0x7f25c00f4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:16.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.566+0000 7f25c6800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c018a600 con 0x7f25c018b4f0 2024-02-21T23:03:16.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.566+0000 7f25c6800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c018a320 con 0x7f25c018b060 2024-02-21T23:03:16.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.566+0000 7f25c6800640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c017f870 con 0x7f25c017f490 2024-02-21T23:03:16.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.567+0000 7f25c4a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f25c018b060 0x7f25c00f23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:16.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.567+0000 7f25c4a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f25c018b060 0x7f25c00f23f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:40066/0 (socket says 172.21.15.99:40066) 2024-02-21T23:03:16.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.567+0000 7f25c4a00640 1 -- 172.21.15.99:0/500601470 learned_addr learned my addr 172.21.15.99:0/500601470 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:03:16.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.566+0000 7f25c5400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f25c017f490 0x7f25c00f1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:16.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.567+0000 7f25c5e00640 1 --2- 172.21.15.99:0/500601470 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f25c018b4f0 0x7f25c00f4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:16.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.568+0000 7f25c5e00640 1 -- 172.21.15.99:0/500601470 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f25c017f490 msgr2=0x7f25c00f1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:16.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.568+0000 7f25c5e00640 1 --2- 172.21.15.99:0/500601470 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f25c017f490 0x7f25c00f1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:16.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.568+0000 7f25c5e00640 1 -- 172.21.15.99:0/500601470 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f25c018b060 msgr2=0x7f25c00f23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:16.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.568+0000 7f25c5e00640 1 --2- 172.21.15.99:0/500601470 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f25c018b060 0x7f25c00f23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:16.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.568+0000 7f25c5e00640 1 -- 172.21.15.99:0/500601470 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25c00d6520 con 0x7f25c018b4f0 2024-02-21T23:03:16.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.569+0000 7f25c5e00640 1 --2- 172.21.15.99:0/500601470 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f25c018b4f0 0x7f25c00f4490 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f25b800c7d0 tx=0x7f25b800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:16.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.570+0000 7f25bd600640 1 -- 172.21.15.99:0/500601470 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b8017070 con 0x7f25c018b4f0 2024-02-21T23:03:16.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.570+0000 7f25c6800640 1 -- 172.21.15.99:0/500601470 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25c02200a0 con 0x7f25c018b4f0 2024-02-21T23:03:16.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.570+0000 7f25c6800640 1 -- 172.21.15.99:0/500601470 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25c00f2a30 con 0x7f25c018b4f0 2024-02-21T23:03:16.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.571+0000 7f25bd600640 1 -- 172.21.15.99:0/500601470 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b8003da0 con 0x7f25c018b4f0 2024-02-21T23:03:16.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.571+0000 7f25bd600640 1 -- 172.21.15.99:0/500601470 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b80052b0 con 0x7f25c018b4f0 2024-02-21T23:03:16.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.578+0000 7f25cadac740 1 Processor -- start 2024-02-21T23:03:16.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.580+0000 7f25bd600640 1 -- 172.21.15.99:0/500601470 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 13) v1 ==== 134589+0+0 (secure 0 0 0) 0x7f25b801a070 con 0x7f25c018b4f0 2024-02-21T23:03:16.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.582+0000 7f25bd600640 1 --2- 172.21.15.99:0/500601470 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f25a009f070 0x7f25a00a1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:16.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.582+0000 7f25bd600640 1 -- 172.21.15.99:0/500601470 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f25b80c97b0 con 0x7f25c018b4f0 2024-02-21T23:03:16.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.583+0000 7f25cadac740 1 -- start start 2024-02-21T23:03:16.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.584+0000 7f25c4a00640 1 --2- 172.21.15.99:0/500601470 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f25a009f070 0x7f25a00a1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:16.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.585+0000 7f25c4a00640 1 --2- 172.21.15.99:0/500601470 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f25a009f070 0x7f25a00a1530 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f25c0091a00 tx=0x7f25ac009040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:16.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.586+0000 7f25cadac740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55721f60a2a0 0x55721f63fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:16.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.586+0000 7f25cadac740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55721f640260 0x55721f60a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:16.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.586+0000 7f25cadac740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55721f60abc0 0x55721f5cd1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:16.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.586+0000 7f25cadac740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55721f536a90 con 0x55721f640260 2024-02-21T23:03:16.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.586+0000 7f25cadac740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55721f4dfb10 con 0x55721f60a2a0 2024-02-21T23:03:16.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.586+0000 7f25cadac740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55721f532b30 con 0x55721f60abc0 2024-02-21T23:03:16.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.588+0000 7f25c4a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55721f640260 0x55721f60a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:16.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.588+0000 7f25c4a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55721f640260 0x55721f60a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:36934/0 (socket says 172.21.15.99:36934) 2024-02-21T23:03:16.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.588+0000 7f25c5e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55721f60abc0 0x55721f5cd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:16.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.588+0000 7f25c5e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55721f60abc0 0x55721f5cd1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:55898/0 (socket says 172.21.15.99:55898) 2024-02-21T23:03:16.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.588+0000 7f25c5e00640 1 -- 172.21.15.99:0/2706653177 learned_addr learned my addr 172.21.15.99:0/2706653177 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:03:16.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.588+0000 7f25c5400640 1 --2- 172.21.15.99:0/2706653177 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55721f60a2a0 0x55721f63fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:16.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.589+0000 7f25c5e00640 1 -- 172.21.15.99:0/2706653177 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55721f60a2a0 msgr2=0x55721f63fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:16.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.589+0000 7f25c5e00640 1 --2- 172.21.15.99:0/2706653177 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55721f60a2a0 0x55721f63fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:16.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.589+0000 7f25c5e00640 1 -- 172.21.15.99:0/2706653177 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55721f640260 msgr2=0x55721f60a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:16.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.589+0000 7f25c5e00640 1 --2- 172.21.15.99:0/2706653177 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55721f640260 0x55721f60a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:16.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.589+0000 7f25c5e00640 1 -- 172.21.15.99:0/2706653177 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55721f3157d0 con 0x55721f60abc0 2024-02-21T23:03:16.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.589+0000 7f25c4a00640 1 --2- 172.21.15.99:0/2706653177 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55721f640260 0x55721f60a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:03:16.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.589+0000 7f25c5400640 1 --2- 172.21.15.99:0/2706653177 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55721f60a2a0 0x55721f63fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:03:16.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.589+0000 7f25c5e00640 1 --2- 172.21.15.99:0/2706653177 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55721f60abc0 0x55721f5cd1d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f25b8093260 tx=0x7f25b80975c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4288b08d2e09197 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:16.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.590+0000 7f25b1c00640 1 -- 172.21.15.99:0/2706653177 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b809f5a0 con 0x55721f60abc0 2024-02-21T23:03:16.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.590+0000 7f25b1c00640 1 -- 172.21.15.99:0/2706653177 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b80aae50 con 0x55721f60abc0 2024-02-21T23:03:16.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.590+0000 7f25b1c00640 1 -- 172.21.15.99:0/2706653177 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b8093470 con 0x55721f60abc0 2024-02-21T23:03:16.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.591+0000 7f25cadac740 1 -- 172.21.15.99:0/2706653177 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55721f60abc0 msgr2=0x55721f5cd1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:16.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.591+0000 7f25cadac740 1 --2- 172.21.15.99:0/2706653177 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55721f60abc0 0x55721f5cd1d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f25b8093260 tx=0x7f25b80975c0 comp rx=0 tx=0).stop 2024-02-21T23:03:16.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.591+0000 7f25cadac740 1 -- 172.21.15.99:0/2706653177 shutdown_connections 2024-02-21T23:03:16.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.591+0000 7f25cadac740 1 --2- 172.21.15.99:0/2706653177 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55721f60abc0 0x55721f5cd1d0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:16.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.591+0000 7f25cadac740 1 --2- 172.21.15.99:0/2706653177 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55721f640260 0x55721f60a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:16.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.591+0000 7f25cadac740 1 --2- 172.21.15.99:0/2706653177 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55721f60a2a0 0x55721f63fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:16.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.591+0000 7f25cadac740 1 -- 172.21.15.99:0/2706653177 >> 172.21.15.99:0/2706653177 conn(0x55721f5996b0 msgr2=0x55721f5d1190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:03:16.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.591+0000 7f25cadac740 1 -- 172.21.15.99:0/2706653177 shutdown_connections 2024-02-21T23:03:16.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.592+0000 7f25cadac740 1 -- 172.21.15.99:0/2706653177 wait complete. 2024-02-21T23:03:16.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.593+0000 7f25cadac740 1 -- start start 2024-02-21T23:03:16.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.593+0000 7f25cadac740 1 Processor -- start 2024-02-21T23:03:16.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.596+0000 7f25cadac740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55721f60a2a0 0x55721f5ce380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:16.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.596+0000 7f25cadac740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55721f60abc0 0x55721f6003e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:16.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.597+0000 7f25cadac740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55721f640260 0x55721f6156d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:16.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.597+0000 7f25cadac740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55721f5d8f30 con 0x55721f60a2a0 2024-02-21T23:03:16.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.597+0000 7f25cadac740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55721f4d51c0 con 0x55721f60abc0 2024-02-21T23:03:16.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.597+0000 7f25cadac740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55721f641930 con 0x55721f640260 2024-02-21T23:03:16.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.597+0000 7f25cadac740 10 client.0 _ll_register_callbacks cb 0x55721f4f2930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:03:16.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.598+0000 7f25c5e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55721f640260 0x55721f6156d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:16.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.598+0000 7f25c5400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55721f60a2a0 0x55721f5ce380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:16.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.598+0000 7f25c5e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55721f640260 0x55721f6156d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:55912/0 (socket says 172.21.15.99:55912) 2024-02-21T23:03:16.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.598+0000 7f25c5e00640 1 -- 172.21.15.99:0/2885495114 learned_addr learned my addr 172.21.15.99:0/2885495114 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:03:16.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.598+0000 7f25c4a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55721f60abc0 0x55721f6003e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:16.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.599+0000 7f25c5400640 1 -- 172.21.15.99:0/2885495114 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55721f640260 msgr2=0x55721f6156d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:16.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.599+0000 7f25c5400640 1 --2- 172.21.15.99:0/2885495114 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55721f640260 0x55721f6156d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:16.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.599+0000 7f25c5400640 1 -- 172.21.15.99:0/2885495114 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55721f60abc0 msgr2=0x55721f6003e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:16.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.599+0000 7f25c5400640 1 --2- 172.21.15.99:0/2885495114 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55721f60abc0 0x55721f6003e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:16.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.599+0000 7f25c5400640 1 -- 172.21.15.99:0/2885495114 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55721f24b3f0 con 0x55721f60a2a0 2024-02-21T23:03:16.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.600+0000 7f25c5e00640 1 --2- 172.21.15.99:0/2885495114 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55721f640260 0x55721f6156d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:03:16.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.601+0000 7f25c5400640 1 --2- 172.21.15.99:0/2885495114 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55721f60a2a0 0x55721f5ce380 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f25b4004000 tx=0x7f25b402d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f09d3f3404da2d9 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:16.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.601+0000 7f25a6000640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:03:16.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.601+0000 7f25a6000640 1 -- 172.21.15.99:0/2885495114 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b4037040 con 0x55721f60a2a0 2024-02-21T23:03:16.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.602+0000 7f25a6000640 1 -- 172.21.15.99:0/2885495114 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f25b4003bc0 con 0x55721f60a2a0 2024-02-21T23:03:16.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.602+0000 7f25cadac740 1 -- 172.21.15.99:0/2885495114 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f25b80aae50 con 0x55721f60a2a0 2024-02-21T23:03:16.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.602+0000 7f25a6000640 1 -- 172.21.15.99:0/2885495114 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f25b4003dc0 con 0x55721f60a2a0 2024-02-21T23:03:16.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.603+0000 7f25cadac740 10 client.5325 fetch_fsmap learned FSMap version 15 2024-02-21T23:03:16.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.603+0000 7f25cadac740 1 -- 172.21.15.99:0/2885495114 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x55721f20b0f0 con 0x55721f60a2a0 2024-02-21T23:03:16.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.604+0000 7f25a6000640 1 -- 172.21.15.99:0/2885495114 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b80aae50 con 0x55721f60a2a0 2024-02-21T23:03:16.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.604+0000 7f25a6000640 1 -- 172.21.15.99:0/2885495114 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 15) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f25b4030510 con 0x55721f60a2a0 2024-02-21T23:03:16.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.604+0000 7f25cadac740 10 client.5325 fetch_fsmap finished waiting for FSMap version 15 2024-02-21T23:03:16.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.604+0000 7f25cadac740 10 client.5325 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:03:16.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.604+0000 7f25cadac740 20 client.5325 populate_metadata read hostname 'smithi099' 2024-02-21T23:03:16.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.604+0000 7f25cadac740 1 --2- 172.21.15.99:0/2885495114 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55721f602940 0x55721f614f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:16.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.604+0000 7f25cadac740 4 client.5325 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:03:16.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.604+0000 7f25cadac740 1 -- 172.21.15.99:0/2885495114 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55721f543fd0 con 0x55721f602940 2024-02-21T23:03:16.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.606+0000 7f25c4a00640 1 --2- 172.21.15.99:0/2885495114 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55721f602940 0x55721f614f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:16.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.607+0000 7f25c4a00640 1 --2- 172.21.15.99:0/2885495114 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55721f602940 0x55721f614f10 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9dcfbd8aec35182 server_cookie=d608d7a4e4eb30bb in_seq=0 out_seq=0 2024-02-21T23:03:16.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.607+0000 7f25a6000640 10 client.5325 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:03:16.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.608+0000 7f25a6000640 1 -- 172.21.15.99:0/2885495114 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55721f543fd0 con 0x55721f602940 2024-02-21T23:03:16.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.608+0000 7f25a6000640 10 client.5325 handle_command_reply: tid=0 2024-02-21T23:03:16.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.608+0000 7f25cadac740 1 client.5325 shutdown 2024-02-21T23:03:16.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.611+0000 7f25cadac740 1 -- 172.21.15.99:0/2885495114 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55721f60a2a0 msgr2=0x55721f5ce380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:16.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.611+0000 7f25cadac740 1 --2- 172.21.15.99:0/2885495114 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55721f60a2a0 0x55721f5ce380 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f25b4004000 tx=0x7f25b402d000 comp rx=0 tx=0).stop 2024-02-21T23:03:16.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.611+0000 7f25cadac740 1 -- 172.21.15.99:0/2885495114 shutdown_connections 2024-02-21T23:03:16.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.611+0000 7f25cadac740 1 --2- 172.21.15.99:0/2885495114 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55721f602940 0x55721f614f10 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:16.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.611+0000 7f25cadac740 1 --2- 172.21.15.99:0/2885495114 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55721f640260 0x55721f6156d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:16.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.611+0000 7f25cadac740 1 --2- 172.21.15.99:0/2885495114 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55721f60abc0 0x55721f6003e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:16.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.611+0000 7f25cadac740 1 --2- 172.21.15.99:0/2885495114 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55721f60a2a0 0x55721f5ce380 secure :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f25b4004000 tx=0x7f25b402d000 comp rx=0 tx=0).stop 2024-02-21T23:03:16.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.611+0000 7f25cadac740 1 -- 172.21.15.99:0/2885495114 >> 172.21.15.99:0/2885495114 conn(0x55721f5996b0 msgr2=0x55721f63f960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:03:16.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.611+0000 7f25a6000640 0 client.5325 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:03:16.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.612+0000 7f25cadac740 1 -- 172.21.15.99:0/2885495114 shutdown_connections 2024-02-21T23:03:16.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.613+0000 7f25cadac740 1 -- 172.21.15.99:0/2885495114 wait complete. 2024-02-21T23:03:16.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.613+0000 7f25cadac740 20 client.5325 trim_cache size 0 max 16384 2024-02-21T23:03:16.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.648+0000 7f25cadac740 1 Processor -- start 2024-02-21T23:03:16.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.648+0000 7f25cadac740 1 -- start start 2024-02-21T23:03:16.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.650+0000 7f25cadac740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55721f60abc0 0x55721f616630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:16.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.650+0000 7f25cadac740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55721f640260 0x55721f5ce360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:16.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.651+0000 7f25c5400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55721f60abc0 0x55721f616630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:16.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.651+0000 7f25c5400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55721f60abc0 0x55721f616630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:55918/0 (socket says 172.21.15.99:55918) 2024-02-21T23:03:16.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.651+0000 7f25c4a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55721f640260 0x55721f5ce360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:16.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.651+0000 7f25c4a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55721f640260 0x55721f5ce360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:40080/0 (socket says 172.21.15.99:40080) 2024-02-21T23:03:16.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.651+0000 7f25cadac740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55721f5d8130 0x55721f5d0110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:16.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.651+0000 7f25cadac740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f259c011b40 con 0x55721f5d8130 2024-02-21T23:03:16.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.651+0000 7f25cadac740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f259c00f6e0 con 0x55721f640260 2024-02-21T23:03:16.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.651+0000 7f25cadac740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f259c00d780 con 0x55721f60abc0 2024-02-21T23:03:16.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.652+0000 7f25c5400640 1 -- 172.21.15.99:0/2135684501 learned_addr learned my addr 172.21.15.99:0/2135684501 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:03:16.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.652+0000 7f25c4a00640 1 -- 172.21.15.99:0/2135684501 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55721f60abc0 msgr2=0x55721f616630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:16.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.652+0000 7f25c4a00640 1 --2- 172.21.15.99:0/2135684501 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55721f60abc0 0x55721f616630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:16.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.652+0000 7f25c5e00640 1 --2- 172.21.15.99:0/2135684501 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55721f5d8130 0x55721f5d0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:16.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.652+0000 7f25c4a00640 1 -- 172.21.15.99:0/2135684501 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55721f5d8130 msgr2=0x55721f5d0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:16.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.653+0000 7f25c4a00640 1 --2- 172.21.15.99:0/2135684501 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55721f5d8130 0x55721f5d0110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:16.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.653+0000 7f25c4a00640 1 -- 172.21.15.99:0/2135684501 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55721f613e90 con 0x55721f640260 2024-02-21T23:03:16.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.653+0000 7f25c5e00640 1 --2- 172.21.15.99:0/2135684501 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55721f5d8130 0x55721f5d0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T23:03:16.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.653+0000 7f25c4a00640 1 --2- 172.21.15.99:0/2135684501 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55721f640260 0x55721f5ce360 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f25ac007fd0 tx=0x7f25ac014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d7af90952fe35ea server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:16.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.654+0000 7f25b1200640 1 -- 172.21.15.99:0/2135684501 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25ac007020 con 0x55721f640260 2024-02-21T23:03:16.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.654+0000 7f25b1200640 1 -- 172.21.15.99:0/2135684501 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25ac0071c0 con 0x55721f640260 2024-02-21T23:03:16.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.654+0000 7f25b1200640 1 -- 172.21.15.99:0/2135684501 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25ac0073b0 con 0x55721f640260 2024-02-21T23:03:16.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.655+0000 7f25cadac740 1 -- 172.21.15.99:0/2135684501 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55721f640260 msgr2=0x55721f5ce360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:16.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.655+0000 7f25cadac740 1 --2- 172.21.15.99:0/2135684501 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55721f640260 0x55721f5ce360 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f25ac007fd0 tx=0x7f25ac014000 comp rx=0 tx=0).stop 2024-02-21T23:03:16.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.655+0000 7f25cadac740 1 -- 172.21.15.99:0/2135684501 shutdown_connections 2024-02-21T23:03:16.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.655+0000 7f25cadac740 1 --2- 172.21.15.99:0/2135684501 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55721f5d8130 0x55721f5d0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:16.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.655+0000 7f25cadac740 1 --2- 172.21.15.99:0/2135684501 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55721f640260 0x55721f5ce360 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:16.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.655+0000 7f25cadac740 1 --2- 172.21.15.99:0/2135684501 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55721f60abc0 0x55721f616630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:16.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.655+0000 7f25cadac740 1 -- 172.21.15.99:0/2135684501 >> 172.21.15.99:0/2135684501 conn(0x55721f5996b0 msgr2=0x55721f6110f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:03:16.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.656+0000 7f25cadac740 1 -- 172.21.15.99:0/2135684501 shutdown_connections 2024-02-21T23:03:16.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.656+0000 7f25cadac740 1 -- 172.21.15.99:0/2135684501 wait complete. 2024-02-21T23:03:16.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.658+0000 7f25cadac740 1 -- start start 2024-02-21T23:03:16.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.658+0000 7f25cadac740 1 Processor -- start 2024-02-21T23:03:16.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.661+0000 7f25cadac740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55721f5d8130 0x55721f5d85b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:16.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.661+0000 7f25cadac740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55721f60abc0 0x55721f5d0110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:16.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.661+0000 7f25cadac740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55721f640260 0x55721f659f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:16.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.662+0000 7f25c5e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55721f640260 0x55721f659f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:16.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.662+0000 7f25c5e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55721f640260 0x55721f659f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:55920/0 (socket says 172.21.15.99:55920) 2024-02-21T23:03:16.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.662+0000 7f25c5e00640 1 -- 172.21.15.99:0/1946842657 learned_addr learned my addr 172.21.15.99:0/1946842657 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:03:16.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.662+0000 7f25cadac740 1 -- 172.21.15.99:0/1946842657 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f259c00dd80 con 0x55721f5d8130 2024-02-21T23:03:16.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.662+0000 7f25cadac740 1 -- 172.21.15.99:0/1946842657 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f259c00f080 con 0x55721f60abc0 2024-02-21T23:03:16.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.662+0000 7f25cadac740 1 -- 172.21.15.99:0/1946842657 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f259c00e3c0 con 0x55721f640260 2024-02-21T23:03:16.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.662+0000 7f25cadac740 10 client.0 _ll_register_callbacks cb 0x7f25b40044d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:03:16.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.662+0000 7f25c4a00640 1 --2- 172.21.15.99:0/1946842657 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55721f60abc0 0x55721f5d0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:16.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.662+0000 7f25c5400640 1 --2- 172.21.15.99:0/1946842657 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55721f5d8130 0x55721f5d85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:16.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.663+0000 7f25c5e00640 1 -- 172.21.15.99:0/1946842657 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55721f60abc0 msgr2=0x55721f5d0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:16.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.663+0000 7f25c5e00640 1 --2- 172.21.15.99:0/1946842657 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55721f60abc0 0x55721f5d0110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:16.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.663+0000 7f25c5e00640 1 -- 172.21.15.99:0/1946842657 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55721f5d8130 msgr2=0x55721f5d85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:16.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.663+0000 7f25c5e00640 1 --2- 172.21.15.99:0/1946842657 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55721f5d8130 0x55721f5d85b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:16.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.663+0000 7f25c5e00640 1 -- 172.21.15.99:0/1946842657 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55721f6a4dc0 con 0x55721f640260 2024-02-21T23:03:16.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.663+0000 7f25c5400640 1 --2- 172.21.15.99:0/1946842657 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55721f5d8130 0x55721f5d85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T23:03:16.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.664+0000 7f25c5e00640 1 --2- 172.21.15.99:0/1946842657 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55721f640260 0x55721f659f10 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f25b800a430 tx=0x7f25b8001250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eddc4c4a7cbbf328 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:16.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.664+0000 7f25a6000640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-02-21T23:03:16.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.664+0000 7f25a6000640 1 -- 172.21.15.99:0/1946842657 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b80c4020 con 0x55721f640260 2024-02-21T23:03:16.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.664+0000 7f25a6000640 1 -- 172.21.15.99:0/1946842657 <== mon.2 v2:172.21.15.181:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f25b80c6ef0 con 0x55721f640260 2024-02-21T23:03:16.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.665+0000 7f25cadac740 1 -- 172.21.15.99:0/1946842657 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f25ac0071c0 con 0x55721f640260 2024-02-21T23:03:16.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.665+0000 7f25a6000640 1 -- 172.21.15.99:0/1946842657 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f25b80930a0 con 0x55721f640260 2024-02-21T23:03:16.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.666+0000 7f25cadac740 10 client.5444 fetch_fsmap learned FSMap version 15 2024-02-21T23:03:16.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.666+0000 7f25cadac740 1 -- 172.21.15.99:0/1946842657 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x55721f6a5380 con 0x55721f640260 2024-02-21T23:03:16.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.667+0000 7f25a6000640 1 -- 172.21.15.99:0/1946842657 <== mon.2 v2:172.21.15.181:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25ac0071c0 con 0x55721f640260 2024-02-21T23:03:16.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.667+0000 7f25a6000640 1 -- 172.21.15.99:0/1946842657 <== mon.2 v2:172.21.15.181:3300/0 5 ==== fsmap(e 15) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f25b8096250 con 0x55721f640260 2024-02-21T23:03:16.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.668+0000 7f25cadac740 10 client.5444 fetch_fsmap finished waiting for FSMap version 15 2024-02-21T23:03:16.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.668+0000 7f25cadac740 10 client.5444 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:03:16.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.668+0000 7f25cadac740 20 client.5444 populate_metadata read hostname 'smithi099' 2024-02-21T23:03:16.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.668+0000 7f25cadac740 1 --2- 172.21.15.99:0/1946842657 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55721f6110f0 0x55721f63de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:16.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.668+0000 7f25cadac740 4 client.5444 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T23:03:16.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.668+0000 7f25cadac740 1 -- 172.21.15.99:0/1946842657 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55721f53e320 con 0x55721f6110f0 2024-02-21T23:03:16.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.669+0000 7f25c5400640 1 --2- 172.21.15.99:0/1946842657 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55721f6110f0 0x55721f63de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:16.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.670+0000 7f25c5400640 1 --2- 172.21.15.99:0/1946842657 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55721f6110f0 0x55721f63de50 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1b4528f846305a2 server_cookie=2aa4ca84a74506d7 in_seq=0 out_seq=0 2024-02-21T23:03:16.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.670+0000 7f25a6000640 10 client.5444 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:03:16.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.671+0000 7f25a6000640 1 -- 172.21.15.99:0/1946842657 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55721f53e320 con 0x55721f6110f0 2024-02-21T23:03:16.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.671+0000 7f25a6000640 10 client.5444 handle_command_reply: tid=0 2024-02-21T23:03:16.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.671+0000 7f25cadac740 1 client.5444 shutdown 2024-02-21T23:03:16.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.671+0000 7f25cadac740 1 -- 172.21.15.99:0/1946842657 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55721f640260 msgr2=0x55721f659f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:16.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.671+0000 7f25cadac740 1 --2- 172.21.15.99:0/1946842657 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55721f640260 0x55721f659f10 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f25b800a430 tx=0x7f25b8001250 comp rx=0 tx=0).stop 2024-02-21T23:03:16.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.672+0000 7f25cadac740 1 -- 172.21.15.99:0/1946842657 shutdown_connections 2024-02-21T23:03:16.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.672+0000 7f25cadac740 1 --2- 172.21.15.99:0/1946842657 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55721f6110f0 0x55721f63de50 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:16.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.672+0000 7f25a6000640 0 client.5444 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:03:16.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.672+0000 7f25cadac740 1 --2- 172.21.15.99:0/1946842657 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55721f640260 0x55721f659f10 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:16.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.672+0000 7f25cadac740 1 --2- 172.21.15.99:0/1946842657 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55721f60abc0 0x55721f5d0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:16.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.672+0000 7f25cadac740 1 --2- 172.21.15.99:0/1946842657 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55721f5d8130 0x55721f5d85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:16.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.672+0000 7f25cadac740 1 -- 172.21.15.99:0/1946842657 >> 172.21.15.99:0/1946842657 conn(0x55721f5996b0 msgr2=0x55721f5cc7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:03:16.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.673+0000 7f25cadac740 1 -- 172.21.15.99:0/1946842657 shutdown_connections 2024-02-21T23:03:16.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.673+0000 7f25cadac740 1 -- 172.21.15.99:0/1946842657 wait complete. 2024-02-21T23:03:16.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.674+0000 7f25cadac740 20 client.5444 trim_cache size 0 max 16384 2024-02-21T23:03:16.665 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-02-21T23:03:16.665 INFO:teuthology.orchestra.run.smithi099.stdout: "status": "no active scrubs running", 2024-02-21T23:03:16.665 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubs": {} 2024-02-21T23:03:16.665 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-02-21T23:03:16.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.676+0000 7f25c6800640 1 -- 172.21.15.99:0/500601470 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f25a009f070 msgr2=0x7f25a00a1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:16.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.676+0000 7f25c6800640 1 --2- 172.21.15.99:0/500601470 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f25a009f070 0x7f25a00a1530 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f25c0091a00 tx=0x7f25ac009040 comp rx=0 tx=0).stop 2024-02-21T23:03:16.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.676+0000 7f25c6800640 1 -- 172.21.15.99:0/500601470 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f25c018b4f0 msgr2=0x7f25c00f4490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:16.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.676+0000 7f25c6800640 1 --2- 172.21.15.99:0/500601470 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f25c018b4f0 0x7f25c00f4490 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f25b800c7d0 tx=0x7f25b800cc90 comp rx=0 tx=0).stop 2024-02-21T23:03:16.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.677+0000 7f25c6800640 1 -- 172.21.15.99:0/500601470 shutdown_connections 2024-02-21T23:03:16.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.677+0000 7f25c6800640 1 --2- 172.21.15.99:0/500601470 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f25a009f070 0x7f25a00a1530 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:16.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.677+0000 7f25c6800640 1 --2- 172.21.15.99:0/500601470 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f25c018b4f0 0x7f25c00f4490 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:16.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.677+0000 7f25c6800640 1 --2- 172.21.15.99:0/500601470 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f25c018b060 0x7f25c00f23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:16.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.677+0000 7f25c6800640 1 --2- 172.21.15.99:0/500601470 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f25c017f490 0x7f25c00f1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:16.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.677+0000 7f25c6800640 1 -- 172.21.15.99:0/500601470 >> 172.21.15.99:0/500601470 conn(0x7f25c00d29b0 msgr2=0x7f25c00d20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:03:16.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.677+0000 7f25c6800640 1 -- 172.21.15.99:0/500601470 shutdown_connections 2024-02-21T23:03:16.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.677+0000 7f25c6800640 1 -- 172.21.15.99:0/500601470 wait complete. 2024-02-21T23:03:16.691 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-02-21T23:03:16.691 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T23:03:16.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.992+0000 7fa9cfe00640 1 Processor -- start 2024-02-21T23:03:16.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.992+0000 7fa9cfe00640 1 -- start start 2024-02-21T23:03:16.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.995+0000 7fa9cfe00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa9d018a010 0x7fa9d018b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:16.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.995+0000 7fa9cfe00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fa9d00719b0 0x7fa9d0071e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:16.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.995+0000 7fa9cfe00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9d018a600 con 0x7fa9d0182a80 2024-02-21T23:03:16.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.995+0000 7fa9cfe00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9d018bec0 con 0x7fa9d018a010 2024-02-21T23:03:16.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.995+0000 7fa9cfe00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9d018a8e0 con 0x7fa9d00719b0 2024-02-21T23:03:16.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.995+0000 7fa9cf400640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fa9d00719b0 0x7fa9d0071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:16.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.996+0000 7fa9cf400640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fa9d00719b0 0x7fa9d0071e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:46966/0 (socket says 172.21.15.99:46966) 2024-02-21T23:03:16.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.996+0000 7fa9cf400640 1 -- 172.21.15.99:0/545615235 learned_addr learned my addr 172.21.15.99:0/545615235 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:03:16.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.996+0000 7fa9cf400640 1 -- 172.21.15.99:0/545615235 >> v2:172.21.15.99:3300/0 conn(0x7fa9d018a010 msgr2=0x7fa9d018b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:16.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.996+0000 7fa9cf400640 1 --2- 172.21.15.99:0/545615235 >> v2:172.21.15.99:3300/0 conn(0x7fa9d018a010 0x7fa9d018b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:16.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.996+0000 7fa9cf400640 1 -- 172.21.15.99:0/545615235 >> v1:172.21.15.99:6789/0 conn(0x7fa9d0182a80 legacy=0x7fa9d0186a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:16.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.996+0000 7fa9cf400640 1 -- 172.21.15.99:0/545615235 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9d018abc0 con 0x7fa9d00719b0 2024-02-21T23:03:16.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.998+0000 7fa9cf400640 1 --2- 172.21.15.99:0/545615235 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9d00719b0 0x7fa9d0071e40 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa9d018c720 tx=0x7fa9c802bdc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2fb01a7566727aae server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:16.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.999+0000 7fa9cd600640 1 -- 172.21.15.99:0/545615235 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c802c960 con 0x7fa9d00719b0 2024-02-21T23:03:16.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.999+0000 7fa9cd600640 1 -- 172.21.15.99:0/545615235 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9c802cb00 con 0x7fa9d00719b0 2024-02-21T23:03:16.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.999+0000 7fa9cd600640 1 -- 172.21.15.99:0/545615235 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c80343f0 con 0x7fa9d00719b0 2024-02-21T23:03:16.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.999+0000 7fa9cfe00640 1 -- 172.21.15.99:0/545615235 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9d00719b0 msgr2=0x7fa9d0071e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:16.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:16.999+0000 7fa9cfe00640 1 --2- 172.21.15.99:0/545615235 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9d00719b0 0x7fa9d0071e40 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa9d018c720 tx=0x7fa9c802bdc0 comp rx=0 tx=0).stop 2024-02-21T23:03:16.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.000+0000 7fa9cfe00640 1 -- 172.21.15.99:0/545615235 shutdown_connections 2024-02-21T23:03:16.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.000+0000 7fa9cfe00640 1 --2- 172.21.15.99:0/545615235 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9d00719b0 0x7fa9d0071e40 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:16.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.000+0000 7fa9cfe00640 1 --2- 172.21.15.99:0/545615235 >> v2:172.21.15.99:3300/0 conn(0x7fa9d018a010 0x7fa9d018b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:16.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.000+0000 7fa9cfe00640 1 -- 172.21.15.99:0/545615235 >> 172.21.15.99:0/545615235 conn(0x7fa9d00d29f0 msgr2=0x7fa9d00d2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:03:16.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.000+0000 7fa9cfe00640 1 -- 172.21.15.99:0/545615235 shutdown_connections 2024-02-21T23:03:16.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.000+0000 7fa9cfe00640 1 -- 172.21.15.99:0/545615235 wait complete. 2024-02-21T23:03:16.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.003+0000 7fa9cfe00640 1 Processor -- start 2024-02-21T23:03:16.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.003+0000 7fa9cfe00640 1 -- start start 2024-02-21T23:03:16.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.005+0000 7fa9cfe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9d00719b0 0x7fa9d0215be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:16.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.005+0000 7fa9cfe00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9d0182a80 0x7fa9d015fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:16.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.005+0000 7fa9cfe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9d018a010 0x7fa9d021ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:16.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.005+0000 7fa9cfe00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d018b460 con 0x7fa9d018a010 2024-02-21T23:03:16.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.005+0000 7fa9cfe00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d018b180 con 0x7fa9d00719b0 2024-02-21T23:03:16.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.005+0000 7fa9cfe00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d0182e60 con 0x7fa9d0182a80 2024-02-21T23:03:16.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.006+0000 7fa9ce000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9d0182a80 0x7fa9d015fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:16.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.006+0000 7fa9cf400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9d018a010 0x7fa9d021ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:16.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.006+0000 7fa9ce000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9d0182a80 0x7fa9d015fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:46968/0 (socket says 172.21.15.99:46968) 2024-02-21T23:03:16.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.006+0000 7fa9ce000640 1 -- 172.21.15.99:0/1939310533 learned_addr learned my addr 172.21.15.99:0/1939310533 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:03:16.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.006+0000 7fa9cea00640 1 --2- 172.21.15.99:0/1939310533 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9d00719b0 0x7fa9d0215be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:16.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.007+0000 7fa9cea00640 1 -- 172.21.15.99:0/1939310533 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9d0182a80 msgr2=0x7fa9d015fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:16.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.007+0000 7fa9cea00640 1 --2- 172.21.15.99:0/1939310533 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9d0182a80 0x7fa9d015fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:16.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.007+0000 7fa9cea00640 1 -- 172.21.15.99:0/1939310533 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9d018a010 msgr2=0x7fa9d021ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:16.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.007+0000 7fa9cea00640 1 --2- 172.21.15.99:0/1939310533 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9d018a010 0x7fa9d021ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:16.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.007+0000 7fa9cea00640 1 -- 172.21.15.99:0/1939310533 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9d017db70 con 0x7fa9d00719b0 2024-02-21T23:03:16.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.007+0000 7fa9cf400640 1 --2- 172.21.15.99:0/1939310533 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9d018a010 0x7fa9d021ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:03:16.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.008+0000 7fa9cea00640 1 --2- 172.21.15.99:0/1939310533 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9d00719b0 0x7fa9d0215be0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa9c000b410 tx=0x7fa9c000b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:16.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.008+0000 7fa9c6a00640 1 -- 172.21.15.99:0/1939310533 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c0015020 con 0x7fa9d00719b0 2024-02-21T23:03:16.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.008+0000 7fa9c6a00640 1 -- 172.21.15.99:0/1939310533 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9c0011830 con 0x7fa9d00719b0 2024-02-21T23:03:16.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.008+0000 7fa9c6a00640 1 -- 172.21.15.99:0/1939310533 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c0011c60 con 0x7fa9d00719b0 2024-02-21T23:03:16.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.008+0000 7fa9cfe00640 1 -- 172.21.15.99:0/1939310533 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9d017de50 con 0x7fa9d00719b0 2024-02-21T23:03:16.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.009+0000 7fa9cfe00640 1 -- 172.21.15.99:0/1939310533 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9d017e410 con 0x7fa9d00719b0 2024-02-21T23:03:17.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.011+0000 7fa9cfe00640 1 -- 172.21.15.99:0/1939310533 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9d0068320 con 0x7fa9d00719b0 2024-02-21T23:03:17.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.014+0000 7fa9c6a00640 1 -- 172.21.15.99:0/1939310533 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 13) v1 ==== 134589+0+0 (secure 0 0 0) 0x7fa9c0018020 con 0x7fa9d00719b0 2024-02-21T23:03:17.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.016+0000 7fa9c6a00640 1 --2- 172.21.15.99:0/1939310533 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa9b009eff0 0x7fa9b00a14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:17.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.016+0000 7fa9c6a00640 1 -- 172.21.15.99:0/1939310533 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7fa9c00c9f60 con 0x7fa9d00719b0 2024-02-21T23:03:17.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.016+0000 7fa9ce000640 1 --2- 172.21.15.99:0/1939310533 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa9b009eff0 0x7fa9b00a14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:17.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.017+0000 7fa9ce000640 1 --2- 172.21.15.99:0/1939310533 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa9b009eff0 0x7fa9b00a14b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa9d0188b40 tx=0x7fa9bc0091c0 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:17.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.020+0000 7fa9c6a00640 1 -- 172.21.15.99:0/1939310533 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fa9c001f020 con 0x7fa9d00719b0 2024-02-21T23:03:17.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.461+0000 7fa9cfe00640 1 -- 172.21.15.99:0/1939310533 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa9d00fc320 con 0x7fa9d00719b0 2024-02-21T23:03:17.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.462+0000 7fa9c6a00640 1 -- 172.21.15.99:0/1939310533 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+11335 (secure 0 0 0) 0x7fa9c0097cb0 con 0x7fa9d00719b0 2024-02-21T23:03:17.455 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T23:03:17.455 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4307,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/3514452812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3514452812},{"type":"v1","addr":"172.21.15.162:6836","nonce":3514452812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4312,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6838/2169982089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":2169982089},{"type":"v1","addr":"172.21.15.162:6838","nonce":2169982089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4315,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6839/3335972724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6837","nonce":3335972724},{"type":"v1","addr":"172.21.15.162:6839","nonce":3335972724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4318,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6841/2135456697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6840","nonce":2135456697},{"type":"v1","addr":"172.21.15.162:6841","nonce":2135456697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4325,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2452242758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2452242758},{"type":"v1","addr":"172.21.15.181:6833","nonce":2452242758}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4328,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6836/2751486400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":2751486400},{"type":"v1","addr":"172.21.15.181:6836","nonce":2751486400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":15,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-21T23:01:02.656130+0000","modified":"2024-02-21T23:01:57.191106+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4355,"mds_1":4352,"mds_2":4348},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4331":{"gid":4331,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6838/3728901330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6835","nonce":3728901330},{"type":"v1","addr":"172.21.15.181:6838","nonce":3728901330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4339":{"gid":4339,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6839/3357929641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6837","nonce":3357929641},{"type":"v1","addr":"172.21.15.181:6839","nonce":3357929641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4343":{"gid":4343,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6833/2793485078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":2793485078},{"type":"v1","addr":"172.21.15.99:6833","nonce":2793485078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4348":{"gid":4348,"name":"d","rank":2,"incarnation":12,"state":"up:active","state_seq":10,"addr":"172.21.15.99:6835/2243461688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2243461688},{"type":"v1","addr":"172.21.15.99:6835","nonce":2243461688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4352":{"gid":4352,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.99:6837/1676159950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":1676159950},{"type":"v1","addr":"172.21.15.99:6837","nonce":1676159950}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4355":{"gid":4355,"name":"j","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6839/4239008786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":4239008786},{"type":"v1","addr":"172.21.15.99:6839","nonce":4239008786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-21T23:03:17.455 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 15 2024-02-21T23:03:17.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.466+0000 7fa9cfe00640 1 -- 172.21.15.99:0/1939310533 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa9b009eff0 msgr2=0x7fa9b00a14b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:17.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.466+0000 7fa9cfe00640 1 --2- 172.21.15.99:0/1939310533 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa9b009eff0 0x7fa9b00a14b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa9d0188b40 tx=0x7fa9bc0091c0 comp rx=0 tx=0).stop 2024-02-21T23:03:17.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.466+0000 7fa9cfe00640 1 -- 172.21.15.99:0/1939310533 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9d00719b0 msgr2=0x7fa9d0215be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:17.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.466+0000 7fa9cfe00640 1 --2- 172.21.15.99:0/1939310533 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9d00719b0 0x7fa9d0215be0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa9c000b410 tx=0x7fa9c000b8d0 comp rx=0 tx=0).stop 2024-02-21T23:03:17.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.467+0000 7fa9cfe00640 1 -- 172.21.15.99:0/1939310533 shutdown_connections 2024-02-21T23:03:17.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.467+0000 7fa9cfe00640 1 --2- 172.21.15.99:0/1939310533 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa9b009eff0 0x7fa9b00a14b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:17.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.467+0000 7fa9cfe00640 1 --2- 172.21.15.99:0/1939310533 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9d018a010 0x7fa9d021ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:17.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.467+0000 7fa9cfe00640 1 --2- 172.21.15.99:0/1939310533 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9d0182a80 0x7fa9d015fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:17.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.467+0000 7fa9cfe00640 1 --2- 172.21.15.99:0/1939310533 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9d00719b0 0x7fa9d0215be0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:17.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.467+0000 7fa9cfe00640 1 -- 172.21.15.99:0/1939310533 >> 172.21.15.99:0/1939310533 conn(0x7fa9d00d29f0 msgr2=0x7fa9d0186990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:03:17.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.467+0000 7fa9cfe00640 1 -- 172.21.15.99:0/1939310533 shutdown_connections 2024-02-21T23:03:17.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.468+0000 7fa9cfe00640 1 -- 172.21.15.99:0/1939310533 wait complete. 2024-02-21T23:03:17.484 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T23:03:17.484 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-02-21T23:03:17.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.766+0000 7f2d31600640 1 Processor -- start 2024-02-21T23:03:17.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.767+0000 7f2d31600640 1 -- start start 2024-02-21T23:03:17.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.769+0000 7f2d31600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f2d2c188e70 0x7f2d2c1857e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:17.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.769+0000 7f2d31600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2d2c071570 0x7f2d2c071a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:17.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.769+0000 7f2d31600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d2c06fcf0 con 0x7f2d2c184cf0 2024-02-21T23:03:17.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.769+0000 7f2d31600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d2c06f750 con 0x7f2d2c188e70 2024-02-21T23:03:17.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.769+0000 7f2d31600640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d2c06fa10 con 0x7f2d2c071570 2024-02-21T23:03:17.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.770+0000 7f2d2a000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f2d2c188e70 0x7f2d2c1857e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:17.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.770+0000 7f2d2aa00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f2d2c184cf0 0x7f2d2c1850d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.99:54628/0 (socket says 172.21.15.99:54628) 2024-02-21T23:03:17.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.770+0000 7f2d2aa00640 1 -- 172.21.15.99:0/2446472510 learned_addr learned my addr 172.21.15.99:0/2446472510 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:03:17.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.770+0000 7f2d2b400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2d2c071570 0x7f2d2c071a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:17.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.770+0000 7f2d2b400640 1 -- 172.21.15.99:0/2446472510 >> v2:172.21.15.99:3300/0 conn(0x7f2d2c188e70 msgr2=0x7f2d2c1857e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:17.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.771+0000 7f2d2b400640 1 --2- 172.21.15.99:0/2446472510 >> v2:172.21.15.99:3300/0 conn(0x7f2d2c188e70 0x7f2d2c1857e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:17.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.772+0000 7f2d2b400640 1 -- 172.21.15.99:0/2446472510 >> v1:172.21.15.162:6789/0 conn(0x7f2d2c184cf0 legacy=0x7f2d2c1850d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:17.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.772+0000 7f2d2b400640 1 -- 172.21.15.99:0/2446472510 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d2c0707b0 con 0x7f2d2c071570 2024-02-21T23:03:17.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.772+0000 7f2d29600640 1 -- 172.21.15.99:0/2446472510 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4232807845 0 0) 0x7f2d2c06fcf0 con 0x7f2d2c184cf0 2024-02-21T23:03:17.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.776+0000 7f2d2b400640 1 --2- 172.21.15.99:0/2446472510 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d2c071570 0x7f2d2c071a00 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c184c80 tx=0x7f2d1c02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb6759a56ec35df1 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:17.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.776+0000 7f2d29600640 1 -- 172.21.15.99:0/2446472510 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1c035020 con 0x7f2d2c071570 2024-02-21T23:03:17.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.776+0000 7f2d29600640 1 -- 172.21.15.99:0/2446472510 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d1c031830 con 0x7f2d2c071570 2024-02-21T23:03:17.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.776+0000 7f2d29600640 1 -- 172.21.15.99:0/2446472510 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1c031c00 con 0x7f2d2c071570 2024-02-21T23:03:17.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.777+0000 7f2d31600640 1 -- 172.21.15.99:0/2446472510 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d2c071570 msgr2=0x7f2d2c071a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:17.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.777+0000 7f2d31600640 1 --2- 172.21.15.99:0/2446472510 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d2c071570 0x7f2d2c071a00 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c184c80 tx=0x7f2d1c02b8d0 comp rx=0 tx=0).stop 2024-02-21T23:03:17.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.778+0000 7f2d31600640 1 -- 172.21.15.99:0/2446472510 shutdown_connections 2024-02-21T23:03:17.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.778+0000 7f2d31600640 1 --2- 172.21.15.99:0/2446472510 >> v2:172.21.15.99:3300/0 conn(0x7f2d2c188e70 0x7f2d2c1857e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:17.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.778+0000 7f2d31600640 1 --2- 172.21.15.99:0/2446472510 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d2c071570 0x7f2d2c071a00 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:17.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.778+0000 7f2d31600640 1 -- 172.21.15.99:0/2446472510 >> 172.21.15.99:0/2446472510 conn(0x7f2d2c0ce490 msgr2=0x7f2d2c0ce8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:03:17.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.779+0000 7f2d31600640 1 -- 172.21.15.99:0/2446472510 shutdown_connections 2024-02-21T23:03:17.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.779+0000 7f2d31600640 1 -- 172.21.15.99:0/2446472510 wait complete. 2024-02-21T23:03:17.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.782+0000 7f2d31600640 1 Processor -- start 2024-02-21T23:03:17.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.782+0000 7f2d31600640 1 -- start start 2024-02-21T23:03:17.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.784+0000 7f2d31600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2d2c071570 0x7f2d2c187770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:17.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.784+0000 7f2d31600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2d2c184cf0 0x7f2d2c21e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:17.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.784+0000 7f2d31600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d2c188e70 0x7f2d2c21e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:17.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.785+0000 7f2d2aa00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2d2c071570 0x7f2d2c187770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:17.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.785+0000 7f2d31600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2c071050 con 0x7f2d2c071570 2024-02-21T23:03:17.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.785+0000 7f2d31600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2c070d70 con 0x7f2d2c188e70 2024-02-21T23:03:17.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.785+0000 7f2d31600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2c17b9b0 con 0x7f2d2c184cf0 2024-02-21T23:03:17.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.785+0000 7f2d2a000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2d2c184cf0 0x7f2d2c21e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:17.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.785+0000 7f2d2b400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d2c188e70 0x7f2d2c21e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:17.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.785+0000 7f2d2b400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d2c188e70 0x7f2d2c21e950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:41640/0 (socket says 172.21.15.99:41640) 2024-02-21T23:03:17.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.785+0000 7f2d2b400640 1 -- 172.21.15.99:0/1773310002 learned_addr learned my addr 172.21.15.99:0/1773310002 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:03:17.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.785+0000 7f2d2b400640 1 -- 172.21.15.99:0/1773310002 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2d2c184cf0 msgr2=0x7f2d2c21e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:17.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.785+0000 7f2d2b400640 1 --2- 172.21.15.99:0/1773310002 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2d2c184cf0 0x7f2d2c21e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:17.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.785+0000 7f2d2b400640 1 -- 172.21.15.99:0/1773310002 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2d2c071570 msgr2=0x7f2d2c187770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:17.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.785+0000 7f2d2b400640 1 --2- 172.21.15.99:0/1773310002 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2d2c071570 0x7f2d2c187770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:17.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.785+0000 7f2d2b400640 1 -- 172.21.15.99:0/1773310002 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d2c06af90 con 0x7f2d2c188e70 2024-02-21T23:03:17.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.786+0000 7f2d2aa00640 1 --2- 172.21.15.99:0/1773310002 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2d2c071570 0x7f2d2c187770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:03:17.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.786+0000 7f2d2b400640 1 --2- 172.21.15.99:0/1773310002 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d2c188e70 0x7f2d2c21e950 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c009890 tx=0x7f2d1c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:17.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.786+0000 7f2d22a00640 1 -- 172.21.15.99:0/1773310002 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1c040070 con 0x7f2d2c188e70 2024-02-21T23:03:17.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.786+0000 7f2d22a00640 1 -- 172.21.15.99:0/1773310002 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d1c0398c0 con 0x7f2d2c188e70 2024-02-21T23:03:17.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.786+0000 7f2d22a00640 1 -- 172.21.15.99:0/1773310002 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1c035040 con 0x7f2d2c188e70 2024-02-21T23:03:17.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.786+0000 7f2d31600640 1 -- 172.21.15.99:0/1773310002 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d2c219b20 con 0x7f2d2c188e70 2024-02-21T23:03:17.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.786+0000 7f2d31600640 1 -- 172.21.15.99:0/1773310002 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d2c21a0e0 con 0x7f2d2c188e70 2024-02-21T23:03:17.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.793+0000 7f2d22a00640 1 -- 172.21.15.99:0/1773310002 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 13) v1 ==== 134589+0+0 (secure 0 0 0) 0x7f2d1c038020 con 0x7f2d2c188e70 2024-02-21T23:03:17.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.796+0000 7f2d22a00640 1 --2- 172.21.15.99:0/1773310002 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f2d0c09f0f0 0x7f2d0c0a15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:17.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.796+0000 7f2d22a00640 1 -- 172.21.15.99:0/1773310002 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f2d1c0eb9d0 con 0x7f2d2c188e70 2024-02-21T23:03:17.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.797+0000 7f2d2aa00640 1 --2- 172.21.15.99:0/1773310002 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f2d0c09f0f0 0x7f2d0c0a15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:17.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.805+0000 7f2d2aa00640 1 --2- 172.21.15.99:0/1773310002 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f2d0c09f0f0 0x7f2d0c0a15b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2d240012e0 tx=0x7f2d24005c30 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:17.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.807+0000 7f2d34575740 1 Processor -- start 2024-02-21T23:03:17.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.808+0000 7f2d34575740 1 -- start start 2024-02-21T23:03:17.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.810+0000 7f2d34575740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b420cd3680 0x55b420cd3a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:17.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.810+0000 7f2d34575740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b420d0e350 0x55b420d0e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:17.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.811+0000 7f2d2a000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b420d0e350 0x55b420d0e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:17.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.811+0000 7f2d2a000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b420d0e350 0x55b420d0e7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54024/0 (socket says 172.21.15.99:54024) 2024-02-21T23:03:17.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.811+0000 7f2d2aa00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b420cd3680 0x55b420cd3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:17.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.811+0000 7f2d2aa00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b420cd3680 0x55b420cd3a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:46986/0 (socket says 172.21.15.99:46986) 2024-02-21T23:03:17.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.811+0000 7f2d34575740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b420d0ed10 0x55b420d0f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:17.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.811+0000 7f2d34575740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b420bfbb50 con 0x55b420d0e350 2024-02-21T23:03:17.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.811+0000 7f2d34575740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b420ba4da0 con 0x55b420d0ed10 2024-02-21T23:03:17.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.811+0000 7f2d34575740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b420bf7bf0 con 0x55b420cd3680 2024-02-21T23:03:17.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.811+0000 7f2d2a000640 1 -- 172.21.15.99:0/4042518882 learned_addr learned my addr 172.21.15.99:0/4042518882 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:03:17.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.812+0000 7f2d2aa00640 1 -- 172.21.15.99:0/4042518882 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b420d0ed10 msgr2=0x55b420d0f580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T23:03:17.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.812+0000 7f2d2aa00640 1 --2- 172.21.15.99:0/4042518882 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b420d0ed10 0x55b420d0f580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:17.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.812+0000 7f2d2aa00640 1 -- 172.21.15.99:0/4042518882 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b420d0e350 msgr2=0x55b420d0e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:17.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.812+0000 7f2d2aa00640 1 --2- 172.21.15.99:0/4042518882 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b420d0e350 0x55b420d0e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:17.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.812+0000 7f2d2aa00640 1 -- 172.21.15.99:0/4042518882 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b420bc7f80 con 0x55b420cd3680 2024-02-21T23:03:17.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.812+0000 7f2d2a000640 1 --2- 172.21.15.99:0/4042518882 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b420d0e350 0x55b420d0e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:03:17.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.812+0000 7f2d2aa00640 1 --2- 172.21.15.99:0/4042518882 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b420cd3680 0x55b420cd3a60 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f2d24001c60 tx=0x7f2d24012000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e12edf1693b8b91f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:17.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.813+0000 7f2d17000640 1 -- 172.21.15.99:0/4042518882 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d240159c0 con 0x55b420cd3680 2024-02-21T23:03:17.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.813+0000 7f2d17000640 1 -- 172.21.15.99:0/4042518882 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d24015b60 con 0x55b420cd3680 2024-02-21T23:03:17.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.813+0000 7f2d17000640 1 -- 172.21.15.99:0/4042518882 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d24021450 con 0x55b420cd3680 2024-02-21T23:03:17.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.813+0000 7f2d34575740 1 -- 172.21.15.99:0/4042518882 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b420cd3680 msgr2=0x55b420cd3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:17.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.813+0000 7f2d34575740 1 --2- 172.21.15.99:0/4042518882 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b420cd3680 0x55b420cd3a60 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f2d24001c60 tx=0x7f2d24012000 comp rx=0 tx=0).stop 2024-02-21T23:03:17.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.818+0000 7f2d34575740 1 -- 172.21.15.99:0/4042518882 shutdown_connections 2024-02-21T23:03:17.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.818+0000 7f2d34575740 1 --2- 172.21.15.99:0/4042518882 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b420d0ed10 0x55b420d0f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:17.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.819+0000 7f2d34575740 1 --2- 172.21.15.99:0/4042518882 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b420d0e350 0x55b420d0e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:17.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.819+0000 7f2d34575740 1 --2- 172.21.15.99:0/4042518882 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b420cd3680 0x55b420cd3a60 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:17.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.819+0000 7f2d34575740 1 -- 172.21.15.99:0/4042518882 >> 172.21.15.99:0/4042518882 conn(0x55b420c956f0 msgr2=0x55b420c96770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:03:17.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.819+0000 7f2d34575740 1 -- 172.21.15.99:0/4042518882 shutdown_connections 2024-02-21T23:03:17.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.819+0000 7f2d34575740 1 -- 172.21.15.99:0/4042518882 wait complete. 2024-02-21T23:03:17.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.820+0000 7f2d34575740 1 -- start start 2024-02-21T23:03:17.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.820+0000 7f2d34575740 1 Processor -- start 2024-02-21T23:03:17.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.823+0000 7f2d34575740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b420d0e350 0x55b420cd99c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:17.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.823+0000 7f2d34575740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b420d0ed10 0x55b420cdd450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:17.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.823+0000 7f2d34575740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b420cda1b0 0x55b420cc5380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:17.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.823+0000 7f2d2aa00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b420d0e350 0x55b420cd99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:17.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.823+0000 7f2d2aa00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b420d0e350 0x55b420cd99c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:46988/0 (socket says 172.21.15.99:46988) 2024-02-21T23:03:17.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.823+0000 7f2d2a000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b420d0ed10 0x55b420cdd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:17.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.823+0000 7f2d2a000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b420d0ed10 0x55b420cdd450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:41642/0 (socket says 172.21.15.99:41642) 2024-02-21T23:03:17.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.824+0000 7f2d2aa00640 1 -- 172.21.15.99:0/51278165 learned_addr learned my addr 172.21.15.99:0/51278165 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:03:17.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.824+0000 7f2d2b400640 1 --2- 172.21.15.99:0/51278165 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b420cda1b0 0x55b420cc5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:17.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.824+0000 7f2d34575740 1 -- 172.21.15.99:0/51278165 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b420d0d0c0 con 0x55b420cda1b0 2024-02-21T23:03:17.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.824+0000 7f2d34575740 1 -- 172.21.15.99:0/51278165 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b420b9a380 con 0x55b420d0ed10 2024-02-21T23:03:17.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.824+0000 7f2d34575740 1 -- 172.21.15.99:0/51278165 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b420d0cde0 con 0x55b420d0e350 2024-02-21T23:03:17.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.825+0000 7f2d2b400640 1 -- 172.21.15.99:0/51278165 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b420d0e350 msgr2=0x55b420cd99c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:17.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.825+0000 7f2d2b400640 1 --2- 172.21.15.99:0/51278165 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b420d0e350 0x55b420cd99c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:17.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.825+0000 7f2d2b400640 1 -- 172.21.15.99:0/51278165 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b420d0ed10 msgr2=0x55b420cdd450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:17.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.825+0000 7f2d2b400640 1 --2- 172.21.15.99:0/51278165 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b420d0ed10 0x55b420cdd450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:17.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.825+0000 7f2d2b400640 1 -- 172.21.15.99:0/51278165 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b420bc2c20 con 0x55b420cda1b0 2024-02-21T23:03:17.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.825+0000 7f2d2b400640 1 --2- 172.21.15.99:0/51278165 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b420cda1b0 0x55b420cc5380 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c0e8f50 tx=0x7f2d1c0b8ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a58ed0f4f0387cd5 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:17.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.826+0000 7f2d0b400640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:03:17.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.827+0000 7f2d0b400640 1 -- 172.21.15.99:0/51278165 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1c0c1800 con 0x55b420cda1b0 2024-02-21T23:03:17.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.827+0000 7f2d0b400640 1 -- 172.21.15.99:0/51278165 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f2d1c0e9150 con 0x55b420cda1b0 2024-02-21T23:03:17.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.827+0000 7f2d0b400640 10 client.0 inactive, discarding osd_map(32..32 src has 1..32) v4 2024-02-21T23:03:17.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.826+0000 7f2d2aa00640 1 --2- 172.21.15.99:0/51278165 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b420d0e350 0x55b420cd99c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T23:03:17.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.827+0000 7f2d34575740 10 client.0 _ll_register_callbacks cb 0x55b420bf3280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:03:17.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.827+0000 7f2d34575740 1 -- 172.21.15.99:0/51278165 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2d24015b60 con 0x55b420cda1b0 2024-02-21T23:03:17.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.827+0000 7f2d0b400640 1 -- 172.21.15.99:0/51278165 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2d1c0e9350 con 0x55b420cda1b0 2024-02-21T23:03:17.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.827+0000 7f2d34575740 10 client.5340 fetch_fsmap learned FSMap version 15 2024-02-21T23:03:17.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.828+0000 7f2d34575740 1 -- 172.21.15.99:0/51278165 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({fsmap=15}) v3 -- 0x55b4209103f0 con 0x55b420cda1b0 2024-02-21T23:03:17.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.828+0000 7f2d0b400640 1 -- 172.21.15.99:0/51278165 <== mon.0 v2:172.21.15.99:3300/0 4 ==== fsmap(e 15) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f2d1c0b84b0 con 0x55b420cda1b0 2024-02-21T23:03:17.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.828+0000 7f2d34575740 10 client.5340 fetch_fsmap finished waiting for FSMap version 15 2024-02-21T23:03:17.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.828+0000 7f2d34575740 10 client.5340 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.d 2024-02-21T23:03:17.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.828+0000 7f2d34575740 20 client.5340 populate_metadata read hostname 'smithi099' 2024-02-21T23:03:17.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.828+0000 7f2d34575740 1 --2- 172.21.15.99:0/51278165 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x55b420cda630 0x55b420cdaf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:17.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.828+0000 7f2d34575740 4 client.5340 mds_command: new command op to 4348 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:03:17.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.828+0000 7f2d34575740 1 -- 172.21.15.99:0/51278165 --> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b420c09090 con 0x55b420cda630 2024-02-21T23:03:17.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.829+0000 7f2d2aa00640 1 --2- 172.21.15.99:0/51278165 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x55b420cda630 0x55b420cdaf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:17.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.830+0000 7f2d0b400640 10 client.5340 ms_handle_connect on v2:172.21.15.99:6834/2243461688 2024-02-21T23:03:17.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.830+0000 7f2d2aa00640 1 --2- 172.21.15.99:0/51278165 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x55b420cda630 0x55b420cdaf20 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b79ead8146aa3579 server_cookie=bb44b5b24ad9aa61 in_seq=0 out_seq=0 2024-02-21T23:03:17.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.831+0000 7f2d0b400640 1 -- 172.21.15.99:0/51278165 <== mds.2 v2:172.21.15.99:6834/2243461688 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55b420c09090 con 0x55b420cda630 2024-02-21T23:03:17.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.831+0000 7f2d0b400640 10 client.5340 handle_command_reply: tid=0 2024-02-21T23:03:17.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.831+0000 7f2d34575740 1 client.5340 shutdown 2024-02-21T23:03:17.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.832+0000 7f2d34575740 1 -- 172.21.15.99:0/51278165 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b420cda1b0 msgr2=0x55b420cc5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:17.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.832+0000 7f2d34575740 1 --2- 172.21.15.99:0/51278165 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b420cda1b0 0x55b420cc5380 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c0e8f50 tx=0x7f2d1c0b8ab0 comp rx=0 tx=0).stop 2024-02-21T23:03:17.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.832+0000 7f2d34575740 1 -- 172.21.15.99:0/51278165 shutdown_connections 2024-02-21T23:03:17.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.832+0000 7f2d34575740 1 --2- 172.21.15.99:0/51278165 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x55b420cda630 0x55b420cdaf20 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:17.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.832+0000 7f2d34575740 1 --2- 172.21.15.99:0/51278165 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b420cda1b0 0x55b420cc5380 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:17.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.832+0000 7f2d34575740 1 --2- 172.21.15.99:0/51278165 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b420d0ed10 0x55b420cdd450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:17.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.832+0000 7f2d34575740 1 --2- 172.21.15.99:0/51278165 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b420d0e350 0x55b420cd99c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:17.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.832+0000 7f2d34575740 1 -- 172.21.15.99:0/51278165 >> 172.21.15.99:0/51278165 conn(0x55b420cd3680 msgr2=0x55b420d0d7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:03:17.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.832+0000 7f2d0b400640 0 client.5340 ms_handle_reset on v2:172.21.15.99:6834/2243461688 2024-02-21T23:03:17.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.833+0000 7f2d34575740 1 -- 172.21.15.99:0/51278165 shutdown_connections 2024-02-21T23:03:17.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.833+0000 7f2d34575740 1 -- 172.21.15.99:0/51278165 wait complete. 2024-02-21T23:03:17.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.833+0000 7f2d34575740 20 client.5340 trim_cache size 0 max 16384 2024-02-21T23:03:17.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.859+0000 7f2d34575740 1 Processor -- start 2024-02-21T23:03:17.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.859+0000 7f2d34575740 1 -- start start 2024-02-21T23:03:17.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.861+0000 7f2d34575740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b420cda1b0 0x55b420c96730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:17.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.861+0000 7f2d34575740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b420d0e350 0x55b420c919f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:17.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.861+0000 7f2d34575740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b420d0ed10 0x55b420d1eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:17.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.861+0000 7f2d34575740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2c228270 con 0x55b420d0ed10 2024-02-21T23:03:17.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.861+0000 7f2d34575740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2c225e10 con 0x55b420cda1b0 2024-02-21T23:03:17.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.861+0000 7f2d34575740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2c21b660 con 0x55b420d0e350 2024-02-21T23:03:17.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.862+0000 7f2d2b400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b420d0ed10 0x55b420d1eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:17.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.862+0000 7f2d2b400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b420d0ed10 0x55b420d1eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54034/0 (socket says 172.21.15.99:54034) 2024-02-21T23:03:17.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.862+0000 7f2d2b400640 1 -- 172.21.15.99:0/3405795629 learned_addr learned my addr 172.21.15.99:0/3405795629 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:03:17.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.862+0000 7f2d2aa00640 1 --2- 172.21.15.99:0/3405795629 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b420cda1b0 0x55b420c96730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:17.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.862+0000 7f2d2a000640 1 --2- 172.21.15.99:0/3405795629 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b420d0e350 0x55b420c919f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:17.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.862+0000 7f2d2b400640 1 -- 172.21.15.99:0/3405795629 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b420d0e350 msgr2=0x55b420c919f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:17.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.862+0000 7f2d2b400640 1 --2- 172.21.15.99:0/3405795629 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b420d0e350 0x55b420c919f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:17.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.862+0000 7f2d2b400640 1 -- 172.21.15.99:0/3405795629 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b420cda1b0 msgr2=0x55b420c96730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:17.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.862+0000 7f2d2b400640 1 --2- 172.21.15.99:0/3405795629 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b420cda1b0 0x55b420c96730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:17.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.862+0000 7f2d2b400640 1 -- 172.21.15.99:0/3405795629 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b4209da7d0 con 0x55b420d0ed10 2024-02-21T23:03:17.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.863+0000 7f2d2b400640 1 --2- 172.21.15.99:0/3405795629 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b420d0ed10 0x55b420d1eca0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c02bfc0 tx=0x7f2d1c0eb000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb9d67e4c7ad04d5 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:17.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.863+0000 7f2d16600640 1 -- 172.21.15.99:0/3405795629 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1c0e7070 con 0x55b420d0ed10 2024-02-21T23:03:17.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.863+0000 7f2d16600640 1 -- 172.21.15.99:0/3405795629 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d24015b60 con 0x55b420d0ed10 2024-02-21T23:03:17.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.863+0000 7f2d16600640 1 -- 172.21.15.99:0/3405795629 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1c0b8ba0 con 0x55b420d0ed10 2024-02-21T23:03:17.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.864+0000 7f2d34575740 1 -- 172.21.15.99:0/3405795629 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b420d0ed10 msgr2=0x55b420d1eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:17.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.864+0000 7f2d34575740 1 --2- 172.21.15.99:0/3405795629 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b420d0ed10 0x55b420d1eca0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c02bfc0 tx=0x7f2d1c0eb000 comp rx=0 tx=0).stop 2024-02-21T23:03:17.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.865+0000 7f2d34575740 1 -- 172.21.15.99:0/3405795629 shutdown_connections 2024-02-21T23:03:17.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.865+0000 7f2d34575740 1 --2- 172.21.15.99:0/3405795629 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b420d0ed10 0x55b420d1eca0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:17.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.865+0000 7f2d34575740 1 --2- 172.21.15.99:0/3405795629 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b420d0e350 0x55b420c919f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:17.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.865+0000 7f2d34575740 1 --2- 172.21.15.99:0/3405795629 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b420cda1b0 0x55b420c96730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:17.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.865+0000 7f2d34575740 1 -- 172.21.15.99:0/3405795629 >> 172.21.15.99:0/3405795629 conn(0x55b420cd3680 msgr2=0x55b420cc5190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:03:17.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.865+0000 7f2d34575740 1 -- 172.21.15.99:0/3405795629 shutdown_connections 2024-02-21T23:03:17.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.865+0000 7f2d34575740 1 -- 172.21.15.99:0/3405795629 wait complete. 2024-02-21T23:03:17.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.866+0000 7f2d34575740 1 -- start start 2024-02-21T23:03:17.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.867+0000 7f2d34575740 1 Processor -- start 2024-02-21T23:03:17.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.869+0000 7f2d34575740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b420cda1b0 0x55b420c92c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:17.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.870+0000 7f2d34575740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b420d0ed10 0x55b420d79820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:17.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.870+0000 7f2d34575740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b420d03980 0x55b420d79d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:17.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.870+0000 7f2d34575740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2c2245b0 con 0x55b420cda1b0 2024-02-21T23:03:17.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.870+0000 7f2d2a000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b420d0ed10 0x55b420d79820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:17.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.870+0000 7f2d2a000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b420d0ed10 0x55b420d79820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:41662/0 (socket says 172.21.15.99:41662) 2024-02-21T23:03:17.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.870+0000 7f2d2a000640 1 -- 172.21.15.99:0/2822147601 learned_addr learned my addr 172.21.15.99:0/2822147601 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:03:17.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.870+0000 7f2d2b400640 1 --2- 172.21.15.99:0/2822147601 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b420d03980 0x55b420d79d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:17.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.871+0000 7f2d2aa00640 1 --2- 172.21.15.99:0/2822147601 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b420cda1b0 0x55b420c92c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:17.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.871+0000 7f2d34575740 1 -- 172.21.15.99:0/2822147601 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2c2257b0 con 0x55b420d0ed10 2024-02-21T23:03:17.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.871+0000 7f2d34575740 1 -- 172.21.15.99:0/2822147601 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2c224bb0 con 0x55b420d03980 2024-02-21T23:03:17.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.871+0000 7f2d34575740 10 client.0 _ll_register_callbacks cb 0x7f2d1c009440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:03:17.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.872+0000 7f2d2aa00640 1 -- 172.21.15.99:0/2822147601 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b420d03980 msgr2=0x55b420d79d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:17.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.872+0000 7f2d2aa00640 1 --2- 172.21.15.99:0/2822147601 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b420d03980 0x55b420d79d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:17.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.872+0000 7f2d2aa00640 1 -- 172.21.15.99:0/2822147601 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b420d0ed10 msgr2=0x55b420d79820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:17.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.872+0000 7f2d2aa00640 1 --2- 172.21.15.99:0/2822147601 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b420d0ed10 0x55b420d79820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:17.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.872+0000 7f2d2aa00640 1 -- 172.21.15.99:0/2822147601 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b420c93170 con 0x55b420cda1b0 2024-02-21T23:03:17.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.875+0000 7f2d2aa00640 1 --2- 172.21.15.99:0/2822147601 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b420cda1b0 0x55b420c92c30 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c0b7310 tx=0x7f2d24011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=193350548af0d16d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:17.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.877+0000 7f2d0b400640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:03:17.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.877+0000 7f2d0b400640 1 -- 172.21.15.99:0/2822147601 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d24010040 con 0x55b420cda1b0 2024-02-21T23:03:17.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.877+0000 7f2d0b400640 1 -- 172.21.15.99:0/2822147601 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f2d2402dab0 con 0x55b420cda1b0 2024-02-21T23:03:17.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.877+0000 7f2d34575740 1 -- 172.21.15.99:0/2822147601 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2d24015b60 con 0x55b420cda1b0 2024-02-21T23:03:17.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.877+0000 7f2d0b400640 1 -- 172.21.15.99:0/2822147601 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2d24039050 con 0x55b420cda1b0 2024-02-21T23:03:17.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.877+0000 7f2d34575740 10 client.5346 fetch_fsmap learned FSMap version 15 2024-02-21T23:03:17.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.877+0000 7f2d34575740 1 -- 172.21.15.99:0/2822147601 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x55b420cdaed0 con 0x55b420cda1b0 2024-02-21T23:03:17.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.878+0000 7f2d0b400640 1 -- 172.21.15.99:0/2822147601 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d24015b60 con 0x55b420cda1b0 2024-02-21T23:03:17.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.878+0000 7f2d0b400640 1 -- 172.21.15.99:0/2822147601 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 15) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f2d2402dcd0 con 0x55b420cda1b0 2024-02-21T23:03:17.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.878+0000 7f2d34575740 10 client.5346 fetch_fsmap finished waiting for FSMap version 15 2024-02-21T23:03:17.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.878+0000 7f2d34575740 10 client.5346 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.d 2024-02-21T23:03:17.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.878+0000 7f2d34575740 20 client.5346 populate_metadata read hostname 'smithi099' 2024-02-21T23:03:17.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.878+0000 7f2d34575740 1 --2- 172.21.15.99:0/2822147601 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x55b420cce2c0 0x55b420d7a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:17.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.878+0000 7f2d34575740 4 client.5346 mds_command: new command op to 4348 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T23:03:17.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.879+0000 7f2d34575740 1 -- 172.21.15.99:0/2822147601 --> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55b420c033e0 con 0x55b420cce2c0 2024-02-21T23:03:17.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.879+0000 7f2d2a000640 1 --2- 172.21.15.99:0/2822147601 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x55b420cce2c0 0x55b420d7a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:17.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.880+0000 7f2d2a000640 1 --2- 172.21.15.99:0/2822147601 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x55b420cce2c0 0x55b420d7a2a0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=87ce387cc8866055 server_cookie=a4a67198c442614 in_seq=0 out_seq=0 2024-02-21T23:03:17.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.880+0000 7f2d0b400640 10 client.5346 ms_handle_connect on v2:172.21.15.99:6834/2243461688 2024-02-21T23:03:17.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.880+0000 7f2d0b400640 1 -- 172.21.15.99:0/2822147601 <== mds.2 v2:172.21.15.99:6834/2243461688 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55b420c033e0 con 0x55b420cce2c0 2024-02-21T23:03:17.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.880+0000 7f2d0b400640 10 client.5346 handle_command_reply: tid=0 2024-02-21T23:03:17.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.880+0000 7f2d34575740 1 client.5346 shutdown 2024-02-21T23:03:17.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.882+0000 7f2d34575740 1 -- 172.21.15.99:0/2822147601 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b420cda1b0 msgr2=0x55b420c92c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:17.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.882+0000 7f2d34575740 1 --2- 172.21.15.99:0/2822147601 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b420cda1b0 0x55b420c92c30 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c0b7310 tx=0x7f2d24011000 comp rx=0 tx=0).stop 2024-02-21T23:03:17.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.882+0000 7f2d34575740 1 -- 172.21.15.99:0/2822147601 shutdown_connections 2024-02-21T23:03:17.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.882+0000 7f2d34575740 1 --2- 172.21.15.99:0/2822147601 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x55b420cce2c0 0x55b420d7a2a0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:17.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.882+0000 7f2d34575740 1 --2- 172.21.15.99:0/2822147601 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b420d03980 0x55b420d79d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:17.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.882+0000 7f2d34575740 1 --2- 172.21.15.99:0/2822147601 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b420d0ed10 0x55b420d79820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:17.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.882+0000 7f2d0b400640 0 client.5346 ms_handle_reset on v2:172.21.15.99:6834/2243461688 2024-02-21T23:03:17.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.882+0000 7f2d34575740 1 --2- 172.21.15.99:0/2822147601 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b420cda1b0 0x55b420c92c30 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:17.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.882+0000 7f2d34575740 1 -- 172.21.15.99:0/2822147601 >> 172.21.15.99:0/2822147601 conn(0x55b420cd3680 msgr2=0x55b420c9ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:03:17.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.883+0000 7f2d34575740 1 -- 172.21.15.99:0/2822147601 shutdown_connections 2024-02-21T23:03:17.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.883+0000 7f2d34575740 1 -- 172.21.15.99:0/2822147601 wait complete. 2024-02-21T23:03:17.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.884+0000 7f2d34575740 20 client.5346 trim_cache size 0 max 16384 2024-02-21T23:03:17.874 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-02-21T23:03:17.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.885+0000 7f2d31600640 1 -- 172.21.15.99:0/1773310002 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f2d0c09f0f0 msgr2=0x7f2d0c0a15b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:17.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.885+0000 7f2d31600640 1 --2- 172.21.15.99:0/1773310002 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f2d0c09f0f0 0x7f2d0c0a15b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2d240012e0 tx=0x7f2d24005c30 comp rx=0 tx=0).stop 2024-02-21T23:03:17.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.885+0000 7f2d31600640 1 -- 172.21.15.99:0/1773310002 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d2c188e70 msgr2=0x7f2d2c21e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:17.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.885+0000 7f2d31600640 1 --2- 172.21.15.99:0/1773310002 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d2c188e70 0x7f2d2c21e950 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c009890 tx=0x7f2d1c0046c0 comp rx=0 tx=0).stop 2024-02-21T23:03:17.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.885+0000 7f2d31600640 1 -- 172.21.15.99:0/1773310002 shutdown_connections 2024-02-21T23:03:17.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.885+0000 7f2d31600640 1 --2- 172.21.15.99:0/1773310002 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f2d0c09f0f0 0x7f2d0c0a15b0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:17.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.885+0000 7f2d31600640 1 --2- 172.21.15.99:0/1773310002 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d2c188e70 0x7f2d2c21e950 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:17.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.885+0000 7f2d31600640 1 --2- 172.21.15.99:0/1773310002 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2d2c184cf0 0x7f2d2c21e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:17.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.885+0000 7f2d31600640 1 --2- 172.21.15.99:0/1773310002 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2d2c071570 0x7f2d2c187770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:17.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.885+0000 7f2d31600640 1 -- 172.21.15.99:0/1773310002 >> 172.21.15.99:0/1773310002 conn(0x7f2d2c0ce490 msgr2=0x7f2d2c188410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:03:17.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.890+0000 7f2d31600640 1 -- 172.21.15.99:0/1773310002 shutdown_connections 2024-02-21T23:03:17.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:17.892+0000 7f2d31600640 1 -- 172.21.15.99:0/1773310002 wait complete. 2024-02-21T23:03:17.907 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T23:03:17.908 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-02-21T23:03:18.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.222+0000 7f32c6600640 1 Processor -- start 2024-02-21T23:03:18.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.222+0000 7f32c6600640 1 -- start start 2024-02-21T23:03:18.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.225+0000 7f32c6600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f32c017f490 0x7f32c018ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:18.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.225+0000 7f32c6600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32c00d6dd0 con 0x7f32c018b060 2024-02-21T23:03:18.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.225+0000 7f32c6600640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32c01614c0 con 0x7f32c018b4f0 2024-02-21T23:03:18.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.225+0000 7f32c6600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32c00d6810 con 0x7f32c017f490 2024-02-21T23:03:18.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.226+0000 7f32c5200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f32c017f490 0x7f32c018ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:18.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.226+0000 7f32bfe00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f32c018b060 0x7f32c0188a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.99:54632/0 (socket says 172.21.15.99:54632) 2024-02-21T23:03:18.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.226+0000 7f32bfe00640 1 -- 172.21.15.99:0/2121499448 learned_addr learned my addr 172.21.15.99:0/2121499448 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:03:18.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.227+0000 7f32c5200640 1 -- 172.21.15.99:0/2121499448 >> v1:172.21.15.181:6789/0 conn(0x7f32c018b4f0 legacy=0x7f32c0189150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:18.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.227+0000 7f32c5200640 1 -- 172.21.15.99:0/2121499448 >> v1:172.21.15.162:6789/0 conn(0x7f32c018b060 legacy=0x7f32c0188a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:18.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.227+0000 7f32c5200640 1 -- 172.21.15.99:0/2121499448 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32c00d6af0 con 0x7f32c017f490 2024-02-21T23:03:18.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.229+0000 7f32c5200640 1 --2- 172.21.15.99:0/2121499448 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32c017f490 0x7f32c018ab20 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f32ac0097a0 tx=0x7f32ac02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=397e4f94c13cfe58 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:18.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.229+0000 7f32bf400640 1 -- 172.21.15.99:0/2121499448 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32ac035020 con 0x7f32c017f490 2024-02-21T23:03:18.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.229+0000 7f32bf400640 1 -- 172.21.15.99:0/2121499448 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32ac031640 con 0x7f32c017f490 2024-02-21T23:03:18.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.230+0000 7f32bf400640 1 -- 172.21.15.99:0/2121499448 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32ac02d040 con 0x7f32c017f490 2024-02-21T23:03:18.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.230+0000 7f32c6600640 1 -- 172.21.15.99:0/2121499448 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32c017f490 msgr2=0x7f32c018ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:18.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.230+0000 7f32c6600640 1 --2- 172.21.15.99:0/2121499448 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32c017f490 0x7f32c018ab20 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f32ac0097a0 tx=0x7f32ac02b8f0 comp rx=0 tx=0).stop 2024-02-21T23:03:18.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.231+0000 7f32c6600640 1 -- 172.21.15.99:0/2121499448 shutdown_connections 2024-02-21T23:03:18.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.231+0000 7f32c6600640 1 --2- 172.21.15.99:0/2121499448 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32c017f490 0x7f32c018ab20 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:18.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.231+0000 7f32c6600640 1 -- 172.21.15.99:0/2121499448 >> 172.21.15.99:0/2121499448 conn(0x7f32c00d29b0 msgr2=0x7f32c00d2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:03:18.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.232+0000 7f32c6600640 1 -- 172.21.15.99:0/2121499448 shutdown_connections 2024-02-21T23:03:18.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.232+0000 7f32c6600640 1 -- 172.21.15.99:0/2121499448 wait complete. 2024-02-21T23:03:18.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.235+0000 7f32c6600640 1 Processor -- start 2024-02-21T23:03:18.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.235+0000 7f32c6600640 1 -- start start 2024-02-21T23:03:18.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.237+0000 7f32c6600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32c017f490 0x7f32c0222dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:18.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.237+0000 7f32c6600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32c018b060 0x7f32c015f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:18.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.237+0000 7f32c6600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32c018b4f0 0x7f32c0159650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:18.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.237+0000 7f32c6600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c018a600 con 0x7f32c018b4f0 2024-02-21T23:03:18.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.237+0000 7f32c6600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c018a320 con 0x7f32c017f490 2024-02-21T23:03:18.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.237+0000 7f32c6600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c017f870 con 0x7f32c018b060 2024-02-21T23:03:18.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.238+0000 7f32bfe00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32c018b060 0x7f32c015f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:18.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.238+0000 7f32bfe00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32c018b060 0x7f32c015f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:47018/0 (socket says 172.21.15.99:47018) 2024-02-21T23:03:18.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.238+0000 7f32bfe00640 1 -- 172.21.15.99:0/3550623447 learned_addr learned my addr 172.21.15.99:0/3550623447 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:03:18.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.238+0000 7f32c5200640 1 --2- 172.21.15.99:0/3550623447 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32c017f490 0x7f32c0222dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:18.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.238+0000 7f32c5c00640 1 --2- 172.21.15.99:0/3550623447 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32c018b4f0 0x7f32c0159650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:18.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.238+0000 7f32bfe00640 1 -- 172.21.15.99:0/3550623447 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32c017f490 msgr2=0x7f32c0222dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:18.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.238+0000 7f32bfe00640 1 --2- 172.21.15.99:0/3550623447 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32c017f490 0x7f32c0222dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:18.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.238+0000 7f32bfe00640 1 -- 172.21.15.99:0/3550623447 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32c018b4f0 msgr2=0x7f32c0159650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:18.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.238+0000 7f32bfe00640 1 --2- 172.21.15.99:0/3550623447 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32c018b4f0 0x7f32c0159650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:18.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.238+0000 7f32bfe00640 1 -- 172.21.15.99:0/3550623447 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32c015ddf0 con 0x7f32c018b060 2024-02-21T23:03:18.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.239+0000 7f32bfe00640 1 --2- 172.21.15.99:0/3550623447 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32c018b060 0x7f32c015f170 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f32b000c4a0 tx=0x7f32b000c960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:18.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.239+0000 7f32bcc00640 1 -- 172.21.15.99:0/3550623447 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b0017070 con 0x7f32c018b060 2024-02-21T23:03:18.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.239+0000 7f32bcc00640 1 -- 172.21.15.99:0/3550623447 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32b0005ce0 con 0x7f32c018b060 2024-02-21T23:03:18.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.239+0000 7f32bcc00640 1 -- 172.21.15.99:0/3550623447 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b0007270 con 0x7f32c018b060 2024-02-21T23:03:18.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.239+0000 7f32c6600640 1 -- 172.21.15.99:0/3550623447 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32c015e0d0 con 0x7f32c018b060 2024-02-21T23:03:18.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.239+0000 7f32c6600640 1 -- 172.21.15.99:0/3550623447 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32c015e690 con 0x7f32c018b060 2024-02-21T23:03:18.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.247+0000 7f32cab86740 1 Processor -- start 2024-02-21T23:03:18.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.247+0000 7f32cab86740 1 -- start start 2024-02-21T23:03:18.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.249+0000 7f32cab86740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a8bbb3f660 0x55a8bbb3fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:18.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.249+0000 7f32cab86740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a8bbb7a330 0x55a8bbb7a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:18.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.249+0000 7f32cab86740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a8bbb7acf0 0x55a8bbb7b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:18.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.249+0000 7f32cab86740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8bba67b50 con 0x55a8bbb7a330 2024-02-21T23:03:18.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.249+0000 7f32cab86740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8bba10da0 con 0x55a8bbb7acf0 2024-02-21T23:03:18.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.249+0000 7f32cab86740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8bba63bf0 con 0x55a8bbb3f660 2024-02-21T23:03:18.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.251+0000 7f32c5c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a8bbb3f660 0x55a8bbb3fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:18.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.251+0000 7f32bcc00640 1 -- 172.21.15.99:0/3550623447 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 13) v1 ==== 134589+0+0 (secure 0 0 0) 0x7f32b001a070 con 0x7f32c018b060 2024-02-21T23:03:18.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.252+0000 7f32bfe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a8bbb7acf0 0x55a8bbb7b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:18.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.252+0000 7f32bfe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a8bbb7acf0 0x55a8bbb7b560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:41678/0 (socket says 172.21.15.99:41678) 2024-02-21T23:03:18.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.252+0000 7f32bfe00640 1 -- 172.21.15.99:0/2673256470 learned_addr learned my addr 172.21.15.99:0/2673256470 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:03:18.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.253+0000 7f32bfe00640 1 -- 172.21.15.99:0/2673256470 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a8bbb3f660 msgr2=0x55a8bbb3fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:18.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.253+0000 7f32bfe00640 1 --2- 172.21.15.99:0/2673256470 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a8bbb3f660 0x55a8bbb3fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:18.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.253+0000 7f32bfe00640 1 -- 172.21.15.99:0/2673256470 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a8bbb7a330 msgr2=0x55a8bbb7a7b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T23:03:18.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.253+0000 7f32bfe00640 1 --2- 172.21.15.99:0/2673256470 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a8bbb7a330 0x55a8bbb7a7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:18.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.253+0000 7f32bfe00640 1 -- 172.21.15.99:0/2673256470 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a8bba33f80 con 0x55a8bbb7acf0 2024-02-21T23:03:18.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.253+0000 7f32bcc00640 1 --2- 172.21.15.99:0/3550623447 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f32a009f140 0x7f32a00a1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:18.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.253+0000 7f32bcc00640 1 -- 172.21.15.99:0/3550623447 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f32b00c93e0 con 0x7f32c018b060 2024-02-21T23:03:18.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.254+0000 7f32bfe00640 1 --2- 172.21.15.99:0/2673256470 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a8bbb7acf0 0x55a8bbb7b560 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f32b00c6890 tx=0x7f32b00d1600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d47f08426e16e9e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:18.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.254+0000 7f32b5600640 1 -- 172.21.15.99:0/2673256470 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b0092cf0 con 0x55a8bbb7acf0 2024-02-21T23:03:18.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.255+0000 7f32b5600640 1 -- 172.21.15.99:0/2673256470 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32b00d1e30 con 0x55a8bbb7acf0 2024-02-21T23:03:18.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.255+0000 7f32b5600640 1 -- 172.21.15.99:0/2673256470 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b0094c20 con 0x55a8bbb7acf0 2024-02-21T23:03:18.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.254+0000 7f32c5c00640 1 --2- 172.21.15.99:0/3550623447 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f32a009f140 0x7f32a00a1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:18.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.256+0000 7f32cab86740 1 -- 172.21.15.99:0/2673256470 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a8bbb7acf0 msgr2=0x55a8bbb7b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:18.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.256+0000 7f32cab86740 1 --2- 172.21.15.99:0/2673256470 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a8bbb7acf0 0x55a8bbb7b560 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f32b00c6890 tx=0x7f32b00d1600 comp rx=0 tx=0).stop 2024-02-21T23:03:18.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.257+0000 7f32cab86740 1 -- 172.21.15.99:0/2673256470 shutdown_connections 2024-02-21T23:03:18.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.257+0000 7f32c5c00640 1 --2- 172.21.15.99:0/3550623447 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f32a009f140 0x7f32a00a1600 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f32b8009fd0 tx=0x7f32b800e040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:18.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.257+0000 7f32cab86740 1 --2- 172.21.15.99:0/2673256470 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a8bbb7acf0 0x55a8bbb7b560 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:18.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.257+0000 7f32cab86740 1 --2- 172.21.15.99:0/2673256470 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a8bbb7a330 0x55a8bbb7a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:18.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.257+0000 7f32cab86740 1 --2- 172.21.15.99:0/2673256470 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a8bbb3f660 0x55a8bbb3fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:18.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.257+0000 7f32cab86740 1 -- 172.21.15.99:0/2673256470 >> 172.21.15.99:0/2673256470 conn(0x55a8bbb016d0 msgr2=0x55a8bbb02750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:03:18.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.260+0000 7f32cab86740 1 -- 172.21.15.99:0/2673256470 shutdown_connections 2024-02-21T23:03:18.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.260+0000 7f32cab86740 1 -- 172.21.15.99:0/2673256470 wait complete. 2024-02-21T23:03:18.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.262+0000 7f32cab86740 1 -- start start 2024-02-21T23:03:18.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.262+0000 7f32cab86740 1 Processor -- start 2024-02-21T23:03:18.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.265+0000 7f32cab86740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a8bbb7acf0 0x55a8bbaff410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:18.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.265+0000 7f32cab86740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a8bbb73ef0 0x55a8bbb42c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:18.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.265+0000 7f32c5200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a8bbb7acf0 0x55a8bbaff410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:18.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.266+0000 7f32bfe00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a8bbb73ef0 0x55a8bbb42c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:18.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.266+0000 7f32bfe00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a8bbb73ef0 0x55a8bbb42c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:47040/0 (socket says 172.21.15.99:47040) 2024-02-21T23:03:18.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.266+0000 7f32c5200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a8bbb7acf0 0x55a8bbaff410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:41680/0 (socket says 172.21.15.99:41680) 2024-02-21T23:03:18.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.266+0000 7f32bfe00640 1 -- 172.21.15.99:0/123461446 learned_addr learned my addr 172.21.15.99:0/123461446 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:03:18.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.266+0000 7f32cab86740 1 --2- 172.21.15.99:0/123461446 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a8bbb350e0 0x55a8bbb494f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:18.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.267+0000 7f32c5c00640 1 --2- 172.21.15.99:0/123461446 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a8bbb350e0 0x55a8bbb494f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:18.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.267+0000 7f32cab86740 1 -- 172.21.15.99:0/123461446 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8bba10da0 con 0x55a8bbb350e0 2024-02-21T23:03:18.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.267+0000 7f32cab86740 1 -- 172.21.15.99:0/123461446 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8bba06380 con 0x55a8bbb7acf0 2024-02-21T23:03:18.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.268+0000 7f32cab86740 1 -- 172.21.15.99:0/123461446 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8bbb790a0 con 0x55a8bbb73ef0 2024-02-21T23:03:18.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.270+0000 7f32bfe00640 1 -- 172.21.15.99:0/123461446 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a8bbb7acf0 msgr2=0x55a8bbaff410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:18.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.270+0000 7f32bfe00640 1 --2- 172.21.15.99:0/123461446 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a8bbb7acf0 0x55a8bbaff410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:18.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.270+0000 7f32bfe00640 1 -- 172.21.15.99:0/123461446 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a8bbb350e0 msgr2=0x55a8bbb494f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:18.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.270+0000 7f32bfe00640 1 --2- 172.21.15.99:0/123461446 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a8bbb350e0 0x55a8bbb494f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:18.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.270+0000 7f32bfe00640 1 -- 172.21.15.99:0/123461446 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a8bba2ec20 con 0x55a8bbb73ef0 2024-02-21T23:03:18.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.270+0000 7f32c5c00640 1 --2- 172.21.15.99:0/123461446 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a8bbb350e0 0x55a8bbb494f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:03:18.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.270+0000 7f32c5200640 1 --2- 172.21.15.99:0/123461446 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a8bbb7acf0 0x55a8bbaff410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:03:18.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.271+0000 7f32cab86740 10 client.0 _ll_register_callbacks cb 0x55a8bba5f280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:03:18.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.271+0000 7f32bfe00640 1 --2- 172.21.15.99:0/123461446 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a8bbb73ef0 0x55a8bbb42c80 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f32b0000f60 tx=0x7f32b00ce070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f40d483d57f37e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:18.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.271+0000 7f32aa000640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-02-21T23:03:18.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.271+0000 7f32aa000640 1 -- 172.21.15.99:0/123461446 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b00b3060 con 0x55a8bbb73ef0 2024-02-21T23:03:18.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.272+0000 7f32cab86740 1 -- 172.21.15.99:0/123461446 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f32b00d1e30 con 0x55a8bbb73ef0 2024-02-21T23:03:18.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.272+0000 7f32aa000640 1 -- 172.21.15.99:0/123461446 <== mon.2 v2:172.21.15.181:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f32b0095f30 con 0x55a8bbb73ef0 2024-02-21T23:03:18.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.272+0000 7f32aa000640 1 -- 172.21.15.99:0/123461446 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f32b0096440 con 0x55a8bbb73ef0 2024-02-21T23:03:18.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.272+0000 7f32cab86740 10 client.5471 fetch_fsmap learned FSMap version 15 2024-02-21T23:03:18.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.272+0000 7f32cab86740 1 -- 172.21.15.99:0/123461446 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({fsmap=15}) v3 -- 0x55a8bb77c3f0 con 0x55a8bbb73ef0 2024-02-21T23:03:18.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.273+0000 7f32aa000640 1 -- 172.21.15.99:0/123461446 <== mon.2 v2:172.21.15.181:3300/0 4 ==== fsmap(e 15) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f32b0007410 con 0x55a8bbb73ef0 2024-02-21T23:03:18.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.273+0000 7f32cab86740 10 client.5471 fetch_fsmap finished waiting for FSMap version 15 2024-02-21T23:03:18.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.273+0000 7f32cab86740 10 client.5471 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2024-02-21T23:03:18.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.273+0000 7f32cab86740 20 client.5471 populate_metadata read hostname 'smithi099' 2024-02-21T23:03:18.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.273+0000 7f32cab86740 1 --2- 172.21.15.99:0/123461446 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x55a8bbb49f00 0x55a8bbb8c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:18.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.274+0000 7f32c5200640 1 --2- 172.21.15.99:0/123461446 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x55a8bbb49f00 0x55a8bbb8c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:18.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.275+0000 7f32cab86740 4 client.5471 mds_command: new command op to 4352 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:03:18.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.275+0000 7f32cab86740 1 -- 172.21.15.99:0/123461446 --> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a8bba75090 con 0x55a8bbb49f00 2024-02-21T23:03:18.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.276+0000 7f32c5200640 1 --2- 172.21.15.99:0/123461446 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x55a8bbb49f00 0x55a8bbb8c0e0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cc8e9ec31c7b0fae server_cookie=c9e51e409ab91fba in_seq=0 out_seq=0 2024-02-21T23:03:18.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.276+0000 7f32aa000640 10 client.5471 ms_handle_connect on v2:172.21.15.99:6836/1676159950 2024-02-21T23:03:18.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.277+0000 7f32aa000640 1 -- 172.21.15.99:0/123461446 <== mds.1 v2:172.21.15.99:6836/1676159950 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55a8bba75090 con 0x55a8bbb49f00 2024-02-21T23:03:18.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.277+0000 7f32aa000640 10 client.5471 handle_command_reply: tid=0 2024-02-21T23:03:18.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.278+0000 7f32cab86740 1 client.5471 shutdown 2024-02-21T23:03:18.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.280+0000 7f32cab86740 1 -- 172.21.15.99:0/123461446 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a8bbb73ef0 msgr2=0x55a8bbb42c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:18.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.280+0000 7f32cab86740 1 --2- 172.21.15.99:0/123461446 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a8bbb73ef0 0x55a8bbb42c80 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f32b0000f60 tx=0x7f32b00ce070 comp rx=0 tx=0).stop 2024-02-21T23:03:18.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.280+0000 7f32cab86740 1 -- 172.21.15.99:0/123461446 shutdown_connections 2024-02-21T23:03:18.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.280+0000 7f32cab86740 1 --2- 172.21.15.99:0/123461446 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x55a8bbb49f00 0x55a8bbb8c0e0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:18.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.280+0000 7f32cab86740 1 --2- 172.21.15.99:0/123461446 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a8bbb350e0 0x55a8bbb494f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:18.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.280+0000 7f32cab86740 1 --2- 172.21.15.99:0/123461446 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a8bbb73ef0 0x55a8bbb42c80 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:18.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.280+0000 7f32cab86740 1 --2- 172.21.15.99:0/123461446 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a8bbb7acf0 0x55a8bbaff410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:18.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.280+0000 7f32cab86740 1 -- 172.21.15.99:0/123461446 >> 172.21.15.99:0/123461446 conn(0x55a8bbb3f660 msgr2=0x55a8bbb79570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:03:18.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.280+0000 7f32aa000640 0 client.5471 ms_handle_reset on v2:172.21.15.99:6836/1676159950 2024-02-21T23:03:18.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.281+0000 7f32cab86740 1 -- 172.21.15.99:0/123461446 shutdown_connections 2024-02-21T23:03:18.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.282+0000 7f32cab86740 1 -- 172.21.15.99:0/123461446 wait complete. 2024-02-21T23:03:18.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.283+0000 7f32cab86740 20 client.5471 trim_cache size 0 max 16384 2024-02-21T23:03:18.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.314+0000 7f32cab86740 1 Processor -- start 2024-02-21T23:03:18.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.319+0000 7f32cab86740 1 -- start start 2024-02-21T23:03:18.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.323+0000 7f32cab86740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a8bbb350e0 0x55a8bbb27f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:18.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.323+0000 7f32cab86740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a8bbb73ef0 0x55a8bbbe5320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:18.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.323+0000 7f32cab86740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a8bbb7acf0 0x55a8bbbe5860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:18.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.323+0000 7f32cab86740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c0228500 con 0x55a8bbb7acf0 2024-02-21T23:03:18.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.324+0000 7f32cab86740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c0070110 con 0x55a8bbb73ef0 2024-02-21T23:03:18.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.324+0000 7f32cab86740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c006e310 con 0x55a8bbb350e0 2024-02-21T23:03:18.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.324+0000 7f32c5200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a8bbb350e0 0x55a8bbb27f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:18.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.324+0000 7f32c5200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a8bbb350e0 0x55a8bbb27f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:47044/0 (socket says 172.21.15.99:47044) 2024-02-21T23:03:18.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.324+0000 7f32c5200640 1 -- 172.21.15.99:0/3406677066 learned_addr learned my addr 172.21.15.99:0/3406677066 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:03:18.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.324+0000 7f32c5200640 1 -- 172.21.15.99:0/3406677066 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a8bbb73ef0 msgr2=0x55a8bbbe5320 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T23:03:18.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.324+0000 7f32c5200640 1 --2- 172.21.15.99:0/3406677066 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a8bbb73ef0 0x55a8bbbe5320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:18.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.325+0000 7f32c5200640 1 -- 172.21.15.99:0/3406677066 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a8bbb7acf0 msgr2=0x55a8bbbe5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:18.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.325+0000 7f32c5200640 1 --2- 172.21.15.99:0/3406677066 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a8bbb7acf0 0x55a8bbbe5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:18.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.325+0000 7f32c5200640 1 -- 172.21.15.99:0/3406677066 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a8bb8467d0 con 0x55a8bbb350e0 2024-02-21T23:03:18.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.325+0000 7f32c5200640 1 --2- 172.21.15.99:0/3406677066 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a8bbb350e0 0x55a8bbb27f50 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f32ac0098c0 tx=0x7f32ac030000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3cdc6c3de31bc5a6 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:18.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.326+0000 7f32b4c00640 1 -- 172.21.15.99:0/3406677066 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32ac035040 con 0x55a8bbb350e0 2024-02-21T23:03:18.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.326+0000 7f32b4c00640 1 -- 172.21.15.99:0/3406677066 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32ac048120 con 0x55a8bbb350e0 2024-02-21T23:03:18.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.326+0000 7f32b4c00640 1 -- 172.21.15.99:0/3406677066 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32ac048980 con 0x55a8bbb350e0 2024-02-21T23:03:18.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.327+0000 7f32cab86740 1 -- 172.21.15.99:0/3406677066 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a8bbb350e0 msgr2=0x55a8bbb27f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:18.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.327+0000 7f32cab86740 1 --2- 172.21.15.99:0/3406677066 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a8bbb350e0 0x55a8bbb27f50 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f32ac0098c0 tx=0x7f32ac030000 comp rx=0 tx=0).stop 2024-02-21T23:03:18.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.327+0000 7f32cab86740 1 -- 172.21.15.99:0/3406677066 shutdown_connections 2024-02-21T23:03:18.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.327+0000 7f32cab86740 1 --2- 172.21.15.99:0/3406677066 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a8bbb7acf0 0x55a8bbbe5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:18.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.327+0000 7f32cab86740 1 --2- 172.21.15.99:0/3406677066 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a8bbb73ef0 0x55a8bbbe5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:18.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.327+0000 7f32cab86740 1 --2- 172.21.15.99:0/3406677066 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a8bbb350e0 0x55a8bbb27f50 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:18.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.327+0000 7f32cab86740 1 -- 172.21.15.99:0/3406677066 >> 172.21.15.99:0/3406677066 conn(0x55a8bbb3f660 msgr2=0x55a8bbb7b130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:03:18.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.327+0000 7f32cab86740 1 -- 172.21.15.99:0/3406677066 shutdown_connections 2024-02-21T23:03:18.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.328+0000 7f32cab86740 1 -- 172.21.15.99:0/3406677066 wait complete. 2024-02-21T23:03:18.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.329+0000 7f32cab86740 1 -- start start 2024-02-21T23:03:18.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.329+0000 7f32cab86740 1 Processor -- start 2024-02-21T23:03:18.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.332+0000 7f32cab86740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a8bbb350e0 0x55a8bbb79d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:18.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.332+0000 7f32cab86740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a8bbb73ef0 0x55a8bbb028c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:18.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.332+0000 7f32cab86740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a8bbb7acf0 0x55a8bbbdf2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:18.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.333+0000 7f32cab86740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c006e910 con 0x55a8bbb7acf0 2024-02-21T23:03:18.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.333+0000 7f32c5c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a8bbb7acf0 0x55a8bbbdf2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:18.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.333+0000 7f32c5200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a8bbb350e0 0x55a8bbb79d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:18.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.333+0000 7f32c5200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a8bbb350e0 0x55a8bbb79d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:41696/0 (socket says 172.21.15.99:41696) 2024-02-21T23:03:18.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.333+0000 7f32cab86740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c006fb10 con 0x55a8bbb350e0 2024-02-21T23:03:18.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.333+0000 7f32cab86740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c006ef10 con 0x55a8bbb73ef0 2024-02-21T23:03:18.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.334+0000 7f32cab86740 10 client.0 _ll_register_callbacks cb 0x7f32b00d13c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:03:18.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.333+0000 7f32bfe00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a8bbb73ef0 0x55a8bbb028c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:18.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.334+0000 7f32bfe00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a8bbb73ef0 0x55a8bbb028c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:47052/0 (socket says 172.21.15.99:47052) 2024-02-21T23:03:18.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.334+0000 7f32c5200640 1 -- 172.21.15.99:0/3774636166 learned_addr learned my addr 172.21.15.99:0/3774636166 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:03:18.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.334+0000 7f32c5200640 1 -- 172.21.15.99:0/3774636166 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a8bbb73ef0 msgr2=0x55a8bbb028c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:18.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.334+0000 7f32c5200640 1 --2- 172.21.15.99:0/3774636166 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a8bbb73ef0 0x55a8bbb028c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:18.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.334+0000 7f32c5200640 1 -- 172.21.15.99:0/3774636166 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a8bbb7acf0 msgr2=0x55a8bbbdf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:18.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.334+0000 7f32c5200640 1 --2- 172.21.15.99:0/3774636166 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a8bbb7acf0 0x55a8bbbdf2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:18.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.334+0000 7f32c5200640 1 -- 172.21.15.99:0/3774636166 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a8bbb02e00 con 0x55a8bbb350e0 2024-02-21T23:03:18.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.335+0000 7f32c5200640 1 --2- 172.21.15.99:0/3774636166 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a8bbb350e0 0x55a8bbb79d60 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f32ac009890 tx=0x7f32ac004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b2fb13e037dbc86 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:18.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.335+0000 7f32aa000640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-02-21T23:03:18.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.337+0000 7f32aa000640 1 -- 172.21.15.99:0/3774636166 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32ac035040 con 0x55a8bbb350e0 2024-02-21T23:03:18.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.337+0000 7f32aa000640 1 -- 172.21.15.99:0/3774636166 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f32ac005ba0 con 0x55a8bbb350e0 2024-02-21T23:03:18.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.337+0000 7f32cab86740 1 -- 172.21.15.99:0/3774636166 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f32ac048120 con 0x55a8bbb350e0 2024-02-21T23:03:18.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.337+0000 7f32aa000640 1 -- 172.21.15.99:0/3774636166 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f32ac005da0 con 0x55a8bbb350e0 2024-02-21T23:03:18.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.338+0000 7f32cab86740 10 client.5470 fetch_fsmap learned FSMap version 15 2024-02-21T23:03:18.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.338+0000 7f32cab86740 1 -- 172.21.15.99:0/3774636166 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x55a8bbb6f250 con 0x55a8bbb350e0 2024-02-21T23:03:18.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.338+0000 7f32aa000640 1 -- 172.21.15.99:0/3774636166 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32ac048120 con 0x55a8bbb350e0 2024-02-21T23:03:18.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.338+0000 7f32aa000640 1 -- 172.21.15.99:0/3774636166 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 15) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f32ac044070 con 0x55a8bbb350e0 2024-02-21T23:03:18.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.338+0000 7f32cab86740 10 client.5470 fetch_fsmap finished waiting for FSMap version 15 2024-02-21T23:03:18.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.338+0000 7f32cab86740 10 client.5470 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2024-02-21T23:03:18.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.338+0000 7f32cab86740 20 client.5470 populate_metadata read hostname 'smithi099' 2024-02-21T23:03:18.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.339+0000 7f32cab86740 1 --2- 172.21.15.99:0/3774636166 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x55a8bbb742d0 0x55a8bbb2a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:18.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.339+0000 7f32cab86740 4 client.5470 mds_command: new command op to 4352 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T23:03:18.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.339+0000 7f32cab86740 1 -- 172.21.15.99:0/3774636166 --> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55a8bba6f3e0 con 0x55a8bbb742d0 2024-02-21T23:03:18.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.339+0000 7f32bfe00640 1 --2- 172.21.15.99:0/3774636166 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x55a8bbb742d0 0x55a8bbb2a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:18.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.340+0000 7f32bfe00640 1 --2- 172.21.15.99:0/3774636166 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x55a8bbb742d0 0x55a8bbb2a4d0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=92d77d9ab79301f9 server_cookie=bbdab10335cec365 in_seq=0 out_seq=0 2024-02-21T23:03:18.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.340+0000 7f32aa000640 10 client.5470 ms_handle_connect on v2:172.21.15.99:6836/1676159950 2024-02-21T23:03:18.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.341+0000 7f32aa000640 1 -- 172.21.15.99:0/3774636166 <== mds.1 v2:172.21.15.99:6836/1676159950 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55a8bba6f3e0 con 0x55a8bbb742d0 2024-02-21T23:03:18.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.341+0000 7f32aa000640 10 client.5470 handle_command_reply: tid=0 2024-02-21T23:03:18.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.341+0000 7f32cab86740 1 client.5470 shutdown 2024-02-21T23:03:18.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.341+0000 7f32cab86740 1 -- 172.21.15.99:0/3774636166 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a8bbb350e0 msgr2=0x55a8bbb79d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:18.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.341+0000 7f32cab86740 1 --2- 172.21.15.99:0/3774636166 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a8bbb350e0 0x55a8bbb79d60 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f32ac009890 tx=0x7f32ac004730 comp rx=0 tx=0).stop 2024-02-21T23:03:18.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.342+0000 7f32cab86740 1 -- 172.21.15.99:0/3774636166 shutdown_connections 2024-02-21T23:03:18.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.342+0000 7f32cab86740 1 --2- 172.21.15.99:0/3774636166 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x55a8bbb742d0 0x55a8bbb2a4d0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:18.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.342+0000 7f32cab86740 1 --2- 172.21.15.99:0/3774636166 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a8bbb7acf0 0x55a8bbbdf2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:18.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.342+0000 7f32cab86740 1 --2- 172.21.15.99:0/3774636166 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a8bbb73ef0 0x55a8bbb028c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:18.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.342+0000 7f32cab86740 1 --2- 172.21.15.99:0/3774636166 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a8bbb350e0 0x55a8bbb79d60 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:18.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.342+0000 7f32cab86740 1 -- 172.21.15.99:0/3774636166 >> 172.21.15.99:0/3774636166 conn(0x55a8bbb3f660 msgr2=0x55a8bbb27db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:03:18.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.342+0000 7f32aa000640 0 client.5470 ms_handle_reset on v2:172.21.15.99:6836/1676159950 2024-02-21T23:03:18.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.343+0000 7f32cab86740 1 -- 172.21.15.99:0/3774636166 shutdown_connections 2024-02-21T23:03:18.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.343+0000 7f32cab86740 1 -- 172.21.15.99:0/3774636166 wait complete. 2024-02-21T23:03:18.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.344+0000 7f32cab86740 20 client.5470 trim_cache size 0 max 16384 2024-02-21T23:03:18.334 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-02-21T23:03:18.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.345+0000 7f32c6600640 1 -- 172.21.15.99:0/3550623447 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f32a009f140 msgr2=0x7f32a00a1600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:18.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.345+0000 7f32c6600640 1 --2- 172.21.15.99:0/3550623447 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f32a009f140 0x7f32a00a1600 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f32b8009fd0 tx=0x7f32b800e040 comp rx=0 tx=0).stop 2024-02-21T23:03:18.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.345+0000 7f32c6600640 1 -- 172.21.15.99:0/3550623447 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32c018b060 msgr2=0x7f32c015f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:18.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.345+0000 7f32c6600640 1 --2- 172.21.15.99:0/3550623447 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32c018b060 0x7f32c015f170 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f32b000c4a0 tx=0x7f32b000c960 comp rx=0 tx=0).stop 2024-02-21T23:03:18.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.346+0000 7f32c6600640 1 -- 172.21.15.99:0/3550623447 shutdown_connections 2024-02-21T23:03:18.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.346+0000 7f32c6600640 1 --2- 172.21.15.99:0/3550623447 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f32a009f140 0x7f32a00a1600 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:18.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.346+0000 7f32c6600640 1 --2- 172.21.15.99:0/3550623447 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32c018b4f0 0x7f32c0159650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:18.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.346+0000 7f32c6600640 1 --2- 172.21.15.99:0/3550623447 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f32c018b060 0x7f32c015f170 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:18.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.346+0000 7f32c6600640 1 --2- 172.21.15.99:0/3550623447 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32c017f490 0x7f32c0222dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:18.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.346+0000 7f32c6600640 1 -- 172.21.15.99:0/3550623447 >> 172.21.15.99:0/3550623447 conn(0x7f32c00d29b0 msgr2=0x7f32c018c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:03:18.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.346+0000 7f32c6600640 1 -- 172.21.15.99:0/3550623447 shutdown_connections 2024-02-21T23:03:18.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.346+0000 7f32c6600640 1 -- 172.21.15.99:0/3550623447 wait complete. 2024-02-21T23:03:18.364 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T23:03:18.364 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-02-21T23:03:18.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.659+0000 7f986a000640 1 Processor -- start 2024-02-21T23:03:18.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.659+0000 7f986a000640 1 -- start start 2024-02-21T23:03:18.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.663+0000 7f986a000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f98640f6240 0x7f98641884e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:18.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.663+0000 7f986a000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98640f9690 con 0x7f9864182a80 2024-02-21T23:03:18.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.664+0000 7f986a000640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98640d2950 con 0x7f9864188100 2024-02-21T23:03:18.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.664+0000 7f986a000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98640f6780 con 0x7f98640f6240 2024-02-21T23:03:18.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.663+0000 7f9863e00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f9864182a80 0x7f98640f8f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.99:54634/0 (socket says 172.21.15.99:54634) 2024-02-21T23:03:18.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.664+0000 7f9863e00640 1 -- 172.21.15.99:0/2061739559 learned_addr learned my addr 172.21.15.99:0/2061739559 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:03:18.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.664+0000 7f9869600640 1 --2- 172.21.15.99:0/2061739559 >> v2:172.21.15.162:3300/0 conn(0x7f98640f6240 0x7f98641884e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:18.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.664+0000 7f9868c00640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f9864188100 0x7f9864185510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:38768/0 (socket says 172.21.15.99:38768) 2024-02-21T23:03:18.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.665+0000 7f9869600640 1 -- 172.21.15.99:0/2061739559 >> v1:172.21.15.181:6789/0 conn(0x7f9864188100 legacy=0x7f9864185510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:18.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.665+0000 7f9869600640 1 -- 172.21.15.99:0/2061739559 >> v1:172.21.15.162:6789/0 conn(0x7f9864182a80 legacy=0x7f98640f8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:18.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.666+0000 7f9869600640 1 -- 172.21.15.99:0/2061739559 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98640f7ee0 con 0x7f98640f6240 2024-02-21T23:03:18.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.668+0000 7f9869600640 1 --2- 172.21.15.99:0/2061739559 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98640f6240 0x7f98641884e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f985c0097a0 tx=0x7f985c02b600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c3876ad8d0e7bd8 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:18.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.668+0000 7f9863400640 1 -- 172.21.15.99:0/2061739559 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985c037070 con 0x7f98640f6240 2024-02-21T23:03:18.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.668+0000 7f9863400640 1 -- 172.21.15.99:0/2061739559 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f985c030510 con 0x7f98640f6240 2024-02-21T23:03:18.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.668+0000 7f9863400640 1 -- 172.21.15.99:0/2061739559 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985c0308e0 con 0x7f98640f6240 2024-02-21T23:03:18.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.669+0000 7f986a000640 1 -- 172.21.15.99:0/2061739559 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98640f6240 msgr2=0x7f98641884e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:18.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.669+0000 7f986a000640 1 --2- 172.21.15.99:0/2061739559 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98640f6240 0x7f98641884e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f985c0097a0 tx=0x7f985c02b600 comp rx=0 tx=0).stop 2024-02-21T23:03:18.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.669+0000 7f986a000640 1 -- 172.21.15.99:0/2061739559 shutdown_connections 2024-02-21T23:03:18.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.669+0000 7f986a000640 1 --2- 172.21.15.99:0/2061739559 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98640f6240 0x7f98641884e0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:18.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.670+0000 7f986a000640 1 -- 172.21.15.99:0/2061739559 >> 172.21.15.99:0/2061739559 conn(0x7f98640ce4b0 msgr2=0x7f98640ce8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:03:18.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.671+0000 7f986a000640 1 -- 172.21.15.99:0/2061739559 shutdown_connections 2024-02-21T23:03:18.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.672+0000 7f986a000640 1 -- 172.21.15.99:0/2061739559 wait complete. 2024-02-21T23:03:18.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.675+0000 7f986a000640 1 Processor -- start 2024-02-21T23:03:18.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.675+0000 7f986a000640 1 -- start start 2024-02-21T23:03:18.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.678+0000 7f986a000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98640f6240 0x7f9864175040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:18.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.678+0000 7f986a000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9864182a80 0x7f9864154cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:18.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.678+0000 7f986a000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9864188100 0x7f9864155200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:18.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.679+0000 7f986a000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98640f8780 con 0x7f9864182a80 2024-02-21T23:03:18.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.679+0000 7f986a000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98640f84a0 con 0x7f9864188100 2024-02-21T23:03:18.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.679+0000 7f986a000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98640f8a60 con 0x7f98640f6240 2024-02-21T23:03:18.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.679+0000 7f9869600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9864188100 0x7f9864155200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:18.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.679+0000 7f9869600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9864188100 0x7f9864155200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:41712/0 (socket says 172.21.15.99:41712) 2024-02-21T23:03:18.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.679+0000 7f9869600640 1 -- 172.21.15.99:0/3159385385 learned_addr learned my addr 172.21.15.99:0/3159385385 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:03:18.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.680+0000 7f9868c00640 1 --2- 172.21.15.99:0/3159385385 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98640f6240 0x7f9864175040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:18.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.680+0000 7f9863e00640 1 --2- 172.21.15.99:0/3159385385 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9864182a80 0x7f9864154cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:18.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.681+0000 7f9869600640 1 -- 172.21.15.99:0/3159385385 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98640f6240 msgr2=0x7f9864175040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:18.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.681+0000 7f9869600640 1 --2- 172.21.15.99:0/3159385385 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98640f6240 0x7f9864175040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:18.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.681+0000 7f9869600640 1 -- 172.21.15.99:0/3159385385 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9864182a80 msgr2=0x7f9864154cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:18.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.681+0000 7f9869600640 1 --2- 172.21.15.99:0/3159385385 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9864182a80 0x7f9864154cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:18.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.681+0000 7f9869600640 1 -- 172.21.15.99:0/3159385385 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98641582a0 con 0x7f9864188100 2024-02-21T23:03:18.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.682+0000 7f9863e00640 1 --2- 172.21.15.99:0/3159385385 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9864182a80 0x7f9864154cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:03:18.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.682+0000 7f9869600640 1 --2- 172.21.15.99:0/3159385385 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9864188100 0x7f9864155200 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f985c0098c0 tx=0x7f985c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:18.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.683+0000 7f9860c00640 1 -- 172.21.15.99:0/3159385385 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985c040020 con 0x7f9864188100 2024-02-21T23:03:18.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.683+0000 7f9860c00640 1 -- 172.21.15.99:0/3159385385 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f985c032930 con 0x7f9864188100 2024-02-21T23:03:18.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.683+0000 7f9860c00640 1 -- 172.21.15.99:0/3159385385 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985c037040 con 0x7f9864188100 2024-02-21T23:03:18.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.683+0000 7f986a000640 1 -- 172.21.15.99:0/3159385385 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9864158580 con 0x7f9864188100 2024-02-21T23:03:18.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.683+0000 7f986a000640 1 -- 172.21.15.99:0/3159385385 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9864158b40 con 0x7f9864188100 2024-02-21T23:03:18.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.693+0000 7f986e61e740 1 Processor -- start 2024-02-21T23:03:18.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.694+0000 7f9860c00640 1 -- 172.21.15.99:0/3159385385 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 13) v1 ==== 134589+0+0 (secure 0 0 0) 0x7f985c043020 con 0x7f9864188100 2024-02-21T23:03:18.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.696+0000 7f9860c00640 1 --2- 172.21.15.99:0/3159385385 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f984809f140 0x7f98480a1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:18.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.696+0000 7f9860c00640 1 -- 172.21.15.99:0/3159385385 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f985c0eb700 con 0x7f9864188100 2024-02-21T23:03:18.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.697+0000 7f9863e00640 1 --2- 172.21.15.99:0/3159385385 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f984809f140 0x7f98480a1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:18.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.698+0000 7f986e61e740 1 -- start start 2024-02-21T23:03:18.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.698+0000 7f9863e00640 1 --2- 172.21.15.99:0/3159385385 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f984809f140 0x7f98480a1600 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f986417e660 tx=0x7f9854005bf0 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:18.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.700+0000 7f986e61e740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560d4f9b1e70 0x560d4f9b2250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:18.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.700+0000 7f986e61e740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560d4f9ecb40 0x560d4f9ecfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:18.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.700+0000 7f986e61e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560d4f9ed500 0x560d4f9edd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:18.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.700+0000 7f986e61e740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d4f8d1b50 con 0x560d4f9b1e70 2024-02-21T23:03:18.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.700+0000 7f986e61e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d4f87ada0 con 0x560d4f9ed500 2024-02-21T23:03:18.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.700+0000 7f986e61e740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d4f8cdbf0 con 0x560d4f9ecb40 2024-02-21T23:03:18.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.700+0000 7f9863e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560d4f9ecb40 0x560d4f9ecfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:18.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.700+0000 7f9863e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560d4f9ecb40 0x560d4f9ecfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:47068/0 (socket says 172.21.15.99:47068) 2024-02-21T23:03:18.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.700+0000 7f9863e00640 1 -- 172.21.15.99:0/3596653770 learned_addr learned my addr 172.21.15.99:0/3596653770 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:03:18.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.701+0000 7f9863e00640 1 -- 172.21.15.99:0/3596653770 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560d4f9ed500 msgr2=0x560d4f9edd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:18.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.701+0000 7f9863e00640 1 --2- 172.21.15.99:0/3596653770 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560d4f9ed500 0x560d4f9edd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:18.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.701+0000 7f9863e00640 1 -- 172.21.15.99:0/3596653770 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560d4f9b1e70 msgr2=0x560d4f9b2250 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T23:03:18.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.701+0000 7f9868c00640 1 --2- 172.21.15.99:0/3596653770 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560d4f9b1e70 0x560d4f9b2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:18.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.701+0000 7f9863e00640 1 --2- 172.21.15.99:0/3596653770 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560d4f9b1e70 0x560d4f9b2250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:18.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.701+0000 7f9863e00640 1 -- 172.21.15.99:0/3596653770 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560d4f89df80 con 0x560d4f9ecb40 2024-02-21T23:03:18.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.702+0000 7f9868c00640 1 --2- 172.21.15.99:0/3596653770 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560d4f9b1e70 0x560d4f9b2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T23:03:18.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.702+0000 7f9863e00640 1 --2- 172.21.15.99:0/3596653770 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560d4f9ecb40 0x560d4f9ecfc0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f9854001da0 tx=0x7f9854012000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4805a0c3b2e5d37c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:18.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.702+0000 7f9851200640 1 -- 172.21.15.99:0/3596653770 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9854015a80 con 0x560d4f9ecb40 2024-02-21T23:03:18.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.704+0000 7f9851200640 1 -- 172.21.15.99:0/3596653770 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9854015c20 con 0x560d4f9ecb40 2024-02-21T23:03:18.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.704+0000 7f9851200640 1 -- 172.21.15.99:0/3596653770 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9854021450 con 0x560d4f9ecb40 2024-02-21T23:03:18.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.705+0000 7f986e61e740 1 -- 172.21.15.99:0/3596653770 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560d4f9ecb40 msgr2=0x560d4f9ecfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:18.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.705+0000 7f986e61e740 1 --2- 172.21.15.99:0/3596653770 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560d4f9ecb40 0x560d4f9ecfc0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f9854001da0 tx=0x7f9854012000 comp rx=0 tx=0).stop 2024-02-21T23:03:18.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.705+0000 7f986e61e740 1 -- 172.21.15.99:0/3596653770 shutdown_connections 2024-02-21T23:03:18.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.705+0000 7f986e61e740 1 --2- 172.21.15.99:0/3596653770 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560d4f9ed500 0x560d4f9edd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:18.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.705+0000 7f986e61e740 1 --2- 172.21.15.99:0/3596653770 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560d4f9ecb40 0x560d4f9ecfc0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:18.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.705+0000 7f986e61e740 1 --2- 172.21.15.99:0/3596653770 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560d4f9b1e70 0x560d4f9b2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:18.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.705+0000 7f986e61e740 1 -- 172.21.15.99:0/3596653770 >> 172.21.15.99:0/3596653770 conn(0x560d4f973ee0 msgr2=0x560d4f974f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:03:18.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.706+0000 7f986e61e740 1 -- 172.21.15.99:0/3596653770 shutdown_connections 2024-02-21T23:03:18.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.706+0000 7f986e61e740 1 -- 172.21.15.99:0/3596653770 wait complete. 2024-02-21T23:03:18.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.708+0000 7f986e61e740 1 -- start start 2024-02-21T23:03:18.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.708+0000 7f986e61e740 1 Processor -- start 2024-02-21T23:03:18.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.711+0000 7f986e61e740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560d4f9ecb40 0x560d4f9f41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:18.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.711+0000 7f986e61e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560d4f9ed500 0x560d4f9dee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:18.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.711+0000 7f986e61e740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560d4f9f79c0 0x560d4f9f67f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:18.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.711+0000 7f986e61e740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d4f9eb8b0 con 0x560d4f9ecb40 2024-02-21T23:03:18.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.711+0000 7f986e61e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d4f870380 con 0x560d4f9ed500 2024-02-21T23:03:18.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.711+0000 7f986e61e740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d4f9eb5d0 con 0x560d4f9f79c0 2024-02-21T23:03:18.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.711+0000 7f986e61e740 10 client.0 _ll_register_callbacks cb 0x560d4f8c9280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:03:18.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.712+0000 7f9863e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560d4f9ed500 0x560d4f9dee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:18.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.712+0000 7f9869600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560d4f9f79c0 0x560d4f9f67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:18.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.712+0000 7f9868c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560d4f9ecb40 0x560d4f9f41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:18.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.712+0000 7f9869600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560d4f9f79c0 0x560d4f9f67f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:47074/0 (socket says 172.21.15.99:47074) 2024-02-21T23:03:18.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.712+0000 7f9869600640 1 -- 172.21.15.99:0/3564797859 learned_addr learned my addr 172.21.15.99:0/3564797859 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:03:18.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.713+0000 7f9868c00640 1 -- 172.21.15.99:0/3564797859 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560d4f9f79c0 msgr2=0x560d4f9f67f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:18.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.713+0000 7f9868c00640 1 --2- 172.21.15.99:0/3564797859 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560d4f9f79c0 0x560d4f9f67f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:18.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.713+0000 7f9868c00640 1 -- 172.21.15.99:0/3564797859 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560d4f9ed500 msgr2=0x560d4f9dee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:18.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.713+0000 7f9868c00640 1 --2- 172.21.15.99:0/3564797859 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560d4f9ed500 0x560d4f9dee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:18.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.713+0000 7f9868c00640 1 -- 172.21.15.99:0/3564797859 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560d4f898c20 con 0x560d4f9ecb40 2024-02-21T23:03:18.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.713+0000 7f9863e00640 1 --2- 172.21.15.99:0/3564797859 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560d4f9ed500 0x560d4f9dee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:03:18.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.714+0000 7f9868c00640 1 --2- 172.21.15.99:0/3564797859 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560d4f9ecb40 0x560d4f9f41e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f9858005ee0 tx=0x7f98580016e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e96cf130b8ed4b17 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:18.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.714+0000 7f9845600640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:03:18.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.715+0000 7f9845600640 1 -- 172.21.15.99:0/3564797859 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9858019060 con 0x560d4f9ecb40 2024-02-21T23:03:18.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.715+0000 7f9845600640 1 -- 172.21.15.99:0/3564797859 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f98580143f0 con 0x560d4f9ecb40 2024-02-21T23:03:18.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.715+0000 7f986e61e740 1 -- 172.21.15.99:0/3564797859 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9854015c20 con 0x560d4f9ecb40 2024-02-21T23:03:18.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.716+0000 7f9845600640 1 -- 172.21.15.99:0/3564797859 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9858019060 con 0x560d4f9ecb40 2024-02-21T23:03:18.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.716+0000 7f986e61e740 10 client.5361 fetch_fsmap learned FSMap version 15 2024-02-21T23:03:18.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.716+0000 7f986e61e740 1 -- 172.21.15.99:0/3564797859 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x560d4f5e63f0 con 0x560d4f9ecb40 2024-02-21T23:03:18.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.717+0000 7f9845600640 1 -- 172.21.15.99:0/3564797859 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98580145f0 con 0x560d4f9ecb40 2024-02-21T23:03:18.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.718+0000 7f9845600640 1 -- 172.21.15.99:0/3564797859 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 15) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f9858013070 con 0x560d4f9ecb40 2024-02-21T23:03:18.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.718+0000 7f986e61e740 10 client.5361 fetch_fsmap finished waiting for FSMap version 15 2024-02-21T23:03:18.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.718+0000 7f986e61e740 10 client.5361 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:03:18.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.718+0000 7f986e61e740 20 client.5361 populate_metadata read hostname 'smithi099' 2024-02-21T23:03:18.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.718+0000 7f986e61e740 1 --2- 172.21.15.99:0/3564797859 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x560d4f9f7e40 0x560d4f9bbc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:18.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.718+0000 7f986e61e740 4 client.5361 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:03:18.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.718+0000 7f986e61e740 1 -- 172.21.15.99:0/3564797859 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9854015c20 con 0x560d4f9f7e40 2024-02-21T23:03:18.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.719+0000 7f9863e00640 1 --2- 172.21.15.99:0/3564797859 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x560d4f9f7e40 0x560d4f9bbc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:18.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.720+0000 7f9863e00640 1 --2- 172.21.15.99:0/3564797859 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x560d4f9f7e40 0x560d4f9bbc20 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88640b471eb2eef8 server_cookie=9368a638a9515894 in_seq=0 out_seq=0 2024-02-21T23:03:18.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.721+0000 7f9845600640 10 client.5361 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:03:18.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.722+0000 7f9845600640 1 -- 172.21.15.99:0/3564797859 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x7f9854015c20 con 0x560d4f9f7e40 2024-02-21T23:03:18.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.722+0000 7f9845600640 10 client.5361 handle_command_reply: tid=0 2024-02-21T23:03:18.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.722+0000 7f986e61e740 1 client.5361 shutdown 2024-02-21T23:03:18.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.723+0000 7f986e61e740 1 -- 172.21.15.99:0/3564797859 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560d4f9ecb40 msgr2=0x560d4f9f41e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:18.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.723+0000 7f986e61e740 1 --2- 172.21.15.99:0/3564797859 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560d4f9ecb40 0x560d4f9f41e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f9858005ee0 tx=0x7f98580016e0 comp rx=0 tx=0).stop 2024-02-21T23:03:18.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.724+0000 7f986e61e740 1 -- 172.21.15.99:0/3564797859 shutdown_connections 2024-02-21T23:03:18.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.724+0000 7f986e61e740 1 --2- 172.21.15.99:0/3564797859 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x560d4f9f7e40 0x560d4f9bbc20 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:18.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.724+0000 7f986e61e740 1 --2- 172.21.15.99:0/3564797859 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560d4f9f79c0 0x560d4f9f67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:18.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.724+0000 7f986e61e740 1 --2- 172.21.15.99:0/3564797859 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560d4f9ed500 0x560d4f9dee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:18.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.724+0000 7f9845600640 0 client.5361 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:03:18.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.725+0000 7f986e61e740 1 --2- 172.21.15.99:0/3564797859 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560d4f9ecb40 0x560d4f9f41e0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:18.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.725+0000 7f986e61e740 1 -- 172.21.15.99:0/3564797859 >> 172.21.15.99:0/3564797859 conn(0x560d4f9b1e70 msgr2=0x560d4f9eada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:03:18.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.725+0000 7f986e61e740 1 -- 172.21.15.99:0/3564797859 shutdown_connections 2024-02-21T23:03:18.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.725+0000 7f986e61e740 1 -- 172.21.15.99:0/3564797859 wait complete. 2024-02-21T23:03:18.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.726+0000 7f986e61e740 20 client.5361 trim_cache size 0 max 16384 2024-02-21T23:03:18.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.753+0000 7f986e61e740 1 Processor -- start 2024-02-21T23:03:18.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.753+0000 7f986e61e740 1 -- start start 2024-02-21T23:03:18.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.755+0000 7f986e61e740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560d4f9ecb40 0x560d4f9b18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:18.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.755+0000 7f986e61e740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560d4f9ed500 0x560d4f9b7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:18.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.755+0000 7f986e61e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560d4f9f79c0 0x560d4f97c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:18.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.755+0000 7f986e61e740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98642285f0 con 0x560d4f9ed500 2024-02-21T23:03:18.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.755+0000 7f986e61e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9864226190 con 0x560d4f9f79c0 2024-02-21T23:03:18.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.755+0000 7f986e61e740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98642210f0 con 0x560d4f9ecb40 2024-02-21T23:03:18.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.756+0000 7f9869600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560d4f9f79c0 0x560d4f97c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:18.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.756+0000 7f9868c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560d4f9ecb40 0x560d4f9b18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:18.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.756+0000 7f9868c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560d4f9ecb40 0x560d4f9b18c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:47086/0 (socket says 172.21.15.99:47086) 2024-02-21T23:03:18.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.756+0000 7f9868c00640 1 -- 172.21.15.99:0/496895759 learned_addr learned my addr 172.21.15.99:0/496895759 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:03:18.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.757+0000 7f9863e00640 1 --2- 172.21.15.99:0/496895759 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560d4f9ed500 0x560d4f9b7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:18.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.757+0000 7f9869600640 1 -- 172.21.15.99:0/496895759 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560d4f9ecb40 msgr2=0x560d4f9b18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:18.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.758+0000 7f9869600640 1 --2- 172.21.15.99:0/496895759 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560d4f9ecb40 0x560d4f9b18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:18.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.758+0000 7f9869600640 1 -- 172.21.15.99:0/496895759 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560d4f9ed500 msgr2=0x560d4f9b7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:18.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.758+0000 7f9869600640 1 --2- 172.21.15.99:0/496895759 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560d4f9ed500 0x560d4f9b7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:18.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.758+0000 7f9869600640 1 -- 172.21.15.99:0/496895759 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560d4f6b07d0 con 0x560d4f9f79c0 2024-02-21T23:03:18.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.758+0000 7f9863e00640 1 --2- 172.21.15.99:0/496895759 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560d4f9ed500 0x560d4f9b7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:03:18.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.759+0000 7f9869600640 1 --2- 172.21.15.99:0/496895759 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560d4f9f79c0 0x560d4f97c380 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f985c0b8a10 tx=0x7f985c0b8ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75f19144b52c0e2c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:18.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.759+0000 7f9847e00640 1 -- 172.21.15.99:0/496895759 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985c030510 con 0x560d4f9f79c0 2024-02-21T23:03:18.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.759+0000 7f9847e00640 1 -- 172.21.15.99:0/496895759 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f985c0b9410 con 0x560d4f9f79c0 2024-02-21T23:03:18.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.759+0000 7f9847e00640 1 -- 172.21.15.99:0/496895759 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985c0b8d10 con 0x560d4f9f79c0 2024-02-21T23:03:18.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.760+0000 7f986e61e740 1 -- 172.21.15.99:0/496895759 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560d4f9f79c0 msgr2=0x560d4f97c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:18.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.761+0000 7f986e61e740 1 --2- 172.21.15.99:0/496895759 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560d4f9f79c0 0x560d4f97c380 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f985c0b8a10 tx=0x7f985c0b8ba0 comp rx=0 tx=0).stop 2024-02-21T23:03:18.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.761+0000 7f986e61e740 1 -- 172.21.15.99:0/496895759 shutdown_connections 2024-02-21T23:03:18.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.761+0000 7f986e61e740 1 --2- 172.21.15.99:0/496895759 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560d4f9f79c0 0x560d4f97c380 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:18.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.761+0000 7f986e61e740 1 --2- 172.21.15.99:0/496895759 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560d4f9ed500 0x560d4f9b7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:18.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.761+0000 7f986e61e740 1 --2- 172.21.15.99:0/496895759 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560d4f9ecb40 0x560d4f9b18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:18.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.761+0000 7f986e61e740 1 -- 172.21.15.99:0/496895759 >> 172.21.15.99:0/496895759 conn(0x560d4f9b1e70 msgr2=0x560d4f9b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:03:18.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.762+0000 7f986e61e740 1 -- 172.21.15.99:0/496895759 shutdown_connections 2024-02-21T23:03:18.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.762+0000 7f986e61e740 1 -- 172.21.15.99:0/496895759 wait complete. 2024-02-21T23:03:18.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.764+0000 7f986e61e740 1 -- start start 2024-02-21T23:03:18.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.764+0000 7f986e61e740 1 Processor -- start 2024-02-21T23:03:18.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.767+0000 7f986e61e740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560d4f9ecb40 0x560d4f9ba330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:18.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.767+0000 7f986e61e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560d4f9ed500 0x560d4f9726a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:18.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.767+0000 7f9868c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560d4f9ecb40 0x560d4f9ba330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:18.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.767+0000 7f9868c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560d4f9ecb40 0x560d4f9ba330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:47098/0 (socket says 172.21.15.99:47098) 2024-02-21T23:03:18.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.767+0000 7f9868c00640 1 -- 172.21.15.99:0/3361520457 learned_addr learned my addr 172.21.15.99:0/3361520457 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:03:18.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.768+0000 7f986e61e740 1 --2- 172.21.15.99:0/3361520457 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560d4f9f79c0 0x560d4f9b1070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:18.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.768+0000 7f986e61e740 1 -- 172.21.15.99:0/3361520457 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9864192470 con 0x560d4f9f79c0 2024-02-21T23:03:18.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.768+0000 7f9863e00640 1 --2- 172.21.15.99:0/3361520457 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560d4f9ed500 0x560d4f9726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:18.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.769+0000 7f986e61e740 1 -- 172.21.15.99:0/3361520457 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9864225b30 con 0x560d4f9ed500 2024-02-21T23:03:18.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.769+0000 7f986e61e740 1 -- 172.21.15.99:0/3361520457 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9864192a70 con 0x560d4f9ecb40 2024-02-21T23:03:18.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.769+0000 7f986e61e740 10 client.0 _ll_register_callbacks cb 0x7f9858007e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:03:18.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.769+0000 7f9869600640 1 --2- 172.21.15.99:0/3361520457 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560d4f9f79c0 0x560d4f9b1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:18.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.770+0000 7f9868c00640 1 -- 172.21.15.99:0/3361520457 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560d4f9ed500 msgr2=0x560d4f9726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:18.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.770+0000 7f9868c00640 1 --2- 172.21.15.99:0/3361520457 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560d4f9ed500 0x560d4f9726a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:18.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.770+0000 7f9868c00640 1 -- 172.21.15.99:0/3361520457 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560d4f9f79c0 msgr2=0x560d4f9b1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:18.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.771+0000 7f9868c00640 1 --2- 172.21.15.99:0/3361520457 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560d4f9f79c0 0x560d4f9b1070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:18.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.771+0000 7f9869600640 1 --2- 172.21.15.99:0/3361520457 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560d4f9f79c0 0x560d4f9b1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T23:03:18.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.771+0000 7f9868c00640 1 -- 172.21.15.99:0/3361520457 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560d4f9b0770 con 0x560d4f9ecb40 2024-02-21T23:03:18.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.771+0000 7f9868c00640 1 --2- 172.21.15.99:0/3361520457 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560d4f9ecb40 0x560d4f9ba330 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f9858011f40 tx=0x7f9858000ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2103161c1f6302b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:18.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.771+0000 7f9845600640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-02-21T23:03:18.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.772+0000 7f9845600640 1 -- 172.21.15.99:0/3361520457 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9858010040 con 0x560d4f9ecb40 2024-02-21T23:03:18.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.772+0000 7f986e61e740 1 -- 172.21.15.99:0/3361520457 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f985c0b9410 con 0x560d4f9ecb40 2024-02-21T23:03:18.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.772+0000 7f9845600640 1 -- 172.21.15.99:0/3361520457 <== mon.2 v2:172.21.15.181:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f985801b300 con 0x560d4f9ecb40 2024-02-21T23:03:18.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.772+0000 7f9845600640 1 -- 172.21.15.99:0/3361520457 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9858037050 con 0x560d4f9ecb40 2024-02-21T23:03:18.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.772+0000 7f986e61e740 10 client.5495 fetch_fsmap learned FSMap version 15 2024-02-21T23:03:18.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.772+0000 7f986e61e740 1 -- 172.21.15.99:0/3361520457 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x560d4f9e5d60 con 0x560d4f9ecb40 2024-02-21T23:03:18.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.772+0000 7f9845600640 1 -- 172.21.15.99:0/3361520457 <== mon.2 v2:172.21.15.181:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f985c0b9410 con 0x560d4f9ecb40 2024-02-21T23:03:18.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.773+0000 7f9845600640 1 -- 172.21.15.99:0/3361520457 <== mon.2 v2:172.21.15.181:3300/0 5 ==== fsmap(e 15) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f9858013070 con 0x560d4f9ecb40 2024-02-21T23:03:18.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.773+0000 7f986e61e740 10 client.5495 fetch_fsmap finished waiting for FSMap version 15 2024-02-21T23:03:18.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.773+0000 7f986e61e740 10 client.5495 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:03:18.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.773+0000 7f986e61e740 20 client.5495 populate_metadata read hostname 'smithi099' 2024-02-21T23:03:18.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.773+0000 7f986e61e740 1 --2- 172.21.15.99:0/3361520457 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x560d4f9f7e40 0x560d4fa52ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:18.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.773+0000 7f986e61e740 4 client.5495 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T23:03:18.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.773+0000 7f986e61e740 1 -- 172.21.15.99:0/3361520457 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x560d4f8df090 con 0x560d4f9f7e40 2024-02-21T23:03:18.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.774+0000 7f9863e00640 1 --2- 172.21.15.99:0/3361520457 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x560d4f9f7e40 0x560d4fa52ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:18.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.775+0000 7f9863e00640 1 --2- 172.21.15.99:0/3361520457 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x560d4f9f7e40 0x560d4fa52ca0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54e497a103ac9537 server_cookie=7ab3c35d74f117b in_seq=0 out_seq=0 2024-02-21T23:03:18.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.776+0000 7f9845600640 10 client.5495 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:03:18.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.776+0000 7f9845600640 1 -- 172.21.15.99:0/3361520457 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x560d4f8df090 con 0x560d4f9f7e40 2024-02-21T23:03:18.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.776+0000 7f9845600640 10 client.5495 handle_command_reply: tid=0 2024-02-21T23:03:18.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.776+0000 7f986e61e740 1 client.5495 shutdown 2024-02-21T23:03:18.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.777+0000 7f986e61e740 1 -- 172.21.15.99:0/3361520457 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560d4f9ecb40 msgr2=0x560d4f9ba330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:18.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.777+0000 7f986e61e740 1 --2- 172.21.15.99:0/3361520457 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560d4f9ecb40 0x560d4f9ba330 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f9858011f40 tx=0x7f9858000ed0 comp rx=0 tx=0).stop 2024-02-21T23:03:18.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.777+0000 7f986e61e740 1 -- 172.21.15.99:0/3361520457 shutdown_connections 2024-02-21T23:03:18.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.777+0000 7f986e61e740 1 --2- 172.21.15.99:0/3361520457 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x560d4f9f7e40 0x560d4fa52ca0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:18.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.777+0000 7f986e61e740 1 --2- 172.21.15.99:0/3361520457 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560d4f9f79c0 0x560d4f9b1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:18.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.777+0000 7f9845600640 0 client.5495 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:03:18.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.777+0000 7f986e61e740 1 --2- 172.21.15.99:0/3361520457 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560d4f9ed500 0x560d4f9726a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:18.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.777+0000 7f986e61e740 1 --2- 172.21.15.99:0/3361520457 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560d4f9ecb40 0x560d4f9ba330 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:18.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.777+0000 7f986e61e740 1 -- 172.21.15.99:0/3361520457 >> 172.21.15.99:0/3361520457 conn(0x560d4f9b1e70 msgr2=0x560d4f975140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:03:18.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.777+0000 7f986e61e740 1 -- 172.21.15.99:0/3361520457 shutdown_connections 2024-02-21T23:03:18.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.778+0000 7f986e61e740 1 -- 172.21.15.99:0/3361520457 wait complete. 2024-02-21T23:03:18.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.778+0000 7f986e61e740 20 client.5495 trim_cache size 0 max 16384 2024-02-21T23:03:18.770 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-02-21T23:03:18.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.782+0000 7f986a000640 1 -- 172.21.15.99:0/3159385385 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f984809f140 msgr2=0x7f98480a1600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:18.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.782+0000 7f986a000640 1 --2- 172.21.15.99:0/3159385385 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f984809f140 0x7f98480a1600 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f986417e660 tx=0x7f9854005bf0 comp rx=0 tx=0).stop 2024-02-21T23:03:18.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.782+0000 7f986a000640 1 -- 172.21.15.99:0/3159385385 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9864188100 msgr2=0x7f9864155200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:18.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.782+0000 7f986a000640 1 --2- 172.21.15.99:0/3159385385 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9864188100 0x7f9864155200 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f985c0098c0 tx=0x7f985c0046c0 comp rx=0 tx=0).stop 2024-02-21T23:03:18.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.782+0000 7f986a000640 1 -- 172.21.15.99:0/3159385385 shutdown_connections 2024-02-21T23:03:18.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.782+0000 7f986a000640 1 --2- 172.21.15.99:0/3159385385 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f984809f140 0x7f98480a1600 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:18.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.782+0000 7f986a000640 1 --2- 172.21.15.99:0/3159385385 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9864188100 0x7f9864155200 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:18.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.782+0000 7f986a000640 1 --2- 172.21.15.99:0/3159385385 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9864182a80 0x7f9864154cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:18.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.782+0000 7f986a000640 1 --2- 172.21.15.99:0/3159385385 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f98640f6240 0x7f9864175040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:18.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.782+0000 7f986a000640 1 -- 172.21.15.99:0/3159385385 >> 172.21.15.99:0/3159385385 conn(0x7f98640ce4b0 msgr2=0x7f98640ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:03:18.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.783+0000 7f986a000640 1 -- 172.21.15.99:0/3159385385 shutdown_connections 2024-02-21T23:03:18.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:18.783+0000 7f986a000640 1 -- 172.21.15.99:0/3159385385 wait complete. 2024-02-21T23:03:19.798 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-02-21T23:03:19.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T23:03:19.799 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-02-21T23:03:20.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.122+0000 7f39ae200640 1 Processor -- start 2024-02-21T23:03:20.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.122+0000 7f39ae200640 1 -- start start 2024-02-21T23:03:20.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.125+0000 7f39ae200640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f39a818b920 0x7f39a80d6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:20.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.125+0000 7f39ae200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39a818a5a0 con 0x7f39a817f710 2024-02-21T23:03:20.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.125+0000 7f39ae200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39a818a880 con 0x7f39a8189f40 2024-02-21T23:03:20.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.125+0000 7f39ae200640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39a818bd80 con 0x7f39a818b920 2024-02-21T23:03:20.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.126+0000 7f39ace00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f39a817f710 0x7f39a815e490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:58842/0 (socket says 172.21.15.99:58842) 2024-02-21T23:03:20.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.126+0000 7f39ace00640 1 -- 172.21.15.99:0/3112410623 learned_addr learned my addr 172.21.15.99:0/3112410623 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:03:20.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.126+0000 7f39ad800640 1 --2- 172.21.15.99:0/3112410623 >> v2:172.21.15.181:3300/0 conn(0x7f39a818b920 0x7f39a80d6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:20.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.126+0000 7f39a7400640 1 -- 172.21.15.99:0/3112410623 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 352153290 0 0) 0x7f39a818a5a0 con 0x7f39a817f710 2024-02-21T23:03:20.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.126+0000 7f39a7400640 1 -- 172.21.15.99:0/3112410623 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3990003520 con 0x7f39a817f710 2024-02-21T23:03:20.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.127+0000 7f39a7400640 1 -- 172.21.15.99:0/3112410623 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2434774537 0 0) 0x7f39a818a880 con 0x7f39a8189f40 2024-02-21T23:03:20.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.127+0000 7f39a7400640 1 -- 172.21.15.99:0/3112410623 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39a818a5a0 con 0x7f39a8189f40 2024-02-21T23:03:20.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.127+0000 7f39a7400640 1 -- 172.21.15.99:0/3112410623 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3798096650 0 0) 0x7f3990003520 con 0x7f39a817f710 2024-02-21T23:03:20.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.127+0000 7f39a7400640 1 -- 172.21.15.99:0/3112410623 >> v2:172.21.15.181:3300/0 conn(0x7f39a818b920 msgr2=0x7f39a80d6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:20.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.127+0000 7f39a7400640 1 --2- 172.21.15.99:0/3112410623 >> v2:172.21.15.181:3300/0 conn(0x7f39a818b920 0x7f39a80d6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:20.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.127+0000 7f39a7400640 1 -- 172.21.15.99:0/3112410623 >> v1:172.21.15.162:6789/0 conn(0x7f39a8189f40 legacy=0x7f39a8071c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:20.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.127+0000 7f39a7400640 1 -- 172.21.15.99:0/3112410623 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39a818ab60 con 0x7f39a817f710 2024-02-21T23:03:20.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.127+0000 7f39a7400640 1 -- 172.21.15.99:0/3112410623 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2069890144 0 0) 0x7f399c001670 con 0x7f39a817f710 2024-02-21T23:03:20.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.127+0000 7f39a7400640 1 -- 172.21.15.99:0/3112410623 >> v1:172.21.15.99:6789/0 conn(0x7f39a817f710 legacy=0x7f39a815e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:20.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.127+0000 7f39a7400640 1 --2- 172.21.15.99:0/3112410623 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3990003be0 0x7f3990003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:20.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.127+0000 7f39a7400640 1 --2- 172.21.15.99:0/3112410623 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3990004800 0x7f3990004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:20.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.127+0000 7f39a7400640 1 --2- 172.21.15.99:0/3112410623 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39900051c0 0x7f399000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:20.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.127+0000 7f39a7400640 1 -- 172.21.15.99:0/3112410623 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39a818bd80 con 0x7f3990004800 2024-02-21T23:03:20.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.127+0000 7f39a7400640 1 -- 172.21.15.99:0/3112410623 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f399000c0f0 con 0x7f39900051c0 2024-02-21T23:03:20.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.127+0000 7f39a7400640 1 -- 172.21.15.99:0/3112410623 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f399000c2f0 con 0x7f3990003be0 2024-02-21T23:03:20.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.128+0000 7f39ad800640 1 --2- 172.21.15.99:0/3112410623 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39900051c0 0x7f399000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:20.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.128+0000 7f39ace00640 1 --2- 172.21.15.99:0/3112410623 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3990003be0 0x7f3990003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:20.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.128+0000 7f39a7e00640 1 --2- 172.21.15.99:0/3112410623 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3990004800 0x7f3990004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:20.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.128+0000 7f39ad800640 1 -- 172.21.15.99:0/3112410623 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3990003be0 msgr2=0x7f3990003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:20.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.128+0000 7f39ad800640 1 --2- 172.21.15.99:0/3112410623 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3990003be0 0x7f3990003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:20.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.128+0000 7f39ad800640 1 -- 172.21.15.99:0/3112410623 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3990004800 msgr2=0x7f3990004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:20.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.128+0000 7f39ad800640 1 --2- 172.21.15.99:0/3112410623 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3990004800 0x7f3990004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:20.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.128+0000 7f39ad800640 1 -- 172.21.15.99:0/3112410623 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3990003520 con 0x7f39900051c0 2024-02-21T23:03:20.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.130+0000 7f39ad800640 1 -- 172.21.15.99:0/3112410623 reap_dead start 2024-02-21T23:03:20.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.130+0000 7f39ad800640 1 --2- 172.21.15.99:0/3112410623 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39900051c0 0x7f399000b9c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f39a0009fc0 tx=0x7f3990005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=248a8a3674c68009 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:20.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.130+0000 7f39a7400640 1 -- 172.21.15.99:0/3112410623 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a003f020 con 0x7f39900051c0 2024-02-21T23:03:20.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.130+0000 7f39a7400640 1 -- 172.21.15.99:0/3112410623 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39a0037070 con 0x7f39900051c0 2024-02-21T23:03:20.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.130+0000 7f39a7400640 1 -- 172.21.15.99:0/3112410623 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a0009c10 con 0x7f39900051c0 2024-02-21T23:03:20.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.131+0000 7f39ae200640 1 -- 172.21.15.99:0/3112410623 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39900051c0 msgr2=0x7f399000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:20.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.131+0000 7f39ae200640 1 --2- 172.21.15.99:0/3112410623 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39900051c0 0x7f399000b9c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f39a0009fc0 tx=0x7f3990005830 comp rx=0 tx=0).stop 2024-02-21T23:03:20.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.132+0000 7f39ae200640 1 -- 172.21.15.99:0/3112410623 shutdown_connections 2024-02-21T23:03:20.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.132+0000 7f39ae200640 1 --2- 172.21.15.99:0/3112410623 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39900051c0 0x7f399000b9c0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:20.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.132+0000 7f39ae200640 1 -- 172.21.15.99:0/3112410623 >> 172.21.15.99:0/3112410623 conn(0x7f39a80fe310 msgr2=0x7f39a80fe720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:03:20.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.132+0000 7f39ae200640 1 -- 172.21.15.99:0/3112410623 shutdown_connections 2024-02-21T23:03:20.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.132+0000 7f39ae200640 1 -- 172.21.15.99:0/3112410623 wait complete. 2024-02-21T23:03:20.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.135+0000 7f39ae200640 1 Processor -- start 2024-02-21T23:03:20.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.136+0000 7f39ae200640 1 -- start start 2024-02-21T23:03:20.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.138+0000 7f39ae200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39a815d620 0x7f39a821e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:20.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.139+0000 7f39ae200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f39a821bae0 0x7f39a80f6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:20.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.139+0000 7f39ae200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f39a815ea00 0x7f39a815ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:20.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.139+0000 7f39ace00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39a815d620 0x7f39a821e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:20.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.139+0000 7f39ace00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39a815d620 0x7f39a821e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:41780/0 (socket says 172.21.15.99:41780) 2024-02-21T23:03:20.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.139+0000 7f39ae200640 1 -- 172.21.15.99:0/2852595148 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39a815e490 con 0x7f39a821bae0 2024-02-21T23:03:20.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.139+0000 7f39ae200640 1 -- 172.21.15.99:0/2852595148 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39a818b120 con 0x7f39a815d620 2024-02-21T23:03:20.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.139+0000 7f39ae200640 1 -- 172.21.15.99:0/2852595148 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39a815e610 con 0x7f39a815ea00 2024-02-21T23:03:20.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.139+0000 7f39a7e00640 1 --2- 172.21.15.99:0/2852595148 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f39a821bae0 0x7f39a80f6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:20.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.140+0000 7f39ad800640 1 --2- 172.21.15.99:0/2852595148 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f39a815ea00 0x7f39a815ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:20.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.140+0000 7f39a7e00640 1 -- 172.21.15.99:0/2852595148 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f39a815ea00 msgr2=0x7f39a815ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:20.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.140+0000 7f39a7e00640 1 --2- 172.21.15.99:0/2852595148 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f39a815ea00 0x7f39a815ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:20.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.140+0000 7f39a7e00640 1 -- 172.21.15.99:0/2852595148 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39a815d620 msgr2=0x7f39a821e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:20.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.140+0000 7f39a7e00640 1 --2- 172.21.15.99:0/2852595148 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39a815d620 0x7f39a821e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:20.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.140+0000 7f39a7e00640 1 -- 172.21.15.99:0/2852595148 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39a80f5760 con 0x7f39a821bae0 2024-02-21T23:03:20.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.139+0000 7f39ace00640 1 -- 172.21.15.99:0/2852595148 learned_addr learned my addr 172.21.15.99:0/2852595148 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:03:20.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.141+0000 7f39ace00640 1 --2- 172.21.15.99:0/2852595148 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39a815d620 0x7f39a821e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-02-21T23:03:20.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.141+0000 7f39a7e00640 1 --2- 172.21.15.99:0/2852595148 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f39a821bae0 0x7f39a80f6ae0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f39a8068df0 tx=0x7f399400e930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:20.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.142+0000 7f39a4c00640 1 -- 172.21.15.99:0/2852595148 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3994019070 con 0x7f39a821bae0 2024-02-21T23:03:20.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.142+0000 7f39ae200640 1 -- 172.21.15.99:0/2852595148 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39a80f5a40 con 0x7f39a821bae0 2024-02-21T23:03:20.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.142+0000 7f39ae200640 1 -- 172.21.15.99:0/2852595148 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39a80f6000 con 0x7f39a821bae0 2024-02-21T23:03:20.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.142+0000 7f39a4c00640 1 -- 172.21.15.99:0/2852595148 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39940052e0 con 0x7f39a821bae0 2024-02-21T23:03:20.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.142+0000 7f39a4c00640 1 -- 172.21.15.99:0/2852595148 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3994003810 con 0x7f39a821bae0 2024-02-21T23:03:20.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.149+0000 7f39a4c00640 1 -- 172.21.15.99:0/2852595148 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 13) v1 ==== 134589+0+0 (secure 0 0 0) 0x7f399401c070 con 0x7f39a821bae0 2024-02-21T23:03:20.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.151+0000 7f39a4c00640 1 --2- 172.21.15.99:0/2852595148 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f398809f0a0 0x7f39880a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:20.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.151+0000 7f39a4c00640 1 -- 172.21.15.99:0/2852595148 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f39940c96d0 con 0x7f39a821bae0 2024-02-21T23:03:20.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.153+0000 7f39b2785740 1 Processor -- start 2024-02-21T23:03:20.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.154+0000 7f39b2785740 1 -- start start 2024-02-21T23:03:20.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.154+0000 7f39ace00640 1 --2- 172.21.15.99:0/2852595148 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f398809f0a0 0x7f39880a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:20.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.156+0000 7f39ace00640 1 --2- 172.21.15.99:0/2852595148 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f398809f0a0 0x7f39880a1560 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f399c001050 tx=0x7f399c001b50 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:20.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.157+0000 7f39b2785740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d0401974c0 0x55d0401978a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:20.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.157+0000 7f39b2785740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d040197de0 0x55d0401d2650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:20.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.158+0000 7f39b2785740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d0401d2b90 0x55d0401d3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:20.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.158+0000 7f39ace00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d0401974c0 0x55d0401978a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:20.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.158+0000 7f39ace00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d0401974c0 0x55d0401978a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:47146/0 (socket says 172.21.15.99:47146) 2024-02-21T23:03:20.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.158+0000 7f39ace00640 1 -- 172.21.15.99:0/35132116 learned_addr learned my addr 172.21.15.99:0/35132116 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:03:20.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.158+0000 7f39b2785740 1 -- 172.21.15.99:0/35132116 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0400bf790 con 0x55d0401d2b90 2024-02-21T23:03:20.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.159+0000 7f39b2785740 1 -- 172.21.15.99:0/35132116 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d040068bf0 con 0x55d040197de0 2024-02-21T23:03:20.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.159+0000 7f39ad800640 1 --2- 172.21.15.99:0/35132116 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d0401d2b90 0x55d0401d3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:20.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.159+0000 7f39a7e00640 1 --2- 172.21.15.99:0/35132116 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d040197de0 0x55d0401d2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:20.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.159+0000 7f39b2785740 1 -- 172.21.15.99:0/35132116 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0400bb830 con 0x55d0401974c0 2024-02-21T23:03:20.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.160+0000 7f39a7e00640 1 -- 172.21.15.99:0/35132116 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d0401974c0 msgr2=0x55d0401978a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:20.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.160+0000 7f39a7e00640 1 --2- 172.21.15.99:0/35132116 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d0401974c0 0x55d0401978a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:20.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.160+0000 7f39a7e00640 1 -- 172.21.15.99:0/35132116 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d0401d2b90 msgr2=0x55d0401d3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:20.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.161+0000 7f39a7e00640 1 --2- 172.21.15.99:0/35132116 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d0401d2b90 0x55d0401d3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:20.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.161+0000 7f39a7e00640 1 -- 172.21.15.99:0/35132116 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d040086c40 con 0x55d040197de0 2024-02-21T23:03:20.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.161+0000 7f39ad800640 1 --2- 172.21.15.99:0/35132116 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d0401d2b90 0x55d0401d3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:03:20.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.161+0000 7f39a7e00640 1 --2- 172.21.15.99:0/35132116 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d040197de0 0x55d0401d2650 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f39940c6c10 tx=0x7f3994096a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61e8dba4f5b657b9 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:20.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.161+0000 7f3999600640 1 -- 172.21.15.99:0/35132116 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f399409af00 con 0x55d040197de0 2024-02-21T23:03:20.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.162+0000 7f3999600640 1 -- 172.21.15.99:0/35132116 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f399409f4c0 con 0x55d040197de0 2024-02-21T23:03:20.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.162+0000 7f3999600640 1 -- 172.21.15.99:0/35132116 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3994093420 con 0x55d040197de0 2024-02-21T23:03:20.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.162+0000 7f39b2785740 1 -- 172.21.15.99:0/35132116 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d040197de0 msgr2=0x55d0401d2650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:20.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.162+0000 7f39b2785740 1 --2- 172.21.15.99:0/35132116 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d040197de0 0x55d0401d2650 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f39940c6c10 tx=0x7f3994096a20 comp rx=0 tx=0).stop 2024-02-21T23:03:20.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.163+0000 7f39b2785740 1 -- 172.21.15.99:0/35132116 shutdown_connections 2024-02-21T23:03:20.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.163+0000 7f39b2785740 1 --2- 172.21.15.99:0/35132116 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d0401d2b90 0x55d0401d3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:20.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.163+0000 7f39b2785740 1 --2- 172.21.15.99:0/35132116 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d040197de0 0x55d0401d2650 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:20.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.163+0000 7f39b2785740 1 --2- 172.21.15.99:0/35132116 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d0401974c0 0x55d0401978a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:20.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.163+0000 7f39b2785740 1 -- 172.21.15.99:0/35132116 >> 172.21.15.99:0/35132116 conn(0x55d040159a90 msgr2=0x55d04015ab10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:03:20.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.163+0000 7f39b2785740 1 -- 172.21.15.99:0/35132116 shutdown_connections 2024-02-21T23:03:20.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.163+0000 7f39b2785740 1 -- 172.21.15.99:0/35132116 wait complete. 2024-02-21T23:03:20.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.164+0000 7f39b2785740 1 -- start start 2024-02-21T23:03:20.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.165+0000 7f39b2785740 1 Processor -- start 2024-02-21T23:03:20.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.167+0000 7f39b2785740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d040197de0 0x55d040196440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:20.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.167+0000 7f39b2785740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d0401d2b90 0x55d0401c0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:20.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.167+0000 7f39b2785740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d0401de4c0 0x55d040156f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:20.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.167+0000 7f39b2785740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0401d1070 con 0x55d040197de0 2024-02-21T23:03:20.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.167+0000 7f39b2785740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d04005e1d0 con 0x55d0401de4c0 2024-02-21T23:03:20.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.167+0000 7f39b2785740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0401d1350 con 0x55d0401d2b90 2024-02-21T23:03:20.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.167+0000 7f39b2785740 10 client.0 _ll_register_callbacks cb 0x55d03fdd3c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:03:20.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.167+0000 7f39ad800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d0401de4c0 0x55d040156f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:20.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.167+0000 7f39ace00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d040197de0 0x55d040196440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:20.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.167+0000 7f39ad800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d0401de4c0 0x55d040156f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:41798/0 (socket says 172.21.15.99:41798) 2024-02-21T23:03:20.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.167+0000 7f39ad800640 1 -- 172.21.15.99:0/1053601146 learned_addr learned my addr 172.21.15.99:0/1053601146 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:03:20.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.168+0000 7f39a7e00640 1 --2- 172.21.15.99:0/1053601146 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d0401d2b90 0x55d0401c0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:20.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.168+0000 7f39ad800640 1 -- 172.21.15.99:0/1053601146 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d0401d2b90 msgr2=0x55d0401c0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:20.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.168+0000 7f39ad800640 1 --2- 172.21.15.99:0/1053601146 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d0401d2b90 0x55d0401c0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:20.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.168+0000 7f39ad800640 1 -- 172.21.15.99:0/1053601146 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d040197de0 msgr2=0x55d040196440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:20.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.168+0000 7f39ad800640 1 --2- 172.21.15.99:0/1053601146 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d040197de0 0x55d040196440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:20.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.168+0000 7f39ad800640 1 -- 172.21.15.99:0/1053601146 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d03fe9c7e0 con 0x55d0401de4c0 2024-02-21T23:03:20.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.168+0000 7f39ace00640 1 --2- 172.21.15.99:0/1053601146 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d040197de0 0x55d040196440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:03:20.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.170+0000 7f39ad800640 1 --2- 172.21.15.99:0/1053601146 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d0401de4c0 0x55d040156f00 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f39a0034ea0 tx=0x7f39a0004ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30235e630386a64b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:20.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.170+0000 7f398e000640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-02-21T23:03:20.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.170+0000 7f398e000640 1 -- 172.21.15.99:0/1053601146 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a003f040 con 0x55d0401de4c0 2024-02-21T23:03:20.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.170+0000 7f398e000640 1 -- 172.21.15.99:0/1053601146 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f39a0003b90 con 0x55d0401de4c0 2024-02-21T23:03:20.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.170+0000 7f39b2785740 1 -- 172.21.15.99:0/1053601146 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f399409f4c0 con 0x55d0401de4c0 2024-02-21T23:03:20.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.171+0000 7f398e000640 1 -- 172.21.15.99:0/1053601146 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f39a0055050 con 0x55d0401de4c0 2024-02-21T23:03:20.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.173+0000 7f39b2785740 10 client.5497 fetch_fsmap learned FSMap version 15 2024-02-21T23:03:20.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.173+0000 7f39b2785740 1 -- 172.21.15.99:0/1053601146 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x55d03fefcf70 con 0x55d0401de4c0 2024-02-21T23:03:20.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.173+0000 7f398e000640 1 -- 172.21.15.99:0/1053601146 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f399409f4c0 con 0x55d0401de4c0 2024-02-21T23:03:20.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.175+0000 7f398e000640 1 -- 172.21.15.99:0/1053601146 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 15) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f39a003b750 con 0x55d0401de4c0 2024-02-21T23:03:20.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.175+0000 7f39b2785740 10 client.5497 fetch_fsmap finished waiting for FSMap version 15 2024-02-21T23:03:20.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.175+0000 7f39b2785740 10 client.5497 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:03:20.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.175+0000 7f39b2785740 20 client.5497 populate_metadata read hostname 'smithi099' 2024-02-21T23:03:20.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.175+0000 7f39b2785740 1 --2- 172.21.15.99:0/1053601146 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55d040157910 0x55d0401dedc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:20.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.175+0000 7f39b2785740 4 client.5497 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:03:20.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.175+0000 7f39b2785740 1 -- 172.21.15.99:0/1053601146 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d0400cccd0 con 0x55d040157910 2024-02-21T23:03:20.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.179+0000 7f39ace00640 1 --2- 172.21.15.99:0/1053601146 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55d040157910 0x55d0401dedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:20.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.180+0000 7f39ace00640 1 --2- 172.21.15.99:0/1053601146 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55d040157910 0x55d0401dedc0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3cf265e5a85e663 server_cookie=af6b1fef06514936 in_seq=0 out_seq=0 2024-02-21T23:03:20.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.180+0000 7f398e000640 10 client.5497 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:03:20.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.181+0000 7f398e000640 1 -- 172.21.15.99:0/1053601146 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55d0400cccd0 con 0x55d040157910 2024-02-21T23:03:20.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.181+0000 7f398e000640 10 client.5497 handle_command_reply: tid=0 2024-02-21T23:03:20.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.181+0000 7f39b2785740 1 client.5497 shutdown 2024-02-21T23:03:20.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.185+0000 7f39b2785740 1 -- 172.21.15.99:0/1053601146 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d0401de4c0 msgr2=0x55d040156f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:20.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.185+0000 7f39b2785740 1 --2- 172.21.15.99:0/1053601146 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d0401de4c0 0x55d040156f00 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f39a0034ea0 tx=0x7f39a0004ab0 comp rx=0 tx=0).stop 2024-02-21T23:03:20.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.185+0000 7f39b2785740 1 -- 172.21.15.99:0/1053601146 shutdown_connections 2024-02-21T23:03:20.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.185+0000 7f39b2785740 1 --2- 172.21.15.99:0/1053601146 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55d040157910 0x55d0401dedc0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:20.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.185+0000 7f39b2785740 1 --2- 172.21.15.99:0/1053601146 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d0401de4c0 0x55d040156f00 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:20.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.185+0000 7f39b2785740 1 --2- 172.21.15.99:0/1053601146 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d0401d2b90 0x55d0401c0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:20.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.185+0000 7f39b2785740 1 --2- 172.21.15.99:0/1053601146 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d040197de0 0x55d040196440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:20.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.185+0000 7f39b2785740 1 -- 172.21.15.99:0/1053601146 >> 172.21.15.99:0/1053601146 conn(0x55d0401974c0 msgr2=0x55d04015b500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:03:20.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.185+0000 7f398e000640 0 client.5497 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:03:20.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.186+0000 7f39b2785740 1 -- 172.21.15.99:0/1053601146 shutdown_connections 2024-02-21T23:03:20.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.186+0000 7f39b2785740 1 -- 172.21.15.99:0/1053601146 wait complete. 2024-02-21T23:03:20.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.186+0000 7f39b2785740 20 client.5497 trim_cache size 0 max 16384 2024-02-21T23:03:20.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.220+0000 7f39b2785740 1 Processor -- start 2024-02-21T23:03:20.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.221+0000 7f39b2785740 1 -- start start 2024-02-21T23:03:20.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.222+0000 7f39b2785740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d040197de0 0x55d0401cfdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:20.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.222+0000 7f39b2785740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d0401d2b90 0x55d0401563d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:20.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.222+0000 7f39b2785740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d0401de4c0 0x55d0401d23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:20.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.222+0000 7f39b2785740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39840119f0 con 0x55d040197de0 2024-02-21T23:03:20.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.222+0000 7f39b2785740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f398400f590 con 0x55d0401de4c0 2024-02-21T23:03:20.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.222+0000 7f39b2785740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f398400d5f0 con 0x55d0401d2b90 2024-02-21T23:03:20.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.223+0000 7f39ad800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d0401de4c0 0x55d0401d23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:20.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.223+0000 7f39a7e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d0401d2b90 0x55d0401563d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:20.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.223+0000 7f39a7e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d0401d2b90 0x55d0401563d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:47164/0 (socket says 172.21.15.99:47164) 2024-02-21T23:03:20.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.223+0000 7f39a7e00640 1 -- 172.21.15.99:0/1787421564 learned_addr learned my addr 172.21.15.99:0/1787421564 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:03:20.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.223+0000 7f39ace00640 1 --2- 172.21.15.99:0/1787421564 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d040197de0 0x55d0401cfdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:20.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.225+0000 7f39ad800640 1 -- 172.21.15.99:0/1787421564 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d0401d2b90 msgr2=0x55d0401563d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:20.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.225+0000 7f39ad800640 1 --2- 172.21.15.99:0/1787421564 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d0401d2b90 0x55d0401563d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:20.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.225+0000 7f39ad800640 1 -- 172.21.15.99:0/1787421564 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d040197de0 msgr2=0x55d0401cfdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:20.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.225+0000 7f39ad800640 1 --2- 172.21.15.99:0/1787421564 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d040197de0 0x55d0401cfdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:20.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.225+0000 7f39ad800640 1 -- 172.21.15.99:0/1787421564 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d040197c10 con 0x55d0401de4c0 2024-02-21T23:03:20.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.225+0000 7f39a7e00640 1 --2- 172.21.15.99:0/1787421564 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d0401d2b90 0x55d0401563d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:03:20.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.225+0000 7f39ad800640 1 --2- 172.21.15.99:0/1787421564 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d0401de4c0 0x55d0401d23f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f39a0034ea0 tx=0x7f39a0049070 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e98b11a52c3e4a63 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:20.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.226+0000 7f3998c00640 1 -- 172.21.15.99:0/1787421564 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a0055050 con 0x55d0401de4c0 2024-02-21T23:03:20.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.226+0000 7f3998c00640 1 -- 172.21.15.99:0/1787421564 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39a005e070 con 0x55d0401de4c0 2024-02-21T23:03:20.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.226+0000 7f3998c00640 1 -- 172.21.15.99:0/1787421564 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a0047690 con 0x55d0401de4c0 2024-02-21T23:03:20.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.227+0000 7f39b2785740 1 -- 172.21.15.99:0/1787421564 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d0401de4c0 msgr2=0x55d0401d23f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:20.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.227+0000 7f39b2785740 1 --2- 172.21.15.99:0/1787421564 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d0401de4c0 0x55d0401d23f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f39a0034ea0 tx=0x7f39a0049070 comp rx=0 tx=0).stop 2024-02-21T23:03:20.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.227+0000 7f39b2785740 1 -- 172.21.15.99:0/1787421564 shutdown_connections 2024-02-21T23:03:20.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.227+0000 7f39b2785740 1 --2- 172.21.15.99:0/1787421564 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d0401de4c0 0x55d0401d23f0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:20.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.227+0000 7f39b2785740 1 --2- 172.21.15.99:0/1787421564 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d0401d2b90 0x55d0401563d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:20.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.227+0000 7f39b2785740 1 --2- 172.21.15.99:0/1787421564 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d040197de0 0x55d0401cfdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:20.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.227+0000 7f39b2785740 1 -- 172.21.15.99:0/1787421564 >> 172.21.15.99:0/1787421564 conn(0x55d0401974c0 msgr2=0x55d04015b500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:03:20.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.228+0000 7f39b2785740 1 -- 172.21.15.99:0/1787421564 shutdown_connections 2024-02-21T23:03:20.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.228+0000 7f39b2785740 1 -- 172.21.15.99:0/1787421564 wait complete. 2024-02-21T23:03:20.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.229+0000 7f39b2785740 1 -- start start 2024-02-21T23:03:20.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.229+0000 7f39b2785740 1 Processor -- start 2024-02-21T23:03:20.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.232+0000 7f39b2785740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d040197de0 0x55d04022da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:20.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.232+0000 7f39b2785740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d0401d2b90 0x55d04023f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:20.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.232+0000 7f39b2785740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d0401de4c0 0x55d0401c7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:20.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.233+0000 7f39b2785740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f398400dc10 con 0x55d0401de4c0 2024-02-21T23:03:20.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.233+0000 7f39b2785740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f398400ef30 con 0x55d0401d2b90 2024-02-21T23:03:20.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.233+0000 7f39b2785740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f398400e270 con 0x55d040197de0 2024-02-21T23:03:20.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.233+0000 7f39b2785740 10 client.0 _ll_register_callbacks cb 0x7f39a00095f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:03:20.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.233+0000 7f39ad800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d0401de4c0 0x55d0401c7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:20.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.233+0000 7f39ace00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d040197de0 0x55d04022da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:20.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.233+0000 7f39a7e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d0401d2b90 0x55d04023f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:20.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.233+0000 7f39a7e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d0401d2b90 0x55d04023f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:41802/0 (socket says 172.21.15.99:41802) 2024-02-21T23:03:20.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.233+0000 7f39a7e00640 1 -- 172.21.15.99:0/3120104041 learned_addr learned my addr 172.21.15.99:0/3120104041 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:03:20.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.234+0000 7f39a7e00640 1 -- 172.21.15.99:0/3120104041 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d040197de0 msgr2=0x55d04022da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:20.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.234+0000 7f39a7e00640 1 --2- 172.21.15.99:0/3120104041 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d040197de0 0x55d04022da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:20.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.234+0000 7f39a7e00640 1 -- 172.21.15.99:0/3120104041 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d0401de4c0 msgr2=0x55d0401c7cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:20.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.234+0000 7f39a7e00640 1 --2- 172.21.15.99:0/3120104041 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d0401de4c0 0x55d0401c7cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:20.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.234+0000 7f39a7e00640 1 -- 172.21.15.99:0/3120104041 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d03fd94170 con 0x55d0401d2b90 2024-02-21T23:03:20.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.234+0000 7f39ad800640 1 --2- 172.21.15.99:0/3120104041 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d0401de4c0 0x55d0401c7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:03:20.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.235+0000 7f39a7e00640 1 --2- 172.21.15.99:0/3120104041 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d0401d2b90 0x55d04023f080 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3994096ab0 tx=0x7f3994012000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=851fec85d1447ff server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:20.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.235+0000 7f398e000640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-02-21T23:03:20.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.235+0000 7f398e000640 1 -- 172.21.15.99:0/3120104041 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f399409af00 con 0x55d0401d2b90 2024-02-21T23:03:20.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.235+0000 7f398e000640 1 -- 172.21.15.99:0/3120104041 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f3994093420 con 0x55d0401d2b90 2024-02-21T23:03:20.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.236+0000 7f39b2785740 1 -- 172.21.15.99:0/3120104041 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f39a005e070 con 0x55d0401d2b90 2024-02-21T23:03:20.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.236+0000 7f398e000640 1 -- 172.21.15.99:0/3120104041 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f399409af00 con 0x55d0401d2b90 2024-02-21T23:03:20.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.236+0000 7f39b2785740 10 client.5503 fetch_fsmap learned FSMap version 15 2024-02-21T23:03:20.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.236+0000 7f39b2785740 1 -- 172.21.15.99:0/3120104041 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x55d0401bcd20 con 0x55d0401d2b90 2024-02-21T23:03:20.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.237+0000 7f398e000640 1 -- 172.21.15.99:0/3120104041 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f399409f4c0 con 0x55d0401d2b90 2024-02-21T23:03:20.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.237+0000 7f398e000640 1 -- 172.21.15.99:0/3120104041 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 15) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f39940b40d0 con 0x55d0401d2b90 2024-02-21T23:03:20.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.237+0000 7f39b2785740 10 client.5503 fetch_fsmap finished waiting for FSMap version 15 2024-02-21T23:03:20.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.237+0000 7f39b2785740 10 client.5503 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:03:20.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.237+0000 7f39b2785740 20 client.5503 populate_metadata read hostname 'smithi099' 2024-02-21T23:03:20.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.237+0000 7f39b2785740 1 --2- 172.21.15.99:0/3120104041 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55d04022f7d0 0x55d04018c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:20.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.238+0000 7f39b2785740 4 client.5503 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-02-21T23:03:20.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.238+0000 7f39b2785740 1 -- 172.21.15.99:0/3120104041 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x7f39a005e070 con 0x55d04022f7d0 2024-02-21T23:03:20.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.238+0000 7f39ace00640 1 --2- 172.21.15.99:0/3120104041 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55d04022f7d0 0x55d04018c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:20.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.240+0000 7f398e000640 10 client.5503 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:03:20.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.240+0000 7f39ace00640 1 --2- 172.21.15.99:0/3120104041 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55d04022f7d0 0x55d04018c1b0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3b4899ad49cdd54 server_cookie=a68668f5ea92f11d in_seq=0 out_seq=0 2024-02-21T23:03:20.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.243+0000 7f398e000640 1 -- 172.21.15.99:0/3120104041 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x7f39a005e070 con 0x55d04022f7d0 2024-02-21T23:03:20.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.243+0000 7f398e000640 10 client.5503 handle_command_reply: tid=0 2024-02-21T23:03:20.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.243+0000 7f39b2785740 1 client.5503 shutdown 2024-02-21T23:03:20.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.246+0000 7f39b2785740 1 -- 172.21.15.99:0/3120104041 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d0401d2b90 msgr2=0x55d04023f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:20.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.246+0000 7f39b2785740 1 --2- 172.21.15.99:0/3120104041 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d0401d2b90 0x55d04023f080 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3994096ab0 tx=0x7f3994012000 comp rx=0 tx=0).stop 2024-02-21T23:03:20.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.246+0000 7f39b2785740 1 -- 172.21.15.99:0/3120104041 shutdown_connections 2024-02-21T23:03:20.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.246+0000 7f39b2785740 1 --2- 172.21.15.99:0/3120104041 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55d04022f7d0 0x55d04018c1b0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:20.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.246+0000 7f39b2785740 1 --2- 172.21.15.99:0/3120104041 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d0401de4c0 0x55d0401c7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:20.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.246+0000 7f39b2785740 1 --2- 172.21.15.99:0/3120104041 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d0401d2b90 0x55d04023f080 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:20.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.246+0000 7f39b2785740 1 --2- 172.21.15.99:0/3120104041 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d040197de0 0x55d04022da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:20.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.246+0000 7f39b2785740 1 -- 172.21.15.99:0/3120104041 >> 172.21.15.99:0/3120104041 conn(0x55d0401974c0 msgr2=0x55d0401563d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:03:20.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.246+0000 7f398e000640 0 client.5503 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:03:20.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.246+0000 7f39b2785740 1 -- 172.21.15.99:0/3120104041 shutdown_connections 2024-02-21T23:03:20.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.247+0000 7f39b2785740 1 -- 172.21.15.99:0/3120104041 wait complete. 2024-02-21T23:03:20.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.248+0000 7f39b2785740 20 client.5503 trim_cache size 0 max 16384 2024-02-21T23:03:20.238 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-02-21T23:03:20.238 INFO:teuthology.orchestra.run.smithi099.stdout: "return_code": 0, 2024-02-21T23:03:20.238 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_tag": "55f1dd69-1e43-4c17-adb1-ea00e8985548", 2024-02-21T23:03:20.238 INFO:teuthology.orchestra.run.smithi099.stdout: "mode": "asynchronous" 2024-02-21T23:03:20.238 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-02-21T23:03:20.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.251+0000 7f39ae200640 1 -- 172.21.15.99:0/2852595148 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f398809f0a0 msgr2=0x7f39880a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:20.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.251+0000 7f39ae200640 1 --2- 172.21.15.99:0/2852595148 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f398809f0a0 0x7f39880a1560 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f399c001050 tx=0x7f399c001b50 comp rx=0 tx=0).stop 2024-02-21T23:03:20.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.251+0000 7f39ae200640 1 -- 172.21.15.99:0/2852595148 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f39a821bae0 msgr2=0x7f39a80f6ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:20.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.251+0000 7f39ae200640 1 --2- 172.21.15.99:0/2852595148 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f39a821bae0 0x7f39a80f6ae0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f39a8068df0 tx=0x7f399400e930 comp rx=0 tx=0).stop 2024-02-21T23:03:20.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.251+0000 7f39ae200640 1 -- 172.21.15.99:0/2852595148 shutdown_connections 2024-02-21T23:03:20.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.251+0000 7f39ae200640 1 --2- 172.21.15.99:0/2852595148 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f398809f0a0 0x7f39880a1560 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:20.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.251+0000 7f39ae200640 1 --2- 172.21.15.99:0/2852595148 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f39a815ea00 0x7f39a815ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:20.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.251+0000 7f39ae200640 1 --2- 172.21.15.99:0/2852595148 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f39a821bae0 0x7f39a80f6ae0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:20.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.251+0000 7f39ae200640 1 --2- 172.21.15.99:0/2852595148 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39a815d620 0x7f39a821e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:20.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.251+0000 7f39ae200640 1 -- 172.21.15.99:0/2852595148 >> 172.21.15.99:0/2852595148 conn(0x7f39a80fe310 msgr2=0x7f39a8071fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:03:20.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.252+0000 7f39ae200640 1 -- 172.21.15.99:0/2852595148 shutdown_connections 2024-02-21T23:03:20.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.253+0000 7f39ae200640 1 -- 172.21.15.99:0/2852595148 wait complete. 2024-02-21T23:03:20.270 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T23:03:20.270 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T23:03:20.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.561+0000 7fb129800640 1 Processor -- start 2024-02-21T23:03:20.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.561+0000 7fb129800640 1 -- start start 2024-02-21T23:03:20.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.563+0000 7fb129800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb12417f490 0x7fb12418ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:20.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.563+0000 7fb129800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb12418b060 0x7fb124188a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:20.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.563+0000 7fb129800640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1240d6dd0 con 0x7fb12418b4f0 2024-02-21T23:03:20.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.563+0000 7fb129800640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1241614c0 con 0x7fb12418b060 2024-02-21T23:03:20.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.563+0000 7fb129800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1240d6810 con 0x7fb12417f490 2024-02-21T23:03:20.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.564+0000 7fb123e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb12417f490 0x7fb12418ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:20.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.564+0000 7fb123400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb12418b060 0x7fb124188a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:20.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.564+0000 7fb128e00640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fb12418b4f0 0x7fb124188f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:38772/0 (socket says 172.21.15.99:38772) 2024-02-21T23:03:20.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.564+0000 7fb128e00640 1 -- 172.21.15.99:0/4191801481 learned_addr learned my addr 172.21.15.99:0/4191801481 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:03:20.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.565+0000 7fb123400640 1 -- 172.21.15.99:0/4191801481 >> v2:172.21.15.162:3300/0 conn(0x7fb12417f490 msgr2=0x7fb12418ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:20.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.565+0000 7fb123400640 1 --2- 172.21.15.99:0/4191801481 >> v2:172.21.15.162:3300/0 conn(0x7fb12417f490 0x7fb12418ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:20.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.565+0000 7fb123400640 1 -- 172.21.15.99:0/4191801481 >> v1:172.21.15.181:6789/0 conn(0x7fb12418b4f0 legacy=0x7fb124188f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:20.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.565+0000 7fb123400640 1 -- 172.21.15.99:0/4191801481 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1240d6af0 con 0x7fb12418b060 2024-02-21T23:03:20.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.566+0000 7fb123400640 1 --2- 172.21.15.99:0/4191801481 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb12418b060 0x7fb124188a40 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb124067c30 tx=0x7fb11402bb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69bbfe0e435a4ebf server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:20.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.566+0000 7fb122a00640 1 -- 172.21.15.99:0/4191801481 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb11402d700 con 0x7fb12418b060 2024-02-21T23:03:20.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.566+0000 7fb122a00640 1 -- 172.21.15.99:0/4191801481 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb11402d8a0 con 0x7fb12418b060 2024-02-21T23:03:20.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.566+0000 7fb122a00640 1 -- 172.21.15.99:0/4191801481 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb11402dc50 con 0x7fb12418b060 2024-02-21T23:03:20.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.567+0000 7fb129800640 1 -- 172.21.15.99:0/4191801481 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb12418b060 msgr2=0x7fb124188a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:20.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.567+0000 7fb129800640 1 --2- 172.21.15.99:0/4191801481 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb12418b060 0x7fb124188a40 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb124067c30 tx=0x7fb11402bb50 comp rx=0 tx=0).stop 2024-02-21T23:03:20.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.567+0000 7fb129800640 1 -- 172.21.15.99:0/4191801481 shutdown_connections 2024-02-21T23:03:20.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.567+0000 7fb129800640 1 --2- 172.21.15.99:0/4191801481 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb12418b060 0x7fb124188a40 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:20.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.567+0000 7fb129800640 1 --2- 172.21.15.99:0/4191801481 >> v2:172.21.15.162:3300/0 conn(0x7fb12417f490 0x7fb12418ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:20.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.567+0000 7fb129800640 1 -- 172.21.15.99:0/4191801481 >> 172.21.15.99:0/4191801481 conn(0x7fb1240d29b0 msgr2=0x7fb1240d2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:03:20.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.567+0000 7fb129800640 1 -- 172.21.15.99:0/4191801481 shutdown_connections 2024-02-21T23:03:20.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.567+0000 7fb129800640 1 -- 172.21.15.99:0/4191801481 wait complete. 2024-02-21T23:03:20.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.569+0000 7fb129800640 1 Processor -- start 2024-02-21T23:03:20.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.569+0000 7fb129800640 1 -- start start 2024-02-21T23:03:20.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.571+0000 7fb129800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb12417f490 0x7fb12418c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:20.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.571+0000 7fb129800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb12418b060 0x7fb124224340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:20.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.571+0000 7fb129800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb12418b4f0 0x7fb124224880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:20.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.571+0000 7fb129800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb12418a600 con 0x7fb12418b4f0 2024-02-21T23:03:20.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.571+0000 7fb129800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb12418a320 con 0x7fb12417f490 2024-02-21T23:03:20.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.571+0000 7fb129800640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb12417f870 con 0x7fb12418b060 2024-02-21T23:03:20.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.571+0000 7fb123e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb12417f490 0x7fb12418c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:20.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.571+0000 7fb123e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb12417f490 0x7fb12418c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:41812/0 (socket says 172.21.15.99:41812) 2024-02-21T23:03:20.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.571+0000 7fb123e00640 1 -- 172.21.15.99:0/1301807096 learned_addr learned my addr 172.21.15.99:0/1301807096 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:03:20.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.571+0000 7fb123400640 1 --2- 172.21.15.99:0/1301807096 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb12418b060 0x7fb124224340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:20.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.572+0000 7fb128e00640 1 --2- 172.21.15.99:0/1301807096 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb12418b4f0 0x7fb124224880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:20.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.572+0000 7fb123e00640 1 -- 172.21.15.99:0/1301807096 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb12418b060 msgr2=0x7fb124224340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:20.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.572+0000 7fb123e00640 1 --2- 172.21.15.99:0/1301807096 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb12418b060 0x7fb124224340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:20.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.572+0000 7fb123e00640 1 -- 172.21.15.99:0/1301807096 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb12418b4f0 msgr2=0x7fb124224880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:20.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.572+0000 7fb123e00640 1 --2- 172.21.15.99:0/1301807096 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb12418b4f0 0x7fb124224880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:20.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.572+0000 7fb123e00640 1 -- 172.21.15.99:0/1301807096 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1242135f0 con 0x7fb12417f490 2024-02-21T23:03:20.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.572+0000 7fb128e00640 1 --2- 172.21.15.99:0/1301807096 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb12418b4f0 0x7fb124224880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:03:20.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.572+0000 7fb123e00640 1 --2- 172.21.15.99:0/1301807096 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb12417f490 0x7fb12418c8e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb10c00e870 tx=0x7fb10c00ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:20.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.573+0000 7fb11be00640 1 -- 172.21.15.99:0/1301807096 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb10c017070 con 0x7fb12417f490 2024-02-21T23:03:20.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.573+0000 7fb11be00640 1 -- 172.21.15.99:0/1301807096 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb10c00c940 con 0x7fb12417f490 2024-02-21T23:03:20.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.573+0000 7fb11be00640 1 -- 172.21.15.99:0/1301807096 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb10c00cd30 con 0x7fb12417f490 2024-02-21T23:03:20.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.573+0000 7fb129800640 1 -- 172.21.15.99:0/1301807096 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1242138d0 con 0x7fb12417f490 2024-02-21T23:03:20.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.573+0000 7fb129800640 1 -- 172.21.15.99:0/1301807096 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb124213e90 con 0x7fb12417f490 2024-02-21T23:03:20.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.578+0000 7fb11be00640 1 -- 172.21.15.99:0/1301807096 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 13) v1 ==== 134589+0+0 (secure 0 0 0) 0x7fb10c01a070 con 0x7fb12417f490 2024-02-21T23:03:20.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.579+0000 7fb12dddc740 1 Processor -- start 2024-02-21T23:03:20.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.579+0000 7fb12dddc740 1 -- start start 2024-02-21T23:03:20.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.581+0000 7fb11be00640 1 --2- 172.21.15.99:0/1301807096 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fb10009f070 0x7fb1000a1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:20.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.581+0000 7fb11be00640 1 -- 172.21.15.99:0/1301807096 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7fb10c0ca090 con 0x7fb12417f490 2024-02-21T23:03:20.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.581+0000 7fb12dddc740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5644552692a0 0x56445529ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:20.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.581+0000 7fb12dddc740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56445529f260 0x564455269680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:20.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.581+0000 7fb12dddc740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564455269bc0 0x56445522c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:20.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.581+0000 7fb12dddc740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x564455195a90 con 0x564455269bc0 2024-02-21T23:03:20.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.581+0000 7fb12dddc740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x56445513eb10 con 0x56445529f260 2024-02-21T23:03:20.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.581+0000 7fb12dddc740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x564455191b30 con 0x5644552692a0 2024-02-21T23:03:20.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.582+0000 7fb123400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56445529f260 0x564455269680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:20.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.582+0000 7fb123400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56445529f260 0x564455269680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:41828/0 (socket says 172.21.15.99:41828) 2024-02-21T23:03:20.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.582+0000 7fb123400640 1 -- 172.21.15.99:0/2184985047 learned_addr learned my addr 172.21.15.99:0/2184985047 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:03:20.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.582+0000 7fb123e00640 1 --2- 172.21.15.99:0/2184985047 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5644552692a0 0x56445529ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:20.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.582+0000 7fb123400640 1 -- 172.21.15.99:0/2184985047 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5644552692a0 msgr2=0x56445529ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:20.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.582+0000 7fb123400640 1 --2- 172.21.15.99:0/2184985047 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5644552692a0 0x56445529ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:20.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.582+0000 7fb123400640 1 -- 172.21.15.99:0/2184985047 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564455269bc0 msgr2=0x56445522c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:20.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.582+0000 7fb128e00640 1 --2- 172.21.15.99:0/2184985047 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564455269bc0 0x56445522c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:20.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.582+0000 7fb123400640 1 --2- 172.21.15.99:0/2184985047 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564455269bc0 0x56445522c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:20.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.582+0000 7fb123400640 1 -- 172.21.15.99:0/2184985047 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564454f747d0 con 0x56445529f260 2024-02-21T23:03:20.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.583+0000 7fb128e00640 1 --2- 172.21.15.99:0/2184985047 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564455269bc0 0x56445522c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T23:03:20.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.583+0000 7fb128e00640 1 --2- 172.21.15.99:0/1301807096 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fb10009f070 0x7fb1000a1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:20.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.583+0000 7fb123400640 1 --2- 172.21.15.99:0/2184985047 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56445529f260 0x564455269680 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb114009af0 tx=0x7fb114030000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ac252fe8ca58c59 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:20.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.583+0000 7fb118c00640 1 -- 172.21.15.99:0/2184985047 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb114003610 con 0x56445529f260 2024-02-21T23:03:20.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.583+0000 7fb118c00640 1 -- 172.21.15.99:0/2184985047 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1140037b0 con 0x56445529f260 2024-02-21T23:03:20.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.583+0000 7fb118c00640 1 -- 172.21.15.99:0/2184985047 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb114003b60 con 0x56445529f260 2024-02-21T23:03:20.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.584+0000 7fb12dddc740 1 -- 172.21.15.99:0/2184985047 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56445529f260 msgr2=0x564455269680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:20.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.584+0000 7fb128e00640 1 --2- 172.21.15.99:0/1301807096 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fb10009f070 0x7fb1000a1530 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb1241793b0 tx=0x7fb11c000f40 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:20.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.584+0000 7fb12dddc740 1 --2- 172.21.15.99:0/2184985047 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56445529f260 0x564455269680 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb114009af0 tx=0x7fb114030000 comp rx=0 tx=0).stop 2024-02-21T23:03:20.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.584+0000 7fb12dddc740 1 -- 172.21.15.99:0/2184985047 shutdown_connections 2024-02-21T23:03:20.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.584+0000 7fb12dddc740 1 --2- 172.21.15.99:0/2184985047 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564455269bc0 0x56445522c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:20.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.584+0000 7fb12dddc740 1 --2- 172.21.15.99:0/2184985047 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56445529f260 0x564455269680 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:20.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.584+0000 7fb12dddc740 1 --2- 172.21.15.99:0/2184985047 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5644552692a0 0x56445529ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:20.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.584+0000 7fb12dddc740 1 -- 172.21.15.99:0/2184985047 >> 172.21.15.99:0/2184985047 conn(0x5644551f86b0 msgr2=0x564455230190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:03:20.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.585+0000 7fb12dddc740 1 -- 172.21.15.99:0/2184985047 shutdown_connections 2024-02-21T23:03:20.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.585+0000 7fb12dddc740 1 -- 172.21.15.99:0/2184985047 wait complete. 2024-02-21T23:03:20.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.585+0000 7fb12dddc740 1 -- start start 2024-02-21T23:03:20.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.586+0000 7fb12dddc740 1 Processor -- start 2024-02-21T23:03:20.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.587+0000 7fb12dddc740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5644552692a0 0x56445529c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:20.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.587+0000 7fb12dddc740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564455269bc0 0x5644552b1d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:20.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.587+0000 7fb12dddc740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56445529f260 0x564455261320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:20.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.587+0000 7fb12dddc740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x564455237f30 con 0x564455269bc0 2024-02-21T23:03:20.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.587+0000 7fb12dddc740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644551341c0 con 0x5644552692a0 2024-02-21T23:03:20.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.587+0000 7fb12dddc740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644552a0930 con 0x56445529f260 2024-02-21T23:03:20.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.587+0000 7fb12dddc740 10 client.0 _ll_register_callbacks cb 0x564455151930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:03:20.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.588+0000 7fb123e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5644552692a0 0x56445529c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:20.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.588+0000 7fb123e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5644552692a0 0x56445529c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:41842/0 (socket says 172.21.15.99:41842) 2024-02-21T23:03:20.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.588+0000 7fb123e00640 1 -- 172.21.15.99:0/2497413646 learned_addr learned my addr 172.21.15.99:0/2497413646 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:03:20.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.588+0000 7fb123400640 1 --2- 172.21.15.99:0/2497413646 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564455269bc0 0x5644552b1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:20.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.588+0000 7fb128e00640 1 --2- 172.21.15.99:0/2497413646 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56445529f260 0x564455261320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:20.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.588+0000 7fb123e00640 1 -- 172.21.15.99:0/2497413646 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56445529f260 msgr2=0x564455261320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:20.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.588+0000 7fb123e00640 1 --2- 172.21.15.99:0/2497413646 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56445529f260 0x564455261320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:20.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.588+0000 7fb123e00640 1 -- 172.21.15.99:0/2497413646 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564455269bc0 msgr2=0x5644552b1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:20.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.588+0000 7fb123e00640 1 --2- 172.21.15.99:0/2497413646 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564455269bc0 0x5644552b1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:20.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.588+0000 7fb123e00640 1 -- 172.21.15.99:0/2497413646 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564454eaa3f0 con 0x5644552692a0 2024-02-21T23:03:20.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.588+0000 7fb123400640 1 --2- 172.21.15.99:0/2497413646 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564455269bc0 0x5644552b1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:03:20.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.589+0000 7fb123e00640 1 --2- 172.21.15.99:0/2497413646 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5644552692a0 0x56445529c920 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb10c00e840 tx=0x7fb10c097040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5490a1a274bf6d7 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:20.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.589+0000 7fb111600640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-02-21T23:03:20.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.589+0000 7fb111600640 1 -- 172.21.15.99:0/2497413646 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb10c021040 con 0x5644552692a0 2024-02-21T23:03:20.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.589+0000 7fb111600640 1 -- 172.21.15.99:0/2497413646 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7fb10c0c77d0 con 0x5644552692a0 2024-02-21T23:03:20.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.589+0000 7fb12dddc740 1 -- 172.21.15.99:0/2497413646 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb1140037b0 con 0x5644552692a0 2024-02-21T23:03:20.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.589+0000 7fb111600640 1 -- 172.21.15.99:0/2497413646 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb10c09b830 con 0x5644552692a0 2024-02-21T23:03:20.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.589+0000 7fb12dddc740 10 client.5515 fetch_fsmap learned FSMap version 15 2024-02-21T23:03:20.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.590+0000 7fb12dddc740 1 -- 172.21.15.99:0/2497413646 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x564454e6a0f0 con 0x5644552692a0 2024-02-21T23:03:20.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.590+0000 7fb111600640 1 -- 172.21.15.99:0/2497413646 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb10c09fe80 con 0x5644552692a0 2024-02-21T23:03:20.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.590+0000 7fb111600640 1 -- 172.21.15.99:0/2497413646 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 15) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fb10c024060 con 0x5644552692a0 2024-02-21T23:03:20.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.590+0000 7fb12dddc740 10 client.5515 fetch_fsmap finished waiting for FSMap version 15 2024-02-21T23:03:20.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.590+0000 7fb12dddc740 10 client.5515 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:03:20.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.591+0000 7fb12dddc740 20 client.5515 populate_metadata read hostname 'smithi099' 2024-02-21T23:03:20.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.591+0000 7fb12dddc740 1 --2- 172.21.15.99:0/2497413646 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5644552955d0 0x5644552b3e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:20.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.592+0000 7fb12dddc740 4 client.5515 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:03:20.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.592+0000 7fb12dddc740 1 -- 172.21.15.99:0/2497413646 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb1140037b0 con 0x5644552955d0 2024-02-21T23:03:20.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.593+0000 7fb123400640 1 --2- 172.21.15.99:0/2497413646 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5644552955d0 0x5644552b3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:20.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.593+0000 7fb123400640 1 --2- 172.21.15.99:0/2497413646 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5644552955d0 0x5644552b3e50 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac55366e6b7f0567 server_cookie=ff00b7a79433e645 in_seq=0 out_seq=0 2024-02-21T23:03:20.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.593+0000 7fb111600640 10 client.5515 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:03:20.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.594+0000 7fb111600640 1 -- 172.21.15.99:0/2497413646 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x7fb1140037b0 con 0x5644552955d0 2024-02-21T23:03:20.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.594+0000 7fb111600640 10 client.5515 handle_command_reply: tid=0 2024-02-21T23:03:20.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.594+0000 7fb12dddc740 1 client.5515 shutdown 2024-02-21T23:03:20.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.595+0000 7fb12dddc740 1 -- 172.21.15.99:0/2497413646 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5644552692a0 msgr2=0x56445529c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:20.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.595+0000 7fb12dddc740 1 --2- 172.21.15.99:0/2497413646 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5644552692a0 0x56445529c920 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb10c00e840 tx=0x7fb10c097040 comp rx=0 tx=0).stop 2024-02-21T23:03:20.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.595+0000 7fb12dddc740 1 -- 172.21.15.99:0/2497413646 shutdown_connections 2024-02-21T23:03:20.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.595+0000 7fb12dddc740 1 --2- 172.21.15.99:0/2497413646 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5644552955d0 0x5644552b3e50 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:20.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.595+0000 7fb12dddc740 1 --2- 172.21.15.99:0/2497413646 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56445529f260 0x564455261320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:20.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.595+0000 7fb12dddc740 1 --2- 172.21.15.99:0/2497413646 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564455269bc0 0x5644552b1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:20.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.595+0000 7fb12dddc740 1 --2- 172.21.15.99:0/2497413646 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5644552692a0 0x56445529c920 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:20.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.595+0000 7fb12dddc740 1 -- 172.21.15.99:0/2497413646 >> 172.21.15.99:0/2497413646 conn(0x5644551f86b0 msgr2=0x564455230b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:03:20.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.595+0000 7fb111600640 0 client.5515 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:03:20.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.595+0000 7fb12dddc740 1 -- 172.21.15.99:0/2497413646 shutdown_connections 2024-02-21T23:03:20.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.595+0000 7fb12dddc740 1 -- 172.21.15.99:0/2497413646 wait complete. 2024-02-21T23:03:20.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.596+0000 7fb12dddc740 20 client.5515 trim_cache size 0 max 16384 2024-02-21T23:03:20.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.613+0000 7fb12dddc740 1 Processor -- start 2024-02-21T23:03:20.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.613+0000 7fb12dddc740 1 -- start start 2024-02-21T23:03:20.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.614+0000 7fb12dddc740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5644552692a0 0x564455230250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:20.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.615+0000 7fb12dddc740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564455269bc0 0x564455298f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:20.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.615+0000 7fb12dddc740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56445529f260 0x564455299450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:20.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.615+0000 7fb12dddc740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb124230f40 con 0x564455269bc0 2024-02-21T23:03:20.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.615+0000 7fb12dddc740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb12422eae0 con 0x56445529f260 2024-02-21T23:03:20.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.615+0000 7fb12dddc740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb124223970 con 0x5644552692a0 2024-02-21T23:03:20.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.615+0000 7fb123e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5644552692a0 0x564455230250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:20.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.615+0000 7fb123400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564455269bc0 0x564455298f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:20.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.615+0000 7fb123400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564455269bc0 0x564455298f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54218/0 (socket says 172.21.15.99:54218) 2024-02-21T23:03:20.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.615+0000 7fb123400640 1 -- 172.21.15.99:0/801627069 learned_addr learned my addr 172.21.15.99:0/801627069 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:03:20.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.615+0000 7fb128e00640 1 --2- 172.21.15.99:0/801627069 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56445529f260 0x564455299450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:20.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.615+0000 7fb123e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5644552692a0 0x564455230250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:47232/0 (socket says 172.21.15.99:47232) 2024-02-21T23:03:20.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.616+0000 7fb128e00640 1 -- 172.21.15.99:0/801627069 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5644552692a0 msgr2=0x564455230250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:20.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.616+0000 7fb128e00640 1 --2- 172.21.15.99:0/801627069 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5644552692a0 0x564455230250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:20.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.616+0000 7fb128e00640 1 -- 172.21.15.99:0/801627069 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564455269bc0 msgr2=0x564455298f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:20.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.616+0000 7fb128e00640 1 --2- 172.21.15.99:0/801627069 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564455269bc0 0x564455298f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:20.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.616+0000 7fb128e00640 1 -- 172.21.15.99:0/801627069 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56445525f270 con 0x56445529f260 2024-02-21T23:03:20.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.616+0000 7fb123400640 1 --2- 172.21.15.99:0/801627069 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564455269bc0 0x564455298f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:03:20.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.616+0000 7fb128e00640 1 --2- 172.21.15.99:0/801627069 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56445529f260 0x564455299450 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb11c001fe0 tx=0x7fb11c012000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0716e276c2a7e09 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:20.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.617+0000 7fb113e00640 1 -- 172.21.15.99:0/801627069 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb11c021410 con 0x56445529f260 2024-02-21T23:03:20.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.617+0000 7fb113e00640 1 -- 172.21.15.99:0/801627069 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb11c026070 con 0x56445529f260 2024-02-21T23:03:20.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.617+0000 7fb113e00640 1 -- 172.21.15.99:0/801627069 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb11c0217b0 con 0x56445529f260 2024-02-21T23:03:20.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.617+0000 7fb12dddc740 1 -- 172.21.15.99:0/801627069 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56445529f260 msgr2=0x564455299450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:20.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.617+0000 7fb12dddc740 1 --2- 172.21.15.99:0/801627069 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56445529f260 0x564455299450 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb11c001fe0 tx=0x7fb11c012000 comp rx=0 tx=0).stop 2024-02-21T23:03:20.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.618+0000 7fb12dddc740 1 -- 172.21.15.99:0/801627069 shutdown_connections 2024-02-21T23:03:20.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.618+0000 7fb12dddc740 1 --2- 172.21.15.99:0/801627069 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56445529f260 0x564455299450 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:20.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.618+0000 7fb12dddc740 1 --2- 172.21.15.99:0/801627069 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564455269bc0 0x564455298f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:20.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.618+0000 7fb12dddc740 1 --2- 172.21.15.99:0/801627069 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5644552692a0 0x564455230250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:20.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.618+0000 7fb12dddc740 1 -- 172.21.15.99:0/801627069 >> 172.21.15.99:0/801627069 conn(0x5644551f86b0 msgr2=0x564455265470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:03:20.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.618+0000 7fb12dddc740 1 -- 172.21.15.99:0/801627069 shutdown_connections 2024-02-21T23:03:20.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.618+0000 7fb12dddc740 1 -- 172.21.15.99:0/801627069 wait complete. 2024-02-21T23:03:20.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.619+0000 7fb12dddc740 1 -- start start 2024-02-21T23:03:20.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.619+0000 7fb12dddc740 1 Processor -- start 2024-02-21T23:03:20.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.620+0000 7fb12dddc740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5644552692a0 0x564455270770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:20.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.620+0000 7fb12dddc740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564455269bc0 0x5644553094a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:20.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.620+0000 7fb12dddc740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56445529f260 0x564455268800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:20.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.620+0000 7fb12dddc740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb12422d280 con 0x5644552692a0 2024-02-21T23:03:20.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.620+0000 7fb12dddc740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb12422e480 con 0x564455269bc0 2024-02-21T23:03:20.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.620+0000 7fb12dddc740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb12422d7e0 con 0x56445529f260 2024-02-21T23:03:20.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.620+0000 7fb12dddc740 10 client.0 _ll_register_callbacks cb 0x7fb10c0972f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:03:20.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.621+0000 7fb123400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564455269bc0 0x5644553094a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:20.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.621+0000 7fb123400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564455269bc0 0x5644553094a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:41856/0 (socket says 172.21.15.99:41856) 2024-02-21T23:03:20.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.621+0000 7fb123400640 1 -- 172.21.15.99:0/1413628321 learned_addr learned my addr 172.21.15.99:0/1413628321 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:03:20.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.621+0000 7fb123e00640 1 --2- 172.21.15.99:0/1413628321 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5644552692a0 0x564455270770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:20.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.621+0000 7fb128e00640 1 --2- 172.21.15.99:0/1413628321 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56445529f260 0x564455268800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:20.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.621+0000 7fb123400640 1 -- 172.21.15.99:0/1413628321 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56445529f260 msgr2=0x564455268800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:20.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.621+0000 7fb123400640 1 --2- 172.21.15.99:0/1413628321 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56445529f260 0x564455268800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:20.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.622+0000 7fb123400640 1 -- 172.21.15.99:0/1413628321 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5644552692a0 msgr2=0x564455270770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:20.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.622+0000 7fb123400640 1 --2- 172.21.15.99:0/1413628321 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5644552692a0 0x564455270770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:20.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.622+0000 7fb123400640 1 -- 172.21.15.99:0/1413628321 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564455268d40 con 0x564455269bc0 2024-02-21T23:03:20.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.622+0000 7fb123400640 1 --2- 172.21.15.99:0/1413628321 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564455269bc0 0x5644553094a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb114009ac0 tx=0x7fb114004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a0c6f6f64a0ae4a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:20.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.622+0000 7fb111600640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-02-21T23:03:20.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.622+0000 7fb111600640 1 -- 172.21.15.99:0/1413628321 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb114005ba0 con 0x564455269bc0 2024-02-21T23:03:20.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.622+0000 7fb12dddc740 1 -- 172.21.15.99:0/1413628321 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb11c026070 con 0x564455269bc0 2024-02-21T23:03:20.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.623+0000 7fb111600640 1 -- 172.21.15.99:0/1413628321 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7fb114005d40 con 0x564455269bc0 2024-02-21T23:03:20.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.623+0000 7fb111600640 1 -- 172.21.15.99:0/1413628321 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb114063050 con 0x564455269bc0 2024-02-21T23:03:20.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.623+0000 7fb12dddc740 10 client.5521 fetch_fsmap learned FSMap version 15 2024-02-21T23:03:20.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.623+0000 7fb12dddc740 1 -- 172.21.15.99:0/1413628321 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x56445522a980 con 0x564455269bc0 2024-02-21T23:03:20.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.623+0000 7fb111600640 1 -- 172.21.15.99:0/1413628321 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb11c026070 con 0x564455269bc0 2024-02-21T23:03:20.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.623+0000 7fb111600640 1 -- 172.21.15.99:0/1413628321 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 15) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fb114058770 con 0x564455269bc0 2024-02-21T23:03:20.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.623+0000 7fb12dddc740 10 client.5521 fetch_fsmap finished waiting for FSMap version 15 2024-02-21T23:03:20.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.624+0000 7fb12dddc740 10 client.5521 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:03:20.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.624+0000 7fb12dddc740 20 client.5521 populate_metadata read hostname 'smithi099' 2024-02-21T23:03:20.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.624+0000 7fb12dddc740 1 --2- 172.21.15.99:0/1413628321 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x56445529d8c0 0x564455291390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:20.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.624+0000 7fb12dddc740 4 client.5521 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T23:03:20.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.624+0000 7fb12dddc740 1 -- 172.21.15.99:0/1413628321 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5644551a2fd0 con 0x56445529d8c0 2024-02-21T23:03:20.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.624+0000 7fb123e00640 1 --2- 172.21.15.99:0/1413628321 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x56445529d8c0 0x564455291390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:20.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.625+0000 7fb123e00640 1 --2- 172.21.15.99:0/1413628321 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x56445529d8c0 0x564455291390 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=77a09edb45ba00e7 server_cookie=7bb3a0c0ad3350d in_seq=0 out_seq=0 2024-02-21T23:03:20.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.625+0000 7fb111600640 10 client.5521 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:03:20.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.625+0000 7fb111600640 1 -- 172.21.15.99:0/1413628321 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5644551a2fd0 con 0x56445529d8c0 2024-02-21T23:03:20.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.625+0000 7fb111600640 10 client.5521 handle_command_reply: tid=0 2024-02-21T23:03:20.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.625+0000 7fb12dddc740 1 client.5521 shutdown 2024-02-21T23:03:20.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.625+0000 7fb12dddc740 1 -- 172.21.15.99:0/1413628321 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564455269bc0 msgr2=0x5644553094a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:20.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.625+0000 7fb12dddc740 1 --2- 172.21.15.99:0/1413628321 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564455269bc0 0x5644553094a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb114009ac0 tx=0x7fb114004730 comp rx=0 tx=0).stop 2024-02-21T23:03:20.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.626+0000 7fb12dddc740 1 -- 172.21.15.99:0/1413628321 shutdown_connections 2024-02-21T23:03:20.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.626+0000 7fb12dddc740 1 --2- 172.21.15.99:0/1413628321 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x56445529d8c0 0x564455291390 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:20.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.626+0000 7fb12dddc740 1 --2- 172.21.15.99:0/1413628321 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56445529f260 0x564455268800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:20.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.626+0000 7fb12dddc740 1 --2- 172.21.15.99:0/1413628321 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564455269bc0 0x5644553094a0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:20.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.626+0000 7fb12dddc740 1 --2- 172.21.15.99:0/1413628321 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5644552692a0 0x564455270770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:20.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.626+0000 7fb12dddc740 1 -- 172.21.15.99:0/1413628321 >> 172.21.15.99:0/1413628321 conn(0x5644551f86b0 msgr2=0x56445522d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:03:20.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.626+0000 7fb111600640 0 client.5521 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:03:20.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.626+0000 7fb12dddc740 1 -- 172.21.15.99:0/1413628321 shutdown_connections 2024-02-21T23:03:20.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.626+0000 7fb12dddc740 1 -- 172.21.15.99:0/1413628321 wait complete. 2024-02-21T23:03:20.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.626+0000 7fb12dddc740 20 client.5521 trim_cache size 0 max 16384 2024-02-21T23:03:20.617 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-02-21T23:03:20.617 INFO:teuthology.orchestra.run.smithi099.stdout: "status": "IDLE (waiting for more scrubs)", 2024-02-21T23:03:20.617 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubs": { 2024-02-21T23:03:20.617 INFO:teuthology.orchestra.run.smithi099.stdout: "55f1dd69-1e43-4c17-adb1-ea00e8985548": { 2024-02-21T23:03:20.617 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/", 2024-02-21T23:03:20.617 INFO:teuthology.orchestra.run.smithi099.stdout: "tag": "55f1dd69-1e43-4c17-adb1-ea00e8985548", 2024-02-21T23:03:20.618 INFO:teuthology.orchestra.run.smithi099.stdout: "options": "recursive,force" 2024-02-21T23:03:20.618 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:03:20.618 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:03:20.618 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-02-21T23:03:20.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.627+0000 7fb129800640 1 -- 172.21.15.99:0/1301807096 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fb10009f070 msgr2=0x7fb1000a1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:20.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.627+0000 7fb129800640 1 --2- 172.21.15.99:0/1301807096 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fb10009f070 0x7fb1000a1530 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb1241793b0 tx=0x7fb11c000f40 comp rx=0 tx=0).stop 2024-02-21T23:03:20.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.627+0000 7fb129800640 1 -- 172.21.15.99:0/1301807096 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb12417f490 msgr2=0x7fb12418c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:20.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.627+0000 7fb129800640 1 --2- 172.21.15.99:0/1301807096 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb12417f490 0x7fb12418c8e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb10c00e870 tx=0x7fb10c00ed30 comp rx=0 tx=0).stop 2024-02-21T23:03:20.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.627+0000 7fb129800640 1 -- 172.21.15.99:0/1301807096 shutdown_connections 2024-02-21T23:03:20.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.627+0000 7fb129800640 1 --2- 172.21.15.99:0/1301807096 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fb10009f070 0x7fb1000a1530 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:20.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.627+0000 7fb129800640 1 --2- 172.21.15.99:0/1301807096 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb12418b4f0 0x7fb124224880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:20.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.627+0000 7fb129800640 1 --2- 172.21.15.99:0/1301807096 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb12418b060 0x7fb124224340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:20.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.627+0000 7fb129800640 1 --2- 172.21.15.99:0/1301807096 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb12417f490 0x7fb12418c8e0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:20.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.627+0000 7fb129800640 1 -- 172.21.15.99:0/1301807096 >> 172.21.15.99:0/1301807096 conn(0x7fb1240d29b0 msgr2=0x7fb12415e810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:03:20.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.628+0000 7fb129800640 1 -- 172.21.15.99:0/1301807096 shutdown_connections 2024-02-21T23:03:20.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:20.628+0000 7fb129800640 1 -- 172.21.15.99:0/1301807096 wait complete. 2024-02-21T23:03:20.634 INFO:tasks.cephfs.filesystem:scrub status for tag:55f1dd69-1e43-4c17-adb1-ea00e8985548 - {'path': '/', 'tag': '55f1dd69-1e43-4c17-adb1-ea00e8985548', 'options': 'recursive,force'} 2024-02-21T23:03:40.686 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:03:40.693 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:03:40.695 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:03:50.635 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T23:03:50.635 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T23:03:50.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.861+0000 7fa6fcc00640 1 Processor -- start 2024-02-21T23:03:50.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.861+0000 7fa6fcc00640 1 -- start start 2024-02-21T23:03:50.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.862+0000 7fa6fcc00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa6f817f490 0x7fa6f818ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:50.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.863+0000 7fa6fcc00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6f80d6dd0 con 0x7fa6f818b060 2024-02-21T23:03:50.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.863+0000 7fa6fcc00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6f81614c0 con 0x7fa6f818b4f0 2024-02-21T23:03:50.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.863+0000 7fa6fcc00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6f80d6810 con 0x7fa6f817f490 2024-02-21T23:03:50.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.863+0000 7fa6f7e00640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fa6f818b4f0 0x7fa6f8189150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:49942/0 (socket says 172.21.15.99:49942) 2024-02-21T23:03:50.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.863+0000 7fa6f7e00640 1 -- 172.21.15.99:0/2169541158 learned_addr learned my addr 172.21.15.99:0/2169541158 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:03:50.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.863+0000 7fa6f7400640 1 --2- 172.21.15.99:0/2169541158 >> v2:172.21.15.162:3300/0 conn(0x7fa6f817f490 0x7fa6f818ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:50.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.863+0000 7fa6f6000640 1 -- 172.21.15.99:0/2169541158 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2567571582 0 0) 0x7fa6f81614c0 con 0x7fa6f818b4f0 2024-02-21T23:03:50.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.863+0000 7fa6f6000640 1 -- 172.21.15.99:0/2169541158 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6dc003520 con 0x7fa6f818b4f0 2024-02-21T23:03:50.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.864+0000 7fa6f7400640 1 -- 172.21.15.99:0/2169541158 >> v1:172.21.15.181:6789/0 conn(0x7fa6f818b4f0 legacy=0x7fa6f8189150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:50.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.864+0000 7fa6f7400640 1 -- 172.21.15.99:0/2169541158 >> v1:172.21.15.162:6789/0 conn(0x7fa6f818b060 legacy=0x7fa6f8188a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:50.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.864+0000 7fa6f7400640 1 -- 172.21.15.99:0/2169541158 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f80d6af0 con 0x7fa6f817f490 2024-02-21T23:03:50.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.865+0000 7fa6f7400640 1 --2- 172.21.15.99:0/2169541158 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6f817f490 0x7fa6f818ab20 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa6e80097a0 tx=0x7fa6e802b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a704162ede8aed72 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:50.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.865+0000 7fa6f6000640 1 -- 172.21.15.99:0/2169541158 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e8034070 con 0x7fa6f817f490 2024-02-21T23:03:50.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.865+0000 7fa6f6000640 1 -- 172.21.15.99:0/2169541158 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6e8030610 con 0x7fa6f817f490 2024-02-21T23:03:50.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.865+0000 7fa6f6000640 1 -- 172.21.15.99:0/2169541158 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e80309c0 con 0x7fa6f817f490 2024-02-21T23:03:50.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.866+0000 7fa6fcc00640 1 -- 172.21.15.99:0/2169541158 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6f817f490 msgr2=0x7fa6f818ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:50.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.866+0000 7fa6fcc00640 1 --2- 172.21.15.99:0/2169541158 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6f817f490 0x7fa6f818ab20 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa6e80097a0 tx=0x7fa6e802b960 comp rx=0 tx=0).stop 2024-02-21T23:03:50.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.866+0000 7fa6fcc00640 1 -- 172.21.15.99:0/2169541158 shutdown_connections 2024-02-21T23:03:50.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.866+0000 7fa6fcc00640 1 --2- 172.21.15.99:0/2169541158 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6f817f490 0x7fa6f818ab20 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:50.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.866+0000 7fa6fcc00640 1 -- 172.21.15.99:0/2169541158 >> 172.21.15.99:0/2169541158 conn(0x7fa6f80d29b0 msgr2=0x7fa6f80d2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:03:50.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.866+0000 7fa6fcc00640 1 -- 172.21.15.99:0/2169541158 shutdown_connections 2024-02-21T23:03:50.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.866+0000 7fa6fcc00640 1 -- 172.21.15.99:0/2169541158 wait complete. 2024-02-21T23:03:50.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.869+0000 7fa6fcc00640 1 Processor -- start 2024-02-21T23:03:50.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.870+0000 7fa6fcc00640 1 -- start start 2024-02-21T23:03:50.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.872+0000 7fa6fcc00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa6f817f490 0x7fa6f817e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:50.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.872+0000 7fa6fcc00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6f818b060 0x7fa6f815ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:50.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.872+0000 7fa6fcc00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa6f818b4f0 0x7fa6f8220580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:50.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.872+0000 7fa6fcc00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f818a600 con 0x7fa6f818b4f0 2024-02-21T23:03:50.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.872+0000 7fa6fcc00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f818a320 con 0x7fa6f818b060 2024-02-21T23:03:50.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.872+0000 7fa6fcc00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f817f870 con 0x7fa6f817f490 2024-02-21T23:03:50.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.872+0000 7fa6f7400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa6f817f490 0x7fa6f817e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:50.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.872+0000 7fa6f7400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa6f817f490 0x7fa6f817e7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:60460/0 (socket says 172.21.15.99:60460) 2024-02-21T23:03:50.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.872+0000 7fa6f7400640 1 -- 172.21.15.99:0/2565737978 learned_addr learned my addr 172.21.15.99:0/2565737978 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:03:50.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.872+0000 7fa6f6a00640 1 --2- 172.21.15.99:0/2565737978 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6f818b060 0x7fa6f815ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:50.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.872+0000 7fa6f7e00640 1 --2- 172.21.15.99:0/2565737978 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa6f818b4f0 0x7fa6f8220580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:50.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.872+0000 7fa6f7400640 1 -- 172.21.15.99:0/2565737978 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6f818b060 msgr2=0x7fa6f815ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:50.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.873+0000 7fa6f7400640 1 --2- 172.21.15.99:0/2565737978 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6f818b060 0x7fa6f815ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:50.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.873+0000 7fa6f7400640 1 -- 172.21.15.99:0/2565737978 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa6f818b4f0 msgr2=0x7fa6f8220580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:50.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.873+0000 7fa6f7400640 1 --2- 172.21.15.99:0/2565737978 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa6f818b4f0 0x7fa6f8220580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:50.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.873+0000 7fa6f7400640 1 -- 172.21.15.99:0/2565737978 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f806beb0 con 0x7fa6f817f490 2024-02-21T23:03:50.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.873+0000 7fa6f6a00640 1 --2- 172.21.15.99:0/2565737978 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6f818b060 0x7fa6f815ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:03:50.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.873+0000 7fa6f7400640 1 --2- 172.21.15.99:0/2565737978 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa6f817f490 0x7fa6f817e7d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa6e80097a0 tx=0x7fa6e80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:50.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.873+0000 7fa6ef400640 1 -- 172.21.15.99:0/2565737978 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e8034040 con 0x7fa6f817f490 2024-02-21T23:03:50.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.873+0000 7fa6ef400640 1 -- 172.21.15.99:0/2565737978 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6e8030410 con 0x7fa6f817f490 2024-02-21T23:03:50.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.873+0000 7fa6fcc00640 1 -- 172.21.15.99:0/2565737978 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6f806c190 con 0x7fa6f817f490 2024-02-21T23:03:50.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.873+0000 7fa6ef400640 1 -- 172.21.15.99:0/2565737978 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e8004250 con 0x7fa6f817f490 2024-02-21T23:03:50.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.874+0000 7fa6fcc00640 1 -- 172.21.15.99:0/2565737978 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6f806c750 con 0x7fa6f817f490 2024-02-21T23:03:50.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.878+0000 7fa6ef400640 1 -- 172.21.15.99:0/2565737978 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7fa6e8037070 con 0x7fa6f817f490 2024-02-21T23:03:50.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.879+0000 7fa7011e4740 1 Processor -- start 2024-02-21T23:03:50.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.879+0000 7fa7011e4740 1 -- start start 2024-02-21T23:03:50.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.880+0000 7fa6ef400640 1 --2- 172.21.15.99:0/2565737978 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa6d809eed0 0x7fa6d80a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:50.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.880+0000 7fa6ef400640 1 -- 172.21.15.99:0/2565737978 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7fa6e80ebaf0 con 0x7fa6f817f490 2024-02-21T23:03:50.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.881+0000 7fa6f7e00640 1 --2- 172.21.15.99:0/2565737978 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa6d809eed0 0x7fa6d80a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:50.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.881+0000 7fa7011e4740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a16d5c82a0 0x55a16d5fdd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:50.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.882+0000 7fa7011e4740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a16d5fe260 0x55a16d5c8680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:50.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.882+0000 7fa7011e4740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a16d5c8bc0 0x55a16d58b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:50.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.882+0000 7fa7011e4740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a16d4f4a90 con 0x55a16d5fe260 2024-02-21T23:03:50.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.882+0000 7fa7011e4740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a16d49db10 con 0x55a16d5c8bc0 2024-02-21T23:03:50.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.882+0000 7fa7011e4740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a16d4f0b30 con 0x55a16d5c82a0 2024-02-21T23:03:50.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.882+0000 7fa6f6a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a16d5fe260 0x55a16d5c8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:50.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.882+0000 7fa6f6a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a16d5fe260 0x55a16d5c8680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60814/0 (socket says 172.21.15.99:60814) 2024-02-21T23:03:50.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.882+0000 7fa6f6a00640 1 -- 172.21.15.99:0/2465278161 learned_addr learned my addr 172.21.15.99:0/2465278161 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:03:50.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.882+0000 7fa6f7400640 1 --2- 172.21.15.99:0/2465278161 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a16d5c82a0 0x55a16d5fdd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:50.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.882+0000 7fa6f7e00640 1 --2- 172.21.15.99:0/2465278161 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a16d5c8bc0 0x55a16d58b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:50.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.882+0000 7fa6f7400640 1 -- 172.21.15.99:0/2465278161 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a16d5c8bc0 msgr2=0x55a16d58b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:50.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.882+0000 7fa6f7400640 1 --2- 172.21.15.99:0/2465278161 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a16d5c8bc0 0x55a16d58b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:50.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.883+0000 7fa6f7400640 1 -- 172.21.15.99:0/2465278161 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a16d5fe260 msgr2=0x55a16d5c8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:50.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.883+0000 7fa6f7400640 1 --2- 172.21.15.99:0/2465278161 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a16d5fe260 0x55a16d5c8680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:50.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.883+0000 7fa6f7400640 1 -- 172.21.15.99:0/2465278161 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a16d2d37d0 con 0x55a16d5c82a0 2024-02-21T23:03:50.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.883+0000 7fa6f6a00640 1 --2- 172.21.15.99:0/2465278161 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a16d5fe260 0x55a16d5c8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:03:50.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.883+0000 7fa6f7e00640 1 --2- 172.21.15.99:0/2565737978 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa6d809eed0 0x7fa6d80a1390 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa6f0002230 tx=0x7fa6f0001950 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:50.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.883+0000 7fa6f7400640 1 --2- 172.21.15.99:0/2465278161 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a16d5c82a0 0x55a16d5fdd20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa6e80e9100 tx=0x7fa6e80b8e00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa7f3645618dfcab server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:50.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.883+0000 7fa6e3400640 1 -- 172.21.15.99:0/2465278161 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e80bd430 con 0x55a16d5c82a0 2024-02-21T23:03:50.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.884+0000 7fa6e3400640 1 -- 172.21.15.99:0/2465278161 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6e80c1a80 con 0x55a16d5c82a0 2024-02-21T23:03:50.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.884+0000 7fa6e3400640 1 -- 172.21.15.99:0/2465278161 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e80bd0c0 con 0x55a16d5c82a0 2024-02-21T23:03:50.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.885+0000 7fa7011e4740 1 -- 172.21.15.99:0/2465278161 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a16d5c82a0 msgr2=0x55a16d5fdd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:50.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.885+0000 7fa7011e4740 1 --2- 172.21.15.99:0/2465278161 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a16d5c82a0 0x55a16d5fdd20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa6e80e9100 tx=0x7fa6e80b8e00 comp rx=0 tx=0).stop 2024-02-21T23:03:50.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.885+0000 7fa7011e4740 1 -- 172.21.15.99:0/2465278161 shutdown_connections 2024-02-21T23:03:50.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.885+0000 7fa7011e4740 1 --2- 172.21.15.99:0/2465278161 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a16d5c8bc0 0x55a16d58b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:50.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.885+0000 7fa7011e4740 1 --2- 172.21.15.99:0/2465278161 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a16d5fe260 0x55a16d5c8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:50.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.885+0000 7fa7011e4740 1 --2- 172.21.15.99:0/2465278161 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a16d5c82a0 0x55a16d5fdd20 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:50.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.885+0000 7fa7011e4740 1 -- 172.21.15.99:0/2465278161 >> 172.21.15.99:0/2465278161 conn(0x55a16d5576b0 msgr2=0x55a16d58f190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:03:50.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.885+0000 7fa7011e4740 1 -- 172.21.15.99:0/2465278161 shutdown_connections 2024-02-21T23:03:50.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.885+0000 7fa7011e4740 1 -- 172.21.15.99:0/2465278161 wait complete. 2024-02-21T23:03:50.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.886+0000 7fa7011e4740 1 -- start start 2024-02-21T23:03:50.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.886+0000 7fa7011e4740 1 Processor -- start 2024-02-21T23:03:50.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.889+0000 7fa7011e4740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a16d5c82a0 0x55a16d60ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:50.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.889+0000 7fa7011e4740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a16d5c8bc0 0x55a16d5c67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:50.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.889+0000 7fa7011e4740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a16d5fe260 0x55a16d5be190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:50.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.889+0000 7fa7011e4740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a16d596f30 con 0x55a16d5fe260 2024-02-21T23:03:50.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.889+0000 7fa7011e4740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a16d4931c0 con 0x55a16d5c82a0 2024-02-21T23:03:50.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.889+0000 7fa7011e4740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a16d5ff930 con 0x55a16d5c8bc0 2024-02-21T23:03:50.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.889+0000 7fa7011e4740 10 client.0 _ll_register_callbacks cb 0x55a16d4b0930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:03:50.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.889+0000 7fa6f7e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a16d5fe260 0x55a16d5be190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:50.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.889+0000 7fa6f7400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a16d5c82a0 0x55a16d60ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:50.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.889+0000 7fa6f7400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a16d5c82a0 0x55a16d60ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:36338/0 (socket says 172.21.15.99:36338) 2024-02-21T23:03:50.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.889+0000 7fa6f7400640 1 -- 172.21.15.99:0/3980461324 learned_addr learned my addr 172.21.15.99:0/3980461324 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:03:50.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.890+0000 7fa6f6a00640 1 --2- 172.21.15.99:0/3980461324 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a16d5c8bc0 0x55a16d5c67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:50.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.890+0000 7fa6f7400640 1 -- 172.21.15.99:0/3980461324 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a16d5c8bc0 msgr2=0x55a16d5c67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:50.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.890+0000 7fa6f7400640 1 --2- 172.21.15.99:0/3980461324 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a16d5c8bc0 0x55a16d5c67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:50.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.890+0000 7fa6f7400640 1 -- 172.21.15.99:0/3980461324 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a16d5fe260 msgr2=0x55a16d5be190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:50.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.890+0000 7fa6f7400640 1 --2- 172.21.15.99:0/3980461324 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a16d5fe260 0x55a16d5be190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:50.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.890+0000 7fa6f7400640 1 -- 172.21.15.99:0/3980461324 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a16d2093f0 con 0x55a16d5c82a0 2024-02-21T23:03:50.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.890+0000 7fa6f6a00640 1 --2- 172.21.15.99:0/3980461324 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a16d5c8bc0 0x55a16d5c67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T23:03:50.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.890+0000 7fa6f7e00640 1 --2- 172.21.15.99:0/3980461324 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a16d5fe260 0x55a16d5be190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:03:50.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.890+0000 7fa6f7400640 1 --2- 172.21.15.99:0/3980461324 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a16d5c82a0 0x55a16d60ffa0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa6e802bf70 tx=0x7fa6e80a4040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3caaf5ac85230ae4 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:50.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.890+0000 7fa6d7e00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-02-21T23:03:50.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.890+0000 7fa6d7e00640 1 -- 172.21.15.99:0/3980461324 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e80bd090 con 0x55a16d5c82a0 2024-02-21T23:03:50.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.890+0000 7fa6d7e00640 1 -- 172.21.15.99:0/3980461324 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7fa6e80d6b40 con 0x55a16d5c82a0 2024-02-21T23:03:50.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.890+0000 7fa7011e4740 1 -- 172.21.15.99:0/3980461324 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa6e80c1a80 con 0x55a16d5c82a0 2024-02-21T23:03:50.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.891+0000 7fa6d7e00640 1 -- 172.21.15.99:0/3980461324 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa6e80bd230 con 0x55a16d5c82a0 2024-02-21T23:03:50.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.891+0000 7fa7011e4740 10 client.5536 fetch_fsmap learned FSMap version 15 2024-02-21T23:03:50.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.891+0000 7fa7011e4740 1 -- 172.21.15.99:0/3980461324 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x55a16d1c90f0 con 0x55a16d5c82a0 2024-02-21T23:03:50.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.891+0000 7fa6d7e00640 1 -- 172.21.15.99:0/3980461324 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6e80c1a80 con 0x55a16d5c82a0 2024-02-21T23:03:50.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.891+0000 7fa6d7e00640 1 -- 172.21.15.99:0/3980461324 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 15) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fa6e802f050 con 0x55a16d5c82a0 2024-02-21T23:03:50.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.891+0000 7fa7011e4740 10 client.5536 fetch_fsmap finished waiting for FSMap version 15 2024-02-21T23:03:50.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.891+0000 7fa7011e4740 10 client.5536 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:03:50.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.891+0000 7fa7011e4740 20 client.5536 populate_metadata read hostname 'smithi099' 2024-02-21T23:03:50.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.891+0000 7fa7011e4740 1 --2- 172.21.15.99:0/3980461324 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55a16d5d4550 0x55a16d5c6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:50.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.891+0000 7fa7011e4740 4 client.5536 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:03:50.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.891+0000 7fa7011e4740 1 -- 172.21.15.99:0/3980461324 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a16d501fd0 con 0x55a16d5d4550 2024-02-21T23:03:50.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.892+0000 7fa6f6a00640 1 --2- 172.21.15.99:0/3980461324 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55a16d5d4550 0x55a16d5c6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:50.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.892+0000 7fa6f6a00640 1 --2- 172.21.15.99:0/3980461324 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55a16d5d4550 0x55a16d5c6ef0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88ab54ac2ddcd573 server_cookie=60a2cc2a3d8a2d82 in_seq=0 out_seq=0 2024-02-21T23:03:50.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.892+0000 7fa6d7e00640 10 client.5536 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:03:50.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.893+0000 7fa6d7e00640 1 -- 172.21.15.99:0/3980461324 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55a16d501fd0 con 0x55a16d5d4550 2024-02-21T23:03:50.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.893+0000 7fa6d7e00640 10 client.5536 handle_command_reply: tid=0 2024-02-21T23:03:50.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.894+0000 7fa7011e4740 1 client.5536 shutdown 2024-02-21T23:03:50.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.894+0000 7fa7011e4740 1 -- 172.21.15.99:0/3980461324 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a16d5c82a0 msgr2=0x55a16d60ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:50.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.894+0000 7fa7011e4740 1 --2- 172.21.15.99:0/3980461324 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a16d5c82a0 0x55a16d60ffa0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa6e802bf70 tx=0x7fa6e80a4040 comp rx=0 tx=0).stop 2024-02-21T23:03:50.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.894+0000 7fa7011e4740 1 -- 172.21.15.99:0/3980461324 shutdown_connections 2024-02-21T23:03:50.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.894+0000 7fa7011e4740 1 --2- 172.21.15.99:0/3980461324 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55a16d5d4550 0x55a16d5c6ef0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:50.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.894+0000 7fa7011e4740 1 --2- 172.21.15.99:0/3980461324 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a16d5fe260 0x55a16d5be190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:50.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.894+0000 7fa7011e4740 1 --2- 172.21.15.99:0/3980461324 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a16d5c8bc0 0x55a16d5c67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:50.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.894+0000 7fa6d7e00640 0 client.5536 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:03:50.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.894+0000 7fa7011e4740 1 --2- 172.21.15.99:0/3980461324 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a16d5c82a0 0x55a16d60ffa0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:50.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.894+0000 7fa7011e4740 1 -- 172.21.15.99:0/3980461324 >> 172.21.15.99:0/3980461324 conn(0x55a16d5576b0 msgr2=0x55a16d58fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:03:50.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.894+0000 7fa7011e4740 1 -- 172.21.15.99:0/3980461324 shutdown_connections 2024-02-21T23:03:50.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.894+0000 7fa7011e4740 1 -- 172.21.15.99:0/3980461324 wait complete. 2024-02-21T23:03:50.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.895+0000 7fa7011e4740 20 client.5536 trim_cache size 0 max 16384 2024-02-21T23:03:50.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.929+0000 7fa7011e4740 1 Processor -- start 2024-02-21T23:03:50.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.930+0000 7fa7011e4740 1 -- start start 2024-02-21T23:03:50.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.931+0000 7fa7011e4740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a16d5c82a0 0x55a16d5cea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:50.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.931+0000 7fa7011e4740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a16d5c8bc0 0x55a16d5ffee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:50.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.932+0000 7fa7011e4740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a16d5fe260 0x55a16d5d1e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:50.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.932+0000 7fa7011e4740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f822c730 con 0x55a16d5c82a0 2024-02-21T23:03:50.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.932+0000 7fa7011e4740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f822a2d0 con 0x55a16d5c8bc0 2024-02-21T23:03:50.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.932+0000 7fa7011e4740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f8228450 con 0x55a16d5fe260 2024-02-21T23:03:50.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.932+0000 7fa6f7400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a16d5c82a0 0x55a16d5cea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:50.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.932+0000 7fa6f7400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a16d5c82a0 0x55a16d5cea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60844/0 (socket says 172.21.15.99:60844) 2024-02-21T23:03:50.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.932+0000 7fa6f7400640 1 -- 172.21.15.99:0/1443660092 learned_addr learned my addr 172.21.15.99:0/1443660092 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:03:50.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.932+0000 7fa6f6a00640 1 --2- 172.21.15.99:0/1443660092 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a16d5c8bc0 0x55a16d5ffee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:50.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.932+0000 7fa6f7e00640 1 --2- 172.21.15.99:0/1443660092 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a16d5fe260 0x55a16d5d1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:50.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.932+0000 7fa6f7400640 1 -- 172.21.15.99:0/1443660092 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a16d5fe260 msgr2=0x55a16d5d1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:50.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.932+0000 7fa6f7400640 1 --2- 172.21.15.99:0/1443660092 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a16d5fe260 0x55a16d5d1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:50.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.932+0000 7fa6f7400640 1 -- 172.21.15.99:0/1443660092 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a16d5c8bc0 msgr2=0x55a16d5ffee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:50.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.932+0000 7fa6f7400640 1 --2- 172.21.15.99:0/1443660092 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a16d5c8bc0 0x55a16d5ffee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:50.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.932+0000 7fa6f7400640 1 -- 172.21.15.99:0/1443660092 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a16d5c7260 con 0x55a16d5c82a0 2024-02-21T23:03:50.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.933+0000 7fa6f7400640 1 --2- 172.21.15.99:0/1443660092 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a16d5c82a0 0x55a16d5cea50 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa6e80b8d10 tx=0x7fa6e804f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41f53ff390a0a97 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:50.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.933+0000 7fa6e2a00640 1 -- 172.21.15.99:0/1443660092 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e80d6b40 con 0x55a16d5c82a0 2024-02-21T23:03:50.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.933+0000 7fa6e2a00640 1 -- 172.21.15.99:0/1443660092 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6e80b5a00 con 0x55a16d5c82a0 2024-02-21T23:03:50.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.933+0000 7fa6e2a00640 1 -- 172.21.15.99:0/1443660092 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e80b8a20 con 0x55a16d5c82a0 2024-02-21T23:03:50.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.934+0000 7fa7011e4740 1 -- 172.21.15.99:0/1443660092 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a16d5c82a0 msgr2=0x55a16d5cea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:50.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.934+0000 7fa7011e4740 1 --2- 172.21.15.99:0/1443660092 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a16d5c82a0 0x55a16d5cea50 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa6e80b8d10 tx=0x7fa6e804f000 comp rx=0 tx=0).stop 2024-02-21T23:03:50.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.934+0000 7fa7011e4740 1 -- 172.21.15.99:0/1443660092 shutdown_connections 2024-02-21T23:03:50.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.934+0000 7fa7011e4740 1 --2- 172.21.15.99:0/1443660092 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a16d5fe260 0x55a16d5d1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:50.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.934+0000 7fa7011e4740 1 --2- 172.21.15.99:0/1443660092 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a16d5c8bc0 0x55a16d5ffee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:50.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.934+0000 7fa7011e4740 1 --2- 172.21.15.99:0/1443660092 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a16d5c82a0 0x55a16d5cea50 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:50.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.934+0000 7fa7011e4740 1 -- 172.21.15.99:0/1443660092 >> 172.21.15.99:0/1443660092 conn(0x55a16d5576b0 msgr2=0x55a16d5897e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:03:50.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.934+0000 7fa7011e4740 1 -- 172.21.15.99:0/1443660092 shutdown_connections 2024-02-21T23:03:50.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.934+0000 7fa7011e4740 1 -- 172.21.15.99:0/1443660092 wait complete. 2024-02-21T23:03:50.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.936+0000 7fa7011e4740 1 -- start start 2024-02-21T23:03:50.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.936+0000 7fa7011e4740 1 Processor -- start 2024-02-21T23:03:50.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.938+0000 7fa7011e4740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a16d5c82a0 0x55a16d5c4a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:50.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.938+0000 7fa7011e4740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a16d5c8bc0 0x55a16d617dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:50.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.938+0000 7fa7011e4740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a16d5fe260 0x55a16d5897e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:50.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.938+0000 7fa7011e4740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f8228a50 con 0x55a16d5c8bc0 2024-02-21T23:03:50.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.938+0000 7fa7011e4740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f8229c70 con 0x55a16d5fe260 2024-02-21T23:03:50.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.938+0000 7fa7011e4740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f8229050 con 0x55a16d5c82a0 2024-02-21T23:03:50.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.938+0000 7fa7011e4740 10 client.0 _ll_register_callbacks cb 0x7fa6e80b5720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:03:50.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.938+0000 7fa6f6a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a16d5c8bc0 0x55a16d617dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:50.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.939+0000 7fa6f6a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a16d5c8bc0 0x55a16d617dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60854/0 (socket says 172.21.15.99:60854) 2024-02-21T23:03:50.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.939+0000 7fa6f6a00640 1 -- 172.21.15.99:0/3005871708 learned_addr learned my addr 172.21.15.99:0/3005871708 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:03:50.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.939+0000 7fa6f7400640 1 --2- 172.21.15.99:0/3005871708 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a16d5c82a0 0x55a16d5c4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:50.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.939+0000 7fa6f7e00640 1 --2- 172.21.15.99:0/3005871708 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a16d5fe260 0x55a16d5897e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:50.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.939+0000 7fa6f7400640 1 -- 172.21.15.99:0/3005871708 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a16d5fe260 msgr2=0x55a16d5897e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:50.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.939+0000 7fa6f7400640 1 --2- 172.21.15.99:0/3005871708 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a16d5fe260 0x55a16d5897e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:50.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.939+0000 7fa6f7400640 1 -- 172.21.15.99:0/3005871708 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a16d5c8bc0 msgr2=0x55a16d617dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:50.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.939+0000 7fa6f7400640 1 --2- 172.21.15.99:0/3005871708 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a16d5c8bc0 0x55a16d617dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:50.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.939+0000 7fa6f7400640 1 -- 172.21.15.99:0/3005871708 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a16d5c4fb0 con 0x55a16d5c82a0 2024-02-21T23:03:50.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.939+0000 7fa6f6a00640 1 --2- 172.21.15.99:0/3005871708 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a16d5c8bc0 0x55a16d617dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:03:50.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.939+0000 7fa6f7400640 1 --2- 172.21.15.99:0/3005871708 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a16d5c82a0 0x55a16d5c4a70 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa6e80e91e0 tx=0x7fa6e8047000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0e5457934d666bd server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:50.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.939+0000 7fa6d7e00640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-02-21T23:03:50.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.940+0000 7fa6d7e00640 1 -- 172.21.15.99:0/3005871708 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e80c1a80 con 0x55a16d5c82a0 2024-02-21T23:03:50.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.940+0000 7fa6d7e00640 1 -- 172.21.15.99:0/3005871708 <== mon.2 v2:172.21.15.181:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7fa6e80b50e0 con 0x55a16d5c82a0 2024-02-21T23:03:50.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.940+0000 7fa7011e4740 1 -- 172.21.15.99:0/3005871708 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa6e80b5a00 con 0x55a16d5c82a0 2024-02-21T23:03:50.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.940+0000 7fa6d7e00640 1 -- 172.21.15.99:0/3005871708 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa6e80b5300 con 0x55a16d5c82a0 2024-02-21T23:03:50.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.940+0000 7fa7011e4740 10 client.5546 fetch_fsmap learned FSMap version 15 2024-02-21T23:03:50.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.940+0000 7fa7011e4740 1 -- 172.21.15.99:0/3005871708 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x55a16d5c4fb0 con 0x55a16d5c82a0 2024-02-21T23:03:50.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.940+0000 7fa6d7e00640 1 -- 172.21.15.99:0/3005871708 <== mon.2 v2:172.21.15.181:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6e80b5a00 con 0x55a16d5c82a0 2024-02-21T23:03:50.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.940+0000 7fa6d7e00640 1 -- 172.21.15.99:0/3005871708 <== mon.2 v2:172.21.15.181:3300/0 5 ==== fsmap(e 15) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fa6e802f070 con 0x55a16d5c82a0 2024-02-21T23:03:50.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.941+0000 7fa7011e4740 10 client.5546 fetch_fsmap finished waiting for FSMap version 15 2024-02-21T23:03:50.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.941+0000 7fa7011e4740 10 client.5546 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:03:50.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.941+0000 7fa7011e4740 20 client.5546 populate_metadata read hostname 'smithi099' 2024-02-21T23:03:50.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.941+0000 7fa7011e4740 1 --2- 172.21.15.99:0/3005871708 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55a16d5fd540 0x55a16d589d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:50.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.941+0000 7fa7011e4740 4 client.5546 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T23:03:50.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.941+0000 7fa7011e4740 1 -- 172.21.15.99:0/3005871708 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55a16d4fc320 con 0x55a16d5fd540 2024-02-21T23:03:50.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.941+0000 7fa6f6a00640 1 --2- 172.21.15.99:0/3005871708 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55a16d5fd540 0x55a16d589d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:50.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.942+0000 7fa6f6a00640 1 --2- 172.21.15.99:0/3005871708 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55a16d5fd540 0x55a16d589d20 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b30132fa5b71b0b7 server_cookie=b8013c13521c2212 in_seq=0 out_seq=0 2024-02-21T23:03:50.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.942+0000 7fa6d7e00640 10 client.5546 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:03:50.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.942+0000 7fa6d7e00640 1 -- 172.21.15.99:0/3005871708 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55a16d4fc320 con 0x55a16d5fd540 2024-02-21T23:03:50.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.942+0000 7fa6d7e00640 10 client.5546 handle_command_reply: tid=0 2024-02-21T23:03:50.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.942+0000 7fa7011e4740 1 client.5546 shutdown 2024-02-21T23:03:50.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.942+0000 7fa7011e4740 1 -- 172.21.15.99:0/3005871708 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a16d5c82a0 msgr2=0x55a16d5c4a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:50.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.942+0000 7fa7011e4740 1 --2- 172.21.15.99:0/3005871708 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a16d5c82a0 0x55a16d5c4a70 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa6e80e91e0 tx=0x7fa6e8047000 comp rx=0 tx=0).stop 2024-02-21T23:03:50.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.942+0000 7fa7011e4740 1 -- 172.21.15.99:0/3005871708 shutdown_connections 2024-02-21T23:03:50.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.942+0000 7fa7011e4740 1 --2- 172.21.15.99:0/3005871708 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55a16d5fd540 0x55a16d589d20 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:50.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.942+0000 7fa7011e4740 1 --2- 172.21.15.99:0/3005871708 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a16d5fe260 0x55a16d5897e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:50.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.942+0000 7fa7011e4740 1 --2- 172.21.15.99:0/3005871708 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a16d5c8bc0 0x55a16d617dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:50.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.942+0000 7fa7011e4740 1 --2- 172.21.15.99:0/3005871708 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a16d5c82a0 0x55a16d5c4a70 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:50.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.942+0000 7fa7011e4740 1 -- 172.21.15.99:0/3005871708 >> 172.21.15.99:0/3005871708 conn(0x55a16d5576b0 msgr2=0x55a16d58a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:03:50.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.942+0000 7fa6d7e00640 0 client.5546 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:03:50.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.943+0000 7fa7011e4740 1 -- 172.21.15.99:0/3005871708 shutdown_connections 2024-02-21T23:03:50.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.943+0000 7fa7011e4740 1 -- 172.21.15.99:0/3005871708 wait complete. 2024-02-21T23:03:50.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.943+0000 7fa7011e4740 20 client.5546 trim_cache size 0 max 16384 2024-02-21T23:03:50.934 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-02-21T23:03:50.935 INFO:teuthology.orchestra.run.smithi099.stdout: "status": "no active scrubs running", 2024-02-21T23:03:50.935 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubs": {} 2024-02-21T23:03:50.935 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-02-21T23:03:50.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.944+0000 7fa6fcc00640 1 -- 172.21.15.99:0/2565737978 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa6d809eed0 msgr2=0x7fa6d80a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:50.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.944+0000 7fa6fcc00640 1 --2- 172.21.15.99:0/2565737978 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa6d809eed0 0x7fa6d80a1390 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa6f0002230 tx=0x7fa6f0001950 comp rx=0 tx=0).stop 2024-02-21T23:03:50.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.944+0000 7fa6fcc00640 1 -- 172.21.15.99:0/2565737978 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa6f817f490 msgr2=0x7fa6f817e7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:50.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.944+0000 7fa6fcc00640 1 --2- 172.21.15.99:0/2565737978 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa6f817f490 0x7fa6f817e7d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa6e80097a0 tx=0x7fa6e80046c0 comp rx=0 tx=0).stop 2024-02-21T23:03:50.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.944+0000 7fa6fcc00640 1 -- 172.21.15.99:0/2565737978 shutdown_connections 2024-02-21T23:03:50.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.944+0000 7fa6fcc00640 1 --2- 172.21.15.99:0/2565737978 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa6d809eed0 0x7fa6d80a1390 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:50.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.944+0000 7fa6fcc00640 1 --2- 172.21.15.99:0/2565737978 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa6f818b4f0 0x7fa6f8220580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:50.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.944+0000 7fa6fcc00640 1 --2- 172.21.15.99:0/2565737978 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6f818b060 0x7fa6f815ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:50.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.944+0000 7fa6fcc00640 1 --2- 172.21.15.99:0/2565737978 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa6f817f490 0x7fa6f817e7d0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:50.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.944+0000 7fa6fcc00640 1 -- 172.21.15.99:0/2565737978 >> 172.21.15.99:0/2565737978 conn(0x7fa6f80d29b0 msgr2=0x7fa6f80912d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:03:50.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.944+0000 7fa6fcc00640 1 -- 172.21.15.99:0/2565737978 shutdown_connections 2024-02-21T23:03:50.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:50.944+0000 7fa6fcc00640 1 -- 172.21.15.99:0/2565737978 wait complete. 2024-02-21T23:03:50.955 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-02-21T23:03:50.955 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T23:03:51.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.189+0000 7f760b800640 1 Processor -- start 2024-02-21T23:03:51.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.190+0000 7f760b800640 1 -- start start 2024-02-21T23:03:51.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.192+0000 7f760b800640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f76041861e0 0x7f76041865c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:51.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.192+0000 7f760b800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7604187a80 0x7f7604187f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:51.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.192+0000 7f760b800640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76040cf7e0 con 0x7f7604188450 2024-02-21T23:03:51.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.192+0000 7f760b800640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7604186d50 con 0x7f7604187a80 2024-02-21T23:03:51.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.192+0000 7f760b800640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76041875f0 con 0x7f76041861e0 2024-02-21T23:03:51.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.193+0000 7f7608e00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f76041861e0 0x7f76041865c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:51.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.193+0000 7f7609800640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f7604188450 0x7f760418c3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:49946/0 (socket says 172.21.15.99:49946) 2024-02-21T23:03:51.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.193+0000 7f7603e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7604187a80 0x7f7604187f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:51.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.193+0000 7f7609800640 1 -- 172.21.15.99:0/2674367932 learned_addr learned my addr 172.21.15.99:0/2674367932 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:03:51.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.193+0000 7f7608e00640 1 -- 172.21.15.99:0/2674367932 >> v2:172.21.15.99:3300/0 conn(0x7f7604187a80 msgr2=0x7f7604187f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:51.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.193+0000 7f7608e00640 1 --2- 172.21.15.99:0/2674367932 >> v2:172.21.15.99:3300/0 conn(0x7f7604187a80 0x7f7604187f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:51.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.193+0000 7f7608e00640 1 -- 172.21.15.99:0/2674367932 >> v1:172.21.15.181:6789/0 conn(0x7f7604188450 legacy=0x7f760418c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:51.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.193+0000 7f7608e00640 1 -- 172.21.15.99:0/2674367932 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76040cfac0 con 0x7f76041861e0 2024-02-21T23:03:51.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.193+0000 7f7603400640 1 -- 172.21.15.99:0/2674367932 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1289871765 0 0) 0x7f76040cf7e0 con 0x7f7604188450 2024-02-21T23:03:51.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.195+0000 7f7608e00640 1 --2- 172.21.15.99:0/2674367932 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f76041861e0 0x7f76041865c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f760408d4b0 tx=0x7f75f802b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab695a5f75b5bb1f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:51.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.195+0000 7f7603400640 1 -- 172.21.15.99:0/2674367932 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f80315a0 con 0x7f76041861e0 2024-02-21T23:03:51.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.195+0000 7f7603400640 1 -- 172.21.15.99:0/2674367932 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75f8037070 con 0x7f76041861e0 2024-02-21T23:03:51.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.195+0000 7f7603400640 1 -- 172.21.15.99:0/2674367932 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f8031960 con 0x7f76041861e0 2024-02-21T23:03:51.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.196+0000 7f760b800640 1 -- 172.21.15.99:0/2674367932 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f76041861e0 msgr2=0x7f76041865c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:51.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.196+0000 7f760b800640 1 --2- 172.21.15.99:0/2674367932 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f76041861e0 0x7f76041865c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f760408d4b0 tx=0x7f75f802b840 comp rx=0 tx=0).stop 2024-02-21T23:03:51.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.196+0000 7f760b800640 1 -- 172.21.15.99:0/2674367932 shutdown_connections 2024-02-21T23:03:51.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.196+0000 7f760b800640 1 --2- 172.21.15.99:0/2674367932 >> v2:172.21.15.99:3300/0 conn(0x7f7604187a80 0x7f7604187f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:51.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.196+0000 7f760b800640 1 --2- 172.21.15.99:0/2674367932 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f76041861e0 0x7f76041865c0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:51.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.196+0000 7f760b800640 1 -- 172.21.15.99:0/2674367932 >> 172.21.15.99:0/2674367932 conn(0x7f76040d6ac0 msgr2=0x7f76040740b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:03:51.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.196+0000 7f760b800640 1 -- 172.21.15.99:0/2674367932 shutdown_connections 2024-02-21T23:03:51.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.196+0000 7f760b800640 1 -- 172.21.15.99:0/2674367932 wait complete. 2024-02-21T23:03:51.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.198+0000 7f760b800640 1 Processor -- start 2024-02-21T23:03:51.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.198+0000 7f760b800640 1 -- start start 2024-02-21T23:03:51.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.200+0000 7f760b800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f76041861e0 0x7f7604177b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:51.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.200+0000 7f760b800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7604187a80 0x7f760416aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:51.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.200+0000 7f760b800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7604188450 0x7f76040d3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:51.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.200+0000 7f760b800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76040d5310 con 0x7f7604187a80 2024-02-21T23:03:51.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.200+0000 7f760b800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7604187280 con 0x7f7604188450 2024-02-21T23:03:51.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.200+0000 7f760b800640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76040d5490 con 0x7f76041861e0 2024-02-21T23:03:51.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.200+0000 7f7603e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7604187a80 0x7f760416aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:51.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.200+0000 7f7603e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7604187a80 0x7f760416aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60878/0 (socket says 172.21.15.99:60878) 2024-02-21T23:03:51.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.200+0000 7f7603e00640 1 -- 172.21.15.99:0/1369423388 learned_addr learned my addr 172.21.15.99:0/1369423388 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:03:51.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.200+0000 7f7608e00640 1 --2- 172.21.15.99:0/1369423388 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f76041861e0 0x7f7604177b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:51.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.200+0000 7f7609800640 1 --2- 172.21.15.99:0/1369423388 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7604188450 0x7f76040d3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:51.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.200+0000 7f7603e00640 1 -- 172.21.15.99:0/1369423388 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f76041861e0 msgr2=0x7f7604177b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:51.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.200+0000 7f7603e00640 1 --2- 172.21.15.99:0/1369423388 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f76041861e0 0x7f7604177b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:51.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.200+0000 7f7603e00640 1 -- 172.21.15.99:0/1369423388 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7604188450 msgr2=0x7f76040d3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:51.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.200+0000 7f7603e00640 1 --2- 172.21.15.99:0/1369423388 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7604188450 0x7f76040d3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:51.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.200+0000 7f7603e00640 1 -- 172.21.15.99:0/1369423388 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76040d0cb0 con 0x7f7604187a80 2024-02-21T23:03:51.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.200+0000 7f7609800640 1 --2- 172.21.15.99:0/1369423388 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7604188450 0x7f76040d3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:03:51.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.201+0000 7f7608e00640 1 --2- 172.21.15.99:0/1369423388 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f76041861e0 0x7f7604177b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:03:51.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.201+0000 7f7603e00640 1 --2- 172.21.15.99:0/1369423388 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7604187a80 0x7f760416aee0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f75f000e9b0 tx=0x7f75f000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:51.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.201+0000 7f7600c00640 1 -- 172.21.15.99:0/1369423388 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f0017070 con 0x7f7604187a80 2024-02-21T23:03:51.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.201+0000 7f7600c00640 1 -- 172.21.15.99:0/1369423388 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75f000c9a0 con 0x7f7604187a80 2024-02-21T23:03:51.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.201+0000 7f760b800640 1 -- 172.21.15.99:0/1369423388 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76040d0f50 con 0x7f7604187a80 2024-02-21T23:03:51.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.201+0000 7f7600c00640 1 -- 172.21.15.99:0/1369423388 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f000cd90 con 0x7f7604187a80 2024-02-21T23:03:51.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.201+0000 7f760b800640 1 -- 172.21.15.99:0/1369423388 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76040d1510 con 0x7f7604187a80 2024-02-21T23:03:51.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.203+0000 7f760b800640 1 -- 172.21.15.99:0/1369423388 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76040d3870 con 0x7f7604187a80 2024-02-21T23:03:51.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.206+0000 7f7600c00640 1 -- 172.21.15.99:0/1369423388 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f75f001a070 con 0x7f7604187a80 2024-02-21T23:03:51.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.207+0000 7f7600c00640 1 --2- 172.21.15.99:0/1369423388 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f75e409eed0 0x7f75e40a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:51.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.207+0000 7f7600c00640 1 -- 172.21.15.99:0/1369423388 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f75f00ca520 con 0x7f7604187a80 2024-02-21T23:03:51.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.207+0000 7f7608e00640 1 --2- 172.21.15.99:0/1369423388 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f75e409eed0 0x7f75e40a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:51.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.208+0000 7f7608e00640 1 --2- 172.21.15.99:0/1369423388 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f75e409eed0 0x7f75e40a1390 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f75f8036000 tx=0x7f75f8008030 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:51.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.211+0000 7f7600c00640 1 -- 172.21.15.99:0/1369423388 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f75f00985b0 con 0x7f7604187a80 2024-02-21T23:03:51.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.565+0000 7f760b800640 1 -- 172.21.15.99:0/1369423388 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f760417da10 con 0x7f7604187a80 2024-02-21T23:03:51.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.566+0000 7f7600c00640 1 -- 172.21.15.99:0/1369423388 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+11335 (secure 0 0 0) 0x7f75f0097eb0 con 0x7f7604187a80 2024-02-21T23:03:51.555 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T23:03:51.555 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4307,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/3514452812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3514452812},{"type":"v1","addr":"172.21.15.162:6836","nonce":3514452812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4312,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6838/2169982089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":2169982089},{"type":"v1","addr":"172.21.15.162:6838","nonce":2169982089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4315,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6839/3335972724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6837","nonce":3335972724},{"type":"v1","addr":"172.21.15.162:6839","nonce":3335972724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4318,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6841/2135456697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6840","nonce":2135456697},{"type":"v1","addr":"172.21.15.162:6841","nonce":2135456697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4325,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2452242758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2452242758},{"type":"v1","addr":"172.21.15.181:6833","nonce":2452242758}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4328,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6836/2751486400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":2751486400},{"type":"v1","addr":"172.21.15.181:6836","nonce":2751486400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":15,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-21T23:01:02.656130+0000","modified":"2024-02-21T23:01:57.191106+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4355,"mds_1":4352,"mds_2":4348},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4331":{"gid":4331,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6838/3728901330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6835","nonce":3728901330},{"type":"v1","addr":"172.21.15.181:6838","nonce":3728901330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4339":{"gid":4339,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6839/3357929641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6837","nonce":3357929641},{"type":"v1","addr":"172.21.15.181:6839","nonce":3357929641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4343":{"gid":4343,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6833/2793485078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":2793485078},{"type":"v1","addr":"172.21.15.99:6833","nonce":2793485078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4348":{"gid":4348,"name":"d","rank":2,"incarnation":12,"state":"up:active","state_seq":10,"addr":"172.21.15.99:6835/2243461688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2243461688},{"type":"v1","addr":"172.21.15.99:6835","nonce":2243461688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4352":{"gid":4352,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.99:6837/1676159950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":1676159950},{"type":"v1","addr":"172.21.15.99:6837","nonce":1676159950}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4355":{"gid":4355,"name":"j","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6839/4239008786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":4239008786},{"type":"v1","addr":"172.21.15.99:6839","nonce":4239008786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-21T23:03:51.555 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 15 2024-02-21T23:03:51.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.568+0000 7f760b800640 1 -- 172.21.15.99:0/1369423388 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f75e409eed0 msgr2=0x7f75e40a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:51.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.568+0000 7f760b800640 1 --2- 172.21.15.99:0/1369423388 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f75e409eed0 0x7f75e40a1390 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f75f8036000 tx=0x7f75f8008030 comp rx=0 tx=0).stop 2024-02-21T23:03:51.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.568+0000 7f760b800640 1 -- 172.21.15.99:0/1369423388 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7604187a80 msgr2=0x7f760416aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:51.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.568+0000 7f760b800640 1 --2- 172.21.15.99:0/1369423388 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7604187a80 0x7f760416aee0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f75f000e9b0 tx=0x7f75f000ee70 comp rx=0 tx=0).stop 2024-02-21T23:03:51.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.568+0000 7f760b800640 1 -- 172.21.15.99:0/1369423388 shutdown_connections 2024-02-21T23:03:51.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.568+0000 7f760b800640 1 --2- 172.21.15.99:0/1369423388 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f75e409eed0 0x7f75e40a1390 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:51.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.569+0000 7f760b800640 1 --2- 172.21.15.99:0/1369423388 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7604188450 0x7f76040d3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:51.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.569+0000 7f760b800640 1 --2- 172.21.15.99:0/1369423388 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7604187a80 0x7f760416aee0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:51.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.569+0000 7f760b800640 1 --2- 172.21.15.99:0/1369423388 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f76041861e0 0x7f7604177b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:51.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.569+0000 7f760b800640 1 -- 172.21.15.99:0/1369423388 >> 172.21.15.99:0/1369423388 conn(0x7f76040d6ac0 msgr2=0x7f76041865c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:03:51.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.569+0000 7f760b800640 1 -- 172.21.15.99:0/1369423388 shutdown_connections 2024-02-21T23:03:51.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.569+0000 7f760b800640 1 -- 172.21.15.99:0/1369423388 wait complete. 2024-02-21T23:03:51.574 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T23:03:51.575 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-02-21T23:03:51.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.782+0000 7f9fe5000640 1 Processor -- start 2024-02-21T23:03:51.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.783+0000 7f9fe5000640 1 -- start start 2024-02-21T23:03:51.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.785+0000 7f9fe5000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f9fe017f490 0x7f9fe018ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:51.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.786+0000 7f9fe5000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fe00d6dd0 con 0x7f9fe018b060 2024-02-21T23:03:51.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.786+0000 7f9fe5000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fe01614c0 con 0x7f9fe018b4f0 2024-02-21T23:03:51.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.786+0000 7f9fe5000640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fe00d6810 con 0x7f9fe017f490 2024-02-21T23:03:51.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.786+0000 7f9fdf400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f9fe017f490 0x7f9fe018ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:51.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.786+0000 7f9fdea00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f9fe018b060 0x7f9fe0188a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:50172/0 (socket says 172.21.15.99:50172) 2024-02-21T23:03:51.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.786+0000 7f9fdea00640 1 -- 172.21.15.99:0/2388917161 learned_addr learned my addr 172.21.15.99:0/2388917161 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:03:51.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.786+0000 7f9fde000640 1 -- 172.21.15.99:0/2388917161 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3047477743 0 0) 0x7f9fe00d6dd0 con 0x7f9fe018b060 2024-02-21T23:03:51.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.786+0000 7f9fde000640 1 -- 172.21.15.99:0/2388917161 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9fc4003520 con 0x7f9fe018b060 2024-02-21T23:03:51.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.787+0000 7f9fdf400640 1 -- 172.21.15.99:0/2388917161 >> v1:172.21.15.162:6789/0 conn(0x7f9fe018b4f0 legacy=0x7f9fe0189150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:51.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.787+0000 7f9fde000640 1 -- 172.21.15.99:0/2388917161 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1997337220 0 0) 0x7f9fe01614c0 con 0x7f9fe018b4f0 2024-02-21T23:03:51.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.787+0000 7f9fdf400640 1 -- 172.21.15.99:0/2388917161 >> v1:172.21.15.99:6789/0 conn(0x7f9fe018b060 legacy=0x7f9fe0188a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:51.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.787+0000 7f9fdf400640 1 -- 172.21.15.99:0/2388917161 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe00d6af0 con 0x7f9fe017f490 2024-02-21T23:03:51.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.788+0000 7f9fdf400640 1 --2- 172.21.15.99:0/2388917161 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9fe017f490 0x7f9fe018ab20 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f9fd00097a0 tx=0x7f9fd002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92092fcdea209ce3 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:51.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.788+0000 7f9fde000640 1 -- 172.21.15.99:0/2388917161 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd0034070 con 0x7f9fe017f490 2024-02-21T23:03:51.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.788+0000 7f9fde000640 1 -- 172.21.15.99:0/2388917161 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fd0030610 con 0x7f9fe017f490 2024-02-21T23:03:51.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.788+0000 7f9fde000640 1 -- 172.21.15.99:0/2388917161 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd00309e0 con 0x7f9fe017f490 2024-02-21T23:03:51.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.789+0000 7f9fe5000640 1 -- 172.21.15.99:0/2388917161 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9fe017f490 msgr2=0x7f9fe018ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:51.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.789+0000 7f9fe5000640 1 --2- 172.21.15.99:0/2388917161 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9fe017f490 0x7f9fe018ab20 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f9fd00097a0 tx=0x7f9fd002b960 comp rx=0 tx=0).stop 2024-02-21T23:03:51.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.789+0000 7f9fe5000640 1 -- 172.21.15.99:0/2388917161 shutdown_connections 2024-02-21T23:03:51.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.789+0000 7f9fe5000640 1 --2- 172.21.15.99:0/2388917161 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9fe017f490 0x7f9fe018ab20 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:51.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.789+0000 7f9fe5000640 1 -- 172.21.15.99:0/2388917161 >> 172.21.15.99:0/2388917161 conn(0x7f9fe00d29b0 msgr2=0x7f9fe00d2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:03:51.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.789+0000 7f9fe5000640 1 -- 172.21.15.99:0/2388917161 shutdown_connections 2024-02-21T23:03:51.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.789+0000 7f9fe5000640 1 -- 172.21.15.99:0/2388917161 wait complete. 2024-02-21T23:03:51.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.791+0000 7f9fe5000640 1 Processor -- start 2024-02-21T23:03:51.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.791+0000 7f9fe5000640 1 -- start start 2024-02-21T23:03:51.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.792+0000 7f9fe5000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9fe017f490 0x7f9fe01748a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:51.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.792+0000 7f9fe5000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9fe018b060 0x7f9fe00f3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:51.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.793+0000 7f9fe5000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9fe018b4f0 0x7f9fe017cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:51.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.793+0000 7f9fe5000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe018a600 con 0x7f9fe017f490 2024-02-21T23:03:51.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.793+0000 7f9fe5000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe018a320 con 0x7f9fe018b4f0 2024-02-21T23:03:51.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.793+0000 7f9fe5000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe017f870 con 0x7f9fe018b060 2024-02-21T23:03:51.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.793+0000 7f9fdf400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9fe017f490 0x7f9fe01748a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:51.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.793+0000 7f9fdf400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9fe017f490 0x7f9fe01748a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60884/0 (socket says 172.21.15.99:60884) 2024-02-21T23:03:51.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.793+0000 7f9fdea00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9fe018b060 0x7f9fe00f3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:51.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.793+0000 7f9fdf400640 1 -- 172.21.15.99:0/1338823816 learned_addr learned my addr 172.21.15.99:0/1338823816 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:03:51.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.793+0000 7f9fdfe00640 1 --2- 172.21.15.99:0/1338823816 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9fe018b4f0 0x7f9fe017cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:51.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.793+0000 7f9fdf400640 1 -- 172.21.15.99:0/1338823816 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9fe018b060 msgr2=0x7f9fe00f3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:51.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.793+0000 7f9fdf400640 1 --2- 172.21.15.99:0/1338823816 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9fe018b060 0x7f9fe00f3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:51.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.793+0000 7f9fdf400640 1 -- 172.21.15.99:0/1338823816 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9fe018b4f0 msgr2=0x7f9fe017cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:51.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.793+0000 7f9fdf400640 1 --2- 172.21.15.99:0/1338823816 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9fe018b4f0 0x7f9fe017cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:51.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.793+0000 7f9fdf400640 1 -- 172.21.15.99:0/1338823816 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe00f4f00 con 0x7f9fe017f490 2024-02-21T23:03:51.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.793+0000 7f9fdea00640 1 --2- 172.21.15.99:0/1338823816 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9fe018b060 0x7f9fe00f3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:03:51.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.794+0000 7f9fdf400640 1 --2- 172.21.15.99:0/1338823816 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9fe017f490 0x7f9fe01748a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f9fd002bf70 tx=0x7f9fd00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:51.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.794+0000 7f9fd7400640 1 -- 172.21.15.99:0/1338823816 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd0049070 con 0x7f9fe017f490 2024-02-21T23:03:51.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.794+0000 7f9fd7400640 1 -- 172.21.15.99:0/1338823816 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fd0030410 con 0x7f9fe017f490 2024-02-21T23:03:51.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.794+0000 7f9fd7400640 1 -- 172.21.15.99:0/1338823816 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd0034040 con 0x7f9fe017f490 2024-02-21T23:03:51.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.794+0000 7f9fe5000640 1 -- 172.21.15.99:0/1338823816 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fe00f40a0 con 0x7f9fe017f490 2024-02-21T23:03:51.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.794+0000 7f9fe5000640 1 -- 172.21.15.99:0/1338823816 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fe00f4660 con 0x7f9fe017f490 2024-02-21T23:03:51.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.799+0000 7f9fd7400640 1 -- 172.21.15.99:0/1338823816 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f9fd004c070 con 0x7f9fe017f490 2024-02-21T23:03:51.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.799+0000 7f9fe9461740 1 Processor -- start 2024-02-21T23:03:51.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.799+0000 7f9fe9461740 1 -- start start 2024-02-21T23:03:51.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.801+0000 7f9fd7400640 1 --2- 172.21.15.99:0/1338823816 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f9fc009ef00 0x7f9fc00a13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:51.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.801+0000 7f9fd7400640 1 -- 172.21.15.99:0/1338823816 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f9fd00ebab0 con 0x7f9fe017f490 2024-02-21T23:03:51.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.801+0000 7f9fe9461740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5618262c7a40 0x5618262ce340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:51.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.801+0000 7f9fe9461740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5618262c7e20 0x5618262875e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:51.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.801+0000 7f9fdfe00640 1 --2- 172.21.15.99:0/1338823816 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f9fc009ef00 0x7f9fc00a13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:51.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.801+0000 7f9fe9461740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561826303790 0x561826303c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:51.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.801+0000 7f9fe9461740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618261ebb50 con 0x5618262c7a40 2024-02-21T23:03:51.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.801+0000 7f9fe9461740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x561826194da0 con 0x5618262c7e20 2024-02-21T23:03:51.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.801+0000 7f9fe9461740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618261e7bf0 con 0x561826303790 2024-02-21T23:03:51.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.802+0000 7f9fdea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5618262c7e20 0x5618262875e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:51.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.802+0000 7f9fdea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5618262c7e20 0x5618262875e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:36396/0 (socket says 172.21.15.99:36396) 2024-02-21T23:03:51.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.802+0000 7f9fdea00640 1 -- 172.21.15.99:0/1330573833 learned_addr learned my addr 172.21.15.99:0/1330573833 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:03:51.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.802+0000 7f9fdfe00640 1 --2- 172.21.15.99:0/1330573833 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561826303790 0x561826303c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:51.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.802+0000 7f9fdf400640 1 --2- 172.21.15.99:0/1330573833 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5618262c7a40 0x5618262ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:51.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.802+0000 7f9fdea00640 1 -- 172.21.15.99:0/1330573833 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561826303790 msgr2=0x561826303c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:51.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.802+0000 7f9fdea00640 1 --2- 172.21.15.99:0/1330573833 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561826303790 0x561826303c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:51.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.802+0000 7f9fdea00640 1 -- 172.21.15.99:0/1330573833 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5618262c7a40 msgr2=0x5618262ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:51.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.802+0000 7f9fdea00640 1 --2- 172.21.15.99:0/1330573833 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5618262c7a40 0x5618262ce340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:51.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.802+0000 7f9fdea00640 1 -- 172.21.15.99:0/1330573833 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5618261b7f80 con 0x5618262c7e20 2024-02-21T23:03:51.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.802+0000 7f9fdfe00640 1 --2- 172.21.15.99:0/1338823816 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f9fc009ef00 0x7f9fc00a13c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9fd8007fd0 tx=0x7f9fd80020f0 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:51.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.803+0000 7f9fdea00640 1 --2- 172.21.15.99:0/1330573833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5618262c7e20 0x5618262875e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc006ed0 tx=0x7f9fcc001a50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d115f5822cfde489 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:51.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.803+0000 7f9fcbe00640 1 -- 172.21.15.99:0/1330573833 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fcc007740 con 0x5618262c7e20 2024-02-21T23:03:51.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.803+0000 7f9fcbe00640 1 -- 172.21.15.99:0/1330573833 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fcc018070 con 0x5618262c7e20 2024-02-21T23:03:51.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.803+0000 7f9fcbe00640 1 -- 172.21.15.99:0/1330573833 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fcc0135f0 con 0x5618262c7e20 2024-02-21T23:03:51.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.804+0000 7f9fe9461740 1 -- 172.21.15.99:0/1330573833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5618262c7e20 msgr2=0x5618262875e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:51.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.804+0000 7f9fe9461740 1 --2- 172.21.15.99:0/1330573833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5618262c7e20 0x5618262875e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc006ed0 tx=0x7f9fcc001a50 comp rx=0 tx=0).stop 2024-02-21T23:03:51.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.804+0000 7f9fe9461740 1 -- 172.21.15.99:0/1330573833 shutdown_connections 2024-02-21T23:03:51.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.804+0000 7f9fe9461740 1 --2- 172.21.15.99:0/1330573833 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561826303790 0x561826303c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:51.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.804+0000 7f9fe9461740 1 --2- 172.21.15.99:0/1330573833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5618262c7e20 0x5618262875e0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:51.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.804+0000 7f9fe9461740 1 --2- 172.21.15.99:0/1330573833 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5618262c7a40 0x5618262ce340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:51.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.804+0000 7f9fe9461740 1 -- 172.21.15.99:0/1330573833 >> 172.21.15.99:0/1330573833 conn(0x5618262856d0 msgr2=0x561826286750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:03:51.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.804+0000 7f9fe9461740 1 -- 172.21.15.99:0/1330573833 shutdown_connections 2024-02-21T23:03:51.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.804+0000 7f9fe9461740 1 -- 172.21.15.99:0/1330573833 wait complete. 2024-02-21T23:03:51.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.806+0000 7f9fe9461740 1 -- start start 2024-02-21T23:03:51.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.806+0000 7f9fe9461740 1 Processor -- start 2024-02-21T23:03:51.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.808+0000 7f9fe9461740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5618262c7e20 0x5618262ba8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:51.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.808+0000 7f9fe9461740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561826303790 0x5618262b5650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:51.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.808+0000 7f9fe9461740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5618262cd200 0x5618263102b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:51.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.808+0000 7f9fe9461740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x561826302730 con 0x5618262c7e20 2024-02-21T23:03:51.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.808+0000 7f9fe9461740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x56182618a380 con 0x561826303790 2024-02-21T23:03:51.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.808+0000 7f9fe9461740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618262ce880 con 0x5618262cd200 2024-02-21T23:03:51.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.808+0000 7f9fe9461740 10 client.0 _ll_register_callbacks cb 0x5618261e3280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:03:51.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.808+0000 7f9fdf400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5618262c7e20 0x5618262ba8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:51.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.808+0000 7f9fdf400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5618262c7e20 0x5618262ba8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60898/0 (socket says 172.21.15.99:60898) 2024-02-21T23:03:51.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.808+0000 7f9fdf400640 1 -- 172.21.15.99:0/1023462349 learned_addr learned my addr 172.21.15.99:0/1023462349 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:03:51.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.809+0000 7f9fdfe00640 1 --2- 172.21.15.99:0/1023462349 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5618262cd200 0x5618263102b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:51.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.809+0000 7f9fdea00640 1 --2- 172.21.15.99:0/1023462349 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561826303790 0x5618262b5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:51.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.809+0000 7f9fdf400640 1 -- 172.21.15.99:0/1023462349 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5618262cd200 msgr2=0x5618263102b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:51.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.809+0000 7f9fdf400640 1 --2- 172.21.15.99:0/1023462349 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5618262cd200 0x5618263102b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:51.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.809+0000 7f9fdf400640 1 -- 172.21.15.99:0/1023462349 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561826303790 msgr2=0x5618262b5650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:51.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.809+0000 7f9fdf400640 1 --2- 172.21.15.99:0/1023462349 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561826303790 0x5618262b5650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:51.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.809+0000 7f9fdf400640 1 -- 172.21.15.99:0/1023462349 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5618261b2c20 con 0x5618262c7e20 2024-02-21T23:03:51.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.809+0000 7f9fdf400640 1 --2- 172.21.15.99:0/1023462349 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5618262c7e20 0x5618262ba8e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f9fd002b9a0 tx=0x7f9fd0009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=975b145a5bc09875 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:51.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.809+0000 7f9fc8c00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:03:51.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.810+0000 7f9fc8c00640 1 -- 172.21.15.99:0/1023462349 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd00bd480 con 0x5618262c7e20 2024-02-21T23:03:51.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.810+0000 7f9fc8c00640 1 -- 172.21.15.99:0/1023462349 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f9fd00bd120 con 0x5618262c7e20 2024-02-21T23:03:51.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.810+0000 7f9fe9461740 1 -- 172.21.15.99:0/1023462349 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9fcc018070 con 0x5618262c7e20 2024-02-21T23:03:51.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.810+0000 7f9fc8c00640 1 -- 172.21.15.99:0/1023462349 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9fd00c1a40 con 0x5618262c7e20 2024-02-21T23:03:51.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.810+0000 7f9fe9461740 10 client.5433 fetch_fsmap learned FSMap version 15 2024-02-21T23:03:51.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.810+0000 7f9fe9461740 1 -- 172.21.15.99:0/1023462349 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x561825f003f0 con 0x5618262c7e20 2024-02-21T23:03:51.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.810+0000 7f9fc8c00640 1 -- 172.21.15.99:0/1023462349 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fcc018070 con 0x5618262c7e20 2024-02-21T23:03:51.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.810+0000 7f9fc8c00640 1 -- 172.21.15.99:0/1023462349 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 15) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f9fd00ce020 con 0x5618262c7e20 2024-02-21T23:03:51.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.811+0000 7f9fe9461740 10 client.5433 fetch_fsmap finished waiting for FSMap version 15 2024-02-21T23:03:51.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.811+0000 7f9fe9461740 10 client.5433 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.d 2024-02-21T23:03:51.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.811+0000 7f9fe9461740 20 client.5433 populate_metadata read hostname 'smithi099' 2024-02-21T23:03:51.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.811+0000 7f9fe9461740 1 --2- 172.21.15.99:0/1023462349 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x561826308810 0x5618262b5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:51.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.811+0000 7f9fe9461740 4 client.5433 mds_command: new command op to 4348 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:03:51.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.811+0000 7f9fe9461740 1 -- 172.21.15.99:0/1023462349 --> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5618261f9090 con 0x561826308810 2024-02-21T23:03:51.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.811+0000 7f9fdea00640 1 --2- 172.21.15.99:0/1023462349 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x561826308810 0x5618262b5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:51.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.812+0000 7f9fc8c00640 10 client.5433 ms_handle_connect on v2:172.21.15.99:6834/2243461688 2024-02-21T23:03:51.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.812+0000 7f9fdea00640 1 --2- 172.21.15.99:0/1023462349 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x561826308810 0x5618262b5de0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=be11534ccea54b69 server_cookie=24234f8603e7371a in_seq=0 out_seq=0 2024-02-21T23:03:51.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.813+0000 7f9fc8c00640 1 -- 172.21.15.99:0/1023462349 <== mds.2 v2:172.21.15.99:6834/2243461688 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x5618261f9090 con 0x561826308810 2024-02-21T23:03:51.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.813+0000 7f9fc8c00640 10 client.5433 handle_command_reply: tid=0 2024-02-21T23:03:51.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.813+0000 7f9fe9461740 1 client.5433 shutdown 2024-02-21T23:03:51.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.814+0000 7f9fe9461740 1 -- 172.21.15.99:0/1023462349 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5618262c7e20 msgr2=0x5618262ba8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:51.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.814+0000 7f9fe9461740 1 --2- 172.21.15.99:0/1023462349 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5618262c7e20 0x5618262ba8e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f9fd002b9a0 tx=0x7f9fd0009500 comp rx=0 tx=0).stop 2024-02-21T23:03:51.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.814+0000 7f9fe9461740 1 -- 172.21.15.99:0/1023462349 shutdown_connections 2024-02-21T23:03:51.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.814+0000 7f9fe9461740 1 --2- 172.21.15.99:0/1023462349 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x561826308810 0x5618262b5de0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:51.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.814+0000 7f9fe9461740 1 --2- 172.21.15.99:0/1023462349 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5618262cd200 0x5618263102b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:51.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.814+0000 7f9fe9461740 1 --2- 172.21.15.99:0/1023462349 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561826303790 0x5618262b5650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:51.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.814+0000 7f9fe9461740 1 --2- 172.21.15.99:0/1023462349 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5618262c7e20 0x5618262ba8e0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:51.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.814+0000 7f9fe9461740 1 -- 172.21.15.99:0/1023462349 >> 172.21.15.99:0/1023462349 conn(0x5618262c7a40 msgr2=0x561826302cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:03:51.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.814+0000 7f9fc8c00640 0 client.5433 ms_handle_reset on v2:172.21.15.99:6834/2243461688 2024-02-21T23:03:51.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.814+0000 7f9fe9461740 1 -- 172.21.15.99:0/1023462349 shutdown_connections 2024-02-21T23:03:51.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.814+0000 7f9fe9461740 1 -- 172.21.15.99:0/1023462349 wait complete. 2024-02-21T23:03:51.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.814+0000 7f9fe9461740 20 client.5433 trim_cache size 0 max 16384 2024-02-21T23:03:51.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.841+0000 7f9fe9461740 1 Processor -- start 2024-02-21T23:03:51.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.841+0000 7f9fe9461740 1 -- start start 2024-02-21T23:03:51.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.843+0000 7f9fe9461740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5618262c7e20 0x56182628ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:51.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.843+0000 7f9fe9461740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5618262cd200 0x5618262ce210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:51.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.843+0000 7f9fe9461740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561826303790 0x5618262b6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:51.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.843+0000 7f9fe9461740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe0228260 con 0x5618262cd200 2024-02-21T23:03:51.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.843+0000 7f9fe9461740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe00705e0 con 0x5618262c7e20 2024-02-21T23:03:51.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.843+0000 7f9fe9461740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe006e6a0 con 0x561826303790 2024-02-21T23:03:51.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.843+0000 7f9fdea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5618262cd200 0x5618262ce210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:51.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.843+0000 7f9fdf400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5618262c7e20 0x56182628ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:51.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.843+0000 7f9fdea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5618262cd200 0x5618262ce210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60912/0 (socket says 172.21.15.99:60912) 2024-02-21T23:03:51.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.843+0000 7f9fdf400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5618262c7e20 0x56182628ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:36412/0 (socket says 172.21.15.99:36412) 2024-02-21T23:03:51.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.843+0000 7f9fdea00640 1 -- 172.21.15.99:0/3037781671 learned_addr learned my addr 172.21.15.99:0/3037781671 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:03:51.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.843+0000 7f9fdfe00640 1 --2- 172.21.15.99:0/3037781671 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561826303790 0x5618262b6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:51.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.844+0000 7f9fdf400640 1 -- 172.21.15.99:0/3037781671 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561826303790 msgr2=0x5618262b6ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:51.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.844+0000 7f9fdf400640 1 --2- 172.21.15.99:0/3037781671 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561826303790 0x5618262b6ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:51.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.844+0000 7f9fdf400640 1 -- 172.21.15.99:0/3037781671 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5618262cd200 msgr2=0x5618262ce210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:51.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.844+0000 7f9fdf400640 1 --2- 172.21.15.99:0/3037781671 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5618262cd200 0x5618262ce210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:51.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.844+0000 7f9fdf400640 1 -- 172.21.15.99:0/3037781671 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561825fca7d0 con 0x5618262c7e20 2024-02-21T23:03:51.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.844+0000 7f9fdf400640 1 --2- 172.21.15.99:0/3037781671 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5618262c7e20 0x56182628ca40 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f9fd00b75e0 tx=0x7f9fd00eb000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1d7fcd5eed46211 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:51.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.844+0000 7f9fcb400640 1 -- 172.21.15.99:0/3037781671 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd00b95e0 con 0x5618262c7e20 2024-02-21T23:03:51.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.844+0000 7f9fcb400640 1 -- 172.21.15.99:0/3037781671 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fd00b9780 con 0x5618262c7e20 2024-02-21T23:03:51.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.844+0000 7f9fcb400640 1 -- 172.21.15.99:0/3037781671 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd00c15b0 con 0x5618262c7e20 2024-02-21T23:03:51.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.845+0000 7f9fe9461740 1 -- 172.21.15.99:0/3037781671 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5618262c7e20 msgr2=0x56182628ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:51.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.845+0000 7f9fe9461740 1 --2- 172.21.15.99:0/3037781671 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5618262c7e20 0x56182628ca40 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f9fd00b75e0 tx=0x7f9fd00eb000 comp rx=0 tx=0).stop 2024-02-21T23:03:51.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.845+0000 7f9fe9461740 1 -- 172.21.15.99:0/3037781671 shutdown_connections 2024-02-21T23:03:51.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.845+0000 7f9fe9461740 1 --2- 172.21.15.99:0/3037781671 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561826303790 0x5618262b6ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:51.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.845+0000 7f9fe9461740 1 --2- 172.21.15.99:0/3037781671 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5618262cd200 0x5618262ce210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:51.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.845+0000 7f9fe9461740 1 --2- 172.21.15.99:0/3037781671 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5618262c7e20 0x56182628ca40 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:51.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.845+0000 7f9fe9461740 1 -- 172.21.15.99:0/3037781671 >> 172.21.15.99:0/3037781671 conn(0x5618262c7a40 msgr2=0x56182628e050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:03:51.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.845+0000 7f9fe9461740 1 -- 172.21.15.99:0/3037781671 shutdown_connections 2024-02-21T23:03:51.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.846+0000 7f9fe9461740 1 -- 172.21.15.99:0/3037781671 wait complete. 2024-02-21T23:03:51.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.847+0000 7f9fe9461740 1 -- start start 2024-02-21T23:03:51.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.847+0000 7f9fe9461740 1 Processor -- start 2024-02-21T23:03:51.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.849+0000 7f9fe9461740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5618262c7e20 0x5618262cb9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:51.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.849+0000 7f9fe9461740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5618262cd200 0x561826281260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:51.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.849+0000 7f9fe9461740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561826303790 0x5618262d21e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:51.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.849+0000 7f9fe9461740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe006eca0 con 0x5618262c7e20 2024-02-21T23:03:51.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.849+0000 7f9fe9461740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe006ff80 con 0x561826303790 2024-02-21T23:03:51.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.849+0000 7f9fe9461740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe006f2c0 con 0x5618262cd200 2024-02-21T23:03:51.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.849+0000 7f9fe9461740 10 client.0 _ll_register_callbacks cb 0x7f9fd0006c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:03:51.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.849+0000 7f9fdf400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5618262c7e20 0x5618262cb9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:51.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.850+0000 7f9fdf400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5618262c7e20 0x5618262cb9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60914/0 (socket says 172.21.15.99:60914) 2024-02-21T23:03:51.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.850+0000 7f9fdf400640 1 -- 172.21.15.99:0/2115022662 learned_addr learned my addr 172.21.15.99:0/2115022662 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:03:51.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.850+0000 7f9fdfe00640 1 --2- 172.21.15.99:0/2115022662 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561826303790 0x5618262d21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:51.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.850+0000 7f9fdea00640 1 --2- 172.21.15.99:0/2115022662 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5618262cd200 0x561826281260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:51.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.850+0000 7f9fdf400640 1 -- 172.21.15.99:0/2115022662 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5618262cd200 msgr2=0x561826281260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:51.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.850+0000 7f9fdf400640 1 --2- 172.21.15.99:0/2115022662 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5618262cd200 0x561826281260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:51.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.850+0000 7f9fdf400640 1 -- 172.21.15.99:0/2115022662 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561826303790 msgr2=0x5618262d21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:51.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.850+0000 7f9fdf400640 1 --2- 172.21.15.99:0/2115022662 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561826303790 0x5618262d21e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:51.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.850+0000 7f9fdf400640 1 -- 172.21.15.99:0/2115022662 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56182628e130 con 0x5618262c7e20 2024-02-21T23:03:51.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.850+0000 7f9fdf400640 1 --2- 172.21.15.99:0/2115022662 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5618262c7e20 0x5618262cb9c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f9fd00b9030 tx=0x7f9fd0006ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c229a943f1abcfa9 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:51.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.850+0000 7f9fc8c00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:03:51.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.851+0000 7f9fc8c00640 1 -- 172.21.15.99:0/2115022662 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd00b95e0 con 0x5618262c7e20 2024-02-21T23:03:51.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.851+0000 7f9fc8c00640 1 -- 172.21.15.99:0/2115022662 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f9fd00b8990 con 0x5618262c7e20 2024-02-21T23:03:51.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.851+0000 7f9fe9461740 1 -- 172.21.15.99:0/2115022662 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9fd00b9780 con 0x5618262c7e20 2024-02-21T23:03:51.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.851+0000 7f9fc8c00640 1 -- 172.21.15.99:0/2115022662 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9fd00bd140 con 0x5618262c7e20 2024-02-21T23:03:51.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.851+0000 7f9fe9461740 10 client.5439 fetch_fsmap learned FSMap version 15 2024-02-21T23:03:51.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.851+0000 7f9fe9461740 1 -- 172.21.15.99:0/2115022662 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x56182628e130 con 0x5618262c7e20 2024-02-21T23:03:51.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.851+0000 7f9fc8c00640 1 -- 172.21.15.99:0/2115022662 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fd00b9780 con 0x5618262c7e20 2024-02-21T23:03:51.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.851+0000 7f9fc8c00640 1 -- 172.21.15.99:0/2115022662 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 15) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f9fd00ce070 con 0x5618262c7e20 2024-02-21T23:03:51.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.852+0000 7f9fe9461740 10 client.5439 fetch_fsmap finished waiting for FSMap version 15 2024-02-21T23:03:51.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.852+0000 7f9fe9461740 10 client.5439 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.d 2024-02-21T23:03:51.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.852+0000 7f9fe9461740 20 client.5439 populate_metadata read hostname 'smithi099' 2024-02-21T23:03:51.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.852+0000 7f9fe9461740 1 --2- 172.21.15.99:0/2115022662 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x561826303140 0x56182636be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:51.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.852+0000 7f9fe9461740 4 client.5439 mds_command: new command op to 4348 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T23:03:51.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.852+0000 7f9fe9461740 1 -- 172.21.15.99:0/2115022662 --> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5618262cca90 con 0x561826303140 2024-02-21T23:03:51.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.852+0000 7f9fdea00640 1 --2- 172.21.15.99:0/2115022662 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x561826303140 0x56182636be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:51.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.853+0000 7f9fc8c00640 10 client.5439 ms_handle_connect on v2:172.21.15.99:6834/2243461688 2024-02-21T23:03:51.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.853+0000 7f9fdea00640 1 --2- 172.21.15.99:0/2115022662 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x561826303140 0x56182636be40 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f9d46c38eacc45e0 server_cookie=e088fb1d801c677b in_seq=0 out_seq=0 2024-02-21T23:03:51.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.853+0000 7f9fc8c00640 1 -- 172.21.15.99:0/2115022662 <== mds.2 v2:172.21.15.99:6834/2243461688 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5618262cca90 con 0x561826303140 2024-02-21T23:03:51.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.853+0000 7f9fc8c00640 10 client.5439 handle_command_reply: tid=0 2024-02-21T23:03:51.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.853+0000 7f9fe9461740 1 client.5439 shutdown 2024-02-21T23:03:51.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.853+0000 7f9fe9461740 1 -- 172.21.15.99:0/2115022662 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5618262c7e20 msgr2=0x5618262cb9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:51.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.853+0000 7f9fe9461740 1 --2- 172.21.15.99:0/2115022662 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5618262c7e20 0x5618262cb9c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f9fd00b9030 tx=0x7f9fd0006ed0 comp rx=0 tx=0).stop 2024-02-21T23:03:51.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.854+0000 7f9fe9461740 1 -- 172.21.15.99:0/2115022662 shutdown_connections 2024-02-21T23:03:51.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.854+0000 7f9fe9461740 1 --2- 172.21.15.99:0/2115022662 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x561826303140 0x56182636be40 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:51.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.854+0000 7f9fe9461740 1 --2- 172.21.15.99:0/2115022662 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561826303790 0x5618262d21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:51.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.854+0000 7f9fc8c00640 0 client.5439 ms_handle_reset on v2:172.21.15.99:6834/2243461688 2024-02-21T23:03:51.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.854+0000 7f9fe9461740 1 --2- 172.21.15.99:0/2115022662 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5618262cd200 0x561826281260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:51.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.854+0000 7f9fe9461740 1 --2- 172.21.15.99:0/2115022662 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5618262c7e20 0x5618262cb9c0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:51.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.854+0000 7f9fe9461740 1 -- 172.21.15.99:0/2115022662 >> 172.21.15.99:0/2115022662 conn(0x5618262c7a40 msgr2=0x5618262b6670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:03:51.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.854+0000 7f9fe9461740 1 -- 172.21.15.99:0/2115022662 shutdown_connections 2024-02-21T23:03:51.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.854+0000 7f9fe9461740 1 -- 172.21.15.99:0/2115022662 wait complete. 2024-02-21T23:03:51.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.854+0000 7f9fe9461740 20 client.5439 trim_cache size 0 max 16384 2024-02-21T23:03:51.845 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-02-21T23:03:51.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.855+0000 7f9fe5000640 1 -- 172.21.15.99:0/1338823816 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f9fc009ef00 msgr2=0x7f9fc00a13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:51.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.855+0000 7f9fe5000640 1 --2- 172.21.15.99:0/1338823816 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f9fc009ef00 0x7f9fc00a13c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9fd8007fd0 tx=0x7f9fd80020f0 comp rx=0 tx=0).stop 2024-02-21T23:03:51.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.855+0000 7f9fe5000640 1 -- 172.21.15.99:0/1338823816 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9fe017f490 msgr2=0x7f9fe01748a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:51.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.855+0000 7f9fe5000640 1 --2- 172.21.15.99:0/1338823816 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9fe017f490 0x7f9fe01748a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f9fd002bf70 tx=0x7f9fd00046c0 comp rx=0 tx=0).stop 2024-02-21T23:03:51.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.855+0000 7f9fe5000640 1 -- 172.21.15.99:0/1338823816 shutdown_connections 2024-02-21T23:03:51.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.855+0000 7f9fe5000640 1 --2- 172.21.15.99:0/1338823816 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f9fc009ef00 0x7f9fc00a13c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:51.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.855+0000 7f9fe5000640 1 --2- 172.21.15.99:0/1338823816 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9fe018b4f0 0x7f9fe017cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:51.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.855+0000 7f9fe5000640 1 --2- 172.21.15.99:0/1338823816 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9fe018b060 0x7f9fe00f3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:51.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.855+0000 7f9fe5000640 1 --2- 172.21.15.99:0/1338823816 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9fe017f490 0x7f9fe01748a0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:51.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.855+0000 7f9fe5000640 1 -- 172.21.15.99:0/1338823816 >> 172.21.15.99:0/1338823816 conn(0x7f9fe00d29b0 msgr2=0x7f9fe00d20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:03:51.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.855+0000 7f9fe5000640 1 -- 172.21.15.99:0/1338823816 shutdown_connections 2024-02-21T23:03:51.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:51.855+0000 7f9fe5000640 1 -- 172.21.15.99:0/1338823816 wait complete. 2024-02-21T23:03:51.867 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T23:03:51.867 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-02-21T23:03:52.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.111+0000 7ffb20200640 1 Processor -- start 2024-02-21T23:03:52.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.111+0000 7ffb20200640 1 -- start start 2024-02-21T23:03:52.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.114+0000 7ffb20200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ffb180d5330 0x7ffb180cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:52.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.114+0000 7ffb20200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb180d5730 con 0x7ffb18186400 2024-02-21T23:03:52.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.114+0000 7ffb20200640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb180cf820 con 0x7ffb181867e0 2024-02-21T23:03:52.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.114+0000 7ffb20200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb18187640 con 0x7ffb180d5330 2024-02-21T23:03:52.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.114+0000 7ffb1d800640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7ffb18186400 0x7ffb18187ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:50184/0 (socket says 172.21.15.99:50184) 2024-02-21T23:03:52.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.114+0000 7ffb1d800640 1 -- 172.21.15.99:0/3830725398 learned_addr learned my addr 172.21.15.99:0/3830725398 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:03:52.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.114+0000 7ffb1e200640 1 --2- 172.21.15.99:0/3830725398 >> v2:172.21.15.99:3300/0 conn(0x7ffb180d5330 0x7ffb180cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:52.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.114+0000 7ffb17e00640 1 -- 172.21.15.99:0/3830725398 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1952436671 0 0) 0x7ffb180cf820 con 0x7ffb181867e0 2024-02-21T23:03:52.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.114+0000 7ffb17e00640 1 -- 172.21.15.99:0/3830725398 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb00003520 con 0x7ffb181867e0 2024-02-21T23:03:52.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.115+0000 7ffb1e200640 1 -- 172.21.15.99:0/3830725398 >> v1:172.21.15.181:6789/0 conn(0x7ffb181867e0 legacy=0x7ffb181881e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:52.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.115+0000 7ffb1e200640 1 -- 172.21.15.99:0/3830725398 >> v1:172.21.15.99:6789/0 conn(0x7ffb18186400 legacy=0x7ffb18187ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:52.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.115+0000 7ffb1e200640 1 -- 172.21.15.99:0/3830725398 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb180cfb00 con 0x7ffb180d5330 2024-02-21T23:03:52.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.116+0000 7ffb1e200640 1 --2- 172.21.15.99:0/3830725398 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffb180d5330 0x7ffb180cdea0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ffb10009d90 tx=0x7ffb1002be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c048df16df3fab3 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:52.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.116+0000 7ffb17e00640 1 -- 172.21.15.99:0/3830725398 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb10039070 con 0x7ffb180d5330 2024-02-21T23:03:52.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.116+0000 7ffb17e00640 1 -- 172.21.15.99:0/3830725398 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb1002cbe0 con 0x7ffb180d5330 2024-02-21T23:03:52.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.116+0000 7ffb17e00640 1 -- 172.21.15.99:0/3830725398 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb10034440 con 0x7ffb180d5330 2024-02-21T23:03:52.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.117+0000 7ffb20200640 1 -- 172.21.15.99:0/3830725398 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffb180d5330 msgr2=0x7ffb180cdea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:52.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.117+0000 7ffb20200640 1 --2- 172.21.15.99:0/3830725398 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffb180d5330 0x7ffb180cdea0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ffb10009d90 tx=0x7ffb1002be30 comp rx=0 tx=0).stop 2024-02-21T23:03:52.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.117+0000 7ffb20200640 1 -- 172.21.15.99:0/3830725398 shutdown_connections 2024-02-21T23:03:52.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.117+0000 7ffb20200640 1 --2- 172.21.15.99:0/3830725398 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffb180d5330 0x7ffb180cdea0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:52.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.117+0000 7ffb20200640 1 -- 172.21.15.99:0/3830725398 >> 172.21.15.99:0/3830725398 conn(0x7ffb180d6af0 msgr2=0x7ffb180740b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:03:52.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.117+0000 7ffb20200640 1 -- 172.21.15.99:0/3830725398 shutdown_connections 2024-02-21T23:03:52.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.117+0000 7ffb20200640 1 -- 172.21.15.99:0/3830725398 wait complete. 2024-02-21T23:03:52.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.120+0000 7ffb20200640 1 Processor -- start 2024-02-21T23:03:52.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.120+0000 7ffb20200640 1 -- start start 2024-02-21T23:03:52.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.122+0000 7ffb20200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffb180d5330 0x7ffb18178b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:52.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.122+0000 7ffb20200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffb18186400 0x7ffb1816b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:52.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.122+0000 7ffb20200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb181867e0 0x7ffb1821ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:52.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.123+0000 7ffb20200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb181872d0 con 0x7ffb180d5330 2024-02-21T23:03:52.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.123+0000 7ffb20200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb18186ff0 con 0x7ffb181867e0 2024-02-21T23:03:52.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.123+0000 7ffb20200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb180ce3e0 con 0x7ffb18186400 2024-02-21T23:03:52.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.123+0000 7ffb1d800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffb180d5330 0x7ffb18178b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:52.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.123+0000 7ffb1d800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffb180d5330 0x7ffb18178b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60920/0 (socket says 172.21.15.99:60920) 2024-02-21T23:03:52.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.123+0000 7ffb1d800640 1 -- 172.21.15.99:0/2439896269 learned_addr learned my addr 172.21.15.99:0/2439896269 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:03:52.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.123+0000 7ffb1ce00640 1 --2- 172.21.15.99:0/2439896269 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffb18186400 0x7ffb1816b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:52.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.123+0000 7ffb1e200640 1 --2- 172.21.15.99:0/2439896269 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb181867e0 0x7ffb1821ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:52.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.123+0000 7ffb1d800640 1 -- 172.21.15.99:0/2439896269 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffb18186400 msgr2=0x7ffb1816b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:52.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.123+0000 7ffb1d800640 1 --2- 172.21.15.99:0/2439896269 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffb18186400 0x7ffb1816b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:52.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.123+0000 7ffb1d800640 1 -- 172.21.15.99:0/2439896269 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb181867e0 msgr2=0x7ffb1821ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:52.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.123+0000 7ffb1d800640 1 --2- 172.21.15.99:0/2439896269 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb181867e0 0x7ffb1821ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:52.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.123+0000 7ffb1d800640 1 -- 172.21.15.99:0/2439896269 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb1817a570 con 0x7ffb180d5330 2024-02-21T23:03:52.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.124+0000 7ffb1d800640 1 --2- 172.21.15.99:0/2439896269 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffb180d5330 0x7ffb18178b90 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c00c400 tx=0x7ffb0c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:52.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.124+0000 7ffb15600640 1 -- 172.21.15.99:0/2439896269 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0c017070 con 0x7ffb180d5330 2024-02-21T23:03:52.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.124+0000 7ffb15600640 1 -- 172.21.15.99:0/2439896269 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb0c005ce0 con 0x7ffb180d5330 2024-02-21T23:03:52.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.124+0000 7ffb20200640 1 -- 172.21.15.99:0/2439896269 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb181791f0 con 0x7ffb180d5330 2024-02-21T23:03:52.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.124+0000 7ffb15600640 1 -- 172.21.15.99:0/2439896269 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0c0072f0 con 0x7ffb180d5330 2024-02-21T23:03:52.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.124+0000 7ffb20200640 1 -- 172.21.15.99:0/2439896269 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb181797b0 con 0x7ffb180d5330 2024-02-21T23:03:52.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.128+0000 7ffb15600640 1 -- 172.21.15.99:0/2439896269 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7ffb0c01a070 con 0x7ffb180d5330 2024-02-21T23:03:52.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.129+0000 7ffb15600640 1 --2- 172.21.15.99:0/2439896269 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7ffaf809eed0 0x7ffaf80a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:52.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.129+0000 7ffb15600640 1 -- 172.21.15.99:0/2439896269 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7ffb0c0c91f0 con 0x7ffb180d5330 2024-02-21T23:03:52.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.129+0000 7ffb1ce00640 1 --2- 172.21.15.99:0/2439896269 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7ffaf809eed0 0x7ffaf80a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:52.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.129+0000 7ffb2317f740 1 Processor -- start 2024-02-21T23:03:52.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.130+0000 7ffb2317f740 1 -- start start 2024-02-21T23:03:52.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.130+0000 7ffb1ce00640 1 --2- 172.21.15.99:0/2439896269 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7ffaf809eed0 0x7ffaf80a1390 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ffb040011e0 tx=0x7ffb04009040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:52.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.131+0000 7ffb2317f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d7854b84b0 0x55d7854b8890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:52.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.131+0000 7ffb2317f740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d7854f3180 0x55d7854f3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:52.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.131+0000 7ffb2317f740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d7854f3b40 0x55d7854f43b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:52.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.131+0000 7ffb2317f740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7853e0b50 con 0x55d7854f3180 2024-02-21T23:03:52.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.131+0000 7ffb2317f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d785389da0 con 0x55d7854b84b0 2024-02-21T23:03:52.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.131+0000 7ffb2317f740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7853dcbf0 con 0x55d7854f3b40 2024-02-21T23:03:52.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.131+0000 7ffb1d800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d7854b84b0 0x55d7854b8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:52.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.131+0000 7ffb1d800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d7854b84b0 0x55d7854b8890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:36438/0 (socket says 172.21.15.99:36438) 2024-02-21T23:03:52.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.131+0000 7ffb1e200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d7854f3b40 0x55d7854f43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:52.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.131+0000 7ffb1d800640 1 -- 172.21.15.99:0/1000314425 learned_addr learned my addr 172.21.15.99:0/1000314425 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:03:52.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.131+0000 7ffb1ce00640 1 --2- 172.21.15.99:0/1000314425 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d7854f3180 0x55d7854f3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:52.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.132+0000 7ffb1e200640 1 -- 172.21.15.99:0/1000314425 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d7854b84b0 msgr2=0x55d7854b8890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:52.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.132+0000 7ffb1e200640 1 --2- 172.21.15.99:0/1000314425 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d7854b84b0 0x55d7854b8890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:52.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.132+0000 7ffb1e200640 1 -- 172.21.15.99:0/1000314425 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d7854f3180 msgr2=0x55d7854f3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:52.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.132+0000 7ffb1e200640 1 --2- 172.21.15.99:0/1000314425 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d7854f3180 0x55d7854f3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:52.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.132+0000 7ffb1e200640 1 -- 172.21.15.99:0/1000314425 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d7853acf80 con 0x55d7854f3b40 2024-02-21T23:03:52.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.132+0000 7ffb1ce00640 1 --2- 172.21.15.99:0/1000314425 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d7854f3180 0x55d7854f3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T23:03:52.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.132+0000 7ffb1e200640 1 --2- 172.21.15.99:0/1000314425 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d7854f3b40 0x55d7854f43b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ffb180d7440 tx=0x7ffb1002e000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2686a8348b00277e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:52.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.132+0000 7ffb0a000640 1 -- 172.21.15.99:0/1000314425 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb10039040 con 0x55d7854f3b40 2024-02-21T23:03:52.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.132+0000 7ffb0a000640 1 -- 172.21.15.99:0/1000314425 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb1003a040 con 0x55d7854f3b40 2024-02-21T23:03:52.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.132+0000 7ffb0a000640 1 -- 172.21.15.99:0/1000314425 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb10034640 con 0x55d7854f3b40 2024-02-21T23:03:52.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.133+0000 7ffb2317f740 1 -- 172.21.15.99:0/1000314425 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d7854f3b40 msgr2=0x55d7854f43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:52.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.133+0000 7ffb2317f740 1 --2- 172.21.15.99:0/1000314425 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d7854f3b40 0x55d7854f43b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ffb180d7440 tx=0x7ffb1002e000 comp rx=0 tx=0).stop 2024-02-21T23:03:52.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.133+0000 7ffb2317f740 1 -- 172.21.15.99:0/1000314425 shutdown_connections 2024-02-21T23:03:52.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.133+0000 7ffb2317f740 1 --2- 172.21.15.99:0/1000314425 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d7854f3b40 0x55d7854f43b0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:52.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.133+0000 7ffb2317f740 1 --2- 172.21.15.99:0/1000314425 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d7854f3180 0x55d7854f3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:52.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.133+0000 7ffb2317f740 1 --2- 172.21.15.99:0/1000314425 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d7854b84b0 0x55d7854b8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:52.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.133+0000 7ffb2317f740 1 -- 172.21.15.99:0/1000314425 >> 172.21.15.99:0/1000314425 conn(0x55d78547a520 msgr2=0x55d78547b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:03:52.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.134+0000 7ffb2317f740 1 -- 172.21.15.99:0/1000314425 shutdown_connections 2024-02-21T23:03:52.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.134+0000 7ffb2317f740 1 -- 172.21.15.99:0/1000314425 wait complete. 2024-02-21T23:03:52.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.134+0000 7ffb2317f740 1 -- start start 2024-02-21T23:03:52.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.135+0000 7ffb2317f740 1 Processor -- start 2024-02-21T23:03:52.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.136+0000 7ffb2317f740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d7854f3180 0x55d7854ecb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:52.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.136+0000 7ffb2317f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d7854f3b40 0x55d7854b3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:52.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.136+0000 7ffb2317f740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d7854ed4e0 0x55d7854aa650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:52.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.136+0000 7ffb2317f740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7854f1ef0 con 0x55d7854ed4e0 2024-02-21T23:03:52.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.136+0000 7ffb2317f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d78537f380 con 0x55d7854f3b40 2024-02-21T23:03:52.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.136+0000 7ffb2317f740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7854f1c10 con 0x55d7854f3180 2024-02-21T23:03:52.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.136+0000 7ffb2317f740 10 client.0 _ll_register_callbacks cb 0x55d7853d8280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:03:52.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.136+0000 7ffb1d800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d7854f3180 0x55d7854ecb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:52.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.136+0000 7ffb1e200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d7854ed4e0 0x55d7854aa650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:52.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.137+0000 7ffb1ce00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d7854f3b40 0x55d7854b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:52.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.137+0000 7ffb1ce00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d7854f3b40 0x55d7854b3260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:36454/0 (socket says 172.21.15.99:36454) 2024-02-21T23:03:52.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.137+0000 7ffb1ce00640 1 -- 172.21.15.99:0/1605229433 learned_addr learned my addr 172.21.15.99:0/1605229433 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:03:52.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.137+0000 7ffb1e200640 1 -- 172.21.15.99:0/1605229433 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d7854f3180 msgr2=0x55d7854ecb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:52.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.137+0000 7ffb1e200640 1 --2- 172.21.15.99:0/1605229433 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d7854f3180 0x55d7854ecb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:52.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.137+0000 7ffb1e200640 1 -- 172.21.15.99:0/1605229433 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d7854f3b40 msgr2=0x55d7854b3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:52.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.137+0000 7ffb1e200640 1 --2- 172.21.15.99:0/1605229433 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d7854f3b40 0x55d7854b3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:52.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.137+0000 7ffb1e200640 1 -- 172.21.15.99:0/1605229433 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d7853a7c20 con 0x55d7854ed4e0 2024-02-21T23:03:52.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.137+0000 7ffb1e200640 1 --2- 172.21.15.99:0/1605229433 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d7854ed4e0 0x55d7854aa650 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ffb1002be70 tx=0x7ffb10004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58217dbe9d083590 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:52.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.137+0000 7ffafea00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:03:52.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.138+0000 7ffafea00640 1 -- 172.21.15.99:0/1605229433 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb1004f030 con 0x55d7854ed4e0 2024-02-21T23:03:52.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.138+0000 7ffb2317f740 1 -- 172.21.15.99:0/1605229433 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ffb1003a040 con 0x55d7854ed4e0 2024-02-21T23:03:52.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.138+0000 7ffafea00640 1 -- 172.21.15.99:0/1605229433 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7ffb1002cb90 con 0x55d7854ed4e0 2024-02-21T23:03:52.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.138+0000 7ffafea00640 1 -- 172.21.15.99:0/1605229433 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffb10059050 con 0x55d7854ed4e0 2024-02-21T23:03:52.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.138+0000 7ffb2317f740 10 client.5451 fetch_fsmap learned FSMap version 15 2024-02-21T23:03:52.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.138+0000 7ffb2317f740 1 -- 172.21.15.99:0/1605229433 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x55d7850f53f0 con 0x55d7854ed4e0 2024-02-21T23:03:52.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.138+0000 7ffafea00640 1 -- 172.21.15.99:0/1605229433 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb1003a040 con 0x55d7854ed4e0 2024-02-21T23:03:52.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.139+0000 7ffafea00640 1 -- 172.21.15.99:0/1605229433 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 15) v1 ==== 7890+0+0 (secure 0 0 0) 0x7ffb10003ba0 con 0x55d7854ed4e0 2024-02-21T23:03:52.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.139+0000 7ffb2317f740 10 client.5451 fetch_fsmap finished waiting for FSMap version 15 2024-02-21T23:03:52.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.139+0000 7ffb2317f740 10 client.5451 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2024-02-21T23:03:52.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.139+0000 7ffb2317f740 20 client.5451 populate_metadata read hostname 'smithi099' 2024-02-21T23:03:52.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.139+0000 7ffb2317f740 1 --2- 172.21.15.99:0/1605229433 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x55d7854ed960 0x55d7854b39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:52.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.139+0000 7ffb2317f740 4 client.5451 mds_command: new command op to 4352 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:03:52.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.139+0000 7ffb2317f740 1 -- 172.21.15.99:0/1605229433 --> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d7853ee090 con 0x55d7854ed960 2024-02-21T23:03:52.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.139+0000 7ffb1d800640 1 --2- 172.21.15.99:0/1605229433 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x55d7854ed960 0x55d7854b39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:52.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.140+0000 7ffafea00640 10 client.5451 ms_handle_connect on v2:172.21.15.99:6836/1676159950 2024-02-21T23:03:52.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.140+0000 7ffb1d800640 1 --2- 172.21.15.99:0/1605229433 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x55d7854ed960 0x55d7854b39b0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5ba1e733561d93fa server_cookie=4636ee60e7ddd9a9 in_seq=0 out_seq=0 2024-02-21T23:03:52.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.141+0000 7ffafea00640 1 -- 172.21.15.99:0/1605229433 <== mds.1 v2:172.21.15.99:6836/1676159950 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55d7853ee090 con 0x55d7854ed960 2024-02-21T23:03:52.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.141+0000 7ffafea00640 10 client.5451 handle_command_reply: tid=0 2024-02-21T23:03:52.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.141+0000 7ffb2317f740 1 client.5451 shutdown 2024-02-21T23:03:52.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.141+0000 7ffb2317f740 1 -- 172.21.15.99:0/1605229433 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d7854ed4e0 msgr2=0x55d7854aa650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:52.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.141+0000 7ffb2317f740 1 --2- 172.21.15.99:0/1605229433 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d7854ed4e0 0x55d7854aa650 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ffb1002be70 tx=0x7ffb10004ab0 comp rx=0 tx=0).stop 2024-02-21T23:03:52.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.141+0000 7ffb2317f740 1 -- 172.21.15.99:0/1605229433 shutdown_connections 2024-02-21T23:03:52.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.141+0000 7ffb2317f740 1 --2- 172.21.15.99:0/1605229433 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x55d7854ed960 0x55d7854b39b0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:52.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.141+0000 7ffafea00640 0 client.5451 ms_handle_reset on v2:172.21.15.99:6836/1676159950 2024-02-21T23:03:52.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.141+0000 7ffb2317f740 1 --2- 172.21.15.99:0/1605229433 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d7854ed4e0 0x55d7854aa650 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:52.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.141+0000 7ffb2317f740 1 --2- 172.21.15.99:0/1605229433 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d7854f3b40 0x55d7854b3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:52.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.141+0000 7ffb2317f740 1 --2- 172.21.15.99:0/1605229433 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d7854f3180 0x55d7854ecb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:52.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.141+0000 7ffb2317f740 1 -- 172.21.15.99:0/1605229433 >> 172.21.15.99:0/1605229433 conn(0x55d7854b84b0 msgr2=0x55d7854f2600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:03:52.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.141+0000 7ffb2317f740 1 -- 172.21.15.99:0/1605229433 shutdown_connections 2024-02-21T23:03:52.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.141+0000 7ffb2317f740 1 -- 172.21.15.99:0/1605229433 wait complete. 2024-02-21T23:03:52.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.142+0000 7ffb2317f740 20 client.5451 trim_cache size 0 max 16384 2024-02-21T23:03:52.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.166+0000 7ffb2317f740 1 Processor -- start 2024-02-21T23:03:52.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.166+0000 7ffb2317f740 1 -- start start 2024-02-21T23:03:52.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.167+0000 7ffb2317f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d7854ed4e0 0x55d7854b39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:52.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.167+0000 7ffb2317f740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d7854f3180 0x55d7854ec730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:52.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.167+0000 7ffb2317f740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d7854f3b40 0x55d7854b3160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:52.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.167+0000 7ffb2317f740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1822c7f0 con 0x55d7854f3180 2024-02-21T23:03:52.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.167+0000 7ffb2317f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1822a390 con 0x55d7854ed4e0 2024-02-21T23:03:52.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.167+0000 7ffb2317f740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb18228590 con 0x55d7854f3b40 2024-02-21T23:03:52.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.168+0000 7ffb1ce00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d7854f3180 0x55d7854ec730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:52.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.168+0000 7ffb1e200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d7854f3b40 0x55d7854b3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:52.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.168+0000 7ffb1ce00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d7854f3180 0x55d7854ec730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60936/0 (socket says 172.21.15.99:60936) 2024-02-21T23:03:52.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.168+0000 7ffb1ce00640 1 -- 172.21.15.99:0/3023023165 learned_addr learned my addr 172.21.15.99:0/3023023165 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:03:52.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.168+0000 7ffb1d800640 1 --2- 172.21.15.99:0/3023023165 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d7854ed4e0 0x55d7854b39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:52.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.168+0000 7ffb1e200640 1 -- 172.21.15.99:0/3023023165 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d7854ed4e0 msgr2=0x55d7854b39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:52.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.168+0000 7ffb1e200640 1 --2- 172.21.15.99:0/3023023165 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d7854ed4e0 0x55d7854b39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:52.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.168+0000 7ffb1e200640 1 -- 172.21.15.99:0/3023023165 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d7854f3180 msgr2=0x55d7854ec730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:52.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.168+0000 7ffb1e200640 1 --2- 172.21.15.99:0/3023023165 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d7854f3180 0x55d7854ec730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:52.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.168+0000 7ffb1e200640 1 -- 172.21.15.99:0/3023023165 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d7851bf7d0 con 0x55d7854f3b40 2024-02-21T23:03:52.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.168+0000 7ffb1d800640 1 --2- 172.21.15.99:0/3023023165 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d7854ed4e0 0x55d7854b39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:03:52.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.168+0000 7ffb1ce00640 1 --2- 172.21.15.99:0/3023023165 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d7854f3180 0x55d7854ec730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:03:52.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.169+0000 7ffb1e200640 1 --2- 172.21.15.99:0/3023023165 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d7854f3b40 0x55d7854b3160 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7ffb10009d90 tx=0x7ffb10043000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=730f37178b98b18f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:52.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.169+0000 7ffb09600640 1 -- 172.21.15.99:0/3023023165 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb1004f070 con 0x55d7854f3b40 2024-02-21T23:03:52.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.169+0000 7ffb09600640 1 -- 172.21.15.99:0/3023023165 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb10003ba0 con 0x55d7854f3b40 2024-02-21T23:03:52.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.169+0000 7ffb09600640 1 -- 172.21.15.99:0/3023023165 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb10039040 con 0x55d7854f3b40 2024-02-21T23:03:52.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.170+0000 7ffb2317f740 1 -- 172.21.15.99:0/3023023165 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d7854f3b40 msgr2=0x55d7854b3160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:52.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.170+0000 7ffb2317f740 1 --2- 172.21.15.99:0/3023023165 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d7854f3b40 0x55d7854b3160 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7ffb10009d90 tx=0x7ffb10043000 comp rx=0 tx=0).stop 2024-02-21T23:03:52.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.170+0000 7ffb2317f740 1 -- 172.21.15.99:0/3023023165 shutdown_connections 2024-02-21T23:03:52.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.170+0000 7ffb2317f740 1 --2- 172.21.15.99:0/3023023165 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d7854f3b40 0x55d7854b3160 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:52.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.170+0000 7ffb2317f740 1 --2- 172.21.15.99:0/3023023165 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d7854f3180 0x55d7854ec730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:52.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.170+0000 7ffb2317f740 1 --2- 172.21.15.99:0/3023023165 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d7854ed4e0 0x55d7854b39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:52.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.170+0000 7ffb2317f740 1 -- 172.21.15.99:0/3023023165 >> 172.21.15.99:0/3023023165 conn(0x55d7854b84b0 msgr2=0x55d7854b1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:03:52.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.170+0000 7ffb2317f740 1 -- 172.21.15.99:0/3023023165 shutdown_connections 2024-02-21T23:03:52.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.170+0000 7ffb2317f740 1 -- 172.21.15.99:0/3023023165 wait complete. 2024-02-21T23:03:52.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.171+0000 7ffb2317f740 1 -- start start 2024-02-21T23:03:52.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.172+0000 7ffb2317f740 1 Processor -- start 2024-02-21T23:03:52.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.174+0000 7ffb2317f740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d7854ed4e0 0x55d7854b6160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:52.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.174+0000 7ffb2317f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d7854f3180 0x55d785558fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:52.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.174+0000 7ffb2317f740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d7854f3b40 0x55d7854c6240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:52.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.174+0000 7ffb2317f740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb18228a70 con 0x55d7854f3b40 2024-02-21T23:03:52.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.174+0000 7ffb2317f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb18229d30 con 0x55d7854f3180 2024-02-21T23:03:52.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.174+0000 7ffb2317f740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb18229070 con 0x55d7854ed4e0 2024-02-21T23:03:52.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.174+0000 7ffb2317f740 10 client.0 _ll_register_callbacks cb 0x7ffb0c092de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:03:52.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.174+0000 7ffb1e200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d7854f3b40 0x55d7854c6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:52.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.174+0000 7ffb1e200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d7854f3b40 0x55d7854c6240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60942/0 (socket says 172.21.15.99:60942) 2024-02-21T23:03:52.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.174+0000 7ffb1e200640 1 -- 172.21.15.99:0/2322854572 learned_addr learned my addr 172.21.15.99:0/2322854572 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:03:52.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.174+0000 7ffb1d800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d7854ed4e0 0x55d7854b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:52.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.174+0000 7ffb1ce00640 1 --2- 172.21.15.99:0/2322854572 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d7854f3180 0x55d785558fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:52.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.174+0000 7ffb1d800640 1 -- 172.21.15.99:0/2322854572 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d7854f3180 msgr2=0x55d785558fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:52.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.174+0000 7ffb1d800640 1 --2- 172.21.15.99:0/2322854572 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d7854f3180 0x55d785558fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:52.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.174+0000 7ffb1d800640 1 -- 172.21.15.99:0/2322854572 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d7854f3b40 msgr2=0x55d7854c6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:52.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.174+0000 7ffb1d800640 1 --2- 172.21.15.99:0/2322854572 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d7854f3b40 0x55d7854c6240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:52.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.174+0000 7ffb1d800640 1 -- 172.21.15.99:0/2322854572 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d7854b66a0 con 0x55d7854ed4e0 2024-02-21T23:03:52.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.174+0000 7ffb1e200640 1 --2- 172.21.15.99:0/2322854572 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d7854f3b40 0x55d7854c6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:03:52.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.175+0000 7ffb1d800640 1 --2- 172.21.15.99:0/2322854572 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d7854ed4e0 0x55d7854b6160 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c00cfd0 tx=0x7ffb0c0c9040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ceb1838f15a598d7 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:52.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.175+0000 7ffafea00640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-02-21T23:03:52.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.175+0000 7ffafea00640 1 -- 172.21.15.99:0/2322854572 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0c094f00 con 0x55d7854ed4e0 2024-02-21T23:03:52.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.175+0000 7ffafea00640 1 -- 172.21.15.99:0/2322854572 <== mon.2 v2:172.21.15.181:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7ffb0c0931b0 con 0x55d7854ed4e0 2024-02-21T23:03:52.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.175+0000 7ffb2317f740 1 -- 172.21.15.99:0/2322854572 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ffb10003ba0 con 0x55d7854ed4e0 2024-02-21T23:03:52.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.175+0000 7ffafea00640 1 -- 172.21.15.99:0/2322854572 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffb0c007490 con 0x55d7854ed4e0 2024-02-21T23:03:52.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.175+0000 7ffb2317f740 10 client.5588 fetch_fsmap learned FSMap version 15 2024-02-21T23:03:52.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.175+0000 7ffb2317f740 1 -- 172.21.15.99:0/2322854572 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x55d7854c3430 con 0x55d7854ed4e0 2024-02-21T23:03:52.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.175+0000 7ffafea00640 1 -- 172.21.15.99:0/2322854572 <== mon.2 v2:172.21.15.181:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb10003ba0 con 0x55d7854ed4e0 2024-02-21T23:03:52.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.176+0000 7ffafea00640 1 -- 172.21.15.99:0/2322854572 <== mon.2 v2:172.21.15.181:3300/0 5 ==== fsmap(e 15) v1 ==== 7890+0+0 (secure 0 0 0) 0x7ffb0c0b5040 con 0x55d7854ed4e0 2024-02-21T23:03:52.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.176+0000 7ffb2317f740 10 client.5588 fetch_fsmap finished waiting for FSMap version 15 2024-02-21T23:03:52.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.176+0000 7ffb2317f740 10 client.5588 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2024-02-21T23:03:52.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.176+0000 7ffb2317f740 20 client.5588 populate_metadata read hostname 'smithi099' 2024-02-21T23:03:52.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.176+0000 7ffb2317f740 1 --2- 172.21.15.99:0/2322854572 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x55d7854fd910 0x55d7854a0130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:52.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.176+0000 7ffb2317f740 4 client.5588 mds_command: new command op to 4352 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T23:03:52.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.176+0000 7ffb2317f740 1 -- 172.21.15.99:0/2322854572 --> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55d78547ac80 con 0x55d7854fd910 2024-02-21T23:03:52.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.176+0000 7ffb1ce00640 1 --2- 172.21.15.99:0/2322854572 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x55d7854fd910 0x55d7854a0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:52.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.177+0000 7ffb1ce00640 1 --2- 172.21.15.99:0/2322854572 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x55d7854fd910 0x55d7854a0130 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=89cc9ffb0b060872 server_cookie=2a8d8a0e3a8fc0fe in_seq=0 out_seq=0 2024-02-21T23:03:52.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.177+0000 7ffafea00640 10 client.5588 ms_handle_connect on v2:172.21.15.99:6836/1676159950 2024-02-21T23:03:52.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.177+0000 7ffafea00640 1 -- 172.21.15.99:0/2322854572 <== mds.1 v2:172.21.15.99:6836/1676159950 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55d78547ac80 con 0x55d7854fd910 2024-02-21T23:03:52.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.177+0000 7ffafea00640 10 client.5588 handle_command_reply: tid=0 2024-02-21T23:03:52.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.177+0000 7ffb2317f740 1 client.5588 shutdown 2024-02-21T23:03:52.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.177+0000 7ffb2317f740 1 -- 172.21.15.99:0/2322854572 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d7854ed4e0 msgr2=0x55d7854b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:52.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.177+0000 7ffb2317f740 1 --2- 172.21.15.99:0/2322854572 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d7854ed4e0 0x55d7854b6160 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c00cfd0 tx=0x7ffb0c0c9040 comp rx=0 tx=0).stop 2024-02-21T23:03:52.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.177+0000 7ffb2317f740 1 -- 172.21.15.99:0/2322854572 shutdown_connections 2024-02-21T23:03:52.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.177+0000 7ffb2317f740 1 --2- 172.21.15.99:0/2322854572 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x55d7854fd910 0x55d7854a0130 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:52.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.177+0000 7ffb2317f740 1 --2- 172.21.15.99:0/2322854572 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d7854f3b40 0x55d7854c6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:52.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.177+0000 7ffb2317f740 1 --2- 172.21.15.99:0/2322854572 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d7854f3180 0x55d785558fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:52.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.177+0000 7ffb2317f740 1 --2- 172.21.15.99:0/2322854572 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d7854ed4e0 0x55d7854b6160 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:52.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.177+0000 7ffafea00640 0 client.5588 ms_handle_reset on v2:172.21.15.99:6836/1676159950 2024-02-21T23:03:52.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.177+0000 7ffb2317f740 1 -- 172.21.15.99:0/2322854572 >> 172.21.15.99:0/2322854572 conn(0x55d7854b84b0 msgr2=0x55d7854b2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:03:52.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.178+0000 7ffb2317f740 1 -- 172.21.15.99:0/2322854572 shutdown_connections 2024-02-21T23:03:52.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.178+0000 7ffb2317f740 1 -- 172.21.15.99:0/2322854572 wait complete. 2024-02-21T23:03:52.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.178+0000 7ffb2317f740 20 client.5588 trim_cache size 0 max 16384 2024-02-21T23:03:52.170 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-02-21T23:03:52.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.180+0000 7ffb20200640 1 -- 172.21.15.99:0/2439896269 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7ffaf809eed0 msgr2=0x7ffaf80a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:52.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.180+0000 7ffb20200640 1 --2- 172.21.15.99:0/2439896269 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7ffaf809eed0 0x7ffaf80a1390 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ffb040011e0 tx=0x7ffb04009040 comp rx=0 tx=0).stop 2024-02-21T23:03:52.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.180+0000 7ffb20200640 1 -- 172.21.15.99:0/2439896269 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffb180d5330 msgr2=0x7ffb18178b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:52.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.180+0000 7ffb20200640 1 --2- 172.21.15.99:0/2439896269 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffb180d5330 0x7ffb18178b90 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c00c400 tx=0x7ffb0c00c8c0 comp rx=0 tx=0).stop 2024-02-21T23:03:52.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.180+0000 7ffb20200640 1 -- 172.21.15.99:0/2439896269 shutdown_connections 2024-02-21T23:03:52.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.180+0000 7ffb20200640 1 --2- 172.21.15.99:0/2439896269 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7ffaf809eed0 0x7ffaf80a1390 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:52.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.180+0000 7ffb20200640 1 --2- 172.21.15.99:0/2439896269 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb181867e0 0x7ffb1821ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:52.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.180+0000 7ffb20200640 1 --2- 172.21.15.99:0/2439896269 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffb18186400 0x7ffb1816b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:52.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.180+0000 7ffb20200640 1 --2- 172.21.15.99:0/2439896269 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffb180d5330 0x7ffb18178b90 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:52.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.180+0000 7ffb20200640 1 -- 172.21.15.99:0/2439896269 >> 172.21.15.99:0/2439896269 conn(0x7ffb180d6af0 msgr2=0x7ffb1818a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:03:52.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.180+0000 7ffb20200640 1 -- 172.21.15.99:0/2439896269 shutdown_connections 2024-02-21T23:03:52.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.180+0000 7ffb20200640 1 -- 172.21.15.99:0/2439896269 wait complete. 2024-02-21T23:03:52.186 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T23:03:52.186 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-02-21T23:03:52.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.416+0000 7f7153c00640 1 Processor -- start 2024-02-21T23:03:52.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.416+0000 7f7153c00640 1 -- start start 2024-02-21T23:03:52.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.419+0000 7f7153c00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f714c0d5730 con 0x7f714c186400 2024-02-21T23:03:52.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.419+0000 7f7153c00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f714c0cf820 con 0x7f714c1867e0 2024-02-21T23:03:52.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.419+0000 7f7153c00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f714c0cfb00 con 0x7f714c0d5330 2024-02-21T23:03:52.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.419+0000 7f7151200640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f714c186400 0x7f714c187ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:50192/0 (socket says 172.21.15.99:50192) 2024-02-21T23:03:52.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.419+0000 7f7151200640 1 -- 172.21.15.99:0/2353397866 learned_addr learned my addr 172.21.15.99:0/2353397866 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:03:52.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.419+0000 7f714b400640 1 -- 172.21.15.99:0/2353397866 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2451405323 0 0) 0x7f714c0cf820 con 0x7f714c1867e0 2024-02-21T23:03:52.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.420+0000 7f714b400640 1 -- 172.21.15.99:0/2353397866 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7134003520 con 0x7f714c1867e0 2024-02-21T23:03:52.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.420+0000 7f714b400640 1 -- 172.21.15.99:0/2353397866 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2134849078 0 0) 0x7f714c0cfb00 con 0x7f714c0d5330 2024-02-21T23:03:52.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.420+0000 7f714b400640 1 -- 172.21.15.99:0/2353397866 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f714c0cf820 con 0x7f714c0d5330 2024-02-21T23:03:52.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.420+0000 7f714b400640 1 -- 172.21.15.99:0/2353397866 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 531151191 0 0) 0x7f714c0d5730 con 0x7f714c186400 2024-02-21T23:03:52.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.420+0000 7f714b400640 1 -- 172.21.15.99:0/2353397866 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f714c0cfb00 con 0x7f714c186400 2024-02-21T23:03:52.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.420+0000 7f714b400640 1 -- 172.21.15.99:0/2353397866 <== mon.1 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3161912632 0 0) 0x7f7134003520 con 0x7f714c1867e0 2024-02-21T23:03:52.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.420+0000 7f714b400640 1 -- 172.21.15.99:0/2353397866 >> v1:172.21.15.181:6789/0 conn(0x7f714c0d5330 legacy=0x7f714c0cdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:52.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.420+0000 7f714b400640 1 -- 172.21.15.99:0/2353397866 >> v1:172.21.15.99:6789/0 conn(0x7f714c186400 legacy=0x7f714c187ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:52.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.420+0000 7f714b400640 1 -- 172.21.15.99:0/2353397866 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f714c186d10 con 0x7f714c1867e0 2024-02-21T23:03:52.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.420+0000 7f714b400640 1 -- 172.21.15.99:0/2353397866 <== mon.1 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2069890144 0 0) 0x7f7138001670 con 0x7f714c1867e0 2024-02-21T23:03:52.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.420+0000 7f714b400640 1 -- 172.21.15.99:0/2353397866 >> v1:172.21.15.162:6789/0 conn(0x7f714c1867e0 legacy=0x7f714c1881e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:52.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.420+0000 7f714b400640 1 --2- 172.21.15.99:0/2353397866 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7134004de0 0x7f71340051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:52.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.420+0000 7f714b400640 1 --2- 172.21.15.99:0/2353397866 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7134003860 0x7f7134003ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:52.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.420+0000 7f714b400640 1 --2- 172.21.15.99:0/2353397866 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f71340099b0 0x7f713400bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:52.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.420+0000 7f714b400640 1 -- 172.21.15.99:0/2353397866 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f713400c390 con 0x7f7134003860 2024-02-21T23:03:52.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.420+0000 7f714b400640 1 -- 172.21.15.99:0/2353397866 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f713400c510 con 0x7f71340099b0 2024-02-21T23:03:52.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.420+0000 7f714b400640 1 -- 172.21.15.99:0/2353397866 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f713400c710 con 0x7f7134004de0 2024-02-21T23:03:52.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.420+0000 7f7151c00640 1 --2- 172.21.15.99:0/2353397866 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f71340099b0 0x7f713400bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:52.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.421+0000 7f7151200640 1 --2- 172.21.15.99:0/2353397866 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7134004de0 0x7f71340051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:52.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.421+0000 7f714be00640 1 --2- 172.21.15.99:0/2353397866 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7134003860 0x7f7134003ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:52.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.421+0000 7f7151200640 1 -- 172.21.15.99:0/2353397866 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f71340099b0 msgr2=0x7f713400bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:52.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.421+0000 7f7151200640 1 --2- 172.21.15.99:0/2353397866 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f71340099b0 0x7f713400bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:52.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.421+0000 7f7151200640 1 -- 172.21.15.99:0/2353397866 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7134003860 msgr2=0x7f7134003ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:52.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.421+0000 7f7151200640 1 --2- 172.21.15.99:0/2353397866 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7134003860 0x7f7134003ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:52.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.421+0000 7f7151200640 1 -- 172.21.15.99:0/2353397866 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f714c186d10 con 0x7f7134004de0 2024-02-21T23:03:52.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.421+0000 7f7151c00640 1 --2- 172.21.15.99:0/2353397866 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f71340099b0 0x7f713400bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:03:52.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.421+0000 7f7151c00640 1 -- 172.21.15.99:0/2353397866 reap_dead start 2024-02-21T23:03:52.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.423+0000 7f7151200640 1 --2- 172.21.15.99:0/2353397866 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7134004de0 0x7f71340051c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f7140001960 tx=0x7f7134005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb98960d4ee81c9d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:52.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.423+0000 7f714b400640 1 -- 172.21.15.99:0/2353397866 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7140037070 con 0x7f7134004de0 2024-02-21T23:03:52.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.423+0000 7f714b400640 1 -- 172.21.15.99:0/2353397866 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71400048a0 con 0x7f7134004de0 2024-02-21T23:03:52.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.423+0000 7f714b400640 1 -- 172.21.15.99:0/2353397866 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71400015b0 con 0x7f7134004de0 2024-02-21T23:03:52.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.424+0000 7f7153c00640 1 -- 172.21.15.99:0/2353397866 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7134004de0 msgr2=0x7f71340051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:52.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.424+0000 7f7153c00640 1 --2- 172.21.15.99:0/2353397866 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7134004de0 0x7f71340051c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f7140001960 tx=0x7f7134005830 comp rx=0 tx=0).stop 2024-02-21T23:03:52.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.424+0000 7f7153c00640 1 -- 172.21.15.99:0/2353397866 shutdown_connections 2024-02-21T23:03:52.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.424+0000 7f7153c00640 1 --2- 172.21.15.99:0/2353397866 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7134004de0 0x7f71340051c0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:52.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.424+0000 7f7153c00640 1 -- 172.21.15.99:0/2353397866 >> 172.21.15.99:0/2353397866 conn(0x7f714c0d6af0 msgr2=0x7f714c0740b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:03:52.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.424+0000 7f7153c00640 1 -- 172.21.15.99:0/2353397866 shutdown_connections 2024-02-21T23:03:52.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.424+0000 7f7153c00640 1 -- 172.21.15.99:0/2353397866 wait complete. 2024-02-21T23:03:52.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.428+0000 7f7153c00640 1 Processor -- start 2024-02-21T23:03:52.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.428+0000 7f7153c00640 1 -- start start 2024-02-21T23:03:52.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.430+0000 7f7153c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7134004de0 0x7f714c171e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:52.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.430+0000 7f7153c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f714c21c7b0 0x7f714c1711d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:52.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.430+0000 7f7153c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f714c171710 0x7f714c2212d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:52.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.430+0000 7f7153c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f714c1872d0 con 0x7f714c21c7b0 2024-02-21T23:03:52.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.430+0000 7f7153c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f714c187640 con 0x7f714c171710 2024-02-21T23:03:52.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.430+0000 7f7153c00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f714c187ad0 con 0x7f7134004de0 2024-02-21T23:03:52.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.430+0000 7f7151200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7134004de0 0x7f714c171e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:52.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.430+0000 7f714be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f714c21c7b0 0x7f714c1711d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:52.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.430+0000 7f7151200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7134004de0 0x7f714c171e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:60622/0 (socket says 172.21.15.99:60622) 2024-02-21T23:03:52.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.430+0000 7f7151200640 1 -- 172.21.15.99:0/506764075 learned_addr learned my addr 172.21.15.99:0/506764075 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:03:52.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.430+0000 7f7151c00640 1 --2- 172.21.15.99:0/506764075 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f714c171710 0x7f714c2212d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:52.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.431+0000 7f7151200640 1 -- 172.21.15.99:0/506764075 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f714c171710 msgr2=0x7f714c2212d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:52.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.431+0000 7f7151200640 1 --2- 172.21.15.99:0/506764075 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f714c171710 0x7f714c2212d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:52.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.431+0000 7f7151200640 1 -- 172.21.15.99:0/506764075 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f714c21c7b0 msgr2=0x7f714c1711d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:52.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.431+0000 7f7151200640 1 --2- 172.21.15.99:0/506764075 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f714c21c7b0 0x7f714c1711d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:52.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.431+0000 7f7151200640 1 -- 172.21.15.99:0/506764075 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f714c21fcb0 con 0x7f7134004de0 2024-02-21T23:03:52.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.431+0000 7f714be00640 1 --2- 172.21.15.99:0/506764075 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f714c21c7b0 0x7f714c1711d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:03:52.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.431+0000 7f7151200640 1 --2- 172.21.15.99:0/506764075 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7134004de0 0x7f714c171e60 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7140035040 tx=0x7f71400012b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:52.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.432+0000 7f7148c00640 1 -- 172.21.15.99:0/506764075 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7140042020 con 0x7f7134004de0 2024-02-21T23:03:52.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.432+0000 7f7148c00640 1 -- 172.21.15.99:0/506764075 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7140001590 con 0x7f7134004de0 2024-02-21T23:03:52.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.432+0000 7f7153c00640 1 -- 172.21.15.99:0/506764075 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f714c21ff50 con 0x7f7134004de0 2024-02-21T23:03:52.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.432+0000 7f7148c00640 1 -- 172.21.15.99:0/506764075 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7140037040 con 0x7f7134004de0 2024-02-21T23:03:52.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.432+0000 7f7153c00640 1 -- 172.21.15.99:0/506764075 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f714c220510 con 0x7f7134004de0 2024-02-21T23:03:52.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.435+0000 7f7148c00640 1 -- 172.21.15.99:0/506764075 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f7140045020 con 0x7f7134004de0 2024-02-21T23:03:52.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.436+0000 7f7148c00640 1 --2- 172.21.15.99:0/506764075 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f712c09ef00 0x7f712c0a13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:52.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.437+0000 7f7148c00640 1 -- 172.21.15.99:0/506764075 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f71400eb470 con 0x7f7134004de0 2024-02-21T23:03:52.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.437+0000 7f714be00640 1 --2- 172.21.15.99:0/506764075 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f712c09ef00 0x7f712c0a13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:52.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.438+0000 7f714be00640 1 --2- 172.21.15.99:0/506764075 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f712c09ef00 0x7f712c0a13c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f714c174aa0 tx=0x7f7138009040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:52.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.438+0000 7f7156c25740 1 Processor -- start 2024-02-21T23:03:52.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.438+0000 7f7156c25740 1 -- start start 2024-02-21T23:03:52.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.440+0000 7f7156c25740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56012e5e84b0 0x56012e5e8890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:52.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.440+0000 7f7156c25740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56012e623180 0x56012e623600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:52.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.440+0000 7f7156c25740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56012e623b40 0x56012e6243b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:52.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.440+0000 7f7156c25740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x56012e510b50 con 0x56012e623180 2024-02-21T23:03:52.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.440+0000 7f7156c25740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x56012e4b9da0 con 0x56012e623b40 2024-02-21T23:03:52.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.440+0000 7f7156c25740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x56012e50cbf0 con 0x56012e5e84b0 2024-02-21T23:03:52.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.441+0000 7f714be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56012e623180 0x56012e623600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:52.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.441+0000 7f7151200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56012e5e84b0 0x56012e5e8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:52.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.441+0000 7f714be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56012e623180 0x56012e623600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60962/0 (socket says 172.21.15.99:60962) 2024-02-21T23:03:52.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.441+0000 7f714be00640 1 -- 172.21.15.99:0/3101811819 learned_addr learned my addr 172.21.15.99:0/3101811819 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:03:52.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.441+0000 7f7151c00640 1 --2- 172.21.15.99:0/3101811819 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56012e623b40 0x56012e6243b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:52.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.441+0000 7f7151200640 1 -- 172.21.15.99:0/3101811819 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56012e623b40 msgr2=0x56012e6243b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:52.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.441+0000 7f7151200640 1 --2- 172.21.15.99:0/3101811819 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56012e623b40 0x56012e6243b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:52.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.441+0000 7f7151200640 1 -- 172.21.15.99:0/3101811819 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56012e623180 msgr2=0x56012e623600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:52.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.441+0000 7f7151200640 1 --2- 172.21.15.99:0/3101811819 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56012e623180 0x56012e623600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:52.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.441+0000 7f7151200640 1 -- 172.21.15.99:0/3101811819 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56012e4dcf80 con 0x56012e5e84b0 2024-02-21T23:03:52.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.442+0000 7f7151200640 1 --2- 172.21.15.99:0/3101811819 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56012e5e84b0 0x56012e5e8890 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f71400e8a80 tx=0x7f71400b88b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d6e4960f16e38e1 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:52.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.442+0000 7f713d600640 1 -- 172.21.15.99:0/3101811819 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71400b9360 con 0x56012e5e84b0 2024-02-21T23:03:52.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.442+0000 7f713d600640 1 -- 172.21.15.99:0/3101811819 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71400b8c60 con 0x56012e5e84b0 2024-02-21T23:03:52.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.442+0000 7f713d600640 1 -- 172.21.15.99:0/3101811819 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71400bcdb0 con 0x56012e5e84b0 2024-02-21T23:03:52.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.443+0000 7f7156c25740 1 -- 172.21.15.99:0/3101811819 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56012e5e84b0 msgr2=0x56012e5e8890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:52.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.443+0000 7f7156c25740 1 --2- 172.21.15.99:0/3101811819 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56012e5e84b0 0x56012e5e8890 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f71400e8a80 tx=0x7f71400b88b0 comp rx=0 tx=0).stop 2024-02-21T23:03:52.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.443+0000 7f7156c25740 1 -- 172.21.15.99:0/3101811819 shutdown_connections 2024-02-21T23:03:52.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.443+0000 7f7156c25740 1 --2- 172.21.15.99:0/3101811819 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56012e623b40 0x56012e6243b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:52.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.443+0000 7f7156c25740 1 --2- 172.21.15.99:0/3101811819 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56012e623180 0x56012e623600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:52.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.443+0000 7f7156c25740 1 --2- 172.21.15.99:0/3101811819 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56012e5e84b0 0x56012e5e8890 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:52.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.443+0000 7f7156c25740 1 -- 172.21.15.99:0/3101811819 >> 172.21.15.99:0/3101811819 conn(0x56012e5aa520 msgr2=0x56012e5ab5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:03:52.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.443+0000 7f7156c25740 1 -- 172.21.15.99:0/3101811819 shutdown_connections 2024-02-21T23:03:52.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.443+0000 7f7156c25740 1 -- 172.21.15.99:0/3101811819 wait complete. 2024-02-21T23:03:52.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.445+0000 7f7156c25740 1 -- start start 2024-02-21T23:03:52.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.445+0000 7f7156c25740 1 Processor -- start 2024-02-21T23:03:52.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.447+0000 7f7156c25740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56012e623180 0x56012e5de240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:52.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.447+0000 7f7156c25740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56012e623b40 0x56012e5a84c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:52.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.447+0000 7f7156c25740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56012e5a6c50 0x56012e5a5c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:52.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.447+0000 7f7156c25740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x56012e4b9da0 con 0x56012e5a6c50 2024-02-21T23:03:52.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.447+0000 7f7156c25740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x56012e4af380 con 0x56012e623180 2024-02-21T23:03:52.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.447+0000 7f7156c25740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x56012e50cbf0 con 0x56012e623b40 2024-02-21T23:03:52.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.447+0000 7f7156c25740 10 client.0 _ll_register_callbacks cb 0x56012e508280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:03:52.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.448+0000 7f714be00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56012e623b40 0x56012e5a84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:52.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.448+0000 7f7151c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56012e5a6c50 0x56012e5a5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:52.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.448+0000 7f714be00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56012e623b40 0x56012e5a84c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:60648/0 (socket says 172.21.15.99:60648) 2024-02-21T23:03:52.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.448+0000 7f714be00640 1 -- 172.21.15.99:0/1228787019 learned_addr learned my addr 172.21.15.99:0/1228787019 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:03:52.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.448+0000 7f7151200640 1 --2- 172.21.15.99:0/1228787019 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56012e623180 0x56012e5de240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:52.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.448+0000 7f714be00640 1 -- 172.21.15.99:0/1228787019 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56012e623180 msgr2=0x56012e5de240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:52.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.448+0000 7f714be00640 1 --2- 172.21.15.99:0/1228787019 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56012e623180 0x56012e5de240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:52.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.448+0000 7f714be00640 1 -- 172.21.15.99:0/1228787019 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56012e5a6c50 msgr2=0x56012e5a5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:52.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.448+0000 7f714be00640 1 --2- 172.21.15.99:0/1228787019 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56012e5a6c50 0x56012e5a5c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:52.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.448+0000 7f714be00640 1 -- 172.21.15.99:0/1228787019 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56012e4d7c20 con 0x56012e623b40 2024-02-21T23:03:52.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.448+0000 7f714be00640 1 --2- 172.21.15.99:0/1228787019 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56012e623b40 0x56012e5a84c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f7138015e90 tx=0x7f7138001e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4647e1691921320a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:52.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.448+0000 7f7132000640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-02-21T23:03:52.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.449+0000 7f7132000640 1 -- 172.21.15.99:0/1228787019 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7138026070 con 0x56012e623b40 2024-02-21T23:03:52.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.449+0000 7f7132000640 1 -- 172.21.15.99:0/1228787019 <== mon.2 v2:172.21.15.181:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f7138014b30 con 0x56012e623b40 2024-02-21T23:03:52.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.449+0000 7f7156c25740 1 -- 172.21.15.99:0/1228787019 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f71400b8c60 con 0x56012e623b40 2024-02-21T23:03:52.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.449+0000 7f7132000640 1 -- 172.21.15.99:0/1228787019 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7138032050 con 0x56012e623b40 2024-02-21T23:03:52.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.449+0000 7f7156c25740 10 client.5600 fetch_fsmap learned FSMap version 15 2024-02-21T23:03:52.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.449+0000 7f7156c25740 1 -- 172.21.15.99:0/1228787019 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x56012e2253f0 con 0x56012e623b40 2024-02-21T23:03:52.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.449+0000 7f7132000640 1 -- 172.21.15.99:0/1228787019 <== mon.2 v2:172.21.15.181:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71400b8c60 con 0x56012e623b40 2024-02-21T23:03:52.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.450+0000 7f7132000640 1 -- 172.21.15.99:0/1228787019 <== mon.2 v2:172.21.15.181:3300/0 5 ==== fsmap(e 15) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f7138007050 con 0x56012e623b40 2024-02-21T23:03:52.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.450+0000 7f7156c25740 10 client.5600 fetch_fsmap finished waiting for FSMap version 15 2024-02-21T23:03:52.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.450+0000 7f7156c25740 10 client.5600 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:03:52.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.450+0000 7f7156c25740 20 client.5600 populate_metadata read hostname 'smithi099' 2024-02-21T23:03:52.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.450+0000 7f7156c25740 1 --2- 172.21.15.99:0/1228787019 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x56012e5a61b0 0x56012e6383f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:52.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.450+0000 7f7156c25740 4 client.5600 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:03:52.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.450+0000 7f7156c25740 1 -- 172.21.15.99:0/1228787019 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56012e51e090 con 0x56012e5a61b0 2024-02-21T23:03:52.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.450+0000 7f7151200640 1 --2- 172.21.15.99:0/1228787019 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x56012e5a61b0 0x56012e6383f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:52.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.451+0000 7f7151200640 1 --2- 172.21.15.99:0/1228787019 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x56012e5a61b0 0x56012e6383f0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=11610eb23093a8ee server_cookie=1d41313ad109cbb7 in_seq=0 out_seq=0 2024-02-21T23:03:52.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.451+0000 7f7132000640 10 client.5600 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:03:52.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.452+0000 7f7132000640 1 -- 172.21.15.99:0/1228787019 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x56012e51e090 con 0x56012e5a61b0 2024-02-21T23:03:52.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.452+0000 7f7132000640 10 client.5600 handle_command_reply: tid=0 2024-02-21T23:03:52.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.452+0000 7f7156c25740 1 client.5600 shutdown 2024-02-21T23:03:52.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.452+0000 7f7156c25740 1 -- 172.21.15.99:0/1228787019 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56012e623b40 msgr2=0x56012e5a84c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:52.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.452+0000 7f7156c25740 1 --2- 172.21.15.99:0/1228787019 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56012e623b40 0x56012e5a84c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f7138015e90 tx=0x7f7138001e70 comp rx=0 tx=0).stop 2024-02-21T23:03:52.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.452+0000 7f7156c25740 1 -- 172.21.15.99:0/1228787019 shutdown_connections 2024-02-21T23:03:52.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.452+0000 7f7156c25740 1 --2- 172.21.15.99:0/1228787019 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x56012e5a61b0 0x56012e6383f0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:52.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.452+0000 7f7156c25740 1 --2- 172.21.15.99:0/1228787019 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56012e5a6c50 0x56012e5a5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:52.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.452+0000 7f7156c25740 1 --2- 172.21.15.99:0/1228787019 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56012e623b40 0x56012e5a84c0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:52.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.452+0000 7f7156c25740 1 --2- 172.21.15.99:0/1228787019 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56012e623180 0x56012e5de240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:52.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.452+0000 7f7132000640 0 client.5600 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:03:52.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.452+0000 7f7156c25740 1 -- 172.21.15.99:0/1228787019 >> 172.21.15.99:0/1228787019 conn(0x56012e5e84b0 msgr2=0x56012e6225d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:03:52.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.452+0000 7f7156c25740 1 -- 172.21.15.99:0/1228787019 shutdown_connections 2024-02-21T23:03:52.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.452+0000 7f7156c25740 1 -- 172.21.15.99:0/1228787019 wait complete. 2024-02-21T23:03:52.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.453+0000 7f7156c25740 20 client.5600 trim_cache size 0 max 16384 2024-02-21T23:03:52.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.467+0000 7f7156c25740 1 Processor -- start 2024-02-21T23:03:52.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.467+0000 7f7156c25740 1 -- start start 2024-02-21T23:03:52.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.469+0000 7f7156c25740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56012e5a6c50 0x56012e618930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:52.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.469+0000 7f7156c25740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56012e623180 0x56012e68b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:52.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.469+0000 7f7156c25740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56012e623b40 0x56012e68bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:52.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.469+0000 7f7156c25740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f714c070c60 con 0x56012e623180 2024-02-21T23:03:52.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.469+0000 7f7156c25740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f714c06ed20 con 0x56012e5a6c50 2024-02-21T23:03:52.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.469+0000 7f7156c25740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f714c070600 con 0x56012e623b40 2024-02-21T23:03:52.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.469+0000 7f7151200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56012e5a6c50 0x56012e618930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:52.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.469+0000 7f7151200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56012e5a6c50 0x56012e618930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:36510/0 (socket says 172.21.15.99:36510) 2024-02-21T23:03:52.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.469+0000 7f7151200640 1 -- 172.21.15.99:0/1336900499 learned_addr learned my addr 172.21.15.99:0/1336900499 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:03:52.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.469+0000 7f7151c00640 1 --2- 172.21.15.99:0/1336900499 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56012e623b40 0x56012e68bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:52.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.470+0000 7f714be00640 1 --2- 172.21.15.99:0/1336900499 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56012e623180 0x56012e68b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:52.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.470+0000 7f7151c00640 1 -- 172.21.15.99:0/1336900499 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56012e5a6c50 msgr2=0x56012e618930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:52.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.470+0000 7f7151c00640 1 --2- 172.21.15.99:0/1336900499 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56012e5a6c50 0x56012e618930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:52.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.470+0000 7f7151c00640 1 -- 172.21.15.99:0/1336900499 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56012e623180 msgr2=0x56012e68b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:52.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.470+0000 7f7151c00640 1 --2- 172.21.15.99:0/1336900499 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56012e623180 0x56012e68b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:52.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.470+0000 7f7151c00640 1 -- 172.21.15.99:0/1336900499 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56012e2ef7d0 con 0x56012e623b40 2024-02-21T23:03:52.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.470+0000 7f7151c00640 1 --2- 172.21.15.99:0/1336900499 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56012e623b40 0x56012e68bb60 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f714c0715c0 tx=0x7f71440167f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69719cbb9e0cf51a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:52.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.471+0000 7f713cc00640 1 -- 172.21.15.99:0/1336900499 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7144001fc0 con 0x56012e623b40 2024-02-21T23:03:52.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.471+0000 7f713cc00640 1 -- 172.21.15.99:0/1336900499 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7144003b80 con 0x56012e623b40 2024-02-21T23:03:52.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.471+0000 7f7156c25740 1 -- 172.21.15.99:0/1336900499 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56012e623b40 msgr2=0x56012e68bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:52.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.471+0000 7f7156c25740 1 --2- 172.21.15.99:0/1336900499 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56012e623b40 0x56012e68bb60 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f714c0715c0 tx=0x7f71440167f0 comp rx=0 tx=0).stop 2024-02-21T23:03:52.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.471+0000 7f7156c25740 1 -- 172.21.15.99:0/1336900499 shutdown_connections 2024-02-21T23:03:52.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.471+0000 7f7156c25740 1 --2- 172.21.15.99:0/1336900499 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56012e623b40 0x56012e68bb60 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:52.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.471+0000 7f7156c25740 1 --2- 172.21.15.99:0/1336900499 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56012e623180 0x56012e68b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:52.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.471+0000 7f7156c25740 1 --2- 172.21.15.99:0/1336900499 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56012e5a6c50 0x56012e618930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:52.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.472+0000 7f7156c25740 1 -- 172.21.15.99:0/1336900499 >> 172.21.15.99:0/1336900499 conn(0x56012e5e84b0 msgr2=0x56012e5ece90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:03:52.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.472+0000 7f7156c25740 1 -- 172.21.15.99:0/1336900499 shutdown_connections 2024-02-21T23:03:52.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.472+0000 7f7156c25740 1 -- 172.21.15.99:0/1336900499 wait complete. 2024-02-21T23:03:52.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.473+0000 7f7156c25740 1 -- start start 2024-02-21T23:03:52.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.473+0000 7f7156c25740 1 Processor -- start 2024-02-21T23:03:52.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.474+0000 7f7156c25740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56012e5a6c50 0x56012e5eb710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:52.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.474+0000 7f7156c25740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56012e623180 0x56012e6448c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:52.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.474+0000 7f7156c25740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56012e623b40 0x56012e644e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:52.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.474+0000 7f7156c25740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f714c06f940 con 0x56012e5a6c50 2024-02-21T23:03:52.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.474+0000 7f7156c25740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f714c06f320 con 0x56012e623b40 2024-02-21T23:03:52.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.474+0000 7f7156c25740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f714c06ffa0 con 0x56012e623180 2024-02-21T23:03:52.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.474+0000 7f7156c25740 10 client.0 _ll_register_callbacks cb 0x7f7138008f90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:03:52.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.475+0000 7f7151c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56012e623b40 0x56012e644e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:52.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.475+0000 7f7151c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56012e623b40 0x56012e644e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:36524/0 (socket says 172.21.15.99:36524) 2024-02-21T23:03:52.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.475+0000 7f7151c00640 1 -- 172.21.15.99:0/1623419831 learned_addr learned my addr 172.21.15.99:0/1623419831 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:03:52.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.475+0000 7f7151200640 1 --2- 172.21.15.99:0/1623419831 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56012e5a6c50 0x56012e5eb710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:52.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.475+0000 7f714be00640 1 --2- 172.21.15.99:0/1623419831 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56012e623180 0x56012e6448c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:52.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.475+0000 7f7151c00640 1 -- 172.21.15.99:0/1623419831 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56012e623180 msgr2=0x56012e6448c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:52.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.475+0000 7f7151c00640 1 --2- 172.21.15.99:0/1623419831 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56012e623180 0x56012e6448c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:52.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.475+0000 7f7151c00640 1 -- 172.21.15.99:0/1623419831 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56012e5a6c50 msgr2=0x56012e5eb710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:52.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.475+0000 7f7151c00640 1 --2- 172.21.15.99:0/1623419831 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56012e5a6c50 0x56012e5eb710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:52.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.475+0000 7f7151c00640 1 -- 172.21.15.99:0/1623419831 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56012e5e1e60 con 0x56012e623b40 2024-02-21T23:03:52.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.475+0000 7f7151200640 1 --2- 172.21.15.99:0/1623419831 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56012e5a6c50 0x56012e5eb710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:03:52.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.476+0000 7f7151c00640 1 --2- 172.21.15.99:0/1623419831 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56012e623b40 0x56012e644e00 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f714c091be0 tx=0x7f7144001a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ec7355075de4e0d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:52.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.476+0000 7f7132000640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-02-21T23:03:52.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.476+0000 7f7132000640 1 -- 172.21.15.99:0/1623419831 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7144001fc0 con 0x56012e623b40 2024-02-21T23:03:52.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.476+0000 7f7156c25740 1 -- 172.21.15.99:0/1623419831 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7144003b80 con 0x56012e623b40 2024-02-21T23:03:52.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.476+0000 7f7132000640 1 -- 172.21.15.99:0/1623419831 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f714401c040 con 0x56012e623b40 2024-02-21T23:03:52.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.476+0000 7f7132000640 1 -- 172.21.15.99:0/1623419831 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7144033050 con 0x56012e623b40 2024-02-21T23:03:52.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.476+0000 7f7156c25740 10 client.5593 fetch_fsmap learned FSMap version 15 2024-02-21T23:03:52.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.476+0000 7f7156c25740 1 -- 172.21.15.99:0/1623419831 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x56012e624da0 con 0x56012e623b40 2024-02-21T23:03:52.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.476+0000 7f7132000640 1 -- 172.21.15.99:0/1623419831 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7144003b80 con 0x56012e623b40 2024-02-21T23:03:52.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.477+0000 7f7132000640 1 -- 172.21.15.99:0/1623419831 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 15) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f7144021630 con 0x56012e623b40 2024-02-21T23:03:52.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.477+0000 7f7156c25740 10 client.5593 fetch_fsmap finished waiting for FSMap version 15 2024-02-21T23:03:52.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.477+0000 7f7156c25740 10 client.5593 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:03:52.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.477+0000 7f7156c25740 20 client.5593 populate_metadata read hostname 'smithi099' 2024-02-21T23:03:52.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.477+0000 7f7156c25740 1 --2- 172.21.15.99:0/1623419831 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x56012e624360 0x56012e645340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:52.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.477+0000 7f7156c25740 4 client.5593 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T23:03:52.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.477+0000 7f7156c25740 1 -- 172.21.15.99:0/1623419831 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56012e5183e0 con 0x56012e624360 2024-02-21T23:03:52.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.477+0000 7f7151200640 1 --2- 172.21.15.99:0/1623419831 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x56012e624360 0x56012e645340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:52.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.477+0000 7f7151200640 1 --2- 172.21.15.99:0/1623419831 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x56012e624360 0x56012e645340 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e26619cc30ba9355 server_cookie=f0fa150aa1123dda in_seq=0 out_seq=0 2024-02-21T23:03:52.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.477+0000 7f7132000640 10 client.5593 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:03:52.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.478+0000 7f7132000640 1 -- 172.21.15.99:0/1623419831 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56012e5183e0 con 0x56012e624360 2024-02-21T23:03:52.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.478+0000 7f7132000640 10 client.5593 handle_command_reply: tid=0 2024-02-21T23:03:52.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.478+0000 7f7156c25740 1 client.5593 shutdown 2024-02-21T23:03:52.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.478+0000 7f7156c25740 1 -- 172.21.15.99:0/1623419831 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56012e623b40 msgr2=0x56012e644e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:52.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.478+0000 7f7156c25740 1 --2- 172.21.15.99:0/1623419831 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56012e623b40 0x56012e644e00 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f714c091be0 tx=0x7f7144001a20 comp rx=0 tx=0).stop 2024-02-21T23:03:52.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.478+0000 7f7156c25740 1 -- 172.21.15.99:0/1623419831 shutdown_connections 2024-02-21T23:03:52.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.478+0000 7f7156c25740 1 --2- 172.21.15.99:0/1623419831 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x56012e624360 0x56012e645340 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:52.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.478+0000 7f7156c25740 1 --2- 172.21.15.99:0/1623419831 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56012e623b40 0x56012e644e00 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:52.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.478+0000 7f7156c25740 1 --2- 172.21.15.99:0/1623419831 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56012e623180 0x56012e6448c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:52.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.478+0000 7f7156c25740 1 --2- 172.21.15.99:0/1623419831 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56012e5a6c50 0x56012e5eb710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:52.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.478+0000 7f7132000640 0 client.5593 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:03:52.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.478+0000 7f7156c25740 1 -- 172.21.15.99:0/1623419831 >> 172.21.15.99:0/1623419831 conn(0x56012e5e84b0 msgr2=0x56012e6268c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:03:52.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.478+0000 7f7156c25740 1 -- 172.21.15.99:0/1623419831 shutdown_connections 2024-02-21T23:03:52.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.478+0000 7f7156c25740 1 -- 172.21.15.99:0/1623419831 wait complete. 2024-02-21T23:03:52.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.479+0000 7f7156c25740 20 client.5593 trim_cache size 0 max 16384 2024-02-21T23:03:52.471 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-02-21T23:03:52.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.479+0000 7f7153c00640 1 -- 172.21.15.99:0/506764075 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f712c09ef00 msgr2=0x7f712c0a13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:52.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.479+0000 7f7153c00640 1 --2- 172.21.15.99:0/506764075 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f712c09ef00 0x7f712c0a13c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f714c174aa0 tx=0x7f7138009040 comp rx=0 tx=0).stop 2024-02-21T23:03:52.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.479+0000 7f7153c00640 1 -- 172.21.15.99:0/506764075 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7134004de0 msgr2=0x7f714c171e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:52.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.479+0000 7f7153c00640 1 --2- 172.21.15.99:0/506764075 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7134004de0 0x7f714c171e60 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7140035040 tx=0x7f71400012b0 comp rx=0 tx=0).stop 2024-02-21T23:03:52.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.479+0000 7f7153c00640 1 -- 172.21.15.99:0/506764075 shutdown_connections 2024-02-21T23:03:52.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.479+0000 7f7153c00640 1 --2- 172.21.15.99:0/506764075 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f712c09ef00 0x7f712c0a13c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:52.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.479+0000 7f7153c00640 1 --2- 172.21.15.99:0/506764075 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f714c171710 0x7f714c2212d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:52.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.479+0000 7f7153c00640 1 --2- 172.21.15.99:0/506764075 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f714c21c7b0 0x7f714c1711d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:52.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.479+0000 7f7153c00640 1 --2- 172.21.15.99:0/506764075 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7134004de0 0x7f714c171e60 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:52.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.479+0000 7f7153c00640 1 -- 172.21.15.99:0/506764075 >> 172.21.15.99:0/506764075 conn(0x7f714c0d6af0 msgr2=0x7f714c068e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:03:52.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.480+0000 7f7153c00640 1 -- 172.21.15.99:0/506764075 shutdown_connections 2024-02-21T23:03:52.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:52.480+0000 7f7153c00640 1 -- 172.21.15.99:0/506764075 wait complete. 2024-02-21T23:03:53.128 INFO:tasks.workunit.client.0.smithi099.stderr:Updating files: 45% (5534/12253) Updating files: 46% (5637/12253) Updating files: 47% (5759/12253) Updating files: 48% (5882/12253) Updating files: 49% (6004/12253) Updating files: 50% (6127/12253) Updating files: 51% (6250/12253) Updating files: 52% (6372/12253) Updating files: 53% (6495/12253) Updating files: 54% (6617/12253) Updating files: 55% (6740/12253) Updating files: 56% (6862/12253) Updating files: 57% (6985/12253) Updating files: 58% (7107/12253) Updating files: 59% (7230/12253) Updating files: 60% (7352/12253) Updating files: 61% (7475/12253) Updating files: 62% (7597/12253) Updating files: 63% (7720/12253) Updating files: 64% (7842/12253) Updating files: 65% (7965/12253) Updating files: 66% (8087/12253) Updating files: 67% (8210/12253) Updating files: 68% (8333/12253) Updating files: 69% (8455/12253) Updating files: 70% (8578/12253) Updating files: 71% (8700/12253) Updating files: 72% (8823/12253) Updating files: 73% (8945/12253) Updating files: 74% (9068/12253) Updating files: 75% (9190/12253) Updating files: 76% (9313/12253) Updating files: 77% (9435/12253) Updating files: 78% (9558/12253) Updating files: 79% (9680/12253) Updating files: 79% (9753/12253) Updating files: 80% (9803/12253) Updating files: 81% (9925/12253) Updating files: 82% (10048/12253) Updating files: 83% (10170/12253) Updating files: 84% (10293/12253) Updating files: 85% (10416/12253) Updating files: 86% (10538/12253) Updating files: 87% (10661/12253) Updating files: 88% (10783/12253) Updating files: 89% (10906/12253) Updating files: 90% (11028/12253) Updating files: 91% (11151/12253) Updating files: 92% (11273/12253) Updating files: 93% (11396/12253) Updating files: 94% (11518/12253) Updating files: 95% (11641/12253) Updating files: 96% (11763/12253) Updating files: 97% (11886/12253) Updating files: 98% (12008/12253) Updating files: 99% (12131/12253) Updating files: 100% (12253/12253) Updating files: 100% (12253/12253), done. 2024-02-21T23:03:53.489 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-02-21T23:03:53.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T23:03:53.489 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-02-21T23:03:53.537 INFO:tasks.workunit.client.0.smithi099.stderr:Note: switching to '3bfc837d7b45ce8e095d92fa9c342964cea5e95f'. 2024-02-21T23:03:53.537 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-02-21T23:03:53.537 INFO:tasks.workunit.client.0.smithi099.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-02-21T23:03:53.538 INFO:tasks.workunit.client.0.smithi099.stderr:changes and commit them, and you can discard any commits you make in this 2024-02-21T23:03:53.538 INFO:tasks.workunit.client.0.smithi099.stderr:state without impacting any branches by switching back to a branch. 2024-02-21T23:03:53.538 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-02-21T23:03:53.538 INFO:tasks.workunit.client.0.smithi099.stderr:If you want to create a new branch to retain commits you create, you may 2024-02-21T23:03:53.538 INFO:tasks.workunit.client.0.smithi099.stderr:do so (now or later) by using -c with the switch command. Example: 2024-02-21T23:03:53.538 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-02-21T23:03:53.538 INFO:tasks.workunit.client.0.smithi099.stderr: git switch -c 2024-02-21T23:03:53.538 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-02-21T23:03:53.538 INFO:tasks.workunit.client.0.smithi099.stderr:Or undo this operation with: 2024-02-21T23:03:53.538 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-02-21T23:03:53.538 INFO:tasks.workunit.client.0.smithi099.stderr: git switch - 2024-02-21T23:03:53.538 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-02-21T23:03:53.538 INFO:tasks.workunit.client.0.smithi099.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-02-21T23:03:53.538 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-02-21T23:03:53.539 INFO:tasks.workunit.client.0.smithi099.stderr:HEAD is now at 3bfc837d7b4 test workaround 2024-02-21T23:03:53.545 DEBUG:teuthology.orchestra.run.smithi099:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-02-21T23:03:53.644 INFO:tasks.workunit.client.0.smithi099.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-02-21T23:03:53.651 INFO:tasks.workunit.client.0.smithi099.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-02-21T23:03:53.651 INFO:tasks.workunit.client.0.smithi099.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-02-21T23:03:53.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.718+0000 7f7cb0a00640 1 Processor -- start 2024-02-21T23:03:53.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.718+0000 7f7cb0a00640 1 -- start start 2024-02-21T23:03:53.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.720+0000 7f7cb0a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7cac182be0 0x7f7cac18b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:53.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.720+0000 7f7cb0a00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f7cac18b990 0x7f7cac1890f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:53.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.720+0000 7f7cb0a00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cac18bda0 con 0x7f7cac06fed0 2024-02-21T23:03:53.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.720+0000 7f7cb0a00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cac18a0d0 con 0x7f7cac182be0 2024-02-21T23:03:53.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.720+0000 7f7cb0a00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cac18a3b0 con 0x7f7cac18b990 2024-02-21T23:03:53.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.720+0000 7f7cab400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7cac182be0 0x7f7cac18b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:53.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.720+0000 7f7ca3e00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f7cac06fed0 0x7f7cac1889e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:50200/0 (socket says 172.21.15.99:50200) 2024-02-21T23:03:53.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.720+0000 7f7ca3e00640 1 -- 172.21.15.99:0/2511347343 learned_addr learned my addr 172.21.15.99:0/2511347343 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:03:53.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.720+0000 7f7cabe00640 1 --2- 172.21.15.99:0/2511347343 >> v2:172.21.15.181:3300/0 conn(0x7f7cac18b990 0x7f7cac1890f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:53.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.721+0000 7f7cab400640 1 -- 172.21.15.99:0/2511347343 >> v2:172.21.15.181:3300/0 conn(0x7f7cac18b990 msgr2=0x7f7cac1890f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:53.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.721+0000 7f7cab400640 1 --2- 172.21.15.99:0/2511347343 >> v2:172.21.15.181:3300/0 conn(0x7f7cac18b990 0x7f7cac1890f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:53.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.721+0000 7f7cab400640 1 -- 172.21.15.99:0/2511347343 >> v1:172.21.15.99:6789/0 conn(0x7f7cac06fed0 legacy=0x7f7cac1889e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:53.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.721+0000 7f7cab400640 1 -- 172.21.15.99:0/2511347343 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cac18a690 con 0x7f7cac182be0 2024-02-21T23:03:53.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.721+0000 7f7caaa00640 1 -- 172.21.15.99:0/2511347343 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3750843538 0 0) 0x7f7cac18bda0 con 0x7f7cac06fed0 2024-02-21T23:03:53.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.722+0000 7f7cab400640 1 --2- 172.21.15.99:0/2511347343 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7cac182be0 0x7f7cac18b450 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7cac0efa70 tx=0x7f7c9c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40745b392c51d230 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:53.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.722+0000 7f7caaa00640 1 -- 172.21.15.99:0/2511347343 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c9c035020 con 0x7f7cac182be0 2024-02-21T23:03:53.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.722+0000 7f7caaa00640 1 -- 172.21.15.99:0/2511347343 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c9c031830 con 0x7f7cac182be0 2024-02-21T23:03:53.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.722+0000 7f7caaa00640 1 -- 172.21.15.99:0/2511347343 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c9c031c00 con 0x7f7cac182be0 2024-02-21T23:03:53.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.723+0000 7f7cb0a00640 1 -- 172.21.15.99:0/2511347343 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7cac182be0 msgr2=0x7f7cac18b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:53.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.723+0000 7f7cb0a00640 1 --2- 172.21.15.99:0/2511347343 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7cac182be0 0x7f7cac18b450 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7cac0efa70 tx=0x7f7c9c02b8d0 comp rx=0 tx=0).stop 2024-02-21T23:03:53.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.723+0000 7f7cb0a00640 1 -- 172.21.15.99:0/2511347343 shutdown_connections 2024-02-21T23:03:53.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.723+0000 7f7cb0a00640 1 --2- 172.21.15.99:0/2511347343 >> v2:172.21.15.181:3300/0 conn(0x7f7cac18b990 0x7f7cac1890f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:53.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.723+0000 7f7cb0a00640 1 --2- 172.21.15.99:0/2511347343 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7cac182be0 0x7f7cac18b450 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:53.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.723+0000 7f7cb0a00640 1 -- 172.21.15.99:0/2511347343 >> 172.21.15.99:0/2511347343 conn(0x7f7cac0f8bb0 msgr2=0x7f7cac0f8fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:03:53.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.723+0000 7f7cb0a00640 1 -- 172.21.15.99:0/2511347343 shutdown_connections 2024-02-21T23:03:53.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.723+0000 7f7cb0a00640 1 -- 172.21.15.99:0/2511347343 wait complete. 2024-02-21T23:03:53.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.726+0000 7f7cb0a00640 1 Processor -- start 2024-02-21T23:03:53.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.727+0000 7f7cb0a00640 1 -- start start 2024-02-21T23:03:53.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.729+0000 7f7cb0a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7cac06fed0 0x7f7cac0fba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:53.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.729+0000 7f7cb0a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7cac182be0 0x7f7cac17bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:53.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.729+0000 7f7cb0a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7cac18b990 0x7f7cac21fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:53.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.729+0000 7f7cb0a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cac18af30 con 0x7f7cac18b990 2024-02-21T23:03:53.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.729+0000 7f7cb0a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cac18ac50 con 0x7f7cac06fed0 2024-02-21T23:03:53.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.729+0000 7f7cb0a00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cac1869b0 con 0x7f7cac182be0 2024-02-21T23:03:53.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.729+0000 7f7cab400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7cac06fed0 0x7f7cac0fba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:53.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.729+0000 7f7ca3e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7cac182be0 0x7f7cac17bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:53.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.729+0000 7f7cabe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7cac18b990 0x7f7cac21fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:53.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.729+0000 7f7cab400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7cac06fed0 0x7f7cac0fba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:36540/0 (socket says 172.21.15.99:36540) 2024-02-21T23:03:53.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.729+0000 7f7cab400640 1 -- 172.21.15.99:0/3592055343 learned_addr learned my addr 172.21.15.99:0/3592055343 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:03:53.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.730+0000 7f7ca3e00640 1 -- 172.21.15.99:0/3592055343 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7cac06fed0 msgr2=0x7f7cac0fba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:53.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.730+0000 7f7ca3e00640 1 --2- 172.21.15.99:0/3592055343 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7cac06fed0 0x7f7cac0fba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:53.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.730+0000 7f7ca3e00640 1 -- 172.21.15.99:0/3592055343 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7cac18b990 msgr2=0x7f7cac21fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:53.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.730+0000 7f7ca3e00640 1 --2- 172.21.15.99:0/3592055343 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7cac18b990 0x7f7cac21fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:53.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.730+0000 7f7ca3e00640 1 -- 172.21.15.99:0/3592055343 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cac0fa6b0 con 0x7f7cac182be0 2024-02-21T23:03:53.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.730+0000 7f7ca3e00640 1 --2- 172.21.15.99:0/3592055343 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7cac182be0 0x7f7cac17bf00 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7c9400c410 tx=0x7f7c9400c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:53.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.730+0000 7f7ca3400640 1 -- 172.21.15.99:0/3592055343 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c940074e0 con 0x7f7cac182be0 2024-02-21T23:03:53.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.730+0000 7f7ca3400640 1 -- 172.21.15.99:0/3592055343 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c940047e0 con 0x7f7cac182be0 2024-02-21T23:03:53.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.730+0000 7f7ca3400640 1 -- 172.21.15.99:0/3592055343 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c94004bd0 con 0x7f7cac182be0 2024-02-21T23:03:53.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.730+0000 7f7cb0a00640 1 -- 172.21.15.99:0/3592055343 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cac0fa990 con 0x7f7cac182be0 2024-02-21T23:03:53.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.730+0000 7f7cb0a00640 1 -- 172.21.15.99:0/3592055343 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cac0faf50 con 0x7f7cac182be0 2024-02-21T23:03:53.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.733+0000 7f7ca3400640 1 -- 172.21.15.99:0/3592055343 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f7c94011070 con 0x7f7cac182be0 2024-02-21T23:03:53.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.735+0000 7f7ca3400640 1 --2- 172.21.15.99:0/3592055343 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f7c8809eed0 0x7f7c880a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:53.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.735+0000 7f7ca3400640 1 -- 172.21.15.99:0/3592055343 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f7c940c9a40 con 0x7f7cac182be0 2024-02-21T23:03:53.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.735+0000 7f7cab400640 1 --2- 172.21.15.99:0/3592055343 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f7c8809eed0 0x7f7c880a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:53.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.736+0000 7f7cb4fbe740 1 Processor -- start 2024-02-21T23:03:53.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.736+0000 7f7cab400640 1 --2- 172.21.15.99:0/3592055343 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f7c8809eed0 0x7f7c880a1390 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c009560 tx=0x7f7c9c008030 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:53.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.736+0000 7f7cb4fbe740 1 -- start start 2024-02-21T23:03:53.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.738+0000 7f7cb4fbe740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5614158374c0 0x5614158378a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:53.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.738+0000 7f7cb4fbe740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561415837de0 0x561415872650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:53.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.738+0000 7f7cb4fbe740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561415872b90 0x561415873920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:53.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.738+0000 7f7cb4fbe740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x56141575f790 con 0x5614158374c0 2024-02-21T23:03:53.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.738+0000 7f7cb4fbe740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x561415708bf0 con 0x561415837de0 2024-02-21T23:03:53.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.738+0000 7f7cb4fbe740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x56141575b830 con 0x561415872b90 2024-02-21T23:03:53.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.738+0000 7f7cab400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5614158374c0 0x5614158378a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:53.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.738+0000 7f7cab400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5614158374c0 0x5614158378a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60998/0 (socket says 172.21.15.99:60998) 2024-02-21T23:03:53.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.738+0000 7f7cab400640 1 -- 172.21.15.99:0/1873926415 learned_addr learned my addr 172.21.15.99:0/1873926415 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:03:53.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.738+0000 7f7ca3e00640 1 --2- 172.21.15.99:0/1873926415 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561415837de0 0x561415872650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:53.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.738+0000 7f7cabe00640 1 --2- 172.21.15.99:0/1873926415 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561415872b90 0x561415873920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:53.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.739+0000 7f7cab400640 1 -- 172.21.15.99:0/1873926415 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561415872b90 msgr2=0x561415873920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:53.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.739+0000 7f7cab400640 1 --2- 172.21.15.99:0/1873926415 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561415872b90 0x561415873920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:53.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.739+0000 7f7cab400640 1 -- 172.21.15.99:0/1873926415 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561415837de0 msgr2=0x561415872650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:53.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.739+0000 7f7cab400640 1 --2- 172.21.15.99:0/1873926415 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561415837de0 0x561415872650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:53.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.739+0000 7f7cab400640 1 -- 172.21.15.99:0/1873926415 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561415726c40 con 0x5614158374c0 2024-02-21T23:03:53.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.739+0000 7f7cab400640 1 --2- 172.21.15.99:0/1873926415 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5614158374c0 0x5614158378a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c031c20 tx=0x7f7c9c030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91fd5769d6f8e3ef server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:53.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.739+0000 7f7c9b400640 1 -- 172.21.15.99:0/1873926415 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c9c035040 con 0x5614158374c0 2024-02-21T23:03:53.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.739+0000 7f7c9b400640 1 -- 172.21.15.99:0/1873926415 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c9c031d10 con 0x5614158374c0 2024-02-21T23:03:53.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.739+0000 7f7c9b400640 1 -- 172.21.15.99:0/1873926415 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c9c004230 con 0x5614158374c0 2024-02-21T23:03:53.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.740+0000 7f7cb4fbe740 1 -- 172.21.15.99:0/1873926415 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5614158374c0 msgr2=0x5614158378a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:53.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.740+0000 7f7cb4fbe740 1 --2- 172.21.15.99:0/1873926415 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5614158374c0 0x5614158378a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c031c20 tx=0x7f7c9c030000 comp rx=0 tx=0).stop 2024-02-21T23:03:53.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.740+0000 7f7cb4fbe740 1 -- 172.21.15.99:0/1873926415 shutdown_connections 2024-02-21T23:03:53.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.740+0000 7f7cb4fbe740 1 --2- 172.21.15.99:0/1873926415 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561415872b90 0x561415873920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:53.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.740+0000 7f7cb4fbe740 1 --2- 172.21.15.99:0/1873926415 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561415837de0 0x561415872650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:53.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.740+0000 7f7cb4fbe740 1 --2- 172.21.15.99:0/1873926415 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5614158374c0 0x5614158378a0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:53.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.740+0000 7f7cb4fbe740 1 -- 172.21.15.99:0/1873926415 >> 172.21.15.99:0/1873926415 conn(0x5614157f9a90 msgr2=0x5614157fab10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:03:53.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.740+0000 7f7cb4fbe740 1 -- 172.21.15.99:0/1873926415 shutdown_connections 2024-02-21T23:03:53.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.740+0000 7f7cb4fbe740 1 -- 172.21.15.99:0/1873926415 wait complete. 2024-02-21T23:03:53.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.741+0000 7f7cb4fbe740 1 -- start start 2024-02-21T23:03:53.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.741+0000 7f7cb4fbe740 1 Processor -- start 2024-02-21T23:03:53.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.743+0000 7f7cb4fbe740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561415837de0 0x5614158292c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:53.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.743+0000 7f7cb4fbe740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561415872b90 0x56141582f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:53.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.743+0000 7f7cb4fbe740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56141583b980 0x56141583c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:53.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.743+0000 7f7cb4fbe740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x56141575f790 con 0x561415872b90 2024-02-21T23:03:53.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.743+0000 7f7cb4fbe740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614156fe1d0 con 0x561415837de0 2024-02-21T23:03:53.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.743+0000 7f7cb4fbe740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x561415871070 con 0x56141583b980 2024-02-21T23:03:53.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.743+0000 7f7cb4fbe740 10 client.0 _ll_register_callbacks cb 0x561415473c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:03:53.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.743+0000 7f7ca3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561415872b90 0x56141582f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:53.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.743+0000 7f7ca3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561415872b90 0x56141582f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:32774/0 (socket says 172.21.15.99:32774) 2024-02-21T23:03:53.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.743+0000 7f7ca3e00640 1 -- 172.21.15.99:0/2286313967 learned_addr learned my addr 172.21.15.99:0/2286313967 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:03:53.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.743+0000 7f7cab400640 1 --2- 172.21.15.99:0/2286313967 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561415837de0 0x5614158292c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:53.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.743+0000 7f7cabe00640 1 --2- 172.21.15.99:0/2286313967 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56141583b980 0x56141583c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:53.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.743+0000 7f7ca3e00640 1 -- 172.21.15.99:0/2286313967 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56141583b980 msgr2=0x56141583c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:53.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.743+0000 7f7ca3e00640 1 --2- 172.21.15.99:0/2286313967 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56141583b980 0x56141583c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:53.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.743+0000 7f7ca3e00640 1 -- 172.21.15.99:0/2286313967 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561415837de0 msgr2=0x5614158292c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:53.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.743+0000 7f7ca3e00640 1 --2- 172.21.15.99:0/2286313967 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561415837de0 0x5614158292c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:53.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.743+0000 7f7ca3e00640 1 -- 172.21.15.99:0/2286313967 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56141553c7e0 con 0x561415872b90 2024-02-21T23:03:53.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.744+0000 7f7ca3e00640 1 --2- 172.21.15.99:0/2286313967 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561415872b90 0x56141582f4c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7c94096fe0 tx=0x7f7c940957f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5a31ac4f7dc5a0b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:53.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.744+0000 7f7c8fe00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:03:53.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.744+0000 7f7c8fe00640 1 -- 172.21.15.99:0/2286313967 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c940972e0 con 0x561415872b90 2024-02-21T23:03:53.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.744+0000 7f7c8fe00640 1 -- 172.21.15.99:0/2286313967 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f7c940b4b40 con 0x561415872b90 2024-02-21T23:03:53.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.744+0000 7f7cb4fbe740 1 -- 172.21.15.99:0/2286313967 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7c9c031d10 con 0x561415872b90 2024-02-21T23:03:53.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.744+0000 7f7c8fe00640 1 -- 172.21.15.99:0/2286313967 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7c9409b430 con 0x561415872b90 2024-02-21T23:03:53.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.744+0000 7f7cb4fbe740 10 client.5490 fetch_fsmap learned FSMap version 15 2024-02-21T23:03:53.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.744+0000 7f7cb4fbe740 1 -- 172.21.15.99:0/2286313967 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x56141559cf70 con 0x561415872b90 2024-02-21T23:03:53.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.744+0000 7f7c8fe00640 1 -- 172.21.15.99:0/2286313967 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c9c031d10 con 0x561415872b90 2024-02-21T23:03:53.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.745+0000 7f7c8fe00640 1 -- 172.21.15.99:0/2286313967 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 15) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f7c94096730 con 0x561415872b90 2024-02-21T23:03:53.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.745+0000 7f7cb4fbe740 10 client.5490 fetch_fsmap finished waiting for FSMap version 15 2024-02-21T23:03:53.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.745+0000 7f7cb4fbe740 10 client.5490 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:03:53.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.745+0000 7f7cb4fbe740 20 client.5490 populate_metadata read hostname 'smithi099' 2024-02-21T23:03:53.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.745+0000 7f7cb4fbe740 1 --2- 172.21.15.99:0/2286313967 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x56141587f7d0 0x56141587fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:53.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.745+0000 7f7cb4fbe740 4 client.5490 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:03:53.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.745+0000 7f7cb4fbe740 1 -- 172.21.15.99:0/2286313967 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56141576ccd0 con 0x56141587f7d0 2024-02-21T23:03:53.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.745+0000 7f7cab400640 1 --2- 172.21.15.99:0/2286313967 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x56141587f7d0 0x56141587fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:53.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.746+0000 7f7c8fe00640 10 client.5490 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:03:53.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.746+0000 7f7cab400640 1 --2- 172.21.15.99:0/2286313967 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x56141587f7d0 0x56141587fc20 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0e7c90e3ee54c58 server_cookie=df56d526fe3007da in_seq=0 out_seq=0 2024-02-21T23:03:53.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.747+0000 7f7c8fe00640 1 -- 172.21.15.99:0/2286313967 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x56141576ccd0 con 0x56141587f7d0 2024-02-21T23:03:53.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.747+0000 7f7c8fe00640 10 client.5490 handle_command_reply: tid=0 2024-02-21T23:03:53.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.747+0000 7f7cb4fbe740 1 client.5490 shutdown 2024-02-21T23:03:53.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.747+0000 7f7cb4fbe740 1 -- 172.21.15.99:0/2286313967 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561415872b90 msgr2=0x56141582f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:53.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.747+0000 7f7cb4fbe740 1 --2- 172.21.15.99:0/2286313967 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561415872b90 0x56141582f4c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7c94096fe0 tx=0x7f7c940957f0 comp rx=0 tx=0).stop 2024-02-21T23:03:53.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.748+0000 7f7cb4fbe740 1 -- 172.21.15.99:0/2286313967 shutdown_connections 2024-02-21T23:03:53.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.748+0000 7f7cb4fbe740 1 --2- 172.21.15.99:0/2286313967 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x56141587f7d0 0x56141587fc20 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:53.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.748+0000 7f7cb4fbe740 1 --2- 172.21.15.99:0/2286313967 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56141583b980 0x56141583c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:53.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.748+0000 7f7cb4fbe740 1 --2- 172.21.15.99:0/2286313967 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561415872b90 0x56141582f4c0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:53.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.748+0000 7f7cb4fbe740 1 --2- 172.21.15.99:0/2286313967 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561415837de0 0x5614158292c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:53.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.748+0000 7f7cb4fbe740 1 -- 172.21.15.99:0/2286313967 >> 172.21.15.99:0/2286313967 conn(0x5614158374c0 msgr2=0x561415872ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:03:53.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.748+0000 7f7c8fe00640 0 client.5490 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:03:53.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.748+0000 7f7cb4fbe740 1 -- 172.21.15.99:0/2286313967 shutdown_connections 2024-02-21T23:03:53.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.748+0000 7f7cb4fbe740 1 -- 172.21.15.99:0/2286313967 wait complete. 2024-02-21T23:03:53.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.748+0000 7f7cb4fbe740 20 client.5490 trim_cache size 0 max 16384 2024-02-21T23:03:53.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.782+0000 7f7cb4fbe740 1 Processor -- start 2024-02-21T23:03:53.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.782+0000 7f7cb4fbe740 1 -- start start 2024-02-21T23:03:53.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.784+0000 7f7cb4fbe740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561415837de0 0x561415830030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:53.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.784+0000 7f7cb4fbe740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56141583b980 0x561415867d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:53.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.784+0000 7f7cb4fbe740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561415872b90 0x561415802300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:53.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.784+0000 7f7cb4fbe740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cac22c6c0 con 0x56141583b980 2024-02-21T23:03:53.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.784+0000 7f7cb4fbe740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cac22a260 con 0x561415837de0 2024-02-21T23:03:53.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.784+0000 7f7cb4fbe740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cac228480 con 0x561415872b90 2024-02-21T23:03:53.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.784+0000 7f7ca3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56141583b980 0x561415867d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:53.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.784+0000 7f7ca3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56141583b980 0x561415867d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:32782/0 (socket says 172.21.15.99:32782) 2024-02-21T23:03:53.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.784+0000 7f7ca3e00640 1 -- 172.21.15.99:0/3498673900 learned_addr learned my addr 172.21.15.99:0/3498673900 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:03:53.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.784+0000 7f7cabe00640 1 --2- 172.21.15.99:0/3498673900 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561415872b90 0x561415802300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:53.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.784+0000 7f7cab400640 1 --2- 172.21.15.99:0/3498673900 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561415837de0 0x561415830030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:53.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.784+0000 7f7ca3e00640 1 -- 172.21.15.99:0/3498673900 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561415872b90 msgr2=0x561415802300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:53.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.784+0000 7f7ca3e00640 1 --2- 172.21.15.99:0/3498673900 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561415872b90 0x561415802300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:53.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.784+0000 7f7ca3e00640 1 -- 172.21.15.99:0/3498673900 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561415837de0 msgr2=0x561415830030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:53.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.784+0000 7f7ca3e00640 1 --2- 172.21.15.99:0/3498673900 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561415837de0 0x561415830030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:53.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.784+0000 7f7ca3e00640 1 -- 172.21.15.99:0/3498673900 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561415434170 con 0x56141583b980 2024-02-21T23:03:53.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.784+0000 7f7cab400640 1 --2- 172.21.15.99:0/3498673900 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561415837de0 0x561415830030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:03:53.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.785+0000 7f7ca3e00640 1 --2- 172.21.15.99:0/3498673900 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56141583b980 0x561415867d60 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7c9400cdd0 tx=0x7f7c940b5000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c5348ef2e6a8fc server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:53.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.785+0000 7f7c9aa00640 1 -- 172.21.15.99:0/3498673900 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c940972e0 con 0x56141583b980 2024-02-21T23:03:53.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.785+0000 7f7c9aa00640 1 -- 172.21.15.99:0/3498673900 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c9409fa80 con 0x56141583b980 2024-02-21T23:03:53.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.785+0000 7f7c9aa00640 1 -- 172.21.15.99:0/3498673900 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c940b4b40 con 0x56141583b980 2024-02-21T23:03:53.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.786+0000 7f7cb4fbe740 1 -- 172.21.15.99:0/3498673900 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56141583b980 msgr2=0x561415867d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:53.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.786+0000 7f7cb4fbe740 1 --2- 172.21.15.99:0/3498673900 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56141583b980 0x561415867d60 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7c9400cdd0 tx=0x7f7c940b5000 comp rx=0 tx=0).stop 2024-02-21T23:03:53.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.786+0000 7f7cb4fbe740 1 -- 172.21.15.99:0/3498673900 shutdown_connections 2024-02-21T23:03:53.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.786+0000 7f7cb4fbe740 1 --2- 172.21.15.99:0/3498673900 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561415872b90 0x561415802300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:53.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.786+0000 7f7cb4fbe740 1 --2- 172.21.15.99:0/3498673900 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56141583b980 0x561415867d60 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:53.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.786+0000 7f7cb4fbe740 1 --2- 172.21.15.99:0/3498673900 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561415837de0 0x561415830030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:53.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.786+0000 7f7cb4fbe740 1 -- 172.21.15.99:0/3498673900 >> 172.21.15.99:0/3498673900 conn(0x5614158374c0 msgr2=0x5614157fad10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:03:53.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.786+0000 7f7cb4fbe740 1 -- 172.21.15.99:0/3498673900 shutdown_connections 2024-02-21T23:03:53.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.786+0000 7f7cb4fbe740 1 -- 172.21.15.99:0/3498673900 wait complete. 2024-02-21T23:03:53.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.787+0000 7f7cb4fbe740 1 -- start start 2024-02-21T23:03:53.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.787+0000 7f7cb4fbe740 1 Processor -- start 2024-02-21T23:03:53.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.788+0000 7f7cb4fbe740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561415837de0 0x56141583c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:53.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.788+0000 7f7cb4fbe740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56141583b980 0x56141582b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:53.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.788+0000 7f7cb4fbe740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561415872b90 0x5614158ca980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:53.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.788+0000 7f7cb4fbe740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cac228960 con 0x56141583b980 2024-02-21T23:03:53.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.788+0000 7f7cb4fbe740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cac229c00 con 0x561415837de0 2024-02-21T23:03:53.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.788+0000 7f7cb4fbe740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cac228f60 con 0x561415872b90 2024-02-21T23:03:53.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.788+0000 7f7cb4fbe740 10 client.0 _ll_register_callbacks cb 0x7f7c940971a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:03:53.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.788+0000 7f7ca3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56141583b980 0x56141582b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:53.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.788+0000 7f7cabe00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561415872b90 0x5614158ca980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:53.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.788+0000 7f7cab400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561415837de0 0x56141583c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:53.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.788+0000 7f7ca3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56141583b980 0x56141582b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:32790/0 (socket says 172.21.15.99:32790) 2024-02-21T23:03:53.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.788+0000 7f7ca3e00640 1 -- 172.21.15.99:0/328983586 learned_addr learned my addr 172.21.15.99:0/328983586 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:03:53.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.789+0000 7f7ca3e00640 1 -- 172.21.15.99:0/328983586 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561415872b90 msgr2=0x5614158ca980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:53.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.789+0000 7f7ca3e00640 1 --2- 172.21.15.99:0/328983586 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561415872b90 0x5614158ca980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:53.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.789+0000 7f7ca3e00640 1 -- 172.21.15.99:0/328983586 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561415837de0 msgr2=0x56141583c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:53.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.789+0000 7f7ca3e00640 1 --2- 172.21.15.99:0/328983586 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561415837de0 0x56141583c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:53.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.789+0000 7f7ca3e00640 1 -- 172.21.15.99:0/328983586 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56141582b720 con 0x56141583b980 2024-02-21T23:03:53.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.789+0000 7f7cabe00640 1 --2- 172.21.15.99:0/328983586 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561415872b90 0x5614158ca980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:03:53.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.789+0000 7f7ca3e00640 1 --2- 172.21.15.99:0/328983586 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56141583b980 0x56141582b1e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7c940b6170 tx=0x7f7c94000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b81bded1fb16a8be server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:53.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.789+0000 7f7c8fe00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:03:53.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.789+0000 7f7c8fe00640 1 -- 172.21.15.99:0/328983586 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c940b4d40 con 0x56141583b980 2024-02-21T23:03:53.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.789+0000 7f7c8fe00640 1 -- 172.21.15.99:0/328983586 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f7c940c0b00 con 0x56141583b980 2024-02-21T23:03:53.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.789+0000 7f7cb4fbe740 1 -- 172.21.15.99:0/328983586 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7c9409fa80 con 0x56141583b980 2024-02-21T23:03:53.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.790+0000 7f7c8fe00640 1 -- 172.21.15.99:0/328983586 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7c940972e0 con 0x56141583b980 2024-02-21T23:03:53.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.790+0000 7f7cb4fbe740 10 client.5496 fetch_fsmap learned FSMap version 15 2024-02-21T23:03:53.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.790+0000 7f7cb4fbe740 1 -- 172.21.15.99:0/328983586 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x56141582b720 con 0x56141583b980 2024-02-21T23:03:53.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.790+0000 7f7c8fe00640 1 -- 172.21.15.99:0/328983586 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c9409fa80 con 0x56141583b980 2024-02-21T23:03:53.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.790+0000 7f7c8fe00640 1 -- 172.21.15.99:0/328983586 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 15) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f7c94092fa0 con 0x56141583b980 2024-02-21T23:03:53.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.790+0000 7f7cb4fbe740 10 client.5496 fetch_fsmap finished waiting for FSMap version 15 2024-02-21T23:03:53.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.790+0000 7f7cb4fbe740 10 client.5496 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:03:53.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.790+0000 7f7cb4fbe740 20 client.5496 populate_metadata read hostname 'smithi099' 2024-02-21T23:03:53.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.790+0000 7f7cb4fbe740 1 --2- 172.21.15.99:0/328983586 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x56141586ab50 0x5614158caec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:53.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.790+0000 7f7cb4fbe740 4 client.5496 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-02-21T23:03:53.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.790+0000 7f7cb4fbe740 1 -- 172.21.15.99:0/328983586 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x561415767020 con 0x56141586ab50 2024-02-21T23:03:53.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.791+0000 7f7cab400640 1 --2- 172.21.15.99:0/328983586 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x56141586ab50 0x5614158caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:53.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.791+0000 7f7cab400640 1 --2- 172.21.15.99:0/328983586 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x56141586ab50 0x5614158caec0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=397a04ab8da9da54 server_cookie=30e39505970b9989 in_seq=0 out_seq=0 2024-02-21T23:03:53.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.791+0000 7f7c8fe00640 10 client.5496 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:03:53.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.793+0000 7f7c8fe00640 1 -- 172.21.15.99:0/328983586 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x561415767020 con 0x56141586ab50 2024-02-21T23:03:53.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.793+0000 7f7c8fe00640 10 client.5496 handle_command_reply: tid=0 2024-02-21T23:03:53.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.793+0000 7f7cb4fbe740 1 client.5496 shutdown 2024-02-21T23:03:53.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.793+0000 7f7cb4fbe740 1 -- 172.21.15.99:0/328983586 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56141583b980 msgr2=0x56141582b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:53.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.793+0000 7f7cb4fbe740 1 --2- 172.21.15.99:0/328983586 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56141583b980 0x56141582b1e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7c940b6170 tx=0x7f7c94000ed0 comp rx=0 tx=0).stop 2024-02-21T23:03:53.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.794+0000 7f7cb4fbe740 1 -- 172.21.15.99:0/328983586 shutdown_connections 2024-02-21T23:03:53.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.794+0000 7f7cb4fbe740 1 --2- 172.21.15.99:0/328983586 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x56141586ab50 0x5614158caec0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:53.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.794+0000 7f7cb4fbe740 1 --2- 172.21.15.99:0/328983586 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561415872b90 0x5614158ca980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:53.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.794+0000 7f7cb4fbe740 1 --2- 172.21.15.99:0/328983586 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56141583b980 0x56141582b1e0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:53.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.794+0000 7f7cb4fbe740 1 --2- 172.21.15.99:0/328983586 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561415837de0 0x56141583c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:53.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.794+0000 7f7cb4fbe740 1 -- 172.21.15.99:0/328983586 >> 172.21.15.99:0/328983586 conn(0x5614158374c0 msgr2=0x56141587c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:03:53.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.794+0000 7f7c8fe00640 0 client.5496 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:03:53.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.794+0000 7f7cb4fbe740 1 -- 172.21.15.99:0/328983586 shutdown_connections 2024-02-21T23:03:53.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.794+0000 7f7cb4fbe740 1 -- 172.21.15.99:0/328983586 wait complete. 2024-02-21T23:03:53.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.795+0000 7f7cb4fbe740 20 client.5496 trim_cache size 0 max 16384 2024-02-21T23:03:53.786 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-02-21T23:03:53.786 INFO:teuthology.orchestra.run.smithi099.stdout: "return_code": 0, 2024-02-21T23:03:53.786 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_tag": "489a6320-0490-4812-93f2-8ce93efa607f", 2024-02-21T23:03:53.786 INFO:teuthology.orchestra.run.smithi099.stdout: "mode": "asynchronous" 2024-02-21T23:03:53.786 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-02-21T23:03:53.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.796+0000 7f7cb0a00640 1 -- 172.21.15.99:0/3592055343 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f7c8809eed0 msgr2=0x7f7c880a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:53.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.796+0000 7f7cb0a00640 1 --2- 172.21.15.99:0/3592055343 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f7c8809eed0 0x7f7c880a1390 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c009560 tx=0x7f7c9c008030 comp rx=0 tx=0).stop 2024-02-21T23:03:53.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.796+0000 7f7cb0a00640 1 -- 172.21.15.99:0/3592055343 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7cac182be0 msgr2=0x7f7cac17bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:53.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.796+0000 7f7cb0a00640 1 --2- 172.21.15.99:0/3592055343 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7cac182be0 0x7f7cac17bf00 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7c9400c410 tx=0x7f7c9400c8d0 comp rx=0 tx=0).stop 2024-02-21T23:03:53.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.796+0000 7f7cb0a00640 1 -- 172.21.15.99:0/3592055343 shutdown_connections 2024-02-21T23:03:53.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.796+0000 7f7cb0a00640 1 --2- 172.21.15.99:0/3592055343 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f7c8809eed0 0x7f7c880a1390 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:53.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.796+0000 7f7cb0a00640 1 --2- 172.21.15.99:0/3592055343 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7cac18b990 0x7f7cac21fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:53.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.796+0000 7f7cb0a00640 1 --2- 172.21.15.99:0/3592055343 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7cac182be0 0x7f7cac17bf00 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:53.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.796+0000 7f7cb0a00640 1 --2- 172.21.15.99:0/3592055343 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7cac06fed0 0x7f7cac0fba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:53.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.796+0000 7f7cb0a00640 1 -- 172.21.15.99:0/3592055343 >> 172.21.15.99:0/3592055343 conn(0x7f7cac0f8bb0 msgr2=0x7f7cac17dc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:03:53.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.796+0000 7f7cb0a00640 1 -- 172.21.15.99:0/3592055343 shutdown_connections 2024-02-21T23:03:53.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:53.796+0000 7f7cb0a00640 1 -- 172.21.15.99:0/3592055343 wait complete. 2024-02-21T23:03:53.803 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T23:03:53.803 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T23:03:53.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.009+0000 7fa4f7e00640 1 Processor -- start 2024-02-21T23:03:53.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.009+0000 7fa4f7e00640 1 -- start start 2024-02-21T23:03:54.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.012+0000 7fa4f7e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa4f80747b0 0x7fa4f8074c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:54.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.012+0000 7fa4f7e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa4f8188260 0x7fa4f8188710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:54.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.012+0000 7fa4f7e00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4f8070350 con 0x7fa4f817d5e0 2024-02-21T23:03:54.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.012+0000 7fa4f7e00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4f8071240 con 0x7fa4f80747b0 2024-02-21T23:03:54.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.012+0000 7fa4f7e00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4f8070630 con 0x7fa4f8188260 2024-02-21T23:03:54.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.012+0000 7fa4f6a00640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fa4f817d5e0 0x7fa4f806f910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:49972/0 (socket says 172.21.15.99:49972) 2024-02-21T23:03:54.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.012+0000 7fa4f6000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa4f80747b0 0x7fa4f8074c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:54.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.012+0000 7fa4f6a00640 1 -- 172.21.15.99:0/3373779193 learned_addr learned my addr 172.21.15.99:0/3373779193 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:03:54.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.012+0000 7fa4f7400640 1 --2- 172.21.15.99:0/3373779193 >> v2:172.21.15.162:3300/0 conn(0x7fa4f8188260 0x7fa4f8188710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:54.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.012+0000 7fa4f5600640 1 -- 172.21.15.99:0/3373779193 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 481357417 0 0) 0x7fa4f8070350 con 0x7fa4f817d5e0 2024-02-21T23:03:54.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.013+0000 7fa4f5600640 1 -- 172.21.15.99:0/3373779193 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4dc003520 con 0x7fa4f817d5e0 2024-02-21T23:03:54.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.013+0000 7fa4f6000640 1 -- 172.21.15.99:0/3373779193 >> v2:172.21.15.162:3300/0 conn(0x7fa4f8188260 msgr2=0x7fa4f8188710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:54.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.013+0000 7fa4f6000640 1 --2- 172.21.15.99:0/3373779193 >> v2:172.21.15.162:3300/0 conn(0x7fa4f8188260 0x7fa4f8188710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:54.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.013+0000 7fa4f6000640 1 -- 172.21.15.99:0/3373779193 >> v1:172.21.15.181:6789/0 conn(0x7fa4f817d5e0 legacy=0x7fa4f806f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:54.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.013+0000 7fa4f6000640 1 -- 172.21.15.99:0/3373779193 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4f8070910 con 0x7fa4f80747b0 2024-02-21T23:03:54.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.014+0000 7fa4f6000640 1 --2- 172.21.15.99:0/3373779193 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa4f80747b0 0x7fa4f8074c10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fa4f808e270 tx=0x7fa4e402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae6a51c2d295aed server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:54.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.015+0000 7fa4f5600640 1 -- 172.21.15.99:0/3373779193 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e4035020 con 0x7fa4f80747b0 2024-02-21T23:03:54.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.015+0000 7fa4f5600640 1 -- 172.21.15.99:0/3373779193 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4e4031830 con 0x7fa4f80747b0 2024-02-21T23:03:54.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.015+0000 7fa4f5600640 1 -- 172.21.15.99:0/3373779193 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e4031be0 con 0x7fa4f80747b0 2024-02-21T23:03:54.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.015+0000 7fa4f7e00640 1 -- 172.21.15.99:0/3373779193 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa4f80747b0 msgr2=0x7fa4f8074c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:54.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.015+0000 7fa4f7e00640 1 --2- 172.21.15.99:0/3373779193 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa4f80747b0 0x7fa4f8074c10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fa4f808e270 tx=0x7fa4e402b8d0 comp rx=0 tx=0).stop 2024-02-21T23:03:54.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.015+0000 7fa4f7e00640 1 -- 172.21.15.99:0/3373779193 shutdown_connections 2024-02-21T23:03:54.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.015+0000 7fa4f7e00640 1 --2- 172.21.15.99:0/3373779193 >> v2:172.21.15.162:3300/0 conn(0x7fa4f8188260 0x7fa4f8188710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:54.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.015+0000 7fa4f7e00640 1 --2- 172.21.15.99:0/3373779193 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa4f80747b0 0x7fa4f8074c10 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:54.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.015+0000 7fa4f7e00640 1 -- 172.21.15.99:0/3373779193 >> 172.21.15.99:0/3373779193 conn(0x7fa4f808cfd0 msgr2=0x7fa4f808d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:03:54.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.015+0000 7fa4f7e00640 1 -- 172.21.15.99:0/3373779193 shutdown_connections 2024-02-21T23:03:54.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.015+0000 7fa4f7e00640 1 -- 172.21.15.99:0/3373779193 wait complete. 2024-02-21T23:03:54.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.018+0000 7fa4f7e00640 1 Processor -- start 2024-02-21T23:03:54.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.018+0000 7fa4f7e00640 1 -- start start 2024-02-21T23:03:54.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.019+0000 7fa4f7e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4f80747b0 0x7fa4f8222830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:54.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.019+0000 7fa4f7e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa4f817d5e0 0x7fa4f816e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:54.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.019+0000 7fa4f7e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa4f8188260 0x7fa4f821fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:54.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.019+0000 7fa4f7e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f8070020 con 0x7fa4f8188260 2024-02-21T23:03:54.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.019+0000 7fa4f7e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f8070ed0 con 0x7fa4f80747b0 2024-02-21T23:03:54.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.019+0000 7fa4f7e00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f8188c50 con 0x7fa4f817d5e0 2024-02-21T23:03:54.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.019+0000 7fa4f7400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa4f8188260 0x7fa4f821fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:54.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.020+0000 7fa4f7400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa4f8188260 0x7fa4f821fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:32808/0 (socket says 172.21.15.99:32808) 2024-02-21T23:03:54.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.020+0000 7fa4f7400640 1 -- 172.21.15.99:0/2403555837 learned_addr learned my addr 172.21.15.99:0/2403555837 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:03:54.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.020+0000 7fa4f6a00640 1 --2- 172.21.15.99:0/2403555837 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4f80747b0 0x7fa4f8222830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:54.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.020+0000 7fa4f6000640 1 --2- 172.21.15.99:0/2403555837 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa4f817d5e0 0x7fa4f816e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:54.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.020+0000 7fa4f6a00640 1 -- 172.21.15.99:0/2403555837 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa4f817d5e0 msgr2=0x7fa4f816e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:54.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.020+0000 7fa4f6a00640 1 --2- 172.21.15.99:0/2403555837 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa4f817d5e0 0x7fa4f816e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:54.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.020+0000 7fa4f6a00640 1 -- 172.21.15.99:0/2403555837 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa4f8188260 msgr2=0x7fa4f821fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:54.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.020+0000 7fa4f6a00640 1 --2- 172.21.15.99:0/2403555837 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa4f8188260 0x7fa4f821fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:54.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.020+0000 7fa4f6a00640 1 -- 172.21.15.99:0/2403555837 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4f817b700 con 0x7fa4f80747b0 2024-02-21T23:03:54.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.020+0000 7fa4f6a00640 1 --2- 172.21.15.99:0/2403555837 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4f80747b0 0x7fa4f8222830 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa4e800c430 tx=0x7fa4e800c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:54.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.021+0000 7fa4ef400640 1 -- 172.21.15.99:0/2403555837 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e8017070 con 0x7fa4f80747b0 2024-02-21T23:03:54.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.021+0000 7fa4ef400640 1 -- 172.21.15.99:0/2403555837 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4e8005ce0 con 0x7fa4f80747b0 2024-02-21T23:03:54.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.021+0000 7fa4f7e00640 1 -- 172.21.15.99:0/2403555837 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4f817b9e0 con 0x7fa4f80747b0 2024-02-21T23:03:54.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.021+0000 7fa4ef400640 1 -- 172.21.15.99:0/2403555837 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e8007310 con 0x7fa4f80747b0 2024-02-21T23:03:54.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.021+0000 7fa4f7e00640 1 -- 172.21.15.99:0/2403555837 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4f817bfa0 con 0x7fa4f80747b0 2024-02-21T23:03:54.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.024+0000 7fa4ef400640 1 -- 172.21.15.99:0/2403555837 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7fa4e801a070 con 0x7fa4f80747b0 2024-02-21T23:03:54.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.026+0000 7fa500dc6740 1 Processor -- start 2024-02-21T23:03:54.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.026+0000 7fa500dc6740 1 -- start start 2024-02-21T23:03:54.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.026+0000 7fa4ef400640 1 --2- 172.21.15.99:0/2403555837 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa4d809ef00 0x7fa4d80a13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:54.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.026+0000 7fa4ef400640 1 -- 172.21.15.99:0/2403555837 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7fa4e80c9270 con 0x7fa4f80747b0 2024-02-21T23:03:54.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.026+0000 7fa4f7400640 1 --2- 172.21.15.99:0/2403555837 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa4d809ef00 0x7fa4d80a13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:54.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.027+0000 7fa4f7400640 1 --2- 172.21.15.99:0/2403555837 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa4d809ef00 0x7fa4d80a13c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa4f00094c0 tx=0x7fa4f000b040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:54.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.027+0000 7fa500dc6740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56151134a2a0 0x56151137fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:54.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.027+0000 7fa500dc6740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561511380260 0x56151134a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:54.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.027+0000 7fa500dc6740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56151134abc0 0x56151130d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:54.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.027+0000 7fa500dc6740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x561511276a90 con 0x56151134abc0 2024-02-21T23:03:54.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.027+0000 7fa500dc6740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x56151121fb10 con 0x56151134a2a0 2024-02-21T23:03:54.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.027+0000 7fa500dc6740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x561511272b30 con 0x561511380260 2024-02-21T23:03:54.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.028+0000 7fa4f6a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56151134a2a0 0x56151137fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:54.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.028+0000 7fa4f6a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56151134a2a0 0x56151137fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:36604/0 (socket says 172.21.15.99:36604) 2024-02-21T23:03:54.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.028+0000 7fa4f6a00640 1 -- 172.21.15.99:0/142347427 learned_addr learned my addr 172.21.15.99:0/142347427 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:03:54.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.028+0000 7fa4f6000640 1 --2- 172.21.15.99:0/142347427 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561511380260 0x56151134a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:54.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.028+0000 7fa4f7400640 1 --2- 172.21.15.99:0/142347427 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56151134abc0 0x56151130d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:54.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.028+0000 7fa4f6a00640 1 -- 172.21.15.99:0/142347427 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561511380260 msgr2=0x56151134a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:54.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.028+0000 7fa4f6a00640 1 --2- 172.21.15.99:0/142347427 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561511380260 0x56151134a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:54.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.028+0000 7fa4f6a00640 1 -- 172.21.15.99:0/142347427 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56151134abc0 msgr2=0x56151130d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:54.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.028+0000 7fa4f6a00640 1 --2- 172.21.15.99:0/142347427 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56151134abc0 0x56151130d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:54.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.028+0000 7fa4f6a00640 1 -- 172.21.15.99:0/142347427 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5615110557d0 con 0x56151134a2a0 2024-02-21T23:03:54.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.028+0000 7fa4f6a00640 1 --2- 172.21.15.99:0/142347427 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56151134a2a0 0x56151137fd20 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa4e809ed80 tx=0x7fa4e8096d10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d4a0390573858f7 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:54.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.029+0000 7fa4e3400640 1 -- 172.21.15.99:0/142347427 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e80c6ad0 con 0x56151134a2a0 2024-02-21T23:03:54.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.029+0000 7fa4e3400640 1 -- 172.21.15.99:0/142347427 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4e8093230 con 0x56151134a2a0 2024-02-21T23:03:54.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.029+0000 7fa4e3400640 1 -- 172.21.15.99:0/142347427 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e80076f0 con 0x56151134a2a0 2024-02-21T23:03:54.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.029+0000 7fa500dc6740 1 -- 172.21.15.99:0/142347427 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56151134a2a0 msgr2=0x56151137fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:54.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.029+0000 7fa500dc6740 1 --2- 172.21.15.99:0/142347427 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56151134a2a0 0x56151137fd20 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa4e809ed80 tx=0x7fa4e8096d10 comp rx=0 tx=0).stop 2024-02-21T23:03:54.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.029+0000 7fa500dc6740 1 -- 172.21.15.99:0/142347427 shutdown_connections 2024-02-21T23:03:54.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.029+0000 7fa500dc6740 1 --2- 172.21.15.99:0/142347427 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56151134abc0 0x56151130d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:54.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.029+0000 7fa500dc6740 1 --2- 172.21.15.99:0/142347427 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561511380260 0x56151134a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:54.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.029+0000 7fa500dc6740 1 --2- 172.21.15.99:0/142347427 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56151134a2a0 0x56151137fd20 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:54.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.029+0000 7fa500dc6740 1 -- 172.21.15.99:0/142347427 >> 172.21.15.99:0/142347427 conn(0x5615112d96b0 msgr2=0x561511311190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:03:54.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.029+0000 7fa500dc6740 1 -- 172.21.15.99:0/142347427 shutdown_connections 2024-02-21T23:03:54.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.029+0000 7fa500dc6740 1 -- 172.21.15.99:0/142347427 wait complete. 2024-02-21T23:03:54.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.030+0000 7fa500dc6740 1 -- start start 2024-02-21T23:03:54.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.030+0000 7fa500dc6740 1 Processor -- start 2024-02-21T23:03:54.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.032+0000 7fa500dc6740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56151134a2a0 0x561511382c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:54.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.032+0000 7fa500dc6740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56151134abc0 0x561511379f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:54.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.033+0000 7fa500dc6740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561511380260 0x56151133cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:54.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.033+0000 7fa500dc6740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x561511318f30 con 0x56151134a2a0 2024-02-21T23:03:54.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.033+0000 7fa500dc6740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615112151c0 con 0x56151134abc0 2024-02-21T23:03:54.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.033+0000 7fa500dc6740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x561511381930 con 0x561511380260 2024-02-21T23:03:54.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.033+0000 7fa500dc6740 10 client.0 _ll_register_callbacks cb 0x561511232930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:03:54.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.033+0000 7fa4f6a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56151134a2a0 0x561511382c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:54.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.033+0000 7fa4f6000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56151134abc0 0x561511379f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:54.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.033+0000 7fa4f6000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56151134abc0 0x561511379f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:36616/0 (socket says 172.21.15.99:36616) 2024-02-21T23:03:54.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.033+0000 7fa4f6000640 1 -- 172.21.15.99:0/1950638943 learned_addr learned my addr 172.21.15.99:0/1950638943 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:03:54.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.033+0000 7fa4f7400640 1 --2- 172.21.15.99:0/1950638943 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561511380260 0x56151133cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:54.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.033+0000 7fa4f6a00640 1 -- 172.21.15.99:0/1950638943 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561511380260 msgr2=0x56151133cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:54.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.033+0000 7fa4f6a00640 1 --2- 172.21.15.99:0/1950638943 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561511380260 0x56151133cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:54.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.033+0000 7fa4f6a00640 1 -- 172.21.15.99:0/1950638943 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56151134abc0 msgr2=0x561511379f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:54.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.033+0000 7fa4f6a00640 1 --2- 172.21.15.99:0/1950638943 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56151134abc0 0x561511379f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:54.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.033+0000 7fa4f6a00640 1 -- 172.21.15.99:0/1950638943 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561510f8b3f0 con 0x56151134a2a0 2024-02-21T23:03:54.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.034+0000 7fa4f6000640 1 --2- 172.21.15.99:0/1950638943 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56151134abc0 0x561511379f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:03:54.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.034+0000 7fa4f6a00640 1 --2- 172.21.15.99:0/1950638943 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56151134a2a0 0x561511382c80 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa4e80011e0 tx=0x7fa4e8001150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20ac0596f89645d0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:54.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.034+0000 7fa4d7e00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:03:54.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.034+0000 7fa4d7e00640 1 -- 172.21.15.99:0/1950638943 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e80b2070 con 0x56151134a2a0 2024-02-21T23:03:54.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.034+0000 7fa500dc6740 1 -- 172.21.15.99:0/1950638943 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa4e8093230 con 0x56151134a2a0 2024-02-21T23:03:54.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.034+0000 7fa4d7e00640 1 -- 172.21.15.99:0/1950638943 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7fa4e80aab60 con 0x56151134a2a0 2024-02-21T23:03:54.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.034+0000 7fa4d7e00640 1 -- 172.21.15.99:0/1950638943 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa4e80aad60 con 0x56151134a2a0 2024-02-21T23:03:54.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.034+0000 7fa500dc6740 10 client.5508 fetch_fsmap learned FSMap version 15 2024-02-21T23:03:54.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.034+0000 7fa500dc6740 1 -- 172.21.15.99:0/1950638943 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x561510f4b0f0 con 0x56151134a2a0 2024-02-21T23:03:54.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.035+0000 7fa4d7e00640 1 -- 172.21.15.99:0/1950638943 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4e8093230 con 0x56151134a2a0 2024-02-21T23:03:54.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.035+0000 7fa4d7e00640 1 -- 172.21.15.99:0/1950638943 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 15) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fa4e8096010 con 0x56151134a2a0 2024-02-21T23:03:54.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.035+0000 7fa500dc6740 10 client.5508 fetch_fsmap finished waiting for FSMap version 15 2024-02-21T23:03:54.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.035+0000 7fa500dc6740 10 client.5508 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:03:54.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.035+0000 7fa500dc6740 20 client.5508 populate_metadata read hostname 'smithi099' 2024-02-21T23:03:54.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.035+0000 7fa500dc6740 1 --2- 172.21.15.99:0/1950638943 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5615113844c0 0x561511343360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:54.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.035+0000 7fa500dc6740 4 client.5508 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:03:54.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.035+0000 7fa500dc6740 1 -- 172.21.15.99:0/1950638943 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561511283fd0 con 0x5615113844c0 2024-02-21T23:03:54.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.035+0000 7fa4f6000640 1 --2- 172.21.15.99:0/1950638943 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5615113844c0 0x561511343360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:54.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.036+0000 7fa4d7e00640 10 client.5508 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:03:54.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.036+0000 7fa4f6000640 1 --2- 172.21.15.99:0/1950638943 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5615113844c0 0x561511343360 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=934cd644e5dda195 server_cookie=75a007a7e42eef76 in_seq=0 out_seq=0 2024-02-21T23:03:54.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.037+0000 7fa4d7e00640 1 -- 172.21.15.99:0/1950638943 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x561511283fd0 con 0x5615113844c0 2024-02-21T23:03:54.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.037+0000 7fa4d7e00640 10 client.5508 handle_command_reply: tid=0 2024-02-21T23:03:54.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.037+0000 7fa500dc6740 1 client.5508 shutdown 2024-02-21T23:03:54.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.037+0000 7fa500dc6740 1 -- 172.21.15.99:0/1950638943 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56151134a2a0 msgr2=0x561511382c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:54.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.037+0000 7fa500dc6740 1 --2- 172.21.15.99:0/1950638943 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56151134a2a0 0x561511382c80 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa4e80011e0 tx=0x7fa4e8001150 comp rx=0 tx=0).stop 2024-02-21T23:03:54.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.038+0000 7fa500dc6740 1 -- 172.21.15.99:0/1950638943 shutdown_connections 2024-02-21T23:03:54.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.038+0000 7fa500dc6740 1 --2- 172.21.15.99:0/1950638943 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5615113844c0 0x561511343360 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:54.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.038+0000 7fa500dc6740 1 --2- 172.21.15.99:0/1950638943 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561511380260 0x56151133cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:54.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.038+0000 7fa500dc6740 1 --2- 172.21.15.99:0/1950638943 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56151134abc0 0x561511379f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:54.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.038+0000 7fa500dc6740 1 --2- 172.21.15.99:0/1950638943 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56151134a2a0 0x561511382c80 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:54.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.038+0000 7fa500dc6740 1 -- 172.21.15.99:0/1950638943 >> 172.21.15.99:0/1950638943 conn(0x5615112d96b0 msgr2=0x561511311b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:03:54.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.038+0000 7fa4d7e00640 0 client.5508 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:03:54.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.038+0000 7fa500dc6740 1 -- 172.21.15.99:0/1950638943 shutdown_connections 2024-02-21T23:03:54.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.038+0000 7fa500dc6740 1 -- 172.21.15.99:0/1950638943 wait complete. 2024-02-21T23:03:54.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.038+0000 7fa500dc6740 20 client.5508 trim_cache size 0 max 16384 2024-02-21T23:03:54.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.063+0000 7fa500dc6740 1 Processor -- start 2024-02-21T23:03:54.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.063+0000 7fa500dc6740 1 -- start start 2024-02-21T23:03:54.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.064+0000 7fa500dc6740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56151134a2a0 0x561511382c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:54.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.064+0000 7fa500dc6740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56151134abc0 0x561511381aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:54.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.064+0000 7fa500dc6740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561511380260 0x561511351220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:54.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.064+0000 7fa500dc6740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f822c660 con 0x561511380260 2024-02-21T23:03:54.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.064+0000 7fa500dc6740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f822a200 con 0x56151134abc0 2024-02-21T23:03:54.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.064+0000 7fa500dc6740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f8228390 con 0x56151134a2a0 2024-02-21T23:03:54.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.064+0000 7fa4f7400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561511380260 0x561511351220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:54.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.064+0000 7fa4f6000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56151134abc0 0x561511381aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:54.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.064+0000 7fa4f7400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561511380260 0x561511351220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:32832/0 (socket says 172.21.15.99:32832) 2024-02-21T23:03:54.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.064+0000 7fa4f7400640 1 -- 172.21.15.99:0/3174114245 learned_addr learned my addr 172.21.15.99:0/3174114245 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:03:54.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.064+0000 7fa4f6a00640 1 --2- 172.21.15.99:0/3174114245 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56151134a2a0 0x561511382c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:54.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.065+0000 7fa4f6000640 1 -- 172.21.15.99:0/3174114245 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56151134a2a0 msgr2=0x561511382c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:54.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.065+0000 7fa4f6000640 1 --2- 172.21.15.99:0/3174114245 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56151134a2a0 0x561511382c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:54.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.065+0000 7fa4f6000640 1 -- 172.21.15.99:0/3174114245 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561511380260 msgr2=0x561511351220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:54.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.065+0000 7fa4f6000640 1 --2- 172.21.15.99:0/3174114245 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561511380260 0x561511351220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:54.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.065+0000 7fa4f6000640 1 -- 172.21.15.99:0/3174114245 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561511379d70 con 0x56151134abc0 2024-02-21T23:03:54.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.065+0000 7fa4f6000640 1 --2- 172.21.15.99:0/3174114245 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56151134abc0 0x561511381aa0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fa4e4000c00 tx=0x7fa4e4008030 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5674d7e0483fa7ad server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:54.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.065+0000 7fa4e2a00640 1 -- 172.21.15.99:0/3174114245 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e4051070 con 0x56151134abc0 2024-02-21T23:03:54.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.065+0000 7fa4e2a00640 1 -- 172.21.15.99:0/3174114245 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4e404c2f0 con 0x56151134abc0 2024-02-21T23:03:54.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.065+0000 7fa4e2a00640 1 -- 172.21.15.99:0/3174114245 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e4031b50 con 0x56151134abc0 2024-02-21T23:03:54.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.066+0000 7fa500dc6740 1 -- 172.21.15.99:0/3174114245 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56151134abc0 msgr2=0x561511381aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:54.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.066+0000 7fa500dc6740 1 --2- 172.21.15.99:0/3174114245 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56151134abc0 0x561511381aa0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fa4e4000c00 tx=0x7fa4e4008030 comp rx=0 tx=0).stop 2024-02-21T23:03:54.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.066+0000 7fa500dc6740 1 -- 172.21.15.99:0/3174114245 shutdown_connections 2024-02-21T23:03:54.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.066+0000 7fa500dc6740 1 --2- 172.21.15.99:0/3174114245 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561511380260 0x561511351220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:54.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.066+0000 7fa500dc6740 1 --2- 172.21.15.99:0/3174114245 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56151134abc0 0x561511381aa0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:54.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.066+0000 7fa500dc6740 1 --2- 172.21.15.99:0/3174114245 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56151134a2a0 0x561511382c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:54.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.066+0000 7fa500dc6740 1 -- 172.21.15.99:0/3174114245 >> 172.21.15.99:0/3174114245 conn(0x5615112d96b0 msgr2=0x56151137f5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:03:54.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.066+0000 7fa500dc6740 1 -- 172.21.15.99:0/3174114245 shutdown_connections 2024-02-21T23:03:54.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.066+0000 7fa500dc6740 1 -- 172.21.15.99:0/3174114245 wait complete. 2024-02-21T23:03:54.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.067+0000 7fa500dc6740 1 -- start start 2024-02-21T23:03:54.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.067+0000 7fa500dc6740 1 Processor -- start 2024-02-21T23:03:54.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.068+0000 7fa500dc6740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56151134a2a0 0x561511378b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:54.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.068+0000 7fa500dc6740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56151134abc0 0x561511382b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:54.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.068+0000 7fa500dc6740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561511380260 0x561511351220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:54.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.068+0000 7fa500dc6740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f8228960 con 0x56151134a2a0 2024-02-21T23:03:54.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.069+0000 7fa500dc6740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f8229ba0 con 0x561511380260 2024-02-21T23:03:54.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.069+0000 7fa500dc6740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f8228f60 con 0x56151134abc0 2024-02-21T23:03:54.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.069+0000 7fa500dc6740 10 client.0 _ll_register_callbacks cb 0x7fa4e8096bc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:03:54.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.069+0000 7fa4f6a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56151134a2a0 0x561511378b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:54.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.069+0000 7fa4f6a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56151134a2a0 0x561511378b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:32844/0 (socket says 172.21.15.99:32844) 2024-02-21T23:03:54.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.069+0000 7fa4f6a00640 1 -- 172.21.15.99:0/3146946359 learned_addr learned my addr 172.21.15.99:0/3146946359 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:03:54.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.069+0000 7fa4f6000640 1 --2- 172.21.15.99:0/3146946359 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56151134abc0 0x561511382b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:54.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.069+0000 7fa4f7400640 1 --2- 172.21.15.99:0/3146946359 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561511380260 0x561511351220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:54.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.069+0000 7fa4f6a00640 1 -- 172.21.15.99:0/3146946359 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56151134abc0 msgr2=0x561511382b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:54.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.069+0000 7fa4f6a00640 1 --2- 172.21.15.99:0/3146946359 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56151134abc0 0x561511382b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:54.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.069+0000 7fa4f6a00640 1 -- 172.21.15.99:0/3146946359 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561511380260 msgr2=0x561511351220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:03:54.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.069+0000 7fa4f6a00640 1 --2- 172.21.15.99:0/3146946359 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561511380260 0x561511351220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:54.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.069+0000 7fa4f6a00640 1 -- 172.21.15.99:0/3146946359 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561511383180 con 0x56151134a2a0 2024-02-21T23:03:54.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.069+0000 7fa4f6a00640 1 --2- 172.21.15.99:0/3146946359 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56151134a2a0 0x561511378b60 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fa4e80070a0 tx=0x7fa4e801e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec0c6d8417a5f86b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:03:54.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.069+0000 7fa4d7e00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:03:54.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.070+0000 7fa4d7e00640 1 -- 172.21.15.99:0/3146946359 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e80b2040 con 0x56151134a2a0 2024-02-21T23:03:54.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.070+0000 7fa4d7e00640 1 -- 172.21.15.99:0/3146946359 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7fa4e8092910 con 0x56151134a2a0 2024-02-21T23:03:54.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.070+0000 7fa500dc6740 1 -- 172.21.15.99:0/3146946359 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56151127e320 con 0x56151134a2a0 2024-02-21T23:03:54.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.070+0000 7fa4d7e00640 1 -- 172.21.15.99:0/3146946359 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa4e8093230 con 0x56151134a2a0 2024-02-21T23:03:54.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.070+0000 7fa500dc6740 10 client.5514 fetch_fsmap learned FSMap version 15 2024-02-21T23:03:54.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.070+0000 7fa500dc6740 1 -- 172.21.15.99:0/3146946359 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x561511383180 con 0x56151134a2a0 2024-02-21T23:03:54.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.070+0000 7fa4d7e00640 1 -- 172.21.15.99:0/3146946359 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56151127e320 con 0x56151134a2a0 2024-02-21T23:03:54.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.070+0000 7fa4d7e00640 1 -- 172.21.15.99:0/3146946359 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 15) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fa4e8092b10 con 0x56151134a2a0 2024-02-21T23:03:54.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.070+0000 7fa500dc6740 10 client.5514 fetch_fsmap finished waiting for FSMap version 15 2024-02-21T23:03:54.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.070+0000 7fa500dc6740 10 client.5514 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:03:54.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.070+0000 7fa500dc6740 20 client.5514 populate_metadata read hostname 'smithi099' 2024-02-21T23:03:54.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.070+0000 7fa500dc6740 1 --2- 172.21.15.99:0/3146946359 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x561511381b10 0x561511380640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:03:54.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.070+0000 7fa500dc6740 4 client.5514 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T23:03:54.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.070+0000 7fa500dc6740 1 -- 172.21.15.99:0/3146946359 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5615111fc370 con 0x561511381b10 2024-02-21T23:03:54.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.071+0000 7fa4f6000640 1 --2- 172.21.15.99:0/3146946359 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x561511381b10 0x561511380640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:03:54.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.071+0000 7fa4f6000640 1 --2- 172.21.15.99:0/3146946359 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x561511381b10 0x561511380640 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=735cba6a4c3420dd server_cookie=bd8f5ce2a7fbd240 in_seq=0 out_seq=0 2024-02-21T23:03:54.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.071+0000 7fa4d7e00640 10 client.5514 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:03:54.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.071+0000 7fa4d7e00640 1 -- 172.21.15.99:0/3146946359 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5615111fc370 con 0x561511381b10 2024-02-21T23:03:54.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.071+0000 7fa4d7e00640 10 client.5514 handle_command_reply: tid=0 2024-02-21T23:03:54.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.072+0000 7fa500dc6740 1 client.5514 shutdown 2024-02-21T23:03:54.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.072+0000 7fa500dc6740 1 -- 172.21.15.99:0/3146946359 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56151134a2a0 msgr2=0x561511378b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:54.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.072+0000 7fa500dc6740 1 --2- 172.21.15.99:0/3146946359 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56151134a2a0 0x561511378b60 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fa4e80070a0 tx=0x7fa4e801e000 comp rx=0 tx=0).stop 2024-02-21T23:03:54.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.072+0000 7fa500dc6740 1 -- 172.21.15.99:0/3146946359 shutdown_connections 2024-02-21T23:03:54.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.072+0000 7fa500dc6740 1 --2- 172.21.15.99:0/3146946359 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x561511381b10 0x561511380640 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:54.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.072+0000 7fa500dc6740 1 --2- 172.21.15.99:0/3146946359 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561511380260 0x561511351220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:54.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.072+0000 7fa500dc6740 1 --2- 172.21.15.99:0/3146946359 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56151134abc0 0x561511382b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:54.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.072+0000 7fa500dc6740 1 --2- 172.21.15.99:0/3146946359 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56151134a2a0 0x561511378b60 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:54.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.072+0000 7fa500dc6740 1 -- 172.21.15.99:0/3146946359 >> 172.21.15.99:0/3146946359 conn(0x5615112d96b0 msgr2=0x561511317de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:03:54.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.072+0000 7fa4d7e00640 0 client.5514 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:03:54.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.072+0000 7fa500dc6740 1 -- 172.21.15.99:0/3146946359 shutdown_connections 2024-02-21T23:03:54.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.072+0000 7fa500dc6740 1 -- 172.21.15.99:0/3146946359 wait complete. 2024-02-21T23:03:54.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.072+0000 7fa500dc6740 20 client.5514 trim_cache size 0 max 16384 2024-02-21T23:03:54.065 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-02-21T23:03:54.065 INFO:teuthology.orchestra.run.smithi099.stdout: "status": "IDLE (waiting for more scrubs)", 2024-02-21T23:03:54.065 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubs": { 2024-02-21T23:03:54.065 INFO:teuthology.orchestra.run.smithi099.stdout: "489a6320-0490-4812-93f2-8ce93efa607f": { 2024-02-21T23:03:54.065 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/", 2024-02-21T23:03:54.065 INFO:teuthology.orchestra.run.smithi099.stdout: "tag": "489a6320-0490-4812-93f2-8ce93efa607f", 2024-02-21T23:03:54.065 INFO:teuthology.orchestra.run.smithi099.stdout: "options": "recursive,force" 2024-02-21T23:03:54.065 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:03:54.065 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:03:54.066 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-02-21T23:03:54.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.073+0000 7fa4f7e00640 1 -- 172.21.15.99:0/2403555837 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa4d809ef00 msgr2=0x7fa4d80a13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:54.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.073+0000 7fa4f7e00640 1 --2- 172.21.15.99:0/2403555837 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa4d809ef00 0x7fa4d80a13c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa4f00094c0 tx=0x7fa4f000b040 comp rx=0 tx=0).stop 2024-02-21T23:03:54.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.073+0000 7fa4f7e00640 1 -- 172.21.15.99:0/2403555837 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4f80747b0 msgr2=0x7fa4f8222830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:03:54.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.073+0000 7fa4f7e00640 1 --2- 172.21.15.99:0/2403555837 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4f80747b0 0x7fa4f8222830 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa4e800c430 tx=0x7fa4e800c8f0 comp rx=0 tx=0).stop 2024-02-21T23:03:54.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.073+0000 7fa4f7e00640 1 -- 172.21.15.99:0/2403555837 shutdown_connections 2024-02-21T23:03:54.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.073+0000 7fa4f7e00640 1 --2- 172.21.15.99:0/2403555837 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa4d809ef00 0x7fa4d80a13c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:54.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.073+0000 7fa4f7e00640 1 --2- 172.21.15.99:0/2403555837 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa4f8188260 0x7fa4f821fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:54.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.073+0000 7fa4f7e00640 1 --2- 172.21.15.99:0/2403555837 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa4f817d5e0 0x7fa4f816e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:54.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.073+0000 7fa4f7e00640 1 --2- 172.21.15.99:0/2403555837 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4f80747b0 0x7fa4f8222830 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:03:54.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.073+0000 7fa4f7e00640 1 -- 172.21.15.99:0/2403555837 >> 172.21.15.99:0/2403555837 conn(0x7fa4f808cfd0 msgr2=0x7fa4f80ee160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:03:54.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.073+0000 7fa4f7e00640 1 -- 172.21.15.99:0/2403555837 shutdown_connections 2024-02-21T23:03:54.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:03:54.073+0000 7fa4f7e00640 1 -- 172.21.15.99:0/2403555837 wait complete. 2024-02-21T23:03:54.078 INFO:tasks.cephfs.filesystem:scrub status for tag:489a6320-0490-4812-93f2-8ce93efa607f - {'path': '/', 'tag': '489a6320-0490-4812-93f2-8ce93efa607f', 'options': 'recursive,force'} 2024-02-21T23:03:54.420 INFO:tasks.workunit.client.0.smithi099.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-02-21T23:03:54.558 INFO:tasks.workunit.client.0.smithi099.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-02-21T23:03:54.635 INFO:tasks.workunit.client.0.smithi099.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-02-21T23:03:54.640 INFO:tasks.workunit.client.0.smithi099.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-02-21T23:03:54.640 INFO:tasks.workunit.client.0.smithi099.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-02-21T23:03:54.718 INFO:tasks.workunit.client.0.smithi099.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-02-21T23:03:54.726 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-02-21T23:03:54.726 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-02-21T23:03:54.768 INFO:tasks.workunit:Running workunits matching suites/fsx.sh on client.0... 2024-02-21T23:03:54.770 INFO:tasks.workunit:Running workunit suites/fsx.sh... 2024-02-21T23:03:54.770 DEBUG:teuthology.orchestra.run.smithi099:workunit test suites/fsx.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3bfc837d7b45ce8e095d92fa9c342964cea5e95f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsx.sh 2024-02-21T23:03:54.869 INFO:tasks.workunit.client.0.smithi099.stderr:+ set -e 2024-02-21T23:03:54.869 INFO:tasks.workunit.client.0.smithi099.stderr:+ git clone https://git.ceph.com/xfstests-dev.git 2024-02-21T23:03:54.874 INFO:tasks.workunit.client.0.smithi099.stderr:Cloning into 'xfstests-dev'... 2024-02-21T23:04:10.851 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:04:10.857 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:04:10.860 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:04:12.394 INFO:tasks.workunit.client.0.smithi099.stderr:Updating files: 17% (741/4260) Updating files: 18% (767/4260) Updating files: 19% (810/4260) Updating files: 20% (852/4260) Updating files: 21% (895/4260) Updating files: 22% (938/4260) Updating files: 22% (971/4260) Updating files: 23% (980/4260) Updating files: 24% (1023/4260) Updating files: 25% (1065/4260) Updating files: 26% (1108/4260) Updating files: 27% (1151/4260) Updating files: 28% (1193/4260) Updating files: 29% (1236/4260) Updating files: 30% (1278/4260) Updating files: 31% (1321/4260) Updating files: 32% (1364/4260) Updating files: 33% (1406/4260) Updating files: 34% (1449/4260) Updating files: 35% (1491/4260) Updating files: 35% (1501/4260) Updating files: 36% (1534/4260) Updating files: 37% (1577/4260) Updating files: 38% (1619/4260) Updating files: 39% (1662/4260) Updating files: 40% (1704/4260) Updating files: 41% (1747/4260) Updating files: 42% (1790/4260) Updating files: 43% (1832/4260) Updating files: 44% (1875/4260) Updating files: 45% (1917/4260) Updating files: 46% (1960/4260) Updating files: 47% (2003/4260) Updating files: 48% (2045/4260) Updating files: 49% (2088/4260) Updating files: 50% (2130/4260) Updating files: 51% (2173/4260) Updating files: 52% (2216/4260) Updating files: 52% (2257/4260) Updating files: 53% (2258/4260) Updating files: 53% (2264/4260) Updating files: 54% (2301/4260) Updating files: 54% (2310/4260) Updating files: 55% (2343/4260) Updating files: 56% (2386/4260) Updating files: 56% (2405/4260) Updating files: 57% (2429/4260) Updating files: 58% (2471/4260) Updating files: 59% (2514/4260) Updating files: 60% (2556/4260) Updating files: 61% (2599/4260) Updating files: 62% (2642/4260) Updating files: 63% (2684/4260) Updating files: 64% (2727/4260) Updating files: 65% (2769/4260) Updating files: 66% (2812/4260) Updating files: 66% (2818/4260) Updating files: 67% (2855/4260) Updating files: 68% (2897/4260) Updating files: 69% (2940/4260) Updating files: 70% (2982/4260) Updating files: 71% (3025/4260) Updating files: 72% (3068/4260) Updating files: 73% (3110/4260) Updating files: 74% (3153/4260) Updating files: 75% (3195/4260) Updating files: 76% (3238/4260) Updating files: 77% (3281/4260) Updating files: 77% (3313/4260) Updating files: 78% (3323/4260) Updating files: 79% (3366/4260) Updating files: 80% (3408/4260) Updating files: 81% (3451/4260) Updating files: 82% (3494/4260) Updating files: 83% (3536/4260) Updating files: 84% (3579/4260) Updating files: 85% (3621/4260) Updating files: 86% (3664/4260) Updating files: 87% (3707/4260) Updating files: 88% (3749/4260) Updating files: 89% (3792/4260) Updating files: 90% (3834/4260) Updating files: 91% (3877/4260) Updating files: 92% (3920/4260) Updating files: 93% (3962/4260) Updating files: 94% (4005/4260) Updating files: 95% (4047/4260) Updating files: 95% (4068/4260) Updating files: 96% (4090/4260) Updating files: 97% (4133/4260) Updating files: 98% (4175/4260) Updating files: 99% (4218/4260) Updating files: 100% (4260/4260) Updating files: 100% (4260/4260), done. 2024-02-21T23:04:12.540 INFO:tasks.workunit.client.0.smithi099.stderr:+ cd xfstests-dev 2024-02-21T23:04:12.540 INFO:tasks.workunit.client.0.smithi099.stderr:+ git checkout 12973fc04fd10d4af086901e10ffa8e48866b735 2024-02-21T23:04:23.466 INFO:tasks.workunit.client.0.smithi099.stderr:Note: switching to '12973fc04fd10d4af086901e10ffa8e48866b735'. 2024-02-21T23:04:23.466 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-02-21T23:04:23.466 INFO:tasks.workunit.client.0.smithi099.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-02-21T23:04:23.466 INFO:tasks.workunit.client.0.smithi099.stderr:changes and commit them, and you can discard any commits you make in this 2024-02-21T23:04:23.466 INFO:tasks.workunit.client.0.smithi099.stderr:state without impacting any branches by switching back to a branch. 2024-02-21T23:04:23.466 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-02-21T23:04:23.466 INFO:tasks.workunit.client.0.smithi099.stderr:If you want to create a new branch to retain commits you create, you may 2024-02-21T23:04:23.466 INFO:tasks.workunit.client.0.smithi099.stderr:do so (now or later) by using -c with the switch command. Example: 2024-02-21T23:04:23.466 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-02-21T23:04:23.467 INFO:tasks.workunit.client.0.smithi099.stderr: git switch -c 2024-02-21T23:04:23.467 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-02-21T23:04:23.467 INFO:tasks.workunit.client.0.smithi099.stderr:Or undo this operation with: 2024-02-21T23:04:23.467 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-02-21T23:04:23.467 INFO:tasks.workunit.client.0.smithi099.stderr: git switch - 2024-02-21T23:04:23.467 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-02-21T23:04:23.467 INFO:tasks.workunit.client.0.smithi099.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-02-21T23:04:23.467 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-02-21T23:04:23.467 INFO:tasks.workunit.client.0.smithi099.stderr:HEAD is now at 12973fc0 btrfs/022: Correct seq number in golden output 2024-02-21T23:04:23.471 INFO:tasks.workunit.client.0.smithi099.stderr:+ make -j4 2024-02-21T23:04:23.502 INFO:tasks.workunit.client.0.smithi099.stdout:libtoolize -cfi 2024-02-21T23:04:24.080 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T23:04:24.080 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T23:04:24.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.285+0000 7fdb46000640 1 Processor -- start 2024-02-21T23:04:24.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.285+0000 7fdb46000640 1 -- start start 2024-02-21T23:04:24.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.288+0000 7fdb46000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fdb400d60b0 0x7fdb400fc990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:24.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.288+0000 7fdb46000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb400d6dd0 con 0x7fdb4018b230 2024-02-21T23:04:24.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.288+0000 7fdb46000640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb401614c0 con 0x7fdb4017f490 2024-02-21T23:04:24.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.288+0000 7fdb46000640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb400d6810 con 0x7fdb400d60b0 2024-02-21T23:04:24.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.288+0000 7fdb44c00640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fdb4017f490 0x7fdb4018ab20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:40448/0 (socket says 172.21.15.99:40448) 2024-02-21T23:04:24.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.288+0000 7fdb44c00640 1 -- 172.21.15.99:0/4056936844 learned_addr learned my addr 172.21.15.99:0/4056936844 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:04:24.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.288+0000 7fdb45600640 1 --2- 172.21.15.99:0/4056936844 >> v2:172.21.15.99:3300/0 conn(0x7fdb400d60b0 0x7fdb400fc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:24.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.289+0000 7fdb45600640 1 -- 172.21.15.99:0/4056936844 >> v1:172.21.15.181:6789/0 conn(0x7fdb4017f490 legacy=0x7fdb4018ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:24.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.289+0000 7fdb45600640 1 -- 172.21.15.99:0/4056936844 >> v1:172.21.15.99:6789/0 conn(0x7fdb4018b230 legacy=0x7fdb400fc280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:24.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.289+0000 7fdb45600640 1 -- 172.21.15.99:0/4056936844 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb400d6af0 con 0x7fdb400d60b0 2024-02-21T23:04:24.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.291+0000 7fdb45600640 1 --2- 172.21.15.99:0/4056936844 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdb400d60b0 0x7fdb400fc990 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fdb38009d90 tx=0x7fdb3802bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88f89e6e50f26dd6 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:04:24.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.291+0000 7fdb3f400640 1 -- 172.21.15.99:0/4056936844 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb3802d920 con 0x7fdb400d60b0 2024-02-21T23:04:24.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.291+0000 7fdb3f400640 1 -- 172.21.15.99:0/4056936844 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb3802dac0 con 0x7fdb400d60b0 2024-02-21T23:04:24.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.291+0000 7fdb3f400640 1 -- 172.21.15.99:0/4056936844 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb3802c440 con 0x7fdb400d60b0 2024-02-21T23:04:24.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.292+0000 7fdb46000640 1 -- 172.21.15.99:0/4056936844 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdb400d60b0 msgr2=0x7fdb400fc990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:24.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.292+0000 7fdb46000640 1 --2- 172.21.15.99:0/4056936844 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdb400d60b0 0x7fdb400fc990 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fdb38009d90 tx=0x7fdb3802bbe0 comp rx=0 tx=0).stop 2024-02-21T23:04:24.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.292+0000 7fdb46000640 1 -- 172.21.15.99:0/4056936844 shutdown_connections 2024-02-21T23:04:24.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.292+0000 7fdb46000640 1 --2- 172.21.15.99:0/4056936844 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdb400d60b0 0x7fdb400fc990 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:24.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.292+0000 7fdb46000640 1 -- 172.21.15.99:0/4056936844 >> 172.21.15.99:0/4056936844 conn(0x7fdb400d29b0 msgr2=0x7fdb400d2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:04:24.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.292+0000 7fdb46000640 1 -- 172.21.15.99:0/4056936844 shutdown_connections 2024-02-21T23:04:24.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.292+0000 7fdb46000640 1 -- 172.21.15.99:0/4056936844 wait complete. 2024-02-21T23:04:24.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.295+0000 7fdb46000640 1 Processor -- start 2024-02-21T23:04:24.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.295+0000 7fdb46000640 1 -- start start 2024-02-21T23:04:24.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.296+0000 7fdb46000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb400d60b0 0x7fdb400cf440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:24.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.296+0000 7fdb46000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdb4017f490 0x7fdb40173730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:24.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.296+0000 7fdb46000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdb4018b230 0x7fdb4017cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:24.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.297+0000 7fdb46000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4018a600 con 0x7fdb4018b230 2024-02-21T23:04:24.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.297+0000 7fdb46000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4018a320 con 0x7fdb400d60b0 2024-02-21T23:04:24.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.297+0000 7fdb46000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb400d6500 con 0x7fdb4017f490 2024-02-21T23:04:24.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.297+0000 7fdb45600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdb4018b230 0x7fdb4017cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:24.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.297+0000 7fdb45600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdb4018b230 0x7fdb4017cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54264/0 (socket says 172.21.15.99:54264) 2024-02-21T23:04:24.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.297+0000 7fdb44c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb400d60b0 0x7fdb400cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:24.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.297+0000 7fdb45600640 1 -- 172.21.15.99:0/2390363986 learned_addr learned my addr 172.21.15.99:0/2390363986 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:04:24.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.297+0000 7fdb3fe00640 1 --2- 172.21.15.99:0/2390363986 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdb4017f490 0x7fdb40173730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:24.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.297+0000 7fdb3fe00640 1 -- 172.21.15.99:0/2390363986 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb400d60b0 msgr2=0x7fdb400cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:24.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.297+0000 7fdb3fe00640 1 --2- 172.21.15.99:0/2390363986 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb400d60b0 0x7fdb400cf440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:24.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.297+0000 7fdb3fe00640 1 -- 172.21.15.99:0/2390363986 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdb4018b230 msgr2=0x7fdb4017cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:24.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.297+0000 7fdb3fe00640 1 --2- 172.21.15.99:0/2390363986 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdb4018b230 0x7fdb4017cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:24.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.297+0000 7fdb3fe00640 1 -- 172.21.15.99:0/2390363986 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb4017dd00 con 0x7fdb4017f490 2024-02-21T23:04:24.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.298+0000 7fdb3fe00640 1 --2- 172.21.15.99:0/2390363986 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdb4017f490 0x7fdb40173730 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c00c410 tx=0x7fdb2c00c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:04:24.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.298+0000 7fdb3cc00640 1 -- 172.21.15.99:0/2390363986 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2c017070 con 0x7fdb4017f490 2024-02-21T23:04:24.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.298+0000 7fdb3cc00640 1 -- 172.21.15.99:0/2390363986 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb2c0035f0 con 0x7fdb4017f490 2024-02-21T23:04:24.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.298+0000 7fdb3cc00640 1 -- 172.21.15.99:0/2390363986 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2c0039e0 con 0x7fdb4017f490 2024-02-21T23:04:24.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.298+0000 7fdb46000640 1 -- 172.21.15.99:0/2390363986 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb4017dfe0 con 0x7fdb4017f490 2024-02-21T23:04:24.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.298+0000 7fdb46000640 1 -- 172.21.15.99:0/2390363986 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb40172f30 con 0x7fdb4017f490 2024-02-21T23:04:24.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.301+0000 7fdb3cc00640 1 -- 172.21.15.99:0/2390363986 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7fdb2c01a070 con 0x7fdb4017f490 2024-02-21T23:04:24.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.302+0000 7fdb4a484740 1 Processor -- start 2024-02-21T23:04:24.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.303+0000 7fdb4a484740 1 -- start start 2024-02-21T23:04:24.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.304+0000 7fdb4a484740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5584c62d72a0 0x5584c630cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:24.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.304+0000 7fdb3cc00640 1 --2- 172.21.15.99:0/2390363986 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fdb2009eed0 0x7fdb200a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:24.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.304+0000 7fdb4a484740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5584c630d260 0x5584c62d7680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:24.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.304+0000 7fdb4a484740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5584c62d7bc0 0x5584c629a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:24.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.304+0000 7fdb4a484740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584c6203a90 con 0x5584c62d7bc0 2024-02-21T23:04:24.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.304+0000 7fdb4a484740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584c61acb10 con 0x5584c62d72a0 2024-02-21T23:04:24.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.304+0000 7fdb4a484740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584c61ffb30 con 0x5584c630d260 2024-02-21T23:04:24.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.304+0000 7fdb3cc00640 1 -- 172.21.15.99:0/2390363986 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7fdb2c0c9250 con 0x7fdb4017f490 2024-02-21T23:04:24.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.304+0000 7fdb3fe00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5584c630d260 0x5584c62d7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:24.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.304+0000 7fdb45600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5584c62d7bc0 0x5584c629a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:24.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.304+0000 7fdb45600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5584c62d7bc0 0x5584c629a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54280/0 (socket says 172.21.15.99:54280) 2024-02-21T23:04:24.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.304+0000 7fdb45600640 1 -- 172.21.15.99:0/2124738190 learned_addr learned my addr 172.21.15.99:0/2124738190 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:04:24.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.304+0000 7fdb44c00640 1 --2- 172.21.15.99:0/2124738190 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5584c62d72a0 0x5584c630cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:24.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.304+0000 7fdb45600640 1 --2- 172.21.15.99:0/2390363986 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fdb2009eed0 0x7fdb200a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:24.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.305+0000 7fdb3fe00640 1 -- 172.21.15.99:0/2124738190 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5584c62d72a0 msgr2=0x5584c630cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:04:24.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.305+0000 7fdb3fe00640 1 --2- 172.21.15.99:0/2124738190 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5584c62d72a0 0x5584c630cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:24.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.305+0000 7fdb3fe00640 1 -- 172.21.15.99:0/2124738190 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5584c62d7bc0 msgr2=0x5584c629a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:04:24.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.305+0000 7fdb3fe00640 1 --2- 172.21.15.99:0/2124738190 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5584c62d7bc0 0x5584c629a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:24.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.305+0000 7fdb3fe00640 1 -- 172.21.15.99:0/2124738190 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5584c5fe27d0 con 0x5584c630d260 2024-02-21T23:04:24.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.305+0000 7fdb44c00640 1 --2- 172.21.15.99:0/2124738190 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5584c62d72a0 0x5584c630cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:04:24.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.305+0000 7fdb3fe00640 1 --2- 172.21.15.99:0/2124738190 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5584c630d260 0x5584c62d7680 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c0c6910 tx=0x7fdb2c0aebd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=198942089e780d73 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:04:24.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.305+0000 7fdb35200640 1 -- 172.21.15.99:0/2124738190 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2c09ac40 con 0x5584c630d260 2024-02-21T23:04:24.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.305+0000 7fdb35200640 1 -- 172.21.15.99:0/2124738190 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb2c09f290 con 0x5584c630d260 2024-02-21T23:04:24.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.305+0000 7fdb35200640 1 -- 172.21.15.99:0/2124738190 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2c0af050 con 0x5584c630d260 2024-02-21T23:04:24.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.306+0000 7fdb4a484740 1 -- 172.21.15.99:0/2124738190 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5584c630d260 msgr2=0x5584c62d7680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:24.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.306+0000 7fdb4a484740 1 --2- 172.21.15.99:0/2124738190 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5584c630d260 0x5584c62d7680 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c0c6910 tx=0x7fdb2c0aebd0 comp rx=0 tx=0).stop 2024-02-21T23:04:24.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.306+0000 7fdb45600640 1 --2- 172.21.15.99:0/2390363986 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fdb2009eed0 0x7fdb200a1390 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdb38009bd0 tx=0x7fdb38031000 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:04:24.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.306+0000 7fdb4a484740 1 -- 172.21.15.99:0/2124738190 shutdown_connections 2024-02-21T23:04:24.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.306+0000 7fdb4a484740 1 --2- 172.21.15.99:0/2124738190 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5584c62d7bc0 0x5584c629a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:24.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.306+0000 7fdb4a484740 1 --2- 172.21.15.99:0/2124738190 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5584c630d260 0x5584c62d7680 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:24.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.306+0000 7fdb4a484740 1 --2- 172.21.15.99:0/2124738190 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5584c62d72a0 0x5584c630cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:24.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.306+0000 7fdb4a484740 1 -- 172.21.15.99:0/2124738190 >> 172.21.15.99:0/2124738190 conn(0x5584c62666b0 msgr2=0x5584c629e190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:04:24.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.307+0000 7fdb4a484740 1 -- 172.21.15.99:0/2124738190 shutdown_connections 2024-02-21T23:04:24.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.307+0000 7fdb4a484740 1 -- 172.21.15.99:0/2124738190 wait complete. 2024-02-21T23:04:24.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.308+0000 7fdb4a484740 1 -- start start 2024-02-21T23:04:24.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.308+0000 7fdb4a484740 1 Processor -- start 2024-02-21T23:04:24.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.310+0000 7fdb4a484740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5584c62d72a0 0x5584c62987e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:24.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.310+0000 7fdb4a484740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5584c62d7bc0 0x5584c630c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:24.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.310+0000 7fdb4a484740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5584c630d260 0x5584c62c8810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:24.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.310+0000 7fdb44c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5584c62d72a0 0x5584c62987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:24.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.311+0000 7fdb3fe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5584c62d7bc0 0x5584c630c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:24.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.311+0000 7fdb3fe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5584c62d7bc0 0x5584c630c8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:47640/0 (socket says 172.21.15.99:47640) 2024-02-21T23:04:24.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.311+0000 7fdb3fe00640 1 -- 172.21.15.99:0/265925233 learned_addr learned my addr 172.21.15.99:0/265925233 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:04:24.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.311+0000 7fdb45600640 1 --2- 172.21.15.99:0/265925233 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5584c630d260 0x5584c62c8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:24.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.311+0000 7fdb4a484740 1 -- 172.21.15.99:0/265925233 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584c62a5f30 con 0x5584c62d72a0 2024-02-21T23:04:24.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.311+0000 7fdb4a484740 1 -- 172.21.15.99:0/265925233 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584c61a21c0 con 0x5584c62d7bc0 2024-02-21T23:04:24.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.311+0000 7fdb4a484740 1 -- 172.21.15.99:0/265925233 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584c630e930 con 0x5584c630d260 2024-02-21T23:04:24.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.311+0000 7fdb4a484740 10 client.0 _ll_register_callbacks cb 0x5584c61bf930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:04:24.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.312+0000 7fdb3fe00640 1 -- 172.21.15.99:0/265925233 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5584c630d260 msgr2=0x5584c62c8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:04:24.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.312+0000 7fdb3fe00640 1 --2- 172.21.15.99:0/265925233 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5584c630d260 0x5584c62c8810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:24.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.312+0000 7fdb3fe00640 1 -- 172.21.15.99:0/265925233 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5584c62d72a0 msgr2=0x5584c62987e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:04:24.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.312+0000 7fdb3fe00640 1 --2- 172.21.15.99:0/265925233 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5584c62d72a0 0x5584c62987e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:24.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.312+0000 7fdb3fe00640 1 -- 172.21.15.99:0/265925233 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5584c5f183f0 con 0x5584c62d7bc0 2024-02-21T23:04:24.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.312+0000 7fdb44c00640 1 --2- 172.21.15.99:0/265925233 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5584c62d72a0 0x5584c62987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:04:24.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.312+0000 7fdb3fe00640 1 --2- 172.21.15.99:0/265925233 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5584c62d7bc0 0x5584c630c8f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c0968a0 tx=0x7fdb2c0c8040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=714812efa087c42c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:04:24.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.312+0000 7fdb29600640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-02-21T23:04:24.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.312+0000 7fdb29600640 1 -- 172.21.15.99:0/265925233 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2c0c6cc0 con 0x5584c62d7bc0 2024-02-21T23:04:24.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.312+0000 7fdb29600640 1 -- 172.21.15.99:0/265925233 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7fdb2c0af3d0 con 0x5584c62d7bc0 2024-02-21T23:04:24.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.312+0000 7fdb4a484740 1 -- 172.21.15.99:0/265925233 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdb2c09f290 con 0x5584c62d7bc0 2024-02-21T23:04:24.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.312+0000 7fdb29600640 1 -- 172.21.15.99:0/265925233 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdb2c0aad40 con 0x5584c62d7bc0 2024-02-21T23:04:24.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.312+0000 7fdb4a484740 10 client.5635 fetch_fsmap learned FSMap version 16 2024-02-21T23:04:24.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.312+0000 7fdb4a484740 1 -- 172.21.15.99:0/265925233 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x5584c5ed80f0 con 0x5584c62d7bc0 2024-02-21T23:04:24.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.313+0000 7fdb29600640 1 -- 172.21.15.99:0/265925233 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb2c09f290 con 0x5584c62d7bc0 2024-02-21T23:04:24.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.313+0000 7fdb29600640 1 -- 172.21.15.99:0/265925233 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fdb2c003b80 con 0x5584c62d7bc0 2024-02-21T23:04:24.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.313+0000 7fdb4a484740 10 client.5635 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T23:04:24.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.313+0000 7fdb4a484740 10 client.5635 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:04:24.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.313+0000 7fdb4a484740 20 client.5635 populate_metadata read hostname 'smithi099' 2024-02-21T23:04:24.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.313+0000 7fdb4a484740 1 --2- 172.21.15.99:0/265925233 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5584c630ce30 0x5584c629eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:24.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.313+0000 7fdb4a484740 4 client.5635 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:04:24.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.313+0000 7fdb4a484740 1 -- 172.21.15.99:0/265925233 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5584c6210fd0 con 0x5584c630ce30 2024-02-21T23:04:24.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.313+0000 7fdb44c00640 1 --2- 172.21.15.99:0/265925233 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5584c630ce30 0x5584c629eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:24.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.314+0000 7fdb44c00640 1 --2- 172.21.15.99:0/265925233 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5584c630ce30 0x5584c629eb80 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=48e56deb799299f2 server_cookie=994d7c6977125bca in_seq=0 out_seq=0 2024-02-21T23:04:24.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.314+0000 7fdb29600640 10 client.5635 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:04:24.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.315+0000 7fdb29600640 1 -- 172.21.15.99:0/265925233 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x5584c6210fd0 con 0x5584c630ce30 2024-02-21T23:04:24.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.315+0000 7fdb29600640 10 client.5635 handle_command_reply: tid=0 2024-02-21T23:04:24.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.315+0000 7fdb4a484740 1 client.5635 shutdown 2024-02-21T23:04:24.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.315+0000 7fdb4a484740 1 -- 172.21.15.99:0/265925233 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5584c62d7bc0 msgr2=0x5584c630c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:24.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.315+0000 7fdb4a484740 1 --2- 172.21.15.99:0/265925233 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5584c62d7bc0 0x5584c630c8f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c0968a0 tx=0x7fdb2c0c8040 comp rx=0 tx=0).stop 2024-02-21T23:04:24.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.315+0000 7fdb4a484740 1 -- 172.21.15.99:0/265925233 shutdown_connections 2024-02-21T23:04:24.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.315+0000 7fdb4a484740 1 --2- 172.21.15.99:0/265925233 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5584c630ce30 0x5584c629eb80 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:24.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.315+0000 7fdb4a484740 1 --2- 172.21.15.99:0/265925233 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5584c630d260 0x5584c62c8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:24.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.315+0000 7fdb4a484740 1 --2- 172.21.15.99:0/265925233 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5584c62d7bc0 0x5584c630c8f0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:24.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.315+0000 7fdb4a484740 1 --2- 172.21.15.99:0/265925233 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5584c62d72a0 0x5584c62987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:24.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.315+0000 7fdb29600640 0 client.5635 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:04:24.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.315+0000 7fdb4a484740 1 -- 172.21.15.99:0/265925233 >> 172.21.15.99:0/265925233 conn(0x5584c62666b0 msgr2=0x5584c62d4660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:04:24.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.316+0000 7fdb4a484740 1 -- 172.21.15.99:0/265925233 shutdown_connections 2024-02-21T23:04:24.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.316+0000 7fdb4a484740 1 -- 172.21.15.99:0/265925233 wait complete. 2024-02-21T23:04:24.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.316+0000 7fdb4a484740 20 client.5635 trim_cache size 0 max 16384 2024-02-21T23:04:24.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.345+0000 7fdb4a484740 1 Processor -- start 2024-02-21T23:04:24.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.346+0000 7fdb4a484740 1 -- start start 2024-02-21T23:04:24.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.347+0000 7fdb4a484740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5584c62d72a0 0x5584c630ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:24.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.347+0000 7fdb4a484740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5584c62d7bc0 0x5584c63717b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:24.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.347+0000 7fdb4a484740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5584c630d260 0x5584c630af30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:24.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.347+0000 7fdb4a484740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4022caa0 con 0x5584c62d7bc0 2024-02-21T23:04:24.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.347+0000 7fdb4a484740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4022a640 con 0x5584c630d260 2024-02-21T23:04:24.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.347+0000 7fdb4a484740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4021f690 con 0x5584c62d72a0 2024-02-21T23:04:24.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.348+0000 7fdb3fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5584c62d7bc0 0x5584c63717b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:24.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.348+0000 7fdb3fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5584c62d7bc0 0x5584c63717b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54296/0 (socket says 172.21.15.99:54296) 2024-02-21T23:04:24.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.348+0000 7fdb3fe00640 1 -- 172.21.15.99:0/3875566022 learned_addr learned my addr 172.21.15.99:0/3875566022 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:04:24.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.348+0000 7fdb44c00640 1 --2- 172.21.15.99:0/3875566022 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5584c62d72a0 0x5584c630ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:24.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.348+0000 7fdb45600640 1 --2- 172.21.15.99:0/3875566022 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5584c630d260 0x5584c630af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:24.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.348+0000 7fdb3fe00640 1 -- 172.21.15.99:0/3875566022 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5584c62d72a0 msgr2=0x5584c630ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:04:24.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.348+0000 7fdb3fe00640 1 --2- 172.21.15.99:0/3875566022 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5584c62d72a0 0x5584c630ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:24.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.348+0000 7fdb3fe00640 1 -- 172.21.15.99:0/3875566022 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5584c630d260 msgr2=0x5584c630af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:04:24.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.348+0000 7fdb3fe00640 1 --2- 172.21.15.99:0/3875566022 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5584c630d260 0x5584c630af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:24.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.348+0000 7fdb3fe00640 1 -- 172.21.15.99:0/3875566022 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5584c62d14c0 con 0x5584c62d7bc0 2024-02-21T23:04:24.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.348+0000 7fdb3fe00640 1 --2- 172.21.15.99:0/3875566022 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5584c62d7bc0 0x5584c63717b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c096d60 tx=0x7fdb2c01e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b98e6e9b85c856f9 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:04:24.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.349+0000 7fdb2be00640 1 -- 172.21.15.99:0/3875566022 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2c09f290 con 0x5584c62d7bc0 2024-02-21T23:04:24.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.349+0000 7fdb2be00640 1 -- 172.21.15.99:0/3875566022 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb2c0aab40 con 0x5584c62d7bc0 2024-02-21T23:04:24.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.349+0000 7fdb2be00640 1 -- 172.21.15.99:0/3875566022 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2c095ff0 con 0x5584c62d7bc0 2024-02-21T23:04:24.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.349+0000 7fdb4a484740 1 -- 172.21.15.99:0/3875566022 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5584c62d7bc0 msgr2=0x5584c63717b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:24.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.349+0000 7fdb4a484740 1 --2- 172.21.15.99:0/3875566022 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5584c62d7bc0 0x5584c63717b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c096d60 tx=0x7fdb2c01e070 comp rx=0 tx=0).stop 2024-02-21T23:04:24.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.349+0000 7fdb4a484740 1 -- 172.21.15.99:0/3875566022 shutdown_connections 2024-02-21T23:04:24.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.349+0000 7fdb4a484740 1 --2- 172.21.15.99:0/3875566022 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5584c630d260 0x5584c630af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:24.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.350+0000 7fdb4a484740 1 --2- 172.21.15.99:0/3875566022 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5584c62d7bc0 0x5584c63717b0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:24.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.350+0000 7fdb4a484740 1 --2- 172.21.15.99:0/3875566022 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5584c62d72a0 0x5584c630ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:24.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.350+0000 7fdb4a484740 1 -- 172.21.15.99:0/3875566022 >> 172.21.15.99:0/3875566022 conn(0x5584c62666b0 msgr2=0x5584c6303c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:04:24.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.350+0000 7fdb4a484740 1 -- 172.21.15.99:0/3875566022 shutdown_connections 2024-02-21T23:04:24.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.350+0000 7fdb4a484740 1 -- 172.21.15.99:0/3875566022 wait complete. 2024-02-21T23:04:24.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.350+0000 7fdb4a484740 1 -- start start 2024-02-21T23:04:24.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.351+0000 7fdb4a484740 1 Processor -- start 2024-02-21T23:04:24.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.353+0000 7fdb4a484740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5584c62d72a0 0x5584c62d0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:24.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.353+0000 7fdb4a484740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5584c62d7bc0 0x5584c6330140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:24.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.353+0000 7fdb4a484740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5584c630d260 0x5584c6294dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:24.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.353+0000 7fdb4a484740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4021fc90 con 0x5584c630d260 2024-02-21T23:04:24.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.353+0000 7fdb4a484740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb40229fe0 con 0x5584c62d72a0 2024-02-21T23:04:24.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.353+0000 7fdb4a484740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb402293e0 con 0x5584c62d7bc0 2024-02-21T23:04:24.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.353+0000 7fdb4a484740 10 client.0 _ll_register_callbacks cb 0x7fdb2c0967d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:04:24.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.353+0000 7fdb45600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5584c630d260 0x5584c6294dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:24.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.353+0000 7fdb3fe00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5584c62d7bc0 0x5584c6330140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:24.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.353+0000 7fdb3fe00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5584c62d7bc0 0x5584c6330140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:48796/0 (socket says 172.21.15.99:48796) 2024-02-21T23:04:24.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.353+0000 7fdb3fe00640 1 -- 172.21.15.99:0/1695610962 learned_addr learned my addr 172.21.15.99:0/1695610962 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:04:24.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.353+0000 7fdb44c00640 1 --2- 172.21.15.99:0/1695610962 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5584c62d72a0 0x5584c62d0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:24.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.353+0000 7fdb45600640 1 -- 172.21.15.99:0/1695610962 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5584c62d7bc0 msgr2=0x5584c6330140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:04:24.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.353+0000 7fdb45600640 1 --2- 172.21.15.99:0/1695610962 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5584c62d7bc0 0x5584c6330140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:24.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.353+0000 7fdb45600640 1 -- 172.21.15.99:0/1695610962 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5584c62d72a0 msgr2=0x5584c62d0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:04:24.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.353+0000 7fdb45600640 1 --2- 172.21.15.99:0/1695610962 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5584c62d72a0 0x5584c62d0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:24.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.353+0000 7fdb45600640 1 -- 172.21.15.99:0/1695610962 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5584c62a5cc0 con 0x5584c630d260 2024-02-21T23:04:24.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.354+0000 7fdb45600640 1 --2- 172.21.15.99:0/1695610962 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5584c630d260 0x5584c6294dd0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fdb38009d90 tx=0x7fdb38004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bda53ab1decedd2c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:04:24.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.354+0000 7fdb29600640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:04:24.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.354+0000 7fdb29600640 1 -- 172.21.15.99:0/1695610962 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb380509b0 con 0x5584c630d260 2024-02-21T23:04:24.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.354+0000 7fdb29600640 1 -- 172.21.15.99:0/1695610962 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7fdb38050b50 con 0x5584c630d260 2024-02-21T23:04:24.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.354+0000 7fdb4a484740 1 -- 172.21.15.99:0/1695610962 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdb2c0aab40 con 0x5584c630d260 2024-02-21T23:04:24.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.355+0000 7fdb29600640 1 -- 172.21.15.99:0/1695610962 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdb38050d50 con 0x5584c630d260 2024-02-21T23:04:24.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.355+0000 7fdb4a484740 10 client.5535 fetch_fsmap learned FSMap version 16 2024-02-21T23:04:24.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.355+0000 7fdb4a484740 1 -- 172.21.15.99:0/1695610962 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x5584c62a5700 con 0x5584c630d260 2024-02-21T23:04:24.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.355+0000 7fdb29600640 1 -- 172.21.15.99:0/1695610962 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb2c0aab40 con 0x5584c630d260 2024-02-21T23:04:24.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.355+0000 7fdb29600640 1 -- 172.21.15.99:0/1695610962 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fdb38035420 con 0x5584c630d260 2024-02-21T23:04:24.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.355+0000 7fdb4a484740 10 client.5535 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T23:04:24.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.355+0000 7fdb4a484740 10 client.5535 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:04:24.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.355+0000 7fdb4a484740 20 client.5535 populate_metadata read hostname 'smithi099' 2024-02-21T23:04:24.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.355+0000 7fdb4a484740 1 --2- 172.21.15.99:0/1695610962 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5584c636aa00 0x5584c6295310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:24.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.355+0000 7fdb4a484740 4 client.5535 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T23:04:24.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.355+0000 7fdb4a484740 1 -- 172.21.15.99:0/1695610962 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5584c620b320 con 0x5584c636aa00 2024-02-21T23:04:24.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.355+0000 7fdb44c00640 1 --2- 172.21.15.99:0/1695610962 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5584c636aa00 0x5584c6295310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:24.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.356+0000 7fdb44c00640 1 --2- 172.21.15.99:0/1695610962 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5584c636aa00 0x5584c6295310 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=455bfb6c9e40809b server_cookie=808cd8353b5bac2 in_seq=0 out_seq=0 2024-02-21T23:04:24.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.356+0000 7fdb29600640 10 client.5535 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:04:24.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.356+0000 7fdb29600640 1 -- 172.21.15.99:0/1695610962 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5584c620b320 con 0x5584c636aa00 2024-02-21T23:04:24.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.356+0000 7fdb29600640 10 client.5535 handle_command_reply: tid=0 2024-02-21T23:04:24.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.356+0000 7fdb4a484740 1 client.5535 shutdown 2024-02-21T23:04:24.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.356+0000 7fdb4a484740 1 -- 172.21.15.99:0/1695610962 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5584c630d260 msgr2=0x5584c6294dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:24.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.356+0000 7fdb4a484740 1 --2- 172.21.15.99:0/1695610962 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5584c630d260 0x5584c6294dd0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fdb38009d90 tx=0x7fdb38004ab0 comp rx=0 tx=0).stop 2024-02-21T23:04:24.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.356+0000 7fdb4a484740 1 -- 172.21.15.99:0/1695610962 shutdown_connections 2024-02-21T23:04:24.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.356+0000 7fdb4a484740 1 --2- 172.21.15.99:0/1695610962 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5584c636aa00 0x5584c6295310 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:24.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.356+0000 7fdb4a484740 1 --2- 172.21.15.99:0/1695610962 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5584c630d260 0x5584c6294dd0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:24.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.357+0000 7fdb4a484740 1 --2- 172.21.15.99:0/1695610962 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5584c62d7bc0 0x5584c6330140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:24.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.357+0000 7fdb4a484740 1 --2- 172.21.15.99:0/1695610962 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5584c62d72a0 0x5584c62d0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:24.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.357+0000 7fdb4a484740 1 -- 172.21.15.99:0/1695610962 >> 172.21.15.99:0/1695610962 conn(0x5584c62666b0 msgr2=0x5584c62c8620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:04:24.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.357+0000 7fdb29600640 0 client.5535 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:04:24.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.357+0000 7fdb4a484740 1 -- 172.21.15.99:0/1695610962 shutdown_connections 2024-02-21T23:04:24.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.357+0000 7fdb4a484740 1 -- 172.21.15.99:0/1695610962 wait complete. 2024-02-21T23:04:24.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.357+0000 7fdb4a484740 20 client.5535 trim_cache size 0 max 16384 2024-02-21T23:04:24.349 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-02-21T23:04:24.349 INFO:teuthology.orchestra.run.smithi099.stdout: "status": "no active scrubs running", 2024-02-21T23:04:24.349 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubs": {} 2024-02-21T23:04:24.349 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-02-21T23:04:24.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.358+0000 7fdb46000640 1 -- 172.21.15.99:0/2390363986 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fdb2009eed0 msgr2=0x7fdb200a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:24.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.358+0000 7fdb46000640 1 --2- 172.21.15.99:0/2390363986 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fdb2009eed0 0x7fdb200a1390 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdb38009bd0 tx=0x7fdb38031000 comp rx=0 tx=0).stop 2024-02-21T23:04:24.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.358+0000 7fdb46000640 1 -- 172.21.15.99:0/2390363986 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdb4017f490 msgr2=0x7fdb40173730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:24.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.358+0000 7fdb46000640 1 --2- 172.21.15.99:0/2390363986 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdb4017f490 0x7fdb40173730 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c00c410 tx=0x7fdb2c00c8d0 comp rx=0 tx=0).stop 2024-02-21T23:04:24.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.358+0000 7fdb46000640 1 -- 172.21.15.99:0/2390363986 shutdown_connections 2024-02-21T23:04:24.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.358+0000 7fdb46000640 1 --2- 172.21.15.99:0/2390363986 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fdb2009eed0 0x7fdb200a1390 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:24.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.358+0000 7fdb46000640 1 --2- 172.21.15.99:0/2390363986 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdb4018b230 0x7fdb4017cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:24.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.358+0000 7fdb46000640 1 --2- 172.21.15.99:0/2390363986 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdb4017f490 0x7fdb40173730 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:24.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.358+0000 7fdb46000640 1 --2- 172.21.15.99:0/2390363986 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb400d60b0 0x7fdb400cf440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:24.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.358+0000 7fdb46000640 1 -- 172.21.15.99:0/2390363986 >> 172.21.15.99:0/2390363986 conn(0x7fdb400d29b0 msgr2=0x7fdb400d0890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:04:24.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.358+0000 7fdb46000640 1 -- 172.21.15.99:0/2390363986 shutdown_connections 2024-02-21T23:04:24.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.358+0000 7fdb46000640 1 -- 172.21.15.99:0/2390363986 wait complete. 2024-02-21T23:04:24.366 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-02-21T23:04:24.366 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T23:04:24.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.564+0000 7fa588e00640 1 Processor -- start 2024-02-21T23:04:24.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.564+0000 7fa588e00640 1 -- start start 2024-02-21T23:04:24.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.567+0000 7fa588e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa5841833f0 0x7fa5840f8020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:24.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.567+0000 7fa588e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa584184cd0 0x7fa58406e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:24.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.567+0000 7fa588e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5840f89a0 con 0x7fa5840f8560 2024-02-21T23:04:24.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.567+0000 7fa588e00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa584186a10 con 0x7fa584184cd0 2024-02-21T23:04:24.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.567+0000 7fa588e00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5840f8c40 con 0x7fa5841833f0 2024-02-21T23:04:24.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.567+0000 7fa582800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa584184cd0 0x7fa58406e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:24.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.567+0000 7fa581e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa5841833f0 0x7fa5840f8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:24.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.567+0000 7fa582800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa584184cd0 0x7fa58406e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54312/0 (socket says 172.21.15.99:54312) 2024-02-21T23:04:24.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.567+0000 7fa582800640 1 -- 172.21.15.99:0/3818857584 learned_addr learned my addr 172.21.15.99:0/3818857584 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:04:24.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.567+0000 7fa581400640 1 --1- 172.21.15.99:0/3818857584 >> v1:172.21.15.162:6789/0 conn(0x7fa5840f8560 0x7fa5841845c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.99:34284/0 (socket says 172.21.15.99:34284) 2024-02-21T23:04:24.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.568+0000 7fa580a00640 1 -- 172.21.15.99:0/3818857584 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3707238477 0 0) 0x7fa5840f89a0 con 0x7fa5840f8560 2024-02-21T23:04:24.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.568+0000 7fa580a00640 1 -- 172.21.15.99:0/3818857584 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa568005730 con 0x7fa5840f8560 2024-02-21T23:04:24.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.568+0000 7fa581e00640 1 -- 172.21.15.99:0/3818857584 >> v2:172.21.15.99:3300/0 conn(0x7fa584184cd0 msgr2=0x7fa58406e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:04:24.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.568+0000 7fa581e00640 1 --2- 172.21.15.99:0/3818857584 >> v2:172.21.15.99:3300/0 conn(0x7fa584184cd0 0x7fa58406e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:24.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.568+0000 7fa581e00640 1 -- 172.21.15.99:0/3818857584 >> v1:172.21.15.162:6789/0 conn(0x7fa5840f8560 legacy=0x7fa5841845c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:24.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.568+0000 7fa581e00640 1 -- 172.21.15.99:0/3818857584 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5840f8f20 con 0x7fa5841833f0 2024-02-21T23:04:24.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.569+0000 7fa581e00640 1 --2- 172.21.15.99:0/3818857584 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa5841833f0 0x7fa5840f8020 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa5840fb220 tx=0x7fa57402b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ddc6905b374800ed server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:04:24.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.569+0000 7fa580a00640 1 -- 172.21.15.99:0/3818857584 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5740315a0 con 0x7fa5841833f0 2024-02-21T23:04:24.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.569+0000 7fa580a00640 1 -- 172.21.15.99:0/3818857584 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa574037070 con 0x7fa5841833f0 2024-02-21T23:04:24.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.569+0000 7fa580a00640 1 -- 172.21.15.99:0/3818857584 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa574031960 con 0x7fa5841833f0 2024-02-21T23:04:24.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.570+0000 7fa588e00640 1 -- 172.21.15.99:0/3818857584 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa5841833f0 msgr2=0x7fa5840f8020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:24.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.570+0000 7fa588e00640 1 --2- 172.21.15.99:0/3818857584 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa5841833f0 0x7fa5840f8020 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa5840fb220 tx=0x7fa57402b840 comp rx=0 tx=0).stop 2024-02-21T23:04:24.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.570+0000 7fa588e00640 1 -- 172.21.15.99:0/3818857584 shutdown_connections 2024-02-21T23:04:24.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.570+0000 7fa588e00640 1 --2- 172.21.15.99:0/3818857584 >> v2:172.21.15.99:3300/0 conn(0x7fa584184cd0 0x7fa58406e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:24.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.570+0000 7fa588e00640 1 --2- 172.21.15.99:0/3818857584 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa5841833f0 0x7fa5840f8020 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:24.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.570+0000 7fa588e00640 1 -- 172.21.15.99:0/3818857584 >> 172.21.15.99:0/3818857584 conn(0x7fa5840ce5f0 msgr2=0x7fa5840cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:04:24.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.570+0000 7fa588e00640 1 -- 172.21.15.99:0/3818857584 shutdown_connections 2024-02-21T23:04:24.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.570+0000 7fa588e00640 1 -- 172.21.15.99:0/3818857584 wait complete. 2024-02-21T23:04:24.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.572+0000 7fa588e00640 1 Processor -- start 2024-02-21T23:04:24.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.572+0000 7fa588e00640 1 -- start start 2024-02-21T23:04:24.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.573+0000 7fa588e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5840f8560 0x7fa5841715a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:24.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.573+0000 7fa588e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa5841833f0 0x7fa584186b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:24.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.573+0000 7fa588e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa584184cd0 0x7fa5841870d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:24.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.573+0000 7fa588e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5841840a0 con 0x7fa5840f8560 2024-02-21T23:04:24.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.573+0000 7fa588e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa584183dc0 con 0x7fa5841833f0 2024-02-21T23:04:24.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.573+0000 7fa588e00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa584185120 con 0x7fa584184cd0 2024-02-21T23:04:24.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.573+0000 7fa581e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5840f8560 0x7fa5841715a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:24.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.573+0000 7fa581e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5840f8560 0x7fa5841715a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54324/0 (socket says 172.21.15.99:54324) 2024-02-21T23:04:24.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.573+0000 7fa581e00640 1 -- 172.21.15.99:0/2475715526 learned_addr learned my addr 172.21.15.99:0/2475715526 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:04:24.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.573+0000 7fa581400640 1 --2- 172.21.15.99:0/2475715526 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa5841833f0 0x7fa584186b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:24.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.574+0000 7fa582800640 1 --2- 172.21.15.99:0/2475715526 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa584184cd0 0x7fa5841870d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:24.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.574+0000 7fa581e00640 1 -- 172.21.15.99:0/2475715526 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa584184cd0 msgr2=0x7fa5841870d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:24.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.574+0000 7fa581e00640 1 --2- 172.21.15.99:0/2475715526 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa584184cd0 0x7fa5841870d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:24.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.574+0000 7fa581e00640 1 -- 172.21.15.99:0/2475715526 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa5841833f0 msgr2=0x7fa584186b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:24.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.574+0000 7fa581e00640 1 --2- 172.21.15.99:0/2475715526 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa5841833f0 0x7fa584186b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:24.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.574+0000 7fa581e00640 1 -- 172.21.15.99:0/2475715526 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa584152fc0 con 0x7fa5840f8560 2024-02-21T23:04:24.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.574+0000 7fa581e00640 1 --2- 172.21.15.99:0/2475715526 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5840f8560 0x7fa5841715a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa574000c00 tx=0x7fa5740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:04:24.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.575+0000 7fa57a000640 1 -- 172.21.15.99:0/2475715526 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa574032630 con 0x7fa5840f8560 2024-02-21T23:04:24.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.575+0000 7fa57a000640 1 -- 172.21.15.99:0/2475715526 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5740327f0 con 0x7fa5840f8560 2024-02-21T23:04:24.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.575+0000 7fa57a000640 1 -- 172.21.15.99:0/2475715526 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa574032be0 con 0x7fa5840f8560 2024-02-21T23:04:24.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.575+0000 7fa588e00640 1 -- 172.21.15.99:0/2475715526 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5840ca000 con 0x7fa5840f8560 2024-02-21T23:04:24.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.575+0000 7fa588e00640 1 -- 172.21.15.99:0/2475715526 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5840ca5c0 con 0x7fa5840f8560 2024-02-21T23:04:24.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.576+0000 7fa588e00640 1 -- 172.21.15.99:0/2475715526 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5840c9380 con 0x7fa5840f8560 2024-02-21T23:04:24.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.578+0000 7fa57a000640 1 -- 172.21.15.99:0/2475715526 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7fa57403b3f0 con 0x7fa5840f8560 2024-02-21T23:04:24.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.579+0000 7fa57a000640 1 --2- 172.21.15.99:0/2475715526 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa56409ef00 0x7fa5640a13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:24.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.580+0000 7fa57a000640 1 -- 172.21.15.99:0/2475715526 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7fa57402f030 con 0x7fa5840f8560 2024-02-21T23:04:24.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.580+0000 7fa581400640 1 --2- 172.21.15.99:0/2475715526 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa56409ef00 0x7fa5640a13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:24.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.581+0000 7fa581400640 1 --2- 172.21.15.99:0/2475715526 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa56409ef00 0x7fa5640a13c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa5840c8dc0 tx=0x7fa570007cf0 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:04:24.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.583+0000 7fa57a000640 1 -- 172.21.15.99:0/2475715526 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fa5840c9380 con 0x7fa5840f8560 2024-02-21T23:04:24.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.936+0000 7fa588e00640 1 -- 172.21.15.99:0/2475715526 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa584174f30 con 0x7fa5840f8560 2024-02-21T23:04:24.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.937+0000 7fa57a000640 1 -- 172.21.15.99:0/2475715526 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+11336 (secure 0 0 0) 0x7fa574040070 con 0x7fa5840f8560 2024-02-21T23:04:24.926 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T23:04:24.927 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4307,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/3514452812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3514452812},{"type":"v1","addr":"172.21.15.162:6836","nonce":3514452812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4312,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6838/2169982089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":2169982089},{"type":"v1","addr":"172.21.15.162:6838","nonce":2169982089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4315,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6839/3335972724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6837","nonce":3335972724},{"type":"v1","addr":"172.21.15.162:6839","nonce":3335972724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4318,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6841/2135456697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6840","nonce":2135456697},{"type":"v1","addr":"172.21.15.162:6841","nonce":2135456697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4325,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2452242758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2452242758},{"type":"v1","addr":"172.21.15.181:6833","nonce":2452242758}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4328,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6836/2751486400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":2751486400},{"type":"v1","addr":"172.21.15.181:6836","nonce":2751486400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":16,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-21T23:01:02.656130+0000","modified":"2024-02-21T23:03:58.159765+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4355,"mds_1":4352,"mds_2":4348},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4331":{"gid":4331,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6838/3728901330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6835","nonce":3728901330},{"type":"v1","addr":"172.21.15.181:6838","nonce":3728901330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4339":{"gid":4339,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6839/3357929641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6837","nonce":3357929641},{"type":"v1","addr":"172.21.15.181:6839","nonce":3357929641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4343":{"gid":4343,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6833/2793485078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":2793485078},{"type":"v1","addr":"172.21.15.99:6833","nonce":2793485078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4348":{"gid":4348,"name":"d","rank":2,"incarnation":12,"state":"up:active","state_seq":10,"addr":"172.21.15.99:6835/2243461688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2243461688},{"type":"v1","addr":"172.21.15.99:6835","nonce":2243461688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4352":{"gid":4352,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.99:6837/1676159950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":1676159950},{"type":"v1","addr":"172.21.15.99:6837","nonce":1676159950}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4355":{"gid":4355,"name":"j","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6839/4239008786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":4239008786},{"type":"v1","addr":"172.21.15.99:6839","nonce":4239008786}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-21T23:04:24.927 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 16 2024-02-21T23:04:24.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.940+0000 7fa588e00640 1 -- 172.21.15.99:0/2475715526 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa56409ef00 msgr2=0x7fa5640a13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:24.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.940+0000 7fa588e00640 1 --2- 172.21.15.99:0/2475715526 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa56409ef00 0x7fa5640a13c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa5840c8dc0 tx=0x7fa570007cf0 comp rx=0 tx=0).stop 2024-02-21T23:04:24.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.940+0000 7fa588e00640 1 -- 172.21.15.99:0/2475715526 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5840f8560 msgr2=0x7fa5841715a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:24.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.940+0000 7fa588e00640 1 --2- 172.21.15.99:0/2475715526 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5840f8560 0x7fa5841715a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fa574000c00 tx=0x7fa5740046c0 comp rx=0 tx=0).stop 2024-02-21T23:04:24.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.940+0000 7fa588e00640 1 -- 172.21.15.99:0/2475715526 shutdown_connections 2024-02-21T23:04:24.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.940+0000 7fa588e00640 1 --2- 172.21.15.99:0/2475715526 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa56409ef00 0x7fa5640a13c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:24.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.940+0000 7fa588e00640 1 --2- 172.21.15.99:0/2475715526 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa584184cd0 0x7fa5841870d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:24.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.940+0000 7fa588e00640 1 --2- 172.21.15.99:0/2475715526 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa5841833f0 0x7fa584186b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:24.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.940+0000 7fa588e00640 1 --2- 172.21.15.99:0/2475715526 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa5840f8560 0x7fa5841715a0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:24.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.940+0000 7fa588e00640 1 -- 172.21.15.99:0/2475715526 >> 172.21.15.99:0/2475715526 conn(0x7fa5840ce5f0 msgr2=0x7fa5840f4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:04:24.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.940+0000 7fa588e00640 1 -- 172.21.15.99:0/2475715526 shutdown_connections 2024-02-21T23:04:24.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:24.940+0000 7fa588e00640 1 -- 172.21.15.99:0/2475715526 wait complete. 2024-02-21T23:04:24.945 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T23:04:24.945 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-02-21T23:04:25.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.196+0000 7f2657e00640 1 Processor -- start 2024-02-21T23:04:25.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.197+0000 7f2657e00640 1 -- start start 2024-02-21T23:04:25.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.198+0000 7f2657e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f26580d60b0 0x7f26580fc990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:25.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.198+0000 7f2657e00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26580d6dd0 con 0x7f265817f490 2024-02-21T23:04:25.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.198+0000 7f2657e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26581614c0 con 0x7f265818b230 2024-02-21T23:04:25.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.198+0000 7f2657e00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26580d6810 con 0x7f26580d60b0 2024-02-21T23:04:25.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.198+0000 7f2656a00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f265817f490 0x7f265818ab20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:54838/0 (socket says 172.21.15.99:54838) 2024-02-21T23:04:25.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.198+0000 7f2656a00640 1 -- 172.21.15.99:0/397311494 learned_addr learned my addr 172.21.15.99:0/397311494 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:04:25.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.199+0000 7f2657400640 1 --2- 172.21.15.99:0/397311494 >> v2:172.21.15.162:3300/0 conn(0x7f26580d60b0 0x7f26580fc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:25.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.199+0000 7f2656000640 1 -- 172.21.15.99:0/397311494 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4002407206 0 0) 0x7f26580d6dd0 con 0x7f265817f490 2024-02-21T23:04:25.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.199+0000 7f2656000640 1 -- 172.21.15.99:0/397311494 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f263c003520 con 0x7f265817f490 2024-02-21T23:04:25.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.199+0000 7f2656000640 1 -- 172.21.15.99:0/397311494 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3217783992 0 0) 0x7f26581614c0 con 0x7f265818b230 2024-02-21T23:04:25.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.199+0000 7f2656000640 1 -- 172.21.15.99:0/397311494 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26580d6dd0 con 0x7f265818b230 2024-02-21T23:04:25.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.199+0000 7f2657400640 1 -- 172.21.15.99:0/397311494 >> v1:172.21.15.162:6789/0 conn(0x7f265818b230 legacy=0x7f26580fc280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:25.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.199+0000 7f2657400640 1 -- 172.21.15.99:0/397311494 >> v1:172.21.15.99:6789/0 conn(0x7f265817f490 legacy=0x7f265818ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:25.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.199+0000 7f2657400640 1 -- 172.21.15.99:0/397311494 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26580d6af0 con 0x7f26580d60b0 2024-02-21T23:04:25.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.201+0000 7f2657400640 1 --2- 172.21.15.99:0/397311494 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f26580d60b0 0x7f26580fc990 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f2650009d90 tx=0x7f265002bf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a1886c59810b0d8 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:04:25.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.201+0000 7f2656000640 1 -- 172.21.15.99:0/397311494 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2650039070 con 0x7f26580d60b0 2024-02-21T23:04:25.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.201+0000 7f2656000640 1 -- 172.21.15.99:0/397311494 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f265002cd00 con 0x7f26580d60b0 2024-02-21T23:04:25.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.201+0000 7f2656000640 1 -- 172.21.15.99:0/397311494 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2650034640 con 0x7f26580d60b0 2024-02-21T23:04:25.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.202+0000 7f2657e00640 1 -- 172.21.15.99:0/397311494 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f26580d60b0 msgr2=0x7f26580fc990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:25.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.202+0000 7f2657e00640 1 --2- 172.21.15.99:0/397311494 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f26580d60b0 0x7f26580fc990 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f2650009d90 tx=0x7f265002bf50 comp rx=0 tx=0).stop 2024-02-21T23:04:25.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.202+0000 7f2657e00640 1 -- 172.21.15.99:0/397311494 shutdown_connections 2024-02-21T23:04:25.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.202+0000 7f2657e00640 1 --2- 172.21.15.99:0/397311494 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f26580d60b0 0x7f26580fc990 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:25.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.202+0000 7f2657e00640 1 -- 172.21.15.99:0/397311494 >> 172.21.15.99:0/397311494 conn(0x7f26580d29b0 msgr2=0x7f26580d2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:04:25.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.202+0000 7f2657e00640 1 -- 172.21.15.99:0/397311494 shutdown_connections 2024-02-21T23:04:25.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.202+0000 7f2657e00640 1 -- 172.21.15.99:0/397311494 wait complete. 2024-02-21T23:04:25.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.205+0000 7f2657e00640 1 Processor -- start 2024-02-21T23:04:25.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.205+0000 7f2657e00640 1 -- start start 2024-02-21T23:04:25.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.207+0000 7f2657e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f26580d60b0 0x7f265815bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:25.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.207+0000 7f2657e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f265817f490 0x7f265817b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:25.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.207+0000 7f2657e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f265818b230 0x7f265817b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:25.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.207+0000 7f2657e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f265818a600 con 0x7f26580d60b0 2024-02-21T23:04:25.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.207+0000 7f2657e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f265818a320 con 0x7f265817f490 2024-02-21T23:04:25.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.207+0000 7f2657e00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26580d6500 con 0x7f265818b230 2024-02-21T23:04:25.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.207+0000 7f2656a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f26580d60b0 0x7f265815bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:25.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.208+0000 7f2656a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f26580d60b0 0x7f265815bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54330/0 (socket says 172.21.15.99:54330) 2024-02-21T23:04:25.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.208+0000 7f2656a00640 1 -- 172.21.15.99:0/3463441928 learned_addr learned my addr 172.21.15.99:0/3463441928 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:04:25.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.208+0000 7f264fe00640 1 --2- 172.21.15.99:0/3463441928 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f265817f490 0x7f265817b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:25.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.208+0000 7f2657400640 1 --2- 172.21.15.99:0/3463441928 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f265818b230 0x7f265817b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:25.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.208+0000 7f264fe00640 1 -- 172.21.15.99:0/3463441928 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f265818b230 msgr2=0x7f265817b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:25.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.208+0000 7f264fe00640 1 --2- 172.21.15.99:0/3463441928 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f265818b230 0x7f265817b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:25.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.208+0000 7f264fe00640 1 -- 172.21.15.99:0/3463441928 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f26580d60b0 msgr2=0x7f265815bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:25.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.208+0000 7f264fe00640 1 --2- 172.21.15.99:0/3463441928 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f26580d60b0 0x7f265815bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:25.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.208+0000 7f264fe00640 1 -- 172.21.15.99:0/3463441928 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2658215270 con 0x7f265817f490 2024-02-21T23:04:25.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.208+0000 7f2656a00640 1 --2- 172.21.15.99:0/3463441928 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f26580d60b0 0x7f265815bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:04:25.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.208+0000 7f264fe00640 1 --2- 172.21.15.99:0/3463441928 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f265817f490 0x7f265817b230 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f264000c3c0 tx=0x7f2640001e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:04:25.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.209+0000 7f264ea00640 1 -- 172.21.15.99:0/3463441928 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2640017070 con 0x7f265817f490 2024-02-21T23:04:25.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.209+0000 7f264ea00640 1 -- 172.21.15.99:0/3463441928 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26400052d0 con 0x7f265817f490 2024-02-21T23:04:25.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.209+0000 7f2657e00640 1 -- 172.21.15.99:0/3463441928 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2658215550 con 0x7f265817f490 2024-02-21T23:04:25.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.209+0000 7f264ea00640 1 -- 172.21.15.99:0/3463441928 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2640003810 con 0x7f265817f490 2024-02-21T23:04:25.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.209+0000 7f2657e00640 1 -- 172.21.15.99:0/3463441928 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2658215b10 con 0x7f265817f490 2024-02-21T23:04:25.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.212+0000 7f264ea00640 1 -- 172.21.15.99:0/3463441928 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f264001a070 con 0x7f265817f490 2024-02-21T23:04:25.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.214+0000 7f264ea00640 1 --2- 172.21.15.99:0/3463441928 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f263409ef00 0x7f26340a13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:25.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.214+0000 7f264ea00640 1 -- 172.21.15.99:0/3463441928 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f26400c90f0 con 0x7f265817f490 2024-02-21T23:04:25.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.215+0000 7f2656a00640 1 --2- 172.21.15.99:0/3463441928 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f263409ef00 0x7f26340a13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:25.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.215+0000 7f2660602740 1 Processor -- start 2024-02-21T23:04:25.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.215+0000 7f2660602740 1 -- start start 2024-02-21T23:04:25.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.215+0000 7f2656a00640 1 --2- 172.21.15.99:0/3463441928 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f263409ef00 0x7f26340a13c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2648000f60 tx=0x7f2648009040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:04:25.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.217+0000 7f2660602740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559885a22660 0x559885a22a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:25.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.217+0000 7f2660602740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559885a5d330 0x559885a5d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:25.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.217+0000 7f2660602740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559885a5dcf0 0x559885a5e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:25.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.217+0000 7f2660602740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55988594ab50 con 0x559885a22660 2024-02-21T23:04:25.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.217+0000 7f2660602740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598858f3da0 con 0x559885a5dcf0 2024-02-21T23:04:25.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.217+0000 7f2660602740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x559885946bf0 con 0x559885a5d330 2024-02-21T23:04:25.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.217+0000 7f2656a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559885a22660 0x559885a22a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:25.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.217+0000 7f264fe00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559885a5d330 0x559885a5d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:25.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.217+0000 7f2656a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559885a22660 0x559885a22a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54344/0 (socket says 172.21.15.99:54344) 2024-02-21T23:04:25.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.217+0000 7f2656a00640 1 -- 172.21.15.99:0/1282889804 learned_addr learned my addr 172.21.15.99:0/1282889804 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:04:25.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.217+0000 7f2657400640 1 --2- 172.21.15.99:0/1282889804 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559885a5dcf0 0x559885a5e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:25.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.217+0000 7f2656a00640 1 -- 172.21.15.99:0/1282889804 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559885a5d330 msgr2=0x559885a5d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:04:25.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.218+0000 7f2656a00640 1 --2- 172.21.15.99:0/1282889804 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559885a5d330 0x559885a5d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:25.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.218+0000 7f2656a00640 1 -- 172.21.15.99:0/1282889804 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559885a5dcf0 msgr2=0x559885a5e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:04:25.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.218+0000 7f2656a00640 1 --2- 172.21.15.99:0/1282889804 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559885a5dcf0 0x559885a5e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:25.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.218+0000 7f2656a00640 1 -- 172.21.15.99:0/1282889804 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559885916f80 con 0x559885a22660 2024-02-21T23:04:25.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.218+0000 7f2656a00640 1 --2- 172.21.15.99:0/1282889804 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559885a22660 0x559885a22a40 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f2648001a30 tx=0x7f2648012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4671e19ea360a22c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:04:25.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.218+0000 7f2647000640 1 -- 172.21.15.99:0/1282889804 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2648025070 con 0x559885a22660 2024-02-21T23:04:25.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.218+0000 7f2647000640 1 -- 172.21.15.99:0/1282889804 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f264801b050 con 0x559885a22660 2024-02-21T23:04:25.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.218+0000 7f2647000640 1 -- 172.21.15.99:0/1282889804 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26480137e0 con 0x559885a22660 2024-02-21T23:04:25.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.219+0000 7f2660602740 1 -- 172.21.15.99:0/1282889804 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559885a22660 msgr2=0x559885a22a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:25.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.219+0000 7f2660602740 1 --2- 172.21.15.99:0/1282889804 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559885a22660 0x559885a22a40 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f2648001a30 tx=0x7f2648012000 comp rx=0 tx=0).stop 2024-02-21T23:04:25.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.219+0000 7f2660602740 1 -- 172.21.15.99:0/1282889804 shutdown_connections 2024-02-21T23:04:25.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.219+0000 7f2660602740 1 --2- 172.21.15.99:0/1282889804 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559885a5dcf0 0x559885a5e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:25.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.219+0000 7f2660602740 1 --2- 172.21.15.99:0/1282889804 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559885a5d330 0x559885a5d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:25.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.219+0000 7f2660602740 1 --2- 172.21.15.99:0/1282889804 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559885a22660 0x559885a22a40 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:25.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.219+0000 7f2660602740 1 -- 172.21.15.99:0/1282889804 >> 172.21.15.99:0/1282889804 conn(0x5598859e46d0 msgr2=0x5598859e5750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:04:25.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.219+0000 7f2660602740 1 -- 172.21.15.99:0/1282889804 shutdown_connections 2024-02-21T23:04:25.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.219+0000 7f2660602740 1 -- 172.21.15.99:0/1282889804 wait complete. 2024-02-21T23:04:25.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.221+0000 7f2660602740 1 -- start start 2024-02-21T23:04:25.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.221+0000 7f2660602740 1 Processor -- start 2024-02-21T23:04:25.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.223+0000 7f2660602740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559885a5d330 0x559885a13b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:25.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.223+0000 7f2660602740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559885a5dcf0 0x559885a0fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:25.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.223+0000 7f2660602740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559885a6a7a0 0x5598859dfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:25.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.223+0000 7f2660602740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x559885a5c0a0 con 0x559885a5d330 2024-02-21T23:04:25.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.223+0000 7f2660602740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598858e9380 con 0x559885a5dcf0 2024-02-21T23:04:25.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.223+0000 7f2660602740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x559885a5bdc0 con 0x559885a6a7a0 2024-02-21T23:04:25.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.223+0000 7f2660602740 10 client.0 _ll_register_callbacks cb 0x559885942280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:04:25.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.223+0000 7f2656a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559885a5d330 0x559885a13b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:25.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.223+0000 7f264fe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559885a5dcf0 0x559885a0fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:25.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.223+0000 7f2656a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559885a5d330 0x559885a13b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54356/0 (socket says 172.21.15.99:54356) 2024-02-21T23:04:25.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.223+0000 7f264fe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559885a5dcf0 0x559885a0fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:47710/0 (socket says 172.21.15.99:47710) 2024-02-21T23:04:25.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.223+0000 7f2656a00640 1 -- 172.21.15.99:0/2391584929 learned_addr learned my addr 172.21.15.99:0/2391584929 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:04:25.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.224+0000 7f2657400640 1 --2- 172.21.15.99:0/2391584929 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559885a6a7a0 0x5598859dfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:25.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.224+0000 7f264fe00640 1 -- 172.21.15.99:0/2391584929 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559885a6a7a0 msgr2=0x5598859dfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:04:25.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.224+0000 7f264fe00640 1 --2- 172.21.15.99:0/2391584929 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559885a6a7a0 0x5598859dfec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:25.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.224+0000 7f264fe00640 1 -- 172.21.15.99:0/2391584929 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559885a5d330 msgr2=0x559885a13b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:04:25.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.224+0000 7f264fe00640 1 --2- 172.21.15.99:0/2391584929 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559885a5d330 0x559885a13b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:25.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.224+0000 7f264fe00640 1 -- 172.21.15.99:0/2391584929 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559885911c20 con 0x559885a5dcf0 2024-02-21T23:04:25.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.224+0000 7f2656a00640 1 --2- 172.21.15.99:0/2391584929 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559885a5d330 0x559885a13b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:04:25.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.224+0000 7f264fe00640 1 --2- 172.21.15.99:0/2391584929 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559885a5dcf0 0x559885a0fc20 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f26400c6840 tx=0x7f2640096510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0db19abfd7bd671 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:04:25.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.224+0000 7f263b400640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-02-21T23:04:25.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.224+0000 7f263b400640 1 -- 172.21.15.99:0/2391584929 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26400960f0 con 0x559885a5dcf0 2024-02-21T23:04:25.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.224+0000 7f263b400640 1 -- 172.21.15.99:0/2391584929 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f2640092760 con 0x559885a5dcf0 2024-02-21T23:04:25.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.224+0000 7f2660602740 1 -- 172.21.15.99:0/2391584929 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f264801b050 con 0x559885a5dcf0 2024-02-21T23:04:25.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.225+0000 7f263b400640 1 -- 172.21.15.99:0/2391584929 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f264009f190 con 0x559885a5dcf0 2024-02-21T23:04:25.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.225+0000 7f2660602740 10 client.5665 fetch_fsmap learned FSMap version 16 2024-02-21T23:04:25.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.225+0000 7f2660602740 1 -- 172.21.15.99:0/2391584929 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55988565f3f0 con 0x559885a5dcf0 2024-02-21T23:04:25.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.225+0000 7f263b400640 1 -- 172.21.15.99:0/2391584929 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f264801b050 con 0x559885a5dcf0 2024-02-21T23:04:25.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.225+0000 7f263b400640 1 -- 172.21.15.99:0/2391584929 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f2640092960 con 0x559885a5dcf0 2024-02-21T23:04:25.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.225+0000 7f2660602740 10 client.5665 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T23:04:25.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.225+0000 7f2660602740 10 client.5665 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.d 2024-02-21T23:04:25.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.225+0000 7f2660602740 20 client.5665 populate_metadata read hostname 'smithi099' 2024-02-21T23:04:25.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.225+0000 7f2660602740 1 --2- 172.21.15.99:0/2391584929 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x5598859e08d0 0x559885a5aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:25.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.225+0000 7f2660602740 4 client.5665 mds_command: new command op to 4348 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:04:25.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.225+0000 7f2660602740 1 -- 172.21.15.99:0/2391584929 --> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559885958090 con 0x5598859e08d0 2024-02-21T23:04:25.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.226+0000 7f2656a00640 1 --2- 172.21.15.99:0/2391584929 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x5598859e08d0 0x559885a5aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:25.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.226+0000 7f2656a00640 1 --2- 172.21.15.99:0/2391584929 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x5598859e08d0 0x559885a5aaa0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=aa4aa1786a361233 server_cookie=ec86540b1bd9b0ee in_seq=0 out_seq=0 2024-02-21T23:04:25.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.226+0000 7f263b400640 10 client.5665 ms_handle_connect on v2:172.21.15.99:6834/2243461688 2024-02-21T23:04:25.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.227+0000 7f263b400640 1 -- 172.21.15.99:0/2391584929 <== mds.2 v2:172.21.15.99:6834/2243461688 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x559885958090 con 0x5598859e08d0 2024-02-21T23:04:25.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.227+0000 7f263b400640 10 client.5665 handle_command_reply: tid=0 2024-02-21T23:04:25.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.227+0000 7f2660602740 1 client.5665 shutdown 2024-02-21T23:04:25.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.227+0000 7f2660602740 1 -- 172.21.15.99:0/2391584929 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559885a5dcf0 msgr2=0x559885a0fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:25.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.227+0000 7f2660602740 1 --2- 172.21.15.99:0/2391584929 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559885a5dcf0 0x559885a0fc20 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f26400c6840 tx=0x7f2640096510 comp rx=0 tx=0).stop 2024-02-21T23:04:25.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.227+0000 7f2660602740 1 -- 172.21.15.99:0/2391584929 shutdown_connections 2024-02-21T23:04:25.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.227+0000 7f2660602740 1 --2- 172.21.15.99:0/2391584929 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x5598859e08d0 0x559885a5aaa0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:25.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.227+0000 7f2660602740 1 --2- 172.21.15.99:0/2391584929 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559885a6a7a0 0x5598859dfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:25.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.227+0000 7f2660602740 1 --2- 172.21.15.99:0/2391584929 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559885a5dcf0 0x559885a0fc20 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:25.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.227+0000 7f2660602740 1 --2- 172.21.15.99:0/2391584929 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559885a5d330 0x559885a13b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:25.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.227+0000 7f263b400640 0 client.5665 ms_handle_reset on v2:172.21.15.99:6834/2243461688 2024-02-21T23:04:25.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.227+0000 7f2660602740 1 -- 172.21.15.99:0/2391584929 >> 172.21.15.99:0/2391584929 conn(0x559885a22660 msgr2=0x559885a2de40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:04:25.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.227+0000 7f2660602740 1 -- 172.21.15.99:0/2391584929 shutdown_connections 2024-02-21T23:04:25.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.227+0000 7f2660602740 1 -- 172.21.15.99:0/2391584929 wait complete. 2024-02-21T23:04:25.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.228+0000 7f2660602740 20 client.5665 trim_cache size 0 max 16384 2024-02-21T23:04:25.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.241+0000 7f2660602740 1 Processor -- start 2024-02-21T23:04:25.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.241+0000 7f2660602740 1 -- start start 2024-02-21T23:04:25.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.242+0000 7f2660602740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559885a5d330 0x559885aba890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:25.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.242+0000 7f2660602740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559885a5dcf0 0x5598859dc830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:25.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.242+0000 7f2660602740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559885a6a7a0 0x5598859e3d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:25.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.242+0000 7f2660602740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f265822c790 con 0x559885a6a7a0 2024-02-21T23:04:25.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.242+0000 7f2660602740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f265822a330 con 0x559885a5dcf0 2024-02-21T23:04:25.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.242+0000 7f2660602740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2658222fc0 con 0x559885a5d330 2024-02-21T23:04:25.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.243+0000 7f2657400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559885a6a7a0 0x5598859e3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:25.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.243+0000 7f2656a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559885a5d330 0x559885aba890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:25.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.243+0000 7f2657400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559885a6a7a0 0x5598859e3d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54362/0 (socket says 172.21.15.99:54362) 2024-02-21T23:04:25.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.243+0000 7f2657400640 1 -- 172.21.15.99:0/2279784011 learned_addr learned my addr 172.21.15.99:0/2279784011 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:04:25.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.243+0000 7f264fe00640 1 --2- 172.21.15.99:0/2279784011 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559885a5dcf0 0x5598859dc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:25.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.243+0000 7f2656a00640 1 -- 172.21.15.99:0/2279784011 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559885a5dcf0 msgr2=0x5598859dc830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:04:25.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.243+0000 7f2656a00640 1 --2- 172.21.15.99:0/2279784011 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559885a5dcf0 0x5598859dc830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:25.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.243+0000 7f2656a00640 1 -- 172.21.15.99:0/2279784011 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559885a6a7a0 msgr2=0x5598859e3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:04:25.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.243+0000 7f2656a00640 1 --2- 172.21.15.99:0/2279784011 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559885a6a7a0 0x5598859e3d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:25.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.243+0000 7f2656a00640 1 -- 172.21.15.99:0/2279784011 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5598857297d0 con 0x559885a5d330 2024-02-21T23:04:25.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.243+0000 7f2656a00640 1 --2- 172.21.15.99:0/2279784011 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559885a5d330 0x559885aba890 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x559885a677b0 tx=0x7f2648015000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e406a0214ddee892 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:04:25.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.244+0000 7f2646600640 1 -- 172.21.15.99:0/2279784011 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2648025040 con 0x559885a5d330 2024-02-21T23:04:25.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.244+0000 7f2646600640 1 -- 172.21.15.99:0/2279784011 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2648030020 con 0x559885a5d330 2024-02-21T23:04:25.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.244+0000 7f2646600640 1 -- 172.21.15.99:0/2279784011 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2648013e60 con 0x559885a5d330 2024-02-21T23:04:25.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.244+0000 7f2660602740 1 -- 172.21.15.99:0/2279784011 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559885a5d330 msgr2=0x559885aba890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:25.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.244+0000 7f2660602740 1 --2- 172.21.15.99:0/2279784011 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559885a5d330 0x559885aba890 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x559885a677b0 tx=0x7f2648015000 comp rx=0 tx=0).stop 2024-02-21T23:04:25.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.244+0000 7f2660602740 1 -- 172.21.15.99:0/2279784011 shutdown_connections 2024-02-21T23:04:25.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.244+0000 7f2660602740 1 --2- 172.21.15.99:0/2279784011 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559885a6a7a0 0x5598859e3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:25.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.244+0000 7f2660602740 1 --2- 172.21.15.99:0/2279784011 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559885a5dcf0 0x5598859dc830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:25.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.244+0000 7f2660602740 1 --2- 172.21.15.99:0/2279784011 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559885a5d330 0x559885aba890 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:25.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.244+0000 7f2660602740 1 -- 172.21.15.99:0/2279784011 >> 172.21.15.99:0/2279784011 conn(0x559885a22660 msgr2=0x559885a6a030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:04:25.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.244+0000 7f2660602740 1 -- 172.21.15.99:0/2279784011 shutdown_connections 2024-02-21T23:04:25.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.244+0000 7f2660602740 1 -- 172.21.15.99:0/2279784011 wait complete. 2024-02-21T23:04:25.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.246+0000 7f2660602740 1 -- start start 2024-02-21T23:04:25.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.246+0000 7f2660602740 1 Processor -- start 2024-02-21T23:04:25.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.248+0000 7f2660602740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559885a5d330 0x559885aafe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:25.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.248+0000 7f2660602740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559885a5dcf0 0x5598859ec170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:25.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.248+0000 7f2660602740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559885a6a7a0 0x559885a17c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:25.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.248+0000 7f2660602740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2658228a70 con 0x559885a5dcf0 2024-02-21T23:04:25.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.248+0000 7f2660602740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2658229cd0 con 0x559885a5d330 2024-02-21T23:04:25.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.248+0000 7f2660602740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2658229070 con 0x559885a6a7a0 2024-02-21T23:04:25.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.248+0000 7f2660602740 10 client.0 _ll_register_callbacks cb 0x7f264000c310 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:04:25.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.248+0000 7f264fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559885a5dcf0 0x5598859ec170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:25.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.248+0000 7f264fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559885a5dcf0 0x5598859ec170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54368/0 (socket says 172.21.15.99:54368) 2024-02-21T23:04:25.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.248+0000 7f264fe00640 1 -- 172.21.15.99:0/3555222598 learned_addr learned my addr 172.21.15.99:0/3555222598 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:04:25.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.248+0000 7f2656a00640 1 --2- 172.21.15.99:0/3555222598 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559885a5d330 0x559885aafe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:25.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.249+0000 7f2657400640 1 --2- 172.21.15.99:0/3555222598 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559885a6a7a0 0x559885a17c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:25.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.249+0000 7f264fe00640 1 -- 172.21.15.99:0/3555222598 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559885a6a7a0 msgr2=0x559885a17c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:04:25.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.249+0000 7f264fe00640 1 --2- 172.21.15.99:0/3555222598 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559885a6a7a0 0x559885a17c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:25.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.249+0000 7f264fe00640 1 -- 172.21.15.99:0/3555222598 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559885a5d330 msgr2=0x559885aafe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:04:25.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.249+0000 7f264fe00640 1 --2- 172.21.15.99:0/3555222598 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559885a5d330 0x559885aafe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:25.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.249+0000 7f264fe00640 1 -- 172.21.15.99:0/3555222598 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559885a5a990 con 0x559885a5dcf0 2024-02-21T23:04:25.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.249+0000 7f264fe00640 1 --2- 172.21.15.99:0/3555222598 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559885a5dcf0 0x5598859ec170 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f26400967a0 tx=0x7f2640000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9f23aa15408b52c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:04:25.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.249+0000 7f263b400640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:04:25.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.249+0000 7f263b400640 1 -- 172.21.15.99:0/3555222598 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2640094be0 con 0x559885a5dcf0 2024-02-21T23:04:25.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.249+0000 7f263b400640 1 -- 172.21.15.99:0/3555222598 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f2640095960 con 0x559885a5dcf0 2024-02-21T23:04:25.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.249+0000 7f2660602740 1 -- 172.21.15.99:0/3555222598 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2648030020 con 0x559885a5dcf0 2024-02-21T23:04:25.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.250+0000 7f263b400640 1 -- 172.21.15.99:0/3555222598 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f26400ba050 con 0x559885a5dcf0 2024-02-21T23:04:25.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.250+0000 7f2660602740 10 client.5559 fetch_fsmap learned FSMap version 16 2024-02-21T23:04:25.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.250+0000 7f2660602740 1 -- 172.21.15.99:0/3555222598 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x559885a59730 con 0x559885a5dcf0 2024-02-21T23:04:25.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.250+0000 7f263b400640 1 -- 172.21.15.99:0/3555222598 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2648030020 con 0x559885a5dcf0 2024-02-21T23:04:25.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.250+0000 7f263b400640 1 -- 172.21.15.99:0/3555222598 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f2640095b60 con 0x559885a5dcf0 2024-02-21T23:04:25.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.250+0000 7f2660602740 10 client.5559 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T23:04:25.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.250+0000 7f2660602740 10 client.5559 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.d 2024-02-21T23:04:25.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.250+0000 7f2660602740 20 client.5559 populate_metadata read hostname 'smithi099' 2024-02-21T23:04:25.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.250+0000 7f2660602740 1 --2- 172.21.15.99:0/3555222598 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x559885a66fe0 0x5598859eb030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:25.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.250+0000 7f2660602740 4 client.5559 mds_command: new command op to 4348 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T23:04:25.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.250+0000 7f2660602740 1 -- 172.21.15.99:0/3555222598 --> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5598859523e0 con 0x559885a66fe0 2024-02-21T23:04:25.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.250+0000 7f2656a00640 1 --2- 172.21.15.99:0/3555222598 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x559885a66fe0 0x5598859eb030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:25.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.251+0000 7f2656a00640 1 --2- 172.21.15.99:0/3555222598 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x559885a66fe0 0x5598859eb030 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b2629026804422cc server_cookie=38dbfe7a82d0fc88 in_seq=0 out_seq=0 2024-02-21T23:04:25.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.251+0000 7f263b400640 10 client.5559 ms_handle_connect on v2:172.21.15.99:6834/2243461688 2024-02-21T23:04:25.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.251+0000 7f263b400640 1 -- 172.21.15.99:0/3555222598 <== mds.2 v2:172.21.15.99:6834/2243461688 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5598859523e0 con 0x559885a66fe0 2024-02-21T23:04:25.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.251+0000 7f263b400640 10 client.5559 handle_command_reply: tid=0 2024-02-21T23:04:25.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.251+0000 7f2660602740 1 client.5559 shutdown 2024-02-21T23:04:25.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.251+0000 7f2660602740 1 -- 172.21.15.99:0/3555222598 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559885a5dcf0 msgr2=0x5598859ec170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:25.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.251+0000 7f2660602740 1 --2- 172.21.15.99:0/3555222598 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559885a5dcf0 0x5598859ec170 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f26400967a0 tx=0x7f2640000ed0 comp rx=0 tx=0).stop 2024-02-21T23:04:25.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.251+0000 7f2660602740 1 -- 172.21.15.99:0/3555222598 shutdown_connections 2024-02-21T23:04:25.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.251+0000 7f2660602740 1 --2- 172.21.15.99:0/3555222598 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x559885a66fe0 0x5598859eb030 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:25.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.251+0000 7f2660602740 1 --2- 172.21.15.99:0/3555222598 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559885a6a7a0 0x559885a17c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:25.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.251+0000 7f2660602740 1 --2- 172.21.15.99:0/3555222598 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559885a5dcf0 0x5598859ec170 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:25.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.251+0000 7f2660602740 1 --2- 172.21.15.99:0/3555222598 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559885a5d330 0x559885aafe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:25.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.251+0000 7f263b400640 0 client.5559 ms_handle_reset on v2:172.21.15.99:6834/2243461688 2024-02-21T23:04:25.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.251+0000 7f2660602740 1 -- 172.21.15.99:0/3555222598 >> 172.21.15.99:0/3555222598 conn(0x559885a22660 msgr2=0x5598859e5930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:04:25.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.252+0000 7f2660602740 1 -- 172.21.15.99:0/3555222598 shutdown_connections 2024-02-21T23:04:25.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.252+0000 7f2660602740 1 -- 172.21.15.99:0/3555222598 wait complete. 2024-02-21T23:04:25.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.252+0000 7f2660602740 20 client.5559 trim_cache size 0 max 16384 2024-02-21T23:04:25.244 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-02-21T23:04:25.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.252+0000 7f2657e00640 1 -- 172.21.15.99:0/3463441928 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f263409ef00 msgr2=0x7f26340a13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:25.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.252+0000 7f2657e00640 1 --2- 172.21.15.99:0/3463441928 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f263409ef00 0x7f26340a13c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2648000f60 tx=0x7f2648009040 comp rx=0 tx=0).stop 2024-02-21T23:04:25.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.252+0000 7f2657e00640 1 -- 172.21.15.99:0/3463441928 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f265817f490 msgr2=0x7f265817b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:25.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.252+0000 7f2657e00640 1 --2- 172.21.15.99:0/3463441928 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f265817f490 0x7f265817b230 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f264000c3c0 tx=0x7f2640001e70 comp rx=0 tx=0).stop 2024-02-21T23:04:25.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.253+0000 7f2657e00640 1 -- 172.21.15.99:0/3463441928 shutdown_connections 2024-02-21T23:04:25.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.253+0000 7f2657e00640 1 --2- 172.21.15.99:0/3463441928 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f263409ef00 0x7f26340a13c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:25.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.253+0000 7f2657e00640 1 --2- 172.21.15.99:0/3463441928 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f265818b230 0x7f265817b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:25.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.253+0000 7f2657e00640 1 --2- 172.21.15.99:0/3463441928 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f265817f490 0x7f265817b230 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:25.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.253+0000 7f2657e00640 1 --2- 172.21.15.99:0/3463441928 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f26580d60b0 0x7f265815bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:25.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.253+0000 7f2657e00640 1 -- 172.21.15.99:0/3463441928 >> 172.21.15.99:0/3463441928 conn(0x7f26580d29b0 msgr2=0x7f2658068e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:04:25.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.253+0000 7f2657e00640 1 -- 172.21.15.99:0/3463441928 shutdown_connections 2024-02-21T23:04:25.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.253+0000 7f2657e00640 1 -- 172.21.15.99:0/3463441928 wait complete. 2024-02-21T23:04:25.257 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T23:04:25.257 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-02-21T23:04:25.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.475+0000 7f915d400640 1 Processor -- start 2024-02-21T23:04:25.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.475+0000 7f915d400640 1 -- start start 2024-02-21T23:04:25.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.478+0000 7f915d400640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f915817d1b0 0x7f915806fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:25.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.478+0000 7f915d400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f9158071f00 0x7f915818a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:25.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.478+0000 7f915d400640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91580700a0 con 0x7f915817d590 2024-02-21T23:04:25.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.478+0000 7f915d400640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9158070380 con 0x7f9158071f00 2024-02-21T23:04:25.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.478+0000 7f915d400640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9158070660 con 0x7f915817d1b0 2024-02-21T23:04:25.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.479+0000 7f9157400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f915817d590 0x7f91580717f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:54846/0 (socket says 172.21.15.99:54846) 2024-02-21T23:04:25.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.479+0000 7f9157400640 1 -- 172.21.15.99:0/2909748937 learned_addr learned my addr 172.21.15.99:0/2909748937 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:04:25.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.479+0000 7f915ca00640 1 --2- 172.21.15.99:0/2909748937 >> v2:172.21.15.162:3300/0 conn(0x7f9158071f00 0x7f915818a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:25.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.479+0000 7f9157e00640 1 --2- 172.21.15.99:0/2909748937 >> v2:172.21.15.181:3300/0 conn(0x7f915817d1b0 0x7f915806fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:25.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.479+0000 7f9156a00640 1 -- 172.21.15.99:0/2909748937 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2669215375 0 0) 0x7f91580700a0 con 0x7f915817d590 2024-02-21T23:04:25.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.479+0000 7f9156a00640 1 -- 172.21.15.99:0/2909748937 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f913c003520 con 0x7f915817d590 2024-02-21T23:04:25.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.479+0000 7f9157e00640 1 -- 172.21.15.99:0/2909748937 >> v2:172.21.15.162:3300/0 conn(0x7f9158071f00 msgr2=0x7f915818a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:04:25.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.479+0000 7f9157e00640 1 --2- 172.21.15.99:0/2909748937 >> v2:172.21.15.162:3300/0 conn(0x7f9158071f00 0x7f915818a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:25.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.479+0000 7f9157e00640 1 -- 172.21.15.99:0/2909748937 >> v1:172.21.15.99:6789/0 conn(0x7f915817d590 legacy=0x7f91580717f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:25.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.479+0000 7f9157e00640 1 -- 172.21.15.99:0/2909748937 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9158070940 con 0x7f915817d1b0 2024-02-21T23:04:25.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.479+0000 7f915ca00640 1 --2- 172.21.15.99:0/2909748937 >> v2:172.21.15.162:3300/0 conn(0x7f9158071f00 0x7f915818a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:04:25.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.481+0000 7f9157e00640 1 --2- 172.21.15.99:0/2909748937 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f915817d1b0 0x7f915806fa40 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f91480097a0 tx=0x7f914802b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d91e04751f01d36 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:04:25.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.481+0000 7f9156a00640 1 -- 172.21.15.99:0/2909748937 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91480315a0 con 0x7f915817d1b0 2024-02-21T23:04:25.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.481+0000 7f9156a00640 1 -- 172.21.15.99:0/2909748937 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9148037070 con 0x7f915817d1b0 2024-02-21T23:04:25.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.481+0000 7f9156a00640 1 -- 172.21.15.99:0/2909748937 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9148031960 con 0x7f915817d1b0 2024-02-21T23:04:25.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.482+0000 7f915d400640 1 -- 172.21.15.99:0/2909748937 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f915817d1b0 msgr2=0x7f915806fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:25.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.482+0000 7f915d400640 1 --2- 172.21.15.99:0/2909748937 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f915817d1b0 0x7f915806fa40 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f91480097a0 tx=0x7f914802b840 comp rx=0 tx=0).stop 2024-02-21T23:04:25.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.482+0000 7f915d400640 1 -- 172.21.15.99:0/2909748937 shutdown_connections 2024-02-21T23:04:25.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.482+0000 7f915d400640 1 --2- 172.21.15.99:0/2909748937 >> v2:172.21.15.162:3300/0 conn(0x7f9158071f00 0x7f915818a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:25.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.482+0000 7f915d400640 1 --2- 172.21.15.99:0/2909748937 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f915817d1b0 0x7f915806fa40 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:25.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.482+0000 7f915d400640 1 -- 172.21.15.99:0/2909748937 >> 172.21.15.99:0/2909748937 conn(0x7f915806e210 msgr2=0x7f915806e620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:04:25.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.482+0000 7f915d400640 1 -- 172.21.15.99:0/2909748937 shutdown_connections 2024-02-21T23:04:25.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.482+0000 7f915d400640 1 -- 172.21.15.99:0/2909748937 wait complete. 2024-02-21T23:04:25.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.484+0000 7f915d400640 1 Processor -- start 2024-02-21T23:04:25.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.484+0000 7f915d400640 1 -- start start 2024-02-21T23:04:25.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.486+0000 7f915d400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9158071f00 0x7f9158166640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:25.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.486+0000 7f915d400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f915817d1b0 0x7f91580cd1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:25.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.486+0000 7f915d400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f915817d590 0x7f9158172460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:25.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.486+0000 7f915d400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9158071420 con 0x7f9158071f00 2024-02-21T23:04:25.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.486+0000 7f915d400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9158070f00 con 0x7f915817d590 2024-02-21T23:04:25.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.486+0000 7f915d400640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91580715a0 con 0x7f915817d1b0 2024-02-21T23:04:25.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.486+0000 7f9157400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f915817d1b0 0x7f91580cd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:25.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.486+0000 7f9157e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9158071f00 0x7f9158166640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:25.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.486+0000 7f9157400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f915817d1b0 0x7f91580cd1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:48882/0 (socket says 172.21.15.99:48882) 2024-02-21T23:04:25.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.486+0000 7f9157400640 1 -- 172.21.15.99:0/1678740536 learned_addr learned my addr 172.21.15.99:0/1678740536 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:04:25.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.486+0000 7f915ca00640 1 --2- 172.21.15.99:0/1678740536 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f915817d590 0x7f9158172460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:25.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.487+0000 7f915ca00640 1 -- 172.21.15.99:0/1678740536 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f915817d1b0 msgr2=0x7f91580cd1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:25.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.487+0000 7f915ca00640 1 --2- 172.21.15.99:0/1678740536 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f915817d1b0 0x7f91580cd1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:25.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.487+0000 7f915ca00640 1 -- 172.21.15.99:0/1678740536 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9158071f00 msgr2=0x7f9158166640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:25.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.487+0000 7f915ca00640 1 --2- 172.21.15.99:0/1678740536 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9158071f00 0x7f9158166640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:25.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.487+0000 7f915ca00640 1 -- 172.21.15.99:0/1678740536 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91580cef20 con 0x7f915817d590 2024-02-21T23:04:25.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.487+0000 7f9157400640 1 --2- 172.21.15.99:0/1678740536 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f915817d1b0 0x7f91580cd1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:04:25.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.487+0000 7f9157e00640 1 --2- 172.21.15.99:0/1678740536 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9158071f00 0x7f9158166640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:04:25.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.487+0000 7f915ca00640 1 --2- 172.21.15.99:0/1678740536 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f915817d590 0x7f9158172460 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9150009db0 tx=0x7f915000c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:04:25.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.487+0000 7f914fe00640 1 -- 172.21.15.99:0/1678740536 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9150018030 con 0x7f915817d590 2024-02-21T23:04:25.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.487+0000 7f914fe00640 1 -- 172.21.15.99:0/1678740536 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f915000cd30 con 0x7f915817d590 2024-02-21T23:04:25.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.487+0000 7f915d400640 1 -- 172.21.15.99:0/1678740536 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91580cdba0 con 0x7f915817d590 2024-02-21T23:04:25.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.487+0000 7f914fe00640 1 -- 172.21.15.99:0/1678740536 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9150003bb0 con 0x7f915817d590 2024-02-21T23:04:25.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.488+0000 7f915d400640 1 -- 172.21.15.99:0/1678740536 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91580ce160 con 0x7f915817d590 2024-02-21T23:04:25.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.492+0000 7f914fe00640 1 -- 172.21.15.99:0/1678740536 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f9150005d10 con 0x7f915817d590 2024-02-21T23:04:25.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.493+0000 7f91617eb740 1 Processor -- start 2024-02-21T23:04:25.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.493+0000 7f91617eb740 1 -- start start 2024-02-21T23:04:25.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.493+0000 7f914fe00640 1 --2- 172.21.15.99:0/1678740536 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f913809eed0 0x7f91380a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:25.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.493+0000 7f914fe00640 1 -- 172.21.15.99:0/1678740536 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f91500ca750 con 0x7f915817d590 2024-02-21T23:04:25.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.494+0000 7f9157400640 1 --2- 172.21.15.99:0/1678740536 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f913809eed0 0x7f91380a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:25.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.494+0000 7f9157400640 1 --2- 172.21.15.99:0/1678740536 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f913809eed0 0x7f91380a1390 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9158184d50 tx=0x7f9144009040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:04:25.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.495+0000 7f91617eb740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55efdffd5660 0x55efdffd5a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:25.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.495+0000 7f91617eb740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55efe0010330 0x55efe00107b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:25.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.495+0000 7f91617eb740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55efe0010cf0 0x55efe0011560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:25.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.495+0000 7f91617eb740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efdfefdb50 con 0x55efdffd5660 2024-02-21T23:04:25.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.495+0000 7f91617eb740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efdfea6da0 con 0x55efe0010330 2024-02-21T23:04:25.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.495+0000 7f91617eb740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efdfef9bf0 con 0x55efe0010cf0 2024-02-21T23:04:25.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.495+0000 7f9157e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55efdffd5660 0x55efdffd5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:25.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.495+0000 7f9157400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55efe0010330 0x55efe00107b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:25.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.495+0000 7f9157e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55efdffd5660 0x55efdffd5a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54374/0 (socket says 172.21.15.99:54374) 2024-02-21T23:04:25.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.495+0000 7f9157e00640 1 -- 172.21.15.99:0/3342291138 learned_addr learned my addr 172.21.15.99:0/3342291138 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:04:25.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.495+0000 7f915ca00640 1 --2- 172.21.15.99:0/3342291138 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55efe0010cf0 0x55efe0011560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:25.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.495+0000 7f9157400640 1 -- 172.21.15.99:0/3342291138 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55efe0010cf0 msgr2=0x55efe0011560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:04:25.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.495+0000 7f9157400640 1 --2- 172.21.15.99:0/3342291138 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55efe0010cf0 0x55efe0011560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:25.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.496+0000 7f9157400640 1 -- 172.21.15.99:0/3342291138 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55efdffd5660 msgr2=0x55efdffd5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:04:25.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.496+0000 7f9157400640 1 --2- 172.21.15.99:0/3342291138 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55efdffd5660 0x55efdffd5a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:25.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.496+0000 7f9157400640 1 -- 172.21.15.99:0/3342291138 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55efdfec9f80 con 0x55efe0010330 2024-02-21T23:04:25.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.496+0000 7f9157e00640 1 --2- 172.21.15.99:0/3342291138 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55efdffd5660 0x55efdffd5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:04:25.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.496+0000 7f9157400640 1 --2- 172.21.15.99:0/3342291138 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55efe0010330 0x55efe00107b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f914400fd60 tx=0x7f9144012000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a7f249538791a619 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:04:25.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.496+0000 7f9143e00640 1 -- 172.21.15.99:0/3342291138 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9144025070 con 0x55efe0010330 2024-02-21T23:04:25.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.496+0000 7f9143e00640 1 -- 172.21.15.99:0/3342291138 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f914401b050 con 0x55efe0010330 2024-02-21T23:04:25.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.496+0000 7f9143e00640 1 -- 172.21.15.99:0/3342291138 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9144020610 con 0x55efe0010330 2024-02-21T23:04:25.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.497+0000 7f91617eb740 1 -- 172.21.15.99:0/3342291138 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55efe0010330 msgr2=0x55efe00107b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:25.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.497+0000 7f91617eb740 1 --2- 172.21.15.99:0/3342291138 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55efe0010330 0x55efe00107b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f914400fd60 tx=0x7f9144012000 comp rx=0 tx=0).stop 2024-02-21T23:04:25.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.497+0000 7f91617eb740 1 -- 172.21.15.99:0/3342291138 shutdown_connections 2024-02-21T23:04:25.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.497+0000 7f91617eb740 1 --2- 172.21.15.99:0/3342291138 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55efe0010cf0 0x55efe0011560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:25.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.497+0000 7f91617eb740 1 --2- 172.21.15.99:0/3342291138 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55efe0010330 0x55efe00107b0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:25.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.497+0000 7f91617eb740 1 --2- 172.21.15.99:0/3342291138 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55efdffd5660 0x55efdffd5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:25.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.497+0000 7f91617eb740 1 -- 172.21.15.99:0/3342291138 >> 172.21.15.99:0/3342291138 conn(0x55efdff976d0 msgr2=0x55efdff98750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:04:25.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.497+0000 7f91617eb740 1 -- 172.21.15.99:0/3342291138 shutdown_connections 2024-02-21T23:04:25.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.497+0000 7f91617eb740 1 -- 172.21.15.99:0/3342291138 wait complete. 2024-02-21T23:04:25.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.498+0000 7f91617eb740 1 -- start start 2024-02-21T23:04:25.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.498+0000 7f91617eb740 1 Processor -- start 2024-02-21T23:04:25.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.499+0000 7f91617eb740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55efe0010330 0x55efe0017ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:25.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.499+0000 7f91617eb740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55efe0010cf0 0x55efe0002640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:25.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.499+0000 7f91617eb740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55efdffdf5d0 0x55efe001cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:25.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.499+0000 7f91617eb740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efe000f0a0 con 0x55efdffdf5d0 2024-02-21T23:04:25.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.499+0000 7f91617eb740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efdfe9c380 con 0x55efe0010cf0 2024-02-21T23:04:25.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.499+0000 7f91617eb740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efe000edc0 con 0x55efe0010330 2024-02-21T23:04:25.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.499+0000 7f91617eb740 10 client.0 _ll_register_callbacks cb 0x55efdfef5280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:04:25.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.500+0000 7f915ca00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55efdffdf5d0 0x55efe001cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:25.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.500+0000 7f915ca00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55efdffdf5d0 0x55efe001cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54378/0 (socket says 172.21.15.99:54378) 2024-02-21T23:04:25.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.500+0000 7f915ca00640 1 -- 172.21.15.99:0/2380290436 learned_addr learned my addr 172.21.15.99:0/2380290436 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:04:25.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.500+0000 7f9157400640 1 --2- 172.21.15.99:0/2380290436 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55efe0010cf0 0x55efe0002640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:25.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.500+0000 7f9157e00640 1 --2- 172.21.15.99:0/2380290436 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55efe0010330 0x55efe0017ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:25.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.500+0000 7f9157400640 1 -- 172.21.15.99:0/2380290436 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55efe0010330 msgr2=0x55efe0017ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:04:25.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.500+0000 7f9157400640 1 --2- 172.21.15.99:0/2380290436 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55efe0010330 0x55efe0017ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:25.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.500+0000 7f9157400640 1 -- 172.21.15.99:0/2380290436 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55efdffdf5d0 msgr2=0x55efe001cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:04:25.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.500+0000 7f9157400640 1 --2- 172.21.15.99:0/2380290436 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55efdffdf5d0 0x55efe001cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:25.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.500+0000 7f9157400640 1 -- 172.21.15.99:0/2380290436 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55efdfec4c20 con 0x55efe0010cf0 2024-02-21T23:04:25.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.500+0000 7f9157400640 1 --2- 172.21.15.99:0/2380290436 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55efe0010cf0 0x55efe0002640 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x55efdffd9840 tx=0x7f9144000ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b690cdcc5f2deb12 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:04:25.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.501+0000 7f9140c00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-02-21T23:04:25.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.501+0000 7f9140c00640 1 -- 172.21.15.99:0/2380290436 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9144025050 con 0x55efe0010cf0 2024-02-21T23:04:25.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.501+0000 7f91617eb740 1 -- 172.21.15.99:0/2380290436 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f914401b050 con 0x55efe0010cf0 2024-02-21T23:04:25.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.501+0000 7f9140c00640 1 -- 172.21.15.99:0/2380290436 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f914402c450 con 0x55efe0010cf0 2024-02-21T23:04:25.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.501+0000 7f9140c00640 1 -- 172.21.15.99:0/2380290436 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f914403a050 con 0x55efe0010cf0 2024-02-21T23:04:25.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.501+0000 7f91617eb740 10 client.5683 fetch_fsmap learned FSMap version 16 2024-02-21T23:04:25.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.501+0000 7f91617eb740 1 -- 172.21.15.99:0/2380290436 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55efdfc123f0 con 0x55efe0010cf0 2024-02-21T23:04:25.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.501+0000 7f9140c00640 1 -- 172.21.15.99:0/2380290436 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f914401b050 con 0x55efe0010cf0 2024-02-21T23:04:25.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.501+0000 7f9140c00640 1 -- 172.21.15.99:0/2380290436 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f914402c650 con 0x55efe0010cf0 2024-02-21T23:04:25.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.502+0000 7f91617eb740 10 client.5683 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T23:04:25.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.502+0000 7f91617eb740 10 client.5683 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2024-02-21T23:04:25.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.502+0000 7f91617eb740 20 client.5683 populate_metadata read hostname 'smithi099' 2024-02-21T23:04:25.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.502+0000 7f91617eb740 1 --2- 172.21.15.99:0/2380290436 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x55efe001d510 0x55efe001d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:25.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.502+0000 7f91617eb740 4 client.5683 mds_command: new command op to 4352 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:04:25.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.502+0000 7f91617eb740 1 -- 172.21.15.99:0/2380290436 --> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55efdff0b090 con 0x55efe001d510 2024-02-21T23:04:25.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.502+0000 7f9157e00640 1 --2- 172.21.15.99:0/2380290436 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x55efe001d510 0x55efe001d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:25.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.502+0000 7f9157e00640 1 --2- 172.21.15.99:0/2380290436 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x55efe001d510 0x55efe001d8f0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=185a1bab26351cb5 server_cookie=f84c4a1d4ffe55db in_seq=0 out_seq=0 2024-02-21T23:04:25.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.503+0000 7f9140c00640 10 client.5683 ms_handle_connect on v2:172.21.15.99:6836/1676159950 2024-02-21T23:04:25.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.503+0000 7f9140c00640 1 -- 172.21.15.99:0/2380290436 <== mds.1 v2:172.21.15.99:6836/1676159950 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55efdff0b090 con 0x55efe001d510 2024-02-21T23:04:25.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.503+0000 7f9140c00640 10 client.5683 handle_command_reply: tid=0 2024-02-21T23:04:25.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.503+0000 7f91617eb740 1 client.5683 shutdown 2024-02-21T23:04:25.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.503+0000 7f91617eb740 1 -- 172.21.15.99:0/2380290436 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55efe0010cf0 msgr2=0x55efe0002640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:25.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.503+0000 7f91617eb740 1 --2- 172.21.15.99:0/2380290436 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55efe0010cf0 0x55efe0002640 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x55efdffd9840 tx=0x7f9144000ed0 comp rx=0 tx=0).stop 2024-02-21T23:04:25.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.503+0000 7f91617eb740 1 -- 172.21.15.99:0/2380290436 shutdown_connections 2024-02-21T23:04:25.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.504+0000 7f91617eb740 1 --2- 172.21.15.99:0/2380290436 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x55efe001d510 0x55efe001d8f0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:25.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.504+0000 7f91617eb740 1 --2- 172.21.15.99:0/2380290436 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55efdffdf5d0 0x55efe001cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:25.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.504+0000 7f91617eb740 1 --2- 172.21.15.99:0/2380290436 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55efe0010cf0 0x55efe0002640 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:25.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.504+0000 7f91617eb740 1 --2- 172.21.15.99:0/2380290436 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55efe0010330 0x55efe0017ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:25.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.504+0000 7f91617eb740 1 -- 172.21.15.99:0/2380290436 >> 172.21.15.99:0/2380290436 conn(0x55efdffd5660 msgr2=0x55efe000e5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:04:25.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.504+0000 7f9140c00640 0 client.5683 ms_handle_reset on v2:172.21.15.99:6836/1676159950 2024-02-21T23:04:25.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.504+0000 7f91617eb740 1 -- 172.21.15.99:0/2380290436 shutdown_connections 2024-02-21T23:04:25.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.504+0000 7f91617eb740 1 -- 172.21.15.99:0/2380290436 wait complete. 2024-02-21T23:04:25.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.504+0000 7f91617eb740 20 client.5683 trim_cache size 0 max 16384 2024-02-21T23:04:25.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.529+0000 7f91617eb740 1 Processor -- start 2024-02-21T23:04:25.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.529+0000 7f91617eb740 1 -- start start 2024-02-21T23:04:25.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.531+0000 7f91617eb740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55efdffdf5d0 0x55efdff95290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:25.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.531+0000 7f91617eb740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55efe0010330 0x55efe000c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:25.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.531+0000 7f91617eb740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55efe0010cf0 0x55efe00733a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:25.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.531+0000 7f91617eb740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f915822c780 con 0x55efe0010cf0 2024-02-21T23:04:25.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.531+0000 7f91617eb740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f915822a320 con 0x55efe0010330 2024-02-21T23:04:25.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.531+0000 7f91617eb740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9158228480 con 0x55efdffdf5d0 2024-02-21T23:04:25.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.531+0000 7f915ca00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55efe0010cf0 0x55efe00733a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:25.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.531+0000 7f915ca00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55efe0010cf0 0x55efe00733a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54382/0 (socket says 172.21.15.99:54382) 2024-02-21T23:04:25.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.531+0000 7f915ca00640 1 -- 172.21.15.99:0/1169777629 learned_addr learned my addr 172.21.15.99:0/1169777629 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:04:25.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.531+0000 7f9157e00640 1 --2- 172.21.15.99:0/1169777629 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55efdffdf5d0 0x55efdff95290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:25.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.531+0000 7f9157400640 1 --2- 172.21.15.99:0/1169777629 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55efe0010330 0x55efe000c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:25.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.531+0000 7f915ca00640 1 -- 172.21.15.99:0/1169777629 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55efdffdf5d0 msgr2=0x55efdff95290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:04:25.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.531+0000 7f915ca00640 1 --2- 172.21.15.99:0/1169777629 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55efdffdf5d0 0x55efdff95290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:25.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.531+0000 7f915ca00640 1 -- 172.21.15.99:0/1169777629 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55efe0010330 msgr2=0x55efe000c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:04:25.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.531+0000 7f915ca00640 1 --2- 172.21.15.99:0/1169777629 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55efe0010330 0x55efe000c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:25.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.531+0000 7f915ca00640 1 -- 172.21.15.99:0/1169777629 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55efdfcdc7d0 con 0x55efe0010cf0 2024-02-21T23:04:25.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.531+0000 7f9157e00640 1 --2- 172.21.15.99:0/1169777629 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55efdffdf5d0 0x55efdff95290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:04:25.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.532+0000 7f915ca00640 1 --2- 172.21.15.99:0/1169777629 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55efe0010cf0 0x55efe00733a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f915000c990 tx=0x7f9150094260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40680c265c4c3da5 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:04:25.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.532+0000 7f9143400640 1 -- 172.21.15.99:0/1169777629 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91500a06e0 con 0x55efe0010cf0 2024-02-21T23:04:25.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.532+0000 7f9143400640 1 -- 172.21.15.99:0/1169777629 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91500c8010 con 0x55efe0010cf0 2024-02-21T23:04:25.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.532+0000 7f9143400640 1 -- 172.21.15.99:0/1169777629 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91500b5300 con 0x55efe0010cf0 2024-02-21T23:04:25.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.532+0000 7f91617eb740 1 -- 172.21.15.99:0/1169777629 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55efe0010cf0 msgr2=0x55efe00733a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:25.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.532+0000 7f91617eb740 1 --2- 172.21.15.99:0/1169777629 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55efe0010cf0 0x55efe00733a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f915000c990 tx=0x7f9150094260 comp rx=0 tx=0).stop 2024-02-21T23:04:25.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.533+0000 7f91617eb740 1 -- 172.21.15.99:0/1169777629 shutdown_connections 2024-02-21T23:04:25.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.533+0000 7f91617eb740 1 --2- 172.21.15.99:0/1169777629 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55efe0010cf0 0x55efe00733a0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:25.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.533+0000 7f91617eb740 1 --2- 172.21.15.99:0/1169777629 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55efe0010330 0x55efe000c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:25.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.533+0000 7f91617eb740 1 --2- 172.21.15.99:0/1169777629 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55efdffdf5d0 0x55efdff95290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:25.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.533+0000 7f91617eb740 1 -- 172.21.15.99:0/1169777629 >> 172.21.15.99:0/1169777629 conn(0x55efdffd5660 msgr2=0x55efdffdd9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:04:25.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.533+0000 7f91617eb740 1 -- 172.21.15.99:0/1169777629 shutdown_connections 2024-02-21T23:04:25.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.533+0000 7f91617eb740 1 -- 172.21.15.99:0/1169777629 wait complete. 2024-02-21T23:04:25.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.533+0000 7f91617eb740 1 -- start start 2024-02-21T23:04:25.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.534+0000 7f91617eb740 1 Processor -- start 2024-02-21T23:04:25.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.535+0000 7f91617eb740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55efdffdf5d0 0x55efe0017940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:25.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.535+0000 7f91617eb740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55efe0010330 0x55efe000cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:25.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.535+0000 7f91617eb740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55efe0010cf0 0x55efe0004460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:25.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.535+0000 7f91617eb740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9158228a80 con 0x55efe0010cf0 2024-02-21T23:04:25.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.535+0000 7f91617eb740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9158229cc0 con 0x55efe0010330 2024-02-21T23:04:25.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.535+0000 7f91617eb740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9158229080 con 0x55efdffdf5d0 2024-02-21T23:04:25.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.535+0000 7f91617eb740 10 client.0 _ll_register_callbacks cb 0x7f9144023070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:04:25.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.535+0000 7f915ca00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55efe0010cf0 0x55efe0004460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:25.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.535+0000 7f9157e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55efdffdf5d0 0x55efe0017940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:25.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.535+0000 7f9157e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55efdffdf5d0 0x55efe0017940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:48916/0 (socket says 172.21.15.99:48916) 2024-02-21T23:04:25.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.535+0000 7f9157e00640 1 -- 172.21.15.99:0/4000575906 learned_addr learned my addr 172.21.15.99:0/4000575906 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:04:25.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.535+0000 7f9157400640 1 --2- 172.21.15.99:0/4000575906 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55efe0010330 0x55efe000cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:25.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.536+0000 7f915ca00640 1 -- 172.21.15.99:0/4000575906 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55efdffdf5d0 msgr2=0x55efe0017940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:04:25.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.536+0000 7f915ca00640 1 --2- 172.21.15.99:0/4000575906 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55efdffdf5d0 0x55efe0017940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:25.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.536+0000 7f915ca00640 1 -- 172.21.15.99:0/4000575906 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55efe0010330 msgr2=0x55efe000cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:04:25.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.536+0000 7f915ca00640 1 --2- 172.21.15.99:0/4000575906 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55efe0010330 0x55efe000cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:25.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.536+0000 7f915ca00640 1 -- 172.21.15.99:0/4000575906 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55efe0004a80 con 0x55efe0010cf0 2024-02-21T23:04:25.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.536+0000 7f9157400640 1 --2- 172.21.15.99:0/4000575906 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55efe0010330 0x55efe000cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:04:25.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.536+0000 7f915ca00640 1 --2- 172.21.15.99:0/4000575906 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55efe0010cf0 0x55efe0004460 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f91500943a0 tx=0x7f9150004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2adc4d871f92916 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:04:25.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.536+0000 7f9140c00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:04:25.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.536+0000 7f9140c00640 1 -- 172.21.15.99:0/4000575906 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91500b5500 con 0x55efe0010cf0 2024-02-21T23:04:25.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.536+0000 7f9140c00640 1 -- 172.21.15.99:0/4000575906 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f91500a0250 con 0x55efe0010cf0 2024-02-21T23:04:25.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.536+0000 7f91617eb740 1 -- 172.21.15.99:0/4000575906 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f91500c8010 con 0x55efe0010cf0 2024-02-21T23:04:25.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.537+0000 7f9140c00640 1 -- 172.21.15.99:0/4000575906 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f91500a06e0 con 0x55efe0010cf0 2024-02-21T23:04:25.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.537+0000 7f91617eb740 10 client.5577 fetch_fsmap learned FSMap version 16 2024-02-21T23:04:25.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.537+0000 7f91617eb740 1 -- 172.21.15.99:0/4000575906 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55efdfffafb0 con 0x55efe0010cf0 2024-02-21T23:04:25.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.537+0000 7f9140c00640 1 -- 172.21.15.99:0/4000575906 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91500c8010 con 0x55efe0010cf0 2024-02-21T23:04:25.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.537+0000 7f9140c00640 1 -- 172.21.15.99:0/4000575906 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f9150097390 con 0x55efe0010cf0 2024-02-21T23:04:25.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.537+0000 7f91617eb740 10 client.5577 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T23:04:25.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.537+0000 7f91617eb740 10 client.5577 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2024-02-21T23:04:25.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.537+0000 7f91617eb740 20 client.5577 populate_metadata read hostname 'smithi099' 2024-02-21T23:04:25.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.537+0000 7f91617eb740 1 --2- 172.21.15.99:0/4000575906 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x55efdffe01a0 0x55efdfff53b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:25.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.537+0000 7f91617eb740 4 client.5577 mds_command: new command op to 4352 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T23:04:25.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.537+0000 7f91617eb740 1 -- 172.21.15.99:0/4000575906 --> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55efdff97e30 con 0x55efdffe01a0 2024-02-21T23:04:25.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.537+0000 7f9157e00640 1 --2- 172.21.15.99:0/4000575906 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x55efdffe01a0 0x55efdfff53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:25.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.538+0000 7f9157e00640 1 --2- 172.21.15.99:0/4000575906 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x55efdffe01a0 0x55efdfff53b0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c0d593bd085cd5c server_cookie=551cdfa160c9a716 in_seq=0 out_seq=0 2024-02-21T23:04:25.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.538+0000 7f9140c00640 10 client.5577 ms_handle_connect on v2:172.21.15.99:6836/1676159950 2024-02-21T23:04:25.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.538+0000 7f9140c00640 1 -- 172.21.15.99:0/4000575906 <== mds.1 v2:172.21.15.99:6836/1676159950 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55efdff97e30 con 0x55efdffe01a0 2024-02-21T23:04:25.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.538+0000 7f9140c00640 10 client.5577 handle_command_reply: tid=0 2024-02-21T23:04:25.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.538+0000 7f91617eb740 1 client.5577 shutdown 2024-02-21T23:04:25.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.538+0000 7f91617eb740 1 -- 172.21.15.99:0/4000575906 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55efe0010cf0 msgr2=0x55efe0004460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:25.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.538+0000 7f91617eb740 1 --2- 172.21.15.99:0/4000575906 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55efe0010cf0 0x55efe0004460 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f91500943a0 tx=0x7f9150004a40 comp rx=0 tx=0).stop 2024-02-21T23:04:25.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.538+0000 7f91617eb740 1 -- 172.21.15.99:0/4000575906 shutdown_connections 2024-02-21T23:04:25.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.538+0000 7f91617eb740 1 --2- 172.21.15.99:0/4000575906 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x55efdffe01a0 0x55efdfff53b0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:25.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.538+0000 7f91617eb740 1 --2- 172.21.15.99:0/4000575906 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55efe0010cf0 0x55efe0004460 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:25.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.538+0000 7f91617eb740 1 --2- 172.21.15.99:0/4000575906 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55efe0010330 0x55efe000cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:25.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.538+0000 7f91617eb740 1 --2- 172.21.15.99:0/4000575906 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55efdffdf5d0 0x55efe0017940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:25.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.538+0000 7f9140c00640 0 client.5577 ms_handle_reset on v2:172.21.15.99:6836/1676159950 2024-02-21T23:04:25.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.538+0000 7f91617eb740 1 -- 172.21.15.99:0/4000575906 >> 172.21.15.99:0/4000575906 conn(0x55efdffd5660 msgr2=0x55efdff95830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:04:25.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.539+0000 7f91617eb740 1 -- 172.21.15.99:0/4000575906 shutdown_connections 2024-02-21T23:04:25.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.539+0000 7f91617eb740 1 -- 172.21.15.99:0/4000575906 wait complete. 2024-02-21T23:04:25.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.539+0000 7f91617eb740 20 client.5577 trim_cache size 0 max 16384 2024-02-21T23:04:25.533 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-02-21T23:04:25.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.540+0000 7f915d400640 1 -- 172.21.15.99:0/1678740536 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f913809eed0 msgr2=0x7f91380a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:25.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.540+0000 7f915d400640 1 --2- 172.21.15.99:0/1678740536 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f913809eed0 0x7f91380a1390 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9158184d50 tx=0x7f9144009040 comp rx=0 tx=0).stop 2024-02-21T23:04:25.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.540+0000 7f915d400640 1 -- 172.21.15.99:0/1678740536 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f915817d590 msgr2=0x7f9158172460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:25.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.540+0000 7f915d400640 1 --2- 172.21.15.99:0/1678740536 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f915817d590 0x7f9158172460 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9150009db0 tx=0x7f915000c490 comp rx=0 tx=0).stop 2024-02-21T23:04:25.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.540+0000 7f915d400640 1 -- 172.21.15.99:0/1678740536 shutdown_connections 2024-02-21T23:04:25.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.540+0000 7f915d400640 1 --2- 172.21.15.99:0/1678740536 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f913809eed0 0x7f91380a1390 secure :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9158184d50 tx=0x7f9144009040 comp rx=0 tx=0).stop 2024-02-21T23:04:25.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.540+0000 7f915d400640 1 --2- 172.21.15.99:0/1678740536 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f915817d590 0x7f9158172460 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:25.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.540+0000 7f915d400640 1 --2- 172.21.15.99:0/1678740536 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f915817d1b0 0x7f91580cd1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:25.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.540+0000 7f915d400640 1 --2- 172.21.15.99:0/1678740536 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9158071f00 0x7f9158166640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:25.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.540+0000 7f915d400640 1 -- 172.21.15.99:0/1678740536 >> 172.21.15.99:0/1678740536 conn(0x7f915806e210 msgr2=0x7f91580717f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:04:25.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.540+0000 7f915d400640 1 -- 172.21.15.99:0/1678740536 shutdown_connections 2024-02-21T23:04:25.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.540+0000 7f915d400640 1 -- 172.21.15.99:0/1678740536 wait complete. 2024-02-21T23:04:25.544 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T23:04:25.544 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-02-21T23:04:25.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.785+0000 7f3b8b600640 1 Processor -- start 2024-02-21T23:04:25.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.785+0000 7f3b8b600640 1 -- start start 2024-02-21T23:04:25.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.788+0000 7f3b8b600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3b84169200 0x7f3b8418c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:25.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.788+0000 7f3b8b600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f3b840cdea0 0x7f3b840ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:25.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.788+0000 7f3b8b600640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b8418c750 con 0x7f3b84168e20 2024-02-21T23:04:25.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.788+0000 7f3b8b600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b840cf4f0 con 0x7f3b840cdea0 2024-02-21T23:04:25.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.788+0000 7f3b8b600640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b840cf7d0 con 0x7f3b84169200 2024-02-21T23:04:25.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.788+0000 7f3b83e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3b84169200 0x7f3b8418c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:25.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.788+0000 7f3b83e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3b84169200 0x7f3b8418c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:47802/0 (socket says 172.21.15.99:47802) 2024-02-21T23:04:25.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.788+0000 7f3b83e00640 1 -- 172.21.15.99:0/2946189354 learned_addr learned my addr 172.21.15.99:0/2946189354 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:04:25.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.793+0000 7f3b89600640 1 --2- 172.21.15.99:0/2946189354 >> v2:172.21.15.99:3300/0 conn(0x7f3b840cdea0 0x7f3b840ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:25.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.800+0000 7f3b83e00640 1 -- 172.21.15.99:0/2946189354 >> v2:172.21.15.99:3300/0 conn(0x7f3b840cdea0 msgr2=0x7f3b840ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:04:25.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.803+0000 7f3b83400640 1 -- 172.21.15.99:0/2946189354 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1802000353 0 0) 0x7f3b8418c750 con 0x7f3b84168e20 2024-02-21T23:04:25.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.803+0000 7f3b83e00640 1 --2- 172.21.15.99:0/2946189354 >> v2:172.21.15.99:3300/0 conn(0x7f3b840cdea0 0x7f3b840ce2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:25.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.803+0000 7f3b83e00640 1 -- 172.21.15.99:0/2946189354 >> v1:172.21.15.99:6789/0 conn(0x7f3b84168e20 legacy=0x7f3b8418bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:25.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.803+0000 7f3b83e00640 1 -- 172.21.15.99:0/2946189354 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b840cfab0 con 0x7f3b84169200 2024-02-21T23:04:25.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.808+0000 7f3b89600640 1 --2- 172.21.15.99:0/2946189354 >> v2:172.21.15.99:3300/0 conn(0x7f3b840cdea0 0x7f3b840ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:04:25.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.809+0000 7f3b83e00640 1 --2- 172.21.15.99:0/2946189354 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b84169200 0x7f3b8418c210 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f3b8418aff0 tx=0x7f3b7c02bf20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8efbe1f03998c70 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:04:25.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.810+0000 7f3b83400640 1 -- 172.21.15.99:0/2946189354 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7c02cac0 con 0x7f3b84169200 2024-02-21T23:04:25.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.811+0000 7f3b83400640 1 -- 172.21.15.99:0/2946189354 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b7c02cc60 con 0x7f3b84169200 2024-02-21T23:04:25.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.811+0000 7f3b83400640 1 -- 172.21.15.99:0/2946189354 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7c034610 con 0x7f3b84169200 2024-02-21T23:04:25.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.812+0000 7f3b8b600640 1 -- 172.21.15.99:0/2946189354 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b84169200 msgr2=0x7f3b8418c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:25.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.812+0000 7f3b8b600640 1 --2- 172.21.15.99:0/2946189354 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b84169200 0x7f3b8418c210 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f3b8418aff0 tx=0x7f3b7c02bf20 comp rx=0 tx=0).stop 2024-02-21T23:04:25.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.813+0000 7f3b8b600640 1 -- 172.21.15.99:0/2946189354 shutdown_connections 2024-02-21T23:04:25.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.813+0000 7f3b8b600640 1 --2- 172.21.15.99:0/2946189354 >> v2:172.21.15.99:3300/0 conn(0x7f3b840cdea0 0x7f3b840ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:25.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.813+0000 7f3b8b600640 1 --2- 172.21.15.99:0/2946189354 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b84169200 0x7f3b8418c210 secure :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f3b8418aff0 tx=0x7f3b7c02bf20 comp rx=0 tx=0).stop 2024-02-21T23:04:25.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.813+0000 7f3b8b600640 1 -- 172.21.15.99:0/2946189354 >> 172.21.15.99:0/2946189354 conn(0x7f3b840d6af0 msgr2=0x7f3b840740b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:04:25.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.815+0000 7f3b8b600640 1 -- 172.21.15.99:0/2946189354 shutdown_connections 2024-02-21T23:04:25.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.815+0000 7f3b8b600640 1 -- 172.21.15.99:0/2946189354 wait complete. 2024-02-21T23:04:25.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.823+0000 7f3b8b600640 1 Processor -- start 2024-02-21T23:04:25.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.823+0000 7f3b8b600640 1 -- start start 2024-02-21T23:04:25.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.825+0000 7f3b8b600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3b840cdea0 0x7f3b84189250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:25.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.826+0000 7f3b8b600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b84168e20 0x7f3b84189790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:25.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.826+0000 7f3b8b600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3b8415b7e0 0x7f3b8415bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:25.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.826+0000 7f3b8b600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8418e100 con 0x7f3b8415b7e0 2024-02-21T23:04:25.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.826+0000 7f3b8b600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8418b5e0 con 0x7f3b84168e20 2024-02-21T23:04:25.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.827+0000 7f3b8b600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b840ce830 con 0x7f3b840cdea0 2024-02-21T23:04:25.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.827+0000 7f3b89600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3b8415b7e0 0x7f3b8415bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:25.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.827+0000 7f3b89600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3b8415b7e0 0x7f3b8415bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54410/0 (socket says 172.21.15.99:54410) 2024-02-21T23:04:25.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.827+0000 7f3b89600640 1 -- 172.21.15.99:0/3361963312 learned_addr learned my addr 172.21.15.99:0/3361963312 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:04:25.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.827+0000 7f3b83e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b84168e20 0x7f3b84189790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:25.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.828+0000 7f3b89600640 1 -- 172.21.15.99:0/3361963312 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3b840cdea0 msgr2=0x7f3b84189250 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-21T23:04:25.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.829+0000 7f3b89600640 1 --2- 172.21.15.99:0/3361963312 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3b840cdea0 0x7f3b84189250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:25.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.830+0000 7f3b89600640 1 -- 172.21.15.99:0/3361963312 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b84168e20 msgr2=0x7f3b84189790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:25.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.830+0000 7f3b89600640 1 --2- 172.21.15.99:0/3361963312 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b84168e20 0x7f3b84189790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:25.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.830+0000 7f3b89600640 1 -- 172.21.15.99:0/3361963312 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b84189fc0 con 0x7f3b8415b7e0 2024-02-21T23:04:25.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.830+0000 7f3b89600640 1 --2- 172.21.15.99:0/3361963312 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3b8415b7e0 0x7f3b8415bc90 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3b7400e930 tx=0x7f3b7400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:04:25.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.835+0000 7f3b80c00640 1 -- 172.21.15.99:0/3361963312 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b74017070 con 0x7f3b8415b7e0 2024-02-21T23:04:25.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.835+0000 7f3b80c00640 1 -- 172.21.15.99:0/3361963312 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b7400ca00 con 0x7f3b8415b7e0 2024-02-21T23:04:25.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.835+0000 7f3b80c00640 1 -- 172.21.15.99:0/3361963312 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7400cdd0 con 0x7f3b8415b7e0 2024-02-21T23:04:25.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.835+0000 7f3b8b600640 1 -- 172.21.15.99:0/3361963312 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b8418a2a0 con 0x7f3b8415b7e0 2024-02-21T23:04:25.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.836+0000 7f3b8b600640 1 -- 172.21.15.99:0/3361963312 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b8418e740 con 0x7f3b8415b7e0 2024-02-21T23:04:25.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.842+0000 7f3b80c00640 1 -- 172.21.15.99:0/3361963312 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f3b74013470 con 0x7f3b8415b7e0 2024-02-21T23:04:25.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.843+0000 7f3b80c00640 1 --2- 172.21.15.99:0/3361963312 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f3b6409efd0 0x7f3b640a1490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:25.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.844+0000 7f3b80c00640 1 -- 172.21.15.99:0/3361963312 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f3b740c9d80 con 0x7f3b8415b7e0 2024-02-21T23:04:25.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.846+0000 7f3b88c00640 1 --2- 172.21.15.99:0/3361963312 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f3b6409efd0 0x7f3b640a1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:25.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.850+0000 7f3b88c00640 1 --2- 172.21.15.99:0/3361963312 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f3b6409efd0 0x7f3b640a1490 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3b70000f60 tx=0x7f3b700079b0 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:04:25.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.855+0000 7f3b8e58b740 1 Processor -- start 2024-02-21T23:04:25.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.855+0000 7f3b8e58b740 1 -- start start 2024-02-21T23:04:25.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.857+0000 7f3b8e58b740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c06ff80040 0x55c06ff86190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:25.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.857+0000 7f3b8e58b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c06ff80420 0x55c06ff866d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:25.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.857+0000 7f3b8e58b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c06ffac710 0x55c06ffacb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:25.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.857+0000 7f3b8e58b740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c06fea3b50 con 0x55c06ff80040 2024-02-21T23:04:25.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.857+0000 7f3b8e58b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c06fe4cda0 con 0x55c06ff80420 2024-02-21T23:04:25.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.857+0000 7f3b8e58b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c06fe9fbf0 con 0x55c06ffac710 2024-02-21T23:04:25.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.863+0000 7f3b83e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c06ff80420 0x55c06ff866d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:25.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.863+0000 7f3b89600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c06ffac710 0x55c06ffacb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:25.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.863+0000 7f3b89600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c06ffac710 0x55c06ffacb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:48922/0 (socket says 172.21.15.99:48922) 2024-02-21T23:04:25.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.863+0000 7f3b89600640 1 -- 172.21.15.99:0/2516601626 learned_addr learned my addr 172.21.15.99:0/2516601626 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:04:25.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.863+0000 7f3b89600640 1 -- 172.21.15.99:0/2516601626 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c06ff80420 msgr2=0x55c06ff866d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:04:25.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.863+0000 7f3b89600640 1 --2- 172.21.15.99:0/2516601626 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c06ff80420 0x55c06ff866d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:25.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.863+0000 7f3b89600640 1 -- 172.21.15.99:0/2516601626 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c06ff80040 msgr2=0x55c06ff86190 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T23:04:25.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.865+0000 7f3b88c00640 1 --2- 172.21.15.99:0/2516601626 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c06ff80040 0x55c06ff86190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:25.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.865+0000 7f3b89600640 1 --2- 172.21.15.99:0/2516601626 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c06ff80040 0x55c06ff86190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:25.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.865+0000 7f3b89600640 1 -- 172.21.15.99:0/2516601626 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c06fe6ff80 con 0x55c06ffac710 2024-02-21T23:04:25.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.866+0000 7f3b89600640 1 --2- 172.21.15.99:0/2516601626 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c06ffac710 0x55c06ffacb90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f3b7400c520 tx=0x7f3b740972d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf4de798ca0ca90 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:04:25.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.867+0000 7f3b79200640 1 -- 172.21.15.99:0/2516601626 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b74020040 con 0x55c06ffac710 2024-02-21T23:04:25.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.867+0000 7f3b79200640 1 -- 172.21.15.99:0/2516601626 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b7409fe20 con 0x55c06ffac710 2024-02-21T23:04:25.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.867+0000 7f3b79200640 1 -- 172.21.15.99:0/2516601626 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b74020040 con 0x55c06ffac710 2024-02-21T23:04:25.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.869+0000 7f3b8e58b740 1 -- 172.21.15.99:0/2516601626 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c06ffac710 msgr2=0x55c06ffacb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:25.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.870+0000 7f3b8e58b740 1 --2- 172.21.15.99:0/2516601626 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c06ffac710 0x55c06ffacb90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f3b7400c520 tx=0x7f3b740972d0 comp rx=0 tx=0).stop 2024-02-21T23:04:25.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.871+0000 7f3b8e58b740 1 -- 172.21.15.99:0/2516601626 shutdown_connections 2024-02-21T23:04:25.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.871+0000 7f3b8e58b740 1 --2- 172.21.15.99:0/2516601626 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c06ffac710 0x55c06ffacb90 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:25.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.871+0000 7f3b8e58b740 1 --2- 172.21.15.99:0/2516601626 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c06ff80420 0x55c06ff866d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:25.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.872+0000 7f3b8e58b740 1 --2- 172.21.15.99:0/2516601626 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c06ff80040 0x55c06ff86190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:25.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.873+0000 7f3b8e58b740 1 -- 172.21.15.99:0/2516601626 >> 172.21.15.99:0/2516601626 conn(0x55c06ff3d520 msgr2=0x55c06ff3e5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:04:25.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.874+0000 7f3b8e58b740 1 -- 172.21.15.99:0/2516601626 shutdown_connections 2024-02-21T23:04:25.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.874+0000 7f3b8e58b740 1 -- 172.21.15.99:0/2516601626 wait complete. 2024-02-21T23:04:25.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.886+0000 7f3b8e58b740 1 -- start start 2024-02-21T23:04:25.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.888+0000 7f3b8e58b740 1 Processor -- start 2024-02-21T23:04:25.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.897+0000 7f3b8e58b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c06ff80420 0x55c06ff7a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:25.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.897+0000 7f3b8e58b740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c06ffac710 0x55c06ff75c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:25.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.900+0000 7f3b8e58b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c06ffd19c0 0x55c06ff7aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:25.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.901+0000 7f3b8e58b740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c06ffad2c0 con 0x55c06ffac710 2024-02-21T23:04:25.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.901+0000 7f3b8e58b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c06fe42380 con 0x55c06ffd19c0 2024-02-21T23:04:25.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.901+0000 7f3b8e58b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c06ffad5a0 con 0x55c06ff80420 2024-02-21T23:04:25.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.901+0000 7f3b8e58b740 10 client.0 _ll_register_callbacks cb 0x55c06fe9b280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:04:25.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.902+0000 7f3b88c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c06ff80420 0x55c06ff7a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:25.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.906+0000 7f3b83e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c06ffac710 0x55c06ff75c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:25.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.906+0000 7f3b88c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c06ff80420 0x55c06ff7a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:48924/0 (socket says 172.21.15.99:48924) 2024-02-21T23:04:25.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.906+0000 7f3b88c00640 1 -- 172.21.15.99:0/393974228 learned_addr learned my addr 172.21.15.99:0/393974228 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:04:25.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.906+0000 7f3b89600640 1 --2- 172.21.15.99:0/393974228 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c06ffd19c0 0x55c06ff7aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:25.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.907+0000 7f3b88c00640 1 -- 172.21.15.99:0/393974228 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c06ffd19c0 msgr2=0x55c06ff7aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:04:25.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.907+0000 7f3b88c00640 1 --2- 172.21.15.99:0/393974228 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c06ffd19c0 0x55c06ff7aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:25.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.907+0000 7f3b88c00640 1 -- 172.21.15.99:0/393974228 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c06ffac710 msgr2=0x55c06ff75c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:04:25.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.908+0000 7f3b88c00640 1 --2- 172.21.15.99:0/393974228 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c06ffac710 0x55c06ff75c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:25.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.908+0000 7f3b88c00640 1 -- 172.21.15.99:0/393974228 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c06fe6ac20 con 0x55c06ff80420 2024-02-21T23:04:25.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.908+0000 7f3b83e00640 1 --2- 172.21.15.99:0/393974228 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c06ffac710 0x55c06ff75c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:04:25.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.910+0000 7f3b6d600640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-02-21T23:04:25.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.910+0000 7f3b88c00640 1 --2- 172.21.15.99:0/393974228 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c06ff80420 0x55c06ff7a360 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f3b70003bd0 tx=0x7f3b70005570 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4588937efd4674 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:04:25.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.914+0000 7f3b6d600640 1 -- 172.21.15.99:0/393974228 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b70012440 con 0x55c06ff80420 2024-02-21T23:04:25.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.914+0000 7f3b6d600640 1 -- 172.21.15.99:0/393974228 <== mon.2 v2:172.21.15.181:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f3b70014d10 con 0x55c06ff80420 2024-02-21T23:04:25.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.914+0000 7f3b8e58b740 1 -- 172.21.15.99:0/393974228 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3b7409fe20 con 0x55c06ff80420 2024-02-21T23:04:25.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.915+0000 7f3b6d600640 1 -- 172.21.15.99:0/393974228 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3b70012440 con 0x55c06ff80420 2024-02-21T23:04:25.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.915+0000 7f3b8e58b740 10 client.5702 fetch_fsmap learned FSMap version 16 2024-02-21T23:04:25.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.916+0000 7f3b8e58b740 1 -- 172.21.15.99:0/393974228 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55c06fbb83f0 con 0x55c06ff80420 2024-02-21T23:04:25.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.916+0000 7f3b6d600640 1 -- 172.21.15.99:0/393974228 <== mon.2 v2:172.21.15.181:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b7409fe20 con 0x55c06ff80420 2024-02-21T23:04:25.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.918+0000 7f3b6d600640 1 -- 172.21.15.99:0/393974228 <== mon.2 v2:172.21.15.181:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f3b700125e0 con 0x55c06ff80420 2024-02-21T23:04:25.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.918+0000 7f3b8e58b740 10 client.5702 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T23:04:25.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.918+0000 7f3b8e58b740 10 client.5702 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:04:25.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.918+0000 7f3b8e58b740 20 client.5702 populate_metadata read hostname 'smithi099' 2024-02-21T23:04:25.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.918+0000 7f3b8e58b740 1 --2- 172.21.15.99:0/393974228 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55c06ff7cac0 0x55c06ffd3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:25.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.918+0000 7f3b8e58b740 4 client.5702 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:04:25.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.918+0000 7f3b8e58b740 1 -- 172.21.15.99:0/393974228 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c06feb1090 con 0x55c06ff7cac0 2024-02-21T23:04:25.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.921+0000 7f3b83e00640 1 --2- 172.21.15.99:0/393974228 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55c06ff7cac0 0x55c06ffd3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:25.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.924+0000 7f3b83e00640 1 --2- 172.21.15.99:0/393974228 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55c06ff7cac0 0x55c06ffd3ac0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51a2e925f6673152 server_cookie=789d3005cd04b7b3 in_seq=0 out_seq=0 2024-02-21T23:04:25.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.924+0000 7f3b6d600640 10 client.5702 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:04:25.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.931+0000 7f3b6d600640 1 -- 172.21.15.99:0/393974228 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55c06feb1090 con 0x55c06ff7cac0 2024-02-21T23:04:25.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.931+0000 7f3b6d600640 10 client.5702 handle_command_reply: tid=0 2024-02-21T23:04:25.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.931+0000 7f3b8e58b740 1 client.5702 shutdown 2024-02-21T23:04:25.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.935+0000 7f3b8e58b740 1 -- 172.21.15.99:0/393974228 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c06ff80420 msgr2=0x55c06ff7a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:25.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.935+0000 7f3b8e58b740 1 --2- 172.21.15.99:0/393974228 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c06ff80420 0x55c06ff7a360 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f3b70003bd0 tx=0x7f3b70005570 comp rx=0 tx=0).stop 2024-02-21T23:04:25.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.937+0000 7f3b8e58b740 1 -- 172.21.15.99:0/393974228 shutdown_connections 2024-02-21T23:04:25.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.937+0000 7f3b8e58b740 1 --2- 172.21.15.99:0/393974228 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55c06ff7cac0 0x55c06ffd3ac0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:25.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.937+0000 7f3b8e58b740 1 --2- 172.21.15.99:0/393974228 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c06ffd19c0 0x55c06ff7aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:25.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.937+0000 7f3b8e58b740 1 --2- 172.21.15.99:0/393974228 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c06ffac710 0x55c06ff75c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:25.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.937+0000 7f3b8e58b740 1 --2- 172.21.15.99:0/393974228 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c06ff80420 0x55c06ff7a360 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:25.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.937+0000 7f3b8e58b740 1 -- 172.21.15.99:0/393974228 >> 172.21.15.99:0/393974228 conn(0x55c06ff80040 msgr2=0x55c06ff3e560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:04:25.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.937+0000 7f3b6d600640 0 client.5702 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:04:25.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.938+0000 7f3b8e58b740 1 -- 172.21.15.99:0/393974228 shutdown_connections 2024-02-21T23:04:25.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.938+0000 7f3b8e58b740 1 -- 172.21.15.99:0/393974228 wait complete. 2024-02-21T23:04:25.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.938+0000 7f3b8e58b740 20 client.5702 trim_cache size 0 max 16384 2024-02-21T23:04:25.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.981+0000 7f3b8e58b740 1 Processor -- start 2024-02-21T23:04:25.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.983+0000 7f3b8e58b740 1 -- start start 2024-02-21T23:04:25.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.985+0000 7f3b8e58b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c06ff80420 0x55c06ff838e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:25.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.985+0000 7f3b8e58b740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c06ffac710 0x55c06ff3e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:25.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.986+0000 7f3b8e58b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c06ffd19c0 0x55c070023c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:25.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.987+0000 7f3b8e58b740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5c011aa0 con 0x55c06ffac710 2024-02-21T23:04:25.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.987+0000 7f3b8e58b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5c00f640 con 0x55c06ff80420 2024-02-21T23:04:25.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.987+0000 7f3b8e58b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5c00d6e0 con 0x55c06ffd19c0 2024-02-21T23:04:25.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.988+0000 7f3b88c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c06ff80420 0x55c06ff838e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:25.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.988+0000 7f3b89600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c06ffd19c0 0x55c070023c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:25.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.988+0000 7f3b88c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c06ff80420 0x55c06ff838e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:47836/0 (socket says 172.21.15.99:47836) 2024-02-21T23:04:25.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.988+0000 7f3b88c00640 1 -- 172.21.15.99:0/1468946637 learned_addr learned my addr 172.21.15.99:0/1468946637 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:04:25.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.988+0000 7f3b83e00640 1 --2- 172.21.15.99:0/1468946637 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c06ffac710 0x55c06ff3e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:25.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.989+0000 7f3b88c00640 1 -- 172.21.15.99:0/1468946637 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c06ffd19c0 msgr2=0x55c070023c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:04:25.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.989+0000 7f3b88c00640 1 --2- 172.21.15.99:0/1468946637 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c06ffd19c0 0x55c070023c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:25.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.989+0000 7f3b88c00640 1 -- 172.21.15.99:0/1468946637 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c06ffac710 msgr2=0x55c06ff3e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:04:25.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.989+0000 7f3b88c00640 1 --2- 172.21.15.99:0/1468946637 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c06ffac710 0x55c06ff3e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:25.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.989+0000 7f3b88c00640 1 -- 172.21.15.99:0/1468946637 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c06ff45d30 con 0x55c06ff80420 2024-02-21T23:04:25.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.989+0000 7f3b83e00640 1 --2- 172.21.15.99:0/1468946637 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c06ffac710 0x55c06ff3e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:04:25.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.991+0000 7f3b88c00640 1 --2- 172.21.15.99:0/1468946637 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c06ff80420 0x55c06ff838e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f3b70014a10 tx=0x7f3b7001c000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb70c2d6824f76ac server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:04:25.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.992+0000 7f3b6fe00640 1 -- 172.21.15.99:0/1468946637 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b70003800 con 0x55c06ff80420 2024-02-21T23:04:25.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.992+0000 7f3b6fe00640 1 -- 172.21.15.99:0/1468946637 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b7002f070 con 0x55c06ff80420 2024-02-21T23:04:25.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.992+0000 7f3b6fe00640 1 -- 172.21.15.99:0/1468946637 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b70012d30 con 0x55c06ff80420 2024-02-21T23:04:25.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.993+0000 7f3b8e58b740 1 -- 172.21.15.99:0/1468946637 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c06ff80420 msgr2=0x55c06ff838e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:25.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.993+0000 7f3b8e58b740 1 --2- 172.21.15.99:0/1468946637 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c06ff80420 0x55c06ff838e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f3b70014a10 tx=0x7f3b7001c000 comp rx=0 tx=0).stop 2024-02-21T23:04:25.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.994+0000 7f3b8e58b740 1 -- 172.21.15.99:0/1468946637 shutdown_connections 2024-02-21T23:04:25.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.994+0000 7f3b8e58b740 1 --2- 172.21.15.99:0/1468946637 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c06ffd19c0 0x55c070023c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:25.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.994+0000 7f3b8e58b740 1 --2- 172.21.15.99:0/1468946637 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c06ffac710 0x55c06ff3e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:25.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.994+0000 7f3b8e58b740 1 --2- 172.21.15.99:0/1468946637 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c06ff80420 0x55c06ff838e0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:25.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:25.994+0000 7f3b8e58b740 1 -- 172.21.15.99:0/1468946637 >> 172.21.15.99:0/1468946637 conn(0x55c06ff80040 msgr2=0x55c06ff761e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:04:25.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:26.000+0000 7f3b8e58b740 1 -- 172.21.15.99:0/1468946637 shutdown_connections 2024-02-21T23:04:25.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:26.000+0000 7f3b8e58b740 1 -- 172.21.15.99:0/1468946637 wait complete. 2024-02-21T23:04:25.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:26.003+0000 7f3b8e58b740 1 -- start start 2024-02-21T23:04:25.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:26.003+0000 7f3b8e58b740 1 Processor -- start 2024-02-21T23:04:26.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:26.018+0000 7f3b8e58b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c06ff80420 0x55c06ff3b690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:26.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:26.018+0000 7f3b8e58b740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c06ffac710 0x55c07001d840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:26.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:26.018+0000 7f3b8e58b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c06ffd19c0 0x55c06ff440d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:26.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:26.019+0000 7f3b8e58b740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5c00dce0 con 0x55c06ffac710 2024-02-21T23:04:26.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:26.019+0000 7f3b8e58b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5c00efe0 con 0x55c06ff80420 2024-02-21T23:04:26.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:26.019+0000 7f3b8e58b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5c00e320 con 0x55c06ffd19c0 2024-02-21T23:04:26.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:26.019+0000 7f3b8e58b740 10 client.0 _ll_register_callbacks cb 0x7f3b70001180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:04:26.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:26.021+0000 7f3b89600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c06ffd19c0 0x55c06ff440d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:26.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:26.021+0000 7f3b89600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c06ffd19c0 0x55c06ff440d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:48948/0 (socket says 172.21.15.99:48948) 2024-02-21T23:04:26.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:26.021+0000 7f3b89600640 1 -- 172.21.15.99:0/3063352948 learned_addr learned my addr 172.21.15.99:0/3063352948 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:04:26.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:26.023+0000 7f3b83e00640 1 --2- 172.21.15.99:0/3063352948 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c06ffac710 0x55c07001d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:26.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:26.023+0000 7f3b88c00640 1 --2- 172.21.15.99:0/3063352948 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c06ff80420 0x55c06ff3b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:26.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:26.023+0000 7f3b83e00640 1 -- 172.21.15.99:0/3063352948 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c06ffd19c0 msgr2=0x55c06ff440d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:04:26.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:26.023+0000 7f3b83e00640 1 --2- 172.21.15.99:0/3063352948 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c06ffd19c0 0x55c06ff440d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:26.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:26.023+0000 7f3b83e00640 1 -- 172.21.15.99:0/3063352948 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c06ff80420 msgr2=0x55c06ff3b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:04:26.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:26.023+0000 7f3b83e00640 1 --2- 172.21.15.99:0/3063352948 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c06ff80420 0x55c06ff3b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:26.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:26.024+0000 7f3b83e00640 1 -- 172.21.15.99:0/3063352948 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c06fc827d0 con 0x55c06ffac710 2024-02-21T23:04:26.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:26.026+0000 7f3b83e00640 1 --2- 172.21.15.99:0/3063352948 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c06ffac710 0x55c07001d840 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c032000 tx=0x7f3b7c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83e8f64fd7643454 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:04:26.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:26.027+0000 7f3b6d600640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:04:26.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:26.027+0000 7f3b6d600640 1 -- 172.21.15.99:0/3063352948 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7c04c060 con 0x55c06ffac710 2024-02-21T23:04:26.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:26.027+0000 7f3b6d600640 1 -- 172.21.15.99:0/3063352948 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f3b7c003990 con 0x55c06ffac710 2024-02-21T23:04:26.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:26.027+0000 7f3b8e58b740 1 -- 172.21.15.99:0/3063352948 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3b7002f070 con 0x55c06ffac710 2024-02-21T23:04:26.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:26.028+0000 7f3b6d600640 1 -- 172.21.15.99:0/3063352948 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3b7c003b90 con 0x55c06ffac710 2024-02-21T23:04:26.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:26.028+0000 7f3b8e58b740 10 client.5595 fetch_fsmap learned FSMap version 16 2024-02-21T23:04:26.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:26.028+0000 7f3b8e58b740 1 -- 172.21.15.99:0/3063352948 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55c06ffaaeb0 con 0x55c06ffac710 2024-02-21T23:04:26.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:26.029+0000 7f3b6d600640 1 -- 172.21.15.99:0/3063352948 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b7002f070 con 0x55c06ffac710 2024-02-21T23:04:26.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:26.030+0000 7f3b6d600640 1 -- 172.21.15.99:0/3063352948 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f3b7c008040 con 0x55c06ffac710 2024-02-21T23:04:26.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:26.030+0000 7f3b8e58b740 10 client.5595 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T23:04:26.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:26.030+0000 7f3b8e58b740 10 client.5595 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:04:26.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:26.030+0000 7f3b8e58b740 20 client.5595 populate_metadata read hostname 'smithi099' 2024-02-21T23:04:26.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:26.030+0000 7f3b8e58b740 1 --2- 172.21.15.99:0/3063352948 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55c06ff45440 0x55c06ffc3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:26.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:26.030+0000 7f3b8e58b740 4 client.5595 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T23:04:26.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:26.030+0000 7f3b8e58b740 1 -- 172.21.15.99:0/3063352948 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55c06ff3dc80 con 0x55c06ff45440 2024-02-21T23:04:26.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:26.037+0000 7f3b88c00640 1 --2- 172.21.15.99:0/3063352948 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55c06ff45440 0x55c06ffc3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:26.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:26.054+0000 7f3b6d600640 10 client.5595 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:04:26.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:26.054+0000 7f3b88c00640 1 --2- 172.21.15.99:0/3063352948 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55c06ff45440 0x55c06ffc3930 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a21a622e5be9da2 server_cookie=fab9e4ce19d5a283 in_seq=0 out_seq=0 2024-02-21T23:04:26.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:26.073+0000 7f3b6d600640 1 -- 172.21.15.99:0/3063352948 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55c06ff3dc80 con 0x55c06ff45440 2024-02-21T23:04:26.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:26.074+0000 7f3b6d600640 10 client.5595 handle_command_reply: tid=0 2024-02-21T23:04:26.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:26.074+0000 7f3b8e58b740 1 client.5595 shutdown 2024-02-21T23:04:26.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:26.074+0000 7f3b8e58b740 1 -- 172.21.15.99:0/3063352948 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c06ffac710 msgr2=0x55c07001d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:26.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:26.074+0000 7f3b8e58b740 1 --2- 172.21.15.99:0/3063352948 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c06ffac710 0x55c07001d840 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c032000 tx=0x7f3b7c004ab0 comp rx=0 tx=0).stop 2024-02-21T23:04:26.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:26.074+0000 7f3b8e58b740 1 -- 172.21.15.99:0/3063352948 shutdown_connections 2024-02-21T23:04:26.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:26.074+0000 7f3b8e58b740 1 --2- 172.21.15.99:0/3063352948 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55c06ff45440 0x55c06ffc3930 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:26.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:26.074+0000 7f3b8e58b740 1 --2- 172.21.15.99:0/3063352948 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c06ffd19c0 0x55c06ff440d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:26.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:26.074+0000 7f3b8e58b740 1 --2- 172.21.15.99:0/3063352948 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c06ffac710 0x55c07001d840 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:26.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:26.074+0000 7f3b8e58b740 1 --2- 172.21.15.99:0/3063352948 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c06ff80420 0x55c06ff3b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:26.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:26.074+0000 7f3b8e58b740 1 -- 172.21.15.99:0/3063352948 >> 172.21.15.99:0/3063352948 conn(0x55c06ff80040 msgr2=0x55c06ffa7c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:04:26.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:26.075+0000 7f3b6d600640 0 client.5595 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:04:26.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:26.077+0000 7f3b8e58b740 1 -- 172.21.15.99:0/3063352948 shutdown_connections 2024-02-21T23:04:26.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:26.078+0000 7f3b8e58b740 1 -- 172.21.15.99:0/3063352948 wait complete. 2024-02-21T23:04:26.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:26.078+0000 7f3b8e58b740 20 client.5595 trim_cache size 0 max 16384 2024-02-21T23:04:26.067 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-02-21T23:04:26.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:26.079+0000 7f3b8b600640 1 -- 172.21.15.99:0/3361963312 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f3b6409efd0 msgr2=0x7f3b640a1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:26.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:26.079+0000 7f3b8b600640 1 --2- 172.21.15.99:0/3361963312 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f3b6409efd0 0x7f3b640a1490 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3b70000f60 tx=0x7f3b700079b0 comp rx=0 tx=0).stop 2024-02-21T23:04:26.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:26.080+0000 7f3b8b600640 1 -- 172.21.15.99:0/3361963312 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3b8415b7e0 msgr2=0x7f3b8415bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:26.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:26.080+0000 7f3b8b600640 1 --2- 172.21.15.99:0/3361963312 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3b8415b7e0 0x7f3b8415bc90 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3b7400e930 tx=0x7f3b7400edf0 comp rx=0 tx=0).stop 2024-02-21T23:04:26.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:26.082+0000 7f3b8b600640 1 -- 172.21.15.99:0/3361963312 shutdown_connections 2024-02-21T23:04:26.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:26.082+0000 7f3b8b600640 1 --2- 172.21.15.99:0/3361963312 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f3b6409efd0 0x7f3b640a1490 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:26.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:26.082+0000 7f3b8b600640 1 --2- 172.21.15.99:0/3361963312 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3b8415b7e0 0x7f3b8415bc90 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:26.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:26.082+0000 7f3b8b600640 1 --2- 172.21.15.99:0/3361963312 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b84168e20 0x7f3b84189790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:26.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:26.082+0000 7f3b8b600640 1 --2- 172.21.15.99:0/3361963312 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3b840cdea0 0x7f3b84189250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:26.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:26.082+0000 7f3b8b600640 1 -- 172.21.15.99:0/3361963312 >> 172.21.15.99:0/3361963312 conn(0x7f3b840d6af0 msgr2=0x7f3b8418d8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:04:26.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:26.087+0000 7f3b8b600640 1 -- 172.21.15.99:0/3361963312 shutdown_connections 2024-02-21T23:04:26.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:26.088+0000 7f3b8b600640 1 -- 172.21.15.99:0/3361963312 wait complete. 2024-02-21T23:04:27.134 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-02-21T23:04:27.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T23:04:27.135 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-02-21T23:04:27.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.505+0000 7fdd5ea00640 1 Processor -- start 2024-02-21T23:04:27.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.505+0000 7fdd5ea00640 1 -- start start 2024-02-21T23:04:27.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.507+0000 7fdd5ea00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fdd580f81c0 0x7fdd580f8620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:27.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.507+0000 7fdd5ea00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd5808d910 con 0x7fdd580faaf0 2024-02-21T23:04:27.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.508+0000 7fdd5ea00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd5808dbf0 con 0x7fdd58190400 2024-02-21T23:04:27.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.508+0000 7fdd5ea00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd5808d6e0 con 0x7fdd580f81c0 2024-02-21T23:04:27.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.509+0000 7fdd5d600640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fdd58190400 0x7fdd5808cfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:41946/0 (socket says 172.21.15.99:41946) 2024-02-21T23:04:27.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.509+0000 7fdd5d600640 1 -- 172.21.15.99:0/1655767000 learned_addr learned my addr 172.21.15.99:0/1655767000 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:04:27.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.510+0000 7fdd5cc00640 1 --2- 172.21.15.99:0/1655767000 >> v2:172.21.15.99:3300/0 conn(0x7fdd580f81c0 0x7fdd580f8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:27.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.510+0000 7fdd57e00640 1 -- 172.21.15.99:0/1655767000 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 94334695 0 0) 0x7fdd5808dbf0 con 0x7fdd58190400 2024-02-21T23:04:27.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.512+0000 7fdd57e00640 1 -- 172.21.15.99:0/1655767000 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd40003520 con 0x7fdd58190400 2024-02-21T23:04:27.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.513+0000 7fdd57e00640 1 -- 172.21.15.99:0/1655767000 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 284047990 0 0) 0x7fdd5808d910 con 0x7fdd580faaf0 2024-02-21T23:04:27.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.513+0000 7fdd57e00640 1 -- 172.21.15.99:0/1655767000 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd5808dbf0 con 0x7fdd580faaf0 2024-02-21T23:04:27.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.514+0000 7fdd57e00640 1 -- 172.21.15.99:0/1655767000 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 783863968 0 0) 0x7fdd5808dbf0 con 0x7fdd580faaf0 2024-02-21T23:04:27.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.514+0000 7fdd57e00640 1 -- 172.21.15.99:0/1655767000 >> v2:172.21.15.99:3300/0 conn(0x7fdd580f81c0 msgr2=0x7fdd580f8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:04:27.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.514+0000 7fdd57e00640 1 --2- 172.21.15.99:0/1655767000 >> v2:172.21.15.99:3300/0 conn(0x7fdd580f81c0 0x7fdd580f8620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:27.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.514+0000 7fdd57e00640 1 -- 172.21.15.99:0/1655767000 >> v1:172.21.15.181:6789/0 conn(0x7fdd58190400 legacy=0x7fdd5808cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:27.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.514+0000 7fdd57e00640 1 -- 172.21.15.99:0/1655767000 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd5808ded0 con 0x7fdd580faaf0 2024-02-21T23:04:27.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.515+0000 7fdd57e00640 1 -- 172.21.15.99:0/1655767000 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2069890144 0 0) 0x7fdd500019f0 con 0x7fdd580faaf0 2024-02-21T23:04:27.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.515+0000 7fdd5cc00640 1 --2- 172.21.15.99:0/1655767000 >> v2:172.21.15.99:3300/0 conn(0x7fdd580f81c0 0x7fdd580f8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:04:27.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.515+0000 7fdd57e00640 1 -- 172.21.15.99:0/1655767000 >> v1:172.21.15.99:6789/0 conn(0x7fdd580faaf0 legacy=0x7fdd581907e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:27.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.515+0000 7fdd57e00640 1 --2- 172.21.15.99:0/1655767000 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdd40004c20 0x7fdd40005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:27.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.515+0000 7fdd57e00640 1 --2- 172.21.15.99:0/1655767000 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdd400037a0 0x7fdd40003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:27.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.515+0000 7fdd57e00640 1 --2- 172.21.15.99:0/1655767000 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdd40004280 0x7fdd4000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:27.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.515+0000 7fdd57e00640 1 -- 172.21.15.99:0/1655767000 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4000c1b0 con 0x7fdd40004280 2024-02-21T23:04:27.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.515+0000 7fdd57e00640 1 -- 172.21.15.99:0/1655767000 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4000c360 con 0x7fdd40004c20 2024-02-21T23:04:27.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.515+0000 7fdd57e00640 1 -- 172.21.15.99:0/1655767000 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4000c560 con 0x7fdd400037a0 2024-02-21T23:04:27.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.516+0000 7fdd5cc00640 1 --2- 172.21.15.99:0/1655767000 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdd400037a0 0x7fdd40003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:27.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.517+0000 7fdd5e000640 1 --2- 172.21.15.99:0/1655767000 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdd40004280 0x7fdd4000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:27.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.517+0000 7fdd5cc00640 1 -- 172.21.15.99:0/1655767000 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdd40004c20 msgr2=0x7fdd40005000 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T23:04:27.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.517+0000 7fdd5cc00640 1 --2- 172.21.15.99:0/1655767000 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdd40004c20 0x7fdd40005000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:27.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.517+0000 7fdd5cc00640 1 -- 172.21.15.99:0/1655767000 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdd40004280 msgr2=0x7fdd4000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:04:27.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.517+0000 7fdd5cc00640 1 --2- 172.21.15.99:0/1655767000 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdd40004280 0x7fdd4000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:27.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.517+0000 7fdd5cc00640 1 -- 172.21.15.99:0/1655767000 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd5808dbf0 con 0x7fdd400037a0 2024-02-21T23:04:27.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.517+0000 7fdd5e000640 1 -- 172.21.15.99:0/1655767000 reap_dead start 2024-02-21T23:04:27.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.519+0000 7fdd5cc00640 1 --2- 172.21.15.99:0/1655767000 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdd400037a0 0x7fdd40003c20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fdd480098a0 tx=0x7fdd40005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a958236a8d9c772e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:04:27.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.519+0000 7fdd57e00640 1 -- 172.21.15.99:0/1655767000 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4800f040 con 0x7fdd400037a0 2024-02-21T23:04:27.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.519+0000 7fdd57e00640 1 -- 172.21.15.99:0/1655767000 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd48004230 con 0x7fdd400037a0 2024-02-21T23:04:27.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.520+0000 7fdd57e00640 1 -- 172.21.15.99:0/1655767000 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd48003610 con 0x7fdd400037a0 2024-02-21T23:04:27.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.521+0000 7fdd5ea00640 1 -- 172.21.15.99:0/1655767000 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdd400037a0 msgr2=0x7fdd40003c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:27.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.521+0000 7fdd5ea00640 1 --2- 172.21.15.99:0/1655767000 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdd400037a0 0x7fdd40003c20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fdd480098a0 tx=0x7fdd40005830 comp rx=0 tx=0).stop 2024-02-21T23:04:27.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.523+0000 7fdd5ea00640 1 -- 172.21.15.99:0/1655767000 shutdown_connections 2024-02-21T23:04:27.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.523+0000 7fdd5ea00640 1 --2- 172.21.15.99:0/1655767000 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdd400037a0 0x7fdd40003c20 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:27.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.524+0000 7fdd5ea00640 1 -- 172.21.15.99:0/1655767000 >> 172.21.15.99:0/1655767000 conn(0x7fdd580d0650 msgr2=0x7fdd580d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:04:27.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.524+0000 7fdd5ea00640 1 -- 172.21.15.99:0/1655767000 shutdown_connections 2024-02-21T23:04:27.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.524+0000 7fdd5ea00640 1 -- 172.21.15.99:0/1655767000 wait complete. 2024-02-21T23:04:27.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.528+0000 7fdd5ea00640 1 Processor -- start 2024-02-21T23:04:27.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.529+0000 7fdd5ea00640 1 -- start start 2024-02-21T23:04:27.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.532+0000 7fdd5ea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdd400037a0 0x7fdd58173710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:27.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.532+0000 7fdd5ea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdd5818b810 0x7fdd5806bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:27.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.533+0000 7fdd5ea00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdd5818bc90 0x7fdd5806c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:27.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.533+0000 7fdd5ea00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5808e770 con 0x7fdd5818b810 2024-02-21T23:04:27.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.534+0000 7fdd5ea00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5808e490 con 0x7fdd400037a0 2024-02-21T23:04:27.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.534+0000 7fdd5ea00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5818a910 con 0x7fdd5818bc90 2024-02-21T23:04:27.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.534+0000 7fdd5d600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdd400037a0 0x7fdd58173710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:27.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.534+0000 7fdd5d600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdd400037a0 0x7fdd58173710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:39786/0 (socket says 172.21.15.99:39786) 2024-02-21T23:04:27.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.534+0000 7fdd5d600640 1 -- 172.21.15.99:0/2680247746 learned_addr learned my addr 172.21.15.99:0/2680247746 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:04:27.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.535+0000 7fdd5e000640 1 --2- 172.21.15.99:0/2680247746 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdd5818bc90 0x7fdd5806c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:27.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.535+0000 7fdd5cc00640 1 --2- 172.21.15.99:0/2680247746 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdd5818b810 0x7fdd5806bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:27.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.536+0000 7fdd5e000640 1 -- 172.21.15.99:0/2680247746 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdd400037a0 msgr2=0x7fdd58173710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:27.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.536+0000 7fdd5e000640 1 --2- 172.21.15.99:0/2680247746 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdd400037a0 0x7fdd58173710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:27.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.536+0000 7fdd5e000640 1 -- 172.21.15.99:0/2680247746 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdd5818b810 msgr2=0x7fdd5806bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:27.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.537+0000 7fdd5e000640 1 --2- 172.21.15.99:0/2680247746 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdd5818b810 0x7fdd5806bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:27.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.537+0000 7fdd5cc00640 1 --2- 172.21.15.99:0/2680247746 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdd5818b810 0x7fdd5806bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T23:04:27.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.537+0000 7fdd5e000640 1 -- 172.21.15.99:0/2680247746 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd58173c50 con 0x7fdd5818bc90 2024-02-21T23:04:27.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.537+0000 7fdd5d600640 1 --2- 172.21.15.99:0/2680247746 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdd400037a0 0x7fdd58173710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:04:27.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.538+0000 7fdd5e000640 1 --2- 172.21.15.99:0/2680247746 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdd5818bc90 0x7fdd5806c0b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fdd580efc80 tx=0x7fdd5000ef00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:04:27.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.538+0000 7fdd55600640 1 -- 172.21.15.99:0/2680247746 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd50019070 con 0x7fdd5818bc90 2024-02-21T23:04:27.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.539+0000 7fdd5ea00640 1 -- 172.21.15.99:0/2680247746 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd5806c5f0 con 0x7fdd5818bc90 2024-02-21T23:04:27.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.539+0000 7fdd55600640 1 -- 172.21.15.99:0/2680247746 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd50003b80 con 0x7fdd5818bc90 2024-02-21T23:04:27.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.539+0000 7fdd5ea00640 1 -- 172.21.15.99:0/2680247746 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd5818fe80 con 0x7fdd5818bc90 2024-02-21T23:04:27.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.540+0000 7fdd55600640 1 -- 172.21.15.99:0/2680247746 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd500050d0 con 0x7fdd5818bc90 2024-02-21T23:04:27.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.548+0000 7fdd62fb8740 1 Processor -- start 2024-02-21T23:04:27.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.550+0000 7fdd55600640 1 -- 172.21.15.99:0/2680247746 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7fdd5001c070 con 0x7fdd5818bc90 2024-02-21T23:04:27.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.552+0000 7fdd62fb8740 1 -- start start 2024-02-21T23:04:27.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.554+0000 7fdd62fb8740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636fd3a74c0 0x5636fd3a78a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:27.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.554+0000 7fdd62fb8740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5636fd3a7de0 0x5636fd3e2650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:27.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.554+0000 7fdd62fb8740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5636fd3e2b90 0x5636fd3e3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:27.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.554+0000 7fdd62fb8740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636fd2cf790 con 0x5636fd3a7de0 2024-02-21T23:04:27.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.554+0000 7fdd62fb8740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636fd278bf0 con 0x5636fd3a74c0 2024-02-21T23:04:27.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.554+0000 7fdd62fb8740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636fd2cb830 con 0x5636fd3e2b90 2024-02-21T23:04:27.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.556+0000 7fdd55600640 1 --2- 172.21.15.99:0/2680247746 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fdd3c09eed0 0x7fdd3c0a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:27.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.556+0000 7fdd5e000640 1 --2- 172.21.15.99:0/2680247746 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fdd3c09eed0 0x7fdd3c0a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:27.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.557+0000 7fdd5cc00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636fd3a74c0 0x5636fd3a78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:27.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.557+0000 7fdd5cc00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636fd3a74c0 0x5636fd3a78a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:39794/0 (socket says 172.21.15.99:39794) 2024-02-21T23:04:27.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.557+0000 7fdd5cc00640 1 -- 172.21.15.99:0/2851841157 learned_addr learned my addr 172.21.15.99:0/2851841157 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:04:27.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.557+0000 7fdd5cc00640 1 --2- 172.21.15.99:0/2851841157 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5636fd3e2b90 0x5636fd3e3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:27.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.558+0000 7fdd5e000640 1 --2- 172.21.15.99:0/2680247746 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fdd3c09eed0 0x7fdd3c0a1390 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdd50096bc0 tx=0x7fdd50069c30 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:04:27.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.558+0000 7fdd55600640 1 -- 172.21.15.99:0/2680247746 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7fdd500c9330 con 0x7fdd5818bc90 2024-02-21T23:04:27.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.558+0000 7fdd5d600640 1 --2- 172.21.15.99:0/2851841157 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5636fd3a7de0 0x5636fd3e2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:27.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.559+0000 7fdd5cc00640 1 -- 172.21.15.99:0/2851841157 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5636fd3e2b90 msgr2=0x5636fd3e3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:04:27.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.559+0000 7fdd5cc00640 1 --2- 172.21.15.99:0/2851841157 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5636fd3e2b90 0x5636fd3e3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:27.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.559+0000 7fdd5cc00640 1 -- 172.21.15.99:0/2851841157 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5636fd3a7de0 msgr2=0x5636fd3e2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:04:27.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.559+0000 7fdd5cc00640 1 --2- 172.21.15.99:0/2851841157 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5636fd3a7de0 0x5636fd3e2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:27.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.559+0000 7fdd5cc00640 1 -- 172.21.15.99:0/2851841157 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5636fd296c40 con 0x5636fd3a74c0 2024-02-21T23:04:27.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.559+0000 7fdd5d600640 1 --2- 172.21.15.99:0/2851841157 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5636fd3a7de0 0x5636fd3e2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:04:27.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.560+0000 7fdd5cc00640 1 --2- 172.21.15.99:0/2851841157 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636fd3a74c0 0x5636fd3a78a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fdd480099c0 tx=0x7fdd48030000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb8dc55442f81580 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:04:27.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.561+0000 7fdd45c00640 1 -- 172.21.15.99:0/2851841157 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4803e030 con 0x5636fd3a74c0 2024-02-21T23:04:27.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.561+0000 7fdd45c00640 1 -- 172.21.15.99:0/2851841157 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd48005b90 con 0x5636fd3a74c0 2024-02-21T23:04:27.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.561+0000 7fdd45c00640 1 -- 172.21.15.99:0/2851841157 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4803e030 con 0x5636fd3a74c0 2024-02-21T23:04:27.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.563+0000 7fdd62fb8740 1 -- 172.21.15.99:0/2851841157 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636fd3a74c0 msgr2=0x5636fd3a78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:27.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.563+0000 7fdd62fb8740 1 --2- 172.21.15.99:0/2851841157 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636fd3a74c0 0x5636fd3a78a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fdd480099c0 tx=0x7fdd48030000 comp rx=0 tx=0).stop 2024-02-21T23:04:27.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.564+0000 7fdd62fb8740 1 -- 172.21.15.99:0/2851841157 shutdown_connections 2024-02-21T23:04:27.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.564+0000 7fdd62fb8740 1 --2- 172.21.15.99:0/2851841157 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5636fd3e2b90 0x5636fd3e3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:27.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.564+0000 7fdd62fb8740 1 --2- 172.21.15.99:0/2851841157 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5636fd3a7de0 0x5636fd3e2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:27.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.564+0000 7fdd62fb8740 1 --2- 172.21.15.99:0/2851841157 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636fd3a74c0 0x5636fd3a78a0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:27.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.564+0000 7fdd62fb8740 1 -- 172.21.15.99:0/2851841157 >> 172.21.15.99:0/2851841157 conn(0x5636fd369a90 msgr2=0x5636fd36ab10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:04:27.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.565+0000 7fdd62fb8740 1 -- 172.21.15.99:0/2851841157 shutdown_connections 2024-02-21T23:04:27.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.565+0000 7fdd62fb8740 1 -- 172.21.15.99:0/2851841157 wait complete. 2024-02-21T23:04:27.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.567+0000 7fdd62fb8740 1 -- start start 2024-02-21T23:04:27.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.568+0000 7fdd62fb8740 1 Processor -- start 2024-02-21T23:04:27.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.571+0000 7fdd62fb8740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5636fd3a7de0 0x5636fd3a6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:27.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.572+0000 7fdd5cc00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5636fd3a7de0 0x5636fd3a6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:27.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.572+0000 7fdd5cc00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5636fd3a7de0 0x5636fd3a6ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54222/0 (socket says 172.21.15.99:54222) 2024-02-21T23:04:27.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.572+0000 7fdd5cc00640 1 -- 172.21.15.99:0/3202062317 learned_addr learned my addr 172.21.15.99:0/3202062317 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:04:27.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.572+0000 7fdd62fb8740 1 --2- 172.21.15.99:0/3202062317 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636fd3e2b90 0x5636fd3af250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:27.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.573+0000 7fdd62fb8740 1 --2- 172.21.15.99:0/3202062317 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5636fd398e50 0x5636fd366930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:27.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.573+0000 7fdd62fb8740 1 -- 172.21.15.99:0/3202062317 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636fd3e1070 con 0x5636fd3a7de0 2024-02-21T23:04:27.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.573+0000 7fdd5d600640 1 --2- 172.21.15.99:0/3202062317 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636fd3e2b90 0x5636fd3af250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:27.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.573+0000 7fdd62fb8740 1 -- 172.21.15.99:0/3202062317 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636fd26e1d0 con 0x5636fd3e2b90 2024-02-21T23:04:27.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.573+0000 7fdd62fb8740 1 -- 172.21.15.99:0/3202062317 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636fd3e1350 con 0x5636fd398e50 2024-02-21T23:04:27.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.574+0000 7fdd5cc00640 1 --2- 172.21.15.99:0/3202062317 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5636fd398e50 0x5636fd366930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:27.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.575+0000 7fdd62fb8740 10 client.0 _ll_register_callbacks cb 0x5636fcfe3c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:04:27.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.575+0000 7fdd5d600640 1 -- 172.21.15.99:0/3202062317 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5636fd398e50 msgr2=0x5636fd366930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:04:27.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.575+0000 7fdd5d600640 1 --2- 172.21.15.99:0/3202062317 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5636fd398e50 0x5636fd366930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:27.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.576+0000 7fdd5d600640 1 -- 172.21.15.99:0/3202062317 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5636fd3a7de0 msgr2=0x5636fd3a6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:04:27.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.576+0000 7fdd5d600640 1 --2- 172.21.15.99:0/3202062317 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5636fd3a7de0 0x5636fd3a6ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:27.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.576+0000 7fdd5d600640 1 -- 172.21.15.99:0/3202062317 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5636fd0ac7e0 con 0x5636fd3e2b90 2024-02-21T23:04:27.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.576+0000 7fdd5cc00640 1 --2- 172.21.15.99:0/3202062317 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5636fd3a7de0 0x5636fd3a6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:04:27.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.577+0000 7fdd3a000640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-02-21T23:04:27.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.577+0000 7fdd5d600640 1 --2- 172.21.15.99:0/3202062317 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636fd3e2b90 0x5636fd3af250 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c011640 tx=0x7fdd4c011b00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8bcb7d8c0a134968 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:04:27.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.578+0000 7fdd3a000640 1 -- 172.21.15.99:0/3202062317 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4c00f740 con 0x5636fd3e2b90 2024-02-21T23:04:27.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.578+0000 7fdd3a000640 1 -- 172.21.15.99:0/3202062317 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7fdd4c00f8e0 con 0x5636fd3e2b90 2024-02-21T23:04:27.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.578+0000 7fdd62fb8740 1 -- 172.21.15.99:0/3202062317 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdd48005b90 con 0x5636fd3e2b90 2024-02-21T23:04:27.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.578+0000 7fdd3a000640 1 -- 172.21.15.99:0/3202062317 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdd4c00fae0 con 0x5636fd3e2b90 2024-02-21T23:04:27.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.579+0000 7fdd62fb8740 10 client.5710 fetch_fsmap learned FSMap version 16 2024-02-21T23:04:27.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.579+0000 7fdd62fb8740 1 -- 172.21.15.99:0/3202062317 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x5636fd10cf70 con 0x5636fd3e2b90 2024-02-21T23:04:27.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.579+0000 7fdd3a000640 1 -- 172.21.15.99:0/3202062317 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd48005b90 con 0x5636fd3e2b90 2024-02-21T23:04:27.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.579+0000 7fdd3a000640 1 -- 172.21.15.99:0/3202062317 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fdd4c00fc80 con 0x5636fd3e2b90 2024-02-21T23:04:27.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.580+0000 7fdd62fb8740 10 client.5710 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T23:04:27.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.580+0000 7fdd62fb8740 10 client.5710 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:04:27.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.580+0000 7fdd62fb8740 20 client.5710 populate_metadata read hostname 'smithi099' 2024-02-21T23:04:27.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.580+0000 7fdd62fb8740 1 --2- 172.21.15.99:0/3202062317 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5636fd3ef3e0 0x5636fd3ef7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:27.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.580+0000 7fdd62fb8740 4 client.5710 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:04:27.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.580+0000 7fdd62fb8740 1 -- 172.21.15.99:0/3202062317 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5636fd2dccd0 con 0x5636fd3ef3e0 2024-02-21T23:04:27.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.581+0000 7fdd5cc00640 1 --2- 172.21.15.99:0/3202062317 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5636fd3ef3e0 0x5636fd3ef7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:27.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.588+0000 7fdd5cc00640 1 --2- 172.21.15.99:0/3202062317 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5636fd3ef3e0 0x5636fd3ef7f0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bbeb3fbfb3a488b server_cookie=7e509ba8c2f643aa in_seq=0 out_seq=0 2024-02-21T23:04:27.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.588+0000 7fdd3a000640 10 client.5710 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:04:27.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.597+0000 7fdd3a000640 1 -- 172.21.15.99:0/3202062317 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x5636fd2dccd0 con 0x5636fd3ef3e0 2024-02-21T23:04:27.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.597+0000 7fdd3a000640 10 client.5710 handle_command_reply: tid=0 2024-02-21T23:04:27.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.597+0000 7fdd62fb8740 1 client.5710 shutdown 2024-02-21T23:04:27.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.598+0000 7fdd62fb8740 1 -- 172.21.15.99:0/3202062317 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636fd3e2b90 msgr2=0x5636fd3af250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:27.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.598+0000 7fdd62fb8740 1 --2- 172.21.15.99:0/3202062317 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636fd3e2b90 0x5636fd3af250 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c011640 tx=0x7fdd4c011b00 comp rx=0 tx=0).stop 2024-02-21T23:04:27.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.598+0000 7fdd62fb8740 1 -- 172.21.15.99:0/3202062317 shutdown_connections 2024-02-21T23:04:27.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.598+0000 7fdd62fb8740 1 --2- 172.21.15.99:0/3202062317 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5636fd3ef3e0 0x5636fd3ef7f0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:27.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.598+0000 7fdd62fb8740 1 --2- 172.21.15.99:0/3202062317 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5636fd398e50 0x5636fd366930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:27.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.598+0000 7fdd62fb8740 1 --2- 172.21.15.99:0/3202062317 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636fd3e2b90 0x5636fd3af250 secure :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c011640 tx=0x7fdd4c011b00 comp rx=0 tx=0).stop 2024-02-21T23:04:27.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.598+0000 7fdd62fb8740 1 --2- 172.21.15.99:0/3202062317 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5636fd3a7de0 0x5636fd3a6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:27.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.598+0000 7fdd62fb8740 1 -- 172.21.15.99:0/3202062317 >> 172.21.15.99:0/3202062317 conn(0x5636fd3a74c0 msgr2=0x5636fd3e2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:04:27.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.598+0000 7fdd3a000640 0 client.5710 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:04:27.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.599+0000 7fdd62fb8740 1 -- 172.21.15.99:0/3202062317 shutdown_connections 2024-02-21T23:04:27.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.599+0000 7fdd62fb8740 1 -- 172.21.15.99:0/3202062317 wait complete. 2024-02-21T23:04:27.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.600+0000 7fdd62fb8740 20 client.5710 trim_cache size 0 max 16384 2024-02-21T23:04:27.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.664+0000 7fdd62fb8740 1 Processor -- start 2024-02-21T23:04:27.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.667+0000 7fdd62fb8740 1 -- start start 2024-02-21T23:04:27.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.671+0000 7fdd62fb8740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636fd398e50 0x5636fd3e1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:27.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.671+0000 7fdd62fb8740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5636fd3a7de0 0x5636fd361700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:27.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.672+0000 7fdd62fb8740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5636fd3ad650 0x5636fd36b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:27.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.674+0000 7fdd62fb8740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd58231250 con 0x5636fd3ad650 2024-02-21T23:04:27.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.674+0000 7fdd5cc00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636fd398e50 0x5636fd3e1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:27.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.674+0000 7fdd5cc00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636fd398e50 0x5636fd3e1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:39808/0 (socket says 172.21.15.99:39808) 2024-02-21T23:04:27.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.674+0000 7fdd5cc00640 1 -- 172.21.15.99:0/363582726 learned_addr learned my addr 172.21.15.99:0/363582726 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:04:27.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.674+0000 7fdd62fb8740 1 -- 172.21.15.99:0/363582726 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5822edf0 con 0x5636fd398e50 2024-02-21T23:04:27.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.674+0000 7fdd62fb8740 1 -- 172.21.15.99:0/363582726 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5822d070 con 0x5636fd3a7de0 2024-02-21T23:04:27.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.674+0000 7fdd5d600640 1 --2- 172.21.15.99:0/363582726 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5636fd3a7de0 0x5636fd361700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:27.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.676+0000 7fdd5cc00640 1 --2- 172.21.15.99:0/363582726 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5636fd3ad650 0x5636fd36b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:27.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.677+0000 7fdd5d600640 1 -- 172.21.15.99:0/363582726 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636fd398e50 msgr2=0x5636fd3e1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:04:27.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.677+0000 7fdd5d600640 1 --2- 172.21.15.99:0/363582726 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636fd398e50 0x5636fd3e1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:27.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.677+0000 7fdd5d600640 1 -- 172.21.15.99:0/363582726 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5636fd3ad650 msgr2=0x5636fd36b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:04:27.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.677+0000 7fdd5d600640 1 --2- 172.21.15.99:0/363582726 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5636fd3ad650 0x5636fd36b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:27.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.677+0000 7fdd5d600640 1 -- 172.21.15.99:0/363582726 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5636fd3a7c10 con 0x5636fd3a7de0 2024-02-21T23:04:27.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.677+0000 7fdd5cc00640 1 --2- 172.21.15.99:0/363582726 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5636fd3ad650 0x5636fd36b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T23:04:27.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.679+0000 7fdd5d600640 1 --2- 172.21.15.99:0/363582726 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5636fd3a7de0 0x5636fd361700 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x5636fd369210 tx=0x7fdd4c00a000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c094fd3068a415e7 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:04:27.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.679+0000 7fdd45200640 1 -- 172.21.15.99:0/363582726 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4c02d070 con 0x5636fd3a7de0 2024-02-21T23:04:27.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.680+0000 7fdd45200640 1 -- 172.21.15.99:0/363582726 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd4c01a070 con 0x5636fd3a7de0 2024-02-21T23:04:27.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.680+0000 7fdd45200640 1 -- 172.21.15.99:0/363582726 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4c00f740 con 0x5636fd3a7de0 2024-02-21T23:04:27.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.681+0000 7fdd62fb8740 1 -- 172.21.15.99:0/363582726 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5636fd3a7de0 msgr2=0x5636fd361700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:27.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.681+0000 7fdd62fb8740 1 --2- 172.21.15.99:0/363582726 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5636fd3a7de0 0x5636fd361700 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x5636fd369210 tx=0x7fdd4c00a000 comp rx=0 tx=0).stop 2024-02-21T23:04:27.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.683+0000 7fdd62fb8740 1 -- 172.21.15.99:0/363582726 shutdown_connections 2024-02-21T23:04:27.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.683+0000 7fdd62fb8740 1 --2- 172.21.15.99:0/363582726 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5636fd3ad650 0x5636fd36b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:27.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.683+0000 7fdd62fb8740 1 --2- 172.21.15.99:0/363582726 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5636fd3a7de0 0x5636fd361700 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:27.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.683+0000 7fdd62fb8740 1 --2- 172.21.15.99:0/363582726 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636fd398e50 0x5636fd3e1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:27.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.683+0000 7fdd62fb8740 1 -- 172.21.15.99:0/363582726 >> 172.21.15.99:0/363582726 conn(0x5636fd3a74c0 msgr2=0x5636fd3db460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:04:27.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.683+0000 7fdd62fb8740 1 -- 172.21.15.99:0/363582726 shutdown_connections 2024-02-21T23:04:27.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.683+0000 7fdd62fb8740 1 -- 172.21.15.99:0/363582726 wait complete. 2024-02-21T23:04:27.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.685+0000 7fdd62fb8740 1 -- start start 2024-02-21T23:04:27.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.685+0000 7fdd62fb8740 1 Processor -- start 2024-02-21T23:04:27.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.692+0000 7fdd62fb8740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636fd398e50 0x5636fd43ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:27.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.692+0000 7fdd62fb8740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5636fd3a7de0 0x5636fd3ab980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:27.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.693+0000 7fdd62fb8740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5636fd3ad650 0x5636fd3ae230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:27.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.693+0000 7fdd62fb8740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5822d550 con 0x5636fd3a7de0 2024-02-21T23:04:27.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.693+0000 7fdd62fb8740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5822e790 con 0x5636fd398e50 2024-02-21T23:04:27.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.693+0000 7fdd62fb8740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5822db50 con 0x5636fd3ad650 2024-02-21T23:04:27.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.694+0000 7fdd62fb8740 10 client.0 _ll_register_callbacks cb 0x7fdd4c0047e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:04:27.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.694+0000 7fdd5cc00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636fd398e50 0x5636fd43ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:27.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.694+0000 7fdd5cc00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636fd398e50 0x5636fd43ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:39810/0 (socket says 172.21.15.99:39810) 2024-02-21T23:04:27.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.694+0000 7fdd5cc00640 1 -- 172.21.15.99:0/3084368917 learned_addr learned my addr 172.21.15.99:0/3084368917 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:04:27.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.695+0000 7fdd5d600640 1 --2- 172.21.15.99:0/3084368917 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5636fd3a7de0 0x5636fd3ab980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:27.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.696+0000 7fdd5cc00640 1 --2- 172.21.15.99:0/3084368917 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5636fd3ad650 0x5636fd3ae230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:27.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.696+0000 7fdd5d600640 1 -- 172.21.15.99:0/3084368917 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5636fd3ad650 msgr2=0x5636fd3ae230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:04:27.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.696+0000 7fdd5d600640 1 --2- 172.21.15.99:0/3084368917 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5636fd3ad650 0x5636fd3ae230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:27.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.696+0000 7fdd5d600640 1 -- 172.21.15.99:0/3084368917 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636fd398e50 msgr2=0x5636fd43ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:04:27.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.696+0000 7fdd5d600640 1 --2- 172.21.15.99:0/3084368917 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636fd398e50 0x5636fd43ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:27.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.696+0000 7fdd5d600640 1 -- 172.21.15.99:0/3084368917 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5636fcfa4170 con 0x5636fd3a7de0 2024-02-21T23:04:27.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.698+0000 7fdd5d600640 1 --2- 172.21.15.99:0/3084368917 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5636fd3a7de0 0x5636fd3ab980 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c011b40 tx=0x7fdd4c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1dfcb474fb8cac1 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:04:27.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.698+0000 7fdd3a000640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:04:27.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.699+0000 7fdd3a000640 1 -- 172.21.15.99:0/3084368917 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4c02d040 con 0x5636fd3a7de0 2024-02-21T23:04:27.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.699+0000 7fdd3a000640 1 -- 172.21.15.99:0/3084368917 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7fdd4c0110c0 con 0x5636fd3a7de0 2024-02-21T23:04:27.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.699+0000 7fdd62fb8740 1 -- 172.21.15.99:0/3084368917 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdd4c01a070 con 0x5636fd3a7de0 2024-02-21T23:04:27.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.700+0000 7fdd3a000640 1 -- 172.21.15.99:0/3084368917 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdd4c02d040 con 0x5636fd3a7de0 2024-02-21T23:04:27.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.701+0000 7fdd62fb8740 10 client.5610 fetch_fsmap learned FSMap version 16 2024-02-21T23:04:27.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.701+0000 7fdd62fb8740 1 -- 172.21.15.99:0/3084368917 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x5636fd365bf0 con 0x5636fd3a7de0 2024-02-21T23:04:27.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.704+0000 7fdd3a000640 1 -- 172.21.15.99:0/3084368917 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd4c01a070 con 0x5636fd3a7de0 2024-02-21T23:04:27.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.705+0000 7fdd3a000640 1 -- 172.21.15.99:0/3084368917 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fdd4c0112c0 con 0x5636fd3a7de0 2024-02-21T23:04:27.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.705+0000 7fdd62fb8740 10 client.5610 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T23:04:27.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.705+0000 7fdd62fb8740 10 client.5610 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:04:27.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.705+0000 7fdd62fb8740 20 client.5610 populate_metadata read hostname 'smithi099' 2024-02-21T23:04:27.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.705+0000 7fdd62fb8740 1 --2- 172.21.15.99:0/3084368917 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5636fd3d8b40 0x5636fd3abf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:27.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.705+0000 7fdd62fb8740 4 client.5610 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-02-21T23:04:27.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.705+0000 7fdd62fb8740 1 -- 172.21.15.99:0/3084368917 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x5636fd3aff90 con 0x5636fd3d8b40 2024-02-21T23:04:27.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.718+0000 7fdd5cc00640 1 --2- 172.21.15.99:0/3084368917 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5636fd3d8b40 0x5636fd3abf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:27.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.731+0000 7fdd5cc00640 1 --2- 172.21.15.99:0/3084368917 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5636fd3d8b40 0x5636fd3abf50 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e6f26610cc718af server_cookie=71f564ee8396f594 in_seq=0 out_seq=0 2024-02-21T23:04:27.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:27.734+0000 7fdd3a000640 10 client.5610 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:04:27.958 INFO:tasks.workunit.client.0.smithi099.stdout:libtoolize: putting auxiliary files in '.'. 2024-02-21T23:04:27.958 INFO:tasks.workunit.client.0.smithi099.stdout:libtoolize: copying file './config.guess' 2024-02-21T23:04:27.971 INFO:tasks.workunit.client.0.smithi099.stdout:libtoolize: copying file './config.sub' 2024-02-21T23:04:27.983 INFO:tasks.workunit.client.0.smithi099.stdout:libtoolize: copying file './install-sh' 2024-02-21T23:04:28.000 INFO:tasks.workunit.client.0.smithi099.stdout:libtoolize: copying file './ltmain.sh' 2024-02-21T23:04:28.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.018+0000 7fdd3a000640 1 -- 172.21.15.99:0/3084368917 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5636fd3aff90 con 0x5636fd3d8b40 2024-02-21T23:04:28.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.018+0000 7fdd3a000640 10 client.5610 handle_command_reply: tid=0 2024-02-21T23:04:28.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.018+0000 7fdd62fb8740 1 client.5610 shutdown 2024-02-21T23:04:28.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.018+0000 7fdd62fb8740 1 -- 172.21.15.99:0/3084368917 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5636fd3a7de0 msgr2=0x5636fd3ab980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:28.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.018+0000 7fdd62fb8740 1 --2- 172.21.15.99:0/3084368917 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5636fd3a7de0 0x5636fd3ab980 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c011b40 tx=0x7fdd4c014000 comp rx=0 tx=0).stop 2024-02-21T23:04:28.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.018+0000 7fdd62fb8740 1 -- 172.21.15.99:0/3084368917 shutdown_connections 2024-02-21T23:04:28.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.018+0000 7fdd62fb8740 1 --2- 172.21.15.99:0/3084368917 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5636fd3d8b40 0x5636fd3abf50 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:28.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.018+0000 7fdd62fb8740 1 --2- 172.21.15.99:0/3084368917 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5636fd3ad650 0x5636fd3ae230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:28.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.018+0000 7fdd62fb8740 1 --2- 172.21.15.99:0/3084368917 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5636fd3a7de0 0x5636fd3ab980 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:28.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.018+0000 7fdd62fb8740 1 --2- 172.21.15.99:0/3084368917 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5636fd398e50 0x5636fd43ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:28.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.018+0000 7fdd62fb8740 1 -- 172.21.15.99:0/3084368917 >> 172.21.15.99:0/3084368917 conn(0x5636fd3a74c0 msgr2=0x5636fd36b500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:04:28.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.018+0000 7fdd3a000640 0 client.5610 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:04:28.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.018+0000 7fdd62fb8740 1 -- 172.21.15.99:0/3084368917 shutdown_connections 2024-02-21T23:04:28.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.019+0000 7fdd62fb8740 1 -- 172.21.15.99:0/3084368917 wait complete. 2024-02-21T23:04:28.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.019+0000 7fdd62fb8740 20 client.5610 trim_cache size 0 max 16384 2024-02-21T23:04:28.009 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-02-21T23:04:28.009 INFO:teuthology.orchestra.run.smithi099.stdout: "return_code": 0, 2024-02-21T23:04:28.009 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_tag": "7c2f2c86-6e63-4330-9b2b-de708a3ddb0f", 2024-02-21T23:04:28.009 INFO:teuthology.orchestra.run.smithi099.stdout: "mode": "asynchronous" 2024-02-21T23:04:28.009 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-02-21T23:04:28.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.020+0000 7fdd5ea00640 1 -- 172.21.15.99:0/2680247746 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fdd3c09eed0 msgr2=0x7fdd3c0a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:28.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.020+0000 7fdd5ea00640 1 --2- 172.21.15.99:0/2680247746 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fdd3c09eed0 0x7fdd3c0a1390 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdd50096bc0 tx=0x7fdd50069c30 comp rx=0 tx=0).stop 2024-02-21T23:04:28.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.020+0000 7fdd5ea00640 1 -- 172.21.15.99:0/2680247746 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdd5818bc90 msgr2=0x7fdd5806c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:28.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.020+0000 7fdd5ea00640 1 --2- 172.21.15.99:0/2680247746 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdd5818bc90 0x7fdd5806c0b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fdd580efc80 tx=0x7fdd5000ef00 comp rx=0 tx=0).stop 2024-02-21T23:04:28.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.020+0000 7fdd5ea00640 1 -- 172.21.15.99:0/2680247746 shutdown_connections 2024-02-21T23:04:28.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.020+0000 7fdd5ea00640 1 --2- 172.21.15.99:0/2680247746 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fdd3c09eed0 0x7fdd3c0a1390 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:28.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.020+0000 7fdd5ea00640 1 --2- 172.21.15.99:0/2680247746 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdd5818bc90 0x7fdd5806c0b0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:28.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.020+0000 7fdd5ea00640 1 --2- 172.21.15.99:0/2680247746 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdd5818b810 0x7fdd5806bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:28.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.020+0000 7fdd5ea00640 1 --2- 172.21.15.99:0/2680247746 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdd400037a0 0x7fdd58173710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:28.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.020+0000 7fdd5ea00640 1 -- 172.21.15.99:0/2680247746 >> 172.21.15.99:0/2680247746 conn(0x7fdd580d0650 msgr2=0x7fdd58068e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:04:28.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.021+0000 7fdd5ea00640 1 -- 172.21.15.99:0/2680247746 shutdown_connections 2024-02-21T23:04:28.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.021+0000 7fdd5ea00640 1 -- 172.21.15.99:0/2680247746 wait complete. 2024-02-21T23:04:28.032 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T23:04:28.032 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T23:04:28.095 INFO:tasks.workunit.client.0.smithi099.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2024-02-21T23:04:28.095 INFO:tasks.workunit.client.0.smithi099.stdout:libtoolize: copying file 'm4/libtool.m4' 2024-02-21T23:04:28.112 INFO:tasks.workunit.client.0.smithi099.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2024-02-21T23:04:28.133 INFO:tasks.workunit.client.0.smithi099.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2024-02-21T23:04:28.152 INFO:tasks.workunit.client.0.smithi099.stdout:libtoolize: copying file 'm4/ltversion.m4' 2024-02-21T23:04:28.171 INFO:tasks.workunit.client.0.smithi099.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2024-02-21T23:04:28.197 INFO:tasks.workunit.client.0.smithi099.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2024-02-21T23:04:28.203 INFO:tasks.workunit.client.0.smithi099.stdout:cp include/install-sh . 2024-02-21T23:04:28.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.313+0000 7f6afbe00640 1 Processor -- start 2024-02-21T23:04:28.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.313+0000 7f6afbe00640 1 -- start start 2024-02-21T23:04:28.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.316+0000 7f6afbe00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f6afc17f490 0x7f6afc18ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:28.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.316+0000 7f6afbe00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6afc18b060 0x7f6afc188a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:28.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.316+0000 7f6afbe00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6afc0d6dd0 con 0x7f6afc18b4f0 2024-02-21T23:04:28.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.316+0000 7f6afbe00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6afc1614c0 con 0x7f6afc18b060 2024-02-21T23:04:28.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.316+0000 7f6afbe00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6afc0d6810 con 0x7f6afc17f490 2024-02-21T23:04:28.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.317+0000 7f6afb400640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f6afc18b4f0 0x7f6afc188f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.99:54232/0 (socket says 172.21.15.99:54232) 2024-02-21T23:04:28.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.317+0000 7f6afaa00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f6afc17f490 0x7f6afc18ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:28.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.317+0000 7f6afa000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6afc18b060 0x7f6afc188a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:28.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.317+0000 7f6afb400640 1 -- 172.21.15.99:0/775413076 learned_addr learned my addr 172.21.15.99:0/775413076 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:04:28.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.317+0000 7f6af9600640 1 -- 172.21.15.99:0/775413076 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3431142748 0 0) 0x7f6afc0d6dd0 con 0x7f6afc18b4f0 2024-02-21T23:04:28.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.317+0000 7f6afaa00640 1 -- 172.21.15.99:0/775413076 >> v2:172.21.15.99:3300/0 conn(0x7f6afc18b060 msgr2=0x7f6afc188a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:04:28.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.317+0000 7f6afaa00640 1 --2- 172.21.15.99:0/775413076 >> v2:172.21.15.99:3300/0 conn(0x7f6afc18b060 0x7f6afc188a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:28.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.317+0000 7f6afaa00640 1 -- 172.21.15.99:0/775413076 >> v1:172.21.15.162:6789/0 conn(0x7f6afc18b4f0 legacy=0x7f6afc188f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:28.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.317+0000 7f6afaa00640 1 -- 172.21.15.99:0/775413076 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6afc0d6af0 con 0x7f6afc17f490 2024-02-21T23:04:28.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.319+0000 7f6afaa00640 1 --2- 172.21.15.99:0/775413076 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6afc17f490 0x7f6afc18ab20 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f6afc067c30 tx=0x7f6aec02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0ab084bf6b2c0e9 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:04:28.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.319+0000 7f6af9600640 1 -- 172.21.15.99:0/775413076 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aec035020 con 0x7f6afc17f490 2024-02-21T23:04:28.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.319+0000 7f6af9600640 1 -- 172.21.15.99:0/775413076 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aec031830 con 0x7f6afc17f490 2024-02-21T23:04:28.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.319+0000 7f6af9600640 1 -- 172.21.15.99:0/775413076 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aec031c00 con 0x7f6afc17f490 2024-02-21T23:04:28.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.320+0000 7f6afbe00640 1 -- 172.21.15.99:0/775413076 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6afc17f490 msgr2=0x7f6afc18ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:28.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.320+0000 7f6afbe00640 1 --2- 172.21.15.99:0/775413076 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6afc17f490 0x7f6afc18ab20 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f6afc067c30 tx=0x7f6aec02b8d0 comp rx=0 tx=0).stop 2024-02-21T23:04:28.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.320+0000 7f6afbe00640 1 -- 172.21.15.99:0/775413076 shutdown_connections 2024-02-21T23:04:28.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.320+0000 7f6afbe00640 1 --2- 172.21.15.99:0/775413076 >> v2:172.21.15.99:3300/0 conn(0x7f6afc18b060 0x7f6afc188a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:28.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.320+0000 7f6afbe00640 1 --2- 172.21.15.99:0/775413076 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6afc17f490 0x7f6afc18ab20 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:28.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.320+0000 7f6afbe00640 1 -- 172.21.15.99:0/775413076 >> 172.21.15.99:0/775413076 conn(0x7f6afc0d29b0 msgr2=0x7f6afc0d2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:04:28.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.320+0000 7f6afbe00640 1 -- 172.21.15.99:0/775413076 shutdown_connections 2024-02-21T23:04:28.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.320+0000 7f6afbe00640 1 -- 172.21.15.99:0/775413076 wait complete. 2024-02-21T23:04:28.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.323+0000 7f6afbe00640 1 Processor -- start 2024-02-21T23:04:28.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.323+0000 7f6afbe00640 1 -- start start 2024-02-21T23:04:28.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.326+0000 7f6afbe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6afc17f490 0x7f6afc06c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:28.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.326+0000 7f6afbe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6afc18b060 0x7f6afc06c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:28.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.326+0000 7f6afbe00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6afc18b4f0 0x7f6afc15e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:28.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.326+0000 7f6afbe00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6afc18a600 con 0x7f6afc18b060 2024-02-21T23:04:28.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.326+0000 7f6afbe00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6afc18a320 con 0x7f6afc17f490 2024-02-21T23:04:28.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.326+0000 7f6afaa00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6afc17f490 0x7f6afc06c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:28.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.326+0000 7f6afbe00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6afc17f870 con 0x7f6afc18b4f0 2024-02-21T23:04:28.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.326+0000 7f6afaa00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6afc17f490 0x7f6afc06c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:39812/0 (socket says 172.21.15.99:39812) 2024-02-21T23:04:28.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.326+0000 7f6afaa00640 1 -- 172.21.15.99:0/3466062541 learned_addr learned my addr 172.21.15.99:0/3466062541 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:04:28.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.326+0000 7f6afb400640 1 --2- 172.21.15.99:0/3466062541 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6afc18b4f0 0x7f6afc15e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:28.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.327+0000 7f6afaa00640 1 -- 172.21.15.99:0/3466062541 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6afc18b4f0 msgr2=0x7f6afc15e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:28.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.327+0000 7f6afaa00640 1 --2- 172.21.15.99:0/3466062541 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6afc18b4f0 0x7f6afc15e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:28.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.327+0000 7f6afaa00640 1 -- 172.21.15.99:0/3466062541 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6afc18b060 msgr2=0x7f6afc06c820 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-21T23:04:28.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.327+0000 7f6afa000640 1 --2- 172.21.15.99:0/3466062541 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6afc18b060 0x7f6afc06c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:28.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.328+0000 7f6afaa00640 1 --2- 172.21.15.99:0/3466062541 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6afc18b060 0x7f6afc06c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:28.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.328+0000 7f6afaa00640 1 -- 172.21.15.99:0/3466062541 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6afc215090 con 0x7f6afc17f490 2024-02-21T23:04:28.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.328+0000 7f6afb400640 1 --2- 172.21.15.99:0/3466062541 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6afc18b4f0 0x7f6afc15e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:04:28.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.329+0000 7f6afa000640 1 --2- 172.21.15.99:0/3466062541 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6afc18b060 0x7f6afc06c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T23:04:28.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.330+0000 7f6afaa00640 1 --2- 172.21.15.99:0/3466062541 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6afc17f490 0x7f6afc06c2e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6aec000c00 tx=0x7f6aec0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:04:28.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.331+0000 7f6af2a00640 1 -- 172.21.15.99:0/3466062541 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aec040070 con 0x7f6afc17f490 2024-02-21T23:04:28.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.331+0000 7f6af2a00640 1 -- 172.21.15.99:0/3466062541 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aec03a910 con 0x7f6afc17f490 2024-02-21T23:04:28.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.331+0000 7f6af2a00640 1 -- 172.21.15.99:0/3466062541 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aec035040 con 0x7f6afc17f490 2024-02-21T23:04:28.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.331+0000 7f6afbe00640 1 -- 172.21.15.99:0/3466062541 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6afc215370 con 0x7f6afc17f490 2024-02-21T23:04:28.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.331+0000 7f6afbe00640 1 -- 172.21.15.99:0/3466062541 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6afc215930 con 0x7f6afc17f490 2024-02-21T23:04:28.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.335+0000 7f6b04a23740 1 Processor -- start 2024-02-21T23:04:28.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.335+0000 7f6b04a23740 1 -- start start 2024-02-21T23:04:28.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.337+0000 7f6b04a23740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5616a60cf2a0 0x5616a6104d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:28.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.337+0000 7f6b04a23740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5616a6105260 0x5616a60cf680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:28.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.337+0000 7f6b04a23740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5616a60cfbc0 0x5616a60921d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:28.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.337+0000 7f6b04a23740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616a5ffba90 con 0x5616a60cf2a0 2024-02-21T23:04:28.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.337+0000 7f6b04a23740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616a5fa4b10 con 0x5616a60cfbc0 2024-02-21T23:04:28.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.337+0000 7f6b04a23740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616a5ff7b30 con 0x5616a6105260 2024-02-21T23:04:28.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.337+0000 7f6afb400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5616a60cf2a0 0x5616a6104d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:28.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.337+0000 7f6afb400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5616a60cf2a0 0x5616a6104d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54260/0 (socket says 172.21.15.99:54260) 2024-02-21T23:04:28.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.337+0000 7f6afb400640 1 -- 172.21.15.99:0/4178958893 learned_addr learned my addr 172.21.15.99:0/4178958893 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:04:28.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.338+0000 7f6afa000640 1 --2- 172.21.15.99:0/4178958893 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5616a60cfbc0 0x5616a60921d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:28.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.338+0000 7f6afb400640 1 -- 172.21.15.99:0/4178958893 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5616a6105260 msgr2=0x5616a60cf680 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T23:04:28.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.338+0000 7f6afb400640 1 --2- 172.21.15.99:0/4178958893 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5616a6105260 0x5616a60cf680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:28.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.338+0000 7f6afb400640 1 -- 172.21.15.99:0/4178958893 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5616a60cfbc0 msgr2=0x5616a60921d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:04:28.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.338+0000 7f6afb400640 1 --2- 172.21.15.99:0/4178958893 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5616a60cfbc0 0x5616a60921d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:28.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.338+0000 7f6afb400640 1 -- 172.21.15.99:0/4178958893 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5616a5dda7d0 con 0x5616a60cf2a0 2024-02-21T23:04:28.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.338+0000 7f6afb400640 1 --2- 172.21.15.99:0/4178958893 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5616a60cf2a0 0x5616a6104d20 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f6af4007300 tx=0x7f6af40077c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb3807c34a2f1cd6 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:04:28.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.339+0000 7f6ae7400640 1 -- 172.21.15.99:0/4178958893 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af4019070 con 0x5616a60cf2a0 2024-02-21T23:04:28.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.339+0000 7f6ae7400640 1 -- 172.21.15.99:0/4178958893 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6af4001e20 con 0x5616a60cf2a0 2024-02-21T23:04:28.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.339+0000 7f6ae7400640 1 -- 172.21.15.99:0/4178958893 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af4019070 con 0x5616a60cf2a0 2024-02-21T23:04:28.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.340+0000 7f6b04a23740 1 -- 172.21.15.99:0/4178958893 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5616a60cf2a0 msgr2=0x5616a6104d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:28.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.340+0000 7f6b04a23740 1 --2- 172.21.15.99:0/4178958893 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5616a60cf2a0 0x5616a6104d20 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f6af4007300 tx=0x7f6af40077c0 comp rx=0 tx=0).stop 2024-02-21T23:04:28.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.340+0000 7f6b04a23740 1 -- 172.21.15.99:0/4178958893 shutdown_connections 2024-02-21T23:04:28.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.340+0000 7f6b04a23740 1 --2- 172.21.15.99:0/4178958893 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5616a60cfbc0 0x5616a60921d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:28.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.340+0000 7f6b04a23740 1 --2- 172.21.15.99:0/4178958893 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5616a6105260 0x5616a60cf680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:28.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.340+0000 7f6b04a23740 1 --2- 172.21.15.99:0/4178958893 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5616a60cf2a0 0x5616a6104d20 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:28.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.340+0000 7f6b04a23740 1 -- 172.21.15.99:0/4178958893 >> 172.21.15.99:0/4178958893 conn(0x5616a605e6b0 msgr2=0x5616a6096190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:04:28.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.342+0000 7f6af2a00640 1 -- 172.21.15.99:0/3466062541 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f6aec04b060 con 0x7f6afc17f490 2024-02-21T23:04:28.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.344+0000 7f6af2a00640 1 --2- 172.21.15.99:0/3466062541 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f6adc09eed0 0x7f6adc0a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:28.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.344+0000 7f6af2a00640 1 -- 172.21.15.99:0/3466062541 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f6aec0eb730 con 0x7f6afc17f490 2024-02-21T23:04:28.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.344+0000 7f6b04a23740 1 -- 172.21.15.99:0/4178958893 shutdown_connections 2024-02-21T23:04:28.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.344+0000 7f6b04a23740 1 -- 172.21.15.99:0/4178958893 wait complete. 2024-02-21T23:04:28.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.345+0000 7f6afa000640 1 --2- 172.21.15.99:0/3466062541 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f6adc09eed0 0x7f6adc0a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:28.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.345+0000 7f6b04a23740 1 -- start start 2024-02-21T23:04:28.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.345+0000 7f6afa000640 1 --2- 172.21.15.99:0/3466062541 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f6adc09eed0 0x7f6adc0a1390 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6afc178260 tx=0x7f6ae8008040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:04:28.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.346+0000 7f6b04a23740 1 Processor -- start 2024-02-21T23:04:28.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.347+0000 7f6b04a23740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5616a60cf2a0 0x5616a6117a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:28.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.347+0000 7f6b04a23740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5616a60cfbc0 0x5616a60c9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:28.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.347+0000 7f6b04a23740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5616a60c5240 0x5616a6116f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:28.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.347+0000 7f6b04a23740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616a609df30 con 0x5616a60cf2a0 2024-02-21T23:04:28.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.347+0000 7f6b04a23740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616a5f9a1c0 con 0x5616a60c5240 2024-02-21T23:04:28.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.347+0000 7f6b04a23740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616a6106930 con 0x5616a60cfbc0 2024-02-21T23:04:28.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.347+0000 7f6b04a23740 10 client.0 _ll_register_callbacks cb 0x5616a5fb7930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:04:28.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.347+0000 7f6afa000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5616a60cfbc0 0x5616a60c9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:28.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.347+0000 7f6afa000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5616a60cfbc0 0x5616a60c9eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:37842/0 (socket says 172.21.15.99:37842) 2024-02-21T23:04:28.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.347+0000 7f6afaa00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5616a60cf2a0 0x5616a6117a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:28.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.347+0000 7f6afa000640 1 -- 172.21.15.99:0/902993200 learned_addr learned my addr 172.21.15.99:0/902993200 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:04:28.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.348+0000 7f6afa000640 1 -- 172.21.15.99:0/902993200 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5616a60c5240 msgr2=0x5616a6116f10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T23:04:28.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.348+0000 7f6afa000640 1 --2- 172.21.15.99:0/902993200 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5616a60c5240 0x5616a6116f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:28.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.348+0000 7f6afa000640 1 -- 172.21.15.99:0/902993200 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5616a60cf2a0 msgr2=0x5616a6117a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:04:28.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.348+0000 7f6afa000640 1 --2- 172.21.15.99:0/902993200 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5616a60cf2a0 0x5616a6117a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:28.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.348+0000 7f6afa000640 1 -- 172.21.15.99:0/902993200 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5616a5d103f0 con 0x5616a60cfbc0 2024-02-21T23:04:28.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.348+0000 7f6afa000640 1 --2- 172.21.15.99:0/902993200 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5616a60cfbc0 0x5616a60c9eb0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6ae8013f70 tx=0x7f6ae8004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34a4fd2a253e6570 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:04:28.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.348+0000 7f6adbe00640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-02-21T23:04:28.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.349+0000 7f6adbe00640 1 -- 172.21.15.99:0/902993200 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae8027030 con 0x5616a60cfbc0 2024-02-21T23:04:28.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.349+0000 7f6b04a23740 1 -- 172.21.15.99:0/902993200 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6af4001e20 con 0x5616a60cfbc0 2024-02-21T23:04:28.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.349+0000 7f6adbe00640 1 -- 172.21.15.99:0/902993200 <== mon.2 v2:172.21.15.181:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f6ae8004020 con 0x5616a60cfbc0 2024-02-21T23:04:28.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.349+0000 7f6adbe00640 1 -- 172.21.15.99:0/902993200 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6ae8031050 con 0x5616a60cfbc0 2024-02-21T23:04:28.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.349+0000 7f6b04a23740 10 client.5735 fetch_fsmap learned FSMap version 16 2024-02-21T23:04:28.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.349+0000 7f6b04a23740 1 -- 172.21.15.99:0/902993200 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x5616a5cd00f0 con 0x5616a60cfbc0 2024-02-21T23:04:28.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.349+0000 7f6adbe00640 1 -- 172.21.15.99:0/902993200 <== mon.2 v2:172.21.15.181:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6af4001e20 con 0x5616a60cfbc0 2024-02-21T23:04:28.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.349+0000 7f6adbe00640 1 -- 172.21.15.99:0/902993200 <== mon.2 v2:172.21.15.181:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f6ae8004220 con 0x5616a60cfbc0 2024-02-21T23:04:28.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.349+0000 7f6b04a23740 10 client.5735 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T23:04:28.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.349+0000 7f6b04a23740 10 client.5735 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:04:28.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.350+0000 7f6b04a23740 20 client.5735 populate_metadata read hostname 'smithi099' 2024-02-21T23:04:28.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.350+0000 7f6b04a23740 1 --2- 172.21.15.99:0/902993200 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5616a60d9360 0x5616a60dac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:28.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.350+0000 7f6b04a23740 4 client.5735 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:04:28.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.350+0000 7f6b04a23740 1 -- 172.21.15.99:0/902993200 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5616a6008fd0 con 0x5616a60d9360 2024-02-21T23:04:28.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.350+0000 7f6afaa00640 1 --2- 172.21.15.99:0/902993200 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5616a60d9360 0x5616a60dac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:28.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.351+0000 7f6afaa00640 1 --2- 172.21.15.99:0/902993200 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5616a60d9360 0x5616a60dac50 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6cacd697dc01bde server_cookie=97370eb2e2723f65 in_seq=0 out_seq=0 2024-02-21T23:04:28.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.351+0000 7f6adbe00640 10 client.5735 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:04:28.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.352+0000 7f6adbe00640 1 -- 172.21.15.99:0/902993200 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x5616a6008fd0 con 0x5616a60d9360 2024-02-21T23:04:28.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.352+0000 7f6adbe00640 10 client.5735 handle_command_reply: tid=0 2024-02-21T23:04:28.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.352+0000 7f6b04a23740 1 client.5735 shutdown 2024-02-21T23:04:28.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.353+0000 7f6b04a23740 1 -- 172.21.15.99:0/902993200 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5616a60cfbc0 msgr2=0x5616a60c9eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:28.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.353+0000 7f6b04a23740 1 --2- 172.21.15.99:0/902993200 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5616a60cfbc0 0x5616a60c9eb0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6ae8013f70 tx=0x7f6ae8004730 comp rx=0 tx=0).stop 2024-02-21T23:04:28.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.353+0000 7f6b04a23740 1 -- 172.21.15.99:0/902993200 shutdown_connections 2024-02-21T23:04:28.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.353+0000 7f6b04a23740 1 --2- 172.21.15.99:0/902993200 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5616a60d9360 0x5616a60dac50 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:28.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.353+0000 7f6b04a23740 1 --2- 172.21.15.99:0/902993200 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5616a60c5240 0x5616a6116f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:28.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.353+0000 7f6b04a23740 1 --2- 172.21.15.99:0/902993200 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5616a60cfbc0 0x5616a60c9eb0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:28.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.353+0000 7f6b04a23740 1 --2- 172.21.15.99:0/902993200 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5616a60cf2a0 0x5616a6117a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:28.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.353+0000 7f6b04a23740 1 -- 172.21.15.99:0/902993200 >> 172.21.15.99:0/902993200 conn(0x5616a605e6b0 msgr2=0x5616a6096b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:04:28.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.353+0000 7f6adbe00640 0 client.5735 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:04:28.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.353+0000 7f6b04a23740 1 -- 172.21.15.99:0/902993200 shutdown_connections 2024-02-21T23:04:28.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.353+0000 7f6b04a23740 1 -- 172.21.15.99:0/902993200 wait complete. 2024-02-21T23:04:28.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.354+0000 7f6b04a23740 20 client.5735 trim_cache size 0 max 16384 2024-02-21T23:04:28.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.387+0000 7f6b04a23740 1 Processor -- start 2024-02-21T23:04:28.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.387+0000 7f6b04a23740 1 -- start start 2024-02-21T23:04:28.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.389+0000 7f6b04a23740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5616a60c5240 0x5616a60baff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:28.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.389+0000 7f6b04a23740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5616a60cf2a0 0x5616a6117bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:28.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.389+0000 7f6b04a23740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5616a60cfbc0 0x5616a60d9e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:28.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.389+0000 7f6b04a23740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6afc2283b0 con 0x5616a60cf2a0 2024-02-21T23:04:28.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.389+0000 7f6b04a23740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6afc06f920 con 0x5616a60cfbc0 2024-02-21T23:04:28.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.389+0000 7f6b04a23740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6afc222f20 con 0x5616a60c5240 2024-02-21T23:04:28.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.390+0000 7f6afaa00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5616a60c5240 0x5616a60baff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:28.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.390+0000 7f6afa000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5616a60cf2a0 0x5616a6117bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:28.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.390+0000 7f6afaa00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5616a60c5240 0x5616a60baff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:37848/0 (socket says 172.21.15.99:37848) 2024-02-21T23:04:28.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.390+0000 7f6afaa00640 1 -- 172.21.15.99:0/579543251 learned_addr learned my addr 172.21.15.99:0/579543251 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:04:28.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.390+0000 7f6afb400640 1 --2- 172.21.15.99:0/579543251 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5616a60cfbc0 0x5616a60d9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:28.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.390+0000 7f6afaa00640 1 -- 172.21.15.99:0/579543251 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5616a60cfbc0 msgr2=0x5616a60d9e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:04:28.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.390+0000 7f6afaa00640 1 --2- 172.21.15.99:0/579543251 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5616a60cfbc0 0x5616a60d9e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:28.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.390+0000 7f6afaa00640 1 -- 172.21.15.99:0/579543251 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5616a60cf2a0 msgr2=0x5616a6117bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:04:28.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.390+0000 7f6afaa00640 1 --2- 172.21.15.99:0/579543251 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5616a60cf2a0 0x5616a6117bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:28.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.390+0000 7f6afaa00640 1 -- 172.21.15.99:0/579543251 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5616a6094ad0 con 0x5616a60c5240 2024-02-21T23:04:28.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.390+0000 7f6afaa00640 1 --2- 172.21.15.99:0/579543251 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5616a60c5240 0x5616a60baff0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f6aec0b54c0 tx=0x7f6aec02bdf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8968f5fcee39eaa0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:04:28.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.391+0000 7f6ae6a00640 1 -- 172.21.15.99:0/579543251 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aec0c1770 con 0x5616a60c5240 2024-02-21T23:04:28.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.391+0000 7f6ae6a00640 1 -- 172.21.15.99:0/579543251 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aec0d5070 con 0x5616a60c5240 2024-02-21T23:04:28.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.391+0000 7f6ae6a00640 1 -- 172.21.15.99:0/579543251 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aec03ad00 con 0x5616a60c5240 2024-02-21T23:04:28.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.392+0000 7f6b04a23740 1 -- 172.21.15.99:0/579543251 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5616a60c5240 msgr2=0x5616a60baff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:28.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.392+0000 7f6b04a23740 1 --2- 172.21.15.99:0/579543251 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5616a60c5240 0x5616a60baff0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f6aec0b54c0 tx=0x7f6aec02bdf0 comp rx=0 tx=0).stop 2024-02-21T23:04:28.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.392+0000 7f6b04a23740 1 -- 172.21.15.99:0/579543251 shutdown_connections 2024-02-21T23:04:28.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.392+0000 7f6b04a23740 1 --2- 172.21.15.99:0/579543251 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5616a60cfbc0 0x5616a60d9e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:28.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.392+0000 7f6b04a23740 1 --2- 172.21.15.99:0/579543251 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5616a60cf2a0 0x5616a6117bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:28.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.392+0000 7f6b04a23740 1 --2- 172.21.15.99:0/579543251 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5616a60c5240 0x5616a60baff0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:28.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.392+0000 7f6b04a23740 1 -- 172.21.15.99:0/579543251 >> 172.21.15.99:0/579543251 conn(0x5616a605e6b0 msgr2=0x5616a60fc5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:04:28.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.392+0000 7f6b04a23740 1 -- 172.21.15.99:0/579543251 shutdown_connections 2024-02-21T23:04:28.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.392+0000 7f6b04a23740 1 -- 172.21.15.99:0/579543251 wait complete. 2024-02-21T23:04:28.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.393+0000 7f6b04a23740 1 -- start start 2024-02-21T23:04:28.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.393+0000 7f6b04a23740 1 Processor -- start 2024-02-21T23:04:28.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.395+0000 7f6b04a23740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5616a60c5240 0x5616a6093a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:28.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.395+0000 7f6b04a23740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5616a60cf2a0 0x5616a6092880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:28.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.395+0000 7f6b04a23740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5616a60cfbc0 0x5616a6096b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:28.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.395+0000 7f6b04a23740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6afc223520 con 0x5616a60cf2a0 2024-02-21T23:04:28.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.395+0000 7f6b04a23740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6afc06f2c0 con 0x5616a60cfbc0 2024-02-21T23:04:28.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.395+0000 7f6b04a23740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6afc06e6c0 con 0x5616a60c5240 2024-02-21T23:04:28.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.395+0000 7f6b04a23740 10 client.0 _ll_register_callbacks cb 0x7f6ae80098a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:04:28.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.396+0000 7f6afaa00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5616a60c5240 0x5616a6093a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:28.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.396+0000 7f6afaa00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5616a60c5240 0x5616a6093a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:37850/0 (socket says 172.21.15.99:37850) 2024-02-21T23:04:28.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.396+0000 7f6afaa00640 1 -- 172.21.15.99:0/2452870196 learned_addr learned my addr 172.21.15.99:0/2452870196 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:04:28.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.396+0000 7f6afa000640 1 --2- 172.21.15.99:0/2452870196 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5616a60cf2a0 0x5616a6092880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:28.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.396+0000 7f6afb400640 1 --2- 172.21.15.99:0/2452870196 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5616a60cfbc0 0x5616a6096b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:28.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.396+0000 7f6afaa00640 1 -- 172.21.15.99:0/2452870196 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5616a60cfbc0 msgr2=0x5616a6096b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:04:28.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.396+0000 7f6afaa00640 1 --2- 172.21.15.99:0/2452870196 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5616a60cfbc0 0x5616a6096b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:28.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.396+0000 7f6afaa00640 1 -- 172.21.15.99:0/2452870196 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5616a60cf2a0 msgr2=0x5616a6092880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:04:28.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.396+0000 7f6afaa00640 1 --2- 172.21.15.99:0/2452870196 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5616a60cf2a0 0x5616a6092880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:28.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.396+0000 7f6afaa00640 1 -- 172.21.15.99:0/2452870196 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5616a6092dc0 con 0x5616a60c5240 2024-02-21T23:04:28.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.396+0000 7f6afb400640 1 --2- 172.21.15.99:0/2452870196 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5616a60cfbc0 0x5616a6096b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T23:04:28.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.396+0000 7f6afaa00640 1 --2- 172.21.15.99:0/2452870196 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5616a60c5240 0x5616a6093a10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f6aec0b8ff0 tx=0x7f6aec03c040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b95eef9d2a2b8de server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:04:28.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.396+0000 7f6adbe00640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-02-21T23:04:28.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.397+0000 7f6adbe00640 1 -- 172.21.15.99:0/2452870196 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aec0b9760 con 0x5616a60c5240 2024-02-21T23:04:28.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.397+0000 7f6adbe00640 1 -- 172.21.15.99:0/2452870196 <== mon.2 v2:172.21.15.181:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f6aec03ad00 con 0x5616a60c5240 2024-02-21T23:04:28.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.397+0000 7f6b04a23740 1 -- 172.21.15.99:0/2452870196 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6aec0d5070 con 0x5616a60c5240 2024-02-21T23:04:28.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.397+0000 7f6adbe00640 1 -- 172.21.15.99:0/2452870196 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6aec0c1770 con 0x5616a60c5240 2024-02-21T23:04:28.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.397+0000 7f6b04a23740 10 client.5741 fetch_fsmap learned FSMap version 16 2024-02-21T23:04:28.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.397+0000 7f6b04a23740 1 -- 172.21.15.99:0/2452870196 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x5616a6109da0 con 0x5616a60c5240 2024-02-21T23:04:28.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.397+0000 7f6adbe00640 1 -- 172.21.15.99:0/2452870196 <== mon.2 v2:172.21.15.181:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aec0d5070 con 0x5616a60c5240 2024-02-21T23:04:28.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.398+0000 7f6adbe00640 1 -- 172.21.15.99:0/2452870196 <== mon.2 v2:172.21.15.181:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f6aec0b56d0 con 0x5616a60c5240 2024-02-21T23:04:28.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.398+0000 7f6b04a23740 10 client.5741 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T23:04:28.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.398+0000 7f6b04a23740 10 client.5741 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:04:28.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.398+0000 7f6b04a23740 20 client.5741 populate_metadata read hostname 'smithi099' 2024-02-21T23:04:28.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.398+0000 7f6b04a23740 1 --2- 172.21.15.99:0/2452870196 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5616a60970c0 0x5616a61069b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:28.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.398+0000 7f6b04a23740 4 client.5741 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T23:04:28.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.398+0000 7f6b04a23740 1 -- 172.21.15.99:0/2452870196 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5616a60c6720 con 0x5616a60970c0 2024-02-21T23:04:28.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.399+0000 7f6afa000640 1 --2- 172.21.15.99:0/2452870196 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5616a60970c0 0x5616a61069b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:28.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.400+0000 7f6adbe00640 10 client.5741 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:04:28.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.400+0000 7f6afa000640 1 --2- 172.21.15.99:0/2452870196 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5616a60970c0 0x5616a61069b0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf0550aa0fd3b3fb server_cookie=9245dea109211f1f in_seq=0 out_seq=0 2024-02-21T23:04:28.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.402+0000 7f6adbe00640 1 -- 172.21.15.99:0/2452870196 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x5616a60c6720 con 0x5616a60970c0 2024-02-21T23:04:28.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.402+0000 7f6adbe00640 10 client.5741 handle_command_reply: tid=0 2024-02-21T23:04:28.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.402+0000 7f6b04a23740 1 client.5741 shutdown 2024-02-21T23:04:28.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.403+0000 7f6b04a23740 1 -- 172.21.15.99:0/2452870196 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5616a60c5240 msgr2=0x5616a6093a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:28.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.403+0000 7f6b04a23740 1 --2- 172.21.15.99:0/2452870196 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5616a60c5240 0x5616a6093a10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f6aec0b8ff0 tx=0x7f6aec03c040 comp rx=0 tx=0).stop 2024-02-21T23:04:28.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.403+0000 7f6b04a23740 1 -- 172.21.15.99:0/2452870196 shutdown_connections 2024-02-21T23:04:28.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.403+0000 7f6b04a23740 1 --2- 172.21.15.99:0/2452870196 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5616a60970c0 0x5616a61069b0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:28.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.403+0000 7f6b04a23740 1 --2- 172.21.15.99:0/2452870196 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5616a60cfbc0 0x5616a6096b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:28.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.403+0000 7f6adbe00640 0 client.5741 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:04:28.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.403+0000 7f6b04a23740 1 --2- 172.21.15.99:0/2452870196 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5616a60cf2a0 0x5616a6092880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:28.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.403+0000 7f6b04a23740 1 --2- 172.21.15.99:0/2452870196 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5616a60c5240 0x5616a6093a10 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:28.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.403+0000 7f6b04a23740 1 -- 172.21.15.99:0/2452870196 >> 172.21.15.99:0/2452870196 conn(0x5616a605e6b0 msgr2=0x5616a61725f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:04:28.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.403+0000 7f6b04a23740 1 -- 172.21.15.99:0/2452870196 shutdown_connections 2024-02-21T23:04:28.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.403+0000 7f6b04a23740 1 -- 172.21.15.99:0/2452870196 wait complete. 2024-02-21T23:04:28.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.404+0000 7f6b04a23740 20 client.5741 trim_cache size 0 max 16384 2024-02-21T23:04:28.393 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-02-21T23:04:28.393 INFO:teuthology.orchestra.run.smithi099.stdout: "status": "scrub active (186 inodes in the stack)", 2024-02-21T23:04:28.394 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubs": { 2024-02-21T23:04:28.394 INFO:teuthology.orchestra.run.smithi099.stdout: "7c2f2c86-6e63-4330-9b2b-de708a3ddb0f": { 2024-02-21T23:04:28.394 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/", 2024-02-21T23:04:28.394 INFO:teuthology.orchestra.run.smithi099.stdout: "tag": "7c2f2c86-6e63-4330-9b2b-de708a3ddb0f", 2024-02-21T23:04:28.394 INFO:teuthology.orchestra.run.smithi099.stdout: "options": "recursive,force" 2024-02-21T23:04:28.394 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:04:28.394 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:04:28.394 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-02-21T23:04:28.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.405+0000 7f6afbe00640 1 -- 172.21.15.99:0/3466062541 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f6adc09eed0 msgr2=0x7f6adc0a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:28.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.405+0000 7f6afbe00640 1 --2- 172.21.15.99:0/3466062541 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f6adc09eed0 0x7f6adc0a1390 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6afc178260 tx=0x7f6ae8008040 comp rx=0 tx=0).stop 2024-02-21T23:04:28.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.405+0000 7f6afbe00640 1 -- 172.21.15.99:0/3466062541 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6afc17f490 msgr2=0x7f6afc06c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:28.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.405+0000 7f6afbe00640 1 --2- 172.21.15.99:0/3466062541 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6afc17f490 0x7f6afc06c2e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6aec000c00 tx=0x7f6aec0046c0 comp rx=0 tx=0).stop 2024-02-21T23:04:28.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.405+0000 7f6afbe00640 1 -- 172.21.15.99:0/3466062541 shutdown_connections 2024-02-21T23:04:28.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.405+0000 7f6afbe00640 1 --2- 172.21.15.99:0/3466062541 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f6adc09eed0 0x7f6adc0a1390 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:28.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.405+0000 7f6afbe00640 1 --2- 172.21.15.99:0/3466062541 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6afc18b4f0 0x7f6afc15e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:28.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.405+0000 7f6afbe00640 1 --2- 172.21.15.99:0/3466062541 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6afc18b060 0x7f6afc06c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:28.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.405+0000 7f6afbe00640 1 --2- 172.21.15.99:0/3466062541 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6afc17f490 0x7f6afc06c2e0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:28.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.405+0000 7f6afbe00640 1 -- 172.21.15.99:0/3466062541 >> 172.21.15.99:0/3466062541 conn(0x7f6afc0d29b0 msgr2=0x7f6afc0fbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:04:28.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.405+0000 7f6afbe00640 1 -- 172.21.15.99:0/3466062541 shutdown_connections 2024-02-21T23:04:28.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:28.405+0000 7f6afbe00640 1 -- 172.21.15.99:0/3466062541 wait complete. 2024-02-21T23:04:28.412 INFO:tasks.cephfs.filesystem:scrub status for tag:7c2f2c86-6e63-4330-9b2b-de708a3ddb0f - {'path': '/', 'tag': '7c2f2c86-6e63-4330-9b2b-de708a3ddb0f', 'options': 'recursive,force'} 2024-02-21T23:04:30.359 INFO:tasks.workunit.client.0.smithi099.stdout:aclocal -I m4 2024-02-21T23:04:32.351 INFO:tasks.workunit.client.0.smithi099.stdout:autoheader 2024-02-21T23:04:32.772 INFO:tasks.workunit.client.0.smithi099.stdout:autoconf 2024-02-21T23:04:33.048 INFO:tasks.workunit.client.0.smithi099.stdout:./configure \ 2024-02-21T23:04:33.049 INFO:tasks.workunit.client.0.smithi099.stdout: --libexecdir=/usr/lib \ 2024-02-21T23:04:33.049 INFO:tasks.workunit.client.0.smithi099.stdout: --exec_prefix=/var/lib 2024-02-21T23:04:33.332 INFO:tasks.workunit.client.0.smithi099.stdout:checking build system type... x86_64-pc-linux-gnu 2024-02-21T23:04:33.332 INFO:tasks.workunit.client.0.smithi099.stdout:checking host system type... x86_64-pc-linux-gnu 2024-02-21T23:04:33.335 INFO:tasks.workunit.client.0.smithi099.stdout:checking how to print strings... printf 2024-02-21T23:04:33.335 INFO:tasks.workunit.client.0.smithi099.stdout:checking for gcc... gcc 2024-02-21T23:04:33.472 INFO:tasks.workunit.client.0.smithi099.stdout:checking whether the C compiler works... yes 2024-02-21T23:04:33.472 INFO:tasks.workunit.client.0.smithi099.stdout:checking for C compiler default output file name... a.out 2024-02-21T23:04:33.536 INFO:tasks.workunit.client.0.smithi099.stdout:checking for suffix of executables... 2024-02-21T23:04:33.602 INFO:tasks.workunit.client.0.smithi099.stdout:checking whether we are cross compiling... no 2024-02-21T23:04:33.671 INFO:tasks.workunit.client.0.smithi099.stdout:checking for suffix of object files... o 2024-02-21T23:04:33.712 INFO:tasks.workunit.client.0.smithi099.stdout:checking whether we are using the GNU C compiler... yes 2024-02-21T23:04:33.757 INFO:tasks.workunit.client.0.smithi099.stdout:checking whether gcc accepts -g... yes 2024-02-21T23:04:33.867 INFO:tasks.workunit.client.0.smithi099.stdout:checking for gcc option to accept ISO C89... none needed 2024-02-21T23:04:33.877 INFO:tasks.workunit.client.0.smithi099.stdout:checking for a sed that does not truncate output... /usr/bin/sed 2024-02-21T23:04:33.884 INFO:tasks.workunit.client.0.smithi099.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-02-21T23:04:33.888 INFO:tasks.workunit.client.0.smithi099.stdout:checking for egrep... /usr/bin/grep -E 2024-02-21T23:04:33.892 INFO:tasks.workunit.client.0.smithi099.stdout:checking for fgrep... /usr/bin/grep -F 2024-02-21T23:04:33.902 INFO:tasks.workunit.client.0.smithi099.stdout:checking for ld used by gcc... /usr/bin/ld 2024-02-21T23:04:33.907 INFO:tasks.workunit.client.0.smithi099.stdout:checking if the linker (/usr/bin/ld) is GNU ld... yes 2024-02-21T23:04:33.920 INFO:tasks.workunit.client.0.smithi099.stdout:checking for BSD- or MS-compatible name lister (nm)... /usr/bin/nm -B 2024-02-21T23:04:35.049 INFO:tasks.workunit.client.0.smithi099.stdout:checking the name lister (/usr/bin/nm -B) interface... BSD nm 2024-02-21T23:04:35.050 INFO:tasks.workunit.client.0.smithi099.stdout:checking whether ln -s works... yes 2024-02-21T23:04:35.083 INFO:tasks.workunit.client.0.smithi099.stdout:checking the maximum length of command line arguments... 1572864 2024-02-21T23:04:35.090 INFO:tasks.workunit.client.0.smithi099.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2024-02-21T23:04:35.090 INFO:tasks.workunit.client.0.smithi099.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2024-02-21T23:04:35.090 INFO:tasks.workunit.client.0.smithi099.stdout:checking for /usr/bin/ld option to reload object files... -r 2024-02-21T23:04:35.091 INFO:tasks.workunit.client.0.smithi099.stdout:checking for objdump... objdump 2024-02-21T23:04:35.091 INFO:tasks.workunit.client.0.smithi099.stdout:checking how to recognize dependent libraries... pass_all 2024-02-21T23:04:35.092 INFO:tasks.workunit.client.0.smithi099.stdout:checking for dlltool... no 2024-02-21T23:04:35.092 INFO:tasks.workunit.client.0.smithi099.stdout:checking how to associate runtime and link libraries... printf %s\n 2024-02-21T23:04:35.092 INFO:tasks.workunit.client.0.smithi099.stdout:checking for ar... ar 2024-02-21T23:04:35.233 INFO:tasks.workunit.client.0.smithi099.stdout:checking for archiver @FILE support... @ 2024-02-21T23:04:35.233 INFO:tasks.workunit.client.0.smithi099.stdout:checking for strip... strip 2024-02-21T23:04:35.234 INFO:tasks.workunit.client.0.smithi099.stdout:checking for ranlib... ranlib 2024-02-21T23:04:35.234 INFO:tasks.workunit.client.0.smithi099.stdout:checking for gawk... gawk 2024-02-21T23:04:35.444 INFO:tasks.workunit.client.0.smithi099.stdout:checking command to parse /usr/bin/nm -B output from gcc object... ok 2024-02-21T23:04:35.450 INFO:tasks.workunit.client.0.smithi099.stdout:checking for sysroot... no 2024-02-21T23:04:35.467 INFO:tasks.workunit.client.0.smithi099.stdout:checking for a working dd... /usr/bin/dd 2024-02-21T23:04:35.481 INFO:tasks.workunit.client.0.smithi099.stdout:checking how to truncate binary pipes... /usr/bin/dd bs=4096 count=1 2024-02-21T23:04:35.951 INFO:tasks.workunit.client.0.smithi099.stdout:checking for mt... no 2024-02-21T23:04:35.974 INFO:tasks.workunit.client.0.smithi099.stdout:checking if : is a manifest tool... no 2024-02-21T23:04:38.855 INFO:tasks.workunit.client.0.smithi099.stdout:checking how to run the C preprocessor... gcc -E 2024-02-21T23:04:40.975 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:04:40.983 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:04:40.986 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:04:42.058 INFO:tasks.workunit.client.0.smithi099.stdout:checking for ANSI C header files... yes 2024-02-21T23:04:46.536 INFO:tasks.workunit.client.0.smithi099.stdout:checking for sys/types.h... yes 2024-02-21T23:04:46.623 INFO:tasks.workunit.client.0.smithi099.stdout:checking for sys/stat.h... yes 2024-02-21T23:04:46.699 INFO:tasks.workunit.client.0.smithi099.stdout:checking for stdlib.h... yes 2024-02-21T23:04:46.779 INFO:tasks.workunit.client.0.smithi099.stdout:checking for string.h... yes 2024-02-21T23:04:46.871 INFO:tasks.workunit.client.0.smithi099.stdout:checking for memory.h... yes 2024-02-21T23:04:46.967 INFO:tasks.workunit.client.0.smithi099.stdout:checking for strings.h... yes 2024-02-21T23:04:47.070 INFO:tasks.workunit.client.0.smithi099.stdout:checking for inttypes.h... yes 2024-02-21T23:04:47.159 INFO:tasks.workunit.client.0.smithi099.stdout:checking for stdint.h... yes 2024-02-21T23:04:47.242 INFO:tasks.workunit.client.0.smithi099.stdout:checking for unistd.h... yes 2024-02-21T23:04:47.324 INFO:tasks.workunit.client.0.smithi099.stdout:checking for dlfcn.h... yes 2024-02-21T23:04:47.337 INFO:tasks.workunit.client.0.smithi099.stdout:checking for objdir... .libs 2024-02-21T23:04:47.548 INFO:tasks.workunit.client.0.smithi099.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2024-02-21T23:04:47.549 INFO:tasks.workunit.client.0.smithi099.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2024-02-21T23:04:47.623 INFO:tasks.workunit.client.0.smithi099.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2024-02-21T23:04:47.690 INFO:tasks.workunit.client.0.smithi099.stdout:checking if gcc static flag -static works... no 2024-02-21T23:04:47.792 INFO:tasks.workunit.client.0.smithi099.stdout:checking if gcc supports -c -o file.o... yes 2024-02-21T23:04:47.792 INFO:tasks.workunit.client.0.smithi099.stdout:checking if gcc supports -c -o file.o... (cached) yes 2024-02-21T23:04:47.814 INFO:tasks.workunit.client.0.smithi099.stdout:checking whether the gcc linker (/usr/bin/ld -m elf_x86_64) supports shared libraries... yes 2024-02-21T23:04:47.895 INFO:tasks.workunit.client.0.smithi099.stdout:checking whether -lc should be explicitly linked in... no 2024-02-21T23:04:48.054 INFO:tasks.workunit.client.0.smithi099.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2024-02-21T23:04:48.054 INFO:tasks.workunit.client.0.smithi099.stdout:checking how to hardcode library paths into programs... immediate 2024-02-21T23:04:48.059 INFO:tasks.workunit.client.0.smithi099.stdout:checking whether stripping libraries is possible... yes 2024-02-21T23:04:48.059 INFO:tasks.workunit.client.0.smithi099.stdout:checking if libtool supports shared libraries... yes 2024-02-21T23:04:48.059 INFO:tasks.workunit.client.0.smithi099.stdout:checking whether to build shared libraries... yes 2024-02-21T23:04:48.059 INFO:tasks.workunit.client.0.smithi099.stdout:checking whether to build static libraries... yes 2024-02-21T23:04:48.077 INFO:tasks.workunit.client.0.smithi099.stdout:checking for gcc... (cached) gcc 2024-02-21T23:04:48.130 INFO:tasks.workunit.client.0.smithi099.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-02-21T23:04:48.130 INFO:tasks.workunit.client.0.smithi099.stdout:checking whether gcc accepts -g... (cached) yes 2024-02-21T23:04:48.130 INFO:tasks.workunit.client.0.smithi099.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-02-21T23:04:48.130 INFO:tasks.workunit.client.0.smithi099.stdout:checking for gmake... /usr/bin/gmake 2024-02-21T23:04:48.131 INFO:tasks.workunit.client.0.smithi099.stderr:./configure: line 11968: test: $(SHELL): binary operator expected 2024-02-21T23:04:48.131 INFO:tasks.workunit.client.0.smithi099.stdout:checking for tar... /bin/tar 2024-02-21T23:04:48.131 INFO:tasks.workunit.client.0.smithi099.stdout:checking for gzip... /bin/gzip 2024-02-21T23:04:48.183 INFO:tasks.workunit.client.0.smithi099.stdout:checking whether gcc -MM is supported... yes 2024-02-21T23:04:48.184 INFO:tasks.workunit.client.0.smithi099.stdout:checking for sort... /bin/sort 2024-02-21T23:04:48.184 INFO:tasks.workunit.client.0.smithi099.stdout:checking whether ln -s works... yes 2024-02-21T23:04:48.184 INFO:tasks.workunit.client.0.smithi099.stdout:checking for rpm... /bin/rpm 2024-02-21T23:04:48.196 INFO:tasks.workunit.client.0.smithi099.stdout:checking for rpmbuild... no 2024-02-21T23:04:48.196 INFO:tasks.workunit.client.0.smithi099.stdout:checking for ANSI C header files... (cached) yes 2024-02-21T23:04:48.279 INFO:tasks.workunit.client.0.smithi099.stdout:checking assert.h usability... yes 2024-02-21T23:04:48.313 INFO:tasks.workunit.client.0.smithi099.stdout:checking assert.h presence... yes 2024-02-21T23:04:48.313 INFO:tasks.workunit.client.0.smithi099.stdout:checking for assert.h... yes 2024-02-21T23:04:48.403 INFO:tasks.workunit.client.0.smithi099.stdout:checking bstring.h usability... no 2024-02-21T23:04:48.459 INFO:tasks.workunit.client.0.smithi099.stdout:checking bstring.h presence... no 2024-02-21T23:04:48.459 INFO:tasks.workunit.client.0.smithi099.stdout:checking for bstring.h... no 2024-02-21T23:04:48.531 INFO:tasks.workunit.client.0.smithi099.stdout:checking libgen.h usability... yes 2024-02-21T23:04:48.559 INFO:tasks.workunit.client.0.smithi099.stdout:checking libgen.h presence... yes 2024-02-21T23:04:48.559 INFO:tasks.workunit.client.0.smithi099.stdout:checking for libgen.h... yes 2024-02-21T23:04:48.667 INFO:tasks.workunit.client.0.smithi099.stdout:checking dirent.h usability... yes 2024-02-21T23:04:48.699 INFO:tasks.workunit.client.0.smithi099.stdout:checking dirent.h presence... yes 2024-02-21T23:04:48.700 INFO:tasks.workunit.client.0.smithi099.stdout:checking for dirent.h... yes 2024-02-21T23:04:48.793 INFO:tasks.workunit.client.0.smithi099.stdout:checking errno.h usability... yes 2024-02-21T23:04:48.829 INFO:tasks.workunit.client.0.smithi099.stdout:checking errno.h presence... yes 2024-02-21T23:04:48.830 INFO:tasks.workunit.client.0.smithi099.stdout:checking for errno.h... yes 2024-02-21T23:04:48.932 INFO:tasks.workunit.client.0.smithi099.stdout:checking malloc.h usability... yes 2024-02-21T23:04:48.968 INFO:tasks.workunit.client.0.smithi099.stdout:checking malloc.h presence... yes 2024-02-21T23:04:48.968 INFO:tasks.workunit.client.0.smithi099.stdout:checking for malloc.h... yes 2024-02-21T23:04:49.061 INFO:tasks.workunit.client.0.smithi099.stdout:checking uuid.h usability... no 2024-02-21T23:04:49.120 INFO:tasks.workunit.client.0.smithi099.stdout:checking uuid.h presence... no 2024-02-21T23:04:49.121 INFO:tasks.workunit.client.0.smithi099.stdout:checking for uuid.h... no 2024-02-21T23:04:49.199 INFO:tasks.workunit.client.0.smithi099.stdout:checking uuid/uuid.h usability... yes 2024-02-21T23:04:49.237 INFO:tasks.workunit.client.0.smithi099.stdout:checking uuid/uuid.h presence... yes 2024-02-21T23:04:49.237 INFO:tasks.workunit.client.0.smithi099.stdout:checking for uuid/uuid.h... yes 2024-02-21T23:04:49.330 INFO:tasks.workunit.client.0.smithi099.stdout:checking sys/uuid.h usability... no 2024-02-21T23:04:49.375 INFO:tasks.workunit.client.0.smithi099.stdout:checking sys/uuid.h presence... no 2024-02-21T23:04:49.375 INFO:tasks.workunit.client.0.smithi099.stdout:checking for sys/uuid.h... no 2024-02-21T23:04:49.456 INFO:tasks.workunit.client.0.smithi099.stdout:checking sys/file.h usability... yes 2024-02-21T23:04:49.486 INFO:tasks.workunit.client.0.smithi099.stdout:checking sys/file.h presence... yes 2024-02-21T23:04:49.487 INFO:tasks.workunit.client.0.smithi099.stdout:checking for sys/file.h... yes 2024-02-21T23:04:49.583 INFO:tasks.workunit.client.0.smithi099.stdout:checking sys/fcntl.h usability... yes 2024-02-21T23:04:49.609 INFO:tasks.workunit.client.0.smithi099.stdout:checking sys/fcntl.h presence... yes 2024-02-21T23:04:49.610 INFO:tasks.workunit.client.0.smithi099.stdout:checking for sys/fcntl.h... yes 2024-02-21T23:04:49.700 INFO:tasks.workunit.client.0.smithi099.stdout:checking sys/syssgi.h usability... no 2024-02-21T23:04:49.746 INFO:tasks.workunit.client.0.smithi099.stdout:checking sys/syssgi.h presence... no 2024-02-21T23:04:49.746 INFO:tasks.workunit.client.0.smithi099.stdout:checking for sys/syssgi.h... no 2024-02-21T23:04:49.896 INFO:tasks.workunit.client.0.smithi099.stdout:checking sys/param.h usability... yes 2024-02-21T23:04:49.927 INFO:tasks.workunit.client.0.smithi099.stdout:checking sys/param.h presence... yes 2024-02-21T23:04:49.928 INFO:tasks.workunit.client.0.smithi099.stdout:checking for sys/param.h... yes 2024-02-21T23:04:49.960 INFO:tasks.workunit.client.0.smithi099.stdout:checking for sys/stat.h... (cached) yes 2024-02-21T23:04:50.051 INFO:tasks.workunit.client.0.smithi099.stdout:checking sys/statvfs.h usability... yes 2024-02-21T23:04:50.081 INFO:tasks.workunit.client.0.smithi099.stdout:checking sys/statvfs.h presence... yes 2024-02-21T23:04:50.081 INFO:tasks.workunit.client.0.smithi099.stdout:checking for sys/statvfs.h... yes 2024-02-21T23:04:50.166 INFO:tasks.workunit.client.0.smithi099.stdout:checking sys/time.h usability... yes 2024-02-21T23:04:50.192 INFO:tasks.workunit.client.0.smithi099.stdout:checking sys/time.h presence... yes 2024-02-21T23:04:50.192 INFO:tasks.workunit.client.0.smithi099.stdout:checking for sys/time.h... yes 2024-02-21T23:04:50.274 INFO:tasks.workunit.client.0.smithi099.stdout:checking sys/ioctl.h usability... yes 2024-02-21T23:04:50.302 INFO:tasks.workunit.client.0.smithi099.stdout:checking sys/ioctl.h presence... yes 2024-02-21T23:04:50.302 INFO:tasks.workunit.client.0.smithi099.stdout:checking for sys/ioctl.h... yes 2024-02-21T23:04:50.405 INFO:tasks.workunit.client.0.smithi099.stdout:checking sys/wait.h usability... yes 2024-02-21T23:04:50.434 INFO:tasks.workunit.client.0.smithi099.stdout:checking sys/wait.h presence... yes 2024-02-21T23:04:50.435 INFO:tasks.workunit.client.0.smithi099.stdout:checking for sys/wait.h... yes 2024-02-21T23:04:50.460 INFO:tasks.workunit.client.0.smithi099.stdout:checking for sys/types.h... (cached) yes 2024-02-21T23:04:50.478 INFO:tasks.workunit.client.0.smithi099.stdout:checking for strings.h... (cached) yes 2024-02-21T23:04:50.548 INFO:tasks.workunit.client.0.smithi099.stdout:checking err.h usability... yes 2024-02-21T23:04:50.583 INFO:tasks.workunit.client.0.smithi099.stdout:checking err.h presence... yes 2024-02-21T23:04:50.583 INFO:tasks.workunit.client.0.smithi099.stdout:checking for err.h... yes 2024-02-21T23:04:50.672 INFO:tasks.workunit.client.0.smithi099.stdout:checking linux/falloc.h usability... yes 2024-02-21T23:04:50.697 INFO:tasks.workunit.client.0.smithi099.stdout:checking linux/falloc.h presence... yes 2024-02-21T23:04:50.697 INFO:tasks.workunit.client.0.smithi099.stdout:checking for linux/falloc.h... yes 2024-02-21T23:04:50.797 INFO:tasks.workunit.client.0.smithi099.stdout:checking sys/fs/xfs_fsops.h usability... no 2024-02-21T23:04:50.844 INFO:tasks.workunit.client.0.smithi099.stdout:checking sys/fs/xfs_fsops.h presence... no 2024-02-21T23:04:50.844 INFO:tasks.workunit.client.0.smithi099.stdout:checking for sys/fs/xfs_fsops.h... no 2024-02-21T23:04:50.922 INFO:tasks.workunit.client.0.smithi099.stdout:checking sys/fs/xfs_itable.h usability... no 2024-02-21T23:04:50.967 INFO:tasks.workunit.client.0.smithi099.stdout:checking sys/fs/xfs_itable.h presence... no 2024-02-21T23:04:50.967 INFO:tasks.workunit.client.0.smithi099.stdout:checking for sys/fs/xfs_itable.h... no 2024-02-21T23:04:51.044 INFO:tasks.workunit.client.0.smithi099.stdout:checking xfs/platform_defs.h usability... no 2024-02-21T23:04:51.089 INFO:tasks.workunit.client.0.smithi099.stdout:checking xfs/platform_defs.h presence... no 2024-02-21T23:04:51.089 INFO:tasks.workunit.client.0.smithi099.stdout:checking for xfs/platform_defs.h... no 2024-02-21T23:04:51.167 INFO:tasks.workunit.client.0.smithi099.stdout:checking btrfs/ioctl.h usability... no 2024-02-21T23:04:51.208 INFO:tasks.workunit.client.0.smithi099.stdout:checking btrfs/ioctl.h presence... no 2024-02-21T23:04:51.208 INFO:tasks.workunit.client.0.smithi099.stdout:checking for btrfs/ioctl.h... no 2024-02-21T23:04:51.301 INFO:tasks.workunit.client.0.smithi099.stdout:checking cifs/ioctl.h usability... no 2024-02-21T23:04:51.347 INFO:tasks.workunit.client.0.smithi099.stdout:checking cifs/ioctl.h presence... no 2024-02-21T23:04:51.347 INFO:tasks.workunit.client.0.smithi099.stdout:checking for cifs/ioctl.h... no 2024-02-21T23:04:51.421 INFO:tasks.workunit.client.0.smithi099.stdout:checking sys/mman.h usability... yes 2024-02-21T23:04:51.454 INFO:tasks.workunit.client.0.smithi099.stdout:checking sys/mman.h presence... yes 2024-02-21T23:04:51.454 INFO:tasks.workunit.client.0.smithi099.stdout:checking for sys/mman.h... yes 2024-02-21T23:04:51.518 INFO:tasks.workunit.client.0.smithi099.stdout:checking for xfs/xfs_log_format.h... no 2024-02-21T23:04:51.626 INFO:tasks.workunit.client.0.smithi099.stdout:checking for uuid_compare... no 2024-02-21T23:04:51.721 INFO:tasks.workunit.client.0.smithi099.stdout:checking for uuid_compare in -luuid... yes 2024-02-21T23:04:51.865 INFO:tasks.workunit.client.0.smithi099.stdout:checking for xfs/xfs.h... yes 2024-02-21T23:04:51.927 INFO:tasks.workunit.client.0.smithi099.stdout:checking for xfs/libxfs.h... no 2024-02-21T23:04:51.986 INFO:tasks.workunit.client.0.smithi099.stdout:checking whether xlog_assign_lsn is declared... no 2024-02-21T23:04:52.073 INFO:tasks.workunit.client.0.smithi099.stdout:checking for xfs/xqm.h... yes 2024-02-21T23:04:52.182 INFO:tasks.workunit.client.0.smithi099.stdout:checking xfsctl from xfs/xfs.h... ok 2024-02-21T23:04:52.279 INFO:tasks.workunit.client.0.smithi099.stdout:checking xfs/handle.h usability... yes 2024-02-21T23:04:52.315 INFO:tasks.workunit.client.0.smithi099.stdout:checking xfs/handle.h presence... yes 2024-02-21T23:04:52.315 INFO:tasks.workunit.client.0.smithi099.stdout:checking for xfs/handle.h... yes 2024-02-21T23:04:52.390 INFO:tasks.workunit.client.0.smithi099.stdout:checking for attr_list_by_handle in -lhandle... yes 2024-02-21T23:04:52.510 INFO:tasks.workunit.client.0.smithi099.stdout:checking attr/attributes.h usability... yes 2024-02-21T23:04:52.544 INFO:tasks.workunit.client.0.smithi099.stdout:checking attr/attributes.h presence... yes 2024-02-21T23:04:52.544 INFO:tasks.workunit.client.0.smithi099.stdout:checking for attr/attributes.h... yes 2024-02-21T23:04:52.642 INFO:tasks.workunit.client.0.smithi099.stdout:checking sys/attributes.h usability... no 2024-02-21T23:04:52.686 INFO:tasks.workunit.client.0.smithi099.stdout:checking sys/attributes.h presence... no 2024-02-21T23:04:52.686 INFO:tasks.workunit.client.0.smithi099.stdout:checking for sys/attributes.h... no 2024-02-21T23:04:52.770 INFO:tasks.workunit.client.0.smithi099.stdout:checking for attr_list in -lattr... yes 2024-02-21T23:04:52.845 INFO:tasks.workunit.client.0.smithi099.stdout:checking for attr_set in -lattr... yes 2024-02-21T23:04:52.939 INFO:tasks.workunit.client.0.smithi099.stdout:checking sys/acl.h usability... yes 2024-02-21T23:04:52.971 INFO:tasks.workunit.client.0.smithi099.stdout:checking sys/acl.h presence... yes 2024-02-21T23:04:52.971 INFO:tasks.workunit.client.0.smithi099.stdout:checking for sys/acl.h... yes 2024-02-21T23:04:53.033 INFO:tasks.workunit.client.0.smithi099.stdout:checking acl/libacl.h usability... yes 2024-02-21T23:04:53.060 INFO:tasks.workunit.client.0.smithi099.stdout:checking acl/libacl.h presence... yes 2024-02-21T23:04:53.060 INFO:tasks.workunit.client.0.smithi099.stdout:checking for acl/libacl.h... yes 2024-02-21T23:04:53.151 INFO:tasks.workunit.client.0.smithi099.stdout:checking for acl_init in -lacl... yes 2024-02-21T23:04:53.217 INFO:tasks.workunit.client.0.smithi099.stdout:checking gdbm-ndbm.h usability... no 2024-02-21T23:04:53.261 INFO:tasks.workunit.client.0.smithi099.stdout:checking gdbm-ndbm.h presence... no 2024-02-21T23:04:53.261 INFO:tasks.workunit.client.0.smithi099.stdout:checking for gdbm-ndbm.h... no 2024-02-21T23:04:53.321 INFO:tasks.workunit.client.0.smithi099.stdout:checking gdbm/ndbm.h usability... no 2024-02-21T23:04:53.366 INFO:tasks.workunit.client.0.smithi099.stdout:checking gdbm/ndbm.h presence... no 2024-02-21T23:04:53.366 INFO:tasks.workunit.client.0.smithi099.stdout:checking for gdbm/ndbm.h... no 2024-02-21T23:04:53.443 INFO:tasks.workunit.client.0.smithi099.stdout:checking ndbm.h usability... no 2024-02-21T23:04:53.507 INFO:tasks.workunit.client.0.smithi099.stdout:checking ndbm.h presence... no 2024-02-21T23:04:53.507 INFO:tasks.workunit.client.0.smithi099.stdout:checking for ndbm.h... no 2024-02-21T23:04:53.583 INFO:tasks.workunit.client.0.smithi099.stdout:checking libaio.h usability... yes 2024-02-21T23:04:53.625 INFO:tasks.workunit.client.0.smithi099.stdout:checking libaio.h presence... yes 2024-02-21T23:04:53.625 INFO:tasks.workunit.client.0.smithi099.stdout:checking for libaio.h... yes 2024-02-21T23:04:53.706 INFO:tasks.workunit.client.0.smithi099.stdout:checking for dm_make_handle in -ldm... no 2024-02-21T23:04:53.707 INFO:tasks.workunit.client.0.smithi099.stdout: 2024-02-21T23:04:53.707 INFO:tasks.workunit.client.0.smithi099.stdout:WARNING: could not find a valid DMAPI base library. 2024-02-21T23:04:53.707 INFO:tasks.workunit.client.0.smithi099.stdout:If you want DMAPI support please install the data migration 2024-02-21T23:04:53.707 INFO:tasks.workunit.client.0.smithi099.stdout:API (dmapi) library package. Alternatively, run "make install" 2024-02-21T23:04:53.707 INFO:tasks.workunit.client.0.smithi099.stdout:from the dmapi source. 2024-02-21T23:04:53.707 INFO:tasks.workunit.client.0.smithi099.stdout: 2024-02-21T23:04:53.768 INFO:tasks.workunit.client.0.smithi099.stdout:checking linux/fiemap.h usability... yes 2024-02-21T23:04:53.795 INFO:tasks.workunit.client.0.smithi099.stdout:checking linux/fiemap.h presence... yes 2024-02-21T23:04:53.796 INFO:tasks.workunit.client.0.smithi099.stdout:checking for linux/fiemap.h... yes 2024-02-21T23:04:53.869 INFO:tasks.workunit.client.0.smithi099.stdout:checking for fallocate... yes 2024-02-21T23:04:53.958 INFO:tasks.workunit.client.0.smithi099.stdout:checking for open_by_handle_at... yes 2024-02-21T23:04:54.062 INFO:tasks.workunit.client.0.smithi099.stdout:checking sys/prctl.h usability... yes 2024-02-21T23:04:54.097 INFO:tasks.workunit.client.0.smithi099.stdout:checking sys/prctl.h presence... yes 2024-02-21T23:04:54.097 INFO:tasks.workunit.client.0.smithi099.stdout:checking for sys/prctl.h... yes 2024-02-21T23:04:54.163 INFO:tasks.workunit.client.0.smithi099.stdout:checking linux/fs.h usability... yes 2024-02-21T23:04:54.190 INFO:tasks.workunit.client.0.smithi099.stdout:checking linux/fs.h presence... yes 2024-02-21T23:04:54.190 INFO:tasks.workunit.client.0.smithi099.stdout:checking for linux/fs.h... yes 2024-02-21T23:04:54.295 INFO:tasks.workunit.client.0.smithi099.stdout:checking btrfsutil.h usability... no 2024-02-21T23:04:54.341 INFO:tasks.workunit.client.0.smithi099.stdout:checking btrfsutil.h presence... no 2024-02-21T23:04:54.341 INFO:tasks.workunit.client.0.smithi099.stdout:checking for btrfsutil.h... no 2024-02-21T23:04:54.439 INFO:tasks.workunit.client.0.smithi099.stdout:checking for copy_file_range... yes 2024-02-21T23:04:54.545 INFO:tasks.workunit.client.0.smithi099.stdout:checking for renameat2... yes 2024-02-21T23:04:54.593 INFO:tasks.workunit.client.0.smithi099.stdout:configure: creating ./config.status 2024-02-21T23:04:55.659 INFO:tasks.workunit.client.0.smithi099.stdout:config.status: creating include/builddefs 2024-02-21T23:04:55.707 INFO:tasks.workunit.client.0.smithi099.stdout:config.status: creating include/config.h 2024-02-21T23:04:55.732 INFO:tasks.workunit.client.0.smithi099.stdout:config.status: executing libtool commands 2024-02-21T23:04:55.866 INFO:tasks.workunit.client.0.smithi099.stdout:Building include 2024-02-21T23:04:55.866 INFO:tasks.workunit.client.0.smithi099.stdout:Building lib 2024-02-21T23:04:55.868 INFO:tasks.workunit.client.0.smithi099.stdout:Building tests 2024-02-21T23:04:55.876 INFO:tasks.workunit.client.0.smithi099.stdout: [LTDEP] 2024-02-21T23:04:56.246 INFO:tasks.workunit.client.0.smithi099.stdout: [CC] databin.lo 2024-02-21T23:04:56.246 INFO:tasks.workunit.client.0.smithi099.stdout: [CC] dataascii.lo 2024-02-21T23:04:56.248 INFO:tasks.workunit.client.0.smithi099.stdout: [CC] datapid.lo 2024-02-21T23:04:56.248 INFO:tasks.workunit.client.0.smithi099.stdout: [CC] file_lock.lo 2024-02-21T23:04:56.552 INFO:tasks.workunit.client.0.smithi099.stdout: [CC] forker.lo 2024-02-21T23:04:56.575 INFO:tasks.workunit.client.0.smithi099.stdout: [CC] pattern.lo 2024-02-21T23:04:56.645 INFO:tasks.workunit.client.0.smithi099.stdout: [CC] open_flags.lo 2024-02-21T23:04:56.667 INFO:tasks.workunit.client.0.smithi099.stdout: [CC] random_range.lo 2024-02-21T23:04:56.910 INFO:tasks.workunit.client.0.smithi099.stdout: [CC] string_to_tokens.lo 2024-02-21T23:04:56.911 INFO:tasks.workunit.client.0.smithi099.stdout: [CC] str_to_bytes.lo 2024-02-21T23:04:57.030 INFO:tasks.workunit.client.0.smithi099.stdout: [CC] tlibio.lo 2024-02-21T23:04:57.157 INFO:tasks.workunit.client.0.smithi099.stdout: [CC] write_log.lo 2024-02-21T23:04:57.203 INFO:tasks.workunit.client.0.smithi099.stdout: [CC] random.lo 2024-02-21T23:04:57.575 INFO:tasks.workunit.client.0.smithi099.stdout: [LD] 2024-02-21T23:04:57.816 INFO:tasks.workunit.client.0.smithi099.stdout:Building src 2024-02-21T23:04:57.817 INFO:tasks.workunit.client.0.smithi099.stdout:Building common 2024-02-21T23:04:57.817 INFO:tasks.workunit.client.0.smithi099.stdout:Building ltp 2024-02-21T23:04:57.817 INFO:tasks.workunit.client.0.smithi099.stdout:Building m4 2024-02-21T23:04:57.831 INFO:tasks.workunit.client.0.smithi099.stdout: [DEP] 2024-02-21T23:04:57.845 INFO:tasks.workunit.client.0.smithi099.stdout: [DEP] 2024-02-21T23:04:58.304 INFO:tasks.workunit.client.0.smithi099.stdout: [CC] fsstress 2024-02-21T23:04:58.305 INFO:tasks.workunit.client.0.smithi099.stdout: [CC] doio 2024-02-21T23:04:58.306 INFO:tasks.workunit.client.0.smithi099.stdout: [CC] fsx 2024-02-21T23:04:58.413 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T23:04:58.413 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T23:04:58.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.711+0000 7f3267e00640 1 Processor -- start 2024-02-21T23:04:58.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.711+0000 7f3267e00640 1 -- start start 2024-02-21T23:04:58.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.714+0000 7f3267e00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f326018ff80 0x7f326018e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:58.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.714+0000 7f3267e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f3260190610 0x7f3260190a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:58.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.714+0000 7f3267e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f326018ec00 con 0x7f326018a9b0 2024-02-21T23:04:58.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.714+0000 7f3267e00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3260190410 con 0x7f3260190610 2024-02-21T23:04:58.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.714+0000 7f3267e00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f326018eee0 con 0x7f326018ff80 2024-02-21T23:04:58.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.716+0000 7f3265400640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f326018a9b0 0x7f326018af90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.99:59676/0 (socket says 172.21.15.99:59676) 2024-02-21T23:04:58.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.716+0000 7f3265400640 1 -- 172.21.15.99:0/3187231016 learned_addr learned my addr 172.21.15.99:0/3187231016 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:04:58.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.716+0000 7f3264a00640 1 --2- 172.21.15.99:0/3187231016 >> v2:172.21.15.181:3300/0 conn(0x7f326018ff80 0x7f326018e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:58.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.716+0000 7f325fe00640 1 -- 172.21.15.99:0/3187231016 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 998036910 0 0) 0x7f326018ec00 con 0x7f326018a9b0 2024-02-21T23:04:58.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.717+0000 7f325fe00640 1 -- 172.21.15.99:0/3187231016 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3248003520 con 0x7f326018a9b0 2024-02-21T23:04:58.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.717+0000 7f325fe00640 1 -- 172.21.15.99:0/3187231016 <== mon.1 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1113897898 0 0) 0x7f3248003520 con 0x7f326018a9b0 2024-02-21T23:04:58.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.717+0000 7f325fe00640 1 -- 172.21.15.99:0/3187231016 >> v2:172.21.15.181:3300/0 conn(0x7f326018ff80 msgr2=0x7f326018e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:04:58.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.717+0000 7f325fe00640 1 --2- 172.21.15.99:0/3187231016 >> v2:172.21.15.181:3300/0 conn(0x7f326018ff80 0x7f326018e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:58.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.717+0000 7f325fe00640 1 -- 172.21.15.99:0/3187231016 >> v2:172.21.15.99:3300/0 conn(0x7f3260190610 msgr2=0x7f3260190a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:04:58.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.717+0000 7f325fe00640 1 --2- 172.21.15.99:0/3187231016 >> v2:172.21.15.99:3300/0 conn(0x7f3260190610 0x7f3260190a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:58.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.717+0000 7f325fe00640 1 -- 172.21.15.99:0/3187231016 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f326018f1c0 con 0x7f326018a9b0 2024-02-21T23:04:58.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.717+0000 7f325fe00640 1 -- 172.21.15.99:0/3187231016 <== mon.1 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2069890144 0 0) 0x7f324c001670 con 0x7f326018a9b0 2024-02-21T23:04:58.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.717+0000 7f325fe00640 1 -- 172.21.15.99:0/3187231016 >> v1:172.21.15.162:6789/0 conn(0x7f326018a9b0 legacy=0x7f326018af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:58.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.717+0000 7f325fe00640 1 --2- 172.21.15.99:0/3187231016 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3248003a00 0x7f3248003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:58.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.718+0000 7f325fe00640 1 --2- 172.21.15.99:0/3187231016 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3248004800 0x7f3248004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:58.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.718+0000 7f325fe00640 1 --2- 172.21.15.99:0/3187231016 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32480052e0 0x7f324800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:58.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.718+0000 7f325fe00640 1 -- 172.21.15.99:0/3187231016 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f326018eee0 con 0x7f32480052e0 2024-02-21T23:04:58.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.718+0000 7f325fe00640 1 -- 172.21.15.99:0/3187231016 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f324800c1e0 con 0x7f3248004800 2024-02-21T23:04:58.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.718+0000 7f325fe00640 1 -- 172.21.15.99:0/3187231016 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f324800c3e0 con 0x7f3248003a00 2024-02-21T23:04:58.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.718+0000 7f3265e00640 1 --2- 172.21.15.99:0/3187231016 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32480052e0 0x7f324800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:58.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.718+0000 7f3265400640 1 --2- 172.21.15.99:0/3187231016 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3248003a00 0x7f3248003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:58.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.719+0000 7f3265400640 1 -- 172.21.15.99:0/3187231016 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3248004800 msgr2=0x7f3248004c80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T23:04:58.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.719+0000 7f3265400640 1 --2- 172.21.15.99:0/3187231016 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3248004800 0x7f3248004c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:58.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.719+0000 7f3265400640 1 -- 172.21.15.99:0/3187231016 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32480052e0 msgr2=0x7f324800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:04:58.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.719+0000 7f3265400640 1 --2- 172.21.15.99:0/3187231016 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32480052e0 0x7f324800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:58.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.719+0000 7f3265400640 1 -- 172.21.15.99:0/3187231016 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f326018f1c0 con 0x7f3248003a00 2024-02-21T23:04:58.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.719+0000 7f3265e00640 1 -- 172.21.15.99:0/3187231016 reap_dead start 2024-02-21T23:04:58.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.721+0000 7f3265400640 1 --2- 172.21.15.99:0/3187231016 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3248003a00 0x7f3248003e20 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f324c00c260 tx=0x7f3248005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=656966e1401e904e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:04:58.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.721+0000 7f325fe00640 1 -- 172.21.15.99:0/3187231016 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324c007d70 con 0x7f3248003a00 2024-02-21T23:04:58.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.721+0000 7f325fe00640 1 -- 172.21.15.99:0/3187231016 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f324c030070 con 0x7f3248003a00 2024-02-21T23:04:58.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.722+0000 7f3267e00640 1 -- 172.21.15.99:0/3187231016 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3248003a00 msgr2=0x7f3248003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:58.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.722+0000 7f325fe00640 1 -- 172.21.15.99:0/3187231016 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324c007d70 con 0x7f3248003a00 2024-02-21T23:04:58.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.722+0000 7f3267e00640 1 --2- 172.21.15.99:0/3187231016 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3248003a00 0x7f3248003e20 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f324c00c260 tx=0x7f3248005830 comp rx=0 tx=0).stop 2024-02-21T23:04:58.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.722+0000 7f3267e00640 1 -- 172.21.15.99:0/3187231016 shutdown_connections 2024-02-21T23:04:58.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.722+0000 7f3267e00640 1 --2- 172.21.15.99:0/3187231016 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3248003a00 0x7f3248003e20 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:58.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.722+0000 7f3267e00640 1 -- 172.21.15.99:0/3187231016 >> 172.21.15.99:0/3187231016 conn(0x7f32600ce5f0 msgr2=0x7f32600cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:04:58.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.722+0000 7f3267e00640 1 -- 172.21.15.99:0/3187231016 shutdown_connections 2024-02-21T23:04:58.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.722+0000 7f3267e00640 1 -- 172.21.15.99:0/3187231016 wait complete. 2024-02-21T23:04:58.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.728+0000 7f3267e00640 1 Processor -- start 2024-02-21T23:04:58.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.728+0000 7f3267e00640 1 -- start start 2024-02-21T23:04:58.720 INFO:tasks.workunit.client.0.smithi099.stderr:fsstress.c: In function 'attr_list_path': 2024-02-21T23:04:58.720 INFO:tasks.workunit.client.0.smithi099.stderr:fsstress.c:859:9: warning: 'attr_list' is deprecated: Use listxattr or llistxattr instead [-Wdeprecated-declarations] 2024-02-21T23:04:58.720 INFO:tasks.workunit.client.0.smithi099.stderr: 859 | rval = attr_list(name->path, buffer, buffersize, flags, cursor); 2024-02-21T23:04:58.721 INFO:tasks.workunit.client.0.smithi099.stderr: | ^~~~ 2024-02-21T23:04:58.721 INFO:tasks.workunit.client.0.smithi099.stderr:In file included from ../src/global.h:25, 2024-02-21T23:04:58.721 INFO:tasks.workunit.client.0.smithi099.stderr: from fsstress.c:12: 2024-02-21T23:04:58.721 INFO:tasks.workunit.client.0.smithi099.stderr:/usr/include/attr/attributes.h:165:12: note: declared here 2024-02-21T23:04:58.721 INFO:tasks.workunit.client.0.smithi099.stderr: 165 | extern int attr_list(const char *__path, char *__buffer, const int __buffersize, 2024-02-21T23:04:58.721 INFO:tasks.workunit.client.0.smithi099.stderr: | ^~~~~~~~~ 2024-02-21T23:04:58.721 INFO:tasks.workunit.client.0.smithi099.stderr:fsstress.c: In function 'attr_remove_path': 2024-02-21T23:04:58.721 INFO:tasks.workunit.client.0.smithi099.stderr:fsstress.c:878:9: warning: 'attr_remove' is deprecated: Use removexattr or lremovexattr instead [-Wdeprecated-declarations] 2024-02-21T23:04:58.721 INFO:tasks.workunit.client.0.smithi099.stderr: 878 | rval = attr_remove(name->path, attrname, flags); 2024-02-21T23:04:58.721 INFO:tasks.workunit.client.0.smithi099.stderr: | ^~~~ 2024-02-21T23:04:58.721 INFO:tasks.workunit.client.0.smithi099.stderr:In file included from ../src/global.h:25, 2024-02-21T23:04:58.722 INFO:tasks.workunit.client.0.smithi099.stderr: from fsstress.c:12: 2024-02-21T23:04:58.722 INFO:tasks.workunit.client.0.smithi099.stderr:/usr/include/attr/attributes.h:152:12: note: declared here 2024-02-21T23:04:58.722 INFO:tasks.workunit.client.0.smithi099.stderr: 152 | extern int attr_remove (const char *__path, const char *__attrname, 2024-02-21T23:04:58.722 INFO:tasks.workunit.client.0.smithi099.stderr: | ^~~~~~~~~~~ 2024-02-21T23:04:58.722 INFO:tasks.workunit.client.0.smithi099.stderr:fsstress.c: In function 'attr_set_path': 2024-02-21T23:04:58.722 INFO:tasks.workunit.client.0.smithi099.stderr:fsstress.c:898:9: warning: 'attr_set' is deprecated: Use setxattr or lsetxattr instead [-Wdeprecated-declarations] 2024-02-21T23:04:58.722 INFO:tasks.workunit.client.0.smithi099.stderr: 898 | rval = attr_set(name->path, attrname, attrvalue, valuelength, flags); 2024-02-21T23:04:58.722 INFO:tasks.workunit.client.0.smithi099.stderr: | ^~~~ 2024-02-21T23:04:58.722 INFO:tasks.workunit.client.0.smithi099.stderr:In file included from ../src/global.h:25, 2024-02-21T23:04:58.722 INFO:tasks.workunit.client.0.smithi099.stderr: from fsstress.c:12: 2024-02-21T23:04:58.722 INFO:tasks.workunit.client.0.smithi099.stderr:/usr/include/attr/attributes.h:139:12: note: declared here 2024-02-21T23:04:58.722 INFO:tasks.workunit.client.0.smithi099.stderr: 139 | extern int attr_set (const char *__path, const char *__attrname, 2024-02-21T23:04:58.722 INFO:tasks.workunit.client.0.smithi099.stderr: | ^~~~~~~~ 2024-02-21T23:04:58.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.730+0000 7f3267e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3248003a00 0x7f32600f49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:58.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.730+0000 7f3267e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32600c9130 0x7f32601768a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:58.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.730+0000 7f3267e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32600c95b0 0x7f32601661d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:58.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.730+0000 7f3267e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f326018fa60 con 0x7f32600c95b0 2024-02-21T23:04:58.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.730+0000 7f3267e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f326018f780 con 0x7f32600c9130 2024-02-21T23:04:58.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.730+0000 7f3267e00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f326018e510 con 0x7f3248003a00 2024-02-21T23:04:58.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.731+0000 7f3265e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32600c95b0 0x7f32601661d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:58.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.731+0000 7f3265e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32600c95b0 0x7f32601661d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55976/0 (socket says 172.21.15.99:55976) 2024-02-21T23:04:58.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.731+0000 7f3265e00640 1 -- 172.21.15.99:0/3050722298 learned_addr learned my addr 172.21.15.99:0/3050722298 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:04:58.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.731+0000 7f3265400640 1 --2- 172.21.15.99:0/3050722298 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3248003a00 0x7f32600f49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:58.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.731+0000 7f3264a00640 1 --2- 172.21.15.99:0/3050722298 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32600c9130 0x7f32601768a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:58.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.731+0000 7f3265400640 1 -- 172.21.15.99:0/3050722298 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32600c9130 msgr2=0x7f32601768a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:58.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.731+0000 7f3265400640 1 --2- 172.21.15.99:0/3050722298 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32600c9130 0x7f32601768a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:58.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.731+0000 7f3265400640 1 -- 172.21.15.99:0/3050722298 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32600c95b0 msgr2=0x7f32601661d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:58.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.732+0000 7f3265400640 1 --2- 172.21.15.99:0/3050722298 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32600c95b0 0x7f32601661d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:58.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.732+0000 7f3265400640 1 -- 172.21.15.99:0/3050722298 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3260168e60 con 0x7f3248003a00 2024-02-21T23:04:58.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.732+0000 7f3265e00640 1 --2- 172.21.15.99:0/3050722298 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32600c95b0 0x7f32601661d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:04:58.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.732+0000 7f3265400640 1 --2- 172.21.15.99:0/3050722298 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3248003a00 0x7f32600f49a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f324c031000 tx=0x7f324c000fe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:04:58.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.733+0000 7f325d600640 1 -- 172.21.15.99:0/3050722298 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324c045070 con 0x7f3248003a00 2024-02-21T23:04:58.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.733+0000 7f325d600640 1 -- 172.21.15.99:0/3050722298 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f324c0049f0 con 0x7f3248003a00 2024-02-21T23:04:58.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.733+0000 7f325d600640 1 -- 172.21.15.99:0/3050722298 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324c045070 con 0x7f3248003a00 2024-02-21T23:04:58.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.733+0000 7f3267e00640 1 -- 172.21.15.99:0/3050722298 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3260169140 con 0x7f3248003a00 2024-02-21T23:04:58.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.733+0000 7f3267e00640 1 -- 172.21.15.99:0/3050722298 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32600c8930 con 0x7f3248003a00 2024-02-21T23:04:58.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.737+0000 7f325d600640 1 -- 172.21.15.99:0/3050722298 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f324c004be0 con 0x7f3248003a00 2024-02-21T23:04:58.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.741+0000 7f326ac0e740 1 Processor -- start 2024-02-21T23:04:58.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.742+0000 7f325d600640 1 --2- 172.21.15.99:0/3050722298 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f324009f0d0 0x7f32400a1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:58.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.742+0000 7f325d600640 1 -- 172.21.15.99:0/3050722298 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f324c0ea6e0 con 0x7f3248003a00 2024-02-21T23:04:58.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.743+0000 7f326ac0e740 1 -- start start 2024-02-21T23:04:58.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.743+0000 7f3265e00640 1 --2- 172.21.15.99:0/3050722298 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f324009f0d0 0x7f32400a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:58.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.744+0000 7f3265e00640 1 --2- 172.21.15.99:0/3050722298 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f324009f0d0 0x7f32400a1590 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f32601909f0 tx=0x7f3254004b50 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:04:58.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.746+0000 7f326ac0e740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562b4512a0d0 0x562b4515fb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:58.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.746+0000 7f326ac0e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562b45160090 0x562b4512a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:58.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.746+0000 7f326ac0e740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562b4512a9f0 0x562b450ed000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:58.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.747+0000 7f3265400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562b4512a0d0 0x562b4515fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:58.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.747+0000 7f3265400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562b4512a0d0 0x562b4515fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:41442/0 (socket says 172.21.15.99:41442) 2024-02-21T23:04:58.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.747+0000 7f3264a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562b45160090 0x562b4512a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:58.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.747+0000 7f3264a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562b45160090 0x562b4512a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:42700/0 (socket says 172.21.15.99:42700) 2024-02-21T23:04:58.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.748+0000 7f3265e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562b4512a9f0 0x562b450ed000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:58.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.748+0000 7f3265e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562b4512a9f0 0x562b450ed000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55978/0 (socket says 172.21.15.99:55978) 2024-02-21T23:04:58.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.748+0000 7f3265400640 1 -- 172.21.15.99:0/330291652 learned_addr learned my addr 172.21.15.99:0/330291652 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:04:58.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.748+0000 7f326ac0e740 1 -- 172.21.15.99:0/330291652 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b45056a90 con 0x562b4512a9f0 2024-02-21T23:04:58.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.748+0000 7f326ac0e740 1 -- 172.21.15.99:0/330291652 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b44fffb10 con 0x562b45160090 2024-02-21T23:04:58.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.748+0000 7f326ac0e740 1 -- 172.21.15.99:0/330291652 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b45052b30 con 0x562b4512a0d0 2024-02-21T23:04:58.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.749+0000 7f3265e00640 1 -- 172.21.15.99:0/330291652 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562b4512a0d0 msgr2=0x562b4515fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:04:58.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.749+0000 7f3265e00640 1 --2- 172.21.15.99:0/330291652 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562b4512a0d0 0x562b4515fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:58.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.749+0000 7f3265e00640 1 -- 172.21.15.99:0/330291652 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562b45160090 msgr2=0x562b4512a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:04:58.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.749+0000 7f3265e00640 1 --2- 172.21.15.99:0/330291652 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562b45160090 0x562b4512a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:58.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.749+0000 7f3265e00640 1 -- 172.21.15.99:0/330291652 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562b44e357d0 con 0x562b4512a9f0 2024-02-21T23:04:58.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.750+0000 7f3265e00640 1 --2- 172.21.15.99:0/330291652 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562b4512a9f0 0x562b450ed000 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f3260070020 tx=0x7f3254014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c2f3af3d0d24518 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:04:58.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.750+0000 7f3264a00640 1 --2- 172.21.15.99:0/330291652 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562b45160090 0x562b4512a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T23:04:58.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.751+0000 7f3251c00640 1 -- 172.21.15.99:0/330291652 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f325402b070 con 0x562b4512a9f0 2024-02-21T23:04:58.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.751+0000 7f3251c00640 1 -- 172.21.15.99:0/330291652 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3254006e50 con 0x562b4512a9f0 2024-02-21T23:04:58.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.751+0000 7f3251c00640 1 -- 172.21.15.99:0/330291652 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3254008040 con 0x562b4512a9f0 2024-02-21T23:04:58.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.753+0000 7f326ac0e740 1 -- 172.21.15.99:0/330291652 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562b4512a9f0 msgr2=0x562b450ed000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:58.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.753+0000 7f326ac0e740 1 --2- 172.21.15.99:0/330291652 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562b4512a9f0 0x562b450ed000 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f3260070020 tx=0x7f3254014000 comp rx=0 tx=0).stop 2024-02-21T23:04:58.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.754+0000 7f326ac0e740 1 -- 172.21.15.99:0/330291652 shutdown_connections 2024-02-21T23:04:58.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.754+0000 7f326ac0e740 1 --2- 172.21.15.99:0/330291652 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562b4512a9f0 0x562b450ed000 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:58.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.754+0000 7f326ac0e740 1 --2- 172.21.15.99:0/330291652 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562b45160090 0x562b4512a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:58.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.754+0000 7f326ac0e740 1 --2- 172.21.15.99:0/330291652 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562b4512a0d0 0x562b4515fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:58.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.754+0000 7f326ac0e740 1 -- 172.21.15.99:0/330291652 >> 172.21.15.99:0/330291652 conn(0x562b450b96b0 msgr2=0x562b450f0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:04:58.743 INFO:tasks.workunit.client.0.smithi099.stderr:fsstress.c: In function 'allocsp_f': 2024-02-21T23:04:58.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.754+0000 7f326ac0e740 1 -- 172.21.15.99:0/330291652 shutdown_connections 2024-02-21T23:04:58.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.754+0000 7f326ac0e740 1 -- 172.21.15.99:0/330291652 wait complete. 2024-02-21T23:04:58.744 INFO:tasks.workunit.client.0.smithi099.stderr:fsstress.c:2047:32: error: 'XFS_IOC_ALLOCSP64' undeclared (first use in this function); did you mean 'XFS_IOC_RESVSP64'? 2024-02-21T23:04:58.744 INFO:tasks.workunit.client.0.smithi099.stderr: 2047 | e = xfsctl(f.path, fd, XFS_IOC_ALLOCSP64, &fl) < 0 ? errno : 0; 2024-02-21T23:04:58.744 INFO:tasks.workunit.client.0.smithi099.stderr: | ^~~~~~~~~~~~~~~~~ 2024-02-21T23:04:58.744 INFO:tasks.workunit.client.0.smithi099.stderr: | XFS_IOC_RESVSP64 2024-02-21T23:04:58.744 INFO:tasks.workunit.client.0.smithi099.stderr:fsstress.c:2047:32: note: each undeclared identifier is reported only once for each function it appears in 2024-02-21T23:04:58.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.755+0000 7f326ac0e740 1 -- start start 2024-02-21T23:04:58.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.756+0000 7f326ac0e740 1 Processor -- start 2024-02-21T23:04:58.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.758+0000 7f326ac0e740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562b4512a0d0 0x562b45120170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:58.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.758+0000 7f326ac0e740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562b4512a9f0 0x562b45121790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:58.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.758+0000 7f326ac0e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562b45160090 0x562b450eb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:58.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.758+0000 7f326ac0e740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b450f8d60 con 0x562b4512a0d0 2024-02-21T23:04:58.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.758+0000 7f326ac0e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b44ff51c0 con 0x562b45160090 2024-02-21T23:04:58.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.758+0000 7f326ac0e740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b45161760 con 0x562b4512a9f0 2024-02-21T23:04:58.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.758+0000 7f326ac0e740 10 client.0 _ll_register_callbacks cb 0x562b45012930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:04:58.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.759+0000 7f3265e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562b45160090 0x562b450eb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:58.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.759+0000 7f3265e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562b45160090 0x562b450eb7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:42716/0 (socket says 172.21.15.99:42716) 2024-02-21T23:04:58.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.759+0000 7f3265e00640 1 -- 172.21.15.99:0/3423427937 learned_addr learned my addr 172.21.15.99:0/3423427937 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:04:58.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.759+0000 7f3265400640 1 --2- 172.21.15.99:0/3423427937 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562b4512a0d0 0x562b45120170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:58.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.759+0000 7f3264a00640 1 --2- 172.21.15.99:0/3423427937 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562b4512a9f0 0x562b45121790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:58.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.759+0000 7f3265e00640 1 -- 172.21.15.99:0/3423427937 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562b4512a9f0 msgr2=0x562b45121790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:04:58.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.759+0000 7f3265e00640 1 --2- 172.21.15.99:0/3423427937 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562b4512a9f0 0x562b45121790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:58.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.759+0000 7f3265e00640 1 -- 172.21.15.99:0/3423427937 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562b4512a0d0 msgr2=0x562b45120170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:04:58.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.759+0000 7f3265e00640 1 --2- 172.21.15.99:0/3423427937 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562b4512a0d0 0x562b45120170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:58.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.759+0000 7f3265e00640 1 -- 172.21.15.99:0/3423427937 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562b44d6b3f0 con 0x562b45160090 2024-02-21T23:04:58.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.760+0000 7f3264a00640 1 --2- 172.21.15.99:0/3423427937 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562b4512a9f0 0x562b45121790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T23:04:58.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.760+0000 7f3265400640 1 --2- 172.21.15.99:0/3423427937 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562b4512a0d0 0x562b45120170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:04:58.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.761+0000 7f3265e00640 1 --2- 172.21.15.99:0/3423427937 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562b45160090 0x562b450eb7b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f3254009fa0 tx=0x7f3254004bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3011b47af4a2d8f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:04:58.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.761+0000 7f3246000640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-02-21T23:04:58.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.762+0000 7f3246000640 1 -- 172.21.15.99:0/3423427937 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3254036060 con 0x562b45160090 2024-02-21T23:04:58.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.762+0000 7f3246000640 1 -- 172.21.15.99:0/3423427937 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f3254026b40 con 0x562b45160090 2024-02-21T23:04:58.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.762+0000 7f326ac0e740 1 -- 172.21.15.99:0/3423427937 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3254006e50 con 0x562b45160090 2024-02-21T23:04:58.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.766+0000 7f3246000640 1 -- 172.21.15.99:0/3423427937 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f325402b070 con 0x562b45160090 2024-02-21T23:04:58.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.766+0000 7f326ac0e740 10 client.5737 fetch_fsmap learned FSMap version 16 2024-02-21T23:04:58.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.766+0000 7f326ac0e740 1 -- 172.21.15.99:0/3423427937 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x562b44d2b0f0 con 0x562b45160090 2024-02-21T23:04:58.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.766+0000 7f3246000640 1 -- 172.21.15.99:0/3423427937 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3254006e50 con 0x562b45160090 2024-02-21T23:04:58.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.767+0000 7f3246000640 1 -- 172.21.15.99:0/3423427937 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f3254031440 con 0x562b45160090 2024-02-21T23:04:58.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.767+0000 7f326ac0e740 10 client.5737 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T23:04:58.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.767+0000 7f326ac0e740 10 client.5737 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:04:58.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.767+0000 7f326ac0e740 20 client.5737 populate_metadata read hostname 'smithi099' 2024-02-21T23:04:58.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.767+0000 7f326ac0e740 1 --2- 172.21.15.99:0/3423427937 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x562b45136060 0x562b45121ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:58.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.767+0000 7f326ac0e740 4 client.5737 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:04:58.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.767+0000 7f326ac0e740 1 -- 172.21.15.99:0/3423427937 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562b45063fd0 con 0x562b45136060 2024-02-21T23:04:58.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.768+0000 7f3265400640 1 --2- 172.21.15.99:0/3423427937 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x562b45136060 0x562b45121ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:58.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.769+0000 7f3265400640 1 --2- 172.21.15.99:0/3423427937 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x562b45136060 0x562b45121ee0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd7f997dd2714c1d server_cookie=34ee0bd59cde65ce in_seq=0 out_seq=0 2024-02-21T23:04:58.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.770+0000 7f3246000640 10 client.5737 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:04:58.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.773+0000 7f3246000640 1 -- 172.21.15.99:0/3423427937 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x562b45063fd0 con 0x562b45136060 2024-02-21T23:04:58.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.773+0000 7f3246000640 10 client.5737 handle_command_reply: tid=0 2024-02-21T23:04:58.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.773+0000 7f326ac0e740 1 client.5737 shutdown 2024-02-21T23:04:58.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.773+0000 7f326ac0e740 1 -- 172.21.15.99:0/3423427937 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562b45160090 msgr2=0x562b450eb7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:58.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.773+0000 7f326ac0e740 1 --2- 172.21.15.99:0/3423427937 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562b45160090 0x562b450eb7b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f3254009fa0 tx=0x7f3254004bc0 comp rx=0 tx=0).stop 2024-02-21T23:04:58.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.774+0000 7f326ac0e740 1 -- 172.21.15.99:0/3423427937 shutdown_connections 2024-02-21T23:04:58.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.774+0000 7f326ac0e740 1 --2- 172.21.15.99:0/3423427937 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x562b45136060 0x562b45121ee0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:58.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.774+0000 7f326ac0e740 1 --2- 172.21.15.99:0/3423427937 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562b45160090 0x562b450eb7b0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:58.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.774+0000 7f326ac0e740 1 --2- 172.21.15.99:0/3423427937 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562b4512a9f0 0x562b45121790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:58.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.774+0000 7f326ac0e740 1 --2- 172.21.15.99:0/3423427937 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562b4512a0d0 0x562b45120170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:58.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.774+0000 7f326ac0e740 1 -- 172.21.15.99:0/3423427937 >> 172.21.15.99:0/3423427937 conn(0x562b450b96b0 msgr2=0x562b4515f900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:04:58.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.774+0000 7f3246000640 0 client.5737 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:04:58.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.776+0000 7f326ac0e740 1 -- 172.21.15.99:0/3423427937 shutdown_connections 2024-02-21T23:04:58.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.776+0000 7f326ac0e740 1 -- 172.21.15.99:0/3423427937 wait complete. 2024-02-21T23:04:58.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.776+0000 7f326ac0e740 20 client.5737 trim_cache size 0 max 16384 2024-02-21T23:04:58.775 INFO:tasks.workunit.client.0.smithi099.stderr:fsstress.c: In function 'freesp_f': 2024-02-21T23:04:58.776 INFO:tasks.workunit.client.0.smithi099.stderr:fsstress.c:3640:32: error: 'XFS_IOC_FREESP64' undeclared (first use in this function); did you mean 'XFS_IOC_RESVSP64'? 2024-02-21T23:04:58.776 INFO:tasks.workunit.client.0.smithi099.stderr: 3640 | e = xfsctl(f.path, fd, XFS_IOC_FREESP64, &fl) < 0 ? errno : 0; 2024-02-21T23:04:58.776 INFO:tasks.workunit.client.0.smithi099.stderr: | ^~~~~~~~~~~~~~~~ 2024-02-21T23:04:58.776 INFO:tasks.workunit.client.0.smithi099.stderr: | XFS_IOC_RESVSP64 2024-02-21T23:04:58.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.812+0000 7f326ac0e740 1 Processor -- start 2024-02-21T23:04:58.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.812+0000 7f326ac0e740 1 -- start start 2024-02-21T23:04:58.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.814+0000 7f326ac0e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562b4512a0d0 0x562b450eff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:58.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.814+0000 7f326ac0e740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562b4512a9f0 0x562b450ef130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:58.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.814+0000 7f326ac0e740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562b45160090 0x562b450ef860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:58.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.814+0000 7f326ac0e740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3260239c00 con 0x562b4512a9f0 2024-02-21T23:04:58.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.815+0000 7f326ac0e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32602377a0 con 0x562b4512a0d0 2024-02-21T23:04:58.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.815+0000 7f326ac0e740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32600cd520 con 0x562b45160090 2024-02-21T23:04:58.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.815+0000 7f3264a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562b4512a9f0 0x562b450ef130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:58.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.815+0000 7f3265e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562b45160090 0x562b450ef860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:58.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.815+0000 7f3264a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562b4512a9f0 0x562b450ef130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55990/0 (socket says 172.21.15.99:55990) 2024-02-21T23:04:58.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.816+0000 7f3264a00640 1 -- 172.21.15.99:0/2274455035 learned_addr learned my addr 172.21.15.99:0/2274455035 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:04:58.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.816+0000 7f3265e00640 1 -- 172.21.15.99:0/2274455035 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562b4512a0d0 msgr2=0x562b450eff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:04:58.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.815+0000 7f3265400640 1 --2- 172.21.15.99:0/2274455035 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562b4512a0d0 0x562b450eff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:58.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.816+0000 7f3265e00640 1 --2- 172.21.15.99:0/2274455035 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562b4512a0d0 0x562b450eff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:58.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.816+0000 7f3265e00640 1 -- 172.21.15.99:0/2274455035 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562b4512a9f0 msgr2=0x562b450ef130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:04:58.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.816+0000 7f3265e00640 1 --2- 172.21.15.99:0/2274455035 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562b4512a9f0 0x562b450ef130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:58.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.816+0000 7f3265e00640 1 -- 172.21.15.99:0/2274455035 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562b451613f0 con 0x562b45160090 2024-02-21T23:04:58.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.817+0000 7f3264a00640 1 --2- 172.21.15.99:0/2274455035 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562b4512a9f0 0x562b450ef130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:04:58.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.817+0000 7f3265400640 1 --2- 172.21.15.99:0/2274455035 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562b4512a0d0 0x562b450eff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T23:04:58.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.817+0000 7f3265e00640 1 --2- 172.21.15.99:0/2274455035 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562b45160090 0x562b450ef860 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x562b45164ff0 tx=0x7f325402b000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d39196982828b971 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:04:58.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.820+0000 7f3251200640 1 -- 172.21.15.99:0/2274455035 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3254036040 con 0x562b45160090 2024-02-21T23:04:58.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.820+0000 7f3251200640 1 -- 172.21.15.99:0/2274455035 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3254031440 con 0x562b45160090 2024-02-21T23:04:58.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.820+0000 7f3251200640 1 -- 172.21.15.99:0/2274455035 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3254040080 con 0x562b45160090 2024-02-21T23:04:58.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.821+0000 7f326ac0e740 1 -- 172.21.15.99:0/2274455035 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562b45160090 msgr2=0x562b450ef860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:58.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.821+0000 7f326ac0e740 1 --2- 172.21.15.99:0/2274455035 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562b45160090 0x562b450ef860 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x562b45164ff0 tx=0x7f325402b000 comp rx=0 tx=0).stop 2024-02-21T23:04:58.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.821+0000 7f326ac0e740 1 -- 172.21.15.99:0/2274455035 shutdown_connections 2024-02-21T23:04:58.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.821+0000 7f326ac0e740 1 --2- 172.21.15.99:0/2274455035 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562b45160090 0x562b450ef860 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:58.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.821+0000 7f326ac0e740 1 --2- 172.21.15.99:0/2274455035 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562b4512a9f0 0x562b450ef130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:58.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.821+0000 7f326ac0e740 1 --2- 172.21.15.99:0/2274455035 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562b4512a0d0 0x562b450eff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:58.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.821+0000 7f326ac0e740 1 -- 172.21.15.99:0/2274455035 >> 172.21.15.99:0/2274455035 conn(0x562b450b96b0 msgr2=0x562b45136060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:04:58.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.822+0000 7f326ac0e740 1 -- 172.21.15.99:0/2274455035 shutdown_connections 2024-02-21T23:04:58.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.822+0000 7f326ac0e740 1 -- 172.21.15.99:0/2274455035 wait complete. 2024-02-21T23:04:58.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.823+0000 7f326ac0e740 1 -- start start 2024-02-21T23:04:58.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.824+0000 7f326ac0e740 1 Processor -- start 2024-02-21T23:04:58.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.826+0000 7f326ac0e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562b4512a0d0 0x562b450f8960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:58.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.826+0000 7f326ac0e740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562b4512a9f0 0x562b450ef7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:58.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.827+0000 7f326ac0e740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562b45160090 0x562b45161ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:58.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.827+0000 7f326ac0e740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3260235ea0 con 0x562b4512a9f0 2024-02-21T23:04:58.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.828+0000 7f326ac0e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3260237140 con 0x562b4512a0d0 2024-02-21T23:04:58.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.828+0000 7f326ac0e740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32602364a0 con 0x562b45160090 2024-02-21T23:04:58.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.828+0000 7f326ac0e740 10 client.0 _ll_register_callbacks cb 0x7f3254026750 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:04:58.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.828+0000 7f3265400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562b4512a0d0 0x562b450f8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:58.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.827+0000 7f3265e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562b45160090 0x562b45161ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:58.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.828+0000 7f3265e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562b45160090 0x562b45161ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:41462/0 (socket says 172.21.15.99:41462) 2024-02-21T23:04:58.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.828+0000 7f3265e00640 1 -- 172.21.15.99:0/2159635500 learned_addr learned my addr 172.21.15.99:0/2159635500 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:04:58.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.829+0000 7f3265400640 1 -- 172.21.15.99:0/2159635500 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562b45160090 msgr2=0x562b45161ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:04:58.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.829+0000 7f3265400640 1 --2- 172.21.15.99:0/2159635500 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562b45160090 0x562b45161ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:58.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.829+0000 7f3265400640 1 -- 172.21.15.99:0/2159635500 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562b4512a9f0 msgr2=0x562b450ef7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:04:58.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.829+0000 7f3264a00640 1 --2- 172.21.15.99:0/2159635500 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562b4512a9f0 0x562b450ef7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:58.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.829+0000 7f3265400640 1 --2- 172.21.15.99:0/2159635500 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562b4512a9f0 0x562b450ef7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:58.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.829+0000 7f3265400640 1 -- 172.21.15.99:0/2159635500 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562b450f81a0 con 0x562b4512a0d0 2024-02-21T23:04:58.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.829+0000 7f3265e00640 1 --2- 172.21.15.99:0/2159635500 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562b45160090 0x562b45161ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:04:58.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.829+0000 7f3264a00640 1 --2- 172.21.15.99:0/2159635500 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562b4512a9f0 0x562b450ef7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T23:04:58.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.830+0000 7f3265400640 1 --2- 172.21.15.99:0/2159635500 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562b4512a0d0 0x562b450f8960 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f324c0b44f0 tx=0x7f324c0ea040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51fb427cc5a889d3 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:04:58.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.830+0000 7f3246000640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-02-21T23:04:58.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.830+0000 7f3246000640 1 -- 172.21.15.99:0/2159635500 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324c0e7fa0 con 0x562b4512a0d0 2024-02-21T23:04:58.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.830+0000 7f3246000640 1 -- 172.21.15.99:0/2159635500 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f324c0b4700 con 0x562b4512a0d0 2024-02-21T23:04:58.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.831+0000 7f326ac0e740 1 -- 172.21.15.99:0/2159635500 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3254031440 con 0x562b4512a0d0 2024-02-21T23:04:58.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.831+0000 7f3246000640 1 -- 172.21.15.99:0/2159635500 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f324c0b74e0 con 0x562b4512a0d0 2024-02-21T23:04:58.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.831+0000 7f326ac0e740 10 client.5740 fetch_fsmap learned FSMap version 16 2024-02-21T23:04:58.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.831+0000 7f326ac0e740 1 -- 172.21.15.99:0/2159635500 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x562b450f8440 con 0x562b4512a0d0 2024-02-21T23:04:58.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.831+0000 7f3246000640 1 -- 172.21.15.99:0/2159635500 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3254031440 con 0x562b4512a0d0 2024-02-21T23:04:58.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.832+0000 7f3246000640 1 -- 172.21.15.99:0/2159635500 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f324c0b7680 con 0x562b4512a0d0 2024-02-21T23:04:58.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.832+0000 7f326ac0e740 10 client.5740 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T23:04:58.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.832+0000 7f326ac0e740 10 client.5740 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:04:58.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.832+0000 7f326ac0e740 20 client.5740 populate_metadata read hostname 'smithi099' 2024-02-21T23:04:58.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.832+0000 7f326ac0e740 1 --2- 172.21.15.99:0/2159635500 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x562b450eff40 0x562b451cd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:58.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.832+0000 7f326ac0e740 4 client.5740 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T23:04:58.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.832+0000 7f326ac0e740 1 -- 172.21.15.99:0/2159635500 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x562b4505e320 con 0x562b450eff40 2024-02-21T23:04:58.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.834+0000 7f3264a00640 1 --2- 172.21.15.99:0/2159635500 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x562b450eff40 0x562b451cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:58.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.835+0000 7f3264a00640 1 --2- 172.21.15.99:0/2159635500 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x562b450eff40 0x562b451cd370 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=477a82445a13c392 server_cookie=5c10237f5ed5e663 in_seq=0 out_seq=0 2024-02-21T23:04:58.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.835+0000 7f3246000640 10 client.5740 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:04:58.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.835+0000 7f3246000640 1 -- 172.21.15.99:0/2159635500 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x562b4505e320 con 0x562b450eff40 2024-02-21T23:04:58.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.835+0000 7f3246000640 10 client.5740 handle_command_reply: tid=0 2024-02-21T23:04:58.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.836+0000 7f326ac0e740 1 client.5740 shutdown 2024-02-21T23:04:58.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.836+0000 7f326ac0e740 1 -- 172.21.15.99:0/2159635500 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562b4512a0d0 msgr2=0x562b450f8960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:58.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.836+0000 7f326ac0e740 1 --2- 172.21.15.99:0/2159635500 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562b4512a0d0 0x562b450f8960 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f324c0b44f0 tx=0x7f324c0ea040 comp rx=0 tx=0).stop 2024-02-21T23:04:58.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.836+0000 7f326ac0e740 1 -- 172.21.15.99:0/2159635500 shutdown_connections 2024-02-21T23:04:58.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.836+0000 7f326ac0e740 1 --2- 172.21.15.99:0/2159635500 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x562b450eff40 0x562b451cd370 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:58.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.837+0000 7f326ac0e740 1 --2- 172.21.15.99:0/2159635500 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562b45160090 0x562b45161ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:58.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.837+0000 7f326ac0e740 1 --2- 172.21.15.99:0/2159635500 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562b4512a9f0 0x562b450ef7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:58.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.837+0000 7f326ac0e740 1 --2- 172.21.15.99:0/2159635500 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562b4512a0d0 0x562b450f8960 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:58.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.837+0000 7f326ac0e740 1 -- 172.21.15.99:0/2159635500 >> 172.21.15.99:0/2159635500 conn(0x562b450b96b0 msgr2=0x562b45136060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:04:58.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.837+0000 7f3246000640 0 client.5740 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:04:58.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.838+0000 7f326ac0e740 1 -- 172.21.15.99:0/2159635500 shutdown_connections 2024-02-21T23:04:58.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.838+0000 7f326ac0e740 1 -- 172.21.15.99:0/2159635500 wait complete. 2024-02-21T23:04:58.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.838+0000 7f326ac0e740 20 client.5740 trim_cache size 0 max 16384 2024-02-21T23:04:58.828 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-02-21T23:04:58.828 INFO:teuthology.orchestra.run.smithi099.stdout: "status": "no active scrubs running", 2024-02-21T23:04:58.828 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubs": {} 2024-02-21T23:04:58.828 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-02-21T23:04:58.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.841+0000 7f3267e00640 1 -- 172.21.15.99:0/3050722298 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f324009f0d0 msgr2=0x7f32400a1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:58.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.841+0000 7f3267e00640 1 --2- 172.21.15.99:0/3050722298 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f324009f0d0 0x7f32400a1590 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f32601909f0 tx=0x7f3254004b50 comp rx=0 tx=0).stop 2024-02-21T23:04:58.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.841+0000 7f3267e00640 1 -- 172.21.15.99:0/3050722298 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3248003a00 msgr2=0x7f32600f49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:58.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.841+0000 7f3267e00640 1 --2- 172.21.15.99:0/3050722298 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3248003a00 0x7f32600f49a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f324c031000 tx=0x7f324c000fe0 comp rx=0 tx=0).stop 2024-02-21T23:04:58.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.842+0000 7f3267e00640 1 -- 172.21.15.99:0/3050722298 shutdown_connections 2024-02-21T23:04:58.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.842+0000 7f3267e00640 1 --2- 172.21.15.99:0/3050722298 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f324009f0d0 0x7f32400a1590 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:58.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.842+0000 7f3267e00640 1 --2- 172.21.15.99:0/3050722298 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f32600c95b0 0x7f32601661d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:58.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.842+0000 7f3267e00640 1 --2- 172.21.15.99:0/3050722298 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32600c9130 0x7f32601768a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:58.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.842+0000 7f3267e00640 1 --2- 172.21.15.99:0/3050722298 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3248003a00 0x7f32600f49a0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:58.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.842+0000 7f3267e00640 1 -- 172.21.15.99:0/3050722298 >> 172.21.15.99:0/3050722298 conn(0x7f32600ce5f0 msgr2=0x7f3260173fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:04:58.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.842+0000 7f3267e00640 1 -- 172.21.15.99:0/3050722298 shutdown_connections 2024-02-21T23:04:58.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:58.842+0000 7f3267e00640 1 -- 172.21.15.99:0/3050722298 wait complete. 2024-02-21T23:04:58.848 INFO:tasks.workunit.client.0.smithi099.stderr:gmake[3]: *** [Makefile:47: fsstress] Error 1 2024-02-21T23:04:58.848 INFO:tasks.workunit.client.0.smithi099.stderr:gmake[3]: *** Waiting for unfinished jobs.... 2024-02-21T23:04:58.865 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-02-21T23:04:58.865 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T23:04:59.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.125+0000 7f14c7a00640 1 Processor -- start 2024-02-21T23:04:59.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.125+0000 7f14c7a00640 1 -- start start 2024-02-21T23:04:59.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.128+0000 7f14c7a00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f14c0186b90 0x7f14c0186f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:59.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.128+0000 7f14c7a00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14c017d980 con 0x7f14c018ab00 2024-02-21T23:04:59.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.128+0000 7f14c7a00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14c0185950 con 0x7f14c01874b0 2024-02-21T23:04:59.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.128+0000 7f14c7a00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14c0185c30 con 0x7f14c0186b90 2024-02-21T23:04:59.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.128+0000 7f14c5000640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f14c0186b90 0x7f14c0186f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:59.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.128+0000 7f14c5000640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f14c0186b90 0x7f14c0186f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:41466/0 (socket says 172.21.15.99:41466) 2024-02-21T23:04:59.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.129+0000 7f14c5000640 1 -- 172.21.15.99:0/2590328390 learned_addr learned my addr 172.21.15.99:0/2590328390 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:04:59.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.129+0000 7f14c5000640 1 -- 172.21.15.99:0/2590328390 >> v1:172.21.15.162:6789/0 conn(0x7f14c01874b0 legacy=0x7f14c018a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:04:59.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.129+0000 7f14c5000640 1 -- 172.21.15.99:0/2590328390 >> v1:172.21.15.99:6789/0 conn(0x7f14c018ab00 legacy=0x7f14c0184a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:04:59.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.129+0000 7f14c5000640 1 -- 172.21.15.99:0/2590328390 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14c0185f10 con 0x7f14c0186b90 2024-02-21T23:04:59.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.131+0000 7f14c5000640 1 --2- 172.21.15.99:0/2590328390 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f14c0186b90 0x7f14c0186f70 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f14b4009870 tx=0x7f14b402b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b519558fd01e3294 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:04:59.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.132+0000 7f14bf400640 1 -- 172.21.15.99:0/2590328390 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b4035020 con 0x7f14c0186b90 2024-02-21T23:04:59.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.132+0000 7f14bf400640 1 -- 172.21.15.99:0/2590328390 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14b4031870 con 0x7f14c0186b90 2024-02-21T23:04:59.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.132+0000 7f14bf400640 1 -- 172.21.15.99:0/2590328390 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b4031c40 con 0x7f14c0186b90 2024-02-21T23:04:59.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.133+0000 7f14c7a00640 1 -- 172.21.15.99:0/2590328390 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f14c0186b90 msgr2=0x7f14c0186f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:59.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.133+0000 7f14c7a00640 1 --2- 172.21.15.99:0/2590328390 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f14c0186b90 0x7f14c0186f70 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f14b4009870 tx=0x7f14b402b910 comp rx=0 tx=0).stop 2024-02-21T23:04:59.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.133+0000 7f14c7a00640 1 -- 172.21.15.99:0/2590328390 shutdown_connections 2024-02-21T23:04:59.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.134+0000 7f14c7a00640 1 --2- 172.21.15.99:0/2590328390 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f14c0186b90 0x7f14c0186f70 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:59.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.134+0000 7f14c7a00640 1 -- 172.21.15.99:0/2590328390 >> 172.21.15.99:0/2590328390 conn(0x7f14c00ce5f0 msgr2=0x7f14c00cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:04:59.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.134+0000 7f14c7a00640 1 -- 172.21.15.99:0/2590328390 shutdown_connections 2024-02-21T23:04:59.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.134+0000 7f14c7a00640 1 -- 172.21.15.99:0/2590328390 wait complete. 2024-02-21T23:04:59.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.137+0000 7f14c7a00640 1 Processor -- start 2024-02-21T23:04:59.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.137+0000 7f14c7a00640 1 -- start start 2024-02-21T23:04:59.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.139+0000 7f14c7a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f14c0186b90 0x7f14c015d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:59.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.139+0000 7f14c7a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f14c01874b0 0x7f14c015e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:59.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.139+0000 7f14c7a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f14c018ab00 0x7f14c015e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:59.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.139+0000 7f14c7a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14c01867b0 con 0x7f14c0186b90 2024-02-21T23:04:59.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.139+0000 7f14c7a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14c01864d0 con 0x7f14c018ab00 2024-02-21T23:04:59.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.139+0000 7f14c7a00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14c00cbf20 con 0x7f14c01874b0 2024-02-21T23:04:59.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.140+0000 7f14c5000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f14c0186b90 0x7f14c015d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:59.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.140+0000 7f14c5000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f14c0186b90 0x7f14c015d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56010/0 (socket says 172.21.15.99:56010) 2024-02-21T23:04:59.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.140+0000 7f14c5000640 1 -- 172.21.15.99:0/1731593945 learned_addr learned my addr 172.21.15.99:0/1731593945 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:04:59.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.140+0000 7f14bfe00640 1 --2- 172.21.15.99:0/1731593945 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f14c01874b0 0x7f14c015e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:59.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.140+0000 7f14bfe00640 1 -- 172.21.15.99:0/1731593945 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f14c018ab00 msgr2=0x7f14c015e840 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-21T23:04:59.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.140+0000 7f14bfe00640 1 --2- 172.21.15.99:0/1731593945 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f14c018ab00 0x7f14c015e840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:59.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.140+0000 7f14bfe00640 1 -- 172.21.15.99:0/1731593945 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f14c0186b90 msgr2=0x7f14c015d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:59.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.140+0000 7f14bfe00640 1 --2- 172.21.15.99:0/1731593945 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f14c0186b90 0x7f14c015d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:59.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.140+0000 7f14bfe00640 1 -- 172.21.15.99:0/1731593945 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14c0168be0 con 0x7f14c01874b0 2024-02-21T23:04:59.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.141+0000 7f14bfe00640 1 --2- 172.21.15.99:0/1731593945 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f14c01874b0 0x7f14c015e300 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f14ac00b410 tx=0x7f14ac00b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:04:59.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.141+0000 7f14bcc00640 1 -- 172.21.15.99:0/1731593945 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ac015030 con 0x7f14c01874b0 2024-02-21T23:04:59.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.141+0000 7f14bcc00640 1 -- 172.21.15.99:0/1731593945 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14ac004020 con 0x7f14c01874b0 2024-02-21T23:04:59.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.141+0000 7f14bcc00640 1 -- 172.21.15.99:0/1731593945 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ac004410 con 0x7f14c01874b0 2024-02-21T23:04:59.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.142+0000 7f14c7a00640 1 -- 172.21.15.99:0/1731593945 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14c0168ec0 con 0x7f14c01874b0 2024-02-21T23:04:59.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.143+0000 7f14c7a00640 1 -- 172.21.15.99:0/1731593945 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14c015fe60 con 0x7f14c01874b0 2024-02-21T23:04:59.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.145+0000 7f14c7a00640 1 -- 172.21.15.99:0/1731593945 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14c015fc50 con 0x7f14c01874b0 2024-02-21T23:04:59.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.148+0000 7f14bcc00640 1 -- 172.21.15.99:0/1731593945 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f14ac018070 con 0x7f14c01874b0 2024-02-21T23:04:59.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.150+0000 7f14bcc00640 1 --2- 172.21.15.99:0/1731593945 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f14a009ef50 0x7f14a00a1410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:59.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.150+0000 7f14bcc00640 1 -- 172.21.15.99:0/1731593945 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f14ac0c9a70 con 0x7f14c01874b0 2024-02-21T23:04:59.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.151+0000 7f14c5000640 1 --2- 172.21.15.99:0/1731593945 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f14a009ef50 0x7f14a00a1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:59.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.152+0000 7f14c5000640 1 --2- 172.21.15.99:0/1731593945 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f14a009ef50 0x7f14a00a1410 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f14b402b950 tx=0x7f14b403c040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:04:59.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.153+0000 7f14bcc00640 1 -- 172.21.15.99:0/1731593945 <== mon.2 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f14ac097a10 con 0x7f14c01874b0 2024-02-21T23:04:59.349 INFO:tasks.workunit.client.0.smithi099.stderr:doio.c: In function 'parse_cmdline': 2024-02-21T23:04:59.349 INFO:tasks.workunit.client.0.smithi099.stderr:doio.c:3113:33: warning: '%s' directive argument is null [-Wformat-overflow=] 2024-02-21T23:04:59.349 INFO:tasks.workunit.client.0.smithi099.stderr: 3113 | fprintf(stderr, 2024-02-21T23:04:59.349 INFO:tasks.workunit.client.0.smithi099.stderr: | ^~~~~~~~~~~~~~~ 2024-02-21T23:04:59.349 INFO:tasks.workunit.client.0.smithi099.stderr: 3114 | "%s%s: Illegal -C arg (%s). Must be one of: ", 2024-02-21T23:04:59.349 INFO:tasks.workunit.client.0.smithi099.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-02-21T23:04:59.349 INFO:tasks.workunit.client.0.smithi099.stderr: 3115 | Prog, TagName, tok); 2024-02-21T23:04:59.349 INFO:tasks.workunit.client.0.smithi099.stderr: | ~~~~~~~~~~~~~~~~~~~ 2024-02-21T23:04:59.384 INFO:tasks.workunit.client.0.smithi099.stderr:fsx.c: In function 'main': 2024-02-21T23:04:59.384 INFO:tasks.workunit.client.0.smithi099.stderr:fsx.c:2662:33: warning: 'strncpy' specified bound 4096 equals destination size [-Wstringop-truncation] 2024-02-21T23:04:59.384 INFO:tasks.workunit.client.0.smithi099.stderr: 2662 | strncpy(opsfile, optarg, sizeof(opsfile)); 2024-02-21T23:04:59.385 INFO:tasks.workunit.client.0.smithi099.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-02-21T23:04:59.385 INFO:tasks.workunit.client.0.smithi099.stderr:fsx.c:2632:25: warning: 'strncpy' specified bound 1024 equals destination size [-Wstringop-truncation] 2024-02-21T23:04:59.385 INFO:tasks.workunit.client.0.smithi099.stderr: 2632 | strncpy(dname, optarg, sizeof(dname)); 2024-02-21T23:04:59.385 INFO:tasks.workunit.client.0.smithi099.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-02-21T23:04:59.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.593+0000 7f14c7a00640 1 -- 172.21.15.99:0/1731593945 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f14c00cc1c0 con 0x7f14c01874b0 2024-02-21T23:04:59.583 INFO:tasks.workunit.client.0.smithi099.stderr:gmake[2]: *** [include/buildrules:30: ltp] Error 2 2024-02-21T23:04:59.583 INFO:tasks.workunit.client.0.smithi099.stderr:gmake[2]: *** Waiting for unfinished jobs.... 2024-02-21T23:04:59.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.595+0000 7f14bcc00640 1 -- 172.21.15.99:0/1731593945 <== mon.2 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+11336 (secure 0 0 0) 0x7f14ac097310 con 0x7f14c01874b0 2024-02-21T23:04:59.584 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T23:04:59.584 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4307,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/3514452812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3514452812},{"type":"v1","addr":"172.21.15.162:6836","nonce":3514452812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4312,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6838/2169982089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":2169982089},{"type":"v1","addr":"172.21.15.162:6838","nonce":2169982089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4315,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6839/3335972724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6837","nonce":3335972724},{"type":"v1","addr":"172.21.15.162:6839","nonce":3335972724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4318,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6841/2135456697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6840","nonce":2135456697},{"type":"v1","addr":"172.21.15.162:6841","nonce":2135456697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4325,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2452242758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2452242758},{"type":"v1","addr":"172.21.15.181:6833","nonce":2452242758}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4328,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6836/2751486400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":2751486400},{"type":"v1","addr":"172.21.15.181:6836","nonce":2751486400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":16,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-21T23:01:02.656130+0000","modified":"2024-02-21T23:03:58.159765+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4355,"mds_1":4352,"mds_2":4348},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4331":{"gid":4331,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6838/3728901330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6835","nonce":3728901330},{"type":"v1","addr":"172.21.15.181:6838","nonce":3728901330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4339":{"gid":4339,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6839/3357929641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6837","nonce":3357929641},{"type":"v1","addr":"172.21.15.181:6839","nonce":3357929641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4343":{"gid":4343,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6833/2793485078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":2793485078},{"type":"v1","addr":"172.21.15.99:6833","nonce":2793485078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4348":{"gid":4348,"name":"d","rank":2,"incarnation":12,"state":"up:active","state_seq":10,"addr":"172.21.15.99:6835/2243461688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2243461688},{"type":"v1","addr":"172.21.15.99:6835","nonce":2243461688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4352":{"gid":4352,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.99:6837/1676159950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":1676159950},{"type":"v1","addr":"172.21.15.99:6837","nonce":1676159950}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4355":{"gid":4355,"name":"j","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6839/4239008786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":4239008786},{"type":"v1","addr":"172.21.15.99:6839","nonce":4239008786}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-21T23:04:59.584 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 16 2024-02-21T23:04:59.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.598+0000 7f14c7a00640 1 -- 172.21.15.99:0/1731593945 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f14a009ef50 msgr2=0x7f14a00a1410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:59.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.598+0000 7f14c7a00640 1 --2- 172.21.15.99:0/1731593945 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f14a009ef50 0x7f14a00a1410 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f14b402b950 tx=0x7f14b403c040 comp rx=0 tx=0).stop 2024-02-21T23:04:59.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.598+0000 7f14c7a00640 1 -- 172.21.15.99:0/1731593945 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f14c01874b0 msgr2=0x7f14c015e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:59.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.598+0000 7f14c7a00640 1 --2- 172.21.15.99:0/1731593945 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f14c01874b0 0x7f14c015e300 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f14ac00b410 tx=0x7f14ac00b8d0 comp rx=0 tx=0).stop 2024-02-21T23:04:59.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.598+0000 7f14c7a00640 1 -- 172.21.15.99:0/1731593945 shutdown_connections 2024-02-21T23:04:59.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.598+0000 7f14c7a00640 1 --2- 172.21.15.99:0/1731593945 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f14a009ef50 0x7f14a00a1410 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:59.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.598+0000 7f14c7a00640 1 --2- 172.21.15.99:0/1731593945 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f14c018ab00 0x7f14c015e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:59.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.598+0000 7f14c7a00640 1 --2- 172.21.15.99:0/1731593945 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f14c01874b0 0x7f14c015e300 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:59.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.598+0000 7f14c7a00640 1 --2- 172.21.15.99:0/1731593945 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f14c0186b90 0x7f14c015d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:59.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.598+0000 7f14c7a00640 1 -- 172.21.15.99:0/1731593945 >> 172.21.15.99:0/1731593945 conn(0x7f14c00ce5f0 msgr2=0x7f14c0184990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:04:59.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.598+0000 7f14c7a00640 1 -- 172.21.15.99:0/1731593945 shutdown_connections 2024-02-21T23:04:59.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.598+0000 7f14c7a00640 1 -- 172.21.15.99:0/1731593945 wait complete. 2024-02-21T23:04:59.605 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T23:04:59.605 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-02-21T23:04:59.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.842+0000 7f6f07e00640 1 Processor -- start 2024-02-21T23:04:59.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.842+0000 7f6f07e00640 1 -- start start 2024-02-21T23:04:59.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.845+0000 7f6f07e00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f6f08188f60 0x7f6f080722b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:59.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.845+0000 7f6f07e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f08070f30 con 0x7f6f080ca1c0 2024-02-21T23:04:59.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.845+0000 7f6f07e00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f08071210 con 0x7f6f080c9d60 2024-02-21T23:04:59.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.845+0000 7f6f07e00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f08071e20 con 0x7f6f08188f60 2024-02-21T23:04:59.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.846+0000 7f6f06a00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f6f08188f60 0x7f6f080722b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:59.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.846+0000 7f6f06000640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f6f080c9d60 0x7f6f08189340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:58130/0 (socket says 172.21.15.99:58130) 2024-02-21T23:04:59.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.846+0000 7f6f06000640 1 -- 172.21.15.99:0/4270082755 learned_addr learned my addr 172.21.15.99:0/4270082755 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:04:59.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.846+0000 7f6f06a00640 1 -- 172.21.15.99:0/4270082755 >> v1:172.21.15.181:6789/0 conn(0x7f6f080c9d60 legacy=0x7f6f08189340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:59.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.846+0000 7f6f06a00640 1 -- 172.21.15.99:0/4270082755 >> v1:172.21.15.162:6789/0 conn(0x7f6f080ca1c0 legacy=0x7f6f0806f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:59.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.846+0000 7f6f05600640 1 -- 172.21.15.99:0/4270082755 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3606408190 0 0) 0x7f6f08071210 con 0x7f6f080c9d60 2024-02-21T23:04:59.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.846+0000 7f6f06a00640 1 -- 172.21.15.99:0/4270082755 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f080714f0 con 0x7f6f08188f60 2024-02-21T23:04:59.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.847+0000 7f6f06a00640 1 --2- 172.21.15.99:0/4270082755 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f08188f60 0x7f6f080722b0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f6ef80097a0 tx=0x7f6ef802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a05fef7573518dc server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:04:59.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.848+0000 7f6f05600640 1 -- 172.21.15.99:0/4270082755 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef8035020 con 0x7f6f08188f60 2024-02-21T23:04:59.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.848+0000 7f6f05600640 1 -- 172.21.15.99:0/4270082755 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ef8031830 con 0x7f6f08188f60 2024-02-21T23:04:59.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.848+0000 7f6f05600640 1 -- 172.21.15.99:0/4270082755 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef8031c00 con 0x7f6f08188f60 2024-02-21T23:04:59.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.848+0000 7f6f07e00640 1 -- 172.21.15.99:0/4270082755 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f08188f60 msgr2=0x7f6f080722b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:59.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.848+0000 7f6f07e00640 1 --2- 172.21.15.99:0/4270082755 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f08188f60 0x7f6f080722b0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f6ef80097a0 tx=0x7f6ef802b8d0 comp rx=0 tx=0).stop 2024-02-21T23:04:59.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.848+0000 7f6f07e00640 1 -- 172.21.15.99:0/4270082755 shutdown_connections 2024-02-21T23:04:59.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.848+0000 7f6f07e00640 1 --2- 172.21.15.99:0/4270082755 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f08188f60 0x7f6f080722b0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:59.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.849+0000 7f6f07e00640 1 -- 172.21.15.99:0/4270082755 >> 172.21.15.99:0/4270082755 conn(0x7f6f080f73f0 msgr2=0x7f6f080f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:04:59.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.849+0000 7f6f07e00640 1 -- 172.21.15.99:0/4270082755 shutdown_connections 2024-02-21T23:04:59.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.849+0000 7f6f07e00640 1 -- 172.21.15.99:0/4270082755 wait complete. 2024-02-21T23:04:59.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.851+0000 7f6f07e00640 1 Processor -- start 2024-02-21T23:04:59.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.851+0000 7f6f07e00640 1 -- start start 2024-02-21T23:04:59.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.853+0000 7f6f07e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f080c9d60 0x7f6f081702c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:59.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.853+0000 7f6f07e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f080ca1c0 0x7f6f08186430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:59.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.853+0000 7f6f07e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f08188f60 0x7f6f08184d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:59.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.853+0000 7f6f07e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f08183340 con 0x7f6f08188f60 2024-02-21T23:04:59.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.853+0000 7f6f07e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f08071ab0 con 0x7f6f080ca1c0 2024-02-21T23:04:59.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.853+0000 7f6f07e00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f080f6880 con 0x7f6f080c9d60 2024-02-21T23:04:59.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.853+0000 7f6f06000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f080ca1c0 0x7f6f08186430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:59.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.853+0000 7f6f06a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f080c9d60 0x7f6f081702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:59.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.853+0000 7f6f06000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f080ca1c0 0x7f6f08186430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:42750/0 (socket says 172.21.15.99:42750) 2024-02-21T23:04:59.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.853+0000 7f6f06a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f080c9d60 0x7f6f081702c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:41500/0 (socket says 172.21.15.99:41500) 2024-02-21T23:04:59.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.853+0000 7f6f06000640 1 -- 172.21.15.99:0/1196471163 learned_addr learned my addr 172.21.15.99:0/1196471163 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:04:59.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.853+0000 7f6f07400640 1 --2- 172.21.15.99:0/1196471163 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f08188f60 0x7f6f08184d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:59.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.854+0000 7f6f06000640 1 -- 172.21.15.99:0/1196471163 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f080c9d60 msgr2=0x7f6f081702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:59.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.854+0000 7f6f06000640 1 --2- 172.21.15.99:0/1196471163 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f080c9d60 0x7f6f081702c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:59.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.854+0000 7f6f06000640 1 -- 172.21.15.99:0/1196471163 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f08188f60 msgr2=0x7f6f08184d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:59.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.854+0000 7f6f06000640 1 --2- 172.21.15.99:0/1196471163 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f08188f60 0x7f6f08184d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:59.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.854+0000 7f6f06000640 1 -- 172.21.15.99:0/1196471163 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f08187480 con 0x7f6f080ca1c0 2024-02-21T23:04:59.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.854+0000 7f6f06000640 1 --2- 172.21.15.99:0/1196471163 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f080ca1c0 0x7f6f08186430 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f6ef400c4a0 tx=0x7f6ef400c960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:04:59.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.855+0000 7f6efea00640 1 -- 172.21.15.99:0/1196471163 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef4018070 con 0x7f6f080ca1c0 2024-02-21T23:04:59.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.855+0000 7f6efea00640 1 -- 172.21.15.99:0/1196471163 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ef40074e0 con 0x7f6f080ca1c0 2024-02-21T23:04:59.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.855+0000 7f6f07e00640 1 -- 172.21.15.99:0/1196471163 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f081783a0 con 0x7f6f080ca1c0 2024-02-21T23:04:59.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.855+0000 7f6efea00640 1 -- 172.21.15.99:0/1196471163 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef4004a20 con 0x7f6f080ca1c0 2024-02-21T23:04:59.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.855+0000 7f6f07e00640 1 -- 172.21.15.99:0/1196471163 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f08183f80 con 0x7f6f080ca1c0 2024-02-21T23:04:59.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.859+0000 7f6efea00640 1 -- 172.21.15.99:0/1196471163 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f6ef401b070 con 0x7f6f080ca1c0 2024-02-21T23:04:59.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.860+0000 7f6f103fd740 1 Processor -- start 2024-02-21T23:04:59.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.860+0000 7f6f103fd740 1 -- start start 2024-02-21T23:04:59.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.861+0000 7f6f103fd740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f957800660 0x55f957800a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:59.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.861+0000 7f6f103fd740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f95783b330 0x55f95783b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:59.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.861+0000 7f6f103fd740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f95783bcf0 0x55f95783c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:59.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.861+0000 7f6f103fd740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f957728b50 con 0x55f957800660 2024-02-21T23:04:59.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.861+0000 7f6f103fd740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9576d1da0 con 0x55f95783b330 2024-02-21T23:04:59.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.861+0000 7f6f103fd740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f957724bf0 con 0x55f95783bcf0 2024-02-21T23:04:59.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.861+0000 7f6efea00640 1 --2- 172.21.15.99:0/1196471163 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f6ee809efa0 0x7f6ee80a1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:59.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.861+0000 7f6f07400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f957800660 0x55f957800a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:59.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.861+0000 7f6f06a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f95783b330 0x55f95783b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:59.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.861+0000 7f6efea00640 1 -- 172.21.15.99:0/1196471163 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f6ef40c91e0 con 0x7f6f080ca1c0 2024-02-21T23:04:59.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.862+0000 7f6f07400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f957800660 0x55f957800a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56020/0 (socket says 172.21.15.99:56020) 2024-02-21T23:04:59.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.862+0000 7f6f07400640 1 -- 172.21.15.99:0/3082222936 learned_addr learned my addr 172.21.15.99:0/3082222936 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:04:59.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.862+0000 7f6f07400640 1 --2- 172.21.15.99:0/1196471163 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f6ee809efa0 0x7f6ee80a1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:59.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.862+0000 7f6f06000640 1 --2- 172.21.15.99:0/3082222936 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f95783bcf0 0x55f95783c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:59.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.862+0000 7f6f06a00640 1 -- 172.21.15.99:0/3082222936 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f95783bcf0 msgr2=0x55f95783c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:04:59.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.862+0000 7f6f06a00640 1 --2- 172.21.15.99:0/3082222936 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f95783bcf0 0x55f95783c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:59.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.862+0000 7f6f06a00640 1 -- 172.21.15.99:0/3082222936 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f957800660 msgr2=0x55f957800a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:04:59.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.862+0000 7f6f06a00640 1 --2- 172.21.15.99:0/3082222936 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f957800660 0x55f957800a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:59.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.862+0000 7f6f06a00640 1 -- 172.21.15.99:0/3082222936 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f9576f4f80 con 0x55f95783b330 2024-02-21T23:04:59.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.862+0000 7f6f06a00640 1 --2- 172.21.15.99:0/3082222936 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f95783b330 0x55f95783b7b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6f0808e4b0 tx=0x7f6ef8008030 comp rx=0 tx=0).ready entity=mon.1 client_cookie=930e79566a48b8e4 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:04:59.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.863+0000 7f6f07400640 1 --2- 172.21.15.99:0/1196471163 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f6ee809efa0 0x7f6ee80a1460 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6f00007bd0 tx=0x7f6f00001a90 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:04:59.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.863+0000 7f6ef3400640 1 -- 172.21.15.99:0/3082222936 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef8049070 con 0x55f95783b330 2024-02-21T23:04:59.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.863+0000 7f6ef3400640 1 -- 172.21.15.99:0/3082222936 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ef8031d60 con 0x55f95783b330 2024-02-21T23:04:59.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.863+0000 7f6ef3400640 1 -- 172.21.15.99:0/3082222936 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef8035040 con 0x55f95783b330 2024-02-21T23:04:59.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.864+0000 7f6f103fd740 1 -- 172.21.15.99:0/3082222936 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f95783b330 msgr2=0x55f95783b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:59.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.864+0000 7f6f103fd740 1 --2- 172.21.15.99:0/3082222936 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f95783b330 0x55f95783b7b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6f0808e4b0 tx=0x7f6ef8008030 comp rx=0 tx=0).stop 2024-02-21T23:04:59.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.864+0000 7f6f103fd740 1 -- 172.21.15.99:0/3082222936 shutdown_connections 2024-02-21T23:04:59.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.864+0000 7f6f103fd740 1 --2- 172.21.15.99:0/3082222936 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f95783bcf0 0x55f95783c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:59.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.864+0000 7f6f103fd740 1 --2- 172.21.15.99:0/3082222936 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f95783b330 0x55f95783b7b0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:59.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.864+0000 7f6f103fd740 1 --2- 172.21.15.99:0/3082222936 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f957800660 0x55f957800a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:59.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.864+0000 7f6f103fd740 1 -- 172.21.15.99:0/3082222936 >> 172.21.15.99:0/3082222936 conn(0x55f9577c26d0 msgr2=0x55f9577c3750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:04:59.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.864+0000 7f6f103fd740 1 -- 172.21.15.99:0/3082222936 shutdown_connections 2024-02-21T23:04:59.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.864+0000 7f6f103fd740 1 -- 172.21.15.99:0/3082222936 wait complete. 2024-02-21T23:04:59.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.865+0000 7f6f103fd740 1 -- start start 2024-02-21T23:04:59.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.865+0000 7f6f103fd740 1 Processor -- start 2024-02-21T23:04:59.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.866+0000 7f6f103fd740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f95783b330 0x55f9577c0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:59.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.866+0000 7f6f103fd740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f95783bcf0 0x55f9577eb500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:59.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.866+0000 7f6f103fd740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f957804be0 0x55f95782f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:59.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.866+0000 7f6f103fd740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f95783a0a0 con 0x55f95783bcf0 2024-02-21T23:04:59.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.866+0000 7f6f103fd740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9576c7380 con 0x55f957804be0 2024-02-21T23:04:59.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.866+0000 7f6f103fd740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f957839dc0 con 0x55f95783b330 2024-02-21T23:04:59.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.867+0000 7f6f103fd740 10 client.0 _ll_register_callbacks cb 0x55f957720280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:04:59.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.867+0000 7f6f06a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f95783b330 0x55f9577c0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:59.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.867+0000 7f6f06000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f95783bcf0 0x55f9577eb500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:59.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.867+0000 7f6f06a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f95783b330 0x55f9577c0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:41532/0 (socket says 172.21.15.99:41532) 2024-02-21T23:04:59.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.867+0000 7f6f06a00640 1 -- 172.21.15.99:0/738657120 learned_addr learned my addr 172.21.15.99:0/738657120 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:04:59.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.867+0000 7f6f07400640 1 --2- 172.21.15.99:0/738657120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f957804be0 0x55f95782f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:59.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.867+0000 7f6f06a00640 1 -- 172.21.15.99:0/738657120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f957804be0 msgr2=0x55f95782f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:04:59.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.867+0000 7f6f06a00640 1 --2- 172.21.15.99:0/738657120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f957804be0 0x55f95782f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:59.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.867+0000 7f6f06a00640 1 -- 172.21.15.99:0/738657120 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f95783bcf0 msgr2=0x55f9577eb500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:04:59.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.867+0000 7f6f06a00640 1 --2- 172.21.15.99:0/738657120 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f95783bcf0 0x55f9577eb500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:59.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.867+0000 7f6f06a00640 1 -- 172.21.15.99:0/738657120 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f9576efc20 con 0x55f95783b330 2024-02-21T23:04:59.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.868+0000 7f6f06a00640 1 --2- 172.21.15.99:0/738657120 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f95783b330 0x55f9577c0910 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f6ef8000c00 tx=0x7f6ef8004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97f76e308aeb12f1 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:04:59.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.868+0000 7f6ee7e00640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-02-21T23:04:59.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.868+0000 7f6ee7e00640 1 -- 172.21.15.99:0/738657120 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef8053020 con 0x55f95783b330 2024-02-21T23:04:59.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.868+0000 7f6f103fd740 1 -- 172.21.15.99:0/738657120 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6ef8031d60 con 0x55f95783b330 2024-02-21T23:04:59.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.868+0000 7f6ee7e00640 1 -- 172.21.15.99:0/738657120 <== mon.2 v2:172.21.15.181:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f6ef8004240 con 0x55f95783b330 2024-02-21T23:04:59.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.868+0000 7f6ee7e00640 1 -- 172.21.15.99:0/738657120 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6ef805b050 con 0x55f95783b330 2024-02-21T23:04:59.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.868+0000 7f6f103fd740 10 client.5777 fetch_fsmap learned FSMap version 16 2024-02-21T23:04:59.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.868+0000 7f6f103fd740 1 -- 172.21.15.99:0/738657120 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55f95743d3f0 con 0x55f95783b330 2024-02-21T23:04:59.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.869+0000 7f6ee7e00640 1 -- 172.21.15.99:0/738657120 <== mon.2 v2:172.21.15.181:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ef8031d60 con 0x55f95783b330 2024-02-21T23:04:59.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.869+0000 7f6ee7e00640 1 -- 172.21.15.99:0/738657120 <== mon.2 v2:172.21.15.181:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f6ef8003610 con 0x55f95783b330 2024-02-21T23:04:59.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.869+0000 7f6f103fd740 10 client.5777 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T23:04:59.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.869+0000 7f6f103fd740 10 client.5777 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.d 2024-02-21T23:04:59.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.869+0000 7f6f103fd740 20 client.5777 populate_metadata read hostname 'smithi099' 2024-02-21T23:04:59.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.869+0000 7f6f103fd740 1 --2- 172.21.15.99:0/738657120 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x55f957830190 0x55f957847b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:59.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.869+0000 7f6f103fd740 4 client.5777 mds_command: new command op to 4348 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:04:59.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.869+0000 7f6f103fd740 1 -- 172.21.15.99:0/738657120 --> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f957736090 con 0x55f957830190 2024-02-21T23:04:59.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.870+0000 7f6f06000640 1 --2- 172.21.15.99:0/738657120 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x55f957830190 0x55f957847b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:59.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.870+0000 7f6f06000640 1 --2- 172.21.15.99:0/738657120 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x55f957830190 0x55f957847b30 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=824933709e7dc134 server_cookie=66b4c6d7320330be in_seq=0 out_seq=0 2024-02-21T23:04:59.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.870+0000 7f6ee7e00640 10 client.5777 ms_handle_connect on v2:172.21.15.99:6834/2243461688 2024-02-21T23:04:59.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.871+0000 7f6ee7e00640 1 -- 172.21.15.99:0/738657120 <== mds.2 v2:172.21.15.99:6834/2243461688 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55f957736090 con 0x55f957830190 2024-02-21T23:04:59.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.871+0000 7f6ee7e00640 10 client.5777 handle_command_reply: tid=0 2024-02-21T23:04:59.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.871+0000 7f6f103fd740 1 client.5777 shutdown 2024-02-21T23:04:59.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.871+0000 7f6f103fd740 1 -- 172.21.15.99:0/738657120 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f95783b330 msgr2=0x55f9577c0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:59.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.871+0000 7f6f103fd740 1 --2- 172.21.15.99:0/738657120 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f95783b330 0x55f9577c0910 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f6ef8000c00 tx=0x7f6ef8004730 comp rx=0 tx=0).stop 2024-02-21T23:04:59.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.872+0000 7f6f103fd740 1 -- 172.21.15.99:0/738657120 shutdown_connections 2024-02-21T23:04:59.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.872+0000 7f6f103fd740 1 --2- 172.21.15.99:0/738657120 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x55f957830190 0x55f957847b30 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:59.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.872+0000 7f6f103fd740 1 --2- 172.21.15.99:0/738657120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f957804be0 0x55f95782f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:59.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.872+0000 7f6f103fd740 1 --2- 172.21.15.99:0/738657120 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f95783bcf0 0x55f9577eb500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:59.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.872+0000 7f6f103fd740 1 --2- 172.21.15.99:0/738657120 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f95783b330 0x55f9577c0910 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:59.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.872+0000 7f6ee7e00640 0 client.5777 ms_handle_reset on v2:172.21.15.99:6834/2243461688 2024-02-21T23:04:59.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.872+0000 7f6f103fd740 1 -- 172.21.15.99:0/738657120 >> 172.21.15.99:0/738657120 conn(0x55f957800660 msgr2=0x55f957839590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:04:59.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.872+0000 7f6f103fd740 1 -- 172.21.15.99:0/738657120 shutdown_connections 2024-02-21T23:04:59.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.872+0000 7f6f103fd740 1 -- 172.21.15.99:0/738657120 wait complete. 2024-02-21T23:04:59.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.872+0000 7f6f103fd740 20 client.5777 trim_cache size 0 max 16384 2024-02-21T23:04:59.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.885+0000 7f6f103fd740 1 Processor -- start 2024-02-21T23:04:59.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.885+0000 7f6f103fd740 1 -- start start 2024-02-21T23:04:59.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.886+0000 7f6f103fd740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f957804be0 0x55f957804fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:59.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.886+0000 7f6f103fd740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f95783b330 0x55f9577eda60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:59.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.886+0000 7f6f103fd740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f95783bcf0 0x55f9577f5710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:59.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.886+0000 7f6f103fd740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f0822c910 con 0x55f957804be0 2024-02-21T23:04:59.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.886+0000 7f6f103fd740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f0822a4b0 con 0x55f95783b330 2024-02-21T23:04:59.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.886+0000 7f6f103fd740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f0821fc70 con 0x55f95783bcf0 2024-02-21T23:04:59.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.887+0000 7f6f06a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f957804be0 0x55f957804fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:59.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.887+0000 7f6f06a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f957804be0 0x55f957804fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56042/0 (socket says 172.21.15.99:56042) 2024-02-21T23:04:59.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.887+0000 7f6f06a00640 1 -- 172.21.15.99:0/1322041167 learned_addr learned my addr 172.21.15.99:0/1322041167 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:04:59.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.887+0000 7f6f06000640 1 --2- 172.21.15.99:0/1322041167 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f95783b330 0x55f9577eda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:59.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.887+0000 7f6f07400640 1 --2- 172.21.15.99:0/1322041167 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f95783bcf0 0x55f9577f5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:59.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.887+0000 7f6f06000640 1 -- 172.21.15.99:0/1322041167 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f95783bcf0 msgr2=0x55f9577f5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:04:59.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.887+0000 7f6f06000640 1 --2- 172.21.15.99:0/1322041167 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f95783bcf0 0x55f9577f5710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:59.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.887+0000 7f6f06000640 1 -- 172.21.15.99:0/1322041167 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f957804be0 msgr2=0x55f957804fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:04:59.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.887+0000 7f6f06000640 1 --2- 172.21.15.99:0/1322041167 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f957804be0 0x55f957804fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:59.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.887+0000 7f6f06000640 1 -- 172.21.15.99:0/1322041167 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f9575077d0 con 0x55f95783b330 2024-02-21T23:04:59.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.887+0000 7f6f06a00640 1 --2- 172.21.15.99:0/1322041167 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f957804be0 0x55f957804fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:04:59.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.888+0000 7f6f06000640 1 --2- 172.21.15.99:0/1322041167 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f95783b330 0x55f9577eda60 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6ef40c68a0 tx=0x7f6ef4006000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e03ff7f90e65d123 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:04:59.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.888+0000 7f6ef2a00640 1 -- 172.21.15.99:0/1322041167 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef409f220 con 0x55f95783b330 2024-02-21T23:04:59.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.888+0000 7f6ef2a00640 1 -- 172.21.15.99:0/1322041167 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ef4094e30 con 0x55f95783b330 2024-02-21T23:04:59.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.888+0000 7f6ef2a00640 1 -- 172.21.15.99:0/1322041167 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef40c6a40 con 0x55f95783b330 2024-02-21T23:04:59.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.888+0000 7f6f103fd740 1 -- 172.21.15.99:0/1322041167 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f95783b330 msgr2=0x55f9577eda60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:59.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.888+0000 7f6f103fd740 1 --2- 172.21.15.99:0/1322041167 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f95783b330 0x55f9577eda60 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6ef40c68a0 tx=0x7f6ef4006000 comp rx=0 tx=0).stop 2024-02-21T23:04:59.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.889+0000 7f6f103fd740 1 -- 172.21.15.99:0/1322041167 shutdown_connections 2024-02-21T23:04:59.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.889+0000 7f6f103fd740 1 --2- 172.21.15.99:0/1322041167 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f95783bcf0 0x55f9577f5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:59.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.889+0000 7f6f103fd740 1 --2- 172.21.15.99:0/1322041167 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f95783b330 0x55f9577eda60 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:59.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.889+0000 7f6f103fd740 1 --2- 172.21.15.99:0/1322041167 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f957804be0 0x55f957804fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:59.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.889+0000 7f6f103fd740 1 -- 172.21.15.99:0/1322041167 >> 172.21.15.99:0/1322041167 conn(0x55f957800660 msgr2=0x55f9577f6980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:04:59.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.889+0000 7f6f103fd740 1 -- 172.21.15.99:0/1322041167 shutdown_connections 2024-02-21T23:04:59.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.889+0000 7f6f103fd740 1 -- 172.21.15.99:0/1322041167 wait complete. 2024-02-21T23:04:59.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.890+0000 7f6f103fd740 1 -- start start 2024-02-21T23:04:59.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.890+0000 7f6f103fd740 1 Processor -- start 2024-02-21T23:04:59.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.891+0000 7f6f103fd740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f957804be0 0x55f957837f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:59.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.891+0000 7f6f103fd740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f95783b330 0x55f957837340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:59.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.891+0000 7f6f103fd740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f95783bcf0 0x55f95784c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:59.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.891+0000 7f6f103fd740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f080f94b0 con 0x55f95783b330 2024-02-21T23:04:59.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.891+0000 7f6f103fd740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f08229e90 con 0x55f95783bcf0 2024-02-21T23:04:59.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.891+0000 7f6f103fd740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f08229290 con 0x55f957804be0 2024-02-21T23:04:59.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.891+0000 7f6f103fd740 10 client.0 _ll_register_callbacks cb 0x7f6ef8047070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:04:59.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.892+0000 7f6f06000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f95783b330 0x55f957837340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:59.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.892+0000 7f6f07400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f95783bcf0 0x55f95784c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:59.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.892+0000 7f6f07400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f95783bcf0 0x55f95784c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:42788/0 (socket says 172.21.15.99:42788) 2024-02-21T23:04:59.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.892+0000 7f6f06000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f95783b330 0x55f957837340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56050/0 (socket says 172.21.15.99:56050) 2024-02-21T23:04:59.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.892+0000 7f6f06000640 1 -- 172.21.15.99:0/1199111050 learned_addr learned my addr 172.21.15.99:0/1199111050 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:04:59.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.892+0000 7f6f06000640 1 -- 172.21.15.99:0/1199111050 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f957804be0 msgr2=0x55f957837f50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T23:04:59.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.892+0000 7f6f06000640 1 --2- 172.21.15.99:0/1199111050 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f957804be0 0x55f957837f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:59.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.892+0000 7f6f06000640 1 -- 172.21.15.99:0/1199111050 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f95783bcf0 msgr2=0x55f95784c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:04:59.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.892+0000 7f6f06000640 1 --2- 172.21.15.99:0/1199111050 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f95783bcf0 0x55f95784c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:59.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.892+0000 7f6f06000640 1 -- 172.21.15.99:0/1199111050 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f957831060 con 0x55f95783b330 2024-02-21T23:04:59.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.893+0000 7f6f06000640 1 --2- 172.21.15.99:0/1199111050 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f95783b330 0x55f957837340 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f6ef4096830 tx=0x7f6ef4009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8239785a8d356ac8 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:04:59.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.893+0000 7f6ee7e00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:04:59.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.893+0000 7f6ee7e00640 1 -- 172.21.15.99:0/1199111050 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef409f220 con 0x55f95783b330 2024-02-21T23:04:59.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.893+0000 7f6ee7e00640 1 -- 172.21.15.99:0/1199111050 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f6ef40c6a40 con 0x55f95783b330 2024-02-21T23:04:59.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.893+0000 7f6f103fd740 1 -- 172.21.15.99:0/1199111050 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6ef4094e30 con 0x55f95783b330 2024-02-21T23:04:59.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.893+0000 7f6ee7e00640 1 -- 172.21.15.99:0/1199111050 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6ef40c6c40 con 0x55f95783b330 2024-02-21T23:04:59.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.893+0000 7f6f103fd740 10 client.5655 fetch_fsmap learned FSMap version 16 2024-02-21T23:04:59.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.893+0000 7f6f103fd740 1 -- 172.21.15.99:0/1199111050 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55f957830aa0 con 0x55f95783b330 2024-02-21T23:04:59.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.893+0000 7f6ee7e00640 1 -- 172.21.15.99:0/1199111050 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ef4094e30 con 0x55f95783b330 2024-02-21T23:04:59.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.894+0000 7f6ee7e00640 1 -- 172.21.15.99:0/1199111050 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f6ef4004bc0 con 0x55f95783b330 2024-02-21T23:04:59.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.894+0000 7f6f103fd740 10 client.5655 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T23:04:59.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.894+0000 7f6f103fd740 10 client.5655 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.d 2024-02-21T23:04:59.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.894+0000 7f6f103fd740 20 client.5655 populate_metadata read hostname 'smithi099' 2024-02-21T23:04:59.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.894+0000 7f6f103fd740 1 --2- 172.21.15.99:0/1199111050 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x55f9577f91c0 0x55f9578a08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:04:59.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.894+0000 7f6f103fd740 4 client.5655 mds_command: new command op to 4348 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T23:04:59.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.894+0000 7f6f103fd740 1 -- 172.21.15.99:0/1199111050 --> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55f9577c2e30 con 0x55f9577f91c0 2024-02-21T23:04:59.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.895+0000 7f6f06a00640 1 --2- 172.21.15.99:0/1199111050 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x55f9577f91c0 0x55f9578a08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:04:59.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.895+0000 7f6f06a00640 1 --2- 172.21.15.99:0/1199111050 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x55f9577f91c0 0x55f9578a08c0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=13a4a412ed8d7c4b server_cookie=7ec26a6220a67c3 in_seq=0 out_seq=0 2024-02-21T23:04:59.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.895+0000 7f6ee7e00640 10 client.5655 ms_handle_connect on v2:172.21.15.99:6834/2243461688 2024-02-21T23:04:59.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.896+0000 7f6ee7e00640 1 -- 172.21.15.99:0/1199111050 <== mds.2 v2:172.21.15.99:6834/2243461688 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55f9577c2e30 con 0x55f9577f91c0 2024-02-21T23:04:59.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.896+0000 7f6ee7e00640 10 client.5655 handle_command_reply: tid=0 2024-02-21T23:04:59.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.896+0000 7f6f103fd740 1 client.5655 shutdown 2024-02-21T23:04:59.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.896+0000 7f6f103fd740 1 -- 172.21.15.99:0/1199111050 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f95783b330 msgr2=0x55f957837340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:59.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.896+0000 7f6f103fd740 1 --2- 172.21.15.99:0/1199111050 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f95783b330 0x55f957837340 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f6ef4096830 tx=0x7f6ef4009040 comp rx=0 tx=0).stop 2024-02-21T23:04:59.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.896+0000 7f6f103fd740 1 -- 172.21.15.99:0/1199111050 shutdown_connections 2024-02-21T23:04:59.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.896+0000 7f6f103fd740 1 --2- 172.21.15.99:0/1199111050 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x55f9577f91c0 0x55f9578a08c0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:59.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.896+0000 7f6f103fd740 1 --2- 172.21.15.99:0/1199111050 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f95783bcf0 0x55f95784c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:59.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.896+0000 7f6f103fd740 1 --2- 172.21.15.99:0/1199111050 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f95783b330 0x55f957837340 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:59.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.896+0000 7f6ee7e00640 0 client.5655 ms_handle_reset on v2:172.21.15.99:6834/2243461688 2024-02-21T23:04:59.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.896+0000 7f6f103fd740 1 --2- 172.21.15.99:0/1199111050 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f957804be0 0x55f957837f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:59.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.896+0000 7f6f103fd740 1 -- 172.21.15.99:0/1199111050 >> 172.21.15.99:0/1199111050 conn(0x55f957800660 msgr2=0x55f9577ba630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:04:59.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.896+0000 7f6f103fd740 1 -- 172.21.15.99:0/1199111050 shutdown_connections 2024-02-21T23:04:59.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.896+0000 7f6f103fd740 1 -- 172.21.15.99:0/1199111050 wait complete. 2024-02-21T23:04:59.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.897+0000 7f6f103fd740 20 client.5655 trim_cache size 0 max 16384 2024-02-21T23:04:59.887 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-02-21T23:04:59.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.897+0000 7f6f07e00640 1 -- 172.21.15.99:0/1196471163 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f6ee809efa0 msgr2=0x7f6ee80a1460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:59.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.897+0000 7f6f07e00640 1 --2- 172.21.15.99:0/1196471163 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f6ee809efa0 0x7f6ee80a1460 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6f00007bd0 tx=0x7f6f00001a90 comp rx=0 tx=0).stop 2024-02-21T23:04:59.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.897+0000 7f6f07e00640 1 -- 172.21.15.99:0/1196471163 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f080ca1c0 msgr2=0x7f6f08186430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:04:59.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.897+0000 7f6f07e00640 1 --2- 172.21.15.99:0/1196471163 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f080ca1c0 0x7f6f08186430 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f6ef400c4a0 tx=0x7f6ef400c960 comp rx=0 tx=0).stop 2024-02-21T23:04:59.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.897+0000 7f6f07e00640 1 -- 172.21.15.99:0/1196471163 shutdown_connections 2024-02-21T23:04:59.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.897+0000 7f6f07e00640 1 --2- 172.21.15.99:0/1196471163 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f6ee809efa0 0x7f6ee80a1460 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:59.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.897+0000 7f6f07e00640 1 --2- 172.21.15.99:0/1196471163 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f08188f60 0x7f6f08184d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:59.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.897+0000 7f6f07e00640 1 --2- 172.21.15.99:0/1196471163 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f080ca1c0 0x7f6f08186430 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:59.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.897+0000 7f6f07e00640 1 --2- 172.21.15.99:0/1196471163 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f080c9d60 0x7f6f081702c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:04:59.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.897+0000 7f6f07e00640 1 -- 172.21.15.99:0/1196471163 >> 172.21.15.99:0/1196471163 conn(0x7f6f080f73f0 msgr2=0x7f6f0806e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:04:59.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.899+0000 7f6f07e00640 1 -- 172.21.15.99:0/1196471163 shutdown_connections 2024-02-21T23:04:59.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:04:59.899+0000 7f6f07e00640 1 -- 172.21.15.99:0/1196471163 wait complete. 2024-02-21T23:04:59.906 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T23:04:59.907 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-02-21T23:05:00.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.129+0000 7f48b6000640 1 Processor -- start 2024-02-21T23:05:00.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.130+0000 7f48b6000640 1 -- start start 2024-02-21T23:05:00.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.132+0000 7f48b6000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f48b0186310 0x7f48b0187d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:00.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.133+0000 7f48b6000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48b01889c0 con 0x7f48b00cf2c0 2024-02-21T23:05:00.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.133+0000 7f48b6000640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48b00fafa0 con 0x7f48b01866f0 2024-02-21T23:05:00.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.133+0000 7f48b6000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48b0186cd0 con 0x7f48b0186310 2024-02-21T23:05:00.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.133+0000 7f48af400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f48b0186310 0x7f48b0187d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:00.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.133+0000 7f48aea00640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f48b01866f0 0x7f48b01882b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:58142/0 (socket says 172.21.15.99:58142) 2024-02-21T23:05:00.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.133+0000 7f48aea00640 1 -- 172.21.15.99:0/4208653904 learned_addr learned my addr 172.21.15.99:0/4208653904 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:05:00.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.133+0000 7f48af400640 1 -- 172.21.15.99:0/4208653904 >> v1:172.21.15.181:6789/0 conn(0x7f48b01866f0 legacy=0x7f48b01882b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:00.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.134+0000 7f48af400640 1 -- 172.21.15.99:0/4208653904 >> v1:172.21.15.162:6789/0 conn(0x7f48b00cf2c0 legacy=0x7f48b00cf6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:00.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.133+0000 7f48ae000640 1 -- 172.21.15.99:0/4208653904 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4203859125 0 0) 0x7f48b00fafa0 con 0x7f48b01866f0 2024-02-21T23:05:00.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.134+0000 7f48af400640 1 -- 172.21.15.99:0/4208653904 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48b0186fb0 con 0x7f48b0186310 2024-02-21T23:05:00.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.135+0000 7f48af400640 1 --2- 172.21.15.99:0/4208653904 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48b0186310 0x7f48b0187d70 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f48a00097a0 tx=0x7f48a002b680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bdbec6a078cc5bb7 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:05:00.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.136+0000 7f48ae000640 1 -- 172.21.15.99:0/4208653904 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a0037070 con 0x7f48b0186310 2024-02-21T23:05:00.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.136+0000 7f48ae000640 1 -- 172.21.15.99:0/4208653904 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48a0030710 con 0x7f48b0186310 2024-02-21T23:05:00.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.136+0000 7f48ae000640 1 -- 172.21.15.99:0/4208653904 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a0030ae0 con 0x7f48b0186310 2024-02-21T23:05:00.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.136+0000 7f48b6000640 1 -- 172.21.15.99:0/4208653904 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48b0186310 msgr2=0x7f48b0187d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:00.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.136+0000 7f48b6000640 1 --2- 172.21.15.99:0/4208653904 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48b0186310 0x7f48b0187d70 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f48a00097a0 tx=0x7f48a002b680 comp rx=0 tx=0).stop 2024-02-21T23:05:00.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.136+0000 7f48b6000640 1 -- 172.21.15.99:0/4208653904 shutdown_connections 2024-02-21T23:05:00.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.136+0000 7f48b6000640 1 --2- 172.21.15.99:0/4208653904 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48b0186310 0x7f48b0187d70 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:00.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.136+0000 7f48b6000640 1 -- 172.21.15.99:0/4208653904 >> 172.21.15.99:0/4208653904 conn(0x7f48b00740b0 msgr2=0x7f48b00744c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:05:00.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.137+0000 7f48b6000640 1 -- 172.21.15.99:0/4208653904 shutdown_connections 2024-02-21T23:05:00.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.137+0000 7f48b6000640 1 -- 172.21.15.99:0/4208653904 wait complete. 2024-02-21T23:05:00.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.139+0000 7f48b6000640 1 Processor -- start 2024-02-21T23:05:00.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.139+0000 7f48b6000640 1 -- start start 2024-02-21T23:05:00.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.140+0000 7f48b6000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48b00cf2c0 0x7f48b00d4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:00.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.140+0000 7f48b6000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f48b0186310 0x7f48b016e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:00.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.140+0000 7f48b6000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f48b01866f0 0x7f48b017d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:00.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.140+0000 7f48b6000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b0187850 con 0x7f48b0186310 2024-02-21T23:05:00.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.140+0000 7f48b6000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b0187570 con 0x7f48b00cf2c0 2024-02-21T23:05:00.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.140+0000 7f48b6000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b00fa7a0 con 0x7f48b01866f0 2024-02-21T23:05:00.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.140+0000 7f48af400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48b00cf2c0 0x7f48b00d4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:00.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.140+0000 7f48af400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48b00cf2c0 0x7f48b00d4780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:42796/0 (socket says 172.21.15.99:42796) 2024-02-21T23:05:00.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.140+0000 7f48af400640 1 -- 172.21.15.99:0/3876690329 learned_addr learned my addr 172.21.15.99:0/3876690329 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:05:00.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.141+0000 7f48aea00640 1 --2- 172.21.15.99:0/3876690329 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f48b0186310 0x7f48b016e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:00.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.141+0000 7f48afe00640 1 --2- 172.21.15.99:0/3876690329 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f48b01866f0 0x7f48b017d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:00.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.141+0000 7f48af400640 1 -- 172.21.15.99:0/3876690329 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f48b01866f0 msgr2=0x7f48b017d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:00.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.141+0000 7f48af400640 1 --2- 172.21.15.99:0/3876690329 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f48b01866f0 0x7f48b017d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:00.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.141+0000 7f48af400640 1 -- 172.21.15.99:0/3876690329 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f48b0186310 msgr2=0x7f48b016e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:00.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.141+0000 7f48af400640 1 --2- 172.21.15.99:0/3876690329 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f48b0186310 0x7f48b016e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:00.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.141+0000 7f48af400640 1 -- 172.21.15.99:0/3876690329 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48b00d4e20 con 0x7f48b00cf2c0 2024-02-21T23:05:00.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.141+0000 7f48aea00640 1 --2- 172.21.15.99:0/3876690329 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f48b0186310 0x7f48b016e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:05:00.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.141+0000 7f48af400640 1 --2- 172.21.15.99:0/3876690329 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48b00cf2c0 0x7f48b00d4780 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f48a00097a0 tx=0x7f48a00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:05:00.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.141+0000 7f48a7400640 1 -- 172.21.15.99:0/3876690329 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a0037040 con 0x7f48b00cf2c0 2024-02-21T23:05:00.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.141+0000 7f48a7400640 1 -- 172.21.15.99:0/3876690329 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48a00329c0 con 0x7f48b00cf2c0 2024-02-21T23:05:00.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.141+0000 7f48a7400640 1 -- 172.21.15.99:0/3876690329 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a0032db0 con 0x7f48b00cf2c0 2024-02-21T23:05:00.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.142+0000 7f48b6000640 1 -- 172.21.15.99:0/3876690329 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48b00d5100 con 0x7f48b00cf2c0 2024-02-21T23:05:00.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.142+0000 7f48b6000640 1 -- 172.21.15.99:0/3876690329 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48b00d56c0 con 0x7f48b00cf2c0 2024-02-21T23:05:00.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.145+0000 7f48b8f69740 1 Processor -- start 2024-02-21T23:05:00.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.146+0000 7f48b8f69740 1 -- start start 2024-02-21T23:05:00.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.146+0000 7f48a7400640 1 -- 172.21.15.99:0/3876690329 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f48a0004030 con 0x7f48b00cf2c0 2024-02-21T23:05:00.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.147+0000 7f48b8f69740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559aeb27f4b0 0x559aeb27f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:00.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.147+0000 7f48b8f69740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559aeb2ba180 0x559aeb2ba600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:00.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.147+0000 7f48b8f69740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559aeb2bab40 0x559aeb2bb3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:00.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.147+0000 7f48b8f69740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x559aeb1a7b50 con 0x559aeb2ba180 2024-02-21T23:05:00.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.147+0000 7f48b8f69740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x559aeb150da0 con 0x559aeb2bab40 2024-02-21T23:05:00.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.147+0000 7f48b8f69740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x559aeb1a3bf0 con 0x559aeb27f4b0 2024-02-21T23:05:00.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.147+0000 7f48af400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559aeb2ba180 0x559aeb2ba600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:00.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.147+0000 7f48afe00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559aeb27f4b0 0x559aeb27f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:00.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.147+0000 7f48af400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559aeb2ba180 0x559aeb2ba600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56066/0 (socket says 172.21.15.99:56066) 2024-02-21T23:05:00.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.147+0000 7f48af400640 1 -- 172.21.15.99:0/3085857502 learned_addr learned my addr 172.21.15.99:0/3085857502 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:05:00.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.147+0000 7f48aea00640 1 --2- 172.21.15.99:0/3085857502 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559aeb2bab40 0x559aeb2bb3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:00.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.148+0000 7f48af400640 1 -- 172.21.15.99:0/3085857502 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559aeb27f4b0 msgr2=0x559aeb27f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:05:00.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.148+0000 7f48af400640 1 --2- 172.21.15.99:0/3085857502 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559aeb27f4b0 0x559aeb27f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:00.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.148+0000 7f48af400640 1 -- 172.21.15.99:0/3085857502 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559aeb2bab40 msgr2=0x559aeb2bb3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:05:00.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.148+0000 7f48af400640 1 --2- 172.21.15.99:0/3085857502 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559aeb2bab40 0x559aeb2bb3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:00.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.148+0000 7f48af400640 1 -- 172.21.15.99:0/3085857502 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559aeb173f80 con 0x559aeb2ba180 2024-02-21T23:05:00.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.148+0000 7f48aea00640 1 --2- 172.21.15.99:0/3085857502 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559aeb2bab40 0x559aeb2bb3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:05:00.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.148+0000 7f48af400640 1 --2- 172.21.15.99:0/3085857502 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559aeb2ba180 0x559aeb2ba600 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f48a00f4190 tx=0x7f48a00f4280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1705c3b69b030f6 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:05:00.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.148+0000 7f48a7400640 1 --2- 172.21.15.99:0/3876690329 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f489009eed0 0x7f48900a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:00.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.149+0000 7f489b400640 1 -- 172.21.15.99:0/3085857502 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a00b5940 con 0x559aeb2ba180 2024-02-21T23:05:00.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.149+0000 7f489b400640 1 -- 172.21.15.99:0/3085857502 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48a00f9070 con 0x559aeb2ba180 2024-02-21T23:05:00.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.149+0000 7f489b400640 1 -- 172.21.15.99:0/3085857502 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a00b8b80 con 0x559aeb2ba180 2024-02-21T23:05:00.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.149+0000 7f48a7400640 1 -- 172.21.15.99:0/3876690329 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f48a00ebfa0 con 0x7f48b00cf2c0 2024-02-21T23:05:00.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.149+0000 7f48afe00640 1 --2- 172.21.15.99:0/3876690329 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f489009eed0 0x7f48900a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:00.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.149+0000 7f48b8f69740 1 -- 172.21.15.99:0/3085857502 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559aeb2ba180 msgr2=0x559aeb2ba600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:00.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.149+0000 7f48b8f69740 1 --2- 172.21.15.99:0/3085857502 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559aeb2ba180 0x559aeb2ba600 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f48a00f4190 tx=0x7f48a00f4280 comp rx=0 tx=0).stop 2024-02-21T23:05:00.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.150+0000 7f48afe00640 1 --2- 172.21.15.99:0/3876690329 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f489009eed0 0x7f48900a1390 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f48a8007fd0 tx=0x7f48a8009040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:05:00.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.150+0000 7f48b8f69740 1 -- 172.21.15.99:0/3085857502 shutdown_connections 2024-02-21T23:05:00.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.150+0000 7f48b8f69740 1 --2- 172.21.15.99:0/3085857502 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559aeb2bab40 0x559aeb2bb3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:00.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.150+0000 7f48b8f69740 1 --2- 172.21.15.99:0/3085857502 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559aeb2ba180 0x559aeb2ba600 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:00.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.150+0000 7f48b8f69740 1 --2- 172.21.15.99:0/3085857502 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559aeb27f4b0 0x559aeb27f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:00.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.150+0000 7f48b8f69740 1 -- 172.21.15.99:0/3085857502 >> 172.21.15.99:0/3085857502 conn(0x559aeb241520 msgr2=0x559aeb2425a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:05:00.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.150+0000 7f48b8f69740 1 -- 172.21.15.99:0/3085857502 shutdown_connections 2024-02-21T23:05:00.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.150+0000 7f48b8f69740 1 -- 172.21.15.99:0/3085857502 wait complete. 2024-02-21T23:05:00.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.151+0000 7f48b8f69740 1 -- start start 2024-02-21T23:05:00.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.151+0000 7f48b8f69740 1 Processor -- start 2024-02-21T23:05:00.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.153+0000 7f48b8f69740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559aeb2ba180 0x559aeb23ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:00.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.154+0000 7f48b8f69740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559aeb2bab40 0x559aeb2797d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:00.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.154+0000 7f48b8f69740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559aeb279fc0 0x559aeb271100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:00.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.154+0000 7f48b8f69740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x559aeb1a7b50 con 0x559aeb2ba180 2024-02-21T23:05:00.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.154+0000 7f48b8f69740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x559aeb146380 con 0x559aeb2bab40 2024-02-21T23:05:00.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.154+0000 7f48b8f69740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x559aeb2b8ef0 con 0x559aeb279fc0 2024-02-21T23:05:00.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.154+0000 7f48b8f69740 10 client.0 _ll_register_callbacks cb 0x559aeb19f280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:05:00.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.154+0000 7f48af400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559aeb2ba180 0x559aeb23ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:00.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.154+0000 7f48af400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559aeb2ba180 0x559aeb23ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56082/0 (socket says 172.21.15.99:56082) 2024-02-21T23:05:00.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.154+0000 7f48af400640 1 -- 172.21.15.99:0/1530276581 learned_addr learned my addr 172.21.15.99:0/1530276581 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:05:00.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.154+0000 7f48afe00640 1 --2- 172.21.15.99:0/1530276581 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559aeb279fc0 0x559aeb271100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:00.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.155+0000 7f48af400640 1 -- 172.21.15.99:0/1530276581 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559aeb279fc0 msgr2=0x559aeb271100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:05:00.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.155+0000 7f48aea00640 1 --2- 172.21.15.99:0/1530276581 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559aeb2bab40 0x559aeb2797d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:00.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.155+0000 7f48af400640 1 --2- 172.21.15.99:0/1530276581 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559aeb279fc0 0x559aeb271100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:00.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.155+0000 7f48af400640 1 -- 172.21.15.99:0/1530276581 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559aeb2bab40 msgr2=0x559aeb2797d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:05:00.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.155+0000 7f48af400640 1 --2- 172.21.15.99:0/1530276581 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559aeb2bab40 0x559aeb2797d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:00.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.155+0000 7f48af400640 1 -- 172.21.15.99:0/1530276581 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559aeb16ec20 con 0x559aeb2ba180 2024-02-21T23:05:00.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.155+0000 7f48afe00640 1 --2- 172.21.15.99:0/1530276581 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559aeb279fc0 0x559aeb271100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:05:00.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.155+0000 7f48aea00640 1 --2- 172.21.15.99:0/1530276581 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559aeb2bab40 0x559aeb2797d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T23:05:00.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.155+0000 7f48af400640 1 --2- 172.21.15.99:0/1530276581 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559aeb2ba180 0x559aeb23ea40 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f48a002bc90 tx=0x7f48a00f1050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a231820f37dff8e5 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:05:00.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.155+0000 7f488fe00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:05:00.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.156+0000 7f488fe00640 1 -- 172.21.15.99:0/1530276581 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a004b040 con 0x559aeb2ba180 2024-02-21T23:05:00.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.156+0000 7f488fe00640 1 -- 172.21.15.99:0/1530276581 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f48a0004320 con 0x559aeb2ba180 2024-02-21T23:05:00.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.156+0000 7f48b8f69740 1 -- 172.21.15.99:0/1530276581 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f48a00f9070 con 0x559aeb2ba180 2024-02-21T23:05:00.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.156+0000 7f488fe00640 1 -- 172.21.15.99:0/1530276581 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f48a00b8eb0 con 0x559aeb2ba180 2024-02-21T23:05:00.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.156+0000 7f48b8f69740 10 client.5664 fetch_fsmap learned FSMap version 16 2024-02-21T23:05:00.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.156+0000 7f48b8f69740 1 -- 172.21.15.99:0/1530276581 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x559aeaebc3f0 con 0x559aeb2ba180 2024-02-21T23:05:00.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.157+0000 7f488fe00640 1 -- 172.21.15.99:0/1530276581 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48a0030710 con 0x559aeb2ba180 2024-02-21T23:05:00.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.157+0000 7f488fe00640 1 -- 172.21.15.99:0/1530276581 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f48a00d11a0 con 0x559aeb2ba180 2024-02-21T23:05:00.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.157+0000 7f48b8f69740 10 client.5664 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T23:05:00.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.157+0000 7f48b8f69740 10 client.5664 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2024-02-21T23:05:00.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.157+0000 7f48b8f69740 20 client.5664 populate_metadata read hostname 'smithi099' 2024-02-21T23:05:00.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.157+0000 7f48b8f69740 1 --2- 172.21.15.99:0/1530276581 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x559aeb27a3a0 0x559aeb23cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:00.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.157+0000 7f48b8f69740 4 client.5664 mds_command: new command op to 4352 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:05:00.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.157+0000 7f48b8f69740 1 -- 172.21.15.99:0/1530276581 --> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f48a00f9070 con 0x559aeb27a3a0 2024-02-21T23:05:00.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.158+0000 7f48aea00640 1 --2- 172.21.15.99:0/1530276581 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x559aeb27a3a0 0x559aeb23cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:00.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.158+0000 7f48aea00640 1 --2- 172.21.15.99:0/1530276581 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x559aeb27a3a0 0x559aeb23cf30 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2fbe85724b5cdedf server_cookie=b9ebb583dc07d00e in_seq=0 out_seq=0 2024-02-21T23:05:00.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.158+0000 7f488fe00640 10 client.5664 ms_handle_connect on v2:172.21.15.99:6836/1676159950 2024-02-21T23:05:00.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.159+0000 7f488fe00640 1 -- 172.21.15.99:0/1530276581 <== mds.1 v2:172.21.15.99:6836/1676159950 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x7f48a00f9070 con 0x559aeb27a3a0 2024-02-21T23:05:00.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.159+0000 7f488fe00640 10 client.5664 handle_command_reply: tid=0 2024-02-21T23:05:00.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.160+0000 7f48b8f69740 1 client.5664 shutdown 2024-02-21T23:05:00.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.160+0000 7f48b8f69740 1 -- 172.21.15.99:0/1530276581 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559aeb2ba180 msgr2=0x559aeb23ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:00.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.160+0000 7f48b8f69740 1 --2- 172.21.15.99:0/1530276581 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559aeb2ba180 0x559aeb23ea40 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f48a002bc90 tx=0x7f48a00f1050 comp rx=0 tx=0).stop 2024-02-21T23:05:00.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.160+0000 7f48b8f69740 1 -- 172.21.15.99:0/1530276581 shutdown_connections 2024-02-21T23:05:00.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.160+0000 7f48b8f69740 1 --2- 172.21.15.99:0/1530276581 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x559aeb27a3a0 0x559aeb23cf30 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:00.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.160+0000 7f48b8f69740 1 --2- 172.21.15.99:0/1530276581 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559aeb279fc0 0x559aeb271100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:00.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.160+0000 7f48b8f69740 1 --2- 172.21.15.99:0/1530276581 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559aeb2bab40 0x559aeb2797d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:00.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.160+0000 7f48b8f69740 1 --2- 172.21.15.99:0/1530276581 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559aeb2ba180 0x559aeb23ea40 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:00.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.160+0000 7f48b8f69740 1 -- 172.21.15.99:0/1530276581 >> 172.21.15.99:0/1530276581 conn(0x559aeb27f4b0 msgr2=0x559aeb28ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:05:00.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.160+0000 7f488fe00640 0 client.5664 ms_handle_reset on v2:172.21.15.99:6836/1676159950 2024-02-21T23:05:00.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.160+0000 7f48b8f69740 1 -- 172.21.15.99:0/1530276581 shutdown_connections 2024-02-21T23:05:00.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.160+0000 7f48b8f69740 1 -- 172.21.15.99:0/1530276581 wait complete. 2024-02-21T23:05:00.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.160+0000 7f48b8f69740 20 client.5664 trim_cache size 0 max 16384 2024-02-21T23:05:00.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.186+0000 7f48b8f69740 1 Processor -- start 2024-02-21T23:05:00.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.186+0000 7f48b8f69740 1 -- start start 2024-02-21T23:05:00.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.188+0000 7f48b8f69740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559aeb279fc0 0x559aeb284ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:00.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.188+0000 7f48b8f69740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559aeb2ba180 0x559aeb27ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:00.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.188+0000 7f48b8f69740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559aeb2bab40 0x559aeb26d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:00.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.188+0000 7f48b8f69740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b022c940 con 0x559aeb2bab40 2024-02-21T23:05:00.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.188+0000 7f48b8f69740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b022a4e0 con 0x559aeb2ba180 2024-02-21T23:05:00.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.188+0000 7f48b8f69740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b02285c0 con 0x559aeb279fc0 2024-02-21T23:05:00.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.188+0000 7f48aea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559aeb2ba180 0x559aeb27ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:00.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.188+0000 7f48aea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559aeb2ba180 0x559aeb27ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:42838/0 (socket says 172.21.15.99:42838) 2024-02-21T23:05:00.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.188+0000 7f48aea00640 1 -- 172.21.15.99:0/1026423398 learned_addr learned my addr 172.21.15.99:0/1026423398 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:05:00.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.189+0000 7f48afe00640 1 --2- 172.21.15.99:0/1026423398 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559aeb2bab40 0x559aeb26d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:00.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.189+0000 7f48aea00640 1 -- 172.21.15.99:0/1026423398 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559aeb279fc0 msgr2=0x559aeb284ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:05:00.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.189+0000 7f48aea00640 1 --2- 172.21.15.99:0/1026423398 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559aeb279fc0 0x559aeb284ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:00.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.189+0000 7f48aea00640 1 -- 172.21.15.99:0/1026423398 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559aeb2bab40 msgr2=0x559aeb26d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:05:00.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.189+0000 7f48aea00640 1 --2- 172.21.15.99:0/1026423398 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559aeb2bab40 0x559aeb26d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:00.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.189+0000 7f48aea00640 1 -- 172.21.15.99:0/1026423398 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559aeaf867d0 con 0x559aeb2ba180 2024-02-21T23:05:00.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.189+0000 7f48aea00640 1 --2- 172.21.15.99:0/1026423398 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559aeb2ba180 0x559aeb27ef00 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f48b0068b10 tx=0x7f489c0070d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17a5d8f5b3f6f305 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:05:00.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.189+0000 7f489aa00640 1 -- 172.21.15.99:0/1026423398 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f489c020070 con 0x559aeb2ba180 2024-02-21T23:05:00.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.189+0000 7f489aa00640 1 -- 172.21.15.99:0/1026423398 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f489c01a180 con 0x559aeb2ba180 2024-02-21T23:05:00.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.189+0000 7f489aa00640 1 -- 172.21.15.99:0/1026423398 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f489c010040 con 0x559aeb2ba180 2024-02-21T23:05:00.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.190+0000 7f48b8f69740 1 -- 172.21.15.99:0/1026423398 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559aeb2ba180 msgr2=0x559aeb27ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:00.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.190+0000 7f48b8f69740 1 --2- 172.21.15.99:0/1026423398 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559aeb2ba180 0x559aeb27ef00 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f48b0068b10 tx=0x7f489c0070d0 comp rx=0 tx=0).stop 2024-02-21T23:05:00.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.191+0000 7f48b8f69740 1 -- 172.21.15.99:0/1026423398 shutdown_connections 2024-02-21T23:05:00.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.191+0000 7f48b8f69740 1 --2- 172.21.15.99:0/1026423398 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559aeb2bab40 0x559aeb26d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:00.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.191+0000 7f48b8f69740 1 --2- 172.21.15.99:0/1026423398 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559aeb2ba180 0x559aeb27ef00 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:00.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.191+0000 7f48b8f69740 1 --2- 172.21.15.99:0/1026423398 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559aeb279fc0 0x559aeb284ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:00.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.191+0000 7f48b8f69740 1 -- 172.21.15.99:0/1026423398 >> 172.21.15.99:0/1026423398 conn(0x559aeb27f4b0 msgr2=0x559aeb242560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:05:00.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.191+0000 7f48b8f69740 1 -- 172.21.15.99:0/1026423398 shutdown_connections 2024-02-21T23:05:00.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.192+0000 7f48b8f69740 1 -- 172.21.15.99:0/1026423398 wait complete. 2024-02-21T23:05:00.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.193+0000 7f48b8f69740 1 -- start start 2024-02-21T23:05:00.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.193+0000 7f48b8f69740 1 Processor -- start 2024-02-21T23:05:00.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.194+0000 7f48b8f69740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559aeb279fc0 0x559aeb270d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:00.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.194+0000 7f48b8f69740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559aeb2ba180 0x559aeb2795e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:00.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.194+0000 7f48b8f69740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559aeb2bab40 0x559aeb284ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:00.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.194+0000 7f48b8f69740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b0228bc0 con 0x559aeb2bab40 2024-02-21T23:05:00.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.194+0000 7f48b8f69740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b0229e80 con 0x559aeb2ba180 2024-02-21T23:05:00.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.194+0000 7f48b8f69740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b02291c0 con 0x559aeb279fc0 2024-02-21T23:05:00.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.194+0000 7f48b8f69740 10 client.0 _ll_register_callbacks cb 0x7f489c007ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:05:00.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.195+0000 7f48aea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559aeb2ba180 0x559aeb2795e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:00.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.195+0000 7f48aea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559aeb2ba180 0x559aeb2795e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:42844/0 (socket says 172.21.15.99:42844) 2024-02-21T23:05:00.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.195+0000 7f48aea00640 1 -- 172.21.15.99:0/1585679416 learned_addr learned my addr 172.21.15.99:0/1585679416 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:05:00.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.195+0000 7f48aea00640 1 -- 172.21.15.99:0/1585679416 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559aeb279fc0 msgr2=0x559aeb270d00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T23:05:00.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.195+0000 7f48aea00640 1 --2- 172.21.15.99:0/1585679416 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559aeb279fc0 0x559aeb270d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:00.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.195+0000 7f48aea00640 1 -- 172.21.15.99:0/1585679416 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559aeb2bab40 msgr2=0x559aeb284ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:05:00.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.195+0000 7f48afe00640 1 --2- 172.21.15.99:0/1585679416 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559aeb2bab40 0x559aeb284ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:00.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.195+0000 7f48aea00640 1 --2- 172.21.15.99:0/1585679416 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559aeb2bab40 0x559aeb284ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:00.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.195+0000 7f48aea00640 1 -- 172.21.15.99:0/1585679416 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559aeb2480f0 con 0x559aeb2ba180 2024-02-21T23:05:00.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.195+0000 7f48afe00640 1 --2- 172.21.15.99:0/1585679416 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559aeb2bab40 0x559aeb284ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T23:05:00.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.195+0000 7f48aea00640 1 --2- 172.21.15.99:0/1585679416 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559aeb2ba180 0x559aeb2795e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x559aeb239fd0 tx=0x7f489c000ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8547f537594a5b27 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:05:00.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.196+0000 7f488fe00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-02-21T23:05:00.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.196+0000 7f488fe00640 1 -- 172.21.15.99:0/1585679416 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f489c02a060 con 0x559aeb2ba180 2024-02-21T23:05:00.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.196+0000 7f48b8f69740 1 -- 172.21.15.99:0/1585679416 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f489c01a180 con 0x559aeb2ba180 2024-02-21T23:05:00.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.196+0000 7f488fe00640 1 -- 172.21.15.99:0/1585679416 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f489c0049f0 con 0x559aeb2ba180 2024-02-21T23:05:00.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.196+0000 7f488fe00640 1 -- 172.21.15.99:0/1585679416 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f489c020070 con 0x559aeb2ba180 2024-02-21T23:05:00.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.196+0000 7f48b8f69740 10 client.5776 fetch_fsmap learned FSMap version 16 2024-02-21T23:05:00.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.196+0000 7f48b8f69740 1 -- 172.21.15.99:0/1585679416 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x559aeb2786e0 con 0x559aeb2ba180 2024-02-21T23:05:00.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.197+0000 7f488fe00640 1 -- 172.21.15.99:0/1585679416 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f489c01a180 con 0x559aeb2ba180 2024-02-21T23:05:00.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.197+0000 7f488fe00640 1 -- 172.21.15.99:0/1585679416 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f489c017430 con 0x559aeb2ba180 2024-02-21T23:05:00.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.197+0000 7f48b8f69740 10 client.5776 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T23:05:00.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.197+0000 7f48b8f69740 10 client.5776 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2024-02-21T23:05:00.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.197+0000 7f48b8f69740 20 client.5776 populate_metadata read hostname 'smithi099' 2024-02-21T23:05:00.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.197+0000 7f48b8f69740 1 --2- 172.21.15.99:0/1585679416 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x559aeb2b59d0 0x559aeb321850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:00.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.197+0000 7f48b8f69740 4 client.5776 mds_command: new command op to 4352 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T23:05:00.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.197+0000 7f48b8f69740 1 -- 172.21.15.99:0/1585679416 --> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x559aeb1b5090 con 0x559aeb2b59d0 2024-02-21T23:05:00.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.199+0000 7f48af400640 1 --2- 172.21.15.99:0/1585679416 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x559aeb2b59d0 0x559aeb321850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:00.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.203+0000 7f48af400640 1 --2- 172.21.15.99:0/1585679416 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x559aeb2b59d0 0x559aeb321850 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d57ee571261a9125 server_cookie=777d27bf9589528 in_seq=0 out_seq=0 2024-02-21T23:05:00.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.203+0000 7f488fe00640 10 client.5776 ms_handle_connect on v2:172.21.15.99:6836/1676159950 2024-02-21T23:05:00.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.203+0000 7f488fe00640 1 -- 172.21.15.99:0/1585679416 <== mds.1 v2:172.21.15.99:6836/1676159950 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x559aeb1b5090 con 0x559aeb2b59d0 2024-02-21T23:05:00.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.203+0000 7f488fe00640 10 client.5776 handle_command_reply: tid=0 2024-02-21T23:05:00.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.203+0000 7f48b8f69740 1 client.5776 shutdown 2024-02-21T23:05:00.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.203+0000 7f48b8f69740 1 -- 172.21.15.99:0/1585679416 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559aeb2ba180 msgr2=0x559aeb2795e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:00.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.203+0000 7f48b8f69740 1 --2- 172.21.15.99:0/1585679416 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559aeb2ba180 0x559aeb2795e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x559aeb239fd0 tx=0x7f489c000ed0 comp rx=0 tx=0).stop 2024-02-21T23:05:00.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.203+0000 7f48b8f69740 1 -- 172.21.15.99:0/1585679416 shutdown_connections 2024-02-21T23:05:00.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.203+0000 7f48b8f69740 1 --2- 172.21.15.99:0/1585679416 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x559aeb2b59d0 0x559aeb321850 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:00.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.203+0000 7f48b8f69740 1 --2- 172.21.15.99:0/1585679416 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559aeb2bab40 0x559aeb284ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:00.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.203+0000 7f48b8f69740 1 --2- 172.21.15.99:0/1585679416 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559aeb2ba180 0x559aeb2795e0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:00.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.203+0000 7f488fe00640 0 client.5776 ms_handle_reset on v2:172.21.15.99:6836/1676159950 2024-02-21T23:05:00.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.203+0000 7f48b8f69740 1 --2- 172.21.15.99:0/1585679416 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559aeb279fc0 0x559aeb270d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:00.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.203+0000 7f48b8f69740 1 -- 172.21.15.99:0/1585679416 >> 172.21.15.99:0/1585679416 conn(0x559aeb27f4b0 msgr2=0x559aeb275530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:05:00.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.203+0000 7f48b8f69740 1 -- 172.21.15.99:0/1585679416 shutdown_connections 2024-02-21T23:05:00.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.203+0000 7f48b8f69740 1 -- 172.21.15.99:0/1585679416 wait complete. 2024-02-21T23:05:00.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.204+0000 7f48b8f69740 20 client.5776 trim_cache size 0 max 16384 2024-02-21T23:05:00.194 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-02-21T23:05:00.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.204+0000 7f48b6000640 1 -- 172.21.15.99:0/3876690329 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f489009eed0 msgr2=0x7f48900a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:00.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.204+0000 7f48b6000640 1 --2- 172.21.15.99:0/3876690329 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f489009eed0 0x7f48900a1390 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f48a8007fd0 tx=0x7f48a8009040 comp rx=0 tx=0).stop 2024-02-21T23:05:00.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.204+0000 7f48b6000640 1 -- 172.21.15.99:0/3876690329 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48b00cf2c0 msgr2=0x7f48b00d4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:00.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.204+0000 7f48b6000640 1 --2- 172.21.15.99:0/3876690329 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48b00cf2c0 0x7f48b00d4780 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f48a00097a0 tx=0x7f48a00046c0 comp rx=0 tx=0).stop 2024-02-21T23:05:00.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.205+0000 7f48b6000640 1 -- 172.21.15.99:0/3876690329 shutdown_connections 2024-02-21T23:05:00.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.205+0000 7f48b6000640 1 --2- 172.21.15.99:0/3876690329 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f489009eed0 0x7f48900a1390 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:00.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.205+0000 7f48b6000640 1 --2- 172.21.15.99:0/3876690329 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f48b01866f0 0x7f48b017d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:00.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.205+0000 7f48b6000640 1 --2- 172.21.15.99:0/3876690329 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f48b0186310 0x7f48b016e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:00.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.205+0000 7f48b6000640 1 --2- 172.21.15.99:0/3876690329 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48b00cf2c0 0x7f48b00d4780 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:00.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.205+0000 7f48b6000640 1 -- 172.21.15.99:0/3876690329 >> 172.21.15.99:0/3876690329 conn(0x7f48b00740b0 msgr2=0x7f48b017c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:05:00.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.205+0000 7f48b6000640 1 -- 172.21.15.99:0/3876690329 shutdown_connections 2024-02-21T23:05:00.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.205+0000 7f48b6000640 1 -- 172.21.15.99:0/3876690329 wait complete. 2024-02-21T23:05:00.216 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T23:05:00.216 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-02-21T23:05:00.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.412+0000 7f1249e00640 1 Processor -- start 2024-02-21T23:05:00.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.413+0000 7f1249e00640 1 -- start start 2024-02-21T23:05:00.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.415+0000 7f1249e00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f1244180ab0 0x7f1244188ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:00.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.415+0000 7f1249e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f12441891e0 0x7f1244189e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:00.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.415+0000 7f1249e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1244187800 con 0x7f1244189660 2024-02-21T23:05:00.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.415+0000 7f1249e00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1244188810 con 0x7f12441891e0 2024-02-21T23:05:00.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.415+0000 7f1249e00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12440f6610 con 0x7f1244180ab0 2024-02-21T23:05:00.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.416+0000 7f1243e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f12441891e0 0x7f1244189e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:00.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.416+0000 7f1248a00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f1244180ab0 0x7f1244188ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:00.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.416+0000 7f1243e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f12441891e0 0x7f1244189e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:42852/0 (socket says 172.21.15.99:42852) 2024-02-21T23:05:00.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.416+0000 7f1243e00640 1 -- 172.21.15.99:0/879287546 learned_addr learned my addr 172.21.15.99:0/879287546 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:05:00.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.416+0000 7f1243e00640 1 -- 172.21.15.99:0/879287546 >> v2:172.21.15.181:3300/0 conn(0x7f1244180ab0 msgr2=0x7f1244188ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:05:00.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.416+0000 7f1243e00640 1 --2- 172.21.15.99:0/879287546 >> v2:172.21.15.181:3300/0 conn(0x7f1244180ab0 0x7f1244188ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:00.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.416+0000 7f1243e00640 1 -- 172.21.15.99:0/879287546 >> v1:172.21.15.162:6789/0 conn(0x7f1244189660 legacy=0x7f124418a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:00.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.416+0000 7f1243e00640 1 -- 172.21.15.99:0/879287546 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1244187ee0 con 0x7f12441891e0 2024-02-21T23:05:00.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.416+0000 7f1248a00640 1 --2- 172.21.15.99:0/879287546 >> v2:172.21.15.181:3300/0 conn(0x7f1244180ab0 0x7f1244188ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:05:00.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.418+0000 7f1243e00640 1 --2- 172.21.15.99:0/879287546 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f12441891e0 0x7f1244189e40 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f12440faf30 tx=0x7f123002b920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad9d9d1bd6f77d5f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:05:00.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.418+0000 7f1243400640 1 -- 172.21.15.99:0/879287546 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1230035020 con 0x7f12441891e0 2024-02-21T23:05:00.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.418+0000 7f1243400640 1 -- 172.21.15.99:0/879287546 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1230031880 con 0x7f12441891e0 2024-02-21T23:05:00.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.418+0000 7f1243400640 1 -- 172.21.15.99:0/879287546 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1230031c50 con 0x7f12441891e0 2024-02-21T23:05:00.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.419+0000 7f1249e00640 1 -- 172.21.15.99:0/879287546 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f12441891e0 msgr2=0x7f1244189e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:00.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.419+0000 7f1249e00640 1 --2- 172.21.15.99:0/879287546 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f12441891e0 0x7f1244189e40 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f12440faf30 tx=0x7f123002b920 comp rx=0 tx=0).stop 2024-02-21T23:05:00.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.419+0000 7f1249e00640 1 -- 172.21.15.99:0/879287546 shutdown_connections 2024-02-21T23:05:00.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.419+0000 7f1249e00640 1 --2- 172.21.15.99:0/879287546 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f12441891e0 0x7f1244189e40 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:00.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.419+0000 7f1249e00640 1 --2- 172.21.15.99:0/879287546 >> v2:172.21.15.181:3300/0 conn(0x7f1244180ab0 0x7f1244188ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:00.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.419+0000 7f1249e00640 1 -- 172.21.15.99:0/879287546 >> 172.21.15.99:0/879287546 conn(0x7f12440ce4b0 msgr2=0x7f12440ce8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:05:00.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.419+0000 7f1249e00640 1 -- 172.21.15.99:0/879287546 shutdown_connections 2024-02-21T23:05:00.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.419+0000 7f1249e00640 1 -- 172.21.15.99:0/879287546 wait complete. 2024-02-21T23:05:00.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.421+0000 7f1249e00640 1 Processor -- start 2024-02-21T23:05:00.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.421+0000 7f1249e00640 1 -- start start 2024-02-21T23:05:00.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.422+0000 7f1249e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1244180ab0 0x7f12440f9940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:00.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.422+0000 7f1249e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12441891e0 0x7f124421ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:00.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.422+0000 7f1249e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1244189660 0x7f124416cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:00.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.422+0000 7f1249e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12440cd2c0 con 0x7f12441891e0 2024-02-21T23:05:00.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.422+0000 7f1249e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12441884a0 con 0x7f1244180ab0 2024-02-21T23:05:00.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.422+0000 7f1249e00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12440cd440 con 0x7f1244189660 2024-02-21T23:05:00.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.423+0000 7f1243e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12441891e0 0x7f124421ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:00.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.423+0000 7f1248a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1244180ab0 0x7f12440f9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:00.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.423+0000 7f1248a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1244180ab0 0x7f12440f9940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:42860/0 (socket says 172.21.15.99:42860) 2024-02-21T23:05:00.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.423+0000 7f1248a00640 1 -- 172.21.15.99:0/2594531433 learned_addr learned my addr 172.21.15.99:0/2594531433 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:05:00.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.423+0000 7f1249400640 1 --2- 172.21.15.99:0/2594531433 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1244189660 0x7f124416cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:00.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.423+0000 7f1248a00640 1 -- 172.21.15.99:0/2594531433 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1244189660 msgr2=0x7f124416cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:00.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.423+0000 7f1248a00640 1 --2- 172.21.15.99:0/2594531433 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1244189660 0x7f124416cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:00.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.423+0000 7f1248a00640 1 -- 172.21.15.99:0/2594531433 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12441891e0 msgr2=0x7f124421ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:00.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.423+0000 7f1248a00640 1 --2- 172.21.15.99:0/2594531433 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12441891e0 0x7f124421ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:00.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.423+0000 7f1248a00640 1 -- 172.21.15.99:0/2594531433 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12440f85c0 con 0x7f1244180ab0 2024-02-21T23:05:00.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.423+0000 7f1249400640 1 --2- 172.21.15.99:0/2594531433 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1244189660 0x7f124416cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:05:00.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.423+0000 7f1243e00640 1 --2- 172.21.15.99:0/2594531433 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12441891e0 0x7f124421ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:05:00.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.423+0000 7f1248a00640 1 --2- 172.21.15.99:0/2594531433 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1244180ab0 0x7f12440f9940 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f123800ebe0 tx=0x7f123800c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:05:00.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.424+0000 7f1240c00640 1 -- 172.21.15.99:0/2594531433 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1238017070 con 0x7f1244180ab0 2024-02-21T23:05:00.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.424+0000 7f1240c00640 1 -- 172.21.15.99:0/2594531433 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f123800cc30 con 0x7f1244180ab0 2024-02-21T23:05:00.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.424+0000 7f1240c00640 1 -- 172.21.15.99:0/2594531433 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1238013470 con 0x7f1244180ab0 2024-02-21T23:05:00.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.424+0000 7f1249e00640 1 -- 172.21.15.99:0/2594531433 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12440f88a0 con 0x7f1244180ab0 2024-02-21T23:05:00.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.424+0000 7f1249e00640 1 -- 172.21.15.99:0/2594531433 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12440f8e60 con 0x7f1244180ab0 2024-02-21T23:05:00.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.429+0000 7f1240c00640 1 -- 172.21.15.99:0/2594531433 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f123801a070 con 0x7f1244180ab0 2024-02-21T23:05:00.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.429+0000 7f124e378740 1 Processor -- start 2024-02-21T23:05:00.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.430+0000 7f124e378740 1 -- start start 2024-02-21T23:05:00.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.431+0000 7f1240c00640 1 --2- 172.21.15.99:0/2594531433 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f122409eed0 0x7f12240a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:00.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.431+0000 7f1240c00640 1 -- 172.21.15.99:0/2594531433 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f12380ca1d0 con 0x7f1244180ab0 2024-02-21T23:05:00.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.431+0000 7f1249400640 1 --2- 172.21.15.99:0/2594531433 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f122409eed0 0x7f12240a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:00.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.431+0000 7f124e378740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ab2f4a2660 0x55ab2f4a2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:00.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.432+0000 7f124e378740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ab2f4dd330 0x55ab2f4dd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:00.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.432+0000 7f124e378740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab2f4ddcf0 0x55ab2f4de560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:00.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.432+0000 7f124e378740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab2f3cab50 con 0x55ab2f4a2660 2024-02-21T23:05:00.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.432+0000 7f124e378740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab2f373da0 con 0x55ab2f4ddcf0 2024-02-21T23:05:00.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.432+0000 7f124e378740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab2f3c6bf0 con 0x55ab2f4dd330 2024-02-21T23:05:00.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.432+0000 7f1243e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ab2f4dd330 0x55ab2f4dd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:00.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.432+0000 7f1243e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ab2f4dd330 0x55ab2f4dd7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:41620/0 (socket says 172.21.15.99:41620) 2024-02-21T23:05:00.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.432+0000 7f1243e00640 1 -- 172.21.15.99:0/134237666 learned_addr learned my addr 172.21.15.99:0/134237666 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:05:00.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.432+0000 7f1249400640 1 --2- 172.21.15.99:0/134237666 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab2f4ddcf0 0x55ab2f4de560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:00.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.432+0000 7f1248a00640 1 --2- 172.21.15.99:0/134237666 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ab2f4a2660 0x55ab2f4a2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:00.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.432+0000 7f1243e00640 1 -- 172.21.15.99:0/134237666 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab2f4ddcf0 msgr2=0x55ab2f4de560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:05:00.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.432+0000 7f1243e00640 1 --2- 172.21.15.99:0/134237666 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab2f4ddcf0 0x55ab2f4de560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:00.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.432+0000 7f1249400640 1 --2- 172.21.15.99:0/2594531433 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f122409eed0 0x7f12240a1390 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f123c001d30 tx=0x7f123c009040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:05:00.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.432+0000 7f1243e00640 1 -- 172.21.15.99:0/134237666 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ab2f4a2660 msgr2=0x55ab2f4a2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:05:00.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.432+0000 7f1243e00640 1 --2- 172.21.15.99:0/134237666 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ab2f4a2660 0x55ab2f4a2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:00.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.432+0000 7f1243e00640 1 -- 172.21.15.99:0/134237666 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ab2f396f80 con 0x55ab2f4dd330 2024-02-21T23:05:00.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.433+0000 7f1243e00640 1 --2- 172.21.15.99:0/134237666 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ab2f4dd330 0x55ab2f4dd7b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f123002bf30 tx=0x7f1230008030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b68be41c5a48be9 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:05:00.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.433+0000 7f1235200640 1 -- 172.21.15.99:0/134237666 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1230049070 con 0x55ab2f4dd330 2024-02-21T23:05:00.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.433+0000 7f1235200640 1 -- 172.21.15.99:0/134237666 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1230044420 con 0x55ab2f4dd330 2024-02-21T23:05:00.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.433+0000 7f1235200640 1 -- 172.21.15.99:0/134237666 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1230035040 con 0x55ab2f4dd330 2024-02-21T23:05:00.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.434+0000 7f124e378740 1 -- 172.21.15.99:0/134237666 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ab2f4dd330 msgr2=0x55ab2f4dd7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:00.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.434+0000 7f124e378740 1 --2- 172.21.15.99:0/134237666 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ab2f4dd330 0x55ab2f4dd7b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f123002bf30 tx=0x7f1230008030 comp rx=0 tx=0).stop 2024-02-21T23:05:00.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.436+0000 7f124e378740 1 -- 172.21.15.99:0/134237666 shutdown_connections 2024-02-21T23:05:00.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.436+0000 7f124e378740 1 --2- 172.21.15.99:0/134237666 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab2f4ddcf0 0x55ab2f4de560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:00.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.436+0000 7f124e378740 1 --2- 172.21.15.99:0/134237666 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ab2f4dd330 0x55ab2f4dd7b0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:00.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.436+0000 7f124e378740 1 --2- 172.21.15.99:0/134237666 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ab2f4a2660 0x55ab2f4a2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:00.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.436+0000 7f124e378740 1 -- 172.21.15.99:0/134237666 >> 172.21.15.99:0/134237666 conn(0x55ab2f4646d0 msgr2=0x55ab2f465750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:05:00.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.436+0000 7f124e378740 1 -- 172.21.15.99:0/134237666 shutdown_connections 2024-02-21T23:05:00.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.436+0000 7f124e378740 1 -- 172.21.15.99:0/134237666 wait complete. 2024-02-21T23:05:00.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.437+0000 7f124e378740 1 -- start start 2024-02-21T23:05:00.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.438+0000 7f124e378740 1 Processor -- start 2024-02-21T23:05:00.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.441+0000 7f124e378740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ab2f4dd330 0x55ab2f4d8160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:00.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.441+0000 7f124e378740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab2f4ddcf0 0x55ab2f4e5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:00.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.441+0000 7f124e378740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ab2f498490 0x55ab2f4ab830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:00.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.441+0000 7f124e378740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab2f4dc0a0 con 0x55ab2f4dd330 2024-02-21T23:05:00.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.441+0000 7f124e378740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab2f369380 con 0x55ab2f4ddcf0 2024-02-21T23:05:00.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.441+0000 7f124e378740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab2f4dbdc0 con 0x55ab2f498490 2024-02-21T23:05:00.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.442+0000 7f124e378740 10 client.0 _ll_register_callbacks cb 0x55ab2f3c2280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:05:00.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.442+0000 7f1243e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab2f4ddcf0 0x55ab2f4e5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:00.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.442+0000 7f1248a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ab2f4dd330 0x55ab2f4d8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:00.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.442+0000 7f1243e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab2f4ddcf0 0x55ab2f4e5fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:42884/0 (socket says 172.21.15.99:42884) 2024-02-21T23:05:00.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.442+0000 7f1243e00640 1 -- 172.21.15.99:0/1244256337 learned_addr learned my addr 172.21.15.99:0/1244256337 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:05:00.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.442+0000 7f1248a00640 1 -- 172.21.15.99:0/1244256337 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ab2f498490 msgr2=0x55ab2f4ab830 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T23:05:00.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.442+0000 7f1248a00640 1 --2- 172.21.15.99:0/1244256337 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ab2f498490 0x55ab2f4ab830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:00.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.442+0000 7f1248a00640 1 -- 172.21.15.99:0/1244256337 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab2f4ddcf0 msgr2=0x55ab2f4e5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:05:00.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.442+0000 7f1248a00640 1 --2- 172.21.15.99:0/1244256337 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab2f4ddcf0 0x55ab2f4e5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:00.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.442+0000 7f1248a00640 1 -- 172.21.15.99:0/1244256337 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ab2f391c20 con 0x55ab2f4dd330 2024-02-21T23:05:00.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.443+0000 7f1248a00640 1 --2- 172.21.15.99:0/1244256337 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ab2f4dd330 0x55ab2f4d8160 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f12380c78f0 tx=0x7f1238095c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b219d28e32384aec server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:05:00.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.443+0000 7f1229600640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:05:00.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.443+0000 7f1229600640 1 -- 172.21.15.99:0/1244256337 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12380af020 con 0x55ab2f4dd330 2024-02-21T23:05:00.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.443+0000 7f1229600640 1 -- 172.21.15.99:0/1244256337 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f1238097130 con 0x55ab2f4dd330 2024-02-21T23:05:00.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.444+0000 7f124e378740 1 -- 172.21.15.99:0/1244256337 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1230044420 con 0x55ab2f4dd330 2024-02-21T23:05:00.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.444+0000 7f1229600640 1 -- 172.21.15.99:0/1244256337 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1238021040 con 0x55ab2f4dd330 2024-02-21T23:05:00.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.444+0000 7f124e378740 10 client.5676 fetch_fsmap learned FSMap version 16 2024-02-21T23:05:00.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.444+0000 7f124e378740 1 -- 172.21.15.99:0/1244256337 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55ab2f0df3f0 con 0x55ab2f4dd330 2024-02-21T23:05:00.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.444+0000 7f1229600640 1 -- 172.21.15.99:0/1244256337 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1230044420 con 0x55ab2f4dd330 2024-02-21T23:05:00.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.445+0000 7f1229600640 1 -- 172.21.15.99:0/1244256337 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f12380c2050 con 0x55ab2f4dd330 2024-02-21T23:05:00.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.445+0000 7f124e378740 10 client.5676 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T23:05:00.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.445+0000 7f124e378740 10 client.5676 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:05:00.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.445+0000 7f124e378740 20 client.5676 populate_metadata read hostname 'smithi099' 2024-02-21T23:05:00.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.445+0000 7f124e378740 1 --2- 172.21.15.99:0/1244256337 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55ab2f4e9dc0 0x55ab2f4ea230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:00.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.445+0000 7f124e378740 4 client.5676 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:05:00.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.445+0000 7f124e378740 1 -- 172.21.15.99:0/1244256337 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ab2f3d8090 con 0x55ab2f4e9dc0 2024-02-21T23:05:00.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.446+0000 7f1243e00640 1 --2- 172.21.15.99:0/1244256337 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55ab2f4e9dc0 0x55ab2f4ea230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:00.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.446+0000 7f1243e00640 1 --2- 172.21.15.99:0/1244256337 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55ab2f4e9dc0 0x55ab2f4ea230 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea7b7ff3fa309b30 server_cookie=98abd0c70d8296ab in_seq=0 out_seq=0 2024-02-21T23:05:00.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.447+0000 7f1229600640 10 client.5676 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:05:00.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.449+0000 7f1229600640 1 -- 172.21.15.99:0/1244256337 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55ab2f3d8090 con 0x55ab2f4e9dc0 2024-02-21T23:05:00.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.449+0000 7f1229600640 10 client.5676 handle_command_reply: tid=0 2024-02-21T23:05:00.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.449+0000 7f124e378740 1 client.5676 shutdown 2024-02-21T23:05:00.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.449+0000 7f124e378740 1 -- 172.21.15.99:0/1244256337 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ab2f4dd330 msgr2=0x55ab2f4d8160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:00.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.449+0000 7f124e378740 1 --2- 172.21.15.99:0/1244256337 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ab2f4dd330 0x55ab2f4d8160 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f12380c78f0 tx=0x7f1238095c10 comp rx=0 tx=0).stop 2024-02-21T23:05:00.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.450+0000 7f124e378740 1 -- 172.21.15.99:0/1244256337 shutdown_connections 2024-02-21T23:05:00.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.450+0000 7f124e378740 1 --2- 172.21.15.99:0/1244256337 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55ab2f4e9dc0 0x55ab2f4ea230 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:00.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.450+0000 7f1229600640 0 client.5676 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:05:00.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.450+0000 7f124e378740 1 --2- 172.21.15.99:0/1244256337 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ab2f498490 0x55ab2f4ab830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:00.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.450+0000 7f124e378740 1 --2- 172.21.15.99:0/1244256337 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab2f4ddcf0 0x55ab2f4e5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:00.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.450+0000 7f124e378740 1 --2- 172.21.15.99:0/1244256337 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ab2f4dd330 0x55ab2f4d8160 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:00.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.450+0000 7f124e378740 1 -- 172.21.15.99:0/1244256337 >> 172.21.15.99:0/1244256337 conn(0x55ab2f4a2660 msgr2=0x55ab2f4ade40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:05:00.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.450+0000 7f124e378740 1 -- 172.21.15.99:0/1244256337 shutdown_connections 2024-02-21T23:05:00.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.450+0000 7f124e378740 1 -- 172.21.15.99:0/1244256337 wait complete. 2024-02-21T23:05:00.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.450+0000 7f124e378740 20 client.5676 trim_cache size 0 max 16384 2024-02-21T23:05:00.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.475+0000 7f124e378740 1 Processor -- start 2024-02-21T23:05:00.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.475+0000 7f124e378740 1 -- start start 2024-02-21T23:05:00.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.476+0000 7f124e378740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ab2f498490 0x55ab2f4956c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:00.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.476+0000 7f124e378740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ab2f4dd330 0x55ab2f4d9390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:00.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.476+0000 7f124e378740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab2f4ddcf0 0x55ab2f549a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:00.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.476+0000 7f124e378740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1244228510 con 0x55ab2f4dd330 2024-02-21T23:05:00.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.476+0000 7f124e378740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1244071e80 con 0x55ab2f4ddcf0 2024-02-21T23:05:00.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.476+0000 7f124e378740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12440f6190 con 0x55ab2f498490 2024-02-21T23:05:00.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.476+0000 7f1248a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ab2f498490 0x55ab2f4956c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:00.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.476+0000 7f1248a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ab2f498490 0x55ab2f4956c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:41632/0 (socket says 172.21.15.99:41632) 2024-02-21T23:05:00.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.476+0000 7f1248a00640 1 -- 172.21.15.99:0/3412840406 learned_addr learned my addr 172.21.15.99:0/3412840406 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:05:00.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.476+0000 7f1243e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ab2f4dd330 0x55ab2f4d9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:00.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.476+0000 7f1249400640 1 --2- 172.21.15.99:0/3412840406 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab2f4ddcf0 0x55ab2f549a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:00.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.477+0000 7f1248a00640 1 -- 172.21.15.99:0/3412840406 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab2f4ddcf0 msgr2=0x55ab2f549a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:05:00.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.477+0000 7f1248a00640 1 --2- 172.21.15.99:0/3412840406 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab2f4ddcf0 0x55ab2f549a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:00.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.477+0000 7f1248a00640 1 -- 172.21.15.99:0/3412840406 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ab2f4dd330 msgr2=0x55ab2f4d9390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:05:00.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.477+0000 7f1248a00640 1 --2- 172.21.15.99:0/3412840406 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ab2f4dd330 0x55ab2f4d9390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:00.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.477+0000 7f1248a00640 1 -- 172.21.15.99:0/3412840406 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ab2f1a97d0 con 0x55ab2f498490 2024-02-21T23:05:00.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.477+0000 7f1248a00640 1 --2- 172.21.15.99:0/3412840406 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ab2f498490 0x55ab2f4956c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f12380c7e10 tx=0x7f123801d000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=afe805bb14031aae server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:05:00.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.477+0000 7f122be00640 1 -- 172.21.15.99:0/3412840406 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123807c070 con 0x55ab2f498490 2024-02-21T23:05:00.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.477+0000 7f122be00640 1 -- 172.21.15.99:0/3412840406 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12380981d0 con 0x55ab2f498490 2024-02-21T23:05:00.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.477+0000 7f122be00640 1 -- 172.21.15.99:0/3412840406 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12380af030 con 0x55ab2f498490 2024-02-21T23:05:00.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.478+0000 7f124e378740 1 -- 172.21.15.99:0/3412840406 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ab2f498490 msgr2=0x55ab2f4956c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:00.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.478+0000 7f124e378740 1 --2- 172.21.15.99:0/3412840406 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ab2f498490 0x55ab2f4956c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f12380c7e10 tx=0x7f123801d000 comp rx=0 tx=0).stop 2024-02-21T23:05:00.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.478+0000 7f124e378740 1 -- 172.21.15.99:0/3412840406 shutdown_connections 2024-02-21T23:05:00.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.478+0000 7f124e378740 1 --2- 172.21.15.99:0/3412840406 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab2f4ddcf0 0x55ab2f549a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:00.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.478+0000 7f124e378740 1 --2- 172.21.15.99:0/3412840406 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ab2f4dd330 0x55ab2f4d9390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:00.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.478+0000 7f124e378740 1 --2- 172.21.15.99:0/3412840406 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ab2f498490 0x55ab2f4956c0 secure :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f12380c7e10 tx=0x7f123801d000 comp rx=0 tx=0).stop 2024-02-21T23:05:00.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.478+0000 7f124e378740 1 -- 172.21.15.99:0/3412840406 >> 172.21.15.99:0/3412840406 conn(0x55ab2f4a2660 msgr2=0x55ab2f4aa9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:05:00.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.478+0000 7f124e378740 1 -- 172.21.15.99:0/3412840406 shutdown_connections 2024-02-21T23:05:00.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.478+0000 7f124e378740 1 -- 172.21.15.99:0/3412840406 wait complete. 2024-02-21T23:05:00.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.480+0000 7f124e378740 1 -- start start 2024-02-21T23:05:00.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.480+0000 7f124e378740 1 Processor -- start 2024-02-21T23:05:00.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.482+0000 7f124e378740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab2f4dd330 0x55ab2f46b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:00.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.482+0000 7f124e378740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ab2f4ddcf0 0x55ab2f4e4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:00.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.482+0000 7f124e378740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ab2f4e9dc0 0x55ab2f4ee1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:00.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.482+0000 7f124e378740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1244070520 con 0x55ab2f4ddcf0 2024-02-21T23:05:00.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.482+0000 7f124e378740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1244071820 con 0x55ab2f4dd330 2024-02-21T23:05:00.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.482+0000 7f124e378740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1244070b60 con 0x55ab2f4e9dc0 2024-02-21T23:05:00.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.482+0000 7f124e378740 10 client.0 _ll_register_callbacks cb 0x7f1238097930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:05:00.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.482+0000 7f1248a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab2f4dd330 0x55ab2f46b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:00.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.482+0000 7f1249400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ab2f4e9dc0 0x55ab2f4ee1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:00.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.482+0000 7f1249400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ab2f4e9dc0 0x55ab2f4ee1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:41638/0 (socket says 172.21.15.99:41638) 2024-02-21T23:05:00.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.482+0000 7f1249400640 1 -- 172.21.15.99:0/615513393 learned_addr learned my addr 172.21.15.99:0/615513393 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:05:00.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.483+0000 7f1243e00640 1 --2- 172.21.15.99:0/615513393 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ab2f4ddcf0 0x55ab2f4e4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:00.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.483+0000 7f1249400640 1 -- 172.21.15.99:0/615513393 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab2f4dd330 msgr2=0x55ab2f46b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:05:00.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.483+0000 7f1249400640 1 --2- 172.21.15.99:0/615513393 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab2f4dd330 0x55ab2f46b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:00.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.483+0000 7f1249400640 1 -- 172.21.15.99:0/615513393 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ab2f4ddcf0 msgr2=0x55ab2f4e4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:05:00.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.483+0000 7f1249400640 1 --2- 172.21.15.99:0/615513393 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ab2f4ddcf0 0x55ab2f4e4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:00.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.483+0000 7f1249400640 1 -- 172.21.15.99:0/615513393 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ab2f4ee730 con 0x55ab2f4e9dc0 2024-02-21T23:05:00.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.483+0000 7f1249400640 1 --2- 172.21.15.99:0/615513393 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ab2f4e9dc0 0x55ab2f4ee1f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f123c00e530 tx=0x7f123c011000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5cd0fc6345914511 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:05:00.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.483+0000 7f1229600640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-02-21T23:05:00.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.483+0000 7f1229600640 1 -- 172.21.15.99:0/615513393 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123c003b80 con 0x55ab2f4e9dc0 2024-02-21T23:05:00.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.483+0000 7f1229600640 1 -- 172.21.15.99:0/615513393 <== mon.2 v2:172.21.15.181:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f123c003d20 con 0x55ab2f4e9dc0 2024-02-21T23:05:00.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.483+0000 7f124e378740 1 -- 172.21.15.99:0/615513393 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f12380981d0 con 0x55ab2f4e9dc0 2024-02-21T23:05:00.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.484+0000 7f1229600640 1 -- 172.21.15.99:0/615513393 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f123c02f050 con 0x55ab2f4e9dc0 2024-02-21T23:05:00.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.484+0000 7f124e378740 10 client.5807 fetch_fsmap learned FSMap version 16 2024-02-21T23:05:00.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.484+0000 7f124e378740 1 -- 172.21.15.99:0/615513393 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55ab2f4a74a0 con 0x55ab2f4e9dc0 2024-02-21T23:05:00.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.484+0000 7f1229600640 1 -- 172.21.15.99:0/615513393 <== mon.2 v2:172.21.15.181:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12380981d0 con 0x55ab2f4e9dc0 2024-02-21T23:05:00.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.484+0000 7f1229600640 1 -- 172.21.15.99:0/615513393 <== mon.2 v2:172.21.15.181:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f123c005110 con 0x55ab2f4e9dc0 2024-02-21T23:05:00.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.484+0000 7f124e378740 10 client.5807 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T23:05:00.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.484+0000 7f124e378740 10 client.5807 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:05:00.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.484+0000 7f124e378740 20 client.5807 populate_metadata read hostname 'smithi099' 2024-02-21T23:05:00.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.484+0000 7f124e378740 1 --2- 172.21.15.99:0/615513393 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55ab2f4a1860 0x55ab2f4cc250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:00.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.484+0000 7f124e378740 4 client.5807 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T23:05:00.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.484+0000 7f124e378740 1 -- 172.21.15.99:0/615513393 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55ab2f3d23e0 con 0x55ab2f4a1860 2024-02-21T23:05:00.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.485+0000 7f1248a00640 1 --2- 172.21.15.99:0/615513393 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55ab2f4a1860 0x55ab2f4cc250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:00.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.485+0000 7f1248a00640 1 --2- 172.21.15.99:0/615513393 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55ab2f4a1860 0x55ab2f4cc250 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b450b0fd69f124f server_cookie=fe097a05c8322e73 in_seq=0 out_seq=0 2024-02-21T23:05:00.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.485+0000 7f1229600640 10 client.5807 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:05:00.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.486+0000 7f1229600640 1 -- 172.21.15.99:0/615513393 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55ab2f3d23e0 con 0x55ab2f4a1860 2024-02-21T23:05:00.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.486+0000 7f1229600640 10 client.5807 handle_command_reply: tid=0 2024-02-21T23:05:00.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.486+0000 7f124e378740 1 client.5807 shutdown 2024-02-21T23:05:00.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.486+0000 7f124e378740 1 -- 172.21.15.99:0/615513393 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ab2f4e9dc0 msgr2=0x55ab2f4ee1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:00.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.486+0000 7f124e378740 1 --2- 172.21.15.99:0/615513393 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ab2f4e9dc0 0x55ab2f4ee1f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f123c00e530 tx=0x7f123c011000 comp rx=0 tx=0).stop 2024-02-21T23:05:00.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.486+0000 7f124e378740 1 -- 172.21.15.99:0/615513393 shutdown_connections 2024-02-21T23:05:00.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.486+0000 7f124e378740 1 --2- 172.21.15.99:0/615513393 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55ab2f4a1860 0x55ab2f4cc250 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:00.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.486+0000 7f124e378740 1 --2- 172.21.15.99:0/615513393 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ab2f4e9dc0 0x55ab2f4ee1f0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:00.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.486+0000 7f124e378740 1 --2- 172.21.15.99:0/615513393 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ab2f4ddcf0 0x55ab2f4e4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:00.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.486+0000 7f124e378740 1 --2- 172.21.15.99:0/615513393 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab2f4dd330 0x55ab2f46b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:00.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.486+0000 7f124e378740 1 -- 172.21.15.99:0/615513393 >> 172.21.15.99:0/615513393 conn(0x55ab2f4a2660 msgr2=0x55ab2f4ee9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:05:00.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.486+0000 7f1229600640 0 client.5807 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:05:00.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.486+0000 7f124e378740 1 -- 172.21.15.99:0/615513393 shutdown_connections 2024-02-21T23:05:00.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.486+0000 7f124e378740 1 -- 172.21.15.99:0/615513393 wait complete. 2024-02-21T23:05:00.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.487+0000 7f124e378740 20 client.5807 trim_cache size 0 max 16384 2024-02-21T23:05:00.478 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-02-21T23:05:00.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.487+0000 7f1249e00640 1 -- 172.21.15.99:0/2594531433 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f122409eed0 msgr2=0x7f12240a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:00.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.488+0000 7f1249e00640 1 --2- 172.21.15.99:0/2594531433 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f122409eed0 0x7f12240a1390 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f123c001d30 tx=0x7f123c009040 comp rx=0 tx=0).stop 2024-02-21T23:05:00.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.488+0000 7f1249e00640 1 -- 172.21.15.99:0/2594531433 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1244180ab0 msgr2=0x7f12440f9940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:00.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.488+0000 7f1249e00640 1 --2- 172.21.15.99:0/2594531433 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1244180ab0 0x7f12440f9940 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f123800ebe0 tx=0x7f123800c520 comp rx=0 tx=0).stop 2024-02-21T23:05:00.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.488+0000 7f1249e00640 1 -- 172.21.15.99:0/2594531433 shutdown_connections 2024-02-21T23:05:00.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.488+0000 7f1249e00640 1 --2- 172.21.15.99:0/2594531433 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f122409eed0 0x7f12240a1390 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:00.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.488+0000 7f1249e00640 1 --2- 172.21.15.99:0/2594531433 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1244189660 0x7f124416cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:00.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.488+0000 7f1249e00640 1 --2- 172.21.15.99:0/2594531433 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12441891e0 0x7f124421ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:00.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.488+0000 7f1249e00640 1 --2- 172.21.15.99:0/2594531433 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1244180ab0 0x7f12440f9940 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:00.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.488+0000 7f1249e00640 1 -- 172.21.15.99:0/2594531433 >> 172.21.15.99:0/2594531433 conn(0x7f12440ce4b0 msgr2=0x7f124417f8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:05:00.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.488+0000 7f1249e00640 1 -- 172.21.15.99:0/2594531433 shutdown_connections 2024-02-21T23:05:00.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:00.488+0000 7f1249e00640 1 -- 172.21.15.99:0/2594531433 wait complete. 2024-02-21T23:05:01.498 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-02-21T23:05:01.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T23:05:01.498 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-02-21T23:05:01.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.709+0000 7f7bc7200640 1 Processor -- start 2024-02-21T23:05:01.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.709+0000 7f7bc7200640 1 -- start start 2024-02-21T23:05:01.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.710+0000 7f7bc7200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7bc8186360 0x7f7bc8186fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:01.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.710+0000 7f7bc7200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bc8162890 con 0x7f7bc8183e50 2024-02-21T23:05:01.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.711+0000 7f7bc7200640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bc81848d0 con 0x7f7bc8184230 2024-02-21T23:05:01.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.711+0000 7f7bc7200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bc80f7e00 con 0x7f7bc8186360 2024-02-21T23:05:01.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.711+0000 7f7bc5e00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f7bc8183e50 0x7f7bc8185c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.99:59714/0 (socket says 172.21.15.99:59714) 2024-02-21T23:05:01.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.711+0000 7f7bc5e00640 1 -- 172.21.15.99:0/488850287 learned_addr learned my addr 172.21.15.99:0/488850287 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:05:01.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.711+0000 7f7bc6800640 1 --2- 172.21.15.99:0/488850287 >> v2:172.21.15.99:3300/0 conn(0x7f7bc8186360 0x7f7bc8186fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:01.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.711+0000 7f7bc4a00640 1 -- 172.21.15.99:0/488850287 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 411874192 0 0) 0x7f7bc8162890 con 0x7f7bc8183e50 2024-02-21T23:05:01.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.711+0000 7f7bc4a00640 1 -- 172.21.15.99:0/488850287 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7bac003520 con 0x7f7bc8183e50 2024-02-21T23:05:01.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.711+0000 7f7bc4a00640 1 -- 172.21.15.99:0/488850287 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1899662257 0 0) 0x7f7bc81848d0 con 0x7f7bc8184230 2024-02-21T23:05:01.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.711+0000 7f7bc6800640 1 -- 172.21.15.99:0/488850287 >> v1:172.21.15.181:6789/0 conn(0x7f7bc8184230 legacy=0x7f7bc81868c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:01.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.711+0000 7f7bc6800640 1 -- 172.21.15.99:0/488850287 >> v1:172.21.15.162:6789/0 conn(0x7f7bc8183e50 legacy=0x7f7bc8185c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:01.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.711+0000 7f7bc6800640 1 -- 172.21.15.99:0/488850287 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc8184bb0 con 0x7f7bc8186360 2024-02-21T23:05:01.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.713+0000 7f7bc6800640 1 --2- 172.21.15.99:0/488850287 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7bc8186360 0x7f7bc8186fd0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7bc0009dc0 tx=0x7f7bc002be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1e03495c5bddd4 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:05:01.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.714+0000 7f7bc4a00640 1 -- 172.21.15.99:0/488850287 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc0039070 con 0x7f7bc8186360 2024-02-21T23:05:01.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.714+0000 7f7bc4a00640 1 -- 172.21.15.99:0/488850287 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bc002cc40 con 0x7f7bc8186360 2024-02-21T23:05:01.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.714+0000 7f7bc4a00640 1 -- 172.21.15.99:0/488850287 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc0034440 con 0x7f7bc8186360 2024-02-21T23:05:01.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.714+0000 7f7bc7200640 1 -- 172.21.15.99:0/488850287 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7bc8186360 msgr2=0x7f7bc8186fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:01.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.714+0000 7f7bc7200640 1 --2- 172.21.15.99:0/488850287 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7bc8186360 0x7f7bc8186fd0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7bc0009dc0 tx=0x7f7bc002be90 comp rx=0 tx=0).stop 2024-02-21T23:05:01.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.715+0000 7f7bc7200640 1 -- 172.21.15.99:0/488850287 shutdown_connections 2024-02-21T23:05:01.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.715+0000 7f7bc7200640 1 --2- 172.21.15.99:0/488850287 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7bc8186360 0x7f7bc8186fd0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:01.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.715+0000 7f7bc7200640 1 -- 172.21.15.99:0/488850287 >> 172.21.15.99:0/488850287 conn(0x7f7bc80ce3d0 msgr2=0x7f7bc80ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:05:01.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.715+0000 7f7bc7200640 1 -- 172.21.15.99:0/488850287 shutdown_connections 2024-02-21T23:05:01.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.715+0000 7f7bc7200640 1 -- 172.21.15.99:0/488850287 wait complete. 2024-02-21T23:05:01.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.718+0000 7f7bc7200640 1 Processor -- start 2024-02-21T23:05:01.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.718+0000 7f7bc7200640 1 -- start start 2024-02-21T23:05:01.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.720+0000 7f7bc7200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7bc8183e50 0x7f7bc80c93d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:01.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.720+0000 7f7bc7200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7bc8184230 0x7f7bc80f4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:01.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.720+0000 7f7bc7200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7bc8186360 0x7f7bc80f4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:01.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.720+0000 7f7bc7200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc8185450 con 0x7f7bc8186360 2024-02-21T23:05:01.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.720+0000 7f7bc7200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc8185170 con 0x7f7bc8183e50 2024-02-21T23:05:01.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.720+0000 7f7bc7200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc8185730 con 0x7f7bc8184230 2024-02-21T23:05:01.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.721+0000 7f7bc5e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7bc8183e50 0x7f7bc80c93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:01.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.721+0000 7f7bc5e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7bc8183e50 0x7f7bc80c93d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:42906/0 (socket says 172.21.15.99:42906) 2024-02-21T23:05:01.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.721+0000 7f7bc5e00640 1 -- 172.21.15.99:0/1842893465 learned_addr learned my addr 172.21.15.99:0/1842893465 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:05:01.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.721+0000 7f7bc6800640 1 --2- 172.21.15.99:0/1842893465 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7bc8186360 0x7f7bc80f4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:01.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.721+0000 7f7bc5400640 1 --2- 172.21.15.99:0/1842893465 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7bc8184230 0x7f7bc80f4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:01.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.721+0000 7f7bc5e00640 1 -- 172.21.15.99:0/1842893465 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7bc8184230 msgr2=0x7f7bc80f4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:01.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.721+0000 7f7bc5e00640 1 --2- 172.21.15.99:0/1842893465 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7bc8184230 0x7f7bc80f4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:01.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.721+0000 7f7bc5e00640 1 -- 172.21.15.99:0/1842893465 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7bc8186360 msgr2=0x7f7bc80f4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:01.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.721+0000 7f7bc5e00640 1 --2- 172.21.15.99:0/1842893465 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7bc8186360 0x7f7bc80f4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:01.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.721+0000 7f7bc5e00640 1 -- 172.21.15.99:0/1842893465 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc821efe0 con 0x7f7bc8183e50 2024-02-21T23:05:01.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.721+0000 7f7bc5400640 1 --2- 172.21.15.99:0/1842893465 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7bc8184230 0x7f7bc80f4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:05:01.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.721+0000 7f7bc6800640 1 --2- 172.21.15.99:0/1842893465 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7bc8186360 0x7f7bc80f4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:05:01.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.722+0000 7f7bc5e00640 1 --2- 172.21.15.99:0/1842893465 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7bc8183e50 0x7f7bc80c93d0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7bb800c440 tx=0x7f7bb800c900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:05:01.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.722+0000 7f7bbe000640 1 -- 172.21.15.99:0/1842893465 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb8017070 con 0x7f7bc8183e50 2024-02-21T23:05:01.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.722+0000 7f7bbe000640 1 -- 172.21.15.99:0/1842893465 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bb8005ce0 con 0x7f7bc8183e50 2024-02-21T23:05:01.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.722+0000 7f7bc7200640 1 -- 172.21.15.99:0/1842893465 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bc821f2a0 con 0x7f7bc8183e50 2024-02-21T23:05:01.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.722+0000 7f7bc7200640 1 -- 172.21.15.99:0/1842893465 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bc821f860 con 0x7f7bc8183e50 2024-02-21T23:05:01.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.722+0000 7f7bbe000640 1 -- 172.21.15.99:0/1842893465 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb80072b0 con 0x7f7bc8183e50 2024-02-21T23:05:01.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.726+0000 7f7bcf9a6740 1 Processor -- start 2024-02-21T23:05:01.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.726+0000 7f7bcf9a6740 1 -- start start 2024-02-21T23:05:01.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.727+0000 7f7bbe000640 1 -- 172.21.15.99:0/1842893465 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f7bb801a070 con 0x7f7bc8183e50 2024-02-21T23:05:01.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.728+0000 7f7bcf9a6740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559b9a9404c0 0x559b9a9408a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:01.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.728+0000 7f7bcf9a6740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559b9a940de0 0x559b9a97b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:01.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.728+0000 7f7bcf9a6740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b9a97bb90 0x559b9a97c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:01.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.728+0000 7f7bcf9a6740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b9a868790 con 0x559b9a9404c0 2024-02-21T23:05:01.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.728+0000 7f7bcf9a6740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b9a811bf0 con 0x559b9a940de0 2024-02-21T23:05:01.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.728+0000 7f7bcf9a6740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b9a864830 con 0x559b9a97bb90 2024-02-21T23:05:01.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.728+0000 7f7bc6800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559b9a9404c0 0x559b9a9408a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:01.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.728+0000 7f7bc6800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559b9a9404c0 0x559b9a9408a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56172/0 (socket says 172.21.15.99:56172) 2024-02-21T23:05:01.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.728+0000 7f7bc6800640 1 -- 172.21.15.99:0/2849408300 learned_addr learned my addr 172.21.15.99:0/2849408300 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:05:01.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.728+0000 7f7bc5e00640 1 --2- 172.21.15.99:0/2849408300 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559b9a940de0 0x559b9a97b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:01.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.728+0000 7f7bc5400640 1 --2- 172.21.15.99:0/2849408300 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b9a97bb90 0x559b9a97c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:01.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.729+0000 7f7bc5400640 1 -- 172.21.15.99:0/2849408300 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559b9a940de0 msgr2=0x559b9a97b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:05:01.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.729+0000 7f7bc5400640 1 --2- 172.21.15.99:0/2849408300 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559b9a940de0 0x559b9a97b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:01.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.729+0000 7f7bc5400640 1 -- 172.21.15.99:0/2849408300 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559b9a9404c0 msgr2=0x559b9a9408a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:05:01.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.729+0000 7f7bc5400640 1 --2- 172.21.15.99:0/2849408300 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559b9a9404c0 0x559b9a9408a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:01.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.729+0000 7f7bc5400640 1 -- 172.21.15.99:0/2849408300 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559b9a82fc40 con 0x559b9a97bb90 2024-02-21T23:05:01.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.729+0000 7f7bc6800640 1 --2- 172.21.15.99:0/2849408300 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559b9a9404c0 0x559b9a9408a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:05:01.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.729+0000 7f7bc5400640 1 --2- 172.21.15.99:0/2849408300 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b9a97bb90 0x559b9a97c920 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f7bb4000f60 tx=0x7f7bb400f5a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd305188a9b41ffa server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:05:01.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.729+0000 7f7bbe000640 1 --2- 172.21.15.99:0/1842893465 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f7ba809eed0 0x7f7ba80a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:01.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.730+0000 7f7bbe000640 1 -- 172.21.15.99:0/1842893465 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f7bb80c90d0 con 0x7f7bc8183e50 2024-02-21T23:05:01.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.730+0000 7f7bb2600640 1 -- 172.21.15.99:0/2849408300 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb400fcb0 con 0x559b9a97bb90 2024-02-21T23:05:01.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.730+0000 7f7bb2600640 1 -- 172.21.15.99:0/2849408300 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bb4018070 con 0x559b9a97bb90 2024-02-21T23:05:01.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.730+0000 7f7bb2600640 1 -- 172.21.15.99:0/2849408300 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb40052d0 con 0x559b9a97bb90 2024-02-21T23:05:01.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.730+0000 7f7bc6800640 1 --2- 172.21.15.99:0/1842893465 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f7ba809eed0 0x7f7ba80a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:01.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.731+0000 7f7bcf9a6740 1 -- 172.21.15.99:0/2849408300 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b9a97bb90 msgr2=0x559b9a97c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:01.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.731+0000 7f7bcf9a6740 1 --2- 172.21.15.99:0/2849408300 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b9a97bb90 0x559b9a97c920 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f7bb4000f60 tx=0x7f7bb400f5a0 comp rx=0 tx=0).stop 2024-02-21T23:05:01.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.731+0000 7f7bcf9a6740 1 -- 172.21.15.99:0/2849408300 shutdown_connections 2024-02-21T23:05:01.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.731+0000 7f7bcf9a6740 1 --2- 172.21.15.99:0/2849408300 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b9a97bb90 0x559b9a97c920 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:01.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.731+0000 7f7bcf9a6740 1 --2- 172.21.15.99:0/2849408300 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559b9a940de0 0x559b9a97b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:01.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.731+0000 7f7bcf9a6740 1 --2- 172.21.15.99:0/2849408300 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559b9a9404c0 0x559b9a9408a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:01.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.731+0000 7f7bcf9a6740 1 -- 172.21.15.99:0/2849408300 >> 172.21.15.99:0/2849408300 conn(0x559b9a902a90 msgr2=0x559b9a903b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:05:01.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.731+0000 7f7bc6800640 1 --2- 172.21.15.99:0/1842893465 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f7ba809eed0 0x7f7ba80a1390 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7bc002bed0 tx=0x7f7bc0030000 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:05:01.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.731+0000 7f7bcf9a6740 1 -- 172.21.15.99:0/2849408300 shutdown_connections 2024-02-21T23:05:01.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.731+0000 7f7bcf9a6740 1 -- 172.21.15.99:0/2849408300 wait complete. 2024-02-21T23:05:01.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.732+0000 7f7bcf9a6740 1 -- start start 2024-02-21T23:05:01.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.733+0000 7f7bcf9a6740 1 Processor -- start 2024-02-21T23:05:01.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.735+0000 7f7bcf9a6740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559b9a940de0 0x559b9a96bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:01.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.735+0000 7f7bcf9a6740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b9a97bb90 0x559b9a93e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:01.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.735+0000 7f7bcf9a6740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559b9a96a1c0 0x559b9a903ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:01.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.735+0000 7f7bcf9a6740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b9a97a070 con 0x559b9a940de0 2024-02-21T23:05:01.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.735+0000 7f7bcf9a6740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b9a8071d0 con 0x559b9a96a1c0 2024-02-21T23:05:01.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.735+0000 7f7bcf9a6740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b9a97a350 con 0x559b9a97bb90 2024-02-21T23:05:01.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.735+0000 7f7bcf9a6740 10 client.0 _ll_register_callbacks cb 0x559b9a57cc60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:05:01.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.735+0000 7f7bc5400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b9a97bb90 0x559b9a93e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:01.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.735+0000 7f7bc5400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b9a97bb90 0x559b9a93e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:41652/0 (socket says 172.21.15.99:41652) 2024-02-21T23:05:01.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.735+0000 7f7bc5400640 1 -- 172.21.15.99:0/542501755 learned_addr learned my addr 172.21.15.99:0/542501755 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:05:01.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.736+0000 7f7bc6800640 1 --2- 172.21.15.99:0/542501755 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559b9a96a1c0 0x559b9a903ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:01.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.736+0000 7f7bc5e00640 1 --2- 172.21.15.99:0/542501755 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559b9a940de0 0x559b9a96bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:01.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.736+0000 7f7bc5400640 1 -- 172.21.15.99:0/542501755 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559b9a96a1c0 msgr2=0x559b9a903ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:05:01.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.736+0000 7f7bc5400640 1 --2- 172.21.15.99:0/542501755 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559b9a96a1c0 0x559b9a903ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:01.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.736+0000 7f7bc5400640 1 -- 172.21.15.99:0/542501755 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559b9a940de0 msgr2=0x559b9a96bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:05:01.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.736+0000 7f7bc5400640 1 --2- 172.21.15.99:0/542501755 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559b9a940de0 0x559b9a96bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:01.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.736+0000 7f7bc5400640 1 -- 172.21.15.99:0/542501755 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559b9a6457e0 con 0x559b9a97bb90 2024-02-21T23:05:01.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.736+0000 7f7bc5e00640 1 --2- 172.21.15.99:0/542501755 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559b9a940de0 0x559b9a96bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T23:05:01.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.736+0000 7f7bc5400640 1 --2- 172.21.15.99:0/542501755 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b9a97bb90 0x559b9a93e670 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x559b9a9412b0 tx=0x7f7bb4007e30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4f50d14748ab05b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:05:01.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.736+0000 7f7ba6a00640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-02-21T23:05:01.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.737+0000 7f7ba6a00640 1 -- 172.21.15.99:0/542501755 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb4003db0 con 0x559b9a97bb90 2024-02-21T23:05:01.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.737+0000 7f7bcf9a6740 1 -- 172.21.15.99:0/542501755 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7bb4018070 con 0x559b9a97bb90 2024-02-21T23:05:01.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.737+0000 7f7ba6a00640 1 -- 172.21.15.99:0/542501755 <== mon.2 v2:172.21.15.181:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f7bb4003bb0 con 0x559b9a97bb90 2024-02-21T23:05:01.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.738+0000 7f7ba6a00640 1 -- 172.21.15.99:0/542501755 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7bb4003db0 con 0x559b9a97bb90 2024-02-21T23:05:01.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.738+0000 7f7bcf9a6740 10 client.5819 fetch_fsmap learned FSMap version 16 2024-02-21T23:05:01.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.738+0000 7f7bcf9a6740 1 -- 172.21.15.99:0/542501755 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x559b9a6a5f70 con 0x559b9a97bb90 2024-02-21T23:05:01.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.738+0000 7f7ba6a00640 1 -- 172.21.15.99:0/542501755 <== mon.2 v2:172.21.15.181:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bb4018070 con 0x559b9a97bb90 2024-02-21T23:05:01.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.739+0000 7f7ba6a00640 1 -- 172.21.15.99:0/542501755 <== mon.2 v2:172.21.15.181:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f7bb4007030 con 0x559b9a97bb90 2024-02-21T23:05:01.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.739+0000 7f7bcf9a6740 10 client.5819 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T23:05:01.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.739+0000 7f7bcf9a6740 10 client.5819 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:05:01.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.739+0000 7f7bcf9a6740 20 client.5819 populate_metadata read hostname 'smithi099' 2024-02-21T23:05:01.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.739+0000 7f7bcf9a6740 1 --2- 172.21.15.99:0/542501755 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x559b9a96a640 0x559b9a9399d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:01.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.739+0000 7f7bcf9a6740 4 client.5819 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:05:01.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.739+0000 7f7bcf9a6740 1 -- 172.21.15.99:0/542501755 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559b9a875cd0 con 0x559b9a96a640 2024-02-21T23:05:01.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.739+0000 7f7bc5e00640 1 --2- 172.21.15.99:0/542501755 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x559b9a96a640 0x559b9a9399d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:01.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.740+0000 7f7bc5e00640 1 --2- 172.21.15.99:0/542501755 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x559b9a96a640 0x559b9a9399d0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=35ed5f900e850a3d server_cookie=c23451db690611ff in_seq=0 out_seq=0 2024-02-21T23:05:01.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.740+0000 7f7ba6a00640 10 client.5819 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:05:01.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.742+0000 7f7ba6a00640 1 -- 172.21.15.99:0/542501755 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x559b9a875cd0 con 0x559b9a96a640 2024-02-21T23:05:01.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.742+0000 7f7ba6a00640 10 client.5819 handle_command_reply: tid=0 2024-02-21T23:05:01.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.742+0000 7f7bcf9a6740 1 client.5819 shutdown 2024-02-21T23:05:01.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.743+0000 7f7bcf9a6740 1 -- 172.21.15.99:0/542501755 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b9a97bb90 msgr2=0x559b9a93e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:01.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.743+0000 7f7bcf9a6740 1 --2- 172.21.15.99:0/542501755 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b9a97bb90 0x559b9a93e670 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x559b9a9412b0 tx=0x7f7bb4007e30 comp rx=0 tx=0).stop 2024-02-21T23:05:01.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.743+0000 7f7bcf9a6740 1 -- 172.21.15.99:0/542501755 shutdown_connections 2024-02-21T23:05:01.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.743+0000 7f7bcf9a6740 1 --2- 172.21.15.99:0/542501755 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x559b9a96a640 0x559b9a9399d0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:01.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.743+0000 7f7bcf9a6740 1 --2- 172.21.15.99:0/542501755 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559b9a96a1c0 0x559b9a903ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:01.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.743+0000 7f7bcf9a6740 1 --2- 172.21.15.99:0/542501755 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b9a97bb90 0x559b9a93e670 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:01.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.743+0000 7f7bcf9a6740 1 --2- 172.21.15.99:0/542501755 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559b9a940de0 0x559b9a96bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:01.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.743+0000 7f7bcf9a6740 1 -- 172.21.15.99:0/542501755 >> 172.21.15.99:0/542501755 conn(0x559b9a9404c0 msgr2=0x559b9a9798a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:05:01.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.743+0000 7f7ba6a00640 0 client.5819 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:05:01.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.744+0000 7f7bcf9a6740 1 -- 172.21.15.99:0/542501755 shutdown_connections 2024-02-21T23:05:01.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.744+0000 7f7bcf9a6740 1 -- 172.21.15.99:0/542501755 wait complete. 2024-02-21T23:05:01.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.744+0000 7f7bcf9a6740 20 client.5819 trim_cache size 0 max 16384 2024-02-21T23:05:01.735 INFO:tasks.workunit.client.0.smithi099.stdout: [DEP] 2024-02-21T23:05:01.736 INFO:tasks.workunit.client.0.smithi099.stdout: [DEP] 2024-02-21T23:05:01.737 INFO:tasks.workunit.client.0.smithi099.stdout: [DEP] 2024-02-21T23:05:01.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.780+0000 7f7bcf9a6740 1 Processor -- start 2024-02-21T23:05:01.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.780+0000 7f7bcf9a6740 1 -- start start 2024-02-21T23:05:01.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.782+0000 7f7bcf9a6740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559b9a940de0 0x559b9a93e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:01.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.782+0000 7f7bcf9a6740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b9a96a1c0 0x559b9a96a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:01.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.783+0000 7f7bcf9a6740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559b9a97bb90 0x559b9a9849a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:01.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.783+0000 7f7bcf9a6740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba0011a90 con 0x559b9a940de0 2024-02-21T23:05:01.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.783+0000 7f7bc5e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559b9a940de0 0x559b9a93e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:01.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.783+0000 7f7bc5e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559b9a940de0 0x559b9a93e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56184/0 (socket says 172.21.15.99:56184) 2024-02-21T23:05:01.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.783+0000 7f7bc5e00640 1 -- 172.21.15.99:0/3436230185 learned_addr learned my addr 172.21.15.99:0/3436230185 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:05:01.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.783+0000 7f7bcf9a6740 1 -- 172.21.15.99:0/3436230185 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba000f630 con 0x559b9a97bb90 2024-02-21T23:05:01.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.783+0000 7f7bc6800640 1 --2- 172.21.15.99:0/3436230185 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559b9a97bb90 0x559b9a9849a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:01.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.783+0000 7f7bcf9a6740 1 -- 172.21.15.99:0/3436230185 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba000d6d0 con 0x559b9a96a1c0 2024-02-21T23:05:01.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.783+0000 7f7bc5400640 1 --2- 172.21.15.99:0/3436230185 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b9a96a1c0 0x559b9a96a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:01.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.784+0000 7f7bc6800640 1 -- 172.21.15.99:0/3436230185 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b9a96a1c0 msgr2=0x559b9a96a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:05:01.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.784+0000 7f7bc6800640 1 --2- 172.21.15.99:0/3436230185 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b9a96a1c0 0x559b9a96a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:01.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.784+0000 7f7bc6800640 1 -- 172.21.15.99:0/3436230185 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559b9a940de0 msgr2=0x559b9a93e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:05:01.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.784+0000 7f7bc6800640 1 --2- 172.21.15.99:0/3436230185 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559b9a940de0 0x559b9a93e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:01.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.784+0000 7f7bc6800640 1 -- 172.21.15.99:0/3436230185 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559b9a53d170 con 0x559b9a97bb90 2024-02-21T23:05:01.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.784+0000 7f7bc6800640 1 --2- 172.21.15.99:0/3436230185 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559b9a97bb90 0x559b9a9849a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f7bc0037040 tx=0x7f7bc002e000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aaf2738c7b3908a7 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:05:01.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.785+0000 7f7bb1c00640 1 -- 172.21.15.99:0/3436230185 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc0039040 con 0x559b9a97bb90 2024-02-21T23:05:01.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.785+0000 7f7bb1c00640 1 -- 172.21.15.99:0/3436230185 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bc003a040 con 0x559b9a97bb90 2024-02-21T23:05:01.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.785+0000 7f7bb1c00640 1 -- 172.21.15.99:0/3436230185 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc0041840 con 0x559b9a97bb90 2024-02-21T23:05:01.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.786+0000 7f7bcf9a6740 1 -- 172.21.15.99:0/3436230185 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559b9a97bb90 msgr2=0x559b9a9849a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:01.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.786+0000 7f7bcf9a6740 1 --2- 172.21.15.99:0/3436230185 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559b9a97bb90 0x559b9a9849a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f7bc0037040 tx=0x7f7bc002e000 comp rx=0 tx=0).stop 2024-02-21T23:05:01.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.786+0000 7f7bcf9a6740 1 -- 172.21.15.99:0/3436230185 shutdown_connections 2024-02-21T23:05:01.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.786+0000 7f7bcf9a6740 1 --2- 172.21.15.99:0/3436230185 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559b9a97bb90 0x559b9a9849a0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:01.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.786+0000 7f7bcf9a6740 1 --2- 172.21.15.99:0/3436230185 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b9a96a1c0 0x559b9a96a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:01.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.786+0000 7f7bcf9a6740 1 --2- 172.21.15.99:0/3436230185 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559b9a940de0 0x559b9a93e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:01.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.786+0000 7f7bcf9a6740 1 -- 172.21.15.99:0/3436230185 >> 172.21.15.99:0/3436230185 conn(0x559b9a9404c0 msgr2=0x559b9a93ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:05:01.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.786+0000 7f7bcf9a6740 1 -- 172.21.15.99:0/3436230185 shutdown_connections 2024-02-21T23:05:01.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.786+0000 7f7bcf9a6740 1 -- 172.21.15.99:0/3436230185 wait complete. 2024-02-21T23:05:01.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.787+0000 7f7bcf9a6740 1 -- start start 2024-02-21T23:05:01.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.788+0000 7f7bcf9a6740 1 Processor -- start 2024-02-21T23:05:01.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.789+0000 7f7bcf9a6740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b9a940de0 0x559b9a94b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:01.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.789+0000 7f7bcf9a6740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559b9a96a1c0 0x559b9a9dc280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:01.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.789+0000 7f7bcf9a6740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559b9a97bb90 0x559b9a9dc7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:01.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.789+0000 7f7bcf9a6740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba000dcd0 con 0x559b9a96a1c0 2024-02-21T23:05:01.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.789+0000 7f7bcf9a6740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba000efd0 con 0x559b9a97bb90 2024-02-21T23:05:01.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.789+0000 7f7bcf9a6740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba000e310 con 0x559b9a940de0 2024-02-21T23:05:01.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.789+0000 7f7bcf9a6740 10 client.0 _ll_register_callbacks cb 0x7f7bac0036f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:05:01.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.790+0000 7f7bc6800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559b9a97bb90 0x559b9a9dc7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:01.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.790+0000 7f7bc6800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559b9a97bb90 0x559b9a9dc7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:42940/0 (socket says 172.21.15.99:42940) 2024-02-21T23:05:01.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.790+0000 7f7bc6800640 1 -- 172.21.15.99:0/3782932227 learned_addr learned my addr 172.21.15.99:0/3782932227 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:05:01.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.790+0000 7f7bc5e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b9a940de0 0x559b9a94b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:01.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.790+0000 7f7bc5400640 1 --2- 172.21.15.99:0/3782932227 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559b9a96a1c0 0x559b9a9dc280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:01.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.790+0000 7f7bc6800640 1 -- 172.21.15.99:0/3782932227 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b9a940de0 msgr2=0x559b9a94b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:05:01.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.790+0000 7f7bc6800640 1 --2- 172.21.15.99:0/3782932227 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b9a940de0 0x559b9a94b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:01.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.790+0000 7f7bc6800640 1 -- 172.21.15.99:0/3782932227 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559b9a96a1c0 msgr2=0x559b9a9dc280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:05:01.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.790+0000 7f7bc6800640 1 --2- 172.21.15.99:0/3782932227 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559b9a96a1c0 0x559b9a9dc280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:01.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.790+0000 7f7bc6800640 1 -- 172.21.15.99:0/3782932227 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559b9a93d9d0 con 0x559b9a97bb90 2024-02-21T23:05:01.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.791+0000 7f7bc5400640 1 --2- 172.21.15.99:0/3782932227 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559b9a96a1c0 0x559b9a9dc280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:05:01.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.791+0000 7f7bc6800640 1 --2- 172.21.15.99:0/3782932227 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559b9a97bb90 0x559b9a9dc7c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f7bc0009bd0 tx=0x7f7bc0004ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81ee069bdc31cc44 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:05:01.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.791+0000 7f7ba6a00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-02-21T23:05:01.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.791+0000 7f7ba6a00640 1 -- 172.21.15.99:0/3782932227 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc0065060 con 0x559b9a97bb90 2024-02-21T23:05:01.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.791+0000 7f7bcf9a6740 1 -- 172.21.15.99:0/3782932227 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7bc003a040 con 0x559b9a97bb90 2024-02-21T23:05:01.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.791+0000 7f7ba6a00640 1 -- 172.21.15.99:0/3782932227 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f7bc0003d80 con 0x559b9a97bb90 2024-02-21T23:05:01.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.792+0000 7f7ba6a00640 1 -- 172.21.15.99:0/3782932227 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7bc0039040 con 0x559b9a97bb90 2024-02-21T23:05:01.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.792+0000 7f7bcf9a6740 10 client.5815 fetch_fsmap learned FSMap version 16 2024-02-21T23:05:01.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.792+0000 7f7bcf9a6740 1 -- 172.21.15.99:0/3782932227 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x559b9a984bd0 con 0x559b9a97bb90 2024-02-21T23:05:01.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.792+0000 7f7ba6a00640 1 -- 172.21.15.99:0/3782932227 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bc003a040 con 0x559b9a97bb90 2024-02-21T23:05:01.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.792+0000 7f7ba6a00640 1 -- 172.21.15.99:0/3782932227 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f7bc0004040 con 0x559b9a97bb90 2024-02-21T23:05:01.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.792+0000 7f7bcf9a6740 10 client.5815 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T23:05:01.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.792+0000 7f7bcf9a6740 10 client.5815 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:05:01.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.792+0000 7f7bcf9a6740 20 client.5815 populate_metadata read hostname 'smithi099' 2024-02-21T23:05:01.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.792+0000 7f7bcf9a6740 1 --2- 172.21.15.99:0/3782932227 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x559b9a93f780 0x559b9a93e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:01.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.792+0000 7f7bcf9a6740 4 client.5815 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-02-21T23:05:01.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.792+0000 7f7bcf9a6740 1 -- 172.21.15.99:0/3782932227 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x559b9a9031f0 con 0x559b9a93f780 2024-02-21T23:05:01.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.793+0000 7f7bc5e00640 1 --2- 172.21.15.99:0/3782932227 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x559b9a93f780 0x559b9a93e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:01.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.794+0000 7f7bc5e00640 1 --2- 172.21.15.99:0/3782932227 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x559b9a93f780 0x559b9a93e630 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d339c39d9e0089 server_cookie=586fedb056fd67d5 in_seq=0 out_seq=0 2024-02-21T23:05:01.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.794+0000 7f7ba6a00640 10 client.5815 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:05:01.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.796+0000 7f7ba6a00640 1 -- 172.21.15.99:0/3782932227 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x559b9a9031f0 con 0x559b9a93f780 2024-02-21T23:05:01.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.796+0000 7f7ba6a00640 10 client.5815 handle_command_reply: tid=0 2024-02-21T23:05:01.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.796+0000 7f7bcf9a6740 1 client.5815 shutdown 2024-02-21T23:05:01.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.796+0000 7f7bcf9a6740 1 -- 172.21.15.99:0/3782932227 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559b9a97bb90 msgr2=0x559b9a9dc7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:01.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.796+0000 7f7bcf9a6740 1 --2- 172.21.15.99:0/3782932227 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559b9a97bb90 0x559b9a9dc7c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f7bc0009bd0 tx=0x7f7bc0004ab0 comp rx=0 tx=0).stop 2024-02-21T23:05:01.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.797+0000 7f7bcf9a6740 1 -- 172.21.15.99:0/3782932227 shutdown_connections 2024-02-21T23:05:01.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.797+0000 7f7bcf9a6740 1 --2- 172.21.15.99:0/3782932227 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x559b9a93f780 0x559b9a93e630 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:01.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.797+0000 7f7bcf9a6740 1 --2- 172.21.15.99:0/3782932227 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559b9a97bb90 0x559b9a9dc7c0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:01.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.797+0000 7f7bcf9a6740 1 --2- 172.21.15.99:0/3782932227 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559b9a96a1c0 0x559b9a9dc280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:01.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.797+0000 7f7bcf9a6740 1 --2- 172.21.15.99:0/3782932227 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559b9a940de0 0x559b9a94b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:01.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.797+0000 7f7bcf9a6740 1 -- 172.21.15.99:0/3782932227 >> 172.21.15.99:0/3782932227 conn(0x559b9a9404c0 msgr2=0x559b9a97aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:05:01.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.797+0000 7f7ba6a00640 0 client.5815 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:05:01.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.798+0000 7f7bcf9a6740 1 -- 172.21.15.99:0/3782932227 shutdown_connections 2024-02-21T23:05:01.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.798+0000 7f7bcf9a6740 1 -- 172.21.15.99:0/3782932227 wait complete. 2024-02-21T23:05:01.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.798+0000 7f7bcf9a6740 20 client.5815 trim_cache size 0 max 16384 2024-02-21T23:05:01.787 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-02-21T23:05:01.787 INFO:teuthology.orchestra.run.smithi099.stdout: "return_code": 0, 2024-02-21T23:05:01.787 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_tag": "dd9c3d94-55fb-45fc-b5a7-c8373f2cc898", 2024-02-21T23:05:01.787 INFO:teuthology.orchestra.run.smithi099.stdout: "mode": "asynchronous" 2024-02-21T23:05:01.787 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-02-21T23:05:01.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.800+0000 7f7bc7200640 1 -- 172.21.15.99:0/1842893465 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f7ba809eed0 msgr2=0x7f7ba80a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:01.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.800+0000 7f7bc7200640 1 --2- 172.21.15.99:0/1842893465 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f7ba809eed0 0x7f7ba80a1390 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7bc002bed0 tx=0x7f7bc0030000 comp rx=0 tx=0).stop 2024-02-21T23:05:01.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.800+0000 7f7bc7200640 1 -- 172.21.15.99:0/1842893465 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7bc8183e50 msgr2=0x7f7bc80c93d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:01.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.800+0000 7f7bc7200640 1 --2- 172.21.15.99:0/1842893465 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7bc8183e50 0x7f7bc80c93d0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7bb800c440 tx=0x7f7bb800c900 comp rx=0 tx=0).stop 2024-02-21T23:05:01.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.801+0000 7f7bc7200640 1 -- 172.21.15.99:0/1842893465 shutdown_connections 2024-02-21T23:05:01.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.801+0000 7f7bc7200640 1 --2- 172.21.15.99:0/1842893465 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f7ba809eed0 0x7f7ba80a1390 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:01.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.801+0000 7f7bc7200640 1 --2- 172.21.15.99:0/1842893465 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7bc8186360 0x7f7bc80f4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:01.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.801+0000 7f7bc7200640 1 --2- 172.21.15.99:0/1842893465 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7bc8184230 0x7f7bc80f4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:01.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.801+0000 7f7bc7200640 1 --2- 172.21.15.99:0/1842893465 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7bc8183e50 0x7f7bc80c93d0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:01.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.801+0000 7f7bc7200640 1 -- 172.21.15.99:0/1842893465 >> 172.21.15.99:0/1842893465 conn(0x7f7bc80ce3d0 msgr2=0x7f7bc8185c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:05:01.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.802+0000 7f7bc7200640 1 -- 172.21.15.99:0/1842893465 shutdown_connections 2024-02-21T23:05:01.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:01.802+0000 7f7bc7200640 1 -- 172.21.15.99:0/1842893465 wait complete. 2024-02-21T23:05:01.822 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T23:05:01.823 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T23:05:02.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.173+0000 7f4be7e00640 1 Processor -- start 2024-02-21T23:05:02.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.173+0000 7f4be7e00640 1 -- start start 2024-02-21T23:05:02.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.179+0000 7f4be5400640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f4be006d220 0x7f4be0070800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:58160/0 (socket says 172.21.15.99:58160) 2024-02-21T23:05:02.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.180+0000 7f4be5400640 1 -- 172.21.15.99:0/2361527051 learned_addr learned my addr 172.21.15.99:0/2361527051 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:05:02.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.180+0000 7f4be7e00640 1 -- 172.21.15.99:0/2361527051 --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4be00710a0 con 0x7f4be006dd10 2024-02-21T23:05:02.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.180+0000 7f4be7e00640 1 -- 172.21.15.99:0/2361527051 --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4be0071380 con 0x7f4be00f9500 2024-02-21T23:05:02.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.180+0000 7f4be7e00640 1 -- 172.21.15.99:0/2361527051 --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4be0071660 con 0x7f4be006d220 2024-02-21T23:05:02.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.181+0000 7f4bdfe00640 1 -- 172.21.15.99:0/2361527051 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3151026242 0 0) 0x7f4be0071660 con 0x7f4be006d220 2024-02-21T23:05:02.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.181+0000 7f4bdfe00640 1 -- 172.21.15.99:0/2361527051 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bc8003440 con 0x7f4be006d220 2024-02-21T23:05:02.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.182+0000 7f4bdfe00640 1 -- 172.21.15.99:0/2361527051 <== mon.2 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2697067347 0 0) 0x7f4bc8003440 con 0x7f4be006d220 2024-02-21T23:05:02.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.183+0000 7f4bdfe00640 1 -- 172.21.15.99:0/2361527051 >> v1:172.21.15.162:6789/0 conn(0x7f4be00f9500 legacy=0x7f4be006d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:05:02.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.183+0000 7f4bdfe00640 1 -- 172.21.15.99:0/2361527051 >> v1:172.21.15.99:6789/0 conn(0x7f4be006dd10 legacy=0x7f4be0188320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:02.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.183+0000 7f4bdfe00640 1 -- 172.21.15.99:0/2361527051 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4be0071940 con 0x7f4be006d220 2024-02-21T23:05:02.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.184+0000 7f4bdfe00640 1 -- 172.21.15.99:0/2361527051 <== mon.2 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2069890144 0 0) 0x7f4bcc004cb0 con 0x7f4be006d220 2024-02-21T23:05:02.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.184+0000 7f4bdfe00640 1 -- 172.21.15.99:0/2361527051 >> v1:172.21.15.181:6789/0 conn(0x7f4be006d220 legacy=0x7f4be0070800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:02.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.184+0000 7f4bdfe00640 1 --2- 172.21.15.99:0/2361527051 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4bc8003af0 0x7f4bc8003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:02.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.184+0000 7f4bdfe00640 1 --2- 172.21.15.99:0/2361527051 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4bc8008a30 0x7f4bc800ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:02.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.184+0000 7f4bdfe00640 1 --2- 172.21.15.99:0/2361527051 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4bc800b720 0x7f4bc800dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:02.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.184+0000 7f4bdfe00640 1 -- 172.21.15.99:0/2361527051 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc800e490 con 0x7f4bc8008a30 2024-02-21T23:05:02.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.184+0000 7f4bdfe00640 1 -- 172.21.15.99:0/2361527051 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc800e640 con 0x7f4bc800b720 2024-02-21T23:05:02.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.184+0000 7f4bdfe00640 1 -- 172.21.15.99:0/2361527051 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc800e840 con 0x7f4bc8003af0 2024-02-21T23:05:02.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.185+0000 7f4be5400640 1 --2- 172.21.15.99:0/2361527051 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4bc8003af0 0x7f4bc8003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:02.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.185+0000 7f4be6800640 1 --2- 172.21.15.99:0/2361527051 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4bc800b720 0x7f4bc800dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:02.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.186+0000 7f4be5400640 1 -- 172.21.15.99:0/2361527051 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4bc800b720 msgr2=0x7f4bc800dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:05:02.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.186+0000 7f4be5400640 1 --2- 172.21.15.99:0/2361527051 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4bc800b720 0x7f4bc800dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:02.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.186+0000 7f4be5400640 1 -- 172.21.15.99:0/2361527051 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4bc8008a30 msgr2=0x7f4bc800ae80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T23:05:02.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.188+0000 7f4be4a00640 1 --2- 172.21.15.99:0/2361527051 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4bc8008a30 0x7f4bc800ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:02.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.190+0000 7f4be5400640 1 --2- 172.21.15.99:0/2361527051 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4bc8008a30 0x7f4bc800ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:02.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.190+0000 7f4be5400640 1 -- 172.21.15.99:0/2361527051 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bc8003440 con 0x7f4bc8003af0 2024-02-21T23:05:02.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.190+0000 7f4be6800640 1 -- 172.21.15.99:0/2361527051 reap_dead start 2024-02-21T23:05:02.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.190+0000 7f4be4a00640 1 --2- 172.21.15.99:0/2361527051 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4bc8008a30 0x7f4bc800ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T23:05:02.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.192+0000 7f4be5400640 1 --2- 172.21.15.99:0/2361527051 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4bc8003af0 0x7f4bc8003ef0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc001da0 tx=0x7f4bc8003730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=205ecca75e2141c6 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:05:02.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.193+0000 7f4bdfe00640 1 -- 172.21.15.99:0/2361527051 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bcc0019f0 con 0x7f4bc8003af0 2024-02-21T23:05:02.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.193+0000 7f4bdfe00640 1 -- 172.21.15.99:0/2361527051 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bcc035440 con 0x7f4bc8003af0 2024-02-21T23:05:02.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.193+0000 7f4bdfe00640 1 -- 172.21.15.99:0/2361527051 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bcc0358b0 con 0x7f4bc8003af0 2024-02-21T23:05:02.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.194+0000 7f4be7e00640 1 -- 172.21.15.99:0/2361527051 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4bc8003af0 msgr2=0x7f4bc8003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:02.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.194+0000 7f4be7e00640 1 --2- 172.21.15.99:0/2361527051 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4bc8003af0 0x7f4bc8003ef0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc001da0 tx=0x7f4bc8003730 comp rx=0 tx=0).stop 2024-02-21T23:05:02.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.195+0000 7f4be7e00640 1 -- 172.21.15.99:0/2361527051 shutdown_connections 2024-02-21T23:05:02.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.195+0000 7f4be7e00640 1 --2- 172.21.15.99:0/2361527051 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4bc8003af0 0x7f4bc8003ef0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:02.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.195+0000 7f4be7e00640 1 -- 172.21.15.99:0/2361527051 >> 172.21.15.99:0/2361527051 conn(0x7f4be00f6c50 msgr2=0x7f4be00f7060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:05:02.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.195+0000 7f4be7e00640 1 -- 172.21.15.99:0/2361527051 shutdown_connections 2024-02-21T23:05:02.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.196+0000 7f4be7e00640 1 -- 172.21.15.99:0/2361527051 wait complete. 2024-02-21T23:05:02.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.200+0000 7f4be7e00640 1 Processor -- start 2024-02-21T23:05:02.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.202+0000 7f4be7e00640 1 -- start start 2024-02-21T23:05:02.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.207+0000 7f4be7e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4bc8003af0 0x7f4be0216780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:02.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.208+0000 7f4be5400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4bc8003af0 0x7f4be0216780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:02.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.208+0000 7f4be5400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4bc8003af0 0x7f4be0216780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56206/0 (socket says 172.21.15.99:56206) 2024-02-21T23:05:02.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.208+0000 7f4be7e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4be016e750 0x7f4be016ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:02.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.208+0000 7f4be5400640 1 -- 172.21.15.99:0/1475511198 learned_addr learned my addr 172.21.15.99:0/1475511198 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:05:02.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.209+0000 7f4be7e00640 1 --2- 172.21.15.99:0/1475511198 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4be00cd3b0 0x7f4be00cd830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:02.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.209+0000 7f4be7e00640 1 -- 172.21.15.99:0/1475511198 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4be017ee00 con 0x7f4bc8003af0 2024-02-21T23:05:02.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.209+0000 7f4be4a00640 1 --2- 172.21.15.99:0/1475511198 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4be016e750 0x7f4be016ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:02.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.210+0000 7f4be6800640 1 --2- 172.21.15.99:0/1475511198 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4be00cd3b0 0x7f4be00cd830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:02.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.210+0000 7f4be7e00640 1 -- 172.21.15.99:0/1475511198 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4be0072000 con 0x7f4be00cd3b0 2024-02-21T23:05:02.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.210+0000 7f4be7e00640 1 -- 172.21.15.99:0/1475511198 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4be017ef80 con 0x7f4be016e750 2024-02-21T23:05:02.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.212+0000 7f4be6800640 1 -- 172.21.15.99:0/1475511198 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4be016e750 msgr2=0x7f4be016ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:02.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.212+0000 7f4be6800640 1 --2- 172.21.15.99:0/1475511198 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4be016e750 0x7f4be016ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:02.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.212+0000 7f4be6800640 1 -- 172.21.15.99:0/1475511198 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4bc8003af0 msgr2=0x7f4be0216780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:02.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.212+0000 7f4be6800640 1 --2- 172.21.15.99:0/1475511198 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4bc8003af0 0x7f4be0216780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:02.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.212+0000 7f4be6800640 1 -- 172.21.15.99:0/1475511198 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4be00ce060 con 0x7f4be00cd3b0 2024-02-21T23:05:02.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.212+0000 7f4be5400640 1 --2- 172.21.15.99:0/1475511198 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4bc8003af0 0x7f4be0216780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:05:02.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.213+0000 7f4be6800640 1 --2- 172.21.15.99:0/1475511198 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4be00cd3b0 0x7f4be00cd830 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4be00fa1a0 tx=0x7f4bd4001d60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:05:02.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.214+0000 7f4bdd600640 1 -- 172.21.15.99:0/1475511198 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd400c670 con 0x7f4be00cd3b0 2024-02-21T23:05:02.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.214+0000 7f4bdd600640 1 -- 172.21.15.99:0/1475511198 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bd4014030 con 0x7f4be00cd3b0 2024-02-21T23:05:02.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.214+0000 7f4bdd600640 1 -- 172.21.15.99:0/1475511198 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd400ca50 con 0x7f4be00cd3b0 2024-02-21T23:05:02.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.214+0000 7f4be7e00640 1 -- 172.21.15.99:0/1475511198 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4be00ce340 con 0x7f4be00cd3b0 2024-02-21T23:05:02.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.214+0000 7f4be7e00640 1 -- 172.21.15.99:0/1475511198 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4be00ce900 con 0x7f4be00cd3b0 2024-02-21T23:05:02.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.224+0000 7f4bdd600640 1 -- 172.21.15.99:0/1475511198 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f4bd400cbf0 con 0x7f4be00cd3b0 2024-02-21T23:05:02.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.229+0000 7f4bdd600640 1 --2- 172.21.15.99:0/1475511198 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f4bc009f020 0x7f4bc00a14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:02.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.229+0000 7f4bdd600640 1 -- 172.21.15.99:0/1475511198 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f4bd40c94c0 con 0x7f4be00cd3b0 2024-02-21T23:05:02.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.230+0000 7f4beae1b740 1 Processor -- start 2024-02-21T23:05:02.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.230+0000 7f4be5400640 1 --2- 172.21.15.99:0/1475511198 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f4bc009f020 0x7f4bc00a14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:02.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.231+0000 7f4beae1b740 1 -- start start 2024-02-21T23:05:02.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.232+0000 7f4be5400640 1 --2- 172.21.15.99:0/1475511198 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f4bc009f020 0x7f4bc00a14e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc001da0 tx=0x7f4bcc02f000 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:05:02.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.233+0000 7f4beae1b740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55dffac672a0 0x55dffac9cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:02.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.234+0000 7f4be5400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55dffac672a0 0x55dffac9cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:02.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.234+0000 7f4beae1b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dffac9d260 0x55dffac67680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:02.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.234+0000 7f4beae1b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dffac67bc0 0x55dffac2a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:02.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.234+0000 7f4beae1b740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dffab93a90 con 0x55dffac672a0 2024-02-21T23:05:02.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.234+0000 7f4beae1b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dffab3cb10 con 0x55dffac67bc0 2024-02-21T23:05:02.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.234+0000 7f4beae1b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dffab8fb30 con 0x55dffac9d260 2024-02-21T23:05:02.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.234+0000 7f4be5400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55dffac672a0 0x55dffac9cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56208/0 (socket says 172.21.15.99:56208) 2024-02-21T23:05:02.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.235+0000 7f4be5400640 1 -- 172.21.15.99:0/3109501446 learned_addr learned my addr 172.21.15.99:0/3109501446 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:05:02.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.235+0000 7f4be5400640 1 -- 172.21.15.99:0/3109501446 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dffac9d260 msgr2=0x55dffac67680 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T23:05:02.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.235+0000 7f4be5400640 1 --2- 172.21.15.99:0/3109501446 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dffac9d260 0x55dffac67680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:02.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.236+0000 7f4be5400640 1 -- 172.21.15.99:0/3109501446 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dffac67bc0 msgr2=0x55dffac2a1d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T23:05:02.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.236+0000 7f4be5400640 1 --2- 172.21.15.99:0/3109501446 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dffac67bc0 0x55dffac2a1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:02.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.236+0000 7f4be5400640 1 -- 172.21.15.99:0/3109501446 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dffa9727d0 con 0x55dffac672a0 2024-02-21T23:05:02.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.236+0000 7f4be5400640 1 --2- 172.21.15.99:0/3109501446 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55dffac672a0 0x55dffac9cd20 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc004cc0 tx=0x7f4bcc007000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29d79963ebd13120 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:05:02.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.237+0000 7f4bd1c00640 1 -- 172.21.15.99:0/3109501446 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bcc043030 con 0x55dffac672a0 2024-02-21T23:05:02.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.237+0000 7f4bd1c00640 1 -- 172.21.15.99:0/3109501446 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bcc04f070 con 0x55dffac672a0 2024-02-21T23:05:02.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.237+0000 7f4bd1c00640 1 -- 172.21.15.99:0/3109501446 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bcc03f600 con 0x55dffac672a0 2024-02-21T23:05:02.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.238+0000 7f4beae1b740 1 -- 172.21.15.99:0/3109501446 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55dffac672a0 msgr2=0x55dffac9cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:02.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.238+0000 7f4beae1b740 1 --2- 172.21.15.99:0/3109501446 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55dffac672a0 0x55dffac9cd20 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc004cc0 tx=0x7f4bcc007000 comp rx=0 tx=0).stop 2024-02-21T23:05:02.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.239+0000 7f4beae1b740 1 -- 172.21.15.99:0/3109501446 shutdown_connections 2024-02-21T23:05:02.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.239+0000 7f4beae1b740 1 --2- 172.21.15.99:0/3109501446 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dffac67bc0 0x55dffac2a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:02.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.239+0000 7f4beae1b740 1 --2- 172.21.15.99:0/3109501446 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dffac9d260 0x55dffac67680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:02.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.239+0000 7f4beae1b740 1 --2- 172.21.15.99:0/3109501446 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55dffac672a0 0x55dffac9cd20 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:02.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.239+0000 7f4beae1b740 1 -- 172.21.15.99:0/3109501446 >> 172.21.15.99:0/3109501446 conn(0x55dffabf66b0 msgr2=0x55dffac2e190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:05:02.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.239+0000 7f4beae1b740 1 -- 172.21.15.99:0/3109501446 shutdown_connections 2024-02-21T23:05:02.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.240+0000 7f4beae1b740 1 -- 172.21.15.99:0/3109501446 wait complete. 2024-02-21T23:05:02.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.241+0000 7f4beae1b740 1 -- start start 2024-02-21T23:05:02.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.242+0000 7f4beae1b740 1 Processor -- start 2024-02-21T23:05:02.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.245+0000 7f4beae1b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dffac672a0 0x55dffacade60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:02.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.245+0000 7f4beae1b740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55dffac67bc0 0x55dffac5cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:02.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.245+0000 7f4beae1b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dffac9d260 0x55dffac729a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:02.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.245+0000 7f4beae1b740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dffac35f30 con 0x55dffac67bc0 2024-02-21T23:05:02.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.245+0000 7f4beae1b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dffab321c0 con 0x55dffac9d260 2024-02-21T23:05:02.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.245+0000 7f4beae1b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dffac9e930 con 0x55dffac672a0 2024-02-21T23:05:02.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.245+0000 7f4beae1b740 10 client.0 _ll_register_callbacks cb 0x55dffab4f930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:05:02.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.245+0000 7f4be5400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dffac672a0 0x55dffacade60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:02.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.245+0000 7f4be5400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dffac672a0 0x55dffacade60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:41704/0 (socket says 172.21.15.99:41704) 2024-02-21T23:05:02.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.245+0000 7f4be5400640 1 -- 172.21.15.99:0/3611024806 learned_addr learned my addr 172.21.15.99:0/3611024806 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:05:02.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.246+0000 7f4be6800640 1 --2- 172.21.15.99:0/3611024806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dffac9d260 0x55dffac729a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:02.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.246+0000 7f4be6800640 1 -- 172.21.15.99:0/3611024806 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dffac672a0 msgr2=0x55dffacade60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:05:02.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.246+0000 7f4be6800640 1 --2- 172.21.15.99:0/3611024806 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dffac672a0 0x55dffacade60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:02.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.246+0000 7f4be6800640 1 -- 172.21.15.99:0/3611024806 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55dffac67bc0 msgr2=0x55dffac5cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:05:02.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.246+0000 7f4be6800640 1 --2- 172.21.15.99:0/3611024806 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55dffac67bc0 0x55dffac5cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:02.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.246+0000 7f4be6800640 1 -- 172.21.15.99:0/3611024806 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dffa8a83f0 con 0x55dffac9d260 2024-02-21T23:05:02.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.247+0000 7f4be6800640 1 --2- 172.21.15.99:0/3611024806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dffac9d260 0x55dffac729a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4bd40c6bb0 tx=0x7f4bd4096a10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8063e5833b54b01b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:05:02.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.247+0000 7f4bc6000640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-02-21T23:05:02.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.247+0000 7f4bc6000640 1 -- 172.21.15.99:0/3611024806 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd401e070 con 0x55dffac9d260 2024-02-21T23:05:02.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.248+0000 7f4bc6000640 1 -- 172.21.15.99:0/3611024806 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f4bd40aeb80 con 0x55dffac9d260 2024-02-21T23:05:02.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.248+0000 7f4beae1b740 1 -- 172.21.15.99:0/3611024806 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4bcc04f070 con 0x55dffac9d260 2024-02-21T23:05:02.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.249+0000 7f4bc6000640 1 -- 172.21.15.99:0/3611024806 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4bd40c6f20 con 0x55dffac9d260 2024-02-21T23:05:02.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.250+0000 7f4beae1b740 10 client.5821 fetch_fsmap learned FSMap version 16 2024-02-21T23:05:02.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.250+0000 7f4beae1b740 1 -- 172.21.15.99:0/3611024806 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55dffa8680f0 con 0x55dffac9d260 2024-02-21T23:05:02.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.252+0000 7f4bc6000640 1 -- 172.21.15.99:0/3611024806 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bcc04f070 con 0x55dffac9d260 2024-02-21T23:05:02.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.252+0000 7f4bc6000640 1 -- 172.21.15.99:0/3611024806 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f4bd4096260 con 0x55dffac9d260 2024-02-21T23:05:02.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.254+0000 7f4beae1b740 10 client.5821 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T23:05:02.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.254+0000 7f4beae1b740 10 client.5821 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:05:02.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.254+0000 7f4beae1b740 20 client.5821 populate_metadata read hostname 'smithi099' 2024-02-21T23:05:02.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.254+0000 7f4beae1b740 1 --2- 172.21.15.99:0/3611024806 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55dffac2e6a0 0x55dffacae5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:02.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.254+0000 7f4beae1b740 4 client.5821 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:05:02.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.254+0000 7f4beae1b740 1 -- 172.21.15.99:0/3611024806 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dffaba0fd0 con 0x55dffac2e6a0 2024-02-21T23:05:02.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.256+0000 7f4be5400640 1 --2- 172.21.15.99:0/3611024806 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55dffac2e6a0 0x55dffacae5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:02.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.258+0000 7f4be5400640 1 --2- 172.21.15.99:0/3611024806 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55dffac2e6a0 0x55dffacae5b0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b69740102d83bec1 server_cookie=800c406b488473d in_seq=0 out_seq=0 2024-02-21T23:05:02.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.258+0000 7f4bc6000640 10 client.5821 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:05:02.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.263+0000 7f4bc6000640 1 -- 172.21.15.99:0/3611024806 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55dffaba0fd0 con 0x55dffac2e6a0 2024-02-21T23:05:02.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.263+0000 7f4bc6000640 10 client.5821 handle_command_reply: tid=0 2024-02-21T23:05:02.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.263+0000 7f4beae1b740 1 client.5821 shutdown 2024-02-21T23:05:02.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.264+0000 7f4beae1b740 1 -- 172.21.15.99:0/3611024806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dffac9d260 msgr2=0x55dffac729a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:02.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.264+0000 7f4beae1b740 1 --2- 172.21.15.99:0/3611024806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dffac9d260 0x55dffac729a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4bd40c6bb0 tx=0x7f4bd4096a10 comp rx=0 tx=0).stop 2024-02-21T23:05:02.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.264+0000 7f4beae1b740 1 -- 172.21.15.99:0/3611024806 shutdown_connections 2024-02-21T23:05:02.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.264+0000 7f4beae1b740 1 --2- 172.21.15.99:0/3611024806 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55dffac2e6a0 0x55dffacae5b0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:02.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.264+0000 7f4beae1b740 1 --2- 172.21.15.99:0/3611024806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dffac9d260 0x55dffac729a0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:02.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.264+0000 7f4beae1b740 1 --2- 172.21.15.99:0/3611024806 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55dffac67bc0 0x55dffac5cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:02.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.264+0000 7f4beae1b740 1 --2- 172.21.15.99:0/3611024806 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dffac672a0 0x55dffacade60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:02.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.264+0000 7f4beae1b740 1 -- 172.21.15.99:0/3611024806 >> 172.21.15.99:0/3611024806 conn(0x55dffabf66b0 msgr2=0x55dffac6fb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:05:02.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.265+0000 7f4bc6000640 0 client.5821 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:05:02.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.266+0000 7f4beae1b740 1 -- 172.21.15.99:0/3611024806 shutdown_connections 2024-02-21T23:05:02.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.266+0000 7f4beae1b740 1 -- 172.21.15.99:0/3611024806 wait complete. 2024-02-21T23:05:02.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.267+0000 7f4beae1b740 20 client.5821 trim_cache size 0 max 16384 2024-02-21T23:05:02.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.308+0000 7f4beae1b740 1 Processor -- start 2024-02-21T23:05:02.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.308+0000 7f4beae1b740 1 -- start start 2024-02-21T23:05:02.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.311+0000 7f4beae1b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dffac672a0 0x55dffac5d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:02.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.311+0000 7f4beae1b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dffac67bc0 0x55dffac2f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:02.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.312+0000 7f4beae1b740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55dffac9d260 0x55dffac359d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:02.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.312+0000 7f4be4a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dffac67bc0 0x55dffac2f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:02.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.312+0000 7f4be4a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dffac67bc0 0x55dffac2f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:42988/0 (socket says 172.21.15.99:42988) 2024-02-21T23:05:02.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.312+0000 7f4be6800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55dffac9d260 0x55dffac359d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:02.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.312+0000 7f4be6800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55dffac9d260 0x55dffac359d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56216/0 (socket says 172.21.15.99:56216) 2024-02-21T23:05:02.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.313+0000 7f4be5400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dffac672a0 0x55dffac5d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:02.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.313+0000 7f4be4a00640 1 -- 172.21.15.99:0/2081912530 learned_addr learned my addr 172.21.15.99:0/2081912530 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:05:02.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.313+0000 7f4beae1b740 1 -- 172.21.15.99:0/2081912530 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4be0231120 con 0x55dffac9d260 2024-02-21T23:05:02.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.313+0000 7f4beae1b740 1 -- 172.21.15.99:0/2081912530 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4be022ecc0 con 0x55dffac67bc0 2024-02-21T23:05:02.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.313+0000 7f4beae1b740 1 -- 172.21.15.99:0/2081912530 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4be022cee0 con 0x55dffac672a0 2024-02-21T23:05:02.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.314+0000 7f4be6800640 1 -- 172.21.15.99:0/2081912530 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dffac672a0 msgr2=0x55dffac5d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:05:02.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.314+0000 7f4be6800640 1 --2- 172.21.15.99:0/2081912530 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dffac672a0 0x55dffac5d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:02.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.314+0000 7f4be6800640 1 -- 172.21.15.99:0/2081912530 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dffac67bc0 msgr2=0x55dffac2f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:05:02.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.314+0000 7f4be6800640 1 --2- 172.21.15.99:0/2081912530 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dffac67bc0 0x55dffac2f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:02.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.314+0000 7f4be6800640 1 -- 172.21.15.99:0/2081912530 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dffac2c710 con 0x55dffac9d260 2024-02-21T23:05:02.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.314+0000 7f4be6800640 1 --2- 172.21.15.99:0/2081912530 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55dffac9d260 0x55dffac359d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x55dffac619a0 tx=0x7f4bd401b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12c3946a817bbb2f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:05:02.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.314+0000 7f4be4a00640 1 --2- 172.21.15.99:0/2081912530 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dffac67bc0 0x55dffac2f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T23:05:02.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.315+0000 7f4be5400640 1 --2- 172.21.15.99:0/2081912530 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dffac672a0 0x55dffac5d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:05:02.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.315+0000 7f4bd1200640 1 -- 172.21.15.99:0/2081912530 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd40c5080 con 0x55dffac9d260 2024-02-21T23:05:02.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.315+0000 7f4bd1200640 1 -- 172.21.15.99:0/2081912530 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bd409f500 con 0x55dffac9d260 2024-02-21T23:05:02.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.315+0000 7f4bd1200640 1 -- 172.21.15.99:0/2081912530 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd40c9270 con 0x55dffac9d260 2024-02-21T23:05:02.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.316+0000 7f4beae1b740 1 -- 172.21.15.99:0/2081912530 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55dffac9d260 msgr2=0x55dffac359d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:02.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.316+0000 7f4beae1b740 1 --2- 172.21.15.99:0/2081912530 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55dffac9d260 0x55dffac359d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x55dffac619a0 tx=0x7f4bd401b000 comp rx=0 tx=0).stop 2024-02-21T23:05:02.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.316+0000 7f4beae1b740 1 -- 172.21.15.99:0/2081912530 shutdown_connections 2024-02-21T23:05:02.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.316+0000 7f4beae1b740 1 --2- 172.21.15.99:0/2081912530 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55dffac9d260 0x55dffac359d0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:02.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.316+0000 7f4beae1b740 1 --2- 172.21.15.99:0/2081912530 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dffac67bc0 0x55dffac2f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:02.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.316+0000 7f4beae1b740 1 --2- 172.21.15.99:0/2081912530 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dffac672a0 0x55dffac5d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:02.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.316+0000 7f4beae1b740 1 -- 172.21.15.99:0/2081912530 >> 172.21.15.99:0/2081912530 conn(0x55dffabf66b0 msgr2=0x55dffac6e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:05:02.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.316+0000 7f4beae1b740 1 -- 172.21.15.99:0/2081912530 shutdown_connections 2024-02-21T23:05:02.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.317+0000 7f4beae1b740 1 -- 172.21.15.99:0/2081912530 wait complete. 2024-02-21T23:05:02.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.318+0000 7f4beae1b740 1 -- start start 2024-02-21T23:05:02.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.318+0000 7f4beae1b740 1 Processor -- start 2024-02-21T23:05:02.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.321+0000 7f4beae1b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dffac672a0 0x55dffac29210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:02.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.321+0000 7f4beae1b740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55dffac67bc0 0x55dffac72480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:02.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.321+0000 7f4beae1b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dffac9d260 0x55dffac56a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:02.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.321+0000 7f4beae1b740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4be022d3c0 con 0x55dffac67bc0 2024-02-21T23:05:02.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.321+0000 7f4beae1b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4be022e660 con 0x55dffac672a0 2024-02-21T23:05:02.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.321+0000 7f4beae1b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4be022d9c0 con 0x55dffac9d260 2024-02-21T23:05:02.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.321+0000 7f4beae1b740 10 client.0 _ll_register_callbacks cb 0x7f4bd400e580 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:05:02.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.322+0000 7f4be5400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dffac672a0 0x55dffac29210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:02.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.322+0000 7f4be5400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dffac672a0 0x55dffac29210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:42998/0 (socket says 172.21.15.99:42998) 2024-02-21T23:05:02.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.322+0000 7f4be5400640 1 -- 172.21.15.99:0/980269506 learned_addr learned my addr 172.21.15.99:0/980269506 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:05:02.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.322+0000 7f4be5400640 1 -- 172.21.15.99:0/980269506 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dffac9d260 msgr2=0x55dffac56a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:05:02.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.322+0000 7f4be4a00640 1 --2- 172.21.15.99:0/980269506 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55dffac67bc0 0x55dffac72480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:02.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.322+0000 7f4be6800640 1 --2- 172.21.15.99:0/980269506 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dffac9d260 0x55dffac56a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:02.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.322+0000 7f4be5400640 1 --2- 172.21.15.99:0/980269506 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dffac9d260 0x55dffac56a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:02.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.322+0000 7f4be5400640 1 -- 172.21.15.99:0/980269506 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55dffac67bc0 msgr2=0x55dffac72480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:05:02.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.323+0000 7f4be5400640 1 --2- 172.21.15.99:0/980269506 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55dffac67bc0 0x55dffac72480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:02.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.323+0000 7f4be5400640 1 -- 172.21.15.99:0/980269506 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dffac2c9a0 con 0x55dffac672a0 2024-02-21T23:05:02.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.323+0000 7f4be6800640 1 --2- 172.21.15.99:0/980269506 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dffac9d260 0x55dffac56a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T23:05:02.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.323+0000 7f4be4a00640 1 --2- 172.21.15.99:0/980269506 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55dffac67bc0 0x55dffac72480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T23:05:02.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.324+0000 7f4be5400640 1 --2- 172.21.15.99:0/980269506 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dffac672a0 0x55dffac29210 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc04c040 tx=0x7f4be0184a80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d93162300d886126 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:05:02.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.324+0000 7f4bc6000640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-02-21T23:05:02.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.324+0000 7f4bc6000640 1 -- 172.21.15.99:0/980269506 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bcc043070 con 0x55dffac672a0 2024-02-21T23:05:02.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.324+0000 7f4bc6000640 1 -- 172.21.15.99:0/980269506 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f4bcc03f9a0 con 0x55dffac672a0 2024-02-21T23:05:02.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.324+0000 7f4beae1b740 1 -- 172.21.15.99:0/980269506 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4bd409f500 con 0x55dffac672a0 2024-02-21T23:05:02.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.325+0000 7f4bc6000640 1 -- 172.21.15.99:0/980269506 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4bcc068050 con 0x55dffac672a0 2024-02-21T23:05:02.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.325+0000 7f4beae1b740 10 client.5824 fetch_fsmap learned FSMap version 16 2024-02-21T23:05:02.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.325+0000 7f4beae1b740 1 -- 172.21.15.99:0/980269506 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55dffac9f320 con 0x55dffac672a0 2024-02-21T23:05:02.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.325+0000 7f4bc6000640 1 -- 172.21.15.99:0/980269506 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bd409f500 con 0x55dffac672a0 2024-02-21T23:05:02.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.325+0000 7f4bc6000640 1 -- 172.21.15.99:0/980269506 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f4bcc05c020 con 0x55dffac672a0 2024-02-21T23:05:02.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.326+0000 7f4beae1b740 10 client.5824 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T23:05:02.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.326+0000 7f4beae1b740 10 client.5824 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:05:02.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.326+0000 7f4beae1b740 20 client.5824 populate_metadata read hostname 'smithi099' 2024-02-21T23:05:02.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.326+0000 7f4beae1b740 1 --2- 172.21.15.99:0/980269506 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55dffac5c9d0 0x55dffac9ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:02.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.326+0000 7f4beae1b740 4 client.5824 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T23:05:02.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.326+0000 7f4beae1b740 1 -- 172.21.15.99:0/980269506 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55dffab9b320 con 0x55dffac5c9d0 2024-02-21T23:05:02.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.327+0000 7f4be4a00640 1 --2- 172.21.15.99:0/980269506 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55dffac5c9d0 0x55dffac9ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:02.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.330+0000 7f4be4a00640 1 --2- 172.21.15.99:0/980269506 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55dffac5c9d0 0x55dffac9ca60 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a96151d3c31f904 server_cookie=1367ecda4a3e9c38 in_seq=0 out_seq=0 2024-02-21T23:05:02.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.330+0000 7f4bc6000640 10 client.5824 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:05:02.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.333+0000 7f4bc6000640 1 -- 172.21.15.99:0/980269506 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+268 (crc 0 0 0) 0x55dffab9b320 con 0x55dffac5c9d0 2024-02-21T23:05:02.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.333+0000 7f4bc6000640 10 client.5824 handle_command_reply: tid=0 2024-02-21T23:05:02.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.333+0000 7f4beae1b740 1 client.5824 shutdown 2024-02-21T23:05:02.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.333+0000 7f4beae1b740 1 -- 172.21.15.99:0/980269506 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dffac672a0 msgr2=0x55dffac29210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:02.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.333+0000 7f4beae1b740 1 --2- 172.21.15.99:0/980269506 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dffac672a0 0x55dffac29210 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc04c040 tx=0x7f4be0184a80 comp rx=0 tx=0).stop 2024-02-21T23:05:02.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.334+0000 7f4beae1b740 1 -- 172.21.15.99:0/980269506 shutdown_connections 2024-02-21T23:05:02.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.334+0000 7f4beae1b740 1 --2- 172.21.15.99:0/980269506 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55dffac5c9d0 0x55dffac9ca60 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:02.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.334+0000 7f4beae1b740 1 --2- 172.21.15.99:0/980269506 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dffac9d260 0x55dffac56a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:02.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.334+0000 7f4beae1b740 1 --2- 172.21.15.99:0/980269506 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55dffac67bc0 0x55dffac72480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:02.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.334+0000 7f4beae1b740 1 --2- 172.21.15.99:0/980269506 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dffac672a0 0x55dffac29210 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:02.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.334+0000 7f4beae1b740 1 -- 172.21.15.99:0/980269506 >> 172.21.15.99:0/980269506 conn(0x55dffabf66b0 msgr2=0x55dffac28b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:05:02.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.334+0000 7f4bc6000640 0 client.5824 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:05:02.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.335+0000 7f4beae1b740 1 -- 172.21.15.99:0/980269506 shutdown_connections 2024-02-21T23:05:02.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.335+0000 7f4beae1b740 1 -- 172.21.15.99:0/980269506 wait complete. 2024-02-21T23:05:02.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.335+0000 7f4beae1b740 20 client.5824 trim_cache size 0 max 16384 2024-02-21T23:05:02.324 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-02-21T23:05:02.325 INFO:teuthology.orchestra.run.smithi099.stdout: "status": "scrub active (1899 inodes in the stack)", 2024-02-21T23:05:02.325 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubs": { 2024-02-21T23:05:02.325 INFO:teuthology.orchestra.run.smithi099.stdout: "dd9c3d94-55fb-45fc-b5a7-c8373f2cc898": { 2024-02-21T23:05:02.325 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/", 2024-02-21T23:05:02.325 INFO:teuthology.orchestra.run.smithi099.stdout: "tag": "dd9c3d94-55fb-45fc-b5a7-c8373f2cc898", 2024-02-21T23:05:02.325 INFO:teuthology.orchestra.run.smithi099.stdout: "options": "recursive,force" 2024-02-21T23:05:02.325 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:05:02.325 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:05:02.325 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-02-21T23:05:02.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.337+0000 7f4be7e00640 1 -- 172.21.15.99:0/1475511198 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f4bc009f020 msgr2=0x7f4bc00a14e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:02.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.337+0000 7f4be7e00640 1 --2- 172.21.15.99:0/1475511198 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f4bc009f020 0x7f4bc00a14e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc001da0 tx=0x7f4bcc02f000 comp rx=0 tx=0).stop 2024-02-21T23:05:02.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.337+0000 7f4be7e00640 1 -- 172.21.15.99:0/1475511198 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4be00cd3b0 msgr2=0x7f4be00cd830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:02.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.337+0000 7f4be7e00640 1 --2- 172.21.15.99:0/1475511198 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4be00cd3b0 0x7f4be00cd830 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4be00fa1a0 tx=0x7f4bd4001d60 comp rx=0 tx=0).stop 2024-02-21T23:05:02.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.337+0000 7f4be7e00640 1 -- 172.21.15.99:0/1475511198 shutdown_connections 2024-02-21T23:05:02.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.337+0000 7f4be7e00640 1 --2- 172.21.15.99:0/1475511198 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f4bc009f020 0x7f4bc00a14e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:02.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.337+0000 7f4be7e00640 1 --2- 172.21.15.99:0/1475511198 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4be00cd3b0 0x7f4be00cd830 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:02.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.337+0000 7f4be7e00640 1 --2- 172.21.15.99:0/1475511198 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4be016e750 0x7f4be016ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:02.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.337+0000 7f4be7e00640 1 --2- 172.21.15.99:0/1475511198 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4bc8003af0 0x7f4be0216780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:02.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.338+0000 7f4be7e00640 1 -- 172.21.15.99:0/1475511198 >> 172.21.15.99:0/1475511198 conn(0x7f4be00f6c50 msgr2=0x7f4be006d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:05:02.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.338+0000 7f4be7e00640 1 -- 172.21.15.99:0/1475511198 shutdown_connections 2024-02-21T23:05:02.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:02.339+0000 7f4be7e00640 1 -- 172.21.15.99:0/1475511198 wait complete. 2024-02-21T23:05:02.351 INFO:tasks.cephfs.filesystem:scrub status for tag:dd9c3d94-55fb-45fc-b5a7-c8373f2cc898 - {'path': '/', 'tag': 'dd9c3d94-55fb-45fc-b5a7-c8373f2cc898', 'options': 'recursive,force'} 2024-02-21T23:05:02.590 INFO:tasks.workunit.client.0.smithi099.stdout: [CC] dirstress 2024-02-21T23:05:02.595 INFO:tasks.workunit.client.0.smithi099.stdout: [CC] fill 2024-02-21T23:05:02.597 INFO:tasks.workunit.client.0.smithi099.stdout: [CC] fill2 2024-02-21T23:05:02.601 INFO:tasks.workunit.client.0.smithi099.stdout: [CC] getpagesize 2024-02-21T23:05:03.231 INFO:tasks.workunit.client.0.smithi099.stdout: [CC] holes 2024-02-21T23:05:03.261 INFO:tasks.workunit.client.0.smithi099.stdout: [CC] lstat64 2024-02-21T23:05:03.413 INFO:tasks.workunit.client.0.smithi099.stdout: [CC] nametest 2024-02-21T23:05:03.473 INFO:tasks.workunit.client.0.smithi099.stdout: [CC] permname 2024-02-21T23:05:03.767 INFO:tasks.workunit.client.0.smithi099.stdout: [CC] randholes 2024-02-21T23:05:03.774 INFO:tasks.workunit.client.0.smithi099.stdout: [CC] runas 2024-02-21T23:05:03.931 INFO:tasks.workunit.client.0.smithi099.stdout: [CC] truncfile 2024-02-21T23:05:03.950 INFO:tasks.workunit.client.0.smithi099.stdout: [CC] usemem 2024-02-21T23:05:04.206 INFO:tasks.workunit.client.0.smithi099.stdout: [CC] mmapcat 2024-02-21T23:05:04.323 INFO:tasks.workunit.client.0.smithi099.stdout: [CC] append_reader 2024-02-21T23:05:04.324 INFO:tasks.workunit.client.0.smithi099.stdout: [CC] append_writer 2024-02-21T23:05:04.375 INFO:tasks.workunit.client.0.smithi099.stdout: [CC] dirperf 2024-02-21T23:05:04.575 INFO:tasks.workunit.client.0.smithi099.stdout: [CC] metaperf 2024-02-21T23:05:04.708 INFO:tasks.workunit.client.0.smithi099.stdout: [CC] devzero 2024-02-21T23:05:04.712 INFO:tasks.workunit.client.0.smithi099.stdout: [CC] feature 2024-02-21T23:05:04.920 INFO:tasks.workunit.client.0.smithi099.stdout: [CC] alloc 2024-02-21T23:05:05.135 INFO:tasks.workunit.client.0.smithi099.stdout: [CC] fault 2024-02-21T23:05:05.162 INFO:tasks.workunit.client.0.smithi099.stdout: [CC] fstest 2024-02-21T23:05:05.211 INFO:tasks.workunit.client.0.smithi099.stdout: [CC] t_access_root 2024-02-21T23:05:05.257 INFO:tasks.workunit.client.0.smithi099.stderr:alloc.c: In function 'main': 2024-02-21T23:05:05.258 INFO:tasks.workunit.client.0.smithi099.stderr:alloc.c:154:1: error: 'bozo' undeclared (first use in this function) 2024-02-21T23:05:05.258 INFO:tasks.workunit.client.0.smithi099.stderr: 154 | bozo! 2024-02-21T23:05:05.258 INFO:tasks.workunit.client.0.smithi099.stderr: | ^~~~ 2024-02-21T23:05:05.258 INFO:tasks.workunit.client.0.smithi099.stderr:alloc.c:154:1: note: each undeclared identifier is reported only once for each function it appears in 2024-02-21T23:05:05.258 INFO:tasks.workunit.client.0.smithi099.stderr:alloc.c:154:5: error: expected ';' before '!' token 2024-02-21T23:05:05.258 INFO:tasks.workunit.client.0.smithi099.stderr: 154 | bozo! 2024-02-21T23:05:05.258 INFO:tasks.workunit.client.0.smithi099.stderr: | ^ 2024-02-21T23:05:05.258 INFO:tasks.workunit.client.0.smithi099.stderr: | ; 2024-02-21T23:05:05.259 INFO:tasks.workunit.client.0.smithi099.stderr:alloc.c:184:25: error: 'rflag' undeclared (first use in this function); did you mean 'nflag'? 2024-02-21T23:05:05.259 INFO:tasks.workunit.client.0.smithi099.stderr: 184 | rflag = 1; 2024-02-21T23:05:05.259 INFO:tasks.workunit.client.0.smithi099.stderr: | ^~~~~ 2024-02-21T23:05:05.259 INFO:tasks.workunit.client.0.smithi099.stderr: | nflag 2024-02-21T23:05:05.259 INFO:tasks.workunit.client.0.smithi099.stderr:alloc.c:320:5: error: expected ';' before '!' token 2024-02-21T23:05:05.259 INFO:tasks.workunit.client.0.smithi099.stderr: 320 | bozo! 2024-02-21T23:05:05.259 INFO:tasks.workunit.client.0.smithi099.stderr: | ^ 2024-02-21T23:05:05.259 INFO:tasks.workunit.client.0.smithi099.stderr: | ; 2024-02-21T23:05:05.260 INFO:tasks.workunit.client.0.smithi099.stderr:alloc.c:128:25: warning: variable 'f' set but not used [-Wunused-but-set-variable] 2024-02-21T23:05:05.260 INFO:tasks.workunit.client.0.smithi099.stderr: 128 | struct flock64 f; 2024-02-21T23:05:05.260 INFO:tasks.workunit.client.0.smithi099.stderr: | ^ 2024-02-21T23:05:05.266 INFO:tasks.workunit.client.0.smithi099.stderr:gmake[3]: *** [Makefile:83: alloc] Error 1 2024-02-21T23:05:05.266 INFO:tasks.workunit.client.0.smithi099.stderr:gmake[3]: *** Waiting for unfinished jobs.... 2024-02-21T23:05:05.533 INFO:tasks.workunit.client.0.smithi099.stderr:fstest.c: In function 'run_child': 2024-02-21T23:05:05.533 INFO:tasks.workunit.client.0.smithi099.stderr:fstest.c:95:27: warning: '/file' directive writing 5 bytes into a region of size between 1 and 1024 [-Wformat-overflow=] 2024-02-21T23:05:05.534 INFO:tasks.workunit.client.0.smithi099.stderr: 95 | sprintf(fname, "%s/file%d", dir, fnum); 2024-02-21T23:05:05.534 INFO:tasks.workunit.client.0.smithi099.stderr: | ^~~~~ 2024-02-21T23:05:05.534 INFO:tasks.workunit.client.0.smithi099.stderr:fstest.c:95:24: note: directive argument in the range [0, 2147483647] 2024-02-21T23:05:05.534 INFO:tasks.workunit.client.0.smithi099.stderr: 95 | sprintf(fname, "%s/file%d", dir, fnum); 2024-02-21T23:05:05.534 INFO:tasks.workunit.client.0.smithi099.stderr: | ^~~~~~~~~~~ 2024-02-21T23:05:05.534 INFO:tasks.workunit.client.0.smithi099.stderr:fstest.c:95:9: note: 'sprintf' output between 7 and 1039 bytes into a destination of size 1024 2024-02-21T23:05:05.534 INFO:tasks.workunit.client.0.smithi099.stderr: 95 | sprintf(fname, "%s/file%d", dir, fnum); 2024-02-21T23:05:05.534 INFO:tasks.workunit.client.0.smithi099.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-02-21T23:05:05.534 INFO:tasks.workunit.client.0.smithi099.stderr:fstest.c:166:27: warning: '/file' directive writing 5 bytes into a region of size between 1 and 1024 [-Wformat-overflow=] 2024-02-21T23:05:05.534 INFO:tasks.workunit.client.0.smithi099.stderr: 166 | sprintf(fname, "%s/file%d", dir, fnum); 2024-02-21T23:05:05.534 INFO:tasks.workunit.client.0.smithi099.stderr: | ^~~~~ 2024-02-21T23:05:05.535 INFO:tasks.workunit.client.0.smithi099.stderr:fstest.c:166:24: note: directive argument in the range [0, 2147483647] 2024-02-21T23:05:05.535 INFO:tasks.workunit.client.0.smithi099.stderr: 166 | sprintf(fname, "%s/file%d", dir, fnum); 2024-02-21T23:05:05.535 INFO:tasks.workunit.client.0.smithi099.stderr: | ^~~~~~~~~~~ 2024-02-21T23:05:05.535 INFO:tasks.workunit.client.0.smithi099.stderr:fstest.c:166:9: note: 'sprintf' output between 7 and 1039 bytes into a destination of size 1024 2024-02-21T23:05:05.535 INFO:tasks.workunit.client.0.smithi099.stderr: 166 | sprintf(fname, "%s/file%d", dir, fnum); 2024-02-21T23:05:05.535 INFO:tasks.workunit.client.0.smithi099.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-02-21T23:05:05.659 INFO:tasks.workunit.client.0.smithi099.stderr:gmake[2]: *** [include/buildrules:30: src] Error 2 2024-02-21T23:05:05.659 INFO:tasks.workunit.client.0.smithi099.stderr:make[1]: *** [Makefile:53: default] Error 2 2024-02-21T23:05:05.660 INFO:tasks.workunit.client.0.smithi099.stderr:make: *** [Makefile:51: default] Error 2 2024-02-21T23:05:05.661 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-02-21T23:05:05.662 INFO:tasks.workunit:Stopping ['suites/fsx.sh'] on client.0... 2024-02-21T23:05:05.662 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-02-21T23:05:06.983 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_3bfc837d7b45ce8e095d92fa9c342964cea5e95f/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/git.ceph.com_ceph-c_3bfc837d7b45ce8e095d92fa9c342964cea5e95f/qa/tasks/workunit.py", line 295, in _spawn_on_all_clients p.spawn(_run_tests, ctx, refspec, role, [unit], env, File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_3bfc837d7b45ce8e095d92fa9c342964cea5e95f/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test suites/fsx.sh) on smithi099 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3bfc837d7b45ce8e095d92fa9c342964cea5e95f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsx.sh' 2024-02-21T23:05:07.230 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=dea682e5d72846279c49b38bb5a438da Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_3bfc837d7b45ce8e095d92fa9c342964cea5e95f/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/git.ceph.com_ceph-c_3bfc837d7b45ce8e095d92fa9c342964cea5e95f/qa/tasks/workunit.py", line 295, in _spawn_on_all_clients p.spawn(_run_tests, ctx, refspec, role, [unit], env, File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_3bfc837d7b45ce8e095d92fa9c342964cea5e95f/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test suites/fsx.sh) on smithi099 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3bfc837d7b45ce8e095d92fa9c342964cea5e95f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsx.sh' 2024-02-21T23:05:07.233 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-02-21T23:05:07.242 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-02-21T23:05:07.243 INFO:teuthology.task.exec:Executing custom commands... 2024-02-21T23:05:07.243 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi099.front.sepia.ceph.com 2024-02-21T23:05:07.243 DEBUG:teuthology.orchestra.run.smithi099:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2024-02-21T23:05:07.336 DEBUG:teuthology.orchestra.run.smithi099:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2024-02-21T23:05:12.187 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:05:12.194 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:05:12.197 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:05:32.353 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T23:05:32.354 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T23:05:32.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.570+0000 7fced3e00640 1 Processor -- start 2024-02-21T23:05:32.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.570+0000 7fced3e00640 1 -- start start 2024-02-21T23:05:32.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.573+0000 7fced3e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fcecc180c80 0x7fcecc187f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:32.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.573+0000 7fced3e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcecc06ee40 con 0x7fcecc188440 2024-02-21T23:05:32.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.573+0000 7fced3e00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcecc06f120 con 0x7fcecc06e910 2024-02-21T23:05:32.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.573+0000 7fced3e00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcecc06f400 con 0x7fcecc180c80 2024-02-21T23:05:32.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.574+0000 7fced0a00640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fcecc06e910 0x7fcecc0cb420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:39976/0 (socket says 172.21.15.99:39976) 2024-02-21T23:05:32.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.574+0000 7fced0a00640 1 -- 172.21.15.99:0/805178684 learned_addr learned my addr 172.21.15.99:0/805178684 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:05:32.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.574+0000 7fced1400640 1 --2- 172.21.15.99:0/805178684 >> v2:172.21.15.162:3300/0 conn(0x7fcecc180c80 0x7fcecc187f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:32.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.574+0000 7fcecbe00640 1 -- 172.21.15.99:0/805178684 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3172504557 0 0) 0x7fcecc06f120 con 0x7fcecc06e910 2024-02-21T23:05:32.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.574+0000 7fced1400640 1 -- 172.21.15.99:0/805178684 >> v1:172.21.15.181:6789/0 conn(0x7fcecc06e910 legacy=0x7fcecc0cb420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:32.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.574+0000 7fced1400640 1 -- 172.21.15.99:0/805178684 >> v1:172.21.15.162:6789/0 conn(0x7fcecc188440 legacy=0x7fcecc0f4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:32.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.574+0000 7fced1400640 1 -- 172.21.15.99:0/805178684 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcecc06f6e0 con 0x7fcecc180c80 2024-02-21T23:05:32.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.575+0000 7fced1400640 1 --2- 172.21.15.99:0/805178684 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcecc180c80 0x7fcecc187f00 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fcec0009d90 tx=0x7fcec002bcf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=379308f24e1569e7 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:05:32.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.575+0000 7fcecbe00640 1 -- 172.21.15.99:0/805178684 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec0039070 con 0x7fcecc180c80 2024-02-21T23:05:32.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.576+0000 7fcecbe00640 1 -- 172.21.15.99:0/805178684 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcec002ca20 con 0x7fcecc180c80 2024-02-21T23:05:32.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.576+0000 7fcecbe00640 1 -- 172.21.15.99:0/805178684 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec002cdf0 con 0x7fcecc180c80 2024-02-21T23:05:32.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.576+0000 7fced3e00640 1 -- 172.21.15.99:0/805178684 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcecc180c80 msgr2=0x7fcecc187f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:32.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.576+0000 7fced3e00640 1 --2- 172.21.15.99:0/805178684 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcecc180c80 0x7fcecc187f00 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fcec0009d90 tx=0x7fcec002bcf0 comp rx=0 tx=0).stop 2024-02-21T23:05:32.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.576+0000 7fced3e00640 1 -- 172.21.15.99:0/805178684 shutdown_connections 2024-02-21T23:05:32.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.576+0000 7fced3e00640 1 --2- 172.21.15.99:0/805178684 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcecc180c80 0x7fcecc187f00 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:32.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.576+0000 7fced3e00640 1 -- 172.21.15.99:0/805178684 >> 172.21.15.99:0/805178684 conn(0x7fcecc0ce5f0 msgr2=0x7fcecc0cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:05:32.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.576+0000 7fced3e00640 1 -- 172.21.15.99:0/805178684 shutdown_connections 2024-02-21T23:05:32.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.576+0000 7fced3e00640 1 -- 172.21.15.99:0/805178684 wait complete. 2024-02-21T23:05:32.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.580+0000 7fced3e00640 1 Processor -- start 2024-02-21T23:05:32.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.580+0000 7fced3e00640 1 -- start start 2024-02-21T23:05:32.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.582+0000 7fced3e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcecc06e910 0x7fcecc16b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:32.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.582+0000 7fced3e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcecc180c80 0x7fcecc21f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:32.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.582+0000 7fced3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcecc188440 0x7fcecc16c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:32.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.582+0000 7fced3e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcecc0701c0 con 0x7fcecc188440 2024-02-21T23:05:32.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.582+0000 7fced3e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcecc06fca0 con 0x7fcecc180c80 2024-02-21T23:05:32.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.582+0000 7fced3e00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcecc070340 con 0x7fcecc06e910 2024-02-21T23:05:32.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.582+0000 7fced0a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcecc180c80 0x7fcecc21f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:32.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.582+0000 7fced1400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcecc06e910 0x7fcecc16b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:32.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.582+0000 7fced1400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcecc06e910 0x7fcecc16b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:34524/0 (socket says 172.21.15.99:34524) 2024-02-21T23:05:32.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.582+0000 7fced1400640 1 -- 172.21.15.99:0/2417043658 learned_addr learned my addr 172.21.15.99:0/2417043658 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:05:32.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.582+0000 7fced0a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcecc180c80 0x7fcecc21f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:33148/0 (socket says 172.21.15.99:33148) 2024-02-21T23:05:32.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.582+0000 7fced1e00640 1 --2- 172.21.15.99:0/2417043658 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcecc188440 0x7fcecc16c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:32.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.583+0000 7fced0a00640 1 -- 172.21.15.99:0/2417043658 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcecc06e910 msgr2=0x7fcecc16b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:32.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.583+0000 7fced0a00640 1 --2- 172.21.15.99:0/2417043658 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcecc06e910 0x7fcecc16b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:32.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.583+0000 7fced0a00640 1 -- 172.21.15.99:0/2417043658 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcecc188440 msgr2=0x7fcecc16c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:32.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.583+0000 7fced0a00640 1 --2- 172.21.15.99:0/2417043658 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcecc188440 0x7fcecc16c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:32.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.583+0000 7fced0a00640 1 -- 172.21.15.99:0/2417043658 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcecc1724c0 con 0x7fcecc180c80 2024-02-21T23:05:32.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.583+0000 7fced0a00640 1 --2- 172.21.15.99:0/2417043658 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcecc180c80 0x7fcecc21f480 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fceb800c3e0 tx=0x7fceb800c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:05:32.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.583+0000 7fcec9600640 1 -- 172.21.15.99:0/2417043658 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb80074e0 con 0x7fcecc180c80 2024-02-21T23:05:32.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.583+0000 7fcec9600640 1 -- 172.21.15.99:0/2417043658 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceb80047e0 con 0x7fcecc180c80 2024-02-21T23:05:32.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.583+0000 7fcec9600640 1 -- 172.21.15.99:0/2417043658 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb8004bd0 con 0x7fcecc180c80 2024-02-21T23:05:32.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.583+0000 7fced3e00640 1 -- 172.21.15.99:0/2417043658 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcecc1727a0 con 0x7fcecc180c80 2024-02-21T23:05:32.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.584+0000 7fced3e00640 1 -- 172.21.15.99:0/2417043658 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcecc172d60 con 0x7fcecc180c80 2024-02-21T23:05:32.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.588+0000 7fcec9600640 1 -- 172.21.15.99:0/2417043658 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7fceb8011070 con 0x7fcecc180c80 2024-02-21T23:05:32.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.590+0000 7fced6bf6740 1 Processor -- start 2024-02-21T23:05:32.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.590+0000 7fcec9600640 1 --2- 172.21.15.99:0/2417043658 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fceac09eed0 0x7fceac0a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:32.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.590+0000 7fced6bf6740 1 -- start start 2024-02-21T23:05:32.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.590+0000 7fcec9600640 1 -- 172.21.15.99:0/2417043658 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7fceb80c9970 con 0x7fcecc180c80 2024-02-21T23:05:32.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.591+0000 7fced1e00640 1 --2- 172.21.15.99:0/2417043658 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fceac09eed0 0x7fceac0a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:32.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.591+0000 7fced1e00640 1 --2- 172.21.15.99:0/2417043658 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fceac09eed0 0x7fceac0a1390 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcec4000f60 tx=0x7fcec4009040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:05:32.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.592+0000 7fced6bf6740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56008a414920 0x56008a3db7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:32.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.592+0000 7fced6bf6740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56008a444db0 0x56008a453110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:32.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.592+0000 7fced6bf6740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56008a414d00 0x56008a415160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:32.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.592+0000 7fced6bf6740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x56008a339a90 con 0x56008a414d00 2024-02-21T23:05:32.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.592+0000 7fced6bf6740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x56008a2e2b10 con 0x56008a414920 2024-02-21T23:05:32.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.592+0000 7fced6bf6740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x56008a335b30 con 0x56008a444db0 2024-02-21T23:05:32.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.592+0000 7fced0a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56008a444db0 0x56008a453110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:32.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.592+0000 7fced1400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56008a414920 0x56008a3db7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:32.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.592+0000 7fced1400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56008a414920 0x56008a3db7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:33162/0 (socket says 172.21.15.99:33162) 2024-02-21T23:05:32.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.592+0000 7fced0a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56008a444db0 0x56008a453110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:34530/0 (socket says 172.21.15.99:34530) 2024-02-21T23:05:32.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.592+0000 7fced1400640 1 -- 172.21.15.99:0/42166467 learned_addr learned my addr 172.21.15.99:0/42166467 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:05:32.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.592+0000 7fced1e00640 1 --2- 172.21.15.99:0/42166467 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56008a414d00 0x56008a415160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:32.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.593+0000 7fced0a00640 1 -- 172.21.15.99:0/42166467 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56008a414920 msgr2=0x56008a3db7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:05:32.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.593+0000 7fced0a00640 1 --2- 172.21.15.99:0/42166467 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56008a414920 0x56008a3db7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:32.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.593+0000 7fced0a00640 1 -- 172.21.15.99:0/42166467 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56008a414d00 msgr2=0x56008a415160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:05:32.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.593+0000 7fced0a00640 1 --2- 172.21.15.99:0/42166467 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56008a414d00 0x56008a415160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:32.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.593+0000 7fced0a00640 1 -- 172.21.15.99:0/42166467 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56008a1187d0 con 0x56008a444db0 2024-02-21T23:05:32.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.593+0000 7fced0a00640 1 --2- 172.21.15.99:0/42166467 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56008a444db0 0x56008a453110 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fceb80c7030 tx=0x7fceb8096e60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2d4efe9e8558064 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:05:32.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.594+0000 7fcebdc00640 1 -- 172.21.15.99:0/42166467 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb809b160 con 0x56008a444db0 2024-02-21T23:05:32.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.594+0000 7fcebdc00640 1 -- 172.21.15.99:0/42166467 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceb809f9b0 con 0x56008a444db0 2024-02-21T23:05:32.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.594+0000 7fcebdc00640 1 -- 172.21.15.99:0/42166467 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb8093880 con 0x56008a444db0 2024-02-21T23:05:32.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.595+0000 7fced6bf6740 1 -- 172.21.15.99:0/42166467 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56008a444db0 msgr2=0x56008a453110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:32.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.595+0000 7fced6bf6740 1 --2- 172.21.15.99:0/42166467 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56008a444db0 0x56008a453110 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fceb80c7030 tx=0x7fceb8096e60 comp rx=0 tx=0).stop 2024-02-21T23:05:32.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.595+0000 7fced6bf6740 1 -- 172.21.15.99:0/42166467 shutdown_connections 2024-02-21T23:05:32.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.595+0000 7fced6bf6740 1 --2- 172.21.15.99:0/42166467 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56008a414d00 0x56008a415160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:32.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.595+0000 7fced6bf6740 1 --2- 172.21.15.99:0/42166467 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56008a444db0 0x56008a453110 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:32.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.595+0000 7fced6bf6740 1 --2- 172.21.15.99:0/42166467 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56008a414920 0x56008a3db7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:32.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.595+0000 7fced6bf6740 1 -- 172.21.15.99:0/42166467 >> 172.21.15.99:0/42166467 conn(0x56008a39c6b0 msgr2=0x56008a3d3fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:05:32.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.595+0000 7fced6bf6740 1 -- 172.21.15.99:0/42166467 shutdown_connections 2024-02-21T23:05:32.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.595+0000 7fced6bf6740 1 -- 172.21.15.99:0/42166467 wait complete. 2024-02-21T23:05:32.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.596+0000 7fced6bf6740 1 -- start start 2024-02-21T23:05:32.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.597+0000 7fced6bf6740 1 Processor -- start 2024-02-21T23:05:32.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.599+0000 7fced6bf6740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56008a414920 0x56008a447030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:32.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.599+0000 7fced6bf6740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56008a414d00 0x56008a400040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:32.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.599+0000 7fced6bf6740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56008a444db0 0x56008a40d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:32.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.599+0000 7fced6bf6740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x56008a443a30 con 0x56008a414d00 2024-02-21T23:05:32.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.599+0000 7fced6bf6740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x56008a2d81c0 con 0x56008a414920 2024-02-21T23:05:32.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.599+0000 7fced6bf6740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x56008a443d10 con 0x56008a444db0 2024-02-21T23:05:32.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.599+0000 7fced6bf6740 10 client.0 _ll_register_callbacks cb 0x56008a2f5930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:05:32.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.599+0000 7fced1400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56008a414920 0x56008a447030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:32.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.599+0000 7fced1400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56008a414920 0x56008a447030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:33164/0 (socket says 172.21.15.99:33164) 2024-02-21T23:05:32.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.599+0000 7fced1400640 1 -- 172.21.15.99:0/799187315 learned_addr learned my addr 172.21.15.99:0/799187315 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:05:32.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.599+0000 7fced0a00640 1 --2- 172.21.15.99:0/799187315 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56008a414d00 0x56008a400040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:32.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.600+0000 7fced1e00640 1 --2- 172.21.15.99:0/799187315 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56008a444db0 0x56008a40d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:32.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.600+0000 7fced0a00640 1 -- 172.21.15.99:0/799187315 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56008a444db0 msgr2=0x56008a40d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:05:32.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.600+0000 7fced0a00640 1 --2- 172.21.15.99:0/799187315 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56008a444db0 0x56008a40d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:32.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.600+0000 7fced0a00640 1 -- 172.21.15.99:0/799187315 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56008a414920 msgr2=0x56008a447030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:05:32.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.600+0000 7fced0a00640 1 --2- 172.21.15.99:0/799187315 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56008a414920 0x56008a447030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:32.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.600+0000 7fced0a00640 1 -- 172.21.15.99:0/799187315 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56008a04e3f0 con 0x56008a414d00 2024-02-21T23:05:32.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.600+0000 7fced1400640 1 --2- 172.21.15.99:0/799187315 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56008a414920 0x56008a447030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:05:32.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.600+0000 7fced0a00640 1 --2- 172.21.15.99:0/799187315 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56008a414d00 0x56008a400040 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fceb8093670 tx=0x7fceb80c9040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc70d78636eaeedd server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:05:32.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.600+0000 7fceb2000640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:05:32.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.600+0000 7fceb2000640 1 -- 172.21.15.99:0/799187315 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb80c5060 con 0x56008a414d00 2024-02-21T23:05:32.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.600+0000 7fceb2000640 1 -- 172.21.15.99:0/799187315 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7fceb80c7140 con 0x56008a414d00 2024-02-21T23:05:32.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.600+0000 7fced6bf6740 1 -- 172.21.15.99:0/799187315 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fceb809f9b0 con 0x56008a414d00 2024-02-21T23:05:32.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.601+0000 7fceb2000640 1 -- 172.21.15.99:0/799187315 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fceb809b160 con 0x56008a414d00 2024-02-21T23:05:32.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.601+0000 7fced6bf6740 10 client.5718 fetch_fsmap learned FSMap version 16 2024-02-21T23:05:32.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.601+0000 7fced6bf6740 1 -- 172.21.15.99:0/799187315 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x56008a00e0f0 con 0x56008a414d00 2024-02-21T23:05:32.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.601+0000 7fceb2000640 1 -- 172.21.15.99:0/799187315 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceb809f9b0 con 0x56008a414d00 2024-02-21T23:05:32.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.601+0000 7fceb2000640 1 -- 172.21.15.99:0/799187315 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fceb8096660 con 0x56008a414d00 2024-02-21T23:05:32.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.601+0000 7fced6bf6740 10 client.5718 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T23:05:32.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.601+0000 7fced6bf6740 10 client.5718 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:05:32.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.601+0000 7fced6bf6740 20 client.5718 populate_metadata read hostname 'smithi099' 2024-02-21T23:05:32.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.601+0000 7fced6bf6740 1 --2- 172.21.15.99:0/799187315 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x56008a40c9f0 0x56008a45e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:32.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.601+0000 7fced6bf6740 4 client.5718 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:05:32.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.601+0000 7fced6bf6740 1 -- 172.21.15.99:0/799187315 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56008a346fd0 con 0x56008a40c9f0 2024-02-21T23:05:32.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.601+0000 7fced1400640 1 --2- 172.21.15.99:0/799187315 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x56008a40c9f0 0x56008a45e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:32.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.602+0000 7fced1400640 1 --2- 172.21.15.99:0/799187315 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x56008a40c9f0 0x56008a45e110 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=23bacc18ea703087 server_cookie=571b410420283dc in_seq=0 out_seq=0 2024-02-21T23:05:32.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.602+0000 7fceb2000640 10 client.5718 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:05:32.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.603+0000 7fceb2000640 1 -- 172.21.15.99:0/799187315 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x56008a346fd0 con 0x56008a40c9f0 2024-02-21T23:05:32.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.603+0000 7fceb2000640 10 client.5718 handle_command_reply: tid=0 2024-02-21T23:05:32.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.603+0000 7fced6bf6740 1 client.5718 shutdown 2024-02-21T23:05:32.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.603+0000 7fced6bf6740 1 -- 172.21.15.99:0/799187315 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56008a414d00 msgr2=0x56008a400040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:32.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.603+0000 7fced6bf6740 1 --2- 172.21.15.99:0/799187315 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56008a414d00 0x56008a400040 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fceb8093670 tx=0x7fceb80c9040 comp rx=0 tx=0).stop 2024-02-21T23:05:32.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.604+0000 7fced6bf6740 1 -- 172.21.15.99:0/799187315 shutdown_connections 2024-02-21T23:05:32.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.604+0000 7fced6bf6740 1 --2- 172.21.15.99:0/799187315 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x56008a40c9f0 0x56008a45e110 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:32.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.604+0000 7fced6bf6740 1 --2- 172.21.15.99:0/799187315 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56008a444db0 0x56008a40d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:32.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.604+0000 7fced6bf6740 1 --2- 172.21.15.99:0/799187315 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56008a414d00 0x56008a400040 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:32.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.604+0000 7fced6bf6740 1 --2- 172.21.15.99:0/799187315 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56008a414920 0x56008a447030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:32.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.604+0000 7fceb2000640 0 client.5718 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:05:32.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.604+0000 7fced6bf6740 1 -- 172.21.15.99:0/799187315 >> 172.21.15.99:0/799187315 conn(0x56008a39c6b0 msgr2=0x56008a3d3f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:05:32.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.604+0000 7fced6bf6740 1 -- 172.21.15.99:0/799187315 shutdown_connections 2024-02-21T23:05:32.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.604+0000 7fced6bf6740 1 -- 172.21.15.99:0/799187315 wait complete. 2024-02-21T23:05:32.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.604+0000 7fced6bf6740 20 client.5718 trim_cache size 0 max 16384 2024-02-21T23:05:32.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.638+0000 7fced6bf6740 1 Processor -- start 2024-02-21T23:05:32.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.638+0000 7fced6bf6740 1 -- start start 2024-02-21T23:05:32.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.639+0000 7fced6bf6740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56008a414920 0x56008a3d2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:32.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.640+0000 7fced6bf6740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56008a414d00 0x56008a444180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:32.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.640+0000 7fced6bf6740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56008a444db0 0x56008a411450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:32.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.640+0000 7fced6bf6740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcecc2285d0 con 0x56008a414d00 2024-02-21T23:05:32.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.640+0000 7fced6bf6740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcecc0e4a30 con 0x56008a414920 2024-02-21T23:05:32.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.640+0000 7fced6bf6740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcecc0e2b50 con 0x56008a444db0 2024-02-21T23:05:32.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.640+0000 7fced1400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56008a414920 0x56008a3d2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:32.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.640+0000 7fced0a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56008a414d00 0x56008a444180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:32.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.640+0000 7fced1400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56008a414920 0x56008a3d2910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:33172/0 (socket says 172.21.15.99:33172) 2024-02-21T23:05:32.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.640+0000 7fced1400640 1 -- 172.21.15.99:0/1861292589 learned_addr learned my addr 172.21.15.99:0/1861292589 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:05:32.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.640+0000 7fced1e00640 1 --2- 172.21.15.99:0/1861292589 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56008a444db0 0x56008a411450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:32.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.640+0000 7fced1400640 1 -- 172.21.15.99:0/1861292589 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56008a444db0 msgr2=0x56008a411450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:05:32.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.640+0000 7fced1400640 1 --2- 172.21.15.99:0/1861292589 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56008a444db0 0x56008a411450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:32.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.640+0000 7fced1400640 1 -- 172.21.15.99:0/1861292589 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56008a414d00 msgr2=0x56008a444180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:05:32.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.640+0000 7fced1400640 1 --2- 172.21.15.99:0/1861292589 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56008a414d00 0x56008a444180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:32.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.640+0000 7fced1400640 1 -- 172.21.15.99:0/1861292589 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56008a407240 con 0x56008a414920 2024-02-21T23:05:32.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.641+0000 7fced1400640 1 --2- 172.21.15.99:0/1861292589 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56008a414920 0x56008a3d2910 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fcec0009d90 tx=0x7fcec002e000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5628f1625b5c8cf3 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:05:32.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.641+0000 7fcebd200640 1 -- 172.21.15.99:0/1861292589 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec0039040 con 0x56008a414920 2024-02-21T23:05:32.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.641+0000 7fcebd200640 1 -- 172.21.15.99:0/1861292589 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcec002ca60 con 0x56008a414920 2024-02-21T23:05:32.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.641+0000 7fcebd200640 1 -- 172.21.15.99:0/1861292589 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec004d290 con 0x56008a414920 2024-02-21T23:05:32.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.641+0000 7fced6bf6740 1 -- 172.21.15.99:0/1861292589 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56008a414920 msgr2=0x56008a3d2910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:32.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.641+0000 7fced6bf6740 1 --2- 172.21.15.99:0/1861292589 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56008a414920 0x56008a3d2910 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fcec0009d90 tx=0x7fcec002e000 comp rx=0 tx=0).stop 2024-02-21T23:05:32.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.642+0000 7fced6bf6740 1 -- 172.21.15.99:0/1861292589 shutdown_connections 2024-02-21T23:05:32.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.642+0000 7fced6bf6740 1 --2- 172.21.15.99:0/1861292589 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56008a444db0 0x56008a411450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:32.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.642+0000 7fced6bf6740 1 --2- 172.21.15.99:0/1861292589 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56008a414d00 0x56008a444180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:32.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.642+0000 7fced6bf6740 1 --2- 172.21.15.99:0/1861292589 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56008a414920 0x56008a3d2910 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:32.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.642+0000 7fced6bf6740 1 -- 172.21.15.99:0/1861292589 >> 172.21.15.99:0/1861292589 conn(0x56008a39c6b0 msgr2=0x56008a45e420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:05:32.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.642+0000 7fced6bf6740 1 -- 172.21.15.99:0/1861292589 shutdown_connections 2024-02-21T23:05:32.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.642+0000 7fced6bf6740 1 -- 172.21.15.99:0/1861292589 wait complete. 2024-02-21T23:05:32.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.642+0000 7fced6bf6740 1 -- start start 2024-02-21T23:05:32.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.643+0000 7fced6bf6740 1 Processor -- start 2024-02-21T23:05:32.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.644+0000 7fced6bf6740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56008a414920 0x56008a41f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:32.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.644+0000 7fced6bf6740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56008a414d00 0x56008a40be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:32.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.644+0000 7fced6bf6740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56008a444db0 0x56008a4afef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:32.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.644+0000 7fced6bf6740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcecc0e3150 con 0x56008a444db0 2024-02-21T23:05:32.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.644+0000 7fced6bf6740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcecc0e43d0 con 0x56008a414920 2024-02-21T23:05:32.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.644+0000 7fced6bf6740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcecc0e3750 con 0x56008a414d00 2024-02-21T23:05:32.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.644+0000 7fced6bf6740 10 client.0 _ll_register_callbacks cb 0x7fcec4017040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:05:32.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.644+0000 7fced1400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56008a414920 0x56008a41f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:32.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.644+0000 7fced1400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56008a414920 0x56008a41f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:33186/0 (socket says 172.21.15.99:33186) 2024-02-21T23:05:32.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.644+0000 7fced1400640 1 -- 172.21.15.99:0/4140141136 learned_addr learned my addr 172.21.15.99:0/4140141136 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:05:32.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.644+0000 7fced1e00640 1 --2- 172.21.15.99:0/4140141136 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56008a444db0 0x56008a4afef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:32.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.644+0000 7fced0a00640 1 --2- 172.21.15.99:0/4140141136 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56008a414d00 0x56008a40be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:32.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.645+0000 7fced1400640 1 -- 172.21.15.99:0/4140141136 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56008a414d00 msgr2=0x56008a40be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:05:32.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.645+0000 7fced1400640 1 --2- 172.21.15.99:0/4140141136 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56008a414d00 0x56008a40be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:32.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.645+0000 7fced1400640 1 -- 172.21.15.99:0/4140141136 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56008a444db0 msgr2=0x56008a4afef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:05:32.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.645+0000 7fced1400640 1 --2- 172.21.15.99:0/4140141136 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56008a444db0 0x56008a4afef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:32.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.645+0000 7fced1400640 1 -- 172.21.15.99:0/4140141136 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56008a4b0430 con 0x56008a414920 2024-02-21T23:05:32.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.645+0000 7fced1400640 1 --2- 172.21.15.99:0/4140141136 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56008a414920 0x56008a41f540 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fcec0037040 tx=0x7fcec0004ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66c4bd7ee1d833b9 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:05:32.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.645+0000 7fceb2000640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-02-21T23:05:32.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.645+0000 7fceb2000640 1 -- 172.21.15.99:0/4140141136 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec0039040 con 0x56008a414920 2024-02-21T23:05:32.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.645+0000 7fceb2000640 1 -- 172.21.15.99:0/4140141136 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7fcec0053040 con 0x56008a414920 2024-02-21T23:05:32.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.645+0000 7fced6bf6740 1 -- 172.21.15.99:0/4140141136 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcec002ca60 con 0x56008a414920 2024-02-21T23:05:32.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.646+0000 7fceb2000640 1 -- 172.21.15.99:0/4140141136 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcec004d020 con 0x56008a414920 2024-02-21T23:05:32.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.646+0000 7fced6bf6740 10 client.5845 fetch_fsmap learned FSMap version 16 2024-02-21T23:05:32.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.646+0000 7fced6bf6740 1 -- 172.21.15.99:0/4140141136 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x56008a3d3390 con 0x56008a414920 2024-02-21T23:05:32.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.646+0000 7fceb2000640 1 -- 172.21.15.99:0/4140141136 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcec002ca60 con 0x56008a414920 2024-02-21T23:05:32.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.646+0000 7fceb2000640 1 -- 172.21.15.99:0/4140141136 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fcec004d6f0 con 0x56008a414920 2024-02-21T23:05:32.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.646+0000 7fced6bf6740 10 client.5845 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T23:05:32.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.646+0000 7fced6bf6740 10 client.5845 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:05:32.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.646+0000 7fced6bf6740 20 client.5845 populate_metadata read hostname 'smithi099' 2024-02-21T23:05:32.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.646+0000 7fced6bf6740 1 --2- 172.21.15.99:0/4140141136 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x56008a416e00 0x56008a3f9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:32.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.646+0000 7fced6bf6740 4 client.5845 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T23:05:32.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.646+0000 7fced6bf6740 1 -- 172.21.15.99:0/4140141136 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56008a341320 con 0x56008a416e00 2024-02-21T23:05:32.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.647+0000 7fced0a00640 1 --2- 172.21.15.99:0/4140141136 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x56008a416e00 0x56008a3f9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:32.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.647+0000 7fced0a00640 1 --2- 172.21.15.99:0/4140141136 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x56008a416e00 0x56008a3f9ae0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=28942b5d8d060e73 server_cookie=ee454eead76ed779 in_seq=0 out_seq=0 2024-02-21T23:05:32.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.647+0000 7fceb2000640 10 client.5845 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:05:32.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.647+0000 7fceb2000640 1 -- 172.21.15.99:0/4140141136 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x56008a341320 con 0x56008a416e00 2024-02-21T23:05:32.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.647+0000 7fceb2000640 10 client.5845 handle_command_reply: tid=0 2024-02-21T23:05:32.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.647+0000 7fced6bf6740 1 client.5845 shutdown 2024-02-21T23:05:32.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.648+0000 7fced6bf6740 1 -- 172.21.15.99:0/4140141136 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56008a414920 msgr2=0x56008a41f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:32.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.648+0000 7fced6bf6740 1 --2- 172.21.15.99:0/4140141136 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56008a414920 0x56008a41f540 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fcec0037040 tx=0x7fcec0004ab0 comp rx=0 tx=0).stop 2024-02-21T23:05:32.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.648+0000 7fced6bf6740 1 -- 172.21.15.99:0/4140141136 shutdown_connections 2024-02-21T23:05:32.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.648+0000 7fced6bf6740 1 --2- 172.21.15.99:0/4140141136 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x56008a416e00 0x56008a3f9ae0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:32.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.648+0000 7fced6bf6740 1 --2- 172.21.15.99:0/4140141136 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56008a444db0 0x56008a4afef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:32.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.648+0000 7fced6bf6740 1 --2- 172.21.15.99:0/4140141136 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56008a414d00 0x56008a40be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:32.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.648+0000 7fced6bf6740 1 --2- 172.21.15.99:0/4140141136 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56008a414920 0x56008a41f540 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:32.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.648+0000 7fceb2000640 0 client.5845 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:05:32.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.648+0000 7fced6bf6740 1 -- 172.21.15.99:0/4140141136 >> 172.21.15.99:0/4140141136 conn(0x56008a39c6b0 msgr2=0x56008a4440f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:05:32.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.648+0000 7fced6bf6740 1 -- 172.21.15.99:0/4140141136 shutdown_connections 2024-02-21T23:05:32.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.648+0000 7fced6bf6740 1 -- 172.21.15.99:0/4140141136 wait complete. 2024-02-21T23:05:32.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.648+0000 7fced6bf6740 20 client.5845 trim_cache size 0 max 16384 2024-02-21T23:05:32.646 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-02-21T23:05:32.646 INFO:teuthology.orchestra.run.smithi099.stdout: "status": "no active scrubs running", 2024-02-21T23:05:32.646 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubs": {} 2024-02-21T23:05:32.646 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-02-21T23:05:32.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.649+0000 7fced3e00640 1 -- 172.21.15.99:0/2417043658 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fceac09eed0 msgr2=0x7fceac0a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:32.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.649+0000 7fced3e00640 1 --2- 172.21.15.99:0/2417043658 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fceac09eed0 0x7fceac0a1390 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcec4000f60 tx=0x7fcec4009040 comp rx=0 tx=0).stop 2024-02-21T23:05:32.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.649+0000 7fced3e00640 1 -- 172.21.15.99:0/2417043658 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcecc180c80 msgr2=0x7fcecc21f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:32.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.649+0000 7fced3e00640 1 --2- 172.21.15.99:0/2417043658 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcecc180c80 0x7fcecc21f480 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fceb800c3e0 tx=0x7fceb800c8a0 comp rx=0 tx=0).stop 2024-02-21T23:05:32.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.649+0000 7fced3e00640 1 -- 172.21.15.99:0/2417043658 shutdown_connections 2024-02-21T23:05:32.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.649+0000 7fced3e00640 1 --2- 172.21.15.99:0/2417043658 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fceac09eed0 0x7fceac0a1390 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:32.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.649+0000 7fced3e00640 1 --2- 172.21.15.99:0/2417043658 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcecc188440 0x7fcecc16c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:32.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.649+0000 7fced3e00640 1 --2- 172.21.15.99:0/2417043658 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcecc180c80 0x7fcecc21f480 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:32.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.649+0000 7fced3e00640 1 --2- 172.21.15.99:0/2417043658 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcecc06e910 0x7fcecc16b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:32.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.649+0000 7fced3e00640 1 -- 172.21.15.99:0/2417043658 >> 172.21.15.99:0/2417043658 conn(0x7fcecc0ce5f0 msgr2=0x7fcecc17f7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:05:32.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.649+0000 7fced3e00640 1 -- 172.21.15.99:0/2417043658 shutdown_connections 2024-02-21T23:05:32.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.649+0000 7fced3e00640 1 -- 172.21.15.99:0/2417043658 wait complete. 2024-02-21T23:05:32.662 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-02-21T23:05:32.662 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T23:05:32.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.870+0000 7fd2e5a00640 1 Processor -- start 2024-02-21T23:05:32.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.870+0000 7fd2e5a00640 1 -- start start 2024-02-21T23:05:32.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.872+0000 7fd2e5a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd2e00fde40 0x7fd2e018b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:32.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.872+0000 7fd2e5a00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2e018a600 con 0x7fd2e018a010 2024-02-21T23:05:32.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.872+0000 7fd2e5a00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2e018a8e0 con 0x7fd2e0182a80 2024-02-21T23:05:32.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.872+0000 7fd2e5a00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2e018bec0 con 0x7fd2e00fde40 2024-02-21T23:05:32.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.872+0000 7fd2dfe00640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fd2e0182a80 0x7fd2e0186a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:39988/0 (socket says 172.21.15.99:39988) 2024-02-21T23:05:32.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.872+0000 7fd2dfe00640 1 -- 172.21.15.99:0/2995441236 learned_addr learned my addr 172.21.15.99:0/2995441236 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:05:32.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.872+0000 7fd2e5000640 1 --2- 172.21.15.99:0/2995441236 >> v2:172.21.15.162:3300/0 conn(0x7fd2e00fde40 0x7fd2e018b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:32.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.872+0000 7fd2d7e00640 1 --1- 172.21.15.99:0/2995441236 >> v1:172.21.15.162:6789/0 conn(0x7fd2e018a010 0x7fd2e00719b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.99:54602/0 (socket says 172.21.15.99:54602) 2024-02-21T23:05:32.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.873+0000 7fd2e5000640 1 -- 172.21.15.99:0/2995441236 >> v1:172.21.15.181:6789/0 conn(0x7fd2e0182a80 legacy=0x7fd2e0186a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:32.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.873+0000 7fd2e5000640 1 -- 172.21.15.99:0/2995441236 >> v1:172.21.15.162:6789/0 conn(0x7fd2e018a010 legacy=0x7fd2e00719b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:32.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.873+0000 7fd2df400640 1 -- 172.21.15.99:0/2995441236 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2136576086 0 0) 0x7fd2e018a600 con 0x7fd2e018a010 2024-02-21T23:05:32.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.873+0000 7fd2e5000640 1 -- 172.21.15.99:0/2995441236 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2e018abc0 con 0x7fd2e00fde40 2024-02-21T23:05:32.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.874+0000 7fd2e5000640 1 --2- 172.21.15.99:0/2995441236 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd2e00fde40 0x7fd2e018b980 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd2d8009d90 tx=0x7fd2d802bc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3542cb86137520aa server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:05:32.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.874+0000 7fd2df400640 1 -- 172.21.15.99:0/2995441236 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d8039070 con 0x7fd2e00fde40 2024-02-21T23:05:32.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.874+0000 7fd2df400640 1 -- 172.21.15.99:0/2995441236 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2d802c9c0 con 0x7fd2e00fde40 2024-02-21T23:05:32.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.874+0000 7fd2df400640 1 -- 172.21.15.99:0/2995441236 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d802cd90 con 0x7fd2e00fde40 2024-02-21T23:05:32.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.875+0000 7fd2e5a00640 1 -- 172.21.15.99:0/2995441236 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd2e00fde40 msgr2=0x7fd2e018b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:32.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.875+0000 7fd2e5a00640 1 --2- 172.21.15.99:0/2995441236 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd2e00fde40 0x7fd2e018b980 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd2d8009d90 tx=0x7fd2d802bc90 comp rx=0 tx=0).stop 2024-02-21T23:05:32.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.875+0000 7fd2e5a00640 1 -- 172.21.15.99:0/2995441236 shutdown_connections 2024-02-21T23:05:32.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.875+0000 7fd2e5a00640 1 --2- 172.21.15.99:0/2995441236 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd2e00fde40 0x7fd2e018b980 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:32.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.875+0000 7fd2e5a00640 1 -- 172.21.15.99:0/2995441236 >> 172.21.15.99:0/2995441236 conn(0x7fd2e00d29f0 msgr2=0x7fd2e00d2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:05:32.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.875+0000 7fd2e5a00640 1 -- 172.21.15.99:0/2995441236 shutdown_connections 2024-02-21T23:05:32.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.875+0000 7fd2e5a00640 1 -- 172.21.15.99:0/2995441236 wait complete. 2024-02-21T23:05:32.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.879+0000 7fd2e5a00640 1 Processor -- start 2024-02-21T23:05:32.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.879+0000 7fd2e5a00640 1 -- start start 2024-02-21T23:05:32.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.881+0000 7fd2e5a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd2e00fde40 0x7fd2e0175990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:32.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.881+0000 7fd2e5a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd2e0182a80 0x7fd2e00f3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:32.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.881+0000 7fd2e5a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd2e018a010 0x7fd2e00f4110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:32.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.881+0000 7fd2e5a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e018b460 con 0x7fd2e00fde40 2024-02-21T23:05:32.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.881+0000 7fd2e5a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e018b180 con 0x7fd2e0182a80 2024-02-21T23:05:32.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.881+0000 7fd2e5a00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e0182e60 con 0x7fd2e018a010 2024-02-21T23:05:32.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.881+0000 7fd2dfe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd2e00fde40 0x7fd2e0175990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:32.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.881+0000 7fd2d7e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd2e0182a80 0x7fd2e00f3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:32.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.881+0000 7fd2dfe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd2e00fde40 0x7fd2e0175990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54182/0 (socket says 172.21.15.99:54182) 2024-02-21T23:05:32.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.881+0000 7fd2dfe00640 1 -- 172.21.15.99:0/4149818923 learned_addr learned my addr 172.21.15.99:0/4149818923 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:05:32.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.881+0000 7fd2e5000640 1 --2- 172.21.15.99:0/4149818923 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd2e018a010 0x7fd2e00f4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:32.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.882+0000 7fd2dfe00640 1 -- 172.21.15.99:0/4149818923 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd2e018a010 msgr2=0x7fd2e00f4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:32.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.882+0000 7fd2dfe00640 1 --2- 172.21.15.99:0/4149818923 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd2e018a010 0x7fd2e00f4110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:32.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.882+0000 7fd2dfe00640 1 -- 172.21.15.99:0/4149818923 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd2e0182a80 msgr2=0x7fd2e00f3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:32.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.882+0000 7fd2dfe00640 1 --2- 172.21.15.99:0/4149818923 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd2e0182a80 0x7fd2e00f3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:32.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.882+0000 7fd2dfe00640 1 -- 172.21.15.99:0/4149818923 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2e021ede0 con 0x7fd2e00fde40 2024-02-21T23:05:32.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.882+0000 7fd2d7e00640 1 --2- 172.21.15.99:0/4149818923 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd2e0182a80 0x7fd2e00f3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:05:32.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.882+0000 7fd2dfe00640 1 --2- 172.21.15.99:0/4149818923 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd2e00fde40 0x7fd2e0175990 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fd2d000c750 tx=0x7fd2d000cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:05:32.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.883+0000 7fd2dcc00640 1 -- 172.21.15.99:0/4149818923 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d0018070 con 0x7fd2e00fde40 2024-02-21T23:05:32.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.883+0000 7fd2dcc00640 1 -- 172.21.15.99:0/4149818923 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2d00072d0 con 0x7fd2e00fde40 2024-02-21T23:05:32.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.883+0000 7fd2dcc00640 1 -- 172.21.15.99:0/4149818923 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d00047e0 con 0x7fd2e00fde40 2024-02-21T23:05:32.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.883+0000 7fd2e5a00640 1 -- 172.21.15.99:0/4149818923 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2e021f0c0 con 0x7fd2e00fde40 2024-02-21T23:05:32.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.883+0000 7fd2e5a00640 1 -- 172.21.15.99:0/4149818923 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2e021f680 con 0x7fd2e00fde40 2024-02-21T23:05:32.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.884+0000 7fd2e5a00640 1 -- 172.21.15.99:0/4149818923 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2e0068320 con 0x7fd2e00fde40 2024-02-21T23:05:32.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.886+0000 7fd2dcc00640 1 -- 172.21.15.99:0/4149818923 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7fd2d001b070 con 0x7fd2e00fde40 2024-02-21T23:05:32.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.887+0000 7fd2dcc00640 1 --2- 172.21.15.99:0/4149818923 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fd2bc09ef00 0x7fd2bc0a13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:32.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.888+0000 7fd2dcc00640 1 -- 172.21.15.99:0/4149818923 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7fd2d00c95a0 con 0x7fd2e00fde40 2024-02-21T23:05:32.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.888+0000 7fd2d7e00640 1 --2- 172.21.15.99:0/4149818923 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fd2bc09ef00 0x7fd2bc0a13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:32.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.889+0000 7fd2d7e00640 1 --2- 172.21.15.99:0/4149818923 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fd2bc09ef00 0x7fd2bc0a13c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd2c8001160 tx=0x7fd2c80010f0 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:05:32.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:32.893+0000 7fd2dcc00640 1 -- 172.21.15.99:0/4149818923 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fd2d0096ef0 con 0x7fd2e00fde40 2024-02-21T23:05:33.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.201+0000 7fd2e5a00640 1 -- 172.21.15.99:0/4149818923 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd2e00fcc10 con 0x7fd2e00fde40 2024-02-21T23:05:33.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.202+0000 7fd2dcc00640 1 -- 172.21.15.99:0/4149818923 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+11336 (secure 0 0 0) 0x7fd2d009af90 con 0x7fd2e00fde40 2024-02-21T23:05:33.191 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T23:05:33.191 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4307,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/3514452812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3514452812},{"type":"v1","addr":"172.21.15.162:6836","nonce":3514452812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4312,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6838/2169982089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":2169982089},{"type":"v1","addr":"172.21.15.162:6838","nonce":2169982089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4315,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6839/3335972724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6837","nonce":3335972724},{"type":"v1","addr":"172.21.15.162:6839","nonce":3335972724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4318,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6841/2135456697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6840","nonce":2135456697},{"type":"v1","addr":"172.21.15.162:6841","nonce":2135456697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4325,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2452242758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2452242758},{"type":"v1","addr":"172.21.15.181:6833","nonce":2452242758}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4328,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6836/2751486400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":2751486400},{"type":"v1","addr":"172.21.15.181:6836","nonce":2751486400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":16,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-21T23:01:02.656130+0000","modified":"2024-02-21T23:03:58.159765+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4355,"mds_1":4352,"mds_2":4348},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4331":{"gid":4331,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6838/3728901330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6835","nonce":3728901330},{"type":"v1","addr":"172.21.15.181:6838","nonce":3728901330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4339":{"gid":4339,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6839/3357929641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6837","nonce":3357929641},{"type":"v1","addr":"172.21.15.181:6839","nonce":3357929641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4343":{"gid":4343,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6833/2793485078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":2793485078},{"type":"v1","addr":"172.21.15.99:6833","nonce":2793485078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4348":{"gid":4348,"name":"d","rank":2,"incarnation":12,"state":"up:active","state_seq":10,"addr":"172.21.15.99:6835/2243461688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2243461688},{"type":"v1","addr":"172.21.15.99:6835","nonce":2243461688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4352":{"gid":4352,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.99:6837/1676159950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":1676159950},{"type":"v1","addr":"172.21.15.99:6837","nonce":1676159950}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4355":{"gid":4355,"name":"j","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6839/4239008786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":4239008786},{"type":"v1","addr":"172.21.15.99:6839","nonce":4239008786}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-21T23:05:33.192 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 16 2024-02-21T23:05:33.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.205+0000 7fd2e5a00640 1 -- 172.21.15.99:0/4149818923 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fd2bc09ef00 msgr2=0x7fd2bc0a13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:33.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.205+0000 7fd2e5a00640 1 --2- 172.21.15.99:0/4149818923 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fd2bc09ef00 0x7fd2bc0a13c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd2c8001160 tx=0x7fd2c80010f0 comp rx=0 tx=0).stop 2024-02-21T23:05:33.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.205+0000 7fd2e5a00640 1 -- 172.21.15.99:0/4149818923 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd2e00fde40 msgr2=0x7fd2e0175990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:33.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.205+0000 7fd2e5a00640 1 --2- 172.21.15.99:0/4149818923 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd2e00fde40 0x7fd2e0175990 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fd2d000c750 tx=0x7fd2d000cc10 comp rx=0 tx=0).stop 2024-02-21T23:05:33.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.205+0000 7fd2e5a00640 1 -- 172.21.15.99:0/4149818923 shutdown_connections 2024-02-21T23:05:33.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.205+0000 7fd2e5a00640 1 --2- 172.21.15.99:0/4149818923 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fd2bc09ef00 0x7fd2bc0a13c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:33.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.205+0000 7fd2e5a00640 1 --2- 172.21.15.99:0/4149818923 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd2e018a010 0x7fd2e00f4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:33.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.205+0000 7fd2e5a00640 1 --2- 172.21.15.99:0/4149818923 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd2e0182a80 0x7fd2e00f3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:33.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.205+0000 7fd2e5a00640 1 --2- 172.21.15.99:0/4149818923 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd2e00fde40 0x7fd2e0175990 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:33.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.205+0000 7fd2e5a00640 1 -- 172.21.15.99:0/4149818923 >> 172.21.15.99:0/4149818923 conn(0x7fd2e00d29f0 msgr2=0x7fd2e017ffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:05:33.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.205+0000 7fd2e5a00640 1 -- 172.21.15.99:0/4149818923 shutdown_connections 2024-02-21T23:05:33.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.205+0000 7fd2e5a00640 1 -- 172.21.15.99:0/4149818923 wait complete. 2024-02-21T23:05:33.218 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T23:05:33.218 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-02-21T23:05:33.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.438+0000 7f9468e00640 1 Processor -- start 2024-02-21T23:05:33.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.438+0000 7f9468e00640 1 -- start start 2024-02-21T23:05:33.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.440+0000 7f9468e00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f9464189560 0x7f94640f8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:33.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.440+0000 7f9468e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9464189b70 con 0x7f94640f8940 2024-02-21T23:05:33.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.440+0000 7f9468e00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9464186fa0 con 0x7f94640f8020 2024-02-21T23:05:33.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.440+0000 7f9468e00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9464186d50 con 0x7f9464189560 2024-02-21T23:05:33.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.440+0000 7f9461400640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f9464189560 0x7f94640f8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:33.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.440+0000 7f9461e00640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f94640f8020 0x7f9464188e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:40004/0 (socket says 172.21.15.99:40004) 2024-02-21T23:05:33.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.440+0000 7f9461e00640 1 -- 172.21.15.99:0/3970380054 learned_addr learned my addr 172.21.15.99:0/3970380054 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:05:33.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.441+0000 7f9460a00640 1 -- 172.21.15.99:0/3970380054 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3803562534 0 0) 0x7f9464186fa0 con 0x7f94640f8020 2024-02-21T23:05:33.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.441+0000 7f9460a00640 1 -- 172.21.15.99:0/3970380054 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9448005730 con 0x7f94640f8020 2024-02-21T23:05:33.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.441+0000 7f9460a00640 1 -- 172.21.15.99:0/3970380054 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2197620875 0 0) 0x7f9464189b70 con 0x7f94640f8940 2024-02-21T23:05:33.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.441+0000 7f9461400640 1 -- 172.21.15.99:0/3970380054 >> v1:172.21.15.181:6789/0 conn(0x7f94640f8020 legacy=0x7f9464188e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:33.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.441+0000 7f9461400640 1 -- 172.21.15.99:0/3970380054 >> v1:172.21.15.162:6789/0 conn(0x7f94640f8940 legacy=0x7f9464187d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:33.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.441+0000 7f9461400640 1 -- 172.21.15.99:0/3970380054 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9464187280 con 0x7f9464189560 2024-02-21T23:05:33.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.442+0000 7f9461400640 1 --2- 172.21.15.99:0/3970380054 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9464189560 0x7f94640f8400 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f94500097a0 tx=0x7f945002b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=123532ae7c50c9a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:05:33.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.442+0000 7f9460a00640 1 -- 172.21.15.99:0/3970380054 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9450035020 con 0x7f9464189560 2024-02-21T23:05:33.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.442+0000 7f9460a00640 1 -- 172.21.15.99:0/3970380054 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9450031830 con 0x7f9464189560 2024-02-21T23:05:33.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.442+0000 7f9460a00640 1 -- 172.21.15.99:0/3970380054 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9450031c00 con 0x7f9464189560 2024-02-21T23:05:33.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.443+0000 7f9468e00640 1 -- 172.21.15.99:0/3970380054 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9464189560 msgr2=0x7f94640f8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:33.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.443+0000 7f9468e00640 1 --2- 172.21.15.99:0/3970380054 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9464189560 0x7f94640f8400 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f94500097a0 tx=0x7f945002b8d0 comp rx=0 tx=0).stop 2024-02-21T23:05:33.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.443+0000 7f9468e00640 1 -- 172.21.15.99:0/3970380054 shutdown_connections 2024-02-21T23:05:33.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.443+0000 7f9468e00640 1 --2- 172.21.15.99:0/3970380054 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9464189560 0x7f94640f8400 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:33.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.443+0000 7f9468e00640 1 -- 172.21.15.99:0/3970380054 >> 172.21.15.99:0/3970380054 conn(0x7f94640ce5f0 msgr2=0x7f94640cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:05:33.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.443+0000 7f9468e00640 1 -- 172.21.15.99:0/3970380054 shutdown_connections 2024-02-21T23:05:33.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.443+0000 7f9468e00640 1 -- 172.21.15.99:0/3970380054 wait complete. 2024-02-21T23:05:33.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.445+0000 7f9468e00640 1 Processor -- start 2024-02-21T23:05:33.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.445+0000 7f9468e00640 1 -- start start 2024-02-21T23:05:33.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.447+0000 7f9468e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f94640f8020 0x7f9464071dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:33.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.447+0000 7f9468e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f94640f8940 0x7f946421f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:33.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.447+0000 7f9468e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9464189560 0x7f946421f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:33.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.447+0000 7f9468e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94640f9f60 con 0x7f94640f8940 2024-02-21T23:05:33.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.447+0000 7f9468e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94641878d0 con 0x7f9464189560 2024-02-21T23:05:33.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.447+0000 7f9468e00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f946417c660 con 0x7f94640f8020 2024-02-21T23:05:33.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.447+0000 7f9461400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f94640f8940 0x7f946421f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:33.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.447+0000 7f9461400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f94640f8940 0x7f946421f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54186/0 (socket says 172.21.15.99:54186) 2024-02-21T23:05:33.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.447+0000 7f9461400640 1 -- 172.21.15.99:0/1299922518 learned_addr learned my addr 172.21.15.99:0/1299922518 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:05:33.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.447+0000 7f9461e00640 1 --2- 172.21.15.99:0/1299922518 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f94640f8020 0x7f9464071dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:33.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.447+0000 7f9462800640 1 --2- 172.21.15.99:0/1299922518 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9464189560 0x7f946421f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:33.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.448+0000 7f9461e00640 1 -- 172.21.15.99:0/1299922518 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9464189560 msgr2=0x7f946421f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:33.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.448+0000 7f9461e00640 1 --2- 172.21.15.99:0/1299922518 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9464189560 0x7f946421f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:33.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.448+0000 7f9461e00640 1 -- 172.21.15.99:0/1299922518 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f94640f8940 msgr2=0x7f946421f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:33.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.448+0000 7f9461e00640 1 --2- 172.21.15.99:0/1299922518 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f94640f8940 0x7f946421f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:33.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.448+0000 7f9461e00640 1 -- 172.21.15.99:0/1299922518 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94640c9cd0 con 0x7f94640f8020 2024-02-21T23:05:33.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.448+0000 7f9461400640 1 --2- 172.21.15.99:0/1299922518 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f94640f8940 0x7f946421f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:05:33.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.448+0000 7f9461e00640 1 --2- 172.21.15.99:0/1299922518 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f94640f8020 0x7f9464071dd0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f945400c3c0 tx=0x7f9454001e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:05:33.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.448+0000 7f945a000640 1 -- 172.21.15.99:0/1299922518 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9454017070 con 0x7f94640f8020 2024-02-21T23:05:33.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.448+0000 7f945a000640 1 -- 172.21.15.99:0/1299922518 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9454005ce0 con 0x7f94640f8020 2024-02-21T23:05:33.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.448+0000 7f9468e00640 1 -- 172.21.15.99:0/1299922518 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94640c9fb0 con 0x7f94640f8020 2024-02-21T23:05:33.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.448+0000 7f945a000640 1 -- 172.21.15.99:0/1299922518 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94540072d0 con 0x7f94640f8020 2024-02-21T23:05:33.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.449+0000 7f9468e00640 1 -- 172.21.15.99:0/1299922518 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94640ca570 con 0x7f94640f8020 2024-02-21T23:05:33.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.452+0000 7f945a000640 1 -- 172.21.15.99:0/1299922518 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f945401a070 con 0x7f94640f8020 2024-02-21T23:05:33.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.453+0000 7f945a000640 1 --2- 172.21.15.99:0/1299922518 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f944409ee50 0x7f94440a1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:33.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.454+0000 7f945a000640 1 -- 172.21.15.99:0/1299922518 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f94540c92a0 con 0x7f94640f8020 2024-02-21T23:05:33.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.454+0000 7f9461400640 1 --2- 172.21.15.99:0/1299922518 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f944409ee50 0x7f94440a1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:33.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.455+0000 7f9461400640 1 --2- 172.21.15.99:0/1299922518 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f944409ee50 0x7f94440a1310 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f94640f7e70 tx=0x7f9450008030 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:05:33.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.455+0000 7f946bdb6740 1 Processor -- start 2024-02-21T23:05:33.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.455+0000 7f946bdb6740 1 -- start start 2024-02-21T23:05:33.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.457+0000 7f946bdb6740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f27aa844b0 0x55f27aa84890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:33.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.457+0000 7f946bdb6740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f27aabf180 0x55f27aabf600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:33.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.457+0000 7f946bdb6740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f27aabfb40 0x55f27aac03b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:33.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.457+0000 7f946bdb6740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f27a9acb50 con 0x55f27aabfb40 2024-02-21T23:05:33.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.457+0000 7f946bdb6740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f27a955da0 con 0x55f27aa844b0 2024-02-21T23:05:33.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.457+0000 7f946bdb6740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f27a9a8bf0 con 0x55f27aabf180 2024-02-21T23:05:33.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.457+0000 7f9461e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f27aa844b0 0x55f27aa84890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:33.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.457+0000 7f9462800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f27aabfb40 0x55f27aac03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:33.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.457+0000 7f9461e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f27aa844b0 0x55f27aa84890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:33228/0 (socket says 172.21.15.99:33228) 2024-02-21T23:05:33.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.457+0000 7f9461e00640 1 -- 172.21.15.99:0/1900595047 learned_addr learned my addr 172.21.15.99:0/1900595047 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:05:33.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.458+0000 7f9461400640 1 --2- 172.21.15.99:0/1900595047 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f27aabf180 0x55f27aabf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:33.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.458+0000 7f9461e00640 1 -- 172.21.15.99:0/1900595047 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f27aabf180 msgr2=0x55f27aabf600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:05:33.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.458+0000 7f9461e00640 1 --2- 172.21.15.99:0/1900595047 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f27aabf180 0x55f27aabf600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:33.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.458+0000 7f9461e00640 1 -- 172.21.15.99:0/1900595047 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f27aabfb40 msgr2=0x55f27aac03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:05:33.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.458+0000 7f9461e00640 1 --2- 172.21.15.99:0/1900595047 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f27aabfb40 0x55f27aac03b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:33.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.458+0000 7f9461e00640 1 -- 172.21.15.99:0/1900595047 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f27a978f80 con 0x55f27aa844b0 2024-02-21T23:05:33.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.458+0000 7f9461400640 1 --2- 172.21.15.99:0/1900595047 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f27aabf180 0x55f27aabf600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:05:33.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.458+0000 7f9461e00640 1 --2- 172.21.15.99:0/1900595047 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f27aa844b0 0x55f27aa84890 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f9454096b80 tx=0x7f9454094df0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e52c8c1d8a97563d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:05:33.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.458+0000 7f944ea00640 1 -- 172.21.15.99:0/1900595047 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f945409f2e0 con 0x55f27aa844b0 2024-02-21T23:05:33.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.458+0000 7f944ea00640 1 -- 172.21.15.99:0/1900595047 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94540c6b00 con 0x55f27aa844b0 2024-02-21T23:05:33.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.458+0000 7f944ea00640 1 -- 172.21.15.99:0/1900595047 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94540aadb0 con 0x55f27aa844b0 2024-02-21T23:05:33.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.459+0000 7f946bdb6740 1 -- 172.21.15.99:0/1900595047 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f27aa844b0 msgr2=0x55f27aa84890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:33.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.459+0000 7f946bdb6740 1 --2- 172.21.15.99:0/1900595047 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f27aa844b0 0x55f27aa84890 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f9454096b80 tx=0x7f9454094df0 comp rx=0 tx=0).stop 2024-02-21T23:05:33.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.459+0000 7f946bdb6740 1 -- 172.21.15.99:0/1900595047 shutdown_connections 2024-02-21T23:05:33.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.459+0000 7f946bdb6740 1 --2- 172.21.15.99:0/1900595047 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f27aabfb40 0x55f27aac03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:33.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.459+0000 7f946bdb6740 1 --2- 172.21.15.99:0/1900595047 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f27aabf180 0x55f27aabf600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:33.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.459+0000 7f946bdb6740 1 --2- 172.21.15.99:0/1900595047 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f27aa844b0 0x55f27aa84890 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:33.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.459+0000 7f946bdb6740 1 -- 172.21.15.99:0/1900595047 >> 172.21.15.99:0/1900595047 conn(0x55f27aa46520 msgr2=0x55f27aa475a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:05:33.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.460+0000 7f946bdb6740 1 -- 172.21.15.99:0/1900595047 shutdown_connections 2024-02-21T23:05:33.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.460+0000 7f946bdb6740 1 -- 172.21.15.99:0/1900595047 wait complete. 2024-02-21T23:05:33.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.461+0000 7f946bdb6740 1 -- start start 2024-02-21T23:05:33.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.461+0000 7f946bdb6740 1 Processor -- start 2024-02-21T23:05:33.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.463+0000 7f946bdb6740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f27aabf180 0x55f27aa89360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:33.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.463+0000 7f946bdb6740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f27aabfb40 0x55f27aacb530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:33.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.463+0000 7f946bdb6740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f27aabe720 0x55f27aa886c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:33.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.463+0000 7f946bdb6740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f27aabdef0 con 0x55f27aabe720 2024-02-21T23:05:33.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.463+0000 7f946bdb6740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f27a94b380 con 0x55f27aabf180 2024-02-21T23:05:33.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.463+0000 7f946bdb6740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f27aabdc10 con 0x55f27aabfb40 2024-02-21T23:05:33.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.464+0000 7f946bdb6740 10 client.0 _ll_register_callbacks cb 0x55f27a9a4280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:05:33.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.464+0000 7f9461400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f27aabfb40 0x55f27aacb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:33.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.464+0000 7f9461e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f27aabf180 0x55f27aa89360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:33.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.464+0000 7f9461400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f27aabfb40 0x55f27aacb530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:34576/0 (socket says 172.21.15.99:34576) 2024-02-21T23:05:33.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.464+0000 7f9461400640 1 -- 172.21.15.99:0/2795528816 learned_addr learned my addr 172.21.15.99:0/2795528816 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:05:33.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.464+0000 7f9462800640 1 --2- 172.21.15.99:0/2795528816 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f27aabe720 0x55f27aa886c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:33.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.464+0000 7f9461e00640 1 -- 172.21.15.99:0/2795528816 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f27aabfb40 msgr2=0x55f27aacb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:05:33.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.464+0000 7f9461e00640 1 --2- 172.21.15.99:0/2795528816 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f27aabfb40 0x55f27aacb530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:33.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.464+0000 7f9461e00640 1 -- 172.21.15.99:0/2795528816 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f27aabe720 msgr2=0x55f27aa886c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:05:33.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.464+0000 7f9461e00640 1 --2- 172.21.15.99:0/2795528816 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f27aabe720 0x55f27aa886c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:33.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.464+0000 7f9461e00640 1 -- 172.21.15.99:0/2795528816 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f27a973c20 con 0x55f27aabf180 2024-02-21T23:05:33.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.464+0000 7f9462800640 1 --2- 172.21.15.99:0/2795528816 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f27aabe720 0x55f27aa886c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:05:33.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.465+0000 7f9461e00640 1 --2- 172.21.15.99:0/2795528816 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f27aabf180 0x55f27aa89360 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f945400cd10 tx=0x7f9454001150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=49234dca35042c02 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:05:33.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.465+0000 7f9443400640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-02-21T23:05:33.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.465+0000 7f9443400640 1 -- 172.21.15.99:0/2795528816 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94540b2070 con 0x55f27aabf180 2024-02-21T23:05:33.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.465+0000 7f946bdb6740 1 -- 172.21.15.99:0/2795528816 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f94540c6b00 con 0x55f27aabf180 2024-02-21T23:05:33.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.465+0000 7f9443400640 1 -- 172.21.15.99:0/2795528816 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f94540aada0 con 0x55f27aabf180 2024-02-21T23:05:33.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.465+0000 7f9443400640 1 -- 172.21.15.99:0/2795528816 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f945409f2e0 con 0x55f27aabf180 2024-02-21T23:05:33.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.465+0000 7f946bdb6740 10 client.5866 fetch_fsmap learned FSMap version 16 2024-02-21T23:05:33.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.465+0000 7f946bdb6740 1 -- 172.21.15.99:0/2795528816 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55f27a6c13f0 con 0x55f27aabf180 2024-02-21T23:05:33.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.465+0000 7f9443400640 1 -- 172.21.15.99:0/2795528816 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94540c6b00 con 0x55f27aabf180 2024-02-21T23:05:33.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.466+0000 7f9443400640 1 -- 172.21.15.99:0/2795528816 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f9454096040 con 0x55f27aabf180 2024-02-21T23:05:33.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.466+0000 7f946bdb6740 10 client.5866 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T23:05:33.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.466+0000 7f946bdb6740 10 client.5866 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.d 2024-02-21T23:05:33.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.466+0000 7f946bdb6740 20 client.5866 populate_metadata read hostname 'smithi099' 2024-02-21T23:05:33.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.466+0000 7f946bdb6740 1 --2- 172.21.15.99:0/2795528816 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x55f27aabeb00 0x55f27aacc320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:33.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.466+0000 7f946bdb6740 4 client.5866 mds_command: new command op to 4348 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:05:33.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.466+0000 7f946bdb6740 1 -- 172.21.15.99:0/2795528816 --> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f27a9ba090 con 0x55f27aabeb00 2024-02-21T23:05:33.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.466+0000 7f9461400640 1 --2- 172.21.15.99:0/2795528816 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x55f27aabeb00 0x55f27aacc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:33.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.467+0000 7f9443400640 10 client.5866 ms_handle_connect on v2:172.21.15.99:6834/2243461688 2024-02-21T23:05:33.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.467+0000 7f9461400640 1 --2- 172.21.15.99:0/2795528816 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x55f27aabeb00 0x55f27aacc320 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c77ca2c571557ab4 server_cookie=f8269c69fd374551 in_seq=0 out_seq=0 2024-02-21T23:05:33.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.468+0000 7f9443400640 1 -- 172.21.15.99:0/2795528816 <== mds.2 v2:172.21.15.99:6834/2243461688 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55f27a9ba090 con 0x55f27aabeb00 2024-02-21T23:05:33.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.468+0000 7f9443400640 10 client.5866 handle_command_reply: tid=0 2024-02-21T23:05:33.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.468+0000 7f946bdb6740 1 client.5866 shutdown 2024-02-21T23:05:33.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.468+0000 7f946bdb6740 1 -- 172.21.15.99:0/2795528816 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f27aabf180 msgr2=0x55f27aa89360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:33.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.468+0000 7f946bdb6740 1 --2- 172.21.15.99:0/2795528816 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f27aabf180 0x55f27aa89360 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f945400cd10 tx=0x7f9454001150 comp rx=0 tx=0).stop 2024-02-21T23:05:33.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.468+0000 7f946bdb6740 1 -- 172.21.15.99:0/2795528816 shutdown_connections 2024-02-21T23:05:33.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.468+0000 7f946bdb6740 1 --2- 172.21.15.99:0/2795528816 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x55f27aabeb00 0x55f27aacc320 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:33.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.468+0000 7f946bdb6740 1 --2- 172.21.15.99:0/2795528816 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f27aabe720 0x55f27aa886c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:33.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.468+0000 7f946bdb6740 1 --2- 172.21.15.99:0/2795528816 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f27aabfb40 0x55f27aacb530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:33.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.468+0000 7f946bdb6740 1 --2- 172.21.15.99:0/2795528816 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f27aabf180 0x55f27aa89360 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:33.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.468+0000 7f9443400640 0 client.5866 ms_handle_reset on v2:172.21.15.99:6834/2243461688 2024-02-21T23:05:33.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.468+0000 7f946bdb6740 1 -- 172.21.15.99:0/2795528816 >> 172.21.15.99:0/2795528816 conn(0x55f27aa844b0 msgr2=0x55f27aabd3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:05:33.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.469+0000 7f946bdb6740 1 -- 172.21.15.99:0/2795528816 shutdown_connections 2024-02-21T23:05:33.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.469+0000 7f946bdb6740 1 -- 172.21.15.99:0/2795528816 wait complete. 2024-02-21T23:05:33.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.469+0000 7f946bdb6740 20 client.5866 trim_cache size 0 max 16384 2024-02-21T23:05:33.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.491+0000 7f946bdb6740 1 Processor -- start 2024-02-21T23:05:33.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.491+0000 7f946bdb6740 1 -- start start 2024-02-21T23:05:33.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.493+0000 7f946bdb6740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f27aabe720 0x55f27aacb510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:33.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.493+0000 7f946bdb6740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f27aabf180 0x55f27aa42330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:33.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.493+0000 7f946bdb6740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f27aabfb40 0x55f27aa75ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:33.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.493+0000 7f946bdb6740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f946422c7b0 con 0x55f27aabfb40 2024-02-21T23:05:33.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.493+0000 7f946bdb6740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f946422a350 con 0x55f27aabe720 2024-02-21T23:05:33.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.493+0000 7f946bdb6740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9464228560 con 0x55f27aabf180 2024-02-21T23:05:33.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.493+0000 7f9461400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f27aabf180 0x55f27aa42330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:33.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.493+0000 7f9462800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f27aabfb40 0x55f27aa75ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:33.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.493+0000 7f9461400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f27aabf180 0x55f27aa42330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:34582/0 (socket says 172.21.15.99:34582) 2024-02-21T23:05:33.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.493+0000 7f9461400640 1 -- 172.21.15.99:0/1448128071 learned_addr learned my addr 172.21.15.99:0/1448128071 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:05:33.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.493+0000 7f9461e00640 1 --2- 172.21.15.99:0/1448128071 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f27aabe720 0x55f27aacb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:33.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.493+0000 7f9461400640 1 -- 172.21.15.99:0/1448128071 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f27aabe720 msgr2=0x55f27aacb510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:05:33.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.493+0000 7f9461400640 1 --2- 172.21.15.99:0/1448128071 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f27aabe720 0x55f27aacb510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:33.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.494+0000 7f9461400640 1 -- 172.21.15.99:0/1448128071 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f27aabfb40 msgr2=0x55f27aa75ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:05:33.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.494+0000 7f9461400640 1 --2- 172.21.15.99:0/1448128071 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f27aabfb40 0x55f27aa75ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:33.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.494+0000 7f9461400640 1 -- 172.21.15.99:0/1448128071 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f27a78b7d0 con 0x55f27aabf180 2024-02-21T23:05:33.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.494+0000 7f9461e00640 1 --2- 172.21.15.99:0/1448128071 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f27aabe720 0x55f27aacb510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:05:33.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.494+0000 7f9461400640 1 --2- 172.21.15.99:0/1448128071 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f27aabf180 0x55f27aa42330 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f9450000c00 tx=0x7f9450030000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e6c919f59e71777 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:05:33.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.494+0000 7f944e000640 1 -- 172.21.15.99:0/1448128071 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f945005d070 con 0x55f27aabf180 2024-02-21T23:05:33.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.494+0000 7f944e000640 1 -- 172.21.15.99:0/1448128071 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9450057160 con 0x55f27aabf180 2024-02-21T23:05:33.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.494+0000 7f944e000640 1 -- 172.21.15.99:0/1448128071 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9450035040 con 0x55f27aabf180 2024-02-21T23:05:33.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.495+0000 7f946bdb6740 1 -- 172.21.15.99:0/1448128071 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f27aabf180 msgr2=0x55f27aa42330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:33.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.495+0000 7f946bdb6740 1 --2- 172.21.15.99:0/1448128071 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f27aabf180 0x55f27aa42330 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f9450000c00 tx=0x7f9450030000 comp rx=0 tx=0).stop 2024-02-21T23:05:33.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.495+0000 7f946bdb6740 1 -- 172.21.15.99:0/1448128071 shutdown_connections 2024-02-21T23:05:33.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.495+0000 7f946bdb6740 1 --2- 172.21.15.99:0/1448128071 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f27aabfb40 0x55f27aa75ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:33.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.495+0000 7f946bdb6740 1 --2- 172.21.15.99:0/1448128071 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f27aabf180 0x55f27aa42330 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:33.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.495+0000 7f946bdb6740 1 --2- 172.21.15.99:0/1448128071 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f27aabe720 0x55f27aacb510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:33.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.495+0000 7f946bdb6740 1 -- 172.21.15.99:0/1448128071 >> 172.21.15.99:0/1448128071 conn(0x55f27aa844b0 msgr2=0x55f27aa8fe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:05:33.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.495+0000 7f946bdb6740 1 -- 172.21.15.99:0/1448128071 shutdown_connections 2024-02-21T23:05:33.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.495+0000 7f946bdb6740 1 -- 172.21.15.99:0/1448128071 wait complete. 2024-02-21T23:05:33.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.496+0000 7f946bdb6740 1 -- start start 2024-02-21T23:05:33.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.496+0000 7f946bdb6740 1 Processor -- start 2024-02-21T23:05:33.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.497+0000 7f946bdb6740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f27aabe720 0x55f27aad0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:33.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.497+0000 7f946bdb6740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f27aabf180 0x55f27aacb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:33.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.497+0000 7f946bdb6740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f27aabfb40 0x55f27aa925d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:33.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.497+0000 7f946bdb6740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9464228a90 con 0x55f27aabf180 2024-02-21T23:05:33.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.497+0000 7f946bdb6740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9464229cf0 con 0x55f27aabe720 2024-02-21T23:05:33.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.497+0000 7f946bdb6740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9464229090 con 0x55f27aabfb40 2024-02-21T23:05:33.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.497+0000 7f946bdb6740 10 client.0 _ll_register_callbacks cb 0x7f945c0018e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:05:33.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.497+0000 7f9461400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f27aabf180 0x55f27aacb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:33.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.498+0000 7f9461400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f27aabf180 0x55f27aacb4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54230/0 (socket says 172.21.15.99:54230) 2024-02-21T23:05:33.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.498+0000 7f9461400640 1 -- 172.21.15.99:0/335901474 learned_addr learned my addr 172.21.15.99:0/335901474 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:05:33.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.498+0000 7f9462800640 1 --2- 172.21.15.99:0/335901474 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f27aabfb40 0x55f27aa925d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:33.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.498+0000 7f9461e00640 1 --2- 172.21.15.99:0/335901474 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f27aabe720 0x55f27aad0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:33.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.498+0000 7f9461400640 1 -- 172.21.15.99:0/335901474 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f27aabfb40 msgr2=0x55f27aa925d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:05:33.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.498+0000 7f9461400640 1 --2- 172.21.15.99:0/335901474 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f27aabfb40 0x55f27aa925d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:33.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.498+0000 7f9461400640 1 -- 172.21.15.99:0/335901474 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f27aabe720 msgr2=0x55f27aad0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:05:33.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.498+0000 7f9461400640 1 --2- 172.21.15.99:0/335901474 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f27aabe720 0x55f27aad0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:33.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.498+0000 7f9461400640 1 -- 172.21.15.99:0/335901474 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f27aa7a190 con 0x55f27aabf180 2024-02-21T23:05:33.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.498+0000 7f9462800640 1 --2- 172.21.15.99:0/335901474 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f27aabfb40 0x55f27aa925d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:05:33.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.498+0000 7f9461e00640 1 --2- 172.21.15.99:0/335901474 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f27aabe720 0x55f27aad0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:05:33.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.498+0000 7f9461400640 1 --2- 172.21.15.99:0/335901474 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f27aabf180 0x55f27aacb4e0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f94500098c0 tx=0x7f9450004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cf9b3aa471e9e92 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:05:33.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.498+0000 7f9443400640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:05:33.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.499+0000 7f9443400640 1 -- 172.21.15.99:0/335901474 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f945005d070 con 0x55f27aabf180 2024-02-21T23:05:33.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.499+0000 7f9443400640 1 -- 172.21.15.99:0/335901474 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f9450004200 con 0x55f27aabf180 2024-02-21T23:05:33.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.499+0000 7f946bdb6740 1 -- 172.21.15.99:0/335901474 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9450057160 con 0x55f27aabf180 2024-02-21T23:05:33.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.499+0000 7f9443400640 1 -- 172.21.15.99:0/335901474 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9450035070 con 0x55f27aabf180 2024-02-21T23:05:33.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.499+0000 7f946bdb6740 10 client.5742 fetch_fsmap learned FSMap version 16 2024-02-21T23:05:33.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.499+0000 7f946bdb6740 1 -- 172.21.15.99:0/335901474 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55f27aac7b90 con 0x55f27aabf180 2024-02-21T23:05:33.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.499+0000 7f9443400640 1 -- 172.21.15.99:0/335901474 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9450057160 con 0x55f27aabf180 2024-02-21T23:05:33.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.499+0000 7f9443400640 1 -- 172.21.15.99:0/335901474 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f94500316b0 con 0x55f27aabf180 2024-02-21T23:05:33.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.499+0000 7f946bdb6740 10 client.5742 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T23:05:33.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.499+0000 7f946bdb6740 10 client.5742 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.d 2024-02-21T23:05:33.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.500+0000 7f946bdb6740 20 client.5742 populate_metadata read hostname 'smithi099' 2024-02-21T23:05:33.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.500+0000 7f946bdb6740 1 --2- 172.21.15.99:0/335901474 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x55f27aa888b0 0x55f27aa92b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:33.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.500+0000 7f946bdb6740 4 client.5742 mds_command: new command op to 4348 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T23:05:33.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.500+0000 7f946bdb6740 1 -- 172.21.15.99:0/335901474 --> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55f27a9b43e0 con 0x55f27aa888b0 2024-02-21T23:05:33.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.500+0000 7f9461e00640 1 --2- 172.21.15.99:0/335901474 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x55f27aa888b0 0x55f27aa92b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:33.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.500+0000 7f9461e00640 1 --2- 172.21.15.99:0/335901474 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x55f27aa888b0 0x55f27aa92b10 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a6a023099c3ab55a server_cookie=70fb8ac2e0b9a181 in_seq=0 out_seq=0 2024-02-21T23:05:33.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.500+0000 7f9443400640 10 client.5742 ms_handle_connect on v2:172.21.15.99:6834/2243461688 2024-02-21T23:05:33.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.501+0000 7f9443400640 1 -- 172.21.15.99:0/335901474 <== mds.2 v2:172.21.15.99:6834/2243461688 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55f27a9b43e0 con 0x55f27aa888b0 2024-02-21T23:05:33.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.501+0000 7f9443400640 10 client.5742 handle_command_reply: tid=0 2024-02-21T23:05:33.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.501+0000 7f946bdb6740 1 client.5742 shutdown 2024-02-21T23:05:33.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.501+0000 7f946bdb6740 1 -- 172.21.15.99:0/335901474 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f27aabf180 msgr2=0x55f27aacb4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:33.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.501+0000 7f946bdb6740 1 --2- 172.21.15.99:0/335901474 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f27aabf180 0x55f27aacb4e0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f94500098c0 tx=0x7f9450004730 comp rx=0 tx=0).stop 2024-02-21T23:05:33.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.501+0000 7f946bdb6740 1 -- 172.21.15.99:0/335901474 shutdown_connections 2024-02-21T23:05:33.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.501+0000 7f946bdb6740 1 --2- 172.21.15.99:0/335901474 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x55f27aa888b0 0x55f27aa92b10 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:33.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.501+0000 7f946bdb6740 1 --2- 172.21.15.99:0/335901474 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f27aabfb40 0x55f27aa925d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:33.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.501+0000 7f946bdb6740 1 --2- 172.21.15.99:0/335901474 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f27aabf180 0x55f27aacb4e0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:33.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.501+0000 7f946bdb6740 1 --2- 172.21.15.99:0/335901474 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f27aabe720 0x55f27aad0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:33.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.501+0000 7f9443400640 0 client.5742 ms_handle_reset on v2:172.21.15.99:6834/2243461688 2024-02-21T23:05:33.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.501+0000 7f946bdb6740 1 -- 172.21.15.99:0/335901474 >> 172.21.15.99:0/335901474 conn(0x55f27aa844b0 msgr2=0x55f27aa4d7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:05:33.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.501+0000 7f946bdb6740 1 -- 172.21.15.99:0/335901474 shutdown_connections 2024-02-21T23:05:33.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.501+0000 7f946bdb6740 1 -- 172.21.15.99:0/335901474 wait complete. 2024-02-21T23:05:33.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.501+0000 7f946bdb6740 20 client.5742 trim_cache size 0 max 16384 2024-02-21T23:05:33.504 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-02-21T23:05:33.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.502+0000 7f9468e00640 1 -- 172.21.15.99:0/1299922518 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f944409ee50 msgr2=0x7f94440a1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:33.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.502+0000 7f9468e00640 1 --2- 172.21.15.99:0/1299922518 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f944409ee50 0x7f94440a1310 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f94640f7e70 tx=0x7f9450008030 comp rx=0 tx=0).stop 2024-02-21T23:05:33.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.502+0000 7f9468e00640 1 -- 172.21.15.99:0/1299922518 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f94640f8020 msgr2=0x7f9464071dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:33.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.502+0000 7f9468e00640 1 --2- 172.21.15.99:0/1299922518 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f94640f8020 0x7f9464071dd0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f945400c3c0 tx=0x7f9454001e70 comp rx=0 tx=0).stop 2024-02-21T23:05:33.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.502+0000 7f9468e00640 1 -- 172.21.15.99:0/1299922518 shutdown_connections 2024-02-21T23:05:33.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.502+0000 7f9468e00640 1 --2- 172.21.15.99:0/1299922518 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f944409ee50 0x7f94440a1310 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:33.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.502+0000 7f9468e00640 1 --2- 172.21.15.99:0/1299922518 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9464189560 0x7f946421f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:33.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.502+0000 7f9468e00640 1 --2- 172.21.15.99:0/1299922518 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f94640f8940 0x7f946421f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:33.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.502+0000 7f9468e00640 1 --2- 172.21.15.99:0/1299922518 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f94640f8020 0x7f9464071dd0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:33.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.502+0000 7f9468e00640 1 -- 172.21.15.99:0/1299922518 >> 172.21.15.99:0/1299922518 conn(0x7f94640ce5f0 msgr2=0x7f94640ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:05:33.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.502+0000 7f9468e00640 1 -- 172.21.15.99:0/1299922518 shutdown_connections 2024-02-21T23:05:33.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.502+0000 7f9468e00640 1 -- 172.21.15.99:0/1299922518 wait complete. 2024-02-21T23:05:33.508 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T23:05:33.508 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-02-21T23:05:33.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.742+0000 7f9b07800640 1 Processor -- start 2024-02-21T23:05:33.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.742+0000 7f9b07800640 1 -- start start 2024-02-21T23:05:33.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.744+0000 7f9b07800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f9b000f8020 0x7f9b00188e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:33.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.744+0000 7f9b07800640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f9b00189390 0x7f9b000f8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:33.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.744+0000 7f9b07800640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b00189b70 con 0x7f9b000f8940 2024-02-21T23:05:33.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.744+0000 7f9b07800640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b00186d50 con 0x7f9b000f8020 2024-02-21T23:05:33.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.744+0000 7f9b07800640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b001878d0 con 0x7f9b00189390 2024-02-21T23:05:33.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.744+0000 7f9b04e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f9b000f8020 0x7f9b00188e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:33.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.744+0000 7f9b05800640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f9b000f8940 0x7f9b00187d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:48408/0 (socket says 172.21.15.99:48408) 2024-02-21T23:05:33.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.744+0000 7f9b04e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f9b000f8020 0x7f9b00188e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54242/0 (socket says 172.21.15.99:54242) 2024-02-21T23:05:33.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.744+0000 7f9b05800640 1 -- 172.21.15.99:0/2875693141 learned_addr learned my addr 172.21.15.99:0/2875693141 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:05:33.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.744+0000 7f9af7e00640 1 --2- 172.21.15.99:0/2875693141 >> v2:172.21.15.181:3300/0 conn(0x7f9b00189390 0x7f9b000f8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:33.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.745+0000 7f9b04e00640 1 -- 172.21.15.99:0/2875693141 >> v2:172.21.15.181:3300/0 conn(0x7f9b00189390 msgr2=0x7f9b000f8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:05:33.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.745+0000 7f9b04e00640 1 --2- 172.21.15.99:0/2875693141 >> v2:172.21.15.181:3300/0 conn(0x7f9b00189390 0x7f9b000f8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:33.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.745+0000 7f9b04e00640 1 -- 172.21.15.99:0/2875693141 >> v1:172.21.15.99:6789/0 conn(0x7f9b000f8940 legacy=0x7f9b00187d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:33.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.745+0000 7f9b04e00640 1 -- 172.21.15.99:0/2875693141 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b00186fa0 con 0x7f9b000f8020 2024-02-21T23:05:33.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.745+0000 7f9affe00640 1 -- 172.21.15.99:0/2875693141 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3284977620 0 0) 0x7f9b00189b70 con 0x7f9b000f8940 2024-02-21T23:05:33.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.747+0000 7f9b04e00640 1 --2- 172.21.15.99:0/2875693141 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b000f8020 0x7f9b00188e50 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f9b000f4720 tx=0x7f9af002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75d98268de9d2e7b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:05:33.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.747+0000 7f9affe00640 1 -- 172.21.15.99:0/2875693141 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af00315a0 con 0x7f9b000f8020 2024-02-21T23:05:33.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.747+0000 7f9affe00640 1 -- 172.21.15.99:0/2875693141 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9af0037070 con 0x7f9b000f8020 2024-02-21T23:05:33.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.747+0000 7f9affe00640 1 -- 172.21.15.99:0/2875693141 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af0031960 con 0x7f9b000f8020 2024-02-21T23:05:33.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.748+0000 7f9b07800640 1 -- 172.21.15.99:0/2875693141 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b000f8020 msgr2=0x7f9b00188e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:33.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.748+0000 7f9b07800640 1 --2- 172.21.15.99:0/2875693141 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b000f8020 0x7f9b00188e50 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f9b000f4720 tx=0x7f9af002b840 comp rx=0 tx=0).stop 2024-02-21T23:05:33.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.748+0000 7f9b07800640 1 -- 172.21.15.99:0/2875693141 shutdown_connections 2024-02-21T23:05:33.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.748+0000 7f9b07800640 1 --2- 172.21.15.99:0/2875693141 >> v2:172.21.15.181:3300/0 conn(0x7f9b00189390 0x7f9b000f8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:33.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.748+0000 7f9b07800640 1 --2- 172.21.15.99:0/2875693141 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b000f8020 0x7f9b00188e50 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:33.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.748+0000 7f9b07800640 1 -- 172.21.15.99:0/2875693141 >> 172.21.15.99:0/2875693141 conn(0x7f9b000ce5f0 msgr2=0x7f9b000cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:05:33.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.748+0000 7f9b07800640 1 -- 172.21.15.99:0/2875693141 shutdown_connections 2024-02-21T23:05:33.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.748+0000 7f9b07800640 1 -- 172.21.15.99:0/2875693141 wait complete. 2024-02-21T23:05:33.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.751+0000 7f9b07800640 1 Processor -- start 2024-02-21T23:05:33.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.751+0000 7f9b07800640 1 -- start start 2024-02-21T23:05:33.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.753+0000 7f9b07800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9b000f8020 0x7f9b0016fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:33.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.753+0000 7f9b07800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9b000f8940 0x7f9b00070d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:33.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.754+0000 7f9b07800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b00189390 0x7f9b0021fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:33.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.754+0000 7f9b07800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b00187560 con 0x7f9b00189390 2024-02-21T23:05:33.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.754+0000 7f9b07800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b000f9f60 con 0x7f9b000f8940 2024-02-21T23:05:33.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.754+0000 7f9b07800640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b0017c660 con 0x7f9b000f8020 2024-02-21T23:05:33.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.754+0000 7f9b04e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9b000f8020 0x7f9b0016fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:33.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.754+0000 7f9b05800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b00189390 0x7f9b0021fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:33.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.754+0000 7f9b04e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9b000f8020 0x7f9b0016fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:34618/0 (socket says 172.21.15.99:34618) 2024-02-21T23:05:33.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.754+0000 7f9b04e00640 1 -- 172.21.15.99:0/2206955142 learned_addr learned my addr 172.21.15.99:0/2206955142 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:05:33.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.754+0000 7f9b05800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b00189390 0x7f9b0021fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54258/0 (socket says 172.21.15.99:54258) 2024-02-21T23:05:33.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.754+0000 7f9af7e00640 1 --2- 172.21.15.99:0/2206955142 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9b000f8940 0x7f9b00070d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:33.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.754+0000 7f9b05800640 1 -- 172.21.15.99:0/2206955142 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9b000f8020 msgr2=0x7f9b0016fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:33.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.754+0000 7f9b05800640 1 --2- 172.21.15.99:0/2206955142 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9b000f8020 0x7f9b0016fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:33.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.754+0000 7f9b05800640 1 -- 172.21.15.99:0/2206955142 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9b000f8940 msgr2=0x7f9b00070d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:33.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.754+0000 7f9b05800640 1 --2- 172.21.15.99:0/2206955142 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9b000f8940 0x7f9b00070d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:33.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.754+0000 7f9b05800640 1 -- 172.21.15.99:0/2206955142 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b000cbd70 con 0x7f9b00189390 2024-02-21T23:05:33.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.755+0000 7f9af7e00640 1 --2- 172.21.15.99:0/2206955142 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9b000f8940 0x7f9b00070d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:05:33.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.755+0000 7f9b05800640 1 --2- 172.21.15.99:0/2206955142 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b00189390 0x7f9b0021fec0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f9af800c700 tx=0x7f9af800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:05:33.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.755+0000 7f9afd600640 1 -- 172.21.15.99:0/2206955142 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af8018070 con 0x7f9b00189390 2024-02-21T23:05:33.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.755+0000 7f9afd600640 1 -- 172.21.15.99:0/2206955142 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9af800ce10 con 0x7f9b00189390 2024-02-21T23:05:33.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.755+0000 7f9b07800640 1 -- 172.21.15.99:0/2206955142 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b000cacd0 con 0x7f9b00189390 2024-02-21T23:05:33.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.755+0000 7f9afd600640 1 -- 172.21.15.99:0/2206955142 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af800a880 con 0x7f9b00189390 2024-02-21T23:05:33.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.755+0000 7f9b07800640 1 -- 172.21.15.99:0/2206955142 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b000cb290 con 0x7f9b00189390 2024-02-21T23:05:33.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.760+0000 7f9afd600640 1 -- 172.21.15.99:0/2206955142 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f9af801b070 con 0x7f9b00189390 2024-02-21T23:05:33.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.761+0000 7f9b0a772740 1 Processor -- start 2024-02-21T23:05:33.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.761+0000 7f9b0a772740 1 -- start start 2024-02-21T23:05:33.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.762+0000 7f9b0a772740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563aa65c04b0 0x563aa65c0890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:33.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.762+0000 7f9b0a772740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563aa65fb180 0x563aa65fb600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:33.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.762+0000 7f9b0a772740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563aa65fbb40 0x563aa65fc3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:33.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.762+0000 7f9b0a772740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x563aa64e8b50 con 0x563aa65fbb40 2024-02-21T23:05:33.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.762+0000 7f9b0a772740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x563aa6491da0 con 0x563aa65c04b0 2024-02-21T23:05:33.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.762+0000 7f9b0a772740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x563aa64e4bf0 con 0x563aa65fb180 2024-02-21T23:05:33.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.762+0000 7f9af7e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563aa65c04b0 0x563aa65c0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:33.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.762+0000 7f9afd600640 1 --2- 172.21.15.99:0/2206955142 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f9adc09ef00 0x7f9adc0a13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:33.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.762+0000 7f9af7e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563aa65c04b0 0x563aa65c0890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:33270/0 (socket says 172.21.15.99:33270) 2024-02-21T23:05:33.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.762+0000 7f9af7e00640 1 -- 172.21.15.99:0/1903197994 learned_addr learned my addr 172.21.15.99:0/1903197994 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:05:33.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.762+0000 7f9b04e00640 1 --2- 172.21.15.99:0/1903197994 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563aa65fb180 0x563aa65fb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:33.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.762+0000 7f9af7e00640 1 --2- 172.21.15.99:0/1903197994 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563aa65fbb40 0x563aa65fc3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:33.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.763+0000 7f9afd600640 1 -- 172.21.15.99:0/2206955142 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f9af80c9200 con 0x7f9b00189390 2024-02-21T23:05:33.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.763+0000 7f9b05800640 1 --2- 172.21.15.99:0/2206955142 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f9adc09ef00 0x7f9adc0a13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:33.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.763+0000 7f9b04e00640 1 -- 172.21.15.99:0/1903197994 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563aa65c04b0 msgr2=0x563aa65c0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:05:33.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.763+0000 7f9b04e00640 1 --2- 172.21.15.99:0/1903197994 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563aa65c04b0 0x563aa65c0890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:33.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.763+0000 7f9b04e00640 1 -- 172.21.15.99:0/1903197994 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563aa65fbb40 msgr2=0x563aa65fc3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:05:33.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.763+0000 7f9b04e00640 1 --2- 172.21.15.99:0/1903197994 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563aa65fbb40 0x563aa65fc3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:33.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.763+0000 7f9b04e00640 1 -- 172.21.15.99:0/1903197994 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563aa64b4f80 con 0x563aa65fb180 2024-02-21T23:05:33.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.763+0000 7f9b04e00640 1 --2- 172.21.15.99:0/1903197994 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563aa65fb180 0x563aa65fb600 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f9af0009890 tx=0x7f9af0008030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fff768ac9818a1b4 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:05:33.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.764+0000 7f9b05800640 1 --2- 172.21.15.99:0/2206955142 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f9adc09ef00 0x7f9adc0a13c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9af80c6aa0 tx=0x7f9af8009040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:05:33.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.764+0000 7f9af5600640 1 -- 172.21.15.99:0/1903197994 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af004a070 con 0x563aa65fb180 2024-02-21T23:05:33.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.764+0000 7f9af5600640 1 -- 172.21.15.99:0/1903197994 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9af0037040 con 0x563aa65fb180 2024-02-21T23:05:33.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.764+0000 7f9af5600640 1 -- 172.21.15.99:0/1903197994 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af00319a0 con 0x563aa65fb180 2024-02-21T23:05:33.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.764+0000 7f9b0a772740 1 -- 172.21.15.99:0/1903197994 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563aa65fb180 msgr2=0x563aa65fb600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:33.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.764+0000 7f9b0a772740 1 --2- 172.21.15.99:0/1903197994 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563aa65fb180 0x563aa65fb600 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f9af0009890 tx=0x7f9af0008030 comp rx=0 tx=0).stop 2024-02-21T23:05:33.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.765+0000 7f9b0a772740 1 -- 172.21.15.99:0/1903197994 shutdown_connections 2024-02-21T23:05:33.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.765+0000 7f9b0a772740 1 --2- 172.21.15.99:0/1903197994 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563aa65fbb40 0x563aa65fc3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:33.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.765+0000 7f9b0a772740 1 --2- 172.21.15.99:0/1903197994 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563aa65fb180 0x563aa65fb600 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:33.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.765+0000 7f9b0a772740 1 --2- 172.21.15.99:0/1903197994 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563aa65c04b0 0x563aa65c0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:33.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.765+0000 7f9b0a772740 1 -- 172.21.15.99:0/1903197994 >> 172.21.15.99:0/1903197994 conn(0x563aa6582520 msgr2=0x563aa65835a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:05:33.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.765+0000 7f9b0a772740 1 -- 172.21.15.99:0/1903197994 shutdown_connections 2024-02-21T23:05:33.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.765+0000 7f9b0a772740 1 -- 172.21.15.99:0/1903197994 wait complete. 2024-02-21T23:05:33.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.766+0000 7f9b0a772740 1 -- start start 2024-02-21T23:05:33.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.766+0000 7f9b0a772740 1 Processor -- start 2024-02-21T23:05:33.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.768+0000 7f9b0a772740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563aa65fb180 0x563aa65f5530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:33.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.768+0000 7f9b0a772740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563aa65fbb40 0x563aa65c7db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:33.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.768+0000 7f9b0a772740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563aa65ca320 0x563aa65c7320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:33.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.768+0000 7f9b0a772740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x563aa65f9ef0 con 0x563aa65ca320 2024-02-21T23:05:33.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.768+0000 7f9b0a772740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x563aa6487380 con 0x563aa65fbb40 2024-02-21T23:05:33.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.768+0000 7f9b0a772740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x563aa65f9c10 con 0x563aa65fb180 2024-02-21T23:05:33.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.768+0000 7f9b0a772740 10 client.0 _ll_register_callbacks cb 0x563aa64e0280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:05:33.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.768+0000 7f9af7e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563aa65fb180 0x563aa65f5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:33.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.768+0000 7f9b04e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563aa65fbb40 0x563aa65c7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:33.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.768+0000 7f9af7e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563aa65fb180 0x563aa65f5530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:34648/0 (socket says 172.21.15.99:34648) 2024-02-21T23:05:33.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.768+0000 7f9af7e00640 1 -- 172.21.15.99:0/2556568436 learned_addr learned my addr 172.21.15.99:0/2556568436 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:05:33.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.768+0000 7f9af7e00640 1 --2- 172.21.15.99:0/2556568436 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563aa65ca320 0x563aa65c7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:33.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.768+0000 7f9b04e00640 1 -- 172.21.15.99:0/2556568436 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563aa65fb180 msgr2=0x563aa65f5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:05:33.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.768+0000 7f9b04e00640 1 --2- 172.21.15.99:0/2556568436 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563aa65fb180 0x563aa65f5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:33.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.768+0000 7f9b04e00640 1 -- 172.21.15.99:0/2556568436 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563aa65ca320 msgr2=0x563aa65c7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:05:33.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.768+0000 7f9b04e00640 1 --2- 172.21.15.99:0/2556568436 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563aa65ca320 0x563aa65c7320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:33.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.768+0000 7f9b04e00640 1 -- 172.21.15.99:0/2556568436 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563aa64afc20 con 0x563aa65fbb40 2024-02-21T23:05:33.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.769+0000 7f9b04e00640 1 --2- 172.21.15.99:0/2556568436 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563aa65fbb40 0x563aa65c7db0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f9af0034040 tx=0x7f9af0004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5aaca0730c029dd9 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:05:33.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.769+0000 7f9aee000640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-02-21T23:05:33.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.769+0000 7f9aee000640 1 -- 172.21.15.99:0/2556568436 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af004a040 con 0x563aa65fbb40 2024-02-21T23:05:33.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.769+0000 7f9aee000640 1 -- 172.21.15.99:0/2556568436 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f9af00317a0 con 0x563aa65fbb40 2024-02-21T23:05:33.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.769+0000 7f9b0a772740 1 -- 172.21.15.99:0/2556568436 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9af0037040 con 0x563aa65fbb40 2024-02-21T23:05:33.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.769+0000 7f9aee000640 1 -- 172.21.15.99:0/2556568436 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9af005c050 con 0x563aa65fbb40 2024-02-21T23:05:33.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.769+0000 7f9b0a772740 10 client.5881 fetch_fsmap learned FSMap version 16 2024-02-21T23:05:33.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.769+0000 7f9b0a772740 1 -- 172.21.15.99:0/2556568436 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x563aa61fd3f0 con 0x563aa65fbb40 2024-02-21T23:05:33.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.770+0000 7f9aee000640 1 -- 172.21.15.99:0/2556568436 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9af0037040 con 0x563aa65fbb40 2024-02-21T23:05:33.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.770+0000 7f9aee000640 1 -- 172.21.15.99:0/2556568436 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f9af004d070 con 0x563aa65fbb40 2024-02-21T23:05:33.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.770+0000 7f9b0a772740 10 client.5881 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T23:05:33.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.770+0000 7f9b0a772740 10 client.5881 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2024-02-21T23:05:33.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.770+0000 7f9b0a772740 20 client.5881 populate_metadata read hostname 'smithi099' 2024-02-21T23:05:33.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.770+0000 7f9b0a772740 1 --2- 172.21.15.99:0/2556568436 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x563aa65bb510 0x563aa65b6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:33.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.770+0000 7f9b0a772740 4 client.5881 mds_command: new command op to 4352 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:05:33.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.770+0000 7f9b0a772740 1 -- 172.21.15.99:0/2556568436 --> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563aa64f6090 con 0x563aa65bb510 2024-02-21T23:05:33.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.770+0000 7f9af7e00640 1 --2- 172.21.15.99:0/2556568436 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x563aa65bb510 0x563aa65b6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:33.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.771+0000 7f9af7e00640 1 --2- 172.21.15.99:0/2556568436 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x563aa65bb510 0x563aa65b6100 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=261906cf51b88f36 server_cookie=c2a126c4396ed8c9 in_seq=0 out_seq=0 2024-02-21T23:05:33.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.771+0000 7f9aee000640 10 client.5881 ms_handle_connect on v2:172.21.15.99:6836/1676159950 2024-02-21T23:05:33.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.772+0000 7f9aee000640 1 -- 172.21.15.99:0/2556568436 <== mds.1 v2:172.21.15.99:6836/1676159950 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x563aa64f6090 con 0x563aa65bb510 2024-02-21T23:05:33.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.772+0000 7f9aee000640 10 client.5881 handle_command_reply: tid=0 2024-02-21T23:05:33.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.772+0000 7f9b0a772740 1 client.5881 shutdown 2024-02-21T23:05:33.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.772+0000 7f9b0a772740 1 -- 172.21.15.99:0/2556568436 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563aa65fbb40 msgr2=0x563aa65c7db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:33.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.772+0000 7f9b0a772740 1 --2- 172.21.15.99:0/2556568436 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563aa65fbb40 0x563aa65c7db0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f9af0034040 tx=0x7f9af0004730 comp rx=0 tx=0).stop 2024-02-21T23:05:33.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.772+0000 7f9b0a772740 1 -- 172.21.15.99:0/2556568436 shutdown_connections 2024-02-21T23:05:33.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.772+0000 7f9b0a772740 1 --2- 172.21.15.99:0/2556568436 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x563aa65bb510 0x563aa65b6100 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:33.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.772+0000 7f9b0a772740 1 --2- 172.21.15.99:0/2556568436 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563aa65ca320 0x563aa65c7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:33.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.772+0000 7f9b0a772740 1 --2- 172.21.15.99:0/2556568436 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563aa65fbb40 0x563aa65c7db0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:33.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.772+0000 7f9aee000640 0 client.5881 ms_handle_reset on v2:172.21.15.99:6836/1676159950 2024-02-21T23:05:33.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.772+0000 7f9b0a772740 1 --2- 172.21.15.99:0/2556568436 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563aa65fb180 0x563aa65f5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:33.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.772+0000 7f9b0a772740 1 -- 172.21.15.99:0/2556568436 >> 172.21.15.99:0/2556568436 conn(0x563aa65c04b0 msgr2=0x563aa65fa600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:05:33.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.773+0000 7f9b0a772740 1 -- 172.21.15.99:0/2556568436 shutdown_connections 2024-02-21T23:05:33.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.773+0000 7f9b0a772740 1 -- 172.21.15.99:0/2556568436 wait complete. 2024-02-21T23:05:33.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.773+0000 7f9b0a772740 20 client.5881 trim_cache size 0 max 16384 2024-02-21T23:05:33.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.790+0000 7f9b0a772740 1 Processor -- start 2024-02-21T23:05:33.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.790+0000 7f9b0a772740 1 -- start start 2024-02-21T23:05:33.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.792+0000 7f9b0a772740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563aa65ca320 0x563aa6589fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:33.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.792+0000 7f9b0a772740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563aa65fb180 0x563aa6581eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:33.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.792+0000 7f9b0a772740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563aa65fbb40 0x563aa65cb370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:33.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.792+0000 7f9b0a772740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b0022c6d0 con 0x563aa65fbb40 2024-02-21T23:05:33.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.792+0000 7f9b0a772740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b0022a270 con 0x563aa65ca320 2024-02-21T23:05:33.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.792+0000 7f9b0a772740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b000ccfd0 con 0x563aa65fb180 2024-02-21T23:05:33.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.792+0000 7f9af7e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563aa65fbb40 0x563aa65cb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:33.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.792+0000 7f9b04e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563aa65fb180 0x563aa6581eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:33.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.792+0000 7f9af7e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563aa65ca320 0x563aa6589fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:33.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.792+0000 7f9b04e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563aa65fb180 0x563aa6581eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:34654/0 (socket says 172.21.15.99:34654) 2024-02-21T23:05:33.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.792+0000 7f9af7e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563aa65ca320 0x563aa6589fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:33284/0 (socket says 172.21.15.99:33284) 2024-02-21T23:05:33.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.792+0000 7f9b04e00640 1 -- 172.21.15.99:0/1139489664 learned_addr learned my addr 172.21.15.99:0/1139489664 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:05:33.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.792+0000 7f9af7e00640 1 -- 172.21.15.99:0/1139489664 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563aa65fb180 msgr2=0x563aa6581eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:05:33.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.792+0000 7f9af7e00640 1 --2- 172.21.15.99:0/1139489664 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563aa65fb180 0x563aa6581eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:33.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.792+0000 7f9af7e00640 1 -- 172.21.15.99:0/1139489664 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563aa65fbb40 msgr2=0x563aa65cb370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:05:33.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.792+0000 7f9af7e00640 1 --2- 172.21.15.99:0/1139489664 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563aa65fbb40 0x563aa65cb370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:33.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.792+0000 7f9af7e00640 1 -- 172.21.15.99:0/1139489664 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563aa62c77d0 con 0x563aa65ca320 2024-02-21T23:05:33.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.793+0000 7f9af7e00640 1 --2- 172.21.15.99:0/1139489664 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563aa65ca320 0x563aa6589fe0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x563aa65f6a10 tx=0x7f9ae8006a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f63d9d24b546242 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:05:33.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.793+0000 7f9af4c00640 1 -- 172.21.15.99:0/1139489664 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae8016b60 con 0x563aa65ca320 2024-02-21T23:05:33.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.793+0000 7f9af4c00640 1 -- 172.21.15.99:0/1139489664 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ae8016d20 con 0x563aa65ca320 2024-02-21T23:05:33.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.793+0000 7f9af4c00640 1 -- 172.21.15.99:0/1139489664 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae8004270 con 0x563aa65ca320 2024-02-21T23:05:33.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.794+0000 7f9b0a772740 1 -- 172.21.15.99:0/1139489664 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563aa65ca320 msgr2=0x563aa6589fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:33.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.794+0000 7f9b0a772740 1 --2- 172.21.15.99:0/1139489664 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563aa65ca320 0x563aa6589fe0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x563aa65f6a10 tx=0x7f9ae8006a20 comp rx=0 tx=0).stop 2024-02-21T23:05:33.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.794+0000 7f9b0a772740 1 -- 172.21.15.99:0/1139489664 shutdown_connections 2024-02-21T23:05:33.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.794+0000 7f9b0a772740 1 --2- 172.21.15.99:0/1139489664 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563aa65fbb40 0x563aa65cb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:33.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.794+0000 7f9b0a772740 1 --2- 172.21.15.99:0/1139489664 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563aa65fb180 0x563aa6581eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:33.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.794+0000 7f9b0a772740 1 --2- 172.21.15.99:0/1139489664 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563aa65ca320 0x563aa6589fe0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:33.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.794+0000 7f9b0a772740 1 -- 172.21.15.99:0/1139489664 >> 172.21.15.99:0/1139489664 conn(0x563aa65c04b0 msgr2=0x563aa65f5430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:05:33.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.794+0000 7f9b0a772740 1 -- 172.21.15.99:0/1139489664 shutdown_connections 2024-02-21T23:05:33.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.794+0000 7f9b0a772740 1 -- 172.21.15.99:0/1139489664 wait complete. 2024-02-21T23:05:33.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.795+0000 7f9b0a772740 1 -- start start 2024-02-21T23:05:33.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.796+0000 7f9b0a772740 1 Processor -- start 2024-02-21T23:05:33.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.798+0000 7f9b0a772740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563aa65ca320 0x563aa6589f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:33.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.798+0000 7f9b0a772740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563aa65fb180 0x563aa6601f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:33.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.798+0000 7f9b0a772740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563aa65fbb40 0x563aa65ab7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:33.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.798+0000 7f9b0a772740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b0021f6e0 con 0x563aa65ca320 2024-02-21T23:05:33.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.798+0000 7f9b0a772740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b00229c10 con 0x563aa65fbb40 2024-02-21T23:05:33.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.798+0000 7f9b0a772740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b00228f50 con 0x563aa65fb180 2024-02-21T23:05:33.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.798+0000 7f9b0a772740 10 client.0 _ll_register_callbacks cb 0x7f9af0048070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:05:33.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.798+0000 7f9af7e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563aa65ca320 0x563aa6589f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:33.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.798+0000 7f9b04e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563aa65fb180 0x563aa6601f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:33.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.798+0000 7f9af7e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563aa65ca320 0x563aa6589f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54288/0 (socket says 172.21.15.99:54288) 2024-02-21T23:05:33.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.798+0000 7f9af7e00640 1 -- 172.21.15.99:0/4041050905 learned_addr learned my addr 172.21.15.99:0/4041050905 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:05:33.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.798+0000 7f9af7e00640 1 --2- 172.21.15.99:0/4041050905 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563aa65fbb40 0x563aa65ab7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:33.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.799+0000 7f9b04e00640 1 -- 172.21.15.99:0/4041050905 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563aa65fbb40 msgr2=0x563aa65ab7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:05:33.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.799+0000 7f9b04e00640 1 --2- 172.21.15.99:0/4041050905 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563aa65fbb40 0x563aa65ab7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:33.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.799+0000 7f9b04e00640 1 -- 172.21.15.99:0/4041050905 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563aa65ca320 msgr2=0x563aa6589f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:05:33.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.799+0000 7f9b04e00640 1 --2- 172.21.15.99:0/4041050905 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563aa65ca320 0x563aa6589f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:33.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.799+0000 7f9b04e00640 1 -- 172.21.15.99:0/4041050905 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563aa65f3f20 con 0x563aa65fb180 2024-02-21T23:05:33.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.799+0000 7f9b04e00640 1 --2- 172.21.15.99:0/4041050905 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563aa65fb180 0x563aa6601f50 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f9af00047b0 tx=0x7f9af003d040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8189dd68fe290bc5 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:05:33.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.799+0000 7f9aee000640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-02-21T23:05:33.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.799+0000 7f9aee000640 1 -- 172.21.15.99:0/4041050905 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af004a040 con 0x563aa65fb180 2024-02-21T23:05:33.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.799+0000 7f9b0a772740 1 -- 172.21.15.99:0/4041050905 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9ae8016d20 con 0x563aa65fb180 2024-02-21T23:05:33.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.799+0000 7f9aee000640 1 -- 172.21.15.99:0/4041050905 <== mon.2 v2:172.21.15.181:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f9af0031ae0 con 0x563aa65fb180 2024-02-21T23:05:33.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.799+0000 7f9aee000640 1 -- 172.21.15.99:0/4041050905 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9af0031d00 con 0x563aa65fb180 2024-02-21T23:05:33.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.799+0000 7f9b0a772740 10 client.5897 fetch_fsmap learned FSMap version 16 2024-02-21T23:05:33.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.799+0000 7f9b0a772740 1 -- 172.21.15.99:0/4041050905 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x563aa65f6c10 con 0x563aa65fb180 2024-02-21T23:05:33.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.800+0000 7f9aee000640 1 -- 172.21.15.99:0/4041050905 <== mon.2 v2:172.21.15.181:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ae8016d20 con 0x563aa65fb180 2024-02-21T23:05:33.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.800+0000 7f9aee000640 1 -- 172.21.15.99:0/4041050905 <== mon.2 v2:172.21.15.181:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f9af0031070 con 0x563aa65fb180 2024-02-21T23:05:33.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.800+0000 7f9b0a772740 10 client.5897 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T23:05:33.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.800+0000 7f9b0a772740 10 client.5897 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2024-02-21T23:05:33.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.800+0000 7f9b0a772740 20 client.5897 populate_metadata read hostname 'smithi099' 2024-02-21T23:05:33.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.800+0000 7f9b0a772740 1 --2- 172.21.15.99:0/4041050905 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x563aa65f5bb0 0x563aa65f35e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:33.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.800+0000 7f9b0a772740 4 client.5897 mds_command: new command op to 4352 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T23:05:33.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.800+0000 7f9b0a772740 1 -- 172.21.15.99:0/4041050905 --> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x563aa6582c80 con 0x563aa65f5bb0 2024-02-21T23:05:33.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.800+0000 7f9af7e00640 1 --2- 172.21.15.99:0/4041050905 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x563aa65f5bb0 0x563aa65f35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:33.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.801+0000 7f9af7e00640 1 --2- 172.21.15.99:0/4041050905 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x563aa65f5bb0 0x563aa65f35e0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6d1376407d24e846 server_cookie=6d6812ad61a5e71f in_seq=0 out_seq=0 2024-02-21T23:05:33.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.801+0000 7f9aee000640 10 client.5897 ms_handle_connect on v2:172.21.15.99:6836/1676159950 2024-02-21T23:05:33.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.801+0000 7f9aee000640 1 -- 172.21.15.99:0/4041050905 <== mds.1 v2:172.21.15.99:6836/1676159950 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x563aa6582c80 con 0x563aa65f5bb0 2024-02-21T23:05:33.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.801+0000 7f9aee000640 10 client.5897 handle_command_reply: tid=0 2024-02-21T23:05:33.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.801+0000 7f9b0a772740 1 client.5897 shutdown 2024-02-21T23:05:33.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.801+0000 7f9b0a772740 1 -- 172.21.15.99:0/4041050905 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563aa65fb180 msgr2=0x563aa6601f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:33.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.801+0000 7f9b0a772740 1 --2- 172.21.15.99:0/4041050905 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563aa65fb180 0x563aa6601f50 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f9af00047b0 tx=0x7f9af003d040 comp rx=0 tx=0).stop 2024-02-21T23:05:33.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.802+0000 7f9b0a772740 1 -- 172.21.15.99:0/4041050905 shutdown_connections 2024-02-21T23:05:33.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.802+0000 7f9b0a772740 1 --2- 172.21.15.99:0/4041050905 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x563aa65f5bb0 0x563aa65f35e0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:33.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.802+0000 7f9b0a772740 1 --2- 172.21.15.99:0/4041050905 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563aa65fbb40 0x563aa65ab7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:33.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.802+0000 7f9b0a772740 1 --2- 172.21.15.99:0/4041050905 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563aa65fb180 0x563aa6601f50 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:33.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.802+0000 7f9b0a772740 1 --2- 172.21.15.99:0/4041050905 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563aa65ca320 0x563aa6589f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:33.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.802+0000 7f9aee000640 0 client.5897 ms_handle_reset on v2:172.21.15.99:6836/1676159950 2024-02-21T23:05:33.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.802+0000 7f9b0a772740 1 -- 172.21.15.99:0/4041050905 >> 172.21.15.99:0/4041050905 conn(0x563aa65c04b0 msgr2=0x563aa657dc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:05:33.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.802+0000 7f9b0a772740 1 -- 172.21.15.99:0/4041050905 shutdown_connections 2024-02-21T23:05:33.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.802+0000 7f9b0a772740 1 -- 172.21.15.99:0/4041050905 wait complete. 2024-02-21T23:05:33.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.802+0000 7f9b0a772740 20 client.5897 trim_cache size 0 max 16384 2024-02-21T23:05:33.799 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-02-21T23:05:33.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.803+0000 7f9b07800640 1 -- 172.21.15.99:0/2206955142 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f9adc09ef00 msgr2=0x7f9adc0a13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:33.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.803+0000 7f9b07800640 1 --2- 172.21.15.99:0/2206955142 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f9adc09ef00 0x7f9adc0a13c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9af80c6aa0 tx=0x7f9af8009040 comp rx=0 tx=0).stop 2024-02-21T23:05:33.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.803+0000 7f9b07800640 1 -- 172.21.15.99:0/2206955142 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b00189390 msgr2=0x7f9b0021fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:33.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.803+0000 7f9b07800640 1 --2- 172.21.15.99:0/2206955142 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b00189390 0x7f9b0021fec0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f9af800c700 tx=0x7f9af800cbc0 comp rx=0 tx=0).stop 2024-02-21T23:05:33.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.803+0000 7f9b07800640 1 -- 172.21.15.99:0/2206955142 shutdown_connections 2024-02-21T23:05:33.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.803+0000 7f9b07800640 1 --2- 172.21.15.99:0/2206955142 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f9adc09ef00 0x7f9adc0a13c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:33.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.803+0000 7f9b07800640 1 --2- 172.21.15.99:0/2206955142 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b00189390 0x7f9b0021fec0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:33.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.803+0000 7f9b07800640 1 --2- 172.21.15.99:0/2206955142 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9b000f8940 0x7f9b00070d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:33.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.803+0000 7f9b07800640 1 --2- 172.21.15.99:0/2206955142 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9b000f8020 0x7f9b0016fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:33.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.803+0000 7f9b07800640 1 -- 172.21.15.99:0/2206955142 >> 172.21.15.99:0/2206955142 conn(0x7f9b000ce5f0 msgr2=0x7f9b000ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:05:33.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.803+0000 7f9b07800640 1 -- 172.21.15.99:0/2206955142 shutdown_connections 2024-02-21T23:05:33.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:33.803+0000 7f9b07800640 1 -- 172.21.15.99:0/2206955142 wait complete. 2024-02-21T23:05:33.810 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T23:05:33.811 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-02-21T23:05:34.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.053+0000 7f3a2ca00640 1 Processor -- start 2024-02-21T23:05:34.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.053+0000 7f3a2ca00640 1 -- start start 2024-02-21T23:05:34.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.055+0000 7f3a2ca00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3a2817f490 0x7f3a2818ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:34.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.055+0000 7f3a2ca00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a280d6dd0 con 0x7f3a2818b060 2024-02-21T23:05:34.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.055+0000 7f3a2ca00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a281614c0 con 0x7f3a2818b4f0 2024-02-21T23:05:34.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.055+0000 7f3a2ca00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a280d6810 con 0x7f3a2817f490 2024-02-21T23:05:34.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.056+0000 7f3a1de00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f3a2818b060 0x7f3a28188a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:48422/0 (socket says 172.21.15.99:48422) 2024-02-21T23:05:34.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.056+0000 7f3a1de00640 1 -- 172.21.15.99:0/2461987226 learned_addr learned my addr 172.21.15.99:0/2461987226 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:05:34.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.056+0000 7f3a26800640 1 --2- 172.21.15.99:0/2461987226 >> v2:172.21.15.162:3300/0 conn(0x7f3a2817f490 0x7f3a2818ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:34.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.056+0000 7f3a26800640 1 -- 172.21.15.99:0/2461987226 >> v1:172.21.15.162:6789/0 conn(0x7f3a2818b4f0 legacy=0x7f3a28189150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:34.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.056+0000 7f3a26800640 1 -- 172.21.15.99:0/2461987226 >> v1:172.21.15.99:6789/0 conn(0x7f3a2818b060 legacy=0x7f3a28188a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:34.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.056+0000 7f3a26800640 1 -- 172.21.15.99:0/2461987226 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a280d6af0 con 0x7f3a2817f490 2024-02-21T23:05:34.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.056+0000 7f3a25e00640 1 -- 172.21.15.99:0/2461987226 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3062317877 0 0) 0x7f3a280d6dd0 con 0x7f3a2818b060 2024-02-21T23:05:34.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.058+0000 7f3a26800640 1 --2- 172.21.15.99:0/2461987226 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a2817f490 0x7f3a2818ab20 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f3a18009d90 tx=0x7f3a1802bf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2bbd38edf8d4eef6 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:05:34.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.058+0000 7f3a25e00640 1 -- 172.21.15.99:0/2461987226 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a18039070 con 0x7f3a2817f490 2024-02-21T23:05:34.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.058+0000 7f3a25e00640 1 -- 172.21.15.99:0/2461987226 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a1802cd00 con 0x7f3a2817f490 2024-02-21T23:05:34.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.058+0000 7f3a25e00640 1 -- 172.21.15.99:0/2461987226 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a18034660 con 0x7f3a2817f490 2024-02-21T23:05:34.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.059+0000 7f3a2ca00640 1 -- 172.21.15.99:0/2461987226 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a2817f490 msgr2=0x7f3a2818ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:34.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.059+0000 7f3a2ca00640 1 --2- 172.21.15.99:0/2461987226 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a2817f490 0x7f3a2818ab20 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f3a18009d90 tx=0x7f3a1802bf50 comp rx=0 tx=0).stop 2024-02-21T23:05:34.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.059+0000 7f3a2ca00640 1 -- 172.21.15.99:0/2461987226 shutdown_connections 2024-02-21T23:05:34.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.059+0000 7f3a2ca00640 1 --2- 172.21.15.99:0/2461987226 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a2817f490 0x7f3a2818ab20 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:34.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.059+0000 7f3a2ca00640 1 -- 172.21.15.99:0/2461987226 >> 172.21.15.99:0/2461987226 conn(0x7f3a280d29b0 msgr2=0x7f3a280d2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:05:34.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.059+0000 7f3a2ca00640 1 -- 172.21.15.99:0/2461987226 shutdown_connections 2024-02-21T23:05:34.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.059+0000 7f3a2ca00640 1 -- 172.21.15.99:0/2461987226 wait complete. 2024-02-21T23:05:34.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.062+0000 7f3a2ca00640 1 Processor -- start 2024-02-21T23:05:34.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.063+0000 7f3a2ca00640 1 -- start start 2024-02-21T23:05:34.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.065+0000 7f3a2ca00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3a2817f490 0x7f3a280f8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:34.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.065+0000 7f3a2ca00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3a2818b060 0x7f3a28175590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:34.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.065+0000 7f3a2ca00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a2818b4f0 0x7f3a28220ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:34.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.065+0000 7f3a2ca00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2818a600 con 0x7f3a2818b060 2024-02-21T23:05:34.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.065+0000 7f3a2ca00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2818a320 con 0x7f3a2818b4f0 2024-02-21T23:05:34.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.065+0000 7f3a2ca00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2817f870 con 0x7f3a2817f490 2024-02-21T23:05:34.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.065+0000 7f3a1de00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3a2818b060 0x7f3a28175590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:34.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.065+0000 7f3a1de00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3a2818b060 0x7f3a28175590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54302/0 (socket says 172.21.15.99:54302) 2024-02-21T23:05:34.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.065+0000 7f3a1de00640 1 -- 172.21.15.99:0/3501634108 learned_addr learned my addr 172.21.15.99:0/3501634108 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:05:34.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.065+0000 7f3a26800640 1 --2- 172.21.15.99:0/3501634108 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3a2817f490 0x7f3a280f8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:34.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.065+0000 7f3a27200640 1 --2- 172.21.15.99:0/3501634108 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a2818b4f0 0x7f3a28220ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:34.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.066+0000 7f3a1de00640 1 -- 172.21.15.99:0/3501634108 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3a2817f490 msgr2=0x7f3a280f8c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:34.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.066+0000 7f3a1de00640 1 --2- 172.21.15.99:0/3501634108 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3a2817f490 0x7f3a280f8c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:34.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.066+0000 7f3a1de00640 1 -- 172.21.15.99:0/3501634108 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a2818b4f0 msgr2=0x7f3a28220ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:34.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.066+0000 7f3a1de00640 1 --2- 172.21.15.99:0/3501634108 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a2818b4f0 0x7f3a28220ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:34.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.066+0000 7f3a1de00640 1 -- 172.21.15.99:0/3501634108 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a280fbab0 con 0x7f3a2818b060 2024-02-21T23:05:34.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.066+0000 7f3a26800640 1 --2- 172.21.15.99:0/3501634108 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3a2817f490 0x7f3a280f8c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:05:34.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.066+0000 7f3a1de00640 1 --2- 172.21.15.99:0/3501634108 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3a2818b060 0x7f3a28175590 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f3a1000c4d0 tx=0x7f3a1000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:05:34.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.066+0000 7f3a1f400640 1 -- 172.21.15.99:0/3501634108 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a10018070 con 0x7f3a2818b060 2024-02-21T23:05:34.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.066+0000 7f3a1f400640 1 -- 172.21.15.99:0/3501634108 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a10007500 con 0x7f3a2818b060 2024-02-21T23:05:34.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.066+0000 7f3a2ca00640 1 -- 172.21.15.99:0/3501634108 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a2821fde0 con 0x7f3a2818b060 2024-02-21T23:05:34.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.066+0000 7f3a1f400640 1 -- 172.21.15.99:0/3501634108 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a10004a20 con 0x7f3a2818b060 2024-02-21T23:05:34.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.067+0000 7f3a2ca00640 1 -- 172.21.15.99:0/3501634108 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a282203a0 con 0x7f3a2818b060 2024-02-21T23:05:34.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.071+0000 7f3a1f400640 1 -- 172.21.15.99:0/3501634108 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f3a1001b070 con 0x7f3a2818b060 2024-02-21T23:05:34.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.072+0000 7f3a30252740 1 Processor -- start 2024-02-21T23:05:34.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.072+0000 7f3a30252740 1 -- start start 2024-02-21T23:05:34.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.073+0000 7f3a1f400640 1 --2- 172.21.15.99:0/3501634108 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f3a0409eed0 0x7f3a040a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:34.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.073+0000 7f3a1f400640 1 -- 172.21.15.99:0/3501634108 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f3a100c9110 con 0x7f3a2818b060 2024-02-21T23:05:34.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.073+0000 7f3a27200640 1 --2- 172.21.15.99:0/3501634108 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f3a0409eed0 0x7f3a040a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:34.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.074+0000 7f3a30252740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560af3cbb660 0x560af3cbba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:34.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.074+0000 7f3a30252740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560af3cf6330 0x560af3cf67b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:34.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.074+0000 7f3a30252740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560af3cf6cf0 0x560af3cf7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:34.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.074+0000 7f3a30252740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x560af3be3b50 con 0x560af3cf6cf0 2024-02-21T23:05:34.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.074+0000 7f3a30252740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x560af3b8cda0 con 0x560af3cf6330 2024-02-21T23:05:34.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.074+0000 7f3a30252740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x560af3bdfbf0 con 0x560af3cbb660 2024-02-21T23:05:34.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.074+0000 7f3a27200640 1 --2- 172.21.15.99:0/3501634108 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f3a0409eed0 0x7f3a040a1390 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3a20000f60 tx=0x7f3a20009040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:05:34.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.074+0000 7f3a27200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560af3cf6cf0 0x560af3cf7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:34.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.074+0000 7f3a1de00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560af3cf6330 0x560af3cf67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:34.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.074+0000 7f3a1de00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560af3cf6330 0x560af3cf67b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:33316/0 (socket says 172.21.15.99:33316) 2024-02-21T23:05:34.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.074+0000 7f3a27200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560af3cf6cf0 0x560af3cf7560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54318/0 (socket says 172.21.15.99:54318) 2024-02-21T23:05:34.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.074+0000 7f3a1de00640 1 -- 172.21.15.99:0/2775142064 learned_addr learned my addr 172.21.15.99:0/2775142064 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:05:34.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.074+0000 7f3a26800640 1 --2- 172.21.15.99:0/2775142064 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560af3cbb660 0x560af3cbba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:34.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.075+0000 7f3a1de00640 1 -- 172.21.15.99:0/2775142064 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560af3cbb660 msgr2=0x560af3cbba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:05:34.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.075+0000 7f3a1de00640 1 --2- 172.21.15.99:0/2775142064 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560af3cbb660 0x560af3cbba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:34.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.075+0000 7f3a1de00640 1 -- 172.21.15.99:0/2775142064 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560af3cf6cf0 msgr2=0x560af3cf7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:05:34.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.075+0000 7f3a1de00640 1 --2- 172.21.15.99:0/2775142064 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560af3cf6cf0 0x560af3cf7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:34.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.075+0000 7f3a1de00640 1 -- 172.21.15.99:0/2775142064 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560af3baff80 con 0x560af3cf6330 2024-02-21T23:05:34.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.075+0000 7f3a1de00640 1 --2- 172.21.15.99:0/2775142064 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560af3cf6330 0x560af3cf67b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f3a10096a50 tx=0x7f3a10096ac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e51a39b2a51ec23c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:05:34.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.075+0000 7f3a17000640 1 -- 172.21.15.99:0/2775142064 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a1009f1b0 con 0x560af3cf6330 2024-02-21T23:05:34.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.075+0000 7f3a17000640 1 -- 172.21.15.99:0/2775142064 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a100930a0 con 0x560af3cf6330 2024-02-21T23:05:34.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.075+0000 7f3a17000640 1 -- 172.21.15.99:0/2775142064 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a10004e00 con 0x560af3cf6330 2024-02-21T23:05:34.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.076+0000 7f3a30252740 1 -- 172.21.15.99:0/2775142064 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560af3cf6330 msgr2=0x560af3cf67b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:34.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.076+0000 7f3a30252740 1 --2- 172.21.15.99:0/2775142064 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560af3cf6330 0x560af3cf67b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f3a10096a50 tx=0x7f3a10096ac0 comp rx=0 tx=0).stop 2024-02-21T23:05:34.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.076+0000 7f3a30252740 1 -- 172.21.15.99:0/2775142064 shutdown_connections 2024-02-21T23:05:34.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.076+0000 7f3a30252740 1 --2- 172.21.15.99:0/2775142064 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560af3cf6cf0 0x560af3cf7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:34.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.076+0000 7f3a30252740 1 --2- 172.21.15.99:0/2775142064 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560af3cf6330 0x560af3cf67b0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:34.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.076+0000 7f3a30252740 1 --2- 172.21.15.99:0/2775142064 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560af3cbb660 0x560af3cbba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:34.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.076+0000 7f3a30252740 1 -- 172.21.15.99:0/2775142064 >> 172.21.15.99:0/2775142064 conn(0x560af3c7d6d0 msgr2=0x560af3c7e750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:05:34.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.076+0000 7f3a30252740 1 -- 172.21.15.99:0/2775142064 shutdown_connections 2024-02-21T23:05:34.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.076+0000 7f3a30252740 1 -- 172.21.15.99:0/2775142064 wait complete. 2024-02-21T23:05:34.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.077+0000 7f3a30252740 1 -- start start 2024-02-21T23:05:34.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.078+0000 7f3a30252740 1 Processor -- start 2024-02-21T23:05:34.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.080+0000 7f3a30252740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560af3cf6330 0x560af3cb5980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:34.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.080+0000 7f3a30252740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560af3cf6cf0 0x560af3cffcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:34.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.080+0000 7f3a30252740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560af3cc2320 0x560af3ceb860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:34.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.080+0000 7f3a30252740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x560af3cf50a0 con 0x560af3cf6330 2024-02-21T23:05:34.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.080+0000 7f3a30252740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x560af3b82380 con 0x560af3cc2320 2024-02-21T23:05:34.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.080+0000 7f3a30252740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x560af3cf4dc0 con 0x560af3cf6cf0 2024-02-21T23:05:34.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.080+0000 7f3a30252740 10 client.0 _ll_register_callbacks cb 0x560af3bdb280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:05:34.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.080+0000 7f3a26800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560af3cf6330 0x560af3cb5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:34.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.080+0000 7f3a26800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560af3cf6330 0x560af3cb5980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54320/0 (socket says 172.21.15.99:54320) 2024-02-21T23:05:34.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.080+0000 7f3a26800640 1 -- 172.21.15.99:0/1291598487 learned_addr learned my addr 172.21.15.99:0/1291598487 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:05:34.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.080+0000 7f3a1de00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560af3cf6cf0 0x560af3cffcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:34.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.081+0000 7f3a27200640 1 --2- 172.21.15.99:0/1291598487 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560af3cc2320 0x560af3ceb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:34.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.081+0000 7f3a1de00640 1 -- 172.21.15.99:0/1291598487 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560af3cc2320 msgr2=0x560af3ceb860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:05:34.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.081+0000 7f3a1de00640 1 --2- 172.21.15.99:0/1291598487 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560af3cc2320 0x560af3ceb860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:34.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.081+0000 7f3a1de00640 1 -- 172.21.15.99:0/1291598487 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560af3cf6330 msgr2=0x560af3cb5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:05:34.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.081+0000 7f3a1de00640 1 --2- 172.21.15.99:0/1291598487 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560af3cf6330 0x560af3cb5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:34.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.081+0000 7f3a1de00640 1 -- 172.21.15.99:0/1291598487 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560af3baac20 con 0x560af3cf6cf0 2024-02-21T23:05:34.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.081+0000 7f3a27200640 1 --2- 172.21.15.99:0/1291598487 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560af3cc2320 0x560af3ceb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:05:34.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.081+0000 7f3a26800640 1 --2- 172.21.15.99:0/1291598487 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560af3cf6330 0x560af3cb5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:05:34.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.081+0000 7f3a1de00640 1 --2- 172.21.15.99:0/1291598487 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560af3cf6cf0 0x560af3cffcb0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f3a100c6d50 tx=0x7f3a100c9040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=935c2d3b43cce866 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:05:34.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.081+0000 7f3a0b400640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-02-21T23:05:34.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.082+0000 7f3a0b400640 1 -- 172.21.15.99:0/1291598487 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a100b3030 con 0x560af3cf6cf0 2024-02-21T23:05:34.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.082+0000 7f3a30252740 1 -- 172.21.15.99:0/1291598487 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3a100930a0 con 0x560af3cf6cf0 2024-02-21T23:05:34.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.082+0000 7f3a0b400640 1 -- 172.21.15.99:0/1291598487 <== mon.2 v2:172.21.15.181:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f3a10092780 con 0x560af3cf6cf0 2024-02-21T23:05:34.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.082+0000 7f3a0b400640 1 -- 172.21.15.99:0/1291598487 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3a1009f1b0 con 0x560af3cf6cf0 2024-02-21T23:05:34.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.082+0000 7f3a30252740 10 client.5906 fetch_fsmap learned FSMap version 16 2024-02-21T23:05:34.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.082+0000 7f3a30252740 1 -- 172.21.15.99:0/1291598487 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x560af38f83f0 con 0x560af3cf6cf0 2024-02-21T23:05:34.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.082+0000 7f3a0b400640 1 -- 172.21.15.99:0/1291598487 <== mon.2 v2:172.21.15.181:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a100930a0 con 0x560af3cf6cf0 2024-02-21T23:05:34.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.082+0000 7f3a0b400640 1 -- 172.21.15.99:0/1291598487 <== mon.2 v2:172.21.15.181:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f3a10092980 con 0x560af3cf6cf0 2024-02-21T23:05:34.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.082+0000 7f3a30252740 10 client.5906 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T23:05:34.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.082+0000 7f3a30252740 10 client.5906 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:05:34.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.082+0000 7f3a30252740 20 client.5906 populate_metadata read hostname 'smithi099' 2024-02-21T23:05:34.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.082+0000 7f3a30252740 1 --2- 172.21.15.99:0/1291598487 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x560af3cbfcf0 0x560af3d03220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:34.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.082+0000 7f3a30252740 4 client.5906 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:05:34.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.082+0000 7f3a30252740 1 -- 172.21.15.99:0/1291598487 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560af3bf1090 con 0x560af3cbfcf0 2024-02-21T23:05:34.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.083+0000 7f3a26800640 1 --2- 172.21.15.99:0/1291598487 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x560af3cbfcf0 0x560af3d03220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:34.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.084+0000 7f3a26800640 1 --2- 172.21.15.99:0/1291598487 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x560af3cbfcf0 0x560af3d03220 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=27a7f0a1e6af20ce server_cookie=dbbee3e333cebc28 in_seq=0 out_seq=0 2024-02-21T23:05:34.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.084+0000 7f3a0b400640 10 client.5906 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:05:34.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.085+0000 7f3a0b400640 1 -- 172.21.15.99:0/1291598487 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x560af3bf1090 con 0x560af3cbfcf0 2024-02-21T23:05:34.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.085+0000 7f3a0b400640 10 client.5906 handle_command_reply: tid=0 2024-02-21T23:05:34.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.085+0000 7f3a30252740 1 client.5906 shutdown 2024-02-21T23:05:34.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.085+0000 7f3a30252740 1 -- 172.21.15.99:0/1291598487 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560af3cf6cf0 msgr2=0x560af3cffcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:34.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.085+0000 7f3a30252740 1 --2- 172.21.15.99:0/1291598487 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560af3cf6cf0 0x560af3cffcb0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f3a100c6d50 tx=0x7f3a100c9040 comp rx=0 tx=0).stop 2024-02-21T23:05:34.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.085+0000 7f3a30252740 1 -- 172.21.15.99:0/1291598487 shutdown_connections 2024-02-21T23:05:34.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.085+0000 7f3a30252740 1 --2- 172.21.15.99:0/1291598487 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x560af3cbfcf0 0x560af3d03220 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:34.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.085+0000 7f3a30252740 1 --2- 172.21.15.99:0/1291598487 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560af3cc2320 0x560af3ceb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:34.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.085+0000 7f3a30252740 1 --2- 172.21.15.99:0/1291598487 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560af3cf6cf0 0x560af3cffcb0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:34.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.085+0000 7f3a30252740 1 --2- 172.21.15.99:0/1291598487 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560af3cf6330 0x560af3cb5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:34.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.085+0000 7f3a30252740 1 -- 172.21.15.99:0/1291598487 >> 172.21.15.99:0/1291598487 conn(0x560af3cbb660 msgr2=0x560af3cf57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:05:34.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.085+0000 7f3a0b400640 0 client.5906 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:05:34.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.086+0000 7f3a30252740 1 -- 172.21.15.99:0/1291598487 shutdown_connections 2024-02-21T23:05:34.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.086+0000 7f3a30252740 1 -- 172.21.15.99:0/1291598487 wait complete. 2024-02-21T23:05:34.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.086+0000 7f3a30252740 20 client.5906 trim_cache size 0 max 16384 2024-02-21T23:05:34.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.108+0000 7f3a30252740 1 Processor -- start 2024-02-21T23:05:34.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.108+0000 7f3a30252740 1 -- start start 2024-02-21T23:05:34.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.110+0000 7f3a30252740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560af3cc2320 0x560af3cc6320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:34.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.110+0000 7f3a30252740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560af3cf6330 0x560af3cc2f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:34.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.110+0000 7f3a30252740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560af3cf6cf0 0x560af3cc0160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:34.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.110+0000 7f3a30252740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2822c740 con 0x560af3cf6cf0 2024-02-21T23:05:34.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.110+0000 7f3a30252740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2822a2e0 con 0x560af3cc2320 2024-02-21T23:05:34.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.110+0000 7f3a30252740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a280fb310 con 0x560af3cf6330 2024-02-21T23:05:34.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.110+0000 7f3a1de00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560af3cf6330 0x560af3cc2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:34.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.110+0000 7f3a27200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560af3cf6cf0 0x560af3cc0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:34.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.110+0000 7f3a26800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560af3cc2320 0x560af3cc6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:34.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.110+0000 7f3a1de00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560af3cf6330 0x560af3cc2f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:34696/0 (socket says 172.21.15.99:34696) 2024-02-21T23:05:34.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.110+0000 7f3a1de00640 1 -- 172.21.15.99:0/248688347 learned_addr learned my addr 172.21.15.99:0/248688347 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:05:34.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.111+0000 7f3a1de00640 1 -- 172.21.15.99:0/248688347 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560af3cc2320 msgr2=0x560af3cc6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:05:34.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.111+0000 7f3a1de00640 1 --2- 172.21.15.99:0/248688347 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560af3cc2320 0x560af3cc6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:34.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.111+0000 7f3a1de00640 1 -- 172.21.15.99:0/248688347 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560af3cf6cf0 msgr2=0x560af3cc0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:05:34.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.111+0000 7f3a1de00640 1 --2- 172.21.15.99:0/248688347 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560af3cf6cf0 0x560af3cc0160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:34.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.111+0000 7f3a1de00640 1 -- 172.21.15.99:0/248688347 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560af39c27d0 con 0x560af3cf6330 2024-02-21T23:05:34.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.111+0000 7f3a1de00640 1 --2- 172.21.15.99:0/248688347 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560af3cf6330 0x560af3cc2f40 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f3a10096a50 tx=0x7f3a100ac050 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2490d47eaed7979 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:05:34.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.111+0000 7f3a16600640 1 -- 172.21.15.99:0/248688347 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a100b3020 con 0x560af3cf6330 2024-02-21T23:05:34.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.111+0000 7f3a16600640 1 -- 172.21.15.99:0/248688347 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a100814e0 con 0x560af3cf6330 2024-02-21T23:05:34.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.111+0000 7f3a16600640 1 -- 172.21.15.99:0/248688347 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a10096890 con 0x560af3cf6330 2024-02-21T23:05:34.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.112+0000 7f3a30252740 1 -- 172.21.15.99:0/248688347 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560af3cf6330 msgr2=0x560af3cc2f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:34.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.112+0000 7f3a30252740 1 --2- 172.21.15.99:0/248688347 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560af3cf6330 0x560af3cc2f40 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f3a10096a50 tx=0x7f3a100ac050 comp rx=0 tx=0).stop 2024-02-21T23:05:34.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.112+0000 7f3a30252740 1 -- 172.21.15.99:0/248688347 shutdown_connections 2024-02-21T23:05:34.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.112+0000 7f3a30252740 1 --2- 172.21.15.99:0/248688347 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560af3cf6cf0 0x560af3cc0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:34.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.112+0000 7f3a30252740 1 --2- 172.21.15.99:0/248688347 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560af3cf6330 0x560af3cc2f40 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:34.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.112+0000 7f3a30252740 1 --2- 172.21.15.99:0/248688347 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560af3cc2320 0x560af3cc6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:34.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.112+0000 7f3a30252740 1 -- 172.21.15.99:0/248688347 >> 172.21.15.99:0/248688347 conn(0x560af3cbb660 msgr2=0x560af3cc2700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:05:34.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.112+0000 7f3a30252740 1 -- 172.21.15.99:0/248688347 shutdown_connections 2024-02-21T23:05:34.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.112+0000 7f3a30252740 1 -- 172.21.15.99:0/248688347 wait complete. 2024-02-21T23:05:34.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.113+0000 7f3a30252740 1 -- start start 2024-02-21T23:05:34.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.113+0000 7f3a30252740 1 Processor -- start 2024-02-21T23:05:34.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.114+0000 7f3a30252740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560af3cc2320 0x560af3cef350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:34.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.114+0000 7f3a30252740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560af3cf6330 0x560af3cee940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:34.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.114+0000 7f3a30252740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560af3cf6cf0 0x560af3c85c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:34.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.114+0000 7f3a30252740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a280fb910 con 0x560af3cc2320 2024-02-21T23:05:34.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.114+0000 7f3a30252740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a28229c80 con 0x560af3cf6330 2024-02-21T23:05:34.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.114+0000 7f3a30252740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a28229060 con 0x560af3cf6cf0 2024-02-21T23:05:34.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.114+0000 7f3a30252740 10 client.0 _ll_register_callbacks cb 0x7f3a20017040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:05:34.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.115+0000 7f3a26800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560af3cc2320 0x560af3cef350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:34.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.115+0000 7f3a26800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560af3cc2320 0x560af3cef350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54336/0 (socket says 172.21.15.99:54336) 2024-02-21T23:05:34.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.115+0000 7f3a26800640 1 -- 172.21.15.99:0/1729754933 learned_addr learned my addr 172.21.15.99:0/1729754933 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:05:34.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.115+0000 7f3a1de00640 1 --2- 172.21.15.99:0/1729754933 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560af3cf6330 0x560af3cee940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:34.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.115+0000 7f3a27200640 1 --2- 172.21.15.99:0/1729754933 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560af3cf6cf0 0x560af3c85c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:34.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.115+0000 7f3a26800640 1 -- 172.21.15.99:0/1729754933 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560af3cf6cf0 msgr2=0x560af3c85c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:05:34.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.115+0000 7f3a26800640 1 --2- 172.21.15.99:0/1729754933 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560af3cf6cf0 0x560af3c85c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:34.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.115+0000 7f3a26800640 1 -- 172.21.15.99:0/1729754933 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560af3cf6330 msgr2=0x560af3cee940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:05:34.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.115+0000 7f3a26800640 1 --2- 172.21.15.99:0/1729754933 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560af3cf6330 0x560af3cee940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:34.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.115+0000 7f3a26800640 1 -- 172.21.15.99:0/1729754933 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560af3ceee80 con 0x560af3cc2320 2024-02-21T23:05:34.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.115+0000 7f3a1de00640 1 --2- 172.21.15.99:0/1729754933 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560af3cf6330 0x560af3cee940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:05:34.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.115+0000 7f3a26800640 1 --2- 172.21.15.99:0/1729754933 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560af3cc2320 0x560af3cef350 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f3a18009eb0 tx=0x7f3a18004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2cef3051630930c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:05:34.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.115+0000 7f3a0b400640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:05:34.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.116+0000 7f3a0b400640 1 -- 172.21.15.99:0/1729754933 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a18039040 con 0x560af3cc2320 2024-02-21T23:05:34.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.116+0000 7f3a0b400640 1 -- 172.21.15.99:0/1729754933 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f3a18034de0 con 0x560af3cc2320 2024-02-21T23:05:34.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.116+0000 7f3a30252740 1 -- 172.21.15.99:0/1729754933 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3a100814e0 con 0x560af3cc2320 2024-02-21T23:05:34.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.116+0000 7f3a0b400640 1 -- 172.21.15.99:0/1729754933 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3a1805a050 con 0x560af3cc2320 2024-02-21T23:05:34.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.116+0000 7f3a30252740 10 client.5781 fetch_fsmap learned FSMap version 16 2024-02-21T23:05:34.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.116+0000 7f3a30252740 1 -- 172.21.15.99:0/1729754933 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x560af3cf5e50 con 0x560af3cc2320 2024-02-21T23:05:34.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.116+0000 7f3a0b400640 1 -- 172.21.15.99:0/1729754933 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a100814e0 con 0x560af3cc2320 2024-02-21T23:05:34.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.117+0000 7f3a0b400640 1 -- 172.21.15.99:0/1729754933 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f3a1804b590 con 0x560af3cc2320 2024-02-21T23:05:34.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.117+0000 7f3a30252740 10 client.5781 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T23:05:34.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.117+0000 7f3a30252740 10 client.5781 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:05:34.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.117+0000 7f3a30252740 20 client.5781 populate_metadata read hostname 'smithi099' 2024-02-21T23:05:34.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.117+0000 7f3a30252740 1 --2- 172.21.15.99:0/1729754933 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x560af3cfd400 0x560af3d546b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:34.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.117+0000 7f3a30252740 4 client.5781 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T23:05:34.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.117+0000 7f3a30252740 1 -- 172.21.15.99:0/1729754933 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x560af3beb3e0 con 0x560af3cfd400 2024-02-21T23:05:34.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.117+0000 7f3a1de00640 1 --2- 172.21.15.99:0/1729754933 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x560af3cfd400 0x560af3d546b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:34.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.118+0000 7f3a1de00640 1 --2- 172.21.15.99:0/1729754933 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x560af3cfd400 0x560af3d546b0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=49c10aef9a6709fb server_cookie=72d64aacda2a1cc in_seq=0 out_seq=0 2024-02-21T23:05:34.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.118+0000 7f3a0b400640 10 client.5781 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:05:34.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.118+0000 7f3a0b400640 1 -- 172.21.15.99:0/1729754933 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x560af3beb3e0 con 0x560af3cfd400 2024-02-21T23:05:34.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.118+0000 7f3a0b400640 10 client.5781 handle_command_reply: tid=0 2024-02-21T23:05:34.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.118+0000 7f3a30252740 1 client.5781 shutdown 2024-02-21T23:05:34.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.118+0000 7f3a30252740 1 -- 172.21.15.99:0/1729754933 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560af3cc2320 msgr2=0x560af3cef350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:34.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.118+0000 7f3a30252740 1 --2- 172.21.15.99:0/1729754933 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560af3cc2320 0x560af3cef350 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f3a18009eb0 tx=0x7f3a18004ab0 comp rx=0 tx=0).stop 2024-02-21T23:05:34.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.118+0000 7f3a30252740 1 -- 172.21.15.99:0/1729754933 shutdown_connections 2024-02-21T23:05:34.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.118+0000 7f3a30252740 1 --2- 172.21.15.99:0/1729754933 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x560af3cfd400 0x560af3d546b0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:34.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.119+0000 7f3a30252740 1 --2- 172.21.15.99:0/1729754933 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560af3cf6cf0 0x560af3c85c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:34.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.119+0000 7f3a30252740 1 --2- 172.21.15.99:0/1729754933 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560af3cf6330 0x560af3cee940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:34.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.119+0000 7f3a30252740 1 --2- 172.21.15.99:0/1729754933 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560af3cc2320 0x560af3cef350 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:34.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.119+0000 7f3a30252740 1 -- 172.21.15.99:0/1729754933 >> 172.21.15.99:0/1729754933 conn(0x560af3cbb660 msgr2=0x560af3d025a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:05:34.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.119+0000 7f3a0b400640 0 client.5781 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:05:34.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.119+0000 7f3a30252740 1 -- 172.21.15.99:0/1729754933 shutdown_connections 2024-02-21T23:05:34.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.119+0000 7f3a30252740 1 -- 172.21.15.99:0/1729754933 wait complete. 2024-02-21T23:05:34.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.119+0000 7f3a30252740 20 client.5781 trim_cache size 0 max 16384 2024-02-21T23:05:34.114 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-02-21T23:05:34.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.120+0000 7f3a2ca00640 1 -- 172.21.15.99:0/3501634108 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f3a0409eed0 msgr2=0x7f3a040a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:34.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.120+0000 7f3a2ca00640 1 --2- 172.21.15.99:0/3501634108 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f3a0409eed0 0x7f3a040a1390 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3a20000f60 tx=0x7f3a20009040 comp rx=0 tx=0).stop 2024-02-21T23:05:34.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.120+0000 7f3a2ca00640 1 -- 172.21.15.99:0/3501634108 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3a2818b060 msgr2=0x7f3a28175590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:34.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.120+0000 7f3a2ca00640 1 --2- 172.21.15.99:0/3501634108 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3a2818b060 0x7f3a28175590 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f3a1000c4d0 tx=0x7f3a1000c990 comp rx=0 tx=0).stop 2024-02-21T23:05:34.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.120+0000 7f3a2ca00640 1 -- 172.21.15.99:0/3501634108 shutdown_connections 2024-02-21T23:05:34.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.120+0000 7f3a2ca00640 1 --2- 172.21.15.99:0/3501634108 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f3a0409eed0 0x7f3a040a1390 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:34.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.120+0000 7f3a2ca00640 1 --2- 172.21.15.99:0/3501634108 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a2818b4f0 0x7f3a28220ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:34.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.120+0000 7f3a2ca00640 1 --2- 172.21.15.99:0/3501634108 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3a2818b060 0x7f3a28175590 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:34.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.120+0000 7f3a2ca00640 1 --2- 172.21.15.99:0/3501634108 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3a2817f490 0x7f3a280f8c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:34.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.120+0000 7f3a2ca00640 1 -- 172.21.15.99:0/3501634108 >> 172.21.15.99:0/3501634108 conn(0x7f3a280d29b0 msgr2=0x7f3a280d2e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:05:34.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.120+0000 7f3a2ca00640 1 -- 172.21.15.99:0/3501634108 shutdown_connections 2024-02-21T23:05:34.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:34.120+0000 7f3a2ca00640 1 -- 172.21.15.99:0/3501634108 wait complete. 2024-02-21T23:05:35.132 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-02-21T23:05:35.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T23:05:35.133 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-02-21T23:05:35.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.390+0000 7f3914400640 1 Processor -- start 2024-02-21T23:05:35.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.390+0000 7f3914400640 1 -- start start 2024-02-21T23:05:35.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.392+0000 7f3914400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f390c188eb0 0x7f390c189290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:35.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.392+0000 7f3914400640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f390c0f91d0 con 0x7f390c0f8720 2024-02-21T23:05:35.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.392+0000 7f3914400640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f390c0f8ef0 con 0x7f390c1897d0 2024-02-21T23:05:35.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.392+0000 7f3914400640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f390c1868d0 con 0x7f390c188eb0 2024-02-21T23:05:35.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.392+0000 7f3911a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f390c188eb0 0x7f390c189290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:35.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.392+0000 7f3912400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f390c0f8720 0x7f390c184700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:48438/0 (socket says 172.21.15.99:48438) 2024-02-21T23:05:35.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.393+0000 7f3912400640 1 -- 172.21.15.99:0/2049463560 learned_addr learned my addr 172.21.15.99:0/2049463560 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:05:35.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.393+0000 7f390be00640 1 -- 172.21.15.99:0/2049463560 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3138681784 0 0) 0x7f390c0f91d0 con 0x7f390c0f8720 2024-02-21T23:05:35.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.393+0000 7f3911a00640 1 -- 172.21.15.99:0/2049463560 >> v1:172.21.15.181:6789/0 conn(0x7f390c1897d0 legacy=0x7f390c0f8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:35.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.393+0000 7f3911a00640 1 -- 172.21.15.99:0/2049463560 >> v1:172.21.15.99:6789/0 conn(0x7f390c0f8720 legacy=0x7f390c184700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:35.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.393+0000 7f3911a00640 1 -- 172.21.15.99:0/2049463560 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f390c183940 con 0x7f390c188eb0 2024-02-21T23:05:35.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.395+0000 7f3911a00640 1 --2- 172.21.15.99:0/2049463560 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f390c188eb0 0x7f390c189290 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f3900009720 tx=0x7f390002b6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14708c82006f7a32 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:05:35.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.395+0000 7f390be00640 1 -- 172.21.15.99:0/2049463560 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3900037070 con 0x7f390c188eb0 2024-02-21T23:05:35.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.395+0000 7f390be00640 1 -- 172.21.15.99:0/2049463560 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3900030710 con 0x7f390c188eb0 2024-02-21T23:05:35.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.395+0000 7f390be00640 1 -- 172.21.15.99:0/2049463560 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3900030ae0 con 0x7f390c188eb0 2024-02-21T23:05:35.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.396+0000 7f3914400640 1 -- 172.21.15.99:0/2049463560 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f390c188eb0 msgr2=0x7f390c189290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:35.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.396+0000 7f3914400640 1 --2- 172.21.15.99:0/2049463560 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f390c188eb0 0x7f390c189290 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f3900009720 tx=0x7f390002b6a0 comp rx=0 tx=0).stop 2024-02-21T23:05:35.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.396+0000 7f3914400640 1 -- 172.21.15.99:0/2049463560 shutdown_connections 2024-02-21T23:05:35.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.396+0000 7f3914400640 1 --2- 172.21.15.99:0/2049463560 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f390c188eb0 0x7f390c189290 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:35.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.396+0000 7f3914400640 1 -- 172.21.15.99:0/2049463560 >> 172.21.15.99:0/2049463560 conn(0x7f390c0ce5e0 msgr2=0x7f390c0ce9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:05:35.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.396+0000 7f3914400640 1 -- 172.21.15.99:0/2049463560 shutdown_connections 2024-02-21T23:05:35.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.396+0000 7f3914400640 1 -- 172.21.15.99:0/2049463560 wait complete. 2024-02-21T23:05:35.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.400+0000 7f3914400640 1 Processor -- start 2024-02-21T23:05:35.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.400+0000 7f3914400640 1 -- start start 2024-02-21T23:05:35.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.402+0000 7f3914400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f390c0f8720 0x7f390c1635f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:35.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.402+0000 7f3914400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f390c188eb0 0x7f390c220650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:35.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.402+0000 7f3914400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f390c1897d0 0x7f390c21d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:35.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.402+0000 7f3914400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f390c0f8bb0 con 0x7f390c1897d0 2024-02-21T23:05:35.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.402+0000 7f3914400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f390c183f00 con 0x7f390c188eb0 2024-02-21T23:05:35.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.402+0000 7f3914400640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f390c189c30 con 0x7f390c0f8720 2024-02-21T23:05:35.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.402+0000 7f3911a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f390c0f8720 0x7f390c1635f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:35.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.402+0000 7f3911000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f390c188eb0 0x7f390c220650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:35.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.402+0000 7f3912400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f390c1897d0 0x7f390c21d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:35.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.402+0000 7f3911a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f390c0f8720 0x7f390c1635f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:34704/0 (socket says 172.21.15.99:34704) 2024-02-21T23:05:35.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.402+0000 7f3911a00640 1 -- 172.21.15.99:0/529784176 learned_addr learned my addr 172.21.15.99:0/529784176 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:05:35.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.403+0000 7f3911a00640 1 -- 172.21.15.99:0/529784176 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f390c188eb0 msgr2=0x7f390c220650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:35.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.403+0000 7f3911a00640 1 --2- 172.21.15.99:0/529784176 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f390c188eb0 0x7f390c220650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:35.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.403+0000 7f3911a00640 1 -- 172.21.15.99:0/529784176 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f390c1897d0 msgr2=0x7f390c21d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:35.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.403+0000 7f3911a00640 1 --2- 172.21.15.99:0/529784176 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f390c1897d0 0x7f390c21d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:35.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.403+0000 7f3911a00640 1 -- 172.21.15.99:0/529784176 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f390c220f50 con 0x7f390c0f8720 2024-02-21T23:05:35.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.403+0000 7f3911a00640 1 --2- 172.21.15.99:0/529784176 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f390c0f8720 0x7f390c1635f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f3900009720 tx=0x7f39000046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:05:35.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.403+0000 7f3909600640 1 -- 172.21.15.99:0/529784176 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3900037040 con 0x7f390c0f8720 2024-02-21T23:05:35.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.404+0000 7f3909600640 1 -- 172.21.15.99:0/529784176 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3900004030 con 0x7f390c0f8720 2024-02-21T23:05:35.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.404+0000 7f3909600640 1 -- 172.21.15.99:0/529784176 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3900004440 con 0x7f390c0f8720 2024-02-21T23:05:35.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.404+0000 7f3914400640 1 -- 172.21.15.99:0/529784176 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f390c221230 con 0x7f390c0f8720 2024-02-21T23:05:35.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.404+0000 7f3914400640 1 -- 172.21.15.99:0/529784176 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f390c2217f0 con 0x7f390c0f8720 2024-02-21T23:05:35.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.409+0000 7f3909600640 1 -- 172.21.15.99:0/529784176 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f39000327b0 con 0x7f390c0f8720 2024-02-21T23:05:35.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.409+0000 7f39173d5740 1 Processor -- start 2024-02-21T23:05:35.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.409+0000 7f39173d5740 1 -- start start 2024-02-21T23:05:35.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.410+0000 7f39173d5740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eb634752f0 0x55eb634756d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:35.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.410+0000 7f39173d5740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55eb63475c10 0x55eb634b0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:35.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.411+0000 7f39173d5740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eb634b09c0 0x55eb634b1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:35.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.411+0000 7f39173d5740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb6339d790 con 0x55eb63475c10 2024-02-21T23:05:35.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.411+0000 7f39173d5740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb63346bf0 con 0x55eb634752f0 2024-02-21T23:05:35.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.411+0000 7f39173d5740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb63399830 con 0x55eb634b09c0 2024-02-21T23:05:35.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.411+0000 7f3911a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55eb63475c10 0x55eb634b0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:35.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.411+0000 7f3912400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eb634752f0 0x55eb634756d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:35.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.411+0000 7f3912400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eb634752f0 0x55eb634756d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:33368/0 (socket says 172.21.15.99:33368) 2024-02-21T23:05:35.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.411+0000 7f3912400640 1 -- 172.21.15.99:0/3172464941 learned_addr learned my addr 172.21.15.99:0/3172464941 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:05:35.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.411+0000 7f3911000640 1 --2- 172.21.15.99:0/3172464941 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eb634b09c0 0x55eb634b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:35.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.411+0000 7f3909600640 1 --2- 172.21.15.99:0/529784176 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f38ec09ef00 0x7f38ec0a13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:35.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.412+0000 7f3911a00640 1 -- 172.21.15.99:0/3172464941 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eb634b09c0 msgr2=0x55eb634b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:05:35.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.412+0000 7f3911a00640 1 --2- 172.21.15.99:0/3172464941 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eb634b09c0 0x55eb634b1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:35.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.412+0000 7f3911a00640 1 -- 172.21.15.99:0/3172464941 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eb634752f0 msgr2=0x55eb634756d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:05:35.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.412+0000 7f3911a00640 1 --2- 172.21.15.99:0/3172464941 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eb634752f0 0x55eb634756d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:35.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.412+0000 7f3911a00640 1 -- 172.21.15.99:0/3172464941 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eb63364c40 con 0x55eb63475c10 2024-02-21T23:05:35.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.412+0000 7f3912400640 1 --2- 172.21.15.99:0/3172464941 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eb634752f0 0x55eb634756d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:05:35.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.412+0000 7f3909600640 1 -- 172.21.15.99:0/529784176 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f39000ec390 con 0x7f390c0f8720 2024-02-21T23:05:35.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.412+0000 7f3912400640 1 --2- 172.21.15.99:0/529784176 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f38ec09ef00 0x7f38ec0a13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:35.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.412+0000 7f3911a00640 1 --2- 172.21.15.99:0/3172464941 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55eb63475c10 0x55eb634b0480 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f39000e99a0 tx=0x7f3900048000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4802af43b0778479 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:05:35.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.413+0000 7f38fe000640 1 -- 172.21.15.99:0/3172464941 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39000b9950 con 0x55eb63475c10 2024-02-21T23:05:35.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.413+0000 7f38fe000640 1 -- 172.21.15.99:0/3172464941 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39000093c0 con 0x55eb63475c10 2024-02-21T23:05:35.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.413+0000 7f38fe000640 1 -- 172.21.15.99:0/3172464941 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39000b7cc0 con 0x55eb63475c10 2024-02-21T23:05:35.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.413+0000 7f39173d5740 1 -- 172.21.15.99:0/3172464941 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55eb63475c10 msgr2=0x55eb634b0480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:35.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.413+0000 7f39173d5740 1 --2- 172.21.15.99:0/3172464941 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55eb63475c10 0x55eb634b0480 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f39000e99a0 tx=0x7f3900048000 comp rx=0 tx=0).stop 2024-02-21T23:05:35.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.413+0000 7f3912400640 1 --2- 172.21.15.99:0/529784176 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f38ec09ef00 0x7f38ec0a13c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x55eb63437640 tx=0x7f3904001680 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:05:35.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.414+0000 7f39173d5740 1 -- 172.21.15.99:0/3172464941 shutdown_connections 2024-02-21T23:05:35.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.414+0000 7f39173d5740 1 --2- 172.21.15.99:0/3172464941 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eb634b09c0 0x55eb634b1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:35.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.414+0000 7f39173d5740 1 --2- 172.21.15.99:0/3172464941 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55eb63475c10 0x55eb634b0480 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:35.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.414+0000 7f39173d5740 1 --2- 172.21.15.99:0/3172464941 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eb634752f0 0x55eb634756d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:35.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.414+0000 7f39173d5740 1 -- 172.21.15.99:0/3172464941 >> 172.21.15.99:0/3172464941 conn(0x55eb634378c0 msgr2=0x55eb63438940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:05:35.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.414+0000 7f39173d5740 1 -- 172.21.15.99:0/3172464941 shutdown_connections 2024-02-21T23:05:35.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.414+0000 7f39173d5740 1 -- 172.21.15.99:0/3172464941 wait complete. 2024-02-21T23:05:35.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.415+0000 7f39173d5740 1 -- start start 2024-02-21T23:05:35.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.415+0000 7f39173d5740 1 Processor -- start 2024-02-21T23:05:35.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.416+0000 7f39173d5740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eb63475c10 0x55eb63464d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:35.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.416+0000 7f39173d5740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55eb634b09c0 0x55eb634af780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:35.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.416+0000 7f39173d5740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eb63433ff0 0x55eb63432f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:35.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.416+0000 7f39173d5740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb6339d790 con 0x55eb634b09c0 2024-02-21T23:05:35.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.416+0000 7f39173d5740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb6333c1d0 con 0x55eb63433ff0 2024-02-21T23:05:35.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.416+0000 7f39173d5740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb634aeea0 con 0x55eb63475c10 2024-02-21T23:05:35.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.417+0000 7f39173d5740 10 client.0 _ll_register_callbacks cb 0x55eb630b1c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:05:35.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.417+0000 7f3911a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eb63475c10 0x55eb63464d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:35.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.417+0000 7f3911000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55eb634b09c0 0x55eb634af780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:35.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.417+0000 7f3911a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eb63475c10 0x55eb63464d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:34720/0 (socket says 172.21.15.99:34720) 2024-02-21T23:05:35.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.417+0000 7f3911a00640 1 -- 172.21.15.99:0/1304628161 learned_addr learned my addr 172.21.15.99:0/1304628161 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:05:35.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.417+0000 7f3912400640 1 --2- 172.21.15.99:0/1304628161 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eb63433ff0 0x55eb63432f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:35.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.418+0000 7f3912400640 1 -- 172.21.15.99:0/1304628161 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eb63475c10 msgr2=0x55eb63464d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:05:35.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.418+0000 7f3912400640 1 --2- 172.21.15.99:0/1304628161 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eb63475c10 0x55eb63464d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:35.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.418+0000 7f3912400640 1 -- 172.21.15.99:0/1304628161 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55eb634b09c0 msgr2=0x55eb634af780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:05:35.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.418+0000 7f3912400640 1 --2- 172.21.15.99:0/1304628161 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55eb634b09c0 0x55eb634af780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:35.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.418+0000 7f3912400640 1 -- 172.21.15.99:0/1304628161 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55eb6317a7e0 con 0x55eb63433ff0 2024-02-21T23:05:35.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.418+0000 7f3912400640 1 --2- 172.21.15.99:0/1304628161 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eb63433ff0 0x55eb63432f90 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f3904015e40 tx=0x7f3904001400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14096aea9c6f3d7d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:05:35.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.418+0000 7f38f2a00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-02-21T23:05:35.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.418+0000 7f38f2a00640 1 -- 172.21.15.99:0/1304628161 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3904028060 con 0x55eb63433ff0 2024-02-21T23:05:35.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.418+0000 7f39173d5740 1 -- 172.21.15.99:0/1304628161 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f39000093c0 con 0x55eb63433ff0 2024-02-21T23:05:35.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.418+0000 7f38f2a00640 1 -- 172.21.15.99:0/1304628161 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f39040148a0 con 0x55eb63433ff0 2024-02-21T23:05:35.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.419+0000 7f38f2a00640 1 -- 172.21.15.99:0/1304628161 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f390402f050 con 0x55eb63433ff0 2024-02-21T23:05:35.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.419+0000 7f39173d5740 10 client.5920 fetch_fsmap learned FSMap version 16 2024-02-21T23:05:35.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.419+0000 7f39173d5740 1 -- 172.21.15.99:0/1304628161 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55eb631daf70 con 0x55eb63433ff0 2024-02-21T23:05:35.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.419+0000 7f38f2a00640 1 -- 172.21.15.99:0/1304628161 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39000093c0 con 0x55eb63433ff0 2024-02-21T23:05:35.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.419+0000 7f38f2a00640 1 -- 172.21.15.99:0/1304628161 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f3904014aa0 con 0x55eb63433ff0 2024-02-21T23:05:35.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.419+0000 7f39173d5740 10 client.5920 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T23:05:35.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.419+0000 7f39173d5740 10 client.5920 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:05:35.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.419+0000 7f39173d5740 20 client.5920 populate_metadata read hostname 'smithi099' 2024-02-21T23:05:35.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.419+0000 7f39173d5740 1 --2- 172.21.15.99:0/1304628161 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55eb634334d0 0x55eb634654b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:35.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.419+0000 7f39173d5740 4 client.5920 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:05:35.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.419+0000 7f39173d5740 1 -- 172.21.15.99:0/1304628161 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55eb633aacd0 con 0x55eb634334d0 2024-02-21T23:05:35.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.420+0000 7f3911a00640 1 --2- 172.21.15.99:0/1304628161 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55eb634334d0 0x55eb634654b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:35.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.420+0000 7f38f2a00640 10 client.5920 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:05:35.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.420+0000 7f3911a00640 1 --2- 172.21.15.99:0/1304628161 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55eb634334d0 0x55eb634654b0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90bf8ed3dd78254d server_cookie=b0c69105359e3cf6 in_seq=0 out_seq=0 2024-02-21T23:05:35.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.421+0000 7f38f2a00640 1 -- 172.21.15.99:0/1304628161 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55eb633aacd0 con 0x55eb634334d0 2024-02-21T23:05:35.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.421+0000 7f38f2a00640 10 client.5920 handle_command_reply: tid=0 2024-02-21T23:05:35.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.421+0000 7f39173d5740 1 client.5920 shutdown 2024-02-21T23:05:35.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.422+0000 7f39173d5740 1 -- 172.21.15.99:0/1304628161 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eb63433ff0 msgr2=0x55eb63432f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:35.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.422+0000 7f39173d5740 1 --2- 172.21.15.99:0/1304628161 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eb63433ff0 0x55eb63432f90 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f3904015e40 tx=0x7f3904001400 comp rx=0 tx=0).stop 2024-02-21T23:05:35.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.422+0000 7f39173d5740 1 -- 172.21.15.99:0/1304628161 shutdown_connections 2024-02-21T23:05:35.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.422+0000 7f39173d5740 1 --2- 172.21.15.99:0/1304628161 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55eb634334d0 0x55eb634654b0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:35.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.422+0000 7f39173d5740 1 --2- 172.21.15.99:0/1304628161 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eb63433ff0 0x55eb63432f90 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:35.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.422+0000 7f39173d5740 1 --2- 172.21.15.99:0/1304628161 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55eb634b09c0 0x55eb634af780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:35.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.422+0000 7f39173d5740 1 --2- 172.21.15.99:0/1304628161 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eb63475c10 0x55eb63464d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:35.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.422+0000 7f39173d5740 1 -- 172.21.15.99:0/1304628161 >> 172.21.15.99:0/1304628161 conn(0x55eb634752f0 msgr2=0x55eb634b0e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:05:35.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.422+0000 7f38f2a00640 0 client.5920 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:05:35.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.422+0000 7f39173d5740 1 -- 172.21.15.99:0/1304628161 shutdown_connections 2024-02-21T23:05:35.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.422+0000 7f39173d5740 1 -- 172.21.15.99:0/1304628161 wait complete. 2024-02-21T23:05:35.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.422+0000 7f39173d5740 20 client.5920 trim_cache size 0 max 16384 2024-02-21T23:05:35.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.448+0000 7f39173d5740 1 Processor -- start 2024-02-21T23:05:35.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.448+0000 7f39173d5740 1 -- start start 2024-02-21T23:05:35.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.449+0000 7f39173d5740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55eb63433ff0 0x55eb63435da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:35.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.449+0000 7f39173d5740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eb63475c10 0x55eb63436f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:35.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.449+0000 7f39173d5740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eb634b09c0 0x55eb634af460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:35.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.449+0000 7f39173d5740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f390c22ca50 con 0x55eb63433ff0 2024-02-21T23:05:35.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.449+0000 7f39173d5740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f390c22a5f0 con 0x55eb63475c10 2024-02-21T23:05:35.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.449+0000 7f39173d5740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f390c16b6e0 con 0x55eb634b09c0 2024-02-21T23:05:35.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.450+0000 7f3911a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55eb63433ff0 0x55eb63435da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:35.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.450+0000 7f3911a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55eb63433ff0 0x55eb63435da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54378/0 (socket says 172.21.15.99:54378) 2024-02-21T23:05:35.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.450+0000 7f3911a00640 1 -- 172.21.15.99:0/3442499729 learned_addr learned my addr 172.21.15.99:0/3442499729 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:05:35.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.450+0000 7f3911000640 1 --2- 172.21.15.99:0/3442499729 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eb63475c10 0x55eb63436f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:35.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.450+0000 7f3912400640 1 --2- 172.21.15.99:0/3442499729 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eb634b09c0 0x55eb634af460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:35.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.450+0000 7f3911a00640 1 -- 172.21.15.99:0/3442499729 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eb634b09c0 msgr2=0x55eb634af460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:05:35.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.450+0000 7f3911a00640 1 --2- 172.21.15.99:0/3442499729 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eb634b09c0 0x55eb634af460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:35.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.450+0000 7f3911a00640 1 -- 172.21.15.99:0/3442499729 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eb63475c10 msgr2=0x55eb63436f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:05:35.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.450+0000 7f3911a00640 1 --2- 172.21.15.99:0/3442499729 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eb63475c10 0x55eb63436f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:35.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.450+0000 7f3911a00640 1 -- 172.21.15.99:0/3442499729 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eb63475a40 con 0x55eb63433ff0 2024-02-21T23:05:35.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.450+0000 7f3911000640 1 --2- 172.21.15.99:0/3442499729 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eb63475c10 0x55eb63436f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:05:35.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.451+0000 7f3911a00640 1 --2- 172.21.15.99:0/3442499729 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55eb63433ff0 0x55eb63435da0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f39000e9a80 tx=0x7f39000b5040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4009c2fc019a9921 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:05:35.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.451+0000 7f38fd600640 1 -- 172.21.15.99:0/3442499729 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39000b94e0 con 0x55eb63433ff0 2024-02-21T23:05:35.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.451+0000 7f38fd600640 1 -- 172.21.15.99:0/3442499729 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39000efc90 con 0x55eb63433ff0 2024-02-21T23:05:35.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.451+0000 7f38fd600640 1 -- 172.21.15.99:0/3442499729 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39000b96c0 con 0x55eb63433ff0 2024-02-21T23:05:35.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.452+0000 7f39173d5740 1 -- 172.21.15.99:0/3442499729 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55eb63433ff0 msgr2=0x55eb63435da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:35.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.452+0000 7f39173d5740 1 --2- 172.21.15.99:0/3442499729 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55eb63433ff0 0x55eb63435da0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f39000e9a80 tx=0x7f39000b5040 comp rx=0 tx=0).stop 2024-02-21T23:05:35.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.452+0000 7f39173d5740 1 -- 172.21.15.99:0/3442499729 shutdown_connections 2024-02-21T23:05:35.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.452+0000 7f39173d5740 1 --2- 172.21.15.99:0/3442499729 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eb634b09c0 0x55eb634af460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:35.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.452+0000 7f39173d5740 1 --2- 172.21.15.99:0/3442499729 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eb63475c10 0x55eb63436f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:35.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.452+0000 7f39173d5740 1 --2- 172.21.15.99:0/3442499729 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55eb63433ff0 0x55eb63435da0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:35.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.452+0000 7f39173d5740 1 -- 172.21.15.99:0/3442499729 >> 172.21.15.99:0/3442499729 conn(0x55eb634752f0 msgr2=0x55eb63439330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:05:35.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.452+0000 7f39173d5740 1 -- 172.21.15.99:0/3442499729 shutdown_connections 2024-02-21T23:05:35.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.452+0000 7f39173d5740 1 -- 172.21.15.99:0/3442499729 wait complete. 2024-02-21T23:05:35.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.453+0000 7f39173d5740 1 -- start start 2024-02-21T23:05:35.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.453+0000 7f39173d5740 1 Processor -- start 2024-02-21T23:05:35.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.454+0000 7f39173d5740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eb63433ff0 0x55eb6346ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:35.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.454+0000 7f39173d5740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55eb63475c10 0x55eb635252c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:35.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.454+0000 7f39173d5740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eb634b09c0 0x55eb634ae020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:35.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.454+0000 7f39173d5740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f390c228cd0 con 0x55eb63475c10 2024-02-21T23:05:35.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.454+0000 7f39173d5740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f390c229f90 con 0x55eb634b09c0 2024-02-21T23:05:35.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.454+0000 7f39173d5740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f390c2292d0 con 0x55eb63433ff0 2024-02-21T23:05:35.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.454+0000 7f39173d5740 10 client.0 _ll_register_callbacks cb 0x7f3904015ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:05:35.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.454+0000 7f3911000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55eb63475c10 0x55eb635252c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:35.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.455+0000 7f3911000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55eb63475c10 0x55eb635252c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54388/0 (socket says 172.21.15.99:54388) 2024-02-21T23:05:35.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.455+0000 7f3911000640 1 -- 172.21.15.99:0/663325623 learned_addr learned my addr 172.21.15.99:0/663325623 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:05:35.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.455+0000 7f3911a00640 1 --2- 172.21.15.99:0/663325623 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eb63433ff0 0x55eb6346ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:35.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.455+0000 7f3912400640 1 --2- 172.21.15.99:0/663325623 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eb634b09c0 0x55eb634ae020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:35.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.455+0000 7f3911000640 1 -- 172.21.15.99:0/663325623 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eb63433ff0 msgr2=0x55eb6346ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:05:35.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.455+0000 7f3911000640 1 --2- 172.21.15.99:0/663325623 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eb63433ff0 0x55eb6346ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:35.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.455+0000 7f3911000640 1 -- 172.21.15.99:0/663325623 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eb634b09c0 msgr2=0x55eb634ae020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:05:35.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.455+0000 7f3911000640 1 --2- 172.21.15.99:0/663325623 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eb634b09c0 0x55eb634ae020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:35.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.455+0000 7f3911000640 1 -- 172.21.15.99:0/663325623 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55eb63072170 con 0x55eb63475c10 2024-02-21T23:05:35.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.455+0000 7f3911a00640 1 --2- 172.21.15.99:0/663325623 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eb63433ff0 0x55eb6346ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:05:35.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.455+0000 7f3911000640 1 --2- 172.21.15.99:0/663325623 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55eb63475c10 0x55eb635252c0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f38f8016a10 tx=0x7f38f8016ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cd85b514d45dbc5 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:05:35.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.455+0000 7f38f2a00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:05:35.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.456+0000 7f38f2a00640 1 -- 172.21.15.99:0/663325623 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f8005320 con 0x55eb63475c10 2024-02-21T23:05:35.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.456+0000 7f38f2a00640 1 -- 172.21.15.99:0/663325623 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f38f8010040 con 0x55eb63475c10 2024-02-21T23:05:35.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.456+0000 7f39173d5740 1 -- 172.21.15.99:0/663325623 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f39000efc90 con 0x55eb63475c10 2024-02-21T23:05:35.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.456+0000 7f38f2a00640 1 -- 172.21.15.99:0/663325623 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f38f8015890 con 0x55eb63475c10 2024-02-21T23:05:35.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.456+0000 7f39173d5740 10 client.5799 fetch_fsmap learned FSMap version 16 2024-02-21T23:05:35.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.456+0000 7f39173d5740 1 -- 172.21.15.99:0/663325623 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55eb6351f9e0 con 0x55eb63475c10 2024-02-21T23:05:35.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.456+0000 7f38f2a00640 1 -- 172.21.15.99:0/663325623 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39000efc90 con 0x55eb63475c10 2024-02-21T23:05:35.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.456+0000 7f38f2a00640 1 -- 172.21.15.99:0/663325623 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f38f8015a30 con 0x55eb63475c10 2024-02-21T23:05:35.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.457+0000 7f39173d5740 10 client.5799 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T23:05:35.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.457+0000 7f39173d5740 10 client.5799 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:05:35.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.457+0000 7f39173d5740 20 client.5799 populate_metadata read hostname 'smithi099' 2024-02-21T23:05:35.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.457+0000 7f39173d5740 1 --2- 172.21.15.99:0/663325623 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55eb63433710 0x55eb6343fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:35.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.457+0000 7f39173d5740 4 client.5799 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-02-21T23:05:35.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.457+0000 7f39173d5740 1 -- 172.21.15.99:0/663325623 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55eb633a5020 con 0x55eb63433710 2024-02-21T23:05:35.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.457+0000 7f3911a00640 1 --2- 172.21.15.99:0/663325623 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55eb63433710 0x55eb6343fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:35.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.458+0000 7f3911a00640 1 --2- 172.21.15.99:0/663325623 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55eb63433710 0x55eb6343fe70 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ffa632f9f22482a2 server_cookie=14c4940218902588 in_seq=0 out_seq=0 2024-02-21T23:05:35.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.458+0000 7f38f2a00640 10 client.5799 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:05:35.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.459+0000 7f38f2a00640 1 -- 172.21.15.99:0/663325623 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55eb633a5020 con 0x55eb63433710 2024-02-21T23:05:35.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.459+0000 7f38f2a00640 10 client.5799 handle_command_reply: tid=0 2024-02-21T23:05:35.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.459+0000 7f39173d5740 1 client.5799 shutdown 2024-02-21T23:05:35.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.460+0000 7f39173d5740 1 -- 172.21.15.99:0/663325623 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55eb63475c10 msgr2=0x55eb635252c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:35.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.460+0000 7f39173d5740 1 --2- 172.21.15.99:0/663325623 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55eb63475c10 0x55eb635252c0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f38f8016a10 tx=0x7f38f8016ed0 comp rx=0 tx=0).stop 2024-02-21T23:05:35.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.460+0000 7f39173d5740 1 -- 172.21.15.99:0/663325623 shutdown_connections 2024-02-21T23:05:35.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.460+0000 7f39173d5740 1 --2- 172.21.15.99:0/663325623 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55eb63433710 0x55eb6343fe70 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:35.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.460+0000 7f39173d5740 1 --2- 172.21.15.99:0/663325623 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eb634b09c0 0x55eb634ae020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:35.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.460+0000 7f39173d5740 1 --2- 172.21.15.99:0/663325623 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55eb63475c10 0x55eb635252c0 secure :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f38f8016a10 tx=0x7f38f8016ed0 comp rx=0 tx=0).stop 2024-02-21T23:05:35.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.460+0000 7f39173d5740 1 --2- 172.21.15.99:0/663325623 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eb63433ff0 0x55eb6346ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:35.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.460+0000 7f39173d5740 1 -- 172.21.15.99:0/663325623 >> 172.21.15.99:0/663325623 conn(0x55eb634752f0 msgr2=0x55eb6346b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:05:35.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.460+0000 7f38f2a00640 0 client.5799 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:05:35.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.460+0000 7f39173d5740 1 -- 172.21.15.99:0/663325623 shutdown_connections 2024-02-21T23:05:35.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.460+0000 7f39173d5740 1 -- 172.21.15.99:0/663325623 wait complete. 2024-02-21T23:05:35.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.461+0000 7f39173d5740 20 client.5799 trim_cache size 0 max 16384 2024-02-21T23:05:35.454 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-02-21T23:05:35.454 INFO:teuthology.orchestra.run.smithi099.stdout: "return_code": 0, 2024-02-21T23:05:35.455 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_tag": "db0ff247-81b4-4818-aef3-f3bc45b85ac7", 2024-02-21T23:05:35.455 INFO:teuthology.orchestra.run.smithi099.stdout: "mode": "asynchronous" 2024-02-21T23:05:35.455 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-02-21T23:05:35.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.462+0000 7f3914400640 1 -- 172.21.15.99:0/529784176 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f38ec09ef00 msgr2=0x7f38ec0a13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:35.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.462+0000 7f3914400640 1 --2- 172.21.15.99:0/529784176 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f38ec09ef00 0x7f38ec0a13c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x55eb63437640 tx=0x7f3904001680 comp rx=0 tx=0).stop 2024-02-21T23:05:35.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.462+0000 7f3914400640 1 -- 172.21.15.99:0/529784176 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f390c0f8720 msgr2=0x7f390c1635f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:35.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.462+0000 7f3914400640 1 --2- 172.21.15.99:0/529784176 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f390c0f8720 0x7f390c1635f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f3900009720 tx=0x7f39000046c0 comp rx=0 tx=0).stop 2024-02-21T23:05:35.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.462+0000 7f3914400640 1 -- 172.21.15.99:0/529784176 shutdown_connections 2024-02-21T23:05:35.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.462+0000 7f3914400640 1 --2- 172.21.15.99:0/529784176 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f38ec09ef00 0x7f38ec0a13c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:35.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.462+0000 7f3914400640 1 --2- 172.21.15.99:0/529784176 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f390c1897d0 0x7f390c21d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:35.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.462+0000 7f3914400640 1 --2- 172.21.15.99:0/529784176 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f390c188eb0 0x7f390c220650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:35.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.462+0000 7f3914400640 1 --2- 172.21.15.99:0/529784176 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f390c0f8720 0x7f390c1635f0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:35.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.462+0000 7f3914400640 1 -- 172.21.15.99:0/529784176 >> 172.21.15.99:0/529784176 conn(0x7f390c0ce5e0 msgr2=0x7f390c072ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:05:35.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.463+0000 7f3914400640 1 -- 172.21.15.99:0/529784176 shutdown_connections 2024-02-21T23:05:35.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.463+0000 7f3914400640 1 -- 172.21.15.99:0/529784176 wait complete. 2024-02-21T23:05:35.480 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T23:05:35.481 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T23:05:35.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.792+0000 7fd6ca200640 1 Processor -- start 2024-02-21T23:05:35.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.792+0000 7fd6ca200640 1 -- start start 2024-02-21T23:05:35.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.794+0000 7fd6ca200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6c418e980 con 0x7fd6c418a9b0 2024-02-21T23:05:35.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.794+0000 7fd6ca200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6c418ec00 con 0x7fd6c418ff80 2024-02-21T23:05:35.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.794+0000 7fd6ca200640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6c418eee0 con 0x7fd6c418e510 2024-02-21T23:05:35.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.794+0000 7fd6c3e00640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fd6c418e510 0x7fd6c4190d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:40022/0 (socket says 172.21.15.99:40022) 2024-02-21T23:05:35.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.794+0000 7fd6c3e00640 1 -- 172.21.15.99:0/4095933240 learned_addr learned my addr 172.21.15.99:0/4095933240 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:05:35.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.795+0000 7fd6c2000640 1 -- 172.21.15.99:0/4095933240 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 764035553 0 0) 0x7fd6c418eee0 con 0x7fd6c418e510 2024-02-21T23:05:35.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.795+0000 7fd6c2000640 1 -- 172.21.15.99:0/4095933240 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6a8003520 con 0x7fd6c418e510 2024-02-21T23:05:35.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.795+0000 7fd6c2000640 1 -- 172.21.15.99:0/4095933240 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2536459714 0 0) 0x7fd6c418ec00 con 0x7fd6c418ff80 2024-02-21T23:05:35.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.795+0000 7fd6c2000640 1 -- 172.21.15.99:0/4095933240 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6c418eee0 con 0x7fd6c418ff80 2024-02-21T23:05:35.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.795+0000 7fd6c2000640 1 -- 172.21.15.99:0/4095933240 <== mon.2 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3945005141 0 0) 0x7fd6a8003520 con 0x7fd6c418e510 2024-02-21T23:05:35.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.795+0000 7fd6c2000640 1 -- 172.21.15.99:0/4095933240 >> v1:172.21.15.162:6789/0 conn(0x7fd6c418ff80 legacy=0x7fd6c4190610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:35.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.795+0000 7fd6c2000640 1 -- 172.21.15.99:0/4095933240 >> v1:172.21.15.99:6789/0 conn(0x7fd6c418a9b0 legacy=0x7fd6c418af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:35.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.795+0000 7fd6c2000640 1 -- 172.21.15.99:0/4095933240 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6c418f1c0 con 0x7fd6c418e510 2024-02-21T23:05:35.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.795+0000 7fd6c2000640 1 -- 172.21.15.99:0/4095933240 <== mon.2 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2069890144 0 0) 0x7fd6b40015a0 con 0x7fd6c418e510 2024-02-21T23:05:35.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.796+0000 7fd6c2000640 1 -- 172.21.15.99:0/4095933240 >> v1:172.21.15.181:6789/0 conn(0x7fd6c418e510 legacy=0x7fd6c4190d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:35.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.796+0000 7fd6c2000640 1 --2- 172.21.15.99:0/4095933240 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6a8003c30 0x7fd6a8004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:35.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.796+0000 7fd6c2000640 1 --2- 172.21.15.99:0/4095933240 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd6a8004800 0x7fd6a8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:35.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.796+0000 7fd6c2000640 1 --2- 172.21.15.99:0/4095933240 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd6a80099b0 0x7fd6a800bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:35.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.796+0000 7fd6c2000640 1 -- 172.21.15.99:0/4095933240 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a800c3c0 con 0x7fd6a8004800 2024-02-21T23:05:35.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.796+0000 7fd6c2000640 1 -- 172.21.15.99:0/4095933240 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a800c570 con 0x7fd6a8003c30 2024-02-21T23:05:35.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.796+0000 7fd6c2000640 1 -- 172.21.15.99:0/4095933240 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a800c770 con 0x7fd6a80099b0 2024-02-21T23:05:35.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.796+0000 7fd6c3e00640 1 --2- 172.21.15.99:0/4095933240 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd6a80099b0 0x7fd6a800bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:35.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.796+0000 7fd6c2a00640 1 --2- 172.21.15.99:0/4095933240 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd6a8004800 0x7fd6a8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:35.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.797+0000 7fd6c3400640 1 --2- 172.21.15.99:0/4095933240 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6a8003c30 0x7fd6a8004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:35.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.797+0000 7fd6c3e00640 1 -- 172.21.15.99:0/4095933240 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6a8003c30 msgr2=0x7fd6a8004030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:05:35.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.797+0000 7fd6c3e00640 1 --2- 172.21.15.99:0/4095933240 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6a8003c30 0x7fd6a8004030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:35.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.797+0000 7fd6c3e00640 1 -- 172.21.15.99:0/4095933240 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd6a8004800 msgr2=0x7fd6a8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:05:35.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.797+0000 7fd6c3e00640 1 --2- 172.21.15.99:0/4095933240 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd6a8004800 0x7fd6a8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:35.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.797+0000 7fd6c3e00640 1 -- 172.21.15.99:0/4095933240 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6a8003520 con 0x7fd6a80099b0 2024-02-21T23:05:35.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.797+0000 7fd6c3400640 1 --2- 172.21.15.99:0/4095933240 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6a8003c30 0x7fd6a8004030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T23:05:35.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.798+0000 7fd6c3e00640 1 -- 172.21.15.99:0/4095933240 reap_dead start 2024-02-21T23:05:35.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.798+0000 7fd6c2a00640 1 --2- 172.21.15.99:0/4095933240 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd6a8004800 0x7fd6a8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:05:35.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.799+0000 7fd6c3e00640 1 --2- 172.21.15.99:0/4095933240 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd6a80099b0 0x7fd6a800bda0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fd6b4007e80 tx=0x7fd6a8005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef53b86f0597e4b6 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:05:35.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.799+0000 7fd6c2000640 1 -- 172.21.15.99:0/4095933240 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b4007ad0 con 0x7fd6a80099b0 2024-02-21T23:05:35.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.799+0000 7fd6c2000640 1 -- 172.21.15.99:0/4095933240 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6b4030070 con 0x7fd6a80099b0 2024-02-21T23:05:35.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.799+0000 7fd6c2000640 1 -- 172.21.15.99:0/4095933240 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b4005d10 con 0x7fd6a80099b0 2024-02-21T23:05:35.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.800+0000 7fd6ca200640 1 -- 172.21.15.99:0/4095933240 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd6a80099b0 msgr2=0x7fd6a800bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:35.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.800+0000 7fd6ca200640 1 --2- 172.21.15.99:0/4095933240 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd6a80099b0 0x7fd6a800bda0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fd6b4007e80 tx=0x7fd6a8005830 comp rx=0 tx=0).stop 2024-02-21T23:05:35.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.800+0000 7fd6ca200640 1 -- 172.21.15.99:0/4095933240 shutdown_connections 2024-02-21T23:05:35.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.800+0000 7fd6ca200640 1 --2- 172.21.15.99:0/4095933240 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd6a80099b0 0x7fd6a800bda0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:35.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.800+0000 7fd6ca200640 1 -- 172.21.15.99:0/4095933240 >> 172.21.15.99:0/4095933240 conn(0x7fd6c40ce5f0 msgr2=0x7fd6c40cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:05:35.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.800+0000 7fd6ca200640 1 -- 172.21.15.99:0/4095933240 shutdown_connections 2024-02-21T23:05:35.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.800+0000 7fd6ca200640 1 -- 172.21.15.99:0/4095933240 wait complete. 2024-02-21T23:05:35.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.802+0000 7fd6ca200640 1 Processor -- start 2024-02-21T23:05:35.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.803+0000 7fd6ca200640 1 -- start start 2024-02-21T23:05:35.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.804+0000 7fd6ca200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6a80099b0 0x7fd6c40ccb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:35.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.804+0000 7fd6ca200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd6c40f7cf0 0x7fd6c4178b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:35.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.804+0000 7fd6ca200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd6c4224720 0x7fd6c4224ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:35.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.804+0000 7fd6ca200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c418f780 con 0x7fd6c4224720 2024-02-21T23:05:35.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.804+0000 7fd6ca200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c418fa60 con 0x7fd6a80099b0 2024-02-21T23:05:35.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.804+0000 7fd6ca200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c418af90 con 0x7fd6c40f7cf0 2024-02-21T23:05:35.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.805+0000 7fd6c2a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd6c40f7cf0 0x7fd6c4178b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:35.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.805+0000 7fd6c2a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd6c40f7cf0 0x7fd6c4178b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:34762/0 (socket says 172.21.15.99:34762) 2024-02-21T23:05:35.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.805+0000 7fd6c2a00640 1 -- 172.21.15.99:0/2599119010 learned_addr learned my addr 172.21.15.99:0/2599119010 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:05:35.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.805+0000 7fd6c3400640 1 --2- 172.21.15.99:0/2599119010 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6a80099b0 0x7fd6c40ccb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:35.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.805+0000 7fd6c3e00640 1 --2- 172.21.15.99:0/2599119010 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd6c4224720 0x7fd6c4224ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:35.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.806+0000 7fd6c2a00640 1 -- 172.21.15.99:0/2599119010 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6a80099b0 msgr2=0x7fd6c40ccb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:35.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.806+0000 7fd6c2a00640 1 --2- 172.21.15.99:0/2599119010 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6a80099b0 0x7fd6c40ccb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:35.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.806+0000 7fd6c2a00640 1 -- 172.21.15.99:0/2599119010 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd6c4224720 msgr2=0x7fd6c4224ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:35.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.806+0000 7fd6c2a00640 1 --2- 172.21.15.99:0/2599119010 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd6c4224720 0x7fd6c4224ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:35.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.806+0000 7fd6c2a00640 1 -- 172.21.15.99:0/2599119010 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6c40f8220 con 0x7fd6c40f7cf0 2024-02-21T23:05:35.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.806+0000 7fd6c3e00640 1 --2- 172.21.15.99:0/2599119010 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd6c4224720 0x7fd6c4224ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T23:05:35.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.807+0000 7fd6c2a00640 1 --2- 172.21.15.99:0/2599119010 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd6c40f7cf0 0x7fd6c4178b90 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fd6b000e4c0 tx=0x7fd6b000e980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:05:35.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.807+0000 7fd6bb400640 1 -- 172.21.15.99:0/2599119010 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b00052e0 con 0x7fd6c40f7cf0 2024-02-21T23:05:35.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.807+0000 7fd6bb400640 1 -- 172.21.15.99:0/2599119010 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6b0005480 con 0x7fd6c40f7cf0 2024-02-21T23:05:35.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.807+0000 7fd6bb400640 1 -- 172.21.15.99:0/2599119010 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b0007020 con 0x7fd6c40f7cf0 2024-02-21T23:05:35.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.807+0000 7fd6ca200640 1 -- 172.21.15.99:0/2599119010 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6c40f8500 con 0x7fd6c40f7cf0 2024-02-21T23:05:35.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.807+0000 7fd6ca200640 1 -- 172.21.15.99:0/2599119010 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6c40f8ac0 con 0x7fd6c40f7cf0 2024-02-21T23:05:35.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.820+0000 7fd6bb400640 1 -- 172.21.15.99:0/2599119010 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7fd6b001a020 con 0x7fd6c40f7cf0 2024-02-21T23:05:35.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.821+0000 7fd6cd1c4740 1 Processor -- start 2024-02-21T23:05:35.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.822+0000 7fd6cd1c4740 1 -- start start 2024-02-21T23:05:35.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.823+0000 7fd6bb400640 1 --2- 172.21.15.99:0/2599119010 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fd6a409f050 0x7fd6a40a1510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:35.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.823+0000 7fd6bb400640 1 -- 172.21.15.99:0/2599119010 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7fd6b00c93a0 con 0x7fd6c40f7cf0 2024-02-21T23:05:35.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.824+0000 7fd6c3e00640 1 --2- 172.21.15.99:0/2599119010 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fd6a409f050 0x7fd6a40a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:35.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.825+0000 7fd6cd1c4740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559ccc7330d0 0x559ccc768b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:35.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.825+0000 7fd6cd1c4740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ccc769090 0x559ccc7334b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:35.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.826+0000 7fd6cd1c4740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559ccc7339f0 0x559ccc6f6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:35.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.826+0000 7fd6cd1c4740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ccc65fa90 con 0x559ccc7339f0 2024-02-21T23:05:35.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.826+0000 7fd6cd1c4740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ccc608b10 con 0x559ccc7330d0 2024-02-21T23:05:35.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.826+0000 7fd6cd1c4740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ccc65bb30 con 0x559ccc769090 2024-02-21T23:05:35.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.826+0000 7fd6c3e00640 1 --2- 172.21.15.99:0/2599119010 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fd6a409f050 0x7fd6a40a1510 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd6a800c940 tx=0x7fd6b4007000 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:05:35.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.826+0000 7fd6c2a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ccc769090 0x559ccc7334b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:35.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.826+0000 7fd6c2a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ccc769090 0x559ccc7334b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:34776/0 (socket says 172.21.15.99:34776) 2024-02-21T23:05:35.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.826+0000 7fd6c2a00640 1 -- 172.21.15.99:0/1180346122 learned_addr learned my addr 172.21.15.99:0/1180346122 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:05:35.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.826+0000 7fd6c3400640 1 --2- 172.21.15.99:0/1180346122 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559ccc7330d0 0x559ccc768b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:35.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.826+0000 7fd6c3e00640 1 --2- 172.21.15.99:0/1180346122 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559ccc7339f0 0x559ccc6f6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:35.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.827+0000 7fd6c2a00640 1 -- 172.21.15.99:0/1180346122 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559ccc7330d0 msgr2=0x559ccc768b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:05:35.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.827+0000 7fd6c2a00640 1 --2- 172.21.15.99:0/1180346122 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559ccc7330d0 0x559ccc768b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:35.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.827+0000 7fd6c2a00640 1 -- 172.21.15.99:0/1180346122 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559ccc7339f0 msgr2=0x559ccc6f6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:05:35.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.827+0000 7fd6c2a00640 1 --2- 172.21.15.99:0/1180346122 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559ccc7339f0 0x559ccc6f6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:35.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.827+0000 7fd6c2a00640 1 -- 172.21.15.99:0/1180346122 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559ccc43e7d0 con 0x559ccc769090 2024-02-21T23:05:35.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.827+0000 7fd6c2a00640 1 --2- 172.21.15.99:0/1180346122 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ccc769090 0x559ccc7334b0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd6b0096940 tx=0x7fd6b0097480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8e4d703cc30a220 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:05:35.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.828+0000 7fd6af400640 1 -- 172.21.15.99:0/1180346122 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b00ae070 con 0x559ccc769090 2024-02-21T23:05:35.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.828+0000 7fd6af400640 1 -- 172.21.15.99:0/1180346122 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6b009f3e0 con 0x559ccc769090 2024-02-21T23:05:35.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.828+0000 7fd6af400640 1 -- 172.21.15.99:0/1180346122 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b00c9150 con 0x559ccc769090 2024-02-21T23:05:35.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.829+0000 7fd6cd1c4740 1 -- 172.21.15.99:0/1180346122 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ccc769090 msgr2=0x559ccc7334b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:35.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.829+0000 7fd6cd1c4740 1 --2- 172.21.15.99:0/1180346122 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ccc769090 0x559ccc7334b0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd6b0096940 tx=0x7fd6b0097480 comp rx=0 tx=0).stop 2024-02-21T23:05:35.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.829+0000 7fd6cd1c4740 1 -- 172.21.15.99:0/1180346122 shutdown_connections 2024-02-21T23:05:35.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.829+0000 7fd6cd1c4740 1 --2- 172.21.15.99:0/1180346122 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559ccc7339f0 0x559ccc6f6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:35.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.829+0000 7fd6cd1c4740 1 --2- 172.21.15.99:0/1180346122 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ccc769090 0x559ccc7334b0 secure :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd6b0096940 tx=0x7fd6b0097480 comp rx=0 tx=0).stop 2024-02-21T23:05:35.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.829+0000 7fd6cd1c4740 1 --2- 172.21.15.99:0/1180346122 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559ccc7330d0 0x559ccc768b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:35.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.829+0000 7fd6cd1c4740 1 -- 172.21.15.99:0/1180346122 >> 172.21.15.99:0/1180346122 conn(0x559ccc6c26b0 msgr2=0x559ccc6f9fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:05:35.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.830+0000 7fd6cd1c4740 1 -- 172.21.15.99:0/1180346122 shutdown_connections 2024-02-21T23:05:35.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.830+0000 7fd6cd1c4740 1 -- 172.21.15.99:0/1180346122 wait complete. 2024-02-21T23:05:35.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.831+0000 7fd6cd1c4740 1 -- start start 2024-02-21T23:05:35.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.831+0000 7fd6cd1c4740 1 Processor -- start 2024-02-21T23:05:35.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.833+0000 7fd6cd1c4740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ccc7330d0 0x559ccc73b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:35.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.833+0000 7fd6cd1c4740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559ccc7339f0 0x559ccc723630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:35.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.833+0000 7fd6cd1c4740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559ccc76c1c0 0x559ccc75f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:35.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.833+0000 7fd6cd1c4740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ccc701d60 con 0x559ccc76c1c0 2024-02-21T23:05:35.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.833+0000 7fd6cd1c4740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ccc5fe1c0 con 0x559ccc7339f0 2024-02-21T23:05:35.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.833+0000 7fd6cd1c4740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ccc76a760 con 0x559ccc7330d0 2024-02-21T23:05:35.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.833+0000 7fd6cd1c4740 10 client.0 _ll_register_callbacks cb 0x559ccc61b930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:05:35.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.834+0000 7fd6c3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559ccc76c1c0 0x559ccc75f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:35.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.834+0000 7fd6c3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559ccc76c1c0 0x559ccc75f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54422/0 (socket says 172.21.15.99:54422) 2024-02-21T23:05:35.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.834+0000 7fd6c3400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ccc7330d0 0x559ccc73b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:35.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.834+0000 7fd6c2a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559ccc7339f0 0x559ccc723630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:35.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.834+0000 7fd6c3400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ccc7330d0 0x559ccc73b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:34782/0 (socket says 172.21.15.99:34782) 2024-02-21T23:05:35.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.834+0000 7fd6c2a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559ccc7339f0 0x559ccc723630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:33428/0 (socket says 172.21.15.99:33428) 2024-02-21T23:05:35.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.834+0000 7fd6c2a00640 1 -- 172.21.15.99:0/2468244544 learned_addr learned my addr 172.21.15.99:0/2468244544 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:05:35.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.835+0000 7fd6c2a00640 1 -- 172.21.15.99:0/2468244544 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ccc7330d0 msgr2=0x559ccc73b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:05:35.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.835+0000 7fd6c2a00640 1 --2- 172.21.15.99:0/2468244544 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ccc7330d0 0x559ccc73b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:35.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.835+0000 7fd6c2a00640 1 -- 172.21.15.99:0/2468244544 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559ccc76c1c0 msgr2=0x559ccc75f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:05:35.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.835+0000 7fd6c2a00640 1 --2- 172.21.15.99:0/2468244544 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559ccc76c1c0 0x559ccc75f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:35.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.835+0000 7fd6c2a00640 1 -- 172.21.15.99:0/2468244544 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559ccc3743f0 con 0x559ccc7339f0 2024-02-21T23:05:35.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.835+0000 7fd6a3e00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-02-21T23:05:35.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.836+0000 7fd6c2a00640 1 --2- 172.21.15.99:0/2468244544 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559ccc7339f0 0x559ccc723630 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fd6b0096bd0 tx=0x7fd6b0099000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2e786bb30e167c1 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:05:35.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.836+0000 7fd6a3e00640 1 -- 172.21.15.99:0/2468244544 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b00ae070 con 0x559ccc7339f0 2024-02-21T23:05:35.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.836+0000 7fd6a3e00640 1 -- 172.21.15.99:0/2468244544 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7fd6b0096090 con 0x559ccc7339f0 2024-02-21T23:05:35.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.836+0000 7fd6cd1c4740 1 -- 172.21.15.99:0/2468244544 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd6b009f3e0 con 0x559ccc7339f0 2024-02-21T23:05:35.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.837+0000 7fd6a3e00640 1 -- 172.21.15.99:0/2468244544 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd6b00c6e00 con 0x559ccc7339f0 2024-02-21T23:05:35.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.837+0000 7fd6cd1c4740 10 client.5938 fetch_fsmap learned FSMap version 16 2024-02-21T23:05:35.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.837+0000 7fd6cd1c4740 1 -- 172.21.15.99:0/2468244544 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x559ccc3340f0 con 0x559ccc7339f0 2024-02-21T23:05:35.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.837+0000 7fd6a3e00640 1 -- 172.21.15.99:0/2468244544 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6b009f3e0 con 0x559ccc7339f0 2024-02-21T23:05:35.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.837+0000 7fd6a3e00640 1 -- 172.21.15.99:0/2468244544 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fd6b0092990 con 0x559ccc7339f0 2024-02-21T23:05:35.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.837+0000 7fd6cd1c4740 10 client.5938 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T23:05:35.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.837+0000 7fd6cd1c4740 10 client.5938 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:05:35.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.837+0000 7fd6cd1c4740 20 client.5938 populate_metadata read hostname 'smithi099' 2024-02-21T23:05:35.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.837+0000 7fd6cd1c4740 1 --2- 172.21.15.99:0/2468244544 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x559ccc76c620 0x559ccc77b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:35.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.837+0000 7fd6cd1c4740 4 client.5938 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:05:35.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.837+0000 7fd6cd1c4740 1 -- 172.21.15.99:0/2468244544 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559ccc66cfd0 con 0x559ccc76c620 2024-02-21T23:05:35.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.838+0000 7fd6c3400640 1 --2- 172.21.15.99:0/2468244544 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x559ccc76c620 0x559ccc77b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:35.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.839+0000 7fd6c3400640 1 --2- 172.21.15.99:0/2468244544 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x559ccc76c620 0x559ccc77b2b0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7e745db019d12ba server_cookie=9b2bf26857c1f66b in_seq=0 out_seq=0 2024-02-21T23:05:35.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.839+0000 7fd6a3e00640 10 client.5938 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:05:35.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.840+0000 7fd6a3e00640 1 -- 172.21.15.99:0/2468244544 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x559ccc66cfd0 con 0x559ccc76c620 2024-02-21T23:05:35.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.840+0000 7fd6a3e00640 10 client.5938 handle_command_reply: tid=0 2024-02-21T23:05:35.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.841+0000 7fd6cd1c4740 1 client.5938 shutdown 2024-02-21T23:05:35.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.841+0000 7fd6cd1c4740 1 -- 172.21.15.99:0/2468244544 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559ccc7339f0 msgr2=0x559ccc723630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:35.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.841+0000 7fd6cd1c4740 1 --2- 172.21.15.99:0/2468244544 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559ccc7339f0 0x559ccc723630 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fd6b0096bd0 tx=0x7fd6b0099000 comp rx=0 tx=0).stop 2024-02-21T23:05:35.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.841+0000 7fd6cd1c4740 1 -- 172.21.15.99:0/2468244544 shutdown_connections 2024-02-21T23:05:35.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.841+0000 7fd6cd1c4740 1 --2- 172.21.15.99:0/2468244544 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x559ccc76c620 0x559ccc77b2b0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:35.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.841+0000 7fd6cd1c4740 1 --2- 172.21.15.99:0/2468244544 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559ccc76c1c0 0x559ccc75f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:35.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.841+0000 7fd6cd1c4740 1 --2- 172.21.15.99:0/2468244544 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559ccc7339f0 0x559ccc723630 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:35.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.841+0000 7fd6cd1c4740 1 --2- 172.21.15.99:0/2468244544 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ccc7330d0 0x559ccc73b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:35.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.841+0000 7fd6cd1c4740 1 -- 172.21.15.99:0/2468244544 >> 172.21.15.99:0/2468244544 conn(0x559ccc6c26b0 msgr2=0x559ccc768920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:05:35.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.841+0000 7fd6a3e00640 0 client.5938 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:05:35.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.842+0000 7fd6cd1c4740 1 -- 172.21.15.99:0/2468244544 shutdown_connections 2024-02-21T23:05:35.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.842+0000 7fd6cd1c4740 1 -- 172.21.15.99:0/2468244544 wait complete. 2024-02-21T23:05:35.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.842+0000 7fd6cd1c4740 20 client.5938 trim_cache size 0 max 16384 2024-02-21T23:05:35.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.866+0000 7fd6cd1c4740 1 Processor -- start 2024-02-21T23:05:35.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.866+0000 7fd6cd1c4740 1 -- start start 2024-02-21T23:05:35.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.868+0000 7fd6cd1c4740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559ccc7330d0 0x559ccc723610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:35.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.868+0000 7fd6cd1c4740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ccc7339f0 0x559ccc73adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:35.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.868+0000 7fd6cd1c4740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559ccc76c1c0 0x559ccc7cdf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:35.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.868+0000 7fd6cd1c4740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c42316a0 con 0x559ccc7330d0 2024-02-21T23:05:35.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.868+0000 7fd6cd1c4740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c422f240 con 0x559ccc76c1c0 2024-02-21T23:05:35.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.868+0000 7fd6cd1c4740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c418c190 con 0x559ccc7339f0 2024-02-21T23:05:35.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.868+0000 7fd6c3400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559ccc7330d0 0x559ccc723610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:35.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.868+0000 7fd6c3400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559ccc7330d0 0x559ccc723610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54436/0 (socket says 172.21.15.99:54436) 2024-02-21T23:05:35.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.868+0000 7fd6c3400640 1 -- 172.21.15.99:0/4078081946 learned_addr learned my addr 172.21.15.99:0/4078081946 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:05:35.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.868+0000 7fd6c2a00640 1 --2- 172.21.15.99:0/4078081946 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ccc7339f0 0x559ccc73adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:35.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.868+0000 7fd6c3e00640 1 --2- 172.21.15.99:0/4078081946 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559ccc76c1c0 0x559ccc7cdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:35.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.869+0000 7fd6c2a00640 1 -- 172.21.15.99:0/4078081946 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559ccc76c1c0 msgr2=0x559ccc7cdf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:05:35.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.869+0000 7fd6c2a00640 1 --2- 172.21.15.99:0/4078081946 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559ccc76c1c0 0x559ccc7cdf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:35.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.869+0000 7fd6c2a00640 1 -- 172.21.15.99:0/4078081946 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559ccc7330d0 msgr2=0x559ccc723610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:05:35.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.869+0000 7fd6c2a00640 1 --2- 172.21.15.99:0/4078081946 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559ccc7330d0 0x559ccc723610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:35.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.869+0000 7fd6c2a00640 1 -- 172.21.15.99:0/4078081946 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559ccc733820 con 0x559ccc7339f0 2024-02-21T23:05:35.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.869+0000 7fd6c3400640 1 --2- 172.21.15.99:0/4078081946 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559ccc7330d0 0x559ccc723610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:05:35.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.870+0000 7fd6c2a00640 1 --2- 172.21.15.99:0/4078081946 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ccc7339f0 0x559ccc73adb0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fd6b009eeb0 tx=0x7fd6b00b2000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=214625550361ef00 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:05:35.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.870+0000 7fd6aea00640 1 -- 172.21.15.99:0/4078081946 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b00b4250 con 0x559ccc7339f0 2024-02-21T23:05:35.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.870+0000 7fd6aea00640 1 -- 172.21.15.99:0/4078081946 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6b009f3e0 con 0x559ccc7339f0 2024-02-21T23:05:35.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.870+0000 7fd6aea00640 1 -- 172.21.15.99:0/4078081946 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b00c9150 con 0x559ccc7339f0 2024-02-21T23:05:35.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.871+0000 7fd6cd1c4740 1 -- 172.21.15.99:0/4078081946 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ccc7339f0 msgr2=0x559ccc73adb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:35.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.871+0000 7fd6cd1c4740 1 --2- 172.21.15.99:0/4078081946 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ccc7339f0 0x559ccc73adb0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fd6b009eeb0 tx=0x7fd6b00b2000 comp rx=0 tx=0).stop 2024-02-21T23:05:35.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.872+0000 7fd6cd1c4740 1 -- 172.21.15.99:0/4078081946 shutdown_connections 2024-02-21T23:05:35.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.872+0000 7fd6cd1c4740 1 --2- 172.21.15.99:0/4078081946 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559ccc76c1c0 0x559ccc7cdf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:35.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.872+0000 7fd6cd1c4740 1 --2- 172.21.15.99:0/4078081946 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ccc7339f0 0x559ccc73adb0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:35.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.872+0000 7fd6cd1c4740 1 --2- 172.21.15.99:0/4078081946 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559ccc7330d0 0x559ccc723610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:35.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.872+0000 7fd6cd1c4740 1 -- 172.21.15.99:0/4078081946 >> 172.21.15.99:0/4078081946 conn(0x559ccc6c26b0 msgr2=0x559ccc778900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:05:35.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.872+0000 7fd6cd1c4740 1 -- 172.21.15.99:0/4078081946 shutdown_connections 2024-02-21T23:05:35.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.872+0000 7fd6cd1c4740 1 -- 172.21.15.99:0/4078081946 wait complete. 2024-02-21T23:05:35.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.873+0000 7fd6cd1c4740 1 -- start start 2024-02-21T23:05:35.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.874+0000 7fd6cd1c4740 1 Processor -- start 2024-02-21T23:05:35.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.876+0000 7fd6cd1c4740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ccc7330d0 0x559ccc73b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:35.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.876+0000 7fd6cd1c4740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559ccc7339f0 0x559ccc73adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:35.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.876+0000 7fd6cd1c4740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559ccc76c1c0 0x559ccc7cb010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:35.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.876+0000 7fd6c3400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ccc7330d0 0x559ccc73b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:35.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.876+0000 7fd6c3400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ccc7330d0 0x559ccc73b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:34788/0 (socket says 172.21.15.99:34788) 2024-02-21T23:05:35.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.876+0000 7fd6c2a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559ccc7339f0 0x559ccc73adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:35.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.877+0000 7fd6c2a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559ccc7339f0 0x559ccc73adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:33448/0 (socket says 172.21.15.99:33448) 2024-02-21T23:05:35.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.877+0000 7fd6c3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559ccc76c1c0 0x559ccc7cb010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:35.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.877+0000 7fd6c3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559ccc76c1c0 0x559ccc7cb010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:54450/0 (socket says 172.21.15.99:54450) 2024-02-21T23:05:35.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.877+0000 7fd6c3e00640 1 -- 172.21.15.99:0/2505262129 learned_addr learned my addr 172.21.15.99:0/2505262129 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:05:35.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.877+0000 7fd6cd1c4740 1 -- 172.21.15.99:0/2505262129 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c422d960 con 0x559ccc76c1c0 2024-02-21T23:05:35.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.877+0000 7fd6cd1c4740 1 -- 172.21.15.99:0/2505262129 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c422ebe0 con 0x559ccc7339f0 2024-02-21T23:05:35.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.877+0000 7fd6cd1c4740 1 -- 172.21.15.99:0/2505262129 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c422df60 con 0x559ccc7330d0 2024-02-21T23:05:35.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.878+0000 7fd6cd1c4740 10 client.0 _ll_register_callbacks cb 0x7fd6bc0019d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:05:35.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.878+0000 7fd6c3e00640 1 -- 172.21.15.99:0/2505262129 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ccc7330d0 msgr2=0x559ccc73b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:05:35.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.878+0000 7fd6c3e00640 1 --2- 172.21.15.99:0/2505262129 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ccc7330d0 0x559ccc73b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:35.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.878+0000 7fd6c3e00640 1 -- 172.21.15.99:0/2505262129 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559ccc7339f0 msgr2=0x559ccc73adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:05:35.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.878+0000 7fd6c3e00640 1 --2- 172.21.15.99:0/2505262129 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559ccc7339f0 0x559ccc73adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:35.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.879+0000 7fd6c3e00640 1 -- 172.21.15.99:0/2505262129 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559ccc72f4d0 con 0x559ccc76c1c0 2024-02-21T23:05:35.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.879+0000 7fd6c3e00640 1 --2- 172.21.15.99:0/2505262129 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559ccc76c1c0 0x559ccc7cb010 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fd6b402c2e0 tx=0x7fd6b40017e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddef1b34820d2ed0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:05:35.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.879+0000 7fd6a3e00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:05:35.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.880+0000 7fd6a3e00640 1 -- 172.21.15.99:0/2505262129 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b4051070 con 0x559ccc76c1c0 2024-02-21T23:05:35.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.880+0000 7fd6a3e00640 1 -- 172.21.15.99:0/2505262129 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7fd6b402c670 con 0x559ccc76c1c0 2024-02-21T23:05:35.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.880+0000 7fd6cd1c4740 1 -- 172.21.15.99:0/2505262129 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd6b009f3e0 con 0x559ccc76c1c0 2024-02-21T23:05:35.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.880+0000 7fd6a3e00640 1 -- 172.21.15.99:0/2505262129 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd6b4007750 con 0x559ccc76c1c0 2024-02-21T23:05:35.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.880+0000 7fd6cd1c4740 10 client.5814 fetch_fsmap learned FSMap version 16 2024-02-21T23:05:35.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.880+0000 7fd6cd1c4740 1 -- 172.21.15.99:0/2505262129 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x559ccc75be80 con 0x559ccc76c1c0 2024-02-21T23:05:35.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.881+0000 7fd6a3e00640 1 -- 172.21.15.99:0/2505262129 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6b009f3e0 con 0x559ccc76c1c0 2024-02-21T23:05:35.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.881+0000 7fd6a3e00640 1 -- 172.21.15.99:0/2505262129 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fd6b402c870 con 0x559ccc76c1c0 2024-02-21T23:05:35.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.881+0000 7fd6cd1c4740 10 client.5814 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T23:05:35.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.881+0000 7fd6cd1c4740 10 client.5814 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:05:35.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.881+0000 7fd6cd1c4740 20 client.5814 populate_metadata read hostname 'smithi099' 2024-02-21T23:05:35.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.881+0000 7fd6cd1c4740 1 --2- 172.21.15.99:0/2505262129 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x559ccc6fa380 0x559ccc7cb550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:05:35.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.881+0000 7fd6cd1c4740 4 client.5814 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T23:05:35.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.881+0000 7fd6cd1c4740 1 -- 172.21.15.99:0/2505262129 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x559ccc667320 con 0x559ccc6fa380 2024-02-21T23:05:35.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.883+0000 7fd6c3400640 1 --2- 172.21.15.99:0/2505262129 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x559ccc6fa380 0x559ccc7cb550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:05:35.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.884+0000 7fd6a3e00640 10 client.5814 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:05:35.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.884+0000 7fd6c3400640 1 --2- 172.21.15.99:0/2505262129 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x559ccc6fa380 0x559ccc7cb550 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c8ab99cdd151fc3a server_cookie=f94adbc15e1bdfa in_seq=0 out_seq=0 2024-02-21T23:05:35.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.885+0000 7fd6a3e00640 1 -- 172.21.15.99:0/2505262129 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+268 (crc 0 0 0) 0x559ccc667320 con 0x559ccc6fa380 2024-02-21T23:05:35.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.885+0000 7fd6a3e00640 10 client.5814 handle_command_reply: tid=0 2024-02-21T23:05:35.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.885+0000 7fd6cd1c4740 1 client.5814 shutdown 2024-02-21T23:05:35.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.885+0000 7fd6cd1c4740 1 -- 172.21.15.99:0/2505262129 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559ccc76c1c0 msgr2=0x559ccc7cb010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:35.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.885+0000 7fd6cd1c4740 1 --2- 172.21.15.99:0/2505262129 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559ccc76c1c0 0x559ccc7cb010 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fd6b402c2e0 tx=0x7fd6b40017e0 comp rx=0 tx=0).stop 2024-02-21T23:05:35.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.886+0000 7fd6cd1c4740 1 -- 172.21.15.99:0/2505262129 shutdown_connections 2024-02-21T23:05:35.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.886+0000 7fd6cd1c4740 1 --2- 172.21.15.99:0/2505262129 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x559ccc6fa380 0x559ccc7cb550 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:35.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.886+0000 7fd6cd1c4740 1 --2- 172.21.15.99:0/2505262129 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x559ccc76c1c0 0x559ccc7cb010 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:35.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.886+0000 7fd6cd1c4740 1 --2- 172.21.15.99:0/2505262129 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559ccc7339f0 0x559ccc73adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:35.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.886+0000 7fd6cd1c4740 1 --2- 172.21.15.99:0/2505262129 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x559ccc7330d0 0x559ccc73b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:35.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.886+0000 7fd6a3e00640 0 client.5814 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:05:35.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.886+0000 7fd6cd1c4740 1 -- 172.21.15.99:0/2505262129 >> 172.21.15.99:0/2505262129 conn(0x559ccc6c26b0 msgr2=0x559ccc6f4c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:05:35.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.886+0000 7fd6cd1c4740 1 -- 172.21.15.99:0/2505262129 shutdown_connections 2024-02-21T23:05:35.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.886+0000 7fd6cd1c4740 1 -- 172.21.15.99:0/2505262129 wait complete. 2024-02-21T23:05:35.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.887+0000 7fd6cd1c4740 20 client.5814 trim_cache size 0 max 16384 2024-02-21T23:05:35.877 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-02-21T23:05:35.877 INFO:teuthology.orchestra.run.smithi099.stdout: "status": "scrub active (1083 inodes in the stack)", 2024-02-21T23:05:35.877 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubs": { 2024-02-21T23:05:35.877 INFO:teuthology.orchestra.run.smithi099.stdout: "db0ff247-81b4-4818-aef3-f3bc45b85ac7": { 2024-02-21T23:05:35.877 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/", 2024-02-21T23:05:35.877 INFO:teuthology.orchestra.run.smithi099.stdout: "tag": "db0ff247-81b4-4818-aef3-f3bc45b85ac7", 2024-02-21T23:05:35.878 INFO:teuthology.orchestra.run.smithi099.stdout: "options": "recursive,force" 2024-02-21T23:05:35.878 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:05:35.878 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:05:35.878 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-02-21T23:05:35.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.887+0000 7fd6ca200640 1 -- 172.21.15.99:0/2599119010 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fd6a409f050 msgr2=0x7fd6a40a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:35.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.887+0000 7fd6ca200640 1 --2- 172.21.15.99:0/2599119010 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fd6a409f050 0x7fd6a40a1510 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd6a800c940 tx=0x7fd6b4007000 comp rx=0 tx=0).stop 2024-02-21T23:05:35.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.887+0000 7fd6ca200640 1 -- 172.21.15.99:0/2599119010 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd6c40f7cf0 msgr2=0x7fd6c4178b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:05:35.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.888+0000 7fd6ca200640 1 --2- 172.21.15.99:0/2599119010 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd6c40f7cf0 0x7fd6c4178b90 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fd6b000e4c0 tx=0x7fd6b000e980 comp rx=0 tx=0).stop 2024-02-21T23:05:35.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.888+0000 7fd6ca200640 1 -- 172.21.15.99:0/2599119010 shutdown_connections 2024-02-21T23:05:35.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.888+0000 7fd6ca200640 1 --2- 172.21.15.99:0/2599119010 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fd6a409f050 0x7fd6a40a1510 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:35.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.888+0000 7fd6ca200640 1 --2- 172.21.15.99:0/2599119010 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd6c4224720 0x7fd6c4224ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:35.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.888+0000 7fd6ca200640 1 --2- 172.21.15.99:0/2599119010 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd6c40f7cf0 0x7fd6c4178b90 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:35.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.888+0000 7fd6ca200640 1 --2- 172.21.15.99:0/2599119010 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6a80099b0 0x7fd6c40ccb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:05:35.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.888+0000 7fd6ca200640 1 -- 172.21.15.99:0/2599119010 >> 172.21.15.99:0/2599119010 conn(0x7fd6c40ce5f0 msgr2=0x7fd6c418d920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:05:35.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.889+0000 7fd6ca200640 1 -- 172.21.15.99:0/2599119010 shutdown_connections 2024-02-21T23:05:35.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:05:35.889+0000 7fd6ca200640 1 -- 172.21.15.99:0/2599119010 wait complete. 2024-02-21T23:05:35.903 INFO:tasks.cephfs.filesystem:scrub status for tag:db0ff247-81b4-4818-aef3-f3bc45b85ac7 - {'path': '/', 'tag': 'db0ff247-81b4-4818-aef3-f3bc45b85ac7', 'options': 'recursive,force'} 2024-02-21T23:05:42.305 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:05:42.314 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:05:42.316 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:06:05.904 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T23:06:05.904 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T23:06:06.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.168+0000 7f979c800640 1 Processor -- start 2024-02-21T23:06:06.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.169+0000 7f979c800640 1 -- start start 2024-02-21T23:06:06.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.170+0000 7f979c800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f97941866c0 0x7f9794189350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:06.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.170+0000 7f979c800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f9794189890 0x7f97940f23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:06.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.170+0000 7f979c800640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9794186aa0 con 0x7f97940f2930 2024-02-21T23:06:06.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.170+0000 7f979c800640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97940f4000 con 0x7f97941866c0 2024-02-21T23:06:06.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.170+0000 7f979c800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97940f3110 con 0x7f9794189890 2024-02-21T23:06:06.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.171+0000 7f979a800640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f97940f2930 0x7f979418a4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:51366/0 (socket says 172.21.15.99:51366) 2024-02-21T23:06:06.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.171+0000 7f979a800640 1 -- 172.21.15.99:0/3126410646 learned_addr learned my addr 172.21.15.99:0/3126410646 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:06:06.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.171+0000 7f9799e00640 1 --2- 172.21.15.99:0/3126410646 >> v2:172.21.15.99:3300/0 conn(0x7f97941866c0 0x7f9794189350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:06.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.171+0000 7f9799400640 1 --2- 172.21.15.99:0/3126410646 >> v2:172.21.15.162:3300/0 conn(0x7f9794189890 0x7f97940f23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:06.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.171+0000 7f9798a00640 1 -- 172.21.15.99:0/3126410646 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 757192907 0 0) 0x7f9794186aa0 con 0x7f97940f2930 2024-02-21T23:06:06.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.171+0000 7f9798a00640 1 -- 172.21.15.99:0/3126410646 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f977c003520 con 0x7f97940f2930 2024-02-21T23:06:06.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.171+0000 7f9799e00640 1 -- 172.21.15.99:0/3126410646 >> v2:172.21.15.162:3300/0 conn(0x7f9794189890 msgr2=0x7f97940f23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:06.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.171+0000 7f9799e00640 1 --2- 172.21.15.99:0/3126410646 >> v2:172.21.15.162:3300/0 conn(0x7f9794189890 0x7f97940f23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:06.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.171+0000 7f9799e00640 1 -- 172.21.15.99:0/3126410646 >> v1:172.21.15.99:6789/0 conn(0x7f97940f2930 legacy=0x7f979418a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:06.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.171+0000 7f9799e00640 1 -- 172.21.15.99:0/3126410646 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97940f33f0 con 0x7f97941866c0 2024-02-21T23:06:06.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.171+0000 7f9799400640 1 --2- 172.21.15.99:0/3126410646 >> v2:172.21.15.162:3300/0 conn(0x7f9794189890 0x7f97940f23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:06:06.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.173+0000 7f9799e00640 1 --2- 172.21.15.99:0/3126410646 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f97941866c0 0x7f9794189350 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f97940f4740 tx=0x7f978802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36b87ed4ba3c6400 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:06.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.175+0000 7f9798a00640 1 -- 172.21.15.99:0/3126410646 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97880315a0 con 0x7f97941866c0 2024-02-21T23:06:06.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.175+0000 7f9798a00640 1 -- 172.21.15.99:0/3126410646 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9788037070 con 0x7f97941866c0 2024-02-21T23:06:06.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.175+0000 7f9798a00640 1 -- 172.21.15.99:0/3126410646 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9788031960 con 0x7f97941866c0 2024-02-21T23:06:06.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.175+0000 7f979c800640 1 -- 172.21.15.99:0/3126410646 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f97941866c0 msgr2=0x7f9794189350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:06.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.175+0000 7f979c800640 1 --2- 172.21.15.99:0/3126410646 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f97941866c0 0x7f9794189350 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f97940f4740 tx=0x7f978802b840 comp rx=0 tx=0).stop 2024-02-21T23:06:06.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.176+0000 7f979c800640 1 -- 172.21.15.99:0/3126410646 shutdown_connections 2024-02-21T23:06:06.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.176+0000 7f979c800640 1 --2- 172.21.15.99:0/3126410646 >> v2:172.21.15.162:3300/0 conn(0x7f9794189890 0x7f97940f23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:06.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.176+0000 7f979c800640 1 --2- 172.21.15.99:0/3126410646 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f97941866c0 0x7f9794189350 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:06.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.176+0000 7f979c800640 1 -- 172.21.15.99:0/3126410646 >> 172.21.15.99:0/3126410646 conn(0x7f97940f7490 msgr2=0x7f97940f78a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:06:06.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.176+0000 7f979c800640 1 -- 172.21.15.99:0/3126410646 shutdown_connections 2024-02-21T23:06:06.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.176+0000 7f979c800640 1 -- 172.21.15.99:0/3126410646 wait complete. 2024-02-21T23:06:06.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.179+0000 7f979c800640 1 Processor -- start 2024-02-21T23:06:06.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.179+0000 7f979c800640 1 -- start start 2024-02-21T23:06:06.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.181+0000 7f979c800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f97940f2930 0x7f979417ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:06.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.181+0000 7f979c800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f97941866c0 0x7f979421d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:06.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.181+0000 7f979c800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9794189890 0x7f979421dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:06.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.181+0000 7f979c800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97940f3c90 con 0x7f97940f2930 2024-02-21T23:06:06.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.181+0000 7f979c800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97940f39b0 con 0x7f9794189890 2024-02-21T23:06:06.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.181+0000 7f979c800640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9794189d20 con 0x7f97941866c0 2024-02-21T23:06:06.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.182+0000 7f9799e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f97940f2930 0x7f979417ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:06.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.182+0000 7f9799e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f97940f2930 0x7f979417ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:44536/0 (socket says 172.21.15.99:44536) 2024-02-21T23:06:06.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.182+0000 7f9799e00640 1 -- 172.21.15.99:0/1946344882 learned_addr learned my addr 172.21.15.99:0/1946344882 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:06:06.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.182+0000 7f979a800640 1 --2- 172.21.15.99:0/1946344882 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9794189890 0x7f979421dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:06.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.182+0000 7f9799400640 1 --2- 172.21.15.99:0/1946344882 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f97941866c0 0x7f979421d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:06.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.182+0000 7f9799e00640 1 -- 172.21.15.99:0/1946344882 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f97941866c0 msgr2=0x7f979421d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:06.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.182+0000 7f9799e00640 1 --2- 172.21.15.99:0/1946344882 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f97941866c0 0x7f979421d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:06.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.182+0000 7f9799e00640 1 -- 172.21.15.99:0/1946344882 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9794189890 msgr2=0x7f979421dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:06.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.182+0000 7f9799e00640 1 --2- 172.21.15.99:0/1946344882 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9794189890 0x7f979421dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:06.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.182+0000 7f9799e00640 1 -- 172.21.15.99:0/1946344882 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9794221950 con 0x7f97940f2930 2024-02-21T23:06:06.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.183+0000 7f9799e00640 1 --2- 172.21.15.99:0/1946344882 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f97940f2930 0x7f979417ba60 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f9788009890 tx=0x7f97880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:06.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.183+0000 7f978e000640 1 -- 172.21.15.99:0/1946344882 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9788032630 con 0x7f97940f2930 2024-02-21T23:06:06.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.183+0000 7f978e000640 1 -- 172.21.15.99:0/1946344882 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97880327d0 con 0x7f97940f2930 2024-02-21T23:06:06.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.183+0000 7f978e000640 1 -- 172.21.15.99:0/1946344882 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9788032bc0 con 0x7f97940f2930 2024-02-21T23:06:06.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.183+0000 7f979c800640 1 -- 172.21.15.99:0/1946344882 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9794221c30 con 0x7f97940f2930 2024-02-21T23:06:06.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.183+0000 7f979c800640 1 -- 172.21.15.99:0/1946344882 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f979421cc60 con 0x7f97940f2930 2024-02-21T23:06:06.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.189+0000 7f978e000640 1 -- 172.21.15.99:0/1946344882 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f978804d3f0 con 0x7f97940f2930 2024-02-21T23:06:06.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.189+0000 7f979f7cb740 1 Processor -- start 2024-02-21T23:06:06.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.190+0000 7f979f7cb740 1 -- start start 2024-02-21T23:06:06.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.191+0000 7f978e000640 1 --2- 172.21.15.99:0/1946344882 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f977809eed0 0x7f97780a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:06.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.191+0000 7f978e000640 1 -- 172.21.15.99:0/1946344882 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f978802f030 con 0x7f97940f2930 2024-02-21T23:06:06.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.191+0000 7f979a800640 1 --2- 172.21.15.99:0/1946344882 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f977809eed0 0x7f97780a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:06.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.192+0000 7f979f7cb740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b6995b50d0 0x55b6995eab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:06.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.192+0000 7f979f7cb740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6995eb090 0x55b6995b54b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:06.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.192+0000 7f979f7cb740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b6995b59f0 0x55b699578000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:06.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.192+0000 7f979f7cb740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6994e1a90 con 0x55b6995b59f0 2024-02-21T23:06:06.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.192+0000 7f979f7cb740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b69948ab10 con 0x55b6995eb090 2024-02-21T23:06:06.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.192+0000 7f979f7cb740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6994ddb30 con 0x55b6995b50d0 2024-02-21T23:06:06.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.192+0000 7f9799400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6995eb090 0x55b6995b54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:06.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.192+0000 7f9799e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b6995b50d0 0x55b6995eab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:06.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.192+0000 7f9799400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6995eb090 0x55b6995b54b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:55072/0 (socket says 172.21.15.99:55072) 2024-02-21T23:06:06.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.192+0000 7f9799e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b6995b50d0 0x55b6995eab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:43768/0 (socket says 172.21.15.99:43768) 2024-02-21T23:06:06.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.192+0000 7f9799400640 1 -- 172.21.15.99:0/2188463570 learned_addr learned my addr 172.21.15.99:0/2188463570 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:06:06.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.192+0000 7f979a800640 1 --2- 172.21.15.99:0/2188463570 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b6995b59f0 0x55b699578000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:06.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.192+0000 7f979a800640 1 --2- 172.21.15.99:0/1946344882 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f977809eed0 0x7f97780a1390 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9790005c00 tx=0x7f9790009040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:06.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.192+0000 7f9799e00640 1 -- 172.21.15.99:0/2188463570 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6995eb090 msgr2=0x55b6995b54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:06.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.192+0000 7f9799e00640 1 --2- 172.21.15.99:0/2188463570 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6995eb090 0x55b6995b54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:06.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.192+0000 7f9799e00640 1 -- 172.21.15.99:0/2188463570 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b6995b59f0 msgr2=0x55b699578000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:06.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.192+0000 7f9799e00640 1 --2- 172.21.15.99:0/2188463570 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b6995b59f0 0x55b699578000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:06.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.192+0000 7f9799e00640 1 -- 172.21.15.99:0/2188463570 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b6992c07d0 con 0x55b6995b50d0 2024-02-21T23:06:06.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.193+0000 7f9799e00640 1 --2- 172.21.15.99:0/2188463570 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b6995b50d0 0x55b6995eab50 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f97880e8ec0 tx=0x7f97880b8a00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a3aa88e593663b8 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:06.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.193+0000 7f9782600640 1 -- 172.21.15.99:0/2188463570 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97880b90a0 con 0x55b6995b50d0 2024-02-21T23:06:06.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.193+0000 7f9782600640 1 -- 172.21.15.99:0/2188463570 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9788037070 con 0x55b6995b50d0 2024-02-21T23:06:06.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.193+0000 7f9782600640 1 -- 172.21.15.99:0/2188463570 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97880bd1f0 con 0x55b6995b50d0 2024-02-21T23:06:06.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.194+0000 7f979f7cb740 1 -- 172.21.15.99:0/2188463570 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b6995b50d0 msgr2=0x55b6995eab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:06.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.194+0000 7f979f7cb740 1 --2- 172.21.15.99:0/2188463570 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b6995b50d0 0x55b6995eab50 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f97880e8ec0 tx=0x7f97880b8a00 comp rx=0 tx=0).stop 2024-02-21T23:06:06.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.194+0000 7f979f7cb740 1 -- 172.21.15.99:0/2188463570 shutdown_connections 2024-02-21T23:06:06.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.194+0000 7f979f7cb740 1 --2- 172.21.15.99:0/2188463570 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b6995b59f0 0x55b699578000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:06.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.194+0000 7f979f7cb740 1 --2- 172.21.15.99:0/2188463570 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6995eb090 0x55b6995b54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:06.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.194+0000 7f979f7cb740 1 --2- 172.21.15.99:0/2188463570 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b6995b50d0 0x55b6995eab50 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:06.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.194+0000 7f979f7cb740 1 -- 172.21.15.99:0/2188463570 >> 172.21.15.99:0/2188463570 conn(0x55b6995446b0 msgr2=0x55b69957bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:06:06.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.194+0000 7f979f7cb740 1 -- 172.21.15.99:0/2188463570 shutdown_connections 2024-02-21T23:06:06.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.194+0000 7f979f7cb740 1 -- 172.21.15.99:0/2188463570 wait complete. 2024-02-21T23:06:06.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.196+0000 7f979f7cb740 1 -- start start 2024-02-21T23:06:06.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.196+0000 7f979f7cb740 1 Processor -- start 2024-02-21T23:06:06.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.198+0000 7f979f7cb740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b6995b50d0 0x55b6995feaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:06.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.198+0000 7f979f7cb740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b6995b59f0 0x55b6995e5460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:06.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.198+0000 7f979f7cb740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6995eb090 0x55b6995ae610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:06.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.198+0000 7f979f7cb740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6994e1a90 con 0x55b6995b50d0 2024-02-21T23:06:06.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.198+0000 7f979f7cb740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6994801c0 con 0x55b6995eb090 2024-02-21T23:06:06.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.198+0000 7f979f7cb740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6994ddb30 con 0x55b6995b59f0 2024-02-21T23:06:06.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.198+0000 7f979f7cb740 10 client.0 _ll_register_callbacks cb 0x55b69949d930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:06:06.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.198+0000 7f9799e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b6995b50d0 0x55b6995feaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:06.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.198+0000 7f9799e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b6995b50d0 0x55b6995feaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:44550/0 (socket says 172.21.15.99:44550) 2024-02-21T23:06:06.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.198+0000 7f9799e00640 1 -- 172.21.15.99:0/3514792407 learned_addr learned my addr 172.21.15.99:0/3514792407 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:06:06.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.198+0000 7f9799400640 1 --2- 172.21.15.99:0/3514792407 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b6995b59f0 0x55b6995e5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:06.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.199+0000 7f979a800640 1 --2- 172.21.15.99:0/3514792407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6995eb090 0x55b6995ae610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:06.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.199+0000 7f9799e00640 1 -- 172.21.15.99:0/3514792407 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b6995b59f0 msgr2=0x55b6995e5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:06.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.199+0000 7f9799e00640 1 --2- 172.21.15.99:0/3514792407 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b6995b59f0 0x55b6995e5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:06.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.199+0000 7f9799e00640 1 -- 172.21.15.99:0/3514792407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6995eb090 msgr2=0x55b6995ae610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:06.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.199+0000 7f9799e00640 1 --2- 172.21.15.99:0/3514792407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6995eb090 0x55b6995ae610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:06.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.199+0000 7f9799e00640 1 -- 172.21.15.99:0/3514792407 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b6991f63f0 con 0x55b6995b50d0 2024-02-21T23:06:06.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.199+0000 7f9799e00640 1 --2- 172.21.15.99:0/3514792407 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b6995b50d0 0x55b6995feaf0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f97880b9030 tx=0x7f978802bd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=237ad6411d25d97b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:06.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.199+0000 7f9776a00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:06:06.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.199+0000 7f9776a00640 1 -- 172.21.15.99:0/3514792407 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97880c15b0 con 0x55b6995b50d0 2024-02-21T23:06:06.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.199+0000 7f9776a00640 1 -- 172.21.15.99:0/3514792407 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f97880b84f0 con 0x55b6995b50d0 2024-02-21T23:06:06.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.199+0000 7f979f7cb740 1 -- 172.21.15.99:0/3514792407 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9788037070 con 0x55b6995b50d0 2024-02-21T23:06:06.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.200+0000 7f9776a00640 1 -- 172.21.15.99:0/3514792407 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f97880bd1f0 con 0x55b6995b50d0 2024-02-21T23:06:06.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.200+0000 7f979f7cb740 10 client.5829 fetch_fsmap learned FSMap version 16 2024-02-21T23:06:06.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.200+0000 7f979f7cb740 1 -- 172.21.15.99:0/3514792407 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55b6991b60f0 con 0x55b6995b50d0 2024-02-21T23:06:06.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.200+0000 7f9776a00640 1 -- 172.21.15.99:0/3514792407 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9788037070 con 0x55b6995b50d0 2024-02-21T23:06:06.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.200+0000 7f9776a00640 1 -- 172.21.15.99:0/3514792407 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f978804c030 con 0x55b6995b50d0 2024-02-21T23:06:06.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.200+0000 7f979f7cb740 10 client.5829 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T23:06:06.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.200+0000 7f979f7cb740 10 client.5829 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:06:06.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.200+0000 7f979f7cb740 20 client.5829 populate_metadata read hostname 'smithi099' 2024-02-21T23:06:06.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.200+0000 7f979f7cb740 1 --2- 172.21.15.99:0/3514792407 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55b6995e4f60 0x55b6995ff240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:06.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.200+0000 7f979f7cb740 4 client.5829 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:06:06.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.200+0000 7f979f7cb740 1 -- 172.21.15.99:0/3514792407 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b6994eefd0 con 0x55b6995e4f60 2024-02-21T23:06:06.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.201+0000 7f9799400640 1 --2- 172.21.15.99:0/3514792407 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55b6995e4f60 0x55b6995ff240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:06.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.201+0000 7f9799400640 1 --2- 172.21.15.99:0/3514792407 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55b6995e4f60 0x55b6995ff240 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da9e53b0369af342 server_cookie=874748ac14cd5c06 in_seq=0 out_seq=0 2024-02-21T23:06:06.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.201+0000 7f9776a00640 10 client.5829 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:06:06.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.202+0000 7f9776a00640 1 -- 172.21.15.99:0/3514792407 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55b6994eefd0 con 0x55b6995e4f60 2024-02-21T23:06:06.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.202+0000 7f9776a00640 10 client.5829 handle_command_reply: tid=0 2024-02-21T23:06:06.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.202+0000 7f979f7cb740 1 client.5829 shutdown 2024-02-21T23:06:06.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.203+0000 7f979f7cb740 1 -- 172.21.15.99:0/3514792407 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b6995b50d0 msgr2=0x55b6995feaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:06.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.203+0000 7f979f7cb740 1 --2- 172.21.15.99:0/3514792407 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b6995b50d0 0x55b6995feaf0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f97880b9030 tx=0x7f978802bd60 comp rx=0 tx=0).stop 2024-02-21T23:06:06.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.203+0000 7f979f7cb740 1 -- 172.21.15.99:0/3514792407 shutdown_connections 2024-02-21T23:06:06.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.203+0000 7f979f7cb740 1 --2- 172.21.15.99:0/3514792407 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55b6995e4f60 0x55b6995ff240 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:06.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.203+0000 7f979f7cb740 1 --2- 172.21.15.99:0/3514792407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6995eb090 0x55b6995ae610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:06.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.203+0000 7f979f7cb740 1 --2- 172.21.15.99:0/3514792407 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b6995b59f0 0x55b6995e5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:06.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.203+0000 7f979f7cb740 1 --2- 172.21.15.99:0/3514792407 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b6995b50d0 0x55b6995feaf0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:06.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.203+0000 7f9776a00640 0 client.5829 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:06:06.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.203+0000 7f979f7cb740 1 -- 172.21.15.99:0/3514792407 >> 172.21.15.99:0/3514792407 conn(0x55b6995446b0 msgr2=0x55b6995829b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:06:06.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.203+0000 7f979f7cb740 1 -- 172.21.15.99:0/3514792407 shutdown_connections 2024-02-21T23:06:06.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.203+0000 7f979f7cb740 1 -- 172.21.15.99:0/3514792407 wait complete. 2024-02-21T23:06:06.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.203+0000 7f979f7cb740 20 client.5829 trim_cache size 0 max 16384 2024-02-21T23:06:06.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.232+0000 7f979f7cb740 1 Processor -- start 2024-02-21T23:06:06.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.232+0000 7f979f7cb740 1 -- start start 2024-02-21T23:06:06.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.234+0000 7f979f7cb740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6995b50d0 0x55b69957c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:06.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.234+0000 7f979f7cb740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b6995b59f0 0x55b699573010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:06.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.234+0000 7f979f7cb740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b6995eb090 0x55b6995832c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:06.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.234+0000 7f979f7cb740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f979422c9c0 con 0x55b6995eb090 2024-02-21T23:06:06.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.234+0000 7f979f7cb740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f979422a560 con 0x55b6995b50d0 2024-02-21T23:06:06.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.234+0000 7f979f7cb740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97942286f0 con 0x55b6995b59f0 2024-02-21T23:06:06.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.234+0000 7f979a800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b6995eb090 0x55b6995832c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:06.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.234+0000 7f9799e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6995b50d0 0x55b69957c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:06.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.234+0000 7f979a800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b6995eb090 0x55b6995832c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:44564/0 (socket says 172.21.15.99:44564) 2024-02-21T23:06:06.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.234+0000 7f9799e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6995b50d0 0x55b69957c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:55088/0 (socket says 172.21.15.99:55088) 2024-02-21T23:06:06.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.234+0000 7f979a800640 1 -- 172.21.15.99:0/776211962 learned_addr learned my addr 172.21.15.99:0/776211962 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:06:06.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.234+0000 7f9799400640 1 --2- 172.21.15.99:0/776211962 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b6995b59f0 0x55b699573010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:06.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.235+0000 7f9799e00640 1 -- 172.21.15.99:0/776211962 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b6995b59f0 msgr2=0x55b699573010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:06.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.235+0000 7f9799e00640 1 --2- 172.21.15.99:0/776211962 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b6995b59f0 0x55b699573010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:06.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.235+0000 7f9799e00640 1 -- 172.21.15.99:0/776211962 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b6995eb090 msgr2=0x55b6995832c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:06.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.235+0000 7f9799e00640 1 --2- 172.21.15.99:0/776211962 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b6995eb090 0x55b6995832c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:06.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.235+0000 7f9799e00640 1 -- 172.21.15.99:0/776211962 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b6995e3730 con 0x55b6995b50d0 2024-02-21T23:06:06.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.235+0000 7f979a800640 1 --2- 172.21.15.99:0/776211962 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b6995eb090 0x55b6995832c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:06:06.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.235+0000 7f9799e00640 1 --2- 172.21.15.99:0/776211962 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6995b50d0 0x55b69957c2f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f978802b880 tx=0x7f9788046000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7288ebf5ac549331 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:06.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.235+0000 7f9781c00640 1 -- 172.21.15.99:0/776211962 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97880b71e0 con 0x55b6995b50d0 2024-02-21T23:06:06.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.235+0000 7f9781c00640 1 -- 172.21.15.99:0/776211962 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97880c15b0 con 0x55b6995b50d0 2024-02-21T23:06:06.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.235+0000 7f9781c00640 1 -- 172.21.15.99:0/776211962 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97880b86f0 con 0x55b6995b50d0 2024-02-21T23:06:06.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.236+0000 7f979f7cb740 1 -- 172.21.15.99:0/776211962 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6995b50d0 msgr2=0x55b69957c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:06.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.236+0000 7f979f7cb740 1 --2- 172.21.15.99:0/776211962 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6995b50d0 0x55b69957c2f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f978802b880 tx=0x7f9788046000 comp rx=0 tx=0).stop 2024-02-21T23:06:06.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.236+0000 7f979f7cb740 1 -- 172.21.15.99:0/776211962 shutdown_connections 2024-02-21T23:06:06.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.236+0000 7f979f7cb740 1 --2- 172.21.15.99:0/776211962 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b6995eb090 0x55b6995832c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:06.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.236+0000 7f979f7cb740 1 --2- 172.21.15.99:0/776211962 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b6995b59f0 0x55b699573010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:06.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.236+0000 7f979f7cb740 1 --2- 172.21.15.99:0/776211962 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6995b50d0 0x55b69957c2f0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:06.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.236+0000 7f979f7cb740 1 -- 172.21.15.99:0/776211962 >> 172.21.15.99:0/776211962 conn(0x55b6995446b0 msgr2=0x55b6995ae420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:06:06.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.236+0000 7f979f7cb740 1 -- 172.21.15.99:0/776211962 shutdown_connections 2024-02-21T23:06:06.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.236+0000 7f979f7cb740 1 -- 172.21.15.99:0/776211962 wait complete. 2024-02-21T23:06:06.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.238+0000 7f979f7cb740 1 -- start start 2024-02-21T23:06:06.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.238+0000 7f979f7cb740 1 Processor -- start 2024-02-21T23:06:06.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.240+0000 7f979f7cb740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6995b50d0 0x55b6995e32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:06.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.240+0000 7f979f7cb740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b6995b59f0 0x55b69965cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:06.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.240+0000 7f979f7cb740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b6995eb090 0x55b699653ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:06.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.240+0000 7f979f7cb740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9794228c20 con 0x55b6995b59f0 2024-02-21T23:06:06.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.240+0000 7f979f7cb740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9794229f00 con 0x55b6995b50d0 2024-02-21T23:06:06.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.240+0000 7f979f7cb740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9794229240 con 0x55b6995eb090 2024-02-21T23:06:06.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.240+0000 7f979f7cb740 10 client.0 _ll_register_callbacks cb 0x7f97840094e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:06:06.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.240+0000 7f9799400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b6995b59f0 0x55b69965cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:06.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.240+0000 7f9799e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6995b50d0 0x55b6995e32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:06.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.240+0000 7f9799400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b6995b59f0 0x55b69965cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:44576/0 (socket says 172.21.15.99:44576) 2024-02-21T23:06:06.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.240+0000 7f9799400640 1 -- 172.21.15.99:0/177372856 learned_addr learned my addr 172.21.15.99:0/177372856 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:06:06.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.241+0000 7f979a800640 1 --2- 172.21.15.99:0/177372856 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b6995eb090 0x55b699653ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:06.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.241+0000 7f9799400640 1 -- 172.21.15.99:0/177372856 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b6995eb090 msgr2=0x55b699653ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:06.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.241+0000 7f9799400640 1 --2- 172.21.15.99:0/177372856 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b6995eb090 0x55b699653ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:06.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.241+0000 7f9799400640 1 -- 172.21.15.99:0/177372856 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6995b50d0 msgr2=0x55b6995e32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:06.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.241+0000 7f9799400640 1 --2- 172.21.15.99:0/177372856 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6995b50d0 0x55b6995e32a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:06.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.241+0000 7f9799400640 1 -- 172.21.15.99:0/177372856 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b69965d080 con 0x55b6995b59f0 2024-02-21T23:06:06.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.241+0000 7f9799e00640 1 --2- 172.21.15.99:0/177372856 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6995b50d0 0x55b6995e32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:06:06.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.241+0000 7f9799400640 1 --2- 172.21.15.99:0/177372856 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b6995b59f0 0x55b69965cb40 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f9784009d20 tx=0x7f9784004330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb9874845db4dd21 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:06.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.241+0000 7f9776a00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:06:06.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.241+0000 7f9776a00640 1 -- 172.21.15.99:0/177372856 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9784003d80 con 0x55b6995b59f0 2024-02-21T23:06:06.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.242+0000 7f9776a00640 1 -- 172.21.15.99:0/177372856 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f9784022690 con 0x55b6995b59f0 2024-02-21T23:06:06.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.242+0000 7f979f7cb740 1 -- 172.21.15.99:0/177372856 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f97880c15b0 con 0x55b6995b59f0 2024-02-21T23:06:06.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.242+0000 7f9776a00640 1 -- 172.21.15.99:0/177372856 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9784032050 con 0x55b6995b59f0 2024-02-21T23:06:06.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.242+0000 7f979f7cb740 10 client.5835 fetch_fsmap learned FSMap version 16 2024-02-21T23:06:06.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.242+0000 7f979f7cb740 1 -- 172.21.15.99:0/177372856 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55b6996541e0 con 0x55b6995b59f0 2024-02-21T23:06:06.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.242+0000 7f9776a00640 1 -- 172.21.15.99:0/177372856 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97880c15b0 con 0x55b6995b59f0 2024-02-21T23:06:06.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.242+0000 7f9776a00640 1 -- 172.21.15.99:0/177372856 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f9784022890 con 0x55b6995b59f0 2024-02-21T23:06:06.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.243+0000 7f979f7cb740 10 client.5835 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T23:06:06.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.243+0000 7f979f7cb740 10 client.5835 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:06:06.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.243+0000 7f979f7cb740 20 client.5835 populate_metadata read hostname 'smithi099' 2024-02-21T23:06:06.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.243+0000 7f979f7cb740 1 --2- 172.21.15.99:0/177372856 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55b6995c1410 0x55b6995e8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:06.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.243+0000 7f979f7cb740 4 client.5835 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T23:06:06.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.243+0000 7f979f7cb740 1 -- 172.21.15.99:0/177372856 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55b6994e9320 con 0x55b6995c1410 2024-02-21T23:06:06.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.243+0000 7f9799e00640 1 --2- 172.21.15.99:0/177372856 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55b6995c1410 0x55b6995e8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:06.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.243+0000 7f9799e00640 1 --2- 172.21.15.99:0/177372856 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55b6995c1410 0x55b6995e8ae0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54cd9f8abc159cc4 server_cookie=7bee9bdb6cbc2751 in_seq=0 out_seq=0 2024-02-21T23:06:06.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.243+0000 7f9776a00640 10 client.5835 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:06:06.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.244+0000 7f9776a00640 1 -- 172.21.15.99:0/177372856 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55b6994e9320 con 0x55b6995c1410 2024-02-21T23:06:06.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.244+0000 7f9776a00640 10 client.5835 handle_command_reply: tid=0 2024-02-21T23:06:06.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.244+0000 7f979f7cb740 1 client.5835 shutdown 2024-02-21T23:06:06.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.244+0000 7f979f7cb740 1 -- 172.21.15.99:0/177372856 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b6995b59f0 msgr2=0x55b69965cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:06.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.244+0000 7f979f7cb740 1 --2- 172.21.15.99:0/177372856 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b6995b59f0 0x55b69965cb40 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f9784009d20 tx=0x7f9784004330 comp rx=0 tx=0).stop 2024-02-21T23:06:06.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.244+0000 7f979f7cb740 1 -- 172.21.15.99:0/177372856 shutdown_connections 2024-02-21T23:06:06.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.244+0000 7f979f7cb740 1 --2- 172.21.15.99:0/177372856 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55b6995c1410 0x55b6995e8ae0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:06.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.244+0000 7f979f7cb740 1 --2- 172.21.15.99:0/177372856 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b6995eb090 0x55b699653ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:06.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.244+0000 7f979f7cb740 1 --2- 172.21.15.99:0/177372856 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b6995b59f0 0x55b69965cb40 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:06.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.244+0000 7f979f7cb740 1 --2- 172.21.15.99:0/177372856 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6995b50d0 0x55b6995e32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:06.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.244+0000 7f9776a00640 0 client.5835 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:06:06.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.244+0000 7f979f7cb740 1 -- 172.21.15.99:0/177372856 >> 172.21.15.99:0/177372856 conn(0x55b6995446b0 msgr2=0x55b6995bd570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:06:06.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.244+0000 7f979f7cb740 1 -- 172.21.15.99:0/177372856 shutdown_connections 2024-02-21T23:06:06.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.244+0000 7f979f7cb740 1 -- 172.21.15.99:0/177372856 wait complete. 2024-02-21T23:06:06.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.244+0000 7f979f7cb740 20 client.5835 trim_cache size 0 max 16384 2024-02-21T23:06:06.244 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-02-21T23:06:06.244 INFO:teuthology.orchestra.run.smithi099.stdout: "status": "no active scrubs running", 2024-02-21T23:06:06.244 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubs": {} 2024-02-21T23:06:06.244 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-02-21T23:06:06.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.245+0000 7f979c800640 1 -- 172.21.15.99:0/1946344882 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f977809eed0 msgr2=0x7f97780a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:06.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.245+0000 7f979c800640 1 --2- 172.21.15.99:0/1946344882 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f977809eed0 0x7f97780a1390 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9790005c00 tx=0x7f9790009040 comp rx=0 tx=0).stop 2024-02-21T23:06:06.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.245+0000 7f979c800640 1 -- 172.21.15.99:0/1946344882 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f97940f2930 msgr2=0x7f979417ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:06.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.245+0000 7f979c800640 1 --2- 172.21.15.99:0/1946344882 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f97940f2930 0x7f979417ba60 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f9788009890 tx=0x7f97880046c0 comp rx=0 tx=0).stop 2024-02-21T23:06:06.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.245+0000 7f979c800640 1 -- 172.21.15.99:0/1946344882 shutdown_connections 2024-02-21T23:06:06.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.245+0000 7f979c800640 1 --2- 172.21.15.99:0/1946344882 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f977809eed0 0x7f97780a1390 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:06.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.245+0000 7f979c800640 1 --2- 172.21.15.99:0/1946344882 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9794189890 0x7f979421dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:06.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.245+0000 7f979c800640 1 --2- 172.21.15.99:0/1946344882 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f97941866c0 0x7f979421d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:06.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.245+0000 7f979c800640 1 --2- 172.21.15.99:0/1946344882 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f97940f2930 0x7f979417ba60 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:06.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.245+0000 7f979c800640 1 -- 172.21.15.99:0/1946344882 >> 172.21.15.99:0/1946344882 conn(0x7f97940f7490 msgr2=0x7f97940f7870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:06:06.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.245+0000 7f979c800640 1 -- 172.21.15.99:0/1946344882 shutdown_connections 2024-02-21T23:06:06.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.246+0000 7f979c800640 1 -- 172.21.15.99:0/1946344882 wait complete. 2024-02-21T23:06:06.252 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-02-21T23:06:06.253 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T23:06:06.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.501+0000 7fcda8a00640 1 Processor -- start 2024-02-21T23:06:06.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.502+0000 7fcda8a00640 1 -- start start 2024-02-21T23:06:06.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.504+0000 7fcda8a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fcda418a010 0x7fcda418b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:06.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.505+0000 7fcda8a00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcda418a600 con 0x7fcda4182a80 2024-02-21T23:06:06.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.505+0000 7fcda8a00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcda418a8e0 con 0x7fcda40719b0 2024-02-21T23:06:06.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.505+0000 7fcda8a00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcda418bec0 con 0x7fcda418a010 2024-02-21T23:06:06.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.505+0000 7fcda3400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fcda4182a80 0x7fcda4186a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:51378/0 (socket says 172.21.15.99:51378) 2024-02-21T23:06:06.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.505+0000 7fcda3400640 1 -- 172.21.15.99:0/2201743809 learned_addr learned my addr 172.21.15.99:0/2201743809 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:06:06.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.505+0000 7fcda2a00640 1 --2- 172.21.15.99:0/2201743809 >> v2:172.21.15.162:3300/0 conn(0x7fcda418a010 0x7fcda418b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:06.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.505+0000 7fcda2000640 1 -- 172.21.15.99:0/2201743809 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3630288450 0 0) 0x7fcda418a600 con 0x7fcda4182a80 2024-02-21T23:06:06.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.505+0000 7fcda2000640 1 -- 172.21.15.99:0/2201743809 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd88003520 con 0x7fcda4182a80 2024-02-21T23:06:06.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.505+0000 7fcda2000640 1 -- 172.21.15.99:0/2201743809 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3968168956 0 0) 0x7fcda418a8e0 con 0x7fcda40719b0 2024-02-21T23:06:06.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.505+0000 7fcda2000640 1 -- 172.21.15.99:0/2201743809 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcda418a600 con 0x7fcda40719b0 2024-02-21T23:06:06.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.506+0000 7fcda2a00640 1 -- 172.21.15.99:0/2201743809 >> v1:172.21.15.181:6789/0 conn(0x7fcda40719b0 legacy=0x7fcda4071e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:06.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.506+0000 7fcda2a00640 1 -- 172.21.15.99:0/2201743809 >> v1:172.21.15.99:6789/0 conn(0x7fcda4182a80 legacy=0x7fcda4186a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:06.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.506+0000 7fcda2a00640 1 -- 172.21.15.99:0/2201743809 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcda418abc0 con 0x7fcda418a010 2024-02-21T23:06:06.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.507+0000 7fcda2a00640 1 --2- 172.21.15.99:0/2201743809 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcda418a010 0x7fcda418b980 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fcd90009790 tx=0x7fcd9002b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5db71f0bcbfb856 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:06.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.508+0000 7fcda2000640 1 -- 172.21.15.99:0/2201743809 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd900315a0 con 0x7fcda418a010 2024-02-21T23:06:06.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.508+0000 7fcda2000640 1 -- 172.21.15.99:0/2201743809 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd90037070 con 0x7fcda418a010 2024-02-21T23:06:06.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.508+0000 7fcda2000640 1 -- 172.21.15.99:0/2201743809 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd90031960 con 0x7fcda418a010 2024-02-21T23:06:06.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.508+0000 7fcda8a00640 1 -- 172.21.15.99:0/2201743809 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcda418a010 msgr2=0x7fcda418b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:06.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.508+0000 7fcda8a00640 1 --2- 172.21.15.99:0/2201743809 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcda418a010 0x7fcda418b980 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fcd90009790 tx=0x7fcd9002b840 comp rx=0 tx=0).stop 2024-02-21T23:06:06.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.509+0000 7fcda8a00640 1 -- 172.21.15.99:0/2201743809 shutdown_connections 2024-02-21T23:06:06.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.509+0000 7fcda8a00640 1 --2- 172.21.15.99:0/2201743809 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcda418a010 0x7fcda418b980 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:06.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.509+0000 7fcda8a00640 1 -- 172.21.15.99:0/2201743809 >> 172.21.15.99:0/2201743809 conn(0x7fcda40d29f0 msgr2=0x7fcda40d2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:06:06.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.509+0000 7fcda8a00640 1 -- 172.21.15.99:0/2201743809 shutdown_connections 2024-02-21T23:06:06.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.509+0000 7fcda8a00640 1 -- 172.21.15.99:0/2201743809 wait complete. 2024-02-21T23:06:06.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.511+0000 7fcda8a00640 1 Processor -- start 2024-02-21T23:06:06.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.512+0000 7fcda8a00640 1 -- start start 2024-02-21T23:06:06.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.514+0000 7fcda8a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcda40719b0 0x7fcda4179240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:06.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.514+0000 7fcda8a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcda4182a80 0x7fcda40fe7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:06.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.514+0000 7fcda8a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcda418a010 0x7fcda42213e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:06.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.514+0000 7fcda8a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcda418b460 con 0x7fcda418a010 2024-02-21T23:06:06.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.514+0000 7fcda8a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcda418b180 con 0x7fcda40719b0 2024-02-21T23:06:06.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.514+0000 7fcda8a00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcda4182e60 con 0x7fcda4182a80 2024-02-21T23:06:06.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.514+0000 7fcda3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcda418a010 0x7fcda42213e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:06.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.514+0000 7fcda2a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcda4182a80 0x7fcda40fe7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:06.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.514+0000 7fcda3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcda418a010 0x7fcda42213e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:44588/0 (socket says 172.21.15.99:44588) 2024-02-21T23:06:06.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.514+0000 7fcda3e00640 1 -- 172.21.15.99:0/3605955875 learned_addr learned my addr 172.21.15.99:0/3605955875 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:06:06.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.514+0000 7fcda3400640 1 --2- 172.21.15.99:0/3605955875 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcda40719b0 0x7fcda4179240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:06.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.515+0000 7fcda2a00640 1 -- 172.21.15.99:0/3605955875 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcda40719b0 msgr2=0x7fcda4179240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:06.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.515+0000 7fcda2a00640 1 --2- 172.21.15.99:0/3605955875 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcda40719b0 0x7fcda4179240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:06.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.515+0000 7fcda2a00640 1 -- 172.21.15.99:0/3605955875 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcda418a010 msgr2=0x7fcda42213e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:06.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.515+0000 7fcda2a00640 1 --2- 172.21.15.99:0/3605955875 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcda418a010 0x7fcda42213e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:06.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.515+0000 7fcda2a00640 1 -- 172.21.15.99:0/3605955875 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcda40fddb0 con 0x7fcda4182a80 2024-02-21T23:06:06.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.515+0000 7fcda3400640 1 --2- 172.21.15.99:0/3605955875 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcda40719b0 0x7fcda4179240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:06:06.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.515+0000 7fcda3e00640 1 --2- 172.21.15.99:0/3605955875 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcda418a010 0x7fcda42213e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:06:06.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.515+0000 7fcda2a00640 1 --2- 172.21.15.99:0/3605955875 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcda4182a80 0x7fcda40fe7d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fcda40fbf40 tx=0x7fcd900046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:06.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.515+0000 7fcd9b400640 1 -- 172.21.15.99:0/3605955875 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd90005b90 con 0x7fcda4182a80 2024-02-21T23:06:06.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.515+0000 7fcd9b400640 1 -- 172.21.15.99:0/3605955875 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd90005d30 con 0x7fcda4182a80 2024-02-21T23:06:06.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.515+0000 7fcda8a00640 1 -- 172.21.15.99:0/3605955875 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcda4220620 con 0x7fcda4182a80 2024-02-21T23:06:06.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.515+0000 7fcd9b400640 1 -- 172.21.15.99:0/3605955875 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd90006270 con 0x7fcda4182a80 2024-02-21T23:06:06.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.516+0000 7fcda8a00640 1 -- 172.21.15.99:0/3605955875 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcda4220be0 con 0x7fcda4182a80 2024-02-21T23:06:06.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.517+0000 7fcda8a00640 1 -- 172.21.15.99:0/3605955875 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcda4068320 con 0x7fcda4182a80 2024-02-21T23:06:06.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.519+0000 7fcd9b400640 1 -- 172.21.15.99:0/3605955875 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7fcd90006410 con 0x7fcda4182a80 2024-02-21T23:06:06.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.521+0000 7fcd9b400640 1 --2- 172.21.15.99:0/3605955875 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fcd8409eed0 0x7fcd840a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:06.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.521+0000 7fcd9b400640 1 -- 172.21.15.99:0/3605955875 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7fcd9002f030 con 0x7fcda4182a80 2024-02-21T23:06:06.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.521+0000 7fcda3400640 1 --2- 172.21.15.99:0/3605955875 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fcd8409eed0 0x7fcd840a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:06.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.522+0000 7fcda3400640 1 --2- 172.21.15.99:0/3605955875 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fcd8409eed0 0x7fcd840a1390 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fcd94007fd0 tx=0x7fcd94009040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:06.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.524+0000 7fcd9b400640 1 -- 172.21.15.99:0/3605955875 <== mon.2 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fcd9004b060 con 0x7fcda4182a80 2024-02-21T23:06:06.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.786+0000 7fcda8a00640 1 -- 172.21.15.99:0/3605955875 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcda40fba30 con 0x7fcda4182a80 2024-02-21T23:06:06.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.787+0000 7fcd9b400640 1 -- 172.21.15.99:0/3605955875 <== mon.2 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+11336 (secure 0 0 0) 0x7fcd900ba290 con 0x7fcda4182a80 2024-02-21T23:06:06.777 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T23:06:06.777 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4307,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/3514452812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3514452812},{"type":"v1","addr":"172.21.15.162:6836","nonce":3514452812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4312,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6838/2169982089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":2169982089},{"type":"v1","addr":"172.21.15.162:6838","nonce":2169982089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4315,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6839/3335972724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6837","nonce":3335972724},{"type":"v1","addr":"172.21.15.162:6839","nonce":3335972724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4318,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6841/2135456697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6840","nonce":2135456697},{"type":"v1","addr":"172.21.15.162:6841","nonce":2135456697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4325,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2452242758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2452242758},{"type":"v1","addr":"172.21.15.181:6833","nonce":2452242758}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4328,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6836/2751486400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":2751486400},{"type":"v1","addr":"172.21.15.181:6836","nonce":2751486400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":16,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-21T23:01:02.656130+0000","modified":"2024-02-21T23:03:58.159765+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4355,"mds_1":4352,"mds_2":4348},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4331":{"gid":4331,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6838/3728901330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6835","nonce":3728901330},{"type":"v1","addr":"172.21.15.181:6838","nonce":3728901330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4339":{"gid":4339,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6839/3357929641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6837","nonce":3357929641},{"type":"v1","addr":"172.21.15.181:6839","nonce":3357929641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4343":{"gid":4343,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6833/2793485078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":2793485078},{"type":"v1","addr":"172.21.15.99:6833","nonce":2793485078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4348":{"gid":4348,"name":"d","rank":2,"incarnation":12,"state":"up:active","state_seq":10,"addr":"172.21.15.99:6835/2243461688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2243461688},{"type":"v1","addr":"172.21.15.99:6835","nonce":2243461688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4352":{"gid":4352,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.99:6837/1676159950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":1676159950},{"type":"v1","addr":"172.21.15.99:6837","nonce":1676159950}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4355":{"gid":4355,"name":"j","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6839/4239008786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":4239008786},{"type":"v1","addr":"172.21.15.99:6839","nonce":4239008786}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-21T23:06:06.777 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 16 2024-02-21T23:06:06.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.790+0000 7fcda8a00640 1 -- 172.21.15.99:0/3605955875 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fcd8409eed0 msgr2=0x7fcd840a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:06.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.790+0000 7fcda8a00640 1 --2- 172.21.15.99:0/3605955875 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fcd8409eed0 0x7fcd840a1390 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fcd94007fd0 tx=0x7fcd94009040 comp rx=0 tx=0).stop 2024-02-21T23:06:06.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.790+0000 7fcda8a00640 1 -- 172.21.15.99:0/3605955875 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcda4182a80 msgr2=0x7fcda40fe7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:06.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.791+0000 7fcda8a00640 1 --2- 172.21.15.99:0/3605955875 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcda4182a80 0x7fcda40fe7d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fcda40fbf40 tx=0x7fcd900046c0 comp rx=0 tx=0).stop 2024-02-21T23:06:06.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.791+0000 7fcda8a00640 1 -- 172.21.15.99:0/3605955875 shutdown_connections 2024-02-21T23:06:06.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.791+0000 7fcda8a00640 1 --2- 172.21.15.99:0/3605955875 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fcd8409eed0 0x7fcd840a1390 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:06.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.791+0000 7fcda8a00640 1 --2- 172.21.15.99:0/3605955875 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcda418a010 0x7fcda42213e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:06.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.791+0000 7fcda8a00640 1 --2- 172.21.15.99:0/3605955875 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcda4182a80 0x7fcda40fe7d0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:06.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.791+0000 7fcda8a00640 1 --2- 172.21.15.99:0/3605955875 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcda40719b0 0x7fcda4179240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:06.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.791+0000 7fcda8a00640 1 -- 172.21.15.99:0/3605955875 >> 172.21.15.99:0/3605955875 conn(0x7fcda40d29f0 msgr2=0x7fcda4186990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:06:06.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.791+0000 7fcda8a00640 1 -- 172.21.15.99:0/3605955875 shutdown_connections 2024-02-21T23:06:06.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:06.791+0000 7fcda8a00640 1 -- 172.21.15.99:0/3605955875 wait complete. 2024-02-21T23:06:06.803 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T23:06:06.803 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-02-21T23:06:06.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.007+0000 7f5f45600640 1 Processor -- start 2024-02-21T23:06:06.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.007+0000 7f5f45600640 1 -- start start 2024-02-21T23:06:07.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.009+0000 7f5f45600640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f5f4017f490 0x7f5f4018ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:07.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.009+0000 7f5f45600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f400d6dd0 con 0x7f5f4018b4f0 2024-02-21T23:06:07.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.009+0000 7f5f45600640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f401614c0 con 0x7f5f4018b060 2024-02-21T23:06:07.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.009+0000 7f5f45600640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f400d6810 con 0x7f5f4017f490 2024-02-21T23:06:07.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.010+0000 7f5f3fe00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f5f4017f490 0x7f5f4018ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:07.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.010+0000 7f5f3f400640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f5f4018b060 0x7f5f40188a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:40308/0 (socket says 172.21.15.99:40308) 2024-02-21T23:06:07.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.010+0000 7f5f3f400640 1 -- 172.21.15.99:0/1482944969 learned_addr learned my addr 172.21.15.99:0/1482944969 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:06:07.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.010+0000 7f5f3fe00640 1 -- 172.21.15.99:0/1482944969 >> v1:172.21.15.181:6789/0 conn(0x7f5f4018b060 legacy=0x7f5f40188a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:07.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.010+0000 7f5f3fe00640 1 -- 172.21.15.99:0/1482944969 >> v1:172.21.15.162:6789/0 conn(0x7f5f4018b4f0 legacy=0x7f5f40189150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:07.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.010+0000 7f5f3fe00640 1 -- 172.21.15.99:0/1482944969 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f400d6af0 con 0x7f5f4017f490 2024-02-21T23:06:07.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.011+0000 7f5f3fe00640 1 --2- 172.21.15.99:0/1482944969 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5f4017f490 0x7f5f4018ab20 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f5f300097a0 tx=0x7f5f3002b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=455d6eaf5ca6d955 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:07.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.012+0000 7f5f3ea00640 1 -- 172.21.15.99:0/1482944969 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f30034070 con 0x7f5f4017f490 2024-02-21T23:06:07.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.012+0000 7f5f3ea00640 1 -- 172.21.15.99:0/1482944969 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f30030610 con 0x7f5f4017f490 2024-02-21T23:06:07.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.012+0000 7f5f3ea00640 1 -- 172.21.15.99:0/1482944969 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f300309e0 con 0x7f5f4017f490 2024-02-21T23:06:07.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.012+0000 7f5f45600640 1 -- 172.21.15.99:0/1482944969 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5f4017f490 msgr2=0x7f5f4018ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:07.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.012+0000 7f5f45600640 1 --2- 172.21.15.99:0/1482944969 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5f4017f490 0x7f5f4018ab20 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f5f300097a0 tx=0x7f5f3002b960 comp rx=0 tx=0).stop 2024-02-21T23:06:07.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.012+0000 7f5f45600640 1 -- 172.21.15.99:0/1482944969 shutdown_connections 2024-02-21T23:06:07.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.012+0000 7f5f45600640 1 --2- 172.21.15.99:0/1482944969 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5f4017f490 0x7f5f4018ab20 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.012+0000 7f5f45600640 1 -- 172.21.15.99:0/1482944969 >> 172.21.15.99:0/1482944969 conn(0x7f5f400d29b0 msgr2=0x7f5f400d2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:06:07.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.012+0000 7f5f45600640 1 -- 172.21.15.99:0/1482944969 shutdown_connections 2024-02-21T23:06:07.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.012+0000 7f5f45600640 1 -- 172.21.15.99:0/1482944969 wait complete. 2024-02-21T23:06:07.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.014+0000 7f5f45600640 1 Processor -- start 2024-02-21T23:06:07.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.014+0000 7f5f45600640 1 -- start start 2024-02-21T23:06:07.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.016+0000 7f5f45600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5f4017f490 0x7f5f4021eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:07.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.016+0000 7f5f45600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5f4018b060 0x7f5f40180110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:07.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.016+0000 7f5f45600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f4018b4f0 0x7f5f400fcf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:07.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.016+0000 7f5f45600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4018a600 con 0x7f5f4017f490 2024-02-21T23:06:07.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.016+0000 7f5f45600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4018a320 con 0x7f5f4018b4f0 2024-02-21T23:06:07.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.016+0000 7f5f45600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4017f870 con 0x7f5f4018b060 2024-02-21T23:06:07.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.016+0000 7f5f3fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5f4017f490 0x7f5f4021eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:07.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.016+0000 7f5f3fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5f4017f490 0x7f5f4021eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:41772/0 (socket says 172.21.15.99:41772) 2024-02-21T23:06:07.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.016+0000 7f5f3f400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5f4018b060 0x7f5f40180110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:07.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.016+0000 7f5f3fe00640 1 -- 172.21.15.99:0/1738412293 learned_addr learned my addr 172.21.15.99:0/1738412293 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:06:07.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.016+0000 7f5f44c00640 1 --2- 172.21.15.99:0/1738412293 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f4018b4f0 0x7f5f400fcf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:07.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.017+0000 7f5f44c00640 1 -- 172.21.15.99:0/1738412293 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5f4018b060 msgr2=0x7f5f40180110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:07.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.017+0000 7f5f44c00640 1 --2- 172.21.15.99:0/1738412293 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5f4018b060 0x7f5f40180110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.017+0000 7f5f44c00640 1 -- 172.21.15.99:0/1738412293 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5f4017f490 msgr2=0x7f5f4021eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:07.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.017+0000 7f5f44c00640 1 --2- 172.21.15.99:0/1738412293 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5f4017f490 0x7f5f4021eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.017+0000 7f5f44c00640 1 -- 172.21.15.99:0/1738412293 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f400fc780 con 0x7f5f4018b4f0 2024-02-21T23:06:07.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.017+0000 7f5f3fe00640 1 --2- 172.21.15.99:0/1738412293 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5f4017f490 0x7f5f4021eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:06:07.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.017+0000 7f5f3f400640 1 --2- 172.21.15.99:0/1738412293 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5f4018b060 0x7f5f40180110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:06:07.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.017+0000 7f5f44c00640 1 --2- 172.21.15.99:0/1738412293 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f4018b4f0 0x7f5f400fcf10 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5f3800c700 tx=0x7f5f3800cbc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:07.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.017+0000 7f5f37e00640 1 -- 172.21.15.99:0/1738412293 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f38003b70 con 0x7f5f4018b4f0 2024-02-21T23:06:07.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.017+0000 7f5f37e00640 1 -- 172.21.15.99:0/1738412293 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f38003d10 con 0x7f5f4018b4f0 2024-02-21T23:06:07.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.017+0000 7f5f45600640 1 -- 172.21.15.99:0/1738412293 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f4021f4c0 con 0x7f5f4018b4f0 2024-02-21T23:06:07.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.017+0000 7f5f37e00640 1 -- 172.21.15.99:0/1738412293 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f38005310 con 0x7f5f4018b4f0 2024-02-21T23:06:07.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.018+0000 7f5f45600640 1 -- 172.21.15.99:0/1738412293 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f4021fa80 con 0x7f5f4018b4f0 2024-02-21T23:06:07.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.022+0000 7f5f49be3740 1 Processor -- start 2024-02-21T23:06:07.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.022+0000 7f5f37e00640 1 -- 172.21.15.99:0/1738412293 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f5f380054b0 con 0x7f5f4018b4f0 2024-02-21T23:06:07.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.023+0000 7f5f49be3740 1 -- start start 2024-02-21T23:06:07.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.024+0000 7f5f49be3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ea384d0660 0x55ea384d0a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:07.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.024+0000 7f5f49be3740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ea3850b330 0x55ea3850b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:07.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.024+0000 7f5f49be3740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ea3850bcf0 0x55ea3850c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:07.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.024+0000 7f5f49be3740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea383f8b50 con 0x55ea3850bcf0 2024-02-21T23:06:07.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.024+0000 7f5f49be3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea383a1da0 con 0x55ea384d0660 2024-02-21T23:06:07.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.024+0000 7f5f49be3740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea383f4bf0 con 0x55ea3850b330 2024-02-21T23:06:07.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.024+0000 7f5f3f400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ea384d0660 0x55ea384d0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:07.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.024+0000 7f5f3f400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ea384d0660 0x55ea384d0a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:46406/0 (socket says 172.21.15.99:46406) 2024-02-21T23:06:07.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.024+0000 7f5f3f400640 1 -- 172.21.15.99:0/3028197833 learned_addr learned my addr 172.21.15.99:0/3028197833 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:06:07.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.024+0000 7f5f3fe00640 1 --2- 172.21.15.99:0/3028197833 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ea3850b330 0x55ea3850b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:07.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.024+0000 7f5f3f400640 1 --2- 172.21.15.99:0/3028197833 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ea3850bcf0 0x55ea3850c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:07.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.025+0000 7f5f37e00640 1 --2- 172.21.15.99:0/1738412293 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f5f2009ef00 0x7f5f200a13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:07.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.025+0000 7f5f3fe00640 1 -- 172.21.15.99:0/3028197833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ea384d0660 msgr2=0x55ea384d0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:07.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.025+0000 7f5f3fe00640 1 --2- 172.21.15.99:0/3028197833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ea384d0660 0x55ea384d0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.025+0000 7f5f3fe00640 1 -- 172.21.15.99:0/3028197833 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ea3850bcf0 msgr2=0x55ea3850c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:07.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.025+0000 7f5f3fe00640 1 --2- 172.21.15.99:0/3028197833 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ea3850bcf0 0x55ea3850c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.025+0000 7f5f3fe00640 1 -- 172.21.15.99:0/3028197833 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ea383c4f80 con 0x55ea3850b330 2024-02-21T23:06:07.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.025+0000 7f5f37e00640 1 -- 172.21.15.99:0/1738412293 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f5f380c9bc0 con 0x7f5f4018b4f0 2024-02-21T23:06:07.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.025+0000 7f5f44c00640 1 --2- 172.21.15.99:0/1738412293 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f5f2009ef00 0x7f5f200a13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:07.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.025+0000 7f5f3fe00640 1 --2- 172.21.15.99:0/3028197833 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ea3850b330 0x55ea3850b7b0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f5f402163a0 tx=0x7f5f30008030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e806ae707d81a7 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:07.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.026+0000 7f5f2be00640 1 -- 172.21.15.99:0/3028197833 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f30034040 con 0x55ea3850b330 2024-02-21T23:06:07.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.026+0000 7f5f2be00640 1 -- 172.21.15.99:0/3028197833 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f3004a070 con 0x55ea3850b330 2024-02-21T23:06:07.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.026+0000 7f5f2be00640 1 -- 172.21.15.99:0/3028197833 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f30039650 con 0x55ea3850b330 2024-02-21T23:06:07.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.026+0000 7f5f49be3740 1 -- 172.21.15.99:0/3028197833 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ea3850b330 msgr2=0x55ea3850b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:07.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.026+0000 7f5f49be3740 1 --2- 172.21.15.99:0/3028197833 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ea3850b330 0x55ea3850b7b0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f5f402163a0 tx=0x7f5f30008030 comp rx=0 tx=0).stop 2024-02-21T23:06:07.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.026+0000 7f5f44c00640 1 --2- 172.21.15.99:0/1738412293 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f5f2009ef00 0x7f5f200a13c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5f380c7800 tx=0x7f5f38005040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:07.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.026+0000 7f5f49be3740 1 -- 172.21.15.99:0/3028197833 shutdown_connections 2024-02-21T23:06:07.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.026+0000 7f5f49be3740 1 --2- 172.21.15.99:0/3028197833 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ea3850bcf0 0x55ea3850c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.026+0000 7f5f49be3740 1 --2- 172.21.15.99:0/3028197833 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ea3850b330 0x55ea3850b7b0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.026+0000 7f5f49be3740 1 --2- 172.21.15.99:0/3028197833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ea384d0660 0x55ea384d0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.026+0000 7f5f49be3740 1 -- 172.21.15.99:0/3028197833 >> 172.21.15.99:0/3028197833 conn(0x55ea384926d0 msgr2=0x55ea38493750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:06:07.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.027+0000 7f5f49be3740 1 -- 172.21.15.99:0/3028197833 shutdown_connections 2024-02-21T23:06:07.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.027+0000 7f5f49be3740 1 -- 172.21.15.99:0/3028197833 wait complete. 2024-02-21T23:06:07.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.027+0000 7f5f49be3740 1 -- start start 2024-02-21T23:06:07.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.028+0000 7f5f49be3740 1 Processor -- start 2024-02-21T23:06:07.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.029+0000 7f5f49be3740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ea3850b330 0x55ea384cb3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:07.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.029+0000 7f5f49be3740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ea3850bcf0 0x55ea3848ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:07.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.029+0000 7f5f49be3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ea384d7850 0x55ea384d6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:07.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.029+0000 7f5f49be3740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea3850a0a0 con 0x55ea3850bcf0 2024-02-21T23:06:07.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.029+0000 7f5f49be3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea38397380 con 0x55ea384d7850 2024-02-21T23:06:07.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.029+0000 7f5f49be3740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea38509dc0 con 0x55ea3850b330 2024-02-21T23:06:07.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.029+0000 7f5f49be3740 10 client.0 _ll_register_callbacks cb 0x55ea383f0280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:06:07.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.029+0000 7f5f3fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ea3850bcf0 0x55ea3848ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:07.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.029+0000 7f5f3fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ea3850bcf0 0x55ea3848ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:41790/0 (socket says 172.21.15.99:41790) 2024-02-21T23:06:07.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.029+0000 7f5f3fe00640 1 -- 172.21.15.99:0/1590500463 learned_addr learned my addr 172.21.15.99:0/1590500463 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:06:07.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.029+0000 7f5f3f400640 1 --2- 172.21.15.99:0/1590500463 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ea384d7850 0x55ea384d6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:07.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.030+0000 7f5f3f400640 1 --2- 172.21.15.99:0/1590500463 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ea3850b330 0x55ea384cb3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:07.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.030+0000 7f5f3fe00640 1 -- 172.21.15.99:0/1590500463 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ea3850b330 msgr2=0x55ea384cb3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:07.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.030+0000 7f5f3fe00640 1 --2- 172.21.15.99:0/1590500463 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ea3850b330 0x55ea384cb3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.030+0000 7f5f3fe00640 1 -- 172.21.15.99:0/1590500463 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ea384d7850 msgr2=0x55ea384d6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:07.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.030+0000 7f5f3fe00640 1 --2- 172.21.15.99:0/1590500463 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ea384d7850 0x55ea384d6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.030+0000 7f5f3fe00640 1 -- 172.21.15.99:0/1590500463 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ea383bfc20 con 0x55ea3850bcf0 2024-02-21T23:06:07.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.030+0000 7f5f3fe00640 1 --2- 172.21.15.99:0/1590500463 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ea3850bcf0 0x55ea3848ee70 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f5f300098c0 tx=0x7f5f30004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=805b5122d4ec6aad server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:07.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.030+0000 7f5f28c00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:06:07.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.031+0000 7f5f28c00640 1 -- 172.21.15.99:0/1590500463 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f30034050 con 0x55ea3850bcf0 2024-02-21T23:06:07.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.031+0000 7f5f49be3740 1 -- 172.21.15.99:0/1590500463 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5f3004a070 con 0x55ea3850bcf0 2024-02-21T23:06:07.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.031+0000 7f5f28c00640 1 -- 172.21.15.99:0/1590500463 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f5f30003810 con 0x55ea3850bcf0 2024-02-21T23:06:07.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.031+0000 7f5f28c00640 1 -- 172.21.15.99:0/1590500463 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5f30006a20 con 0x55ea3850bcf0 2024-02-21T23:06:07.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.031+0000 7f5f49be3740 10 client.5850 fetch_fsmap learned FSMap version 16 2024-02-21T23:06:07.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.031+0000 7f5f49be3740 1 -- 172.21.15.99:0/1590500463 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55ea3810d3f0 con 0x55ea3850bcf0 2024-02-21T23:06:07.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.031+0000 7f5f28c00640 1 -- 172.21.15.99:0/1590500463 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f3004a070 con 0x55ea3850bcf0 2024-02-21T23:06:07.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.031+0000 7f5f28c00640 1 -- 172.21.15.99:0/1590500463 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f5f3002f050 con 0x55ea3850bcf0 2024-02-21T23:06:07.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.032+0000 7f5f49be3740 10 client.5850 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T23:06:07.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.032+0000 7f5f49be3740 10 client.5850 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.d 2024-02-21T23:06:07.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.032+0000 7f5f49be3740 20 client.5850 populate_metadata read hostname 'smithi099' 2024-02-21T23:06:07.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.032+0000 7f5f49be3740 1 --2- 172.21.15.99:0/1590500463 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x55ea384fa510 0x55ea384ca8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:07.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.032+0000 7f5f49be3740 4 client.5850 mds_command: new command op to 4348 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:06:07.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.032+0000 7f5f49be3740 1 -- 172.21.15.99:0/1590500463 --> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ea38406090 con 0x55ea384fa510 2024-02-21T23:06:07.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.032+0000 7f5f3f400640 1 --2- 172.21.15.99:0/1590500463 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x55ea384fa510 0x55ea384ca8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:07.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.033+0000 7f5f3f400640 1 --2- 172.21.15.99:0/1590500463 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x55ea384fa510 0x55ea384ca8a0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=89a494a801a7494b server_cookie=1f029baf4c6c30b1 in_seq=0 out_seq=0 2024-02-21T23:06:07.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.033+0000 7f5f28c00640 10 client.5850 ms_handle_connect on v2:172.21.15.99:6834/2243461688 2024-02-21T23:06:07.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.033+0000 7f5f28c00640 1 -- 172.21.15.99:0/1590500463 <== mds.2 v2:172.21.15.99:6834/2243461688 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55ea38406090 con 0x55ea384fa510 2024-02-21T23:06:07.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.033+0000 7f5f28c00640 10 client.5850 handle_command_reply: tid=0 2024-02-21T23:06:07.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.034+0000 7f5f49be3740 1 client.5850 shutdown 2024-02-21T23:06:07.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.034+0000 7f5f49be3740 1 -- 172.21.15.99:0/1590500463 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ea3850bcf0 msgr2=0x55ea3848ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:07.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.034+0000 7f5f49be3740 1 --2- 172.21.15.99:0/1590500463 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ea3850bcf0 0x55ea3848ee70 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f5f300098c0 tx=0x7f5f30004730 comp rx=0 tx=0).stop 2024-02-21T23:06:07.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.034+0000 7f5f49be3740 1 -- 172.21.15.99:0/1590500463 shutdown_connections 2024-02-21T23:06:07.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.034+0000 7f5f49be3740 1 --2- 172.21.15.99:0/1590500463 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x55ea384fa510 0x55ea384ca8a0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.034+0000 7f5f49be3740 1 --2- 172.21.15.99:0/1590500463 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ea384d7850 0x55ea384d6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.034+0000 7f5f28c00640 0 client.5850 ms_handle_reset on v2:172.21.15.99:6834/2243461688 2024-02-21T23:06:07.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.034+0000 7f5f49be3740 1 --2- 172.21.15.99:0/1590500463 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ea3850bcf0 0x55ea3848ee70 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.034+0000 7f5f49be3740 1 --2- 172.21.15.99:0/1590500463 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ea3850b330 0x55ea384cb3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.034+0000 7f5f49be3740 1 -- 172.21.15.99:0/1590500463 >> 172.21.15.99:0/1590500463 conn(0x55ea384d0660 msgr2=0x55ea3850a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:06:07.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.034+0000 7f5f49be3740 1 -- 172.21.15.99:0/1590500463 shutdown_connections 2024-02-21T23:06:07.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.034+0000 7f5f49be3740 1 -- 172.21.15.99:0/1590500463 wait complete. 2024-02-21T23:06:07.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.035+0000 7f5f49be3740 20 client.5850 trim_cache size 0 max 16384 2024-02-21T23:06:07.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.048+0000 7f5f49be3740 1 Processor -- start 2024-02-21T23:06:07.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.048+0000 7f5f49be3740 1 -- start start 2024-02-21T23:06:07.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.049+0000 7f5f49be3740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ea384d7850 0x55ea384da770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:07.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.050+0000 7f5f49be3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ea384fa510 0x55ea384d5e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:07.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.050+0000 7f5f49be3740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ea3850b330 0x55ea384dad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:07.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.050+0000 7f5f49be3740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4022c960 con 0x55ea3850b330 2024-02-21T23:06:07.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.050+0000 7f5f49be3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4022a500 con 0x55ea384fa510 2024-02-21T23:06:07.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.050+0000 7f5f49be3740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f40223180 con 0x55ea384d7850 2024-02-21T23:06:07.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.050+0000 7f5f3f400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ea384d7850 0x55ea384da770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:07.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.050+0000 7f5f3f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ea3850b330 0x55ea384dad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:07.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.050+0000 7f5f3fe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ea384fa510 0x55ea384d5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:07.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.050+0000 7f5f3f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ea3850b330 0x55ea384dad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:41804/0 (socket says 172.21.15.99:41804) 2024-02-21T23:06:07.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.050+0000 7f5f3f400640 1 -- 172.21.15.99:0/516279345 learned_addr learned my addr 172.21.15.99:0/516279345 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:06:07.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.050+0000 7f5f3fe00640 1 -- 172.21.15.99:0/516279345 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ea384d7850 msgr2=0x55ea384da770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:07.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.050+0000 7f5f3fe00640 1 --2- 172.21.15.99:0/516279345 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ea384d7850 0x55ea384da770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.050+0000 7f5f3fe00640 1 -- 172.21.15.99:0/516279345 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ea3850b330 msgr2=0x55ea384dad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:07.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.050+0000 7f5f3fe00640 1 --2- 172.21.15.99:0/516279345 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ea3850b330 0x55ea384dad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.050+0000 7f5f3fe00640 1 -- 172.21.15.99:0/516279345 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ea381d77d0 con 0x55ea384fa510 2024-02-21T23:06:07.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.050+0000 7f5f3f400640 1 --2- 172.21.15.99:0/516279345 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ea384d7850 0x55ea384da770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:06:07.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.051+0000 7f5f3fe00640 1 --2- 172.21.15.99:0/516279345 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ea384fa510 0x55ea384d5e50 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f5f300097a0 tx=0x7f5f3004f000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5709b1711ec60f3 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:07.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.051+0000 7f5f2b400640 1 -- 172.21.15.99:0/516279345 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f30034070 con 0x55ea384fa510 2024-02-21T23:06:07.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.051+0000 7f5f2b400640 1 -- 172.21.15.99:0/516279345 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f3004a040 con 0x55ea384fa510 2024-02-21T23:06:07.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.051+0000 7f5f2b400640 1 -- 172.21.15.99:0/516279345 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f30003610 con 0x55ea384fa510 2024-02-21T23:06:07.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.052+0000 7f5f49be3740 1 -- 172.21.15.99:0/516279345 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ea384fa510 msgr2=0x55ea384d5e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:07.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.052+0000 7f5f49be3740 1 --2- 172.21.15.99:0/516279345 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ea384fa510 0x55ea384d5e50 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f5f300097a0 tx=0x7f5f3004f000 comp rx=0 tx=0).stop 2024-02-21T23:06:07.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.052+0000 7f5f49be3740 1 -- 172.21.15.99:0/516279345 shutdown_connections 2024-02-21T23:06:07.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.052+0000 7f5f49be3740 1 --2- 172.21.15.99:0/516279345 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ea3850b330 0x55ea384dad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.052+0000 7f5f49be3740 1 --2- 172.21.15.99:0/516279345 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ea384fa510 0x55ea384d5e50 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.052+0000 7f5f49be3740 1 --2- 172.21.15.99:0/516279345 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ea384d7850 0x55ea384da770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.052+0000 7f5f49be3740 1 -- 172.21.15.99:0/516279345 >> 172.21.15.99:0/516279345 conn(0x55ea384d0660 msgr2=0x55ea385097c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:06:07.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.052+0000 7f5f49be3740 1 -- 172.21.15.99:0/516279345 shutdown_connections 2024-02-21T23:06:07.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.052+0000 7f5f49be3740 1 -- 172.21.15.99:0/516279345 wait complete. 2024-02-21T23:06:07.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.053+0000 7f5f49be3740 1 -- start start 2024-02-21T23:06:07.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.054+0000 7f5f49be3740 1 Processor -- start 2024-02-21T23:06:07.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.055+0000 7f5f49be3740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ea384d7850 0x55ea38514f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:07.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.055+0000 7f5f49be3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ea384fa510 0x55ea384d2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:07.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.055+0000 7f5f49be3740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ea3850b330 0x55ea38563540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:07.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.055+0000 7f5f49be3740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4018cad0 con 0x55ea384d7850 2024-02-21T23:06:07.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.055+0000 7f5f49be3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f40229ee0 con 0x55ea384fa510 2024-02-21T23:06:07.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.055+0000 7f5f49be3740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f402292e0 con 0x55ea3850b330 2024-02-21T23:06:07.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.055+0000 7f5f49be3740 10 client.0 _ll_register_callbacks cb 0x7f5f2c016300 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:06:07.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.055+0000 7f5f3f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ea384d7850 0x55ea38514f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:07.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.055+0000 7f5f3f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ea384d7850 0x55ea38514f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:41814/0 (socket says 172.21.15.99:41814) 2024-02-21T23:06:07.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.055+0000 7f5f3f400640 1 -- 172.21.15.99:0/93070026 learned_addr learned my addr 172.21.15.99:0/93070026 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:06:07.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.056+0000 7f5f3fe00640 1 --2- 172.21.15.99:0/93070026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ea384fa510 0x55ea384d2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:07.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.056+0000 7f5f3f400640 1 --2- 172.21.15.99:0/93070026 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ea3850b330 0x55ea38563540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:07.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.056+0000 7f5f3f400640 1 -- 172.21.15.99:0/93070026 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ea3850b330 msgr2=0x55ea38563540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:07.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.056+0000 7f5f3f400640 1 --2- 172.21.15.99:0/93070026 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ea3850b330 0x55ea38563540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.056+0000 7f5f3f400640 1 -- 172.21.15.99:0/93070026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ea384fa510 msgr2=0x55ea384d2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:07.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.056+0000 7f5f3f400640 1 --2- 172.21.15.99:0/93070026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ea384fa510 0x55ea384d2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.056+0000 7f5f3f400640 1 -- 172.21.15.99:0/93070026 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ea384ca000 con 0x55ea384d7850 2024-02-21T23:06:07.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.056+0000 7f5f3fe00640 1 --2- 172.21.15.99:0/93070026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ea384fa510 0x55ea384d2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:06:07.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.056+0000 7f5f3f400640 1 --2- 172.21.15.99:0/93070026 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ea384d7850 0x55ea38514f20 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c000f60 tx=0x7f5f2c01c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56a8fa88850da472 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:07.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.056+0000 7f5f28c00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:06:07.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.057+0000 7f5f28c00640 1 -- 172.21.15.99:0/93070026 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2c010040 con 0x55ea384d7850 2024-02-21T23:06:07.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.057+0000 7f5f49be3740 1 -- 172.21.15.99:0/93070026 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5f3004a040 con 0x55ea384d7850 2024-02-21T23:06:07.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.057+0000 7f5f28c00640 1 -- 172.21.15.99:0/93070026 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f5f2c025bf0 con 0x55ea384d7850 2024-02-21T23:06:07.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.057+0000 7f5f28c00640 1 -- 172.21.15.99:0/93070026 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5f2c025df0 con 0x55ea384d7850 2024-02-21T23:06:07.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.057+0000 7f5f49be3740 10 client.5856 fetch_fsmap learned FSMap version 16 2024-02-21T23:06:07.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.057+0000 7f5f49be3740 1 -- 172.21.15.99:0/93070026 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55ea384d3260 con 0x55ea384d7850 2024-02-21T23:06:07.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.057+0000 7f5f28c00640 1 -- 172.21.15.99:0/93070026 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f3004a040 con 0x55ea384d7850 2024-02-21T23:06:07.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.057+0000 7f5f28c00640 1 -- 172.21.15.99:0/93070026 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f5f2c0058b0 con 0x55ea384d7850 2024-02-21T23:06:07.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.058+0000 7f5f49be3740 10 client.5856 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T23:06:07.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.058+0000 7f5f49be3740 10 client.5856 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.d 2024-02-21T23:06:07.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.058+0000 7f5f49be3740 20 client.5856 populate_metadata read hostname 'smithi099' 2024-02-21T23:06:07.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.058+0000 7f5f49be3740 1 --2- 172.21.15.99:0/93070026 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x55ea3850bcf0 0x55ea3849ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:07.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.058+0000 7f5f49be3740 4 client.5856 mds_command: new command op to 4348 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T23:06:07.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.058+0000 7f5f49be3740 1 -- 172.21.15.99:0/93070026 --> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55ea38492e30 con 0x55ea3850bcf0 2024-02-21T23:06:07.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.058+0000 7f5f3fe00640 1 --2- 172.21.15.99:0/93070026 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x55ea3850bcf0 0x55ea3849ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:07.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.059+0000 7f5f3fe00640 1 --2- 172.21.15.99:0/93070026 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x55ea3850bcf0 0x55ea3849ab70 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a26a8467f48df034 server_cookie=ec0eac87be8af9f0 in_seq=0 out_seq=0 2024-02-21T23:06:07.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.059+0000 7f5f28c00640 10 client.5856 ms_handle_connect on v2:172.21.15.99:6834/2243461688 2024-02-21T23:06:07.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.059+0000 7f5f28c00640 1 -- 172.21.15.99:0/93070026 <== mds.2 v2:172.21.15.99:6834/2243461688 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55ea38492e30 con 0x55ea3850bcf0 2024-02-21T23:06:07.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.059+0000 7f5f28c00640 10 client.5856 handle_command_reply: tid=0 2024-02-21T23:06:07.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.059+0000 7f5f49be3740 1 client.5856 shutdown 2024-02-21T23:06:07.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.059+0000 7f5f49be3740 1 -- 172.21.15.99:0/93070026 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ea384d7850 msgr2=0x55ea38514f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:07.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.059+0000 7f5f49be3740 1 --2- 172.21.15.99:0/93070026 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ea384d7850 0x55ea38514f20 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c000f60 tx=0x7f5f2c01c040 comp rx=0 tx=0).stop 2024-02-21T23:06:07.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.059+0000 7f5f49be3740 1 -- 172.21.15.99:0/93070026 shutdown_connections 2024-02-21T23:06:07.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.059+0000 7f5f49be3740 1 --2- 172.21.15.99:0/93070026 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x55ea3850bcf0 0x55ea3849ab70 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.059+0000 7f5f49be3740 1 --2- 172.21.15.99:0/93070026 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ea3850b330 0x55ea38563540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.059+0000 7f5f49be3740 1 --2- 172.21.15.99:0/93070026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ea384fa510 0x55ea384d2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.059+0000 7f5f49be3740 1 --2- 172.21.15.99:0/93070026 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ea384d7850 0x55ea38514f20 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.059+0000 7f5f49be3740 1 -- 172.21.15.99:0/93070026 >> 172.21.15.99:0/93070026 conn(0x55ea384d0660 msgr2=0x55ea384cf910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:06:07.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.059+0000 7f5f28c00640 0 client.5856 ms_handle_reset on v2:172.21.15.99:6834/2243461688 2024-02-21T23:06:07.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.059+0000 7f5f49be3740 1 -- 172.21.15.99:0/93070026 shutdown_connections 2024-02-21T23:06:07.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.059+0000 7f5f49be3740 1 -- 172.21.15.99:0/93070026 wait complete. 2024-02-21T23:06:07.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.060+0000 7f5f49be3740 20 client.5856 trim_cache size 0 max 16384 2024-02-21T23:06:07.058 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-02-21T23:06:07.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.060+0000 7f5f45600640 1 -- 172.21.15.99:0/1738412293 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f5f2009ef00 msgr2=0x7f5f200a13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:07.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.060+0000 7f5f45600640 1 --2- 172.21.15.99:0/1738412293 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f5f2009ef00 0x7f5f200a13c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5f380c7800 tx=0x7f5f38005040 comp rx=0 tx=0).stop 2024-02-21T23:06:07.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.060+0000 7f5f45600640 1 -- 172.21.15.99:0/1738412293 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f4018b4f0 msgr2=0x7f5f400fcf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:07.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.060+0000 7f5f45600640 1 --2- 172.21.15.99:0/1738412293 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f4018b4f0 0x7f5f400fcf10 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5f3800c700 tx=0x7f5f3800cbc0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.060+0000 7f5f45600640 1 -- 172.21.15.99:0/1738412293 shutdown_connections 2024-02-21T23:06:07.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.060+0000 7f5f45600640 1 --2- 172.21.15.99:0/1738412293 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f5f2009ef00 0x7f5f200a13c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.060+0000 7f5f45600640 1 --2- 172.21.15.99:0/1738412293 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f4018b4f0 0x7f5f400fcf10 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.060+0000 7f5f45600640 1 --2- 172.21.15.99:0/1738412293 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5f4018b060 0x7f5f40180110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.060+0000 7f5f45600640 1 --2- 172.21.15.99:0/1738412293 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5f4017f490 0x7f5f4021eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.060+0000 7f5f45600640 1 -- 172.21.15.99:0/1738412293 >> 172.21.15.99:0/1738412293 conn(0x7f5f400d29b0 msgr2=0x7f5f400d2d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:06:07.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.061+0000 7f5f45600640 1 -- 172.21.15.99:0/1738412293 shutdown_connections 2024-02-21T23:06:07.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.061+0000 7f5f45600640 1 -- 172.21.15.99:0/1738412293 wait complete. 2024-02-21T23:06:07.068 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T23:06:07.068 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-02-21T23:06:07.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.308+0000 7f11bdc00640 1 Processor -- start 2024-02-21T23:06:07.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.308+0000 7f11bdc00640 1 -- start start 2024-02-21T23:06:07.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.311+0000 7f11bdc00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f11b817f490 0x7f11b818ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:07.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.311+0000 7f11bdc00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11b80d6dd0 con 0x7f11b818b4f0 2024-02-21T23:06:07.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.312+0000 7f11bdc00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11b81614c0 con 0x7f11b818b060 2024-02-21T23:06:07.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.312+0000 7f11bdc00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11b80d6810 con 0x7f11b817f490 2024-02-21T23:06:07.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.312+0000 7f11bd200640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f11b818b4f0 0x7f11b8189150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:50788/0 (socket says 172.21.15.99:50788) 2024-02-21T23:06:07.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.312+0000 7f11bd200640 1 -- 172.21.15.99:0/1063661812 learned_addr learned my addr 172.21.15.99:0/1063661812 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:06:07.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.312+0000 7f11b7e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f11b817f490 0x7f11b818ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:07.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.312+0000 7f11b7e00640 1 -- 172.21.15.99:0/1063661812 >> v1:172.21.15.181:6789/0 conn(0x7f11b818b060 legacy=0x7f11b8188a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:07.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.312+0000 7f11b6a00640 1 -- 172.21.15.99:0/1063661812 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3844372229 0 0) 0x7f11b80d6dd0 con 0x7f11b818b4f0 2024-02-21T23:06:07.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.312+0000 7f11b7e00640 1 -- 172.21.15.99:0/1063661812 >> v1:172.21.15.99:6789/0 conn(0x7f11b818b4f0 legacy=0x7f11b8189150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:07.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.312+0000 7f11b7e00640 1 -- 172.21.15.99:0/1063661812 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11b80d6af0 con 0x7f11b817f490 2024-02-21T23:06:07.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.314+0000 7f11b7e00640 1 --2- 172.21.15.99:0/1063661812 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f11b817f490 0x7f11b818ab20 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f11a8009720 tx=0x7f11a802b730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a249c762aa5e82a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:07.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.315+0000 7f11b6a00640 1 -- 172.21.15.99:0/1063661812 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a8037070 con 0x7f11b817f490 2024-02-21T23:06:07.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.315+0000 7f11b6a00640 1 -- 172.21.15.99:0/1063661812 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11a8030710 con 0x7f11b817f490 2024-02-21T23:06:07.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.315+0000 7f11b6a00640 1 -- 172.21.15.99:0/1063661812 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a8030ae0 con 0x7f11b817f490 2024-02-21T23:06:07.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.315+0000 7f11bdc00640 1 -- 172.21.15.99:0/1063661812 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f11b817f490 msgr2=0x7f11b818ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:07.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.315+0000 7f11bdc00640 1 --2- 172.21.15.99:0/1063661812 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f11b817f490 0x7f11b818ab20 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f11a8009720 tx=0x7f11a802b730 comp rx=0 tx=0).stop 2024-02-21T23:06:07.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.315+0000 7f11bdc00640 1 -- 172.21.15.99:0/1063661812 shutdown_connections 2024-02-21T23:06:07.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.315+0000 7f11bdc00640 1 --2- 172.21.15.99:0/1063661812 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f11b817f490 0x7f11b818ab20 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.315+0000 7f11bdc00640 1 -- 172.21.15.99:0/1063661812 >> 172.21.15.99:0/1063661812 conn(0x7f11b80d29b0 msgr2=0x7f11b80d2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:06:07.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.316+0000 7f11bdc00640 1 -- 172.21.15.99:0/1063661812 shutdown_connections 2024-02-21T23:06:07.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.316+0000 7f11bdc00640 1 -- 172.21.15.99:0/1063661812 wait complete. 2024-02-21T23:06:07.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.319+0000 7f11bdc00640 1 Processor -- start 2024-02-21T23:06:07.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.319+0000 7f11bdc00640 1 -- start start 2024-02-21T23:06:07.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.321+0000 7f11bdc00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11b817f490 0x7f11b806b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:07.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.321+0000 7f11bdc00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f11b818b060 0x7f11b8183070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:07.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.321+0000 7f11bdc00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11b818b4f0 0x7f11b8175280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:07.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.321+0000 7f11bdc00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11b818a600 con 0x7f11b818b4f0 2024-02-21T23:06:07.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.321+0000 7f11bdc00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11b818a320 con 0x7f11b818b060 2024-02-21T23:06:07.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.321+0000 7f11bdc00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11b817f870 con 0x7f11b817f490 2024-02-21T23:06:07.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.321+0000 7f11bd200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11b818b4f0 0x7f11b8175280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:07.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.321+0000 7f11b7400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f11b818b060 0x7f11b8183070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:07.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.321+0000 7f11b7e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11b817f490 0x7f11b806b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:07.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.321+0000 7f11b7400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f11b818b060 0x7f11b8183070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:46460/0 (socket says 172.21.15.99:46460) 2024-02-21T23:06:07.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.321+0000 7f11bd200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11b818b4f0 0x7f11b8175280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:41820/0 (socket says 172.21.15.99:41820) 2024-02-21T23:06:07.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.321+0000 7f11b7400640 1 -- 172.21.15.99:0/117097205 learned_addr learned my addr 172.21.15.99:0/117097205 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:06:07.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.322+0000 7f11b7400640 1 -- 172.21.15.99:0/117097205 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11b817f490 msgr2=0x7f11b806b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:07.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.322+0000 7f11b7400640 1 --2- 172.21.15.99:0/117097205 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11b817f490 0x7f11b806b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.322+0000 7f11b7400640 1 -- 172.21.15.99:0/117097205 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11b818b4f0 msgr2=0x7f11b8175280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:07.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.322+0000 7f11b7400640 1 --2- 172.21.15.99:0/117097205 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11b818b4f0 0x7f11b8175280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.322+0000 7f11b7400640 1 -- 172.21.15.99:0/117097205 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11b8185fd0 con 0x7f11b818b060 2024-02-21T23:06:07.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.322+0000 7f11b7400640 1 --2- 172.21.15.99:0/117097205 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f11b818b060 0x7f11b8183070 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f11a400c780 tx=0x7f11a400cc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:07.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.322+0000 7f11afe00640 1 -- 172.21.15.99:0/117097205 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a4005270 con 0x7f11b818b060 2024-02-21T23:06:07.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.322+0000 7f11afe00640 1 -- 172.21.15.99:0/117097205 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11a4005430 con 0x7f11b818b060 2024-02-21T23:06:07.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.322+0000 7f11afe00640 1 -- 172.21.15.99:0/117097205 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a400a880 con 0x7f11b818b060 2024-02-21T23:06:07.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.322+0000 7f11bdc00640 1 -- 172.21.15.99:0/117097205 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11b8183790 con 0x7f11b818b060 2024-02-21T23:06:07.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.323+0000 7f11bdc00640 1 -- 172.21.15.99:0/117097205 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11b8183d50 con 0x7f11b818b060 2024-02-21T23:06:07.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.326+0000 7f11afe00640 1 -- 172.21.15.99:0/117097205 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f11a400aa20 con 0x7f11b818b060 2024-02-21T23:06:07.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.327+0000 7f11c2064740 1 Processor -- start 2024-02-21T23:06:07.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.327+0000 7f11c2064740 1 -- start start 2024-02-21T23:06:07.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.327+0000 7f11afe00640 1 --2- 172.21.15.99:0/117097205 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f119809eed0 0x7f11980a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:07.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.328+0000 7f11afe00640 1 -- 172.21.15.99:0/117097205 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f11a40c9c20 con 0x7f11b818b060 2024-02-21T23:06:07.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.328+0000 7f11bd200640 1 --2- 172.21.15.99:0/117097205 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f119809eed0 0x7f11980a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:07.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.328+0000 7f11bd200640 1 --2- 172.21.15.99:0/117097205 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f119809eed0 0x7f11980a1390 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f11b818ad70 tx=0x7f11b0004d40 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:07.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.329+0000 7f11c2064740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bbf7610660 0x55bbf7610a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:07.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.329+0000 7f11c2064740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bbf764b330 0x55bbf764b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:07.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.329+0000 7f11c2064740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bbf764bcf0 0x55bbf764c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:07.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.329+0000 7f11c2064740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbf7538b50 con 0x55bbf764bcf0 2024-02-21T23:06:07.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.329+0000 7f11c2064740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbf74e1da0 con 0x55bbf7610660 2024-02-21T23:06:07.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.329+0000 7f11c2064740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbf7534bf0 con 0x55bbf764b330 2024-02-21T23:06:07.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.330+0000 7f11b7e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bbf7610660 0x55bbf7610a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:07.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.330+0000 7f11b7e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bbf7610660 0x55bbf7610a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:46468/0 (socket says 172.21.15.99:46468) 2024-02-21T23:06:07.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.330+0000 7f11b7e00640 1 -- 172.21.15.99:0/3871734811 learned_addr learned my addr 172.21.15.99:0/3871734811 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:06:07.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.330+0000 7f11bd200640 1 --2- 172.21.15.99:0/3871734811 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bbf764bcf0 0x55bbf764c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:07.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.330+0000 7f11b7400640 1 --2- 172.21.15.99:0/3871734811 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bbf764b330 0x55bbf764b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:07.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.330+0000 7f11b7400640 1 -- 172.21.15.99:0/3871734811 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bbf7610660 msgr2=0x55bbf7610a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:07.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.330+0000 7f11b7400640 1 --2- 172.21.15.99:0/3871734811 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bbf7610660 0x55bbf7610a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.330+0000 7f11b7400640 1 -- 172.21.15.99:0/3871734811 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bbf764bcf0 msgr2=0x55bbf764c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:07.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.330+0000 7f11b7400640 1 --2- 172.21.15.99:0/3871734811 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bbf764bcf0 0x55bbf764c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.330+0000 7f11b7400640 1 -- 172.21.15.99:0/3871734811 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bbf7504f80 con 0x55bbf764b330 2024-02-21T23:06:07.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.330+0000 7f11b7e00640 1 --2- 172.21.15.99:0/3871734811 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bbf7610660 0x55bbf7610a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:06:07.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.330+0000 7f11b7400640 1 --2- 172.21.15.99:0/3871734811 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bbf764b330 0x55bbf764b7b0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f11a40c72e0 tx=0x7f11a4097c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af9ea366f17bb21b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:07.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.331+0000 7f11acc00640 1 -- 172.21.15.99:0/3871734811 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a4082070 con 0x55bbf764b330 2024-02-21T23:06:07.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.331+0000 7f11acc00640 1 -- 172.21.15.99:0/3871734811 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11a409fc60 con 0x55bbf764b330 2024-02-21T23:06:07.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.331+0000 7f11acc00640 1 -- 172.21.15.99:0/3871734811 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a400ad10 con 0x55bbf764b330 2024-02-21T23:06:07.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.331+0000 7f11c2064740 1 -- 172.21.15.99:0/3871734811 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bbf764b330 msgr2=0x55bbf764b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:07.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.331+0000 7f11c2064740 1 --2- 172.21.15.99:0/3871734811 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bbf764b330 0x55bbf764b7b0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f11a40c72e0 tx=0x7f11a4097c80 comp rx=0 tx=0).stop 2024-02-21T23:06:07.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.331+0000 7f11c2064740 1 -- 172.21.15.99:0/3871734811 shutdown_connections 2024-02-21T23:06:07.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.331+0000 7f11c2064740 1 --2- 172.21.15.99:0/3871734811 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bbf764bcf0 0x55bbf764c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.331+0000 7f11c2064740 1 --2- 172.21.15.99:0/3871734811 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bbf764b330 0x55bbf764b7b0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.331+0000 7f11c2064740 1 --2- 172.21.15.99:0/3871734811 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bbf7610660 0x55bbf7610a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.331+0000 7f11c2064740 1 -- 172.21.15.99:0/3871734811 >> 172.21.15.99:0/3871734811 conn(0x55bbf75d26d0 msgr2=0x55bbf75d3750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:06:07.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.333+0000 7f11c2064740 1 -- 172.21.15.99:0/3871734811 shutdown_connections 2024-02-21T23:06:07.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.333+0000 7f11c2064740 1 -- 172.21.15.99:0/3871734811 wait complete. 2024-02-21T23:06:07.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.334+0000 7f11c2064740 1 -- start start 2024-02-21T23:06:07.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.334+0000 7f11c2064740 1 Processor -- start 2024-02-21T23:06:07.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.335+0000 7f11c2064740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bbf764b330 0x55bbf7640940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:07.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.335+0000 7f11c2064740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bbf764bcf0 0x55bbf7652b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:07.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.335+0000 7f11c2064740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bbf7644d40 0x55bbf7657f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:07.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.335+0000 7f11c2064740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbf764a0a0 con 0x55bbf764b330 2024-02-21T23:06:07.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.335+0000 7f11c2064740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbf74d7380 con 0x55bbf7644d40 2024-02-21T23:06:07.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.335+0000 7f11c2064740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbf7649dc0 con 0x55bbf764bcf0 2024-02-21T23:06:07.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.335+0000 7f11c2064740 10 client.0 _ll_register_callbacks cb 0x55bbf7530280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:06:07.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.335+0000 7f11b7400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bbf764bcf0 0x55bbf7652b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:07.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.335+0000 7f11b7400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bbf764bcf0 0x55bbf7652b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:40524/0 (socket says 172.21.15.99:40524) 2024-02-21T23:06:07.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.335+0000 7f11b7400640 1 -- 172.21.15.99:0/2115918316 learned_addr learned my addr 172.21.15.99:0/2115918316 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:06:07.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.335+0000 7f11bd200640 1 --2- 172.21.15.99:0/2115918316 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bbf7644d40 0x55bbf7657f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:07.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.336+0000 7f11bd200640 1 -- 172.21.15.99:0/2115918316 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bbf764bcf0 msgr2=0x55bbf7652b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:07.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.336+0000 7f11bd200640 1 --2- 172.21.15.99:0/2115918316 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bbf764bcf0 0x55bbf7652b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.336+0000 7f11bd200640 1 -- 172.21.15.99:0/2115918316 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bbf764b330 msgr2=0x55bbf7640940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:07.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.336+0000 7f11bd200640 1 --2- 172.21.15.99:0/2115918316 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bbf764b330 0x55bbf7640940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.336+0000 7f11bd200640 1 -- 172.21.15.99:0/2115918316 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bbf74ffc20 con 0x55bbf7644d40 2024-02-21T23:06:07.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.336+0000 7f11bd200640 1 --2- 172.21.15.99:0/2115918316 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bbf7644d40 0x55bbf7657f60 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f11b0004fd0 tx=0x7f11b00015c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c504cfb069b72b8 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:07.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.336+0000 7f11a1600640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-02-21T23:06:07.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.336+0000 7f11a1600640 1 -- 172.21.15.99:0/2115918316 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b00128a0 con 0x55bbf7644d40 2024-02-21T23:06:07.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.336+0000 7f11a1600640 1 -- 172.21.15.99:0/2115918316 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f11b0012a40 con 0x55bbf7644d40 2024-02-21T23:06:07.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.336+0000 7f11c2064740 1 -- 172.21.15.99:0/2115918316 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f11a409fc60 con 0x55bbf7644d40 2024-02-21T23:06:07.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.337+0000 7f11a1600640 1 -- 172.21.15.99:0/2115918316 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f11b002f050 con 0x55bbf7644d40 2024-02-21T23:06:07.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.337+0000 7f11c2064740 10 client.5998 fetch_fsmap learned FSMap version 16 2024-02-21T23:06:07.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.337+0000 7f11c2064740 1 -- 172.21.15.99:0/2115918316 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55bbf724d3f0 con 0x55bbf7644d40 2024-02-21T23:06:07.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.337+0000 7f11a1600640 1 -- 172.21.15.99:0/2115918316 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11a409fc60 con 0x55bbf7644d40 2024-02-21T23:06:07.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.337+0000 7f11a1600640 1 -- 172.21.15.99:0/2115918316 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f11b0012c40 con 0x55bbf7644d40 2024-02-21T23:06:07.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.337+0000 7f11c2064740 10 client.5998 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T23:06:07.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.337+0000 7f11c2064740 10 client.5998 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2024-02-21T23:06:07.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.337+0000 7f11c2064740 20 client.5998 populate_metadata read hostname 'smithi099' 2024-02-21T23:06:07.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.337+0000 7f11c2064740 1 --2- 172.21.15.99:0/2115918316 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x55bbf7658970 0x55bbf76549f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:07.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.337+0000 7f11c2064740 4 client.5998 mds_command: new command op to 4352 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:06:07.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.337+0000 7f11c2064740 1 -- 172.21.15.99:0/2115918316 --> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bbf7546090 con 0x55bbf7658970 2024-02-21T23:06:07.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.338+0000 7f11b7e00640 1 --2- 172.21.15.99:0/2115918316 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x55bbf7658970 0x55bbf76549f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:07.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.339+0000 7f11a1600640 10 client.5998 ms_handle_connect on v2:172.21.15.99:6836/1676159950 2024-02-21T23:06:07.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.339+0000 7f11b7e00640 1 --2- 172.21.15.99:0/2115918316 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x55bbf7658970 0x55bbf76549f0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=baae12dd89fb9934 server_cookie=184123bbd81de2e0 in_seq=0 out_seq=0 2024-02-21T23:06:07.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.340+0000 7f11a1600640 1 -- 172.21.15.99:0/2115918316 <== mds.1 v2:172.21.15.99:6836/1676159950 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55bbf7546090 con 0x55bbf7658970 2024-02-21T23:06:07.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.340+0000 7f11a1600640 10 client.5998 handle_command_reply: tid=0 2024-02-21T23:06:07.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.340+0000 7f11c2064740 1 client.5998 shutdown 2024-02-21T23:06:07.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.340+0000 7f11c2064740 1 -- 172.21.15.99:0/2115918316 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bbf7644d40 msgr2=0x55bbf7657f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:07.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.340+0000 7f11c2064740 1 --2- 172.21.15.99:0/2115918316 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bbf7644d40 0x55bbf7657f60 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f11b0004fd0 tx=0x7f11b00015c0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.340+0000 7f11c2064740 1 -- 172.21.15.99:0/2115918316 shutdown_connections 2024-02-21T23:06:07.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.340+0000 7f11c2064740 1 --2- 172.21.15.99:0/2115918316 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x55bbf7658970 0x55bbf76549f0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.340+0000 7f11c2064740 1 --2- 172.21.15.99:0/2115918316 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bbf7644d40 0x55bbf7657f60 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.340+0000 7f11c2064740 1 --2- 172.21.15.99:0/2115918316 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bbf764bcf0 0x55bbf7652b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.340+0000 7f11a1600640 0 client.5998 ms_handle_reset on v2:172.21.15.99:6836/1676159950 2024-02-21T23:06:07.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.340+0000 7f11c2064740 1 --2- 172.21.15.99:0/2115918316 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bbf764b330 0x55bbf7640940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.340+0000 7f11c2064740 1 -- 172.21.15.99:0/2115918316 >> 172.21.15.99:0/2115918316 conn(0x55bbf7610660 msgr2=0x55bbf764a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:06:07.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.340+0000 7f11c2064740 1 -- 172.21.15.99:0/2115918316 shutdown_connections 2024-02-21T23:06:07.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.340+0000 7f11c2064740 1 -- 172.21.15.99:0/2115918316 wait complete. 2024-02-21T23:06:07.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.340+0000 7f11c2064740 20 client.5998 trim_cache size 0 max 16384 2024-02-21T23:06:07.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.354+0000 7f11c2064740 1 Processor -- start 2024-02-21T23:06:07.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.354+0000 7f11c2064740 1 -- start start 2024-02-21T23:06:07.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.356+0000 7f11c2064740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bbf7644d40 0x55bbf7657ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:07.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.356+0000 7f11c2064740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bbf764b330 0x55bbf7647980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:07.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.356+0000 7f11c2064740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bbf764bcf0 0x55bbf75d0980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:07.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.356+0000 7f11c2064740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11b822c760 con 0x55bbf7644d40 2024-02-21T23:06:07.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.356+0000 7f11c2064740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11b821f9d0 con 0x55bbf764b330 2024-02-21T23:06:07.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.356+0000 7f11c2064740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11b82229b0 con 0x55bbf764bcf0 2024-02-21T23:06:07.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.356+0000 7f11b7e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bbf7644d40 0x55bbf7657ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:07.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.356+0000 7f11b7e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bbf7644d40 0x55bbf7657ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:41838/0 (socket says 172.21.15.99:41838) 2024-02-21T23:06:07.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.356+0000 7f11b7e00640 1 -- 172.21.15.99:0/3458124862 learned_addr learned my addr 172.21.15.99:0/3458124862 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:06:07.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.356+0000 7f11b7400640 1 --2- 172.21.15.99:0/3458124862 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bbf764b330 0x55bbf7647980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:07.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.356+0000 7f11bd200640 1 --2- 172.21.15.99:0/3458124862 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bbf764bcf0 0x55bbf75d0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:07.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.356+0000 7f11b7e00640 1 -- 172.21.15.99:0/3458124862 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bbf764bcf0 msgr2=0x55bbf75d0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:07.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.356+0000 7f11b7e00640 1 --2- 172.21.15.99:0/3458124862 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bbf764bcf0 0x55bbf75d0980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.356+0000 7f11b7e00640 1 -- 172.21.15.99:0/3458124862 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bbf764b330 msgr2=0x55bbf7647980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:07.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.356+0000 7f11b7e00640 1 --2- 172.21.15.99:0/3458124862 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bbf764b330 0x55bbf7647980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.356+0000 7f11b7e00640 1 -- 172.21.15.99:0/3458124862 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bbf73177d0 con 0x55bbf7644d40 2024-02-21T23:06:07.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.357+0000 7f11b7e00640 1 --2- 172.21.15.99:0/3458124862 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bbf7644d40 0x55bbf7657ef0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f11a8009810 tx=0x7f11a802d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=983bda85a222246f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:07.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.357+0000 7f11a3e00640 1 -- 172.21.15.99:0/3458124862 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a8037040 con 0x55bbf7644d40 2024-02-21T23:06:07.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.357+0000 7f11a3e00640 1 -- 172.21.15.99:0/3458124862 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11a804f070 con 0x55bbf7644d40 2024-02-21T23:06:07.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.357+0000 7f11a3e00640 1 -- 172.21.15.99:0/3458124862 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a8049690 con 0x55bbf7644d40 2024-02-21T23:06:07.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.358+0000 7f11c2064740 1 -- 172.21.15.99:0/3458124862 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bbf7644d40 msgr2=0x55bbf7657ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:07.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.358+0000 7f11c2064740 1 --2- 172.21.15.99:0/3458124862 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bbf7644d40 0x55bbf7657ef0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f11a8009810 tx=0x7f11a802d000 comp rx=0 tx=0).stop 2024-02-21T23:06:07.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.358+0000 7f11c2064740 1 -- 172.21.15.99:0/3458124862 shutdown_connections 2024-02-21T23:06:07.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.358+0000 7f11c2064740 1 --2- 172.21.15.99:0/3458124862 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bbf764bcf0 0x55bbf75d0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.358+0000 7f11c2064740 1 --2- 172.21.15.99:0/3458124862 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bbf764b330 0x55bbf7647980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.358+0000 7f11c2064740 1 --2- 172.21.15.99:0/3458124862 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bbf7644d40 0x55bbf7657ef0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.358+0000 7f11c2064740 1 -- 172.21.15.99:0/3458124862 >> 172.21.15.99:0/3458124862 conn(0x55bbf7610660 msgr2=0x55bbf7640750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:06:07.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.358+0000 7f11c2064740 1 -- 172.21.15.99:0/3458124862 shutdown_connections 2024-02-21T23:06:07.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.358+0000 7f11c2064740 1 -- 172.21.15.99:0/3458124862 wait complete. 2024-02-21T23:06:07.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.359+0000 7f11c2064740 1 -- start start 2024-02-21T23:06:07.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.359+0000 7f11c2064740 1 Processor -- start 2024-02-21T23:06:07.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.361+0000 7f11c2064740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bbf7644d40 0x55bbf75d93a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:07.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.361+0000 7f11c2064740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bbf764b330 0x55bbf764ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:07.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.361+0000 7f11c2064740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bbf764bcf0 0x55bbf76655b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:07.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.361+0000 7f11c2064740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11b8222fb0 con 0x55bbf7644d40 2024-02-21T23:06:07.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.361+0000 7f11c2064740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11b821f370 con 0x55bbf764bcf0 2024-02-21T23:06:07.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.361+0000 7f11c2064740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11b817a720 con 0x55bbf764b330 2024-02-21T23:06:07.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.361+0000 7f11c2064740 10 client.0 _ll_register_callbacks cb 0x7f11b0002190 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:06:07.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.362+0000 7f11b7e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bbf7644d40 0x55bbf75d93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:07.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.362+0000 7f11b7e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bbf7644d40 0x55bbf75d93a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:41840/0 (socket says 172.21.15.99:41840) 2024-02-21T23:06:07.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.362+0000 7f11b7e00640 1 -- 172.21.15.99:0/3770502851 learned_addr learned my addr 172.21.15.99:0/3770502851 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:06:07.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.362+0000 7f11b7400640 1 --2- 172.21.15.99:0/3770502851 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bbf764b330 0x55bbf764ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:07.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.362+0000 7f11bd200640 1 --2- 172.21.15.99:0/3770502851 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bbf764bcf0 0x55bbf76655b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:07.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.362+0000 7f11b7e00640 1 -- 172.21.15.99:0/3770502851 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bbf764b330 msgr2=0x55bbf764ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:07.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.362+0000 7f11b7e00640 1 --2- 172.21.15.99:0/3770502851 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bbf764b330 0x55bbf764ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.362+0000 7f11b7e00640 1 -- 172.21.15.99:0/3770502851 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bbf764bcf0 msgr2=0x55bbf76655b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:07.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.362+0000 7f11b7e00640 1 --2- 172.21.15.99:0/3770502851 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bbf764bcf0 0x55bbf76655b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.362+0000 7f11b7e00640 1 -- 172.21.15.99:0/3770502851 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bbf763daf0 con 0x55bbf7644d40 2024-02-21T23:06:07.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.363+0000 7f11b7e00640 1 --2- 172.21.15.99:0/3770502851 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bbf7644d40 0x55bbf75d93a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f11a8009840 tx=0x7f11a8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b24b985038cdfcd9 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:07.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.363+0000 7f11a1600640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:06:07.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.363+0000 7f11a1600640 1 -- 172.21.15.99:0/3770502851 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a8037040 con 0x55bbf7644d40 2024-02-21T23:06:07.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.363+0000 7f11a1600640 1 -- 172.21.15.99:0/3770502851 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f11a8005c50 con 0x55bbf7644d40 2024-02-21T23:06:07.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.363+0000 7f11c2064740 1 -- 172.21.15.99:0/3770502851 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f11a804f070 con 0x55bbf7644d40 2024-02-21T23:06:07.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.363+0000 7f11a1600640 1 -- 172.21.15.99:0/3770502851 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f11a805e050 con 0x55bbf7644d40 2024-02-21T23:06:07.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.363+0000 7f11c2064740 10 client.5871 fetch_fsmap learned FSMap version 16 2024-02-21T23:06:07.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.363+0000 7f11c2064740 1 -- 172.21.15.99:0/3770502851 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55bbf76406e0 con 0x55bbf7644d40 2024-02-21T23:06:07.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.363+0000 7f11a1600640 1 -- 172.21.15.99:0/3770502851 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11a804f070 con 0x55bbf7644d40 2024-02-21T23:06:07.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.364+0000 7f11a1600640 1 -- 172.21.15.99:0/3770502851 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f11a8049690 con 0x55bbf7644d40 2024-02-21T23:06:07.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.364+0000 7f11c2064740 10 client.5871 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T23:06:07.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.364+0000 7f11c2064740 10 client.5871 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2024-02-21T23:06:07.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.364+0000 7f11c2064740 20 client.5871 populate_metadata read hostname 'smithi099' 2024-02-21T23:06:07.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.364+0000 7f11c2064740 1 --2- 172.21.15.99:0/3770502851 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x55bbf7648040 0x55bbf76a9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:07.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.364+0000 7f11c2064740 4 client.5871 mds_command: new command op to 4352 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T23:06:07.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.364+0000 7f11c2064740 1 -- 172.21.15.99:0/3770502851 --> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55bbf75403e0 con 0x55bbf7648040 2024-02-21T23:06:07.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.364+0000 7f11b7400640 1 --2- 172.21.15.99:0/3770502851 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x55bbf7648040 0x55bbf76a9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:07.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.364+0000 7f11b7400640 1 --2- 172.21.15.99:0/3770502851 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x55bbf7648040 0x55bbf76a9cd0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1705973f8403901f server_cookie=214d19769451a536 in_seq=0 out_seq=0 2024-02-21T23:06:07.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.365+0000 7f11a1600640 10 client.5871 ms_handle_connect on v2:172.21.15.99:6836/1676159950 2024-02-21T23:06:07.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.365+0000 7f11a1600640 1 -- 172.21.15.99:0/3770502851 <== mds.1 v2:172.21.15.99:6836/1676159950 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55bbf75403e0 con 0x55bbf7648040 2024-02-21T23:06:07.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.365+0000 7f11a1600640 10 client.5871 handle_command_reply: tid=0 2024-02-21T23:06:07.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.365+0000 7f11c2064740 1 client.5871 shutdown 2024-02-21T23:06:07.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.365+0000 7f11c2064740 1 -- 172.21.15.99:0/3770502851 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bbf7644d40 msgr2=0x55bbf75d93a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:07.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.365+0000 7f11c2064740 1 --2- 172.21.15.99:0/3770502851 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bbf7644d40 0x55bbf75d93a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f11a8009840 tx=0x7f11a8004730 comp rx=0 tx=0).stop 2024-02-21T23:06:07.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.365+0000 7f11c2064740 1 -- 172.21.15.99:0/3770502851 shutdown_connections 2024-02-21T23:06:07.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.365+0000 7f11c2064740 1 --2- 172.21.15.99:0/3770502851 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x55bbf7648040 0x55bbf76a9cd0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.365+0000 7f11c2064740 1 --2- 172.21.15.99:0/3770502851 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bbf764bcf0 0x55bbf76655b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.365+0000 7f11c2064740 1 --2- 172.21.15.99:0/3770502851 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bbf764b330 0x55bbf764ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.365+0000 7f11c2064740 1 --2- 172.21.15.99:0/3770502851 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bbf7644d40 0x55bbf75d93a0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.365+0000 7f11c2064740 1 -- 172.21.15.99:0/3770502851 >> 172.21.15.99:0/3770502851 conn(0x55bbf7610660 msgr2=0x55bbf76494e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:06:07.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.365+0000 7f11a1600640 0 client.5871 ms_handle_reset on v2:172.21.15.99:6836/1676159950 2024-02-21T23:06:07.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.365+0000 7f11c2064740 1 -- 172.21.15.99:0/3770502851 shutdown_connections 2024-02-21T23:06:07.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.365+0000 7f11c2064740 1 -- 172.21.15.99:0/3770502851 wait complete. 2024-02-21T23:06:07.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.366+0000 7f11c2064740 20 client.5871 trim_cache size 0 max 16384 2024-02-21T23:06:07.361 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-02-21T23:06:07.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.366+0000 7f11bdc00640 1 -- 172.21.15.99:0/117097205 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f119809eed0 msgr2=0x7f11980a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:07.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.366+0000 7f11bdc00640 1 --2- 172.21.15.99:0/117097205 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f119809eed0 0x7f11980a1390 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f11b818ad70 tx=0x7f11b0004d40 comp rx=0 tx=0).stop 2024-02-21T23:06:07.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.366+0000 7f11bdc00640 1 -- 172.21.15.99:0/117097205 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f11b818b060 msgr2=0x7f11b8183070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:07.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.366+0000 7f11bdc00640 1 --2- 172.21.15.99:0/117097205 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f11b818b060 0x7f11b8183070 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f11a400c780 tx=0x7f11a400cc40 comp rx=0 tx=0).stop 2024-02-21T23:06:07.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.366+0000 7f11bdc00640 1 -- 172.21.15.99:0/117097205 shutdown_connections 2024-02-21T23:06:07.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.366+0000 7f11bdc00640 1 --2- 172.21.15.99:0/117097205 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f119809eed0 0x7f11980a1390 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.366+0000 7f11bdc00640 1 --2- 172.21.15.99:0/117097205 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f11b818b4f0 0x7f11b8175280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.366+0000 7f11bdc00640 1 --2- 172.21.15.99:0/117097205 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f11b818b060 0x7f11b8183070 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.366+0000 7f11bdc00640 1 --2- 172.21.15.99:0/117097205 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f11b817f490 0x7f11b806b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.366+0000 7f11bdc00640 1 -- 172.21.15.99:0/117097205 >> 172.21.15.99:0/117097205 conn(0x7f11b80d29b0 msgr2=0x7f11b80fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:06:07.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.366+0000 7f11bdc00640 1 -- 172.21.15.99:0/117097205 shutdown_connections 2024-02-21T23:06:07.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.367+0000 7f11bdc00640 1 -- 172.21.15.99:0/117097205 wait complete. 2024-02-21T23:06:07.379 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T23:06:07.379 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-02-21T23:06:07.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.647+0000 7ff87ca00640 1 Processor -- start 2024-02-21T23:06:07.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.647+0000 7ff87ca00640 1 -- start start 2024-02-21T23:06:07.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.651+0000 7ff87ca00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff8780f8e20 0x7ff87818c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:07.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.651+0000 7ff87ca00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8781830b0 con 0x7ff878182cd0 2024-02-21T23:06:07.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.651+0000 7ff87ca00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff878186f40 con 0x7ff87818c760 2024-02-21T23:06:07.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.651+0000 7ff87ca00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff878187e30 con 0x7ff8780f8e20 2024-02-21T23:06:07.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.651+0000 7ff875e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff8780f8e20 0x7ff87818c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:07.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.651+0000 7ff876800640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7ff878182cd0 0x7ff8781882c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:50792/0 (socket says 172.21.15.99:50792) 2024-02-21T23:06:07.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.651+0000 7ff876800640 1 -- 172.21.15.99:0/1724788543 learned_addr learned my addr 172.21.15.99:0/1724788543 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:06:07.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.652+0000 7ff875e00640 1 -- 172.21.15.99:0/1724788543 >> v1:172.21.15.162:6789/0 conn(0x7ff87818c760 legacy=0x7ff87818cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:07.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.652+0000 7ff875e00640 1 -- 172.21.15.99:0/1724788543 >> v1:172.21.15.99:6789/0 conn(0x7ff878182cd0 legacy=0x7ff8781882c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:07.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.652+0000 7ff875e00640 1 -- 172.21.15.99:0/1724788543 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff878187220 con 0x7ff8780f8e20 2024-02-21T23:06:07.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.652+0000 7ff875400640 1 -- 172.21.15.99:0/1724788543 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3366863562 0 0) 0x7ff8781830b0 con 0x7ff878182cd0 2024-02-21T23:06:07.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.653+0000 7ff875e00640 1 --2- 172.21.15.99:0/1724788543 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff8780f8e20 0x7ff87818c220 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ff8640097a0 tx=0x7ff86402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afc3e2c98baf6c3a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:07.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.654+0000 7ff875400640 1 -- 172.21.15.99:0/1724788543 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8640315a0 con 0x7ff8780f8e20 2024-02-21T23:06:07.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.654+0000 7ff875400640 1 -- 172.21.15.99:0/1724788543 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff864037070 con 0x7ff8780f8e20 2024-02-21T23:06:07.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.654+0000 7ff875400640 1 -- 172.21.15.99:0/1724788543 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff864031960 con 0x7ff8780f8e20 2024-02-21T23:06:07.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.654+0000 7ff87ca00640 1 -- 172.21.15.99:0/1724788543 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff8780f8e20 msgr2=0x7ff87818c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:07.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.654+0000 7ff87ca00640 1 --2- 172.21.15.99:0/1724788543 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff8780f8e20 0x7ff87818c220 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ff8640097a0 tx=0x7ff86402b840 comp rx=0 tx=0).stop 2024-02-21T23:06:07.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.654+0000 7ff87ca00640 1 -- 172.21.15.99:0/1724788543 shutdown_connections 2024-02-21T23:06:07.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.654+0000 7ff87ca00640 1 --2- 172.21.15.99:0/1724788543 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff8780f8e20 0x7ff87818c220 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.654+0000 7ff87ca00640 1 -- 172.21.15.99:0/1724788543 >> 172.21.15.99:0/1724788543 conn(0x7ff8780fe4a0 msgr2=0x7ff8780fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:06:07.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.654+0000 7ff87ca00640 1 -- 172.21.15.99:0/1724788543 shutdown_connections 2024-02-21T23:06:07.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.654+0000 7ff87ca00640 1 -- 172.21.15.99:0/1724788543 wait complete. 2024-02-21T23:06:07.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.658+0000 7ff87ca00640 1 Processor -- start 2024-02-21T23:06:07.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.658+0000 7ff87ca00640 1 -- start start 2024-02-21T23:06:07.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.660+0000 7ff87ca00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff8780f8e20 0x7ff87816a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:07.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.660+0000 7ff87ca00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff878182cd0 0x7ff878180e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:07.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.660+0000 7ff87ca00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff87818c760 0x7ff8781813b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:07.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.660+0000 7ff87ca00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff878187ac0 con 0x7ff87818c760 2024-02-21T23:06:07.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.660+0000 7ff87ca00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8781877e0 con 0x7ff878182cd0 2024-02-21T23:06:07.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.660+0000 7ff87ca00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8781889d0 con 0x7ff8780f8e20 2024-02-21T23:06:07.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.660+0000 7ff877200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff87818c760 0x7ff8781813b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:07.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.660+0000 7ff877200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff87818c760 0x7ff8781813b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:41844/0 (socket says 172.21.15.99:41844) 2024-02-21T23:06:07.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.660+0000 7ff877200640 1 -- 172.21.15.99:0/420399357 learned_addr learned my addr 172.21.15.99:0/420399357 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:06:07.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.660+0000 7ff876800640 1 --2- 172.21.15.99:0/420399357 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff8780f8e20 0x7ff87816a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:07.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.660+0000 7ff875e00640 1 --2- 172.21.15.99:0/420399357 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff878182cd0 0x7ff878180e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:07.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.661+0000 7ff877200640 1 -- 172.21.15.99:0/420399357 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff8780f8e20 msgr2=0x7ff87816a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:07.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.661+0000 7ff877200640 1 --2- 172.21.15.99:0/420399357 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff8780f8e20 0x7ff87816a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.661+0000 7ff877200640 1 -- 172.21.15.99:0/420399357 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff878182cd0 msgr2=0x7ff878180e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:07.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.661+0000 7ff877200640 1 --2- 172.21.15.99:0/420399357 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff878182cd0 0x7ff878180e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.661+0000 7ff877200640 1 -- 172.21.15.99:0/420399357 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8781800f0 con 0x7ff87818c760 2024-02-21T23:06:07.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.661+0000 7ff877200640 1 --2- 172.21.15.99:0/420399357 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff87818c760 0x7ff8781813b0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff87000c7a0 tx=0x7ff87000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:07.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.661+0000 7ff86ea00640 1 -- 172.21.15.99:0/420399357 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff870003b70 con 0x7ff87818c760 2024-02-21T23:06:07.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.661+0000 7ff86ea00640 1 -- 172.21.15.99:0/420399357 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff870003d30 con 0x7ff87818c760 2024-02-21T23:06:07.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.661+0000 7ff87ca00640 1 -- 172.21.15.99:0/420399357 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff87821f640 con 0x7ff87818c760 2024-02-21T23:06:07.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.661+0000 7ff86ea00640 1 -- 172.21.15.99:0/420399357 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff87000aa90 con 0x7ff87818c760 2024-02-21T23:06:07.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.662+0000 7ff87ca00640 1 -- 172.21.15.99:0/420399357 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff878180670 con 0x7ff87818c760 2024-02-21T23:06:07.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.666+0000 7ff86ea00640 1 -- 172.21.15.99:0/420399357 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7ff87000ac30 con 0x7ff87818c760 2024-02-21T23:06:07.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.668+0000 7ff880248740 1 Processor -- start 2024-02-21T23:06:07.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.668+0000 7ff880248740 1 -- start start 2024-02-21T23:06:07.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.668+0000 7ff86ea00640 1 --2- 172.21.15.99:0/420399357 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7ff85809eed0 0x7ff8580a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:07.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.669+0000 7ff86ea00640 1 -- 172.21.15.99:0/420399357 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7ff8700c9c70 con 0x7ff87818c760 2024-02-21T23:06:07.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.669+0000 7ff875e00640 1 --2- 172.21.15.99:0/420399357 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7ff85809eed0 0x7ff8580a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:07.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.670+0000 7ff875e00640 1 --2- 172.21.15.99:0/420399357 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7ff85809eed0 0x7ff8580a1390 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff864036000 tx=0x7ff86403d040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:07.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.670+0000 7ff880248740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561f25d4b660 0x561f25d4ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:07.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.670+0000 7ff880248740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561f25d86330 0x561f25d867b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:07.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.670+0000 7ff880248740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561f25d86cf0 0x561f25d87560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:07.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.670+0000 7ff880248740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f25c73b50 con 0x561f25d86cf0 2024-02-21T23:06:07.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.670+0000 7ff880248740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f25c1cda0 con 0x561f25d86330 2024-02-21T23:06:07.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.670+0000 7ff880248740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f25c6fbf0 con 0x561f25d4b660 2024-02-21T23:06:07.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.670+0000 7ff877200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561f25d86cf0 0x561f25d87560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:07.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.670+0000 7ff877200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561f25d86cf0 0x561f25d87560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:41846/0 (socket says 172.21.15.99:41846) 2024-02-21T23:06:07.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.670+0000 7ff877200640 1 -- 172.21.15.99:0/2133187418 learned_addr learned my addr 172.21.15.99:0/2133187418 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:06:07.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.670+0000 7ff875e00640 1 --2- 172.21.15.99:0/2133187418 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561f25d86330 0x561f25d867b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:07.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.670+0000 7ff876800640 1 --2- 172.21.15.99:0/2133187418 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561f25d4b660 0x561f25d4ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:07.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.671+0000 7ff877200640 1 -- 172.21.15.99:0/2133187418 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561f25d4b660 msgr2=0x561f25d4ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:07.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.671+0000 7ff877200640 1 --2- 172.21.15.99:0/2133187418 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561f25d4b660 0x561f25d4ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.671+0000 7ff877200640 1 -- 172.21.15.99:0/2133187418 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561f25d86330 msgr2=0x561f25d867b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:07.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.671+0000 7ff877200640 1 --2- 172.21.15.99:0/2133187418 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561f25d86330 0x561f25d867b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.671+0000 7ff877200640 1 -- 172.21.15.99:0/2133187418 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561f25c3ff80 con 0x561f25d86cf0 2024-02-21T23:06:07.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.671+0000 7ff877200640 1 --2- 172.21.15.99:0/2133187418 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561f25d86cf0 0x561f25d87560 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ff8700c7470 tx=0x7ff870096f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bcae5a3dc29ab91 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:07.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.671+0000 7ff863000640 1 -- 172.21.15.99:0/2133187418 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff87009b750 con 0x561f25d86cf0 2024-02-21T23:06:07.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.671+0000 7ff863000640 1 -- 172.21.15.99:0/2133187418 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff87009fd10 con 0x561f25d86cf0 2024-02-21T23:06:07.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.671+0000 7ff863000640 1 -- 172.21.15.99:0/2133187418 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8700c7530 con 0x561f25d86cf0 2024-02-21T23:06:07.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.672+0000 7ff880248740 1 -- 172.21.15.99:0/2133187418 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561f25d86cf0 msgr2=0x561f25d87560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:07.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.672+0000 7ff880248740 1 --2- 172.21.15.99:0/2133187418 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561f25d86cf0 0x561f25d87560 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ff8700c7470 tx=0x7ff870096f60 comp rx=0 tx=0).stop 2024-02-21T23:06:07.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.672+0000 7ff880248740 1 -- 172.21.15.99:0/2133187418 shutdown_connections 2024-02-21T23:06:07.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.672+0000 7ff880248740 1 --2- 172.21.15.99:0/2133187418 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561f25d86cf0 0x561f25d87560 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.672+0000 7ff880248740 1 --2- 172.21.15.99:0/2133187418 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561f25d86330 0x561f25d867b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.672+0000 7ff880248740 1 --2- 172.21.15.99:0/2133187418 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561f25d4b660 0x561f25d4ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.672+0000 7ff880248740 1 -- 172.21.15.99:0/2133187418 >> 172.21.15.99:0/2133187418 conn(0x561f25d0d6d0 msgr2=0x561f25d0e750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:06:07.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.672+0000 7ff880248740 1 -- 172.21.15.99:0/2133187418 shutdown_connections 2024-02-21T23:06:07.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.672+0000 7ff880248740 1 -- 172.21.15.99:0/2133187418 wait complete. 2024-02-21T23:06:07.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.674+0000 7ff880248740 1 -- start start 2024-02-21T23:06:07.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.674+0000 7ff880248740 1 Processor -- start 2024-02-21T23:06:07.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.676+0000 7ff880248740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561f25d86330 0x561f25d8e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:07.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.676+0000 7ff880248740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561f25d86cf0 0x561f25d7b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:07.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.676+0000 7ff880248740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561f25d0a890 0x561f25d4f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:07.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.676+0000 7ff880248740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f25d850a0 con 0x561f25d86330 2024-02-21T23:06:07.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.676+0000 7ff880248740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f25c12380 con 0x561f25d86cf0 2024-02-21T23:06:07.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.676+0000 7ff880248740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f25d84dc0 con 0x561f25d0a890 2024-02-21T23:06:07.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.676+0000 7ff880248740 10 client.0 _ll_register_callbacks cb 0x561f25c6b280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:06:07.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.677+0000 7ff876800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561f25d86330 0x561f25d8e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:07.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.677+0000 7ff876800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561f25d86330 0x561f25d8e470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:41854/0 (socket says 172.21.15.99:41854) 2024-02-21T23:06:07.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.677+0000 7ff876800640 1 -- 172.21.15.99:0/1507118018 learned_addr learned my addr 172.21.15.99:0/1507118018 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:06:07.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.677+0000 7ff875e00640 1 --2- 172.21.15.99:0/1507118018 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561f25d86cf0 0x561f25d7b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:07.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.677+0000 7ff877200640 1 --2- 172.21.15.99:0/1507118018 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561f25d0a890 0x561f25d4f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:07.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.677+0000 7ff876800640 1 -- 172.21.15.99:0/1507118018 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561f25d0a890 msgr2=0x561f25d4f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:07.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.677+0000 7ff876800640 1 --2- 172.21.15.99:0/1507118018 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561f25d0a890 0x561f25d4f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.677+0000 7ff876800640 1 -- 172.21.15.99:0/1507118018 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561f25d86cf0 msgr2=0x561f25d7b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:07.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.677+0000 7ff876800640 1 --2- 172.21.15.99:0/1507118018 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561f25d86cf0 0x561f25d7b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.677+0000 7ff876800640 1 -- 172.21.15.99:0/1507118018 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561f25c3ac20 con 0x561f25d86330 2024-02-21T23:06:07.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.677+0000 7ff875e00640 1 --2- 172.21.15.99:0/1507118018 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561f25d86cf0 0x561f25d7b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:06:07.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.677+0000 7ff876800640 1 --2- 172.21.15.99:0/1507118018 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561f25d86330 0x561f25d8e470 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ff868004eb0 tx=0x7ff8680015e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df106958e0aa7406 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:07.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.677+0000 7ff857400640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:06:07.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.678+0000 7ff857400640 1 -- 172.21.15.99:0/1507118018 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff868015650 con 0x561f25d86330 2024-02-21T23:06:07.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.678+0000 7ff857400640 1 -- 172.21.15.99:0/1507118018 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7ff868010040 con 0x561f25d86330 2024-02-21T23:06:07.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.678+0000 7ff880248740 1 -- 172.21.15.99:0/1507118018 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff87009fd10 con 0x561f25d86330 2024-02-21T23:06:07.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.678+0000 7ff857400640 1 -- 172.21.15.99:0/1507118018 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff868025050 con 0x561f25d86330 2024-02-21T23:06:07.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.678+0000 7ff880248740 10 client.5886 fetch_fsmap learned FSMap version 16 2024-02-21T23:06:07.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.678+0000 7ff880248740 1 -- 172.21.15.99:0/1507118018 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x561f259883f0 con 0x561f25d86330 2024-02-21T23:06:07.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.678+0000 7ff857400640 1 -- 172.21.15.99:0/1507118018 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff87009fd10 con 0x561f25d86330 2024-02-21T23:06:07.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.679+0000 7ff857400640 1 -- 172.21.15.99:0/1507118018 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7ff8680157f0 con 0x561f25d86330 2024-02-21T23:06:07.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.679+0000 7ff880248740 10 client.5886 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T23:06:07.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.679+0000 7ff880248740 10 client.5886 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:06:07.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.679+0000 7ff880248740 20 client.5886 populate_metadata read hostname 'smithi099' 2024-02-21T23:06:07.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.679+0000 7ff880248740 1 --2- 172.21.15.99:0/1507118018 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x561f25d4fe20 0x561f25d0a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:07.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.679+0000 7ff880248740 4 client.5886 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:06:07.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.679+0000 7ff880248740 1 -- 172.21.15.99:0/1507118018 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561f25c81090 con 0x561f25d4fe20 2024-02-21T23:06:07.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.679+0000 7ff875e00640 1 --2- 172.21.15.99:0/1507118018 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x561f25d4fe20 0x561f25d0a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:07.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.680+0000 7ff857400640 10 client.5886 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:06:07.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.680+0000 7ff875e00640 1 --2- 172.21.15.99:0/1507118018 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x561f25d4fe20 0x561f25d0a2d0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c05e216bc6530162 server_cookie=70f3383b1c162e28 in_seq=0 out_seq=0 2024-02-21T23:06:07.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.681+0000 7ff857400640 1 -- 172.21.15.99:0/1507118018 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x561f25c81090 con 0x561f25d4fe20 2024-02-21T23:06:07.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.681+0000 7ff857400640 10 client.5886 handle_command_reply: tid=0 2024-02-21T23:06:07.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.681+0000 7ff880248740 1 client.5886 shutdown 2024-02-21T23:06:07.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.681+0000 7ff880248740 1 -- 172.21.15.99:0/1507118018 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561f25d86330 msgr2=0x561f25d8e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:07.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.681+0000 7ff880248740 1 --2- 172.21.15.99:0/1507118018 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561f25d86330 0x561f25d8e470 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ff868004eb0 tx=0x7ff8680015e0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.681+0000 7ff880248740 1 -- 172.21.15.99:0/1507118018 shutdown_connections 2024-02-21T23:06:07.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.681+0000 7ff880248740 1 --2- 172.21.15.99:0/1507118018 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x561f25d4fe20 0x561f25d0a2d0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.681+0000 7ff880248740 1 --2- 172.21.15.99:0/1507118018 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561f25d0a890 0x561f25d4f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.681+0000 7ff880248740 1 --2- 172.21.15.99:0/1507118018 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561f25d86cf0 0x561f25d7b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.681+0000 7ff880248740 1 --2- 172.21.15.99:0/1507118018 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561f25d86330 0x561f25d8e470 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.681+0000 7ff880248740 1 -- 172.21.15.99:0/1507118018 >> 172.21.15.99:0/1507118018 conn(0x561f25d4b660 msgr2=0x561f25d08ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:06:07.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.681+0000 7ff857400640 0 client.5886 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:06:07.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.682+0000 7ff880248740 1 -- 172.21.15.99:0/1507118018 shutdown_connections 2024-02-21T23:06:07.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.682+0000 7ff880248740 1 -- 172.21.15.99:0/1507118018 wait complete. 2024-02-21T23:06:07.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.682+0000 7ff880248740 20 client.5886 trim_cache size 0 max 16384 2024-02-21T23:06:07.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.708+0000 7ff880248740 1 Processor -- start 2024-02-21T23:06:07.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.708+0000 7ff880248740 1 -- start start 2024-02-21T23:06:07.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.710+0000 7ff880248740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561f25d0a890 0x561f25d0f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:07.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.710+0000 7ff880248740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561f25d86330 0x561f25d86710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:07.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.710+0000 7ff880248740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561f25d86cf0 0x561f25d4f820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:07.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.710+0000 7ff880248740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff87822c950 con 0x561f25d86cf0 2024-02-21T23:06:07.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.710+0000 7ff880248740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff87822a4f0 con 0x561f25d86330 2024-02-21T23:06:07.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.710+0000 7ff880248740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8782228c0 con 0x561f25d0a890 2024-02-21T23:06:07.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.711+0000 7ff877200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561f25d86cf0 0x561f25d4f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:07.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.711+0000 7ff876800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561f25d0a890 0x561f25d0f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:07.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.711+0000 7ff877200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561f25d86cf0 0x561f25d4f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:41866/0 (socket says 172.21.15.99:41866) 2024-02-21T23:06:07.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.711+0000 7ff877200640 1 -- 172.21.15.99:0/569451128 learned_addr learned my addr 172.21.15.99:0/569451128 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:06:07.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.711+0000 7ff875e00640 1 --2- 172.21.15.99:0/569451128 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561f25d86330 0x561f25d86710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:07.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.711+0000 7ff876800640 1 -- 172.21.15.99:0/569451128 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561f25d86330 msgr2=0x561f25d86710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:07.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.711+0000 7ff876800640 1 --2- 172.21.15.99:0/569451128 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561f25d86330 0x561f25d86710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.711+0000 7ff876800640 1 -- 172.21.15.99:0/569451128 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561f25d86cf0 msgr2=0x561f25d4f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:07.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.711+0000 7ff876800640 1 --2- 172.21.15.99:0/569451128 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561f25d86cf0 0x561f25d4f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.711+0000 7ff876800640 1 -- 172.21.15.99:0/569451128 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561f25a527d0 con 0x561f25d0a890 2024-02-21T23:06:07.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.711+0000 7ff876800640 1 --2- 172.21.15.99:0/569451128 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561f25d0a890 0x561f25d0f930 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7ff868007c00 tx=0x7ff86800f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af97e680fcdf6598 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:07.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.712+0000 7ff862600640 1 -- 172.21.15.99:0/569451128 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff868019070 con 0x561f25d0a890 2024-02-21T23:06:07.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.712+0000 7ff862600640 1 -- 172.21.15.99:0/569451128 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff868007e50 con 0x561f25d0a890 2024-02-21T23:06:07.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.712+0000 7ff862600640 1 -- 172.21.15.99:0/569451128 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff868015850 con 0x561f25d0a890 2024-02-21T23:06:07.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.712+0000 7ff880248740 1 -- 172.21.15.99:0/569451128 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561f25d0a890 msgr2=0x561f25d0f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:07.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.712+0000 7ff880248740 1 --2- 172.21.15.99:0/569451128 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561f25d0a890 0x561f25d0f930 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7ff868007c00 tx=0x7ff86800f000 comp rx=0 tx=0).stop 2024-02-21T23:06:07.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.712+0000 7ff880248740 1 -- 172.21.15.99:0/569451128 shutdown_connections 2024-02-21T23:06:07.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.712+0000 7ff880248740 1 --2- 172.21.15.99:0/569451128 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561f25d86cf0 0x561f25d4f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.712+0000 7ff880248740 1 --2- 172.21.15.99:0/569451128 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561f25d86330 0x561f25d86710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.712+0000 7ff880248740 1 --2- 172.21.15.99:0/569451128 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561f25d0a890 0x561f25d0f930 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.712+0000 7ff880248740 1 -- 172.21.15.99:0/569451128 >> 172.21.15.99:0/569451128 conn(0x561f25d4b660 msgr2=0x561f25d056e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:06:07.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.713+0000 7ff880248740 1 -- 172.21.15.99:0/569451128 shutdown_connections 2024-02-21T23:06:07.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.713+0000 7ff880248740 1 -- 172.21.15.99:0/569451128 wait complete. 2024-02-21T23:06:07.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.714+0000 7ff880248740 1 -- start start 2024-02-21T23:06:07.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.714+0000 7ff880248740 1 Processor -- start 2024-02-21T23:06:07.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.716+0000 7ff880248740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561f25d0a890 0x561f25d4ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:07.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.716+0000 7ff880248740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561f25d86330 0x561f25d0f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:07.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.716+0000 7ff880248740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561f25d86cf0 0x561f25d0f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:07.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.716+0000 7ff880248740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff878228cf0 con 0x561f25d0a890 2024-02-21T23:06:07.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.716+0000 7ff880248740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff878229e90 con 0x561f25d86cf0 2024-02-21T23:06:07.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.716+0000 7ff880248740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8782291f0 con 0x561f25d86330 2024-02-21T23:06:07.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.716+0000 7ff880248740 10 client.0 _ll_register_callbacks cb 0x7ff8680072b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:06:07.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.716+0000 7ff876800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561f25d0a890 0x561f25d4ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:07.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.717+0000 7ff875e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561f25d86330 0x561f25d0f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:07.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.717+0000 7ff877200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561f25d86cf0 0x561f25d0f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:07.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.717+0000 7ff875e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561f25d86330 0x561f25d0f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:40594/0 (socket says 172.21.15.99:40594) 2024-02-21T23:06:07.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.717+0000 7ff875e00640 1 -- 172.21.15.99:0/1101945107 learned_addr learned my addr 172.21.15.99:0/1101945107 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:06:07.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.717+0000 7ff876800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561f25d0a890 0x561f25d4ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:41876/0 (socket says 172.21.15.99:41876) 2024-02-21T23:06:07.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.717+0000 7ff875e00640 1 -- 172.21.15.99:0/1101945107 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561f25d86cf0 msgr2=0x561f25d0f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:07.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.717+0000 7ff875e00640 1 --2- 172.21.15.99:0/1101945107 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561f25d86cf0 0x561f25d0f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.717+0000 7ff875e00640 1 -- 172.21.15.99:0/1101945107 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561f25d0a890 msgr2=0x561f25d4ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:07.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.717+0000 7ff875e00640 1 --2- 172.21.15.99:0/1101945107 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561f25d0a890 0x561f25d4ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.717+0000 7ff875e00640 1 -- 172.21.15.99:0/1101945107 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561f25d74250 con 0x561f25d86330 2024-02-21T23:06:07.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.717+0000 7ff877200640 1 --2- 172.21.15.99:0/1101945107 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561f25d86cf0 0x561f25d0f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:06:07.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.717+0000 7ff875e00640 1 --2- 172.21.15.99:0/1101945107 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561f25d86330 0x561f25d0f140 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7ff864009560 tx=0x7ff864004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac3ca01f4f792578 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:07.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.717+0000 7ff857400640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-02-21T23:06:07.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.718+0000 7ff857400640 1 -- 172.21.15.99:0/1101945107 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff864054260 con 0x561f25d86330 2024-02-21T23:06:07.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.718+0000 7ff857400640 1 -- 172.21.15.99:0/1101945107 <== mon.2 v2:172.21.15.181:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7ff864054760 con 0x561f25d86330 2024-02-21T23:06:07.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.718+0000 7ff880248740 1 -- 172.21.15.99:0/1101945107 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff868007e50 con 0x561f25d86330 2024-02-21T23:06:07.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.718+0000 7ff857400640 1 -- 172.21.15.99:0/1101945107 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff864054960 con 0x561f25d86330 2024-02-21T23:06:07.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.718+0000 7ff880248740 10 client.6023 fetch_fsmap learned FSMap version 16 2024-02-21T23:06:07.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.718+0000 7ff880248740 1 -- 172.21.15.99:0/1101945107 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x561f25df1820 con 0x561f25d86330 2024-02-21T23:06:07.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.718+0000 7ff857400640 1 -- 172.21.15.99:0/1101945107 <== mon.2 v2:172.21.15.181:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff868007e50 con 0x561f25d86330 2024-02-21T23:06:07.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.718+0000 7ff857400640 1 -- 172.21.15.99:0/1101945107 <== mon.2 v2:172.21.15.181:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7ff864050040 con 0x561f25d86330 2024-02-21T23:06:07.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.718+0000 7ff880248740 10 client.6023 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T23:06:07.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.718+0000 7ff880248740 10 client.6023 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:06:07.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.718+0000 7ff880248740 20 client.6023 populate_metadata read hostname 'smithi099' 2024-02-21T23:06:07.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.718+0000 7ff880248740 1 --2- 172.21.15.99:0/1101945107 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x561f25da1150 0x561f25dede30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:07.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.719+0000 7ff880248740 4 client.6023 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T23:06:07.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.719+0000 7ff880248740 1 -- 172.21.15.99:0/1101945107 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x561f25c7b3e0 con 0x561f25da1150 2024-02-21T23:06:07.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.719+0000 7ff876800640 1 --2- 172.21.15.99:0/1101945107 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x561f25da1150 0x561f25dede30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:07.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.719+0000 7ff876800640 1 --2- 172.21.15.99:0/1101945107 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x561f25da1150 0x561f25dede30 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6289fb9217a01b86 server_cookie=8142fc8ca49b363f in_seq=0 out_seq=0 2024-02-21T23:06:07.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.719+0000 7ff857400640 10 client.6023 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:06:07.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.720+0000 7ff857400640 1 -- 172.21.15.99:0/1101945107 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x561f25c7b3e0 con 0x561f25da1150 2024-02-21T23:06:07.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.720+0000 7ff857400640 10 client.6023 handle_command_reply: tid=0 2024-02-21T23:06:07.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.720+0000 7ff880248740 1 client.6023 shutdown 2024-02-21T23:06:07.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.720+0000 7ff880248740 1 -- 172.21.15.99:0/1101945107 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561f25d86330 msgr2=0x561f25d0f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:07.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.720+0000 7ff880248740 1 --2- 172.21.15.99:0/1101945107 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561f25d86330 0x561f25d0f140 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7ff864009560 tx=0x7ff864004730 comp rx=0 tx=0).stop 2024-02-21T23:06:07.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.720+0000 7ff880248740 1 -- 172.21.15.99:0/1101945107 shutdown_connections 2024-02-21T23:06:07.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.720+0000 7ff880248740 1 --2- 172.21.15.99:0/1101945107 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x561f25da1150 0x561f25dede30 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.720+0000 7ff880248740 1 --2- 172.21.15.99:0/1101945107 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561f25d86cf0 0x561f25d0f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.720+0000 7ff880248740 1 --2- 172.21.15.99:0/1101945107 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561f25d86330 0x561f25d0f140 secure :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7ff864009560 tx=0x7ff864004730 comp rx=0 tx=0).stop 2024-02-21T23:06:07.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.720+0000 7ff880248740 1 --2- 172.21.15.99:0/1101945107 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561f25d0a890 0x561f25d4ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.720+0000 7ff857400640 0 client.6023 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:06:07.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.720+0000 7ff880248740 1 -- 172.21.15.99:0/1101945107 >> 172.21.15.99:0/1101945107 conn(0x561f25d4b660 msgr2=0x561f25d09460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:06:07.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.720+0000 7ff880248740 1 -- 172.21.15.99:0/1101945107 shutdown_connections 2024-02-21T23:06:07.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.720+0000 7ff880248740 1 -- 172.21.15.99:0/1101945107 wait complete. 2024-02-21T23:06:07.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.720+0000 7ff880248740 20 client.6023 trim_cache size 0 max 16384 2024-02-21T23:06:07.718 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-02-21T23:06:07.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.721+0000 7ff87ca00640 1 -- 172.21.15.99:0/420399357 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7ff85809eed0 msgr2=0x7ff8580a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:07.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.721+0000 7ff87ca00640 1 --2- 172.21.15.99:0/420399357 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7ff85809eed0 0x7ff8580a1390 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff864036000 tx=0x7ff86403d040 comp rx=0 tx=0).stop 2024-02-21T23:06:07.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.721+0000 7ff87ca00640 1 -- 172.21.15.99:0/420399357 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff87818c760 msgr2=0x7ff8781813b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:07.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.721+0000 7ff87ca00640 1 --2- 172.21.15.99:0/420399357 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff87818c760 0x7ff8781813b0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff87000c7a0 tx=0x7ff87000cc60 comp rx=0 tx=0).stop 2024-02-21T23:06:07.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.721+0000 7ff87ca00640 1 -- 172.21.15.99:0/420399357 shutdown_connections 2024-02-21T23:06:07.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.721+0000 7ff87ca00640 1 --2- 172.21.15.99:0/420399357 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7ff85809eed0 0x7ff8580a1390 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.721+0000 7ff87ca00640 1 --2- 172.21.15.99:0/420399357 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff87818c760 0x7ff8781813b0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.721+0000 7ff87ca00640 1 --2- 172.21.15.99:0/420399357 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff878182cd0 0x7ff878180e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.721+0000 7ff87ca00640 1 --2- 172.21.15.99:0/420399357 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff8780f8e20 0x7ff87816a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:07.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.721+0000 7ff87ca00640 1 -- 172.21.15.99:0/420399357 >> 172.21.15.99:0/420399357 conn(0x7ff8780fe4a0 msgr2=0x7ff8781882c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:06:07.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.722+0000 7ff87ca00640 1 -- 172.21.15.99:0/420399357 shutdown_connections 2024-02-21T23:06:07.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:07.722+0000 7ff87ca00640 1 -- 172.21.15.99:0/420399357 wait complete. 2024-02-21T23:06:08.735 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-02-21T23:06:08.735 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T23:06:08.736 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-02-21T23:06:08.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.968+0000 7f756e800640 1 Processor -- start 2024-02-21T23:06:08.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.968+0000 7f756e800640 1 -- start start 2024-02-21T23:06:08.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.971+0000 7f756e800640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f756817d640 0x7f756806e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:08.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.971+0000 7f756e800640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7568070460 con 0x7f75680732d0 2024-02-21T23:06:08.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.971+0000 7f756e800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f756806f0e0 con 0x7f7568185090 2024-02-21T23:06:08.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.971+0000 7f756e800640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f756806eec0 con 0x7f756817d640 2024-02-21T23:06:08.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.972+0000 7f7566a00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f75680732d0 0x7f7568184980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:50804/0 (socket says 172.21.15.99:50804) 2024-02-21T23:06:08.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.972+0000 7f7566a00640 1 -- 172.21.15.99:0/236345560 learned_addr learned my addr 172.21.15.99:0/236345560 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:06:08.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.972+0000 7f7567400640 1 --2- 172.21.15.99:0/236345560 >> v2:172.21.15.181:3300/0 conn(0x7f756817d640 0x7f756806e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:08.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.972+0000 7f7566000640 1 -- 172.21.15.99:0/236345560 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2240847875 0 0) 0x7f756806f0e0 con 0x7f7568185090 2024-02-21T23:06:08.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.972+0000 7f7566000640 1 -- 172.21.15.99:0/236345560 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f754c003520 con 0x7f7568185090 2024-02-21T23:06:08.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.972+0000 7f7567400640 1 -- 172.21.15.99:0/236345560 >> v1:172.21.15.162:6789/0 conn(0x7f7568185090 legacy=0x7f7568186a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:08.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.972+0000 7f7567400640 1 -- 172.21.15.99:0/236345560 >> v1:172.21.15.99:6789/0 conn(0x7f75680732d0 legacy=0x7f7568184980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:08.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.972+0000 7f7566000640 1 -- 172.21.15.99:0/236345560 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3051187080 0 0) 0x7f7568070460 con 0x7f75680732d0 2024-02-21T23:06:08.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.972+0000 7f7567400640 1 -- 172.21.15.99:0/236345560 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f756806f3c0 con 0x7f756817d640 2024-02-21T23:06:08.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.974+0000 7f7567400640 1 --2- 172.21.15.99:0/236345560 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f756817d640 0x7f756806e980 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f75580097a0 tx=0x7f755802b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15dc753c21b7ef6b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:08.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.974+0000 7f7566000640 1 -- 172.21.15.99:0/236345560 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7558034070 con 0x7f756817d640 2024-02-21T23:06:08.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.974+0000 7f7566000640 1 -- 172.21.15.99:0/236345560 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7558030610 con 0x7f756817d640 2024-02-21T23:06:08.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.974+0000 7f7566000640 1 -- 172.21.15.99:0/236345560 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75580309e0 con 0x7f756817d640 2024-02-21T23:06:08.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.975+0000 7f756e800640 1 -- 172.21.15.99:0/236345560 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f756817d640 msgr2=0x7f756806e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:08.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.975+0000 7f756e800640 1 --2- 172.21.15.99:0/236345560 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f756817d640 0x7f756806e980 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f75580097a0 tx=0x7f755802b960 comp rx=0 tx=0).stop 2024-02-21T23:06:08.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.975+0000 7f756e800640 1 -- 172.21.15.99:0/236345560 shutdown_connections 2024-02-21T23:06:08.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.975+0000 7f756e800640 1 --2- 172.21.15.99:0/236345560 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f756817d640 0x7f756806e980 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:08.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.975+0000 7f756e800640 1 -- 172.21.15.99:0/236345560 >> 172.21.15.99:0/236345560 conn(0x7f75680ce5e0 msgr2=0x7f75680ce9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:06:08.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.975+0000 7f756e800640 1 -- 172.21.15.99:0/236345560 shutdown_connections 2024-02-21T23:06:08.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.975+0000 7f756e800640 1 -- 172.21.15.99:0/236345560 wait complete. 2024-02-21T23:06:08.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.978+0000 7f756e800640 1 Processor -- start 2024-02-21T23:06:08.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.979+0000 7f756e800640 1 -- start start 2024-02-21T23:06:08.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.981+0000 7f756e800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f75680732d0 0x7f7568186a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:08.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.981+0000 7f756e800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f756817d640 0x7f7568186f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:08.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.981+0000 7f756e800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7568185090 0x7f7568166130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:08.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.981+0000 7f756e800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f756806f980 con 0x7f7568185090 2024-02-21T23:06:08.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.981+0000 7f756e800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f756806ffd0 con 0x7f75680732d0 2024-02-21T23:06:08.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.981+0000 7f756e800640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f756806fc60 con 0x7f756817d640 2024-02-21T23:06:08.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.981+0000 7f7566a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f756817d640 0x7f7568186f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:08.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.981+0000 7f7566a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f756817d640 0x7f7568186f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:40622/0 (socket says 172.21.15.99:40622) 2024-02-21T23:06:08.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.981+0000 7f7566a00640 1 -- 172.21.15.99:0/3129124919 learned_addr learned my addr 172.21.15.99:0/3129124919 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:06:08.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.981+0000 7f7567400640 1 --2- 172.21.15.99:0/3129124919 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f75680732d0 0x7f7568186a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:08.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.981+0000 7f7567e00640 1 --2- 172.21.15.99:0/3129124919 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7568185090 0x7f7568166130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:08.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.981+0000 7f7566a00640 1 -- 172.21.15.99:0/3129124919 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f75680732d0 msgr2=0x7f7568186a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:08.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.981+0000 7f7566a00640 1 --2- 172.21.15.99:0/3129124919 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f75680732d0 0x7f7568186a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:08.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.981+0000 7f7566a00640 1 -- 172.21.15.99:0/3129124919 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7568185090 msgr2=0x7f7568166130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:08.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.981+0000 7f7566a00640 1 --2- 172.21.15.99:0/3129124919 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7568185090 0x7f7568166130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:08.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.981+0000 7f7566a00640 1 -- 172.21.15.99:0/3129124919 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7568220460 con 0x7f756817d640 2024-02-21T23:06:08.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.982+0000 7f7566a00640 1 --2- 172.21.15.99:0/3129124919 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f756817d640 0x7f7568186f40 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f755400c3f0 tx=0x7f755400c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:08.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.982+0000 7f755f400640 1 -- 172.21.15.99:0/3129124919 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75540074e0 con 0x7f756817d640 2024-02-21T23:06:08.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.982+0000 7f755f400640 1 -- 172.21.15.99:0/3129124919 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75540047e0 con 0x7f756817d640 2024-02-21T23:06:08.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.982+0000 7f756e800640 1 -- 172.21.15.99:0/3129124919 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7568185960 con 0x7f756817d640 2024-02-21T23:06:08.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.982+0000 7f755f400640 1 -- 172.21.15.99:0/3129124919 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7554004c10 con 0x7f756817d640 2024-02-21T23:06:08.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.982+0000 7f756e800640 1 -- 172.21.15.99:0/3129124919 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7568185f20 con 0x7f756817d640 2024-02-21T23:06:08.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.986+0000 7f755f400640 1 -- 172.21.15.99:0/3129124919 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f7554011070 con 0x7f756817d640 2024-02-21T23:06:08.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.986+0000 7f75717b4740 1 Processor -- start 2024-02-21T23:06:08.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.986+0000 7f75717b4740 1 -- start start 2024-02-21T23:06:08.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.987+0000 7f75717b4740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5582e5a702f0 0x5582e5a706d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:08.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.987+0000 7f75717b4740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5582e5a70c10 0x5582e5aab480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:08.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.987+0000 7f75717b4740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5582e5aab9c0 0x5582e5aac750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:08.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.987+0000 7f75717b4740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582e5998790 con 0x5582e5aab9c0 2024-02-21T23:06:08.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.987+0000 7f75717b4740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582e5941bf0 con 0x5582e5a70c10 2024-02-21T23:06:08.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.987+0000 7f75717b4740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582e5994830 con 0x5582e5a702f0 2024-02-21T23:06:08.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.988+0000 7f7566a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5582e5aab9c0 0x5582e5aac750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:08.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.988+0000 7f755f400640 1 --2- 172.21.15.99:0/3129124919 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f754809eed0 0x7f75480a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:08.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.988+0000 7f7567e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5582e5a702f0 0x5582e5a706d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:08.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.988+0000 7f7566a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5582e5aab9c0 0x5582e5aac750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:41890/0 (socket says 172.21.15.99:41890) 2024-02-21T23:06:08.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.988+0000 7f7566a00640 1 -- 172.21.15.99:0/3854242072 learned_addr learned my addr 172.21.15.99:0/3854242072 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:06:08.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.988+0000 7f7567400640 1 --2- 172.21.15.99:0/3854242072 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5582e5a70c10 0x5582e5aab480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:08.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.988+0000 7f755f400640 1 -- 172.21.15.99:0/3129124919 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f75540c9a40 con 0x7f756817d640 2024-02-21T23:06:08.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.988+0000 7f7567e00640 1 --2- 172.21.15.99:0/3129124919 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f754809eed0 0x7f75480a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:08.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.988+0000 7f7567e00640 1 -- 172.21.15.99:0/3854242072 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5582e5a70c10 msgr2=0x5582e5aab480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:08.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.988+0000 7f7567e00640 1 --2- 172.21.15.99:0/3854242072 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5582e5a70c10 0x5582e5aab480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:08.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.988+0000 7f7567e00640 1 -- 172.21.15.99:0/3854242072 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5582e5aab9c0 msgr2=0x5582e5aac750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:08.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.989+0000 7f7567e00640 1 --2- 172.21.15.99:0/3854242072 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5582e5aab9c0 0x5582e5aac750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:08.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.989+0000 7f7567e00640 1 -- 172.21.15.99:0/3854242072 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5582e595fc40 con 0x5582e5a702f0 2024-02-21T23:06:08.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.989+0000 7f7566a00640 1 --2- 172.21.15.99:0/3854242072 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5582e5aab9c0 0x5582e5aac750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:06:08.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.989+0000 7f7567e00640 1 --2- 172.21.15.99:0/3854242072 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5582e5a702f0 0x5582e5a706d0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f75600165f0 tx=0x7f75600169f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81d244b79ff41440 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:08.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.989+0000 7f7553e00640 1 -- 172.21.15.99:0/3854242072 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f756001d030 con 0x5582e5a702f0 2024-02-21T23:06:08.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.989+0000 7f7553e00640 1 -- 172.21.15.99:0/3854242072 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7560018d80 con 0x5582e5a702f0 2024-02-21T23:06:08.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.989+0000 7f7553e00640 1 -- 172.21.15.99:0/3854242072 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7560001f10 con 0x5582e5a702f0 2024-02-21T23:06:08.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.990+0000 7f75717b4740 1 -- 172.21.15.99:0/3854242072 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5582e5a702f0 msgr2=0x5582e5a706d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:08.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.990+0000 7f7567e00640 1 --2- 172.21.15.99:0/3129124919 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f754809eed0 0x7f75480a1390 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7560020000 tx=0x7f756001e000 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:08.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.990+0000 7f75717b4740 1 --2- 172.21.15.99:0/3854242072 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5582e5a702f0 0x5582e5a706d0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f75600165f0 tx=0x7f75600169f0 comp rx=0 tx=0).stop 2024-02-21T23:06:08.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.990+0000 7f75717b4740 1 -- 172.21.15.99:0/3854242072 shutdown_connections 2024-02-21T23:06:08.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.990+0000 7f75717b4740 1 --2- 172.21.15.99:0/3854242072 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5582e5aab9c0 0x5582e5aac750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:08.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.990+0000 7f75717b4740 1 --2- 172.21.15.99:0/3854242072 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5582e5a70c10 0x5582e5aab480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:08.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.990+0000 7f75717b4740 1 --2- 172.21.15.99:0/3854242072 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5582e5a702f0 0x5582e5a706d0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:08.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.990+0000 7f75717b4740 1 -- 172.21.15.99:0/3854242072 >> 172.21.15.99:0/3854242072 conn(0x5582e5a328c0 msgr2=0x5582e5a33940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:06:08.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.990+0000 7f75717b4740 1 -- 172.21.15.99:0/3854242072 shutdown_connections 2024-02-21T23:06:08.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.990+0000 7f75717b4740 1 -- 172.21.15.99:0/3854242072 wait complete. 2024-02-21T23:06:08.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.992+0000 7f75717b4740 1 -- start start 2024-02-21T23:06:08.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.992+0000 7f75717b4740 1 Processor -- start 2024-02-21T23:06:08.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.994+0000 7f75717b4740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5582e5a70c10 0x5582e5a63ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:08.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.994+0000 7f75717b4740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5582e5aab9c0 0x5582e5a625a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:08.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.994+0000 7f75717b4740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5582e5ab5cd0 0x5582e5ab2b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:08.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.994+0000 7f75717b4740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582e5aa9ea0 con 0x5582e5ab5cd0 2024-02-21T23:06:08.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.994+0000 7f75717b4740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582e59371d0 con 0x5582e5a70c10 2024-02-21T23:06:08.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.994+0000 7f75717b4740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582e5aaa180 con 0x5582e5aab9c0 2024-02-21T23:06:08.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.994+0000 7f75717b4740 10 client.0 _ll_register_callbacks cb 0x5582e56acc60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:06:08.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.995+0000 7f7567e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5582e5ab5cd0 0x5582e5ab2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:08.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.995+0000 7f7567400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5582e5a70c10 0x5582e5a63ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:08.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.995+0000 7f7567400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5582e5a70c10 0x5582e5a63ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:46574/0 (socket says 172.21.15.99:46574) 2024-02-21T23:06:08.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.995+0000 7f7567400640 1 -- 172.21.15.99:0/1307369086 learned_addr learned my addr 172.21.15.99:0/1307369086 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:06:08.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.995+0000 7f7567e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5582e5ab5cd0 0x5582e5ab2b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:41892/0 (socket says 172.21.15.99:41892) 2024-02-21T23:06:08.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.995+0000 7f7566a00640 1 --2- 172.21.15.99:0/1307369086 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5582e5aab9c0 0x5582e5a625a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:08.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.995+0000 7f7566a00640 1 -- 172.21.15.99:0/1307369086 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5582e5a70c10 msgr2=0x5582e5a63ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:08.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.995+0000 7f7566a00640 1 --2- 172.21.15.99:0/1307369086 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5582e5a70c10 0x5582e5a63ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:08.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.995+0000 7f7566a00640 1 -- 172.21.15.99:0/1307369086 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5582e5ab5cd0 msgr2=0x5582e5ab2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:08.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.995+0000 7f7566a00640 1 --2- 172.21.15.99:0/1307369086 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5582e5ab5cd0 0x5582e5ab2b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:08.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.995+0000 7f7566a00640 1 -- 172.21.15.99:0/1307369086 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5582e57757e0 con 0x5582e5aab9c0 2024-02-21T23:06:08.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.995+0000 7f7567400640 1 --2- 172.21.15.99:0/1307369086 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5582e5a70c10 0x5582e5a63ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:06:08.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.995+0000 7f7567e00640 1 --2- 172.21.15.99:0/1307369086 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5582e5ab5cd0 0x5582e5ab2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:06:08.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.996+0000 7f7566a00640 1 --2- 172.21.15.99:0/1307369086 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5582e5aab9c0 0x5582e5a625a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f7554097270 tx=0x7f7554096f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e8eb931be0982e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:08.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.996+0000 7f7550c00640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-02-21T23:06:08.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.996+0000 7f7550c00640 1 -- 172.21.15.99:0/1307369086 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75540c74b0 con 0x5582e5aab9c0 2024-02-21T23:06:08.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.996+0000 7f7550c00640 1 -- 172.21.15.99:0/1307369086 <== mon.2 v2:172.21.15.181:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f75540b4d40 con 0x5582e5aab9c0 2024-02-21T23:06:08.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.996+0000 7f75717b4740 1 -- 172.21.15.99:0/1307369086 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7560018d80 con 0x5582e5aab9c0 2024-02-21T23:06:08.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.996+0000 7f7550c00640 1 -- 172.21.15.99:0/1307369086 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f75540972e0 con 0x5582e5aab9c0 2024-02-21T23:06:08.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.996+0000 7f75717b4740 10 client.6035 fetch_fsmap learned FSMap version 16 2024-02-21T23:06:08.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.996+0000 7f75717b4740 1 -- 172.21.15.99:0/1307369086 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x5582e57d5f70 con 0x5582e5aab9c0 2024-02-21T23:06:08.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.996+0000 7f7550c00640 1 -- 172.21.15.99:0/1307369086 <== mon.2 v2:172.21.15.181:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7560018d80 con 0x5582e5aab9c0 2024-02-21T23:06:08.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.997+0000 7f7550c00640 1 -- 172.21.15.99:0/1307369086 <== mon.2 v2:172.21.15.181:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f7554096730 con 0x5582e5aab9c0 2024-02-21T23:06:08.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.997+0000 7f75717b4740 10 client.6035 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T23:06:08.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.997+0000 7f75717b4740 10 client.6035 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:06:08.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.997+0000 7f75717b4740 20 client.6035 populate_metadata read hostname 'smithi099' 2024-02-21T23:06:08.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.997+0000 7f75717b4740 1 --2- 172.21.15.99:0/1307369086 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5582e5ab82a0 0x5582e5ab86b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:08.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.997+0000 7f75717b4740 4 client.6035 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:06:08.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.997+0000 7f75717b4740 1 -- 172.21.15.99:0/1307369086 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5582e59a5cd0 con 0x5582e5ab82a0 2024-02-21T23:06:08.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.997+0000 7f7567400640 1 --2- 172.21.15.99:0/1307369086 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5582e5ab82a0 0x5582e5ab86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:08.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.998+0000 7f7567400640 1 --2- 172.21.15.99:0/1307369086 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5582e5ab82a0 0x5582e5ab86b0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd31bc1d43a69a59 server_cookie=40148fcc8b887ef1 in_seq=0 out_seq=0 2024-02-21T23:06:08.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.998+0000 7f7550c00640 10 client.6035 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:06:08.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.999+0000 7f7550c00640 1 -- 172.21.15.99:0/1307369086 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x5582e59a5cd0 con 0x5582e5ab82a0 2024-02-21T23:06:08.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.999+0000 7f7550c00640 10 client.6035 handle_command_reply: tid=0 2024-02-21T23:06:08.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.999+0000 7f75717b4740 1 client.6035 shutdown 2024-02-21T23:06:08.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.999+0000 7f75717b4740 1 -- 172.21.15.99:0/1307369086 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5582e5aab9c0 msgr2=0x5582e5a625a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:08.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.999+0000 7f75717b4740 1 --2- 172.21.15.99:0/1307369086 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5582e5aab9c0 0x5582e5a625a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f7554097270 tx=0x7f7554096f10 comp rx=0 tx=0).stop 2024-02-21T23:06:08.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.999+0000 7f75717b4740 1 -- 172.21.15.99:0/1307369086 shutdown_connections 2024-02-21T23:06:08.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.999+0000 7f75717b4740 1 --2- 172.21.15.99:0/1307369086 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5582e5ab82a0 0x5582e5ab86b0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:08.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.999+0000 7f75717b4740 1 --2- 172.21.15.99:0/1307369086 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5582e5ab5cd0 0x5582e5ab2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:08.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.999+0000 7f75717b4740 1 --2- 172.21.15.99:0/1307369086 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5582e5aab9c0 0x5582e5a625a0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:08.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.999+0000 7f75717b4740 1 --2- 172.21.15.99:0/1307369086 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5582e5a70c10 0x5582e5a63ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:08.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.999+0000 7f7550c00640 0 client.6035 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:06:08.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.999+0000 7f75717b4740 1 -- 172.21.15.99:0/1307369086 >> 172.21.15.99:0/1307369086 conn(0x5582e5a702f0 msgr2=0x5582e5a34330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:06:08.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.999+0000 7f75717b4740 1 -- 172.21.15.99:0/1307369086 shutdown_connections 2024-02-21T23:06:08.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.999+0000 7f75717b4740 1 -- 172.21.15.99:0/1307369086 wait complete. 2024-02-21T23:06:08.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:08.999+0000 7f75717b4740 20 client.6035 trim_cache size 0 max 16384 2024-02-21T23:06:09.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.026+0000 7f75717b4740 1 Processor -- start 2024-02-21T23:06:09.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.026+0000 7f75717b4740 1 -- start start 2024-02-21T23:06:09.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.028+0000 7f75717b4740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5582e5a70c10 0x5582e5a31f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:09.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.028+0000 7f75717b4740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5582e5aab9c0 0x5582e5aa93f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:09.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.028+0000 7f75717b4740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5582e5ab5cd0 0x5582e5a624b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:09.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.028+0000 7f75717b4740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f756822c800 con 0x5582e5a70c10 2024-02-21T23:06:09.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.028+0000 7f75717b4740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f756822a3a0 con 0x5582e5ab5cd0 2024-02-21T23:06:09.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.028+0000 7f75717b4740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75682284a0 con 0x5582e5aab9c0 2024-02-21T23:06:09.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.029+0000 7f7567400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5582e5a70c10 0x5582e5a31f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:09.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.029+0000 7f7567400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5582e5a70c10 0x5582e5a31f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:41898/0 (socket says 172.21.15.99:41898) 2024-02-21T23:06:09.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.029+0000 7f7567400640 1 -- 172.21.15.99:0/259365068 learned_addr learned my addr 172.21.15.99:0/259365068 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:06:09.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.029+0000 7f7567e00640 1 --2- 172.21.15.99:0/259365068 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5582e5ab5cd0 0x5582e5a624b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:09.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.029+0000 7f7566a00640 1 --2- 172.21.15.99:0/259365068 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5582e5aab9c0 0x5582e5aa93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:09.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.029+0000 7f7567400640 1 -- 172.21.15.99:0/259365068 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5582e5aab9c0 msgr2=0x5582e5aa93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:09.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.029+0000 7f7567400640 1 --2- 172.21.15.99:0/259365068 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5582e5aab9c0 0x5582e5aa93f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:09.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.029+0000 7f7567400640 1 -- 172.21.15.99:0/259365068 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5582e5ab5cd0 msgr2=0x5582e5a624b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:09.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.029+0000 7f7567400640 1 --2- 172.21.15.99:0/259365068 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5582e5ab5cd0 0x5582e5a624b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:09.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.029+0000 7f7567400640 1 -- 172.21.15.99:0/259365068 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5582e566d170 con 0x5582e5a70c10 2024-02-21T23:06:09.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.029+0000 7f7567400640 1 --2- 172.21.15.99:0/259365068 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5582e5a70c10 0x5582e5a31f90 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f7558009560 tx=0x7f7558030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=927949bc67cd27c7 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:09.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.030+0000 7f7553400640 1 -- 172.21.15.99:0/259365068 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7558034040 con 0x5582e5a70c10 2024-02-21T23:06:09.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.030+0000 7f7553400640 1 -- 172.21.15.99:0/259365068 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7558003a50 con 0x5582e5a70c10 2024-02-21T23:06:09.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.030+0000 7f7553400640 1 -- 172.21.15.99:0/259365068 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7558003e40 con 0x5582e5a70c10 2024-02-21T23:06:09.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.030+0000 7f75717b4740 1 -- 172.21.15.99:0/259365068 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5582e5a70c10 msgr2=0x5582e5a31f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:09.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.030+0000 7f75717b4740 1 --2- 172.21.15.99:0/259365068 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5582e5a70c10 0x5582e5a31f90 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f7558009560 tx=0x7f7558030000 comp rx=0 tx=0).stop 2024-02-21T23:06:09.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.030+0000 7f75717b4740 1 -- 172.21.15.99:0/259365068 shutdown_connections 2024-02-21T23:06:09.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.030+0000 7f75717b4740 1 --2- 172.21.15.99:0/259365068 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5582e5ab5cd0 0x5582e5a624b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:09.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.030+0000 7f75717b4740 1 --2- 172.21.15.99:0/259365068 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5582e5aab9c0 0x5582e5aa93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:09.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.030+0000 7f75717b4740 1 --2- 172.21.15.99:0/259365068 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5582e5a70c10 0x5582e5a31f90 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:09.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.031+0000 7f75717b4740 1 -- 172.21.15.99:0/259365068 >> 172.21.15.99:0/259365068 conn(0x5582e5a702f0 msgr2=0x5582e5a34330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:06:09.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.031+0000 7f75717b4740 1 -- 172.21.15.99:0/259365068 shutdown_connections 2024-02-21T23:06:09.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.031+0000 7f75717b4740 1 -- 172.21.15.99:0/259365068 wait complete. 2024-02-21T23:06:09.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.031+0000 7f75717b4740 1 -- start start 2024-02-21T23:06:09.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.032+0000 7f75717b4740 1 Processor -- start 2024-02-21T23:06:09.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.033+0000 7f75717b4740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5582e5a70c10 0x5582e5aa0710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:09.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.033+0000 7f75717b4740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5582e5aab9c0 0x5582e5a5eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:09.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.033+0000 7f75717b4740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5582e5ab5cd0 0x5582e5ab6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:09.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.033+0000 7f75717b4740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7568228aa0 con 0x5582e5aab9c0 2024-02-21T23:06:09.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.033+0000 7f75717b4740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7568229d40 con 0x5582e5a70c10 2024-02-21T23:06:09.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.033+0000 7f75717b4740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75682290a0 con 0x5582e5ab5cd0 2024-02-21T23:06:09.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.033+0000 7f75717b4740 10 client.0 _ll_register_callbacks cb 0x7f7554097180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:06:09.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.033+0000 7f7567400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5582e5a70c10 0x5582e5aa0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:09.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.033+0000 7f7566a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5582e5aab9c0 0x5582e5a5eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:09.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.033+0000 7f7567400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5582e5a70c10 0x5582e5aa0710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:46592/0 (socket says 172.21.15.99:46592) 2024-02-21T23:06:09.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.033+0000 7f7567400640 1 -- 172.21.15.99:0/2183285178 learned_addr learned my addr 172.21.15.99:0/2183285178 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:06:09.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.033+0000 7f7567e00640 1 --2- 172.21.15.99:0/2183285178 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5582e5ab5cd0 0x5582e5ab6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:09.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.034+0000 7f7567400640 1 -- 172.21.15.99:0/2183285178 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5582e5ab5cd0 msgr2=0x5582e5ab6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:09.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.034+0000 7f7567400640 1 --2- 172.21.15.99:0/2183285178 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5582e5ab5cd0 0x5582e5ab6ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:09.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.034+0000 7f7567400640 1 -- 172.21.15.99:0/2183285178 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5582e5aab9c0 msgr2=0x5582e5a5eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:09.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.034+0000 7f7567400640 1 --2- 172.21.15.99:0/2183285178 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5582e5aab9c0 0x5582e5a5eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:09.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.034+0000 7f7567400640 1 -- 172.21.15.99:0/2183285178 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5582e5aa98c0 con 0x5582e5a70c10 2024-02-21T23:06:09.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.034+0000 7f7567400640 1 --2- 172.21.15.99:0/2183285178 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5582e5a70c10 0x5582e5aa0710 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f75580098c0 tx=0x7f7558004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12217e2c613f929d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:09.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.034+0000 7f7550c00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-02-21T23:06:09.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.034+0000 7f7550c00640 1 -- 172.21.15.99:0/2183285178 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7558054060 con 0x5582e5a70c10 2024-02-21T23:06:09.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.034+0000 7f75717b4740 1 -- 172.21.15.99:0/2183285178 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7558003a50 con 0x5582e5a70c10 2024-02-21T23:06:09.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.034+0000 7f7550c00640 1 -- 172.21.15.99:0/2183285178 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f7558039450 con 0x5582e5a70c10 2024-02-21T23:06:09.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.035+0000 7f7550c00640 1 -- 172.21.15.99:0/2183285178 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7558034030 con 0x5582e5a70c10 2024-02-21T23:06:09.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.035+0000 7f75717b4740 10 client.6040 fetch_fsmap learned FSMap version 16 2024-02-21T23:06:09.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.035+0000 7f75717b4740 1 -- 172.21.15.99:0/2183285178 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x5582e5a5bcb0 con 0x5582e5a70c10 2024-02-21T23:06:09.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.035+0000 7f7550c00640 1 -- 172.21.15.99:0/2183285178 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7558003a50 con 0x5582e5a70c10 2024-02-21T23:06:09.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.036+0000 7f7550c00640 1 -- 172.21.15.99:0/2183285178 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f755802f050 con 0x5582e5a70c10 2024-02-21T23:06:09.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.036+0000 7f75717b4740 10 client.6040 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T23:06:09.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.036+0000 7f75717b4740 10 client.6040 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:06:09.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.036+0000 7f75717b4740 20 client.6040 populate_metadata read hostname 'smithi099' 2024-02-21T23:06:09.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.036+0000 7f75717b4740 1 --2- 172.21.15.99:0/2183285178 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5582e5abcac0 0x5582e5ab7020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:09.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.036+0000 7f75717b4740 4 client.6040 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-02-21T23:06:09.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.036+0000 7f75717b4740 1 -- 172.21.15.99:0/2183285178 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x5582e59a0020 con 0x5582e5abcac0 2024-02-21T23:06:09.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.036+0000 7f7566a00640 1 --2- 172.21.15.99:0/2183285178 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5582e5abcac0 0x5582e5ab7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:09.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.037+0000 7f7566a00640 1 --2- 172.21.15.99:0/2183285178 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5582e5abcac0 0x5582e5ab7020 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b98e0e5b546bc479 server_cookie=8f1583cedead6526 in_seq=0 out_seq=0 2024-02-21T23:06:09.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.037+0000 7f7550c00640 10 client.6040 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:06:09.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.038+0000 7f7550c00640 1 -- 172.21.15.99:0/2183285178 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5582e59a0020 con 0x5582e5abcac0 2024-02-21T23:06:09.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.038+0000 7f7550c00640 10 client.6040 handle_command_reply: tid=0 2024-02-21T23:06:09.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.038+0000 7f75717b4740 1 client.6040 shutdown 2024-02-21T23:06:09.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.038+0000 7f75717b4740 1 -- 172.21.15.99:0/2183285178 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5582e5a70c10 msgr2=0x5582e5aa0710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:09.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.038+0000 7f75717b4740 1 --2- 172.21.15.99:0/2183285178 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5582e5a70c10 0x5582e5aa0710 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f75580098c0 tx=0x7f7558004730 comp rx=0 tx=0).stop 2024-02-21T23:06:09.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.038+0000 7f75717b4740 1 -- 172.21.15.99:0/2183285178 shutdown_connections 2024-02-21T23:06:09.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.038+0000 7f75717b4740 1 --2- 172.21.15.99:0/2183285178 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5582e5abcac0 0x5582e5ab7020 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:09.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.038+0000 7f75717b4740 1 --2- 172.21.15.99:0/2183285178 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5582e5ab5cd0 0x5582e5ab6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:09.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.038+0000 7f75717b4740 1 --2- 172.21.15.99:0/2183285178 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5582e5aab9c0 0x5582e5a5eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:09.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.038+0000 7f75717b4740 1 --2- 172.21.15.99:0/2183285178 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5582e5a70c10 0x5582e5aa0710 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:09.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.038+0000 7f75717b4740 1 -- 172.21.15.99:0/2183285178 >> 172.21.15.99:0/2183285178 conn(0x5582e5a702f0 msgr2=0x5582e5a621a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:06:09.033 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-02-21T23:06:09.034 INFO:teuthology.orchestra.run.smithi099.stdout: "return_code": 0, 2024-02-21T23:06:09.034 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_tag": "e1f4c941-d26b-416e-9073-41a7abdfdfeb", 2024-02-21T23:06:09.034 INFO:teuthology.orchestra.run.smithi099.stdout: "mode": "asynchronous" 2024-02-21T23:06:09.034 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-02-21T23:06:09.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.039+0000 7f7550c00640 0 client.6040 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:06:09.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.039+0000 7f75717b4740 1 -- 172.21.15.99:0/2183285178 shutdown_connections 2024-02-21T23:06:09.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.039+0000 7f75717b4740 1 -- 172.21.15.99:0/2183285178 wait complete. 2024-02-21T23:06:09.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.039+0000 7f75717b4740 20 client.6040 trim_cache size 0 max 16384 2024-02-21T23:06:09.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.040+0000 7f756e800640 1 -- 172.21.15.99:0/3129124919 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f754809eed0 msgr2=0x7f75480a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:09.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.040+0000 7f756e800640 1 --2- 172.21.15.99:0/3129124919 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f754809eed0 0x7f75480a1390 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7560020000 tx=0x7f756001e000 comp rx=0 tx=0).stop 2024-02-21T23:06:09.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.040+0000 7f756e800640 1 -- 172.21.15.99:0/3129124919 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f756817d640 msgr2=0x7f7568186f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:09.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.040+0000 7f756e800640 1 --2- 172.21.15.99:0/3129124919 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f756817d640 0x7f7568186f40 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f755400c3f0 tx=0x7f755400c8b0 comp rx=0 tx=0).stop 2024-02-21T23:06:09.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.041+0000 7f756e800640 1 -- 172.21.15.99:0/3129124919 shutdown_connections 2024-02-21T23:06:09.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.041+0000 7f756e800640 1 --2- 172.21.15.99:0/3129124919 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f754809eed0 0x7f75480a1390 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:09.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.041+0000 7f756e800640 1 --2- 172.21.15.99:0/3129124919 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7568185090 0x7f7568166130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:09.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.041+0000 7f756e800640 1 --2- 172.21.15.99:0/3129124919 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f756817d640 0x7f7568186f40 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:09.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.041+0000 7f756e800640 1 --2- 172.21.15.99:0/3129124919 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f75680732d0 0x7f7568186a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:09.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.041+0000 7f756e800640 1 -- 172.21.15.99:0/3129124919 >> 172.21.15.99:0/3129124919 conn(0x7f75680ce5e0 msgr2=0x7f7568184880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:06:09.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.041+0000 7f756e800640 1 -- 172.21.15.99:0/3129124919 shutdown_connections 2024-02-21T23:06:09.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.041+0000 7f756e800640 1 -- 172.21.15.99:0/3129124919 wait complete. 2024-02-21T23:06:09.053 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T23:06:09.053 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T23:06:09.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.356+0000 7f0b1d800640 1 Processor -- start 2024-02-21T23:06:09.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.356+0000 7f0b1d800640 1 -- start start 2024-02-21T23:06:09.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.359+0000 7f0b1d800640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f0b1817f490 0x7f0b1818ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:09.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.359+0000 7f0b1d800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f0b1818b060 0x7f0b18188a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:09.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.359+0000 7f0b1d800640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b180d6dd0 con 0x7f0b1818b4f0 2024-02-21T23:06:09.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.359+0000 7f0b1d800640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b181614c0 con 0x7f0b1818b060 2024-02-21T23:06:09.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.359+0000 7f0b1d800640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b180d6810 con 0x7f0b1817f490 2024-02-21T23:06:09.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.359+0000 7f0b1ce00640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f0b1818b4f0 0x7f0b18188f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:40314/0 (socket says 172.21.15.99:40314) 2024-02-21T23:06:09.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.359+0000 7f0b17e00640 1 --2- 172.21.15.99:0/3096491532 >> v2:172.21.15.181:3300/0 conn(0x7f0b1817f490 0x7f0b1818ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:09.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.359+0000 7f0b1ce00640 1 -- 172.21.15.99:0/3096491532 learned_addr learned my addr 172.21.15.99:0/3096491532 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:06:09.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.360+0000 7f0b16a00640 1 -- 172.21.15.99:0/3096491532 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1352574365 0 0) 0x7f0b180d6dd0 con 0x7f0b1818b4f0 2024-02-21T23:06:09.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.360+0000 7f0b16a00640 1 -- 172.21.15.99:0/3096491532 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0afc003520 con 0x7f0b1818b4f0 2024-02-21T23:06:09.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.360+0000 7f0b17e00640 1 -- 172.21.15.99:0/3096491532 >> v2:172.21.15.99:3300/0 conn(0x7f0b1818b060 msgr2=0x7f0b18188a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:09.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.360+0000 7f0b17e00640 1 --2- 172.21.15.99:0/3096491532 >> v2:172.21.15.99:3300/0 conn(0x7f0b1818b060 0x7f0b18188a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:09.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.360+0000 7f0b17e00640 1 -- 172.21.15.99:0/3096491532 >> v1:172.21.15.181:6789/0 conn(0x7f0b1818b4f0 legacy=0x7f0b18188f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:09.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.360+0000 7f0b17e00640 1 -- 172.21.15.99:0/3096491532 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b180d6af0 con 0x7f0b1817f490 2024-02-21T23:06:09.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.362+0000 7f0b17e00640 1 --2- 172.21.15.99:0/3096491532 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0b1817f490 0x7f0b1818ab20 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f0b18067c30 tx=0x7f0b0802b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7db634f09418c9 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:09.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.363+0000 7f0b16a00640 1 -- 172.21.15.99:0/3096491532 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b080315a0 con 0x7f0b1817f490 2024-02-21T23:06:09.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.363+0000 7f0b16a00640 1 -- 172.21.15.99:0/3096491532 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b08037070 con 0x7f0b1817f490 2024-02-21T23:06:09.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.363+0000 7f0b16a00640 1 -- 172.21.15.99:0/3096491532 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b08031960 con 0x7f0b1817f490 2024-02-21T23:06:09.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.364+0000 7f0b1d800640 1 -- 172.21.15.99:0/3096491532 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0b1817f490 msgr2=0x7f0b1818ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:09.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.364+0000 7f0b1d800640 1 --2- 172.21.15.99:0/3096491532 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0b1817f490 0x7f0b1818ab20 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f0b18067c30 tx=0x7f0b0802b840 comp rx=0 tx=0).stop 2024-02-21T23:06:09.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.364+0000 7f0b1d800640 1 -- 172.21.15.99:0/3096491532 shutdown_connections 2024-02-21T23:06:09.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.364+0000 7f0b1d800640 1 --2- 172.21.15.99:0/3096491532 >> v2:172.21.15.99:3300/0 conn(0x7f0b1818b060 0x7f0b18188a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:09.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.364+0000 7f0b1d800640 1 --2- 172.21.15.99:0/3096491532 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0b1817f490 0x7f0b1818ab20 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:09.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.364+0000 7f0b1d800640 1 -- 172.21.15.99:0/3096491532 >> 172.21.15.99:0/3096491532 conn(0x7f0b180d29b0 msgr2=0x7f0b180d2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:06:09.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.364+0000 7f0b1d800640 1 -- 172.21.15.99:0/3096491532 shutdown_connections 2024-02-21T23:06:09.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.364+0000 7f0b1d800640 1 -- 172.21.15.99:0/3096491532 wait complete. 2024-02-21T23:06:09.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.368+0000 7f0b1d800640 1 Processor -- start 2024-02-21T23:06:09.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.368+0000 7f0b1d800640 1 -- start start 2024-02-21T23:06:09.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.370+0000 7f0b1d800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0b1817f490 0x7f0b1815ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:09.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.370+0000 7f0b1d800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b1818b060 0x7f0b1817c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:09.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.370+0000 7f0b1d800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0b1818b4f0 0x7f0b1817c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:09.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.371+0000 7f0b1d800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b1818a600 con 0x7f0b1818b060 2024-02-21T23:06:09.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.371+0000 7f0b1ce00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0b1818b4f0 0x7f0b1817c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:09.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.371+0000 7f0b17400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b1818b060 0x7f0b1817c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:09.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.371+0000 7f0b1ce00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0b1818b4f0 0x7f0b1817c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:46606/0 (socket says 172.21.15.99:46606) 2024-02-21T23:06:09.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.371+0000 7f0b1ce00640 1 -- 172.21.15.99:0/2957025313 learned_addr learned my addr 172.21.15.99:0/2957025313 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:06:09.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.371+0000 7f0b1d800640 1 -- 172.21.15.99:0/2957025313 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b1818a320 con 0x7f0b1818b4f0 2024-02-21T23:06:09.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.371+0000 7f0b1d800640 1 -- 172.21.15.99:0/2957025313 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b1817f870 con 0x7f0b1817f490 2024-02-21T23:06:09.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.372+0000 7f0b1ce00640 1 -- 172.21.15.99:0/2957025313 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0b1817f490 msgr2=0x7f0b1815ba00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-21T23:06:09.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.372+0000 7f0b1ce00640 1 --2- 172.21.15.99:0/2957025313 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0b1817f490 0x7f0b1815ba00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:09.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.372+0000 7f0b1ce00640 1 -- 172.21.15.99:0/2957025313 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b1818b060 msgr2=0x7f0b1817c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:09.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.372+0000 7f0b1ce00640 1 --2- 172.21.15.99:0/2957025313 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b1818b060 0x7f0b1817c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:09.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.372+0000 7f0b1ce00640 1 -- 172.21.15.99:0/2957025313 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b1815bf40 con 0x7f0b1818b4f0 2024-02-21T23:06:09.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.372+0000 7f0b17400640 1 --2- 172.21.15.99:0/2957025313 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b1818b060 0x7f0b1817c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:06:09.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.372+0000 7f0b1ce00640 1 --2- 172.21.15.99:0/2957025313 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0b1818b4f0 0x7f0b1817c660 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f0b10007fd0 tx=0x7f0b1000cc70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:09.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.373+0000 7f0b0fe00640 1 -- 172.21.15.99:0/2957025313 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b10018070 con 0x7f0b1818b4f0 2024-02-21T23:06:09.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.373+0000 7f0b0fe00640 1 -- 172.21.15.99:0/2957025313 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b1000a640 con 0x7f0b1818b4f0 2024-02-21T23:06:09.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.373+0000 7f0b1d800640 1 -- 172.21.15.99:0/2957025313 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b1817b0c0 con 0x7f0b1818b4f0 2024-02-21T23:06:09.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.373+0000 7f0b1d800640 1 -- 172.21.15.99:0/2957025313 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b1817b640 con 0x7f0b1818b4f0 2024-02-21T23:06:09.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.374+0000 7f0b0fe00640 1 -- 172.21.15.99:0/2957025313 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1000aa10 con 0x7f0b1818b4f0 2024-02-21T23:06:09.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.380+0000 7f0b0fe00640 1 -- 172.21.15.99:0/2957025313 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f0b1001b070 con 0x7f0b1818b4f0 2024-02-21T23:06:09.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.381+0000 7f0b21d83740 1 Processor -- start 2024-02-21T23:06:09.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.381+0000 7f0b21d83740 1 -- start start 2024-02-21T23:06:09.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.382+0000 7f0b0fe00640 1 --2- 172.21.15.99:0/2957025313 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f0af809ef50 0x7f0af80a1410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:09.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.383+0000 7f0b0fe00640 1 -- 172.21.15.99:0/2957025313 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f0b100c9490 con 0x7f0b1818b4f0 2024-02-21T23:06:09.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.383+0000 7f0b17400640 1 --2- 172.21.15.99:0/2957025313 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f0af809ef50 0x7f0af80a1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:09.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.384+0000 7f0b21d83740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ab04c562a0 0x55ab04c8bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:09.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.384+0000 7f0b21d83740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ab04c8c260 0x55ab04c56680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:09.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.384+0000 7f0b21d83740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab04c56bc0 0x55ab04c191d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:09.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.384+0000 7f0b17400640 1 --2- 172.21.15.99:0/2957025313 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f0af809ef50 0x7f0af80a1410 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0b180fcfc0 tx=0x7f0b04008040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:09.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.384+0000 7f0b21d83740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab04b82a90 con 0x55ab04c562a0 2024-02-21T23:06:09.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.384+0000 7f0b21d83740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab04b2bb10 con 0x55ab04c56bc0 2024-02-21T23:06:09.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.384+0000 7f0b21d83740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab04b7eb30 con 0x55ab04c8c260 2024-02-21T23:06:09.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.384+0000 7f0b17400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ab04c8c260 0x55ab04c56680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:09.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.384+0000 7f0b17400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ab04c8c260 0x55ab04c56680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:40694/0 (socket says 172.21.15.99:40694) 2024-02-21T23:06:09.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.384+0000 7f0b17400640 1 -- 172.21.15.99:0/2392940868 learned_addr learned my addr 172.21.15.99:0/2392940868 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:06:09.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.384+0000 7f0b1ce00640 1 --2- 172.21.15.99:0/2392940868 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab04c56bc0 0x55ab04c191d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:09.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.384+0000 7f0b17e00640 1 --2- 172.21.15.99:0/2392940868 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ab04c562a0 0x55ab04c8bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:09.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.385+0000 7f0b17400640 1 -- 172.21.15.99:0/2392940868 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab04c56bc0 msgr2=0x55ab04c191d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:09.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.385+0000 7f0b17400640 1 --2- 172.21.15.99:0/2392940868 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab04c56bc0 0x55ab04c191d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:09.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.385+0000 7f0b17400640 1 -- 172.21.15.99:0/2392940868 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ab04c562a0 msgr2=0x55ab04c8bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:09.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.385+0000 7f0b17400640 1 --2- 172.21.15.99:0/2392940868 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ab04c562a0 0x55ab04c8bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:09.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.385+0000 7f0b17400640 1 -- 172.21.15.99:0/2392940868 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ab049617d0 con 0x55ab04c8c260 2024-02-21T23:06:09.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.385+0000 7f0b17e00640 1 --2- 172.21.15.99:0/2392940868 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ab04c562a0 0x55ab04c8bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T23:06:09.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.385+0000 7f0b17400640 1 --2- 172.21.15.99:0/2392940868 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ab04c8c260 0x55ab04c56680 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f0b04009730 tx=0x7f0b04010000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b4af96a214eaa78 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:09.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.385+0000 7f0b0cc00640 1 -- 172.21.15.99:0/2392940868 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b04024070 con 0x55ab04c8c260 2024-02-21T23:06:09.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.385+0000 7f0b0cc00640 1 -- 172.21.15.99:0/2392940868 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b0400de50 con 0x55ab04c8c260 2024-02-21T23:06:09.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.385+0000 7f0b0cc00640 1 -- 172.21.15.99:0/2392940868 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b04014de0 con 0x55ab04c8c260 2024-02-21T23:06:09.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.386+0000 7f0b21d83740 1 -- 172.21.15.99:0/2392940868 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ab04c8c260 msgr2=0x55ab04c56680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:09.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.386+0000 7f0b21d83740 1 --2- 172.21.15.99:0/2392940868 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ab04c8c260 0x55ab04c56680 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f0b04009730 tx=0x7f0b04010000 comp rx=0 tx=0).stop 2024-02-21T23:06:09.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.386+0000 7f0b21d83740 1 -- 172.21.15.99:0/2392940868 shutdown_connections 2024-02-21T23:06:09.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.386+0000 7f0b21d83740 1 --2- 172.21.15.99:0/2392940868 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab04c56bc0 0x55ab04c191d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:09.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.386+0000 7f0b21d83740 1 --2- 172.21.15.99:0/2392940868 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ab04c8c260 0x55ab04c56680 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:09.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.386+0000 7f0b21d83740 1 --2- 172.21.15.99:0/2392940868 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ab04c562a0 0x55ab04c8bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:09.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.386+0000 7f0b21d83740 1 -- 172.21.15.99:0/2392940868 >> 172.21.15.99:0/2392940868 conn(0x55ab04be56b0 msgr2=0x55ab04c1d190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:06:09.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.386+0000 7f0b21d83740 1 -- 172.21.15.99:0/2392940868 shutdown_connections 2024-02-21T23:06:09.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.387+0000 7f0b21d83740 1 -- 172.21.15.99:0/2392940868 wait complete. 2024-02-21T23:06:09.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.388+0000 7f0b21d83740 1 -- start start 2024-02-21T23:06:09.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.388+0000 7f0b21d83740 1 Processor -- start 2024-02-21T23:06:09.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.390+0000 7f0b21d83740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab04c562a0 0x55ab04c4c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:09.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.390+0000 7f0b21d83740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ab04c56bc0 0x55ab04c9c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:09.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.390+0000 7f0b21d83740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ab04c8c260 0x55ab04c61590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:09.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.391+0000 7f0b17e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab04c562a0 0x55ab04c4c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:09.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.391+0000 7f0b21d83740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab04c24f30 con 0x55ab04c8c260 2024-02-21T23:06:09.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.391+0000 7f0b21d83740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab04b211c0 con 0x55ab04c562a0 2024-02-21T23:06:09.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.391+0000 7f0b21d83740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab04c8d930 con 0x55ab04c56bc0 2024-02-21T23:06:09.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.391+0000 7f0b21d83740 10 client.0 _ll_register_callbacks cb 0x55ab04b3e930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:06:09.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.391+0000 7f0b17400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ab04c56bc0 0x55ab04c9c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:09.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.391+0000 7f0b17400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ab04c56bc0 0x55ab04c9c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:40710/0 (socket says 172.21.15.99:40710) 2024-02-21T23:06:09.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.391+0000 7f0b17400640 1 -- 172.21.15.99:0/482588210 learned_addr learned my addr 172.21.15.99:0/482588210 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:06:09.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.391+0000 7f0b1ce00640 1 --2- 172.21.15.99:0/482588210 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ab04c8c260 0x55ab04c61590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:09.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.391+0000 7f0b17400640 1 -- 172.21.15.99:0/482588210 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab04c562a0 msgr2=0x55ab04c4c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:09.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.392+0000 7f0b17400640 1 --2- 172.21.15.99:0/482588210 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab04c562a0 0x55ab04c4c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:09.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.392+0000 7f0b17400640 1 -- 172.21.15.99:0/482588210 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ab04c8c260 msgr2=0x55ab04c61590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:09.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.392+0000 7f0b17400640 1 --2- 172.21.15.99:0/482588210 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ab04c8c260 0x55ab04c61590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:09.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.392+0000 7f0b17400640 1 -- 172.21.15.99:0/482588210 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ab048973f0 con 0x55ab04c56bc0 2024-02-21T23:06:09.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.392+0000 7f0b1ce00640 1 --2- 172.21.15.99:0/482588210 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ab04c8c260 0x55ab04c61590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T23:06:09.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.393+0000 7f0b17400640 1 --2- 172.21.15.99:0/482588210 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ab04c56bc0 0x55ab04c9c8e0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f0b04022040 tx=0x7f0b040046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3fd431d80913b06 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:09.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.393+0000 7f0b01600640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-02-21T23:06:09.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.393+0000 7f0b01600640 1 -- 172.21.15.99:0/482588210 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b04024040 con 0x55ab04c56bc0 2024-02-21T23:06:09.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.394+0000 7f0b01600640 1 -- 172.21.15.99:0/482588210 <== mon.2 v2:172.21.15.181:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f0b04028700 con 0x55ab04c56bc0 2024-02-21T23:06:09.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.394+0000 7f0b21d83740 1 -- 172.21.15.99:0/482588210 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0b0400de50 con 0x55ab04c56bc0 2024-02-21T23:06:09.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.394+0000 7f0b01600640 1 -- 172.21.15.99:0/482588210 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0b040059c0 con 0x55ab04c56bc0 2024-02-21T23:06:09.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.395+0000 7f0b21d83740 10 client.6053 fetch_fsmap learned FSMap version 16 2024-02-21T23:06:09.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.395+0000 7f0b21d83740 1 -- 172.21.15.99:0/482588210 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55ab048570f0 con 0x55ab04c56bc0 2024-02-21T23:06:09.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.395+0000 7f0b01600640 1 -- 172.21.15.99:0/482588210 <== mon.2 v2:172.21.15.181:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b0400de50 con 0x55ab04c56bc0 2024-02-21T23:06:09.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.395+0000 7f0b01600640 1 -- 172.21.15.99:0/482588210 <== mon.2 v2:172.21.15.181:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f0b04013070 con 0x55ab04c56bc0 2024-02-21T23:06:09.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.395+0000 7f0b21d83740 10 client.6053 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T23:06:09.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.395+0000 7f0b21d83740 10 client.6053 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:06:09.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.395+0000 7f0b21d83740 20 client.6053 populate_metadata read hostname 'smithi099' 2024-02-21T23:06:09.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.396+0000 7f0b21d83740 1 --2- 172.21.15.99:0/482588210 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55ab04c8c680 0x55ab04c8ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:09.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.396+0000 7f0b21d83740 4 client.6053 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:06:09.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.396+0000 7f0b21d83740 1 -- 172.21.15.99:0/482588210 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ab04b8ffd0 con 0x55ab04c8c680 2024-02-21T23:06:09.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.396+0000 7f0b17e00640 1 --2- 172.21.15.99:0/482588210 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55ab04c8c680 0x55ab04c8ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:09.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.397+0000 7f0b17e00640 1 --2- 172.21.15.99:0/482588210 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55ab04c8c680 0x55ab04c8ca60 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6aa1a9338c8a63b server_cookie=bbadebc63fef8895 in_seq=0 out_seq=0 2024-02-21T23:06:09.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.398+0000 7f0b01600640 10 client.6053 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:06:09.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.399+0000 7f0b01600640 1 -- 172.21.15.99:0/482588210 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55ab04b8ffd0 con 0x55ab04c8c680 2024-02-21T23:06:09.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.399+0000 7f0b01600640 10 client.6053 handle_command_reply: tid=0 2024-02-21T23:06:09.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.399+0000 7f0b21d83740 1 client.6053 shutdown 2024-02-21T23:06:09.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.401+0000 7f0b21d83740 1 -- 172.21.15.99:0/482588210 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ab04c56bc0 msgr2=0x55ab04c9c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:09.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.401+0000 7f0b21d83740 1 --2- 172.21.15.99:0/482588210 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ab04c56bc0 0x55ab04c9c8e0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f0b04022040 tx=0x7f0b040046c0 comp rx=0 tx=0).stop 2024-02-21T23:06:09.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.402+0000 7f0b21d83740 1 -- 172.21.15.99:0/482588210 shutdown_connections 2024-02-21T23:06:09.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.402+0000 7f0b21d83740 1 --2- 172.21.15.99:0/482588210 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55ab04c8c680 0x55ab04c8ca60 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:09.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.402+0000 7f0b21d83740 1 --2- 172.21.15.99:0/482588210 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ab04c8c260 0x55ab04c61590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:09.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.402+0000 7f0b21d83740 1 --2- 172.21.15.99:0/482588210 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ab04c56bc0 0x55ab04c9c8e0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:09.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.402+0000 7f0b21d83740 1 --2- 172.21.15.99:0/482588210 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab04c562a0 0x55ab04c4c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:09.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.402+0000 7f0b21d83740 1 -- 172.21.15.99:0/482588210 >> 172.21.15.99:0/482588210 conn(0x55ab04be56b0 msgr2=0x55ab04c8def0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:06:09.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.402+0000 7f0b01600640 0 client.6053 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:06:09.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.402+0000 7f0b21d83740 1 -- 172.21.15.99:0/482588210 shutdown_connections 2024-02-21T23:06:09.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.402+0000 7f0b21d83740 1 -- 172.21.15.99:0/482588210 wait complete. 2024-02-21T23:06:09.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.402+0000 7f0b21d83740 20 client.6053 trim_cache size 0 max 16384 2024-02-21T23:06:09.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.438+0000 7f0b21d83740 1 Processor -- start 2024-02-21T23:06:09.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.438+0000 7f0b21d83740 1 -- start start 2024-02-21T23:06:09.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.440+0000 7f0b21d83740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ab04c562a0 0x55ab04c9d000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:09.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.440+0000 7f0b21d83740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ab04c56bc0 0x55ab04c1b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:09.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.440+0000 7f0b21d83740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab04c8c260 0x55ab04c9af50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:09.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.440+0000 7f0b21d83740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b18228370 con 0x55ab04c56bc0 2024-02-21T23:06:09.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.440+0000 7f0b21d83740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b1806fda0 con 0x55ab04c8c260 2024-02-21T23:06:09.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.441+0000 7f0b21d83740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b181748b0 con 0x55ab04c562a0 2024-02-21T23:06:09.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.441+0000 7f0b17e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ab04c562a0 0x55ab04c9d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:09.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.441+0000 7f0b1ce00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab04c8c260 0x55ab04c9af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:09.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.441+0000 7f0b1ce00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab04c8c260 0x55ab04c9af50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:46616/0 (socket says 172.21.15.99:46616) 2024-02-21T23:06:09.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.441+0000 7f0b1ce00640 1 -- 172.21.15.99:0/2371093519 learned_addr learned my addr 172.21.15.99:0/2371093519 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:06:09.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.441+0000 7f0b17400640 1 --2- 172.21.15.99:0/2371093519 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ab04c56bc0 0x55ab04c1b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:09.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.441+0000 7f0b1ce00640 1 -- 172.21.15.99:0/2371093519 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ab04c562a0 msgr2=0x55ab04c9d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:09.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.441+0000 7f0b1ce00640 1 --2- 172.21.15.99:0/2371093519 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ab04c562a0 0x55ab04c9d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:09.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.441+0000 7f0b1ce00640 1 -- 172.21.15.99:0/2371093519 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ab04c56bc0 msgr2=0x55ab04c1b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:09.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.441+0000 7f0b1ce00640 1 --2- 172.21.15.99:0/2371093519 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ab04c56bc0 0x55ab04c1b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:09.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.441+0000 7f0b1ce00640 1 -- 172.21.15.99:0/2371093519 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ab04c8cdd0 con 0x55ab04c8c260 2024-02-21T23:06:09.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.442+0000 7f0b17e00640 1 --2- 172.21.15.99:0/2371093519 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ab04c562a0 0x55ab04c9d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:06:09.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.442+0000 7f0b1ce00640 1 --2- 172.21.15.99:0/2371093519 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab04c8c260 0x55ab04c9af50 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f0b10096a90 tx=0x7f0b10097550 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30c7b3b74ab18ee1 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:09.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.442+0000 7f0b03e00640 1 -- 172.21.15.99:0/2371093519 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1009f530 con 0x55ab04c8c260 2024-02-21T23:06:09.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.442+0000 7f0b03e00640 1 -- 172.21.15.99:0/2371093519 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b100c92a0 con 0x55ab04c8c260 2024-02-21T23:06:09.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.442+0000 7f0b03e00640 1 -- 172.21.15.99:0/2371093519 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b10093400 con 0x55ab04c8c260 2024-02-21T23:06:09.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.443+0000 7f0b21d83740 1 -- 172.21.15.99:0/2371093519 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab04c8c260 msgr2=0x55ab04c9af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:09.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.443+0000 7f0b21d83740 1 --2- 172.21.15.99:0/2371093519 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab04c8c260 0x55ab04c9af50 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f0b10096a90 tx=0x7f0b10097550 comp rx=0 tx=0).stop 2024-02-21T23:06:09.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.443+0000 7f0b21d83740 1 -- 172.21.15.99:0/2371093519 shutdown_connections 2024-02-21T23:06:09.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.443+0000 7f0b21d83740 1 --2- 172.21.15.99:0/2371093519 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab04c8c260 0x55ab04c9af50 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:09.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.443+0000 7f0b21d83740 1 --2- 172.21.15.99:0/2371093519 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ab04c56bc0 0x55ab04c1b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:09.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.443+0000 7f0b21d83740 1 --2- 172.21.15.99:0/2371093519 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ab04c562a0 0x55ab04c9d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:09.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.443+0000 7f0b21d83740 1 -- 172.21.15.99:0/2371093519 >> 172.21.15.99:0/2371093519 conn(0x55ab04be56b0 msgr2=0x55ab04c177e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:06:09.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.443+0000 7f0b21d83740 1 -- 172.21.15.99:0/2371093519 shutdown_connections 2024-02-21T23:06:09.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.443+0000 7f0b21d83740 1 -- 172.21.15.99:0/2371093519 wait complete. 2024-02-21T23:06:09.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.444+0000 7f0b21d83740 1 -- start start 2024-02-21T23:06:09.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.445+0000 7f0b21d83740 1 Processor -- start 2024-02-21T23:06:09.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.447+0000 7f0b21d83740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ab04c562a0 0x55ab04c90dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:09.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.447+0000 7f0b21d83740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab04c56bc0 0x55ab04c9c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:09.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.447+0000 7f0b21d83740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ab04c8c260 0x55ab04cfa3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:09.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.447+0000 7f0b21d83740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b1806e500 con 0x55ab04c562a0 2024-02-21T23:06:09.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.447+0000 7f0b21d83740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b1806f740 con 0x55ab04c56bc0 2024-02-21T23:06:09.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.447+0000 7f0b21d83740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b1806eb00 con 0x55ab04c8c260 2024-02-21T23:06:09.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.447+0000 7f0b21d83740 10 client.0 _ll_register_callbacks cb 0x7f0b0400d800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:06:09.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.447+0000 7f0b17400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab04c56bc0 0x55ab04c9c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:09.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.447+0000 7f0b1ce00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ab04c8c260 0x55ab04cfa3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:09.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.447+0000 7f0b17400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab04c56bc0 0x55ab04c9c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:46620/0 (socket says 172.21.15.99:46620) 2024-02-21T23:06:09.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.447+0000 7f0b1ce00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ab04c8c260 0x55ab04cfa3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:40728/0 (socket says 172.21.15.99:40728) 2024-02-21T23:06:09.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.447+0000 7f0b17400640 1 -- 172.21.15.99:0/3913782340 learned_addr learned my addr 172.21.15.99:0/3913782340 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:06:09.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.447+0000 7f0b17e00640 1 --2- 172.21.15.99:0/3913782340 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ab04c562a0 0x55ab04c90dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:09.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.448+0000 7f0b1ce00640 1 -- 172.21.15.99:0/3913782340 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab04c56bc0 msgr2=0x55ab04c9c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:09.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.448+0000 7f0b1ce00640 1 --2- 172.21.15.99:0/3913782340 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab04c56bc0 0x55ab04c9c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:09.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.448+0000 7f0b1ce00640 1 -- 172.21.15.99:0/3913782340 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ab04c562a0 msgr2=0x55ab04c90dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:09.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.448+0000 7f0b1ce00640 1 --2- 172.21.15.99:0/3913782340 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ab04c562a0 0x55ab04c90dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:09.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.448+0000 7f0b1ce00640 1 -- 172.21.15.99:0/3913782340 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ab04c8b740 con 0x55ab04c8c260 2024-02-21T23:06:09.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.449+0000 7f0b1ce00640 1 --2- 172.21.15.99:0/3913782340 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ab04c8c260 0x55ab04cfa3f0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f0b10001560 tx=0x7f0b10004f70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9dc365169777c3 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:09.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.449+0000 7f0b01600640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-02-21T23:06:09.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.449+0000 7f0b01600640 1 -- 172.21.15.99:0/3913782340 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1009f530 con 0x55ab04c8c260 2024-02-21T23:06:09.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.449+0000 7f0b01600640 1 -- 172.21.15.99:0/3913782340 <== mon.2 v2:172.21.15.181:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f0b10093400 con 0x55ab04c8c260 2024-02-21T23:06:09.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.450+0000 7f0b21d83740 1 -- 172.21.15.99:0/3913782340 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0b100c92a0 con 0x55ab04c8c260 2024-02-21T23:06:09.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.450+0000 7f0b01600640 1 -- 172.21.15.99:0/3913782340 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0b100aebb0 con 0x55ab04c8c260 2024-02-21T23:06:09.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.450+0000 7f0b21d83740 10 client.6059 fetch_fsmap learned FSMap version 16 2024-02-21T23:06:09.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.450+0000 7f0b21d83740 1 -- 172.21.15.99:0/3913782340 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55ab04c42bf0 con 0x55ab04c8c260 2024-02-21T23:06:09.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.450+0000 7f0b01600640 1 -- 172.21.15.99:0/3913782340 <== mon.2 v2:172.21.15.181:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b100c92a0 con 0x55ab04c8c260 2024-02-21T23:06:09.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.450+0000 7f0b01600640 1 -- 172.21.15.99:0/3913782340 <== mon.2 v2:172.21.15.181:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f0b1000abb0 con 0x55ab04c8c260 2024-02-21T23:06:09.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.451+0000 7f0b21d83740 10 client.6059 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T23:06:09.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.451+0000 7f0b21d83740 10 client.6059 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:06:09.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.451+0000 7f0b21d83740 20 client.6059 populate_metadata read hostname 'smithi099' 2024-02-21T23:06:09.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.451+0000 7f0b21d83740 1 --2- 172.21.15.99:0/3913782340 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55ab04c4ffb0 0x55ab04c1b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:09.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.451+0000 7f0b21d83740 4 client.6059 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T23:06:09.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.451+0000 7f0b21d83740 1 -- 172.21.15.99:0/3913782340 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55ab04b8a320 con 0x55ab04c4ffb0 2024-02-21T23:06:09.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.452+0000 7f0b17e00640 1 --2- 172.21.15.99:0/3913782340 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55ab04c4ffb0 0x55ab04c1b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:09.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.453+0000 7f0b17e00640 1 --2- 172.21.15.99:0/3913782340 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55ab04c4ffb0 0x55ab04c1b9a0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46db2cf1235b9ff1 server_cookie=fc6a2d8ecc052d63 in_seq=0 out_seq=0 2024-02-21T23:06:09.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.453+0000 7f0b01600640 10 client.6059 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:06:09.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.454+0000 7f0b01600640 1 -- 172.21.15.99:0/3913782340 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x55ab04b8a320 con 0x55ab04c4ffb0 2024-02-21T23:06:09.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.454+0000 7f0b01600640 10 client.6059 handle_command_reply: tid=0 2024-02-21T23:06:09.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.454+0000 7f0b21d83740 1 client.6059 shutdown 2024-02-21T23:06:09.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.455+0000 7f0b21d83740 1 -- 172.21.15.99:0/3913782340 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ab04c8c260 msgr2=0x55ab04cfa3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:09.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.455+0000 7f0b21d83740 1 --2- 172.21.15.99:0/3913782340 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ab04c8c260 0x55ab04cfa3f0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f0b10001560 tx=0x7f0b10004f70 comp rx=0 tx=0).stop 2024-02-21T23:06:09.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.455+0000 7f0b21d83740 1 -- 172.21.15.99:0/3913782340 shutdown_connections 2024-02-21T23:06:09.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.455+0000 7f0b21d83740 1 --2- 172.21.15.99:0/3913782340 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55ab04c4ffb0 0x55ab04c1b9a0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:09.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.455+0000 7f0b21d83740 1 --2- 172.21.15.99:0/3913782340 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ab04c8c260 0x55ab04cfa3f0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:09.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.455+0000 7f0b21d83740 1 --2- 172.21.15.99:0/3913782340 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ab04c56bc0 0x55ab04c9c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:09.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.455+0000 7f0b21d83740 1 --2- 172.21.15.99:0/3913782340 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ab04c562a0 0x55ab04c90dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:09.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.455+0000 7f0b21d83740 1 -- 172.21.15.99:0/3913782340 >> 172.21.15.99:0/3913782340 conn(0x55ab04be56b0 msgr2=0x55ab04c14040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:06:09.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.455+0000 7f0b01600640 0 client.6059 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:06:09.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.455+0000 7f0b21d83740 1 -- 172.21.15.99:0/3913782340 shutdown_connections 2024-02-21T23:06:09.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.455+0000 7f0b21d83740 1 -- 172.21.15.99:0/3913782340 wait complete. 2024-02-21T23:06:09.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.455+0000 7f0b21d83740 20 client.6059 trim_cache size 0 max 16384 2024-02-21T23:06:09.453 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-02-21T23:06:09.453 INFO:teuthology.orchestra.run.smithi099.stdout: "status": "scrub active (952 inodes in the stack)", 2024-02-21T23:06:09.453 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubs": { 2024-02-21T23:06:09.454 INFO:teuthology.orchestra.run.smithi099.stdout: "e1f4c941-d26b-416e-9073-41a7abdfdfeb": { 2024-02-21T23:06:09.454 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/", 2024-02-21T23:06:09.454 INFO:teuthology.orchestra.run.smithi099.stdout: "tag": "e1f4c941-d26b-416e-9073-41a7abdfdfeb", 2024-02-21T23:06:09.454 INFO:teuthology.orchestra.run.smithi099.stdout: "options": "recursive,force" 2024-02-21T23:06:09.454 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:06:09.454 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:06:09.455 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-02-21T23:06:09.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.456+0000 7f0b1d800640 1 -- 172.21.15.99:0/2957025313 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f0af809ef50 msgr2=0x7f0af80a1410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:09.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.456+0000 7f0b1d800640 1 --2- 172.21.15.99:0/2957025313 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f0af809ef50 0x7f0af80a1410 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0b180fcfc0 tx=0x7f0b04008040 comp rx=0 tx=0).stop 2024-02-21T23:06:09.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.456+0000 7f0b1d800640 1 -- 172.21.15.99:0/2957025313 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0b1818b4f0 msgr2=0x7f0b1817c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:09.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.456+0000 7f0b1d800640 1 --2- 172.21.15.99:0/2957025313 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0b1818b4f0 0x7f0b1817c660 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f0b10007fd0 tx=0x7f0b1000cc70 comp rx=0 tx=0).stop 2024-02-21T23:06:09.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.456+0000 7f0b1d800640 1 -- 172.21.15.99:0/2957025313 shutdown_connections 2024-02-21T23:06:09.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.456+0000 7f0b1d800640 1 --2- 172.21.15.99:0/2957025313 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f0af809ef50 0x7f0af80a1410 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:09.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.456+0000 7f0b1d800640 1 --2- 172.21.15.99:0/2957025313 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0b1818b4f0 0x7f0b1817c660 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:09.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.456+0000 7f0b1d800640 1 --2- 172.21.15.99:0/2957025313 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0b1818b060 0x7f0b1817c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:09.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.456+0000 7f0b1d800640 1 --2- 172.21.15.99:0/2957025313 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0b1817f490 0x7f0b1815ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:09.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.456+0000 7f0b1d800640 1 -- 172.21.15.99:0/2957025313 >> 172.21.15.99:0/2957025313 conn(0x7f0b180d29b0 msgr2=0x7f0b180912a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:06:09.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.457+0000 7f0b1d800640 1 -- 172.21.15.99:0/2957025313 shutdown_connections 2024-02-21T23:06:09.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:09.457+0000 7f0b1d800640 1 -- 172.21.15.99:0/2957025313 wait complete. 2024-02-21T23:06:09.470 INFO:tasks.cephfs.filesystem:scrub status for tag:e1f4c941-d26b-416e-9073-41a7abdfdfeb - {'path': '/', 'tag': 'e1f4c941-d26b-416e-9073-41a7abdfdfeb', 'options': 'recursive,force'} 2024-02-21T23:06:12.425 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:06:12.433 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:06:12.436 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:06:39.472 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T23:06:39.473 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T23:06:39.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.717+0000 7f5af9a00640 1 Processor -- start 2024-02-21T23:06:39.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.717+0000 7f5af9a00640 1 -- start start 2024-02-21T23:06:39.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.721+0000 7f5af9a00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f5af4180ab0 0x7f5af4188ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:39.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.721+0000 7f5af9a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5af4189660 0x7f5af418a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:39.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.721+0000 7f5af9a00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5af4187800 con 0x7f5af41891e0 2024-02-21T23:06:39.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.721+0000 7f5af9a00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5af4188810 con 0x7f5af4189660 2024-02-21T23:06:39.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.721+0000 7f5af9a00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5af40f6610 con 0x7f5af4180ab0 2024-02-21T23:06:39.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.721+0000 7f5af3e00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f5af4180ab0 0x7f5af4188ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:39.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.721+0000 7f5aebe00640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f5af41891e0 0x7f5af4189e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:54980/0 (socket says 172.21.15.99:54980) 2024-02-21T23:06:39.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.721+0000 7f5aebe00640 1 -- 172.21.15.99:0/1401251580 learned_addr learned my addr 172.21.15.99:0/1401251580 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:06:39.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.721+0000 7f5af9000640 1 --2- 172.21.15.99:0/1401251580 >> v2:172.21.15.162:3300/0 conn(0x7f5af4189660 0x7f5af418a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:39.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.722+0000 7f5af3400640 1 -- 172.21.15.99:0/1401251580 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3700953583 0 0) 0x7f5af4187800 con 0x7f5af41891e0 2024-02-21T23:06:39.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.722+0000 7f5af3e00640 1 -- 172.21.15.99:0/1401251580 >> v2:172.21.15.162:3300/0 conn(0x7f5af4189660 msgr2=0x7f5af418a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:39.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.722+0000 7f5af3e00640 1 --2- 172.21.15.99:0/1401251580 >> v2:172.21.15.162:3300/0 conn(0x7f5af4189660 0x7f5af418a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:39.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.722+0000 7f5af3e00640 1 -- 172.21.15.99:0/1401251580 >> v1:172.21.15.181:6789/0 conn(0x7f5af41891e0 legacy=0x7f5af4189e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:39.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.722+0000 7f5af3e00640 1 -- 172.21.15.99:0/1401251580 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5af4187ee0 con 0x7f5af4180ab0 2024-02-21T23:06:39.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.723+0000 7f5af3e00640 1 --2- 172.21.15.99:0/1401251580 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5af4180ab0 0x7f5af4188ca0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f5af40faf30 tx=0x7f5ae402b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=562cc0824f73cc37 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:39.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.724+0000 7f5af3400640 1 -- 172.21.15.99:0/1401251580 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae40315a0 con 0x7f5af4180ab0 2024-02-21T23:06:39.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.724+0000 7f5af3400640 1 -- 172.21.15.99:0/1401251580 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ae4037070 con 0x7f5af4180ab0 2024-02-21T23:06:39.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.724+0000 7f5af3400640 1 -- 172.21.15.99:0/1401251580 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae4031960 con 0x7f5af4180ab0 2024-02-21T23:06:39.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.724+0000 7f5af9a00640 1 -- 172.21.15.99:0/1401251580 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5af4180ab0 msgr2=0x7f5af4188ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:39.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.724+0000 7f5af9a00640 1 --2- 172.21.15.99:0/1401251580 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5af4180ab0 0x7f5af4188ca0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f5af40faf30 tx=0x7f5ae402b840 comp rx=0 tx=0).stop 2024-02-21T23:06:39.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.725+0000 7f5af9a00640 1 -- 172.21.15.99:0/1401251580 shutdown_connections 2024-02-21T23:06:39.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.725+0000 7f5af9a00640 1 --2- 172.21.15.99:0/1401251580 >> v2:172.21.15.162:3300/0 conn(0x7f5af4189660 0x7f5af418a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:39.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.725+0000 7f5af9a00640 1 --2- 172.21.15.99:0/1401251580 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5af4180ab0 0x7f5af4188ca0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:39.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.725+0000 7f5af9a00640 1 -- 172.21.15.99:0/1401251580 >> 172.21.15.99:0/1401251580 conn(0x7f5af40ce4b0 msgr2=0x7f5af40ce8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:06:39.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.725+0000 7f5af9a00640 1 -- 172.21.15.99:0/1401251580 shutdown_connections 2024-02-21T23:06:39.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.725+0000 7f5af9a00640 1 -- 172.21.15.99:0/1401251580 wait complete. 2024-02-21T23:06:39.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.728+0000 7f5af9a00640 1 Processor -- start 2024-02-21T23:06:39.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.728+0000 7f5af9a00640 1 -- start start 2024-02-21T23:06:39.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.730+0000 7f5af9a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5af4180ab0 0x7f5af406b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:39.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.730+0000 7f5af9a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5af41891e0 0x7f5af4159af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:39.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.730+0000 7f5af9a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5af4189660 0x7f5af4168630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:39.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.730+0000 7f5af9a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af40cd2c0 con 0x7f5af41891e0 2024-02-21T23:06:39.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.730+0000 7f5af9a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af41884a0 con 0x7f5af4180ab0 2024-02-21T23:06:39.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.730+0000 7f5af9a00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af40cd440 con 0x7f5af4189660 2024-02-21T23:06:39.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.731+0000 7f5aebe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5af41891e0 0x7f5af4159af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:39.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.731+0000 7f5af3e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5af4180ab0 0x7f5af406b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:39.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.731+0000 7f5aebe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5af41891e0 0x7f5af4159af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45614/0 (socket says 172.21.15.99:45614) 2024-02-21T23:06:39.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.731+0000 7f5aebe00640 1 -- 172.21.15.99:0/2299930794 learned_addr learned my addr 172.21.15.99:0/2299930794 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:06:39.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.731+0000 7f5af9000640 1 --2- 172.21.15.99:0/2299930794 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5af4189660 0x7f5af4168630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:39.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.731+0000 7f5af3e00640 1 -- 172.21.15.99:0/2299930794 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5af4189660 msgr2=0x7f5af4168630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:39.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.731+0000 7f5af3e00640 1 --2- 172.21.15.99:0/2299930794 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5af4189660 0x7f5af4168630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:39.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.731+0000 7f5af3e00640 1 -- 172.21.15.99:0/2299930794 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5af41891e0 msgr2=0x7f5af4159af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:39.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.731+0000 7f5af3e00640 1 --2- 172.21.15.99:0/2299930794 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5af41891e0 0x7f5af4159af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:39.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.731+0000 7f5af3e00640 1 -- 172.21.15.99:0/2299930794 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5af421e2a0 con 0x7f5af4180ab0 2024-02-21T23:06:39.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.731+0000 7f5aebe00640 1 --2- 172.21.15.99:0/2299930794 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5af41891e0 0x7f5af4159af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:06:39.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.732+0000 7f5af3e00640 1 --2- 172.21.15.99:0/2299930794 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5af4180ab0 0x7f5af406b5d0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f5ae4033000 tx=0x7f5ae40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:39.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.732+0000 7f5af0c00640 1 -- 172.21.15.99:0/2299930794 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae4032630 con 0x7f5af4180ab0 2024-02-21T23:06:39.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.732+0000 7f5af0c00640 1 -- 172.21.15.99:0/2299930794 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ae40327d0 con 0x7f5af4180ab0 2024-02-21T23:06:39.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.732+0000 7f5af0c00640 1 -- 172.21.15.99:0/2299930794 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae4032ba0 con 0x7f5af4180ab0 2024-02-21T23:06:39.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.732+0000 7f5af9a00640 1 -- 172.21.15.99:0/2299930794 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5af421e580 con 0x7f5af4180ab0 2024-02-21T23:06:39.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.732+0000 7f5af9a00640 1 -- 172.21.15.99:0/2299930794 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5af4167b50 con 0x7f5af4180ab0 2024-02-21T23:06:39.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.736+0000 7f5af0c00640 1 -- 172.21.15.99:0/2299930794 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f5ae404e430 con 0x7f5af4180ab0 2024-02-21T23:06:39.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.737+0000 7f5af0c00640 1 --2- 172.21.15.99:0/2299930794 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f5ad009ee50 0x7f5ad00a1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:39.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.737+0000 7f5af0c00640 1 -- 172.21.15.99:0/2299930794 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f5ae402f030 con 0x7f5af4180ab0 2024-02-21T23:06:39.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.739+0000 7f5aebe00640 1 --2- 172.21.15.99:0/2299930794 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f5ad009ee50 0x7f5ad00a1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:39.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.739+0000 7f5afdf6a740 1 Processor -- start 2024-02-21T23:06:39.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.739+0000 7f5afdf6a740 1 -- start start 2024-02-21T23:06:39.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.739+0000 7f5aebe00640 1 --2- 172.21.15.99:0/2299930794 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f5ad009ee50 0x7f5ad00a1310 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5af4173ae0 tx=0x7f5adc007a60 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:39.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.741+0000 7f5afdf6a740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564342aaa2a0 0x564342adfd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:39.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.741+0000 7f5afdf6a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564342ae0260 0x564342aaa680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:39.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.741+0000 7f5afdf6a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564342aaabc0 0x564342a6d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:39.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.741+0000 7f5afdf6a740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643429d6a90 con 0x564342aaa2a0 2024-02-21T23:06:39.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.741+0000 7f5afdf6a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x56434297fb10 con 0x564342aaabc0 2024-02-21T23:06:39.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.741+0000 7f5afdf6a740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643429d2b30 con 0x564342ae0260 2024-02-21T23:06:39.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.741+0000 7f5af3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564342aaa2a0 0x564342adfd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:39.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.741+0000 7f5af3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564342aaa2a0 0x564342adfd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45624/0 (socket says 172.21.15.99:45624) 2024-02-21T23:06:39.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.741+0000 7f5af3e00640 1 -- 172.21.15.99:0/731156711 learned_addr learned my addr 172.21.15.99:0/731156711 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:06:39.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.741+0000 7f5aebe00640 1 --2- 172.21.15.99:0/731156711 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564342ae0260 0x564342aaa680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:39.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.741+0000 7f5af9000640 1 --2- 172.21.15.99:0/731156711 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564342aaabc0 0x564342a6d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:39.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.742+0000 7f5af3e00640 1 -- 172.21.15.99:0/731156711 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564342ae0260 msgr2=0x564342aaa680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:39.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.742+0000 7f5af3e00640 1 --2- 172.21.15.99:0/731156711 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564342ae0260 0x564342aaa680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:39.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.742+0000 7f5af3e00640 1 -- 172.21.15.99:0/731156711 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564342aaabc0 msgr2=0x564342a6d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:39.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.742+0000 7f5af3e00640 1 --2- 172.21.15.99:0/731156711 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564342aaabc0 0x564342a6d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:39.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.742+0000 7f5af3e00640 1 -- 172.21.15.99:0/731156711 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5643427b57d0 con 0x564342aaa2a0 2024-02-21T23:06:39.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.742+0000 7f5aebe00640 1 --2- 172.21.15.99:0/731156711 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564342ae0260 0x564342aaa680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:06:39.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.742+0000 7f5af3e00640 1 --2- 172.21.15.99:0/731156711 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564342aaa2a0 0x564342adfd20 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f5ae402bdd0 tx=0x7f5ae40b5ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85d052c748961753 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:39.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.742+0000 7f5ae8c00640 1 -- 172.21.15.99:0/731156711 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae40b9780 con 0x564342aaa2a0 2024-02-21T23:06:39.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.743+0000 7f5ae8c00640 1 -- 172.21.15.99:0/731156711 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ae4037020 con 0x564342aaa2a0 2024-02-21T23:06:39.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.743+0000 7f5ae8c00640 1 -- 172.21.15.99:0/731156711 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae40bd8d0 con 0x564342aaa2a0 2024-02-21T23:06:39.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.743+0000 7f5afdf6a740 1 -- 172.21.15.99:0/731156711 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564342aaa2a0 msgr2=0x564342adfd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:39.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.743+0000 7f5afdf6a740 1 --2- 172.21.15.99:0/731156711 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564342aaa2a0 0x564342adfd20 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f5ae402bdd0 tx=0x7f5ae40b5ad0 comp rx=0 tx=0).stop 2024-02-21T23:06:39.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.744+0000 7f5afdf6a740 1 -- 172.21.15.99:0/731156711 shutdown_connections 2024-02-21T23:06:39.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.744+0000 7f5afdf6a740 1 --2- 172.21.15.99:0/731156711 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564342aaabc0 0x564342a6d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:39.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.744+0000 7f5afdf6a740 1 --2- 172.21.15.99:0/731156711 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564342ae0260 0x564342aaa680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:39.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.744+0000 7f5afdf6a740 1 --2- 172.21.15.99:0/731156711 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564342aaa2a0 0x564342adfd20 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:39.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.744+0000 7f5afdf6a740 1 -- 172.21.15.99:0/731156711 >> 172.21.15.99:0/731156711 conn(0x564342a396b0 msgr2=0x564342a71190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:06:39.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.744+0000 7f5afdf6a740 1 -- 172.21.15.99:0/731156711 shutdown_connections 2024-02-21T23:06:39.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.744+0000 7f5afdf6a740 1 -- 172.21.15.99:0/731156711 wait complete. 2024-02-21T23:06:39.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.745+0000 7f5afdf6a740 1 -- start start 2024-02-21T23:06:39.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.745+0000 7f5afdf6a740 1 Processor -- start 2024-02-21T23:06:39.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.748+0000 7f5afdf6a740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564342aaa2a0 0x564342aa7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:39.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.748+0000 7f5afdf6a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564342aaabc0 0x564342af21a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:39.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.748+0000 7f5afdf6a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564342ae0260 0x564342a9f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:39.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.748+0000 7f5afdf6a740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x56434297fb10 con 0x564342aaa2a0 2024-02-21T23:06:39.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.748+0000 7f5afdf6a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643429751c0 con 0x564342aaabc0 2024-02-21T23:06:39.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.748+0000 7f5afdf6a740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643429d6a90 con 0x564342ae0260 2024-02-21T23:06:39.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.748+0000 7f5afdf6a740 10 client.0 _ll_register_callbacks cb 0x564342992930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:06:39.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.748+0000 7f5af3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564342aaa2a0 0x564342aa7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:39.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.748+0000 7f5af3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564342aaa2a0 0x564342aa7ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45628/0 (socket says 172.21.15.99:45628) 2024-02-21T23:06:39.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.748+0000 7f5af3e00640 1 -- 172.21.15.99:0/1313704407 learned_addr learned my addr 172.21.15.99:0/1313704407 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:06:39.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.748+0000 7f5af9000640 1 --2- 172.21.15.99:0/1313704407 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564342ae0260 0x564342a9f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:39.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.748+0000 7f5aebe00640 1 --2- 172.21.15.99:0/1313704407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564342aaabc0 0x564342af21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:39.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.749+0000 7f5af3e00640 1 -- 172.21.15.99:0/1313704407 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564342ae0260 msgr2=0x564342a9f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:39.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.749+0000 7f5af3e00640 1 --2- 172.21.15.99:0/1313704407 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564342ae0260 0x564342a9f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:39.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.749+0000 7f5af3e00640 1 -- 172.21.15.99:0/1313704407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564342aaabc0 msgr2=0x564342af21a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:39.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.749+0000 7f5af3e00640 1 --2- 172.21.15.99:0/1313704407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564342aaabc0 0x564342af21a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:39.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.749+0000 7f5af3e00640 1 -- 172.21.15.99:0/1313704407 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5643426eb3f0 con 0x564342aaa2a0 2024-02-21T23:06:39.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.749+0000 7f5af9000640 1 --2- 172.21.15.99:0/1313704407 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564342ae0260 0x564342a9f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:06:39.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.749+0000 7f5af3e00640 1 --2- 172.21.15.99:0/1313704407 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564342aaa2a0 0x564342aa7ee0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f5ae402be50 tx=0x7f5ae4006c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=254cdbcb1cb1133d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:39.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.749+0000 7f5ae1600640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:06:39.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.749+0000 7f5ae1600640 1 -- 172.21.15.99:0/1313704407 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae40e7060 con 0x564342aaa2a0 2024-02-21T23:06:39.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.749+0000 7f5ae1600640 1 -- 172.21.15.99:0/1313704407 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f5ae40d1170 con 0x564342aaa2a0 2024-02-21T23:06:39.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.749+0000 7f5afdf6a740 1 -- 172.21.15.99:0/1313704407 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5ae4037020 con 0x564342aaa2a0 2024-02-21T23:06:39.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.749+0000 7f5ae1600640 1 -- 172.21.15.99:0/1313704407 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5ae409e050 con 0x564342aaa2a0 2024-02-21T23:06:39.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.749+0000 7f5afdf6a740 10 client.5928 fetch_fsmap learned FSMap version 16 2024-02-21T23:06:39.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.749+0000 7f5afdf6a740 1 -- 172.21.15.99:0/1313704407 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x5643426ab0f0 con 0x564342aaa2a0 2024-02-21T23:06:39.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.750+0000 7f5ae1600640 1 -- 172.21.15.99:0/1313704407 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ae4037020 con 0x564342aaa2a0 2024-02-21T23:06:39.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.750+0000 7f5ae1600640 1 -- 172.21.15.99:0/1313704407 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f5ae4031070 con 0x564342aaa2a0 2024-02-21T23:06:39.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.750+0000 7f5afdf6a740 10 client.5928 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T23:06:39.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.750+0000 7f5afdf6a740 10 client.5928 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:06:39.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.750+0000 7f5afdf6a740 20 client.5928 populate_metadata read hostname 'smithi099' 2024-02-21T23:06:39.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.750+0000 7f5afdf6a740 1 --2- 172.21.15.99:0/1313704407 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x564342af1a40 0x564342a71b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:39.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.750+0000 7f5afdf6a740 4 client.5928 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:06:39.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.750+0000 7f5afdf6a740 1 -- 172.21.15.99:0/1313704407 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5643429e3fd0 con 0x564342af1a40 2024-02-21T23:06:39.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.750+0000 7f5aebe00640 1 --2- 172.21.15.99:0/1313704407 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x564342af1a40 0x564342a71b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:39.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.751+0000 7f5aebe00640 1 --2- 172.21.15.99:0/1313704407 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x564342af1a40 0x564342a71b80 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2406b8bfdab8518 server_cookie=d081bfb2aa9d2776 in_seq=0 out_seq=0 2024-02-21T23:06:39.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.751+0000 7f5ae1600640 10 client.5928 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:06:39.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.752+0000 7f5ae1600640 1 -- 172.21.15.99:0/1313704407 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x5643429e3fd0 con 0x564342af1a40 2024-02-21T23:06:39.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.752+0000 7f5ae1600640 10 client.5928 handle_command_reply: tid=0 2024-02-21T23:06:39.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.752+0000 7f5afdf6a740 1 client.5928 shutdown 2024-02-21T23:06:39.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.752+0000 7f5afdf6a740 1 -- 172.21.15.99:0/1313704407 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564342aaa2a0 msgr2=0x564342aa7ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:39.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.752+0000 7f5afdf6a740 1 --2- 172.21.15.99:0/1313704407 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564342aaa2a0 0x564342aa7ee0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f5ae402be50 tx=0x7f5ae4006c30 comp rx=0 tx=0).stop 2024-02-21T23:06:39.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.752+0000 7f5afdf6a740 1 -- 172.21.15.99:0/1313704407 shutdown_connections 2024-02-21T23:06:39.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.752+0000 7f5afdf6a740 1 --2- 172.21.15.99:0/1313704407 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x564342af1a40 0x564342a71b80 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:39.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.752+0000 7f5afdf6a740 1 --2- 172.21.15.99:0/1313704407 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564342ae0260 0x564342a9f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:39.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.752+0000 7f5afdf6a740 1 --2- 172.21.15.99:0/1313704407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564342aaabc0 0x564342af21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:39.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.752+0000 7f5afdf6a740 1 --2- 172.21.15.99:0/1313704407 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564342aaa2a0 0x564342aa7ee0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:39.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.752+0000 7f5afdf6a740 1 -- 172.21.15.99:0/1313704407 >> 172.21.15.99:0/1313704407 conn(0x564342a396b0 msgr2=0x564342adfa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:06:39.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.753+0000 7f5ae1600640 0 client.5928 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:06:39.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.753+0000 7f5afdf6a740 1 -- 172.21.15.99:0/1313704407 shutdown_connections 2024-02-21T23:06:39.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.753+0000 7f5afdf6a740 1 -- 172.21.15.99:0/1313704407 wait complete. 2024-02-21T23:06:39.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.753+0000 7f5afdf6a740 20 client.5928 trim_cache size 0 max 16384 2024-02-21T23:06:39.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.770+0000 7f5afdf6a740 1 Processor -- start 2024-02-21T23:06:39.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.770+0000 7f5afdf6a740 1 -- start start 2024-02-21T23:06:39.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.772+0000 7f5afdf6a740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564342aaa2a0 0x564342a99360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:39.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.772+0000 7f5afdf6a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564342aaabc0 0x564342a78c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:39.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.772+0000 7f5afdf6a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564342ae0260 0x564342b444d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:39.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.772+0000 7f5afdf6a740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af422c6a0 con 0x564342aaa2a0 2024-02-21T23:06:39.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.772+0000 7f5afdf6a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af422a240 con 0x564342aaabc0 2024-02-21T23:06:39.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.772+0000 7f5afdf6a740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af421de90 con 0x564342ae0260 2024-02-21T23:06:39.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.772+0000 7f5af3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564342aaa2a0 0x564342a99360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:39.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.772+0000 7f5af3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564342aaa2a0 0x564342a99360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45636/0 (socket says 172.21.15.99:45636) 2024-02-21T23:06:39.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.772+0000 7f5af3e00640 1 -- 172.21.15.99:0/3121268922 learned_addr learned my addr 172.21.15.99:0/3121268922 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:06:39.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.772+0000 7f5aebe00640 1 --2- 172.21.15.99:0/3121268922 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564342aaabc0 0x564342a78c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:39.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.772+0000 7f5af9000640 1 --2- 172.21.15.99:0/3121268922 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564342ae0260 0x564342b444d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:39.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.772+0000 7f5af3e00640 1 -- 172.21.15.99:0/3121268922 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564342ae0260 msgr2=0x564342b444d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:39.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.772+0000 7f5af3e00640 1 --2- 172.21.15.99:0/3121268922 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564342ae0260 0x564342b444d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:39.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.772+0000 7f5af3e00640 1 -- 172.21.15.99:0/3121268922 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564342aaabc0 msgr2=0x564342a78c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:39.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.772+0000 7f5af3e00640 1 --2- 172.21.15.99:0/3121268922 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564342aaabc0 0x564342a78c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:39.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.772+0000 7f5af3e00640 1 -- 172.21.15.99:0/3121268922 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564342adaa00 con 0x564342aaa2a0 2024-02-21T23:06:39.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.772+0000 7f5aebe00640 1 --2- 172.21.15.99:0/3121268922 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564342aaabc0 0x564342a78c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:06:39.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.773+0000 7f5af3e00640 1 --2- 172.21.15.99:0/3121268922 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564342aaa2a0 0x564342a99360 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f5ae402bdd0 tx=0x7f5ae40ce000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4caa27873ba6d90 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:39.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.773+0000 7f5ae3e00640 1 -- 172.21.15.99:0/3121268922 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae40e7070 con 0x564342aaa2a0 2024-02-21T23:06:39.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.773+0000 7f5ae3e00640 1 -- 172.21.15.99:0/3121268922 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ae4037070 con 0x564342aaa2a0 2024-02-21T23:06:39.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.773+0000 7f5ae3e00640 1 -- 172.21.15.99:0/3121268922 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae40b5a20 con 0x564342aaa2a0 2024-02-21T23:06:39.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.774+0000 7f5afdf6a740 1 -- 172.21.15.99:0/3121268922 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564342aaa2a0 msgr2=0x564342a99360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:39.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.774+0000 7f5afdf6a740 1 --2- 172.21.15.99:0/3121268922 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564342aaa2a0 0x564342a99360 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f5ae402bdd0 tx=0x7f5ae40ce000 comp rx=0 tx=0).stop 2024-02-21T23:06:39.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.774+0000 7f5afdf6a740 1 -- 172.21.15.99:0/3121268922 shutdown_connections 2024-02-21T23:06:39.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.774+0000 7f5afdf6a740 1 --2- 172.21.15.99:0/3121268922 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564342ae0260 0x564342b444d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:39.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.774+0000 7f5afdf6a740 1 --2- 172.21.15.99:0/3121268922 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564342aaabc0 0x564342a78c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:39.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.774+0000 7f5afdf6a740 1 --2- 172.21.15.99:0/3121268922 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564342aaa2a0 0x564342a99360 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:39.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.774+0000 7f5afdf6a740 1 -- 172.21.15.99:0/3121268922 >> 172.21.15.99:0/3121268922 conn(0x564342a396b0 msgr2=0x564342a9f740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:06:39.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.774+0000 7f5afdf6a740 1 -- 172.21.15.99:0/3121268922 shutdown_connections 2024-02-21T23:06:39.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.774+0000 7f5afdf6a740 1 -- 172.21.15.99:0/3121268922 wait complete. 2024-02-21T23:06:39.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.775+0000 7f5afdf6a740 1 -- start start 2024-02-21T23:06:39.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.775+0000 7f5afdf6a740 1 Processor -- start 2024-02-21T23:06:39.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.776+0000 7f5afdf6a740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564342aaa2a0 0x564342b3dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:39.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.776+0000 7f5afdf6a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564342aaabc0 0x564342a6b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:39.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.776+0000 7f5afdf6a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564342ae0260 0x564342a6bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:39.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.776+0000 7f5afdf6a740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af4228900 con 0x564342aaa2a0 2024-02-21T23:06:39.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.776+0000 7f5afdf6a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af4229be0 con 0x564342ae0260 2024-02-21T23:06:39.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.776+0000 7f5afdf6a740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af4228f20 con 0x564342aaabc0 2024-02-21T23:06:39.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.776+0000 7f5afdf6a740 10 client.0 _ll_register_callbacks cb 0x7f5ae40b92e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:06:39.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.777+0000 7f5af3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564342aaa2a0 0x564342b3dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:39.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.777+0000 7f5af3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564342aaa2a0 0x564342b3dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45638/0 (socket says 172.21.15.99:45638) 2024-02-21T23:06:39.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.777+0000 7f5af3e00640 1 -- 172.21.15.99:0/806313288 learned_addr learned my addr 172.21.15.99:0/806313288 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:06:39.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.777+0000 7f5aebe00640 1 --2- 172.21.15.99:0/806313288 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564342aaabc0 0x564342a6b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:39.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.777+0000 7f5af9000640 1 --2- 172.21.15.99:0/806313288 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564342ae0260 0x564342a6bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:39.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.777+0000 7f5af3e00640 1 -- 172.21.15.99:0/806313288 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564342aaabc0 msgr2=0x564342a6b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:39.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.777+0000 7f5af3e00640 1 --2- 172.21.15.99:0/806313288 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564342aaabc0 0x564342a6b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:39.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.777+0000 7f5af3e00640 1 -- 172.21.15.99:0/806313288 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564342ae0260 msgr2=0x564342a6bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:39.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.777+0000 7f5af3e00640 1 --2- 172.21.15.99:0/806313288 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564342ae0260 0x564342a6bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:39.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.777+0000 7f5af3e00640 1 -- 172.21.15.99:0/806313288 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564342ae5850 con 0x564342aaa2a0 2024-02-21T23:06:39.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.777+0000 7f5aebe00640 1 --2- 172.21.15.99:0/806313288 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564342aaabc0 0x564342a6b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:06:39.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.778+0000 7f5af3e00640 1 --2- 172.21.15.99:0/806313288 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564342aaa2a0 0x564342b3dd30 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f5ae402be50 tx=0x7f5ae40d8040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95a7d1d022e27b2d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:39.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.778+0000 7f5ae1600640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:06:39.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.778+0000 7f5ae1600640 1 -- 172.21.15.99:0/806313288 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae40e7070 con 0x564342aaa2a0 2024-02-21T23:06:39.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.778+0000 7f5ae1600640 1 -- 172.21.15.99:0/806313288 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f5ae40d1170 con 0x564342aaa2a0 2024-02-21T23:06:39.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.778+0000 7f5afdf6a740 1 -- 172.21.15.99:0/806313288 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5ae4037070 con 0x564342aaa2a0 2024-02-21T23:06:39.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.778+0000 7f5ae1600640 1 -- 172.21.15.99:0/806313288 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5ae40b5a20 con 0x564342aaa2a0 2024-02-21T23:06:39.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.778+0000 7f5afdf6a740 10 client.5934 fetch_fsmap learned FSMap version 16 2024-02-21T23:06:39.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.778+0000 7f5afdf6a740 1 -- 172.21.15.99:0/806313288 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x564342ae5850 con 0x564342aaa2a0 2024-02-21T23:06:39.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.779+0000 7f5ae1600640 1 -- 172.21.15.99:0/806313288 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ae4037070 con 0x564342aaa2a0 2024-02-21T23:06:39.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.779+0000 7f5ae1600640 1 -- 172.21.15.99:0/806313288 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f5ae4031040 con 0x564342aaa2a0 2024-02-21T23:06:39.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.779+0000 7f5afdf6a740 10 client.5934 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T23:06:39.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.779+0000 7f5afdf6a740 10 client.5934 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:06:39.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.779+0000 7f5afdf6a740 20 client.5934 populate_metadata read hostname 'smithi099' 2024-02-21T23:06:39.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.779+0000 7f5afdf6a740 1 --2- 172.21.15.99:0/806313288 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x564342adfe20 0x564342a6c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:39.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.779+0000 7f5afdf6a740 4 client.5934 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T23:06:39.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.779+0000 7f5afdf6a740 1 -- 172.21.15.99:0/806313288 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5643429de320 con 0x564342adfe20 2024-02-21T23:06:39.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.779+0000 7f5aebe00640 1 --2- 172.21.15.99:0/806313288 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x564342adfe20 0x564342a6c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:39.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.780+0000 7f5ae1600640 10 client.5934 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:06:39.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.780+0000 7f5aebe00640 1 --2- 172.21.15.99:0/806313288 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x564342adfe20 0x564342a6c260 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4262014756fcfe36 server_cookie=2483cf65013b4af3 in_seq=0 out_seq=0 2024-02-21T23:06:39.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.780+0000 7f5ae1600640 1 -- 172.21.15.99:0/806313288 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5643429de320 con 0x564342adfe20 2024-02-21T23:06:39.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.780+0000 7f5ae1600640 10 client.5934 handle_command_reply: tid=0 2024-02-21T23:06:39.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.780+0000 7f5afdf6a740 1 client.5934 shutdown 2024-02-21T23:06:39.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.780+0000 7f5afdf6a740 1 -- 172.21.15.99:0/806313288 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564342aaa2a0 msgr2=0x564342b3dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:39.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.780+0000 7f5afdf6a740 1 --2- 172.21.15.99:0/806313288 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564342aaa2a0 0x564342b3dd30 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f5ae402be50 tx=0x7f5ae40d8040 comp rx=0 tx=0).stop 2024-02-21T23:06:39.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.780+0000 7f5afdf6a740 1 -- 172.21.15.99:0/806313288 shutdown_connections 2024-02-21T23:06:39.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.780+0000 7f5afdf6a740 1 --2- 172.21.15.99:0/806313288 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x564342adfe20 0x564342a6c260 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:39.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.780+0000 7f5afdf6a740 1 --2- 172.21.15.99:0/806313288 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564342ae0260 0x564342a6bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:39.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.780+0000 7f5afdf6a740 1 --2- 172.21.15.99:0/806313288 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564342aaabc0 0x564342a6b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:39.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.780+0000 7f5afdf6a740 1 --2- 172.21.15.99:0/806313288 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564342aaa2a0 0x564342b3dd30 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:39.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.780+0000 7f5afdf6a740 1 -- 172.21.15.99:0/806313288 >> 172.21.15.99:0/806313288 conn(0x564342a396b0 msgr2=0x564342aa7d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:06:39.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.780+0000 7f5ae1600640 0 client.5934 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:06:39.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.781+0000 7f5afdf6a740 1 -- 172.21.15.99:0/806313288 shutdown_connections 2024-02-21T23:06:39.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.781+0000 7f5afdf6a740 1 -- 172.21.15.99:0/806313288 wait complete. 2024-02-21T23:06:39.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.781+0000 7f5afdf6a740 20 client.5934 trim_cache size 0 max 16384 2024-02-21T23:06:39.777 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-02-21T23:06:39.777 INFO:teuthology.orchestra.run.smithi099.stdout: "status": "no active scrubs running", 2024-02-21T23:06:39.777 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubs": {} 2024-02-21T23:06:39.778 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-02-21T23:06:39.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.781+0000 7f5af9a00640 1 -- 172.21.15.99:0/2299930794 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f5ad009ee50 msgr2=0x7f5ad00a1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:39.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.781+0000 7f5af9a00640 1 --2- 172.21.15.99:0/2299930794 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f5ad009ee50 0x7f5ad00a1310 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5af4173ae0 tx=0x7f5adc007a60 comp rx=0 tx=0).stop 2024-02-21T23:06:39.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.781+0000 7f5af9a00640 1 -- 172.21.15.99:0/2299930794 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5af4180ab0 msgr2=0x7f5af406b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:39.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.781+0000 7f5af9a00640 1 --2- 172.21.15.99:0/2299930794 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5af4180ab0 0x7f5af406b5d0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f5ae4033000 tx=0x7f5ae40046c0 comp rx=0 tx=0).stop 2024-02-21T23:06:39.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.782+0000 7f5af9a00640 1 -- 172.21.15.99:0/2299930794 shutdown_connections 2024-02-21T23:06:39.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.782+0000 7f5af9a00640 1 --2- 172.21.15.99:0/2299930794 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f5ad009ee50 0x7f5ad00a1310 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:39.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.782+0000 7f5af9a00640 1 --2- 172.21.15.99:0/2299930794 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5af4189660 0x7f5af4168630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:39.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.782+0000 7f5af9a00640 1 --2- 172.21.15.99:0/2299930794 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5af41891e0 0x7f5af4159af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:39.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.782+0000 7f5af9a00640 1 --2- 172.21.15.99:0/2299930794 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5af4180ab0 0x7f5af406b5d0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:39.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.782+0000 7f5af9a00640 1 -- 172.21.15.99:0/2299930794 >> 172.21.15.99:0/2299930794 conn(0x7f5af40ce4b0 msgr2=0x7f5af40f5a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:06:39.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.782+0000 7f5af9a00640 1 -- 172.21.15.99:0/2299930794 shutdown_connections 2024-02-21T23:06:39.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:39.782+0000 7f5af9a00640 1 -- 172.21.15.99:0/2299930794 wait complete. 2024-02-21T23:06:39.788 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-02-21T23:06:39.789 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T23:06:40.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.023+0000 7f4f17e00640 1 Processor -- start 2024-02-21T23:06:40.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.023+0000 7f4f17e00640 1 -- start start 2024-02-21T23:06:40.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.026+0000 7f4f17e00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f4f180fde40 0x7f4f1818b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:40.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.026+0000 7f4f17e00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f1818a600 con 0x7f4f18182a80 2024-02-21T23:06:40.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.026+0000 7f4f17e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f1818a8e0 con 0x7f4f1818a010 2024-02-21T23:06:40.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.026+0000 7f4f17e00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f1818bec0 con 0x7f4f180fde40 2024-02-21T23:06:40.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.027+0000 7f4f16a00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f4f18182a80 0x7f4f18186a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:50534/0 (socket says 172.21.15.99:50534) 2024-02-21T23:06:40.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.027+0000 7f4f16a00640 1 -- 172.21.15.99:0/1985944941 learned_addr learned my addr 172.21.15.99:0/1985944941 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:06:40.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.027+0000 7f4f17400640 1 --2- 172.21.15.99:0/1985944941 >> v2:172.21.15.181:3300/0 conn(0x7f4f180fde40 0x7f4f1818b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:40.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.027+0000 7f4f15600640 1 -- 172.21.15.99:0/1985944941 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1420050568 0 0) 0x7f4f1818a600 con 0x7f4f18182a80 2024-02-21T23:06:40.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.027+0000 7f4f15600640 1 -- 172.21.15.99:0/1985944941 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4efc003520 con 0x7f4f18182a80 2024-02-21T23:06:40.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.027+0000 7f4f15600640 1 -- 172.21.15.99:0/1985944941 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2111870186 0 0) 0x7f4f1818a8e0 con 0x7f4f1818a010 2024-02-21T23:06:40.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.027+0000 7f4f15600640 1 -- 172.21.15.99:0/1985944941 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f1818a600 con 0x7f4f1818a010 2024-02-21T23:06:40.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.027+0000 7f4f17400640 1 -- 172.21.15.99:0/1985944941 >> v1:172.21.15.162:6789/0 conn(0x7f4f1818a010 legacy=0x7f4f180719b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:40.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.027+0000 7f4f17400640 1 -- 172.21.15.99:0/1985944941 >> v1:172.21.15.99:6789/0 conn(0x7f4f18182a80 legacy=0x7f4f18186a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:40.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.027+0000 7f4f17400640 1 -- 172.21.15.99:0/1985944941 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f1818abc0 con 0x7f4f180fde40 2024-02-21T23:06:40.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.029+0000 7f4f17400640 1 --2- 172.21.15.99:0/1985944941 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4f180fde40 0x7f4f1818b980 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f4f10009d90 tx=0x7f4f1002be20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bbc30c27959cc95a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:40.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.030+0000 7f4f15600640 1 -- 172.21.15.99:0/1985944941 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f10039070 con 0x7f4f180fde40 2024-02-21T23:06:40.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.030+0000 7f4f15600640 1 -- 172.21.15.99:0/1985944941 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f1002cbd0 con 0x7f4f180fde40 2024-02-21T23:06:40.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.030+0000 7f4f15600640 1 -- 172.21.15.99:0/1985944941 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f10034440 con 0x7f4f180fde40 2024-02-21T23:06:40.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.030+0000 7f4f17e00640 1 -- 172.21.15.99:0/1985944941 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4f180fde40 msgr2=0x7f4f1818b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:40.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.030+0000 7f4f17e00640 1 --2- 172.21.15.99:0/1985944941 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4f180fde40 0x7f4f1818b980 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f4f10009d90 tx=0x7f4f1002be20 comp rx=0 tx=0).stop 2024-02-21T23:06:40.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.030+0000 7f4f17e00640 1 -- 172.21.15.99:0/1985944941 shutdown_connections 2024-02-21T23:06:40.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.030+0000 7f4f17e00640 1 --2- 172.21.15.99:0/1985944941 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4f180fde40 0x7f4f1818b980 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:40.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.030+0000 7f4f17e00640 1 -- 172.21.15.99:0/1985944941 >> 172.21.15.99:0/1985944941 conn(0x7f4f180d29f0 msgr2=0x7f4f180d2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:06:40.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.030+0000 7f4f17e00640 1 -- 172.21.15.99:0/1985944941 shutdown_connections 2024-02-21T23:06:40.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.030+0000 7f4f17e00640 1 -- 172.21.15.99:0/1985944941 wait complete. 2024-02-21T23:06:40.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.034+0000 7f4f17e00640 1 Processor -- start 2024-02-21T23:06:40.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.034+0000 7f4f17e00640 1 -- start start 2024-02-21T23:06:40.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.035+0000 7f4f17e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f180fde40 0x7f4f1817c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:40.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.035+0000 7f4f17e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4f18182a80 0x7f4f180f6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:40.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.035+0000 7f4f17e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4f1818a010 0x7f4f1821ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:40.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.035+0000 7f4f17e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1818b460 con 0x7f4f18182a80 2024-02-21T23:06:40.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.035+0000 7f4f17e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1818b180 con 0x7f4f180fde40 2024-02-21T23:06:40.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.035+0000 7f4f17e00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f18182e60 con 0x7f4f1818a010 2024-02-21T23:06:40.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.035+0000 7f4f16000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4f18182a80 0x7f4f180f6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:40.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.035+0000 7f4f16000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4f18182a80 0x7f4f180f6bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45640/0 (socket says 172.21.15.99:45640) 2024-02-21T23:06:40.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.035+0000 7f4f16a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f180fde40 0x7f4f1817c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:40.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.035+0000 7f4f16000640 1 -- 172.21.15.99:0/3209823641 learned_addr learned my addr 172.21.15.99:0/3209823641 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:06:40.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.035+0000 7f4f17400640 1 --2- 172.21.15.99:0/3209823641 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4f1818a010 0x7f4f1821ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:40.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.036+0000 7f4f16000640 1 -- 172.21.15.99:0/3209823641 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4f1818a010 msgr2=0x7f4f1821ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:40.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.036+0000 7f4f16000640 1 --2- 172.21.15.99:0/3209823641 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4f1818a010 0x7f4f1821ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:40.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.036+0000 7f4f16000640 1 -- 172.21.15.99:0/3209823641 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f180fde40 msgr2=0x7f4f1817c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:40.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.036+0000 7f4f16000640 1 --2- 172.21.15.99:0/3209823641 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f180fde40 0x7f4f1817c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:40.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.036+0000 7f4f16000640 1 -- 172.21.15.99:0/3209823641 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f180f7610 con 0x7f4f18182a80 2024-02-21T23:06:40.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.036+0000 7f4f16a00640 1 --2- 172.21.15.99:0/3209823641 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f180fde40 0x7f4f1817c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:06:40.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.036+0000 7f4f16000640 1 --2- 172.21.15.99:0/3209823641 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4f18182a80 0x7f4f180f6bf0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f4f0400c3c0 tx=0x7f4f0400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:40.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.037+0000 7f4f0ea00640 1 -- 172.21.15.99:0/3209823641 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f04017070 con 0x7f4f18182a80 2024-02-21T23:06:40.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.037+0000 7f4f0ea00640 1 -- 172.21.15.99:0/3209823641 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f040052f0 con 0x7f4f18182a80 2024-02-21T23:06:40.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.037+0000 7f4f0ea00640 1 -- 172.21.15.99:0/3209823641 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f04003640 con 0x7f4f18182a80 2024-02-21T23:06:40.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.037+0000 7f4f17e00640 1 -- 172.21.15.99:0/3209823641 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f180f78f0 con 0x7f4f18182a80 2024-02-21T23:06:40.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.037+0000 7f4f17e00640 1 -- 172.21.15.99:0/3209823641 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f180f7eb0 con 0x7f4f18182a80 2024-02-21T23:06:40.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.038+0000 7f4f17e00640 1 -- 172.21.15.99:0/3209823641 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f18068320 con 0x7f4f18182a80 2024-02-21T23:06:40.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.040+0000 7f4f0ea00640 1 -- 172.21.15.99:0/3209823641 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f4f0401a070 con 0x7f4f18182a80 2024-02-21T23:06:40.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.042+0000 7f4f0ea00640 1 --2- 172.21.15.99:0/3209823641 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f4ef809eed0 0x7f4ef80a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:40.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.043+0000 7f4f0ea00640 1 -- 172.21.15.99:0/3209823641 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f4f040c94f0 con 0x7f4f18182a80 2024-02-21T23:06:40.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.043+0000 7f4f16a00640 1 --2- 172.21.15.99:0/3209823641 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f4ef809eed0 0x7f4ef80a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:40.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.044+0000 7f4f16a00640 1 --2- 172.21.15.99:0/3209823641 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f4ef809eed0 0x7f4ef80a1390 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4f08000f60 tx=0x7f4f08009040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:40.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.045+0000 7f4f0ea00640 1 -- 172.21.15.99:0/3209823641 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f4f04021020 con 0x7f4f18182a80 2024-02-21T23:06:40.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.291+0000 7f4f17e00640 1 -- 172.21.15.99:0/3209823641 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4f18180080 con 0x7f4f18182a80 2024-02-21T23:06:40.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.292+0000 7f4f0ea00640 1 -- 172.21.15.99:0/3209823641 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+11336 (secure 0 0 0) 0x7f4f04096e40 con 0x7f4f18182a80 2024-02-21T23:06:40.281 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T23:06:40.281 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4307,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/3514452812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3514452812},{"type":"v1","addr":"172.21.15.162:6836","nonce":3514452812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4312,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6838/2169982089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":2169982089},{"type":"v1","addr":"172.21.15.162:6838","nonce":2169982089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4315,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6839/3335972724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6837","nonce":3335972724},{"type":"v1","addr":"172.21.15.162:6839","nonce":3335972724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4318,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6841/2135456697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6840","nonce":2135456697},{"type":"v1","addr":"172.21.15.162:6841","nonce":2135456697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4325,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2452242758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2452242758},{"type":"v1","addr":"172.21.15.181:6833","nonce":2452242758}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4328,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6836/2751486400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":2751486400},{"type":"v1","addr":"172.21.15.181:6836","nonce":2751486400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":16,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-21T23:01:02.656130+0000","modified":"2024-02-21T23:03:58.159765+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4355,"mds_1":4352,"mds_2":4348},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4331":{"gid":4331,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6838/3728901330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6835","nonce":3728901330},{"type":"v1","addr":"172.21.15.181:6838","nonce":3728901330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4339":{"gid":4339,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6839/3357929641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6837","nonce":3357929641},{"type":"v1","addr":"172.21.15.181:6839","nonce":3357929641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4343":{"gid":4343,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6833/2793485078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":2793485078},{"type":"v1","addr":"172.21.15.99:6833","nonce":2793485078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4348":{"gid":4348,"name":"d","rank":2,"incarnation":12,"state":"up:active","state_seq":10,"addr":"172.21.15.99:6835/2243461688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2243461688},{"type":"v1","addr":"172.21.15.99:6835","nonce":2243461688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4352":{"gid":4352,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.99:6837/1676159950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":1676159950},{"type":"v1","addr":"172.21.15.99:6837","nonce":1676159950}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4355":{"gid":4355,"name":"j","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6839/4239008786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":4239008786},{"type":"v1","addr":"172.21.15.99:6839","nonce":4239008786}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-21T23:06:40.282 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 16 2024-02-21T23:06:40.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.295+0000 7f4f17e00640 1 -- 172.21.15.99:0/3209823641 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f4ef809eed0 msgr2=0x7f4ef80a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:40.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.295+0000 7f4f17e00640 1 --2- 172.21.15.99:0/3209823641 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f4ef809eed0 0x7f4ef80a1390 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4f08000f60 tx=0x7f4f08009040 comp rx=0 tx=0).stop 2024-02-21T23:06:40.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.295+0000 7f4f17e00640 1 -- 172.21.15.99:0/3209823641 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4f18182a80 msgr2=0x7f4f180f6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:40.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.295+0000 7f4f17e00640 1 --2- 172.21.15.99:0/3209823641 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4f18182a80 0x7f4f180f6bf0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f4f0400c3c0 tx=0x7f4f0400c880 comp rx=0 tx=0).stop 2024-02-21T23:06:40.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.295+0000 7f4f17e00640 1 -- 172.21.15.99:0/3209823641 shutdown_connections 2024-02-21T23:06:40.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.295+0000 7f4f17e00640 1 --2- 172.21.15.99:0/3209823641 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f4ef809eed0 0x7f4ef80a1390 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:40.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.295+0000 7f4f17e00640 1 --2- 172.21.15.99:0/3209823641 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4f1818a010 0x7f4f1821ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:40.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.295+0000 7f4f17e00640 1 --2- 172.21.15.99:0/3209823641 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4f18182a80 0x7f4f180f6bf0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:40.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.295+0000 7f4f17e00640 1 --2- 172.21.15.99:0/3209823641 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f180fde40 0x7f4f1817c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:40.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.295+0000 7f4f17e00640 1 -- 172.21.15.99:0/3209823641 >> 172.21.15.99:0/3209823641 conn(0x7f4f180d29f0 msgr2=0x7f4f180d2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:06:40.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.295+0000 7f4f17e00640 1 -- 172.21.15.99:0/3209823641 shutdown_connections 2024-02-21T23:06:40.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.295+0000 7f4f17e00640 1 -- 172.21.15.99:0/3209823641 wait complete. 2024-02-21T23:06:40.302 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T23:06:40.302 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-02-21T23:06:40.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.528+0000 7f7e57200640 1 Processor -- start 2024-02-21T23:06:40.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.528+0000 7f7e57200640 1 -- start start 2024-02-21T23:06:40.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.532+0000 7f7e57200640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f7e5017c560 0x7f7e500f8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:40.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.532+0000 7f7e57200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f7e500cc9c0 0x7f7e50187130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:40.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.532+0000 7f7e57200640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e500cd190 con 0x7f7e5017c180 2024-02-21T23:06:40.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.532+0000 7f7e57200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e500cd470 con 0x7f7e500cc9c0 2024-02-21T23:06:40.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.532+0000 7f7e57200640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e500cd750 con 0x7f7e5017c560 2024-02-21T23:06:40.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.532+0000 7f7e55e00640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f7e5017c180 0x7f7e500cc2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:54994/0 (socket says 172.21.15.99:54994) 2024-02-21T23:06:40.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.532+0000 7f7e55e00640 1 -- 172.21.15.99:0/2422104235 learned_addr learned my addr 172.21.15.99:0/2422104235 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:06:40.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.532+0000 7f7e55400640 1 --2- 172.21.15.99:0/2422104235 >> v2:172.21.15.181:3300/0 conn(0x7f7e5017c560 0x7f7e500f8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:40.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.533+0000 7f7e56800640 1 --2- 172.21.15.99:0/2422104235 >> v2:172.21.15.162:3300/0 conn(0x7f7e500cc9c0 0x7f7e50187130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:40.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.533+0000 7f7e54a00640 1 -- 172.21.15.99:0/2422104235 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1112220641 0 0) 0x7f7e500cd190 con 0x7f7e5017c180 2024-02-21T23:06:40.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.533+0000 7f7e55400640 1 -- 172.21.15.99:0/2422104235 >> v2:172.21.15.162:3300/0 conn(0x7f7e500cc9c0 msgr2=0x7f7e50187130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:40.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.533+0000 7f7e55400640 1 --2- 172.21.15.99:0/2422104235 >> v2:172.21.15.162:3300/0 conn(0x7f7e500cc9c0 0x7f7e50187130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:40.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.533+0000 7f7e55400640 1 -- 172.21.15.99:0/2422104235 >> v1:172.21.15.181:6789/0 conn(0x7f7e5017c180 legacy=0x7f7e500cc2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:40.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.533+0000 7f7e55400640 1 -- 172.21.15.99:0/2422104235 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e500cda30 con 0x7f7e5017c560 2024-02-21T23:06:40.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.534+0000 7f7e55400640 1 --2- 172.21.15.99:0/2422104235 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7e5017c560 0x7f7e500f8110 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f7e50073730 tx=0x7f7e4002b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bac31b86537e9524 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:40.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.534+0000 7f7e54a00640 1 -- 172.21.15.99:0/2422104235 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e400315a0 con 0x7f7e5017c560 2024-02-21T23:06:40.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.534+0000 7f7e54a00640 1 -- 172.21.15.99:0/2422104235 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e40037070 con 0x7f7e5017c560 2024-02-21T23:06:40.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.534+0000 7f7e54a00640 1 -- 172.21.15.99:0/2422104235 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e40031960 con 0x7f7e5017c560 2024-02-21T23:06:40.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.535+0000 7f7e57200640 1 -- 172.21.15.99:0/2422104235 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7e5017c560 msgr2=0x7f7e500f8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:40.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.535+0000 7f7e57200640 1 --2- 172.21.15.99:0/2422104235 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7e5017c560 0x7f7e500f8110 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f7e50073730 tx=0x7f7e4002b840 comp rx=0 tx=0).stop 2024-02-21T23:06:40.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.535+0000 7f7e57200640 1 -- 172.21.15.99:0/2422104235 shutdown_connections 2024-02-21T23:06:40.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.535+0000 7f7e57200640 1 --2- 172.21.15.99:0/2422104235 >> v2:172.21.15.162:3300/0 conn(0x7f7e500cc9c0 0x7f7e50187130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:40.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.535+0000 7f7e57200640 1 --2- 172.21.15.99:0/2422104235 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7e5017c560 0x7f7e500f8110 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:40.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.535+0000 7f7e57200640 1 -- 172.21.15.99:0/2422104235 >> 172.21.15.99:0/2422104235 conn(0x7f7e500ce4b0 msgr2=0x7f7e500ce8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:06:40.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.535+0000 7f7e57200640 1 -- 172.21.15.99:0/2422104235 shutdown_connections 2024-02-21T23:06:40.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.535+0000 7f7e57200640 1 -- 172.21.15.99:0/2422104235 wait complete. 2024-02-21T23:06:40.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.538+0000 7f7e57200640 1 Processor -- start 2024-02-21T23:06:40.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.539+0000 7f7e57200640 1 -- start start 2024-02-21T23:06:40.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.541+0000 7f7e57200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e500cc9c0 0x7f7e501864c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:40.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.541+0000 7f7e57200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e5017c180 0x7f7e5017ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:40.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.541+0000 7f7e57200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7e5017c560 0x7f7e50173950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:40.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.541+0000 7f7e57200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e50187670 con 0x7f7e5017c180 2024-02-21T23:06:40.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.541+0000 7f7e57200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e500cce50 con 0x7f7e500cc9c0 2024-02-21T23:06:40.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.541+0000 7f7e57200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e501877f0 con 0x7f7e5017c560 2024-02-21T23:06:40.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.541+0000 7f7e55400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e5017c180 0x7f7e5017ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:40.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.541+0000 7f7e55e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e500cc9c0 0x7f7e501864c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:40.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.541+0000 7f7e55400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e5017c180 0x7f7e5017ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45652/0 (socket says 172.21.15.99:45652) 2024-02-21T23:06:40.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.541+0000 7f7e55400640 1 -- 172.21.15.99:0/4165540692 learned_addr learned my addr 172.21.15.99:0/4165540692 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:06:40.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.541+0000 7f7e56800640 1 --2- 172.21.15.99:0/4165540692 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7e5017c560 0x7f7e50173950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:40.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.542+0000 7f7e55e00640 1 -- 172.21.15.99:0/4165540692 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7e5017c560 msgr2=0x7f7e50173950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:40.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.542+0000 7f7e55e00640 1 --2- 172.21.15.99:0/4165540692 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7e5017c560 0x7f7e50173950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:40.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.542+0000 7f7e55e00640 1 -- 172.21.15.99:0/4165540692 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e5017c180 msgr2=0x7f7e5017ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:40.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.542+0000 7f7e55e00640 1 --2- 172.21.15.99:0/4165540692 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e5017c180 0x7f7e5017ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:40.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.542+0000 7f7e55e00640 1 -- 172.21.15.99:0/4165540692 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e501805f0 con 0x7f7e500cc9c0 2024-02-21T23:06:40.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.542+0000 7f7e55400640 1 --2- 172.21.15.99:0/4165540692 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e5017c180 0x7f7e5017ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:06:40.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.542+0000 7f7e55e00640 1 --2- 172.21.15.99:0/4165540692 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e500cc9c0 0x7f7e501864c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f7e4400c3e0 tx=0x7f7e4400c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:40.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.542+0000 7f7e4a000640 1 -- 172.21.15.99:0/4165540692 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e440074e0 con 0x7f7e500cc9c0 2024-02-21T23:06:40.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.542+0000 7f7e4a000640 1 -- 172.21.15.99:0/4165540692 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e44007680 con 0x7f7e500cc9c0 2024-02-21T23:06:40.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.542+0000 7f7e4a000640 1 -- 172.21.15.99:0/4165540692 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e44004a20 con 0x7f7e500cc9c0 2024-02-21T23:06:40.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.542+0000 7f7e57200640 1 -- 172.21.15.99:0/4165540692 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e501808d0 con 0x7f7e500cc9c0 2024-02-21T23:06:40.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.542+0000 7f7e57200640 1 -- 172.21.15.99:0/4165540692 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e5017dba0 con 0x7f7e500cc9c0 2024-02-21T23:06:40.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.546+0000 7f7e4a000640 1 -- 172.21.15.99:0/4165540692 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f7e44011070 con 0x7f7e500cc9c0 2024-02-21T23:06:40.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.547+0000 7f7e4a000640 1 --2- 172.21.15.99:0/4165540692 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f7e3409eed0 0x7f7e340a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:40.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.547+0000 7f7e5b683740 1 Processor -- start 2024-02-21T23:06:40.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.547+0000 7f7e4a000640 1 -- 172.21.15.99:0/4165540692 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f7e440c9a30 con 0x7f7e500cc9c0 2024-02-21T23:06:40.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.548+0000 7f7e5b683740 1 -- start start 2024-02-21T23:06:40.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.548+0000 7f7e55400640 1 --2- 172.21.15.99:0/4165540692 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f7e3409eed0 0x7f7e340a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:40.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.548+0000 7f7e55400640 1 --2- 172.21.15.99:0/4165540692 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f7e3409eed0 0x7f7e340a1390 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7e500cec70 tx=0x7f7e4003d040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:40.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.549+0000 7f7e5b683740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56164d3ea660 0x56164d3eaa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:40.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.549+0000 7f7e5b683740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56164d425330 0x56164d4257b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:40.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.549+0000 7f7e5b683740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56164d425cf0 0x56164d426560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:40.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.549+0000 7f7e5b683740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x56164d312b50 con 0x56164d3ea660 2024-02-21T23:06:40.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.549+0000 7f7e5b683740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x56164d2bbda0 con 0x56164d425cf0 2024-02-21T23:06:40.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.549+0000 7f7e5b683740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x56164d30ebf0 con 0x56164d425330 2024-02-21T23:06:40.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.549+0000 7f7e55e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56164d3ea660 0x56164d3eaa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:40.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.549+0000 7f7e55400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56164d425330 0x56164d4257b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:40.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.549+0000 7f7e55e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56164d3ea660 0x56164d3eaa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45660/0 (socket says 172.21.15.99:45660) 2024-02-21T23:06:40.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.549+0000 7f7e55e00640 1 -- 172.21.15.99:0/2252826076 learned_addr learned my addr 172.21.15.99:0/2252826076 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:06:40.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.549+0000 7f7e56800640 1 --2- 172.21.15.99:0/2252826076 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56164d425cf0 0x56164d426560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:40.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.550+0000 7f7e55e00640 1 -- 172.21.15.99:0/2252826076 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56164d425330 msgr2=0x56164d4257b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:40.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.550+0000 7f7e55e00640 1 --2- 172.21.15.99:0/2252826076 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56164d425330 0x56164d4257b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:40.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.550+0000 7f7e55e00640 1 -- 172.21.15.99:0/2252826076 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56164d425cf0 msgr2=0x56164d426560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:40.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.550+0000 7f7e55e00640 1 --2- 172.21.15.99:0/2252826076 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56164d425cf0 0x56164d426560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:40.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.550+0000 7f7e55e00640 1 -- 172.21.15.99:0/2252826076 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56164d2def80 con 0x56164d3ea660 2024-02-21T23:06:40.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.550+0000 7f7e56800640 1 --2- 172.21.15.99:0/2252826076 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56164d425cf0 0x56164d426560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:06:40.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.550+0000 7f7e55e00640 1 --2- 172.21.15.99:0/2252826076 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56164d3ea660 0x56164d3eaa40 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f7e4400cfd0 tx=0x7f7e440972d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cfd8a023eeaa29e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:40.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.550+0000 7f7e3e600640 1 -- 172.21.15.99:0/2252826076 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e4409fa70 con 0x56164d3ea660 2024-02-21T23:06:40.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.550+0000 7f7e3e600640 1 -- 172.21.15.99:0/2252826076 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e440955d0 con 0x56164d3ea660 2024-02-21T23:06:40.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.550+0000 7f7e3e600640 1 -- 172.21.15.99:0/2252826076 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e440c7290 con 0x56164d3ea660 2024-02-21T23:06:40.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.551+0000 7f7e5b683740 1 -- 172.21.15.99:0/2252826076 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56164d3ea660 msgr2=0x56164d3eaa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:40.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.551+0000 7f7e5b683740 1 --2- 172.21.15.99:0/2252826076 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56164d3ea660 0x56164d3eaa40 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f7e4400cfd0 tx=0x7f7e440972d0 comp rx=0 tx=0).stop 2024-02-21T23:06:40.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.551+0000 7f7e5b683740 1 -- 172.21.15.99:0/2252826076 shutdown_connections 2024-02-21T23:06:40.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.551+0000 7f7e5b683740 1 --2- 172.21.15.99:0/2252826076 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56164d425cf0 0x56164d426560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:40.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.551+0000 7f7e5b683740 1 --2- 172.21.15.99:0/2252826076 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56164d425330 0x56164d4257b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:40.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.551+0000 7f7e5b683740 1 --2- 172.21.15.99:0/2252826076 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56164d3ea660 0x56164d3eaa40 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:40.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.551+0000 7f7e5b683740 1 -- 172.21.15.99:0/2252826076 >> 172.21.15.99:0/2252826076 conn(0x56164d3ac6d0 msgr2=0x56164d3ad750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:06:40.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.551+0000 7f7e5b683740 1 -- 172.21.15.99:0/2252826076 shutdown_connections 2024-02-21T23:06:40.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.551+0000 7f7e5b683740 1 -- 172.21.15.99:0/2252826076 wait complete. 2024-02-21T23:06:40.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.552+0000 7f7e5b683740 1 -- start start 2024-02-21T23:06:40.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.552+0000 7f7e5b683740 1 Processor -- start 2024-02-21T23:06:40.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.555+0000 7f7e5b683740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56164d425330 0x56164d422b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:40.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.555+0000 7f7e5b683740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56164d425cf0 0x56164d423330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:40.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.555+0000 7f7e5b683740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56164d3dd3a0 0x56164d431f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:40.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.555+0000 7f7e5b683740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x56164d4240a0 con 0x56164d425cf0 2024-02-21T23:06:40.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.555+0000 7f7e5b683740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x56164d2b1380 con 0x56164d425330 2024-02-21T23:06:40.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.555+0000 7f7e5b683740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x56164d423dc0 con 0x56164d3dd3a0 2024-02-21T23:06:40.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.555+0000 7f7e5b683740 10 client.0 _ll_register_callbacks cb 0x56164d30a280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:06:40.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.555+0000 7f7e56800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56164d3dd3a0 0x56164d431f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:40.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.555+0000 7f7e55400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56164d425cf0 0x56164d423330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:40.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.555+0000 7f7e55e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56164d425330 0x56164d422b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:40.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.555+0000 7f7e56800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56164d3dd3a0 0x56164d431f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:45446/0 (socket says 172.21.15.99:45446) 2024-02-21T23:06:40.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.555+0000 7f7e56800640 1 -- 172.21.15.99:0/3188545342 learned_addr learned my addr 172.21.15.99:0/3188545342 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:06:40.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.555+0000 7f7e55e00640 1 -- 172.21.15.99:0/3188545342 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56164d3dd3a0 msgr2=0x56164d431f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:40.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.555+0000 7f7e55e00640 1 --2- 172.21.15.99:0/3188545342 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56164d3dd3a0 0x56164d431f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:40.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.555+0000 7f7e55e00640 1 -- 172.21.15.99:0/3188545342 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56164d425cf0 msgr2=0x56164d423330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:40.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.555+0000 7f7e55e00640 1 --2- 172.21.15.99:0/3188545342 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56164d425cf0 0x56164d423330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:40.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.556+0000 7f7e55e00640 1 -- 172.21.15.99:0/3188545342 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56164d2d9c20 con 0x56164d425330 2024-02-21T23:06:40.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.556+0000 7f7e55e00640 1 --2- 172.21.15.99:0/3188545342 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56164d425330 0x56164d422b40 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f7e44000c00 tx=0x7f7e440c9040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df93f4dad7144e21 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:40.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.556+0000 7f7e32a00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-02-21T23:06:40.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.556+0000 7f7e32a00640 1 -- 172.21.15.99:0/3188545342 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e440c6060 con 0x56164d425330 2024-02-21T23:06:40.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.556+0000 7f7e32a00640 1 -- 172.21.15.99:0/3188545342 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f7e44004bc0 con 0x56164d425330 2024-02-21T23:06:40.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.556+0000 7f7e5b683740 1 -- 172.21.15.99:0/3188545342 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7e440955d0 con 0x56164d425330 2024-02-21T23:06:40.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.556+0000 7f7e32a00640 1 -- 172.21.15.99:0/3188545342 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7e4409fa70 con 0x56164d425330 2024-02-21T23:06:40.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.556+0000 7f7e5b683740 10 client.6091 fetch_fsmap learned FSMap version 16 2024-02-21T23:06:40.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.556+0000 7f7e5b683740 1 -- 172.21.15.99:0/3188545342 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x56164d0273f0 con 0x56164d425330 2024-02-21T23:06:40.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.557+0000 7f7e32a00640 1 -- 172.21.15.99:0/3188545342 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e440955d0 con 0x56164d425330 2024-02-21T23:06:40.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.557+0000 7f7e32a00640 1 -- 172.21.15.99:0/3188545342 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f7e440b4b30 con 0x56164d425330 2024-02-21T23:06:40.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.557+0000 7f7e5b683740 10 client.6091 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T23:06:40.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.557+0000 7f7e5b683740 10 client.6091 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.d 2024-02-21T23:06:40.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.557+0000 7f7e5b683740 20 client.6091 populate_metadata read hostname 'smithi099' 2024-02-21T23:06:40.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.557+0000 7f7e5b683740 1 --2- 172.21.15.99:0/3188545342 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x56164d3d92f0 0x56164d420e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:40.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.557+0000 7f7e5b683740 4 client.6091 mds_command: new command op to 4348 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:06:40.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.557+0000 7f7e5b683740 1 -- 172.21.15.99:0/3188545342 --> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56164d320090 con 0x56164d3d92f0 2024-02-21T23:06:40.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.557+0000 7f7e55400640 1 --2- 172.21.15.99:0/3188545342 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x56164d3d92f0 0x56164d420e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:40.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.558+0000 7f7e55400640 1 --2- 172.21.15.99:0/3188545342 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x56164d3d92f0 0x56164d420e80 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=aa547a3576f76fdf server_cookie=158ce64fd495dae2 in_seq=0 out_seq=0 2024-02-21T23:06:40.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.558+0000 7f7e32a00640 10 client.6091 ms_handle_connect on v2:172.21.15.99:6834/2243461688 2024-02-21T23:06:40.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.559+0000 7f7e32a00640 1 -- 172.21.15.99:0/3188545342 <== mds.2 v2:172.21.15.99:6834/2243461688 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x56164d320090 con 0x56164d3d92f0 2024-02-21T23:06:40.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.559+0000 7f7e32a00640 10 client.6091 handle_command_reply: tid=0 2024-02-21T23:06:40.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.559+0000 7f7e5b683740 1 client.6091 shutdown 2024-02-21T23:06:40.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.559+0000 7f7e5b683740 1 -- 172.21.15.99:0/3188545342 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56164d425330 msgr2=0x56164d422b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:40.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.559+0000 7f7e5b683740 1 --2- 172.21.15.99:0/3188545342 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56164d425330 0x56164d422b40 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f7e44000c00 tx=0x7f7e440c9040 comp rx=0 tx=0).stop 2024-02-21T23:06:40.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.559+0000 7f7e5b683740 1 -- 172.21.15.99:0/3188545342 shutdown_connections 2024-02-21T23:06:40.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.559+0000 7f7e5b683740 1 --2- 172.21.15.99:0/3188545342 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x56164d3d92f0 0x56164d420e80 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:40.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.559+0000 7f7e5b683740 1 --2- 172.21.15.99:0/3188545342 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56164d3dd3a0 0x56164d431f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:40.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.559+0000 7f7e5b683740 1 --2- 172.21.15.99:0/3188545342 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56164d425cf0 0x56164d423330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:40.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.559+0000 7f7e32a00640 0 client.6091 ms_handle_reset on v2:172.21.15.99:6834/2243461688 2024-02-21T23:06:40.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.559+0000 7f7e5b683740 1 --2- 172.21.15.99:0/3188545342 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56164d425330 0x56164d422b40 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:40.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.559+0000 7f7e5b683740 1 -- 172.21.15.99:0/3188545342 >> 172.21.15.99:0/3188545342 conn(0x56164d3ea660 msgr2=0x56164d3ee870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:06:40.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.559+0000 7f7e5b683740 1 -- 172.21.15.99:0/3188545342 shutdown_connections 2024-02-21T23:06:40.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.559+0000 7f7e5b683740 1 -- 172.21.15.99:0/3188545342 wait complete. 2024-02-21T23:06:40.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.560+0000 7f7e5b683740 20 client.6091 trim_cache size 0 max 16384 2024-02-21T23:06:40.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.578+0000 7f7e5b683740 1 Processor -- start 2024-02-21T23:06:40.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.578+0000 7f7e5b683740 1 -- start start 2024-02-21T23:06:40.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.580+0000 7f7e5b683740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56164d3dd3a0 0x56164d487ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:40.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.580+0000 7f7e5b683740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56164d425330 0x56164d488410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:40.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.580+0000 7f7e5b683740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56164d425cf0 0x56164d488950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:40.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.580+0000 7f7e5b683740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e50228230 con 0x56164d3dd3a0 2024-02-21T23:06:40.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.580+0000 7f7e5b683740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e50071b10 con 0x56164d425330 2024-02-21T23:06:40.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.580+0000 7f7e5b683740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e5017d650 con 0x56164d425cf0 2024-02-21T23:06:40.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.580+0000 7f7e55e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56164d3dd3a0 0x56164d487ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:40.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.580+0000 7f7e55e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56164d3dd3a0 0x56164d487ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45670/0 (socket says 172.21.15.99:45670) 2024-02-21T23:06:40.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.580+0000 7f7e55e00640 1 -- 172.21.15.99:0/2199403111 learned_addr learned my addr 172.21.15.99:0/2199403111 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:06:40.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.580+0000 7f7e55400640 1 --2- 172.21.15.99:0/2199403111 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56164d425330 0x56164d488410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:40.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.580+0000 7f7e56800640 1 --2- 172.21.15.99:0/2199403111 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56164d425cf0 0x56164d488950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:40.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.580+0000 7f7e55e00640 1 -- 172.21.15.99:0/2199403111 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56164d425cf0 msgr2=0x56164d488950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:40.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.580+0000 7f7e55e00640 1 --2- 172.21.15.99:0/2199403111 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56164d425cf0 0x56164d488950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:40.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.580+0000 7f7e55e00640 1 -- 172.21.15.99:0/2199403111 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56164d425330 msgr2=0x56164d488410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:40.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.580+0000 7f7e55e00640 1 --2- 172.21.15.99:0/2199403111 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56164d425330 0x56164d488410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:40.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.580+0000 7f7e55e00640 1 -- 172.21.15.99:0/2199403111 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56164d0f17d0 con 0x56164d3dd3a0 2024-02-21T23:06:40.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.581+0000 7f7e55e00640 1 --2- 172.21.15.99:0/2199403111 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56164d3dd3a0 0x56164d487ed0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f7e44096fd0 tx=0x7f7e440b3000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=985265a131d56cf9 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:40.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.581+0000 7f7e3dc00640 1 -- 172.21.15.99:0/2199403111 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e440c6040 con 0x56164d3dd3a0 2024-02-21T23:06:40.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.581+0000 7f7e3dc00640 1 -- 172.21.15.99:0/2199403111 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e440955d0 con 0x56164d3dd3a0 2024-02-21T23:06:40.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.581+0000 7f7e3dc00640 1 -- 172.21.15.99:0/2199403111 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e44004bc0 con 0x56164d3dd3a0 2024-02-21T23:06:40.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.582+0000 7f7e5b683740 1 -- 172.21.15.99:0/2199403111 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56164d3dd3a0 msgr2=0x56164d487ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:40.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.582+0000 7f7e5b683740 1 --2- 172.21.15.99:0/2199403111 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56164d3dd3a0 0x56164d487ed0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f7e44096fd0 tx=0x7f7e440b3000 comp rx=0 tx=0).stop 2024-02-21T23:06:40.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.582+0000 7f7e5b683740 1 -- 172.21.15.99:0/2199403111 shutdown_connections 2024-02-21T23:06:40.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.582+0000 7f7e5b683740 1 --2- 172.21.15.99:0/2199403111 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56164d425cf0 0x56164d488950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:40.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.582+0000 7f7e5b683740 1 --2- 172.21.15.99:0/2199403111 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56164d425330 0x56164d488410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:40.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.582+0000 7f7e5b683740 1 --2- 172.21.15.99:0/2199403111 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56164d3dd3a0 0x56164d487ed0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:40.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.582+0000 7f7e5b683740 1 -- 172.21.15.99:0/2199403111 >> 172.21.15.99:0/2199403111 conn(0x56164d3ea660 msgr2=0x56164d3f2920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:06:40.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.582+0000 7f7e5b683740 1 -- 172.21.15.99:0/2199403111 shutdown_connections 2024-02-21T23:06:40.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.582+0000 7f7e5b683740 1 -- 172.21.15.99:0/2199403111 wait complete. 2024-02-21T23:06:40.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.583+0000 7f7e5b683740 1 -- start start 2024-02-21T23:06:40.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.583+0000 7f7e5b683740 1 Processor -- start 2024-02-21T23:06:40.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.584+0000 7f7e5b683740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56164d3dd3a0 0x56164d3dc230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:40.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.584+0000 7f7e5b683740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56164d425330 0x56164d3f1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:40.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.584+0000 7f7e5b683740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56164d425cf0 0x56164d42e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:40.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.584+0000 7f7e5b683740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e50070250 con 0x56164d425330 2024-02-21T23:06:40.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.584+0000 7f7e5b683740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e500714b0 con 0x56164d3dd3a0 2024-02-21T23:06:40.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.584+0000 7f7e5b683740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e50070850 con 0x56164d425cf0 2024-02-21T23:06:40.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.584+0000 7f7e5b683740 10 client.0 _ll_register_callbacks cb 0x7f7e4c009d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:06:40.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.584+0000 7f7e55400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56164d425330 0x56164d3f1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:40.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.585+0000 7f7e55e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56164d3dd3a0 0x56164d3dc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:40.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.585+0000 7f7e55e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56164d3dd3a0 0x56164d3dc230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:39616/0 (socket says 172.21.15.99:39616) 2024-02-21T23:06:40.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.585+0000 7f7e55e00640 1 -- 172.21.15.99:0/3748301545 learned_addr learned my addr 172.21.15.99:0/3748301545 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:06:40.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.585+0000 7f7e56800640 1 --2- 172.21.15.99:0/3748301545 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56164d425cf0 0x56164d42e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:40.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.585+0000 7f7e55400640 1 -- 172.21.15.99:0/3748301545 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56164d425cf0 msgr2=0x56164d42e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:40.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.585+0000 7f7e55400640 1 --2- 172.21.15.99:0/3748301545 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56164d425cf0 0x56164d42e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:40.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.585+0000 7f7e55400640 1 -- 172.21.15.99:0/3748301545 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56164d3dd3a0 msgr2=0x56164d3dc230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:40.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.585+0000 7f7e55400640 1 --2- 172.21.15.99:0/3748301545 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56164d3dd3a0 0x56164d3dc230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:40.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.585+0000 7f7e55400640 1 -- 172.21.15.99:0/3748301545 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56164d3f24c0 con 0x56164d425330 2024-02-21T23:06:40.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.585+0000 7f7e55e00640 1 --2- 172.21.15.99:0/3748301545 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56164d3dd3a0 0x56164d3dc230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:06:40.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.585+0000 7f7e55400640 1 --2- 172.21.15.99:0/3748301545 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56164d425330 0x56164d3f1f80 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f7e40000c00 tx=0x7f7e4002e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fd568ed6863460d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:40.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.585+0000 7f7e32a00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:06:40.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.586+0000 7f7e32a00640 1 -- 172.21.15.99:0/3748301545 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e400552e0 con 0x56164d425330 2024-02-21T23:06:40.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.586+0000 7f7e5b683740 1 -- 172.21.15.99:0/3748301545 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7e440955d0 con 0x56164d425330 2024-02-21T23:06:40.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.586+0000 7f7e32a00640 1 -- 172.21.15.99:0/3748301545 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f7e40053480 con 0x56164d425330 2024-02-21T23:06:40.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.586+0000 7f7e32a00640 1 -- 172.21.15.99:0/3748301545 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7e40065050 con 0x56164d425330 2024-02-21T23:06:40.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.586+0000 7f7e5b683740 10 client.5955 fetch_fsmap learned FSMap version 16 2024-02-21T23:06:40.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.586+0000 7f7e5b683740 1 -- 172.21.15.99:0/3748301545 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x56164d3a8340 con 0x56164d425330 2024-02-21T23:06:40.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.586+0000 7f7e32a00640 1 -- 172.21.15.99:0/3748301545 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e440955d0 con 0x56164d425330 2024-02-21T23:06:40.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.587+0000 7f7e32a00640 1 -- 172.21.15.99:0/3748301545 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f7e40031070 con 0x56164d425330 2024-02-21T23:06:40.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.587+0000 7f7e5b683740 10 client.5955 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T23:06:40.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.587+0000 7f7e5b683740 10 client.5955 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.d 2024-02-21T23:06:40.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.587+0000 7f7e5b683740 20 client.5955 populate_metadata read hostname 'smithi099' 2024-02-21T23:06:40.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.587+0000 7f7e5b683740 1 --2- 172.21.15.99:0/3748301545 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x56164d3ea050 0x56164d42ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:40.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.587+0000 7f7e5b683740 4 client.5955 mds_command: new command op to 4348 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T23:06:40.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.587+0000 7f7e5b683740 1 -- 172.21.15.99:0/3748301545 --> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56164d31a3e0 con 0x56164d3ea050 2024-02-21T23:06:40.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.593+0000 7f7e55e00640 1 --2- 172.21.15.99:0/3748301545 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x56164d3ea050 0x56164d42ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:40.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.597+0000 7f7e55e00640 1 --2- 172.21.15.99:0/3748301545 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x56164d3ea050 0x56164d42ea50 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ba261955cdfd20fe server_cookie=1301698337671fa9 in_seq=0 out_seq=0 2024-02-21T23:06:40.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.597+0000 7f7e32a00640 10 client.5955 ms_handle_connect on v2:172.21.15.99:6834/2243461688 2024-02-21T23:06:40.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.597+0000 7f7e32a00640 1 -- 172.21.15.99:0/3748301545 <== mds.2 v2:172.21.15.99:6834/2243461688 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56164d31a3e0 con 0x56164d3ea050 2024-02-21T23:06:40.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.597+0000 7f7e32a00640 10 client.5955 handle_command_reply: tid=0 2024-02-21T23:06:40.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.597+0000 7f7e5b683740 1 client.5955 shutdown 2024-02-21T23:06:40.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.597+0000 7f7e5b683740 1 -- 172.21.15.99:0/3748301545 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56164d425330 msgr2=0x56164d3f1f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:40.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.597+0000 7f7e5b683740 1 --2- 172.21.15.99:0/3748301545 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56164d425330 0x56164d3f1f80 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f7e40000c00 tx=0x7f7e4002e000 comp rx=0 tx=0).stop 2024-02-21T23:06:40.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.597+0000 7f7e5b683740 1 -- 172.21.15.99:0/3748301545 shutdown_connections 2024-02-21T23:06:40.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.597+0000 7f7e5b683740 1 --2- 172.21.15.99:0/3748301545 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x56164d3ea050 0x56164d42ea50 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:40.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.597+0000 7f7e5b683740 1 --2- 172.21.15.99:0/3748301545 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56164d425cf0 0x56164d42e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:40.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.597+0000 7f7e5b683740 1 --2- 172.21.15.99:0/3748301545 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56164d425330 0x56164d3f1f80 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:40.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.597+0000 7f7e5b683740 1 --2- 172.21.15.99:0/3748301545 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56164d3dd3a0 0x56164d3dc230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:40.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.597+0000 7f7e5b683740 1 -- 172.21.15.99:0/3748301545 >> 172.21.15.99:0/3748301545 conn(0x56164d3ea660 msgr2=0x56164d431a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:06:40.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.597+0000 7f7e32a00640 0 client.5955 ms_handle_reset on v2:172.21.15.99:6834/2243461688 2024-02-21T23:06:40.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.598+0000 7f7e5b683740 1 -- 172.21.15.99:0/3748301545 shutdown_connections 2024-02-21T23:06:40.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.598+0000 7f7e5b683740 1 -- 172.21.15.99:0/3748301545 wait complete. 2024-02-21T23:06:40.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.598+0000 7f7e5b683740 20 client.5955 trim_cache size 0 max 16384 2024-02-21T23:06:40.589 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-02-21T23:06:40.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.598+0000 7f7e57200640 1 -- 172.21.15.99:0/4165540692 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f7e3409eed0 msgr2=0x7f7e340a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:40.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.598+0000 7f7e57200640 1 --2- 172.21.15.99:0/4165540692 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f7e3409eed0 0x7f7e340a1390 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7e500cec70 tx=0x7f7e4003d040 comp rx=0 tx=0).stop 2024-02-21T23:06:40.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.598+0000 7f7e57200640 1 -- 172.21.15.99:0/4165540692 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e500cc9c0 msgr2=0x7f7e501864c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:40.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.598+0000 7f7e57200640 1 --2- 172.21.15.99:0/4165540692 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e500cc9c0 0x7f7e501864c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f7e4400c3e0 tx=0x7f7e4400c8a0 comp rx=0 tx=0).stop 2024-02-21T23:06:40.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.599+0000 7f7e57200640 1 -- 172.21.15.99:0/4165540692 shutdown_connections 2024-02-21T23:06:40.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.599+0000 7f7e57200640 1 --2- 172.21.15.99:0/4165540692 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f7e3409eed0 0x7f7e340a1390 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:40.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.599+0000 7f7e57200640 1 --2- 172.21.15.99:0/4165540692 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7e5017c560 0x7f7e50173950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:40.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.599+0000 7f7e57200640 1 --2- 172.21.15.99:0/4165540692 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e5017c180 0x7f7e5017ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:40.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.599+0000 7f7e57200640 1 --2- 172.21.15.99:0/4165540692 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e500cc9c0 0x7f7e501864c0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:40.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.599+0000 7f7e57200640 1 -- 172.21.15.99:0/4165540692 >> 172.21.15.99:0/4165540692 conn(0x7f7e500ce4b0 msgr2=0x7f7e500f3db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:06:40.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.599+0000 7f7e57200640 1 -- 172.21.15.99:0/4165540692 shutdown_connections 2024-02-21T23:06:40.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.599+0000 7f7e57200640 1 -- 172.21.15.99:0/4165540692 wait complete. 2024-02-21T23:06:40.605 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T23:06:40.606 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-02-21T23:06:40.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.850+0000 7f354fe00640 1 Processor -- start 2024-02-21T23:06:40.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.850+0000 7f354fe00640 1 -- start start 2024-02-21T23:06:40.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.852+0000 7f354fe00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f355018b230 0x7f35500fc280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:40.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.852+0000 7f354fe00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f35500fc7c0 0x7f35500fcc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:40.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.852+0000 7f354fe00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35500d6dd0 con 0x7f355017f490 2024-02-21T23:06:40.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.852+0000 7f354fe00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35501614c0 con 0x7f35500fc7c0 2024-02-21T23:06:40.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.852+0000 7f354fe00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35500d6810 con 0x7f355018b230 2024-02-21T23:06:40.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.853+0000 7f354e000640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f355018b230 0x7f35500fc280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:40.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.853+0000 7f354ea00640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f355017f490 0x7f355018ab20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:55004/0 (socket says 172.21.15.99:55004) 2024-02-21T23:06:40.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.853+0000 7f354ea00640 1 -- 172.21.15.99:0/2358018276 learned_addr learned my addr 172.21.15.99:0/2358018276 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:06:40.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.853+0000 7f354f400640 1 --2- 172.21.15.99:0/2358018276 >> v2:172.21.15.99:3300/0 conn(0x7f35500fc7c0 0x7f35500fcc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:40.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.853+0000 7f354d600640 1 -- 172.21.15.99:0/2358018276 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4272064907 0 0) 0x7f35500d6dd0 con 0x7f355017f490 2024-02-21T23:06:40.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.853+0000 7f354d600640 1 -- 172.21.15.99:0/2358018276 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3534003520 con 0x7f355017f490 2024-02-21T23:06:40.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.853+0000 7f354e000640 1 -- 172.21.15.99:0/2358018276 >> v2:172.21.15.99:3300/0 conn(0x7f35500fc7c0 msgr2=0x7f35500fcc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:40.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.853+0000 7f354e000640 1 --2- 172.21.15.99:0/2358018276 >> v2:172.21.15.99:3300/0 conn(0x7f35500fc7c0 0x7f35500fcc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:40.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.853+0000 7f354e000640 1 -- 172.21.15.99:0/2358018276 >> v1:172.21.15.181:6789/0 conn(0x7f355017f490 legacy=0x7f355018ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:40.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.853+0000 7f354e000640 1 -- 172.21.15.99:0/2358018276 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35500d6af0 con 0x7f355018b230 2024-02-21T23:06:40.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.855+0000 7f354e000640 1 --2- 172.21.15.99:0/2358018276 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f355018b230 0x7f35500fc280 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f3550186880 tx=0x7f353c02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2a3cd01d543baf3 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:40.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.855+0000 7f354d600640 1 -- 172.21.15.99:0/2358018276 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f353c035020 con 0x7f355018b230 2024-02-21T23:06:40.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.855+0000 7f354d600640 1 -- 172.21.15.99:0/2358018276 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f353c031830 con 0x7f355018b230 2024-02-21T23:06:40.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.855+0000 7f354d600640 1 -- 172.21.15.99:0/2358018276 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f353c031c00 con 0x7f355018b230 2024-02-21T23:06:40.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.856+0000 7f354fe00640 1 -- 172.21.15.99:0/2358018276 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f355018b230 msgr2=0x7f35500fc280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:40.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.856+0000 7f354fe00640 1 --2- 172.21.15.99:0/2358018276 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f355018b230 0x7f35500fc280 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f3550186880 tx=0x7f353c02b8d0 comp rx=0 tx=0).stop 2024-02-21T23:06:40.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.856+0000 7f354fe00640 1 -- 172.21.15.99:0/2358018276 shutdown_connections 2024-02-21T23:06:40.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.856+0000 7f354fe00640 1 --2- 172.21.15.99:0/2358018276 >> v2:172.21.15.99:3300/0 conn(0x7f35500fc7c0 0x7f35500fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:40.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.856+0000 7f354fe00640 1 --2- 172.21.15.99:0/2358018276 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f355018b230 0x7f35500fc280 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:40.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.856+0000 7f354fe00640 1 -- 172.21.15.99:0/2358018276 >> 172.21.15.99:0/2358018276 conn(0x7f35500d29b0 msgr2=0x7f35500d2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:06:40.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.856+0000 7f354fe00640 1 -- 172.21.15.99:0/2358018276 shutdown_connections 2024-02-21T23:06:40.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.856+0000 7f354fe00640 1 -- 172.21.15.99:0/2358018276 wait complete. 2024-02-21T23:06:40.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.858+0000 7f354fe00640 1 Processor -- start 2024-02-21T23:06:40.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.858+0000 7f354fe00640 1 -- start start 2024-02-21T23:06:40.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.860+0000 7f354fe00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f35500fc7c0 0x7f35500cf750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:40.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.860+0000 7f354fe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f355017f490 0x7f35501887c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:40.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.860+0000 7f354fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f355018b230 0x7f3550188d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:40.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.860+0000 7f354fe00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f355018a600 con 0x7f355018b230 2024-02-21T23:06:40.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.860+0000 7f354fe00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f355018a320 con 0x7f355017f490 2024-02-21T23:06:40.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.860+0000 7f354fe00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f355018b6c0 con 0x7f35500fc7c0 2024-02-21T23:06:40.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.860+0000 7f354f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f355018b230 0x7f3550188d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:40.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.860+0000 7f354e000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f355017f490 0x7f35501887c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:40.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.860+0000 7f354ea00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f35500fc7c0 0x7f35500cf750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:40.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.860+0000 7f354e000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f355017f490 0x7f35501887c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:39630/0 (socket says 172.21.15.99:39630) 2024-02-21T23:06:40.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.860+0000 7f354e000640 1 -- 172.21.15.99:0/1302215828 learned_addr learned my addr 172.21.15.99:0/1302215828 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:06:40.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.860+0000 7f354f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f355018b230 0x7f3550188d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45698/0 (socket says 172.21.15.99:45698) 2024-02-21T23:06:40.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.860+0000 7f354e000640 1 -- 172.21.15.99:0/1302215828 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f35500fc7c0 msgr2=0x7f35500cf750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:40.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.860+0000 7f354e000640 1 --2- 172.21.15.99:0/1302215828 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f35500fc7c0 0x7f35500cf750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:40.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.860+0000 7f354e000640 1 -- 172.21.15.99:0/1302215828 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f355018b230 msgr2=0x7f3550188d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:40.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.860+0000 7f354e000640 1 --2- 172.21.15.99:0/1302215828 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f355018b230 0x7f3550188d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:40.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.860+0000 7f354e000640 1 -- 172.21.15.99:0/1302215828 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35501893b0 con 0x7f355017f490 2024-02-21T23:06:40.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.860+0000 7f354f400640 1 --2- 172.21.15.99:0/1302215828 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f355018b230 0x7f3550188d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:06:40.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.861+0000 7f354e000640 1 --2- 172.21.15.99:0/1302215828 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f355017f490 0x7f35501887c0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f353c000c00 tx=0x7f353c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:40.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.861+0000 7f3546a00640 1 -- 172.21.15.99:0/1302215828 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f353c040070 con 0x7f355017f490 2024-02-21T23:06:40.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.861+0000 7f3546a00640 1 -- 172.21.15.99:0/1302215828 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f353c03a830 con 0x7f355017f490 2024-02-21T23:06:40.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.861+0000 7f354fe00640 1 -- 172.21.15.99:0/1302215828 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3550222a00 con 0x7f355017f490 2024-02-21T23:06:40.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.861+0000 7f3546a00640 1 -- 172.21.15.99:0/1302215828 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f353c035040 con 0x7f355017f490 2024-02-21T23:06:40.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.862+0000 7f354fe00640 1 -- 172.21.15.99:0/1302215828 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3550222fc0 con 0x7f355017f490 2024-02-21T23:06:40.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.865+0000 7f3558827740 1 Processor -- start 2024-02-21T23:06:40.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.866+0000 7f3558827740 1 -- start start 2024-02-21T23:06:40.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.866+0000 7f3546a00640 1 -- 172.21.15.99:0/1302215828 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f353c04b060 con 0x7f355017f490 2024-02-21T23:06:40.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.867+0000 7f3558827740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d7ce09d660 0x55d7ce09da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:40.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.867+0000 7f3558827740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d7ce0d8330 0x55d7ce0d87b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:40.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.867+0000 7f3558827740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d7ce0d8cf0 0x55d7ce0d9560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:40.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.867+0000 7f3558827740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7cdfc5b50 con 0x55d7ce09d660 2024-02-21T23:06:40.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.867+0000 7f3558827740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7cdf6eda0 con 0x55d7ce0d8cf0 2024-02-21T23:06:40.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.867+0000 7f3558827740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7cdfc1bf0 con 0x55d7ce0d8330 2024-02-21T23:06:40.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.867+0000 7f354ea00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d7ce0d8330 0x55d7ce0d87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:40.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.867+0000 7f354ea00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d7ce0d8330 0x55d7ce0d87b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:45478/0 (socket says 172.21.15.99:45478) 2024-02-21T23:06:40.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.867+0000 7f354ea00640 1 -- 172.21.15.99:0/378672023 learned_addr learned my addr 172.21.15.99:0/378672023 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:06:40.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.867+0000 7f354f400640 1 --2- 172.21.15.99:0/378672023 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d7ce09d660 0x55d7ce09da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:40.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.867+0000 7f354e000640 1 --2- 172.21.15.99:0/378672023 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d7ce0d8cf0 0x55d7ce0d9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:40.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.868+0000 7f354ea00640 1 -- 172.21.15.99:0/378672023 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d7ce0d8cf0 msgr2=0x55d7ce0d9560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:40.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.868+0000 7f354ea00640 1 --2- 172.21.15.99:0/378672023 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d7ce0d8cf0 0x55d7ce0d9560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:40.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.868+0000 7f354ea00640 1 -- 172.21.15.99:0/378672023 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d7ce09d660 msgr2=0x55d7ce09da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:40.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.868+0000 7f3546a00640 1 --2- 172.21.15.99:0/1302215828 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f353009ef00 0x7f35300a13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:40.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.868+0000 7f354ea00640 1 --2- 172.21.15.99:0/378672023 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d7ce09d660 0x55d7ce09da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:40.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.868+0000 7f354ea00640 1 -- 172.21.15.99:0/378672023 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d7cdf91f80 con 0x55d7ce0d8330 2024-02-21T23:06:40.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.868+0000 7f354e000640 1 --2- 172.21.15.99:0/378672023 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d7ce0d8cf0 0x55d7ce0d9560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:06:40.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.868+0000 7f3546a00640 1 -- 172.21.15.99:0/1302215828 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f353c0eb5b0 con 0x7f355017f490 2024-02-21T23:06:40.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.868+0000 7f354f400640 1 --2- 172.21.15.99:0/378672023 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d7ce09d660 0x55d7ce09da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:06:40.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.868+0000 7f354ea00640 1 --2- 172.21.15.99:0/378672023 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d7ce0d8330 0x55d7ce0d87b0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f3540006f50 tx=0x7f35400074d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5754c57d9f91aef4 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:40.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.868+0000 7f354e000640 1 --2- 172.21.15.99:0/1302215828 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f353009ef00 0x7f35300a13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:40.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.869+0000 7f353b400640 1 -- 172.21.15.99:0/378672023 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3540007720 con 0x55d7ce0d8330 2024-02-21T23:06:40.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.869+0000 7f353b400640 1 -- 172.21.15.99:0/378672023 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3540018070 con 0x55d7ce0d8330 2024-02-21T23:06:40.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.869+0000 7f353b400640 1 -- 172.21.15.99:0/378672023 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3540001c40 con 0x55d7ce0d8330 2024-02-21T23:06:40.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.870+0000 7f3558827740 1 -- 172.21.15.99:0/378672023 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d7ce0d8330 msgr2=0x55d7ce0d87b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:40.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.870+0000 7f3558827740 1 --2- 172.21.15.99:0/378672023 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d7ce0d8330 0x55d7ce0d87b0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f3540006f50 tx=0x7f35400074d0 comp rx=0 tx=0).stop 2024-02-21T23:06:40.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.870+0000 7f354e000640 1 --2- 172.21.15.99:0/1302215828 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f353009ef00 0x7f35300a13c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f353c0e8db0 tx=0x7f353c031f90 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:40.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.870+0000 7f3558827740 1 -- 172.21.15.99:0/378672023 shutdown_connections 2024-02-21T23:06:40.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.870+0000 7f3558827740 1 --2- 172.21.15.99:0/378672023 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d7ce0d8cf0 0x55d7ce0d9560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:40.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.870+0000 7f3558827740 1 --2- 172.21.15.99:0/378672023 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d7ce0d8330 0x55d7ce0d87b0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:40.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.870+0000 7f3558827740 1 --2- 172.21.15.99:0/378672023 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d7ce09d660 0x55d7ce09da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:40.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.870+0000 7f3558827740 1 -- 172.21.15.99:0/378672023 >> 172.21.15.99:0/378672023 conn(0x55d7ce05f6d0 msgr2=0x55d7ce060750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:06:40.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.870+0000 7f3558827740 1 -- 172.21.15.99:0/378672023 shutdown_connections 2024-02-21T23:06:40.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.870+0000 7f3558827740 1 -- 172.21.15.99:0/378672023 wait complete. 2024-02-21T23:06:40.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.871+0000 7f3558827740 1 -- start start 2024-02-21T23:06:40.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.871+0000 7f3558827740 1 Processor -- start 2024-02-21T23:06:40.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.872+0000 7f3558827740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d7ce0d8330 0x55d7ce093a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:40.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.872+0000 7f3558827740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d7ce0d8cf0 0x55d7ce0cbfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:40.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.872+0000 7f3558827740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d7ce0a61f0 0x55d7ce0d35e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:40.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.872+0000 7f3558827740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7ce0d70a0 con 0x55d7ce0d8cf0 2024-02-21T23:06:40.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.872+0000 7f3558827740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7cdf64380 con 0x55d7ce0d8330 2024-02-21T23:06:40.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.872+0000 7f3558827740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7ce0d6dc0 con 0x55d7ce0a61f0 2024-02-21T23:06:40.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.873+0000 7f3558827740 10 client.0 _ll_register_callbacks cb 0x55d7cdfbd280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:06:40.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.873+0000 7f354f400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d7ce0a61f0 0x55d7ce0d35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:40.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.873+0000 7f354f400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d7ce0a61f0 0x55d7ce0d35e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:45490/0 (socket says 172.21.15.99:45490) 2024-02-21T23:06:40.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.873+0000 7f354f400640 1 -- 172.21.15.99:0/3831287509 learned_addr learned my addr 172.21.15.99:0/3831287509 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:06:40.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.873+0000 7f354ea00640 1 --2- 172.21.15.99:0/3831287509 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d7ce0d8cf0 0x55d7ce0cbfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:40.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.873+0000 7f354f400640 1 --2- 172.21.15.99:0/3831287509 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d7ce0d8330 0x55d7ce093a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:40.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.873+0000 7f354f400640 1 -- 172.21.15.99:0/3831287509 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d7ce0d8330 msgr2=0x55d7ce093a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:40.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.873+0000 7f354f400640 1 --2- 172.21.15.99:0/3831287509 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d7ce0d8330 0x55d7ce093a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:40.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.873+0000 7f354f400640 1 -- 172.21.15.99:0/3831287509 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d7ce0d8cf0 msgr2=0x55d7ce0cbfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:40.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.873+0000 7f354f400640 1 --2- 172.21.15.99:0/3831287509 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d7ce0d8cf0 0x55d7ce0cbfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:40.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.873+0000 7f354f400640 1 -- 172.21.15.99:0/3831287509 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d7cdf8cc20 con 0x55d7ce0a61f0 2024-02-21T23:06:40.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.874+0000 7f354f400640 1 --2- 172.21.15.99:0/3831287509 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d7ce0a61f0 0x55d7ce0d35e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f354801bf00 tx=0x7f3548009750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9da7211998424cc6 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:40.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.874+0000 7f352fe00640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-02-21T23:06:40.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.874+0000 7f352fe00640 1 -- 172.21.15.99:0/3831287509 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f354800ee60 con 0x55d7ce0a61f0 2024-02-21T23:06:40.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.874+0000 7f3558827740 1 -- 172.21.15.99:0/3831287509 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3540018070 con 0x55d7ce0a61f0 2024-02-21T23:06:40.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.874+0000 7f352fe00640 1 -- 172.21.15.99:0/3831287509 <== mon.2 v2:172.21.15.181:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f3548018410 con 0x55d7ce0a61f0 2024-02-21T23:06:40.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.874+0000 7f352fe00640 1 -- 172.21.15.99:0/3831287509 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f354802c050 con 0x55d7ce0a61f0 2024-02-21T23:06:40.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.874+0000 7f3558827740 10 client.6122 fetch_fsmap learned FSMap version 16 2024-02-21T23:06:40.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.874+0000 7f3558827740 1 -- 172.21.15.99:0/3831287509 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55d7cdcda3f0 con 0x55d7ce0a61f0 2024-02-21T23:06:40.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.875+0000 7f352fe00640 1 -- 172.21.15.99:0/3831287509 <== mon.2 v2:172.21.15.181:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3540018070 con 0x55d7ce0a61f0 2024-02-21T23:06:40.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.875+0000 7f352fe00640 1 -- 172.21.15.99:0/3831287509 <== mon.2 v2:172.21.15.181:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f3548018610 con 0x55d7ce0a61f0 2024-02-21T23:06:40.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.875+0000 7f3558827740 10 client.6122 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T23:06:40.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.875+0000 7f3558827740 10 client.6122 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2024-02-21T23:06:40.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.875+0000 7f3558827740 20 client.6122 populate_metadata read hostname 'smithi099' 2024-02-21T23:06:40.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.875+0000 7f3558827740 1 --2- 172.21.15.99:0/3831287509 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x55d7ce0cc6f0 0x55d7ce0a6670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:40.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.875+0000 7f3558827740 4 client.6122 mds_command: new command op to 4352 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:06:40.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.875+0000 7f3558827740 1 -- 172.21.15.99:0/3831287509 --> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d7cdfd3090 con 0x55d7ce0cc6f0 2024-02-21T23:06:40.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.875+0000 7f354ea00640 1 --2- 172.21.15.99:0/3831287509 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x55d7ce0cc6f0 0x55d7ce0a6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:40.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.876+0000 7f354ea00640 1 --2- 172.21.15.99:0/3831287509 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x55d7ce0cc6f0 0x55d7ce0a6670 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1085170d6144e500 server_cookie=650cfc94db02b052 in_seq=0 out_seq=0 2024-02-21T23:06:40.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.876+0000 7f352fe00640 10 client.6122 ms_handle_connect on v2:172.21.15.99:6836/1676159950 2024-02-21T23:06:40.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.877+0000 7f352fe00640 1 -- 172.21.15.99:0/3831287509 <== mds.1 v2:172.21.15.99:6836/1676159950 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55d7cdfd3090 con 0x55d7ce0cc6f0 2024-02-21T23:06:40.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.877+0000 7f352fe00640 10 client.6122 handle_command_reply: tid=0 2024-02-21T23:06:40.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.877+0000 7f3558827740 1 client.6122 shutdown 2024-02-21T23:06:40.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.877+0000 7f3558827740 1 -- 172.21.15.99:0/3831287509 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d7ce0a61f0 msgr2=0x55d7ce0d35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:40.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.877+0000 7f3558827740 1 --2- 172.21.15.99:0/3831287509 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d7ce0a61f0 0x55d7ce0d35e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f354801bf00 tx=0x7f3548009750 comp rx=0 tx=0).stop 2024-02-21T23:06:40.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.877+0000 7f3558827740 1 -- 172.21.15.99:0/3831287509 shutdown_connections 2024-02-21T23:06:40.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.877+0000 7f3558827740 1 --2- 172.21.15.99:0/3831287509 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x55d7ce0cc6f0 0x55d7ce0a6670 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:40.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.877+0000 7f3558827740 1 --2- 172.21.15.99:0/3831287509 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d7ce0a61f0 0x55d7ce0d35e0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:40.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.877+0000 7f3558827740 1 --2- 172.21.15.99:0/3831287509 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d7ce0d8cf0 0x55d7ce0cbfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:40.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.877+0000 7f352fe00640 0 client.6122 ms_handle_reset on v2:172.21.15.99:6836/1676159950 2024-02-21T23:06:40.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.877+0000 7f3558827740 1 --2- 172.21.15.99:0/3831287509 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d7ce0d8330 0x55d7ce093a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:40.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.877+0000 7f3558827740 1 -- 172.21.15.99:0/3831287509 >> 172.21.15.99:0/3831287509 conn(0x55d7ce09d660 msgr2=0x55d7ce099ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:06:40.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.877+0000 7f3558827740 1 -- 172.21.15.99:0/3831287509 shutdown_connections 2024-02-21T23:06:40.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.877+0000 7f3558827740 1 -- 172.21.15.99:0/3831287509 wait complete. 2024-02-21T23:06:40.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.878+0000 7f3558827740 20 client.6122 trim_cache size 0 max 16384 2024-02-21T23:06:40.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.904+0000 7f3558827740 1 Processor -- start 2024-02-21T23:06:40.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.904+0000 7f3558827740 1 -- start start 2024-02-21T23:06:40.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.906+0000 7f3558827740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d7ce0a61f0 0x55d7ce0f2110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:40.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.906+0000 7f3558827740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d7ce0d8330 0x55d7ce0a2e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:40.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.906+0000 7f3558827740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d7ce0d8cf0 0x55d7ce0a65f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:40.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.906+0000 7f3558827740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f355022c5f0 con 0x55d7ce0d8cf0 2024-02-21T23:06:40.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.906+0000 7f3558827740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f355022a190 con 0x55d7ce0a61f0 2024-02-21T23:06:40.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.906+0000 7f3558827740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f355017a440 con 0x55d7ce0d8330 2024-02-21T23:06:40.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.907+0000 7f354f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d7ce0d8cf0 0x55d7ce0a65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:40.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.907+0000 7f354ea00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d7ce0d8330 0x55d7ce0a2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:40.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.907+0000 7f354f400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d7ce0a61f0 0x55d7ce0f2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:40.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.907+0000 7f354ea00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d7ce0d8330 0x55d7ce0a2e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:45506/0 (socket says 172.21.15.99:45506) 2024-02-21T23:06:40.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.907+0000 7f354ea00640 1 -- 172.21.15.99:0/3371691302 learned_addr learned my addr 172.21.15.99:0/3371691302 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:06:40.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.907+0000 7f354ea00640 1 -- 172.21.15.99:0/3371691302 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d7ce0a61f0 msgr2=0x55d7ce0f2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:40.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.907+0000 7f354ea00640 1 --2- 172.21.15.99:0/3371691302 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d7ce0a61f0 0x55d7ce0f2110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:40.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.907+0000 7f354ea00640 1 -- 172.21.15.99:0/3371691302 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d7ce0d8cf0 msgr2=0x55d7ce0a65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:40.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.907+0000 7f354ea00640 1 --2- 172.21.15.99:0/3371691302 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d7ce0d8cf0 0x55d7ce0a65f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:40.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.907+0000 7f354ea00640 1 -- 172.21.15.99:0/3371691302 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d7cdda47d0 con 0x55d7ce0d8330 2024-02-21T23:06:40.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.907+0000 7f354ea00640 1 --2- 172.21.15.99:0/3371691302 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d7ce0d8330 0x55d7ce0a2e50 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f3540007510 tx=0x7f354000c000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d38dee6dc80c9f4a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:40.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.908+0000 7f353aa00640 1 -- 172.21.15.99:0/3371691302 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3540001c40 con 0x55d7ce0d8330 2024-02-21T23:06:40.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.908+0000 7f353aa00640 1 -- 172.21.15.99:0/3371691302 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3540018040 con 0x55d7ce0d8330 2024-02-21T23:06:40.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.908+0000 7f353aa00640 1 -- 172.21.15.99:0/3371691302 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35400062f0 con 0x55d7ce0d8330 2024-02-21T23:06:40.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.908+0000 7f3558827740 1 -- 172.21.15.99:0/3371691302 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d7ce0d8330 msgr2=0x55d7ce0a2e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:40.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.908+0000 7f3558827740 1 --2- 172.21.15.99:0/3371691302 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d7ce0d8330 0x55d7ce0a2e50 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f3540007510 tx=0x7f354000c000 comp rx=0 tx=0).stop 2024-02-21T23:06:40.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.909+0000 7f3558827740 1 -- 172.21.15.99:0/3371691302 shutdown_connections 2024-02-21T23:06:40.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.909+0000 7f3558827740 1 --2- 172.21.15.99:0/3371691302 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d7ce0d8cf0 0x55d7ce0a65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:40.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.909+0000 7f3558827740 1 --2- 172.21.15.99:0/3371691302 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d7ce0d8330 0x55d7ce0a2e50 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:40.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.909+0000 7f3558827740 1 --2- 172.21.15.99:0/3371691302 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d7ce0a61f0 0x55d7ce0f2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:40.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.909+0000 7f3558827740 1 -- 172.21.15.99:0/3371691302 >> 172.21.15.99:0/3371691302 conn(0x55d7ce09d660 msgr2=0x55d7ce0575e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:06:40.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.909+0000 7f3558827740 1 -- 172.21.15.99:0/3371691302 shutdown_connections 2024-02-21T23:06:40.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.909+0000 7f3558827740 1 -- 172.21.15.99:0/3371691302 wait complete. 2024-02-21T23:06:40.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.909+0000 7f3558827740 1 -- start start 2024-02-21T23:06:40.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.910+0000 7f3558827740 1 Processor -- start 2024-02-21T23:06:40.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.911+0000 7f3558827740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d7ce0a61f0 0x55d7ce089cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:40.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.911+0000 7f3558827740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d7ce0d8330 0x55d7ce05cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:40.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.911+0000 7f3558827740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d7ce0d8cf0 0x55d7ce0665b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:40.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.911+0000 7f3558827740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f355015f410 con 0x55d7ce0d8330 2024-02-21T23:06:40.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.911+0000 7f3558827740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3550229b30 con 0x55d7ce0a61f0 2024-02-21T23:06:40.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.911+0000 7f3558827740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3550228f30 con 0x55d7ce0d8cf0 2024-02-21T23:06:40.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.911+0000 7f3558827740 10 client.0 _ll_register_callbacks cb 0x7f354800e7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:06:40.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.911+0000 7f354f400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d7ce0a61f0 0x55d7ce089cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:40.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.911+0000 7f354f400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d7ce0a61f0 0x55d7ce089cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:39652/0 (socket says 172.21.15.99:39652) 2024-02-21T23:06:40.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.911+0000 7f354f400640 1 -- 172.21.15.99:0/2526678854 learned_addr learned my addr 172.21.15.99:0/2526678854 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:06:40.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.911+0000 7f354ea00640 1 --2- 172.21.15.99:0/2526678854 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d7ce0d8330 0x55d7ce05cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:40.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.911+0000 7f354f400640 1 --2- 172.21.15.99:0/2526678854 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d7ce0d8cf0 0x55d7ce0665b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:41.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.912+0000 7f354f400640 1 -- 172.21.15.99:0/2526678854 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d7ce0d8cf0 msgr2=0x55d7ce0665b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:41.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.912+0000 7f354f400640 1 --2- 172.21.15.99:0/2526678854 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d7ce0d8cf0 0x55d7ce0665b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:41.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.912+0000 7f354f400640 1 -- 172.21.15.99:0/2526678854 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d7ce0d8330 msgr2=0x55d7ce05cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:41.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.912+0000 7f354f400640 1 --2- 172.21.15.99:0/2526678854 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d7ce0d8330 0x55d7ce05cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:41.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.912+0000 7f354f400640 1 -- 172.21.15.99:0/2526678854 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d7ce0890b0 con 0x55d7ce0a61f0 2024-02-21T23:06:41.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.912+0000 7f354ea00640 1 --2- 172.21.15.99:0/2526678854 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d7ce0d8330 0x55d7ce05cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:06:41.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.912+0000 7f354f400640 1 --2- 172.21.15.99:0/2526678854 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d7ce0a61f0 0x55d7ce089cc0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f3548007b90 tx=0x7f3548014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f21942bd68780dbf server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:41.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.912+0000 7f352fe00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-02-21T23:06:41.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.912+0000 7f352fe00640 1 -- 172.21.15.99:0/2526678854 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f354800ee60 con 0x55d7ce0a61f0 2024-02-21T23:06:41.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.912+0000 7f3558827740 1 -- 172.21.15.99:0/2526678854 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3540018040 con 0x55d7ce0a61f0 2024-02-21T23:06:41.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.912+0000 7f352fe00640 1 -- 172.21.15.99:0/2526678854 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f354801bc10 con 0x55d7ce0a61f0 2024-02-21T23:06:41.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.912+0000 7f352fe00640 1 -- 172.21.15.99:0/2526678854 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f354803f050 con 0x55d7ce0a61f0 2024-02-21T23:06:41.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.913+0000 7f3558827740 10 client.6112 fetch_fsmap learned FSMap version 16 2024-02-21T23:06:41.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.913+0000 7f3558827740 1 -- 172.21.15.99:0/2526678854 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55d7ce0d46c0 con 0x55d7ce0a61f0 2024-02-21T23:06:41.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.913+0000 7f352fe00640 1 -- 172.21.15.99:0/2526678854 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3540018040 con 0x55d7ce0a61f0 2024-02-21T23:06:41.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.913+0000 7f352fe00640 1 -- 172.21.15.99:0/2526678854 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f3548018b10 con 0x55d7ce0a61f0 2024-02-21T23:06:41.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.913+0000 7f3558827740 10 client.6112 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T23:06:41.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.913+0000 7f3558827740 10 client.6112 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2024-02-21T23:06:41.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.913+0000 7f3558827740 20 client.6112 populate_metadata read hostname 'smithi099' 2024-02-21T23:06:41.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.913+0000 7f3558827740 1 --2- 172.21.15.99:0/2526678854 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x55d7ce0ac100 0x55d7ce0a1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:41.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.913+0000 7f3558827740 4 client.6112 mds_command: new command op to 4352 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T23:06:41.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.913+0000 7f3558827740 1 -- 172.21.15.99:0/2526678854 --> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55d7cdfcd3e0 con 0x55d7ce0ac100 2024-02-21T23:06:41.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.913+0000 7f354ea00640 1 --2- 172.21.15.99:0/2526678854 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x55d7ce0ac100 0x55d7ce0a1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:41.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.914+0000 7f354ea00640 1 --2- 172.21.15.99:0/2526678854 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x55d7ce0ac100 0x55d7ce0a1e20 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e39368e3b74c77d5 server_cookie=c3e55baffe3aea4e in_seq=0 out_seq=0 2024-02-21T23:06:41.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.914+0000 7f352fe00640 10 client.6112 ms_handle_connect on v2:172.21.15.99:6836/1676159950 2024-02-21T23:06:41.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.914+0000 7f352fe00640 1 -- 172.21.15.99:0/2526678854 <== mds.1 v2:172.21.15.99:6836/1676159950 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55d7cdfcd3e0 con 0x55d7ce0ac100 2024-02-21T23:06:41.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.914+0000 7f352fe00640 10 client.6112 handle_command_reply: tid=0 2024-02-21T23:06:41.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.914+0000 7f3558827740 1 client.6112 shutdown 2024-02-21T23:06:41.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.915+0000 7f3558827740 1 -- 172.21.15.99:0/2526678854 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d7ce0a61f0 msgr2=0x55d7ce089cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:41.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.915+0000 7f3558827740 1 --2- 172.21.15.99:0/2526678854 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d7ce0a61f0 0x55d7ce089cc0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f3548007b90 tx=0x7f3548014000 comp rx=0 tx=0).stop 2024-02-21T23:06:41.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.915+0000 7f3558827740 1 -- 172.21.15.99:0/2526678854 shutdown_connections 2024-02-21T23:06:41.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.915+0000 7f3558827740 1 --2- 172.21.15.99:0/2526678854 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x55d7ce0ac100 0x55d7ce0a1e20 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:41.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.915+0000 7f3558827740 1 --2- 172.21.15.99:0/2526678854 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d7ce0d8cf0 0x55d7ce0665b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:41.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.915+0000 7f3558827740 1 --2- 172.21.15.99:0/2526678854 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d7ce0d8330 0x55d7ce05cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:41.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.915+0000 7f3558827740 1 --2- 172.21.15.99:0/2526678854 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d7ce0a61f0 0x55d7ce089cc0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:41.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.915+0000 7f352fe00640 0 client.6112 ms_handle_reset on v2:172.21.15.99:6836/1676159950 2024-02-21T23:06:41.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.915+0000 7f3558827740 1 -- 172.21.15.99:0/2526678854 >> 172.21.15.99:0/2526678854 conn(0x55d7ce09d660 msgr2=0x55d7ce0575e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:06:41.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.915+0000 7f3558827740 1 -- 172.21.15.99:0/2526678854 shutdown_connections 2024-02-21T23:06:41.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.915+0000 7f3558827740 1 -- 172.21.15.99:0/2526678854 wait complete. 2024-02-21T23:06:41.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.915+0000 7f3558827740 20 client.6112 trim_cache size 0 max 16384 2024-02-21T23:06:41.005 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-02-21T23:06:41.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.916+0000 7f354fe00640 1 -- 172.21.15.99:0/1302215828 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f353009ef00 msgr2=0x7f35300a13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:41.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.916+0000 7f354fe00640 1 --2- 172.21.15.99:0/1302215828 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f353009ef00 0x7f35300a13c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f353c0e8db0 tx=0x7f353c031f90 comp rx=0 tx=0).stop 2024-02-21T23:06:41.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.916+0000 7f354fe00640 1 -- 172.21.15.99:0/1302215828 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f355017f490 msgr2=0x7f35501887c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:41.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.916+0000 7f354fe00640 1 --2- 172.21.15.99:0/1302215828 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f355017f490 0x7f35501887c0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f353c000c00 tx=0x7f353c0046c0 comp rx=0 tx=0).stop 2024-02-21T23:06:41.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.916+0000 7f354fe00640 1 -- 172.21.15.99:0/1302215828 shutdown_connections 2024-02-21T23:06:41.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.916+0000 7f354fe00640 1 --2- 172.21.15.99:0/1302215828 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f353009ef00 0x7f35300a13c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:41.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.916+0000 7f354fe00640 1 --2- 172.21.15.99:0/1302215828 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f355018b230 0x7f3550188d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:41.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.916+0000 7f354fe00640 1 --2- 172.21.15.99:0/1302215828 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f355017f490 0x7f35501887c0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:41.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.916+0000 7f354fe00640 1 --2- 172.21.15.99:0/1302215828 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f35500fc7c0 0x7f35500cf750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:41.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.916+0000 7f354fe00640 1 -- 172.21.15.99:0/1302215828 >> 172.21.15.99:0/1302215828 conn(0x7f35500d29b0 msgr2=0x7f3550068f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:06:41.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.916+0000 7f354fe00640 1 -- 172.21.15.99:0/1302215828 shutdown_connections 2024-02-21T23:06:41.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:40.916+0000 7f354fe00640 1 -- 172.21.15.99:0/1302215828 wait complete. 2024-02-21T23:06:41.009 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T23:06:41.009 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-02-21T23:06:41.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.283+0000 7fb9e3200640 1 Processor -- start 2024-02-21T23:06:41.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.283+0000 7fb9e3200640 1 -- start start 2024-02-21T23:06:41.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.285+0000 7fb9e3200640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fb9e418b230 0x7fb9e40fc280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:41.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.285+0000 7fb9e3200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb9e40fc7c0 0x7fb9e40fcc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:41.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.285+0000 7fb9e3200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9e40d6dd0 con 0x7fb9e417f490 2024-02-21T23:06:41.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.285+0000 7fb9e3200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9e41614c0 con 0x7fb9e40fc7c0 2024-02-21T23:06:41.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.285+0000 7fb9e3200640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9e40d6810 con 0x7fb9e418b230 2024-02-21T23:06:41.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.285+0000 7fb9e1e00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fb9e417f490 0x7fb9e418ab20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.99:59900/0 (socket says 172.21.15.99:59900) 2024-02-21T23:06:41.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.285+0000 7fb9e1e00640 1 -- 172.21.15.99:0/1446041664 learned_addr learned my addr 172.21.15.99:0/1446041664 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:06:41.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.285+0000 7fb9e2800640 1 --2- 172.21.15.99:0/1446041664 >> v2:172.21.15.99:3300/0 conn(0x7fb9e40fc7c0 0x7fb9e40fcc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:41.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.285+0000 7fb9e1400640 1 --2- 172.21.15.99:0/1446041664 >> v2:172.21.15.181:3300/0 conn(0x7fb9e418b230 0x7fb9e40fc280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:41.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.286+0000 7fb9e0a00640 1 -- 172.21.15.99:0/1446041664 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4257059457 0 0) 0x7fb9e40d6dd0 con 0x7fb9e417f490 2024-02-21T23:06:41.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.286+0000 7fb9e0a00640 1 -- 172.21.15.99:0/1446041664 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9c4003520 con 0x7fb9e417f490 2024-02-21T23:06:41.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.286+0000 7fb9e1400640 1 -- 172.21.15.99:0/1446041664 >> v2:172.21.15.99:3300/0 conn(0x7fb9e40fc7c0 msgr2=0x7fb9e40fcc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:41.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.286+0000 7fb9e1400640 1 --2- 172.21.15.99:0/1446041664 >> v2:172.21.15.99:3300/0 conn(0x7fb9e40fc7c0 0x7fb9e40fcc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:41.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.286+0000 7fb9e1400640 1 -- 172.21.15.99:0/1446041664 >> v1:172.21.15.162:6789/0 conn(0x7fb9e417f490 legacy=0x7fb9e418ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:41.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.286+0000 7fb9e1400640 1 -- 172.21.15.99:0/1446041664 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e40d6af0 con 0x7fb9e418b230 2024-02-21T23:06:41.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.286+0000 7fb9e2800640 1 --2- 172.21.15.99:0/1446041664 >> v2:172.21.15.99:3300/0 conn(0x7fb9e40fc7c0 0x7fb9e40fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:06:41.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.287+0000 7fb9e1400640 1 --2- 172.21.15.99:0/1446041664 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb9e418b230 0x7fb9e40fc280 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fb9e4186880 tx=0x7fb9cc02bec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af9d15f0a5a52a58 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:41.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.288+0000 7fb9e0a00640 1 -- 172.21.15.99:0/1446041664 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc039070 con 0x7fb9e418b230 2024-02-21T23:06:41.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.288+0000 7fb9e0a00640 1 -- 172.21.15.99:0/1446041664 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9cc02cc70 con 0x7fb9e418b230 2024-02-21T23:06:41.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.288+0000 7fb9e0a00640 1 -- 172.21.15.99:0/1446041664 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc034660 con 0x7fb9e418b230 2024-02-21T23:06:41.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.288+0000 7fb9e3200640 1 -- 172.21.15.99:0/1446041664 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb9e418b230 msgr2=0x7fb9e40fc280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:41.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.288+0000 7fb9e3200640 1 --2- 172.21.15.99:0/1446041664 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb9e418b230 0x7fb9e40fc280 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fb9e4186880 tx=0x7fb9cc02bec0 comp rx=0 tx=0).stop 2024-02-21T23:06:41.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.288+0000 7fb9e3200640 1 -- 172.21.15.99:0/1446041664 shutdown_connections 2024-02-21T23:06:41.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.288+0000 7fb9e3200640 1 --2- 172.21.15.99:0/1446041664 >> v2:172.21.15.99:3300/0 conn(0x7fb9e40fc7c0 0x7fb9e40fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:41.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.288+0000 7fb9e3200640 1 --2- 172.21.15.99:0/1446041664 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb9e418b230 0x7fb9e40fc280 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:41.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.288+0000 7fb9e3200640 1 -- 172.21.15.99:0/1446041664 >> 172.21.15.99:0/1446041664 conn(0x7fb9e40d29b0 msgr2=0x7fb9e40d2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:06:41.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.288+0000 7fb9e3200640 1 -- 172.21.15.99:0/1446041664 shutdown_connections 2024-02-21T23:06:41.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.289+0000 7fb9e3200640 1 -- 172.21.15.99:0/1446041664 wait complete. 2024-02-21T23:06:41.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.292+0000 7fb9e3200640 1 Processor -- start 2024-02-21T23:06:41.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.292+0000 7fb9e3200640 1 -- start start 2024-02-21T23:06:41.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.294+0000 7fb9e3200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb9e40fc7c0 0x7fb9e4159770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:41.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.294+0000 7fb9e3200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb9e417f490 0x7fb9e417f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:41.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.294+0000 7fb9e3200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb9e418b230 0x7fb9e4220010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:41.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.294+0000 7fb9e3200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e418a600 con 0x7fb9e418b230 2024-02-21T23:06:41.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.294+0000 7fb9e3200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e418a320 con 0x7fb9e40fc7c0 2024-02-21T23:06:41.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.294+0000 7fb9e3200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e418b6c0 con 0x7fb9e417f490 2024-02-21T23:06:41.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.294+0000 7fb9e2800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb9e418b230 0x7fb9e4220010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:41.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.294+0000 7fb9e1e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb9e40fc7c0 0x7fb9e4159770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:41.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.294+0000 7fb9e2800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb9e418b230 0x7fb9e4220010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45746/0 (socket says 172.21.15.99:45746) 2024-02-21T23:06:41.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.294+0000 7fb9e2800640 1 -- 172.21.15.99:0/3985058503 learned_addr learned my addr 172.21.15.99:0/3985058503 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:06:41.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.294+0000 7fb9e1400640 1 --2- 172.21.15.99:0/3985058503 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb9e417f490 0x7fb9e417f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:41.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.295+0000 7fb9e2800640 1 -- 172.21.15.99:0/3985058503 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb9e417f490 msgr2=0x7fb9e417f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:41.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.295+0000 7fb9e2800640 1 --2- 172.21.15.99:0/3985058503 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb9e417f490 0x7fb9e417f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:41.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.295+0000 7fb9e2800640 1 -- 172.21.15.99:0/3985058503 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb9e40fc7c0 msgr2=0x7fb9e4159770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:41.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.295+0000 7fb9e2800640 1 --2- 172.21.15.99:0/3985058503 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb9e40fc7c0 0x7fb9e4159770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:41.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.295+0000 7fb9e2800640 1 -- 172.21.15.99:0/3985058503 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e4180110 con 0x7fb9e418b230 2024-02-21T23:06:41.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.295+0000 7fb9e1e00640 1 --2- 172.21.15.99:0/3985058503 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb9e40fc7c0 0x7fb9e4159770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:06:41.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.295+0000 7fb9e2800640 1 --2- 172.21.15.99:0/3985058503 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb9e418b230 0x7fb9e4220010 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc00e960 tx=0x7fb9dc00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:41.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.296+0000 7fb9da000640 1 -- 172.21.15.99:0/3985058503 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9dc017070 con 0x7fb9e418b230 2024-02-21T23:06:41.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.296+0000 7fb9da000640 1 -- 172.21.15.99:0/3985058503 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9dc004020 con 0x7fb9e418b230 2024-02-21T23:06:41.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.296+0000 7fb9da000640 1 -- 172.21.15.99:0/3985058503 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9dc0043f0 con 0x7fb9e418b230 2024-02-21T23:06:41.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.296+0000 7fb9e3200640 1 -- 172.21.15.99:0/3985058503 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9e41803f0 con 0x7fb9e418b230 2024-02-21T23:06:41.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.296+0000 7fb9e3200640 1 -- 172.21.15.99:0/3985058503 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9e41809b0 con 0x7fb9e418b230 2024-02-21T23:06:41.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.299+0000 7fb9da000640 1 -- 172.21.15.99:0/3985058503 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7fb9dc00ca00 con 0x7fb9e418b230 2024-02-21T23:06:41.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.301+0000 7fb9da000640 1 --2- 172.21.15.99:0/3985058503 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fb9c009eed0 0x7fb9c00a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:41.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.302+0000 7fb9da000640 1 -- 172.21.15.99:0/3985058503 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7fb9dc0c9ff0 con 0x7fb9e418b230 2024-02-21T23:06:41.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.302+0000 7fb9e1e00640 1 --2- 172.21.15.99:0/3985058503 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fb9c009eed0 0x7fb9c00a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:41.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.302+0000 7fb9ec059740 1 Processor -- start 2024-02-21T23:06:41.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.302+0000 7fb9ec059740 1 -- start start 2024-02-21T23:06:41.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.303+0000 7fb9e1e00640 1 --2- 172.21.15.99:0/3985058503 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fb9c009eed0 0x7fb9c00a1390 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb9d40011e0 tx=0x7fb9d4007d30 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:41.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.304+0000 7fb9ec059740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5599cbc0b660 0x5599cbc0ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:41.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.304+0000 7fb9ec059740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5599cbc46330 0x5599cbc467b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:41.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.304+0000 7fb9ec059740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599cbc46cf0 0x5599cbc47560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:41.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.304+0000 7fb9ec059740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599cbb33b50 con 0x5599cbc46330 2024-02-21T23:06:41.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.304+0000 7fb9ec059740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599cbadcda0 con 0x5599cbc46cf0 2024-02-21T23:06:41.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.304+0000 7fb9ec059740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599cbb2fbf0 con 0x5599cbc0b660 2024-02-21T23:06:41.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.305+0000 7fb9e1e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5599cbc0b660 0x5599cbc0ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:41.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.305+0000 7fb9e1400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5599cbc46330 0x5599cbc467b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:41.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.305+0000 7fb9e1e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5599cbc0b660 0x5599cbc0ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:45556/0 (socket says 172.21.15.99:45556) 2024-02-21T23:06:41.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.305+0000 7fb9e1e00640 1 -- 172.21.15.99:0/3634728028 learned_addr learned my addr 172.21.15.99:0/3634728028 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:06:41.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.305+0000 7fb9e1400640 1 -- 172.21.15.99:0/3634728028 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5599cbc0b660 msgr2=0x5599cbc0ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:41.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.305+0000 7fb9e1400640 1 --2- 172.21.15.99:0/3634728028 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5599cbc0b660 0x5599cbc0ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:41.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.305+0000 7fb9e1400640 1 -- 172.21.15.99:0/3634728028 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599cbc46cf0 msgr2=0x5599cbc47560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:41.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.305+0000 7fb9e2800640 1 --2- 172.21.15.99:0/3634728028 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599cbc46cf0 0x5599cbc47560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:41.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.305+0000 7fb9e1400640 1 --2- 172.21.15.99:0/3634728028 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599cbc46cf0 0x5599cbc47560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:41.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.306+0000 7fb9e1400640 1 -- 172.21.15.99:0/3634728028 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5599cbafff80 con 0x5599cbc46330 2024-02-21T23:06:41.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.306+0000 7fb9e1e00640 1 --2- 172.21.15.99:0/3634728028 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5599cbc0b660 0x5599cbc0ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:06:41.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.306+0000 7fb9e2800640 1 --2- 172.21.15.99:0/3634728028 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599cbc46cf0 0x5599cbc47560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T23:06:41.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.306+0000 7fb9e1400640 1 --2- 172.21.15.99:0/3634728028 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5599cbc46330 0x5599cbc467b0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fb9e4160a80 tx=0x7fb9cc02e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8af15513a84dec33 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:41.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.306+0000 7fb9d2a00640 1 -- 172.21.15.99:0/3634728028 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc045070 con 0x5599cbc46330 2024-02-21T23:06:41.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.306+0000 7fb9d2a00640 1 -- 172.21.15.99:0/3634728028 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9cc03a040 con 0x5599cbc46330 2024-02-21T23:06:41.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.306+0000 7fb9d2a00640 1 -- 172.21.15.99:0/3634728028 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc039040 con 0x5599cbc46330 2024-02-21T23:06:41.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.307+0000 7fb9ec059740 1 -- 172.21.15.99:0/3634728028 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5599cbc46330 msgr2=0x5599cbc467b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:41.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.307+0000 7fb9ec059740 1 --2- 172.21.15.99:0/3634728028 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5599cbc46330 0x5599cbc467b0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fb9e4160a80 tx=0x7fb9cc02e000 comp rx=0 tx=0).stop 2024-02-21T23:06:41.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.307+0000 7fb9ec059740 1 -- 172.21.15.99:0/3634728028 shutdown_connections 2024-02-21T23:06:41.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.307+0000 7fb9ec059740 1 --2- 172.21.15.99:0/3634728028 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599cbc46cf0 0x5599cbc47560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:41.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.307+0000 7fb9ec059740 1 --2- 172.21.15.99:0/3634728028 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5599cbc46330 0x5599cbc467b0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:41.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.307+0000 7fb9ec059740 1 --2- 172.21.15.99:0/3634728028 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5599cbc0b660 0x5599cbc0ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:41.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.307+0000 7fb9ec059740 1 -- 172.21.15.99:0/3634728028 >> 172.21.15.99:0/3634728028 conn(0x5599cbbcd6d0 msgr2=0x5599cbbce750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:06:41.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.307+0000 7fb9ec059740 1 -- 172.21.15.99:0/3634728028 shutdown_connections 2024-02-21T23:06:41.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.307+0000 7fb9ec059740 1 -- 172.21.15.99:0/3634728028 wait complete. 2024-02-21T23:06:41.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.308+0000 7fb9ec059740 1 -- start start 2024-02-21T23:06:41.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.309+0000 7fb9ec059740 1 Processor -- start 2024-02-21T23:06:41.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.311+0000 7fb9ec059740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5599cbc46330 0x5599cbbcb870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:41.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.311+0000 7fb9ec059740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5599cbc46cf0 0x5599cbbfa2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:41.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.311+0000 7fb9ec059740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599cbc43a10 0x5599cbc44140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:41.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.311+0000 7fb9ec059740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599cbc450a0 con 0x5599cbc46330 2024-02-21T23:06:41.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.311+0000 7fb9ec059740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599cbad2380 con 0x5599cbc43a10 2024-02-21T23:06:41.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.311+0000 7fb9ec059740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599cbc44dc0 con 0x5599cbc46cf0 2024-02-21T23:06:41.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.311+0000 7fb9ec059740 10 client.0 _ll_register_callbacks cb 0x5599cbb2b280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:06:41.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.311+0000 7fb9e1e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5599cbc46330 0x5599cbbcb870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:41.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.311+0000 7fb9e1400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5599cbc46cf0 0x5599cbbfa2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:41.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.311+0000 7fb9e1e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5599cbc46330 0x5599cbbcb870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45768/0 (socket says 172.21.15.99:45768) 2024-02-21T23:06:41.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.311+0000 7fb9e1e00640 1 -- 172.21.15.99:0/195577154 learned_addr learned my addr 172.21.15.99:0/195577154 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:06:41.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.311+0000 7fb9e2800640 1 --2- 172.21.15.99:0/195577154 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599cbc43a10 0x5599cbc44140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:41.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.312+0000 7fb9e2800640 1 -- 172.21.15.99:0/195577154 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5599cbc46cf0 msgr2=0x5599cbbfa2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:41.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.312+0000 7fb9e2800640 1 --2- 172.21.15.99:0/195577154 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5599cbc46cf0 0x5599cbbfa2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:41.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.312+0000 7fb9e2800640 1 -- 172.21.15.99:0/195577154 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5599cbc46330 msgr2=0x5599cbbcb870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:41.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.312+0000 7fb9e2800640 1 --2- 172.21.15.99:0/195577154 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5599cbc46330 0x5599cbbcb870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:41.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.312+0000 7fb9e2800640 1 -- 172.21.15.99:0/195577154 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5599cbafac20 con 0x5599cbc43a10 2024-02-21T23:06:41.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.312+0000 7fb9e1e00640 1 --2- 172.21.15.99:0/195577154 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5599cbc46330 0x5599cbbcb870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:06:41.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.312+0000 7fb9e1400640 1 --2- 172.21.15.99:0/195577154 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5599cbc46cf0 0x5599cbbfa2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:06:41.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.312+0000 7fb9e2800640 1 --2- 172.21.15.99:0/195577154 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599cbc43a10 0x5599cbc44140 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc0c76d0 tx=0x7fb9dc097960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e610f901306e917 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:41.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.312+0000 7fb9cb400640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-02-21T23:06:41.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.312+0000 7fb9cb400640 1 -- 172.21.15.99:0/195577154 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9dc020070 con 0x5599cbc43a10 2024-02-21T23:06:41.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.312+0000 7fb9ec059740 1 -- 172.21.15.99:0/195577154 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb9cc03a040 con 0x5599cbc43a10 2024-02-21T23:06:41.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.312+0000 7fb9cb400640 1 -- 172.21.15.99:0/195577154 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7fb9dc098de0 con 0x5599cbc43a10 2024-02-21T23:06:41.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.313+0000 7fb9cb400640 1 -- 172.21.15.99:0/195577154 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb9dc0c3020 con 0x5599cbc43a10 2024-02-21T23:06:41.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.313+0000 7fb9ec059740 10 client.6121 fetch_fsmap learned FSMap version 16 2024-02-21T23:06:41.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.313+0000 7fb9ec059740 1 -- 172.21.15.99:0/195577154 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x5599cb8483f0 con 0x5599cbc43a10 2024-02-21T23:06:41.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.313+0000 7fb9cb400640 1 -- 172.21.15.99:0/195577154 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9cc03a040 con 0x5599cbc43a10 2024-02-21T23:06:41.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.313+0000 7fb9cb400640 1 -- 172.21.15.99:0/195577154 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fb9dc096db0 con 0x5599cbc43a10 2024-02-21T23:06:41.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.313+0000 7fb9ec059740 10 client.6121 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T23:06:41.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.313+0000 7fb9ec059740 10 client.6121 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:06:41.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.313+0000 7fb9ec059740 20 client.6121 populate_metadata read hostname 'smithi099' 2024-02-21T23:06:41.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.313+0000 7fb9ec059740 1 --2- 172.21.15.99:0/195577154 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5599cbbffc00 0x5599cbc00010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:41.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.313+0000 7fb9ec059740 4 client.6121 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:06:41.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.313+0000 7fb9ec059740 1 -- 172.21.15.99:0/195577154 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5599cbb41090 con 0x5599cbbffc00 2024-02-21T23:06:41.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.314+0000 7fb9e1e00640 1 --2- 172.21.15.99:0/195577154 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5599cbbffc00 0x5599cbc00010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:41.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.314+0000 7fb9e1e00640 1 --2- 172.21.15.99:0/195577154 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5599cbbffc00 0x5599cbc00010 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea744022c26ff419 server_cookie=209496c3741a0215 in_seq=0 out_seq=0 2024-02-21T23:06:41.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.314+0000 7fb9cb400640 10 client.6121 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:06:41.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.315+0000 7fb9cb400640 1 -- 172.21.15.99:0/195577154 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x5599cbb41090 con 0x5599cbbffc00 2024-02-21T23:06:41.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.315+0000 7fb9cb400640 10 client.6121 handle_command_reply: tid=0 2024-02-21T23:06:41.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.315+0000 7fb9ec059740 1 client.6121 shutdown 2024-02-21T23:06:41.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.315+0000 7fb9ec059740 1 -- 172.21.15.99:0/195577154 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599cbc43a10 msgr2=0x5599cbc44140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:41.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.315+0000 7fb9ec059740 1 --2- 172.21.15.99:0/195577154 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599cbc43a10 0x5599cbc44140 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc0c76d0 tx=0x7fb9dc097960 comp rx=0 tx=0).stop 2024-02-21T23:06:41.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.316+0000 7fb9ec059740 1 -- 172.21.15.99:0/195577154 shutdown_connections 2024-02-21T23:06:41.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.316+0000 7fb9ec059740 1 --2- 172.21.15.99:0/195577154 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5599cbbffc00 0x5599cbc00010 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:41.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.316+0000 7fb9ec059740 1 --2- 172.21.15.99:0/195577154 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599cbc43a10 0x5599cbc44140 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:41.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.316+0000 7fb9ec059740 1 --2- 172.21.15.99:0/195577154 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5599cbc46cf0 0x5599cbbfa2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:41.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.316+0000 7fb9ec059740 1 --2- 172.21.15.99:0/195577154 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5599cbc46330 0x5599cbbcb870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:41.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.316+0000 7fb9cb400640 0 client.6121 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:06:41.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.316+0000 7fb9ec059740 1 -- 172.21.15.99:0/195577154 >> 172.21.15.99:0/195577154 conn(0x5599cbc0b660 msgr2=0x5599cbc01900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:06:41.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.316+0000 7fb9ec059740 1 -- 172.21.15.99:0/195577154 shutdown_connections 2024-02-21T23:06:41.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.316+0000 7fb9ec059740 1 -- 172.21.15.99:0/195577154 wait complete. 2024-02-21T23:06:41.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.316+0000 7fb9ec059740 20 client.6121 trim_cache size 0 max 16384 2024-02-21T23:06:41.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.329+0000 7fb9ec059740 1 Processor -- start 2024-02-21T23:06:41.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.330+0000 7fb9ec059740 1 -- start start 2024-02-21T23:06:41.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.331+0000 7fb9ec059740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599cbc43a10 0x5599cbc00010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:41.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.331+0000 7fb9ec059740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5599cbc46330 0x5599cbbc56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:41.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.331+0000 7fb9ec059740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5599cbc46cf0 0x5599cbc16200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:41.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.331+0000 7fb9ec059740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e422c540 con 0x5599cbc46330 2024-02-21T23:06:41.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.331+0000 7fb9ec059740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e422a0e0 con 0x5599cbc43a10 2024-02-21T23:06:41.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.331+0000 7fb9ec059740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e4185e60 con 0x5599cbc46cf0 2024-02-21T23:06:41.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.331+0000 7fb9e1400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5599cbc46330 0x5599cbbc56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:41.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.331+0000 7fb9e1400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5599cbc46330 0x5599cbbc56c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45770/0 (socket says 172.21.15.99:45770) 2024-02-21T23:06:41.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.331+0000 7fb9e1400640 1 -- 172.21.15.99:0/1524374113 learned_addr learned my addr 172.21.15.99:0/1524374113 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:06:41.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.331+0000 7fb9e1e00640 1 --2- 172.21.15.99:0/1524374113 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599cbc43a10 0x5599cbc00010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:41.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.331+0000 7fb9e2800640 1 --2- 172.21.15.99:0/1524374113 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5599cbc46cf0 0x5599cbc16200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:41.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.332+0000 7fb9e1e00640 1 -- 172.21.15.99:0/1524374113 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5599cbc46cf0 msgr2=0x5599cbc16200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:41.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.332+0000 7fb9e1e00640 1 --2- 172.21.15.99:0/1524374113 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5599cbc46cf0 0x5599cbc16200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:41.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.332+0000 7fb9e1e00640 1 -- 172.21.15.99:0/1524374113 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5599cbc46330 msgr2=0x5599cbbc56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:41.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.332+0000 7fb9e1e00640 1 --2- 172.21.15.99:0/1524374113 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5599cbc46330 0x5599cbbc56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:41.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.332+0000 7fb9e1e00640 1 -- 172.21.15.99:0/1524374113 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5599cb9127d0 con 0x5599cbc43a10 2024-02-21T23:06:41.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.332+0000 7fb9e2800640 1 --2- 172.21.15.99:0/1524374113 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5599cbc46cf0 0x5599cbc16200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:06:41.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.332+0000 7fb9e1400640 1 --2- 172.21.15.99:0/1524374113 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5599cbc46330 0x5599cbbc56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:06:41.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.332+0000 7fb9e1e00640 1 --2- 172.21.15.99:0/1524374113 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599cbc43a10 0x5599cbc00010 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x5599cbc507f0 tx=0x7fb9d400a000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7dba2b749c0f3808 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:41.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.332+0000 7fb9d2000640 1 -- 172.21.15.99:0/1524374113 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d402a2d0 con 0x5599cbc43a10 2024-02-21T23:06:41.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.332+0000 7fb9d2000640 1 -- 172.21.15.99:0/1524374113 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9d401b040 con 0x5599cbc43a10 2024-02-21T23:06:41.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.332+0000 7fb9d2000640 1 -- 172.21.15.99:0/1524374113 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d4016110 con 0x5599cbc43a10 2024-02-21T23:06:41.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.333+0000 7fb9ec059740 1 -- 172.21.15.99:0/1524374113 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599cbc43a10 msgr2=0x5599cbc00010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:41.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.333+0000 7fb9ec059740 1 --2- 172.21.15.99:0/1524374113 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599cbc43a10 0x5599cbc00010 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x5599cbc507f0 tx=0x7fb9d400a000 comp rx=0 tx=0).stop 2024-02-21T23:06:41.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.333+0000 7fb9ec059740 1 -- 172.21.15.99:0/1524374113 shutdown_connections 2024-02-21T23:06:41.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.333+0000 7fb9ec059740 1 --2- 172.21.15.99:0/1524374113 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5599cbc46cf0 0x5599cbc16200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:41.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.333+0000 7fb9ec059740 1 --2- 172.21.15.99:0/1524374113 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5599cbc46330 0x5599cbbc56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:41.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.333+0000 7fb9ec059740 1 --2- 172.21.15.99:0/1524374113 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599cbc43a10 0x5599cbc00010 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:41.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.333+0000 7fb9ec059740 1 -- 172.21.15.99:0/1524374113 >> 172.21.15.99:0/1524374113 conn(0x5599cbc0b660 msgr2=0x5599cbc139b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:06:41.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.333+0000 7fb9ec059740 1 -- 172.21.15.99:0/1524374113 shutdown_connections 2024-02-21T23:06:41.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.333+0000 7fb9ec059740 1 -- 172.21.15.99:0/1524374113 wait complete. 2024-02-21T23:06:41.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.334+0000 7fb9ec059740 1 -- start start 2024-02-21T23:06:41.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.334+0000 7fb9ec059740 1 Processor -- start 2024-02-21T23:06:41.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.336+0000 7fb9ec059740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599cbc43a10 0x5599cbc4d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:41.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.336+0000 7fb9ec059740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5599cbc46330 0x5599cbc18f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:41.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.336+0000 7fb9ec059740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5599cbc46cf0 0x5599cbbd3400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:41.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.336+0000 7fb9ec059740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e4228800 con 0x5599cbc46330 2024-02-21T23:06:41.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.336+0000 7fb9ec059740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e4229a80 con 0x5599cbc43a10 2024-02-21T23:06:41.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.336+0000 7fb9ec059740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e4228e00 con 0x5599cbc46cf0 2024-02-21T23:06:41.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.336+0000 7fb9ec059740 10 client.0 _ll_register_callbacks cb 0x7fb9dc009400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:06:41.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.337+0000 7fb9e1400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5599cbc46330 0x5599cbc18f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:41.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.337+0000 7fb9e1400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5599cbc46330 0x5599cbc18f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45784/0 (socket says 172.21.15.99:45784) 2024-02-21T23:06:41.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.337+0000 7fb9e1400640 1 -- 172.21.15.99:0/1046843408 learned_addr learned my addr 172.21.15.99:0/1046843408 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:06:41.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.337+0000 7fb9e1e00640 1 --2- 172.21.15.99:0/1046843408 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599cbc43a10 0x5599cbc4d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:41.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.337+0000 7fb9e2800640 1 --2- 172.21.15.99:0/1046843408 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5599cbc46cf0 0x5599cbbd3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:41.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.337+0000 7fb9e1e00640 1 -- 172.21.15.99:0/1046843408 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5599cbc46cf0 msgr2=0x5599cbbd3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:41.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.337+0000 7fb9e1e00640 1 --2- 172.21.15.99:0/1046843408 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5599cbc46cf0 0x5599cbbd3400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:41.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.337+0000 7fb9e1e00640 1 -- 172.21.15.99:0/1046843408 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5599cbc46330 msgr2=0x5599cbc18f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:41.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.337+0000 7fb9e1e00640 1 --2- 172.21.15.99:0/1046843408 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5599cbc46330 0x5599cbc18f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:41.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.337+0000 7fb9e1e00640 1 -- 172.21.15.99:0/1046843408 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5599cbc9f550 con 0x5599cbc43a10 2024-02-21T23:06:41.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.337+0000 7fb9e1e00640 1 --2- 172.21.15.99:0/1046843408 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599cbc43a10 0x5599cbc4d300 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fb9d4014600 tx=0x7fb9d4000ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34ca2d7c37b894f0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:41.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.337+0000 7fb9cb400640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-02-21T23:06:41.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.338+0000 7fb9cb400640 1 -- 172.21.15.99:0/1046843408 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d402a2d0 con 0x5599cbc43a10 2024-02-21T23:06:41.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.338+0000 7fb9ec059740 1 -- 172.21.15.99:0/1046843408 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb9d401b040 con 0x5599cbc43a10 2024-02-21T23:06:41.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.338+0000 7fb9cb400640 1 -- 172.21.15.99:0/1046843408 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7fb9d4029040 con 0x5599cbc43a10 2024-02-21T23:06:41.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.338+0000 7fb9cb400640 1 -- 172.21.15.99:0/1046843408 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb9d403b050 con 0x5599cbc43a10 2024-02-21T23:06:41.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.338+0000 7fb9ec059740 10 client.6127 fetch_fsmap learned FSMap version 16 2024-02-21T23:06:41.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.338+0000 7fb9ec059740 1 -- 172.21.15.99:0/1046843408 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x5599cbc19890 con 0x5599cbc43a10 2024-02-21T23:06:41.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.338+0000 7fb9cb400640 1 -- 172.21.15.99:0/1046843408 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9d401b040 con 0x5599cbc43a10 2024-02-21T23:06:41.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.338+0000 7fb9cb400640 1 -- 172.21.15.99:0/1046843408 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fb9d4020040 con 0x5599cbc43a10 2024-02-21T23:06:41.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.339+0000 7fb9ec059740 10 client.6127 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T23:06:41.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.339+0000 7fb9ec059740 10 client.6127 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:06:41.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.339+0000 7fb9ec059740 20 client.6127 populate_metadata read hostname 'smithi099' 2024-02-21T23:06:41.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.339+0000 7fb9ec059740 1 --2- 172.21.15.99:0/1046843408 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5599cbc16960 0x5599cbc9e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:41.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.339+0000 7fb9ec059740 4 client.6127 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T23:06:41.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.339+0000 7fb9ec059740 1 -- 172.21.15.99:0/1046843408 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5599cbb3b3e0 con 0x5599cbc16960 2024-02-21T23:06:41.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.339+0000 7fb9e1400640 1 --2- 172.21.15.99:0/1046843408 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5599cbc16960 0x5599cbc9e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:41.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.339+0000 7fb9e1400640 1 --2- 172.21.15.99:0/1046843408 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5599cbc16960 0x5599cbc9e8b0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6359804184824596 server_cookie=91f9ada0f607f4d1 in_seq=0 out_seq=0 2024-02-21T23:06:41.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.339+0000 7fb9cb400640 10 client.6127 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:06:41.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.340+0000 7fb9cb400640 1 -- 172.21.15.99:0/1046843408 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5599cbb3b3e0 con 0x5599cbc16960 2024-02-21T23:06:41.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.340+0000 7fb9cb400640 10 client.6127 handle_command_reply: tid=0 2024-02-21T23:06:41.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.340+0000 7fb9ec059740 1 client.6127 shutdown 2024-02-21T23:06:41.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.340+0000 7fb9ec059740 1 -- 172.21.15.99:0/1046843408 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599cbc43a10 msgr2=0x5599cbc4d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:41.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.340+0000 7fb9ec059740 1 --2- 172.21.15.99:0/1046843408 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599cbc43a10 0x5599cbc4d300 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fb9d4014600 tx=0x7fb9d4000ed0 comp rx=0 tx=0).stop 2024-02-21T23:06:41.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.340+0000 7fb9ec059740 1 -- 172.21.15.99:0/1046843408 shutdown_connections 2024-02-21T23:06:41.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.340+0000 7fb9ec059740 1 --2- 172.21.15.99:0/1046843408 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5599cbc16960 0x5599cbc9e8b0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:41.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.340+0000 7fb9ec059740 1 --2- 172.21.15.99:0/1046843408 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5599cbc46cf0 0x5599cbbd3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:41.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.340+0000 7fb9ec059740 1 --2- 172.21.15.99:0/1046843408 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5599cbc46330 0x5599cbc18f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:41.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.340+0000 7fb9ec059740 1 --2- 172.21.15.99:0/1046843408 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599cbc43a10 0x5599cbc4d300 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:41.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.340+0000 7fb9cb400640 0 client.6127 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:06:41.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.340+0000 7fb9ec059740 1 -- 172.21.15.99:0/1046843408 >> 172.21.15.99:0/1046843408 conn(0x5599cbc0b660 msgr2=0x5599cbc139b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:06:41.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.340+0000 7fb9ec059740 1 -- 172.21.15.99:0/1046843408 shutdown_connections 2024-02-21T23:06:41.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.340+0000 7fb9ec059740 1 -- 172.21.15.99:0/1046843408 wait complete. 2024-02-21T23:06:41.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.340+0000 7fb9ec059740 20 client.6127 trim_cache size 0 max 16384 2024-02-21T23:06:41.339 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-02-21T23:06:41.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.341+0000 7fb9e3200640 1 -- 172.21.15.99:0/3985058503 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fb9c009eed0 msgr2=0x7fb9c00a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:41.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.341+0000 7fb9e3200640 1 --2- 172.21.15.99:0/3985058503 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fb9c009eed0 0x7fb9c00a1390 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb9d40011e0 tx=0x7fb9d4007d30 comp rx=0 tx=0).stop 2024-02-21T23:06:41.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.341+0000 7fb9e3200640 1 -- 172.21.15.99:0/3985058503 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb9e418b230 msgr2=0x7fb9e4220010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:41.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.341+0000 7fb9e3200640 1 --2- 172.21.15.99:0/3985058503 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb9e418b230 0x7fb9e4220010 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc00e960 tx=0x7fb9dc00ee20 comp rx=0 tx=0).stop 2024-02-21T23:06:41.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.342+0000 7fb9e3200640 1 -- 172.21.15.99:0/3985058503 shutdown_connections 2024-02-21T23:06:41.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.342+0000 7fb9e3200640 1 --2- 172.21.15.99:0/3985058503 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fb9c009eed0 0x7fb9c00a1390 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:41.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.342+0000 7fb9e3200640 1 --2- 172.21.15.99:0/3985058503 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb9e418b230 0x7fb9e4220010 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:41.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.342+0000 7fb9e3200640 1 --2- 172.21.15.99:0/3985058503 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb9e417f490 0x7fb9e417f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:41.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.342+0000 7fb9e3200640 1 --2- 172.21.15.99:0/3985058503 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb9e40fc7c0 0x7fb9e4159770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:41.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.342+0000 7fb9e3200640 1 -- 172.21.15.99:0/3985058503 >> 172.21.15.99:0/3985058503 conn(0x7fb9e40d29b0 msgr2=0x7fb9e4068e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:06:41.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.342+0000 7fb9e3200640 1 -- 172.21.15.99:0/3985058503 shutdown_connections 2024-02-21T23:06:41.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:41.342+0000 7fb9e3200640 1 -- 172.21.15.99:0/3985058503 wait complete. 2024-02-21T23:06:42.350 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-02-21T23:06:42.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T23:06:42.351 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-02-21T23:06:42.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.572+0000 7f3cf7600640 1 Processor -- start 2024-02-21T23:06:42.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.572+0000 7f3cf7600640 1 -- start start 2024-02-21T23:06:42.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.574+0000 7f3cf7600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f3cf0186a50 0x7f3cf00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:42.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.575+0000 7f3cf7600640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cf0071740 con 0x7f3cf0070f20 2024-02-21T23:06:42.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.575+0000 7f3cf7600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cf0071a20 con 0x7f3cf0187540 2024-02-21T23:06:42.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.575+0000 7f3cf7600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cf0071d00 con 0x7f3cf0186a50 2024-02-21T23:06:42.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.575+0000 7f3cefe00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f3cf0070f20 0x7f3cf0186e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:50550/0 (socket says 172.21.15.99:50550) 2024-02-21T23:06:42.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.575+0000 7f3cefe00640 1 -- 172.21.15.99:0/1083798350 learned_addr learned my addr 172.21.15.99:0/1083798350 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:06:42.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.575+0000 7f3cf4c00640 1 --2- 172.21.15.99:0/1083798350 >> v2:172.21.15.99:3300/0 conn(0x7f3cf0186a50 0x7f3cf00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:42.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.575+0000 7f3cf4c00640 1 -- 172.21.15.99:0/1083798350 >> v1:172.21.15.162:6789/0 conn(0x7f3cf0187540 legacy=0x7f3cf00f7620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:42.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.575+0000 7f3cf4c00640 1 -- 172.21.15.99:0/1083798350 >> v1:172.21.15.99:6789/0 conn(0x7f3cf0070f20 legacy=0x7f3cf0186e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:42.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.575+0000 7f3cf4c00640 1 -- 172.21.15.99:0/1083798350 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cf00f6e20 con 0x7f3cf0186a50 2024-02-21T23:06:42.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.577+0000 7f3cf4c00640 1 --2- 172.21.15.99:0/1083798350 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3cf0186a50 0x7f3cf00709e0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f3ce40097a0 tx=0x7f3ce402b600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f4e93f0226cf1ea server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:42.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.578+0000 7f3cef400640 1 -- 172.21.15.99:0/1083798350 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce4037070 con 0x7f3cf0186a50 2024-02-21T23:06:42.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.578+0000 7f3cef400640 1 -- 172.21.15.99:0/1083798350 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ce4030510 con 0x7f3cf0186a50 2024-02-21T23:06:42.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.578+0000 7f3cef400640 1 -- 172.21.15.99:0/1083798350 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce40308e0 con 0x7f3cf0186a50 2024-02-21T23:06:42.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.579+0000 7f3cf7600640 1 -- 172.21.15.99:0/1083798350 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3cf0186a50 msgr2=0x7f3cf00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:42.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.579+0000 7f3cf7600640 1 --2- 172.21.15.99:0/1083798350 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3cf0186a50 0x7f3cf00709e0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f3ce40097a0 tx=0x7f3ce402b600 comp rx=0 tx=0).stop 2024-02-21T23:06:42.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.579+0000 7f3cf7600640 1 -- 172.21.15.99:0/1083798350 shutdown_connections 2024-02-21T23:06:42.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.579+0000 7f3cf7600640 1 --2- 172.21.15.99:0/1083798350 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3cf0186a50 0x7f3cf00709e0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:42.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.579+0000 7f3cf7600640 1 -- 172.21.15.99:0/1083798350 >> 172.21.15.99:0/1083798350 conn(0x7f3cf00f8d80 msgr2=0x7f3cf00f9190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:06:42.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.579+0000 7f3cf7600640 1 -- 172.21.15.99:0/1083798350 shutdown_connections 2024-02-21T23:06:42.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.579+0000 7f3cf7600640 1 -- 172.21.15.99:0/1083798350 wait complete. 2024-02-21T23:06:42.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.582+0000 7f3cf7600640 1 Processor -- start 2024-02-21T23:06:42.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.582+0000 7f3cf7600640 1 -- start start 2024-02-21T23:06:42.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.584+0000 7f3cf7600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3cf0070f20 0x7f3cf0172d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:42.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.584+0000 7f3cf7600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3cf0186a50 0x7f3cf00fb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:42.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.584+0000 7f3cf7600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3cf0187540 0x7f3cf00fba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:42.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.584+0000 7f3cf7600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf0071380 con 0x7f3cf0070f20 2024-02-21T23:06:42.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.584+0000 7f3cf7600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf00704b0 con 0x7f3cf0186a50 2024-02-21T23:06:42.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.584+0000 7f3cf7600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf0071500 con 0x7f3cf0187540 2024-02-21T23:06:42.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.585+0000 7f3cf4c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3cf0070f20 0x7f3cf0172d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:42.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.585+0000 7f3cf4c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3cf0070f20 0x7f3cf0172d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45802/0 (socket says 172.21.15.99:45802) 2024-02-21T23:06:42.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.585+0000 7f3cf4c00640 1 -- 172.21.15.99:0/1338582831 learned_addr learned my addr 172.21.15.99:0/1338582831 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:06:42.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.585+0000 7f3cf5600640 1 --2- 172.21.15.99:0/1338582831 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3cf0187540 0x7f3cf00fba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:42.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.585+0000 7f3cefe00640 1 --2- 172.21.15.99:0/1338582831 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3cf0186a50 0x7f3cf00fb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:42.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.585+0000 7f3cf4c00640 1 -- 172.21.15.99:0/1338582831 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3cf0187540 msgr2=0x7f3cf00fba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:42.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.585+0000 7f3cf4c00640 1 --2- 172.21.15.99:0/1338582831 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3cf0187540 0x7f3cf00fba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:42.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.585+0000 7f3cf4c00640 1 -- 172.21.15.99:0/1338582831 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3cf0186a50 msgr2=0x7f3cf00fb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:42.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.585+0000 7f3cf4c00640 1 --2- 172.21.15.99:0/1338582831 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3cf0186a50 0x7f3cf00fb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:42.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.585+0000 7f3cf4c00640 1 -- 172.21.15.99:0/1338582831 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cf008cfd0 con 0x7f3cf0070f20 2024-02-21T23:06:42.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.585+0000 7f3cefe00640 1 --2- 172.21.15.99:0/1338582831 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3cf0186a50 0x7f3cf00fb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:06:42.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.585+0000 7f3cf4c00640 1 --2- 172.21.15.99:0/1338582831 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3cf0070f20 0x7f3cf0172d10 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f3ce4000c00 tx=0x7f3ce40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:42.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.586+0000 7f3cecc00640 1 -- 172.21.15.99:0/1338582831 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce4042070 con 0x7f3cf0070f20 2024-02-21T23:06:42.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.586+0000 7f3cecc00640 1 -- 172.21.15.99:0/1338582831 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ce403e870 con 0x7f3cf0070f20 2024-02-21T23:06:42.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.586+0000 7f3cf7600640 1 -- 172.21.15.99:0/1338582831 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cf008d2b0 con 0x7f3cf0070f20 2024-02-21T23:06:42.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.586+0000 7f3cecc00640 1 -- 172.21.15.99:0/1338582831 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce4037040 con 0x7f3cf0070f20 2024-02-21T23:06:42.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.586+0000 7f3cf7600640 1 -- 172.21.15.99:0/1338582831 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cf008d870 con 0x7f3cf0070f20 2024-02-21T23:06:42.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.589+0000 7f3cecc00640 1 -- 172.21.15.99:0/1338582831 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f3ce4045070 con 0x7f3cf0070f20 2024-02-21T23:06:42.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.590+0000 7f3cecc00640 1 --2- 172.21.15.99:0/1338582831 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f3cd009eed0 0x7f3cd00a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:42.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.591+0000 7f3cecc00640 1 -- 172.21.15.99:0/1338582831 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f3ce40ebd10 con 0x7f3cf0070f20 2024-02-21T23:06:42.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.591+0000 7f3cefe00640 1 --2- 172.21.15.99:0/1338582831 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f3cd009eed0 0x7f3cd00a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:42.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.592+0000 7f3cefe00640 1 --2- 172.21.15.99:0/1338582831 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f3cd009eed0 0x7f3cd00a1390 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc007fd0 tx=0x7f3cdc007dc0 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:42.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.592+0000 7f3cfa5d8740 1 Processor -- start 2024-02-21T23:06:42.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.592+0000 7f3cfa5d8740 1 -- start start 2024-02-21T23:06:42.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.594+0000 7f3cfa5d8740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579a43467c0 0x5579a4346ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:42.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.594+0000 7f3cfa5d8740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5579a43470e0 0x5579a4380b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:42.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.594+0000 7f3cfa5d8740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5579a43810a0 0x5579a434d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:42.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.594+0000 7f3cfa5d8740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579a426a790 con 0x5579a43470e0 2024-02-21T23:06:42.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.594+0000 7f3cfa5d8740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579a4213bf0 con 0x5579a43467c0 2024-02-21T23:06:42.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.594+0000 7f3cfa5d8740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579a4266830 con 0x5579a43810a0 2024-02-21T23:06:42.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.594+0000 7f3cefe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5579a43470e0 0x5579a4380b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:42.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.594+0000 7f3cf5600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5579a43810a0 0x5579a434d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:42.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.595+0000 7f3cf4c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579a43467c0 0x5579a4346ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:42.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.595+0000 7f3cefe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5579a43470e0 0x5579a4380b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:45818/0 (socket says 172.21.15.99:45818) 2024-02-21T23:06:42.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.595+0000 7f3cefe00640 1 -- 172.21.15.99:0/1037875777 learned_addr learned my addr 172.21.15.99:0/1037875777 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:06:42.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.595+0000 7f3cf5600640 1 -- 172.21.15.99:0/1037875777 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579a43467c0 msgr2=0x5579a4346ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:42.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.595+0000 7f3cf5600640 1 --2- 172.21.15.99:0/1037875777 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579a43467c0 0x5579a4346ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:42.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.595+0000 7f3cf5600640 1 -- 172.21.15.99:0/1037875777 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5579a43470e0 msgr2=0x5579a4380b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:42.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.595+0000 7f3cf5600640 1 --2- 172.21.15.99:0/1037875777 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5579a43470e0 0x5579a4380b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:42.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.595+0000 7f3cf5600640 1 -- 172.21.15.99:0/1037875777 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5579a4231c40 con 0x5579a43810a0 2024-02-21T23:06:42.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.595+0000 7f3cf5600640 1 --2- 172.21.15.99:0/1037875777 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5579a43810a0 0x5579a434d820 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f3ce80012e0 tx=0x7f3ce8001710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f07931bd879422b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:42.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.596+0000 7f3ce1200640 1 -- 172.21.15.99:0/1037875777 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce800fe50 con 0x5579a43810a0 2024-02-21T23:06:42.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.596+0000 7f3ce1200640 1 -- 172.21.15.99:0/1037875777 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ce8018070 con 0x5579a43810a0 2024-02-21T23:06:42.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.596+0000 7f3ce1200640 1 -- 172.21.15.99:0/1037875777 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce8003bb0 con 0x5579a43810a0 2024-02-21T23:06:42.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.596+0000 7f3cfa5d8740 1 -- 172.21.15.99:0/1037875777 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5579a43810a0 msgr2=0x5579a434d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:42.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.596+0000 7f3cfa5d8740 1 --2- 172.21.15.99:0/1037875777 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5579a43810a0 0x5579a434d820 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f3ce80012e0 tx=0x7f3ce8001710 comp rx=0 tx=0).stop 2024-02-21T23:06:42.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.596+0000 7f3cfa5d8740 1 -- 172.21.15.99:0/1037875777 shutdown_connections 2024-02-21T23:06:42.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.596+0000 7f3cfa5d8740 1 --2- 172.21.15.99:0/1037875777 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5579a43810a0 0x5579a434d820 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:42.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.596+0000 7f3cfa5d8740 1 --2- 172.21.15.99:0/1037875777 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5579a43470e0 0x5579a4380b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:42.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.596+0000 7f3cfa5d8740 1 --2- 172.21.15.99:0/1037875777 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579a43467c0 0x5579a4346ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:42.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.596+0000 7f3cfa5d8740 1 -- 172.21.15.99:0/1037875777 >> 172.21.15.99:0/1037875777 conn(0x5579a43048c0 msgr2=0x5579a4305940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:06:42.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.597+0000 7f3cfa5d8740 1 -- 172.21.15.99:0/1037875777 shutdown_connections 2024-02-21T23:06:42.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.597+0000 7f3cfa5d8740 1 -- 172.21.15.99:0/1037875777 wait complete. 2024-02-21T23:06:42.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.598+0000 7f3cfa5d8740 1 -- start start 2024-02-21T23:06:42.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.598+0000 7f3cfa5d8740 1 Processor -- start 2024-02-21T23:06:42.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.600+0000 7f3cfa5d8740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5579a43470e0 0x5579a4338b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:42.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.600+0000 7f3cfa5d8740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5579a43810a0 0x5579a438b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:42.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.600+0000 7f3cfa5d8740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579a43772d0 0x5579a432c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:42.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.600+0000 7f3cfa5d8740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579a4301280 con 0x5579a43810a0 2024-02-21T23:06:42.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.600+0000 7f3cfa5d8740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579a42091d0 con 0x5579a43772d0 2024-02-21T23:06:42.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.600+0000 7f3cfa5d8740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579a4301560 con 0x5579a43470e0 2024-02-21T23:06:42.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.601+0000 7f3cfa5d8740 10 client.0 _ll_register_callbacks cb 0x5579a3f7ec60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:06:42.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.601+0000 7f3cefe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5579a43810a0 0x5579a438b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:42.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.601+0000 7f3cf4c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5579a43470e0 0x5579a4338b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:42.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.601+0000 7f3cf4c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5579a43470e0 0x5579a4338b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:45610/0 (socket says 172.21.15.99:45610) 2024-02-21T23:06:42.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.601+0000 7f3cf4c00640 1 -- 172.21.15.99:0/2213104902 learned_addr learned my addr 172.21.15.99:0/2213104902 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:06:42.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.601+0000 7f3cf5600640 1 --2- 172.21.15.99:0/2213104902 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579a43772d0 0x5579a432c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:42.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.601+0000 7f3cf4c00640 1 -- 172.21.15.99:0/2213104902 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579a43772d0 msgr2=0x5579a432c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:42.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.601+0000 7f3cf4c00640 1 --2- 172.21.15.99:0/2213104902 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579a43772d0 0x5579a432c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:42.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.601+0000 7f3cf4c00640 1 -- 172.21.15.99:0/2213104902 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5579a43810a0 msgr2=0x5579a438b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:42.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.601+0000 7f3cf4c00640 1 --2- 172.21.15.99:0/2213104902 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5579a43810a0 0x5579a438b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:42.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.601+0000 7f3cf4c00640 1 -- 172.21.15.99:0/2213104902 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5579a40477e0 con 0x5579a43470e0 2024-02-21T23:06:42.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.602+0000 7f3cf4c00640 1 --2- 172.21.15.99:0/2213104902 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5579a43470e0 0x5579a4338b60 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f3ce40097a0 tx=0x7f3ce40b9180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f99e408922c8d66e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:42.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.602+0000 7f3cd5600640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-02-21T23:06:42.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.602+0000 7f3cd5600640 1 -- 172.21.15.99:0/2213104902 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce404c040 con 0x5579a43470e0 2024-02-21T23:06:42.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.602+0000 7f3cd5600640 1 -- 172.21.15.99:0/2213104902 <== mon.2 v2:172.21.15.181:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f3ce40c18d0 con 0x5579a43470e0 2024-02-21T23:06:42.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.602+0000 7f3cfa5d8740 1 -- 172.21.15.99:0/2213104902 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3ce8018070 con 0x5579a43470e0 2024-02-21T23:06:42.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.602+0000 7f3cd5600640 1 -- 172.21.15.99:0/2213104902 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3ce40b95c0 con 0x5579a43470e0 2024-02-21T23:06:42.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.602+0000 7f3cfa5d8740 10 client.6155 fetch_fsmap learned FSMap version 16 2024-02-21T23:06:42.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.602+0000 7f3cfa5d8740 1 -- 172.21.15.99:0/2213104902 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x5579a40a7f70 con 0x5579a43470e0 2024-02-21T23:06:42.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.602+0000 7f3cd5600640 1 -- 172.21.15.99:0/2213104902 <== mon.2 v2:172.21.15.181:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ce8018070 con 0x5579a43470e0 2024-02-21T23:06:42.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.603+0000 7f3cd5600640 1 -- 172.21.15.99:0/2213104902 <== mon.2 v2:172.21.15.181:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f3ce40b8a10 con 0x5579a43470e0 2024-02-21T23:06:42.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.603+0000 7f3cfa5d8740 10 client.6155 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T23:06:42.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.603+0000 7f3cfa5d8740 10 client.6155 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:06:42.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.603+0000 7f3cfa5d8740 20 client.6155 populate_metadata read hostname 'smithi099' 2024-02-21T23:06:42.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.603+0000 7f3cfa5d8740 1 --2- 172.21.15.99:0/2213104902 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5579a4300460 0x5579a4378200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:42.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.603+0000 7f3cfa5d8740 4 client.6155 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:06:42.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.603+0000 7f3cfa5d8740 1 -- 172.21.15.99:0/2213104902 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5579a4277cd0 con 0x5579a4300460 2024-02-21T23:06:42.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.603+0000 7f3cefe00640 1 --2- 172.21.15.99:0/2213104902 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5579a4300460 0x5579a4378200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:42.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.604+0000 7f3cefe00640 1 --2- 172.21.15.99:0/2213104902 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5579a4300460 0x5579a4378200 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ecf13aa8eec33508 server_cookie=3c32f0c077ecda31 in_seq=0 out_seq=0 2024-02-21T23:06:42.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.604+0000 7f3cd5600640 10 client.6155 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:06:42.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.604+0000 7f3cd5600640 1 -- 172.21.15.99:0/2213104902 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x5579a4277cd0 con 0x5579a4300460 2024-02-21T23:06:42.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.604+0000 7f3cd5600640 10 client.6155 handle_command_reply: tid=0 2024-02-21T23:06:42.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.604+0000 7f3cfa5d8740 1 client.6155 shutdown 2024-02-21T23:06:42.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.605+0000 7f3cfa5d8740 1 -- 172.21.15.99:0/2213104902 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5579a43470e0 msgr2=0x5579a4338b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:42.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.605+0000 7f3cfa5d8740 1 --2- 172.21.15.99:0/2213104902 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5579a43470e0 0x5579a4338b60 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f3ce40097a0 tx=0x7f3ce40b9180 comp rx=0 tx=0).stop 2024-02-21T23:06:42.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.605+0000 7f3cfa5d8740 1 -- 172.21.15.99:0/2213104902 shutdown_connections 2024-02-21T23:06:42.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.605+0000 7f3cfa5d8740 1 --2- 172.21.15.99:0/2213104902 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5579a4300460 0x5579a4378200 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:42.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.605+0000 7f3cfa5d8740 1 --2- 172.21.15.99:0/2213104902 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579a43772d0 0x5579a432c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:42.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.605+0000 7f3cfa5d8740 1 --2- 172.21.15.99:0/2213104902 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5579a43810a0 0x5579a438b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:42.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.605+0000 7f3cfa5d8740 1 --2- 172.21.15.99:0/2213104902 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5579a43470e0 0x5579a4338b60 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:42.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.605+0000 7f3cd5600640 0 client.6155 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:06:42.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.605+0000 7f3cfa5d8740 1 -- 172.21.15.99:0/2213104902 >> 172.21.15.99:0/2213104902 conn(0x5579a43467c0 msgr2=0x5579a4301a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:06:42.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.605+0000 7f3cfa5d8740 1 -- 172.21.15.99:0/2213104902 shutdown_connections 2024-02-21T23:06:42.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.605+0000 7f3cfa5d8740 1 -- 172.21.15.99:0/2213104902 wait complete. 2024-02-21T23:06:42.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.605+0000 7f3cfa5d8740 20 client.6155 trim_cache size 0 max 16384 2024-02-21T23:06:42.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.636+0000 7f3cfa5d8740 1 Processor -- start 2024-02-21T23:06:42.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.636+0000 7f3cfa5d8740 1 -- start start 2024-02-21T23:06:42.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.638+0000 7f3cfa5d8740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5579a43470e0 0x5579a4305900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:42.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.638+0000 7f3cfa5d8740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579a43772d0 0x5579a439b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:42.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.638+0000 7f3cfa5d8740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5579a43810a0 0x5579a4392830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:42.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.638+0000 7f3cfa5d8740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf0228850 con 0x5579a43810a0 2024-02-21T23:06:42.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.638+0000 7f3cfa5d8740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf02263f0 con 0x5579a43772d0 2024-02-21T23:06:42.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.638+0000 7f3cfa5d8740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf006cd10 con 0x5579a43470e0 2024-02-21T23:06:42.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.638+0000 7f3cf4c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5579a43470e0 0x5579a4305900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:42.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.638+0000 7f3cf5600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5579a43810a0 0x5579a4392830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:42.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.638+0000 7f3cf4c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5579a43470e0 0x5579a4305900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:45624/0 (socket says 172.21.15.99:45624) 2024-02-21T23:06:42.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.638+0000 7f3cefe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579a43772d0 0x5579a439b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:42.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.638+0000 7f3cf4c00640 1 -- 172.21.15.99:0/2133493883 learned_addr learned my addr 172.21.15.99:0/2133493883 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:06:42.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.638+0000 7f3cf4c00640 1 -- 172.21.15.99:0/2133493883 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579a43772d0 msgr2=0x5579a439b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:42.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.638+0000 7f3cf4c00640 1 --2- 172.21.15.99:0/2133493883 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579a43772d0 0x5579a439b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:42.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.638+0000 7f3cf4c00640 1 -- 172.21.15.99:0/2133493883 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5579a43810a0 msgr2=0x5579a4392830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:42.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.639+0000 7f3cf4c00640 1 --2- 172.21.15.99:0/2133493883 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5579a43810a0 0x5579a4392830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:42.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.639+0000 7f3cf4c00640 1 -- 172.21.15.99:0/2133493883 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5579a3f3f170 con 0x5579a43470e0 2024-02-21T23:06:42.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.639+0000 7f3cefe00640 1 --2- 172.21.15.99:0/2133493883 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579a43772d0 0x5579a439b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:06:42.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.639+0000 7f3cf5600640 1 --2- 172.21.15.99:0/2133493883 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5579a43810a0 0x5579a4392830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:06:42.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.639+0000 7f3cf4c00640 1 --2- 172.21.15.99:0/2133493883 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5579a43470e0 0x5579a4305900 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f3ce40b92c0 tx=0x7f3ce4049000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ea910dc00812d59 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:42.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.639+0000 7f3cd7e00640 1 -- 172.21.15.99:0/2133493883 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce404c070 con 0x5579a43470e0 2024-02-21T23:06:42.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.639+0000 7f3cd7e00640 1 -- 172.21.15.99:0/2133493883 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ce40bd710 con 0x5579a43470e0 2024-02-21T23:06:42.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.639+0000 7f3cd7e00640 1 -- 172.21.15.99:0/2133493883 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce40c1d60 con 0x5579a43470e0 2024-02-21T23:06:42.633 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:06:42.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.640+0000 7f3cfa5d8740 1 -- 172.21.15.99:0/2133493883 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5579a43470e0 msgr2=0x5579a4305900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:42.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.640+0000 7f3cfa5d8740 1 --2- 172.21.15.99:0/2133493883 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5579a43470e0 0x5579a4305900 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f3ce40b92c0 tx=0x7f3ce4049000 comp rx=0 tx=0).stop 2024-02-21T23:06:42.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.640+0000 7f3cfa5d8740 1 -- 172.21.15.99:0/2133493883 shutdown_connections 2024-02-21T23:06:42.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.640+0000 7f3cfa5d8740 1 --2- 172.21.15.99:0/2133493883 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5579a43810a0 0x5579a4392830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:42.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.640+0000 7f3cfa5d8740 1 --2- 172.21.15.99:0/2133493883 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579a43772d0 0x5579a439b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:42.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.640+0000 7f3cfa5d8740 1 --2- 172.21.15.99:0/2133493883 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5579a43470e0 0x5579a4305900 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:42.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.640+0000 7f3cfa5d8740 1 -- 172.21.15.99:0/2133493883 >> 172.21.15.99:0/2133493883 conn(0x5579a43467c0 msgr2=0x5579a432c460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:06:42.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.640+0000 7f3cfa5d8740 1 -- 172.21.15.99:0/2133493883 shutdown_connections 2024-02-21T23:06:42.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.640+0000 7f3cfa5d8740 1 -- 172.21.15.99:0/2133493883 wait complete. 2024-02-21T23:06:42.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.641+0000 7f3cfa5d8740 1 -- start start 2024-02-21T23:06:42.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.642+0000 7f3cfa5d8740 1 Processor -- start 2024-02-21T23:06:42.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.644+0000 7f3cfa5d8740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5579a43470e0 0x5579a43dfa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:42.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.644+0000 7f3cfa5d8740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579a43772d0 0x5579a436fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:42.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.644+0000 7f3cfa5d8740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5579a43810a0 0x5579a432bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:42.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.644+0000 7f3cfa5d8740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf0157bc0 con 0x5579a43810a0 2024-02-21T23:06:42.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.644+0000 7f3cfa5d8740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf0225d90 con 0x5579a43772d0 2024-02-21T23:06:42.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.644+0000 7f3cfa5d8740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf01581c0 con 0x5579a43470e0 2024-02-21T23:06:42.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.644+0000 7f3cfa5d8740 10 client.0 _ll_register_callbacks cb 0x7f3ce40b58b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:06:42.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.644+0000 7f3cf4c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5579a43470e0 0x5579a43dfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:42.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.644+0000 7f3cf5600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5579a43810a0 0x5579a432bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:42.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.644+0000 7f3cf4c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5579a43470e0 0x5579a43dfa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:45628/0 (socket says 172.21.15.99:45628) 2024-02-21T23:06:42.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.644+0000 7f3cf4c00640 1 -- 172.21.15.99:0/2763538756 learned_addr learned my addr 172.21.15.99:0/2763538756 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:06:42.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.644+0000 7f3cefe00640 1 --2- 172.21.15.99:0/2763538756 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579a43772d0 0x5579a436fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:42.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.645+0000 7f3cf4c00640 1 -- 172.21.15.99:0/2763538756 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579a43772d0 msgr2=0x5579a436fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:42.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.645+0000 7f3cf4c00640 1 --2- 172.21.15.99:0/2763538756 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579a43772d0 0x5579a436fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:42.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.645+0000 7f3cf4c00640 1 -- 172.21.15.99:0/2763538756 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5579a43810a0 msgr2=0x5579a432bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:42.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.645+0000 7f3cf4c00640 1 --2- 172.21.15.99:0/2763538756 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5579a43810a0 0x5579a432bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:42.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.645+0000 7f3cf4c00640 1 -- 172.21.15.99:0/2763538756 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5579a4306060 con 0x5579a43470e0 2024-02-21T23:06:42.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.645+0000 7f3cf4c00640 1 --2- 172.21.15.99:0/2763538756 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5579a43470e0 0x5579a43dfa70 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f3ce40b9550 tx=0x7f3ce403b000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bfe48f90ed8b84f0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:42.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.645+0000 7f3cd5600640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-02-21T23:06:42.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.645+0000 7f3cd5600640 1 -- 172.21.15.99:0/2763538756 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce404c040 con 0x5579a43470e0 2024-02-21T23:06:42.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.645+0000 7f3cd5600640 1 -- 172.21.15.99:0/2763538756 <== mon.2 v2:172.21.15.181:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f3ce40c18d0 con 0x5579a43470e0 2024-02-21T23:06:42.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.645+0000 7f3cfa5d8740 1 -- 172.21.15.99:0/2763538756 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3ce40bd710 con 0x5579a43470e0 2024-02-21T23:06:42.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.646+0000 7f3cd5600640 1 -- 172.21.15.99:0/2763538756 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3ce40c1d60 con 0x5579a43470e0 2024-02-21T23:06:42.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.646+0000 7f3cfa5d8740 10 client.6161 fetch_fsmap learned FSMap version 16 2024-02-21T23:06:42.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.646+0000 7f3cfa5d8740 1 -- 172.21.15.99:0/2763538756 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x5579a4306060 con 0x5579a43470e0 2024-02-21T23:06:42.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.646+0000 7f3cd5600640 1 -- 172.21.15.99:0/2763538756 <== mon.2 v2:172.21.15.181:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ce40bd710 con 0x5579a43470e0 2024-02-21T23:06:42.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.646+0000 7f3cd5600640 1 -- 172.21.15.99:0/2763538756 <== mon.2 v2:172.21.15.181:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f3ce40b5310 con 0x5579a43470e0 2024-02-21T23:06:42.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.646+0000 7f3cfa5d8740 10 client.6161 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T23:06:42.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.646+0000 7f3cfa5d8740 10 client.6161 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:06:42.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.646+0000 7f3cfa5d8740 20 client.6161 populate_metadata read hostname 'smithi099' 2024-02-21T23:06:42.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.646+0000 7f3cfa5d8740 1 --2- 172.21.15.99:0/2763538756 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5579a43e00b0 0x5579a4391f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:42.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.646+0000 7f3cfa5d8740 4 client.6161 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-02-21T23:06:42.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.646+0000 7f3cfa5d8740 1 -- 172.21.15.99:0/2763538756 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x5579a4272020 con 0x5579a43e00b0 2024-02-21T23:06:42.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.646+0000 7f3cefe00640 1 --2- 172.21.15.99:0/2763538756 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5579a43e00b0 0x5579a4391f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:42.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.647+0000 7f3cefe00640 1 --2- 172.21.15.99:0/2763538756 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5579a43e00b0 0x5579a4391f20 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=40802209b675fc01 server_cookie=58bf2cb2fb23e65f in_seq=0 out_seq=0 2024-02-21T23:06:42.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.647+0000 7f3cd5600640 10 client.6161 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:06:42.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.648+0000 7f3cd5600640 1 -- 172.21.15.99:0/2763538756 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5579a4272020 con 0x5579a43e00b0 2024-02-21T23:06:42.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.648+0000 7f3cd5600640 10 client.6161 handle_command_reply: tid=0 2024-02-21T23:06:42.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.648+0000 7f3cfa5d8740 1 client.6161 shutdown 2024-02-21T23:06:42.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.649+0000 7f3cfa5d8740 1 -- 172.21.15.99:0/2763538756 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5579a43470e0 msgr2=0x5579a43dfa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:42.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.649+0000 7f3cfa5d8740 1 --2- 172.21.15.99:0/2763538756 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5579a43470e0 0x5579a43dfa70 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f3ce40b9550 tx=0x7f3ce403b000 comp rx=0 tx=0).stop 2024-02-21T23:06:42.647 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:06:42.648 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-02-21T23:06:42.649 INFO:teuthology.orchestra.run.smithi099.stdout: "return_code": 0, 2024-02-21T23:06:42.649 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_tag": "97aa8b4f-2d60-4c72-be40-90f51d822a03", 2024-02-21T23:06:42.649 INFO:teuthology.orchestra.run.smithi099.stdout: "mode": "asynchronous" 2024-02-21T23:06:42.649 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-02-21T23:06:42.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.649+0000 7f3cfa5d8740 1 -- 172.21.15.99:0/2763538756 shutdown_connections 2024-02-21T23:06:42.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.649+0000 7f3cfa5d8740 1 --2- 172.21.15.99:0/2763538756 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5579a43e00b0 0x5579a4391f20 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:42.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.649+0000 7f3cfa5d8740 1 --2- 172.21.15.99:0/2763538756 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5579a43810a0 0x5579a432bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:42.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.649+0000 7f3cfa5d8740 1 --2- 172.21.15.99:0/2763538756 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5579a43772d0 0x5579a436fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:42.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.649+0000 7f3cfa5d8740 1 --2- 172.21.15.99:0/2763538756 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5579a43470e0 0x5579a43dfa70 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:42.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.649+0000 7f3cfa5d8740 1 -- 172.21.15.99:0/2763538756 >> 172.21.15.99:0/2763538756 conn(0x5579a43467c0 msgr2=0x5579a4338880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:06:42.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.649+0000 7f3cd5600640 0 client.6161 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:06:42.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.650+0000 7f3cfa5d8740 1 -- 172.21.15.99:0/2763538756 shutdown_connections 2024-02-21T23:06:42.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.651+0000 7f3cfa5d8740 1 -- 172.21.15.99:0/2763538756 wait complete. 2024-02-21T23:06:42.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.651+0000 7f3cfa5d8740 20 client.6161 trim_cache size 0 max 16384 2024-02-21T23:06:42.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.653+0000 7f3cf7600640 1 -- 172.21.15.99:0/1338582831 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f3cd009eed0 msgr2=0x7f3cd00a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:42.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.653+0000 7f3cf7600640 1 --2- 172.21.15.99:0/1338582831 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f3cd009eed0 0x7f3cd00a1390 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc007fd0 tx=0x7f3cdc007dc0 comp rx=0 tx=0).stop 2024-02-21T23:06:42.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.653+0000 7f3cf7600640 1 -- 172.21.15.99:0/1338582831 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3cf0070f20 msgr2=0x7f3cf0172d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:42.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.653+0000 7f3cf7600640 1 --2- 172.21.15.99:0/1338582831 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3cf0070f20 0x7f3cf0172d10 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f3ce4000c00 tx=0x7f3ce40046c0 comp rx=0 tx=0).stop 2024-02-21T23:06:42.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.653+0000 7f3cf7600640 1 -- 172.21.15.99:0/1338582831 shutdown_connections 2024-02-21T23:06:42.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.653+0000 7f3cf7600640 1 --2- 172.21.15.99:0/1338582831 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f3cd009eed0 0x7f3cd00a1390 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:42.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.653+0000 7f3cf7600640 1 --2- 172.21.15.99:0/1338582831 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3cf0187540 0x7f3cf00fba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:42.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.653+0000 7f3cf7600640 1 --2- 172.21.15.99:0/1338582831 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3cf0186a50 0x7f3cf00fb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:42.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.653+0000 7f3cf7600640 1 --2- 172.21.15.99:0/1338582831 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3cf0070f20 0x7f3cf0172d10 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:42.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.653+0000 7f3cf7600640 1 -- 172.21.15.99:0/1338582831 >> 172.21.15.99:0/1338582831 conn(0x7f3cf00f8d80 msgr2=0x7f3cf00cdb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:06:42.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.653+0000 7f3cf7600640 1 -- 172.21.15.99:0/1338582831 shutdown_connections 2024-02-21T23:06:42.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:42.653+0000 7f3cf7600640 1 -- 172.21.15.99:0/1338582831 wait complete. 2024-02-21T23:06:42.656 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:06:42.668 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T23:06:42.668 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T23:06:43.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.016+0000 7f6a1b000640 1 Processor -- start 2024-02-21T23:06:43.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.017+0000 7f6a1b000640 1 -- start start 2024-02-21T23:06:43.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.020+0000 7f6a1b000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f6a1418e2e0 0x7f6a1418e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:43.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.020+0000 7f6a1b000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a140f6850 con 0x7f6a141903e0 2024-02-21T23:06:43.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.020+0000 7f6a1b000640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a140f54d0 con 0x7f6a1418a770 2024-02-21T23:06:43.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.020+0000 7f6a1b000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a140f57b0 con 0x7f6a1418e2e0 2024-02-21T23:06:43.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.020+0000 7f6a19c00640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f6a1418a770 0x7f6a140f4cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:55016/0 (socket says 172.21.15.99:55016) 2024-02-21T23:06:43.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.020+0000 7f6a19c00640 1 -- 172.21.15.99:0/26309953 learned_addr learned my addr 172.21.15.99:0/26309953 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:06:43.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.020+0000 7f6a19200640 1 --2- 172.21.15.99:0/26309953 >> v2:172.21.15.162:3300/0 conn(0x7f6a1418e2e0 0x7f6a1418e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:43.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.021+0000 7f6a19200640 1 -- 172.21.15.99:0/26309953 >> v1:172.21.15.181:6789/0 conn(0x7f6a1418a770 legacy=0x7f6a140f4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:43.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.021+0000 7f6a19200640 1 -- 172.21.15.99:0/26309953 >> v1:172.21.15.99:6789/0 conn(0x7f6a141903e0 legacy=0x7f6a14190830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:43.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.021+0000 7f6a19200640 1 -- 172.21.15.99:0/26309953 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a140f5a90 con 0x7f6a1418e2e0 2024-02-21T23:06:43.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.023+0000 7f6a19200640 1 --2- 172.21.15.99:0/26309953 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a1418e2e0 0x7f6a1418e740 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f6a00009720 tx=0x7f6a0002b730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2124a96d5789f17 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:43.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.023+0000 7f6a13e00640 1 -- 172.21.15.99:0/26309953 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a00037070 con 0x7f6a1418e2e0 2024-02-21T23:06:43.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.023+0000 7f6a13e00640 1 -- 172.21.15.99:0/26309953 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a00030710 con 0x7f6a1418e2e0 2024-02-21T23:06:43.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.023+0000 7f6a13e00640 1 -- 172.21.15.99:0/26309953 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a00030ae0 con 0x7f6a1418e2e0 2024-02-21T23:06:43.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.024+0000 7f6a1b000640 1 -- 172.21.15.99:0/26309953 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a1418e2e0 msgr2=0x7f6a1418e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:43.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.024+0000 7f6a1b000640 1 --2- 172.21.15.99:0/26309953 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a1418e2e0 0x7f6a1418e740 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f6a00009720 tx=0x7f6a0002b730 comp rx=0 tx=0).stop 2024-02-21T23:06:43.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.025+0000 7f6a1b000640 1 -- 172.21.15.99:0/26309953 shutdown_connections 2024-02-21T23:06:43.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.025+0000 7f6a1b000640 1 --2- 172.21.15.99:0/26309953 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a1418e2e0 0x7f6a1418e740 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:43.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.025+0000 7f6a1b000640 1 -- 172.21.15.99:0/26309953 >> 172.21.15.99:0/26309953 conn(0x7f6a140ce4b0 msgr2=0x7f6a140ce8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:06:43.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.025+0000 7f6a1b000640 1 -- 172.21.15.99:0/26309953 shutdown_connections 2024-02-21T23:06:43.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.025+0000 7f6a1b000640 1 -- 172.21.15.99:0/26309953 wait complete. 2024-02-21T23:06:43.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.029+0000 7f6a1b000640 1 Processor -- start 2024-02-21T23:06:43.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.029+0000 7f6a1b000640 1 -- start start 2024-02-21T23:06:43.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.031+0000 7f6a1b000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a1418a770 0x7f6a1416e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:43.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.031+0000 7f6a1b000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6a1418e2e0 0x7f6a14222550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:43.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.031+0000 7f6a1b000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a141903e0 0x7f6a14222a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:43.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.031+0000 7f6a1b000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a140f6330 con 0x7f6a141903e0 2024-02-21T23:06:43.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.031+0000 7f6a1b000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a140f6050 con 0x7f6a1418a770 2024-02-21T23:06:43.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.031+0000 7f6a1b000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1418ec80 con 0x7f6a1418e2e0 2024-02-21T23:06:43.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.032+0000 7f6a19c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a1418a770 0x7f6a1416e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:43.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.032+0000 7f6a1a600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a141903e0 0x7f6a14222a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:43.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.032+0000 7f6a19200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6a1418e2e0 0x7f6a14222550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:43.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.032+0000 7f6a19200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6a1418e2e0 0x7f6a14222550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:45640/0 (socket says 172.21.15.99:45640) 2024-02-21T23:06:43.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.032+0000 7f6a19200640 1 -- 172.21.15.99:0/4155438139 learned_addr learned my addr 172.21.15.99:0/4155438139 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:06:43.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.033+0000 7f6a19c00640 1 -- 172.21.15.99:0/4155438139 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6a1418e2e0 msgr2=0x7f6a14222550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:43.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.033+0000 7f6a19c00640 1 --2- 172.21.15.99:0/4155438139 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6a1418e2e0 0x7f6a14222550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:43.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.033+0000 7f6a19c00640 1 -- 172.21.15.99:0/4155438139 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a141903e0 msgr2=0x7f6a14222a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:43.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.033+0000 7f6a19c00640 1 --2- 172.21.15.99:0/4155438139 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a141903e0 0x7f6a14222a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:43.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.033+0000 7f6a19c00640 1 -- 172.21.15.99:0/4155438139 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a142211d0 con 0x7f6a1418a770 2024-02-21T23:06:43.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.034+0000 7f6a19c00640 1 --2- 172.21.15.99:0/4155438139 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a1418a770 0x7f6a1416e500 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f6a0800c500 tx=0x7f6a0800c9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:43.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.035+0000 7f6a11600640 1 -- 172.21.15.99:0/4155438139 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a08018070 con 0x7f6a1418a770 2024-02-21T23:06:43.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.035+0000 7f6a11600640 1 -- 172.21.15.99:0/4155438139 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a080074e0 con 0x7f6a1418a770 2024-02-21T23:06:43.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.035+0000 7f6a11600640 1 -- 172.21.15.99:0/4155438139 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a08004a20 con 0x7f6a1418a770 2024-02-21T23:06:43.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.035+0000 7f6a1b000640 1 -- 172.21.15.99:0/4155438139 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a142214b0 con 0x7f6a1418a770 2024-02-21T23:06:43.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.035+0000 7f6a1b000640 1 -- 172.21.15.99:0/4155438139 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a14221a70 con 0x7f6a1418a770 2024-02-21T23:06:43.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.039+0000 7f6a11600640 1 -- 172.21.15.99:0/4155438139 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f6a0801b070 con 0x7f6a1418a770 2024-02-21T23:06:43.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.041+0000 7f6a11600640 1 --2- 172.21.15.99:0/4155438139 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f69f409efa0 0x7f69f40a1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:43.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.042+0000 7f6a1f5e0740 1 Processor -- start 2024-02-21T23:06:43.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.042+0000 7f6a11600640 1 -- 172.21.15.99:0/4155438139 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f6a080c9290 con 0x7f6a1418a770 2024-02-21T23:06:43.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.042+0000 7f6a19200640 1 --2- 172.21.15.99:0/4155438139 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f69f409efa0 0x7f69f40a1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:43.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.042+0000 7f6a1f5e0740 1 -- start start 2024-02-21T23:06:43.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.044+0000 7f6a19200640 1 --2- 172.21.15.99:0/4155438139 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f69f409efa0 0x7f69f40a1460 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6a0002b770 tx=0x7f6a00008030 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:43.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.044+0000 7f6a1f5e0740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bf1e8e82a0 0x55bf1e91dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:43.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.045+0000 7f6a1f5e0740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bf1e91e260 0x55bf1e8e8680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:43.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.045+0000 7f6a1f5e0740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bf1e8e8bc0 0x55bf1e8ab1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:43.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.045+0000 7f6a1f5e0740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf1e814a90 con 0x55bf1e8e8bc0 2024-02-21T23:06:43.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.045+0000 7f6a1f5e0740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf1e7bdb10 con 0x55bf1e91e260 2024-02-21T23:06:43.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.045+0000 7f6a1f5e0740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf1e810b30 con 0x55bf1e8e82a0 2024-02-21T23:06:43.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.045+0000 7f6a19c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bf1e8e82a0 0x55bf1e91dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:43.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.045+0000 7f6a19c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bf1e8e82a0 0x55bf1e91dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:45654/0 (socket says 172.21.15.99:45654) 2024-02-21T23:06:43.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.045+0000 7f6a19c00640 1 -- 172.21.15.99:0/217865073 learned_addr learned my addr 172.21.15.99:0/217865073 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:06:43.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.045+0000 7f6a19200640 1 --2- 172.21.15.99:0/217865073 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bf1e91e260 0x55bf1e8e8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:43.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.045+0000 7f6a1a600640 1 --2- 172.21.15.99:0/217865073 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bf1e8e8bc0 0x55bf1e8ab1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:43.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.046+0000 7f6a19c00640 1 -- 172.21.15.99:0/217865073 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bf1e91e260 msgr2=0x55bf1e8e8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:43.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.046+0000 7f6a19c00640 1 --2- 172.21.15.99:0/217865073 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bf1e91e260 0x55bf1e8e8680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:43.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.046+0000 7f6a19c00640 1 -- 172.21.15.99:0/217865073 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bf1e8e8bc0 msgr2=0x55bf1e8ab1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:43.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.046+0000 7f6a19c00640 1 --2- 172.21.15.99:0/217865073 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bf1e8e8bc0 0x55bf1e8ab1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:43.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.046+0000 7f6a19c00640 1 -- 172.21.15.99:0/217865073 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bf1e5f37d0 con 0x55bf1e8e82a0 2024-02-21T23:06:43.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.046+0000 7f6a1a600640 1 --2- 172.21.15.99:0/217865073 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bf1e8e8bc0 0x55bf1e8ab1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:06:43.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.047+0000 7f6a19c00640 1 --2- 172.21.15.99:0/217865073 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bf1e8e82a0 0x55bf1e91dd20 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f6a0800c4d0 tx=0x7f6a0809adc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19f8215e7acd5d1b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:43.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.047+0000 7f6a06000640 1 -- 172.21.15.99:0/217865073 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a08097e60 con 0x55bf1e8e82a0 2024-02-21T23:06:43.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.047+0000 7f6a06000640 1 -- 172.21.15.99:0/217865073 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a080c6af0 con 0x55bf1e8e82a0 2024-02-21T23:06:43.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.047+0000 7f6a06000640 1 -- 172.21.15.99:0/217865073 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a08004dc0 con 0x55bf1e8e82a0 2024-02-21T23:06:43.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.049+0000 7f6a1f5e0740 1 -- 172.21.15.99:0/217865073 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bf1e8e82a0 msgr2=0x55bf1e91dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:43.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.049+0000 7f6a1f5e0740 1 --2- 172.21.15.99:0/217865073 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bf1e8e82a0 0x55bf1e91dd20 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f6a0800c4d0 tx=0x7f6a0809adc0 comp rx=0 tx=0).stop 2024-02-21T23:06:43.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.050+0000 7f6a1f5e0740 1 -- 172.21.15.99:0/217865073 shutdown_connections 2024-02-21T23:06:43.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.050+0000 7f6a1f5e0740 1 --2- 172.21.15.99:0/217865073 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bf1e8e8bc0 0x55bf1e8ab1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:43.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.050+0000 7f6a1f5e0740 1 --2- 172.21.15.99:0/217865073 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bf1e91e260 0x55bf1e8e8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:43.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.050+0000 7f6a1f5e0740 1 --2- 172.21.15.99:0/217865073 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bf1e8e82a0 0x55bf1e91dd20 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:43.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.050+0000 7f6a1f5e0740 1 -- 172.21.15.99:0/217865073 >> 172.21.15.99:0/217865073 conn(0x55bf1e8776b0 msgr2=0x55bf1e8af190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:06:43.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.050+0000 7f6a1f5e0740 1 -- 172.21.15.99:0/217865073 shutdown_connections 2024-02-21T23:06:43.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.050+0000 7f6a1f5e0740 1 -- 172.21.15.99:0/217865073 wait complete. 2024-02-21T23:06:43.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.052+0000 7f6a1f5e0740 1 -- start start 2024-02-21T23:06:43.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.052+0000 7f6a1f5e0740 1 Processor -- start 2024-02-21T23:06:43.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.054+0000 7f6a1f5e0740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bf1e8e82a0 0x55bf1e8e7040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:43.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.054+0000 7f6a1f5e0740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bf1e8e8bc0 0x55bf1e8de340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:43.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.054+0000 7f6a1f5e0740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bf1e91e260 0x55bf1e921ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:43.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.054+0000 7f6a19200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bf1e8e8bc0 0x55bf1e8de340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:43.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.054+0000 7f6a19c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bf1e8e82a0 0x55bf1e8e7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:43.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.054+0000 7f6a1f5e0740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf1e8b6f30 con 0x55bf1e91e260 2024-02-21T23:06:43.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.054+0000 7f6a1f5e0740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf1e7b31c0 con 0x55bf1e8e82a0 2024-02-21T23:06:43.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.054+0000 7f6a19c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bf1e8e82a0 0x55bf1e8e7040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:39790/0 (socket says 172.21.15.99:39790) 2024-02-21T23:06:43.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.054+0000 7f6a1f5e0740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf1e91f930 con 0x55bf1e8e8bc0 2024-02-21T23:06:43.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.054+0000 7f6a19c00640 1 -- 172.21.15.99:0/2411959602 learned_addr learned my addr 172.21.15.99:0/2411959602 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:06:43.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.055+0000 7f6a1f5e0740 10 client.0 _ll_register_callbacks cb 0x55bf1e7d0930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:06:43.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.055+0000 7f6a1a600640 1 --2- 172.21.15.99:0/2411959602 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bf1e91e260 0x55bf1e921ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:43.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.055+0000 7f6a19c00640 1 -- 172.21.15.99:0/2411959602 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bf1e8e8bc0 msgr2=0x55bf1e8de340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:43.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.055+0000 7f6a19c00640 1 --2- 172.21.15.99:0/2411959602 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bf1e8e8bc0 0x55bf1e8de340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:43.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.055+0000 7f6a19c00640 1 -- 172.21.15.99:0/2411959602 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bf1e91e260 msgr2=0x55bf1e921ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:43.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.055+0000 7f6a19c00640 1 --2- 172.21.15.99:0/2411959602 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bf1e91e260 0x55bf1e921ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:43.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.055+0000 7f6a19c00640 1 -- 172.21.15.99:0/2411959602 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bf1e5293f0 con 0x55bf1e8e82a0 2024-02-21T23:06:43.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.055+0000 7f6a19200640 1 --2- 172.21.15.99:0/2411959602 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bf1e8e8bc0 0x55bf1e8de340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:06:43.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.056+0000 7f6a19c00640 1 --2- 172.21.15.99:0/2411959602 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bf1e8e82a0 0x55bf1e8e7040 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f6a08007ad0 tx=0x7f6a0801f040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d2f9a199b9dded6a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:43.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.056+0000 7f69faa00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-02-21T23:06:43.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.056+0000 7f69faa00640 1 -- 172.21.15.99:0/2411959602 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a08097e60 con 0x55bf1e8e82a0 2024-02-21T23:06:43.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.056+0000 7f69faa00640 1 -- 172.21.15.99:0/2411959602 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f6a080aad90 con 0x55bf1e8e82a0 2024-02-21T23:06:43.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.057+0000 7f6a1f5e0740 1 -- 172.21.15.99:0/2411959602 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6a080c6af0 con 0x55bf1e8e82a0 2024-02-21T23:06:43.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.057+0000 7f69faa00640 1 -- 172.21.15.99:0/2411959602 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6a08096030 con 0x55bf1e8e82a0 2024-02-21T23:06:43.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.057+0000 7f6a1f5e0740 10 client.6157 fetch_fsmap learned FSMap version 16 2024-02-21T23:06:43.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.057+0000 7f6a1f5e0740 1 -- 172.21.15.99:0/2411959602 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55bf1e4e90f0 con 0x55bf1e8e82a0 2024-02-21T23:06:43.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.057+0000 7f69faa00640 1 -- 172.21.15.99:0/2411959602 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a080c6af0 con 0x55bf1e8e82a0 2024-02-21T23:06:43.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.058+0000 7f69faa00640 1 -- 172.21.15.99:0/2411959602 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f6a080961d0 con 0x55bf1e8e82a0 2024-02-21T23:06:43.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.058+0000 7f6a1f5e0740 10 client.6157 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T23:06:43.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.058+0000 7f6a1f5e0740 10 client.6157 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:06:43.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.058+0000 7f6a1f5e0740 20 client.6157 populate_metadata read hostname 'smithi099' 2024-02-21T23:06:43.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.058+0000 7f6a1f5e0740 1 --2- 172.21.15.99:0/2411959602 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55bf1e930bc0 0x55bf1e8e7790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:43.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.058+0000 7f6a1f5e0740 4 client.6157 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:06:43.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.058+0000 7f6a1f5e0740 1 -- 172.21.15.99:0/2411959602 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bf1e821fd0 con 0x55bf1e930bc0 2024-02-21T23:06:43.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.058+0000 7f6a19200640 1 --2- 172.21.15.99:0/2411959602 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55bf1e930bc0 0x55bf1e8e7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:43.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.059+0000 7f69faa00640 10 client.6157 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:06:43.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.059+0000 7f6a19200640 1 --2- 172.21.15.99:0/2411959602 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55bf1e930bc0 0x55bf1e8e7790 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=79f4b28b78553d server_cookie=44883c1c062500fd in_seq=0 out_seq=0 2024-02-21T23:06:43.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.061+0000 7f69faa00640 1 -- 172.21.15.99:0/2411959602 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55bf1e821fd0 con 0x55bf1e930bc0 2024-02-21T23:06:43.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.061+0000 7f69faa00640 10 client.6157 handle_command_reply: tid=0 2024-02-21T23:06:43.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.061+0000 7f6a1f5e0740 1 client.6157 shutdown 2024-02-21T23:06:43.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.061+0000 7f6a1f5e0740 1 -- 172.21.15.99:0/2411959602 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bf1e8e82a0 msgr2=0x55bf1e8e7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:43.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.061+0000 7f6a1f5e0740 1 --2- 172.21.15.99:0/2411959602 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bf1e8e82a0 0x55bf1e8e7040 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f6a08007ad0 tx=0x7f6a0801f040 comp rx=0 tx=0).stop 2024-02-21T23:06:43.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.062+0000 7f6a1f5e0740 1 -- 172.21.15.99:0/2411959602 shutdown_connections 2024-02-21T23:06:43.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.062+0000 7f6a1f5e0740 1 --2- 172.21.15.99:0/2411959602 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55bf1e930bc0 0x55bf1e8e7790 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:43.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.062+0000 7f6a1f5e0740 1 --2- 172.21.15.99:0/2411959602 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bf1e91e260 0x55bf1e921ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:43.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.062+0000 7f6a1f5e0740 1 --2- 172.21.15.99:0/2411959602 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bf1e8e8bc0 0x55bf1e8de340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:43.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.062+0000 7f6a1f5e0740 1 --2- 172.21.15.99:0/2411959602 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bf1e8e82a0 0x55bf1e8e7040 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:43.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.062+0000 7f6a1f5e0740 1 -- 172.21.15.99:0/2411959602 >> 172.21.15.99:0/2411959602 conn(0x55bf1e8776b0 msgr2=0x55bf1e8afb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:06:43.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.062+0000 7f69faa00640 0 client.6157 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:06:43.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.062+0000 7f6a1f5e0740 1 -- 172.21.15.99:0/2411959602 shutdown_connections 2024-02-21T23:06:43.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.062+0000 7f6a1f5e0740 1 -- 172.21.15.99:0/2411959602 wait complete. 2024-02-21T23:06:43.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.062+0000 7f6a1f5e0740 20 client.6157 trim_cache size 0 max 16384 2024-02-21T23:06:43.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.091+0000 7f6a1f5e0740 1 Processor -- start 2024-02-21T23:06:43.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.091+0000 7f6a1f5e0740 1 -- start start 2024-02-21T23:06:43.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.092+0000 7f6a1f5e0740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bf1e8e82a0 0x55bf1e922800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:43.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.092+0000 7f6a1f5e0740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bf1e8e8bc0 0x55bf1e989a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:43.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.092+0000 7f6a1f5e0740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bf1e91e260 0x55bf1e989f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:43.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.092+0000 7f6a1f5e0740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a14231010 con 0x55bf1e91e260 2024-02-21T23:06:43.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.092+0000 7f6a1f5e0740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1422ebb0 con 0x55bf1e8e82a0 2024-02-21T23:06:43.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.092+0000 7f6a1f5e0740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1422cc90 con 0x55bf1e8e8bc0 2024-02-21T23:06:43.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.093+0000 7f6a19c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bf1e8e82a0 0x55bf1e922800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:43.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.093+0000 7f6a19c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bf1e8e82a0 0x55bf1e922800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:39800/0 (socket says 172.21.15.99:39800) 2024-02-21T23:06:43.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.093+0000 7f6a19c00640 1 -- 172.21.15.99:0/4131325067 learned_addr learned my addr 172.21.15.99:0/4131325067 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:06:43.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.093+0000 7f6a19200640 1 --2- 172.21.15.99:0/4131325067 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bf1e8e8bc0 0x55bf1e989a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:43.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.093+0000 7f6a1a600640 1 --2- 172.21.15.99:0/4131325067 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bf1e91e260 0x55bf1e989f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:43.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.093+0000 7f6a19c00640 1 -- 172.21.15.99:0/4131325067 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bf1e8e8bc0 msgr2=0x55bf1e989a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:43.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.093+0000 7f6a19c00640 1 --2- 172.21.15.99:0/4131325067 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bf1e8e8bc0 0x55bf1e989a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:43.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.093+0000 7f6a19c00640 1 -- 172.21.15.99:0/4131325067 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bf1e91e260 msgr2=0x55bf1e989f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:43.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.093+0000 7f6a19c00640 1 --2- 172.21.15.99:0/4131325067 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bf1e91e260 0x55bf1e989f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:43.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.093+0000 7f6a19c00640 1 -- 172.21.15.99:0/4131325067 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bf1e8e5660 con 0x55bf1e8e82a0 2024-02-21T23:06:43.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.094+0000 7f6a19c00640 1 --2- 172.21.15.99:0/4131325067 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bf1e8e82a0 0x55bf1e922800 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f6a08096b20 tx=0x7f6a08006000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c29391db424e9261 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:43.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.094+0000 7f6a05600640 1 -- 172.21.15.99:0/4131325067 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a080ba070 con 0x55bf1e8e82a0 2024-02-21T23:06:43.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.094+0000 7f6a05600640 1 -- 172.21.15.99:0/4131325067 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a080961d0 con 0x55bf1e8e82a0 2024-02-21T23:06:43.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.094+0000 7f6a05600640 1 -- 172.21.15.99:0/4131325067 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a080aee60 con 0x55bf1e8e82a0 2024-02-21T23:06:43.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.095+0000 7f6a1f5e0740 1 -- 172.21.15.99:0/4131325067 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bf1e8e82a0 msgr2=0x55bf1e922800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:43.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.095+0000 7f6a1f5e0740 1 --2- 172.21.15.99:0/4131325067 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bf1e8e82a0 0x55bf1e922800 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f6a08096b20 tx=0x7f6a08006000 comp rx=0 tx=0).stop 2024-02-21T23:06:43.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.095+0000 7f6a1f5e0740 1 -- 172.21.15.99:0/4131325067 shutdown_connections 2024-02-21T23:06:43.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.095+0000 7f6a1f5e0740 1 --2- 172.21.15.99:0/4131325067 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bf1e91e260 0x55bf1e989f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:43.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.095+0000 7f6a1f5e0740 1 --2- 172.21.15.99:0/4131325067 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bf1e8e8bc0 0x55bf1e989a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:43.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.095+0000 7f6a1f5e0740 1 --2- 172.21.15.99:0/4131325067 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bf1e8e82a0 0x55bf1e922800 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:43.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.095+0000 7f6a1f5e0740 1 -- 172.21.15.99:0/4131325067 >> 172.21.15.99:0/4131325067 conn(0x55bf1e8776b0 msgr2=0x55bf1e930bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:06:43.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.096+0000 7f6a1f5e0740 1 -- 172.21.15.99:0/4131325067 shutdown_connections 2024-02-21T23:06:43.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.096+0000 7f6a1f5e0740 1 -- 172.21.15.99:0/4131325067 wait complete. 2024-02-21T23:06:43.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.097+0000 7f6a1f5e0740 1 -- start start 2024-02-21T23:06:43.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.097+0000 7f6a1f5e0740 1 Processor -- start 2024-02-21T23:06:43.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.099+0000 7f6a1f5e0740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bf1e8e82a0 0x55bf1e8e0160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:43.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.099+0000 7f6a1f5e0740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bf1e8e8bc0 0x55bf1e91da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:43.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.099+0000 7f6a1f5e0740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bf1e91e260 0x55bf1e977cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:43.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.099+0000 7f6a1f5e0740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1422d290 con 0x55bf1e8e8bc0 2024-02-21T23:06:43.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.099+0000 7f6a1f5e0740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1422e550 con 0x55bf1e91e260 2024-02-21T23:06:43.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.099+0000 7f6a1f5e0740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1422d890 con 0x55bf1e8e82a0 2024-02-21T23:06:43.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.099+0000 7f6a1f5e0740 10 client.0 _ll_register_callbacks cb 0x7f6a0c0018b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:06:43.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.100+0000 7f6a1a600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bf1e91e260 0x55bf1e977cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:43.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.100+0000 7f6a1a600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bf1e91e260 0x55bf1e977cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:39816/0 (socket says 172.21.15.99:39816) 2024-02-21T23:06:43.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.100+0000 7f6a1a600640 1 -- 172.21.15.99:0/543886913 learned_addr learned my addr 172.21.15.99:0/543886913 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:06:43.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.100+0000 7f6a19c00640 1 --2- 172.21.15.99:0/543886913 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bf1e8e82a0 0x55bf1e8e0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:43.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.100+0000 7f6a19200640 1 --2- 172.21.15.99:0/543886913 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bf1e8e8bc0 0x55bf1e91da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:43.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.101+0000 7f6a1a600640 1 -- 172.21.15.99:0/543886913 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bf1e8e82a0 msgr2=0x55bf1e8e0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:43.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.101+0000 7f6a1a600640 1 --2- 172.21.15.99:0/543886913 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bf1e8e82a0 0x55bf1e8e0160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:43.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.101+0000 7f6a1a600640 1 -- 172.21.15.99:0/543886913 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bf1e8e8bc0 msgr2=0x55bf1e91da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:06:43.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.101+0000 7f6a1a600640 1 --2- 172.21.15.99:0/543886913 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bf1e8e8bc0 0x55bf1e91da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:43.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.101+0000 7f6a1a600640 1 -- 172.21.15.99:0/543886913 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bf1e978230 con 0x55bf1e91e260 2024-02-21T23:06:43.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.101+0000 7f6a19200640 1 --2- 172.21.15.99:0/543886913 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bf1e8e8bc0 0x55bf1e91da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:06:43.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.101+0000 7f6a1a600640 1 --2- 172.21.15.99:0/543886913 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bf1e91e260 0x55bf1e977cf0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c002010 tx=0x7f6a0c005420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57d266ec8d7e268b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:06:43.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.102+0000 7f69faa00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-02-21T23:06:43.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.102+0000 7f69faa00640 1 -- 172.21.15.99:0/543886913 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a0c017700 con 0x55bf1e91e260 2024-02-21T23:06:43.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.102+0000 7f69faa00640 1 -- 172.21.15.99:0/543886913 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f6a0c0178a0 con 0x55bf1e91e260 2024-02-21T23:06:43.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.102+0000 7f6a1f5e0740 1 -- 172.21.15.99:0/543886913 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6a080961d0 con 0x55bf1e91e260 2024-02-21T23:06:43.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.102+0000 7f69faa00640 1 -- 172.21.15.99:0/543886913 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6a0c027050 con 0x55bf1e91e260 2024-02-21T23:06:43.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.102+0000 7f6a1f5e0740 10 client.6163 fetch_fsmap learned FSMap version 16 2024-02-21T23:06:43.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.102+0000 7f6a1f5e0740 1 -- 172.21.15.99:0/543886913 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x55bf1e937c00 con 0x55bf1e91e260 2024-02-21T23:06:43.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.102+0000 7f69faa00640 1 -- 172.21.15.99:0/543886913 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a080961d0 con 0x55bf1e91e260 2024-02-21T23:06:43.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.103+0000 7f69faa00640 1 -- 172.21.15.99:0/543886913 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 16) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f6a0c017aa0 con 0x55bf1e91e260 2024-02-21T23:06:43.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.103+0000 7f6a1f5e0740 10 client.6163 fetch_fsmap finished waiting for FSMap version 16 2024-02-21T23:06:43.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.103+0000 7f6a1f5e0740 10 client.6163 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:06:43.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.103+0000 7f6a1f5e0740 20 client.6163 populate_metadata read hostname 'smithi099' 2024-02-21T23:06:43.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.103+0000 7f6a1f5e0740 1 --2- 172.21.15.99:0/543886913 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55bf1e992d00 0x55bf1e8b6440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:06:43.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.103+0000 7f6a1f5e0740 4 client.6163 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T23:06:43.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.103+0000 7f6a1f5e0740 1 -- 172.21.15.99:0/543886913 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55bf1e91ff80 con 0x55bf1e992d00 2024-02-21T23:06:43.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.104+0000 7f6a19c00640 1 --2- 172.21.15.99:0/543886913 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55bf1e992d00 0x55bf1e8b6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:06:43.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.105+0000 7f6a19c00640 1 --2- 172.21.15.99:0/543886913 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55bf1e992d00 0x55bf1e8b6440 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=835d6a634673bbe8 server_cookie=d19a1d56739574e in_seq=0 out_seq=0 2024-02-21T23:06:43.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.105+0000 7f69faa00640 10 client.6163 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:06:43.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.105+0000 7f69faa00640 1 -- 172.21.15.99:0/543886913 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x55bf1e91ff80 con 0x55bf1e992d00 2024-02-21T23:06:43.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.105+0000 7f69faa00640 10 client.6163 handle_command_reply: tid=0 2024-02-21T23:06:43.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.105+0000 7f6a1f5e0740 1 client.6163 shutdown 2024-02-21T23:06:43.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.105+0000 7f6a1f5e0740 1 -- 172.21.15.99:0/543886913 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bf1e91e260 msgr2=0x55bf1e977cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:43.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.105+0000 7f6a1f5e0740 1 --2- 172.21.15.99:0/543886913 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bf1e91e260 0x55bf1e977cf0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c002010 tx=0x7f6a0c005420 comp rx=0 tx=0).stop 2024-02-21T23:06:43.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.106+0000 7f6a1f5e0740 1 -- 172.21.15.99:0/543886913 shutdown_connections 2024-02-21T23:06:43.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.106+0000 7f6a1f5e0740 1 --2- 172.21.15.99:0/543886913 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55bf1e992d00 0x55bf1e8b6440 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:43.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.106+0000 7f6a1f5e0740 1 --2- 172.21.15.99:0/543886913 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bf1e91e260 0x55bf1e977cf0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:43.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.106+0000 7f6a1f5e0740 1 --2- 172.21.15.99:0/543886913 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bf1e8e8bc0 0x55bf1e91da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:43.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.106+0000 7f6a1f5e0740 1 --2- 172.21.15.99:0/543886913 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bf1e8e82a0 0x55bf1e8e0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:43.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.106+0000 7f6a1f5e0740 1 -- 172.21.15.99:0/543886913 >> 172.21.15.99:0/543886913 conn(0x55bf1e8776b0 msgr2=0x55bf1e8e7790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:06:43.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.106+0000 7f69faa00640 0 client.6163 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:06:43.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.106+0000 7f6a1f5e0740 1 -- 172.21.15.99:0/543886913 shutdown_connections 2024-02-21T23:06:43.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.106+0000 7f6a1f5e0740 1 -- 172.21.15.99:0/543886913 wait complete. 2024-02-21T23:06:43.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.106+0000 7f6a1f5e0740 20 client.6163 trim_cache size 0 max 16384 2024-02-21T23:06:43.099 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-02-21T23:06:43.099 INFO:teuthology.orchestra.run.smithi099.stdout: "status": "scrub active (500 inodes in the stack)", 2024-02-21T23:06:43.100 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubs": { 2024-02-21T23:06:43.100 INFO:teuthology.orchestra.run.smithi099.stdout: "97aa8b4f-2d60-4c72-be40-90f51d822a03": { 2024-02-21T23:06:43.100 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/", 2024-02-21T23:06:43.100 INFO:teuthology.orchestra.run.smithi099.stdout: "tag": "97aa8b4f-2d60-4c72-be40-90f51d822a03", 2024-02-21T23:06:43.100 INFO:teuthology.orchestra.run.smithi099.stdout: "options": "recursive,force" 2024-02-21T23:06:43.100 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:06:43.101 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:06:43.101 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-02-21T23:06:43.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.108+0000 7f6a1b000640 1 -- 172.21.15.99:0/4155438139 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f69f409efa0 msgr2=0x7f69f40a1460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:43.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.108+0000 7f6a1b000640 1 --2- 172.21.15.99:0/4155438139 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f69f409efa0 0x7f69f40a1460 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6a0002b770 tx=0x7f6a00008030 comp rx=0 tx=0).stop 2024-02-21T23:06:43.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.108+0000 7f6a1b000640 1 -- 172.21.15.99:0/4155438139 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a1418a770 msgr2=0x7f6a1416e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:06:43.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.108+0000 7f6a1b000640 1 --2- 172.21.15.99:0/4155438139 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a1418a770 0x7f6a1416e500 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f6a0800c500 tx=0x7f6a0800c9c0 comp rx=0 tx=0).stop 2024-02-21T23:06:43.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.109+0000 7f6a1b000640 1 -- 172.21.15.99:0/4155438139 shutdown_connections 2024-02-21T23:06:43.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.109+0000 7f6a1b000640 1 --2- 172.21.15.99:0/4155438139 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f69f409efa0 0x7f69f40a1460 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:43.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.109+0000 7f6a1b000640 1 --2- 172.21.15.99:0/4155438139 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6a141903e0 0x7f6a14222a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:43.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.109+0000 7f6a1b000640 1 --2- 172.21.15.99:0/4155438139 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6a1418e2e0 0x7f6a14222550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:43.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.109+0000 7f6a1b000640 1 --2- 172.21.15.99:0/4155438139 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a1418a770 0x7f6a1416e500 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:06:43.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.109+0000 7f6a1b000640 1 -- 172.21.15.99:0/4155438139 >> 172.21.15.99:0/4155438139 conn(0x7f6a140ce4b0 msgr2=0x7f6a1418f250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:06:43.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.109+0000 7f6a1b000640 1 -- 172.21.15.99:0/4155438139 shutdown_connections 2024-02-21T23:06:43.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:06:43.109+0000 7f6a1b000640 1 -- 172.21.15.99:0/4155438139 wait complete. 2024-02-21T23:06:43.120 INFO:tasks.cephfs.filesystem:scrub status for tag:97aa8b4f-2d60-4c72-be40-90f51d822a03 - {'path': '/', 'tag': '97aa8b4f-2d60-4c72-be40-90f51d822a03', 'options': 'recursive,force'} 2024-02-21T23:07:12.767 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:07:12.778 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:07:12.781 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:07:13.121 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T23:07:13.121 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T23:07:13.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.374+0000 7ff57a200640 1 Processor -- start 2024-02-21T23:07:13.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.374+0000 7ff57a200640 1 -- start start 2024-02-21T23:07:13.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.376+0000 7ff57a200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff574180ab0 0x7ff574188ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:13.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.376+0000 7ff57a200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff5741891e0 0x7ff574189e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:13.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.376+0000 7ff57a200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff574187800 con 0x7ff574189660 2024-02-21T23:07:13.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.376+0000 7ff57a200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff574188810 con 0x7ff574180ab0 2024-02-21T23:07:13.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.376+0000 7ff57a200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5740f6610 con 0x7ff5741891e0 2024-02-21T23:07:13.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.376+0000 7ff578e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff574180ab0 0x7ff574188ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:13.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.376+0000 7ff578e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ff574180ab0 0x7ff574188ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:36344/0 (socket says 172.21.15.99:36344) 2024-02-21T23:07:13.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.376+0000 7ff578e00640 1 -- 172.21.15.99:0/653889395 learned_addr learned my addr 172.21.15.99:0/653889395 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:07:13.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.377+0000 7ff56be00640 1 --2- 172.21.15.99:0/653889395 >> v2:172.21.15.162:3300/0 conn(0x7ff5741891e0 0x7ff574189e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:13.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.377+0000 7ff578e00640 1 -- 172.21.15.99:0/653889395 >> v2:172.21.15.162:3300/0 conn(0x7ff5741891e0 msgr2=0x7ff574189e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:13.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.377+0000 7ff578e00640 1 --2- 172.21.15.99:0/653889395 >> v2:172.21.15.162:3300/0 conn(0x7ff5741891e0 0x7ff574189e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:13.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.377+0000 7ff578e00640 1 -- 172.21.15.99:0/653889395 >> v1:172.21.15.162:6789/0 conn(0x7ff574189660 legacy=0x7ff57418a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:13.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.377+0000 7ff578e00640 1 -- 172.21.15.99:0/653889395 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff574187ee0 con 0x7ff574180ab0 2024-02-21T23:07:13.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.378+0000 7ff578e00640 1 --2- 172.21.15.99:0/653889395 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff574180ab0 0x7ff574188ca0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ff5740c8d10 tx=0x7ff56402b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26c44562a43e2109 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:13.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.378+0000 7ff573e00640 1 -- 172.21.15.99:0/653889395 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff564035020 con 0x7ff574180ab0 2024-02-21T23:07:13.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.379+0000 7ff573e00640 1 -- 172.21.15.99:0/653889395 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff564031890 con 0x7ff574180ab0 2024-02-21T23:07:13.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.379+0000 7ff573e00640 1 -- 172.21.15.99:0/653889395 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff564031c60 con 0x7ff574180ab0 2024-02-21T23:07:13.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.379+0000 7ff57a200640 1 -- 172.21.15.99:0/653889395 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff574180ab0 msgr2=0x7ff574188ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:13.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.379+0000 7ff57a200640 1 --2- 172.21.15.99:0/653889395 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff574180ab0 0x7ff574188ca0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ff5740c8d10 tx=0x7ff56402b930 comp rx=0 tx=0).stop 2024-02-21T23:07:13.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.379+0000 7ff57a200640 1 -- 172.21.15.99:0/653889395 shutdown_connections 2024-02-21T23:07:13.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.379+0000 7ff57a200640 1 --2- 172.21.15.99:0/653889395 >> v2:172.21.15.162:3300/0 conn(0x7ff5741891e0 0x7ff574189e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:13.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.379+0000 7ff57a200640 1 --2- 172.21.15.99:0/653889395 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff574180ab0 0x7ff574188ca0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:13.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.379+0000 7ff57a200640 1 -- 172.21.15.99:0/653889395 >> 172.21.15.99:0/653889395 conn(0x7ff5740ce4b0 msgr2=0x7ff5740ce8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:07:13.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.379+0000 7ff57a200640 1 -- 172.21.15.99:0/653889395 shutdown_connections 2024-02-21T23:07:13.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.380+0000 7ff57a200640 1 -- 172.21.15.99:0/653889395 wait complete. 2024-02-21T23:07:13.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.381+0000 7ff57a200640 1 Processor -- start 2024-02-21T23:07:13.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.382+0000 7ff57a200640 1 -- start start 2024-02-21T23:07:13.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.384+0000 7ff57a200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff574180ab0 0x7ff574210e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:13.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.384+0000 7ff57a200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff5741891e0 0x7ff5741729c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:13.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.384+0000 7ff57a200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff574189660 0x7ff57420eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:13.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.384+0000 7ff57a200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5740cd2c0 con 0x7ff5741891e0 2024-02-21T23:07:13.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.384+0000 7ff57a200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5741884a0 con 0x7ff574180ab0 2024-02-21T23:07:13.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.384+0000 7ff57a200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5740cd440 con 0x7ff574189660 2024-02-21T23:07:13.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.384+0000 7ff56be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff5741891e0 0x7ff5741729c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:13.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.384+0000 7ff578e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff574180ab0 0x7ff574210e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:13.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.384+0000 7ff56be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff5741891e0 0x7ff5741729c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:36360/0 (socket says 172.21.15.99:36360) 2024-02-21T23:07:13.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.384+0000 7ff56be00640 1 -- 172.21.15.99:0/3308001617 learned_addr learned my addr 172.21.15.99:0/3308001617 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:07:13.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.384+0000 7ff578e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff574180ab0 0x7ff574210e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:56376/0 (socket says 172.21.15.99:56376) 2024-02-21T23:07:13.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.384+0000 7ff579800640 1 --2- 172.21.15.99:0/3308001617 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff574189660 0x7ff57420eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:13.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.385+0000 7ff578e00640 1 -- 172.21.15.99:0/3308001617 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff574189660 msgr2=0x7ff57420eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:13.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.385+0000 7ff578e00640 1 --2- 172.21.15.99:0/3308001617 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff574189660 0x7ff57420eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:13.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.385+0000 7ff578e00640 1 -- 172.21.15.99:0/3308001617 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff5741891e0 msgr2=0x7ff5741729c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:13.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.385+0000 7ff578e00640 1 --2- 172.21.15.99:0/3308001617 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff5741891e0 0x7ff5741729c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:13.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.385+0000 7ff578e00640 1 -- 172.21.15.99:0/3308001617 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff574172f00 con 0x7ff574180ab0 2024-02-21T23:07:13.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.385+0000 7ff578e00640 1 --2- 172.21.15.99:0/3308001617 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff574180ab0 0x7ff574210e80 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff564033000 tx=0x7ff5640046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:13.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.385+0000 7ff571600640 1 -- 172.21.15.99:0/3308001617 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff564040070 con 0x7ff574180ab0 2024-02-21T23:07:13.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.385+0000 7ff571600640 1 -- 172.21.15.99:0/3308001617 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff564030d20 con 0x7ff574180ab0 2024-02-21T23:07:13.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.385+0000 7ff571600640 1 -- 172.21.15.99:0/3308001617 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff564035040 con 0x7ff574180ab0 2024-02-21T23:07:13.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.386+0000 7ff57a200640 1 -- 172.21.15.99:0/3308001617 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff57420f380 con 0x7ff574180ab0 2024-02-21T23:07:13.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.386+0000 7ff57a200640 1 -- 172.21.15.99:0/3308001617 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff57420f940 con 0x7ff574180ab0 2024-02-21T23:07:13.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.390+0000 7ff57e791740 1 Processor -- start 2024-02-21T23:07:13.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.390+0000 7ff57e791740 1 -- start start 2024-02-21T23:07:13.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.390+0000 7ff571600640 1 -- 172.21.15.99:0/3308001617 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7ff56404b060 con 0x7ff574180ab0 2024-02-21T23:07:13.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.391+0000 7ff57e791740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5566ce7412a0 0x5566ce776d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:13.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.391+0000 7ff57e791740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5566ce777260 0x5566ce741680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:13.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.391+0000 7ff57e791740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5566ce741bc0 0x5566ce7041d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:13.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.391+0000 7ff57e791740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566ce66da90 con 0x5566ce777260 2024-02-21T23:07:13.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.391+0000 7ff57e791740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566ce616b10 con 0x5566ce7412a0 2024-02-21T23:07:13.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.391+0000 7ff57e791740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566ce669b30 con 0x5566ce741bc0 2024-02-21T23:07:13.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.391+0000 7ff579800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5566ce7412a0 0x5566ce776d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:13.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.391+0000 7ff578e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5566ce777260 0x5566ce741680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:13.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.391+0000 7ff579800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5566ce7412a0 0x5566ce776d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:56390/0 (socket says 172.21.15.99:56390) 2024-02-21T23:07:13.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.391+0000 7ff579800640 1 -- 172.21.15.99:0/1058257537 learned_addr learned my addr 172.21.15.99:0/1058257537 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:07:13.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.391+0000 7ff56be00640 1 --2- 172.21.15.99:0/1058257537 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5566ce741bc0 0x5566ce7041d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:13.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.392+0000 7ff571600640 1 --2- 172.21.15.99:0/3308001617 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7ff55009eed0 0x7ff5500a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:13.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.392+0000 7ff579800640 1 -- 172.21.15.99:0/1058257537 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5566ce741bc0 msgr2=0x5566ce7041d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:13.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.392+0000 7ff579800640 1 --2- 172.21.15.99:0/1058257537 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5566ce741bc0 0x5566ce7041d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:13.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.392+0000 7ff579800640 1 -- 172.21.15.99:0/1058257537 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5566ce777260 msgr2=0x5566ce741680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:13.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.392+0000 7ff579800640 1 --2- 172.21.15.99:0/1058257537 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5566ce777260 0x5566ce741680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:13.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.392+0000 7ff579800640 1 -- 172.21.15.99:0/1058257537 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5566ce44c7d0 con 0x5566ce7412a0 2024-02-21T23:07:13.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.392+0000 7ff571600640 1 -- 172.21.15.99:0/3308001617 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7ff5640ebb00 con 0x7ff574180ab0 2024-02-21T23:07:13.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.392+0000 7ff579800640 1 --2- 172.21.15.99:0/1058257537 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5566ce7412a0 0x5566ce776d20 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ff56c001e90 tx=0x7ff56c0015d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e46fc1cd3887a90 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:13.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.392+0000 7ff579800640 1 --2- 172.21.15.99:0/3308001617 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7ff55009eed0 0x7ff5500a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:13.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.393+0000 7ff569600640 1 -- 172.21.15.99:0/1058257537 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56c00fe50 con 0x5566ce7412a0 2024-02-21T23:07:13.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.393+0000 7ff569600640 1 -- 172.21.15.99:0/1058257537 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff56c003970 con 0x5566ce7412a0 2024-02-21T23:07:13.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.393+0000 7ff569600640 1 -- 172.21.15.99:0/1058257537 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56c003da0 con 0x5566ce7412a0 2024-02-21T23:07:13.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.393+0000 7ff57e791740 1 -- 172.21.15.99:0/1058257537 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5566ce7412a0 msgr2=0x5566ce776d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:13.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.393+0000 7ff579800640 1 --2- 172.21.15.99:0/3308001617 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7ff55009eed0 0x7ff5500a1390 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff56c010010 tx=0x7ff56c005000 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:13.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.393+0000 7ff57e791740 1 --2- 172.21.15.99:0/1058257537 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5566ce7412a0 0x5566ce776d20 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ff56c001e90 tx=0x7ff56c0015d0 comp rx=0 tx=0).stop 2024-02-21T23:07:13.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.394+0000 7ff57e791740 1 -- 172.21.15.99:0/1058257537 shutdown_connections 2024-02-21T23:07:13.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.394+0000 7ff57e791740 1 --2- 172.21.15.99:0/1058257537 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5566ce741bc0 0x5566ce7041d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:13.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.394+0000 7ff57e791740 1 --2- 172.21.15.99:0/1058257537 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5566ce777260 0x5566ce741680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:13.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.394+0000 7ff57e791740 1 --2- 172.21.15.99:0/1058257537 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5566ce7412a0 0x5566ce776d20 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:13.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.394+0000 7ff57e791740 1 -- 172.21.15.99:0/1058257537 >> 172.21.15.99:0/1058257537 conn(0x5566ce6d06b0 msgr2=0x5566ce708190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:07:13.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.394+0000 7ff57e791740 1 -- 172.21.15.99:0/1058257537 shutdown_connections 2024-02-21T23:07:13.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.394+0000 7ff57e791740 1 -- 172.21.15.99:0/1058257537 wait complete. 2024-02-21T23:07:13.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.395+0000 7ff57e791740 1 -- start start 2024-02-21T23:07:13.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.395+0000 7ff57e791740 1 Processor -- start 2024-02-21T23:07:13.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.396+0000 7ff57e791740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5566ce7412a0 0x5566ce7371d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:13.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.396+0000 7ff57e791740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5566ce741bc0 0x5566ce73ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:13.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.396+0000 7ff57e791740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5566ce777260 0x5566ce7082e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:13.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.396+0000 7ff57e791740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566ce70ff30 con 0x5566ce7412a0 2024-02-21T23:07:13.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.396+0000 7ff57e791740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566ce60c1c0 con 0x5566ce741bc0 2024-02-21T23:07:13.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.396+0000 7ff57e791740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566ce778930 con 0x5566ce777260 2024-02-21T23:07:13.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.396+0000 7ff57e791740 10 client.0 _ll_register_callbacks cb 0x5566ce629930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:07:13.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.396+0000 7ff578e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5566ce7412a0 0x5566ce7371d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:13.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.396+0000 7ff578e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5566ce7412a0 0x5566ce7371d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:36388/0 (socket says 172.21.15.99:36388) 2024-02-21T23:07:13.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.396+0000 7ff578e00640 1 -- 172.21.15.99:0/4134613017 learned_addr learned my addr 172.21.15.99:0/4134613017 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:07:13.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.396+0000 7ff56be00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5566ce741bc0 0x5566ce73ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:13.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.397+0000 7ff579800640 1 --2- 172.21.15.99:0/4134613017 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5566ce777260 0x5566ce7082e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:13.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.397+0000 7ff56be00640 1 -- 172.21.15.99:0/4134613017 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5566ce777260 msgr2=0x5566ce7082e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:13.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.397+0000 7ff56be00640 1 --2- 172.21.15.99:0/4134613017 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5566ce777260 0x5566ce7082e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:13.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.397+0000 7ff56be00640 1 -- 172.21.15.99:0/4134613017 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5566ce7412a0 msgr2=0x5566ce7371d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:13.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.397+0000 7ff56be00640 1 --2- 172.21.15.99:0/4134613017 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5566ce7412a0 0x5566ce7371d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:13.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.397+0000 7ff56be00640 1 -- 172.21.15.99:0/4134613017 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5566ce3823f0 con 0x5566ce741bc0 2024-02-21T23:07:13.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.397+0000 7ff578e00640 1 --2- 172.21.15.99:0/4134613017 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5566ce7412a0 0x5566ce7371d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:07:13.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.397+0000 7ff56be00640 1 --2- 172.21.15.99:0/4134613017 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5566ce741bc0 0x5566ce73ee00 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ff574213a50 tx=0x7ff55c011e20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0a2c30978dd51af server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:13.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.397+0000 7ff562000640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-02-21T23:07:13.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.398+0000 7ff562000640 1 -- 172.21.15.99:0/4134613017 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55c004300 con 0x5566ce741bc0 2024-02-21T23:07:13.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.398+0000 7ff562000640 1 -- 172.21.15.99:0/4134613017 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7ff55c017790 con 0x5566ce741bc0 2024-02-21T23:07:13.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.398+0000 7ff57e791740 1 -- 172.21.15.99:0/4134613017 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff56c003970 con 0x5566ce741bc0 2024-02-21T23:07:13.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.398+0000 7ff562000640 1 -- 172.21.15.99:0/4134613017 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff55c029050 con 0x5566ce741bc0 2024-02-21T23:07:13.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.398+0000 7ff57e791740 10 client.6178 fetch_fsmap learned FSMap version 17 2024-02-21T23:07:13.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.398+0000 7ff57e791740 1 -- 172.21.15.99:0/4134613017 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5566ce3420f0 con 0x5566ce741bc0 2024-02-21T23:07:13.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.398+0000 7ff562000640 1 -- 172.21.15.99:0/4134613017 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff56c003970 con 0x5566ce741bc0 2024-02-21T23:07:13.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.399+0000 7ff562000640 1 -- 172.21.15.99:0/4134613017 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7ff55c017990 con 0x5566ce741bc0 2024-02-21T23:07:13.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.399+0000 7ff57e791740 10 client.6178 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:07:13.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.399+0000 7ff57e791740 10 client.6178 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:07:13.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.399+0000 7ff57e791740 20 client.6178 populate_metadata read hostname 'smithi099' 2024-02-21T23:07:13.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.399+0000 7ff57e791740 1 --2- 172.21.15.99:0/4134613017 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5566ce76f140 0x5566ce70e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:13.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.399+0000 7ff57e791740 4 client.6178 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:07:13.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.399+0000 7ff57e791740 1 -- 172.21.15.99:0/4134613017 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5566ce67afd0 con 0x5566ce76f140 2024-02-21T23:07:13.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.399+0000 7ff578e00640 1 --2- 172.21.15.99:0/4134613017 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5566ce76f140 0x5566ce70e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:13.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.400+0000 7ff562000640 10 client.6178 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:07:13.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.400+0000 7ff578e00640 1 --2- 172.21.15.99:0/4134613017 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5566ce76f140 0x5566ce70e6e0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf8806e1f8db7ba server_cookie=4d55fc19dadd8371 in_seq=0 out_seq=0 2024-02-21T23:07:13.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.400+0000 7ff562000640 1 -- 172.21.15.99:0/4134613017 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x5566ce67afd0 con 0x5566ce76f140 2024-02-21T23:07:13.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.400+0000 7ff562000640 10 client.6178 handle_command_reply: tid=0 2024-02-21T23:07:13.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.400+0000 7ff57e791740 1 client.6178 shutdown 2024-02-21T23:07:13.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.401+0000 7ff57e791740 1 -- 172.21.15.99:0/4134613017 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5566ce741bc0 msgr2=0x5566ce73ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:13.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.401+0000 7ff57e791740 1 --2- 172.21.15.99:0/4134613017 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5566ce741bc0 0x5566ce73ee00 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ff574213a50 tx=0x7ff55c011e20 comp rx=0 tx=0).stop 2024-02-21T23:07:13.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.401+0000 7ff57e791740 1 -- 172.21.15.99:0/4134613017 shutdown_connections 2024-02-21T23:07:13.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.401+0000 7ff57e791740 1 --2- 172.21.15.99:0/4134613017 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5566ce76f140 0x5566ce70e6e0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:13.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.401+0000 7ff57e791740 1 --2- 172.21.15.99:0/4134613017 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5566ce777260 0x5566ce7082e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:13.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.401+0000 7ff57e791740 1 --2- 172.21.15.99:0/4134613017 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5566ce741bc0 0x5566ce73ee00 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:13.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.401+0000 7ff57e791740 1 --2- 172.21.15.99:0/4134613017 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5566ce7412a0 0x5566ce7371d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:13.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.401+0000 7ff562000640 0 client.6178 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:07:13.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.401+0000 7ff57e791740 1 -- 172.21.15.99:0/4134613017 >> 172.21.15.99:0/4134613017 conn(0x5566ce6d06b0 msgr2=0x5566ce708b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:07:13.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.401+0000 7ff57e791740 1 -- 172.21.15.99:0/4134613017 shutdown_connections 2024-02-21T23:07:13.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.401+0000 7ff57e791740 1 -- 172.21.15.99:0/4134613017 wait complete. 2024-02-21T23:07:13.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.401+0000 7ff57e791740 20 client.6178 trim_cache size 0 max 16384 2024-02-21T23:07:13.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.424+0000 7ff57e791740 1 Processor -- start 2024-02-21T23:07:13.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.424+0000 7ff57e791740 1 -- start start 2024-02-21T23:07:13.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.425+0000 7ff57e791740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5566ce7412a0 0x5566ce6ff0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:13.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.425+0000 7ff57e791740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5566ce741bc0 0x5566ce76e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:13.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.425+0000 7ff57e791740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5566ce777260 0x5566ce77b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:13.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.425+0000 7ff57e791740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff574228420 con 0x5566ce741bc0 2024-02-21T23:07:13.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.425+0000 7ff57e791740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff574225fc0 con 0x5566ce7412a0 2024-02-21T23:07:13.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.425+0000 7ff57e791740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff574157f50 con 0x5566ce777260 2024-02-21T23:07:13.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.425+0000 7ff56be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5566ce741bc0 0x5566ce76e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:13.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.426+0000 7ff56be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5566ce741bc0 0x5566ce76e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:36404/0 (socket says 172.21.15.99:36404) 2024-02-21T23:07:13.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.426+0000 7ff578e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5566ce7412a0 0x5566ce6ff0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:13.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.426+0000 7ff56be00640 1 -- 172.21.15.99:0/1181985420 learned_addr learned my addr 172.21.15.99:0/1181985420 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:07:13.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.426+0000 7ff579800640 1 --2- 172.21.15.99:0/1181985420 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5566ce777260 0x5566ce77b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:13.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.426+0000 7ff56be00640 1 -- 172.21.15.99:0/1181985420 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5566ce777260 msgr2=0x5566ce77b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:13.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.426+0000 7ff56be00640 1 --2- 172.21.15.99:0/1181985420 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5566ce777260 0x5566ce77b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:13.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.426+0000 7ff56be00640 1 -- 172.21.15.99:0/1181985420 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5566ce7412a0 msgr2=0x5566ce6ff0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:13.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.426+0000 7ff56be00640 1 --2- 172.21.15.99:0/1181985420 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5566ce7412a0 0x5566ce6ff0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:13.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.426+0000 7ff56be00640 1 -- 172.21.15.99:0/1181985420 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5566ce77b2e0 con 0x5566ce741bc0 2024-02-21T23:07:13.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.426+0000 7ff578e00640 1 --2- 172.21.15.99:0/1181985420 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5566ce7412a0 0x5566ce6ff0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:07:13.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.426+0000 7ff56be00640 1 --2- 172.21.15.99:0/1181985420 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5566ce741bc0 0x5566ce76e670 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7ff55c009ff0 tx=0x7ff55c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dc43a7a04a7c2a3 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:13.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.427+0000 7ff568c00640 1 -- 172.21.15.99:0/1181985420 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55c031070 con 0x5566ce741bc0 2024-02-21T23:07:13.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.427+0000 7ff568c00640 1 -- 172.21.15.99:0/1181985420 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff55c004300 con 0x5566ce741bc0 2024-02-21T23:07:13.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.427+0000 7ff568c00640 1 -- 172.21.15.99:0/1181985420 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55c0179d0 con 0x5566ce741bc0 2024-02-21T23:07:13.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.427+0000 7ff57e791740 1 -- 172.21.15.99:0/1181985420 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5566ce741bc0 msgr2=0x5566ce76e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:13.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.427+0000 7ff57e791740 1 --2- 172.21.15.99:0/1181985420 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5566ce741bc0 0x5566ce76e670 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7ff55c009ff0 tx=0x7ff55c01a000 comp rx=0 tx=0).stop 2024-02-21T23:07:13.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.427+0000 7ff57e791740 1 -- 172.21.15.99:0/1181985420 shutdown_connections 2024-02-21T23:07:13.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.427+0000 7ff57e791740 1 --2- 172.21.15.99:0/1181985420 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5566ce777260 0x5566ce77b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:13.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.427+0000 7ff57e791740 1 --2- 172.21.15.99:0/1181985420 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5566ce741bc0 0x5566ce76e670 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:13.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.427+0000 7ff57e791740 1 --2- 172.21.15.99:0/1181985420 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5566ce7412a0 0x5566ce6ff0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:13.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.427+0000 7ff57e791740 1 -- 172.21.15.99:0/1181985420 >> 172.21.15.99:0/1181985420 conn(0x5566ce6d06b0 msgr2=0x5566ce736fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:07:13.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.428+0000 7ff57e791740 1 -- 172.21.15.99:0/1181985420 shutdown_connections 2024-02-21T23:07:13.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.428+0000 7ff57e791740 1 -- 172.21.15.99:0/1181985420 wait complete. 2024-02-21T23:07:13.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.428+0000 7ff57e791740 1 -- start start 2024-02-21T23:07:13.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.428+0000 7ff57e791740 1 Processor -- start 2024-02-21T23:07:13.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.431+0000 7ff57e791740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5566ce7412a0 0x5566ce6ff2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:13.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.431+0000 7ff57e791740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5566ce741bc0 0x5566ce7e55d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:13.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.431+0000 7ff57e791740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5566ce777260 0x5566ce7997e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:13.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.431+0000 7ff57e791740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5740cae60 con 0x5566ce777260 2024-02-21T23:07:13.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.431+0000 7ff57e791740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff574225960 con 0x5566ce741bc0 2024-02-21T23:07:13.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.431+0000 7ff57e791740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff57421d590 con 0x5566ce7412a0 2024-02-21T23:07:13.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.431+0000 7ff57e791740 10 client.0 _ll_register_callbacks cb 0x7ff55c0115d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:07:13.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.431+0000 7ff579800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5566ce777260 0x5566ce7997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:13.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.431+0000 7ff56be00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5566ce741bc0 0x5566ce7e55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:13.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.431+0000 7ff579800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5566ce777260 0x5566ce7997e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:36408/0 (socket says 172.21.15.99:36408) 2024-02-21T23:07:13.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.431+0000 7ff56be00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5566ce741bc0 0x5566ce7e55d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:56424/0 (socket says 172.21.15.99:56424) 2024-02-21T23:07:13.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.431+0000 7ff579800640 1 -- 172.21.15.99:0/3382930433 learned_addr learned my addr 172.21.15.99:0/3382930433 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:07:13.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.431+0000 7ff578e00640 1 --2- 172.21.15.99:0/3382930433 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5566ce7412a0 0x5566ce6ff2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:13.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.431+0000 7ff56be00640 1 -- 172.21.15.99:0/3382930433 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5566ce7412a0 msgr2=0x5566ce6ff2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:13.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.431+0000 7ff56be00640 1 --2- 172.21.15.99:0/3382930433 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5566ce7412a0 0x5566ce6ff2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:13.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.431+0000 7ff56be00640 1 -- 172.21.15.99:0/3382930433 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5566ce777260 msgr2=0x5566ce7997e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:13.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.431+0000 7ff56be00640 1 --2- 172.21.15.99:0/3382930433 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5566ce777260 0x5566ce7997e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:13.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.431+0000 7ff56be00640 1 -- 172.21.15.99:0/3382930433 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5566ce799d20 con 0x5566ce741bc0 2024-02-21T23:07:13.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.431+0000 7ff579800640 1 --2- 172.21.15.99:0/3382930433 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5566ce777260 0x5566ce7997e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:07:13.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.432+0000 7ff56be00640 1 --2- 172.21.15.99:0/3382930433 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5566ce741bc0 0x5566ce7e55d0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff55c009d20 tx=0x7ff55c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=551e16b100508012 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:13.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.432+0000 7ff562000640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-02-21T23:07:13.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.432+0000 7ff562000640 1 -- 172.21.15.99:0/3382930433 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55c03a070 con 0x5566ce741bc0 2024-02-21T23:07:13.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.432+0000 7ff562000640 1 -- 172.21.15.99:0/3382930433 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7ff55c017790 con 0x5566ce741bc0 2024-02-21T23:07:13.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.432+0000 7ff57e791740 1 -- 172.21.15.99:0/3382930433 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff55c004300 con 0x5566ce741bc0 2024-02-21T23:07:13.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.432+0000 7ff562000640 1 -- 172.21.15.99:0/3382930433 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff55c045050 con 0x5566ce741bc0 2024-02-21T23:07:13.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.433+0000 7ff57e791740 10 client.6184 fetch_fsmap learned FSMap version 17 2024-02-21T23:07:13.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.433+0000 7ff57e791740 1 -- 172.21.15.99:0/3382930433 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5566ce73fa40 con 0x5566ce741bc0 2024-02-21T23:07:13.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.433+0000 7ff562000640 1 -- 172.21.15.99:0/3382930433 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff55c004300 con 0x5566ce741bc0 2024-02-21T23:07:13.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.433+0000 7ff562000640 1 -- 172.21.15.99:0/3382930433 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7ff55c017990 con 0x5566ce741bc0 2024-02-21T23:07:13.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.433+0000 7ff57e791740 10 client.6184 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:07:13.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.433+0000 7ff57e791740 10 client.6184 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:07:13.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.433+0000 7ff57e791740 20 client.6184 populate_metadata read hostname 'smithi099' 2024-02-21T23:07:13.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.433+0000 7ff57e791740 1 --2- 172.21.15.99:0/3382930433 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5566ce7058e0 0x5566ce77b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:13.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.433+0000 7ff57e791740 4 client.6184 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T23:07:13.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.433+0000 7ff57e791740 1 -- 172.21.15.99:0/3382930433 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5566ce675320 con 0x5566ce7058e0 2024-02-21T23:07:13.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.433+0000 7ff578e00640 1 --2- 172.21.15.99:0/3382930433 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5566ce7058e0 0x5566ce77b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:13.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.434+0000 7ff578e00640 1 --2- 172.21.15.99:0/3382930433 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5566ce7058e0 0x5566ce77b950 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1a31ade8fe90757 server_cookie=45b8fa2c4f7e22d5 in_seq=0 out_seq=0 2024-02-21T23:07:13.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.434+0000 7ff562000640 10 client.6184 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:07:13.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.434+0000 7ff562000640 1 -- 172.21.15.99:0/3382930433 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5566ce675320 con 0x5566ce7058e0 2024-02-21T23:07:13.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.434+0000 7ff562000640 10 client.6184 handle_command_reply: tid=0 2024-02-21T23:07:13.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.434+0000 7ff57e791740 1 client.6184 shutdown 2024-02-21T23:07:13.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.434+0000 7ff57e791740 1 -- 172.21.15.99:0/3382930433 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5566ce741bc0 msgr2=0x5566ce7e55d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:13.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.434+0000 7ff57e791740 1 --2- 172.21.15.99:0/3382930433 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5566ce741bc0 0x5566ce7e55d0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff55c009d20 tx=0x7ff55c0046c0 comp rx=0 tx=0).stop 2024-02-21T23:07:13.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.435+0000 7ff57e791740 1 -- 172.21.15.99:0/3382930433 shutdown_connections 2024-02-21T23:07:13.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.435+0000 7ff57e791740 1 --2- 172.21.15.99:0/3382930433 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5566ce7058e0 0x5566ce77b950 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:13.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.435+0000 7ff57e791740 1 --2- 172.21.15.99:0/3382930433 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5566ce777260 0x5566ce7997e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:13.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.435+0000 7ff57e791740 1 --2- 172.21.15.99:0/3382930433 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5566ce741bc0 0x5566ce7e55d0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:13.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.435+0000 7ff57e791740 1 --2- 172.21.15.99:0/3382930433 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5566ce7412a0 0x5566ce6ff2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:13.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.435+0000 7ff562000640 0 client.6184 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:07:13.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.435+0000 7ff57e791740 1 -- 172.21.15.99:0/3382930433 >> 172.21.15.99:0/3382930433 conn(0x5566ce6d06b0 msgr2=0x5566ce772200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:07:13.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.435+0000 7ff57e791740 1 -- 172.21.15.99:0/3382930433 shutdown_connections 2024-02-21T23:07:13.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.435+0000 7ff57e791740 1 -- 172.21.15.99:0/3382930433 wait complete. 2024-02-21T23:07:13.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.435+0000 7ff57e791740 20 client.6184 trim_cache size 0 max 16384 2024-02-21T23:07:13.430 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-02-21T23:07:13.430 INFO:teuthology.orchestra.run.smithi099.stdout: "status": "no active scrubs running", 2024-02-21T23:07:13.431 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubs": {} 2024-02-21T23:07:13.431 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-02-21T23:07:13.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.435+0000 7ff57a200640 1 -- 172.21.15.99:0/3308001617 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7ff55009eed0 msgr2=0x7ff5500a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:13.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.435+0000 7ff57a200640 1 --2- 172.21.15.99:0/3308001617 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7ff55009eed0 0x7ff5500a1390 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff56c010010 tx=0x7ff56c005000 comp rx=0 tx=0).stop 2024-02-21T23:07:13.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.436+0000 7ff57a200640 1 -- 172.21.15.99:0/3308001617 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff574180ab0 msgr2=0x7ff574210e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:13.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.436+0000 7ff57a200640 1 --2- 172.21.15.99:0/3308001617 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff574180ab0 0x7ff574210e80 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff564033000 tx=0x7ff5640046c0 comp rx=0 tx=0).stop 2024-02-21T23:07:13.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.436+0000 7ff57a200640 1 -- 172.21.15.99:0/3308001617 shutdown_connections 2024-02-21T23:07:13.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.436+0000 7ff57a200640 1 --2- 172.21.15.99:0/3308001617 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7ff55009eed0 0x7ff5500a1390 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:13.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.436+0000 7ff57a200640 1 --2- 172.21.15.99:0/3308001617 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff574189660 0x7ff57420eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:13.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.436+0000 7ff57a200640 1 --2- 172.21.15.99:0/3308001617 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff5741891e0 0x7ff5741729c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:13.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.436+0000 7ff57a200640 1 --2- 172.21.15.99:0/3308001617 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff574180ab0 0x7ff574210e80 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:13.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.436+0000 7ff57a200640 1 -- 172.21.15.99:0/3308001617 >> 172.21.15.99:0/3308001617 conn(0x7ff5740ce4b0 msgr2=0x7ff5740cca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:07:13.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.436+0000 7ff57a200640 1 -- 172.21.15.99:0/3308001617 shutdown_connections 2024-02-21T23:07:13.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.436+0000 7ff57a200640 1 -- 172.21.15.99:0/3308001617 wait complete. 2024-02-21T23:07:13.443 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-02-21T23:07:13.444 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T23:07:13.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.682+0000 7f517a400640 1 Processor -- start 2024-02-21T23:07:13.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.682+0000 7f517a400640 1 -- start start 2024-02-21T23:07:13.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.684+0000 7f517a400640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f517418a010 0x7f517418b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:13.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.684+0000 7f517a400640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f517418a600 con 0x7f5174182a80 2024-02-21T23:07:13.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.684+0000 7f517a400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f517418a8e0 con 0x7f51740719b0 2024-02-21T23:07:13.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.684+0000 7f517a400640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f517418bec0 con 0x7f517418a010 2024-02-21T23:07:13.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.684+0000 7f5179000640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f5174182a80 0x7f5174186a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:39296/0 (socket says 172.21.15.99:39296) 2024-02-21T23:07:13.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.684+0000 7f5179000640 1 -- 172.21.15.99:0/2540183050 learned_addr learned my addr 172.21.15.99:0/2540183050 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:07:13.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.684+0000 7f5173e00640 1 --2- 172.21.15.99:0/2540183050 >> v2:172.21.15.181:3300/0 conn(0x7f517418a010 0x7f517418b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:13.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.685+0000 7f5173400640 1 -- 172.21.15.99:0/2540183050 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2593631006 0 0) 0x7f517418a600 con 0x7f5174182a80 2024-02-21T23:07:13.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.685+0000 7f5173400640 1 -- 172.21.15.99:0/2540183050 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f515c003520 con 0x7f5174182a80 2024-02-21T23:07:13.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.685+0000 7f5173400640 1 -- 172.21.15.99:0/2540183050 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1821054086 0 0) 0x7f517418a8e0 con 0x7f51740719b0 2024-02-21T23:07:13.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.685+0000 7f5173e00640 1 -- 172.21.15.99:0/2540183050 >> v1:172.21.15.162:6789/0 conn(0x7f51740719b0 legacy=0x7f5174071e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:13.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.685+0000 7f5173e00640 1 -- 172.21.15.99:0/2540183050 >> v1:172.21.15.99:6789/0 conn(0x7f5174182a80 legacy=0x7f5174186a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:13.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.685+0000 7f5173e00640 1 -- 172.21.15.99:0/2540183050 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f517418abc0 con 0x7f517418a010 2024-02-21T23:07:13.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.686+0000 7f5173e00640 1 --2- 172.21.15.99:0/2540183050 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f517418a010 0x7f517418b980 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f5160009790 tx=0x7f516002b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68f9de2834ea637c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:13.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.686+0000 7f5173400640 1 -- 172.21.15.99:0/2540183050 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51600315a0 con 0x7f517418a010 2024-02-21T23:07:13.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.686+0000 7f5173400640 1 -- 172.21.15.99:0/2540183050 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5160037070 con 0x7f517418a010 2024-02-21T23:07:13.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.686+0000 7f5173400640 1 -- 172.21.15.99:0/2540183050 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5160031960 con 0x7f517418a010 2024-02-21T23:07:13.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.687+0000 7f517a400640 1 -- 172.21.15.99:0/2540183050 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f517418a010 msgr2=0x7f517418b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:13.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.687+0000 7f517a400640 1 --2- 172.21.15.99:0/2540183050 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f517418a010 0x7f517418b980 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f5160009790 tx=0x7f516002b840 comp rx=0 tx=0).stop 2024-02-21T23:07:13.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.687+0000 7f517a400640 1 -- 172.21.15.99:0/2540183050 shutdown_connections 2024-02-21T23:07:13.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.687+0000 7f517a400640 1 --2- 172.21.15.99:0/2540183050 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f517418a010 0x7f517418b980 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:13.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.687+0000 7f517a400640 1 -- 172.21.15.99:0/2540183050 >> 172.21.15.99:0/2540183050 conn(0x7f51740d29f0 msgr2=0x7f51740d2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:07:13.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.687+0000 7f517a400640 1 -- 172.21.15.99:0/2540183050 shutdown_connections 2024-02-21T23:07:13.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.687+0000 7f517a400640 1 -- 172.21.15.99:0/2540183050 wait complete. 2024-02-21T23:07:13.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.691+0000 7f517a400640 1 Processor -- start 2024-02-21T23:07:13.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.691+0000 7f517a400640 1 -- start start 2024-02-21T23:07:13.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.693+0000 7f517a400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51740719b0 0x7f5174181e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:13.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.693+0000 7f517a400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5174182a80 0x7f517415fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:13.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.693+0000 7f517a400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f517418a010 0x7f51740f3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:13.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.693+0000 7f517a400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f517418b460 con 0x7f5174182a80 2024-02-21T23:07:13.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.693+0000 7f517a400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f517418b180 con 0x7f51740719b0 2024-02-21T23:07:13.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.693+0000 7f517a400640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5174182e60 con 0x7f517418a010 2024-02-21T23:07:13.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.693+0000 7f5173e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5174182a80 0x7f517415fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:13.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.693+0000 7f5179000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51740719b0 0x7f5174181e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:13.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.693+0000 7f5179a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f517418a010 0x7f51740f3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:13.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.693+0000 7f5179000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51740719b0 0x7f5174181e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:56430/0 (socket says 172.21.15.99:56430) 2024-02-21T23:07:13.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.693+0000 7f5179000640 1 -- 172.21.15.99:0/3570827729 learned_addr learned my addr 172.21.15.99:0/3570827729 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:07:13.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.694+0000 7f5179a00640 1 -- 172.21.15.99:0/3570827729 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51740719b0 msgr2=0x7f5174181e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:13.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.694+0000 7f5179a00640 1 --2- 172.21.15.99:0/3570827729 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51740719b0 0x7f5174181e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:13.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.694+0000 7f5179a00640 1 -- 172.21.15.99:0/3570827729 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5174182a80 msgr2=0x7f517415fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:13.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.694+0000 7f5179a00640 1 --2- 172.21.15.99:0/3570827729 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5174182a80 0x7f517415fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:13.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.694+0000 7f5179a00640 1 -- 172.21.15.99:0/3570827729 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51740fd320 con 0x7f517418a010 2024-02-21T23:07:13.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.694+0000 7f5179000640 1 --2- 172.21.15.99:0/3570827729 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51740719b0 0x7f5174181e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:07:13.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.694+0000 7f5179a00640 1 --2- 172.21.15.99:0/3570827729 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f517418a010 0x7f51740f3ba0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f516c00c6d0 tx=0x7f516c00cb90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:13.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.694+0000 7f5170c00640 1 -- 172.21.15.99:0/3570827729 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f516c003b70 con 0x7f517418a010 2024-02-21T23:07:13.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.694+0000 7f5170c00640 1 -- 172.21.15.99:0/3570827729 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f516c003d30 con 0x7f517418a010 2024-02-21T23:07:13.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.694+0000 7f517a400640 1 -- 172.21.15.99:0/3570827729 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51740fd600 con 0x7f517418a010 2024-02-21T23:07:13.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.694+0000 7f5170c00640 1 -- 172.21.15.99:0/3570827729 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f516c0052b0 con 0x7f517418a010 2024-02-21T23:07:13.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.695+0000 7f517a400640 1 -- 172.21.15.99:0/3570827729 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51740fdbc0 con 0x7f517418a010 2024-02-21T23:07:13.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.696+0000 7f517a400640 1 -- 172.21.15.99:0/3570827729 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f517418b980 con 0x7f517418a010 2024-02-21T23:07:13.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.699+0000 7f5170c00640 1 -- 172.21.15.99:0/3570827729 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f516c005660 con 0x7f517418a010 2024-02-21T23:07:13.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.701+0000 7f5170c00640 1 --2- 172.21.15.99:0/3570827729 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f515409eed0 0x7f51540a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:13.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.701+0000 7f5170c00640 1 -- 172.21.15.99:0/3570827729 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f516c0ca9a0 con 0x7f517418a010 2024-02-21T23:07:13.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.701+0000 7f5179000640 1 --2- 172.21.15.99:0/3570827729 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f515409eed0 0x7f51540a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:13.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.702+0000 7f5170c00640 1 -- 172.21.15.99:0/3570827729 <== mon.2 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f517418b980 con 0x7f517418a010 2024-02-21T23:07:13.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.702+0000 7f5179000640 1 --2- 172.21.15.99:0/3570827729 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f515409eed0 0x7f51540a1390 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f51680011e0 tx=0x7f5168009040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:13.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.961+0000 7f517a400640 1 -- 172.21.15.99:0/3570827729 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5174068320 con 0x7f517418a010 2024-02-21T23:07:13.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.962+0000 7f5170c00640 1 -- 172.21.15.99:0/3570827729 <== mon.2 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+11335 (secure 0 0 0) 0x7f516c098980 con 0x7f517418a010 2024-02-21T23:07:13.951 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T23:07:13.951 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4307,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/3514452812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3514452812},{"type":"v1","addr":"172.21.15.162:6836","nonce":3514452812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4312,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6838/2169982089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":2169982089},{"type":"v1","addr":"172.21.15.162:6838","nonce":2169982089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4315,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6839/3335972724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6837","nonce":3335972724},{"type":"v1","addr":"172.21.15.162:6839","nonce":3335972724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4318,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6841/2135456697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6840","nonce":2135456697},{"type":"v1","addr":"172.21.15.162:6841","nonce":2135456697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4325,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2452242758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2452242758},{"type":"v1","addr":"172.21.15.181:6833","nonce":2452242758}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4328,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6836/2751486400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":2751486400},{"type":"v1","addr":"172.21.15.181:6836","nonce":2751486400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":17,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-21T23:01:02.656130+0000","modified":"2024-02-21T23:07:03.165223+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4355,"mds_1":4352,"mds_2":4348},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4331":{"gid":4331,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6838/3728901330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6835","nonce":3728901330},{"type":"v1","addr":"172.21.15.181:6838","nonce":3728901330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4339":{"gid":4339,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6839/3357929641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6837","nonce":3357929641},{"type":"v1","addr":"172.21.15.181:6839","nonce":3357929641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4343":{"gid":4343,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6833/2793485078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":2793485078},{"type":"v1","addr":"172.21.15.99:6833","nonce":2793485078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4348":{"gid":4348,"name":"d","rank":2,"incarnation":12,"state":"up:active","state_seq":10,"addr":"172.21.15.99:6835/2243461688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2243461688},{"type":"v1","addr":"172.21.15.99:6835","nonce":2243461688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4352":{"gid":4352,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.99:6837/1676159950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":1676159950},{"type":"v1","addr":"172.21.15.99:6837","nonce":1676159950}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4355":{"gid":4355,"name":"j","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6839/4239008786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":4239008786},{"type":"v1","addr":"172.21.15.99:6839","nonce":4239008786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-21T23:07:13.952 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 17 2024-02-21T23:07:13.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.966+0000 7f517a400640 1 -- 172.21.15.99:0/3570827729 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f515409eed0 msgr2=0x7f51540a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:13.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.966+0000 7f517a400640 1 --2- 172.21.15.99:0/3570827729 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f515409eed0 0x7f51540a1390 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f51680011e0 tx=0x7f5168009040 comp rx=0 tx=0).stop 2024-02-21T23:07:13.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.966+0000 7f517a400640 1 -- 172.21.15.99:0/3570827729 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f517418a010 msgr2=0x7f51740f3ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:13.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.966+0000 7f517a400640 1 --2- 172.21.15.99:0/3570827729 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f517418a010 0x7f51740f3ba0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f516c00c6d0 tx=0x7f516c00cb90 comp rx=0 tx=0).stop 2024-02-21T23:07:13.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.966+0000 7f517a400640 1 -- 172.21.15.99:0/3570827729 shutdown_connections 2024-02-21T23:07:13.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.966+0000 7f517a400640 1 --2- 172.21.15.99:0/3570827729 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f515409eed0 0x7f51540a1390 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:13.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.966+0000 7f517a400640 1 --2- 172.21.15.99:0/3570827729 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f517418a010 0x7f51740f3ba0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:13.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.966+0000 7f517a400640 1 --2- 172.21.15.99:0/3570827729 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5174182a80 0x7f517415fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:13.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.966+0000 7f517a400640 1 --2- 172.21.15.99:0/3570827729 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51740719b0 0x7f5174181e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:13.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.966+0000 7f517a400640 1 -- 172.21.15.99:0/3570827729 >> 172.21.15.99:0/3570827729 conn(0x7f51740d29f0 msgr2=0x7f517418c040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:07:13.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.966+0000 7f517a400640 1 -- 172.21.15.99:0/3570827729 shutdown_connections 2024-02-21T23:07:13.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:13.966+0000 7f517a400640 1 -- 172.21.15.99:0/3570827729 wait complete. 2024-02-21T23:07:13.973 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T23:07:13.973 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-02-21T23:07:14.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.216+0000 7f2b73200640 1 Processor -- start 2024-02-21T23:07:14.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.216+0000 7f2b73200640 1 -- start start 2024-02-21T23:07:14.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.219+0000 7f2b73200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2b7418b230 0x7f2b740fc280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:14.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.219+0000 7f2b73200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b740d6dd0 con 0x7f2b7417f490 2024-02-21T23:07:14.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.219+0000 7f2b73200640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b741614c0 con 0x7f2b740fc7c0 2024-02-21T23:07:14.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.219+0000 7f2b73200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b740d6810 con 0x7f2b7418b230 2024-02-21T23:07:14.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.219+0000 7f2b71e00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f2b7417f490 0x7f2b7418ab20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:39300/0 (socket says 172.21.15.99:39300) 2024-02-21T23:07:14.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.219+0000 7f2b71e00640 1 -- 172.21.15.99:0/850066020 learned_addr learned my addr 172.21.15.99:0/850066020 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:07:14.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.219+0000 7f2b71400640 1 --2- 172.21.15.99:0/850066020 >> v2:172.21.15.162:3300/0 conn(0x7f2b7418b230 0x7f2b740fc280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:14.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.220+0000 7f2b70a00640 1 -- 172.21.15.99:0/850066020 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2442226269 0 0) 0x7f2b741614c0 con 0x7f2b740fc7c0 2024-02-21T23:07:14.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.220+0000 7f2b71400640 1 -- 172.21.15.99:0/850066020 >> v1:172.21.15.181:6789/0 conn(0x7f2b740fc7c0 legacy=0x7f2b740fcc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:14.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.220+0000 7f2b71400640 1 -- 172.21.15.99:0/850066020 >> v1:172.21.15.99:6789/0 conn(0x7f2b7417f490 legacy=0x7f2b7418ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:14.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.220+0000 7f2b71400640 1 -- 172.21.15.99:0/850066020 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b740d6af0 con 0x7f2b7418b230 2024-02-21T23:07:14.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.221+0000 7f2b71400640 1 --2- 172.21.15.99:0/850066020 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b7418b230 0x7f2b740fc280 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f2b600097a0 tx=0x7f2b6002b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=926584a1c4399e8a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:14.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.221+0000 7f2b70a00640 1 -- 172.21.15.99:0/850066020 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b60037070 con 0x7f2b7418b230 2024-02-21T23:07:14.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.221+0000 7f2b70a00640 1 -- 172.21.15.99:0/850066020 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b60030710 con 0x7f2b7418b230 2024-02-21T23:07:14.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.221+0000 7f2b70a00640 1 -- 172.21.15.99:0/850066020 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b60030ae0 con 0x7f2b7418b230 2024-02-21T23:07:14.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.222+0000 7f2b73200640 1 -- 172.21.15.99:0/850066020 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b7418b230 msgr2=0x7f2b740fc280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:14.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.222+0000 7f2b73200640 1 --2- 172.21.15.99:0/850066020 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b7418b230 0x7f2b740fc280 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f2b600097a0 tx=0x7f2b6002b790 comp rx=0 tx=0).stop 2024-02-21T23:07:14.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.222+0000 7f2b73200640 1 -- 172.21.15.99:0/850066020 shutdown_connections 2024-02-21T23:07:14.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.222+0000 7f2b73200640 1 --2- 172.21.15.99:0/850066020 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b7418b230 0x7f2b740fc280 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.222+0000 7f2b73200640 1 -- 172.21.15.99:0/850066020 >> 172.21.15.99:0/850066020 conn(0x7f2b740d29b0 msgr2=0x7f2b740d2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:07:14.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.222+0000 7f2b73200640 1 -- 172.21.15.99:0/850066020 shutdown_connections 2024-02-21T23:07:14.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.222+0000 7f2b73200640 1 -- 172.21.15.99:0/850066020 wait complete. 2024-02-21T23:07:14.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.225+0000 7f2b73200640 1 Processor -- start 2024-02-21T23:07:14.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.225+0000 7f2b73200640 1 -- start start 2024-02-21T23:07:14.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.227+0000 7f2b73200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b740fc7c0 0x7f2b742204e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:14.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.227+0000 7f2b73200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b7417f490 0x7f2b741789f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:14.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.227+0000 7f2b73200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b7418b230 0x7f2b741595e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:14.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.227+0000 7f2b73200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7418a600 con 0x7f2b7417f490 2024-02-21T23:07:14.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.227+0000 7f2b73200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7418a320 con 0x7f2b7418b230 2024-02-21T23:07:14.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.227+0000 7f2b73200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7418b6c0 con 0x7f2b740fc7c0 2024-02-21T23:07:14.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.227+0000 7f2b71e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b740fc7c0 0x7f2b742204e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:14.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.228+0000 7f2b71400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b7417f490 0x7f2b741789f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:14.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.228+0000 7f2b71e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b740fc7c0 0x7f2b742204e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:37586/0 (socket says 172.21.15.99:37586) 2024-02-21T23:07:14.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.228+0000 7f2b71e00640 1 -- 172.21.15.99:0/3351342695 learned_addr learned my addr 172.21.15.99:0/3351342695 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:07:14.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.228+0000 7f2b72800640 1 --2- 172.21.15.99:0/3351342695 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b7418b230 0x7f2b741595e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:14.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.228+0000 7f2b71e00640 1 -- 172.21.15.99:0/3351342695 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b7418b230 msgr2=0x7f2b741595e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:14.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.228+0000 7f2b71e00640 1 --2- 172.21.15.99:0/3351342695 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b7418b230 0x7f2b741595e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.228+0000 7f2b71e00640 1 -- 172.21.15.99:0/3351342695 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b7417f490 msgr2=0x7f2b741789f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:14.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.228+0000 7f2b71e00640 1 --2- 172.21.15.99:0/3351342695 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b7417f490 0x7f2b741789f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.228+0000 7f2b71e00640 1 -- 172.21.15.99:0/3351342695 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b74177670 con 0x7f2b740fc7c0 2024-02-21T23:07:14.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.228+0000 7f2b71e00640 1 --2- 172.21.15.99:0/3351342695 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b740fc7c0 0x7f2b742204e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f2b6400c800 tx=0x7f2b6400ccc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:14.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.229+0000 7f2b6a000640 1 -- 172.21.15.99:0/3351342695 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b64018070 con 0x7f2b740fc7c0 2024-02-21T23:07:14.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.229+0000 7f2b6a000640 1 -- 172.21.15.99:0/3351342695 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b640072d0 con 0x7f2b740fc7c0 2024-02-21T23:07:14.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.229+0000 7f2b6a000640 1 -- 172.21.15.99:0/3351342695 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b640047e0 con 0x7f2b740fc7c0 2024-02-21T23:07:14.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.229+0000 7f2b73200640 1 -- 172.21.15.99:0/3351342695 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b74177950 con 0x7f2b740fc7c0 2024-02-21T23:07:14.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.229+0000 7f2b73200640 1 -- 172.21.15.99:0/3351342695 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b74177f10 con 0x7f2b740fc7c0 2024-02-21T23:07:14.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.234+0000 7f2b6a000640 1 -- 172.21.15.99:0/3351342695 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f2b64004980 con 0x7f2b740fc7c0 2024-02-21T23:07:14.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.234+0000 7f2b7ba22740 1 Processor -- start 2024-02-21T23:07:14.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.234+0000 7f2b7ba22740 1 -- start start 2024-02-21T23:07:14.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.235+0000 7f2b6a000640 1 --2- 172.21.15.99:0/3351342695 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f2b5409eed0 0x7f2b540a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:14.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.236+0000 7f2b6a000640 1 -- 172.21.15.99:0/3351342695 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f2b640c9430 con 0x7f2b740fc7c0 2024-02-21T23:07:14.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.236+0000 7f2b72800640 1 --2- 172.21.15.99:0/3351342695 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f2b5409eed0 0x7f2b540a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:14.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.236+0000 7f2b72800640 1 --2- 172.21.15.99:0/3351342695 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f2b5409eed0 0x7f2b540a1390 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c0012e0 tx=0x7f2b6c009040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:14.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.237+0000 7f2b7ba22740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b2e388660 0x563b2e388a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:14.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.237+0000 7f2b7ba22740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563b2e3c3330 0x563b2e3c37b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:14.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.237+0000 7f2b7ba22740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b2e3c3cf0 0x563b2e3c4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:14.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.237+0000 7f2b7ba22740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b2e2b0b50 con 0x563b2e3c3330 2024-02-21T23:07:14.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.237+0000 7f2b7ba22740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b2e259da0 con 0x563b2e3c3cf0 2024-02-21T23:07:14.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.237+0000 7f2b7ba22740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b2e2acbf0 con 0x563b2e388660 2024-02-21T23:07:14.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.237+0000 7f2b71e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b2e388660 0x563b2e388a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:14.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.237+0000 7f2b71e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b2e388660 0x563b2e388a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:37598/0 (socket says 172.21.15.99:37598) 2024-02-21T23:07:14.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.237+0000 7f2b71e00640 1 -- 172.21.15.99:0/551993776 learned_addr learned my addr 172.21.15.99:0/551993776 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:07:14.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.237+0000 7f2b72800640 1 --2- 172.21.15.99:0/551993776 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b2e3c3cf0 0x563b2e3c4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:14.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.237+0000 7f2b71400640 1 --2- 172.21.15.99:0/551993776 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563b2e3c3330 0x563b2e3c37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:14.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.237+0000 7f2b71e00640 1 -- 172.21.15.99:0/551993776 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b2e3c3cf0 msgr2=0x563b2e3c4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:14.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.237+0000 7f2b71e00640 1 --2- 172.21.15.99:0/551993776 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b2e3c3cf0 0x563b2e3c4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.237+0000 7f2b71e00640 1 -- 172.21.15.99:0/551993776 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563b2e3c3330 msgr2=0x563b2e3c37b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:14.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.237+0000 7f2b71e00640 1 --2- 172.21.15.99:0/551993776 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563b2e3c3330 0x563b2e3c37b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.237+0000 7f2b71e00640 1 -- 172.21.15.99:0/551993776 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563b2e27cf80 con 0x563b2e388660 2024-02-21T23:07:14.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.237+0000 7f2b71400640 1 --2- 172.21.15.99:0/551993776 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563b2e3c3330 0x563b2e3c37b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:07:14.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.237+0000 7f2b72800640 1 --2- 172.21.15.99:0/551993776 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b2e3c3cf0 0x563b2e3c4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:07:14.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.238+0000 7f2b71e00640 1 --2- 172.21.15.99:0/551993776 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b2e388660 0x563b2e388a40 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f2b6400a430 tx=0x7f2b640966e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79bd78c72597d92 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:14.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.238+0000 7f2b5e600640 1 -- 172.21.15.99:0/551993776 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b64096d80 con 0x563b2e388660 2024-02-21T23:07:14.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.238+0000 7f2b5e600640 1 -- 172.21.15.99:0/551993776 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b6409ae20 con 0x563b2e388660 2024-02-21T23:07:14.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.238+0000 7f2b5e600640 1 -- 172.21.15.99:0/551993776 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b6409f470 con 0x563b2e388660 2024-02-21T23:07:14.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.239+0000 7f2b7ba22740 1 -- 172.21.15.99:0/551993776 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b2e388660 msgr2=0x563b2e388a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:14.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.239+0000 7f2b7ba22740 1 --2- 172.21.15.99:0/551993776 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b2e388660 0x563b2e388a40 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f2b6400a430 tx=0x7f2b640966e0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.239+0000 7f2b7ba22740 1 -- 172.21.15.99:0/551993776 shutdown_connections 2024-02-21T23:07:14.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.239+0000 7f2b7ba22740 1 --2- 172.21.15.99:0/551993776 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b2e3c3cf0 0x563b2e3c4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.239+0000 7f2b7ba22740 1 --2- 172.21.15.99:0/551993776 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563b2e3c3330 0x563b2e3c37b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.239+0000 7f2b7ba22740 1 --2- 172.21.15.99:0/551993776 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b2e388660 0x563b2e388a40 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.239+0000 7f2b7ba22740 1 -- 172.21.15.99:0/551993776 >> 172.21.15.99:0/551993776 conn(0x563b2e34a6d0 msgr2=0x563b2e34b750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:07:14.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.239+0000 7f2b7ba22740 1 -- 172.21.15.99:0/551993776 shutdown_connections 2024-02-21T23:07:14.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.239+0000 7f2b7ba22740 1 -- 172.21.15.99:0/551993776 wait complete. 2024-02-21T23:07:14.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.240+0000 7f2b7ba22740 1 -- start start 2024-02-21T23:07:14.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.240+0000 7f2b7ba22740 1 Processor -- start 2024-02-21T23:07:14.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.242+0000 7f2b7ba22740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b2e3c3330 0x563b2e380080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:14.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.242+0000 7f2b7ba22740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563b2e3c3cf0 0x563b2e346480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:14.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.242+0000 7f2b7ba22740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b2e373ac0 0x563b2e3cc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:14.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.242+0000 7f2b7ba22740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b2e3c20a0 con 0x563b2e3c3cf0 2024-02-21T23:07:14.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.242+0000 7f2b7ba22740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b2e24f380 con 0x563b2e373ac0 2024-02-21T23:07:14.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.242+0000 7f2b7ba22740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b2e3c1dc0 con 0x563b2e3c3330 2024-02-21T23:07:14.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.242+0000 7f2b7ba22740 10 client.0 _ll_register_callbacks cb 0x563b2e2a8280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:07:14.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.242+0000 7f2b71e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b2e3c3330 0x563b2e380080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:14.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.242+0000 7f2b71400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563b2e3c3cf0 0x563b2e346480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:14.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.242+0000 7f2b71e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b2e3c3330 0x563b2e380080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:37612/0 (socket says 172.21.15.99:37612) 2024-02-21T23:07:14.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.242+0000 7f2b71e00640 1 -- 172.21.15.99:0/3120127013 learned_addr learned my addr 172.21.15.99:0/3120127013 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:07:14.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.242+0000 7f2b72800640 1 --2- 172.21.15.99:0/3120127013 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b2e373ac0 0x563b2e3cc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:14.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.242+0000 7f2b71e00640 1 -- 172.21.15.99:0/3120127013 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b2e373ac0 msgr2=0x563b2e3cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:14.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.243+0000 7f2b71e00640 1 --2- 172.21.15.99:0/3120127013 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b2e373ac0 0x563b2e3cc9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.243+0000 7f2b71e00640 1 -- 172.21.15.99:0/3120127013 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563b2e3c3cf0 msgr2=0x563b2e346480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:14.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.243+0000 7f2b71e00640 1 --2- 172.21.15.99:0/3120127013 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563b2e3c3cf0 0x563b2e346480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.243+0000 7f2b71e00640 1 -- 172.21.15.99:0/3120127013 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563b2e277c20 con 0x563b2e3c3330 2024-02-21T23:07:14.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.243+0000 7f2b72800640 1 --2- 172.21.15.99:0/3120127013 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b2e373ac0 0x563b2e3cc9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:07:14.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.243+0000 7f2b71e00640 1 --2- 172.21.15.99:0/3120127013 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b2e3c3330 0x563b2e380080 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f2b64001350 tx=0x7f2b6401e000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb7f251ac2c05852 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:14.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.243+0000 7f2b52a00640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-02-21T23:07:14.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.243+0000 7f2b52a00640 1 -- 172.21.15.99:0/3120127013 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b640b4060 con 0x563b2e3c3330 2024-02-21T23:07:14.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.243+0000 7f2b52a00640 1 -- 172.21.15.99:0/3120127013 <== mon.2 v2:172.21.15.181:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f2b640963e0 con 0x563b2e3c3330 2024-02-21T23:07:14.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.243+0000 7f2b7ba22740 1 -- 172.21.15.99:0/3120127013 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2b6409ae20 con 0x563b2e3c3330 2024-02-21T23:07:14.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.243+0000 7f2b52a00640 1 -- 172.21.15.99:0/3120127013 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2b6409f470 con 0x563b2e3c3330 2024-02-21T23:07:14.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.243+0000 7f2b7ba22740 10 client.6212 fetch_fsmap learned FSMap version 17 2024-02-21T23:07:14.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.243+0000 7f2b7ba22740 1 -- 172.21.15.99:0/3120127013 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x563b2dfc53f0 con 0x563b2e3c3330 2024-02-21T23:07:14.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.244+0000 7f2b52a00640 1 -- 172.21.15.99:0/3120127013 <== mon.2 v2:172.21.15.181:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b6409ae20 con 0x563b2e3c3330 2024-02-21T23:07:14.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.244+0000 7f2b52a00640 1 -- 172.21.15.99:0/3120127013 <== mon.2 v2:172.21.15.181:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f2b64076be0 con 0x563b2e3c3330 2024-02-21T23:07:14.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.244+0000 7f2b7ba22740 10 client.6212 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:07:14.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.244+0000 7f2b7ba22740 10 client.6212 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.d 2024-02-21T23:07:14.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.244+0000 7f2b7ba22740 20 client.6212 populate_metadata read hostname 'smithi099' 2024-02-21T23:07:14.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.244+0000 7f2b7ba22740 1 --2- 172.21.15.99:0/3120127013 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x563b2e3480d0 0x563b2e348580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:14.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.244+0000 7f2b7ba22740 4 client.6212 mds_command: new command op to 4348 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:07:14.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.244+0000 7f2b7ba22740 1 -- 172.21.15.99:0/3120127013 --> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563b2e2be090 con 0x563b2e3480d0 2024-02-21T23:07:14.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.244+0000 7f2b71400640 1 --2- 172.21.15.99:0/3120127013 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x563b2e3480d0 0x563b2e348580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:14.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.245+0000 7f2b52a00640 10 client.6212 ms_handle_connect on v2:172.21.15.99:6834/2243461688 2024-02-21T23:07:14.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.245+0000 7f2b71400640 1 --2- 172.21.15.99:0/3120127013 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x563b2e3480d0 0x563b2e348580 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7ee6bb0140659d59 server_cookie=cacf75afc93433c0 in_seq=0 out_seq=0 2024-02-21T23:07:14.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.246+0000 7f2b52a00640 1 -- 172.21.15.99:0/3120127013 <== mds.2 v2:172.21.15.99:6834/2243461688 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x563b2e2be090 con 0x563b2e3480d0 2024-02-21T23:07:14.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.246+0000 7f2b52a00640 10 client.6212 handle_command_reply: tid=0 2024-02-21T23:07:14.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.246+0000 7f2b7ba22740 1 client.6212 shutdown 2024-02-21T23:07:14.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.246+0000 7f2b7ba22740 1 -- 172.21.15.99:0/3120127013 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b2e3c3330 msgr2=0x563b2e380080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:14.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.246+0000 7f2b7ba22740 1 --2- 172.21.15.99:0/3120127013 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b2e3c3330 0x563b2e380080 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f2b64001350 tx=0x7f2b6401e000 comp rx=0 tx=0).stop 2024-02-21T23:07:14.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.246+0000 7f2b7ba22740 1 -- 172.21.15.99:0/3120127013 shutdown_connections 2024-02-21T23:07:14.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.246+0000 7f2b7ba22740 1 --2- 172.21.15.99:0/3120127013 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x563b2e3480d0 0x563b2e348580 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.246+0000 7f2b7ba22740 1 --2- 172.21.15.99:0/3120127013 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b2e373ac0 0x563b2e3cc9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.246+0000 7f2b52a00640 0 client.6212 ms_handle_reset on v2:172.21.15.99:6834/2243461688 2024-02-21T23:07:14.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.246+0000 7f2b7ba22740 1 --2- 172.21.15.99:0/3120127013 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563b2e3c3cf0 0x563b2e346480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.246+0000 7f2b7ba22740 1 --2- 172.21.15.99:0/3120127013 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b2e3c3330 0x563b2e380080 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.246+0000 7f2b7ba22740 1 -- 172.21.15.99:0/3120127013 >> 172.21.15.99:0/3120127013 conn(0x563b2e388660 msgr2=0x563b2e3820d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:07:14.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.246+0000 7f2b7ba22740 1 -- 172.21.15.99:0/3120127013 shutdown_connections 2024-02-21T23:07:14.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.246+0000 7f2b7ba22740 1 -- 172.21.15.99:0/3120127013 wait complete. 2024-02-21T23:07:14.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.246+0000 7f2b7ba22740 20 client.6212 trim_cache size 0 max 16384 2024-02-21T23:07:14.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.260+0000 7f2b7ba22740 1 Processor -- start 2024-02-21T23:07:14.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.260+0000 7f2b7ba22740 1 -- start start 2024-02-21T23:07:14.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.261+0000 7f2b7ba22740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b2e3480d0 0x563b2e379ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:14.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.261+0000 7f2b7ba22740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b2e373ac0 0x563b2e37a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:14.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.261+0000 7f2b7ba22740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563b2e3c3330 0x563b2e37a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:14.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.261+0000 7f2b7ba22740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7422c780 con 0x563b2e3c3330 2024-02-21T23:07:14.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.261+0000 7f2b7ba22740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7422a320 con 0x563b2e373ac0 2024-02-21T23:07:14.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.261+0000 7f2b7ba22740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b740f3060 con 0x563b2e3480d0 2024-02-21T23:07:14.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.262+0000 7f2b72800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563b2e3c3330 0x563b2e37a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:14.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.262+0000 7f2b72800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563b2e3c3330 0x563b2e37a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:36470/0 (socket says 172.21.15.99:36470) 2024-02-21T23:07:14.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.262+0000 7f2b72800640 1 -- 172.21.15.99:0/1316862308 learned_addr learned my addr 172.21.15.99:0/1316862308 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:07:14.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.262+0000 7f2b71e00640 1 --2- 172.21.15.99:0/1316862308 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b2e3480d0 0x563b2e379ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:14.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.262+0000 7f2b71400640 1 --2- 172.21.15.99:0/1316862308 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b2e373ac0 0x563b2e37a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:14.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.262+0000 7f2b71e00640 1 -- 172.21.15.99:0/1316862308 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b2e373ac0 msgr2=0x563b2e37a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:14.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.262+0000 7f2b71e00640 1 --2- 172.21.15.99:0/1316862308 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b2e373ac0 0x563b2e37a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.262+0000 7f2b71e00640 1 -- 172.21.15.99:0/1316862308 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563b2e3c3330 msgr2=0x563b2e37a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:14.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.262+0000 7f2b71e00640 1 --2- 172.21.15.99:0/1316862308 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563b2e3c3330 0x563b2e37a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.262+0000 7f2b71e00640 1 -- 172.21.15.99:0/1316862308 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563b2e08f7d0 con 0x563b2e3480d0 2024-02-21T23:07:14.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.262+0000 7f2b72800640 1 --2- 172.21.15.99:0/1316862308 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563b2e3c3330 0x563b2e37a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:07:14.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.263+0000 7f2b71e00640 1 --2- 172.21.15.99:0/1316862308 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b2e3480d0 0x563b2e379ed0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f2b64093670 tx=0x7f2b64098000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6cb940c339b23922 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:14.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.263+0000 7f2b5dc00640 1 -- 172.21.15.99:0/1316862308 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b640b4040 con 0x563b2e3480d0 2024-02-21T23:07:14.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.263+0000 7f2b5dc00640 1 -- 172.21.15.99:0/1316862308 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b6409ae20 con 0x563b2e3480d0 2024-02-21T23:07:14.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.263+0000 7f2b5dc00640 1 -- 172.21.15.99:0/1316862308 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b64096d80 con 0x563b2e3480d0 2024-02-21T23:07:14.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.264+0000 7f2b7ba22740 1 -- 172.21.15.99:0/1316862308 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b2e3480d0 msgr2=0x563b2e379ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:14.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.264+0000 7f2b7ba22740 1 --2- 172.21.15.99:0/1316862308 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b2e3480d0 0x563b2e379ed0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f2b64093670 tx=0x7f2b64098000 comp rx=0 tx=0).stop 2024-02-21T23:07:14.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.264+0000 7f2b7ba22740 1 -- 172.21.15.99:0/1316862308 shutdown_connections 2024-02-21T23:07:14.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.264+0000 7f2b7ba22740 1 --2- 172.21.15.99:0/1316862308 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563b2e3c3330 0x563b2e37a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.264+0000 7f2b7ba22740 1 --2- 172.21.15.99:0/1316862308 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b2e373ac0 0x563b2e37a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.264+0000 7f2b7ba22740 1 --2- 172.21.15.99:0/1316862308 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b2e3480d0 0x563b2e379ed0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.264+0000 7f2b7ba22740 1 -- 172.21.15.99:0/1316862308 >> 172.21.15.99:0/1316862308 conn(0x563b2e388660 msgr2=0x563b2e352190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:07:14.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.264+0000 7f2b7ba22740 1 -- 172.21.15.99:0/1316862308 shutdown_connections 2024-02-21T23:07:14.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.264+0000 7f2b7ba22740 1 -- 172.21.15.99:0/1316862308 wait complete. 2024-02-21T23:07:14.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.265+0000 7f2b7ba22740 1 -- start start 2024-02-21T23:07:14.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.265+0000 7f2b7ba22740 1 Processor -- start 2024-02-21T23:07:14.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.266+0000 7f2b7ba22740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b2e3480d0 0x563b2e351ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:14.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.266+0000 7f2b7ba22740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b2e373ac0 0x563b2e381f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:14.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.266+0000 7f2b7ba22740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563b2e3c3330 0x563b2e390ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:14.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.266+0000 7f2b7ba22740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b74228b10 con 0x563b2e3c3330 2024-02-21T23:07:14.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.266+0000 7f2b7ba22740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b74229cc0 con 0x563b2e3480d0 2024-02-21T23:07:14.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.266+0000 7f2b7ba22740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b74229040 con 0x563b2e373ac0 2024-02-21T23:07:14.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.266+0000 7f2b7ba22740 10 client.0 _ll_register_callbacks cb 0x7f2b64015070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:07:14.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.267+0000 7f2b72800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563b2e3c3330 0x563b2e390ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:14.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.267+0000 7f2b72800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563b2e3c3330 0x563b2e390ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:36478/0 (socket says 172.21.15.99:36478) 2024-02-21T23:07:14.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.267+0000 7f2b72800640 1 -- 172.21.15.99:0/1486999565 learned_addr learned my addr 172.21.15.99:0/1486999565 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:07:14.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.267+0000 7f2b71400640 1 --2- 172.21.15.99:0/1486999565 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b2e373ac0 0x563b2e381f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:14.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.267+0000 7f2b71e00640 1 --2- 172.21.15.99:0/1486999565 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b2e3480d0 0x563b2e351ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:14.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.267+0000 7f2b71400640 1 -- 172.21.15.99:0/1486999565 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b2e3480d0 msgr2=0x563b2e351ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:14.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.267+0000 7f2b71400640 1 --2- 172.21.15.99:0/1486999565 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b2e3480d0 0x563b2e351ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.267+0000 7f2b71400640 1 -- 172.21.15.99:0/1486999565 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563b2e3c3330 msgr2=0x563b2e390ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:14.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.267+0000 7f2b71400640 1 --2- 172.21.15.99:0/1486999565 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563b2e3c3330 0x563b2e390ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.267+0000 7f2b71400640 1 -- 172.21.15.99:0/1486999565 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563b2e38cc00 con 0x563b2e373ac0 2024-02-21T23:07:14.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.267+0000 7f2b72800640 1 --2- 172.21.15.99:0/1486999565 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563b2e3c3330 0x563b2e390ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:07:14.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.267+0000 7f2b71e00640 1 --2- 172.21.15.99:0/1486999565 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b2e3480d0 0x563b2e351ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:07:14.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.267+0000 7f2b71400640 1 --2- 172.21.15.99:0/1486999565 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b2e373ac0 0x563b2e381f30 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f2b74160a80 tx=0x7f2b60004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df0c24e1b065c49c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:14.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.267+0000 7f2b52a00640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-02-21T23:07:14.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.268+0000 7f2b52a00640 1 -- 172.21.15.99:0/1486999565 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b6004f020 con 0x563b2e373ac0 2024-02-21T23:07:14.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.268+0000 7f2b52a00640 1 -- 172.21.15.99:0/1486999565 <== mon.2 v2:172.21.15.181:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f2b6004b070 con 0x563b2e373ac0 2024-02-21T23:07:14.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.268+0000 7f2b7ba22740 1 -- 172.21.15.99:0/1486999565 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2b6409ae20 con 0x563b2e373ac0 2024-02-21T23:07:14.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.268+0000 7f2b52a00640 1 -- 172.21.15.99:0/1486999565 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2b6005a050 con 0x563b2e373ac0 2024-02-21T23:07:14.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.268+0000 7f2b7ba22740 10 client.6218 fetch_fsmap learned FSMap version 17 2024-02-21T23:07:14.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.268+0000 7f2b7ba22740 1 -- 172.21.15.99:0/1486999565 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x563b2e38d780 con 0x563b2e373ac0 2024-02-21T23:07:14.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.268+0000 7f2b52a00640 1 -- 172.21.15.99:0/1486999565 <== mon.2 v2:172.21.15.181:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b6409ae20 con 0x563b2e373ac0 2024-02-21T23:07:14.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.269+0000 7f2b52a00640 1 -- 172.21.15.99:0/1486999565 <== mon.2 v2:172.21.15.181:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f2b600307f0 con 0x563b2e373ac0 2024-02-21T23:07:14.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.269+0000 7f2b7ba22740 10 client.6218 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:07:14.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.269+0000 7f2b7ba22740 10 client.6218 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.d 2024-02-21T23:07:14.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.269+0000 7f2b7ba22740 20 client.6218 populate_metadata read hostname 'smithi099' 2024-02-21T23:07:14.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.269+0000 7f2b7ba22740 1 --2- 172.21.15.99:0/1486999565 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x563b2e3c3cf0 0x563b2e428710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:14.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.269+0000 7f2b7ba22740 4 client.6218 mds_command: new command op to 4348 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T23:07:14.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.269+0000 7f2b7ba22740 1 -- 172.21.15.99:0/1486999565 --> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x563b2e2b83e0 con 0x563b2e3c3cf0 2024-02-21T23:07:14.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.269+0000 7f2b71e00640 1 --2- 172.21.15.99:0/1486999565 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x563b2e3c3cf0 0x563b2e428710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:14.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.270+0000 7f2b71e00640 1 --2- 172.21.15.99:0/1486999565 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x563b2e3c3cf0 0x563b2e428710 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f68fb8dd51289793 server_cookie=366773f6aa3fa59 in_seq=0 out_seq=0 2024-02-21T23:07:14.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.270+0000 7f2b52a00640 10 client.6218 ms_handle_connect on v2:172.21.15.99:6834/2243461688 2024-02-21T23:07:14.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.270+0000 7f2b52a00640 1 -- 172.21.15.99:0/1486999565 <== mds.2 v2:172.21.15.99:6834/2243461688 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x563b2e2b83e0 con 0x563b2e3c3cf0 2024-02-21T23:07:14.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.270+0000 7f2b52a00640 10 client.6218 handle_command_reply: tid=0 2024-02-21T23:07:14.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.270+0000 7f2b7ba22740 1 client.6218 shutdown 2024-02-21T23:07:14.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.270+0000 7f2b7ba22740 1 -- 172.21.15.99:0/1486999565 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b2e373ac0 msgr2=0x563b2e381f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:14.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.270+0000 7f2b7ba22740 1 --2- 172.21.15.99:0/1486999565 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b2e373ac0 0x563b2e381f30 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f2b74160a80 tx=0x7f2b60004730 comp rx=0 tx=0).stop 2024-02-21T23:07:14.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.270+0000 7f2b7ba22740 1 -- 172.21.15.99:0/1486999565 shutdown_connections 2024-02-21T23:07:14.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.270+0000 7f2b7ba22740 1 --2- 172.21.15.99:0/1486999565 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x563b2e3c3cf0 0x563b2e428710 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.270+0000 7f2b7ba22740 1 --2- 172.21.15.99:0/1486999565 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563b2e3c3330 0x563b2e390ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.270+0000 7f2b7ba22740 1 --2- 172.21.15.99:0/1486999565 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b2e373ac0 0x563b2e381f30 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.270+0000 7f2b52a00640 0 client.6218 ms_handle_reset on v2:172.21.15.99:6834/2243461688 2024-02-21T23:07:14.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.270+0000 7f2b7ba22740 1 --2- 172.21.15.99:0/1486999565 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b2e3480d0 0x563b2e351ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.270+0000 7f2b7ba22740 1 -- 172.21.15.99:0/1486999565 >> 172.21.15.99:0/1486999565 conn(0x563b2e388660 msgr2=0x563b2e37fbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:07:14.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.271+0000 7f2b7ba22740 1 -- 172.21.15.99:0/1486999565 shutdown_connections 2024-02-21T23:07:14.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.271+0000 7f2b7ba22740 1 -- 172.21.15.99:0/1486999565 wait complete. 2024-02-21T23:07:14.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.271+0000 7f2b7ba22740 20 client.6218 trim_cache size 0 max 16384 2024-02-21T23:07:14.267 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-02-21T23:07:14.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.271+0000 7f2b73200640 1 -- 172.21.15.99:0/3351342695 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f2b5409eed0 msgr2=0x7f2b540a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:14.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.272+0000 7f2b73200640 1 --2- 172.21.15.99:0/3351342695 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f2b5409eed0 0x7f2b540a1390 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c0012e0 tx=0x7f2b6c009040 comp rx=0 tx=0).stop 2024-02-21T23:07:14.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.272+0000 7f2b73200640 1 -- 172.21.15.99:0/3351342695 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b740fc7c0 msgr2=0x7f2b742204e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:14.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.272+0000 7f2b73200640 1 --2- 172.21.15.99:0/3351342695 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b740fc7c0 0x7f2b742204e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f2b6400c800 tx=0x7f2b6400ccc0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.272+0000 7f2b73200640 1 -- 172.21.15.99:0/3351342695 shutdown_connections 2024-02-21T23:07:14.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.272+0000 7f2b73200640 1 --2- 172.21.15.99:0/3351342695 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f2b5409eed0 0x7f2b540a1390 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.272+0000 7f2b73200640 1 --2- 172.21.15.99:0/3351342695 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b7418b230 0x7f2b741595e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.272+0000 7f2b73200640 1 --2- 172.21.15.99:0/3351342695 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2b7417f490 0x7f2b741789f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.272+0000 7f2b73200640 1 --2- 172.21.15.99:0/3351342695 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2b740fc7c0 0x7f2b742204e0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.272+0000 7f2b73200640 1 -- 172.21.15.99:0/3351342695 >> 172.21.15.99:0/3351342695 conn(0x7f2b740d29b0 msgr2=0x7f2b74160ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:07:14.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.272+0000 7f2b73200640 1 -- 172.21.15.99:0/3351342695 shutdown_connections 2024-02-21T23:07:14.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.272+0000 7f2b73200640 1 -- 172.21.15.99:0/3351342695 wait complete. 2024-02-21T23:07:14.281 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T23:07:14.281 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-02-21T23:07:14.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.495+0000 7f1335c00640 1 Processor -- start 2024-02-21T23:07:14.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.496+0000 7f1335c00640 1 -- start start 2024-02-21T23:07:14.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.497+0000 7f1335c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f1330180c80 0x7f1330187f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:14.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.497+0000 7f1335c00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f133006ee40 con 0x7f133006e910 2024-02-21T23:07:14.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.497+0000 7f1335c00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f133006f120 con 0x7f1330188440 2024-02-21T23:07:14.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.497+0000 7f1335c00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f133006f400 con 0x7f1330180c80 2024-02-21T23:07:14.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.498+0000 7f132ea00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f1330180c80 0x7f1330187f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:14.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.498+0000 7f1326000640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f133006e910 0x7f13300cb420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:39302/0 (socket says 172.21.15.99:39302) 2024-02-21T23:07:14.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.498+0000 7f1326000640 1 -- 172.21.15.99:0/3348371552 learned_addr learned my addr 172.21.15.99:0/3348371552 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:07:14.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.498+0000 7f132ea00640 1 -- 172.21.15.99:0/3348371552 >> v1:172.21.15.181:6789/0 conn(0x7f1330188440 legacy=0x7f13300f4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:14.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.498+0000 7f132ea00640 1 -- 172.21.15.99:0/3348371552 >> v1:172.21.15.99:6789/0 conn(0x7f133006e910 legacy=0x7f13300cb420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:14.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.498+0000 7f132ea00640 1 -- 172.21.15.99:0/3348371552 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f133006f6e0 con 0x7f1330180c80 2024-02-21T23:07:14.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.498+0000 7f132e000640 1 -- 172.21.15.99:0/3348371552 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1215849601 0 0) 0x7f133006f120 con 0x7f1330188440 2024-02-21T23:07:14.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.500+0000 7f132ea00640 1 --2- 172.21.15.99:0/3348371552 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1330180c80 0x7f1330187f00 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f1320009d90 tx=0x7f132002beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51908e840cb8186b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:14.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.500+0000 7f132e000640 1 -- 172.21.15.99:0/3348371552 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1320039070 con 0x7f1330180c80 2024-02-21T23:07:14.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.500+0000 7f132e000640 1 -- 172.21.15.99:0/3348371552 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f132002cc60 con 0x7f1330180c80 2024-02-21T23:07:14.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.500+0000 7f132e000640 1 -- 172.21.15.99:0/3348371552 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1320034660 con 0x7f1330180c80 2024-02-21T23:07:14.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.501+0000 7f1335c00640 1 -- 172.21.15.99:0/3348371552 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1330180c80 msgr2=0x7f1330187f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:14.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.501+0000 7f1335c00640 1 --2- 172.21.15.99:0/3348371552 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1330180c80 0x7f1330187f00 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f1320009d90 tx=0x7f132002beb0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.501+0000 7f1335c00640 1 -- 172.21.15.99:0/3348371552 shutdown_connections 2024-02-21T23:07:14.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.501+0000 7f1335c00640 1 --2- 172.21.15.99:0/3348371552 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1330180c80 0x7f1330187f00 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.501+0000 7f1335c00640 1 -- 172.21.15.99:0/3348371552 >> 172.21.15.99:0/3348371552 conn(0x7f13300ce5f0 msgr2=0x7f13300cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:07:14.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.501+0000 7f1335c00640 1 -- 172.21.15.99:0/3348371552 shutdown_connections 2024-02-21T23:07:14.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.501+0000 7f1335c00640 1 -- 172.21.15.99:0/3348371552 wait complete. 2024-02-21T23:07:14.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.503+0000 7f1335c00640 1 Processor -- start 2024-02-21T23:07:14.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.504+0000 7f1335c00640 1 -- start start 2024-02-21T23:07:14.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.506+0000 7f1335c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f133006e910 0x7f1330163480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:14.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.506+0000 7f1335c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1330180c80 0x7f133017b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:14.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.506+0000 7f1335c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1330188440 0x7f133017ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:14.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.506+0000 7f1335c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13300701c0 con 0x7f133006e910 2024-02-21T23:07:14.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.506+0000 7f1335c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f133006fca0 con 0x7f1330188440 2024-02-21T23:07:14.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.506+0000 7f1335c00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1330070340 con 0x7f1330180c80 2024-02-21T23:07:14.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.506+0000 7f132ea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f133006e910 0x7f1330163480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:14.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.506+0000 7f132ea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f133006e910 0x7f1330163480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:36488/0 (socket says 172.21.15.99:36488) 2024-02-21T23:07:14.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.506+0000 7f132ea00640 1 -- 172.21.15.99:0/2337334518 learned_addr learned my addr 172.21.15.99:0/2337334518 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:07:14.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.507+0000 7f1326000640 1 --2- 172.21.15.99:0/2337334518 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1330180c80 0x7f133017b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:14.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.507+0000 7f132f400640 1 --2- 172.21.15.99:0/2337334518 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1330188440 0x7f133017ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:14.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.507+0000 7f132ea00640 1 -- 172.21.15.99:0/2337334518 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1330180c80 msgr2=0x7f133017b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:14.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.507+0000 7f132ea00640 1 --2- 172.21.15.99:0/2337334518 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1330180c80 0x7f133017b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.507+0000 7f132ea00640 1 -- 172.21.15.99:0/2337334518 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1330188440 msgr2=0x7f133017ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:14.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.507+0000 7f132ea00640 1 --2- 172.21.15.99:0/2337334518 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1330188440 0x7f133017ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.507+0000 7f132ea00640 1 -- 172.21.15.99:0/2337334518 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f133016ab90 con 0x7f133006e910 2024-02-21T23:07:14.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.507+0000 7f132f400640 1 --2- 172.21.15.99:0/2337334518 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1330188440 0x7f133017ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:07:14.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.507+0000 7f132ea00640 1 --2- 172.21.15.99:0/2337334518 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f133006e910 0x7f1330163480 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f1320037040 tx=0x7f1320004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:14.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.508+0000 7f1327400640 1 -- 172.21.15.99:0/2337334518 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1320039050 con 0x7f133006e910 2024-02-21T23:07:14.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.508+0000 7f1327400640 1 -- 172.21.15.99:0/2337334518 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1320045070 con 0x7f133006e910 2024-02-21T23:07:14.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.508+0000 7f1327400640 1 -- 172.21.15.99:0/2337334518 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f132003ea50 con 0x7f133006e910 2024-02-21T23:07:14.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.508+0000 7f1335c00640 1 -- 172.21.15.99:0/2337334518 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f133016ae70 con 0x7f133006e910 2024-02-21T23:07:14.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.508+0000 7f1335c00640 1 -- 172.21.15.99:0/2337334518 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f133016b430 con 0x7f133006e910 2024-02-21T23:07:14.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.511+0000 7f1327400640 1 -- 172.21.15.99:0/2337334518 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f132002cb20 con 0x7f133006e910 2024-02-21T23:07:14.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.514+0000 7f1327400640 1 --2- 172.21.15.99:0/2337334518 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f130c09eed0 0x7f130c0a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:14.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.514+0000 7f1327400640 1 -- 172.21.15.99:0/2337334518 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f13200ece80 con 0x7f133006e910 2024-02-21T23:07:14.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.514+0000 7f1326000640 1 --2- 172.21.15.99:0/2337334518 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f130c09eed0 0x7f130c0a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:14.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.514+0000 7f1338a7e740 1 Processor -- start 2024-02-21T23:07:14.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.515+0000 7f1338a7e740 1 -- start start 2024-02-21T23:07:14.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.515+0000 7f1326000640 1 --2- 172.21.15.99:0/2337334518 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f130c09eed0 0x7f130c0a1390 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f133017e5c0 tx=0x7f1318009040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:14.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.516+0000 7f1338a7e740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e62adc95a0 0x55e62adccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:14.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.516+0000 7f1338a7e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e62ad7fd40 0x55e62adc9980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:14.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.516+0000 7f1338a7e740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e62adffa00 0x55e62adffe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:14.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.516+0000 7f1338a7e740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e62ace9b50 con 0x55e62adc95a0 2024-02-21T23:07:14.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.516+0000 7f1338a7e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e62ac92da0 con 0x55e62ad7fd40 2024-02-21T23:07:14.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.516+0000 7f1338a7e740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e62ace5bf0 con 0x55e62adffa00 2024-02-21T23:07:14.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.516+0000 7f132ea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e62adc95a0 0x55e62adccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:14.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.516+0000 7f1326000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e62ad7fd40 0x55e62adc9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:14.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.516+0000 7f132ea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e62adc95a0 0x55e62adccb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:36494/0 (socket says 172.21.15.99:36494) 2024-02-21T23:07:14.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.516+0000 7f1326000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e62ad7fd40 0x55e62adc9980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:56514/0 (socket says 172.21.15.99:56514) 2024-02-21T23:07:14.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.516+0000 7f132ea00640 1 -- 172.21.15.99:0/1878969937 learned_addr learned my addr 172.21.15.99:0/1878969937 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:07:14.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.516+0000 7f132f400640 1 --2- 172.21.15.99:0/1878969937 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e62adffa00 0x55e62adffe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:14.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.517+0000 7f1326000640 1 -- 172.21.15.99:0/1878969937 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e62adffa00 msgr2=0x55e62adffe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:14.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.517+0000 7f1326000640 1 --2- 172.21.15.99:0/1878969937 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e62adffa00 0x55e62adffe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.517+0000 7f1326000640 1 -- 172.21.15.99:0/1878969937 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e62adc95a0 msgr2=0x55e62adccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:14.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.517+0000 7f1326000640 1 --2- 172.21.15.99:0/1878969937 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e62adc95a0 0x55e62adccb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.517+0000 7f1326000640 1 -- 172.21.15.99:0/1878969937 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e62acb5f80 con 0x55e62ad7fd40 2024-02-21T23:07:14.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.517+0000 7f132ea00640 1 --2- 172.21.15.99:0/1878969937 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e62adc95a0 0x55e62adccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:07:14.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.517+0000 7f1326000640 1 --2- 172.21.15.99:0/1878969937 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e62ad7fd40 0x55e62adc9980 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f133017aa10 tx=0x7f1318011000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc8fde80e075c705 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:14.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.517+0000 7f131f400640 1 -- 172.21.15.99:0/1878969937 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f131800e4a0 con 0x55e62ad7fd40 2024-02-21T23:07:14.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.517+0000 7f131f400640 1 -- 172.21.15.99:0/1878969937 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f131800e640 con 0x55e62ad7fd40 2024-02-21T23:07:14.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.517+0000 7f131f400640 1 -- 172.21.15.99:0/1878969937 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f131800ea30 con 0x55e62ad7fd40 2024-02-21T23:07:14.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.518+0000 7f1338a7e740 1 -- 172.21.15.99:0/1878969937 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e62ad7fd40 msgr2=0x55e62adc9980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:14.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.518+0000 7f1338a7e740 1 --2- 172.21.15.99:0/1878969937 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e62ad7fd40 0x55e62adc9980 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f133017aa10 tx=0x7f1318011000 comp rx=0 tx=0).stop 2024-02-21T23:07:14.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.518+0000 7f1338a7e740 1 -- 172.21.15.99:0/1878969937 shutdown_connections 2024-02-21T23:07:14.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.518+0000 7f1338a7e740 1 --2- 172.21.15.99:0/1878969937 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e62adffa00 0x55e62adffe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.518+0000 7f1338a7e740 1 --2- 172.21.15.99:0/1878969937 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e62ad7fd40 0x55e62adc9980 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.518+0000 7f1338a7e740 1 --2- 172.21.15.99:0/1878969937 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e62adc95a0 0x55e62adccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.518+0000 7f1338a7e740 1 -- 172.21.15.99:0/1878969937 >> 172.21.15.99:0/1878969937 conn(0x55e62ad83520 msgr2=0x55e62ad845a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:07:14.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.518+0000 7f1338a7e740 1 -- 172.21.15.99:0/1878969937 shutdown_connections 2024-02-21T23:07:14.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.519+0000 7f1338a7e740 1 -- 172.21.15.99:0/1878969937 wait complete. 2024-02-21T23:07:14.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.519+0000 7f1338a7e740 1 -- start start 2024-02-21T23:07:14.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.520+0000 7f1338a7e740 1 Processor -- start 2024-02-21T23:07:14.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.521+0000 7f1338a7e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e62adc95a0 0x55e62ae0c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:14.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.521+0000 7f1338a7e740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e62adffa00 0x55e62adb0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:14.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.521+0000 7f1338a7e740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e62adbbe30 0x55e62adbad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:14.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.521+0000 7f1338a7e740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e62adc9ec0 con 0x55e62adffa00 2024-02-21T23:07:14.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.521+0000 7f1338a7e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e62ac88380 con 0x55e62adc95a0 2024-02-21T23:07:14.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.521+0000 7f1338a7e740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e62ad801c0 con 0x55e62adbbe30 2024-02-21T23:07:14.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.521+0000 7f1338a7e740 10 client.0 _ll_register_callbacks cb 0x55e62ace1280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:07:14.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.521+0000 7f132ea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e62adc95a0 0x55e62ae0c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:14.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.521+0000 7f132ea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e62adc95a0 0x55e62ae0c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:56522/0 (socket says 172.21.15.99:56522) 2024-02-21T23:07:14.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.521+0000 7f132ea00640 1 -- 172.21.15.99:0/2427635016 learned_addr learned my addr 172.21.15.99:0/2427635016 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:07:14.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.521+0000 7f1326000640 1 --2- 172.21.15.99:0/2427635016 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e62adffa00 0x55e62adb0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:14.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.522+0000 7f132ea00640 1 -- 172.21.15.99:0/2427635016 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e62adbbe30 msgr2=0x55e62adbad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:14.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.522+0000 7f132ea00640 1 --2- 172.21.15.99:0/2427635016 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e62adbbe30 0x55e62adbad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.522+0000 7f132ea00640 1 -- 172.21.15.99:0/2427635016 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e62adffa00 msgr2=0x55e62adb0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:14.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.522+0000 7f132ea00640 1 --2- 172.21.15.99:0/2427635016 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e62adffa00 0x55e62adb0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.522+0000 7f132ea00640 1 -- 172.21.15.99:0/2427635016 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e62acb0c20 con 0x55e62adc95a0 2024-02-21T23:07:14.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.522+0000 7f1326000640 1 --2- 172.21.15.99:0/2427635016 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e62adffa00 0x55e62adb0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:07:14.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.522+0000 7f132ea00640 1 --2- 172.21.15.99:0/2427635016 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e62adc95a0 0x55e62ae0c480 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f13200ea4b0 tx=0x7f13200ba080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26e456d49670821e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:14.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.522+0000 7f1313e00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-02-21T23:07:14.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.522+0000 7f1313e00640 1 -- 172.21.15.99:0/2427635016 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13200ba720 con 0x55e62adc95a0 2024-02-21T23:07:14.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.522+0000 7f1338a7e740 1 -- 172.21.15.99:0/2427635016 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f131800e640 con 0x55e62adc95a0 2024-02-21T23:07:14.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.522+0000 7f1313e00640 1 -- 172.21.15.99:0/2427635016 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f13200c2a30 con 0x55e62adc95a0 2024-02-21T23:07:14.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.522+0000 7f1313e00640 1 -- 172.21.15.99:0/2427635016 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f13200be870 con 0x55e62adc95a0 2024-02-21T23:07:14.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.522+0000 7f1338a7e740 10 client.6220 fetch_fsmap learned FSMap version 17 2024-02-21T23:07:14.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.522+0000 7f1338a7e740 1 -- 172.21.15.99:0/2427635016 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55e62a9fe3f0 con 0x55e62adc95a0 2024-02-21T23:07:14.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.523+0000 7f1313e00640 1 -- 172.21.15.99:0/2427635016 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f131800e640 con 0x55e62adc95a0 2024-02-21T23:07:14.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.523+0000 7f1313e00640 1 -- 172.21.15.99:0/2427635016 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f13200eabb0 con 0x55e62adc95a0 2024-02-21T23:07:14.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.523+0000 7f1338a7e740 10 client.6220 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:07:14.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.523+0000 7f1338a7e740 10 client.6220 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2024-02-21T23:07:14.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.523+0000 7f1338a7e740 20 client.6220 populate_metadata read hostname 'smithi099' 2024-02-21T23:07:14.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.523+0000 7f1338a7e740 1 --2- 172.21.15.99:0/2427635016 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x55e62adbc2b0 0x55e62ae0d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:14.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.523+0000 7f1338a7e740 4 client.6220 mds_command: new command op to 4352 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:07:14.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.523+0000 7f1338a7e740 1 -- 172.21.15.99:0/2427635016 --> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e62acf7090 con 0x55e62adbc2b0 2024-02-21T23:07:14.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.523+0000 7f1326000640 1 --2- 172.21.15.99:0/2427635016 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x55e62adbc2b0 0x55e62ae0d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:14.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.524+0000 7f1326000640 1 --2- 172.21.15.99:0/2427635016 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x55e62adbc2b0 0x55e62ae0d640 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3e48e38b4d82ec03 server_cookie=7909e4458cad50fd in_seq=0 out_seq=0 2024-02-21T23:07:14.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.524+0000 7f1313e00640 10 client.6220 ms_handle_connect on v2:172.21.15.99:6836/1676159950 2024-02-21T23:07:14.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.525+0000 7f1313e00640 1 -- 172.21.15.99:0/2427635016 <== mds.1 v2:172.21.15.99:6836/1676159950 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55e62acf7090 con 0x55e62adbc2b0 2024-02-21T23:07:14.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.525+0000 7f1313e00640 10 client.6220 handle_command_reply: tid=0 2024-02-21T23:07:14.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.525+0000 7f1338a7e740 1 client.6220 shutdown 2024-02-21T23:07:14.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.525+0000 7f1338a7e740 1 -- 172.21.15.99:0/2427635016 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e62adc95a0 msgr2=0x55e62ae0c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:14.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.525+0000 7f1338a7e740 1 --2- 172.21.15.99:0/2427635016 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e62adc95a0 0x55e62ae0c480 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f13200ea4b0 tx=0x7f13200ba080 comp rx=0 tx=0).stop 2024-02-21T23:07:14.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.525+0000 7f1338a7e740 1 -- 172.21.15.99:0/2427635016 shutdown_connections 2024-02-21T23:07:14.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.525+0000 7f1338a7e740 1 --2- 172.21.15.99:0/2427635016 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x55e62adbc2b0 0x55e62ae0d640 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.525+0000 7f1338a7e740 1 --2- 172.21.15.99:0/2427635016 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e62adbbe30 0x55e62adbad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.525+0000 7f1338a7e740 1 --2- 172.21.15.99:0/2427635016 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e62adffa00 0x55e62adb0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.525+0000 7f1313e00640 0 client.6220 ms_handle_reset on v2:172.21.15.99:6836/1676159950 2024-02-21T23:07:14.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.525+0000 7f1338a7e740 1 --2- 172.21.15.99:0/2427635016 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e62adc95a0 0x55e62ae0c480 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.525+0000 7f1338a7e740 1 -- 172.21.15.99:0/2427635016 >> 172.21.15.99:0/2427635016 conn(0x55e62ad7fd40 msgr2=0x55e62adf8630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:07:14.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.526+0000 7f1338a7e740 1 -- 172.21.15.99:0/2427635016 shutdown_connections 2024-02-21T23:07:14.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.526+0000 7f1338a7e740 1 -- 172.21.15.99:0/2427635016 wait complete. 2024-02-21T23:07:14.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.526+0000 7f1338a7e740 20 client.6220 trim_cache size 0 max 16384 2024-02-21T23:07:14.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.544+0000 7f1338a7e740 1 Processor -- start 2024-02-21T23:07:14.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.544+0000 7f1338a7e740 1 -- start start 2024-02-21T23:07:14.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.546+0000 7f1338a7e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e62adbbe30 0x55e62ad8bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:14.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.546+0000 7f1338a7e740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e62adc95a0 0x55e62ae5f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:14.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.546+0000 7f1338a7e740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e62adffa00 0x55e62ae017b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:14.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.546+0000 7f1338a7e740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1330228570 con 0x55e62adffa00 2024-02-21T23:07:14.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.546+0000 7f1338a7e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1330226110 con 0x55e62adbbe30 2024-02-21T23:07:14.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.546+0000 7f1338a7e740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1330180310 con 0x55e62adc95a0 2024-02-21T23:07:14.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.546+0000 7f132ea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e62adbbe30 0x55e62ad8bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:14.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.546+0000 7f132f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e62adffa00 0x55e62ae017b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:14.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.546+0000 7f132ea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e62adbbe30 0x55e62ad8bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:56526/0 (socket says 172.21.15.99:56526) 2024-02-21T23:07:14.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.546+0000 7f132ea00640 1 -- 172.21.15.99:0/2367696954 learned_addr learned my addr 172.21.15.99:0/2367696954 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:07:14.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.546+0000 7f1326000640 1 --2- 172.21.15.99:0/2367696954 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e62adc95a0 0x55e62ae5f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:14.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.547+0000 7f132ea00640 1 -- 172.21.15.99:0/2367696954 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e62adc95a0 msgr2=0x55e62ae5f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:14.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.547+0000 7f132ea00640 1 --2- 172.21.15.99:0/2367696954 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e62adc95a0 0x55e62ae5f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.547+0000 7f132ea00640 1 -- 172.21.15.99:0/2367696954 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e62adffa00 msgr2=0x55e62ae017b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:14.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.547+0000 7f132ea00640 1 --2- 172.21.15.99:0/2367696954 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e62adffa00 0x55e62ae017b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.547+0000 7f132ea00640 1 -- 172.21.15.99:0/2367696954 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e62aac87d0 con 0x55e62adbbe30 2024-02-21T23:07:14.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.547+0000 7f132ea00640 1 --2- 172.21.15.99:0/2367696954 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e62adbbe30 0x55e62ad8bf00 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f13200ea4e0 tx=0x7f132004c000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bfdaadf2dc3c733a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:14.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.547+0000 7f131ea00640 1 -- 172.21.15.99:0/2367696954 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13200b8860 con 0x55e62adbbe30 2024-02-21T23:07:14.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.547+0000 7f131ea00640 1 -- 172.21.15.99:0/2367696954 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f132003a040 con 0x55e62adbbe30 2024-02-21T23:07:14.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.547+0000 7f131ea00640 1 -- 172.21.15.99:0/2367696954 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13200ba720 con 0x55e62adbbe30 2024-02-21T23:07:14.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.548+0000 7f1338a7e740 1 -- 172.21.15.99:0/2367696954 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e62adbbe30 msgr2=0x55e62ad8bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:14.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.548+0000 7f1338a7e740 1 --2- 172.21.15.99:0/2367696954 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e62adbbe30 0x55e62ad8bf00 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f13200ea4e0 tx=0x7f132004c000 comp rx=0 tx=0).stop 2024-02-21T23:07:14.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.548+0000 7f1338a7e740 1 -- 172.21.15.99:0/2367696954 shutdown_connections 2024-02-21T23:07:14.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.548+0000 7f1338a7e740 1 --2- 172.21.15.99:0/2367696954 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e62adffa00 0x55e62ae017b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.548+0000 7f1338a7e740 1 --2- 172.21.15.99:0/2367696954 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e62adc95a0 0x55e62ae5f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.548+0000 7f1338a7e740 1 --2- 172.21.15.99:0/2367696954 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e62adbbe30 0x55e62ad8bf00 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.548+0000 7f1338a7e740 1 -- 172.21.15.99:0/2367696954 >> 172.21.15.99:0/2367696954 conn(0x55e62ad7fd40 msgr2=0x55e62adf61f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:07:14.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.548+0000 7f1338a7e740 1 -- 172.21.15.99:0/2367696954 shutdown_connections 2024-02-21T23:07:14.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.548+0000 7f1338a7e740 1 -- 172.21.15.99:0/2367696954 wait complete. 2024-02-21T23:07:14.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.549+0000 7f1338a7e740 1 -- start start 2024-02-21T23:07:14.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.549+0000 7f1338a7e740 1 Processor -- start 2024-02-21T23:07:14.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.550+0000 7f1338a7e740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e62adbbe30 0x55e62adad330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:14.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.550+0000 7f1338a7e740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e62adc95a0 0x55e62ae5a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:14.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.550+0000 7f1338a7e740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e62adffa00 0x55e62ae5bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:14.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.550+0000 7f1338a7e740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13300f6240 con 0x55e62adc95a0 2024-02-21T23:07:14.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.550+0000 7f1338a7e740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1330225ab0 con 0x55e62adbbe30 2024-02-21T23:07:14.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.550+0000 7f1338a7e740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1330071e30 con 0x55e62adffa00 2024-02-21T23:07:14.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.550+0000 7f1338a7e740 10 client.0 _ll_register_callbacks cb 0x7f13200b6a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:07:14.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.551+0000 7f1326000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e62adc95a0 0x55e62ae5a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:14.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.551+0000 7f132ea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e62adbbe30 0x55e62adad330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:14.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.551+0000 7f1326000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e62adc95a0 0x55e62ae5a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:36536/0 (socket says 172.21.15.99:36536) 2024-02-21T23:07:14.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.551+0000 7f1326000640 1 -- 172.21.15.99:0/1117878625 learned_addr learned my addr 172.21.15.99:0/1117878625 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:07:14.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.551+0000 7f132f400640 1 --2- 172.21.15.99:0/1117878625 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e62adffa00 0x55e62ae5bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:14.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.551+0000 7f132ea00640 1 -- 172.21.15.99:0/1117878625 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e62adffa00 msgr2=0x55e62ae5bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:14.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.551+0000 7f132ea00640 1 --2- 172.21.15.99:0/1117878625 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e62adffa00 0x55e62ae5bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.551+0000 7f132ea00640 1 -- 172.21.15.99:0/1117878625 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e62adc95a0 msgr2=0x55e62ae5a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:14.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.551+0000 7f132ea00640 1 --2- 172.21.15.99:0/1117878625 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e62adc95a0 0x55e62ae5a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.551+0000 7f132ea00640 1 -- 172.21.15.99:0/1117878625 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e62ae07000 con 0x55e62adbbe30 2024-02-21T23:07:14.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.551+0000 7f132ea00640 1 --2- 172.21.15.99:0/1117878625 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e62adbbe30 0x55e62adad330 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f13200b8750 tx=0x7f132002beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5cc85b2fd89551a5 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:14.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.551+0000 7f1313e00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-02-21T23:07:14.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.552+0000 7f1313e00640 1 -- 172.21.15.99:0/1117878625 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13200a0070 con 0x55e62adbbe30 2024-02-21T23:07:14.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.552+0000 7f1313e00640 1 -- 172.21.15.99:0/1117878625 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f13200eabb0 con 0x55e62adbbe30 2024-02-21T23:07:14.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.552+0000 7f1338a7e740 1 -- 172.21.15.99:0/1117878625 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f132003a040 con 0x55e62adbbe30 2024-02-21T23:07:14.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.552+0000 7f1313e00640 1 -- 172.21.15.99:0/1117878625 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f13200b8860 con 0x55e62adbbe30 2024-02-21T23:07:14.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.552+0000 7f1338a7e740 10 client.6226 fetch_fsmap learned FSMap version 17 2024-02-21T23:07:14.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.552+0000 7f1338a7e740 1 -- 172.21.15.99:0/1117878625 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55e62ae07000 con 0x55e62adbbe30 2024-02-21T23:07:14.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.552+0000 7f1313e00640 1 -- 172.21.15.99:0/1117878625 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f132003a040 con 0x55e62adbbe30 2024-02-21T23:07:14.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.552+0000 7f1313e00640 1 -- 172.21.15.99:0/1117878625 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f1320009030 con 0x55e62adbbe30 2024-02-21T23:07:14.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.552+0000 7f1338a7e740 10 client.6226 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:07:14.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.552+0000 7f1338a7e740 10 client.6226 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2024-02-21T23:07:14.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.552+0000 7f1338a7e740 20 client.6226 populate_metadata read hostname 'smithi099' 2024-02-21T23:07:14.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.553+0000 7f1338a7e740 1 --2- 172.21.15.99:0/1117878625 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x55e62ad84aa0 0x55e62ae19b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:14.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.553+0000 7f1338a7e740 4 client.6226 mds_command: new command op to 4352 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T23:07:14.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.553+0000 7f1338a7e740 1 -- 172.21.15.99:0/1117878625 --> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55e62acf13e0 con 0x55e62ad84aa0 2024-02-21T23:07:14.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.553+0000 7f1326000640 1 --2- 172.21.15.99:0/1117878625 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x55e62ad84aa0 0x55e62ae19b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:14.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.553+0000 7f1313e00640 10 client.6226 ms_handle_connect on v2:172.21.15.99:6836/1676159950 2024-02-21T23:07:14.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.553+0000 7f1326000640 1 --2- 172.21.15.99:0/1117878625 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x55e62ad84aa0 0x55e62ae19b10 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7aa8783eaa3cc546 server_cookie=49affbd2dabd162d in_seq=0 out_seq=0 2024-02-21T23:07:14.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.554+0000 7f1313e00640 1 -- 172.21.15.99:0/1117878625 <== mds.1 v2:172.21.15.99:6836/1676159950 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55e62acf13e0 con 0x55e62ad84aa0 2024-02-21T23:07:14.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.554+0000 7f1313e00640 10 client.6226 handle_command_reply: tid=0 2024-02-21T23:07:14.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.554+0000 7f1338a7e740 1 client.6226 shutdown 2024-02-21T23:07:14.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.554+0000 7f1338a7e740 1 -- 172.21.15.99:0/1117878625 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e62adbbe30 msgr2=0x55e62adad330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:14.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.554+0000 7f1338a7e740 1 --2- 172.21.15.99:0/1117878625 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e62adbbe30 0x55e62adad330 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f13200b8750 tx=0x7f132002beb0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.554+0000 7f1338a7e740 1 -- 172.21.15.99:0/1117878625 shutdown_connections 2024-02-21T23:07:14.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.554+0000 7f1338a7e740 1 --2- 172.21.15.99:0/1117878625 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x55e62ad84aa0 0x55e62ae19b10 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.554+0000 7f1338a7e740 1 --2- 172.21.15.99:0/1117878625 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e62adffa00 0x55e62ae5bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.554+0000 7f1338a7e740 1 --2- 172.21.15.99:0/1117878625 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e62adc95a0 0x55e62ae5a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.554+0000 7f1338a7e740 1 --2- 172.21.15.99:0/1117878625 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e62adbbe30 0x55e62adad330 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.554+0000 7f1313e00640 0 client.6226 ms_handle_reset on v2:172.21.15.99:6836/1676159950 2024-02-21T23:07:14.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.554+0000 7f1338a7e740 1 -- 172.21.15.99:0/1117878625 >> 172.21.15.99:0/1117878625 conn(0x55e62ad7fd40 msgr2=0x55e62ad7b390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:07:14.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.554+0000 7f1338a7e740 1 -- 172.21.15.99:0/1117878625 shutdown_connections 2024-02-21T23:07:14.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.554+0000 7f1338a7e740 1 -- 172.21.15.99:0/1117878625 wait complete. 2024-02-21T23:07:14.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.554+0000 7f1338a7e740 20 client.6226 trim_cache size 0 max 16384 2024-02-21T23:07:14.549 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-02-21T23:07:14.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.555+0000 7f1335c00640 1 -- 172.21.15.99:0/2337334518 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f130c09eed0 msgr2=0x7f130c0a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:14.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.555+0000 7f1335c00640 1 --2- 172.21.15.99:0/2337334518 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f130c09eed0 0x7f130c0a1390 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f133017e5c0 tx=0x7f1318009040 comp rx=0 tx=0).stop 2024-02-21T23:07:14.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.555+0000 7f1335c00640 1 -- 172.21.15.99:0/2337334518 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f133006e910 msgr2=0x7f1330163480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:14.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.555+0000 7f1335c00640 1 --2- 172.21.15.99:0/2337334518 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f133006e910 0x7f1330163480 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f1320037040 tx=0x7f1320004a40 comp rx=0 tx=0).stop 2024-02-21T23:07:14.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.555+0000 7f1335c00640 1 -- 172.21.15.99:0/2337334518 shutdown_connections 2024-02-21T23:07:14.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.555+0000 7f1335c00640 1 --2- 172.21.15.99:0/2337334518 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f130c09eed0 0x7f130c0a1390 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.555+0000 7f1335c00640 1 --2- 172.21.15.99:0/2337334518 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1330188440 0x7f133017ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.555+0000 7f1335c00640 1 --2- 172.21.15.99:0/2337334518 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1330180c80 0x7f133017b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.555+0000 7f1335c00640 1 --2- 172.21.15.99:0/2337334518 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f133006e910 0x7f1330163480 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.555+0000 7f1335c00640 1 -- 172.21.15.99:0/2337334518 >> 172.21.15.99:0/2337334518 conn(0x7f13300ce5f0 msgr2=0x7f133006c280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:07:14.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.555+0000 7f1335c00640 1 -- 172.21.15.99:0/2337334518 shutdown_connections 2024-02-21T23:07:14.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.555+0000 7f1335c00640 1 -- 172.21.15.99:0/2337334518 wait complete. 2024-02-21T23:07:14.562 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T23:07:14.562 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-02-21T23:07:14.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.760+0000 7f9c9a200640 1 Processor -- start 2024-02-21T23:07:14.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.760+0000 7f9c9a200640 1 -- start start 2024-02-21T23:07:14.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.764+0000 7f9c9a200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f9c940d5330 0x7f9c940cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:14.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.764+0000 7f9c9a200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c940d5730 con 0x7f9c94186400 2024-02-21T23:07:14.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.764+0000 7f9c9a200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c940cf820 con 0x7f9c941867e0 2024-02-21T23:07:14.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.764+0000 7f9c9a200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c94187640 con 0x7f9c940d5330 2024-02-21T23:07:14.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.764+0000 7f9c93400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f9c94186400 0x7f9c94187ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:39304/0 (socket says 172.21.15.99:39304) 2024-02-21T23:07:14.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.764+0000 7f9c93400640 1 -- 172.21.15.99:0/1533564935 learned_addr learned my addr 172.21.15.99:0/1533564935 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:07:14.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.764+0000 7f9c93e00640 1 --2- 172.21.15.99:0/1533564935 >> v2:172.21.15.99:3300/0 conn(0x7f9c940d5330 0x7f9c940cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:14.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.765+0000 7f9c92000640 1 -- 172.21.15.99:0/1533564935 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4061115454 0 0) 0x7f9c940cf820 con 0x7f9c941867e0 2024-02-21T23:07:14.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.765+0000 7f9c92000640 1 -- 172.21.15.99:0/1533564935 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c78003520 con 0x7f9c941867e0 2024-02-21T23:07:14.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.765+0000 7f9c93e00640 1 -- 172.21.15.99:0/1533564935 >> v1:172.21.15.162:6789/0 conn(0x7f9c941867e0 legacy=0x7f9c941881e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:14.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.765+0000 7f9c93e00640 1 -- 172.21.15.99:0/1533564935 >> v1:172.21.15.99:6789/0 conn(0x7f9c94186400 legacy=0x7f9c94187ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:14.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.765+0000 7f9c93e00640 1 -- 172.21.15.99:0/1533564935 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c940cfb00 con 0x7f9c940d5330 2024-02-21T23:07:14.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.766+0000 7f9c93e00640 1 --2- 172.21.15.99:0/1533564935 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9c940d5330 0x7f9c940cdea0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c009d90 tx=0x7f9c8c02be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9358240931ed6848 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:14.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.767+0000 7f9c92000640 1 -- 172.21.15.99:0/1533564935 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8c039070 con 0x7f9c940d5330 2024-02-21T23:07:14.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.767+0000 7f9c92000640 1 -- 172.21.15.99:0/1533564935 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c8c02cbd0 con 0x7f9c940d5330 2024-02-21T23:07:14.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.767+0000 7f9c92000640 1 -- 172.21.15.99:0/1533564935 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8c034440 con 0x7f9c940d5330 2024-02-21T23:07:14.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.768+0000 7f9c9a200640 1 -- 172.21.15.99:0/1533564935 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9c940d5330 msgr2=0x7f9c940cdea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:14.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.768+0000 7f9c9a200640 1 --2- 172.21.15.99:0/1533564935 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9c940d5330 0x7f9c940cdea0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c009d90 tx=0x7f9c8c02be20 comp rx=0 tx=0).stop 2024-02-21T23:07:14.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.768+0000 7f9c9a200640 1 -- 172.21.15.99:0/1533564935 shutdown_connections 2024-02-21T23:07:14.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.768+0000 7f9c9a200640 1 --2- 172.21.15.99:0/1533564935 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9c940d5330 0x7f9c940cdea0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.768+0000 7f9c9a200640 1 -- 172.21.15.99:0/1533564935 >> 172.21.15.99:0/1533564935 conn(0x7f9c940d6af0 msgr2=0x7f9c940740b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:07:14.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.768+0000 7f9c9a200640 1 -- 172.21.15.99:0/1533564935 shutdown_connections 2024-02-21T23:07:14.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.768+0000 7f9c9a200640 1 -- 172.21.15.99:0/1533564935 wait complete. 2024-02-21T23:07:14.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.770+0000 7f9c9a200640 1 Processor -- start 2024-02-21T23:07:14.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.770+0000 7f9c9a200640 1 -- start start 2024-02-21T23:07:14.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.771+0000 7f9c9a200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9c940d5330 0x7f9c9408fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:14.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.771+0000 7f9c9a200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c94186400 0x7f9c9408e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:14.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.771+0000 7f9c9a200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9c941867e0 0x7f9c941722e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:14.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.771+0000 7f9c9a200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c941872d0 con 0x7f9c941867e0 2024-02-21T23:07:14.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.771+0000 7f9c9a200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c94186ff0 con 0x7f9c94186400 2024-02-21T23:07:14.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.771+0000 7f9c9a200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c940ce3e0 con 0x7f9c940d5330 2024-02-21T23:07:14.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.772+0000 7f9c93e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9c941867e0 0x7f9c941722e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:14.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.772+0000 7f9c93e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9c941867e0 0x7f9c941722e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:36562/0 (socket says 172.21.15.99:36562) 2024-02-21T23:07:14.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.772+0000 7f9c93e00640 1 -- 172.21.15.99:0/2661173942 learned_addr learned my addr 172.21.15.99:0/2661173942 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:07:14.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.772+0000 7f9c93400640 1 --2- 172.21.15.99:0/2661173942 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9c940d5330 0x7f9c9408fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:14.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.772+0000 7f9c92a00640 1 --2- 172.21.15.99:0/2661173942 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c94186400 0x7f9c9408e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:14.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.772+0000 7f9c93400640 1 -- 172.21.15.99:0/2661173942 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c94186400 msgr2=0x7f9c9408e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:14.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.772+0000 7f9c93400640 1 --2- 172.21.15.99:0/2661173942 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c94186400 0x7f9c9408e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.772+0000 7f9c93400640 1 -- 172.21.15.99:0/2661173942 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9c941867e0 msgr2=0x7f9c941722e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:14.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.772+0000 7f9c93400640 1 --2- 172.21.15.99:0/2661173942 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9c941867e0 0x7f9c941722e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.772+0000 7f9c93400640 1 -- 172.21.15.99:0/2661173942 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c94172820 con 0x7f9c940d5330 2024-02-21T23:07:14.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.772+0000 7f9c93e00640 1 --2- 172.21.15.99:0/2661173942 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9c941867e0 0x7f9c941722e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:07:14.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.772+0000 7f9c93400640 1 --2- 172.21.15.99:0/2661173942 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9c940d5330 0x7f9c9408fd10 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f9c84000f60 tx=0x7f9c8400c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:14.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.773+0000 7f9c8b400640 1 -- 172.21.15.99:0/2661173942 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c84017070 con 0x7f9c940d5330 2024-02-21T23:07:14.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.773+0000 7f9c8b400640 1 -- 172.21.15.99:0/2661173942 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c84005ce0 con 0x7f9c940d5330 2024-02-21T23:07:14.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.773+0000 7f9c9a200640 1 -- 172.21.15.99:0/2661173942 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c9408e990 con 0x7f9c940d5330 2024-02-21T23:07:14.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.773+0000 7f9c8b400640 1 -- 172.21.15.99:0/2661173942 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c84007310 con 0x7f9c940d5330 2024-02-21T23:07:14.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.773+0000 7f9c9a200640 1 -- 172.21.15.99:0/2661173942 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c9408ef50 con 0x7f9c940d5330 2024-02-21T23:07:14.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.778+0000 7f9c8b400640 1 -- 172.21.15.99:0/2661173942 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f9c8401a070 con 0x7f9c940d5330 2024-02-21T23:07:14.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.779+0000 7f9c9d20b740 1 Processor -- start 2024-02-21T23:07:14.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.779+0000 7f9c9d20b740 1 -- start start 2024-02-21T23:07:14.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.780+0000 7f9c8b400640 1 --2- 172.21.15.99:0/2661173942 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f9c7409ef50 0x7f9c740a1410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:14.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.780+0000 7f9c8b400640 1 -- 172.21.15.99:0/2661173942 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f9c840c9180 con 0x7f9c940d5330 2024-02-21T23:07:14.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.780+0000 7f9c93e00640 1 --2- 172.21.15.99:0/2661173942 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f9c7409ef50 0x7f9c740a1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:14.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.781+0000 7f9c9d20b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56373f7514b0 0x56373f751890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:14.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.781+0000 7f9c9d20b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56373f78c180 0x56373f78c600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:14.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.781+0000 7f9c9d20b740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56373f78cb40 0x56373f78d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:14.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.781+0000 7f9c9d20b740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x56373f679b50 con 0x56373f78cb40 2024-02-21T23:07:14.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.781+0000 7f9c9d20b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x56373f622da0 con 0x56373f7514b0 2024-02-21T23:07:14.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.781+0000 7f9c9d20b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x56373f675bf0 con 0x56373f78c180 2024-02-21T23:07:14.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.781+0000 7f9c93400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56373f7514b0 0x56373f751890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:14.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.781+0000 7f9c93e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56373f78cb40 0x56373f78d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:14.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.781+0000 7f9c93400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56373f7514b0 0x56373f751890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:56556/0 (socket says 172.21.15.99:56556) 2024-02-21T23:07:14.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.781+0000 7f9c93400640 1 -- 172.21.15.99:0/3273151481 learned_addr learned my addr 172.21.15.99:0/3273151481 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:07:14.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.781+0000 7f9c93e00640 1 --2- 172.21.15.99:0/2661173942 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f9c7409ef50 0x7f9c740a1410 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c009bd0 tx=0x7f9c8c030000 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:14.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.781+0000 7f9c92a00640 1 --2- 172.21.15.99:0/3273151481 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56373f78c180 0x56373f78c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:14.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.782+0000 7f9c93400640 1 -- 172.21.15.99:0/3273151481 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56373f78c180 msgr2=0x56373f78c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:14.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.782+0000 7f9c93400640 1 --2- 172.21.15.99:0/3273151481 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56373f78c180 0x56373f78c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.782+0000 7f9c93400640 1 -- 172.21.15.99:0/3273151481 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56373f78cb40 msgr2=0x56373f78d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:14.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.782+0000 7f9c93400640 1 --2- 172.21.15.99:0/3273151481 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56373f78cb40 0x56373f78d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.782+0000 7f9c93400640 1 -- 172.21.15.99:0/3273151481 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56373f645f80 con 0x56373f7514b0 2024-02-21T23:07:14.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.782+0000 7f9c93400640 1 --2- 172.21.15.99:0/3273151481 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56373f7514b0 0x56373f751890 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f9c840c6810 tx=0x7f9c84096ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc104eaff4fe4118 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:14.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.782+0000 7f9c7f400640 1 -- 172.21.15.99:0/3273151481 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c84094dd0 con 0x56373f7514b0 2024-02-21T23:07:14.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.782+0000 7f9c7f400640 1 -- 172.21.15.99:0/3273151481 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c84093140 con 0x56373f7514b0 2024-02-21T23:07:14.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.782+0000 7f9c7f400640 1 -- 172.21.15.99:0/3273151481 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c840c6be0 con 0x56373f7514b0 2024-02-21T23:07:14.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.783+0000 7f9c9d20b740 1 -- 172.21.15.99:0/3273151481 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56373f7514b0 msgr2=0x56373f751890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:14.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.783+0000 7f9c9d20b740 1 --2- 172.21.15.99:0/3273151481 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56373f7514b0 0x56373f751890 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f9c840c6810 tx=0x7f9c84096ad0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.783+0000 7f9c9d20b740 1 -- 172.21.15.99:0/3273151481 shutdown_connections 2024-02-21T23:07:14.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.783+0000 7f9c9d20b740 1 --2- 172.21.15.99:0/3273151481 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56373f78cb40 0x56373f78d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.783+0000 7f9c9d20b740 1 --2- 172.21.15.99:0/3273151481 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56373f78c180 0x56373f78c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.783+0000 7f9c9d20b740 1 --2- 172.21.15.99:0/3273151481 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56373f7514b0 0x56373f751890 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.783+0000 7f9c9d20b740 1 -- 172.21.15.99:0/3273151481 >> 172.21.15.99:0/3273151481 conn(0x56373f713520 msgr2=0x56373f7145a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:07:14.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.783+0000 7f9c9d20b740 1 -- 172.21.15.99:0/3273151481 shutdown_connections 2024-02-21T23:07:14.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.783+0000 7f9c9d20b740 1 -- 172.21.15.99:0/3273151481 wait complete. 2024-02-21T23:07:14.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.784+0000 7f9c9d20b740 1 -- start start 2024-02-21T23:07:14.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.784+0000 7f9c9d20b740 1 Processor -- start 2024-02-21T23:07:14.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.785+0000 7f9c9d20b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56373f78c180 0x56373f798810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:14.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.785+0000 7f9c9d20b740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56373f78cb40 0x56373f796d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:14.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.785+0000 7f9c9d20b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56373f747a20 0x56373f727de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:14.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.785+0000 7f9c9d20b740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x56373f78aef0 con 0x56373f78cb40 2024-02-21T23:07:14.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.785+0000 7f9c9d20b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x56373f618380 con 0x56373f747a20 2024-02-21T23:07:14.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.785+0000 7f9c9d20b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x56373f78ac10 con 0x56373f78c180 2024-02-21T23:07:14.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.786+0000 7f9c9d20b740 10 client.0 _ll_register_callbacks cb 0x56373f671280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:07:14.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.786+0000 7f9c93400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56373f78c180 0x56373f798810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:14.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.786+0000 7f9c92a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56373f78cb40 0x56373f796d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:14.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.786+0000 7f9c93400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56373f78c180 0x56373f798810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:37698/0 (socket says 172.21.15.99:37698) 2024-02-21T23:07:14.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.786+0000 7f9c93400640 1 -- 172.21.15.99:0/3995443255 learned_addr learned my addr 172.21.15.99:0/3995443255 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:07:14.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.786+0000 7f9c92a00640 1 -- 172.21.15.99:0/3995443255 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56373f78c180 msgr2=0x56373f798810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:14.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.786+0000 7f9c93e00640 1 --2- 172.21.15.99:0/3995443255 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56373f747a20 0x56373f727de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:14.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.786+0000 7f9c92a00640 1 --2- 172.21.15.99:0/3995443255 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56373f78c180 0x56373f798810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.786+0000 7f9c92a00640 1 -- 172.21.15.99:0/3995443255 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56373f747a20 msgr2=0x56373f727de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:14.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.786+0000 7f9c92a00640 1 --2- 172.21.15.99:0/3995443255 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56373f747a20 0x56373f727de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.786+0000 7f9c92a00640 1 -- 172.21.15.99:0/3995443255 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56373f640c20 con 0x56373f78cb40 2024-02-21T23:07:14.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.786+0000 7f9c93400640 1 --2- 172.21.15.99:0/3995443255 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56373f78c180 0x56373f798810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:07:14.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.786+0000 7f9c93e00640 1 --2- 172.21.15.99:0/3995443255 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56373f747a20 0x56373f727de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T23:07:14.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.787+0000 7f9c92a00640 1 --2- 172.21.15.99:0/3995443255 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56373f78cb40 0x56373f796d50 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f9c94091350 tx=0x7f9c80012690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2866433001f1a89d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:14.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.787+0000 7f9c73e00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:07:14.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.787+0000 7f9c73e00640 1 -- 172.21.15.99:0/3995443255 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c80019020 con 0x56373f78cb40 2024-02-21T23:07:14.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.787+0000 7f9c9d20b740 1 -- 172.21.15.99:0/3995443255 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9c84093140 con 0x56373f78cb40 2024-02-21T23:07:14.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.787+0000 7f9c73e00640 1 -- 172.21.15.99:0/3995443255 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f9c800050d0 con 0x56373f78cb40 2024-02-21T23:07:14.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.787+0000 7f9c73e00640 1 -- 172.21.15.99:0/3995443255 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9c80024050 con 0x56373f78cb40 2024-02-21T23:07:14.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.787+0000 7f9c9d20b740 10 client.6105 fetch_fsmap learned FSMap version 17 2024-02-21T23:07:14.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.787+0000 7f9c9d20b740 1 -- 172.21.15.99:0/3995443255 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x56373f38e3f0 con 0x56373f78cb40 2024-02-21T23:07:14.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.788+0000 7f9c73e00640 1 -- 172.21.15.99:0/3995443255 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c84093140 con 0x56373f78cb40 2024-02-21T23:07:14.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.788+0000 7f9c73e00640 1 -- 172.21.15.99:0/3995443255 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f9c800035f0 con 0x56373f78cb40 2024-02-21T23:07:14.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.788+0000 7f9c9d20b740 10 client.6105 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:07:14.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.788+0000 7f9c9d20b740 10 client.6105 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:07:14.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.788+0000 7f9c9d20b740 20 client.6105 populate_metadata read hostname 'smithi099' 2024-02-21T23:07:14.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.788+0000 7f9c9d20b740 1 --2- 172.21.15.99:0/3995443255 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x56373f781940 0x56373f7287f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:14.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.789+0000 7f9c9d20b740 4 client.6105 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:07:14.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.789+0000 7f9c9d20b740 1 -- 172.21.15.99:0/3995443255 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56373f687090 con 0x56373f781940 2024-02-21T23:07:14.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.789+0000 7f9c93400640 1 --2- 172.21.15.99:0/3995443255 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x56373f781940 0x56373f7287f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:14.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.789+0000 7f9c73e00640 10 client.6105 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:07:14.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.789+0000 7f9c93400640 1 --2- 172.21.15.99:0/3995443255 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x56373f781940 0x56373f7287f0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2430f98605d85b28 server_cookie=6d73c139df584148 in_seq=0 out_seq=0 2024-02-21T23:07:14.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.791+0000 7f9c73e00640 1 -- 172.21.15.99:0/3995443255 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x56373f687090 con 0x56373f781940 2024-02-21T23:07:14.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.791+0000 7f9c73e00640 10 client.6105 handle_command_reply: tid=0 2024-02-21T23:07:14.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.791+0000 7f9c9d20b740 1 client.6105 shutdown 2024-02-21T23:07:14.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.791+0000 7f9c9d20b740 1 -- 172.21.15.99:0/3995443255 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56373f78cb40 msgr2=0x56373f796d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:14.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.791+0000 7f9c9d20b740 1 --2- 172.21.15.99:0/3995443255 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56373f78cb40 0x56373f796d50 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f9c94091350 tx=0x7f9c80012690 comp rx=0 tx=0).stop 2024-02-21T23:07:14.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.791+0000 7f9c9d20b740 1 -- 172.21.15.99:0/3995443255 shutdown_connections 2024-02-21T23:07:14.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.791+0000 7f9c9d20b740 1 --2- 172.21.15.99:0/3995443255 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x56373f781940 0x56373f7287f0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.791+0000 7f9c9d20b740 1 --2- 172.21.15.99:0/3995443255 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56373f747a20 0x56373f727de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.791+0000 7f9c9d20b740 1 --2- 172.21.15.99:0/3995443255 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56373f78cb40 0x56373f796d50 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.791+0000 7f9c9d20b740 1 --2- 172.21.15.99:0/3995443255 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56373f78c180 0x56373f798810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.791+0000 7f9c9d20b740 1 -- 172.21.15.99:0/3995443255 >> 172.21.15.99:0/3995443255 conn(0x56373f7514b0 msgr2=0x56373f78b600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:07:14.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.791+0000 7f9c73e00640 0 client.6105 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:07:14.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.791+0000 7f9c9d20b740 1 -- 172.21.15.99:0/3995443255 shutdown_connections 2024-02-21T23:07:14.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.791+0000 7f9c9d20b740 1 -- 172.21.15.99:0/3995443255 wait complete. 2024-02-21T23:07:14.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.791+0000 7f9c9d20b740 20 client.6105 trim_cache size 0 max 16384 2024-02-21T23:07:14.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.818+0000 7f9c9d20b740 1 Processor -- start 2024-02-21T23:07:14.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.818+0000 7f9c9d20b740 1 -- start start 2024-02-21T23:07:14.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.820+0000 7f9c9d20b740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56373f747a20 0x56373f714560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:14.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.820+0000 7f9c9d20b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56373f78c180 0x56373f75c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:14.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.820+0000 7f9c9d20b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56373f78cb40 0x56373f7e8880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:14.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.820+0000 7f9c9d20b740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c9422ca60 con 0x56373f747a20 2024-02-21T23:07:14.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.820+0000 7f9c9d20b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c9422a600 con 0x56373f78cb40 2024-02-21T23:07:14.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.820+0000 7f9c9d20b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c942286e0 con 0x56373f78c180 2024-02-21T23:07:14.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.821+0000 7f9c93400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56373f747a20 0x56373f714560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:14.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.821+0000 7f9c93400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56373f747a20 0x56373f714560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:36608/0 (socket says 172.21.15.99:36608) 2024-02-21T23:07:14.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.821+0000 7f9c93400640 1 -- 172.21.15.99:0/3639101653 learned_addr learned my addr 172.21.15.99:0/3639101653 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:07:14.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.821+0000 7f9c92a00640 1 --2- 172.21.15.99:0/3639101653 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56373f78c180 0x56373f75c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:14.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.821+0000 7f9c93400640 1 -- 172.21.15.99:0/3639101653 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56373f78c180 msgr2=0x56373f75c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:14.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.821+0000 7f9c93400640 1 --2- 172.21.15.99:0/3639101653 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56373f78c180 0x56373f75c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.821+0000 7f9c93400640 1 -- 172.21.15.99:0/3639101653 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56373f78cb40 msgr2=0x56373f7e8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:14.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.821+0000 7f9c93e00640 1 --2- 172.21.15.99:0/3639101653 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56373f78cb40 0x56373f7e8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:14.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.821+0000 7f9c93400640 1 --2- 172.21.15.99:0/3639101653 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56373f78cb40 0x56373f7e8880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.821+0000 7f9c93400640 1 -- 172.21.15.99:0/3639101653 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56373f4587d0 con 0x56373f747a20 2024-02-21T23:07:14.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.821+0000 7f9c93e00640 1 --2- 172.21.15.99:0/3639101653 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56373f78cb40 0x56373f7e8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T23:07:14.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.821+0000 7f9c93400640 1 --2- 172.21.15.99:0/3639101653 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56373f747a20 0x56373f714560 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f9c840967d0 tx=0x7f9c84014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23f1118cbfaaa047 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:14.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.822+0000 7f9c7ea00640 1 -- 172.21.15.99:0/3639101653 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c840c6810 con 0x56373f747a20 2024-02-21T23:07:14.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.822+0000 7f9c7ea00640 1 -- 172.21.15.99:0/3639101653 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c84094dd0 con 0x56373f747a20 2024-02-21T23:07:14.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.822+0000 7f9c7ea00640 1 -- 172.21.15.99:0/3639101653 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c840076b0 con 0x56373f747a20 2024-02-21T23:07:14.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.822+0000 7f9c9d20b740 1 -- 172.21.15.99:0/3639101653 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56373f747a20 msgr2=0x56373f714560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:14.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.822+0000 7f9c9d20b740 1 --2- 172.21.15.99:0/3639101653 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56373f747a20 0x56373f714560 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f9c840967d0 tx=0x7f9c84014000 comp rx=0 tx=0).stop 2024-02-21T23:07:14.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.823+0000 7f9c9d20b740 1 -- 172.21.15.99:0/3639101653 shutdown_connections 2024-02-21T23:07:14.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.823+0000 7f9c9d20b740 1 --2- 172.21.15.99:0/3639101653 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56373f78cb40 0x56373f7e8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.823+0000 7f9c9d20b740 1 --2- 172.21.15.99:0/3639101653 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56373f78c180 0x56373f75c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.823+0000 7f9c9d20b740 1 --2- 172.21.15.99:0/3639101653 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56373f747a20 0x56373f714560 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.823+0000 7f9c9d20b740 1 -- 172.21.15.99:0/3639101653 >> 172.21.15.99:0/3639101653 conn(0x56373f7514b0 msgr2=0x56373f7958e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:07:14.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.823+0000 7f9c9d20b740 1 -- 172.21.15.99:0/3639101653 shutdown_connections 2024-02-21T23:07:14.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.823+0000 7f9c9d20b740 1 -- 172.21.15.99:0/3639101653 wait complete. 2024-02-21T23:07:14.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.824+0000 7f9c9d20b740 1 -- start start 2024-02-21T23:07:14.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.824+0000 7f9c9d20b740 1 Processor -- start 2024-02-21T23:07:14.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.825+0000 7f9c9d20b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56373f747a20 0x56373f71aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:14.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.825+0000 7f9c9d20b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56373f78c180 0x56373f727db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:14.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.825+0000 7f9c9d20b740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56373f78cb40 0x56373f710640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:14.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.825+0000 7f9c9d20b740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c94228ce0 con 0x56373f78cb40 2024-02-21T23:07:14.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.825+0000 7f9c9d20b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c94229fa0 con 0x56373f78c180 2024-02-21T23:07:14.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.825+0000 7f9c9d20b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c942292e0 con 0x56373f747a20 2024-02-21T23:07:14.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.825+0000 7f9c9d20b740 10 client.0 _ll_register_callbacks cb 0x7f9c80001a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:07:14.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.825+0000 7f9c93400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56373f747a20 0x56373f71aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:14.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.825+0000 7f9c93400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56373f747a20 0x56373f71aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:37716/0 (socket says 172.21.15.99:37716) 2024-02-21T23:07:14.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.825+0000 7f9c93400640 1 -- 172.21.15.99:0/3707213371 learned_addr learned my addr 172.21.15.99:0/3707213371 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:07:14.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.825+0000 7f9c93e00640 1 --2- 172.21.15.99:0/3707213371 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56373f78cb40 0x56373f710640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:14.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.826+0000 7f9c92a00640 1 --2- 172.21.15.99:0/3707213371 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56373f78c180 0x56373f727db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:14.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.826+0000 7f9c93400640 1 -- 172.21.15.99:0/3707213371 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56373f78c180 msgr2=0x56373f727db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:14.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.826+0000 7f9c93400640 1 --2- 172.21.15.99:0/3707213371 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56373f78c180 0x56373f727db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.826+0000 7f9c93400640 1 -- 172.21.15.99:0/3707213371 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56373f78cb40 msgr2=0x56373f710640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:14.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.826+0000 7f9c93400640 1 --2- 172.21.15.99:0/3707213371 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56373f78cb40 0x56373f710640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.826+0000 7f9c93400640 1 -- 172.21.15.99:0/3707213371 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56373f75c5b0 con 0x56373f747a20 2024-02-21T23:07:14.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.826+0000 7f9c93400640 1 --2- 172.21.15.99:0/3707213371 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56373f747a20 0x56373f71aae0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f9c84092f30 tx=0x7f9c84000ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd5d2d7ceb38ec90 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:14.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.826+0000 7f9c73e00640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-02-21T23:07:14.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.826+0000 7f9c73e00640 1 -- 172.21.15.99:0/3707213371 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8407b060 con 0x56373f747a20 2024-02-21T23:07:14.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.826+0000 7f9c9d20b740 1 -- 172.21.15.99:0/3707213371 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9c84094dd0 con 0x56373f747a20 2024-02-21T23:07:14.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.827+0000 7f9c73e00640 1 -- 172.21.15.99:0/3707213371 <== mon.2 v2:172.21.15.181:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f9c84095f20 con 0x56373f747a20 2024-02-21T23:07:14.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.827+0000 7f9c73e00640 1 -- 172.21.15.99:0/3707213371 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9c840c6810 con 0x56373f747a20 2024-02-21T23:07:14.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.827+0000 7f9c9d20b740 10 client.6248 fetch_fsmap learned FSMap version 17 2024-02-21T23:07:14.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.827+0000 7f9c9d20b740 1 -- 172.21.15.99:0/3707213371 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x56373f75cb70 con 0x56373f747a20 2024-02-21T23:07:14.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.827+0000 7f9c73e00640 1 -- 172.21.15.99:0/3707213371 <== mon.2 v2:172.21.15.181:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c84094dd0 con 0x56373f747a20 2024-02-21T23:07:14.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.827+0000 7f9c73e00640 1 -- 172.21.15.99:0/3707213371 <== mon.2 v2:172.21.15.181:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f9c84092820 con 0x56373f747a20 2024-02-21T23:07:14.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.827+0000 7f9c9d20b740 10 client.6248 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:07:14.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.827+0000 7f9c9d20b740 10 client.6248 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:07:14.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.827+0000 7f9c9d20b740 20 client.6248 populate_metadata read hostname 'smithi099' 2024-02-21T23:07:14.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.827+0000 7f9c9d20b740 1 --2- 172.21.15.99:0/3707213371 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x56373f77b730 0x56373f79cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:14.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.827+0000 7f9c9d20b740 4 client.6248 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T23:07:14.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.827+0000 7f9c9d20b740 1 -- 172.21.15.99:0/3707213371 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56373f713c80 con 0x56373f77b730 2024-02-21T23:07:14.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.828+0000 7f9c92a00640 1 --2- 172.21.15.99:0/3707213371 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x56373f77b730 0x56373f79cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:14.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.828+0000 7f9c92a00640 1 --2- 172.21.15.99:0/3707213371 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x56373f77b730 0x56373f79cde0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d054093139291bf server_cookie=b1e6d27c8a715129 in_seq=0 out_seq=0 2024-02-21T23:07:14.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.828+0000 7f9c73e00640 10 client.6248 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:07:14.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.828+0000 7f9c73e00640 1 -- 172.21.15.99:0/3707213371 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56373f713c80 con 0x56373f77b730 2024-02-21T23:07:14.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.828+0000 7f9c73e00640 10 client.6248 handle_command_reply: tid=0 2024-02-21T23:07:14.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.828+0000 7f9c9d20b740 1 client.6248 shutdown 2024-02-21T23:07:14.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.829+0000 7f9c9d20b740 1 -- 172.21.15.99:0/3707213371 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56373f747a20 msgr2=0x56373f71aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:14.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.829+0000 7f9c9d20b740 1 --2- 172.21.15.99:0/3707213371 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56373f747a20 0x56373f71aae0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f9c84092f30 tx=0x7f9c84000ed0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.829+0000 7f9c9d20b740 1 -- 172.21.15.99:0/3707213371 shutdown_connections 2024-02-21T23:07:14.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.829+0000 7f9c9d20b740 1 --2- 172.21.15.99:0/3707213371 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x56373f77b730 0x56373f79cde0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.829+0000 7f9c9d20b740 1 --2- 172.21.15.99:0/3707213371 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56373f78cb40 0x56373f710640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.829+0000 7f9c9d20b740 1 --2- 172.21.15.99:0/3707213371 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56373f78c180 0x56373f727db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.829+0000 7f9c9d20b740 1 --2- 172.21.15.99:0/3707213371 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56373f747a20 0x56373f71aae0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.829+0000 7f9c9d20b740 1 -- 172.21.15.99:0/3707213371 >> 172.21.15.99:0/3707213371 conn(0x56373f7514b0 msgr2=0x56373f789190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:07:14.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.829+0000 7f9c73e00640 0 client.6248 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:07:14.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.829+0000 7f9c9d20b740 1 -- 172.21.15.99:0/3707213371 shutdown_connections 2024-02-21T23:07:14.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.829+0000 7f9c9d20b740 1 -- 172.21.15.99:0/3707213371 wait complete. 2024-02-21T23:07:14.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.829+0000 7f9c9d20b740 20 client.6248 trim_cache size 0 max 16384 2024-02-21T23:07:14.825 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-02-21T23:07:14.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.830+0000 7f9c9a200640 1 -- 172.21.15.99:0/2661173942 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f9c7409ef50 msgr2=0x7f9c740a1410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:14.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.830+0000 7f9c9a200640 1 --2- 172.21.15.99:0/2661173942 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f9c7409ef50 0x7f9c740a1410 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c009bd0 tx=0x7f9c8c030000 comp rx=0 tx=0).stop 2024-02-21T23:07:14.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.830+0000 7f9c9a200640 1 -- 172.21.15.99:0/2661173942 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9c940d5330 msgr2=0x7f9c9408fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:14.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.830+0000 7f9c9a200640 1 --2- 172.21.15.99:0/2661173942 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9c940d5330 0x7f9c9408fd10 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f9c84000f60 tx=0x7f9c8400c800 comp rx=0 tx=0).stop 2024-02-21T23:07:14.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.830+0000 7f9c9a200640 1 -- 172.21.15.99:0/2661173942 shutdown_connections 2024-02-21T23:07:14.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.830+0000 7f9c9a200640 1 --2- 172.21.15.99:0/2661173942 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f9c7409ef50 0x7f9c740a1410 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.830+0000 7f9c9a200640 1 --2- 172.21.15.99:0/2661173942 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9c941867e0 0x7f9c941722e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.830+0000 7f9c9a200640 1 --2- 172.21.15.99:0/2661173942 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c94186400 0x7f9c9408e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.830+0000 7f9c9a200640 1 --2- 172.21.15.99:0/2661173942 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9c940d5330 0x7f9c9408fd10 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:14.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.830+0000 7f9c9a200640 1 -- 172.21.15.99:0/2661173942 >> 172.21.15.99:0/2661173942 conn(0x7f9c940d6af0 msgr2=0x7f9c94189d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:07:14.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.830+0000 7f9c9a200640 1 -- 172.21.15.99:0/2661173942 shutdown_connections 2024-02-21T23:07:14.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:14.830+0000 7f9c9a200640 1 -- 172.21.15.99:0/2661173942 wait complete. 2024-02-21T23:07:15.837 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-02-21T23:07:15.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T23:07:15.838 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-02-21T23:07:16.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.085+0000 7f54e1200640 1 Processor -- start 2024-02-21T23:07:16.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.085+0000 7f54e1200640 1 -- start start 2024-02-21T23:07:16.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.088+0000 7f54e1200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f54dc188eb0 0x7f54dc189290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:16.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.088+0000 7f54e1200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f54dc0f8720 0x7f54dc184700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:16.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.088+0000 7f54e1200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54dc0f91d0 con 0x7f54dc1897d0 2024-02-21T23:07:16.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.088+0000 7f54e1200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54dc1868d0 con 0x7f54dc0f8720 2024-02-21T23:07:16.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.088+0000 7f54e1200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54dc0f8ef0 con 0x7f54dc188eb0 2024-02-21T23:07:16.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.088+0000 7f54d3e00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f54dc1897d0 0x7f54dc0f8010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:39320/0 (socket says 172.21.15.99:39320) 2024-02-21T23:07:16.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.088+0000 7f54d3e00640 1 -- 172.21.15.99:0/517770914 learned_addr learned my addr 172.21.15.99:0/517770914 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:07:16.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.088+0000 7f54da800640 1 --2- 172.21.15.99:0/517770914 >> v2:172.21.15.99:3300/0 conn(0x7f54dc0f8720 0x7f54dc184700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:16.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.088+0000 7f54d9e00640 1 --2- 172.21.15.99:0/517770914 >> v2:172.21.15.162:3300/0 conn(0x7f54dc188eb0 0x7f54dc189290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:16.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.089+0000 7f54d9400640 1 -- 172.21.15.99:0/517770914 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3844627953 0 0) 0x7f54dc0f91d0 con 0x7f54dc1897d0 2024-02-21T23:07:16.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.089+0000 7f54d9400640 1 -- 172.21.15.99:0/517770914 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54c0003520 con 0x7f54dc1897d0 2024-02-21T23:07:16.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.089+0000 7f54d9e00640 1 -- 172.21.15.99:0/517770914 >> v2:172.21.15.99:3300/0 conn(0x7f54dc0f8720 msgr2=0x7f54dc184700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:16.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.089+0000 7f54d9e00640 1 --2- 172.21.15.99:0/517770914 >> v2:172.21.15.99:3300/0 conn(0x7f54dc0f8720 0x7f54dc184700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:16.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.089+0000 7f54d9e00640 1 -- 172.21.15.99:0/517770914 >> v1:172.21.15.99:6789/0 conn(0x7f54dc1897d0 legacy=0x7f54dc0f8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:16.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.089+0000 7f54d9e00640 1 -- 172.21.15.99:0/517770914 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54dc183940 con 0x7f54dc188eb0 2024-02-21T23:07:16.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.089+0000 7f54da800640 1 --2- 172.21.15.99:0/517770914 >> v2:172.21.15.99:3300/0 conn(0x7f54dc0f8720 0x7f54dc184700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:07:16.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.091+0000 7f54d9e00640 1 --2- 172.21.15.99:0/517770914 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54dc188eb0 0x7f54dc189290 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f54dc08e6f0 tx=0x7f54cc02b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9918dc39fa218ca server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:16.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.091+0000 7f54d9400640 1 -- 172.21.15.99:0/517770914 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54cc0315a0 con 0x7f54dc188eb0 2024-02-21T23:07:16.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.091+0000 7f54d9400640 1 -- 172.21.15.99:0/517770914 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54cc037070 con 0x7f54dc188eb0 2024-02-21T23:07:16.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.091+0000 7f54d9400640 1 -- 172.21.15.99:0/517770914 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54cc031960 con 0x7f54dc188eb0 2024-02-21T23:07:16.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.092+0000 7f54e1200640 1 -- 172.21.15.99:0/517770914 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54dc188eb0 msgr2=0x7f54dc189290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:16.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.092+0000 7f54e1200640 1 --2- 172.21.15.99:0/517770914 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54dc188eb0 0x7f54dc189290 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f54dc08e6f0 tx=0x7f54cc02b840 comp rx=0 tx=0).stop 2024-02-21T23:07:16.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.092+0000 7f54e1200640 1 -- 172.21.15.99:0/517770914 shutdown_connections 2024-02-21T23:07:16.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.092+0000 7f54e1200640 1 --2- 172.21.15.99:0/517770914 >> v2:172.21.15.99:3300/0 conn(0x7f54dc0f8720 0x7f54dc184700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:16.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.092+0000 7f54e1200640 1 --2- 172.21.15.99:0/517770914 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54dc188eb0 0x7f54dc189290 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:16.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.092+0000 7f54e1200640 1 -- 172.21.15.99:0/517770914 >> 172.21.15.99:0/517770914 conn(0x7f54dc0ce5e0 msgr2=0x7f54dc0ce9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:07:16.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.092+0000 7f54e1200640 1 -- 172.21.15.99:0/517770914 shutdown_connections 2024-02-21T23:07:16.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.092+0000 7f54e1200640 1 -- 172.21.15.99:0/517770914 wait complete. 2024-02-21T23:07:16.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.095+0000 7f54e1200640 1 Processor -- start 2024-02-21T23:07:16.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.095+0000 7f54e1200640 1 -- start start 2024-02-21T23:07:16.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.097+0000 7f54e1200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54dc0f8720 0x7f54dc21d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:16.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.097+0000 7f54e1200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54dc188eb0 0x7f54dc21be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:16.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.097+0000 7f54e1200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f54dc1897d0 0x7f54dc21c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:16.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.097+0000 7f54e1200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54dc0f8bb0 con 0x7f54dc0f8720 2024-02-21T23:07:16.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.097+0000 7f54e1200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54dc183f00 con 0x7f54dc188eb0 2024-02-21T23:07:16.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.097+0000 7f54e1200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54dc189c30 con 0x7f54dc1897d0 2024-02-21T23:07:16.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.098+0000 7f54d9e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54dc0f8720 0x7f54dc21d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:16.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.098+0000 7f54d9e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54dc0f8720 0x7f54dc21d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:36640/0 (socket says 172.21.15.99:36640) 2024-02-21T23:07:16.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.098+0000 7f54d9e00640 1 -- 172.21.15.99:0/3212074919 learned_addr learned my addr 172.21.15.99:0/3212074919 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:07:16.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.098+0000 7f54d3e00640 1 --2- 172.21.15.99:0/3212074919 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54dc188eb0 0x7f54dc21be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:16.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.098+0000 7f54da800640 1 --2- 172.21.15.99:0/3212074919 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f54dc1897d0 0x7f54dc21c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:16.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.098+0000 7f54d9e00640 1 -- 172.21.15.99:0/3212074919 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f54dc1897d0 msgr2=0x7f54dc21c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:16.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.098+0000 7f54d9e00640 1 --2- 172.21.15.99:0/3212074919 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f54dc1897d0 0x7f54dc21c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:16.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.098+0000 7f54d9e00640 1 -- 172.21.15.99:0/3212074919 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54dc188eb0 msgr2=0x7f54dc21be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:16.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.098+0000 7f54d9e00640 1 --2- 172.21.15.99:0/3212074919 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54dc188eb0 0x7f54dc21be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:16.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.098+0000 7f54d9e00640 1 -- 172.21.15.99:0/3212074919 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54dc21c8b0 con 0x7f54dc0f8720 2024-02-21T23:07:16.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.098+0000 7f54da800640 1 --2- 172.21.15.99:0/3212074919 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f54dc1897d0 0x7f54dc21c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:07:16.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.098+0000 7f54d9e00640 1 --2- 172.21.15.99:0/3212074919 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54dc0f8720 0x7f54dc21d2c0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f54cc009890 tx=0x7f54cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:16.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.099+0000 7f54d2000640 1 -- 172.21.15.99:0/3212074919 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54cc032630 con 0x7f54dc0f8720 2024-02-21T23:07:16.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.099+0000 7f54d2000640 1 -- 172.21.15.99:0/3212074919 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54cc0327d0 con 0x7f54dc0f8720 2024-02-21T23:07:16.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.099+0000 7f54d2000640 1 -- 172.21.15.99:0/3212074919 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54cc032bc0 con 0x7f54dc0f8720 2024-02-21T23:07:16.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.099+0000 7f54e1200640 1 -- 172.21.15.99:0/3212074919 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54dc21aab0 con 0x7f54dc0f8720 2024-02-21T23:07:16.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.099+0000 7f54e1200640 1 -- 172.21.15.99:0/3212074919 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54dc21b070 con 0x7f54dc0f8720 2024-02-21T23:07:16.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.103+0000 7f54d2000640 1 -- 172.21.15.99:0/3212074919 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f54cc04c020 con 0x7f54dc0f8720 2024-02-21T23:07:16.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.105+0000 7f54d2000640 1 --2- 172.21.15.99:0/3212074919 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f54b809eed0 0x7f54b80a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:16.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.105+0000 7f54d2000640 1 -- 172.21.15.99:0/3212074919 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f54cc02f020 con 0x7f54dc0f8720 2024-02-21T23:07:16.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.105+0000 7f54e41b9740 1 Processor -- start 2024-02-21T23:07:16.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.105+0000 7f54d3e00640 1 --2- 172.21.15.99:0/3212074919 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f54b809eed0 0x7f54b80a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:16.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.106+0000 7f54e41b9740 1 -- start start 2024-02-21T23:07:16.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.106+0000 7f54d3e00640 1 --2- 172.21.15.99:0/3212074919 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f54b809eed0 0x7f54b80a1390 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f54dc0c8f40 tx=0x7f54c4009040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:16.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.107+0000 7f54e41b9740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eced6d47c0 0x55eced6d4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:16.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.108+0000 7f54e41b9740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55eced6d50e0 0x55eced70eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:16.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.108+0000 7f54e41b9740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eced70f0a0 0x55eced6db820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:16.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.108+0000 7f54e41b9740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eced5f8790 con 0x55eced6d50e0 2024-02-21T23:07:16.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.108+0000 7f54e41b9740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eced5a1bf0 con 0x55eced70f0a0 2024-02-21T23:07:16.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.108+0000 7f54e41b9740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eced5f4830 con 0x55eced6d47c0 2024-02-21T23:07:16.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.108+0000 7f54d9e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eced6d47c0 0x55eced6d4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:16.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.108+0000 7f54d3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55eced6d50e0 0x55eced70eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:16.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.108+0000 7f54d9e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eced6d47c0 0x55eced6d4ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:37728/0 (socket says 172.21.15.99:37728) 2024-02-21T23:07:16.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.108+0000 7f54d9e00640 1 -- 172.21.15.99:0/1900993412 learned_addr learned my addr 172.21.15.99:0/1900993412 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:07:16.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.108+0000 7f54da800640 1 --2- 172.21.15.99:0/1900993412 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eced70f0a0 0x55eced6db820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:16.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.108+0000 7f54d9e00640 1 -- 172.21.15.99:0/1900993412 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eced70f0a0 msgr2=0x55eced6db820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:16.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.108+0000 7f54d9e00640 1 --2- 172.21.15.99:0/1900993412 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eced70f0a0 0x55eced6db820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:16.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.108+0000 7f54d9e00640 1 -- 172.21.15.99:0/1900993412 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55eced6d50e0 msgr2=0x55eced70eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:16.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.108+0000 7f54d9e00640 1 --2- 172.21.15.99:0/1900993412 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55eced6d50e0 0x55eced70eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:16.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.108+0000 7f54d9e00640 1 -- 172.21.15.99:0/1900993412 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eced5bfc40 con 0x55eced6d47c0 2024-02-21T23:07:16.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.109+0000 7f54d9e00640 1 --2- 172.21.15.99:0/1900993412 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eced6d47c0 0x55eced6d4ba0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f54cc0091d0 tx=0x7f54cc0b8c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b82736834c3dd699 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:16.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.109+0000 7f54caa00640 1 -- 172.21.15.99:0/1900993412 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54cc0bd3c0 con 0x55eced6d47c0 2024-02-21T23:07:16.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.109+0000 7f54caa00640 1 -- 172.21.15.99:0/1900993412 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54cc037040 con 0x55eced6d47c0 2024-02-21T23:07:16.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.109+0000 7f54caa00640 1 -- 172.21.15.99:0/1900993412 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54cc0c1980 con 0x55eced6d47c0 2024-02-21T23:07:16.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.110+0000 7f54e41b9740 1 -- 172.21.15.99:0/1900993412 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eced6d47c0 msgr2=0x55eced6d4ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:16.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.110+0000 7f54e41b9740 1 --2- 172.21.15.99:0/1900993412 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eced6d47c0 0x55eced6d4ba0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f54cc0091d0 tx=0x7f54cc0b8c50 comp rx=0 tx=0).stop 2024-02-21T23:07:16.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.110+0000 7f54e41b9740 1 -- 172.21.15.99:0/1900993412 shutdown_connections 2024-02-21T23:07:16.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.110+0000 7f54e41b9740 1 --2- 172.21.15.99:0/1900993412 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eced70f0a0 0x55eced6db820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:16.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.110+0000 7f54e41b9740 1 --2- 172.21.15.99:0/1900993412 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55eced6d50e0 0x55eced70eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:16.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.110+0000 7f54e41b9740 1 --2- 172.21.15.99:0/1900993412 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eced6d47c0 0x55eced6d4ba0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:16.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.110+0000 7f54e41b9740 1 -- 172.21.15.99:0/1900993412 >> 172.21.15.99:0/1900993412 conn(0x55eced6928c0 msgr2=0x55eced693940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:07:16.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.110+0000 7f54e41b9740 1 -- 172.21.15.99:0/1900993412 shutdown_connections 2024-02-21T23:07:16.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.110+0000 7f54e41b9740 1 -- 172.21.15.99:0/1900993412 wait complete. 2024-02-21T23:07:16.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.112+0000 7f54e41b9740 1 -- start start 2024-02-21T23:07:16.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.112+0000 7f54e41b9740 1 Processor -- start 2024-02-21T23:07:16.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.114+0000 7f54e41b9740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55eced6d50e0 0x55eced6ff520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:16.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.114+0000 7f54e41b9740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eced70f0a0 0x55eced6c08b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:16.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.114+0000 7f54e41b9740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eced6c0df0 0x55eced718a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:16.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.114+0000 7f54e41b9740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eced5f8790 con 0x55eced6d50e0 2024-02-21T23:07:16.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.114+0000 7f54e41b9740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eced5971d0 con 0x55eced70f0a0 2024-02-21T23:07:16.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.114+0000 7f54e41b9740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eced5f4830 con 0x55eced6c0df0 2024-02-21T23:07:16.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.114+0000 7f54e41b9740 10 client.0 _ll_register_callbacks cb 0x55eced30cc60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:07:16.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.114+0000 7f54d9e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55eced6d50e0 0x55eced6ff520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:16.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.114+0000 7f54d9e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55eced6d50e0 0x55eced6ff520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:36666/0 (socket says 172.21.15.99:36666) 2024-02-21T23:07:16.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.114+0000 7f54d9e00640 1 -- 172.21.15.99:0/543822321 learned_addr learned my addr 172.21.15.99:0/543822321 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:07:16.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.114+0000 7f54da800640 1 --2- 172.21.15.99:0/543822321 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eced6c0df0 0x55eced718a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:16.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.114+0000 7f54d3e00640 1 --2- 172.21.15.99:0/543822321 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eced70f0a0 0x55eced6c08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:16.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.115+0000 7f54d9e00640 1 -- 172.21.15.99:0/543822321 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eced6c0df0 msgr2=0x55eced718a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:16.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.115+0000 7f54d9e00640 1 --2- 172.21.15.99:0/543822321 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eced6c0df0 0x55eced718a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:16.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.115+0000 7f54d9e00640 1 -- 172.21.15.99:0/543822321 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eced70f0a0 msgr2=0x55eced6c08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:16.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.115+0000 7f54d9e00640 1 --2- 172.21.15.99:0/543822321 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eced70f0a0 0x55eced6c08b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:16.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.115+0000 7f54d9e00640 1 -- 172.21.15.99:0/543822321 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55eced3d57e0 con 0x55eced6d50e0 2024-02-21T23:07:16.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.115+0000 7f54d9e00640 1 --2- 172.21.15.99:0/543822321 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55eced6d50e0 0x55eced6ff520 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f54cc006f80 tx=0x7f54cc031000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84916d5ebd034c57 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:16.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.115+0000 7f54bf400640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:07:16.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.115+0000 7f54bf400640 1 -- 172.21.15.99:0/543822321 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54cc0d5060 con 0x55eced6d50e0 2024-02-21T23:07:16.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.115+0000 7f54bf400640 1 -- 172.21.15.99:0/543822321 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f54cc0b58e0 con 0x55eced6d50e0 2024-02-21T23:07:16.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.115+0000 7f54e41b9740 1 -- 172.21.15.99:0/543822321 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f54cc037040 con 0x55eced6d50e0 2024-02-21T23:07:16.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.116+0000 7f54bf400640 1 -- 172.21.15.99:0/543822321 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f54cc0bd3c0 con 0x55eced6d50e0 2024-02-21T23:07:16.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.116+0000 7f54e41b9740 10 client.6126 fetch_fsmap learned FSMap version 17 2024-02-21T23:07:16.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.116+0000 7f54e41b9740 1 -- 172.21.15.99:0/543822321 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55eced435f70 con 0x55eced6d50e0 2024-02-21T23:07:16.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.116+0000 7f54bf400640 1 -- 172.21.15.99:0/543822321 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54cc037040 con 0x55eced6d50e0 2024-02-21T23:07:16.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.116+0000 7f54bf400640 1 -- 172.21.15.99:0/543822321 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f54cc031070 con 0x55eced6d50e0 2024-02-21T23:07:16.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.116+0000 7f54e41b9740 10 client.6126 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:07:16.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.116+0000 7f54e41b9740 10 client.6126 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:07:16.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.116+0000 7f54e41b9740 20 client.6126 populate_metadata read hostname 'smithi099' 2024-02-21T23:07:16.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.116+0000 7f54e41b9740 1 --2- 172.21.15.99:0/543822321 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55eced719490 0x55eced6cfe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:16.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.116+0000 7f54e41b9740 4 client.6126 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:07:16.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.117+0000 7f54e41b9740 1 -- 172.21.15.99:0/543822321 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55eced605cd0 con 0x55eced719490 2024-02-21T23:07:16.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.117+0000 7f54d3e00640 1 --2- 172.21.15.99:0/543822321 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55eced719490 0x55eced6cfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:16.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.118+0000 7f54d3e00640 1 --2- 172.21.15.99:0/543822321 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55eced719490 0x55eced6cfe20 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af06125633260f94 server_cookie=925eab05c0e3e36b in_seq=0 out_seq=0 2024-02-21T23:07:16.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.118+0000 7f54bf400640 10 client.6126 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:07:16.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.119+0000 7f54bf400640 1 -- 172.21.15.99:0/543822321 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55eced605cd0 con 0x55eced719490 2024-02-21T23:07:16.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.119+0000 7f54bf400640 10 client.6126 handle_command_reply: tid=0 2024-02-21T23:07:16.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.119+0000 7f54e41b9740 1 client.6126 shutdown 2024-02-21T23:07:16.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.119+0000 7f54e41b9740 1 -- 172.21.15.99:0/543822321 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55eced6d50e0 msgr2=0x55eced6ff520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:16.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.119+0000 7f54e41b9740 1 --2- 172.21.15.99:0/543822321 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55eced6d50e0 0x55eced6ff520 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f54cc006f80 tx=0x7f54cc031000 comp rx=0 tx=0).stop 2024-02-21T23:07:16.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.119+0000 7f54e41b9740 1 -- 172.21.15.99:0/543822321 shutdown_connections 2024-02-21T23:07:16.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.119+0000 7f54e41b9740 1 --2- 172.21.15.99:0/543822321 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55eced719490 0x55eced6cfe20 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:16.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.119+0000 7f54e41b9740 1 --2- 172.21.15.99:0/543822321 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eced6c0df0 0x55eced718a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:16.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.119+0000 7f54e41b9740 1 --2- 172.21.15.99:0/543822321 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eced70f0a0 0x55eced6c08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:16.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.119+0000 7f54e41b9740 1 --2- 172.21.15.99:0/543822321 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55eced6d50e0 0x55eced6ff520 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:16.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.119+0000 7f54e41b9740 1 -- 172.21.15.99:0/543822321 >> 172.21.15.99:0/543822321 conn(0x55eced6d47c0 msgr2=0x55eced707070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:07:16.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.120+0000 7f54bf400640 0 client.6126 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:07:16.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.120+0000 7f54e41b9740 1 -- 172.21.15.99:0/543822321 shutdown_connections 2024-02-21T23:07:16.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.120+0000 7f54e41b9740 1 -- 172.21.15.99:0/543822321 wait complete. 2024-02-21T23:07:16.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.120+0000 7f54e41b9740 20 client.6126 trim_cache size 0 max 16384 2024-02-21T23:07:16.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.155+0000 7f54e41b9740 1 Processor -- start 2024-02-21T23:07:16.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.155+0000 7f54e41b9740 1 -- start start 2024-02-21T23:07:16.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.157+0000 7f54e41b9740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eced6c0df0 0x55eced706d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:16.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.157+0000 7f54e41b9740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eced6d50e0 0x55eced70e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:16.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.157+0000 7f54e41b9740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55eced70f0a0 0x55eced690b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:16.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.157+0000 7f54e41b9740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54dc228480 con 0x55eced70f0a0 2024-02-21T23:07:16.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.157+0000 7f54e41b9740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54dc226020 con 0x55eced6c0df0 2024-02-21T23:07:16.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.157+0000 7f54e41b9740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54dc190450 con 0x55eced6d50e0 2024-02-21T23:07:16.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.157+0000 7f54da800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55eced70f0a0 0x55eced690b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:16.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.157+0000 7f54d9e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eced6c0df0 0x55eced706d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:16.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.158+0000 7f54d3e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eced6d50e0 0x55eced70e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:16.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.158+0000 7f54d9e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eced6c0df0 0x55eced706d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:56628/0 (socket says 172.21.15.99:56628) 2024-02-21T23:07:16.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.158+0000 7f54d3e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eced6d50e0 0x55eced70e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:37740/0 (socket says 172.21.15.99:37740) 2024-02-21T23:07:16.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.158+0000 7f54d9e00640 1 -- 172.21.15.99:0/2787496437 learned_addr learned my addr 172.21.15.99:0/2787496437 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:07:16.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.158+0000 7f54d9e00640 1 -- 172.21.15.99:0/2787496437 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eced6d50e0 msgr2=0x55eced70e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:16.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.158+0000 7f54d9e00640 1 --2- 172.21.15.99:0/2787496437 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eced6d50e0 0x55eced70e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:16.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.158+0000 7f54d9e00640 1 -- 172.21.15.99:0/2787496437 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55eced70f0a0 msgr2=0x55eced690b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:16.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.158+0000 7f54d9e00640 1 --2- 172.21.15.99:0/2787496437 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55eced70f0a0 0x55eced690b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:16.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.158+0000 7f54d9e00640 1 -- 172.21.15.99:0/2787496437 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eced6d4f10 con 0x55eced6c0df0 2024-02-21T23:07:16.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.158+0000 7f54d9e00640 1 --2- 172.21.15.99:0/2787496437 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eced6c0df0 0x55eced706d70 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f54cc0b7520 tx=0x7f54cc0bb000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e15d1e53cb72b4b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:16.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.158+0000 7f54ca000640 1 -- 172.21.15.99:0/2787496437 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54cc0d5030 con 0x55eced6c0df0 2024-02-21T23:07:16.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.158+0000 7f54ca000640 1 -- 172.21.15.99:0/2787496437 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54cc037040 con 0x55eced6c0df0 2024-02-21T23:07:16.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.159+0000 7f54ca000640 1 -- 172.21.15.99:0/2787496437 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54cc0b9040 con 0x55eced6c0df0 2024-02-21T23:07:16.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.159+0000 7f54e41b9740 1 -- 172.21.15.99:0/2787496437 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eced6c0df0 msgr2=0x55eced706d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:16.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.159+0000 7f54e41b9740 1 --2- 172.21.15.99:0/2787496437 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eced6c0df0 0x55eced706d70 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f54cc0b7520 tx=0x7f54cc0bb000 comp rx=0 tx=0).stop 2024-02-21T23:07:16.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.159+0000 7f54e41b9740 1 -- 172.21.15.99:0/2787496437 shutdown_connections 2024-02-21T23:07:16.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.159+0000 7f54e41b9740 1 --2- 172.21.15.99:0/2787496437 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55eced70f0a0 0x55eced690b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:16.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.159+0000 7f54e41b9740 1 --2- 172.21.15.99:0/2787496437 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eced6d50e0 0x55eced70e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:16.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.159+0000 7f54e41b9740 1 --2- 172.21.15.99:0/2787496437 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eced6c0df0 0x55eced706d70 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:16.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.159+0000 7f54e41b9740 1 -- 172.21.15.99:0/2787496437 >> 172.21.15.99:0/2787496437 conn(0x55eced6d47c0 msgr2=0x55eced6c06c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:07:16.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.159+0000 7f54e41b9740 1 -- 172.21.15.99:0/2787496437 shutdown_connections 2024-02-21T23:07:16.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.159+0000 7f54e41b9740 1 -- 172.21.15.99:0/2787496437 wait complete. 2024-02-21T23:07:16.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.160+0000 7f54e41b9740 1 -- start start 2024-02-21T23:07:16.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.160+0000 7f54e41b9740 1 Processor -- start 2024-02-21T23:07:16.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.162+0000 7f54e41b9740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55eced6c0df0 0x55eced6d4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:16.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.162+0000 7f54e41b9740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eced6d50e0 0x55eced6ff520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:16.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.162+0000 7f54e41b9740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eced70f0a0 0x55eced68f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:16.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.162+0000 7f54e41b9740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54dc190a50 con 0x55eced6c0df0 2024-02-21T23:07:16.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.162+0000 7f54e41b9740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54dc2259c0 con 0x55eced70f0a0 2024-02-21T23:07:16.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.162+0000 7f54e41b9740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54dc191050 con 0x55eced6d50e0 2024-02-21T23:07:16.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.163+0000 7f54e41b9740 10 client.0 _ll_register_callbacks cb 0x7f54d4009b90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:07:16.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.163+0000 7f54d9e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55eced6c0df0 0x55eced6d4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:16.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.163+0000 7f54d3e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eced6d50e0 0x55eced6ff520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:16.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.163+0000 7f54d3e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eced6d50e0 0x55eced6ff520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:37748/0 (socket says 172.21.15.99:37748) 2024-02-21T23:07:16.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.163+0000 7f54d3e00640 1 -- 172.21.15.99:0/3905022126 learned_addr learned my addr 172.21.15.99:0/3905022126 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:07:16.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.163+0000 7f54da800640 1 --2- 172.21.15.99:0/3905022126 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eced70f0a0 0x55eced68f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:16.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.163+0000 7f54d3e00640 1 -- 172.21.15.99:0/3905022126 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eced70f0a0 msgr2=0x55eced68f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:16.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.163+0000 7f54d3e00640 1 --2- 172.21.15.99:0/3905022126 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eced70f0a0 0x55eced68f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:16.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.163+0000 7f54d3e00640 1 -- 172.21.15.99:0/3905022126 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55eced6c0df0 msgr2=0x55eced6d4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:16.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.163+0000 7f54d3e00640 1 --2- 172.21.15.99:0/3905022126 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55eced6c0df0 0x55eced6d4ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:16.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.163+0000 7f54d3e00640 1 -- 172.21.15.99:0/3905022126 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55eced2cd170 con 0x55eced6d50e0 2024-02-21T23:07:16.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.163+0000 7f54d9e00640 1 --2- 172.21.15.99:0/3905022126 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55eced6c0df0 0x55eced6d4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:07:16.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.164+0000 7f54d3e00640 1 --2- 172.21.15.99:0/3905022126 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eced6d50e0 0x55eced6ff520 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x55eced69b9c0 tx=0x7f54c4000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b762c4ce8d45587d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:16.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.164+0000 7f54bf400640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-02-21T23:07:16.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.164+0000 7f54bf400640 1 -- 172.21.15.99:0/3905022126 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c4028e10 con 0x55eced6d50e0 2024-02-21T23:07:16.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.164+0000 7f54e41b9740 1 -- 172.21.15.99:0/3905022126 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f54cc037040 con 0x55eced6d50e0 2024-02-21T23:07:16.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.164+0000 7f54bf400640 1 -- 172.21.15.99:0/3905022126 <== mon.2 v2:172.21.15.181:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f54c401e040 con 0x55eced6d50e0 2024-02-21T23:07:16.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.164+0000 7f54bf400640 1 -- 172.21.15.99:0/3905022126 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f54c4037050 con 0x55eced6d50e0 2024-02-21T23:07:16.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.164+0000 7f54e41b9740 10 client.6263 fetch_fsmap learned FSMap version 17 2024-02-21T23:07:16.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.164+0000 7f54e41b9740 1 -- 172.21.15.99:0/3905022126 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55eced76e8a0 con 0x55eced6d50e0 2024-02-21T23:07:16.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.164+0000 7f54bf400640 1 -- 172.21.15.99:0/3905022126 <== mon.2 v2:172.21.15.181:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54cc037040 con 0x55eced6d50e0 2024-02-21T23:07:16.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.165+0000 7f54bf400640 1 -- 172.21.15.99:0/3905022126 <== mon.2 v2:172.21.15.181:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f54c4014450 con 0x55eced6d50e0 2024-02-21T23:07:16.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.165+0000 7f54e41b9740 10 client.6263 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:07:16.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.165+0000 7f54e41b9740 10 client.6263 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:07:16.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.165+0000 7f54e41b9740 20 client.6263 populate_metadata read hostname 'smithi099' 2024-02-21T23:07:16.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.165+0000 7f54e41b9740 1 --2- 172.21.15.99:0/3905022126 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55eced701110 0x55eced76aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:16.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.165+0000 7f54e41b9740 4 client.6263 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-02-21T23:07:16.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.165+0000 7f54e41b9740 1 -- 172.21.15.99:0/3905022126 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55eced600020 con 0x55eced701110 2024-02-21T23:07:16.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.165+0000 7f54d9e00640 1 --2- 172.21.15.99:0/3905022126 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55eced701110 0x55eced76aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:16.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.166+0000 7f54d9e00640 1 --2- 172.21.15.99:0/3905022126 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55eced701110 0x55eced76aa90 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de3ff14876f74ceb server_cookie=af8ce64fd8984463 in_seq=0 out_seq=0 2024-02-21T23:07:16.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.166+0000 7f54bf400640 10 client.6263 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:07:16.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.167+0000 7f54bf400640 1 -- 172.21.15.99:0/3905022126 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55eced600020 con 0x55eced701110 2024-02-21T23:07:16.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.167+0000 7f54bf400640 10 client.6263 handle_command_reply: tid=0 2024-02-21T23:07:16.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.167+0000 7f54e41b9740 1 client.6263 shutdown 2024-02-21T23:07:16.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.167+0000 7f54e41b9740 1 -- 172.21.15.99:0/3905022126 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eced6d50e0 msgr2=0x55eced6ff520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:16.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.167+0000 7f54e41b9740 1 --2- 172.21.15.99:0/3905022126 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eced6d50e0 0x55eced6ff520 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x55eced69b9c0 tx=0x7f54c4000bc0 comp rx=0 tx=0).stop 2024-02-21T23:07:16.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.168+0000 7f54e41b9740 1 -- 172.21.15.99:0/3905022126 shutdown_connections 2024-02-21T23:07:16.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.168+0000 7f54e41b9740 1 --2- 172.21.15.99:0/3905022126 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55eced701110 0x55eced76aa90 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:16.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.168+0000 7f54e41b9740 1 --2- 172.21.15.99:0/3905022126 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eced70f0a0 0x55eced68f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:16.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.168+0000 7f54e41b9740 1 --2- 172.21.15.99:0/3905022126 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55eced6d50e0 0x55eced6ff520 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:16.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.168+0000 7f54e41b9740 1 --2- 172.21.15.99:0/3905022126 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55eced6c0df0 0x55eced6d4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:16.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.168+0000 7f54e41b9740 1 -- 172.21.15.99:0/3905022126 >> 172.21.15.99:0/3905022126 conn(0x55eced6d47c0 msgr2=0x55eced68e120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:07:16.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.168+0000 7f54bf400640 0 client.6263 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:07:16.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.168+0000 7f54e41b9740 1 -- 172.21.15.99:0/3905022126 shutdown_connections 2024-02-21T23:07:16.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.168+0000 7f54e41b9740 1 -- 172.21.15.99:0/3905022126 wait complete. 2024-02-21T23:07:16.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.168+0000 7f54e41b9740 20 client.6263 trim_cache size 0 max 16384 2024-02-21T23:07:16.164 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-02-21T23:07:16.164 INFO:teuthology.orchestra.run.smithi099.stdout: "return_code": 0, 2024-02-21T23:07:16.165 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_tag": "1d928e09-6f2e-4695-a83b-cfd2f7ab3cb6", 2024-02-21T23:07:16.165 INFO:teuthology.orchestra.run.smithi099.stdout: "mode": "asynchronous" 2024-02-21T23:07:16.165 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-02-21T23:07:16.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.169+0000 7f54e1200640 1 -- 172.21.15.99:0/3212074919 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f54b809eed0 msgr2=0x7f54b80a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:16.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.169+0000 7f54e1200640 1 --2- 172.21.15.99:0/3212074919 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f54b809eed0 0x7f54b80a1390 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f54dc0c8f40 tx=0x7f54c4009040 comp rx=0 tx=0).stop 2024-02-21T23:07:16.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.169+0000 7f54e1200640 1 -- 172.21.15.99:0/3212074919 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54dc0f8720 msgr2=0x7f54dc21d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:16.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.169+0000 7f54e1200640 1 --2- 172.21.15.99:0/3212074919 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54dc0f8720 0x7f54dc21d2c0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f54cc009890 tx=0x7f54cc0046c0 comp rx=0 tx=0).stop 2024-02-21T23:07:16.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.170+0000 7f54e1200640 1 -- 172.21.15.99:0/3212074919 shutdown_connections 2024-02-21T23:07:16.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.170+0000 7f54e1200640 1 --2- 172.21.15.99:0/3212074919 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f54b809eed0 0x7f54b80a1390 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:16.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.170+0000 7f54e1200640 1 --2- 172.21.15.99:0/3212074919 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f54dc1897d0 0x7f54dc21c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:16.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.170+0000 7f54e1200640 1 --2- 172.21.15.99:0/3212074919 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54dc188eb0 0x7f54dc21be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:16.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.170+0000 7f54e1200640 1 --2- 172.21.15.99:0/3212074919 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54dc0f8720 0x7f54dc21d2c0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:16.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.170+0000 7f54e1200640 1 -- 172.21.15.99:0/3212074919 >> 172.21.15.99:0/3212074919 conn(0x7f54dc0ce5e0 msgr2=0x7f54dc0f5680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:07:16.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.170+0000 7f54e1200640 1 -- 172.21.15.99:0/3212074919 shutdown_connections 2024-02-21T23:07:16.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.170+0000 7f54e1200640 1 -- 172.21.15.99:0/3212074919 wait complete. 2024-02-21T23:07:16.182 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T23:07:16.182 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T23:07:16.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.479+0000 7f4c36200640 1 Processor -- start 2024-02-21T23:07:16.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.479+0000 7f4c36200640 1 -- start start 2024-02-21T23:07:16.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.482+0000 7f4c36200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4c30186400 0x7f4c30187ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:16.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.482+0000 7f4c36200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f4c301867e0 0x7f4c30188010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:16.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.482+0000 7f4c36200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c300cf820 con 0x7f4c30188550 2024-02-21T23:07:16.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.482+0000 7f4c36200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c30187640 con 0x7f4c301867e0 2024-02-21T23:07:16.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.482+0000 7f4c36200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c300cfb00 con 0x7f4c30186400 2024-02-21T23:07:16.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.482+0000 7f4c2f400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4c30186400 0x7f4c30187ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:16.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.482+0000 7f4c2f400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4c30186400 0x7f4c30187ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:56634/0 (socket says 172.21.15.99:56634) 2024-02-21T23:07:16.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.482+0000 7f4c2ea00640 1 --2- 172.21.15.99:0/1755355873 >> v2:172.21.15.99:3300/0 conn(0x7f4c301867e0 0x7f4c30188010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:16.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.482+0000 7f4c2f400640 1 -- 172.21.15.99:0/1755355873 learned_addr learned my addr 172.21.15.99:0/1755355873 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:07:16.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.483+0000 7f4c2f400640 1 -- 172.21.15.99:0/1755355873 >> v2:172.21.15.99:3300/0 conn(0x7f4c301867e0 msgr2=0x7f4c30188010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:16.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.483+0000 7f4c2f400640 1 --2- 172.21.15.99:0/1755355873 >> v2:172.21.15.99:3300/0 conn(0x7f4c301867e0 0x7f4c30188010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:16.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.483+0000 7f4c2f400640 1 -- 172.21.15.99:0/1755355873 >> v1:172.21.15.162:6789/0 conn(0x7f4c30188550 legacy=0x7f4c3018c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:16.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.483+0000 7f4c2f400640 1 -- 172.21.15.99:0/1755355873 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c30186d10 con 0x7f4c30186400 2024-02-21T23:07:16.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.483+0000 7f4c2ea00640 1 --2- 172.21.15.99:0/1755355873 >> v2:172.21.15.99:3300/0 conn(0x7f4c301867e0 0x7f4c30188010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:07:16.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.483+0000 7f4c2e000640 1 -- 172.21.15.99:0/1755355873 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3665047212 0 0) 0x7f4c300cf820 con 0x7f4c30188550 2024-02-21T23:07:16.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.485+0000 7f4c2f400640 1 --2- 172.21.15.99:0/1755355873 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c30186400 0x7f4c30187ad0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f4c300d3f70 tx=0x7f4c2002b920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad0c7de8ea0d5f0c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:16.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.485+0000 7f4c2e000640 1 -- 172.21.15.99:0/1755355873 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c20035020 con 0x7f4c30186400 2024-02-21T23:07:16.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.485+0000 7f4c2e000640 1 -- 172.21.15.99:0/1755355873 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c20031880 con 0x7f4c30186400 2024-02-21T23:07:16.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.485+0000 7f4c2e000640 1 -- 172.21.15.99:0/1755355873 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c20031c50 con 0x7f4c30186400 2024-02-21T23:07:16.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.486+0000 7f4c36200640 1 -- 172.21.15.99:0/1755355873 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c30186400 msgr2=0x7f4c30187ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:16.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.486+0000 7f4c36200640 1 --2- 172.21.15.99:0/1755355873 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c30186400 0x7f4c30187ad0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f4c300d3f70 tx=0x7f4c2002b920 comp rx=0 tx=0).stop 2024-02-21T23:07:16.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.486+0000 7f4c36200640 1 -- 172.21.15.99:0/1755355873 shutdown_connections 2024-02-21T23:07:16.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.486+0000 7f4c36200640 1 --2- 172.21.15.99:0/1755355873 >> v2:172.21.15.99:3300/0 conn(0x7f4c301867e0 0x7f4c30188010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:16.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.486+0000 7f4c36200640 1 --2- 172.21.15.99:0/1755355873 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c30186400 0x7f4c30187ad0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:16.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.486+0000 7f4c36200640 1 -- 172.21.15.99:0/1755355873 >> 172.21.15.99:0/1755355873 conn(0x7f4c300d6af0 msgr2=0x7f4c300740b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:07:16.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.486+0000 7f4c36200640 1 -- 172.21.15.99:0/1755355873 shutdown_connections 2024-02-21T23:07:16.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.486+0000 7f4c36200640 1 -- 172.21.15.99:0/1755355873 wait complete. 2024-02-21T23:07:16.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.489+0000 7f4c36200640 1 Processor -- start 2024-02-21T23:07:16.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.490+0000 7f4c36200640 1 -- start start 2024-02-21T23:07:16.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.491+0000 7f4c36200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c30186400 0x7f4c30168e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:16.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.491+0000 7f4c36200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4c301867e0 0x7f4c3017dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:16.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.491+0000 7f4c36200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4c30188550 0x7f4c3017e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:16.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.491+0000 7f4c36200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c300d5330 con 0x7f4c30188550 2024-02-21T23:07:16.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.491+0000 7f4c36200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c301872d0 con 0x7f4c30186400 2024-02-21T23:07:16.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.491+0000 7f4c36200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c300d54b0 con 0x7f4c301867e0 2024-02-21T23:07:16.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.492+0000 7f4c2f400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c30186400 0x7f4c30168e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:16.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.492+0000 7f4c2f400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c30186400 0x7f4c30168e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:56648/0 (socket says 172.21.15.99:56648) 2024-02-21T23:07:16.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.492+0000 7f4c2f400640 1 -- 172.21.15.99:0/921389910 learned_addr learned my addr 172.21.15.99:0/921389910 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:07:16.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.492+0000 7f4c2fe00640 1 --2- 172.21.15.99:0/921389910 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4c30188550 0x7f4c3017e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:16.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.492+0000 7f4c2ea00640 1 --2- 172.21.15.99:0/921389910 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4c301867e0 0x7f4c3017dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:16.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.493+0000 7f4c2f400640 1 -- 172.21.15.99:0/921389910 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4c301867e0 msgr2=0x7f4c3017dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:16.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.493+0000 7f4c2f400640 1 --2- 172.21.15.99:0/921389910 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4c301867e0 0x7f4c3017dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:16.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.493+0000 7f4c2f400640 1 -- 172.21.15.99:0/921389910 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4c30188550 msgr2=0x7f4c3017e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:16.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.493+0000 7f4c2f400640 1 --2- 172.21.15.99:0/921389910 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4c30188550 0x7f4c3017e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:16.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.493+0000 7f4c2f400640 1 -- 172.21.15.99:0/921389910 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c30182a20 con 0x7f4c30186400 2024-02-21T23:07:16.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.493+0000 7f4c2fe00640 1 --2- 172.21.15.99:0/921389910 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4c30188550 0x7f4c3017e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:07:16.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.493+0000 7f4c2ea00640 1 --2- 172.21.15.99:0/921389910 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4c301867e0 0x7f4c3017dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:07:16.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.493+0000 7f4c2f400640 1 --2- 172.21.15.99:0/921389910 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c30186400 0x7f4c30168e40 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f4c20000c00 tx=0x7f4c200046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:16.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.494+0000 7f4c27400640 1 -- 172.21.15.99:0/921389910 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c20040070 con 0x7f4c30186400 2024-02-21T23:07:16.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.494+0000 7f4c27400640 1 -- 172.21.15.99:0/921389910 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c20030c90 con 0x7f4c30186400 2024-02-21T23:07:16.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.494+0000 7f4c27400640 1 -- 172.21.15.99:0/921389910 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c20035040 con 0x7f4c30186400 2024-02-21T23:07:16.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.494+0000 7f4c36200640 1 -- 172.21.15.99:0/921389910 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c30182d00 con 0x7f4c30186400 2024-02-21T23:07:16.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.494+0000 7f4c36200640 1 -- 172.21.15.99:0/921389910 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c301832c0 con 0x7f4c30186400 2024-02-21T23:07:16.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.499+0000 7f4c27400640 1 -- 172.21.15.99:0/921389910 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f4c20038020 con 0x7f4c30186400 2024-02-21T23:07:16.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.502+0000 7f4c27400640 1 --2- 172.21.15.99:0/921389910 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f4c1009eed0 0x7f4c100a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:16.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.502+0000 7f4c391b7740 1 Processor -- start 2024-02-21T23:07:16.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.502+0000 7f4c391b7740 1 -- start start 2024-02-21T23:07:16.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.502+0000 7f4c27400640 1 -- 172.21.15.99:0/921389910 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f4c200ebce0 con 0x7f4c30186400 2024-02-21T23:07:16.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.503+0000 7f4c2ea00640 1 --2- 172.21.15.99:0/921389910 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f4c1009eed0 0x7f4c100a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:16.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.504+0000 7f4c2ea00640 1 --2- 172.21.15.99:0/921389910 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f4c1009eed0 0x7f4c100a1390 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c006fd0 tx=0x7f4c1c008040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:16.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.504+0000 7f4c391b7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55df4bc670d0 0x55df4bc9cb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:16.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.504+0000 7f4c391b7740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55df4bc9d090 0x55df4bc674b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:16.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.504+0000 7f4c391b7740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55df4bc679f0 0x55df4bc2a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:16.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.504+0000 7f4c391b7740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df4bb93a90 con 0x55df4bc679f0 2024-02-21T23:07:16.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.504+0000 7f4c391b7740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df4bb3cb10 con 0x55df4bc670d0 2024-02-21T23:07:16.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.504+0000 7f4c391b7740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df4bb8fb30 con 0x55df4bc9d090 2024-02-21T23:07:16.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.504+0000 7f4c2f400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55df4bc670d0 0x55df4bc9cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:16.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.504+0000 7f4c2ea00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55df4bc9d090 0x55df4bc674b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:16.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.504+0000 7f4c2ea00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55df4bc9d090 0x55df4bc674b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:37778/0 (socket says 172.21.15.99:37778) 2024-02-21T23:07:16.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.504+0000 7f4c2ea00640 1 -- 172.21.15.99:0/3155793020 learned_addr learned my addr 172.21.15.99:0/3155793020 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:07:16.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.505+0000 7f4c2fe00640 1 --2- 172.21.15.99:0/3155793020 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55df4bc679f0 0x55df4bc2a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:16.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.505+0000 7f4c2ea00640 1 -- 172.21.15.99:0/3155793020 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55df4bc670d0 msgr2=0x55df4bc9cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:16.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.505+0000 7f4c2ea00640 1 --2- 172.21.15.99:0/3155793020 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55df4bc670d0 0x55df4bc9cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:16.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.505+0000 7f4c2ea00640 1 -- 172.21.15.99:0/3155793020 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55df4bc679f0 msgr2=0x55df4bc2a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:16.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.505+0000 7f4c2ea00640 1 --2- 172.21.15.99:0/3155793020 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55df4bc679f0 0x55df4bc2a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:16.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.505+0000 7f4c2ea00640 1 -- 172.21.15.99:0/3155793020 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55df4b9727d0 con 0x55df4bc9d090 2024-02-21T23:07:16.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.505+0000 7f4c2ea00640 1 --2- 172.21.15.99:0/3155793020 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55df4bc9d090 0x55df4bc674b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c0109f0 tx=0x7f4c1c013000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b53d5c7aca33ca0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:16.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.506+0000 7f4c1b400640 1 -- 172.21.15.99:0/3155793020 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1c01c050 con 0x55df4bc9d090 2024-02-21T23:07:16.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.506+0000 7f4c1b400640 1 -- 172.21.15.99:0/3155793020 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c1c026070 con 0x55df4bc9d090 2024-02-21T23:07:16.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.506+0000 7f4c1b400640 1 -- 172.21.15.99:0/3155793020 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1c00f040 con 0x55df4bc9d090 2024-02-21T23:07:16.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.507+0000 7f4c391b7740 1 -- 172.21.15.99:0/3155793020 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55df4bc9d090 msgr2=0x55df4bc674b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:16.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.507+0000 7f4c391b7740 1 --2- 172.21.15.99:0/3155793020 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55df4bc9d090 0x55df4bc674b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c0109f0 tx=0x7f4c1c013000 comp rx=0 tx=0).stop 2024-02-21T23:07:16.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.507+0000 7f4c391b7740 1 -- 172.21.15.99:0/3155793020 shutdown_connections 2024-02-21T23:07:16.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.507+0000 7f4c391b7740 1 --2- 172.21.15.99:0/3155793020 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55df4bc679f0 0x55df4bc2a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:16.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.507+0000 7f4c391b7740 1 --2- 172.21.15.99:0/3155793020 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55df4bc9d090 0x55df4bc674b0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:16.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.507+0000 7f4c391b7740 1 --2- 172.21.15.99:0/3155793020 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55df4bc670d0 0x55df4bc9cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:16.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.507+0000 7f4c391b7740 1 -- 172.21.15.99:0/3155793020 >> 172.21.15.99:0/3155793020 conn(0x55df4bbf66b0 msgr2=0x55df4bc2dfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:07:16.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.508+0000 7f4c391b7740 1 -- 172.21.15.99:0/3155793020 shutdown_connections 2024-02-21T23:07:16.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.508+0000 7f4c391b7740 1 -- 172.21.15.99:0/3155793020 wait complete. 2024-02-21T23:07:16.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.509+0000 7f4c391b7740 1 -- start start 2024-02-21T23:07:16.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.509+0000 7f4c391b7740 1 Processor -- start 2024-02-21T23:07:16.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.511+0000 7f4c391b7740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55df4bc670d0 0x55df4bc70cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:16.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.511+0000 7f4c391b7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55df4bc679f0 0x55df4bc71320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:16.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.511+0000 7f4c391b7740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55df4bc9d090 0x55df4bc286b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:16.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.512+0000 7f4c391b7740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df4bc35d60 con 0x55df4bc9d090 2024-02-21T23:07:16.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.512+0000 7f4c2ea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55df4bc679f0 0x55df4bc71320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:16.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.512+0000 7f4c2ea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55df4bc679f0 0x55df4bc71320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:56656/0 (socket says 172.21.15.99:56656) 2024-02-21T23:07:16.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.512+0000 7f4c2ea00640 1 -- 172.21.15.99:0/1220311412 learned_addr learned my addr 172.21.15.99:0/1220311412 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:07:16.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.511+0000 7f4c2f400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55df4bc670d0 0x55df4bc70cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:16.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.512+0000 7f4c391b7740 1 -- 172.21.15.99:0/1220311412 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df4bb321c0 con 0x55df4bc679f0 2024-02-21T23:07:16.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.512+0000 7f4c391b7740 1 -- 172.21.15.99:0/1220311412 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df4bc9e760 con 0x55df4bc670d0 2024-02-21T23:07:16.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.512+0000 7f4c2fe00640 1 --2- 172.21.15.99:0/1220311412 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55df4bc9d090 0x55df4bc286b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:16.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.513+0000 7f4c391b7740 10 client.0 _ll_register_callbacks cb 0x55df4bb4f930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:07:16.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.513+0000 7f4c2f400640 1 -- 172.21.15.99:0/1220311412 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55df4bc679f0 msgr2=0x55df4bc71320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:16.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.513+0000 7f4c2f400640 1 --2- 172.21.15.99:0/1220311412 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55df4bc679f0 0x55df4bc71320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:16.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.513+0000 7f4c2f400640 1 -- 172.21.15.99:0/1220311412 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55df4bc9d090 msgr2=0x55df4bc286b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:16.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.513+0000 7f4c2f400640 1 --2- 172.21.15.99:0/1220311412 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55df4bc9d090 0x55df4bc286b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:16.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.513+0000 7f4c2f400640 1 -- 172.21.15.99:0/1220311412 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55df4b8a83f0 con 0x55df4bc670d0 2024-02-21T23:07:16.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.513+0000 7f4c2fe00640 1 --2- 172.21.15.99:0/1220311412 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55df4bc9d090 0x55df4bc286b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:07:16.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.514+0000 7f4c2f400640 1 --2- 172.21.15.99:0/1220311412 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55df4bc670d0 0x55df4bc70cc0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f4c200e9400 tx=0x7f4c20006d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6f7d25b944b6000 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:16.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.514+0000 7f4c0fe00640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-02-21T23:07:16.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.514+0000 7f4c0fe00640 1 -- 172.21.15.99:0/1220311412 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c200bd730 con 0x55df4bc670d0 2024-02-21T23:07:16.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.514+0000 7f4c0fe00640 1 -- 172.21.15.99:0/1220311412 <== mon.2 v2:172.21.15.181:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f4c200b5c50 con 0x55df4bc670d0 2024-02-21T23:07:16.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.514+0000 7f4c391b7740 1 -- 172.21.15.99:0/1220311412 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4c1c026070 con 0x55df4bc670d0 2024-02-21T23:07:16.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.515+0000 7f4c0fe00640 1 -- 172.21.15.99:0/1220311412 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4c200c1d80 con 0x55df4bc670d0 2024-02-21T23:07:16.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.515+0000 7f4c391b7740 10 client.6272 fetch_fsmap learned FSMap version 17 2024-02-21T23:07:16.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.515+0000 7f4c391b7740 1 -- 172.21.15.99:0/1220311412 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55df4b8680f0 con 0x55df4bc670d0 2024-02-21T23:07:16.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.515+0000 7f4c0fe00640 1 -- 172.21.15.99:0/1220311412 <== mon.2 v2:172.21.15.181:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c1c026070 con 0x55df4bc670d0 2024-02-21T23:07:16.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.515+0000 7f4c0fe00640 1 -- 172.21.15.99:0/1220311412 <== mon.2 v2:172.21.15.181:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f4c200a2ce0 con 0x55df4bc670d0 2024-02-21T23:07:16.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.516+0000 7f4c391b7740 10 client.6272 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:07:16.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.516+0000 7f4c391b7740 10 client.6272 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:07:16.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.516+0000 7f4c391b7740 20 client.6272 populate_metadata read hostname 'smithi099' 2024-02-21T23:07:16.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.516+0000 7f4c391b7740 1 --2- 172.21.15.99:0/1220311412 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55df4bc5d3c0 0x55df4bc2a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:16.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.516+0000 7f4c391b7740 4 client.6272 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:07:16.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.516+0000 7f4c391b7740 1 -- 172.21.15.99:0/1220311412 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55df4bba0fd0 con 0x55df4bc5d3c0 2024-02-21T23:07:16.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.516+0000 7f4c2ea00640 1 --2- 172.21.15.99:0/1220311412 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55df4bc5d3c0 0x55df4bc2a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:16.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.519+0000 7f4c2ea00640 1 --2- 172.21.15.99:0/1220311412 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55df4bc5d3c0 0x55df4bc2a440 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52d1b16c3e692a6a server_cookie=63e14271241eb65c in_seq=0 out_seq=0 2024-02-21T23:07:16.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.519+0000 7f4c0fe00640 10 client.6272 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:07:16.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.520+0000 7f4c0fe00640 1 -- 172.21.15.99:0/1220311412 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55df4bba0fd0 con 0x55df4bc5d3c0 2024-02-21T23:07:16.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.520+0000 7f4c0fe00640 10 client.6272 handle_command_reply: tid=0 2024-02-21T23:07:16.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.520+0000 7f4c391b7740 1 client.6272 shutdown 2024-02-21T23:07:16.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.521+0000 7f4c391b7740 1 -- 172.21.15.99:0/1220311412 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55df4bc670d0 msgr2=0x55df4bc70cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:16.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.521+0000 7f4c391b7740 1 --2- 172.21.15.99:0/1220311412 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55df4bc670d0 0x55df4bc70cc0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f4c200e9400 tx=0x7f4c20006d50 comp rx=0 tx=0).stop 2024-02-21T23:07:16.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.521+0000 7f4c391b7740 1 -- 172.21.15.99:0/1220311412 shutdown_connections 2024-02-21T23:07:16.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.521+0000 7f4c391b7740 1 --2- 172.21.15.99:0/1220311412 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55df4bc5d3c0 0x55df4bc2a440 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:16.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.522+0000 7f4c391b7740 1 --2- 172.21.15.99:0/1220311412 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55df4bc9d090 0x55df4bc286b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:16.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.522+0000 7f4c391b7740 1 --2- 172.21.15.99:0/1220311412 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55df4bc679f0 0x55df4bc71320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:16.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.522+0000 7f4c391b7740 1 --2- 172.21.15.99:0/1220311412 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55df4bc670d0 0x55df4bc70cc0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:16.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.522+0000 7f4c391b7740 1 -- 172.21.15.99:0/1220311412 >> 172.21.15.99:0/1220311412 conn(0x55df4bbf66b0 msgr2=0x55df4bc9c840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:07:16.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.522+0000 7f4c0fe00640 0 client.6272 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:07:16.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.522+0000 7f4c391b7740 1 -- 172.21.15.99:0/1220311412 shutdown_connections 2024-02-21T23:07:16.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.522+0000 7f4c391b7740 1 -- 172.21.15.99:0/1220311412 wait complete. 2024-02-21T23:07:16.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.523+0000 7f4c391b7740 20 client.6272 trim_cache size 0 max 16384 2024-02-21T23:07:16.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.558+0000 7f4c391b7740 1 Processor -- start 2024-02-21T23:07:16.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.559+0000 7f4c391b7740 1 -- start start 2024-02-21T23:07:16.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.560+0000 7f4c391b7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55df4bc670d0 0x55df4bc53a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:16.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.560+0000 7f4c391b7740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55df4bc679f0 0x55df4bc349e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:16.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.560+0000 7f4c391b7740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55df4bc9d090 0x55df4bc297a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:16.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.560+0000 7f4c391b7740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c30230cd0 con 0x55df4bc9d090 2024-02-21T23:07:16.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.560+0000 7f4c391b7740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c3022e870 con 0x55df4bc670d0 2024-02-21T23:07:16.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.560+0000 7f4c391b7740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c3017b680 con 0x55df4bc679f0 2024-02-21T23:07:16.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.561+0000 7f4c2ea00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55df4bc679f0 0x55df4bc349e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:16.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.562+0000 7f4c2f400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55df4bc670d0 0x55df4bc53a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:16.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.562+0000 7f4c2fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55df4bc9d090 0x55df4bc297a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:16.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.562+0000 7f4c2fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55df4bc9d090 0x55df4bc297a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:36720/0 (socket says 172.21.15.99:36720) 2024-02-21T23:07:16.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.562+0000 7f4c2fe00640 1 -- 172.21.15.99:0/2481378135 learned_addr learned my addr 172.21.15.99:0/2481378135 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:07:16.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.562+0000 7f4c2fe00640 1 -- 172.21.15.99:0/2481378135 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55df4bc679f0 msgr2=0x55df4bc349e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:16.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.562+0000 7f4c2fe00640 1 --2- 172.21.15.99:0/2481378135 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55df4bc679f0 0x55df4bc349e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:16.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.562+0000 7f4c2fe00640 1 -- 172.21.15.99:0/2481378135 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55df4bc670d0 msgr2=0x55df4bc53a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:16.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.562+0000 7f4c2fe00640 1 --2- 172.21.15.99:0/2481378135 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55df4bc670d0 0x55df4bc53a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:16.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.562+0000 7f4c2fe00640 1 -- 172.21.15.99:0/2481378135 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55df4bc9ec00 con 0x55df4bc9d090 2024-02-21T23:07:16.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.563+0000 7f4c2fe00640 1 --2- 172.21.15.99:0/2481378135 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55df4bc9d090 0x55df4bc297a0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f4c28003da0 tx=0x7f4c28005420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92d7aa27ce6c09bb server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:16.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.563+0000 7f4c1aa00640 1 -- 172.21.15.99:0/2481378135 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c28006e00 con 0x55df4bc9d090 2024-02-21T23:07:16.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.563+0000 7f4c1aa00640 1 -- 172.21.15.99:0/2481378135 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c2801b020 con 0x55df4bc9d090 2024-02-21T23:07:16.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.563+0000 7f4c1aa00640 1 -- 172.21.15.99:0/2481378135 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c280164e0 con 0x55df4bc9d090 2024-02-21T23:07:16.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.564+0000 7f4c391b7740 1 -- 172.21.15.99:0/2481378135 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55df4bc9d090 msgr2=0x55df4bc297a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:16.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.564+0000 7f4c391b7740 1 --2- 172.21.15.99:0/2481378135 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55df4bc9d090 0x55df4bc297a0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f4c28003da0 tx=0x7f4c28005420 comp rx=0 tx=0).stop 2024-02-21T23:07:16.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.564+0000 7f4c391b7740 1 -- 172.21.15.99:0/2481378135 shutdown_connections 2024-02-21T23:07:16.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.564+0000 7f4c391b7740 1 --2- 172.21.15.99:0/2481378135 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55df4bc9d090 0x55df4bc297a0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:16.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.564+0000 7f4c391b7740 1 --2- 172.21.15.99:0/2481378135 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55df4bc679f0 0x55df4bc349e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:16.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.564+0000 7f4c391b7740 1 --2- 172.21.15.99:0/2481378135 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55df4bc670d0 0x55df4bc53a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:16.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.564+0000 7f4c391b7740 1 -- 172.21.15.99:0/2481378135 >> 172.21.15.99:0/2481378135 conn(0x55df4bbf66b0 msgr2=0x55df4bc700e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:07:16.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.565+0000 7f4c391b7740 1 -- 172.21.15.99:0/2481378135 shutdown_connections 2024-02-21T23:07:16.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.565+0000 7f4c391b7740 1 -- 172.21.15.99:0/2481378135 wait complete. 2024-02-21T23:07:16.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.566+0000 7f4c391b7740 1 -- start start 2024-02-21T23:07:16.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.566+0000 7f4c391b7740 1 Processor -- start 2024-02-21T23:07:16.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.568+0000 7f4c391b7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55df4bc670d0 0x55df4bd0ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:16.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.568+0000 7f4c391b7740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55df4bc679f0 0x55df4bcac0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:16.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.568+0000 7f4c391b7740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55df4bc9d090 0x55df4bc5ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:16.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.568+0000 7f4c391b7740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c3022cf30 con 0x55df4bc9d090 2024-02-21T23:07:16.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.568+0000 7f4c391b7740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c3022e210 con 0x55df4bc670d0 2024-02-21T23:07:16.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.568+0000 7f4c391b7740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c3022d550 con 0x55df4bc679f0 2024-02-21T23:07:16.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.568+0000 7f4c391b7740 10 client.0 _ll_register_callbacks cb 0x7f4c200b9120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:07:16.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.569+0000 7f4c2ea00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55df4bc679f0 0x55df4bcac0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:16.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.569+0000 7f4c2f400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55df4bc670d0 0x55df4bd0ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:16.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.569+0000 7f4c2ea00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55df4bc679f0 0x55df4bcac0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:37812/0 (socket says 172.21.15.99:37812) 2024-02-21T23:07:16.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.569+0000 7f4c2ea00640 1 -- 172.21.15.99:0/2495299478 learned_addr learned my addr 172.21.15.99:0/2495299478 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:07:16.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.569+0000 7f4c2fe00640 1 --2- 172.21.15.99:0/2495299478 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55df4bc9d090 0x55df4bc5ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:16.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.569+0000 7f4c2f400640 1 -- 172.21.15.99:0/2495299478 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55df4bc679f0 msgr2=0x55df4bcac0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:16.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.569+0000 7f4c2f400640 1 --2- 172.21.15.99:0/2495299478 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55df4bc679f0 0x55df4bcac0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:16.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.569+0000 7f4c2f400640 1 -- 172.21.15.99:0/2495299478 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55df4bc9d090 msgr2=0x55df4bc5ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:16.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.569+0000 7f4c2f400640 1 --2- 172.21.15.99:0/2495299478 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55df4bc9d090 0x55df4bc5ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:16.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.569+0000 7f4c2f400640 1 -- 172.21.15.99:0/2495299478 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55df4bc29d30 con 0x55df4bc670d0 2024-02-21T23:07:16.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.569+0000 7f4c2fe00640 1 --2- 172.21.15.99:0/2495299478 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55df4bc9d090 0x55df4bc5ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:07:16.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.570+0000 7f4c2f400640 1 --2- 172.21.15.99:0/2495299478 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55df4bc670d0 0x55df4bd0ad40 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f4c200b7890 tx=0x7f4c200eb040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45f8261035367efe server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:16.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.570+0000 7f4c0fe00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-02-21T23:07:16.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.570+0000 7f4c0fe00640 1 -- 172.21.15.99:0/2495299478 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c200bd730 con 0x55df4bc670d0 2024-02-21T23:07:16.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.570+0000 7f4c0fe00640 1 -- 172.21.15.99:0/2495299478 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f4c200b5c50 con 0x55df4bc670d0 2024-02-21T23:07:16.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.571+0000 7f4c391b7740 1 -- 172.21.15.99:0/2495299478 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4c2801b020 con 0x55df4bc670d0 2024-02-21T23:07:16.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.571+0000 7f4c0fe00640 1 -- 172.21.15.99:0/2495299478 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4c200d10c0 con 0x55df4bc670d0 2024-02-21T23:07:16.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.571+0000 7f4c391b7740 10 client.6277 fetch_fsmap learned FSMap version 17 2024-02-21T23:07:16.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.571+0000 7f4c391b7740 1 -- 172.21.15.99:0/2495299478 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55df4bc29d30 con 0x55df4bc670d0 2024-02-21T23:07:16.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.572+0000 7f4c0fe00640 1 -- 172.21.15.99:0/2495299478 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c2801b020 con 0x55df4bc670d0 2024-02-21T23:07:16.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.572+0000 7f4c0fe00640 1 -- 172.21.15.99:0/2495299478 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f4c200a2ce0 con 0x55df4bc670d0 2024-02-21T23:07:16.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.572+0000 7f4c391b7740 10 client.6277 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:07:16.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.572+0000 7f4c391b7740 10 client.6277 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:07:16.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.572+0000 7f4c391b7740 20 client.6277 populate_metadata read hostname 'smithi099' 2024-02-21T23:07:16.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.572+0000 7f4c391b7740 1 --2- 172.21.15.99:0/2495299478 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55df4bc53b20 0x55df4bc2df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:16.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.572+0000 7f4c391b7740 4 client.6277 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T23:07:16.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.572+0000 7f4c391b7740 1 -- 172.21.15.99:0/2495299478 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55df4bb9b320 con 0x55df4bc53b20 2024-02-21T23:07:16.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.572+0000 7f4c2ea00640 1 --2- 172.21.15.99:0/2495299478 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55df4bc53b20 0x55df4bc2df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:16.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.573+0000 7f4c2ea00640 1 --2- 172.21.15.99:0/2495299478 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55df4bc53b20 0x55df4bc2df80 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=339cda4d2f0d397f server_cookie=9e9fb2a692978787 in_seq=0 out_seq=0 2024-02-21T23:07:16.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.574+0000 7f4c0fe00640 10 client.6277 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:07:16.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.574+0000 7f4c0fe00640 1 -- 172.21.15.99:0/2495299478 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x55df4bb9b320 con 0x55df4bc53b20 2024-02-21T23:07:16.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.574+0000 7f4c0fe00640 10 client.6277 handle_command_reply: tid=0 2024-02-21T23:07:16.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.575+0000 7f4c391b7740 1 client.6277 shutdown 2024-02-21T23:07:16.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.575+0000 7f4c391b7740 1 -- 172.21.15.99:0/2495299478 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55df4bc670d0 msgr2=0x55df4bd0ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:16.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.575+0000 7f4c391b7740 1 --2- 172.21.15.99:0/2495299478 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55df4bc670d0 0x55df4bd0ad40 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f4c200b7890 tx=0x7f4c200eb040 comp rx=0 tx=0).stop 2024-02-21T23:07:16.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.575+0000 7f4c391b7740 1 -- 172.21.15.99:0/2495299478 shutdown_connections 2024-02-21T23:07:16.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.575+0000 7f4c391b7740 1 --2- 172.21.15.99:0/2495299478 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55df4bc53b20 0x55df4bc2df80 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:16.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.575+0000 7f4c0fe00640 0 client.6277 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:07:16.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.575+0000 7f4c391b7740 1 --2- 172.21.15.99:0/2495299478 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55df4bc9d090 0x55df4bc5ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:16.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.575+0000 7f4c391b7740 1 --2- 172.21.15.99:0/2495299478 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55df4bc679f0 0x55df4bcac0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:16.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.575+0000 7f4c391b7740 1 --2- 172.21.15.99:0/2495299478 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55df4bc670d0 0x55df4bd0ad40 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:16.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.575+0000 7f4c391b7740 1 -- 172.21.15.99:0/2495299478 >> 172.21.15.99:0/2495299478 conn(0x55df4bbf66b0 msgr2=0x55df4bc945a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:07:16.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.576+0000 7f4c391b7740 1 -- 172.21.15.99:0/2495299478 shutdown_connections 2024-02-21T23:07:16.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.576+0000 7f4c391b7740 1 -- 172.21.15.99:0/2495299478 wait complete. 2024-02-21T23:07:16.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.576+0000 7f4c391b7740 20 client.6277 trim_cache size 0 max 16384 2024-02-21T23:07:16.567 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-02-21T23:07:16.567 INFO:teuthology.orchestra.run.smithi099.stdout: "status": "scrub active (893 inodes in the stack)", 2024-02-21T23:07:16.568 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubs": { 2024-02-21T23:07:16.568 INFO:teuthology.orchestra.run.smithi099.stdout: "1d928e09-6f2e-4695-a83b-cfd2f7ab3cb6": { 2024-02-21T23:07:16.568 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/", 2024-02-21T23:07:16.568 INFO:teuthology.orchestra.run.smithi099.stdout: "tag": "1d928e09-6f2e-4695-a83b-cfd2f7ab3cb6", 2024-02-21T23:07:16.568 INFO:teuthology.orchestra.run.smithi099.stdout: "options": "recursive,force" 2024-02-21T23:07:16.568 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:07:16.569 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:07:16.569 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-02-21T23:07:16.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.577+0000 7f4c36200640 1 -- 172.21.15.99:0/921389910 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f4c1009eed0 msgr2=0x7f4c100a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:16.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.577+0000 7f4c36200640 1 --2- 172.21.15.99:0/921389910 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f4c1009eed0 0x7f4c100a1390 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c006fd0 tx=0x7f4c1c008040 comp rx=0 tx=0).stop 2024-02-21T23:07:16.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.577+0000 7f4c36200640 1 -- 172.21.15.99:0/921389910 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c30186400 msgr2=0x7f4c30168e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:16.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.577+0000 7f4c36200640 1 --2- 172.21.15.99:0/921389910 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c30186400 0x7f4c30168e40 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f4c20000c00 tx=0x7f4c200046c0 comp rx=0 tx=0).stop 2024-02-21T23:07:16.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.577+0000 7f4c36200640 1 -- 172.21.15.99:0/921389910 shutdown_connections 2024-02-21T23:07:16.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.577+0000 7f4c36200640 1 --2- 172.21.15.99:0/921389910 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f4c1009eed0 0x7f4c100a1390 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:16.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.577+0000 7f4c36200640 1 --2- 172.21.15.99:0/921389910 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f4c30188550 0x7f4c3017e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:16.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.577+0000 7f4c36200640 1 --2- 172.21.15.99:0/921389910 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4c301867e0 0x7f4c3017dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:16.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.577+0000 7f4c36200640 1 --2- 172.21.15.99:0/921389910 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c30186400 0x7f4c30168e40 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:16.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.577+0000 7f4c36200640 1 -- 172.21.15.99:0/921389910 >> 172.21.15.99:0/921389910 conn(0x7f4c300d6af0 msgr2=0x7f4c30187e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:07:16.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.577+0000 7f4c36200640 1 -- 172.21.15.99:0/921389910 shutdown_connections 2024-02-21T23:07:16.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:16.578+0000 7f4c36200640 1 -- 172.21.15.99:0/921389910 wait complete. 2024-02-21T23:07:16.590 INFO:tasks.cephfs.filesystem:scrub status for tag:1d928e09-6f2e-4695-a83b-cfd2f7ab3cb6 - {'path': '/', 'tag': '1d928e09-6f2e-4695-a83b-cfd2f7ab3cb6', 'options': 'recursive,force'} 2024-02-21T23:07:42.894 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:07:42.902 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:07:42.905 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:07:46.592 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T23:07:46.593 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T23:07:46.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.828+0000 7f0dfbe00640 1 Processor -- start 2024-02-21T23:07:46.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.829+0000 7f0dfbe00640 1 -- start start 2024-02-21T23:07:46.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.831+0000 7f0dfbe00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f0dfc17f490 0x7f0dfc18ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:46.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.831+0000 7f0dfbe00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f0dfc18b4f0 0x7f0dfc0fd290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:46.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.831+0000 7f0dfbe00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dfc0d6dd0 con 0x7f0dfc18b060 2024-02-21T23:07:46.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.831+0000 7f0dfbe00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dfc1614c0 con 0x7f0dfc17f490 2024-02-21T23:07:46.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.831+0000 7f0dfbe00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dfc0d6810 con 0x7f0dfc18b4f0 2024-02-21T23:07:46.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.831+0000 7f0dfaa00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f0dfc17f490 0x7f0dfc18ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:46.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.831+0000 7f0dfb400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f0dfc18b4f0 0x7f0dfc0fd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:46.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.831+0000 7f0dfaa00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f0dfc17f490 0x7f0dfc18ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35066/0 (socket says 172.21.15.99:35066) 2024-02-21T23:07:46.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.831+0000 7f0dfaa00640 1 -- 172.21.15.99:0/4052856668 learned_addr learned my addr 172.21.15.99:0/4052856668 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:07:46.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.832+0000 7f0dfb400640 1 -- 172.21.15.99:0/4052856668 >> v2:172.21.15.99:3300/0 conn(0x7f0dfc17f490 msgr2=0x7f0dfc18ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:46.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.832+0000 7f0dfb400640 1 --2- 172.21.15.99:0/4052856668 >> v2:172.21.15.99:3300/0 conn(0x7f0dfc17f490 0x7f0dfc18ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:46.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.832+0000 7f0dfb400640 1 -- 172.21.15.99:0/4052856668 >> v1:172.21.15.162:6789/0 conn(0x7f0dfc18b060 legacy=0x7f0dfc188a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:46.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.832+0000 7f0dfb400640 1 -- 172.21.15.99:0/4052856668 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dfc0d6af0 con 0x7f0dfc18b4f0 2024-02-21T23:07:46.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.832+0000 7f0dfaa00640 1 --2- 172.21.15.99:0/4052856668 >> v2:172.21.15.99:3300/0 conn(0x7f0dfc17f490 0x7f0dfc18ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:07:46.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.833+0000 7f0dfb400640 1 --2- 172.21.15.99:0/4052856668 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0dfc18b4f0 0x7f0dfc0fd290 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc186580 tx=0x7f0df402bec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=adf9731270007a7e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:46.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.833+0000 7f0dfa000640 1 -- 172.21.15.99:0/4052856668 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df4039070 con 0x7f0dfc18b4f0 2024-02-21T23:07:46.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.833+0000 7f0dfa000640 1 -- 172.21.15.99:0/4052856668 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0df402cc70 con 0x7f0dfc18b4f0 2024-02-21T23:07:46.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.833+0000 7f0dfa000640 1 -- 172.21.15.99:0/4052856668 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df4034660 con 0x7f0dfc18b4f0 2024-02-21T23:07:46.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.834+0000 7f0dfbe00640 1 -- 172.21.15.99:0/4052856668 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0dfc18b4f0 msgr2=0x7f0dfc0fd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:46.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.834+0000 7f0dfbe00640 1 --2- 172.21.15.99:0/4052856668 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0dfc18b4f0 0x7f0dfc0fd290 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc186580 tx=0x7f0df402bec0 comp rx=0 tx=0).stop 2024-02-21T23:07:46.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.834+0000 7f0dfbe00640 1 -- 172.21.15.99:0/4052856668 shutdown_connections 2024-02-21T23:07:46.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.834+0000 7f0dfbe00640 1 --2- 172.21.15.99:0/4052856668 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0dfc18b4f0 0x7f0dfc0fd290 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:46.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.834+0000 7f0dfbe00640 1 --2- 172.21.15.99:0/4052856668 >> v2:172.21.15.99:3300/0 conn(0x7f0dfc17f490 0x7f0dfc18ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:46.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.834+0000 7f0dfbe00640 1 -- 172.21.15.99:0/4052856668 >> 172.21.15.99:0/4052856668 conn(0x7f0dfc0d29b0 msgr2=0x7f0dfc0d2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:07:46.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.834+0000 7f0dfbe00640 1 -- 172.21.15.99:0/4052856668 shutdown_connections 2024-02-21T23:07:46.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.834+0000 7f0dfbe00640 1 -- 172.21.15.99:0/4052856668 wait complete. 2024-02-21T23:07:46.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.836+0000 7f0dfbe00640 1 Processor -- start 2024-02-21T23:07:46.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.836+0000 7f0dfbe00640 1 -- start start 2024-02-21T23:07:46.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.837+0000 7f0dfbe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0dfc17f490 0x7f0dfc17ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:46.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.837+0000 7f0dfbe00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0dfc18b060 0x7f0dfc174dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:46.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.837+0000 7f0dfbe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0dfc18b4f0 0x7f0dfc175300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:46.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.837+0000 7f0dfbe00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dfc18a600 con 0x7f0dfc18b4f0 2024-02-21T23:07:46.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.837+0000 7f0dfbe00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dfc18a320 con 0x7f0dfc17f490 2024-02-21T23:07:46.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.837+0000 7f0dfbe00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dfc17f870 con 0x7f0dfc18b060 2024-02-21T23:07:46.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.838+0000 7f0dfb400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0dfc18b4f0 0x7f0dfc175300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:46.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.838+0000 7f0dfb400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0dfc18b4f0 0x7f0dfc175300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35068/0 (socket says 172.21.15.99:35068) 2024-02-21T23:07:46.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.838+0000 7f0dfb400640 1 -- 172.21.15.99:0/2507429501 learned_addr learned my addr 172.21.15.99:0/2507429501 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:07:46.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.838+0000 7f0dfaa00640 1 --2- 172.21.15.99:0/2507429501 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0dfc17f490 0x7f0dfc17ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:46.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.838+0000 7f0df3e00640 1 --2- 172.21.15.99:0/2507429501 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0dfc18b060 0x7f0dfc174dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:46.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.838+0000 7f0dfb400640 1 -- 172.21.15.99:0/2507429501 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0dfc18b060 msgr2=0x7f0dfc174dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:46.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.838+0000 7f0dfb400640 1 --2- 172.21.15.99:0/2507429501 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0dfc18b060 0x7f0dfc174dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:46.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.838+0000 7f0dfb400640 1 -- 172.21.15.99:0/2507429501 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0dfc17f490 msgr2=0x7f0dfc17ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:46.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.838+0000 7f0dfb400640 1 --2- 172.21.15.99:0/2507429501 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0dfc17f490 0x7f0dfc17ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:46.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.838+0000 7f0dfb400640 1 -- 172.21.15.99:0/2507429501 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dfc17d3a0 con 0x7f0dfc18b4f0 2024-02-21T23:07:46.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.838+0000 7f0dfaa00640 1 --2- 172.21.15.99:0/2507429501 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0dfc17f490 0x7f0dfc17ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:07:46.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.839+0000 7f0dfb400640 1 --2- 172.21.15.99:0/2507429501 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0dfc18b4f0 0x7f0dfc175300 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f0df402c4d0 tx=0x7f0df4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:46.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.839+0000 7f0df2a00640 1 -- 172.21.15.99:0/2507429501 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df4039050 con 0x7f0dfc18b4f0 2024-02-21T23:07:46.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.839+0000 7f0df2a00640 1 -- 172.21.15.99:0/2507429501 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0df4045070 con 0x7f0dfc18b4f0 2024-02-21T23:07:46.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.839+0000 7f0dfbe00640 1 -- 172.21.15.99:0/2507429501 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dfc17d680 con 0x7f0dfc18b4f0 2024-02-21T23:07:46.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.839+0000 7f0df2a00640 1 -- 172.21.15.99:0/2507429501 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df4009450 con 0x7f0dfc18b4f0 2024-02-21T23:07:46.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.839+0000 7f0dfbe00640 1 -- 172.21.15.99:0/2507429501 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dfc17dc40 con 0x7f0dfc18b4f0 2024-02-21T23:07:46.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.842+0000 7f0df2a00640 1 -- 172.21.15.99:0/2507429501 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f0df403e850 con 0x7f0dfc18b4f0 2024-02-21T23:07:46.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.844+0000 7f0df2a00640 1 --2- 172.21.15.99:0/2507429501 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f0dd809eed0 0x7f0dd80a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:46.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.844+0000 7f0df2a00640 1 -- 172.21.15.99:0/2507429501 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f0df40ecb00 con 0x7f0dfc18b4f0 2024-02-21T23:07:46.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.844+0000 7f0dfaa00640 1 --2- 172.21.15.99:0/2507429501 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f0dd809eed0 0x7f0dd80a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:46.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.844+0000 7f0e049c7740 1 Processor -- start 2024-02-21T23:07:46.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.844+0000 7f0e049c7740 1 -- start start 2024-02-21T23:07:46.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.845+0000 7f0dfaa00640 1 --2- 172.21.15.99:0/2507429501 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f0dd809eed0 0x7f0dd80a1390 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0dec009630 tx=0x7f0dec009240 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:46.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.846+0000 7f0e049c7740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556cc71102a0 0x556cc7145d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:46.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.846+0000 7f0e049c7740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556cc7146260 0x556cc7110680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:46.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.846+0000 7f0e049c7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556cc7110bc0 0x556cc70d31d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:46.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.846+0000 7f0e049c7740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cc703ca90 con 0x556cc71102a0 2024-02-21T23:07:46.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.846+0000 7f0e049c7740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cc6fe5b10 con 0x556cc7110bc0 2024-02-21T23:07:46.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.846+0000 7f0e049c7740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cc7038b30 con 0x556cc7146260 2024-02-21T23:07:46.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.846+0000 7f0dfaa00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556cc71102a0 0x556cc7145d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:46.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.846+0000 7f0df3e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556cc7146260 0x556cc7110680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:46.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.846+0000 7f0dfaa00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556cc71102a0 0x556cc7145d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35082/0 (socket says 172.21.15.99:35082) 2024-02-21T23:07:46.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.846+0000 7f0dfaa00640 1 -- 172.21.15.99:0/665022132 learned_addr learned my addr 172.21.15.99:0/665022132 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:07:46.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.846+0000 7f0dfb400640 1 --2- 172.21.15.99:0/665022132 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556cc7110bc0 0x556cc70d31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:46.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.846+0000 7f0dfaa00640 1 -- 172.21.15.99:0/665022132 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556cc7146260 msgr2=0x556cc7110680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:46.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.846+0000 7f0dfaa00640 1 --2- 172.21.15.99:0/665022132 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556cc7146260 0x556cc7110680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:46.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.847+0000 7f0dfaa00640 1 -- 172.21.15.99:0/665022132 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556cc7110bc0 msgr2=0x556cc70d31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:46.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.847+0000 7f0dfaa00640 1 --2- 172.21.15.99:0/665022132 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556cc7110bc0 0x556cc70d31d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:46.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.847+0000 7f0dfaa00640 1 -- 172.21.15.99:0/665022132 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556cc6e1b7d0 con 0x556cc71102a0 2024-02-21T23:07:46.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.847+0000 7f0dfb400640 1 --2- 172.21.15.99:0/665022132 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556cc7110bc0 0x556cc70d31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:07:46.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.847+0000 7f0df3e00640 1 --2- 172.21.15.99:0/665022132 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556cc7146260 0x556cc7110680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:07:46.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.847+0000 7f0dfaa00640 1 --2- 172.21.15.99:0/665022132 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556cc71102a0 0x556cc7145d20 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f0dec014700 tx=0x7f0dec014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15de787f29f86b71 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:46.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.847+0000 7f0deb400640 1 -- 172.21.15.99:0/665022132 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dec025070 con 0x556cc71102a0 2024-02-21T23:07:46.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.847+0000 7f0deb400640 1 -- 172.21.15.99:0/665022132 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dec01b070 con 0x556cc71102a0 2024-02-21T23:07:46.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.847+0000 7f0deb400640 1 -- 172.21.15.99:0/665022132 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dec0215f0 con 0x556cc71102a0 2024-02-21T23:07:46.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.848+0000 7f0e049c7740 1 -- 172.21.15.99:0/665022132 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556cc71102a0 msgr2=0x556cc7145d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:46.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.848+0000 7f0e049c7740 1 --2- 172.21.15.99:0/665022132 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556cc71102a0 0x556cc7145d20 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f0dec014700 tx=0x7f0dec014000 comp rx=0 tx=0).stop 2024-02-21T23:07:46.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.848+0000 7f0e049c7740 1 -- 172.21.15.99:0/665022132 shutdown_connections 2024-02-21T23:07:46.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.848+0000 7f0e049c7740 1 --2- 172.21.15.99:0/665022132 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556cc7110bc0 0x556cc70d31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:46.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.848+0000 7f0e049c7740 1 --2- 172.21.15.99:0/665022132 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556cc7146260 0x556cc7110680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:46.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.848+0000 7f0e049c7740 1 --2- 172.21.15.99:0/665022132 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556cc71102a0 0x556cc7145d20 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:46.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.848+0000 7f0e049c7740 1 -- 172.21.15.99:0/665022132 >> 172.21.15.99:0/665022132 conn(0x556cc709f6b0 msgr2=0x556cc70d7190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:07:46.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.849+0000 7f0e049c7740 1 -- 172.21.15.99:0/665022132 shutdown_connections 2024-02-21T23:07:46.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.849+0000 7f0e049c7740 1 -- 172.21.15.99:0/665022132 wait complete. 2024-02-21T23:07:46.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.850+0000 7f0e049c7740 1 -- start start 2024-02-21T23:07:46.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.850+0000 7f0e049c7740 1 Processor -- start 2024-02-21T23:07:46.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.852+0000 7f0e049c7740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556cc71102a0 0x556cc7149a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:46.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.852+0000 7f0e049c7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556cc7110bc0 0x556cc715a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:46.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.853+0000 7f0e049c7740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556cc7146260 0x556cc7105f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:46.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.853+0000 7f0e049c7740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cc70def30 con 0x556cc7146260 2024-02-21T23:07:46.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.853+0000 7f0e049c7740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cc6fdb1c0 con 0x556cc7110bc0 2024-02-21T23:07:46.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.853+0000 7f0e049c7740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cc7147930 con 0x556cc71102a0 2024-02-21T23:07:46.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.853+0000 7f0e049c7740 10 client.0 _ll_register_callbacks cb 0x556cc6ff8930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:07:46.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.853+0000 7f0df3e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556cc7110bc0 0x556cc715a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:46.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.853+0000 7f0dfaa00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556cc71102a0 0x556cc7149a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:46.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.853+0000 7f0df3e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556cc7110bc0 0x556cc715a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:49580/0 (socket says 172.21.15.99:49580) 2024-02-21T23:07:46.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.853+0000 7f0df3e00640 1 -- 172.21.15.99:0/3732784878 learned_addr learned my addr 172.21.15.99:0/3732784878 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:07:46.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.853+0000 7f0dfb400640 1 --2- 172.21.15.99:0/3732784878 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556cc7146260 0x556cc7105f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:46.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.853+0000 7f0df3e00640 1 -- 172.21.15.99:0/3732784878 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556cc71102a0 msgr2=0x556cc7149a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:46.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.853+0000 7f0df3e00640 1 --2- 172.21.15.99:0/3732784878 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556cc71102a0 0x556cc7149a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:46.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.853+0000 7f0df3e00640 1 -- 172.21.15.99:0/3732784878 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556cc7146260 msgr2=0x556cc7105f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:46.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.853+0000 7f0df3e00640 1 --2- 172.21.15.99:0/3732784878 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556cc7146260 0x556cc7105f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:46.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.853+0000 7f0df3e00640 1 -- 172.21.15.99:0/3732784878 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556cc6d513f0 con 0x556cc7110bc0 2024-02-21T23:07:46.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.853+0000 7f0dfb400640 1 --2- 172.21.15.99:0/3732784878 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556cc7146260 0x556cc7105f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:07:46.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.854+0000 7f0df3e00640 1 --2- 172.21.15.99:0/3732784878 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556cc7110bc0 0x556cc715a7d0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f0de4001e70 tx=0x7f0de4012690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=21692028f3d8aac6 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:46.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.854+0000 7f0ddfe00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-02-21T23:07:46.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.854+0000 7f0ddfe00640 1 -- 172.21.15.99:0/3732784878 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de4005320 con 0x556cc7110bc0 2024-02-21T23:07:46.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.854+0000 7f0e049c7740 1 -- 172.21.15.99:0/3732784878 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0dec01b070 con 0x556cc7110bc0 2024-02-21T23:07:46.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.854+0000 7f0ddfe00640 1 -- 172.21.15.99:0/3732784878 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f0de4007050 con 0x556cc7110bc0 2024-02-21T23:07:46.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.855+0000 7f0ddfe00640 1 -- 172.21.15.99:0/3732784878 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0de4024050 con 0x556cc7110bc0 2024-02-21T23:07:46.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.855+0000 7f0e049c7740 10 client.6292 fetch_fsmap learned FSMap version 17 2024-02-21T23:07:46.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.855+0000 7f0e049c7740 1 -- 172.21.15.99:0/3732784878 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x556cc6d110f0 con 0x556cc7110bc0 2024-02-21T23:07:46.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.855+0000 7f0ddfe00640 1 -- 172.21.15.99:0/3732784878 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dec01b070 con 0x556cc7110bc0 2024-02-21T23:07:46.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.855+0000 7f0ddfe00640 1 -- 172.21.15.99:0/3732784878 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f0de4007250 con 0x556cc7110bc0 2024-02-21T23:07:46.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.856+0000 7f0e049c7740 10 client.6292 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:07:46.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.856+0000 7f0e049c7740 10 client.6292 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:07:46.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.856+0000 7f0e049c7740 20 client.6292 populate_metadata read hostname 'smithi099' 2024-02-21T23:07:46.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.856+0000 7f0e049c7740 1 --2- 172.21.15.99:0/3732784878 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x556cc7148780 0x556cc7148b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:46.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.856+0000 7f0e049c7740 4 client.6292 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:07:46.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.856+0000 7f0e049c7740 1 -- 172.21.15.99:0/3732784878 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556cc7049fd0 con 0x556cc7148780 2024-02-21T23:07:46.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.856+0000 7f0dfaa00640 1 --2- 172.21.15.99:0/3732784878 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x556cc7148780 0x556cc7148b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:46.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.856+0000 7f0dfaa00640 1 --2- 172.21.15.99:0/3732784878 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x556cc7148780 0x556cc7148b60 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=143d184d1d18c3ab server_cookie=a125e50779297b82 in_seq=0 out_seq=0 2024-02-21T23:07:46.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.856+0000 7f0ddfe00640 10 client.6292 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:07:46.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.857+0000 7f0ddfe00640 1 -- 172.21.15.99:0/3732784878 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x556cc7049fd0 con 0x556cc7148780 2024-02-21T23:07:46.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.857+0000 7f0ddfe00640 10 client.6292 handle_command_reply: tid=0 2024-02-21T23:07:46.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.857+0000 7f0e049c7740 1 client.6292 shutdown 2024-02-21T23:07:46.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.857+0000 7f0e049c7740 1 -- 172.21.15.99:0/3732784878 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556cc7110bc0 msgr2=0x556cc715a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:46.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.857+0000 7f0e049c7740 1 --2- 172.21.15.99:0/3732784878 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556cc7110bc0 0x556cc715a7d0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f0de4001e70 tx=0x7f0de4012690 comp rx=0 tx=0).stop 2024-02-21T23:07:46.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.858+0000 7f0e049c7740 1 -- 172.21.15.99:0/3732784878 shutdown_connections 2024-02-21T23:07:46.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.858+0000 7f0e049c7740 1 --2- 172.21.15.99:0/3732784878 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x556cc7148780 0x556cc7148b60 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:46.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.858+0000 7f0e049c7740 1 --2- 172.21.15.99:0/3732784878 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556cc7146260 0x556cc7105f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:46.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.858+0000 7f0e049c7740 1 --2- 172.21.15.99:0/3732784878 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556cc7110bc0 0x556cc715a7d0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:46.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.858+0000 7f0e049c7740 1 --2- 172.21.15.99:0/3732784878 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556cc71102a0 0x556cc7149a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:46.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.858+0000 7f0ddfe00640 0 client.6292 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:07:46.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.858+0000 7f0e049c7740 1 -- 172.21.15.99:0/3732784878 >> 172.21.15.99:0/3732784878 conn(0x556cc709f6b0 msgr2=0x556cc7145b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:07:46.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.858+0000 7f0e049c7740 1 -- 172.21.15.99:0/3732784878 shutdown_connections 2024-02-21T23:07:46.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.858+0000 7f0e049c7740 1 -- 172.21.15.99:0/3732784878 wait complete. 2024-02-21T23:07:46.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.858+0000 7f0e049c7740 20 client.6292 trim_cache size 0 max 16384 2024-02-21T23:07:46.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.876+0000 7f0e049c7740 1 Processor -- start 2024-02-21T23:07:46.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.876+0000 7f0e049c7740 1 -- start start 2024-02-21T23:07:46.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.877+0000 7f0e049c7740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556cc71102a0 0x556cc70ffec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:46.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.877+0000 7f0e049c7740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556cc7110bc0 0x556cc70d7db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:46.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.877+0000 7f0e049c7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556cc7146260 0x556cc715a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:46.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.877+0000 7f0e049c7740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dfc22c940 con 0x556cc71102a0 2024-02-21T23:07:46.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.877+0000 7f0e049c7740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dfc22a4e0 con 0x556cc7146260 2024-02-21T23:07:46.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.877+0000 7f0e049c7740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dfc0fd430 con 0x556cc7110bc0 2024-02-21T23:07:46.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.878+0000 7f0dfaa00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556cc71102a0 0x556cc70ffec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:46.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.878+0000 7f0dfaa00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556cc71102a0 0x556cc70ffec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35108/0 (socket says 172.21.15.99:35108) 2024-02-21T23:07:46.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.878+0000 7f0dfaa00640 1 -- 172.21.15.99:0/1819913564 learned_addr learned my addr 172.21.15.99:0/1819913564 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:07:46.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.878+0000 7f0df3e00640 1 --2- 172.21.15.99:0/1819913564 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556cc7110bc0 0x556cc70d7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:46.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.878+0000 7f0dfb400640 1 --2- 172.21.15.99:0/1819913564 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556cc7146260 0x556cc715a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:46.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.878+0000 7f0dfaa00640 1 -- 172.21.15.99:0/1819913564 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556cc7110bc0 msgr2=0x556cc70d7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:46.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.878+0000 7f0dfaa00640 1 --2- 172.21.15.99:0/1819913564 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556cc7110bc0 0x556cc70d7db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:46.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.878+0000 7f0dfaa00640 1 -- 172.21.15.99:0/1819913564 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556cc7146260 msgr2=0x556cc715a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:46.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.878+0000 7f0dfaa00640 1 --2- 172.21.15.99:0/1819913564 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556cc7146260 0x556cc715a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:46.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.878+0000 7f0dfaa00640 1 -- 172.21.15.99:0/1819913564 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556cc71109f0 con 0x556cc71102a0 2024-02-21T23:07:46.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.878+0000 7f0dfaa00640 1 --2- 172.21.15.99:0/1819913564 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556cc71102a0 0x556cc70ffec0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f0dec014bc0 tx=0x7f0dec020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e89999a9d60c6b9 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:46.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.879+0000 7f0deaa00640 1 -- 172.21.15.99:0/1819913564 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dec025040 con 0x556cc71102a0 2024-02-21T23:07:46.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.879+0000 7f0deaa00640 1 -- 172.21.15.99:0/1819913564 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dec01b070 con 0x556cc71102a0 2024-02-21T23:07:46.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.879+0000 7f0deaa00640 1 -- 172.21.15.99:0/1819913564 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dec004440 con 0x556cc71102a0 2024-02-21T23:07:46.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.879+0000 7f0e049c7740 1 -- 172.21.15.99:0/1819913564 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556cc71102a0 msgr2=0x556cc70ffec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:46.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.879+0000 7f0e049c7740 1 --2- 172.21.15.99:0/1819913564 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556cc71102a0 0x556cc70ffec0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f0dec014bc0 tx=0x7f0dec020000 comp rx=0 tx=0).stop 2024-02-21T23:07:46.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.879+0000 7f0e049c7740 1 -- 172.21.15.99:0/1819913564 shutdown_connections 2024-02-21T23:07:46.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.879+0000 7f0e049c7740 1 --2- 172.21.15.99:0/1819913564 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556cc7146260 0x556cc715a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:46.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.879+0000 7f0e049c7740 1 --2- 172.21.15.99:0/1819913564 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556cc7110bc0 0x556cc70d7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:46.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.879+0000 7f0e049c7740 1 --2- 172.21.15.99:0/1819913564 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556cc71102a0 0x556cc70ffec0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:46.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.879+0000 7f0e049c7740 1 -- 172.21.15.99:0/1819913564 >> 172.21.15.99:0/1819913564 conn(0x556cc709f6b0 msgr2=0x556cc7105d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:07:46.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.879+0000 7f0e049c7740 1 -- 172.21.15.99:0/1819913564 shutdown_connections 2024-02-21T23:07:46.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.880+0000 7f0e049c7740 1 -- 172.21.15.99:0/1819913564 wait complete. 2024-02-21T23:07:46.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.880+0000 7f0e049c7740 1 -- start start 2024-02-21T23:07:46.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.880+0000 7f0e049c7740 1 Processor -- start 2024-02-21T23:07:46.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.882+0000 7f0e049c7740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556cc71102a0 0x556cc71b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:46.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.882+0000 7f0e049c7740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556cc7110bc0 0x556cc70de370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:46.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.883+0000 7f0e049c7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556cc7146260 0x556cc7140aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:46.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.883+0000 7f0e049c7740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dfc228c80 con 0x556cc71102a0 2024-02-21T23:07:46.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.883+0000 7f0e049c7740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dfc229e80 con 0x556cc7146260 2024-02-21T23:07:46.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.883+0000 7f0e049c7740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dfc229280 con 0x556cc7110bc0 2024-02-21T23:07:46.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.883+0000 7f0e049c7740 10 client.0 _ll_register_callbacks cb 0x7f0de4001310 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:07:46.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.883+0000 7f0dfaa00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556cc71102a0 0x556cc71b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:46.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.883+0000 7f0dfaa00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556cc71102a0 0x556cc71b40f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:35118/0 (socket says 172.21.15.99:35118) 2024-02-21T23:07:46.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.883+0000 7f0dfaa00640 1 -- 172.21.15.99:0/3348466878 learned_addr learned my addr 172.21.15.99:0/3348466878 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:07:46.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.883+0000 7f0df3e00640 1 --2- 172.21.15.99:0/3348466878 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556cc7110bc0 0x556cc70de370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:46.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.883+0000 7f0dfb400640 1 --2- 172.21.15.99:0/3348466878 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556cc7146260 0x556cc7140aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:46.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.883+0000 7f0dfaa00640 1 -- 172.21.15.99:0/3348466878 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556cc7110bc0 msgr2=0x556cc70de370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:46.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.883+0000 7f0dfaa00640 1 --2- 172.21.15.99:0/3348466878 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556cc7110bc0 0x556cc70de370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:46.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.883+0000 7f0dfaa00640 1 -- 172.21.15.99:0/3348466878 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556cc7146260 msgr2=0x556cc7140aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:46.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.883+0000 7f0dfaa00640 1 --2- 172.21.15.99:0/3348466878 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556cc7146260 0x556cc7140aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:46.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.883+0000 7f0dfaa00640 1 -- 172.21.15.99:0/3348466878 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556cc70de9d0 con 0x556cc71102a0 2024-02-21T23:07:46.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.884+0000 7f0dfaa00640 1 --2- 172.21.15.99:0/3348466878 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556cc71102a0 0x556cc71b40f0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f0dec012010 tx=0x7f0dec004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5c5ddaeeba5fcf1 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:46.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.884+0000 7f0ddfe00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:07:46.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.884+0000 7f0ddfe00640 1 -- 172.21.15.99:0/3348466878 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dec025030 con 0x556cc71102a0 2024-02-21T23:07:46.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.884+0000 7f0ddfe00640 1 -- 172.21.15.99:0/3348466878 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f0dec035ad0 con 0x556cc71102a0 2024-02-21T23:07:46.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.884+0000 7f0e049c7740 1 -- 172.21.15.99:0/3348466878 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0dec01b070 con 0x556cc71102a0 2024-02-21T23:07:46.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.884+0000 7f0ddfe00640 1 -- 172.21.15.99:0/3348466878 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0dec035cd0 con 0x556cc71102a0 2024-02-21T23:07:46.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.885+0000 7f0e049c7740 10 client.6168 fetch_fsmap learned FSMap version 17 2024-02-21T23:07:46.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.885+0000 7f0e049c7740 1 -- 172.21.15.99:0/3348466878 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x556cc7140580 con 0x556cc71102a0 2024-02-21T23:07:46.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.885+0000 7f0ddfe00640 1 -- 172.21.15.99:0/3348466878 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dec01b070 con 0x556cc71102a0 2024-02-21T23:07:46.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.885+0000 7f0ddfe00640 1 -- 172.21.15.99:0/3348466878 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f0dec020070 con 0x556cc71102a0 2024-02-21T23:07:46.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.885+0000 7f0e049c7740 10 client.6168 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:07:46.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.885+0000 7f0e049c7740 10 client.6168 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:07:46.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.885+0000 7f0e049c7740 20 client.6168 populate_metadata read hostname 'smithi099' 2024-02-21T23:07:46.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.885+0000 7f0e049c7740 1 --2- 172.21.15.99:0/3348466878 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x556cc70ce390 0x556cc70dd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:46.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.885+0000 7f0e049c7740 4 client.6168 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T23:07:46.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.885+0000 7f0e049c7740 1 -- 172.21.15.99:0/3348466878 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x556cc7044320 con 0x556cc70ce390 2024-02-21T23:07:46.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.886+0000 7f0df3e00640 1 --2- 172.21.15.99:0/3348466878 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x556cc70ce390 0x556cc70dd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:46.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.886+0000 7f0df3e00640 1 --2- 172.21.15.99:0/3348466878 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x556cc70ce390 0x556cc70dd5c0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a81a4dd00d928e9 server_cookie=23a333e4d0bb9567 in_seq=0 out_seq=0 2024-02-21T23:07:46.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.886+0000 7f0ddfe00640 10 client.6168 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:07:46.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.886+0000 7f0ddfe00640 1 -- 172.21.15.99:0/3348466878 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x556cc7044320 con 0x556cc70ce390 2024-02-21T23:07:46.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.886+0000 7f0ddfe00640 10 client.6168 handle_command_reply: tid=0 2024-02-21T23:07:46.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.886+0000 7f0e049c7740 1 client.6168 shutdown 2024-02-21T23:07:46.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.887+0000 7f0e049c7740 1 -- 172.21.15.99:0/3348466878 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556cc71102a0 msgr2=0x556cc71b40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:46.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.887+0000 7f0e049c7740 1 --2- 172.21.15.99:0/3348466878 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556cc71102a0 0x556cc71b40f0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f0dec012010 tx=0x7f0dec004730 comp rx=0 tx=0).stop 2024-02-21T23:07:46.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.887+0000 7f0e049c7740 1 -- 172.21.15.99:0/3348466878 shutdown_connections 2024-02-21T23:07:46.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.887+0000 7f0e049c7740 1 --2- 172.21.15.99:0/3348466878 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x556cc70ce390 0x556cc70dd5c0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:46.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.887+0000 7f0e049c7740 1 --2- 172.21.15.99:0/3348466878 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556cc7146260 0x556cc7140aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:46.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.887+0000 7f0e049c7740 1 --2- 172.21.15.99:0/3348466878 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556cc7110bc0 0x556cc70de370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:46.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.887+0000 7f0e049c7740 1 --2- 172.21.15.99:0/3348466878 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556cc71102a0 0x556cc71b40f0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:46.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.887+0000 7f0ddfe00640 0 client.6168 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:07:46.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.887+0000 7f0e049c7740 1 -- 172.21.15.99:0/3348466878 >> 172.21.15.99:0/3348466878 conn(0x556cc709f6b0 msgr2=0x556cc711b010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:07:46.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.887+0000 7f0e049c7740 1 -- 172.21.15.99:0/3348466878 shutdown_connections 2024-02-21T23:07:46.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.887+0000 7f0e049c7740 1 -- 172.21.15.99:0/3348466878 wait complete. 2024-02-21T23:07:46.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.887+0000 7f0e049c7740 20 client.6168 trim_cache size 0 max 16384 2024-02-21T23:07:46.883 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-02-21T23:07:46.883 INFO:teuthology.orchestra.run.smithi099.stdout: "status": "no active scrubs running", 2024-02-21T23:07:46.884 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubs": {} 2024-02-21T23:07:46.884 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-02-21T23:07:46.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.888+0000 7f0dfbe00640 1 -- 172.21.15.99:0/2507429501 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f0dd809eed0 msgr2=0x7f0dd80a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:46.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.888+0000 7f0dfbe00640 1 --2- 172.21.15.99:0/2507429501 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f0dd809eed0 0x7f0dd80a1390 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0dec009630 tx=0x7f0dec009240 comp rx=0 tx=0).stop 2024-02-21T23:07:46.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.888+0000 7f0dfbe00640 1 -- 172.21.15.99:0/2507429501 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0dfc18b4f0 msgr2=0x7f0dfc175300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:46.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.888+0000 7f0dfbe00640 1 --2- 172.21.15.99:0/2507429501 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0dfc18b4f0 0x7f0dfc175300 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f0df402c4d0 tx=0x7f0df4004a40 comp rx=0 tx=0).stop 2024-02-21T23:07:46.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.888+0000 7f0dfbe00640 1 -- 172.21.15.99:0/2507429501 shutdown_connections 2024-02-21T23:07:46.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.888+0000 7f0dfbe00640 1 --2- 172.21.15.99:0/2507429501 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f0dd809eed0 0x7f0dd80a1390 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:46.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.888+0000 7f0dfbe00640 1 --2- 172.21.15.99:0/2507429501 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0dfc18b4f0 0x7f0dfc175300 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:46.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.888+0000 7f0dfbe00640 1 --2- 172.21.15.99:0/2507429501 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0dfc18b060 0x7f0dfc174dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:46.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.888+0000 7f0dfbe00640 1 --2- 172.21.15.99:0/2507429501 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0dfc17f490 0x7f0dfc17ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:46.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.888+0000 7f0dfbe00640 1 -- 172.21.15.99:0/2507429501 >> 172.21.15.99:0/2507429501 conn(0x7f0dfc0d29b0 msgr2=0x7f0dfc17aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:07:46.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.888+0000 7f0dfbe00640 1 -- 172.21.15.99:0/2507429501 shutdown_connections 2024-02-21T23:07:46.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:46.888+0000 7f0dfbe00640 1 -- 172.21.15.99:0/2507429501 wait complete. 2024-02-21T23:07:46.902 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-02-21T23:07:46.902 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T23:07:47.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.132+0000 7f87ab200640 1 Processor -- start 2024-02-21T23:07:47.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.132+0000 7f87ab200640 1 -- start start 2024-02-21T23:07:47.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.135+0000 7f87ab200640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f87ac0d1ef0 0x7f87ac186c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:47.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.135+0000 7f87ab200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87ac0f4b80 con 0x7f87ac0d1a70 2024-02-21T23:07:47.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.135+0000 7f87ab200640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87ac0f4e60 con 0x7f87ac186830 2024-02-21T23:07:47.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.135+0000 7f87ab200640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87ac0f5140 con 0x7f87ac0d1ef0 2024-02-21T23:07:47.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.136+0000 7f87a9e00640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f87ac186830 0x7f87ac072f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:35148/0 (socket says 172.21.15.99:35148) 2024-02-21T23:07:47.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.136+0000 7f87a9e00640 1 -- 172.21.15.99:0/4075927589 learned_addr learned my addr 172.21.15.99:0/4075927589 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:07:47.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.136+0000 7f87aa800640 1 --2- 172.21.15.99:0/4075927589 >> v2:172.21.15.181:3300/0 conn(0x7f87ac0d1ef0 0x7f87ac186c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:47.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.136+0000 7f87a8a00640 1 -- 172.21.15.99:0/4075927589 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 29122346 0 0) 0x7f87ac0f4e60 con 0x7f87ac186830 2024-02-21T23:07:47.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.136+0000 7f87aa800640 1 -- 172.21.15.99:0/4075927589 >> v1:172.21.15.181:6789/0 conn(0x7f87ac186830 legacy=0x7f87ac072f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:47.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.136+0000 7f87aa800640 1 -- 172.21.15.99:0/4075927589 >> v1:172.21.15.162:6789/0 conn(0x7f87ac0d1a70 legacy=0x7f87ac0cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:47.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.136+0000 7f87aa800640 1 -- 172.21.15.99:0/4075927589 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87ac0f5420 con 0x7f87ac0d1ef0 2024-02-21T23:07:47.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.137+0000 7f87aa800640 1 --2- 172.21.15.99:0/4075927589 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f87ac0d1ef0 0x7f87ac186c10 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f87a4009d90 tx=0x7f87a402bf50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f25f5024d596b6a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:47.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.138+0000 7f87a8a00640 1 -- 172.21.15.99:0/4075927589 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a4039070 con 0x7f87ac0d1ef0 2024-02-21T23:07:47.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.138+0000 7f87a8a00640 1 -- 172.21.15.99:0/4075927589 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87a402cd00 con 0x7f87ac0d1ef0 2024-02-21T23:07:47.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.138+0000 7f87a8a00640 1 -- 172.21.15.99:0/4075927589 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a4034660 con 0x7f87ac0d1ef0 2024-02-21T23:07:47.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.138+0000 7f87ab200640 1 -- 172.21.15.99:0/4075927589 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f87ac0d1ef0 msgr2=0x7f87ac186c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:47.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.138+0000 7f87ab200640 1 --2- 172.21.15.99:0/4075927589 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f87ac0d1ef0 0x7f87ac186c10 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f87a4009d90 tx=0x7f87a402bf50 comp rx=0 tx=0).stop 2024-02-21T23:07:47.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.139+0000 7f87ab200640 1 -- 172.21.15.99:0/4075927589 shutdown_connections 2024-02-21T23:07:47.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.139+0000 7f87ab200640 1 --2- 172.21.15.99:0/4075927589 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f87ac0d1ef0 0x7f87ac186c10 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:47.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.139+0000 7f87ab200640 1 -- 172.21.15.99:0/4075927589 >> 172.21.15.99:0/4075927589 conn(0x7f87ac0ce3c0 msgr2=0x7f87ac0ce7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:07:47.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.139+0000 7f87ab200640 1 -- 172.21.15.99:0/4075927589 shutdown_connections 2024-02-21T23:07:47.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.139+0000 7f87ab200640 1 -- 172.21.15.99:0/4075927589 wait complete. 2024-02-21T23:07:47.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.142+0000 7f87ab200640 1 Processor -- start 2024-02-21T23:07:47.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.142+0000 7f87ab200640 1 -- start start 2024-02-21T23:07:47.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.144+0000 7f87ab200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f87ac0d1a70 0x7f87ac0cca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:47.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.144+0000 7f87ab200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f87ac0d1ef0 0x7f87ac160370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:47.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.144+0000 7f87ab200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87ac186830 0x7f87ac21eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:47.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.144+0000 7f87ab200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87ac0f4870 con 0x7f87ac0d1a70 2024-02-21T23:07:47.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.144+0000 7f87ab200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87ac0f59e0 con 0x7f87ac186830 2024-02-21T23:07:47.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.144+0000 7f87ab200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87ac180b50 con 0x7f87ac0d1ef0 2024-02-21T23:07:47.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.144+0000 7f87a9e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f87ac0d1a70 0x7f87ac0cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:47.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.145+0000 7f87a9e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f87ac0d1a70 0x7f87ac0cca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:36722/0 (socket says 172.21.15.99:36722) 2024-02-21T23:07:47.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.145+0000 7f87a9e00640 1 -- 172.21.15.99:0/230959039 learned_addr learned my addr 172.21.15.99:0/230959039 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:07:47.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.145+0000 7f87aa800640 1 --2- 172.21.15.99:0/230959039 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87ac186830 0x7f87ac21eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:47.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.145+0000 7f87a9400640 1 --2- 172.21.15.99:0/230959039 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f87ac0d1ef0 0x7f87ac160370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:47.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.145+0000 7f87aa800640 1 -- 172.21.15.99:0/230959039 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f87ac0d1ef0 msgr2=0x7f87ac160370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:47.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.145+0000 7f87aa800640 1 --2- 172.21.15.99:0/230959039 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f87ac0d1ef0 0x7f87ac160370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:47.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.145+0000 7f87aa800640 1 -- 172.21.15.99:0/230959039 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f87ac0d1a70 msgr2=0x7f87ac0cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:47.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.145+0000 7f87aa800640 1 --2- 172.21.15.99:0/230959039 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f87ac0d1a70 0x7f87ac0cca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:47.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.145+0000 7f87aa800640 1 -- 172.21.15.99:0/230959039 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87ac0efc00 con 0x7f87ac186830 2024-02-21T23:07:47.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.145+0000 7f87a9e00640 1 --2- 172.21.15.99:0/230959039 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f87ac0d1a70 0x7f87ac0cca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:07:47.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.146+0000 7f87aa800640 1 --2- 172.21.15.99:0/230959039 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87ac186830 0x7f87ac21eab0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f87a4033000 tx=0x7f87a4004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:47.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.146+0000 7f87a2000640 1 -- 172.21.15.99:0/230959039 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a4044020 con 0x7f87ac186830 2024-02-21T23:07:47.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.146+0000 7f87a2000640 1 -- 172.21.15.99:0/230959039 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87a403a040 con 0x7f87ac186830 2024-02-21T23:07:47.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.146+0000 7f87ab200640 1 -- 172.21.15.99:0/230959039 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87ac0efee0 con 0x7f87ac186830 2024-02-21T23:07:47.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.146+0000 7f87a2000640 1 -- 172.21.15.99:0/230959039 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a4039050 con 0x7f87ac186830 2024-02-21T23:07:47.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.146+0000 7f87ab200640 1 -- 172.21.15.99:0/230959039 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87ac21e2b0 con 0x7f87ac186830 2024-02-21T23:07:47.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.148+0000 7f87ab200640 1 -- 172.21.15.99:0/230959039 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87ac068320 con 0x7f87ac186830 2024-02-21T23:07:47.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.151+0000 7f87a2000640 1 -- 172.21.15.99:0/230959039 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f87a402cbc0 con 0x7f87ac186830 2024-02-21T23:07:47.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.152+0000 7f87a2000640 1 --2- 172.21.15.99:0/230959039 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f878c09eed0 0x7f878c0a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:47.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.152+0000 7f87a2000640 1 -- 172.21.15.99:0/230959039 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f87a40ec460 con 0x7f87ac186830 2024-02-21T23:07:47.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.152+0000 7f87a9e00640 1 --2- 172.21.15.99:0/230959039 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f878c09eed0 0x7f878c0a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:47.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.153+0000 7f87a9e00640 1 --2- 172.21.15.99:0/230959039 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f878c09eed0 0x7f878c0a1390 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f879c007b10 tx=0x7f879c007a60 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:47.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.157+0000 7f87a2000640 1 -- 172.21.15.99:0/230959039 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f87a404e060 con 0x7f87ac186830 2024-02-21T23:07:47.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.511+0000 7f87ab200640 1 -- 172.21.15.99:0/230959039 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f87ac1696e0 con 0x7f87ac186830 2024-02-21T23:07:47.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.513+0000 7f87a2000640 1 -- 172.21.15.99:0/230959039 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+11335 (secure 0 0 0) 0x7f87a40ba490 con 0x7f87ac186830 2024-02-21T23:07:47.501 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T23:07:47.502 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4307,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/3514452812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3514452812},{"type":"v1","addr":"172.21.15.162:6836","nonce":3514452812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4312,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6838/2169982089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":2169982089},{"type":"v1","addr":"172.21.15.162:6838","nonce":2169982089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4315,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6839/3335972724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6837","nonce":3335972724},{"type":"v1","addr":"172.21.15.162:6839","nonce":3335972724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4318,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6841/2135456697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6840","nonce":2135456697},{"type":"v1","addr":"172.21.15.162:6841","nonce":2135456697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4325,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2452242758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2452242758},{"type":"v1","addr":"172.21.15.181:6833","nonce":2452242758}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4328,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6836/2751486400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":2751486400},{"type":"v1","addr":"172.21.15.181:6836","nonce":2751486400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":17,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-21T23:01:02.656130+0000","modified":"2024-02-21T23:07:03.165223+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4355,"mds_1":4352,"mds_2":4348},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4331":{"gid":4331,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6838/3728901330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6835","nonce":3728901330},{"type":"v1","addr":"172.21.15.181:6838","nonce":3728901330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4339":{"gid":4339,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6839/3357929641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6837","nonce":3357929641},{"type":"v1","addr":"172.21.15.181:6839","nonce":3357929641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4343":{"gid":4343,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6833/2793485078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":2793485078},{"type":"v1","addr":"172.21.15.99:6833","nonce":2793485078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4348":{"gid":4348,"name":"d","rank":2,"incarnation":12,"state":"up:active","state_seq":10,"addr":"172.21.15.99:6835/2243461688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2243461688},{"type":"v1","addr":"172.21.15.99:6835","nonce":2243461688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4352":{"gid":4352,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.99:6837/1676159950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":1676159950},{"type":"v1","addr":"172.21.15.99:6837","nonce":1676159950}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4355":{"gid":4355,"name":"j","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6839/4239008786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":4239008786},{"type":"v1","addr":"172.21.15.99:6839","nonce":4239008786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-21T23:07:47.502 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 17 2024-02-21T23:07:47.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.515+0000 7f87ab200640 1 -- 172.21.15.99:0/230959039 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f878c09eed0 msgr2=0x7f878c0a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:47.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.515+0000 7f87ab200640 1 --2- 172.21.15.99:0/230959039 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f878c09eed0 0x7f878c0a1390 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f879c007b10 tx=0x7f879c007a60 comp rx=0 tx=0).stop 2024-02-21T23:07:47.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.515+0000 7f87ab200640 1 -- 172.21.15.99:0/230959039 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87ac186830 msgr2=0x7f87ac21eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:47.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.515+0000 7f87ab200640 1 --2- 172.21.15.99:0/230959039 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87ac186830 0x7f87ac21eab0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f87a4033000 tx=0x7f87a4004a40 comp rx=0 tx=0).stop 2024-02-21T23:07:47.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.515+0000 7f87ab200640 1 -- 172.21.15.99:0/230959039 shutdown_connections 2024-02-21T23:07:47.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.515+0000 7f87ab200640 1 --2- 172.21.15.99:0/230959039 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f878c09eed0 0x7f878c0a1390 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:47.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.515+0000 7f87ab200640 1 --2- 172.21.15.99:0/230959039 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87ac186830 0x7f87ac21eab0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:47.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.515+0000 7f87ab200640 1 --2- 172.21.15.99:0/230959039 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f87ac0d1ef0 0x7f87ac160370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:47.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.515+0000 7f87ab200640 1 --2- 172.21.15.99:0/230959039 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f87ac0d1a70 0x7f87ac0cca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:47.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.515+0000 7f87ab200640 1 -- 172.21.15.99:0/230959039 >> 172.21.15.99:0/230959039 conn(0x7f87ac0ce3c0 msgr2=0x7f87ac072f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:07:47.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.516+0000 7f87ab200640 1 -- 172.21.15.99:0/230959039 shutdown_connections 2024-02-21T23:07:47.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.516+0000 7f87ab200640 1 -- 172.21.15.99:0/230959039 wait complete. 2024-02-21T23:07:47.529 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T23:07:47.529 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-02-21T23:07:47.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.733+0000 7f429b200640 1 Processor -- start 2024-02-21T23:07:47.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.734+0000 7f429b200640 1 -- start start 2024-02-21T23:07:47.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.737+0000 7f429b200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f429c18cd60 0x7f429c18a020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:47.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.737+0000 7f429b200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f429c071aa0 con 0x7f429c18a560 2024-02-21T23:07:47.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.737+0000 7f429b200640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f429c071d80 con 0x7f429c186320 2024-02-21T23:07:47.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.737+0000 7f429b200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f429c072e20 con 0x7f429c18cd60 2024-02-21T23:07:47.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.738+0000 7f4299400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f429c18cd60 0x7f429c18a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:47.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.738+0000 7f4299400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f429c18cd60 0x7f429c18a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:36728/0 (socket says 172.21.15.99:36728) 2024-02-21T23:07:47.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.738+0000 7f4299400640 1 -- 172.21.15.99:0/2758729004 learned_addr learned my addr 172.21.15.99:0/2758729004 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:07:47.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.738+0000 7f429a800640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f429c18a560 0x7f429c188b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:47912/0 (socket says 172.21.15.99:47912) 2024-02-21T23:07:47.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.738+0000 7f4299e00640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f429c186320 0x7f429c18c650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:35164/0 (socket says 172.21.15.99:35164) 2024-02-21T23:07:47.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.738+0000 7f4299400640 1 -- 172.21.15.99:0/2758729004 >> v1:172.21.15.181:6789/0 conn(0x7f429c186320 legacy=0x7f429c18c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:47.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.738+0000 7f4298a00640 1 -- 172.21.15.99:0/2758729004 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3901793491 0 0) 0x7f429c071d80 con 0x7f429c186320 2024-02-21T23:07:47.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.738+0000 7f4299400640 1 -- 172.21.15.99:0/2758729004 >> v1:172.21.15.99:6789/0 conn(0x7f429c18a560 legacy=0x7f429c188b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:47.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.738+0000 7f4299400640 1 -- 172.21.15.99:0/2758729004 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f429c072060 con 0x7f429c18cd60 2024-02-21T23:07:47.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.739+0000 7f4299400640 1 --2- 172.21.15.99:0/2758729004 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f429c18cd60 0x7f429c18a020 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f4288009870 tx=0x7f428802b740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f398dc7fa31bc16 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:47.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.740+0000 7f4298a00640 1 -- 172.21.15.99:0/2758729004 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4288037070 con 0x7f429c18cd60 2024-02-21T23:07:47.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.740+0000 7f4298a00640 1 -- 172.21.15.99:0/2758729004 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4288030710 con 0x7f429c18cd60 2024-02-21T23:07:47.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.740+0000 7f4298a00640 1 -- 172.21.15.99:0/2758729004 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4288030ae0 con 0x7f429c18cd60 2024-02-21T23:07:47.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.740+0000 7f429b200640 1 -- 172.21.15.99:0/2758729004 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f429c18cd60 msgr2=0x7f429c18a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:47.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.740+0000 7f429b200640 1 --2- 172.21.15.99:0/2758729004 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f429c18cd60 0x7f429c18a020 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f4288009870 tx=0x7f428802b740 comp rx=0 tx=0).stop 2024-02-21T23:07:47.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.740+0000 7f429b200640 1 -- 172.21.15.99:0/2758729004 shutdown_connections 2024-02-21T23:07:47.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.740+0000 7f429b200640 1 --2- 172.21.15.99:0/2758729004 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f429c18cd60 0x7f429c18a020 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:47.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.740+0000 7f429b200640 1 -- 172.21.15.99:0/2758729004 >> 172.21.15.99:0/2758729004 conn(0x7f429c06e210 msgr2=0x7f429c06e620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:07:47.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.741+0000 7f429b200640 1 -- 172.21.15.99:0/2758729004 shutdown_connections 2024-02-21T23:07:47.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.741+0000 7f429b200640 1 -- 172.21.15.99:0/2758729004 wait complete. 2024-02-21T23:07:47.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.743+0000 7f429b200640 1 Processor -- start 2024-02-21T23:07:47.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.743+0000 7f429b200640 1 -- start start 2024-02-21T23:07:47.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.745+0000 7f429b200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f429c186320 0x7f429c173210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:47.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.745+0000 7f429b200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f429c18a560 0x7f429c2229e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:47.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.745+0000 7f429b200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f429c18cd60 0x7f429c222f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:47.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.745+0000 7f429b200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f429c072900 con 0x7f429c18cd60 2024-02-21T23:07:47.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.745+0000 7f429b200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f429c072620 con 0x7f429c18a560 2024-02-21T23:07:47.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.745+0000 7f429b200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f429c18a9f0 con 0x7f429c186320 2024-02-21T23:07:47.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.745+0000 7f4299e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f429c186320 0x7f429c173210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:47.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.745+0000 7f429a800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f429c18cd60 0x7f429c222f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:47.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.745+0000 7f4299e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f429c186320 0x7f429c173210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:59194/0 (socket says 172.21.15.99:59194) 2024-02-21T23:07:47.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.745+0000 7f4299e00640 1 -- 172.21.15.99:0/1298249577 learned_addr learned my addr 172.21.15.99:0/1298249577 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:07:47.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.745+0000 7f4299400640 1 --2- 172.21.15.99:0/1298249577 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f429c18a560 0x7f429c2229e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:47.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.746+0000 7f429a800640 1 -- 172.21.15.99:0/1298249577 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f429c186320 msgr2=0x7f429c173210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:47.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.746+0000 7f429a800640 1 --2- 172.21.15.99:0/1298249577 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f429c186320 0x7f429c173210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:47.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.746+0000 7f429a800640 1 -- 172.21.15.99:0/1298249577 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f429c18a560 msgr2=0x7f429c2229e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:47.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.746+0000 7f429a800640 1 --2- 172.21.15.99:0/1298249577 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f429c18a560 0x7f429c2229e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:47.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.746+0000 7f429a800640 1 -- 172.21.15.99:0/1298249577 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f429c18bee0 con 0x7f429c18cd60 2024-02-21T23:07:47.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.746+0000 7f429a800640 1 --2- 172.21.15.99:0/1298249577 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f429c18cd60 0x7f429c222f20 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f429400c820 tx=0x7f429400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:47.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.747+0000 7f4292000640 1 -- 172.21.15.99:0/1298249577 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4294018070 con 0x7f429c18cd60 2024-02-21T23:07:47.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.747+0000 7f4292000640 1 -- 172.21.15.99:0/1298249577 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f429400a640 con 0x7f429c18cd60 2024-02-21T23:07:47.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.747+0000 7f4292000640 1 -- 172.21.15.99:0/1298249577 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f429400aa50 con 0x7f429c18cd60 2024-02-21T23:07:47.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.747+0000 7f429b200640 1 -- 172.21.15.99:0/1298249577 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f429c0f5a50 con 0x7f429c18cd60 2024-02-21T23:07:47.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.747+0000 7f429b200640 1 -- 172.21.15.99:0/1298249577 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f429c0f6010 con 0x7f429c18cd60 2024-02-21T23:07:47.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.750+0000 7f4292000640 1 -- 172.21.15.99:0/1298249577 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f429400abf0 con 0x7f429c18cd60 2024-02-21T23:07:47.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.752+0000 7f42a3e58740 1 Processor -- start 2024-02-21T23:07:47.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.752+0000 7f42a3e58740 1 -- start start 2024-02-21T23:07:47.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.753+0000 7f4292000640 1 --2- 172.21.15.99:0/1298249577 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f427c09ef00 0x7f427c0a13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:47.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.753+0000 7f4292000640 1 -- 172.21.15.99:0/1298249577 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f42940c9400 con 0x7f429c18cd60 2024-02-21T23:07:47.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.753+0000 7f4299400640 1 --2- 172.21.15.99:0/1298249577 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f427c09ef00 0x7f427c0a13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:47.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.754+0000 7f4299400640 1 --2- 172.21.15.99:0/1298249577 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f427c09ef00 0x7f427c0a13c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4288034000 tx=0x7f4288008030 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:47.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.754+0000 7f42a3e58740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563933a6c660 0x563933a6ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:47.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.754+0000 7f42a3e58740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563933aa7330 0x563933aa77b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:47.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.754+0000 7f42a3e58740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563933aa7cf0 0x563933aa8560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:47.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.754+0000 7f42a3e58740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x563933994b50 con 0x563933a6c660 2024-02-21T23:07:47.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.754+0000 7f42a3e58740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x56393393dda0 con 0x563933aa7cf0 2024-02-21T23:07:47.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.754+0000 7f42a3e58740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x563933990bf0 con 0x563933aa7330 2024-02-21T23:07:47.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.755+0000 7f4299e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563933a6c660 0x563933a6ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:47.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.755+0000 7f429a800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563933aa7cf0 0x563933aa8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:47.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.755+0000 7f4299e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563933a6c660 0x563933a6ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:36754/0 (socket says 172.21.15.99:36754) 2024-02-21T23:07:47.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.755+0000 7f4299e00640 1 -- 172.21.15.99:0/386901040 learned_addr learned my addr 172.21.15.99:0/386901040 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:07:47.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.755+0000 7f4299400640 1 --2- 172.21.15.99:0/386901040 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563933aa7330 0x563933aa77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:47.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.755+0000 7f429a800640 1 -- 172.21.15.99:0/386901040 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563933aa7330 msgr2=0x563933aa77b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:47.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.755+0000 7f429a800640 1 --2- 172.21.15.99:0/386901040 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563933aa7330 0x563933aa77b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:47.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.755+0000 7f429a800640 1 -- 172.21.15.99:0/386901040 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563933a6c660 msgr2=0x563933a6ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:47.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.755+0000 7f429a800640 1 --2- 172.21.15.99:0/386901040 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563933a6c660 0x563933a6ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:47.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.755+0000 7f429a800640 1 -- 172.21.15.99:0/386901040 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563933960f80 con 0x563933aa7cf0 2024-02-21T23:07:47.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.755+0000 7f429a800640 1 --2- 172.21.15.99:0/386901040 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563933aa7cf0 0x563933aa8560 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f42940c6ac0 tx=0x7f4294096c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2044b9d0fef44dd0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:47.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.755+0000 7f4286a00640 1 -- 172.21.15.99:0/386901040 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42940c91b0 con 0x563933aa7cf0 2024-02-21T23:07:47.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.756+0000 7f4286a00640 1 -- 172.21.15.99:0/386901040 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42940933c0 con 0x563933aa7cf0 2024-02-21T23:07:47.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.756+0000 7f4286a00640 1 -- 172.21.15.99:0/386901040 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42940961a0 con 0x563933aa7cf0 2024-02-21T23:07:47.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.756+0000 7f42a3e58740 1 -- 172.21.15.99:0/386901040 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563933aa7cf0 msgr2=0x563933aa8560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:47.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.756+0000 7f42a3e58740 1 --2- 172.21.15.99:0/386901040 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563933aa7cf0 0x563933aa8560 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f42940c6ac0 tx=0x7f4294096c30 comp rx=0 tx=0).stop 2024-02-21T23:07:47.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.756+0000 7f42a3e58740 1 -- 172.21.15.99:0/386901040 shutdown_connections 2024-02-21T23:07:47.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.756+0000 7f42a3e58740 1 --2- 172.21.15.99:0/386901040 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563933aa7cf0 0x563933aa8560 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:47.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.756+0000 7f42a3e58740 1 --2- 172.21.15.99:0/386901040 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563933aa7330 0x563933aa77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:47.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.756+0000 7f42a3e58740 1 --2- 172.21.15.99:0/386901040 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563933a6c660 0x563933a6ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:47.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.756+0000 7f42a3e58740 1 -- 172.21.15.99:0/386901040 >> 172.21.15.99:0/386901040 conn(0x563933a2e6d0 msgr2=0x563933a2f750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:07:47.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.756+0000 7f42a3e58740 1 -- 172.21.15.99:0/386901040 shutdown_connections 2024-02-21T23:07:47.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.757+0000 7f42a3e58740 1 -- 172.21.15.99:0/386901040 wait complete. 2024-02-21T23:07:47.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.757+0000 7f42a3e58740 1 -- start start 2024-02-21T23:07:47.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.758+0000 7f42a3e58740 1 Processor -- start 2024-02-21T23:07:47.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.759+0000 7f42a3e58740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563933aa7330 0x563933a5b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:47.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.759+0000 7f42a3e58740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563933aa7cf0 0x563933aa11d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:47.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.759+0000 7f42a3e58740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563933a66980 0x563933a67120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:47.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.759+0000 7f42a3e58740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x563933aa60a0 con 0x563933aa7cf0 2024-02-21T23:07:47.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.759+0000 7f42a3e58740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x563933933380 con 0x563933aa7330 2024-02-21T23:07:47.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.759+0000 7f42a3e58740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x563933aa5dc0 con 0x563933a66980 2024-02-21T23:07:47.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.759+0000 7f42a3e58740 10 client.0 _ll_register_callbacks cb 0x56393398c280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:07:47.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.759+0000 7f4299e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563933aa7330 0x563933a5b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:47.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.759+0000 7f4299e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563933aa7330 0x563933a5b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:36916/0 (socket says 172.21.15.99:36916) 2024-02-21T23:07:47.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.759+0000 7f4299e00640 1 -- 172.21.15.99:0/352024651 learned_addr learned my addr 172.21.15.99:0/352024651 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:07:47.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.759+0000 7f4299400640 1 --2- 172.21.15.99:0/352024651 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563933aa7cf0 0x563933aa11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:47.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.760+0000 7f429a800640 1 --2- 172.21.15.99:0/352024651 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563933a66980 0x563933a67120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:47.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.760+0000 7f4299e00640 1 -- 172.21.15.99:0/352024651 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563933a66980 msgr2=0x563933a67120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:47.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.760+0000 7f4299e00640 1 --2- 172.21.15.99:0/352024651 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563933a66980 0x563933a67120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:47.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.760+0000 7f4299e00640 1 -- 172.21.15.99:0/352024651 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563933aa7cf0 msgr2=0x563933aa11d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:47.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.760+0000 7f4299e00640 1 --2- 172.21.15.99:0/352024651 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563933aa7cf0 0x563933aa11d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:47.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.760+0000 7f4299e00640 1 -- 172.21.15.99:0/352024651 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56393395bc20 con 0x563933aa7330 2024-02-21T23:07:47.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.760+0000 7f4299e00640 1 --2- 172.21.15.99:0/352024651 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563933aa7330 0x563933a5b620 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f428c001280 tx=0x7f428c001740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12d6774f310c3ecf server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:47.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.760+0000 7f427b400640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-02-21T23:07:47.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.760+0000 7f427b400640 1 -- 172.21.15.99:0/352024651 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428c0145b0 con 0x563933aa7330 2024-02-21T23:07:47.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.760+0000 7f427b400640 1 -- 172.21.15.99:0/352024651 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f428c014750 con 0x563933aa7330 2024-02-21T23:07:47.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.760+0000 7f42a3e58740 1 -- 172.21.15.99:0/352024651 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f42940933c0 con 0x563933aa7330 2024-02-21T23:07:47.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.761+0000 7f427b400640 1 -- 172.21.15.99:0/352024651 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f428c023050 con 0x563933aa7330 2024-02-21T23:07:47.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.761+0000 7f42a3e58740 10 client.6313 fetch_fsmap learned FSMap version 17 2024-02-21T23:07:47.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.761+0000 7f42a3e58740 1 -- 172.21.15.99:0/352024651 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5639336a93f0 con 0x563933aa7330 2024-02-21T23:07:47.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.761+0000 7f427b400640 1 -- 172.21.15.99:0/352024651 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42940933c0 con 0x563933aa7330 2024-02-21T23:07:47.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.761+0000 7f427b400640 1 -- 172.21.15.99:0/352024651 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f428c014950 con 0x563933aa7330 2024-02-21T23:07:47.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.761+0000 7f42a3e58740 10 client.6313 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:07:47.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.761+0000 7f42a3e58740 10 client.6313 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.d 2024-02-21T23:07:47.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.761+0000 7f42a3e58740 20 client.6313 populate_metadata read hostname 'smithi099' 2024-02-21T23:07:47.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.761+0000 7f42a3e58740 1 --2- 172.21.15.99:0/352024651 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x563933aa3b80 0x563933aa1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:47.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.761+0000 7f42a3e58740 4 client.6313 mds_command: new command op to 4348 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:07:47.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.761+0000 7f42a3e58740 1 -- 172.21.15.99:0/352024651 --> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5639339a2090 con 0x563933aa3b80 2024-02-21T23:07:47.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.762+0000 7f4299400640 1 --2- 172.21.15.99:0/352024651 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x563933aa3b80 0x563933aa1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:47.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.762+0000 7f4299400640 1 --2- 172.21.15.99:0/352024651 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x563933aa3b80 0x563933aa1920 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=499dc2e402565404 server_cookie=4aeff95675f6a9f8 in_seq=0 out_seq=0 2024-02-21T23:07:47.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.762+0000 7f427b400640 10 client.6313 ms_handle_connect on v2:172.21.15.99:6834/2243461688 2024-02-21T23:07:47.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.763+0000 7f427b400640 1 -- 172.21.15.99:0/352024651 <== mds.2 v2:172.21.15.99:6834/2243461688 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x5639339a2090 con 0x563933aa3b80 2024-02-21T23:07:47.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.763+0000 7f427b400640 10 client.6313 handle_command_reply: tid=0 2024-02-21T23:07:47.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.763+0000 7f42a3e58740 1 client.6313 shutdown 2024-02-21T23:07:47.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.764+0000 7f42a3e58740 1 -- 172.21.15.99:0/352024651 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563933aa7330 msgr2=0x563933a5b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:47.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.764+0000 7f42a3e58740 1 --2- 172.21.15.99:0/352024651 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563933aa7330 0x563933a5b620 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f428c001280 tx=0x7f428c001740 comp rx=0 tx=0).stop 2024-02-21T23:07:47.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.764+0000 7f42a3e58740 1 -- 172.21.15.99:0/352024651 shutdown_connections 2024-02-21T23:07:47.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.764+0000 7f42a3e58740 1 --2- 172.21.15.99:0/352024651 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x563933aa3b80 0x563933aa1920 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:47.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.764+0000 7f42a3e58740 1 --2- 172.21.15.99:0/352024651 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563933a66980 0x563933a67120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:47.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.764+0000 7f42a3e58740 1 --2- 172.21.15.99:0/352024651 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563933aa7cf0 0x563933aa11d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:47.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.764+0000 7f42a3e58740 1 --2- 172.21.15.99:0/352024651 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563933aa7330 0x563933a5b620 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:47.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.764+0000 7f42a3e58740 1 -- 172.21.15.99:0/352024651 >> 172.21.15.99:0/352024651 conn(0x563933a6c660 msgr2=0x563933aa67b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:07:47.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.764+0000 7f427b400640 0 client.6313 ms_handle_reset on v2:172.21.15.99:6834/2243461688 2024-02-21T23:07:47.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.764+0000 7f42a3e58740 1 -- 172.21.15.99:0/352024651 shutdown_connections 2024-02-21T23:07:47.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.764+0000 7f42a3e58740 1 -- 172.21.15.99:0/352024651 wait complete. 2024-02-21T23:07:47.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.764+0000 7f42a3e58740 20 client.6313 trim_cache size 0 max 16384 2024-02-21T23:07:47.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.791+0000 7f42a3e58740 1 Processor -- start 2024-02-21T23:07:47.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.792+0000 7f42a3e58740 1 -- start start 2024-02-21T23:07:47.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.793+0000 7f42a3e58740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563933a66980 0x563933a36b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:47.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.793+0000 7f42a3e58740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563933aa7330 0x563933aa42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:47.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.793+0000 7f42a3e58740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563933aa7cf0 0x563933b04420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:47.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.793+0000 7f42a3e58740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f429c22c9f0 con 0x563933aa7cf0 2024-02-21T23:07:47.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.794+0000 7f42a3e58740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f429c22a590 con 0x563933a66980 2024-02-21T23:07:47.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.794+0000 7f42a3e58740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f429c21fd60 con 0x563933aa7330 2024-02-21T23:07:47.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.794+0000 7f4299e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563933a66980 0x563933a36b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:47.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.794+0000 7f4299e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563933a66980 0x563933a36b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:36918/0 (socket says 172.21.15.99:36918) 2024-02-21T23:07:47.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.794+0000 7f4299e00640 1 -- 172.21.15.99:0/792658422 learned_addr learned my addr 172.21.15.99:0/792658422 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:07:47.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.794+0000 7f429a800640 1 --2- 172.21.15.99:0/792658422 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563933aa7cf0 0x563933b04420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:47.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.794+0000 7f4299400640 1 --2- 172.21.15.99:0/792658422 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563933aa7330 0x563933aa42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:47.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.794+0000 7f4299e00640 1 -- 172.21.15.99:0/792658422 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563933aa7330 msgr2=0x563933aa42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:47.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.794+0000 7f4299e00640 1 --2- 172.21.15.99:0/792658422 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563933aa7330 0x563933aa42a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:47.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.794+0000 7f4299e00640 1 -- 172.21.15.99:0/792658422 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563933aa7cf0 msgr2=0x563933b04420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:47.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.794+0000 7f4299e00640 1 --2- 172.21.15.99:0/792658422 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563933aa7cf0 0x563933b04420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:47.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.794+0000 7f4299e00640 1 -- 172.21.15.99:0/792658422 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5639337737d0 con 0x563933a66980 2024-02-21T23:07:47.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.794+0000 7f4299e00640 1 --2- 172.21.15.99:0/792658422 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563933a66980 0x563933a36b70 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f428c0147c0 tx=0x7f428c00f000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b23d570ae96f058 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:47.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.795+0000 7f4286000640 1 -- 172.21.15.99:0/792658422 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428c02b020 con 0x563933a66980 2024-02-21T23:07:47.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.795+0000 7f4286000640 1 -- 172.21.15.99:0/792658422 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f428c00b040 con 0x563933a66980 2024-02-21T23:07:47.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.795+0000 7f4286000640 1 -- 172.21.15.99:0/792658422 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428c0157a0 con 0x563933a66980 2024-02-21T23:07:47.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.796+0000 7f42a3e58740 1 -- 172.21.15.99:0/792658422 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563933a66980 msgr2=0x563933a36b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:47.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.796+0000 7f42a3e58740 1 --2- 172.21.15.99:0/792658422 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563933a66980 0x563933a36b70 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f428c0147c0 tx=0x7f428c00f000 comp rx=0 tx=0).stop 2024-02-21T23:07:47.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.796+0000 7f42a3e58740 1 -- 172.21.15.99:0/792658422 shutdown_connections 2024-02-21T23:07:47.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.796+0000 7f42a3e58740 1 --2- 172.21.15.99:0/792658422 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563933aa7cf0 0x563933b04420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:47.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.796+0000 7f42a3e58740 1 --2- 172.21.15.99:0/792658422 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563933aa7330 0x563933aa42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:47.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.796+0000 7f42a3e58740 1 --2- 172.21.15.99:0/792658422 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563933a66980 0x563933a36b70 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:47.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.796+0000 7f42a3e58740 1 -- 172.21.15.99:0/792658422 >> 172.21.15.99:0/792658422 conn(0x563933a6c660 msgr2=0x563933a36190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:07:47.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.796+0000 7f42a3e58740 1 -- 172.21.15.99:0/792658422 shutdown_connections 2024-02-21T23:07:47.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.796+0000 7f42a3e58740 1 -- 172.21.15.99:0/792658422 wait complete. 2024-02-21T23:07:47.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.797+0000 7f42a3e58740 1 -- start start 2024-02-21T23:07:47.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.797+0000 7f42a3e58740 1 Processor -- start 2024-02-21T23:07:47.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.800+0000 7f42a3e58740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563933a66980 0x563933ab0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:47.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.800+0000 7f42a3e58740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563933aa7330 0x563933a54310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:47.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.800+0000 7f42a3e58740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563933aa7cf0 0x563933a67340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:47.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.800+0000 7f42a3e58740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f429c228cb0 con 0x563933a66980 2024-02-21T23:07:47.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.800+0000 7f42a3e58740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f429c229f30 con 0x563933aa7cf0 2024-02-21T23:07:47.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.800+0000 7f42a3e58740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f429c2292b0 con 0x563933aa7330 2024-02-21T23:07:47.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.800+0000 7f42a3e58740 10 client.0 _ll_register_callbacks cb 0x7f428c007320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:07:47.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.800+0000 7f4299e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563933a66980 0x563933ab0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:47.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.800+0000 7f4299400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563933aa7330 0x563933a54310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:47.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.800+0000 7f4299e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563933a66980 0x563933ab0aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:36770/0 (socket says 172.21.15.99:36770) 2024-02-21T23:07:47.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.800+0000 7f4299400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563933aa7330 0x563933a54310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:59216/0 (socket says 172.21.15.99:59216) 2024-02-21T23:07:47.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.800+0000 7f4299e00640 1 -- 172.21.15.99:0/3891851723 learned_addr learned my addr 172.21.15.99:0/3891851723 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:07:47.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.800+0000 7f429a800640 1 --2- 172.21.15.99:0/3891851723 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563933aa7cf0 0x563933a67340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:47.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.800+0000 7f4299400640 1 -- 172.21.15.99:0/3891851723 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563933aa7cf0 msgr2=0x563933a67340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:47.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.800+0000 7f4299400640 1 --2- 172.21.15.99:0/3891851723 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563933aa7cf0 0x563933a67340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:47.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.800+0000 7f4299400640 1 -- 172.21.15.99:0/3891851723 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563933a66980 msgr2=0x563933ab0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:47.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.800+0000 7f4299400640 1 --2- 172.21.15.99:0/3891851723 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563933a66980 0x563933ab0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:47.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.800+0000 7f4299400640 1 -- 172.21.15.99:0/3891851723 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563933a67880 con 0x563933aa7330 2024-02-21T23:07:47.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.801+0000 7f4299400640 1 --2- 172.21.15.99:0/3891851723 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563933aa7330 0x563933a54310 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f429c0fb070 tx=0x7f428802d000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8363ac07fbda24a1 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:47.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.801+0000 7f427b400640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-02-21T23:07:47.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.801+0000 7f427b400640 1 -- 172.21.15.99:0/3891851723 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4288058060 con 0x563933aa7330 2024-02-21T23:07:47.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.801+0000 7f42a3e58740 1 -- 172.21.15.99:0/3891851723 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f428c00b040 con 0x563933aa7330 2024-02-21T23:07:47.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.801+0000 7f427b400640 1 -- 172.21.15.99:0/3891851723 <== mon.2 v2:172.21.15.181:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f4288052590 con 0x563933aa7330 2024-02-21T23:07:47.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.801+0000 7f427b400640 1 -- 172.21.15.99:0/3891851723 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f428805f050 con 0x563933aa7330 2024-02-21T23:07:47.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.801+0000 7f42a3e58740 10 client.6320 fetch_fsmap learned FSMap version 17 2024-02-21T23:07:47.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.801+0000 7f42a3e58740 1 -- 172.21.15.99:0/3891851723 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x563933a6f670 con 0x563933aa7330 2024-02-21T23:07:47.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.802+0000 7f427b400640 1 -- 172.21.15.99:0/3891851723 <== mon.2 v2:172.21.15.181:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f428c00b040 con 0x563933aa7330 2024-02-21T23:07:47.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.802+0000 7f427b400640 1 -- 172.21.15.99:0/3891851723 <== mon.2 v2:172.21.15.181:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f4288052790 con 0x563933aa7330 2024-02-21T23:07:47.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.802+0000 7f42a3e58740 10 client.6320 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:07:47.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.802+0000 7f42a3e58740 10 client.6320 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.d 2024-02-21T23:07:47.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.802+0000 7f42a3e58740 20 client.6320 populate_metadata read hostname 'smithi099' 2024-02-21T23:07:47.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.802+0000 7f42a3e58740 1 --2- 172.21.15.99:0/3891851723 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x563933aa1350 0x563933ab1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:47.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.802+0000 7f42a3e58740 4 client.6320 mds_command: new command op to 4348 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T23:07:47.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.802+0000 7f42a3e58740 1 -- 172.21.15.99:0/3891851723 --> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56393399c3e0 con 0x563933aa1350 2024-02-21T23:07:47.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.802+0000 7f4299e00640 1 --2- 172.21.15.99:0/3891851723 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x563933aa1350 0x563933ab1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:47.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.803+0000 7f4299e00640 1 --2- 172.21.15.99:0/3891851723 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x563933aa1350 0x563933ab1010 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7041219a4707818d server_cookie=e7d4d547ecad3ec0 in_seq=0 out_seq=0 2024-02-21T23:07:47.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.803+0000 7f427b400640 10 client.6320 ms_handle_connect on v2:172.21.15.99:6834/2243461688 2024-02-21T23:07:47.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.803+0000 7f427b400640 1 -- 172.21.15.99:0/3891851723 <== mds.2 v2:172.21.15.99:6834/2243461688 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56393399c3e0 con 0x563933aa1350 2024-02-21T23:07:47.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.803+0000 7f427b400640 10 client.6320 handle_command_reply: tid=0 2024-02-21T23:07:47.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.803+0000 7f42a3e58740 1 client.6320 shutdown 2024-02-21T23:07:47.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.803+0000 7f42a3e58740 1 -- 172.21.15.99:0/3891851723 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563933aa7330 msgr2=0x563933a54310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:47.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.803+0000 7f42a3e58740 1 --2- 172.21.15.99:0/3891851723 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563933aa7330 0x563933a54310 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f429c0fb070 tx=0x7f428802d000 comp rx=0 tx=0).stop 2024-02-21T23:07:47.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.804+0000 7f42a3e58740 1 -- 172.21.15.99:0/3891851723 shutdown_connections 2024-02-21T23:07:47.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.804+0000 7f42a3e58740 1 --2- 172.21.15.99:0/3891851723 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x563933aa1350 0x563933ab1010 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:47.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.804+0000 7f42a3e58740 1 --2- 172.21.15.99:0/3891851723 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563933aa7cf0 0x563933a67340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:47.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.804+0000 7f42a3e58740 1 --2- 172.21.15.99:0/3891851723 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563933aa7330 0x563933a54310 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:47.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.804+0000 7f42a3e58740 1 --2- 172.21.15.99:0/3891851723 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563933a66980 0x563933ab0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:47.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.804+0000 7f427b400640 0 client.6320 ms_handle_reset on v2:172.21.15.99:6834/2243461688 2024-02-21T23:07:47.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.804+0000 7f42a3e58740 1 -- 172.21.15.99:0/3891851723 >> 172.21.15.99:0/3891851723 conn(0x563933a6c660 msgr2=0x563933a5e960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:07:47.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.804+0000 7f42a3e58740 1 -- 172.21.15.99:0/3891851723 shutdown_connections 2024-02-21T23:07:47.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.804+0000 7f42a3e58740 1 -- 172.21.15.99:0/3891851723 wait complete. 2024-02-21T23:07:47.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.804+0000 7f42a3e58740 20 client.6320 trim_cache size 0 max 16384 2024-02-21T23:07:47.801 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-02-21T23:07:47.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.805+0000 7f429b200640 1 -- 172.21.15.99:0/1298249577 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f427c09ef00 msgr2=0x7f427c0a13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:47.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.805+0000 7f429b200640 1 --2- 172.21.15.99:0/1298249577 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f427c09ef00 0x7f427c0a13c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4288034000 tx=0x7f4288008030 comp rx=0 tx=0).stop 2024-02-21T23:07:47.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.805+0000 7f429b200640 1 -- 172.21.15.99:0/1298249577 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f429c18cd60 msgr2=0x7f429c222f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:47.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.805+0000 7f429b200640 1 --2- 172.21.15.99:0/1298249577 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f429c18cd60 0x7f429c222f20 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f429400c820 tx=0x7f429400cce0 comp rx=0 tx=0).stop 2024-02-21T23:07:47.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.805+0000 7f429b200640 1 -- 172.21.15.99:0/1298249577 shutdown_connections 2024-02-21T23:07:47.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.805+0000 7f429b200640 1 --2- 172.21.15.99:0/1298249577 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f427c09ef00 0x7f427c0a13c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:47.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.805+0000 7f429b200640 1 --2- 172.21.15.99:0/1298249577 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f429c18cd60 0x7f429c222f20 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:47.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.805+0000 7f429b200640 1 --2- 172.21.15.99:0/1298249577 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f429c18a560 0x7f429c2229e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:47.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.805+0000 7f429b200640 1 --2- 172.21.15.99:0/1298249577 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f429c186320 0x7f429c173210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:47.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.805+0000 7f429b200640 1 -- 172.21.15.99:0/1298249577 >> 172.21.15.99:0/1298249577 conn(0x7f429c06e210 msgr2=0x7f429c181a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:07:47.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.805+0000 7f429b200640 1 -- 172.21.15.99:0/1298249577 shutdown_connections 2024-02-21T23:07:47.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:47.805+0000 7f429b200640 1 -- 172.21.15.99:0/1298249577 wait complete. 2024-02-21T23:07:47.812 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T23:07:47.812 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-02-21T23:07:48.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.063+0000 7f8877e00640 1 Processor -- start 2024-02-21T23:07:48.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.063+0000 7f8877e00640 1 -- start start 2024-02-21T23:07:48.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.065+0000 7f8877e00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f887817f490 0x7f887818ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:48.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.065+0000 7f8877e00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88780d6dd0 con 0x7f887818b060 2024-02-21T23:07:48.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.065+0000 7f8877e00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88781614c0 con 0x7f887818b4f0 2024-02-21T23:07:48.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.065+0000 7f8877e00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88780d6810 con 0x7f887817f490 2024-02-21T23:07:48.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.066+0000 7f8876000640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f887818b060 0x7f8878188a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:47928/0 (socket says 172.21.15.99:47928) 2024-02-21T23:07:48.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.066+0000 7f8876000640 1 -- 172.21.15.99:0/3418957166 learned_addr learned my addr 172.21.15.99:0/3418957166 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:07:48.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.066+0000 7f8876a00640 1 --2- 172.21.15.99:0/3418957166 >> v2:172.21.15.181:3300/0 conn(0x7f887817f490 0x7f887818ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:48.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.066+0000 7f8875600640 1 -- 172.21.15.99:0/3418957166 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 193540496 0 0) 0x7f88781614c0 con 0x7f887818b4f0 2024-02-21T23:07:48.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.066+0000 7f8875600640 1 -- 172.21.15.99:0/3418957166 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f885c003520 con 0x7f887818b4f0 2024-02-21T23:07:48.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.066+0000 7f8875600640 1 -- 172.21.15.99:0/3418957166 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 809333211 0 0) 0x7f88780d6dd0 con 0x7f887818b060 2024-02-21T23:07:48.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.066+0000 7f8875600640 1 -- 172.21.15.99:0/3418957166 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88781614c0 con 0x7f887818b060 2024-02-21T23:07:48.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.066+0000 7f8876a00640 1 -- 172.21.15.99:0/3418957166 >> v1:172.21.15.181:6789/0 conn(0x7f887818b4f0 legacy=0x7f8878189150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:48.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.066+0000 7f8876a00640 1 -- 172.21.15.99:0/3418957166 >> v1:172.21.15.99:6789/0 conn(0x7f887818b060 legacy=0x7f8878188a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:48.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.066+0000 7f8876a00640 1 -- 172.21.15.99:0/3418957166 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88780d6af0 con 0x7f887817f490 2024-02-21T23:07:48.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.068+0000 7f8876a00640 1 --2- 172.21.15.99:0/3418957166 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f887817f490 0x7f887818ab20 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f88680097a0 tx=0x7f886802b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1a31b967049a30 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:48.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.068+0000 7f8875600640 1 -- 172.21.15.99:0/3418957166 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8868034070 con 0x7f887817f490 2024-02-21T23:07:48.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.068+0000 7f8875600640 1 -- 172.21.15.99:0/3418957166 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8868030610 con 0x7f887817f490 2024-02-21T23:07:48.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.068+0000 7f8875600640 1 -- 172.21.15.99:0/3418957166 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88680309e0 con 0x7f887817f490 2024-02-21T23:07:48.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.069+0000 7f8877e00640 1 -- 172.21.15.99:0/3418957166 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f887817f490 msgr2=0x7f887818ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:48.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.069+0000 7f8877e00640 1 --2- 172.21.15.99:0/3418957166 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f887817f490 0x7f887818ab20 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f88680097a0 tx=0x7f886802b960 comp rx=0 tx=0).stop 2024-02-21T23:07:48.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.069+0000 7f8877e00640 1 -- 172.21.15.99:0/3418957166 shutdown_connections 2024-02-21T23:07:48.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.069+0000 7f8877e00640 1 --2- 172.21.15.99:0/3418957166 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f887817f490 0x7f887818ab20 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:48.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.069+0000 7f8877e00640 1 -- 172.21.15.99:0/3418957166 >> 172.21.15.99:0/3418957166 conn(0x7f88780d29b0 msgr2=0x7f88780d2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:07:48.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.069+0000 7f8877e00640 1 -- 172.21.15.99:0/3418957166 shutdown_connections 2024-02-21T23:07:48.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.069+0000 7f8877e00640 1 -- 172.21.15.99:0/3418957166 wait complete. 2024-02-21T23:07:48.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.071+0000 7f8877e00640 1 Processor -- start 2024-02-21T23:07:48.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.071+0000 7f8877e00640 1 -- start start 2024-02-21T23:07:48.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.073+0000 7f8877e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f887817f490 0x7f887815c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:48.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.073+0000 7f8877e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f887818b060 0x7f88780fc4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:48.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.073+0000 7f8877e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f887818b4f0 0x7f887817e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:48.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.073+0000 7f8877e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f887818a600 con 0x7f887818b060 2024-02-21T23:07:48.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.073+0000 7f8877e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f887818a320 con 0x7f887818b4f0 2024-02-21T23:07:48.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.073+0000 7f8877e00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f887817f870 con 0x7f887817f490 2024-02-21T23:07:48.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.073+0000 7f8876a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f887817f490 0x7f887815c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:48.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.073+0000 7f8876a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f887817f490 0x7f887815c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:59224/0 (socket says 172.21.15.99:59224) 2024-02-21T23:07:48.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.073+0000 7f8876a00640 1 -- 172.21.15.99:0/925540952 learned_addr learned my addr 172.21.15.99:0/925540952 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:07:48.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.074+0000 7f8876000640 1 --2- 172.21.15.99:0/925540952 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f887818b060 0x7f88780fc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:48.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.074+0000 7f8877400640 1 --2- 172.21.15.99:0/925540952 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f887818b4f0 0x7f887817e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:48.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.074+0000 7f8876a00640 1 -- 172.21.15.99:0/925540952 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f887818b4f0 msgr2=0x7f887817e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:48.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.074+0000 7f8876a00640 1 --2- 172.21.15.99:0/925540952 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f887818b4f0 0x7f887817e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:48.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.074+0000 7f8876a00640 1 -- 172.21.15.99:0/925540952 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f887818b060 msgr2=0x7f88780fc4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:48.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.074+0000 7f8876a00640 1 --2- 172.21.15.99:0/925540952 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f887818b060 0x7f88780fc4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:48.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.074+0000 7f8876a00640 1 -- 172.21.15.99:0/925540952 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88780fcde0 con 0x7f887817f490 2024-02-21T23:07:48.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.074+0000 7f8877400640 1 --2- 172.21.15.99:0/925540952 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f887818b4f0 0x7f887817e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:07:48.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.074+0000 7f8876a00640 1 --2- 172.21.15.99:0/925540952 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f887817f490 0x7f887815c480 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f886802bf70 tx=0x7f88680046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:48.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.075+0000 7f886ea00640 1 -- 172.21.15.99:0/925540952 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8868034040 con 0x7f887817f490 2024-02-21T23:07:48.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.075+0000 7f886ea00640 1 -- 172.21.15.99:0/925540952 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8868030410 con 0x7f887817f490 2024-02-21T23:07:48.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.075+0000 7f8877e00640 1 -- 172.21.15.99:0/925540952 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88780fd0c0 con 0x7f887817f490 2024-02-21T23:07:48.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.075+0000 7f886ea00640 1 -- 172.21.15.99:0/925540952 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8868006e10 con 0x7f887817f490 2024-02-21T23:07:48.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.075+0000 7f8877e00640 1 -- 172.21.15.99:0/925540952 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f887817d880 con 0x7f887817f490 2024-02-21T23:07:48.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.079+0000 7f886ea00640 1 -- 172.21.15.99:0/925540952 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f8868037070 con 0x7f887817f490 2024-02-21T23:07:48.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.080+0000 7f8880820740 1 Processor -- start 2024-02-21T23:07:48.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.080+0000 7f8880820740 1 -- start start 2024-02-21T23:07:48.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.081+0000 7f886ea00640 1 --2- 172.21.15.99:0/925540952 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f885809eed0 0x7f88580a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:48.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.081+0000 7f886ea00640 1 -- 172.21.15.99:0/925540952 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f88680ebf00 con 0x7f887817f490 2024-02-21T23:07:48.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.081+0000 7f8877400640 1 --2- 172.21.15.99:0/925540952 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f885809eed0 0x7f88580a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:48.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.082+0000 7f8880820740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56411dcc9660 0x56411dcc9a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:48.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.082+0000 7f8880820740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56411dd04330 0x56411dd047b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:48.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.082+0000 7f8880820740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56411dd04cf0 0x56411dd05560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:48.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.082+0000 7f8880820740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x56411dbf1b50 con 0x56411dcc9660 2024-02-21T23:07:48.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.082+0000 7f8880820740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x56411db9ada0 con 0x56411dd04330 2024-02-21T23:07:48.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.082+0000 7f8880820740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x56411dbedbf0 con 0x56411dd04cf0 2024-02-21T23:07:48.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.082+0000 7f8876a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56411dcc9660 0x56411dcc9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:48.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.082+0000 7f8876a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56411dcc9660 0x56411dcc9a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:36782/0 (socket says 172.21.15.99:36782) 2024-02-21T23:07:48.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.082+0000 7f8876a00640 1 -- 172.21.15.99:0/2585639247 learned_addr learned my addr 172.21.15.99:0/2585639247 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:07:48.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.082+0000 7f8876000640 1 --2- 172.21.15.99:0/2585639247 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56411dd04330 0x56411dd047b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:48.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.082+0000 7f8877400640 1 --2- 172.21.15.99:0/2585639247 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56411dd04cf0 0x56411dd05560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:48.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.082+0000 7f8876a00640 1 -- 172.21.15.99:0/2585639247 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56411dd04cf0 msgr2=0x56411dd05560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:48.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.082+0000 7f8876a00640 1 --2- 172.21.15.99:0/2585639247 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56411dd04cf0 0x56411dd05560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:48.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.082+0000 7f8876a00640 1 -- 172.21.15.99:0/2585639247 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56411dd04330 msgr2=0x56411dd047b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:48.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.082+0000 7f8876a00640 1 --2- 172.21.15.99:0/2585639247 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56411dd04330 0x56411dd047b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:48.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.082+0000 7f8877400640 1 --2- 172.21.15.99:0/925540952 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f885809eed0 0x7f88580a1390 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8870001560 tx=0x7f8870009040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:48.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.082+0000 7f8876a00640 1 -- 172.21.15.99:0/2585639247 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56411dbbdf80 con 0x56411dcc9660 2024-02-21T23:07:48.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.083+0000 7f8876a00640 1 --2- 172.21.15.99:0/2585639247 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56411dcc9660 0x56411dcc9a40 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f88680b5ac0 tx=0x7f88680b9110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1c2c1420b346d33 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:48.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.083+0000 7f8863400640 1 -- 172.21.15.99:0/2585639247 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88680b96f0 con 0x56411dcc9660 2024-02-21T23:07:48.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.083+0000 7f8863400640 1 -- 172.21.15.99:0/2585639247 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88680bd840 con 0x56411dcc9660 2024-02-21T23:07:48.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.083+0000 7f8863400640 1 -- 172.21.15.99:0/2585639247 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88680c1e90 con 0x56411dcc9660 2024-02-21T23:07:48.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.084+0000 7f8880820740 1 -- 172.21.15.99:0/2585639247 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56411dcc9660 msgr2=0x56411dcc9a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:48.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.084+0000 7f8880820740 1 --2- 172.21.15.99:0/2585639247 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56411dcc9660 0x56411dcc9a40 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f88680b5ac0 tx=0x7f88680b9110 comp rx=0 tx=0).stop 2024-02-21T23:07:48.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.084+0000 7f8880820740 1 -- 172.21.15.99:0/2585639247 shutdown_connections 2024-02-21T23:07:48.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.084+0000 7f8880820740 1 --2- 172.21.15.99:0/2585639247 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56411dd04cf0 0x56411dd05560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:48.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.084+0000 7f8880820740 1 --2- 172.21.15.99:0/2585639247 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56411dd04330 0x56411dd047b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:48.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.084+0000 7f8880820740 1 --2- 172.21.15.99:0/2585639247 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56411dcc9660 0x56411dcc9a40 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:48.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.084+0000 7f8880820740 1 -- 172.21.15.99:0/2585639247 >> 172.21.15.99:0/2585639247 conn(0x56411dc8b6d0 msgr2=0x56411dc8c750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:07:48.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.084+0000 7f8880820740 1 -- 172.21.15.99:0/2585639247 shutdown_connections 2024-02-21T23:07:48.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.084+0000 7f8880820740 1 -- 172.21.15.99:0/2585639247 wait complete. 2024-02-21T23:07:48.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.085+0000 7f8880820740 1 -- start start 2024-02-21T23:07:48.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.086+0000 7f8880820740 1 Processor -- start 2024-02-21T23:07:48.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.088+0000 7f8880820740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56411dd04330 0x56411dd00930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:48.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.088+0000 7f8880820740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56411dd04cf0 0x56411dcbacb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:48.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.088+0000 7f8880820740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56411dcffe80 0x56411dcb8280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:48.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.088+0000 7f8880820740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x56411dd030a0 con 0x56411dd04cf0 2024-02-21T23:07:48.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.088+0000 7f8880820740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x56411db90380 con 0x56411dcffe80 2024-02-21T23:07:48.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.088+0000 7f8880820740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x56411dd02dc0 con 0x56411dd04330 2024-02-21T23:07:48.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.088+0000 7f8880820740 10 client.0 _ll_register_callbacks cb 0x56411dbe9280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:07:48.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.088+0000 7f8876a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56411dd04330 0x56411dd00930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:48.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.088+0000 7f8876a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56411dd04330 0x56411dd00930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:59250/0 (socket says 172.21.15.99:59250) 2024-02-21T23:07:48.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.088+0000 7f8876a00640 1 -- 172.21.15.99:0/3227962085 learned_addr learned my addr 172.21.15.99:0/3227962085 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:07:48.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.088+0000 7f8876000640 1 --2- 172.21.15.99:0/3227962085 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56411dd04cf0 0x56411dcbacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:48.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.088+0000 7f8877400640 1 --2- 172.21.15.99:0/3227962085 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56411dcffe80 0x56411dcb8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:48.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.089+0000 7f8876a00640 1 -- 172.21.15.99:0/3227962085 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56411dcffe80 msgr2=0x56411dcb8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:48.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.089+0000 7f8876a00640 1 --2- 172.21.15.99:0/3227962085 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56411dcffe80 0x56411dcb8280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:48.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.089+0000 7f8876a00640 1 -- 172.21.15.99:0/3227962085 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56411dd04cf0 msgr2=0x56411dcbacb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:48.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.089+0000 7f8876a00640 1 --2- 172.21.15.99:0/3227962085 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56411dd04cf0 0x56411dcbacb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:48.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.089+0000 7f8876a00640 1 -- 172.21.15.99:0/3227962085 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56411dbb8c20 con 0x56411dd04330 2024-02-21T23:07:48.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.089+0000 7f8876a00640 1 --2- 172.21.15.99:0/3227962085 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56411dd04330 0x56411dd00930 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f886802bef0 tx=0x7f886802be80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61c3b9b36a9d3b9 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:48.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.089+0000 7f8857e00640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-02-21T23:07:48.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.089+0000 7f8857e00640 1 -- 172.21.15.99:0/3227962085 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88680d6060 con 0x56411dd04330 2024-02-21T23:07:48.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.089+0000 7f8857e00640 1 -- 172.21.15.99:0/3227962085 <== mon.2 v2:172.21.15.181:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f88680c1a00 con 0x56411dd04330 2024-02-21T23:07:48.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.089+0000 7f8880820740 1 -- 172.21.15.99:0/3227962085 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f88680bd840 con 0x56411dd04330 2024-02-21T23:07:48.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.089+0000 7f8857e00640 1 -- 172.21.15.99:0/3227962085 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f88680c1e90 con 0x56411dd04330 2024-02-21T23:07:48.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.089+0000 7f8880820740 10 client.6335 fetch_fsmap learned FSMap version 17 2024-02-21T23:07:48.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.090+0000 7f8880820740 1 -- 172.21.15.99:0/3227962085 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x56411d9063f0 con 0x56411dd04330 2024-02-21T23:07:48.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.090+0000 7f8857e00640 1 -- 172.21.15.99:0/3227962085 <== mon.2 v2:172.21.15.181:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88680bd840 con 0x56411dd04330 2024-02-21T23:07:48.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.090+0000 7f8857e00640 1 -- 172.21.15.99:0/3227962085 <== mon.2 v2:172.21.15.181:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f8868041070 con 0x56411dd04330 2024-02-21T23:07:48.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.090+0000 7f8880820740 10 client.6335 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:07:48.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.090+0000 7f8880820740 10 client.6335 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2024-02-21T23:07:48.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.090+0000 7f8880820740 20 client.6335 populate_metadata read hostname 'smithi099' 2024-02-21T23:07:48.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.090+0000 7f8880820740 1 --2- 172.21.15.99:0/3227962085 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x56411dc87830 0x56411dcbb400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:48.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.090+0000 7f8880820740 4 client.6335 mds_command: new command op to 4352 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:07:48.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.090+0000 7f8880820740 1 -- 172.21.15.99:0/3227962085 --> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56411dbff090 con 0x56411dc87830 2024-02-21T23:07:48.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.090+0000 7f8876000640 1 --2- 172.21.15.99:0/3227962085 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x56411dc87830 0x56411dcbb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:48.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.091+0000 7f8876000640 1 --2- 172.21.15.99:0/3227962085 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x56411dc87830 0x56411dcbb400 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=facd377602b73d81 server_cookie=90504d83cee353bb in_seq=0 out_seq=0 2024-02-21T23:07:48.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.091+0000 7f8857e00640 10 client.6335 ms_handle_connect on v2:172.21.15.99:6836/1676159950 2024-02-21T23:07:48.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.092+0000 7f8857e00640 1 -- 172.21.15.99:0/3227962085 <== mds.1 v2:172.21.15.99:6836/1676159950 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x56411dbff090 con 0x56411dc87830 2024-02-21T23:07:48.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.092+0000 7f8857e00640 10 client.6335 handle_command_reply: tid=0 2024-02-21T23:07:48.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.092+0000 7f8880820740 1 client.6335 shutdown 2024-02-21T23:07:48.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.092+0000 7f8880820740 1 -- 172.21.15.99:0/3227962085 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56411dd04330 msgr2=0x56411dd00930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:48.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.092+0000 7f8880820740 1 --2- 172.21.15.99:0/3227962085 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56411dd04330 0x56411dd00930 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f886802bef0 tx=0x7f886802be80 comp rx=0 tx=0).stop 2024-02-21T23:07:48.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.092+0000 7f8880820740 1 -- 172.21.15.99:0/3227962085 shutdown_connections 2024-02-21T23:07:48.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.092+0000 7f8880820740 1 --2- 172.21.15.99:0/3227962085 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x56411dc87830 0x56411dcbb400 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:48.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.092+0000 7f8857e00640 0 client.6335 ms_handle_reset on v2:172.21.15.99:6836/1676159950 2024-02-21T23:07:48.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.092+0000 7f8880820740 1 --2- 172.21.15.99:0/3227962085 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56411dcffe80 0x56411dcb8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:48.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.092+0000 7f8880820740 1 --2- 172.21.15.99:0/3227962085 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56411dd04cf0 0x56411dcbacb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:48.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.092+0000 7f8880820740 1 --2- 172.21.15.99:0/3227962085 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56411dd04330 0x56411dd00930 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:48.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.093+0000 7f8880820740 1 -- 172.21.15.99:0/3227962085 >> 172.21.15.99:0/3227962085 conn(0x56411dcc9660 msgr2=0x56411dd037b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:07:48.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.093+0000 7f8880820740 1 -- 172.21.15.99:0/3227962085 shutdown_connections 2024-02-21T23:07:48.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.093+0000 7f8880820740 1 -- 172.21.15.99:0/3227962085 wait complete. 2024-02-21T23:07:48.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.093+0000 7f8880820740 20 client.6335 trim_cache size 0 max 16384 2024-02-21T23:07:48.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.120+0000 7f8880820740 1 Processor -- start 2024-02-21T23:07:48.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.120+0000 7f8880820740 1 -- start start 2024-02-21T23:07:48.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.122+0000 7f8880820740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56411dcffe80 0x56411dccd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:48.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.122+0000 7f8880820740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56411dd04330 0x56411dcb9e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:48.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.122+0000 7f8880820740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56411dd04cf0 0x56411dd63cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:48.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.122+0000 7f8880820740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f887822c7a0 con 0x56411dd04cf0 2024-02-21T23:07:48.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.122+0000 7f8880820740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f887822a340 con 0x56411dcffe80 2024-02-21T23:07:48.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.122+0000 7f8880820740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88782284a0 con 0x56411dd04330 2024-02-21T23:07:48.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.122+0000 7f8877400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56411dd04cf0 0x56411dd63cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:48.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.122+0000 7f8877400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56411dd04cf0 0x56411dd63cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:36804/0 (socket says 172.21.15.99:36804) 2024-02-21T23:07:48.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.122+0000 7f8877400640 1 -- 172.21.15.99:0/4253175074 learned_addr learned my addr 172.21.15.99:0/4253175074 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:07:48.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.123+0000 7f8876000640 1 --2- 172.21.15.99:0/4253175074 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56411dd04330 0x56411dcb9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:48.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.123+0000 7f8876a00640 1 --2- 172.21.15.99:0/4253175074 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56411dcffe80 0x56411dccd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:48.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.123+0000 7f8877400640 1 -- 172.21.15.99:0/4253175074 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56411dd04330 msgr2=0x56411dcb9e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:48.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.123+0000 7f8877400640 1 --2- 172.21.15.99:0/4253175074 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56411dd04330 0x56411dcb9e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:48.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.123+0000 7f8877400640 1 -- 172.21.15.99:0/4253175074 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56411dcffe80 msgr2=0x56411dccd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:48.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.123+0000 7f8877400640 1 --2- 172.21.15.99:0/4253175074 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56411dcffe80 0x56411dccd010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:48.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.123+0000 7f8877400640 1 -- 172.21.15.99:0/4253175074 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56411d9d07d0 con 0x56411dd04cf0 2024-02-21T23:07:48.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.123+0000 7f8876a00640 1 --2- 172.21.15.99:0/4253175074 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56411dcffe80 0x56411dccd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:07:48.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.123+0000 7f8877400640 1 --2- 172.21.15.99:0/4253175074 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56411dd04cf0 0x56411dd63cb0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f8870003d20 tx=0x7f8870014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f0e5b1252c12c5b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:48.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.124+0000 7f8862a00640 1 -- 172.21.15.99:0/4253175074 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f887001a040 con 0x56411dd04cf0 2024-02-21T23:07:48.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.124+0000 7f8862a00640 1 -- 172.21.15.99:0/4253175074 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8870003e10 con 0x56411dd04cf0 2024-02-21T23:07:48.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.124+0000 7f8862a00640 1 -- 172.21.15.99:0/4253175074 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88700055d0 con 0x56411dd04cf0 2024-02-21T23:07:48.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.124+0000 7f8880820740 1 -- 172.21.15.99:0/4253175074 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56411dd04cf0 msgr2=0x56411dd63cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:48.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.124+0000 7f8880820740 1 --2- 172.21.15.99:0/4253175074 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56411dd04cf0 0x56411dd63cb0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f8870003d20 tx=0x7f8870014000 comp rx=0 tx=0).stop 2024-02-21T23:07:48.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.124+0000 7f8880820740 1 -- 172.21.15.99:0/4253175074 shutdown_connections 2024-02-21T23:07:48.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.124+0000 7f8880820740 1 --2- 172.21.15.99:0/4253175074 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56411dd04cf0 0x56411dd63cb0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:48.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.124+0000 7f8880820740 1 --2- 172.21.15.99:0/4253175074 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56411dd04330 0x56411dcb9e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:48.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.124+0000 7f8880820740 1 --2- 172.21.15.99:0/4253175074 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56411dcffe80 0x56411dccd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:48.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.124+0000 7f8880820740 1 -- 172.21.15.99:0/4253175074 >> 172.21.15.99:0/4253175074 conn(0x56411dcc9660 msgr2=0x56411dc93190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:07:48.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.124+0000 7f8880820740 1 -- 172.21.15.99:0/4253175074 shutdown_connections 2024-02-21T23:07:48.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.124+0000 7f8880820740 1 -- 172.21.15.99:0/4253175074 wait complete. 2024-02-21T23:07:48.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.125+0000 7f8880820740 1 -- start start 2024-02-21T23:07:48.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.125+0000 7f8880820740 1 Processor -- start 2024-02-21T23:07:48.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.127+0000 7f8880820740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56411dcffe80 0x56411dd705d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:48.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.127+0000 7f8880820740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56411dd04330 0x56411dd60fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:48.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.127+0000 7f8880820740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56411dd04cf0 0x56411dccba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:48.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.127+0000 7f8880820740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8878228aa0 con 0x56411dd04cf0 2024-02-21T23:07:48.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.127+0000 7f8880820740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8878229ce0 con 0x56411dd04330 2024-02-21T23:07:48.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.127+0000 7f8880820740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88782290a0 con 0x56411dcffe80 2024-02-21T23:07:48.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.127+0000 7f8880820740 10 client.0 _ll_register_callbacks cb 0x7f88640012d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:07:48.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.127+0000 7f8877400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56411dd04cf0 0x56411dccba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:48.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.127+0000 7f8876a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56411dcffe80 0x56411dd705d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:48.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.127+0000 7f8877400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56411dd04cf0 0x56411dccba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:36816/0 (socket says 172.21.15.99:36816) 2024-02-21T23:07:48.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.127+0000 7f8877400640 1 -- 172.21.15.99:0/2355385224 learned_addr learned my addr 172.21.15.99:0/2355385224 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:07:48.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.127+0000 7f8876000640 1 --2- 172.21.15.99:0/2355385224 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56411dd04330 0x56411dd60fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:48.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.128+0000 7f8876a00640 1 -- 172.21.15.99:0/2355385224 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56411dd04330 msgr2=0x56411dd60fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:48.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.128+0000 7f8876a00640 1 --2- 172.21.15.99:0/2355385224 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56411dd04330 0x56411dd60fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:48.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.128+0000 7f8876a00640 1 -- 172.21.15.99:0/2355385224 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56411dd04cf0 msgr2=0x56411dccba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:48.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.128+0000 7f8876a00640 1 --2- 172.21.15.99:0/2355385224 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56411dd04cf0 0x56411dccba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:48.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.128+0000 7f8876a00640 1 -- 172.21.15.99:0/2355385224 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56411dcd7c00 con 0x56411dcffe80 2024-02-21T23:07:48.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.128+0000 7f8877400640 1 --2- 172.21.15.99:0/2355385224 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56411dd04cf0 0x56411dccba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:07:48.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.128+0000 7f8876a00640 1 --2- 172.21.15.99:0/2355385224 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56411dcffe80 0x56411dd705d0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f88680b9680 tx=0x7f88680b5a30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e163a149227f6c6 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:48.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.128+0000 7f8857e00640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-02-21T23:07:48.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.128+0000 7f8857e00640 1 -- 172.21.15.99:0/2355385224 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88680d6070 con 0x56411dcffe80 2024-02-21T23:07:48.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.128+0000 7f8857e00640 1 -- 172.21.15.99:0/2355385224 <== mon.2 v2:172.21.15.181:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f88680c1a00 con 0x56411dcffe80 2024-02-21T23:07:48.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.128+0000 7f8880820740 1 -- 172.21.15.99:0/2355385224 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8870003e10 con 0x56411dcffe80 2024-02-21T23:07:48.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.128+0000 7f8857e00640 1 -- 172.21.15.99:0/2355385224 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f88680b9740 con 0x56411dcffe80 2024-02-21T23:07:48.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.128+0000 7f8880820740 10 client.6341 fetch_fsmap learned FSMap version 17 2024-02-21T23:07:48.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.128+0000 7f8880820740 1 -- 172.21.15.99:0/2355385224 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x56411dd1f780 con 0x56411dcffe80 2024-02-21T23:07:48.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.129+0000 7f8857e00640 1 -- 172.21.15.99:0/2355385224 <== mon.2 v2:172.21.15.181:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8870003e10 con 0x56411dcffe80 2024-02-21T23:07:48.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.129+0000 7f8857e00640 1 -- 172.21.15.99:0/2355385224 <== mon.2 v2:172.21.15.181:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f8868041040 con 0x56411dcffe80 2024-02-21T23:07:48.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.129+0000 7f8880820740 10 client.6341 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:07:48.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.129+0000 7f8880820740 10 client.6341 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2024-02-21T23:07:48.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.129+0000 7f8880820740 20 client.6341 populate_metadata read hostname 'smithi099' 2024-02-21T23:07:48.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.129+0000 7f8880820740 1 --2- 172.21.15.99:0/2355385224 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x56411dcd7780 0x56411dccbf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:48.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.129+0000 7f8880820740 4 client.6341 mds_command: new command op to 4352 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T23:07:48.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.129+0000 7f8880820740 1 -- 172.21.15.99:0/2355385224 --> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56411dc8be30 con 0x56411dcd7780 2024-02-21T23:07:48.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.129+0000 7f8876000640 1 --2- 172.21.15.99:0/2355385224 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x56411dcd7780 0x56411dccbf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:48.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.130+0000 7f8876000640 1 --2- 172.21.15.99:0/2355385224 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x56411dcd7780 0x56411dccbf90 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=627e11497b4b4905 server_cookie=f11091aa2957e28c in_seq=0 out_seq=0 2024-02-21T23:07:48.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.130+0000 7f8857e00640 10 client.6341 ms_handle_connect on v2:172.21.15.99:6836/1676159950 2024-02-21T23:07:48.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.130+0000 7f8857e00640 1 -- 172.21.15.99:0/2355385224 <== mds.1 v2:172.21.15.99:6836/1676159950 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56411dc8be30 con 0x56411dcd7780 2024-02-21T23:07:48.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.130+0000 7f8857e00640 10 client.6341 handle_command_reply: tid=0 2024-02-21T23:07:48.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.130+0000 7f8880820740 1 client.6341 shutdown 2024-02-21T23:07:48.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.130+0000 7f8880820740 1 -- 172.21.15.99:0/2355385224 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56411dcffe80 msgr2=0x56411dd705d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:48.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.130+0000 7f8880820740 1 --2- 172.21.15.99:0/2355385224 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56411dcffe80 0x56411dd705d0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f88680b9680 tx=0x7f88680b5a30 comp rx=0 tx=0).stop 2024-02-21T23:07:48.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.130+0000 7f8880820740 1 -- 172.21.15.99:0/2355385224 shutdown_connections 2024-02-21T23:07:48.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.131+0000 7f8880820740 1 --2- 172.21.15.99:0/2355385224 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x56411dcd7780 0x56411dccbf90 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:48.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.131+0000 7f8880820740 1 --2- 172.21.15.99:0/2355385224 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56411dd04cf0 0x56411dccba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:48.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.131+0000 7f8880820740 1 --2- 172.21.15.99:0/2355385224 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56411dd04330 0x56411dd60fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:48.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.131+0000 7f8880820740 1 --2- 172.21.15.99:0/2355385224 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56411dcffe80 0x56411dd705d0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:48.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.131+0000 7f8880820740 1 -- 172.21.15.99:0/2355385224 >> 172.21.15.99:0/2355385224 conn(0x56411dcc9660 msgr2=0x56411dc93b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:07:48.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.131+0000 7f8857e00640 0 client.6341 ms_handle_reset on v2:172.21.15.99:6836/1676159950 2024-02-21T23:07:48.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.131+0000 7f8880820740 1 -- 172.21.15.99:0/2355385224 shutdown_connections 2024-02-21T23:07:48.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.131+0000 7f8880820740 1 -- 172.21.15.99:0/2355385224 wait complete. 2024-02-21T23:07:48.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.131+0000 7f8880820740 20 client.6341 trim_cache size 0 max 16384 2024-02-21T23:07:48.126 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-02-21T23:07:48.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.132+0000 7f8877e00640 1 -- 172.21.15.99:0/925540952 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f885809eed0 msgr2=0x7f88580a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:48.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.132+0000 7f8877e00640 1 --2- 172.21.15.99:0/925540952 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f885809eed0 0x7f88580a1390 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8870001560 tx=0x7f8870009040 comp rx=0 tx=0).stop 2024-02-21T23:07:48.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.132+0000 7f8877e00640 1 -- 172.21.15.99:0/925540952 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f887817f490 msgr2=0x7f887815c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:48.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.132+0000 7f8877e00640 1 --2- 172.21.15.99:0/925540952 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f887817f490 0x7f887815c480 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f886802bf70 tx=0x7f88680046c0 comp rx=0 tx=0).stop 2024-02-21T23:07:48.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.132+0000 7f8877e00640 1 -- 172.21.15.99:0/925540952 shutdown_connections 2024-02-21T23:07:48.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.132+0000 7f8877e00640 1 --2- 172.21.15.99:0/925540952 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f885809eed0 0x7f88580a1390 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:48.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.132+0000 7f8877e00640 1 --2- 172.21.15.99:0/925540952 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f887818b4f0 0x7f887817e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:48.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.132+0000 7f8877e00640 1 --2- 172.21.15.99:0/925540952 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f887818b060 0x7f88780fc4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:48.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.132+0000 7f8877e00640 1 --2- 172.21.15.99:0/925540952 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f887817f490 0x7f887815c480 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:48.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.132+0000 7f8877e00640 1 -- 172.21.15.99:0/925540952 >> 172.21.15.99:0/925540952 conn(0x7f88780d29b0 msgr2=0x7f88780d2e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:07:48.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.132+0000 7f8877e00640 1 -- 172.21.15.99:0/925540952 shutdown_connections 2024-02-21T23:07:48.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.132+0000 7f8877e00640 1 -- 172.21.15.99:0/925540952 wait complete. 2024-02-21T23:07:48.141 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T23:07:48.142 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-02-21T23:07:48.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.393+0000 7f2216400640 1 Processor -- start 2024-02-21T23:07:48.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.394+0000 7f2216400640 1 -- start start 2024-02-21T23:07:48.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.396+0000 7f2216400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f221017f490 0x7f221018ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:48.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.396+0000 7f2216400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f221018b060 0x7f2210188a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:48.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.396+0000 7f2216400640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f221018b4f0 0x7f2210188f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:48.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.396+0000 7f2216400640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22100d6dd0 con 0x7f221017f490 2024-02-21T23:07:48.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.396+0000 7f2216400640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22101614c0 con 0x7f221018b060 2024-02-21T23:07:48.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.396+0000 7f2216400640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22100d6810 con 0x7f221018b4f0 2024-02-21T23:07:48.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.397+0000 7f2215000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f221017f490 0x7f221018ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:48.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.397+0000 7f220fe00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f221018b060 0x7f2210188a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:48.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.397+0000 7f2215a00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f221018b4f0 0x7f2210188f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:48.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.397+0000 7f2215000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f221017f490 0x7f221018ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:36828/0 (socket says 172.21.15.99:36828) 2024-02-21T23:07:48.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.397+0000 7f2215000640 1 -- 172.21.15.99:0/1888085912 learned_addr learned my addr 172.21.15.99:0/1888085912 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:07:48.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.397+0000 7f220fe00640 1 --2- 172.21.15.99:0/1888085912 >> v2:172.21.15.162:3300/0 conn(0x7f221018b060 0x7f2210188a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:36980/0 (socket says 172.21.15.99:36980) 2024-02-21T23:07:48.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.397+0000 7f2215000640 1 -- 172.21.15.99:0/1888085912 >> v2:172.21.15.181:3300/0 conn(0x7f221018b4f0 msgr2=0x7f2210188f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:48.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.397+0000 7f2215000640 1 --2- 172.21.15.99:0/1888085912 >> v2:172.21.15.181:3300/0 conn(0x7f221018b4f0 0x7f2210188f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:48.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.397+0000 7f2215000640 1 -- 172.21.15.99:0/1888085912 >> v2:172.21.15.162:3300/0 conn(0x7f221018b060 msgr2=0x7f2210188a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:48.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.397+0000 7f2215000640 1 --2- 172.21.15.99:0/1888085912 >> v2:172.21.15.162:3300/0 conn(0x7f221018b060 0x7f2210188a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:48.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.397+0000 7f2215000640 1 -- 172.21.15.99:0/1888085912 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22100d6af0 con 0x7f221017f490 2024-02-21T23:07:48.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.397+0000 7f220fe00640 1 --2- 172.21.15.99:0/1888085912 >> v2:172.21.15.162:3300/0 conn(0x7f221018b060 0x7f2210188a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:07:48.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.399+0000 7f2215000640 1 --2- 172.21.15.99:0/1888085912 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f221017f490 0x7f221018ab20 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f2210186880 tx=0x7f220402b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8707224baf0807 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:48.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.399+0000 7f220f400640 1 -- 172.21.15.99:0/1888085912 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2204034070 con 0x7f221017f490 2024-02-21T23:07:48.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.399+0000 7f220f400640 1 -- 172.21.15.99:0/1888085912 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2204030800 con 0x7f221017f490 2024-02-21T23:07:48.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.400+0000 7f220f400640 1 -- 172.21.15.99:0/1888085912 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2204030bd0 con 0x7f221017f490 2024-02-21T23:07:48.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.400+0000 7f2216400640 1 -- 172.21.15.99:0/1888085912 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f221017f490 msgr2=0x7f221018ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:48.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.400+0000 7f2216400640 1 --2- 172.21.15.99:0/1888085912 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f221017f490 0x7f221018ab20 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f2210186880 tx=0x7f220402b940 comp rx=0 tx=0).stop 2024-02-21T23:07:48.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.400+0000 7f2216400640 1 -- 172.21.15.99:0/1888085912 shutdown_connections 2024-02-21T23:07:48.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.400+0000 7f2216400640 1 --2- 172.21.15.99:0/1888085912 >> v2:172.21.15.181:3300/0 conn(0x7f221018b4f0 0x7f2210188f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:48.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.400+0000 7f2216400640 1 --2- 172.21.15.99:0/1888085912 >> v2:172.21.15.162:3300/0 conn(0x7f221018b060 0x7f2210188a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:48.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.400+0000 7f2216400640 1 --2- 172.21.15.99:0/1888085912 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f221017f490 0x7f221018ab20 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:48.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.400+0000 7f2216400640 1 -- 172.21.15.99:0/1888085912 >> 172.21.15.99:0/1888085912 conn(0x7f22100d29b0 msgr2=0x7f22100d2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:07:48.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.401+0000 7f2216400640 1 -- 172.21.15.99:0/1888085912 shutdown_connections 2024-02-21T23:07:48.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.401+0000 7f2216400640 1 -- 172.21.15.99:0/1888085912 wait complete. 2024-02-21T23:07:48.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.403+0000 7f2216400640 1 Processor -- start 2024-02-21T23:07:48.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.403+0000 7f2216400640 1 -- start start 2024-02-21T23:07:48.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.404+0000 7f2216400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f221017f490 0x7f221006aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:48.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.404+0000 7f2216400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f221018b060 0x7f221015bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:48.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.404+0000 7f2216400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f221018b4f0 0x7f2210179790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:48.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.404+0000 7f2216400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f221018a600 con 0x7f221017f490 2024-02-21T23:07:48.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.404+0000 7f2216400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f221018a320 con 0x7f221018b4f0 2024-02-21T23:07:48.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.404+0000 7f2216400640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f221017f870 con 0x7f221018b060 2024-02-21T23:07:48.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.404+0000 7f2215000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f221017f490 0x7f221006aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:48.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.404+0000 7f2215000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f221017f490 0x7f221006aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:36838/0 (socket says 172.21.15.99:36838) 2024-02-21T23:07:48.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.404+0000 7f2215000640 1 -- 172.21.15.99:0/767623421 learned_addr learned my addr 172.21.15.99:0/767623421 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:07:48.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.405+0000 7f220fe00640 1 --2- 172.21.15.99:0/767623421 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f221018b060 0x7f221015bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:48.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.405+0000 7f2215a00640 1 --2- 172.21.15.99:0/767623421 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f221018b4f0 0x7f2210179790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:48.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.405+0000 7f2215000640 1 -- 172.21.15.99:0/767623421 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f221018b060 msgr2=0x7f221015bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:48.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.405+0000 7f2215000640 1 --2- 172.21.15.99:0/767623421 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f221018b060 0x7f221015bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:48.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.405+0000 7f2215000640 1 -- 172.21.15.99:0/767623421 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f221018b4f0 msgr2=0x7f2210179790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:48.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.405+0000 7f2215000640 1 --2- 172.21.15.99:0/767623421 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f221018b4f0 0x7f2210179790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:48.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.405+0000 7f2215000640 1 -- 172.21.15.99:0/767623421 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f221006b790 con 0x7f221017f490 2024-02-21T23:07:48.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.405+0000 7f2215000640 1 --2- 172.21.15.99:0/767623421 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f221017f490 0x7f221006aef0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f220402b980 tx=0x7f22040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:48.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.406+0000 7f220cc00640 1 -- 172.21.15.99:0/767623421 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2204034040 con 0x7f221017f490 2024-02-21T23:07:48.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.406+0000 7f220cc00640 1 -- 172.21.15.99:0/767623421 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2204039cb0 con 0x7f221017f490 2024-02-21T23:07:48.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.406+0000 7f2216400640 1 -- 172.21.15.99:0/767623421 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f221006ba70 con 0x7f221017f490 2024-02-21T23:07:48.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.406+0000 7f220cc00640 1 -- 172.21.15.99:0/767623421 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2204039e60 con 0x7f221017f490 2024-02-21T23:07:48.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.406+0000 7f2216400640 1 -- 172.21.15.99:0/767623421 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f221006c030 con 0x7f221017f490 2024-02-21T23:07:48.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.410+0000 7f220cc00640 1 -- 172.21.15.99:0/767623421 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f220404a060 con 0x7f221017f490 2024-02-21T23:07:48.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.410+0000 7f221a81b740 1 Processor -- start 2024-02-21T23:07:48.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.410+0000 7f221a81b740 1 -- start start 2024-02-21T23:07:48.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.411+0000 7f221a81b740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56095d1a6660 0x56095d1a6a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:48.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.411+0000 7f221a81b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56095d1e1330 0x56095d1e17b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:48.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.411+0000 7f221a81b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56095d1e1cf0 0x56095d1e2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:48.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.411+0000 7f221a81b740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x56095d0ceb50 con 0x56095d1a6660 2024-02-21T23:07:48.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.411+0000 7f221a81b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x56095d077da0 con 0x56095d1e1cf0 2024-02-21T23:07:48.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.411+0000 7f221a81b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x56095d0cabf0 con 0x56095d1e1330 2024-02-21T23:07:48.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.412+0000 7f2215a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56095d1a6660 0x56095d1a6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:48.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.412+0000 7f2215a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56095d1a6660 0x56095d1a6a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:36848/0 (socket says 172.21.15.99:36848) 2024-02-21T23:07:48.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.412+0000 7f2215a00640 1 -- 172.21.15.99:0/3433134454 learned_addr learned my addr 172.21.15.99:0/3433134454 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:07:48.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.412+0000 7f2215000640 1 --2- 172.21.15.99:0/3433134454 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56095d1e1330 0x56095d1e17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:48.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.412+0000 7f220fe00640 1 --2- 172.21.15.99:0/3433134454 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56095d1e1cf0 0x56095d1e2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:48.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.412+0000 7f220cc00640 1 --2- 172.21.15.99:0/767623421 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f21f009eed0 0x7f21f00a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:48.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.412+0000 7f2215a00640 1 -- 172.21.15.99:0/3433134454 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56095d1e1330 msgr2=0x56095d1e17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:48.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.412+0000 7f2215a00640 1 --2- 172.21.15.99:0/3433134454 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56095d1e1330 0x56095d1e17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:48.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.412+0000 7f2215a00640 1 -- 172.21.15.99:0/3433134454 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56095d1e1cf0 msgr2=0x56095d1e2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:48.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.412+0000 7f2215a00640 1 --2- 172.21.15.99:0/3433134454 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56095d1e1cf0 0x56095d1e2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:48.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.412+0000 7f2215a00640 1 -- 172.21.15.99:0/3433134454 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56095d09af80 con 0x56095d1a6660 2024-02-21T23:07:48.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.412+0000 7f220cc00640 1 -- 172.21.15.99:0/767623421 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f22040ebce0 con 0x7f221017f490 2024-02-21T23:07:48.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.413+0000 7f2215a00640 1 --2- 172.21.15.99:0/767623421 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f21f009eed0 0x7f21f00a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:48.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.413+0000 7f2215a00640 1 --2- 172.21.15.99:0/3433134454 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56095d1a6660 0x56095d1a6a40 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f22080115e0 tx=0x7f2208009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c640315627d437d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:48.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.413+0000 7f2201600640 1 -- 172.21.15.99:0/3433134454 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2208015a00 con 0x56095d1a6660 2024-02-21T23:07:48.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.413+0000 7f2201600640 1 -- 172.21.15.99:0/3433134454 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2208015ba0 con 0x56095d1a6660 2024-02-21T23:07:48.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.413+0000 7f2201600640 1 -- 172.21.15.99:0/3433134454 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f220801f480 con 0x56095d1a6660 2024-02-21T23:07:48.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.414+0000 7f221a81b740 1 -- 172.21.15.99:0/3433134454 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56095d1a6660 msgr2=0x56095d1a6a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:48.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.414+0000 7f2215a00640 1 --2- 172.21.15.99:0/767623421 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f21f009eed0 0x7f21f00a1390 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2208015fd0 tx=0x7f220801b000 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:48.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.414+0000 7f221a81b740 1 --2- 172.21.15.99:0/3433134454 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56095d1a6660 0x56095d1a6a40 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f22080115e0 tx=0x7f2208009750 comp rx=0 tx=0).stop 2024-02-21T23:07:48.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.414+0000 7f221a81b740 1 -- 172.21.15.99:0/3433134454 shutdown_connections 2024-02-21T23:07:48.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.414+0000 7f221a81b740 1 --2- 172.21.15.99:0/3433134454 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56095d1e1cf0 0x56095d1e2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:48.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.414+0000 7f221a81b740 1 --2- 172.21.15.99:0/3433134454 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56095d1e1330 0x56095d1e17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:48.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.414+0000 7f221a81b740 1 --2- 172.21.15.99:0/3433134454 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56095d1a6660 0x56095d1a6a40 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:48.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.414+0000 7f221a81b740 1 -- 172.21.15.99:0/3433134454 >> 172.21.15.99:0/3433134454 conn(0x56095d1686d0 msgr2=0x56095d169750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:07:48.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.414+0000 7f221a81b740 1 -- 172.21.15.99:0/3433134454 shutdown_connections 2024-02-21T23:07:48.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.414+0000 7f221a81b740 1 -- 172.21.15.99:0/3433134454 wait complete. 2024-02-21T23:07:48.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.415+0000 7f221a81b740 1 -- start start 2024-02-21T23:07:48.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.415+0000 7f221a81b740 1 Processor -- start 2024-02-21T23:07:48.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.417+0000 7f221a81b740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56095d1e1330 0x56095d1ad580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:48.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.417+0000 7f221a81b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56095d1e1cf0 0x56095d1aff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:48.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.417+0000 7f221a81b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56095d165f40 0x56095d1666e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:48.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.417+0000 7f221a81b740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x56095d1e00a0 con 0x56095d1e1330 2024-02-21T23:07:48.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.417+0000 7f221a81b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x56095d06d380 con 0x56095d165f40 2024-02-21T23:07:48.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.417+0000 7f221a81b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x56095d1dfdc0 con 0x56095d1e1cf0 2024-02-21T23:07:48.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.417+0000 7f221a81b740 10 client.0 _ll_register_callbacks cb 0x56095d0c6280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:07:48.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.417+0000 7f2215000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56095d1e1330 0x56095d1ad580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:48.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.417+0000 7f2215a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56095d165f40 0x56095d1666e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:48.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.417+0000 7f2215a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56095d165f40 0x56095d1666e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:37006/0 (socket says 172.21.15.99:37006) 2024-02-21T23:07:48.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.417+0000 7f2215000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56095d1e1330 0x56095d1ad580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:36854/0 (socket says 172.21.15.99:36854) 2024-02-21T23:07:48.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.417+0000 7f2215a00640 1 -- 172.21.15.99:0/4170157565 learned_addr learned my addr 172.21.15.99:0/4170157565 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:07:48.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.418+0000 7f2215000640 1 -- 172.21.15.99:0/4170157565 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56095d1e1cf0 msgr2=0x56095d1aff90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T23:07:48.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.418+0000 7f2215000640 1 --2- 172.21.15.99:0/4170157565 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56095d1e1cf0 0x56095d1aff90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:48.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.418+0000 7f2215000640 1 -- 172.21.15.99:0/4170157565 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56095d165f40 msgr2=0x56095d1666e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:48.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.418+0000 7f2215000640 1 --2- 172.21.15.99:0/4170157565 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56095d165f40 0x56095d1666e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:48.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.418+0000 7f2215000640 1 -- 172.21.15.99:0/4170157565 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56095d095c20 con 0x56095d1e1330 2024-02-21T23:07:48.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.418+0000 7f2215000640 1 --2- 172.21.15.99:0/4170157565 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56095d1e1330 0x56095d1ad580 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f22040e9290 tx=0x7f22040094d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb014bef383e4ebe server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:48.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.418+0000 7f21f6000640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:07:48.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.418+0000 7f21f6000640 1 -- 172.21.15.99:0/4170157565 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22040b8fb0 con 0x56095d1e1330 2024-02-21T23:07:48.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.418+0000 7f21f6000640 1 -- 172.21.15.99:0/4170157565 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f22040e9540 con 0x56095d1e1330 2024-02-21T23:07:48.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.418+0000 7f221a81b740 1 -- 172.21.15.99:0/4170157565 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2208015ba0 con 0x56095d1e1330 2024-02-21T23:07:48.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.419+0000 7f21f6000640 1 -- 172.21.15.99:0/4170157565 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f22040b8dd0 con 0x56095d1e1330 2024-02-21T23:07:48.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.419+0000 7f221a81b740 10 client.6222 fetch_fsmap learned FSMap version 17 2024-02-21T23:07:48.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.419+0000 7f221a81b740 1 -- 172.21.15.99:0/4170157565 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x56095cde33f0 con 0x56095d1e1330 2024-02-21T23:07:48.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.419+0000 7f21f6000640 1 -- 172.21.15.99:0/4170157565 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2208015ba0 con 0x56095d1e1330 2024-02-21T23:07:48.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.419+0000 7f21f6000640 1 -- 172.21.15.99:0/4170157565 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f22040c1780 con 0x56095d1e1330 2024-02-21T23:07:48.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.419+0000 7f221a81b740 10 client.6222 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:07:48.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.419+0000 7f221a81b740 10 client.6222 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:07:48.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.419+0000 7f221a81b740 20 client.6222 populate_metadata read hostname 'smithi099' 2024-02-21T23:07:48.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.419+0000 7f221a81b740 1 --2- 172.21.15.99:0/4170157565 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x56095d1a24f0 0x56095d19ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:48.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.419+0000 7f221a81b740 4 client.6222 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:07:48.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.419+0000 7f221a81b740 1 -- 172.21.15.99:0/4170157565 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56095d0dc090 con 0x56095d1a24f0 2024-02-21T23:07:48.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.430+0000 7f220fe00640 1 --2- 172.21.15.99:0/4170157565 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x56095d1a24f0 0x56095d19ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:48.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.430+0000 7f220fe00640 1 --2- 172.21.15.99:0/4170157565 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x56095d1a24f0 0x56095d19ca50 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d002cbd20f1ec68f server_cookie=203139e8fedd5b06 in_seq=0 out_seq=0 2024-02-21T23:07:48.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.430+0000 7f21f6000640 10 client.6222 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:07:48.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.432+0000 7f21f6000640 1 -- 172.21.15.99:0/4170157565 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x56095d0dc090 con 0x56095d1a24f0 2024-02-21T23:07:48.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.432+0000 7f21f6000640 10 client.6222 handle_command_reply: tid=0 2024-02-21T23:07:48.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.432+0000 7f221a81b740 1 client.6222 shutdown 2024-02-21T23:07:48.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.432+0000 7f221a81b740 1 -- 172.21.15.99:0/4170157565 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56095d1e1330 msgr2=0x56095d1ad580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:48.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.432+0000 7f221a81b740 1 --2- 172.21.15.99:0/4170157565 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56095d1e1330 0x56095d1ad580 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f22040e9290 tx=0x7f22040094d0 comp rx=0 tx=0).stop 2024-02-21T23:07:48.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.432+0000 7f221a81b740 1 -- 172.21.15.99:0/4170157565 shutdown_connections 2024-02-21T23:07:48.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.432+0000 7f221a81b740 1 --2- 172.21.15.99:0/4170157565 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x56095d1a24f0 0x56095d19ca50 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:48.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.432+0000 7f21f6000640 0 client.6222 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:07:48.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.432+0000 7f221a81b740 1 --2- 172.21.15.99:0/4170157565 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56095d165f40 0x56095d1666e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:48.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.432+0000 7f221a81b740 1 --2- 172.21.15.99:0/4170157565 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56095d1e1cf0 0x56095d1aff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:48.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.432+0000 7f221a81b740 1 --2- 172.21.15.99:0/4170157565 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56095d1e1330 0x56095d1ad580 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:48.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.432+0000 7f221a81b740 1 -- 172.21.15.99:0/4170157565 >> 172.21.15.99:0/4170157565 conn(0x56095d1a6660 msgr2=0x56095d1e07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:07:48.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.433+0000 7f221a81b740 1 -- 172.21.15.99:0/4170157565 shutdown_connections 2024-02-21T23:07:48.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.433+0000 7f221a81b740 1 -- 172.21.15.99:0/4170157565 wait complete. 2024-02-21T23:07:48.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.433+0000 7f221a81b740 20 client.6222 trim_cache size 0 max 16384 2024-02-21T23:07:48.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.447+0000 7f221a81b740 1 Processor -- start 2024-02-21T23:07:48.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.447+0000 7f221a81b740 1 -- start start 2024-02-21T23:07:48.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.448+0000 7f221a81b740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56095d165f40 0x56095d1e1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:48.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.448+0000 7f221a81b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56095d1e1330 0x56095d1a2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:48.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.448+0000 7f221a81b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56095d1e1cf0 0x56095d244520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:48.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.448+0000 7f221a81b740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f221022c7e0 con 0x56095d165f40 2024-02-21T23:07:48.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.448+0000 7f221a81b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f221022a380 con 0x56095d1e1330 2024-02-21T23:07:48.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.448+0000 7f221a81b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f221017e860 con 0x56095d1e1cf0 2024-02-21T23:07:48.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.448+0000 7f2215000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56095d165f40 0x56095d1e1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:48.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.449+0000 7f2215000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56095d165f40 0x56095d1e1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:36856/0 (socket says 172.21.15.99:36856) 2024-02-21T23:07:48.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.449+0000 7f2215000640 1 -- 172.21.15.99:0/2564571529 learned_addr learned my addr 172.21.15.99:0/2564571529 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:07:48.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.449+0000 7f220fe00640 1 --2- 172.21.15.99:0/2564571529 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56095d1e1330 0x56095d1a2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:48.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.449+0000 7f2215a00640 1 --2- 172.21.15.99:0/2564571529 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56095d1e1cf0 0x56095d244520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:48.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.449+0000 7f2215000640 1 -- 172.21.15.99:0/2564571529 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56095d1e1cf0 msgr2=0x56095d244520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:48.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.449+0000 7f2215000640 1 --2- 172.21.15.99:0/2564571529 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56095d1e1cf0 0x56095d244520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:48.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.449+0000 7f2215000640 1 -- 172.21.15.99:0/2564571529 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56095d1e1330 msgr2=0x56095d1a2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:48.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.449+0000 7f2215000640 1 --2- 172.21.15.99:0/2564571529 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56095d1e1330 0x56095d1a2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:48.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.449+0000 7f2215000640 1 -- 172.21.15.99:0/2564571529 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56095d19cdc0 con 0x56095d165f40 2024-02-21T23:07:48.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.449+0000 7f220fe00640 1 --2- 172.21.15.99:0/2564571529 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56095d1e1330 0x56095d1a2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:07:48.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.449+0000 7f2215000640 1 --2- 172.21.15.99:0/2564571529 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56095d165f40 0x56095d1e1710 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f2204009930 tx=0x7f22040a4000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bdc7acac0927272 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:48.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.450+0000 7f2200c00640 1 -- 172.21.15.99:0/2564571529 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22040b8fb0 con 0x56095d165f40 2024-02-21T23:07:48.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.450+0000 7f2200c00640 1 -- 172.21.15.99:0/2564571529 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22040b9b70 con 0x56095d165f40 2024-02-21T23:07:48.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.450+0000 7f2200c00640 1 -- 172.21.15.99:0/2564571529 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22040b5710 con 0x56095d165f40 2024-02-21T23:07:48.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.450+0000 7f221a81b740 1 -- 172.21.15.99:0/2564571529 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56095d165f40 msgr2=0x56095d1e1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:48.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.450+0000 7f221a81b740 1 --2- 172.21.15.99:0/2564571529 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56095d165f40 0x56095d1e1710 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f2204009930 tx=0x7f22040a4000 comp rx=0 tx=0).stop 2024-02-21T23:07:48.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.450+0000 7f221a81b740 1 -- 172.21.15.99:0/2564571529 shutdown_connections 2024-02-21T23:07:48.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.450+0000 7f221a81b740 1 --2- 172.21.15.99:0/2564571529 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56095d1e1cf0 0x56095d244520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:48.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.450+0000 7f221a81b740 1 --2- 172.21.15.99:0/2564571529 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56095d1e1330 0x56095d1a2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:48.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.450+0000 7f221a81b740 1 --2- 172.21.15.99:0/2564571529 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56095d165f40 0x56095d1e1710 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:48.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.451+0000 7f221a81b740 1 -- 172.21.15.99:0/2564571529 >> 172.21.15.99:0/2564571529 conn(0x56095d1a6660 msgr2=0x56095d19f940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:07:48.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.451+0000 7f221a81b740 1 -- 172.21.15.99:0/2564571529 shutdown_connections 2024-02-21T23:07:48.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.451+0000 7f221a81b740 1 -- 172.21.15.99:0/2564571529 wait complete. 2024-02-21T23:07:48.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.451+0000 7f221a81b740 1 -- start start 2024-02-21T23:07:48.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.452+0000 7f221a81b740 1 Processor -- start 2024-02-21T23:07:48.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.453+0000 7f221a81b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56095d165f40 0x56095d1a8c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:48.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.453+0000 7f221a81b740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56095d1e1330 0x56095d238030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:48.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.453+0000 7f221a81b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56095d1e1cf0 0x56095d164a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:48.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.453+0000 7f221a81b740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2210228b40 con 0x56095d1e1330 2024-02-21T23:07:48.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.453+0000 7f221a81b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2210229d40 con 0x56095d1e1cf0 2024-02-21T23:07:48.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.453+0000 7f221a81b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2210229140 con 0x56095d165f40 2024-02-21T23:07:48.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.453+0000 7f221a81b740 10 client.0 _ll_register_callbacks cb 0x7f22040091e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:07:48.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.453+0000 7f220fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56095d1e1330 0x56095d238030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:48.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.453+0000 7f220fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56095d1e1330 0x56095d238030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:36872/0 (socket says 172.21.15.99:36872) 2024-02-21T23:07:48.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.453+0000 7f220fe00640 1 -- 172.21.15.99:0/413372353 learned_addr learned my addr 172.21.15.99:0/413372353 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:07:48.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.454+0000 7f2215a00640 1 --2- 172.21.15.99:0/413372353 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56095d1e1cf0 0x56095d164a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:48.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.454+0000 7f2215000640 1 --2- 172.21.15.99:0/413372353 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56095d165f40 0x56095d1a8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:48.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.454+0000 7f2215000640 1 -- 172.21.15.99:0/413372353 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56095d1e1cf0 msgr2=0x56095d164a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:48.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.454+0000 7f2215000640 1 --2- 172.21.15.99:0/413372353 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56095d1e1cf0 0x56095d164a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:48.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.454+0000 7f2215000640 1 -- 172.21.15.99:0/413372353 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56095d1e1330 msgr2=0x56095d238030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:48.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.454+0000 7f2215000640 1 --2- 172.21.15.99:0/413372353 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56095d1e1330 0x56095d238030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:48.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.454+0000 7f2215000640 1 -- 172.21.15.99:0/413372353 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56095cead7d0 con 0x56095d165f40 2024-02-21T23:07:48.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.454+0000 7f2215a00640 1 --2- 172.21.15.99:0/413372353 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56095d1e1cf0 0x56095d164a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:07:48.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.454+0000 7f220fe00640 1 --2- 172.21.15.99:0/413372353 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56095d1e1330 0x56095d238030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:07:48.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.454+0000 7f2215000640 1 --2- 172.21.15.99:0/413372353 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56095d165f40 0x56095d1a8c00 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f2204044000 tx=0x7f22040ee130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=94395f9bb484daae server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:48.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.454+0000 7f21f6000640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-02-21T23:07:48.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.455+0000 7f21f6000640 1 -- 172.21.15.99:0/413372353 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22040b5710 con 0x56095d165f40 2024-02-21T23:07:48.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.455+0000 7f21f6000640 1 -- 172.21.15.99:0/413372353 <== mon.2 v2:172.21.15.181:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f22040a2b70 con 0x56095d165f40 2024-02-21T23:07:48.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.455+0000 7f221a81b740 1 -- 172.21.15.99:0/413372353 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f22040b9b70 con 0x56095d165f40 2024-02-21T23:07:48.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.455+0000 7f21f6000640 1 -- 172.21.15.99:0/413372353 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f22040b8fb0 con 0x56095d165f40 2024-02-21T23:07:48.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.455+0000 7f221a81b740 10 client.6356 fetch_fsmap learned FSMap version 17 2024-02-21T23:07:48.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.455+0000 7f221a81b740 1 -- 172.21.15.99:0/413372353 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x56095cead7d0 con 0x56095d165f40 2024-02-21T23:07:48.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.455+0000 7f21f6000640 1 -- 172.21.15.99:0/413372353 <== mon.2 v2:172.21.15.181:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22040b9b70 con 0x56095d165f40 2024-02-21T23:07:48.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.456+0000 7f21f6000640 1 -- 172.21.15.99:0/413372353 <== mon.2 v2:172.21.15.181:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f22040b88c0 con 0x56095d165f40 2024-02-21T23:07:48.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.456+0000 7f221a81b740 10 client.6356 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:07:48.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.456+0000 7f221a81b740 10 client.6356 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:07:48.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.456+0000 7f221a81b740 20 client.6356 populate_metadata read hostname 'smithi099' 2024-02-21T23:07:48.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.456+0000 7f221a81b740 1 --2- 172.21.15.99:0/413372353 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x56095d24e980 0x56095d164fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:48.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.456+0000 7f221a81b740 4 client.6356 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T23:07:48.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.456+0000 7f221a81b740 1 -- 172.21.15.99:0/413372353 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56095d0d63e0 con 0x56095d24e980 2024-02-21T23:07:48.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.456+0000 7f220fe00640 1 --2- 172.21.15.99:0/413372353 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x56095d24e980 0x56095d164fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:48.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.457+0000 7f220fe00640 1 --2- 172.21.15.99:0/413372353 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x56095d24e980 0x56095d164fa0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b889e551e8380a2f server_cookie=3606c2db13ab1f05 in_seq=0 out_seq=0 2024-02-21T23:07:48.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.457+0000 7f21f6000640 10 client.6356 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:07:48.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.457+0000 7f21f6000640 1 -- 172.21.15.99:0/413372353 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56095d0d63e0 con 0x56095d24e980 2024-02-21T23:07:48.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.457+0000 7f21f6000640 10 client.6356 handle_command_reply: tid=0 2024-02-21T23:07:48.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.457+0000 7f221a81b740 1 client.6356 shutdown 2024-02-21T23:07:48.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.457+0000 7f221a81b740 1 -- 172.21.15.99:0/413372353 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56095d165f40 msgr2=0x56095d1a8c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:48.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.457+0000 7f221a81b740 1 --2- 172.21.15.99:0/413372353 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56095d165f40 0x56095d1a8c00 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f2204044000 tx=0x7f22040ee130 comp rx=0 tx=0).stop 2024-02-21T23:07:48.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.457+0000 7f221a81b740 1 -- 172.21.15.99:0/413372353 shutdown_connections 2024-02-21T23:07:48.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.457+0000 7f221a81b740 1 --2- 172.21.15.99:0/413372353 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x56095d24e980 0x56095d164fa0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:48.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.457+0000 7f221a81b740 1 --2- 172.21.15.99:0/413372353 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56095d1e1cf0 0x56095d164a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:48.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.457+0000 7f221a81b740 1 --2- 172.21.15.99:0/413372353 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56095d1e1330 0x56095d238030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:48.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.457+0000 7f221a81b740 1 --2- 172.21.15.99:0/413372353 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56095d165f40 0x56095d1a8c00 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:48.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.457+0000 7f221a81b740 1 -- 172.21.15.99:0/413372353 >> 172.21.15.99:0/413372353 conn(0x56095d1a6660 msgr2=0x56095d1a2900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:07:48.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.457+0000 7f21f6000640 0 client.6356 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:07:48.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.458+0000 7f221a81b740 1 -- 172.21.15.99:0/413372353 shutdown_connections 2024-02-21T23:07:48.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.458+0000 7f221a81b740 1 -- 172.21.15.99:0/413372353 wait complete. 2024-02-21T23:07:48.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.458+0000 7f221a81b740 20 client.6356 trim_cache size 0 max 16384 2024-02-21T23:07:48.454 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-02-21T23:07:48.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.458+0000 7f2216400640 1 -- 172.21.15.99:0/767623421 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f21f009eed0 msgr2=0x7f21f00a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:48.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.458+0000 7f2216400640 1 --2- 172.21.15.99:0/767623421 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f21f009eed0 0x7f21f00a1390 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2208015fd0 tx=0x7f220801b000 comp rx=0 tx=0).stop 2024-02-21T23:07:48.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.458+0000 7f2216400640 1 -- 172.21.15.99:0/767623421 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f221017f490 msgr2=0x7f221006aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:48.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.458+0000 7f2216400640 1 --2- 172.21.15.99:0/767623421 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f221017f490 0x7f221006aef0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f220402b980 tx=0x7f22040046c0 comp rx=0 tx=0).stop 2024-02-21T23:07:48.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.459+0000 7f2216400640 1 -- 172.21.15.99:0/767623421 shutdown_connections 2024-02-21T23:07:48.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.459+0000 7f2216400640 1 --2- 172.21.15.99:0/767623421 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f21f009eed0 0x7f21f00a1390 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:48.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.459+0000 7f2216400640 1 --2- 172.21.15.99:0/767623421 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f221018b4f0 0x7f2210179790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:48.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.459+0000 7f2216400640 1 --2- 172.21.15.99:0/767623421 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f221018b060 0x7f221015bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:48.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.459+0000 7f2216400640 1 --2- 172.21.15.99:0/767623421 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f221017f490 0x7f221006aef0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:48.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.459+0000 7f2216400640 1 -- 172.21.15.99:0/767623421 >> 172.21.15.99:0/767623421 conn(0x7f22100d29b0 msgr2=0x7f221018bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:07:48.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.459+0000 7f2216400640 1 -- 172.21.15.99:0/767623421 shutdown_connections 2024-02-21T23:07:48.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:48.459+0000 7f2216400640 1 -- 172.21.15.99:0/767623421 wait complete. 2024-02-21T23:07:49.471 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-02-21T23:07:49.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T23:07:49.471 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-02-21T23:07:49.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.704+0000 7f7949a00640 1 Processor -- start 2024-02-21T23:07:49.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.705+0000 7f7949a00640 1 -- start start 2024-02-21T23:07:49.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.708+0000 7f7949a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f794417f710 0x7f7944189f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:49.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.708+0000 7f7949a00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f794418b920 0x7f794415e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:49.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.708+0000 7f7949a00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f794418a5a0 con 0x7f7944071c20 2024-02-21T23:07:49.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.708+0000 7f7949a00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f794418bda0 con 0x7f794417f710 2024-02-21T23:07:49.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.708+0000 7f7949a00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f794418a880 con 0x7f794418b920 2024-02-21T23:07:49.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.708+0000 7f7943400640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f794418b920 0x7f794415e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:49.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.708+0000 7f7949000640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f7944071c20 0x7f7944188a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:35188/0 (socket says 172.21.15.99:35188) 2024-02-21T23:07:49.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.709+0000 7f7949000640 1 -- 172.21.15.99:0/20039967 learned_addr learned my addr 172.21.15.99:0/20039967 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:07:49.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.708+0000 7f7943e00640 1 --2- 172.21.15.99:0/20039967 >> v2:172.21.15.162:3300/0 conn(0x7f794417f710 0x7f7944189f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:49.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.709+0000 7f7942a00640 1 -- 172.21.15.99:0/20039967 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2794876360 0 0) 0x7f794418a5a0 con 0x7f7944071c20 2024-02-21T23:07:49.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.709+0000 7f7943e00640 1 -- 172.21.15.99:0/20039967 >> v2:172.21.15.181:3300/0 conn(0x7f794418b920 msgr2=0x7f794415e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:49.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.709+0000 7f7943e00640 1 --2- 172.21.15.99:0/20039967 >> v2:172.21.15.181:3300/0 conn(0x7f794418b920 0x7f794415e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:49.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.709+0000 7f7943e00640 1 -- 172.21.15.99:0/20039967 >> v1:172.21.15.181:6789/0 conn(0x7f7944071c20 legacy=0x7f7944188a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:49.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.709+0000 7f7943e00640 1 -- 172.21.15.99:0/20039967 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f794418ab60 con 0x7f794417f710 2024-02-21T23:07:49.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.710+0000 7f7943e00640 1 --2- 172.21.15.99:0/20039967 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f794417f710 0x7f7944189f40 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f79440d0390 tx=0x7f793402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a151417335fd76e7 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:49.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.710+0000 7f7942a00640 1 -- 172.21.15.99:0/20039967 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7934035020 con 0x7f794417f710 2024-02-21T23:07:49.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.711+0000 7f7942a00640 1 -- 172.21.15.99:0/20039967 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7934031830 con 0x7f794417f710 2024-02-21T23:07:49.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.711+0000 7f7942a00640 1 -- 172.21.15.99:0/20039967 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7934031c00 con 0x7f794417f710 2024-02-21T23:07:49.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.711+0000 7f7949a00640 1 -- 172.21.15.99:0/20039967 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f794417f710 msgr2=0x7f7944189f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:49.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.711+0000 7f7949a00640 1 --2- 172.21.15.99:0/20039967 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f794417f710 0x7f7944189f40 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f79440d0390 tx=0x7f793402b8d0 comp rx=0 tx=0).stop 2024-02-21T23:07:49.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.711+0000 7f7949a00640 1 -- 172.21.15.99:0/20039967 shutdown_connections 2024-02-21T23:07:49.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.711+0000 7f7949a00640 1 --2- 172.21.15.99:0/20039967 >> v2:172.21.15.181:3300/0 conn(0x7f794418b920 0x7f794415e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:49.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.711+0000 7f7949a00640 1 --2- 172.21.15.99:0/20039967 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f794417f710 0x7f7944189f40 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:49.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.711+0000 7f7949a00640 1 -- 172.21.15.99:0/20039967 >> 172.21.15.99:0/20039967 conn(0x7f79440fe310 msgr2=0x7f79440fe720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:07:49.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.711+0000 7f7949a00640 1 -- 172.21.15.99:0/20039967 shutdown_connections 2024-02-21T23:07:49.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.712+0000 7f7949a00640 1 -- 172.21.15.99:0/20039967 wait complete. 2024-02-21T23:07:49.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.713+0000 7f7949a00640 1 Processor -- start 2024-02-21T23:07:49.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.714+0000 7f7949a00640 1 -- start start 2024-02-21T23:07:49.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.715+0000 7f7949a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7944071c20 0x7f7944178570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:49.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.715+0000 7f7949a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f794417f710 0x7f79440f9650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:49.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.715+0000 7f7949a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f794418b920 0x7f79440f53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:49.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.715+0000 7f7949a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f794415e9d0 con 0x7f794417f710 2024-02-21T23:07:49.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.715+0000 7f7949a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f794418b120 con 0x7f7944071c20 2024-02-21T23:07:49.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.715+0000 7f7949a00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f794415eb50 con 0x7f794418b920 2024-02-21T23:07:49.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.715+0000 7f7943400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f794417f710 0x7f79440f9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:49.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.715+0000 7f7943e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7944071c20 0x7f7944178570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:49.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.715+0000 7f7943e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7944071c20 0x7f7944178570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:37042/0 (socket says 172.21.15.99:37042) 2024-02-21T23:07:49.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.715+0000 7f7943e00640 1 -- 172.21.15.99:0/2074914844 learned_addr learned my addr 172.21.15.99:0/2074914844 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:07:49.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.715+0000 7f7949000640 1 --2- 172.21.15.99:0/2074914844 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f794418b920 0x7f79440f53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:49.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.716+0000 7f7943e00640 1 -- 172.21.15.99:0/2074914844 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f794418b920 msgr2=0x7f79440f53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:49.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.716+0000 7f7943e00640 1 --2- 172.21.15.99:0/2074914844 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f794418b920 0x7f79440f53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:49.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.716+0000 7f7943e00640 1 -- 172.21.15.99:0/2074914844 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f794417f710 msgr2=0x7f79440f9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:49.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.716+0000 7f7943e00640 1 --2- 172.21.15.99:0/2074914844 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f794417f710 0x7f79440f9650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:49.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.716+0000 7f7943e00640 1 -- 172.21.15.99:0/2074914844 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79440f6000 con 0x7f7944071c20 2024-02-21T23:07:49.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.716+0000 7f7943400640 1 --2- 172.21.15.99:0/2074914844 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f794417f710 0x7f79440f9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:07:49.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.716+0000 7f7943e00640 1 --2- 172.21.15.99:0/2074914844 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7944071c20 0x7f7944178570 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f793402be10 tx=0x7f79340046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:49.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.716+0000 7f793be00640 1 -- 172.21.15.99:0/2074914844 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7934035040 con 0x7f7944071c20 2024-02-21T23:07:49.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.717+0000 7f7949a00640 1 -- 172.21.15.99:0/2074914844 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79440f62e0 con 0x7f7944071c20 2024-02-21T23:07:49.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.717+0000 7f793be00640 1 -- 172.21.15.99:0/2074914844 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7934004230 con 0x7f7944071c20 2024-02-21T23:07:49.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.717+0000 7f793be00640 1 -- 172.21.15.99:0/2074914844 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f793403a640 con 0x7f7944071c20 2024-02-21T23:07:49.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.717+0000 7f7949a00640 1 -- 172.21.15.99:0/2074914844 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79440f68a0 con 0x7f7944071c20 2024-02-21T23:07:49.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.721+0000 7f793be00640 1 -- 172.21.15.99:0/2074914844 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f7934038020 con 0x7f7944071c20 2024-02-21T23:07:49.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.722+0000 7f794e02c740 1 Processor -- start 2024-02-21T23:07:49.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.722+0000 7f794e02c740 1 -- start start 2024-02-21T23:07:49.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.723+0000 7f793be00640 1 --2- 172.21.15.99:0/2074914844 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f792409ee50 0x7f79240a1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:49.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.724+0000 7f793be00640 1 -- 172.21.15.99:0/2074914844 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f79340ebc20 con 0x7f7944071c20 2024-02-21T23:07:49.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.724+0000 7f794e02c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55be2a4ef4c0 0x55be2a4ef8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:49.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.724+0000 7f7949000640 1 --2- 172.21.15.99:0/2074914844 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f792409ee50 0x7f79240a1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:49.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.724+0000 7f794e02c740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55be2a4efde0 0x55be2a52a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:49.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.724+0000 7f794e02c740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55be2a52ab90 0x55be2a52b920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:49.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.724+0000 7f794e02c740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be2a417790 con 0x55be2a4efde0 2024-02-21T23:07:49.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.724+0000 7f794e02c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be2a3c0bf0 con 0x55be2a4ef4c0 2024-02-21T23:07:49.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.724+0000 7f794e02c740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be2a413830 con 0x55be2a52ab90 2024-02-21T23:07:49.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.724+0000 7f7943e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55be2a4ef4c0 0x55be2a4ef8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:49.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.724+0000 7f7943e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55be2a4ef4c0 0x55be2a4ef8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:37052/0 (socket says 172.21.15.99:37052) 2024-02-21T23:07:49.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.724+0000 7f7943e00640 1 -- 172.21.15.99:0/571017817 learned_addr learned my addr 172.21.15.99:0/571017817 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:07:49.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.724+0000 7f7943400640 1 --2- 172.21.15.99:0/571017817 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55be2a4efde0 0x55be2a52a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:49.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.725+0000 7f7949000640 1 --2- 172.21.15.99:0/571017817 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55be2a52ab90 0x55be2a52b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:49.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.725+0000 7f7943e00640 1 -- 172.21.15.99:0/571017817 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55be2a52ab90 msgr2=0x55be2a52b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:49.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.725+0000 7f7943e00640 1 --2- 172.21.15.99:0/571017817 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55be2a52ab90 0x55be2a52b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:49.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.725+0000 7f7943e00640 1 -- 172.21.15.99:0/571017817 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55be2a4efde0 msgr2=0x55be2a52a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:49.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.725+0000 7f7943e00640 1 --2- 172.21.15.99:0/571017817 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55be2a4efde0 0x55be2a52a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:49.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.725+0000 7f7943e00640 1 -- 172.21.15.99:0/571017817 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55be2a3dec40 con 0x55be2a4ef4c0 2024-02-21T23:07:49.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.725+0000 7f7949000640 1 --2- 172.21.15.99:0/2074914844 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f792409ee50 0x7f79240a1310 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f793c0012e0 tx=0x7f793c001ed0 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:49.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.725+0000 7f7943e00640 1 --2- 172.21.15.99:0/571017817 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55be2a4ef4c0 0x55be2a4ef8a0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f79340e9860 tx=0x7f79340b7720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac351bf9f4adc219 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:49.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.725+0000 7f7938c00640 1 -- 172.21.15.99:0/571017817 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79340bd670 con 0x55be2a4ef4c0 2024-02-21T23:07:49.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.725+0000 7f7938c00640 1 -- 172.21.15.99:0/571017817 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79340c1cc0 con 0x55be2a4ef4c0 2024-02-21T23:07:49.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.725+0000 7f7938c00640 1 -- 172.21.15.99:0/571017817 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79340d80b0 con 0x55be2a4ef4c0 2024-02-21T23:07:49.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.726+0000 7f794e02c740 1 -- 172.21.15.99:0/571017817 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55be2a4ef4c0 msgr2=0x55be2a4ef8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:49.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.726+0000 7f794e02c740 1 --2- 172.21.15.99:0/571017817 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55be2a4ef4c0 0x55be2a4ef8a0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f79340e9860 tx=0x7f79340b7720 comp rx=0 tx=0).stop 2024-02-21T23:07:49.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.726+0000 7f794e02c740 1 -- 172.21.15.99:0/571017817 shutdown_connections 2024-02-21T23:07:49.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.726+0000 7f794e02c740 1 --2- 172.21.15.99:0/571017817 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55be2a52ab90 0x55be2a52b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:49.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.726+0000 7f794e02c740 1 --2- 172.21.15.99:0/571017817 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55be2a4efde0 0x55be2a52a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:49.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.726+0000 7f794e02c740 1 --2- 172.21.15.99:0/571017817 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55be2a4ef4c0 0x55be2a4ef8a0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:49.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.726+0000 7f794e02c740 1 -- 172.21.15.99:0/571017817 >> 172.21.15.99:0/571017817 conn(0x55be2a4b1a90 msgr2=0x55be2a4b2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:07:49.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.726+0000 7f794e02c740 1 -- 172.21.15.99:0/571017817 shutdown_connections 2024-02-21T23:07:49.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.727+0000 7f794e02c740 1 -- 172.21.15.99:0/571017817 wait complete. 2024-02-21T23:07:49.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.727+0000 7f794e02c740 1 -- start start 2024-02-21T23:07:49.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.728+0000 7f794e02c740 1 Processor -- start 2024-02-21T23:07:49.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.730+0000 7f794e02c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55be2a4efde0 0x55be2a4e3f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:49.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.730+0000 7f794e02c740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55be2a52ab90 0x55be2a4af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:49.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.730+0000 7f794e02c740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55be2a4ba5b0 0x55be2a4e22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:49.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.730+0000 7f794e02c740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be2a417790 con 0x55be2a52ab90 2024-02-21T23:07:49.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.730+0000 7f794e02c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be2a3b61d0 con 0x55be2a4efde0 2024-02-21T23:07:49.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.730+0000 7f794e02c740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be2a3c0bf0 con 0x55be2a4ba5b0 2024-02-21T23:07:49.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.730+0000 7f794e02c740 10 client.0 _ll_register_callbacks cb 0x55be2a12bc60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:07:49.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.730+0000 7f7943e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55be2a4efde0 0x55be2a4e3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:49.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.730+0000 7f7943400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55be2a52ab90 0x55be2a4af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:49.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.730+0000 7f7943e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55be2a4efde0 0x55be2a4e3f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:37062/0 (socket says 172.21.15.99:37062) 2024-02-21T23:07:49.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.730+0000 7f7943400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55be2a52ab90 0x55be2a4af3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:36896/0 (socket says 172.21.15.99:36896) 2024-02-21T23:07:49.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.730+0000 7f7943e00640 1 -- 172.21.15.99:0/3898462172 learned_addr learned my addr 172.21.15.99:0/3898462172 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:07:49.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.730+0000 7f7943e00640 1 -- 172.21.15.99:0/3898462172 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55be2a4ba5b0 msgr2=0x55be2a4e22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:49.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.730+0000 7f7943e00640 1 --2- 172.21.15.99:0/3898462172 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55be2a4ba5b0 0x55be2a4e22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:49.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.730+0000 7f7943e00640 1 -- 172.21.15.99:0/3898462172 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55be2a52ab90 msgr2=0x55be2a4af3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:49.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.730+0000 7f7943e00640 1 --2- 172.21.15.99:0/3898462172 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55be2a52ab90 0x55be2a4af3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:49.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.730+0000 7f7943e00640 1 -- 172.21.15.99:0/3898462172 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55be2a1f47e0 con 0x55be2a4efde0 2024-02-21T23:07:49.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.731+0000 7f7943e00640 1 --2- 172.21.15.99:0/3898462172 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55be2a4efde0 0x55be2a4e3f10 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f79340e9420 tx=0x7f7934009190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58fd0161b0d8ee35 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:49.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.731+0000 7f792d600640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-02-21T23:07:49.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.731+0000 7f792d600640 1 -- 172.21.15.99:0/3898462172 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79340bd670 con 0x55be2a4efde0 2024-02-21T23:07:49.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.731+0000 7f792d600640 1 -- 172.21.15.99:0/3898462172 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f79340b5b00 con 0x55be2a4efde0 2024-02-21T23:07:49.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.731+0000 7f794e02c740 1 -- 172.21.15.99:0/3898462172 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f79340c1cc0 con 0x55be2a4efde0 2024-02-21T23:07:49.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.731+0000 7f792d600640 1 -- 172.21.15.99:0/3898462172 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f79340e9450 con 0x55be2a4efde0 2024-02-21T23:07:49.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.731+0000 7f794e02c740 10 client.6364 fetch_fsmap learned FSMap version 17 2024-02-21T23:07:49.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.731+0000 7f794e02c740 1 -- 172.21.15.99:0/3898462172 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55be2a254f70 con 0x55be2a4efde0 2024-02-21T23:07:49.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.732+0000 7f792d600640 1 -- 172.21.15.99:0/3898462172 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79340c1cc0 con 0x55be2a4efde0 2024-02-21T23:07:49.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.732+0000 7f792d600640 1 -- 172.21.15.99:0/3898462172 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f79340b9780 con 0x55be2a4efde0 2024-02-21T23:07:49.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.732+0000 7f794e02c740 10 client.6364 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:07:49.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.732+0000 7f794e02c740 10 client.6364 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:07:49.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.732+0000 7f794e02c740 20 client.6364 populate_metadata read hostname 'smithi099' 2024-02-21T23:07:49.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.732+0000 7f794e02c740 1 --2- 172.21.15.99:0/3898462172 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55be2a4ae690 0x55be2a4aead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:49.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.732+0000 7f794e02c740 4 client.6364 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:07:49.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.732+0000 7f794e02c740 1 -- 172.21.15.99:0/3898462172 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55be2a424cd0 con 0x55be2a4ae690 2024-02-21T23:07:49.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.732+0000 7f7943400640 1 --2- 172.21.15.99:0/3898462172 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55be2a4ae690 0x55be2a4aead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:49.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.733+0000 7f792d600640 10 client.6364 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:07:49.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.733+0000 7f7943400640 1 --2- 172.21.15.99:0/3898462172 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55be2a4ae690 0x55be2a4aead0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9af9306fcfd3bae2 server_cookie=4abd953e1e2d312f in_seq=0 out_seq=0 2024-02-21T23:07:49.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.734+0000 7f792d600640 1 -- 172.21.15.99:0/3898462172 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55be2a424cd0 con 0x55be2a4ae690 2024-02-21T23:07:49.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.734+0000 7f792d600640 10 client.6364 handle_command_reply: tid=0 2024-02-21T23:07:49.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.734+0000 7f794e02c740 1 client.6364 shutdown 2024-02-21T23:07:49.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.734+0000 7f794e02c740 1 -- 172.21.15.99:0/3898462172 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55be2a4efde0 msgr2=0x55be2a4e3f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:49.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.734+0000 7f794e02c740 1 --2- 172.21.15.99:0/3898462172 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55be2a4efde0 0x55be2a4e3f10 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f79340e9420 tx=0x7f7934009190 comp rx=0 tx=0).stop 2024-02-21T23:07:49.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.734+0000 7f794e02c740 1 -- 172.21.15.99:0/3898462172 shutdown_connections 2024-02-21T23:07:49.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.734+0000 7f794e02c740 1 --2- 172.21.15.99:0/3898462172 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55be2a4ae690 0x55be2a4aead0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:49.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.734+0000 7f792d600640 0 client.6364 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:07:49.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.734+0000 7f794e02c740 1 --2- 172.21.15.99:0/3898462172 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55be2a4ba5b0 0x55be2a4e22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:49.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.734+0000 7f794e02c740 1 --2- 172.21.15.99:0/3898462172 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55be2a52ab90 0x55be2a4af3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:49.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.734+0000 7f794e02c740 1 --2- 172.21.15.99:0/3898462172 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55be2a4efde0 0x55be2a4e3f10 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:49.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.734+0000 7f794e02c740 1 -- 172.21.15.99:0/3898462172 >> 172.21.15.99:0/3898462172 conn(0x55be2a4ef4c0 msgr2=0x55be2a4b3500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:07:49.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.735+0000 7f794e02c740 1 -- 172.21.15.99:0/3898462172 shutdown_connections 2024-02-21T23:07:49.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.735+0000 7f794e02c740 1 -- 172.21.15.99:0/3898462172 wait complete. 2024-02-21T23:07:49.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.735+0000 7f794e02c740 20 client.6364 trim_cache size 0 max 16384 2024-02-21T23:07:49.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.770+0000 7f794e02c740 1 Processor -- start 2024-02-21T23:07:49.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.770+0000 7f794e02c740 1 -- start start 2024-02-21T23:07:49.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.771+0000 7f794e02c740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55be2a4ba5b0 0x55be2a4ef8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:49.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.771+0000 7f794e02c740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55be2a4efde0 0x55be2a4b0b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:49.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.771+0000 7f794e02c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55be2a52ab90 0x55be2a5293d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:49.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.771+0000 7f794e02c740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7944228470 con 0x55be2a4efde0 2024-02-21T23:07:49.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.771+0000 7f794e02c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f794406fd80 con 0x55be2a52ab90 2024-02-21T23:07:49.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.771+0000 7f794e02c740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79440f3280 con 0x55be2a4ba5b0 2024-02-21T23:07:49.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.771+0000 7f7943400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55be2a4efde0 0x55be2a4b0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:49.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.771+0000 7f7943e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55be2a4ba5b0 0x55be2a4ef8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:49.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.771+0000 7f7943e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55be2a4ba5b0 0x55be2a4ef8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:59374/0 (socket says 172.21.15.99:59374) 2024-02-21T23:07:49.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.771+0000 7f7943e00640 1 -- 172.21.15.99:0/3209127554 learned_addr learned my addr 172.21.15.99:0/3209127554 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:07:49.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.771+0000 7f7943400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55be2a4efde0 0x55be2a4b0b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:36902/0 (socket says 172.21.15.99:36902) 2024-02-21T23:07:49.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.771+0000 7f7949000640 1 --2- 172.21.15.99:0/3209127554 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55be2a52ab90 0x55be2a5293d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:49.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.772+0000 7f7943400640 1 -- 172.21.15.99:0/3209127554 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55be2a4ba5b0 msgr2=0x55be2a4ef8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:49.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.772+0000 7f7943400640 1 --2- 172.21.15.99:0/3209127554 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55be2a4ba5b0 0x55be2a4ef8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:49.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.772+0000 7f7943400640 1 -- 172.21.15.99:0/3209127554 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55be2a52ab90 msgr2=0x55be2a5293d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:49.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.772+0000 7f7943400640 1 --2- 172.21.15.99:0/3209127554 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55be2a52ab90 0x55be2a5293d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:49.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.772+0000 7f7943400640 1 -- 172.21.15.99:0/3209127554 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55be2a0ec170 con 0x55be2a4efde0 2024-02-21T23:07:49.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.772+0000 7f7943400640 1 --2- 172.21.15.99:0/3209127554 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55be2a4efde0 0x55be2a4b0b70 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x55be2a4afff0 tx=0x7f7930008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac9404612109a540 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:49.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.772+0000 7f792fe00640 1 -- 172.21.15.99:0/3209127554 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f793001fa40 con 0x55be2a4efde0 2024-02-21T23:07:49.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.772+0000 7f792fe00640 1 -- 172.21.15.99:0/3209127554 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f793001fbe0 con 0x55be2a4efde0 2024-02-21T23:07:49.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.772+0000 7f792fe00640 1 -- 172.21.15.99:0/3209127554 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7930004020 con 0x55be2a4efde0 2024-02-21T23:07:49.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.773+0000 7f794e02c740 1 -- 172.21.15.99:0/3209127554 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55be2a4efde0 msgr2=0x55be2a4b0b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:49.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.773+0000 7f794e02c740 1 --2- 172.21.15.99:0/3209127554 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55be2a4efde0 0x55be2a4b0b70 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x55be2a4afff0 tx=0x7f7930008040 comp rx=0 tx=0).stop 2024-02-21T23:07:49.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.773+0000 7f794e02c740 1 -- 172.21.15.99:0/3209127554 shutdown_connections 2024-02-21T23:07:49.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.773+0000 7f794e02c740 1 --2- 172.21.15.99:0/3209127554 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55be2a52ab90 0x55be2a5293d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:49.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.773+0000 7f794e02c740 1 --2- 172.21.15.99:0/3209127554 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55be2a4efde0 0x55be2a4b0b70 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:49.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.773+0000 7f794e02c740 1 --2- 172.21.15.99:0/3209127554 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55be2a4ba5b0 0x55be2a4ef8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:49.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.773+0000 7f794e02c740 1 -- 172.21.15.99:0/3209127554 >> 172.21.15.99:0/3209127554 conn(0x55be2a4ef4c0 msgr2=0x55be2a4e20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:07:49.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.773+0000 7f794e02c740 1 -- 172.21.15.99:0/3209127554 shutdown_connections 2024-02-21T23:07:49.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.773+0000 7f794e02c740 1 -- 172.21.15.99:0/3209127554 wait complete. 2024-02-21T23:07:49.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.774+0000 7f794e02c740 1 -- start start 2024-02-21T23:07:49.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.774+0000 7f794e02c740 1 Processor -- start 2024-02-21T23:07:49.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.775+0000 7f794e02c740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55be2a4ba5b0 0x55be2a5960f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:49.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.775+0000 7f794e02c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55be2a4efde0 0x55be2a529140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:49.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.775+0000 7f794e02c740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55be2a52ab90 0x55be2a529680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:49.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.775+0000 7f794e02c740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f794406e4a0 con 0x55be2a4ba5b0 2024-02-21T23:07:49.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.775+0000 7f794e02c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f794406f720 con 0x55be2a4efde0 2024-02-21T23:07:49.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.776+0000 7f794e02c740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f794406eaa0 con 0x55be2a52ab90 2024-02-21T23:07:49.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.776+0000 7f794e02c740 10 client.0 _ll_register_callbacks cb 0x7f79340bd070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:07:49.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.776+0000 7f7943e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55be2a4ba5b0 0x55be2a5960f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:49.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.776+0000 7f7943e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55be2a4ba5b0 0x55be2a5960f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:36912/0 (socket says 172.21.15.99:36912) 2024-02-21T23:07:49.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.776+0000 7f7943e00640 1 -- 172.21.15.99:0/2921192620 learned_addr learned my addr 172.21.15.99:0/2921192620 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:07:49.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.776+0000 7f7949000640 1 --2- 172.21.15.99:0/2921192620 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55be2a52ab90 0x55be2a529680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:49.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.776+0000 7f7943400640 1 --2- 172.21.15.99:0/2921192620 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55be2a4efde0 0x55be2a529140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:49.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.776+0000 7f7943e00640 1 -- 172.21.15.99:0/2921192620 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55be2a52ab90 msgr2=0x55be2a529680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:49.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.776+0000 7f7943e00640 1 --2- 172.21.15.99:0/2921192620 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55be2a52ab90 0x55be2a529680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:49.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.776+0000 7f7943e00640 1 -- 172.21.15.99:0/2921192620 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55be2a4efde0 msgr2=0x55be2a529140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:49.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.776+0000 7f7943e00640 1 --2- 172.21.15.99:0/2921192620 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55be2a4efde0 0x55be2a529140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:49.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.776+0000 7f7943e00640 1 -- 172.21.15.99:0/2921192620 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55be2a596840 con 0x55be2a4ba5b0 2024-02-21T23:07:49.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.776+0000 7f7943400640 1 --2- 172.21.15.99:0/2921192620 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55be2a4efde0 0x55be2a529140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:07:49.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.777+0000 7f7943e00640 1 --2- 172.21.15.99:0/2921192620 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55be2a4ba5b0 0x55be2a5960f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f7934049040 tx=0x7f79340b7790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23d7c746c75955f1 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:49.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.777+0000 7f792d600640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:07:49.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.777+0000 7f792d600640 1 -- 172.21.15.99:0/2921192620 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79340b8e80 con 0x55be2a4ba5b0 2024-02-21T23:07:49.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.777+0000 7f792d600640 1 -- 172.21.15.99:0/2921192620 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f79340b5b00 con 0x55be2a4ba5b0 2024-02-21T23:07:49.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.777+0000 7f794e02c740 1 -- 172.21.15.99:0/2921192620 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f793001fbe0 con 0x55be2a4ba5b0 2024-02-21T23:07:49.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.777+0000 7f792d600640 1 -- 172.21.15.99:0/2921192620 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f79340c1cc0 con 0x55be2a4ba5b0 2024-02-21T23:07:49.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.777+0000 7f794e02c740 10 client.6243 fetch_fsmap learned FSMap version 17 2024-02-21T23:07:49.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.777+0000 7f794e02c740 1 -- 172.21.15.99:0/2921192620 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55be2a596840 con 0x55be2a4ba5b0 2024-02-21T23:07:49.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.777+0000 7f792d600640 1 -- 172.21.15.99:0/2921192620 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f793001fbe0 con 0x55be2a4ba5b0 2024-02-21T23:07:49.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.778+0000 7f792d600640 1 -- 172.21.15.99:0/2921192620 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f793409f020 con 0x55be2a4ba5b0 2024-02-21T23:07:49.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.778+0000 7f794e02c740 10 client.6243 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:07:49.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.778+0000 7f794e02c740 10 client.6243 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:07:49.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.778+0000 7f794e02c740 20 client.6243 populate_metadata read hostname 'smithi099' 2024-02-21T23:07:49.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.778+0000 7f794e02c740 1 --2- 172.21.15.99:0/2921192620 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55be2a4f4c20 0x55be2a594080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:49.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.778+0000 7f794e02c740 4 client.6243 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-02-21T23:07:49.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.778+0000 7f794e02c740 1 -- 172.21.15.99:0/2921192620 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55be2a41f020 con 0x55be2a4f4c20 2024-02-21T23:07:49.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.778+0000 7f7943400640 1 --2- 172.21.15.99:0/2921192620 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55be2a4f4c20 0x55be2a594080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:49.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.779+0000 7f792d600640 10 client.6243 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:07:49.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.779+0000 7f7943400640 1 --2- 172.21.15.99:0/2921192620 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55be2a4f4c20 0x55be2a594080 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd99a5e32e50d20f server_cookie=a433f3240c726a07 in_seq=0 out_seq=0 2024-02-21T23:07:49.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.780+0000 7f792d600640 1 -- 172.21.15.99:0/2921192620 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55be2a41f020 con 0x55be2a4f4c20 2024-02-21T23:07:49.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.780+0000 7f792d600640 10 client.6243 handle_command_reply: tid=0 2024-02-21T23:07:49.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.780+0000 7f794e02c740 1 client.6243 shutdown 2024-02-21T23:07:49.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.781+0000 7f794e02c740 1 -- 172.21.15.99:0/2921192620 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55be2a4ba5b0 msgr2=0x55be2a5960f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:49.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.781+0000 7f794e02c740 1 --2- 172.21.15.99:0/2921192620 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55be2a4ba5b0 0x55be2a5960f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f7934049040 tx=0x7f79340b7790 comp rx=0 tx=0).stop 2024-02-21T23:07:49.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.781+0000 7f794e02c740 1 -- 172.21.15.99:0/2921192620 shutdown_connections 2024-02-21T23:07:49.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.781+0000 7f794e02c740 1 --2- 172.21.15.99:0/2921192620 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55be2a4f4c20 0x55be2a594080 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:49.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.782+0000 7f794e02c740 1 --2- 172.21.15.99:0/2921192620 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55be2a52ab90 0x55be2a529680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:49.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.782+0000 7f794e02c740 1 --2- 172.21.15.99:0/2921192620 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55be2a4efde0 0x55be2a529140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:49.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.782+0000 7f794e02c740 1 --2- 172.21.15.99:0/2921192620 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55be2a4ba5b0 0x55be2a5960f0 secure :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f7934049040 tx=0x7f79340b7790 comp rx=0 tx=0).stop 2024-02-21T23:07:49.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.782+0000 7f794e02c740 1 -- 172.21.15.99:0/2921192620 >> 172.21.15.99:0/2921192620 conn(0x55be2a4ef4c0 msgr2=0x55be2a4b3500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:07:49.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.782+0000 7f792d600640 0 client.6243 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:07:49.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.782+0000 7f794e02c740 1 -- 172.21.15.99:0/2921192620 shutdown_connections 2024-02-21T23:07:49.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.782+0000 7f794e02c740 1 -- 172.21.15.99:0/2921192620 wait complete. 2024-02-21T23:07:49.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.782+0000 7f794e02c740 20 client.6243 trim_cache size 0 max 16384 2024-02-21T23:07:49.780 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-02-21T23:07:49.780 INFO:teuthology.orchestra.run.smithi099.stdout: "return_code": 0, 2024-02-21T23:07:49.780 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_tag": "404b0fa2-81e3-4e8c-bac6-27c243dcdd91", 2024-02-21T23:07:49.780 INFO:teuthology.orchestra.run.smithi099.stdout: "mode": "asynchronous" 2024-02-21T23:07:49.780 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-02-21T23:07:49.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.783+0000 7f7949a00640 1 -- 172.21.15.99:0/2074914844 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f792409ee50 msgr2=0x7f79240a1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:49.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.783+0000 7f7949a00640 1 --2- 172.21.15.99:0/2074914844 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f792409ee50 0x7f79240a1310 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f793c0012e0 tx=0x7f793c001ed0 comp rx=0 tx=0).stop 2024-02-21T23:07:49.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.783+0000 7f7949a00640 1 -- 172.21.15.99:0/2074914844 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7944071c20 msgr2=0x7f7944178570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:49.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.783+0000 7f7949a00640 1 --2- 172.21.15.99:0/2074914844 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7944071c20 0x7f7944178570 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f793402be10 tx=0x7f79340046c0 comp rx=0 tx=0).stop 2024-02-21T23:07:49.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.783+0000 7f7949a00640 1 -- 172.21.15.99:0/2074914844 shutdown_connections 2024-02-21T23:07:49.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.783+0000 7f7949a00640 1 --2- 172.21.15.99:0/2074914844 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f792409ee50 0x7f79240a1310 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:49.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.783+0000 7f7949a00640 1 --2- 172.21.15.99:0/2074914844 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f794418b920 0x7f79440f53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:49.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.783+0000 7f7949a00640 1 --2- 172.21.15.99:0/2074914844 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f794417f710 0x7f79440f9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:49.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.783+0000 7f7949a00640 1 --2- 172.21.15.99:0/2074914844 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7944071c20 0x7f7944178570 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:49.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.783+0000 7f7949a00640 1 -- 172.21.15.99:0/2074914844 >> 172.21.15.99:0/2074914844 conn(0x7f79440fe310 msgr2=0x7f794418c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:07:49.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.784+0000 7f7949a00640 1 -- 172.21.15.99:0/2074914844 shutdown_connections 2024-02-21T23:07:49.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:49.784+0000 7f7949a00640 1 -- 172.21.15.99:0/2074914844 wait complete. 2024-02-21T23:07:49.796 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T23:07:49.797 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T23:07:50.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.085+0000 7fc8e7e00640 1 Processor -- start 2024-02-21T23:07:50.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.086+0000 7fc8e7e00640 1 -- start start 2024-02-21T23:07:50.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.089+0000 7fc8e7e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fc8e817f490 0x7fc8e818ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:50.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.089+0000 7fc8e7e00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8e80d6dd0 con 0x7fc8e818b4f0 2024-02-21T23:07:50.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.089+0000 7fc8e7e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8e81614c0 con 0x7fc8e818b060 2024-02-21T23:07:50.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.089+0000 7fc8e7e00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8e80d6810 con 0x7fc8e817f490 2024-02-21T23:07:50.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.090+0000 7fc8e6000640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fc8e818b060 0x7fc8e8188a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.99:55626/0 (socket says 172.21.15.99:55626) 2024-02-21T23:07:50.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.090+0000 7fc8e6000640 1 -- 172.21.15.99:0/561988075 learned_addr learned my addr 172.21.15.99:0/561988075 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:07:50.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.091+0000 7fc8e5600640 1 -- 172.21.15.99:0/561988075 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4197858977 0 0) 0x7fc8e81614c0 con 0x7fc8e818b060 2024-02-21T23:07:50.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.091+0000 7fc8e5600640 1 -- 172.21.15.99:0/561988075 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8cc003520 con 0x7fc8e818b060 2024-02-21T23:07:50.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.091+0000 7fc8e6a00640 1 --2- 172.21.15.99:0/561988075 >> v2:172.21.15.99:3300/0 conn(0x7fc8e817f490 0x7fc8e818ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:50.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.091+0000 7fc8e5600640 1 -- 172.21.15.99:0/561988075 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 829692116 0 0) 0x7fc8e80d6dd0 con 0x7fc8e818b4f0 2024-02-21T23:07:50.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.091+0000 7fc8e5600640 1 -- 172.21.15.99:0/561988075 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8e81614c0 con 0x7fc8e818b4f0 2024-02-21T23:07:50.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.091+0000 7fc8e5600640 1 -- 172.21.15.99:0/561988075 <== mon.1 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2185739840 0 0) 0x7fc8cc003520 con 0x7fc8e818b060 2024-02-21T23:07:50.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.091+0000 7fc8e5600640 1 -- 172.21.15.99:0/561988075 >> v2:172.21.15.99:3300/0 conn(0x7fc8e817f490 msgr2=0x7fc8e818ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:50.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.091+0000 7fc8e5600640 1 --2- 172.21.15.99:0/561988075 >> v2:172.21.15.99:3300/0 conn(0x7fc8e817f490 0x7fc8e818ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:50.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.092+0000 7fc8e5600640 1 -- 172.21.15.99:0/561988075 >> v1:172.21.15.99:6789/0 conn(0x7fc8e818b4f0 legacy=0x7fc8e8189150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:50.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.092+0000 7fc8e5600640 1 -- 172.21.15.99:0/561988075 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8e80d6af0 con 0x7fc8e818b060 2024-02-21T23:07:50.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.092+0000 7fc8e5600640 1 -- 172.21.15.99:0/561988075 <== mon.1 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2069890144 0 0) 0x7fc8d40015f0 con 0x7fc8e818b060 2024-02-21T23:07:50.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.092+0000 7fc8e5600640 1 -- 172.21.15.99:0/561988075 >> v1:172.21.15.162:6789/0 conn(0x7fc8e818b060 legacy=0x7fc8e8188a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:50.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.092+0000 7fc8e5600640 1 --2- 172.21.15.99:0/561988075 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc8cc003b40 0x7fc8cc003f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:50.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.092+0000 7fc8e5600640 1 --2- 172.21.15.99:0/561988075 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8cc004800 0x7fc8cc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:50.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.092+0000 7fc8e5600640 1 --2- 172.21.15.99:0/561988075 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8cc0051c0 0x7fc8cc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:50.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.092+0000 7fc8e5600640 1 -- 172.21.15.99:0/561988075 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e80d6810 con 0x7fc8cc0051c0 2024-02-21T23:07:50.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.092+0000 7fc8e5600640 1 -- 172.21.15.99:0/561988075 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8cc00c0f0 con 0x7fc8cc004800 2024-02-21T23:07:50.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.092+0000 7fc8e5600640 1 -- 172.21.15.99:0/561988075 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8cc00c2f0 con 0x7fc8cc003b40 2024-02-21T23:07:50.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.092+0000 7fc8e6000640 1 --2- 172.21.15.99:0/561988075 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8cc004800 0x7fc8cc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:50.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.093+0000 7fc8e6a00640 1 --2- 172.21.15.99:0/561988075 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc8cc003b40 0x7fc8cc003f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:50.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.093+0000 7fc8e6000640 1 -- 172.21.15.99:0/561988075 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc8cc003b40 msgr2=0x7fc8cc003f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:50.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.093+0000 7fc8e6000640 1 --2- 172.21.15.99:0/561988075 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc8cc003b40 0x7fc8cc003f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:50.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.093+0000 7fc8e6000640 1 -- 172.21.15.99:0/561988075 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8cc0051c0 msgr2=0x7fc8cc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:50.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.093+0000 7fc8e6000640 1 --2- 172.21.15.99:0/561988075 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8cc0051c0 0x7fc8cc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:50.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.093+0000 7fc8e6000640 1 -- 172.21.15.99:0/561988075 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8e80d6af0 con 0x7fc8cc004800 2024-02-21T23:07:50.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.093+0000 7fc8e6a00640 1 --2- 172.21.15.99:0/561988075 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc8cc003b40 0x7fc8cc003f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T23:07:50.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.093+0000 7fc8e7400640 1 -- 172.21.15.99:0/561988075 reap_dead start 2024-02-21T23:07:50.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.095+0000 7fc8e6000640 1 --2- 172.21.15.99:0/561988075 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8cc004800 0x7fc8cc004c80 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fc8d400c190 tx=0x7fc8cc005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12e22bf131dd5baf server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:50.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.095+0000 7fc8e5600640 1 -- 172.21.15.99:0/561988075 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d4007c20 con 0x7fc8cc004800 2024-02-21T23:07:50.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.095+0000 7fc8e5600640 1 -- 172.21.15.99:0/561988075 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8d4030070 con 0x7fc8cc004800 2024-02-21T23:07:50.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.095+0000 7fc8e5600640 1 -- 172.21.15.99:0/561988075 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d4005d50 con 0x7fc8cc004800 2024-02-21T23:07:50.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.096+0000 7fc8e7e00640 1 -- 172.21.15.99:0/561988075 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8cc004800 msgr2=0x7fc8cc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:50.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.096+0000 7fc8e7e00640 1 --2- 172.21.15.99:0/561988075 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8cc004800 0x7fc8cc004c80 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fc8d400c190 tx=0x7fc8cc005830 comp rx=0 tx=0).stop 2024-02-21T23:07:50.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.097+0000 7fc8e7e00640 1 -- 172.21.15.99:0/561988075 shutdown_connections 2024-02-21T23:07:50.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.097+0000 7fc8e7e00640 1 --2- 172.21.15.99:0/561988075 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8cc004800 0x7fc8cc004c80 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:50.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.097+0000 7fc8e7e00640 1 -- 172.21.15.99:0/561988075 >> 172.21.15.99:0/561988075 conn(0x7fc8e80d29b0 msgr2=0x7fc8e80d2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:07:50.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.097+0000 7fc8e7e00640 1 -- 172.21.15.99:0/561988075 shutdown_connections 2024-02-21T23:07:50.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.097+0000 7fc8e7e00640 1 -- 172.21.15.99:0/561988075 wait complete. 2024-02-21T23:07:50.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.101+0000 7fc8e7e00640 1 Processor -- start 2024-02-21T23:07:50.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.101+0000 7fc8e7e00640 1 -- start start 2024-02-21T23:07:50.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.103+0000 7fc8e7e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc8cc004800 0x7fc8e816eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:50.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.103+0000 7fc8e7e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8e818ca30 0x7fc8e815acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:50.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.103+0000 7fc8e7e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8e817e4a0 0x7fc8e82261e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:50.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.103+0000 7fc8e7e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e818a600 con 0x7fc8e818ca30 2024-02-21T23:07:50.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.103+0000 7fc8e7e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e818a320 con 0x7fc8e817e4a0 2024-02-21T23:07:50.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.104+0000 7fc8e7e00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e817f870 con 0x7fc8cc004800 2024-02-21T23:07:50.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.104+0000 7fc8e6a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc8cc004800 0x7fc8e816eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:50.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.104+0000 7fc8e6a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc8cc004800 0x7fc8e816eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:59400/0 (socket says 172.21.15.99:59400) 2024-02-21T23:07:50.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.104+0000 7fc8e6a00640 1 -- 172.21.15.99:0/4180097473 learned_addr learned my addr 172.21.15.99:0/4180097473 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:07:50.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.104+0000 7fc8e7400640 1 --2- 172.21.15.99:0/4180097473 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8e817e4a0 0x7fc8e82261e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:50.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.104+0000 7fc8e6000640 1 --2- 172.21.15.99:0/4180097473 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8e818ca30 0x7fc8e815acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:50.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.105+0000 7fc8e6a00640 1 -- 172.21.15.99:0/4180097473 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8e817e4a0 msgr2=0x7fc8e82261e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:50.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.105+0000 7fc8e6a00640 1 --2- 172.21.15.99:0/4180097473 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8e817e4a0 0x7fc8e82261e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:50.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.105+0000 7fc8e6a00640 1 -- 172.21.15.99:0/4180097473 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8e818ca30 msgr2=0x7fc8e815acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:50.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.105+0000 7fc8e6a00640 1 --2- 172.21.15.99:0/4180097473 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8e818ca30 0x7fc8e815acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:50.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.105+0000 7fc8e6a00640 1 -- 172.21.15.99:0/4180097473 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8e806cc10 con 0x7fc8cc004800 2024-02-21T23:07:50.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.105+0000 7fc8e6000640 1 --2- 172.21.15.99:0/4180097473 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8e818ca30 0x7fc8e815acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:07:50.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.106+0000 7fc8e6a00640 1 --2- 172.21.15.99:0/4180097473 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc8cc004800 0x7fc8e816eaf0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fc8e000f150 tx=0x7fc8e000f610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:50.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.106+0000 7fc8dea00640 1 -- 172.21.15.99:0/4180097473 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e0018020 con 0x7fc8cc004800 2024-02-21T23:07:50.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.106+0000 7fc8dea00640 1 -- 172.21.15.99:0/4180097473 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8e0014600 con 0x7fc8cc004800 2024-02-21T23:07:50.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.106+0000 7fc8e7e00640 1 -- 172.21.15.99:0/4180097473 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8e806c930 con 0x7fc8cc004800 2024-02-21T23:07:50.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.106+0000 7fc8dea00640 1 -- 172.21.15.99:0/4180097473 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e00149b0 con 0x7fc8cc004800 2024-02-21T23:07:50.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.106+0000 7fc8e7e00640 1 -- 172.21.15.99:0/4180097473 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8e817d9c0 con 0x7fc8cc004800 2024-02-21T23:07:50.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.110+0000 7fc8dea00640 1 -- 172.21.15.99:0/4180097473 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7fc8e001b020 con 0x7fc8cc004800 2024-02-21T23:07:50.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.114+0000 7fc8dea00640 1 --2- 172.21.15.99:0/4180097473 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fc8c809ef00 0x7fc8c80a13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:50.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.114+0000 7fc8dea00640 1 -- 172.21.15.99:0/4180097473 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7fc8e00cac80 con 0x7fc8cc004800 2024-02-21T23:07:50.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.114+0000 7fc8e6000640 1 --2- 172.21.15.99:0/4180097473 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fc8c809ef00 0x7fc8c80a13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:50.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.115+0000 7fc8f0660740 1 Processor -- start 2024-02-21T23:07:50.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.116+0000 7fc8f0660740 1 -- start start 2024-02-21T23:07:50.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.116+0000 7fc8e6000640 1 --2- 172.21.15.99:0/4180097473 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fc8c809ef00 0x7fc8c80a13c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc8d4034000 tx=0x7fc8d402f000 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:50.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.118+0000 7fc8f0660740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56352ad922a0 0x56352adc7d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:50.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.119+0000 7fc8f0660740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56352adc8260 0x56352ad92680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:50.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.119+0000 7fc8f0660740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56352ad92bc0 0x56352ad551d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:50.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.119+0000 7fc8f0660740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x56352acbea90 con 0x56352ad922a0 2024-02-21T23:07:50.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.119+0000 7fc8f0660740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x56352ac67b10 con 0x56352ad92bc0 2024-02-21T23:07:50.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.119+0000 7fc8f0660740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x56352acbab30 con 0x56352adc8260 2024-02-21T23:07:50.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.119+0000 7fc8e6000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56352adc8260 0x56352ad92680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:50.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.119+0000 7fc8e6000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56352adc8260 0x56352ad92680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:59414/0 (socket says 172.21.15.99:59414) 2024-02-21T23:07:50.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.119+0000 7fc8e6000640 1 -- 172.21.15.99:0/3613609073 learned_addr learned my addr 172.21.15.99:0/3613609073 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:07:50.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.120+0000 7fc8e6a00640 1 --2- 172.21.15.99:0/3613609073 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56352ad922a0 0x56352adc7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:50.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.120+0000 7fc8e7400640 1 --2- 172.21.15.99:0/3613609073 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56352ad92bc0 0x56352ad551d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:50.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.120+0000 7fc8e6000640 1 -- 172.21.15.99:0/3613609073 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56352ad92bc0 msgr2=0x56352ad551d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:50.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.120+0000 7fc8e6000640 1 --2- 172.21.15.99:0/3613609073 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56352ad92bc0 0x56352ad551d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:50.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.120+0000 7fc8e6000640 1 -- 172.21.15.99:0/3613609073 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56352ad922a0 msgr2=0x56352adc7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:50.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.120+0000 7fc8e6000640 1 --2- 172.21.15.99:0/3613609073 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56352ad922a0 0x56352adc7d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:50.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.120+0000 7fc8e6000640 1 -- 172.21.15.99:0/3613609073 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56352aa9d7d0 con 0x56352adc8260 2024-02-21T23:07:50.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.121+0000 7fc8e6000640 1 --2- 172.21.15.99:0/3613609073 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56352adc8260 0x56352ad92680 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fc8d400c280 tx=0x7fc8d4009030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8fe9782511fa08db server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:50.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.122+0000 7fc8d3400640 1 -- 172.21.15.99:0/3613609073 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d4004e60 con 0x56352adc8260 2024-02-21T23:07:50.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.122+0000 7fc8d3400640 1 -- 172.21.15.99:0/3613609073 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8d402ccc0 con 0x56352adc8260 2024-02-21T23:07:50.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.122+0000 7fc8d3400640 1 -- 172.21.15.99:0/3613609073 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d4004e60 con 0x56352adc8260 2024-02-21T23:07:50.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.123+0000 7fc8f0660740 1 -- 172.21.15.99:0/3613609073 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56352adc8260 msgr2=0x56352ad92680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:50.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.123+0000 7fc8f0660740 1 --2- 172.21.15.99:0/3613609073 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56352adc8260 0x56352ad92680 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fc8d400c280 tx=0x7fc8d4009030 comp rx=0 tx=0).stop 2024-02-21T23:07:50.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.124+0000 7fc8f0660740 1 -- 172.21.15.99:0/3613609073 shutdown_connections 2024-02-21T23:07:50.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.124+0000 7fc8f0660740 1 --2- 172.21.15.99:0/3613609073 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56352ad92bc0 0x56352ad551d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:50.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.124+0000 7fc8f0660740 1 --2- 172.21.15.99:0/3613609073 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56352adc8260 0x56352ad92680 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:50.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.124+0000 7fc8f0660740 1 --2- 172.21.15.99:0/3613609073 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56352ad922a0 0x56352adc7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:50.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.124+0000 7fc8f0660740 1 -- 172.21.15.99:0/3613609073 >> 172.21.15.99:0/3613609073 conn(0x56352ad216b0 msgr2=0x56352ad59190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:07:50.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.124+0000 7fc8f0660740 1 -- 172.21.15.99:0/3613609073 shutdown_connections 2024-02-21T23:07:50.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.124+0000 7fc8f0660740 1 -- 172.21.15.99:0/3613609073 wait complete. 2024-02-21T23:07:50.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.126+0000 7fc8f0660740 1 -- start start 2024-02-21T23:07:50.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.126+0000 7fc8f0660740 1 Processor -- start 2024-02-21T23:07:50.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.128+0000 7fc8f0660740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56352ad922a0 0x56352ad81500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:50.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.128+0000 7fc8f0660740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56352ad92bc0 0x56352adddd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:50.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.128+0000 7fc8f0660740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56352adc8260 0x56352ad90340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:50.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.128+0000 7fc8f0660740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x56352acbab30 con 0x56352ad922a0 2024-02-21T23:07:50.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.128+0000 7fc8f0660740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x56352ac5d1c0 con 0x56352ad92bc0 2024-02-21T23:07:50.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.128+0000 7fc8f0660740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x56352ad60f30 con 0x56352adc8260 2024-02-21T23:07:50.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.128+0000 7fc8f0660740 10 client.0 _ll_register_callbacks cb 0x56352ac7a930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:07:50.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.129+0000 7fc8e7400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56352adc8260 0x56352ad90340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:50.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.129+0000 7fc8e7400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56352adc8260 0x56352ad90340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:59420/0 (socket says 172.21.15.99:59420) 2024-02-21T23:07:50.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.129+0000 7fc8e7400640 1 -- 172.21.15.99:0/827820453 learned_addr learned my addr 172.21.15.99:0/827820453 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:07:50.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.129+0000 7fc8e6000640 1 --2- 172.21.15.99:0/827820453 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56352ad92bc0 0x56352adddd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:50.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.130+0000 7fc8e7400640 1 -- 172.21.15.99:0/827820453 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56352ad92bc0 msgr2=0x56352adddd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:50.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.130+0000 7fc8e7400640 1 --2- 172.21.15.99:0/827820453 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56352ad92bc0 0x56352adddd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:50.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.130+0000 7fc8e7400640 1 -- 172.21.15.99:0/827820453 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56352ad922a0 msgr2=0x56352ad81500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:50.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.130+0000 7fc8e7400640 1 --2- 172.21.15.99:0/827820453 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56352ad922a0 0x56352ad81500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:50.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.130+0000 7fc8e7400640 1 -- 172.21.15.99:0/827820453 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56352a9d33f0 con 0x56352adc8260 2024-02-21T23:07:50.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.130+0000 7fc8e7400640 1 --2- 172.21.15.99:0/827820453 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56352adc8260 0x56352ad90340 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fc8e818bf60 tx=0x7fc8d800f5a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b1749b63f75164a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:50.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.130+0000 7fc8c7e00640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-02-21T23:07:50.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.130+0000 7fc8c7e00640 1 -- 172.21.15.99:0/827820453 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d8017030 con 0x56352adc8260 2024-02-21T23:07:50.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.131+0000 7fc8f0660740 1 -- 172.21.15.99:0/827820453 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc8d402ccc0 con 0x56352adc8260 2024-02-21T23:07:50.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.131+0000 7fc8c7e00640 1 -- 172.21.15.99:0/827820453 <== mon.2 v2:172.21.15.181:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7fc8d8010040 con 0x56352adc8260 2024-02-21T23:07:50.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.131+0000 7fc8c7e00640 1 -- 172.21.15.99:0/827820453 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc8d800fe10 con 0x56352adc8260 2024-02-21T23:07:50.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.131+0000 7fc8f0660740 10 client.6383 fetch_fsmap learned FSMap version 17 2024-02-21T23:07:50.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.131+0000 7fc8f0660740 1 -- 172.21.15.99:0/827820453 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x56352a9930f0 con 0x56352adc8260 2024-02-21T23:07:50.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.132+0000 7fc8c7e00640 1 -- 172.21.15.99:0/827820453 <== mon.2 v2:172.21.15.181:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8d402ccc0 con 0x56352adc8260 2024-02-21T23:07:50.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.132+0000 7fc8c7e00640 1 -- 172.21.15.99:0/827820453 <== mon.2 v2:172.21.15.181:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fc8d8004020 con 0x56352adc8260 2024-02-21T23:07:50.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.132+0000 7fc8f0660740 10 client.6383 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:07:50.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.132+0000 7fc8f0660740 10 client.6383 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:07:50.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.132+0000 7fc8f0660740 20 client.6383 populate_metadata read hostname 'smithi099' 2024-02-21T23:07:50.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.132+0000 7fc8f0660740 1 --2- 172.21.15.99:0/827820453 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x56352ad90a90 0x56352ad9df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:50.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.132+0000 7fc8f0660740 4 client.6383 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:07:50.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.132+0000 7fc8f0660740 1 -- 172.21.15.99:0/827820453 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56352accbfd0 con 0x56352ad90a90 2024-02-21T23:07:50.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.133+0000 7fc8e6a00640 1 --2- 172.21.15.99:0/827820453 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x56352ad90a90 0x56352ad9df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:50.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.134+0000 7fc8e6a00640 1 --2- 172.21.15.99:0/827820453 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x56352ad90a90 0x56352ad9df10 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3cf8238c19ebedf4 server_cookie=e5129341b8bcd28a in_seq=0 out_seq=0 2024-02-21T23:07:50.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.134+0000 7fc8c7e00640 10 client.6383 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:07:50.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.135+0000 7fc8c7e00640 1 -- 172.21.15.99:0/827820453 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x56352accbfd0 con 0x56352ad90a90 2024-02-21T23:07:50.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.135+0000 7fc8c7e00640 10 client.6383 handle_command_reply: tid=0 2024-02-21T23:07:50.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.135+0000 7fc8f0660740 1 client.6383 shutdown 2024-02-21T23:07:50.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.136+0000 7fc8f0660740 1 -- 172.21.15.99:0/827820453 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56352adc8260 msgr2=0x56352ad90340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:50.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.136+0000 7fc8f0660740 1 --2- 172.21.15.99:0/827820453 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56352adc8260 0x56352ad90340 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fc8e818bf60 tx=0x7fc8d800f5a0 comp rx=0 tx=0).stop 2024-02-21T23:07:50.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.136+0000 7fc8f0660740 1 -- 172.21.15.99:0/827820453 shutdown_connections 2024-02-21T23:07:50.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.136+0000 7fc8f0660740 1 --2- 172.21.15.99:0/827820453 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x56352ad90a90 0x56352ad9df10 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:50.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.136+0000 7fc8f0660740 1 --2- 172.21.15.99:0/827820453 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56352adc8260 0x56352ad90340 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:50.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.136+0000 7fc8f0660740 1 --2- 172.21.15.99:0/827820453 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56352ad92bc0 0x56352adddd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:50.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.136+0000 7fc8f0660740 1 --2- 172.21.15.99:0/827820453 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56352ad922a0 0x56352ad81500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:50.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.136+0000 7fc8c7e00640 0 client.6383 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:07:50.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.136+0000 7fc8f0660740 1 -- 172.21.15.99:0/827820453 >> 172.21.15.99:0/827820453 conn(0x56352ad216b0 msgr2=0x56352ad59150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:07:50.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.136+0000 7fc8f0660740 1 -- 172.21.15.99:0/827820453 shutdown_connections 2024-02-21T23:07:50.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.136+0000 7fc8f0660740 1 -- 172.21.15.99:0/827820453 wait complete. 2024-02-21T23:07:50.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.137+0000 7fc8f0660740 20 client.6383 trim_cache size 0 max 16384 2024-02-21T23:07:50.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.177+0000 7fc8f0660740 1 Processor -- start 2024-02-21T23:07:50.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.177+0000 7fc8f0660740 1 -- start start 2024-02-21T23:07:50.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.179+0000 7fc8f0660740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56352ad922a0 0x56352ad592f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:50.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.179+0000 7fc8f0660740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56352ad92bc0 0x56352ad9be90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:50.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.179+0000 7fc8f0660740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56352adc8260 0x56352ae30b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:50.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.179+0000 7fc8f0660740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e8231160 con 0x56352adc8260 2024-02-21T23:07:50.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.179+0000 7fc8f0660740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e822ed00 con 0x56352ad92bc0 2024-02-21T23:07:50.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.179+0000 7fc8f0660740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e815fd90 con 0x56352ad922a0 2024-02-21T23:07:50.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.179+0000 7fc8e6000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56352ad92bc0 0x56352ad9be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:50.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.179+0000 7fc8e6000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56352ad92bc0 0x56352ad9be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:37140/0 (socket says 172.21.15.99:37140) 2024-02-21T23:07:50.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.179+0000 7fc8e6000640 1 -- 172.21.15.99:0/2760232105 learned_addr learned my addr 172.21.15.99:0/2760232105 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:07:50.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.180+0000 7fc8e7400640 1 --2- 172.21.15.99:0/2760232105 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56352adc8260 0x56352ae30b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:50.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.180+0000 7fc8e6a00640 1 --2- 172.21.15.99:0/2760232105 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56352ad922a0 0x56352ad592f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:50.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.180+0000 7fc8e6000640 1 -- 172.21.15.99:0/2760232105 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56352ad922a0 msgr2=0x56352ad592f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:50.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.180+0000 7fc8e6000640 1 --2- 172.21.15.99:0/2760232105 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56352ad922a0 0x56352ad592f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:50.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.180+0000 7fc8e6000640 1 -- 172.21.15.99:0/2760232105 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56352adc8260 msgr2=0x56352ae30b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:50.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.180+0000 7fc8e6000640 1 --2- 172.21.15.99:0/2760232105 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56352adc8260 0x56352ae30b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:50.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.180+0000 7fc8e6000640 1 -- 172.21.15.99:0/2760232105 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56352adcc540 con 0x56352ad92bc0 2024-02-21T23:07:50.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.180+0000 7fc8e6a00640 1 --2- 172.21.15.99:0/2760232105 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56352ad922a0 0x56352ad592f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T23:07:50.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.180+0000 7fc8e7400640 1 --2- 172.21.15.99:0/2760232105 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56352adc8260 0x56352ae30b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:07:50.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.181+0000 7fc8e6000640 1 --2- 172.21.15.99:0/2760232105 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56352ad92bc0 0x56352ad9be90 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x56352adcc950 tx=0x7fc8d4001d90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d2e23d80bae85ab server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:50.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.181+0000 7fc8d2a00640 1 -- 172.21.15.99:0/2760232105 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d405a070 con 0x56352ad92bc0 2024-02-21T23:07:50.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.181+0000 7fc8d2a00640 1 -- 172.21.15.99:0/2760232105 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8d4007070 con 0x56352ad92bc0 2024-02-21T23:07:50.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.181+0000 7fc8d2a00640 1 -- 172.21.15.99:0/2760232105 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d4004e60 con 0x56352ad92bc0 2024-02-21T23:07:50.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.182+0000 7fc8f0660740 1 -- 172.21.15.99:0/2760232105 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56352ad92bc0 msgr2=0x56352ad9be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:50.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.182+0000 7fc8f0660740 1 --2- 172.21.15.99:0/2760232105 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56352ad92bc0 0x56352ad9be90 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x56352adcc950 tx=0x7fc8d4001d90 comp rx=0 tx=0).stop 2024-02-21T23:07:50.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.182+0000 7fc8f0660740 1 -- 172.21.15.99:0/2760232105 shutdown_connections 2024-02-21T23:07:50.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.182+0000 7fc8f0660740 1 --2- 172.21.15.99:0/2760232105 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56352adc8260 0x56352ae30b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:50.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.182+0000 7fc8f0660740 1 --2- 172.21.15.99:0/2760232105 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56352ad92bc0 0x56352ad9be90 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:50.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.182+0000 7fc8f0660740 1 --2- 172.21.15.99:0/2760232105 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56352ad922a0 0x56352ad592f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:50.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.182+0000 7fc8f0660740 1 -- 172.21.15.99:0/2760232105 >> 172.21.15.99:0/2760232105 conn(0x56352ad216b0 msgr2=0x56352adddb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:07:50.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.182+0000 7fc8f0660740 1 -- 172.21.15.99:0/2760232105 shutdown_connections 2024-02-21T23:07:50.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.182+0000 7fc8f0660740 1 -- 172.21.15.99:0/2760232105 wait complete. 2024-02-21T23:07:50.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.183+0000 7fc8f0660740 1 -- start start 2024-02-21T23:07:50.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.184+0000 7fc8f0660740 1 Processor -- start 2024-02-21T23:07:50.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.186+0000 7fc8f0660740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56352ad922a0 0x56352ae2f620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:50.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.186+0000 7fc8f0660740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56352ad92bc0 0x56352adc24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:50.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.186+0000 7fc8f0660740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56352adc8260 0x56352ae2cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:50.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.186+0000 7fc8f0660740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e822d400 con 0x56352ad922a0 2024-02-21T23:07:50.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.186+0000 7fc8f0660740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e822e6a0 con 0x56352adc8260 2024-02-21T23:07:50.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.186+0000 7fc8f0660740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e822da00 con 0x56352ad92bc0 2024-02-21T23:07:50.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.186+0000 7fc8f0660740 10 client.0 _ll_register_callbacks cb 0x7fc8d8001960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:07:50.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.186+0000 7fc8e7400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56352adc8260 0x56352ae2cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:50.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.186+0000 7fc8e7400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56352adc8260 0x56352ae2cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:37154/0 (socket says 172.21.15.99:37154) 2024-02-21T23:07:50.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.186+0000 7fc8e7400640 1 -- 172.21.15.99:0/1642360754 learned_addr learned my addr 172.21.15.99:0/1642360754 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:07:50.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.187+0000 7fc8e6a00640 1 --2- 172.21.15.99:0/1642360754 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56352ad922a0 0x56352ae2f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:50.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.187+0000 7fc8e7400640 1 -- 172.21.15.99:0/1642360754 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56352ad92bc0 msgr2=0x56352adc24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:50.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.187+0000 7fc8e7400640 1 --2- 172.21.15.99:0/1642360754 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56352ad92bc0 0x56352adc24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:50.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.187+0000 7fc8e7400640 1 -- 172.21.15.99:0/1642360754 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56352ad922a0 msgr2=0x56352ae2f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:07:50.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.187+0000 7fc8e7400640 1 --2- 172.21.15.99:0/1642360754 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56352ad922a0 0x56352ae2f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:50.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.187+0000 7fc8e7400640 1 -- 172.21.15.99:0/1642360754 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56352ad81310 con 0x56352adc8260 2024-02-21T23:07:50.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.187+0000 7fc8e7400640 1 --2- 172.21.15.99:0/1642360754 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56352adc8260 0x56352ae2cde0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fc8d8004610 tx=0x7fc8d80012b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d93c5daaaf7a8e4 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:07:50.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.187+0000 7fc8c7e00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-02-21T23:07:50.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.188+0000 7fc8c7e00640 1 -- 172.21.15.99:0/1642360754 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d802a060 con 0x56352adc8260 2024-02-21T23:07:50.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.188+0000 7fc8c7e00640 1 -- 172.21.15.99:0/1642360754 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7fc8d8005bd0 con 0x56352adc8260 2024-02-21T23:07:50.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.188+0000 7fc8f0660740 1 -- 172.21.15.99:0/1642360754 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc8d4007070 con 0x56352adc8260 2024-02-21T23:07:50.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.188+0000 7fc8c7e00640 1 -- 172.21.15.99:0/1642360754 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc8d8017070 con 0x56352adc8260 2024-02-21T23:07:50.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.188+0000 7fc8f0660740 10 client.6385 fetch_fsmap learned FSMap version 17 2024-02-21T23:07:50.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.188+0000 7fc8f0660740 1 -- 172.21.15.99:0/1642360754 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x56352adc7f80 con 0x56352adc8260 2024-02-21T23:07:50.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.189+0000 7fc8c7e00640 1 -- 172.21.15.99:0/1642360754 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8d4007070 con 0x56352adc8260 2024-02-21T23:07:50.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.189+0000 7fc8c7e00640 1 -- 172.21.15.99:0/1642360754 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fc8d802f420 con 0x56352adc8260 2024-02-21T23:07:50.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.189+0000 7fc8f0660740 10 client.6385 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:07:50.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.189+0000 7fc8f0660740 10 client.6385 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:07:50.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.189+0000 7fc8f0660740 20 client.6385 populate_metadata read hostname 'smithi099' 2024-02-21T23:07:50.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.189+0000 7fc8f0660740 1 --2- 172.21.15.99:0/1642360754 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x56352adc7a00 0x56352ad87df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:07:50.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.189+0000 7fc8f0660740 4 client.6385 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T23:07:50.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.189+0000 7fc8f0660740 1 -- 172.21.15.99:0/1642360754 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56352acc6320 con 0x56352adc7a00 2024-02-21T23:07:50.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.190+0000 7fc8e6a00640 1 --2- 172.21.15.99:0/1642360754 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x56352adc7a00 0x56352ad87df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:07:50.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.191+0000 7fc8e6a00640 1 --2- 172.21.15.99:0/1642360754 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x56352adc7a00 0x56352ad87df0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dbfd359da9a4cbd1 server_cookie=3c8a2f87b64516b6 in_seq=0 out_seq=0 2024-02-21T23:07:50.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.191+0000 7fc8c7e00640 10 client.6385 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:07:50.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.192+0000 7fc8c7e00640 1 -- 172.21.15.99:0/1642360754 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x56352acc6320 con 0x56352adc7a00 2024-02-21T23:07:50.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.192+0000 7fc8c7e00640 10 client.6385 handle_command_reply: tid=0 2024-02-21T23:07:50.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.192+0000 7fc8f0660740 1 client.6385 shutdown 2024-02-21T23:07:50.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.192+0000 7fc8f0660740 1 -- 172.21.15.99:0/1642360754 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56352adc8260 msgr2=0x56352ae2cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:50.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.192+0000 7fc8f0660740 1 --2- 172.21.15.99:0/1642360754 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56352adc8260 0x56352ae2cde0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fc8d8004610 tx=0x7fc8d80012b0 comp rx=0 tx=0).stop 2024-02-21T23:07:50.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.192+0000 7fc8f0660740 1 -- 172.21.15.99:0/1642360754 shutdown_connections 2024-02-21T23:07:50.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.192+0000 7fc8f0660740 1 --2- 172.21.15.99:0/1642360754 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x56352adc7a00 0x56352ad87df0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:50.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.192+0000 7fc8f0660740 1 --2- 172.21.15.99:0/1642360754 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56352adc8260 0x56352ae2cde0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:50.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.192+0000 7fc8f0660740 1 --2- 172.21.15.99:0/1642360754 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56352ad92bc0 0x56352adc24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:50.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.192+0000 7fc8f0660740 1 --2- 172.21.15.99:0/1642360754 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56352ad922a0 0x56352ae2f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:50.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.192+0000 7fc8c7e00640 0 client.6385 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:07:50.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.192+0000 7fc8f0660740 1 -- 172.21.15.99:0/1642360754 >> 172.21.15.99:0/1642360754 conn(0x56352ad216b0 msgr2=0x56352ad580a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:07:50.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.193+0000 7fc8f0660740 1 -- 172.21.15.99:0/1642360754 shutdown_connections 2024-02-21T23:07:50.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.193+0000 7fc8f0660740 1 -- 172.21.15.99:0/1642360754 wait complete. 2024-02-21T23:07:50.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.193+0000 7fc8f0660740 20 client.6385 trim_cache size 0 max 16384 2024-02-21T23:07:50.190 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-02-21T23:07:50.190 INFO:teuthology.orchestra.run.smithi099.stdout: "status": "scrub active (917 inodes in the stack)", 2024-02-21T23:07:50.190 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubs": { 2024-02-21T23:07:50.191 INFO:teuthology.orchestra.run.smithi099.stdout: "404b0fa2-81e3-4e8c-bac6-27c243dcdd91": { 2024-02-21T23:07:50.191 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/", 2024-02-21T23:07:50.191 INFO:teuthology.orchestra.run.smithi099.stdout: "tag": "404b0fa2-81e3-4e8c-bac6-27c243dcdd91", 2024-02-21T23:07:50.191 INFO:teuthology.orchestra.run.smithi099.stdout: "options": "recursive,force" 2024-02-21T23:07:50.191 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:07:50.191 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:07:50.191 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-02-21T23:07:50.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.194+0000 7fc8e7e00640 1 -- 172.21.15.99:0/4180097473 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fc8c809ef00 msgr2=0x7fc8c80a13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:50.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.194+0000 7fc8e7e00640 1 --2- 172.21.15.99:0/4180097473 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fc8c809ef00 0x7fc8c80a13c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc8d4034000 tx=0x7fc8d402f000 comp rx=0 tx=0).stop 2024-02-21T23:07:50.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.194+0000 7fc8e7e00640 1 -- 172.21.15.99:0/4180097473 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc8cc004800 msgr2=0x7fc8e816eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:07:50.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.194+0000 7fc8e7e00640 1 --2- 172.21.15.99:0/4180097473 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc8cc004800 0x7fc8e816eaf0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fc8e000f150 tx=0x7fc8e000f610 comp rx=0 tx=0).stop 2024-02-21T23:07:50.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.195+0000 7fc8e7e00640 1 -- 172.21.15.99:0/4180097473 shutdown_connections 2024-02-21T23:07:50.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.195+0000 7fc8e7e00640 1 --2- 172.21.15.99:0/4180097473 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fc8c809ef00 0x7fc8c80a13c0 secure :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc8d4034000 tx=0x7fc8d402f000 comp rx=0 tx=0).stop 2024-02-21T23:07:50.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.195+0000 7fc8e7e00640 1 --2- 172.21.15.99:0/4180097473 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8e817e4a0 0x7fc8e82261e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:50.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.195+0000 7fc8e7e00640 1 --2- 172.21.15.99:0/4180097473 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8e818ca30 0x7fc8e815acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:50.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.195+0000 7fc8e7e00640 1 --2- 172.21.15.99:0/4180097473 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc8cc004800 0x7fc8e816eaf0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:07:50.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.195+0000 7fc8e7e00640 1 -- 172.21.15.99:0/4180097473 >> 172.21.15.99:0/4180097473 conn(0x7fc8e80d29b0 msgr2=0x7fc8e80d2d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:07:50.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.195+0000 7fc8e7e00640 1 -- 172.21.15.99:0/4180097473 shutdown_connections 2024-02-21T23:07:50.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:07:50.195+0000 7fc8e7e00640 1 -- 172.21.15.99:0/4180097473 wait complete. 2024-02-21T23:07:50.209 INFO:tasks.cephfs.filesystem:scrub status for tag:404b0fa2-81e3-4e8c-bac6-27c243dcdd91 - {'path': '/', 'tag': '404b0fa2-81e3-4e8c-bac6-27c243dcdd91', 'options': 'recursive,force'} 2024-02-21T23:08:13.048 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:08:13.059 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:08:13.062 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:08:20.210 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T23:08:20.210 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T23:08:20.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.425+0000 7f9331600640 1 Processor -- start 2024-02-21T23:08:20.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.426+0000 7f9331600640 1 -- start start 2024-02-21T23:08:20.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.429+0000 7f9331600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f932c18b230 0x7f932c0fc280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:20.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.429+0000 7f9331600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f932c0d6dd0 con 0x7f932c0fc7c0 2024-02-21T23:08:20.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.429+0000 7f9331600640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f932c1614c0 con 0x7f932c17f490 2024-02-21T23:08:20.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.429+0000 7f9331600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f932c0d6810 con 0x7f932c18b230 2024-02-21T23:08:20.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.429+0000 7f9323e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f932c18b230 0x7f932c0fc280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:20.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.429+0000 7f9323e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f932c18b230 0x7f932c0fc280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:41586/0 (socket says 172.21.15.99:41586) 2024-02-21T23:08:20.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.429+0000 7f9323e00640 1 -- 172.21.15.99:0/602547021 learned_addr learned my addr 172.21.15.99:0/602547021 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:08:20.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.429+0000 7f932be00640 1 --1- 172.21.15.99:0/602547021 >> v1:172.21.15.181:6789/0 conn(0x7f932c17f490 0x7f932c18ab20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:52652/0 (socket says 172.21.15.99:52652) 2024-02-21T23:08:20.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.430+0000 7f932b400640 1 -- 172.21.15.99:0/602547021 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3570264345 0 0) 0x7f932c1614c0 con 0x7f932c17f490 2024-02-21T23:08:20.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.430+0000 7f932b400640 1 -- 172.21.15.99:0/602547021 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9310003520 con 0x7f932c17f490 2024-02-21T23:08:20.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.430+0000 7f9323e00640 1 -- 172.21.15.99:0/602547021 >> v1:172.21.15.181:6789/0 conn(0x7f932c17f490 legacy=0x7f932c18ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:20.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.430+0000 7f9323e00640 1 -- 172.21.15.99:0/602547021 >> v1:172.21.15.162:6789/0 conn(0x7f932c0fc7c0 legacy=0x7f932c0fcc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:20.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.430+0000 7f9323e00640 1 -- 172.21.15.99:0/602547021 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f932c0d6af0 con 0x7f932c18b230 2024-02-21T23:08:20.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.431+0000 7f9323e00640 1 --2- 172.21.15.99:0/602547021 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f932c18b230 0x7f932c0fc280 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f9314009870 tx=0x7f931402b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97206731442e8f5f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:20.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.431+0000 7f932b400640 1 -- 172.21.15.99:0/602547021 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9314034070 con 0x7f932c18b230 2024-02-21T23:08:20.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.431+0000 7f932b400640 1 -- 172.21.15.99:0/602547021 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9314030850 con 0x7f932c18b230 2024-02-21T23:08:20.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.431+0000 7f932b400640 1 -- 172.21.15.99:0/602547021 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9314030c20 con 0x7f932c18b230 2024-02-21T23:08:20.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.432+0000 7f9331600640 1 -- 172.21.15.99:0/602547021 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f932c18b230 msgr2=0x7f932c0fc280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:20.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.432+0000 7f9331600640 1 --2- 172.21.15.99:0/602547021 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f932c18b230 0x7f932c0fc280 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f9314009870 tx=0x7f931402b990 comp rx=0 tx=0).stop 2024-02-21T23:08:20.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.432+0000 7f9331600640 1 -- 172.21.15.99:0/602547021 shutdown_connections 2024-02-21T23:08:20.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.432+0000 7f9331600640 1 --2- 172.21.15.99:0/602547021 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f932c18b230 0x7f932c0fc280 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:20.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.432+0000 7f9331600640 1 -- 172.21.15.99:0/602547021 >> 172.21.15.99:0/602547021 conn(0x7f932c0d29b0 msgr2=0x7f932c0d2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:08:20.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.432+0000 7f9331600640 1 -- 172.21.15.99:0/602547021 shutdown_connections 2024-02-21T23:08:20.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.433+0000 7f9331600640 1 -- 172.21.15.99:0/602547021 wait complete. 2024-02-21T23:08:20.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.434+0000 7f9331600640 1 Processor -- start 2024-02-21T23:08:20.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.435+0000 7f9331600640 1 -- start start 2024-02-21T23:08:20.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.436+0000 7f9331600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f932c0fc7c0 0x7f932c222b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:20.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.436+0000 7f9331600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f932c17f490 0x7f932c1590f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:20.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.436+0000 7f9331600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f932c18b230 0x7f932c159630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:20.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.436+0000 7f9331600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f932c18a600 con 0x7f932c0fc7c0 2024-02-21T23:08:20.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.436+0000 7f9331600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f932c18a320 con 0x7f932c17f490 2024-02-21T23:08:20.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.436+0000 7f9331600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f932c18b6c0 con 0x7f932c18b230 2024-02-21T23:08:20.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.436+0000 7f932be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f932c0fc7c0 0x7f932c222b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:20.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.437+0000 7f932be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f932c0fc7c0 0x7f932c222b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:41602/0 (socket says 172.21.15.99:41602) 2024-02-21T23:08:20.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.437+0000 7f932be00640 1 -- 172.21.15.99:0/3449465661 learned_addr learned my addr 172.21.15.99:0/3449465661 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:08:20.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.437+0000 7f9323e00640 1 --2- 172.21.15.99:0/3449465661 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f932c17f490 0x7f932c1590f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:20.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.437+0000 7f9330c00640 1 --2- 172.21.15.99:0/3449465661 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f932c18b230 0x7f932c159630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:20.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.437+0000 7f932be00640 1 -- 172.21.15.99:0/3449465661 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f932c18b230 msgr2=0x7f932c159630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:20.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.437+0000 7f932be00640 1 --2- 172.21.15.99:0/3449465661 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f932c18b230 0x7f932c159630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:20.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.437+0000 7f932be00640 1 -- 172.21.15.99:0/3449465661 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f932c17f490 msgr2=0x7f932c1590f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:20.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.437+0000 7f932be00640 1 --2- 172.21.15.99:0/3449465661 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f932c17f490 0x7f932c1590f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:20.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.437+0000 7f932be00640 1 -- 172.21.15.99:0/3449465661 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f932c221450 con 0x7f932c0fc7c0 2024-02-21T23:08:20.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.437+0000 7f9323e00640 1 --2- 172.21.15.99:0/3449465661 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f932c17f490 0x7f932c1590f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:08:20.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.437+0000 7f9330c00640 1 --2- 172.21.15.99:0/3449465661 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f932c18b230 0x7f932c159630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:08:20.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.438+0000 7f932be00640 1 --2- 172.21.15.99:0/3449465661 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f932c0fc7c0 0x7f932c222b70 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f931c00c530 tx=0x7f931c00c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:20.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.438+0000 7f9328c00640 1 -- 172.21.15.99:0/3449465661 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931c018070 con 0x7f932c0fc7c0 2024-02-21T23:08:20.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.438+0000 7f9328c00640 1 -- 172.21.15.99:0/3449465661 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f931c0074e0 con 0x7f932c0fc7c0 2024-02-21T23:08:20.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.438+0000 7f9331600640 1 -- 172.21.15.99:0/3449465661 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f932c221730 con 0x7f932c0fc7c0 2024-02-21T23:08:20.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.438+0000 7f9328c00640 1 -- 172.21.15.99:0/3449465661 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931c0049e0 con 0x7f932c0fc7c0 2024-02-21T23:08:20.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.439+0000 7f9331600640 1 -- 172.21.15.99:0/3449465661 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f932c221cf0 con 0x7f932c0fc7c0 2024-02-21T23:08:20.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.441+0000 7f9328c00640 1 -- 172.21.15.99:0/3449465661 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f931c01b070 con 0x7f932c0fc7c0 2024-02-21T23:08:20.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.444+0000 7f9328c00640 1 --2- 172.21.15.99:0/3449465661 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f930809eed0 0x7f93080a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:20.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.444+0000 7f9335b6a740 1 Processor -- start 2024-02-21T23:08:20.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.444+0000 7f9328c00640 1 -- 172.21.15.99:0/3449465661 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f931c0c9430 con 0x7f932c0fc7c0 2024-02-21T23:08:20.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.444+0000 7f9323e00640 1 --2- 172.21.15.99:0/3449465661 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f930809eed0 0x7f93080a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:20.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.444+0000 7f9335b6a740 1 -- start start 2024-02-21T23:08:20.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.445+0000 7f9323e00640 1 --2- 172.21.15.99:0/3449465661 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f930809eed0 0x7f93080a1390 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9314036000 tx=0x7f931403c040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:20.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.446+0000 7f9335b6a740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558e7acb82a0 0x558e7acedd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:20.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.446+0000 7f9335b6a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558e7acee260 0x558e7acb8680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:20.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.446+0000 7f9335b6a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558e7acb8bc0 0x558e7ac7b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:20.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.446+0000 7f9335b6a740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e7abe4a90 con 0x558e7acb82a0 2024-02-21T23:08:20.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.446+0000 7f9335b6a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e7ab8db10 con 0x558e7acee260 2024-02-21T23:08:20.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.446+0000 7f9335b6a740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e7abe0b30 con 0x558e7acb8bc0 2024-02-21T23:08:20.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.446+0000 7f932be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558e7acb82a0 0x558e7acedd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:20.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.446+0000 7f932be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558e7acb82a0 0x558e7acedd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:41616/0 (socket says 172.21.15.99:41616) 2024-02-21T23:08:20.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.446+0000 7f932be00640 1 -- 172.21.15.99:0/4241401549 learned_addr learned my addr 172.21.15.99:0/4241401549 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:08:20.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.446+0000 7f9323e00640 1 --2- 172.21.15.99:0/4241401549 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558e7acee260 0x558e7acb8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:20.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.446+0000 7f9330c00640 1 --2- 172.21.15.99:0/4241401549 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558e7acb8bc0 0x558e7ac7b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:20.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.447+0000 7f932be00640 1 -- 172.21.15.99:0/4241401549 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558e7acb8bc0 msgr2=0x558e7ac7b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:20.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.447+0000 7f932be00640 1 --2- 172.21.15.99:0/4241401549 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558e7acb8bc0 0x558e7ac7b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:20.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.447+0000 7f932be00640 1 -- 172.21.15.99:0/4241401549 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558e7acee260 msgr2=0x558e7acb8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:20.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.447+0000 7f932be00640 1 --2- 172.21.15.99:0/4241401549 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558e7acee260 0x558e7acb8680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:20.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.447+0000 7f932be00640 1 -- 172.21.15.99:0/4241401549 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558e7a9c37d0 con 0x558e7acb82a0 2024-02-21T23:08:20.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.447+0000 7f9323e00640 1 --2- 172.21.15.99:0/4241401549 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558e7acee260 0x558e7acb8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:08:20.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.447+0000 7f932be00640 1 --2- 172.21.15.99:0/4241401549 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558e7acb82a0 0x558e7acedd20 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f931c0c6c30 tx=0x7f931c094f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3167e5b972970a19 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:20.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.447+0000 7f931be00640 1 -- 172.21.15.99:0/4241401549 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931c09f4d0 con 0x558e7acb82a0 2024-02-21T23:08:20.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.447+0000 7f931be00640 1 -- 172.21.15.99:0/4241401549 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f931c093310 con 0x558e7acb82a0 2024-02-21T23:08:20.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.447+0000 7f931be00640 1 -- 172.21.15.99:0/4241401549 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931c09f280 con 0x558e7acb82a0 2024-02-21T23:08:20.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.448+0000 7f9335b6a740 1 -- 172.21.15.99:0/4241401549 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558e7acb82a0 msgr2=0x558e7acedd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:20.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.448+0000 7f9335b6a740 1 --2- 172.21.15.99:0/4241401549 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558e7acb82a0 0x558e7acedd20 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f931c0c6c30 tx=0x7f931c094f30 comp rx=0 tx=0).stop 2024-02-21T23:08:20.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.448+0000 7f9335b6a740 1 -- 172.21.15.99:0/4241401549 shutdown_connections 2024-02-21T23:08:20.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.449+0000 7f9335b6a740 1 --2- 172.21.15.99:0/4241401549 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558e7acb8bc0 0x558e7ac7b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:20.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.449+0000 7f9335b6a740 1 --2- 172.21.15.99:0/4241401549 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558e7acee260 0x558e7acb8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:20.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.449+0000 7f9335b6a740 1 --2- 172.21.15.99:0/4241401549 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558e7acb82a0 0x558e7acedd20 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:20.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.449+0000 7f9335b6a740 1 -- 172.21.15.99:0/4241401549 >> 172.21.15.99:0/4241401549 conn(0x558e7ac476b0 msgr2=0x558e7ac7f190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:08:20.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.449+0000 7f9335b6a740 1 -- 172.21.15.99:0/4241401549 shutdown_connections 2024-02-21T23:08:20.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.449+0000 7f9335b6a740 1 -- 172.21.15.99:0/4241401549 wait complete. 2024-02-21T23:08:20.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.449+0000 7f9335b6a740 1 -- start start 2024-02-21T23:08:20.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.450+0000 7f9335b6a740 1 Processor -- start 2024-02-21T23:08:20.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.451+0000 7f9335b6a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558e7acb82a0 0x558e7acfe8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:20.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.451+0000 7f9335b6a740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558e7acb8bc0 0x558e7acbad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:20.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.451+0000 7f9335b6a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558e7acee260 0x558e7acbb500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:20.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.451+0000 7f9335b6a740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e7ac86f30 con 0x558e7acb8bc0 2024-02-21T23:08:20.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.451+0000 7f9335b6a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e7ab831c0 con 0x558e7acb82a0 2024-02-21T23:08:20.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.451+0000 7f9335b6a740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e7acef930 con 0x558e7acee260 2024-02-21T23:08:20.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.451+0000 7f9335b6a740 10 client.0 _ll_register_callbacks cb 0x558e7aba0930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:08:20.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.451+0000 7f9323e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558e7acb8bc0 0x558e7acbad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:20.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.451+0000 7f932be00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558e7acb82a0 0x558e7acfe8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:20.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.451+0000 7f932be00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558e7acb82a0 0x558e7acfe8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:36628/0 (socket says 172.21.15.99:36628) 2024-02-21T23:08:20.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.451+0000 7f932be00640 1 -- 172.21.15.99:0/1409990900 learned_addr learned my addr 172.21.15.99:0/1409990900 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:08:20.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.451+0000 7f9330c00640 1 --2- 172.21.15.99:0/1409990900 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558e7acee260 0x558e7acbb500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:20.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.452+0000 7f932be00640 1 -- 172.21.15.99:0/1409990900 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558e7acee260 msgr2=0x558e7acbb500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:20.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.452+0000 7f932be00640 1 --2- 172.21.15.99:0/1409990900 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558e7acee260 0x558e7acbb500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:20.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.452+0000 7f932be00640 1 -- 172.21.15.99:0/1409990900 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558e7acb8bc0 msgr2=0x558e7acbad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:20.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.452+0000 7f932be00640 1 --2- 172.21.15.99:0/1409990900 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558e7acb8bc0 0x558e7acbad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:20.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.452+0000 7f932be00640 1 -- 172.21.15.99:0/1409990900 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558e7a8f93f0 con 0x558e7acb82a0 2024-02-21T23:08:20.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.452+0000 7f932be00640 1 --2- 172.21.15.99:0/1409990900 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558e7acb82a0 0x558e7acfe8f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f931c000fb0 tx=0x7f931c01f070 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f488339961ca43d6 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:20.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.452+0000 7f9318c00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-02-21T23:08:20.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.452+0000 7f9318c00640 1 -- 172.21.15.99:0/1409990900 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931c09f4d0 con 0x558e7acb82a0 2024-02-21T23:08:20.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.452+0000 7f9318c00640 1 -- 172.21.15.99:0/1409990900 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f931c004b80 con 0x558e7acb82a0 2024-02-21T23:08:20.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.452+0000 7f9335b6a740 1 -- 172.21.15.99:0/1409990900 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f931c093310 con 0x558e7acb82a0 2024-02-21T23:08:20.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.453+0000 7f9318c00640 1 -- 172.21.15.99:0/1409990900 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f931c004d80 con 0x558e7acb82a0 2024-02-21T23:08:20.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.453+0000 7f9335b6a740 10 client.6397 fetch_fsmap learned FSMap version 17 2024-02-21T23:08:20.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.453+0000 7f9335b6a740 1 -- 172.21.15.99:0/1409990900 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x558e7a8b90f0 con 0x558e7acb82a0 2024-02-21T23:08:20.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.453+0000 7f9318c00640 1 -- 172.21.15.99:0/1409990900 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f931c093310 con 0x558e7acb82a0 2024-02-21T23:08:20.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.453+0000 7f9318c00640 1 -- 172.21.15.99:0/1409990900 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f931c076b90 con 0x558e7acb82a0 2024-02-21T23:08:20.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.453+0000 7f9335b6a740 10 client.6397 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:08:20.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.453+0000 7f9335b6a740 10 client.6397 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:08:20.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.453+0000 7f9335b6a740 20 client.6397 populate_metadata read hostname 'smithi099' 2024-02-21T23:08:20.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.453+0000 7f9335b6a740 1 --2- 172.21.15.99:0/1409990900 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x558e7ac79a70 0x558e7ac79e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:20.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.453+0000 7f9335b6a740 4 client.6397 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:08:20.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.453+0000 7f9335b6a740 1 -- 172.21.15.99:0/1409990900 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558e7abf1fd0 con 0x558e7ac79a70 2024-02-21T23:08:20.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.454+0000 7f9323e00640 1 --2- 172.21.15.99:0/1409990900 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x558e7ac79a70 0x558e7ac79e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:20.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.454+0000 7f9323e00640 1 --2- 172.21.15.99:0/1409990900 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x558e7ac79a70 0x558e7ac79e50 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=867afdf2cf82d515 server_cookie=b1bfda130e0f8602 in_seq=0 out_seq=0 2024-02-21T23:08:20.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.454+0000 7f9318c00640 10 client.6397 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:08:20.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.455+0000 7f9318c00640 1 -- 172.21.15.99:0/1409990900 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x558e7abf1fd0 con 0x558e7ac79a70 2024-02-21T23:08:20.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.455+0000 7f9318c00640 10 client.6397 handle_command_reply: tid=0 2024-02-21T23:08:20.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.455+0000 7f9335b6a740 1 client.6397 shutdown 2024-02-21T23:08:20.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.455+0000 7f9335b6a740 1 -- 172.21.15.99:0/1409990900 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558e7acb82a0 msgr2=0x558e7acfe8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:20.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.455+0000 7f9335b6a740 1 --2- 172.21.15.99:0/1409990900 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558e7acb82a0 0x558e7acfe8f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f931c000fb0 tx=0x7f931c01f070 comp rx=0 tx=0).stop 2024-02-21T23:08:20.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.455+0000 7f9335b6a740 1 -- 172.21.15.99:0/1409990900 shutdown_connections 2024-02-21T23:08:20.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.455+0000 7f9335b6a740 1 --2- 172.21.15.99:0/1409990900 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x558e7ac79a70 0x558e7ac79e50 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:20.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.455+0000 7f9335b6a740 1 --2- 172.21.15.99:0/1409990900 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558e7acee260 0x558e7acbb500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:20.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.455+0000 7f9335b6a740 1 --2- 172.21.15.99:0/1409990900 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558e7acb8bc0 0x558e7acbad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:20.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.455+0000 7f9335b6a740 1 --2- 172.21.15.99:0/1409990900 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558e7acb82a0 0x558e7acfe8f0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:20.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.455+0000 7f9335b6a740 1 -- 172.21.15.99:0/1409990900 >> 172.21.15.99:0/1409990900 conn(0x558e7ac476b0 msgr2=0x558e7ac7fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:08:20.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.455+0000 7f9318c00640 0 client.6397 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:08:20.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.456+0000 7f9335b6a740 1 -- 172.21.15.99:0/1409990900 shutdown_connections 2024-02-21T23:08:20.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.456+0000 7f9335b6a740 1 -- 172.21.15.99:0/1409990900 wait complete. 2024-02-21T23:08:20.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.456+0000 7f9335b6a740 20 client.6397 trim_cache size 0 max 16384 2024-02-21T23:08:20.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.473+0000 7f9335b6a740 1 Processor -- start 2024-02-21T23:08:20.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.474+0000 7f9335b6a740 1 -- start start 2024-02-21T23:08:20.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.475+0000 7f9335b6a740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558e7acb82a0 0x558e7acc15b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:20.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.475+0000 7f9335b6a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558e7acb8bc0 0x558e7acb9340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:20.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.475+0000 7f9335b6a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558e7acee260 0x558e7ad557a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:20.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.475+0000 7f9335b6a740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f932c22c750 con 0x558e7acb82a0 2024-02-21T23:08:20.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.475+0000 7f9335b6a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f932c22a2f0 con 0x558e7acb8bc0 2024-02-21T23:08:20.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.475+0000 7f9335b6a740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f932c220df0 con 0x558e7acee260 2024-02-21T23:08:20.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.475+0000 7f932be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558e7acb82a0 0x558e7acc15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:20.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.475+0000 7f932be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558e7acb82a0 0x558e7acc15b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:41640/0 (socket says 172.21.15.99:41640) 2024-02-21T23:08:20.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.475+0000 7f932be00640 1 -- 172.21.15.99:0/1665060534 learned_addr learned my addr 172.21.15.99:0/1665060534 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:08:20.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.475+0000 7f9323e00640 1 --2- 172.21.15.99:0/1665060534 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558e7acb8bc0 0x558e7acb9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:20.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.475+0000 7f9330c00640 1 --2- 172.21.15.99:0/1665060534 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558e7acee260 0x558e7ad557a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:20.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.475+0000 7f932be00640 1 -- 172.21.15.99:0/1665060534 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558e7acee260 msgr2=0x558e7ad557a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:20.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.475+0000 7f932be00640 1 --2- 172.21.15.99:0/1665060534 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558e7acee260 0x558e7ad557a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:20.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.475+0000 7f932be00640 1 -- 172.21.15.99:0/1665060534 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558e7acb8bc0 msgr2=0x558e7acb9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:20.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.475+0000 7f932be00640 1 --2- 172.21.15.99:0/1665060534 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558e7acb8bc0 0x558e7acb9340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:20.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.475+0000 7f932be00640 1 -- 172.21.15.99:0/1665060534 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558e7acfe8d0 con 0x558e7acb82a0 2024-02-21T23:08:20.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.476+0000 7f932be00640 1 --2- 172.21.15.99:0/1665060534 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558e7acb82a0 0x558e7acc15b0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f931c09efa0 tx=0x7f931c0b1040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5a29dd4f7c90a32 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:20.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.476+0000 7f931b400640 1 -- 172.21.15.99:0/1665060534 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931c09ae80 con 0x558e7acb82a0 2024-02-21T23:08:20.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.476+0000 7f931b400640 1 -- 172.21.15.99:0/1665060534 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f931c0b42e0 con 0x558e7acb82a0 2024-02-21T23:08:20.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.476+0000 7f931b400640 1 -- 172.21.15.99:0/1665060534 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931c093310 con 0x558e7acb82a0 2024-02-21T23:08:20.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.477+0000 7f9335b6a740 1 -- 172.21.15.99:0/1665060534 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558e7acb82a0 msgr2=0x558e7acc15b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:20.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.477+0000 7f9335b6a740 1 --2- 172.21.15.99:0/1665060534 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558e7acb82a0 0x558e7acc15b0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f931c09efa0 tx=0x7f931c0b1040 comp rx=0 tx=0).stop 2024-02-21T23:08:20.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.477+0000 7f9335b6a740 1 -- 172.21.15.99:0/1665060534 shutdown_connections 2024-02-21T23:08:20.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.477+0000 7f9335b6a740 1 --2- 172.21.15.99:0/1665060534 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558e7acee260 0x558e7ad557a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:20.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.477+0000 7f9335b6a740 1 --2- 172.21.15.99:0/1665060534 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558e7acb8bc0 0x558e7acb9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:20.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.477+0000 7f9335b6a740 1 --2- 172.21.15.99:0/1665060534 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558e7acb82a0 0x558e7acc15b0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:20.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.477+0000 7f9335b6a740 1 -- 172.21.15.99:0/1665060534 >> 172.21.15.99:0/1665060534 conn(0x558e7ac476b0 msgr2=0x558e7acbad80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:08:20.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.477+0000 7f9335b6a740 1 -- 172.21.15.99:0/1665060534 shutdown_connections 2024-02-21T23:08:20.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.477+0000 7f9335b6a740 1 -- 172.21.15.99:0/1665060534 wait complete. 2024-02-21T23:08:20.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.478+0000 7f9335b6a740 1 -- start start 2024-02-21T23:08:20.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.478+0000 7f9335b6a740 1 Processor -- start 2024-02-21T23:08:20.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.481+0000 7f9335b6a740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558e7acb82a0 0x558e7acef690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:20.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.481+0000 7f9335b6a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558e7acb8bc0 0x558e7acaa8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:20.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.481+0000 7f9335b6a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558e7acee260 0x558e7ad54340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:20.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.481+0000 7f9335b6a740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f932c228a10 con 0x558e7acb82a0 2024-02-21T23:08:20.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.481+0000 7f9335b6a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f932c229c90 con 0x558e7acee260 2024-02-21T23:08:20.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.481+0000 7f9335b6a740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f932c229010 con 0x558e7acb8bc0 2024-02-21T23:08:20.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.481+0000 7f9335b6a740 10 client.0 _ll_register_callbacks cb 0x7f931c096690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:08:20.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.481+0000 7f932be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558e7acb82a0 0x558e7acef690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:20.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.481+0000 7f9323e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558e7acb8bc0 0x558e7acaa8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:20.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.481+0000 7f932be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558e7acb82a0 0x558e7acef690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:41642/0 (socket says 172.21.15.99:41642) 2024-02-21T23:08:20.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.481+0000 7f932be00640 1 -- 172.21.15.99:0/1623698286 learned_addr learned my addr 172.21.15.99:0/1623698286 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:08:20.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.481+0000 7f9330c00640 1 --2- 172.21.15.99:0/1623698286 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558e7acee260 0x558e7ad54340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:20.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.481+0000 7f932be00640 1 -- 172.21.15.99:0/1623698286 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558e7acb8bc0 msgr2=0x558e7acaa8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:20.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.481+0000 7f932be00640 1 --2- 172.21.15.99:0/1623698286 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558e7acb8bc0 0x558e7acaa8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:20.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.481+0000 7f932be00640 1 -- 172.21.15.99:0/1623698286 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558e7acee260 msgr2=0x558e7ad54340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:20.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.481+0000 7f932be00640 1 --2- 172.21.15.99:0/1623698286 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558e7acee260 0x558e7ad54340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:20.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.481+0000 7f932be00640 1 -- 172.21.15.99:0/1623698286 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558e7acab1f0 con 0x558e7acb82a0 2024-02-21T23:08:20.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.481+0000 7f9330c00640 1 --2- 172.21.15.99:0/1623698286 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558e7acee260 0x558e7ad54340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:08:20.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.482+0000 7f932be00640 1 --2- 172.21.15.99:0/1623698286 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558e7acb82a0 0x558e7acef690 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f931c00cef0 tx=0x7f931c092fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b59f99d72be1dbc server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:20.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.482+0000 7f9318c00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:08:20.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.482+0000 7f9318c00640 1 -- 172.21.15.99:0/1623698286 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931c09f4d0 con 0x558e7acb82a0 2024-02-21T23:08:20.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.482+0000 7f9318c00640 1 -- 172.21.15.99:0/1623698286 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f931c0aeb50 con 0x558e7acb82a0 2024-02-21T23:08:20.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.482+0000 7f9335b6a740 1 -- 172.21.15.99:0/1623698286 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f931c0b42e0 con 0x558e7acb82a0 2024-02-21T23:08:20.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.482+0000 7f9318c00640 1 -- 172.21.15.99:0/1623698286 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f931c09ae80 con 0x558e7acb82a0 2024-02-21T23:08:20.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.482+0000 7f9335b6a740 10 client.6276 fetch_fsmap learned FSMap version 17 2024-02-21T23:08:20.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.482+0000 7f9335b6a740 1 -- 172.21.15.99:0/1623698286 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x558e7acab1f0 con 0x558e7acb82a0 2024-02-21T23:08:20.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.482+0000 7f9318c00640 1 -- 172.21.15.99:0/1623698286 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f931c0b42e0 con 0x558e7acb82a0 2024-02-21T23:08:20.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.483+0000 7f9318c00640 1 -- 172.21.15.99:0/1623698286 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f931c096180 con 0x558e7acb82a0 2024-02-21T23:08:20.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.483+0000 7f9335b6a740 10 client.6276 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:08:20.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.483+0000 7f9335b6a740 10 client.6276 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:08:20.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.483+0000 7f9335b6a740 20 client.6276 populate_metadata read hostname 'smithi099' 2024-02-21T23:08:20.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.483+0000 7f9335b6a740 1 --2- 172.21.15.99:0/1623698286 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x558e7ad5eb20 0x558e7acbe270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:20.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.483+0000 7f9335b6a740 4 client.6276 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T23:08:20.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.483+0000 7f9335b6a740 1 -- 172.21.15.99:0/1623698286 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x558e7abec320 con 0x558e7ad5eb20 2024-02-21T23:08:20.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.483+0000 7f9323e00640 1 --2- 172.21.15.99:0/1623698286 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x558e7ad5eb20 0x558e7acbe270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:20.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.484+0000 7f9323e00640 1 --2- 172.21.15.99:0/1623698286 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x558e7ad5eb20 0x558e7acbe270 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc87acb66c9d256c server_cookie=9ee7455d475b5411 in_seq=0 out_seq=0 2024-02-21T23:08:20.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.484+0000 7f9318c00640 10 client.6276 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:08:20.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.484+0000 7f9318c00640 1 -- 172.21.15.99:0/1623698286 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x558e7abec320 con 0x558e7ad5eb20 2024-02-21T23:08:20.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.484+0000 7f9318c00640 10 client.6276 handle_command_reply: tid=0 2024-02-21T23:08:20.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.484+0000 7f9335b6a740 1 client.6276 shutdown 2024-02-21T23:08:20.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.484+0000 7f9335b6a740 1 -- 172.21.15.99:0/1623698286 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558e7acb82a0 msgr2=0x558e7acef690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:20.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.484+0000 7f9335b6a740 1 --2- 172.21.15.99:0/1623698286 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558e7acb82a0 0x558e7acef690 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f931c00cef0 tx=0x7f931c092fc0 comp rx=0 tx=0).stop 2024-02-21T23:08:20.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.484+0000 7f9335b6a740 1 -- 172.21.15.99:0/1623698286 shutdown_connections 2024-02-21T23:08:20.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.484+0000 7f9335b6a740 1 --2- 172.21.15.99:0/1623698286 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x558e7ad5eb20 0x558e7acbe270 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:20.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.484+0000 7f9335b6a740 1 --2- 172.21.15.99:0/1623698286 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558e7acee260 0x558e7ad54340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:20.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.484+0000 7f9335b6a740 1 --2- 172.21.15.99:0/1623698286 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558e7acb8bc0 0x558e7acaa8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:20.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.484+0000 7f9335b6a740 1 --2- 172.21.15.99:0/1623698286 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558e7acb82a0 0x558e7acef690 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:20.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.484+0000 7f9335b6a740 1 -- 172.21.15.99:0/1623698286 >> 172.21.15.99:0/1623698286 conn(0x558e7ac476b0 msgr2=0x558e7aced900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:08:20.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.484+0000 7f9318c00640 0 client.6276 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:08:20.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.485+0000 7f9335b6a740 1 -- 172.21.15.99:0/1623698286 shutdown_connections 2024-02-21T23:08:20.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.485+0000 7f9335b6a740 1 -- 172.21.15.99:0/1623698286 wait complete. 2024-02-21T23:08:20.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.485+0000 7f9335b6a740 20 client.6276 trim_cache size 0 max 16384 2024-02-21T23:08:20.494 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-02-21T23:08:20.494 INFO:teuthology.orchestra.run.smithi099.stdout: "status": "no active scrubs running", 2024-02-21T23:08:20.494 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubs": {} 2024-02-21T23:08:20.494 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-02-21T23:08:20.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.486+0000 7f9331600640 1 -- 172.21.15.99:0/3449465661 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f930809eed0 msgr2=0x7f93080a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:20.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.486+0000 7f9331600640 1 --2- 172.21.15.99:0/3449465661 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f930809eed0 0x7f93080a1390 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9314036000 tx=0x7f931403c040 comp rx=0 tx=0).stop 2024-02-21T23:08:20.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.486+0000 7f9331600640 1 -- 172.21.15.99:0/3449465661 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f932c0fc7c0 msgr2=0x7f932c222b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:20.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.486+0000 7f9331600640 1 --2- 172.21.15.99:0/3449465661 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f932c0fc7c0 0x7f932c222b70 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f931c00c530 tx=0x7f931c00c9f0 comp rx=0 tx=0).stop 2024-02-21T23:08:20.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.486+0000 7f9331600640 1 -- 172.21.15.99:0/3449465661 shutdown_connections 2024-02-21T23:08:20.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.486+0000 7f9331600640 1 --2- 172.21.15.99:0/3449465661 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f930809eed0 0x7f93080a1390 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:20.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.486+0000 7f9331600640 1 --2- 172.21.15.99:0/3449465661 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f932c18b230 0x7f932c159630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:20.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.486+0000 7f9331600640 1 --2- 172.21.15.99:0/3449465661 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f932c17f490 0x7f932c1590f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:20.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.486+0000 7f9331600640 1 --2- 172.21.15.99:0/3449465661 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f932c0fc7c0 0x7f932c222b70 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:20.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.486+0000 7f9331600640 1 -- 172.21.15.99:0/3449465661 >> 172.21.15.99:0/3449465661 conn(0x7f932c0d29b0 msgr2=0x7f932c068e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:08:20.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.486+0000 7f9331600640 1 -- 172.21.15.99:0/3449465661 shutdown_connections 2024-02-21T23:08:20.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.486+0000 7f9331600640 1 -- 172.21.15.99:0/3449465661 wait complete. 2024-02-21T23:08:20.499 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-02-21T23:08:20.500 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T23:08:20.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.704+0000 7fbe0ca00640 1 Processor -- start 2024-02-21T23:08:20.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.705+0000 7fbe0ca00640 1 -- start start 2024-02-21T23:08:20.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.707+0000 7fbe0ca00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fbe08186830 0x7fbe08072f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:20.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.707+0000 7fbe0ca00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe080734d0 con 0x7fbe080d1ef0 2024-02-21T23:08:20.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.707+0000 7fbe0ca00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe080f4b80 con 0x7fbe080d1a70 2024-02-21T23:08:20.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.707+0000 7fbe0ca00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe080f4e60 con 0x7fbe08186830 2024-02-21T23:08:20.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.708+0000 7fbe07200640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fbe080d1ef0 0x7fbe08186c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:50556/0 (socket says 172.21.15.99:50556) 2024-02-21T23:08:20.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.708+0000 7fbe07200640 1 -- 172.21.15.99:0/282513564 learned_addr learned my addr 172.21.15.99:0/282513564 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:08:20.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.708+0000 7fbe06800640 1 --2- 172.21.15.99:0/282513564 >> v2:172.21.15.99:3300/0 conn(0x7fbe08186830 0x7fbe08072f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:20.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.708+0000 7fbe05400640 1 -- 172.21.15.99:0/282513564 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 643038779 0 0) 0x7fbe080f4b80 con 0x7fbe080d1a70 2024-02-21T23:08:20.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.708+0000 7fbe05400640 1 -- 172.21.15.99:0/282513564 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbdec003520 con 0x7fbe080d1a70 2024-02-21T23:08:20.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.708+0000 7fbe05400640 1 -- 172.21.15.99:0/282513564 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3148947673 0 0) 0x7fbe080734d0 con 0x7fbe080d1ef0 2024-02-21T23:08:20.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.708+0000 7fbe05400640 1 -- 172.21.15.99:0/282513564 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe080f4b80 con 0x7fbe080d1ef0 2024-02-21T23:08:20.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.708+0000 7fbe06800640 1 -- 172.21.15.99:0/282513564 >> v1:172.21.15.181:6789/0 conn(0x7fbe080d1a70 legacy=0x7fbe080cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:20.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.708+0000 7fbe06800640 1 -- 172.21.15.99:0/282513564 >> v1:172.21.15.99:6789/0 conn(0x7fbe080d1ef0 legacy=0x7fbe08186c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:20.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.709+0000 7fbe06800640 1 -- 172.21.15.99:0/282513564 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe080f5140 con 0x7fbe08186830 2024-02-21T23:08:20.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.710+0000 7fbe06800640 1 --2- 172.21.15.99:0/282513564 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbe08186830 0x7fbe08072f90 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fbdf80097a0 tx=0x7fbdf802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d89d925bbf74d147 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:20.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.711+0000 7fbe05400640 1 -- 172.21.15.99:0/282513564 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf8034070 con 0x7fbe08186830 2024-02-21T23:08:20.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.711+0000 7fbe05400640 1 -- 172.21.15.99:0/282513564 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdf8030610 con 0x7fbe08186830 2024-02-21T23:08:20.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.711+0000 7fbe05400640 1 -- 172.21.15.99:0/282513564 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf80309c0 con 0x7fbe08186830 2024-02-21T23:08:20.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.711+0000 7fbe0ca00640 1 -- 172.21.15.99:0/282513564 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbe08186830 msgr2=0x7fbe08072f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:20.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.711+0000 7fbe0ca00640 1 --2- 172.21.15.99:0/282513564 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbe08186830 0x7fbe08072f90 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fbdf80097a0 tx=0x7fbdf802b960 comp rx=0 tx=0).stop 2024-02-21T23:08:20.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.711+0000 7fbe0ca00640 1 -- 172.21.15.99:0/282513564 shutdown_connections 2024-02-21T23:08:20.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.711+0000 7fbe0ca00640 1 --2- 172.21.15.99:0/282513564 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbe08186830 0x7fbe08072f90 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:20.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.712+0000 7fbe0ca00640 1 -- 172.21.15.99:0/282513564 >> 172.21.15.99:0/282513564 conn(0x7fbe080ce3c0 msgr2=0x7fbe080ce7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:08:20.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.712+0000 7fbe0ca00640 1 -- 172.21.15.99:0/282513564 shutdown_connections 2024-02-21T23:08:20.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.712+0000 7fbe0ca00640 1 -- 172.21.15.99:0/282513564 wait complete. 2024-02-21T23:08:20.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.713+0000 7fbe0ca00640 1 Processor -- start 2024-02-21T23:08:20.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.713+0000 7fbe0ca00640 1 -- start start 2024-02-21T23:08:20.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.716+0000 7fbe0ca00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbe080d1a70 0x7fbe08184b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:20.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.716+0000 7fbe0ca00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbe080d1ef0 0x7fbe08180e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:20.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.716+0000 7fbe0ca00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbe08186830 0x7fbe08181350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:20.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.716+0000 7fbe0ca00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe080f59e0 con 0x7fbe08186830 2024-02-21T23:08:20.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.716+0000 7fbe0ca00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe080f5700 con 0x7fbe080d1ef0 2024-02-21T23:08:20.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.716+0000 7fbe0ca00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe080f4870 con 0x7fbe080d1a70 2024-02-21T23:08:20.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.716+0000 7fbe07200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbe08186830 0x7fbe08181350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:20.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.716+0000 7fbe06800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbe080d1a70 0x7fbe08184b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:20.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.716+0000 7fbe07200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbe08186830 0x7fbe08181350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:41656/0 (socket says 172.21.15.99:41656) 2024-02-21T23:08:20.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.716+0000 7fbe07200640 1 -- 172.21.15.99:0/2087810730 learned_addr learned my addr 172.21.15.99:0/2087810730 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:08:20.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.716+0000 7fbe05e00640 1 --2- 172.21.15.99:0/2087810730 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbe080d1ef0 0x7fbe08180e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:20.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.717+0000 7fbe07200640 1 -- 172.21.15.99:0/2087810730 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbe080d1a70 msgr2=0x7fbe08184b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:20.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.717+0000 7fbe07200640 1 --2- 172.21.15.99:0/2087810730 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbe080d1a70 0x7fbe08184b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:20.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.717+0000 7fbe07200640 1 -- 172.21.15.99:0/2087810730 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbe080d1ef0 msgr2=0x7fbe08180e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:20.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.717+0000 7fbe07200640 1 --2- 172.21.15.99:0/2087810730 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbe080d1ef0 0x7fbe08180e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:20.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.717+0000 7fbe07200640 1 -- 172.21.15.99:0/2087810730 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe08183bc0 con 0x7fbe08186830 2024-02-21T23:08:20.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.717+0000 7fbe07200640 1 --2- 172.21.15.99:0/2087810730 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbe08186830 0x7fbe08181350 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fbe0000caa0 tx=0x7fbe0000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:20.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.717+0000 7fbdfea00640 1 -- 172.21.15.99:0/2087810730 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe00017070 con 0x7fbe08186830 2024-02-21T23:08:20.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.717+0000 7fbdfea00640 1 -- 172.21.15.99:0/2087810730 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe0000ac00 con 0x7fbe08186830 2024-02-21T23:08:20.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.717+0000 7fbe0ca00640 1 -- 172.21.15.99:0/2087810730 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe081852a0 con 0x7fbe08186830 2024-02-21T23:08:20.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.717+0000 7fbdfea00640 1 -- 172.21.15.99:0/2087810730 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe00012400 con 0x7fbe08186830 2024-02-21T23:08:20.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.717+0000 7fbe0ca00640 1 -- 172.21.15.99:0/2087810730 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe08185860 con 0x7fbe08186830 2024-02-21T23:08:20.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.719+0000 7fbe0ca00640 1 -- 172.21.15.99:0/2087810730 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe08068320 con 0x7fbe08186830 2024-02-21T23:08:20.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.722+0000 7fbdfea00640 1 -- 172.21.15.99:0/2087810730 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7fbe0001a070 con 0x7fbe08186830 2024-02-21T23:08:20.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.724+0000 7fbdfea00640 1 --2- 172.21.15.99:0/2087810730 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fbde809eed0 0x7fbde80a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:20.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.724+0000 7fbdfea00640 1 -- 172.21.15.99:0/2087810730 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7fbe000c9fe0 con 0x7fbe08186830 2024-02-21T23:08:20.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.724+0000 7fbe06800640 1 --2- 172.21.15.99:0/2087810730 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fbde809eed0 0x7fbde80a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:20.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.725+0000 7fbe06800640 1 --2- 172.21.15.99:0/2087810730 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fbde809eed0 0x7fbde80a1390 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbdf8036000 tx=0x7fbdf803b040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:20.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.726+0000 7fbdfea00640 1 -- 172.21.15.99:0/2087810730 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fbe00021020 con 0x7fbe08186830 2024-02-21T23:08:20.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.997+0000 7fbe0ca00640 1 -- 172.21.15.99:0/2087810730 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbe080f95c0 con 0x7fbe08186830 2024-02-21T23:08:20.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:20.999+0000 7fbdfea00640 1 -- 172.21.15.99:0/2087810730 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+11335 (secure 0 0 0) 0x7fbe00097930 con 0x7fbe08186830 2024-02-21T23:08:20.987 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T23:08:20.987 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4307,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/3514452812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3514452812},{"type":"v1","addr":"172.21.15.162:6836","nonce":3514452812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4312,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6838/2169982089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":2169982089},{"type":"v1","addr":"172.21.15.162:6838","nonce":2169982089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4315,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6839/3335972724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6837","nonce":3335972724},{"type":"v1","addr":"172.21.15.162:6839","nonce":3335972724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4318,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6841/2135456697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6840","nonce":2135456697},{"type":"v1","addr":"172.21.15.162:6841","nonce":2135456697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4325,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2452242758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2452242758},{"type":"v1","addr":"172.21.15.181:6833","nonce":2452242758}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4328,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6836/2751486400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":2751486400},{"type":"v1","addr":"172.21.15.181:6836","nonce":2751486400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":17,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-21T23:01:02.656130+0000","modified":"2024-02-21T23:07:03.165223+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4355,"mds_1":4352,"mds_2":4348},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4331":{"gid":4331,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6838/3728901330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6835","nonce":3728901330},{"type":"v1","addr":"172.21.15.181:6838","nonce":3728901330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4339":{"gid":4339,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6839/3357929641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6837","nonce":3357929641},{"type":"v1","addr":"172.21.15.181:6839","nonce":3357929641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4343":{"gid":4343,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6833/2793485078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":2793485078},{"type":"v1","addr":"172.21.15.99:6833","nonce":2793485078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4348":{"gid":4348,"name":"d","rank":2,"incarnation":12,"state":"up:active","state_seq":10,"addr":"172.21.15.99:6835/2243461688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2243461688},{"type":"v1","addr":"172.21.15.99:6835","nonce":2243461688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4352":{"gid":4352,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.99:6837/1676159950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":1676159950},{"type":"v1","addr":"172.21.15.99:6837","nonce":1676159950}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4355":{"gid":4355,"name":"j","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6839/4239008786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":4239008786},{"type":"v1","addr":"172.21.15.99:6839","nonce":4239008786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-21T23:08:20.988 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 17 2024-02-21T23:08:20.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.001+0000 7fbe0ca00640 1 -- 172.21.15.99:0/2087810730 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fbde809eed0 msgr2=0x7fbde80a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:20.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.001+0000 7fbe0ca00640 1 --2- 172.21.15.99:0/2087810730 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fbde809eed0 0x7fbde80a1390 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbdf8036000 tx=0x7fbdf803b040 comp rx=0 tx=0).stop 2024-02-21T23:08:20.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.001+0000 7fbe0ca00640 1 -- 172.21.15.99:0/2087810730 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbe08186830 msgr2=0x7fbe08181350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:20.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.001+0000 7fbe0ca00640 1 --2- 172.21.15.99:0/2087810730 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbe08186830 0x7fbe08181350 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fbe0000caa0 tx=0x7fbe0000cf60 comp rx=0 tx=0).stop 2024-02-21T23:08:20.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.001+0000 7fbe0ca00640 1 -- 172.21.15.99:0/2087810730 shutdown_connections 2024-02-21T23:08:20.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.001+0000 7fbe0ca00640 1 --2- 172.21.15.99:0/2087810730 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fbde809eed0 0x7fbde80a1390 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:20.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.001+0000 7fbe0ca00640 1 --2- 172.21.15.99:0/2087810730 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fbe08186830 0x7fbe08181350 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:20.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.001+0000 7fbe0ca00640 1 --2- 172.21.15.99:0/2087810730 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbe080d1ef0 0x7fbe08180e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:20.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.001+0000 7fbe0ca00640 1 --2- 172.21.15.99:0/2087810730 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fbe080d1a70 0x7fbe08184b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:20.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.001+0000 7fbe0ca00640 1 -- 172.21.15.99:0/2087810730 >> 172.21.15.99:0/2087810730 conn(0x7fbe080ce3c0 msgr2=0x7fbe080f8d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:08:20.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.001+0000 7fbe0ca00640 1 -- 172.21.15.99:0/2087810730 shutdown_connections 2024-02-21T23:08:20.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.001+0000 7fbe0ca00640 1 -- 172.21.15.99:0/2087810730 wait complete. 2024-02-21T23:08:21.008 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T23:08:21.009 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-02-21T23:08:21.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.235+0000 7f9b87e00640 1 Processor -- start 2024-02-21T23:08:21.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.236+0000 7f9b87e00640 1 -- start start 2024-02-21T23:08:21.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.237+0000 7f9b87e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f9b8817f490 0x7f9b8818ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:21.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.238+0000 7f9b87e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f9b8818b4f0 0x7f9b880fd290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:21.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.238+0000 7f9b87e00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b880d6dd0 con 0x7f9b8818b060 2024-02-21T23:08:21.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.238+0000 7f9b87e00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b881614c0 con 0x7f9b8818b4f0 2024-02-21T23:08:21.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.238+0000 7f9b87e00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b880d6810 con 0x7f9b8817f490 2024-02-21T23:08:21.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.238+0000 7f9b86000640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f9b8818b060 0x7f9b88188a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:52666/0 (socket says 172.21.15.99:52666) 2024-02-21T23:08:21.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.238+0000 7f9b86000640 1 -- 172.21.15.99:0/3107978439 learned_addr learned my addr 172.21.15.99:0/3107978439 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:08:21.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.238+0000 7f9b86a00640 1 --2- 172.21.15.99:0/3107978439 >> v2:172.21.15.162:3300/0 conn(0x7f9b8817f490 0x7f9b8818ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:21.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.238+0000 7f9b87400640 1 --2- 172.21.15.99:0/3107978439 >> v2:172.21.15.99:3300/0 conn(0x7f9b8818b4f0 0x7f9b880fd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:21.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.238+0000 7f9b85600640 1 -- 172.21.15.99:0/3107978439 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1488050245 0 0) 0x7f9b880d6dd0 con 0x7f9b8818b060 2024-02-21T23:08:21.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.238+0000 7f9b85600640 1 -- 172.21.15.99:0/3107978439 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b6c003520 con 0x7f9b8818b060 2024-02-21T23:08:21.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.238+0000 7f9b86a00640 1 -- 172.21.15.99:0/3107978439 >> v2:172.21.15.99:3300/0 conn(0x7f9b8818b4f0 msgr2=0x7f9b880fd290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:21.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.238+0000 7f9b86a00640 1 --2- 172.21.15.99:0/3107978439 >> v2:172.21.15.99:3300/0 conn(0x7f9b8818b4f0 0x7f9b880fd290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.238+0000 7f9b86a00640 1 -- 172.21.15.99:0/3107978439 >> v1:172.21.15.181:6789/0 conn(0x7f9b8818b060 legacy=0x7f9b88188a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:21.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.239+0000 7f9b86a00640 1 -- 172.21.15.99:0/3107978439 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b880d6af0 con 0x7f9b8817f490 2024-02-21T23:08:21.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.240+0000 7f9b86a00640 1 --2- 172.21.15.99:0/3107978439 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9b8817f490 0x7f9b8818ab20 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f9b88067c30 tx=0x7f9b7802b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81e17243e8a5e2c7 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:21.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.240+0000 7f9b85600640 1 -- 172.21.15.99:0/3107978439 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b78035020 con 0x7f9b8817f490 2024-02-21T23:08:21.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.240+0000 7f9b85600640 1 -- 172.21.15.99:0/3107978439 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b78031830 con 0x7f9b8817f490 2024-02-21T23:08:21.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.240+0000 7f9b85600640 1 -- 172.21.15.99:0/3107978439 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b78031be0 con 0x7f9b8817f490 2024-02-21T23:08:21.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.240+0000 7f9b87e00640 1 -- 172.21.15.99:0/3107978439 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9b8817f490 msgr2=0x7f9b8818ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:21.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.240+0000 7f9b87e00640 1 --2- 172.21.15.99:0/3107978439 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9b8817f490 0x7f9b8818ab20 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f9b88067c30 tx=0x7f9b7802b8d0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.241+0000 7f9b87e00640 1 -- 172.21.15.99:0/3107978439 shutdown_connections 2024-02-21T23:08:21.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.241+0000 7f9b87e00640 1 --2- 172.21.15.99:0/3107978439 >> v2:172.21.15.99:3300/0 conn(0x7f9b8818b4f0 0x7f9b880fd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.241+0000 7f9b87e00640 1 --2- 172.21.15.99:0/3107978439 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9b8817f490 0x7f9b8818ab20 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.241+0000 7f9b87e00640 1 -- 172.21.15.99:0/3107978439 >> 172.21.15.99:0/3107978439 conn(0x7f9b880d29b0 msgr2=0x7f9b880d2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:08:21.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.241+0000 7f9b87e00640 1 -- 172.21.15.99:0/3107978439 shutdown_connections 2024-02-21T23:08:21.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.241+0000 7f9b87e00640 1 -- 172.21.15.99:0/3107978439 wait complete. 2024-02-21T23:08:21.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.244+0000 7f9b87e00640 1 Processor -- start 2024-02-21T23:08:21.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.244+0000 7f9b87e00640 1 -- start start 2024-02-21T23:08:21.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.246+0000 7f9b87e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9b8817f490 0x7f9b881749a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:21.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.246+0000 7f9b87e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b8818b060 0x7f9b8821fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:21.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.246+0000 7f9b87e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9b8818b4f0 0x7f9b88220050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:21.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.246+0000 7f9b87e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8818a600 con 0x7f9b8818b060 2024-02-21T23:08:21.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.246+0000 7f9b87e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8818a320 con 0x7f9b8817f490 2024-02-21T23:08:21.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.246+0000 7f9b87e00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8817f870 con 0x7f9b8818b4f0 2024-02-21T23:08:21.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.247+0000 7f9b86000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b8818b060 0x7f9b8821fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:21.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.247+0000 7f9b86000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b8818b060 0x7f9b8821fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:41682/0 (socket says 172.21.15.99:41682) 2024-02-21T23:08:21.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.247+0000 7f9b86000640 1 -- 172.21.15.99:0/329092072 learned_addr learned my addr 172.21.15.99:0/329092072 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:08:21.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.247+0000 7f9b86a00640 1 --2- 172.21.15.99:0/329092072 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9b8817f490 0x7f9b881749a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:21.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.247+0000 7f9b87400640 1 --2- 172.21.15.99:0/329092072 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9b8818b4f0 0x7f9b88220050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:21.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.247+0000 7f9b86000640 1 -- 172.21.15.99:0/329092072 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9b8818b4f0 msgr2=0x7f9b88220050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:21.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.247+0000 7f9b86000640 1 --2- 172.21.15.99:0/329092072 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9b8818b4f0 0x7f9b88220050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.247+0000 7f9b86000640 1 -- 172.21.15.99:0/329092072 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9b8817f490 msgr2=0x7f9b881749a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:21.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.247+0000 7f9b86000640 1 --2- 172.21.15.99:0/329092072 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9b8817f490 0x7f9b881749a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.247+0000 7f9b86000640 1 -- 172.21.15.99:0/329092072 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b8815ad00 con 0x7f9b8818b060 2024-02-21T23:08:21.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.247+0000 7f9b87400640 1 --2- 172.21.15.99:0/329092072 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9b8818b4f0 0x7f9b88220050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:08:21.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.248+0000 7f9b86000640 1 --2- 172.21.15.99:0/329092072 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b8818b060 0x7f9b8821fb10 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f9b7400c460 tx=0x7f9b7400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:21.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.248+0000 7f9b7ea00640 1 -- 172.21.15.99:0/329092072 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b74017070 con 0x7f9b8818b060 2024-02-21T23:08:21.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.248+0000 7f9b7ea00640 1 -- 172.21.15.99:0/329092072 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b74005ce0 con 0x7f9b8818b060 2024-02-21T23:08:21.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.248+0000 7f9b87e00640 1 -- 172.21.15.99:0/329092072 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b8815afe0 con 0x7f9b8818b060 2024-02-21T23:08:21.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.248+0000 7f9b7ea00640 1 -- 172.21.15.99:0/329092072 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b74007290 con 0x7f9b8818b060 2024-02-21T23:08:21.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.248+0000 7f9b87e00640 1 -- 172.21.15.99:0/329092072 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b8815b5a0 con 0x7f9b8818b060 2024-02-21T23:08:21.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.252+0000 7f9b7ea00640 1 -- 172.21.15.99:0/329092072 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f9b7401a070 con 0x7f9b8818b060 2024-02-21T23:08:21.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.253+0000 7f9b7ea00640 1 --2- 172.21.15.99:0/329092072 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f9b6809eed0 0x7f9b680a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:21.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.253+0000 7f9b7ea00640 1 -- 172.21.15.99:0/329092072 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f9b740c9120 con 0x7f9b8818b060 2024-02-21T23:08:21.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.253+0000 7f9b86a00640 1 --2- 172.21.15.99:0/329092072 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f9b6809eed0 0x7f9b680a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:21.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.253+0000 7f9b90b8d740 1 Processor -- start 2024-02-21T23:08:21.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.254+0000 7f9b90b8d740 1 -- start start 2024-02-21T23:08:21.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.254+0000 7f9b86a00640 1 --2- 172.21.15.99:0/329092072 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f9b6809eed0 0x7f9b680a1390 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9b78036000 tx=0x7f9b7803c040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:21.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.256+0000 7f9b90b8d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd8bac6660 0x55fd8bac6a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:21.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.256+0000 7f9b90b8d740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fd8bb01330 0x55fd8bb017b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:21.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.256+0000 7f9b90b8d740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fd8bb01cf0 0x55fd8bb02560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:21.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.256+0000 7f9b90b8d740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd8b9eeb50 con 0x55fd8bb01330 2024-02-21T23:08:21.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.256+0000 7f9b90b8d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd8b997da0 con 0x55fd8bac6660 2024-02-21T23:08:21.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.256+0000 7f9b90b8d740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd8b9eabf0 con 0x55fd8bb01cf0 2024-02-21T23:08:21.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.256+0000 7f9b86a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd8bac6660 0x55fd8bac6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:21.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.256+0000 7f9b86000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fd8bb01330 0x55fd8bb017b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:21.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.256+0000 7f9b86a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd8bac6660 0x55fd8bac6a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:36686/0 (socket says 172.21.15.99:36686) 2024-02-21T23:08:21.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.256+0000 7f9b86a00640 1 -- 172.21.15.99:0/4242190024 learned_addr learned my addr 172.21.15.99:0/4242190024 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:08:21.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.256+0000 7f9b87400640 1 --2- 172.21.15.99:0/4242190024 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fd8bb01cf0 0x55fd8bb02560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:21.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.256+0000 7f9b86a00640 1 -- 172.21.15.99:0/4242190024 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fd8bb01cf0 msgr2=0x55fd8bb02560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:21.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.256+0000 7f9b86a00640 1 --2- 172.21.15.99:0/4242190024 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fd8bb01cf0 0x55fd8bb02560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.256+0000 7f9b86a00640 1 -- 172.21.15.99:0/4242190024 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fd8bb01330 msgr2=0x55fd8bb017b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:21.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.256+0000 7f9b86a00640 1 --2- 172.21.15.99:0/4242190024 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fd8bb01330 0x55fd8bb017b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.256+0000 7f9b86a00640 1 -- 172.21.15.99:0/4242190024 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fd8b9baf80 con 0x55fd8bac6660 2024-02-21T23:08:21.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.257+0000 7f9b86a00640 1 --2- 172.21.15.99:0/4242190024 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd8bac6660 0x55fd8bac6a40 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f9b78009860 tx=0x7f9b78030000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=149f3d7c727ed24b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:21.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.257+0000 7f9b73400640 1 -- 172.21.15.99:0/4242190024 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b78052070 con 0x55fd8bac6660 2024-02-21T23:08:21.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.257+0000 7f9b73400640 1 -- 172.21.15.99:0/4242190024 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b78044900 con 0x55fd8bac6660 2024-02-21T23:08:21.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.257+0000 7f9b73400640 1 -- 172.21.15.99:0/4242190024 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b78035040 con 0x55fd8bac6660 2024-02-21T23:08:21.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.258+0000 7f9b90b8d740 1 -- 172.21.15.99:0/4242190024 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd8bac6660 msgr2=0x55fd8bac6a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:21.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.258+0000 7f9b90b8d740 1 --2- 172.21.15.99:0/4242190024 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd8bac6660 0x55fd8bac6a40 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f9b78009860 tx=0x7f9b78030000 comp rx=0 tx=0).stop 2024-02-21T23:08:21.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.258+0000 7f9b90b8d740 1 -- 172.21.15.99:0/4242190024 shutdown_connections 2024-02-21T23:08:21.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.258+0000 7f9b90b8d740 1 --2- 172.21.15.99:0/4242190024 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fd8bb01cf0 0x55fd8bb02560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.258+0000 7f9b90b8d740 1 --2- 172.21.15.99:0/4242190024 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fd8bb01330 0x55fd8bb017b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.258+0000 7f9b90b8d740 1 --2- 172.21.15.99:0/4242190024 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd8bac6660 0x55fd8bac6a40 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.258+0000 7f9b90b8d740 1 -- 172.21.15.99:0/4242190024 >> 172.21.15.99:0/4242190024 conn(0x55fd8ba886d0 msgr2=0x55fd8ba89750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:08:21.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.258+0000 7f9b90b8d740 1 -- 172.21.15.99:0/4242190024 shutdown_connections 2024-02-21T23:08:21.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.258+0000 7f9b90b8d740 1 -- 172.21.15.99:0/4242190024 wait complete. 2024-02-21T23:08:21.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.259+0000 7f9b90b8d740 1 -- start start 2024-02-21T23:08:21.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.260+0000 7f9b90b8d740 1 Processor -- start 2024-02-21T23:08:21.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.262+0000 7f9b90b8d740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fd8bb01330 0x55fd8babc280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:21.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.262+0000 7f9b90b8d740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fd8bb01cf0 0x55fd8bb0a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:21.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.262+0000 7f9b90b8d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd8bad07e0 0x55fd8bb0a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:21.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.262+0000 7f9b90b8d740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd8bb000a0 con 0x55fd8bb01cf0 2024-02-21T23:08:21.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.262+0000 7f9b90b8d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd8b98d380 con 0x55fd8bad07e0 2024-02-21T23:08:21.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.262+0000 7f9b90b8d740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd8baffdc0 con 0x55fd8bb01330 2024-02-21T23:08:21.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.262+0000 7f9b90b8d740 10 client.0 _ll_register_callbacks cb 0x55fd8b9e6280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:08:21.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.262+0000 7f9b86000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fd8bb01cf0 0x55fd8bb0a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:21.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.262+0000 7f9b86a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fd8bb01330 0x55fd8babc280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:21.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.262+0000 7f9b86000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fd8bb01cf0 0x55fd8bb0a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:41698/0 (socket says 172.21.15.99:41698) 2024-02-21T23:08:21.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.262+0000 7f9b86000640 1 -- 172.21.15.99:0/3356508160 learned_addr learned my addr 172.21.15.99:0/3356508160 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:08:21.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.263+0000 7f9b87400640 1 --2- 172.21.15.99:0/3356508160 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd8bad07e0 0x55fd8bb0a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:21.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.263+0000 7f9b86a00640 1 -- 172.21.15.99:0/3356508160 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd8bad07e0 msgr2=0x55fd8bb0a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:21.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.263+0000 7f9b86a00640 1 --2- 172.21.15.99:0/3356508160 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd8bad07e0 0x55fd8bb0a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.263+0000 7f9b86a00640 1 -- 172.21.15.99:0/3356508160 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fd8bb01cf0 msgr2=0x55fd8bb0a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:21.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.263+0000 7f9b86a00640 1 --2- 172.21.15.99:0/3356508160 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fd8bb01cf0 0x55fd8bb0a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.263+0000 7f9b86a00640 1 -- 172.21.15.99:0/3356508160 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fd8b9b5c20 con 0x55fd8bb01330 2024-02-21T23:08:21.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.263+0000 7f9b86000640 1 --2- 172.21.15.99:0/3356508160 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fd8bb01cf0 0x55fd8bb0a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:08:21.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.263+0000 7f9b86a00640 1 --2- 172.21.15.99:0/3356508160 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fd8bb01330 0x55fd8babc280 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f9b7804c000 tx=0x7f9b78004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9bf94ad1275b4098 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:21.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.263+0000 7f9b67e00640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-02-21T23:08:21.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.263+0000 7f9b67e00640 1 -- 172.21.15.99:0/3356508160 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b78052070 con 0x55fd8bb01330 2024-02-21T23:08:21.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.264+0000 7f9b90b8d740 1 -- 172.21.15.99:0/3356508160 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9b78044900 con 0x55fd8bb01330 2024-02-21T23:08:21.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.264+0000 7f9b67e00640 1 -- 172.21.15.99:0/3356508160 <== mon.2 v2:172.21.15.181:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f9b7803a6f0 con 0x55fd8bb01330 2024-02-21T23:08:21.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.264+0000 7f9b67e00640 1 -- 172.21.15.99:0/3356508160 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9b7803a8f0 con 0x55fd8bb01330 2024-02-21T23:08:21.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.264+0000 7f9b90b8d740 10 client.6419 fetch_fsmap learned FSMap version 17 2024-02-21T23:08:21.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.264+0000 7f9b90b8d740 1 -- 172.21.15.99:0/3356508160 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55fd8b7033f0 con 0x55fd8bb01330 2024-02-21T23:08:21.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.264+0000 7f9b67e00640 1 -- 172.21.15.99:0/3356508160 <== mon.2 v2:172.21.15.181:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b78044900 con 0x55fd8bb01330 2024-02-21T23:08:21.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.264+0000 7f9b67e00640 1 -- 172.21.15.99:0/3356508160 <== mon.2 v2:172.21.15.181:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f9b7803aa90 con 0x55fd8bb01330 2024-02-21T23:08:21.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.265+0000 7f9b90b8d740 10 client.6419 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:08:21.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.265+0000 7f9b90b8d740 10 client.6419 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.d 2024-02-21T23:08:21.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.265+0000 7f9b90b8d740 20 client.6419 populate_metadata read hostname 'smithi099' 2024-02-21T23:08:21.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.265+0000 7f9b90b8d740 1 --2- 172.21.15.99:0/3356508160 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x55fd8bb0af10 0x55fd8bb0b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:21.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.265+0000 7f9b90b8d740 4 client.6419 mds_command: new command op to 4348 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:08:21.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.265+0000 7f9b90b8d740 1 -- 172.21.15.99:0/3356508160 --> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fd8b9fc090 con 0x55fd8bb0af10 2024-02-21T23:08:21.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.265+0000 7f9b86000640 1 --2- 172.21.15.99:0/3356508160 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x55fd8bb0af10 0x55fd8bb0b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:21.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.265+0000 7f9b86000640 1 --2- 172.21.15.99:0/3356508160 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x55fd8bb0af10 0x55fd8bb0b380 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=115439371ba00253 server_cookie=3e75504015fe4d0 in_seq=0 out_seq=0 2024-02-21T23:08:21.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.265+0000 7f9b67e00640 10 client.6419 ms_handle_connect on v2:172.21.15.99:6834/2243461688 2024-02-21T23:08:21.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.266+0000 7f9b67e00640 1 -- 172.21.15.99:0/3356508160 <== mds.2 v2:172.21.15.99:6834/2243461688 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55fd8b9fc090 con 0x55fd8bb0af10 2024-02-21T23:08:21.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.266+0000 7f9b67e00640 10 client.6419 handle_command_reply: tid=0 2024-02-21T23:08:21.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.266+0000 7f9b90b8d740 1 client.6419 shutdown 2024-02-21T23:08:21.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.266+0000 7f9b90b8d740 1 -- 172.21.15.99:0/3356508160 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fd8bb01330 msgr2=0x55fd8babc280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:21.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.266+0000 7f9b90b8d740 1 --2- 172.21.15.99:0/3356508160 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fd8bb01330 0x55fd8babc280 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f9b7804c000 tx=0x7f9b78004730 comp rx=0 tx=0).stop 2024-02-21T23:08:21.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.267+0000 7f9b90b8d740 1 -- 172.21.15.99:0/3356508160 shutdown_connections 2024-02-21T23:08:21.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.267+0000 7f9b90b8d740 1 --2- 172.21.15.99:0/3356508160 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x55fd8bb0af10 0x55fd8bb0b380 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.267+0000 7f9b90b8d740 1 --2- 172.21.15.99:0/3356508160 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd8bad07e0 0x55fd8bb0a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.267+0000 7f9b90b8d740 1 --2- 172.21.15.99:0/3356508160 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fd8bb01cf0 0x55fd8bb0a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.267+0000 7f9b90b8d740 1 --2- 172.21.15.99:0/3356508160 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fd8bb01330 0x55fd8babc280 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.267+0000 7f9b90b8d740 1 -- 172.21.15.99:0/3356508160 >> 172.21.15.99:0/3356508160 conn(0x55fd8bac6660 msgr2=0x55fd8bb007b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:08:21.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.267+0000 7f9b67e00640 0 client.6419 ms_handle_reset on v2:172.21.15.99:6834/2243461688 2024-02-21T23:08:21.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.267+0000 7f9b90b8d740 1 -- 172.21.15.99:0/3356508160 shutdown_connections 2024-02-21T23:08:21.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.267+0000 7f9b90b8d740 1 -- 172.21.15.99:0/3356508160 wait complete. 2024-02-21T23:08:21.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.267+0000 7f9b90b8d740 20 client.6419 trim_cache size 0 max 16384 2024-02-21T23:08:21.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.281+0000 7f9b90b8d740 1 Processor -- start 2024-02-21T23:08:21.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.281+0000 7f9b90b8d740 1 -- start start 2024-02-21T23:08:21.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.282+0000 7f9b90b8d740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fd8bad07e0 0x55fd8bafc820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:21.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.282+0000 7f9b90b8d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd8bb01330 0x55fd8bad4970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:21.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.282+0000 7f9b90b8d740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fd8bb01cf0 0x55fd8bad4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:21.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.282+0000 7f9b90b8d740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8822c510 con 0x55fd8bb01cf0 2024-02-21T23:08:21.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.282+0000 7f9b90b8d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8822a0b0 con 0x55fd8bb01330 2024-02-21T23:08:21.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.282+0000 7f9b90b8d740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b88228290 con 0x55fd8bad07e0 2024-02-21T23:08:21.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.283+0000 7f9b86a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fd8bad07e0 0x55fd8bafc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:21.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.283+0000 7f9b87400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fd8bb01cf0 0x55fd8bad4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:21.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.283+0000 7f9b86000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd8bb01330 0x55fd8bad4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:21.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.283+0000 7f9b86a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fd8bad07e0 0x55fd8bafc820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:38390/0 (socket says 172.21.15.99:38390) 2024-02-21T23:08:21.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.283+0000 7f9b86a00640 1 -- 172.21.15.99:0/1330998070 learned_addr learned my addr 172.21.15.99:0/1330998070 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:08:21.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.283+0000 7f9b86a00640 1 -- 172.21.15.99:0/1330998070 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd8bb01330 msgr2=0x55fd8bad4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:21.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.283+0000 7f9b86a00640 1 --2- 172.21.15.99:0/1330998070 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd8bb01330 0x55fd8bad4970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.283+0000 7f9b86a00640 1 -- 172.21.15.99:0/1330998070 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fd8bb01cf0 msgr2=0x55fd8bad4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:21.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.283+0000 7f9b86a00640 1 --2- 172.21.15.99:0/1330998070 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fd8bb01cf0 0x55fd8bad4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.283+0000 7f9b86a00640 1 -- 172.21.15.99:0/1330998070 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fd8b7cd7d0 con 0x55fd8bad07e0 2024-02-21T23:08:21.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.284+0000 7f9b86a00640 1 --2- 172.21.15.99:0/1330998070 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fd8bad07e0 0x55fd8bafc820 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f9b7803a8a0 tx=0x7f9b78052000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93a0bb09ec2e91dd server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:21.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.284+0000 7f9b72a00640 1 -- 172.21.15.99:0/1330998070 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b7803aa90 con 0x55fd8bad07e0 2024-02-21T23:08:21.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.284+0000 7f9b72a00640 1 -- 172.21.15.99:0/1330998070 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b780447d0 con 0x55fd8bad07e0 2024-02-21T23:08:21.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.284+0000 7f9b72a00640 1 -- 172.21.15.99:0/1330998070 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b7805c540 con 0x55fd8bad07e0 2024-02-21T23:08:21.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.285+0000 7f9b90b8d740 1 -- 172.21.15.99:0/1330998070 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fd8bad07e0 msgr2=0x55fd8bafc820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:21.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.285+0000 7f9b90b8d740 1 --2- 172.21.15.99:0/1330998070 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fd8bad07e0 0x55fd8bafc820 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f9b7803a8a0 tx=0x7f9b78052000 comp rx=0 tx=0).stop 2024-02-21T23:08:21.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.285+0000 7f9b90b8d740 1 -- 172.21.15.99:0/1330998070 shutdown_connections 2024-02-21T23:08:21.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.285+0000 7f9b90b8d740 1 --2- 172.21.15.99:0/1330998070 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fd8bb01cf0 0x55fd8bad4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.285+0000 7f9b90b8d740 1 --2- 172.21.15.99:0/1330998070 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd8bb01330 0x55fd8bad4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.285+0000 7f9b90b8d740 1 --2- 172.21.15.99:0/1330998070 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fd8bad07e0 0x55fd8bafc820 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.285+0000 7f9b90b8d740 1 -- 172.21.15.99:0/1330998070 >> 172.21.15.99:0/1330998070 conn(0x55fd8bac6660 msgr2=0x55fd8bb0b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:08:21.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.285+0000 7f9b90b8d740 1 -- 172.21.15.99:0/1330998070 shutdown_connections 2024-02-21T23:08:21.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.285+0000 7f9b90b8d740 1 -- 172.21.15.99:0/1330998070 wait complete. 2024-02-21T23:08:21.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.286+0000 7f9b90b8d740 1 -- start start 2024-02-21T23:08:21.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.286+0000 7f9b90b8d740 1 Processor -- start 2024-02-21T23:08:21.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.287+0000 7f9b90b8d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd8bad07e0 0x55fd8bad5380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:21.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.287+0000 7f9b90b8d740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fd8bb01330 0x55fd8bacb470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:21.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.287+0000 7f9b90b8d740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fd8bb01cf0 0x55fd8bb1afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:21.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.287+0000 7f9b90b8d740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b88228890 con 0x55fd8bb01330 2024-02-21T23:08:21.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.287+0000 7f9b90b8d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b88229a90 con 0x55fd8bad07e0 2024-02-21T23:08:21.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.287+0000 7f9b90b8d740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b88228e90 con 0x55fd8bb01cf0 2024-02-21T23:08:21.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.287+0000 7f9b90b8d740 10 client.0 _ll_register_callbacks cb 0x7f9b78050070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:08:21.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.287+0000 7f9b86000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fd8bb01330 0x55fd8bacb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:21.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.287+0000 7f9b86a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd8bad07e0 0x55fd8bad5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:21.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.287+0000 7f9b86a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd8bad07e0 0x55fd8bad5380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:36722/0 (socket says 172.21.15.99:36722) 2024-02-21T23:08:21.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.288+0000 7f9b86000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fd8bb01330 0x55fd8bacb470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:41720/0 (socket says 172.21.15.99:41720) 2024-02-21T23:08:21.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.288+0000 7f9b86a00640 1 -- 172.21.15.99:0/4272816995 learned_addr learned my addr 172.21.15.99:0/4272816995 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:08:21.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.288+0000 7f9b87400640 1 --2- 172.21.15.99:0/4272816995 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fd8bb01cf0 0x55fd8bb1afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:21.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.288+0000 7f9b86a00640 1 -- 172.21.15.99:0/4272816995 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fd8bb01cf0 msgr2=0x55fd8bb1afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:21.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.288+0000 7f9b86a00640 1 --2- 172.21.15.99:0/4272816995 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fd8bb01cf0 0x55fd8bb1afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.288+0000 7f9b86a00640 1 -- 172.21.15.99:0/4272816995 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fd8bb01330 msgr2=0x55fd8bacb470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:21.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.288+0000 7f9b86a00640 1 --2- 172.21.15.99:0/4272816995 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fd8bb01330 0x55fd8bacb470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.288+0000 7f9b86a00640 1 -- 172.21.15.99:0/4272816995 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fd8bb01a90 con 0x55fd8bad07e0 2024-02-21T23:08:21.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.288+0000 7f9b86000640 1 --2- 172.21.15.99:0/4272816995 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fd8bb01330 0x55fd8bacb470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:08:21.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.288+0000 7f9b86a00640 1 --2- 172.21.15.99:0/4272816995 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd8bad07e0 0x55fd8bad5380 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f9b7802bee0 tx=0x7f9b78008030 comp rx=0 tx=0).ready entity=mon.1 client_cookie=717fb251272abb14 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:21.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.288+0000 7f9b67e00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-02-21T23:08:21.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.288+0000 7f9b67e00640 1 -- 172.21.15.99:0/4272816995 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b7806a060 con 0x55fd8bad07e0 2024-02-21T23:08:21.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.289+0000 7f9b90b8d740 1 -- 172.21.15.99:0/4272816995 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9b780447d0 con 0x55fd8bad07e0 2024-02-21T23:08:21.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.289+0000 7f9b67e00640 1 -- 172.21.15.99:0/4272816995 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f9b78044980 con 0x55fd8bad07e0 2024-02-21T23:08:21.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.289+0000 7f9b67e00640 1 -- 172.21.15.99:0/4272816995 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9b78071050 con 0x55fd8bad07e0 2024-02-21T23:08:21.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.289+0000 7f9b90b8d740 10 client.6424 fetch_fsmap learned FSMap version 17 2024-02-21T23:08:21.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.289+0000 7f9b90b8d740 1 -- 172.21.15.99:0/4272816995 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55fd8bb1a460 con 0x55fd8bad07e0 2024-02-21T23:08:21.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.289+0000 7f9b67e00640 1 -- 172.21.15.99:0/4272816995 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b780447d0 con 0x55fd8bad07e0 2024-02-21T23:08:21.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.289+0000 7f9b67e00640 1 -- 172.21.15.99:0/4272816995 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f9b7805c540 con 0x55fd8bad07e0 2024-02-21T23:08:21.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.289+0000 7f9b90b8d740 10 client.6424 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:08:21.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.289+0000 7f9b90b8d740 10 client.6424 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.d 2024-02-21T23:08:21.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.289+0000 7f9b90b8d740 20 client.6424 populate_metadata read hostname 'smithi099' 2024-02-21T23:08:21.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.289+0000 7f9b90b8d740 1 --2- 172.21.15.99:0/4272816995 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x55fd8ba91110 0x55fd8bac9a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:21.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.289+0000 7f9b90b8d740 4 client.6424 mds_command: new command op to 4348 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T23:08:21.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.289+0000 7f9b90b8d740 1 -- 172.21.15.99:0/4272816995 --> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55fd8b9f63e0 con 0x55fd8ba91110 2024-02-21T23:08:21.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.290+0000 7f9b86000640 1 --2- 172.21.15.99:0/4272816995 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x55fd8ba91110 0x55fd8bac9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:21.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.291+0000 7f9b86000640 1 --2- 172.21.15.99:0/4272816995 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x55fd8ba91110 0x55fd8bac9a80 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1ce539fca6ef996d server_cookie=f560b08d684f3f3c in_seq=0 out_seq=0 2024-02-21T23:08:21.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.291+0000 7f9b67e00640 10 client.6424 ms_handle_connect on v2:172.21.15.99:6834/2243461688 2024-02-21T23:08:21.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.291+0000 7f9b67e00640 1 -- 172.21.15.99:0/4272816995 <== mds.2 v2:172.21.15.99:6834/2243461688 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55fd8b9f63e0 con 0x55fd8ba91110 2024-02-21T23:08:21.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.291+0000 7f9b67e00640 10 client.6424 handle_command_reply: tid=0 2024-02-21T23:08:21.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.291+0000 7f9b90b8d740 1 client.6424 shutdown 2024-02-21T23:08:21.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.291+0000 7f9b90b8d740 1 -- 172.21.15.99:0/4272816995 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd8bad07e0 msgr2=0x55fd8bad5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:21.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.291+0000 7f9b90b8d740 1 --2- 172.21.15.99:0/4272816995 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd8bad07e0 0x55fd8bad5380 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f9b7802bee0 tx=0x7f9b78008030 comp rx=0 tx=0).stop 2024-02-21T23:08:21.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.291+0000 7f9b90b8d740 1 -- 172.21.15.99:0/4272816995 shutdown_connections 2024-02-21T23:08:21.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.291+0000 7f9b90b8d740 1 --2- 172.21.15.99:0/4272816995 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x55fd8ba91110 0x55fd8bac9a80 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.291+0000 7f9b90b8d740 1 --2- 172.21.15.99:0/4272816995 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55fd8bb01cf0 0x55fd8bb1afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.291+0000 7f9b90b8d740 1 --2- 172.21.15.99:0/4272816995 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55fd8bb01330 0x55fd8bacb470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.291+0000 7f9b90b8d740 1 --2- 172.21.15.99:0/4272816995 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fd8bad07e0 0x55fd8bad5380 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.291+0000 7f9b67e00640 0 client.6424 ms_handle_reset on v2:172.21.15.99:6834/2243461688 2024-02-21T23:08:21.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.291+0000 7f9b90b8d740 1 -- 172.21.15.99:0/4272816995 >> 172.21.15.99:0/4272816995 conn(0x55fd8bac6660 msgr2=0x55fd8baf6710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:08:21.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.291+0000 7f9b90b8d740 1 -- 172.21.15.99:0/4272816995 shutdown_connections 2024-02-21T23:08:21.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.291+0000 7f9b90b8d740 1 -- 172.21.15.99:0/4272816995 wait complete. 2024-02-21T23:08:21.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.292+0000 7f9b90b8d740 20 client.6424 trim_cache size 0 max 16384 2024-02-21T23:08:21.290 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-02-21T23:08:21.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.292+0000 7f9b87e00640 1 -- 172.21.15.99:0/329092072 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f9b6809eed0 msgr2=0x7f9b680a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:21.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.292+0000 7f9b87e00640 1 --2- 172.21.15.99:0/329092072 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f9b6809eed0 0x7f9b680a1390 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9b78036000 tx=0x7f9b7803c040 comp rx=0 tx=0).stop 2024-02-21T23:08:21.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.292+0000 7f9b87e00640 1 -- 172.21.15.99:0/329092072 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b8818b060 msgr2=0x7f9b8821fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:21.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.292+0000 7f9b87e00640 1 --2- 172.21.15.99:0/329092072 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b8818b060 0x7f9b8821fb10 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f9b7400c460 tx=0x7f9b7400c920 comp rx=0 tx=0).stop 2024-02-21T23:08:21.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.292+0000 7f9b87e00640 1 -- 172.21.15.99:0/329092072 shutdown_connections 2024-02-21T23:08:21.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.292+0000 7f9b87e00640 1 --2- 172.21.15.99:0/329092072 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f9b6809eed0 0x7f9b680a1390 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.292+0000 7f9b87e00640 1 --2- 172.21.15.99:0/329092072 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9b8818b4f0 0x7f9b88220050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.292+0000 7f9b87e00640 1 --2- 172.21.15.99:0/329092072 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9b8818b060 0x7f9b8821fb10 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.292+0000 7f9b87e00640 1 --2- 172.21.15.99:0/329092072 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9b8817f490 0x7f9b881749a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.292+0000 7f9b87e00640 1 -- 172.21.15.99:0/329092072 >> 172.21.15.99:0/329092072 conn(0x7f9b880d29b0 msgr2=0x7f9b8818c820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:08:21.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.293+0000 7f9b87e00640 1 -- 172.21.15.99:0/329092072 shutdown_connections 2024-02-21T23:08:21.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.293+0000 7f9b87e00640 1 -- 172.21.15.99:0/329092072 wait complete. 2024-02-21T23:08:21.299 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T23:08:21.299 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-02-21T23:08:21.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.513+0000 7f66e2200640 1 Processor -- start 2024-02-21T23:08:21.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.513+0000 7f66e2200640 1 -- start start 2024-02-21T23:08:21.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.517+0000 7f66e2200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f66dc182cb0 0x7f66dc0f5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:21.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.517+0000 7f66e2200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f66dc06daa0 0x7f66dc18c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:21.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.517+0000 7f66e2200640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66dc0f6310 con 0x7f66dc06fff0 2024-02-21T23:08:21.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.517+0000 7f66e2200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66dc070470 con 0x7f66dc06daa0 2024-02-21T23:08:21.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.517+0000 7f66e2200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66dc189b80 con 0x7f66dc182cb0 2024-02-21T23:08:21.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.517+0000 7f66dbe00640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f66dc06fff0 0x7f66dc06d390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:52676/0 (socket says 172.21.15.99:52676) 2024-02-21T23:08:21.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.517+0000 7f66dbe00640 1 -- 172.21.15.99:0/595272975 learned_addr learned my addr 172.21.15.99:0/595272975 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:08:21.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.517+0000 7f66e1800640 1 --2- 172.21.15.99:0/595272975 >> v2:172.21.15.99:3300/0 conn(0x7f66dc06daa0 0x7f66dc18c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:21.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.517+0000 7f66e0e00640 1 --2- 172.21.15.99:0/595272975 >> v2:172.21.15.162:3300/0 conn(0x7f66dc182cb0 0x7f66dc0f5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:21.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.518+0000 7f66db400640 1 -- 172.21.15.99:0/595272975 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3660018553 0 0) 0x7f66dc0f6310 con 0x7f66dc06fff0 2024-02-21T23:08:21.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.518+0000 7f66db400640 1 -- 172.21.15.99:0/595272975 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66c4003520 con 0x7f66dc06fff0 2024-02-21T23:08:21.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.518+0000 7f66e0e00640 1 -- 172.21.15.99:0/595272975 >> v2:172.21.15.99:3300/0 conn(0x7f66dc06daa0 msgr2=0x7f66dc18c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:21.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.518+0000 7f66e0e00640 1 --2- 172.21.15.99:0/595272975 >> v2:172.21.15.99:3300/0 conn(0x7f66dc06daa0 0x7f66dc18c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.518+0000 7f66e0e00640 1 -- 172.21.15.99:0/595272975 >> v1:172.21.15.181:6789/0 conn(0x7f66dc06fff0 legacy=0x7f66dc06d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:21.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.518+0000 7f66e0e00640 1 -- 172.21.15.99:0/595272975 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66dc0f65f0 con 0x7f66dc182cb0 2024-02-21T23:08:21.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.519+0000 7f66e0e00640 1 --2- 172.21.15.99:0/595272975 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66dc182cb0 0x7f66dc0f5cb0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f66dc0751c0 tx=0x7f66d002b7c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7821c452813abad1 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:21.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.519+0000 7f66db400640 1 -- 172.21.15.99:0/595272975 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d0038070 con 0x7f66dc182cb0 2024-02-21T23:08:21.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.519+0000 7f66db400640 1 -- 172.21.15.99:0/595272975 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66d0031520 con 0x7f66dc182cb0 2024-02-21T23:08:21.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.520+0000 7f66db400640 1 -- 172.21.15.99:0/595272975 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d00318d0 con 0x7f66dc182cb0 2024-02-21T23:08:21.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.520+0000 7f66e2200640 1 -- 172.21.15.99:0/595272975 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66dc182cb0 msgr2=0x7f66dc0f5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:21.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.520+0000 7f66e2200640 1 --2- 172.21.15.99:0/595272975 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66dc182cb0 0x7f66dc0f5cb0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f66dc0751c0 tx=0x7f66d002b7c0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.520+0000 7f66e2200640 1 -- 172.21.15.99:0/595272975 shutdown_connections 2024-02-21T23:08:21.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.520+0000 7f66e2200640 1 --2- 172.21.15.99:0/595272975 >> v2:172.21.15.99:3300/0 conn(0x7f66dc06daa0 0x7f66dc18c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.520+0000 7f66e2200640 1 --2- 172.21.15.99:0/595272975 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66dc182cb0 0x7f66dc0f5cb0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.520+0000 7f66e2200640 1 -- 172.21.15.99:0/595272975 >> 172.21.15.99:0/595272975 conn(0x7f66dc08cfd0 msgr2=0x7f66dc08d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:08:21.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.521+0000 7f66e2200640 1 -- 172.21.15.99:0/595272975 shutdown_connections 2024-02-21T23:08:21.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.521+0000 7f66e2200640 1 -- 172.21.15.99:0/595272975 wait complete. 2024-02-21T23:08:21.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.523+0000 7f66e2200640 1 Processor -- start 2024-02-21T23:08:21.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.523+0000 7f66e2200640 1 -- start start 2024-02-21T23:08:21.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.524+0000 7f66e2200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f66dc06daa0 0x7f66dc16aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:21.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.524+0000 7f66e2200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f66dc06fff0 0x7f66dc0ce840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:21.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.524+0000 7f66e2200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66dc182cb0 0x7f66dc221ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:21.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.524+0000 7f66e2200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66dc06cf00 con 0x7f66dc06daa0 2024-02-21T23:08:21.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.524+0000 7f66e2200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66dc183090 con 0x7f66dc182cb0 2024-02-21T23:08:21.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.524+0000 7f66e2200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66dc0f6bb0 con 0x7f66dc06fff0 2024-02-21T23:08:21.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.524+0000 7f66e0e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f66dc06daa0 0x7f66dc16aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:21.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.524+0000 7f66e0e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f66dc06daa0 0x7f66dc16aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:41728/0 (socket says 172.21.15.99:41728) 2024-02-21T23:08:21.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.524+0000 7f66e0e00640 1 -- 172.21.15.99:0/3248751367 learned_addr learned my addr 172.21.15.99:0/3248751367 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:08:21.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.524+0000 7f66dbe00640 1 --2- 172.21.15.99:0/3248751367 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f66dc06fff0 0x7f66dc0ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:21.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.524+0000 7f66e1800640 1 --2- 172.21.15.99:0/3248751367 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66dc182cb0 0x7f66dc221ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:21.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.525+0000 7f66e0e00640 1 -- 172.21.15.99:0/3248751367 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f66dc06fff0 msgr2=0x7f66dc0ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:21.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.525+0000 7f66e0e00640 1 --2- 172.21.15.99:0/3248751367 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f66dc06fff0 0x7f66dc0ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.525+0000 7f66e0e00640 1 -- 172.21.15.99:0/3248751367 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66dc182cb0 msgr2=0x7f66dc221ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:21.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.525+0000 7f66e0e00640 1 --2- 172.21.15.99:0/3248751367 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66dc182cb0 0x7f66dc221ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.525+0000 7f66e0e00640 1 -- 172.21.15.99:0/3248751367 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66dc222990 con 0x7f66dc06daa0 2024-02-21T23:08:21.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.525+0000 7f66e0e00640 1 --2- 172.21.15.99:0/3248751367 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f66dc06daa0 0x7f66dc16aff0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f66d0000c00 tx=0x7f66d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:21.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.525+0000 7f66d8c00640 1 -- 172.21.15.99:0/3248751367 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d0042030 con 0x7f66dc06daa0 2024-02-21T23:08:21.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.526+0000 7f66d8c00640 1 -- 172.21.15.99:0/3248751367 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66d003d670 con 0x7f66dc06daa0 2024-02-21T23:08:21.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.526+0000 7f66d8c00640 1 -- 172.21.15.99:0/3248751367 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d0038040 con 0x7f66dc06daa0 2024-02-21T23:08:21.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.526+0000 7f66e2200640 1 -- 172.21.15.99:0/3248751367 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66dc222c70 con 0x7f66dc06daa0 2024-02-21T23:08:21.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.526+0000 7f66e2200640 1 -- 172.21.15.99:0/3248751367 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66dc21ef20 con 0x7f66dc06daa0 2024-02-21T23:08:21.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.529+0000 7f66d8c00640 1 -- 172.21.15.99:0/3248751367 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f66d0045070 con 0x7f66dc06daa0 2024-02-21T23:08:21.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.531+0000 7f66d8c00640 1 --2- 172.21.15.99:0/3248751367 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f66bc09ef00 0x7f66bc0a13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:21.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.531+0000 7f66d8c00640 1 -- 172.21.15.99:0/3248751367 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f66d00eb6e0 con 0x7f66dc06daa0 2024-02-21T23:08:21.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.531+0000 7f66dbe00640 1 --2- 172.21.15.99:0/3248751367 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f66bc09ef00 0x7f66bc0a13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:21.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.532+0000 7f66dbe00640 1 --2- 172.21.15.99:0/3248751367 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f66bc09ef00 0x7f66bc0a13c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f66dc0f5520 tx=0x7f66c8009040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:21.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.532+0000 7f66e6606740 1 Processor -- start 2024-02-21T23:08:21.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.532+0000 7f66e6606740 1 -- start start 2024-02-21T23:08:21.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.534+0000 7f66e6606740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b9def16660 0x55b9def16a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:21.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.534+0000 7f66e6606740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b9def51330 0x55b9def517b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:21.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.534+0000 7f66e6606740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b9def51cf0 0x55b9def52560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:21.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.534+0000 7f66e6606740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9dee3eb50 con 0x55b9def51330 2024-02-21T23:08:21.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.534+0000 7f66e6606740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9dede7da0 con 0x55b9def51cf0 2024-02-21T23:08:21.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.534+0000 7f66e6606740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9dee3abf0 con 0x55b9def16660 2024-02-21T23:08:21.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.535+0000 7f66dbe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b9def51330 0x55b9def517b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:21.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.535+0000 7f66e0e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b9def16660 0x55b9def16a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:21.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.535+0000 7f66e0e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b9def16660 0x55b9def16a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:38436/0 (socket says 172.21.15.99:38436) 2024-02-21T23:08:21.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.535+0000 7f66dbe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b9def51330 0x55b9def517b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:41732/0 (socket says 172.21.15.99:41732) 2024-02-21T23:08:21.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.535+0000 7f66e0e00640 1 -- 172.21.15.99:0/1481358325 learned_addr learned my addr 172.21.15.99:0/1481358325 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:08:21.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.535+0000 7f66e1800640 1 --2- 172.21.15.99:0/1481358325 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b9def51cf0 0x55b9def52560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:21.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.535+0000 7f66e0e00640 1 -- 172.21.15.99:0/1481358325 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b9def51cf0 msgr2=0x55b9def52560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:21.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.535+0000 7f66e0e00640 1 --2- 172.21.15.99:0/1481358325 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b9def51cf0 0x55b9def52560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.535+0000 7f66e0e00640 1 -- 172.21.15.99:0/1481358325 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b9def51330 msgr2=0x55b9def517b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:21.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.535+0000 7f66e0e00640 1 --2- 172.21.15.99:0/1481358325 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b9def51330 0x55b9def517b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.535+0000 7f66e0e00640 1 -- 172.21.15.99:0/1481358325 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b9dee0af80 con 0x55b9def16660 2024-02-21T23:08:21.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.535+0000 7f66e0e00640 1 --2- 172.21.15.99:0/1481358325 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b9def16660 0x55b9def16a40 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f66d00e8c30 tx=0x7f66d00b5240 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2ff2c9fd19b8b0c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:21.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.536+0000 7f66cd600640 1 -- 172.21.15.99:0/1481358325 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d00b8e70 con 0x55b9def16660 2024-02-21T23:08:21.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.536+0000 7f66cd600640 1 -- 172.21.15.99:0/1481358325 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66d00bcfc0 con 0x55b9def16660 2024-02-21T23:08:21.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.536+0000 7f66cd600640 1 -- 172.21.15.99:0/1481358325 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d00c1610 con 0x55b9def16660 2024-02-21T23:08:21.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.537+0000 7f66e6606740 1 -- 172.21.15.99:0/1481358325 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b9def16660 msgr2=0x55b9def16a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:21.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.537+0000 7f66e6606740 1 --2- 172.21.15.99:0/1481358325 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b9def16660 0x55b9def16a40 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f66d00e8c30 tx=0x7f66d00b5240 comp rx=0 tx=0).stop 2024-02-21T23:08:21.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.537+0000 7f66e6606740 1 -- 172.21.15.99:0/1481358325 shutdown_connections 2024-02-21T23:08:21.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.537+0000 7f66e6606740 1 --2- 172.21.15.99:0/1481358325 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b9def51cf0 0x55b9def52560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.537+0000 7f66e6606740 1 --2- 172.21.15.99:0/1481358325 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b9def51330 0x55b9def517b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.537+0000 7f66e6606740 1 --2- 172.21.15.99:0/1481358325 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b9def16660 0x55b9def16a40 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.537+0000 7f66e6606740 1 -- 172.21.15.99:0/1481358325 >> 172.21.15.99:0/1481358325 conn(0x55b9deed86d0 msgr2=0x55b9deed9750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:08:21.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.537+0000 7f66e6606740 1 -- 172.21.15.99:0/1481358325 shutdown_connections 2024-02-21T23:08:21.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.537+0000 7f66e6606740 1 -- 172.21.15.99:0/1481358325 wait complete. 2024-02-21T23:08:21.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.538+0000 7f66e6606740 1 -- start start 2024-02-21T23:08:21.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.539+0000 7f66e6606740 1 Processor -- start 2024-02-21T23:08:21.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.541+0000 7f66e6606740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b9def51330 0x55b9def5a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:21.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.541+0000 7f66e6606740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b9def51cf0 0x55b9def5d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:21.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.541+0000 7f66e6606740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b9def5b1a0 0x55b9def0c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:21.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.541+0000 7f66e6606740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9dee3abf0 con 0x55b9def5b1a0 2024-02-21T23:08:21.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.541+0000 7f66e6606740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9deddd380 con 0x55b9def51cf0 2024-02-21T23:08:21.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.541+0000 7f66e6606740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9def500a0 con 0x55b9def51330 2024-02-21T23:08:21.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.541+0000 7f66e6606740 10 client.0 _ll_register_callbacks cb 0x55b9dee36280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:08:21.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.541+0000 7f66e1800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b9def5b1a0 0x55b9def0c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:21.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.541+0000 7f66e0e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b9def51330 0x55b9def5a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:21.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.541+0000 7f66e0e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b9def51330 0x55b9def5a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:38444/0 (socket says 172.21.15.99:38444) 2024-02-21T23:08:21.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.541+0000 7f66e1800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b9def5b1a0 0x55b9def0c1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:41744/0 (socket says 172.21.15.99:41744) 2024-02-21T23:08:21.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.541+0000 7f66e0e00640 1 -- 172.21.15.99:0/1963418130 learned_addr learned my addr 172.21.15.99:0/1963418130 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:08:21.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.541+0000 7f66dbe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b9def51cf0 0x55b9def5d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:21.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.542+0000 7f66e1800640 1 -- 172.21.15.99:0/1963418130 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b9def51330 msgr2=0x55b9def5a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:21.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.542+0000 7f66e1800640 1 --2- 172.21.15.99:0/1963418130 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b9def51330 0x55b9def5a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.542+0000 7f66e1800640 1 -- 172.21.15.99:0/1963418130 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b9def51cf0 msgr2=0x55b9def5d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:21.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.542+0000 7f66e1800640 1 --2- 172.21.15.99:0/1963418130 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b9def51cf0 0x55b9def5d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.542+0000 7f66e1800640 1 -- 172.21.15.99:0/1963418130 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b9dee05c20 con 0x55b9def5b1a0 2024-02-21T23:08:21.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.542+0000 7f66e1800640 1 --2- 172.21.15.99:0/1963418130 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b9def5b1a0 0x55b9def0c1f0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f66d4014d90 tx=0x7f66d4012670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fc303ed79641a92 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:21.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.542+0000 7f66c2000640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:08:21.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.542+0000 7f66c2000640 1 -- 172.21.15.99:0/1963418130 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d4003b90 con 0x55b9def5b1a0 2024-02-21T23:08:21.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.543+0000 7f66e6606740 1 -- 172.21.15.99:0/1963418130 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f66d00bcfc0 con 0x55b9def5b1a0 2024-02-21T23:08:21.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.543+0000 7f66c2000640 1 -- 172.21.15.99:0/1963418130 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f66d4003d30 con 0x55b9def5b1a0 2024-02-21T23:08:21.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.543+0000 7f66c2000640 1 -- 172.21.15.99:0/1963418130 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f66d4004030 con 0x55b9def5b1a0 2024-02-21T23:08:21.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.543+0000 7f66e6606740 10 client.6315 fetch_fsmap learned FSMap version 17 2024-02-21T23:08:21.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.543+0000 7f66e6606740 1 -- 172.21.15.99:0/1963418130 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55b9deb533f0 con 0x55b9def5b1a0 2024-02-21T23:08:21.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.543+0000 7f66c2000640 1 -- 172.21.15.99:0/1963418130 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66d00bcfc0 con 0x55b9def5b1a0 2024-02-21T23:08:21.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.544+0000 7f66c2000640 1 -- 172.21.15.99:0/1963418130 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f66d40041d0 con 0x55b9def5b1a0 2024-02-21T23:08:21.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.544+0000 7f66e6606740 10 client.6315 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:08:21.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.544+0000 7f66e6606740 10 client.6315 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2024-02-21T23:08:21.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.544+0000 7f66e6606740 20 client.6315 populate_metadata read hostname 'smithi099' 2024-02-21T23:08:21.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.544+0000 7f66e6606740 1 --2- 172.21.15.99:0/1963418130 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x55b9deed6810 0x55b9def12ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:21.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.544+0000 7f66e6606740 4 client.6315 mds_command: new command op to 4352 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:08:21.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.544+0000 7f66e6606740 1 -- 172.21.15.99:0/1963418130 --> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b9dee4c090 con 0x55b9deed6810 2024-02-21T23:08:21.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.544+0000 7f66e0e00640 1 --2- 172.21.15.99:0/1963418130 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x55b9deed6810 0x55b9def12ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:21.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.545+0000 7f66e0e00640 1 --2- 172.21.15.99:0/1963418130 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x55b9deed6810 0x55b9def12ba0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=51f7cb337e9d7210 server_cookie=6388403c7e433554 in_seq=0 out_seq=0 2024-02-21T23:08:21.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.545+0000 7f66c2000640 10 client.6315 ms_handle_connect on v2:172.21.15.99:6836/1676159950 2024-02-21T23:08:21.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.546+0000 7f66c2000640 1 -- 172.21.15.99:0/1963418130 <== mds.1 v2:172.21.15.99:6836/1676159950 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55b9dee4c090 con 0x55b9deed6810 2024-02-21T23:08:21.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.546+0000 7f66c2000640 10 client.6315 handle_command_reply: tid=0 2024-02-21T23:08:21.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.546+0000 7f66e6606740 1 client.6315 shutdown 2024-02-21T23:08:21.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.546+0000 7f66e6606740 1 -- 172.21.15.99:0/1963418130 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b9def5b1a0 msgr2=0x55b9def0c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:21.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.546+0000 7f66e6606740 1 --2- 172.21.15.99:0/1963418130 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b9def5b1a0 0x55b9def0c1f0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f66d4014d90 tx=0x7f66d4012670 comp rx=0 tx=0).stop 2024-02-21T23:08:21.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.546+0000 7f66e6606740 1 -- 172.21.15.99:0/1963418130 shutdown_connections 2024-02-21T23:08:21.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.546+0000 7f66e6606740 1 --2- 172.21.15.99:0/1963418130 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x55b9deed6810 0x55b9def12ba0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.546+0000 7f66e6606740 1 --2- 172.21.15.99:0/1963418130 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b9def5b1a0 0x55b9def0c1f0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.546+0000 7f66e6606740 1 --2- 172.21.15.99:0/1963418130 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b9def51cf0 0x55b9def5d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.546+0000 7f66e6606740 1 --2- 172.21.15.99:0/1963418130 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b9def51330 0x55b9def5a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.546+0000 7f66e6606740 1 -- 172.21.15.99:0/1963418130 >> 172.21.15.99:0/1963418130 conn(0x55b9def16660 msgr2=0x55b9def4f4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:08:21.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.546+0000 7f66c2000640 0 client.6315 ms_handle_reset on v2:172.21.15.99:6836/1676159950 2024-02-21T23:08:21.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.547+0000 7f66e6606740 1 -- 172.21.15.99:0/1963418130 shutdown_connections 2024-02-21T23:08:21.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.547+0000 7f66e6606740 1 -- 172.21.15.99:0/1963418130 wait complete. 2024-02-21T23:08:21.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.547+0000 7f66e6606740 20 client.6315 trim_cache size 0 max 16384 2024-02-21T23:08:21.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.574+0000 7f66e6606740 1 Processor -- start 2024-02-21T23:08:21.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.574+0000 7f66e6606740 1 -- start start 2024-02-21T23:08:21.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.576+0000 7f66e6606740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b9def51330 0x55b9def4d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:21.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.576+0000 7f66e6606740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b9def51cf0 0x55b9def20bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:21.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.576+0000 7f66e6606740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b9def5b1a0 0x55b9def210f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:21.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.576+0000 7f66e6606740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66dc22c0b0 con 0x55b9def5b1a0 2024-02-21T23:08:21.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.576+0000 7f66e6606740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66dc22c710 con 0x55b9def51330 2024-02-21T23:08:21.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.576+0000 7f66e6606740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66dc22a2b0 con 0x55b9def51cf0 2024-02-21T23:08:21.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.576+0000 7f66e1800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b9def5b1a0 0x55b9def210f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:21.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.576+0000 7f66e1800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b9def5b1a0 0x55b9def210f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:41760/0 (socket says 172.21.15.99:41760) 2024-02-21T23:08:21.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.576+0000 7f66e1800640 1 -- 172.21.15.99:0/3883646676 learned_addr learned my addr 172.21.15.99:0/3883646676 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:08:21.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.576+0000 7f66e0e00640 1 --2- 172.21.15.99:0/3883646676 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b9def51330 0x55b9def4d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:21.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.576+0000 7f66dbe00640 1 --2- 172.21.15.99:0/3883646676 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b9def51cf0 0x55b9def20bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:21.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.577+0000 7f66e1800640 1 -- 172.21.15.99:0/3883646676 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b9def51cf0 msgr2=0x55b9def20bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:21.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.577+0000 7f66e1800640 1 --2- 172.21.15.99:0/3883646676 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b9def51cf0 0x55b9def20bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.577+0000 7f66e1800640 1 -- 172.21.15.99:0/3883646676 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b9def51330 msgr2=0x55b9def4d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:21.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.577+0000 7f66e1800640 1 --2- 172.21.15.99:0/3883646676 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b9def51330 0x55b9def4d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.577+0000 7f66e1800640 1 -- 172.21.15.99:0/3883646676 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b9dec1d7d0 con 0x55b9def5b1a0 2024-02-21T23:08:21.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.577+0000 7f66dbe00640 1 --2- 172.21.15.99:0/3883646676 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b9def51cf0 0x55b9def20bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:08:21.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.577+0000 7f66e1800640 1 --2- 172.21.15.99:0/3883646676 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b9def5b1a0 0x55b9def210f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f66d4004680 tx=0x7f66d4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8578555928a157e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:21.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.577+0000 7f66ccc00640 1 -- 172.21.15.99:0/3883646676 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d40047a0 con 0x55b9def5b1a0 2024-02-21T23:08:21.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.577+0000 7f66ccc00640 1 -- 172.21.15.99:0/3883646676 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66d40041d0 con 0x55b9def5b1a0 2024-02-21T23:08:21.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.577+0000 7f66ccc00640 1 -- 172.21.15.99:0/3883646676 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d4003bd0 con 0x55b9def5b1a0 2024-02-21T23:08:21.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.578+0000 7f66e6606740 1 -- 172.21.15.99:0/3883646676 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b9def5b1a0 msgr2=0x55b9def210f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:21.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.578+0000 7f66e6606740 1 --2- 172.21.15.99:0/3883646676 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b9def5b1a0 0x55b9def210f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f66d4004680 tx=0x7f66d4019000 comp rx=0 tx=0).stop 2024-02-21T23:08:21.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.578+0000 7f66e6606740 1 -- 172.21.15.99:0/3883646676 shutdown_connections 2024-02-21T23:08:21.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.578+0000 7f66e6606740 1 --2- 172.21.15.99:0/3883646676 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b9def5b1a0 0x55b9def210f0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.578+0000 7f66e6606740 1 --2- 172.21.15.99:0/3883646676 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b9def51cf0 0x55b9def20bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.578+0000 7f66e6606740 1 --2- 172.21.15.99:0/3883646676 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b9def51330 0x55b9def4d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.578+0000 7f66e6606740 1 -- 172.21.15.99:0/3883646676 >> 172.21.15.99:0/3883646676 conn(0x55b9def16660 msgr2=0x55b9def5b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:08:21.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.578+0000 7f66e6606740 1 -- 172.21.15.99:0/3883646676 shutdown_connections 2024-02-21T23:08:21.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.578+0000 7f66e6606740 1 -- 172.21.15.99:0/3883646676 wait complete. 2024-02-21T23:08:21.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.580+0000 7f66e6606740 1 -- start start 2024-02-21T23:08:21.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.580+0000 7f66e6606740 1 Processor -- start 2024-02-21T23:08:21.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.581+0000 7f66e6606740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b9def51330 0x55b9def215c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:21.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.581+0000 7f66e6606740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b9def51cf0 0x55b9def508b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:21.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.581+0000 7f66e6606740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b9def5b1a0 0x55b9def49b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:21.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.581+0000 7f66e6606740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66dc229c90 con 0x55b9def5b1a0 2024-02-21T23:08:21.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.581+0000 7f66e6606740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66dc17bec0 con 0x55b9def51330 2024-02-21T23:08:21.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.581+0000 7f66e6606740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66dc229090 con 0x55b9def51cf0 2024-02-21T23:08:21.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.581+0000 7f66e6606740 10 client.0 _ll_register_callbacks cb 0x7f66d4009e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:08:21.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.582+0000 7f66dbe00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b9def51cf0 0x55b9def508b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:21.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.582+0000 7f66e0e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b9def51330 0x55b9def215c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:21.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.582+0000 7f66dbe00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b9def51cf0 0x55b9def508b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:38464/0 (socket says 172.21.15.99:38464) 2024-02-21T23:08:21.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.582+0000 7f66dbe00640 1 -- 172.21.15.99:0/567509043 learned_addr learned my addr 172.21.15.99:0/567509043 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:08:21.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.582+0000 7f66e1800640 1 --2- 172.21.15.99:0/567509043 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b9def5b1a0 0x55b9def49b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:21.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.582+0000 7f66e0e00640 1 -- 172.21.15.99:0/567509043 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b9def51cf0 msgr2=0x55b9def508b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:21.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.582+0000 7f66e0e00640 1 --2- 172.21.15.99:0/567509043 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b9def51cf0 0x55b9def508b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.582+0000 7f66e0e00640 1 -- 172.21.15.99:0/567509043 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b9def5b1a0 msgr2=0x55b9def49b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:21.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.582+0000 7f66e0e00640 1 --2- 172.21.15.99:0/567509043 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b9def5b1a0 0x55b9def49b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.582+0000 7f66e0e00640 1 -- 172.21.15.99:0/567509043 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b9def05980 con 0x55b9def51330 2024-02-21T23:08:21.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.582+0000 7f66e0e00640 1 --2- 172.21.15.99:0/567509043 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b9def51330 0x55b9def215c0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f66d00b5280 tx=0x7f66d0007000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69fb8b825b1d5a2 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:21.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.582+0000 7f66c2000640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-02-21T23:08:21.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.583+0000 7f66c2000640 1 -- 172.21.15.99:0/567509043 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d00e8060 con 0x55b9def51330 2024-02-21T23:08:21.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.583+0000 7f66e6606740 1 -- 172.21.15.99:0/567509043 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f66d40041d0 con 0x55b9def51330 2024-02-21T23:08:21.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.583+0000 7f66c2000640 1 -- 172.21.15.99:0/567509043 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f66d00e8f40 con 0x55b9def51330 2024-02-21T23:08:21.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.583+0000 7f66c2000640 1 -- 172.21.15.99:0/567509043 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f66d00bcfc0 con 0x55b9def51330 2024-02-21T23:08:21.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.583+0000 7f66e6606740 10 client.6442 fetch_fsmap learned FSMap version 17 2024-02-21T23:08:21.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.583+0000 7f66e6606740 1 -- 172.21.15.99:0/567509043 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55b9def05980 con 0x55b9def51330 2024-02-21T23:08:21.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.583+0000 7f66c2000640 1 -- 172.21.15.99:0/567509043 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66d40041d0 con 0x55b9def51330 2024-02-21T23:08:21.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.583+0000 7f66c2000640 1 -- 172.21.15.99:0/567509043 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f66d004f060 con 0x55b9def51330 2024-02-21T23:08:21.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.583+0000 7f66e6606740 10 client.6442 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:08:21.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.583+0000 7f66e6606740 10 client.6442 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2024-02-21T23:08:21.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.583+0000 7f66e6606740 20 client.6442 populate_metadata read hostname 'smithi099' 2024-02-21T23:08:21.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.583+0000 7f66e6606740 1 --2- 172.21.15.99:0/567509043 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x55b9def4cf60 0x55b9defb7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:21.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.583+0000 7f66e6606740 4 client.6442 mds_command: new command op to 4352 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T23:08:21.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.583+0000 7f66e6606740 1 -- 172.21.15.99:0/567509043 --> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55b9dee463e0 con 0x55b9def4cf60 2024-02-21T23:08:21.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.584+0000 7f66dbe00640 1 --2- 172.21.15.99:0/567509043 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x55b9def4cf60 0x55b9defb7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:21.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.584+0000 7f66dbe00640 1 --2- 172.21.15.99:0/567509043 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x55b9def4cf60 0x55b9defb7ab0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ac6ef4629f23ca09 server_cookie=1e6ccca2782d3fe in_seq=0 out_seq=0 2024-02-21T23:08:21.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.584+0000 7f66c2000640 10 client.6442 ms_handle_connect on v2:172.21.15.99:6836/1676159950 2024-02-21T23:08:21.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.584+0000 7f66c2000640 1 -- 172.21.15.99:0/567509043 <== mds.1 v2:172.21.15.99:6836/1676159950 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55b9dee463e0 con 0x55b9def4cf60 2024-02-21T23:08:21.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.584+0000 7f66c2000640 10 client.6442 handle_command_reply: tid=0 2024-02-21T23:08:21.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.585+0000 7f66e6606740 1 client.6442 shutdown 2024-02-21T23:08:21.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.585+0000 7f66e6606740 1 -- 172.21.15.99:0/567509043 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b9def51330 msgr2=0x55b9def215c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:21.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.585+0000 7f66e6606740 1 --2- 172.21.15.99:0/567509043 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b9def51330 0x55b9def215c0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f66d00b5280 tx=0x7f66d0007000 comp rx=0 tx=0).stop 2024-02-21T23:08:21.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.585+0000 7f66e6606740 1 -- 172.21.15.99:0/567509043 shutdown_connections 2024-02-21T23:08:21.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.585+0000 7f66e6606740 1 --2- 172.21.15.99:0/567509043 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x55b9def4cf60 0x55b9defb7ab0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.585+0000 7f66e6606740 1 --2- 172.21.15.99:0/567509043 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b9def5b1a0 0x55b9def49b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.585+0000 7f66e6606740 1 --2- 172.21.15.99:0/567509043 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b9def51cf0 0x55b9def508b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.585+0000 7f66e6606740 1 --2- 172.21.15.99:0/567509043 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b9def51330 0x55b9def215c0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.585+0000 7f66c2000640 0 client.6442 ms_handle_reset on v2:172.21.15.99:6836/1676159950 2024-02-21T23:08:21.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.585+0000 7f66e6606740 1 -- 172.21.15.99:0/567509043 >> 172.21.15.99:0/567509043 conn(0x55b9def16660 msgr2=0x55b9deed68a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:08:21.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.585+0000 7f66e6606740 1 -- 172.21.15.99:0/567509043 shutdown_connections 2024-02-21T23:08:21.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.585+0000 7f66e6606740 1 -- 172.21.15.99:0/567509043 wait complete. 2024-02-21T23:08:21.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.585+0000 7f66e6606740 20 client.6442 trim_cache size 0 max 16384 2024-02-21T23:08:21.583 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-02-21T23:08:21.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.586+0000 7f66e2200640 1 -- 172.21.15.99:0/3248751367 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f66bc09ef00 msgr2=0x7f66bc0a13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:21.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.586+0000 7f66e2200640 1 --2- 172.21.15.99:0/3248751367 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f66bc09ef00 0x7f66bc0a13c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f66dc0f5520 tx=0x7f66c8009040 comp rx=0 tx=0).stop 2024-02-21T23:08:21.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.586+0000 7f66e2200640 1 -- 172.21.15.99:0/3248751367 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f66dc06daa0 msgr2=0x7f66dc16aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:21.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.586+0000 7f66e2200640 1 --2- 172.21.15.99:0/3248751367 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f66dc06daa0 0x7f66dc16aff0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f66d0000c00 tx=0x7f66d00046c0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.586+0000 7f66e2200640 1 -- 172.21.15.99:0/3248751367 shutdown_connections 2024-02-21T23:08:21.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.586+0000 7f66e2200640 1 --2- 172.21.15.99:0/3248751367 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f66bc09ef00 0x7f66bc0a13c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.586+0000 7f66e2200640 1 --2- 172.21.15.99:0/3248751367 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66dc182cb0 0x7f66dc221ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.586+0000 7f66e2200640 1 --2- 172.21.15.99:0/3248751367 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f66dc06fff0 0x7f66dc0ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.586+0000 7f66e2200640 1 --2- 172.21.15.99:0/3248751367 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f66dc06daa0 0x7f66dc16aff0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.586+0000 7f66e2200640 1 -- 172.21.15.99:0/3248751367 >> 172.21.15.99:0/3248751367 conn(0x7f66dc08cfd0 msgr2=0x7f66dc0f59a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:08:21.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.586+0000 7f66e2200640 1 -- 172.21.15.99:0/3248751367 shutdown_connections 2024-02-21T23:08:21.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.586+0000 7f66e2200640 1 -- 172.21.15.99:0/3248751367 wait complete. 2024-02-21T23:08:21.593 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T23:08:21.594 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-02-21T23:08:21.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.798+0000 7fa2dd200640 1 Processor -- start 2024-02-21T23:08:21.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.798+0000 7fa2dd200640 1 -- start start 2024-02-21T23:08:21.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.800+0000 7fa2dd200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa2d80701c0 0x7fa2d80cbb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:21.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.800+0000 7fa2dd200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2d806ee40 con 0x7fa2d8180c80 2024-02-21T23:08:21.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.800+0000 7fa2dd200640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2d806f120 con 0x7fa2d806e910 2024-02-21T23:08:21.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.800+0000 7fa2dd200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2d806f400 con 0x7fa2d80701c0 2024-02-21T23:08:21.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.801+0000 7fa2d5400640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fa2d806e910 0x7fa2d80cb420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:52678/0 (socket says 172.21.15.99:52678) 2024-02-21T23:08:21.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.801+0000 7fa2d5400640 1 -- 172.21.15.99:0/2986563606 learned_addr learned my addr 172.21.15.99:0/2986563606 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:08:21.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.801+0000 7fa2d5e00640 1 --1- 172.21.15.99:0/2986563606 >> v1:172.21.15.99:6789/0 conn(0x7fa2d8180c80 0x7fa2d8187f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:50570/0 (socket says 172.21.15.99:50570) 2024-02-21T23:08:21.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.801+0000 7fa2d6800640 1 --2- 172.21.15.99:0/2986563606 >> v2:172.21.15.99:3300/0 conn(0x7fa2d80701c0 0x7fa2d80cbb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:21.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.801+0000 7fa2d4a00640 1 -- 172.21.15.99:0/2986563606 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1432655411 0 0) 0x7fa2d806f120 con 0x7fa2d806e910 2024-02-21T23:08:21.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.801+0000 7fa2d4a00640 1 -- 172.21.15.99:0/2986563606 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2bc003520 con 0x7fa2d806e910 2024-02-21T23:08:21.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.801+0000 7fa2d6800640 1 -- 172.21.15.99:0/2986563606 >> v1:172.21.15.181:6789/0 conn(0x7fa2d806e910 legacy=0x7fa2d80cb420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:21.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.801+0000 7fa2d6800640 1 -- 172.21.15.99:0/2986563606 >> v1:172.21.15.99:6789/0 conn(0x7fa2d8180c80 legacy=0x7fa2d8187f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:21.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.801+0000 7fa2d4a00640 1 -- 172.21.15.99:0/2986563606 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1906713731 0 0) 0x7fa2d806ee40 con 0x7fa2d8180c80 2024-02-21T23:08:21.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.801+0000 7fa2d6800640 1 -- 172.21.15.99:0/2986563606 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d806f6e0 con 0x7fa2d80701c0 2024-02-21T23:08:21.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.803+0000 7fa2d6800640 1 --2- 172.21.15.99:0/2986563606 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa2d80701c0 0x7fa2d80cbb30 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fa2d00097a0 tx=0x7fa2d002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=706e298ddf1d689e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:21.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.803+0000 7fa2d4a00640 1 -- 172.21.15.99:0/2986563606 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d0035020 con 0x7fa2d80701c0 2024-02-21T23:08:21.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.803+0000 7fa2d4a00640 1 -- 172.21.15.99:0/2986563606 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2d0031830 con 0x7fa2d80701c0 2024-02-21T23:08:21.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.803+0000 7fa2d4a00640 1 -- 172.21.15.99:0/2986563606 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d0031be0 con 0x7fa2d80701c0 2024-02-21T23:08:21.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.804+0000 7fa2dd200640 1 -- 172.21.15.99:0/2986563606 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa2d80701c0 msgr2=0x7fa2d80cbb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:21.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.804+0000 7fa2dd200640 1 --2- 172.21.15.99:0/2986563606 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa2d80701c0 0x7fa2d80cbb30 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fa2d00097a0 tx=0x7fa2d002b8d0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.804+0000 7fa2dd200640 1 -- 172.21.15.99:0/2986563606 shutdown_connections 2024-02-21T23:08:21.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.804+0000 7fa2dd200640 1 --2- 172.21.15.99:0/2986563606 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa2d80701c0 0x7fa2d80cbb30 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.804+0000 7fa2dd200640 1 -- 172.21.15.99:0/2986563606 >> 172.21.15.99:0/2986563606 conn(0x7fa2d80ce5f0 msgr2=0x7fa2d80cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:08:21.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.804+0000 7fa2dd200640 1 -- 172.21.15.99:0/2986563606 shutdown_connections 2024-02-21T23:08:21.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.804+0000 7fa2dd200640 1 -- 172.21.15.99:0/2986563606 wait complete. 2024-02-21T23:08:21.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.806+0000 7fa2dd200640 1 Processor -- start 2024-02-21T23:08:21.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.806+0000 7fa2dd200640 1 -- start start 2024-02-21T23:08:21.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.808+0000 7fa2dd200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa2d806e910 0x7fa2d816f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:21.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.808+0000 7fa2dd200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa2d80701c0 0x7fa2d80cc780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:21.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.808+0000 7fa2dd200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa2d8180c80 0x7fa2d80cccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:21.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.808+0000 7fa2dd200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d8188610 con 0x7fa2d8180c80 2024-02-21T23:08:21.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.808+0000 7fa2dd200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d806fca0 con 0x7fa2d806e910 2024-02-21T23:08:21.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.808+0000 7fa2dd200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d80f5f50 con 0x7fa2d80701c0 2024-02-21T23:08:21.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.808+0000 7fa2d6800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa2d8180c80 0x7fa2d80cccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:21.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.808+0000 7fa2d5400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa2d80701c0 0x7fa2d80cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:21.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.808+0000 7fa2d5e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa2d806e910 0x7fa2d816f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:21.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.808+0000 7fa2d5400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa2d80701c0 0x7fa2d80cc780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:38472/0 (socket says 172.21.15.99:38472) 2024-02-21T23:08:21.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.808+0000 7fa2d6800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa2d8180c80 0x7fa2d80cccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:41780/0 (socket says 172.21.15.99:41780) 2024-02-21T23:08:21.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.808+0000 7fa2d5400640 1 -- 172.21.15.99:0/3747721857 learned_addr learned my addr 172.21.15.99:0/3747721857 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:08:21.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.808+0000 7fa2d5e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa2d806e910 0x7fa2d816f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:36792/0 (socket says 172.21.15.99:36792) 2024-02-21T23:08:21.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.809+0000 7fa2d6800640 1 -- 172.21.15.99:0/3747721857 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa2d80701c0 msgr2=0x7fa2d80cc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:21.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.809+0000 7fa2d6800640 1 --2- 172.21.15.99:0/3747721857 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa2d80701c0 0x7fa2d80cc780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.809+0000 7fa2d6800640 1 -- 172.21.15.99:0/3747721857 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa2d806e910 msgr2=0x7fa2d816f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:21.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.809+0000 7fa2d6800640 1 --2- 172.21.15.99:0/3747721857 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa2d806e910 0x7fa2d816f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.809+0000 7fa2d6800640 1 -- 172.21.15.99:0/3747721857 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d821db00 con 0x7fa2d8180c80 2024-02-21T23:08:21.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.809+0000 7fa2d5e00640 1 --2- 172.21.15.99:0/3747721857 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa2d806e910 0x7fa2d816f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:08:21.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.809+0000 7fa2d6800640 1 --2- 172.21.15.99:0/3747721857 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa2d8180c80 0x7fa2d80cccc0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fa2d0033000 tx=0x7fa2d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:21.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.809+0000 7fa2ce000640 1 -- 172.21.15.99:0/3747721857 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d0041070 con 0x7fa2d8180c80 2024-02-21T23:08:21.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.809+0000 7fa2ce000640 1 -- 172.21.15.99:0/3747721857 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2d003f070 con 0x7fa2d8180c80 2024-02-21T23:08:21.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.809+0000 7fa2ce000640 1 -- 172.21.15.99:0/3747721857 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d0035040 con 0x7fa2d8180c80 2024-02-21T23:08:21.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.809+0000 7fa2dd200640 1 -- 172.21.15.99:0/3747721857 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2d821dde0 con 0x7fa2d8180c80 2024-02-21T23:08:21.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.810+0000 7fa2dd200640 1 -- 172.21.15.99:0/3747721857 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2d821e3a0 con 0x7fa2d8180c80 2024-02-21T23:08:21.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.814+0000 7fa2ce000640 1 -- 172.21.15.99:0/3747721857 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7fa2d0038020 con 0x7fa2d8180c80 2024-02-21T23:08:21.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.814+0000 7fa2e0186740 1 Processor -- start 2024-02-21T23:08:21.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.815+0000 7fa2e0186740 1 -- start start 2024-02-21T23:08:21.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.815+0000 7fa2ce000640 1 --2- 172.21.15.99:0/3747721857 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa2b809eed0 0x7fa2b80a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:21.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.816+0000 7fa2ce000640 1 -- 172.21.15.99:0/3747721857 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7fa2d00eb720 con 0x7fa2d8180c80 2024-02-21T23:08:21.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.816+0000 7fa2d5400640 1 --2- 172.21.15.99:0/3747721857 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa2b809eed0 0x7fa2b80a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:21.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.817+0000 7fa2d5400640 1 --2- 172.21.15.99:0/3747721857 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa2b809eed0 0x7fa2b80a1390 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa2d821f9f0 tx=0x7fa2c4009040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:21.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.817+0000 7fa2e0186740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556cc5fa74b0 0x556cc5fa7890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:21.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.817+0000 7fa2e0186740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556cc5fe2180 0x556cc5fe2600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:21.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.817+0000 7fa2e0186740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556cc5fe2b40 0x556cc5fe33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:21.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.817+0000 7fa2e0186740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cc5ecfb50 con 0x556cc5fa74b0 2024-02-21T23:08:21.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.817+0000 7fa2e0186740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cc5e78da0 con 0x556cc5fe2b40 2024-02-21T23:08:21.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.817+0000 7fa2e0186740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cc5ecbbf0 con 0x556cc5fe2180 2024-02-21T23:08:21.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.817+0000 7fa2d5e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556cc5fa74b0 0x556cc5fa7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:21.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.817+0000 7fa2d5e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556cc5fa74b0 0x556cc5fa7890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:41782/0 (socket says 172.21.15.99:41782) 2024-02-21T23:08:21.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.817+0000 7fa2d5e00640 1 -- 172.21.15.99:0/2033677352 learned_addr learned my addr 172.21.15.99:0/2033677352 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:08:21.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.817+0000 7fa2d5400640 1 --2- 172.21.15.99:0/2033677352 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556cc5fe2180 0x556cc5fe2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:21.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.817+0000 7fa2d6800640 1 --2- 172.21.15.99:0/2033677352 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556cc5fe2b40 0x556cc5fe33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:21.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.817+0000 7fa2d6800640 1 -- 172.21.15.99:0/2033677352 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556cc5fe2180 msgr2=0x556cc5fe2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:21.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.817+0000 7fa2d6800640 1 --2- 172.21.15.99:0/2033677352 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556cc5fe2180 0x556cc5fe2600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.817+0000 7fa2d6800640 1 -- 172.21.15.99:0/2033677352 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556cc5fa74b0 msgr2=0x556cc5fa7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:21.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.817+0000 7fa2d6800640 1 --2- 172.21.15.99:0/2033677352 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556cc5fa74b0 0x556cc5fa7890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.818+0000 7fa2d6800640 1 -- 172.21.15.99:0/2033677352 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556cc5e9bf80 con 0x556cc5fe2b40 2024-02-21T23:08:21.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.818+0000 7fa2d5e00640 1 --2- 172.21.15.99:0/2033677352 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556cc5fa74b0 0x556cc5fa7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:08:21.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.818+0000 7fa2d6800640 1 --2- 172.21.15.99:0/2033677352 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556cc5fe2b40 0x556cc5fe33b0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fa2d00e8de0 tx=0x7fa2d0009190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1ff86de35e46089 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:21.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.818+0000 7fa2c2a00640 1 -- 172.21.15.99:0/2033677352 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d00d5070 con 0x556cc5fe2b40 2024-02-21T23:08:21.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.818+0000 7fa2c2a00640 1 -- 172.21.15.99:0/2033677352 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2d00c1760 con 0x556cc5fe2b40 2024-02-21T23:08:21.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.818+0000 7fa2c2a00640 1 -- 172.21.15.99:0/2033677352 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d004b070 con 0x556cc5fe2b40 2024-02-21T23:08:21.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.819+0000 7fa2e0186740 1 -- 172.21.15.99:0/2033677352 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556cc5fe2b40 msgr2=0x556cc5fe33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:21.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.819+0000 7fa2e0186740 1 --2- 172.21.15.99:0/2033677352 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556cc5fe2b40 0x556cc5fe33b0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fa2d00e8de0 tx=0x7fa2d0009190 comp rx=0 tx=0).stop 2024-02-21T23:08:21.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.819+0000 7fa2e0186740 1 -- 172.21.15.99:0/2033677352 shutdown_connections 2024-02-21T23:08:21.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.819+0000 7fa2e0186740 1 --2- 172.21.15.99:0/2033677352 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556cc5fe2b40 0x556cc5fe33b0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.819+0000 7fa2e0186740 1 --2- 172.21.15.99:0/2033677352 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556cc5fe2180 0x556cc5fe2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.819+0000 7fa2e0186740 1 --2- 172.21.15.99:0/2033677352 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556cc5fa74b0 0x556cc5fa7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.819+0000 7fa2e0186740 1 -- 172.21.15.99:0/2033677352 >> 172.21.15.99:0/2033677352 conn(0x556cc5f69520 msgr2=0x556cc5f6a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:08:21.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.819+0000 7fa2e0186740 1 -- 172.21.15.99:0/2033677352 shutdown_connections 2024-02-21T23:08:21.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.819+0000 7fa2e0186740 1 -- 172.21.15.99:0/2033677352 wait complete. 2024-02-21T23:08:21.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.821+0000 7fa2e0186740 1 -- start start 2024-02-21T23:08:21.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.821+0000 7fa2e0186740 1 Processor -- start 2024-02-21T23:08:21.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.823+0000 7fa2e0186740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556cc5fe2180 0x556cc5f9d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:21.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.823+0000 7fa2e0186740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556cc5fe2b40 0x556cc5faeae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:21.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.823+0000 7fa2e0186740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556cc5fdd840 0x556cc5fef0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:21.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.823+0000 7fa2e0186740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cc5e78da0 con 0x556cc5fe2180 2024-02-21T23:08:21.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.823+0000 7fa2e0186740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cc5e6e380 con 0x556cc5fdd840 2024-02-21T23:08:21.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.823+0000 7fa2e0186740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cc5fe0ef0 con 0x556cc5fe2b40 2024-02-21T23:08:21.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.823+0000 7fa2e0186740 10 client.0 _ll_register_callbacks cb 0x556cc5ec7280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:08:21.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.823+0000 7fa2d5e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556cc5fe2180 0x556cc5f9d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:21.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.824+0000 7fa2d5e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556cc5fe2180 0x556cc5f9d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:41794/0 (socket says 172.21.15.99:41794) 2024-02-21T23:08:21.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.824+0000 7fa2d5e00640 1 -- 172.21.15.99:0/3289700211 learned_addr learned my addr 172.21.15.99:0/3289700211 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:08:21.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.824+0000 7fa2d5400640 1 --2- 172.21.15.99:0/3289700211 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556cc5fe2b40 0x556cc5faeae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:21.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.824+0000 7fa2d6800640 1 --2- 172.21.15.99:0/3289700211 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556cc5fdd840 0x556cc5fef0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:21.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.824+0000 7fa2d5e00640 1 -- 172.21.15.99:0/3289700211 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556cc5fe2b40 msgr2=0x556cc5faeae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:21.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.824+0000 7fa2d5e00640 1 --2- 172.21.15.99:0/3289700211 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556cc5fe2b40 0x556cc5faeae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.824+0000 7fa2d5e00640 1 -- 172.21.15.99:0/3289700211 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556cc5fdd840 msgr2=0x556cc5fef0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:21.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.824+0000 7fa2d5e00640 1 --2- 172.21.15.99:0/3289700211 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556cc5fdd840 0x556cc5fef0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.824+0000 7fa2d5e00640 1 -- 172.21.15.99:0/3289700211 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556cc5e96c20 con 0x556cc5fe2180 2024-02-21T23:08:21.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.824+0000 7fa2d5e00640 1 --2- 172.21.15.99:0/3289700211 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556cc5fe2180 0x556cc5f9d300 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fa2c80077e0 tx=0x7fa2c8001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f27b01cb097ceef server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:21.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.824+0000 7fa2b7400640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:08:21.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.825+0000 7fa2b7400640 1 -- 172.21.15.99:0/3289700211 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c8012820 con 0x556cc5fe2180 2024-02-21T23:08:21.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.825+0000 7fa2b7400640 1 -- 172.21.15.99:0/3289700211 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7fa2c80129c0 con 0x556cc5fe2180 2024-02-21T23:08:21.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.825+0000 7fa2e0186740 1 -- 172.21.15.99:0/3289700211 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa2d00c1760 con 0x556cc5fe2180 2024-02-21T23:08:21.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.825+0000 7fa2b7400640 1 -- 172.21.15.99:0/3289700211 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa2c8023050 con 0x556cc5fe2180 2024-02-21T23:08:21.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.825+0000 7fa2e0186740 10 client.6336 fetch_fsmap learned FSMap version 17 2024-02-21T23:08:21.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.825+0000 7fa2e0186740 1 -- 172.21.15.99:0/3289700211 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x556cc5be43f0 con 0x556cc5fe2180 2024-02-21T23:08:21.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.825+0000 7fa2b7400640 1 -- 172.21.15.99:0/3289700211 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2d00c1760 con 0x556cc5fe2180 2024-02-21T23:08:21.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.825+0000 7fa2b7400640 1 -- 172.21.15.99:0/3289700211 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fa2c8012bc0 con 0x556cc5fe2180 2024-02-21T23:08:21.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.826+0000 7fa2e0186740 10 client.6336 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:08:21.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.826+0000 7fa2e0186740 10 client.6336 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:08:21.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.826+0000 7fa2e0186740 20 client.6336 populate_metadata read hostname 'smithi099' 2024-02-21T23:08:21.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.826+0000 7fa2e0186740 1 --2- 172.21.15.99:0/3289700211 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x556cc5fddcc0 0x556cc5faf210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:21.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.826+0000 7fa2e0186740 4 client.6336 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:08:21.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.826+0000 7fa2e0186740 1 -- 172.21.15.99:0/3289700211 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556cc5edd090 con 0x556cc5fddcc0 2024-02-21T23:08:21.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.826+0000 7fa2d5400640 1 --2- 172.21.15.99:0/3289700211 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x556cc5fddcc0 0x556cc5faf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:21.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.827+0000 7fa2d5400640 1 --2- 172.21.15.99:0/3289700211 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x556cc5fddcc0 0x556cc5faf210 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1884d7d410d83a15 server_cookie=850f7477df132512 in_seq=0 out_seq=0 2024-02-21T23:08:21.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.827+0000 7fa2b7400640 10 client.6336 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:08:21.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.827+0000 7fa2b7400640 1 -- 172.21.15.99:0/3289700211 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x556cc5edd090 con 0x556cc5fddcc0 2024-02-21T23:08:21.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.827+0000 7fa2b7400640 10 client.6336 handle_command_reply: tid=0 2024-02-21T23:08:21.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.827+0000 7fa2e0186740 1 client.6336 shutdown 2024-02-21T23:08:21.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.828+0000 7fa2e0186740 1 -- 172.21.15.99:0/3289700211 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556cc5fe2180 msgr2=0x556cc5f9d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:21.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.828+0000 7fa2e0186740 1 --2- 172.21.15.99:0/3289700211 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556cc5fe2180 0x556cc5f9d300 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fa2c80077e0 tx=0x7fa2c8001a00 comp rx=0 tx=0).stop 2024-02-21T23:08:21.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.828+0000 7fa2e0186740 1 -- 172.21.15.99:0/3289700211 shutdown_connections 2024-02-21T23:08:21.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.828+0000 7fa2e0186740 1 --2- 172.21.15.99:0/3289700211 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x556cc5fddcc0 0x556cc5faf210 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.828+0000 7fa2e0186740 1 --2- 172.21.15.99:0/3289700211 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556cc5fdd840 0x556cc5fef0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.828+0000 7fa2e0186740 1 --2- 172.21.15.99:0/3289700211 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556cc5fe2b40 0x556cc5faeae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.828+0000 7fa2e0186740 1 --2- 172.21.15.99:0/3289700211 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556cc5fe2180 0x556cc5f9d300 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.828+0000 7fa2e0186740 1 -- 172.21.15.99:0/3289700211 >> 172.21.15.99:0/3289700211 conn(0x556cc5fa74b0 msgr2=0x556cc5f70630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:08:21.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.828+0000 7fa2b7400640 0 client.6336 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:08:21.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.828+0000 7fa2e0186740 1 -- 172.21.15.99:0/3289700211 shutdown_connections 2024-02-21T23:08:21.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.828+0000 7fa2e0186740 1 -- 172.21.15.99:0/3289700211 wait complete. 2024-02-21T23:08:21.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.828+0000 7fa2e0186740 20 client.6336 trim_cache size 0 max 16384 2024-02-21T23:08:21.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.842+0000 7fa2e0186740 1 Processor -- start 2024-02-21T23:08:21.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.843+0000 7fa2e0186740 1 -- start start 2024-02-21T23:08:21.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.844+0000 7fa2e0186740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556cc5fdd840 0x556cc5faab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:21.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.844+0000 7fa2e0186740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556cc5fe2180 0x556cc5f615d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:21.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.845+0000 7fa2e0186740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556cc5fe2b40 0x556cc5f67ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:21.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.845+0000 7fa2e0186740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d822c6d0 con 0x556cc5fdd840 2024-02-21T23:08:21.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.845+0000 7fa2e0186740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d822a270 con 0x556cc5fe2180 2024-02-21T23:08:21.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.845+0000 7fa2e0186740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d8228420 con 0x556cc5fe2b40 2024-02-21T23:08:21.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.845+0000 7fa2d5e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556cc5fdd840 0x556cc5faab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:21.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.845+0000 7fa2d5e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556cc5fdd840 0x556cc5faab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:41804/0 (socket says 172.21.15.99:41804) 2024-02-21T23:08:21.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.845+0000 7fa2d5e00640 1 -- 172.21.15.99:0/1268964903 learned_addr learned my addr 172.21.15.99:0/1268964903 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:08:21.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.845+0000 7fa2d5400640 1 --2- 172.21.15.99:0/1268964903 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556cc5fe2180 0x556cc5f615d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:21.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.845+0000 7fa2d6800640 1 --2- 172.21.15.99:0/1268964903 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556cc5fe2b40 0x556cc5f67ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:21.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.845+0000 7fa2d5e00640 1 -- 172.21.15.99:0/1268964903 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556cc5fe2b40 msgr2=0x556cc5f67ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:21.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.845+0000 7fa2d5e00640 1 --2- 172.21.15.99:0/1268964903 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556cc5fe2b40 0x556cc5f67ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.845+0000 7fa2d5e00640 1 -- 172.21.15.99:0/1268964903 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556cc5fe2180 msgr2=0x556cc5f615d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:21.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.845+0000 7fa2d5e00640 1 --2- 172.21.15.99:0/1268964903 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556cc5fe2180 0x556cc5f615d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.845+0000 7fa2d5e00640 1 -- 172.21.15.99:0/1268964903 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556cc5cae7d0 con 0x556cc5fdd840 2024-02-21T23:08:21.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.846+0000 7fa2d5e00640 1 --2- 172.21.15.99:0/1268964903 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556cc5fdd840 0x556cc5faab70 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fa2c8007a90 tx=0x7fa2c800c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32f9c6f08d014a9b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:21.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.846+0000 7fa2c2000640 1 -- 172.21.15.99:0/1268964903 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c8012a20 con 0x556cc5fdd840 2024-02-21T23:08:21.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.846+0000 7fa2c2000640 1 -- 172.21.15.99:0/1268964903 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2c800b040 con 0x556cc5fdd840 2024-02-21T23:08:21.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.846+0000 7fa2c2000640 1 -- 172.21.15.99:0/1268964903 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c8015680 con 0x556cc5fdd840 2024-02-21T23:08:21.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.847+0000 7fa2e0186740 1 -- 172.21.15.99:0/1268964903 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556cc5fdd840 msgr2=0x556cc5faab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:21.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.847+0000 7fa2e0186740 1 --2- 172.21.15.99:0/1268964903 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556cc5fdd840 0x556cc5faab70 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fa2c8007a90 tx=0x7fa2c800c000 comp rx=0 tx=0).stop 2024-02-21T23:08:21.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.847+0000 7fa2e0186740 1 -- 172.21.15.99:0/1268964903 shutdown_connections 2024-02-21T23:08:21.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.847+0000 7fa2e0186740 1 --2- 172.21.15.99:0/1268964903 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556cc5fe2b40 0x556cc5f67ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.847+0000 7fa2e0186740 1 --2- 172.21.15.99:0/1268964903 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556cc5fe2180 0x556cc5f615d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.847+0000 7fa2e0186740 1 --2- 172.21.15.99:0/1268964903 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556cc5fdd840 0x556cc5faab70 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.847+0000 7fa2e0186740 1 -- 172.21.15.99:0/1268964903 >> 172.21.15.99:0/1268964903 conn(0x556cc5fa74b0 msgr2=0x556cc5faf140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:08:21.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.847+0000 7fa2e0186740 1 -- 172.21.15.99:0/1268964903 shutdown_connections 2024-02-21T23:08:21.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.847+0000 7fa2e0186740 1 -- 172.21.15.99:0/1268964903 wait complete. 2024-02-21T23:08:21.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.848+0000 7fa2e0186740 1 -- start start 2024-02-21T23:08:21.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.848+0000 7fa2e0186740 1 Processor -- start 2024-02-21T23:08:21.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.850+0000 7fa2e0186740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556cc5fdd840 0x556cc5f96b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:21.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.850+0000 7fa2e0186740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556cc5fe2180 0x556cc5fdf330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:21.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.850+0000 7fa2e0186740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556cc5fe2b40 0x556cc5fa9c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:21.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.850+0000 7fa2e0186740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d82289f0 con 0x556cc5fdd840 2024-02-21T23:08:21.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.850+0000 7fa2e0186740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d8229c10 con 0x556cc5fe2180 2024-02-21T23:08:21.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.850+0000 7fa2e0186740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d8228ff0 con 0x556cc5fe2b40 2024-02-21T23:08:21.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.850+0000 7fa2e0186740 10 client.0 _ll_register_callbacks cb 0x7fa2c8007080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:08:21.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.850+0000 7fa2d5e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556cc5fdd840 0x556cc5f96b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:21.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.850+0000 7fa2d5e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556cc5fdd840 0x556cc5f96b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:41816/0 (socket says 172.21.15.99:41816) 2024-02-21T23:08:21.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.850+0000 7fa2d5e00640 1 -- 172.21.15.99:0/3880566475 learned_addr learned my addr 172.21.15.99:0/3880566475 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:08:21.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.851+0000 7fa2d6800640 1 --2- 172.21.15.99:0/3880566475 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556cc5fe2b40 0x556cc5fa9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:21.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.851+0000 7fa2d5400640 1 --2- 172.21.15.99:0/3880566475 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556cc5fe2180 0x556cc5fdf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:21.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.851+0000 7fa2d5e00640 1 -- 172.21.15.99:0/3880566475 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556cc5fe2b40 msgr2=0x556cc5fa9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:21.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.851+0000 7fa2d5e00640 1 --2- 172.21.15.99:0/3880566475 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556cc5fe2b40 0x556cc5fa9c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.851+0000 7fa2d5e00640 1 -- 172.21.15.99:0/3880566475 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556cc5fe2180 msgr2=0x556cc5fdf330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:21.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.851+0000 7fa2d5e00640 1 --2- 172.21.15.99:0/3880566475 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556cc5fe2180 0x556cc5fdf330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.851+0000 7fa2d5e00640 1 -- 172.21.15.99:0/3880566475 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556cc5faa1c0 con 0x556cc5fdd840 2024-02-21T23:08:21.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.851+0000 7fa2d5400640 1 --2- 172.21.15.99:0/3880566475 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556cc5fe2180 0x556cc5fdf330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:08:21.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.851+0000 7fa2d6800640 1 --2- 172.21.15.99:0/3880566475 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556cc5fe2b40 0x556cc5fa9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:08:21.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.851+0000 7fa2d5e00640 1 --2- 172.21.15.99:0/3880566475 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556cc5fdd840 0x556cc5f96b70 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fa2c8017040 tx=0x7fa2c8000fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=255f720624f0b15e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:21.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.852+0000 7fa2b7400640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:08:21.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.852+0000 7fa2b7400640 1 -- 172.21.15.99:0/3880566475 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c8007b20 con 0x556cc5fdd840 2024-02-21T23:08:21.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.852+0000 7fa2e0186740 1 -- 172.21.15.99:0/3880566475 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa2c800b040 con 0x556cc5fdd840 2024-02-21T23:08:21.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.852+0000 7fa2b7400640 1 -- 172.21.15.99:0/3880566475 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7fa2c802d040 con 0x556cc5fdd840 2024-02-21T23:08:21.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.852+0000 7fa2b7400640 1 -- 172.21.15.99:0/3880566475 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa2c8007b20 con 0x556cc5fdd840 2024-02-21T23:08:21.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.852+0000 7fa2e0186740 10 client.6342 fetch_fsmap learned FSMap version 17 2024-02-21T23:08:21.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.853+0000 7fa2e0186740 1 -- 172.21.15.99:0/3880566475 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x556cc5ffb700 con 0x556cc5fdd840 2024-02-21T23:08:21.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.853+0000 7fa2b7400640 1 -- 172.21.15.99:0/3880566475 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2c800b040 con 0x556cc5fdd840 2024-02-21T23:08:21.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.853+0000 7fa2b7400640 1 -- 172.21.15.99:0/3880566475 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fa2c8007540 con 0x556cc5fdd840 2024-02-21T23:08:21.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.853+0000 7fa2e0186740 10 client.6342 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:08:21.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.853+0000 7fa2e0186740 10 client.6342 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:08:21.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.853+0000 7fa2e0186740 20 client.6342 populate_metadata read hostname 'smithi099' 2024-02-21T23:08:21.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.853+0000 7fa2e0186740 1 --2- 172.21.15.99:0/3880566475 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x556cc5f701c0 0x556cc5fd7440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:21.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.853+0000 7fa2e0186740 4 client.6342 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T23:08:21.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.853+0000 7fa2e0186740 1 -- 172.21.15.99:0/3880566475 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x556cc5f69c80 con 0x556cc5f701c0 2024-02-21T23:08:21.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.854+0000 7fa2d5400640 1 --2- 172.21.15.99:0/3880566475 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x556cc5f701c0 0x556cc5fd7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:21.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.854+0000 7fa2d5400640 1 --2- 172.21.15.99:0/3880566475 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x556cc5f701c0 0x556cc5fd7440 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=713080d809f582c9 server_cookie=b4d3e76134aa8d5c in_seq=0 out_seq=0 2024-02-21T23:08:21.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.854+0000 7fa2b7400640 10 client.6342 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:08:21.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.854+0000 7fa2b7400640 1 -- 172.21.15.99:0/3880566475 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x556cc5f69c80 con 0x556cc5f701c0 2024-02-21T23:08:21.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.854+0000 7fa2b7400640 10 client.6342 handle_command_reply: tid=0 2024-02-21T23:08:21.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.854+0000 7fa2e0186740 1 client.6342 shutdown 2024-02-21T23:08:21.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.855+0000 7fa2e0186740 1 -- 172.21.15.99:0/3880566475 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556cc5fdd840 msgr2=0x556cc5f96b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:21.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.855+0000 7fa2e0186740 1 --2- 172.21.15.99:0/3880566475 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556cc5fdd840 0x556cc5f96b70 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fa2c8017040 tx=0x7fa2c8000fb0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.855+0000 7fa2e0186740 1 -- 172.21.15.99:0/3880566475 shutdown_connections 2024-02-21T23:08:21.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.855+0000 7fa2e0186740 1 --2- 172.21.15.99:0/3880566475 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x556cc5f701c0 0x556cc5fd7440 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.855+0000 7fa2e0186740 1 --2- 172.21.15.99:0/3880566475 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556cc5fe2b40 0x556cc5fa9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.855+0000 7fa2e0186740 1 --2- 172.21.15.99:0/3880566475 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556cc5fe2180 0x556cc5fdf330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.855+0000 7fa2e0186740 1 --2- 172.21.15.99:0/3880566475 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556cc5fdd840 0x556cc5f96b70 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.855+0000 7fa2b7400640 0 client.6342 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:08:21.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.855+0000 7fa2e0186740 1 -- 172.21.15.99:0/3880566475 >> 172.21.15.99:0/3880566475 conn(0x556cc5fa74b0 msgr2=0x556cc5ff3af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:08:21.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.855+0000 7fa2e0186740 1 -- 172.21.15.99:0/3880566475 shutdown_connections 2024-02-21T23:08:21.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.855+0000 7fa2e0186740 1 -- 172.21.15.99:0/3880566475 wait complete. 2024-02-21T23:08:21.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.855+0000 7fa2e0186740 20 client.6342 trim_cache size 0 max 16384 2024-02-21T23:08:21.854 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-02-21T23:08:21.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.856+0000 7fa2dd200640 1 -- 172.21.15.99:0/3747721857 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa2b809eed0 msgr2=0x7fa2b80a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:21.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.856+0000 7fa2dd200640 1 --2- 172.21.15.99:0/3747721857 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa2b809eed0 0x7fa2b80a1390 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa2d821f9f0 tx=0x7fa2c4009040 comp rx=0 tx=0).stop 2024-02-21T23:08:21.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.856+0000 7fa2dd200640 1 -- 172.21.15.99:0/3747721857 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa2d8180c80 msgr2=0x7fa2d80cccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:21.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.856+0000 7fa2dd200640 1 --2- 172.21.15.99:0/3747721857 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa2d8180c80 0x7fa2d80cccc0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fa2d0033000 tx=0x7fa2d00046c0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.856+0000 7fa2dd200640 1 -- 172.21.15.99:0/3747721857 shutdown_connections 2024-02-21T23:08:21.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.856+0000 7fa2dd200640 1 --2- 172.21.15.99:0/3747721857 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa2b809eed0 0x7fa2b80a1390 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.856+0000 7fa2dd200640 1 --2- 172.21.15.99:0/3747721857 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa2d8180c80 0x7fa2d80cccc0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.856+0000 7fa2dd200640 1 --2- 172.21.15.99:0/3747721857 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa2d80701c0 0x7fa2d80cc780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.856+0000 7fa2dd200640 1 --2- 172.21.15.99:0/3747721857 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa2d806e910 0x7fa2d816f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:21.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.856+0000 7fa2dd200640 1 -- 172.21.15.99:0/3747721857 >> 172.21.15.99:0/3747721857 conn(0x7fa2d80ce5f0 msgr2=0x7fa2d80f4c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:08:21.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.856+0000 7fa2dd200640 1 -- 172.21.15.99:0/3747721857 shutdown_connections 2024-02-21T23:08:21.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:21.856+0000 7fa2dd200640 1 -- 172.21.15.99:0/3747721857 wait complete. 2024-02-21T23:08:22.863 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-02-21T23:08:22.864 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T23:08:22.864 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-02-21T23:08:23.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.085+0000 7f7944a00640 1 Processor -- start 2024-02-21T23:08:23.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.085+0000 7f7944a00640 1 -- start start 2024-02-21T23:08:23.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.087+0000 7f7944a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f794017f710 0x7f7940189f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:23.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.087+0000 7f7944a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f794018b920 0x7f794015e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:23.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.087+0000 7f7944a00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f794018a5a0 con 0x7f7940071c20 2024-02-21T23:08:23.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.087+0000 7f7944a00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f794018bda0 con 0x7f794018b920 2024-02-21T23:08:23.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.087+0000 7f7944a00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f794018a880 con 0x7f794017f710 2024-02-21T23:08:23.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.087+0000 7f793ea00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f794018b920 0x7f794015e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:23.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.087+0000 7f793f400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f794017f710 0x7f7940189f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:23.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.087+0000 7f793ea00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f794018b920 0x7f794015e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:41824/0 (socket says 172.21.15.99:41824) 2024-02-21T23:08:23.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.087+0000 7f793ea00640 1 -- 172.21.15.99:0/532723563 learned_addr learned my addr 172.21.15.99:0/532723563 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:08:23.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.088+0000 7f793ea00640 1 -- 172.21.15.99:0/532723563 >> v2:172.21.15.162:3300/0 conn(0x7f794017f710 msgr2=0x7f7940189f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:23.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.088+0000 7f793ea00640 1 --2- 172.21.15.99:0/532723563 >> v2:172.21.15.162:3300/0 conn(0x7f794017f710 0x7f7940189f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:23.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.088+0000 7f793ea00640 1 -- 172.21.15.99:0/532723563 >> v1:172.21.15.181:6789/0 conn(0x7f7940071c20 legacy=0x7f7940188a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:23.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.088+0000 7f793ea00640 1 -- 172.21.15.99:0/532723563 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f794018ab60 con 0x7f794018b920 2024-02-21T23:08:23.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.088+0000 7f793e000640 1 -- 172.21.15.99:0/532723563 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2127572950 0 0) 0x7f794018a5a0 con 0x7f7940071c20 2024-02-21T23:08:23.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.088+0000 7f793f400640 1 --2- 172.21.15.99:0/532723563 >> v2:172.21.15.162:3300/0 conn(0x7f794017f710 0x7f7940189f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:08:23.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.090+0000 7f793ea00640 1 --2- 172.21.15.99:0/532723563 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f794018b920 0x7f794015e490 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f79400fbe00 tx=0x7f792c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0162bc4fed1dbe1 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:23.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.090+0000 7f793e000640 1 -- 172.21.15.99:0/532723563 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f792c034070 con 0x7f794018b920 2024-02-21T23:08:23.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.090+0000 7f793e000640 1 -- 172.21.15.99:0/532723563 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f792c030860 con 0x7f794018b920 2024-02-21T23:08:23.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.090+0000 7f793e000640 1 -- 172.21.15.99:0/532723563 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f792c030c30 con 0x7f794018b920 2024-02-21T23:08:23.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.091+0000 7f7944a00640 1 -- 172.21.15.99:0/532723563 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f794018b920 msgr2=0x7f794015e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:23.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.091+0000 7f7944a00640 1 --2- 172.21.15.99:0/532723563 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f794018b920 0x7f794015e490 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f79400fbe00 tx=0x7f792c02b9a0 comp rx=0 tx=0).stop 2024-02-21T23:08:23.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.091+0000 7f7944a00640 1 -- 172.21.15.99:0/532723563 shutdown_connections 2024-02-21T23:08:23.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.091+0000 7f7944a00640 1 --2- 172.21.15.99:0/532723563 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f794018b920 0x7f794015e490 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:23.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.091+0000 7f7944a00640 1 --2- 172.21.15.99:0/532723563 >> v2:172.21.15.162:3300/0 conn(0x7f794017f710 0x7f7940189f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:23.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.091+0000 7f7944a00640 1 -- 172.21.15.99:0/532723563 >> 172.21.15.99:0/532723563 conn(0x7f79400fe310 msgr2=0x7f79400fe720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:08:23.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.091+0000 7f7944a00640 1 -- 172.21.15.99:0/532723563 shutdown_connections 2024-02-21T23:08:23.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.091+0000 7f7944a00640 1 -- 172.21.15.99:0/532723563 wait complete. 2024-02-21T23:08:23.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.094+0000 7f7944a00640 1 Processor -- start 2024-02-21T23:08:23.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.094+0000 7f7944a00640 1 -- start start 2024-02-21T23:08:23.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.095+0000 7f7944a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7940071c20 0x7f794015a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:23.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.095+0000 7f7944a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f794017f710 0x7f79400f1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:23.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.095+0000 7f7944a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f794018b920 0x7f79400f2380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:23.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.095+0000 7f7944a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f794015e9d0 con 0x7f794018b920 2024-02-21T23:08:23.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.095+0000 7f7944a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f794018b120 con 0x7f7940071c20 2024-02-21T23:08:23.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.095+0000 7f7944a00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f794015eb50 con 0x7f794017f710 2024-02-21T23:08:23.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.096+0000 7f793fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f794018b920 0x7f79400f2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:23.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.096+0000 7f793f400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7940071c20 0x7f794015a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:23.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.096+0000 7f793ea00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f794017f710 0x7f79400f1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:23.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.096+0000 7f793f400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7940071c20 0x7f794015a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:36850/0 (socket says 172.21.15.99:36850) 2024-02-21T23:08:23.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.096+0000 7f793f400640 1 -- 172.21.15.99:0/1366240514 learned_addr learned my addr 172.21.15.99:0/1366240514 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:08:23.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.096+0000 7f793fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f794018b920 0x7f79400f2380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:41834/0 (socket says 172.21.15.99:41834) 2024-02-21T23:08:23.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.096+0000 7f793f400640 1 -- 172.21.15.99:0/1366240514 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f794017f710 msgr2=0x7f79400f1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:23.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.096+0000 7f793f400640 1 --2- 172.21.15.99:0/1366240514 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f794017f710 0x7f79400f1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:23.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.096+0000 7f793f400640 1 -- 172.21.15.99:0/1366240514 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f794018b920 msgr2=0x7f79400f2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:23.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.096+0000 7f793f400640 1 --2- 172.21.15.99:0/1366240514 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f794018b920 0x7f79400f2380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:23.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.096+0000 7f793f400640 1 -- 172.21.15.99:0/1366240514 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79400f2a60 con 0x7f7940071c20 2024-02-21T23:08:23.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.096+0000 7f793ea00640 1 --2- 172.21.15.99:0/1366240514 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f794017f710 0x7f79400f1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:08:23.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.097+0000 7f793f400640 1 --2- 172.21.15.99:0/1366240514 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7940071c20 0x7f794015a680 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f793000e960 tx=0x7f793000ee20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:23.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.097+0000 7f7937400640 1 -- 172.21.15.99:0/1366240514 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7930017070 con 0x7f7940071c20 2024-02-21T23:08:23.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.097+0000 7f7937400640 1 -- 172.21.15.99:0/1366240514 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f793000c9a0 con 0x7f7940071c20 2024-02-21T23:08:23.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.097+0000 7f7944a00640 1 -- 172.21.15.99:0/1366240514 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79400f2d40 con 0x7f7940071c20 2024-02-21T23:08:23.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.097+0000 7f7937400640 1 -- 172.21.15.99:0/1366240514 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f793000cd70 con 0x7f7940071c20 2024-02-21T23:08:23.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.097+0000 7f7944a00640 1 -- 172.21.15.99:0/1366240514 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79400f3300 con 0x7f7940071c20 2024-02-21T23:08:23.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.101+0000 7f7937400640 1 -- 172.21.15.99:0/1366240514 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f793001a070 con 0x7f7940071c20 2024-02-21T23:08:23.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.102+0000 7f7948fd0740 1 Processor -- start 2024-02-21T23:08:23.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.102+0000 7f7948fd0740 1 -- start start 2024-02-21T23:08:23.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.103+0000 7f7937400640 1 --2- 172.21.15.99:0/1366240514 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f792009ee50 0x7f79200a1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:23.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.103+0000 7f7937400640 1 -- 172.21.15.99:0/1366240514 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f79300c9fe0 con 0x7f7940071c20 2024-02-21T23:08:23.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.103+0000 7f793fe00640 1 --2- 172.21.15.99:0/1366240514 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f792009ee50 0x7f79200a1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:23.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.104+0000 7f7948fd0740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c63bec24c0 0x55c63bec28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:23.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.104+0000 7f7948fd0740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c63bec2de0 0x55c63befd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:23.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.104+0000 7f7948fd0740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c63befdb90 0x55c63befe920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:23.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.104+0000 7f7948fd0740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c63bdea790 con 0x55c63bec24c0 2024-02-21T23:08:23.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.104+0000 7f7948fd0740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c63bd93bf0 con 0x55c63bec2de0 2024-02-21T23:08:23.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.104+0000 7f7948fd0740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c63bde6830 con 0x55c63befdb90 2024-02-21T23:08:23.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.104+0000 7f793fe00640 1 --2- 172.21.15.99:0/1366240514 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f792009ee50 0x7f79200a1310 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f79380012e0 tx=0x7f7938009040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:23.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.104+0000 7f793f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c63bec24c0 0x55c63bec28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:23.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.104+0000 7f793ea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c63bec2de0 0x55c63befd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:23.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.104+0000 7f793f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c63bec24c0 0x55c63bec28a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:41838/0 (socket says 172.21.15.99:41838) 2024-02-21T23:08:23.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.104+0000 7f793f400640 1 -- 172.21.15.99:0/2760854783 learned_addr learned my addr 172.21.15.99:0/2760854783 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:08:23.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.105+0000 7f793fe00640 1 --2- 172.21.15.99:0/2760854783 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c63befdb90 0x55c63befe920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:23.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.105+0000 7f793ea00640 1 -- 172.21.15.99:0/2760854783 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c63befdb90 msgr2=0x55c63befe920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:23.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.105+0000 7f793ea00640 1 --2- 172.21.15.99:0/2760854783 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c63befdb90 0x55c63befe920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:23.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.105+0000 7f793ea00640 1 -- 172.21.15.99:0/2760854783 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c63bec24c0 msgr2=0x55c63bec28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:23.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.105+0000 7f793ea00640 1 --2- 172.21.15.99:0/2760854783 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c63bec24c0 0x55c63bec28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:23.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.105+0000 7f793ea00640 1 -- 172.21.15.99:0/2760854783 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c63bdb1c40 con 0x55c63bec2de0 2024-02-21T23:08:23.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.105+0000 7f793fe00640 1 --2- 172.21.15.99:0/2760854783 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c63befdb90 0x55c63befe920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:08:23.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.105+0000 7f793f400640 1 --2- 172.21.15.99:0/2760854783 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c63bec24c0 0x55c63bec28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:08:23.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.105+0000 7f793ea00640 1 --2- 172.21.15.99:0/2760854783 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c63bec2de0 0x55c63befd650 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f7940092960 tx=0x7f792c008030 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6989cf4d86ec4967 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:23.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.106+0000 7f792b400640 1 -- 172.21.15.99:0/2760854783 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f792c049070 con 0x55c63bec2de0 2024-02-21T23:08:23.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.106+0000 7f792b400640 1 -- 172.21.15.99:0/2760854783 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f792c004040 con 0x55c63bec2de0 2024-02-21T23:08:23.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.106+0000 7f792b400640 1 -- 172.21.15.99:0/2760854783 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f792c034040 con 0x55c63bec2de0 2024-02-21T23:08:23.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.106+0000 7f7948fd0740 1 -- 172.21.15.99:0/2760854783 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c63bec2de0 msgr2=0x55c63befd650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:23.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.106+0000 7f7948fd0740 1 --2- 172.21.15.99:0/2760854783 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c63bec2de0 0x55c63befd650 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f7940092960 tx=0x7f792c008030 comp rx=0 tx=0).stop 2024-02-21T23:08:23.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.106+0000 7f7948fd0740 1 -- 172.21.15.99:0/2760854783 shutdown_connections 2024-02-21T23:08:23.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.106+0000 7f7948fd0740 1 --2- 172.21.15.99:0/2760854783 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c63befdb90 0x55c63befe920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:23.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.106+0000 7f7948fd0740 1 --2- 172.21.15.99:0/2760854783 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c63bec2de0 0x55c63befd650 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:23.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.106+0000 7f7948fd0740 1 --2- 172.21.15.99:0/2760854783 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c63bec24c0 0x55c63bec28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:23.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.106+0000 7f7948fd0740 1 -- 172.21.15.99:0/2760854783 >> 172.21.15.99:0/2760854783 conn(0x55c63be84a90 msgr2=0x55c63be85b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:08:23.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.107+0000 7f7948fd0740 1 -- 172.21.15.99:0/2760854783 shutdown_connections 2024-02-21T23:08:23.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.107+0000 7f7948fd0740 1 -- 172.21.15.99:0/2760854783 wait complete. 2024-02-21T23:08:23.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.108+0000 7f7948fd0740 1 -- start start 2024-02-21T23:08:23.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.108+0000 7f7948fd0740 1 Processor -- start 2024-02-21T23:08:23.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.110+0000 7f7948fd0740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c63bec2de0 0x55c63bead470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:23.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.110+0000 7f7948fd0740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c63befdb90 0x55c63be820b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:23.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.110+0000 7f7948fd0740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c63bebefa0 0x55c63beb7410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:23.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.110+0000 7f7948fd0740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c63befc070 con 0x55c63befdb90 2024-02-21T23:08:23.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.110+0000 7f7948fd0740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c63bd891d0 con 0x55c63bebefa0 2024-02-21T23:08:23.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.110+0000 7f7948fd0740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c63befc350 con 0x55c63bec2de0 2024-02-21T23:08:23.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.111+0000 7f7948fd0740 10 client.0 _ll_register_callbacks cb 0x55c63bafec60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:08:23.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.111+0000 7f793ea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c63befdb90 0x55c63be820b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:23.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.111+0000 7f793f400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c63bec2de0 0x55c63bead470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:23.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.111+0000 7f793f400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c63bec2de0 0x55c63bead470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:38532/0 (socket says 172.21.15.99:38532) 2024-02-21T23:08:23.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.111+0000 7f793f400640 1 -- 172.21.15.99:0/3383570035 learned_addr learned my addr 172.21.15.99:0/3383570035 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:08:23.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.111+0000 7f793fe00640 1 --2- 172.21.15.99:0/3383570035 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c63bebefa0 0x55c63beb7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:23.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.111+0000 7f793f400640 1 -- 172.21.15.99:0/3383570035 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c63bebefa0 msgr2=0x55c63beb7410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:23.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.111+0000 7f793f400640 1 --2- 172.21.15.99:0/3383570035 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c63bebefa0 0x55c63beb7410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:23.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.111+0000 7f793f400640 1 -- 172.21.15.99:0/3383570035 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c63befdb90 msgr2=0x55c63be820b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:23.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.111+0000 7f793f400640 1 --2- 172.21.15.99:0/3383570035 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c63befdb90 0x55c63be820b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:23.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.111+0000 7f793f400640 1 -- 172.21.15.99:0/3383570035 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c63bbc77e0 con 0x55c63bec2de0 2024-02-21T23:08:23.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.111+0000 7f793f400640 1 --2- 172.21.15.99:0/3383570035 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c63bec2de0 0x55c63bead470 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f793000e930 tx=0x7f79300a0120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=179a3f71c10e06d1 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:23.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.111+0000 7f791fe00640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-02-21T23:08:23.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.112+0000 7f791fe00640 1 -- 172.21.15.99:0/3383570035 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7930021070 con 0x55c63bec2de0 2024-02-21T23:08:23.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.112+0000 7f791fe00640 1 -- 172.21.15.99:0/3383570035 <== mon.2 v2:172.21.15.181:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f7930097050 con 0x55c63bec2de0 2024-02-21T23:08:23.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.112+0000 7f793ea00640 1 --2- 172.21.15.99:0/3383570035 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c63befdb90 0x55c63be820b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:08:23.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.112+0000 7f7948fd0740 1 -- 172.21.15.99:0/3383570035 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f792c004040 con 0x55c63bec2de0 2024-02-21T23:08:23.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.112+0000 7f791fe00640 1 -- 172.21.15.99:0/3383570035 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f79300af170 con 0x55c63bec2de0 2024-02-21T23:08:23.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.112+0000 7f7948fd0740 10 client.6473 fetch_fsmap learned FSMap version 17 2024-02-21T23:08:23.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.112+0000 7f7948fd0740 1 -- 172.21.15.99:0/3383570035 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55c63bc27f70 con 0x55c63bec2de0 2024-02-21T23:08:23.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.112+0000 7f791fe00640 1 -- 172.21.15.99:0/3383570035 <== mon.2 v2:172.21.15.181:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f792c004040 con 0x55c63bec2de0 2024-02-21T23:08:23.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.112+0000 7f791fe00640 1 -- 172.21.15.99:0/3383570035 <== mon.2 v2:172.21.15.181:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f79300c6020 con 0x55c63bec2de0 2024-02-21T23:08:23.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.113+0000 7f7948fd0740 10 client.6473 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:08:23.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.113+0000 7f7948fd0740 10 client.6473 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:08:23.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.113+0000 7f7948fd0740 20 client.6473 populate_metadata read hostname 'smithi099' 2024-02-21T23:08:23.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.113+0000 7f793fe00640 1 --2- 172.21.15.99:0/3383570035 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c63bebefa0 0x55c63beb7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:08:23.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.113+0000 7f7948fd0740 1 --2- 172.21.15.99:0/3383570035 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55c63beb7e20 0x55c63bf0a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:23.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.113+0000 7f7948fd0740 4 client.6473 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:08:23.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.113+0000 7f7948fd0740 1 -- 172.21.15.99:0/3383570035 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c63bdf7cd0 con 0x55c63beb7e20 2024-02-21T23:08:23.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.114+0000 7f793ea00640 1 --2- 172.21.15.99:0/3383570035 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55c63beb7e20 0x55c63bf0a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:23.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.114+0000 7f793ea00640 1 --2- 172.21.15.99:0/3383570035 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55c63beb7e20 0x55c63bf0a010 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12fe2b2d8d921f7 server_cookie=a9483fb5677f05cc in_seq=0 out_seq=0 2024-02-21T23:08:23.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.114+0000 7f791fe00640 10 client.6473 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:08:23.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.115+0000 7f791fe00640 1 -- 172.21.15.99:0/3383570035 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55c63bdf7cd0 con 0x55c63beb7e20 2024-02-21T23:08:23.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.115+0000 7f791fe00640 10 client.6473 handle_command_reply: tid=0 2024-02-21T23:08:23.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.116+0000 7f7948fd0740 1 client.6473 shutdown 2024-02-21T23:08:23.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.116+0000 7f7948fd0740 1 -- 172.21.15.99:0/3383570035 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c63bec2de0 msgr2=0x55c63bead470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:23.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.116+0000 7f7948fd0740 1 --2- 172.21.15.99:0/3383570035 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c63bec2de0 0x55c63bead470 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f793000e930 tx=0x7f79300a0120 comp rx=0 tx=0).stop 2024-02-21T23:08:23.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.116+0000 7f7948fd0740 1 -- 172.21.15.99:0/3383570035 shutdown_connections 2024-02-21T23:08:23.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.116+0000 7f7948fd0740 1 --2- 172.21.15.99:0/3383570035 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55c63beb7e20 0x55c63bf0a010 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:23.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.116+0000 7f7948fd0740 1 --2- 172.21.15.99:0/3383570035 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c63bebefa0 0x55c63beb7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:23.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.116+0000 7f7948fd0740 1 --2- 172.21.15.99:0/3383570035 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c63befdb90 0x55c63be820b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:23.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.116+0000 7f7948fd0740 1 --2- 172.21.15.99:0/3383570035 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c63bec2de0 0x55c63bead470 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:23.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.116+0000 7f791fe00640 0 client.6473 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:08:23.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.116+0000 7f7948fd0740 1 -- 172.21.15.99:0/3383570035 >> 172.21.15.99:0/3383570035 conn(0x55c63bec24c0 msgr2=0x55c63be86500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:08:23.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.116+0000 7f7948fd0740 1 -- 172.21.15.99:0/3383570035 shutdown_connections 2024-02-21T23:08:23.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.116+0000 7f7948fd0740 1 -- 172.21.15.99:0/3383570035 wait complete. 2024-02-21T23:08:23.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.116+0000 7f7948fd0740 20 client.6473 trim_cache size 0 max 16384 2024-02-21T23:08:23.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.142+0000 7f7948fd0740 1 Processor -- start 2024-02-21T23:08:23.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.142+0000 7f7948fd0740 1 -- start start 2024-02-21T23:08:23.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.144+0000 7f7948fd0740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c63bebefa0 0x55c63be82090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:23.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.144+0000 7f7948fd0740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c63bec2de0 0x55c63be8d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:23.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.144+0000 7f7948fd0740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c63befdb90 0x55c63be83150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:23.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.144+0000 7f7948fd0740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f794022c820 con 0x55c63befdb90 2024-02-21T23:08:23.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.144+0000 7f7948fd0740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f794022a3c0 con 0x55c63bec2de0 2024-02-21T23:08:23.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.144+0000 7f7948fd0740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f794021fb40 con 0x55c63bebefa0 2024-02-21T23:08:23.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.145+0000 7f793f400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c63bebefa0 0x55c63be82090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:23.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.145+0000 7f793fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c63befdb90 0x55c63be83150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:23.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.145+0000 7f793ea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c63bec2de0 0x55c63be8d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:23.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.145+0000 7f793f400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c63bebefa0 0x55c63be82090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:38534/0 (socket says 172.21.15.99:38534) 2024-02-21T23:08:23.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.145+0000 7f793ea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c63bec2de0 0x55c63be8d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:36894/0 (socket says 172.21.15.99:36894) 2024-02-21T23:08:23.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.145+0000 7f793f400640 1 -- 172.21.15.99:0/3305503497 learned_addr learned my addr 172.21.15.99:0/3305503497 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:08:23.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.145+0000 7f793f400640 1 -- 172.21.15.99:0/3305503497 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c63bec2de0 msgr2=0x55c63be8d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:23.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.145+0000 7f793f400640 1 --2- 172.21.15.99:0/3305503497 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c63bec2de0 0x55c63be8d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:23.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.145+0000 7f793f400640 1 -- 172.21.15.99:0/3305503497 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c63befdb90 msgr2=0x55c63be83150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:23.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.145+0000 7f793f400640 1 --2- 172.21.15.99:0/3305503497 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c63befdb90 0x55c63be83150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:23.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.145+0000 7f793f400640 1 -- 172.21.15.99:0/3305503497 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c63beb7780 con 0x55c63bebefa0 2024-02-21T23:08:23.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.145+0000 7f793fe00640 1 --2- 172.21.15.99:0/3305503497 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c63befdb90 0x55c63be83150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:08:23.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.146+0000 7f793f400640 1 --2- 172.21.15.99:0/3305503497 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c63bebefa0 0x55c63be82090 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f79300c7c00 tx=0x7f793001d000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=926313e303d34a51 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:23.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.146+0000 7f792aa00640 1 -- 172.21.15.99:0/3305503497 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79300af310 con 0x55c63bebefa0 2024-02-21T23:08:23.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.146+0000 7f792aa00640 1 -- 172.21.15.99:0/3305503497 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79300c3020 con 0x55c63bebefa0 2024-02-21T23:08:23.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.146+0000 7f792aa00640 1 -- 172.21.15.99:0/3305503497 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7930097090 con 0x55c63bebefa0 2024-02-21T23:08:23.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.147+0000 7f7948fd0740 1 -- 172.21.15.99:0/3305503497 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c63bebefa0 msgr2=0x55c63be82090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:23.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.147+0000 7f7948fd0740 1 --2- 172.21.15.99:0/3305503497 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c63bebefa0 0x55c63be82090 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f79300c7c00 tx=0x7f793001d000 comp rx=0 tx=0).stop 2024-02-21T23:08:23.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.147+0000 7f7948fd0740 1 -- 172.21.15.99:0/3305503497 shutdown_connections 2024-02-21T23:08:23.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.147+0000 7f7948fd0740 1 --2- 172.21.15.99:0/3305503497 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c63befdb90 0x55c63be83150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:23.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.147+0000 7f7948fd0740 1 --2- 172.21.15.99:0/3305503497 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c63bec2de0 0x55c63be8d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:23.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.147+0000 7f7948fd0740 1 --2- 172.21.15.99:0/3305503497 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c63bebefa0 0x55c63be82090 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:23.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.147+0000 7f7948fd0740 1 -- 172.21.15.99:0/3305503497 >> 172.21.15.99:0/3305503497 conn(0x55c63bec24c0 msgr2=0x55c63bec6c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:08:23.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.147+0000 7f7948fd0740 1 -- 172.21.15.99:0/3305503497 shutdown_connections 2024-02-21T23:08:23.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.147+0000 7f7948fd0740 1 -- 172.21.15.99:0/3305503497 wait complete. 2024-02-21T23:08:23.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.148+0000 7f7948fd0740 1 -- start start 2024-02-21T23:08:23.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.148+0000 7f7948fd0740 1 Processor -- start 2024-02-21T23:08:23.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.150+0000 7f7948fd0740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c63bebefa0 0x55c63bec6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:23.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.150+0000 7f7948fd0740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c63bec2de0 0x55c63bf69630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:23.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.150+0000 7f7948fd0740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c63befdb90 0x55c63be81dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:23.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.150+0000 7f7948fd0740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7940228aa0 con 0x55c63befdb90 2024-02-21T23:08:23.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.150+0000 7f7948fd0740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7940229d60 con 0x55c63bec2de0 2024-02-21T23:08:23.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.150+0000 7f7948fd0740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79402290a0 con 0x55c63bebefa0 2024-02-21T23:08:23.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.150+0000 7f7948fd0740 10 client.0 _ll_register_callbacks cb 0x7f793009baa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:08:23.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.150+0000 7f793f400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c63bebefa0 0x55c63bec6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:23.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.150+0000 7f793f400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c63bebefa0 0x55c63bec6dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:38544/0 (socket says 172.21.15.99:38544) 2024-02-21T23:08:23.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.150+0000 7f793f400640 1 -- 172.21.15.99:0/1670331885 learned_addr learned my addr 172.21.15.99:0/1670331885 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:08:23.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.150+0000 7f793fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c63befdb90 0x55c63be81dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:23.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.150+0000 7f793ea00640 1 --2- 172.21.15.99:0/1670331885 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c63bec2de0 0x55c63bf69630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:23.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.150+0000 7f793f400640 1 -- 172.21.15.99:0/1670331885 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c63bec2de0 msgr2=0x55c63bf69630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:23.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.150+0000 7f793f400640 1 --2- 172.21.15.99:0/1670331885 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c63bec2de0 0x55c63bf69630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:23.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.150+0000 7f793f400640 1 -- 172.21.15.99:0/1670331885 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c63befdb90 msgr2=0x55c63be81dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:23.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.150+0000 7f793f400640 1 --2- 172.21.15.99:0/1670331885 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c63befdb90 0x55c63be81dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:23.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.150+0000 7f793f400640 1 -- 172.21.15.99:0/1670331885 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c63bec2c10 con 0x55c63bebefa0 2024-02-21T23:08:23.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.151+0000 7f793f400640 1 --2- 172.21.15.99:0/1670331885 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c63bebefa0 0x55c63bec6dc0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f793000e930 tx=0x7f7930000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ce58486cd2ea2b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:23.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.151+0000 7f791fe00640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-02-21T23:08:23.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.151+0000 7f791fe00640 1 -- 172.21.15.99:0/1670331885 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79300c73f0 con 0x55c63bebefa0 2024-02-21T23:08:23.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.151+0000 7f791fe00640 1 -- 172.21.15.99:0/1670331885 <== mon.2 v2:172.21.15.181:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f7930093750 con 0x55c63bebefa0 2024-02-21T23:08:23.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.151+0000 7f7948fd0740 1 -- 172.21.15.99:0/1670331885 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f79300c3020 con 0x55c63bebefa0 2024-02-21T23:08:23.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.151+0000 7f791fe00640 1 -- 172.21.15.99:0/1670331885 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7930097060 con 0x55c63bebefa0 2024-02-21T23:08:23.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.151+0000 7f7948fd0740 10 client.6479 fetch_fsmap learned FSMap version 17 2024-02-21T23:08:23.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.151+0000 7f7948fd0740 1 -- 172.21.15.99:0/1670331885 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55c63babf170 con 0x55c63bebefa0 2024-02-21T23:08:23.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.151+0000 7f791fe00640 1 -- 172.21.15.99:0/1670331885 <== mon.2 v2:172.21.15.181:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79300c3020 con 0x55c63bebefa0 2024-02-21T23:08:23.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.151+0000 7f791fe00640 1 -- 172.21.15.99:0/1670331885 <== mon.2 v2:172.21.15.181:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f79300c6040 con 0x55c63bebefa0 2024-02-21T23:08:23.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.151+0000 7f7948fd0740 10 client.6479 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:08:23.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.151+0000 7f7948fd0740 10 client.6479 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:08:23.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.151+0000 7f7948fd0740 20 client.6479 populate_metadata read hostname 'smithi099' 2024-02-21T23:08:23.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.152+0000 7f7948fd0740 1 --2- 172.21.15.99:0/1670331885 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55c63bec7c20 0x55c63befcc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:23.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.152+0000 7f7948fd0740 4 client.6479 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-02-21T23:08:23.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.152+0000 7f7948fd0740 1 -- 172.21.15.99:0/1670331885 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55c63bdf2020 con 0x55c63bec7c20 2024-02-21T23:08:23.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.152+0000 7f793ea00640 1 --2- 172.21.15.99:0/1670331885 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55c63bec7c20 0x55c63befcc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:23.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.152+0000 7f791fe00640 10 client.6479 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:08:23.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.152+0000 7f793ea00640 1 --2- 172.21.15.99:0/1670331885 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55c63bec7c20 0x55c63befcc90 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2cde9f8063f98df8 server_cookie=e6923fe57cfca77c in_seq=0 out_seq=0 2024-02-21T23:08:23.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.154+0000 7f791fe00640 1 -- 172.21.15.99:0/1670331885 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55c63bdf2020 con 0x55c63bec7c20 2024-02-21T23:08:23.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.154+0000 7f791fe00640 10 client.6479 handle_command_reply: tid=0 2024-02-21T23:08:23.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.154+0000 7f7948fd0740 1 client.6479 shutdown 2024-02-21T23:08:23.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.154+0000 7f7948fd0740 1 -- 172.21.15.99:0/1670331885 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c63bebefa0 msgr2=0x55c63bec6dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:23.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.154+0000 7f7948fd0740 1 --2- 172.21.15.99:0/1670331885 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c63bebefa0 0x55c63bec6dc0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f793000e930 tx=0x7f7930000bc0 comp rx=0 tx=0).stop 2024-02-21T23:08:23.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.154+0000 7f7948fd0740 1 -- 172.21.15.99:0/1670331885 shutdown_connections 2024-02-21T23:08:23.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.154+0000 7f7948fd0740 1 --2- 172.21.15.99:0/1670331885 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55c63bec7c20 0x55c63befcc90 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:23.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.154+0000 7f7948fd0740 1 --2- 172.21.15.99:0/1670331885 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c63befdb90 0x55c63be81dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:23.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.154+0000 7f7948fd0740 1 --2- 172.21.15.99:0/1670331885 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c63bec2de0 0x55c63bf69630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:23.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.154+0000 7f7948fd0740 1 --2- 172.21.15.99:0/1670331885 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c63bebefa0 0x55c63bec6dc0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:23.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.154+0000 7f7948fd0740 1 -- 172.21.15.99:0/1670331885 >> 172.21.15.99:0/1670331885 conn(0x55c63bec24c0 msgr2=0x55c63be86500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:08:23.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.154+0000 7f791fe00640 0 client.6479 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:08:23.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.155+0000 7f7948fd0740 1 -- 172.21.15.99:0/1670331885 shutdown_connections 2024-02-21T23:08:23.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.155+0000 7f7948fd0740 1 -- 172.21.15.99:0/1670331885 wait complete. 2024-02-21T23:08:23.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.155+0000 7f7948fd0740 20 client.6479 trim_cache size 0 max 16384 2024-02-21T23:08:23.149 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-02-21T23:08:23.149 INFO:teuthology.orchestra.run.smithi099.stdout: "return_code": 0, 2024-02-21T23:08:23.149 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_tag": "fc6827e3-669a-4c78-8a06-11411d66c9c5", 2024-02-21T23:08:23.149 INFO:teuthology.orchestra.run.smithi099.stdout: "mode": "asynchronous" 2024-02-21T23:08:23.149 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-02-21T23:08:23.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.156+0000 7f7944a00640 1 -- 172.21.15.99:0/1366240514 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f792009ee50 msgr2=0x7f79200a1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:23.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.156+0000 7f7944a00640 1 --2- 172.21.15.99:0/1366240514 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f792009ee50 0x7f79200a1310 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f79380012e0 tx=0x7f7938009040 comp rx=0 tx=0).stop 2024-02-21T23:08:23.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.156+0000 7f7944a00640 1 -- 172.21.15.99:0/1366240514 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7940071c20 msgr2=0x7f794015a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:23.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.156+0000 7f7944a00640 1 --2- 172.21.15.99:0/1366240514 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7940071c20 0x7f794015a680 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f793000e960 tx=0x7f793000ee20 comp rx=0 tx=0).stop 2024-02-21T23:08:23.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.156+0000 7f7944a00640 1 -- 172.21.15.99:0/1366240514 shutdown_connections 2024-02-21T23:08:23.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.156+0000 7f7944a00640 1 --2- 172.21.15.99:0/1366240514 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f792009ee50 0x7f79200a1310 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:23.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.156+0000 7f7944a00640 1 --2- 172.21.15.99:0/1366240514 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f794018b920 0x7f79400f2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:23.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.156+0000 7f7944a00640 1 --2- 172.21.15.99:0/1366240514 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f794017f710 0x7f79400f1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:23.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.156+0000 7f7944a00640 1 --2- 172.21.15.99:0/1366240514 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7940071c20 0x7f794015a680 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:23.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.156+0000 7f7944a00640 1 -- 172.21.15.99:0/1366240514 >> 172.21.15.99:0/1366240514 conn(0x7f79400fe310 msgr2=0x7f79400fc490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:08:23.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.157+0000 7f7944a00640 1 -- 172.21.15.99:0/1366240514 shutdown_connections 2024-02-21T23:08:23.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.157+0000 7f7944a00640 1 -- 172.21.15.99:0/1366240514 wait complete. 2024-02-21T23:08:23.169 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T23:08:23.169 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T23:08:23.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.466+0000 7f7456c00640 1 Processor -- start 2024-02-21T23:08:23.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.466+0000 7f7456c00640 1 -- start start 2024-02-21T23:08:23.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.469+0000 7f7456c00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74500efc90 con 0x7f7450182dd0 2024-02-21T23:08:23.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.469+0000 7f7456c00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74500f6e60 con 0x7f74500cd070 2024-02-21T23:08:23.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.469+0000 7f7456c00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74500f7140 con 0x7f745018a2e0 2024-02-21T23:08:23.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.469+0000 7f744f400640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f745018a2e0 0x7f74500f81e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:52698/0 (socket says 172.21.15.99:52698) 2024-02-21T23:08:23.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.469+0000 7f744f400640 1 -- 172.21.15.99:0/218726073 learned_addr learned my addr 172.21.15.99:0/218726073 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:08:23.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.470+0000 7f744ea00640 1 -- 172.21.15.99:0/218726073 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2937044804 0 0) 0x7f74500f7140 con 0x7f745018a2e0 2024-02-21T23:08:23.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.470+0000 7f744ea00640 1 -- 172.21.15.99:0/218726073 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7434003520 con 0x7f745018a2e0 2024-02-21T23:08:23.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.470+0000 7f744ea00640 1 -- 172.21.15.99:0/218726073 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4003227927 0 0) 0x7f74500f6e60 con 0x7f74500cd070 2024-02-21T23:08:23.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.470+0000 7f744ea00640 1 -- 172.21.15.99:0/218726073 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74500f7140 con 0x7f74500cd070 2024-02-21T23:08:23.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.470+0000 7f744ea00640 1 -- 172.21.15.99:0/218726073 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1803052848 0 0) 0x7f74500efc90 con 0x7f7450182dd0 2024-02-21T23:08:23.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.470+0000 7f744ea00640 1 -- 172.21.15.99:0/218726073 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74500f6e60 con 0x7f7450182dd0 2024-02-21T23:08:23.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.470+0000 7f744ea00640 1 -- 172.21.15.99:0/218726073 <== mon.2 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2668709960 0 0) 0x7f7434003520 con 0x7f745018a2e0 2024-02-21T23:08:23.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.470+0000 7f744ea00640 1 -- 172.21.15.99:0/218726073 >> v1:172.21.15.162:6789/0 conn(0x7f74500cd070 legacy=0x7f74500cd4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:23.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.470+0000 7f744ea00640 1 -- 172.21.15.99:0/218726073 >> v1:172.21.15.99:6789/0 conn(0x7f7450182dd0 legacy=0x7f74500ef580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:23.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.470+0000 7f744ea00640 1 -- 172.21.15.99:0/218726073 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74500f7420 con 0x7f745018a2e0 2024-02-21T23:08:23.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.470+0000 7f744ea00640 1 -- 172.21.15.99:0/218726073 <== mon.2 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2069890144 0 0) 0x7f743c001670 con 0x7f745018a2e0 2024-02-21T23:08:23.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.470+0000 7f744ea00640 1 -- 172.21.15.99:0/218726073 >> v1:172.21.15.181:6789/0 conn(0x7f745018a2e0 legacy=0x7f74500f81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:23.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.471+0000 7f744ea00640 1 --2- 172.21.15.99:0/218726073 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7434003d50 0x7f7434004130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:23.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.471+0000 7f744ea00640 1 --2- 172.21.15.99:0/218726073 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f74340048c0 0x7f7434004d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:23.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.471+0000 7f744ea00640 1 --2- 172.21.15.99:0/218726073 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74340099b0 0x7f743400bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:23.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.471+0000 7f744ea00640 1 -- 172.21.15.99:0/218726073 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f743400c330 con 0x7f7434003d50 2024-02-21T23:08:23.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.471+0000 7f744ea00640 1 -- 172.21.15.99:0/218726073 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f743400c4e0 con 0x7f74340099b0 2024-02-21T23:08:23.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.471+0000 7f744ea00640 1 -- 172.21.15.99:0/218726073 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f743400c6e0 con 0x7f74340048c0 2024-02-21T23:08:23.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.471+0000 7f744f400640 1 --2- 172.21.15.99:0/218726073 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f74340048c0 0x7f7434004d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:23.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.471+0000 7f7454c00640 1 --2- 172.21.15.99:0/218726073 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74340099b0 0x7f743400bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:23.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.471+0000 7f744fe00640 1 --2- 172.21.15.99:0/218726073 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7434003d50 0x7f7434004130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:23.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.471+0000 7f744f400640 1 -- 172.21.15.99:0/218726073 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74340099b0 msgr2=0x7f743400bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:23.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.471+0000 7f744f400640 1 --2- 172.21.15.99:0/218726073 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74340099b0 0x7f743400bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:23.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.472+0000 7f744f400640 1 -- 172.21.15.99:0/218726073 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7434003d50 msgr2=0x7f7434004130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:23.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.472+0000 7f744f400640 1 --2- 172.21.15.99:0/218726073 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7434003d50 0x7f7434004130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:23.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.472+0000 7f744f400640 1 -- 172.21.15.99:0/218726073 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74500f7420 con 0x7f74340048c0 2024-02-21T23:08:23.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.472+0000 7f744fe00640 1 --2- 172.21.15.99:0/218726073 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7434003d50 0x7f7434004130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T23:08:23.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.473+0000 7f7454c00640 1 -- 172.21.15.99:0/218726073 reap_dead start 2024-02-21T23:08:23.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.473+0000 7f744f400640 1 --2- 172.21.15.99:0/218726073 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f74340048c0 0x7f7434004d40 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f743c00c210 tx=0x7f7434005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bbea5ab73e2ced7d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:23.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.474+0000 7f744ea00640 1 -- 172.21.15.99:0/218726073 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f743c007d30 con 0x7f74340048c0 2024-02-21T23:08:23.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.474+0000 7f744ea00640 1 -- 172.21.15.99:0/218726073 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f743c030070 con 0x7f74340048c0 2024-02-21T23:08:23.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.474+0000 7f744ea00640 1 -- 172.21.15.99:0/218726073 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f743c005cf0 con 0x7f74340048c0 2024-02-21T23:08:23.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.475+0000 7f7456c00640 1 -- 172.21.15.99:0/218726073 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f74340048c0 msgr2=0x7f7434004d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:23.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.475+0000 7f7456c00640 1 --2- 172.21.15.99:0/218726073 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f74340048c0 0x7f7434004d40 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f743c00c210 tx=0x7f7434005830 comp rx=0 tx=0).stop 2024-02-21T23:08:23.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.475+0000 7f7456c00640 1 -- 172.21.15.99:0/218726073 shutdown_connections 2024-02-21T23:08:23.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.475+0000 7f7456c00640 1 --2- 172.21.15.99:0/218726073 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f74340048c0 0x7f7434004d40 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:23.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.475+0000 7f7456c00640 1 -- 172.21.15.99:0/218726073 >> 172.21.15.99:0/218726073 conn(0x7f74500f8e30 msgr2=0x7f74500f9240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:08:23.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.475+0000 7f7456c00640 1 -- 172.21.15.99:0/218726073 shutdown_connections 2024-02-21T23:08:23.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.476+0000 7f7456c00640 1 -- 172.21.15.99:0/218726073 wait complete. 2024-02-21T23:08:23.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.479+0000 7f7456c00640 1 Processor -- start 2024-02-21T23:08:23.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.479+0000 7f7456c00640 1 -- start start 2024-02-21T23:08:23.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.483+0000 7f7456c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f74340048c0 0x7f7450167bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:23.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.483+0000 7f7456c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7450168110 0x7f7450210960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:23.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.483+0000 7f7456c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7450210ea0 0x7f7450180350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:23.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.483+0000 7f7456c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74500f79e0 con 0x7f74340048c0 2024-02-21T23:08:23.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.483+0000 7f7456c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74500f7d50 con 0x7f7450168110 2024-02-21T23:08:23.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.483+0000 7f7456c00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74501831b0 con 0x7f7450210ea0 2024-02-21T23:08:23.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.483+0000 7f744f400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7450168110 0x7f7450210960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:23.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.483+0000 7f744f400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7450168110 0x7f7450210960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:36926/0 (socket says 172.21.15.99:36926) 2024-02-21T23:08:23.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.483+0000 7f744f400640 1 -- 172.21.15.99:0/2230699004 learned_addr learned my addr 172.21.15.99:0/2230699004 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:08:23.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.483+0000 7f744fe00640 1 --2- 172.21.15.99:0/2230699004 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f74340048c0 0x7f7450167bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:23.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.483+0000 7f7454c00640 1 --2- 172.21.15.99:0/2230699004 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7450210ea0 0x7f7450180350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:23.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.484+0000 7f744f400640 1 -- 172.21.15.99:0/2230699004 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7450210ea0 msgr2=0x7f7450180350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:23.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.484+0000 7f744f400640 1 --2- 172.21.15.99:0/2230699004 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7450210ea0 0x7f7450180350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:23.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.484+0000 7f744f400640 1 -- 172.21.15.99:0/2230699004 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f74340048c0 msgr2=0x7f7450167bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:23.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.484+0000 7f744f400640 1 --2- 172.21.15.99:0/2230699004 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f74340048c0 0x7f7450167bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:23.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.484+0000 7f744f400640 1 -- 172.21.15.99:0/2230699004 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74501835e0 con 0x7f7450168110 2024-02-21T23:08:23.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.484+0000 7f744fe00640 1 --2- 172.21.15.99:0/2230699004 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f74340048c0 0x7f7450167bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:08:23.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.485+0000 7f744f400640 1 --2- 172.21.15.99:0/2230699004 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7450168110 0x7f7450210960 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f743c00c330 tx=0x7f743c02e070 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:23.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.485+0000 7f7447e00640 1 -- 172.21.15.99:0/2230699004 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f743c046070 con 0x7f7450168110 2024-02-21T23:08:23.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.486+0000 7f7447e00640 1 -- 172.21.15.99:0/2230699004 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f743c004bf0 con 0x7f7450168110 2024-02-21T23:08:23.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.486+0000 7f7447e00640 1 -- 172.21.15.99:0/2230699004 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f743c007d30 con 0x7f7450168110 2024-02-21T23:08:23.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.486+0000 7f7456c00640 1 -- 172.21.15.99:0/2230699004 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74501838c0 con 0x7f7450168110 2024-02-21T23:08:23.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.486+0000 7f7456c00640 1 -- 172.21.15.99:0/2230699004 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7450183e80 con 0x7f7450168110 2024-02-21T23:08:23.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.491+0000 7f7447e00640 1 -- 172.21.15.99:0/2230699004 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f743c007070 con 0x7f7450168110 2024-02-21T23:08:23.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.493+0000 7f7459a38740 1 Processor -- start 2024-02-21T23:08:23.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.493+0000 7f7459a38740 1 -- start start 2024-02-21T23:08:23.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.494+0000 7f7447e00640 1 --2- 172.21.15.99:0/2230699004 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f743009efd0 0x7f74300a1490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:23.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.494+0000 7f7447e00640 1 -- 172.21.15.99:0/2230699004 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f743c0eae90 con 0x7f7450168110 2024-02-21T23:08:23.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.495+0000 7f7459a38740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564e2b8370d0 0x564e2b86cb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:23.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.495+0000 7f7459a38740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564e2b86d090 0x564e2b8374b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:23.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.495+0000 7f7459a38740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564e2b8379f0 0x564e2b7fa000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:23.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.495+0000 7f7459a38740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e2b763a90 con 0x564e2b8370d0 2024-02-21T23:08:23.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.495+0000 7f7459a38740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e2b70cb10 con 0x564e2b86d090 2024-02-21T23:08:23.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.495+0000 7f7459a38740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e2b75fb30 con 0x564e2b8379f0 2024-02-21T23:08:23.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.495+0000 7f744f400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564e2b86d090 0x564e2b8374b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:23.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.495+0000 7f744f400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564e2b86d090 0x564e2b8374b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:36936/0 (socket says 172.21.15.99:36936) 2024-02-21T23:08:23.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.495+0000 7f744f400640 1 -- 172.21.15.99:0/1447301238 learned_addr learned my addr 172.21.15.99:0/1447301238 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:08:23.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.496+0000 7f7454c00640 1 --2- 172.21.15.99:0/2230699004 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f743009efd0 0x7f74300a1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:23.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.496+0000 7f744fe00640 1 --2- 172.21.15.99:0/1447301238 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564e2b8370d0 0x564e2b86cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:23.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.496+0000 7f7454c00640 1 --2- 172.21.15.99:0/1447301238 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564e2b8379f0 0x564e2b7fa000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:23.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.496+0000 7f744f400640 1 -- 172.21.15.99:0/1447301238 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564e2b8379f0 msgr2=0x564e2b7fa000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:23.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.496+0000 7f744f400640 1 --2- 172.21.15.99:0/1447301238 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564e2b8379f0 0x564e2b7fa000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:23.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.496+0000 7f744f400640 1 -- 172.21.15.99:0/1447301238 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564e2b8370d0 msgr2=0x564e2b86cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:23.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.496+0000 7f744f400640 1 --2- 172.21.15.99:0/1447301238 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564e2b8370d0 0x564e2b86cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:23.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.496+0000 7f744f400640 1 -- 172.21.15.99:0/1447301238 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564e2b5427d0 con 0x564e2b86d090 2024-02-21T23:08:23.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.496+0000 7f7454c00640 1 --2- 172.21.15.99:0/1447301238 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564e2b8379f0 0x564e2b7fa000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T23:08:23.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.496+0000 7f744fe00640 1 --2- 172.21.15.99:0/1447301238 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564e2b8370d0 0x564e2b86cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:08:23.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.497+0000 7f744f400640 1 --2- 172.21.15.99:0/1447301238 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564e2b86d090 0x564e2b8374b0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f743c00c300 tx=0x7f743c0b8480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=519f24d187d93361 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:23.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.497+0000 7f7454c00640 1 --2- 172.21.15.99:0/2230699004 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f743009efd0 0x7f74300a1490 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7450071620 tx=0x7f7448005040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:23.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.497+0000 7f743be00640 1 -- 172.21.15.99:0/1447301238 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f743c0bc970 con 0x564e2b86d090 2024-02-21T23:08:23.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.497+0000 7f743be00640 1 -- 172.21.15.99:0/1447301238 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f743c030030 con 0x564e2b86d090 2024-02-21T23:08:23.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.497+0000 7f743be00640 1 -- 172.21.15.99:0/1447301238 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f743c0c0f30 con 0x564e2b86d090 2024-02-21T23:08:23.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.498+0000 7f7459a38740 1 -- 172.21.15.99:0/1447301238 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564e2b86d090 msgr2=0x564e2b8374b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:23.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.498+0000 7f7459a38740 1 --2- 172.21.15.99:0/1447301238 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564e2b86d090 0x564e2b8374b0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f743c00c300 tx=0x7f743c0b8480 comp rx=0 tx=0).stop 2024-02-21T23:08:23.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.498+0000 7f7459a38740 1 -- 172.21.15.99:0/1447301238 shutdown_connections 2024-02-21T23:08:23.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.498+0000 7f7459a38740 1 --2- 172.21.15.99:0/1447301238 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564e2b8379f0 0x564e2b7fa000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:23.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.498+0000 7f7459a38740 1 --2- 172.21.15.99:0/1447301238 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564e2b86d090 0x564e2b8374b0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:23.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.498+0000 7f7459a38740 1 --2- 172.21.15.99:0/1447301238 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564e2b8370d0 0x564e2b86cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:23.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.498+0000 7f7459a38740 1 -- 172.21.15.99:0/1447301238 >> 172.21.15.99:0/1447301238 conn(0x564e2b7c66b0 msgr2=0x564e2b7fdfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:08:23.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.499+0000 7f7459a38740 1 -- 172.21.15.99:0/1447301238 shutdown_connections 2024-02-21T23:08:23.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.499+0000 7f7459a38740 1 -- 172.21.15.99:0/1447301238 wait complete. 2024-02-21T23:08:23.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.501+0000 7f7459a38740 1 -- start start 2024-02-21T23:08:23.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.501+0000 7f7459a38740 1 Processor -- start 2024-02-21T23:08:23.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.503+0000 7f7459a38740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564e2b8370d0 0x564e2b8658c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:23.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.503+0000 7f7459a38740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564e2b8379f0 0x564e2b7fa070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:23.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.503+0000 7f7459a38740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564e2b86d090 0x564e2b82eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:23.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.503+0000 7f7459a38740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e2b763a90 con 0x564e2b86d090 2024-02-21T23:08:23.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.503+0000 7f7459a38740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e2b7021c0 con 0x564e2b8379f0 2024-02-21T23:08:23.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.503+0000 7f7459a38740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x564e2b70cb10 con 0x564e2b8370d0 2024-02-21T23:08:23.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.503+0000 7f7459a38740 10 client.0 _ll_register_callbacks cb 0x564e2b71f930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:08:23.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.504+0000 7f744f400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564e2b8379f0 0x564e2b7fa070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:23.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.504+0000 7f744f400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564e2b8379f0 0x564e2b7fa070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:36940/0 (socket says 172.21.15.99:36940) 2024-02-21T23:08:23.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.504+0000 7f744f400640 1 -- 172.21.15.99:0/2310411104 learned_addr learned my addr 172.21.15.99:0/2310411104 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:08:23.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.504+0000 7f7454c00640 1 --2- 172.21.15.99:0/2310411104 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564e2b86d090 0x564e2b82eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:23.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.504+0000 7f744fe00640 1 --2- 172.21.15.99:0/2310411104 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564e2b8370d0 0x564e2b8658c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:23.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.505+0000 7f744f400640 1 -- 172.21.15.99:0/2310411104 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564e2b8370d0 msgr2=0x564e2b8658c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:23.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.505+0000 7f744f400640 1 --2- 172.21.15.99:0/2310411104 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564e2b8370d0 0x564e2b8658c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:23.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.505+0000 7f744f400640 1 -- 172.21.15.99:0/2310411104 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564e2b86d090 msgr2=0x564e2b82eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:23.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.505+0000 7f744f400640 1 --2- 172.21.15.99:0/2310411104 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564e2b86d090 0x564e2b82eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:23.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.505+0000 7f744f400640 1 -- 172.21.15.99:0/2310411104 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564e2b4783f0 con 0x564e2b8379f0 2024-02-21T23:08:23.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.505+0000 7f7454c00640 1 --2- 172.21.15.99:0/2310411104 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564e2b86d090 0x564e2b82eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:08:23.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.505+0000 7f744f400640 1 --2- 172.21.15.99:0/2310411104 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564e2b8379f0 0x564e2b7fa070 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f743c0b8520 tx=0x7f743c0ea070 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a850f3dc1458bf7 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:23.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.505+0000 7f7438c00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-02-21T23:08:23.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.506+0000 7f7438c00640 1 -- 172.21.15.99:0/2310411104 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f743c0c0f30 con 0x564e2b8379f0 2024-02-21T23:08:23.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.506+0000 7f7438c00640 1 -- 172.21.15.99:0/2310411104 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f743c0e86c0 con 0x564e2b8379f0 2024-02-21T23:08:23.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.506+0000 7f7459a38740 1 -- 172.21.15.99:0/2310411104 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f743c030030 con 0x564e2b8379f0 2024-02-21T23:08:23.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.507+0000 7f7438c00640 1 -- 172.21.15.99:0/2310411104 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f743c0e88c0 con 0x564e2b8379f0 2024-02-21T23:08:23.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.507+0000 7f7459a38740 10 client.6487 fetch_fsmap learned FSMap version 17 2024-02-21T23:08:23.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.507+0000 7f7459a38740 1 -- 172.21.15.99:0/2310411104 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x564e2b4380f0 con 0x564e2b8379f0 2024-02-21T23:08:23.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.508+0000 7f7438c00640 1 -- 172.21.15.99:0/2310411104 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f743c030030 con 0x564e2b8379f0 2024-02-21T23:08:23.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.508+0000 7f7438c00640 1 -- 172.21.15.99:0/2310411104 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f743c0b9b50 con 0x564e2b8379f0 2024-02-21T23:08:23.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.508+0000 7f7459a38740 10 client.6487 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:08:23.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.508+0000 7f7459a38740 10 client.6487 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:08:23.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.508+0000 7f7459a38740 20 client.6487 populate_metadata read hostname 'smithi099' 2024-02-21T23:08:23.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.509+0000 7f7459a38740 1 --2- 172.21.15.99:0/2310411104 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x564e2b86fa80 0x564e2b86fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:23.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.509+0000 7f7459a38740 4 client.6487 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:08:23.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.509+0000 7f7459a38740 1 -- 172.21.15.99:0/2310411104 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564e2b770fd0 con 0x564e2b86fa80 2024-02-21T23:08:23.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.510+0000 7f744fe00640 1 --2- 172.21.15.99:0/2310411104 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x564e2b86fa80 0x564e2b86fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:23.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.511+0000 7f7438c00640 10 client.6487 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:08:23.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.511+0000 7f744fe00640 1 --2- 172.21.15.99:0/2310411104 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x564e2b86fa80 0x564e2b86fe60 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21fc05f6c9e782e9 server_cookie=f41f9e8fbf4b522c in_seq=0 out_seq=0 2024-02-21T23:08:23.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.513+0000 7f7438c00640 1 -- 172.21.15.99:0/2310411104 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x564e2b770fd0 con 0x564e2b86fa80 2024-02-21T23:08:23.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.513+0000 7f7438c00640 10 client.6487 handle_command_reply: tid=0 2024-02-21T23:08:23.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.513+0000 7f7459a38740 1 client.6487 shutdown 2024-02-21T23:08:23.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.514+0000 7f7459a38740 1 -- 172.21.15.99:0/2310411104 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564e2b8379f0 msgr2=0x564e2b7fa070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:23.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.514+0000 7f7459a38740 1 --2- 172.21.15.99:0/2310411104 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564e2b8379f0 0x564e2b7fa070 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f743c0b8520 tx=0x7f743c0ea070 comp rx=0 tx=0).stop 2024-02-21T23:08:23.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.514+0000 7f7459a38740 1 -- 172.21.15.99:0/2310411104 shutdown_connections 2024-02-21T23:08:23.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.514+0000 7f7459a38740 1 --2- 172.21.15.99:0/2310411104 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x564e2b86fa80 0x564e2b86fe60 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:23.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.514+0000 7f7459a38740 1 --2- 172.21.15.99:0/2310411104 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564e2b86d090 0x564e2b82eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:23.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.514+0000 7f7459a38740 1 --2- 172.21.15.99:0/2310411104 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564e2b8379f0 0x564e2b7fa070 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:23.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.514+0000 7f7459a38740 1 --2- 172.21.15.99:0/2310411104 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564e2b8370d0 0x564e2b8658c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:23.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.514+0000 7f7438c00640 0 client.6487 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:08:23.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.514+0000 7f7459a38740 1 -- 172.21.15.99:0/2310411104 >> 172.21.15.99:0/2310411104 conn(0x564e2b7c66b0 msgr2=0x564e2b86c890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:08:23.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.515+0000 7f7459a38740 1 -- 172.21.15.99:0/2310411104 shutdown_connections 2024-02-21T23:08:23.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.515+0000 7f7459a38740 1 -- 172.21.15.99:0/2310411104 wait complete. 2024-02-21T23:08:23.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.515+0000 7f7459a38740 20 client.6487 trim_cache size 0 max 16384 2024-02-21T23:08:23.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.552+0000 7f7459a38740 1 Processor -- start 2024-02-21T23:08:23.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.552+0000 7f7459a38740 1 -- start start 2024-02-21T23:08:23.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.555+0000 7f7459a38740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564e2b8370d0 0x564e2b8675d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:23.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.555+0000 7f7459a38740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564e2b8379f0 0x564e2b8da3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:23.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.555+0000 7f7459a38740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564e2b86d090 0x564e2b8e02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:23.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.555+0000 7f7459a38740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7450228b90 con 0x564e2b8370d0 2024-02-21T23:08:23.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.555+0000 7f7459a38740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74500e71c0 con 0x564e2b86d090 2024-02-21T23:08:23.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.555+0000 7f7459a38740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f745021fa90 con 0x564e2b8379f0 2024-02-21T23:08:23.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.556+0000 7f744f400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564e2b8379f0 0x564e2b8da3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:23.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.556+0000 7f7454c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564e2b86d090 0x564e2b8e02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:23.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.556+0000 7f7454c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564e2b86d090 0x564e2b8e02a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:36956/0 (socket says 172.21.15.99:36956) 2024-02-21T23:08:23.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.556+0000 7f7454c00640 1 -- 172.21.15.99:0/182212270 learned_addr learned my addr 172.21.15.99:0/182212270 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:08:23.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.556+0000 7f744fe00640 1 --2- 172.21.15.99:0/182212270 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564e2b8370d0 0x564e2b8675d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:23.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.557+0000 7f744f400640 1 -- 172.21.15.99:0/182212270 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564e2b86d090 msgr2=0x564e2b8e02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:23.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.557+0000 7f744f400640 1 --2- 172.21.15.99:0/182212270 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564e2b86d090 0x564e2b8e02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:23.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.557+0000 7f744f400640 1 -- 172.21.15.99:0/182212270 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564e2b8370d0 msgr2=0x564e2b8675d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:23.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.557+0000 7f744f400640 1 --2- 172.21.15.99:0/182212270 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564e2b8370d0 0x564e2b8675d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:23.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.557+0000 7f744f400640 1 -- 172.21.15.99:0/182212270 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564e2b8374b0 con 0x564e2b8379f0 2024-02-21T23:08:23.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.558+0000 7f7454c00640 1 --2- 172.21.15.99:0/182212270 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564e2b86d090 0x564e2b8e02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:08:23.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.558+0000 7f744fe00640 1 --2- 172.21.15.99:0/182212270 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564e2b8370d0 0x564e2b8675d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:08:23.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.558+0000 7f744f400640 1 --2- 172.21.15.99:0/182212270 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564e2b8379f0 0x564e2b8da3f0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f743c02dfd0 tx=0x7f743c0d2070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0bd4da5357a5b2 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:23.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.558+0000 7f743b400640 1 -- 172.21.15.99:0/182212270 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f743c0c0f30 con 0x564e2b8379f0 2024-02-21T23:08:23.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.559+0000 7f743b400640 1 -- 172.21.15.99:0/182212270 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f743c030070 con 0x564e2b8379f0 2024-02-21T23:08:23.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.559+0000 7f743b400640 1 -- 172.21.15.99:0/182212270 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f743c0b9b50 con 0x564e2b8379f0 2024-02-21T23:08:23.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.560+0000 7f7459a38740 1 -- 172.21.15.99:0/182212270 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564e2b8379f0 msgr2=0x564e2b8da3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:23.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.560+0000 7f7459a38740 1 --2- 172.21.15.99:0/182212270 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564e2b8379f0 0x564e2b8da3f0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f743c02dfd0 tx=0x7f743c0d2070 comp rx=0 tx=0).stop 2024-02-21T23:08:23.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.560+0000 7f7459a38740 1 -- 172.21.15.99:0/182212270 shutdown_connections 2024-02-21T23:08:23.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.560+0000 7f7459a38740 1 --2- 172.21.15.99:0/182212270 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564e2b86d090 0x564e2b8e02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:23.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.560+0000 7f7459a38740 1 --2- 172.21.15.99:0/182212270 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564e2b8379f0 0x564e2b8da3f0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:23.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.560+0000 7f7459a38740 1 --2- 172.21.15.99:0/182212270 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564e2b8370d0 0x564e2b8675d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:23.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.561+0000 7f7459a38740 1 -- 172.21.15.99:0/182212270 >> 172.21.15.99:0/182212270 conn(0x564e2b7c66b0 msgr2=0x564e2b83df20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:08:23.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.561+0000 7f7459a38740 1 -- 172.21.15.99:0/182212270 shutdown_connections 2024-02-21T23:08:23.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.561+0000 7f7459a38740 1 -- 172.21.15.99:0/182212270 wait complete. 2024-02-21T23:08:23.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.563+0000 7f7459a38740 1 -- start start 2024-02-21T23:08:23.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.564+0000 7f7459a38740 1 Processor -- start 2024-02-21T23:08:23.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.567+0000 7f7459a38740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564e2b8370d0 0x564e2b870870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:23.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.567+0000 7f7459a38740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564e2b8379f0 0x564e2b8983e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:23.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.567+0000 7f7459a38740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564e2b86d090 0x564e2b899150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:23.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.567+0000 7f7459a38740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74500e5980 con 0x564e2b86d090 2024-02-21T23:08:23.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.567+0000 7f7459a38740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74500e6b80 con 0x564e2b8370d0 2024-02-21T23:08:23.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.567+0000 7f7459a38740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74500e5f80 con 0x564e2b8379f0 2024-02-21T23:08:23.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.567+0000 7f7459a38740 10 client.0 _ll_register_callbacks cb 0x7f743c0b9020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:08:23.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.568+0000 7f744f400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564e2b8379f0 0x564e2b8983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:23.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.568+0000 7f744f400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564e2b8379f0 0x564e2b8983e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:38586/0 (socket says 172.21.15.99:38586) 2024-02-21T23:08:23.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.568+0000 7f744f400640 1 -- 172.21.15.99:0/484543327 learned_addr learned my addr 172.21.15.99:0/484543327 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:08:23.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.568+0000 7f744fe00640 1 --2- 172.21.15.99:0/484543327 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564e2b8370d0 0x564e2b870870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:23.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.568+0000 7f7454c00640 1 --2- 172.21.15.99:0/484543327 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564e2b86d090 0x564e2b899150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:23.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.568+0000 7f744f400640 1 -- 172.21.15.99:0/484543327 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564e2b8370d0 msgr2=0x564e2b870870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:23.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.568+0000 7f744f400640 1 --2- 172.21.15.99:0/484543327 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564e2b8370d0 0x564e2b870870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:23.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.568+0000 7f744f400640 1 -- 172.21.15.99:0/484543327 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564e2b86d090 msgr2=0x564e2b899150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:23.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.568+0000 7f744f400640 1 --2- 172.21.15.99:0/484543327 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564e2b86d090 0x564e2b899150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:23.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.569+0000 7f744f400640 1 -- 172.21.15.99:0/484543327 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564e2b831280 con 0x564e2b8379f0 2024-02-21T23:08:23.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.569+0000 7f744fe00640 1 --2- 172.21.15.99:0/484543327 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564e2b8370d0 0x564e2b870870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T23:08:23.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.569+0000 7f7454c00640 1 --2- 172.21.15.99:0/484543327 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564e2b86d090 0x564e2b899150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T23:08:23.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.569+0000 7f744f400640 1 --2- 172.21.15.99:0/484543327 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564e2b8379f0 0x564e2b8983e0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f743c0c10f0 tx=0x7f743c006040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=387e1280d7ea1989 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:23.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.569+0000 7f7438c00640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-02-21T23:08:23.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.570+0000 7f7438c00640 1 -- 172.21.15.99:0/484543327 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f743c0c0f30 con 0x564e2b8379f0 2024-02-21T23:08:23.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.570+0000 7f7438c00640 1 -- 172.21.15.99:0/484543327 <== mon.2 v2:172.21.15.181:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f743c0d01d0 con 0x564e2b8379f0 2024-02-21T23:08:23.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.570+0000 7f7459a38740 1 -- 172.21.15.99:0/484543327 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f743c030070 con 0x564e2b8379f0 2024-02-21T23:08:23.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.570+0000 7f7438c00640 1 -- 172.21.15.99:0/484543327 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f743c0b7c70 con 0x564e2b8379f0 2024-02-21T23:08:23.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.571+0000 7f7459a38740 10 client.6494 fetch_fsmap learned FSMap version 17 2024-02-21T23:08:23.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.571+0000 7f7459a38740 1 -- 172.21.15.99:0/484543327 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x564e2b831280 con 0x564e2b8379f0 2024-02-21T23:08:23.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.571+0000 7f7438c00640 1 -- 172.21.15.99:0/484543327 <== mon.2 v2:172.21.15.181:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f743c030070 con 0x564e2b8379f0 2024-02-21T23:08:23.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.571+0000 7f7438c00640 1 -- 172.21.15.99:0/484543327 <== mon.2 v2:172.21.15.181:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f743c0b7e10 con 0x564e2b8379f0 2024-02-21T23:08:23.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.571+0000 7f7459a38740 10 client.6494 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:08:23.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.571+0000 7f7459a38740 10 client.6494 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:08:23.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.571+0000 7f7459a38740 20 client.6494 populate_metadata read hostname 'smithi099' 2024-02-21T23:08:23.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.571+0000 7f7459a38740 1 --2- 172.21.15.99:0/484543327 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x564e2b7faed0 0x564e2b8e9d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:23.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.571+0000 7f7459a38740 4 client.6494 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T23:08:23.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.571+0000 7f7459a38740 1 -- 172.21.15.99:0/484543327 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x564e2b76b320 con 0x564e2b7faed0 2024-02-21T23:08:23.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.572+0000 7f744fe00640 1 --2- 172.21.15.99:0/484543327 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x564e2b7faed0 0x564e2b8e9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:23.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.574+0000 7f744fe00640 1 --2- 172.21.15.99:0/484543327 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x564e2b7faed0 0x564e2b8e9d90 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7375f8babe8b989 server_cookie=12ae6487a3daba7b in_seq=0 out_seq=0 2024-02-21T23:08:23.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.574+0000 7f7438c00640 10 client.6494 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:08:23.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.574+0000 7f7438c00640 1 -- 172.21.15.99:0/484543327 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x564e2b76b320 con 0x564e2b7faed0 2024-02-21T23:08:23.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.574+0000 7f7438c00640 10 client.6494 handle_command_reply: tid=0 2024-02-21T23:08:23.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.574+0000 7f7459a38740 1 client.6494 shutdown 2024-02-21T23:08:23.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.575+0000 7f7459a38740 1 -- 172.21.15.99:0/484543327 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564e2b8379f0 msgr2=0x564e2b8983e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:23.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.575+0000 7f7459a38740 1 --2- 172.21.15.99:0/484543327 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564e2b8379f0 0x564e2b8983e0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f743c0c10f0 tx=0x7f743c006040 comp rx=0 tx=0).stop 2024-02-21T23:08:23.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.575+0000 7f7459a38740 1 -- 172.21.15.99:0/484543327 shutdown_connections 2024-02-21T23:08:23.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.575+0000 7f7459a38740 1 --2- 172.21.15.99:0/484543327 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x564e2b7faed0 0x564e2b8e9d90 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:23.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.576+0000 7f7438c00640 0 client.6494 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:08:23.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.576+0000 7f7459a38740 1 --2- 172.21.15.99:0/484543327 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564e2b86d090 0x564e2b899150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:23.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.576+0000 7f7459a38740 1 --2- 172.21.15.99:0/484543327 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564e2b8379f0 0x564e2b8983e0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:23.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.576+0000 7f7459a38740 1 --2- 172.21.15.99:0/484543327 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564e2b8370d0 0x564e2b870870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:23.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.576+0000 7f7459a38740 1 -- 172.21.15.99:0/484543327 >> 172.21.15.99:0/484543327 conn(0x564e2b7c66b0 msgr2=0x564e2b8058c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:08:23.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.576+0000 7f7459a38740 1 -- 172.21.15.99:0/484543327 shutdown_connections 2024-02-21T23:08:23.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.576+0000 7f7459a38740 1 -- 172.21.15.99:0/484543327 wait complete. 2024-02-21T23:08:23.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.577+0000 7f7459a38740 20 client.6494 trim_cache size 0 max 16384 2024-02-21T23:08:23.567 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-02-21T23:08:23.567 INFO:teuthology.orchestra.run.smithi099.stdout: "status": "scrub active (828 inodes in the stack)", 2024-02-21T23:08:23.568 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubs": { 2024-02-21T23:08:23.568 INFO:teuthology.orchestra.run.smithi099.stdout: "fc6827e3-669a-4c78-8a06-11411d66c9c5": { 2024-02-21T23:08:23.568 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/", 2024-02-21T23:08:23.568 INFO:teuthology.orchestra.run.smithi099.stdout: "tag": "fc6827e3-669a-4c78-8a06-11411d66c9c5", 2024-02-21T23:08:23.568 INFO:teuthology.orchestra.run.smithi099.stdout: "options": "recursive,force" 2024-02-21T23:08:23.568 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:08:23.568 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:08:23.568 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-02-21T23:08:23.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.579+0000 7f7456c00640 1 -- 172.21.15.99:0/2230699004 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f743009efd0 msgr2=0x7f74300a1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:23.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.579+0000 7f7456c00640 1 --2- 172.21.15.99:0/2230699004 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f743009efd0 0x7f74300a1490 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7450071620 tx=0x7f7448005040 comp rx=0 tx=0).stop 2024-02-21T23:08:23.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.579+0000 7f7456c00640 1 -- 172.21.15.99:0/2230699004 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7450168110 msgr2=0x7f7450210960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:23.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.579+0000 7f7456c00640 1 --2- 172.21.15.99:0/2230699004 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7450168110 0x7f7450210960 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f743c00c330 tx=0x7f743c02e070 comp rx=0 tx=0).stop 2024-02-21T23:08:23.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.580+0000 7f7456c00640 1 -- 172.21.15.99:0/2230699004 shutdown_connections 2024-02-21T23:08:23.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.580+0000 7f7456c00640 1 --2- 172.21.15.99:0/2230699004 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f743009efd0 0x7f74300a1490 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:23.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.580+0000 7f7456c00640 1 --2- 172.21.15.99:0/2230699004 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7450210ea0 0x7f7450180350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:23.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.580+0000 7f7456c00640 1 --2- 172.21.15.99:0/2230699004 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7450168110 0x7f7450210960 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:23.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.580+0000 7f7456c00640 1 --2- 172.21.15.99:0/2230699004 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f74340048c0 0x7f7450167bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:23.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.580+0000 7f7456c00640 1 -- 172.21.15.99:0/2230699004 >> 172.21.15.99:0/2230699004 conn(0x7f74500f8e30 msgr2=0x7f7450174750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:08:23.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.580+0000 7f7456c00640 1 -- 172.21.15.99:0/2230699004 shutdown_connections 2024-02-21T23:08:23.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:23.580+0000 7f7456c00640 1 -- 172.21.15.99:0/2230699004 wait complete. 2024-02-21T23:08:23.595 INFO:tasks.cephfs.filesystem:scrub status for tag:fc6827e3-669a-4c78-8a06-11411d66c9c5 - {'path': '/', 'tag': 'fc6827e3-669a-4c78-8a06-11411d66c9c5', 'options': 'recursive,force'} 2024-02-21T23:08:43.178 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:08:43.187 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:08:43.190 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:08:53.596 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T23:08:53.597 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T23:08:53.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.878+0000 7f0194c00640 1 Processor -- start 2024-02-21T23:08:53.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.878+0000 7f0194c00640 1 -- start start 2024-02-21T23:08:53.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.879+0000 7f0194c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f019017f490 0x7f019018ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:53.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.879+0000 7f0194c00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f019018b060 0x7f0190188a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:53.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.879+0000 7f0194c00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f019018b4f0 0x7f0190188f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:53.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.879+0000 7f0194c00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01900d6dd0 con 0x7f019018b4f0 2024-02-21T23:08:53.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.879+0000 7f0194c00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01901614c0 con 0x7f019017f490 2024-02-21T23:08:53.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.879+0000 7f0194c00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01900d6810 con 0x7f019018b060 2024-02-21T23:08:53.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.880+0000 7f018f400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f019017f490 0x7f019018ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:53.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.880+0000 7f018fe00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f019018b4f0 0x7f0190188f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:53.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.880+0000 7f018ea00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f019018b060 0x7f0190188a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:53.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.880+0000 7f018f400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f019017f490 0x7f019018ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:59058/0 (socket says 172.21.15.99:59058) 2024-02-21T23:08:53.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.880+0000 7f018f400640 1 -- 172.21.15.99:0/1894151008 learned_addr learned my addr 172.21.15.99:0/1894151008 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:08:53.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.880+0000 7f018ea00640 1 --2- 172.21.15.99:0/1894151008 >> v2:172.21.15.181:3300/0 conn(0x7f019018b060 0x7f0190188a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:55994/0 (socket says 172.21.15.99:55994) 2024-02-21T23:08:53.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.880+0000 7f018f400640 1 -- 172.21.15.99:0/1894151008 >> v2:172.21.15.181:3300/0 conn(0x7f019018b060 msgr2=0x7f0190188a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:53.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.880+0000 7f018f400640 1 --2- 172.21.15.99:0/1894151008 >> v2:172.21.15.181:3300/0 conn(0x7f019018b060 0x7f0190188a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:53.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.880+0000 7f018f400640 1 -- 172.21.15.99:0/1894151008 >> v2:172.21.15.99:3300/0 conn(0x7f019018b4f0 msgr2=0x7f0190188f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:53.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.880+0000 7f018f400640 1 --2- 172.21.15.99:0/1894151008 >> v2:172.21.15.99:3300/0 conn(0x7f019018b4f0 0x7f0190188f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:53.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.880+0000 7f018f400640 1 -- 172.21.15.99:0/1894151008 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01900d6af0 con 0x7f019017f490 2024-02-21T23:08:53.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.882+0000 7f018f400640 1 --2- 172.21.15.99:0/1894151008 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f019017f490 0x7f019018ab20 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f0190067c30 tx=0x7f018002b940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2fa227ee3f4f08f4 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:53.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.882+0000 7f018e000640 1 -- 172.21.15.99:0/1894151008 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0180034070 con 0x7f019017f490 2024-02-21T23:08:53.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.882+0000 7f018e000640 1 -- 172.21.15.99:0/1894151008 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0180030800 con 0x7f019017f490 2024-02-21T23:08:53.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.882+0000 7f018e000640 1 -- 172.21.15.99:0/1894151008 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0180030bd0 con 0x7f019017f490 2024-02-21T23:08:53.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.883+0000 7f0194c00640 1 -- 172.21.15.99:0/1894151008 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f019017f490 msgr2=0x7f019018ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:53.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.883+0000 7f0194c00640 1 --2- 172.21.15.99:0/1894151008 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f019017f490 0x7f019018ab20 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f0190067c30 tx=0x7f018002b940 comp rx=0 tx=0).stop 2024-02-21T23:08:53.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.883+0000 7f0194c00640 1 -- 172.21.15.99:0/1894151008 shutdown_connections 2024-02-21T23:08:53.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.883+0000 7f0194c00640 1 --2- 172.21.15.99:0/1894151008 >> v2:172.21.15.99:3300/0 conn(0x7f019018b4f0 0x7f0190188f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:53.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.883+0000 7f0194c00640 1 --2- 172.21.15.99:0/1894151008 >> v2:172.21.15.181:3300/0 conn(0x7f019018b060 0x7f0190188a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:53.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.883+0000 7f0194c00640 1 --2- 172.21.15.99:0/1894151008 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f019017f490 0x7f019018ab20 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:53.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.883+0000 7f0194c00640 1 -- 172.21.15.99:0/1894151008 >> 172.21.15.99:0/1894151008 conn(0x7f01900d29b0 msgr2=0x7f01900d2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:08:53.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.883+0000 7f0194c00640 1 -- 172.21.15.99:0/1894151008 shutdown_connections 2024-02-21T23:08:53.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.883+0000 7f0194c00640 1 -- 172.21.15.99:0/1894151008 wait complete. 2024-02-21T23:08:53.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.885+0000 7f0194c00640 1 Processor -- start 2024-02-21T23:08:53.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.886+0000 7f0194c00640 1 -- start start 2024-02-21T23:08:53.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.888+0000 7f0194c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f019017f490 0x7f019021ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:53.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.888+0000 7f0194c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f019018b060 0x7f01901750d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:53.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.888+0000 7f0194c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f019018b4f0 0x7f019021f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:53.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.888+0000 7f0194c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f019018a600 con 0x7f019018b060 2024-02-21T23:08:53.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.888+0000 7f0194c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f019018a320 con 0x7f019018b4f0 2024-02-21T23:08:53.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.888+0000 7f0194c00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f019017f870 con 0x7f019017f490 2024-02-21T23:08:53.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.888+0000 7f018ea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f019018b060 0x7f01901750d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:53.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.888+0000 7f018ea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f019018b060 0x7f01901750d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52872/0 (socket says 172.21.15.99:52872) 2024-02-21T23:08:53.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.888+0000 7f018ea00640 1 -- 172.21.15.99:0/803649413 learned_addr learned my addr 172.21.15.99:0/803649413 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:08:53.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.888+0000 7f018f400640 1 --2- 172.21.15.99:0/803649413 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f019017f490 0x7f019021ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:53.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.888+0000 7f018fe00640 1 --2- 172.21.15.99:0/803649413 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f019018b4f0 0x7f019021f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:53.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.888+0000 7f018ea00640 1 -- 172.21.15.99:0/803649413 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f019017f490 msgr2=0x7f019021ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:53.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.888+0000 7f018ea00640 1 --2- 172.21.15.99:0/803649413 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f019017f490 0x7f019021ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:53.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.888+0000 7f018ea00640 1 -- 172.21.15.99:0/803649413 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f019018b4f0 msgr2=0x7f019021f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:53.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.888+0000 7f018ea00640 1 --2- 172.21.15.99:0/803649413 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f019018b4f0 0x7f019021f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:53.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.888+0000 7f018ea00640 1 -- 172.21.15.99:0/803649413 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0190173d50 con 0x7f019018b060 2024-02-21T23:08:53.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.889+0000 7f018f400640 1 --2- 172.21.15.99:0/803649413 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f019017f490 0x7f019021ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:08:53.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.889+0000 7f018ea00640 1 --2- 172.21.15.99:0/803649413 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f019018b060 0x7f01901750d0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f017c00e8a0 tx=0x7f017c00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:53.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.889+0000 7f0187400640 1 -- 172.21.15.99:0/803649413 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f017c017070 con 0x7f019018b060 2024-02-21T23:08:53.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.889+0000 7f0187400640 1 -- 172.21.15.99:0/803649413 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f017c00ee90 con 0x7f019018b060 2024-02-21T23:08:53.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.889+0000 7f0194c00640 1 -- 172.21.15.99:0/803649413 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0190174030 con 0x7f019018b060 2024-02-21T23:08:53.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.889+0000 7f0187400640 1 -- 172.21.15.99:0/803649413 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f017c00cb80 con 0x7f019018b060 2024-02-21T23:08:53.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.889+0000 7f0194c00640 1 -- 172.21.15.99:0/803649413 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01901745f0 con 0x7f019018b060 2024-02-21T23:08:53.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.893+0000 7f0187400640 1 -- 172.21.15.99:0/803649413 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f017c01a070 con 0x7f019018b060 2024-02-21T23:08:53.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.895+0000 7f0187400640 1 --2- 172.21.15.99:0/803649413 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f017009eed0 0x7f01700a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:53.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.895+0000 7f0187400640 1 -- 172.21.15.99:0/803649413 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f017c0c9fe0 con 0x7f019018b060 2024-02-21T23:08:53.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.895+0000 7f018f400640 1 --2- 172.21.15.99:0/803649413 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f017009eed0 0x7f01700a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:53.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.895+0000 7f01991c4740 1 Processor -- start 2024-02-21T23:08:53.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.896+0000 7f01991c4740 1 -- start start 2024-02-21T23:08:53.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.896+0000 7f018f400640 1 --2- 172.21.15.99:0/803649413 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f017009eed0 0x7f01700a1390 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0180036000 tx=0x7f018003b040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:53.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.897+0000 7f01991c4740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ba930b02a0 0x55ba930e5d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:53.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.897+0000 7f01991c4740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ba930e6260 0x55ba930b0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:53.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.897+0000 7f01991c4740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ba930b0bc0 0x55ba930731d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:53.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.897+0000 7f01991c4740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba92fdca90 con 0x55ba930e6260 2024-02-21T23:08:53.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.897+0000 7f01991c4740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba92f85b10 con 0x55ba930b02a0 2024-02-21T23:08:53.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.897+0000 7f01991c4740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba92fd8b30 con 0x55ba930b0bc0 2024-02-21T23:08:53.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.897+0000 7f018f400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ba930b02a0 0x55ba930e5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:53.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.897+0000 7f018f400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ba930b02a0 0x55ba930e5d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:59082/0 (socket says 172.21.15.99:59082) 2024-02-21T23:08:53.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.897+0000 7f018f400640 1 -- 172.21.15.99:0/3842480623 learned_addr learned my addr 172.21.15.99:0/3842480623 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:08:53.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.897+0000 7f018ea00640 1 --2- 172.21.15.99:0/3842480623 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ba930e6260 0x55ba930b0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:53.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.897+0000 7f018fe00640 1 --2- 172.21.15.99:0/3842480623 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ba930b0bc0 0x55ba930731d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:53.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.898+0000 7f018f400640 1 -- 172.21.15.99:0/3842480623 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ba930b0bc0 msgr2=0x55ba930731d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:53.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.898+0000 7f018f400640 1 --2- 172.21.15.99:0/3842480623 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ba930b0bc0 0x55ba930731d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:53.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.898+0000 7f018f400640 1 -- 172.21.15.99:0/3842480623 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ba930e6260 msgr2=0x55ba930b0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:53.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.898+0000 7f018f400640 1 --2- 172.21.15.99:0/3842480623 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ba930e6260 0x55ba930b0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:53.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.898+0000 7f018f400640 1 -- 172.21.15.99:0/3842480623 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ba92dbb7d0 con 0x55ba930b02a0 2024-02-21T23:08:53.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.898+0000 7f018f400640 1 --2- 172.21.15.99:0/3842480623 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ba930b02a0 0x55ba930e5d20 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f018002b980 tx=0x7f0180030000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4efdc6cdb217f786 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:53.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.898+0000 7f017b400640 1 -- 172.21.15.99:0/3842480623 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0180053070 con 0x55ba930b02a0 2024-02-21T23:08:53.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.898+0000 7f017b400640 1 -- 172.21.15.99:0/3842480623 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0180039d30 con 0x55ba930b02a0 2024-02-21T23:08:53.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.898+0000 7f017b400640 1 -- 172.21.15.99:0/3842480623 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0180034040 con 0x55ba930b02a0 2024-02-21T23:08:53.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.899+0000 7f01991c4740 1 -- 172.21.15.99:0/3842480623 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ba930b02a0 msgr2=0x55ba930e5d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:53.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.899+0000 7f01991c4740 1 --2- 172.21.15.99:0/3842480623 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ba930b02a0 0x55ba930e5d20 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f018002b980 tx=0x7f0180030000 comp rx=0 tx=0).stop 2024-02-21T23:08:53.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.899+0000 7f01991c4740 1 -- 172.21.15.99:0/3842480623 shutdown_connections 2024-02-21T23:08:53.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.899+0000 7f01991c4740 1 --2- 172.21.15.99:0/3842480623 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ba930b0bc0 0x55ba930731d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:53.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.899+0000 7f01991c4740 1 --2- 172.21.15.99:0/3842480623 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ba930e6260 0x55ba930b0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:53.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.899+0000 7f01991c4740 1 --2- 172.21.15.99:0/3842480623 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ba930b02a0 0x55ba930e5d20 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:53.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.899+0000 7f01991c4740 1 -- 172.21.15.99:0/3842480623 >> 172.21.15.99:0/3842480623 conn(0x55ba9303f6b0 msgr2=0x55ba93077190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:08:53.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.900+0000 7f01991c4740 1 -- 172.21.15.99:0/3842480623 shutdown_connections 2024-02-21T23:08:53.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.900+0000 7f01991c4740 1 -- 172.21.15.99:0/3842480623 wait complete. 2024-02-21T23:08:53.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.901+0000 7f01991c4740 1 -- start start 2024-02-21T23:08:53.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.901+0000 7f01991c4740 1 Processor -- start 2024-02-21T23:08:53.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.903+0000 7f01991c4740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ba930b02a0 0x55ba930e3b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:53.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.903+0000 7f01991c4740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ba930b0bc0 0x55ba930aaeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:53.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.904+0000 7f01991c4740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ba930e6260 0x55ba930e33a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:53.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.904+0000 7f01991c4740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba9307ef30 con 0x55ba930e6260 2024-02-21T23:08:53.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.904+0000 7f01991c4740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba92f7b1c0 con 0x55ba930b02a0 2024-02-21T23:08:53.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.904+0000 7f01991c4740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba930e7930 con 0x55ba930b0bc0 2024-02-21T23:08:53.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.904+0000 7f01991c4740 10 client.0 _ll_register_callbacks cb 0x55ba92f98930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:08:53.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.904+0000 7f018ea00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ba930b0bc0 0x55ba930aaeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:53.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.904+0000 7f018ea00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ba930b0bc0 0x55ba930aaeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:56022/0 (socket says 172.21.15.99:56022) 2024-02-21T23:08:53.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.904+0000 7f018ea00640 1 -- 172.21.15.99:0/1318627508 learned_addr learned my addr 172.21.15.99:0/1318627508 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:08:53.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.904+0000 7f018f400640 1 --2- 172.21.15.99:0/1318627508 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ba930b02a0 0x55ba930e3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:53.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.904+0000 7f018fe00640 1 --2- 172.21.15.99:0/1318627508 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ba930e6260 0x55ba930e33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:53.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.904+0000 7f018ea00640 1 -- 172.21.15.99:0/1318627508 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ba930b02a0 msgr2=0x55ba930e3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:53.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.904+0000 7f018ea00640 1 --2- 172.21.15.99:0/1318627508 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ba930b02a0 0x55ba930e3b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:53.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.904+0000 7f018ea00640 1 -- 172.21.15.99:0/1318627508 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ba930e6260 msgr2=0x55ba930e33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:53.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.904+0000 7f018ea00640 1 --2- 172.21.15.99:0/1318627508 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ba930e6260 0x55ba930e33a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:53.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.904+0000 7f018ea00640 1 -- 172.21.15.99:0/1318627508 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ba92cf13f0 con 0x55ba930b0bc0 2024-02-21T23:08:53.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.904+0000 7f018f400640 1 --2- 172.21.15.99:0/1318627508 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ba930b02a0 0x55ba930e3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:08:53.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.905+0000 7f018ea00640 1 --2- 172.21.15.99:0/1318627508 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ba930b0bc0 0x55ba930aaeb0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f017c0978c0 tx=0x7f017c09bb10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de294500d640e9a9 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:53.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.905+0000 7f016fe00640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-02-21T23:08:53.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.905+0000 7f016fe00640 1 -- 172.21.15.99:0/1318627508 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f017c0b4060 con 0x55ba930b0bc0 2024-02-21T23:08:53.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.905+0000 7f01991c4740 1 -- 172.21.15.99:0/1318627508 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0180039d30 con 0x55ba930b0bc0 2024-02-21T23:08:53.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.905+0000 7f016fe00640 1 -- 172.21.15.99:0/1318627508 <== mon.2 v2:172.21.15.181:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f017c098db0 con 0x55ba930b0bc0 2024-02-21T23:08:53.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.905+0000 7f016fe00640 1 -- 172.21.15.99:0/1318627508 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f017c021040 con 0x55ba930b0bc0 2024-02-21T23:08:53.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.905+0000 7f01991c4740 10 client.6506 fetch_fsmap learned FSMap version 17 2024-02-21T23:08:53.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.905+0000 7f01991c4740 1 -- 172.21.15.99:0/1318627508 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55ba92cb10f0 con 0x55ba930b0bc0 2024-02-21T23:08:53.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.905+0000 7f016fe00640 1 -- 172.21.15.99:0/1318627508 <== mon.2 v2:172.21.15.181:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0180039d30 con 0x55ba930b0bc0 2024-02-21T23:08:53.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.905+0000 7f016fe00640 1 -- 172.21.15.99:0/1318627508 <== mon.2 v2:172.21.15.181:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f017c0af170 con 0x55ba930b0bc0 2024-02-21T23:08:53.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.906+0000 7f01991c4740 10 client.6506 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:08:53.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.906+0000 7f01991c4740 10 client.6506 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:08:53.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.906+0000 7f01991c4740 20 client.6506 populate_metadata read hostname 'smithi099' 2024-02-21T23:08:53.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.906+0000 7f01991c4740 1 --2- 172.21.15.99:0/1318627508 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55ba930afbf0 0x55ba930aee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:53.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.906+0000 7f01991c4740 4 client.6506 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:08:53.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.906+0000 7f01991c4740 1 -- 172.21.15.99:0/1318627508 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ba92fe9fd0 con 0x55ba930afbf0 2024-02-21T23:08:53.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.906+0000 7f018f400640 1 --2- 172.21.15.99:0/1318627508 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55ba930afbf0 0x55ba930aee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:53.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.907+0000 7f016fe00640 10 client.6506 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:08:53.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.907+0000 7f018f400640 1 --2- 172.21.15.99:0/1318627508 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55ba930afbf0 0x55ba930aee00 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60b51e79a2f4a710 server_cookie=acb43136a147db98 in_seq=0 out_seq=0 2024-02-21T23:08:53.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.908+0000 7f016fe00640 1 -- 172.21.15.99:0/1318627508 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55ba92fe9fd0 con 0x55ba930afbf0 2024-02-21T23:08:53.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.908+0000 7f016fe00640 10 client.6506 handle_command_reply: tid=0 2024-02-21T23:08:53.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.908+0000 7f01991c4740 1 client.6506 shutdown 2024-02-21T23:08:53.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.908+0000 7f01991c4740 1 -- 172.21.15.99:0/1318627508 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ba930b0bc0 msgr2=0x55ba930aaeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:53.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.908+0000 7f01991c4740 1 --2- 172.21.15.99:0/1318627508 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ba930b0bc0 0x55ba930aaeb0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f017c0978c0 tx=0x7f017c09bb10 comp rx=0 tx=0).stop 2024-02-21T23:08:53.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.908+0000 7f01991c4740 1 -- 172.21.15.99:0/1318627508 shutdown_connections 2024-02-21T23:08:53.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.908+0000 7f01991c4740 1 --2- 172.21.15.99:0/1318627508 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55ba930afbf0 0x55ba930aee00 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:53.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.908+0000 7f01991c4740 1 --2- 172.21.15.99:0/1318627508 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ba930e6260 0x55ba930e33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:53.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.908+0000 7f01991c4740 1 --2- 172.21.15.99:0/1318627508 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ba930b0bc0 0x55ba930aaeb0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:53.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.908+0000 7f01991c4740 1 --2- 172.21.15.99:0/1318627508 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ba930b02a0 0x55ba930e3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:53.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.908+0000 7f01991c4740 1 -- 172.21.15.99:0/1318627508 >> 172.21.15.99:0/1318627508 conn(0x55ba9303f6b0 msgr2=0x55ba93077b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:08:53.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.908+0000 7f016fe00640 0 client.6506 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:08:53.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.908+0000 7f01991c4740 1 -- 172.21.15.99:0/1318627508 shutdown_connections 2024-02-21T23:08:53.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.908+0000 7f01991c4740 1 -- 172.21.15.99:0/1318627508 wait complete. 2024-02-21T23:08:53.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.909+0000 7f01991c4740 20 client.6506 trim_cache size 0 max 16384 2024-02-21T23:08:53.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.943+0000 7f01991c4740 1 Processor -- start 2024-02-21T23:08:53.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.943+0000 7f01991c4740 1 -- start start 2024-02-21T23:08:53.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.945+0000 7f01991c4740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ba930b02a0 0x55ba930748f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:53.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.945+0000 7f01991c4740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ba930b0bc0 0x55ba930e1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:53.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.945+0000 7f01991c4740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ba930e6260 0x55ba930e31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:53.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.945+0000 7f01991c4740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f019022c980 con 0x55ba930b02a0 2024-02-21T23:08:53.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.945+0000 7f01991c4740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f019022a520 con 0x55ba930b0bc0 2024-02-21T23:08:53.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.945+0000 7f01991c4740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0190168820 con 0x55ba930e6260 2024-02-21T23:08:53.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.945+0000 7f018f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ba930b02a0 0x55ba930748f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:53.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.945+0000 7f018ea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ba930b0bc0 0x55ba930e1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:53.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.945+0000 7f018f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ba930b02a0 0x55ba930748f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52916/0 (socket says 172.21.15.99:52916) 2024-02-21T23:08:53.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.945+0000 7f018f400640 1 -- 172.21.15.99:0/3229690470 learned_addr learned my addr 172.21.15.99:0/3229690470 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:08:53.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.945+0000 7f018ea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ba930b0bc0 0x55ba930e1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:59092/0 (socket says 172.21.15.99:59092) 2024-02-21T23:08:53.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.945+0000 7f018fe00640 1 --2- 172.21.15.99:0/3229690470 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ba930e6260 0x55ba930e31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:53.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.945+0000 7f018f400640 1 -- 172.21.15.99:0/3229690470 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ba930e6260 msgr2=0x55ba930e31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:53.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.946+0000 7f018f400640 1 --2- 172.21.15.99:0/3229690470 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ba930e6260 0x55ba930e31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:53.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.946+0000 7f018f400640 1 -- 172.21.15.99:0/3229690470 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ba930b0bc0 msgr2=0x55ba930e1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:53.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.946+0000 7f018f400640 1 --2- 172.21.15.99:0/3229690470 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ba930b0bc0 0x55ba930e1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:53.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.946+0000 7f018f400640 1 -- 172.21.15.99:0/3229690470 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ba930b09f0 con 0x55ba930b02a0 2024-02-21T23:08:53.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.946+0000 7f018ea00640 1 --2- 172.21.15.99:0/3229690470 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ba930b0bc0 0x55ba930e1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:08:53.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.946+0000 7f018f400640 1 --2- 172.21.15.99:0/3229690470 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ba930b02a0 0x55ba930748f0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f0180009930 tx=0x7f0180009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=658a3551133d8cd0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:53.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.946+0000 7f017aa00640 1 -- 172.21.15.99:0/3229690470 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0180034040 con 0x55ba930b02a0 2024-02-21T23:08:53.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.946+0000 7f017aa00640 1 -- 172.21.15.99:0/3229690470 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f018005e070 con 0x55ba930b02a0 2024-02-21T23:08:53.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.946+0000 7f017aa00640 1 -- 172.21.15.99:0/3229690470 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0180053040 con 0x55ba930b02a0 2024-02-21T23:08:53.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.947+0000 7f01991c4740 1 -- 172.21.15.99:0/3229690470 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ba930b02a0 msgr2=0x55ba930748f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:53.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.947+0000 7f01991c4740 1 --2- 172.21.15.99:0/3229690470 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ba930b02a0 0x55ba930748f0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f0180009930 tx=0x7f0180009240 comp rx=0 tx=0).stop 2024-02-21T23:08:53.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.947+0000 7f01991c4740 1 -- 172.21.15.99:0/3229690470 shutdown_connections 2024-02-21T23:08:53.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.947+0000 7f01991c4740 1 --2- 172.21.15.99:0/3229690470 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ba930e6260 0x55ba930e31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:53.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.947+0000 7f01991c4740 1 --2- 172.21.15.99:0/3229690470 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ba930b0bc0 0x55ba930e1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:53.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.947+0000 7f01991c4740 1 --2- 172.21.15.99:0/3229690470 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ba930b02a0 0x55ba930748f0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:53.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.947+0000 7f01991c4740 1 -- 172.21.15.99:0/3229690470 >> 172.21.15.99:0/3229690470 conn(0x55ba9303f6b0 msgr2=0x55ba930addc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:08:53.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.947+0000 7f01991c4740 1 -- 172.21.15.99:0/3229690470 shutdown_connections 2024-02-21T23:08:53.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.947+0000 7f01991c4740 1 -- 172.21.15.99:0/3229690470 wait complete. 2024-02-21T23:08:53.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.948+0000 7f01991c4740 1 -- start start 2024-02-21T23:08:53.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.948+0000 7f01991c4740 1 Processor -- start 2024-02-21T23:08:53.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.949+0000 7f01991c4740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ba930b02a0 0x55ba930f47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:53.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.949+0000 7f01991c4740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ba930b0bc0 0x55ba9307ec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:53.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.949+0000 7f01991c4740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ba930e6260 0x55ba930e4960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:53.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.949+0000 7f01991c4740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0190228c80 con 0x55ba930b02a0 2024-02-21T23:08:53.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.949+0000 7f01991c4740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0190229ec0 con 0x55ba930e6260 2024-02-21T23:08:53.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.949+0000 7f01991c4740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0190229280 con 0x55ba930b0bc0 2024-02-21T23:08:53.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.949+0000 7f01991c4740 10 client.0 _ll_register_callbacks cb 0x7f017c0979a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:08:53.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.950+0000 7f018f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ba930b02a0 0x55ba930f47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:53.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.950+0000 7f018f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ba930b02a0 0x55ba930f47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52922/0 (socket says 172.21.15.99:52922) 2024-02-21T23:08:53.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.950+0000 7f018f400640 1 -- 172.21.15.99:0/3865489215 learned_addr learned my addr 172.21.15.99:0/3865489215 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:08:53.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.950+0000 7f018ea00640 1 --2- 172.21.15.99:0/3865489215 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ba930b0bc0 0x55ba9307ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:53.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.950+0000 7f018fe00640 1 --2- 172.21.15.99:0/3865489215 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ba930e6260 0x55ba930e4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:53.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.950+0000 7f018f400640 1 -- 172.21.15.99:0/3865489215 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ba930b0bc0 msgr2=0x55ba9307ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:53.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.950+0000 7f018f400640 1 --2- 172.21.15.99:0/3865489215 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ba930b0bc0 0x55ba9307ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:53.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.950+0000 7f018f400640 1 -- 172.21.15.99:0/3865489215 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ba930e6260 msgr2=0x55ba930e4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:53.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.950+0000 7f018f400640 1 --2- 172.21.15.99:0/3865489215 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ba930e6260 0x55ba930e4960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:53.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.950+0000 7f018f400640 1 -- 172.21.15.99:0/3865489215 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ba9315f900 con 0x55ba930b02a0 2024-02-21T23:08:53.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.950+0000 7f018fe00640 1 --2- 172.21.15.99:0/3865489215 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ba930e6260 0x55ba930e4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:08:53.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.950+0000 7f018ea00640 1 --2- 172.21.15.99:0/3865489215 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ba930b0bc0 0x55ba9307ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:08:53.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.950+0000 7f018f400640 1 --2- 172.21.15.99:0/3865489215 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ba930b02a0 0x55ba930f47d0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x55ba930ea920 tx=0x7f0180004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0a0e55943e188ae server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:53.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.950+0000 7f016fe00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:08:53.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.951+0000 7f016fe00640 1 -- 172.21.15.99:0/3865489215 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0180053040 con 0x55ba930b02a0 2024-02-21T23:08:53.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.951+0000 7f016fe00640 1 -- 172.21.15.99:0/3865489215 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f0180039cb0 con 0x55ba930b02a0 2024-02-21T23:08:53.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.951+0000 7f01991c4740 1 -- 172.21.15.99:0/3865489215 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f018005e070 con 0x55ba930b02a0 2024-02-21T23:08:53.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.951+0000 7f016fe00640 1 -- 172.21.15.99:0/3865489215 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0180070050 con 0x55ba930b02a0 2024-02-21T23:08:53.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.951+0000 7f01991c4740 10 client.6393 fetch_fsmap learned FSMap version 17 2024-02-21T23:08:53.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.951+0000 7f01991c4740 1 -- 172.21.15.99:0/3865489215 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55ba93160200 con 0x55ba930b02a0 2024-02-21T23:08:53.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.951+0000 7f016fe00640 1 -- 172.21.15.99:0/3865489215 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f018005e070 con 0x55ba930b02a0 2024-02-21T23:08:53.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.951+0000 7f016fe00640 1 -- 172.21.15.99:0/3865489215 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f0180056030 con 0x55ba930b02a0 2024-02-21T23:08:53.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.952+0000 7f01991c4740 10 client.6393 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:08:53.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.952+0000 7f01991c4740 10 client.6393 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:08:53.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.952+0000 7f01991c4740 20 client.6393 populate_metadata read hostname 'smithi099' 2024-02-21T23:08:53.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.952+0000 7f01991c4740 1 --2- 172.21.15.99:0/3865489215 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55ba930eaff0 0x55ba930aee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:53.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.952+0000 7f01991c4740 4 client.6393 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T23:08:53.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.952+0000 7f01991c4740 1 -- 172.21.15.99:0/3865489215 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55ba92fe4320 con 0x55ba930eaff0 2024-02-21T23:08:53.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.952+0000 7f018ea00640 1 --2- 172.21.15.99:0/3865489215 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55ba930eaff0 0x55ba930aee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:53.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.952+0000 7f018ea00640 1 --2- 172.21.15.99:0/3865489215 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55ba930eaff0 0x55ba930aee00 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13338fecef8e36db server_cookie=59218055e85c7ce2 in_seq=0 out_seq=0 2024-02-21T23:08:53.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.952+0000 7f016fe00640 10 client.6393 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:08:53.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.953+0000 7f016fe00640 1 -- 172.21.15.99:0/3865489215 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55ba92fe4320 con 0x55ba930eaff0 2024-02-21T23:08:53.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.953+0000 7f016fe00640 10 client.6393 handle_command_reply: tid=0 2024-02-21T23:08:53.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.953+0000 7f01991c4740 1 client.6393 shutdown 2024-02-21T23:08:53.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.953+0000 7f01991c4740 1 -- 172.21.15.99:0/3865489215 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ba930b02a0 msgr2=0x55ba930f47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:53.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.953+0000 7f01991c4740 1 --2- 172.21.15.99:0/3865489215 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ba930b02a0 0x55ba930f47d0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x55ba930ea920 tx=0x7f0180004730 comp rx=0 tx=0).stop 2024-02-21T23:08:53.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.953+0000 7f01991c4740 1 -- 172.21.15.99:0/3865489215 shutdown_connections 2024-02-21T23:08:53.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.953+0000 7f01991c4740 1 --2- 172.21.15.99:0/3865489215 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55ba930eaff0 0x55ba930aee00 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:53.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.953+0000 7f01991c4740 1 --2- 172.21.15.99:0/3865489215 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ba930e6260 0x55ba930e4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:53.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.953+0000 7f01991c4740 1 --2- 172.21.15.99:0/3865489215 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ba930b0bc0 0x55ba9307ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:53.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.953+0000 7f01991c4740 1 --2- 172.21.15.99:0/3865489215 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ba930b02a0 0x55ba930f47d0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:53.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.953+0000 7f016fe00640 0 client.6393 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:08:53.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.953+0000 7f01991c4740 1 -- 172.21.15.99:0/3865489215 >> 172.21.15.99:0/3865489215 conn(0x55ba9303f6b0 msgr2=0x55ba9307d4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:08:53.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.953+0000 7f01991c4740 1 -- 172.21.15.99:0/3865489215 shutdown_connections 2024-02-21T23:08:53.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.953+0000 7f01991c4740 1 -- 172.21.15.99:0/3865489215 wait complete. 2024-02-21T23:08:53.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.954+0000 7f01991c4740 20 client.6393 trim_cache size 0 max 16384 2024-02-21T23:08:53.950 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-02-21T23:08:53.950 INFO:teuthology.orchestra.run.smithi099.stdout: "status": "no active scrubs running", 2024-02-21T23:08:53.950 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubs": {} 2024-02-21T23:08:53.950 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-02-21T23:08:53.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.954+0000 7f0194c00640 1 -- 172.21.15.99:0/803649413 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f017009eed0 msgr2=0x7f01700a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:53.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.954+0000 7f0194c00640 1 --2- 172.21.15.99:0/803649413 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f017009eed0 0x7f01700a1390 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0180036000 tx=0x7f018003b040 comp rx=0 tx=0).stop 2024-02-21T23:08:53.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.954+0000 7f0194c00640 1 -- 172.21.15.99:0/803649413 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f019018b060 msgr2=0x7f01901750d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:53.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.954+0000 7f0194c00640 1 --2- 172.21.15.99:0/803649413 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f019018b060 0x7f01901750d0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f017c00e8a0 tx=0x7f017c00ed60 comp rx=0 tx=0).stop 2024-02-21T23:08:53.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.954+0000 7f0194c00640 1 -- 172.21.15.99:0/803649413 shutdown_connections 2024-02-21T23:08:53.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.954+0000 7f0194c00640 1 --2- 172.21.15.99:0/803649413 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f017009eed0 0x7f01700a1390 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:53.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.955+0000 7f0194c00640 1 --2- 172.21.15.99:0/803649413 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f019018b4f0 0x7f019021f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:53.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.955+0000 7f0194c00640 1 --2- 172.21.15.99:0/803649413 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f019018b060 0x7f01901750d0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:53.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.955+0000 7f0194c00640 1 --2- 172.21.15.99:0/803649413 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f019017f490 0x7f019021ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:53.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.955+0000 7f0194c00640 1 -- 172.21.15.99:0/803649413 >> 172.21.15.99:0/803649413 conn(0x7f01900d29b0 msgr2=0x7f0190185d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:08:53.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.955+0000 7f0194c00640 1 -- 172.21.15.99:0/803649413 shutdown_connections 2024-02-21T23:08:53.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:53.955+0000 7f0194c00640 1 -- 172.21.15.99:0/803649413 wait complete. 2024-02-21T23:08:53.961 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-02-21T23:08:53.962 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T23:08:54.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.184+0000 7f6676000640 1 Processor -- start 2024-02-21T23:08:54.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.185+0000 7f6676000640 1 -- start start 2024-02-21T23:08:54.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.186+0000 7f6676000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f6670182a80 0x7f667018a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:54.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.187+0000 7f6676000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f667018a600 con 0x7f667018b980 2024-02-21T23:08:54.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.187+0000 7f6676000640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f667018a8e0 con 0x7f66700719b0 2024-02-21T23:08:54.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.187+0000 7f6676000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f667018abc0 con 0x7f6670182a80 2024-02-21T23:08:54.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.187+0000 7f666fe00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f667018b980 0x7f6670186a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.99:39992/0 (socket says 172.21.15.99:39992) 2024-02-21T23:08:54.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.187+0000 7f666fe00640 1 -- 172.21.15.99:0/2287187257 learned_addr learned my addr 172.21.15.99:0/2287187257 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:08:54.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.187+0000 7f6674c00640 1 --2- 172.21.15.99:0/2287187257 >> v2:172.21.15.162:3300/0 conn(0x7f6670182a80 0x7f667018a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:54.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.187+0000 7f666f400640 1 -- 172.21.15.99:0/2287187257 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1281480407 0 0) 0x7f667018a600 con 0x7f667018b980 2024-02-21T23:08:54.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.188+0000 7f666f400640 1 -- 172.21.15.99:0/2287187257 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6658003520 con 0x7f667018b980 2024-02-21T23:08:54.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.188+0000 7f666f400640 1 -- 172.21.15.99:0/2287187257 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 775884817 0 0) 0x7f667018a8e0 con 0x7f66700719b0 2024-02-21T23:08:54.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.188+0000 7f6674c00640 1 -- 172.21.15.99:0/2287187257 >> v1:172.21.15.181:6789/0 conn(0x7f66700719b0 legacy=0x7f6670071e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:54.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.188+0000 7f6674c00640 1 -- 172.21.15.99:0/2287187257 >> v1:172.21.15.162:6789/0 conn(0x7f667018b980 legacy=0x7f6670186a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:54.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.188+0000 7f6674c00640 1 -- 172.21.15.99:0/2287187257 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f667018aea0 con 0x7f6670182a80 2024-02-21T23:08:54.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.189+0000 7f6674c00640 1 --2- 172.21.15.99:0/2287187257 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6670182a80 0x7f667018a010 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f66640097a0 tx=0x7f666402b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74127ed78442b019 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:54.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.190+0000 7f666f400640 1 -- 172.21.15.99:0/2287187257 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66640315a0 con 0x7f6670182a80 2024-02-21T23:08:54.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.190+0000 7f666f400640 1 -- 172.21.15.99:0/2287187257 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6664037070 con 0x7f6670182a80 2024-02-21T23:08:54.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.190+0000 7f666f400640 1 -- 172.21.15.99:0/2287187257 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6664031940 con 0x7f6670182a80 2024-02-21T23:08:54.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.190+0000 7f6676000640 1 -- 172.21.15.99:0/2287187257 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6670182a80 msgr2=0x7f667018a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:54.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.191+0000 7f6676000640 1 --2- 172.21.15.99:0/2287187257 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6670182a80 0x7f667018a010 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f66640097a0 tx=0x7f666402b840 comp rx=0 tx=0).stop 2024-02-21T23:08:54.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.191+0000 7f6676000640 1 -- 172.21.15.99:0/2287187257 shutdown_connections 2024-02-21T23:08:54.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.191+0000 7f6676000640 1 --2- 172.21.15.99:0/2287187257 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6670182a80 0x7f667018a010 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:54.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.191+0000 7f6676000640 1 -- 172.21.15.99:0/2287187257 >> 172.21.15.99:0/2287187257 conn(0x7f66700d29f0 msgr2=0x7f66700d2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:08:54.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.191+0000 7f6676000640 1 -- 172.21.15.99:0/2287187257 shutdown_connections 2024-02-21T23:08:54.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.191+0000 7f6676000640 1 -- 172.21.15.99:0/2287187257 wait complete. 2024-02-21T23:08:54.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.194+0000 7f6676000640 1 Processor -- start 2024-02-21T23:08:54.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.194+0000 7f6676000640 1 -- start start 2024-02-21T23:08:54.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.196+0000 7f6676000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66700719b0 0x7f667017c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:54.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.196+0000 7f6676000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6670182a80 0x7f6670072320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:54.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.196+0000 7f6676000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f667018b980 0x7f667021fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:54.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.196+0000 7f6676000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f667018be00 con 0x7f6670182a80 2024-02-21T23:08:54.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.196+0000 7f6676000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f667018b460 con 0x7f66700719b0 2024-02-21T23:08:54.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.196+0000 7f6676000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6670182e60 con 0x7f667018b980 2024-02-21T23:08:54.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.197+0000 7f666fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6670182a80 0x7f6670072320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:54.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.197+0000 7f6674c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66700719b0 0x7f667017c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:54.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.197+0000 7f666fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6670182a80 0x7f6670072320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52930/0 (socket says 172.21.15.99:52930) 2024-02-21T23:08:54.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.197+0000 7f666fe00640 1 -- 172.21.15.99:0/4153664436 learned_addr learned my addr 172.21.15.99:0/4153664436 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:08:54.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.197+0000 7f6675600640 1 --2- 172.21.15.99:0/4153664436 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f667018b980 0x7f667021fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:54.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.197+0000 7f6674c00640 1 -- 172.21.15.99:0/4153664436 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f667018b980 msgr2=0x7f667021fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:54.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.197+0000 7f6674c00640 1 --2- 172.21.15.99:0/4153664436 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f667018b980 0x7f667021fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:54.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.197+0000 7f6674c00640 1 -- 172.21.15.99:0/4153664436 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6670182a80 msgr2=0x7f6670072320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:54.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.197+0000 7f6674c00640 1 --2- 172.21.15.99:0/4153664436 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6670182a80 0x7f6670072320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:54.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.197+0000 7f6674c00640 1 -- 172.21.15.99:0/4153664436 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66700f9580 con 0x7f66700719b0 2024-02-21T23:08:54.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.197+0000 7f666fe00640 1 --2- 172.21.15.99:0/4153664436 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6670182a80 0x7f6670072320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:08:54.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.198+0000 7f6674c00640 1 --2- 172.21.15.99:0/4153664436 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66700719b0 0x7f667017c500 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f6664033000 tx=0x7f66640046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:54.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.198+0000 7f666cc00640 1 -- 172.21.15.99:0/4153664436 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6664032840 con 0x7f66700719b0 2024-02-21T23:08:54.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.198+0000 7f666cc00640 1 -- 172.21.15.99:0/4153664436 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6664032a00 con 0x7f66700719b0 2024-02-21T23:08:54.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.198+0000 7f666cc00640 1 -- 172.21.15.99:0/4153664436 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6664032df0 con 0x7f66700719b0 2024-02-21T23:08:54.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.198+0000 7f6676000640 1 -- 172.21.15.99:0/4153664436 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66700f9860 con 0x7f66700719b0 2024-02-21T23:08:54.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.198+0000 7f6676000640 1 -- 172.21.15.99:0/4153664436 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66700f9e20 con 0x7f66700719b0 2024-02-21T23:08:54.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.199+0000 7f6676000640 1 -- 172.21.15.99:0/4153664436 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6670068320 con 0x7f66700719b0 2024-02-21T23:08:54.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.201+0000 7f666cc00640 1 -- 172.21.15.99:0/4153664436 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f666404e470 con 0x7f66700719b0 2024-02-21T23:08:54.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.203+0000 7f666cc00640 1 --2- 172.21.15.99:0/4153664436 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f665009eed0 0x7f66500a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:54.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.203+0000 7f666cc00640 1 -- 172.21.15.99:0/4153664436 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f666402f030 con 0x7f66700719b0 2024-02-21T23:08:54.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.203+0000 7f666fe00640 1 --2- 172.21.15.99:0/4153664436 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f665009eed0 0x7f66500a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:54.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.204+0000 7f666fe00640 1 --2- 172.21.15.99:0/4153664436 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f665009eed0 0x7f66500a1390 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6670182350 tx=0x7f665c009040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:54.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.205+0000 7f666cc00640 1 -- 172.21.15.99:0/4153664436 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f6664040070 con 0x7f66700719b0 2024-02-21T23:08:54.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.515+0000 7f6676000640 1 -- 172.21.15.99:0/4153664436 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f66700f8850 con 0x7f66700719b0 2024-02-21T23:08:54.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.516+0000 7f666cc00640 1 -- 172.21.15.99:0/4153664436 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+11335 (secure 0 0 0) 0x7f6664031e90 con 0x7f66700719b0 2024-02-21T23:08:54.506 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T23:08:54.506 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4307,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/3514452812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3514452812},{"type":"v1","addr":"172.21.15.162:6836","nonce":3514452812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4312,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6838/2169982089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":2169982089},{"type":"v1","addr":"172.21.15.162:6838","nonce":2169982089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4315,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6839/3335972724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6837","nonce":3335972724},{"type":"v1","addr":"172.21.15.162:6839","nonce":3335972724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4318,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6841/2135456697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6840","nonce":2135456697},{"type":"v1","addr":"172.21.15.162:6841","nonce":2135456697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4325,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2452242758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2452242758},{"type":"v1","addr":"172.21.15.181:6833","nonce":2452242758}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4328,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6836/2751486400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":2751486400},{"type":"v1","addr":"172.21.15.181:6836","nonce":2751486400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":17,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-21T23:01:02.656130+0000","modified":"2024-02-21T23:07:03.165223+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4355,"mds_1":4352,"mds_2":4348},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4331":{"gid":4331,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6838/3728901330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6835","nonce":3728901330},{"type":"v1","addr":"172.21.15.181:6838","nonce":3728901330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4339":{"gid":4339,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6839/3357929641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6837","nonce":3357929641},{"type":"v1","addr":"172.21.15.181:6839","nonce":3357929641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4343":{"gid":4343,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6833/2793485078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":2793485078},{"type":"v1","addr":"172.21.15.99:6833","nonce":2793485078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4348":{"gid":4348,"name":"d","rank":2,"incarnation":12,"state":"up:active","state_seq":10,"addr":"172.21.15.99:6835/2243461688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2243461688},{"type":"v1","addr":"172.21.15.99:6835","nonce":2243461688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4352":{"gid":4352,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.99:6837/1676159950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":1676159950},{"type":"v1","addr":"172.21.15.99:6837","nonce":1676159950}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4355":{"gid":4355,"name":"j","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6839/4239008786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":4239008786},{"type":"v1","addr":"172.21.15.99:6839","nonce":4239008786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-21T23:08:54.507 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 17 2024-02-21T23:08:54.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.518+0000 7f6676000640 1 -- 172.21.15.99:0/4153664436 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f665009eed0 msgr2=0x7f66500a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:54.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.518+0000 7f6676000640 1 --2- 172.21.15.99:0/4153664436 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f665009eed0 0x7f66500a1390 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6670182350 tx=0x7f665c009040 comp rx=0 tx=0).stop 2024-02-21T23:08:54.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.518+0000 7f6676000640 1 -- 172.21.15.99:0/4153664436 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66700719b0 msgr2=0x7f667017c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:54.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.518+0000 7f6676000640 1 --2- 172.21.15.99:0/4153664436 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66700719b0 0x7f667017c500 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f6664033000 tx=0x7f66640046c0 comp rx=0 tx=0).stop 2024-02-21T23:08:54.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.519+0000 7f6676000640 1 -- 172.21.15.99:0/4153664436 shutdown_connections 2024-02-21T23:08:54.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.519+0000 7f6676000640 1 --2- 172.21.15.99:0/4153664436 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f665009eed0 0x7f66500a1390 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:54.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.519+0000 7f6676000640 1 --2- 172.21.15.99:0/4153664436 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f667018b980 0x7f667021fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:54.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.519+0000 7f6676000640 1 --2- 172.21.15.99:0/4153664436 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6670182a80 0x7f6670072320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:54.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.519+0000 7f6676000640 1 --2- 172.21.15.99:0/4153664436 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66700719b0 0x7f667017c500 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:54.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.519+0000 7f6676000640 1 -- 172.21.15.99:0/4153664436 >> 172.21.15.99:0/4153664436 conn(0x7f66700d29f0 msgr2=0x7f66700d2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:08:54.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.519+0000 7f6676000640 1 -- 172.21.15.99:0/4153664436 shutdown_connections 2024-02-21T23:08:54.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.519+0000 7f6676000640 1 -- 172.21.15.99:0/4153664436 wait complete. 2024-02-21T23:08:54.532 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T23:08:54.533 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-02-21T23:08:54.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.774+0000 7f2954200640 1 Processor -- start 2024-02-21T23:08:54.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.774+0000 7f2954200640 1 -- start start 2024-02-21T23:08:54.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.776+0000 7f2954200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f294c06e910 0x7f294c0cb420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:54.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.776+0000 7f2954200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f294c06ee40 con 0x7f294c180c80 2024-02-21T23:08:54.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.776+0000 7f2954200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f294c06f120 con 0x7f294c0701c0 2024-02-21T23:08:54.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.776+0000 7f2954200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f294c06f400 con 0x7f294c06e910 2024-02-21T23:08:54.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.776+0000 7f2951800640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f294c180c80 0x7f294c187f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:56124/0 (socket says 172.21.15.99:56124) 2024-02-21T23:08:54.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.776+0000 7f2951800640 1 -- 172.21.15.99:0/4085161358 learned_addr learned my addr 172.21.15.99:0/4085161358 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:08:54.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.776+0000 7f2950e00640 1 --2- 172.21.15.99:0/4085161358 >> v2:172.21.15.99:3300/0 conn(0x7f294c06e910 0x7f294c0cb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:54.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.777+0000 7f294be00640 1 -- 172.21.15.99:0/4085161358 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1826001078 0 0) 0x7f294c06ee40 con 0x7f294c180c80 2024-02-21T23:08:54.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.777+0000 7f2950e00640 1 -- 172.21.15.99:0/4085161358 >> v1:172.21.15.162:6789/0 conn(0x7f294c0701c0 legacy=0x7f294c0cb960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:54.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.777+0000 7f2950e00640 1 -- 172.21.15.99:0/4085161358 >> v1:172.21.15.99:6789/0 conn(0x7f294c180c80 legacy=0x7f294c187f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:54.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.777+0000 7f2950e00640 1 -- 172.21.15.99:0/4085161358 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f294c06f6e0 con 0x7f294c06e910 2024-02-21T23:08:54.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.778+0000 7f2950e00640 1 --2- 172.21.15.99:0/4085161358 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f294c06e910 0x7f294c0cb420 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f2938009720 tx=0x7f293802b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ac4f19d8493da53 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:54.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.778+0000 7f294be00640 1 -- 172.21.15.99:0/4085161358 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2938037070 con 0x7f294c06e910 2024-02-21T23:08:54.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.778+0000 7f294be00640 1 -- 172.21.15.99:0/4085161358 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2938030710 con 0x7f294c06e910 2024-02-21T23:08:54.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.778+0000 7f294be00640 1 -- 172.21.15.99:0/4085161358 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2938030ae0 con 0x7f294c06e910 2024-02-21T23:08:54.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.779+0000 7f2954200640 1 -- 172.21.15.99:0/4085161358 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f294c06e910 msgr2=0x7f294c0cb420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:54.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.779+0000 7f2954200640 1 --2- 172.21.15.99:0/4085161358 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f294c06e910 0x7f294c0cb420 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f2938009720 tx=0x7f293802b6a0 comp rx=0 tx=0).stop 2024-02-21T23:08:54.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.779+0000 7f2954200640 1 -- 172.21.15.99:0/4085161358 shutdown_connections 2024-02-21T23:08:54.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.779+0000 7f2954200640 1 --2- 172.21.15.99:0/4085161358 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f294c06e910 0x7f294c0cb420 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:54.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.779+0000 7f2954200640 1 -- 172.21.15.99:0/4085161358 >> 172.21.15.99:0/4085161358 conn(0x7f294c0ce5f0 msgr2=0x7f294c0cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:08:54.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.779+0000 7f2954200640 1 -- 172.21.15.99:0/4085161358 shutdown_connections 2024-02-21T23:08:54.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.779+0000 7f2954200640 1 -- 172.21.15.99:0/4085161358 wait complete. 2024-02-21T23:08:54.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.782+0000 7f2954200640 1 Processor -- start 2024-02-21T23:08:54.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.783+0000 7f2954200640 1 -- start start 2024-02-21T23:08:54.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.785+0000 7f2954200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f294c06e910 0x7f294c21c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:54.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.785+0000 7f2954200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f294c0701c0 0x7f294c0d08e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:54.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.785+0000 7f2954200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f294c180c80 0x7f294c16ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:54.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.785+0000 7f2954200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f294c188610 con 0x7f294c06e910 2024-02-21T23:08:54.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.785+0000 7f2954200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f294c06fca0 con 0x7f294c0701c0 2024-02-21T23:08:54.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.785+0000 7f2954200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f294c0f5f50 con 0x7f294c180c80 2024-02-21T23:08:54.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.785+0000 7f2951800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f294c06e910 0x7f294c21c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:54.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.785+0000 7f2951800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f294c06e910 0x7f294c21c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52944/0 (socket says 172.21.15.99:52944) 2024-02-21T23:08:54.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.785+0000 7f2951800640 1 -- 172.21.15.99:0/3953629560 learned_addr learned my addr 172.21.15.99:0/3953629560 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:08:54.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.785+0000 7f2950e00640 1 --2- 172.21.15.99:0/3953629560 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f294c0701c0 0x7f294c0d08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:54.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.785+0000 7f2952200640 1 --2- 172.21.15.99:0/3953629560 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f294c180c80 0x7f294c16ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:54.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.785+0000 7f2951800640 1 -- 172.21.15.99:0/3953629560 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f294c180c80 msgr2=0x7f294c16ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:54.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.785+0000 7f2951800640 1 --2- 172.21.15.99:0/3953629560 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f294c180c80 0x7f294c16ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:54.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.785+0000 7f2951800640 1 -- 172.21.15.99:0/3953629560 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f294c0701c0 msgr2=0x7f294c0d08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:54.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.785+0000 7f2951800640 1 --2- 172.21.15.99:0/3953629560 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f294c0701c0 0x7f294c0d08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:54.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.785+0000 7f2951800640 1 -- 172.21.15.99:0/3953629560 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f294c21cf30 con 0x7f294c06e910 2024-02-21T23:08:54.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.786+0000 7f2951800640 1 --2- 172.21.15.99:0/3953629560 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f294c06e910 0x7f294c21c9f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f294000c430 tx=0x7f294000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:54.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.786+0000 7f2949600640 1 -- 172.21.15.99:0/3953629560 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29400074e0 con 0x7f294c06e910 2024-02-21T23:08:54.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.786+0000 7f2949600640 1 -- 172.21.15.99:0/3953629560 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29400047e0 con 0x7f294c06e910 2024-02-21T23:08:54.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.786+0000 7f2949600640 1 -- 172.21.15.99:0/3953629560 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2940004bd0 con 0x7f294c06e910 2024-02-21T23:08:54.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.786+0000 7f2954200640 1 -- 172.21.15.99:0/3953629560 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f294c0ce250 con 0x7f294c06e910 2024-02-21T23:08:54.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.786+0000 7f2954200640 1 -- 172.21.15.99:0/3953629560 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f294c0cf840 con 0x7f294c06e910 2024-02-21T23:08:54.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.789+0000 7f2949600640 1 -- 172.21.15.99:0/3953629560 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f2940011070 con 0x7f294c06e910 2024-02-21T23:08:54.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.791+0000 7f2949600640 1 --2- 172.21.15.99:0/3953629560 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f292c09ef00 0x7f292c0a13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:54.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.792+0000 7f2949600640 1 -- 172.21.15.99:0/3953629560 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f29400c9aa0 con 0x7f294c06e910 2024-02-21T23:08:54.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.792+0000 7f2957234740 1 Processor -- start 2024-02-21T23:08:54.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.792+0000 7f2950e00640 1 --2- 172.21.15.99:0/3953629560 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f292c09ef00 0x7f292c0a13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:54.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.792+0000 7f2957234740 1 -- start start 2024-02-21T23:08:54.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.793+0000 7f2950e00640 1 --2- 172.21.15.99:0/3953629560 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f292c09ef00 0x7f292c0a13c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2938034000 tx=0x7f2938008030 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:54.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.793+0000 7f2957234740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dc959cd4b0 0x55dc959cd890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:54.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.793+0000 7f2957234740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dc95a08180 0x55dc95a08600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:54.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.793+0000 7f2957234740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55dc95a08b40 0x55dc95a093b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:54.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.793+0000 7f2957234740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc958f5b50 con 0x55dc95a08b40 2024-02-21T23:08:54.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.793+0000 7f2957234740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc9589eda0 con 0x55dc959cd4b0 2024-02-21T23:08:54.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.793+0000 7f2957234740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc958f1bf0 con 0x55dc95a08180 2024-02-21T23:08:54.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.793+0000 7f2951800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dc959cd4b0 0x55dc959cd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:54.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.794+0000 7f2952200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55dc95a08b40 0x55dc95a093b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:54.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.794+0000 7f2951800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dc959cd4b0 0x55dc959cd890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:59118/0 (socket says 172.21.15.99:59118) 2024-02-21T23:08:54.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.794+0000 7f2951800640 1 -- 172.21.15.99:0/3200745580 learned_addr learned my addr 172.21.15.99:0/3200745580 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:08:54.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.794+0000 7f2950e00640 1 --2- 172.21.15.99:0/3200745580 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dc95a08180 0x55dc95a08600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:54.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.794+0000 7f2951800640 1 -- 172.21.15.99:0/3200745580 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dc95a08180 msgr2=0x55dc95a08600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:54.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.794+0000 7f2951800640 1 --2- 172.21.15.99:0/3200745580 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dc95a08180 0x55dc95a08600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:54.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.794+0000 7f2951800640 1 -- 172.21.15.99:0/3200745580 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55dc95a08b40 msgr2=0x55dc95a093b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:54.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.794+0000 7f2951800640 1 --2- 172.21.15.99:0/3200745580 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55dc95a08b40 0x55dc95a093b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:54.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.794+0000 7f2951800640 1 -- 172.21.15.99:0/3200745580 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dc958c1f80 con 0x55dc959cd4b0 2024-02-21T23:08:54.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.794+0000 7f2952200640 1 --2- 172.21.15.99:0/3200745580 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55dc95a08b40 0x55dc95a093b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:08:54.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.794+0000 7f2951800640 1 --2- 172.21.15.99:0/3200745580 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dc959cd4b0 0x55dc959cd890 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f29400972d0 tx=0x7f29400077a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ce95100ffe6b5a9 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:54.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.794+0000 7f293e000640 1 -- 172.21.15.99:0/3200745580 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f294009b490 con 0x55dc959cd4b0 2024-02-21T23:08:54.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.795+0000 7f293e000640 1 -- 172.21.15.99:0/3200745580 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f294009fae0 con 0x55dc959cd4b0 2024-02-21T23:08:54.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.795+0000 7f293e000640 1 -- 172.21.15.99:0/3200745580 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f294009b160 con 0x55dc959cd4b0 2024-02-21T23:08:54.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.795+0000 7f2957234740 1 -- 172.21.15.99:0/3200745580 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dc959cd4b0 msgr2=0x55dc959cd890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:54.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.795+0000 7f2957234740 1 --2- 172.21.15.99:0/3200745580 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dc959cd4b0 0x55dc959cd890 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f29400972d0 tx=0x7f29400077a0 comp rx=0 tx=0).stop 2024-02-21T23:08:54.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.795+0000 7f2957234740 1 -- 172.21.15.99:0/3200745580 shutdown_connections 2024-02-21T23:08:54.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.795+0000 7f2957234740 1 --2- 172.21.15.99:0/3200745580 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55dc95a08b40 0x55dc95a093b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:54.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.795+0000 7f2957234740 1 --2- 172.21.15.99:0/3200745580 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dc95a08180 0x55dc95a08600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:54.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.795+0000 7f2957234740 1 --2- 172.21.15.99:0/3200745580 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dc959cd4b0 0x55dc959cd890 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:54.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.796+0000 7f2957234740 1 -- 172.21.15.99:0/3200745580 >> 172.21.15.99:0/3200745580 conn(0x55dc9598f520 msgr2=0x55dc959905a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:08:54.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.796+0000 7f2957234740 1 -- 172.21.15.99:0/3200745580 shutdown_connections 2024-02-21T23:08:54.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.796+0000 7f2957234740 1 -- 172.21.15.99:0/3200745580 wait complete. 2024-02-21T23:08:54.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.796+0000 7f2957234740 1 -- start start 2024-02-21T23:08:54.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.797+0000 7f2957234740 1 Processor -- start 2024-02-21T23:08:54.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.798+0000 7f2957234740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dc95a08180 0x55dc959c87e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:54.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.798+0000 7f2957234740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55dc95a08b40 0x55dc95a15610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:54.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.798+0000 7f2957234740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dc959ca1b0 0x55dc9598c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:54.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.798+0000 7f2957234740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc95a06ef0 con 0x55dc95a08b40 2024-02-21T23:08:54.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.798+0000 7f2957234740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc95894380 con 0x55dc959ca1b0 2024-02-21T23:08:54.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.798+0000 7f2957234740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc95a06c10 con 0x55dc95a08180 2024-02-21T23:08:54.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.798+0000 7f2957234740 10 client.0 _ll_register_callbacks cb 0x55dc958ed280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:08:54.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.798+0000 7f2950e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55dc95a08b40 0x55dc95a15610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:54.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.798+0000 7f2951800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dc95a08180 0x55dc959c87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:54.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.798+0000 7f2951800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dc95a08180 0x55dc959c87e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:56072/0 (socket says 172.21.15.99:56072) 2024-02-21T23:08:54.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.798+0000 7f2951800640 1 -- 172.21.15.99:0/1994088805 learned_addr learned my addr 172.21.15.99:0/1994088805 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:08:54.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.798+0000 7f2952200640 1 --2- 172.21.15.99:0/1994088805 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dc959ca1b0 0x55dc9598c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:54.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.799+0000 7f2951800640 1 -- 172.21.15.99:0/1994088805 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dc959ca1b0 msgr2=0x55dc9598c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:54.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.799+0000 7f2951800640 1 --2- 172.21.15.99:0/1994088805 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dc959ca1b0 0x55dc9598c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:54.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.799+0000 7f2951800640 1 -- 172.21.15.99:0/1994088805 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55dc95a08b40 msgr2=0x55dc95a15610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:54.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.799+0000 7f2951800640 1 --2- 172.21.15.99:0/1994088805 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55dc95a08b40 0x55dc95a15610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:54.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.799+0000 7f2951800640 1 -- 172.21.15.99:0/1994088805 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dc958bcc20 con 0x55dc95a08180 2024-02-21T23:08:54.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.799+0000 7f2951800640 1 --2- 172.21.15.99:0/1994088805 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dc95a08180 0x55dc959c87e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f2940097040 tx=0x7f2940001060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2f0647a3ceb863e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:54.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.799+0000 7f2932a00640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-02-21T23:08:54.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.799+0000 7f2932a00640 1 -- 172.21.15.99:0/1994088805 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f294009b490 con 0x55dc95a08180 2024-02-21T23:08:54.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.799+0000 7f2957234740 1 -- 172.21.15.99:0/1994088805 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f294009fae0 con 0x55dc95a08180 2024-02-21T23:08:54.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.799+0000 7f2932a00640 1 -- 172.21.15.99:0/1994088805 <== mon.2 v2:172.21.15.181:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f29400c7270 con 0x55dc95a08180 2024-02-21T23:08:54.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.800+0000 7f2932a00640 1 -- 172.21.15.99:0/1994088805 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f29400c7470 con 0x55dc95a08180 2024-02-21T23:08:54.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.800+0000 7f2957234740 10 client.6527 fetch_fsmap learned FSMap version 17 2024-02-21T23:08:54.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.800+0000 7f2957234740 1 -- 172.21.15.99:0/1994088805 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55dc9560a3f0 con 0x55dc95a08180 2024-02-21T23:08:54.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.800+0000 7f2932a00640 1 -- 172.21.15.99:0/1994088805 <== mon.2 v2:172.21.15.181:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f294009fae0 con 0x55dc95a08180 2024-02-21T23:08:54.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.800+0000 7f2932a00640 1 -- 172.21.15.99:0/1994088805 <== mon.2 v2:172.21.15.181:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f29400b4ba0 con 0x55dc95a08180 2024-02-21T23:08:54.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.800+0000 7f2957234740 10 client.6527 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:08:54.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.800+0000 7f2957234740 10 client.6527 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.d 2024-02-21T23:08:54.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.800+0000 7f2957234740 20 client.6527 populate_metadata read hostname 'smithi099' 2024-02-21T23:08:54.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.800+0000 7f2957234740 1 --2- 172.21.15.99:0/1994088805 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x55dc9598ccf0 0x55dc9598d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:54.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.800+0000 7f2957234740 4 client.6527 mds_command: new command op to 4348 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:08:54.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.800+0000 7f2957234740 1 -- 172.21.15.99:0/1994088805 --> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dc95903090 con 0x55dc9598ccf0 2024-02-21T23:08:54.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.801+0000 7f2950e00640 1 --2- 172.21.15.99:0/1994088805 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x55dc9598ccf0 0x55dc9598d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:54.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.801+0000 7f2932a00640 10 client.6527 ms_handle_connect on v2:172.21.15.99:6834/2243461688 2024-02-21T23:08:54.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.801+0000 7f2950e00640 1 --2- 172.21.15.99:0/1994088805 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x55dc9598ccf0 0x55dc9598d290 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d5d7d2b24137aaf0 server_cookie=4816109ea0e339db in_seq=0 out_seq=0 2024-02-21T23:08:54.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.802+0000 7f2932a00640 1 -- 172.21.15.99:0/1994088805 <== mds.2 v2:172.21.15.99:6834/2243461688 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55dc95903090 con 0x55dc9598ccf0 2024-02-21T23:08:54.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.802+0000 7f2932a00640 10 client.6527 handle_command_reply: tid=0 2024-02-21T23:08:54.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.802+0000 7f2957234740 1 client.6527 shutdown 2024-02-21T23:08:54.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.802+0000 7f2957234740 1 -- 172.21.15.99:0/1994088805 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dc95a08180 msgr2=0x55dc959c87e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:54.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.802+0000 7f2957234740 1 --2- 172.21.15.99:0/1994088805 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dc95a08180 0x55dc959c87e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f2940097040 tx=0x7f2940001060 comp rx=0 tx=0).stop 2024-02-21T23:08:54.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.802+0000 7f2957234740 1 -- 172.21.15.99:0/1994088805 shutdown_connections 2024-02-21T23:08:54.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.802+0000 7f2957234740 1 --2- 172.21.15.99:0/1994088805 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x55dc9598ccf0 0x55dc9598d290 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:54.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.802+0000 7f2957234740 1 --2- 172.21.15.99:0/1994088805 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dc959ca1b0 0x55dc9598c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:54.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.802+0000 7f2957234740 1 --2- 172.21.15.99:0/1994088805 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55dc95a08b40 0x55dc95a15610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:54.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.802+0000 7f2957234740 1 --2- 172.21.15.99:0/1994088805 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dc95a08180 0x55dc959c87e0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:54.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.802+0000 7f2932a00640 0 client.6527 ms_handle_reset on v2:172.21.15.99:6834/2243461688 2024-02-21T23:08:54.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.802+0000 7f2957234740 1 -- 172.21.15.99:0/1994088805 >> 172.21.15.99:0/1994088805 conn(0x55dc959cd4b0 msgr2=0x55dc959d8c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:08:54.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.802+0000 7f2957234740 1 -- 172.21.15.99:0/1994088805 shutdown_connections 2024-02-21T23:08:54.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.802+0000 7f2957234740 1 -- 172.21.15.99:0/1994088805 wait complete. 2024-02-21T23:08:54.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.803+0000 7f2957234740 20 client.6527 trim_cache size 0 max 16384 2024-02-21T23:08:54.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.816+0000 7f2957234740 1 Processor -- start 2024-02-21T23:08:54.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.816+0000 7f2957234740 1 -- start start 2024-02-21T23:08:54.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.818+0000 7f2957234740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dc959ca1b0 0x55dc95a04e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:54.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.818+0000 7f2957234740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55dc95a08180 0x55dc9598c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:54.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.818+0000 7f2957234740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dc95a08b40 0x55dc959b9e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:54.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.818+0000 7f2957234740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f294c22cab0 con 0x55dc95a08180 2024-02-21T23:08:54.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.818+0000 7f2957234740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f294c22a650 con 0x55dc959ca1b0 2024-02-21T23:08:54.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.818+0000 7f2957234740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f294c228710 con 0x55dc95a08b40 2024-02-21T23:08:54.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.818+0000 7f2950e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55dc95a08180 0x55dc9598c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:54.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.818+0000 7f2950e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55dc95a08180 0x55dc9598c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52966/0 (socket says 172.21.15.99:52966) 2024-02-21T23:08:54.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.818+0000 7f2950e00640 1 -- 172.21.15.99:0/926597455 learned_addr learned my addr 172.21.15.99:0/926597455 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:08:54.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.818+0000 7f2951800640 1 --2- 172.21.15.99:0/926597455 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dc959ca1b0 0x55dc95a04e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:54.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.818+0000 7f2952200640 1 --2- 172.21.15.99:0/926597455 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dc95a08b40 0x55dc959b9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:54.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.818+0000 7f2950e00640 1 -- 172.21.15.99:0/926597455 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dc95a08b40 msgr2=0x55dc959b9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:54.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.818+0000 7f2950e00640 1 --2- 172.21.15.99:0/926597455 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dc95a08b40 0x55dc959b9e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:54.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.818+0000 7f2950e00640 1 -- 172.21.15.99:0/926597455 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dc959ca1b0 msgr2=0x55dc95a04e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:54.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.818+0000 7f2950e00640 1 --2- 172.21.15.99:0/926597455 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dc959ca1b0 0x55dc95a04e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:54.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.819+0000 7f2950e00640 1 -- 172.21.15.99:0/926597455 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dc956d47d0 con 0x55dc95a08180 2024-02-21T23:08:54.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.819+0000 7f2950e00640 1 --2- 172.21.15.99:0/926597455 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55dc95a08180 0x55dc9598c7b0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f2938009810 tx=0x7f2938030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b2c8c0f868ec548 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:54.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.819+0000 7f293d600640 1 -- 172.21.15.99:0/926597455 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2938042070 con 0x55dc95a08180 2024-02-21T23:08:54.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.819+0000 7f293d600640 1 -- 172.21.15.99:0/926597455 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f293805b070 con 0x55dc95a08180 2024-02-21T23:08:54.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.819+0000 7f293d600640 1 -- 172.21.15.99:0/926597455 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2938037040 con 0x55dc95a08180 2024-02-21T23:08:54.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.820+0000 7f2957234740 1 -- 172.21.15.99:0/926597455 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55dc95a08180 msgr2=0x55dc9598c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:54.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.820+0000 7f2957234740 1 --2- 172.21.15.99:0/926597455 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55dc95a08180 0x55dc9598c7b0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f2938009810 tx=0x7f2938030000 comp rx=0 tx=0).stop 2024-02-21T23:08:54.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.820+0000 7f2957234740 1 -- 172.21.15.99:0/926597455 shutdown_connections 2024-02-21T23:08:54.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.820+0000 7f2957234740 1 --2- 172.21.15.99:0/926597455 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dc95a08b40 0x55dc959b9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:54.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.820+0000 7f2957234740 1 --2- 172.21.15.99:0/926597455 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55dc95a08180 0x55dc9598c7b0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:54.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.820+0000 7f2957234740 1 --2- 172.21.15.99:0/926597455 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dc959ca1b0 0x55dc95a04e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:54.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.820+0000 7f2957234740 1 -- 172.21.15.99:0/926597455 >> 172.21.15.99:0/926597455 conn(0x55dc959cd4b0 msgr2=0x55dc959d8170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:08:54.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.820+0000 7f2957234740 1 -- 172.21.15.99:0/926597455 shutdown_connections 2024-02-21T23:08:54.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.820+0000 7f2957234740 1 -- 172.21.15.99:0/926597455 wait complete. 2024-02-21T23:08:54.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.821+0000 7f2957234740 1 -- start start 2024-02-21T23:08:54.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.822+0000 7f2957234740 1 Processor -- start 2024-02-21T23:08:54.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.824+0000 7f2957234740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dc959ca1b0 0x55dc9598d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:54.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.824+0000 7f2957234740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55dc95a08180 0x55dc959ccb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:54.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.824+0000 7f2957234740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dc95a08b40 0x55dc959d8170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:54.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.824+0000 7f2957234740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f294c228d10 con 0x55dc95a08180 2024-02-21T23:08:54.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.824+0000 7f2957234740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f294c229ff0 con 0x55dc959ca1b0 2024-02-21T23:08:54.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.824+0000 7f2957234740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f294c229330 con 0x55dc95a08b40 2024-02-21T23:08:54.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.824+0000 7f2957234740 10 client.0 _ll_register_callbacks cb 0x7f2944001810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:08:54.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.824+0000 7f2950e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55dc95a08180 0x55dc959ccb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:54.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.824+0000 7f2950e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55dc95a08180 0x55dc959ccb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:52982/0 (socket says 172.21.15.99:52982) 2024-02-21T23:08:54.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.824+0000 7f2950e00640 1 -- 172.21.15.99:0/489545341 learned_addr learned my addr 172.21.15.99:0/489545341 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:08:54.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.824+0000 7f2951800640 1 --2- 172.21.15.99:0/489545341 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dc959ca1b0 0x55dc9598d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:54.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.824+0000 7f2952200640 1 --2- 172.21.15.99:0/489545341 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dc95a08b40 0x55dc959d8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:54.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.825+0000 7f2950e00640 1 -- 172.21.15.99:0/489545341 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dc95a08b40 msgr2=0x55dc959d8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:54.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.825+0000 7f2950e00640 1 --2- 172.21.15.99:0/489545341 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dc95a08b40 0x55dc959d8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:54.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.825+0000 7f2950e00640 1 -- 172.21.15.99:0/489545341 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dc959ca1b0 msgr2=0x55dc9598d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:54.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.825+0000 7f2950e00640 1 --2- 172.21.15.99:0/489545341 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dc959ca1b0 0x55dc9598d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:54.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.825+0000 7f2950e00640 1 -- 172.21.15.99:0/489545341 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dc9598d960 con 0x55dc95a08180 2024-02-21T23:08:54.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.825+0000 7f2950e00640 1 --2- 172.21.15.99:0/489545341 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55dc95a08180 0x55dc959ccb30 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f29380091d0 tx=0x7f293802d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74999c83cf808a01 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:54.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.825+0000 7f2932a00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:08:54.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.825+0000 7f2932a00640 1 -- 172.21.15.99:0/489545341 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2938042040 con 0x55dc95a08180 2024-02-21T23:08:54.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.825+0000 7f2932a00640 1 -- 172.21.15.99:0/489545341 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f2938057780 con 0x55dc95a08180 2024-02-21T23:08:54.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.825+0000 7f2957234740 1 -- 172.21.15.99:0/489545341 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f293805b070 con 0x55dc95a08180 2024-02-21T23:08:54.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.826+0000 7f2932a00640 1 -- 172.21.15.99:0/489545341 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2938057980 con 0x55dc95a08180 2024-02-21T23:08:54.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.826+0000 7f2957234740 10 client.6417 fetch_fsmap learned FSMap version 17 2024-02-21T23:08:54.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.826+0000 7f2957234740 1 -- 172.21.15.99:0/489545341 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55dc959dbc90 con 0x55dc95a08180 2024-02-21T23:08:54.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.826+0000 7f2932a00640 1 -- 172.21.15.99:0/489545341 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f293805b070 con 0x55dc95a08180 2024-02-21T23:08:54.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.826+0000 7f2932a00640 1 -- 172.21.15.99:0/489545341 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f2938057b20 con 0x55dc95a08180 2024-02-21T23:08:54.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.826+0000 7f2957234740 10 client.6417 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:08:54.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.826+0000 7f2957234740 10 client.6417 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.d 2024-02-21T23:08:54.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.826+0000 7f2957234740 20 client.6417 populate_metadata read hostname 'smithi099' 2024-02-21T23:08:54.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.826+0000 7f2957234740 1 --2- 172.21.15.99:0/489545341 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x55dc95a0c150 0x55dc95a15610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:54.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.826+0000 7f2957234740 4 client.6417 mds_command: new command op to 4348 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T23:08:54.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.826+0000 7f2957234740 1 -- 172.21.15.99:0/489545341 --> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55dc958fd3e0 con 0x55dc95a0c150 2024-02-21T23:08:54.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.826+0000 7f2951800640 1 --2- 172.21.15.99:0/489545341 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x55dc95a0c150 0x55dc95a15610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:54.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.827+0000 7f2951800640 1 --2- 172.21.15.99:0/489545341 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x55dc95a0c150 0x55dc95a15610 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7a92956570d3e5d0 server_cookie=77136b655b93be3a in_seq=0 out_seq=0 2024-02-21T23:08:54.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.827+0000 7f2932a00640 10 client.6417 ms_handle_connect on v2:172.21.15.99:6834/2243461688 2024-02-21T23:08:54.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.827+0000 7f2932a00640 1 -- 172.21.15.99:0/489545341 <== mds.2 v2:172.21.15.99:6834/2243461688 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55dc958fd3e0 con 0x55dc95a0c150 2024-02-21T23:08:54.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.827+0000 7f2932a00640 10 client.6417 handle_command_reply: tid=0 2024-02-21T23:08:54.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.827+0000 7f2957234740 1 client.6417 shutdown 2024-02-21T23:08:54.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.827+0000 7f2957234740 1 -- 172.21.15.99:0/489545341 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55dc95a08180 msgr2=0x55dc959ccb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:54.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.827+0000 7f2957234740 1 --2- 172.21.15.99:0/489545341 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55dc95a08180 0x55dc959ccb30 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f29380091d0 tx=0x7f293802d000 comp rx=0 tx=0).stop 2024-02-21T23:08:54.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.828+0000 7f2957234740 1 -- 172.21.15.99:0/489545341 shutdown_connections 2024-02-21T23:08:54.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.828+0000 7f2957234740 1 --2- 172.21.15.99:0/489545341 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x55dc95a0c150 0x55dc95a15610 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:54.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.828+0000 7f2957234740 1 --2- 172.21.15.99:0/489545341 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55dc95a08b40 0x55dc959d8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:54.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.828+0000 7f2957234740 1 --2- 172.21.15.99:0/489545341 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55dc95a08180 0x55dc959ccb30 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:54.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.828+0000 7f2957234740 1 --2- 172.21.15.99:0/489545341 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dc959ca1b0 0x55dc9598d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:54.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.828+0000 7f2932a00640 0 client.6417 ms_handle_reset on v2:172.21.15.99:6834/2243461688 2024-02-21T23:08:54.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.828+0000 7f2957234740 1 -- 172.21.15.99:0/489545341 >> 172.21.15.99:0/489545341 conn(0x55dc959cd4b0 msgr2=0x55dc95a06880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:08:54.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.828+0000 7f2957234740 1 -- 172.21.15.99:0/489545341 shutdown_connections 2024-02-21T23:08:54.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.828+0000 7f2957234740 1 -- 172.21.15.99:0/489545341 wait complete. 2024-02-21T23:08:54.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.828+0000 7f2957234740 20 client.6417 trim_cache size 0 max 16384 2024-02-21T23:08:54.823 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-02-21T23:08:54.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.828+0000 7f2954200640 1 -- 172.21.15.99:0/3953629560 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f292c09ef00 msgr2=0x7f292c0a13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:54.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.828+0000 7f2954200640 1 --2- 172.21.15.99:0/3953629560 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f292c09ef00 0x7f292c0a13c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2938034000 tx=0x7f2938008030 comp rx=0 tx=0).stop 2024-02-21T23:08:54.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.829+0000 7f2954200640 1 -- 172.21.15.99:0/3953629560 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f294c06e910 msgr2=0x7f294c21c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:54.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.829+0000 7f2954200640 1 --2- 172.21.15.99:0/3953629560 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f294c06e910 0x7f294c21c9f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f294000c430 tx=0x7f294000c8f0 comp rx=0 tx=0).stop 2024-02-21T23:08:54.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.829+0000 7f2954200640 1 -- 172.21.15.99:0/3953629560 shutdown_connections 2024-02-21T23:08:54.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.829+0000 7f2954200640 1 --2- 172.21.15.99:0/3953629560 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f292c09ef00 0x7f292c0a13c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:54.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.829+0000 7f2954200640 1 --2- 172.21.15.99:0/3953629560 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f294c180c80 0x7f294c16ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:54.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.829+0000 7f2954200640 1 --2- 172.21.15.99:0/3953629560 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f294c0701c0 0x7f294c0d08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:54.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.829+0000 7f2954200640 1 --2- 172.21.15.99:0/3953629560 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f294c06e910 0x7f294c21c9f0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:54.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.829+0000 7f2954200640 1 -- 172.21.15.99:0/3953629560 >> 172.21.15.99:0/3953629560 conn(0x7f294c0ce5f0 msgr2=0x7f294c0caf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:08:54.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.829+0000 7f2954200640 1 -- 172.21.15.99:0/3953629560 shutdown_connections 2024-02-21T23:08:54.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:54.829+0000 7f2954200640 1 -- 172.21.15.99:0/3953629560 wait complete. 2024-02-21T23:08:54.833 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T23:08:54.834 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-02-21T23:08:55.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.048+0000 7f0547400640 1 Processor -- start 2024-02-21T23:08:55.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.048+0000 7f0547400640 1 -- start start 2024-02-21T23:08:55.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.050+0000 7f0547400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f0540180c80 0x7f0540187f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:55.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.050+0000 7f0547400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f0540188440 0x7f05400cbb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:55.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.050+0000 7f0547400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f054006ee40 con 0x7f054006e910 2024-02-21T23:08:55.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.050+0000 7f0547400640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f054006f120 con 0x7f0540188440 2024-02-21T23:08:55.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.050+0000 7f0547400640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f054006f400 con 0x7f0540180c80 2024-02-21T23:08:55.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.050+0000 7f0545400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f0540188440 0x7f05400cbb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:55.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.050+0000 7f0544a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f0540180c80 0x7f0540187f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:55.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.050+0000 7f053fe00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f054006e910 0x7f05400cb420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.99:40016/0 (socket says 172.21.15.99:40016) 2024-02-21T23:08:55.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.050+0000 7f053fe00640 1 -- 172.21.15.99:0/2084515120 learned_addr learned my addr 172.21.15.99:0/2084515120 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:08:55.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.051+0000 7f0544a00640 1 -- 172.21.15.99:0/2084515120 >> v2:172.21.15.99:3300/0 conn(0x7f0540188440 msgr2=0x7f05400cbb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:55.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.051+0000 7f0544a00640 1 --2- 172.21.15.99:0/2084515120 >> v2:172.21.15.99:3300/0 conn(0x7f0540188440 0x7f05400cbb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:55.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.051+0000 7f0544a00640 1 -- 172.21.15.99:0/2084515120 >> v1:172.21.15.162:6789/0 conn(0x7f054006e910 legacy=0x7f05400cb420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:55.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.051+0000 7f0544a00640 1 -- 172.21.15.99:0/2084515120 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f054006f6e0 con 0x7f0540180c80 2024-02-21T23:08:55.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.051+0000 7f053f400640 1 -- 172.21.15.99:0/2084515120 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1072892294 0 0) 0x7f054006ee40 con 0x7f054006e910 2024-02-21T23:08:55.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.052+0000 7f0544a00640 1 --2- 172.21.15.99:0/2084515120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0540180c80 0x7f0540187f00 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f054008e200 tx=0x7f053402b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2683de201cc9400e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:55.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.053+0000 7f053f400640 1 -- 172.21.15.99:0/2084515120 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05340315a0 con 0x7f0540180c80 2024-02-21T23:08:55.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.053+0000 7f053f400640 1 -- 172.21.15.99:0/2084515120 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0534037070 con 0x7f0540180c80 2024-02-21T23:08:55.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.053+0000 7f053f400640 1 -- 172.21.15.99:0/2084515120 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0534031960 con 0x7f0540180c80 2024-02-21T23:08:55.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.053+0000 7f0547400640 1 -- 172.21.15.99:0/2084515120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0540180c80 msgr2=0x7f0540187f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:55.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.053+0000 7f0547400640 1 --2- 172.21.15.99:0/2084515120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0540180c80 0x7f0540187f00 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f054008e200 tx=0x7f053402b840 comp rx=0 tx=0).stop 2024-02-21T23:08:55.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.053+0000 7f0547400640 1 -- 172.21.15.99:0/2084515120 shutdown_connections 2024-02-21T23:08:55.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.053+0000 7f0547400640 1 --2- 172.21.15.99:0/2084515120 >> v2:172.21.15.99:3300/0 conn(0x7f0540188440 0x7f05400cbb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:55.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.053+0000 7f0547400640 1 --2- 172.21.15.99:0/2084515120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0540180c80 0x7f0540187f00 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:55.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.053+0000 7f0547400640 1 -- 172.21.15.99:0/2084515120 >> 172.21.15.99:0/2084515120 conn(0x7f05400ce5f0 msgr2=0x7f05400cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:08:55.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.053+0000 7f0547400640 1 -- 172.21.15.99:0/2084515120 shutdown_connections 2024-02-21T23:08:55.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.053+0000 7f0547400640 1 -- 172.21.15.99:0/2084515120 wait complete. 2024-02-21T23:08:55.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.055+0000 7f0547400640 1 Processor -- start 2024-02-21T23:08:55.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.055+0000 7f0547400640 1 -- start start 2024-02-21T23:08:55.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.057+0000 7f0547400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f054006e910 0x7f0540164fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:55.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.057+0000 7f0547400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0540180c80 0x7f054021f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:55.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.057+0000 7f0547400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0540188440 0x7f054016cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:55.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.057+0000 7f0547400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05400701c0 con 0x7f0540180c80 2024-02-21T23:08:55.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.057+0000 7f0547400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f054006fca0 con 0x7f0540188440 2024-02-21T23:08:55.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.057+0000 7f0547400640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0540070340 con 0x7f054006e910 2024-02-21T23:08:55.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.057+0000 7f053fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0540180c80 0x7f054021f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:55.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.057+0000 7f0545400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0540188440 0x7f054016cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:55.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.057+0000 7f0545400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0540188440 0x7f054016cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:59154/0 (socket says 172.21.15.99:59154) 2024-02-21T23:08:55.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.057+0000 7f0545400640 1 -- 172.21.15.99:0/1633723829 learned_addr learned my addr 172.21.15.99:0/1633723829 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:08:55.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.057+0000 7f0544a00640 1 --2- 172.21.15.99:0/1633723829 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f054006e910 0x7f0540164fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:55.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.057+0000 7f0545400640 1 -- 172.21.15.99:0/1633723829 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f054006e910 msgr2=0x7f0540164fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:55.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.057+0000 7f0545400640 1 --2- 172.21.15.99:0/1633723829 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f054006e910 0x7f0540164fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:55.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.057+0000 7f0545400640 1 -- 172.21.15.99:0/1633723829 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0540180c80 msgr2=0x7f054021f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:55.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.057+0000 7f0545400640 1 --2- 172.21.15.99:0/1633723829 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0540180c80 0x7f054021f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:55.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.057+0000 7f0545400640 1 -- 172.21.15.99:0/1633723829 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05401703e0 con 0x7f0540188440 2024-02-21T23:08:55.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.058+0000 7f0545400640 1 --2- 172.21.15.99:0/1633723829 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0540188440 0x7f054016cd30 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f053800efc0 tx=0x7f053800c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:55.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.058+0000 7f053cc00640 1 -- 172.21.15.99:0/1633723829 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0538018020 con 0x7f0540188440 2024-02-21T23:08:55.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.058+0000 7f053cc00640 1 -- 172.21.15.99:0/1633723829 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0538014480 con 0x7f0540188440 2024-02-21T23:08:55.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.058+0000 7f0547400640 1 -- 172.21.15.99:0/1633723829 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05401706c0 con 0x7f0540188440 2024-02-21T23:08:55.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.058+0000 7f053cc00640 1 -- 172.21.15.99:0/1633723829 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0538014870 con 0x7f0540188440 2024-02-21T23:08:55.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.058+0000 7f0547400640 1 -- 172.21.15.99:0/1633723829 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0540170c80 con 0x7f0540188440 2024-02-21T23:08:55.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.063+0000 7f053cc00640 1 -- 172.21.15.99:0/1633723829 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f053801b020 con 0x7f0540188440 2024-02-21T23:08:55.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.063+0000 7f054a1e0740 1 Processor -- start 2024-02-21T23:08:55.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.063+0000 7f054a1e0740 1 -- start start 2024-02-21T23:08:55.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.064+0000 7f053cc00640 1 --2- 172.21.15.99:0/1633723829 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f052009eed0 0x7f05200a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:55.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.064+0000 7f053cc00640 1 -- 172.21.15.99:0/1633723829 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f05380caaf0 con 0x7f0540188440 2024-02-21T23:08:55.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.065+0000 7f054a1e0740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5567121b64b0 0x5567121b6890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:55.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.065+0000 7f054a1e0740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5567121f1180 0x5567121f1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:55.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.065+0000 7f054a1e0740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5567121f1b40 0x5567121f23b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:55.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.065+0000 7f054a1e0740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567120deb50 con 0x5567121f1180 2024-02-21T23:08:55.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.065+0000 7f054a1e0740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x556712087da0 con 0x5567121b64b0 2024-02-21T23:08:55.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.065+0000 7f054a1e0740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567120dabf0 con 0x5567121f1b40 2024-02-21T23:08:55.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.065+0000 7f053fe00640 1 --2- 172.21.15.99:0/1633723829 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f052009eed0 0x7f05200a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:55.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.065+0000 7f0544a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5567121b64b0 0x5567121b6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:55.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.065+0000 7f0544a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5567121b64b0 0x5567121b6890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:59170/0 (socket says 172.21.15.99:59170) 2024-02-21T23:08:55.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.065+0000 7f0544a00640 1 -- 172.21.15.99:0/2368323968 learned_addr learned my addr 172.21.15.99:0/2368323968 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:08:55.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.065+0000 7f0545400640 1 --2- 172.21.15.99:0/2368323968 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5567121f1b40 0x5567121f23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:55.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.065+0000 7f053fe00640 1 --2- 172.21.15.99:0/2368323968 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5567121f1180 0x5567121f1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:55.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.065+0000 7f0544a00640 1 -- 172.21.15.99:0/2368323968 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5567121f1b40 msgr2=0x5567121f23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:55.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.065+0000 7f0544a00640 1 --2- 172.21.15.99:0/2368323968 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5567121f1b40 0x5567121f23b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:55.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.065+0000 7f0544a00640 1 -- 172.21.15.99:0/2368323968 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5567121f1180 msgr2=0x5567121f1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:55.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.065+0000 7f0544a00640 1 --2- 172.21.15.99:0/2368323968 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5567121f1180 0x5567121f1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:55.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.065+0000 7f0544a00640 1 -- 172.21.15.99:0/2368323968 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5567120aaf80 con 0x5567121b64b0 2024-02-21T23:08:55.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.065+0000 7f0545400640 1 --2- 172.21.15.99:0/2368323968 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5567121f1b40 0x5567121f23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:08:55.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.066+0000 7f053fe00640 1 --2- 172.21.15.99:0/1633723829 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f052009eed0 0x7f05200a1390 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f054021cb60 tx=0x7f052c004e80 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:55.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.066+0000 7f0544a00640 1 --2- 172.21.15.99:0/2368323968 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5567121b64b0 0x5567121b6890 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f053402be50 tx=0x7f0534008030 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0cac32e3c80ae03 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:55.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.066+0000 7f0531200640 1 -- 172.21.15.99:0/2368323968 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f053404a070 con 0x5567121b64b0 2024-02-21T23:08:55.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.066+0000 7f0531200640 1 -- 172.21.15.99:0/2368323968 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0534037040 con 0x5567121b64b0 2024-02-21T23:08:55.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.066+0000 7f0531200640 1 -- 172.21.15.99:0/2368323968 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0534031aa0 con 0x5567121b64b0 2024-02-21T23:08:55.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.067+0000 7f054a1e0740 1 -- 172.21.15.99:0/2368323968 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5567121b64b0 msgr2=0x5567121b6890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:55.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.067+0000 7f054a1e0740 1 --2- 172.21.15.99:0/2368323968 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5567121b64b0 0x5567121b6890 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f053402be50 tx=0x7f0534008030 comp rx=0 tx=0).stop 2024-02-21T23:08:55.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.067+0000 7f054a1e0740 1 -- 172.21.15.99:0/2368323968 shutdown_connections 2024-02-21T23:08:55.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.067+0000 7f054a1e0740 1 --2- 172.21.15.99:0/2368323968 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5567121f1b40 0x5567121f23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:55.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.067+0000 7f054a1e0740 1 --2- 172.21.15.99:0/2368323968 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5567121f1180 0x5567121f1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:55.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.067+0000 7f054a1e0740 1 --2- 172.21.15.99:0/2368323968 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5567121b64b0 0x5567121b6890 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:55.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.067+0000 7f054a1e0740 1 -- 172.21.15.99:0/2368323968 >> 172.21.15.99:0/2368323968 conn(0x556712178520 msgr2=0x5567121795a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:08:55.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.067+0000 7f054a1e0740 1 -- 172.21.15.99:0/2368323968 shutdown_connections 2024-02-21T23:08:55.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.067+0000 7f054a1e0740 1 -- 172.21.15.99:0/2368323968 wait complete. 2024-02-21T23:08:55.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.068+0000 7f054a1e0740 1 -- start start 2024-02-21T23:08:55.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.068+0000 7f054a1e0740 1 Processor -- start 2024-02-21T23:08:55.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.069+0000 7f054a1e0740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5567121f1180 0x5567121fcf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:55.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.069+0000 7f054a1e0740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5567121f1b40 0x5567121e3540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:55.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.069+0000 7f054a1e0740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5567121b1790 0x5567121b0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:55.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.069+0000 7f054a1e0740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567121efef0 con 0x5567121f1b40 2024-02-21T23:08:55.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.069+0000 7f054a1e0740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55671207d380 con 0x5567121f1180 2024-02-21T23:08:55.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.069+0000 7f054a1e0740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567121efc10 con 0x5567121b1790 2024-02-21T23:08:55.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.069+0000 7f054a1e0740 10 client.0 _ll_register_callbacks cb 0x5567120d6280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:08:55.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.070+0000 7f053fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5567121f1b40 0x5567121e3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:55.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.070+0000 7f0544a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5567121f1180 0x5567121fcf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:55.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.070+0000 7f053fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5567121f1b40 0x5567121e3540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53010/0 (socket says 172.21.15.99:53010) 2024-02-21T23:08:55.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.070+0000 7f053fe00640 1 -- 172.21.15.99:0/3465227521 learned_addr learned my addr 172.21.15.99:0/3465227521 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:08:55.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.070+0000 7f0545400640 1 --2- 172.21.15.99:0/3465227521 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5567121b1790 0x5567121b0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:55.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.070+0000 7f0544a00640 1 -- 172.21.15.99:0/3465227521 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5567121b1790 msgr2=0x5567121b0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:55.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.070+0000 7f0544a00640 1 --2- 172.21.15.99:0/3465227521 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5567121b1790 0x5567121b0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:55.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.070+0000 7f0544a00640 1 -- 172.21.15.99:0/3465227521 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5567121f1b40 msgr2=0x5567121e3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:55.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.070+0000 7f0544a00640 1 --2- 172.21.15.99:0/3465227521 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5567121f1b40 0x5567121e3540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:55.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.070+0000 7f0544a00640 1 -- 172.21.15.99:0/3465227521 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5567120a5c20 con 0x5567121f1180 2024-02-21T23:08:55.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.070+0000 7f053fe00640 1 --2- 172.21.15.99:0/3465227521 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5567121f1b40 0x5567121e3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:08:55.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.071+0000 7f0544a00640 1 --2- 172.21.15.99:0/3465227521 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5567121f1180 0x5567121fcf20 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f0534047000 tx=0x7f0534004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af0fbfa429a1122a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:55.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.071+0000 7f0525600640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-02-21T23:08:55.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.071+0000 7f0525600640 1 -- 172.21.15.99:0/3465227521 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f053404a070 con 0x5567121f1180 2024-02-21T23:08:55.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.071+0000 7f054a1e0740 1 -- 172.21.15.99:0/3465227521 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0534037040 con 0x5567121f1180 2024-02-21T23:08:55.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.071+0000 7f0525600640 1 -- 172.21.15.99:0/3465227521 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f0534031a70 con 0x5567121f1180 2024-02-21T23:08:55.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.071+0000 7f0525600640 1 -- 172.21.15.99:0/3465227521 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f05340093c0 con 0x5567121f1180 2024-02-21T23:08:55.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.071+0000 7f054a1e0740 10 client.6550 fetch_fsmap learned FSMap version 17 2024-02-21T23:08:55.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.071+0000 7f054a1e0740 1 -- 172.21.15.99:0/3465227521 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x556711df33f0 con 0x5567121f1180 2024-02-21T23:08:55.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.071+0000 7f0525600640 1 -- 172.21.15.99:0/3465227521 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0534037040 con 0x5567121f1180 2024-02-21T23:08:55.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.072+0000 7f0525600640 1 -- 172.21.15.99:0/3465227521 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f0534031070 con 0x5567121f1180 2024-02-21T23:08:55.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.072+0000 7f054a1e0740 10 client.6550 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:08:55.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.072+0000 7f054a1e0740 10 client.6550 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2024-02-21T23:08:55.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.072+0000 7f054a1e0740 20 client.6550 populate_metadata read hostname 'smithi099' 2024-02-21T23:08:55.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.072+0000 7f054a1e0740 1 --2- 172.21.15.99:0/3465227521 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x5567121b1c10 0x5567121fde50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:55.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.072+0000 7f054a1e0740 4 client.6550 mds_command: new command op to 4352 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:08:55.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.072+0000 7f054a1e0740 1 -- 172.21.15.99:0/3465227521 --> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5567120ec090 con 0x5567121b1c10 2024-02-21T23:08:55.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.072+0000 7f053fe00640 1 --2- 172.21.15.99:0/3465227521 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x5567121b1c10 0x5567121fde50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:55.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.073+0000 7f0525600640 10 client.6550 ms_handle_connect on v2:172.21.15.99:6836/1676159950 2024-02-21T23:08:55.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.073+0000 7f053fe00640 1 --2- 172.21.15.99:0/3465227521 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x5567121b1c10 0x5567121fde50 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b99a31e98e1fb591 server_cookie=c46cf9c20b51d20d in_seq=0 out_seq=0 2024-02-21T23:08:55.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.073+0000 7f0525600640 1 -- 172.21.15.99:0/3465227521 <== mds.1 v2:172.21.15.99:6836/1676159950 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x5567120ec090 con 0x5567121b1c10 2024-02-21T23:08:55.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.073+0000 7f0525600640 10 client.6550 handle_command_reply: tid=0 2024-02-21T23:08:55.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.074+0000 7f054a1e0740 1 client.6550 shutdown 2024-02-21T23:08:55.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.074+0000 7f054a1e0740 1 -- 172.21.15.99:0/3465227521 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5567121f1180 msgr2=0x5567121fcf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:55.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.074+0000 7f054a1e0740 1 --2- 172.21.15.99:0/3465227521 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5567121f1180 0x5567121fcf20 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f0534047000 tx=0x7f0534004730 comp rx=0 tx=0).stop 2024-02-21T23:08:55.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.074+0000 7f054a1e0740 1 -- 172.21.15.99:0/3465227521 shutdown_connections 2024-02-21T23:08:55.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.074+0000 7f054a1e0740 1 --2- 172.21.15.99:0/3465227521 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x5567121b1c10 0x5567121fde50 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:55.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.074+0000 7f054a1e0740 1 --2- 172.21.15.99:0/3465227521 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5567121b1790 0x5567121b0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:55.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.074+0000 7f054a1e0740 1 --2- 172.21.15.99:0/3465227521 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5567121f1b40 0x5567121e3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:55.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.074+0000 7f054a1e0740 1 --2- 172.21.15.99:0/3465227521 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5567121f1180 0x5567121fcf20 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:55.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.074+0000 7f0525600640 0 client.6550 ms_handle_reset on v2:172.21.15.99:6836/1676159950 2024-02-21T23:08:55.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.074+0000 7f054a1e0740 1 -- 172.21.15.99:0/3465227521 >> 172.21.15.99:0/3465227521 conn(0x5567121b64b0 msgr2=0x5567121f0600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:08:55.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.074+0000 7f054a1e0740 1 -- 172.21.15.99:0/3465227521 shutdown_connections 2024-02-21T23:08:55.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.074+0000 7f054a1e0740 1 -- 172.21.15.99:0/3465227521 wait complete. 2024-02-21T23:08:55.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.074+0000 7f054a1e0740 20 client.6550 trim_cache size 0 max 16384 2024-02-21T23:08:55.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.094+0000 7f054a1e0740 1 Processor -- start 2024-02-21T23:08:55.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.095+0000 7f054a1e0740 1 -- start start 2024-02-21T23:08:55.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.095+0000 7f054a1e0740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5567121b1790 0x5567121b0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:55.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.096+0000 7f054a1e0740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5567121f1180 0x5567121e3350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:55.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.096+0000 7f054a1e0740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5567121f1b40 0x5567121fcf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:55.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.096+0000 7f054a1e0740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f054022c930 con 0x5567121f1180 2024-02-21T23:08:55.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.096+0000 7f054a1e0740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f054022a4d0 con 0x5567121f1b40 2024-02-21T23:08:55.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.096+0000 7f054a1e0740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0540173230 con 0x5567121b1790 2024-02-21T23:08:55.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.096+0000 7f053fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5567121f1180 0x5567121e3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:55.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.096+0000 7f053fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5567121f1180 0x5567121e3350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53024/0 (socket says 172.21.15.99:53024) 2024-02-21T23:08:55.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.096+0000 7f053fe00640 1 -- 172.21.15.99:0/991879709 learned_addr learned my addr 172.21.15.99:0/991879709 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:08:55.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.096+0000 7f0545400640 1 --2- 172.21.15.99:0/991879709 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5567121f1b40 0x5567121fcf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:55.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.096+0000 7f0544a00640 1 --2- 172.21.15.99:0/991879709 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5567121b1790 0x5567121b0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:55.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.096+0000 7f053fe00640 1 -- 172.21.15.99:0/991879709 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5567121b1790 msgr2=0x5567121b0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:55.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.096+0000 7f053fe00640 1 --2- 172.21.15.99:0/991879709 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5567121b1790 0x5567121b0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:55.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.096+0000 7f053fe00640 1 -- 172.21.15.99:0/991879709 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5567121f1b40 msgr2=0x5567121fcf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:55.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.096+0000 7f053fe00640 1 --2- 172.21.15.99:0/991879709 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5567121f1b40 0x5567121fcf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:55.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.096+0000 7f053fe00640 1 -- 172.21.15.99:0/991879709 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556711ebd7d0 con 0x5567121f1180 2024-02-21T23:08:55.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.096+0000 7f0545400640 1 --2- 172.21.15.99:0/991879709 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5567121f1b40 0x5567121fcf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:08:55.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.097+0000 7f053fe00640 1 --2- 172.21.15.99:0/991879709 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5567121f1180 0x5567121e3350 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f052c000c00 tx=0x7f052c007e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d2febee75959e08 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:55.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.097+0000 7f0527e00640 1 -- 172.21.15.99:0/991879709 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052c029240 con 0x5567121f1180 2024-02-21T23:08:55.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.097+0000 7f0527e00640 1 -- 172.21.15.99:0/991879709 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f052c020040 con 0x5567121f1180 2024-02-21T23:08:55.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.097+0000 7f0527e00640 1 -- 172.21.15.99:0/991879709 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052c019680 con 0x5567121f1180 2024-02-21T23:08:55.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.098+0000 7f054a1e0740 1 -- 172.21.15.99:0/991879709 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5567121f1180 msgr2=0x5567121e3350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:55.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.098+0000 7f054a1e0740 1 --2- 172.21.15.99:0/991879709 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5567121f1180 0x5567121e3350 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f052c000c00 tx=0x7f052c007e40 comp rx=0 tx=0).stop 2024-02-21T23:08:55.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.098+0000 7f054a1e0740 1 -- 172.21.15.99:0/991879709 shutdown_connections 2024-02-21T23:08:55.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.098+0000 7f054a1e0740 1 --2- 172.21.15.99:0/991879709 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5567121f1b40 0x5567121fcf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:55.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.098+0000 7f054a1e0740 1 --2- 172.21.15.99:0/991879709 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5567121f1180 0x5567121e3350 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:55.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.098+0000 7f054a1e0740 1 --2- 172.21.15.99:0/991879709 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5567121b1790 0x5567121b0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:55.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.098+0000 7f054a1e0740 1 -- 172.21.15.99:0/991879709 >> 172.21.15.99:0/991879709 conn(0x5567121b64b0 msgr2=0x5567121809c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:08:55.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.098+0000 7f054a1e0740 1 -- 172.21.15.99:0/991879709 shutdown_connections 2024-02-21T23:08:55.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.098+0000 7f054a1e0740 1 -- 172.21.15.99:0/991879709 wait complete. 2024-02-21T23:08:55.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.099+0000 7f054a1e0740 1 -- start start 2024-02-21T23:08:55.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.100+0000 7f054a1e0740 1 Processor -- start 2024-02-21T23:08:55.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.102+0000 7f054a1e0740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5567121b1790 0x5567121b0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:55.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.102+0000 7f054a1e0740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5567121f1180 0x55671225cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:55.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.102+0000 7f054a1e0740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5567121f1b40 0x556712256ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:55.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.102+0000 7f054a1e0740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0540228c10 con 0x5567121b1790 2024-02-21T23:08:55.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.102+0000 7f054a1e0740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0540229e70 con 0x5567121f1b40 2024-02-21T23:08:55.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.102+0000 7f054a1e0740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0540229210 con 0x5567121f1180 2024-02-21T23:08:55.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.102+0000 7f054a1e0740 10 client.0 _ll_register_callbacks cb 0x7f0534048070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:08:55.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.102+0000 7f0544a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5567121b1790 0x5567121b0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:55.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.102+0000 7f0545400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5567121f1b40 0x556712256ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:55.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.102+0000 7f053fe00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5567121f1180 0x55671225cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:55.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.102+0000 7f0544a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5567121b1790 0x5567121b0570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53030/0 (socket says 172.21.15.99:53030) 2024-02-21T23:08:55.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.102+0000 7f0544a00640 1 -- 172.21.15.99:0/2603851625 learned_addr learned my addr 172.21.15.99:0/2603851625 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:08:55.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.102+0000 7f0545400640 1 -- 172.21.15.99:0/2603851625 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5567121f1180 msgr2=0x55671225cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:55.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.102+0000 7f0545400640 1 --2- 172.21.15.99:0/2603851625 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5567121f1180 0x55671225cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:55.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.102+0000 7f0545400640 1 -- 172.21.15.99:0/2603851625 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5567121b1790 msgr2=0x5567121b0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:55.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.102+0000 7f0545400640 1 --2- 172.21.15.99:0/2603851625 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5567121b1790 0x5567121b0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:55.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.102+0000 7f0545400640 1 -- 172.21.15.99:0/2603851625 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55671225d900 con 0x5567121f1b40 2024-02-21T23:08:55.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.103+0000 7f0544a00640 1 --2- 172.21.15.99:0/2603851625 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5567121b1790 0x5567121b0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:08:55.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.103+0000 7f0545400640 1 --2- 172.21.15.99:0/2603851625 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5567121f1b40 0x556712256ba0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f05380c80a0 tx=0x7f05380983c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f96c05f66052e38 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:55.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.103+0000 7f0525600640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-02-21T23:08:55.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.103+0000 7f0525600640 1 -- 172.21.15.99:0/2603851625 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05380978d0 con 0x5567121f1b40 2024-02-21T23:08:55.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.103+0000 7f054a1e0740 1 -- 172.21.15.99:0/2603851625 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f052c020040 con 0x5567121f1b40 2024-02-21T23:08:55.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.103+0000 7f0525600640 1 -- 172.21.15.99:0/2603851625 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f05380b5ae0 con 0x5567121f1b40 2024-02-21T23:08:55.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.103+0000 7f0525600640 1 -- 172.21.15.99:0/2603851625 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f05380b5ce0 con 0x5567121f1b40 2024-02-21T23:08:55.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.103+0000 7f054a1e0740 10 client.6556 fetch_fsmap learned FSMap version 17 2024-02-21T23:08:55.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.103+0000 7f054a1e0740 1 -- 172.21.15.99:0/2603851625 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5567121facc0 con 0x5567121f1b40 2024-02-21T23:08:55.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.104+0000 7f0525600640 1 -- 172.21.15.99:0/2603851625 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05380b3080 con 0x5567121f1b40 2024-02-21T23:08:55.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.104+0000 7f0525600640 1 -- 172.21.15.99:0/2603851625 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f0538093fd0 con 0x5567121f1b40 2024-02-21T23:08:55.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.104+0000 7f054a1e0740 10 client.6556 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:08:55.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.104+0000 7f054a1e0740 10 client.6556 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2024-02-21T23:08:55.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.104+0000 7f054a1e0740 20 client.6556 populate_metadata read hostname 'smithi099' 2024-02-21T23:08:55.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.104+0000 7f054a1e0740 1 --2- 172.21.15.99:0/2603851625 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x5567121fc000 0x556712202040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:55.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.104+0000 7f054a1e0740 4 client.6556 mds_command: new command op to 4352 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T23:08:55.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.104+0000 7f054a1e0740 1 -- 172.21.15.99:0/2603851625 --> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5567120e63e0 con 0x5567121fc000 2024-02-21T23:08:55.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.104+0000 7f0544a00640 1 --2- 172.21.15.99:0/2603851625 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x5567121fc000 0x556712202040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:55.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.105+0000 7f0544a00640 1 --2- 172.21.15.99:0/2603851625 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x5567121fc000 0x556712202040 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=48b22e44b12fbe77 server_cookie=f9de060a5748f0f9 in_seq=0 out_seq=0 2024-02-21T23:08:55.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.105+0000 7f0525600640 10 client.6556 ms_handle_connect on v2:172.21.15.99:6836/1676159950 2024-02-21T23:08:55.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.105+0000 7f0525600640 1 -- 172.21.15.99:0/2603851625 <== mds.1 v2:172.21.15.99:6836/1676159950 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5567120e63e0 con 0x5567121fc000 2024-02-21T23:08:55.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.105+0000 7f0525600640 10 client.6556 handle_command_reply: tid=0 2024-02-21T23:08:55.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.105+0000 7f054a1e0740 1 client.6556 shutdown 2024-02-21T23:08:55.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.105+0000 7f054a1e0740 1 -- 172.21.15.99:0/2603851625 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5567121f1b40 msgr2=0x556712256ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:55.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.105+0000 7f054a1e0740 1 --2- 172.21.15.99:0/2603851625 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5567121f1b40 0x556712256ba0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f05380c80a0 tx=0x7f05380983c0 comp rx=0 tx=0).stop 2024-02-21T23:08:55.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.105+0000 7f054a1e0740 1 -- 172.21.15.99:0/2603851625 shutdown_connections 2024-02-21T23:08:55.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.105+0000 7f054a1e0740 1 --2- 172.21.15.99:0/2603851625 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x5567121fc000 0x556712202040 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:55.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.105+0000 7f054a1e0740 1 --2- 172.21.15.99:0/2603851625 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5567121f1b40 0x556712256ba0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:55.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.105+0000 7f054a1e0740 1 --2- 172.21.15.99:0/2603851625 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5567121f1180 0x55671225cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:55.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.105+0000 7f054a1e0740 1 --2- 172.21.15.99:0/2603851625 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5567121b1790 0x5567121b0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:55.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.105+0000 7f054a1e0740 1 -- 172.21.15.99:0/2603851625 >> 172.21.15.99:0/2603851625 conn(0x5567121b64b0 msgr2=0x556712180be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:08:55.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.105+0000 7f0525600640 0 client.6556 ms_handle_reset on v2:172.21.15.99:6836/1676159950 2024-02-21T23:08:55.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.105+0000 7f054a1e0740 1 -- 172.21.15.99:0/2603851625 shutdown_connections 2024-02-21T23:08:55.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.105+0000 7f054a1e0740 1 -- 172.21.15.99:0/2603851625 wait complete. 2024-02-21T23:08:55.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.106+0000 7f054a1e0740 20 client.6556 trim_cache size 0 max 16384 2024-02-21T23:08:55.102 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-02-21T23:08:55.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.106+0000 7f0547400640 1 -- 172.21.15.99:0/1633723829 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f052009eed0 msgr2=0x7f05200a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:55.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.106+0000 7f0547400640 1 --2- 172.21.15.99:0/1633723829 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f052009eed0 0x7f05200a1390 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f054021cb60 tx=0x7f052c004e80 comp rx=0 tx=0).stop 2024-02-21T23:08:55.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.106+0000 7f0547400640 1 -- 172.21.15.99:0/1633723829 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0540188440 msgr2=0x7f054016cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:55.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.106+0000 7f0547400640 1 --2- 172.21.15.99:0/1633723829 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0540188440 0x7f054016cd30 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f053800efc0 tx=0x7f053800c490 comp rx=0 tx=0).stop 2024-02-21T23:08:55.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.106+0000 7f0547400640 1 -- 172.21.15.99:0/1633723829 shutdown_connections 2024-02-21T23:08:55.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.106+0000 7f0547400640 1 --2- 172.21.15.99:0/1633723829 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f052009eed0 0x7f05200a1390 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:55.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.106+0000 7f0547400640 1 --2- 172.21.15.99:0/1633723829 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0540188440 0x7f054016cd30 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:55.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.106+0000 7f0547400640 1 --2- 172.21.15.99:0/1633723829 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0540180c80 0x7f054021f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:55.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.106+0000 7f0547400640 1 --2- 172.21.15.99:0/1633723829 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f054006e910 0x7f0540164fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:55.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.106+0000 7f0547400640 1 -- 172.21.15.99:0/1633723829 >> 172.21.15.99:0/1633723829 conn(0x7f05400ce5f0 msgr2=0x7f05400f84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:08:55.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.106+0000 7f0547400640 1 -- 172.21.15.99:0/1633723829 shutdown_connections 2024-02-21T23:08:55.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.107+0000 7f0547400640 1 -- 172.21.15.99:0/1633723829 wait complete. 2024-02-21T23:08:55.114 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T23:08:55.114 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-02-21T23:08:55.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.349+0000 7f4085c00640 1 Processor -- start 2024-02-21T23:08:55.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.350+0000 7f4085c00640 1 -- start start 2024-02-21T23:08:55.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.352+0000 7f4085c00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f40800fe4f0 0x7f408018cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:55.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.352+0000 7f4085c00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40800f9f10 con 0x7f40800fe8d0 2024-02-21T23:08:55.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.352+0000 7f4085c00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40800d06b0 con 0x7f408006c540 2024-02-21T23:08:55.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.352+0000 7f4085c00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f408006c0b0 con 0x7f40800fe4f0 2024-02-21T23:08:55.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.352+0000 7f407f400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f40800fe8d0 0x7f40800fed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:56126/0 (socket says 172.21.15.99:56126) 2024-02-21T23:08:55.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.352+0000 7f407f400640 1 -- 172.21.15.99:0/3178181240 learned_addr learned my addr 172.21.15.99:0/3178181240 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:08:55.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.352+0000 7f407ea00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f40800fe4f0 0x7f408018cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:55.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.353+0000 7f407ea00640 1 -- 172.21.15.99:0/3178181240 >> v1:172.21.15.162:6789/0 conn(0x7f408006c540 legacy=0x7f408006c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:55.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.353+0000 7f407ea00640 1 -- 172.21.15.99:0/3178181240 >> v1:172.21.15.99:6789/0 conn(0x7f40800fe8d0 legacy=0x7f40800fed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:55.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.353+0000 7f407d600640 1 -- 172.21.15.99:0/3178181240 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2176957822 0 0) 0x7f40800d06b0 con 0x7f408006c540 2024-02-21T23:08:55.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.353+0000 7f407ea00640 1 -- 172.21.15.99:0/3178181240 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40800d03d0 con 0x7f40800fe4f0 2024-02-21T23:08:55.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.354+0000 7f407ea00640 1 --2- 172.21.15.99:0/3178181240 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f40800fe4f0 0x7f408018cad0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f40680097a0 tx=0x7f406802b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=823f76cca0254dc2 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:55.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.355+0000 7f407d600640 1 -- 172.21.15.99:0/3178181240 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4068037070 con 0x7f40800fe4f0 2024-02-21T23:08:55.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.355+0000 7f407d600640 1 -- 172.21.15.99:0/3178181240 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4068030710 con 0x7f40800fe4f0 2024-02-21T23:08:55.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.355+0000 7f407d600640 1 -- 172.21.15.99:0/3178181240 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4068030ae0 con 0x7f40800fe4f0 2024-02-21T23:08:55.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.355+0000 7f4085c00640 1 -- 172.21.15.99:0/3178181240 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f40800fe4f0 msgr2=0x7f408018cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:55.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.355+0000 7f4085c00640 1 --2- 172.21.15.99:0/3178181240 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f40800fe4f0 0x7f408018cad0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f40680097a0 tx=0x7f406802b790 comp rx=0 tx=0).stop 2024-02-21T23:08:55.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.355+0000 7f4085c00640 1 -- 172.21.15.99:0/3178181240 shutdown_connections 2024-02-21T23:08:55.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.355+0000 7f4085c00640 1 --2- 172.21.15.99:0/3178181240 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f40800fe4f0 0x7f408018cad0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:55.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.355+0000 7f4085c00640 1 -- 172.21.15.99:0/3178181240 >> 172.21.15.99:0/3178181240 conn(0x7f40800d6bc0 msgr2=0x7f4080072620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:08:55.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.355+0000 7f4085c00640 1 -- 172.21.15.99:0/3178181240 shutdown_connections 2024-02-21T23:08:55.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.356+0000 7f4085c00640 1 -- 172.21.15.99:0/3178181240 wait complete. 2024-02-21T23:08:55.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.359+0000 7f4085c00640 1 Processor -- start 2024-02-21T23:08:55.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.359+0000 7f4085c00640 1 -- start start 2024-02-21T23:08:55.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.361+0000 7f4085c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f408006c540 0x7f4080174250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:55.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.361+0000 7f4085c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f40800fe4f0 0x7f4080220080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:55.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.361+0000 7f4085c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40800fe8d0 0x7f40802205c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:55.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.361+0000 7f4085c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f408006bd40 con 0x7f40800fe8d0 2024-02-21T23:08:55.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.361+0000 7f4085c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f408006ba60 con 0x7f408006c540 2024-02-21T23:08:55.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.361+0000 7f4085c00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f408018a1b0 con 0x7f40800fe4f0 2024-02-21T23:08:55.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.361+0000 7f407ea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f408006c540 0x7f4080174250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:55.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.361+0000 7f407ea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f408006c540 0x7f4080174250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:59196/0 (socket says 172.21.15.99:59196) 2024-02-21T23:08:55.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.361+0000 7f407f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40800fe8d0 0x7f40802205c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:55.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.361+0000 7f407ea00640 1 -- 172.21.15.99:0/3387857872 learned_addr learned my addr 172.21.15.99:0/3387857872 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:08:55.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.361+0000 7f407e000640 1 --2- 172.21.15.99:0/3387857872 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f40800fe4f0 0x7f4080220080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:55.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.362+0000 7f407ea00640 1 -- 172.21.15.99:0/3387857872 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f40800fe4f0 msgr2=0x7f4080220080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:55.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.362+0000 7f407ea00640 1 --2- 172.21.15.99:0/3387857872 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f40800fe4f0 0x7f4080220080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:55.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.362+0000 7f407ea00640 1 -- 172.21.15.99:0/3387857872 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40800fe8d0 msgr2=0x7f40802205c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:55.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.362+0000 7f407ea00640 1 --2- 172.21.15.99:0/3387857872 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40800fe8d0 0x7f40802205c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:55.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.362+0000 7f407ea00640 1 -- 172.21.15.99:0/3387857872 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40800d0bb0 con 0x7f408006c540 2024-02-21T23:08:55.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.362+0000 7f407ea00640 1 --2- 172.21.15.99:0/3387857872 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f408006c540 0x7f4080174250 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f40680097a0 tx=0x7f40680046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:55.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.363+0000 7f4076a00640 1 -- 172.21.15.99:0/3387857872 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4068037040 con 0x7f408006c540 2024-02-21T23:08:55.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.363+0000 7f4076a00640 1 -- 172.21.15.99:0/3387857872 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4068004250 con 0x7f408006c540 2024-02-21T23:08:55.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.363+0000 7f4085c00640 1 -- 172.21.15.99:0/3387857872 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40800d0e90 con 0x7f408006c540 2024-02-21T23:08:55.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.363+0000 7f4076a00640 1 -- 172.21.15.99:0/3387857872 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40680327b0 con 0x7f408006c540 2024-02-21T23:08:55.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.363+0000 7f4085c00640 1 -- 172.21.15.99:0/3387857872 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40800d1450 con 0x7f408006c540 2024-02-21T23:08:55.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.367+0000 7f4088ba6740 1 Processor -- start 2024-02-21T23:08:55.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.367+0000 7f4088ba6740 1 -- start start 2024-02-21T23:08:55.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.367+0000 7f4076a00640 1 -- 172.21.15.99:0/3387857872 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f40680305d0 con 0x7f408006c540 2024-02-21T23:08:55.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.368+0000 7f4088ba6740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592bd7c04b0 0x5592bd7c0890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:55.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.368+0000 7f4088ba6740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5592bd7fb180 0x5592bd7fb600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:55.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.368+0000 7f4088ba6740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5592bd7fbb40 0x5592bd7fc3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:55.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.368+0000 7f4088ba6740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592bd6e8b50 con 0x5592bd7fb180 2024-02-21T23:08:55.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.368+0000 7f4088ba6740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592bd691da0 con 0x5592bd7c04b0 2024-02-21T23:08:55.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.368+0000 7f4088ba6740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592bd6e4bf0 con 0x5592bd7fbb40 2024-02-21T23:08:55.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.369+0000 7f407f400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592bd7c04b0 0x5592bd7c0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:55.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.369+0000 7f407ea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5592bd7fb180 0x5592bd7fb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:55.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.369+0000 7f407f400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592bd7c04b0 0x5592bd7c0890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:59202/0 (socket says 172.21.15.99:59202) 2024-02-21T23:08:55.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.369+0000 7f407f400640 1 -- 172.21.15.99:0/1712362511 learned_addr learned my addr 172.21.15.99:0/1712362511 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:08:55.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.369+0000 7f407e000640 1 --2- 172.21.15.99:0/1712362511 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5592bd7fbb40 0x5592bd7fc3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:55.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.369+0000 7f407f400640 1 -- 172.21.15.99:0/1712362511 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5592bd7fbb40 msgr2=0x5592bd7fc3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:55.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.369+0000 7f407f400640 1 --2- 172.21.15.99:0/1712362511 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5592bd7fbb40 0x5592bd7fc3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:55.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.369+0000 7f407f400640 1 -- 172.21.15.99:0/1712362511 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5592bd7fb180 msgr2=0x5592bd7fb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:55.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.369+0000 7f407f400640 1 --2- 172.21.15.99:0/1712362511 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5592bd7fb180 0x5592bd7fb600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:55.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.369+0000 7f407f400640 1 -- 172.21.15.99:0/1712362511 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5592bd6b4f80 con 0x5592bd7c04b0 2024-02-21T23:08:55.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.369+0000 7f407ea00640 1 --2- 172.21.15.99:0/1712362511 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5592bd7fb180 0x5592bd7fb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:08:55.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.370+0000 7f4076a00640 1 --2- 172.21.15.99:0/3387857872 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f405c09ef00 0x7f405c0a13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:55.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.370+0000 7f407f400640 1 --2- 172.21.15.99:0/1712362511 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592bd7c04b0 0x5592bd7c0890 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f4078007770 tx=0x7f4078004c70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=565fc1cbf7dac82a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:55.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.370+0000 7f4076a00640 1 -- 172.21.15.99:0/3387857872 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f40680ec280 con 0x7f408006c540 2024-02-21T23:08:55.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.370+0000 7f407ea00640 1 --2- 172.21.15.99:0/3387857872 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f405c09ef00 0x7f405c0a13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:55.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.370+0000 7f406f400640 1 -- 172.21.15.99:0/1712362511 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f407801a070 con 0x5592bd7c04b0 2024-02-21T23:08:55.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.370+0000 7f406f400640 1 -- 172.21.15.99:0/1712362511 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40780018a0 con 0x5592bd7c04b0 2024-02-21T23:08:55.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.370+0000 7f406f400640 1 -- 172.21.15.99:0/1712362511 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4078001c50 con 0x5592bd7c04b0 2024-02-21T23:08:55.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.371+0000 7f4088ba6740 1 -- 172.21.15.99:0/1712362511 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592bd7c04b0 msgr2=0x5592bd7c0890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:55.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.371+0000 7f4088ba6740 1 --2- 172.21.15.99:0/1712362511 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592bd7c04b0 0x5592bd7c0890 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f4078007770 tx=0x7f4078004c70 comp rx=0 tx=0).stop 2024-02-21T23:08:55.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.371+0000 7f407ea00640 1 --2- 172.21.15.99:0/3387857872 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f405c09ef00 0x7f405c0a13c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x5592bd7c4690 tx=0x7f40680efd30 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:55.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.371+0000 7f4088ba6740 1 -- 172.21.15.99:0/1712362511 shutdown_connections 2024-02-21T23:08:55.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.371+0000 7f4088ba6740 1 --2- 172.21.15.99:0/1712362511 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5592bd7fbb40 0x5592bd7fc3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:55.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.371+0000 7f4088ba6740 1 --2- 172.21.15.99:0/1712362511 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5592bd7fb180 0x5592bd7fb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:55.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.371+0000 7f4088ba6740 1 --2- 172.21.15.99:0/1712362511 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592bd7c04b0 0x5592bd7c0890 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:55.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.371+0000 7f4088ba6740 1 -- 172.21.15.99:0/1712362511 >> 172.21.15.99:0/1712362511 conn(0x5592bd782520 msgr2=0x5592bd7835a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:08:55.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.371+0000 7f4088ba6740 1 -- 172.21.15.99:0/1712362511 shutdown_connections 2024-02-21T23:08:55.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.371+0000 7f4088ba6740 1 -- 172.21.15.99:0/1712362511 wait complete. 2024-02-21T23:08:55.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.372+0000 7f4088ba6740 1 -- start start 2024-02-21T23:08:55.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.372+0000 7f4088ba6740 1 Processor -- start 2024-02-21T23:08:55.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.373+0000 7f4088ba6740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5592bd7fb180 0x5592bd803840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:55.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.373+0000 7f4088ba6740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5592bd7fbb40 0x5592bd7caaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:55.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.373+0000 7f4088ba6740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592bd7ed430 0x5592bd7bc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:55.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.373+0000 7f4088ba6740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592bd7f9ef0 con 0x5592bd7fbb40 2024-02-21T23:08:55.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.373+0000 7f4088ba6740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592bd687380 con 0x5592bd7ed430 2024-02-21T23:08:55.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.373+0000 7f4088ba6740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592bd7f9c10 con 0x5592bd7fb180 2024-02-21T23:08:55.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.374+0000 7f4088ba6740 10 client.0 _ll_register_callbacks cb 0x5592bd6e0280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:08:55.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.374+0000 7f407f400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5592bd7fb180 0x5592bd803840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:55.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.374+0000 7f407f400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5592bd7fb180 0x5592bd803840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:56156/0 (socket says 172.21.15.99:56156) 2024-02-21T23:08:55.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.374+0000 7f407f400640 1 -- 172.21.15.99:0/2326252662 learned_addr learned my addr 172.21.15.99:0/2326252662 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:08:55.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.374+0000 7f407f400640 1 --2- 172.21.15.99:0/2326252662 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592bd7ed430 0x5592bd7bc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:55.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.374+0000 7f407f400640 1 -- 172.21.15.99:0/2326252662 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592bd7ed430 msgr2=0x5592bd7bc9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:55.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.374+0000 7f407f400640 1 --2- 172.21.15.99:0/2326252662 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592bd7ed430 0x5592bd7bc9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:55.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.374+0000 7f407f400640 1 -- 172.21.15.99:0/2326252662 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5592bd7fbb40 msgr2=0x5592bd7caaf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T23:08:55.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.377+0000 7f407e000640 1 --2- 172.21.15.99:0/2326252662 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5592bd7fbb40 0x5592bd7caaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:55.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.377+0000 7f407f400640 1 --2- 172.21.15.99:0/2326252662 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5592bd7fbb40 0x5592bd7caaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:55.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.377+0000 7f407f400640 1 -- 172.21.15.99:0/2326252662 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5592bd6afc20 con 0x5592bd7fb180 2024-02-21T23:08:55.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.377+0000 7f407e000640 1 --2- 172.21.15.99:0/2326252662 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5592bd7fbb40 0x5592bd7caaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T23:08:55.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.378+0000 7f407f400640 1 --2- 172.21.15.99:0/2326252662 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5592bd7fb180 0x5592bd803840 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x5592bd7b5120 tx=0x7f407800c000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=94dafaca95a48244 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:55.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.378+0000 7f4063e00640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-02-21T23:08:55.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.378+0000 7f4063e00640 1 -- 172.21.15.99:0/2326252662 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f407802a060 con 0x5592bd7fb180 2024-02-21T23:08:55.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.378+0000 7f4088ba6740 1 -- 172.21.15.99:0/2326252662 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f40780018a0 con 0x5592bd7fb180 2024-02-21T23:08:55.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.378+0000 7f4063e00640 1 -- 172.21.15.99:0/2326252662 <== mon.2 v2:172.21.15.181:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f4078024680 con 0x5592bd7fb180 2024-02-21T23:08:55.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.378+0000 7f4063e00640 1 -- 172.21.15.99:0/2326252662 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4078031050 con 0x5592bd7fb180 2024-02-21T23:08:55.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.378+0000 7f4088ba6740 10 client.6560 fetch_fsmap learned FSMap version 17 2024-02-21T23:08:55.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.378+0000 7f4088ba6740 1 -- 172.21.15.99:0/2326252662 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5592bd3fd3f0 con 0x5592bd7fb180 2024-02-21T23:08:55.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.379+0000 7f4063e00640 1 -- 172.21.15.99:0/2326252662 <== mon.2 v2:172.21.15.181:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40780018a0 con 0x5592bd7fb180 2024-02-21T23:08:55.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.379+0000 7f4063e00640 1 -- 172.21.15.99:0/2326252662 <== mon.2 v2:172.21.15.181:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f4078024880 con 0x5592bd7fb180 2024-02-21T23:08:55.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.379+0000 7f4088ba6740 10 client.6560 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:08:55.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.379+0000 7f4088ba6740 10 client.6560 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:08:55.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.379+0000 7f4088ba6740 20 client.6560 populate_metadata read hostname 'smithi099' 2024-02-21T23:08:55.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.379+0000 7f4088ba6740 1 --2- 172.21.15.99:0/2326252662 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5592bd7ed830 0x5592bd7bd400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:55.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.379+0000 7f4088ba6740 4 client.6560 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:08:55.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.379+0000 7f4088ba6740 1 -- 172.21.15.99:0/2326252662 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5592bd6f6090 con 0x5592bd7ed830 2024-02-21T23:08:55.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.379+0000 7f407e000640 1 --2- 172.21.15.99:0/2326252662 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5592bd7ed830 0x5592bd7bd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:55.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.381+0000 7f407e000640 1 --2- 172.21.15.99:0/2326252662 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5592bd7ed830 0x5592bd7bd400 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e457b3e4626b6843 server_cookie=51e1f11949b11876 in_seq=0 out_seq=0 2024-02-21T23:08:55.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.381+0000 7f4063e00640 10 client.6560 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:08:55.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.381+0000 7f4063e00640 1 -- 172.21.15.99:0/2326252662 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x5592bd6f6090 con 0x5592bd7ed830 2024-02-21T23:08:55.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.381+0000 7f4063e00640 10 client.6560 handle_command_reply: tid=0 2024-02-21T23:08:55.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.381+0000 7f4088ba6740 1 client.6560 shutdown 2024-02-21T23:08:55.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.382+0000 7f4088ba6740 1 -- 172.21.15.99:0/2326252662 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5592bd7fb180 msgr2=0x5592bd803840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:55.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.382+0000 7f4088ba6740 1 --2- 172.21.15.99:0/2326252662 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5592bd7fb180 0x5592bd803840 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x5592bd7b5120 tx=0x7f407800c000 comp rx=0 tx=0).stop 2024-02-21T23:08:55.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.382+0000 7f4088ba6740 1 -- 172.21.15.99:0/2326252662 shutdown_connections 2024-02-21T23:08:55.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.382+0000 7f4088ba6740 1 --2- 172.21.15.99:0/2326252662 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5592bd7ed830 0x5592bd7bd400 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:55.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.382+0000 7f4088ba6740 1 --2- 172.21.15.99:0/2326252662 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592bd7ed430 0x5592bd7bc9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:55.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.382+0000 7f4088ba6740 1 --2- 172.21.15.99:0/2326252662 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5592bd7fbb40 0x5592bd7caaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:55.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.382+0000 7f4063e00640 0 client.6560 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:08:55.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.382+0000 7f4088ba6740 1 --2- 172.21.15.99:0/2326252662 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5592bd7fb180 0x5592bd803840 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:55.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.382+0000 7f4088ba6740 1 -- 172.21.15.99:0/2326252662 >> 172.21.15.99:0/2326252662 conn(0x5592bd7c04b0 msgr2=0x5592bd7f93a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:08:55.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.382+0000 7f4088ba6740 1 -- 172.21.15.99:0/2326252662 shutdown_connections 2024-02-21T23:08:55.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.382+0000 7f4088ba6740 1 -- 172.21.15.99:0/2326252662 wait complete. 2024-02-21T23:08:55.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.382+0000 7f4088ba6740 20 client.6560 trim_cache size 0 max 16384 2024-02-21T23:08:55.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.396+0000 7f4088ba6740 1 Processor -- start 2024-02-21T23:08:55.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.396+0000 7f4088ba6740 1 -- start start 2024-02-21T23:08:55.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.397+0000 7f4088ba6740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5592bd7ed430 0x5592bd7c4000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:55.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.397+0000 7f4088ba6740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5592bd7fb180 0x5592bd803820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:55.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.397+0000 7f4088ba6740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592bd7fbb40 0x5592bd7c93f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:55.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.397+0000 7f4088ba6740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f408022ca70 con 0x5592bd7fb180 2024-02-21T23:08:55.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.397+0000 7f4088ba6740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f408022a610 con 0x5592bd7fbb40 2024-02-21T23:08:55.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.397+0000 7f4088ba6740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f408021f4e0 con 0x5592bd7ed430 2024-02-21T23:08:55.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.397+0000 7f407e000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5592bd7fb180 0x5592bd803820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:55.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.397+0000 7f407e000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5592bd7fb180 0x5592bd803820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53052/0 (socket says 172.21.15.99:53052) 2024-02-21T23:08:55.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.397+0000 7f407e000640 1 -- 172.21.15.99:0/4055150235 learned_addr learned my addr 172.21.15.99:0/4055150235 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:08:55.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.397+0000 7f407f400640 1 --2- 172.21.15.99:0/4055150235 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5592bd7ed430 0x5592bd7c4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:55.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.397+0000 7f407f400640 1 --2- 172.21.15.99:0/4055150235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592bd7fbb40 0x5592bd7c93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:55.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.398+0000 7f407e000640 1 -- 172.21.15.99:0/4055150235 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5592bd7ed430 msgr2=0x5592bd7c4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:55.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.398+0000 7f407e000640 1 --2- 172.21.15.99:0/4055150235 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5592bd7ed430 0x5592bd7c4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:55.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.398+0000 7f407e000640 1 -- 172.21.15.99:0/4055150235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592bd7fbb40 msgr2=0x5592bd7c93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:55.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.398+0000 7f407e000640 1 --2- 172.21.15.99:0/4055150235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592bd7fbb40 0x5592bd7c93f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:55.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.398+0000 7f407e000640 1 -- 172.21.15.99:0/4055150235 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5592bd4c77d0 con 0x5592bd7fb180 2024-02-21T23:08:55.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.398+0000 7f407f400640 1 --2- 172.21.15.99:0/4055150235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592bd7fbb40 0x5592bd7c93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:08:55.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.398+0000 7f407e000640 1 --2- 172.21.15.99:0/4055150235 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5592bd7fb180 0x5592bd803820 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f4070003ee0 tx=0x7f4070001f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4731cf2b916a74b3 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:55.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.398+0000 7f406ea00640 1 -- 172.21.15.99:0/4055150235 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f407001a070 con 0x5592bd7fb180 2024-02-21T23:08:55.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.398+0000 7f406ea00640 1 -- 172.21.15.99:0/4055150235 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f407001bd40 con 0x5592bd7fb180 2024-02-21T23:08:55.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.398+0000 7f406ea00640 1 -- 172.21.15.99:0/4055150235 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4070005070 con 0x5592bd7fb180 2024-02-21T23:08:55.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.399+0000 7f4088ba6740 1 -- 172.21.15.99:0/4055150235 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5592bd7fb180 msgr2=0x5592bd803820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:55.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.399+0000 7f4088ba6740 1 --2- 172.21.15.99:0/4055150235 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5592bd7fb180 0x5592bd803820 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f4070003ee0 tx=0x7f4070001f60 comp rx=0 tx=0).stop 2024-02-21T23:08:55.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.399+0000 7f4088ba6740 1 -- 172.21.15.99:0/4055150235 shutdown_connections 2024-02-21T23:08:55.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.399+0000 7f4088ba6740 1 --2- 172.21.15.99:0/4055150235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592bd7fbb40 0x5592bd7c93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:55.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.399+0000 7f4088ba6740 1 --2- 172.21.15.99:0/4055150235 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5592bd7fb180 0x5592bd803820 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:55.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.399+0000 7f4088ba6740 1 --2- 172.21.15.99:0/4055150235 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5592bd7ed430 0x5592bd7c4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:55.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.399+0000 7f4088ba6740 1 -- 172.21.15.99:0/4055150235 >> 172.21.15.99:0/4055150235 conn(0x5592bd7c04b0 msgr2=0x5592bd78ac20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:08:55.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.399+0000 7f4088ba6740 1 -- 172.21.15.99:0/4055150235 shutdown_connections 2024-02-21T23:08:55.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.399+0000 7f4088ba6740 1 -- 172.21.15.99:0/4055150235 wait complete. 2024-02-21T23:08:55.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.400+0000 7f4088ba6740 1 -- start start 2024-02-21T23:08:55.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.400+0000 7f4088ba6740 1 Processor -- start 2024-02-21T23:08:55.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.402+0000 7f4088ba6740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5592bd7ed430 0x5592bd7cdec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:55.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.402+0000 7f4088ba6740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592bd7fb180 0x5592bd7b9170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:55.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.402+0000 7f4088ba6740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5592bd7fbb40 0x5592bd860d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:55.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.402+0000 7f4088ba6740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f408021fae0 con 0x5592bd7ed430 2024-02-21T23:08:55.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.402+0000 7f4088ba6740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4080229fd0 con 0x5592bd7fb180 2024-02-21T23:08:55.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.402+0000 7f4088ba6740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40802293d0 con 0x5592bd7fbb40 2024-02-21T23:08:55.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.402+0000 7f4088ba6740 10 client.0 _ll_register_callbacks cb 0x7f4078018070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:08:55.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.402+0000 7f407f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5592bd7ed430 0x5592bd7cdec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:55.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.402+0000 7f407f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5592bd7ed430 0x5592bd7cdec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53056/0 (socket says 172.21.15.99:53056) 2024-02-21T23:08:55.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.402+0000 7f407f400640 1 -- 172.21.15.99:0/1143234139 learned_addr learned my addr 172.21.15.99:0/1143234139 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:08:55.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.402+0000 7f407e000640 1 --2- 172.21.15.99:0/1143234139 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592bd7fb180 0x5592bd7b9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:55.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.402+0000 7f407f400640 1 --2- 172.21.15.99:0/1143234139 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5592bd7fbb40 0x5592bd860d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:55.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.403+0000 7f407f400640 1 -- 172.21.15.99:0/1143234139 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5592bd7fbb40 msgr2=0x5592bd860d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:55.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.403+0000 7f407f400640 1 --2- 172.21.15.99:0/1143234139 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5592bd7fbb40 0x5592bd860d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:55.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.403+0000 7f407f400640 1 -- 172.21.15.99:0/1143234139 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592bd7fb180 msgr2=0x5592bd7b9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:55.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.403+0000 7f407f400640 1 --2- 172.21.15.99:0/1143234139 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592bd7fb180 0x5592bd7b9170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:55.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.403+0000 7f407f400640 1 -- 172.21.15.99:0/1143234139 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5592bd781310 con 0x5592bd7ed430 2024-02-21T23:08:55.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.403+0000 7f407e000640 1 --2- 172.21.15.99:0/1143234139 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592bd7fb180 0x5592bd7b9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:08:55.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.403+0000 7f407f400640 1 --2- 172.21.15.99:0/1143234139 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5592bd7ed430 0x5592bd7cdec0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f407802f040 tx=0x7f4078012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a496f200517aaa04 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:55.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.403+0000 7f4063e00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:08:55.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.403+0000 7f4063e00640 1 -- 172.21.15.99:0/1143234139 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f407802a040 con 0x5592bd7ed430 2024-02-21T23:08:55.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.403+0000 7f4063e00640 1 -- 172.21.15.99:0/1143234139 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7f4078001890 con 0x5592bd7ed430 2024-02-21T23:08:55.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.403+0000 7f4088ba6740 1 -- 172.21.15.99:0/1143234139 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f407001bd40 con 0x5592bd7ed430 2024-02-21T23:08:55.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.404+0000 7f4063e00640 1 -- 172.21.15.99:0/1143234139 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4078046050 con 0x5592bd7ed430 2024-02-21T23:08:55.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.404+0000 7f4088ba6740 10 client.6450 fetch_fsmap learned FSMap version 17 2024-02-21T23:08:55.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.404+0000 7f4088ba6740 1 -- 172.21.15.99:0/1143234139 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5592bd7b9c10 con 0x5592bd7ed430 2024-02-21T23:08:55.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.404+0000 7f4063e00640 1 -- 172.21.15.99:0/1143234139 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f407001bd40 con 0x5592bd7ed430 2024-02-21T23:08:55.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.404+0000 7f4063e00640 1 -- 172.21.15.99:0/1143234139 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f4078024480 con 0x5592bd7ed430 2024-02-21T23:08:55.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.404+0000 7f4088ba6740 10 client.6450 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:08:55.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.404+0000 7f4088ba6740 10 client.6450 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:08:55.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.404+0000 7f4088ba6740 20 client.6450 populate_metadata read hostname 'smithi099' 2024-02-21T23:08:55.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.404+0000 7f4088ba6740 1 --2- 172.21.15.99:0/1143234139 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5592bd7bc910 0x5592bd866b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:55.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.404+0000 7f4088ba6740 4 client.6450 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T23:08:55.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.404+0000 7f4088ba6740 1 -- 172.21.15.99:0/1143234139 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5592bd6f03e0 con 0x5592bd7bc910 2024-02-21T23:08:55.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.405+0000 7f407e000640 1 --2- 172.21.15.99:0/1143234139 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5592bd7bc910 0x5592bd866b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:55.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.405+0000 7f407e000640 1 --2- 172.21.15.99:0/1143234139 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5592bd7bc910 0x5592bd866b50 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=adfe4fde6e64b17b server_cookie=5f0b4ebac28fdb25 in_seq=0 out_seq=0 2024-02-21T23:08:55.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.405+0000 7f4063e00640 10 client.6450 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:08:55.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.405+0000 7f4063e00640 1 -- 172.21.15.99:0/1143234139 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5592bd6f03e0 con 0x5592bd7bc910 2024-02-21T23:08:55.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.405+0000 7f4063e00640 10 client.6450 handle_command_reply: tid=0 2024-02-21T23:08:55.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.405+0000 7f4088ba6740 1 client.6450 shutdown 2024-02-21T23:08:55.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.405+0000 7f4088ba6740 1 -- 172.21.15.99:0/1143234139 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5592bd7ed430 msgr2=0x5592bd7cdec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:55.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.405+0000 7f4088ba6740 1 --2- 172.21.15.99:0/1143234139 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5592bd7ed430 0x5592bd7cdec0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f407802f040 tx=0x7f4078012000 comp rx=0 tx=0).stop 2024-02-21T23:08:55.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.406+0000 7f4088ba6740 1 -- 172.21.15.99:0/1143234139 shutdown_connections 2024-02-21T23:08:55.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.406+0000 7f4088ba6740 1 --2- 172.21.15.99:0/1143234139 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5592bd7bc910 0x5592bd866b50 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:55.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.406+0000 7f4088ba6740 1 --2- 172.21.15.99:0/1143234139 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5592bd7fbb40 0x5592bd860d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:55.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.406+0000 7f4088ba6740 1 --2- 172.21.15.99:0/1143234139 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5592bd7fb180 0x5592bd7b9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:55.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.406+0000 7f4088ba6740 1 --2- 172.21.15.99:0/1143234139 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5592bd7ed430 0x5592bd7cdec0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:55.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.406+0000 7f4088ba6740 1 -- 172.21.15.99:0/1143234139 >> 172.21.15.99:0/1143234139 conn(0x5592bd7c04b0 msgr2=0x5592bd807ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:08:55.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.406+0000 7f4063e00640 0 client.6450 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:08:55.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.406+0000 7f4088ba6740 1 -- 172.21.15.99:0/1143234139 shutdown_connections 2024-02-21T23:08:55.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.406+0000 7f4088ba6740 1 -- 172.21.15.99:0/1143234139 wait complete. 2024-02-21T23:08:55.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.406+0000 7f4088ba6740 20 client.6450 trim_cache size 0 max 16384 2024-02-21T23:08:55.402 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-02-21T23:08:55.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.407+0000 7f4085c00640 1 -- 172.21.15.99:0/3387857872 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f405c09ef00 msgr2=0x7f405c0a13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:55.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.407+0000 7f4085c00640 1 --2- 172.21.15.99:0/3387857872 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f405c09ef00 0x7f405c0a13c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x5592bd7c4690 tx=0x7f40680efd30 comp rx=0 tx=0).stop 2024-02-21T23:08:55.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.407+0000 7f4085c00640 1 -- 172.21.15.99:0/3387857872 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f408006c540 msgr2=0x7f4080174250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:55.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.407+0000 7f4085c00640 1 --2- 172.21.15.99:0/3387857872 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f408006c540 0x7f4080174250 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f40680097a0 tx=0x7f40680046c0 comp rx=0 tx=0).stop 2024-02-21T23:08:55.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.407+0000 7f4085c00640 1 -- 172.21.15.99:0/3387857872 shutdown_connections 2024-02-21T23:08:55.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.407+0000 7f4085c00640 1 --2- 172.21.15.99:0/3387857872 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f405c09ef00 0x7f405c0a13c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:55.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.407+0000 7f4085c00640 1 --2- 172.21.15.99:0/3387857872 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f40800fe8d0 0x7f40802205c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:55.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.407+0000 7f4085c00640 1 --2- 172.21.15.99:0/3387857872 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f40800fe4f0 0x7f4080220080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:55.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.407+0000 7f4085c00640 1 --2- 172.21.15.99:0/3387857872 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f408006c540 0x7f4080174250 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:55.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.407+0000 7f4085c00640 1 -- 172.21.15.99:0/3387857872 >> 172.21.15.99:0/3387857872 conn(0x7f40800d6bc0 msgr2=0x7f408006c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:08:55.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.407+0000 7f4085c00640 1 -- 172.21.15.99:0/3387857872 shutdown_connections 2024-02-21T23:08:55.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:55.407+0000 7f4085c00640 1 -- 172.21.15.99:0/3387857872 wait complete. 2024-02-21T23:08:56.415 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-02-21T23:08:56.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T23:08:56.416 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-02-21T23:08:56.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.627+0000 7fb50e000640 1 Processor -- start 2024-02-21T23:08:56.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.627+0000 7fb50e000640 1 -- start start 2024-02-21T23:08:56.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.629+0000 7fb50e000640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fb50817f5e0 0x7fb508071e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:56.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.629+0000 7fb50e000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5080727f0 con 0x7fb508072370 2024-02-21T23:08:56.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.629+0000 7fb50e000640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5080cfeb0 con 0x7fb508187c90 2024-02-21T23:08:56.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.629+0000 7fb50e000640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb508186b30 con 0x7fb50817f5e0 2024-02-21T23:08:56.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.630+0000 7fb4ffe00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fb508072370 0x7fb508187580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.99:40026/0 (socket says 172.21.15.99:40026) 2024-02-21T23:08:56.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.630+0000 7fb4ffe00640 1 -- 172.21.15.99:0/1481850557 learned_addr learned my addr 172.21.15.99:0/1481850557 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:08:56.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.630+0000 7fb507400640 1 --2- 172.21.15.99:0/1481850557 >> v2:172.21.15.181:3300/0 conn(0x7fb50817f5e0 0x7fb508071e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:56.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.630+0000 7fb506a00640 1 -- 172.21.15.99:0/1481850557 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1530957577 0 0) 0x7fb5080727f0 con 0x7fb508072370 2024-02-21T23:08:56.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.630+0000 7fb506a00640 1 -- 172.21.15.99:0/1481850557 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4ec003520 con 0x7fb508072370 2024-02-21T23:08:56.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.630+0000 7fb506a00640 1 -- 172.21.15.99:0/1481850557 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2796890512 0 0) 0x7fb5080cfeb0 con 0x7fb508187c90 2024-02-21T23:08:56.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.630+0000 7fb506a00640 1 -- 172.21.15.99:0/1481850557 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5080727f0 con 0x7fb508187c90 2024-02-21T23:08:56.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.630+0000 7fb507400640 1 -- 172.21.15.99:0/1481850557 >> v1:172.21.15.181:6789/0 conn(0x7fb508187c90 legacy=0x7fb5080cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:56.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.630+0000 7fb507400640 1 -- 172.21.15.99:0/1481850557 >> v1:172.21.15.162:6789/0 conn(0x7fb508072370 legacy=0x7fb508187580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:56.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.630+0000 7fb507400640 1 -- 172.21.15.99:0/1481850557 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5080d0190 con 0x7fb50817f5e0 2024-02-21T23:08:56.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.632+0000 7fb507400640 1 --2- 172.21.15.99:0/1481850557 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb50817f5e0 0x7fb508071e30 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fb4f80097a0 tx=0x7fb4f802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9518914f2b77d250 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:56.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.633+0000 7fb506a00640 1 -- 172.21.15.99:0/1481850557 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f8035020 con 0x7fb50817f5e0 2024-02-21T23:08:56.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.633+0000 7fb506a00640 1 -- 172.21.15.99:0/1481850557 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4f8031830 con 0x7fb50817f5e0 2024-02-21T23:08:56.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.633+0000 7fb506a00640 1 -- 172.21.15.99:0/1481850557 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f8031c00 con 0x7fb50817f5e0 2024-02-21T23:08:56.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.634+0000 7fb50e000640 1 -- 172.21.15.99:0/1481850557 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb50817f5e0 msgr2=0x7fb508071e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:56.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.634+0000 7fb50e000640 1 --2- 172.21.15.99:0/1481850557 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb50817f5e0 0x7fb508071e30 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fb4f80097a0 tx=0x7fb4f802b8d0 comp rx=0 tx=0).stop 2024-02-21T23:08:56.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.634+0000 7fb50e000640 1 -- 172.21.15.99:0/1481850557 shutdown_connections 2024-02-21T23:08:56.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.634+0000 7fb50e000640 1 --2- 172.21.15.99:0/1481850557 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb50817f5e0 0x7fb508071e30 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:56.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.634+0000 7fb50e000640 1 -- 172.21.15.99:0/1481850557 >> 172.21.15.99:0/1481850557 conn(0x7fb5080fe610 msgr2=0x7fb5080fea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:08:56.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.634+0000 7fb50e000640 1 -- 172.21.15.99:0/1481850557 shutdown_connections 2024-02-21T23:08:56.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.634+0000 7fb50e000640 1 -- 172.21.15.99:0/1481850557 wait complete. 2024-02-21T23:08:56.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.636+0000 7fb50e000640 1 Processor -- start 2024-02-21T23:08:56.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.637+0000 7fb50e000640 1 -- start start 2024-02-21T23:08:56.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.639+0000 7fb50e000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb508072370 0x7fb5081723a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:56.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.639+0000 7fb50e000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb50817f5e0 0x7fb508168420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:56.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.639+0000 7fb50e000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb508187c90 0x7fb508171320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:56.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.639+0000 7fb50e000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb508187060 con 0x7fb50817f5e0 2024-02-21T23:08:56.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.639+0000 7fb50e000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb508186d80 con 0x7fb508187c90 2024-02-21T23:08:56.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.639+0000 7fb50e000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb50817f9c0 con 0x7fb508072370 2024-02-21T23:08:56.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.639+0000 7fb507400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb508072370 0x7fb5081723a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:56.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.639+0000 7fb507400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb508072370 0x7fb5081723a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:56202/0 (socket says 172.21.15.99:56202) 2024-02-21T23:08:56.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.639+0000 7fb507400640 1 -- 172.21.15.99:0/2647406296 learned_addr learned my addr 172.21.15.99:0/2647406296 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:08:56.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.639+0000 7fb4ffe00640 1 --2- 172.21.15.99:0/2647406296 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb50817f5e0 0x7fb508168420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:56.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.639+0000 7fb507e00640 1 --2- 172.21.15.99:0/2647406296 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb508187c90 0x7fb508171320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:56.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.639+0000 7fb507400640 1 -- 172.21.15.99:0/2647406296 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb508187c90 msgr2=0x7fb508171320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:56.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.639+0000 7fb507400640 1 --2- 172.21.15.99:0/2647406296 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb508187c90 0x7fb508171320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:56.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.639+0000 7fb507400640 1 -- 172.21.15.99:0/2647406296 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb50817f5e0 msgr2=0x7fb508168420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:56.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.639+0000 7fb507400640 1 --2- 172.21.15.99:0/2647406296 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb50817f5e0 0x7fb508168420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:56.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.639+0000 7fb507400640 1 -- 172.21.15.99:0/2647406296 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb50816ffa0 con 0x7fb508072370 2024-02-21T23:08:56.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.639+0000 7fb507e00640 1 --2- 172.21.15.99:0/2647406296 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb508187c90 0x7fb508171320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:08:56.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.640+0000 7fb507400640 1 --2- 172.21.15.99:0/2647406296 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb508072370 0x7fb5081723a0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fb4f8034040 tx=0x7fb4f80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:56.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.640+0000 7fb4ff400640 1 -- 172.21.15.99:0/2647406296 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f8040070 con 0x7fb508072370 2024-02-21T23:08:56.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.640+0000 7fb4ff400640 1 -- 172.21.15.99:0/2647406296 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4f803a910 con 0x7fb508072370 2024-02-21T23:08:56.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.640+0000 7fb50e000640 1 -- 172.21.15.99:0/2647406296 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb508170280 con 0x7fb508072370 2024-02-21T23:08:56.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.640+0000 7fb4ff400640 1 -- 172.21.15.99:0/2647406296 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f8035040 con 0x7fb508072370 2024-02-21T23:08:56.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.641+0000 7fb50e000640 1 -- 172.21.15.99:0/2647406296 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb508170840 con 0x7fb508072370 2024-02-21T23:08:56.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.644+0000 7fb4ff400640 1 -- 172.21.15.99:0/2647406296 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7fb4f8038020 con 0x7fb508072370 2024-02-21T23:08:56.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.645+0000 7fb4ff400640 1 --2- 172.21.15.99:0/2647406296 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fb4e409eed0 0x7fb4e40a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:56.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.645+0000 7fb4ff400640 1 -- 172.21.15.99:0/2647406296 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7fb4f80eb720 con 0x7fb508072370 2024-02-21T23:08:56.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.645+0000 7fb4ffe00640 1 --2- 172.21.15.99:0/2647406296 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fb4e409eed0 0x7fb4e40a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:56.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.646+0000 7fb4ffe00640 1 --2- 172.21.15.99:0/2647406296 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fb4e409eed0 0x7fb4e40a1390 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb5080ce360 tx=0x7fb4f0009040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:56.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.647+0000 7fb510f88740 1 Processor -- start 2024-02-21T23:08:56.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.647+0000 7fb510f88740 1 -- start start 2024-02-21T23:08:56.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.649+0000 7fb510f88740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ae3efa42f0 0x55ae3efa46d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:56.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.649+0000 7fb510f88740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ae3efa4c10 0x55ae3efdf480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:56.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.649+0000 7fb510f88740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ae3efdf9c0 0x55ae3efe0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:56.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.649+0000 7fb510f88740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae3eecc790 con 0x55ae3efdf9c0 2024-02-21T23:08:56.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.649+0000 7fb510f88740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae3ee75bf0 con 0x55ae3efa42f0 2024-02-21T23:08:56.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.649+0000 7fb510f88740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae3eec8830 con 0x55ae3efa4c10 2024-02-21T23:08:56.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.649+0000 7fb507400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ae3efa42f0 0x55ae3efa46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:56.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.649+0000 7fb507400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ae3efa42f0 0x55ae3efa46d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:59234/0 (socket says 172.21.15.99:59234) 2024-02-21T23:08:56.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.649+0000 7fb507400640 1 -- 172.21.15.99:0/3586147710 learned_addr learned my addr 172.21.15.99:0/3586147710 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:08:56.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.649+0000 7fb4ffe00640 1 --2- 172.21.15.99:0/3586147710 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ae3efa4c10 0x55ae3efdf480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:56.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.649+0000 7fb507e00640 1 --2- 172.21.15.99:0/3586147710 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ae3efdf9c0 0x55ae3efe0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:56.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.650+0000 7fb507400640 1 -- 172.21.15.99:0/3586147710 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ae3efa4c10 msgr2=0x55ae3efdf480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:56.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.650+0000 7fb507400640 1 --2- 172.21.15.99:0/3586147710 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ae3efa4c10 0x55ae3efdf480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:56.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.650+0000 7fb507400640 1 -- 172.21.15.99:0/3586147710 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ae3efdf9c0 msgr2=0x55ae3efe0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:56.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.650+0000 7fb507400640 1 --2- 172.21.15.99:0/3586147710 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ae3efdf9c0 0x55ae3efe0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:56.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.650+0000 7fb507400640 1 -- 172.21.15.99:0/3586147710 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ae3ee93c40 con 0x55ae3efa42f0 2024-02-21T23:08:56.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.650+0000 7fb4ffe00640 1 --2- 172.21.15.99:0/3586147710 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ae3efa4c10 0x55ae3efdf480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:08:56.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.650+0000 7fb507400640 1 --2- 172.21.15.99:0/3586147710 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ae3efa42f0 0x55ae3efa46d0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fb4f80b8fb0 tx=0x7fb4f80b8980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5b3736619eff92d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:56.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.650+0000 7fb4f7400640 1 -- 172.21.15.99:0/3586147710 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f80b9020 con 0x55ae3efa42f0 2024-02-21T23:08:56.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.650+0000 7fb4f7400640 1 -- 172.21.15.99:0/3586147710 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4f80bd170 con 0x55ae3efa42f0 2024-02-21T23:08:56.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.650+0000 7fb4f7400640 1 -- 172.21.15.99:0/3586147710 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f80c17c0 con 0x55ae3efa42f0 2024-02-21T23:08:56.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.651+0000 7fb510f88740 1 -- 172.21.15.99:0/3586147710 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ae3efa42f0 msgr2=0x55ae3efa46d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:56.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.651+0000 7fb510f88740 1 --2- 172.21.15.99:0/3586147710 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ae3efa42f0 0x55ae3efa46d0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fb4f80b8fb0 tx=0x7fb4f80b8980 comp rx=0 tx=0).stop 2024-02-21T23:08:56.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.651+0000 7fb510f88740 1 -- 172.21.15.99:0/3586147710 shutdown_connections 2024-02-21T23:08:56.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.651+0000 7fb510f88740 1 --2- 172.21.15.99:0/3586147710 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ae3efdf9c0 0x55ae3efe0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:56.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.651+0000 7fb510f88740 1 --2- 172.21.15.99:0/3586147710 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ae3efa4c10 0x55ae3efdf480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:56.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.651+0000 7fb510f88740 1 --2- 172.21.15.99:0/3586147710 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ae3efa42f0 0x55ae3efa46d0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:56.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.651+0000 7fb510f88740 1 -- 172.21.15.99:0/3586147710 >> 172.21.15.99:0/3586147710 conn(0x55ae3ef668c0 msgr2=0x55ae3ef67940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:08:56.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.651+0000 7fb510f88740 1 -- 172.21.15.99:0/3586147710 shutdown_connections 2024-02-21T23:08:56.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.651+0000 7fb510f88740 1 -- 172.21.15.99:0/3586147710 wait complete. 2024-02-21T23:08:56.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.653+0000 7fb510f88740 1 -- start start 2024-02-21T23:08:56.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.653+0000 7fb510f88740 1 Processor -- start 2024-02-21T23:08:56.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.655+0000 7fb510f88740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ae3efa4c10 0x55ae3efa16c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:56.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.655+0000 7fb510f88740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ae3efdf9c0 0x55ae3efd3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:56.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.655+0000 7fb510f88740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ae3efac320 0x55ae3efa0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:56.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.655+0000 7fb510f88740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae3ee75bf0 con 0x55ae3efdf9c0 2024-02-21T23:08:56.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.655+0000 7fb510f88740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae3ee6b1d0 con 0x55ae3efa4c10 2024-02-21T23:08:56.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.655+0000 7fb510f88740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae3efddea0 con 0x55ae3efac320 2024-02-21T23:08:56.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.655+0000 7fb510f88740 10 client.0 _ll_register_callbacks cb 0x55ae3ebe0c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:08:56.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.655+0000 7fb4ffe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ae3efdf9c0 0x55ae3efd3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:56.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.655+0000 7fb507400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ae3efa4c10 0x55ae3efa16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:56.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.656+0000 7fb4ffe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ae3efdf9c0 0x55ae3efd3920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53088/0 (socket says 172.21.15.99:53088) 2024-02-21T23:08:56.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.656+0000 7fb4ffe00640 1 -- 172.21.15.99:0/638827769 learned_addr learned my addr 172.21.15.99:0/638827769 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:08:56.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.656+0000 7fb507e00640 1 --2- 172.21.15.99:0/638827769 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ae3efac320 0x55ae3efa0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:56.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.656+0000 7fb507400640 1 -- 172.21.15.99:0/638827769 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ae3efac320 msgr2=0x55ae3efa0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:56.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.656+0000 7fb507400640 1 --2- 172.21.15.99:0/638827769 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ae3efac320 0x55ae3efa0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:56.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.656+0000 7fb507400640 1 -- 172.21.15.99:0/638827769 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ae3efdf9c0 msgr2=0x55ae3efd3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:56.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.656+0000 7fb507400640 1 --2- 172.21.15.99:0/638827769 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ae3efdf9c0 0x55ae3efd3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:56.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.656+0000 7fb507400640 1 -- 172.21.15.99:0/638827769 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ae3eca97e0 con 0x55ae3efa4c10 2024-02-21T23:08:56.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.656+0000 7fb507400640 1 --2- 172.21.15.99:0/638827769 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ae3efa4c10 0x55ae3efa16c0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fb4f802bee0 tx=0x7fb4f8009190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1bc7fc83de06e84e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:56.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.656+0000 7fb4ebe00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-02-21T23:08:56.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.657+0000 7fb4ebe00640 1 -- 172.21.15.99:0/638827769 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f80e7060 con 0x55ae3efa4c10 2024-02-21T23:08:56.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.657+0000 7fb510f88740 1 -- 172.21.15.99:0/638827769 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb4f80bd170 con 0x55ae3efa4c10 2024-02-21T23:08:56.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.657+0000 7fb4ebe00640 1 -- 172.21.15.99:0/638827769 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7fb4f80e8f20 con 0x55ae3efa4c10 2024-02-21T23:08:56.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.657+0000 7fb4ebe00640 1 -- 172.21.15.99:0/638827769 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb4f80e9160 con 0x55ae3efa4c10 2024-02-21T23:08:56.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.657+0000 7fb510f88740 10 client.6586 fetch_fsmap learned FSMap version 17 2024-02-21T23:08:56.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.657+0000 7fb510f88740 1 -- 172.21.15.99:0/638827769 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55ae3ed09f70 con 0x55ae3efa4c10 2024-02-21T23:08:56.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.657+0000 7fb4ebe00640 1 -- 172.21.15.99:0/638827769 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4f80bd170 con 0x55ae3efa4c10 2024-02-21T23:08:56.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.657+0000 7fb4ebe00640 1 -- 172.21.15.99:0/638827769 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fb4f80a22a0 con 0x55ae3efa4c10 2024-02-21T23:08:56.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.657+0000 7fb510f88740 10 client.6586 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:08:56.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.658+0000 7fb510f88740 10 client.6586 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:08:56.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.658+0000 7fb510f88740 20 client.6586 populate_metadata read hostname 'smithi099' 2024-02-21T23:08:56.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.658+0000 7fb510f88740 1 --2- 172.21.15.99:0/638827769 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55ae3ef95820 0x55ae3ef95c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:56.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.658+0000 7fb510f88740 4 client.6586 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:08:56.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.658+0000 7fb510f88740 1 -- 172.21.15.99:0/638827769 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ae3eed9cd0 con 0x55ae3ef95820 2024-02-21T23:08:56.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.658+0000 7fb4ffe00640 1 --2- 172.21.15.99:0/638827769 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55ae3ef95820 0x55ae3ef95c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:56.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.659+0000 7fb4ffe00640 1 --2- 172.21.15.99:0/638827769 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55ae3ef95820 0x55ae3ef95c70 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b66bc41760817d9a server_cookie=11d703652ee3fe25 in_seq=0 out_seq=0 2024-02-21T23:08:56.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.659+0000 7fb4ebe00640 10 client.6586 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:08:56.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.659+0000 7fb4ebe00640 1 -- 172.21.15.99:0/638827769 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55ae3eed9cd0 con 0x55ae3ef95820 2024-02-21T23:08:56.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.659+0000 7fb4ebe00640 10 client.6586 handle_command_reply: tid=0 2024-02-21T23:08:56.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.659+0000 7fb510f88740 1 client.6586 shutdown 2024-02-21T23:08:56.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.660+0000 7fb510f88740 1 -- 172.21.15.99:0/638827769 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ae3efa4c10 msgr2=0x55ae3efa16c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:56.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.660+0000 7fb510f88740 1 --2- 172.21.15.99:0/638827769 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ae3efa4c10 0x55ae3efa16c0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fb4f802bee0 tx=0x7fb4f8009190 comp rx=0 tx=0).stop 2024-02-21T23:08:56.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.660+0000 7fb510f88740 1 -- 172.21.15.99:0/638827769 shutdown_connections 2024-02-21T23:08:56.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.660+0000 7fb510f88740 1 --2- 172.21.15.99:0/638827769 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55ae3ef95820 0x55ae3ef95c70 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:56.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.660+0000 7fb510f88740 1 --2- 172.21.15.99:0/638827769 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ae3efac320 0x55ae3efa0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:56.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.660+0000 7fb510f88740 1 --2- 172.21.15.99:0/638827769 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ae3efdf9c0 0x55ae3efd3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:56.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.660+0000 7fb510f88740 1 --2- 172.21.15.99:0/638827769 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ae3efa4c10 0x55ae3efa16c0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:56.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.660+0000 7fb4ebe00640 0 client.6586 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:08:56.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.660+0000 7fb510f88740 1 -- 172.21.15.99:0/638827769 >> 172.21.15.99:0/638827769 conn(0x55ae3efa42f0 msgr2=0x55ae3efdfe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:08:56.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.660+0000 7fb510f88740 1 -- 172.21.15.99:0/638827769 shutdown_connections 2024-02-21T23:08:56.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.660+0000 7fb510f88740 1 -- 172.21.15.99:0/638827769 wait complete. 2024-02-21T23:08:56.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.660+0000 7fb510f88740 20 client.6586 trim_cache size 0 max 16384 2024-02-21T23:08:56.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.677+0000 7fb510f88740 1 Processor -- start 2024-02-21T23:08:56.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.678+0000 7fb510f88740 1 -- start start 2024-02-21T23:08:56.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.679+0000 7fb510f88740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ae3efa4c10 0x55ae3ef68540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:56.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.679+0000 7fb510f88740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ae3efac320 0x55ae3ef98c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:56.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.679+0000 7fb510f88740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ae3efdf9c0 0x55ae3ef991d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:56.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.679+0000 7fb510f88740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb50822c9c0 con 0x55ae3efa4c10 2024-02-21T23:08:56.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.679+0000 7fb510f88740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb50822a560 con 0x55ae3efac320 2024-02-21T23:08:56.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.679+0000 7fb510f88740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb508185ff0 con 0x55ae3efdf9c0 2024-02-21T23:08:56.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.679+0000 7fb507400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ae3efa4c10 0x55ae3ef68540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:56.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.679+0000 7fb507400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ae3efa4c10 0x55ae3ef68540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53102/0 (socket says 172.21.15.99:53102) 2024-02-21T23:08:56.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.679+0000 7fb507400640 1 -- 172.21.15.99:0/3101723703 learned_addr learned my addr 172.21.15.99:0/3101723703 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:08:56.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.679+0000 7fb507e00640 1 --2- 172.21.15.99:0/3101723703 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ae3efdf9c0 0x55ae3ef991d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:56.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.679+0000 7fb4ffe00640 1 --2- 172.21.15.99:0/3101723703 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ae3efac320 0x55ae3ef98c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:56.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.679+0000 7fb507400640 1 -- 172.21.15.99:0/3101723703 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ae3efdf9c0 msgr2=0x55ae3ef991d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:56.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.679+0000 7fb507400640 1 --2- 172.21.15.99:0/3101723703 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ae3efdf9c0 0x55ae3ef991d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:56.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.679+0000 7fb507400640 1 -- 172.21.15.99:0/3101723703 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ae3efac320 msgr2=0x55ae3ef98c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:56.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.679+0000 7fb507400640 1 --2- 172.21.15.99:0/3101723703 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ae3efac320 0x55ae3ef98c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:56.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.679+0000 7fb507400640 1 -- 172.21.15.99:0/3101723703 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ae3eba1170 con 0x55ae3efa4c10 2024-02-21T23:08:56.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.680+0000 7fb507400640 1 --2- 172.21.15.99:0/3101723703 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ae3efa4c10 0x55ae3ef68540 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fb4f80097a0 tx=0x7fb4f8048000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0765895918de481 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:56.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.680+0000 7fb4f6a00640 1 -- 172.21.15.99:0/3101723703 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f80bd170 con 0x55ae3efa4c10 2024-02-21T23:08:56.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.680+0000 7fb4f6a00640 1 -- 172.21.15.99:0/3101723703 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4f80c17c0 con 0x55ae3efa4c10 2024-02-21T23:08:56.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.680+0000 7fb4f6a00640 1 -- 172.21.15.99:0/3101723703 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f80b9020 con 0x55ae3efa4c10 2024-02-21T23:08:56.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.681+0000 7fb510f88740 1 -- 172.21.15.99:0/3101723703 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ae3efa4c10 msgr2=0x55ae3ef68540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:56.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.681+0000 7fb510f88740 1 --2- 172.21.15.99:0/3101723703 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ae3efa4c10 0x55ae3ef68540 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fb4f80097a0 tx=0x7fb4f8048000 comp rx=0 tx=0).stop 2024-02-21T23:08:56.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.681+0000 7fb510f88740 1 -- 172.21.15.99:0/3101723703 shutdown_connections 2024-02-21T23:08:56.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.681+0000 7fb510f88740 1 --2- 172.21.15.99:0/3101723703 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ae3efdf9c0 0x55ae3ef991d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:56.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.681+0000 7fb510f88740 1 --2- 172.21.15.99:0/3101723703 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ae3efac320 0x55ae3ef98c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:56.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.681+0000 7fb510f88740 1 --2- 172.21.15.99:0/3101723703 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ae3efa4c10 0x55ae3ef68540 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:56.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.681+0000 7fb510f88740 1 -- 172.21.15.99:0/3101723703 >> 172.21.15.99:0/3101723703 conn(0x55ae3efa42f0 msgr2=0x55ae3efd3670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:08:56.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.681+0000 7fb510f88740 1 -- 172.21.15.99:0/3101723703 shutdown_connections 2024-02-21T23:08:56.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.681+0000 7fb510f88740 1 -- 172.21.15.99:0/3101723703 wait complete. 2024-02-21T23:08:56.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.682+0000 7fb510f88740 1 -- start start 2024-02-21T23:08:56.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.682+0000 7fb510f88740 1 Processor -- start 2024-02-21T23:08:56.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.684+0000 7fb510f88740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ae3efa4c10 0x55ae3ef926c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:56.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.684+0000 7fb510f88740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ae3efac320 0x55ae3ef961b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:56.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.684+0000 7fb510f88740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ae3efdf9c0 0x55ae3efeaa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:56.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.684+0000 7fb510f88740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb508228ca0 con 0x55ae3efa4c10 2024-02-21T23:08:56.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.684+0000 7fb510f88740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb508229f00 con 0x55ae3efac320 2024-02-21T23:08:56.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.684+0000 7fb510f88740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5082292a0 con 0x55ae3efdf9c0 2024-02-21T23:08:56.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.684+0000 7fb510f88740 10 client.0 _ll_register_callbacks cb 0x7fb500001750 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:08:56.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.684+0000 7fb507400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ae3efa4c10 0x55ae3ef926c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:56.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.684+0000 7fb507400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ae3efa4c10 0x55ae3ef926c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53104/0 (socket says 172.21.15.99:53104) 2024-02-21T23:08:56.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.684+0000 7fb507400640 1 -- 172.21.15.99:0/3026305533 learned_addr learned my addr 172.21.15.99:0/3026305533 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:08:56.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.685+0000 7fb4ffe00640 1 --2- 172.21.15.99:0/3026305533 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ae3efac320 0x55ae3ef961b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:56.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.685+0000 7fb507e00640 1 --2- 172.21.15.99:0/3026305533 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ae3efdf9c0 0x55ae3efeaa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:56.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.685+0000 7fb507400640 1 -- 172.21.15.99:0/3026305533 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ae3efdf9c0 msgr2=0x55ae3efeaa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:56.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.685+0000 7fb507400640 1 --2- 172.21.15.99:0/3026305533 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ae3efdf9c0 0x55ae3efeaa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:56.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.685+0000 7fb507400640 1 -- 172.21.15.99:0/3026305533 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ae3efac320 msgr2=0x55ae3ef961b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:56.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.685+0000 7fb507400640 1 --2- 172.21.15.99:0/3026305533 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ae3efac320 0x55ae3ef961b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:56.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.685+0000 7fb507400640 1 -- 172.21.15.99:0/3026305533 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ae3efeb4a0 con 0x55ae3efa4c10 2024-02-21T23:08:56.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.685+0000 7fb507400640 1 --2- 172.21.15.99:0/3026305533 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ae3efa4c10 0x55ae3ef926c0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fb4f802bee0 tx=0x7fb4f8009480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6031fb04e1e787b7 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:56.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.685+0000 7fb4ebe00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:08:56.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.685+0000 7fb4ebe00640 1 -- 172.21.15.99:0/3026305533 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f80b9020 con 0x55ae3efa4c10 2024-02-21T23:08:56.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.685+0000 7fb4ebe00640 1 -- 172.21.15.99:0/3026305533 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7fb4f80c1330 con 0x55ae3efa4c10 2024-02-21T23:08:56.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.685+0000 7fb510f88740 1 -- 172.21.15.99:0/3026305533 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb4f80c17c0 con 0x55ae3efa4c10 2024-02-21T23:08:56.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.686+0000 7fb4ebe00640 1 -- 172.21.15.99:0/3026305533 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb4f80bd170 con 0x55ae3efa4c10 2024-02-21T23:08:56.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.686+0000 7fb510f88740 10 client.6465 fetch_fsmap learned FSMap version 17 2024-02-21T23:08:56.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.686+0000 7fb510f88740 1 -- 172.21.15.99:0/3026305533 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55ae3efeb4a0 con 0x55ae3efa4c10 2024-02-21T23:08:56.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.686+0000 7fb4ebe00640 1 -- 172.21.15.99:0/3026305533 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4f80c17c0 con 0x55ae3efa4c10 2024-02-21T23:08:56.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.686+0000 7fb4ebe00640 1 -- 172.21.15.99:0/3026305533 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fb4f80b8470 con 0x55ae3efa4c10 2024-02-21T23:08:56.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.686+0000 7fb510f88740 10 client.6465 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:08:56.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.686+0000 7fb510f88740 10 client.6465 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:08:56.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.686+0000 7fb510f88740 20 client.6465 populate_metadata read hostname 'smithi099' 2024-02-21T23:08:56.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.686+0000 7fb510f88740 1 --2- 172.21.15.99:0/3026305533 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55ae3ef95c30 0x55ae3efe89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:56.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.686+0000 7fb510f88740 4 client.6465 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-02-21T23:08:56.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.686+0000 7fb510f88740 1 -- 172.21.15.99:0/3026305533 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55ae3eed4020 con 0x55ae3ef95c30 2024-02-21T23:08:56.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.687+0000 7fb4ffe00640 1 --2- 172.21.15.99:0/3026305533 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55ae3ef95c30 0x55ae3efe89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:56.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.687+0000 7fb4ffe00640 1 --2- 172.21.15.99:0/3026305533 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55ae3ef95c30 0x55ae3efe89c0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e63adb602b49480b server_cookie=e88befb4d4206858 in_seq=0 out_seq=0 2024-02-21T23:08:56.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.687+0000 7fb4ebe00640 10 client.6465 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:08:56.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.688+0000 7fb4ebe00640 1 -- 172.21.15.99:0/3026305533 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55ae3eed4020 con 0x55ae3ef95c30 2024-02-21T23:08:56.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.688+0000 7fb4ebe00640 10 client.6465 handle_command_reply: tid=0 2024-02-21T23:08:56.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.689+0000 7fb510f88740 1 client.6465 shutdown 2024-02-21T23:08:56.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.689+0000 7fb510f88740 1 -- 172.21.15.99:0/3026305533 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ae3efa4c10 msgr2=0x55ae3ef926c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:56.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.689+0000 7fb510f88740 1 --2- 172.21.15.99:0/3026305533 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ae3efa4c10 0x55ae3ef926c0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fb4f802bee0 tx=0x7fb4f8009480 comp rx=0 tx=0).stop 2024-02-21T23:08:56.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.689+0000 7fb510f88740 1 -- 172.21.15.99:0/3026305533 shutdown_connections 2024-02-21T23:08:56.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.689+0000 7fb510f88740 1 --2- 172.21.15.99:0/3026305533 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55ae3ef95c30 0x55ae3efe89c0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:56.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.689+0000 7fb510f88740 1 --2- 172.21.15.99:0/3026305533 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ae3efdf9c0 0x55ae3efeaa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:56.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.689+0000 7fb510f88740 1 --2- 172.21.15.99:0/3026305533 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ae3efac320 0x55ae3ef961b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:56.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.689+0000 7fb510f88740 1 --2- 172.21.15.99:0/3026305533 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ae3efa4c10 0x55ae3ef926c0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:56.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.689+0000 7fb510f88740 1 -- 172.21.15.99:0/3026305533 >> 172.21.15.99:0/3026305533 conn(0x55ae3efa42f0 msgr2=0x55ae3ef63fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:08:56.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.689+0000 7fb4ebe00640 0 client.6465 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:08:56.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.690+0000 7fb510f88740 1 -- 172.21.15.99:0/3026305533 shutdown_connections 2024-02-21T23:08:56.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.690+0000 7fb510f88740 1 -- 172.21.15.99:0/3026305533 wait complete. 2024-02-21T23:08:56.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.690+0000 7fb510f88740 20 client.6465 trim_cache size 0 max 16384 2024-02-21T23:08:56.685 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-02-21T23:08:56.686 INFO:teuthology.orchestra.run.smithi099.stdout: "return_code": 0, 2024-02-21T23:08:56.686 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_tag": "b6ee238e-1951-453e-ac7b-45397e83575a", 2024-02-21T23:08:56.686 INFO:teuthology.orchestra.run.smithi099.stdout: "mode": "asynchronous" 2024-02-21T23:08:56.686 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-02-21T23:08:56.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.691+0000 7fb50e000640 1 -- 172.21.15.99:0/2647406296 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fb4e409eed0 msgr2=0x7fb4e40a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:56.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.691+0000 7fb50e000640 1 --2- 172.21.15.99:0/2647406296 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fb4e409eed0 0x7fb4e40a1390 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb5080ce360 tx=0x7fb4f0009040 comp rx=0 tx=0).stop 2024-02-21T23:08:56.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.691+0000 7fb50e000640 1 -- 172.21.15.99:0/2647406296 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb508072370 msgr2=0x7fb5081723a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:56.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.691+0000 7fb50e000640 1 --2- 172.21.15.99:0/2647406296 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb508072370 0x7fb5081723a0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fb4f8034040 tx=0x7fb4f80046c0 comp rx=0 tx=0).stop 2024-02-21T23:08:56.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.691+0000 7fb50e000640 1 -- 172.21.15.99:0/2647406296 shutdown_connections 2024-02-21T23:08:56.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.691+0000 7fb50e000640 1 --2- 172.21.15.99:0/2647406296 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fb4e409eed0 0x7fb4e40a1390 secure :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb5080ce360 tx=0x7fb4f0009040 comp rx=0 tx=0).stop 2024-02-21T23:08:56.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.691+0000 7fb50e000640 1 --2- 172.21.15.99:0/2647406296 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb508187c90 0x7fb508171320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:56.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.691+0000 7fb50e000640 1 --2- 172.21.15.99:0/2647406296 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb50817f5e0 0x7fb508168420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:56.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.691+0000 7fb50e000640 1 --2- 172.21.15.99:0/2647406296 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb508072370 0x7fb5081723a0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:56.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.691+0000 7fb50e000640 1 -- 172.21.15.99:0/2647406296 >> 172.21.15.99:0/2647406296 conn(0x7fb5080fe610 msgr2=0x7fb508071750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:08:56.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.693+0000 7fb50e000640 1 -- 172.21.15.99:0/2647406296 shutdown_connections 2024-02-21T23:08:56.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.693+0000 7fb50e000640 1 -- 172.21.15.99:0/2647406296 wait complete. 2024-02-21T23:08:56.708 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T23:08:56.708 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T23:08:56.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.993+0000 7fa970800640 1 Processor -- start 2024-02-21T23:08:56.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.994+0000 7fa970800640 1 -- start start 2024-02-21T23:08:56.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.997+0000 7fa970800640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fa9680c8fd0 0x7fa968195e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:56.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.997+0000 7fa970800640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9680f6480 con 0x7fa968199800 2024-02-21T23:08:56.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.997+0000 7fa970800640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa968196800 con 0x7fa968196380 2024-02-21T23:08:56.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.997+0000 7fa970800640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9680f5760 con 0x7fa9680c8fd0 2024-02-21T23:08:56.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.997+0000 7fa96d400640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fa968196380 0x7fa9681990f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:36246/0 (socket says 172.21.15.99:36246) 2024-02-21T23:08:56.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.997+0000 7fa96d400640 1 -- 172.21.15.99:0/2990026578 learned_addr learned my addr 172.21.15.99:0/2990026578 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:08:56.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.998+0000 7fa96ca00640 1 -- 172.21.15.99:0/2990026578 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1548913936 0 0) 0x7fa968196800 con 0x7fa968196380 2024-02-21T23:08:56.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.998+0000 7fa96ca00640 1 -- 172.21.15.99:0/2990026578 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa954004630 con 0x7fa968196380 2024-02-21T23:08:56.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.998+0000 7fa96ca00640 1 -- 172.21.15.99:0/2990026578 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2726626744 0 0) 0x7fa9680f6480 con 0x7fa968199800 2024-02-21T23:08:56.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.998+0000 7fa96ca00640 1 -- 172.21.15.99:0/2990026578 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa968196800 con 0x7fa968199800 2024-02-21T23:08:56.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.999+0000 7fa96ca00640 1 -- 172.21.15.99:0/2990026578 <== mon.2 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2530605945 0 0) 0x7fa954004630 con 0x7fa968196380 2024-02-21T23:08:56.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.999+0000 7fa96ca00640 1 -- 172.21.15.99:0/2990026578 >> v2:172.21.15.181:3300/0 conn(0x7fa9680c8fd0 msgr2=0x7fa968195e40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T23:08:56.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.999+0000 7fa96ca00640 1 --2- 172.21.15.99:0/2990026578 >> v2:172.21.15.181:3300/0 conn(0x7fa9680c8fd0 0x7fa968195e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:56.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.999+0000 7fa96ca00640 1 -- 172.21.15.99:0/2990026578 >> v1:172.21.15.99:6789/0 conn(0x7fa968199800 legacy=0x7fa968070870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:56.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.999+0000 7fa96ca00640 1 -- 172.21.15.99:0/2990026578 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9680718e0 con 0x7fa968196380 2024-02-21T23:08:56.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.999+0000 7fa96ca00640 1 -- 172.21.15.99:0/2990026578 <== mon.2 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2069890144 0 0) 0x7fa958001670 con 0x7fa968196380 2024-02-21T23:08:56.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.999+0000 7fa96ca00640 1 -- 172.21.15.99:0/2990026578 >> v1:172.21.15.181:6789/0 conn(0x7fa968196380 legacy=0x7fa9681990f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:56.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.999+0000 7fa96ca00640 1 --2- 172.21.15.99:0/2990026578 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa954005da0 0x7fa9540061a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:56.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.999+0000 7fa96ca00640 1 --2- 172.21.15.99:0/2990026578 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9540048b0 0x7fa954004d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:56.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.999+0000 7fa96ca00640 1 --2- 172.21.15.99:0/2990026578 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9540054c0 0x7fa9540034f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:56.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.999+0000 7fa96ca00640 1 -- 172.21.15.99:0/2990026578 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9680f5760 con 0x7fa9540054c0 2024-02-21T23:08:56.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.999+0000 7fa96ca00640 1 -- 172.21.15.99:0/2990026578 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa954003c40 con 0x7fa9540048b0 2024-02-21T23:08:56.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:56.999+0000 7fa96ca00640 1 -- 172.21.15.99:0/2990026578 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa954003e40 con 0x7fa954005da0 2024-02-21T23:08:56.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.000+0000 7fa96de00640 1 --2- 172.21.15.99:0/2990026578 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa954005da0 0x7fa9540061a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:56.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.000+0000 7fa96d400640 1 --2- 172.21.15.99:0/2990026578 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9540048b0 0x7fa954004d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:56.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.000+0000 7fa96e800640 1 --2- 172.21.15.99:0/2990026578 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9540054c0 0x7fa9540034f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:56.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.000+0000 7fa96d400640 1 -- 172.21.15.99:0/2990026578 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa954005da0 msgr2=0x7fa9540061a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:56.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.000+0000 7fa96d400640 1 --2- 172.21.15.99:0/2990026578 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa954005da0 0x7fa9540061a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:56.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.000+0000 7fa96d400640 1 -- 172.21.15.99:0/2990026578 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9540054c0 msgr2=0x7fa9540034f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:56.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.000+0000 7fa96d400640 1 --2- 172.21.15.99:0/2990026578 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9540054c0 0x7fa9540034f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:56.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.000+0000 7fa96d400640 1 -- 172.21.15.99:0/2990026578 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa954004630 con 0x7fa9540048b0 2024-02-21T23:08:56.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.000+0000 7fa96de00640 1 --2- 172.21.15.99:0/2990026578 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa954005da0 0x7fa9540061a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:08:56.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.000+0000 7fa96e800640 1 --2- 172.21.15.99:0/2990026578 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa9540054c0 0x7fa9540034f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T23:08:56.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.000+0000 7fa96e800640 1 -- 172.21.15.99:0/2990026578 reap_dead start 2024-02-21T23:08:56.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.003+0000 7fa96d400640 1 --2- 172.21.15.99:0/2990026578 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9540048b0 0x7fa954004d30 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fa95800c0e0 tx=0x7fa954006940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b637b1492bd4a3d9 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:56.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.003+0000 7fa96ca00640 1 -- 172.21.15.99:0/2990026578 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa958007c40 con 0x7fa9540048b0 2024-02-21T23:08:56.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.003+0000 7fa96ca00640 1 -- 172.21.15.99:0/2990026578 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa958030070 con 0x7fa9540048b0 2024-02-21T23:08:56.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.003+0000 7fa96ca00640 1 -- 172.21.15.99:0/2990026578 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa958005dd0 con 0x7fa9540048b0 2024-02-21T23:08:56.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.004+0000 7fa970800640 1 -- 172.21.15.99:0/2990026578 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9540048b0 msgr2=0x7fa954004d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:56.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.004+0000 7fa970800640 1 --2- 172.21.15.99:0/2990026578 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9540048b0 0x7fa954004d30 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fa95800c0e0 tx=0x7fa954006940 comp rx=0 tx=0).stop 2024-02-21T23:08:56.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.004+0000 7fa970800640 1 -- 172.21.15.99:0/2990026578 shutdown_connections 2024-02-21T23:08:56.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.004+0000 7fa970800640 1 --2- 172.21.15.99:0/2990026578 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9540048b0 0x7fa954004d30 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:56.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.004+0000 7fa970800640 1 -- 172.21.15.99:0/2990026578 >> 172.21.15.99:0/2990026578 conn(0x7fa9680ce5f0 msgr2=0x7fa9680cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:08:56.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.005+0000 7fa970800640 1 -- 172.21.15.99:0/2990026578 shutdown_connections 2024-02-21T23:08:56.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.005+0000 7fa970800640 1 -- 172.21.15.99:0/2990026578 wait complete. 2024-02-21T23:08:56.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.008+0000 7fa970800640 1 Processor -- start 2024-02-21T23:08:56.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.008+0000 7fa970800640 1 -- start start 2024-02-21T23:08:56.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.010+0000 7fa970800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9540048b0 0x7fa968193700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:56.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.010+0000 7fa970800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa96817fed0 0x7fa96822b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:56.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.010+0000 7fa970800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa96822b610 0x7fa9680f8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:56.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.010+0000 7fa970800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9680f53f0 con 0x7fa96822b610 2024-02-21T23:08:56.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.010+0000 7fa970800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9680f5110 con 0x7fa96817fed0 2024-02-21T23:08:57.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.010+0000 7fa970800640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa968199c90 con 0x7fa9540048b0 2024-02-21T23:08:57.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.010+0000 7fa96de00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9540048b0 0x7fa968193700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:57.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.010+0000 7fa96de00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9540048b0 0x7fa968193700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:47780/0 (socket says 172.21.15.99:47780) 2024-02-21T23:08:57.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.010+0000 7fa96de00640 1 -- 172.21.15.99:0/612783235 learned_addr learned my addr 172.21.15.99:0/612783235 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:08:57.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.010+0000 7fa96e800640 1 --2- 172.21.15.99:0/612783235 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa96822b610 0x7fa9680f8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:57.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.010+0000 7fa96d400640 1 --2- 172.21.15.99:0/612783235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa96817fed0 0x7fa96822b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:57.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.010+0000 7fa96de00640 1 -- 172.21.15.99:0/612783235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa96817fed0 msgr2=0x7fa96822b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:57.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.010+0000 7fa96de00640 1 --2- 172.21.15.99:0/612783235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa96817fed0 0x7fa96822b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:57.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.010+0000 7fa96de00640 1 -- 172.21.15.99:0/612783235 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa96822b610 msgr2=0x7fa9680f8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:57.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.011+0000 7fa96de00640 1 --2- 172.21.15.99:0/612783235 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa96822b610 0x7fa9680f8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:57.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.011+0000 7fa96de00640 1 -- 172.21.15.99:0/612783235 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa968229d50 con 0x7fa9540048b0 2024-02-21T23:08:57.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.011+0000 7fa96d400640 1 --2- 172.21.15.99:0/612783235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa96817fed0 0x7fa96822b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:08:57.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.011+0000 7fa96de00640 1 --2- 172.21.15.99:0/612783235 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9540048b0 0x7fa968193700 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fa96000e820 tx=0x7fa96000ec20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:57.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.011+0000 7fa95e000640 1 -- 172.21.15.99:0/612783235 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa960017070 con 0x7fa9540048b0 2024-02-21T23:08:57.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.011+0000 7fa95e000640 1 -- 172.21.15.99:0/612783235 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa96000ee70 con 0x7fa9540048b0 2024-02-21T23:08:57.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.011+0000 7fa95e000640 1 -- 172.21.15.99:0/612783235 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9600093b0 con 0x7fa9540048b0 2024-02-21T23:08:57.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.011+0000 7fa970800640 1 -- 172.21.15.99:0/612783235 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa96822a030 con 0x7fa9540048b0 2024-02-21T23:08:57.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.011+0000 7fa970800640 1 -- 172.21.15.99:0/612783235 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa96822a5f0 con 0x7fa9540048b0 2024-02-21T23:08:57.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.023+0000 7fa9735e1740 1 Processor -- start 2024-02-21T23:08:57.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.023+0000 7fa9735e1740 1 -- start start 2024-02-21T23:08:57.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.024+0000 7fa95e000640 1 -- 172.21.15.99:0/612783235 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7fa96001a070 con 0x7fa9540048b0 2024-02-21T23:08:57.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.025+0000 7fa9735e1740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5638fc4370d0 0x5638fc46cb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:57.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.025+0000 7fa9735e1740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638fc46d090 0x5638fc4374b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:57.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.025+0000 7fa9735e1740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5638fc4379f0 0x5638fc3fa000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:57.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.025+0000 7fa9735e1740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638fc363a90 con 0x5638fc4379f0 2024-02-21T23:08:57.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.025+0000 7fa9735e1740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638fc30cb10 con 0x5638fc46d090 2024-02-21T23:08:57.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.025+0000 7fa9735e1740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638fc35fb30 con 0x5638fc4370d0 2024-02-21T23:08:57.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.026+0000 7fa96e800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5638fc4370d0 0x5638fc46cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:57.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.026+0000 7fa96e800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5638fc4370d0 0x5638fc46cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:47794/0 (socket says 172.21.15.99:47794) 2024-02-21T23:08:57.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.026+0000 7fa96e800640 1 -- 172.21.15.99:0/626333402 learned_addr learned my addr 172.21.15.99:0/626333402 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:08:57.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.026+0000 7fa95e000640 1 --2- 172.21.15.99:0/612783235 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa94c09ef50 0x7fa94c0a1410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:57.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.026+0000 7fa96e800640 1 -- 172.21.15.99:0/626333402 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638fc46d090 msgr2=0x5638fc4374b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T23:08:57.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.026+0000 7fa96e800640 1 --2- 172.21.15.99:0/626333402 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638fc46d090 0x5638fc4374b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:57.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.026+0000 7fa96e800640 1 -- 172.21.15.99:0/626333402 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5638fc4379f0 msgr2=0x5638fc3fa000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:57.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.026+0000 7fa96d400640 1 --2- 172.21.15.99:0/626333402 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5638fc4379f0 0x5638fc3fa000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:57.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.026+0000 7fa95e000640 1 -- 172.21.15.99:0/612783235 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7fa9600c9f80 con 0x7fa9540048b0 2024-02-21T23:08:57.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.026+0000 7fa96e800640 1 --2- 172.21.15.99:0/626333402 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5638fc4379f0 0x5638fc3fa000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:57.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.026+0000 7fa96e800640 1 -- 172.21.15.99:0/626333402 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5638fc1427d0 con 0x5638fc4370d0 2024-02-21T23:08:57.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.026+0000 7fa96d400640 1 --2- 172.21.15.99:0/626333402 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5638fc4379f0 0x5638fc3fa000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T23:08:57.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.026+0000 7fa96e800640 1 --2- 172.21.15.99:0/612783235 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa94c09ef50 0x7fa94c0a1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:57.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.027+0000 7fa96e800640 1 --2- 172.21.15.99:0/626333402 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5638fc4370d0 0x5638fc46cb50 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fa9680cf710 tx=0x7fa964010240 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93e0e81fd5cddc7b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:57.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.027+0000 7fa952600640 1 -- 172.21.15.99:0/626333402 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa964020760 con 0x5638fc4370d0 2024-02-21T23:08:57.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.027+0000 7fa952600640 1 -- 172.21.15.99:0/626333402 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa964019040 con 0x5638fc4370d0 2024-02-21T23:08:57.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.027+0000 7fa952600640 1 -- 172.21.15.99:0/626333402 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa964020bc0 con 0x5638fc4370d0 2024-02-21T23:08:57.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.028+0000 7fa9735e1740 1 -- 172.21.15.99:0/626333402 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5638fc4370d0 msgr2=0x5638fc46cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:57.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.028+0000 7fa96e800640 1 --2- 172.21.15.99:0/612783235 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa94c09ef50 0x7fa94c0a1410 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa96401f000 tx=0x7fa964020000 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:57.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.028+0000 7fa9735e1740 1 --2- 172.21.15.99:0/626333402 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5638fc4370d0 0x5638fc46cb50 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fa9680cf710 tx=0x7fa964010240 comp rx=0 tx=0).stop 2024-02-21T23:08:57.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.028+0000 7fa9735e1740 1 -- 172.21.15.99:0/626333402 shutdown_connections 2024-02-21T23:08:57.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.028+0000 7fa9735e1740 1 --2- 172.21.15.99:0/626333402 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5638fc4379f0 0x5638fc3fa000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:57.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.028+0000 7fa9735e1740 1 --2- 172.21.15.99:0/626333402 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638fc46d090 0x5638fc4374b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:57.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.028+0000 7fa9735e1740 1 --2- 172.21.15.99:0/626333402 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5638fc4370d0 0x5638fc46cb50 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:57.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.028+0000 7fa9735e1740 1 -- 172.21.15.99:0/626333402 >> 172.21.15.99:0/626333402 conn(0x5638fc3c66b0 msgr2=0x5638fc3fdfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:08:57.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.030+0000 7fa9735e1740 1 -- 172.21.15.99:0/626333402 shutdown_connections 2024-02-21T23:08:57.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.030+0000 7fa9735e1740 1 -- 172.21.15.99:0/626333402 wait complete. 2024-02-21T23:08:57.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.031+0000 7fa9735e1740 1 -- start start 2024-02-21T23:08:57.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.032+0000 7fa9735e1740 1 Processor -- start 2024-02-21T23:08:57.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.034+0000 7fa9735e1740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5638fc4370d0 0x5638fc46f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:57.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.034+0000 7fa9735e1740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5638fc4379f0 0x5638fc482a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:57.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.034+0000 7fa9735e1740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638fc46d090 0x5638fc4831f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:57.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.034+0000 7fa9735e1740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638fc405d60 con 0x5638fc4370d0 2024-02-21T23:08:57.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.034+0000 7fa9735e1740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638fc3021c0 con 0x5638fc46d090 2024-02-21T23:08:57.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.034+0000 7fa9735e1740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638fc46e760 con 0x5638fc4379f0 2024-02-21T23:08:57.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.034+0000 7fa9735e1740 10 client.0 _ll_register_callbacks cb 0x5638fc31f930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:08:57.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.034+0000 7fa96d400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5638fc4379f0 0x5638fc482a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:57.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.034+0000 7fa96d400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5638fc4379f0 0x5638fc482a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:47798/0 (socket says 172.21.15.99:47798) 2024-02-21T23:08:57.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.034+0000 7fa96d400640 1 -- 172.21.15.99:0/567184683 learned_addr learned my addr 172.21.15.99:0/567184683 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:08:57.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.034+0000 7fa96de00640 1 --2- 172.21.15.99:0/567184683 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5638fc4370d0 0x5638fc46f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:57.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.035+0000 7fa96e800640 1 --2- 172.21.15.99:0/567184683 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638fc46d090 0x5638fc4831f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:57.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.035+0000 7fa96de00640 1 -- 172.21.15.99:0/567184683 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5638fc4379f0 msgr2=0x5638fc482a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:57.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.035+0000 7fa96de00640 1 --2- 172.21.15.99:0/567184683 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5638fc4379f0 0x5638fc482a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:57.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.035+0000 7fa96de00640 1 -- 172.21.15.99:0/567184683 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638fc46d090 msgr2=0x5638fc4831f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:57.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.035+0000 7fa96de00640 1 --2- 172.21.15.99:0/567184683 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638fc46d090 0x5638fc4831f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:57.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.035+0000 7fa96de00640 1 -- 172.21.15.99:0/567184683 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5638fc0783f0 con 0x5638fc4370d0 2024-02-21T23:08:57.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.035+0000 7fa96d400640 1 --2- 172.21.15.99:0/567184683 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5638fc4379f0 0x5638fc482a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:08:57.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.035+0000 7fa96e800640 1 --2- 172.21.15.99:0/567184683 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638fc46d090 0x5638fc4831f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:08:57.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.036+0000 7fa96de00640 1 --2- 172.21.15.99:0/567184683 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5638fc4370d0 0x5638fc46f8e0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fa9600c7640 tx=0x7fa9600c7ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8c4996bc35a0c0f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:57.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.036+0000 7fa946a00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:08:57.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.036+0000 7fa946a00640 1 -- 172.21.15.99:0/567184683 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa960021040 con 0x5638fc4370d0 2024-02-21T23:08:57.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.036+0000 7fa946a00640 1 -- 172.21.15.99:0/567184683 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7fa9600af320 con 0x5638fc4370d0 2024-02-21T23:08:57.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.036+0000 7fa9735e1740 1 -- 172.21.15.99:0/567184683 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa964019040 con 0x5638fc4370d0 2024-02-21T23:08:57.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.037+0000 7fa946a00640 1 -- 172.21.15.99:0/567184683 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa96009ffc0 con 0x5638fc4370d0 2024-02-21T23:08:57.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.037+0000 7fa9735e1740 10 client.6474 fetch_fsmap learned FSMap version 17 2024-02-21T23:08:57.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.037+0000 7fa9735e1740 1 -- 172.21.15.99:0/567184683 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5638fc0380f0 con 0x5638fc4370d0 2024-02-21T23:08:57.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.038+0000 7fa946a00640 1 -- 172.21.15.99:0/567184683 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa964019040 con 0x5638fc4370d0 2024-02-21T23:08:57.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.038+0000 7fa946a00640 1 -- 172.21.15.99:0/567184683 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fa960098b50 con 0x5638fc4370d0 2024-02-21T23:08:57.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.038+0000 7fa9735e1740 10 client.6474 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:08:57.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.038+0000 7fa9735e1740 10 client.6474 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:08:57.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.038+0000 7fa9735e1740 20 client.6474 populate_metadata read hostname 'smithi099' 2024-02-21T23:08:57.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.038+0000 7fa9735e1740 1 --2- 172.21.15.99:0/567184683 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5638fc42d290 0x5638fc470010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:57.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.038+0000 7fa9735e1740 4 client.6474 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:08:57.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.038+0000 7fa9735e1740 1 -- 172.21.15.99:0/567184683 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5638fc370fd0 con 0x5638fc42d290 2024-02-21T23:08:57.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.039+0000 7fa96d400640 1 --2- 172.21.15.99:0/567184683 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5638fc42d290 0x5638fc470010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:57.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.039+0000 7fa96d400640 1 --2- 172.21.15.99:0/567184683 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5638fc42d290 0x5638fc470010 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9983d69ed72c07 server_cookie=315bd28c4149780b in_seq=0 out_seq=0 2024-02-21T23:08:57.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.039+0000 7fa946a00640 10 client.6474 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:08:57.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.041+0000 7fa946a00640 1 -- 172.21.15.99:0/567184683 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x5638fc370fd0 con 0x5638fc42d290 2024-02-21T23:08:57.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.041+0000 7fa946a00640 10 client.6474 handle_command_reply: tid=0 2024-02-21T23:08:57.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.041+0000 7fa9735e1740 1 client.6474 shutdown 2024-02-21T23:08:57.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.041+0000 7fa9735e1740 1 -- 172.21.15.99:0/567184683 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5638fc4370d0 msgr2=0x5638fc46f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:57.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.041+0000 7fa9735e1740 1 --2- 172.21.15.99:0/567184683 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5638fc4370d0 0x5638fc46f8e0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fa9600c7640 tx=0x7fa9600c7ad0 comp rx=0 tx=0).stop 2024-02-21T23:08:57.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.041+0000 7fa9735e1740 1 -- 172.21.15.99:0/567184683 shutdown_connections 2024-02-21T23:08:57.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.041+0000 7fa9735e1740 1 --2- 172.21.15.99:0/567184683 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5638fc42d290 0x5638fc470010 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:57.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.041+0000 7fa9735e1740 1 --2- 172.21.15.99:0/567184683 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638fc46d090 0x5638fc4831f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:57.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.041+0000 7fa9735e1740 1 --2- 172.21.15.99:0/567184683 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5638fc4379f0 0x5638fc482a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:57.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.041+0000 7fa9735e1740 1 --2- 172.21.15.99:0/567184683 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5638fc4370d0 0x5638fc46f8e0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:57.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.041+0000 7fa9735e1740 1 -- 172.21.15.99:0/567184683 >> 172.21.15.99:0/567184683 conn(0x5638fc3c66b0 msgr2=0x5638fc3fe9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:08:57.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.041+0000 7fa946a00640 0 client.6474 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:08:57.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.043+0000 7fa9735e1740 1 -- 172.21.15.99:0/567184683 shutdown_connections 2024-02-21T23:08:57.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.043+0000 7fa9735e1740 1 -- 172.21.15.99:0/567184683 wait complete. 2024-02-21T23:08:57.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.044+0000 7fa9735e1740 20 client.6474 trim_cache size 0 max 16384 2024-02-21T23:08:57.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.078+0000 7fa9735e1740 1 Processor -- start 2024-02-21T23:08:57.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.078+0000 7fa9735e1740 1 -- start start 2024-02-21T23:08:57.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.079+0000 7fa9735e1740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5638fc4379f0 0x5638fc470da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:57.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.080+0000 7fa9735e1740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638fc46d090 0x5638fc440020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:57.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.080+0000 7fa9735e1740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5638fc470120 0x5638fc4d21e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:57.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.080+0000 7fa9735e1740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa968239c50 con 0x5638fc4379f0 2024-02-21T23:08:57.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.080+0000 7fa9735e1740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9682377f0 con 0x5638fc46d090 2024-02-21T23:08:57.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.080+0000 7fa9735e1740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa96818f600 con 0x5638fc470120 2024-02-21T23:08:57.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.080+0000 7fa96de00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5638fc4379f0 0x5638fc470da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:57.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.080+0000 7fa96d400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638fc46d090 0x5638fc440020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:57.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.080+0000 7fa96d400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638fc46d090 0x5638fc440020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:51280/0 (socket says 172.21.15.99:51280) 2024-02-21T23:08:57.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.080+0000 7fa96d400640 1 -- 172.21.15.99:0/1831944277 learned_addr learned my addr 172.21.15.99:0/1831944277 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:08:57.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.080+0000 7fa96e800640 1 --2- 172.21.15.99:0/1831944277 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5638fc470120 0x5638fc4d21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:57.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.081+0000 7fa96d400640 1 -- 172.21.15.99:0/1831944277 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5638fc470120 msgr2=0x5638fc4d21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:57.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.081+0000 7fa96d400640 1 --2- 172.21.15.99:0/1831944277 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5638fc470120 0x5638fc4d21e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:57.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.081+0000 7fa96d400640 1 -- 172.21.15.99:0/1831944277 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5638fc4379f0 msgr2=0x5638fc470da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:57.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.081+0000 7fa96d400640 1 --2- 172.21.15.99:0/1831944277 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5638fc4379f0 0x5638fc470da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:57.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.081+0000 7fa96d400640 1 -- 172.21.15.99:0/1831944277 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5638fc437820 con 0x5638fc46d090 2024-02-21T23:08:57.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.081+0000 7fa96de00640 1 --2- 172.21.15.99:0/1831944277 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5638fc4379f0 0x5638fc470da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T23:08:57.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.081+0000 7fa96e800640 1 --2- 172.21.15.99:0/1831944277 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5638fc470120 0x5638fc4d21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:08:57.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.081+0000 7fa96d400640 1 --2- 172.21.15.99:0/1831944277 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638fc46d090 0x5638fc440020 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fa95800c200 tx=0x7fa958007000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86e05144c66fe131 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:57.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.081+0000 7fa951c00640 1 -- 172.21.15.99:0/1831944277 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa95802dd10 con 0x5638fc46d090 2024-02-21T23:08:57.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.082+0000 7fa951c00640 1 -- 172.21.15.99:0/1831944277 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa958045070 con 0x5638fc46d090 2024-02-21T23:08:57.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.082+0000 7fa951c00640 1 -- 172.21.15.99:0/1831944277 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa958046ab0 con 0x5638fc46d090 2024-02-21T23:08:57.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.083+0000 7fa9735e1740 1 -- 172.21.15.99:0/1831944277 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638fc46d090 msgr2=0x5638fc440020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:57.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.083+0000 7fa9735e1740 1 --2- 172.21.15.99:0/1831944277 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638fc46d090 0x5638fc440020 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fa95800c200 tx=0x7fa958007000 comp rx=0 tx=0).stop 2024-02-21T23:08:57.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.083+0000 7fa9735e1740 1 -- 172.21.15.99:0/1831944277 shutdown_connections 2024-02-21T23:08:57.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.083+0000 7fa9735e1740 1 --2- 172.21.15.99:0/1831944277 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5638fc470120 0x5638fc4d21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:57.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.083+0000 7fa9735e1740 1 --2- 172.21.15.99:0/1831944277 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638fc46d090 0x5638fc440020 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:57.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.083+0000 7fa9735e1740 1 --2- 172.21.15.99:0/1831944277 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5638fc4379f0 0x5638fc470da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:57.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.083+0000 7fa9735e1740 1 -- 172.21.15.99:0/1831944277 >> 172.21.15.99:0/1831944277 conn(0x5638fc3c66b0 msgr2=0x5638fc3fe9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:08:57.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.083+0000 7fa9735e1740 1 -- 172.21.15.99:0/1831944277 shutdown_connections 2024-02-21T23:08:57.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.084+0000 7fa9735e1740 1 -- 172.21.15.99:0/1831944277 wait complete. 2024-02-21T23:08:57.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.085+0000 7fa9735e1740 1 -- start start 2024-02-21T23:08:57.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.085+0000 7fa9735e1740 1 Processor -- start 2024-02-21T23:08:57.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.087+0000 7fa9735e1740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5638fc4379f0 0x5638fc4cf030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:57.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.087+0000 7fa9735e1740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638fc46d090 0x5638fc46ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:57.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.087+0000 7fa9735e1740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5638fc470120 0x5638fc4ce1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:57.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.087+0000 7fa9735e1740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa968235e90 con 0x5638fc470120 2024-02-21T23:08:57.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.087+0000 7fa9735e1740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa968237190 con 0x5638fc46d090 2024-02-21T23:08:57.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.087+0000 7fa9735e1740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9682364d0 con 0x5638fc4379f0 2024-02-21T23:08:57.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.087+0000 7fa9735e1740 10 client.0 _ll_register_callbacks cb 0x7fa9600972a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:08:57.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.087+0000 7fa96de00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5638fc4379f0 0x5638fc4cf030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:57.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.087+0000 7fa96de00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5638fc4379f0 0x5638fc4cf030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:47830/0 (socket says 172.21.15.99:47830) 2024-02-21T23:08:57.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.087+0000 7fa96de00640 1 -- 172.21.15.99:0/2479745664 learned_addr learned my addr 172.21.15.99:0/2479745664 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:08:57.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.087+0000 7fa96d400640 1 --2- 172.21.15.99:0/2479745664 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638fc46d090 0x5638fc46ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:57.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.088+0000 7fa96e800640 1 --2- 172.21.15.99:0/2479745664 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5638fc470120 0x5638fc4ce1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:57.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.088+0000 7fa96de00640 1 -- 172.21.15.99:0/2479745664 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638fc46d090 msgr2=0x5638fc46ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:57.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.088+0000 7fa96de00640 1 --2- 172.21.15.99:0/2479745664 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638fc46d090 0x5638fc46ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:57.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.088+0000 7fa96de00640 1 -- 172.21.15.99:0/2479745664 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5638fc470120 msgr2=0x5638fc4ce1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:08:57.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.088+0000 7fa96de00640 1 --2- 172.21.15.99:0/2479745664 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5638fc470120 0x5638fc4ce1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:57.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.088+0000 7fa96de00640 1 -- 172.21.15.99:0/2479745664 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5638fc46f3d0 con 0x5638fc4379f0 2024-02-21T23:08:57.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.088+0000 7fa96de00640 1 --2- 172.21.15.99:0/2479745664 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5638fc4379f0 0x5638fc4cf030 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fa960097810 tx=0x7fa960082000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87b22ed8e77cec76 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:08:57.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.088+0000 7fa946a00640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-02-21T23:08:57.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.088+0000 7fa946a00640 1 -- 172.21.15.99:0/2479745664 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa960021040 con 0x5638fc4379f0 2024-02-21T23:08:57.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.089+0000 7fa946a00640 1 -- 172.21.15.99:0/2479745664 <== mon.2 v2:172.21.15.181:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 8789+0+0 (secure 0 0 0) 0x7fa960093590 con 0x5638fc4379f0 2024-02-21T23:08:57.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.089+0000 7fa9735e1740 1 -- 172.21.15.99:0/2479745664 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa958045070 con 0x5638fc4379f0 2024-02-21T23:08:57.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.089+0000 7fa946a00640 1 -- 172.21.15.99:0/2479745664 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa9600c74a0 con 0x5638fc4379f0 2024-02-21T23:08:57.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.089+0000 7fa9735e1740 10 client.6605 fetch_fsmap learned FSMap version 17 2024-02-21T23:08:57.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.089+0000 7fa9735e1740 1 -- 172.21.15.99:0/2479745664 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5638fc46f3d0 con 0x5638fc4379f0 2024-02-21T23:08:57.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.089+0000 7fa946a00640 1 -- 172.21.15.99:0/2479745664 <== mon.2 v2:172.21.15.181:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa958045070 con 0x5638fc4379f0 2024-02-21T23:08:57.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.089+0000 7fa946a00640 1 -- 172.21.15.99:0/2479745664 <== mon.2 v2:172.21.15.181:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fa960093790 con 0x5638fc4379f0 2024-02-21T23:08:57.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.089+0000 7fa9735e1740 10 client.6605 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:08:57.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.089+0000 7fa9735e1740 10 client.6605 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:08:57.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.089+0000 7fa9735e1740 20 client.6605 populate_metadata read hostname 'smithi099' 2024-02-21T23:08:57.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.089+0000 7fa9735e1740 1 --2- 172.21.15.99:0/2479745664 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5638fc3fba70 0x5638fc4ce720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:08:57.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.089+0000 7fa9735e1740 4 client.6605 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T23:08:57.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.089+0000 7fa9735e1740 1 -- 172.21.15.99:0/2479745664 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5638fc36b320 con 0x5638fc3fba70 2024-02-21T23:08:57.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.090+0000 7fa96d400640 1 --2- 172.21.15.99:0/2479745664 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5638fc3fba70 0x5638fc4ce720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:08:57.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.091+0000 7fa946a00640 10 client.6605 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:08:57.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.091+0000 7fa96d400640 1 --2- 172.21.15.99:0/2479745664 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5638fc3fba70 0x5638fc4ce720 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=49af1b11e7795b62 server_cookie=80bebdc5d2413b31 in_seq=0 out_seq=0 2024-02-21T23:08:57.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.092+0000 7fa946a00640 1 -- 172.21.15.99:0/2479745664 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x5638fc36b320 con 0x5638fc3fba70 2024-02-21T23:08:57.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.092+0000 7fa946a00640 10 client.6605 handle_command_reply: tid=0 2024-02-21T23:08:57.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.092+0000 7fa9735e1740 1 client.6605 shutdown 2024-02-21T23:08:57.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.092+0000 7fa9735e1740 1 -- 172.21.15.99:0/2479745664 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5638fc4379f0 msgr2=0x5638fc4cf030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:57.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.092+0000 7fa9735e1740 1 --2- 172.21.15.99:0/2479745664 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5638fc4379f0 0x5638fc4cf030 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fa960097810 tx=0x7fa960082000 comp rx=0 tx=0).stop 2024-02-21T23:08:57.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.092+0000 7fa9735e1740 1 -- 172.21.15.99:0/2479745664 shutdown_connections 2024-02-21T23:08:57.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.093+0000 7fa9735e1740 1 --2- 172.21.15.99:0/2479745664 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5638fc3fba70 0x5638fc4ce720 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:57.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.093+0000 7fa9735e1740 1 --2- 172.21.15.99:0/2479745664 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5638fc470120 0x5638fc4ce1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:57.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.093+0000 7fa9735e1740 1 --2- 172.21.15.99:0/2479745664 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5638fc46d090 0x5638fc46ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:57.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.093+0000 7fa9735e1740 1 --2- 172.21.15.99:0/2479745664 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5638fc4379f0 0x5638fc4cf030 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:57.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.093+0000 7fa9735e1740 1 -- 172.21.15.99:0/2479745664 >> 172.21.15.99:0/2479745664 conn(0x5638fc3c66b0 msgr2=0x5638fc470a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:08:57.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.093+0000 7fa946a00640 0 client.6605 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:08:57.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.093+0000 7fa9735e1740 1 -- 172.21.15.99:0/2479745664 shutdown_connections 2024-02-21T23:08:57.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.093+0000 7fa9735e1740 1 -- 172.21.15.99:0/2479745664 wait complete. 2024-02-21T23:08:57.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.093+0000 7fa9735e1740 20 client.6605 trim_cache size 0 max 16384 2024-02-21T23:08:57.086 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-02-21T23:08:57.086 INFO:teuthology.orchestra.run.smithi099.stdout: "status": "scrub active (872 inodes in the stack)", 2024-02-21T23:08:57.086 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubs": { 2024-02-21T23:08:57.086 INFO:teuthology.orchestra.run.smithi099.stdout: "b6ee238e-1951-453e-ac7b-45397e83575a": { 2024-02-21T23:08:57.087 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/", 2024-02-21T23:08:57.087 INFO:teuthology.orchestra.run.smithi099.stdout: "tag": "b6ee238e-1951-453e-ac7b-45397e83575a", 2024-02-21T23:08:57.087 INFO:teuthology.orchestra.run.smithi099.stdout: "options": "recursive,force" 2024-02-21T23:08:57.087 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:08:57.087 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:08:57.087 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-02-21T23:08:57.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.094+0000 7fa970800640 1 -- 172.21.15.99:0/612783235 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa94c09ef50 msgr2=0x7fa94c0a1410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:57.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.094+0000 7fa970800640 1 --2- 172.21.15.99:0/612783235 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa94c09ef50 0x7fa94c0a1410 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa96401f000 tx=0x7fa964020000 comp rx=0 tx=0).stop 2024-02-21T23:08:57.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.094+0000 7fa970800640 1 -- 172.21.15.99:0/612783235 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9540048b0 msgr2=0x7fa968193700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:08:57.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.094+0000 7fa970800640 1 --2- 172.21.15.99:0/612783235 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9540048b0 0x7fa968193700 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fa96000e820 tx=0x7fa96000ec20 comp rx=0 tx=0).stop 2024-02-21T23:08:57.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.094+0000 7fa970800640 1 -- 172.21.15.99:0/612783235 shutdown_connections 2024-02-21T23:08:57.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.094+0000 7fa970800640 1 --2- 172.21.15.99:0/612783235 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa94c09ef50 0x7fa94c0a1410 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:57.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.094+0000 7fa970800640 1 --2- 172.21.15.99:0/612783235 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa96822b610 0x7fa9680f8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:57.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.094+0000 7fa970800640 1 --2- 172.21.15.99:0/612783235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa96817fed0 0x7fa96822b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:57.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.094+0000 7fa970800640 1 --2- 172.21.15.99:0/612783235 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9540048b0 0x7fa968193700 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:08:57.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.094+0000 7fa970800640 1 -- 172.21.15.99:0/612783235 >> 172.21.15.99:0/612783235 conn(0x7fa9680ce5f0 msgr2=0x7fa9681990f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:08:57.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.095+0000 7fa970800640 1 -- 172.21.15.99:0/612783235 shutdown_connections 2024-02-21T23:08:57.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:08:57.095+0000 7fa970800640 1 -- 172.21.15.99:0/612783235 wait complete. 2024-02-21T23:08:57.108 INFO:tasks.cephfs.filesystem:scrub status for tag:b6ee238e-1951-453e-ac7b-45397e83575a - {'path': '/', 'tag': 'b6ee238e-1951-453e-ac7b-45397e83575a', 'options': 'recursive,force'} 2024-02-21T23:09:13.490 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:09:13.499 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:09:13.501 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:09:27.109 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T23:09:27.109 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T23:09:27.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.358+0000 7efcd7200640 1 Processor -- start 2024-02-21T23:09:27.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.358+0000 7efcd7200640 1 -- start start 2024-02-21T23:09:27.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.361+0000 7efcd7200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7efcd8182cd0 0x7efcd80f8e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:27.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.361+0000 7efcd7200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcd81830b0 con 0x7efcd8188750 2024-02-21T23:09:27.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.361+0000 7efcd7200640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcd8186f40 con 0x7efcd81882c0 2024-02-21T23:09:27.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.361+0000 7efcd7200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcd8187e30 con 0x7efcd8182cd0 2024-02-21T23:09:27.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.361+0000 7efcd5e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7efcd8182cd0 0x7efcd80f8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:27.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.361+0000 7efcd6800640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7efcd8188750 0x7efcd8071db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.99:49976/0 (socket says 172.21.15.99:49976) 2024-02-21T23:09:27.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.361+0000 7efcd5e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7efcd8182cd0 0x7efcd80f8e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:44072/0 (socket says 172.21.15.99:44072) 2024-02-21T23:09:27.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.361+0000 7efcd6800640 1 -- 172.21.15.99:0/1846962451 learned_addr learned my addr 172.21.15.99:0/1846962451 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:09:27.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.362+0000 7efcd5e00640 1 -- 172.21.15.99:0/1846962451 >> v1:172.21.15.181:6789/0 conn(0x7efcd81882c0 legacy=0x7efcd80716a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:09:27.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.362+0000 7efcd4a00640 1 -- 172.21.15.99:0/1846962451 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2822518660 0 0) 0x7efcd8186f40 con 0x7efcd81882c0 2024-02-21T23:09:27.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.362+0000 7efcd5e00640 1 -- 172.21.15.99:0/1846962451 >> v1:172.21.15.162:6789/0 conn(0x7efcd8188750 legacy=0x7efcd8071db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:09:27.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.362+0000 7efcd5e00640 1 -- 172.21.15.99:0/1846962451 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcd8187220 con 0x7efcd8182cd0 2024-02-21T23:09:27.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.363+0000 7efcd5e00640 1 --2- 172.21.15.99:0/1846962451 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efcd8182cd0 0x7efcd80f8e20 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7efcc80097a0 tx=0x7efcc802b710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ffd00c8c68935ea6 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:09:27.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.363+0000 7efcd4a00640 1 -- 172.21.15.99:0/1846962451 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc8037070 con 0x7efcd8182cd0 2024-02-21T23:09:27.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.364+0000 7efcd4a00640 1 -- 172.21.15.99:0/1846962451 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcc8030710 con 0x7efcd8182cd0 2024-02-21T23:09:27.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.364+0000 7efcd4a00640 1 -- 172.21.15.99:0/1846962451 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc8030ae0 con 0x7efcd8182cd0 2024-02-21T23:09:27.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.364+0000 7efcd7200640 1 -- 172.21.15.99:0/1846962451 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efcd8182cd0 msgr2=0x7efcd80f8e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:09:27.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.364+0000 7efcd7200640 1 --2- 172.21.15.99:0/1846962451 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efcd8182cd0 0x7efcd80f8e20 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7efcc80097a0 tx=0x7efcc802b710 comp rx=0 tx=0).stop 2024-02-21T23:09:27.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.364+0000 7efcd7200640 1 -- 172.21.15.99:0/1846962451 shutdown_connections 2024-02-21T23:09:27.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.364+0000 7efcd7200640 1 --2- 172.21.15.99:0/1846962451 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efcd8182cd0 0x7efcd80f8e20 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:27.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.364+0000 7efcd7200640 1 -- 172.21.15.99:0/1846962451 >> 172.21.15.99:0/1846962451 conn(0x7efcd80fe4a0 msgr2=0x7efcd80fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:09:27.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.365+0000 7efcd7200640 1 -- 172.21.15.99:0/1846962451 shutdown_connections 2024-02-21T23:09:27.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.365+0000 7efcd7200640 1 -- 172.21.15.99:0/1846962451 wait complete. 2024-02-21T23:09:27.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.368+0000 7efcd7200640 1 Processor -- start 2024-02-21T23:09:27.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.368+0000 7efcd7200640 1 -- start start 2024-02-21T23:09:27.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.370+0000 7efcd7200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efcd8182cd0 0x7efcd8221a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:27.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.370+0000 7efcd7200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efcd81882c0 0x7efcd821ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:27.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.370+0000 7efcd7200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efcd8188750 0x7efcd817a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:27.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.370+0000 7efcd7200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd8187ac0 con 0x7efcd8188750 2024-02-21T23:09:27.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.370+0000 7efcd7200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd81877e0 con 0x7efcd81882c0 2024-02-21T23:09:27.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.370+0000 7efcd7200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd80724c0 con 0x7efcd8182cd0 2024-02-21T23:09:27.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.370+0000 7efcd6800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efcd8188750 0x7efcd817a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:27.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.370+0000 7efcd5e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efcd8182cd0 0x7efcd8221a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:27.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.370+0000 7efcd6800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efcd8188750 0x7efcd817a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42480/0 (socket says 172.21.15.99:42480) 2024-02-21T23:09:27.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.371+0000 7efcd5e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efcd8182cd0 0x7efcd8221a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:40856/0 (socket says 172.21.15.99:40856) 2024-02-21T23:09:27.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.371+0000 7efcd6800640 1 -- 172.21.15.99:0/3346476879 learned_addr learned my addr 172.21.15.99:0/3346476879 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:09:27.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.371+0000 7efcd5400640 1 --2- 172.21.15.99:0/3346476879 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efcd81882c0 0x7efcd821ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:27.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.371+0000 7efcd5e00640 1 -- 172.21.15.99:0/3346476879 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efcd81882c0 msgr2=0x7efcd821ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:09:27.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.371+0000 7efcd5e00640 1 --2- 172.21.15.99:0/3346476879 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efcd81882c0 0x7efcd821ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:27.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.371+0000 7efcd5e00640 1 -- 172.21.15.99:0/3346476879 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efcd8188750 msgr2=0x7efcd817a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:09:27.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.371+0000 7efcd5e00640 1 --2- 172.21.15.99:0/3346476879 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efcd8188750 0x7efcd817a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:27.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.371+0000 7efcd5e00640 1 -- 172.21.15.99:0/3346476879 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcd82206a0 con 0x7efcd8182cd0 2024-02-21T23:09:27.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.371+0000 7efcd5400640 1 --2- 172.21.15.99:0/3346476879 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efcd81882c0 0x7efcd821ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:09:27.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.371+0000 7efcd5e00640 1 --2- 172.21.15.99:0/3346476879 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efcd8182cd0 0x7efcd8221a20 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7efcc8032000 tx=0x7efcc80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:09:27.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.372+0000 7efcce000640 1 -- 172.21.15.99:0/3346476879 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc8042070 con 0x7efcd8182cd0 2024-02-21T23:09:27.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.372+0000 7efcce000640 1 -- 172.21.15.99:0/3346476879 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcc8032a40 con 0x7efcd8182cd0 2024-02-21T23:09:27.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.372+0000 7efcd7200640 1 -- 172.21.15.99:0/3346476879 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcd8220980 con 0x7efcd8182cd0 2024-02-21T23:09:27.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.372+0000 7efcce000640 1 -- 172.21.15.99:0/3346476879 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc8037040 con 0x7efcd8182cd0 2024-02-21T23:09:27.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.372+0000 7efcd7200640 1 -- 172.21.15.99:0/3346476879 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcd8220f40 con 0x7efcd8182cd0 2024-02-21T23:09:27.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.375+0000 7efcce000640 1 -- 172.21.15.99:0/3346476879 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7efcc8045070 con 0x7efcd8182cd0 2024-02-21T23:09:27.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.376+0000 7efcce000640 1 --2- 172.21.15.99:0/3346476879 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7efcb809eed0 0x7efcb80a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:27.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.377+0000 7efcdf9e9740 1 Processor -- start 2024-02-21T23:09:27.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.377+0000 7efcce000640 1 -- 172.21.15.99:0/3346476879 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 8877+0+0 (secure 0 0 0) 0x7efcc80ebd90 con 0x7efcd8182cd0 2024-02-21T23:09:27.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.377+0000 7efcdf9e9740 1 -- start start 2024-02-21T23:09:27.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.377+0000 7efcd5400640 1 --2- 172.21.15.99:0/3346476879 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7efcb809eed0 0x7efcb80a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:27.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.378+0000 7efcd5400640 1 --2- 172.21.15.99:0/3346476879 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7efcb809eed0 0x7efcb80a1390 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7efcd816e5a0 tx=0x7efcc4009040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:09:27.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.379+0000 7efcdf9e9740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555af3b932a0 0x555af3bc8d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:27.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.379+0000 7efcdf9e9740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555af3bc9260 0x555af3b93680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:27.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.379+0000 7efcdf9e9740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555af3b93bc0 0x555af3b561d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:27.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.379+0000 7efcdf9e9740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x555af3abfa90 con 0x555af3bc9260 2024-02-21T23:09:27.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.379+0000 7efcdf9e9740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x555af3a68b10 con 0x555af3b932a0 2024-02-21T23:09:27.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.379+0000 7efcdf9e9740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x555af3abbb30 con 0x555af3b93bc0 2024-02-21T23:09:27.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.379+0000 7efcd5e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555af3b932a0 0x555af3bc8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:27.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.379+0000 7efcd5400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555af3bc9260 0x555af3b93680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:27.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.379+0000 7efcd5e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555af3b932a0 0x555af3bc8d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:44096/0 (socket says 172.21.15.99:44096) 2024-02-21T23:09:27.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.379+0000 7efcd5e00640 1 -- 172.21.15.99:0/3570035999 learned_addr learned my addr 172.21.15.99:0/3570035999 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:09:27.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.379+0000 7efcd6800640 1 --2- 172.21.15.99:0/3570035999 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555af3b93bc0 0x555af3b561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:27.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.380+0000 7efcd5e00640 1 -- 172.21.15.99:0/3570035999 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555af3b93bc0 msgr2=0x555af3b561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:09:27.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.380+0000 7efcd5e00640 1 --2- 172.21.15.99:0/3570035999 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555af3b93bc0 0x555af3b561d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:27.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.380+0000 7efcd5e00640 1 -- 172.21.15.99:0/3570035999 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555af3bc9260 msgr2=0x555af3b93680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:09:27.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.380+0000 7efcd5e00640 1 --2- 172.21.15.99:0/3570035999 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555af3bc9260 0x555af3b93680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:27.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.380+0000 7efcd5e00640 1 -- 172.21.15.99:0/3570035999 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555af389e7d0 con 0x555af3b932a0 2024-02-21T23:09:27.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.380+0000 7efcd5e00640 1 --2- 172.21.15.99:0/3570035999 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555af3b932a0 0x555af3bc8d20 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7efcc80e93e0 tx=0x7efcc80b9370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0457075dca25aa5 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:09:27.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.380+0000 7efcc2600640 1 -- 172.21.15.99:0/3570035999 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc80bd7a0 con 0x555af3b932a0 2024-02-21T23:09:27.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.380+0000 7efcc2600640 1 -- 172.21.15.99:0/3570035999 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcc80c1df0 con 0x555af3b932a0 2024-02-21T23:09:27.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.380+0000 7efcc2600640 1 -- 172.21.15.99:0/3570035999 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc80e9600 con 0x555af3b932a0 2024-02-21T23:09:27.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.381+0000 7efcdf9e9740 1 -- 172.21.15.99:0/3570035999 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555af3b932a0 msgr2=0x555af3bc8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:09:27.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.381+0000 7efcdf9e9740 1 --2- 172.21.15.99:0/3570035999 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555af3b932a0 0x555af3bc8d20 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7efcc80e93e0 tx=0x7efcc80b9370 comp rx=0 tx=0).stop 2024-02-21T23:09:27.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.381+0000 7efcdf9e9740 1 -- 172.21.15.99:0/3570035999 shutdown_connections 2024-02-21T23:09:27.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.381+0000 7efcdf9e9740 1 --2- 172.21.15.99:0/3570035999 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555af3b93bc0 0x555af3b561d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:27.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.381+0000 7efcdf9e9740 1 --2- 172.21.15.99:0/3570035999 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555af3bc9260 0x555af3b93680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:27.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.381+0000 7efcdf9e9740 1 --2- 172.21.15.99:0/3570035999 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555af3b932a0 0x555af3bc8d20 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:27.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.381+0000 7efcdf9e9740 1 -- 172.21.15.99:0/3570035999 >> 172.21.15.99:0/3570035999 conn(0x555af3b226b0 msgr2=0x555af3b5a190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:09:27.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.381+0000 7efcdf9e9740 1 -- 172.21.15.99:0/3570035999 shutdown_connections 2024-02-21T23:09:27.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.381+0000 7efcdf9e9740 1 -- 172.21.15.99:0/3570035999 wait complete. 2024-02-21T23:09:27.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.382+0000 7efcdf9e9740 1 -- start start 2024-02-21T23:09:27.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.383+0000 7efcdf9e9740 1 Processor -- start 2024-02-21T23:09:27.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.385+0000 7efcdf9e9740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555af3b932a0 0x555af3b8cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:27.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.385+0000 7efcdf9e9740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555af3b93bc0 0x555af3b9ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:27.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.385+0000 7efcdf9e9740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555af3bc9260 0x555af3b9d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:27.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.385+0000 7efcdf9e9740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x555af3b61f30 con 0x555af3b932a0 2024-02-21T23:09:27.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.385+0000 7efcdf9e9740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x555af3a5e1c0 con 0x555af3bc9260 2024-02-21T23:09:27.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.385+0000 7efcdf9e9740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x555af3bca930 con 0x555af3b93bc0 2024-02-21T23:09:27.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.385+0000 7efcdf9e9740 10 client.0 _ll_register_callbacks cb 0x555af3a7b930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:09:27.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.385+0000 7efcd5e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555af3b932a0 0x555af3b8cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:27.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.385+0000 7efcd5e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555af3b932a0 0x555af3b8cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42504/0 (socket says 172.21.15.99:42504) 2024-02-21T23:09:27.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.385+0000 7efcd5400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555af3b93bc0 0x555af3b9ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:27.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.385+0000 7efcd5e00640 1 -- 172.21.15.99:0/2014731563 learned_addr learned my addr 172.21.15.99:0/2014731563 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:09:27.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.385+0000 7efcd6800640 1 --2- 172.21.15.99:0/2014731563 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555af3bc9260 0x555af3b9d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:27.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.386+0000 7efcd5e00640 1 -- 172.21.15.99:0/2014731563 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555af3b93bc0 msgr2=0x555af3b9ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:09:27.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.386+0000 7efcd5e00640 1 --2- 172.21.15.99:0/2014731563 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555af3b93bc0 0x555af3b9ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:27.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.386+0000 7efcd5e00640 1 -- 172.21.15.99:0/2014731563 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555af3bc9260 msgr2=0x555af3b9d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:09:27.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.386+0000 7efcd5e00640 1 --2- 172.21.15.99:0/2014731563 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555af3bc9260 0x555af3b9d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:27.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.386+0000 7efcd5e00640 1 -- 172.21.15.99:0/2014731563 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555af37d43f0 con 0x555af3b932a0 2024-02-21T23:09:27.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.386+0000 7efcd5400640 1 --2- 172.21.15.99:0/2014731563 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555af3b93bc0 0x555af3b9ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:09:27.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.386+0000 7efcd6800640 1 --2- 172.21.15.99:0/2014731563 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555af3bc9260 0x555af3b9d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:09:27.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.386+0000 7efcd5e00640 1 --2- 172.21.15.99:0/2014731563 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555af3b932a0 0x555af3b8cf40 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7efcc80b79b0 tx=0x7efcc8006c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e005d1423bc6fb01 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:09:27.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.386+0000 7efcb6a00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:09:27.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.386+0000 7efcb6a00640 1 -- 172.21.15.99:0/2014731563 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc80c1960 con 0x555af3b932a0 2024-02-21T23:09:27.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.386+0000 7efcb6a00640 1 -- 172.21.15.99:0/2014731563 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8877+0+0 (secure 0 0 0) 0x7efcc80c1b00 con 0x555af3b932a0 2024-02-21T23:09:27.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.386+0000 7efcdf9e9740 1 -- 172.21.15.99:0/2014731563 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efcc80c1df0 con 0x555af3b932a0 2024-02-21T23:09:27.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.387+0000 7efcb6a00640 1 -- 172.21.15.99:0/2014731563 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7efcc80b8b50 con 0x555af3b932a0 2024-02-21T23:09:27.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.387+0000 7efcdf9e9740 10 client.6486 fetch_fsmap learned FSMap version 17 2024-02-21T23:09:27.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.387+0000 7efcdf9e9740 1 -- 172.21.15.99:0/2014731563 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x555af37940f0 con 0x555af3b932a0 2024-02-21T23:09:27.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.387+0000 7efcb6a00640 1 -- 172.21.15.99:0/2014731563 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcc80c1df0 con 0x555af3b932a0 2024-02-21T23:09:27.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.387+0000 7efcb6a00640 1 -- 172.21.15.99:0/2014731563 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7efcc80b8cf0 con 0x555af3b932a0 2024-02-21T23:09:27.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.387+0000 7efcdf9e9740 10 client.6486 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:09:27.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.387+0000 7efcdf9e9740 10 client.6486 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:09:27.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.387+0000 7efcdf9e9740 20 client.6486 populate_metadata read hostname 'smithi099' 2024-02-21T23:09:27.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.387+0000 7efcdf9e9740 1 --2- 172.21.15.99:0/2014731563 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x555af3b9dc80 0x555af3b9e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:27.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.387+0000 7efcdf9e9740 4 client.6486 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:09:27.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.387+0000 7efcdf9e9740 1 -- 172.21.15.99:0/2014731563 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555af3accfd0 con 0x555af3b9dc80 2024-02-21T23:09:27.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.388+0000 7efcd5400640 1 --2- 172.21.15.99:0/2014731563 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x555af3b9dc80 0x555af3b9e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:27.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.388+0000 7efcd5400640 1 --2- 172.21.15.99:0/2014731563 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x555af3b9dc80 0x555af3b9e090 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7896d38e89dcd6a1 server_cookie=f528b83eb4114cd2 in_seq=0 out_seq=0 2024-02-21T23:09:27.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.388+0000 7efcb6a00640 10 client.6486 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:09:27.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.389+0000 7efcb6a00640 1 -- 172.21.15.99:0/2014731563 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x555af3accfd0 con 0x555af3b9dc80 2024-02-21T23:09:27.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.389+0000 7efcb6a00640 10 client.6486 handle_command_reply: tid=0 2024-02-21T23:09:27.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.389+0000 7efcdf9e9740 1 client.6486 shutdown 2024-02-21T23:09:27.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.389+0000 7efcdf9e9740 1 -- 172.21.15.99:0/2014731563 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555af3b932a0 msgr2=0x555af3b8cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:09:27.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.389+0000 7efcdf9e9740 1 --2- 172.21.15.99:0/2014731563 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555af3b932a0 0x555af3b8cf40 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7efcc80b79b0 tx=0x7efcc8006c30 comp rx=0 tx=0).stop 2024-02-21T23:09:27.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.389+0000 7efcdf9e9740 1 -- 172.21.15.99:0/2014731563 shutdown_connections 2024-02-21T23:09:27.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.389+0000 7efcdf9e9740 1 --2- 172.21.15.99:0/2014731563 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x555af3b9dc80 0x555af3b9e090 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:27.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.389+0000 7efcdf9e9740 1 --2- 172.21.15.99:0/2014731563 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555af3bc9260 0x555af3b9d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:27.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.389+0000 7efcdf9e9740 1 --2- 172.21.15.99:0/2014731563 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555af3b93bc0 0x555af3b9ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:27.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.389+0000 7efcdf9e9740 1 --2- 172.21.15.99:0/2014731563 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555af3b932a0 0x555af3b8cf40 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:27.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.389+0000 7efcdf9e9740 1 -- 172.21.15.99:0/2014731563 >> 172.21.15.99:0/2014731563 conn(0x555af3b226b0 msgr2=0x555af3b5ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:09:27.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.389+0000 7efcb6a00640 0 client.6486 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:09:27.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.390+0000 7efcdf9e9740 1 -- 172.21.15.99:0/2014731563 shutdown_connections 2024-02-21T23:09:27.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.390+0000 7efcdf9e9740 1 -- 172.21.15.99:0/2014731563 wait complete. 2024-02-21T23:09:27.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.390+0000 7efcdf9e9740 20 client.6486 trim_cache size 0 max 16384 2024-02-21T23:09:27.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.417+0000 7efcdf9e9740 1 Processor -- start 2024-02-21T23:09:27.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.417+0000 7efcdf9e9740 1 -- start start 2024-02-21T23:09:27.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.418+0000 7efcdf9e9740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555af3b932a0 0x555af3b8a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:27.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.418+0000 7efcdf9e9740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555af3b93bc0 0x555af3beb9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:27.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.418+0000 7efcdf9e9740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555af3bc9260 0x555af3bebf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:27.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.418+0000 7efcdf9e9740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd822ca90 con 0x555af3b932a0 2024-02-21T23:09:27.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.418+0000 7efcdf9e9740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd822a630 con 0x555af3bc9260 2024-02-21T23:09:27.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.418+0000 7efcdf9e9740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd8228730 con 0x555af3b93bc0 2024-02-21T23:09:27.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.419+0000 7efcd5e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555af3b932a0 0x555af3b8a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:27.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.419+0000 7efcd5e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555af3b932a0 0x555af3b8a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42512/0 (socket says 172.21.15.99:42512) 2024-02-21T23:09:27.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.419+0000 7efcd5400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555af3b93bc0 0x555af3beb9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:27.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.419+0000 7efcd5e00640 1 -- 172.21.15.99:0/3195177457 learned_addr learned my addr 172.21.15.99:0/3195177457 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:09:27.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.419+0000 7efcd6800640 1 --2- 172.21.15.99:0/3195177457 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555af3bc9260 0x555af3bebf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:27.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.419+0000 7efcd5400640 1 -- 172.21.15.99:0/3195177457 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555af3bc9260 msgr2=0x555af3bebf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:09:27.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.419+0000 7efcd5400640 1 --2- 172.21.15.99:0/3195177457 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555af3bc9260 0x555af3bebf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:27.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.419+0000 7efcd5400640 1 -- 172.21.15.99:0/3195177457 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555af3b932a0 msgr2=0x555af3b8a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:09:27.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.419+0000 7efcd5400640 1 --2- 172.21.15.99:0/3195177457 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555af3b932a0 0x555af3b8a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:27.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.419+0000 7efcd5400640 1 -- 172.21.15.99:0/3195177457 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555af3b9bc80 con 0x555af3b93bc0 2024-02-21T23:09:27.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.420+0000 7efcd5400640 1 --2- 172.21.15.99:0/3195177457 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555af3b93bc0 0x555af3beb9d0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7efcd816e5f0 tx=0x7efcc400a000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51cc36bca50ba27d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:09:27.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.420+0000 7efcc1c00640 1 -- 172.21.15.99:0/3195177457 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc402a2d0 con 0x555af3b93bc0 2024-02-21T23:09:27.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.420+0000 7efcc1c00640 1 -- 172.21.15.99:0/3195177457 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcc401b040 con 0x555af3b93bc0 2024-02-21T23:09:27.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.420+0000 7efcc1c00640 1 -- 172.21.15.99:0/3195177457 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc4016110 con 0x555af3b93bc0 2024-02-21T23:09:27.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.421+0000 7efcdf9e9740 1 -- 172.21.15.99:0/3195177457 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555af3b93bc0 msgr2=0x555af3beb9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:09:27.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.421+0000 7efcdf9e9740 1 --2- 172.21.15.99:0/3195177457 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555af3b93bc0 0x555af3beb9d0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7efcd816e5f0 tx=0x7efcc400a000 comp rx=0 tx=0).stop 2024-02-21T23:09:27.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.421+0000 7efcdf9e9740 1 -- 172.21.15.99:0/3195177457 shutdown_connections 2024-02-21T23:09:27.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.421+0000 7efcdf9e9740 1 --2- 172.21.15.99:0/3195177457 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555af3bc9260 0x555af3bebf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:27.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.421+0000 7efcdf9e9740 1 --2- 172.21.15.99:0/3195177457 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555af3b93bc0 0x555af3beb9d0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:27.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.421+0000 7efcdf9e9740 1 --2- 172.21.15.99:0/3195177457 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555af3b932a0 0x555af3b8a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:27.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.421+0000 7efcdf9e9740 1 -- 172.21.15.99:0/3195177457 >> 172.21.15.99:0/3195177457 conn(0x555af3b226b0 msgr2=0x555af3bc7100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:09:27.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.421+0000 7efcdf9e9740 1 -- 172.21.15.99:0/3195177457 shutdown_connections 2024-02-21T23:09:27.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.421+0000 7efcdf9e9740 1 -- 172.21.15.99:0/3195177457 wait complete. 2024-02-21T23:09:27.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.422+0000 7efcdf9e9740 1 -- start start 2024-02-21T23:09:27.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.423+0000 7efcdf9e9740 1 Processor -- start 2024-02-21T23:09:27.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.425+0000 7efcdf9e9740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555af3b932a0 0x555af3b589a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:27.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.425+0000 7efcdf9e9740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555af3b93bc0 0x555af3c36050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:27.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.425+0000 7efcdf9e9740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555af3bc9260 0x555af3b89260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:27.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.425+0000 7efcdf9e9740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd8228d30 con 0x555af3bc9260 2024-02-21T23:09:27.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.425+0000 7efcdf9e9740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd8229fd0 con 0x555af3b93bc0 2024-02-21T23:09:27.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.425+0000 7efcdf9e9740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd8229330 con 0x555af3b932a0 2024-02-21T23:09:27.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.425+0000 7efcdf9e9740 10 client.0 _ll_register_callbacks cb 0x7efcc80b9240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:09:27.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.425+0000 7efcd6800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555af3bc9260 0x555af3b89260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:27.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.425+0000 7efcd5e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555af3b932a0 0x555af3b589a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:27.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.425+0000 7efcd5e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555af3b932a0 0x555af3b589a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:40902/0 (socket says 172.21.15.99:40902) 2024-02-21T23:09:27.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.425+0000 7efcd5e00640 1 -- 172.21.15.99:0/1240289223 learned_addr learned my addr 172.21.15.99:0/1240289223 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:09:27.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.425+0000 7efcd5400640 1 --2- 172.21.15.99:0/1240289223 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555af3b93bc0 0x555af3c36050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:27.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.426+0000 7efcd5e00640 1 -- 172.21.15.99:0/1240289223 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555af3b93bc0 msgr2=0x555af3c36050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:09:27.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.426+0000 7efcd5e00640 1 --2- 172.21.15.99:0/1240289223 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555af3b93bc0 0x555af3c36050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:27.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.426+0000 7efcd5e00640 1 -- 172.21.15.99:0/1240289223 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555af3bc9260 msgr2=0x555af3b89260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:09:27.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.426+0000 7efcd5e00640 1 --2- 172.21.15.99:0/1240289223 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555af3bc9260 0x555af3b89260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:27.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.426+0000 7efcd5e00640 1 -- 172.21.15.99:0/1240289223 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555af3b897a0 con 0x555af3b932a0 2024-02-21T23:09:27.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.426+0000 7efcd5400640 1 --2- 172.21.15.99:0/1240289223 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555af3b93bc0 0x555af3c36050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:09:27.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.426+0000 7efcd6800640 1 --2- 172.21.15.99:0/1240289223 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555af3bc9260 0x555af3b89260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:09:27.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.426+0000 7efcd5e00640 1 --2- 172.21.15.99:0/1240289223 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555af3b932a0 0x555af3b589a0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7efcc80bd120 tx=0x7efcc8009190 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79457c9f1cdd693f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:09:27.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.426+0000 7efcb6a00640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-02-21T23:09:27.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.426+0000 7efcb6a00640 1 -- 172.21.15.99:0/1240289223 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc8032e30 con 0x555af3b932a0 2024-02-21T23:09:27.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.426+0000 7efcb6a00640 1 -- 172.21.15.99:0/1240289223 <== mon.2 v2:172.21.15.181:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8877+0+0 (secure 0 0 0) 0x7efcc80b5450 con 0x555af3b932a0 2024-02-21T23:09:27.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.426+0000 7efcdf9e9740 1 -- 172.21.15.99:0/1240289223 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efcc401b040 con 0x555af3b932a0 2024-02-21T23:09:27.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.426+0000 7efcb6a00640 1 -- 172.21.15.99:0/1240289223 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7efcc80c7050 con 0x555af3b932a0 2024-02-21T23:09:27.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.426+0000 7efcdf9e9740 10 client.6623 fetch_fsmap learned FSMap version 17 2024-02-21T23:09:27.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.426+0000 7efcdf9e9740 1 -- 172.21.15.99:0/1240289223 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x555af3b897a0 con 0x555af3b932a0 2024-02-21T23:09:27.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.427+0000 7efcb6a00640 1 -- 172.21.15.99:0/1240289223 <== mon.2 v2:172.21.15.181:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcc401b040 con 0x555af3b932a0 2024-02-21T23:09:27.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.427+0000 7efcb6a00640 1 -- 172.21.15.99:0/1240289223 <== mon.2 v2:172.21.15.181:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7efcc80e9ad0 con 0x555af3b932a0 2024-02-21T23:09:27.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.427+0000 7efcdf9e9740 10 client.6623 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:09:27.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.427+0000 7efcdf9e9740 10 client.6623 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:09:27.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.427+0000 7efcdf9e9740 20 client.6623 populate_metadata read hostname 'smithi099' 2024-02-21T23:09:27.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.427+0000 7efcdf9e9740 1 --2- 172.21.15.99:0/1240289223 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x555af3bddd40 0x555af3beb9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:27.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.427+0000 7efcdf9e9740 4 client.6623 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T23:09:27.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.427+0000 7efcdf9e9740 1 -- 172.21.15.99:0/1240289223 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x555af3ac7320 con 0x555af3bddd40 2024-02-21T23:09:27.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.427+0000 7efcd5400640 1 --2- 172.21.15.99:0/1240289223 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x555af3bddd40 0x555af3beb9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:27.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.428+0000 7efcd5400640 1 --2- 172.21.15.99:0/1240289223 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x555af3bddd40 0x555af3beb9d0 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=457b160591da7bf5 server_cookie=941fe539a387129a in_seq=0 out_seq=0 2024-02-21T23:09:27.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.428+0000 7efcb6a00640 10 client.6623 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:09:27.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.428+0000 7efcb6a00640 1 -- 172.21.15.99:0/1240289223 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x555af3ac7320 con 0x555af3bddd40 2024-02-21T23:09:27.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.428+0000 7efcb6a00640 10 client.6623 handle_command_reply: tid=0 2024-02-21T23:09:27.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.428+0000 7efcdf9e9740 1 client.6623 shutdown 2024-02-21T23:09:27.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.428+0000 7efcdf9e9740 1 -- 172.21.15.99:0/1240289223 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555af3b932a0 msgr2=0x555af3b589a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:09:27.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.428+0000 7efcdf9e9740 1 --2- 172.21.15.99:0/1240289223 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555af3b932a0 0x555af3b589a0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7efcc80bd120 tx=0x7efcc8009190 comp rx=0 tx=0).stop 2024-02-21T23:09:27.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.428+0000 7efcdf9e9740 1 -- 172.21.15.99:0/1240289223 shutdown_connections 2024-02-21T23:09:27.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.428+0000 7efcdf9e9740 1 --2- 172.21.15.99:0/1240289223 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x555af3bddd40 0x555af3beb9d0 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:27.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.428+0000 7efcdf9e9740 1 --2- 172.21.15.99:0/1240289223 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555af3bc9260 0x555af3b89260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:27.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.428+0000 7efcdf9e9740 1 --2- 172.21.15.99:0/1240289223 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555af3b93bc0 0x555af3c36050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:27.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.428+0000 7efcdf9e9740 1 --2- 172.21.15.99:0/1240289223 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555af3b932a0 0x555af3b589a0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:27.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.428+0000 7efcb6a00640 0 client.6623 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:09:27.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.428+0000 7efcdf9e9740 1 -- 172.21.15.99:0/1240289223 >> 172.21.15.99:0/1240289223 conn(0x555af3b226b0 msgr2=0x555af3bc85c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:09:27.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.429+0000 7efcdf9e9740 1 -- 172.21.15.99:0/1240289223 shutdown_connections 2024-02-21T23:09:27.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.429+0000 7efcdf9e9740 1 -- 172.21.15.99:0/1240289223 wait complete. 2024-02-21T23:09:27.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.429+0000 7efcdf9e9740 20 client.6623 trim_cache size 0 max 16384 2024-02-21T23:09:27.423 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-02-21T23:09:27.423 INFO:teuthology.orchestra.run.smithi099.stdout: "status": "no active scrubs running", 2024-02-21T23:09:27.423 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubs": {} 2024-02-21T23:09:27.423 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-02-21T23:09:27.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.429+0000 7efcd7200640 1 -- 172.21.15.99:0/3346476879 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7efcb809eed0 msgr2=0x7efcb80a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:09:27.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.429+0000 7efcd7200640 1 --2- 172.21.15.99:0/3346476879 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7efcb809eed0 0x7efcb80a1390 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7efcd816e5a0 tx=0x7efcc4009040 comp rx=0 tx=0).stop 2024-02-21T23:09:27.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.429+0000 7efcd7200640 1 -- 172.21.15.99:0/3346476879 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efcd8182cd0 msgr2=0x7efcd8221a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:09:27.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.429+0000 7efcd7200640 1 --2- 172.21.15.99:0/3346476879 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efcd8182cd0 0x7efcd8221a20 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7efcc8032000 tx=0x7efcc80046c0 comp rx=0 tx=0).stop 2024-02-21T23:09:27.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.430+0000 7efcd7200640 1 -- 172.21.15.99:0/3346476879 shutdown_connections 2024-02-21T23:09:27.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.430+0000 7efcd7200640 1 --2- 172.21.15.99:0/3346476879 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7efcb809eed0 0x7efcb80a1390 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:27.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.430+0000 7efcd7200640 1 --2- 172.21.15.99:0/3346476879 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efcd8188750 0x7efcd817a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:27.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.430+0000 7efcd7200640 1 --2- 172.21.15.99:0/3346476879 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efcd81882c0 0x7efcd821ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:27.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.430+0000 7efcd7200640 1 --2- 172.21.15.99:0/3346476879 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efcd8182cd0 0x7efcd8221a20 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:27.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.430+0000 7efcd7200640 1 -- 172.21.15.99:0/3346476879 >> 172.21.15.99:0/3346476879 conn(0x7efcd80fe4a0 msgr2=0x7efcd80716a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:09:27.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.430+0000 7efcd7200640 1 -- 172.21.15.99:0/3346476879 shutdown_connections 2024-02-21T23:09:27.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.430+0000 7efcd7200640 1 -- 172.21.15.99:0/3346476879 wait complete. 2024-02-21T23:09:27.438 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-02-21T23:09:27.438 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T23:09:27.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.658+0000 7f427ea00640 1 Processor -- start 2024-02-21T23:09:27.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.658+0000 7f427ea00640 1 -- start start 2024-02-21T23:09:27.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.660+0000 7f427ea00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f42780faa20 0x7f42780d0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:27.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.660+0000 7f427ea00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4278187ae0 con 0x7f4278188e70 2024-02-21T23:09:27.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.660+0000 7f427ea00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4278187dc0 con 0x7f4278188a90 2024-02-21T23:09:27.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.660+0000 7f427ea00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42780d0820 con 0x7f42780faa20 2024-02-21T23:09:27.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.660+0000 7f427cc00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f4278188e70 0x7f42781892f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.99:49982/0 (socket says 172.21.15.99:49982) 2024-02-21T23:09:27.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.660+0000 7f427e000640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f42780faa20 0x7f42780d0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:27.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.660+0000 7f427cc00640 1 -- 172.21.15.99:0/3180149025 learned_addr learned my addr 172.21.15.99:0/3180149025 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:09:27.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.661+0000 7f4277e00640 1 -- 172.21.15.99:0/3180149025 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1395048255 0 0) 0x7f4278187ae0 con 0x7f4278188e70 2024-02-21T23:09:27.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.661+0000 7f4277e00640 1 -- 172.21.15.99:0/3180149025 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4260003520 con 0x7f4278188e70 2024-02-21T23:09:27.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.661+0000 7f4277e00640 1 -- 172.21.15.99:0/3180149025 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2541903950 0 0) 0x7f4278187dc0 con 0x7f4278188a90 2024-02-21T23:09:27.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.661+0000 7f4277e00640 1 -- 172.21.15.99:0/3180149025 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4278187ae0 con 0x7f4278188a90 2024-02-21T23:09:27.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.661+0000 7f427e000640 1 -- 172.21.15.99:0/3180149025 >> v1:172.21.15.181:6789/0 conn(0x7f4278188a90 legacy=0x7f42780fca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:09:27.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.661+0000 7f427e000640 1 -- 172.21.15.99:0/3180149025 >> v1:172.21.15.162:6789/0 conn(0x7f4278188e70 legacy=0x7f42781892f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:09:27.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.661+0000 7f427e000640 1 -- 172.21.15.99:0/3180149025 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42781880a0 con 0x7f42780faa20 2024-02-21T23:09:27.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.662+0000 7f427e000640 1 --2- 172.21.15.99:0/3180149025 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f42780faa20 0x7f42780d0cb0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f42700097a0 tx=0x7f427002b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7d84f7315323e22 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:09:27.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.666+0000 7f4277e00640 1 -- 172.21.15.99:0/3180149025 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4270034070 con 0x7f42780faa20 2024-02-21T23:09:27.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.666+0000 7f4277e00640 1 -- 172.21.15.99:0/3180149025 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4270030610 con 0x7f42780faa20 2024-02-21T23:09:27.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.666+0000 7f4277e00640 1 -- 172.21.15.99:0/3180149025 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42700309e0 con 0x7f42780faa20 2024-02-21T23:09:27.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.667+0000 7f427ea00640 1 -- 172.21.15.99:0/3180149025 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f42780faa20 msgr2=0x7f42780d0cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:09:27.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.667+0000 7f427ea00640 1 --2- 172.21.15.99:0/3180149025 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f42780faa20 0x7f42780d0cb0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f42700097a0 tx=0x7f427002b960 comp rx=0 tx=0).stop 2024-02-21T23:09:27.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.667+0000 7f427ea00640 1 -- 172.21.15.99:0/3180149025 shutdown_connections 2024-02-21T23:09:27.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.667+0000 7f427ea00640 1 --2- 172.21.15.99:0/3180149025 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f42780faa20 0x7f42780d0cb0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:27.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.667+0000 7f427ea00640 1 -- 172.21.15.99:0/3180149025 >> 172.21.15.99:0/3180149025 conn(0x7f42780fe3d0 msgr2=0x7f42780fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:09:27.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.667+0000 7f427ea00640 1 -- 172.21.15.99:0/3180149025 shutdown_connections 2024-02-21T23:09:27.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.668+0000 7f427ea00640 1 -- 172.21.15.99:0/3180149025 wait complete. 2024-02-21T23:09:27.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.670+0000 7f427ea00640 1 Processor -- start 2024-02-21T23:09:27.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.670+0000 7f427ea00640 1 -- start start 2024-02-21T23:09:27.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.671+0000 7f427ea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f42780faa20 0x7f4278176d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:27.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.671+0000 7f427ea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4278188a90 0x7f427817cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:27.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.671+0000 7f427ea00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4278188e70 0x7f4278221c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:27.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.671+0000 7f427ea00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42780fd110 con 0x7f42780faa20 2024-02-21T23:09:27.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.671+0000 7f427ea00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4278188660 con 0x7f4278188a90 2024-02-21T23:09:27.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.671+0000 7f427ea00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4278164aa0 con 0x7f4278188e70 2024-02-21T23:09:27.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.671+0000 7f427d600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f42780faa20 0x7f4278176d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:27.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.671+0000 7f427cc00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4278188a90 0x7f427817cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:27.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.671+0000 7f427e000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4278188e70 0x7f4278221c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:27.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.671+0000 7f427cc00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4278188a90 0x7f427817cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:44128/0 (socket says 172.21.15.99:44128) 2024-02-21T23:09:27.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.671+0000 7f427cc00640 1 -- 172.21.15.99:0/3753401683 learned_addr learned my addr 172.21.15.99:0/3753401683 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:09:27.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.672+0000 7f427cc00640 1 -- 172.21.15.99:0/3753401683 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4278188e70 msgr2=0x7f4278221c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:09:27.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.672+0000 7f427cc00640 1 --2- 172.21.15.99:0/3753401683 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4278188e70 0x7f4278221c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:27.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.672+0000 7f427cc00640 1 -- 172.21.15.99:0/3753401683 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f42780faa20 msgr2=0x7f4278176d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:09:27.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.672+0000 7f427cc00640 1 --2- 172.21.15.99:0/3753401683 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f42780faa20 0x7f4278176d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:27.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.672+0000 7f427cc00640 1 -- 172.21.15.99:0/3753401683 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4278220890 con 0x7f4278188a90 2024-02-21T23:09:27.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.672+0000 7f427cc00640 1 --2- 172.21.15.99:0/3753401683 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4278188a90 0x7f427817cfd0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f426400c450 tx=0x7f426400c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:09:27.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.672+0000 7f4275600640 1 -- 172.21.15.99:0/3753401683 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4264017070 con 0x7f4278188a90 2024-02-21T23:09:27.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.672+0000 7f4275600640 1 -- 172.21.15.99:0/3753401683 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4264005ce0 con 0x7f4278188a90 2024-02-21T23:09:27.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.672+0000 7f427ea00640 1 -- 172.21.15.99:0/3753401683 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4278220b70 con 0x7f4278188a90 2024-02-21T23:09:27.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.672+0000 7f4275600640 1 -- 172.21.15.99:0/3753401683 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4264007310 con 0x7f4278188a90 2024-02-21T23:09:27.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.673+0000 7f427ea00640 1 -- 172.21.15.99:0/3753401683 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4278221130 con 0x7f4278188a90 2024-02-21T23:09:27.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.674+0000 7f427ea00640 1 -- 172.21.15.99:0/3753401683 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f427808d4c0 con 0x7f4278188a90 2024-02-21T23:09:27.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.675+0000 7f4275600640 1 -- 172.21.15.99:0/3753401683 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f426401a070 con 0x7f4278188a90 2024-02-21T23:09:27.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.677+0000 7f4275600640 1 --2- 172.21.15.99:0/3753401683 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f425809eed0 0x7f42580a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:27.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.677+0000 7f4275600640 1 -- 172.21.15.99:0/3753401683 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f42640c9240 con 0x7f4278188a90 2024-02-21T23:09:27.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.677+0000 7f427d600640 1 --2- 172.21.15.99:0/3753401683 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f425809eed0 0x7f42580a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:27.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.678+0000 7f427d600640 1 --2- 172.21.15.99:0/3753401683 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f425809eed0 0x7f42580a1390 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f426c001560 tx=0x7f426c009040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:09:27.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:27.681+0000 7f4275600640 1 -- 172.21.15.99:0/3753401683 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f427808d4c0 con 0x7f4278188a90 2024-02-21T23:09:28.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.052+0000 7f427ea00640 1 -- 172.21.15.99:0/3753401683 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4278091230 con 0x7f4278188a90 2024-02-21T23:09:28.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.053+0000 7f4275600640 1 -- 172.21.15.99:0/3753401683 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+11335 (secure 0 0 0) 0x7f4278091230 con 0x7f4278188a90 2024-02-21T23:09:28.041 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T23:09:28.041 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4307,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/3514452812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3514452812},{"type":"v1","addr":"172.21.15.162:6836","nonce":3514452812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4312,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6838/2169982089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":2169982089},{"type":"v1","addr":"172.21.15.162:6838","nonce":2169982089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4315,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6839/3335972724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6837","nonce":3335972724},{"type":"v1","addr":"172.21.15.162:6839","nonce":3335972724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4318,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6841/2135456697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6840","nonce":2135456697},{"type":"v1","addr":"172.21.15.162:6841","nonce":2135456697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4325,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2452242758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2452242758},{"type":"v1","addr":"172.21.15.181:6833","nonce":2452242758}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4328,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6836/2751486400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":2751486400},{"type":"v1","addr":"172.21.15.181:6836","nonce":2751486400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":17,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-21T23:01:02.656130+0000","modified":"2024-02-21T23:07:03.165223+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4355,"mds_1":4352,"mds_2":4348},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4331":{"gid":4331,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6838/3728901330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6835","nonce":3728901330},{"type":"v1","addr":"172.21.15.181:6838","nonce":3728901330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4339":{"gid":4339,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6839/3357929641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6837","nonce":3357929641},{"type":"v1","addr":"172.21.15.181:6839","nonce":3357929641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4343":{"gid":4343,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6833/2793485078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":2793485078},{"type":"v1","addr":"172.21.15.99:6833","nonce":2793485078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4348":{"gid":4348,"name":"d","rank":2,"incarnation":12,"state":"up:active","state_seq":10,"addr":"172.21.15.99:6835/2243461688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2243461688},{"type":"v1","addr":"172.21.15.99:6835","nonce":2243461688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4352":{"gid":4352,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.99:6837/1676159950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":1676159950},{"type":"v1","addr":"172.21.15.99:6837","nonce":1676159950}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4355":{"gid":4355,"name":"j","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6839/4239008786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":4239008786},{"type":"v1","addr":"172.21.15.99:6839","nonce":4239008786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-21T23:09:28.042 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 17 2024-02-21T23:09:28.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.055+0000 7f427ea00640 1 -- 172.21.15.99:0/3753401683 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f425809eed0 msgr2=0x7f42580a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:09:28.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.056+0000 7f427ea00640 1 --2- 172.21.15.99:0/3753401683 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f425809eed0 0x7f42580a1390 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f426c001560 tx=0x7f426c009040 comp rx=0 tx=0).stop 2024-02-21T23:09:28.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.056+0000 7f427ea00640 1 -- 172.21.15.99:0/3753401683 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4278188a90 msgr2=0x7f427817cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:09:28.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.056+0000 7f427ea00640 1 --2- 172.21.15.99:0/3753401683 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4278188a90 0x7f427817cfd0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f426400c450 tx=0x7f426400c850 comp rx=0 tx=0).stop 2024-02-21T23:09:28.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.056+0000 7f427ea00640 1 -- 172.21.15.99:0/3753401683 shutdown_connections 2024-02-21T23:09:28.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.056+0000 7f427ea00640 1 --2- 172.21.15.99:0/3753401683 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f425809eed0 0x7f42580a1390 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.056+0000 7f427ea00640 1 --2- 172.21.15.99:0/3753401683 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f4278188e70 0x7f4278221c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.056+0000 7f427ea00640 1 --2- 172.21.15.99:0/3753401683 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4278188a90 0x7f427817cfd0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.056+0000 7f427ea00640 1 --2- 172.21.15.99:0/3753401683 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f42780faa20 0x7f4278176d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.056+0000 7f427ea00640 1 -- 172.21.15.99:0/3753401683 >> 172.21.15.99:0/3753401683 conn(0x7f42780fe3d0 msgr2=0x7f42780d2140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:09:28.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.056+0000 7f427ea00640 1 -- 172.21.15.99:0/3753401683 shutdown_connections 2024-02-21T23:09:28.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.056+0000 7f427ea00640 1 -- 172.21.15.99:0/3753401683 wait complete. 2024-02-21T23:09:28.065 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T23:09:28.065 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-02-21T23:09:28.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.298+0000 7fb4dd000640 1 Processor -- start 2024-02-21T23:09:28.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.298+0000 7fb4dd000640 1 -- start start 2024-02-21T23:09:28.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.300+0000 7fb4dd000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb4d80d60b0 0x7fb4d80fc990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:28.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.300+0000 7fb4dd000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4d80d6dd0 con 0x7fb4d817f490 2024-02-21T23:09:28.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.300+0000 7fb4dd000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4d81614c0 con 0x7fb4d818b230 2024-02-21T23:09:28.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.300+0000 7fb4dd000640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4d80d6810 con 0x7fb4d80d60b0 2024-02-21T23:09:28.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.300+0000 7fb4d7e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb4d80d60b0 0x7fb4d80fc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:28.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.300+0000 7fb4d7e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb4d80d60b0 0x7fb4d80fc990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42530/0 (socket says 172.21.15.99:42530) 2024-02-21T23:09:28.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.300+0000 7fb4d7e00640 1 -- 172.21.15.99:0/1168244999 learned_addr learned my addr 172.21.15.99:0/1168244999 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:09:28.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.300+0000 7fb4d7400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fb4d817f490 0x7fb4d818ab20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:59896/0 (socket says 172.21.15.99:59896) 2024-02-21T23:09:28.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.301+0000 7fb4d6000640 1 -- 172.21.15.99:0/1168244999 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2737357627 0 0) 0x7fb4d81614c0 con 0x7fb4d818b230 2024-02-21T23:09:28.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.301+0000 7fb4d6000640 1 -- 172.21.15.99:0/1168244999 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4bc003520 con 0x7fb4d818b230 2024-02-21T23:09:28.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.301+0000 7fb4d7e00640 1 -- 172.21.15.99:0/1168244999 >> v1:172.21.15.162:6789/0 conn(0x7fb4d818b230 legacy=0x7fb4d80fc280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:09:28.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.301+0000 7fb4d7e00640 1 -- 172.21.15.99:0/1168244999 >> v1:172.21.15.99:6789/0 conn(0x7fb4d817f490 legacy=0x7fb4d818ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:09:28.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.301+0000 7fb4d7e00640 1 -- 172.21.15.99:0/1168244999 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4d80d6af0 con 0x7fb4d80d60b0 2024-02-21T23:09:28.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.302+0000 7fb4d7e00640 1 --2- 172.21.15.99:0/1168244999 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4d80d60b0 0x7fb4d80fc990 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fb4d0009e50 tx=0x7fb4d002c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93292d1b9bfe7ef1 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:09:28.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.302+0000 7fb4d6000640 1 -- 172.21.15.99:0/1168244999 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d002cbb0 con 0x7fb4d80d60b0 2024-02-21T23:09:28.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.302+0000 7fb4d6000640 1 -- 172.21.15.99:0/1168244999 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4d002cd50 con 0x7fb4d80d60b0 2024-02-21T23:09:28.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.302+0000 7fb4d6000640 1 -- 172.21.15.99:0/1168244999 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d0034610 con 0x7fb4d80d60b0 2024-02-21T23:09:28.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.303+0000 7fb4dd000640 1 -- 172.21.15.99:0/1168244999 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4d80d60b0 msgr2=0x7fb4d80fc990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:09:28.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.303+0000 7fb4dd000640 1 --2- 172.21.15.99:0/1168244999 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4d80d60b0 0x7fb4d80fc990 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fb4d0009e50 tx=0x7fb4d002c010 comp rx=0 tx=0).stop 2024-02-21T23:09:28.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.303+0000 7fb4dd000640 1 -- 172.21.15.99:0/1168244999 shutdown_connections 2024-02-21T23:09:28.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.303+0000 7fb4dd000640 1 --2- 172.21.15.99:0/1168244999 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4d80d60b0 0x7fb4d80fc990 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.303+0000 7fb4dd000640 1 -- 172.21.15.99:0/1168244999 >> 172.21.15.99:0/1168244999 conn(0x7fb4d80d29b0 msgr2=0x7fb4d80d2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:09:28.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.303+0000 7fb4dd000640 1 -- 172.21.15.99:0/1168244999 shutdown_connections 2024-02-21T23:09:28.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.303+0000 7fb4dd000640 1 -- 172.21.15.99:0/1168244999 wait complete. 2024-02-21T23:09:28.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.305+0000 7fb4dd000640 1 Processor -- start 2024-02-21T23:09:28.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.305+0000 7fb4dd000640 1 -- start start 2024-02-21T23:09:28.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.307+0000 7fb4dd000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4d80d60b0 0x7fb4d806bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:28.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.307+0000 7fb4dd000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb4d817f490 0x7fb4d8173360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:28.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.307+0000 7fb4dd000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4d818b230 0x7fb4d8173dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:28.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.307+0000 7fb4dd000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d818a600 con 0x7fb4d80d60b0 2024-02-21T23:09:28.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.307+0000 7fb4dd000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d818a320 con 0x7fb4d818b230 2024-02-21T23:09:28.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.307+0000 7fb4dd000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d80d6500 con 0x7fb4d817f490 2024-02-21T23:09:28.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.307+0000 7fb4d7400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4d80d60b0 0x7fb4d806bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:28.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.307+0000 7fb4d7400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4d80d60b0 0x7fb4d806bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42536/0 (socket says 172.21.15.99:42536) 2024-02-21T23:09:28.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.307+0000 7fb4d7400640 1 -- 172.21.15.99:0/3302940320 learned_addr learned my addr 172.21.15.99:0/3302940320 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:09:28.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.307+0000 7fb4d7e00640 1 --2- 172.21.15.99:0/3302940320 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4d818b230 0x7fb4d8173dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:28.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.307+0000 7fb4d6a00640 1 --2- 172.21.15.99:0/3302940320 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb4d817f490 0x7fb4d8173360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:28.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.307+0000 7fb4d7e00640 1 -- 172.21.15.99:0/3302940320 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb4d817f490 msgr2=0x7fb4d8173360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:09:28.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.307+0000 7fb4d7e00640 1 --2- 172.21.15.99:0/3302940320 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb4d817f490 0x7fb4d8173360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.307+0000 7fb4d7e00640 1 -- 172.21.15.99:0/3302940320 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4d80d60b0 msgr2=0x7fb4d806bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:09:28.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.307+0000 7fb4d7e00640 1 --2- 172.21.15.99:0/3302940320 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4d80d60b0 0x7fb4d806bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.308+0000 7fb4d7e00640 1 -- 172.21.15.99:0/3302940320 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4d817b7a0 con 0x7fb4d818b230 2024-02-21T23:09:28.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.308+0000 7fb4d6a00640 1 --2- 172.21.15.99:0/3302940320 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb4d817f490 0x7fb4d8173360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:09:28.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.308+0000 7fb4d7400640 1 --2- 172.21.15.99:0/3302940320 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4d80d60b0 0x7fb4d806bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:09:28.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.308+0000 7fb4d7e00640 1 --2- 172.21.15.99:0/3302940320 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4d818b230 0x7fb4d8173dd0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fb4d0032000 tx=0x7fb4d0004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:09:28.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.308+0000 7fb4cf400640 1 -- 172.21.15.99:0/3302940320 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d0043020 con 0x7fb4d818b230 2024-02-21T23:09:28.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.308+0000 7fb4cf400640 1 -- 172.21.15.99:0/3302940320 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4d003e450 con 0x7fb4d818b230 2024-02-21T23:09:28.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.308+0000 7fb4cf400640 1 -- 172.21.15.99:0/3302940320 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d003e840 con 0x7fb4d818b230 2024-02-21T23:09:28.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.308+0000 7fb4dd000640 1 -- 172.21.15.99:0/3302940320 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4d817ba80 con 0x7fb4d818b230 2024-02-21T23:09:28.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.308+0000 7fb4dd000640 1 -- 172.21.15.99:0/3302940320 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4d806b1d0 con 0x7fb4d818b230 2024-02-21T23:09:28.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.312+0000 7fb4cf400640 1 -- 172.21.15.99:0/3302940320 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7fb4d0005d10 con 0x7fb4d818b230 2024-02-21T23:09:28.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.313+0000 7fb4cf400640 1 --2- 172.21.15.99:0/3302940320 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fb4b809ef00 0x7fb4b80a13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:28.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.313+0000 7fb4cf400640 1 -- 172.21.15.99:0/3302940320 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 8877+0+0 (secure 0 0 0) 0x7fb4d00ec300 con 0x7fb4d818b230 2024-02-21T23:09:28.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.314+0000 7fb4d7400640 1 --2- 172.21.15.99:0/3302940320 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fb4b809ef00 0x7fb4b80a13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:28.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.314+0000 7fb4d7400640 1 --2- 172.21.15.99:0/3302940320 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fb4b809ef00 0x7fb4b80a13c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb4c8004e00 tx=0x7fb4c8007f10 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:09:28.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.315+0000 7fb4e15b9740 1 Processor -- start 2024-02-21T23:09:28.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.315+0000 7fb4e15b9740 1 -- start start 2024-02-21T23:09:28.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.317+0000 7fb4e15b9740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555969c65660 0x555969c65a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:28.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.317+0000 7fb4e15b9740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555969ca0330 0x555969ca07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:28.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.317+0000 7fb4e15b9740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555969ca0cf0 0x555969ca1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:28.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.317+0000 7fb4e15b9740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x555969b8db50 con 0x555969ca0cf0 2024-02-21T23:09:28.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.317+0000 7fb4e15b9740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x555969b36da0 con 0x555969c65660 2024-02-21T23:09:28.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.317+0000 7fb4e15b9740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x555969b89bf0 con 0x555969ca0330 2024-02-21T23:09:28.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.317+0000 7fb4d7400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555969c65660 0x555969c65a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:28.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.317+0000 7fb4d7400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555969c65660 0x555969c65a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:44148/0 (socket says 172.21.15.99:44148) 2024-02-21T23:09:28.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.317+0000 7fb4d7400640 1 -- 172.21.15.99:0/2336067791 learned_addr learned my addr 172.21.15.99:0/2336067791 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:09:28.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.317+0000 7fb4d6a00640 1 --2- 172.21.15.99:0/2336067791 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555969ca0330 0x555969ca07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:28.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.317+0000 7fb4d7e00640 1 --2- 172.21.15.99:0/2336067791 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555969ca0cf0 0x555969ca1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:28.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.318+0000 7fb4d7400640 1 -- 172.21.15.99:0/2336067791 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555969ca0330 msgr2=0x555969ca07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:09:28.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.318+0000 7fb4d7400640 1 --2- 172.21.15.99:0/2336067791 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555969ca0330 0x555969ca07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.318+0000 7fb4d7400640 1 -- 172.21.15.99:0/2336067791 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555969ca0cf0 msgr2=0x555969ca1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:09:28.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.318+0000 7fb4d7400640 1 --2- 172.21.15.99:0/2336067791 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555969ca0cf0 0x555969ca1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.318+0000 7fb4d7400640 1 -- 172.21.15.99:0/2336067791 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555969b59f80 con 0x555969c65660 2024-02-21T23:09:28.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.318+0000 7fb4d7e00640 1 --2- 172.21.15.99:0/2336067791 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555969ca0cf0 0x555969ca1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:09:28.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.318+0000 7fb4d7400640 1 --2- 172.21.15.99:0/2336067791 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555969c65660 0x555969c65a40 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fb4c80076b0 tx=0x7fb4c8013000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1a3d865f11c2703 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:09:28.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.318+0000 7fb4c3e00640 1 -- 172.21.15.99:0/2336067791 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c8026070 con 0x555969c65660 2024-02-21T23:09:28.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.318+0000 7fb4c3e00640 1 -- 172.21.15.99:0/2336067791 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4c8012350 con 0x555969c65660 2024-02-21T23:09:28.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.318+0000 7fb4c3e00640 1 -- 172.21.15.99:0/2336067791 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c8012700 con 0x555969c65660 2024-02-21T23:09:28.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.319+0000 7fb4e15b9740 1 -- 172.21.15.99:0/2336067791 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555969c65660 msgr2=0x555969c65a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:09:28.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.319+0000 7fb4e15b9740 1 --2- 172.21.15.99:0/2336067791 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555969c65660 0x555969c65a40 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fb4c80076b0 tx=0x7fb4c8013000 comp rx=0 tx=0).stop 2024-02-21T23:09:28.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.319+0000 7fb4e15b9740 1 -- 172.21.15.99:0/2336067791 shutdown_connections 2024-02-21T23:09:28.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.319+0000 7fb4e15b9740 1 --2- 172.21.15.99:0/2336067791 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555969ca0cf0 0x555969ca1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.319+0000 7fb4e15b9740 1 --2- 172.21.15.99:0/2336067791 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555969ca0330 0x555969ca07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.319+0000 7fb4e15b9740 1 --2- 172.21.15.99:0/2336067791 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555969c65660 0x555969c65a40 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.319+0000 7fb4e15b9740 1 -- 172.21.15.99:0/2336067791 >> 172.21.15.99:0/2336067791 conn(0x555969c276d0 msgr2=0x555969c28750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:09:28.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.319+0000 7fb4e15b9740 1 -- 172.21.15.99:0/2336067791 shutdown_connections 2024-02-21T23:09:28.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.319+0000 7fb4e15b9740 1 -- 172.21.15.99:0/2336067791 wait complete. 2024-02-21T23:09:28.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.321+0000 7fb4e15b9740 1 -- start start 2024-02-21T23:09:28.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.321+0000 7fb4e15b9740 1 Processor -- start 2024-02-21T23:09:28.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.323+0000 7fb4e15b9740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555969ca0cf0 0x555969ca7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:28.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.323+0000 7fb4e15b9740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555969c584f0 0x555969c5f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:28.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.323+0000 7fb4e15b9740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555969c588d0 0x555969c5e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:28.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.323+0000 7fb4e15b9740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x555969c9f0a0 con 0x555969c588d0 2024-02-21T23:09:28.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.323+0000 7fb4e15b9740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x555969b2c380 con 0x555969c584f0 2024-02-21T23:09:28.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.323+0000 7fb4e15b9740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x555969c9edc0 con 0x555969ca0cf0 2024-02-21T23:09:28.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.323+0000 7fb4e15b9740 10 client.0 _ll_register_callbacks cb 0x555969b85280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:09:28.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.324+0000 7fb4d7e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555969c588d0 0x555969c5e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:28.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.324+0000 7fb4d7400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555969ca0cf0 0x555969ca7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:28.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.324+0000 7fb4d6a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555969c584f0 0x555969c5f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:28.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.324+0000 7fb4d7400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555969ca0cf0 0x555969ca7ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:40960/0 (socket says 172.21.15.99:40960) 2024-02-21T23:09:28.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.324+0000 7fb4d7400640 1 -- 172.21.15.99:0/809137273 learned_addr learned my addr 172.21.15.99:0/809137273 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:09:28.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.324+0000 7fb4d6a00640 1 -- 172.21.15.99:0/809137273 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555969ca0cf0 msgr2=0x555969ca7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:09:28.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.324+0000 7fb4d6a00640 1 --2- 172.21.15.99:0/809137273 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555969ca0cf0 0x555969ca7ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.324+0000 7fb4d6a00640 1 -- 172.21.15.99:0/809137273 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555969c588d0 msgr2=0x555969c5e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:09:28.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.324+0000 7fb4d6a00640 1 --2- 172.21.15.99:0/809137273 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555969c588d0 0x555969c5e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.324+0000 7fb4d6a00640 1 -- 172.21.15.99:0/809137273 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555969b54c20 con 0x555969c584f0 2024-02-21T23:09:28.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.324+0000 7fb4d7e00640 1 --2- 172.21.15.99:0/809137273 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555969c588d0 0x555969c5e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:09:28.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.325+0000 7fb4d6a00640 1 --2- 172.21.15.99:0/809137273 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555969c584f0 0x555969c5f3a0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fb4d817ed90 tx=0x7fb4c40011b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=420f39a8e2e92e90 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:09:28.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.325+0000 7fb4c0c00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-02-21T23:09:28.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.325+0000 7fb4c0c00640 1 -- 172.21.15.99:0/809137273 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c401a060 con 0x555969c584f0 2024-02-21T23:09:28.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.325+0000 7fb4e15b9740 1 -- 172.21.15.99:0/809137273 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb4c8012350 con 0x555969c584f0 2024-02-21T23:09:28.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.325+0000 7fb4c0c00640 1 -- 172.21.15.99:0/809137273 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8877+0+0 (secure 0 0 0) 0x7fb4c4001b60 con 0x555969c584f0 2024-02-21T23:09:28.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.325+0000 7fb4c0c00640 1 -- 172.21.15.99:0/809137273 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb4c4021050 con 0x555969c584f0 2024-02-21T23:09:28.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.325+0000 7fb4e15b9740 10 client.6643 fetch_fsmap learned FSMap version 17 2024-02-21T23:09:28.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.325+0000 7fb4e15b9740 1 -- 172.21.15.99:0/809137273 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5559698a23f0 con 0x555969c584f0 2024-02-21T23:09:28.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.326+0000 7fb4c0c00640 1 -- 172.21.15.99:0/809137273 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4c8012350 con 0x555969c584f0 2024-02-21T23:09:28.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.326+0000 7fb4c0c00640 1 -- 172.21.15.99:0/809137273 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fb4c4015460 con 0x555969c584f0 2024-02-21T23:09:28.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.326+0000 7fb4e15b9740 10 client.6643 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:09:28.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.326+0000 7fb4e15b9740 10 client.6643 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.d 2024-02-21T23:09:28.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.326+0000 7fb4e15b9740 20 client.6643 populate_metadata read hostname 'smithi099' 2024-02-21T23:09:28.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.326+0000 7fb4e15b9740 1 --2- 172.21.15.99:0/809137273 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x555969c259b0 0x555969cad200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:28.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.326+0000 7fb4e15b9740 4 client.6643 mds_command: new command op to 4348 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:09:28.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.326+0000 7fb4e15b9740 1 -- 172.21.15.99:0/809137273 --> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555969b9b090 con 0x555969c259b0 2024-02-21T23:09:28.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.326+0000 7fb4d7400640 1 --2- 172.21.15.99:0/809137273 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x555969c259b0 0x555969cad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:28.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.327+0000 7fb4d7400640 1 --2- 172.21.15.99:0/809137273 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x555969c259b0 0x555969cad200 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=82b542ec09a66dd6 server_cookie=5cf15a435ef607f2 in_seq=0 out_seq=0 2024-02-21T23:09:28.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.327+0000 7fb4c0c00640 10 client.6643 ms_handle_connect on v2:172.21.15.99:6834/2243461688 2024-02-21T23:09:28.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.328+0000 7fb4c0c00640 1 -- 172.21.15.99:0/809137273 <== mds.2 v2:172.21.15.99:6834/2243461688 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x555969b9b090 con 0x555969c259b0 2024-02-21T23:09:28.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.328+0000 7fb4c0c00640 10 client.6643 handle_command_reply: tid=0 2024-02-21T23:09:28.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.328+0000 7fb4e15b9740 1 client.6643 shutdown 2024-02-21T23:09:28.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.328+0000 7fb4e15b9740 1 -- 172.21.15.99:0/809137273 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555969c584f0 msgr2=0x555969c5f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:09:28.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.328+0000 7fb4e15b9740 1 --2- 172.21.15.99:0/809137273 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555969c584f0 0x555969c5f3a0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fb4d817ed90 tx=0x7fb4c40011b0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.328+0000 7fb4e15b9740 1 -- 172.21.15.99:0/809137273 shutdown_connections 2024-02-21T23:09:28.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.328+0000 7fb4e15b9740 1 --2- 172.21.15.99:0/809137273 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x555969c259b0 0x555969cad200 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.328+0000 7fb4e15b9740 1 --2- 172.21.15.99:0/809137273 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555969c588d0 0x555969c5e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.328+0000 7fb4e15b9740 1 --2- 172.21.15.99:0/809137273 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555969c584f0 0x555969c5f3a0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.328+0000 7fb4e15b9740 1 --2- 172.21.15.99:0/809137273 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555969ca0cf0 0x555969ca7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.328+0000 7fb4e15b9740 1 -- 172.21.15.99:0/809137273 >> 172.21.15.99:0/809137273 conn(0x555969ca0330 msgr2=0x555969c9f7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:09:28.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.328+0000 7fb4c0c00640 0 client.6643 ms_handle_reset on v2:172.21.15.99:6834/2243461688 2024-02-21T23:09:28.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.328+0000 7fb4e15b9740 1 -- 172.21.15.99:0/809137273 shutdown_connections 2024-02-21T23:09:28.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.328+0000 7fb4e15b9740 1 -- 172.21.15.99:0/809137273 wait complete. 2024-02-21T23:09:28.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.329+0000 7fb4e15b9740 20 client.6643 trim_cache size 0 max 16384 2024-02-21T23:09:28.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.342+0000 7fb4e15b9740 1 Processor -- start 2024-02-21T23:09:28.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.342+0000 7fb4e15b9740 1 -- start start 2024-02-21T23:09:28.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.344+0000 7fb4e15b9740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555969c584f0 0x555969ca0710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:28.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.344+0000 7fb4e15b9740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555969c588d0 0x555969ca7e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:28.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.344+0000 7fb4e15b9740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555969ca0cf0 0x555969c9fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:28.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.344+0000 7fb4e15b9740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d822c960 con 0x555969c584f0 2024-02-21T23:09:28.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.344+0000 7fb4e15b9740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d822a500 con 0x555969ca0cf0 2024-02-21T23:09:28.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.344+0000 7fb4e15b9740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d818cd30 con 0x555969c588d0 2024-02-21T23:09:28.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.344+0000 7fb4d7400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555969c584f0 0x555969ca0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:28.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.345+0000 7fb4d7400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555969c584f0 0x555969ca0710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42558/0 (socket says 172.21.15.99:42558) 2024-02-21T23:09:28.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.345+0000 7fb4d7400640 1 -- 172.21.15.99:0/2501141697 learned_addr learned my addr 172.21.15.99:0/2501141697 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:09:28.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.345+0000 7fb4d6a00640 1 --2- 172.21.15.99:0/2501141697 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555969c588d0 0x555969ca7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:28.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.345+0000 7fb4d7e00640 1 --2- 172.21.15.99:0/2501141697 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555969ca0cf0 0x555969c9fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:28.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.345+0000 7fb4d7400640 1 -- 172.21.15.99:0/2501141697 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555969c588d0 msgr2=0x555969ca7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:09:28.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.345+0000 7fb4d7400640 1 --2- 172.21.15.99:0/2501141697 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555969c588d0 0x555969ca7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.345+0000 7fb4d7400640 1 -- 172.21.15.99:0/2501141697 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555969ca0cf0 msgr2=0x555969c9fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:09:28.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.345+0000 7fb4d7400640 1 --2- 172.21.15.99:0/2501141697 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555969ca0cf0 0x555969c9fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.345+0000 7fb4d7400640 1 -- 172.21.15.99:0/2501141697 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55596996c7d0 con 0x555969c584f0 2024-02-21T23:09:28.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.345+0000 7fb4d7400640 1 --2- 172.21.15.99:0/2501141697 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555969c584f0 0x555969ca0710 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fb4c8004fd0 tx=0x7fb4c8014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98d7e4a3a86a6bbb server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:09:28.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.346+0000 7fb4c3400640 1 -- 172.21.15.99:0/2501141697 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c8026040 con 0x555969c584f0 2024-02-21T23:09:28.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.346+0000 7fb4c3400640 1 -- 172.21.15.99:0/2501141697 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4c8027040 con 0x555969c584f0 2024-02-21T23:09:28.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.346+0000 7fb4c3400640 1 -- 172.21.15.99:0/2501141697 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c8004aa0 con 0x555969c584f0 2024-02-21T23:09:28.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.346+0000 7fb4e15b9740 1 -- 172.21.15.99:0/2501141697 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555969c584f0 msgr2=0x555969ca0710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:09:28.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.346+0000 7fb4e15b9740 1 --2- 172.21.15.99:0/2501141697 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555969c584f0 0x555969ca0710 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fb4c8004fd0 tx=0x7fb4c8014000 comp rx=0 tx=0).stop 2024-02-21T23:09:28.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.346+0000 7fb4e15b9740 1 -- 172.21.15.99:0/2501141697 shutdown_connections 2024-02-21T23:09:28.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.346+0000 7fb4e15b9740 1 --2- 172.21.15.99:0/2501141697 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555969ca0cf0 0x555969c9fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.346+0000 7fb4e15b9740 1 --2- 172.21.15.99:0/2501141697 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555969c588d0 0x555969ca7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.346+0000 7fb4e15b9740 1 --2- 172.21.15.99:0/2501141697 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555969c584f0 0x555969ca0710 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.346+0000 7fb4e15b9740 1 -- 172.21.15.99:0/2501141697 >> 172.21.15.99:0/2501141697 conn(0x555969ca0330 msgr2=0x555969c5d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:09:28.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.346+0000 7fb4e15b9740 1 -- 172.21.15.99:0/2501141697 shutdown_connections 2024-02-21T23:09:28.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.346+0000 7fb4e15b9740 1 -- 172.21.15.99:0/2501141697 wait complete. 2024-02-21T23:09:28.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.347+0000 7fb4e15b9740 1 -- start start 2024-02-21T23:09:28.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.347+0000 7fb4e15b9740 1 Processor -- start 2024-02-21T23:09:28.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.349+0000 7fb4e15b9740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555969c584f0 0x555969c609a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:28.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.349+0000 7fb4e15b9740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555969c588d0 0x555969d0c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:28.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.349+0000 7fb4e15b9740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555969ca0cf0 0x555969c5ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:28.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.349+0000 7fb4e15b9740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d80d2190 con 0x555969c584f0 2024-02-21T23:09:28.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.349+0000 7fb4e15b9740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d8229ea0 con 0x555969ca0cf0 2024-02-21T23:09:28.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.349+0000 7fb4e15b9740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d8229240 con 0x555969c588d0 2024-02-21T23:09:28.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.349+0000 7fb4e15b9740 10 client.0 _ll_register_callbacks cb 0x7fb4c4007e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:09:28.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.349+0000 7fb4d7400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555969c584f0 0x555969c609a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:28.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.349+0000 7fb4d7400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555969c584f0 0x555969c609a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42566/0 (socket says 172.21.15.99:42566) 2024-02-21T23:09:28.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.349+0000 7fb4d7400640 1 -- 172.21.15.99:0/512481220 learned_addr learned my addr 172.21.15.99:0/512481220 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:09:28.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.349+0000 7fb4d7e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555969ca0cf0 0x555969c5ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:28.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.349+0000 7fb4d6a00640 1 --2- 172.21.15.99:0/512481220 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555969c588d0 0x555969d0c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:28.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.349+0000 7fb4d7e00640 1 -- 172.21.15.99:0/512481220 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555969c588d0 msgr2=0x555969d0c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:09:28.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.350+0000 7fb4d7e00640 1 --2- 172.21.15.99:0/512481220 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555969c588d0 0x555969d0c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.350+0000 7fb4d7e00640 1 -- 172.21.15.99:0/512481220 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555969c584f0 msgr2=0x555969c609a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:09:28.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.350+0000 7fb4d7e00640 1 --2- 172.21.15.99:0/512481220 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555969c584f0 0x555969c609a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.350+0000 7fb4d7e00640 1 -- 172.21.15.99:0/512481220 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555969d0c740 con 0x555969ca0cf0 2024-02-21T23:09:28.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.350+0000 7fb4d7e00640 1 --2- 172.21.15.99:0/512481220 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555969ca0cf0 0x555969c5ef20 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fb4d00e9970 tx=0x7fb4d00b9750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e60f4a77538a2984 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:09:28.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.350+0000 7fb4c0c00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-02-21T23:09:28.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.350+0000 7fb4c0c00640 1 -- 172.21.15.99:0/512481220 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d00d6060 con 0x555969ca0cf0 2024-02-21T23:09:28.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.350+0000 7fb4c0c00640 1 -- 172.21.15.99:0/512481220 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8877+0+0 (secure 0 0 0) 0x7fb4d00c1e60 con 0x555969ca0cf0 2024-02-21T23:09:28.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.350+0000 7fb4e15b9740 1 -- 172.21.15.99:0/512481220 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb4c8027040 con 0x555969ca0cf0 2024-02-21T23:09:28.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.350+0000 7fb4c0c00640 1 -- 172.21.15.99:0/512481220 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb4d00b9b50 con 0x555969ca0cf0 2024-02-21T23:09:28.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.350+0000 7fb4e15b9740 10 client.6649 fetch_fsmap learned FSMap version 17 2024-02-21T23:09:28.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.350+0000 7fb4e15b9740 1 -- 172.21.15.99:0/512481220 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x555969c23870 con 0x555969ca0cf0 2024-02-21T23:09:28.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.351+0000 7fb4c0c00640 1 -- 172.21.15.99:0/512481220 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4c8027040 con 0x555969ca0cf0 2024-02-21T23:09:28.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.351+0000 7fb4c0c00640 1 -- 172.21.15.99:0/512481220 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fb4d00cdba0 con 0x555969ca0cf0 2024-02-21T23:09:28.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.351+0000 7fb4e15b9740 10 client.6649 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:09:28.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.351+0000 7fb4e15b9740 10 client.6649 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.d 2024-02-21T23:09:28.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.351+0000 7fb4e15b9740 20 client.6649 populate_metadata read hostname 'smithi099' 2024-02-21T23:09:28.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.351+0000 7fb4e15b9740 1 --2- 172.21.15.99:0/512481220 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x555969d02d60 0x555969c624b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:28.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.351+0000 7fb4e15b9740 4 client.6649 mds_command: new command op to 4348 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T23:09:28.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.351+0000 7fb4e15b9740 1 -- 172.21.15.99:0/512481220 --> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x555969c27e30 con 0x555969d02d60 2024-02-21T23:09:28.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.351+0000 7fb4d7400640 1 --2- 172.21.15.99:0/512481220 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x555969d02d60 0x555969c624b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:28.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.352+0000 7fb4d7400640 1 --2- 172.21.15.99:0/512481220 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x555969d02d60 0x555969c624b0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b3d6cd7a673fda92 server_cookie=f25192e5c9c6421 in_seq=0 out_seq=0 2024-02-21T23:09:28.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.352+0000 7fb4c0c00640 10 client.6649 ms_handle_connect on v2:172.21.15.99:6834/2243461688 2024-02-21T23:09:28.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.352+0000 7fb4c0c00640 1 -- 172.21.15.99:0/512481220 <== mds.2 v2:172.21.15.99:6834/2243461688 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x555969c27e30 con 0x555969d02d60 2024-02-21T23:09:28.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.352+0000 7fb4c0c00640 10 client.6649 handle_command_reply: tid=0 2024-02-21T23:09:28.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.352+0000 7fb4e15b9740 1 client.6649 shutdown 2024-02-21T23:09:28.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.352+0000 7fb4e15b9740 1 -- 172.21.15.99:0/512481220 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555969ca0cf0 msgr2=0x555969c5ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:09:28.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.352+0000 7fb4e15b9740 1 --2- 172.21.15.99:0/512481220 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555969ca0cf0 0x555969c5ef20 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fb4d00e9970 tx=0x7fb4d00b9750 comp rx=0 tx=0).stop 2024-02-21T23:09:28.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.352+0000 7fb4e15b9740 1 -- 172.21.15.99:0/512481220 shutdown_connections 2024-02-21T23:09:28.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.352+0000 7fb4e15b9740 1 --2- 172.21.15.99:0/512481220 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x555969d02d60 0x555969c624b0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.352+0000 7fb4e15b9740 1 --2- 172.21.15.99:0/512481220 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555969ca0cf0 0x555969c5ef20 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.352+0000 7fb4e15b9740 1 --2- 172.21.15.99:0/512481220 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555969c588d0 0x555969d0c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.352+0000 7fb4e15b9740 1 --2- 172.21.15.99:0/512481220 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555969c584f0 0x555969c609a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.352+0000 7fb4c0c00640 0 client.6649 ms_handle_reset on v2:172.21.15.99:6834/2243461688 2024-02-21T23:09:28.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.352+0000 7fb4e15b9740 1 -- 172.21.15.99:0/512481220 >> 172.21.15.99:0/512481220 conn(0x555969ca0330 msgr2=0x555969c5d320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:09:28.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.353+0000 7fb4e15b9740 1 -- 172.21.15.99:0/512481220 shutdown_connections 2024-02-21T23:09:28.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.353+0000 7fb4e15b9740 1 -- 172.21.15.99:0/512481220 wait complete. 2024-02-21T23:09:28.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.353+0000 7fb4e15b9740 20 client.6649 trim_cache size 0 max 16384 2024-02-21T23:09:28.350 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-02-21T23:09:28.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.354+0000 7fb4dd000640 1 -- 172.21.15.99:0/3302940320 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fb4b809ef00 msgr2=0x7fb4b80a13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:09:28.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.354+0000 7fb4dd000640 1 --2- 172.21.15.99:0/3302940320 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fb4b809ef00 0x7fb4b80a13c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb4c8004e00 tx=0x7fb4c8007f10 comp rx=0 tx=0).stop 2024-02-21T23:09:28.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.354+0000 7fb4dd000640 1 -- 172.21.15.99:0/3302940320 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4d818b230 msgr2=0x7fb4d8173dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:09:28.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.354+0000 7fb4dd000640 1 --2- 172.21.15.99:0/3302940320 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4d818b230 0x7fb4d8173dd0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fb4d0032000 tx=0x7fb4d0004a40 comp rx=0 tx=0).stop 2024-02-21T23:09:28.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.354+0000 7fb4dd000640 1 -- 172.21.15.99:0/3302940320 shutdown_connections 2024-02-21T23:09:28.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.354+0000 7fb4dd000640 1 --2- 172.21.15.99:0/3302940320 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fb4b809ef00 0x7fb4b80a13c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.354+0000 7fb4dd000640 1 --2- 172.21.15.99:0/3302940320 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4d818b230 0x7fb4d8173dd0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.354+0000 7fb4dd000640 1 --2- 172.21.15.99:0/3302940320 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb4d817f490 0x7fb4d8173360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.354+0000 7fb4dd000640 1 --2- 172.21.15.99:0/3302940320 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4d80d60b0 0x7fb4d806bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.354+0000 7fb4dd000640 1 -- 172.21.15.99:0/3302940320 >> 172.21.15.99:0/3302940320 conn(0x7fb4d80d29b0 msgr2=0x7fb4d8068e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:09:28.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.354+0000 7fb4dd000640 1 -- 172.21.15.99:0/3302940320 shutdown_connections 2024-02-21T23:09:28.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.354+0000 7fb4dd000640 1 -- 172.21.15.99:0/3302940320 wait complete. 2024-02-21T23:09:28.367 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T23:09:28.368 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-02-21T23:09:28.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.600+0000 7fab3fe00640 1 Processor -- start 2024-02-21T23:09:28.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.601+0000 7fab3fe00640 1 -- start start 2024-02-21T23:09:28.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.604+0000 7fab3fe00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fab4017f490 0x7fab4018ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:28.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.604+0000 7fab3fe00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fab4018b060 0x7fab40188a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:28.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.604+0000 7fab3fe00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab400d6dd0 con 0x7fab4018b4f0 2024-02-21T23:09:28.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.604+0000 7fab3fe00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab401614c0 con 0x7fab4018b060 2024-02-21T23:09:28.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.604+0000 7fab3fe00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab400d6810 con 0x7fab4017f490 2024-02-21T23:09:28.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.604+0000 7fab37e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fab4018b060 0x7fab40188a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:28.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.604+0000 7fab3f400640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fab4018b4f0 0x7fab40188f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:33488/0 (socket says 172.21.15.99:33488) 2024-02-21T23:09:28.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.604+0000 7fab3f400640 1 -- 172.21.15.99:0/178703896 learned_addr learned my addr 172.21.15.99:0/178703896 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:09:28.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.604+0000 7fab3ea00640 1 --2- 172.21.15.99:0/178703896 >> v2:172.21.15.162:3300/0 conn(0x7fab4017f490 0x7fab4018ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:28.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.605+0000 7fab3ea00640 1 -- 172.21.15.99:0/178703896 >> v2:172.21.15.99:3300/0 conn(0x7fab4018b060 msgr2=0x7fab40188a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:09:28.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.605+0000 7fab3ea00640 1 --2- 172.21.15.99:0/178703896 >> v2:172.21.15.99:3300/0 conn(0x7fab4018b060 0x7fab40188a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.605+0000 7fab3ea00640 1 -- 172.21.15.99:0/178703896 >> v1:172.21.15.181:6789/0 conn(0x7fab4018b4f0 legacy=0x7fab40188f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:09:28.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.605+0000 7fab3e000640 1 -- 172.21.15.99:0/178703896 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3187151227 0 0) 0x7fab400d6dd0 con 0x7fab4018b4f0 2024-02-21T23:09:28.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.605+0000 7fab3ea00640 1 -- 172.21.15.99:0/178703896 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab400d6af0 con 0x7fab4017f490 2024-02-21T23:09:28.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.606+0000 7fab3ea00640 1 --2- 172.21.15.99:0/178703896 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab4017f490 0x7fab4018ab20 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fab40067c30 tx=0x7fab3002b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d561cc6639e0f47f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:09:28.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.607+0000 7fab3e000640 1 -- 172.21.15.99:0/178703896 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab30035020 con 0x7fab4017f490 2024-02-21T23:09:28.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.607+0000 7fab3e000640 1 -- 172.21.15.99:0/178703896 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab30031830 con 0x7fab4017f490 2024-02-21T23:09:28.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.607+0000 7fab3e000640 1 -- 172.21.15.99:0/178703896 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab30031c00 con 0x7fab4017f490 2024-02-21T23:09:28.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.608+0000 7fab3fe00640 1 -- 172.21.15.99:0/178703896 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab4017f490 msgr2=0x7fab4018ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:09:28.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.608+0000 7fab3fe00640 1 --2- 172.21.15.99:0/178703896 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab4017f490 0x7fab4018ab20 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fab40067c30 tx=0x7fab3002b8d0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.608+0000 7fab3fe00640 1 -- 172.21.15.99:0/178703896 shutdown_connections 2024-02-21T23:09:28.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.608+0000 7fab3fe00640 1 --2- 172.21.15.99:0/178703896 >> v2:172.21.15.99:3300/0 conn(0x7fab4018b060 0x7fab40188a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.608+0000 7fab3fe00640 1 --2- 172.21.15.99:0/178703896 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab4017f490 0x7fab4018ab20 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.608+0000 7fab3fe00640 1 -- 172.21.15.99:0/178703896 >> 172.21.15.99:0/178703896 conn(0x7fab400d29b0 msgr2=0x7fab400d2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:09:28.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.608+0000 7fab3fe00640 1 -- 172.21.15.99:0/178703896 shutdown_connections 2024-02-21T23:09:28.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.608+0000 7fab3fe00640 1 -- 172.21.15.99:0/178703896 wait complete. 2024-02-21T23:09:28.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.610+0000 7fab3fe00640 1 Processor -- start 2024-02-21T23:09:28.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.610+0000 7fab3fe00640 1 -- start start 2024-02-21T23:09:28.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.611+0000 7fab3fe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab4017f490 0x7fab4021ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:28.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.611+0000 7fab3fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab4018b060 0x7fab40175020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:28.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.611+0000 7fab3fe00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fab4018b4f0 0x7fab400cf420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:28.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.611+0000 7fab3fe00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab4018a600 con 0x7fab4018b060 2024-02-21T23:09:28.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.611+0000 7fab3fe00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab4018a320 con 0x7fab4017f490 2024-02-21T23:09:28.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.611+0000 7fab3fe00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab4017f870 con 0x7fab4018b4f0 2024-02-21T23:09:28.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.612+0000 7fab37e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab4018b060 0x7fab40175020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:28.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.612+0000 7fab37e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab4018b060 0x7fab40175020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42592/0 (socket says 172.21.15.99:42592) 2024-02-21T23:09:28.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.612+0000 7fab37e00640 1 -- 172.21.15.99:0/2559384888 learned_addr learned my addr 172.21.15.99:0/2559384888 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:09:28.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.612+0000 7fab3ea00640 1 --2- 172.21.15.99:0/2559384888 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab4017f490 0x7fab4021ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:28.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.612+0000 7fab3f400640 1 --2- 172.21.15.99:0/2559384888 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fab4018b4f0 0x7fab400cf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:28.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.612+0000 7fab3ea00640 1 -- 172.21.15.99:0/2559384888 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fab4018b4f0 msgr2=0x7fab400cf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:09:28.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.612+0000 7fab3ea00640 1 --2- 172.21.15.99:0/2559384888 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fab4018b4f0 0x7fab400cf420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.612+0000 7fab3ea00640 1 -- 172.21.15.99:0/2559384888 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab4018b060 msgr2=0x7fab40175020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:09:28.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.612+0000 7fab3ea00640 1 --2- 172.21.15.99:0/2559384888 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab4018b060 0x7fab40175020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.612+0000 7fab3ea00640 1 -- 172.21.15.99:0/2559384888 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab40173ca0 con 0x7fab4017f490 2024-02-21T23:09:28.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.612+0000 7fab37e00640 1 --2- 172.21.15.99:0/2559384888 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab4018b060 0x7fab40175020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:09:28.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.613+0000 7fab3ea00640 1 --2- 172.21.15.99:0/2559384888 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab4017f490 0x7fab4021ffa0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fab400fbed0 tx=0x7fab300046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:09:28.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.613+0000 7fab36a00640 1 -- 172.21.15.99:0/2559384888 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab30040070 con 0x7fab4017f490 2024-02-21T23:09:28.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.613+0000 7fab36a00640 1 -- 172.21.15.99:0/2559384888 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab3003e070 con 0x7fab4017f490 2024-02-21T23:09:28.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.613+0000 7fab3fe00640 1 -- 172.21.15.99:0/2559384888 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab40173f80 con 0x7fab4017f490 2024-02-21T23:09:28.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.613+0000 7fab36a00640 1 -- 172.21.15.99:0/2559384888 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab30035040 con 0x7fab4017f490 2024-02-21T23:09:28.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.613+0000 7fab3fe00640 1 -- 172.21.15.99:0/2559384888 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab40174540 con 0x7fab4017f490 2024-02-21T23:09:28.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.617+0000 7fab36a00640 1 -- 172.21.15.99:0/2559384888 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7fab30038020 con 0x7fab4017f490 2024-02-21T23:09:28.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.618+0000 7fab36a00640 1 --2- 172.21.15.99:0/2559384888 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fab1c09ef00 0x7fab1c0a13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:28.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.619+0000 7fab36a00640 1 -- 172.21.15.99:0/2559384888 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 8877+0+0 (secure 0 0 0) 0x7fab300eb3e0 con 0x7fab4017f490 2024-02-21T23:09:28.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.619+0000 7fab37e00640 1 --2- 172.21.15.99:0/2559384888 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fab1c09ef00 0x7fab1c0a13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:28.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.619+0000 7fab48bd2740 1 Processor -- start 2024-02-21T23:09:28.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.620+0000 7fab48bd2740 1 -- start start 2024-02-21T23:09:28.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.620+0000 7fab37e00640 1 --2- 172.21.15.99:0/2559384888 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fab1c09ef00 0x7fab1c0a13c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fab401867b0 tx=0x7fab28009190 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:09:28.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.621+0000 7fab48bd2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5653901f5660 0x5653901f5a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:28.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.621+0000 7fab48bd2740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x565390230330 0x5653902307b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:28.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.621+0000 7fab48bd2740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x565390230cf0 0x565390231560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:28.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.621+0000 7fab48bd2740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x56539011db50 con 0x565390230cf0 2024-02-21T23:09:28.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.621+0000 7fab48bd2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653900c6da0 con 0x5653901f5660 2024-02-21T23:09:28.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.621+0000 7fab48bd2740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x565390119bf0 con 0x565390230330 2024-02-21T23:09:28.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.621+0000 7fab3ea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5653901f5660 0x5653901f5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:28.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.621+0000 7fab37e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x565390230330 0x5653902307b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:28.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.621+0000 7fab3ea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5653901f5660 0x5653901f5a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:44196/0 (socket says 172.21.15.99:44196) 2024-02-21T23:09:28.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.621+0000 7fab3ea00640 1 -- 172.21.15.99:0/1783647999 learned_addr learned my addr 172.21.15.99:0/1783647999 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:09:28.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.621+0000 7fab3f400640 1 --2- 172.21.15.99:0/1783647999 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x565390230cf0 0x565390231560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:28.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.621+0000 7fab37e00640 1 -- 172.21.15.99:0/1783647999 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5653901f5660 msgr2=0x5653901f5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:09:28.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.621+0000 7fab37e00640 1 --2- 172.21.15.99:0/1783647999 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5653901f5660 0x5653901f5a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.621+0000 7fab37e00640 1 -- 172.21.15.99:0/1783647999 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x565390230cf0 msgr2=0x565390231560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:09:28.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.621+0000 7fab37e00640 1 --2- 172.21.15.99:0/1783647999 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x565390230cf0 0x565390231560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.622+0000 7fab37e00640 1 -- 172.21.15.99:0/1783647999 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5653900e9f80 con 0x565390230330 2024-02-21T23:09:28.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.622+0000 7fab3ea00640 1 --2- 172.21.15.99:0/1783647999 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5653901f5660 0x5653901f5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:09:28.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.622+0000 7fab37e00640 1 --2- 172.21.15.99:0/1783647999 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x565390230330 0x5653902307b0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fab28014760 tx=0x7fab28014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=865eb14ecc1cc190 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:09:28.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.622+0000 7fab2f400640 1 -- 172.21.15.99:0/1783647999 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab28025070 con 0x565390230330 2024-02-21T23:09:28.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.622+0000 7fab2f400640 1 -- 172.21.15.99:0/1783647999 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab2801b070 con 0x565390230330 2024-02-21T23:09:28.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.622+0000 7fab2f400640 1 -- 172.21.15.99:0/1783647999 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab280215f0 con 0x565390230330 2024-02-21T23:09:28.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.623+0000 7fab48bd2740 1 -- 172.21.15.99:0/1783647999 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x565390230330 msgr2=0x5653902307b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:09:28.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.623+0000 7fab48bd2740 1 --2- 172.21.15.99:0/1783647999 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x565390230330 0x5653902307b0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fab28014760 tx=0x7fab28014000 comp rx=0 tx=0).stop 2024-02-21T23:09:28.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.623+0000 7fab48bd2740 1 -- 172.21.15.99:0/1783647999 shutdown_connections 2024-02-21T23:09:28.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.623+0000 7fab48bd2740 1 --2- 172.21.15.99:0/1783647999 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x565390230cf0 0x565390231560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.623+0000 7fab48bd2740 1 --2- 172.21.15.99:0/1783647999 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x565390230330 0x5653902307b0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.623+0000 7fab48bd2740 1 --2- 172.21.15.99:0/1783647999 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5653901f5660 0x5653901f5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.623+0000 7fab48bd2740 1 -- 172.21.15.99:0/1783647999 >> 172.21.15.99:0/1783647999 conn(0x5653901b76d0 msgr2=0x5653901b8750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:09:28.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.623+0000 7fab48bd2740 1 -- 172.21.15.99:0/1783647999 shutdown_connections 2024-02-21T23:09:28.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.623+0000 7fab48bd2740 1 -- 172.21.15.99:0/1783647999 wait complete. 2024-02-21T23:09:28.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.625+0000 7fab48bd2740 1 -- start start 2024-02-21T23:09:28.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.625+0000 7fab48bd2740 1 Processor -- start 2024-02-21T23:09:28.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.627+0000 7fab48bd2740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x565390230330 0x5653901b3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:28.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.627+0000 7fab48bd2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565390230cf0 0x5653901fec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:28.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.627+0000 7fab48bd2740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5653901fd230 0x5653901eb490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:28.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.627+0000 7fab48bd2740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x56539022f0a0 con 0x5653901fd230 2024-02-21T23:09:28.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.627+0000 7fab48bd2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653900bc380 con 0x565390230cf0 2024-02-21T23:09:28.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.627+0000 7fab48bd2740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x56539022edc0 con 0x565390230330 2024-02-21T23:09:28.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.627+0000 7fab48bd2740 10 client.0 _ll_register_callbacks cb 0x565390115280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:09:28.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.628+0000 7fab3ea00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x565390230330 0x5653901b3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:28.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.628+0000 7fab37e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565390230cf0 0x5653901fec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:28.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.628+0000 7fab3f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5653901fd230 0x5653901eb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:28.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.628+0000 7fab37e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565390230cf0 0x5653901fec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:44202/0 (socket says 172.21.15.99:44202) 2024-02-21T23:09:28.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.628+0000 7fab3ea00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x565390230330 0x5653901b3e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:41012/0 (socket says 172.21.15.99:41012) 2024-02-21T23:09:28.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.628+0000 7fab37e00640 1 -- 172.21.15.99:0/3029816148 learned_addr learned my addr 172.21.15.99:0/3029816148 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:09:28.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.628+0000 7fab3ea00640 1 -- 172.21.15.99:0/3029816148 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565390230cf0 msgr2=0x5653901fec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:09:28.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.628+0000 7fab3ea00640 1 --2- 172.21.15.99:0/3029816148 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565390230cf0 0x5653901fec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.628+0000 7fab3ea00640 1 -- 172.21.15.99:0/3029816148 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5653901fd230 msgr2=0x5653901eb490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:09:28.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.628+0000 7fab3ea00640 1 --2- 172.21.15.99:0/3029816148 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5653901fd230 0x5653901eb490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.628+0000 7fab3ea00640 1 -- 172.21.15.99:0/3029816148 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5653900e4c20 con 0x565390230330 2024-02-21T23:09:28.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.628+0000 7fab3ea00640 1 --2- 172.21.15.99:0/3029816148 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x565390230330 0x5653901b3e00 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fab300b5000 tx=0x7fab300b8b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3cf0f4db6af3dbc2 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:09:28.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.628+0000 7fab23e00640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-02-21T23:09:28.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.628+0000 7fab23e00640 1 -- 172.21.15.99:0/3029816148 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab300bcd80 con 0x565390230330 2024-02-21T23:09:28.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.629+0000 7fab23e00640 1 -- 172.21.15.99:0/3029816148 <== mon.2 v2:172.21.15.181:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8877+0+0 (secure 0 0 0) 0x7fab300b8080 con 0x565390230330 2024-02-21T23:09:28.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.629+0000 7fab48bd2740 1 -- 172.21.15.99:0/3029816148 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fab2801b070 con 0x565390230330 2024-02-21T23:09:28.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.629+0000 7fab23e00640 1 -- 172.21.15.99:0/3029816148 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fab300c13d0 con 0x565390230330 2024-02-21T23:09:28.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.629+0000 7fab48bd2740 10 client.6659 fetch_fsmap learned FSMap version 17 2024-02-21T23:09:28.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.629+0000 7fab48bd2740 1 -- 172.21.15.99:0/3029816148 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x56538fe323f0 con 0x565390230330 2024-02-21T23:09:28.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.629+0000 7fab23e00640 1 -- 172.21.15.99:0/3029816148 <== mon.2 v2:172.21.15.181:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab2801b070 con 0x565390230330 2024-02-21T23:09:28.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.629+0000 7fab23e00640 1 -- 172.21.15.99:0/3029816148 <== mon.2 v2:172.21.15.181:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fab3004c030 con 0x565390230330 2024-02-21T23:09:28.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.629+0000 7fab48bd2740 10 client.6659 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:09:28.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.629+0000 7fab48bd2740 10 client.6659 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2024-02-21T23:09:28.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.629+0000 7fab48bd2740 20 client.6659 populate_metadata read hostname 'smithi099' 2024-02-21T23:09:28.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.629+0000 7fab48bd2740 1 --2- 172.21.15.99:0/3029816148 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x5653901ff2e0 0x5653901f9870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:28.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.629+0000 7fab48bd2740 4 client.6659 mds_command: new command op to 4352 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:09:28.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.629+0000 7fab48bd2740 1 -- 172.21.15.99:0/3029816148 --> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56539012b090 con 0x5653901ff2e0 2024-02-21T23:09:28.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.630+0000 7fab37e00640 1 --2- 172.21.15.99:0/3029816148 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x5653901ff2e0 0x5653901f9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:28.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.630+0000 7fab37e00640 1 --2- 172.21.15.99:0/3029816148 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x5653901ff2e0 0x5653901f9870 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=da5244eeb511aa85 server_cookie=7438490a65a8c5f in_seq=0 out_seq=0 2024-02-21T23:09:28.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.630+0000 7fab23e00640 10 client.6659 ms_handle_connect on v2:172.21.15.99:6836/1676159950 2024-02-21T23:09:28.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.631+0000 7fab23e00640 1 -- 172.21.15.99:0/3029816148 <== mds.1 v2:172.21.15.99:6836/1676159950 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x56539012b090 con 0x5653901ff2e0 2024-02-21T23:09:28.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.631+0000 7fab23e00640 10 client.6659 handle_command_reply: tid=0 2024-02-21T23:09:28.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.631+0000 7fab48bd2740 1 client.6659 shutdown 2024-02-21T23:09:28.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.631+0000 7fab48bd2740 1 -- 172.21.15.99:0/3029816148 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x565390230330 msgr2=0x5653901b3e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:09:28.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.631+0000 7fab48bd2740 1 --2- 172.21.15.99:0/3029816148 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x565390230330 0x5653901b3e00 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fab300b5000 tx=0x7fab300b8b30 comp rx=0 tx=0).stop 2024-02-21T23:09:28.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.631+0000 7fab48bd2740 1 -- 172.21.15.99:0/3029816148 shutdown_connections 2024-02-21T23:09:28.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.631+0000 7fab48bd2740 1 --2- 172.21.15.99:0/3029816148 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x5653901ff2e0 0x5653901f9870 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.631+0000 7fab48bd2740 1 --2- 172.21.15.99:0/3029816148 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5653901fd230 0x5653901eb490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.631+0000 7fab48bd2740 1 --2- 172.21.15.99:0/3029816148 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565390230cf0 0x5653901fec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.631+0000 7fab48bd2740 1 --2- 172.21.15.99:0/3029816148 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x565390230330 0x5653901b3e00 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.631+0000 7fab48bd2740 1 -- 172.21.15.99:0/3029816148 >> 172.21.15.99:0/3029816148 conn(0x5653901f5660 msgr2=0x56539022e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:09:28.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.631+0000 7fab23e00640 0 client.6659 ms_handle_reset on v2:172.21.15.99:6836/1676159950 2024-02-21T23:09:28.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.632+0000 7fab48bd2740 1 -- 172.21.15.99:0/3029816148 shutdown_connections 2024-02-21T23:09:28.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.632+0000 7fab48bd2740 1 -- 172.21.15.99:0/3029816148 wait complete. 2024-02-21T23:09:28.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.632+0000 7fab48bd2740 20 client.6659 trim_cache size 0 max 16384 2024-02-21T23:09:28.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.650+0000 7fab48bd2740 1 Processor -- start 2024-02-21T23:09:28.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.650+0000 7fab48bd2740 1 -- start start 2024-02-21T23:09:28.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.651+0000 7fab48bd2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5653901fd230 0x5653901fec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:28.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.651+0000 7fab48bd2740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x565390230330 0x5653901fae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:28.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.651+0000 7fab48bd2740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x565390230cf0 0x5653901ee940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:28.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.651+0000 7fab48bd2740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab4022c850 con 0x565390230330 2024-02-21T23:09:28.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.651+0000 7fab48bd2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab4022a3f0 con 0x5653901fd230 2024-02-21T23:09:28.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.651+0000 7fab48bd2740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab402285d0 con 0x565390230cf0 2024-02-21T23:09:28.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.652+0000 7fab37e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x565390230330 0x5653901fae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:28.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.652+0000 7fab3ea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5653901fd230 0x5653901fec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:28.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.652+0000 7fab3ea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5653901fd230 0x5653901fec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:44218/0 (socket says 172.21.15.99:44218) 2024-02-21T23:09:28.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.652+0000 7fab37e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x565390230330 0x5653901fae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42604/0 (socket says 172.21.15.99:42604) 2024-02-21T23:09:28.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.652+0000 7fab3ea00640 1 -- 172.21.15.99:0/788501557 learned_addr learned my addr 172.21.15.99:0/788501557 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:09:28.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.652+0000 7fab3f400640 1 --2- 172.21.15.99:0/788501557 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x565390230cf0 0x5653901ee940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:28.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.652+0000 7fab3ea00640 1 -- 172.21.15.99:0/788501557 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x565390230cf0 msgr2=0x5653901ee940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:09:28.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.652+0000 7fab3ea00640 1 --2- 172.21.15.99:0/788501557 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x565390230cf0 0x5653901ee940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.652+0000 7fab3ea00640 1 -- 172.21.15.99:0/788501557 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x565390230330 msgr2=0x5653901fae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:09:28.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.652+0000 7fab3ea00640 1 --2- 172.21.15.99:0/788501557 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x565390230330 0x5653901fae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.652+0000 7fab3ea00640 1 -- 172.21.15.99:0/788501557 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5653901bfee0 con 0x5653901fd230 2024-02-21T23:09:28.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.652+0000 7fab37e00640 1 --2- 172.21.15.99:0/788501557 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x565390230330 0x5653901fae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:09:28.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.652+0000 7fab3ea00640 1 --2- 172.21.15.99:0/788501557 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5653901fd230 0x5653901fec00 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fab300b9490 tx=0x7fab300ba000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3b2587ad4d79c22 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:09:28.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.653+0000 7fab2ea00640 1 -- 172.21.15.99:0/788501557 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab300b8080 con 0x5653901fd230 2024-02-21T23:09:28.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.653+0000 7fab2ea00640 1 -- 172.21.15.99:0/788501557 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab300b8220 con 0x5653901fd230 2024-02-21T23:09:28.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.653+0000 7fab2ea00640 1 -- 172.21.15.99:0/788501557 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab3003ad10 con 0x5653901fd230 2024-02-21T23:09:28.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.653+0000 7fab48bd2740 1 -- 172.21.15.99:0/788501557 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5653901fd230 msgr2=0x5653901fec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:09:28.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.653+0000 7fab48bd2740 1 --2- 172.21.15.99:0/788501557 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5653901fd230 0x5653901fec00 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fab300b9490 tx=0x7fab300ba000 comp rx=0 tx=0).stop 2024-02-21T23:09:28.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.654+0000 7fab48bd2740 1 -- 172.21.15.99:0/788501557 shutdown_connections 2024-02-21T23:09:28.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.654+0000 7fab48bd2740 1 --2- 172.21.15.99:0/788501557 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x565390230cf0 0x5653901ee940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.654+0000 7fab48bd2740 1 --2- 172.21.15.99:0/788501557 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x565390230330 0x5653901fae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.654+0000 7fab48bd2740 1 --2- 172.21.15.99:0/788501557 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5653901fd230 0x5653901fec00 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.654+0000 7fab48bd2740 1 -- 172.21.15.99:0/788501557 >> 172.21.15.99:0/788501557 conn(0x5653901f5660 msgr2=0x56539022f1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:09:28.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.654+0000 7fab48bd2740 1 -- 172.21.15.99:0/788501557 shutdown_connections 2024-02-21T23:09:28.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.654+0000 7fab48bd2740 1 -- 172.21.15.99:0/788501557 wait complete. 2024-02-21T23:09:28.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.655+0000 7fab48bd2740 1 -- start start 2024-02-21T23:09:28.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.655+0000 7fab48bd2740 1 Processor -- start 2024-02-21T23:09:28.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.657+0000 7fab48bd2740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5653901fd230 0x565390228790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:28.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.657+0000 7fab48bd2740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x565390230330 0x5653901fd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:28.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.657+0000 7fab48bd2740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565390230cf0 0x56539028b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:28.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.658+0000 7fab48bd2740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab40228b30 con 0x5653901fd230 2024-02-21T23:09:28.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.658+0000 7fab48bd2740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab40229d90 con 0x565390230cf0 2024-02-21T23:09:28.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.658+0000 7fab48bd2740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab40229130 con 0x565390230330 2024-02-21T23:09:28.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.658+0000 7fab48bd2740 10 client.0 _ll_register_callbacks cb 0x7fab300b6de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:09:28.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.658+0000 7fab3ea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5653901fd230 0x565390228790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:28.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.658+0000 7fab3ea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5653901fd230 0x565390228790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42608/0 (socket says 172.21.15.99:42608) 2024-02-21T23:09:28.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.658+0000 7fab3ea00640 1 -- 172.21.15.99:0/2588579308 learned_addr learned my addr 172.21.15.99:0/2588579308 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:09:28.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.658+0000 7fab37e00640 1 --2- 172.21.15.99:0/2588579308 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x565390230330 0x5653901fd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:28.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.658+0000 7fab3f400640 1 --2- 172.21.15.99:0/2588579308 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565390230cf0 0x56539028b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:28.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.658+0000 7fab3ea00640 1 -- 172.21.15.99:0/2588579308 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x565390230330 msgr2=0x5653901fd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:09:28.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.658+0000 7fab3ea00640 1 --2- 172.21.15.99:0/2588579308 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x565390230330 0x5653901fd650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.658+0000 7fab3ea00640 1 -- 172.21.15.99:0/2588579308 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565390230cf0 msgr2=0x56539028b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:09:28.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.658+0000 7fab3ea00640 1 --2- 172.21.15.99:0/2588579308 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565390230cf0 0x56539028b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.658+0000 7fab3ea00640 1 -- 172.21.15.99:0/2588579308 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5653901f5250 con 0x5653901fd230 2024-02-21T23:09:28.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.658+0000 7fab37e00640 1 --2- 172.21.15.99:0/2588579308 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x565390230330 0x5653901fd650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:09:28.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.659+0000 7fab3ea00640 1 --2- 172.21.15.99:0/2588579308 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5653901fd230 0x565390228790 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fab3002b910 tx=0x7fab3003c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=728834ce4e66aceb server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:09:28.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.659+0000 7fab23e00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:09:28.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.659+0000 7fab23e00640 1 -- 172.21.15.99:0/2588579308 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab300a0060 con 0x5653901fd230 2024-02-21T23:09:28.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.659+0000 7fab23e00640 1 -- 172.21.15.99:0/2588579308 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8877+0+0 (secure 0 0 0) 0x7fab300b48f0 con 0x5653901fd230 2024-02-21T23:09:28.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.659+0000 7fab48bd2740 1 -- 172.21.15.99:0/2588579308 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fab300b8220 con 0x5653901fd230 2024-02-21T23:09:28.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.659+0000 7fab23e00640 1 -- 172.21.15.99:0/2588579308 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fab300b8080 con 0x5653901fd230 2024-02-21T23:09:28.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.659+0000 7fab48bd2740 10 client.6534 fetch_fsmap learned FSMap version 17 2024-02-21T23:09:28.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.659+0000 7fab48bd2740 1 -- 172.21.15.99:0/2588579308 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x56538fefc7d0 con 0x5653901fd230 2024-02-21T23:09:28.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.659+0000 7fab23e00640 1 -- 172.21.15.99:0/2588579308 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab300b8220 con 0x5653901fd230 2024-02-21T23:09:28.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.660+0000 7fab23e00640 1 -- 172.21.15.99:0/2588579308 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fab3004c070 con 0x5653901fd230 2024-02-21T23:09:28.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.660+0000 7fab48bd2740 10 client.6534 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:09:28.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.660+0000 7fab48bd2740 10 client.6534 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2024-02-21T23:09:28.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.660+0000 7fab48bd2740 20 client.6534 populate_metadata read hostname 'smithi099' 2024-02-21T23:09:28.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.660+0000 7fab48bd2740 1 --2- 172.21.15.99:0/2588579308 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x5653901ec150 0x56539024a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:28.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.660+0000 7fab48bd2740 4 client.6534 mds_command: new command op to 4352 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T23:09:28.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.660+0000 7fab48bd2740 1 -- 172.21.15.99:0/2588579308 --> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5653901b7e30 con 0x5653901ec150 2024-02-21T23:09:28.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.660+0000 7fab37e00640 1 --2- 172.21.15.99:0/2588579308 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x5653901ec150 0x56539024a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:28.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.661+0000 7fab37e00640 1 --2- 172.21.15.99:0/2588579308 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x5653901ec150 0x56539024a4a0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6e7bd9ab503167a6 server_cookie=2e70daab2c85695d in_seq=0 out_seq=0 2024-02-21T23:09:28.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.661+0000 7fab23e00640 10 client.6534 ms_handle_connect on v2:172.21.15.99:6836/1676159950 2024-02-21T23:09:28.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.661+0000 7fab23e00640 1 -- 172.21.15.99:0/2588579308 <== mds.1 v2:172.21.15.99:6836/1676159950 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5653901b7e30 con 0x5653901ec150 2024-02-21T23:09:28.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.661+0000 7fab23e00640 10 client.6534 handle_command_reply: tid=0 2024-02-21T23:09:28.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.661+0000 7fab48bd2740 1 client.6534 shutdown 2024-02-21T23:09:28.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.661+0000 7fab48bd2740 1 -- 172.21.15.99:0/2588579308 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5653901fd230 msgr2=0x565390228790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:09:28.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.661+0000 7fab48bd2740 1 --2- 172.21.15.99:0/2588579308 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5653901fd230 0x565390228790 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fab3002b910 tx=0x7fab3003c040 comp rx=0 tx=0).stop 2024-02-21T23:09:28.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.661+0000 7fab48bd2740 1 -- 172.21.15.99:0/2588579308 shutdown_connections 2024-02-21T23:09:28.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.661+0000 7fab48bd2740 1 --2- 172.21.15.99:0/2588579308 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x5653901ec150 0x56539024a4a0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.661+0000 7fab48bd2740 1 --2- 172.21.15.99:0/2588579308 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x565390230cf0 0x56539028b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.661+0000 7fab48bd2740 1 --2- 172.21.15.99:0/2588579308 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x565390230330 0x5653901fd650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.661+0000 7fab23e00640 0 client.6534 ms_handle_reset on v2:172.21.15.99:6836/1676159950 2024-02-21T23:09:28.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.661+0000 7fab48bd2740 1 --2- 172.21.15.99:0/2588579308 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5653901fd230 0x565390228790 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.661+0000 7fab48bd2740 1 -- 172.21.15.99:0/2588579308 >> 172.21.15.99:0/2588579308 conn(0x5653901f5660 msgr2=0x5653901ff750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:09:28.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.661+0000 7fab48bd2740 1 -- 172.21.15.99:0/2588579308 shutdown_connections 2024-02-21T23:09:28.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.661+0000 7fab48bd2740 1 -- 172.21.15.99:0/2588579308 wait complete. 2024-02-21T23:09:28.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.662+0000 7fab48bd2740 20 client.6534 trim_cache size 0 max 16384 2024-02-21T23:09:28.656 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-02-21T23:09:28.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.662+0000 7fab3fe00640 1 -- 172.21.15.99:0/2559384888 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fab1c09ef00 msgr2=0x7fab1c0a13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:09:28.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.662+0000 7fab3fe00640 1 --2- 172.21.15.99:0/2559384888 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fab1c09ef00 0x7fab1c0a13c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fab401867b0 tx=0x7fab28009190 comp rx=0 tx=0).stop 2024-02-21T23:09:28.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.662+0000 7fab3fe00640 1 -- 172.21.15.99:0/2559384888 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab4017f490 msgr2=0x7fab4021ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:09:28.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.662+0000 7fab3fe00640 1 --2- 172.21.15.99:0/2559384888 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab4017f490 0x7fab4021ffa0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fab400fbed0 tx=0x7fab300046c0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.662+0000 7fab3fe00640 1 -- 172.21.15.99:0/2559384888 shutdown_connections 2024-02-21T23:09:28.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.663+0000 7fab3fe00640 1 --2- 172.21.15.99:0/2559384888 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fab1c09ef00 0x7fab1c0a13c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.663+0000 7fab3fe00640 1 --2- 172.21.15.99:0/2559384888 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fab4018b4f0 0x7fab400cf420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.663+0000 7fab3fe00640 1 --2- 172.21.15.99:0/2559384888 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab4018b060 0x7fab40175020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.663+0000 7fab3fe00640 1 --2- 172.21.15.99:0/2559384888 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab4017f490 0x7fab4021ffa0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.663+0000 7fab3fe00640 1 -- 172.21.15.99:0/2559384888 >> 172.21.15.99:0/2559384888 conn(0x7fab400d29b0 msgr2=0x7fab400fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:09:28.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.663+0000 7fab3fe00640 1 -- 172.21.15.99:0/2559384888 shutdown_connections 2024-02-21T23:09:28.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.663+0000 7fab3fe00640 1 -- 172.21.15.99:0/2559384888 wait complete. 2024-02-21T23:09:28.671 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T23:09:28.671 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-02-21T23:09:28.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.903+0000 7f66f7200640 1 Processor -- start 2024-02-21T23:09:28.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.903+0000 7f66f7200640 1 -- start start 2024-02-21T23:09:28.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.905+0000 7f66f7200640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f66f817f490 0x7f66f818ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:28.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.905+0000 7f66f7200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f66f818b060 0x7f66f8188a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:28.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.905+0000 7f66f7200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f66f818b4f0 0x7f66f8188f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:28.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.905+0000 7f66f7200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66f80d6dd0 con 0x7f66f818b4f0 2024-02-21T23:09:28.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.905+0000 7f66f7200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66f81614c0 con 0x7f66f818b060 2024-02-21T23:09:28.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.905+0000 7f66f7200640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66f80d6810 con 0x7f66f817f490 2024-02-21T23:09:28.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.905+0000 7f66f6800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f66f818b4f0 0x7f66f8188f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:28.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.905+0000 7f66f5e00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f66f817f490 0x7f66f818ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:28.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.905+0000 7f66f5400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f66f818b060 0x7f66f8188a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:28.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.905+0000 7f66f5e00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f66f817f490 0x7f66f818ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:41042/0 (socket says 172.21.15.99:41042) 2024-02-21T23:09:28.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.905+0000 7f66f5e00640 1 -- 172.21.15.99:0/135183243 learned_addr learned my addr 172.21.15.99:0/135183243 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:09:28.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.905+0000 7f66f6800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f66f818b4f0 0x7f66f8188f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42614/0 (socket says 172.21.15.99:42614) 2024-02-21T23:09:28.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.906+0000 7f66f5e00640 1 -- 172.21.15.99:0/135183243 >> v2:172.21.15.162:3300/0 conn(0x7f66f818b060 msgr2=0x7f66f8188a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:09:28.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.906+0000 7f66f5e00640 1 --2- 172.21.15.99:0/135183243 >> v2:172.21.15.162:3300/0 conn(0x7f66f818b060 0x7f66f8188a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.906+0000 7f66f5e00640 1 -- 172.21.15.99:0/135183243 >> v2:172.21.15.99:3300/0 conn(0x7f66f818b4f0 msgr2=0x7f66f8188f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:09:28.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.906+0000 7f66f5e00640 1 --2- 172.21.15.99:0/135183243 >> v2:172.21.15.99:3300/0 conn(0x7f66f818b4f0 0x7f66f8188f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.906+0000 7f66f5e00640 1 -- 172.21.15.99:0/135183243 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66f80d6af0 con 0x7f66f817f490 2024-02-21T23:09:28.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.906+0000 7f66f5400640 1 --2- 172.21.15.99:0/135183243 >> v2:172.21.15.162:3300/0 conn(0x7f66f818b060 0x7f66f8188a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:09:28.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.907+0000 7f66f5e00640 1 --2- 172.21.15.99:0/135183243 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f66f817f490 0x7f66f818ab20 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f66f8186880 tx=0x7f66e802b920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7762382bc55ba5e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:09:28.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.907+0000 7f66f4a00640 1 -- 172.21.15.99:0/135183243 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e8035020 con 0x7f66f817f490 2024-02-21T23:09:28.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.907+0000 7f66f4a00640 1 -- 172.21.15.99:0/135183243 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66e8031880 con 0x7f66f817f490 2024-02-21T23:09:28.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.907+0000 7f66f4a00640 1 -- 172.21.15.99:0/135183243 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e8031c50 con 0x7f66f817f490 2024-02-21T23:09:28.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.908+0000 7f66f7200640 1 -- 172.21.15.99:0/135183243 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f66f817f490 msgr2=0x7f66f818ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:09:28.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.908+0000 7f66f7200640 1 --2- 172.21.15.99:0/135183243 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f66f817f490 0x7f66f818ab20 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f66f8186880 tx=0x7f66e802b920 comp rx=0 tx=0).stop 2024-02-21T23:09:28.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.908+0000 7f66f7200640 1 -- 172.21.15.99:0/135183243 shutdown_connections 2024-02-21T23:09:28.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.908+0000 7f66f7200640 1 --2- 172.21.15.99:0/135183243 >> v2:172.21.15.99:3300/0 conn(0x7f66f818b4f0 0x7f66f8188f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.908+0000 7f66f7200640 1 --2- 172.21.15.99:0/135183243 >> v2:172.21.15.162:3300/0 conn(0x7f66f818b060 0x7f66f8188a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.908+0000 7f66f7200640 1 --2- 172.21.15.99:0/135183243 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f66f817f490 0x7f66f818ab20 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.908+0000 7f66f7200640 1 -- 172.21.15.99:0/135183243 >> 172.21.15.99:0/135183243 conn(0x7f66f80d29b0 msgr2=0x7f66f80d2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:09:28.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.908+0000 7f66f7200640 1 -- 172.21.15.99:0/135183243 shutdown_connections 2024-02-21T23:09:28.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.908+0000 7f66f7200640 1 -- 172.21.15.99:0/135183243 wait complete. 2024-02-21T23:09:28.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.911+0000 7f66f7200640 1 Processor -- start 2024-02-21T23:09:28.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.911+0000 7f66f7200640 1 -- start start 2024-02-21T23:09:28.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.913+0000 7f66f7200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f66f817f490 0x7f66f81757d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:28.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.913+0000 7f66f7200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f66f818b060 0x7f66f8220580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:28.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.913+0000 7f66f7200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66f818b4f0 0x7f66f8220ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:28.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.913+0000 7f66f7200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f818a600 con 0x7f66f818b060 2024-02-21T23:09:28.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.913+0000 7f66f7200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f818a320 con 0x7f66f818b4f0 2024-02-21T23:09:28.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.913+0000 7f66f7200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f817f870 con 0x7f66f817f490 2024-02-21T23:09:28.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.913+0000 7f66f5400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f66f818b060 0x7f66f8220580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:28.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.913+0000 7f66f5400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f66f818b060 0x7f66f8220580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42630/0 (socket says 172.21.15.99:42630) 2024-02-21T23:09:28.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.913+0000 7f66f5400640 1 -- 172.21.15.99:0/2275291748 learned_addr learned my addr 172.21.15.99:0/2275291748 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:09:28.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.913+0000 7f66f5e00640 1 --2- 172.21.15.99:0/2275291748 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f66f817f490 0x7f66f81757d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:28.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.914+0000 7f66f6800640 1 --2- 172.21.15.99:0/2275291748 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66f818b4f0 0x7f66f8220ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:28.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.914+0000 7f66f5400640 1 -- 172.21.15.99:0/2275291748 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f66f817f490 msgr2=0x7f66f81757d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:09:28.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.914+0000 7f66f5400640 1 --2- 172.21.15.99:0/2275291748 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f66f817f490 0x7f66f81757d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.914+0000 7f66f5400640 1 -- 172.21.15.99:0/2275291748 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66f818b4f0 msgr2=0x7f66f8220ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:09:28.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.914+0000 7f66f5400640 1 --2- 172.21.15.99:0/2275291748 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66f818b4f0 0x7f66f8220ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.914+0000 7f66f5400640 1 -- 172.21.15.99:0/2275291748 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66f82211a0 con 0x7f66f818b060 2024-02-21T23:09:28.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.914+0000 7f66f5e00640 1 --2- 172.21.15.99:0/2275291748 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f66f817f490 0x7f66f81757d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:09:28.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.914+0000 7f66f5400640 1 --2- 172.21.15.99:0/2275291748 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f66f818b060 0x7f66f8220580 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f66e400e8e0 tx=0x7f66e400eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:09:28.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.915+0000 7f66ee000640 1 -- 172.21.15.99:0/2275291748 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e4017070 con 0x7f66f818b060 2024-02-21T23:09:28.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.915+0000 7f66ee000640 1 -- 172.21.15.99:0/2275291748 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66e400c8e0 con 0x7f66f818b060 2024-02-21T23:09:28.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.915+0000 7f66f7200640 1 -- 172.21.15.99:0/2275291748 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66f8221480 con 0x7f66f818b060 2024-02-21T23:09:28.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.915+0000 7f66ee000640 1 -- 172.21.15.99:0/2275291748 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e400ccb0 con 0x7f66f818b060 2024-02-21T23:09:28.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.915+0000 7f66f7200640 1 -- 172.21.15.99:0/2275291748 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66f8221a40 con 0x7f66f818b060 2024-02-21T23:09:28.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.918+0000 7f66ee000640 1 -- 172.21.15.99:0/2275291748 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f66e401a070 con 0x7f66f818b060 2024-02-21T23:09:28.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.920+0000 7f66ee000640 1 --2- 172.21.15.99:0/2275291748 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f66d809eed0 0x7f66d80a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:28.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.920+0000 7f66ee000640 1 -- 172.21.15.99:0/2275291748 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f66e40c9ff0 con 0x7f66f818b060 2024-02-21T23:09:28.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.920+0000 7f66f5e00640 1 --2- 172.21.15.99:0/2275291748 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f66d809eed0 0x7f66d80a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:28.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.921+0000 7f66f5e00640 1 --2- 172.21.15.99:0/2275291748 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f66d809eed0 0x7f66d80a1390 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f66e8036000 tx=0x7f66e803c040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:09:28.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.921+0000 7f66ffe56740 1 Processor -- start 2024-02-21T23:09:28.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.921+0000 7f66ffe56740 1 -- start start 2024-02-21T23:09:28.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.923+0000 7f66ffe56740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d81f789660 0x55d81f789a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:28.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.923+0000 7f66ffe56740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d81f7c4330 0x55d81f7c47b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:28.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.923+0000 7f66ffe56740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d81f7c4cf0 0x55d81f7c5560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:28.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.923+0000 7f66ffe56740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d81f6b1b50 con 0x55d81f789660 2024-02-21T23:09:28.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.923+0000 7f66ffe56740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d81f65ada0 con 0x55d81f7c4cf0 2024-02-21T23:09:28.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.923+0000 7f66ffe56740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d81f6adbf0 con 0x55d81f7c4330 2024-02-21T23:09:28.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.924+0000 7f66f5e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d81f789660 0x55d81f789a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:28.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.924+0000 7f66f5e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d81f789660 0x55d81f789a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42644/0 (socket says 172.21.15.99:42644) 2024-02-21T23:09:28.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.924+0000 7f66f5e00640 1 -- 172.21.15.99:0/4029097512 learned_addr learned my addr 172.21.15.99:0/4029097512 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:09:28.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.924+0000 7f66f6800640 1 --2- 172.21.15.99:0/4029097512 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d81f7c4cf0 0x55d81f7c5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:28.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.924+0000 7f66f5400640 1 --2- 172.21.15.99:0/4029097512 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d81f7c4330 0x55d81f7c47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:28.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.924+0000 7f66f5e00640 1 -- 172.21.15.99:0/4029097512 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d81f7c4330 msgr2=0x55d81f7c47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:09:28.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.924+0000 7f66f5e00640 1 --2- 172.21.15.99:0/4029097512 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d81f7c4330 0x55d81f7c47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.924+0000 7f66f5e00640 1 -- 172.21.15.99:0/4029097512 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d81f7c4cf0 msgr2=0x55d81f7c5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:09:28.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.924+0000 7f66f5e00640 1 --2- 172.21.15.99:0/4029097512 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d81f7c4cf0 0x55d81f7c5560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.924+0000 7f66f5e00640 1 -- 172.21.15.99:0/4029097512 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d81f67df80 con 0x55d81f789660 2024-02-21T23:09:28.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.924+0000 7f66f5400640 1 --2- 172.21.15.99:0/4029097512 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d81f7c4330 0x55d81f7c47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T23:09:28.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.924+0000 7f66f6800640 1 --2- 172.21.15.99:0/4029097512 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d81f7c4cf0 0x55d81f7c5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:09:28.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.924+0000 7f66f5e00640 1 --2- 172.21.15.99:0/4029097512 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d81f789660 0x55d81f789a40 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f66e80090b0 tx=0x7f66e8008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce8d7ed59cd14e93 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:09:28.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.925+0000 7f66e2a00640 1 -- 172.21.15.99:0/4029097512 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e8053070 con 0x55d81f789660 2024-02-21T23:09:28.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.925+0000 7f66e2a00640 1 -- 172.21.15.99:0/4029097512 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66e803ae00 con 0x55d81f789660 2024-02-21T23:09:28.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.925+0000 7f66e2a00640 1 -- 172.21.15.99:0/4029097512 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e8035040 con 0x55d81f789660 2024-02-21T23:09:28.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.926+0000 7f66ffe56740 1 -- 172.21.15.99:0/4029097512 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d81f789660 msgr2=0x55d81f789a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:09:28.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.926+0000 7f66ffe56740 1 --2- 172.21.15.99:0/4029097512 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d81f789660 0x55d81f789a40 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f66e80090b0 tx=0x7f66e8008030 comp rx=0 tx=0).stop 2024-02-21T23:09:28.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.926+0000 7f66ffe56740 1 -- 172.21.15.99:0/4029097512 shutdown_connections 2024-02-21T23:09:28.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.926+0000 7f66ffe56740 1 --2- 172.21.15.99:0/4029097512 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d81f7c4cf0 0x55d81f7c5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.926+0000 7f66ffe56740 1 --2- 172.21.15.99:0/4029097512 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d81f7c4330 0x55d81f7c47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.926+0000 7f66ffe56740 1 --2- 172.21.15.99:0/4029097512 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d81f789660 0x55d81f789a40 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.926+0000 7f66ffe56740 1 -- 172.21.15.99:0/4029097512 >> 172.21.15.99:0/4029097512 conn(0x55d81f74b6d0 msgr2=0x55d81f74c750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:09:28.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.926+0000 7f66ffe56740 1 -- 172.21.15.99:0/4029097512 shutdown_connections 2024-02-21T23:09:28.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.926+0000 7f66ffe56740 1 -- 172.21.15.99:0/4029097512 wait complete. 2024-02-21T23:09:28.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.927+0000 7f66ffe56740 1 -- start start 2024-02-21T23:09:28.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.928+0000 7f66ffe56740 1 Processor -- start 2024-02-21T23:09:28.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.929+0000 7f66ffe56740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d81f7c4330 0x55d81f7cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:28.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.929+0000 7f66ffe56740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d81f7c4cf0 0x55d81f7cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:28.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.929+0000 7f66ffe56740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d81f7cf040 0x55d81f77a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:28.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.929+0000 7f66ffe56740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d81f7c30a0 con 0x55d81f7c4cf0 2024-02-21T23:09:28.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.929+0000 7f66ffe56740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d81f650380 con 0x55d81f7cf040 2024-02-21T23:09:28.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.929+0000 7f66ffe56740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d81f7c2dc0 con 0x55d81f7c4330 2024-02-21T23:09:28.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.929+0000 7f66ffe56740 10 client.0 _ll_register_callbacks cb 0x55d81f6a9280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:09:28.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.929+0000 7f66f5400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d81f7c4cf0 0x55d81f7cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:28.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.929+0000 7f66f6800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d81f7cf040 0x55d81f77a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:28.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.929+0000 7f66f6800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d81f7cf040 0x55d81f77a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:44268/0 (socket says 172.21.15.99:44268) 2024-02-21T23:09:28.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.929+0000 7f66f6800640 1 -- 172.21.15.99:0/807211020 learned_addr learned my addr 172.21.15.99:0/807211020 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:09:28.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.929+0000 7f66f5400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d81f7c4cf0 0x55d81f7cb770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42652/0 (socket says 172.21.15.99:42652) 2024-02-21T23:09:28.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.930+0000 7f66f5e00640 1 --2- 172.21.15.99:0/807211020 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d81f7c4330 0x55d81f7cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:28.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.930+0000 7f66f6800640 1 -- 172.21.15.99:0/807211020 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d81f7c4330 msgr2=0x55d81f7cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:09:28.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.930+0000 7f66f6800640 1 --2- 172.21.15.99:0/807211020 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d81f7c4330 0x55d81f7cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.930+0000 7f66f6800640 1 -- 172.21.15.99:0/807211020 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d81f7c4cf0 msgr2=0x55d81f7cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:09:28.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.930+0000 7f66f6800640 1 --2- 172.21.15.99:0/807211020 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d81f7c4cf0 0x55d81f7cb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.930+0000 7f66f6800640 1 -- 172.21.15.99:0/807211020 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d81f678c20 con 0x55d81f7cf040 2024-02-21T23:09:28.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.930+0000 7f66f5400640 1 --2- 172.21.15.99:0/807211020 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d81f7c4cf0 0x55d81f7cb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:09:28.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.930+0000 7f66f6800640 1 --2- 172.21.15.99:0/807211020 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d81f7cf040 0x55d81f77a5a0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f66f0007dd0 tx=0x7f66f0013680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=add82ceadf7bfc71 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:09:28.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.930+0000 7f66d7400640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-02-21T23:09:28.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.930+0000 7f66d7400640 1 -- 172.21.15.99:0/807211020 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f001c070 con 0x55d81f7cf040 2024-02-21T23:09:28.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.930+0000 7f66ffe56740 1 -- 172.21.15.99:0/807211020 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f66e803ae00 con 0x55d81f7cf040 2024-02-21T23:09:28.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.930+0000 7f66d7400640 1 -- 172.21.15.99:0/807211020 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f66f0016630 con 0x55d81f7cf040 2024-02-21T23:09:28.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.931+0000 7f66d7400640 1 -- 172.21.15.99:0/807211020 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f66f0028050 con 0x55d81f7cf040 2024-02-21T23:09:28.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.931+0000 7f66ffe56740 10 client.6679 fetch_fsmap learned FSMap version 17 2024-02-21T23:09:28.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.931+0000 7f66ffe56740 1 -- 172.21.15.99:0/807211020 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55d81f3c63f0 con 0x55d81f7cf040 2024-02-21T23:09:28.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.931+0000 7f66d7400640 1 -- 172.21.15.99:0/807211020 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66e803ae00 con 0x55d81f7cf040 2024-02-21T23:09:28.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.931+0000 7f66d7400640 1 -- 172.21.15.99:0/807211020 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f66f0016830 con 0x55d81f7cf040 2024-02-21T23:09:28.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.931+0000 7f66ffe56740 10 client.6679 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:09:28.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.931+0000 7f66ffe56740 10 client.6679 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:09:28.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.932+0000 7f66ffe56740 20 client.6679 populate_metadata read hostname 'smithi099' 2024-02-21T23:09:28.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.932+0000 7f66ffe56740 1 --2- 172.21.15.99:0/807211020 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55d81f7cf4a0 0x55d81f7940f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:28.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.932+0000 7f66ffe56740 4 client.6679 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:09:28.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.932+0000 7f66ffe56740 1 -- 172.21.15.99:0/807211020 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d81f6bf090 con 0x55d81f7cf4a0 2024-02-21T23:09:28.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.932+0000 7f66f5e00640 1 --2- 172.21.15.99:0/807211020 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55d81f7cf4a0 0x55d81f7940f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:28.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.933+0000 7f66f5e00640 1 --2- 172.21.15.99:0/807211020 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55d81f7cf4a0 0x55d81f7940f0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=616f599025063fd0 server_cookie=eb95c63c3dbfc521 in_seq=0 out_seq=0 2024-02-21T23:09:28.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.933+0000 7f66d7400640 10 client.6679 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:09:28.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.934+0000 7f66d7400640 1 -- 172.21.15.99:0/807211020 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55d81f6bf090 con 0x55d81f7cf4a0 2024-02-21T23:09:28.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.934+0000 7f66d7400640 10 client.6679 handle_command_reply: tid=0 2024-02-21T23:09:28.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.934+0000 7f66ffe56740 1 client.6679 shutdown 2024-02-21T23:09:28.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.934+0000 7f66ffe56740 1 -- 172.21.15.99:0/807211020 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d81f7cf040 msgr2=0x55d81f77a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:09:28.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.934+0000 7f66ffe56740 1 --2- 172.21.15.99:0/807211020 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d81f7cf040 0x55d81f77a5a0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f66f0007dd0 tx=0x7f66f0013680 comp rx=0 tx=0).stop 2024-02-21T23:09:28.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.934+0000 7f66ffe56740 1 -- 172.21.15.99:0/807211020 shutdown_connections 2024-02-21T23:09:28.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.934+0000 7f66ffe56740 1 --2- 172.21.15.99:0/807211020 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55d81f7cf4a0 0x55d81f7940f0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.934+0000 7f66ffe56740 1 --2- 172.21.15.99:0/807211020 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d81f7cf040 0x55d81f77a5a0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.934+0000 7f66ffe56740 1 --2- 172.21.15.99:0/807211020 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d81f7c4cf0 0x55d81f7cb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.934+0000 7f66ffe56740 1 --2- 172.21.15.99:0/807211020 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d81f7c4330 0x55d81f7cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.934+0000 7f66d7400640 0 client.6679 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:09:28.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.934+0000 7f66ffe56740 1 -- 172.21.15.99:0/807211020 >> 172.21.15.99:0/807211020 conn(0x55d81f789660 msgr2=0x55d81f785ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:09:28.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.934+0000 7f66ffe56740 1 -- 172.21.15.99:0/807211020 shutdown_connections 2024-02-21T23:09:28.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.934+0000 7f66ffe56740 1 -- 172.21.15.99:0/807211020 wait complete. 2024-02-21T23:09:28.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.934+0000 7f66ffe56740 20 client.6679 trim_cache size 0 max 16384 2024-02-21T23:09:28.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.961+0000 7f66ffe56740 1 Processor -- start 2024-02-21T23:09:28.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.961+0000 7f66ffe56740 1 -- start start 2024-02-21T23:09:28.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.962+0000 7f66ffe56740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d81f7c4330 0x55d81f753190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:28.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.963+0000 7f66ffe56740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d81f7c4cf0 0x55d81f7436b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:28.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.963+0000 7f66ffe56740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d81f7cf040 0x55d81f824720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:28.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.963+0000 7f66ffe56740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f822cc30 con 0x55d81f7c4330 2024-02-21T23:09:28.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.963+0000 7f66ffe56740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f822a7d0 con 0x55d81f7c4cf0 2024-02-21T23:09:28.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.963+0000 7f66ffe56740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f817a6e0 con 0x55d81f7cf040 2024-02-21T23:09:28.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.963+0000 7f66f5e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d81f7c4330 0x55d81f753190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:28.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.963+0000 7f66f5400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d81f7c4cf0 0x55d81f7436b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:28.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.963+0000 7f66f5400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d81f7c4cf0 0x55d81f7436b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:44280/0 (socket says 172.21.15.99:44280) 2024-02-21T23:09:28.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.963+0000 7f66f5400640 1 -- 172.21.15.99:0/1244822066 learned_addr learned my addr 172.21.15.99:0/1244822066 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:09:28.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.963+0000 7f66f6800640 1 --2- 172.21.15.99:0/1244822066 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d81f7cf040 0x55d81f824720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:28.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.963+0000 7f66f5400640 1 -- 172.21.15.99:0/1244822066 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d81f7cf040 msgr2=0x55d81f824720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:09:28.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.963+0000 7f66f5400640 1 --2- 172.21.15.99:0/1244822066 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d81f7cf040 0x55d81f824720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.963+0000 7f66f5400640 1 -- 172.21.15.99:0/1244822066 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d81f7c4330 msgr2=0x55d81f753190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:09:28.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.963+0000 7f66f5400640 1 --2- 172.21.15.99:0/1244822066 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d81f7c4330 0x55d81f753190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.963+0000 7f66f5400640 1 -- 172.21.15.99:0/1244822066 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d81f4907d0 con 0x55d81f7c4cf0 2024-02-21T23:09:28.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.964+0000 7f66f5400640 1 --2- 172.21.15.99:0/1244822066 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d81f7c4cf0 0x55d81f7436b0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f66e4009770 tx=0x7f66e4097ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52541ff5d8ad7a28 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:09:28.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.964+0000 7f66e2000640 1 -- 172.21.15.99:0/1244822066 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e4021040 con 0x55d81f7c4cf0 2024-02-21T23:09:28.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.964+0000 7f66e2000640 1 -- 172.21.15.99:0/1244822066 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66e4094010 con 0x55d81f7c4cf0 2024-02-21T23:09:28.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.964+0000 7f66e2000640 1 -- 172.21.15.99:0/1244822066 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e40af380 con 0x55d81f7c4cf0 2024-02-21T23:09:28.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.965+0000 7f66ffe56740 1 -- 172.21.15.99:0/1244822066 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d81f7c4cf0 msgr2=0x55d81f7436b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:09:28.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.965+0000 7f66ffe56740 1 --2- 172.21.15.99:0/1244822066 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d81f7c4cf0 0x55d81f7436b0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f66e4009770 tx=0x7f66e4097ad0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.965+0000 7f66ffe56740 1 -- 172.21.15.99:0/1244822066 shutdown_connections 2024-02-21T23:09:28.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.965+0000 7f66ffe56740 1 --2- 172.21.15.99:0/1244822066 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d81f7cf040 0x55d81f824720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.965+0000 7f66ffe56740 1 --2- 172.21.15.99:0/1244822066 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d81f7c4cf0 0x55d81f7436b0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.965+0000 7f66ffe56740 1 --2- 172.21.15.99:0/1244822066 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d81f7c4330 0x55d81f753190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.965+0000 7f66ffe56740 1 -- 172.21.15.99:0/1244822066 >> 172.21.15.99:0/1244822066 conn(0x55d81f789660 msgr2=0x55d81f7cb750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:09:28.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.965+0000 7f66ffe56740 1 -- 172.21.15.99:0/1244822066 shutdown_connections 2024-02-21T23:09:28.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.965+0000 7f66ffe56740 1 -- 172.21.15.99:0/1244822066 wait complete. 2024-02-21T23:09:28.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.966+0000 7f66ffe56740 1 -- start start 2024-02-21T23:09:28.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.966+0000 7f66ffe56740 1 Processor -- start 2024-02-21T23:09:28.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.968+0000 7f66ffe56740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d81f7c4330 0x55d81f7bfaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:28.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.969+0000 7f66ffe56740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d81f7c4cf0 0x55d81f7ccc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:28.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.969+0000 7f66ffe56740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d81f7cf040 0x55d81f822a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:28.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.969+0000 7f66ffe56740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f8228f10 con 0x55d81f7c4cf0 2024-02-21T23:09:28.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.969+0000 7f66ffe56740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f822a170 con 0x55d81f7c4330 2024-02-21T23:09:28.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.969+0000 7f66ffe56740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f8229510 con 0x55d81f7cf040 2024-02-21T23:09:28.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.969+0000 7f66ffe56740 10 client.0 _ll_register_callbacks cb 0x7f66f0009e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:09:28.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.969+0000 7f66f5e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d81f7c4330 0x55d81f7bfaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:28.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.969+0000 7f66f5400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d81f7c4cf0 0x55d81f7ccc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:28.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.969+0000 7f66f5e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d81f7c4330 0x55d81f7bfaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:44296/0 (socket says 172.21.15.99:44296) 2024-02-21T23:09:28.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.969+0000 7f66f5e00640 1 -- 172.21.15.99:0/1025187878 learned_addr learned my addr 172.21.15.99:0/1025187878 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:09:28.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.969+0000 7f66f6800640 1 --2- 172.21.15.99:0/1025187878 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d81f7cf040 0x55d81f822a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:28.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.969+0000 7f66f5e00640 1 -- 172.21.15.99:0/1025187878 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d81f7cf040 msgr2=0x55d81f822a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:09:28.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.969+0000 7f66f5e00640 1 --2- 172.21.15.99:0/1025187878 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d81f7cf040 0x55d81f822a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.969+0000 7f66f5e00640 1 -- 172.21.15.99:0/1025187878 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d81f7c4cf0 msgr2=0x55d81f7ccc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:09:28.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.969+0000 7f66f5e00640 1 --2- 172.21.15.99:0/1025187878 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d81f7c4cf0 0x55d81f7ccc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.969+0000 7f66f5e00640 1 -- 172.21.15.99:0/1025187878 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d81f7c0030 con 0x55d81f7c4330 2024-02-21T23:09:28.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.969+0000 7f66f6800640 1 --2- 172.21.15.99:0/1025187878 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d81f7cf040 0x55d81f822a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:09:28.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.970+0000 7f66f5e00640 1 --2- 172.21.15.99:0/1025187878 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d81f7c4330 0x55d81f7bfaf0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f66e802bf30 tx=0x7f66e8004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f0d5c45d014a230e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:09:28.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.970+0000 7f66d7400640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-02-21T23:09:28.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.970+0000 7f66d7400640 1 -- 172.21.15.99:0/1025187878 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e8053040 con 0x55d81f7c4330 2024-02-21T23:09:28.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.970+0000 7f66d7400640 1 -- 172.21.15.99:0/1025187878 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f66e805e270 con 0x55d81f7c4330 2024-02-21T23:09:28.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.970+0000 7f66ffe56740 1 -- 172.21.15.99:0/1025187878 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f66e4094010 con 0x55d81f7c4330 2024-02-21T23:09:28.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.970+0000 7f66d7400640 1 -- 172.21.15.99:0/1025187878 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f66e806a050 con 0x55d81f7c4330 2024-02-21T23:09:28.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.970+0000 7f66ffe56740 10 client.6685 fetch_fsmap learned FSMap version 17 2024-02-21T23:09:28.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.970+0000 7f66ffe56740 1 -- 172.21.15.99:0/1025187878 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55d81f754260 con 0x55d81f7c4330 2024-02-21T23:09:28.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.971+0000 7f66d7400640 1 -- 172.21.15.99:0/1025187878 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66e4094010 con 0x55d81f7c4330 2024-02-21T23:09:28.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.971+0000 7f66d7400640 1 -- 172.21.15.99:0/1025187878 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f66e805e820 con 0x55d81f7c4330 2024-02-21T23:09:28.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.971+0000 7f66ffe56740 10 client.6685 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:09:28.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.971+0000 7f66ffe56740 10 client.6685 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:09:28.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.971+0000 7f66ffe56740 20 client.6685 populate_metadata read hostname 'smithi099' 2024-02-21T23:09:28.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.971+0000 7f66ffe56740 1 --2- 172.21.15.99:0/1025187878 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55d81f770900 0x55d81f822fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:28.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.971+0000 7f66ffe56740 4 client.6685 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T23:09:28.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.971+0000 7f66ffe56740 1 -- 172.21.15.99:0/1025187878 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55d81f78f1c0 con 0x55d81f770900 2024-02-21T23:09:28.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.971+0000 7f66f5400640 1 --2- 172.21.15.99:0/1025187878 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55d81f770900 0x55d81f822fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:28.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.972+0000 7f66f5400640 1 --2- 172.21.15.99:0/1025187878 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55d81f770900 0x55d81f822fb0 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6c8f9628db8363e server_cookie=cdfdf2737e7c93ac in_seq=0 out_seq=0 2024-02-21T23:09:28.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.972+0000 7f66d7400640 10 client.6685 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:09:28.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.973+0000 7f66d7400640 1 -- 172.21.15.99:0/1025187878 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55d81f78f1c0 con 0x55d81f770900 2024-02-21T23:09:28.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.973+0000 7f66d7400640 10 client.6685 handle_command_reply: tid=0 2024-02-21T23:09:28.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.973+0000 7f66ffe56740 1 client.6685 shutdown 2024-02-21T23:09:28.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.973+0000 7f66ffe56740 1 -- 172.21.15.99:0/1025187878 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d81f7c4330 msgr2=0x55d81f7bfaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:09:28.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.973+0000 7f66ffe56740 1 --2- 172.21.15.99:0/1025187878 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d81f7c4330 0x55d81f7bfaf0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f66e802bf30 tx=0x7f66e8004730 comp rx=0 tx=0).stop 2024-02-21T23:09:28.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.973+0000 7f66ffe56740 1 -- 172.21.15.99:0/1025187878 shutdown_connections 2024-02-21T23:09:28.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.973+0000 7f66ffe56740 1 --2- 172.21.15.99:0/1025187878 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55d81f770900 0x55d81f822fb0 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.973+0000 7f66ffe56740 1 --2- 172.21.15.99:0/1025187878 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d81f7cf040 0x55d81f822a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.973+0000 7f66ffe56740 1 --2- 172.21.15.99:0/1025187878 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d81f7c4cf0 0x55d81f7ccc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.973+0000 7f66d7400640 0 client.6685 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:09:28.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.973+0000 7f66ffe56740 1 --2- 172.21.15.99:0/1025187878 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d81f7c4330 0x55d81f7bfaf0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.973+0000 7f66ffe56740 1 -- 172.21.15.99:0/1025187878 >> 172.21.15.99:0/1025187878 conn(0x55d81f789660 msgr2=0x55d81f7cb670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:09:28.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.973+0000 7f66ffe56740 1 -- 172.21.15.99:0/1025187878 shutdown_connections 2024-02-21T23:09:28.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.973+0000 7f66ffe56740 1 -- 172.21.15.99:0/1025187878 wait complete. 2024-02-21T23:09:28.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.973+0000 7f66ffe56740 20 client.6685 trim_cache size 0 max 16384 2024-02-21T23:09:28.968 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-02-21T23:09:28.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.974+0000 7f66f7200640 1 -- 172.21.15.99:0/2275291748 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f66d809eed0 msgr2=0x7f66d80a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:09:28.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.974+0000 7f66f7200640 1 --2- 172.21.15.99:0/2275291748 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f66d809eed0 0x7f66d80a1390 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f66e8036000 tx=0x7f66e803c040 comp rx=0 tx=0).stop 2024-02-21T23:09:28.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.974+0000 7f66f7200640 1 -- 172.21.15.99:0/2275291748 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f66f818b060 msgr2=0x7f66f8220580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:09:28.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.974+0000 7f66f7200640 1 --2- 172.21.15.99:0/2275291748 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f66f818b060 0x7f66f8220580 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f66e400e8e0 tx=0x7f66e400eda0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.974+0000 7f66f7200640 1 -- 172.21.15.99:0/2275291748 shutdown_connections 2024-02-21T23:09:28.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.974+0000 7f66f7200640 1 --2- 172.21.15.99:0/2275291748 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f66d809eed0 0x7f66d80a1390 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.974+0000 7f66f7200640 1 --2- 172.21.15.99:0/2275291748 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66f818b4f0 0x7f66f8220ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.974+0000 7f66f7200640 1 --2- 172.21.15.99:0/2275291748 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f66f818b060 0x7f66f8220580 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.974+0000 7f66f7200640 1 --2- 172.21.15.99:0/2275291748 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f66f817f490 0x7f66f81757d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:28.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.974+0000 7f66f7200640 1 -- 172.21.15.99:0/2275291748 >> 172.21.15.99:0/2275291748 conn(0x7f66f80d29b0 msgr2=0x7f66f80d2eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:09:28.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.974+0000 7f66f7200640 1 -- 172.21.15.99:0/2275291748 shutdown_connections 2024-02-21T23:09:28.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:28.974+0000 7f66f7200640 1 -- 172.21.15.99:0/2275291748 wait complete. 2024-02-21T23:09:29.981 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-02-21T23:09:29.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T23:09:29.982 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-02-21T23:09:30.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.248+0000 7fa39f000640 1 Processor -- start 2024-02-21T23:09:30.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.248+0000 7fa39f000640 1 -- start start 2024-02-21T23:09:30.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.250+0000 7fa39f000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa39818b920 0x7fa3980d6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:30.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.250+0000 7fa39f000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa39818a5a0 con 0x7fa398189f40 2024-02-21T23:09:30.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.250+0000 7fa39f000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa39818a880 con 0x7fa39817f710 2024-02-21T23:09:30.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.250+0000 7fa39f000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa39818bd80 con 0x7fa39818b920 2024-02-21T23:09:30.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.250+0000 7fa39dc00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fa39817f710 0x7fa39815e490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.99:49992/0 (socket says 172.21.15.99:49992) 2024-02-21T23:09:30.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.250+0000 7fa39dc00640 1 -- 172.21.15.99:0/2711840818 learned_addr learned my addr 172.21.15.99:0/2711840818 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:09:30.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.250+0000 7fa39e600640 1 --2- 172.21.15.99:0/2711840818 >> v2:172.21.15.162:3300/0 conn(0x7fa39818b920 0x7fa3980d6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:30.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.251+0000 7fa397e00640 1 -- 172.21.15.99:0/2711840818 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1556491045 0 0) 0x7fa39818a880 con 0x7fa39817f710 2024-02-21T23:09:30.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.251+0000 7fa397e00640 1 -- 172.21.15.99:0/2711840818 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa380003520 con 0x7fa39817f710 2024-02-21T23:09:30.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.251+0000 7fa39e600640 1 -- 172.21.15.99:0/2711840818 >> v1:172.21.15.162:6789/0 conn(0x7fa39817f710 legacy=0x7fa39815e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:09:30.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.251+0000 7fa39e600640 1 -- 172.21.15.99:0/2711840818 >> v1:172.21.15.99:6789/0 conn(0x7fa398189f40 legacy=0x7fa398071c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:09:30.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.251+0000 7fa39e600640 1 -- 172.21.15.99:0/2711840818 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa39818ab60 con 0x7fa39818b920 2024-02-21T23:09:30.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.253+0000 7fa39e600640 1 --2- 172.21.15.99:0/2711840818 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa39818b920 0x7fa3980d6000 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fa390009d90 tx=0x7fa39002bf40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10b2481e8e70c718 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:09:30.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.253+0000 7fa397e00640 1 -- 172.21.15.99:0/2711840818 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa390039070 con 0x7fa39818b920 2024-02-21T23:09:30.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.253+0000 7fa397e00640 1 -- 172.21.15.99:0/2711840818 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa39002ccf0 con 0x7fa39818b920 2024-02-21T23:09:30.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.253+0000 7fa397e00640 1 -- 172.21.15.99:0/2711840818 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa390034660 con 0x7fa39818b920 2024-02-21T23:09:30.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.254+0000 7fa39f000640 1 -- 172.21.15.99:0/2711840818 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa39818b920 msgr2=0x7fa3980d6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:09:30.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.254+0000 7fa39f000640 1 --2- 172.21.15.99:0/2711840818 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa39818b920 0x7fa3980d6000 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fa390009d90 tx=0x7fa39002bf40 comp rx=0 tx=0).stop 2024-02-21T23:09:30.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.254+0000 7fa39f000640 1 -- 172.21.15.99:0/2711840818 shutdown_connections 2024-02-21T23:09:30.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.254+0000 7fa39f000640 1 --2- 172.21.15.99:0/2711840818 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa39818b920 0x7fa3980d6000 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:30.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.254+0000 7fa39f000640 1 -- 172.21.15.99:0/2711840818 >> 172.21.15.99:0/2711840818 conn(0x7fa3980fe310 msgr2=0x7fa3980fe720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:09:30.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.254+0000 7fa39f000640 1 -- 172.21.15.99:0/2711840818 shutdown_connections 2024-02-21T23:09:30.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.254+0000 7fa39f000640 1 -- 172.21.15.99:0/2711840818 wait complete. 2024-02-21T23:09:30.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.257+0000 7fa39f000640 1 Processor -- start 2024-02-21T23:09:30.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.258+0000 7fa39f000640 1 -- start start 2024-02-21T23:09:30.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.260+0000 7fa39f000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa39817f710 0x7fa39821c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:30.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.260+0000 7fa39f000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa398189f40 0x7fa3980cf660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:30.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.260+0000 7fa39f000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa39818b920 0x7fa3982216f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:30.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.260+0000 7fa39f000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa398072330 con 0x7fa39818b920 2024-02-21T23:09:30.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.260+0000 7fa39f000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa39818b120 con 0x7fa39817f710 2024-02-21T23:09:30.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.260+0000 7fa39f000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3980724b0 con 0x7fa398189f40 2024-02-21T23:09:30.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.260+0000 7fa39dc00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa39817f710 0x7fa39821c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:30.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.260+0000 7fa39e600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa39818b920 0x7fa3982216f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:30.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.260+0000 7fa39dc00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa39817f710 0x7fa39821c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:44316/0 (socket says 172.21.15.99:44316) 2024-02-21T23:09:30.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.260+0000 7fa39dc00640 1 -- 172.21.15.99:0/2108162976 learned_addr learned my addr 172.21.15.99:0/2108162976 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:09:30.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.260+0000 7fa39d200640 1 --2- 172.21.15.99:0/2108162976 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa398189f40 0x7fa3980cf660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:30.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.261+0000 7fa39dc00640 1 -- 172.21.15.99:0/2108162976 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa398189f40 msgr2=0x7fa3980cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:09:30.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.261+0000 7fa39dc00640 1 --2- 172.21.15.99:0/2108162976 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa398189f40 0x7fa3980cf660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:30.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.261+0000 7fa39dc00640 1 -- 172.21.15.99:0/2108162976 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa39818b920 msgr2=0x7fa3982216f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:09:30.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.261+0000 7fa39dc00640 1 --2- 172.21.15.99:0/2108162976 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa39818b920 0x7fa3982216f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:30.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.261+0000 7fa39dc00640 1 -- 172.21.15.99:0/2108162976 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa398220370 con 0x7fa39817f710 2024-02-21T23:09:30.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.261+0000 7fa39dc00640 1 --2- 172.21.15.99:0/2108162976 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa39817f710 0x7fa39821c9f0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fa38c00c410 tx=0x7fa38c00c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:09:30.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.261+0000 7fa395600640 1 -- 172.21.15.99:0/2108162976 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38c017070 con 0x7fa39817f710 2024-02-21T23:09:30.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.261+0000 7fa395600640 1 -- 172.21.15.99:0/2108162976 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa38c005ce0 con 0x7fa39817f710 2024-02-21T23:09:30.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.261+0000 7fa39f000640 1 -- 172.21.15.99:0/2108162976 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa398220650 con 0x7fa39817f710 2024-02-21T23:09:30.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.261+0000 7fa395600640 1 -- 172.21.15.99:0/2108162976 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38c0072f0 con 0x7fa39817f710 2024-02-21T23:09:30.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.262+0000 7fa39f000640 1 -- 172.21.15.99:0/2108162976 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa398220c10 con 0x7fa39817f710 2024-02-21T23:09:30.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.265+0000 7fa395600640 1 -- 172.21.15.99:0/2108162976 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7fa38c01a070 con 0x7fa39817f710 2024-02-21T23:09:30.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.266+0000 7fa395600640 1 --2- 172.21.15.99:0/2108162976 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa37809eed0 0x7fa3780a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:30.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.266+0000 7fa395600640 1 -- 172.21.15.99:0/2108162976 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 8877+0+0 (secure 0 0 0) 0x7fa38c0c9310 con 0x7fa39817f710 2024-02-21T23:09:30.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.267+0000 7fa39d200640 1 --2- 172.21.15.99:0/2108162976 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa37809eed0 0x7fa3780a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:30.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.267+0000 7fa3a3617740 1 Processor -- start 2024-02-21T23:09:30.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.267+0000 7fa39d200640 1 --2- 172.21.15.99:0/2108162976 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa37809eed0 0x7fa3780a1390 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa3980d26e0 tx=0x7fa384009040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:09:30.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.267+0000 7fa3a3617740 1 -- start start 2024-02-21T23:09:30.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.269+0000 7fa3a3617740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ed22c854c0 0x55ed22c858a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:30.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.269+0000 7fa3a3617740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ed22c85de0 0x55ed22cc0650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:30.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.269+0000 7fa3a3617740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ed22cc0b90 0x55ed22cc1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:30.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.269+0000 7fa3a3617740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed22bad790 con 0x55ed22c854c0 2024-02-21T23:09:30.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.269+0000 7fa3a3617740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed22b56bf0 con 0x55ed22cc0b90 2024-02-21T23:09:30.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.269+0000 7fa3a3617740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed22ba9830 con 0x55ed22c85de0 2024-02-21T23:09:30.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.270+0000 7fa39dc00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ed22c854c0 0x55ed22c858a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:30.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.270+0000 7fa39dc00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ed22c854c0 0x55ed22c858a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42674/0 (socket says 172.21.15.99:42674) 2024-02-21T23:09:30.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.270+0000 7fa39dc00640 1 -- 172.21.15.99:0/601965254 learned_addr learned my addr 172.21.15.99:0/601965254 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:09:30.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.270+0000 7fa39d200640 1 --2- 172.21.15.99:0/601965254 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ed22c85de0 0x55ed22cc0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:30.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.270+0000 7fa39e600640 1 --2- 172.21.15.99:0/601965254 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ed22cc0b90 0x55ed22cc1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:30.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.270+0000 7fa39dc00640 1 -- 172.21.15.99:0/601965254 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ed22c85de0 msgr2=0x55ed22cc0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:09:30.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.270+0000 7fa39dc00640 1 --2- 172.21.15.99:0/601965254 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ed22c85de0 0x55ed22cc0650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:30.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.270+0000 7fa39dc00640 1 -- 172.21.15.99:0/601965254 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ed22cc0b90 msgr2=0x55ed22cc1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:09:30.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.270+0000 7fa39dc00640 1 --2- 172.21.15.99:0/601965254 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ed22cc0b90 0x55ed22cc1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:30.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.270+0000 7fa39dc00640 1 -- 172.21.15.99:0/601965254 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ed22b74c40 con 0x55ed22c854c0 2024-02-21T23:09:30.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.270+0000 7fa39dc00640 1 --2- 172.21.15.99:0/601965254 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ed22c854c0 0x55ed22c858a0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fa38c0070a0 tx=0x7fa38c0c9200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2a6c2ce39e763c2 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:09:30.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.271+0000 7fa38a000640 1 -- 172.21.15.99:0/601965254 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38c0c6b20 con 0x55ed22c854c0 2024-02-21T23:09:30.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.271+0000 7fa38a000640 1 -- 172.21.15.99:0/601965254 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa38c093280 con 0x55ed22c854c0 2024-02-21T23:09:30.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.271+0000 7fa38a000640 1 -- 172.21.15.99:0/601965254 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38c0aadf0 con 0x55ed22c854c0 2024-02-21T23:09:30.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.271+0000 7fa3a3617740 1 -- 172.21.15.99:0/601965254 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ed22c854c0 msgr2=0x55ed22c858a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:09:30.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.271+0000 7fa3a3617740 1 --2- 172.21.15.99:0/601965254 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ed22c854c0 0x55ed22c858a0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fa38c0070a0 tx=0x7fa38c0c9200 comp rx=0 tx=0).stop 2024-02-21T23:09:30.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.271+0000 7fa3a3617740 1 -- 172.21.15.99:0/601965254 shutdown_connections 2024-02-21T23:09:30.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.271+0000 7fa3a3617740 1 --2- 172.21.15.99:0/601965254 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ed22cc0b90 0x55ed22cc1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:30.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.271+0000 7fa3a3617740 1 --2- 172.21.15.99:0/601965254 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ed22c85de0 0x55ed22cc0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:30.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.271+0000 7fa3a3617740 1 --2- 172.21.15.99:0/601965254 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ed22c854c0 0x55ed22c858a0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:30.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.271+0000 7fa3a3617740 1 -- 172.21.15.99:0/601965254 >> 172.21.15.99:0/601965254 conn(0x55ed22c47a90 msgr2=0x55ed22c48b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:09:30.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.272+0000 7fa3a3617740 1 -- 172.21.15.99:0/601965254 shutdown_connections 2024-02-21T23:09:30.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.272+0000 7fa3a3617740 1 -- 172.21.15.99:0/601965254 wait complete. 2024-02-21T23:09:30.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.272+0000 7fa3a3617740 1 -- start start 2024-02-21T23:09:30.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.273+0000 7fa3a3617740 1 Processor -- start 2024-02-21T23:09:30.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.274+0000 7fa3a3617740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ed22c85de0 0x55ed22c7c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:30.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.274+0000 7fa3a3617740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ed22cc0b90 0x55ed22ccbad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:30.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.274+0000 7fa3a3617740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ed22c76d50 0x55ed22c7cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:30.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.274+0000 7fa3a3617740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed22cbf070 con 0x55ed22c76d50 2024-02-21T23:09:30.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.274+0000 7fa3a3617740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed22b4c1d0 con 0x55ed22cc0b90 2024-02-21T23:09:30.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.274+0000 7fa3a3617740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed22cbf350 con 0x55ed22c85de0 2024-02-21T23:09:30.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.274+0000 7fa3a3617740 10 client.0 _ll_register_callbacks cb 0x55ed228c1c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:09:30.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.274+0000 7fa39d200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ed22cc0b90 0x55ed22ccbad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:30.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.274+0000 7fa39dc00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ed22c85de0 0x55ed22c7c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:30.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.274+0000 7fa39d200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ed22cc0b90 0x55ed22ccbad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:44328/0 (socket says 172.21.15.99:44328) 2024-02-21T23:09:30.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.274+0000 7fa39d200640 1 -- 172.21.15.99:0/2454212596 learned_addr learned my addr 172.21.15.99:0/2454212596 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:09:30.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.274+0000 7fa39e600640 1 --2- 172.21.15.99:0/2454212596 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ed22c76d50 0x55ed22c7cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:30.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.275+0000 7fa39d200640 1 -- 172.21.15.99:0/2454212596 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ed22c85de0 msgr2=0x55ed22c7c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:09:30.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.275+0000 7fa39d200640 1 --2- 172.21.15.99:0/2454212596 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ed22c85de0 0x55ed22c7c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:30.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.275+0000 7fa39d200640 1 -- 172.21.15.99:0/2454212596 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ed22c76d50 msgr2=0x55ed22c7cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:09:30.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.275+0000 7fa39d200640 1 --2- 172.21.15.99:0/2454212596 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ed22c76d50 0x55ed22c7cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:30.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.275+0000 7fa39d200640 1 -- 172.21.15.99:0/2454212596 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ed2298a7e0 con 0x55ed22cc0b90 2024-02-21T23:09:30.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.275+0000 7fa39d200640 1 --2- 172.21.15.99:0/2454212596 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ed22cc0b90 0x55ed22ccbad0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fa384006ae0 tx=0x7fa384000ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5b0131c1eafa1a6 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:09:30.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.275+0000 7fa37ea00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-02-21T23:09:30.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.275+0000 7fa37ea00640 1 -- 172.21.15.99:0/2454212596 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa384021410 con 0x55ed22cc0b90 2024-02-21T23:09:30.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.275+0000 7fa3a3617740 1 -- 172.21.15.99:0/2454212596 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa38c093280 con 0x55ed22cc0b90 2024-02-21T23:09:30.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.275+0000 7fa37ea00640 1 -- 172.21.15.99:0/2454212596 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8877+0+0 (secure 0 0 0) 0x7fa3840215b0 con 0x55ed22cc0b90 2024-02-21T23:09:30.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.276+0000 7fa37ea00640 1 -- 172.21.15.99:0/2454212596 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa38402f050 con 0x55ed22cc0b90 2024-02-21T23:09:30.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.276+0000 7fa3a3617740 10 client.6700 fetch_fsmap learned FSMap version 17 2024-02-21T23:09:30.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.276+0000 7fa3a3617740 1 -- 172.21.15.99:0/2454212596 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55ed229eaf70 con 0x55ed22cc0b90 2024-02-21T23:09:30.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.276+0000 7fa37ea00640 1 -- 172.21.15.99:0/2454212596 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa38c093280 con 0x55ed22cc0b90 2024-02-21T23:09:30.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.276+0000 7fa37ea00640 1 -- 172.21.15.99:0/2454212596 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fa3840217b0 con 0x55ed22cc0b90 2024-02-21T23:09:30.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.276+0000 7fa3a3617740 10 client.6700 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:09:30.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.276+0000 7fa3a3617740 10 client.6700 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:09:30.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.276+0000 7fa3a3617740 20 client.6700 populate_metadata read hostname 'smithi099' 2024-02-21T23:09:30.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.276+0000 7fa3a3617740 1 --2- 172.21.15.99:0/2454212596 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55ed22ccd370 0x55ed22ccd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:30.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.276+0000 7fa3a3617740 4 client.6700 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:09:30.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.276+0000 7fa3a3617740 1 -- 172.21.15.99:0/2454212596 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ed22bbacd0 con 0x55ed22ccd370 2024-02-21T23:09:30.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.277+0000 7fa39dc00640 1 --2- 172.21.15.99:0/2454212596 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55ed22ccd370 0x55ed22ccd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:30.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.277+0000 7fa37ea00640 10 client.6700 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:09:30.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.277+0000 7fa39dc00640 1 --2- 172.21.15.99:0/2454212596 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55ed22ccd370 0x55ed22ccd780 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=754512b53e8c0980 server_cookie=1af50b3a2f948bb7 in_seq=0 out_seq=0 2024-02-21T23:09:30.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.278+0000 7fa37ea00640 1 -- 172.21.15.99:0/2454212596 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55ed22bbacd0 con 0x55ed22ccd370 2024-02-21T23:09:30.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.278+0000 7fa37ea00640 10 client.6700 handle_command_reply: tid=0 2024-02-21T23:09:30.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.278+0000 7fa3a3617740 1 client.6700 shutdown 2024-02-21T23:09:30.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.278+0000 7fa3a3617740 1 -- 172.21.15.99:0/2454212596 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ed22cc0b90 msgr2=0x55ed22ccbad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:09:30.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.278+0000 7fa3a3617740 1 --2- 172.21.15.99:0/2454212596 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ed22cc0b90 0x55ed22ccbad0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fa384006ae0 tx=0x7fa384000ed0 comp rx=0 tx=0).stop 2024-02-21T23:09:30.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.278+0000 7fa3a3617740 1 -- 172.21.15.99:0/2454212596 shutdown_connections 2024-02-21T23:09:30.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.278+0000 7fa3a3617740 1 --2- 172.21.15.99:0/2454212596 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55ed22ccd370 0x55ed22ccd780 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:30.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.278+0000 7fa3a3617740 1 --2- 172.21.15.99:0/2454212596 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ed22c76d50 0x55ed22c7cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:30.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.278+0000 7fa3a3617740 1 --2- 172.21.15.99:0/2454212596 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ed22cc0b90 0x55ed22ccbad0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:30.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.278+0000 7fa3a3617740 1 --2- 172.21.15.99:0/2454212596 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ed22c85de0 0x55ed22c7c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:30.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.278+0000 7fa37ea00640 0 client.6700 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:09:30.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.278+0000 7fa3a3617740 1 -- 172.21.15.99:0/2454212596 >> 172.21.15.99:0/2454212596 conn(0x55ed22c854c0 msgr2=0x55ed22cc0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:09:30.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.279+0000 7fa3a3617740 1 -- 172.21.15.99:0/2454212596 shutdown_connections 2024-02-21T23:09:30.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.279+0000 7fa3a3617740 1 -- 172.21.15.99:0/2454212596 wait complete. 2024-02-21T23:09:30.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.279+0000 7fa3a3617740 20 client.6700 trim_cache size 0 max 16384 2024-02-21T23:09:30.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.297+0000 7fa3a3617740 1 Processor -- start 2024-02-21T23:09:30.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.297+0000 7fa3a3617740 1 -- start start 2024-02-21T23:09:30.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.299+0000 7fa3a3617740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ed22c76d50 0x55ed22c7c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:30.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.299+0000 7fa3a3617740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ed22c85de0 0x55ed22cbcb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:30.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.299+0000 7fa3a3617740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ed22cc0b90 0x55ed22c47160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:30.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.299+0000 7fa3a3617740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa39822cb20 con 0x55ed22cc0b90 2024-02-21T23:09:30.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.299+0000 7fa3a3617740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa39822a6c0 con 0x55ed22c85de0 2024-02-21T23:09:30.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.299+0000 7fa3a3617740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa398228780 con 0x55ed22c76d50 2024-02-21T23:09:30.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.300+0000 7fa39d200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ed22c85de0 0x55ed22cbcb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:30.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.300+0000 7fa39e600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ed22cc0b90 0x55ed22c47160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:30.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.300+0000 7fa39dc00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ed22c76d50 0x55ed22c7c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:30.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.300+0000 7fa39d200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ed22c85de0 0x55ed22cbcb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:44340/0 (socket says 172.21.15.99:44340) 2024-02-21T23:09:30.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.300+0000 7fa39d200640 1 -- 172.21.15.99:0/51604834 learned_addr learned my addr 172.21.15.99:0/51604834 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:09:30.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.300+0000 7fa39d200640 1 -- 172.21.15.99:0/51604834 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ed22c76d50 msgr2=0x55ed22c7c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:09:30.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.300+0000 7fa39d200640 1 --2- 172.21.15.99:0/51604834 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ed22c76d50 0x55ed22c7c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:30.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.300+0000 7fa39d200640 1 -- 172.21.15.99:0/51604834 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ed22cc0b90 msgr2=0x55ed22c47160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:09:30.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.300+0000 7fa39d200640 1 --2- 172.21.15.99:0/51604834 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ed22cc0b90 0x55ed22c47160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:30.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.300+0000 7fa39d200640 1 -- 172.21.15.99:0/51604834 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ed22c85c10 con 0x55ed22c85de0 2024-02-21T23:09:30.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.300+0000 7fa39dc00640 1 --2- 172.21.15.99:0/51604834 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ed22c76d50 0x55ed22c7c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:09:30.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.300+0000 7fa39d200640 1 --2- 172.21.15.99:0/51604834 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ed22c85de0 0x55ed22cbcb70 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fa384007400 tx=0x7fa384021000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc606ff44d2e4f30 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:09:30.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.301+0000 7fa389600640 1 -- 172.21.15.99:0/51604834 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa384021610 con 0x55ed22c85de0 2024-02-21T23:09:30.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.301+0000 7fa389600640 1 -- 172.21.15.99:0/51604834 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa384038030 con 0x55ed22c85de0 2024-02-21T23:09:30.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.301+0000 7fa389600640 1 -- 172.21.15.99:0/51604834 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa384007740 con 0x55ed22c85de0 2024-02-21T23:09:30.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.301+0000 7fa3a3617740 1 -- 172.21.15.99:0/51604834 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ed22c85de0 msgr2=0x55ed22cbcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:09:30.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.301+0000 7fa3a3617740 1 --2- 172.21.15.99:0/51604834 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ed22c85de0 0x55ed22cbcb70 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fa384007400 tx=0x7fa384021000 comp rx=0 tx=0).stop 2024-02-21T23:09:30.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.301+0000 7fa3a3617740 1 -- 172.21.15.99:0/51604834 shutdown_connections 2024-02-21T23:09:30.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.301+0000 7fa3a3617740 1 --2- 172.21.15.99:0/51604834 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ed22cc0b90 0x55ed22c47160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:30.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.301+0000 7fa3a3617740 1 --2- 172.21.15.99:0/51604834 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ed22c85de0 0x55ed22cbcb70 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:30.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.301+0000 7fa3a3617740 1 --2- 172.21.15.99:0/51604834 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ed22c76d50 0x55ed22c7c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:30.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.301+0000 7fa3a3617740 1 -- 172.21.15.99:0/51604834 >> 172.21.15.99:0/51604834 conn(0x55ed22c854c0 msgr2=0x55ed22ccc040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:09:30.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.302+0000 7fa3a3617740 1 -- 172.21.15.99:0/51604834 shutdown_connections 2024-02-21T23:09:30.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.302+0000 7fa3a3617740 1 -- 172.21.15.99:0/51604834 wait complete. 2024-02-21T23:09:30.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.302+0000 7fa3a3617740 1 -- start start 2024-02-21T23:09:30.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.302+0000 7fa3a3617740 1 Processor -- start 2024-02-21T23:09:30.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.304+0000 7fa3a3617740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ed22c76d50 0x55ed22d26dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:30.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.304+0000 7fa3a3617740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ed22c85de0 0x55ed22cbe8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:30.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.304+0000 7fa3a3617740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ed22cc0b90 0x55ed22cb53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:30.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.304+0000 7fa3a3617740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa398228d80 con 0x55ed22cc0b90 2024-02-21T23:09:30.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.304+0000 7fa3a3617740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa39822a060 con 0x55ed22c76d50 2024-02-21T23:09:30.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.304+0000 7fa3a3617740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3982293a0 con 0x55ed22c85de0 2024-02-21T23:09:30.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.304+0000 7fa3a3617740 10 client.0 _ll_register_callbacks cb 0x7fa384001c90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:09:30.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.304+0000 7fa39dc00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ed22c76d50 0x55ed22d26dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:30.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.304+0000 7fa39dc00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ed22c76d50 0x55ed22d26dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:44352/0 (socket says 172.21.15.99:44352) 2024-02-21T23:09:30.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.304+0000 7fa39dc00640 1 -- 172.21.15.99:0/1476951804 learned_addr learned my addr 172.21.15.99:0/1476951804 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:09:30.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.304+0000 7fa39e600640 1 --2- 172.21.15.99:0/1476951804 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ed22cc0b90 0x55ed22cb53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:30.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.304+0000 7fa39d200640 1 --2- 172.21.15.99:0/1476951804 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ed22c85de0 0x55ed22cbe8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:30.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.304+0000 7fa39dc00640 1 -- 172.21.15.99:0/1476951804 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ed22c85de0 msgr2=0x55ed22cbe8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:09:30.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.304+0000 7fa39dc00640 1 --2- 172.21.15.99:0/1476951804 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ed22c85de0 0x55ed22cbe8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:30.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.304+0000 7fa39dc00640 1 -- 172.21.15.99:0/1476951804 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ed22cc0b90 msgr2=0x55ed22cb53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:09:30.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.304+0000 7fa39dc00640 1 --2- 172.21.15.99:0/1476951804 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ed22cc0b90 0x55ed22cb53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:30.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.304+0000 7fa39dc00640 1 -- 172.21.15.99:0/1476951804 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ed22882170 con 0x55ed22c76d50 2024-02-21T23:09:30.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.304+0000 7fa39e600640 1 --2- 172.21.15.99:0/1476951804 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ed22cc0b90 0x55ed22cb53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:09:30.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.305+0000 7fa39dc00640 1 --2- 172.21.15.99:0/1476951804 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ed22c76d50 0x55ed22d26dc0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fa38c096910 tx=0x7fa38c01e070 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83d4e3260bc86dc1 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:09:30.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.305+0000 7fa37ea00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-02-21T23:09:30.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.305+0000 7fa37ea00640 1 -- 172.21.15.99:0/1476951804 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38c0969e0 con 0x55ed22c76d50 2024-02-21T23:09:30.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.305+0000 7fa37ea00640 1 -- 172.21.15.99:0/1476951804 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8877+0+0 (secure 0 0 0) 0x7fa38c0c6150 con 0x55ed22c76d50 2024-02-21T23:09:30.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.305+0000 7fa3a3617740 1 -- 172.21.15.99:0/1476951804 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa384038030 con 0x55ed22c76d50 2024-02-21T23:09:30.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.305+0000 7fa37ea00640 1 -- 172.21.15.99:0/1476951804 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa38c0c6b20 con 0x55ed22c76d50 2024-02-21T23:09:30.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.305+0000 7fa3a3617740 10 client.6706 fetch_fsmap learned FSMap version 17 2024-02-21T23:09:30.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.305+0000 7fa3a3617740 1 -- 172.21.15.99:0/1476951804 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55ed22cae140 con 0x55ed22c76d50 2024-02-21T23:09:30.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.305+0000 7fa37ea00640 1 -- 172.21.15.99:0/1476951804 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa384038030 con 0x55ed22c76d50 2024-02-21T23:09:30.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.306+0000 7fa37ea00640 1 -- 172.21.15.99:0/1476951804 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fa38c0aabb0 con 0x55ed22c76d50 2024-02-21T23:09:30.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.306+0000 7fa3a3617740 10 client.6706 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:09:30.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.306+0000 7fa3a3617740 10 client.6706 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:09:30.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.306+0000 7fa3a3617740 20 client.6706 populate_metadata read hostname 'smithi099' 2024-02-21T23:09:30.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.306+0000 7fa3a3617740 1 --2- 172.21.15.99:0/1476951804 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55ed22c49780 0x55ed22c43140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:30.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.306+0000 7fa3a3617740 4 client.6706 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-02-21T23:09:30.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.306+0000 7fa3a3617740 1 -- 172.21.15.99:0/1476951804 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55ed22c481f0 con 0x55ed22c49780 2024-02-21T23:09:30.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.306+0000 7fa39d200640 1 --2- 172.21.15.99:0/1476951804 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55ed22c49780 0x55ed22c43140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:30.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.307+0000 7fa37ea00640 10 client.6706 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:09:30.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.307+0000 7fa39d200640 1 --2- 172.21.15.99:0/1476951804 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55ed22c49780 0x55ed22c43140 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d95478470bfd9cc server_cookie=3c1e8760001a02b7 in_seq=0 out_seq=0 2024-02-21T23:09:30.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.308+0000 7fa37ea00640 1 -- 172.21.15.99:0/1476951804 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55ed22c481f0 con 0x55ed22c49780 2024-02-21T23:09:30.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.308+0000 7fa37ea00640 10 client.6706 handle_command_reply: tid=0 2024-02-21T23:09:30.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.308+0000 7fa3a3617740 1 client.6706 shutdown 2024-02-21T23:09:30.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.308+0000 7fa3a3617740 1 -- 172.21.15.99:0/1476951804 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ed22c76d50 msgr2=0x55ed22d26dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:09:30.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.308+0000 7fa3a3617740 1 --2- 172.21.15.99:0/1476951804 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ed22c76d50 0x55ed22d26dc0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fa38c096910 tx=0x7fa38c01e070 comp rx=0 tx=0).stop 2024-02-21T23:09:30.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.309+0000 7fa3a3617740 1 -- 172.21.15.99:0/1476951804 shutdown_connections 2024-02-21T23:09:30.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.309+0000 7fa3a3617740 1 --2- 172.21.15.99:0/1476951804 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55ed22c49780 0x55ed22c43140 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:30.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.309+0000 7fa3a3617740 1 --2- 172.21.15.99:0/1476951804 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55ed22cc0b90 0x55ed22cb53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:30.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.309+0000 7fa3a3617740 1 --2- 172.21.15.99:0/1476951804 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55ed22c85de0 0x55ed22cbe8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:30.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.309+0000 7fa3a3617740 1 --2- 172.21.15.99:0/1476951804 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ed22c76d50 0x55ed22d26dc0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:30.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.309+0000 7fa37ea00640 0 client.6706 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:09:30.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.309+0000 7fa3a3617740 1 -- 172.21.15.99:0/1476951804 >> 172.21.15.99:0/1476951804 conn(0x55ed22c854c0 msgr2=0x55ed22c7ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:09:30.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.309+0000 7fa3a3617740 1 -- 172.21.15.99:0/1476951804 shutdown_connections 2024-02-21T23:09:30.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.309+0000 7fa3a3617740 1 -- 172.21.15.99:0/1476951804 wait complete. 2024-02-21T23:09:30.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.309+0000 7fa3a3617740 20 client.6706 trim_cache size 0 max 16384 2024-02-21T23:09:30.303 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-02-21T23:09:30.303 INFO:teuthology.orchestra.run.smithi099.stdout: "return_code": 0, 2024-02-21T23:09:30.303 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_tag": "fd0ab1b3-7c87-4cbc-8ef4-f2eca74d5f2e", 2024-02-21T23:09:30.303 INFO:teuthology.orchestra.run.smithi099.stdout: "mode": "asynchronous" 2024-02-21T23:09:30.303 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-02-21T23:09:30.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.310+0000 7fa39f000640 1 -- 172.21.15.99:0/2108162976 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa37809eed0 msgr2=0x7fa3780a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:09:30.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.310+0000 7fa39f000640 1 --2- 172.21.15.99:0/2108162976 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa37809eed0 0x7fa3780a1390 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa3980d26e0 tx=0x7fa384009040 comp rx=0 tx=0).stop 2024-02-21T23:09:30.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.310+0000 7fa39f000640 1 -- 172.21.15.99:0/2108162976 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa39817f710 msgr2=0x7fa39821c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:09:30.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.310+0000 7fa39f000640 1 --2- 172.21.15.99:0/2108162976 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa39817f710 0x7fa39821c9f0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fa38c00c410 tx=0x7fa38c00c8d0 comp rx=0 tx=0).stop 2024-02-21T23:09:30.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.310+0000 7fa39f000640 1 -- 172.21.15.99:0/2108162976 shutdown_connections 2024-02-21T23:09:30.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.310+0000 7fa39f000640 1 --2- 172.21.15.99:0/2108162976 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa37809eed0 0x7fa3780a1390 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:30.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.311+0000 7fa39f000640 1 --2- 172.21.15.99:0/2108162976 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa39818b920 0x7fa3982216f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:30.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.311+0000 7fa39f000640 1 --2- 172.21.15.99:0/2108162976 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa398189f40 0x7fa3980cf660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:30.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.311+0000 7fa39f000640 1 --2- 172.21.15.99:0/2108162976 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa39817f710 0x7fa39821c9f0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:30.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.311+0000 7fa39f000640 1 -- 172.21.15.99:0/2108162976 >> 172.21.15.99:0/2108162976 conn(0x7fa3980fe310 msgr2=0x7fa398071c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:09:30.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.311+0000 7fa39f000640 1 -- 172.21.15.99:0/2108162976 shutdown_connections 2024-02-21T23:09:30.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.311+0000 7fa39f000640 1 -- 172.21.15.99:0/2108162976 wait complete. 2024-02-21T23:09:30.325 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T23:09:30.325 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T23:09:30.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.611+0000 7f46ea400640 1 Processor -- start 2024-02-21T23:09:30.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.611+0000 7f46ea400640 1 -- start start 2024-02-21T23:09:30.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.613+0000 7f46ea400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f46e417f490 0x7f46e418ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:30.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.614+0000 7f46ea400640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46e40d6dd0 con 0x7f46e418b060 2024-02-21T23:09:30.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.614+0000 7f46ea400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46e41614c0 con 0x7f46e418b4f0 2024-02-21T23:09:30.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.614+0000 7f46ea400640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46e40d6810 con 0x7f46e417f490 2024-02-21T23:09:30.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.614+0000 7f46e9000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f46e417f490 0x7f46e418ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:30.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.614+0000 7f46e9000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f46e417f490 0x7f46e418ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:44354/0 (socket says 172.21.15.99:44354) 2024-02-21T23:09:30.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.614+0000 7f46e9000640 1 -- 172.21.15.99:0/4124765644 learned_addr learned my addr 172.21.15.99:0/4124765644 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:09:30.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.614+0000 7f46e9a00640 1 --1- 172.21.15.99:0/4124765644 >> v1:172.21.15.162:6789/0 conn(0x7f46e418b4f0 0x7f46e4189150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.99:50004/0 (socket says 172.21.15.99:50004) 2024-02-21T23:09:30.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.614+0000 7f46e9000640 1 -- 172.21.15.99:0/4124765644 >> v1:172.21.15.162:6789/0 conn(0x7f46e418b4f0 legacy=0x7f46e4189150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:09:30.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.614+0000 7f46e3400640 1 -- 172.21.15.99:0/4124765644 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3619799088 0 0) 0x7f46e41614c0 con 0x7f46e418b4f0 2024-02-21T23:09:30.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.615+0000 7f46e9000640 1 -- 172.21.15.99:0/4124765644 >> v1:172.21.15.99:6789/0 conn(0x7f46e418b060 legacy=0x7f46e4188a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:09:30.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.615+0000 7f46e9000640 1 -- 172.21.15.99:0/4124765644 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46e40d6af0 con 0x7f46e417f490 2024-02-21T23:09:30.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.616+0000 7f46e9000640 1 --2- 172.21.15.99:0/4124765644 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46e417f490 0x7f46e418ab20 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f46d8009870 tx=0x7f46d802b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a41befc5bbd1922 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:09:30.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.617+0000 7f46e3400640 1 -- 172.21.15.99:0/4124765644 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d8034070 con 0x7f46e417f490 2024-02-21T23:09:30.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.617+0000 7f46e3400640 1 -- 172.21.15.99:0/4124765644 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46d8030860 con 0x7f46e417f490 2024-02-21T23:09:30.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.617+0000 7f46e3400640 1 -- 172.21.15.99:0/4124765644 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d8030c30 con 0x7f46e417f490 2024-02-21T23:09:30.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.617+0000 7f46ea400640 1 -- 172.21.15.99:0/4124765644 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46e417f490 msgr2=0x7f46e418ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:09:30.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.617+0000 7f46ea400640 1 --2- 172.21.15.99:0/4124765644 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46e417f490 0x7f46e418ab20 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f46d8009870 tx=0x7f46d802b9a0 comp rx=0 tx=0).stop 2024-02-21T23:09:30.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.618+0000 7f46ea400640 1 -- 172.21.15.99:0/4124765644 shutdown_connections 2024-02-21T23:09:30.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.618+0000 7f46ea400640 1 --2- 172.21.15.99:0/4124765644 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46e417f490 0x7f46e418ab20 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:30.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.618+0000 7f46ea400640 1 -- 172.21.15.99:0/4124765644 >> 172.21.15.99:0/4124765644 conn(0x7f46e40d29b0 msgr2=0x7f46e40d2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:09:30.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.618+0000 7f46ea400640 1 -- 172.21.15.99:0/4124765644 shutdown_connections 2024-02-21T23:09:30.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.618+0000 7f46ea400640 1 -- 172.21.15.99:0/4124765644 wait complete. 2024-02-21T23:09:30.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.620+0000 7f46ea400640 1 Processor -- start 2024-02-21T23:09:30.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.621+0000 7f46ea400640 1 -- start start 2024-02-21T23:09:30.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.622+0000 7f46ea400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f46e417f490 0x7f46e4181980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:30.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.622+0000 7f46ea400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46e418b060 0x7f46e415ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:30.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.622+0000 7f46ea400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f46e418b4f0 0x7f46e4214db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:30.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.622+0000 7f46ea400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e418a600 con 0x7f46e417f490 2024-02-21T23:09:30.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.622+0000 7f46ea400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e418a320 con 0x7f46e418b060 2024-02-21T23:09:30.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.622+0000 7f46ea400640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e417f870 con 0x7f46e418b4f0 2024-02-21T23:09:30.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.623+0000 7f46e3e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46e418b060 0x7f46e415ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:30.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.623+0000 7f46e3e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46e418b060 0x7f46e415ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:44358/0 (socket says 172.21.15.99:44358) 2024-02-21T23:09:30.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.623+0000 7f46e3e00640 1 -- 172.21.15.99:0/2843136427 learned_addr learned my addr 172.21.15.99:0/2843136427 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:09:30.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.623+0000 7f46e9a00640 1 --2- 172.21.15.99:0/2843136427 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f46e418b4f0 0x7f46e4214db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:30.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.623+0000 7f46e9000640 1 --2- 172.21.15.99:0/2843136427 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f46e417f490 0x7f46e4181980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:30.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.624+0000 7f46e9a00640 1 -- 172.21.15.99:0/2843136427 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46e418b060 msgr2=0x7f46e415ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:09:30.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.624+0000 7f46e9a00640 1 --2- 172.21.15.99:0/2843136427 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46e418b060 0x7f46e415ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:30.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.624+0000 7f46e9a00640 1 -- 172.21.15.99:0/2843136427 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f46e417f490 msgr2=0x7f46e4181980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:09:30.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.624+0000 7f46e9a00640 1 --2- 172.21.15.99:0/2843136427 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f46e417f490 0x7f46e4181980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:30.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.624+0000 7f46e9a00640 1 -- 172.21.15.99:0/2843136427 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46e4182430 con 0x7f46e418b4f0 2024-02-21T23:09:30.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.624+0000 7f46e9a00640 1 --2- 172.21.15.99:0/2843136427 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f46e418b4f0 0x7f46e4214db0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f46dc00c780 tx=0x7f46dc00cc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:09:30.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.625+0000 7f46e0c00640 1 -- 172.21.15.99:0/2843136427 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46dc018070 con 0x7f46e418b4f0 2024-02-21T23:09:30.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.625+0000 7f46e0c00640 1 -- 172.21.15.99:0/2843136427 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46dc004d60 con 0x7f46e418b4f0 2024-02-21T23:09:30.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.625+0000 7f46e0c00640 1 -- 172.21.15.99:0/2843136427 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46dc00a880 con 0x7f46e418b4f0 2024-02-21T23:09:30.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.625+0000 7f46ea400640 1 -- 172.21.15.99:0/2843136427 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46e4182710 con 0x7f46e418b4f0 2024-02-21T23:09:30.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.625+0000 7f46ea400640 1 -- 172.21.15.99:0/2843136427 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46e42145b0 con 0x7f46e418b4f0 2024-02-21T23:09:30.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.629+0000 7f46e0c00640 1 -- 172.21.15.99:0/2843136427 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f46dc01b070 con 0x7f46e418b4f0 2024-02-21T23:09:30.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.632+0000 7f46e0c00640 1 --2- 172.21.15.99:0/2843136427 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f46c409efa0 0x7f46c40a1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:30.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.632+0000 7f46e0c00640 1 -- 172.21.15.99:0/2843136427 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f46dc0c9340 con 0x7f46e418b4f0 2024-02-21T23:09:30.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.632+0000 7f46e9000640 1 --2- 172.21.15.99:0/2843136427 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f46c409efa0 0x7f46c40a1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:30.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.633+0000 7f46e9000640 1 --2- 172.21.15.99:0/2843136427 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f46c409efa0 0x7f46c40a1460 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f46d8036000 tx=0x7f46d8008030 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:09:30.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.637+0000 7f46ee83b740 1 Processor -- start 2024-02-21T23:09:30.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.637+0000 7f46ee83b740 1 -- start start 2024-02-21T23:09:30.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.639+0000 7f46ee83b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5620fa75c2a0 0x5620fa791d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:30.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.639+0000 7f46ee83b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5620fa792260 0x5620fa75c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:30.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.640+0000 7f46e9000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5620fa75c2a0 0x5620fa791d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:30.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.640+0000 7f46ee83b740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5620fa75cbc0 0x5620fa71f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:30.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.640+0000 7f46e9000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5620fa75c2a0 0x5620fa791d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:44372/0 (socket says 172.21.15.99:44372) 2024-02-21T23:09:30.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.640+0000 7f46ee83b740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620fa688a90 con 0x5620fa75cbc0 2024-02-21T23:09:30.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.640+0000 7f46e3e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5620fa792260 0x5620fa75c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:30.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.640+0000 7f46e3e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5620fa792260 0x5620fa75c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:41146/0 (socket says 172.21.15.99:41146) 2024-02-21T23:09:30.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.640+0000 7f46e3e00640 1 -- 172.21.15.99:0/2107975005 learned_addr learned my addr 172.21.15.99:0/2107975005 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:09:30.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.640+0000 7f46ee83b740 1 -- 172.21.15.99:0/2107975005 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620fa631b10 con 0x5620fa75c2a0 2024-02-21T23:09:30.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.640+0000 7f46ee83b740 1 -- 172.21.15.99:0/2107975005 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620fa684b30 con 0x5620fa792260 2024-02-21T23:09:30.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.641+0000 7f46e9a00640 1 --2- 172.21.15.99:0/2107975005 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5620fa75cbc0 0x5620fa71f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:30.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.641+0000 7f46e3e00640 1 -- 172.21.15.99:0/2107975005 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5620fa75c2a0 msgr2=0x5620fa791d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:09:30.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.641+0000 7f46e3e00640 1 --2- 172.21.15.99:0/2107975005 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5620fa75c2a0 0x5620fa791d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:30.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.641+0000 7f46e3e00640 1 -- 172.21.15.99:0/2107975005 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5620fa75cbc0 msgr2=0x5620fa71f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:09:30.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.641+0000 7f46e3e00640 1 --2- 172.21.15.99:0/2107975005 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5620fa75cbc0 0x5620fa71f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:30.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.641+0000 7f46e3e00640 1 -- 172.21.15.99:0/2107975005 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5620fa4677d0 con 0x5620fa792260 2024-02-21T23:09:30.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.641+0000 7f46e3e00640 1 --2- 172.21.15.99:0/2107975005 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5620fa792260 0x5620fa75c680 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f46d00050c0 tx=0x7f46d0005580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=872e29e232c91788 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:09:30.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.642+0000 7f46d5600640 1 -- 172.21.15.99:0/2107975005 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d0017020 con 0x5620fa792260 2024-02-21T23:09:30.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.642+0000 7f46d5600640 1 -- 172.21.15.99:0/2107975005 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46d0003c10 con 0x5620fa792260 2024-02-21T23:09:30.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.642+0000 7f46d5600640 1 -- 172.21.15.99:0/2107975005 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d000f930 con 0x5620fa792260 2024-02-21T23:09:30.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.643+0000 7f46ee83b740 1 -- 172.21.15.99:0/2107975005 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5620fa792260 msgr2=0x5620fa75c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:09:30.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.643+0000 7f46ee83b740 1 --2- 172.21.15.99:0/2107975005 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5620fa792260 0x5620fa75c680 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f46d00050c0 tx=0x7f46d0005580 comp rx=0 tx=0).stop 2024-02-21T23:09:30.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.643+0000 7f46ee83b740 1 -- 172.21.15.99:0/2107975005 shutdown_connections 2024-02-21T23:09:30.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.643+0000 7f46ee83b740 1 --2- 172.21.15.99:0/2107975005 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5620fa75cbc0 0x5620fa71f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:30.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.643+0000 7f46ee83b740 1 --2- 172.21.15.99:0/2107975005 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5620fa792260 0x5620fa75c680 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:30.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.643+0000 7f46ee83b740 1 --2- 172.21.15.99:0/2107975005 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5620fa75c2a0 0x5620fa791d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:30.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.643+0000 7f46ee83b740 1 -- 172.21.15.99:0/2107975005 >> 172.21.15.99:0/2107975005 conn(0x5620fa6eb6b0 msgr2=0x5620fa723190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:09:30.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.643+0000 7f46ee83b740 1 -- 172.21.15.99:0/2107975005 shutdown_connections 2024-02-21T23:09:30.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.643+0000 7f46ee83b740 1 -- 172.21.15.99:0/2107975005 wait complete. 2024-02-21T23:09:30.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.644+0000 7f46ee83b740 1 -- start start 2024-02-21T23:09:30.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.644+0000 7f46ee83b740 1 Processor -- start 2024-02-21T23:09:30.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.646+0000 7f46ee83b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5620fa75c2a0 0x5620fa7a5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:30.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.646+0000 7f46ee83b740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5620fa75cbc0 0x5620fa74edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:30.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.646+0000 7f46ee83b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5620fa792260 0x5620fa7a3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:30.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.646+0000 7f46ee83b740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620fa72af30 con 0x5620fa75cbc0 2024-02-21T23:09:30.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.646+0000 7f46ee83b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620fa6271c0 con 0x5620fa75c2a0 2024-02-21T23:09:30.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.646+0000 7f46ee83b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620fa793930 con 0x5620fa792260 2024-02-21T23:09:30.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.646+0000 7f46ee83b740 10 client.0 _ll_register_callbacks cb 0x5620fa644930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:09:30.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.647+0000 7f46e3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5620fa75cbc0 0x5620fa74edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:30.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.647+0000 7f46e9a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5620fa792260 0x5620fa7a3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:30.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.647+0000 7f46e3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5620fa75cbc0 0x5620fa74edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:42746/0 (socket says 172.21.15.99:42746) 2024-02-21T23:09:30.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.647+0000 7f46e3e00640 1 -- 172.21.15.99:0/2053520590 learned_addr learned my addr 172.21.15.99:0/2053520590 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:09:30.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.647+0000 7f46e9000640 1 --2- 172.21.15.99:0/2053520590 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5620fa75c2a0 0x5620fa7a5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:30.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.647+0000 7f46e3e00640 1 -- 172.21.15.99:0/2053520590 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5620fa792260 msgr2=0x5620fa7a3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:09:30.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.647+0000 7f46e3e00640 1 --2- 172.21.15.99:0/2053520590 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5620fa792260 0x5620fa7a3bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:30.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.647+0000 7f46e3e00640 1 -- 172.21.15.99:0/2053520590 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5620fa75c2a0 msgr2=0x5620fa7a5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:09:30.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.648+0000 7f46e3e00640 1 --2- 172.21.15.99:0/2053520590 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5620fa75c2a0 0x5620fa7a5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:30.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.648+0000 7f46e3e00640 1 -- 172.21.15.99:0/2053520590 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5620fa39d3f0 con 0x5620fa75cbc0 2024-02-21T23:09:30.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.648+0000 7f46e3e00640 1 --2- 172.21.15.99:0/2053520590 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5620fa75cbc0 0x5620fa74edc0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f46d000f660 tx=0x7f46d00036f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deb880a74b2e5bdd server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:09:30.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.648+0000 7f46ca000640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:09:30.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.649+0000 7f46ca000640 1 -- 172.21.15.99:0/2053520590 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d0017030 con 0x5620fa75cbc0 2024-02-21T23:09:30.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.649+0000 7f46ca000640 1 -- 172.21.15.99:0/2053520590 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f46d0007450 con 0x5620fa75cbc0 2024-02-21T23:09:30.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.649+0000 7f46ee83b740 1 -- 172.21.15.99:0/2053520590 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f46d0003c10 con 0x5620fa75cbc0 2024-02-21T23:09:30.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.649+0000 7f46ca000640 1 -- 172.21.15.99:0/2053520590 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f46d0007650 con 0x5620fa75cbc0 2024-02-21T23:09:30.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.649+0000 7f46ee83b740 10 client.6579 fetch_fsmap learned FSMap version 17 2024-02-21T23:09:30.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.649+0000 7f46ee83b740 1 -- 172.21.15.99:0/2053520590 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5620fa35d0f0 con 0x5620fa75cbc0 2024-02-21T23:09:30.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.649+0000 7f46ca000640 1 -- 172.21.15.99:0/2053520590 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46d0003c10 con 0x5620fa75cbc0 2024-02-21T23:09:30.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.650+0000 7f46ca000640 1 -- 172.21.15.99:0/2053520590 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f46d00067d0 con 0x5620fa75cbc0 2024-02-21T23:09:30.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.650+0000 7f46ee83b740 10 client.6579 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:09:30.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.650+0000 7f46ee83b740 10 client.6579 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:09:30.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.650+0000 7f46ee83b740 20 client.6579 populate_metadata read hostname 'smithi099' 2024-02-21T23:09:30.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.650+0000 7f46ee83b740 1 --2- 172.21.15.99:0/2053520590 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5620fa78f600 0x5620fa78f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:30.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.650+0000 7f46ee83b740 4 client.6579 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:09:30.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.650+0000 7f46ee83b740 1 -- 172.21.15.99:0/2053520590 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5620fa695fd0 con 0x5620fa78f600 2024-02-21T23:09:30.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.650+0000 7f46e9000640 1 --2- 172.21.15.99:0/2053520590 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5620fa78f600 0x5620fa78f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:30.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.652+0000 7f46e9000640 1 --2- 172.21.15.99:0/2053520590 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5620fa78f600 0x5620fa78f9e0 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd32ba1aa5e972a9 server_cookie=c9a1795fe9ce1f0 in_seq=0 out_seq=0 2024-02-21T23:09:30.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.652+0000 7f46ca000640 10 client.6579 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:09:30.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.653+0000 7f46ca000640 1 -- 172.21.15.99:0/2053520590 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x5620fa695fd0 con 0x5620fa78f600 2024-02-21T23:09:30.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.653+0000 7f46ca000640 10 client.6579 handle_command_reply: tid=0 2024-02-21T23:09:30.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.653+0000 7f46ee83b740 1 client.6579 shutdown 2024-02-21T23:09:30.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.654+0000 7f46ee83b740 1 -- 172.21.15.99:0/2053520590 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5620fa75cbc0 msgr2=0x5620fa74edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:09:30.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.654+0000 7f46ee83b740 1 --2- 172.21.15.99:0/2053520590 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5620fa75cbc0 0x5620fa74edc0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f46d000f660 tx=0x7f46d00036f0 comp rx=0 tx=0).stop 2024-02-21T23:09:30.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.654+0000 7f46ee83b740 1 -- 172.21.15.99:0/2053520590 shutdown_connections 2024-02-21T23:09:30.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.654+0000 7f46ee83b740 1 --2- 172.21.15.99:0/2053520590 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5620fa78f600 0x5620fa78f9e0 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:30.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.654+0000 7f46ee83b740 1 --2- 172.21.15.99:0/2053520590 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5620fa792260 0x5620fa7a3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:30.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.654+0000 7f46ee83b740 1 --2- 172.21.15.99:0/2053520590 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5620fa75cbc0 0x5620fa74edc0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:30.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.654+0000 7f46ee83b740 1 --2- 172.21.15.99:0/2053520590 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5620fa75c2a0 0x5620fa7a5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:30.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.654+0000 7f46ee83b740 1 -- 172.21.15.99:0/2053520590 >> 172.21.15.99:0/2053520590 conn(0x5620fa6eb6b0 msgr2=0x5620fa793ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:09:30.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.654+0000 7f46ca000640 0 client.6579 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:09:30.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.655+0000 7f46ee83b740 1 -- 172.21.15.99:0/2053520590 shutdown_connections 2024-02-21T23:09:30.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.655+0000 7f46ee83b740 1 -- 172.21.15.99:0/2053520590 wait complete. 2024-02-21T23:09:30.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.655+0000 7f46ee83b740 20 client.6579 trim_cache size 0 max 16384 2024-02-21T23:09:30.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.682+0000 7f46ee83b740 1 Processor -- start 2024-02-21T23:09:30.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.683+0000 7f46ee83b740 1 -- start start 2024-02-21T23:09:30.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.684+0000 7f46ee83b740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5620fa75c2a0 0x5620fa78d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:30.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.684+0000 7f46ee83b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5620fa75cbc0 0x5620fa767f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:30.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.684+0000 7f46ee83b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5620fa792260 0x5620fa805510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:30.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.684+0000 7f46ee83b740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e422c970 con 0x5620fa75c2a0 2024-02-21T23:09:30.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.684+0000 7f46ee83b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e422a510 con 0x5620fa75cbc0 2024-02-21T23:09:30.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.684+0000 7f46ee83b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e421f370 con 0x5620fa792260 2024-02-21T23:09:30.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.685+0000 7f46e9a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5620fa792260 0x5620fa805510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:30.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.685+0000 7f46e3e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5620fa75cbc0 0x5620fa767f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:30.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.685+0000 7f46e3e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5620fa75cbc0 0x5620fa767f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:44398/0 (socket says 172.21.15.99:44398) 2024-02-21T23:09:30.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.685+0000 7f46e9a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5620fa792260 0x5620fa805510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:41170/0 (socket says 172.21.15.99:41170) 2024-02-21T23:09:30.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.685+0000 7f46e3e00640 1 -- 172.21.15.99:0/1614580154 learned_addr learned my addr 172.21.15.99:0/1614580154 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:09:30.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.685+0000 7f46e9000640 1 --2- 172.21.15.99:0/1614580154 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5620fa75c2a0 0x5620fa78d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:30.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.685+0000 7f46e9a00640 1 -- 172.21.15.99:0/1614580154 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5620fa75cbc0 msgr2=0x5620fa767f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:09:30.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.685+0000 7f46e9a00640 1 --2- 172.21.15.99:0/1614580154 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5620fa75cbc0 0x5620fa767f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:30.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.685+0000 7f46e9a00640 1 -- 172.21.15.99:0/1614580154 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5620fa75c2a0 msgr2=0x5620fa78d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:09:30.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.685+0000 7f46e9a00640 1 --2- 172.21.15.99:0/1614580154 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5620fa75c2a0 0x5620fa78d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:30.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.685+0000 7f46e9a00640 1 -- 172.21.15.99:0/1614580154 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5620fa71a390 con 0x5620fa792260 2024-02-21T23:09:30.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.685+0000 7f46e9000640 1 --2- 172.21.15.99:0/1614580154 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5620fa75c2a0 0x5620fa78d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T23:09:30.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.685+0000 7f46e9a00640 1 --2- 172.21.15.99:0/1614580154 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5620fa792260 0x5620fa805510 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f46dc0c6a10 tx=0x7f46dc014040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a727e049b95072b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:09:30.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.686+0000 7f46d4c00640 1 -- 172.21.15.99:0/1614580154 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46dc0c9170 con 0x5620fa792260 2024-02-21T23:09:30.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.686+0000 7f46d4c00640 1 -- 172.21.15.99:0/1614580154 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46dc0ae020 con 0x5620fa792260 2024-02-21T23:09:30.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.686+0000 7f46d4c00640 1 -- 172.21.15.99:0/1614580154 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46dc093310 con 0x5620fa792260 2024-02-21T23:09:30.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.686+0000 7f46ee83b740 1 -- 172.21.15.99:0/1614580154 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5620fa792260 msgr2=0x5620fa805510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:09:30.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.686+0000 7f46ee83b740 1 --2- 172.21.15.99:0/1614580154 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5620fa792260 0x5620fa805510 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f46dc0c6a10 tx=0x7f46dc014040 comp rx=0 tx=0).stop 2024-02-21T23:09:30.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.687+0000 7f46ee83b740 1 -- 172.21.15.99:0/1614580154 shutdown_connections 2024-02-21T23:09:30.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.687+0000 7f46ee83b740 1 --2- 172.21.15.99:0/1614580154 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5620fa792260 0x5620fa805510 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:30.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.687+0000 7f46ee83b740 1 --2- 172.21.15.99:0/1614580154 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5620fa75cbc0 0x5620fa767f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:30.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.687+0000 7f46ee83b740 1 --2- 172.21.15.99:0/1614580154 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5620fa75c2a0 0x5620fa78d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:30.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.687+0000 7f46ee83b740 1 -- 172.21.15.99:0/1614580154 >> 172.21.15.99:0/1614580154 conn(0x5620fa6eb6b0 msgr2=0x5620fa762fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:09:30.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.687+0000 7f46ee83b740 1 -- 172.21.15.99:0/1614580154 shutdown_connections 2024-02-21T23:09:30.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.687+0000 7f46ee83b740 1 -- 172.21.15.99:0/1614580154 wait complete. 2024-02-21T23:09:30.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.688+0000 7f46ee83b740 1 -- start start 2024-02-21T23:09:30.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.688+0000 7f46ee83b740 1 Processor -- start 2024-02-21T23:09:30.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.690+0000 7f46ee83b740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5620fa75c2a0 0x5620fa747c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:30.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.690+0000 7f46ee83b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5620fa75cbc0 0x5620fa7f7280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:30.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.690+0000 7f46ee83b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5620fa792260 0x5620fa7f77c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:30.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.690+0000 7f46ee83b740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e421f970 con 0x5620fa75c2a0 2024-02-21T23:09:30.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.690+0000 7f46ee83b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e4229eb0 con 0x5620fa75cbc0 2024-02-21T23:09:30.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.690+0000 7f46ee83b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e4229210 con 0x5620fa792260 2024-02-21T23:09:30.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.690+0000 7f46ee83b740 10 client.0 _ll_register_callbacks cb 0x7f46d0010c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:09:30.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.690+0000 7f46e3e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5620fa75cbc0 0x5620fa7f7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:30.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.690+0000 7f46e3e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5620fa75cbc0 0x5620fa7f7280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:44400/0 (socket says 172.21.15.99:44400) 2024-02-21T23:09:30.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.690+0000 7f46e3e00640 1 -- 172.21.15.99:0/4212645073 learned_addr learned my addr 172.21.15.99:0/4212645073 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:09:30.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.690+0000 7f46e9000640 1 --2- 172.21.15.99:0/4212645073 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5620fa75c2a0 0x5620fa747c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:30.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.690+0000 7f46e9a00640 1 --2- 172.21.15.99:0/4212645073 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5620fa792260 0x5620fa7f77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:30.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.690+0000 7f46e3e00640 1 -- 172.21.15.99:0/4212645073 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5620fa792260 msgr2=0x5620fa7f77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:09:30.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.690+0000 7f46e3e00640 1 --2- 172.21.15.99:0/4212645073 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5620fa792260 0x5620fa7f77c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:30.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.690+0000 7f46e3e00640 1 -- 172.21.15.99:0/4212645073 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5620fa75c2a0 msgr2=0x5620fa747c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:09:30.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.690+0000 7f46e3e00640 1 --2- 172.21.15.99:0/4212645073 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5620fa75c2a0 0x5620fa747c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:30.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.690+0000 7f46e3e00640 1 -- 172.21.15.99:0/4212645073 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5620fa792ac0 con 0x5620fa75cbc0 2024-02-21T23:09:30.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.690+0000 7f46e9000640 1 --2- 172.21.15.99:0/4212645073 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5620fa75c2a0 0x5620fa747c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T23:09:30.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.691+0000 7f46e9a00640 1 --2- 172.21.15.99:0/4212645073 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5620fa792260 0x5620fa7f77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T23:09:30.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.691+0000 7f46e3e00640 1 --2- 172.21.15.99:0/4212645073 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5620fa75cbc0 0x5620fa7f7280 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f46d0000c00 tx=0x7f46d0007ef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97f1f3963b98d468 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:09:30.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.691+0000 7f46ca000640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-02-21T23:09:30.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.691+0000 7f46ca000640 1 -- 172.21.15.99:0/4212645073 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d0017040 con 0x5620fa75cbc0 2024-02-21T23:09:30.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.691+0000 7f46ca000640 1 -- 172.21.15.99:0/4212645073 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f46d0007450 con 0x5620fa75cbc0 2024-02-21T23:09:30.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.691+0000 7f46ee83b740 1 -- 172.21.15.99:0/4212645073 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f46dc0ae020 con 0x5620fa75cbc0 2024-02-21T23:09:30.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.691+0000 7f46ca000640 1 -- 172.21.15.99:0/4212645073 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f46d003a050 con 0x5620fa75cbc0 2024-02-21T23:09:30.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.692+0000 7f46ee83b740 10 client.6727 fetch_fsmap learned FSMap version 17 2024-02-21T23:09:30.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.692+0000 7f46ee83b740 1 -- 172.21.15.99:0/4212645073 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5620fa7930e0 con 0x5620fa75cbc0 2024-02-21T23:09:30.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.692+0000 7f46ca000640 1 -- 172.21.15.99:0/4212645073 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46dc0ae020 con 0x5620fa75cbc0 2024-02-21T23:09:30.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.693+0000 7f46ca000640 1 -- 172.21.15.99:0/4212645073 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f46d002c470 con 0x5620fa75cbc0 2024-02-21T23:09:30.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.693+0000 7f46ee83b740 10 client.6727 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:09:30.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.693+0000 7f46ee83b740 10 client.6727 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:09:30.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.693+0000 7f46ee83b740 20 client.6727 populate_metadata read hostname 'smithi099' 2024-02-21T23:09:30.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.693+0000 7f46ee83b740 1 --2- 172.21.15.99:0/4212645073 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5620fa795f00 0x5620fa78f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:09:30.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.693+0000 7f46ee83b740 4 client.6727 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T23:09:30.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.693+0000 7f46ee83b740 1 -- 172.21.15.99:0/4212645073 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5620fa690320 con 0x5620fa795f00 2024-02-21T23:09:30.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.693+0000 7f46e9000640 1 --2- 172.21.15.99:0/4212645073 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5620fa795f00 0x5620fa78f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:09:30.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.695+0000 7f46e9000640 1 --2- 172.21.15.99:0/4212645073 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5620fa795f00 0x5620fa78f600 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b19a7b9063e56ca3 server_cookie=cc92438efadd16aa in_seq=0 out_seq=0 2024-02-21T23:09:30.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.695+0000 7f46ca000640 10 client.6727 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:09:30.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.695+0000 7f46ca000640 1 -- 172.21.15.99:0/4212645073 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+268 (crc 0 0 0) 0x5620fa690320 con 0x5620fa795f00 2024-02-21T23:09:30.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.695+0000 7f46ca000640 10 client.6727 handle_command_reply: tid=0 2024-02-21T23:09:30.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.696+0000 7f46ee83b740 1 client.6727 shutdown 2024-02-21T23:09:30.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.697+0000 7f46ee83b740 1 -- 172.21.15.99:0/4212645073 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5620fa75cbc0 msgr2=0x5620fa7f7280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:09:30.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.697+0000 7f46ee83b740 1 --2- 172.21.15.99:0/4212645073 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5620fa75cbc0 0x5620fa7f7280 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f46d0000c00 tx=0x7f46d0007ef0 comp rx=0 tx=0).stop 2024-02-21T23:09:30.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.697+0000 7f46ee83b740 1 -- 172.21.15.99:0/4212645073 shutdown_connections 2024-02-21T23:09:30.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.697+0000 7f46ee83b740 1 --2- 172.21.15.99:0/4212645073 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5620fa795f00 0x5620fa78f600 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:30.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.697+0000 7f46ee83b740 1 --2- 172.21.15.99:0/4212645073 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5620fa792260 0x5620fa7f77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:30.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.697+0000 7f46ee83b740 1 --2- 172.21.15.99:0/4212645073 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5620fa75cbc0 0x5620fa7f7280 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:30.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.697+0000 7f46ee83b740 1 --2- 172.21.15.99:0/4212645073 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5620fa75c2a0 0x5620fa747c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:30.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.697+0000 7f46ee83b740 1 -- 172.21.15.99:0/4212645073 >> 172.21.15.99:0/4212645073 conn(0x5620fa6eb6b0 msgr2=0x5620fa790730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:09:30.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.697+0000 7f46ca000640 0 client.6727 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:09:30.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.698+0000 7f46ee83b740 1 -- 172.21.15.99:0/4212645073 shutdown_connections 2024-02-21T23:09:30.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.698+0000 7f46ee83b740 1 -- 172.21.15.99:0/4212645073 wait complete. 2024-02-21T23:09:30.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.698+0000 7f46ee83b740 20 client.6727 trim_cache size 0 max 16384 2024-02-21T23:09:30.689 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-02-21T23:09:30.689 INFO:teuthology.orchestra.run.smithi099.stdout: "status": "scrub active (1097 inodes in the stack)", 2024-02-21T23:09:30.689 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubs": { 2024-02-21T23:09:30.690 INFO:teuthology.orchestra.run.smithi099.stdout: "fd0ab1b3-7c87-4cbc-8ef4-f2eca74d5f2e": { 2024-02-21T23:09:30.690 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/", 2024-02-21T23:09:30.690 INFO:teuthology.orchestra.run.smithi099.stdout: "tag": "fd0ab1b3-7c87-4cbc-8ef4-f2eca74d5f2e", 2024-02-21T23:09:30.690 INFO:teuthology.orchestra.run.smithi099.stdout: "options": "recursive,force" 2024-02-21T23:09:30.690 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:09:30.690 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:09:30.690 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-02-21T23:09:30.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.699+0000 7f46ea400640 1 -- 172.21.15.99:0/2843136427 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f46c409efa0 msgr2=0x7f46c40a1460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:09:30.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.699+0000 7f46ea400640 1 --2- 172.21.15.99:0/2843136427 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f46c409efa0 0x7f46c40a1460 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f46d8036000 tx=0x7f46d8008030 comp rx=0 tx=0).stop 2024-02-21T23:09:30.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.699+0000 7f46ea400640 1 -- 172.21.15.99:0/2843136427 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f46e418b4f0 msgr2=0x7f46e4214db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:09:30.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.699+0000 7f46ea400640 1 --2- 172.21.15.99:0/2843136427 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f46e418b4f0 0x7f46e4214db0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f46dc00c780 tx=0x7f46dc00cc40 comp rx=0 tx=0).stop 2024-02-21T23:09:30.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.699+0000 7f46ea400640 1 -- 172.21.15.99:0/2843136427 shutdown_connections 2024-02-21T23:09:30.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.699+0000 7f46ea400640 1 --2- 172.21.15.99:0/2843136427 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f46c409efa0 0x7f46c40a1460 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:30.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.699+0000 7f46ea400640 1 --2- 172.21.15.99:0/2843136427 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f46e418b4f0 0x7f46e4214db0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:30.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.699+0000 7f46ea400640 1 --2- 172.21.15.99:0/2843136427 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46e418b060 0x7f46e415ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:30.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.699+0000 7f46ea400640 1 --2- 172.21.15.99:0/2843136427 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f46e417f490 0x7f46e4181980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:09:30.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.699+0000 7f46ea400640 1 -- 172.21.15.99:0/2843136427 >> 172.21.15.99:0/2843136427 conn(0x7f46e40d29b0 msgr2=0x7f46e40d2eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:09:30.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.700+0000 7f46ea400640 1 -- 172.21.15.99:0/2843136427 shutdown_connections 2024-02-21T23:09:30.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:09:30.700+0000 7f46ea400640 1 -- 172.21.15.99:0/2843136427 wait complete. 2024-02-21T23:09:30.712 INFO:tasks.cephfs.filesystem:scrub status for tag:fd0ab1b3-7c87-4cbc-8ef4-f2eca74d5f2e - {'path': '/', 'tag': 'fd0ab1b3-7c87-4cbc-8ef4-f2eca74d5f2e', 'options': 'recursive,force'} 2024-02-21T23:09:43.698 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:09:43.706 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:09:43.708 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:10:00.713 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T23:10:00.714 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T23:10:00.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.934+0000 7f2125c00640 1 Processor -- start 2024-02-21T23:10:00.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.934+0000 7f2125c00640 1 -- start start 2024-02-21T23:10:00.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.936+0000 7f2125c00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f2120074ba0 0x7f212006cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:00.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.936+0000 7f2125c00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21200703b0 con 0x7f21200740b0 2024-02-21T23:10:00.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.936+0000 7f2125c00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f212006d320 con 0x7f212006ff20 2024-02-21T23:10:00.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.936+0000 7f2125c00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f212006d600 con 0x7f2120074ba0 2024-02-21T23:10:00.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.937+0000 7f211fe00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f21200740b0 0x7f2120074490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:42258/0 (socket says 172.21.15.99:42258) 2024-02-21T23:10:00.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.937+0000 7f211fe00640 1 -- 172.21.15.99:0/787102782 learned_addr learned my addr 172.21.15.99:0/787102782 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:10:00.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.937+0000 7f211f400640 1 --2- 172.21.15.99:0/787102782 >> v2:172.21.15.181:3300/0 conn(0x7f2120074ba0 0x7f212006cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:00.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.937+0000 7f211ea00640 1 -- 172.21.15.99:0/787102782 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 597402712 0 0) 0x7f212006d320 con 0x7f212006ff20 2024-02-21T23:10:00.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.937+0000 7f211ea00640 1 -- 172.21.15.99:0/787102782 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2104003520 con 0x7f212006ff20 2024-02-21T23:10:00.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.937+0000 7f211ea00640 1 -- 172.21.15.99:0/787102782 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1135158604 0 0) 0x7f21200703b0 con 0x7f21200740b0 2024-02-21T23:10:00.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.937+0000 7f211ea00640 1 -- 172.21.15.99:0/787102782 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f212006d320 con 0x7f21200740b0 2024-02-21T23:10:00.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.937+0000 7f211f400640 1 -- 172.21.15.99:0/787102782 >> v1:172.21.15.162:6789/0 conn(0x7f212006ff20 legacy=0x7f21200f62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:00.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.937+0000 7f211f400640 1 -- 172.21.15.99:0/787102782 >> v1:172.21.15.99:6789/0 conn(0x7f21200740b0 legacy=0x7f2120074490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:00.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.937+0000 7f211f400640 1 -- 172.21.15.99:0/787102782 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f212006d8e0 con 0x7f2120074ba0 2024-02-21T23:10:00.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.939+0000 7f211f400640 1 --2- 172.21.15.99:0/787102782 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2120074ba0 0x7f212006cbe0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f210c0097a0 tx=0x7f210c02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ef87c5cfb78e17c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:00.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.940+0000 7f211ea00640 1 -- 172.21.15.99:0/787102782 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210c035020 con 0x7f2120074ba0 2024-02-21T23:10:00.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.940+0000 7f211ea00640 1 -- 172.21.15.99:0/787102782 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f210c031830 con 0x7f2120074ba0 2024-02-21T23:10:00.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.940+0000 7f211ea00640 1 -- 172.21.15.99:0/787102782 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210c031c00 con 0x7f2120074ba0 2024-02-21T23:10:00.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.940+0000 7f2125c00640 1 -- 172.21.15.99:0/787102782 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2120074ba0 msgr2=0x7f212006cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:00.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.940+0000 7f2125c00640 1 --2- 172.21.15.99:0/787102782 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2120074ba0 0x7f212006cbe0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f210c0097a0 tx=0x7f210c02b8d0 comp rx=0 tx=0).stop 2024-02-21T23:10:00.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.940+0000 7f2125c00640 1 -- 172.21.15.99:0/787102782 shutdown_connections 2024-02-21T23:10:00.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.940+0000 7f2125c00640 1 --2- 172.21.15.99:0/787102782 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2120074ba0 0x7f212006cbe0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:00.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.940+0000 7f2125c00640 1 -- 172.21.15.99:0/787102782 >> 172.21.15.99:0/787102782 conn(0x7f212008cfd0 msgr2=0x7f212008d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:10:00.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.940+0000 7f2125c00640 1 -- 172.21.15.99:0/787102782 shutdown_connections 2024-02-21T23:10:00.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.940+0000 7f2125c00640 1 -- 172.21.15.99:0/787102782 wait complete. 2024-02-21T23:10:00.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.942+0000 7f2125c00640 1 Processor -- start 2024-02-21T23:10:00.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.943+0000 7f2125c00640 1 -- start start 2024-02-21T23:10:00.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.944+0000 7f2125c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f212006ff20 0x7f2120168dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:00.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.944+0000 7f2125c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f21200740b0 0x7f2120211e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:00.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.944+0000 7f2125c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2120074ba0 0x7f2120212370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:00.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.944+0000 7f2125c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2120182dc0 con 0x7f21200740b0 2024-02-21T23:10:00.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.944+0000 7f2125c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21200f5dd0 con 0x7f212006ff20 2024-02-21T23:10:00.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.944+0000 7f2125c00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21200f6a00 con 0x7f2120074ba0 2024-02-21T23:10:00.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.944+0000 7f211f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f21200740b0 0x7f2120211e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:00.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.944+0000 7f211f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f21200740b0 0x7f2120211e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46726/0 (socket says 172.21.15.99:46726) 2024-02-21T23:10:00.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.944+0000 7f211f400640 1 -- 172.21.15.99:0/3565005548 learned_addr learned my addr 172.21.15.99:0/3565005548 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:10:00.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.944+0000 7f211fe00640 1 --2- 172.21.15.99:0/3565005548 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f212006ff20 0x7f2120168dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:00.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.944+0000 7f2125200640 1 --2- 172.21.15.99:0/3565005548 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2120074ba0 0x7f2120212370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:00.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.945+0000 7f211f400640 1 -- 172.21.15.99:0/3565005548 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2120074ba0 msgr2=0x7f2120212370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:00.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.945+0000 7f211f400640 1 --2- 172.21.15.99:0/3565005548 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2120074ba0 0x7f2120212370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:00.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.945+0000 7f211f400640 1 -- 172.21.15.99:0/3565005548 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f212006ff20 msgr2=0x7f2120168dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:00.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.945+0000 7f211f400640 1 --2- 172.21.15.99:0/3565005548 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f212006ff20 0x7f2120168dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:00.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.945+0000 7f211f400640 1 -- 172.21.15.99:0/3565005548 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21201804d0 con 0x7f21200740b0 2024-02-21T23:10:00.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.945+0000 7f211fe00640 1 --2- 172.21.15.99:0/3565005548 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f212006ff20 0x7f2120168dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:10:00.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.945+0000 7f211f400640 1 --2- 172.21.15.99:0/3565005548 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f21200740b0 0x7f2120211e30 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f210c034040 tx=0x7f210c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:00.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.945+0000 7f2117e00640 1 -- 172.21.15.99:0/3565005548 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210c040070 con 0x7f21200740b0 2024-02-21T23:10:00.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.945+0000 7f2117e00640 1 -- 172.21.15.99:0/3565005548 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f210c03a910 con 0x7f21200740b0 2024-02-21T23:10:00.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.945+0000 7f2117e00640 1 -- 172.21.15.99:0/3565005548 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210c035040 con 0x7f21200740b0 2024-02-21T23:10:00.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.945+0000 7f2125c00640 1 -- 172.21.15.99:0/3565005548 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2120212a50 con 0x7f21200740b0 2024-02-21T23:10:00.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.946+0000 7f2125c00640 1 -- 172.21.15.99:0/3565005548 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2120213010 con 0x7f21200740b0 2024-02-21T23:10:00.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.950+0000 7f212a057740 1 Processor -- start 2024-02-21T23:10:00.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.950+0000 7f2117e00640 1 -- 172.21.15.99:0/3565005548 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f210c038020 con 0x7f21200740b0 2024-02-21T23:10:00.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.950+0000 7f212a057740 1 -- start start 2024-02-21T23:10:00.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.951+0000 7f2117e00640 1 --2- 172.21.15.99:0/3565005548 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f210009eed0 0x7f21000a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:00.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.951+0000 7f2117e00640 1 -- 172.21.15.99:0/3565005548 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f210c0eb690 con 0x7f21200740b0 2024-02-21T23:10:00.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.952+0000 7f2125200640 1 --2- 172.21.15.99:0/3565005548 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f210009eed0 0x7f21000a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:00.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.952+0000 7f212a057740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56385ea532a0 0x56385ea88d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:00.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.952+0000 7f212a057740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56385ea89260 0x56385ea53680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:00.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.952+0000 7f212a057740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56385ea53bc0 0x56385ea161d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:00.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.952+0000 7f212a057740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x56385e97fa90 con 0x56385ea532a0 2024-02-21T23:10:00.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.952+0000 7f212a057740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x56385e928b10 con 0x56385ea53bc0 2024-02-21T23:10:00.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.952+0000 7f212a057740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x56385e97bb30 con 0x56385ea89260 2024-02-21T23:10:00.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.953+0000 7f2125200640 1 --2- 172.21.15.99:0/3565005548 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f210009eed0 0x7f21000a1390 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2120214de0 tx=0x7f2118009040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:00.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.953+0000 7f2125200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56385ea53bc0 0x56385ea161d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:00.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.953+0000 7f211fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56385ea532a0 0x56385ea88d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:00.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.953+0000 7f2125200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56385ea53bc0 0x56385ea161d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:41276/0 (socket says 172.21.15.99:41276) 2024-02-21T23:10:00.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.953+0000 7f2125200640 1 -- 172.21.15.99:0/2302555234 learned_addr learned my addr 172.21.15.99:0/2302555234 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:10:00.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.953+0000 7f211f400640 1 --2- 172.21.15.99:0/2302555234 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56385ea89260 0x56385ea53680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:00.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.953+0000 7f2125200640 1 -- 172.21.15.99:0/2302555234 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56385ea89260 msgr2=0x56385ea53680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:00.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.953+0000 7f2125200640 1 --2- 172.21.15.99:0/2302555234 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56385ea89260 0x56385ea53680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:00.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.953+0000 7f2125200640 1 -- 172.21.15.99:0/2302555234 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56385ea532a0 msgr2=0x56385ea88d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:00.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.953+0000 7f2125200640 1 --2- 172.21.15.99:0/2302555234 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56385ea532a0 0x56385ea88d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:00.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.953+0000 7f2125200640 1 -- 172.21.15.99:0/2302555234 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56385e75e7d0 con 0x56385ea53bc0 2024-02-21T23:10:00.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.954+0000 7f2125200640 1 --2- 172.21.15.99:0/2302555234 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56385ea53bc0 0x56385ea161d0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f211800fd50 tx=0x7f2118012000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d9cb843c1997647 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:00.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.954+0000 7f2114c00640 1 -- 172.21.15.99:0/2302555234 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2118025070 con 0x56385ea53bc0 2024-02-21T23:10:00.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.954+0000 7f2114c00640 1 -- 172.21.15.99:0/2302555234 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f211801b050 con 0x56385ea53bc0 2024-02-21T23:10:00.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.954+0000 7f2114c00640 1 -- 172.21.15.99:0/2302555234 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2118020610 con 0x56385ea53bc0 2024-02-21T23:10:00.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.955+0000 7f212a057740 1 -- 172.21.15.99:0/2302555234 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56385ea53bc0 msgr2=0x56385ea161d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:00.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.955+0000 7f212a057740 1 --2- 172.21.15.99:0/2302555234 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56385ea53bc0 0x56385ea161d0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f211800fd50 tx=0x7f2118012000 comp rx=0 tx=0).stop 2024-02-21T23:10:00.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.955+0000 7f212a057740 1 -- 172.21.15.99:0/2302555234 shutdown_connections 2024-02-21T23:10:00.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.955+0000 7f212a057740 1 --2- 172.21.15.99:0/2302555234 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56385ea53bc0 0x56385ea161d0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:00.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.955+0000 7f212a057740 1 --2- 172.21.15.99:0/2302555234 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56385ea89260 0x56385ea53680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:00.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.955+0000 7f212a057740 1 --2- 172.21.15.99:0/2302555234 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56385ea532a0 0x56385ea88d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:00.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.955+0000 7f212a057740 1 -- 172.21.15.99:0/2302555234 >> 172.21.15.99:0/2302555234 conn(0x56385e9e26b0 msgr2=0x56385ea1a190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:10:00.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.955+0000 7f212a057740 1 -- 172.21.15.99:0/2302555234 shutdown_connections 2024-02-21T23:10:00.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.955+0000 7f212a057740 1 -- 172.21.15.99:0/2302555234 wait complete. 2024-02-21T23:10:00.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.956+0000 7f212a057740 1 -- start start 2024-02-21T23:10:00.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.957+0000 7f212a057740 1 Processor -- start 2024-02-21T23:10:00.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.959+0000 7f212a057740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56385ea532a0 0x56385ea83170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:00.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.959+0000 7f212a057740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56385ea53bc0 0x56385ea9ce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:00.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.959+0000 7f212a057740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56385ea89260 0x56385ea9ae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:00.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.959+0000 7f212a057740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x56385ea21f30 con 0x56385ea89260 2024-02-21T23:10:00.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.959+0000 7f212a057740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x56385e91e1c0 con 0x56385ea53bc0 2024-02-21T23:10:00.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.959+0000 7f212a057740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x56385ea8a930 con 0x56385ea532a0 2024-02-21T23:10:00.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.959+0000 7f212a057740 10 client.0 _ll_register_callbacks cb 0x56385e93b930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:10:00.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.959+0000 7f211fe00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56385ea532a0 0x56385ea83170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:00.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.959+0000 7f211f400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56385ea53bc0 0x56385ea9ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:00.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.959+0000 7f2125200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56385ea89260 0x56385ea9ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:00.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.959+0000 7f211fe00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56385ea532a0 0x56385ea83170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:46672/0 (socket says 172.21.15.99:46672) 2024-02-21T23:10:00.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.959+0000 7f211f400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56385ea53bc0 0x56385ea9ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:41284/0 (socket says 172.21.15.99:41284) 2024-02-21T23:10:00.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.959+0000 7f211fe00640 1 -- 172.21.15.99:0/4181622005 learned_addr learned my addr 172.21.15.99:0/4181622005 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:10:00.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.960+0000 7f211f400640 1 -- 172.21.15.99:0/4181622005 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56385ea532a0 msgr2=0x56385ea83170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:00.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.960+0000 7f211f400640 1 --2- 172.21.15.99:0/4181622005 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56385ea532a0 0x56385ea83170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:00.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.960+0000 7f211f400640 1 -- 172.21.15.99:0/4181622005 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56385ea89260 msgr2=0x56385ea9ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:00.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.960+0000 7f211f400640 1 --2- 172.21.15.99:0/4181622005 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56385ea89260 0x56385ea9ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:00.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.960+0000 7f211f400640 1 -- 172.21.15.99:0/4181622005 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56385e6943f0 con 0x56385ea53bc0 2024-02-21T23:10:00.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.960+0000 7f211f400640 1 --2- 172.21.15.99:0/4181622005 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56385ea53bc0 0x56385ea9ce30 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f210c0e8d30 tx=0x7f210c0b96a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c091fe0c5f36e97c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:00.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.960+0000 7f2109600640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-02-21T23:10:00.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.960+0000 7f2109600640 1 -- 172.21.15.99:0/4181622005 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210c0d4030 con 0x56385ea53bc0 2024-02-21T23:10:00.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.960+0000 7f212a057740 1 -- 172.21.15.99:0/4181622005 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f211801b050 con 0x56385ea53bc0 2024-02-21T23:10:00.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.960+0000 7f2109600640 1 -- 172.21.15.99:0/4181622005 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f210c03ad00 con 0x56385ea53bc0 2024-02-21T23:10:00.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.961+0000 7f2109600640 1 -- 172.21.15.99:0/4181622005 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f210c0bd030 con 0x56385ea53bc0 2024-02-21T23:10:00.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.961+0000 7f212a057740 10 client.6739 fetch_fsmap learned FSMap version 17 2024-02-21T23:10:00.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.961+0000 7f212a057740 1 -- 172.21.15.99:0/4181622005 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x56385e6540f0 con 0x56385ea53bc0 2024-02-21T23:10:00.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.961+0000 7f2109600640 1 -- 172.21.15.99:0/4181622005 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f211801b050 con 0x56385ea53bc0 2024-02-21T23:10:00.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.961+0000 7f2109600640 1 -- 172.21.15.99:0/4181622005 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f210c0e8ea0 con 0x56385ea53bc0 2024-02-21T23:10:00.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.961+0000 7f212a057740 10 client.6739 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:10:00.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.961+0000 7f212a057740 10 client.6739 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:10:00.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.961+0000 7f212a057740 20 client.6739 populate_metadata read hostname 'smithi099' 2024-02-21T23:10:00.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.962+0000 7f212a057740 1 --2- 172.21.15.99:0/4181622005 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x56385ea147e0 0x56385ea14bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:00.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.962+0000 7f212a057740 4 client.6739 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:10:00.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.962+0000 7f212a057740 1 -- 172.21.15.99:0/4181622005 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56385e98cfd0 con 0x56385ea147e0 2024-02-21T23:10:00.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.962+0000 7f211fe00640 1 --2- 172.21.15.99:0/4181622005 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x56385ea147e0 0x56385ea14bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:00.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.963+0000 7f211fe00640 1 --2- 172.21.15.99:0/4181622005 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x56385ea147e0 0x56385ea14bf0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=babba1f3fe1f7943 server_cookie=56c1f87d563b6c5e in_seq=0 out_seq=0 2024-02-21T23:10:00.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.963+0000 7f2109600640 10 client.6739 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:10:00.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.964+0000 7f2109600640 1 -- 172.21.15.99:0/4181622005 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x56385e98cfd0 con 0x56385ea147e0 2024-02-21T23:10:00.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.964+0000 7f2109600640 10 client.6739 handle_command_reply: tid=0 2024-02-21T23:10:00.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.964+0000 7f212a057740 1 client.6739 shutdown 2024-02-21T23:10:00.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.964+0000 7f212a057740 1 -- 172.21.15.99:0/4181622005 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56385ea53bc0 msgr2=0x56385ea9ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:00.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.964+0000 7f212a057740 1 --2- 172.21.15.99:0/4181622005 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56385ea53bc0 0x56385ea9ce30 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f210c0e8d30 tx=0x7f210c0b96a0 comp rx=0 tx=0).stop 2024-02-21T23:10:00.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.964+0000 7f212a057740 1 -- 172.21.15.99:0/4181622005 shutdown_connections 2024-02-21T23:10:00.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.964+0000 7f212a057740 1 --2- 172.21.15.99:0/4181622005 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x56385ea147e0 0x56385ea14bf0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:00.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.964+0000 7f212a057740 1 --2- 172.21.15.99:0/4181622005 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56385ea89260 0x56385ea9ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:00.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.964+0000 7f212a057740 1 --2- 172.21.15.99:0/4181622005 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56385ea53bc0 0x56385ea9ce30 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:00.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.964+0000 7f212a057740 1 --2- 172.21.15.99:0/4181622005 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56385ea532a0 0x56385ea83170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:00.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.964+0000 7f2109600640 0 client.6739 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:10:00.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.964+0000 7f212a057740 1 -- 172.21.15.99:0/4181622005 >> 172.21.15.99:0/4181622005 conn(0x56385e9e26b0 msgr2=0x56385ea1a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:10:00.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.964+0000 7f212a057740 1 -- 172.21.15.99:0/4181622005 shutdown_connections 2024-02-21T23:10:00.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.964+0000 7f212a057740 1 -- 172.21.15.99:0/4181622005 wait complete. 2024-02-21T23:10:00.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.964+0000 7f212a057740 20 client.6739 trim_cache size 0 max 16384 2024-02-21T23:10:00.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.982+0000 7f212a057740 1 Processor -- start 2024-02-21T23:10:00.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.983+0000 7f212a057740 1 -- start start 2024-02-21T23:10:00.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.984+0000 7f212a057740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56385ea532a0 0x56385ea10e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:00.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.984+0000 7f212a057740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56385ea53bc0 0x56385ea178f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:00.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.985+0000 7f212a057740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56385ea89260 0x56385ea151c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:00.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.985+0000 7f212a057740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f212022ca30 con 0x56385ea89260 2024-02-21T23:10:00.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.985+0000 7f212a057740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f212022a5d0 con 0x56385ea53bc0 2024-02-21T23:10:00.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.985+0000 7f212a057740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2120173ae0 con 0x56385ea532a0 2024-02-21T23:10:00.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.985+0000 7f2125200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56385ea89260 0x56385ea151c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:00.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.985+0000 7f211f400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56385ea53bc0 0x56385ea178f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:00.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.985+0000 7f2125200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56385ea89260 0x56385ea151c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46752/0 (socket says 172.21.15.99:46752) 2024-02-21T23:10:00.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.985+0000 7f2125200640 1 -- 172.21.15.99:0/3533354618 learned_addr learned my addr 172.21.15.99:0/3533354618 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:10:00.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.985+0000 7f211fe00640 1 --2- 172.21.15.99:0/3533354618 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56385ea532a0 0x56385ea10e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:00.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.985+0000 7f211f400640 1 -- 172.21.15.99:0/3533354618 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56385ea532a0 msgr2=0x56385ea10e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:00.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.985+0000 7f211f400640 1 --2- 172.21.15.99:0/3533354618 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56385ea532a0 0x56385ea10e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:00.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.985+0000 7f211f400640 1 -- 172.21.15.99:0/3533354618 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56385ea89260 msgr2=0x56385ea151c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:00.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.985+0000 7f211f400640 1 --2- 172.21.15.99:0/3533354618 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56385ea89260 0x56385ea151c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:00.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.986+0000 7f211f400640 1 -- 172.21.15.99:0/3533354618 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56385ea539f0 con 0x56385ea53bc0 2024-02-21T23:10:00.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.986+0000 7f211f400640 1 --2- 172.21.15.99:0/3533354618 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56385ea53bc0 0x56385ea178f0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f210c02b910 tx=0x7f210c0d0000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fef936d1bb1b2661 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:00.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.986+0000 7f210be00640 1 -- 172.21.15.99:0/3533354618 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210c0d4070 con 0x56385ea53bc0 2024-02-21T23:10:00.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.986+0000 7f210be00640 1 -- 172.21.15.99:0/3533354618 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f210c03ad00 con 0x56385ea53bc0 2024-02-21T23:10:00.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.986+0000 7f210be00640 1 -- 172.21.15.99:0/3533354618 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210c0e8ea0 con 0x56385ea53bc0 2024-02-21T23:10:00.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.987+0000 7f212a057740 1 -- 172.21.15.99:0/3533354618 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56385ea53bc0 msgr2=0x56385ea178f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:00.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.987+0000 7f212a057740 1 --2- 172.21.15.99:0/3533354618 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56385ea53bc0 0x56385ea178f0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f210c02b910 tx=0x7f210c0d0000 comp rx=0 tx=0).stop 2024-02-21T23:10:00.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.987+0000 7f212a057740 1 -- 172.21.15.99:0/3533354618 shutdown_connections 2024-02-21T23:10:00.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.987+0000 7f212a057740 1 --2- 172.21.15.99:0/3533354618 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56385ea89260 0x56385ea151c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:00.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.987+0000 7f212a057740 1 --2- 172.21.15.99:0/3533354618 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56385ea53bc0 0x56385ea178f0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:00.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.987+0000 7f212a057740 1 --2- 172.21.15.99:0/3533354618 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56385ea532a0 0x56385ea10e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:00.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.987+0000 7f212a057740 1 -- 172.21.15.99:0/3533354618 >> 172.21.15.99:0/3533354618 conn(0x56385e9e26b0 msgr2=0x56385ea42840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:10:00.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.987+0000 7f212a057740 1 -- 172.21.15.99:0/3533354618 shutdown_connections 2024-02-21T23:10:00.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.987+0000 7f212a057740 1 -- 172.21.15.99:0/3533354618 wait complete. 2024-02-21T23:10:00.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.988+0000 7f212a057740 1 -- start start 2024-02-21T23:10:00.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.989+0000 7f212a057740 1 Processor -- start 2024-02-21T23:10:00.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.991+0000 7f212a057740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56385ea532a0 0x56385ea9acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:00.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.991+0000 7f212a057740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56385ea53bc0 0x56385ea9d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:00.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.991+0000 7f212a057740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56385ea89260 0x56385eaf7e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:00.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.991+0000 7f212a057740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21201740e0 con 0x56385ea53bc0 2024-02-21T23:10:00.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.991+0000 7f212a057740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2120229f70 con 0x56385ea89260 2024-02-21T23:10:00.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.991+0000 7f212a057740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21202292b0 con 0x56385ea532a0 2024-02-21T23:10:00.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.991+0000 7f212a057740 10 client.0 _ll_register_callbacks cb 0x7f210c0b8ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:10:00.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.991+0000 7f211f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56385ea53bc0 0x56385ea9d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:00.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.991+0000 7f211f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56385ea53bc0 0x56385ea9d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46766/0 (socket says 172.21.15.99:46766) 2024-02-21T23:10:00.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.991+0000 7f211f400640 1 -- 172.21.15.99:0/2162828124 learned_addr learned my addr 172.21.15.99:0/2162828124 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:10:00.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.991+0000 7f211fe00640 1 --2- 172.21.15.99:0/2162828124 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56385ea532a0 0x56385ea9acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:00.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.991+0000 7f2125200640 1 --2- 172.21.15.99:0/2162828124 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56385ea89260 0x56385eaf7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:00.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.991+0000 7f211fe00640 1 -- 172.21.15.99:0/2162828124 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56385ea89260 msgr2=0x56385eaf7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:00.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.991+0000 7f211fe00640 1 --2- 172.21.15.99:0/2162828124 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56385ea89260 0x56385eaf7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:00.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.991+0000 7f211fe00640 1 -- 172.21.15.99:0/2162828124 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56385ea53bc0 msgr2=0x56385ea9d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:00.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.991+0000 7f211fe00640 1 --2- 172.21.15.99:0/2162828124 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56385ea53bc0 0x56385ea9d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:00.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.991+0000 7f211fe00640 1 -- 172.21.15.99:0/2162828124 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56385ea88e30 con 0x56385ea532a0 2024-02-21T23:10:00.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.991+0000 7f211f400640 1 --2- 172.21.15.99:0/2162828124 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56385ea53bc0 0x56385ea9d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:10:00.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.992+0000 7f211fe00640 1 --2- 172.21.15.99:0/2162828124 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56385ea532a0 0x56385ea9acb0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f2110001de0 tx=0x7f2110007d10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90789f227c4f0735 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:00.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.992+0000 7f2109600640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-02-21T23:10:00.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.992+0000 7f2109600640 1 -- 172.21.15.99:0/2162828124 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2110007500 con 0x56385ea532a0 2024-02-21T23:10:00.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.992+0000 7f212a057740 1 -- 172.21.15.99:0/2162828124 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f210c03ad00 con 0x56385ea532a0 2024-02-21T23:10:00.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.992+0000 7f2109600640 1 -- 172.21.15.99:0/2162828124 <== mon.2 v2:172.21.15.181:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f21100076a0 con 0x56385ea532a0 2024-02-21T23:10:00.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.992+0000 7f2109600640 1 -- 172.21.15.99:0/2162828124 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f211001e590 con 0x56385ea532a0 2024-02-21T23:10:00.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.992+0000 7f212a057740 10 client.6725 fetch_fsmap learned FSMap version 17 2024-02-21T23:10:00.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.992+0000 7f212a057740 1 -- 172.21.15.99:0/2162828124 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x56385ea213c0 con 0x56385ea532a0 2024-02-21T23:10:00.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.993+0000 7f2109600640 1 -- 172.21.15.99:0/2162828124 <== mon.2 v2:172.21.15.181:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f210c03ad00 con 0x56385ea532a0 2024-02-21T23:10:00.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.993+0000 7f2109600640 1 -- 172.21.15.99:0/2162828124 <== mon.2 v2:172.21.15.181:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f211001e730 con 0x56385ea532a0 2024-02-21T23:10:00.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.993+0000 7f212a057740 10 client.6725 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:10:00.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.993+0000 7f212a057740 10 client.6725 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:10:00.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.993+0000 7f212a057740 20 client.6725 populate_metadata read hostname 'smithi099' 2024-02-21T23:10:00.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.993+0000 7f212a057740 1 --2- 172.21.15.99:0/2162828124 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x56385ea9bf60 0x56385eaf8390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:00.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.993+0000 7f212a057740 4 client.6725 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T23:10:00.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.993+0000 7f212a057740 1 -- 172.21.15.99:0/2162828124 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56385e987320 con 0x56385ea9bf60 2024-02-21T23:10:00.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.993+0000 7f211f400640 1 --2- 172.21.15.99:0/2162828124 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x56385ea9bf60 0x56385eaf8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:00.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.994+0000 7f211f400640 1 --2- 172.21.15.99:0/2162828124 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x56385ea9bf60 0x56385eaf8390 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be4786d31aae0402 server_cookie=9213c6e7d8829872 in_seq=0 out_seq=0 2024-02-21T23:10:00.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.994+0000 7f2109600640 10 client.6725 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:10:00.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.994+0000 7f2109600640 1 -- 172.21.15.99:0/2162828124 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x56385e987320 con 0x56385ea9bf60 2024-02-21T23:10:00.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.994+0000 7f2109600640 10 client.6725 handle_command_reply: tid=0 2024-02-21T23:10:00.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.994+0000 7f212a057740 1 client.6725 shutdown 2024-02-21T23:10:00.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.994+0000 7f212a057740 1 -- 172.21.15.99:0/2162828124 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56385ea532a0 msgr2=0x56385ea9acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:00.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.994+0000 7f212a057740 1 --2- 172.21.15.99:0/2162828124 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56385ea532a0 0x56385ea9acb0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f2110001de0 tx=0x7f2110007d10 comp rx=0 tx=0).stop 2024-02-21T23:10:00.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.995+0000 7f212a057740 1 -- 172.21.15.99:0/2162828124 shutdown_connections 2024-02-21T23:10:00.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.995+0000 7f212a057740 1 --2- 172.21.15.99:0/2162828124 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x56385ea9bf60 0x56385eaf8390 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:00.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.995+0000 7f212a057740 1 --2- 172.21.15.99:0/2162828124 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56385ea89260 0x56385eaf7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:00.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.995+0000 7f212a057740 1 --2- 172.21.15.99:0/2162828124 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56385ea53bc0 0x56385ea9d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:00.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.995+0000 7f212a057740 1 --2- 172.21.15.99:0/2162828124 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56385ea532a0 0x56385ea9acb0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:00.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.995+0000 7f212a057740 1 -- 172.21.15.99:0/2162828124 >> 172.21.15.99:0/2162828124 conn(0x56385e9e26b0 msgr2=0x56385ea179f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:10:00.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.995+0000 7f2109600640 0 client.6725 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:10:00.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.995+0000 7f212a057740 1 -- 172.21.15.99:0/2162828124 shutdown_connections 2024-02-21T23:10:00.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.995+0000 7f212a057740 1 -- 172.21.15.99:0/2162828124 wait complete. 2024-02-21T23:10:00.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.995+0000 7f212a057740 20 client.6725 trim_cache size 0 max 16384 2024-02-21T23:10:00.995 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-02-21T23:10:00.995 INFO:teuthology.orchestra.run.smithi099.stdout: "status": "no active scrubs running", 2024-02-21T23:10:00.995 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubs": {} 2024-02-21T23:10:00.996 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-02-21T23:10:00.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.996+0000 7f2125c00640 1 -- 172.21.15.99:0/3565005548 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f210009eed0 msgr2=0x7f21000a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:00.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.996+0000 7f2125c00640 1 --2- 172.21.15.99:0/3565005548 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f210009eed0 0x7f21000a1390 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2120214de0 tx=0x7f2118009040 comp rx=0 tx=0).stop 2024-02-21T23:10:00.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.996+0000 7f2125c00640 1 -- 172.21.15.99:0/3565005548 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f21200740b0 msgr2=0x7f2120211e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:00.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.996+0000 7f2125c00640 1 --2- 172.21.15.99:0/3565005548 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f21200740b0 0x7f2120211e30 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f210c034040 tx=0x7f210c0046c0 comp rx=0 tx=0).stop 2024-02-21T23:10:00.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.996+0000 7f2125c00640 1 -- 172.21.15.99:0/3565005548 shutdown_connections 2024-02-21T23:10:00.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.996+0000 7f2125c00640 1 --2- 172.21.15.99:0/3565005548 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f210009eed0 0x7f21000a1390 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:00.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.996+0000 7f2125c00640 1 --2- 172.21.15.99:0/3565005548 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f2120074ba0 0x7f2120212370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:00.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.996+0000 7f2125c00640 1 --2- 172.21.15.99:0/3565005548 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f21200740b0 0x7f2120211e30 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:00.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.996+0000 7f2125c00640 1 --2- 172.21.15.99:0/3565005548 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f212006ff20 0x7f2120168dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:00.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.996+0000 7f2125c00640 1 -- 172.21.15.99:0/3565005548 >> 172.21.15.99:0/3565005548 conn(0x7f212008cfd0 msgr2=0x7f2120074490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:10:00.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.996+0000 7f2125c00640 1 -- 172.21.15.99:0/3565005548 shutdown_connections 2024-02-21T23:10:00.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:00.996+0000 7f2125c00640 1 -- 172.21.15.99:0/3565005548 wait complete. 2024-02-21T23:10:01.004 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-02-21T23:10:01.005 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T23:10:01.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.216+0000 7f1bdd400640 1 Processor -- start 2024-02-21T23:10:01.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.216+0000 7f1bdd400640 1 -- start start 2024-02-21T23:10:01.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.219+0000 7f1bdd400640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f1bd8182700 0x7f1bd80f5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:01.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.219+0000 7f1bdd400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f1bd8184e50 0x7f1bd81852e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:01.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.219+0000 7f1bdd400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bd8182ae0 con 0x7f1bd80cff40 2024-02-21T23:10:01.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.219+0000 7f1bdd400640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bd80f5900 con 0x7f1bd8184e50 2024-02-21T23:10:01.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.219+0000 7f1bdd400640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bd80d12f0 con 0x7f1bd8182700 2024-02-21T23:10:01.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.219+0000 7f1bd7e00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f1bd8182700 0x7f1bd80f5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:01.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.219+0000 7f1bd7e00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f1bd8182700 0x7f1bd80f5d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:46696/0 (socket says 172.21.15.99:46696) 2024-02-21T23:10:01.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.219+0000 7f1bd7e00640 1 -- 172.21.15.99:0/1357326455 learned_addr learned my addr 172.21.15.99:0/1357326455 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:10:01.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.219+0000 7f1bdca00640 1 --2- 172.21.15.99:0/1357326455 >> v2:172.21.15.162:3300/0 conn(0x7f1bd8184e50 0x7f1bd81852e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:01.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.219+0000 7f1bd7e00640 1 -- 172.21.15.99:0/1357326455 >> v2:172.21.15.162:3300/0 conn(0x7f1bd8184e50 msgr2=0x7f1bd81852e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:01.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.219+0000 7f1bd7e00640 1 --2- 172.21.15.99:0/1357326455 >> v2:172.21.15.162:3300/0 conn(0x7f1bd8184e50 0x7f1bd81852e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:01.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.219+0000 7f1bd7e00640 1 -- 172.21.15.99:0/1357326455 >> v1:172.21.15.162:6789/0 conn(0x7f1bd80cff40 legacy=0x7f1bd80d0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:01.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.220+0000 7f1bd7e00640 1 -- 172.21.15.99:0/1357326455 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bd80f4a10 con 0x7f1bd8182700 2024-02-21T23:10:01.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.221+0000 7f1bd7e00640 1 --2- 172.21.15.99:0/1357326455 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1bd8182700 0x7f1bd80f5d90 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f1bd80faee0 tx=0x7f1bc802b880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8fc68b7428f488c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:01.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.222+0000 7f1bd6a00640 1 -- 172.21.15.99:0/1357326455 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc802e070 con 0x7f1bd8182700 2024-02-21T23:10:01.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.222+0000 7f1bd6a00640 1 -- 172.21.15.99:0/1357326455 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bc8037070 con 0x7f1bd8182700 2024-02-21T23:10:01.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.222+0000 7f1bd6a00640 1 -- 172.21.15.99:0/1357326455 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc8031a00 con 0x7f1bd8182700 2024-02-21T23:10:01.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.222+0000 7f1bdd400640 1 -- 172.21.15.99:0/1357326455 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1bd8182700 msgr2=0x7f1bd80f5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:01.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.222+0000 7f1bdd400640 1 --2- 172.21.15.99:0/1357326455 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1bd8182700 0x7f1bd80f5d90 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f1bd80faee0 tx=0x7f1bc802b880 comp rx=0 tx=0).stop 2024-02-21T23:10:01.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.223+0000 7f1bdd400640 1 -- 172.21.15.99:0/1357326455 shutdown_connections 2024-02-21T23:10:01.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.223+0000 7f1bdd400640 1 --2- 172.21.15.99:0/1357326455 >> v2:172.21.15.162:3300/0 conn(0x7f1bd8184e50 0x7f1bd81852e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:01.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.223+0000 7f1bdd400640 1 --2- 172.21.15.99:0/1357326455 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1bd8182700 0x7f1bd80f5d90 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:01.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.223+0000 7f1bdd400640 1 -- 172.21.15.99:0/1357326455 >> 172.21.15.99:0/1357326455 conn(0x7f1bd80ce3c0 msgr2=0x7f1bd80ce7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:10:01.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.223+0000 7f1bdd400640 1 -- 172.21.15.99:0/1357326455 shutdown_connections 2024-02-21T23:10:01.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.223+0000 7f1bdd400640 1 -- 172.21.15.99:0/1357326455 wait complete. 2024-02-21T23:10:01.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.225+0000 7f1bdd400640 1 Processor -- start 2024-02-21T23:10:01.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.225+0000 7f1bdd400640 1 -- start start 2024-02-21T23:10:01.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.226+0000 7f1bdd400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1bd80cff40 0x7f1bd816b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:01.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.226+0000 7f1bdd400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1bd8182700 0x7f1bd8182cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:01.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.226+0000 7f1bdd400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1bd8184e50 0x7f1bd8183200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:01.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.226+0000 7f1bdd400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd80f52b0 con 0x7f1bd80cff40 2024-02-21T23:10:01.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.226+0000 7f1bdd400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd80f4fd0 con 0x7f1bd8182700 2024-02-21T23:10:01.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.226+0000 7f1bdd400640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd80f5590 con 0x7f1bd8184e50 2024-02-21T23:10:01.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.226+0000 7f1bd7e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1bd80cff40 0x7f1bd816b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:01.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.226+0000 7f1bd7e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1bd80cff40 0x7f1bd816b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46772/0 (socket says 172.21.15.99:46772) 2024-02-21T23:10:01.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.226+0000 7f1bd7e00640 1 -- 172.21.15.99:0/1713829497 learned_addr learned my addr 172.21.15.99:0/1713829497 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:10:01.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.227+0000 7f1bd7400640 1 --2- 172.21.15.99:0/1713829497 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1bd8182700 0x7f1bd8182cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:01.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.227+0000 7f1bdca00640 1 --2- 172.21.15.99:0/1713829497 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1bd8184e50 0x7f1bd8183200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:01.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.227+0000 7f1bdca00640 1 -- 172.21.15.99:0/1713829497 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1bd8182700 msgr2=0x7f1bd8182cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:01.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.227+0000 7f1bdca00640 1 --2- 172.21.15.99:0/1713829497 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1bd8182700 0x7f1bd8182cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:01.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.227+0000 7f1bdca00640 1 -- 172.21.15.99:0/1713829497 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1bd80cff40 msgr2=0x7f1bd816b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:01.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.227+0000 7f1bdca00640 1 --2- 172.21.15.99:0/1713829497 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1bd80cff40 0x7f1bd816b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:01.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.227+0000 7f1bdca00640 1 -- 172.21.15.99:0/1713829497 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bd8183740 con 0x7f1bd8184e50 2024-02-21T23:10:01.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.227+0000 7f1bd7e00640 1 --2- 172.21.15.99:0/1713829497 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1bd80cff40 0x7f1bd816b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:10:01.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.227+0000 7f1bd7400640 1 --2- 172.21.15.99:0/1713829497 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1bd8182700 0x7f1bd8182cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:10:01.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.227+0000 7f1bdca00640 1 --2- 172.21.15.99:0/1713829497 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1bd8184e50 0x7f1bd8183200 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f1bd000ebd0 tx=0x7f1bd000c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:01.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.228+0000 7f1bcfe00640 1 -- 172.21.15.99:0/1713829497 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd0018020 con 0x7f1bd8184e50 2024-02-21T23:10:01.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.228+0000 7f1bcfe00640 1 -- 172.21.15.99:0/1713829497 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bd000cd20 con 0x7f1bd8184e50 2024-02-21T23:10:01.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.228+0000 7f1bcfe00640 1 -- 172.21.15.99:0/1713829497 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd00146c0 con 0x7f1bd8184e50 2024-02-21T23:10:01.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.228+0000 7f1bdd400640 1 -- 172.21.15.99:0/1713829497 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bd81839e0 con 0x7f1bd8184e50 2024-02-21T23:10:01.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.228+0000 7f1bdd400640 1 -- 172.21.15.99:0/1713829497 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bd8183fa0 con 0x7f1bd8184e50 2024-02-21T23:10:01.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.229+0000 7f1bdd400640 1 -- 172.21.15.99:0/1713829497 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bd8068320 con 0x7f1bd8184e50 2024-02-21T23:10:01.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.233+0000 7f1bcfe00640 1 -- 172.21.15.99:0/1713829497 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f1bd0005d10 con 0x7f1bd8184e50 2024-02-21T23:10:01.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.235+0000 7f1bcfe00640 1 --2- 172.21.15.99:0/1713829497 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f1bb809eed0 0x7f1bb80a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:01.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.235+0000 7f1bcfe00640 1 -- 172.21.15.99:0/1713829497 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f1bd00cac30 con 0x7f1bd8184e50 2024-02-21T23:10:01.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.235+0000 7f1bd7e00640 1 --2- 172.21.15.99:0/1713829497 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f1bb809eed0 0x7f1bb80a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:01.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.236+0000 7f1bd7e00640 1 --2- 172.21.15.99:0/1713829497 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f1bb809eed0 0x7f1bb80a1390 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1bc80090b0 tx=0x7f1bc803d040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:01.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.238+0000 7f1bcfe00640 1 -- 172.21.15.99:0/1713829497 <== mon.2 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f1bd0022030 con 0x7f1bd8184e50 2024-02-21T23:10:01.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.484+0000 7f1bdd400640 1 -- 172.21.15.99:0/1713829497 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1bd80f0d80 con 0x7f1bd8184e50 2024-02-21T23:10:01.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.485+0000 7f1bcfe00640 1 -- 172.21.15.99:0/1713829497 <== mon.2 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+11335 (secure 0 0 0) 0x7f1bd0010040 con 0x7f1bd8184e50 2024-02-21T23:10:01.474 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T23:10:01.474 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4307,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/3514452812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3514452812},{"type":"v1","addr":"172.21.15.162:6836","nonce":3514452812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4312,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6838/2169982089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":2169982089},{"type":"v1","addr":"172.21.15.162:6838","nonce":2169982089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4315,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6839/3335972724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6837","nonce":3335972724},{"type":"v1","addr":"172.21.15.162:6839","nonce":3335972724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4318,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6841/2135456697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6840","nonce":2135456697},{"type":"v1","addr":"172.21.15.162:6841","nonce":2135456697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4325,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2452242758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2452242758},{"type":"v1","addr":"172.21.15.181:6833","nonce":2452242758}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4328,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6836/2751486400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":2751486400},{"type":"v1","addr":"172.21.15.181:6836","nonce":2751486400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":17,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-21T23:01:02.656130+0000","modified":"2024-02-21T23:07:03.165223+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4355,"mds_1":4352,"mds_2":4348},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4331":{"gid":4331,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6838/3728901330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6835","nonce":3728901330},{"type":"v1","addr":"172.21.15.181:6838","nonce":3728901330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4339":{"gid":4339,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6839/3357929641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6837","nonce":3357929641},{"type":"v1","addr":"172.21.15.181:6839","nonce":3357929641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4343":{"gid":4343,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6833/2793485078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":2793485078},{"type":"v1","addr":"172.21.15.99:6833","nonce":2793485078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4348":{"gid":4348,"name":"d","rank":2,"incarnation":12,"state":"up:active","state_seq":10,"addr":"172.21.15.99:6835/2243461688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2243461688},{"type":"v1","addr":"172.21.15.99:6835","nonce":2243461688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4352":{"gid":4352,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.99:6837/1676159950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":1676159950},{"type":"v1","addr":"172.21.15.99:6837","nonce":1676159950}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4355":{"gid":4355,"name":"j","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6839/4239008786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":4239008786},{"type":"v1","addr":"172.21.15.99:6839","nonce":4239008786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-21T23:10:01.474 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 17 2024-02-21T23:10:01.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.489+0000 7f1bdd400640 1 -- 172.21.15.99:0/1713829497 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f1bb809eed0 msgr2=0x7f1bb80a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:01.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.489+0000 7f1bdd400640 1 --2- 172.21.15.99:0/1713829497 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f1bb809eed0 0x7f1bb80a1390 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1bc80090b0 tx=0x7f1bc803d040 comp rx=0 tx=0).stop 2024-02-21T23:10:01.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.489+0000 7f1bdd400640 1 -- 172.21.15.99:0/1713829497 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1bd8184e50 msgr2=0x7f1bd8183200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:01.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.489+0000 7f1bdd400640 1 --2- 172.21.15.99:0/1713829497 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1bd8184e50 0x7f1bd8183200 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f1bd000ebd0 tx=0x7f1bd000c490 comp rx=0 tx=0).stop 2024-02-21T23:10:01.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.489+0000 7f1bdd400640 1 -- 172.21.15.99:0/1713829497 shutdown_connections 2024-02-21T23:10:01.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.489+0000 7f1bdd400640 1 --2- 172.21.15.99:0/1713829497 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f1bb809eed0 0x7f1bb80a1390 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:01.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.489+0000 7f1bdd400640 1 --2- 172.21.15.99:0/1713829497 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1bd8184e50 0x7f1bd8183200 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:01.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.489+0000 7f1bdd400640 1 --2- 172.21.15.99:0/1713829497 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1bd8182700 0x7f1bd8182cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:01.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.489+0000 7f1bdd400640 1 --2- 172.21.15.99:0/1713829497 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1bd80cff40 0x7f1bd816b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:01.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.489+0000 7f1bdd400640 1 -- 172.21.15.99:0/1713829497 >> 172.21.15.99:0/1713829497 conn(0x7f1bd80ce3c0 msgr2=0x7f1bd8188b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:10:01.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.489+0000 7f1bdd400640 1 -- 172.21.15.99:0/1713829497 shutdown_connections 2024-02-21T23:10:01.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.489+0000 7f1bdd400640 1 -- 172.21.15.99:0/1713829497 wait complete. 2024-02-21T23:10:01.500 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T23:10:01.501 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-02-21T23:10:01.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.716+0000 7f1da5e00640 1 Processor -- start 2024-02-21T23:10:01.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.716+0000 7f1da5e00640 1 -- start start 2024-02-21T23:10:01.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.717+0000 7f1da5e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f1da0186650 0x7f1da018b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:01.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.717+0000 7f1da5e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f1da01899b0 0x7f1da018bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:01.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.717+0000 7f1da5e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1da018a330 con 0x7f1da018c1e0 2024-02-21T23:10:01.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.718+0000 7f1da5e00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1da006f920 con 0x7f1da0186650 2024-02-21T23:10:01.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.718+0000 7f1da5e00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1da018a0e0 con 0x7f1da01899b0 2024-02-21T23:10:01.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.718+0000 7f1d9ea00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f1da0186650 0x7f1da018b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:01.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.718+0000 7f1d97e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f1da01899b0 0x7f1da018bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:01.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.718+0000 7f1d9f400640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f1da018c1e0 0x7f1da018c690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.99:43726/0 (socket says 172.21.15.99:43726) 2024-02-21T23:10:01.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.718+0000 7f1d9f400640 1 -- 172.21.15.99:0/4249785723 learned_addr learned my addr 172.21.15.99:0/4249785723 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:10:01.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.718+0000 7f1d9ea00640 1 --2- 172.21.15.99:0/4249785723 >> v2:172.21.15.99:3300/0 conn(0x7f1da0186650 0x7f1da018b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46774/0 (socket says 172.21.15.99:46774) 2024-02-21T23:10:01.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.718+0000 7f1d9e000640 1 -- 172.21.15.99:0/4249785723 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4258135478 0 0) 0x7f1da018a330 con 0x7f1da018c1e0 2024-02-21T23:10:01.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.718+0000 7f1d97e00640 1 -- 172.21.15.99:0/4249785723 >> v2:172.21.15.99:3300/0 conn(0x7f1da0186650 msgr2=0x7f1da018b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:01.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.718+0000 7f1d97e00640 1 --2- 172.21.15.99:0/4249785723 >> v2:172.21.15.99:3300/0 conn(0x7f1da0186650 0x7f1da018b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:01.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.718+0000 7f1d97e00640 1 -- 172.21.15.99:0/4249785723 >> v1:172.21.15.162:6789/0 conn(0x7f1da018c1e0 legacy=0x7f1da018c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:01.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.718+0000 7f1d97e00640 1 -- 172.21.15.99:0/4249785723 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1da018a610 con 0x7f1da01899b0 2024-02-21T23:10:01.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.720+0000 7f1d97e00640 1 --2- 172.21.15.99:0/4249785723 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1da01899b0 0x7f1da018bbf0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f1da008d160 tx=0x7f1d8802b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=581bb0d0a37d7064 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:01.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.720+0000 7f1d9e000640 1 -- 172.21.15.99:0/4249785723 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d880315a0 con 0x7f1da01899b0 2024-02-21T23:10:01.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.720+0000 7f1d9e000640 1 -- 172.21.15.99:0/4249785723 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d88037070 con 0x7f1da01899b0 2024-02-21T23:10:01.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.720+0000 7f1d9e000640 1 -- 172.21.15.99:0/4249785723 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d88031960 con 0x7f1da01899b0 2024-02-21T23:10:01.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.720+0000 7f1da5e00640 1 -- 172.21.15.99:0/4249785723 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1da01899b0 msgr2=0x7f1da018bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:01.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.720+0000 7f1da5e00640 1 --2- 172.21.15.99:0/4249785723 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1da01899b0 0x7f1da018bbf0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f1da008d160 tx=0x7f1d8802b840 comp rx=0 tx=0).stop 2024-02-21T23:10:01.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.721+0000 7f1da5e00640 1 -- 172.21.15.99:0/4249785723 shutdown_connections 2024-02-21T23:10:01.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.721+0000 7f1da5e00640 1 --2- 172.21.15.99:0/4249785723 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1da01899b0 0x7f1da018bbf0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:01.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.721+0000 7f1da5e00640 1 --2- 172.21.15.99:0/4249785723 >> v2:172.21.15.99:3300/0 conn(0x7f1da0186650 0x7f1da018b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:01.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.721+0000 7f1da5e00640 1 -- 172.21.15.99:0/4249785723 >> 172.21.15.99:0/4249785723 conn(0x7f1da00ce5f0 msgr2=0x7f1da00cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:10:01.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.721+0000 7f1da5e00640 1 -- 172.21.15.99:0/4249785723 shutdown_connections 2024-02-21T23:10:01.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.721+0000 7f1da5e00640 1 -- 172.21.15.99:0/4249785723 wait complete. 2024-02-21T23:10:01.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.723+0000 7f1da5e00640 1 Processor -- start 2024-02-21T23:10:01.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.723+0000 7f1da5e00640 1 -- start start 2024-02-21T23:10:01.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.725+0000 7f1da5e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1da0186650 0x7f1da0171040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:01.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.725+0000 7f1da5e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1da01899b0 0x7f1da00f52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:01.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.725+0000 7f1da5e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1da018c1e0 0x7f1da00f57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:01.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.725+0000 7f1da5e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da018aeb0 con 0x7f1da01899b0 2024-02-21T23:10:01.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.725+0000 7f1da5e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da018abd0 con 0x7f1da018c1e0 2024-02-21T23:10:01.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.725+0000 7f1da5e00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da018b190 con 0x7f1da0186650 2024-02-21T23:10:01.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.725+0000 7f1d97e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1da01899b0 0x7f1da00f52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:01.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.726+0000 7f1d9ea00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1da0186650 0x7f1da0171040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:01.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.726+0000 7f1d97e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1da01899b0 0x7f1da00f52b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46788/0 (socket says 172.21.15.99:46788) 2024-02-21T23:10:01.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.726+0000 7f1d97e00640 1 -- 172.21.15.99:0/3097583366 learned_addr learned my addr 172.21.15.99:0/3097583366 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:10:01.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.726+0000 7f1d9f400640 1 --2- 172.21.15.99:0/3097583366 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1da018c1e0 0x7f1da00f57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:01.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.726+0000 7f1d9ea00640 1 -- 172.21.15.99:0/3097583366 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1da018c1e0 msgr2=0x7f1da00f57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:01.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.726+0000 7f1d9ea00640 1 --2- 172.21.15.99:0/3097583366 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1da018c1e0 0x7f1da00f57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:01.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.726+0000 7f1d9ea00640 1 -- 172.21.15.99:0/3097583366 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1da01899b0 msgr2=0x7f1da00f52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:01.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.726+0000 7f1d9ea00640 1 --2- 172.21.15.99:0/3097583366 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1da01899b0 0x7f1da00f52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:01.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.726+0000 7f1d9ea00640 1 -- 172.21.15.99:0/3097583366 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1da00f6020 con 0x7f1da0186650 2024-02-21T23:10:01.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.726+0000 7f1d97e00640 1 --2- 172.21.15.99:0/3097583366 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1da01899b0 0x7f1da00f52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:10:01.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.726+0000 7f1d9ea00640 1 --2- 172.21.15.99:0/3097583366 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1da0186650 0x7f1da0171040 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f1d9000e8a0 tx=0x7f1d9000ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:01.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.727+0000 7f1d97400640 1 -- 172.21.15.99:0/3097583366 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d90017070 con 0x7f1da0186650 2024-02-21T23:10:01.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.727+0000 7f1d97400640 1 -- 172.21.15.99:0/3097583366 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d9000c940 con 0x7f1da0186650 2024-02-21T23:10:01.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.727+0000 7f1d97400640 1 -- 172.21.15.99:0/3097583366 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d90009e60 con 0x7f1da0186650 2024-02-21T23:10:01.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.727+0000 7f1da5e00640 1 -- 172.21.15.99:0/3097583366 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1da00f6300 con 0x7f1da0186650 2024-02-21T23:10:01.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.727+0000 7f1da5e00640 1 -- 172.21.15.99:0/3097583366 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1da00f68c0 con 0x7f1da0186650 2024-02-21T23:10:01.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.731+0000 7f1d97400640 1 -- 172.21.15.99:0/3097583366 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f1d9001a070 con 0x7f1da0186650 2024-02-21T23:10:01.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.732+0000 7f1da8da6740 1 Processor -- start 2024-02-21T23:10:01.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.732+0000 7f1da8da6740 1 -- start start 2024-02-21T23:10:01.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.733+0000 7f1d97400640 1 --2- 172.21.15.99:0/3097583366 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f1d7c09ef00 0x7f1d7c0a13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:01.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.734+0000 7f1d97400640 1 -- 172.21.15.99:0/3097583366 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f1d900c9fe0 con 0x7f1da0186650 2024-02-21T23:10:01.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.734+0000 7f1d9f400640 1 --2- 172.21.15.99:0/3097583366 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f1d7c09ef00 0x7f1d7c0a13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:01.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.734+0000 7f1da8da6740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558c2308d4b0 0x558c2308d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:01.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.734+0000 7f1da8da6740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558c230c8180 0x558c230c8600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:01.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.734+0000 7f1d9f400640 1 --2- 172.21.15.99:0/3097583366 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f1d7c09ef00 0x7f1d7c0a13c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1d980018a0 tx=0x7f1d98001830 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:01.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.734+0000 7f1da8da6740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c230c8b40 0x558c230c93b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:01.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.734+0000 7f1da8da6740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c22fb5b50 con 0x558c2308d4b0 2024-02-21T23:10:01.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.734+0000 7f1da8da6740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c22f5eda0 con 0x558c230c8b40 2024-02-21T23:10:01.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.734+0000 7f1da8da6740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c22fb1bf0 con 0x558c230c8180 2024-02-21T23:10:01.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.735+0000 7f1d9ea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558c2308d4b0 0x558c2308d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:01.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.735+0000 7f1d9f400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c230c8b40 0x558c230c93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:01.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.735+0000 7f1d9ea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558c2308d4b0 0x558c2308d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46800/0 (socket says 172.21.15.99:46800) 2024-02-21T23:10:01.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.735+0000 7f1d9ea00640 1 -- 172.21.15.99:0/620775284 learned_addr learned my addr 172.21.15.99:0/620775284 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:10:01.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.735+0000 7f1d97e00640 1 --2- 172.21.15.99:0/620775284 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558c230c8180 0x558c230c8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:01.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.735+0000 7f1d9ea00640 1 -- 172.21.15.99:0/620775284 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558c230c8180 msgr2=0x558c230c8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:01.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.735+0000 7f1d9ea00640 1 --2- 172.21.15.99:0/620775284 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558c230c8180 0x558c230c8600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:01.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.735+0000 7f1d9ea00640 1 -- 172.21.15.99:0/620775284 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c230c8b40 msgr2=0x558c230c93b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:01.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.735+0000 7f1d9ea00640 1 --2- 172.21.15.99:0/620775284 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c230c8b40 0x558c230c93b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:01.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.735+0000 7f1d9ea00640 1 -- 172.21.15.99:0/620775284 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558c22f81f80 con 0x558c2308d4b0 2024-02-21T23:10:01.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.736+0000 7f1d9ea00640 1 --2- 172.21.15.99:0/620775284 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558c2308d4b0 0x558c2308d890 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f1d900c7740 tx=0x7f1d90095b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a9eff5f0ea3cb6b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:01.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.736+0000 7f1d8f400640 1 -- 172.21.15.99:0/620775284 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d90021040 con 0x558c2308d4b0 2024-02-21T23:10:01.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.736+0000 7f1d8f400640 1 -- 172.21.15.99:0/620775284 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d9000cd10 con 0x558c2308d4b0 2024-02-21T23:10:01.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.736+0000 7f1d8f400640 1 -- 172.21.15.99:0/620775284 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d90098bc0 con 0x558c2308d4b0 2024-02-21T23:10:01.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.736+0000 7f1da8da6740 1 -- 172.21.15.99:0/620775284 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558c2308d4b0 msgr2=0x558c2308d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:01.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.736+0000 7f1da8da6740 1 --2- 172.21.15.99:0/620775284 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558c2308d4b0 0x558c2308d890 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f1d900c7740 tx=0x7f1d90095b80 comp rx=0 tx=0).stop 2024-02-21T23:10:01.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.737+0000 7f1da8da6740 1 -- 172.21.15.99:0/620775284 shutdown_connections 2024-02-21T23:10:01.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.737+0000 7f1da8da6740 1 --2- 172.21.15.99:0/620775284 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c230c8b40 0x558c230c93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:01.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.737+0000 7f1da8da6740 1 --2- 172.21.15.99:0/620775284 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558c230c8180 0x558c230c8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:01.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.737+0000 7f1da8da6740 1 --2- 172.21.15.99:0/620775284 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558c2308d4b0 0x558c2308d890 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:01.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.737+0000 7f1da8da6740 1 -- 172.21.15.99:0/620775284 >> 172.21.15.99:0/620775284 conn(0x558c2304f520 msgr2=0x558c230505a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:10:01.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.737+0000 7f1da8da6740 1 -- 172.21.15.99:0/620775284 shutdown_connections 2024-02-21T23:10:01.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.737+0000 7f1da8da6740 1 -- 172.21.15.99:0/620775284 wait complete. 2024-02-21T23:10:01.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.738+0000 7f1da8da6740 1 -- start start 2024-02-21T23:10:01.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.738+0000 7f1da8da6740 1 Processor -- start 2024-02-21T23:10:01.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.740+0000 7f1da8da6740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c230c8180 0x558c2307ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:01.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.740+0000 7f1da8da6740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558c230c8b40 0x558c2307c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:01.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.740+0000 7f1da8da6740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558c23081220 0x558c2307f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:01.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.740+0000 7f1da8da6740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c230c6ef0 con 0x558c230c8b40 2024-02-21T23:10:01.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.740+0000 7f1da8da6740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c22f54380 con 0x558c230c8180 2024-02-21T23:10:01.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.740+0000 7f1da8da6740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c230c6c10 con 0x558c23081220 2024-02-21T23:10:01.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.740+0000 7f1da8da6740 10 client.0 _ll_register_callbacks cb 0x558c22fad280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:10:01.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.740+0000 7f1d97e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558c230c8b40 0x558c2307c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:01.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.741+0000 7f1d97e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558c230c8b40 0x558c2307c270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46816/0 (socket says 172.21.15.99:46816) 2024-02-21T23:10:01.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.741+0000 7f1d97e00640 1 -- 172.21.15.99:0/3697812088 learned_addr learned my addr 172.21.15.99:0/3697812088 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:10:01.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.741+0000 7f1d9ea00640 1 --2- 172.21.15.99:0/3697812088 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c230c8180 0x558c2307ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:01.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.741+0000 7f1d9f400640 1 --2- 172.21.15.99:0/3697812088 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558c23081220 0x558c2307f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:01.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.741+0000 7f1d97e00640 1 -- 172.21.15.99:0/3697812088 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558c23081220 msgr2=0x558c2307f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:01.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.741+0000 7f1d97e00640 1 --2- 172.21.15.99:0/3697812088 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558c23081220 0x558c2307f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:01.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.741+0000 7f1d97e00640 1 -- 172.21.15.99:0/3697812088 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c230c8180 msgr2=0x558c2307ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:01.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.741+0000 7f1d97e00640 1 --2- 172.21.15.99:0/3697812088 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c230c8180 0x558c2307ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:01.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.741+0000 7f1d97e00640 1 -- 172.21.15.99:0/3697812088 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558c22f7cc20 con 0x558c230c8b40 2024-02-21T23:10:01.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.741+0000 7f1d97e00640 1 --2- 172.21.15.99:0/3697812088 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558c230c8b40 0x558c2307c270 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f1d88009890 tx=0x7f1d88004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20c667838052db6e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:01.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.741+0000 7f1d83e00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:10:01.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.742+0000 7f1d83e00640 1 -- 172.21.15.99:0/3697812088 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8804a020 con 0x558c230c8b40 2024-02-21T23:10:01.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.742+0000 7f1d83e00640 1 -- 172.21.15.99:0/3697812088 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f1d88046640 con 0x558c230c8b40 2024-02-21T23:10:01.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.742+0000 7f1da8da6740 1 -- 172.21.15.99:0/3697812088 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1d9000cd10 con 0x558c230c8b40 2024-02-21T23:10:01.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.742+0000 7f1d83e00640 1 -- 172.21.15.99:0/3697812088 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1d88046840 con 0x558c230c8b40 2024-02-21T23:10:01.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.742+0000 7f1da8da6740 10 client.6612 fetch_fsmap learned FSMap version 17 2024-02-21T23:10:01.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.742+0000 7f1da8da6740 1 -- 172.21.15.99:0/3697812088 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x558c22cca3f0 con 0x558c230c8b40 2024-02-21T23:10:01.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.743+0000 7f1d83e00640 1 -- 172.21.15.99:0/3697812088 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d9000cd10 con 0x558c230c8b40 2024-02-21T23:10:01.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.743+0000 7f1d83e00640 1 -- 172.21.15.99:0/3697812088 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f1d88031070 con 0x558c230c8b40 2024-02-21T23:10:01.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.743+0000 7f1da8da6740 10 client.6612 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:10:01.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.743+0000 7f1da8da6740 10 client.6612 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.d 2024-02-21T23:10:01.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.743+0000 7f1da8da6740 20 client.6612 populate_metadata read hostname 'smithi099' 2024-02-21T23:10:01.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.743+0000 7f1da8da6740 1 --2- 172.21.15.99:0/3697812088 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x558c230d1fd0 0x558c230c5640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:01.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.743+0000 7f1da8da6740 4 client.6612 mds_command: new command op to 4348 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:10:01.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.743+0000 7f1da8da6740 1 -- 172.21.15.99:0/3697812088 --> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558c22fc3090 con 0x558c230d1fd0 2024-02-21T23:10:01.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.744+0000 7f1d9ea00640 1 --2- 172.21.15.99:0/3697812088 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x558c230d1fd0 0x558c230c5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:01.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.744+0000 7f1d9ea00640 1 --2- 172.21.15.99:0/3697812088 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x558c230d1fd0 0x558c230c5640 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=983bb2598d87c211 server_cookie=ef687b30ab41353a in_seq=0 out_seq=0 2024-02-21T23:10:01.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.744+0000 7f1d83e00640 10 client.6612 ms_handle_connect on v2:172.21.15.99:6834/2243461688 2024-02-21T23:10:01.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.745+0000 7f1d83e00640 1 -- 172.21.15.99:0/3697812088 <== mds.2 v2:172.21.15.99:6834/2243461688 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x558c22fc3090 con 0x558c230d1fd0 2024-02-21T23:10:01.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.745+0000 7f1d83e00640 10 client.6612 handle_command_reply: tid=0 2024-02-21T23:10:01.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.745+0000 7f1da8da6740 1 client.6612 shutdown 2024-02-21T23:10:01.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.745+0000 7f1da8da6740 1 -- 172.21.15.99:0/3697812088 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558c230c8b40 msgr2=0x558c2307c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:01.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.745+0000 7f1da8da6740 1 --2- 172.21.15.99:0/3697812088 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558c230c8b40 0x558c2307c270 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f1d88009890 tx=0x7f1d88004730 comp rx=0 tx=0).stop 2024-02-21T23:10:01.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.746+0000 7f1da8da6740 1 -- 172.21.15.99:0/3697812088 shutdown_connections 2024-02-21T23:10:01.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.746+0000 7f1da8da6740 1 --2- 172.21.15.99:0/3697812088 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x558c230d1fd0 0x558c230c5640 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:01.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.746+0000 7f1da8da6740 1 --2- 172.21.15.99:0/3697812088 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558c23081220 0x558c2307f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:01.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.746+0000 7f1da8da6740 1 --2- 172.21.15.99:0/3697812088 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558c230c8b40 0x558c2307c270 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:01.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.746+0000 7f1da8da6740 1 --2- 172.21.15.99:0/3697812088 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c230c8180 0x558c2307ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:01.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.746+0000 7f1da8da6740 1 -- 172.21.15.99:0/3697812088 >> 172.21.15.99:0/3697812088 conn(0x558c2308d4b0 msgr2=0x558c23083770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:10:01.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.746+0000 7f1d83e00640 0 client.6612 ms_handle_reset on v2:172.21.15.99:6834/2243461688 2024-02-21T23:10:01.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.746+0000 7f1da8da6740 1 -- 172.21.15.99:0/3697812088 shutdown_connections 2024-02-21T23:10:01.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.746+0000 7f1da8da6740 1 -- 172.21.15.99:0/3697812088 wait complete. 2024-02-21T23:10:01.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.746+0000 7f1da8da6740 20 client.6612 trim_cache size 0 max 16384 2024-02-21T23:10:01.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.763+0000 7f1da8da6740 1 Processor -- start 2024-02-21T23:10:01.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.763+0000 7f1da8da6740 1 -- start start 2024-02-21T23:10:01.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.765+0000 7f1da8da6740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558c23081220 0x558c230c8560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:01.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.765+0000 7f1da8da6740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558c230c8180 0x558c230d4be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:01.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.765+0000 7f1da8da6740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c230c8b40 0x558c23055fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:01.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.765+0000 7f1da8da6740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da022c9a0 con 0x558c23081220 2024-02-21T23:10:01.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.765+0000 7f1da8da6740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da022a540 con 0x558c230c8b40 2024-02-21T23:10:01.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.765+0000 7f1da8da6740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da0228670 con 0x558c230c8180 2024-02-21T23:10:01.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.765+0000 7f1d9ea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558c23081220 0x558c230c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:01.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.765+0000 7f1d97e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558c230c8180 0x558c230d4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:01.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.765+0000 7f1d97e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558c230c8180 0x558c230d4be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:46728/0 (socket says 172.21.15.99:46728) 2024-02-21T23:10:01.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.765+0000 7f1d97e00640 1 -- 172.21.15.99:0/3990604477 learned_addr learned my addr 172.21.15.99:0/3990604477 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:10:01.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.765+0000 7f1d9f400640 1 --2- 172.21.15.99:0/3990604477 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c230c8b40 0x558c23055fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:01.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.766+0000 7f1d97e00640 1 -- 172.21.15.99:0/3990604477 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c230c8b40 msgr2=0x558c23055fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:01.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.766+0000 7f1d97e00640 1 --2- 172.21.15.99:0/3990604477 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c230c8b40 0x558c23055fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:01.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.766+0000 7f1d97e00640 1 -- 172.21.15.99:0/3990604477 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558c23081220 msgr2=0x558c230c8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:01.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.766+0000 7f1d97e00640 1 --2- 172.21.15.99:0/3990604477 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558c23081220 0x558c230c8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:01.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.766+0000 7f1d97e00640 1 -- 172.21.15.99:0/3990604477 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558c22d947d0 con 0x558c230c8180 2024-02-21T23:10:01.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.766+0000 7f1d97e00640 1 --2- 172.21.15.99:0/3990604477 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558c230c8180 0x558c230d4be0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f1d88009860 tx=0x7f1d88042000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16fdc7aa828ae09 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:01.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.766+0000 7f1d8ea00640 1 -- 172.21.15.99:0/3990604477 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8804a070 con 0x558c230c8180 2024-02-21T23:10:01.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.766+0000 7f1d8ea00640 1 -- 172.21.15.99:0/3990604477 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d88037040 con 0x558c230c8180 2024-02-21T23:10:01.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.766+0000 7f1d8ea00640 1 -- 172.21.15.99:0/3990604477 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d88031c60 con 0x558c230c8180 2024-02-21T23:10:01.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.767+0000 7f1da8da6740 1 -- 172.21.15.99:0/3990604477 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558c230c8180 msgr2=0x558c230d4be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:01.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.767+0000 7f1da8da6740 1 --2- 172.21.15.99:0/3990604477 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558c230c8180 0x558c230d4be0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f1d88009860 tx=0x7f1d88042000 comp rx=0 tx=0).stop 2024-02-21T23:10:01.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.767+0000 7f1da8da6740 1 -- 172.21.15.99:0/3990604477 shutdown_connections 2024-02-21T23:10:01.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.767+0000 7f1da8da6740 1 --2- 172.21.15.99:0/3990604477 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c230c8b40 0x558c23055fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:01.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.767+0000 7f1da8da6740 1 --2- 172.21.15.99:0/3990604477 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558c230c8180 0x558c230d4be0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:01.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.767+0000 7f1da8da6740 1 --2- 172.21.15.99:0/3990604477 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558c23081220 0x558c230c8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:01.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.767+0000 7f1da8da6740 1 -- 172.21.15.99:0/3990604477 >> 172.21.15.99:0/3990604477 conn(0x558c2308d4b0 msgr2=0x558c2307c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:10:01.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.767+0000 7f1da8da6740 1 -- 172.21.15.99:0/3990604477 shutdown_connections 2024-02-21T23:10:01.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.767+0000 7f1da8da6740 1 -- 172.21.15.99:0/3990604477 wait complete. 2024-02-21T23:10:01.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.768+0000 7f1da8da6740 1 -- start start 2024-02-21T23:10:01.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.768+0000 7f1da8da6740 1 Processor -- start 2024-02-21T23:10:01.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.770+0000 7f1da8da6740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c23081220 0x558c2304e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:01.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.770+0000 7f1da8da6740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558c230c8180 0x558c230579c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:01.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.770+0000 7f1da8da6740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558c230c8b40 0x558c23079110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:01.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.770+0000 7f1da8da6740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da0228c20 con 0x558c230c8b40 2024-02-21T23:10:01.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.770+0000 7f1da8da6740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da0229ee0 con 0x558c23081220 2024-02-21T23:10:01.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.770+0000 7f1da8da6740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da0229220 con 0x558c230c8180 2024-02-21T23:10:01.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.770+0000 7f1da8da6740 10 client.0 _ll_register_callbacks cb 0x7f1d88006e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:10:01.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.770+0000 7f1d97e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558c230c8180 0x558c230579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:01.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.770+0000 7f1d9ea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c23081220 0x558c2304e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:01.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.770+0000 7f1d9f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558c230c8b40 0x558c23079110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:01.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.770+0000 7f1d97e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558c230c8180 0x558c230579c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:46742/0 (socket says 172.21.15.99:46742) 2024-02-21T23:10:01.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.770+0000 7f1d97e00640 1 -- 172.21.15.99:0/3380366414 learned_addr learned my addr 172.21.15.99:0/3380366414 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:10:01.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.770+0000 7f1d9ea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c23081220 0x558c2304e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:41386/0 (socket says 172.21.15.99:41386) 2024-02-21T23:10:01.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.771+0000 7f1d97e00640 1 -- 172.21.15.99:0/3380366414 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c23081220 msgr2=0x558c2304e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:01.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.771+0000 7f1d97e00640 1 --2- 172.21.15.99:0/3380366414 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c23081220 0x558c2304e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:01.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.771+0000 7f1d97e00640 1 -- 172.21.15.99:0/3380366414 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558c230c8b40 msgr2=0x558c23079110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:01.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.771+0000 7f1d97e00640 1 --2- 172.21.15.99:0/3380366414 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558c230c8b40 0x558c23079110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:01.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.771+0000 7f1d97e00640 1 -- 172.21.15.99:0/3380366414 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558c230508e0 con 0x558c230c8180 2024-02-21T23:10:01.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.771+0000 7f1d97e00640 1 --2- 172.21.15.99:0/3380366414 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558c230c8180 0x558c230579c0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f1d88034040 tx=0x7f1d88031000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40578a03e4eef81b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:01.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.771+0000 7f1d83e00640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-02-21T23:10:01.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.771+0000 7f1d83e00640 1 -- 172.21.15.99:0/3380366414 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8804a070 con 0x558c230c8180 2024-02-21T23:10:01.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.771+0000 7f1da8da6740 1 -- 172.21.15.99:0/3380366414 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1d88037040 con 0x558c230c8180 2024-02-21T23:10:01.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.771+0000 7f1d83e00640 1 -- 172.21.15.99:0/3380366414 <== mon.2 v2:172.21.15.181:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f1d880319c0 con 0x558c230c8180 2024-02-21T23:10:01.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.772+0000 7f1d83e00640 1 -- 172.21.15.99:0/3380366414 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1d88031bc0 con 0x558c230c8180 2024-02-21T23:10:01.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.772+0000 7f1da8da6740 10 client.6746 fetch_fsmap learned FSMap version 17 2024-02-21T23:10:01.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.772+0000 7f1da8da6740 1 -- 172.21.15.99:0/3380366414 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x558c2307d090 con 0x558c230c8180 2024-02-21T23:10:01.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.772+0000 7f1d83e00640 1 -- 172.21.15.99:0/3380366414 <== mon.2 v2:172.21.15.181:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d88037040 con 0x558c230c8180 2024-02-21T23:10:01.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.772+0000 7f1d83e00640 1 -- 172.21.15.99:0/3380366414 <== mon.2 v2:172.21.15.181:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f1d88004040 con 0x558c230c8180 2024-02-21T23:10:01.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.772+0000 7f1da8da6740 10 client.6746 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:10:01.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.772+0000 7f1da8da6740 10 client.6746 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.d 2024-02-21T23:10:01.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.772+0000 7f1da8da6740 20 client.6746 populate_metadata read hostname 'smithi099' 2024-02-21T23:10:01.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.772+0000 7f1da8da6740 1 --2- 172.21.15.99:0/3380366414 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x558c23089760 0x558c230c6430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:01.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.772+0000 7f1da8da6740 4 client.6746 mds_command: new command op to 4348 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T23:10:01.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.772+0000 7f1da8da6740 1 -- 172.21.15.99:0/3380366414 --> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x558c22fbd3e0 con 0x558c23089760 2024-02-21T23:10:01.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.773+0000 7f1d9ea00640 1 --2- 172.21.15.99:0/3380366414 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x558c23089760 0x558c230c6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:01.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.773+0000 7f1d9ea00640 1 --2- 172.21.15.99:0/3380366414 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x558c23089760 0x558c230c6430 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=410f16b606fcfbf1 server_cookie=2ad89fd93c6aeef9 in_seq=0 out_seq=0 2024-02-21T23:10:01.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.773+0000 7f1d83e00640 10 client.6746 ms_handle_connect on v2:172.21.15.99:6834/2243461688 2024-02-21T23:10:01.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.773+0000 7f1d83e00640 1 -- 172.21.15.99:0/3380366414 <== mds.2 v2:172.21.15.99:6834/2243461688 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x558c22fbd3e0 con 0x558c23089760 2024-02-21T23:10:01.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.773+0000 7f1d83e00640 10 client.6746 handle_command_reply: tid=0 2024-02-21T23:10:01.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.773+0000 7f1da8da6740 1 client.6746 shutdown 2024-02-21T23:10:01.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.774+0000 7f1da8da6740 1 -- 172.21.15.99:0/3380366414 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558c230c8180 msgr2=0x558c230579c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:01.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.774+0000 7f1da8da6740 1 --2- 172.21.15.99:0/3380366414 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558c230c8180 0x558c230579c0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f1d88034040 tx=0x7f1d88031000 comp rx=0 tx=0).stop 2024-02-21T23:10:01.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.774+0000 7f1da8da6740 1 -- 172.21.15.99:0/3380366414 shutdown_connections 2024-02-21T23:10:01.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.774+0000 7f1da8da6740 1 --2- 172.21.15.99:0/3380366414 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x558c23089760 0x558c230c6430 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:01.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.774+0000 7f1da8da6740 1 --2- 172.21.15.99:0/3380366414 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558c230c8b40 0x558c23079110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:01.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.774+0000 7f1da8da6740 1 --2- 172.21.15.99:0/3380366414 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558c230c8180 0x558c230579c0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:01.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.774+0000 7f1da8da6740 1 --2- 172.21.15.99:0/3380366414 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558c23081220 0x558c2304e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:01.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.774+0000 7f1d83e00640 0 client.6746 ms_handle_reset on v2:172.21.15.99:6834/2243461688 2024-02-21T23:10:01.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.774+0000 7f1da8da6740 1 -- 172.21.15.99:0/3380366414 >> 172.21.15.99:0/3380366414 conn(0x558c2308d4b0 msgr2=0x558c23098c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:10:01.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.774+0000 7f1da8da6740 1 -- 172.21.15.99:0/3380366414 shutdown_connections 2024-02-21T23:10:01.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.774+0000 7f1da8da6740 1 -- 172.21.15.99:0/3380366414 wait complete. 2024-02-21T23:10:01.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.774+0000 7f1da8da6740 20 client.6746 trim_cache size 0 max 16384 2024-02-21T23:10:01.770 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-02-21T23:10:01.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.775+0000 7f1da5e00640 1 -- 172.21.15.99:0/3097583366 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f1d7c09ef00 msgr2=0x7f1d7c0a13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:01.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.775+0000 7f1da5e00640 1 --2- 172.21.15.99:0/3097583366 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f1d7c09ef00 0x7f1d7c0a13c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1d980018a0 tx=0x7f1d98001830 comp rx=0 tx=0).stop 2024-02-21T23:10:01.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.775+0000 7f1da5e00640 1 -- 172.21.15.99:0/3097583366 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1da0186650 msgr2=0x7f1da0171040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:01.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.775+0000 7f1da5e00640 1 --2- 172.21.15.99:0/3097583366 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1da0186650 0x7f1da0171040 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f1d9000e8a0 tx=0x7f1d9000ed60 comp rx=0 tx=0).stop 2024-02-21T23:10:01.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.775+0000 7f1da5e00640 1 -- 172.21.15.99:0/3097583366 shutdown_connections 2024-02-21T23:10:01.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.775+0000 7f1da5e00640 1 --2- 172.21.15.99:0/3097583366 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f1d7c09ef00 0x7f1d7c0a13c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:01.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.775+0000 7f1da5e00640 1 --2- 172.21.15.99:0/3097583366 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1da018c1e0 0x7f1da00f57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:01.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.775+0000 7f1da5e00640 1 --2- 172.21.15.99:0/3097583366 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1da01899b0 0x7f1da00f52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:01.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.775+0000 7f1da5e00640 1 --2- 172.21.15.99:0/3097583366 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1da0186650 0x7f1da0171040 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:01.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.775+0000 7f1da5e00640 1 -- 172.21.15.99:0/3097583366 >> 172.21.15.99:0/3097583366 conn(0x7f1da00ce5f0 msgr2=0x7f1da0174f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:10:01.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.775+0000 7f1da5e00640 1 -- 172.21.15.99:0/3097583366 shutdown_connections 2024-02-21T23:10:01.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.775+0000 7f1da5e00640 1 -- 172.21.15.99:0/3097583366 wait complete. 2024-02-21T23:10:01.786 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T23:10:01.787 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-02-21T23:10:01.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.994+0000 7f0577200640 1 Processor -- start 2024-02-21T23:10:01.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.994+0000 7f0577200640 1 -- start start 2024-02-21T23:10:01.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.997+0000 7f0577200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f057817f490 0x7f057818ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:01.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.997+0000 7f0577200640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f057818b4f0 0x7f05780fd290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:01.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.997+0000 7f0577200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05780d6dd0 con 0x7f057818b060 2024-02-21T23:10:01.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.997+0000 7f0577200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05781614c0 con 0x7f057817f490 2024-02-21T23:10:01.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.997+0000 7f0577200640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05780d6810 con 0x7f057818b4f0 2024-02-21T23:10:01.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.997+0000 7f0575e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f057817f490 0x7f057818ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:01.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.997+0000 7f0575400640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f057818b060 0x7f0578188a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.99:43742/0 (socket says 172.21.15.99:43742) 2024-02-21T23:10:01.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.997+0000 7f0575400640 1 -- 172.21.15.99:0/951564801 learned_addr learned my addr 172.21.15.99:0/951564801 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:10:01.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.998+0000 7f0576800640 1 --2- 172.21.15.99:0/951564801 >> v2:172.21.15.181:3300/0 conn(0x7f057818b4f0 0x7f05780fd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:01.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.998+0000 7f0574a00640 1 -- 172.21.15.99:0/951564801 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 414148371 0 0) 0x7f05780d6dd0 con 0x7f057818b060 2024-02-21T23:10:01.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.998+0000 7f0575e00640 1 -- 172.21.15.99:0/951564801 >> v2:172.21.15.181:3300/0 conn(0x7f057818b4f0 msgr2=0x7f05780fd290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:01.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.998+0000 7f0575e00640 1 --2- 172.21.15.99:0/951564801 >> v2:172.21.15.181:3300/0 conn(0x7f057818b4f0 0x7f05780fd290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:01.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.998+0000 7f0575e00640 1 -- 172.21.15.99:0/951564801 >> v1:172.21.15.162:6789/0 conn(0x7f057818b060 legacy=0x7f0578188a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:01.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.998+0000 7f0575e00640 1 -- 172.21.15.99:0/951564801 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05780d6af0 con 0x7f057817f490 2024-02-21T23:10:01.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.999+0000 7f0575e00640 1 --2- 172.21.15.99:0/951564801 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f057817f490 0x7f057818ab20 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f0578186580 tx=0x7f056802b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=993831f98bd38754 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:01.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.999+0000 7f0574a00640 1 -- 172.21.15.99:0/951564801 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0568035020 con 0x7f057817f490 2024-02-21T23:10:01.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.999+0000 7f0574a00640 1 -- 172.21.15.99:0/951564801 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0568031830 con 0x7f057817f490 2024-02-21T23:10:01.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:01.999+0000 7f0574a00640 1 -- 172.21.15.99:0/951564801 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0568031c00 con 0x7f057817f490 2024-02-21T23:10:01.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.000+0000 7f0577200640 1 -- 172.21.15.99:0/951564801 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f057817f490 msgr2=0x7f057818ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:01.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.000+0000 7f0577200640 1 --2- 172.21.15.99:0/951564801 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f057817f490 0x7f057818ab20 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f0578186580 tx=0x7f056802b8d0 comp rx=0 tx=0).stop 2024-02-21T23:10:01.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.000+0000 7f0577200640 1 -- 172.21.15.99:0/951564801 shutdown_connections 2024-02-21T23:10:01.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.000+0000 7f0577200640 1 --2- 172.21.15.99:0/951564801 >> v2:172.21.15.181:3300/0 conn(0x7f057818b4f0 0x7f05780fd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:01.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.000+0000 7f0577200640 1 --2- 172.21.15.99:0/951564801 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f057817f490 0x7f057818ab20 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:01.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.000+0000 7f0577200640 1 -- 172.21.15.99:0/951564801 >> 172.21.15.99:0/951564801 conn(0x7f05780d29b0 msgr2=0x7f05780d2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:10:01.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.000+0000 7f0577200640 1 -- 172.21.15.99:0/951564801 shutdown_connections 2024-02-21T23:10:01.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.000+0000 7f0577200640 1 -- 172.21.15.99:0/951564801 wait complete. 2024-02-21T23:10:01.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.003+0000 7f0577200640 1 Processor -- start 2024-02-21T23:10:01.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.003+0000 7f0577200640 1 -- start start 2024-02-21T23:10:01.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.005+0000 7f0577200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f057817f490 0x7f05781727e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:01.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.006+0000 7f0577200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f057818b060 0x7f057821e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:01.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.006+0000 7f0577200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f057818b4f0 0x7f057821ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:01.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.006+0000 7f0577200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f057818a600 con 0x7f057817f490 2024-02-21T23:10:01.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.006+0000 7f0577200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f057818a320 con 0x7f057818b060 2024-02-21T23:10:01.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.006+0000 7f0577200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f057817f870 con 0x7f057818b4f0 2024-02-21T23:10:01.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.006+0000 7f0575e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f057817f490 0x7f05781727e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:01.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.006+0000 7f0575e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f057817f490 0x7f05781727e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46834/0 (socket says 172.21.15.99:46834) 2024-02-21T23:10:01.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.006+0000 7f0576800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f057818b4f0 0x7f057821ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:01.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.006+0000 7f0575e00640 1 -- 172.21.15.99:0/1631701930 learned_addr learned my addr 172.21.15.99:0/1631701930 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:10:01.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.006+0000 7f0575400640 1 --2- 172.21.15.99:0/1631701930 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f057818b060 0x7f057821e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:01.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.006+0000 7f0575e00640 1 -- 172.21.15.99:0/1631701930 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f057818b4f0 msgr2=0x7f057821ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:01.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.006+0000 7f0575e00640 1 --2- 172.21.15.99:0/1631701930 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f057818b4f0 0x7f057821ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:01.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.006+0000 7f0575e00640 1 -- 172.21.15.99:0/1631701930 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f057818b060 msgr2=0x7f057821e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:01.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.006+0000 7f0575e00640 1 --2- 172.21.15.99:0/1631701930 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f057818b060 0x7f057821e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:01.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.006+0000 7f0575e00640 1 -- 172.21.15.99:0/1631701930 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f057821f6d0 con 0x7f057817f490 2024-02-21T23:10:01.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.006+0000 7f0576800640 1 --2- 172.21.15.99:0/1631701930 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f057818b4f0 0x7f057821ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:10:01.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.006+0000 7f0575400640 1 --2- 172.21.15.99:0/1631701930 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f057818b060 0x7f057821e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:10:01.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.007+0000 7f0575e00640 1 --2- 172.21.15.99:0/1631701930 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f057817f490 0x7f05781727e0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f0568000c00 tx=0x7f05680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:01.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.007+0000 7f056e000640 1 -- 172.21.15.99:0/1631701930 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0568040070 con 0x7f057817f490 2024-02-21T23:10:01.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.007+0000 7f056e000640 1 -- 172.21.15.99:0/1631701930 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f056803a910 con 0x7f057817f490 2024-02-21T23:10:01.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.007+0000 7f056e000640 1 -- 172.21.15.99:0/1631701930 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0568035040 con 0x7f057817f490 2024-02-21T23:10:01.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.007+0000 7f0577200640 1 -- 172.21.15.99:0/1631701930 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f057821c850 con 0x7f057817f490 2024-02-21T23:10:01.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.007+0000 7f0577200640 1 -- 172.21.15.99:0/1631701930 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f057821ce10 con 0x7f057817f490 2024-02-21T23:10:01.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.011+0000 7f056e000640 1 -- 172.21.15.99:0/1631701930 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f056804b060 con 0x7f057817f490 2024-02-21T23:10:02.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.012+0000 7f056e000640 1 --2- 172.21.15.99:0/1631701930 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f055809eed0 0x7f05580a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:02.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.012+0000 7f056e000640 1 -- 172.21.15.99:0/1631701930 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f05680eb760 con 0x7f057817f490 2024-02-21T23:10:02.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.012+0000 7f0575400640 1 --2- 172.21.15.99:0/1631701930 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f055809eed0 0x7f05580a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:02.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.013+0000 7f0575400640 1 --2- 172.21.15.99:0/1631701930 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f055809eed0 0x7f05580a1390 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0564007f70 tx=0x7f0564007f00 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:02.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.014+0000 7f057f80b740 1 Processor -- start 2024-02-21T23:10:02.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.014+0000 7f057f80b740 1 -- start start 2024-02-21T23:10:02.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.016+0000 7f057f80b740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558128fa4660 0x558128fa4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:02.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.016+0000 7f057f80b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558128fdf330 0x558128fdf7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:02.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.016+0000 7f057f80b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558128fdfcf0 0x558128fe0560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:02.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.016+0000 7f057f80b740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x558128eccb50 con 0x558128fa4660 2024-02-21T23:10:02.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.016+0000 7f057f80b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x558128e75da0 con 0x558128fdf330 2024-02-21T23:10:02.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.016+0000 7f057f80b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x558128ec8bf0 con 0x558128fdfcf0 2024-02-21T23:10:02.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.016+0000 7f0575e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558128fa4660 0x558128fa4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:02.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.016+0000 7f0575e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558128fa4660 0x558128fa4a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46848/0 (socket says 172.21.15.99:46848) 2024-02-21T23:10:02.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.016+0000 7f0575e00640 1 -- 172.21.15.99:0/4036054007 learned_addr learned my addr 172.21.15.99:0/4036054007 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:10:02.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.017+0000 7f0575400640 1 --2- 172.21.15.99:0/4036054007 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558128fdf330 0x558128fdf7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:02.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.017+0000 7f0576800640 1 --2- 172.21.15.99:0/4036054007 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558128fdfcf0 0x558128fe0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:02.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.017+0000 7f0575e00640 1 -- 172.21.15.99:0/4036054007 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558128fdfcf0 msgr2=0x558128fe0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:02.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.017+0000 7f0575e00640 1 --2- 172.21.15.99:0/4036054007 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558128fdfcf0 0x558128fe0560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:02.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.017+0000 7f0575e00640 1 -- 172.21.15.99:0/4036054007 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558128fdf330 msgr2=0x558128fdf7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:02.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.017+0000 7f0575e00640 1 --2- 172.21.15.99:0/4036054007 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558128fdf330 0x558128fdf7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:02.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.017+0000 7f0575e00640 1 -- 172.21.15.99:0/4036054007 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558128e98f80 con 0x558128fa4660 2024-02-21T23:10:02.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.017+0000 7f0575e00640 1 --2- 172.21.15.99:0/4036054007 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558128fa4660 0x558128fa4a40 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f056802b910 tx=0x7f0568009480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=841e630b3d79953e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:02.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.017+0000 7f0562600640 1 -- 172.21.15.99:0/4036054007 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05680b8fb0 con 0x558128fa4660 2024-02-21T23:10:02.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.018+0000 7f0562600640 1 -- 172.21.15.99:0/4036054007 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05680bd100 con 0x558128fa4660 2024-02-21T23:10:02.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.018+0000 7f0562600640 1 -- 172.21.15.99:0/4036054007 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05680c1750 con 0x558128fa4660 2024-02-21T23:10:02.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.018+0000 7f057f80b740 1 -- 172.21.15.99:0/4036054007 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558128fa4660 msgr2=0x558128fa4a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:02.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.018+0000 7f057f80b740 1 --2- 172.21.15.99:0/4036054007 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558128fa4660 0x558128fa4a40 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f056802b910 tx=0x7f0568009480 comp rx=0 tx=0).stop 2024-02-21T23:10:02.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.019+0000 7f057f80b740 1 -- 172.21.15.99:0/4036054007 shutdown_connections 2024-02-21T23:10:02.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.019+0000 7f057f80b740 1 --2- 172.21.15.99:0/4036054007 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558128fdfcf0 0x558128fe0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:02.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.019+0000 7f057f80b740 1 --2- 172.21.15.99:0/4036054007 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558128fdf330 0x558128fdf7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:02.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.019+0000 7f057f80b740 1 --2- 172.21.15.99:0/4036054007 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558128fa4660 0x558128fa4a40 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:02.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.019+0000 7f057f80b740 1 -- 172.21.15.99:0/4036054007 >> 172.21.15.99:0/4036054007 conn(0x558128f666d0 msgr2=0x558128f67750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:10:02.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.019+0000 7f057f80b740 1 -- 172.21.15.99:0/4036054007 shutdown_connections 2024-02-21T23:10:02.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.019+0000 7f057f80b740 1 -- 172.21.15.99:0/4036054007 wait complete. 2024-02-21T23:10:02.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.020+0000 7f057f80b740 1 -- start start 2024-02-21T23:10:02.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.020+0000 7f057f80b740 1 Processor -- start 2024-02-21T23:10:02.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.023+0000 7f057f80b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558128fdf330 0x558128f94b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:02.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.023+0000 7f057f80b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558128fdfcf0 0x558128fdccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:02.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.023+0000 7f057f80b740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558128f9eb10 0x558128f61ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:02.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.023+0000 7f057f80b740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x558128e75da0 con 0x558128f9eb10 2024-02-21T23:10:02.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.023+0000 7f057f80b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x558128e6b380 con 0x558128fdf330 2024-02-21T23:10:02.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.023+0000 7f057f80b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x558128eccb50 con 0x558128fdfcf0 2024-02-21T23:10:02.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.023+0000 7f057f80b740 10 client.0 _ll_register_callbacks cb 0x558128ec4280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:10:02.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.023+0000 7f0576800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558128f9eb10 0x558128f61ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:02.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.023+0000 7f0575e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558128fdf330 0x558128f94b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:02.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.023+0000 7f0576800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558128f9eb10 0x558128f61ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46860/0 (socket says 172.21.15.99:46860) 2024-02-21T23:10:02.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.023+0000 7f0576800640 1 -- 172.21.15.99:0/142920709 learned_addr learned my addr 172.21.15.99:0/142920709 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:10:02.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.023+0000 7f0575400640 1 --2- 172.21.15.99:0/142920709 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558128fdfcf0 0x558128fdccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:02.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.023+0000 7f0576800640 1 -- 172.21.15.99:0/142920709 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558128fdfcf0 msgr2=0x558128fdccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:02.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.023+0000 7f0576800640 1 --2- 172.21.15.99:0/142920709 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558128fdfcf0 0x558128fdccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:02.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.023+0000 7f0576800640 1 -- 172.21.15.99:0/142920709 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558128fdf330 msgr2=0x558128f94b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:02.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.023+0000 7f0576800640 1 --2- 172.21.15.99:0/142920709 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558128fdf330 0x558128f94b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:02.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.023+0000 7f0576800640 1 -- 172.21.15.99:0/142920709 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558128e93c20 con 0x558128f9eb10 2024-02-21T23:10:02.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.024+0000 7f0576800640 1 --2- 172.21.15.99:0/142920709 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558128f9eb10 0x558128f61ec0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f0570004660 tx=0x7f057000e8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff908af856e92d9d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:02.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.024+0000 7f0556a00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:10:02.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.024+0000 7f0556a00640 1 -- 172.21.15.99:0/142920709 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057001a070 con 0x558128f9eb10 2024-02-21T23:10:02.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.024+0000 7f0556a00640 1 -- 172.21.15.99:0/142920709 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f057001f660 con 0x558128f9eb10 2024-02-21T23:10:02.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.024+0000 7f057f80b740 1 -- 172.21.15.99:0/142920709 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f05680bd100 con 0x558128f9eb10 2024-02-21T23:10:02.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.024+0000 7f0556a00640 1 -- 172.21.15.99:0/142920709 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f057001f860 con 0x558128f9eb10 2024-02-21T23:10:02.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.024+0000 7f057f80b740 10 client.6627 fetch_fsmap learned FSMap version 17 2024-02-21T23:10:02.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.024+0000 7f057f80b740 1 -- 172.21.15.99:0/142920709 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x558128be13f0 con 0x558128f9eb10 2024-02-21T23:10:02.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.025+0000 7f0556a00640 1 -- 172.21.15.99:0/142920709 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05680bd100 con 0x558128f9eb10 2024-02-21T23:10:02.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.025+0000 7f0556a00640 1 -- 172.21.15.99:0/142920709 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f057001fa00 con 0x558128f9eb10 2024-02-21T23:10:02.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.025+0000 7f057f80b740 10 client.6627 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:10:02.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.025+0000 7f057f80b740 10 client.6627 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2024-02-21T23:10:02.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.025+0000 7f057f80b740 20 client.6627 populate_metadata read hostname 'smithi099' 2024-02-21T23:10:02.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.025+0000 7f057f80b740 1 --2- 172.21.15.99:0/142920709 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x558128f9ef90 0x558128febe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:02.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.025+0000 7f057f80b740 4 client.6627 mds_command: new command op to 4352 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:10:02.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.025+0000 7f057f80b740 1 -- 172.21.15.99:0/142920709 --> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558128eda090 con 0x558128f9ef90 2024-02-21T23:10:02.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.025+0000 7f0575e00640 1 --2- 172.21.15.99:0/142920709 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x558128f9ef90 0x558128febe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:02.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.026+0000 7f0575e00640 1 --2- 172.21.15.99:0/142920709 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x558128f9ef90 0x558128febe40 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=dd5c75374cb8bc18 server_cookie=a4a033d710d8b734 in_seq=0 out_seq=0 2024-02-21T23:10:02.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.026+0000 7f0556a00640 10 client.6627 ms_handle_connect on v2:172.21.15.99:6836/1676159950 2024-02-21T23:10:02.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.027+0000 7f0556a00640 1 -- 172.21.15.99:0/142920709 <== mds.1 v2:172.21.15.99:6836/1676159950 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x558128eda090 con 0x558128f9ef90 2024-02-21T23:10:02.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.027+0000 7f0556a00640 10 client.6627 handle_command_reply: tid=0 2024-02-21T23:10:02.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.027+0000 7f057f80b740 1 client.6627 shutdown 2024-02-21T23:10:02.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.027+0000 7f057f80b740 1 -- 172.21.15.99:0/142920709 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558128f9eb10 msgr2=0x558128f61ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:02.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.027+0000 7f057f80b740 1 --2- 172.21.15.99:0/142920709 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558128f9eb10 0x558128f61ec0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f0570004660 tx=0x7f057000e8c0 comp rx=0 tx=0).stop 2024-02-21T23:10:02.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.027+0000 7f057f80b740 1 -- 172.21.15.99:0/142920709 shutdown_connections 2024-02-21T23:10:02.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.027+0000 7f057f80b740 1 --2- 172.21.15.99:0/142920709 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x558128f9ef90 0x558128febe40 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:02.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.027+0000 7f057f80b740 1 --2- 172.21.15.99:0/142920709 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558128f9eb10 0x558128f61ec0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:02.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.027+0000 7f057f80b740 1 --2- 172.21.15.99:0/142920709 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558128fdfcf0 0x558128fdccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:02.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.027+0000 7f057f80b740 1 --2- 172.21.15.99:0/142920709 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558128fdf330 0x558128f94b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:02.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.027+0000 7f057f80b740 1 -- 172.21.15.99:0/142920709 >> 172.21.15.99:0/142920709 conn(0x558128fa4660 msgr2=0x558128fde7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:10:02.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.028+0000 7f0556a00640 0 client.6627 ms_handle_reset on v2:172.21.15.99:6836/1676159950 2024-02-21T23:10:02.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.028+0000 7f057f80b740 1 -- 172.21.15.99:0/142920709 shutdown_connections 2024-02-21T23:10:02.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.028+0000 7f057f80b740 1 -- 172.21.15.99:0/142920709 wait complete. 2024-02-21T23:10:02.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.028+0000 7f057f80b740 20 client.6627 trim_cache size 0 max 16384 2024-02-21T23:10:02.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.055+0000 7f057f80b740 1 Processor -- start 2024-02-21T23:10:02.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.055+0000 7f057f80b740 1 -- start start 2024-02-21T23:10:02.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.057+0000 7f057f80b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558128f9eb10 0x558128fa9860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:02.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.057+0000 7f057f80b740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558128fdf330 0x558128feff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:02.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.057+0000 7f057f80b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558128fdfcf0 0x558128ff04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:02.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.057+0000 7f057f80b740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f057822c8a0 con 0x558128fdf330 2024-02-21T23:10:02.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.057+0000 7f057f80b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f057822a440 con 0x558128fdfcf0 2024-02-21T23:10:02.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.057+0000 7f057f80b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05782227d0 con 0x558128f9eb10 2024-02-21T23:10:02.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.057+0000 7f0575400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558128fdf330 0x558128feff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:02.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.057+0000 7f0575400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558128fdf330 0x558128feff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46874/0 (socket says 172.21.15.99:46874) 2024-02-21T23:10:02.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.057+0000 7f0575400640 1 -- 172.21.15.99:0/322887687 learned_addr learned my addr 172.21.15.99:0/322887687 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:10:02.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.057+0000 7f0575e00640 1 --2- 172.21.15.99:0/322887687 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558128f9eb10 0x558128fa9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:02.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.057+0000 7f0576800640 1 --2- 172.21.15.99:0/322887687 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558128fdfcf0 0x558128ff04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:02.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.058+0000 7f0575e00640 1 -- 172.21.15.99:0/322887687 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558128fdfcf0 msgr2=0x558128ff04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:02.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.058+0000 7f0575e00640 1 --2- 172.21.15.99:0/322887687 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558128fdfcf0 0x558128ff04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:02.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.058+0000 7f0575e00640 1 -- 172.21.15.99:0/322887687 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558128fdf330 msgr2=0x558128feff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:02.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.058+0000 7f0575e00640 1 --2- 172.21.15.99:0/322887687 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558128fdf330 0x558128feff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:02.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.058+0000 7f0575e00640 1 -- 172.21.15.99:0/322887687 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558128cab7d0 con 0x558128f9eb10 2024-02-21T23:10:02.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.058+0000 7f0575400640 1 --2- 172.21.15.99:0/322887687 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558128fdf330 0x558128feff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:10:02.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.058+0000 7f0575e00640 1 --2- 172.21.15.99:0/322887687 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558128f9eb10 0x558128fa9860 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f05680b5380 tx=0x7f05680eb000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a4029fb0c0948c9 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:02.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.058+0000 7f0561c00640 1 -- 172.21.15.99:0/322887687 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05680e7070 con 0x558128f9eb10 2024-02-21T23:10:02.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.058+0000 7f0561c00640 1 -- 172.21.15.99:0/322887687 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05680c1750 con 0x558128f9eb10 2024-02-21T23:10:02.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.058+0000 7f0561c00640 1 -- 172.21.15.99:0/322887687 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05680b8fb0 con 0x558128f9eb10 2024-02-21T23:10:02.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.059+0000 7f057f80b740 1 -- 172.21.15.99:0/322887687 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558128f9eb10 msgr2=0x558128fa9860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:02.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.059+0000 7f057f80b740 1 --2- 172.21.15.99:0/322887687 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558128f9eb10 0x558128fa9860 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f05680b5380 tx=0x7f05680eb000 comp rx=0 tx=0).stop 2024-02-21T23:10:02.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.059+0000 7f057f80b740 1 -- 172.21.15.99:0/322887687 shutdown_connections 2024-02-21T23:10:02.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.059+0000 7f057f80b740 1 --2- 172.21.15.99:0/322887687 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558128fdfcf0 0x558128ff04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:02.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.059+0000 7f057f80b740 1 --2- 172.21.15.99:0/322887687 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558128fdf330 0x558128feff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:02.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.059+0000 7f057f80b740 1 --2- 172.21.15.99:0/322887687 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558128f9eb10 0x558128fa9860 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:02.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.059+0000 7f057f80b740 1 -- 172.21.15.99:0/322887687 >> 172.21.15.99:0/322887687 conn(0x558128fa4660 msgr2=0x558128faf510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:10:02.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.059+0000 7f057f80b740 1 -- 172.21.15.99:0/322887687 shutdown_connections 2024-02-21T23:10:02.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.059+0000 7f057f80b740 1 -- 172.21.15.99:0/322887687 wait complete. 2024-02-21T23:10:02.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.060+0000 7f057f80b740 1 -- start start 2024-02-21T23:10:02.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.060+0000 7f057f80b740 1 Processor -- start 2024-02-21T23:10:02.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.061+0000 7f057f80b740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558128f9eb10 0x558128fa9860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:02.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.061+0000 7f057f80b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558128fdf330 0x558128fa07e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:02.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.062+0000 7f057f80b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558128fdfcf0 0x558128fa1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:02.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.062+0000 7f057f80b740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0578228bf0 con 0x558128f9eb10 2024-02-21T23:10:02.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.062+0000 7f057f80b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0578229de0 con 0x558128fdf330 2024-02-21T23:10:02.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.062+0000 7f057f80b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0578229120 con 0x558128fdfcf0 2024-02-21T23:10:02.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.062+0000 7f057f80b740 10 client.0 _ll_register_callbacks cb 0x7f0570009ed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:10:02.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.062+0000 7f0575e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558128f9eb10 0x558128fa9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:02.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.062+0000 7f0575400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558128fdf330 0x558128fa07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:02.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.062+0000 7f0575e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558128f9eb10 0x558128fa9860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46884/0 (socket says 172.21.15.99:46884) 2024-02-21T23:10:02.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.062+0000 7f0575e00640 1 -- 172.21.15.99:0/2078755896 learned_addr learned my addr 172.21.15.99:0/2078755896 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:10:02.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.062+0000 7f0576800640 1 --2- 172.21.15.99:0/2078755896 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558128fdfcf0 0x558128fa1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:02.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.062+0000 7f0575e00640 1 -- 172.21.15.99:0/2078755896 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558128fdfcf0 msgr2=0x558128fa1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:02.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.062+0000 7f0575e00640 1 --2- 172.21.15.99:0/2078755896 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558128fdfcf0 0x558128fa1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:02.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.062+0000 7f0575e00640 1 -- 172.21.15.99:0/2078755896 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558128fdf330 msgr2=0x558128fa07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:02.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.062+0000 7f0575e00640 1 --2- 172.21.15.99:0/2078755896 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558128fdf330 0x558128fa07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:02.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.062+0000 7f0575e00640 1 -- 172.21.15.99:0/2078755896 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558128fe0c30 con 0x558128f9eb10 2024-02-21T23:10:02.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.063+0000 7f0575e00640 1 --2- 172.21.15.99:0/2078755896 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558128f9eb10 0x558128fa9860 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f0568006e80 tx=0x7f0568006e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f31766d13e64b88c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:02.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.063+0000 7f0556a00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:10:02.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.063+0000 7f0556a00640 1 -- 172.21.15.99:0/2078755896 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05680e7070 con 0x558128f9eb10 2024-02-21T23:10:02.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.063+0000 7f0556a00640 1 -- 172.21.15.99:0/2078755896 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f05680e8ee0 con 0x558128f9eb10 2024-02-21T23:10:02.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.063+0000 7f057f80b740 1 -- 172.21.15.99:0/2078755896 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f05680c1750 con 0x558128f9eb10 2024-02-21T23:10:02.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.063+0000 7f0556a00640 1 -- 172.21.15.99:0/2078755896 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0568009110 con 0x558128f9eb10 2024-02-21T23:10:02.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.063+0000 7f057f80b740 10 client.6633 fetch_fsmap learned FSMap version 17 2024-02-21T23:10:02.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.063+0000 7f057f80b740 1 -- 172.21.15.99:0/2078755896 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x558128f9e4c0 con 0x558128f9eb10 2024-02-21T23:10:02.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.063+0000 7f0556a00640 1 -- 172.21.15.99:0/2078755896 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05680c1750 con 0x558128f9eb10 2024-02-21T23:10:02.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.064+0000 7f0556a00640 1 -- 172.21.15.99:0/2078755896 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f05680b8400 con 0x558128f9eb10 2024-02-21T23:10:02.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.064+0000 7f057f80b740 10 client.6633 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:10:02.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.064+0000 7f057f80b740 10 client.6633 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2024-02-21T23:10:02.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.064+0000 7f057f80b740 20 client.6633 populate_metadata read hostname 'smithi099' 2024-02-21T23:10:02.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.064+0000 7f057f80b740 1 --2- 172.21.15.99:0/2078755896 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x558128f8aa70 0x558128f5e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:02.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.064+0000 7f057f80b740 4 client.6633 mds_command: new command op to 4352 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T23:10:02.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.064+0000 7f057f80b740 1 -- 172.21.15.99:0/2078755896 --> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x558128ed43e0 con 0x558128f8aa70 2024-02-21T23:10:02.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.064+0000 7f0575400640 1 --2- 172.21.15.99:0/2078755896 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x558128f8aa70 0x558128f5e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:02.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.065+0000 7f0575400640 1 --2- 172.21.15.99:0/2078755896 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x558128f8aa70 0x558128f5e790 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d24b0e99b22e2d11 server_cookie=9c947adbbdcc83c0 in_seq=0 out_seq=0 2024-02-21T23:10:02.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.065+0000 7f0556a00640 10 client.6633 ms_handle_connect on v2:172.21.15.99:6836/1676159950 2024-02-21T23:10:02.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.065+0000 7f0556a00640 1 -- 172.21.15.99:0/2078755896 <== mds.1 v2:172.21.15.99:6836/1676159950 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x558128ed43e0 con 0x558128f8aa70 2024-02-21T23:10:02.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.065+0000 7f0556a00640 10 client.6633 handle_command_reply: tid=0 2024-02-21T23:10:02.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.065+0000 7f057f80b740 1 client.6633 shutdown 2024-02-21T23:10:02.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.065+0000 7f057f80b740 1 -- 172.21.15.99:0/2078755896 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558128f9eb10 msgr2=0x558128fa9860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:02.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.065+0000 7f057f80b740 1 --2- 172.21.15.99:0/2078755896 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558128f9eb10 0x558128fa9860 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f0568006e80 tx=0x7f0568006e10 comp rx=0 tx=0).stop 2024-02-21T23:10:02.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.065+0000 7f057f80b740 1 -- 172.21.15.99:0/2078755896 shutdown_connections 2024-02-21T23:10:02.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.065+0000 7f057f80b740 1 --2- 172.21.15.99:0/2078755896 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x558128f8aa70 0x558128f5e790 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:02.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.065+0000 7f057f80b740 1 --2- 172.21.15.99:0/2078755896 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558128fdfcf0 0x558128fa1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:02.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.065+0000 7f057f80b740 1 --2- 172.21.15.99:0/2078755896 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558128fdf330 0x558128fa07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:02.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.065+0000 7f057f80b740 1 --2- 172.21.15.99:0/2078755896 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558128f9eb10 0x558128fa9860 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:02.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.065+0000 7f057f80b740 1 -- 172.21.15.99:0/2078755896 >> 172.21.15.99:0/2078755896 conn(0x558128fa4660 msgr2=0x558128ff9a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:10:02.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.065+0000 7f0556a00640 0 client.6633 ms_handle_reset on v2:172.21.15.99:6836/1676159950 2024-02-21T23:10:02.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.066+0000 7f057f80b740 1 -- 172.21.15.99:0/2078755896 shutdown_connections 2024-02-21T23:10:02.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.066+0000 7f057f80b740 1 -- 172.21.15.99:0/2078755896 wait complete. 2024-02-21T23:10:02.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.066+0000 7f057f80b740 20 client.6633 trim_cache size 0 max 16384 2024-02-21T23:10:02.060 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-02-21T23:10:02.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.067+0000 7f0577200640 1 -- 172.21.15.99:0/1631701930 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f055809eed0 msgr2=0x7f05580a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:02.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.067+0000 7f0577200640 1 --2- 172.21.15.99:0/1631701930 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f055809eed0 0x7f05580a1390 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0564007f70 tx=0x7f0564007f00 comp rx=0 tx=0).stop 2024-02-21T23:10:02.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.067+0000 7f0577200640 1 -- 172.21.15.99:0/1631701930 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f057817f490 msgr2=0x7f05781727e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:02.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.067+0000 7f0577200640 1 --2- 172.21.15.99:0/1631701930 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f057817f490 0x7f05781727e0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f0568000c00 tx=0x7f05680046c0 comp rx=0 tx=0).stop 2024-02-21T23:10:02.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.067+0000 7f0577200640 1 -- 172.21.15.99:0/1631701930 shutdown_connections 2024-02-21T23:10:02.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.067+0000 7f0577200640 1 --2- 172.21.15.99:0/1631701930 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f055809eed0 0x7f05580a1390 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:02.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.067+0000 7f0577200640 1 --2- 172.21.15.99:0/1631701930 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f057818b4f0 0x7f057821ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:02.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.067+0000 7f0577200640 1 --2- 172.21.15.99:0/1631701930 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f057818b060 0x7f057821e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:02.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.067+0000 7f0577200640 1 --2- 172.21.15.99:0/1631701930 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f057817f490 0x7f05781727e0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:02.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.067+0000 7f0577200640 1 -- 172.21.15.99:0/1631701930 >> 172.21.15.99:0/1631701930 conn(0x7f05780d29b0 msgr2=0x7f05780fe380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:10:02.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.067+0000 7f0577200640 1 -- 172.21.15.99:0/1631701930 shutdown_connections 2024-02-21T23:10:02.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.067+0000 7f0577200640 1 -- 172.21.15.99:0/1631701930 wait complete. 2024-02-21T23:10:02.074 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T23:10:02.074 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-02-21T23:10:02.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.274+0000 7f3b86400640 1 Processor -- start 2024-02-21T23:10:02.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.275+0000 7f3b86400640 1 -- start start 2024-02-21T23:10:02.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.276+0000 7f3b86400640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f3b801867e0 0x7f3b801881e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:02.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.276+0000 7f3b86400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b80188720 con 0x7f3b800d4320 2024-02-21T23:10:02.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.276+0000 7f3b86400640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b800cf820 con 0x7f3b80186400 2024-02-21T23:10:02.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.276+0000 7f3b86400640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b80187640 con 0x7f3b801867e0 2024-02-21T23:10:02.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.277+0000 7f3b77e00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f3b801867e0 0x7f3b801881e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:02.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.277+0000 7f3b7fe00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f3b800d4320 0x7f3b800d4750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.99:43750/0 (socket says 172.21.15.99:43750) 2024-02-21T23:10:02.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.277+0000 7f3b7fe00640 1 -- 172.21.15.99:0/5084566 learned_addr learned my addr 172.21.15.99:0/5084566 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:10:02.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.277+0000 7f3b7f400640 1 --1- 172.21.15.99:0/5084566 >> v1:172.21.15.181:6789/0 conn(0x7f3b80186400 0x7f3b80187ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:54484/0 (socket says 172.21.15.99:54484) 2024-02-21T23:10:02.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.277+0000 7f3b7ea00640 1 -- 172.21.15.99:0/5084566 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 87884288 0 0) 0x7f3b800cf820 con 0x7f3b80186400 2024-02-21T23:10:02.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.277+0000 7f3b7ea00640 1 -- 172.21.15.99:0/5084566 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b64003520 con 0x7f3b80186400 2024-02-21T23:10:02.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.277+0000 7f3b7ea00640 1 -- 172.21.15.99:0/5084566 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4147261828 0 0) 0x7f3b80188720 con 0x7f3b800d4320 2024-02-21T23:10:02.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.277+0000 7f3b77e00640 1 -- 172.21.15.99:0/5084566 >> v1:172.21.15.181:6789/0 conn(0x7f3b80186400 legacy=0x7f3b80187ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:02.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.277+0000 7f3b77e00640 1 -- 172.21.15.99:0/5084566 >> v1:172.21.15.162:6789/0 conn(0x7f3b800d4320 legacy=0x7f3b800d4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:02.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.277+0000 7f3b77e00640 1 -- 172.21.15.99:0/5084566 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b800cfb00 con 0x7f3b801867e0 2024-02-21T23:10:02.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.279+0000 7f3b77e00640 1 --2- 172.21.15.99:0/5084566 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3b801867e0 0x7f3b801881e0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f3b680097a0 tx=0x7f3b6802b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d715d3f457c8cf4a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:02.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.279+0000 7f3b7ea00640 1 -- 172.21.15.99:0/5084566 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b680315a0 con 0x7f3b801867e0 2024-02-21T23:10:02.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.279+0000 7f3b7ea00640 1 -- 172.21.15.99:0/5084566 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b68037070 con 0x7f3b801867e0 2024-02-21T23:10:02.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.279+0000 7f3b7ea00640 1 -- 172.21.15.99:0/5084566 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b68031940 con 0x7f3b801867e0 2024-02-21T23:10:02.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.280+0000 7f3b86400640 1 -- 172.21.15.99:0/5084566 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3b801867e0 msgr2=0x7f3b801881e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:02.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.280+0000 7f3b86400640 1 --2- 172.21.15.99:0/5084566 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3b801867e0 0x7f3b801881e0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f3b680097a0 tx=0x7f3b6802b840 comp rx=0 tx=0).stop 2024-02-21T23:10:02.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.280+0000 7f3b86400640 1 -- 172.21.15.99:0/5084566 shutdown_connections 2024-02-21T23:10:02.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.280+0000 7f3b86400640 1 --2- 172.21.15.99:0/5084566 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3b801867e0 0x7f3b801881e0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:02.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.280+0000 7f3b86400640 1 -- 172.21.15.99:0/5084566 >> 172.21.15.99:0/5084566 conn(0x7f3b800d6af0 msgr2=0x7f3b800740b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:10:02.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.280+0000 7f3b86400640 1 -- 172.21.15.99:0/5084566 shutdown_connections 2024-02-21T23:10:02.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.280+0000 7f3b86400640 1 -- 172.21.15.99:0/5084566 wait complete. 2024-02-21T23:10:02.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.284+0000 7f3b86400640 1 Processor -- start 2024-02-21T23:10:02.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.284+0000 7f3b86400640 1 -- start start 2024-02-21T23:10:02.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.286+0000 7f3b86400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b800d4320 0x7f3b8008eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:02.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.286+0000 7f3b86400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3b80186400 0x7f3b8016b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:02.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.286+0000 7f3b86400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3b801867e0 0x7f3b80220220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:02.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.286+0000 7f3b86400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b801872d0 con 0x7f3b80186400 2024-02-21T23:10:02.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.286+0000 7f3b86400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b80186ff0 con 0x7f3b800d4320 2024-02-21T23:10:02.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.286+0000 7f3b86400640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b800ceeb0 con 0x7f3b801867e0 2024-02-21T23:10:02.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.286+0000 7f3b7f400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b800d4320 0x7f3b8008eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:02.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.286+0000 7f3b77e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3b80186400 0x7f3b8016b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:02.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.286+0000 7f3b7f400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b800d4320 0x7f3b8008eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:41460/0 (socket says 172.21.15.99:41460) 2024-02-21T23:10:02.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.286+0000 7f3b7f400640 1 -- 172.21.15.99:0/2808442023 learned_addr learned my addr 172.21.15.99:0/2808442023 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:10:02.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.286+0000 7f3b7fe00640 1 --2- 172.21.15.99:0/2808442023 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3b801867e0 0x7f3b80220220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:02.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.287+0000 7f3b7f400640 1 -- 172.21.15.99:0/2808442023 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3b801867e0 msgr2=0x7f3b80220220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:02.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.287+0000 7f3b7f400640 1 --2- 172.21.15.99:0/2808442023 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3b801867e0 0x7f3b80220220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:02.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.287+0000 7f3b7f400640 1 -- 172.21.15.99:0/2808442023 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3b80186400 msgr2=0x7f3b8016b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:02.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.287+0000 7f3b7f400640 1 --2- 172.21.15.99:0/2808442023 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3b80186400 0x7f3b8016b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:02.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.287+0000 7f3b7f400640 1 -- 172.21.15.99:0/2808442023 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b8008eff0 con 0x7f3b800d4320 2024-02-21T23:10:02.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.287+0000 7f3b77e00640 1 --2- 172.21.15.99:0/2808442023 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3b80186400 0x7f3b8016b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:10:02.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.287+0000 7f3b7f400640 1 --2- 172.21.15.99:0/2808442023 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b800d4320 0x7f3b8008eab0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f3b7000c450 tx=0x7f3b7000c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:02.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.287+0000 7f3b77400640 1 -- 172.21.15.99:0/2808442023 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b700074e0 con 0x7f3b800d4320 2024-02-21T23:10:02.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.287+0000 7f3b77400640 1 -- 172.21.15.99:0/2808442023 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b70007680 con 0x7f3b800d4320 2024-02-21T23:10:02.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.288+0000 7f3b77400640 1 -- 172.21.15.99:0/2808442023 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b70004a00 con 0x7f3b800d4320 2024-02-21T23:10:02.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.288+0000 7f3b86400640 1 -- 172.21.15.99:0/2808442023 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b8008f2a0 con 0x7f3b800d4320 2024-02-21T23:10:02.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.288+0000 7f3b86400640 1 -- 172.21.15.99:0/2808442023 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b8008f860 con 0x7f3b800d4320 2024-02-21T23:10:02.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.293+0000 7f3b77400640 1 -- 172.21.15.99:0/2808442023 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f3b7001a020 con 0x7f3b800d4320 2024-02-21T23:10:02.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.293+0000 7f3b8924b740 1 Processor -- start 2024-02-21T23:10:02.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.294+0000 7f3b8924b740 1 -- start start 2024-02-21T23:10:02.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.295+0000 7f3b77400640 1 --2- 172.21.15.99:0/2808442023 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f3b5c09eed0 0x7f3b5c0a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:02.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.295+0000 7f3b77400640 1 -- 172.21.15.99:0/2808442023 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f3b700c96f0 con 0x7f3b800d4320 2024-02-21T23:10:02.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.295+0000 7f3b7fe00640 1 --2- 172.21.15.99:0/2808442023 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f3b5c09eed0 0x7f3b5c0a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:02.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.295+0000 7f3b8924b740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558d9fdce4b0 0x558d9fdce890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:02.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.295+0000 7f3b8924b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d9fe09180 0x558d9fe09600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:02.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.295+0000 7f3b8924b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558d9fe09b40 0x558d9fe0a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:02.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.295+0000 7f3b8924b740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d9fcf6b50 con 0x558d9fdce4b0 2024-02-21T23:10:02.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.295+0000 7f3b8924b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d9fc9fda0 con 0x558d9fe09180 2024-02-21T23:10:02.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.295+0000 7f3b8924b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d9fcf2bf0 con 0x558d9fe09b40 2024-02-21T23:10:02.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.296+0000 7f3b77e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d9fe09180 0x558d9fe09600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:02.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.296+0000 7f3b7f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558d9fdce4b0 0x558d9fdce890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:02.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.296+0000 7f3b77e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d9fe09180 0x558d9fe09600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:41472/0 (socket says 172.21.15.99:41472) 2024-02-21T23:10:02.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.296+0000 7f3b77e00640 1 -- 172.21.15.99:0/2014483956 learned_addr learned my addr 172.21.15.99:0/2014483956 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:10:02.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.296+0000 7f3b7fe00640 1 --2- 172.21.15.99:0/2014483956 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558d9fe09b40 0x558d9fe0a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:02.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.296+0000 7f3b7fe00640 1 --2- 172.21.15.99:0/2808442023 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f3b5c09eed0 0x7f3b5c0a1390 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3b780018c0 tx=0x7f3b78001850 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:02.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.296+0000 7f3b77e00640 1 -- 172.21.15.99:0/2014483956 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558d9fe09b40 msgr2=0x558d9fe0a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:02.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.296+0000 7f3b77e00640 1 --2- 172.21.15.99:0/2014483956 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558d9fe09b40 0x558d9fe0a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:02.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.296+0000 7f3b77e00640 1 -- 172.21.15.99:0/2014483956 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558d9fdce4b0 msgr2=0x558d9fdce890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:02.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.296+0000 7f3b77e00640 1 --2- 172.21.15.99:0/2014483956 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558d9fdce4b0 0x558d9fdce890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:02.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.296+0000 7f3b77e00640 1 -- 172.21.15.99:0/2014483956 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558d9fcc2f80 con 0x558d9fe09180 2024-02-21T23:10:02.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.296+0000 7f3b77e00640 1 --2- 172.21.15.99:0/2014483956 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d9fe09180 0x558d9fe09600 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f3b680098c0 tx=0x7f3b68008030 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e591160d1a3cc45f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:02.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.297+0000 7f3b6fe00640 1 -- 172.21.15.99:0/2014483956 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6804a070 con 0x558d9fe09180 2024-02-21T23:10:02.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.297+0000 7f3b6fe00640 1 -- 172.21.15.99:0/2014483956 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b68037040 con 0x558d9fe09180 2024-02-21T23:10:02.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.297+0000 7f3b6fe00640 1 -- 172.21.15.99:0/2014483956 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b68031b30 con 0x558d9fe09180 2024-02-21T23:10:02.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.297+0000 7f3b8924b740 1 -- 172.21.15.99:0/2014483956 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d9fe09180 msgr2=0x558d9fe09600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:02.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.297+0000 7f3b8924b740 1 --2- 172.21.15.99:0/2014483956 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d9fe09180 0x558d9fe09600 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f3b680098c0 tx=0x7f3b68008030 comp rx=0 tx=0).stop 2024-02-21T23:10:02.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.298+0000 7f3b8924b740 1 -- 172.21.15.99:0/2014483956 shutdown_connections 2024-02-21T23:10:02.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.298+0000 7f3b8924b740 1 --2- 172.21.15.99:0/2014483956 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558d9fe09b40 0x558d9fe0a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:02.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.298+0000 7f3b8924b740 1 --2- 172.21.15.99:0/2014483956 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d9fe09180 0x558d9fe09600 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:02.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.298+0000 7f3b8924b740 1 --2- 172.21.15.99:0/2014483956 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558d9fdce4b0 0x558d9fdce890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:02.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.298+0000 7f3b8924b740 1 -- 172.21.15.99:0/2014483956 >> 172.21.15.99:0/2014483956 conn(0x558d9fd90520 msgr2=0x558d9fd915a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:10:02.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.299+0000 7f3b8924b740 1 -- 172.21.15.99:0/2014483956 shutdown_connections 2024-02-21T23:10:02.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.299+0000 7f3b8924b740 1 -- 172.21.15.99:0/2014483956 wait complete. 2024-02-21T23:10:02.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.300+0000 7f3b8924b740 1 -- start start 2024-02-21T23:10:02.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.300+0000 7f3b8924b740 1 Processor -- start 2024-02-21T23:10:02.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.302+0000 7f3b8924b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d9fe09180 0x558d9fe125f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:02.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.302+0000 7f3b8924b740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558d9fe09b40 0x558d9fe03430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:02.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.303+0000 7f3b8924b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558d9fdc3e90 0x558d9fdc9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:02.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.303+0000 7f3b8924b740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d9fe07ef0 con 0x558d9fe09b40 2024-02-21T23:10:02.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.303+0000 7f3b8924b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d9fc95380 con 0x558d9fe09180 2024-02-21T23:10:02.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.303+0000 7f3b8924b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d9fe07c10 con 0x558d9fdc3e90 2024-02-21T23:10:02.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.303+0000 7f3b8924b740 10 client.0 _ll_register_callbacks cb 0x558d9fcee280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:10:02.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.303+0000 7f3b7fe00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558d9fdc3e90 0x558d9fdc9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:02.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.303+0000 7f3b77e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558d9fe09b40 0x558d9fe03430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:02.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.303+0000 7f3b7fe00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558d9fdc3e90 0x558d9fdc9920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:46820/0 (socket says 172.21.15.99:46820) 2024-02-21T23:10:02.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.303+0000 7f3b7fe00640 1 -- 172.21.15.99:0/255323993 learned_addr learned my addr 172.21.15.99:0/255323993 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:10:02.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.303+0000 7f3b7f400640 1 --2- 172.21.15.99:0/255323993 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d9fe09180 0x558d9fe125f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:02.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.303+0000 7f3b7fe00640 1 -- 172.21.15.99:0/255323993 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d9fe09180 msgr2=0x558d9fe125f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:02.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.303+0000 7f3b7fe00640 1 --2- 172.21.15.99:0/255323993 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d9fe09180 0x558d9fe125f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:02.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.303+0000 7f3b7fe00640 1 -- 172.21.15.99:0/255323993 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558d9fe09b40 msgr2=0x558d9fe03430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:02.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.303+0000 7f3b7fe00640 1 --2- 172.21.15.99:0/255323993 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558d9fe09b40 0x558d9fe03430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:02.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.303+0000 7f3b7fe00640 1 -- 172.21.15.99:0/255323993 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558d9fcbdc20 con 0x558d9fdc3e90 2024-02-21T23:10:02.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.304+0000 7f3b7fe00640 1 --2- 172.21.15.99:0/255323993 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558d9fdc3e90 0x558d9fdc9920 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f3b780014e0 tx=0x7f3b78001250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f209dca902c8d34 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:02.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.304+0000 7f3b6cc00640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-02-21T23:10:02.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.304+0000 7f3b6cc00640 1 -- 172.21.15.99:0/255323993 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7801e840 con 0x558d9fdc3e90 2024-02-21T23:10:02.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.304+0000 7f3b6cc00640 1 -- 172.21.15.99:0/255323993 <== mon.2 v2:172.21.15.181:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f3b7801e9e0 con 0x558d9fdc3e90 2024-02-21T23:10:02.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.304+0000 7f3b8924b740 1 -- 172.21.15.99:0/255323993 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3b68037040 con 0x558d9fdc3e90 2024-02-21T23:10:02.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.305+0000 7f3b6cc00640 1 -- 172.21.15.99:0/255323993 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3b7802f050 con 0x558d9fdc3e90 2024-02-21T23:10:02.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.305+0000 7f3b8924b740 10 client.6779 fetch_fsmap learned FSMap version 17 2024-02-21T23:10:02.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.305+0000 7f3b8924b740 1 -- 172.21.15.99:0/255323993 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x558d9fa0b3f0 con 0x558d9fdc3e90 2024-02-21T23:10:02.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.305+0000 7f3b6cc00640 1 -- 172.21.15.99:0/255323993 <== mon.2 v2:172.21.15.181:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b68037040 con 0x558d9fdc3e90 2024-02-21T23:10:02.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.305+0000 7f3b6cc00640 1 -- 172.21.15.99:0/255323993 <== mon.2 v2:172.21.15.181:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f3b7801d040 con 0x558d9fdc3e90 2024-02-21T23:10:02.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.305+0000 7f3b8924b740 10 client.6779 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:10:02.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.305+0000 7f3b8924b740 10 client.6779 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:10:02.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.305+0000 7f3b8924b740 20 client.6779 populate_metadata read hostname 'smithi099' 2024-02-21T23:10:02.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.305+0000 7f3b8924b740 1 --2- 172.21.15.99:0/255323993 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x558d9fdd36b0 0x558d9fdc9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:02.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.305+0000 7f3b8924b740 4 client.6779 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:10:02.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.305+0000 7f3b8924b740 1 -- 172.21.15.99:0/255323993 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558d9fd04090 con 0x558d9fdd36b0 2024-02-21T23:10:02.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.306+0000 7f3b7f400640 1 --2- 172.21.15.99:0/255323993 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x558d9fdd36b0 0x558d9fdc9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:02.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.306+0000 7f3b7f400640 1 --2- 172.21.15.99:0/255323993 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x558d9fdd36b0 0x558d9fdc9e60 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a92ccb1c52e4c4d0 server_cookie=4d22ca57199a57de in_seq=0 out_seq=0 2024-02-21T23:10:02.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.306+0000 7f3b6cc00640 10 client.6779 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:10:02.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.307+0000 7f3b6cc00640 1 -- 172.21.15.99:0/255323993 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x558d9fd04090 con 0x558d9fdd36b0 2024-02-21T23:10:02.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.307+0000 7f3b6cc00640 10 client.6779 handle_command_reply: tid=0 2024-02-21T23:10:02.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.307+0000 7f3b8924b740 1 client.6779 shutdown 2024-02-21T23:10:02.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.307+0000 7f3b8924b740 1 -- 172.21.15.99:0/255323993 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558d9fdc3e90 msgr2=0x558d9fdc9920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:02.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.307+0000 7f3b8924b740 1 --2- 172.21.15.99:0/255323993 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558d9fdc3e90 0x558d9fdc9920 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f3b780014e0 tx=0x7f3b78001250 comp rx=0 tx=0).stop 2024-02-21T23:10:02.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.308+0000 7f3b8924b740 1 -- 172.21.15.99:0/255323993 shutdown_connections 2024-02-21T23:10:02.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.308+0000 7f3b8924b740 1 --2- 172.21.15.99:0/255323993 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x558d9fdd36b0 0x558d9fdc9e60 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:02.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.308+0000 7f3b8924b740 1 --2- 172.21.15.99:0/255323993 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558d9fdc3e90 0x558d9fdc9920 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:02.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.308+0000 7f3b8924b740 1 --2- 172.21.15.99:0/255323993 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558d9fe09b40 0x558d9fe03430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:02.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.308+0000 7f3b8924b740 1 --2- 172.21.15.99:0/255323993 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d9fe09180 0x558d9fe125f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:02.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.308+0000 7f3b8924b740 1 -- 172.21.15.99:0/255323993 >> 172.21.15.99:0/255323993 conn(0x558d9fdce4b0 msgr2=0x558d9fe08600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:10:02.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.308+0000 7f3b6cc00640 0 client.6779 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:10:02.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.308+0000 7f3b8924b740 1 -- 172.21.15.99:0/255323993 shutdown_connections 2024-02-21T23:10:02.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.308+0000 7f3b8924b740 1 -- 172.21.15.99:0/255323993 wait complete. 2024-02-21T23:10:02.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.308+0000 7f3b8924b740 20 client.6779 trim_cache size 0 max 16384 2024-02-21T23:10:02.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.322+0000 7f3b8924b740 1 Processor -- start 2024-02-21T23:10:02.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.322+0000 7f3b8924b740 1 -- start start 2024-02-21T23:10:02.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.323+0000 7f3b8924b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558d9fdc3e90 0x558d9fe083c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:02.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.323+0000 7f3b8924b740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558d9fe09180 0x558d9fd8ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:02.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.323+0000 7f3b8924b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d9fe09b40 0x558d9fe0ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:02.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.323+0000 7f3b8924b740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8022c920 con 0x558d9fe09180 2024-02-21T23:10:02.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.323+0000 7f3b8924b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8022a4c0 con 0x558d9fe09b40 2024-02-21T23:10:02.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.323+0000 7f3b8924b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8021fc30 con 0x558d9fdc3e90 2024-02-21T23:10:02.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.323+0000 7f3b77e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558d9fe09180 0x558d9fd8ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:02.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.323+0000 7f3b77e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558d9fe09180 0x558d9fd8ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46928/0 (socket says 172.21.15.99:46928) 2024-02-21T23:10:02.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.323+0000 7f3b77e00640 1 -- 172.21.15.99:0/942389250 learned_addr learned my addr 172.21.15.99:0/942389250 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:10:02.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.324+0000 7f3b7f400640 1 --2- 172.21.15.99:0/942389250 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558d9fdc3e90 0x558d9fe083c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:02.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.324+0000 7f3b7fe00640 1 --2- 172.21.15.99:0/942389250 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d9fe09b40 0x558d9fe0ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:02.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.324+0000 7f3b77e00640 1 -- 172.21.15.99:0/942389250 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558d9fdc3e90 msgr2=0x558d9fe083c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:02.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.324+0000 7f3b77e00640 1 --2- 172.21.15.99:0/942389250 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558d9fdc3e90 0x558d9fe083c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:02.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.324+0000 7f3b77e00640 1 -- 172.21.15.99:0/942389250 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d9fe09b40 msgr2=0x558d9fe0ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:02.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.324+0000 7f3b77e00640 1 --2- 172.21.15.99:0/942389250 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d9fe09b40 0x558d9fe0ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:02.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.324+0000 7f3b77e00640 1 -- 172.21.15.99:0/942389250 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558d9fad57d0 con 0x558d9fe09180 2024-02-21T23:10:02.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.324+0000 7f3b77e00640 1 --2- 172.21.15.99:0/942389250 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558d9fe09180 0x558d9fd8ee80 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f3b6802bd80 tx=0x7f3b68030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb612806e193f46b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:02.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.325+0000 7f3b6f400640 1 -- 172.21.15.99:0/942389250 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6804a070 con 0x558d9fe09180 2024-02-21T23:10:02.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.325+0000 7f3b6f400640 1 -- 172.21.15.99:0/942389250 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b68037070 con 0x558d9fe09180 2024-02-21T23:10:02.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.325+0000 7f3b6f400640 1 -- 172.21.15.99:0/942389250 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b68004240 con 0x558d9fe09180 2024-02-21T23:10:02.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.325+0000 7f3b8924b740 1 -- 172.21.15.99:0/942389250 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558d9fe09180 msgr2=0x558d9fd8ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:02.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.325+0000 7f3b8924b740 1 --2- 172.21.15.99:0/942389250 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558d9fe09180 0x558d9fd8ee80 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f3b6802bd80 tx=0x7f3b68030000 comp rx=0 tx=0).stop 2024-02-21T23:10:02.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.325+0000 7f3b8924b740 1 -- 172.21.15.99:0/942389250 shutdown_connections 2024-02-21T23:10:02.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.325+0000 7f3b8924b740 1 --2- 172.21.15.99:0/942389250 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d9fe09b40 0x558d9fe0ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:02.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.325+0000 7f3b8924b740 1 --2- 172.21.15.99:0/942389250 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558d9fe09180 0x558d9fd8ee80 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:02.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.325+0000 7f3b8924b740 1 --2- 172.21.15.99:0/942389250 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558d9fdc3e90 0x558d9fe083c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:02.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.325+0000 7f3b8924b740 1 -- 172.21.15.99:0/942389250 >> 172.21.15.99:0/942389250 conn(0x558d9fdce4b0 msgr2=0x558d9fe03410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:10:02.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.325+0000 7f3b8924b740 1 -- 172.21.15.99:0/942389250 shutdown_connections 2024-02-21T23:10:02.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.326+0000 7f3b8924b740 1 -- 172.21.15.99:0/942389250 wait complete. 2024-02-21T23:10:02.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.326+0000 7f3b8924b740 1 -- start start 2024-02-21T23:10:02.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.327+0000 7f3b8924b740 1 Processor -- start 2024-02-21T23:10:02.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.328+0000 7f3b8924b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d9fdc3e90 0x558d9fd97270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:02.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.328+0000 7f3b8924b740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558d9fe09180 0x558d9fdfdf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:02.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.328+0000 7f3b8924b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558d9fe09b40 0x558d9fdd08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:02.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.328+0000 7f3b8924b740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b80228b80 con 0x558d9fe09180 2024-02-21T23:10:02.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.328+0000 7f3b8924b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b80229e60 con 0x558d9fdc3e90 2024-02-21T23:10:02.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.328+0000 7f3b8924b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b802291a0 con 0x558d9fe09b40 2024-02-21T23:10:02.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.328+0000 7f3b8924b740 10 client.0 _ll_register_callbacks cb 0x7f3b78007630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:10:02.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.328+0000 7f3b77e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558d9fe09180 0x558d9fdfdf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:02.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.328+0000 7f3b77e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558d9fe09180 0x558d9fdfdf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46934/0 (socket says 172.21.15.99:46934) 2024-02-21T23:10:02.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.328+0000 7f3b7fe00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558d9fe09b40 0x558d9fdd08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:02.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.328+0000 7f3b77e00640 1 -- 172.21.15.99:0/3366668469 learned_addr learned my addr 172.21.15.99:0/3366668469 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:10:02.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.328+0000 7f3b7f400640 1 --2- 172.21.15.99:0/3366668469 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d9fdc3e90 0x558d9fd97270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:02.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.329+0000 7f3b7f400640 1 -- 172.21.15.99:0/3366668469 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558d9fe09b40 msgr2=0x558d9fdd08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:02.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.329+0000 7f3b7f400640 1 --2- 172.21.15.99:0/3366668469 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558d9fe09b40 0x558d9fdd08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:02.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.329+0000 7f3b7f400640 1 -- 172.21.15.99:0/3366668469 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558d9fe09180 msgr2=0x558d9fdfdf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:02.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.329+0000 7f3b7f400640 1 --2- 172.21.15.99:0/3366668469 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558d9fe09180 0x558d9fdfdf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:02.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.329+0000 7f3b7f400640 1 -- 172.21.15.99:0/3366668469 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558d9fdfe890 con 0x558d9fdc3e90 2024-02-21T23:10:02.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.329+0000 7f3b77e00640 1 --2- 172.21.15.99:0/3366668469 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558d9fe09180 0x558d9fdfdf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:10:02.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.329+0000 7f3b7f400640 1 --2- 172.21.15.99:0/3366668469 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d9fdc3e90 0x558d9fd97270 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f3b700c6d60 tx=0x7f3b70093310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=424f8b58df4ddbb2 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:02.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.329+0000 7f3b6cc00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-02-21T23:10:02.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.329+0000 7f3b6cc00640 1 -- 172.21.15.99:0/3366668469 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b700c6f00 con 0x558d9fdc3e90 2024-02-21T23:10:02.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.330+0000 7f3b8924b740 1 -- 172.21.15.99:0/3366668469 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3b68037070 con 0x558d9fdc3e90 2024-02-21T23:10:02.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.330+0000 7f3b6cc00640 1 -- 172.21.15.99:0/3366668469 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f3b700971a0 con 0x558d9fdc3e90 2024-02-21T23:10:02.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.330+0000 7f3b6cc00640 1 -- 172.21.15.99:0/3366668469 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3b700c70a0 con 0x558d9fdc3e90 2024-02-21T23:10:02.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.330+0000 7f3b8924b740 10 client.6814 fetch_fsmap learned FSMap version 17 2024-02-21T23:10:02.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.330+0000 7f3b8924b740 1 -- 172.21.15.99:0/3366668469 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x558d9fe72220 con 0x558d9fdc3e90 2024-02-21T23:10:02.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.330+0000 7f3b6cc00640 1 -- 172.21.15.99:0/3366668469 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b68037070 con 0x558d9fdc3e90 2024-02-21T23:10:02.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.330+0000 7f3b6cc00640 1 -- 172.21.15.99:0/3366668469 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f3b7009f250 con 0x558d9fdc3e90 2024-02-21T23:10:02.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.330+0000 7f3b8924b740 10 client.6814 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:10:02.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.330+0000 7f3b8924b740 10 client.6814 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:10:02.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.330+0000 7f3b8924b740 20 client.6814 populate_metadata read hostname 'smithi099' 2024-02-21T23:10:02.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.330+0000 7f3b8924b740 1 --2- 172.21.15.99:0/3366668469 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x558d9fe5e2d0 0x558d9fdd0de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:02.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.330+0000 7f3b8924b740 4 client.6814 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T23:10:02.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.330+0000 7f3b8924b740 1 -- 172.21.15.99:0/3366668469 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x558d9fcfe3e0 con 0x558d9fe5e2d0 2024-02-21T23:10:02.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.331+0000 7f3b77e00640 1 --2- 172.21.15.99:0/3366668469 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x558d9fe5e2d0 0x558d9fdd0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:02.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.332+0000 7f3b77e00640 1 --2- 172.21.15.99:0/3366668469 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x558d9fe5e2d0 0x558d9fdd0de0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d49f02b6d47676c server_cookie=259191ac59a1538 in_seq=0 out_seq=0 2024-02-21T23:10:02.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.332+0000 7f3b6cc00640 10 client.6814 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:10:02.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.332+0000 7f3b6cc00640 1 -- 172.21.15.99:0/3366668469 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x558d9fcfe3e0 con 0x558d9fe5e2d0 2024-02-21T23:10:02.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.332+0000 7f3b6cc00640 10 client.6814 handle_command_reply: tid=0 2024-02-21T23:10:02.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.332+0000 7f3b8924b740 1 client.6814 shutdown 2024-02-21T23:10:02.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.332+0000 7f3b8924b740 1 -- 172.21.15.99:0/3366668469 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d9fdc3e90 msgr2=0x558d9fd97270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:02.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.332+0000 7f3b8924b740 1 --2- 172.21.15.99:0/3366668469 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d9fdc3e90 0x558d9fd97270 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f3b700c6d60 tx=0x7f3b70093310 comp rx=0 tx=0).stop 2024-02-21T23:10:02.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.332+0000 7f3b8924b740 1 -- 172.21.15.99:0/3366668469 shutdown_connections 2024-02-21T23:10:02.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.332+0000 7f3b8924b740 1 --2- 172.21.15.99:0/3366668469 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x558d9fe5e2d0 0x558d9fdd0de0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:02.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.332+0000 7f3b8924b740 1 --2- 172.21.15.99:0/3366668469 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558d9fe09b40 0x558d9fdd08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:02.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.332+0000 7f3b8924b740 1 --2- 172.21.15.99:0/3366668469 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558d9fe09180 0x558d9fdfdf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:02.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.332+0000 7f3b8924b740 1 --2- 172.21.15.99:0/3366668469 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558d9fdc3e90 0x558d9fd97270 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:02.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.332+0000 7f3b8924b740 1 -- 172.21.15.99:0/3366668469 >> 172.21.15.99:0/3366668469 conn(0x558d9fdce4b0 msgr2=0x558d9fdbd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:10:02.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.332+0000 7f3b6cc00640 0 client.6814 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:10:02.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.332+0000 7f3b8924b740 1 -- 172.21.15.99:0/3366668469 shutdown_connections 2024-02-21T23:10:02.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.332+0000 7f3b8924b740 1 -- 172.21.15.99:0/3366668469 wait complete. 2024-02-21T23:10:02.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.333+0000 7f3b8924b740 20 client.6814 trim_cache size 0 max 16384 2024-02-21T23:10:02.327 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-02-21T23:10:02.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.333+0000 7f3b86400640 1 -- 172.21.15.99:0/2808442023 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f3b5c09eed0 msgr2=0x7f3b5c0a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:02.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.333+0000 7f3b86400640 1 --2- 172.21.15.99:0/2808442023 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f3b5c09eed0 0x7f3b5c0a1390 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3b780018c0 tx=0x7f3b78001850 comp rx=0 tx=0).stop 2024-02-21T23:10:02.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.333+0000 7f3b86400640 1 -- 172.21.15.99:0/2808442023 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b800d4320 msgr2=0x7f3b8008eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:02.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.333+0000 7f3b86400640 1 --2- 172.21.15.99:0/2808442023 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b800d4320 0x7f3b8008eab0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f3b7000c450 tx=0x7f3b7000c850 comp rx=0 tx=0).stop 2024-02-21T23:10:02.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.333+0000 7f3b86400640 1 -- 172.21.15.99:0/2808442023 shutdown_connections 2024-02-21T23:10:02.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.333+0000 7f3b86400640 1 --2- 172.21.15.99:0/2808442023 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f3b5c09eed0 0x7f3b5c0a1390 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:02.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.333+0000 7f3b86400640 1 --2- 172.21.15.99:0/2808442023 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3b801867e0 0x7f3b80220220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:02.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.333+0000 7f3b86400640 1 --2- 172.21.15.99:0/2808442023 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3b80186400 0x7f3b8016b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:02.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.333+0000 7f3b86400640 1 --2- 172.21.15.99:0/2808442023 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b800d4320 0x7f3b8008eab0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:02.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.333+0000 7f3b86400640 1 -- 172.21.15.99:0/2808442023 >> 172.21.15.99:0/2808442023 conn(0x7f3b800d6af0 msgr2=0x7f3b80188e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:10:02.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.334+0000 7f3b86400640 1 -- 172.21.15.99:0/2808442023 shutdown_connections 2024-02-21T23:10:02.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:02.334+0000 7f3b86400640 1 -- 172.21.15.99:0/2808442023 wait complete. 2024-02-21T23:10:03.342 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-02-21T23:10:03.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T23:10:03.343 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-02-21T23:10:03.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.568+0000 7fb4e7e00640 1 Processor -- start 2024-02-21T23:10:03.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.568+0000 7fb4e7e00640 1 -- start start 2024-02-21T23:10:03.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.570+0000 7fb4e7e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb4e015de70 0x7fb4e018a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:03.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.570+0000 7fb4e7e00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4e018a970 con 0x7fb4e018bcf0 2024-02-21T23:10:03.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.570+0000 7fb4e7e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4e018ac50 con 0x7fb4e015e250 2024-02-21T23:10:03.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.570+0000 7fb4e7e00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4e018c180 con 0x7fb4e015de70 2024-02-21T23:10:03.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.570+0000 7fb4e5400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb4e015de70 0x7fb4e018a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:03.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.570+0000 7fb4e5e00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fb4e018bcf0 0x7fb4e018c410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:42268/0 (socket says 172.21.15.99:42268) 2024-02-21T23:10:03.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.570+0000 7fb4e5e00640 1 -- 172.21.15.99:0/2105579999 learned_addr learned my addr 172.21.15.99:0/2105579999 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:10:03.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.571+0000 7fb4e5400640 1 -- 172.21.15.99:0/2105579999 >> v1:172.21.15.162:6789/0 conn(0x7fb4e015e250 legacy=0x7fb4e0186d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:03.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.571+0000 7fb4e5400640 1 -- 172.21.15.99:0/2105579999 >> v1:172.21.15.99:6789/0 conn(0x7fb4e018bcf0 legacy=0x7fb4e018c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:03.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.571+0000 7fb4e5400640 1 -- 172.21.15.99:0/2105579999 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e018af30 con 0x7fb4e015de70 2024-02-21T23:10:03.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.571+0000 7fb4dfe00640 1 -- 172.21.15.99:0/2105579999 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 24543260 0 0) 0x7fb4e018ac50 con 0x7fb4e015e250 2024-02-21T23:10:03.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.573+0000 7fb4e5400640 1 --2- 172.21.15.99:0/2105579999 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4e015de70 0x7fb4e018a310 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fb4d40097a0 tx=0x7fb4d402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b3b0ffbb842cc7 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:03.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.573+0000 7fb4dfe00640 1 -- 172.21.15.99:0/2105579999 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d40315a0 con 0x7fb4e015de70 2024-02-21T23:10:03.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.573+0000 7fb4dfe00640 1 -- 172.21.15.99:0/2105579999 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4d4037070 con 0x7fb4e015de70 2024-02-21T23:10:03.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.573+0000 7fb4dfe00640 1 -- 172.21.15.99:0/2105579999 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d4031960 con 0x7fb4e015de70 2024-02-21T23:10:03.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.574+0000 7fb4e7e00640 1 -- 172.21.15.99:0/2105579999 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4e015de70 msgr2=0x7fb4e018a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:03.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.574+0000 7fb4e7e00640 1 --2- 172.21.15.99:0/2105579999 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4e015de70 0x7fb4e018a310 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fb4d40097a0 tx=0x7fb4d402b840 comp rx=0 tx=0).stop 2024-02-21T23:10:03.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.574+0000 7fb4e7e00640 1 -- 172.21.15.99:0/2105579999 shutdown_connections 2024-02-21T23:10:03.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.574+0000 7fb4e7e00640 1 --2- 172.21.15.99:0/2105579999 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4e015de70 0x7fb4e018a310 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:03.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.574+0000 7fb4e7e00640 1 -- 172.21.15.99:0/2105579999 >> 172.21.15.99:0/2105579999 conn(0x7fb4e00740b0 msgr2=0x7fb4e00744c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:10:03.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.574+0000 7fb4e7e00640 1 -- 172.21.15.99:0/2105579999 shutdown_connections 2024-02-21T23:10:03.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.574+0000 7fb4e7e00640 1 -- 172.21.15.99:0/2105579999 wait complete. 2024-02-21T23:10:03.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.576+0000 7fb4e7e00640 1 Processor -- start 2024-02-21T23:10:03.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.576+0000 7fb4e7e00640 1 -- start start 2024-02-21T23:10:03.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.578+0000 7fb4e7e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4e015de70 0x7fb4e01578c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:03.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.578+0000 7fb4e7e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb4e018bcf0 0x7fb4e00f8f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:03.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.578+0000 7fb4e7e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4e00f94c0 0x7fb4e00fa620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:03.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.578+0000 7fb4e7e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e018b4f0 con 0x7fb4e00f94c0 2024-02-21T23:10:03.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.578+0000 7fb4e7e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e018b860 con 0x7fb4e015de70 2024-02-21T23:10:03.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.578+0000 7fb4e7e00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e0189d50 con 0x7fb4e018bcf0 2024-02-21T23:10:03.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.579+0000 7fb4e5400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4e015de70 0x7fb4e01578c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:03.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.579+0000 7fb4e5e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4e00f94c0 0x7fb4e00fa620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:03.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.579+0000 7fb4e5400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4e015de70 0x7fb4e01578c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:41502/0 (socket says 172.21.15.99:41502) 2024-02-21T23:10:03.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.579+0000 7fb4e5400640 1 -- 172.21.15.99:0/4285860944 learned_addr learned my addr 172.21.15.99:0/4285860944 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:10:03.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.579+0000 7fb4e4a00640 1 --2- 172.21.15.99:0/4285860944 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb4e018bcf0 0x7fb4e00f8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:03.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.579+0000 7fb4e5400640 1 -- 172.21.15.99:0/4285860944 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb4e018bcf0 msgr2=0x7fb4e00f8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:03.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.579+0000 7fb4e5400640 1 --2- 172.21.15.99:0/4285860944 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb4e018bcf0 0x7fb4e00f8f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:03.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.579+0000 7fb4e5400640 1 -- 172.21.15.99:0/4285860944 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4e00f94c0 msgr2=0x7fb4e00fa620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:03.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.579+0000 7fb4e5400640 1 --2- 172.21.15.99:0/4285860944 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4e00f94c0 0x7fb4e00fa620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:03.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.579+0000 7fb4e5400640 1 -- 172.21.15.99:0/4285860944 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e00fdb30 con 0x7fb4e015de70 2024-02-21T23:10:03.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.580+0000 7fb4e5400640 1 --2- 172.21.15.99:0/4285860944 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4e015de70 0x7fb4e01578c0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fb4d40098c0 tx=0x7fb4d40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:03.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.580+0000 7fb4dd600640 1 -- 172.21.15.99:0/4285860944 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d4032840 con 0x7fb4e015de70 2024-02-21T23:10:03.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.580+0000 7fb4dd600640 1 -- 172.21.15.99:0/4285860944 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4d40329e0 con 0x7fb4e015de70 2024-02-21T23:10:03.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.580+0000 7fb4e7e00640 1 -- 172.21.15.99:0/4285860944 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4e00fd570 con 0x7fb4e015de70 2024-02-21T23:10:03.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.580+0000 7fb4dd600640 1 -- 172.21.15.99:0/4285860944 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d4032dd0 con 0x7fb4e015de70 2024-02-21T23:10:03.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.580+0000 7fb4e7e00640 1 -- 172.21.15.99:0/4285860944 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4e00f9b40 con 0x7fb4e015de70 2024-02-21T23:10:03.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.583+0000 7fb4dd600640 1 -- 172.21.15.99:0/4285860944 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7fb4d403b3f0 con 0x7fb4e015de70 2024-02-21T23:10:03.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.585+0000 7fb4dd600640 1 --2- 172.21.15.99:0/4285860944 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fb4c009eed0 0x7fb4c00a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:03.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.586+0000 7fb4dd600640 1 -- 172.21.15.99:0/4285860944 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 8877+0+0 (secure 0 0 0) 0x7fb4d402f030 con 0x7fb4e015de70 2024-02-21T23:10:03.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.586+0000 7fb4e4a00640 1 --2- 172.21.15.99:0/4285860944 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fb4c009eed0 0x7fb4c00a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:03.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.586+0000 7fb4ead87740 1 Processor -- start 2024-02-21T23:10:03.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.586+0000 7fb4ead87740 1 -- start start 2024-02-21T23:10:03.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.586+0000 7fb4e4a00640 1 --2- 172.21.15.99:0/4285860944 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fb4c009eed0 0x7fb4c00a1390 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb4e0159650 tx=0x7fb4cc009040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:03.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.588+0000 7fb4ead87740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a3d79cb2f0 0x55a3d79cb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:03.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.588+0000 7fb4ead87740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a3d79cbc10 0x55a3d7a06480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:03.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.588+0000 7fb4ead87740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3d7a069c0 0x55a3d7a07750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:03.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.588+0000 7fb4ead87740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3d78f3790 con 0x55a3d79cb2f0 2024-02-21T23:10:03.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.588+0000 7fb4ead87740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3d789cbf0 con 0x55a3d7a069c0 2024-02-21T23:10:03.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.588+0000 7fb4ead87740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3d78ef830 con 0x55a3d79cbc10 2024-02-21T23:10:03.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.588+0000 7fb4e5400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a3d79cb2f0 0x55a3d79cb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:03.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.589+0000 7fb4e5400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a3d79cb2f0 0x55a3d79cb6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46968/0 (socket says 172.21.15.99:46968) 2024-02-21T23:10:03.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.589+0000 7fb4e5400640 1 -- 172.21.15.99:0/1136797081 learned_addr learned my addr 172.21.15.99:0/1136797081 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:10:03.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.589+0000 7fb4e5e00640 1 --2- 172.21.15.99:0/1136797081 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3d7a069c0 0x55a3d7a07750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:03.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.589+0000 7fb4e4a00640 1 --2- 172.21.15.99:0/1136797081 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a3d79cbc10 0x55a3d7a06480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:03.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.589+0000 7fb4e5400640 1 -- 172.21.15.99:0/1136797081 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a3d79cbc10 msgr2=0x55a3d7a06480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:03.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.589+0000 7fb4e5400640 1 --2- 172.21.15.99:0/1136797081 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a3d79cbc10 0x55a3d7a06480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:03.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.589+0000 7fb4e5400640 1 -- 172.21.15.99:0/1136797081 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3d7a069c0 msgr2=0x55a3d7a07750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:03.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.589+0000 7fb4e5400640 1 --2- 172.21.15.99:0/1136797081 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3d7a069c0 0x55a3d7a07750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:03.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.589+0000 7fb4e5400640 1 -- 172.21.15.99:0/1136797081 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a3d78bac40 con 0x55a3d79cb2f0 2024-02-21T23:10:03.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.589+0000 7fb4e5400640 1 --2- 172.21.15.99:0/1136797081 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a3d79cb2f0 0x55a3d79cb6d0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fb4d4000c00 tx=0x7fb4d4009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d25bdc75d0a7c9 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:03.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.590+0000 7fb4d1c00640 1 -- 172.21.15.99:0/1136797081 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d40c1e50 con 0x55a3d79cb2f0 2024-02-21T23:10:03.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.590+0000 7fb4d1c00640 1 -- 172.21.15.99:0/1136797081 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4d4037070 con 0x55a3d79cb2f0 2024-02-21T23:10:03.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.590+0000 7fb4d1c00640 1 -- 172.21.15.99:0/1136797081 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d40e9780 con 0x55a3d79cb2f0 2024-02-21T23:10:03.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.590+0000 7fb4ead87740 1 -- 172.21.15.99:0/1136797081 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a3d79cb2f0 msgr2=0x55a3d79cb6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:03.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.590+0000 7fb4ead87740 1 --2- 172.21.15.99:0/1136797081 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a3d79cb2f0 0x55a3d79cb6d0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fb4d4000c00 tx=0x7fb4d4009190 comp rx=0 tx=0).stop 2024-02-21T23:10:03.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.591+0000 7fb4ead87740 1 -- 172.21.15.99:0/1136797081 shutdown_connections 2024-02-21T23:10:03.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.591+0000 7fb4ead87740 1 --2- 172.21.15.99:0/1136797081 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3d7a069c0 0x55a3d7a07750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:03.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.591+0000 7fb4ead87740 1 --2- 172.21.15.99:0/1136797081 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a3d79cbc10 0x55a3d7a06480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:03.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.591+0000 7fb4ead87740 1 --2- 172.21.15.99:0/1136797081 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a3d79cb2f0 0x55a3d79cb6d0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:03.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.591+0000 7fb4ead87740 1 -- 172.21.15.99:0/1136797081 >> 172.21.15.99:0/1136797081 conn(0x55a3d798d8c0 msgr2=0x55a3d798e940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:10:03.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.591+0000 7fb4ead87740 1 -- 172.21.15.99:0/1136797081 shutdown_connections 2024-02-21T23:10:03.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.591+0000 7fb4ead87740 1 -- 172.21.15.99:0/1136797081 wait complete. 2024-02-21T23:10:03.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.592+0000 7fb4ead87740 1 -- start start 2024-02-21T23:10:03.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.592+0000 7fb4ead87740 1 Processor -- start 2024-02-21T23:10:03.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.595+0000 7fb4ead87740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3d79cbc10 0x55a3d79c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:03.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.595+0000 7fb4ead87740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a3d7a069c0 0x55a3d79bde10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:03.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.595+0000 7fb4ead87740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a3d79c93d0 0x55a3d79bc850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:03.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.595+0000 7fb4ead87740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3d7a04ea0 con 0x55a3d79c93d0 2024-02-21T23:10:03.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.595+0000 7fb4ead87740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3d78921d0 con 0x55a3d79cbc10 2024-02-21T23:10:03.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.595+0000 7fb4ead87740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3d7a05180 con 0x55a3d7a069c0 2024-02-21T23:10:03.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.595+0000 7fb4ead87740 10 client.0 _ll_register_callbacks cb 0x55a3d7607c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:10:03.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.595+0000 7fb4e5400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3d79cbc10 0x55a3d79c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:03.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.595+0000 7fb4e5400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3d79cbc10 0x55a3d79c8e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:41520/0 (socket says 172.21.15.99:41520) 2024-02-21T23:10:03.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.595+0000 7fb4e5400640 1 -- 172.21.15.99:0/753937285 learned_addr learned my addr 172.21.15.99:0/753937285 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:10:03.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.595+0000 7fb4e4a00640 1 --2- 172.21.15.99:0/753937285 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a3d7a069c0 0x55a3d79bde10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:03.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.595+0000 7fb4e5e00640 1 --2- 172.21.15.99:0/753937285 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a3d79c93d0 0x55a3d79bc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:03.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.595+0000 7fb4e4a00640 1 -- 172.21.15.99:0/753937285 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3d79cbc10 msgr2=0x55a3d79c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:03.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.595+0000 7fb4e4a00640 1 --2- 172.21.15.99:0/753937285 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3d79cbc10 0x55a3d79c8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:03.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.595+0000 7fb4e4a00640 1 -- 172.21.15.99:0/753937285 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a3d79c93d0 msgr2=0x55a3d79bc850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:03.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.595+0000 7fb4e4a00640 1 --2- 172.21.15.99:0/753937285 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a3d79c93d0 0x55a3d79bc850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:03.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.596+0000 7fb4e4a00640 1 -- 172.21.15.99:0/753937285 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a3d76d07e0 con 0x55a3d7a069c0 2024-02-21T23:10:03.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.596+0000 7fb4e4a00640 1 --2- 172.21.15.99:0/753937285 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a3d7a069c0 0x55a3d79bde10 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fb4e00d0280 tx=0x7fb4cc000ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=946b0565aab4606 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:03.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.596+0000 7fb4c6000640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-02-21T23:10:03.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.596+0000 7fb4c6000640 1 -- 172.21.15.99:0/753937285 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4cc025020 con 0x55a3d7a069c0 2024-02-21T23:10:03.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.596+0000 7fb4c6000640 1 -- 172.21.15.99:0/753937285 <== mon.2 v2:172.21.15.181:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8877+0+0 (secure 0 0 0) 0x7fb4cc013680 con 0x55a3d7a069c0 2024-02-21T23:10:03.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.596+0000 7fb4ead87740 1 -- 172.21.15.99:0/753937285 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb4d4037070 con 0x55a3d7a069c0 2024-02-21T23:10:03.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.597+0000 7fb4c6000640 1 -- 172.21.15.99:0/753937285 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb4cc030050 con 0x55a3d7a069c0 2024-02-21T23:10:03.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.597+0000 7fb4ead87740 10 client.6794 fetch_fsmap learned FSMap version 17 2024-02-21T23:10:03.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.597+0000 7fb4ead87740 1 -- 172.21.15.99:0/753937285 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55a3d7730f70 con 0x55a3d7a069c0 2024-02-21T23:10:03.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.597+0000 7fb4c6000640 1 -- 172.21.15.99:0/753937285 <== mon.2 v2:172.21.15.181:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4d4037070 con 0x55a3d7a069c0 2024-02-21T23:10:03.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.597+0000 7fb4c6000640 1 -- 172.21.15.99:0/753937285 <== mon.2 v2:172.21.15.181:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fb4cc020040 con 0x55a3d7a069c0 2024-02-21T23:10:03.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.597+0000 7fb4ead87740 10 client.6794 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:10:03.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.597+0000 7fb4ead87740 10 client.6794 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:10:03.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.597+0000 7fb4ead87740 20 client.6794 populate_metadata read hostname 'smithi099' 2024-02-21T23:10:03.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.597+0000 7fb4ead87740 1 --2- 172.21.15.99:0/753937285 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55a3d79c97b0 0x55a3d7989690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:03.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.597+0000 7fb4ead87740 4 client.6794 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:10:03.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.597+0000 7fb4ead87740 1 -- 172.21.15.99:0/753937285 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a3d7900cd0 con 0x55a3d79c97b0 2024-02-21T23:10:03.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.597+0000 7fb4e5400640 1 --2- 172.21.15.99:0/753937285 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55a3d79c97b0 0x55a3d7989690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:03.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.598+0000 7fb4e5400640 1 --2- 172.21.15.99:0/753937285 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55a3d79c97b0 0x55a3d7989690 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a5e216bea51a292 server_cookie=6e779d41a40db2fd in_seq=0 out_seq=0 2024-02-21T23:10:03.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.598+0000 7fb4c6000640 10 client.6794 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:10:03.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.599+0000 7fb4c6000640 1 -- 172.21.15.99:0/753937285 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55a3d7900cd0 con 0x55a3d79c97b0 2024-02-21T23:10:03.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.599+0000 7fb4c6000640 10 client.6794 handle_command_reply: tid=0 2024-02-21T23:10:03.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.599+0000 7fb4ead87740 1 client.6794 shutdown 2024-02-21T23:10:03.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.599+0000 7fb4ead87740 1 -- 172.21.15.99:0/753937285 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a3d7a069c0 msgr2=0x55a3d79bde10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:03.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.599+0000 7fb4ead87740 1 --2- 172.21.15.99:0/753937285 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a3d7a069c0 0x55a3d79bde10 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fb4e00d0280 tx=0x7fb4cc000ed0 comp rx=0 tx=0).stop 2024-02-21T23:10:03.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.599+0000 7fb4ead87740 1 -- 172.21.15.99:0/753937285 shutdown_connections 2024-02-21T23:10:03.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.599+0000 7fb4ead87740 1 --2- 172.21.15.99:0/753937285 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55a3d79c97b0 0x55a3d7989690 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:03.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.599+0000 7fb4ead87740 1 --2- 172.21.15.99:0/753937285 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a3d79c93d0 0x55a3d79bc850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:03.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.599+0000 7fb4ead87740 1 --2- 172.21.15.99:0/753937285 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a3d7a069c0 0x55a3d79bde10 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:03.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.599+0000 7fb4ead87740 1 --2- 172.21.15.99:0/753937285 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3d79cbc10 0x55a3d79c8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:03.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.599+0000 7fb4c6000640 0 client.6794 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:10:03.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.599+0000 7fb4ead87740 1 -- 172.21.15.99:0/753937285 >> 172.21.15.99:0/753937285 conn(0x55a3d79cb2f0 msgr2=0x55a3d7a04660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:10:03.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.600+0000 7fb4ead87740 1 -- 172.21.15.99:0/753937285 shutdown_connections 2024-02-21T23:10:03.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.600+0000 7fb4ead87740 1 -- 172.21.15.99:0/753937285 wait complete. 2024-02-21T23:10:03.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.600+0000 7fb4ead87740 20 client.6794 trim_cache size 0 max 16384 2024-02-21T23:10:03.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.617+0000 7fb4ead87740 1 Processor -- start 2024-02-21T23:10:03.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.617+0000 7fb4ead87740 1 -- start start 2024-02-21T23:10:03.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.619+0000 7fb4ead87740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3d79c93d0 0x55a3d7a17550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:03.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.619+0000 7fb4ead87740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a3d79cbc10 0x55a3d7a029a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:03.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.619+0000 7fb4ead87740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a3d7a069c0 0x55a3d79c3700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:03.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.619+0000 7fb4ead87740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e022cb90 con 0x55a3d79cbc10 2024-02-21T23:10:03.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.619+0000 7fb4ead87740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e022a730 con 0x55a3d79c93d0 2024-02-21T23:10:03.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.619+0000 7fb4ead87740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e021f5c0 con 0x55a3d7a069c0 2024-02-21T23:10:03.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.619+0000 7fb4e4a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a3d79cbc10 0x55a3d7a029a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:03.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.619+0000 7fb4e4a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a3d79cbc10 0x55a3d7a029a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:46998/0 (socket says 172.21.15.99:46998) 2024-02-21T23:10:03.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.619+0000 7fb4e4a00640 1 -- 172.21.15.99:0/744802505 learned_addr learned my addr 172.21.15.99:0/744802505 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:10:03.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.619+0000 7fb4e5e00640 1 --2- 172.21.15.99:0/744802505 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a3d7a069c0 0x55a3d79c3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:03.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.619+0000 7fb4e5400640 1 --2- 172.21.15.99:0/744802505 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3d79c93d0 0x55a3d7a17550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:03.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.619+0000 7fb4e4a00640 1 -- 172.21.15.99:0/744802505 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a3d7a069c0 msgr2=0x55a3d79c3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:03.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.619+0000 7fb4e4a00640 1 --2- 172.21.15.99:0/744802505 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a3d7a069c0 0x55a3d79c3700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:03.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.619+0000 7fb4e4a00640 1 -- 172.21.15.99:0/744802505 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3d79c93d0 msgr2=0x55a3d7a17550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:03.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.619+0000 7fb4e4a00640 1 --2- 172.21.15.99:0/744802505 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3d79c93d0 0x55a3d7a17550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:03.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.619+0000 7fb4e4a00640 1 -- 172.21.15.99:0/744802505 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a3d75c8170 con 0x55a3d79cbc10 2024-02-21T23:10:03.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.620+0000 7fb4e4a00640 1 --2- 172.21.15.99:0/744802505 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a3d79cbc10 0x55a3d7a029a0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc010ec0 tx=0x7fb4cc01b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30297fdb286ec84 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:03.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.620+0000 7fb4d1200640 1 -- 172.21.15.99:0/744802505 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4cc0139c0 con 0x55a3d79cbc10 2024-02-21T23:10:03.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.620+0000 7fb4d1200640 1 -- 172.21.15.99:0/744802505 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4cc01b070 con 0x55a3d79cbc10 2024-02-21T23:10:03.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.620+0000 7fb4d1200640 1 -- 172.21.15.99:0/744802505 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4cc034620 con 0x55a3d79cbc10 2024-02-21T23:10:03.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.621+0000 7fb4ead87740 1 -- 172.21.15.99:0/744802505 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a3d79cbc10 msgr2=0x55a3d7a029a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:03.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.621+0000 7fb4ead87740 1 --2- 172.21.15.99:0/744802505 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a3d79cbc10 0x55a3d7a029a0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc010ec0 tx=0x7fb4cc01b000 comp rx=0 tx=0).stop 2024-02-21T23:10:03.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.621+0000 7fb4ead87740 1 -- 172.21.15.99:0/744802505 shutdown_connections 2024-02-21T23:10:03.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.621+0000 7fb4ead87740 1 --2- 172.21.15.99:0/744802505 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a3d7a069c0 0x55a3d79c3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:03.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.621+0000 7fb4ead87740 1 --2- 172.21.15.99:0/744802505 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a3d79cbc10 0x55a3d7a029a0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:03.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.621+0000 7fb4ead87740 1 --2- 172.21.15.99:0/744802505 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3d79c93d0 0x55a3d7a17550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:03.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.621+0000 7fb4ead87740 1 -- 172.21.15.99:0/744802505 >> 172.21.15.99:0/744802505 conn(0x55a3d79cb2f0 msgr2=0x55a3d79bc660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:10:03.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.621+0000 7fb4ead87740 1 -- 172.21.15.99:0/744802505 shutdown_connections 2024-02-21T23:10:03.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.621+0000 7fb4ead87740 1 -- 172.21.15.99:0/744802505 wait complete. 2024-02-21T23:10:03.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.622+0000 7fb4ead87740 1 -- start start 2024-02-21T23:10:03.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.622+0000 7fb4ead87740 1 Processor -- start 2024-02-21T23:10:03.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.625+0000 7fb4ead87740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3d79c93d0 0x55a3d79b1e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:03.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.625+0000 7fb4ead87740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a3d79cbc10 0x55a3d7a730b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:03.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.625+0000 7fb4ead87740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a3d7a069c0 0x55a3d79aead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:03.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.625+0000 7fb4ead87740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e0228e30 con 0x55a3d7a069c0 2024-02-21T23:10:03.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.625+0000 7fb4ead87740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e022a0d0 con 0x55a3d79c93d0 2024-02-21T23:10:03.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.625+0000 7fb4ead87740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e0229430 con 0x55a3d79cbc10 2024-02-21T23:10:03.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.625+0000 7fb4ead87740 10 client.0 _ll_register_callbacks cb 0x7fb4cc0079c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:10:03.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.625+0000 7fb4e5400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3d79c93d0 0x55a3d79b1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:03.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.625+0000 7fb4e5400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3d79c93d0 0x55a3d79b1e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:41532/0 (socket says 172.21.15.99:41532) 2024-02-21T23:10:03.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.625+0000 7fb4e5400640 1 -- 172.21.15.99:0/3211297397 learned_addr learned my addr 172.21.15.99:0/3211297397 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:10:03.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.625+0000 7fb4e5e00640 1 --2- 172.21.15.99:0/3211297397 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a3d7a069c0 0x55a3d79aead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:03.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.625+0000 7fb4e4a00640 1 --2- 172.21.15.99:0/3211297397 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a3d79cbc10 0x55a3d7a730b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:03.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.625+0000 7fb4e5400640 1 -- 172.21.15.99:0/3211297397 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a3d79cbc10 msgr2=0x55a3d7a730b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:03.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.625+0000 7fb4e5400640 1 --2- 172.21.15.99:0/3211297397 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a3d79cbc10 0x55a3d7a730b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:03.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.625+0000 7fb4e5400640 1 -- 172.21.15.99:0/3211297397 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a3d7a069c0 msgr2=0x55a3d79aead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:03.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.625+0000 7fb4e5400640 1 --2- 172.21.15.99:0/3211297397 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a3d7a069c0 0x55a3d79aead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:03.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.626+0000 7fb4e5400640 1 -- 172.21.15.99:0/3211297397 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a3d79b1c40 con 0x55a3d79c93d0 2024-02-21T23:10:03.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.626+0000 7fb4e5400640 1 --2- 172.21.15.99:0/3211297397 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3d79c93d0 0x55a3d79b1e60 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fb4d40b93b0 tx=0x7fb4d40a4070 comp rx=0 tx=0).ready entity=mon.1 client_cookie=37e380db12b40cee server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:03.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.626+0000 7fb4c6000640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-02-21T23:10:03.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.626+0000 7fb4c6000640 1 -- 172.21.15.99:0/3211297397 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d40b5950 con 0x55a3d79c93d0 2024-02-21T23:10:03.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.626+0000 7fb4c6000640 1 -- 172.21.15.99:0/3211297397 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8877+0+0 (secure 0 0 0) 0x7fb4d40a40e0 con 0x55a3d79c93d0 2024-02-21T23:10:03.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.626+0000 7fb4ead87740 1 -- 172.21.15.99:0/3211297397 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb4cc01b070 con 0x55a3d79c93d0 2024-02-21T23:10:03.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.626+0000 7fb4c6000640 1 -- 172.21.15.99:0/3211297397 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb4d40b5d20 con 0x55a3d79c93d0 2024-02-21T23:10:03.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.626+0000 7fb4ead87740 10 client.6832 fetch_fsmap learned FSMap version 17 2024-02-21T23:10:03.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.626+0000 7fb4ead87740 1 -- 172.21.15.99:0/3211297397 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55a3d79b5820 con 0x55a3d79c93d0 2024-02-21T23:10:03.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.627+0000 7fb4c6000640 1 -- 172.21.15.99:0/3211297397 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4cc01b070 con 0x55a3d79c93d0 2024-02-21T23:10:03.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.627+0000 7fb4c6000640 1 -- 172.21.15.99:0/3211297397 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fb4d404c070 con 0x55a3d79c93d0 2024-02-21T23:10:03.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.627+0000 7fb4ead87740 10 client.6832 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:10:03.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.627+0000 7fb4ead87740 10 client.6832 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:10:03.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.627+0000 7fb4ead87740 20 client.6832 populate_metadata read hostname 'smithi099' 2024-02-21T23:10:03.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.627+0000 7fb4ead87740 1 --2- 172.21.15.99:0/3211297397 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55a3d7a10240 0x55a3d79af010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:03.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.627+0000 7fb4ead87740 4 client.6832 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-02-21T23:10:03.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.627+0000 7fb4ead87740 1 -- 172.21.15.99:0/3211297397 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55a3d798e020 con 0x55a3d7a10240 2024-02-21T23:10:03.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.627+0000 7fb4e4a00640 1 --2- 172.21.15.99:0/3211297397 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55a3d7a10240 0x55a3d79af010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:03.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.628+0000 7fb4e4a00640 1 --2- 172.21.15.99:0/3211297397 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55a3d7a10240 0x55a3d79af010 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e811c4ecacebb20b server_cookie=802238c20cf1fd0e in_seq=0 out_seq=0 2024-02-21T23:10:03.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.628+0000 7fb4c6000640 10 client.6832 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:10:03.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.629+0000 7fb4c6000640 1 -- 172.21.15.99:0/3211297397 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55a3d798e020 con 0x55a3d7a10240 2024-02-21T23:10:03.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.629+0000 7fb4c6000640 10 client.6832 handle_command_reply: tid=0 2024-02-21T23:10:03.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.629+0000 7fb4ead87740 1 client.6832 shutdown 2024-02-21T23:10:03.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.630+0000 7fb4ead87740 1 -- 172.21.15.99:0/3211297397 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3d79c93d0 msgr2=0x55a3d79b1e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:03.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.630+0000 7fb4ead87740 1 --2- 172.21.15.99:0/3211297397 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3d79c93d0 0x55a3d79b1e60 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fb4d40b93b0 tx=0x7fb4d40a4070 comp rx=0 tx=0).stop 2024-02-21T23:10:03.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.630+0000 7fb4ead87740 1 -- 172.21.15.99:0/3211297397 shutdown_connections 2024-02-21T23:10:03.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.630+0000 7fb4ead87740 1 --2- 172.21.15.99:0/3211297397 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55a3d7a10240 0x55a3d79af010 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:03.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.630+0000 7fb4ead87740 1 --2- 172.21.15.99:0/3211297397 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55a3d7a069c0 0x55a3d79aead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:03.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.630+0000 7fb4ead87740 1 --2- 172.21.15.99:0/3211297397 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55a3d79cbc10 0x55a3d7a730b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:03.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.630+0000 7fb4ead87740 1 --2- 172.21.15.99:0/3211297397 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a3d79c93d0 0x55a3d79b1e60 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:03.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.630+0000 7fb4ead87740 1 -- 172.21.15.99:0/3211297397 >> 172.21.15.99:0/3211297397 conn(0x55a3d79cb2f0 msgr2=0x55a3d79bdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:10:03.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.630+0000 7fb4c6000640 0 client.6832 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:10:03.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.630+0000 7fb4ead87740 1 -- 172.21.15.99:0/3211297397 shutdown_connections 2024-02-21T23:10:03.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.630+0000 7fb4ead87740 1 -- 172.21.15.99:0/3211297397 wait complete. 2024-02-21T23:10:03.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.631+0000 7fb4ead87740 20 client.6832 trim_cache size 0 max 16384 2024-02-21T23:10:03.622 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-02-21T23:10:03.623 INFO:teuthology.orchestra.run.smithi099.stdout: "return_code": 0, 2024-02-21T23:10:03.623 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_tag": "b3ba0750-bd19-4f4e-9554-bb3835891eb1", 2024-02-21T23:10:03.623 INFO:teuthology.orchestra.run.smithi099.stdout: "mode": "asynchronous" 2024-02-21T23:10:03.623 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-02-21T23:10:03.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.632+0000 7fb4e7e00640 1 -- 172.21.15.99:0/4285860944 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fb4c009eed0 msgr2=0x7fb4c00a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:03.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.632+0000 7fb4e7e00640 1 --2- 172.21.15.99:0/4285860944 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fb4c009eed0 0x7fb4c00a1390 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb4e0159650 tx=0x7fb4cc009040 comp rx=0 tx=0).stop 2024-02-21T23:10:03.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.632+0000 7fb4e7e00640 1 -- 172.21.15.99:0/4285860944 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4e015de70 msgr2=0x7fb4e01578c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:03.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.632+0000 7fb4e7e00640 1 --2- 172.21.15.99:0/4285860944 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4e015de70 0x7fb4e01578c0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fb4d40098c0 tx=0x7fb4d40046c0 comp rx=0 tx=0).stop 2024-02-21T23:10:03.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.632+0000 7fb4e7e00640 1 -- 172.21.15.99:0/4285860944 shutdown_connections 2024-02-21T23:10:03.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.632+0000 7fb4e7e00640 1 --2- 172.21.15.99:0/4285860944 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fb4c009eed0 0x7fb4c00a1390 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:03.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.632+0000 7fb4e7e00640 1 --2- 172.21.15.99:0/4285860944 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb4e00f94c0 0x7fb4e00fa620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:03.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.632+0000 7fb4e7e00640 1 --2- 172.21.15.99:0/4285860944 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb4e018bcf0 0x7fb4e00f8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:03.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.632+0000 7fb4e7e00640 1 --2- 172.21.15.99:0/4285860944 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4e015de70 0x7fb4e01578c0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:03.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.632+0000 7fb4e7e00640 1 -- 172.21.15.99:0/4285860944 >> 172.21.15.99:0/4285860944 conn(0x7fb4e00740b0 msgr2=0x7fb4e0189320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:10:03.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.632+0000 7fb4e7e00640 1 -- 172.21.15.99:0/4285860944 shutdown_connections 2024-02-21T23:10:03.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.632+0000 7fb4e7e00640 1 -- 172.21.15.99:0/4285860944 wait complete. 2024-02-21T23:10:03.646 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T23:10:03.647 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T23:10:03.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.932+0000 7f8617000640 1 Processor -- start 2024-02-21T23:10:03.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.932+0000 7f8617000640 1 -- start start 2024-02-21T23:10:03.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.935+0000 7f8617000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f861018a9b0 0x7f861018ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:03.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.936+0000 7f860f400640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f861018e510 0x7f861018af90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:54492/0 (socket says 172.21.15.99:54492) 2024-02-21T23:10:03.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.936+0000 7f8617000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f861018ec00 con 0x7f8610190610 2024-02-21T23:10:03.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.936+0000 7f8617000640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f861018eee0 con 0x7f861018e510 2024-02-21T23:10:03.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.936+0000 7f8617000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f861018e9a0 con 0x7f861018a9b0 2024-02-21T23:10:03.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.936+0000 7f860f400640 1 -- 172.21.15.99:0/1193744814 learned_addr learned my addr 172.21.15.99:0/1193744814 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:10:03.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.936+0000 7f860fe00640 1 --2- 172.21.15.99:0/1193744814 >> v2:172.21.15.162:3300/0 conn(0x7f861018a9b0 0x7f861018ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:03.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.936+0000 7f860ea00640 1 -- 172.21.15.99:0/1193744814 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3855887008 0 0) 0x7f861018eee0 con 0x7f861018e510 2024-02-21T23:10:03.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.937+0000 7f860ea00640 1 -- 172.21.15.99:0/1193744814 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85f4003520 con 0x7f861018e510 2024-02-21T23:10:03.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.937+0000 7f860ea00640 1 -- 172.21.15.99:0/1193744814 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1948062153 0 0) 0x7f861018ec00 con 0x7f8610190610 2024-02-21T23:10:03.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.937+0000 7f860ea00640 1 -- 172.21.15.99:0/1193744814 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f861018eee0 con 0x7f8610190610 2024-02-21T23:10:03.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.937+0000 7f860ea00640 1 -- 172.21.15.99:0/1193744814 <== mon.2 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 702005965 0 0) 0x7f85f4003520 con 0x7f861018e510 2024-02-21T23:10:03.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.937+0000 7f860ea00640 1 -- 172.21.15.99:0/1193744814 >> v2:172.21.15.162:3300/0 conn(0x7f861018a9b0 msgr2=0x7f861018ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:03.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.937+0000 7f860ea00640 1 --2- 172.21.15.99:0/1193744814 >> v2:172.21.15.162:3300/0 conn(0x7f861018a9b0 0x7f861018ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:03.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.937+0000 7f860ea00640 1 -- 172.21.15.99:0/1193744814 >> v1:172.21.15.99:6789/0 conn(0x7f8610190610 legacy=0x7f8610190a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:03.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.937+0000 7f860ea00640 1 -- 172.21.15.99:0/1193744814 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f861018f1c0 con 0x7f861018e510 2024-02-21T23:10:03.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.937+0000 7f860ea00640 1 -- 172.21.15.99:0/1193744814 <== mon.2 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2069890144 0 0) 0x7f85fc001670 con 0x7f861018e510 2024-02-21T23:10:03.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.937+0000 7f860ea00640 1 -- 172.21.15.99:0/1193744814 >> v1:172.21.15.181:6789/0 conn(0x7f861018e510 legacy=0x7f861018af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:03.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.937+0000 7f860ea00640 1 --2- 172.21.15.99:0/1193744814 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f85f4003b40 0x7f85f4003f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:03.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.937+0000 7f860ea00640 1 --2- 172.21.15.99:0/1193744814 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85f4004800 0x7f85f4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:03.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.937+0000 7f860ea00640 1 --2- 172.21.15.99:0/1193744814 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f85f4005210 0x7f85f400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:03.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.937+0000 7f860ea00640 1 -- 172.21.15.99:0/1193744814 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f861018e9a0 con 0x7f85f4004800 2024-02-21T23:10:03.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.937+0000 7f860ea00640 1 -- 172.21.15.99:0/1193744814 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85f400c160 con 0x7f85f4003b40 2024-02-21T23:10:03.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.937+0000 7f860ea00640 1 -- 172.21.15.99:0/1193744814 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85f400c360 con 0x7f85f4005210 2024-02-21T23:10:03.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.938+0000 7f8615000640 1 --2- 172.21.15.99:0/1193744814 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f85f4005210 0x7f85f400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:03.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.938+0000 7f860f400640 1 --2- 172.21.15.99:0/1193744814 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85f4004800 0x7f85f4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:03.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.939+0000 7f860fe00640 1 --2- 172.21.15.99:0/1193744814 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f85f4003b40 0x7f85f4003f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:03.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.939+0000 7f8615000640 1 -- 172.21.15.99:0/1193744814 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f85f4003b40 msgr2=0x7f85f4003f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:03.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.939+0000 7f8615000640 1 --2- 172.21.15.99:0/1193744814 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f85f4003b40 0x7f85f4003f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:03.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.939+0000 7f8615000640 1 -- 172.21.15.99:0/1193744814 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85f4004800 msgr2=0x7f85f4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:03.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.939+0000 7f8615000640 1 --2- 172.21.15.99:0/1193744814 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85f4004800 0x7f85f4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:03.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.939+0000 7f8615000640 1 -- 172.21.15.99:0/1193744814 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f861018f1c0 con 0x7f85f4005210 2024-02-21T23:10:03.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.939+0000 7f860f400640 1 --2- 172.21.15.99:0/1193744814 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85f4004800 0x7f85f4004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T23:10:03.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.939+0000 7f860fe00640 1 --2- 172.21.15.99:0/1193744814 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f85f4003b40 0x7f85f4003f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T23:10:03.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.942+0000 7f8615000640 1 -- 172.21.15.99:0/1193744814 reap_dead start 2024-02-21T23:10:03.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.943+0000 7f8615000640 1 --2- 172.21.15.99:0/1193744814 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f85f4005210 0x7f85f400b9c0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f8608002010 tx=0x7f85f4005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9012d8a94a53bcd3 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:03.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.944+0000 7f860ea00640 1 -- 172.21.15.99:0/1193744814 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8608039070 con 0x7f85f4005210 2024-02-21T23:10:03.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.944+0000 7f860ea00640 1 -- 172.21.15.99:0/1193744814 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f860802c790 con 0x7f85f4005210 2024-02-21T23:10:03.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.944+0000 7f860ea00640 1 -- 172.21.15.99:0/1193744814 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8608001be0 con 0x7f85f4005210 2024-02-21T23:10:03.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.945+0000 7f8617000640 1 -- 172.21.15.99:0/1193744814 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f85f4005210 msgr2=0x7f85f400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:03.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.945+0000 7f8617000640 1 --2- 172.21.15.99:0/1193744814 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f85f4005210 0x7f85f400b9c0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f8608002010 tx=0x7f85f4005830 comp rx=0 tx=0).stop 2024-02-21T23:10:03.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.945+0000 7f8617000640 1 -- 172.21.15.99:0/1193744814 shutdown_connections 2024-02-21T23:10:03.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.945+0000 7f8617000640 1 --2- 172.21.15.99:0/1193744814 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f85f4005210 0x7f85f400b9c0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:03.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.945+0000 7f8617000640 1 -- 172.21.15.99:0/1193744814 >> 172.21.15.99:0/1193744814 conn(0x7f86100ce5f0 msgr2=0x7f86100cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:10:03.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.946+0000 7f8617000640 1 -- 172.21.15.99:0/1193744814 shutdown_connections 2024-02-21T23:10:03.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.946+0000 7f8617000640 1 -- 172.21.15.99:0/1193744814 wait complete. 2024-02-21T23:10:03.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.949+0000 7f8617000640 1 Processor -- start 2024-02-21T23:10:03.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.950+0000 7f8617000640 1 -- start start 2024-02-21T23:10:03.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.952+0000 7f8617000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85f4005210 0x7f861006c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:03.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.952+0000 7f8617000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f861006cb70 0x7f86100f9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:03.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.952+0000 7f8617000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86100f99a0 0x7f861017eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:03.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.952+0000 7f8617000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f861018fa60 con 0x7f85f4005210 2024-02-21T23:10:03.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.952+0000 7f8617000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f861018f780 con 0x7f86100f99a0 2024-02-21T23:10:03.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.952+0000 7f8617000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f861018ff80 con 0x7f861006cb70 2024-02-21T23:10:03.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.952+0000 7f860f400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f861006cb70 0x7f86100f9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:03.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.953+0000 7f8615000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86100f99a0 0x7f861017eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:03.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.952+0000 7f860fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85f4005210 0x7f861006c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:03.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.953+0000 7f860fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85f4005210 0x7f861006c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47010/0 (socket says 172.21.15.99:47010) 2024-02-21T23:10:03.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.953+0000 7f860fe00640 1 -- 172.21.15.99:0/478127574 learned_addr learned my addr 172.21.15.99:0/478127574 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:10:03.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.953+0000 7f860fe00640 1 -- 172.21.15.99:0/478127574 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f861006cb70 msgr2=0x7f86100f9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:03.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.954+0000 7f860fe00640 1 --2- 172.21.15.99:0/478127574 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f861006cb70 0x7f86100f9460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:03.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.954+0000 7f860fe00640 1 -- 172.21.15.99:0/478127574 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86100f99a0 msgr2=0x7f861017eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:03.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.954+0000 7f860fe00640 1 --2- 172.21.15.99:0/478127574 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86100f99a0 0x7f861017eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:03.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.954+0000 7f860fe00640 1 -- 172.21.15.99:0/478127574 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86100f9e20 con 0x7f85f4005210 2024-02-21T23:10:03.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.954+0000 7f860f400640 1 --2- 172.21.15.99:0/478127574 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f861006cb70 0x7f86100f9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:10:03.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.954+0000 7f8615000640 1 --2- 172.21.15.99:0/478127574 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86100f99a0 0x7f861017eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:10:03.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.954+0000 7f860fe00640 1 --2- 172.21.15.99:0/478127574 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85f4005210 0x7f861006c630 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f8600010910 tx=0x7f8600010dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:03.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.955+0000 7f8607e00640 1 -- 172.21.15.99:0/478127574 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f860000f040 con 0x7f85f4005210 2024-02-21T23:10:03.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.955+0000 7f8607e00640 1 -- 172.21.15.99:0/478127574 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f860000eb00 con 0x7f85f4005210 2024-02-21T23:10:03.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.955+0000 7f8607e00640 1 -- 172.21.15.99:0/478127574 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f860001c400 con 0x7f85f4005210 2024-02-21T23:10:03.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.955+0000 7f8617000640 1 -- 172.21.15.99:0/478127574 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8610222f00 con 0x7f85f4005210 2024-02-21T23:10:03.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.956+0000 7f8617000640 1 -- 172.21.15.99:0/478127574 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86102234c0 con 0x7f85f4005210 2024-02-21T23:10:03.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.962+0000 7f8619f73740 1 Processor -- start 2024-02-21T23:10:03.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.962+0000 7f8619f73740 1 -- start start 2024-02-21T23:10:03.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.962+0000 7f8607e00640 1 -- 172.21.15.99:0/478127574 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f860001c5a0 con 0x7f85f4005210 2024-02-21T23:10:03.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.964+0000 7f8619f73740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e44d3650d0 0x55e44d39ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:03.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.964+0000 7f8619f73740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e44d39b090 0x55e44d3654b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:03.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.965+0000 7f8619f73740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e44d3659f0 0x55e44d328000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:03.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.965+0000 7f8619f73740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e44d291a90 con 0x55e44d39b090 2024-02-21T23:10:03.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.965+0000 7f8619f73740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e44d23ab10 con 0x55e44d3650d0 2024-02-21T23:10:03.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.965+0000 7f8619f73740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e44d28db30 con 0x55e44d3659f0 2024-02-21T23:10:03.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.965+0000 7f8615000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e44d3650d0 0x55e44d39ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:03.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.965+0000 7f8615000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e44d3650d0 0x55e44d39ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:41556/0 (socket says 172.21.15.99:41556) 2024-02-21T23:10:03.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.965+0000 7f8615000640 1 -- 172.21.15.99:0/4018271280 learned_addr learned my addr 172.21.15.99:0/4018271280 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:10:03.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.965+0000 7f860fe00640 1 --2- 172.21.15.99:0/4018271280 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e44d39b090 0x55e44d3654b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:03.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.965+0000 7f860f400640 1 --2- 172.21.15.99:0/4018271280 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e44d3659f0 0x55e44d328000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:03.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.967+0000 7f8607e00640 1 --2- 172.21.15.99:0/478127574 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f85f009efa0 0x7f85f00a1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:03.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.967+0000 7f860fe00640 1 -- 172.21.15.99:0/4018271280 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e44d3659f0 msgr2=0x55e44d328000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:03.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.967+0000 7f860fe00640 1 --2- 172.21.15.99:0/4018271280 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e44d3659f0 0x55e44d328000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:03.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.967+0000 7f860fe00640 1 -- 172.21.15.99:0/4018271280 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e44d3650d0 msgr2=0x55e44d39ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:03.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.967+0000 7f860fe00640 1 --2- 172.21.15.99:0/4018271280 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e44d3650d0 0x55e44d39ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:03.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.967+0000 7f8607e00640 1 -- 172.21.15.99:0/478127574 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f86000ca4f0 con 0x7f85f4005210 2024-02-21T23:10:03.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.967+0000 7f860fe00640 1 -- 172.21.15.99:0/4018271280 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e44d0707d0 con 0x55e44d39b090 2024-02-21T23:10:03.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.967+0000 7f860f400640 1 --2- 172.21.15.99:0/4018271280 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e44d3659f0 0x55e44d328000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:10:03.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.968+0000 7f8615000640 1 --2- 172.21.15.99:0/4018271280 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e44d3650d0 0x55e44d39ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:10:03.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.968+0000 7f860fe00640 1 --2- 172.21.15.99:0/4018271280 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e44d39b090 0x55e44d3654b0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f86000c7bf0 tx=0x7f86000094a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cbd5daa75ad1afb server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:03.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.969+0000 7f8615000640 1 --2- 172.21.15.99:0/478127574 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f85f009efa0 0x7f85f00a1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:03.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.969+0000 7f8604c00640 1 -- 172.21.15.99:0/4018271280 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86000978e0 con 0x55e44d39b090 2024-02-21T23:10:03.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.969+0000 7f8604c00640 1 -- 172.21.15.99:0/4018271280 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86000984a0 con 0x55e44d39b090 2024-02-21T23:10:03.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.969+0000 7f8604c00640 1 -- 172.21.15.99:0/4018271280 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8600097700 con 0x55e44d39b090 2024-02-21T23:10:03.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.970+0000 7f8619f73740 1 -- 172.21.15.99:0/4018271280 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e44d39b090 msgr2=0x55e44d3654b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:03.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.970+0000 7f8619f73740 1 --2- 172.21.15.99:0/4018271280 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e44d39b090 0x55e44d3654b0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f86000c7bf0 tx=0x7f86000094a0 comp rx=0 tx=0).stop 2024-02-21T23:10:03.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.970+0000 7f8615000640 1 --2- 172.21.15.99:0/478127574 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f85f009efa0 0x7f85f00a1460 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8608001460 tx=0x7f8608005040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:03.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.970+0000 7f8619f73740 1 -- 172.21.15.99:0/4018271280 shutdown_connections 2024-02-21T23:10:03.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.970+0000 7f8619f73740 1 --2- 172.21.15.99:0/4018271280 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e44d3659f0 0x55e44d328000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:03.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.970+0000 7f8619f73740 1 --2- 172.21.15.99:0/4018271280 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e44d39b090 0x55e44d3654b0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:03.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.970+0000 7f8619f73740 1 --2- 172.21.15.99:0/4018271280 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e44d3650d0 0x55e44d39ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:03.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.970+0000 7f8619f73740 1 -- 172.21.15.99:0/4018271280 >> 172.21.15.99:0/4018271280 conn(0x55e44d2f46b0 msgr2=0x55e44d32bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:10:03.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.970+0000 7f8619f73740 1 -- 172.21.15.99:0/4018271280 shutdown_connections 2024-02-21T23:10:03.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.971+0000 7f8619f73740 1 -- 172.21.15.99:0/4018271280 wait complete. 2024-02-21T23:10:03.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.972+0000 7f8619f73740 1 -- start start 2024-02-21T23:10:03.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.972+0000 7f8619f73740 1 Processor -- start 2024-02-21T23:10:03.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.975+0000 7f8619f73740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e44d3650d0 0x55e44d3aeb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:03.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.975+0000 7f8619f73740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e44d3659f0 0x55e44d362d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:03.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.975+0000 7f8619f73740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e44d39b090 0x55e44d391680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:03.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.975+0000 7f8619f73740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e44d333d60 con 0x55e44d3650d0 2024-02-21T23:10:03.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.975+0000 7f8619f73740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e44d2301c0 con 0x55e44d39b090 2024-02-21T23:10:03.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.975+0000 7f8619f73740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e44d39c760 con 0x55e44d3659f0 2024-02-21T23:10:03.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.975+0000 7f8619f73740 10 client.0 _ll_register_callbacks cb 0x55e44d24d930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:10:03.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.975+0000 7f860f400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e44d3659f0 0x55e44d362d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:03.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.975+0000 7f8615000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e44d39b090 0x55e44d391680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:03.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.976+0000 7f860f400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e44d3659f0 0x55e44d362d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:46928/0 (socket says 172.21.15.99:46928) 2024-02-21T23:10:03.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.976+0000 7f860f400640 1 -- 172.21.15.99:0/2414168290 learned_addr learned my addr 172.21.15.99:0/2414168290 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:10:03.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.976+0000 7f860fe00640 1 --2- 172.21.15.99:0/2414168290 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e44d3650d0 0x55e44d3aeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:03.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.976+0000 7f860f400640 1 -- 172.21.15.99:0/2414168290 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e44d39b090 msgr2=0x55e44d391680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:03.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.976+0000 7f860f400640 1 --2- 172.21.15.99:0/2414168290 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e44d39b090 0x55e44d391680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:03.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.976+0000 7f860f400640 1 -- 172.21.15.99:0/2414168290 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e44d3650d0 msgr2=0x55e44d3aeb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:03.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.976+0000 7f860f400640 1 --2- 172.21.15.99:0/2414168290 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e44d3650d0 0x55e44d3aeb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:03.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.976+0000 7f860f400640 1 -- 172.21.15.99:0/2414168290 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e44cfa63f0 con 0x55e44d3659f0 2024-02-21T23:10:03.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.976+0000 7f860fe00640 1 --2- 172.21.15.99:0/2414168290 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e44d3650d0 0x55e44d3aeb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:10:03.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.977+0000 7f860f400640 1 --2- 172.21.15.99:0/2414168290 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e44d3659f0 0x55e44d362d10 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f85fc004850 tx=0x7f85fc004d10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62deaf1487f84a7 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:03.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.977+0000 7f85f9600640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-02-21T23:10:03.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.977+0000 7f85f9600640 1 -- 172.21.15.99:0/2414168290 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85fc01a030 con 0x55e44d3659f0 2024-02-21T23:10:03.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.977+0000 7f85f9600640 1 -- 172.21.15.99:0/2414168290 <== mon.2 v2:172.21.15.181:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f85fc013a40 con 0x55e44d3659f0 2024-02-21T23:10:03.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.977+0000 7f8619f73740 1 -- 172.21.15.99:0/2414168290 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f86000984a0 con 0x55e44d3659f0 2024-02-21T23:10:03.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.979+0000 7f85f9600640 1 -- 172.21.15.99:0/2414168290 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f85fc024050 con 0x55e44d3659f0 2024-02-21T23:10:03.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.979+0000 7f8619f73740 10 client.6812 fetch_fsmap learned FSMap version 17 2024-02-21T23:10:03.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.979+0000 7f8619f73740 1 -- 172.21.15.99:0/2414168290 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55e44cf660f0 con 0x55e44d3659f0 2024-02-21T23:10:03.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.979+0000 7f85f9600640 1 -- 172.21.15.99:0/2414168290 <== mon.2 v2:172.21.15.181:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86000984a0 con 0x55e44d3659f0 2024-02-21T23:10:03.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.979+0000 7f85f9600640 1 -- 172.21.15.99:0/2414168290 <== mon.2 v2:172.21.15.181:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f85fc013c40 con 0x55e44d3659f0 2024-02-21T23:10:03.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.980+0000 7f8619f73740 10 client.6812 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:10:03.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.980+0000 7f8619f73740 10 client.6812 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:10:03.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.980+0000 7f8619f73740 20 client.6812 populate_metadata read hostname 'smithi099' 2024-02-21T23:10:03.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.980+0000 7f8619f73740 1 --2- 172.21.15.99:0/2414168290 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55e44d391bc0 0x55e44d3adb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:03.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.980+0000 7f8619f73740 4 client.6812 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:10:03.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.980+0000 7f8619f73740 1 -- 172.21.15.99:0/2414168290 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e44d29efd0 con 0x55e44d391bc0 2024-02-21T23:10:03.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.980+0000 7f860fe00640 1 --2- 172.21.15.99:0/2414168290 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55e44d391bc0 0x55e44d3adb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:03.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.981+0000 7f860fe00640 1 --2- 172.21.15.99:0/2414168290 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55e44d391bc0 0x55e44d3adb10 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c60a9144a76cc99 server_cookie=1b401ea0b0359b25 in_seq=0 out_seq=0 2024-02-21T23:10:03.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.981+0000 7f85f9600640 10 client.6812 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:10:03.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.983+0000 7f85f9600640 1 -- 172.21.15.99:0/2414168290 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55e44d29efd0 con 0x55e44d391bc0 2024-02-21T23:10:03.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.983+0000 7f85f9600640 10 client.6812 handle_command_reply: tid=0 2024-02-21T23:10:03.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.983+0000 7f8619f73740 1 client.6812 shutdown 2024-02-21T23:10:03.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.984+0000 7f8619f73740 1 -- 172.21.15.99:0/2414168290 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e44d3659f0 msgr2=0x55e44d362d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:03.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.984+0000 7f8619f73740 1 --2- 172.21.15.99:0/2414168290 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e44d3659f0 0x55e44d362d10 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f85fc004850 tx=0x7f85fc004d10 comp rx=0 tx=0).stop 2024-02-21T23:10:03.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.984+0000 7f8619f73740 1 -- 172.21.15.99:0/2414168290 shutdown_connections 2024-02-21T23:10:03.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.984+0000 7f8619f73740 1 --2- 172.21.15.99:0/2414168290 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55e44d391bc0 0x55e44d3adb10 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:03.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.984+0000 7f8619f73740 1 --2- 172.21.15.99:0/2414168290 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e44d39b090 0x55e44d391680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:03.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.984+0000 7f8619f73740 1 --2- 172.21.15.99:0/2414168290 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e44d3659f0 0x55e44d362d10 secure :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f85fc004850 tx=0x7f85fc004d10 comp rx=0 tx=0).stop 2024-02-21T23:10:03.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.984+0000 7f85f9600640 0 client.6812 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:10:03.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.984+0000 7f8619f73740 1 --2- 172.21.15.99:0/2414168290 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e44d3650d0 0x55e44d3aeb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:03.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.985+0000 7f8619f73740 1 -- 172.21.15.99:0/2414168290 >> 172.21.15.99:0/2414168290 conn(0x55e44d2f46b0 msgr2=0x55e44d39a890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:10:03.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.985+0000 7f8619f73740 1 -- 172.21.15.99:0/2414168290 shutdown_connections 2024-02-21T23:10:03.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.985+0000 7f8619f73740 1 -- 172.21.15.99:0/2414168290 wait complete. 2024-02-21T23:10:03.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:03.986+0000 7f8619f73740 20 client.6812 trim_cache size 0 max 16384 2024-02-21T23:10:04.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.016+0000 7f8619f73740 1 Processor -- start 2024-02-21T23:10:04.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.016+0000 7f8619f73740 1 -- start start 2024-02-21T23:10:04.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.017+0000 7f8619f73740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e44d3650d0 0x55e44d36be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:04.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.017+0000 7f8619f73740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e44d39b090 0x55e44d391490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:04.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.017+0000 7f8619f73740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e44d32d2c0 0x55e44d406d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:04.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.017+0000 7f8619f73740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8610231240 con 0x55e44d39b090 2024-02-21T23:10:04.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.017+0000 7f8619f73740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f861022ede0 con 0x55e44d32d2c0 2024-02-21T23:10:04.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.017+0000 7f8619f73740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f861006bf00 con 0x55e44d3650d0 2024-02-21T23:10:04.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.018+0000 7f8615000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e44d32d2c0 0x55e44d406d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:04.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.018+0000 7f860fe00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e44d3650d0 0x55e44d36be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:04.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.018+0000 7f8615000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e44d32d2c0 0x55e44d406d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:41576/0 (socket says 172.21.15.99:41576) 2024-02-21T23:10:04.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.018+0000 7f8615000640 1 -- 172.21.15.99:0/2763433228 learned_addr learned my addr 172.21.15.99:0/2763433228 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:10:04.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.018+0000 7f860f400640 1 --2- 172.21.15.99:0/2763433228 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e44d39b090 0x55e44d391490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:04.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.019+0000 7f8615000640 1 -- 172.21.15.99:0/2763433228 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e44d3650d0 msgr2=0x55e44d36be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:04.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.019+0000 7f8615000640 1 --2- 172.21.15.99:0/2763433228 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e44d3650d0 0x55e44d36be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:04.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.019+0000 7f8615000640 1 -- 172.21.15.99:0/2763433228 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e44d39b090 msgr2=0x55e44d391490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:04.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.019+0000 7f8615000640 1 --2- 172.21.15.99:0/2763433228 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e44d39b090 0x55e44d391490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:04.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.019+0000 7f8615000640 1 -- 172.21.15.99:0/2763433228 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e44d39c100 con 0x55e44d32d2c0 2024-02-21T23:10:04.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.019+0000 7f860fe00640 1 --2- 172.21.15.99:0/2763433228 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e44d3650d0 0x55e44d36be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T23:10:04.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.019+0000 7f860f400640 1 --2- 172.21.15.99:0/2763433228 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e44d39b090 0x55e44d391490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:10:04.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.019+0000 7f8615000640 1 --2- 172.21.15.99:0/2763433228 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e44d32d2c0 0x55e44d406d70 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f8608003cb0 tx=0x7f860802e000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9ac0b4e7587dff5 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:04.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.020+0000 7f85fbe00640 1 -- 172.21.15.99:0/2763433228 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8608050070 con 0x55e44d32d2c0 2024-02-21T23:10:04.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.021+0000 7f85fbe00640 1 -- 172.21.15.99:0/2763433228 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f860802c590 con 0x55e44d32d2c0 2024-02-21T23:10:04.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.022+0000 7f85fbe00640 1 -- 172.21.15.99:0/2763433228 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8608039040 con 0x55e44d32d2c0 2024-02-21T23:10:04.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.023+0000 7f8619f73740 1 -- 172.21.15.99:0/2763433228 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e44d32d2c0 msgr2=0x55e44d406d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:04.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.023+0000 7f8619f73740 1 --2- 172.21.15.99:0/2763433228 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e44d32d2c0 0x55e44d406d70 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f8608003cb0 tx=0x7f860802e000 comp rx=0 tx=0).stop 2024-02-21T23:10:04.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.023+0000 7f8619f73740 1 -- 172.21.15.99:0/2763433228 shutdown_connections 2024-02-21T23:10:04.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.023+0000 7f8619f73740 1 --2- 172.21.15.99:0/2763433228 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e44d32d2c0 0x55e44d406d70 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:04.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.023+0000 7f8619f73740 1 --2- 172.21.15.99:0/2763433228 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e44d39b090 0x55e44d391490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:04.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.023+0000 7f8619f73740 1 --2- 172.21.15.99:0/2763433228 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e44d3650d0 0x55e44d36be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:04.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.023+0000 7f8619f73740 1 -- 172.21.15.99:0/2763433228 >> 172.21.15.99:0/2763433228 conn(0x55e44d2f46b0 msgr2=0x55e44d364650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:10:04.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.023+0000 7f8619f73740 1 -- 172.21.15.99:0/2763433228 shutdown_connections 2024-02-21T23:10:04.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.023+0000 7f8619f73740 1 -- 172.21.15.99:0/2763433228 wait complete. 2024-02-21T23:10:04.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.025+0000 7f8619f73740 1 -- start start 2024-02-21T23:10:04.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.025+0000 7f8619f73740 1 Processor -- start 2024-02-21T23:10:04.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.028+0000 7f8619f73740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e44d32d2c0 0x55e44d35a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:04.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.028+0000 7f8619f73740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e44d3650d0 0x55e44d3266b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:04.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.028+0000 7f8619f73740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e44d39b090 0x55e44d3feb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:04.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.028+0000 7f8619f73740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f861022d4a0 con 0x55e44d32d2c0 2024-02-21T23:10:04.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.028+0000 7f8619f73740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f861022e780 con 0x55e44d39b090 2024-02-21T23:10:04.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.028+0000 7f8619f73740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f861022dac0 con 0x55e44d3650d0 2024-02-21T23:10:04.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.028+0000 7f860fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e44d32d2c0 0x55e44d35a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:04.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.029+0000 7f8619f73740 10 client.0 _ll_register_callbacks cb 0x7f85fc007730 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:10:04.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.029+0000 7f860fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e44d32d2c0 0x55e44d35a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:47036/0 (socket says 172.21.15.99:47036) 2024-02-21T23:10:04.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.029+0000 7f860fe00640 1 -- 172.21.15.99:0/4267036933 learned_addr learned my addr 172.21.15.99:0/4267036933 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:10:04.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.029+0000 7f860f400640 1 --2- 172.21.15.99:0/4267036933 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e44d3650d0 0x55e44d3266b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:04.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.029+0000 7f8615000640 1 --2- 172.21.15.99:0/4267036933 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e44d39b090 0x55e44d3feb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:04.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.029+0000 7f860fe00640 1 -- 172.21.15.99:0/4267036933 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e44d3650d0 msgr2=0x55e44d3266b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:04.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.029+0000 7f860fe00640 1 --2- 172.21.15.99:0/4267036933 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e44d3650d0 0x55e44d3266b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:04.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.029+0000 7f860fe00640 1 -- 172.21.15.99:0/4267036933 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e44d39b090 msgr2=0x55e44d3feb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:04.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.029+0000 7f860fe00640 1 --2- 172.21.15.99:0/4267036933 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e44d39b090 0x55e44d3feb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:04.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.029+0000 7f860fe00640 1 -- 172.21.15.99:0/4267036933 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e44d3b4ce0 con 0x55e44d32d2c0 2024-02-21T23:10:04.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.029+0000 7f8615000640 1 --2- 172.21.15.99:0/4267036933 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e44d39b090 0x55e44d3feb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:10:04.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.030+0000 7f860fe00640 1 --2- 172.21.15.99:0/4267036933 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e44d32d2c0 0x55e44d35a9c0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f8600097aa0 tx=0x7f86000cca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7b57fc01ad98ad7 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:04.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.030+0000 7f85f9600640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:10:04.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.031+0000 7f85f9600640 1 -- 172.21.15.99:0/4267036933 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86000984a0 con 0x55e44d32d2c0 2024-02-21T23:10:04.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.031+0000 7f85f9600640 1 -- 172.21.15.99:0/4267036933 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f8600094410 con 0x55e44d32d2c0 2024-02-21T23:10:04.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.031+0000 7f8619f73740 1 -- 172.21.15.99:0/4267036933 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f860802c590 con 0x55e44d32d2c0 2024-02-21T23:10:04.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.031+0000 7f85f9600640 1 -- 172.21.15.99:0/4267036933 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8600097da0 con 0x55e44d32d2c0 2024-02-21T23:10:04.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.032+0000 7f8619f73740 10 client.6687 fetch_fsmap learned FSMap version 17 2024-02-21T23:10:04.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.032+0000 7f8619f73740 1 -- 172.21.15.99:0/4267036933 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55e44d35a500 con 0x55e44d32d2c0 2024-02-21T23:10:04.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.032+0000 7f85f9600640 1 -- 172.21.15.99:0/4267036933 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f860802c590 con 0x55e44d32d2c0 2024-02-21T23:10:04.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.032+0000 7f85f9600640 1 -- 172.21.15.99:0/4267036933 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f86000a00b0 con 0x55e44d32d2c0 2024-02-21T23:10:04.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.033+0000 7f8619f73740 10 client.6687 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:10:04.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.033+0000 7f8619f73740 10 client.6687 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:10:04.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.033+0000 7f8619f73740 20 client.6687 populate_metadata read hostname 'smithi099' 2024-02-21T23:10:04.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.033+0000 7f8619f73740 1 --2- 172.21.15.99:0/4267036933 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55e44d3331a0 0x55e44d3ff090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:04.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.033+0000 7f8619f73740 4 client.6687 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T23:10:04.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.033+0000 7f8619f73740 1 -- 172.21.15.99:0/4267036933 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55e44d299320 con 0x55e44d3331a0 2024-02-21T23:10:04.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.034+0000 7f860f400640 1 --2- 172.21.15.99:0/4267036933 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55e44d3331a0 0x55e44d3ff090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:04.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.035+0000 7f860f400640 1 --2- 172.21.15.99:0/4267036933 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55e44d3331a0 0x55e44d3ff090 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b628e91d9745722 server_cookie=b7f82a512b66b9f5 in_seq=0 out_seq=0 2024-02-21T23:10:04.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.035+0000 7f85f9600640 10 client.6687 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:10:04.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.036+0000 7f85f9600640 1 -- 172.21.15.99:0/4267036933 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x55e44d299320 con 0x55e44d3331a0 2024-02-21T23:10:04.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.036+0000 7f85f9600640 10 client.6687 handle_command_reply: tid=0 2024-02-21T23:10:04.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.036+0000 7f8619f73740 1 client.6687 shutdown 2024-02-21T23:10:04.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.037+0000 7f8619f73740 1 -- 172.21.15.99:0/4267036933 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e44d32d2c0 msgr2=0x55e44d35a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:04.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.037+0000 7f8619f73740 1 --2- 172.21.15.99:0/4267036933 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e44d32d2c0 0x55e44d35a9c0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f8600097aa0 tx=0x7f86000cca70 comp rx=0 tx=0).stop 2024-02-21T23:10:04.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.037+0000 7f8619f73740 1 -- 172.21.15.99:0/4267036933 shutdown_connections 2024-02-21T23:10:04.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.037+0000 7f8619f73740 1 --2- 172.21.15.99:0/4267036933 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55e44d3331a0 0x55e44d3ff090 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:04.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.037+0000 7f8619f73740 1 --2- 172.21.15.99:0/4267036933 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55e44d39b090 0x55e44d3feb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:04.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.037+0000 7f8619f73740 1 --2- 172.21.15.99:0/4267036933 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55e44d3650d0 0x55e44d3266b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:04.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.037+0000 7f8619f73740 1 --2- 172.21.15.99:0/4267036933 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55e44d32d2c0 0x55e44d35a9c0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:04.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.037+0000 7f85f9600640 0 client.6687 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:10:04.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.037+0000 7f8619f73740 1 -- 172.21.15.99:0/4267036933 >> 172.21.15.99:0/4267036933 conn(0x55e44d2f46b0 msgr2=0x55e44d362e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:10:04.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.037+0000 7f8619f73740 1 -- 172.21.15.99:0/4267036933 shutdown_connections 2024-02-21T23:10:04.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.037+0000 7f8619f73740 1 -- 172.21.15.99:0/4267036933 wait complete. 2024-02-21T23:10:04.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.038+0000 7f8619f73740 20 client.6687 trim_cache size 0 max 16384 2024-02-21T23:10:04.027 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-02-21T23:10:04.028 INFO:teuthology.orchestra.run.smithi099.stdout: "status": "scrub active (886 inodes in the stack)", 2024-02-21T23:10:04.028 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubs": { 2024-02-21T23:10:04.028 INFO:teuthology.orchestra.run.smithi099.stdout: "b3ba0750-bd19-4f4e-9554-bb3835891eb1": { 2024-02-21T23:10:04.028 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/", 2024-02-21T23:10:04.028 INFO:teuthology.orchestra.run.smithi099.stdout: "tag": "b3ba0750-bd19-4f4e-9554-bb3835891eb1", 2024-02-21T23:10:04.028 INFO:teuthology.orchestra.run.smithi099.stdout: "options": "recursive,force" 2024-02-21T23:10:04.028 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:10:04.029 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:10:04.029 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-02-21T23:10:04.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.039+0000 7f8617000640 1 -- 172.21.15.99:0/478127574 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f85f009efa0 msgr2=0x7f85f00a1460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:04.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.039+0000 7f8617000640 1 --2- 172.21.15.99:0/478127574 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f85f009efa0 0x7f85f00a1460 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8608001460 tx=0x7f8608005040 comp rx=0 tx=0).stop 2024-02-21T23:10:04.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.039+0000 7f8617000640 1 -- 172.21.15.99:0/478127574 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85f4005210 msgr2=0x7f861006c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:04.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.039+0000 7f8617000640 1 --2- 172.21.15.99:0/478127574 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85f4005210 0x7f861006c630 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f8600010910 tx=0x7f8600010dd0 comp rx=0 tx=0).stop 2024-02-21T23:10:04.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.039+0000 7f8617000640 1 -- 172.21.15.99:0/478127574 shutdown_connections 2024-02-21T23:10:04.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.039+0000 7f8617000640 1 --2- 172.21.15.99:0/478127574 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f85f009efa0 0x7f85f00a1460 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:04.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.039+0000 7f8617000640 1 --2- 172.21.15.99:0/478127574 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86100f99a0 0x7f861017eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:04.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.039+0000 7f8617000640 1 --2- 172.21.15.99:0/478127574 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f861006cb70 0x7f86100f9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:04.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.039+0000 7f8617000640 1 --2- 172.21.15.99:0/478127574 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f85f4005210 0x7f861006c630 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:04.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.039+0000 7f8617000640 1 -- 172.21.15.99:0/478127574 >> 172.21.15.99:0/478127574 conn(0x7f86100ce5f0 msgr2=0x7f86100ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:10:04.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.040+0000 7f8617000640 1 -- 172.21.15.99:0/478127574 shutdown_connections 2024-02-21T23:10:04.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:04.040+0000 7f8617000640 1 -- 172.21.15.99:0/478127574 wait complete. 2024-02-21T23:10:04.053 INFO:tasks.cephfs.filesystem:scrub status for tag:b3ba0750-bd19-4f4e-9554-bb3835891eb1 - {'path': '/', 'tag': 'b3ba0750-bd19-4f4e-9554-bb3835891eb1', 'options': 'recursive,force'} 2024-02-21T23:10:13.836 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:10:13.842 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:10:13.845 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:10:34.055 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T23:10:34.056 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T23:10:34.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.299+0000 7fd565a00640 1 Processor -- start 2024-02-21T23:10:34.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.299+0000 7fd565a00640 1 -- start start 2024-02-21T23:10:34.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.301+0000 7fd565a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd56017f490 0x7fd56018ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:34.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.301+0000 7fd565a00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fd56018b4f0 0x7fd5600fd290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:34.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.301+0000 7fd565a00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5600d6dd0 con 0x7fd56018b060 2024-02-21T23:10:34.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.301+0000 7fd565a00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5601614c0 con 0x7fd56017f490 2024-02-21T23:10:34.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.301+0000 7fd565a00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5600d6810 con 0x7fd56018b4f0 2024-02-21T23:10:34.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.301+0000 7fd55fe00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd56017f490 0x7fd56018ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:34.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.301+0000 7fd565000640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fd56018b4f0 0x7fd5600fd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:34.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.302+0000 7fd55f400640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fd56018b060 0x7fd560188a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.99:59612/0 (socket says 172.21.15.99:59612) 2024-02-21T23:10:34.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.302+0000 7fd55f400640 1 -- 172.21.15.99:0/2120801053 learned_addr learned my addr 172.21.15.99:0/2120801053 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:10:34.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.302+0000 7fd55fe00640 1 -- 172.21.15.99:0/2120801053 >> v2:172.21.15.181:3300/0 conn(0x7fd56018b4f0 msgr2=0x7fd5600fd290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:34.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.302+0000 7fd55fe00640 1 --2- 172.21.15.99:0/2120801053 >> v2:172.21.15.181:3300/0 conn(0x7fd56018b4f0 0x7fd5600fd290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:34.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.302+0000 7fd55fe00640 1 -- 172.21.15.99:0/2120801053 >> v1:172.21.15.162:6789/0 conn(0x7fd56018b060 legacy=0x7fd560188a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:34.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.302+0000 7fd55fe00640 1 -- 172.21.15.99:0/2120801053 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5600d6af0 con 0x7fd56017f490 2024-02-21T23:10:34.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.303+0000 7fd55fe00640 1 --2- 172.21.15.99:0/2120801053 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd56017f490 0x7fd56018ab20 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fd560186580 tx=0x7fd55002b710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ef8b9f15b0d07ca server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:34.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.303+0000 7fd55ea00640 1 -- 172.21.15.99:0/2120801053 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd550037070 con 0x7fd56017f490 2024-02-21T23:10:34.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.303+0000 7fd55ea00640 1 -- 172.21.15.99:0/2120801053 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd550030710 con 0x7fd56017f490 2024-02-21T23:10:34.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.303+0000 7fd55ea00640 1 -- 172.21.15.99:0/2120801053 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd550030ae0 con 0x7fd56017f490 2024-02-21T23:10:34.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.304+0000 7fd565a00640 1 -- 172.21.15.99:0/2120801053 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd56017f490 msgr2=0x7fd56018ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:34.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.304+0000 7fd565a00640 1 --2- 172.21.15.99:0/2120801053 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd56017f490 0x7fd56018ab20 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fd560186580 tx=0x7fd55002b710 comp rx=0 tx=0).stop 2024-02-21T23:10:34.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.304+0000 7fd565a00640 1 -- 172.21.15.99:0/2120801053 shutdown_connections 2024-02-21T23:10:34.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.304+0000 7fd565a00640 1 --2- 172.21.15.99:0/2120801053 >> v2:172.21.15.181:3300/0 conn(0x7fd56018b4f0 0x7fd5600fd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:34.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.304+0000 7fd565a00640 1 --2- 172.21.15.99:0/2120801053 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd56017f490 0x7fd56018ab20 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:34.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.304+0000 7fd565a00640 1 -- 172.21.15.99:0/2120801053 >> 172.21.15.99:0/2120801053 conn(0x7fd5600d29b0 msgr2=0x7fd5600d2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:10:34.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.304+0000 7fd565a00640 1 -- 172.21.15.99:0/2120801053 shutdown_connections 2024-02-21T23:10:34.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.305+0000 7fd565a00640 1 -- 172.21.15.99:0/2120801053 wait complete. 2024-02-21T23:10:34.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.308+0000 7fd565a00640 1 Processor -- start 2024-02-21T23:10:34.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.308+0000 7fd565a00640 1 -- start start 2024-02-21T23:10:34.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.310+0000 7fd565a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd56017f490 0x7fd56017e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:34.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.310+0000 7fd565a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd56018b060 0x7fd560186ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:34.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.310+0000 7fd565a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd56018b4f0 0x7fd56017c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:34.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.310+0000 7fd565a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd56018a600 con 0x7fd56017f490 2024-02-21T23:10:34.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.310+0000 7fd565a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd56018a320 con 0x7fd56018b4f0 2024-02-21T23:10:34.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.310+0000 7fd565a00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd56017f870 con 0x7fd56018b060 2024-02-21T23:10:34.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.310+0000 7fd55fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd56017f490 0x7fd56017e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:34.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.310+0000 7fd55fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd56017f490 0x7fd56017e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:57804/0 (socket says 172.21.15.99:57804) 2024-02-21T23:10:34.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.310+0000 7fd55fe00640 1 -- 172.21.15.99:0/3241256711 learned_addr learned my addr 172.21.15.99:0/3241256711 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:10:34.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.310+0000 7fd55f400640 1 --2- 172.21.15.99:0/3241256711 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd56018b060 0x7fd560186ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:34.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.311+0000 7fd565000640 1 --2- 172.21.15.99:0/3241256711 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd56018b4f0 0x7fd56017c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:34.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.311+0000 7fd55f400640 1 -- 172.21.15.99:0/3241256711 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd56018b4f0 msgr2=0x7fd56017c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:34.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.311+0000 7fd55f400640 1 --2- 172.21.15.99:0/3241256711 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd56018b4f0 0x7fd56017c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:34.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.311+0000 7fd55f400640 1 -- 172.21.15.99:0/3241256711 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd56017f490 msgr2=0x7fd56017e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:34.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.311+0000 7fd55f400640 1 --2- 172.21.15.99:0/3241256711 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd56017f490 0x7fd56017e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:34.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.311+0000 7fd55f400640 1 -- 172.21.15.99:0/3241256711 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5601875d0 con 0x7fd56018b060 2024-02-21T23:10:34.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.311+0000 7fd55fe00640 1 --2- 172.21.15.99:0/3241256711 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd56017f490 0x7fd56017e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:10:34.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.311+0000 7fd55f400640 1 --2- 172.21.15.99:0/3241256711 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd56018b060 0x7fd560186ee0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fd54c00c750 tx=0x7fd54c00cc10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:34.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.312+0000 7fd557e00640 1 -- 172.21.15.99:0/3241256711 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54c018070 con 0x7fd56018b060 2024-02-21T23:10:34.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.312+0000 7fd565a00640 1 -- 172.21.15.99:0/3241256711 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5601878b0 con 0x7fd56018b060 2024-02-21T23:10:34.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.312+0000 7fd557e00640 1 -- 172.21.15.99:0/3241256711 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd54c0072d0 con 0x7fd56018b060 2024-02-21T23:10:34.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.312+0000 7fd557e00640 1 -- 172.21.15.99:0/3241256711 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54c0047e0 con 0x7fd56018b060 2024-02-21T23:10:34.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.312+0000 7fd565a00640 1 -- 172.21.15.99:0/3241256711 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd560187e70 con 0x7fd56018b060 2024-02-21T23:10:34.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.316+0000 7fd557e00640 1 -- 172.21.15.99:0/3241256711 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7fd54c004980 con 0x7fd56018b060 2024-02-21T23:10:34.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.317+0000 7fd569f90740 1 Processor -- start 2024-02-21T23:10:34.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.317+0000 7fd569f90740 1 -- start start 2024-02-21T23:10:34.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.318+0000 7fd569f90740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b86fc62a0 0x563b86ffbd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:34.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.318+0000 7fd569f90740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b86ffc260 0x563b86fc6680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:34.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.318+0000 7fd569f90740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563b86fc6bc0 0x563b86f891d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:34.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.318+0000 7fd569f90740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b86ef2a90 con 0x563b86fc6bc0 2024-02-21T23:10:34.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.318+0000 7fd569f90740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b86e9bb10 con 0x563b86fc62a0 2024-02-21T23:10:34.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.318+0000 7fd569f90740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b86eeeb30 con 0x563b86ffc260 2024-02-21T23:10:34.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.319+0000 7fd565000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b86fc62a0 0x563b86ffbd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:34.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.319+0000 7fd565000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b86fc62a0 0x563b86ffbd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:48622/0 (socket says 172.21.15.99:48622) 2024-02-21T23:10:34.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.319+0000 7fd565000640 1 -- 172.21.15.99:0/496817864 learned_addr learned my addr 172.21.15.99:0/496817864 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:10:34.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.319+0000 7fd55f400640 1 --2- 172.21.15.99:0/496817864 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563b86fc6bc0 0x563b86f891d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:34.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.319+0000 7fd55fe00640 1 --2- 172.21.15.99:0/496817864 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b86ffc260 0x563b86fc6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:34.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.319+0000 7fd557e00640 1 --2- 172.21.15.99:0/3241256711 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fd54009ee50 0x7fd5400a1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:34.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.319+0000 7fd565000640 1 -- 172.21.15.99:0/496817864 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b86ffc260 msgr2=0x563b86fc6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:34.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.319+0000 7fd565000640 1 --2- 172.21.15.99:0/496817864 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b86ffc260 0x563b86fc6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:34.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.319+0000 7fd565000640 1 -- 172.21.15.99:0/496817864 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563b86fc6bc0 msgr2=0x563b86f891d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:34.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.319+0000 7fd565000640 1 --2- 172.21.15.99:0/496817864 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563b86fc6bc0 0x563b86f891d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:34.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.319+0000 7fd565000640 1 -- 172.21.15.99:0/496817864 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563b86cd17d0 con 0x563b86fc62a0 2024-02-21T23:10:34.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.319+0000 7fd565000640 1 --2- 172.21.15.99:0/3241256711 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fd54009ee50 0x7fd5400a1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:34.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.319+0000 7fd557e00640 1 -- 172.21.15.99:0/3241256711 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 8877+0+0 (secure 0 0 0) 0x7fd54c0c9260 con 0x7fd56018b060 2024-02-21T23:10:34.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.320+0000 7fd565000640 1 --2- 172.21.15.99:0/496817864 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b86fc62a0 0x563b86ffbd20 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fd558011580 tx=0x7fd558009750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f8973f56412563a2 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:34.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.320+0000 7fd554c00640 1 -- 172.21.15.99:0/496817864 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd558019070 con 0x563b86fc62a0 2024-02-21T23:10:34.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.320+0000 7fd554c00640 1 -- 172.21.15.99:0/496817864 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd558015d40 con 0x563b86fc62a0 2024-02-21T23:10:34.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.320+0000 7fd554c00640 1 -- 172.21.15.99:0/496817864 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd558020600 con 0x563b86fc62a0 2024-02-21T23:10:34.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.321+0000 7fd569f90740 1 -- 172.21.15.99:0/496817864 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b86fc62a0 msgr2=0x563b86ffbd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:34.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.321+0000 7fd565000640 1 --2- 172.21.15.99:0/3241256711 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fd54009ee50 0x7fd5400a1310 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd558021000 tx=0x7fd558022000 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:34.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.321+0000 7fd569f90740 1 --2- 172.21.15.99:0/496817864 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b86fc62a0 0x563b86ffbd20 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fd558011580 tx=0x7fd558009750 comp rx=0 tx=0).stop 2024-02-21T23:10:34.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.321+0000 7fd569f90740 1 -- 172.21.15.99:0/496817864 shutdown_connections 2024-02-21T23:10:34.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.321+0000 7fd569f90740 1 --2- 172.21.15.99:0/496817864 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563b86fc6bc0 0x563b86f891d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:34.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.321+0000 7fd569f90740 1 --2- 172.21.15.99:0/496817864 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b86ffc260 0x563b86fc6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:34.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.321+0000 7fd569f90740 1 --2- 172.21.15.99:0/496817864 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b86fc62a0 0x563b86ffbd20 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:34.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.321+0000 7fd569f90740 1 -- 172.21.15.99:0/496817864 >> 172.21.15.99:0/496817864 conn(0x563b86f556b0 msgr2=0x563b86f8d190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:10:34.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.321+0000 7fd569f90740 1 -- 172.21.15.99:0/496817864 shutdown_connections 2024-02-21T23:10:34.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.321+0000 7fd569f90740 1 -- 172.21.15.99:0/496817864 wait complete. 2024-02-21T23:10:34.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.322+0000 7fd569f90740 1 -- start start 2024-02-21T23:10:34.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.322+0000 7fd569f90740 1 Processor -- start 2024-02-21T23:10:34.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.324+0000 7fd569f90740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b86fc62a0 0x563b86fbc3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:34.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.324+0000 7fd569f90740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563b86fc6bc0 0x563b8700dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:34.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.324+0000 7fd569f90740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b86ffc260 0x563b86ffeb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:34.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.324+0000 7fd569f90740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b86f94f30 con 0x563b86fc6bc0 2024-02-21T23:10:34.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.324+0000 7fd569f90740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b86e911c0 con 0x563b86fc62a0 2024-02-21T23:10:34.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.324+0000 7fd569f90740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b86ffd930 con 0x563b86ffc260 2024-02-21T23:10:34.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.324+0000 7fd569f90740 10 client.0 _ll_register_callbacks cb 0x563b86eae930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:10:34.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.325+0000 7fd55f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563b86fc6bc0 0x563b8700dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:34.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.325+0000 7fd55f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563b86fc6bc0 0x563b8700dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:57822/0 (socket says 172.21.15.99:57822) 2024-02-21T23:10:34.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.325+0000 7fd55f400640 1 -- 172.21.15.99:0/4151412823 learned_addr learned my addr 172.21.15.99:0/4151412823 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:10:34.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.325+0000 7fd55fe00640 1 --2- 172.21.15.99:0/4151412823 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b86fc62a0 0x563b86fbc3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:34.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.325+0000 7fd565000640 1 --2- 172.21.15.99:0/4151412823 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b86ffc260 0x563b86ffeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:34.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.325+0000 7fd55fe00640 1 -- 172.21.15.99:0/4151412823 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b86ffc260 msgr2=0x563b86ffeb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:34.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.325+0000 7fd55fe00640 1 --2- 172.21.15.99:0/4151412823 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b86ffc260 0x563b86ffeb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:34.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.325+0000 7fd55fe00640 1 -- 172.21.15.99:0/4151412823 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563b86fc6bc0 msgr2=0x563b8700dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:34.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.325+0000 7fd55fe00640 1 --2- 172.21.15.99:0/4151412823 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563b86fc6bc0 0x563b8700dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:34.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.325+0000 7fd55fe00640 1 -- 172.21.15.99:0/4151412823 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563b86c073f0 con 0x563b86fc62a0 2024-02-21T23:10:34.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.325+0000 7fd55f400640 1 --2- 172.21.15.99:0/4151412823 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563b86fc6bc0 0x563b8700dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:10:34.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.325+0000 7fd55fe00640 1 --2- 172.21.15.99:0/4151412823 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b86fc62a0 0x563b86fbc3e0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fd550000c00 tx=0x7fd550004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=13066a7cc859144d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:34.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.325+0000 7fd549600640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-02-21T23:10:34.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.326+0000 7fd549600640 1 -- 172.21.15.99:0/4151412823 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd550049060 con 0x563b86fc62a0 2024-02-21T23:10:34.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.326+0000 7fd549600640 1 -- 172.21.15.99:0/4151412823 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(36..36 src has 1..36) v4 ==== 8877+0+0 (secure 0 0 0) 0x7fd55003c820 con 0x563b86fc62a0 2024-02-21T23:10:34.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.326+0000 7fd569f90740 1 -- 172.21.15.99:0/4151412823 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd558015d40 con 0x563b86fc62a0 2024-02-21T23:10:34.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.326+0000 7fd549600640 1 -- 172.21.15.99:0/4151412823 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd550050050 con 0x563b86fc62a0 2024-02-21T23:10:34.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.326+0000 7fd569f90740 10 client.6865 fetch_fsmap learned FSMap version 17 2024-02-21T23:10:34.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.326+0000 7fd569f90740 1 -- 172.21.15.99:0/4151412823 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x563b86bc70f0 con 0x563b86fc62a0 2024-02-21T23:10:34.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.326+0000 7fd549600640 1 -- 172.21.15.99:0/4151412823 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd558015d40 con 0x563b86fc62a0 2024-02-21T23:10:34.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.326+0000 7fd549600640 1 -- 172.21.15.99:0/4151412823 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fd550043030 con 0x563b86fc62a0 2024-02-21T23:10:34.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.327+0000 7fd569f90740 10 client.6865 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:10:34.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.327+0000 7fd569f90740 10 client.6865 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:10:34.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.327+0000 7fd569f90740 20 client.6865 populate_metadata read hostname 'smithi099' 2024-02-21T23:10:34.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.327+0000 7fd569f90740 1 --2- 172.21.15.99:0/4151412823 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x563b86fcfe90 0x563b86fd0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:34.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.327+0000 7fd569f90740 4 client.6865 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:10:34.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.327+0000 7fd569f90740 1 -- 172.21.15.99:0/4151412823 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563b86efffd0 con 0x563b86fcfe90 2024-02-21T23:10:34.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.327+0000 7fd55f400640 1 --2- 172.21.15.99:0/4151412823 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x563b86fcfe90 0x563b86fd0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:34.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.327+0000 7fd549600640 10 client.6865 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:10:34.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.327+0000 7fd55f400640 1 --2- 172.21.15.99:0/4151412823 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x563b86fcfe90 0x563b86fd0270 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da41f098d5314798 server_cookie=c4a9692289c865b0 in_seq=0 out_seq=0 2024-02-21T23:10:34.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.328+0000 7fd549600640 1 -- 172.21.15.99:0/4151412823 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x563b86efffd0 con 0x563b86fcfe90 2024-02-21T23:10:34.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.328+0000 7fd549600640 10 client.6865 handle_command_reply: tid=0 2024-02-21T23:10:34.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.329+0000 7fd569f90740 1 client.6865 shutdown 2024-02-21T23:10:34.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.329+0000 7fd569f90740 1 -- 172.21.15.99:0/4151412823 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b86fc62a0 msgr2=0x563b86fbc3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:34.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.329+0000 7fd569f90740 1 --2- 172.21.15.99:0/4151412823 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b86fc62a0 0x563b86fbc3e0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fd550000c00 tx=0x7fd550004730 comp rx=0 tx=0).stop 2024-02-21T23:10:34.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.329+0000 7fd569f90740 1 -- 172.21.15.99:0/4151412823 shutdown_connections 2024-02-21T23:10:34.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.329+0000 7fd569f90740 1 --2- 172.21.15.99:0/4151412823 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x563b86fcfe90 0x563b86fd0270 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:34.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.329+0000 7fd569f90740 1 --2- 172.21.15.99:0/4151412823 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b86ffc260 0x563b86ffeb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:34.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.329+0000 7fd569f90740 1 --2- 172.21.15.99:0/4151412823 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563b86fc6bc0 0x563b8700dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:34.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.329+0000 7fd569f90740 1 --2- 172.21.15.99:0/4151412823 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b86fc62a0 0x563b86fbc3e0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:34.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.329+0000 7fd549600640 0 client.6865 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:10:34.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.329+0000 7fd569f90740 1 -- 172.21.15.99:0/4151412823 >> 172.21.15.99:0/4151412823 conn(0x563b86f556b0 msgr2=0x563b86f8db80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:10:34.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.329+0000 7fd569f90740 1 -- 172.21.15.99:0/4151412823 shutdown_connections 2024-02-21T23:10:34.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.329+0000 7fd569f90740 1 -- 172.21.15.99:0/4151412823 wait complete. 2024-02-21T23:10:34.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.329+0000 7fd569f90740 20 client.6865 trim_cache size 0 max 16384 2024-02-21T23:10:34.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.363+0000 7fd569f90740 1 Processor -- start 2024-02-21T23:10:34.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.363+0000 7fd569f90740 1 -- start start 2024-02-21T23:10:34.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.365+0000 7fd569f90740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b86fc62a0 0x563b86f8c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:34.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.365+0000 7fd569f90740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563b86fc6bc0 0x563b86fbefd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:34.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.365+0000 7fd569f90740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b86ffc260 0x563b86fbf510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:34.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.365+0000 7fd569f90740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd56022cba0 con 0x563b86fc6bc0 2024-02-21T23:10:34.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.365+0000 7fd569f90740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd56022a740 con 0x563b86fc62a0 2024-02-21T23:10:34.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.365+0000 7fd569f90740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd56021fdc0 con 0x563b86ffc260 2024-02-21T23:10:34.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.366+0000 7fd565000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b86ffc260 0x563b86fbf510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:34.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.366+0000 7fd55fe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b86fc62a0 0x563b86f8c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:34.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.366+0000 7fd565000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b86ffc260 0x563b86fbf510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:55766/0 (socket says 172.21.15.99:55766) 2024-02-21T23:10:34.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.366+0000 7fd55fe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b86fc62a0 0x563b86f8c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:48628/0 (socket says 172.21.15.99:48628) 2024-02-21T23:10:34.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.366+0000 7fd565000640 1 -- 172.21.15.99:0/3431297244 learned_addr learned my addr 172.21.15.99:0/3431297244 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:10:34.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.366+0000 7fd55f400640 1 --2- 172.21.15.99:0/3431297244 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563b86fc6bc0 0x563b86fbefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:34.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.366+0000 7fd565000640 1 -- 172.21.15.99:0/3431297244 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b86fc62a0 msgr2=0x563b86f8c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:34.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.366+0000 7fd565000640 1 --2- 172.21.15.99:0/3431297244 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b86fc62a0 0x563b86f8c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:34.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.366+0000 7fd565000640 1 -- 172.21.15.99:0/3431297244 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563b86fc6bc0 msgr2=0x563b86fbefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:34.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.366+0000 7fd565000640 1 --2- 172.21.15.99:0/3431297244 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563b86fc6bc0 0x563b86fbefd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:34.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.366+0000 7fd565000640 1 -- 172.21.15.99:0/3431297244 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563b86fbfed0 con 0x563b86ffc260 2024-02-21T23:10:34.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.366+0000 7fd55fe00640 1 --2- 172.21.15.99:0/3431297244 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b86fc62a0 0x563b86f8c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:10:34.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.367+0000 7fd565000640 1 --2- 172.21.15.99:0/3431297244 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b86ffc260 0x563b86fbf510 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fd558011ed0 tx=0x7fd558019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=94aa0736fad99eef server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:34.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.367+0000 7fd54be00640 1 -- 172.21.15.99:0/3431297244 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd55803b070 con 0x563b86ffc260 2024-02-21T23:10:34.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.367+0000 7fd54be00640 1 -- 172.21.15.99:0/3431297244 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd558020cf0 con 0x563b86ffc260 2024-02-21T23:10:34.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.367+0000 7fd54be00640 1 -- 172.21.15.99:0/3431297244 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5580158e0 con 0x563b86ffc260 2024-02-21T23:10:34.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.368+0000 7fd569f90740 1 -- 172.21.15.99:0/3431297244 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b86ffc260 msgr2=0x563b86fbf510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:34.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.368+0000 7fd569f90740 1 --2- 172.21.15.99:0/3431297244 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b86ffc260 0x563b86fbf510 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fd558011ed0 tx=0x7fd558019000 comp rx=0 tx=0).stop 2024-02-21T23:10:34.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.368+0000 7fd569f90740 1 -- 172.21.15.99:0/3431297244 shutdown_connections 2024-02-21T23:10:34.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.368+0000 7fd569f90740 1 --2- 172.21.15.99:0/3431297244 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b86ffc260 0x563b86fbf510 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:34.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.368+0000 7fd569f90740 1 --2- 172.21.15.99:0/3431297244 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563b86fc6bc0 0x563b86fbefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:34.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.368+0000 7fd569f90740 1 --2- 172.21.15.99:0/3431297244 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b86fc62a0 0x563b86f8c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:34.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.368+0000 7fd569f90740 1 -- 172.21.15.99:0/3431297244 >> 172.21.15.99:0/3431297244 conn(0x563b86f556b0 msgr2=0x563b86f87950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:10:34.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.368+0000 7fd569f90740 1 -- 172.21.15.99:0/3431297244 shutdown_connections 2024-02-21T23:10:34.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.368+0000 7fd569f90740 1 -- 172.21.15.99:0/3431297244 wait complete. 2024-02-21T23:10:34.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.369+0000 7fd569f90740 1 -- start start 2024-02-21T23:10:34.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.370+0000 7fd569f90740 1 Processor -- start 2024-02-21T23:10:34.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.372+0000 7fd569f90740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b86fc62a0 0x563b870673f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:34.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.372+0000 7fd569f90740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b86fc6bc0 0x563b86f8a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:34.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.372+0000 7fd569f90740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563b86ffc260 0x563b86f8a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:34.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.372+0000 7fd569f90740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd56017bb90 con 0x563b86ffc260 2024-02-21T23:10:34.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.372+0000 7fd569f90740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd56022a0e0 con 0x563b86fc62a0 2024-02-21T23:10:34.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.372+0000 7fd569f90740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd560229440 con 0x563b86fc6bc0 2024-02-21T23:10:34.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.372+0000 7fd569f90740 10 client.0 _ll_register_callbacks cb 0x7fd550030c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:10:34.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.372+0000 7fd55fe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b86fc62a0 0x563b870673f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:34.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.372+0000 7fd565000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563b86ffc260 0x563b86f8a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:34.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.372+0000 7fd55f400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b86fc6bc0 0x563b86f8a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:34.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.372+0000 7fd55fe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b86fc62a0 0x563b870673f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:48632/0 (socket says 172.21.15.99:48632) 2024-02-21T23:10:34.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.372+0000 7fd55fe00640 1 -- 172.21.15.99:0/2862023572 learned_addr learned my addr 172.21.15.99:0/2862023572 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:10:34.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.372+0000 7fd565000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563b86ffc260 0x563b86f8a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:57832/0 (socket says 172.21.15.99:57832) 2024-02-21T23:10:34.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.373+0000 7fd55fe00640 1 -- 172.21.15.99:0/2862023572 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b86fc6bc0 msgr2=0x563b86f8a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:34.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.373+0000 7fd55fe00640 1 --2- 172.21.15.99:0/2862023572 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b86fc6bc0 0x563b86f8a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:34.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.373+0000 7fd55fe00640 1 -- 172.21.15.99:0/2862023572 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563b86ffc260 msgr2=0x563b86f8a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:34.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.373+0000 7fd55fe00640 1 --2- 172.21.15.99:0/2862023572 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563b86ffc260 0x563b86f8a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:34.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.373+0000 7fd55fe00640 1 -- 172.21.15.99:0/2862023572 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563b86ff9800 con 0x563b86fc62a0 2024-02-21T23:10:34.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.373+0000 7fd55f400640 1 --2- 172.21.15.99:0/2862023572 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b86fc6bc0 0x563b86f8a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:10:34.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.373+0000 7fd55fe00640 1 --2- 172.21.15.99:0/2862023572 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b86fc62a0 0x563b870673f0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fd55003c880 tx=0x7fd550009190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1165b53c9324ac7c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:34.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.373+0000 7fd549600640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-02-21T23:10:34.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.373+0000 7fd549600640 1 -- 172.21.15.99:0/2862023572 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd550037040 con 0x563b86fc62a0 2024-02-21T23:10:34.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.374+0000 7fd569f90740 1 -- 172.21.15.99:0/2862023572 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd558020cf0 con 0x563b86fc62a0 2024-02-21T23:10:34.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.374+0000 7fd549600640 1 -- 172.21.15.99:0/2862023572 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(36..36 src has 1..36) v4 ==== 8877+0+0 (secure 0 0 0) 0x7fd550004450 con 0x563b86fc62a0 2024-02-21T23:10:34.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.374+0000 7fd549600640 1 -- 172.21.15.99:0/2862023572 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd55003cb60 con 0x563b86fc62a0 2024-02-21T23:10:34.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.374+0000 7fd569f90740 10 client.6871 fetch_fsmap learned FSMap version 17 2024-02-21T23:10:34.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.374+0000 7fd569f90740 1 -- 172.21.15.99:0/2862023572 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x563b86ff9ac0 con 0x563b86fc62a0 2024-02-21T23:10:34.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.374+0000 7fd549600640 1 -- 172.21.15.99:0/2862023572 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd558020cf0 con 0x563b86fc62a0 2024-02-21T23:10:34.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.374+0000 7fd549600640 1 -- 172.21.15.99:0/2862023572 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fd550043040 con 0x563b86fc62a0 2024-02-21T23:10:34.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.375+0000 7fd569f90740 10 client.6871 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:10:34.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.375+0000 7fd569f90740 10 client.6871 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:10:34.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.375+0000 7fd569f90740 20 client.6871 populate_metadata read hostname 'smithi099' 2024-02-21T23:10:34.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.375+0000 7fd569f90740 1 --2- 172.21.15.99:0/2862023572 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x563b86ffb9e0 0x563b86f8abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:34.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.375+0000 7fd569f90740 4 client.6871 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T23:10:34.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.375+0000 7fd569f90740 1 -- 172.21.15.99:0/2862023572 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x563b86efa320 con 0x563b86ffb9e0 2024-02-21T23:10:34.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.375+0000 7fd55f400640 1 --2- 172.21.15.99:0/2862023572 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x563b86ffb9e0 0x563b86f8abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:34.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.375+0000 7fd55f400640 1 --2- 172.21.15.99:0/2862023572 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x563b86ffb9e0 0x563b86f8abf0 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8abf2c9fef1d6f0 server_cookie=bf88853339a2ad0b in_seq=0 out_seq=0 2024-02-21T23:10:34.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.375+0000 7fd549600640 10 client.6871 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:10:34.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.376+0000 7fd549600640 1 -- 172.21.15.99:0/2862023572 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x563b86efa320 con 0x563b86ffb9e0 2024-02-21T23:10:34.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.376+0000 7fd549600640 10 client.6871 handle_command_reply: tid=0 2024-02-21T23:10:34.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.376+0000 7fd569f90740 1 client.6871 shutdown 2024-02-21T23:10:34.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.376+0000 7fd569f90740 1 -- 172.21.15.99:0/2862023572 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b86fc62a0 msgr2=0x563b870673f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:34.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.376+0000 7fd569f90740 1 --2- 172.21.15.99:0/2862023572 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b86fc62a0 0x563b870673f0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fd55003c880 tx=0x7fd550009190 comp rx=0 tx=0).stop 2024-02-21T23:10:34.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.376+0000 7fd569f90740 1 -- 172.21.15.99:0/2862023572 shutdown_connections 2024-02-21T23:10:34.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.376+0000 7fd569f90740 1 --2- 172.21.15.99:0/2862023572 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x563b86ffb9e0 0x563b86f8abf0 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:34.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.376+0000 7fd569f90740 1 --2- 172.21.15.99:0/2862023572 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x563b86ffc260 0x563b86f8a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:34.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.376+0000 7fd569f90740 1 --2- 172.21.15.99:0/2862023572 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x563b86fc6bc0 0x563b86f8a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:34.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.376+0000 7fd569f90740 1 --2- 172.21.15.99:0/2862023572 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b86fc62a0 0x563b870673f0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:34.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.376+0000 7fd549600640 0 client.6871 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:10:34.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.376+0000 7fd569f90740 1 -- 172.21.15.99:0/2862023572 >> 172.21.15.99:0/2862023572 conn(0x563b86f556b0 msgr2=0x563b86f87920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:10:34.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.376+0000 7fd569f90740 1 -- 172.21.15.99:0/2862023572 shutdown_connections 2024-02-21T23:10:34.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.376+0000 7fd569f90740 1 -- 172.21.15.99:0/2862023572 wait complete. 2024-02-21T23:10:34.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.376+0000 7fd569f90740 20 client.6871 trim_cache size 0 max 16384 2024-02-21T23:10:34.375 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-02-21T23:10:34.375 INFO:teuthology.orchestra.run.smithi099.stdout: "status": "no active scrubs running", 2024-02-21T23:10:34.376 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubs": {} 2024-02-21T23:10:34.376 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-02-21T23:10:34.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.377+0000 7fd565a00640 1 -- 172.21.15.99:0/3241256711 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fd54009ee50 msgr2=0x7fd5400a1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:34.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.377+0000 7fd565a00640 1 --2- 172.21.15.99:0/3241256711 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fd54009ee50 0x7fd5400a1310 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd558021000 tx=0x7fd558022000 comp rx=0 tx=0).stop 2024-02-21T23:10:34.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.377+0000 7fd565a00640 1 -- 172.21.15.99:0/3241256711 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd56018b060 msgr2=0x7fd560186ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:34.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.377+0000 7fd565a00640 1 --2- 172.21.15.99:0/3241256711 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd56018b060 0x7fd560186ee0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fd54c00c750 tx=0x7fd54c00cc10 comp rx=0 tx=0).stop 2024-02-21T23:10:34.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.377+0000 7fd565a00640 1 -- 172.21.15.99:0/3241256711 shutdown_connections 2024-02-21T23:10:34.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.377+0000 7fd565a00640 1 --2- 172.21.15.99:0/3241256711 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fd54009ee50 0x7fd5400a1310 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:34.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.377+0000 7fd565a00640 1 --2- 172.21.15.99:0/3241256711 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd56018b4f0 0x7fd56017c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:34.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.377+0000 7fd565a00640 1 --2- 172.21.15.99:0/3241256711 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fd56018b060 0x7fd560186ee0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:34.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.377+0000 7fd565a00640 1 --2- 172.21.15.99:0/3241256711 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd56017f490 0x7fd56017e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:34.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.377+0000 7fd565a00640 1 -- 172.21.15.99:0/3241256711 >> 172.21.15.99:0/3241256711 conn(0x7fd5600d29b0 msgr2=0x7fd5600d0580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:10:34.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.377+0000 7fd565a00640 1 -- 172.21.15.99:0/3241256711 shutdown_connections 2024-02-21T23:10:34.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.377+0000 7fd565a00640 1 -- 172.21.15.99:0/3241256711 wait complete. 2024-02-21T23:10:34.382 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-02-21T23:10:34.384 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T23:10:34.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.638+0000 7f6f2ac00640 1 Processor -- start 2024-02-21T23:10:34.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.638+0000 7f6f2ac00640 1 -- start start 2024-02-21T23:10:34.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.640+0000 7f6f2ac00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f6f24186830 0x7f6f24072f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:34.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.640+0000 7f6f2ac00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6f240d1ef0 0x7f6f24186c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:34.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.640+0000 7f6f2ac00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f240734d0 con 0x7f6f240d1a70 2024-02-21T23:10:34.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.640+0000 7f6f2ac00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f240f4b80 con 0x7f6f240d1ef0 2024-02-21T23:10:34.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.640+0000 7f6f2ac00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f240f4e60 con 0x7f6f24186830 2024-02-21T23:10:34.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.640+0000 7f6f2a200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6f240d1ef0 0x7f6f24186c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:34.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.640+0000 7f6f29800640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f6f24186830 0x7f6f24072f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:34.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.640+0000 7f6f28e00640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f6f240d1a70 0x7f6f240cb5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:59636/0 (socket says 172.21.15.99:59636) 2024-02-21T23:10:34.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.640+0000 7f6f2a200640 1 --2- 172.21.15.99:0/3434182703 >> v2:172.21.15.99:3300/0 conn(0x7f6f240d1ef0 0x7f6f24186c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:57838/0 (socket says 172.21.15.99:57838) 2024-02-21T23:10:34.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.640+0000 7f6f28e00640 1 -- 172.21.15.99:0/3434182703 learned_addr learned my addr 172.21.15.99:0/3434182703 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:10:34.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.641+0000 7f6f29800640 1 -- 172.21.15.99:0/3434182703 >> v2:172.21.15.99:3300/0 conn(0x7f6f240d1ef0 msgr2=0x7f6f24186c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:34.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.641+0000 7f6f29800640 1 --2- 172.21.15.99:0/3434182703 >> v2:172.21.15.99:3300/0 conn(0x7f6f240d1ef0 0x7f6f24186c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:34.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.641+0000 7f6f29800640 1 -- 172.21.15.99:0/3434182703 >> v1:172.21.15.181:6789/0 conn(0x7f6f240d1a70 legacy=0x7f6f240cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:34.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.641+0000 7f6f29800640 1 -- 172.21.15.99:0/3434182703 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f240f5140 con 0x7f6f24186830 2024-02-21T23:10:34.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.642+0000 7f6f29800640 1 --2- 172.21.15.99:0/3434182703 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f24186830 0x7f6f24072f90 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f6f240cbf60 tx=0x7f6f1802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=706bc0cf22d16465 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:34.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.642+0000 7f6f23e00640 1 -- 172.21.15.99:0/3434182703 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f18035020 con 0x7f6f24186830 2024-02-21T23:10:34.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.642+0000 7f6f23e00640 1 -- 172.21.15.99:0/3434182703 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f18031830 con 0x7f6f24186830 2024-02-21T23:10:34.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.642+0000 7f6f23e00640 1 -- 172.21.15.99:0/3434182703 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f18031c00 con 0x7f6f24186830 2024-02-21T23:10:34.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.643+0000 7f6f2ac00640 1 -- 172.21.15.99:0/3434182703 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f24186830 msgr2=0x7f6f24072f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:34.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.643+0000 7f6f2ac00640 1 --2- 172.21.15.99:0/3434182703 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f24186830 0x7f6f24072f90 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f6f240cbf60 tx=0x7f6f1802b8d0 comp rx=0 tx=0).stop 2024-02-21T23:10:34.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.643+0000 7f6f2ac00640 1 -- 172.21.15.99:0/3434182703 shutdown_connections 2024-02-21T23:10:34.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.643+0000 7f6f2ac00640 1 --2- 172.21.15.99:0/3434182703 >> v2:172.21.15.99:3300/0 conn(0x7f6f240d1ef0 0x7f6f24186c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:34.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.643+0000 7f6f2ac00640 1 --2- 172.21.15.99:0/3434182703 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f24186830 0x7f6f24072f90 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:34.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.643+0000 7f6f2ac00640 1 -- 172.21.15.99:0/3434182703 >> 172.21.15.99:0/3434182703 conn(0x7f6f240ce3c0 msgr2=0x7f6f240ce7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:10:34.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.643+0000 7f6f2ac00640 1 -- 172.21.15.99:0/3434182703 shutdown_connections 2024-02-21T23:10:34.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.643+0000 7f6f2ac00640 1 -- 172.21.15.99:0/3434182703 wait complete. 2024-02-21T23:10:34.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.645+0000 7f6f2ac00640 1 Processor -- start 2024-02-21T23:10:34.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.646+0000 7f6f2ac00640 1 -- start start 2024-02-21T23:10:34.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.648+0000 7f6f2ac00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f240d1a70 0x7f6f24167270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:34.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.648+0000 7f6f2ac00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f240d1ef0 0x7f6f240cbf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:34.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.648+0000 7f6f2ac00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f24186830 0x7f6f240cc4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:34.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.648+0000 7f6f2ac00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f240f59e0 con 0x7f6f240d1a70 2024-02-21T23:10:34.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.648+0000 7f6f2ac00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f240f5700 con 0x7f6f240d1ef0 2024-02-21T23:10:34.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.648+0000 7f6f2ac00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f240f4870 con 0x7f6f24186830 2024-02-21T23:10:34.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.648+0000 7f6f29800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f240d1a70 0x7f6f24167270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:34.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.648+0000 7f6f29800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f240d1a70 0x7f6f24167270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:57854/0 (socket says 172.21.15.99:57854) 2024-02-21T23:10:34.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.648+0000 7f6f29800640 1 -- 172.21.15.99:0/999152333 learned_addr learned my addr 172.21.15.99:0/999152333 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:10:34.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.648+0000 7f6f28e00640 1 --2- 172.21.15.99:0/999152333 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f240d1ef0 0x7f6f240cbf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:34.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.648+0000 7f6f2a200640 1 --2- 172.21.15.99:0/999152333 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f24186830 0x7f6f240cc4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:34.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.649+0000 7f6f29800640 1 -- 172.21.15.99:0/999152333 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f24186830 msgr2=0x7f6f240cc4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:34.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.649+0000 7f6f29800640 1 --2- 172.21.15.99:0/999152333 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f24186830 0x7f6f240cc4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:34.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.649+0000 7f6f29800640 1 -- 172.21.15.99:0/999152333 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f240d1ef0 msgr2=0x7f6f240cbf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:34.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.649+0000 7f6f29800640 1 --2- 172.21.15.99:0/999152333 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f240d1ef0 0x7f6f240cbf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:34.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.649+0000 7f6f29800640 1 -- 172.21.15.99:0/999152333 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f24211450 con 0x7f6f240d1a70 2024-02-21T23:10:34.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.649+0000 7f6f29800640 1 --2- 172.21.15.99:0/999152333 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f240d1a70 0x7f6f24167270 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f6f18000c00 tx=0x7f6f180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:34.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.649+0000 7f6f21600640 1 -- 172.21.15.99:0/999152333 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f18040070 con 0x7f6f240d1a70 2024-02-21T23:10:34.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.649+0000 7f6f21600640 1 -- 172.21.15.99:0/999152333 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f1803a910 con 0x7f6f240d1a70 2024-02-21T23:10:34.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.649+0000 7f6f2ac00640 1 -- 172.21.15.99:0/999152333 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f24211730 con 0x7f6f240d1a70 2024-02-21T23:10:34.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.649+0000 7f6f21600640 1 -- 172.21.15.99:0/999152333 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f18035040 con 0x7f6f240d1a70 2024-02-21T23:10:34.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.650+0000 7f6f2ac00640 1 -- 172.21.15.99:0/999152333 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f24211cf0 con 0x7f6f240d1a70 2024-02-21T23:10:34.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.651+0000 7f6f2ac00640 1 -- 172.21.15.99:0/999152333 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f24068320 con 0x7f6f240d1a70 2024-02-21T23:10:34.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.653+0000 7f6f21600640 1 -- 172.21.15.99:0/999152333 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f6f1804b060 con 0x7f6f240d1a70 2024-02-21T23:10:34.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.655+0000 7f6f21600640 1 --2- 172.21.15.99:0/999152333 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f6f0409eed0 0x7f6f040a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:34.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.655+0000 7f6f21600640 1 -- 172.21.15.99:0/999152333 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f6f180eb750 con 0x7f6f240d1a70 2024-02-21T23:10:34.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.655+0000 7f6f28e00640 1 --2- 172.21.15.99:0/999152333 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f6f0409eed0 0x7f6f040a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:34.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.656+0000 7f6f28e00640 1 --2- 172.21.15.99:0/999152333 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f6f0409eed0 0x7f6f040a1390 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6f240ed9f0 tx=0x7f6f10007e80 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:34.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.660+0000 7f6f21600640 1 -- 172.21.15.99:0/999152333 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f6f180b96a0 con 0x7f6f240d1a70 2024-02-21T23:10:34.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.906+0000 7f6f2ac00640 1 -- 172.21.15.99:0/999152333 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6f24184c80 con 0x7f6f240d1a70 2024-02-21T23:10:34.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.907+0000 7f6f21600640 1 -- 172.21.15.99:0/999152333 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+11335 (secure 0 0 0) 0x7f6f18031800 con 0x7f6f240d1a70 2024-02-21T23:10:34.895 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T23:10:34.896 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4307,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/3514452812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3514452812},{"type":"v1","addr":"172.21.15.162:6836","nonce":3514452812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4312,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6838/2169982089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":2169982089},{"type":"v1","addr":"172.21.15.162:6838","nonce":2169982089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4315,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6839/3335972724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6837","nonce":3335972724},{"type":"v1","addr":"172.21.15.162:6839","nonce":3335972724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4318,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6841/2135456697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6840","nonce":2135456697},{"type":"v1","addr":"172.21.15.162:6841","nonce":2135456697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4325,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2452242758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2452242758},{"type":"v1","addr":"172.21.15.181:6833","nonce":2452242758}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4328,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6836/2751486400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":2751486400},{"type":"v1","addr":"172.21.15.181:6836","nonce":2751486400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":17,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-21T23:01:02.656130+0000","modified":"2024-02-21T23:07:03.165223+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4355,"mds_1":4352,"mds_2":4348},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4331":{"gid":4331,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6838/3728901330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6835","nonce":3728901330},{"type":"v1","addr":"172.21.15.181:6838","nonce":3728901330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4339":{"gid":4339,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6839/3357929641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6837","nonce":3357929641},{"type":"v1","addr":"172.21.15.181:6839","nonce":3357929641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4343":{"gid":4343,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6833/2793485078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":2793485078},{"type":"v1","addr":"172.21.15.99:6833","nonce":2793485078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4348":{"gid":4348,"name":"d","rank":2,"incarnation":12,"state":"up:active","state_seq":10,"addr":"172.21.15.99:6835/2243461688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2243461688},{"type":"v1","addr":"172.21.15.99:6835","nonce":2243461688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4352":{"gid":4352,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.99:6837/1676159950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":1676159950},{"type":"v1","addr":"172.21.15.99:6837","nonce":1676159950}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4355":{"gid":4355,"name":"j","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6839/4239008786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":4239008786},{"type":"v1","addr":"172.21.15.99:6839","nonce":4239008786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-21T23:10:34.896 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 17 2024-02-21T23:10:34.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.909+0000 7f6f2ac00640 1 -- 172.21.15.99:0/999152333 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f6f0409eed0 msgr2=0x7f6f040a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:34.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.909+0000 7f6f2ac00640 1 --2- 172.21.15.99:0/999152333 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f6f0409eed0 0x7f6f040a1390 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6f240ed9f0 tx=0x7f6f10007e80 comp rx=0 tx=0).stop 2024-02-21T23:10:34.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.910+0000 7f6f2ac00640 1 -- 172.21.15.99:0/999152333 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f240d1a70 msgr2=0x7f6f24167270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:34.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.910+0000 7f6f2ac00640 1 --2- 172.21.15.99:0/999152333 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f240d1a70 0x7f6f24167270 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f6f18000c00 tx=0x7f6f180046c0 comp rx=0 tx=0).stop 2024-02-21T23:10:34.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.910+0000 7f6f2ac00640 1 -- 172.21.15.99:0/999152333 shutdown_connections 2024-02-21T23:10:34.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.910+0000 7f6f2ac00640 1 --2- 172.21.15.99:0/999152333 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f6f0409eed0 0x7f6f040a1390 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:34.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.910+0000 7f6f2ac00640 1 --2- 172.21.15.99:0/999152333 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6f24186830 0x7f6f240cc4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:34.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.910+0000 7f6f2ac00640 1 --2- 172.21.15.99:0/999152333 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f240d1ef0 0x7f6f240cbf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:34.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.910+0000 7f6f2ac00640 1 --2- 172.21.15.99:0/999152333 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6f240d1a70 0x7f6f24167270 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:34.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.910+0000 7f6f2ac00640 1 -- 172.21.15.99:0/999152333 >> 172.21.15.99:0/999152333 conn(0x7f6f240ce3c0 msgr2=0x7f6f24184ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:10:34.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.910+0000 7f6f2ac00640 1 -- 172.21.15.99:0/999152333 shutdown_connections 2024-02-21T23:10:34.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:34.910+0000 7f6f2ac00640 1 -- 172.21.15.99:0/999152333 wait complete. 2024-02-21T23:10:34.917 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T23:10:34.917 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-02-21T23:10:35.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.140+0000 7f4586200640 1 Processor -- start 2024-02-21T23:10:35.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.140+0000 7f4586200640 1 -- start start 2024-02-21T23:10:35.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.142+0000 7f4586200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f458017f490 0x7f458018ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:35.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.142+0000 7f4586200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45800d6dd0 con 0x7f458018b4f0 2024-02-21T23:10:35.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.142+0000 7f4586200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45801614c0 con 0x7f458018b060 2024-02-21T23:10:35.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.142+0000 7f4586200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45800d6810 con 0x7f458017f490 2024-02-21T23:10:35.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.143+0000 7f4585800640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f458018b4f0 0x7f4580189150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:40536/0 (socket says 172.21.15.99:40536) 2024-02-21T23:10:35.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.143+0000 7f4585800640 1 -- 172.21.15.99:0/218436343 learned_addr learned my addr 172.21.15.99:0/218436343 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:10:35.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.143+0000 7f4584e00640 1 --2- 172.21.15.99:0/218436343 >> v2:172.21.15.162:3300/0 conn(0x7f458017f490 0x7f458018ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:35.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.143+0000 7f457f400640 1 -- 172.21.15.99:0/218436343 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3662708626 0 0) 0x7f45801614c0 con 0x7f458018b060 2024-02-21T23:10:35.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.143+0000 7f457f400640 1 -- 172.21.15.99:0/218436343 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4568003520 con 0x7f458018b060 2024-02-21T23:10:35.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.143+0000 7f457f400640 1 -- 172.21.15.99:0/218436343 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2872128620 0 0) 0x7f45800d6dd0 con 0x7f458018b4f0 2024-02-21T23:10:35.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.143+0000 7f457f400640 1 -- 172.21.15.99:0/218436343 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45801614c0 con 0x7f458018b4f0 2024-02-21T23:10:35.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.143+0000 7f4584e00640 1 -- 172.21.15.99:0/218436343 >> v1:172.21.15.162:6789/0 conn(0x7f458018b060 legacy=0x7f4580188a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:35.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.143+0000 7f4584e00640 1 -- 172.21.15.99:0/218436343 >> v1:172.21.15.99:6789/0 conn(0x7f458018b4f0 legacy=0x7f4580189150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:35.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.143+0000 7f4584e00640 1 -- 172.21.15.99:0/218436343 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45800d6af0 con 0x7f458017f490 2024-02-21T23:10:35.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.145+0000 7f4584e00640 1 --2- 172.21.15.99:0/218436343 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f458017f490 0x7f458018ab20 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f45740097a0 tx=0x7f457402b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f33c2961189464ac server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:35.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.145+0000 7f457f400640 1 -- 172.21.15.99:0/218436343 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4574034070 con 0x7f458017f490 2024-02-21T23:10:35.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.145+0000 7f457f400640 1 -- 172.21.15.99:0/218436343 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4574030610 con 0x7f458017f490 2024-02-21T23:10:35.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.145+0000 7f457f400640 1 -- 172.21.15.99:0/218436343 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45740309e0 con 0x7f458017f490 2024-02-21T23:10:35.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.146+0000 7f4586200640 1 -- 172.21.15.99:0/218436343 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f458017f490 msgr2=0x7f458018ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:35.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.146+0000 7f4586200640 1 --2- 172.21.15.99:0/218436343 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f458017f490 0x7f458018ab20 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f45740097a0 tx=0x7f457402b960 comp rx=0 tx=0).stop 2024-02-21T23:10:35.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.146+0000 7f4586200640 1 -- 172.21.15.99:0/218436343 shutdown_connections 2024-02-21T23:10:35.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.146+0000 7f4586200640 1 --2- 172.21.15.99:0/218436343 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f458017f490 0x7f458018ab20 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.146+0000 7f4586200640 1 -- 172.21.15.99:0/218436343 >> 172.21.15.99:0/218436343 conn(0x7f45800d29b0 msgr2=0x7f45800d2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:10:35.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.146+0000 7f4586200640 1 -- 172.21.15.99:0/218436343 shutdown_connections 2024-02-21T23:10:35.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.146+0000 7f4586200640 1 -- 172.21.15.99:0/218436343 wait complete. 2024-02-21T23:10:35.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.149+0000 7f4586200640 1 Processor -- start 2024-02-21T23:10:35.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.149+0000 7f4586200640 1 -- start start 2024-02-21T23:10:35.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.151+0000 7f4586200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f458017f490 0x7f45802229f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:35.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.151+0000 7f4586200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f458018b060 0x7f4580172ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:35.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.152+0000 7f4586200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f458018b4f0 0x7f45802207f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:35.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.152+0000 7f4586200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f458018a600 con 0x7f458017f490 2024-02-21T23:10:35.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.152+0000 7f4586200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f458018a320 con 0x7f458018b4f0 2024-02-21T23:10:35.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.152+0000 7f4586200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f458017f870 con 0x7f458018b060 2024-02-21T23:10:35.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.152+0000 7f4584e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f458017f490 0x7f45802229f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:35.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.152+0000 7f4584e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f458017f490 0x7f45802229f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:57856/0 (socket says 172.21.15.99:57856) 2024-02-21T23:10:35.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.152+0000 7f4584e00640 1 -- 172.21.15.99:0/3813000174 learned_addr learned my addr 172.21.15.99:0/3813000174 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:10:35.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.152+0000 7f4585800640 1 --2- 172.21.15.99:0/3813000174 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f458018b4f0 0x7f45802207f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:35.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.152+0000 7f457fe00640 1 --2- 172.21.15.99:0/3813000174 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f458018b060 0x7f4580172ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:35.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.152+0000 7f4584e00640 1 -- 172.21.15.99:0/3813000174 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f458018b060 msgr2=0x7f4580172ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:35.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.152+0000 7f4584e00640 1 --2- 172.21.15.99:0/3813000174 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f458018b060 0x7f4580172ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.152+0000 7f4584e00640 1 -- 172.21.15.99:0/3813000174 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f458018b4f0 msgr2=0x7f45802207f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:35.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.152+0000 7f4584e00640 1 --2- 172.21.15.99:0/3813000174 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f458018b4f0 0x7f45802207f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.152+0000 7f4584e00640 1 -- 172.21.15.99:0/3813000174 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f458006c580 con 0x7f458017f490 2024-02-21T23:10:35.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.152+0000 7f4585800640 1 --2- 172.21.15.99:0/3813000174 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f458018b4f0 0x7f45802207f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:10:35.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.153+0000 7f4584e00640 1 --2- 172.21.15.99:0/3813000174 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f458017f490 0x7f45802229f0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f457402bf70 tx=0x7f45740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:35.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.153+0000 7f457cc00640 1 -- 172.21.15.99:0/3813000174 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4574034040 con 0x7f458017f490 2024-02-21T23:10:35.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.153+0000 7f457cc00640 1 -- 172.21.15.99:0/3813000174 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4574030410 con 0x7f458017f490 2024-02-21T23:10:35.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.153+0000 7f4586200640 1 -- 172.21.15.99:0/3813000174 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f458006c860 con 0x7f458017f490 2024-02-21T23:10:35.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.153+0000 7f457cc00640 1 -- 172.21.15.99:0/3813000174 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4574006e10 con 0x7f458017f490 2024-02-21T23:10:35.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.153+0000 7f4586200640 1 -- 172.21.15.99:0/3813000174 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f458021fff0 con 0x7f458017f490 2024-02-21T23:10:35.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.158+0000 7f457cc00640 1 -- 172.21.15.99:0/3813000174 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f4574037070 con 0x7f458017f490 2024-02-21T23:10:35.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.160+0000 7f458a5fe740 1 Processor -- start 2024-02-21T23:10:35.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.160+0000 7f458a5fe740 1 -- start start 2024-02-21T23:10:35.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.160+0000 7f457cc00640 1 --2- 172.21.15.99:0/3813000174 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f456009eed0 0x7f45600a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:35.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.161+0000 7f457cc00640 1 -- 172.21.15.99:0/3813000174 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f45740ebe90 con 0x7f458017f490 2024-02-21T23:10:35.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.161+0000 7f4585800640 1 --2- 172.21.15.99:0/3813000174 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f456009eed0 0x7f45600a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:35.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.162+0000 7f4585800640 1 --2- 172.21.15.99:0/3813000174 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f456009eed0 0x7f45600a1390 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4578001560 tx=0x7f4578001970 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:35.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.162+0000 7f458a5fe740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555d88a65660 0x555d88a65a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:35.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.162+0000 7f458a5fe740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555d88aa0330 0x555d88aa07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:35.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.162+0000 7f458a5fe740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555d88aa0cf0 0x555d88aa1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:35.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.162+0000 7f458a5fe740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d8898db50 con 0x555d88a65660 2024-02-21T23:10:35.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.162+0000 7f458a5fe740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d88936da0 con 0x555d88aa0330 2024-02-21T23:10:35.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.162+0000 7f458a5fe740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d88989bf0 con 0x555d88aa0cf0 2024-02-21T23:10:35.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.162+0000 7f4584e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555d88a65660 0x555d88a65a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:35.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.162+0000 7f4584e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555d88a65660 0x555d88a65a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:57862/0 (socket says 172.21.15.99:57862) 2024-02-21T23:10:35.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.162+0000 7f4584e00640 1 -- 172.21.15.99:0/473599744 learned_addr learned my addr 172.21.15.99:0/473599744 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:10:35.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.162+0000 7f4585800640 1 --2- 172.21.15.99:0/473599744 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555d88aa0cf0 0x555d88aa1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:35.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.162+0000 7f457fe00640 1 --2- 172.21.15.99:0/473599744 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555d88aa0330 0x555d88aa07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:35.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.163+0000 7f4584e00640 1 -- 172.21.15.99:0/473599744 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555d88aa0cf0 msgr2=0x555d88aa1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:35.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.163+0000 7f4584e00640 1 --2- 172.21.15.99:0/473599744 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555d88aa0cf0 0x555d88aa1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.163+0000 7f4584e00640 1 -- 172.21.15.99:0/473599744 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555d88aa0330 msgr2=0x555d88aa07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:35.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.163+0000 7f4584e00640 1 --2- 172.21.15.99:0/473599744 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555d88aa0330 0x555d88aa07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.163+0000 7f4584e00640 1 -- 172.21.15.99:0/473599744 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555d88959f80 con 0x555d88a65660 2024-02-21T23:10:35.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.163+0000 7f457fe00640 1 --2- 172.21.15.99:0/473599744 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555d88aa0330 0x555d88aa07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:10:35.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.163+0000 7f4584e00640 1 --2- 172.21.15.99:0/473599744 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555d88a65660 0x555d88a65a40 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f45740b76b0 tx=0x7f45740b9010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54deb128fd088e81 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:35.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.163+0000 7f4571600640 1 -- 172.21.15.99:0/473599744 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45740b9630 con 0x555d88a65660 2024-02-21T23:10:35.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.163+0000 7f4571600640 1 -- 172.21.15.99:0/473599744 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45740bd780 con 0x555d88a65660 2024-02-21T23:10:35.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.163+0000 7f4571600640 1 -- 172.21.15.99:0/473599744 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45740c1dd0 con 0x555d88a65660 2024-02-21T23:10:35.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.164+0000 7f458a5fe740 1 -- 172.21.15.99:0/473599744 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555d88a65660 msgr2=0x555d88a65a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:35.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.164+0000 7f458a5fe740 1 --2- 172.21.15.99:0/473599744 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555d88a65660 0x555d88a65a40 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f45740b76b0 tx=0x7f45740b9010 comp rx=0 tx=0).stop 2024-02-21T23:10:35.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.164+0000 7f458a5fe740 1 -- 172.21.15.99:0/473599744 shutdown_connections 2024-02-21T23:10:35.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.164+0000 7f458a5fe740 1 --2- 172.21.15.99:0/473599744 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555d88aa0cf0 0x555d88aa1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.164+0000 7f458a5fe740 1 --2- 172.21.15.99:0/473599744 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555d88aa0330 0x555d88aa07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.165+0000 7f458a5fe740 1 --2- 172.21.15.99:0/473599744 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555d88a65660 0x555d88a65a40 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.165+0000 7f458a5fe740 1 -- 172.21.15.99:0/473599744 >> 172.21.15.99:0/473599744 conn(0x555d88a276d0 msgr2=0x555d88a28750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:10:35.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.165+0000 7f458a5fe740 1 -- 172.21.15.99:0/473599744 shutdown_connections 2024-02-21T23:10:35.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.165+0000 7f458a5fe740 1 -- 172.21.15.99:0/473599744 wait complete. 2024-02-21T23:10:35.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.166+0000 7f458a5fe740 1 -- start start 2024-02-21T23:10:35.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.166+0000 7f458a5fe740 1 Processor -- start 2024-02-21T23:10:35.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.169+0000 7f458a5fe740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555d88aa0330 0x555d88a54c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:35.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.169+0000 7f458a5fe740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555d88aa0cf0 0x555d88a541f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:35.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.169+0000 7f458a5fe740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555d88a56d40 0x555d88a571b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:35.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.169+0000 7f458a5fe740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d88a9f0a0 con 0x555d88a56d40 2024-02-21T23:10:35.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.169+0000 7f458a5fe740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d8892c380 con 0x555d88aa0cf0 2024-02-21T23:10:35.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.169+0000 7f458a5fe740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d88a9edc0 con 0x555d88aa0330 2024-02-21T23:10:35.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.169+0000 7f458a5fe740 10 client.0 _ll_register_callbacks cb 0x555d88985280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:10:35.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.169+0000 7f457fe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555d88aa0cf0 0x555d88a541f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:35.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.169+0000 7f4585800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555d88a56d40 0x555d88a571b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:35.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.169+0000 7f457fe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555d88aa0cf0 0x555d88a541f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:48674/0 (socket says 172.21.15.99:48674) 2024-02-21T23:10:35.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.169+0000 7f457fe00640 1 -- 172.21.15.99:0/1289675679 learned_addr learned my addr 172.21.15.99:0/1289675679 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:10:35.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.169+0000 7f4584e00640 1 --2- 172.21.15.99:0/1289675679 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555d88aa0330 0x555d88a54c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:35.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.170+0000 7f4585800640 1 -- 172.21.15.99:0/1289675679 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555d88aa0330 msgr2=0x555d88a54c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:35.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.170+0000 7f4585800640 1 --2- 172.21.15.99:0/1289675679 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555d88aa0330 0x555d88a54c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.170+0000 7f4585800640 1 -- 172.21.15.99:0/1289675679 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555d88aa0cf0 msgr2=0x555d88a541f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:35.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.170+0000 7f4585800640 1 --2- 172.21.15.99:0/1289675679 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555d88aa0cf0 0x555d88a541f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.170+0000 7f4585800640 1 -- 172.21.15.99:0/1289675679 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555d88954c20 con 0x555d88a56d40 2024-02-21T23:10:35.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.170+0000 7f4585800640 1 --2- 172.21.15.99:0/1289675679 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555d88a56d40 0x555d88a571b0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x555d88a71740 tx=0x7f45780014d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70bf690b8a16fbb8 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:35.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.170+0000 7f4566000640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:10:35.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.170+0000 7f4566000640 1 -- 172.21.15.99:0/1289675679 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4578025020 con 0x555d88a56d40 2024-02-21T23:10:35.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.170+0000 7f4566000640 1 -- 172.21.15.99:0/1289675679 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(36..36 src has 1..36) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f4578021400 con 0x555d88a56d40 2024-02-21T23:10:35.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.170+0000 7f458a5fe740 1 -- 172.21.15.99:0/1289675679 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f45740bd780 con 0x555d88a56d40 2024-02-21T23:10:35.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.171+0000 7f4566000640 1 -- 172.21.15.99:0/1289675679 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4578030050 con 0x555d88a56d40 2024-02-21T23:10:35.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.171+0000 7f458a5fe740 10 client.6720 fetch_fsmap learned FSMap version 17 2024-02-21T23:10:35.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.171+0000 7f458a5fe740 1 -- 172.21.15.99:0/1289675679 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x555d886a23f0 con 0x555d88a56d40 2024-02-21T23:10:35.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.171+0000 7f4566000640 1 -- 172.21.15.99:0/1289675679 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45740bd780 con 0x555d88a56d40 2024-02-21T23:10:35.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.171+0000 7f4566000640 1 -- 172.21.15.99:0/1289675679 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f4578020040 con 0x555d88a56d40 2024-02-21T23:10:35.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.171+0000 7f458a5fe740 10 client.6720 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:10:35.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.171+0000 7f458a5fe740 10 client.6720 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.d 2024-02-21T23:10:35.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.172+0000 7f458a5fe740 20 client.6720 populate_metadata read hostname 'smithi099' 2024-02-21T23:10:35.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.172+0000 7f458a5fe740 1 --2- 172.21.15.99:0/1289675679 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x555d88a23390 0x555d88a237a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:35.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.172+0000 7f458a5fe740 4 client.6720 mds_command: new command op to 4348 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:10:35.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.172+0000 7f458a5fe740 1 -- 172.21.15.99:0/1289675679 --> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555d8899b090 con 0x555d88a23390 2024-02-21T23:10:35.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.172+0000 7f4584e00640 1 --2- 172.21.15.99:0/1289675679 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x555d88a23390 0x555d88a237a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:35.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.172+0000 7f4566000640 10 client.6720 ms_handle_connect on v2:172.21.15.99:6834/2243461688 2024-02-21T23:10:35.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.172+0000 7f4584e00640 1 --2- 172.21.15.99:0/1289675679 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x555d88a23390 0x555d88a237a0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1e7049d8c23fc49a server_cookie=c23beb37ceb2bc44 in_seq=0 out_seq=0 2024-02-21T23:10:35.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.173+0000 7f4566000640 1 -- 172.21.15.99:0/1289675679 <== mds.2 v2:172.21.15.99:6834/2243461688 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x7f45740e2e50 con 0x555d88a23390 2024-02-21T23:10:35.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.173+0000 7f4566000640 10 client.6720 handle_command_reply: tid=0 2024-02-21T23:10:35.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.173+0000 7f458a5fe740 1 client.6720 shutdown 2024-02-21T23:10:35.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.174+0000 7f458a5fe740 1 -- 172.21.15.99:0/1289675679 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555d88a56d40 msgr2=0x555d88a571b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:35.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.174+0000 7f458a5fe740 1 --2- 172.21.15.99:0/1289675679 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555d88a56d40 0x555d88a571b0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x555d88a71740 tx=0x7f45780014d0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.174+0000 7f458a5fe740 1 -- 172.21.15.99:0/1289675679 shutdown_connections 2024-02-21T23:10:35.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.174+0000 7f458a5fe740 1 --2- 172.21.15.99:0/1289675679 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x555d88a23390 0x555d88a237a0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.174+0000 7f458a5fe740 1 --2- 172.21.15.99:0/1289675679 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555d88a56d40 0x555d88a571b0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.174+0000 7f458a5fe740 1 --2- 172.21.15.99:0/1289675679 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555d88aa0cf0 0x555d88a541f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.174+0000 7f458a5fe740 1 --2- 172.21.15.99:0/1289675679 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555d88aa0330 0x555d88a54c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.174+0000 7f458a5fe740 1 -- 172.21.15.99:0/1289675679 >> 172.21.15.99:0/1289675679 conn(0x555d88a65660 msgr2=0x555d88a9f7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:10:35.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.174+0000 7f4566000640 0 client.6720 ms_handle_reset on v2:172.21.15.99:6834/2243461688 2024-02-21T23:10:35.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.174+0000 7f458a5fe740 1 -- 172.21.15.99:0/1289675679 shutdown_connections 2024-02-21T23:10:35.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.174+0000 7f458a5fe740 1 -- 172.21.15.99:0/1289675679 wait complete. 2024-02-21T23:10:35.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.174+0000 7f458a5fe740 20 client.6720 trim_cache size 0 max 16384 2024-02-21T23:10:35.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.188+0000 7f458a5fe740 1 Processor -- start 2024-02-21T23:10:35.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.188+0000 7f458a5fe740 1 -- start start 2024-02-21T23:10:35.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.189+0000 7f458a5fe740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555d88a56d40 0x555d88a614a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:35.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.189+0000 7f458a5fe740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555d88aa0330 0x555d88a69130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:35.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.189+0000 7f458a5fe740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555d88aa0cf0 0x555d88afccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:35.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.189+0000 7f458a5fe740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f458022c900 con 0x555d88aa0cf0 2024-02-21T23:10:35.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.189+0000 7f458a5fe740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f458022a4a0 con 0x555d88a56d40 2024-02-21T23:10:35.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.189+0000 7f458a5fe740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4580228580 con 0x555d88aa0330 2024-02-21T23:10:35.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.189+0000 7f4585800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555d88aa0cf0 0x555d88afccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:35.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.190+0000 7f4585800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555d88aa0cf0 0x555d88afccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:57886/0 (socket says 172.21.15.99:57886) 2024-02-21T23:10:35.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.190+0000 7f4585800640 1 -- 172.21.15.99:0/3010428543 learned_addr learned my addr 172.21.15.99:0/3010428543 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:10:35.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.190+0000 7f457fe00640 1 --2- 172.21.15.99:0/3010428543 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555d88aa0330 0x555d88a69130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:35.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.190+0000 7f4584e00640 1 --2- 172.21.15.99:0/3010428543 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555d88a56d40 0x555d88a614a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:35.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.190+0000 7f4585800640 1 -- 172.21.15.99:0/3010428543 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555d88aa0330 msgr2=0x555d88a69130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:35.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.190+0000 7f4585800640 1 --2- 172.21.15.99:0/3010428543 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555d88aa0330 0x555d88a69130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.190+0000 7f4585800640 1 -- 172.21.15.99:0/3010428543 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555d88a56d40 msgr2=0x555d88a614a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:35.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.190+0000 7f4585800640 1 --2- 172.21.15.99:0/3010428543 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555d88a56d40 0x555d88a614a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.190+0000 7f4585800640 1 -- 172.21.15.99:0/3010428543 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555d8876c7d0 con 0x555d88aa0cf0 2024-02-21T23:10:35.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.190+0000 7f4585800640 1 --2- 172.21.15.99:0/3010428543 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555d88aa0cf0 0x555d88afccd0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x555d88a57160 tx=0x7f457801b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac03e79538a4edb4 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:35.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.191+0000 7f4570c00640 1 -- 172.21.15.99:0/3010428543 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4578025070 con 0x555d88aa0cf0 2024-02-21T23:10:35.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.191+0000 7f4570c00640 1 -- 172.21.15.99:0/3010428543 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f457801b070 con 0x555d88aa0cf0 2024-02-21T23:10:35.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.191+0000 7f4570c00640 1 -- 172.21.15.99:0/3010428543 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45780219f0 con 0x555d88aa0cf0 2024-02-21T23:10:35.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.191+0000 7f458a5fe740 1 -- 172.21.15.99:0/3010428543 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555d88aa0cf0 msgr2=0x555d88afccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:35.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.191+0000 7f458a5fe740 1 --2- 172.21.15.99:0/3010428543 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555d88aa0cf0 0x555d88afccd0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x555d88a57160 tx=0x7f457801b000 comp rx=0 tx=0).stop 2024-02-21T23:10:35.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.192+0000 7f458a5fe740 1 -- 172.21.15.99:0/3010428543 shutdown_connections 2024-02-21T23:10:35.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.192+0000 7f458a5fe740 1 --2- 172.21.15.99:0/3010428543 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555d88aa0cf0 0x555d88afccd0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.192+0000 7f458a5fe740 1 --2- 172.21.15.99:0/3010428543 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555d88aa0330 0x555d88a69130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.192+0000 7f458a5fe740 1 --2- 172.21.15.99:0/3010428543 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555d88a56d40 0x555d88a614a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.192+0000 7f458a5fe740 1 -- 172.21.15.99:0/3010428543 >> 172.21.15.99:0/3010428543 conn(0x555d88a65660 msgr2=0x555d88a9f570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:10:35.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.192+0000 7f458a5fe740 1 -- 172.21.15.99:0/3010428543 shutdown_connections 2024-02-21T23:10:35.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.192+0000 7f458a5fe740 1 -- 172.21.15.99:0/3010428543 wait complete. 2024-02-21T23:10:35.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.193+0000 7f458a5fe740 1 -- start start 2024-02-21T23:10:35.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.193+0000 7f458a5fe740 1 Processor -- start 2024-02-21T23:10:35.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.195+0000 7f458a5fe740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555d88a56d40 0x555d88a9af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:35.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.195+0000 7f458a5fe740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555d88aa0330 0x555d88a9d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:35.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.195+0000 7f458a5fe740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555d88aa0cf0 0x555d88aaa620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:35.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.195+0000 7f458a5fe740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4580228b80 con 0x555d88aa0cf0 2024-02-21T23:10:35.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.195+0000 7f458a5fe740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4580229e40 con 0x555d88aa0330 2024-02-21T23:10:35.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.195+0000 7f458a5fe740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4580229180 con 0x555d88a56d40 2024-02-21T23:10:35.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.195+0000 7f458a5fe740 10 client.0 _ll_register_callbacks cb 0x7f4578002150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:10:35.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.195+0000 7f457fe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555d88aa0330 0x555d88a9d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:35.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.195+0000 7f4585800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555d88aa0cf0 0x555d88aaa620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:35.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.195+0000 7f4584e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555d88a56d40 0x555d88a9af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:35.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.195+0000 7f4585800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555d88aa0cf0 0x555d88aaa620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:57896/0 (socket says 172.21.15.99:57896) 2024-02-21T23:10:35.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.195+0000 7f4585800640 1 -- 172.21.15.99:0/239177224 learned_addr learned my addr 172.21.15.99:0/239177224 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:10:35.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.196+0000 7f4584e00640 1 -- 172.21.15.99:0/239177224 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555d88aa0330 msgr2=0x555d88a9d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:35.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.196+0000 7f4584e00640 1 --2- 172.21.15.99:0/239177224 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555d88aa0330 0x555d88a9d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.196+0000 7f4584e00640 1 -- 172.21.15.99:0/239177224 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555d88aa0cf0 msgr2=0x555d88aaa620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:35.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.196+0000 7f4584e00640 1 --2- 172.21.15.99:0/239177224 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555d88aa0cf0 0x555d88aaa620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.196+0000 7f4584e00640 1 -- 172.21.15.99:0/239177224 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555d88a9de40 con 0x555d88a56d40 2024-02-21T23:10:35.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.196+0000 7f457fe00640 1 --2- 172.21.15.99:0/239177224 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555d88aa0330 0x555d88a9d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:10:35.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.196+0000 7f4584e00640 1 --2- 172.21.15.99:0/239177224 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555d88a56d40 0x555d88a9af20 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f45740e9530 tx=0x7f45740a4040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9414086f8e1de22a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:35.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.196+0000 7f4566000640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-02-21T23:10:35.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.196+0000 7f4566000640 1 -- 172.21.15.99:0/239177224 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45740d1220 con 0x555d88a56d40 2024-02-21T23:10:35.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.196+0000 7f4566000640 1 -- 172.21.15.99:0/239177224 <== mon.2 v2:172.21.15.181:3300/0 2 ==== osd_map(36..36 src has 1..36) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f45740e9700 con 0x555d88a56d40 2024-02-21T23:10:35.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.196+0000 7f458a5fe740 1 -- 172.21.15.99:0/239177224 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f457801b070 con 0x555d88a56d40 2024-02-21T23:10:35.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.197+0000 7f4566000640 1 -- 172.21.15.99:0/239177224 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f45740b9630 con 0x555d88a56d40 2024-02-21T23:10:35.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.197+0000 7f458a5fe740 10 client.6857 fetch_fsmap learned FSMap version 17 2024-02-21T23:10:35.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.197+0000 7f458a5fe740 1 -- 172.21.15.99:0/239177224 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x555d88a53ec0 con 0x555d88a56d40 2024-02-21T23:10:35.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.197+0000 7f4566000640 1 -- 172.21.15.99:0/239177224 <== mon.2 v2:172.21.15.181:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f457801b070 con 0x555d88a56d40 2024-02-21T23:10:35.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.197+0000 7f4566000640 1 -- 172.21.15.99:0/239177224 <== mon.2 v2:172.21.15.181:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f4574041070 con 0x555d88a56d40 2024-02-21T23:10:35.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.197+0000 7f458a5fe740 10 client.6857 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:10:35.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.197+0000 7f458a5fe740 10 client.6857 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.d 2024-02-21T23:10:35.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.197+0000 7f458a5fe740 20 client.6857 populate_metadata read hostname 'smithi099' 2024-02-21T23:10:35.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.197+0000 7f458a5fe740 1 --2- 172.21.15.99:0/239177224 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x555d88a30130 0x555d88b0cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:35.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.197+0000 7f458a5fe740 4 client.6857 mds_command: new command op to 4348 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T23:10:35.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.197+0000 7f458a5fe740 1 -- 172.21.15.99:0/239177224 --> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x555d889953e0 con 0x555d88a30130 2024-02-21T23:10:35.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.198+0000 7f457fe00640 1 --2- 172.21.15.99:0/239177224 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x555d88a30130 0x555d88b0cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:35.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.198+0000 7f457fe00640 1 --2- 172.21.15.99:0/239177224 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x555d88a30130 0x555d88b0cbd0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fea6121317450b7b server_cookie=37a57a974391b2ac in_seq=0 out_seq=0 2024-02-21T23:10:35.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.198+0000 7f4566000640 10 client.6857 ms_handle_connect on v2:172.21.15.99:6834/2243461688 2024-02-21T23:10:35.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.198+0000 7f4566000640 1 -- 172.21.15.99:0/239177224 <== mds.2 v2:172.21.15.99:6834/2243461688 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x555d889953e0 con 0x555d88a30130 2024-02-21T23:10:35.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.198+0000 7f4566000640 10 client.6857 handle_command_reply: tid=0 2024-02-21T23:10:35.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.198+0000 7f458a5fe740 1 client.6857 shutdown 2024-02-21T23:10:35.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.199+0000 7f458a5fe740 1 -- 172.21.15.99:0/239177224 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555d88a56d40 msgr2=0x555d88a9af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:35.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.199+0000 7f458a5fe740 1 --2- 172.21.15.99:0/239177224 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555d88a56d40 0x555d88a9af20 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f45740e9530 tx=0x7f45740a4040 comp rx=0 tx=0).stop 2024-02-21T23:10:35.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.199+0000 7f458a5fe740 1 -- 172.21.15.99:0/239177224 shutdown_connections 2024-02-21T23:10:35.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.199+0000 7f458a5fe740 1 --2- 172.21.15.99:0/239177224 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x555d88a30130 0x555d88b0cbd0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.199+0000 7f458a5fe740 1 --2- 172.21.15.99:0/239177224 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x555d88aa0cf0 0x555d88aaa620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.199+0000 7f458a5fe740 1 --2- 172.21.15.99:0/239177224 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x555d88aa0330 0x555d88a9d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.199+0000 7f458a5fe740 1 --2- 172.21.15.99:0/239177224 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x555d88a56d40 0x555d88a9af20 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.199+0000 7f458a5fe740 1 -- 172.21.15.99:0/239177224 >> 172.21.15.99:0/239177224 conn(0x555d88a65660 msgr2=0x555d88a1f5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:10:35.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.199+0000 7f4566000640 0 client.6857 ms_handle_reset on v2:172.21.15.99:6834/2243461688 2024-02-21T23:10:35.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.199+0000 7f458a5fe740 1 -- 172.21.15.99:0/239177224 shutdown_connections 2024-02-21T23:10:35.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.199+0000 7f458a5fe740 1 -- 172.21.15.99:0/239177224 wait complete. 2024-02-21T23:10:35.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.199+0000 7f458a5fe740 20 client.6857 trim_cache size 0 max 16384 2024-02-21T23:10:35.196 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-02-21T23:10:35.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.200+0000 7f4586200640 1 -- 172.21.15.99:0/3813000174 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f456009eed0 msgr2=0x7f45600a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:35.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.200+0000 7f4586200640 1 --2- 172.21.15.99:0/3813000174 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f456009eed0 0x7f45600a1390 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4578001560 tx=0x7f4578001970 comp rx=0 tx=0).stop 2024-02-21T23:10:35.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.200+0000 7f4586200640 1 -- 172.21.15.99:0/3813000174 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f458017f490 msgr2=0x7f45802229f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:35.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.200+0000 7f4586200640 1 --2- 172.21.15.99:0/3813000174 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f458017f490 0x7f45802229f0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f457402bf70 tx=0x7f45740046c0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.200+0000 7f4586200640 1 -- 172.21.15.99:0/3813000174 shutdown_connections 2024-02-21T23:10:35.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.200+0000 7f4586200640 1 --2- 172.21.15.99:0/3813000174 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f456009eed0 0x7f45600a1390 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.200+0000 7f4586200640 1 --2- 172.21.15.99:0/3813000174 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f458018b4f0 0x7f45802207f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.200+0000 7f4586200640 1 --2- 172.21.15.99:0/3813000174 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f458018b060 0x7f4580172ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.200+0000 7f4586200640 1 --2- 172.21.15.99:0/3813000174 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f458017f490 0x7f45802229f0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.200+0000 7f4586200640 1 -- 172.21.15.99:0/3813000174 >> 172.21.15.99:0/3813000174 conn(0x7f45800d29b0 msgr2=0x7f45800fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:10:35.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.200+0000 7f4586200640 1 -- 172.21.15.99:0/3813000174 shutdown_connections 2024-02-21T23:10:35.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.200+0000 7f4586200640 1 -- 172.21.15.99:0/3813000174 wait complete. 2024-02-21T23:10:35.205 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T23:10:35.205 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-02-21T23:10:35.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.405+0000 7f636d600640 1 Processor -- start 2024-02-21T23:10:35.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.405+0000 7f636d600640 1 -- start start 2024-02-21T23:10:35.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.408+0000 7f636d600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f636818c250 0x7f6368186bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:35.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.408+0000 7f636d600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6368187110 0x7f63680fa210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:35.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.409+0000 7f636d600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6368188a00 con 0x7f63680fa750 2024-02-21T23:10:35.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.409+0000 7f636d600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6368187680 con 0x7f6368187110 2024-02-21T23:10:35.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.409+0000 7f636d600640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6368187960 con 0x7f636818c250 2024-02-21T23:10:35.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.409+0000 7f635fe00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6368187110 0x7f63680fa210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:35.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.409+0000 7f6367400640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f63680fa750 0x7f636818c630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.99:59632/0 (socket says 172.21.15.99:59632) 2024-02-21T23:10:35.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.409+0000 7f6367400640 1 -- 172.21.15.99:0/3168025627 learned_addr learned my addr 172.21.15.99:0/3168025627 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:10:35.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.409+0000 7f6366a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f636818c250 0x7f6368186bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:35.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.409+0000 7f6366000640 1 -- 172.21.15.99:0/3168025627 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2024935248 0 0) 0x7f6368188a00 con 0x7f63680fa750 2024-02-21T23:10:35.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.409+0000 7f635fe00640 1 -- 172.21.15.99:0/3168025627 >> v2:172.21.15.162:3300/0 conn(0x7f636818c250 msgr2=0x7f6368186bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:35.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.409+0000 7f635fe00640 1 --2- 172.21.15.99:0/3168025627 >> v2:172.21.15.162:3300/0 conn(0x7f636818c250 0x7f6368186bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.409+0000 7f635fe00640 1 -- 172.21.15.99:0/3168025627 >> v1:172.21.15.162:6789/0 conn(0x7f63680fa750 legacy=0x7f636818c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:35.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.409+0000 7f635fe00640 1 -- 172.21.15.99:0/3168025627 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6368187c40 con 0x7f6368187110 2024-02-21T23:10:35.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.409+0000 7f6366a00640 1 --2- 172.21.15.99:0/3168025627 >> v2:172.21.15.162:3300/0 conn(0x7f636818c250 0x7f6368186bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:10:35.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.410+0000 7f635fe00640 1 --2- 172.21.15.99:0/3168025627 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6368187110 0x7f63680fa210 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f63680903d0 tx=0x7f635002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4bcc0a13524c7b5 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:35.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.411+0000 7f6366000640 1 -- 172.21.15.99:0/3168025627 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63500315a0 con 0x7f6368187110 2024-02-21T23:10:35.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.411+0000 7f6366000640 1 -- 172.21.15.99:0/3168025627 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6350037070 con 0x7f6368187110 2024-02-21T23:10:35.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.411+0000 7f6366000640 1 -- 172.21.15.99:0/3168025627 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6350031960 con 0x7f6368187110 2024-02-21T23:10:35.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.412+0000 7f636d600640 1 -- 172.21.15.99:0/3168025627 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6368187110 msgr2=0x7f63680fa210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:35.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.412+0000 7f636d600640 1 --2- 172.21.15.99:0/3168025627 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6368187110 0x7f63680fa210 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f63680903d0 tx=0x7f635002b840 comp rx=0 tx=0).stop 2024-02-21T23:10:35.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.412+0000 7f636d600640 1 -- 172.21.15.99:0/3168025627 shutdown_connections 2024-02-21T23:10:35.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.412+0000 7f636d600640 1 --2- 172.21.15.99:0/3168025627 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6368187110 0x7f63680fa210 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.412+0000 7f636d600640 1 --2- 172.21.15.99:0/3168025627 >> v2:172.21.15.162:3300/0 conn(0x7f636818c250 0x7f6368186bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.412+0000 7f636d600640 1 -- 172.21.15.99:0/3168025627 >> 172.21.15.99:0/3168025627 conn(0x7f63680f8d90 msgr2=0x7f63680f91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:10:35.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.412+0000 7f636d600640 1 -- 172.21.15.99:0/3168025627 shutdown_connections 2024-02-21T23:10:35.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.412+0000 7f636d600640 1 -- 172.21.15.99:0/3168025627 wait complete. 2024-02-21T23:10:35.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.414+0000 7f636d600640 1 Processor -- start 2024-02-21T23:10:35.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.415+0000 7f636d600640 1 -- start start 2024-02-21T23:10:35.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.417+0000 7f636d600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63680fa750 0x7f636806eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:35.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.417+0000 7f636d600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6368187110 0x7f6368220140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:35.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.417+0000 7f636d600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f636818c250 0x7f6368171560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:35.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.417+0000 7f636d600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63681884e0 con 0x7f6368187110 2024-02-21T23:10:35.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.417+0000 7f636d600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6368188200 con 0x7f63680fa750 2024-02-21T23:10:35.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.417+0000 7f636d600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63680fabe0 con 0x7f636818c250 2024-02-21T23:10:35.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.417+0000 7f635fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6368187110 0x7f6368220140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:35.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.417+0000 7f6366a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63680fa750 0x7f636806eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:35.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.417+0000 7f6366a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63680fa750 0x7f636806eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:48718/0 (socket says 172.21.15.99:48718) 2024-02-21T23:10:35.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.417+0000 7f6366a00640 1 -- 172.21.15.99:0/595663278 learned_addr learned my addr 172.21.15.99:0/595663278 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:10:35.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.417+0000 7f6367400640 1 --2- 172.21.15.99:0/595663278 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f636818c250 0x7f6368171560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:35.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.418+0000 7f6366a00640 1 -- 172.21.15.99:0/595663278 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f636818c250 msgr2=0x7f6368171560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:35.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.418+0000 7f6366a00640 1 --2- 172.21.15.99:0/595663278 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f636818c250 0x7f6368171560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.418+0000 7f6366a00640 1 -- 172.21.15.99:0/595663278 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6368187110 msgr2=0x7f6368220140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:35.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.418+0000 7f6366a00640 1 --2- 172.21.15.99:0/595663278 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6368187110 0x7f6368220140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.418+0000 7f6366a00640 1 -- 172.21.15.99:0/595663278 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f636806d4e0 con 0x7f63680fa750 2024-02-21T23:10:35.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.418+0000 7f6366a00640 1 --2- 172.21.15.99:0/595663278 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63680fa750 0x7f636806eb40 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f635800e960 tx=0x7f635800ee20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:35.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.418+0000 7f635ea00640 1 -- 172.21.15.99:0/595663278 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6358017070 con 0x7f63680fa750 2024-02-21T23:10:35.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.418+0000 7f635ea00640 1 -- 172.21.15.99:0/595663278 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f635800ca00 con 0x7f63680fa750 2024-02-21T23:10:35.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.418+0000 7f636d600640 1 -- 172.21.15.99:0/595663278 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f636806d7c0 con 0x7f63680fa750 2024-02-21T23:10:35.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.418+0000 7f635ea00640 1 -- 172.21.15.99:0/595663278 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f635800cdd0 con 0x7f63680fa750 2024-02-21T23:10:35.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.419+0000 7f636d600640 1 -- 172.21.15.99:0/595663278 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f636806dd80 con 0x7f63680fa750 2024-02-21T23:10:35.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.423+0000 7f635ea00640 1 -- 172.21.15.99:0/595663278 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f635801a070 con 0x7f63680fa750 2024-02-21T23:10:35.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.424+0000 7f635ea00640 1 --2- 172.21.15.99:0/595663278 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f634409ef50 0x7f63440a1410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:35.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.424+0000 7f635ea00640 1 -- 172.21.15.99:0/595663278 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f63580ca0c0 con 0x7f63680fa750 2024-02-21T23:10:35.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.424+0000 7f63705d1740 1 Processor -- start 2024-02-21T23:10:35.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.425+0000 7f635fe00640 1 --2- 172.21.15.99:0/595663278 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f634409ef50 0x7f63440a1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:35.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.425+0000 7f63705d1740 1 -- start start 2024-02-21T23:10:35.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.425+0000 7f635fe00640 1 --2- 172.21.15.99:0/595663278 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f634409ef50 0x7f63440a1410 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6350036000 tx=0x7f6350008030 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:35.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.427+0000 7f63705d1740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561ea429f4b0 0x561ea429f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:35.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.427+0000 7f63705d1740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561ea42da180 0x561ea42da600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:35.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.427+0000 7f63705d1740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561ea42dab40 0x561ea42db3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:35.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.427+0000 7f63705d1740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ea41c7b50 con 0x561ea42dab40 2024-02-21T23:10:35.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.427+0000 7f63705d1740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ea4170da0 con 0x561ea429f4b0 2024-02-21T23:10:35.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.427+0000 7f63705d1740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ea41c3bf0 con 0x561ea42da180 2024-02-21T23:10:35.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.427+0000 7f635fe00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561ea42da180 0x561ea42da600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:35.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.427+0000 7f635fe00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561ea42da180 0x561ea42da600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:55884/0 (socket says 172.21.15.99:55884) 2024-02-21T23:10:35.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.427+0000 7f635fe00640 1 -- 172.21.15.99:0/1899113359 learned_addr learned my addr 172.21.15.99:0/1899113359 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:10:35.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.427+0000 7f6366a00640 1 --2- 172.21.15.99:0/1899113359 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561ea429f4b0 0x561ea429f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:35.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.427+0000 7f6367400640 1 --2- 172.21.15.99:0/1899113359 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561ea42dab40 0x561ea42db3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:35.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.427+0000 7f635fe00640 1 -- 172.21.15.99:0/1899113359 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561ea429f4b0 msgr2=0x561ea429f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:35.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.427+0000 7f635fe00640 1 --2- 172.21.15.99:0/1899113359 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561ea429f4b0 0x561ea429f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.427+0000 7f635fe00640 1 -- 172.21.15.99:0/1899113359 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561ea42dab40 msgr2=0x561ea42db3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:35.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.427+0000 7f635fe00640 1 --2- 172.21.15.99:0/1899113359 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561ea42dab40 0x561ea42db3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.427+0000 7f635fe00640 1 -- 172.21.15.99:0/1899113359 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561ea4193f80 con 0x561ea42da180 2024-02-21T23:10:35.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.427+0000 7f6367400640 1 --2- 172.21.15.99:0/1899113359 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561ea42dab40 0x561ea42db3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:10:35.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.428+0000 7f635fe00640 1 --2- 172.21.15.99:0/1899113359 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561ea42da180 0x561ea42da600 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f6350009860 tx=0x7f6350030000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f4b82c66fc0251a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:35.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.428+0000 7f6357000640 1 -- 172.21.15.99:0/1899113359 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6350031660 con 0x561ea42da180 2024-02-21T23:10:35.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.428+0000 7f6357000640 1 -- 172.21.15.99:0/1899113359 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6350037040 con 0x561ea42da180 2024-02-21T23:10:35.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.428+0000 7f6357000640 1 -- 172.21.15.99:0/1899113359 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6350031a00 con 0x561ea42da180 2024-02-21T23:10:35.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.429+0000 7f63705d1740 1 -- 172.21.15.99:0/1899113359 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561ea42da180 msgr2=0x561ea42da600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:35.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.429+0000 7f63705d1740 1 --2- 172.21.15.99:0/1899113359 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561ea42da180 0x561ea42da600 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f6350009860 tx=0x7f6350030000 comp rx=0 tx=0).stop 2024-02-21T23:10:35.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.429+0000 7f63705d1740 1 -- 172.21.15.99:0/1899113359 shutdown_connections 2024-02-21T23:10:35.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.429+0000 7f63705d1740 1 --2- 172.21.15.99:0/1899113359 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561ea42dab40 0x561ea42db3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.429+0000 7f63705d1740 1 --2- 172.21.15.99:0/1899113359 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561ea42da180 0x561ea42da600 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.429+0000 7f63705d1740 1 --2- 172.21.15.99:0/1899113359 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561ea429f4b0 0x561ea429f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.429+0000 7f63705d1740 1 -- 172.21.15.99:0/1899113359 >> 172.21.15.99:0/1899113359 conn(0x561ea4261520 msgr2=0x561ea42625a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:10:35.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.429+0000 7f63705d1740 1 -- 172.21.15.99:0/1899113359 shutdown_connections 2024-02-21T23:10:35.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.429+0000 7f63705d1740 1 -- 172.21.15.99:0/1899113359 wait complete. 2024-02-21T23:10:35.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.431+0000 7f63705d1740 1 -- start start 2024-02-21T23:10:35.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.431+0000 7f63705d1740 1 Processor -- start 2024-02-21T23:10:35.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.433+0000 7f63705d1740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561ea42da180 0x561ea42cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:35.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.433+0000 7f63705d1740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561ea42dab40 0x561ea42e1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:35.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.433+0000 7f63705d1740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561ea42d3b90 0x561ea42e3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:35.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.433+0000 7f63705d1740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ea42d8ef0 con 0x561ea42dab40 2024-02-21T23:10:35.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.433+0000 7f63705d1740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ea4166380 con 0x561ea42da180 2024-02-21T23:10:35.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.433+0000 7f63705d1740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ea42d8c10 con 0x561ea42d3b90 2024-02-21T23:10:35.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.433+0000 7f63705d1740 10 client.0 _ll_register_callbacks cb 0x561ea41bf280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:10:35.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.434+0000 7f6366a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561ea42da180 0x561ea42cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:35.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.434+0000 7f6366a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561ea42da180 0x561ea42cf720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:48732/0 (socket says 172.21.15.99:48732) 2024-02-21T23:10:35.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.434+0000 7f6366a00640 1 -- 172.21.15.99:0/2577900070 learned_addr learned my addr 172.21.15.99:0/2577900070 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:10:35.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.434+0000 7f635fe00640 1 --2- 172.21.15.99:0/2577900070 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561ea42dab40 0x561ea42e1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:35.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.434+0000 7f6367400640 1 --2- 172.21.15.99:0/2577900070 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561ea42d3b90 0x561ea42e3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:35.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.434+0000 7f6366a00640 1 -- 172.21.15.99:0/2577900070 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561ea42d3b90 msgr2=0x561ea42e3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:35.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.434+0000 7f6366a00640 1 --2- 172.21.15.99:0/2577900070 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561ea42d3b90 0x561ea42e3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.434+0000 7f6366a00640 1 -- 172.21.15.99:0/2577900070 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561ea42dab40 msgr2=0x561ea42e1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:35.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.434+0000 7f6366a00640 1 --2- 172.21.15.99:0/2577900070 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561ea42dab40 0x561ea42e1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.434+0000 7f6366a00640 1 -- 172.21.15.99:0/2577900070 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561ea418ec20 con 0x561ea42da180 2024-02-21T23:10:35.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.435+0000 7f6366a00640 1 --2- 172.21.15.99:0/2577900070 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561ea42da180 0x561ea42cf720 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f63580976c0 tx=0x7f635809bb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b9eecee2f2f9af6 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:35.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.435+0000 7f634b400640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-02-21T23:10:35.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.435+0000 7f634b400640 1 -- 172.21.15.99:0/2577900070 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6358021040 con 0x561ea42da180 2024-02-21T23:10:35.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.435+0000 7f634b400640 1 -- 172.21.15.99:0/2577900070 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(36..36 src has 1..36) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f6358097010 con 0x561ea42da180 2024-02-21T23:10:35.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.435+0000 7f63705d1740 1 -- 172.21.15.99:0/2577900070 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6350037040 con 0x561ea42da180 2024-02-21T23:10:35.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.435+0000 7f634b400640 1 -- 172.21.15.99:0/2577900070 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f63580b6040 con 0x561ea42da180 2024-02-21T23:10:35.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.435+0000 7f63705d1740 10 client.6910 fetch_fsmap learned FSMap version 17 2024-02-21T23:10:35.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.435+0000 7f63705d1740 1 -- 172.21.15.99:0/2577900070 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x561ea3edc3f0 con 0x561ea42da180 2024-02-21T23:10:35.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.435+0000 7f634b400640 1 -- 172.21.15.99:0/2577900070 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6350037040 con 0x561ea42da180 2024-02-21T23:10:35.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.436+0000 7f634b400640 1 -- 172.21.15.99:0/2577900070 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f63580c71a0 con 0x561ea42da180 2024-02-21T23:10:35.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.436+0000 7f63705d1740 10 client.6910 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:10:35.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.436+0000 7f63705d1740 10 client.6910 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2024-02-21T23:10:35.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.436+0000 7f63705d1740 20 client.6910 populate_metadata read hostname 'smithi099' 2024-02-21T23:10:35.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.436+0000 7f63705d1740 1 --2- 172.21.15.99:0/2577900070 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x561ea42e4210 0x561ea42a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:35.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.436+0000 7f63705d1740 4 client.6910 mds_command: new command op to 4352 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:10:35.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.436+0000 7f63705d1740 1 -- 172.21.15.99:0/2577900070 --> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561ea41d5090 con 0x561ea42e4210 2024-02-21T23:10:35.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.436+0000 7f635fe00640 1 --2- 172.21.15.99:0/2577900070 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x561ea42e4210 0x561ea42a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:35.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.437+0000 7f635fe00640 1 --2- 172.21.15.99:0/2577900070 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x561ea42e4210 0x561ea42a36c0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=30e4f72fccadb954 server_cookie=587edd51ffee5113 in_seq=0 out_seq=0 2024-02-21T23:10:35.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.437+0000 7f634b400640 10 client.6910 ms_handle_connect on v2:172.21.15.99:6836/1676159950 2024-02-21T23:10:35.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.437+0000 7f634b400640 1 -- 172.21.15.99:0/2577900070 <== mds.1 v2:172.21.15.99:6836/1676159950 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x561ea41d5090 con 0x561ea42e4210 2024-02-21T23:10:35.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.437+0000 7f634b400640 10 client.6910 handle_command_reply: tid=0 2024-02-21T23:10:35.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.437+0000 7f63705d1740 1 client.6910 shutdown 2024-02-21T23:10:35.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.438+0000 7f63705d1740 1 -- 172.21.15.99:0/2577900070 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561ea42da180 msgr2=0x561ea42cf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:35.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.438+0000 7f63705d1740 1 --2- 172.21.15.99:0/2577900070 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561ea42da180 0x561ea42cf720 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f63580976c0 tx=0x7f635809bb20 comp rx=0 tx=0).stop 2024-02-21T23:10:35.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.438+0000 7f63705d1740 1 -- 172.21.15.99:0/2577900070 shutdown_connections 2024-02-21T23:10:35.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.438+0000 7f63705d1740 1 --2- 172.21.15.99:0/2577900070 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x561ea42e4210 0x561ea42a36c0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.438+0000 7f63705d1740 1 --2- 172.21.15.99:0/2577900070 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561ea42d3b90 0x561ea42e3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.438+0000 7f63705d1740 1 --2- 172.21.15.99:0/2577900070 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561ea42dab40 0x561ea42e1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.438+0000 7f634b400640 0 client.6910 ms_handle_reset on v2:172.21.15.99:6836/1676159950 2024-02-21T23:10:35.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.438+0000 7f63705d1740 1 --2- 172.21.15.99:0/2577900070 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561ea42da180 0x561ea42cf720 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.438+0000 7f63705d1740 1 -- 172.21.15.99:0/2577900070 >> 172.21.15.99:0/2577900070 conn(0x561ea429f4b0 msgr2=0x561ea42d8430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:10:35.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.438+0000 7f63705d1740 1 -- 172.21.15.99:0/2577900070 shutdown_connections 2024-02-21T23:10:35.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.438+0000 7f63705d1740 1 -- 172.21.15.99:0/2577900070 wait complete. 2024-02-21T23:10:35.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.438+0000 7f63705d1740 20 client.6910 trim_cache size 0 max 16384 2024-02-21T23:10:35.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.452+0000 7f63705d1740 1 Processor -- start 2024-02-21T23:10:35.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.452+0000 7f63705d1740 1 -- start start 2024-02-21T23:10:35.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.453+0000 7f63705d1740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561ea42d3b90 0x561ea4336e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:35.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.453+0000 7f63705d1740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561ea42da180 0x561ea4337340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:35.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.453+0000 7f63705d1740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561ea42dab40 0x561ea425ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:35.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.453+0000 7f63705d1740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6368228570 con 0x561ea42da180 2024-02-21T23:10:35.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.453+0000 7f63705d1740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63680e6c60 con 0x561ea42d3b90 2024-02-21T23:10:35.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.453+0000 7f63705d1740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63680e4d40 con 0x561ea42dab40 2024-02-21T23:10:35.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.453+0000 7f635fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561ea42da180 0x561ea4337340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:35.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.453+0000 7f635fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561ea42da180 0x561ea4337340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:57924/0 (socket says 172.21.15.99:57924) 2024-02-21T23:10:35.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.453+0000 7f635fe00640 1 -- 172.21.15.99:0/3055644807 learned_addr learned my addr 172.21.15.99:0/3055644807 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:10:35.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.453+0000 7f6367400640 1 --2- 172.21.15.99:0/3055644807 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561ea42dab40 0x561ea425ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:35.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.454+0000 7f6366a00640 1 --2- 172.21.15.99:0/3055644807 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561ea42d3b90 0x561ea4336e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:35.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.454+0000 7f6367400640 1 -- 172.21.15.99:0/3055644807 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561ea42d3b90 msgr2=0x561ea4336e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:35.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.454+0000 7f6367400640 1 --2- 172.21.15.99:0/3055644807 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561ea42d3b90 0x561ea4336e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.454+0000 7f6367400640 1 -- 172.21.15.99:0/3055644807 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561ea42da180 msgr2=0x561ea4337340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:35.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.454+0000 7f6367400640 1 --2- 172.21.15.99:0/3055644807 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561ea42da180 0x561ea4337340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.454+0000 7f6367400640 1 -- 172.21.15.99:0/3055644807 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561ea3fa67d0 con 0x561ea42dab40 2024-02-21T23:10:35.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.454+0000 7f6367400640 1 --2- 172.21.15.99:0/3055644807 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561ea42dab40 0x561ea425ec80 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x561ea42a8130 tx=0x7f6360001db0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=485364c994af8f88 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:35.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.455+0000 7f6356600640 1 -- 172.21.15.99:0/3055644807 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f636001a070 con 0x561ea42dab40 2024-02-21T23:10:35.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.455+0000 7f6356600640 1 -- 172.21.15.99:0/3055644807 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6360007590 con 0x561ea42dab40 2024-02-21T23:10:35.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.455+0000 7f6356600640 1 -- 172.21.15.99:0/3055644807 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6360007960 con 0x561ea42dab40 2024-02-21T23:10:35.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.455+0000 7f63705d1740 1 -- 172.21.15.99:0/3055644807 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561ea42dab40 msgr2=0x561ea425ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:35.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.455+0000 7f63705d1740 1 --2- 172.21.15.99:0/3055644807 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561ea42dab40 0x561ea425ec80 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x561ea42a8130 tx=0x7f6360001db0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.455+0000 7f63705d1740 1 -- 172.21.15.99:0/3055644807 shutdown_connections 2024-02-21T23:10:35.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.455+0000 7f63705d1740 1 --2- 172.21.15.99:0/3055644807 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561ea42dab40 0x561ea425ec80 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.455+0000 7f63705d1740 1 --2- 172.21.15.99:0/3055644807 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561ea42da180 0x561ea4337340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.455+0000 7f63705d1740 1 --2- 172.21.15.99:0/3055644807 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561ea42d3b90 0x561ea4336e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.455+0000 7f63705d1740 1 -- 172.21.15.99:0/3055644807 >> 172.21.15.99:0/3055644807 conn(0x561ea429f4b0 msgr2=0x561ea42e3380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:10:35.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.456+0000 7f63705d1740 1 -- 172.21.15.99:0/3055644807 shutdown_connections 2024-02-21T23:10:35.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.456+0000 7f63705d1740 1 -- 172.21.15.99:0/3055644807 wait complete. 2024-02-21T23:10:35.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.457+0000 7f63705d1740 1 -- start start 2024-02-21T23:10:35.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.457+0000 7f63705d1740 1 Processor -- start 2024-02-21T23:10:35.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.459+0000 7f63705d1740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561ea42d3b90 0x561ea42da5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:35.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.459+0000 7f63705d1740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561ea42da180 0x561ea42a8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:35.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.459+0000 7f63705d1740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561ea42dab40 0x561ea4331bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:35.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.459+0000 7f63705d1740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63680e5340 con 0x561ea42da180 2024-02-21T23:10:35.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.459+0000 7f63705d1740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63680e6600 con 0x561ea42dab40 2024-02-21T23:10:35.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.459+0000 7f63705d1740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63680e5940 con 0x561ea42d3b90 2024-02-21T23:10:35.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.459+0000 7f63705d1740 10 client.0 _ll_register_callbacks cb 0x7f63580975d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:10:35.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.460+0000 7f635fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561ea42da180 0x561ea42a8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:35.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.460+0000 7f635fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561ea42da180 0x561ea42a8ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:57934/0 (socket says 172.21.15.99:57934) 2024-02-21T23:10:35.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.460+0000 7f635fe00640 1 -- 172.21.15.99:0/1229939674 learned_addr learned my addr 172.21.15.99:0/1229939674 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:10:35.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.460+0000 7f6366a00640 1 --2- 172.21.15.99:0/1229939674 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561ea42d3b90 0x561ea42da5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:35.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.460+0000 7f6367400640 1 --2- 172.21.15.99:0/1229939674 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561ea42dab40 0x561ea4331bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:35.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.460+0000 7f6366a00640 1 -- 172.21.15.99:0/1229939674 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561ea42dab40 msgr2=0x561ea4331bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:35.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.460+0000 7f6366a00640 1 --2- 172.21.15.99:0/1229939674 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561ea42dab40 0x561ea4331bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.460+0000 7f6366a00640 1 -- 172.21.15.99:0/1229939674 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561ea42da180 msgr2=0x561ea42a8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:35.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.460+0000 7f6366a00640 1 --2- 172.21.15.99:0/1229939674 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561ea42da180 0x561ea42a8ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.460+0000 7f6366a00640 1 -- 172.21.15.99:0/1229939674 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561ea42a7a00 con 0x561ea42d3b90 2024-02-21T23:10:35.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.460+0000 7f635fe00640 1 --2- 172.21.15.99:0/1229939674 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561ea42da180 0x561ea42a8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:10:35.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.460+0000 7f6366a00640 1 --2- 172.21.15.99:0/1229939674 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561ea42d3b90 0x561ea42da5c0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f6358094340 tx=0x7f6358000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b346859de8c53ec1 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:35.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.460+0000 7f634b400640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-02-21T23:10:35.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.461+0000 7f634b400640 1 -- 172.21.15.99:0/1229939674 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6358021070 con 0x561ea42d3b90 2024-02-21T23:10:35.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.461+0000 7f634b400640 1 -- 172.21.15.99:0/1229939674 <== mon.2 v2:172.21.15.181:3300/0 2 ==== osd_map(36..36 src has 1..36) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f6358096e10 con 0x561ea42d3b90 2024-02-21T23:10:35.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.461+0000 7f63705d1740 1 -- 172.21.15.99:0/1229939674 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6360007590 con 0x561ea42d3b90 2024-02-21T23:10:35.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.461+0000 7f634b400640 1 -- 172.21.15.99:0/1229939674 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f63580c7ae0 con 0x561ea42d3b90 2024-02-21T23:10:35.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.461+0000 7f63705d1740 10 client.6872 fetch_fsmap learned FSMap version 17 2024-02-21T23:10:35.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.461+0000 7f63705d1740 1 -- 172.21.15.99:0/1229939674 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x561ea42ccad0 con 0x561ea42d3b90 2024-02-21T23:10:35.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.461+0000 7f634b400640 1 -- 172.21.15.99:0/1229939674 <== mon.2 v2:172.21.15.181:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6360007590 con 0x561ea42d3b90 2024-02-21T23:10:35.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.461+0000 7f634b400640 1 -- 172.21.15.99:0/1229939674 <== mon.2 v2:172.21.15.181:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f6358093710 con 0x561ea42d3b90 2024-02-21T23:10:35.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.461+0000 7f63705d1740 10 client.6872 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:10:35.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.461+0000 7f63705d1740 10 client.6872 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2024-02-21T23:10:35.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.461+0000 7f63705d1740 20 client.6872 populate_metadata read hostname 'smithi099' 2024-02-21T23:10:35.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.461+0000 7f63705d1740 1 --2- 172.21.15.99:0/1229939674 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x561ea42625f0 0x561ea43320f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:35.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.461+0000 7f63705d1740 4 client.6872 mds_command: new command op to 4352 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T23:10:35.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.461+0000 7f63705d1740 1 -- 172.21.15.99:0/1229939674 --> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x561ea41cf3e0 con 0x561ea42625f0 2024-02-21T23:10:35.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.462+0000 7f635fe00640 1 --2- 172.21.15.99:0/1229939674 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x561ea42625f0 0x561ea43320f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:35.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.462+0000 7f635fe00640 1 --2- 172.21.15.99:0/1229939674 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x561ea42625f0 0x561ea43320f0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=10086ba271839692 server_cookie=ba282f0edfb5137a in_seq=0 out_seq=0 2024-02-21T23:10:35.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.462+0000 7f634b400640 10 client.6872 ms_handle_connect on v2:172.21.15.99:6836/1676159950 2024-02-21T23:10:35.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.462+0000 7f634b400640 1 -- 172.21.15.99:0/1229939674 <== mds.1 v2:172.21.15.99:6836/1676159950 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x561ea41cf3e0 con 0x561ea42625f0 2024-02-21T23:10:35.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.462+0000 7f634b400640 10 client.6872 handle_command_reply: tid=0 2024-02-21T23:10:35.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.462+0000 7f63705d1740 1 client.6872 shutdown 2024-02-21T23:10:35.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.463+0000 7f63705d1740 1 -- 172.21.15.99:0/1229939674 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561ea42d3b90 msgr2=0x561ea42da5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:35.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.463+0000 7f63705d1740 1 --2- 172.21.15.99:0/1229939674 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561ea42d3b90 0x561ea42da5c0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f6358094340 tx=0x7f6358000bc0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.463+0000 7f63705d1740 1 -- 172.21.15.99:0/1229939674 shutdown_connections 2024-02-21T23:10:35.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.463+0000 7f63705d1740 1 --2- 172.21.15.99:0/1229939674 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x561ea42625f0 0x561ea43320f0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.463+0000 7f63705d1740 1 --2- 172.21.15.99:0/1229939674 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561ea42dab40 0x561ea4331bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.463+0000 7f63705d1740 1 --2- 172.21.15.99:0/1229939674 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561ea42da180 0x561ea42a8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.463+0000 7f63705d1740 1 --2- 172.21.15.99:0/1229939674 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561ea42d3b90 0x561ea42da5c0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.463+0000 7f634b400640 0 client.6872 ms_handle_reset on v2:172.21.15.99:6836/1676159950 2024-02-21T23:10:35.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.463+0000 7f63705d1740 1 -- 172.21.15.99:0/1229939674 >> 172.21.15.99:0/1229939674 conn(0x561ea429f4b0 msgr2=0x561ea42e3380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:10:35.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.463+0000 7f63705d1740 1 -- 172.21.15.99:0/1229939674 shutdown_connections 2024-02-21T23:10:35.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.463+0000 7f63705d1740 1 -- 172.21.15.99:0/1229939674 wait complete. 2024-02-21T23:10:35.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.463+0000 7f63705d1740 20 client.6872 trim_cache size 0 max 16384 2024-02-21T23:10:35.458 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-02-21T23:10:35.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.464+0000 7f636d600640 1 -- 172.21.15.99:0/595663278 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f634409ef50 msgr2=0x7f63440a1410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:35.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.464+0000 7f636d600640 1 --2- 172.21.15.99:0/595663278 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f634409ef50 0x7f63440a1410 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6350036000 tx=0x7f6350008030 comp rx=0 tx=0).stop 2024-02-21T23:10:35.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.464+0000 7f636d600640 1 -- 172.21.15.99:0/595663278 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63680fa750 msgr2=0x7f636806eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:35.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.464+0000 7f636d600640 1 --2- 172.21.15.99:0/595663278 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63680fa750 0x7f636806eb40 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f635800e960 tx=0x7f635800ee20 comp rx=0 tx=0).stop 2024-02-21T23:10:35.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.464+0000 7f636d600640 1 -- 172.21.15.99:0/595663278 shutdown_connections 2024-02-21T23:10:35.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.464+0000 7f636d600640 1 --2- 172.21.15.99:0/595663278 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f634409ef50 0x7f63440a1410 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.464+0000 7f636d600640 1 --2- 172.21.15.99:0/595663278 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f636818c250 0x7f6368171560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.464+0000 7f636d600640 1 --2- 172.21.15.99:0/595663278 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6368187110 0x7f6368220140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.464+0000 7f636d600640 1 --2- 172.21.15.99:0/595663278 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63680fa750 0x7f636806eb40 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.464+0000 7f636d600640 1 -- 172.21.15.99:0/595663278 >> 172.21.15.99:0/595663278 conn(0x7f63680f8d90 msgr2=0x7f636808e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:10:35.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.464+0000 7f636d600640 1 -- 172.21.15.99:0/595663278 shutdown_connections 2024-02-21T23:10:35.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.464+0000 7f636d600640 1 -- 172.21.15.99:0/595663278 wait complete. 2024-02-21T23:10:35.473 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T23:10:35.473 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-02-21T23:10:35.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.674+0000 7f25ea400640 1 Processor -- start 2024-02-21T23:10:35.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.674+0000 7f25ea400640 1 -- start start 2024-02-21T23:10:35.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.677+0000 7f25ea400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f25e40fb650 0x7f25e406b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:35.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.677+0000 7f25ea400640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25e417f980 con 0x7f25e4188b30 2024-02-21T23:10:35.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.677+0000 7f25ea400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25e40fa2d0 con 0x7f25e406b980 2024-02-21T23:10:35.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.677+0000 7f25ea400640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25e40fbab0 con 0x7f25e40fb650 2024-02-21T23:10:35.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.677+0000 7f25e9000640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f25e4188b30 0x7f25e4186a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:40548/0 (socket says 172.21.15.99:40548) 2024-02-21T23:10:35.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.677+0000 7f25e9000640 1 -- 172.21.15.99:0/1733634612 learned_addr learned my addr 172.21.15.99:0/1733634612 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:10:35.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.677+0000 7f25e3e00640 1 --2- 172.21.15.99:0/1733634612 >> v2:172.21.15.99:3300/0 conn(0x7f25e40fb650 0x7f25e406b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:35.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.678+0000 7f25e3e00640 1 -- 172.21.15.99:0/1733634612 >> v1:172.21.15.162:6789/0 conn(0x7f25e406b980 legacy=0x7f25e4188f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:35.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.678+0000 7f25e3e00640 1 -- 172.21.15.99:0/1733634612 >> v1:172.21.15.99:6789/0 conn(0x7f25e4188b30 legacy=0x7f25e4186a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:35.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.678+0000 7f25e3400640 1 -- 172.21.15.99:0/1733634612 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 617037725 0 0) 0x7f25e417f980 con 0x7f25e4188b30 2024-02-21T23:10:35.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.678+0000 7f25e3e00640 1 -- 172.21.15.99:0/1733634612 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25e40fa5b0 con 0x7f25e40fb650 2024-02-21T23:10:35.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.680+0000 7f25e3e00640 1 --2- 172.21.15.99:0/1733634612 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f25e40fb650 0x7f25e406b440 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f25d0009720 tx=0x7f25d002b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=752596ce990b0399 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:35.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.680+0000 7f25e3400640 1 -- 172.21.15.99:0/1733634612 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d0037070 con 0x7f25e40fb650 2024-02-21T23:10:35.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.680+0000 7f25e3400640 1 -- 172.21.15.99:0/1733634612 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25d0030710 con 0x7f25e40fb650 2024-02-21T23:10:35.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.680+0000 7f25e3400640 1 -- 172.21.15.99:0/1733634612 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d0030ae0 con 0x7f25e40fb650 2024-02-21T23:10:35.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.681+0000 7f25ea400640 1 -- 172.21.15.99:0/1733634612 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f25e40fb650 msgr2=0x7f25e406b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:35.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.681+0000 7f25ea400640 1 --2- 172.21.15.99:0/1733634612 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f25e40fb650 0x7f25e406b440 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f25d0009720 tx=0x7f25d002b6a0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.681+0000 7f25ea400640 1 -- 172.21.15.99:0/1733634612 shutdown_connections 2024-02-21T23:10:35.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.681+0000 7f25ea400640 1 --2- 172.21.15.99:0/1733634612 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f25e40fb650 0x7f25e406b440 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.681+0000 7f25ea400640 1 -- 172.21.15.99:0/1733634612 >> 172.21.15.99:0/1733634612 conn(0x7f25e40f8cb0 msgr2=0x7f25e40f90c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:10:35.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.681+0000 7f25ea400640 1 -- 172.21.15.99:0/1733634612 shutdown_connections 2024-02-21T23:10:35.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.681+0000 7f25ea400640 1 -- 172.21.15.99:0/1733634612 wait complete. 2024-02-21T23:10:35.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.683+0000 7f25ea400640 1 Processor -- start 2024-02-21T23:10:35.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.683+0000 7f25ea400640 1 -- start start 2024-02-21T23:10:35.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.684+0000 7f25ea400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f25e406b980 0x7f25e4188310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:35.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.684+0000 7f25ea400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f25e40fb650 0x7f25e4220620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:35.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.685+0000 7f25ea400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f25e4188b30 0x7f25e41625b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:35.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.685+0000 7f25ea400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e40fae50 con 0x7f25e40fb650 2024-02-21T23:10:35.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.685+0000 7f25ea400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e40fab70 con 0x7f25e4188b30 2024-02-21T23:10:35.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.685+0000 7f25ea400640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e40fb130 con 0x7f25e406b980 2024-02-21T23:10:35.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.685+0000 7f25e3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f25e40fb650 0x7f25e4220620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:35.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.685+0000 7f25e3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f25e40fb650 0x7f25e4220620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:57958/0 (socket says 172.21.15.99:57958) 2024-02-21T23:10:35.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.685+0000 7f25e3e00640 1 -- 172.21.15.99:0/984871549 learned_addr learned my addr 172.21.15.99:0/984871549 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:10:35.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.685+0000 7f25e9000640 1 --2- 172.21.15.99:0/984871549 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f25e406b980 0x7f25e4188310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:35.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.685+0000 7f25e9a00640 1 --2- 172.21.15.99:0/984871549 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f25e4188b30 0x7f25e41625b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:35.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.685+0000 7f25e3e00640 1 -- 172.21.15.99:0/984871549 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f25e406b980 msgr2=0x7f25e4188310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:35.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.685+0000 7f25e3e00640 1 --2- 172.21.15.99:0/984871549 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f25e406b980 0x7f25e4188310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.685+0000 7f25e3e00640 1 -- 172.21.15.99:0/984871549 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f25e4188b30 msgr2=0x7f25e41625b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:35.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.685+0000 7f25e3e00640 1 --2- 172.21.15.99:0/984871549 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f25e4188b30 0x7f25e41625b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.685+0000 7f25e3e00640 1 -- 172.21.15.99:0/984871549 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25e418b080 con 0x7f25e40fb650 2024-02-21T23:10:35.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.686+0000 7f25e3e00640 1 --2- 172.21.15.99:0/984871549 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f25e40fb650 0x7f25e4220620 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f25d0009840 tx=0x7f25d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:35.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.686+0000 7f25e0c00640 1 -- 172.21.15.99:0/984871549 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d0042070 con 0x7f25e40fb650 2024-02-21T23:10:35.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.686+0000 7f25e0c00640 1 -- 172.21.15.99:0/984871549 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25d0032a40 con 0x7f25e40fb650 2024-02-21T23:10:35.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.686+0000 7f25e0c00640 1 -- 172.21.15.99:0/984871549 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d0037040 con 0x7f25e40fb650 2024-02-21T23:10:35.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.686+0000 7f25ea400640 1 -- 172.21.15.99:0/984871549 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25e4187270 con 0x7f25e40fb650 2024-02-21T23:10:35.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.686+0000 7f25ea400640 1 -- 172.21.15.99:0/984871549 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25e4187830 con 0x7f25e40fb650 2024-02-21T23:10:35.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.691+0000 7f25ee85f740 1 Processor -- start 2024-02-21T23:10:35.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.691+0000 7f25ee85f740 1 -- start start 2024-02-21T23:10:35.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.691+0000 7f25e0c00640 1 -- 172.21.15.99:0/984871549 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f25d0045070 con 0x7f25e40fb650 2024-02-21T23:10:35.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.692+0000 7f25ee85f740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f2e3afe660 0x55f2e3afea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:35.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.692+0000 7f25ee85f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f2e3b39330 0x55f2e3b397b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:35.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.692+0000 7f25ee85f740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f2e3b39cf0 0x55f2e3b3a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:35.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.692+0000 7f25ee85f740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2e3a26b50 con 0x55f2e3afe660 2024-02-21T23:10:35.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.692+0000 7f25ee85f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2e39cfda0 con 0x55f2e3b39330 2024-02-21T23:10:35.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.692+0000 7f25ee85f740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2e3a22bf0 con 0x55f2e3b39cf0 2024-02-21T23:10:35.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.693+0000 7f25e9a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f2e3afe660 0x55f2e3afea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:35.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.693+0000 7f25e9a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f2e3afe660 0x55f2e3afea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:57964/0 (socket says 172.21.15.99:57964) 2024-02-21T23:10:35.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.693+0000 7f25e9a00640 1 -- 172.21.15.99:0/1499570367 learned_addr learned my addr 172.21.15.99:0/1499570367 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:10:35.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.693+0000 7f25e9000640 1 --2- 172.21.15.99:0/1499570367 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f2e3b39330 0x55f2e3b397b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:35.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.693+0000 7f25e3e00640 1 --2- 172.21.15.99:0/1499570367 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f2e3b39cf0 0x55f2e3b3a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:35.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.693+0000 7f25e9000640 1 -- 172.21.15.99:0/1499570367 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f2e3b39cf0 msgr2=0x55f2e3b3a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:35.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.693+0000 7f25e9000640 1 --2- 172.21.15.99:0/1499570367 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f2e3b39cf0 0x55f2e3b3a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.693+0000 7f25e9000640 1 -- 172.21.15.99:0/1499570367 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f2e3afe660 msgr2=0x55f2e3afea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:35.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.693+0000 7f25e9000640 1 --2- 172.21.15.99:0/1499570367 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f2e3afe660 0x55f2e3afea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.693+0000 7f25e9000640 1 -- 172.21.15.99:0/1499570367 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f2e39f2f80 con 0x55f2e3b39330 2024-02-21T23:10:35.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.693+0000 7f25e3e00640 1 --2- 172.21.15.99:0/1499570367 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f2e3b39cf0 0x55f2e3b3a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:10:35.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.694+0000 7f25e0c00640 1 --2- 172.21.15.99:0/984871549 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f25c409eed0 0x7f25c40a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:35.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.694+0000 7f25e9000640 1 --2- 172.21.15.99:0/1499570367 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f2e3b39330 0x55f2e3b397b0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f25d8007680 tx=0x7f25d8004bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a31a7c55334a2410 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:35.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.694+0000 7f25e0c00640 1 -- 172.21.15.99:0/984871549 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f25d00ebd20 con 0x7f25e40fb650 2024-02-21T23:10:35.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.694+0000 7f25e9a00640 1 --2- 172.21.15.99:0/984871549 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f25c409eed0 0x7f25c40a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:35.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.694+0000 7f25d5600640 1 -- 172.21.15.99:0/1499570367 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d801a070 con 0x55f2e3b39330 2024-02-21T23:10:35.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.694+0000 7f25d5600640 1 -- 172.21.15.99:0/1499570367 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25d80017f0 con 0x55f2e3b39330 2024-02-21T23:10:35.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.694+0000 7f25d5600640 1 -- 172.21.15.99:0/1499570367 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d8001be0 con 0x55f2e3b39330 2024-02-21T23:10:35.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.695+0000 7f25ee85f740 1 -- 172.21.15.99:0/1499570367 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f2e3b39330 msgr2=0x55f2e3b397b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:35.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.695+0000 7f25ee85f740 1 --2- 172.21.15.99:0/1499570367 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f2e3b39330 0x55f2e3b397b0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f25d8007680 tx=0x7f25d8004bb0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.695+0000 7f25e9a00640 1 --2- 172.21.15.99:0/984871549 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f25c409eed0 0x7f25c40a1390 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f25dc002150 tx=0x7f25dc009040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:35.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.695+0000 7f25ee85f740 1 -- 172.21.15.99:0/1499570367 shutdown_connections 2024-02-21T23:10:35.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.695+0000 7f25ee85f740 1 --2- 172.21.15.99:0/1499570367 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f2e3b39cf0 0x55f2e3b3a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.695+0000 7f25ee85f740 1 --2- 172.21.15.99:0/1499570367 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f2e3b39330 0x55f2e3b397b0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.695+0000 7f25ee85f740 1 --2- 172.21.15.99:0/1499570367 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f2e3afe660 0x55f2e3afea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.695+0000 7f25ee85f740 1 -- 172.21.15.99:0/1499570367 >> 172.21.15.99:0/1499570367 conn(0x55f2e3ac06d0 msgr2=0x55f2e3ac1750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:10:35.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.695+0000 7f25ee85f740 1 -- 172.21.15.99:0/1499570367 shutdown_connections 2024-02-21T23:10:35.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.695+0000 7f25ee85f740 1 -- 172.21.15.99:0/1499570367 wait complete. 2024-02-21T23:10:35.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.696+0000 7f25ee85f740 1 -- start start 2024-02-21T23:10:35.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.696+0000 7f25ee85f740 1 Processor -- start 2024-02-21T23:10:35.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.698+0000 7f25ee85f740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f2e3b39330 0x55f2e3b428f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:35.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.698+0000 7f25ee85f740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f2e3b39cf0 0x55f2e3af08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:35.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.698+0000 7f25ee85f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f2e3b43d60 0x55f2e3b36e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:35.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.698+0000 7f25ee85f740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2e3b380a0 con 0x55f2e3b39cf0 2024-02-21T23:10:35.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.698+0000 7f25ee85f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2e39c5380 con 0x55f2e3b43d60 2024-02-21T23:10:35.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.698+0000 7f25ee85f740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2e3b37dc0 con 0x55f2e3b39330 2024-02-21T23:10:35.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.698+0000 7f25ee85f740 10 client.0 _ll_register_callbacks cb 0x55f2e3a1e280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:10:35.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.699+0000 7f25e3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f2e3b39cf0 0x55f2e3af08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:35.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.699+0000 7f25e9000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f2e3b39330 0x55f2e3b428f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:35.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.699+0000 7f25e9000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f2e3b39330 0x55f2e3b428f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:55952/0 (socket says 172.21.15.99:55952) 2024-02-21T23:10:35.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.699+0000 7f25e9000640 1 -- 172.21.15.99:0/95226417 learned_addr learned my addr 172.21.15.99:0/95226417 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:10:35.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.699+0000 7f25e9a00640 1 --2- 172.21.15.99:0/95226417 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f2e3b43d60 0x55f2e3b36e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:35.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.699+0000 7f25e9000640 1 -- 172.21.15.99:0/95226417 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f2e3b43d60 msgr2=0x55f2e3b36e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:35.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.699+0000 7f25e9000640 1 --2- 172.21.15.99:0/95226417 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f2e3b43d60 0x55f2e3b36e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.699+0000 7f25e9000640 1 -- 172.21.15.99:0/95226417 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f2e3b39cf0 msgr2=0x55f2e3af08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:35.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.699+0000 7f25e9000640 1 --2- 172.21.15.99:0/95226417 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f2e3b39cf0 0x55f2e3af08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.699+0000 7f25e9000640 1 -- 172.21.15.99:0/95226417 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f2e39edc20 con 0x55f2e3b39330 2024-02-21T23:10:35.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.699+0000 7f25e9000640 1 --2- 172.21.15.99:0/95226417 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f2e3b39330 0x55f2e3b428f0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f25d80015e0 tx=0x7f25d8000ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46176c123f15cef server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:35.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.699+0000 7f25ca000640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-02-21T23:10:35.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.700+0000 7f25ca000640 1 -- 172.21.15.99:0/95226417 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d8027060 con 0x55f2e3b39330 2024-02-21T23:10:35.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.700+0000 7f25ca000640 1 -- 172.21.15.99:0/95226417 <== mon.2 v2:172.21.15.181:3300/0 2 ==== osd_map(36..36 src has 1..36) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f25d8014860 con 0x55f2e3b39330 2024-02-21T23:10:35.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.700+0000 7f25ee85f740 1 -- 172.21.15.99:0/95226417 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f25d80017f0 con 0x55f2e3b39330 2024-02-21T23:10:35.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.700+0000 7f25ca000640 1 -- 172.21.15.99:0/95226417 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f25d801a040 con 0x55f2e3b39330 2024-02-21T23:10:35.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.700+0000 7f25ee85f740 10 client.6881 fetch_fsmap learned FSMap version 17 2024-02-21T23:10:35.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.700+0000 7f25ee85f740 1 -- 172.21.15.99:0/95226417 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55f2e373b3f0 con 0x55f2e3b39330 2024-02-21T23:10:35.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.700+0000 7f25ca000640 1 -- 172.21.15.99:0/95226417 <== mon.2 v2:172.21.15.181:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25d80017f0 con 0x55f2e3b39330 2024-02-21T23:10:35.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.701+0000 7f25ca000640 1 -- 172.21.15.99:0/95226417 <== mon.2 v2:172.21.15.181:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f25d8020040 con 0x55f2e3b39330 2024-02-21T23:10:35.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.701+0000 7f25ee85f740 10 client.6881 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:10:35.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.701+0000 7f25ee85f740 10 client.6881 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:10:35.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.701+0000 7f25ee85f740 20 client.6881 populate_metadata read hostname 'smithi099' 2024-02-21T23:10:35.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.701+0000 7f25ee85f740 1 --2- 172.21.15.99:0/95226417 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55f2e3aed7d0 0x55f2e3b34710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:35.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.701+0000 7f25ee85f740 4 client.6881 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:10:35.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.701+0000 7f25ee85f740 1 -- 172.21.15.99:0/95226417 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f2e3a34090 con 0x55f2e3aed7d0 2024-02-21T23:10:35.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.701+0000 7f25e3e00640 1 --2- 172.21.15.99:0/95226417 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55f2e3aed7d0 0x55f2e3b34710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:35.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.702+0000 7f25ca000640 10 client.6881 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:10:35.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.702+0000 7f25e3e00640 1 --2- 172.21.15.99:0/95226417 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55f2e3aed7d0 0x55f2e3b34710 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb6cbd25523cb160 server_cookie=ef9ff1c19cf5ae5d in_seq=0 out_seq=0 2024-02-21T23:10:35.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.702+0000 7f25ca000640 1 -- 172.21.15.99:0/95226417 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55f2e3a34090 con 0x55f2e3aed7d0 2024-02-21T23:10:35.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.702+0000 7f25ca000640 10 client.6881 handle_command_reply: tid=0 2024-02-21T23:10:35.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.702+0000 7f25ee85f740 1 client.6881 shutdown 2024-02-21T23:10:35.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.703+0000 7f25ee85f740 1 -- 172.21.15.99:0/95226417 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f2e3b39330 msgr2=0x55f2e3b428f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:35.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.703+0000 7f25ee85f740 1 --2- 172.21.15.99:0/95226417 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f2e3b39330 0x55f2e3b428f0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f25d80015e0 tx=0x7f25d8000ed0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.703+0000 7f25ee85f740 1 -- 172.21.15.99:0/95226417 shutdown_connections 2024-02-21T23:10:35.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.703+0000 7f25ee85f740 1 --2- 172.21.15.99:0/95226417 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55f2e3aed7d0 0x55f2e3b34710 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.703+0000 7f25ee85f740 1 --2- 172.21.15.99:0/95226417 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f2e3b43d60 0x55f2e3b36e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.703+0000 7f25ee85f740 1 --2- 172.21.15.99:0/95226417 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f2e3b39cf0 0x55f2e3af08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.703+0000 7f25ca000640 0 client.6881 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:10:35.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.703+0000 7f25ee85f740 1 --2- 172.21.15.99:0/95226417 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f2e3b39330 0x55f2e3b428f0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.703+0000 7f25ee85f740 1 -- 172.21.15.99:0/95226417 >> 172.21.15.99:0/95226417 conn(0x55f2e3afe660 msgr2=0x55f2e3af4920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:10:35.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.703+0000 7f25ee85f740 1 -- 172.21.15.99:0/95226417 shutdown_connections 2024-02-21T23:10:35.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.703+0000 7f25ee85f740 1 -- 172.21.15.99:0/95226417 wait complete. 2024-02-21T23:10:35.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.703+0000 7f25ee85f740 20 client.6881 trim_cache size 0 max 16384 2024-02-21T23:10:35.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.730+0000 7f25ee85f740 1 Processor -- start 2024-02-21T23:10:35.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.730+0000 7f25ee85f740 1 -- start start 2024-02-21T23:10:35.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.731+0000 7f25ee85f740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f2e3b39330 0x55f2e3af08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:35.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.731+0000 7f25ee85f740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f2e3b39cf0 0x55f2e3b42870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:35.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.731+0000 7f25ee85f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f2e3b43d60 0x55f2e3b9c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:35.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.731+0000 7f25ee85f740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e422c9a0 con 0x55f2e3b39cf0 2024-02-21T23:10:35.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.731+0000 7f25ee85f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e422a540 con 0x55f2e3b43d60 2024-02-21T23:10:35.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.731+0000 7f25ee85f740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e418a9b0 con 0x55f2e3b39330 2024-02-21T23:10:35.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.731+0000 7f25e3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f2e3b39cf0 0x55f2e3b42870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:35.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.731+0000 7f25e3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f2e3b39cf0 0x55f2e3b42870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:57982/0 (socket says 172.21.15.99:57982) 2024-02-21T23:10:35.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.731+0000 7f25e3e00640 1 -- 172.21.15.99:0/3395132977 learned_addr learned my addr 172.21.15.99:0/3395132977 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:10:35.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.731+0000 7f25e9000640 1 --2- 172.21.15.99:0/3395132977 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f2e3b39330 0x55f2e3af08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:35.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.732+0000 7f25e9a00640 1 --2- 172.21.15.99:0/3395132977 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f2e3b43d60 0x55f2e3b9c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:35.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.732+0000 7f25e3e00640 1 -- 172.21.15.99:0/3395132977 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f2e3b39330 msgr2=0x55f2e3af08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:35.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.732+0000 7f25e3e00640 1 --2- 172.21.15.99:0/3395132977 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f2e3b39330 0x55f2e3af08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.732+0000 7f25e3e00640 1 -- 172.21.15.99:0/3395132977 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f2e3b43d60 msgr2=0x55f2e3b9c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:35.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.732+0000 7f25e3e00640 1 --2- 172.21.15.99:0/3395132977 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f2e3b43d60 0x55f2e3b9c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.732+0000 7f25e3e00640 1 -- 172.21.15.99:0/3395132977 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f2e38057d0 con 0x55f2e3b39cf0 2024-02-21T23:10:35.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.732+0000 7f25e9000640 1 --2- 172.21.15.99:0/3395132977 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f2e3b39330 0x55f2e3af08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:10:35.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.732+0000 7f25e9a00640 1 --2- 172.21.15.99:0/3395132977 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f2e3b43d60 0x55f2e3b9c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:10:35.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.732+0000 7f25e3e00640 1 --2- 172.21.15.99:0/3395132977 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f2e3b39cf0 0x55f2e3b42870 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f25d0000c00 tx=0x7f25d00ee1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6019a7cde84a54b8 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:35.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.732+0000 7f25d4c00640 1 -- 172.21.15.99:0/3395132977 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d004c040 con 0x55f2e3b39cf0 2024-02-21T23:10:35.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.732+0000 7f25d4c00640 1 -- 172.21.15.99:0/3395132977 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25d0030710 con 0x55f2e3b39cf0 2024-02-21T23:10:35.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.732+0000 7f25d4c00640 1 -- 172.21.15.99:0/3395132977 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d00b8e70 con 0x55f2e3b39cf0 2024-02-21T23:10:35.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.733+0000 7f25ee85f740 1 -- 172.21.15.99:0/3395132977 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f2e3b39cf0 msgr2=0x55f2e3b42870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:35.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.733+0000 7f25ee85f740 1 --2- 172.21.15.99:0/3395132977 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f2e3b39cf0 0x55f2e3b42870 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f25d0000c00 tx=0x7f25d00ee1e0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.733+0000 7f25ee85f740 1 -- 172.21.15.99:0/3395132977 shutdown_connections 2024-02-21T23:10:35.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.733+0000 7f25ee85f740 1 --2- 172.21.15.99:0/3395132977 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f2e3b43d60 0x55f2e3b9c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.733+0000 7f25ee85f740 1 --2- 172.21.15.99:0/3395132977 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f2e3b39cf0 0x55f2e3b42870 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.733+0000 7f25ee85f740 1 --2- 172.21.15.99:0/3395132977 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f2e3b39330 0x55f2e3af08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.733+0000 7f25ee85f740 1 -- 172.21.15.99:0/3395132977 >> 172.21.15.99:0/3395132977 conn(0x55f2e3afe660 msgr2=0x55f2e3ae38f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:10:35.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.733+0000 7f25ee85f740 1 -- 172.21.15.99:0/3395132977 shutdown_connections 2024-02-21T23:10:35.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.733+0000 7f25ee85f740 1 -- 172.21.15.99:0/3395132977 wait complete. 2024-02-21T23:10:35.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.734+0000 7f25ee85f740 1 -- start start 2024-02-21T23:10:35.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.735+0000 7f25ee85f740 1 Processor -- start 2024-02-21T23:10:35.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.737+0000 7f25ee85f740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f2e3b39330 0x55f2e3b33d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:35.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.737+0000 7f25ee85f740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f2e3b39cf0 0x55f2e3afde30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:35.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.737+0000 7f25ee85f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f2e3b43d60 0x55f2e3b34ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:35.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.737+0000 7f25ee85f740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e4228c50 con 0x55f2e3b39cf0 2024-02-21T23:10:35.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.737+0000 7f25ee85f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e4229ee0 con 0x55f2e3b43d60 2024-02-21T23:10:35.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.737+0000 7f25ee85f740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e4229220 con 0x55f2e3b39330 2024-02-21T23:10:35.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.737+0000 7f25ee85f740 10 client.0 _ll_register_callbacks cb 0x7f25d8018070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:10:35.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.737+0000 7f25e3e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f2e3b39cf0 0x55f2e3afde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:35.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.737+0000 7f25e9000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f2e3b39330 0x55f2e3b33d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:35.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.737+0000 7f25e9000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f2e3b39330 0x55f2e3b33d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:55966/0 (socket says 172.21.15.99:55966) 2024-02-21T23:10:35.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.737+0000 7f25e9000640 1 -- 172.21.15.99:0/3309499868 learned_addr learned my addr 172.21.15.99:0/3309499868 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:10:35.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.737+0000 7f25e9a00640 1 --2- 172.21.15.99:0/3309499868 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f2e3b43d60 0x55f2e3b34ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:35.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.738+0000 7f25e9000640 1 -- 172.21.15.99:0/3309499868 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f2e3b43d60 msgr2=0x55f2e3b34ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:35.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.738+0000 7f25e9000640 1 --2- 172.21.15.99:0/3309499868 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f2e3b43d60 0x55f2e3b34ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.738+0000 7f25e9000640 1 -- 172.21.15.99:0/3309499868 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f2e3b39cf0 msgr2=0x55f2e3afde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:35.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.738+0000 7f25e9000640 1 --2- 172.21.15.99:0/3309499868 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f2e3b39cf0 0x55f2e3afde30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.738+0000 7f25e9000640 1 -- 172.21.15.99:0/3309499868 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f2e3b350e0 con 0x55f2e3b39330 2024-02-21T23:10:35.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.738+0000 7f25e9000640 1 --2- 172.21.15.99:0/3309499868 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f2e3b39330 0x55f2e3b33d00 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f25d802c7b0 tx=0x7f25d8009000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f5e993a39c48f4 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:35.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.738+0000 7f25ca000640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-02-21T23:10:35.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.738+0000 7f25ca000640 1 -- 172.21.15.99:0/3309499868 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d801a040 con 0x55f2e3b39330 2024-02-21T23:10:35.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.738+0000 7f25ee85f740 1 -- 172.21.15.99:0/3309499868 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f25d0030710 con 0x55f2e3b39330 2024-02-21T23:10:35.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.738+0000 7f25ca000640 1 -- 172.21.15.99:0/3309499868 <== mon.2 v2:172.21.15.181:3300/0 2 ==== osd_map(36..36 src has 1..36) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f25d8014860 con 0x55f2e3b39330 2024-02-21T23:10:35.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.739+0000 7f25ca000640 1 -- 172.21.15.99:0/3309499868 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f25d8014660 con 0x55f2e3b39330 2024-02-21T23:10:35.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.739+0000 7f25ee85f740 10 client.6887 fetch_fsmap learned FSMap version 17 2024-02-21T23:10:35.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.739+0000 7f25ee85f740 1 -- 172.21.15.99:0/3309499868 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55f2e3b44fe0 con 0x55f2e3b39330 2024-02-21T23:10:35.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.739+0000 7f25ca000640 1 -- 172.21.15.99:0/3309499868 <== mon.2 v2:172.21.15.181:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25d0030710 con 0x55f2e3b39330 2024-02-21T23:10:35.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.739+0000 7f25ca000640 1 -- 172.21.15.99:0/3309499868 <== mon.2 v2:172.21.15.181:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f25d8020040 con 0x55f2e3b39330 2024-02-21T23:10:35.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.739+0000 7f25ee85f740 10 client.6887 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:10:35.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.739+0000 7f25ee85f740 10 client.6887 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:10:35.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.739+0000 7f25ee85f740 20 client.6887 populate_metadata read hostname 'smithi099' 2024-02-21T23:10:35.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.739+0000 7f25ee85f740 1 --2- 172.21.15.99:0/3309499868 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55f2e3b33850 0x55f2e3b98150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:35.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.739+0000 7f25ee85f740 4 client.6887 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T23:10:35.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.739+0000 7f25ee85f740 1 -- 172.21.15.99:0/3309499868 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55f2e3ac0e30 con 0x55f2e3b33850 2024-02-21T23:10:35.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.740+0000 7f25e3e00640 1 --2- 172.21.15.99:0/3309499868 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55f2e3b33850 0x55f2e3b98150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:35.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.740+0000 7f25e3e00640 1 --2- 172.21.15.99:0/3309499868 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55f2e3b33850 0x55f2e3b98150 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1969b7acf18cfaba server_cookie=27cf1343f8b809ca in_seq=0 out_seq=0 2024-02-21T23:10:35.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.740+0000 7f25ca000640 10 client.6887 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:10:35.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.740+0000 7f25ca000640 1 -- 172.21.15.99:0/3309499868 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55f2e3ac0e30 con 0x55f2e3b33850 2024-02-21T23:10:35.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.740+0000 7f25ca000640 10 client.6887 handle_command_reply: tid=0 2024-02-21T23:10:35.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.740+0000 7f25ee85f740 1 client.6887 shutdown 2024-02-21T23:10:35.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.741+0000 7f25ee85f740 1 -- 172.21.15.99:0/3309499868 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f2e3b39330 msgr2=0x55f2e3b33d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:35.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.741+0000 7f25ee85f740 1 --2- 172.21.15.99:0/3309499868 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f2e3b39330 0x55f2e3b33d00 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f25d802c7b0 tx=0x7f25d8009000 comp rx=0 tx=0).stop 2024-02-21T23:10:35.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.741+0000 7f25ee85f740 1 -- 172.21.15.99:0/3309499868 shutdown_connections 2024-02-21T23:10:35.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.741+0000 7f25ee85f740 1 --2- 172.21.15.99:0/3309499868 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55f2e3b33850 0x55f2e3b98150 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.741+0000 7f25ee85f740 1 --2- 172.21.15.99:0/3309499868 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f2e3b43d60 0x55f2e3b34ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.741+0000 7f25ee85f740 1 --2- 172.21.15.99:0/3309499868 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f2e3b39cf0 0x55f2e3afde30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.741+0000 7f25ee85f740 1 --2- 172.21.15.99:0/3309499868 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f2e3b39330 0x55f2e3b33d00 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.741+0000 7f25ca000640 0 client.6887 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:10:35.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.741+0000 7f25ee85f740 1 -- 172.21.15.99:0/3309499868 >> 172.21.15.99:0/3309499868 conn(0x55f2e3afe660 msgr2=0x55f2e3ac77d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:10:35.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.741+0000 7f25ee85f740 1 -- 172.21.15.99:0/3309499868 shutdown_connections 2024-02-21T23:10:35.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.741+0000 7f25ee85f740 1 -- 172.21.15.99:0/3309499868 wait complete. 2024-02-21T23:10:35.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.741+0000 7f25ee85f740 20 client.6887 trim_cache size 0 max 16384 2024-02-21T23:10:35.737 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-02-21T23:10:35.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.742+0000 7f25ea400640 1 -- 172.21.15.99:0/984871549 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f25c409eed0 msgr2=0x7f25c40a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:35.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.742+0000 7f25ea400640 1 --2- 172.21.15.99:0/984871549 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f25c409eed0 0x7f25c40a1390 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f25dc002150 tx=0x7f25dc009040 comp rx=0 tx=0).stop 2024-02-21T23:10:35.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.742+0000 7f25ea400640 1 -- 172.21.15.99:0/984871549 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f25e40fb650 msgr2=0x7f25e4220620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:35.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.742+0000 7f25ea400640 1 --2- 172.21.15.99:0/984871549 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f25e40fb650 0x7f25e4220620 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f25d0009840 tx=0x7f25d00046c0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.742+0000 7f25ea400640 1 -- 172.21.15.99:0/984871549 shutdown_connections 2024-02-21T23:10:35.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.742+0000 7f25ea400640 1 --2- 172.21.15.99:0/984871549 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f25c409eed0 0x7f25c40a1390 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.742+0000 7f25ea400640 1 --2- 172.21.15.99:0/984871549 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f25e4188b30 0x7f25e41625b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.742+0000 7f25ea400640 1 --2- 172.21.15.99:0/984871549 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f25e40fb650 0x7f25e4220620 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.742+0000 7f25ea400640 1 --2- 172.21.15.99:0/984871549 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f25e406b980 0x7f25e4188310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:35.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.742+0000 7f25ea400640 1 -- 172.21.15.99:0/984871549 >> 172.21.15.99:0/984871549 conn(0x7f25e40f8cb0 msgr2=0x7f25e40f9090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:10:35.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.742+0000 7f25ea400640 1 -- 172.21.15.99:0/984871549 shutdown_connections 2024-02-21T23:10:35.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:35.742+0000 7f25ea400640 1 -- 172.21.15.99:0/984871549 wait complete. 2024-02-21T23:10:36.751 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-02-21T23:10:36.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T23:10:36.752 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-02-21T23:10:36.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.962+0000 7f9871400640 1 Processor -- start 2024-02-21T23:10:36.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.962+0000 7f9871400640 1 -- start start 2024-02-21T23:10:36.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.966+0000 7f9871400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f986c0cb5d0 0x7f986c074490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:36.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.967+0000 7f9871400640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f986c0cb3c0 con 0x7f986c0749d0 2024-02-21T23:10:36.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.967+0000 7f9871400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f986c0c9f30 con 0x7f986c0740b0 2024-02-21T23:10:36.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.967+0000 7f9871400640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f986c06bcc0 con 0x7f986c0cb5d0 2024-02-21T23:10:36.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.967+0000 7f986b400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f986c0cb5d0 0x7f986c074490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:36.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.967+0000 7f986b400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f986c0cb5d0 0x7f986c074490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:39538/0 (socket says 172.21.15.99:39538) 2024-02-21T23:10:36.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.967+0000 7f986b400640 1 -- 172.21.15.99:0/2959539238 learned_addr learned my addr 172.21.15.99:0/2959539238 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:10:36.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.967+0000 7f9870a00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f986c0749d0 0x7f986c06aef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:47544/0 (socket says 172.21.15.99:47544) 2024-02-21T23:10:36.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.967+0000 7f986b400640 1 -- 172.21.15.99:0/2959539238 >> v1:172.21.15.162:6789/0 conn(0x7f986c0740b0 legacy=0x7f986c0cacb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:36.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.967+0000 7f986b400640 1 -- 172.21.15.99:0/2959539238 >> v1:172.21.15.99:6789/0 conn(0x7f986c0749d0 legacy=0x7f986c06aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:36.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.967+0000 7f986b400640 1 -- 172.21.15.99:0/2959539238 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f986c0ca1d0 con 0x7f986c0cb5d0 2024-02-21T23:10:36.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.969+0000 7f986b400640 1 --2- 172.21.15.99:0/2959539238 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f986c0cb5d0 0x7f986c074490 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f9858009870 tx=0x7f985802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb54b7f120a0dfb8 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:36.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.969+0000 7f986aa00640 1 -- 172.21.15.99:0/2959539238 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9858034070 con 0x7f986c0cb5d0 2024-02-21T23:10:36.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.969+0000 7f986aa00640 1 -- 172.21.15.99:0/2959539238 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9858030860 con 0x7f986c0cb5d0 2024-02-21T23:10:36.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.969+0000 7f986aa00640 1 -- 172.21.15.99:0/2959539238 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9858030c30 con 0x7f986c0cb5d0 2024-02-21T23:10:36.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.970+0000 7f9871400640 1 -- 172.21.15.99:0/2959539238 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f986c0cb5d0 msgr2=0x7f986c074490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:36.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.970+0000 7f9871400640 1 --2- 172.21.15.99:0/2959539238 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f986c0cb5d0 0x7f986c074490 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f9858009870 tx=0x7f985802b9a0 comp rx=0 tx=0).stop 2024-02-21T23:10:36.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.970+0000 7f9871400640 1 -- 172.21.15.99:0/2959539238 shutdown_connections 2024-02-21T23:10:36.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.970+0000 7f9871400640 1 --2- 172.21.15.99:0/2959539238 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f986c0cb5d0 0x7f986c074490 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:36.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.970+0000 7f9871400640 1 -- 172.21.15.99:0/2959539238 >> 172.21.15.99:0/2959539238 conn(0x7f986c0cf580 msgr2=0x7f986c0cf990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:10:36.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.970+0000 7f9871400640 1 -- 172.21.15.99:0/2959539238 shutdown_connections 2024-02-21T23:10:36.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.970+0000 7f9871400640 1 -- 172.21.15.99:0/2959539238 wait complete. 2024-02-21T23:10:36.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.972+0000 7f9871400640 1 Processor -- start 2024-02-21T23:10:36.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.973+0000 7f9871400640 1 -- start start 2024-02-21T23:10:36.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.975+0000 7f9871400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f986c0740b0 0x7f986c0cd420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:36.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.975+0000 7f9871400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f986c0749d0 0x7f986c16fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:36.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.975+0000 7f9871400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f986c0cb5d0 0x7f986c220400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:36.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.975+0000 7f9871400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f986c074e60 con 0x7f986c0749d0 2024-02-21T23:10:36.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.975+0000 7f9871400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f986c0ca790 con 0x7f986c0cb5d0 2024-02-21T23:10:36.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.975+0000 7f9871400640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f986c06bfa0 con 0x7f986c0740b0 2024-02-21T23:10:36.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.975+0000 7f986b400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f986c0749d0 0x7f986c16fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:36.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.975+0000 7f986b400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f986c0749d0 0x7f986c16fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:39540/0 (socket says 172.21.15.99:39540) 2024-02-21T23:10:36.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.975+0000 7f986b400640 1 -- 172.21.15.99:0/242248455 learned_addr learned my addr 172.21.15.99:0/242248455 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:10:36.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.975+0000 7f9870a00640 1 --2- 172.21.15.99:0/242248455 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f986c0cb5d0 0x7f986c220400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:36.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.975+0000 7f986be00640 1 --2- 172.21.15.99:0/242248455 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f986c0740b0 0x7f986c0cd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:36.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.976+0000 7f986b400640 1 -- 172.21.15.99:0/242248455 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f986c0740b0 msgr2=0x7f986c0cd420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:36.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.976+0000 7f986b400640 1 --2- 172.21.15.99:0/242248455 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f986c0740b0 0x7f986c0cd420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:36.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.976+0000 7f986b400640 1 -- 172.21.15.99:0/242248455 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f986c0cb5d0 msgr2=0x7f986c220400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:36.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.976+0000 7f986b400640 1 --2- 172.21.15.99:0/242248455 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f986c0cb5d0 0x7f986c220400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:36.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.976+0000 7f986b400640 1 -- 172.21.15.99:0/242248455 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f986c0cd960 con 0x7f986c0749d0 2024-02-21T23:10:36.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.976+0000 7f986b400640 1 --2- 172.21.15.99:0/242248455 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f986c0749d0 0x7f986c16fd30 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f9858000c00 tx=0x7f98580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:36.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.976+0000 7f9863e00640 1 -- 172.21.15.99:0/242248455 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9858034040 con 0x7f986c0749d0 2024-02-21T23:10:36.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.976+0000 7f9863e00640 1 -- 172.21.15.99:0/242248455 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98580433f0 con 0x7f986c0749d0 2024-02-21T23:10:36.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.976+0000 7f9863e00640 1 -- 172.21.15.99:0/242248455 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98580437e0 con 0x7f986c0749d0 2024-02-21T23:10:36.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.976+0000 7f9871400640 1 -- 172.21.15.99:0/242248455 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f986c0cdc30 con 0x7f986c0749d0 2024-02-21T23:10:36.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.977+0000 7f9871400640 1 -- 172.21.15.99:0/242248455 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f986c0ce1f0 con 0x7f986c0749d0 2024-02-21T23:10:36.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.981+0000 7f9863e00640 1 -- 172.21.15.99:0/242248455 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f985804a060 con 0x7f986c0749d0 2024-02-21T23:10:36.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.983+0000 7f9863e00640 1 --2- 172.21.15.99:0/242248455 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f984c09ef00 0x7f984c0a13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:36.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.984+0000 7f98757e3740 1 Processor -- start 2024-02-21T23:10:36.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.984+0000 7f9863e00640 1 -- 172.21.15.99:0/242248455 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f98580ec1b0 con 0x7f986c0749d0 2024-02-21T23:10:36.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.984+0000 7f98757e3740 1 -- start start 2024-02-21T23:10:36.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.984+0000 7f986be00640 1 --2- 172.21.15.99:0/242248455 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f984c09ef00 0x7f984c0a13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:36.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.985+0000 7f986be00640 1 --2- 172.21.15.99:0/242248455 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f984c09ef00 0x7f984c0a13c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f986c21fde0 tx=0x7f985c009040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:36.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.985+0000 7f98757e3740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562a1d5de160 0x562a1d5de540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:36.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.985+0000 7f98757e3740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a1d5e4700 0x562a1d60ac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:36.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.985+0000 7f98757e3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562a1d5e4b80 0x562a1d60b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:36.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.985+0000 7f98757e3740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a1d501790 con 0x562a1d5de160 2024-02-21T23:10:36.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.985+0000 7f98757e3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a1d4aabf0 con 0x562a1d5e4b80 2024-02-21T23:10:36.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.985+0000 7f98757e3740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a1d4fd830 con 0x562a1d5e4700 2024-02-21T23:10:36.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.986+0000 7f986be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562a1d5de160 0x562a1d5de540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:36.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.986+0000 7f986be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562a1d5de160 0x562a1d5de540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:39556/0 (socket says 172.21.15.99:39556) 2024-02-21T23:10:36.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.986+0000 7f986be00640 1 -- 172.21.15.99:0/2952803929 learned_addr learned my addr 172.21.15.99:0/2952803929 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:10:36.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.986+0000 7f986b400640 1 --2- 172.21.15.99:0/2952803929 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a1d5e4700 0x562a1d60ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:36.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.986+0000 7f9870a00640 1 --2- 172.21.15.99:0/2952803929 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562a1d5e4b80 0x562a1d60b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:36.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.986+0000 7f986be00640 1 -- 172.21.15.99:0/2952803929 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a1d5e4700 msgr2=0x562a1d60ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:36.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.986+0000 7f986be00640 1 --2- 172.21.15.99:0/2952803929 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a1d5e4700 0x562a1d60ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:36.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.986+0000 7f986be00640 1 -- 172.21.15.99:0/2952803929 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562a1d5e4b80 msgr2=0x562a1d60b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:36.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.986+0000 7f986be00640 1 --2- 172.21.15.99:0/2952803929 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562a1d5e4b80 0x562a1d60b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:36.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.986+0000 7f986be00640 1 -- 172.21.15.99:0/2952803929 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562a1d4c8c40 con 0x562a1d5de160 2024-02-21T23:10:36.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.986+0000 7f9870a00640 1 --2- 172.21.15.99:0/2952803929 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562a1d5e4b80 0x562a1d60b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:10:36.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.986+0000 7f986be00640 1 --2- 172.21.15.99:0/2952803929 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562a1d5de160 0x562a1d5de540 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f985c00f9b0 tx=0x7f985c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f352f9de4bdce18b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:36.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.987+0000 7f9857e00640 1 -- 172.21.15.99:0/2952803929 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985c025070 con 0x562a1d5de160 2024-02-21T23:10:36.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.987+0000 7f9857e00640 1 -- 172.21.15.99:0/2952803929 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f985c01b050 con 0x562a1d5de160 2024-02-21T23:10:36.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.987+0000 7f9857e00640 1 -- 172.21.15.99:0/2952803929 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985c0013a0 con 0x562a1d5de160 2024-02-21T23:10:36.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.988+0000 7f98757e3740 1 -- 172.21.15.99:0/2952803929 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562a1d5de160 msgr2=0x562a1d5de540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:36.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.988+0000 7f98757e3740 1 --2- 172.21.15.99:0/2952803929 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562a1d5de160 0x562a1d5de540 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f985c00f9b0 tx=0x7f985c012000 comp rx=0 tx=0).stop 2024-02-21T23:10:36.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.988+0000 7f98757e3740 1 -- 172.21.15.99:0/2952803929 shutdown_connections 2024-02-21T23:10:36.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.988+0000 7f98757e3740 1 --2- 172.21.15.99:0/2952803929 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562a1d5e4b80 0x562a1d60b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:36.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.988+0000 7f98757e3740 1 --2- 172.21.15.99:0/2952803929 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a1d5e4700 0x562a1d60ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:36.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.988+0000 7f98757e3740 1 --2- 172.21.15.99:0/2952803929 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562a1d5de160 0x562a1d5de540 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:36.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.988+0000 7f98757e3740 1 -- 172.21.15.99:0/2952803929 >> 172.21.15.99:0/2952803929 conn(0x562a1d59ba90 msgr2=0x562a1d59cb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:10:36.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.988+0000 7f98757e3740 1 -- 172.21.15.99:0/2952803929 shutdown_connections 2024-02-21T23:10:36.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.988+0000 7f98757e3740 1 -- 172.21.15.99:0/2952803929 wait complete. 2024-02-21T23:10:36.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.989+0000 7f98757e3740 1 -- start start 2024-02-21T23:10:36.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.990+0000 7f98757e3740 1 Processor -- start 2024-02-21T23:10:36.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.992+0000 7f98757e3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562a1d5e4700 0x562a1d610500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:36.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.992+0000 7f98757e3740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a1d5e4b80 0x562a1d6263e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:36.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.992+0000 7f98757e3740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562a1d628c80 0x562a1d5d7680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:36.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.992+0000 7f98757e3740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a1d60b8a0 con 0x562a1d628c80 2024-02-21T23:10:36.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.992+0000 7f98757e3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a1d4a01d0 con 0x562a1d5e4700 2024-02-21T23:10:36.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.992+0000 7f98757e3740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a1d60bb80 con 0x562a1d5e4b80 2024-02-21T23:10:36.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.992+0000 7f98757e3740 10 client.0 _ll_register_callbacks cb 0x562a1d215c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:10:36.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.992+0000 7f986be00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562a1d5e4700 0x562a1d610500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:36.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.992+0000 7f986be00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562a1d5e4700 0x562a1d610500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:53826/0 (socket says 172.21.15.99:53826) 2024-02-21T23:10:36.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.992+0000 7f986be00640 1 -- 172.21.15.99:0/2326886914 learned_addr learned my addr 172.21.15.99:0/2326886914 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:10:36.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.992+0000 7f986b400640 1 --2- 172.21.15.99:0/2326886914 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a1d5e4b80 0x562a1d6263e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:36.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.992+0000 7f9870a00640 1 --2- 172.21.15.99:0/2326886914 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562a1d628c80 0x562a1d5d7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:36.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.993+0000 7f986be00640 1 -- 172.21.15.99:0/2326886914 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a1d5e4b80 msgr2=0x562a1d6263e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:36.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.993+0000 7f986be00640 1 --2- 172.21.15.99:0/2326886914 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a1d5e4b80 0x562a1d6263e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:36.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.993+0000 7f986be00640 1 -- 172.21.15.99:0/2326886914 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562a1d628c80 msgr2=0x562a1d5d7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:36.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.993+0000 7f986be00640 1 --2- 172.21.15.99:0/2326886914 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562a1d628c80 0x562a1d5d7680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:36.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.993+0000 7f986be00640 1 -- 172.21.15.99:0/2326886914 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562a1d2de7e0 con 0x562a1d5e4700 2024-02-21T23:10:36.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.993+0000 7f986be00640 1 --2- 172.21.15.99:0/2326886914 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562a1d5e4700 0x562a1d610500 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f985c0206f0 tx=0x7f985c000ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23e90932a114772 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:36.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.993+0000 7f9854c00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-02-21T23:10:36.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.994+0000 7f9854c00640 1 -- 172.21.15.99:0/2326886914 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985c02e030 con 0x562a1d5e4700 2024-02-21T23:10:36.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.994+0000 7f98757e3740 1 -- 172.21.15.99:0/2326886914 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f985c01b050 con 0x562a1d5e4700 2024-02-21T23:10:36.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.994+0000 7f9854c00640 1 -- 172.21.15.99:0/2326886914 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(36..36 src has 1..36) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f985c0208d0 con 0x562a1d5e4700 2024-02-21T23:10:36.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.994+0000 7f9854c00640 1 -- 172.21.15.99:0/2326886914 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f985c038050 con 0x562a1d5e4700 2024-02-21T23:10:36.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.994+0000 7f98757e3740 10 client.6946 fetch_fsmap learned FSMap version 17 2024-02-21T23:10:36.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.994+0000 7f98757e3740 1 -- 172.21.15.99:0/2326886914 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x562a1d33ef70 con 0x562a1d5e4700 2024-02-21T23:10:36.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.994+0000 7f9854c00640 1 -- 172.21.15.99:0/2326886914 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f985c01b050 con 0x562a1d5e4700 2024-02-21T23:10:36.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.994+0000 7f9854c00640 1 -- 172.21.15.99:0/2326886914 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f985c020ad0 con 0x562a1d5e4700 2024-02-21T23:10:36.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.994+0000 7f98757e3740 10 client.6946 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:10:36.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.994+0000 7f98757e3740 10 client.6946 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:10:36.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.995+0000 7f98757e3740 20 client.6946 populate_metadata read hostname 'smithi099' 2024-02-21T23:10:36.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.995+0000 7f98757e3740 1 --2- 172.21.15.99:0/2326886914 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x562a1d59a960 0x562a1d629100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:36.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.995+0000 7f98757e3740 4 client.6946 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:10:36.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.995+0000 7f98757e3740 1 -- 172.21.15.99:0/2326886914 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562a1d50ecd0 con 0x562a1d59a960 2024-02-21T23:10:36.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.995+0000 7f986b400640 1 --2- 172.21.15.99:0/2326886914 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x562a1d59a960 0x562a1d629100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:36.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.995+0000 7f986b400640 1 --2- 172.21.15.99:0/2326886914 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x562a1d59a960 0x562a1d629100 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34f96baf7234a8de server_cookie=63e11fbd12529254 in_seq=0 out_seq=0 2024-02-21T23:10:36.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.995+0000 7f9854c00640 10 client.6946 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:10:36.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.996+0000 7f9854c00640 1 -- 172.21.15.99:0/2326886914 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x562a1d50ecd0 con 0x562a1d59a960 2024-02-21T23:10:36.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.996+0000 7f9854c00640 10 client.6946 handle_command_reply: tid=0 2024-02-21T23:10:36.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.996+0000 7f98757e3740 1 client.6946 shutdown 2024-02-21T23:10:36.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.997+0000 7f98757e3740 1 -- 172.21.15.99:0/2326886914 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562a1d5e4700 msgr2=0x562a1d610500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:36.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.997+0000 7f98757e3740 1 --2- 172.21.15.99:0/2326886914 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562a1d5e4700 0x562a1d610500 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f985c0206f0 tx=0x7f985c000ed0 comp rx=0 tx=0).stop 2024-02-21T23:10:36.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.997+0000 7f98757e3740 1 -- 172.21.15.99:0/2326886914 shutdown_connections 2024-02-21T23:10:36.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.997+0000 7f98757e3740 1 --2- 172.21.15.99:0/2326886914 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x562a1d59a960 0x562a1d629100 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:36.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.997+0000 7f98757e3740 1 --2- 172.21.15.99:0/2326886914 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562a1d628c80 0x562a1d5d7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:36.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.997+0000 7f98757e3740 1 --2- 172.21.15.99:0/2326886914 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a1d5e4b80 0x562a1d6263e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:36.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.997+0000 7f98757e3740 1 --2- 172.21.15.99:0/2326886914 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562a1d5e4700 0x562a1d610500 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:36.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.997+0000 7f9854c00640 0 client.6946 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:10:36.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.997+0000 7f98757e3740 1 -- 172.21.15.99:0/2326886914 >> 172.21.15.99:0/2326886914 conn(0x562a1d5de160 msgr2=0x562a1d61b7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:10:36.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.997+0000 7f98757e3740 1 -- 172.21.15.99:0/2326886914 shutdown_connections 2024-02-21T23:10:36.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.997+0000 7f98757e3740 1 -- 172.21.15.99:0/2326886914 wait complete. 2024-02-21T23:10:36.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:36.997+0000 7f98757e3740 20 client.6946 trim_cache size 0 max 16384 2024-02-21T23:10:37.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.032+0000 7f98757e3740 1 Processor -- start 2024-02-21T23:10:37.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.032+0000 7f98757e3740 1 -- start start 2024-02-21T23:10:37.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.034+0000 7f98757e3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562a1d5e4700 0x562a1d606970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:37.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.034+0000 7f98757e3740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562a1d5e4b80 0x562a1d5e7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:37.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.034+0000 7f98757e3740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a1d628c80 0x562a1d5e8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:37.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.034+0000 7f98757e3740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f986c228810 con 0x562a1d5e4b80 2024-02-21T23:10:37.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.034+0000 7f98757e3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f986c0e5b50 con 0x562a1d5e4700 2024-02-21T23:10:37.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.034+0000 7f98757e3740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f986c173210 con 0x562a1d628c80 2024-02-21T23:10:37.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.035+0000 7f986b400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562a1d5e4b80 0x562a1d5e7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:37.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.035+0000 7f986b400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562a1d5e4b80 0x562a1d5e7cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:39562/0 (socket says 172.21.15.99:39562) 2024-02-21T23:10:37.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.035+0000 7f986b400640 1 -- 172.21.15.99:0/113211116 learned_addr learned my addr 172.21.15.99:0/113211116 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:10:37.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.035+0000 7f986be00640 1 --2- 172.21.15.99:0/113211116 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562a1d5e4700 0x562a1d606970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:37.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.035+0000 7f9870a00640 1 --2- 172.21.15.99:0/113211116 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a1d628c80 0x562a1d5e8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:37.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.035+0000 7f986b400640 1 -- 172.21.15.99:0/113211116 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a1d628c80 msgr2=0x562a1d5e8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:37.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.035+0000 7f986b400640 1 --2- 172.21.15.99:0/113211116 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a1d628c80 0x562a1d5e8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:37.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.035+0000 7f986b400640 1 -- 172.21.15.99:0/113211116 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562a1d5e4700 msgr2=0x562a1d606970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:37.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.035+0000 7f986b400640 1 --2- 172.21.15.99:0/113211116 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562a1d5e4700 0x562a1d606970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:37.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.035+0000 7f986b400640 1 -- 172.21.15.99:0/113211116 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562a1d1d6170 con 0x562a1d5e4b80 2024-02-21T23:10:37.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.035+0000 7f986b400640 1 --2- 172.21.15.99:0/113211116 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562a1d5e4b80 0x562a1d5e7cf0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f98580b5d50 tx=0x7f98580095f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=181aec563eb8eee2 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:37.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.036+0000 7f9857400640 1 -- 172.21.15.99:0/113211116 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98580e5070 con 0x562a1d5e4b80 2024-02-21T23:10:37.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.036+0000 7f9857400640 1 -- 172.21.15.99:0/113211116 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98580c2090 con 0x562a1d5e4b80 2024-02-21T23:10:37.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.036+0000 7f9857400640 1 -- 172.21.15.99:0/113211116 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9858030720 con 0x562a1d5e4b80 2024-02-21T23:10:37.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.037+0000 7f98757e3740 1 -- 172.21.15.99:0/113211116 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562a1d5e4b80 msgr2=0x562a1d5e7cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:37.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.037+0000 7f98757e3740 1 --2- 172.21.15.99:0/113211116 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562a1d5e4b80 0x562a1d5e7cf0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f98580b5d50 tx=0x7f98580095f0 comp rx=0 tx=0).stop 2024-02-21T23:10:37.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.037+0000 7f98757e3740 1 -- 172.21.15.99:0/113211116 shutdown_connections 2024-02-21T23:10:37.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.037+0000 7f98757e3740 1 --2- 172.21.15.99:0/113211116 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a1d628c80 0x562a1d5e8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:37.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.037+0000 7f98757e3740 1 --2- 172.21.15.99:0/113211116 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562a1d5e4b80 0x562a1d5e7cf0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:37.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.037+0000 7f98757e3740 1 --2- 172.21.15.99:0/113211116 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562a1d5e4700 0x562a1d606970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:37.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.037+0000 7f98757e3740 1 -- 172.21.15.99:0/113211116 >> 172.21.15.99:0/113211116 conn(0x562a1d5de160 msgr2=0x562a1d5934e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:10:37.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.037+0000 7f98757e3740 1 -- 172.21.15.99:0/113211116 shutdown_connections 2024-02-21T23:10:37.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.037+0000 7f98757e3740 1 -- 172.21.15.99:0/113211116 wait complete. 2024-02-21T23:10:37.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.038+0000 7f98757e3740 1 -- start start 2024-02-21T23:10:37.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.038+0000 7f98757e3740 1 Processor -- start 2024-02-21T23:10:37.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.041+0000 7f98757e3740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562a1d5e4700 0x562a1d688f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:37.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.041+0000 7f98757e3740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562a1d5e4b80 0x562a1d66def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:37.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.041+0000 7f98757e3740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a1d628c80 0x562a1d66e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:37.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.041+0000 7f98757e3740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f986c173810 con 0x562a1d5e4700 2024-02-21T23:10:37.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.041+0000 7f98757e3740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f986c0e54f0 con 0x562a1d5e4b80 2024-02-21T23:10:37.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.041+0000 7f98757e3740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f986c0e4870 con 0x562a1d628c80 2024-02-21T23:10:37.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.041+0000 7f98757e3740 10 client.0 _ll_register_callbacks cb 0x7f985c023070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:10:37.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.041+0000 7f986be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562a1d5e4700 0x562a1d688f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:37.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.041+0000 7f986be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562a1d5e4700 0x562a1d688f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:39564/0 (socket says 172.21.15.99:39564) 2024-02-21T23:10:37.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.041+0000 7f986be00640 1 -- 172.21.15.99:0/2058084109 learned_addr learned my addr 172.21.15.99:0/2058084109 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:10:37.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.041+0000 7f9870a00640 1 --2- 172.21.15.99:0/2058084109 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a1d628c80 0x562a1d66e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:37.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.041+0000 7f986b400640 1 --2- 172.21.15.99:0/2058084109 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562a1d5e4b80 0x562a1d66def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:37.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.041+0000 7f9870a00640 1 -- 172.21.15.99:0/2058084109 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562a1d5e4b80 msgr2=0x562a1d66def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:37.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.041+0000 7f9870a00640 1 --2- 172.21.15.99:0/2058084109 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562a1d5e4b80 0x562a1d66def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:37.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.041+0000 7f9870a00640 1 -- 172.21.15.99:0/2058084109 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562a1d5e4700 msgr2=0x562a1d688f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:37.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.041+0000 7f9870a00640 1 --2- 172.21.15.99:0/2058084109 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562a1d5e4700 0x562a1d688f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:37.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.041+0000 7f9870a00640 1 -- 172.21.15.99:0/2058084109 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562a1d5d7840 con 0x562a1d628c80 2024-02-21T23:10:37.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.042+0000 7f986be00640 1 --2- 172.21.15.99:0/2058084109 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562a1d5e4700 0x562a1d688f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:10:37.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.042+0000 7f9870a00640 1 --2- 172.21.15.99:0/2058084109 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a1d628c80 0x562a1d66e430 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x562a1d5a3e80 tx=0x7f9864007780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48f08f112ec05f54 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:37.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.042+0000 7f9854c00640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-02-21T23:10:37.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.042+0000 7f9854c00640 1 -- 172.21.15.99:0/2058084109 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98640178e0 con 0x562a1d628c80 2024-02-21T23:10:37.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.042+0000 7f9854c00640 1 -- 172.21.15.99:0/2058084109 <== mon.2 v2:172.21.15.181:3300/0 2 ==== osd_map(36..36 src has 1..36) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f9864017a80 con 0x562a1d628c80 2024-02-21T23:10:37.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.042+0000 7f98757e3740 1 -- 172.21.15.99:0/2058084109 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f98580c2090 con 0x562a1d628c80 2024-02-21T23:10:37.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.043+0000 7f9854c00640 1 -- 172.21.15.99:0/2058084109 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9864017c80 con 0x562a1d628c80 2024-02-21T23:10:37.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.043+0000 7f98757e3740 10 client.6902 fetch_fsmap learned FSMap version 17 2024-02-21T23:10:37.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.043+0000 7f98757e3740 1 -- 172.21.15.99:0/2058084109 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x562a1d60c5d0 con 0x562a1d628c80 2024-02-21T23:10:37.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.043+0000 7f9854c00640 1 -- 172.21.15.99:0/2058084109 <== mon.2 v2:172.21.15.181:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98580c2090 con 0x562a1d628c80 2024-02-21T23:10:37.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.043+0000 7f9854c00640 1 -- 172.21.15.99:0/2058084109 <== mon.2 v2:172.21.15.181:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f9864026470 con 0x562a1d628c80 2024-02-21T23:10:37.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.043+0000 7f98757e3740 10 client.6902 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:10:37.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.043+0000 7f98757e3740 10 client.6902 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:10:37.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.043+0000 7f98757e3740 20 client.6902 populate_metadata read hostname 'smithi099' 2024-02-21T23:10:37.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.043+0000 7f98757e3740 1 --2- 172.21.15.99:0/2058084109 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x562a1d5d4a30 0x562a1d5e7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:37.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.043+0000 7f98757e3740 4 client.6902 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-02-21T23:10:37.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.043+0000 7f98757e3740 1 -- 172.21.15.99:0/2058084109 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x562a1d509020 con 0x562a1d5d4a30 2024-02-21T23:10:37.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.044+0000 7f986be00640 1 --2- 172.21.15.99:0/2058084109 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x562a1d5d4a30 0x562a1d5e7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:37.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.044+0000 7f986be00640 1 --2- 172.21.15.99:0/2058084109 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x562a1d5d4a30 0x562a1d5e7cf0 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6406c457606ef4fe server_cookie=78853ddb852cf7d1 in_seq=0 out_seq=0 2024-02-21T23:10:37.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.044+0000 7f9854c00640 10 client.6902 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:10:37.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.046+0000 7f9854c00640 1 -- 172.21.15.99:0/2058084109 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x562a1d509020 con 0x562a1d5d4a30 2024-02-21T23:10:37.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.046+0000 7f9854c00640 10 client.6902 handle_command_reply: tid=0 2024-02-21T23:10:37.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.046+0000 7f98757e3740 1 client.6902 shutdown 2024-02-21T23:10:37.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.046+0000 7f98757e3740 1 -- 172.21.15.99:0/2058084109 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a1d628c80 msgr2=0x562a1d66e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:37.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.046+0000 7f98757e3740 1 --2- 172.21.15.99:0/2058084109 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a1d628c80 0x562a1d66e430 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x562a1d5a3e80 tx=0x7f9864007780 comp rx=0 tx=0).stop 2024-02-21T23:10:37.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.047+0000 7f98757e3740 1 -- 172.21.15.99:0/2058084109 shutdown_connections 2024-02-21T23:10:37.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.047+0000 7f98757e3740 1 --2- 172.21.15.99:0/2058084109 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x562a1d5d4a30 0x562a1d5e7cf0 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:37.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.047+0000 7f98757e3740 1 --2- 172.21.15.99:0/2058084109 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x562a1d628c80 0x562a1d66e430 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:37.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.047+0000 7f98757e3740 1 --2- 172.21.15.99:0/2058084109 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562a1d5e4b80 0x562a1d66def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:37.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.047+0000 7f98757e3740 1 --2- 172.21.15.99:0/2058084109 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x562a1d5e4700 0x562a1d688f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:37.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.047+0000 7f98757e3740 1 -- 172.21.15.99:0/2058084109 >> 172.21.15.99:0/2058084109 conn(0x562a1d5de160 msgr2=0x562a1d59cad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:10:37.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.047+0000 7f9854c00640 0 client.6902 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:10:37.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.047+0000 7f98757e3740 1 -- 172.21.15.99:0/2058084109 shutdown_connections 2024-02-21T23:10:37.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.047+0000 7f98757e3740 1 -- 172.21.15.99:0/2058084109 wait complete. 2024-02-21T23:10:37.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.047+0000 7f98757e3740 20 client.6902 trim_cache size 0 max 16384 2024-02-21T23:10:37.043 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-02-21T23:10:37.043 INFO:teuthology.orchestra.run.smithi099.stdout: "return_code": 0, 2024-02-21T23:10:37.044 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_tag": "3be23ca5-e038-4dba-8928-b7d56a260c63", 2024-02-21T23:10:37.044 INFO:teuthology.orchestra.run.smithi099.stdout: "mode": "asynchronous" 2024-02-21T23:10:37.044 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-02-21T23:10:37.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.048+0000 7f9871400640 1 -- 172.21.15.99:0/242248455 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f984c09ef00 msgr2=0x7f984c0a13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:37.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.048+0000 7f9871400640 1 --2- 172.21.15.99:0/242248455 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f984c09ef00 0x7f984c0a13c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f986c21fde0 tx=0x7f985c009040 comp rx=0 tx=0).stop 2024-02-21T23:10:37.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.048+0000 7f9871400640 1 -- 172.21.15.99:0/242248455 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f986c0749d0 msgr2=0x7f986c16fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:37.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.048+0000 7f9871400640 1 --2- 172.21.15.99:0/242248455 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f986c0749d0 0x7f986c16fd30 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f9858000c00 tx=0x7f98580046c0 comp rx=0 tx=0).stop 2024-02-21T23:10:37.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.048+0000 7f9871400640 1 -- 172.21.15.99:0/242248455 shutdown_connections 2024-02-21T23:10:37.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.048+0000 7f9871400640 1 --2- 172.21.15.99:0/242248455 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f984c09ef00 0x7f984c0a13c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:37.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.048+0000 7f9871400640 1 --2- 172.21.15.99:0/242248455 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f986c0cb5d0 0x7f986c220400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:37.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.048+0000 7f9871400640 1 --2- 172.21.15.99:0/242248455 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f986c0749d0 0x7f986c16fd30 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:37.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.048+0000 7f9871400640 1 --2- 172.21.15.99:0/242248455 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f986c0740b0 0x7f986c0cd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:37.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.049+0000 7f9871400640 1 -- 172.21.15.99:0/242248455 >> 172.21.15.99:0/242248455 conn(0x7f986c0cf580 msgr2=0x7f986c175150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:10:37.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.049+0000 7f9871400640 1 -- 172.21.15.99:0/242248455 shutdown_connections 2024-02-21T23:10:37.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.049+0000 7f9871400640 1 -- 172.21.15.99:0/242248455 wait complete. 2024-02-21T23:10:37.063 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T23:10:37.063 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T23:10:37.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.357+0000 7ff241c00640 1 Processor -- start 2024-02-21T23:10:37.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.358+0000 7ff241c00640 1 -- start start 2024-02-21T23:10:37.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.360+0000 7ff241c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff23c18e2e0 0x7ff23c18e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:37.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.360+0000 7ff241c00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff23c0f6850 con 0x7ff23c18a770 2024-02-21T23:10:37.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.360+0000 7ff241c00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff23c0f54d0 con 0x7ff23c1903e0 2024-02-21T23:10:37.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.360+0000 7ff241c00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff23c0f57b0 con 0x7ff23c18e2e0 2024-02-21T23:10:37.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.360+0000 7ff23be00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7ff23c18a770 0x7ff23c0f4cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.99:53976/0 (socket says 172.21.15.99:53976) 2024-02-21T23:10:37.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.360+0000 7ff23be00640 1 -- 172.21.15.99:0/4132003023 learned_addr learned my addr 172.21.15.99:0/4132003023 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:10:37.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.360+0000 7ff23b400640 1 --2- 172.21.15.99:0/4132003023 >> v2:172.21.15.162:3300/0 conn(0x7ff23c18e2e0 0x7ff23c18e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:37.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.361+0000 7ff23aa00640 1 -- 172.21.15.99:0/4132003023 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 14770098 0 0) 0x7ff23c0f6850 con 0x7ff23c18a770 2024-02-21T23:10:37.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.361+0000 7ff23aa00640 1 -- 172.21.15.99:0/4132003023 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff220003520 con 0x7ff23c18a770 2024-02-21T23:10:37.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.361+0000 7ff23aa00640 1 -- 172.21.15.99:0/4132003023 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 40493083 0 0) 0x7ff23c0f54d0 con 0x7ff23c1903e0 2024-02-21T23:10:37.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.361+0000 7ff23aa00640 1 -- 172.21.15.99:0/4132003023 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff23c0f6850 con 0x7ff23c1903e0 2024-02-21T23:10:37.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.361+0000 7ff23b400640 1 -- 172.21.15.99:0/4132003023 >> v1:172.21.15.181:6789/0 conn(0x7ff23c1903e0 legacy=0x7ff23c190830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:37.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.361+0000 7ff23b400640 1 -- 172.21.15.99:0/4132003023 >> v1:172.21.15.162:6789/0 conn(0x7ff23c18a770 legacy=0x7ff23c0f4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:37.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.361+0000 7ff23b400640 1 -- 172.21.15.99:0/4132003023 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff23c0f5a90 con 0x7ff23c18e2e0 2024-02-21T23:10:37.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.361+0000 7ff23aa00640 1 -- 172.21.15.99:0/4132003023 <== mon.1 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 642058466 0 0) 0x7ff220003520 con 0x7ff23c18a770 2024-02-21T23:10:37.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.362+0000 7ff23b400640 1 --2- 172.21.15.99:0/4132003023 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff23c18e2e0 0x7ff23c18e740 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7ff2240097a0 tx=0x7ff22402b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c72587d2c55d571c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:37.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.363+0000 7ff23aa00640 1 -- 172.21.15.99:0/4132003023 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff224038070 con 0x7ff23c18e2e0 2024-02-21T23:10:37.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.363+0000 7ff23aa00640 1 -- 172.21.15.99:0/4132003023 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff224031500 con 0x7ff23c18e2e0 2024-02-21T23:10:37.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.363+0000 7ff23aa00640 1 -- 172.21.15.99:0/4132003023 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22c0019f0 con 0x7ff23c18e2e0 2024-02-21T23:10:37.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.364+0000 7ff241c00640 1 -- 172.21.15.99:0/4132003023 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff23c18e2e0 msgr2=0x7ff23c18e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:37.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.364+0000 7ff241c00640 1 --2- 172.21.15.99:0/4132003023 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff23c18e2e0 0x7ff23c18e740 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7ff2240097a0 tx=0x7ff22402b820 comp rx=0 tx=0).stop 2024-02-21T23:10:37.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.364+0000 7ff241c00640 1 -- 172.21.15.99:0/4132003023 shutdown_connections 2024-02-21T23:10:37.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.364+0000 7ff241c00640 1 --2- 172.21.15.99:0/4132003023 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff23c18e2e0 0x7ff23c18e740 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:37.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.364+0000 7ff241c00640 1 -- 172.21.15.99:0/4132003023 >> 172.21.15.99:0/4132003023 conn(0x7ff23c0ce4b0 msgr2=0x7ff23c0ce8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:10:37.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.365+0000 7ff241c00640 1 -- 172.21.15.99:0/4132003023 shutdown_connections 2024-02-21T23:10:37.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.365+0000 7ff241c00640 1 -- 172.21.15.99:0/4132003023 wait complete. 2024-02-21T23:10:37.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.367+0000 7ff241c00640 1 Processor -- start 2024-02-21T23:10:37.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.367+0000 7ff241c00640 1 -- start start 2024-02-21T23:10:37.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.369+0000 7ff241c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff23c18a770 0x7ff23c221050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:37.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.369+0000 7ff241c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff23c18e2e0 0x7ff23c1531c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:37.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.369+0000 7ff241c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff23c1903e0 0x7ff23c16e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:37.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.369+0000 7ff241c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff23c0f6330 con 0x7ff23c1903e0 2024-02-21T23:10:37.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.369+0000 7ff241c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff23c0f6050 con 0x7ff23c18a770 2024-02-21T23:10:37.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.369+0000 7ff241c00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff23c18ec80 con 0x7ff23c18e2e0 2024-02-21T23:10:37.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.370+0000 7ff23be00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff23c18a770 0x7ff23c221050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:37.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.370+0000 7ff23b400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff23c18e2e0 0x7ff23c1531c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:37.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.370+0000 7ff23be00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff23c18a770 0x7ff23c221050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:53868/0 (socket says 172.21.15.99:53868) 2024-02-21T23:10:37.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.370+0000 7ff23be00640 1 -- 172.21.15.99:0/2658478082 learned_addr learned my addr 172.21.15.99:0/2658478082 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:10:37.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.370+0000 7ff241200640 1 --2- 172.21.15.99:0/2658478082 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff23c1903e0 0x7ff23c16e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:37.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.370+0000 7ff23be00640 1 -- 172.21.15.99:0/2658478082 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff23c18e2e0 msgr2=0x7ff23c1531c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:37.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.370+0000 7ff23be00640 1 --2- 172.21.15.99:0/2658478082 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff23c18e2e0 0x7ff23c1531c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:37.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.370+0000 7ff23be00640 1 -- 172.21.15.99:0/2658478082 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff23c1903e0 msgr2=0x7ff23c16e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:37.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.370+0000 7ff23be00640 1 --2- 172.21.15.99:0/2658478082 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff23c1903e0 0x7ff23c16e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:37.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.370+0000 7ff23be00640 1 -- 172.21.15.99:0/2658478082 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff23c06b650 con 0x7ff23c18a770 2024-02-21T23:10:37.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.371+0000 7ff23b400640 1 --2- 172.21.15.99:0/2658478082 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff23c18e2e0 0x7ff23c1531c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:10:37.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.371+0000 7ff23be00640 1 --2- 172.21.15.99:0/2658478082 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff23c18a770 0x7ff23c221050 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7ff22c00cc70 tx=0x7ff22c00a430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:37.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.372+0000 7ff233e00640 1 -- 172.21.15.99:0/2658478082 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22c017070 con 0x7ff23c18a770 2024-02-21T23:10:37.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.372+0000 7ff233e00640 1 -- 172.21.15.99:0/2658478082 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff22c012400 con 0x7ff23c18a770 2024-02-21T23:10:37.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.372+0000 7ff233e00640 1 -- 172.21.15.99:0/2658478082 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22c0127f0 con 0x7ff23c18a770 2024-02-21T23:10:37.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.372+0000 7ff241c00640 1 -- 172.21.15.99:0/2658478082 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff23c06b930 con 0x7ff23c18a770 2024-02-21T23:10:37.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.372+0000 7ff241c00640 1 -- 172.21.15.99:0/2658478082 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff23c06bef0 con 0x7ff23c18a770 2024-02-21T23:10:37.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.378+0000 7ff233e00640 1 -- 172.21.15.99:0/2658478082 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7ff22c01a070 con 0x7ff23c18a770 2024-02-21T23:10:37.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.380+0000 7ff233e00640 1 --2- 172.21.15.99:0/2658478082 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7ff21809f020 0x7ff2180a14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:37.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.380+0000 7ff246045740 1 Processor -- start 2024-02-21T23:10:37.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.380+0000 7ff246045740 1 -- start start 2024-02-21T23:10:37.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.380+0000 7ff23b400640 1 --2- 172.21.15.99:0/2658478082 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7ff21809f020 0x7ff2180a14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:37.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.380+0000 7ff233e00640 1 -- 172.21.15.99:0/2658478082 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 8877+0+0 (secure 0 0 0) 0x7ff22c0c9f10 con 0x7ff23c18a770 2024-02-21T23:10:37.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.382+0000 7ff23b400640 1 --2- 172.21.15.99:0/2658478082 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7ff21809f020 0x7ff2180a14e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff224035000 tx=0x7ff224008030 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:37.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.383+0000 7ff246045740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5645edfa42a0 0x5645edfd9d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:37.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.383+0000 7ff246045740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5645edfda260 0x5645edfa4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:37.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.384+0000 7ff246045740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5645edfa4bc0 0x5645edf671d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:37.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.384+0000 7ff246045740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645eded0a90 con 0x5645edfda260 2024-02-21T23:10:37.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.384+0000 7ff246045740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645ede79b10 con 0x5645edfa42a0 2024-02-21T23:10:37.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.384+0000 7ff246045740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645edeccb30 con 0x5645edfa4bc0 2024-02-21T23:10:37.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.384+0000 7ff23be00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5645edfa42a0 0x5645edfd9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:37.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.384+0000 7ff23be00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5645edfa42a0 0x5645edfd9d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:53872/0 (socket says 172.21.15.99:53872) 2024-02-21T23:10:37.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.384+0000 7ff23be00640 1 -- 172.21.15.99:0/1841561434 learned_addr learned my addr 172.21.15.99:0/1841561434 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:10:37.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.384+0000 7ff23be00640 1 -- 172.21.15.99:0/1841561434 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5645edfa4bc0 msgr2=0x5645edf671d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:37.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.384+0000 7ff23be00640 1 --2- 172.21.15.99:0/1841561434 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5645edfa4bc0 0x5645edf671d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:37.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.384+0000 7ff23be00640 1 -- 172.21.15.99:0/1841561434 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5645edfda260 msgr2=0x5645edfa4680 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T23:10:37.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.384+0000 7ff23b400640 1 --2- 172.21.15.99:0/1841561434 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5645edfda260 0x5645edfa4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:37.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.384+0000 7ff23be00640 1 --2- 172.21.15.99:0/1841561434 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5645edfda260 0x5645edfa4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:37.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.384+0000 7ff23be00640 1 -- 172.21.15.99:0/1841561434 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5645edcaf7d0 con 0x5645edfa42a0 2024-02-21T23:10:37.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.384+0000 7ff23b400640 1 --2- 172.21.15.99:0/1841561434 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5645edfda260 0x5645edfa4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T23:10:37.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.385+0000 7ff23be00640 1 --2- 172.21.15.99:0/1841561434 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5645edfa42a0 0x5645edfd9d20 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7ff22c097460 tx=0x7ff22c097e60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a7de71735a74720 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:37.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.385+0000 7ff230c00640 1 -- 172.21.15.99:0/1841561434 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22c09ff00 con 0x5645edfa42a0 2024-02-21T23:10:37.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.385+0000 7ff230c00640 1 -- 172.21.15.99:0/1841561434 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff22c0c7720 con 0x5645edfa42a0 2024-02-21T23:10:37.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.385+0000 7ff230c00640 1 -- 172.21.15.99:0/1841561434 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22c09fa70 con 0x5645edfa42a0 2024-02-21T23:10:37.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.386+0000 7ff246045740 1 -- 172.21.15.99:0/1841561434 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5645edfa42a0 msgr2=0x5645edfd9d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:37.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.386+0000 7ff246045740 1 --2- 172.21.15.99:0/1841561434 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5645edfa42a0 0x5645edfd9d20 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7ff22c097460 tx=0x7ff22c097e60 comp rx=0 tx=0).stop 2024-02-21T23:10:37.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.387+0000 7ff246045740 1 -- 172.21.15.99:0/1841561434 shutdown_connections 2024-02-21T23:10:37.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.387+0000 7ff246045740 1 --2- 172.21.15.99:0/1841561434 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5645edfa4bc0 0x5645edf671d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:37.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.387+0000 7ff246045740 1 --2- 172.21.15.99:0/1841561434 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5645edfda260 0x5645edfa4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:37.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.387+0000 7ff246045740 1 --2- 172.21.15.99:0/1841561434 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5645edfa42a0 0x5645edfd9d20 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:37.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.387+0000 7ff246045740 1 -- 172.21.15.99:0/1841561434 >> 172.21.15.99:0/1841561434 conn(0x5645edf336b0 msgr2=0x5645edf6b190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:10:37.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.387+0000 7ff246045740 1 -- 172.21.15.99:0/1841561434 shutdown_connections 2024-02-21T23:10:37.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.387+0000 7ff246045740 1 -- 172.21.15.99:0/1841561434 wait complete. 2024-02-21T23:10:37.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.388+0000 7ff246045740 1 -- start start 2024-02-21T23:10:37.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.389+0000 7ff246045740 1 Processor -- start 2024-02-21T23:10:37.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.391+0000 7ff246045740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5645edfa42a0 0x5645edfef480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:37.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.391+0000 7ff246045740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5645edfa4bc0 0x5645edf96e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:37.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.391+0000 7ff246045740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5645edfda260 0x5645edf9eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:37.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.391+0000 7ff246045740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645edf72f30 con 0x5645edfa4bc0 2024-02-21T23:10:37.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.391+0000 7ff246045740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645ede6f1c0 con 0x5645edfa42a0 2024-02-21T23:10:37.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.391+0000 7ff246045740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645edfdb930 con 0x5645edfda260 2024-02-21T23:10:37.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.391+0000 7ff246045740 10 client.0 _ll_register_callbacks cb 0x5645ede8c930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:10:37.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.391+0000 7ff23be00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5645edfa42a0 0x5645edfef480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:37.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.391+0000 7ff23be00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5645edfa42a0 0x5645edfef480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:53888/0 (socket says 172.21.15.99:53888) 2024-02-21T23:10:37.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.391+0000 7ff23be00640 1 -- 172.21.15.99:0/4035271073 learned_addr learned my addr 172.21.15.99:0/4035271073 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:10:37.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.391+0000 7ff23be00640 1 -- 172.21.15.99:0/4035271073 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5645edfda260 msgr2=0x5645edf9eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:37.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.391+0000 7ff241200640 1 --2- 172.21.15.99:0/4035271073 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5645edfda260 0x5645edf9eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:37.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.392+0000 7ff23be00640 1 --2- 172.21.15.99:0/4035271073 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5645edfda260 0x5645edf9eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:37.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.392+0000 7ff23be00640 1 -- 172.21.15.99:0/4035271073 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5645edfa4bc0 msgr2=0x5645edf96e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:37.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.392+0000 7ff23be00640 1 --2- 172.21.15.99:0/4035271073 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5645edfa4bc0 0x5645edf96e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:37.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.392+0000 7ff23be00640 1 -- 172.21.15.99:0/4035271073 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5645edbe53f0 con 0x5645edfa42a0 2024-02-21T23:10:37.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.392+0000 7ff241200640 1 --2- 172.21.15.99:0/4035271073 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5645edfda260 0x5645edf9eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T23:10:37.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.392+0000 7ff23be00640 1 --2- 172.21.15.99:0/4035271073 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5645edfa42a0 0x5645edfef480 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7ff22c093b30 tx=0x7ff22c095770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75128161cf904ca9 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:37.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.392+0000 7ff229600640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-02-21T23:10:37.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.392+0000 7ff229600640 1 -- 172.21.15.99:0/4035271073 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22c0af310 con 0x5645edfa42a0 2024-02-21T23:10:37.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.392+0000 7ff229600640 1 -- 172.21.15.99:0/4035271073 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(36..36 src has 1..36) v4 ==== 8877+0+0 (secure 0 0 0) 0x7ff22c096bb0 con 0x5645edfa42a0 2024-02-21T23:10:37.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.392+0000 7ff246045740 1 -- 172.21.15.99:0/4035271073 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff22c0c7720 con 0x5645edfa42a0 2024-02-21T23:10:37.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.393+0000 7ff229600640 1 -- 172.21.15.99:0/4035271073 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff22c096db0 con 0x5645edfa42a0 2024-02-21T23:10:37.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.393+0000 7ff246045740 10 client.6967 fetch_fsmap learned FSMap version 17 2024-02-21T23:10:37.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.393+0000 7ff246045740 1 -- 172.21.15.99:0/4035271073 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5645edba50f0 con 0x5645edfa42a0 2024-02-21T23:10:37.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.393+0000 7ff229600640 1 -- 172.21.15.99:0/4035271073 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff22c0c7720 con 0x5645edfa42a0 2024-02-21T23:10:37.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.393+0000 7ff229600640 1 -- 172.21.15.99:0/4035271073 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7ff22c093420 con 0x5645edfa42a0 2024-02-21T23:10:37.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.393+0000 7ff246045740 10 client.6967 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:10:37.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.393+0000 7ff246045740 10 client.6967 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:10:37.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.393+0000 7ff246045740 20 client.6967 populate_metadata read hostname 'smithi099' 2024-02-21T23:10:37.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.393+0000 7ff246045740 1 --2- 172.21.15.99:0/4035271073 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5645edf657e0 0x5645edf65c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:37.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.394+0000 7ff246045740 4 client.6967 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:10:37.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.394+0000 7ff246045740 1 -- 172.21.15.99:0/4035271073 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5645ededdfd0 con 0x5645edf657e0 2024-02-21T23:10:37.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.394+0000 7ff23b400640 1 --2- 172.21.15.99:0/4035271073 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5645edf657e0 0x5645edf65c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:37.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.396+0000 7ff23b400640 1 --2- 172.21.15.99:0/4035271073 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5645edf657e0 0x5645edf65c70 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7a783334e9210f6 server_cookie=434578d07ee8e95f in_seq=0 out_seq=0 2024-02-21T23:10:37.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.396+0000 7ff229600640 10 client.6967 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:10:37.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.397+0000 7ff229600640 1 -- 172.21.15.99:0/4035271073 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x5645ededdfd0 con 0x5645edf657e0 2024-02-21T23:10:37.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.397+0000 7ff229600640 10 client.6967 handle_command_reply: tid=0 2024-02-21T23:10:37.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.397+0000 7ff246045740 1 client.6967 shutdown 2024-02-21T23:10:37.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.398+0000 7ff246045740 1 -- 172.21.15.99:0/4035271073 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5645edfa42a0 msgr2=0x5645edfef480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:37.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.398+0000 7ff246045740 1 --2- 172.21.15.99:0/4035271073 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5645edfa42a0 0x5645edfef480 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7ff22c093b30 tx=0x7ff22c095770 comp rx=0 tx=0).stop 2024-02-21T23:10:37.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.399+0000 7ff246045740 1 -- 172.21.15.99:0/4035271073 shutdown_connections 2024-02-21T23:10:37.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.399+0000 7ff246045740 1 --2- 172.21.15.99:0/4035271073 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5645edf657e0 0x5645edf65c70 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:37.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.399+0000 7ff246045740 1 --2- 172.21.15.99:0/4035271073 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5645edfda260 0x5645edf9eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:37.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.399+0000 7ff246045740 1 --2- 172.21.15.99:0/4035271073 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5645edfa4bc0 0x5645edf96e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:37.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.399+0000 7ff246045740 1 --2- 172.21.15.99:0/4035271073 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5645edfa42a0 0x5645edfef480 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:37.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.399+0000 7ff246045740 1 -- 172.21.15.99:0/4035271073 >> 172.21.15.99:0/4035271073 conn(0x5645edf336b0 msgr2=0x5645edfd9af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:10:37.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.399+0000 7ff229600640 0 client.6967 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:10:37.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.399+0000 7ff246045740 1 -- 172.21.15.99:0/4035271073 shutdown_connections 2024-02-21T23:10:37.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.399+0000 7ff246045740 1 -- 172.21.15.99:0/4035271073 wait complete. 2024-02-21T23:10:37.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.400+0000 7ff246045740 20 client.6967 trim_cache size 0 max 16384 2024-02-21T23:10:37.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.433+0000 7ff246045740 1 Processor -- start 2024-02-21T23:10:37.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.433+0000 7ff246045740 1 -- start start 2024-02-21T23:10:37.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.434+0000 7ff246045740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5645edfa4bc0 0x5645edfde920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:37.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.434+0000 7ff246045740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5645edfda260 0x5645edf65db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:37.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.434+0000 7ff246045740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5645edfdb470 0x5645edf9ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:37.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.434+0000 7ff246045740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff23c230ed0 con 0x5645edfda260 2024-02-21T23:10:37.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.434+0000 7ff246045740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff23c22ea70 con 0x5645edfa4bc0 2024-02-21T23:10:37.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.434+0000 7ff246045740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff23c22cc00 con 0x5645edfdb470 2024-02-21T23:10:37.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.435+0000 7ff23be00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5645edfa4bc0 0x5645edfde920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:37.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.435+0000 7ff23be00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5645edfa4bc0 0x5645edfde920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:53890/0 (socket says 172.21.15.99:53890) 2024-02-21T23:10:37.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.435+0000 7ff23be00640 1 -- 172.21.15.99:0/812270640 learned_addr learned my addr 172.21.15.99:0/812270640 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:10:37.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.435+0000 7ff241200640 1 --2- 172.21.15.99:0/812270640 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5645edfdb470 0x5645edf9ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:37.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.435+0000 7ff23b400640 1 --2- 172.21.15.99:0/812270640 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5645edfda260 0x5645edf65db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:37.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.435+0000 7ff23be00640 1 -- 172.21.15.99:0/812270640 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5645edfdb470 msgr2=0x5645edf9ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:37.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.435+0000 7ff23be00640 1 --2- 172.21.15.99:0/812270640 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5645edfdb470 0x5645edf9ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:37.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.436+0000 7ff23be00640 1 -- 172.21.15.99:0/812270640 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5645edfda260 msgr2=0x5645edf65db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:37.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.436+0000 7ff23be00640 1 --2- 172.21.15.99:0/812270640 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5645edfda260 0x5645edf65db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:37.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.436+0000 7ff23be00640 1 -- 172.21.15.99:0/812270640 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5645edf714c0 con 0x5645edfa4bc0 2024-02-21T23:10:37.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.436+0000 7ff23b400640 1 --2- 172.21.15.99:0/812270640 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5645edfda260 0x5645edf65db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T23:10:37.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.436+0000 7ff241200640 1 --2- 172.21.15.99:0/812270640 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5645edfdb470 0x5645edf9ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:10:37.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.436+0000 7ff23be00640 1 --2- 172.21.15.99:0/812270640 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5645edfa4bc0 0x5645edfde920 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7ff22c0b5fd0 tx=0x7ff22c0ac000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98a1fcc6032ecb57 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:37.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.436+0000 7ff22be00640 1 -- 172.21.15.99:0/812270640 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22c093420 con 0x5645edfa4bc0 2024-02-21T23:10:37.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.436+0000 7ff22be00640 1 -- 172.21.15.99:0/812270640 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff22c0c7690 con 0x5645edfa4bc0 2024-02-21T23:10:37.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.436+0000 7ff22be00640 1 -- 172.21.15.99:0/812270640 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22c004b60 con 0x5645edfa4bc0 2024-02-21T23:10:37.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.437+0000 7ff246045740 1 -- 172.21.15.99:0/812270640 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5645edfa4bc0 msgr2=0x5645edfde920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:37.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.437+0000 7ff246045740 1 --2- 172.21.15.99:0/812270640 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5645edfa4bc0 0x5645edfde920 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7ff22c0b5fd0 tx=0x7ff22c0ac000 comp rx=0 tx=0).stop 2024-02-21T23:10:37.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.437+0000 7ff246045740 1 -- 172.21.15.99:0/812270640 shutdown_connections 2024-02-21T23:10:37.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.437+0000 7ff246045740 1 --2- 172.21.15.99:0/812270640 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5645edfdb470 0x5645edf9ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:37.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.437+0000 7ff246045740 1 --2- 172.21.15.99:0/812270640 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5645edfda260 0x5645edf65db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:37.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.437+0000 7ff246045740 1 --2- 172.21.15.99:0/812270640 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5645edfa4bc0 0x5645edfde920 secure :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7ff22c0b5fd0 tx=0x7ff22c0ac000 comp rx=0 tx=0).stop 2024-02-21T23:10:37.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.437+0000 7ff246045740 1 -- 172.21.15.99:0/812270640 >> 172.21.15.99:0/812270640 conn(0x5645edf336b0 msgr2=0x5645edfe9760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:10:37.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.438+0000 7ff246045740 1 -- 172.21.15.99:0/812270640 shutdown_connections 2024-02-21T23:10:37.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.438+0000 7ff246045740 1 -- 172.21.15.99:0/812270640 wait complete. 2024-02-21T23:10:37.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.439+0000 7ff246045740 1 -- start start 2024-02-21T23:10:37.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.439+0000 7ff246045740 1 Processor -- start 2024-02-21T23:10:37.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.443+0000 7ff246045740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5645edfda260 0x5645edf659f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:37.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.443+0000 7ff246045740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5645edfdb470 0x5645ee0489d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:37.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.443+0000 7ff246045740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5645edfde4c0 0x5645edf70b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:37.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.443+0000 7ff23be00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5645edfda260 0x5645edf659f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:37.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.443+0000 7ff23be00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5645edfda260 0x5645edf659f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:47534/0 (socket says 172.21.15.99:47534) 2024-02-21T23:10:37.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.444+0000 7ff23b400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5645edfdb470 0x5645ee0489d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:37.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.444+0000 7ff23b400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5645edfdb470 0x5645ee0489d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:53898/0 (socket says 172.21.15.99:53898) 2024-02-21T23:10:37.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.444+0000 7ff23be00640 1 -- 172.21.15.99:0/2818971754 learned_addr learned my addr 172.21.15.99:0/2818971754 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:10:37.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.444+0000 7ff246045740 1 -- 172.21.15.99:0/2818971754 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff23c22d130 con 0x5645edfde4c0 2024-02-21T23:10:37.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.444+0000 7ff246045740 1 -- 172.21.15.99:0/2818971754 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff23c22e410 con 0x5645edfdb470 2024-02-21T23:10:37.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.444+0000 7ff246045740 1 -- 172.21.15.99:0/2818971754 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff23c22d750 con 0x5645edfda260 2024-02-21T23:10:37.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.444+0000 7ff246045740 10 client.0 _ll_register_callbacks cb 0x7ff22c001de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:10:37.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.444+0000 7ff23be00640 1 -- 172.21.15.99:0/2818971754 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5645edfdb470 msgr2=0x5645ee0489d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:37.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.444+0000 7ff23be00640 1 --2- 172.21.15.99:0/2818971754 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5645edfdb470 0x5645ee0489d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:37.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.444+0000 7ff23be00640 1 -- 172.21.15.99:0/2818971754 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5645edfde4c0 msgr2=0x5645edf70b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:10:37.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.445+0000 7ff241200640 1 --2- 172.21.15.99:0/2818971754 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5645edfde4c0 0x5645edf70b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:37.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.445+0000 7ff23be00640 1 --2- 172.21.15.99:0/2818971754 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5645edfde4c0 0x5645edf70b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:37.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.445+0000 7ff23be00640 1 -- 172.21.15.99:0/2818971754 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5645edf660c0 con 0x5645edfda260 2024-02-21T23:10:37.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.445+0000 7ff23be00640 1 --2- 172.21.15.99:0/2818971754 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5645edfda260 0x5645edf659f0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7ff22c0012e0 tx=0x7ff22c007070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f5b032062ece45 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:10:37.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.445+0000 7ff229600640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-02-21T23:10:37.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.445+0000 7ff229600640 1 -- 172.21.15.99:0/2818971754 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22c097760 con 0x5645edfda260 2024-02-21T23:10:37.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.445+0000 7ff229600640 1 -- 172.21.15.99:0/2818971754 <== mon.2 v2:172.21.15.181:3300/0 2 ==== osd_map(36..36 src has 1..36) v4 ==== 8877+0+0 (secure 0 0 0) 0x7ff22c0af310 con 0x5645edfda260 2024-02-21T23:10:37.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.446+0000 7ff246045740 1 -- 172.21.15.99:0/2818971754 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff22c0c7690 con 0x5645edfda260 2024-02-21T23:10:37.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.446+0000 7ff229600640 1 -- 172.21.15.99:0/2818971754 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff22c0c72e0 con 0x5645edfda260 2024-02-21T23:10:37.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.446+0000 7ff246045740 10 client.6914 fetch_fsmap learned FSMap version 17 2024-02-21T23:10:37.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.446+0000 7ff246045740 1 -- 172.21.15.99:0/2818971754 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5645edf660c0 con 0x5645edfda260 2024-02-21T23:10:37.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.447+0000 7ff229600640 1 -- 172.21.15.99:0/2818971754 <== mon.2 v2:172.21.15.181:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff22c0b4020 con 0x5645edfda260 2024-02-21T23:10:37.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.447+0000 7ff229600640 1 -- 172.21.15.99:0/2818971754 <== mon.2 v2:172.21.15.181:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7ff22c004b60 con 0x5645edfda260 2024-02-21T23:10:37.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.447+0000 7ff246045740 10 client.6914 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:10:37.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.447+0000 7ff246045740 10 client.6914 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:10:37.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.447+0000 7ff246045740 20 client.6914 populate_metadata read hostname 'smithi099' 2024-02-21T23:10:37.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.447+0000 7ff246045740 1 --2- 172.21.15.99:0/2818971754 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5645edf710c0 0x5645edf99770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:10:37.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.447+0000 7ff246045740 4 client.6914 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T23:10:37.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.447+0000 7ff246045740 1 -- 172.21.15.99:0/2818971754 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5645eded8320 con 0x5645edf710c0 2024-02-21T23:10:37.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.448+0000 7ff23b400640 1 --2- 172.21.15.99:0/2818971754 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5645edf710c0 0x5645edf99770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:10:37.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.449+0000 7ff23b400640 1 --2- 172.21.15.99:0/2818971754 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5645edf710c0 0x5645edf99770 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e23d0c10a2dbd01 server_cookie=345efb353e01b6fc in_seq=0 out_seq=0 2024-02-21T23:10:37.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.449+0000 7ff229600640 10 client.6914 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:10:37.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.450+0000 7ff229600640 1 -- 172.21.15.99:0/2818971754 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x5645eded8320 con 0x5645edf710c0 2024-02-21T23:10:37.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.450+0000 7ff229600640 10 client.6914 handle_command_reply: tid=0 2024-02-21T23:10:37.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.450+0000 7ff246045740 1 client.6914 shutdown 2024-02-21T23:10:37.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.451+0000 7ff246045740 1 -- 172.21.15.99:0/2818971754 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5645edfda260 msgr2=0x5645edf659f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:37.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.451+0000 7ff246045740 1 --2- 172.21.15.99:0/2818971754 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5645edfda260 0x5645edf659f0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7ff22c0012e0 tx=0x7ff22c007070 comp rx=0 tx=0).stop 2024-02-21T23:10:37.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.451+0000 7ff246045740 1 -- 172.21.15.99:0/2818971754 shutdown_connections 2024-02-21T23:10:37.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.451+0000 7ff246045740 1 --2- 172.21.15.99:0/2818971754 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5645edf710c0 0x5645edf99770 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:37.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.451+0000 7ff246045740 1 --2- 172.21.15.99:0/2818971754 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5645edfde4c0 0x5645edf70b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:37.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.451+0000 7ff246045740 1 --2- 172.21.15.99:0/2818971754 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5645edfdb470 0x5645ee0489d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:37.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.451+0000 7ff246045740 1 --2- 172.21.15.99:0/2818971754 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5645edfda260 0x5645edf659f0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:37.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.451+0000 7ff246045740 1 -- 172.21.15.99:0/2818971754 >> 172.21.15.99:0/2818971754 conn(0x5645edf336b0 msgr2=0x5645edf72260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:10:37.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.451+0000 7ff229600640 0 client.6914 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:10:37.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.452+0000 7ff246045740 1 -- 172.21.15.99:0/2818971754 shutdown_connections 2024-02-21T23:10:37.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.452+0000 7ff246045740 1 -- 172.21.15.99:0/2818971754 wait complete. 2024-02-21T23:10:37.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.452+0000 7ff246045740 20 client.6914 trim_cache size 0 max 16384 2024-02-21T23:10:37.444 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-02-21T23:10:37.445 INFO:teuthology.orchestra.run.smithi099.stdout: "status": "scrub active (809 inodes in the stack)", 2024-02-21T23:10:37.445 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubs": { 2024-02-21T23:10:37.445 INFO:teuthology.orchestra.run.smithi099.stdout: "3be23ca5-e038-4dba-8928-b7d56a260c63": { 2024-02-21T23:10:37.445 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/", 2024-02-21T23:10:37.445 INFO:teuthology.orchestra.run.smithi099.stdout: "tag": "3be23ca5-e038-4dba-8928-b7d56a260c63", 2024-02-21T23:10:37.445 INFO:teuthology.orchestra.run.smithi099.stdout: "options": "recursive,force" 2024-02-21T23:10:37.445 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:10:37.446 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:10:37.446 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-02-21T23:10:37.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.453+0000 7ff241c00640 1 -- 172.21.15.99:0/2658478082 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7ff21809f020 msgr2=0x7ff2180a14e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:37.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.453+0000 7ff241c00640 1 --2- 172.21.15.99:0/2658478082 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7ff21809f020 0x7ff2180a14e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff224035000 tx=0x7ff224008030 comp rx=0 tx=0).stop 2024-02-21T23:10:37.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.453+0000 7ff241c00640 1 -- 172.21.15.99:0/2658478082 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff23c18a770 msgr2=0x7ff23c221050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:10:37.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.453+0000 7ff241c00640 1 --2- 172.21.15.99:0/2658478082 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff23c18a770 0x7ff23c221050 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7ff22c00cc70 tx=0x7ff22c00a430 comp rx=0 tx=0).stop 2024-02-21T23:10:37.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.454+0000 7ff241c00640 1 -- 172.21.15.99:0/2658478082 shutdown_connections 2024-02-21T23:10:37.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.454+0000 7ff241c00640 1 --2- 172.21.15.99:0/2658478082 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7ff21809f020 0x7ff2180a14e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:37.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.454+0000 7ff241c00640 1 --2- 172.21.15.99:0/2658478082 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff23c1903e0 0x7ff23c16e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:37.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.454+0000 7ff241c00640 1 --2- 172.21.15.99:0/2658478082 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff23c18e2e0 0x7ff23c1531c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:37.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.454+0000 7ff241c00640 1 --2- 172.21.15.99:0/2658478082 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff23c18a770 0x7ff23c221050 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:10:37.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.454+0000 7ff241c00640 1 -- 172.21.15.99:0/2658478082 >> 172.21.15.99:0/2658478082 conn(0x7ff23c0ce4b0 msgr2=0x7ff23c0cf120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:10:37.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.454+0000 7ff241c00640 1 -- 172.21.15.99:0/2658478082 shutdown_connections 2024-02-21T23:10:37.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:10:37.454+0000 7ff241c00640 1 -- 172.21.15.99:0/2658478082 wait complete. 2024-02-21T23:10:37.466 INFO:tasks.cephfs.filesystem:scrub status for tag:3be23ca5-e038-4dba-8928-b7d56a260c63 - {'path': '/', 'tag': '3be23ca5-e038-4dba-8928-b7d56a260c63', 'options': 'recursive,force'} 2024-02-21T23:10:43.975 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:10:43.983 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:10:43.986 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:11:07.468 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T23:11:07.469 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T23:11:07.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.730+0000 7f7f41a00640 1 Processor -- start 2024-02-21T23:11:07.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.730+0000 7f7f41a00640 1 -- start start 2024-02-21T23:11:07.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.732+0000 7f7f41a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7f3c0f5cb0 0x7f7f3c06daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:07.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.732+0000 7f7f41a00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f3c0f6310 con 0x7f7f3c182cb0 2024-02-21T23:11:07.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.732+0000 7f7f41a00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f3c0f65f0 con 0x7f7f3c06fff0 2024-02-21T23:11:07.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.732+0000 7f7f41a00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f3c070480 con 0x7f7f3c0f5cb0 2024-02-21T23:11:07.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.733+0000 7f7f3be00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f7f3c182cb0 0x7f7f3c06d390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:48928/0 (socket says 172.21.15.99:48928) 2024-02-21T23:11:07.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.733+0000 7f7f3b400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7f3c0f5cb0 0x7f7f3c06daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:07.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.733+0000 7f7f3be00640 1 -- 172.21.15.99:0/173744042 learned_addr learned my addr 172.21.15.99:0/173744042 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:11:07.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.733+0000 7f7f3b400640 1 -- 172.21.15.99:0/173744042 >> v1:172.21.15.181:6789/0 conn(0x7f7f3c06fff0 legacy=0x7f7f3c18c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:07.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.733+0000 7f7f3b400640 1 -- 172.21.15.99:0/173744042 >> v1:172.21.15.99:6789/0 conn(0x7f7f3c182cb0 legacy=0x7f7f3c06d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:07.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.733+0000 7f7f3b400640 1 -- 172.21.15.99:0/173744042 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f3c0f68d0 con 0x7f7f3c0f5cb0 2024-02-21T23:11:07.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.733+0000 7f7f3aa00640 1 -- 172.21.15.99:0/173744042 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1346999958 0 0) 0x7f7f3c0f6310 con 0x7f7f3c182cb0 2024-02-21T23:11:07.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.735+0000 7f7f3b400640 1 --2- 172.21.15.99:0/173744042 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f3c0f5cb0 0x7f7f3c06daa0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f7f280097a0 tx=0x7f7f2802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=410350b7fd44c679 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:07.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.735+0000 7f7f3aa00640 1 -- 172.21.15.99:0/173744042 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f280315a0 con 0x7f7f3c0f5cb0 2024-02-21T23:11:07.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.735+0000 7f7f3aa00640 1 -- 172.21.15.99:0/173744042 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f28037070 con 0x7f7f3c0f5cb0 2024-02-21T23:11:07.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.735+0000 7f7f3aa00640 1 -- 172.21.15.99:0/173744042 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f28031960 con 0x7f7f3c0f5cb0 2024-02-21T23:11:07.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.735+0000 7f7f41a00640 1 -- 172.21.15.99:0/173744042 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f3c0f5cb0 msgr2=0x7f7f3c06daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:07.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.736+0000 7f7f41a00640 1 --2- 172.21.15.99:0/173744042 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f3c0f5cb0 0x7f7f3c06daa0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f7f280097a0 tx=0x7f7f2802b840 comp rx=0 tx=0).stop 2024-02-21T23:11:07.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.736+0000 7f7f41a00640 1 -- 172.21.15.99:0/173744042 shutdown_connections 2024-02-21T23:11:07.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.736+0000 7f7f41a00640 1 --2- 172.21.15.99:0/173744042 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f3c0f5cb0 0x7f7f3c06daa0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:07.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.736+0000 7f7f41a00640 1 -- 172.21.15.99:0/173744042 >> 172.21.15.99:0/173744042 conn(0x7f7f3c08cfd0 msgr2=0x7f7f3c08d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:11:07.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.736+0000 7f7f41a00640 1 -- 172.21.15.99:0/173744042 shutdown_connections 2024-02-21T23:11:07.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.736+0000 7f7f41a00640 1 -- 172.21.15.99:0/173744042 wait complete. 2024-02-21T23:11:07.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.739+0000 7f7f41a00640 1 Processor -- start 2024-02-21T23:11:07.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.739+0000 7f7f41a00640 1 -- start start 2024-02-21T23:11:07.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.741+0000 7f7f41a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f3c06fff0 0x7f7f3c16e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:07.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.741+0000 7f7f41a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7f3c0f5cb0 0x7f7f3c18b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:07.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.741+0000 7f7f41a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f3c182cb0 0x7f7f3c0747b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:07.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.741+0000 7f7f41a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3c183090 con 0x7f7f3c182cb0 2024-02-21T23:11:07.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.741+0000 7f7f41a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3c06cf00 con 0x7f7f3c06fff0 2024-02-21T23:11:07.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.741+0000 7f7f41a00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3c06cb90 con 0x7f7f3c0f5cb0 2024-02-21T23:11:07.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.742+0000 7f7f41000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f3c182cb0 0x7f7f3c0747b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:07.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.742+0000 7f7f3be00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f3c06fff0 0x7f7f3c16e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:07.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.742+0000 7f7f41000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f3c182cb0 0x7f7f3c0747b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34106/0 (socket says 172.21.15.99:34106) 2024-02-21T23:11:07.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.742+0000 7f7f41000640 1 -- 172.21.15.99:0/2173271055 learned_addr learned my addr 172.21.15.99:0/2173271055 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:11:07.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.742+0000 7f7f3b400640 1 --2- 172.21.15.99:0/2173271055 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7f3c0f5cb0 0x7f7f3c18b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:07.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.742+0000 7f7f41000640 1 -- 172.21.15.99:0/2173271055 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7f3c0f5cb0 msgr2=0x7f7f3c18b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:07.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.742+0000 7f7f41000640 1 --2- 172.21.15.99:0/2173271055 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7f3c0f5cb0 0x7f7f3c18b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:07.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.742+0000 7f7f41000640 1 -- 172.21.15.99:0/2173271055 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f3c06fff0 msgr2=0x7f7f3c16e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:07.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.742+0000 7f7f41000640 1 --2- 172.21.15.99:0/2173271055 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f3c06fff0 0x7f7f3c16e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:07.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.742+0000 7f7f41000640 1 -- 172.21.15.99:0/2173271055 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f3c18a760 con 0x7f7f3c182cb0 2024-02-21T23:11:07.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.742+0000 7f7f3be00640 1 --2- 172.21.15.99:0/2173271055 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f3c06fff0 0x7f7f3c16e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:11:07.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.743+0000 7f7f41000640 1 --2- 172.21.15.99:0/2173271055 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f3c182cb0 0x7f7f3c0747b0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f7f3400c6b0 tx=0x7f7f3400cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:07.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.743+0000 7f7f33e00640 1 -- 172.21.15.99:0/2173271055 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f34003b70 con 0x7f7f3c182cb0 2024-02-21T23:11:07.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.743+0000 7f7f33e00640 1 -- 172.21.15.99:0/2173271055 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f34003d30 con 0x7f7f3c182cb0 2024-02-21T23:11:07.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.743+0000 7f7f41a00640 1 -- 172.21.15.99:0/2173271055 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f3c174ce0 con 0x7f7f3c182cb0 2024-02-21T23:11:07.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.743+0000 7f7f33e00640 1 -- 172.21.15.99:0/2173271055 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f34005310 con 0x7f7f3c182cb0 2024-02-21T23:11:07.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.743+0000 7f7f41a00640 1 -- 172.21.15.99:0/2173271055 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f3c18ace0 con 0x7f7f3c182cb0 2024-02-21T23:11:07.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.747+0000 7f7f45e17740 1 Processor -- start 2024-02-21T23:11:07.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.748+0000 7f7f33e00640 1 -- 172.21.15.99:0/2173271055 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f7f340054b0 con 0x7f7f3c182cb0 2024-02-21T23:11:07.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.748+0000 7f7f45e17740 1 -- start start 2024-02-21T23:11:07.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.749+0000 7f7f45e17740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55994718b2a0 0x5599471c0d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:07.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.749+0000 7f7f45e17740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599471c1260 0x55994718b680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:07.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.749+0000 7f7f45e17740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55994718bbc0 0x55994714e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:07.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.749+0000 7f7f45e17740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599470b7a90 con 0x55994718b2a0 2024-02-21T23:11:07.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.749+0000 7f7f45e17740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x559947060b10 con 0x5599471c1260 2024-02-21T23:11:07.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.749+0000 7f7f45e17740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599470b3b30 con 0x55994718bbc0 2024-02-21T23:11:07.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.750+0000 7f7f3b400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55994718b2a0 0x5599471c0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:07.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.750+0000 7f7f3b400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55994718b2a0 0x5599471c0d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34122/0 (socket says 172.21.15.99:34122) 2024-02-21T23:11:07.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.750+0000 7f7f3b400640 1 -- 172.21.15.99:0/726238491 learned_addr learned my addr 172.21.15.99:0/726238491 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:11:07.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.750+0000 7f7f3be00640 1 --2- 172.21.15.99:0/726238491 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599471c1260 0x55994718b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:07.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.750+0000 7f7f3b400640 1 --2- 172.21.15.99:0/726238491 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55994718bbc0 0x55994714e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:07.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.750+0000 7f7f33e00640 1 --2- 172.21.15.99:0/2173271055 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f7f1c09eed0 0x7f7f1c0a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:07.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.750+0000 7f7f3be00640 1 -- 172.21.15.99:0/726238491 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55994718bbc0 msgr2=0x55994714e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:07.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.750+0000 7f7f3be00640 1 --2- 172.21.15.99:0/726238491 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55994718bbc0 0x55994714e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:07.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.750+0000 7f7f3be00640 1 -- 172.21.15.99:0/726238491 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55994718b2a0 msgr2=0x5599471c0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:07.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.750+0000 7f7f3be00640 1 --2- 172.21.15.99:0/726238491 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55994718b2a0 0x5599471c0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:07.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.750+0000 7f7f3be00640 1 -- 172.21.15.99:0/726238491 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559946e967d0 con 0x5599471c1260 2024-02-21T23:11:07.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.750+0000 7f7f33e00640 1 -- 172.21.15.99:0/2173271055 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f7f340c9cd0 con 0x7f7f3c182cb0 2024-02-21T23:11:07.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.751+0000 7f7f41000640 1 --2- 172.21.15.99:0/2173271055 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f7f1c09eed0 0x7f7f1c0a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:07.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.751+0000 7f7f3be00640 1 --2- 172.21.15.99:0/726238491 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599471c1260 0x55994718b680 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c007690 tx=0x7f7f2c004bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=96adaea06e9301ff server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:07.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.751+0000 7f7f30c00640 1 -- 172.21.15.99:0/726238491 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f2c01a070 con 0x5599471c1260 2024-02-21T23:11:07.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.751+0000 7f7f30c00640 1 -- 172.21.15.99:0/726238491 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f2c001ba0 con 0x5599471c1260 2024-02-21T23:11:07.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.751+0000 7f7f30c00640 1 -- 172.21.15.99:0/726238491 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f2c012550 con 0x5599471c1260 2024-02-21T23:11:07.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.752+0000 7f7f45e17740 1 -- 172.21.15.99:0/726238491 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599471c1260 msgr2=0x55994718b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:07.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.752+0000 7f7f41000640 1 --2- 172.21.15.99:0/2173271055 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f7f1c09eed0 0x7f7f1c0a1390 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7f3400a430 tx=0x7f7f34001380 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:07.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.752+0000 7f7f45e17740 1 --2- 172.21.15.99:0/726238491 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599471c1260 0x55994718b680 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c007690 tx=0x7f7f2c004bb0 comp rx=0 tx=0).stop 2024-02-21T23:11:07.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.752+0000 7f7f45e17740 1 -- 172.21.15.99:0/726238491 shutdown_connections 2024-02-21T23:11:07.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.752+0000 7f7f45e17740 1 --2- 172.21.15.99:0/726238491 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55994718bbc0 0x55994714e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:07.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.752+0000 7f7f45e17740 1 --2- 172.21.15.99:0/726238491 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599471c1260 0x55994718b680 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:07.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.752+0000 7f7f45e17740 1 --2- 172.21.15.99:0/726238491 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55994718b2a0 0x5599471c0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:07.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.752+0000 7f7f45e17740 1 -- 172.21.15.99:0/726238491 >> 172.21.15.99:0/726238491 conn(0x55994711a6b0 msgr2=0x559947152190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:11:07.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.752+0000 7f7f45e17740 1 -- 172.21.15.99:0/726238491 shutdown_connections 2024-02-21T23:11:07.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.752+0000 7f7f45e17740 1 -- 172.21.15.99:0/726238491 wait complete. 2024-02-21T23:11:07.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.753+0000 7f7f45e17740 1 -- start start 2024-02-21T23:11:07.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.754+0000 7f7f45e17740 1 Processor -- start 2024-02-21T23:11:07.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.756+0000 7f7f45e17740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55994718b2a0 0x559947181340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:07.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.756+0000 7f7f45e17740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55994718bbc0 0x5599471967e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:07.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.756+0000 7f7f45e17740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5599471c1260 0x5599471d6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:07.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.756+0000 7f7f45e17740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x559947159f30 con 0x55994718bbc0 2024-02-21T23:11:07.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.756+0000 7f7f45e17740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599470561c0 con 0x55994718b2a0 2024-02-21T23:11:07.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.756+0000 7f7f45e17740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599471c2930 con 0x5599471c1260 2024-02-21T23:11:07.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.756+0000 7f7f45e17740 10 client.0 _ll_register_callbacks cb 0x559947073930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:11:07.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.756+0000 7f7f3be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55994718bbc0 0x5599471967e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:07.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.756+0000 7f7f3be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55994718bbc0 0x5599471967e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34136/0 (socket says 172.21.15.99:34136) 2024-02-21T23:11:07.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.756+0000 7f7f3be00640 1 -- 172.21.15.99:0/963914798 learned_addr learned my addr 172.21.15.99:0/963914798 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:11:07.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.756+0000 7f7f3b400640 1 --2- 172.21.15.99:0/963914798 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55994718b2a0 0x559947181340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:07.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.756+0000 7f7f3b400640 1 --2- 172.21.15.99:0/963914798 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5599471c1260 0x5599471d6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:07.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.757+0000 7f7f3be00640 1 -- 172.21.15.99:0/963914798 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5599471c1260 msgr2=0x5599471d6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:07.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.757+0000 7f7f3be00640 1 --2- 172.21.15.99:0/963914798 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5599471c1260 0x5599471d6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:07.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.757+0000 7f7f3be00640 1 -- 172.21.15.99:0/963914798 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55994718b2a0 msgr2=0x559947181340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:07.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.757+0000 7f7f3be00640 1 --2- 172.21.15.99:0/963914798 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55994718b2a0 0x559947181340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:07.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.757+0000 7f7f3be00640 1 -- 172.21.15.99:0/963914798 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559946dcc3f0 con 0x55994718bbc0 2024-02-21T23:11:07.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.757+0000 7f7f3be00640 1 --2- 172.21.15.99:0/963914798 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55994718bbc0 0x5599471967e0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c0077e0 tx=0x7f7f2c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12755a8be342250e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:07.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.757+0000 7f7f25600640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:11:07.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.758+0000 7f7f25600640 1 -- 172.21.15.99:0/963914798 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f2c01a070 con 0x55994718bbc0 2024-02-21T23:11:07.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.758+0000 7f7f45e17740 1 -- 172.21.15.99:0/963914798 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7f2c001ba0 con 0x55994718bbc0 2024-02-21T23:11:07.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.758+0000 7f7f25600640 1 -- 172.21.15.99:0/963914798 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(36..36 src has 1..36) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f7f2c015d60 con 0x55994718bbc0 2024-02-21T23:11:07.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.758+0000 7f7f25600640 1 -- 172.21.15.99:0/963914798 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7f2c02d050 con 0x55994718bbc0 2024-02-21T23:11:07.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.758+0000 7f7f45e17740 10 client.6804 fetch_fsmap learned FSMap version 17 2024-02-21T23:11:07.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.758+0000 7f7f45e17740 1 -- 172.21.15.99:0/963914798 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x559946d8c0f0 con 0x55994718bbc0 2024-02-21T23:11:07.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.758+0000 7f7f25600640 1 -- 172.21.15.99:0/963914798 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f2c001ba0 con 0x55994718bbc0 2024-02-21T23:11:07.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.759+0000 7f7f25600640 1 -- 172.21.15.99:0/963914798 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f7f2c01f440 con 0x55994718bbc0 2024-02-21T23:11:07.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.759+0000 7f7f45e17740 10 client.6804 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:11:07.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.759+0000 7f7f45e17740 10 client.6804 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:11:07.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.759+0000 7f7f45e17740 20 client.6804 populate_metadata read hostname 'smithi099' 2024-02-21T23:11:07.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.759+0000 7f7f45e17740 1 --2- 172.21.15.99:0/963914798 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5599471d62e0 0x5599471c4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:07.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.759+0000 7f7f45e17740 4 client.6804 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:11:07.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.759+0000 7f7f45e17740 1 -- 172.21.15.99:0/963914798 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5599470c4fd0 con 0x5599471d62e0 2024-02-21T23:11:07.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.759+0000 7f7f3b400640 1 --2- 172.21.15.99:0/963914798 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5599471d62e0 0x5599471c4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:07.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.760+0000 7f7f3b400640 1 --2- 172.21.15.99:0/963914798 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5599471d62e0 0x5599471c4ca0 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9130eb29007c5553 server_cookie=20d3721e3084fba4 in_seq=0 out_seq=0 2024-02-21T23:11:07.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.760+0000 7f7f25600640 10 client.6804 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:11:07.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.760+0000 7f7f25600640 1 -- 172.21.15.99:0/963914798 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x5599470c4fd0 con 0x5599471d62e0 2024-02-21T23:11:07.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.760+0000 7f7f25600640 10 client.6804 handle_command_reply: tid=0 2024-02-21T23:11:07.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.760+0000 7f7f45e17740 1 client.6804 shutdown 2024-02-21T23:11:07.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.761+0000 7f7f45e17740 1 -- 172.21.15.99:0/963914798 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55994718bbc0 msgr2=0x5599471967e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:07.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.761+0000 7f7f45e17740 1 --2- 172.21.15.99:0/963914798 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55994718bbc0 0x5599471967e0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c0077e0 tx=0x7f7f2c000ed0 comp rx=0 tx=0).stop 2024-02-21T23:11:07.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.761+0000 7f7f45e17740 1 -- 172.21.15.99:0/963914798 shutdown_connections 2024-02-21T23:11:07.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.761+0000 7f7f45e17740 1 --2- 172.21.15.99:0/963914798 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5599471d62e0 0x5599471c4ca0 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:07.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.761+0000 7f7f45e17740 1 --2- 172.21.15.99:0/963914798 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5599471c1260 0x5599471d6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:07.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.761+0000 7f7f45e17740 1 --2- 172.21.15.99:0/963914798 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55994718bbc0 0x5599471967e0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:07.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.761+0000 7f7f45e17740 1 --2- 172.21.15.99:0/963914798 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55994718b2a0 0x559947181340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:07.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.761+0000 7f7f25600640 0 client.6804 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:11:07.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.761+0000 7f7f45e17740 1 -- 172.21.15.99:0/963914798 >> 172.21.15.99:0/963914798 conn(0x55994711a6b0 msgr2=0x5599471c2e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:11:07.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.761+0000 7f7f45e17740 1 -- 172.21.15.99:0/963914798 shutdown_connections 2024-02-21T23:11:07.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.761+0000 7f7f45e17740 1 -- 172.21.15.99:0/963914798 wait complete. 2024-02-21T23:11:07.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.761+0000 7f7f45e17740 20 client.6804 trim_cache size 0 max 16384 2024-02-21T23:11:07.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.779+0000 7f7f45e17740 1 Processor -- start 2024-02-21T23:11:07.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.779+0000 7f7f45e17740 1 -- start start 2024-02-21T23:11:07.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.780+0000 7f7f45e17740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55994718b2a0 0x559947191fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:07.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.780+0000 7f7f45e17740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55994718bbc0 0x559947151110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:07.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.780+0000 7f7f45e17740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5599471c1260 0x5599471c1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:07.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.780+0000 7f7f45e17740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3c22c920 con 0x55994718b2a0 2024-02-21T23:11:07.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.780+0000 7f7f45e17740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3c22a4c0 con 0x55994718bbc0 2024-02-21T23:11:07.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.780+0000 7f7f45e17740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3c21fa50 con 0x5599471c1260 2024-02-21T23:11:07.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.780+0000 7f7f3b400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55994718b2a0 0x559947191fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:07.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.780+0000 7f7f3b400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55994718b2a0 0x559947191fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34146/0 (socket says 172.21.15.99:34146) 2024-02-21T23:11:07.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.780+0000 7f7f3b400640 1 -- 172.21.15.99:0/3217793587 learned_addr learned my addr 172.21.15.99:0/3217793587 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:11:07.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.780+0000 7f7f3be00640 1 --2- 172.21.15.99:0/3217793587 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55994718bbc0 0x559947151110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:07.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.781+0000 7f7f3b400640 1 --2- 172.21.15.99:0/3217793587 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5599471c1260 0x5599471c1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:07.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.781+0000 7f7f3b400640 1 -- 172.21.15.99:0/3217793587 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5599471c1260 msgr2=0x5599471c1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:07.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.781+0000 7f7f3b400640 1 --2- 172.21.15.99:0/3217793587 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5599471c1260 0x5599471c1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:07.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.781+0000 7f7f3b400640 1 -- 172.21.15.99:0/3217793587 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55994718bbc0 msgr2=0x559947151110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:07.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.781+0000 7f7f3b400640 1 --2- 172.21.15.99:0/3217793587 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55994718bbc0 0x559947151110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:07.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.781+0000 7f7f3b400640 1 -- 172.21.15.99:0/3217793587 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55994718b9f0 con 0x55994718b2a0 2024-02-21T23:11:07.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.781+0000 7f7f3b400640 1 --2- 172.21.15.99:0/3217793587 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55994718b2a0 0x559947191fd0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f7f2802b880 tx=0x7f7f28008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1af494a8f30192 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:07.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.781+0000 7f7f27e00640 1 -- 172.21.15.99:0/3217793587 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f28045040 con 0x55994718b2a0 2024-02-21T23:11:07.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.781+0000 7f7f27e00640 1 -- 172.21.15.99:0/3217793587 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f28046040 con 0x55994718b2a0 2024-02-21T23:11:07.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.781+0000 7f7f27e00640 1 -- 172.21.15.99:0/3217793587 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f28053120 con 0x55994718b2a0 2024-02-21T23:11:07.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.782+0000 7f7f45e17740 1 -- 172.21.15.99:0/3217793587 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55994718b2a0 msgr2=0x559947191fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:07.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.782+0000 7f7f45e17740 1 --2- 172.21.15.99:0/3217793587 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55994718b2a0 0x559947191fd0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f7f2802b880 tx=0x7f7f28008030 comp rx=0 tx=0).stop 2024-02-21T23:11:07.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.782+0000 7f7f45e17740 1 -- 172.21.15.99:0/3217793587 shutdown_connections 2024-02-21T23:11:07.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.782+0000 7f7f45e17740 1 --2- 172.21.15.99:0/3217793587 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5599471c1260 0x5599471c1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:07.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.782+0000 7f7f45e17740 1 --2- 172.21.15.99:0/3217793587 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55994718bbc0 0x559947151110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:07.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.782+0000 7f7f45e17740 1 --2- 172.21.15.99:0/3217793587 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55994718b2a0 0x559947191fd0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:07.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.782+0000 7f7f45e17740 1 -- 172.21.15.99:0/3217793587 >> 172.21.15.99:0/3217793587 conn(0x55994711a6b0 msgr2=0x5599471c05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:11:07.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.782+0000 7f7f45e17740 1 -- 172.21.15.99:0/3217793587 shutdown_connections 2024-02-21T23:11:07.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.782+0000 7f7f45e17740 1 -- 172.21.15.99:0/3217793587 wait complete. 2024-02-21T23:11:07.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.783+0000 7f7f45e17740 1 -- start start 2024-02-21T23:11:07.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.784+0000 7f7f45e17740 1 Processor -- start 2024-02-21T23:11:07.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.786+0000 7f7f45e17740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55994718b2a0 0x559947149300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:07.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.786+0000 7f7f45e17740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55994718bbc0 0x5599471511a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:07.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.786+0000 7f7f45e17740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599471c1260 0x559947183c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:07.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.786+0000 7f7f45e17740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3c228ba0 con 0x55994718b2a0 2024-02-21T23:11:07.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.786+0000 7f7f45e17740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3c229e60 con 0x5599471c1260 2024-02-21T23:11:07.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.786+0000 7f7f45e17740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3c2291a0 con 0x55994718bbc0 2024-02-21T23:11:07.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.786+0000 7f7f45e17740 10 client.0 _ll_register_callbacks cb 0x7f7f2c007510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:11:07.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.786+0000 7f7f3b400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55994718b2a0 0x559947149300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:07.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.786+0000 7f7f3b400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55994718b2a0 0x559947149300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34154/0 (socket says 172.21.15.99:34154) 2024-02-21T23:11:07.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.786+0000 7f7f3b400640 1 -- 172.21.15.99:0/3759359410 learned_addr learned my addr 172.21.15.99:0/3759359410 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:11:07.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.786+0000 7f7f3be00640 1 --2- 172.21.15.99:0/3759359410 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55994718bbc0 0x5599471511a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:07.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.787+0000 7f7f3b400640 1 --2- 172.21.15.99:0/3759359410 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599471c1260 0x559947183c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:07.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.787+0000 7f7f3b400640 1 -- 172.21.15.99:0/3759359410 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55994718bbc0 msgr2=0x5599471511a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:07.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.787+0000 7f7f3b400640 1 --2- 172.21.15.99:0/3759359410 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55994718bbc0 0x5599471511a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:07.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.787+0000 7f7f3b400640 1 -- 172.21.15.99:0/3759359410 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599471c1260 msgr2=0x559947183c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:07.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.787+0000 7f7f3b400640 1 --2- 172.21.15.99:0/3759359410 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599471c1260 0x559947183c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:07.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.787+0000 7f7f3b400640 1 -- 172.21.15.99:0/3759359410 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5599471841a0 con 0x55994718b2a0 2024-02-21T23:11:07.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.787+0000 7f7f3b400640 1 --2- 172.21.15.99:0/3759359410 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55994718b2a0 0x559947149300 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f7f28009890 tx=0x7f7f2c00c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c22aaf93f853243 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:07.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.787+0000 7f7f25600640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:11:07.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.787+0000 7f7f25600640 1 -- 172.21.15.99:0/3759359410 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f28045040 con 0x55994718b2a0 2024-02-21T23:11:07.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.787+0000 7f7f25600640 1 -- 172.21.15.99:0/3759359410 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(36..36 src has 1..36) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f7f280531e0 con 0x55994718b2a0 2024-02-21T23:11:07.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.787+0000 7f7f45e17740 1 -- 172.21.15.99:0/3759359410 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7f28046040 con 0x55994718b2a0 2024-02-21T23:11:07.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.788+0000 7f7f25600640 1 -- 172.21.15.99:0/3759359410 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7f28060050 con 0x55994718b2a0 2024-02-21T23:11:07.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.788+0000 7f7f45e17740 10 client.6810 fetch_fsmap learned FSMap version 17 2024-02-21T23:11:07.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.788+0000 7f7f45e17740 1 -- 172.21.15.99:0/3759359410 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5599471c5100 con 0x55994718b2a0 2024-02-21T23:11:07.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.788+0000 7f7f25600640 1 -- 172.21.15.99:0/3759359410 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f28046040 con 0x55994718b2a0 2024-02-21T23:11:07.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.788+0000 7f7f25600640 1 -- 172.21.15.99:0/3759359410 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f7f28031070 con 0x55994718b2a0 2024-02-21T23:11:07.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.788+0000 7f7f45e17740 10 client.6810 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:11:07.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.788+0000 7f7f45e17740 10 client.6810 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:11:07.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.788+0000 7f7f45e17740 20 client.6810 populate_metadata read hostname 'smithi099' 2024-02-21T23:11:07.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.788+0000 7f7f45e17740 1 --2- 172.21.15.99:0/3759359410 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5599471c2be0 0x55994722afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:07.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.788+0000 7f7f45e17740 4 client.6810 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T23:11:07.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.788+0000 7f7f45e17740 1 -- 172.21.15.99:0/3759359410 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5599470bf320 con 0x5599471c2be0 2024-02-21T23:11:07.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.789+0000 7f7f3be00640 1 --2- 172.21.15.99:0/3759359410 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5599471c2be0 0x55994722afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:07.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.789+0000 7f7f3be00640 1 --2- 172.21.15.99:0/3759359410 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5599471c2be0 0x55994722afb0 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45792f69984bfedb server_cookie=f0df4077de89d3e6 in_seq=0 out_seq=0 2024-02-21T23:11:07.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.789+0000 7f7f25600640 10 client.6810 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:11:07.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.789+0000 7f7f25600640 1 -- 172.21.15.99:0/3759359410 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5599470bf320 con 0x5599471c2be0 2024-02-21T23:11:07.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.789+0000 7f7f25600640 10 client.6810 handle_command_reply: tid=0 2024-02-21T23:11:07.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.789+0000 7f7f45e17740 1 client.6810 shutdown 2024-02-21T23:11:07.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.790+0000 7f7f45e17740 1 -- 172.21.15.99:0/3759359410 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55994718b2a0 msgr2=0x559947149300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:07.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.790+0000 7f7f45e17740 1 --2- 172.21.15.99:0/3759359410 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55994718b2a0 0x559947149300 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f7f28009890 tx=0x7f7f2c00c000 comp rx=0 tx=0).stop 2024-02-21T23:11:07.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.790+0000 7f7f45e17740 1 -- 172.21.15.99:0/3759359410 shutdown_connections 2024-02-21T23:11:07.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.790+0000 7f7f45e17740 1 --2- 172.21.15.99:0/3759359410 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5599471c2be0 0x55994722afb0 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:07.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.790+0000 7f7f45e17740 1 --2- 172.21.15.99:0/3759359410 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5599471c1260 0x559947183c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:07.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.790+0000 7f7f25600640 0 client.6810 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:11:07.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.790+0000 7f7f45e17740 1 --2- 172.21.15.99:0/3759359410 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55994718bbc0 0x5599471511a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:07.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.790+0000 7f7f45e17740 1 --2- 172.21.15.99:0/3759359410 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55994718b2a0 0x559947149300 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:07.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.790+0000 7f7f45e17740 1 -- 172.21.15.99:0/3759359410 >> 172.21.15.99:0/3759359410 conn(0x55994711a6b0 msgr2=0x5599471c0540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:11:07.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.790+0000 7f7f45e17740 1 -- 172.21.15.99:0/3759359410 shutdown_connections 2024-02-21T23:11:07.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.790+0000 7f7f45e17740 1 -- 172.21.15.99:0/3759359410 wait complete. 2024-02-21T23:11:07.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.790+0000 7f7f45e17740 20 client.6810 trim_cache size 0 max 16384 2024-02-21T23:11:07.790 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-02-21T23:11:07.791 INFO:teuthology.orchestra.run.smithi099.stdout: "status": "no active scrubs running", 2024-02-21T23:11:07.791 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubs": {} 2024-02-21T23:11:07.791 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-02-21T23:11:07.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.791+0000 7f7f41a00640 1 -- 172.21.15.99:0/2173271055 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f7f1c09eed0 msgr2=0x7f7f1c0a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:07.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.791+0000 7f7f41a00640 1 --2- 172.21.15.99:0/2173271055 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f7f1c09eed0 0x7f7f1c0a1390 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7f3400a430 tx=0x7f7f34001380 comp rx=0 tx=0).stop 2024-02-21T23:11:07.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.791+0000 7f7f41a00640 1 -- 172.21.15.99:0/2173271055 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f3c182cb0 msgr2=0x7f7f3c0747b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:07.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.791+0000 7f7f41a00640 1 --2- 172.21.15.99:0/2173271055 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f3c182cb0 0x7f7f3c0747b0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f7f3400c6b0 tx=0x7f7f3400cb70 comp rx=0 tx=0).stop 2024-02-21T23:11:07.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.791+0000 7f7f41a00640 1 -- 172.21.15.99:0/2173271055 shutdown_connections 2024-02-21T23:11:07.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.791+0000 7f7f41a00640 1 --2- 172.21.15.99:0/2173271055 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f7f1c09eed0 0x7f7f1c0a1390 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:07.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.791+0000 7f7f41a00640 1 --2- 172.21.15.99:0/2173271055 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7f3c182cb0 0x7f7f3c0747b0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:07.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.791+0000 7f7f41a00640 1 --2- 172.21.15.99:0/2173271055 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7f3c0f5cb0 0x7f7f3c18b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:07.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.791+0000 7f7f41a00640 1 --2- 172.21.15.99:0/2173271055 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f3c06fff0 0x7f7f3c16e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:07.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.791+0000 7f7f41a00640 1 -- 172.21.15.99:0/2173271055 >> 172.21.15.99:0/2173271055 conn(0x7f7f3c08cfd0 msgr2=0x7f7f3c0fa7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:11:07.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.791+0000 7f7f41a00640 1 -- 172.21.15.99:0/2173271055 shutdown_connections 2024-02-21T23:11:07.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.791+0000 7f7f41a00640 1 -- 172.21.15.99:0/2173271055 wait complete. 2024-02-21T23:11:07.798 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-02-21T23:11:07.798 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T23:11:07.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.991+0000 7fcfdc800640 1 Processor -- start 2024-02-21T23:11:07.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.991+0000 7fcfdc800640 1 -- start start 2024-02-21T23:11:07.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.993+0000 7fcfdc800640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fcfd41833f0 0x7fcfd40f8020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:07.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.993+0000 7fcfdc800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fcfd4184cd0 0x7fcfd406e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:07.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.993+0000 7fcfdc800640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfd40f89a0 con 0x7fcfd40f8560 2024-02-21T23:11:07.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.993+0000 7fcfdc800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfd4186a10 con 0x7fcfd4184cd0 2024-02-21T23:11:07.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.993+0000 7fcfdc800640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfd40f8c40 con 0x7fcfd41833f0 2024-02-21T23:11:07.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.993+0000 7fcfd9e00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fcfd41833f0 0x7fcfd40f8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:07.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.993+0000 7fcfd9400640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fcfd40f8560 0x7fcfd41845c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:53780/0 (socket says 172.21.15.99:53780) 2024-02-21T23:11:07.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.993+0000 7fcfd9400640 1 -- 172.21.15.99:0/603660425 learned_addr learned my addr 172.21.15.99:0/603660425 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:11:07.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.993+0000 7fcfda800640 1 --2- 172.21.15.99:0/603660425 >> v2:172.21.15.162:3300/0 conn(0x7fcfd4184cd0 0x7fcfd406e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:07.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.994+0000 7fcfd8a00640 1 -- 172.21.15.99:0/603660425 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2704124060 0 0) 0x7fcfd40f89a0 con 0x7fcfd40f8560 2024-02-21T23:11:07.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.994+0000 7fcfd9e00640 1 -- 172.21.15.99:0/603660425 >> v2:172.21.15.162:3300/0 conn(0x7fcfd4184cd0 msgr2=0x7fcfd406e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:07.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.994+0000 7fcfd9e00640 1 --2- 172.21.15.99:0/603660425 >> v2:172.21.15.162:3300/0 conn(0x7fcfd4184cd0 0x7fcfd406e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:07.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.994+0000 7fcfd9e00640 1 -- 172.21.15.99:0/603660425 >> v1:172.21.15.181:6789/0 conn(0x7fcfd40f8560 legacy=0x7fcfd41845c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:07.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.994+0000 7fcfd9e00640 1 -- 172.21.15.99:0/603660425 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfd40f8f20 con 0x7fcfd41833f0 2024-02-21T23:11:07.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.994+0000 7fcfda800640 1 --2- 172.21.15.99:0/603660425 >> v2:172.21.15.162:3300/0 conn(0x7fcfd4184cd0 0x7fcfd406e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:11:07.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.995+0000 7fcfd9e00640 1 --2- 172.21.15.99:0/603660425 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcfd41833f0 0x7fcfd40f8020 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fcfd40fb220 tx=0x7fcfc802e010 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57491a9ba3c0e53a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:07.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.995+0000 7fcfd8a00640 1 -- 172.21.15.99:0/603660425 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc803b070 con 0x7fcfd41833f0 2024-02-21T23:11:07.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.995+0000 7fcfd8a00640 1 -- 172.21.15.99:0/603660425 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfc802edc0 con 0x7fcfd41833f0 2024-02-21T23:11:07.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.995+0000 7fcfd8a00640 1 -- 172.21.15.99:0/603660425 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc8036660 con 0x7fcfd41833f0 2024-02-21T23:11:07.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.996+0000 7fcfdc800640 1 -- 172.21.15.99:0/603660425 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcfd41833f0 msgr2=0x7fcfd40f8020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:07.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.996+0000 7fcfdc800640 1 --2- 172.21.15.99:0/603660425 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcfd41833f0 0x7fcfd40f8020 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fcfd40fb220 tx=0x7fcfc802e010 comp rx=0 tx=0).stop 2024-02-21T23:11:07.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.996+0000 7fcfdc800640 1 -- 172.21.15.99:0/603660425 shutdown_connections 2024-02-21T23:11:07.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.996+0000 7fcfdc800640 1 --2- 172.21.15.99:0/603660425 >> v2:172.21.15.162:3300/0 conn(0x7fcfd4184cd0 0x7fcfd406e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:07.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.996+0000 7fcfdc800640 1 --2- 172.21.15.99:0/603660425 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcfd41833f0 0x7fcfd40f8020 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:07.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.996+0000 7fcfdc800640 1 -- 172.21.15.99:0/603660425 >> 172.21.15.99:0/603660425 conn(0x7fcfd40ce5f0 msgr2=0x7fcfd40cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:11:07.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.996+0000 7fcfdc800640 1 -- 172.21.15.99:0/603660425 shutdown_connections 2024-02-21T23:11:07.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.996+0000 7fcfdc800640 1 -- 172.21.15.99:0/603660425 wait complete. 2024-02-21T23:11:07.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:07.999+0000 7fcfdc800640 1 Processor -- start 2024-02-21T23:11:07.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.000+0000 7fcfdc800640 1 -- start start 2024-02-21T23:11:07.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.001+0000 7fcfdc800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcfd40f8560 0x7fcfd42232a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:07.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.002+0000 7fcfdc800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcfd41833f0 0x7fcfd4071d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:07.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.002+0000 7fcfdc800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcfd4184cd0 0x7fcfd416d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:07.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.002+0000 7fcfdc800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd41840a0 con 0x7fcfd40f8560 2024-02-21T23:11:07.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.002+0000 7fcfdc800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd4183dc0 con 0x7fcfd4184cd0 2024-02-21T23:11:07.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.002+0000 7fcfdc800640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd4185120 con 0x7fcfd41833f0 2024-02-21T23:11:07.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.002+0000 7fcfd9e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcfd40f8560 0x7fcfd42232a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:07.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.002+0000 7fcfd9400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcfd41833f0 0x7fcfd4071d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:07.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.002+0000 7fcfd9e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcfd40f8560 0x7fcfd42232a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34160/0 (socket says 172.21.15.99:34160) 2024-02-21T23:11:07.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.002+0000 7fcfd9e00640 1 -- 172.21.15.99:0/2470656496 learned_addr learned my addr 172.21.15.99:0/2470656496 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:11:07.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.002+0000 7fcfda800640 1 --2- 172.21.15.99:0/2470656496 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcfd4184cd0 0x7fcfd416d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:07.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.002+0000 7fcfd9e00640 1 -- 172.21.15.99:0/2470656496 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcfd41833f0 msgr2=0x7fcfd4071d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:07.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.002+0000 7fcfd9e00640 1 --2- 172.21.15.99:0/2470656496 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcfd41833f0 0x7fcfd4071d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:07.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.002+0000 7fcfd9e00640 1 -- 172.21.15.99:0/2470656496 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcfd4184cd0 msgr2=0x7fcfd416d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:07.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.002+0000 7fcfd9e00640 1 --2- 172.21.15.99:0/2470656496 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcfd4184cd0 0x7fcfd416d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:07.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.002+0000 7fcfd9e00640 1 -- 172.21.15.99:0/2470656496 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfd416dad0 con 0x7fcfd40f8560 2024-02-21T23:11:07.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.003+0000 7fcfda800640 1 --2- 172.21.15.99:0/2470656496 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcfd4184cd0 0x7fcfd416d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:11:07.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.003+0000 7fcfd9e00640 1 --2- 172.21.15.99:0/2470656496 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcfd40f8560 0x7fcfd42232a0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fcfc8000c00 tx=0x7fcfc80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:07.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.003+0000 7fcfce000640 1 -- 172.21.15.99:0/2470656496 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc803b040 con 0x7fcfd40f8560 2024-02-21T23:11:07.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.003+0000 7fcfce000640 1 -- 172.21.15.99:0/2470656496 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfc803f420 con 0x7fcfd40f8560 2024-02-21T23:11:07.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.003+0000 7fcfce000640 1 -- 172.21.15.99:0/2470656496 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc8006e10 con 0x7fcfd40f8560 2024-02-21T23:11:07.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.003+0000 7fcfdc800640 1 -- 172.21.15.99:0/2470656496 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfd4072470 con 0x7fcfd40f8560 2024-02-21T23:11:07.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.003+0000 7fcfdc800640 1 -- 172.21.15.99:0/2470656496 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfd4072a30 con 0x7fcfd40f8560 2024-02-21T23:11:07.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.005+0000 7fcfdc800640 1 -- 172.21.15.99:0/2470656496 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfd40d2aa0 con 0x7fcfd40f8560 2024-02-21T23:11:07.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.007+0000 7fcfce000640 1 -- 172.21.15.99:0/2470656496 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7fcfc803f7d0 con 0x7fcfd40f8560 2024-02-21T23:11:07.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.008+0000 7fcfce000640 1 --2- 172.21.15.99:0/2470656496 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fcfb809ef00 0x7fcfb80a13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:07.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.008+0000 7fcfce000640 1 -- 172.21.15.99:0/2470656496 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 8877+0+0 (secure 0 0 0) 0x7fcfc80ebd00 con 0x7fcfd40f8560 2024-02-21T23:11:07.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.009+0000 7fcfd9400640 1 --2- 172.21.15.99:0/2470656496 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fcfb809ef00 0x7fcfb80a13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:07.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.009+0000 7fcfd9400640 1 --2- 172.21.15.99:0/2470656496 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fcfb809ef00 0x7fcfb80a13c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fcfd4176bb0 tx=0x7fcfc4007b80 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:08.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.013+0000 7fcfce000640 1 -- 172.21.15.99:0/2470656496 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fcfc80b9cb0 con 0x7fcfd40f8560 2024-02-21T23:11:08.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.257+0000 7fcfdc800640 1 -- 172.21.15.99:0/2470656496 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcfd40c90a0 con 0x7fcfd40f8560 2024-02-21T23:11:08.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.258+0000 7fcfce000640 1 -- 172.21.15.99:0/2470656496 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+11335 (secure 0 0 0) 0x7fcfc80b95b0 con 0x7fcfd40f8560 2024-02-21T23:11:08.247 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T23:11:08.247 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4307,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/3514452812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3514452812},{"type":"v1","addr":"172.21.15.162:6836","nonce":3514452812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4312,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6838/2169982089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":2169982089},{"type":"v1","addr":"172.21.15.162:6838","nonce":2169982089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4315,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6839/3335972724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6837","nonce":3335972724},{"type":"v1","addr":"172.21.15.162:6839","nonce":3335972724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4318,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6841/2135456697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6840","nonce":2135456697},{"type":"v1","addr":"172.21.15.162:6841","nonce":2135456697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4325,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2452242758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2452242758},{"type":"v1","addr":"172.21.15.181:6833","nonce":2452242758}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4328,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6836/2751486400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":2751486400},{"type":"v1","addr":"172.21.15.181:6836","nonce":2751486400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":17,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-21T23:01:02.656130+0000","modified":"2024-02-21T23:07:03.165223+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4355,"mds_1":4352,"mds_2":4348},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4331":{"gid":4331,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6838/3728901330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6835","nonce":3728901330},{"type":"v1","addr":"172.21.15.181:6838","nonce":3728901330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4339":{"gid":4339,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6839/3357929641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6837","nonce":3357929641},{"type":"v1","addr":"172.21.15.181:6839","nonce":3357929641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4343":{"gid":4343,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6833/2793485078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":2793485078},{"type":"v1","addr":"172.21.15.99:6833","nonce":2793485078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4348":{"gid":4348,"name":"d","rank":2,"incarnation":12,"state":"up:active","state_seq":10,"addr":"172.21.15.99:6835/2243461688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2243461688},{"type":"v1","addr":"172.21.15.99:6835","nonce":2243461688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4352":{"gid":4352,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.99:6837/1676159950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":1676159950},{"type":"v1","addr":"172.21.15.99:6837","nonce":1676159950}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4355":{"gid":4355,"name":"j","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6839/4239008786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":4239008786},{"type":"v1","addr":"172.21.15.99:6839","nonce":4239008786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-21T23:11:08.248 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 17 2024-02-21T23:11:08.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.261+0000 7fcfdc800640 1 -- 172.21.15.99:0/2470656496 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fcfb809ef00 msgr2=0x7fcfb80a13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:08.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.261+0000 7fcfdc800640 1 --2- 172.21.15.99:0/2470656496 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fcfb809ef00 0x7fcfb80a13c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fcfd4176bb0 tx=0x7fcfc4007b80 comp rx=0 tx=0).stop 2024-02-21T23:11:08.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.261+0000 7fcfdc800640 1 -- 172.21.15.99:0/2470656496 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcfd40f8560 msgr2=0x7fcfd42232a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:08.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.261+0000 7fcfdc800640 1 --2- 172.21.15.99:0/2470656496 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcfd40f8560 0x7fcfd42232a0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fcfc8000c00 tx=0x7fcfc80046c0 comp rx=0 tx=0).stop 2024-02-21T23:11:08.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.261+0000 7fcfdc800640 1 -- 172.21.15.99:0/2470656496 shutdown_connections 2024-02-21T23:11:08.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.262+0000 7fcfdc800640 1 --2- 172.21.15.99:0/2470656496 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fcfb809ef00 0x7fcfb80a13c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:08.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.262+0000 7fcfdc800640 1 --2- 172.21.15.99:0/2470656496 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcfd4184cd0 0x7fcfd416d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:08.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.262+0000 7fcfdc800640 1 --2- 172.21.15.99:0/2470656496 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcfd41833f0 0x7fcfd4071d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:08.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.262+0000 7fcfdc800640 1 --2- 172.21.15.99:0/2470656496 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcfd40f8560 0x7fcfd42232a0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:08.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.262+0000 7fcfdc800640 1 -- 172.21.15.99:0/2470656496 >> 172.21.15.99:0/2470656496 conn(0x7fcfd40ce5f0 msgr2=0x7fcfd4068e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:11:08.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.262+0000 7fcfdc800640 1 -- 172.21.15.99:0/2470656496 shutdown_connections 2024-02-21T23:11:08.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.262+0000 7fcfdc800640 1 -- 172.21.15.99:0/2470656496 wait complete. 2024-02-21T23:11:08.277 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T23:11:08.278 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-02-21T23:11:08.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.491+0000 7f5445a00640 1 Processor -- start 2024-02-21T23:11:08.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.491+0000 7f5445a00640 1 -- start start 2024-02-21T23:11:08.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.493+0000 7f5445a00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f54400fa920 0x7f544018c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:08.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.493+0000 7f5445a00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5440188a00 con 0x7f54400719f0 2024-02-21T23:11:08.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.493+0000 7f5445a00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5440187680 con 0x7f544018c250 2024-02-21T23:11:08.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.493+0000 7f5445a00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5440187960 con 0x7f54400fa920 2024-02-21T23:11:08.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.493+0000 7f5436000640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f54400719f0 0x7f54400fa210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:48936/0 (socket says 172.21.15.99:48936) 2024-02-21T23:11:08.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.493+0000 7f5436000640 1 -- 172.21.15.99:0/1867649529 learned_addr learned my addr 172.21.15.99:0/1867649529 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:11:08.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.493+0000 7f543f400640 1 --2- 172.21.15.99:0/1867649529 >> v2:172.21.15.181:3300/0 conn(0x7f54400fa920 0x7f544018c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:08.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.494+0000 7f543e000640 1 -- 172.21.15.99:0/1867649529 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1021946738 0 0) 0x7f5440187680 con 0x7f544018c250 2024-02-21T23:11:08.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.494+0000 7f543f400640 1 -- 172.21.15.99:0/1867649529 >> v1:172.21.15.162:6789/0 conn(0x7f544018c250 legacy=0x7f5440186bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:08.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.494+0000 7f543f400640 1 -- 172.21.15.99:0/1867649529 >> v1:172.21.15.99:6789/0 conn(0x7f54400719f0 legacy=0x7f54400fa210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:08.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.494+0000 7f543f400640 1 -- 172.21.15.99:0/1867649529 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5440187c40 con 0x7f54400fa920 2024-02-21T23:11:08.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.496+0000 7f543f400640 1 --2- 172.21.15.99:0/1867649529 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f54400fa920 0x7f544018c630 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f5438009d90 tx=0x7f543802bc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=118a5fb660fa61e6 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:08.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.496+0000 7f543e000640 1 -- 172.21.15.99:0/1867649529 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5438039070 con 0x7f54400fa920 2024-02-21T23:11:08.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.496+0000 7f543e000640 1 -- 172.21.15.99:0/1867649529 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f543802c990 con 0x7f54400fa920 2024-02-21T23:11:08.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.496+0000 7f543e000640 1 -- 172.21.15.99:0/1867649529 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f543802cd60 con 0x7f54400fa920 2024-02-21T23:11:08.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.497+0000 7f5445a00640 1 -- 172.21.15.99:0/1867649529 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f54400fa920 msgr2=0x7f544018c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:08.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.497+0000 7f5445a00640 1 --2- 172.21.15.99:0/1867649529 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f54400fa920 0x7f544018c630 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f5438009d90 tx=0x7f543802bc60 comp rx=0 tx=0).stop 2024-02-21T23:11:08.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.497+0000 7f5445a00640 1 -- 172.21.15.99:0/1867649529 shutdown_connections 2024-02-21T23:11:08.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.497+0000 7f5445a00640 1 --2- 172.21.15.99:0/1867649529 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f54400fa920 0x7f544018c630 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:08.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.497+0000 7f5445a00640 1 -- 172.21.15.99:0/1867649529 >> 172.21.15.99:0/1867649529 conn(0x7f54400f8d90 msgr2=0x7f54400f91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:11:08.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.497+0000 7f5445a00640 1 -- 172.21.15.99:0/1867649529 shutdown_connections 2024-02-21T23:11:08.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.497+0000 7f5445a00640 1 -- 172.21.15.99:0/1867649529 wait complete. 2024-02-21T23:11:08.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.500+0000 7f5445a00640 1 Processor -- start 2024-02-21T23:11:08.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.500+0000 7f5445a00640 1 -- start start 2024-02-21T23:11:08.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.501+0000 7f5445a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f54400719f0 0x7f544016dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:08.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.502+0000 7f5445a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54400fa920 0x7f544006e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:08.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.502+0000 7f5445a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f544018c250 0x7f5440185170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:08.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.502+0000 7f5445a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54401884e0 con 0x7f54400fa920 2024-02-21T23:11:08.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.502+0000 7f5445a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5440188200 con 0x7f544018c250 2024-02-21T23:11:08.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.502+0000 7f5445a00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5440071e50 con 0x7f54400719f0 2024-02-21T23:11:08.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.502+0000 7f5436000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54400fa920 0x7f544006e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:08.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.502+0000 7f543ea00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f54400719f0 0x7f544016dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:08.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.502+0000 7f543ea00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f54400719f0 0x7f544016dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:41018/0 (socket says 172.21.15.99:41018) 2024-02-21T23:11:08.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.502+0000 7f543ea00640 1 -- 172.21.15.99:0/3808277120 learned_addr learned my addr 172.21.15.99:0/3808277120 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:11:08.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.502+0000 7f543f400640 1 --2- 172.21.15.99:0/3808277120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f544018c250 0x7f5440185170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:08.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.502+0000 7f543ea00640 1 -- 172.21.15.99:0/3808277120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f544018c250 msgr2=0x7f5440185170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:08.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.502+0000 7f543ea00640 1 --2- 172.21.15.99:0/3808277120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f544018c250 0x7f5440185170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:08.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.502+0000 7f543ea00640 1 -- 172.21.15.99:0/3808277120 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54400fa920 msgr2=0x7f544006e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:08.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.502+0000 7f543ea00640 1 --2- 172.21.15.99:0/3808277120 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54400fa920 0x7f544006e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:08.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.502+0000 7f543ea00640 1 -- 172.21.15.99:0/3808277120 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54400d0200 con 0x7f54400719f0 2024-02-21T23:11:08.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.503+0000 7f543ea00640 1 --2- 172.21.15.99:0/3808277120 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f54400719f0 0x7f544016dd90 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f543000c3f0 tx=0x7f543000c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:08.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.503+0000 7f5437400640 1 -- 172.21.15.99:0/3808277120 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5430017070 con 0x7f54400719f0 2024-02-21T23:11:08.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.503+0000 7f5437400640 1 -- 172.21.15.99:0/3808277120 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54300035f0 con 0x7f54400719f0 2024-02-21T23:11:08.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.503+0000 7f5445a00640 1 -- 172.21.15.99:0/3808277120 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54401843b0 con 0x7f54400719f0 2024-02-21T23:11:08.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.503+0000 7f5437400640 1 -- 172.21.15.99:0/3808277120 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54300039e0 con 0x7f54400719f0 2024-02-21T23:11:08.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.503+0000 7f5445a00640 1 -- 172.21.15.99:0/3808277120 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5440184970 con 0x7f54400719f0 2024-02-21T23:11:08.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.506+0000 7f5437400640 1 -- 172.21.15.99:0/3808277120 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f543001a070 con 0x7f54400719f0 2024-02-21T23:11:08.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.507+0000 7f5448a1a740 1 Processor -- start 2024-02-21T23:11:08.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.508+0000 7f5448a1a740 1 -- start start 2024-02-21T23:11:08.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.509+0000 7f5448a1a740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556afb6cd4b0 0x556afb6cd890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:08.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.509+0000 7f5448a1a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556afb708180 0x556afb708600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:08.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.509+0000 7f5448a1a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556afb708b40 0x556afb7093b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:08.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.509+0000 7f5448a1a740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x556afb5f5b50 con 0x556afb6cd4b0 2024-02-21T23:11:08.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.509+0000 7f5448a1a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x556afb59eda0 con 0x556afb708b40 2024-02-21T23:11:08.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.509+0000 7f5448a1a740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x556afb5f1bf0 con 0x556afb708180 2024-02-21T23:11:08.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.509+0000 7f5437400640 1 --2- 172.21.15.99:0/3808277120 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f541c09eed0 0x7f541c0a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:08.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.509+0000 7f543f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556afb6cd4b0 0x556afb6cd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:08.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.509+0000 7f5437400640 1 -- 172.21.15.99:0/3808277120 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 8965+0+0 (secure 0 0 0) 0x7f54300c9310 con 0x7f54400719f0 2024-02-21T23:11:08.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.509+0000 7f543f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556afb6cd4b0 0x556afb6cd890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34184/0 (socket says 172.21.15.99:34184) 2024-02-21T23:11:08.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.509+0000 7f543f400640 1 -- 172.21.15.99:0/1204999960 learned_addr learned my addr 172.21.15.99:0/1204999960 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:11:08.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.509+0000 7f5436000640 1 --2- 172.21.15.99:0/1204999960 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556afb708b40 0x556afb7093b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:08.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.509+0000 7f543f400640 1 --2- 172.21.15.99:0/3808277120 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f541c09eed0 0x7f541c0a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:08.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.510+0000 7f543f400640 1 -- 172.21.15.99:0/1204999960 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556afb708180 msgr2=0x556afb708600 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T23:11:08.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.510+0000 7f543f400640 1 --2- 172.21.15.99:0/1204999960 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556afb708180 0x556afb708600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:08.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.510+0000 7f543f400640 1 -- 172.21.15.99:0/1204999960 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556afb708b40 msgr2=0x556afb7093b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:08.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.510+0000 7f543f400640 1 --2- 172.21.15.99:0/1204999960 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556afb708b40 0x556afb7093b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:08.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.510+0000 7f543f400640 1 -- 172.21.15.99:0/1204999960 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556afb5c1f80 con 0x556afb6cd4b0 2024-02-21T23:11:08.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.510+0000 7f543f400640 1 --2- 172.21.15.99:0/1204999960 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556afb6cd4b0 0x556afb6cd890 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f5438009eb0 tx=0x7f5438004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df68f158c7d9c461 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:08.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.510+0000 7f543f400640 1 --2- 172.21.15.99:0/3808277120 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f541c09eed0 0x7f541c0a1390 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f543802bca0 tx=0x7f543803a000 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:08.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.510+0000 7f542f400640 1 -- 172.21.15.99:0/1204999960 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5438039040 con 0x556afb6cd4b0 2024-02-21T23:11:08.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.510+0000 7f542f400640 1 -- 172.21.15.99:0/1204999960 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5438004410 con 0x556afb6cd4b0 2024-02-21T23:11:08.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.510+0000 7f542f400640 1 -- 172.21.15.99:0/1204999960 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5438004600 con 0x556afb6cd4b0 2024-02-21T23:11:08.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.511+0000 7f5448a1a740 1 -- 172.21.15.99:0/1204999960 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556afb6cd4b0 msgr2=0x556afb6cd890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:08.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.511+0000 7f5448a1a740 1 --2- 172.21.15.99:0/1204999960 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556afb6cd4b0 0x556afb6cd890 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f5438009eb0 tx=0x7f5438004ab0 comp rx=0 tx=0).stop 2024-02-21T23:11:08.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.511+0000 7f5448a1a740 1 -- 172.21.15.99:0/1204999960 shutdown_connections 2024-02-21T23:11:08.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.511+0000 7f5448a1a740 1 --2- 172.21.15.99:0/1204999960 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556afb708b40 0x556afb7093b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:08.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.511+0000 7f5448a1a740 1 --2- 172.21.15.99:0/1204999960 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556afb708180 0x556afb708600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:08.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.511+0000 7f5448a1a740 1 --2- 172.21.15.99:0/1204999960 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556afb6cd4b0 0x556afb6cd890 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:08.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.511+0000 7f5448a1a740 1 -- 172.21.15.99:0/1204999960 >> 172.21.15.99:0/1204999960 conn(0x556afb68f520 msgr2=0x556afb6905a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:11:08.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.511+0000 7f5448a1a740 1 -- 172.21.15.99:0/1204999960 shutdown_connections 2024-02-21T23:11:08.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.511+0000 7f5448a1a740 1 -- 172.21.15.99:0/1204999960 wait complete. 2024-02-21T23:11:08.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.512+0000 7f5448a1a740 1 -- start start 2024-02-21T23:11:08.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.512+0000 7f5448a1a740 1 Processor -- start 2024-02-21T23:11:08.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.514+0000 7f5448a1a740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556afb708180 0x556afb7085e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:08.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.514+0000 7f5448a1a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556afb708b40 0x556afb68b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:08.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.514+0000 7f5448a1a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556afb6bce90 0x556afb6d37f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:08.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.514+0000 7f5448a1a740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x556afb706ef0 con 0x556afb708180 2024-02-21T23:11:08.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.514+0000 7f5448a1a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x556afb594380 con 0x556afb708b40 2024-02-21T23:11:08.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.514+0000 7f5448a1a740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x556afb706c10 con 0x556afb6bce90 2024-02-21T23:11:08.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.514+0000 7f5448a1a740 10 client.0 _ll_register_callbacks cb 0x556afb5ed280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:11:08.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.514+0000 7f5436000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556afb708b40 0x556afb68b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:08.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.514+0000 7f543ea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556afb708180 0x556afb7085e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:08.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.514+0000 7f5436000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556afb708b40 0x556afb68b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:58670/0 (socket says 172.21.15.99:58670) 2024-02-21T23:11:08.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.514+0000 7f5436000640 1 -- 172.21.15.99:0/1522874313 learned_addr learned my addr 172.21.15.99:0/1522874313 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:11:08.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.514+0000 7f543f400640 1 --2- 172.21.15.99:0/1522874313 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556afb6bce90 0x556afb6d37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:08.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.515+0000 7f5436000640 1 -- 172.21.15.99:0/1522874313 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556afb6bce90 msgr2=0x556afb6d37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:08.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.515+0000 7f5436000640 1 --2- 172.21.15.99:0/1522874313 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556afb6bce90 0x556afb6d37f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:08.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.515+0000 7f5436000640 1 -- 172.21.15.99:0/1522874313 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556afb708180 msgr2=0x556afb7085e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:08.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.515+0000 7f5436000640 1 --2- 172.21.15.99:0/1522874313 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556afb708180 0x556afb7085e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:08.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.515+0000 7f5436000640 1 -- 172.21.15.99:0/1522874313 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556afb5bcc20 con 0x556afb708b40 2024-02-21T23:11:08.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.515+0000 7f543ea00640 1 --2- 172.21.15.99:0/1522874313 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556afb708180 0x556afb7085e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:11:08.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.515+0000 7f5436000640 1 --2- 172.21.15.99:0/1522874313 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556afb708b40 0x556afb68b1e0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f5428004f20 tx=0x7f54280017e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c7792ec4ac197d8 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:08.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.515+0000 7f5423e00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-02-21T23:11:08.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.515+0000 7f5423e00640 1 -- 172.21.15.99:0/1522874313 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5428014670 con 0x556afb708b40 2024-02-21T23:11:08.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.515+0000 7f5448a1a740 1 -- 172.21.15.99:0/1522874313 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5438004410 con 0x556afb708b40 2024-02-21T23:11:08.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.515+0000 7f5423e00640 1 -- 172.21.15.99:0/1522874313 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(37..37 src has 1..37) v4 ==== 8965+0+0 (secure 0 0 0) 0x7f5428014810 con 0x556afb708b40 2024-02-21T23:11:08.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.516+0000 7f5423e00640 1 -- 172.21.15.99:0/1522874313 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5428023050 con 0x556afb708b40 2024-02-21T23:11:08.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.516+0000 7f5448a1a740 10 client.7006 fetch_fsmap learned FSMap version 17 2024-02-21T23:11:08.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.516+0000 7f5448a1a740 1 -- 172.21.15.99:0/1522874313 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x556afb30a3f0 con 0x556afb708b40 2024-02-21T23:11:08.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.516+0000 7f5423e00640 1 -- 172.21.15.99:0/1522874313 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5438004410 con 0x556afb708b40 2024-02-21T23:11:08.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.516+0000 7f5423e00640 1 -- 172.21.15.99:0/1522874313 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f5428014a10 con 0x556afb708b40 2024-02-21T23:11:08.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.516+0000 7f5448a1a740 10 client.7006 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:11:08.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.516+0000 7f5448a1a740 10 client.7006 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.d 2024-02-21T23:11:08.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.516+0000 7f5448a1a740 20 client.7006 populate_metadata read hostname 'smithi099' 2024-02-21T23:11:08.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.516+0000 7f5448a1a740 1 --2- 172.21.15.99:0/1522874313 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x556afb6d5380 0x556afb6b9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:08.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.516+0000 7f5448a1a740 4 client.7006 mds_command: new command op to 4348 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:11:08.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.516+0000 7f5448a1a740 1 -- 172.21.15.99:0/1522874313 --> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556afb603090 con 0x556afb6d5380 2024-02-21T23:11:08.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.517+0000 7f543ea00640 1 --2- 172.21.15.99:0/1522874313 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x556afb6d5380 0x556afb6b9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:08.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.517+0000 7f543ea00640 1 --2- 172.21.15.99:0/1522874313 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x556afb6d5380 0x556afb6b9fb0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=63cb9f828b7d91d5 server_cookie=d6b2d6ea93af8c00 in_seq=0 out_seq=0 2024-02-21T23:11:08.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.517+0000 7f5423e00640 10 client.7006 ms_handle_connect on v2:172.21.15.99:6834/2243461688 2024-02-21T23:11:08.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.518+0000 7f5423e00640 1 -- 172.21.15.99:0/1522874313 <== mds.2 v2:172.21.15.99:6834/2243461688 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x556afb603090 con 0x556afb6d5380 2024-02-21T23:11:08.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.518+0000 7f5423e00640 10 client.7006 handle_command_reply: tid=0 2024-02-21T23:11:08.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.518+0000 7f5448a1a740 1 client.7006 shutdown 2024-02-21T23:11:08.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.518+0000 7f5448a1a740 1 -- 172.21.15.99:0/1522874313 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556afb708b40 msgr2=0x556afb68b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:08.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.518+0000 7f5448a1a740 1 --2- 172.21.15.99:0/1522874313 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556afb708b40 0x556afb68b1e0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f5428004f20 tx=0x7f54280017e0 comp rx=0 tx=0).stop 2024-02-21T23:11:08.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.518+0000 7f5448a1a740 1 -- 172.21.15.99:0/1522874313 shutdown_connections 2024-02-21T23:11:08.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.518+0000 7f5448a1a740 1 --2- 172.21.15.99:0/1522874313 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x556afb6d5380 0x556afb6b9fb0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:08.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.518+0000 7f5448a1a740 1 --2- 172.21.15.99:0/1522874313 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556afb6bce90 0x556afb6d37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:08.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.518+0000 7f5448a1a740 1 --2- 172.21.15.99:0/1522874313 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556afb708b40 0x556afb68b1e0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:08.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.518+0000 7f5448a1a740 1 --2- 172.21.15.99:0/1522874313 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556afb708180 0x556afb7085e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:08.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.518+0000 7f5423e00640 0 client.7006 ms_handle_reset on v2:172.21.15.99:6834/2243461688 2024-02-21T23:11:08.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.518+0000 7f5448a1a740 1 -- 172.21.15.99:0/1522874313 >> 172.21.15.99:0/1522874313 conn(0x556afb6cd4b0 msgr2=0x556afb707600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:11:08.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.518+0000 7f5448a1a740 1 -- 172.21.15.99:0/1522874313 shutdown_connections 2024-02-21T23:11:08.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.518+0000 7f5448a1a740 1 -- 172.21.15.99:0/1522874313 wait complete. 2024-02-21T23:11:08.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.519+0000 7f5448a1a740 20 client.7006 trim_cache size 0 max 16384 2024-02-21T23:11:08.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.533+0000 7f5448a1a740 1 Processor -- start 2024-02-21T23:11:08.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.533+0000 7f5448a1a740 1 -- start start 2024-02-21T23:11:08.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.534+0000 7f5448a1a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556afb6bce90 0x556afb6d3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:08.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.534+0000 7f5448a1a740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556afb708180 0x556afb6d4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:08.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.534+0000 7f5448a1a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556afb708b40 0x556afb722570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:08.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.534+0000 7f5448a1a740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5440228980 con 0x556afb708180 2024-02-21T23:11:08.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.534+0000 7f5448a1a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54400e6c60 con 0x556afb708b40 2024-02-21T23:11:08.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.534+0000 7f5448a1a740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54400e4d40 con 0x556afb6bce90 2024-02-21T23:11:08.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.535+0000 7f543ea00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556afb6bce90 0x556afb6d3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:08.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.535+0000 7f5436000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556afb708180 0x556afb6d4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:08.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.535+0000 7f543ea00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556afb6bce90 0x556afb6d3fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:41054/0 (socket says 172.21.15.99:41054) 2024-02-21T23:11:08.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.535+0000 7f543ea00640 1 -- 172.21.15.99:0/2586050874 learned_addr learned my addr 172.21.15.99:0/2586050874 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:11:08.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.535+0000 7f543f400640 1 --2- 172.21.15.99:0/2586050874 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556afb708b40 0x556afb722570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:08.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.535+0000 7f543ea00640 1 -- 172.21.15.99:0/2586050874 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556afb708b40 msgr2=0x556afb722570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:08.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.535+0000 7f543ea00640 1 --2- 172.21.15.99:0/2586050874 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556afb708b40 0x556afb722570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:08.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.535+0000 7f543ea00640 1 -- 172.21.15.99:0/2586050874 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556afb708180 msgr2=0x556afb6d4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:08.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.535+0000 7f543ea00640 1 --2- 172.21.15.99:0/2586050874 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556afb708180 0x556afb6d4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:08.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.535+0000 7f543ea00640 1 -- 172.21.15.99:0/2586050874 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556afb3d47d0 con 0x556afb6bce90 2024-02-21T23:11:08.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.535+0000 7f543ea00640 1 --2- 172.21.15.99:0/2586050874 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556afb6bce90 0x556afb6d3fe0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f5430092f30 tx=0x7f54300c9040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7be3c4e7dd9b6a63 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:08.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.536+0000 7f542ea00640 1 -- 172.21.15.99:0/2586050874 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f543009f2a0 con 0x556afb6bce90 2024-02-21T23:11:08.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.536+0000 7f542ea00640 1 -- 172.21.15.99:0/2586050874 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5430094eb0 con 0x556afb6bce90 2024-02-21T23:11:08.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.536+0000 7f542ea00640 1 -- 172.21.15.99:0/2586050874 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54300c6cc0 con 0x556afb6bce90 2024-02-21T23:11:08.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.537+0000 7f5448a1a740 1 -- 172.21.15.99:0/2586050874 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556afb6bce90 msgr2=0x556afb6d3fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:08.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.537+0000 7f5448a1a740 1 --2- 172.21.15.99:0/2586050874 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556afb6bce90 0x556afb6d3fe0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f5430092f30 tx=0x7f54300c9040 comp rx=0 tx=0).stop 2024-02-21T23:11:08.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.537+0000 7f5448a1a740 1 -- 172.21.15.99:0/2586050874 shutdown_connections 2024-02-21T23:11:08.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.537+0000 7f5448a1a740 1 --2- 172.21.15.99:0/2586050874 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556afb708b40 0x556afb722570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:08.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.537+0000 7f5448a1a740 1 --2- 172.21.15.99:0/2586050874 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556afb708180 0x556afb6d4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:08.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.537+0000 7f5448a1a740 1 --2- 172.21.15.99:0/2586050874 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556afb6bce90 0x556afb6d3fe0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:08.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.537+0000 7f5448a1a740 1 -- 172.21.15.99:0/2586050874 >> 172.21.15.99:0/2586050874 conn(0x556afb6cd4b0 msgr2=0x556afb690780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:11:08.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.537+0000 7f5448a1a740 1 -- 172.21.15.99:0/2586050874 shutdown_connections 2024-02-21T23:11:08.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.537+0000 7f5448a1a740 1 -- 172.21.15.99:0/2586050874 wait complete. 2024-02-21T23:11:08.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.538+0000 7f5448a1a740 1 -- start start 2024-02-21T23:11:08.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.538+0000 7f5448a1a740 1 Processor -- start 2024-02-21T23:11:08.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.540+0000 7f5448a1a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556afb6bce90 0x556afb6b3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:08.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.540+0000 7f5448a1a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556afb708180 0x556afb68b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:08.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.540+0000 7f5448a1a740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556afb708b40 0x556afb722590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:08.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.540+0000 7f5448a1a740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54400e5340 con 0x556afb708b40 2024-02-21T23:11:08.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.540+0000 7f5448a1a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54400e6600 con 0x556afb6bce90 2024-02-21T23:11:08.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.540+0000 7f5448a1a740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54400e5940 con 0x556afb708180 2024-02-21T23:11:08.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.540+0000 7f5448a1a740 10 client.0 _ll_register_callbacks cb 0x7f5428004b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:11:08.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.540+0000 7f543ea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556afb6bce90 0x556afb6b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:08.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.540+0000 7f543ea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556afb6bce90 0x556afb6b3930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:58690/0 (socket says 172.21.15.99:58690) 2024-02-21T23:11:08.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.540+0000 7f543ea00640 1 -- 172.21.15.99:0/1753795570 learned_addr learned my addr 172.21.15.99:0/1753795570 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:11:08.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.540+0000 7f5436000640 1 --2- 172.21.15.99:0/1753795570 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556afb708180 0x556afb68b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:08.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.540+0000 7f543f400640 1 --2- 172.21.15.99:0/1753795570 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556afb708b40 0x556afb722590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:08.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.540+0000 7f543ea00640 1 -- 172.21.15.99:0/1753795570 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556afb708180 msgr2=0x556afb68b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:08.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.540+0000 7f543ea00640 1 --2- 172.21.15.99:0/1753795570 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556afb708180 0x556afb68b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:08.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.540+0000 7f543ea00640 1 -- 172.21.15.99:0/1753795570 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556afb708b40 msgr2=0x556afb722590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:08.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.540+0000 7f543ea00640 1 --2- 172.21.15.99:0/1753795570 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556afb708b40 0x556afb722590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:08.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.540+0000 7f543ea00640 1 -- 172.21.15.99:0/1753795570 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556afb6bbe70 con 0x556afb6bce90 2024-02-21T23:11:08.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.541+0000 7f543ea00640 1 --2- 172.21.15.99:0/1753795570 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556afb6bce90 0x556afb6b3930 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f543000cdb0 tx=0x7f5430001100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e1c6597dc32d889 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:08.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.541+0000 7f5423e00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-02-21T23:11:08.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.541+0000 7f5423e00640 1 -- 172.21.15.99:0/1753795570 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5430092dc0 con 0x556afb6bce90 2024-02-21T23:11:08.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.541+0000 7f5423e00640 1 -- 172.21.15.99:0/1753795570 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(37..37 src has 1..37) v4 ==== 8965+0+0 (secure 0 0 0) 0x7f54300c6180 con 0x556afb6bce90 2024-02-21T23:11:08.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.541+0000 7f5448a1a740 1 -- 172.21.15.99:0/1753795570 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5430094eb0 con 0x556afb6bce90 2024-02-21T23:11:08.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.541+0000 7f5423e00640 1 -- 172.21.15.99:0/1753795570 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f543009f2a0 con 0x556afb6bce90 2024-02-21T23:11:08.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.541+0000 7f5448a1a740 10 client.7012 fetch_fsmap learned FSMap version 17 2024-02-21T23:11:08.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.541+0000 7f5448a1a740 1 -- 172.21.15.99:0/1753795570 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x556afb6db050 con 0x556afb6bce90 2024-02-21T23:11:08.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.541+0000 7f5423e00640 1 -- 172.21.15.99:0/1753795570 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5430094eb0 con 0x556afb6bce90 2024-02-21T23:11:08.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.542+0000 7f5423e00640 1 -- 172.21.15.99:0/1753795570 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f54300aab50 con 0x556afb6bce90 2024-02-21T23:11:08.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.542+0000 7f5448a1a740 10 client.7012 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:11:08.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.542+0000 7f5448a1a740 10 client.7012 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.d 2024-02-21T23:11:08.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.542+0000 7f5448a1a740 20 client.7012 populate_metadata read hostname 'smithi099' 2024-02-21T23:11:08.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.542+0000 7f5448a1a740 1 --2- 172.21.15.99:0/1753795570 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x556afb6d1300 0x556afb704750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:08.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.542+0000 7f5448a1a740 4 client.7012 mds_command: new command op to 4348 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T23:11:08.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.542+0000 7f5448a1a740 1 -- 172.21.15.99:0/1753795570 --> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x556afb5fd3e0 con 0x556afb6d1300 2024-02-21T23:11:08.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.542+0000 7f5436000640 1 --2- 172.21.15.99:0/1753795570 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x556afb6d1300 0x556afb704750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:08.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.543+0000 7f5436000640 1 --2- 172.21.15.99:0/1753795570 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x556afb6d1300 0x556afb704750 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=450722c41adba60f server_cookie=bd6fd1ce7ab220b2 in_seq=0 out_seq=0 2024-02-21T23:11:08.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.543+0000 7f5423e00640 10 client.7012 ms_handle_connect on v2:172.21.15.99:6834/2243461688 2024-02-21T23:11:08.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.543+0000 7f5423e00640 1 -- 172.21.15.99:0/1753795570 <== mds.2 v2:172.21.15.99:6834/2243461688 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x556afb5fd3e0 con 0x556afb6d1300 2024-02-21T23:11:08.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.543+0000 7f5423e00640 10 client.7012 handle_command_reply: tid=0 2024-02-21T23:11:08.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.543+0000 7f5448a1a740 1 client.7012 shutdown 2024-02-21T23:11:08.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.543+0000 7f5448a1a740 1 -- 172.21.15.99:0/1753795570 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556afb6bce90 msgr2=0x556afb6b3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:08.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.543+0000 7f5448a1a740 1 --2- 172.21.15.99:0/1753795570 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556afb6bce90 0x556afb6b3930 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f543000cdb0 tx=0x7f5430001100 comp rx=0 tx=0).stop 2024-02-21T23:11:08.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.543+0000 7f5448a1a740 1 -- 172.21.15.99:0/1753795570 shutdown_connections 2024-02-21T23:11:08.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.543+0000 7f5448a1a740 1 --2- 172.21.15.99:0/1753795570 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x556afb6d1300 0x556afb704750 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:08.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.543+0000 7f5448a1a740 1 --2- 172.21.15.99:0/1753795570 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556afb708b40 0x556afb722590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:08.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.543+0000 7f5448a1a740 1 --2- 172.21.15.99:0/1753795570 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556afb708180 0x556afb68b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:08.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.543+0000 7f5448a1a740 1 --2- 172.21.15.99:0/1753795570 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556afb6bce90 0x556afb6b3930 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:08.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.543+0000 7f5448a1a740 1 -- 172.21.15.99:0/1753795570 >> 172.21.15.99:0/1753795570 conn(0x556afb6cd4b0 msgr2=0x556afb691090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:11:08.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.543+0000 7f5423e00640 0 client.7012 ms_handle_reset on v2:172.21.15.99:6834/2243461688 2024-02-21T23:11:08.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.544+0000 7f5448a1a740 1 -- 172.21.15.99:0/1753795570 shutdown_connections 2024-02-21T23:11:08.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.544+0000 7f5448a1a740 1 -- 172.21.15.99:0/1753795570 wait complete. 2024-02-21T23:11:08.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.544+0000 7f5448a1a740 20 client.7012 trim_cache size 0 max 16384 2024-02-21T23:11:08.545 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-02-21T23:11:08.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.544+0000 7f5445a00640 1 -- 172.21.15.99:0/3808277120 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f541c09eed0 msgr2=0x7f541c0a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:08.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.544+0000 7f5445a00640 1 --2- 172.21.15.99:0/3808277120 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f541c09eed0 0x7f541c0a1390 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f543802bca0 tx=0x7f543803a000 comp rx=0 tx=0).stop 2024-02-21T23:11:08.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.544+0000 7f5445a00640 1 -- 172.21.15.99:0/3808277120 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f54400719f0 msgr2=0x7f544016dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:08.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.544+0000 7f5445a00640 1 --2- 172.21.15.99:0/3808277120 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f54400719f0 0x7f544016dd90 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f543000c3f0 tx=0x7f543000c8b0 comp rx=0 tx=0).stop 2024-02-21T23:11:08.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.545+0000 7f5445a00640 1 -- 172.21.15.99:0/3808277120 shutdown_connections 2024-02-21T23:11:08.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.545+0000 7f5445a00640 1 --2- 172.21.15.99:0/3808277120 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f541c09eed0 0x7f541c0a1390 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:08.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.545+0000 7f5445a00640 1 --2- 172.21.15.99:0/3808277120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f544018c250 0x7f5440185170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:08.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.545+0000 7f5445a00640 1 --2- 172.21.15.99:0/3808277120 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f54400fa920 0x7f544006e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:08.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.545+0000 7f5445a00640 1 --2- 172.21.15.99:0/3808277120 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f54400719f0 0x7f544016dd90 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:08.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.545+0000 7f5445a00640 1 -- 172.21.15.99:0/3808277120 >> 172.21.15.99:0/3808277120 conn(0x7f54400f8d90 msgr2=0x7f544006ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:11:08.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.545+0000 7f5445a00640 1 -- 172.21.15.99:0/3808277120 shutdown_connections 2024-02-21T23:11:08.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.545+0000 7f5445a00640 1 -- 172.21.15.99:0/3808277120 wait complete. 2024-02-21T23:11:08.550 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T23:11:08.550 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-02-21T23:11:08.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.759+0000 7f67e3c00640 1 Processor -- start 2024-02-21T23:11:08.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.759+0000 7f67e3c00640 1 -- start start 2024-02-21T23:11:08.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.762+0000 7f67e3c00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f67dc189fc0 0x7f67dc15f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:08.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.762+0000 7f67e3c00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67dc184600 con 0x7f67dc0709a0 2024-02-21T23:11:08.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.762+0000 7f67e3c00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67dc070e80 con 0x7f67dc18aab0 2024-02-21T23:11:08.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.762+0000 7f67e3c00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67dc15f5b0 con 0x7f67dc189fc0 2024-02-21T23:11:08.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.762+0000 7f67e1200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f67dc189fc0 0x7f67dc15f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:08.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.762+0000 7f67e1200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f67dc189fc0 0x7f67dc15f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34228/0 (socket says 172.21.15.99:34228) 2024-02-21T23:11:08.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.762+0000 7f67e1200640 1 -- 172.21.15.99:0/3758198782 learned_addr learned my addr 172.21.15.99:0/3758198782 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:11:08.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.762+0000 7f67dbe00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f67dc0709a0 0x7f67dc18a3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:48944/0 (socket says 172.21.15.99:48944) 2024-02-21T23:11:08.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.763+0000 7f67db400640 1 -- 172.21.15.99:0/3758198782 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 701696931 0 0) 0x7f67dc070e80 con 0x7f67dc18aab0 2024-02-21T23:11:08.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.763+0000 7f67db400640 1 -- 172.21.15.99:0/3758198782 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67c4003520 con 0x7f67dc18aab0 2024-02-21T23:11:08.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.763+0000 7f67db400640 1 -- 172.21.15.99:0/3758198782 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4234688788 0 0) 0x7f67dc184600 con 0x7f67dc0709a0 2024-02-21T23:11:08.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.763+0000 7f67db400640 1 -- 172.21.15.99:0/3758198782 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67dc070e80 con 0x7f67dc0709a0 2024-02-21T23:11:08.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.763+0000 7f67e1200640 1 -- 172.21.15.99:0/3758198782 >> v1:172.21.15.162:6789/0 conn(0x7f67dc18aab0 legacy=0x7f67dc187ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:08.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.763+0000 7f67e1200640 1 -- 172.21.15.99:0/3758198782 >> v1:172.21.15.99:6789/0 conn(0x7f67dc0709a0 legacy=0x7f67dc18a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:08.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.763+0000 7f67e1200640 1 -- 172.21.15.99:0/3758198782 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67dc071160 con 0x7f67dc189fc0 2024-02-21T23:11:08.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.764+0000 7f67e1200640 1 --2- 172.21.15.99:0/3758198782 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f67dc189fc0 0x7f67dc15f070 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f67d0009870 tx=0x7f67d002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ade178f9a417642b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:08.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.764+0000 7f67db400640 1 -- 172.21.15.99:0/3758198782 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d0034070 con 0x7f67dc189fc0 2024-02-21T23:11:08.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.765+0000 7f67db400640 1 -- 172.21.15.99:0/3758198782 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67d0030860 con 0x7f67dc189fc0 2024-02-21T23:11:08.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.765+0000 7f67db400640 1 -- 172.21.15.99:0/3758198782 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d0030c30 con 0x7f67dc189fc0 2024-02-21T23:11:08.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.765+0000 7f67e3c00640 1 -- 172.21.15.99:0/3758198782 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f67dc189fc0 msgr2=0x7f67dc15f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:08.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.765+0000 7f67e3c00640 1 --2- 172.21.15.99:0/3758198782 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f67dc189fc0 0x7f67dc15f070 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f67d0009870 tx=0x7f67d002b9a0 comp rx=0 tx=0).stop 2024-02-21T23:11:08.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.765+0000 7f67e3c00640 1 -- 172.21.15.99:0/3758198782 shutdown_connections 2024-02-21T23:11:08.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.765+0000 7f67e3c00640 1 --2- 172.21.15.99:0/3758198782 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f67dc189fc0 0x7f67dc15f070 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:08.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.765+0000 7f67e3c00640 1 -- 172.21.15.99:0/3758198782 >> 172.21.15.99:0/3758198782 conn(0x7f67dc0f8d90 msgr2=0x7f67dc0f91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:11:08.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.766+0000 7f67e3c00640 1 -- 172.21.15.99:0/3758198782 shutdown_connections 2024-02-21T23:11:08.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.766+0000 7f67e3c00640 1 -- 172.21.15.99:0/3758198782 wait complete. 2024-02-21T23:11:08.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.768+0000 7f67e3c00640 1 Processor -- start 2024-02-21T23:11:08.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.768+0000 7f67e3c00640 1 -- start start 2024-02-21T23:11:08.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.769+0000 7f67e3c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f67dc0709a0 0x7f67dc175200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:08.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.769+0000 7f67e3c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f67dc189fc0 0x7f67dc15d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:08.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.769+0000 7f67e3c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f67dc18aab0 0x7f67dc15d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:08.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.769+0000 7f67e3c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67dc071720 con 0x7f67dc18aab0 2024-02-21T23:11:08.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.769+0000 7f67e3c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67dc1879e0 con 0x7f67dc189fc0 2024-02-21T23:11:08.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.769+0000 7f67e3c00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67dc071a00 con 0x7f67dc0709a0 2024-02-21T23:11:08.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.769+0000 7f67e1c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f67dc18aab0 0x7f67dc15d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:08.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.769+0000 7f67e1200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f67dc0709a0 0x7f67dc175200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:08.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.769+0000 7f67e1c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f67dc18aab0 0x7f67dc15d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34236/0 (socket says 172.21.15.99:34236) 2024-02-21T23:11:08.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.769+0000 7f67e1c00640 1 -- 172.21.15.99:0/1290316087 learned_addr learned my addr 172.21.15.99:0/1290316087 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:11:08.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.769+0000 7f67dbe00640 1 --2- 172.21.15.99:0/1290316087 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f67dc189fc0 0x7f67dc15d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:08.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.770+0000 7f67e1200640 1 -- 172.21.15.99:0/1290316087 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f67dc189fc0 msgr2=0x7f67dc15d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:08.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.770+0000 7f67e1200640 1 --2- 172.21.15.99:0/1290316087 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f67dc189fc0 0x7f67dc15d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:08.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.770+0000 7f67e1200640 1 -- 172.21.15.99:0/1290316087 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f67dc18aab0 msgr2=0x7f67dc15d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:08.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.770+0000 7f67e1200640 1 --2- 172.21.15.99:0/1290316087 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f67dc18aab0 0x7f67dc15d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:08.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.770+0000 7f67e1200640 1 -- 172.21.15.99:0/1290316087 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67dc0fa2b0 con 0x7f67dc0709a0 2024-02-21T23:11:08.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.770+0000 7f67e1c00640 1 --2- 172.21.15.99:0/1290316087 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f67dc18aab0 0x7f67dc15d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:11:08.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.770+0000 7f67e1200640 1 --2- 172.21.15.99:0/1290316087 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f67dc0709a0 0x7f67dc175200 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f67dc090300 tx=0x7f67d00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:08.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.771+0000 7f67d8c00640 1 -- 172.21.15.99:0/1290316087 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d0034040 con 0x7f67dc0709a0 2024-02-21T23:11:08.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.771+0000 7f67d8c00640 1 -- 172.21.15.99:0/1290316087 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67d0039d90 con 0x7f67dc0709a0 2024-02-21T23:11:08.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.771+0000 7f67e3c00640 1 -- 172.21.15.99:0/1290316087 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67dc15dd40 con 0x7f67dc0709a0 2024-02-21T23:11:08.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.771+0000 7f67d8c00640 1 -- 172.21.15.99:0/1290316087 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d0030e60 con 0x7f67dc0709a0 2024-02-21T23:11:08.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.771+0000 7f67e3c00640 1 -- 172.21.15.99:0/1290316087 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67dc0fa550 con 0x7f67dc0709a0 2024-02-21T23:11:08.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.774+0000 7f67d8c00640 1 -- 172.21.15.99:0/1290316087 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f67d004a060 con 0x7f67dc0709a0 2024-02-21T23:11:08.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.776+0000 7f67d8c00640 1 --2- 172.21.15.99:0/1290316087 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f67bc09eed0 0x7f67bc0a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:08.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.776+0000 7f67d8c00640 1 -- 172.21.15.99:0/1290316087 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 8965+0+0 (secure 0 0 0) 0x7f67d00ebea0 con 0x7f67dc0709a0 2024-02-21T23:11:08.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.776+0000 7f67dbe00640 1 --2- 172.21.15.99:0/1290316087 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f67bc09eed0 0x7f67bc0a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:08.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.777+0000 7f67dbe00640 1 --2- 172.21.15.99:0/1290316087 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f67bc09eed0 0x7f67bc0a1390 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f67dc0f8d60 tx=0x7f67c8007cf0 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:08.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.777+0000 7f67e6b63740 1 Processor -- start 2024-02-21T23:11:08.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.777+0000 7f67e6b63740 1 -- start start 2024-02-21T23:11:08.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.779+0000 7f67e6b63740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c7b1ac4b0 0x556c7b1ac890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:08.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.779+0000 7f67e6b63740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556c7b1e7180 0x556c7b1e7600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:08.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.779+0000 7f67e6b63740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556c7b1e7b40 0x556c7b1e83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:08.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.779+0000 7f67e6b63740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c7b0d4b50 con 0x556c7b1e7180 2024-02-21T23:11:08.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.779+0000 7f67e6b63740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c7b07dda0 con 0x556c7b1ac4b0 2024-02-21T23:11:08.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.779+0000 7f67e6b63740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c7b0d0bf0 con 0x556c7b1e7b40 2024-02-21T23:11:08.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.780+0000 7f67dbe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556c7b1e7180 0x556c7b1e7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:08.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.780+0000 7f67dbe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556c7b1e7180 0x556c7b1e7600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34252/0 (socket says 172.21.15.99:34252) 2024-02-21T23:11:08.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.780+0000 7f67dbe00640 1 -- 172.21.15.99:0/1377687014 learned_addr learned my addr 172.21.15.99:0/1377687014 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:11:08.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.780+0000 7f67e1200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c7b1ac4b0 0x556c7b1ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:08.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.780+0000 7f67e1c00640 1 --2- 172.21.15.99:0/1377687014 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556c7b1e7b40 0x556c7b1e83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:08.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.780+0000 7f67e1c00640 1 -- 172.21.15.99:0/1377687014 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c7b1ac4b0 msgr2=0x556c7b1ac890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:08.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.780+0000 7f67e1c00640 1 --2- 172.21.15.99:0/1377687014 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c7b1ac4b0 0x556c7b1ac890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:08.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.780+0000 7f67e1c00640 1 -- 172.21.15.99:0/1377687014 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556c7b1e7180 msgr2=0x556c7b1e7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:08.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.780+0000 7f67e1c00640 1 --2- 172.21.15.99:0/1377687014 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556c7b1e7180 0x556c7b1e7600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:08.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.780+0000 7f67e1c00640 1 -- 172.21.15.99:0/1377687014 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556c7b0a0f80 con 0x556c7b1e7b40 2024-02-21T23:11:08.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.781+0000 7f67e1c00640 1 --2- 172.21.15.99:0/1377687014 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556c7b1e7b40 0x556c7b1e83b0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f67d4001460 tx=0x7f67d40016e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d51ae33c5c25d5a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:08.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.781+0000 7f67cd600640 1 -- 172.21.15.99:0/1377687014 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d4003b80 con 0x556c7b1e7b40 2024-02-21T23:11:08.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.781+0000 7f67cd600640 1 -- 172.21.15.99:0/1377687014 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67d4018070 con 0x556c7b1e7b40 2024-02-21T23:11:08.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.781+0000 7f67cd600640 1 -- 172.21.15.99:0/1377687014 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d40050d0 con 0x556c7b1e7b40 2024-02-21T23:11:08.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.782+0000 7f67e6b63740 1 -- 172.21.15.99:0/1377687014 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556c7b1e7b40 msgr2=0x556c7b1e83b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:08.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.782+0000 7f67e6b63740 1 --2- 172.21.15.99:0/1377687014 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556c7b1e7b40 0x556c7b1e83b0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f67d4001460 tx=0x7f67d40016e0 comp rx=0 tx=0).stop 2024-02-21T23:11:08.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.782+0000 7f67e6b63740 1 -- 172.21.15.99:0/1377687014 shutdown_connections 2024-02-21T23:11:08.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.782+0000 7f67e6b63740 1 --2- 172.21.15.99:0/1377687014 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556c7b1e7b40 0x556c7b1e83b0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:08.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.782+0000 7f67e6b63740 1 --2- 172.21.15.99:0/1377687014 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556c7b1e7180 0x556c7b1e7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:08.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.782+0000 7f67e6b63740 1 --2- 172.21.15.99:0/1377687014 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c7b1ac4b0 0x556c7b1ac890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:08.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.782+0000 7f67e6b63740 1 -- 172.21.15.99:0/1377687014 >> 172.21.15.99:0/1377687014 conn(0x556c7b16e520 msgr2=0x556c7b16f5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:11:08.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.782+0000 7f67e6b63740 1 -- 172.21.15.99:0/1377687014 shutdown_connections 2024-02-21T23:11:08.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.782+0000 7f67e6b63740 1 -- 172.21.15.99:0/1377687014 wait complete. 2024-02-21T23:11:08.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.783+0000 7f67e6b63740 1 -- start start 2024-02-21T23:11:08.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.783+0000 7f67e6b63740 1 Processor -- start 2024-02-21T23:11:08.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.785+0000 7f67e6b63740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556c7b1e7180 0x556c7b1a3d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:08.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.785+0000 7f67e6b63740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c7b1e7b40 0x556c7b1a7020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:08.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.785+0000 7f67e6b63740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556c7b1b6840 0x556c7b1b6c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:08.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.785+0000 7f67e6b63740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c7b1e5ef0 con 0x556c7b1e7180 2024-02-21T23:11:08.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.785+0000 7f67e6b63740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c7b073380 con 0x556c7b1e7b40 2024-02-21T23:11:08.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.785+0000 7f67e6b63740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c7b1e5c10 con 0x556c7b1b6840 2024-02-21T23:11:08.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.785+0000 7f67e6b63740 10 client.0 _ll_register_callbacks cb 0x556c7b0cc280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:11:08.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.785+0000 7f67e1200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556c7b1e7180 0x556c7b1a3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:08.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.785+0000 7f67dbe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c7b1e7b40 0x556c7b1a7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:08.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.786+0000 7f67e1200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556c7b1e7180 0x556c7b1a3d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34266/0 (socket says 172.21.15.99:34266) 2024-02-21T23:11:08.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.786+0000 7f67dbe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c7b1e7b40 0x556c7b1a7020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:58714/0 (socket says 172.21.15.99:58714) 2024-02-21T23:11:08.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.786+0000 7f67e1200640 1 -- 172.21.15.99:0/3261831688 learned_addr learned my addr 172.21.15.99:0/3261831688 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:11:08.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.786+0000 7f67e1c00640 1 --2- 172.21.15.99:0/3261831688 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556c7b1b6840 0x556c7b1b6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:08.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.786+0000 7f67e1200640 1 -- 172.21.15.99:0/3261831688 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556c7b1b6840 msgr2=0x556c7b1b6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:08.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.786+0000 7f67e1200640 1 --2- 172.21.15.99:0/3261831688 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556c7b1b6840 0x556c7b1b6c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:08.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.786+0000 7f67e1200640 1 -- 172.21.15.99:0/3261831688 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c7b1e7b40 msgr2=0x556c7b1a7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:08.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.786+0000 7f67e1200640 1 --2- 172.21.15.99:0/3261831688 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c7b1e7b40 0x556c7b1a7020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:08.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.786+0000 7f67e1200640 1 -- 172.21.15.99:0/3261831688 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556c7b09bc20 con 0x556c7b1e7180 2024-02-21T23:11:08.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.786+0000 7f67dbe00640 1 --2- 172.21.15.99:0/3261831688 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c7b1e7b40 0x556c7b1a7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:11:08.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.786+0000 7f67e1200640 1 --2- 172.21.15.99:0/3261831688 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556c7b1e7180 0x556c7b1a3d90 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f67d002bfb0 tx=0x7f67d00b9c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24539cf0497ad5ef server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:08.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.786+0000 7f67c2000640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:11:08.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.787+0000 7f67c2000640 1 -- 172.21.15.99:0/3261831688 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d00d1170 con 0x556c7b1e7180 2024-02-21T23:11:08.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.787+0000 7f67c2000640 1 -- 172.21.15.99:0/3261831688 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(37..37 src has 1..37) v4 ==== 8965+0+0 (secure 0 0 0) 0x7f67d00d80b0 con 0x556c7b1e7180 2024-02-21T23:11:08.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.787+0000 7f67e6b63740 1 -- 172.21.15.99:0/3261831688 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f67d4018070 con 0x556c7b1e7180 2024-02-21T23:11:08.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.787+0000 7f67c2000640 1 -- 172.21.15.99:0/3261831688 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f67d00c1d20 con 0x556c7b1e7180 2024-02-21T23:11:08.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.787+0000 7f67e6b63740 10 client.6846 fetch_fsmap learned FSMap version 17 2024-02-21T23:11:08.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.787+0000 7f67e6b63740 1 -- 172.21.15.99:0/3261831688 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x556c7ade93f0 con 0x556c7b1e7180 2024-02-21T23:11:08.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.787+0000 7f67c2000640 1 -- 172.21.15.99:0/3261831688 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67d4018070 con 0x556c7b1e7180 2024-02-21T23:11:08.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.787+0000 7f67c2000640 1 -- 172.21.15.99:0/3261831688 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f67d00c1890 con 0x556c7b1e7180 2024-02-21T23:11:08.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.787+0000 7f67e6b63740 10 client.6846 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:11:08.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.787+0000 7f67e6b63740 10 client.6846 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2024-02-21T23:11:08.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.788+0000 7f67e6b63740 20 client.6846 populate_metadata read hostname 'smithi099' 2024-02-21T23:11:08.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.788+0000 7f67e6b63740 1 --2- 172.21.15.99:0/3261831688 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x556c7b1f4440 0x556c7b1f4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:08.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.788+0000 7f67e6b63740 4 client.6846 mds_command: new command op to 4352 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:11:08.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.788+0000 7f67e6b63740 1 -- 172.21.15.99:0/3261831688 --> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556c7b0e2090 con 0x556c7b1f4440 2024-02-21T23:11:08.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.788+0000 7f67dbe00640 1 --2- 172.21.15.99:0/3261831688 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x556c7b1f4440 0x556c7b1f4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:08.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.789+0000 7f67c2000640 10 client.6846 ms_handle_connect on v2:172.21.15.99:6836/1676159950 2024-02-21T23:11:08.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.789+0000 7f67dbe00640 1 --2- 172.21.15.99:0/3261831688 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x556c7b1f4440 0x556c7b1f4880 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3472b2cbdaa6cc11 server_cookie=73df23ea2de2debd in_seq=0 out_seq=0 2024-02-21T23:11:08.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.789+0000 7f67c2000640 1 -- 172.21.15.99:0/3261831688 <== mds.1 v2:172.21.15.99:6836/1676159950 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x556c7b0e2090 con 0x556c7b1f4440 2024-02-21T23:11:08.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.789+0000 7f67c2000640 10 client.6846 handle_command_reply: tid=0 2024-02-21T23:11:08.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.789+0000 7f67e6b63740 1 client.6846 shutdown 2024-02-21T23:11:08.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.789+0000 7f67e6b63740 1 -- 172.21.15.99:0/3261831688 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556c7b1e7180 msgr2=0x556c7b1a3d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:08.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.789+0000 7f67e6b63740 1 --2- 172.21.15.99:0/3261831688 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556c7b1e7180 0x556c7b1a3d90 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f67d002bfb0 tx=0x7f67d00b9c80 comp rx=0 tx=0).stop 2024-02-21T23:11:08.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.790+0000 7f67e6b63740 1 -- 172.21.15.99:0/3261831688 shutdown_connections 2024-02-21T23:11:08.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.790+0000 7f67e6b63740 1 --2- 172.21.15.99:0/3261831688 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x556c7b1f4440 0x556c7b1f4880 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:08.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.790+0000 7f67e6b63740 1 --2- 172.21.15.99:0/3261831688 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556c7b1b6840 0x556c7b1b6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:08.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.790+0000 7f67e6b63740 1 --2- 172.21.15.99:0/3261831688 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c7b1e7b40 0x556c7b1a7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:08.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.790+0000 7f67e6b63740 1 --2- 172.21.15.99:0/3261831688 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556c7b1e7180 0x556c7b1a3d90 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:08.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.790+0000 7f67e6b63740 1 -- 172.21.15.99:0/3261831688 >> 172.21.15.99:0/3261831688 conn(0x556c7b1ac4b0 msgr2=0x556c7b1e6600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:11:08.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.790+0000 7f67c2000640 0 client.6846 ms_handle_reset on v2:172.21.15.99:6836/1676159950 2024-02-21T23:11:08.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.790+0000 7f67e6b63740 1 -- 172.21.15.99:0/3261831688 shutdown_connections 2024-02-21T23:11:08.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.790+0000 7f67e6b63740 1 -- 172.21.15.99:0/3261831688 wait complete. 2024-02-21T23:11:08.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.790+0000 7f67e6b63740 20 client.6846 trim_cache size 0 max 16384 2024-02-21T23:11:08.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.804+0000 7f67e6b63740 1 Processor -- start 2024-02-21T23:11:08.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.804+0000 7f67e6b63740 1 -- start start 2024-02-21T23:11:08.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.805+0000 7f67e6b63740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556c7b1b6840 0x556c7b16a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:08.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.805+0000 7f67e6b63740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c7b1e7180 0x556c7b1efaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:08.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.805+0000 7f67e6b63740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556c7b1e7b40 0x556c7b1f0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:08.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.805+0000 7f67e6b63740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67dc22cb70 con 0x556c7b1b6840 2024-02-21T23:11:08.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.805+0000 7f67e6b63740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67dc22a710 con 0x556c7b1e7180 2024-02-21T23:11:08.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.805+0000 7f67e6b63740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67dc228820 con 0x556c7b1e7b40 2024-02-21T23:11:08.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.805+0000 7f67e1200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556c7b1b6840 0x556c7b16a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:08.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.806+0000 7f67e1200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556c7b1b6840 0x556c7b16a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34280/0 (socket says 172.21.15.99:34280) 2024-02-21T23:11:08.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.806+0000 7f67e1200640 1 -- 172.21.15.99:0/404078541 learned_addr learned my addr 172.21.15.99:0/404078541 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:11:08.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.806+0000 7f67dbe00640 1 --2- 172.21.15.99:0/404078541 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c7b1e7180 0x556c7b1efaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:08.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.806+0000 7f67e1c00640 1 --2- 172.21.15.99:0/404078541 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556c7b1e7b40 0x556c7b1f0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:08.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.806+0000 7f67e1200640 1 -- 172.21.15.99:0/404078541 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556c7b1e7b40 msgr2=0x556c7b1f0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:08.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.806+0000 7f67e1200640 1 --2- 172.21.15.99:0/404078541 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556c7b1e7b40 0x556c7b1f0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:08.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.806+0000 7f67e1200640 1 -- 172.21.15.99:0/404078541 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c7b1e7180 msgr2=0x556c7b1efaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:08.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.806+0000 7f67e1200640 1 --2- 172.21.15.99:0/404078541 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c7b1e7180 0x556c7b1efaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:08.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.806+0000 7f67e1200640 1 -- 172.21.15.99:0/404078541 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556c7aeb37d0 con 0x556c7b1b6840 2024-02-21T23:11:08.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.806+0000 7f67e1200640 1 --2- 172.21.15.99:0/404078541 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556c7b1b6840 0x556c7b16a580 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f67d00b9510 tx=0x7f67d0044000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6692129be5c0e68d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:08.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.806+0000 7f67ccc00640 1 -- 172.21.15.99:0/404078541 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d00d1170 con 0x556c7b1b6840 2024-02-21T23:11:08.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.807+0000 7f67ccc00640 1 -- 172.21.15.99:0/404078541 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67d00b5bf0 con 0x556c7b1b6840 2024-02-21T23:11:08.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.807+0000 7f67ccc00640 1 -- 172.21.15.99:0/404078541 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d00b89d0 con 0x556c7b1b6840 2024-02-21T23:11:08.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.807+0000 7f67e6b63740 1 -- 172.21.15.99:0/404078541 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556c7b1b6840 msgr2=0x556c7b16a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:08.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.807+0000 7f67e6b63740 1 --2- 172.21.15.99:0/404078541 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556c7b1b6840 0x556c7b16a580 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f67d00b9510 tx=0x7f67d0044000 comp rx=0 tx=0).stop 2024-02-21T23:11:08.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.807+0000 7f67e6b63740 1 -- 172.21.15.99:0/404078541 shutdown_connections 2024-02-21T23:11:08.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.807+0000 7f67e6b63740 1 --2- 172.21.15.99:0/404078541 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556c7b1e7b40 0x556c7b1f0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:08.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.807+0000 7f67e6b63740 1 --2- 172.21.15.99:0/404078541 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c7b1e7180 0x556c7b1efaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:08.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.807+0000 7f67e6b63740 1 --2- 172.21.15.99:0/404078541 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556c7b1b6840 0x556c7b16a580 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:08.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.807+0000 7f67e6b63740 1 -- 172.21.15.99:0/404078541 >> 172.21.15.99:0/404078541 conn(0x556c7b1ac4b0 msgr2=0x556c7b1b4890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:11:08.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.807+0000 7f67e6b63740 1 -- 172.21.15.99:0/404078541 shutdown_connections 2024-02-21T23:11:08.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.807+0000 7f67e6b63740 1 -- 172.21.15.99:0/404078541 wait complete. 2024-02-21T23:11:08.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.808+0000 7f67e6b63740 1 -- start start 2024-02-21T23:11:08.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.808+0000 7f67e6b63740 1 Processor -- start 2024-02-21T23:11:08.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.810+0000 7f67e6b63740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556c7b1b6840 0x556c7b1e1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:08.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.810+0000 7f67e6b63740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c7b1e7180 0x556c7b1bb1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:08.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.810+0000 7f67e6b63740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556c7b1e7b40 0x556c7b1afde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:08.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.810+0000 7f67e6b63740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67dc228df0 con 0x556c7b1e7b40 2024-02-21T23:11:08.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.810+0000 7f67e6b63740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67dc22a0b0 con 0x556c7b1e7180 2024-02-21T23:11:08.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.810+0000 7f67e6b63740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67dc2293f0 con 0x556c7b1b6840 2024-02-21T23:11:08.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.810+0000 7f67e6b63740 10 client.0 _ll_register_callbacks cb 0x7f67d0006cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:11:08.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.810+0000 7f67e1200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556c7b1b6840 0x556c7b1e1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:08.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.810+0000 7f67e1200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556c7b1b6840 0x556c7b1e1110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:41112/0 (socket says 172.21.15.99:41112) 2024-02-21T23:11:08.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.810+0000 7f67e1200640 1 -- 172.21.15.99:0/3502056227 learned_addr learned my addr 172.21.15.99:0/3502056227 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:11:08.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.810+0000 7f67e1c00640 1 --2- 172.21.15.99:0/3502056227 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556c7b1e7b40 0x556c7b1afde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:08.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.810+0000 7f67dbe00640 1 --2- 172.21.15.99:0/3502056227 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c7b1e7180 0x556c7b1bb1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:08.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.810+0000 7f67e1200640 1 -- 172.21.15.99:0/3502056227 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c7b1e7180 msgr2=0x556c7b1bb1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:08.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.810+0000 7f67e1200640 1 --2- 172.21.15.99:0/3502056227 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c7b1e7180 0x556c7b1bb1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:08.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.810+0000 7f67e1200640 1 -- 172.21.15.99:0/3502056227 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556c7b1e7b40 msgr2=0x556c7b1afde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:08.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.810+0000 7f67e1200640 1 --2- 172.21.15.99:0/3502056227 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556c7b1e7b40 0x556c7b1afde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:08.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.810+0000 7f67e1200640 1 -- 172.21.15.99:0/3502056227 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556c7b16cfc0 con 0x556c7b1b6840 2024-02-21T23:11:08.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.810+0000 7f67dbe00640 1 --2- 172.21.15.99:0/3502056227 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c7b1e7180 0x556c7b1bb1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:11:08.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.810+0000 7f67e1c00640 1 --2- 172.21.15.99:0/3502056227 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556c7b1e7b40 0x556c7b1afde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:11:08.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.811+0000 7f67e1200640 1 --2- 172.21.15.99:0/3502056227 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556c7b1b6840 0x556c7b1e1110 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f67d00b9e30 tx=0x7f67d002b9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a225f70bcc66ff56 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:08.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.811+0000 7f67c2000640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-02-21T23:11:08.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.811+0000 7f67c2000640 1 -- 172.21.15.99:0/3502056227 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d00d1170 con 0x556c7b1b6840 2024-02-21T23:11:08.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.811+0000 7f67c2000640 1 -- 172.21.15.99:0/3502056227 <== mon.2 v2:172.21.15.181:3300/0 2 ==== osd_map(37..37 src has 1..37) v4 ==== 8965+0+0 (secure 0 0 0) 0x7f67d00d80b0 con 0x556c7b1b6840 2024-02-21T23:11:08.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.811+0000 7f67e6b63740 1 -- 172.21.15.99:0/3502056227 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f67d00b5bf0 con 0x556c7b1b6840 2024-02-21T23:11:08.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.811+0000 7f67c2000640 1 -- 172.21.15.99:0/3502056227 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f67d00b89d0 con 0x556c7b1b6840 2024-02-21T23:11:08.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.811+0000 7f67e6b63740 10 client.6971 fetch_fsmap learned FSMap version 17 2024-02-21T23:11:08.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.811+0000 7f67e6b63740 1 -- 172.21.15.99:0/3502056227 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x556c7b16cfc0 con 0x556c7b1b6840 2024-02-21T23:11:08.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.812+0000 7f67c2000640 1 -- 172.21.15.99:0/3502056227 <== mon.2 v2:172.21.15.181:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67d00b5bf0 con 0x556c7b1b6840 2024-02-21T23:11:08.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.812+0000 7f67c2000640 1 -- 172.21.15.99:0/3502056227 <== mon.2 v2:172.21.15.181:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f67d00b8b70 con 0x556c7b1b6840 2024-02-21T23:11:08.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.812+0000 7f67e6b63740 10 client.6971 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:11:08.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.812+0000 7f67e6b63740 10 client.6971 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2024-02-21T23:11:08.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.812+0000 7f67e6b63740 20 client.6971 populate_metadata read hostname 'smithi099' 2024-02-21T23:11:08.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.812+0000 7f67e6b63740 1 --2- 172.21.15.99:0/3502056227 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x556c7b1e39a0 0x556c7b1a5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:08.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.812+0000 7f67e6b63740 4 client.6971 mds_command: new command op to 4352 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T23:11:08.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.812+0000 7f67e6b63740 1 -- 172.21.15.99:0/3502056227 --> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x556c7b0dc3e0 con 0x556c7b1e39a0 2024-02-21T23:11:08.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.812+0000 7f67dbe00640 1 --2- 172.21.15.99:0/3502056227 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x556c7b1e39a0 0x556c7b1a5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:08.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.813+0000 7f67c2000640 10 client.6971 ms_handle_connect on v2:172.21.15.99:6836/1676159950 2024-02-21T23:11:08.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.813+0000 7f67dbe00640 1 --2- 172.21.15.99:0/3502056227 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x556c7b1e39a0 0x556c7b1a5fc0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=31023e5a50915a2 server_cookie=19e579e769b70fa2 in_seq=0 out_seq=0 2024-02-21T23:11:08.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.813+0000 7f67c2000640 1 -- 172.21.15.99:0/3502056227 <== mds.1 v2:172.21.15.99:6836/1676159950 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x556c7b0dc3e0 con 0x556c7b1e39a0 2024-02-21T23:11:08.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.813+0000 7f67c2000640 10 client.6971 handle_command_reply: tid=0 2024-02-21T23:11:08.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.813+0000 7f67e6b63740 1 client.6971 shutdown 2024-02-21T23:11:08.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.813+0000 7f67e6b63740 1 -- 172.21.15.99:0/3502056227 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556c7b1b6840 msgr2=0x556c7b1e1110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:08.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.813+0000 7f67e6b63740 1 --2- 172.21.15.99:0/3502056227 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556c7b1b6840 0x556c7b1e1110 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f67d00b9e30 tx=0x7f67d002b9a0 comp rx=0 tx=0).stop 2024-02-21T23:11:08.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.813+0000 7f67e6b63740 1 -- 172.21.15.99:0/3502056227 shutdown_connections 2024-02-21T23:11:08.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.813+0000 7f67e6b63740 1 --2- 172.21.15.99:0/3502056227 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x556c7b1e39a0 0x556c7b1a5fc0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:08.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.813+0000 7f67e6b63740 1 --2- 172.21.15.99:0/3502056227 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556c7b1e7b40 0x556c7b1afde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:08.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.813+0000 7f67e6b63740 1 --2- 172.21.15.99:0/3502056227 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556c7b1e7180 0x556c7b1bb1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:08.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.813+0000 7f67e6b63740 1 --2- 172.21.15.99:0/3502056227 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556c7b1b6840 0x556c7b1e1110 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:08.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.813+0000 7f67c2000640 0 client.6971 ms_handle_reset on v2:172.21.15.99:6836/1676159950 2024-02-21T23:11:08.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.813+0000 7f67e6b63740 1 -- 172.21.15.99:0/3502056227 >> 172.21.15.99:0/3502056227 conn(0x556c7b1ac4b0 msgr2=0x556c7b16dd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:11:08.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.814+0000 7f67e6b63740 1 -- 172.21.15.99:0/3502056227 shutdown_connections 2024-02-21T23:11:08.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.814+0000 7f67e6b63740 1 -- 172.21.15.99:0/3502056227 wait complete. 2024-02-21T23:11:08.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.814+0000 7f67e6b63740 20 client.6971 trim_cache size 0 max 16384 2024-02-21T23:11:08.813 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-02-21T23:11:08.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.814+0000 7f67e3c00640 1 -- 172.21.15.99:0/1290316087 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f67bc09eed0 msgr2=0x7f67bc0a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:08.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.814+0000 7f67e3c00640 1 --2- 172.21.15.99:0/1290316087 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f67bc09eed0 0x7f67bc0a1390 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f67dc0f8d60 tx=0x7f67c8007cf0 comp rx=0 tx=0).stop 2024-02-21T23:11:08.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.815+0000 7f67e3c00640 1 -- 172.21.15.99:0/1290316087 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f67dc0709a0 msgr2=0x7f67dc175200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:08.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.815+0000 7f67e3c00640 1 --2- 172.21.15.99:0/1290316087 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f67dc0709a0 0x7f67dc175200 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f67dc090300 tx=0x7f67d00046c0 comp rx=0 tx=0).stop 2024-02-21T23:11:08.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.815+0000 7f67e3c00640 1 -- 172.21.15.99:0/1290316087 shutdown_connections 2024-02-21T23:11:08.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.815+0000 7f67e3c00640 1 --2- 172.21.15.99:0/1290316087 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f67bc09eed0 0x7f67bc0a1390 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:08.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.815+0000 7f67e3c00640 1 --2- 172.21.15.99:0/1290316087 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f67dc18aab0 0x7f67dc15d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:08.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.815+0000 7f67e3c00640 1 --2- 172.21.15.99:0/1290316087 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f67dc189fc0 0x7f67dc15d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:08.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.815+0000 7f67e3c00640 1 --2- 172.21.15.99:0/1290316087 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f67dc0709a0 0x7f67dc175200 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:08.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.815+0000 7f67e3c00640 1 -- 172.21.15.99:0/1290316087 >> 172.21.15.99:0/1290316087 conn(0x7f67dc0f8d90 msgr2=0x7f67dc0f99a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:11:08.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.815+0000 7f67e3c00640 1 -- 172.21.15.99:0/1290316087 shutdown_connections 2024-02-21T23:11:08.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:08.815+0000 7f67e3c00640 1 -- 172.21.15.99:0/1290316087 wait complete. 2024-02-21T23:11:08.828 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T23:11:08.828 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-02-21T23:11:09.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.037+0000 7fc87b000640 1 Processor -- start 2024-02-21T23:11:09.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.037+0000 7fc87b000640 1 -- start start 2024-02-21T23:11:09.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.038+0000 7fc87b000640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fc874180c80 0x7fc874187f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:09.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.039+0000 7fc87b000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc87406ee40 con 0x7fc874188440 2024-02-21T23:11:09.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.039+0000 7fc87b000640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc87406f120 con 0x7fc87406e910 2024-02-21T23:11:09.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.039+0000 7fc87b000640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc87406f400 con 0x7fc874180c80 2024-02-21T23:11:09.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.039+0000 7fc873e00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fc874180c80 0x7fc874187f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:09.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.039+0000 7fc873400640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fc87406e910 0x7fc8740cb420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:53794/0 (socket says 172.21.15.99:53794) 2024-02-21T23:11:09.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.039+0000 7fc873400640 1 -- 172.21.15.99:0/3922770788 learned_addr learned my addr 172.21.15.99:0/3922770788 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:11:09.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.039+0000 7fc872a00640 1 -- 172.21.15.99:0/3922770788 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1382884071 0 0) 0x7fc87406f120 con 0x7fc87406e910 2024-02-21T23:11:09.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.039+0000 7fc873e00640 1 -- 172.21.15.99:0/3922770788 >> v1:172.21.15.181:6789/0 conn(0x7fc87406e910 legacy=0x7fc8740cb420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:09.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.039+0000 7fc873e00640 1 -- 172.21.15.99:0/3922770788 >> v1:172.21.15.162:6789/0 conn(0x7fc874188440 legacy=0x7fc8740f4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:09.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.039+0000 7fc873e00640 1 -- 172.21.15.99:0/3922770788 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc87406f6e0 con 0x7fc874180c80 2024-02-21T23:11:09.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.041+0000 7fc873e00640 1 --2- 172.21.15.99:0/3922770788 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc874180c80 0x7fc874187f00 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fc8640097a0 tx=0x7fc86402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3fdce26dfdb8829a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:09.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.041+0000 7fc872a00640 1 -- 172.21.15.99:0/3922770788 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc864035020 con 0x7fc874180c80 2024-02-21T23:11:09.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.041+0000 7fc872a00640 1 -- 172.21.15.99:0/3922770788 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc864031830 con 0x7fc874180c80 2024-02-21T23:11:09.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.041+0000 7fc872a00640 1 -- 172.21.15.99:0/3922770788 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc864031c00 con 0x7fc874180c80 2024-02-21T23:11:09.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.041+0000 7fc87b000640 1 -- 172.21.15.99:0/3922770788 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc874180c80 msgr2=0x7fc874187f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:09.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.041+0000 7fc87b000640 1 --2- 172.21.15.99:0/3922770788 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc874180c80 0x7fc874187f00 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fc8640097a0 tx=0x7fc86402b8d0 comp rx=0 tx=0).stop 2024-02-21T23:11:09.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.042+0000 7fc87b000640 1 -- 172.21.15.99:0/3922770788 shutdown_connections 2024-02-21T23:11:09.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.042+0000 7fc87b000640 1 --2- 172.21.15.99:0/3922770788 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc874180c80 0x7fc874187f00 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:09.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.042+0000 7fc87b000640 1 -- 172.21.15.99:0/3922770788 >> 172.21.15.99:0/3922770788 conn(0x7fc8740ce5f0 msgr2=0x7fc8740cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:11:09.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.042+0000 7fc87b000640 1 -- 172.21.15.99:0/3922770788 shutdown_connections 2024-02-21T23:11:09.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.042+0000 7fc87b000640 1 -- 172.21.15.99:0/3922770788 wait complete. 2024-02-21T23:11:09.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.044+0000 7fc87b000640 1 Processor -- start 2024-02-21T23:11:09.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.044+0000 7fc87b000640 1 -- start start 2024-02-21T23:11:09.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.045+0000 7fc87b000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc87406e910 0x7fc8740f64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:09.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.045+0000 7fc87b000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc874180c80 0x7fc8740f49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:09.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.045+0000 7fc87b000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc874188440 0x7fc874169c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:09.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.045+0000 7fc87b000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8740701c0 con 0x7fc874188440 2024-02-21T23:11:09.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.045+0000 7fc87b000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc87406fca0 con 0x7fc874180c80 2024-02-21T23:11:09.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.045+0000 7fc87b000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc874070340 con 0x7fc87406e910 2024-02-21T23:11:09.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.045+0000 7fc879000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc874188440 0x7fc874169c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:09.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.045+0000 7fc873e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc87406e910 0x7fc8740f64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:09.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.046+0000 7fc873e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc87406e910 0x7fc8740f64d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:41132/0 (socket says 172.21.15.99:41132) 2024-02-21T23:11:09.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.046+0000 7fc873e00640 1 -- 172.21.15.99:0/2355232329 learned_addr learned my addr 172.21.15.99:0/2355232329 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:11:09.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.046+0000 7fc873400640 1 --2- 172.21.15.99:0/2355232329 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc874180c80 0x7fc8740f49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:09.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.046+0000 7fc873400640 1 -- 172.21.15.99:0/2355232329 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc87406e910 msgr2=0x7fc8740f64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:09.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.046+0000 7fc873400640 1 --2- 172.21.15.99:0/2355232329 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc87406e910 0x7fc8740f64d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:09.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.046+0000 7fc873400640 1 -- 172.21.15.99:0/2355232329 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc874188440 msgr2=0x7fc874169c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:09.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.046+0000 7fc873400640 1 --2- 172.21.15.99:0/2355232329 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc874188440 0x7fc874169c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:09.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.046+0000 7fc873400640 1 -- 172.21.15.99:0/2355232329 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8740f5100 con 0x7fc874180c80 2024-02-21T23:11:09.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.046+0000 7fc873e00640 1 --2- 172.21.15.99:0/2355232329 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc87406e910 0x7fc8740f64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:11:09.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.046+0000 7fc879000640 1 --2- 172.21.15.99:0/2355232329 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc874188440 0x7fc874169c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:11:09.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.046+0000 7fc873400640 1 --2- 172.21.15.99:0/2355232329 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc874180c80 0x7fc8740f49a0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fc86000c3e0 tx=0x7fc86000c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:09.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.047+0000 7fc86be00640 1 -- 172.21.15.99:0/2355232329 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8600074e0 con 0x7fc874180c80 2024-02-21T23:11:09.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.047+0000 7fc86be00640 1 -- 172.21.15.99:0/2355232329 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8600047e0 con 0x7fc874180c80 2024-02-21T23:11:09.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.047+0000 7fc86be00640 1 -- 172.21.15.99:0/2355232329 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc860004bd0 con 0x7fc874180c80 2024-02-21T23:11:09.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.047+0000 7fc87b000640 1 -- 172.21.15.99:0/2355232329 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8740f53e0 con 0x7fc874180c80 2024-02-21T23:11:09.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.047+0000 7fc87b000640 1 -- 172.21.15.99:0/2355232329 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8740f59a0 con 0x7fc874180c80 2024-02-21T23:11:09.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.050+0000 7fc86be00640 1 -- 172.21.15.99:0/2355232329 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7fc860011070 con 0x7fc874180c80 2024-02-21T23:11:09.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.053+0000 7fc86be00640 1 --2- 172.21.15.99:0/2355232329 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fc85409eed0 0x7fc8540a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:09.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.053+0000 7fc86be00640 1 -- 172.21.15.99:0/2355232329 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 8965+0+0 (secure 0 0 0) 0x7fc8600c9b50 con 0x7fc874180c80 2024-02-21T23:11:09.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.053+0000 7fc873e00640 1 --2- 172.21.15.99:0/2355232329 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fc85409eed0 0x7fc8540a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:09.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.054+0000 7fc87de6b740 1 Processor -- start 2024-02-21T23:11:09.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.054+0000 7fc87de6b740 1 -- start start 2024-02-21T23:11:09.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.054+0000 7fc873e00640 1 --2- 172.21.15.99:0/2355232329 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fc85409eed0 0x7fc8540a1390 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc864009560 tx=0x7fc864008030 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:09.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.056+0000 7fc87de6b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561db2d8e5a0 0x561db2d91b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:09.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.056+0000 7fc87de6b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561db2d44d40 0x561db2d8e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:09.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.056+0000 7fc87de6b740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561db2dc4a00 0x561db2dc4e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:09.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.056+0000 7fc87de6b740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x561db2caeb50 con 0x561db2dc4a00 2024-02-21T23:11:09.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.056+0000 7fc87de6b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x561db2c57da0 con 0x561db2d44d40 2024-02-21T23:11:09.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.056+0000 7fc87de6b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x561db2caabf0 con 0x561db2d8e5a0 2024-02-21T23:11:09.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.056+0000 7fc879000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561db2dc4a00 0x561db2dc4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:09.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.056+0000 7fc879000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561db2dc4a00 0x561db2dc4e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34322/0 (socket says 172.21.15.99:34322) 2024-02-21T23:11:09.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.056+0000 7fc879000640 1 -- 172.21.15.99:0/2059082833 learned_addr learned my addr 172.21.15.99:0/2059082833 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:11:09.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.056+0000 7fc873e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561db2d8e5a0 0x561db2d91b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:09.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.056+0000 7fc873400640 1 --2- 172.21.15.99:0/2059082833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561db2d44d40 0x561db2d8e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:09.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.057+0000 7fc879000640 1 -- 172.21.15.99:0/2059082833 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561db2d8e5a0 msgr2=0x561db2d91b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:09.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.057+0000 7fc879000640 1 --2- 172.21.15.99:0/2059082833 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561db2d8e5a0 0x561db2d91b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:09.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.057+0000 7fc879000640 1 -- 172.21.15.99:0/2059082833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561db2d44d40 msgr2=0x561db2d8e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:09.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.057+0000 7fc879000640 1 --2- 172.21.15.99:0/2059082833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561db2d44d40 0x561db2d8e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:09.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.057+0000 7fc879000640 1 -- 172.21.15.99:0/2059082833 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561db2c7af80 con 0x561db2dc4a00 2024-02-21T23:11:09.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.057+0000 7fc873e00640 1 --2- 172.21.15.99:0/2059082833 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561db2d8e5a0 0x561db2d91b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:11:09.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.057+0000 7fc879000640 1 --2- 172.21.15.99:0/2059082833 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561db2dc4a00 0x561db2dc4e80 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fc86c00f300 tx=0x7fc86c001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=701ed8413195810a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:09.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.057+0000 7fc868c00640 1 -- 172.21.15.99:0/2059082833 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc86c003b80 con 0x561db2dc4a00 2024-02-21T23:11:09.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.057+0000 7fc868c00640 1 -- 172.21.15.99:0/2059082833 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc86c018070 con 0x561db2dc4a00 2024-02-21T23:11:09.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.057+0000 7fc868c00640 1 -- 172.21.15.99:0/2059082833 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc86c0050d0 con 0x561db2dc4a00 2024-02-21T23:11:09.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.058+0000 7fc87de6b740 1 -- 172.21.15.99:0/2059082833 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561db2dc4a00 msgr2=0x561db2dc4e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:09.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.058+0000 7fc87de6b740 1 --2- 172.21.15.99:0/2059082833 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561db2dc4a00 0x561db2dc4e80 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fc86c00f300 tx=0x7fc86c001670 comp rx=0 tx=0).stop 2024-02-21T23:11:09.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.058+0000 7fc87de6b740 1 -- 172.21.15.99:0/2059082833 shutdown_connections 2024-02-21T23:11:09.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.058+0000 7fc87de6b740 1 --2- 172.21.15.99:0/2059082833 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561db2dc4a00 0x561db2dc4e80 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:09.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.058+0000 7fc87de6b740 1 --2- 172.21.15.99:0/2059082833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561db2d44d40 0x561db2d8e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:09.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.058+0000 7fc87de6b740 1 --2- 172.21.15.99:0/2059082833 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561db2d8e5a0 0x561db2d91b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:09.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.058+0000 7fc87de6b740 1 -- 172.21.15.99:0/2059082833 >> 172.21.15.99:0/2059082833 conn(0x561db2d48520 msgr2=0x561db2d495a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:11:09.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.058+0000 7fc87de6b740 1 -- 172.21.15.99:0/2059082833 shutdown_connections 2024-02-21T23:11:09.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.058+0000 7fc87de6b740 1 -- 172.21.15.99:0/2059082833 wait complete. 2024-02-21T23:11:09.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.060+0000 7fc87de6b740 1 -- start start 2024-02-21T23:11:09.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.060+0000 7fc87de6b740 1 Processor -- start 2024-02-21T23:11:09.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.062+0000 7fc87de6b740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561db2d8e5a0 0x561db2dd0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:09.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.062+0000 7fc87de6b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561db2dc4a00 0x561db2dccc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:09.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.062+0000 7fc87de6b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561db2d79060 0x561db2d794e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:09.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.062+0000 7fc87de6b740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x561db2d8eec0 con 0x561db2d8e5a0 2024-02-21T23:11:09.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.062+0000 7fc87de6b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x561db2c4d380 con 0x561db2dc4a00 2024-02-21T23:11:09.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.062+0000 7fc87de6b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x561db2d451c0 con 0x561db2d79060 2024-02-21T23:11:09.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.062+0000 7fc87de6b740 10 client.0 _ll_register_callbacks cb 0x561db2ca6280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:11:09.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.062+0000 7fc873e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561db2d8e5a0 0x561db2dd0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:09.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.063+0000 7fc873e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561db2d8e5a0 0x561db2dd0450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34324/0 (socket says 172.21.15.99:34324) 2024-02-21T23:11:09.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.063+0000 7fc873e00640 1 -- 172.21.15.99:0/1979109900 learned_addr learned my addr 172.21.15.99:0/1979109900 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:11:09.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.063+0000 7fc879000640 1 --2- 172.21.15.99:0/1979109900 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561db2d79060 0x561db2d794e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:09.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.063+0000 7fc873400640 1 --2- 172.21.15.99:0/1979109900 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561db2dc4a00 0x561db2dccc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:09.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.063+0000 7fc873e00640 1 -- 172.21.15.99:0/1979109900 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561db2d79060 msgr2=0x561db2d794e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:09.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.063+0000 7fc873e00640 1 --2- 172.21.15.99:0/1979109900 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561db2d79060 0x561db2d794e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:09.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.063+0000 7fc873e00640 1 -- 172.21.15.99:0/1979109900 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561db2dc4a00 msgr2=0x561db2dccc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:09.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.063+0000 7fc873e00640 1 --2- 172.21.15.99:0/1979109900 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561db2dc4a00 0x561db2dccc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:09.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.063+0000 7fc873e00640 1 -- 172.21.15.99:0/1979109900 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561db2c75c20 con 0x561db2d8e5a0 2024-02-21T23:11:09.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.064+0000 7fc873e00640 1 --2- 172.21.15.99:0/1979109900 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561db2d8e5a0 0x561db2dd0450 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fc864031e20 tx=0x7fc86402e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a65913acaad3ad2f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:09.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.064+0000 7fc85d600640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:11:09.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.064+0000 7fc85d600640 1 -- 172.21.15.99:0/1979109900 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc864056060 con 0x561db2d8e5a0 2024-02-21T23:11:09.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.064+0000 7fc85d600640 1 -- 172.21.15.99:0/1979109900 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(37..37 src has 1..37) v4 ==== 8965+0+0 (secure 0 0 0) 0x7fc864046650 con 0x561db2d8e5a0 2024-02-21T23:11:09.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.064+0000 7fc87de6b740 1 -- 172.21.15.99:0/1979109900 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc86c018070 con 0x561db2d8e5a0 2024-02-21T23:11:09.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.064+0000 7fc85d600640 1 -- 172.21.15.99:0/1979109900 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc86405d050 con 0x561db2d8e5a0 2024-02-21T23:11:09.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.064+0000 7fc87de6b740 10 client.6861 fetch_fsmap learned FSMap version 17 2024-02-21T23:11:09.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.064+0000 7fc87de6b740 1 -- 172.21.15.99:0/1979109900 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x561db29c33f0 con 0x561db2d8e5a0 2024-02-21T23:11:09.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.065+0000 7fc85d600640 1 -- 172.21.15.99:0/1979109900 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc86c018070 con 0x561db2d8e5a0 2024-02-21T23:11:09.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.065+0000 7fc85d600640 1 -- 172.21.15.99:0/1979109900 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fc864046850 con 0x561db2d8e5a0 2024-02-21T23:11:09.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.065+0000 7fc87de6b740 10 client.6861 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:11:09.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.065+0000 7fc87de6b740 10 client.6861 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:11:09.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.065+0000 7fc87de6b740 20 client.6861 populate_metadata read hostname 'smithi099' 2024-02-21T23:11:09.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.065+0000 7fc87de6b740 1 --2- 172.21.15.99:0/1979109900 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x561db2dcf570 0x561db2dd2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:09.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.065+0000 7fc87de6b740 4 client.6861 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:11:09.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.065+0000 7fc87de6b740 1 -- 172.21.15.99:0/1979109900 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561db2cbc090 con 0x561db2dcf570 2024-02-21T23:11:09.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.066+0000 7fc873400640 1 --2- 172.21.15.99:0/1979109900 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x561db2dcf570 0x561db2dd2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:09.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.066+0000 7fc873400640 1 --2- 172.21.15.99:0/1979109900 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x561db2dcf570 0x561db2dd2270 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1fcc6e254d75699c server_cookie=d6d21f429ebf7d90 in_seq=0 out_seq=0 2024-02-21T23:11:09.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.066+0000 7fc85d600640 10 client.6861 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:11:09.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.067+0000 7fc85d600640 1 -- 172.21.15.99:0/1979109900 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x561db2cbc090 con 0x561db2dcf570 2024-02-21T23:11:09.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.067+0000 7fc85d600640 10 client.6861 handle_command_reply: tid=0 2024-02-21T23:11:09.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.067+0000 7fc87de6b740 1 client.6861 shutdown 2024-02-21T23:11:09.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.067+0000 7fc87de6b740 1 -- 172.21.15.99:0/1979109900 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561db2d8e5a0 msgr2=0x561db2dd0450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:09.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.067+0000 7fc87de6b740 1 --2- 172.21.15.99:0/1979109900 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561db2d8e5a0 0x561db2dd0450 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fc864031e20 tx=0x7fc86402e000 comp rx=0 tx=0).stop 2024-02-21T23:11:09.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.067+0000 7fc87de6b740 1 -- 172.21.15.99:0/1979109900 shutdown_connections 2024-02-21T23:11:09.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.067+0000 7fc87de6b740 1 --2- 172.21.15.99:0/1979109900 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x561db2dcf570 0x561db2dd2270 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:09.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.067+0000 7fc87de6b740 1 --2- 172.21.15.99:0/1979109900 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561db2d79060 0x561db2d794e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:09.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.067+0000 7fc87de6b740 1 --2- 172.21.15.99:0/1979109900 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561db2dc4a00 0x561db2dccc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:09.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.067+0000 7fc87de6b740 1 --2- 172.21.15.99:0/1979109900 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561db2d8e5a0 0x561db2dd0450 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:09.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.067+0000 7fc85d600640 0 client.6861 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:11:09.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.067+0000 7fc87de6b740 1 -- 172.21.15.99:0/1979109900 >> 172.21.15.99:0/1979109900 conn(0x561db2d44d40 msgr2=0x561db2d4fb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:11:09.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.067+0000 7fc87de6b740 1 -- 172.21.15.99:0/1979109900 shutdown_connections 2024-02-21T23:11:09.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.067+0000 7fc87de6b740 1 -- 172.21.15.99:0/1979109900 wait complete. 2024-02-21T23:11:09.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.068+0000 7fc87de6b740 20 client.6861 trim_cache size 0 max 16384 2024-02-21T23:11:09.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.095+0000 7fc87de6b740 1 Processor -- start 2024-02-21T23:11:09.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.095+0000 7fc87de6b740 1 -- start start 2024-02-21T23:11:09.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.096+0000 7fc87de6b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561db2d79060 0x561db2d49560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:09.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.097+0000 7fc87de6b740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561db2d8e5a0 0x561db2dc4400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:09.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.097+0000 7fc87de6b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561db2dc4a00 0x561db2e22070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:09.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.097+0000 7fc87de6b740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc874228810 con 0x561db2d8e5a0 2024-02-21T23:11:09.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.097+0000 7fc87de6b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8742263b0 con 0x561db2dc4a00 2024-02-21T23:11:09.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.097+0000 7fc87de6b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc874072780 con 0x561db2d79060 2024-02-21T23:11:09.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.097+0000 7fc873400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561db2d8e5a0 0x561db2dc4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:09.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.097+0000 7fc873e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561db2d79060 0x561db2d49560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:09.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.097+0000 7fc873400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561db2d8e5a0 0x561db2dc4400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34340/0 (socket says 172.21.15.99:34340) 2024-02-21T23:11:09.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.097+0000 7fc873400640 1 -- 172.21.15.99:0/820476258 learned_addr learned my addr 172.21.15.99:0/820476258 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:11:09.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.097+0000 7fc879000640 1 --2- 172.21.15.99:0/820476258 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561db2dc4a00 0x561db2e22070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:09.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.097+0000 7fc873e00640 1 -- 172.21.15.99:0/820476258 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561db2dc4a00 msgr2=0x561db2e22070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:09.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.097+0000 7fc873e00640 1 --2- 172.21.15.99:0/820476258 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561db2dc4a00 0x561db2e22070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:09.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.097+0000 7fc873e00640 1 -- 172.21.15.99:0/820476258 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561db2d8e5a0 msgr2=0x561db2dc4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:09.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.097+0000 7fc873e00640 1 --2- 172.21.15.99:0/820476258 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561db2d8e5a0 0x561db2dc4400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:09.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.097+0000 7fc873e00640 1 -- 172.21.15.99:0/820476258 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561db2a8d7d0 con 0x561db2d79060 2024-02-21T23:11:09.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.098+0000 7fc873e00640 1 --2- 172.21.15.99:0/820476258 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561db2d79060 0x561db2d49560 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fc864031e20 tx=0x7fc864040000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8eb13adbf08852b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:09.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.098+0000 7fc85fe00640 1 -- 172.21.15.99:0/820476258 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc864056040 con 0x561db2d79060 2024-02-21T23:11:09.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.098+0000 7fc85fe00640 1 -- 172.21.15.99:0/820476258 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc864046650 con 0x561db2d79060 2024-02-21T23:11:09.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.098+0000 7fc85fe00640 1 -- 172.21.15.99:0/820476258 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc864035040 con 0x561db2d79060 2024-02-21T23:11:09.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.099+0000 7fc87de6b740 1 -- 172.21.15.99:0/820476258 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561db2d79060 msgr2=0x561db2d49560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:09.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.099+0000 7fc87de6b740 1 --2- 172.21.15.99:0/820476258 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561db2d79060 0x561db2d49560 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fc864031e20 tx=0x7fc864040000 comp rx=0 tx=0).stop 2024-02-21T23:11:09.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.099+0000 7fc87de6b740 1 -- 172.21.15.99:0/820476258 shutdown_connections 2024-02-21T23:11:09.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.099+0000 7fc87de6b740 1 --2- 172.21.15.99:0/820476258 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561db2dc4a00 0x561db2e22070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:09.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.099+0000 7fc87de6b740 1 --2- 172.21.15.99:0/820476258 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561db2d8e5a0 0x561db2dc4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:09.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.099+0000 7fc87de6b740 1 --2- 172.21.15.99:0/820476258 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561db2d79060 0x561db2d49560 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:09.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.099+0000 7fc87de6b740 1 -- 172.21.15.99:0/820476258 >> 172.21.15.99:0/820476258 conn(0x561db2d44d40 msgr2=0x561db2d454c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:11:09.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.099+0000 7fc87de6b740 1 -- 172.21.15.99:0/820476258 shutdown_connections 2024-02-21T23:11:09.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.099+0000 7fc87de6b740 1 -- 172.21.15.99:0/820476258 wait complete. 2024-02-21T23:11:09.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.100+0000 7fc87de6b740 1 -- start start 2024-02-21T23:11:09.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.100+0000 7fc87de6b740 1 Processor -- start 2024-02-21T23:11:09.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.101+0000 7fc87de6b740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561db2d79060 0x561db2e24f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:09.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.101+0000 7fc87de6b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561db2d8e5a0 0x561db2e1d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:09.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.101+0000 7fc87de6b740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561db2dc4a00 0x561db2e1dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:09.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.101+0000 7fc87de6b740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc87421d230 con 0x561db2d79060 2024-02-21T23:11:09.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.101+0000 7fc87de6b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc874225d50 con 0x561db2d8e5a0 2024-02-21T23:11:09.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.101+0000 7fc87de6b740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc87421d850 con 0x561db2dc4a00 2024-02-21T23:11:09.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.101+0000 7fc87de6b740 10 client.0 _ll_register_callbacks cb 0x7fc864031ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:11:09.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.101+0000 7fc873e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561db2d79060 0x561db2e24f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:09.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.102+0000 7fc873e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561db2d79060 0x561db2e24f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34356/0 (socket says 172.21.15.99:34356) 2024-02-21T23:11:09.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.102+0000 7fc873e00640 1 -- 172.21.15.99:0/3652849711 learned_addr learned my addr 172.21.15.99:0/3652849711 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:11:09.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.102+0000 7fc873400640 1 --2- 172.21.15.99:0/3652849711 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561db2d8e5a0 0x561db2e1d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:09.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.102+0000 7fc879000640 1 --2- 172.21.15.99:0/3652849711 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561db2dc4a00 0x561db2e1dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:09.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.102+0000 7fc873e00640 1 -- 172.21.15.99:0/3652849711 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561db2dc4a00 msgr2=0x561db2e1dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:09.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.102+0000 7fc873e00640 1 --2- 172.21.15.99:0/3652849711 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561db2dc4a00 0x561db2e1dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:09.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.102+0000 7fc873e00640 1 -- 172.21.15.99:0/3652849711 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561db2d8e5a0 msgr2=0x561db2e1d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:09.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.102+0000 7fc873e00640 1 --2- 172.21.15.99:0/3652849711 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561db2d8e5a0 0x561db2e1d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:09.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.102+0000 7fc873e00640 1 -- 172.21.15.99:0/3652849711 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561db2e25450 con 0x561db2d79060 2024-02-21T23:11:09.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.102+0000 7fc879000640 1 --2- 172.21.15.99:0/3652849711 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561db2dc4a00 0x561db2e1dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:11:09.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.102+0000 7fc873e00640 1 --2- 172.21.15.99:0/3652849711 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561db2d79060 0x561db2e24f10 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fc864031e20 tx=0x7fc864009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd164a6f908ba386 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:09.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.102+0000 7fc85d600640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:11:09.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.103+0000 7fc85d600640 1 -- 172.21.15.99:0/3652849711 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc864065070 con 0x561db2d79060 2024-02-21T23:11:09.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.103+0000 7fc85d600640 1 -- 172.21.15.99:0/3652849711 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(37..37 src has 1..37) v4 ==== 8965+0+0 (secure 0 0 0) 0x7fc864004230 con 0x561db2d79060 2024-02-21T23:11:09.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.103+0000 7fc87de6b740 1 -- 172.21.15.99:0/3652849711 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc864046650 con 0x561db2d79060 2024-02-21T23:11:09.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.103+0000 7fc85d600640 1 -- 172.21.15.99:0/3652849711 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc864070050 con 0x561db2d79060 2024-02-21T23:11:09.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.103+0000 7fc87de6b740 10 client.6867 fetch_fsmap learned FSMap version 17 2024-02-21T23:11:09.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.103+0000 7fc87de6b740 1 -- 172.21.15.99:0/3652849711 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x561db2d47c70 con 0x561db2d79060 2024-02-21T23:11:09.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.103+0000 7fc85d600640 1 -- 172.21.15.99:0/3652849711 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc864046650 con 0x561db2d79060 2024-02-21T23:11:09.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.103+0000 7fc85d600640 1 -- 172.21.15.99:0/3652849711 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fc864003610 con 0x561db2d79060 2024-02-21T23:11:09.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.104+0000 7fc87de6b740 10 client.6867 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:11:09.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.104+0000 7fc87de6b740 10 client.6867 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:11:09.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.104+0000 7fc87de6b740 20 client.6867 populate_metadata read hostname 'smithi099' 2024-02-21T23:11:09.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.104+0000 7fc87de6b740 1 --2- 172.21.15.99:0/3652849711 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x561db2d50f00 0x561db2db6220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:09.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.104+0000 7fc87de6b740 4 client.6867 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T23:11:09.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.104+0000 7fc87de6b740 1 -- 172.21.15.99:0/3652849711 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x561db2cb63e0 con 0x561db2d50f00 2024-02-21T23:11:09.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.104+0000 7fc873400640 1 --2- 172.21.15.99:0/3652849711 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x561db2d50f00 0x561db2db6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:09.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.104+0000 7fc873400640 1 --2- 172.21.15.99:0/3652849711 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x561db2d50f00 0x561db2db6220 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c3dd5c1ae4429d4 server_cookie=538ee78ec7ce78a5 in_seq=0 out_seq=0 2024-02-21T23:11:09.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.104+0000 7fc85d600640 10 client.6867 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:11:09.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.105+0000 7fc85d600640 1 -- 172.21.15.99:0/3652849711 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x561db2cb63e0 con 0x561db2d50f00 2024-02-21T23:11:09.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.105+0000 7fc85d600640 10 client.6867 handle_command_reply: tid=0 2024-02-21T23:11:09.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.105+0000 7fc87de6b740 1 client.6867 shutdown 2024-02-21T23:11:09.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.105+0000 7fc87de6b740 1 -- 172.21.15.99:0/3652849711 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561db2d79060 msgr2=0x561db2e24f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:09.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.105+0000 7fc87de6b740 1 --2- 172.21.15.99:0/3652849711 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561db2d79060 0x561db2e24f10 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fc864031e20 tx=0x7fc864009190 comp rx=0 tx=0).stop 2024-02-21T23:11:09.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.105+0000 7fc87de6b740 1 -- 172.21.15.99:0/3652849711 shutdown_connections 2024-02-21T23:11:09.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.105+0000 7fc87de6b740 1 --2- 172.21.15.99:0/3652849711 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x561db2d50f00 0x561db2db6220 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:09.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.105+0000 7fc87de6b740 1 --2- 172.21.15.99:0/3652849711 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x561db2dc4a00 0x561db2e1dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:09.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.105+0000 7fc87de6b740 1 --2- 172.21.15.99:0/3652849711 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x561db2d8e5a0 0x561db2e1d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:09.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.105+0000 7fc87de6b740 1 --2- 172.21.15.99:0/3652849711 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x561db2d79060 0x561db2e24f10 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:09.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.105+0000 7fc87de6b740 1 -- 172.21.15.99:0/3652849711 >> 172.21.15.99:0/3652849711 conn(0x561db2d44d40 msgr2=0x561db2d500b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:11:09.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.105+0000 7fc85d600640 0 client.6867 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:11:09.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.105+0000 7fc87de6b740 1 -- 172.21.15.99:0/3652849711 shutdown_connections 2024-02-21T23:11:09.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.105+0000 7fc87de6b740 1 -- 172.21.15.99:0/3652849711 wait complete. 2024-02-21T23:11:09.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.106+0000 7fc87de6b740 20 client.6867 trim_cache size 0 max 16384 2024-02-21T23:11:09.109 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-02-21T23:11:09.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.106+0000 7fc87b000640 1 -- 172.21.15.99:0/2355232329 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fc85409eed0 msgr2=0x7fc8540a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:09.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.106+0000 7fc87b000640 1 --2- 172.21.15.99:0/2355232329 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fc85409eed0 0x7fc8540a1390 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc864009560 tx=0x7fc864008030 comp rx=0 tx=0).stop 2024-02-21T23:11:09.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.106+0000 7fc87b000640 1 -- 172.21.15.99:0/2355232329 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc874180c80 msgr2=0x7fc8740f49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:09.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.106+0000 7fc87b000640 1 --2- 172.21.15.99:0/2355232329 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc874180c80 0x7fc8740f49a0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fc86000c3e0 tx=0x7fc86000c8a0 comp rx=0 tx=0).stop 2024-02-21T23:11:09.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.106+0000 7fc87b000640 1 -- 172.21.15.99:0/2355232329 shutdown_connections 2024-02-21T23:11:09.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.106+0000 7fc87b000640 1 --2- 172.21.15.99:0/2355232329 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fc85409eed0 0x7fc8540a1390 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:09.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.106+0000 7fc87b000640 1 --2- 172.21.15.99:0/2355232329 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc874188440 0x7fc874169c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:09.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.106+0000 7fc87b000640 1 --2- 172.21.15.99:0/2355232329 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc874180c80 0x7fc8740f49a0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:09.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.106+0000 7fc87b000640 1 --2- 172.21.15.99:0/2355232329 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc87406e910 0x7fc8740f64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:09.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.106+0000 7fc87b000640 1 -- 172.21.15.99:0/2355232329 >> 172.21.15.99:0/2355232329 conn(0x7fc8740ce5f0 msgr2=0x7fc8740f7cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:11:09.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.107+0000 7fc87b000640 1 -- 172.21.15.99:0/2355232329 shutdown_connections 2024-02-21T23:11:09.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:09.107+0000 7fc87b000640 1 -- 172.21.15.99:0/2355232329 wait complete. 2024-02-21T23:11:10.120 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-02-21T23:11:10.120 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T23:11:10.121 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-02-21T23:11:10.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.342+0000 7f3f61a00640 1 Processor -- start 2024-02-21T23:11:10.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.342+0000 7f3f61a00640 1 -- start start 2024-02-21T23:11:10.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.345+0000 7f3f61a00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f3f5c182b90 0x7f3f5c06cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:10.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.345+0000 7f3f61a00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f5c06deb0 con 0x7f3f5c072db0 2024-02-21T23:11:10.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.345+0000 7f3f61a00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f5c06d330 con 0x7f3f5c070160 2024-02-21T23:11:10.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.345+0000 7f3f61a00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f5c06d610 con 0x7f3f5c182b90 2024-02-21T23:11:10.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.345+0000 7f3f5be00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f3f5c182b90 0x7f3f5c06cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:10.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.345+0000 7f3f53e00640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f3f5c070160 0x7f3f5c0726a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:53806/0 (socket says 172.21.15.99:53806) 2024-02-21T23:11:10.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.345+0000 7f3f53e00640 1 -- 172.21.15.99:0/2229439408 learned_addr learned my addr 172.21.15.99:0/2229439408 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:11:10.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.345+0000 7f3f61000640 1 --1- 172.21.15.99:0/2229439408 >> v1:172.21.15.162:6789/0 conn(0x7f3f5c072db0 0x7f3f5c0740b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.99:57184/0 (socket says 172.21.15.99:57184) 2024-02-21T23:11:10.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.346+0000 7f3f5b400640 1 -- 172.21.15.99:0/2229439408 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2970592376 0 0) 0x7f3f5c06d330 con 0x7f3f5c070160 2024-02-21T23:11:10.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.346+0000 7f3f5b400640 1 -- 172.21.15.99:0/2229439408 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f40003520 con 0x7f3f5c070160 2024-02-21T23:11:10.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.346+0000 7f3f5b400640 1 -- 172.21.15.99:0/2229439408 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3298274568 0 0) 0x7f3f5c06deb0 con 0x7f3f5c072db0 2024-02-21T23:11:10.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.346+0000 7f3f5be00640 1 -- 172.21.15.99:0/2229439408 >> v1:172.21.15.181:6789/0 conn(0x7f3f5c070160 legacy=0x7f3f5c0726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:10.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.346+0000 7f3f5be00640 1 -- 172.21.15.99:0/2229439408 >> v1:172.21.15.162:6789/0 conn(0x7f3f5c072db0 legacy=0x7f3f5c0740b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:10.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.346+0000 7f3f5be00640 1 -- 172.21.15.99:0/2229439408 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f5c06d8f0 con 0x7f3f5c182b90 2024-02-21T23:11:10.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.347+0000 7f3f5be00640 1 --2- 172.21.15.99:0/2229439408 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3f5c182b90 0x7f3f5c06cab0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c0097a0 tx=0x7f3f4c02b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=feb87187036cbd70 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:10.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.347+0000 7f3f5b400640 1 -- 172.21.15.99:0/2229439408 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4c0315a0 con 0x7f3f5c182b90 2024-02-21T23:11:10.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.347+0000 7f3f5b400640 1 -- 172.21.15.99:0/2229439408 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f4c037070 con 0x7f3f5c182b90 2024-02-21T23:11:10.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.347+0000 7f3f5b400640 1 -- 172.21.15.99:0/2229439408 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4c031960 con 0x7f3f5c182b90 2024-02-21T23:11:10.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.348+0000 7f3f61a00640 1 -- 172.21.15.99:0/2229439408 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3f5c182b90 msgr2=0x7f3f5c06cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:10.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.348+0000 7f3f61a00640 1 --2- 172.21.15.99:0/2229439408 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3f5c182b90 0x7f3f5c06cab0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c0097a0 tx=0x7f3f4c02b840 comp rx=0 tx=0).stop 2024-02-21T23:11:10.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.348+0000 7f3f61a00640 1 -- 172.21.15.99:0/2229439408 shutdown_connections 2024-02-21T23:11:10.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.348+0000 7f3f61a00640 1 --2- 172.21.15.99:0/2229439408 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3f5c182b90 0x7f3f5c06cab0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:10.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.348+0000 7f3f61a00640 1 -- 172.21.15.99:0/2229439408 >> 172.21.15.99:0/2229439408 conn(0x7f3f5c06e1a0 msgr2=0x7f3f5c06e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:11:10.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.348+0000 7f3f61a00640 1 -- 172.21.15.99:0/2229439408 shutdown_connections 2024-02-21T23:11:10.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.348+0000 7f3f61a00640 1 -- 172.21.15.99:0/2229439408 wait complete. 2024-02-21T23:11:10.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.351+0000 7f3f61a00640 1 Processor -- start 2024-02-21T23:11:10.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.352+0000 7f3f61a00640 1 -- start start 2024-02-21T23:11:10.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.354+0000 7f3f61a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f5c070160 0x7f3f5c175e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:10.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.354+0000 7f3f61a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3f5c072db0 0x7f3f5c180c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:10.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.354+0000 7f3f61a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f5c182b90 0x7f3f5c1811b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:10.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.354+0000 7f3f61a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5c073240 con 0x7f3f5c070160 2024-02-21T23:11:10.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.354+0000 7f3f61a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5c06cff0 con 0x7f3f5c182b90 2024-02-21T23:11:10.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.354+0000 7f3f61a00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5c0747c0 con 0x7f3f5c072db0 2024-02-21T23:11:10.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.354+0000 7f3f5be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f5c070160 0x7f3f5c175e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:10.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.354+0000 7f3f5be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f5c070160 0x7f3f5c175e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34362/0 (socket says 172.21.15.99:34362) 2024-02-21T23:11:10.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.354+0000 7f3f5be00640 1 -- 172.21.15.99:0/3618367140 learned_addr learned my addr 172.21.15.99:0/3618367140 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:11:10.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.354+0000 7f3f53e00640 1 --2- 172.21.15.99:0/3618367140 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3f5c072db0 0x7f3f5c180c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:10.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.354+0000 7f3f61000640 1 --2- 172.21.15.99:0/3618367140 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f5c182b90 0x7f3f5c1811b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:10.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.355+0000 7f3f5be00640 1 -- 172.21.15.99:0/3618367140 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3f5c072db0 msgr2=0x7f3f5c180c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:10.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.355+0000 7f3f5be00640 1 --2- 172.21.15.99:0/3618367140 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3f5c072db0 0x7f3f5c180c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:10.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.355+0000 7f3f5be00640 1 -- 172.21.15.99:0/3618367140 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f5c182b90 msgr2=0x7f3f5c1811b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:10.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.355+0000 7f3f5be00640 1 --2- 172.21.15.99:0/3618367140 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f5c182b90 0x7f3f5c1811b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:10.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.355+0000 7f3f5be00640 1 -- 172.21.15.99:0/3618367140 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f5c0f6c80 con 0x7f3f5c070160 2024-02-21T23:11:10.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.355+0000 7f3f61000640 1 --2- 172.21.15.99:0/3618367140 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f5c182b90 0x7f3f5c1811b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:11:10.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.355+0000 7f3f5be00640 1 --2- 172.21.15.99:0/3618367140 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f5c070160 0x7f3f5c175e80 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c034040 tx=0x7f3f4c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:10.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.355+0000 7f3f58c00640 1 -- 172.21.15.99:0/3618367140 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4c004020 con 0x7f3f5c070160 2024-02-21T23:11:10.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.355+0000 7f3f58c00640 1 -- 172.21.15.99:0/3618367140 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f4c0041e0 con 0x7f3f5c070160 2024-02-21T23:11:10.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.355+0000 7f3f61a00640 1 -- 172.21.15.99:0/3618367140 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f5c0f5e20 con 0x7f3f5c070160 2024-02-21T23:11:10.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.355+0000 7f3f58c00640 1 -- 172.21.15.99:0/3618367140 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4c003610 con 0x7f3f5c070160 2024-02-21T23:11:10.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.356+0000 7f3f61a00640 1 -- 172.21.15.99:0/3618367140 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f5c0f63e0 con 0x7f3f5c070160 2024-02-21T23:11:10.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.359+0000 7f3f58c00640 1 -- 172.21.15.99:0/3618367140 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f3f4c04c020 con 0x7f3f5c070160 2024-02-21T23:11:10.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.360+0000 7f3f58c00640 1 --2- 172.21.15.99:0/3618367140 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f3f3809eed0 0x7f3f380a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:10.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.360+0000 7f3f58c00640 1 -- 172.21.15.99:0/3618367140 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 8965+0+0 (secure 0 0 0) 0x7f3f4c02f020 con 0x7f3f5c070160 2024-02-21T23:11:10.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.361+0000 7f3f53e00640 1 --2- 172.21.15.99:0/3618367140 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f3f3809eed0 0x7f3f380a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:10.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.361+0000 7f3f53e00640 1 --2- 172.21.15.99:0/3618367140 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f3f3809eed0 0x7f3f380a1390 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c0700b0 tx=0x7f3f44009040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:10.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.362+0000 7f3f65f97740 1 Processor -- start 2024-02-21T23:11:10.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.362+0000 7f3f65f97740 1 -- start start 2024-02-21T23:11:10.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.364+0000 7f3f65f97740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c6067704c0 0x55c6067708a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:10.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.364+0000 7f3f65f97740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c606770de0 0x55c6067ab650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:10.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.364+0000 7f3f65f97740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c6067abb90 0x55c6067ac920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:10.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.364+0000 7f3f65f97740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c606698790 con 0x55c6067abb90 2024-02-21T23:11:10.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.364+0000 7f3f65f97740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c606641bf0 con 0x55c6067704c0 2024-02-21T23:11:10.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.364+0000 7f3f65f97740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c606694830 con 0x55c606770de0 2024-02-21T23:11:10.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.364+0000 7f3f53e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c606770de0 0x55c6067ab650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:10.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.364+0000 7f3f5be00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c6067704c0 0x55c6067708a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:10.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.364+0000 7f3f61000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c6067abb90 0x55c6067ac920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:10.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.364+0000 7f3f5be00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c6067704c0 0x55c6067708a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:58774/0 (socket says 172.21.15.99:58774) 2024-02-21T23:11:10.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.364+0000 7f3f53e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c606770de0 0x55c6067ab650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:41190/0 (socket says 172.21.15.99:41190) 2024-02-21T23:11:10.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.364+0000 7f3f5be00640 1 -- 172.21.15.99:0/3161628684 learned_addr learned my addr 172.21.15.99:0/3161628684 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:11:10.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.365+0000 7f3f5be00640 1 -- 172.21.15.99:0/3161628684 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c606770de0 msgr2=0x55c6067ab650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:10.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.365+0000 7f3f5be00640 1 --2- 172.21.15.99:0/3161628684 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c606770de0 0x55c6067ab650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:10.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.365+0000 7f3f5be00640 1 -- 172.21.15.99:0/3161628684 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c6067abb90 msgr2=0x55c6067ac920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:10.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.365+0000 7f3f5be00640 1 --2- 172.21.15.99:0/3161628684 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c6067abb90 0x55c6067ac920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:10.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.365+0000 7f3f5be00640 1 -- 172.21.15.99:0/3161628684 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c60665fc40 con 0x55c6067704c0 2024-02-21T23:11:10.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.365+0000 7f3f5be00640 1 --2- 172.21.15.99:0/3161628684 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c6067704c0 0x55c6067708a0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c0b9170 tx=0x7f3f4c0b8b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef83dfbeb7a0f062 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:10.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.365+0000 7f3f50c00640 1 -- 172.21.15.99:0/3161628684 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4c0bd330 con 0x55c6067704c0 2024-02-21T23:11:10.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.365+0000 7f3f50c00640 1 -- 172.21.15.99:0/3161628684 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f4c037040 con 0x55c6067704c0 2024-02-21T23:11:10.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.365+0000 7f3f50c00640 1 -- 172.21.15.99:0/3161628684 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4c0c18f0 con 0x55c6067704c0 2024-02-21T23:11:10.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.366+0000 7f3f65f97740 1 -- 172.21.15.99:0/3161628684 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c6067704c0 msgr2=0x55c6067708a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:10.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.366+0000 7f3f65f97740 1 --2- 172.21.15.99:0/3161628684 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c6067704c0 0x55c6067708a0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c0b9170 tx=0x7f3f4c0b8b40 comp rx=0 tx=0).stop 2024-02-21T23:11:10.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.366+0000 7f3f65f97740 1 -- 172.21.15.99:0/3161628684 shutdown_connections 2024-02-21T23:11:10.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.366+0000 7f3f65f97740 1 --2- 172.21.15.99:0/3161628684 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c6067abb90 0x55c6067ac920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:10.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.366+0000 7f3f65f97740 1 --2- 172.21.15.99:0/3161628684 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c606770de0 0x55c6067ab650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:10.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.366+0000 7f3f65f97740 1 --2- 172.21.15.99:0/3161628684 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c6067704c0 0x55c6067708a0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:10.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.366+0000 7f3f65f97740 1 -- 172.21.15.99:0/3161628684 >> 172.21.15.99:0/3161628684 conn(0x55c606732a90 msgr2=0x55c606733b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:11:10.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.367+0000 7f3f65f97740 1 -- 172.21.15.99:0/3161628684 shutdown_connections 2024-02-21T23:11:10.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.367+0000 7f3f65f97740 1 -- 172.21.15.99:0/3161628684 wait complete. 2024-02-21T23:11:10.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.368+0000 7f3f65f97740 1 -- start start 2024-02-21T23:11:10.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.368+0000 7f3f65f97740 1 Processor -- start 2024-02-21T23:11:10.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.370+0000 7f3f65f97740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c606770de0 0x55c60676ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:10.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.370+0000 7f3f65f97740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c6067abb90 0x55c606765370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:10.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.370+0000 7f3f65f97740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c606764f70 0x55c6067620b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:10.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.370+0000 7f3f65f97740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c606641bf0 con 0x55c6067abb90 2024-02-21T23:11:10.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.370+0000 7f3f65f97740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6066371d0 con 0x55c606770de0 2024-02-21T23:11:10.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.370+0000 7f3f65f97740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6067aa070 con 0x55c606764f70 2024-02-21T23:11:10.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.371+0000 7f3f65f97740 10 client.0 _ll_register_callbacks cb 0x55c6063acc60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:11:10.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.371+0000 7f3f53e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c6067abb90 0x55c606765370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:10.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.371+0000 7f3f53e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c6067abb90 0x55c606765370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34386/0 (socket says 172.21.15.99:34386) 2024-02-21T23:11:10.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.371+0000 7f3f5be00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c606770de0 0x55c60676ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:10.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.371+0000 7f3f53e00640 1 -- 172.21.15.99:0/2985080264 learned_addr learned my addr 172.21.15.99:0/2985080264 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:11:10.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.371+0000 7f3f61000640 1 --2- 172.21.15.99:0/2985080264 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c606764f70 0x55c6067620b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:10.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.371+0000 7f3f5be00640 1 -- 172.21.15.99:0/2985080264 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c606764f70 msgr2=0x55c6067620b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:10.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.371+0000 7f3f5be00640 1 --2- 172.21.15.99:0/2985080264 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c606764f70 0x55c6067620b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:10.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.371+0000 7f3f5be00640 1 -- 172.21.15.99:0/2985080264 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c6067abb90 msgr2=0x55c606765370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:10.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.371+0000 7f3f5be00640 1 --2- 172.21.15.99:0/2985080264 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c6067abb90 0x55c606765370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:10.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.371+0000 7f3f5be00640 1 -- 172.21.15.99:0/2985080264 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c6064757e0 con 0x55c606770de0 2024-02-21T23:11:10.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.371+0000 7f3f61000640 1 --2- 172.21.15.99:0/2985080264 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c606764f70 0x55c6067620b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T23:11:10.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.372+0000 7f3f5be00640 1 --2- 172.21.15.99:0/2985080264 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c606770de0 0x55c60676ef60 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c000c00 tx=0x7f3f4c02bd60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9d65a444829e0c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:10.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.372+0000 7f3f49600640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-02-21T23:11:10.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.372+0000 7f3f49600640 1 -- 172.21.15.99:0/2985080264 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4c0c1660 con 0x55c606770de0 2024-02-21T23:11:10.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.372+0000 7f3f65f97740 1 -- 172.21.15.99:0/2985080264 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3f4c037040 con 0x55c606770de0 2024-02-21T23:11:10.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.372+0000 7f3f49600640 1 -- 172.21.15.99:0/2985080264 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(37..37 src has 1..37) v4 ==== 8965+0+0 (secure 0 0 0) 0x7f3f4c0b8630 con 0x55c606770de0 2024-02-21T23:11:10.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.372+0000 7f3f49600640 1 -- 172.21.15.99:0/2985080264 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3f4c0c18f0 con 0x55c606770de0 2024-02-21T23:11:10.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.372+0000 7f3f65f97740 10 client.7060 fetch_fsmap learned FSMap version 17 2024-02-21T23:11:10.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.372+0000 7f3f65f97740 1 -- 172.21.15.99:0/2985080264 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55c6064d5f70 con 0x55c606770de0 2024-02-21T23:11:10.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.372+0000 7f3f49600640 1 -- 172.21.15.99:0/2985080264 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f4c037040 con 0x55c606770de0 2024-02-21T23:11:10.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.372+0000 7f3f49600640 1 -- 172.21.15.99:0/2985080264 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f3f4c031070 con 0x55c606770de0 2024-02-21T23:11:10.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.373+0000 7f3f65f97740 10 client.7060 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:11:10.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.373+0000 7f3f65f97740 10 client.7060 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:11:10.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.373+0000 7f3f65f97740 20 client.7060 populate_metadata read hostname 'smithi099' 2024-02-21T23:11:10.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.373+0000 7f3f65f97740 1 --2- 172.21.15.99:0/2985080264 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55c6067b2dc0 0x55c6067b8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:10.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.373+0000 7f3f65f97740 4 client.7060 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:11:10.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.373+0000 7f3f65f97740 1 -- 172.21.15.99:0/2985080264 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c6066a5cd0 con 0x55c6067b2dc0 2024-02-21T23:11:10.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.373+0000 7f3f53e00640 1 --2- 172.21.15.99:0/2985080264 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55c6067b2dc0 0x55c6067b8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:10.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.374+0000 7f3f53e00640 1 --2- 172.21.15.99:0/2985080264 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55c6067b2dc0 0x55c6067b8760 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6adf7647be207d09 server_cookie=995f9e224391c657 in_seq=0 out_seq=0 2024-02-21T23:11:10.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.374+0000 7f3f49600640 10 client.7060 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:11:10.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.374+0000 7f3f49600640 1 -- 172.21.15.99:0/2985080264 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55c6066a5cd0 con 0x55c6067b2dc0 2024-02-21T23:11:10.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.374+0000 7f3f49600640 10 client.7060 handle_command_reply: tid=0 2024-02-21T23:11:10.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.374+0000 7f3f65f97740 1 client.7060 shutdown 2024-02-21T23:11:10.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.375+0000 7f3f65f97740 1 -- 172.21.15.99:0/2985080264 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c606770de0 msgr2=0x55c60676ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:10.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.375+0000 7f3f65f97740 1 --2- 172.21.15.99:0/2985080264 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c606770de0 0x55c60676ef60 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c000c00 tx=0x7f3f4c02bd60 comp rx=0 tx=0).stop 2024-02-21T23:11:10.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.375+0000 7f3f65f97740 1 -- 172.21.15.99:0/2985080264 shutdown_connections 2024-02-21T23:11:10.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.375+0000 7f3f65f97740 1 --2- 172.21.15.99:0/2985080264 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55c6067b2dc0 0x55c6067b8760 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:10.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.375+0000 7f3f65f97740 1 --2- 172.21.15.99:0/2985080264 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c606764f70 0x55c6067620b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:10.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.375+0000 7f3f65f97740 1 --2- 172.21.15.99:0/2985080264 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c6067abb90 0x55c606765370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:10.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.375+0000 7f3f65f97740 1 --2- 172.21.15.99:0/2985080264 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c606770de0 0x55c60676ef60 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:10.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.375+0000 7f3f49600640 0 client.7060 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:11:10.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.375+0000 7f3f65f97740 1 -- 172.21.15.99:0/2985080264 >> 172.21.15.99:0/2985080264 conn(0x55c6067704c0 msgr2=0x55c6067a98a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:11:10.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.375+0000 7f3f65f97740 1 -- 172.21.15.99:0/2985080264 shutdown_connections 2024-02-21T23:11:10.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.375+0000 7f3f65f97740 1 -- 172.21.15.99:0/2985080264 wait complete. 2024-02-21T23:11:10.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.375+0000 7f3f65f97740 20 client.7060 trim_cache size 0 max 16384 2024-02-21T23:11:10.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.393+0000 7f3f65f97740 1 Processor -- start 2024-02-21T23:11:10.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.393+0000 7f3f65f97740 1 -- start start 2024-02-21T23:11:10.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.394+0000 7f3f65f97740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c606764f70 0x55c60673a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:10.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.394+0000 7f3f65f97740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c606770de0 0x55c60679d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:10.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.394+0000 7f3f65f97740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c6067abb90 0x55c60679db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:10.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.394+0000 7f3f65f97740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5c2284e0 con 0x55c606770de0 2024-02-21T23:11:10.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.394+0000 7f3f65f97740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5c0e48c0 con 0x55c606764f70 2024-02-21T23:11:10.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.394+0000 7f3f65f97740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5c0e2a00 con 0x55c6067abb90 2024-02-21T23:11:10.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.394+0000 7f3f53e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c606770de0 0x55c60679d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:10.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.394+0000 7f3f53e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c606770de0 0x55c60679d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34396/0 (socket says 172.21.15.99:34396) 2024-02-21T23:11:10.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.394+0000 7f3f53e00640 1 -- 172.21.15.99:0/2938869148 learned_addr learned my addr 172.21.15.99:0/2938869148 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:11:10.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.394+0000 7f3f5be00640 1 --2- 172.21.15.99:0/2938869148 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c606764f70 0x55c60673a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:10.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.395+0000 7f3f61000640 1 --2- 172.21.15.99:0/2938869148 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c6067abb90 0x55c60679db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:10.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.395+0000 7f3f53e00640 1 -- 172.21.15.99:0/2938869148 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c6067abb90 msgr2=0x55c60679db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:10.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.395+0000 7f3f53e00640 1 --2- 172.21.15.99:0/2938869148 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c6067abb90 0x55c60679db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:10.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.395+0000 7f3f53e00640 1 -- 172.21.15.99:0/2938869148 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c606764f70 msgr2=0x55c60673a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:10.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.395+0000 7f3f53e00640 1 --2- 172.21.15.99:0/2938869148 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c606764f70 0x55c60673a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:10.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.395+0000 7f3f53e00640 1 -- 172.21.15.99:0/2938869148 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c60636d170 con 0x55c606770de0 2024-02-21T23:11:10.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.395+0000 7f3f61000640 1 --2- 172.21.15.99:0/2938869148 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c6067abb90 0x55c60679db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:11:10.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.395+0000 7f3f53e00640 1 --2- 172.21.15.99:0/2938869148 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c606770de0 0x55c60679d5a0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f3f440016b0 tx=0x7f3f44000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e7208d3e77bcca2 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:10.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.395+0000 7f3f4be00640 1 -- 172.21.15.99:0/2938869148 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4402e070 con 0x55c606770de0 2024-02-21T23:11:10.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.395+0000 7f3f4be00640 1 -- 172.21.15.99:0/2938869148 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f4400fda0 con 0x55c606770de0 2024-02-21T23:11:10.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.395+0000 7f3f4be00640 1 -- 172.21.15.99:0/2938869148 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f44028150 con 0x55c606770de0 2024-02-21T23:11:10.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.396+0000 7f3f65f97740 1 -- 172.21.15.99:0/2938869148 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c606770de0 msgr2=0x55c60679d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:10.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.396+0000 7f3f65f97740 1 --2- 172.21.15.99:0/2938869148 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c606770de0 0x55c60679d5a0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f3f440016b0 tx=0x7f3f44000ed0 comp rx=0 tx=0).stop 2024-02-21T23:11:10.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.396+0000 7f3f65f97740 1 -- 172.21.15.99:0/2938869148 shutdown_connections 2024-02-21T23:11:10.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.396+0000 7f3f65f97740 1 --2- 172.21.15.99:0/2938869148 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c6067abb90 0x55c60679db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:10.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.396+0000 7f3f65f97740 1 --2- 172.21.15.99:0/2938869148 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c606770de0 0x55c60679d5a0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:10.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.396+0000 7f3f65f97740 1 --2- 172.21.15.99:0/2938869148 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c606764f70 0x55c60673a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:10.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.396+0000 7f3f65f97740 1 -- 172.21.15.99:0/2938869148 >> 172.21.15.99:0/2938869148 conn(0x55c6067704c0 msgr2=0x55c606766110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:11:10.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.396+0000 7f3f65f97740 1 -- 172.21.15.99:0/2938869148 shutdown_connections 2024-02-21T23:11:10.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.396+0000 7f3f65f97740 1 -- 172.21.15.99:0/2938869148 wait complete. 2024-02-21T23:11:10.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.398+0000 7f3f65f97740 1 -- start start 2024-02-21T23:11:10.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.398+0000 7f3f65f97740 1 Processor -- start 2024-02-21T23:11:10.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.400+0000 7f3f65f97740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c606764f70 0x55c606766280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:10.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.400+0000 7f3f65f97740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c606770de0 0x55c606819f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:10.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.400+0000 7f3f65f97740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c6067abb90 0x55c60681fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:10.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.400+0000 7f3f65f97740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5c0e3000 con 0x55c606764f70 2024-02-21T23:11:10.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.400+0000 7f3f65f97740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5c0e4260 con 0x55c606770de0 2024-02-21T23:11:10.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.400+0000 7f3f65f97740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5c0e3600 con 0x55c6067abb90 2024-02-21T23:11:10.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.400+0000 7f3f65f97740 10 client.0 _ll_register_callbacks cb 0x7f3f54004c40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:11:10.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.400+0000 7f3f5be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c606764f70 0x55c606766280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:10.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.400+0000 7f3f5be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c606764f70 0x55c606766280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34400/0 (socket says 172.21.15.99:34400) 2024-02-21T23:11:10.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.400+0000 7f3f5be00640 1 -- 172.21.15.99:0/422553549 learned_addr learned my addr 172.21.15.99:0/422553549 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:11:10.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.400+0000 7f3f53e00640 1 --2- 172.21.15.99:0/422553549 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c606770de0 0x55c606819f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:10.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.400+0000 7f3f61000640 1 --2- 172.21.15.99:0/422553549 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c6067abb90 0x55c60681fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:10.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.401+0000 7f3f5be00640 1 -- 172.21.15.99:0/422553549 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c6067abb90 msgr2=0x55c60681fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:10.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.401+0000 7f3f5be00640 1 --2- 172.21.15.99:0/422553549 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c6067abb90 0x55c60681fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:10.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.401+0000 7f3f5be00640 1 -- 172.21.15.99:0/422553549 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c606770de0 msgr2=0x55c606819f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:10.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.401+0000 7f3f5be00640 1 --2- 172.21.15.99:0/422553549 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c606770de0 0x55c606819f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:10.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.401+0000 7f3f5be00640 1 -- 172.21.15.99:0/422553549 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c606766060 con 0x55c606764f70 2024-02-21T23:11:10.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.401+0000 7f3f5be00640 1 --2- 172.21.15.99:0/422553549 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c606764f70 0x55c606766280 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c02be50 tx=0x7f3f4c009480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edd20c773b1e12 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:10.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.401+0000 7f3f49600640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:11:10.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.401+0000 7f3f49600640 1 -- 172.21.15.99:0/422553549 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4c0bd330 con 0x55c606764f70 2024-02-21T23:11:10.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.401+0000 7f3f49600640 1 -- 172.21.15.99:0/422553549 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(37..37 src has 1..37) v4 ==== 8965+0+0 (secure 0 0 0) 0x7f3f4c0bf2c0 con 0x55c606764f70 2024-02-21T23:11:10.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.401+0000 7f3f65f97740 1 -- 172.21.15.99:0/422553549 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3f4400fda0 con 0x55c606764f70 2024-02-21T23:11:10.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.402+0000 7f3f49600640 1 -- 172.21.15.99:0/422553549 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3f4c0bf4c0 con 0x55c606764f70 2024-02-21T23:11:10.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.402+0000 7f3f65f97740 10 client.6882 fetch_fsmap learned FSMap version 17 2024-02-21T23:11:10.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.402+0000 7f3f65f97740 1 -- 172.21.15.99:0/422553549 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55c606766060 con 0x55c606764f70 2024-02-21T23:11:10.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.402+0000 7f3f49600640 1 -- 172.21.15.99:0/422553549 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f4400fda0 con 0x55c606764f70 2024-02-21T23:11:10.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.402+0000 7f3f49600640 1 -- 172.21.15.99:0/422553549 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f3f4c031040 con 0x55c606764f70 2024-02-21T23:11:10.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.402+0000 7f3f65f97740 10 client.6882 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:11:10.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.402+0000 7f3f65f97740 10 client.6882 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:11:10.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.402+0000 7f3f65f97740 20 client.6882 populate_metadata read hostname 'smithi099' 2024-02-21T23:11:10.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.402+0000 7f3f65f97740 1 --2- 172.21.15.99:0/422553549 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55c606731c70 0x55c6067a74b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:10.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.402+0000 7f3f65f97740 4 client.6882 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-02-21T23:11:10.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.402+0000 7f3f65f97740 1 -- 172.21.15.99:0/422553549 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55c6066a0020 con 0x55c606731c70 2024-02-21T23:11:10.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.402+0000 7f3f53e00640 1 --2- 172.21.15.99:0/422553549 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55c606731c70 0x55c6067a74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:10.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.403+0000 7f3f53e00640 1 --2- 172.21.15.99:0/422553549 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55c606731c70 0x55c6067a74b0 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b34692656f5306ec server_cookie=6b97d7cacd52b6a4 in_seq=0 out_seq=0 2024-02-21T23:11:10.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.403+0000 7f3f49600640 10 client.6882 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:11:10.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.404+0000 7f3f49600640 1 -- 172.21.15.99:0/422553549 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55c6066a0020 con 0x55c606731c70 2024-02-21T23:11:10.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.404+0000 7f3f49600640 10 client.6882 handle_command_reply: tid=0 2024-02-21T23:11:10.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.405+0000 7f3f65f97740 1 client.6882 shutdown 2024-02-21T23:11:10.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.405+0000 7f3f65f97740 1 -- 172.21.15.99:0/422553549 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c606764f70 msgr2=0x55c606766280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:10.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.405+0000 7f3f65f97740 1 --2- 172.21.15.99:0/422553549 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c606764f70 0x55c606766280 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c02be50 tx=0x7f3f4c009480 comp rx=0 tx=0).stop 2024-02-21T23:11:10.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.405+0000 7f3f65f97740 1 -- 172.21.15.99:0/422553549 shutdown_connections 2024-02-21T23:11:10.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.405+0000 7f3f65f97740 1 --2- 172.21.15.99:0/422553549 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55c606731c70 0x55c6067a74b0 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:10.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.405+0000 7f3f65f97740 1 --2- 172.21.15.99:0/422553549 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c6067abb90 0x55c60681fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:10.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.405+0000 7f3f65f97740 1 --2- 172.21.15.99:0/422553549 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c606770de0 0x55c606819f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:10.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.405+0000 7f3f65f97740 1 --2- 172.21.15.99:0/422553549 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c606764f70 0x55c606766280 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:10.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.405+0000 7f3f65f97740 1 -- 172.21.15.99:0/422553549 >> 172.21.15.99:0/422553549 conn(0x55c6067704c0 msgr2=0x55c606734500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:11:10.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.405+0000 7f3f49600640 0 client.6882 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:11:10.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.406+0000 7f3f65f97740 1 -- 172.21.15.99:0/422553549 shutdown_connections 2024-02-21T23:11:10.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.406+0000 7f3f65f97740 1 -- 172.21.15.99:0/422553549 wait complete. 2024-02-21T23:11:10.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.406+0000 7f3f65f97740 20 client.6882 trim_cache size 0 max 16384 2024-02-21T23:11:10.402 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-02-21T23:11:10.402 INFO:teuthology.orchestra.run.smithi099.stdout: "return_code": 0, 2024-02-21T23:11:10.402 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_tag": "c8f157a3-2a37-44ac-bb6f-9c02338a2f00", 2024-02-21T23:11:10.402 INFO:teuthology.orchestra.run.smithi099.stdout: "mode": "asynchronous" 2024-02-21T23:11:10.402 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-02-21T23:11:10.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.407+0000 7f3f61a00640 1 -- 172.21.15.99:0/3618367140 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f3f3809eed0 msgr2=0x7f3f380a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:10.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.407+0000 7f3f61a00640 1 --2- 172.21.15.99:0/3618367140 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f3f3809eed0 0x7f3f380a1390 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c0700b0 tx=0x7f3f44009040 comp rx=0 tx=0).stop 2024-02-21T23:11:10.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.407+0000 7f3f61a00640 1 -- 172.21.15.99:0/3618367140 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f5c070160 msgr2=0x7f3f5c175e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:10.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.407+0000 7f3f61a00640 1 --2- 172.21.15.99:0/3618367140 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f5c070160 0x7f3f5c175e80 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c034040 tx=0x7f3f4c0046c0 comp rx=0 tx=0).stop 2024-02-21T23:11:10.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.408+0000 7f3f61a00640 1 -- 172.21.15.99:0/3618367140 shutdown_connections 2024-02-21T23:11:10.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.408+0000 7f3f61a00640 1 --2- 172.21.15.99:0/3618367140 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f3f3809eed0 0x7f3f380a1390 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:10.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.408+0000 7f3f61a00640 1 --2- 172.21.15.99:0/3618367140 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f5c182b90 0x7f3f5c1811b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:10.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.408+0000 7f3f61a00640 1 --2- 172.21.15.99:0/3618367140 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3f5c072db0 0x7f3f5c180c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:10.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.408+0000 7f3f61a00640 1 --2- 172.21.15.99:0/3618367140 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3f5c070160 0x7f3f5c175e80 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:10.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.408+0000 7f3f61a00640 1 -- 172.21.15.99:0/3618367140 >> 172.21.15.99:0/3618367140 conn(0x7f3f5c06e1a0 msgr2=0x7f3f5c070860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:11:10.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.408+0000 7f3f61a00640 1 -- 172.21.15.99:0/3618367140 shutdown_connections 2024-02-21T23:11:10.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.409+0000 7f3f61a00640 1 -- 172.21.15.99:0/3618367140 wait complete. 2024-02-21T23:11:10.424 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T23:11:10.425 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T23:11:10.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.719+0000 7fcdf9600640 1 Processor -- start 2024-02-21T23:11:10.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.719+0000 7fcdf9600640 1 -- start start 2024-02-21T23:11:10.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.722+0000 7fcdf9600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fcdf4182cb0 0x7fcdf40f5c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:10.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.722+0000 7fcdf9600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdf40cd270 con 0x7fcdf40f65d0 2024-02-21T23:11:10.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.722+0000 7fcdf9600640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdf40cd550 con 0x7fcdf40f6150 2024-02-21T23:11:10.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.722+0000 7fcdf9600640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdf4189ad0 con 0x7fcdf4182cb0 2024-02-21T23:11:10.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.722+0000 7fcdf3e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fcdf4182cb0 0x7fcdf40f5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:10.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.722+0000 7fcdf3400640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fcdf40f6150 0x7fcdf418ace0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:53812/0 (socket says 172.21.15.99:53812) 2024-02-21T23:11:10.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.723+0000 7fcdf3400640 1 -- 172.21.15.99:0/372105070 learned_addr learned my addr 172.21.15.99:0/372105070 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:11:10.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.722+0000 7fcdf8c00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fcdf40f65d0 0x7fcdf418b3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.99:57192/0 (socket says 172.21.15.99:57192) 2024-02-21T23:11:10.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.723+0000 7fcdf3e00640 1 -- 172.21.15.99:0/372105070 >> v1:172.21.15.181:6789/0 conn(0x7fcdf40f6150 legacy=0x7fcdf418ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:10.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.723+0000 7fcdf3e00640 1 -- 172.21.15.99:0/372105070 >> v1:172.21.15.162:6789/0 conn(0x7fcdf40f65d0 legacy=0x7fcdf418b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:10.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.723+0000 7fcdf3e00640 1 -- 172.21.15.99:0/372105070 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdf418a200 con 0x7fcdf4182cb0 2024-02-21T23:11:10.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.725+0000 7fcdf3e00640 1 --2- 172.21.15.99:0/372105070 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcdf4182cb0 0x7fcdf40f5c10 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fcde4009720 tx=0x7fcde402b620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc7fa27e8d0f26bb server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:10.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.725+0000 7fcdf2a00640 1 -- 172.21.15.99:0/372105070 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde4037070 con 0x7fcdf4182cb0 2024-02-21T23:11:10.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.725+0000 7fcdf2a00640 1 -- 172.21.15.99:0/372105070 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcde4030710 con 0x7fcdf4182cb0 2024-02-21T23:11:10.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.725+0000 7fcdf2a00640 1 -- 172.21.15.99:0/372105070 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde4030ae0 con 0x7fcdf4182cb0 2024-02-21T23:11:10.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.726+0000 7fcdf9600640 1 -- 172.21.15.99:0/372105070 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcdf4182cb0 msgr2=0x7fcdf40f5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:10.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.726+0000 7fcdf9600640 1 --2- 172.21.15.99:0/372105070 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcdf4182cb0 0x7fcdf40f5c10 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fcde4009720 tx=0x7fcde402b620 comp rx=0 tx=0).stop 2024-02-21T23:11:10.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.726+0000 7fcdf9600640 1 -- 172.21.15.99:0/372105070 shutdown_connections 2024-02-21T23:11:10.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.726+0000 7fcdf9600640 1 --2- 172.21.15.99:0/372105070 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcdf4182cb0 0x7fcdf40f5c10 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:10.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.726+0000 7fcdf9600640 1 -- 172.21.15.99:0/372105070 >> 172.21.15.99:0/372105070 conn(0x7fcdf40ce4b0 msgr2=0x7fcdf40ce8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:11:10.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.726+0000 7fcdf9600640 1 -- 172.21.15.99:0/372105070 shutdown_connections 2024-02-21T23:11:10.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.726+0000 7fcdf9600640 1 -- 172.21.15.99:0/372105070 wait complete. 2024-02-21T23:11:10.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.731+0000 7fcdf9600640 1 Processor -- start 2024-02-21T23:11:10.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.731+0000 7fcdf9600640 1 -- start start 2024-02-21T23:11:10.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.733+0000 7fcdf9600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcdf40f6150 0x7fcdf416b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:10.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.733+0000 7fcdf9600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcdf40f65d0 0x7fcdf40f7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:10.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.733+0000 7fcdf9600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcdf4182cb0 0x7fcdf406c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:10.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.733+0000 7fcdf9600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf418a7c0 con 0x7fcdf40f6150 2024-02-21T23:11:10.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.733+0000 7fcdf9600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf4189fb0 con 0x7fcdf40f65d0 2024-02-21T23:11:10.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.733+0000 7fcdf9600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf40cc2b0 con 0x7fcdf4182cb0 2024-02-21T23:11:10.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.733+0000 7fcdf3400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcdf40f65d0 0x7fcdf40f7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:10.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.733+0000 7fcdf3400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcdf40f65d0 0x7fcdf40f7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:58822/0 (socket says 172.21.15.99:58822) 2024-02-21T23:11:10.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.733+0000 7fcdf3400640 1 -- 172.21.15.99:0/3761751773 learned_addr learned my addr 172.21.15.99:0/3761751773 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:11:10.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.733+0000 7fcdf8c00640 1 --2- 172.21.15.99:0/3761751773 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcdf4182cb0 0x7fcdf406c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:10.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.734+0000 7fcdf3400640 1 -- 172.21.15.99:0/3761751773 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcdf4182cb0 msgr2=0x7fcdf406c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:10.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.734+0000 7fcdf3400640 1 --2- 172.21.15.99:0/3761751773 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcdf4182cb0 0x7fcdf406c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:10.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.734+0000 7fcdf3400640 1 -- 172.21.15.99:0/3761751773 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcdf40f6150 msgr2=0x7fcdf416b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:10.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.734+0000 7fcdf3e00640 1 --2- 172.21.15.99:0/3761751773 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcdf40f6150 0x7fcdf416b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:10.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.734+0000 7fcdf3400640 1 --2- 172.21.15.99:0/3761751773 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcdf40f6150 0x7fcdf416b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:10.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.734+0000 7fcdf3400640 1 -- 172.21.15.99:0/3761751773 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdf40f9590 con 0x7fcdf40f65d0 2024-02-21T23:11:10.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.735+0000 7fcdf3e00640 1 --2- 172.21.15.99:0/3761751773 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcdf40f6150 0x7fcdf416b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T23:11:10.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.735+0000 7fcdf3400640 1 --2- 172.21.15.99:0/3761751773 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcdf40f65d0 0x7fcdf40f7bb0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fcde000c750 tx=0x7fcde000cc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:10.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.735+0000 7fcdebe00640 1 -- 172.21.15.99:0/3761751773 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde0018070 con 0x7fcdf40f65d0 2024-02-21T23:11:10.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.735+0000 7fcdebe00640 1 -- 172.21.15.99:0/3761751773 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcde00072e0 con 0x7fcdf40f65d0 2024-02-21T23:11:10.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.735+0000 7fcdebe00640 1 -- 172.21.15.99:0/3761751773 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde00047e0 con 0x7fcdf40f65d0 2024-02-21T23:11:10.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.735+0000 7fcdf9600640 1 -- 172.21.15.99:0/3761751773 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdf40f86a0 con 0x7fcdf40f65d0 2024-02-21T23:11:10.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.736+0000 7fcdf9600640 1 -- 172.21.15.99:0/3761751773 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdf40f8c60 con 0x7fcdf40f65d0 2024-02-21T23:11:10.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.740+0000 7fcdebe00640 1 -- 172.21.15.99:0/3761751773 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7fcde0004980 con 0x7fcdf40f65d0 2024-02-21T23:11:10.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.743+0000 7fcdebe00640 1 --2- 172.21.15.99:0/3761751773 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fcdd409eed0 0x7fcdd40a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:10.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.743+0000 7fcdebe00640 1 -- 172.21.15.99:0/3761751773 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 8965+0+0 (secure 0 0 0) 0x7fcde00c9500 con 0x7fcdf40f65d0 2024-02-21T23:11:10.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.744+0000 7fcdf3e00640 1 --2- 172.21.15.99:0/3761751773 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fcdd409eed0 0x7fcdd40a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:10.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.746+0000 7fcdfdb70740 1 Processor -- start 2024-02-21T23:11:10.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.746+0000 7fcdf3e00640 1 --2- 172.21.15.99:0/3761751773 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fcdd409eed0 0x7fcdd40a1390 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fcde4034000 tx=0x7fcde4008030 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:10.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.746+0000 7fcdfdb70740 1 -- start start 2024-02-21T23:11:10.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.749+0000 7fcdfdb70740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c79aa262a0 0x55c79aa5bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:10.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.749+0000 7fcdfdb70740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c79aa5c260 0x55c79aa26680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:10.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.749+0000 7fcdfdb70740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c79aa26bc0 0x55c79a9e91d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:10.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.749+0000 7fcdfdb70740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c79a952a90 con 0x55c79aa5c260 2024-02-21T23:11:10.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.749+0000 7fcdfdb70740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c79a8fbb10 con 0x55c79aa26bc0 2024-02-21T23:11:10.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.749+0000 7fcdfdb70740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c79a94eb30 con 0x55c79aa262a0 2024-02-21T23:11:10.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.750+0000 7fcdf8c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c79aa26bc0 0x55c79a9e91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:10.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.750+0000 7fcdf8c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c79aa26bc0 0x55c79a9e91d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:58824/0 (socket says 172.21.15.99:58824) 2024-02-21T23:11:10.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.750+0000 7fcdf8c00640 1 -- 172.21.15.99:0/2214740223 learned_addr learned my addr 172.21.15.99:0/2214740223 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:11:10.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.750+0000 7fcdf3400640 1 --2- 172.21.15.99:0/2214740223 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c79aa5c260 0x55c79aa26680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:10.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.750+0000 7fcdf8c00640 1 -- 172.21.15.99:0/2214740223 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c79aa262a0 msgr2=0x55c79aa5bd20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-02-21T23:11:10.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.750+0000 7fcdf8c00640 1 --2- 172.21.15.99:0/2214740223 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c79aa262a0 0x55c79aa5bd20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:10.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.750+0000 7fcdf8c00640 1 -- 172.21.15.99:0/2214740223 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c79aa5c260 msgr2=0x55c79aa26680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:10.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.750+0000 7fcdf8c00640 1 --2- 172.21.15.99:0/2214740223 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c79aa5c260 0x55c79aa26680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:10.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.750+0000 7fcdf8c00640 1 -- 172.21.15.99:0/2214740223 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c79a7317d0 con 0x55c79aa26bc0 2024-02-21T23:11:10.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.751+0000 7fcdf8c00640 1 --2- 172.21.15.99:0/2214740223 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c79aa26bc0 0x55c79a9e91d0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fcdec001b40 tx=0x7fcdec002000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73bf0f9f3a3ae194 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:10.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.751+0000 7fcddfe00640 1 -- 172.21.15.99:0/2214740223 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdec007910 con 0x55c79aa26bc0 2024-02-21T23:11:10.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.751+0000 7fcddfe00640 1 -- 172.21.15.99:0/2214740223 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdec018070 con 0x55c79aa26bc0 2024-02-21T23:11:10.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.751+0000 7fcddfe00640 1 -- 172.21.15.99:0/2214740223 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdec013630 con 0x55c79aa26bc0 2024-02-21T23:11:10.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.752+0000 7fcdfdb70740 1 -- 172.21.15.99:0/2214740223 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c79aa26bc0 msgr2=0x55c79a9e91d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:10.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.752+0000 7fcdfdb70740 1 --2- 172.21.15.99:0/2214740223 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c79aa26bc0 0x55c79a9e91d0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fcdec001b40 tx=0x7fcdec002000 comp rx=0 tx=0).stop 2024-02-21T23:11:10.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.753+0000 7fcdfdb70740 1 -- 172.21.15.99:0/2214740223 shutdown_connections 2024-02-21T23:11:10.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.753+0000 7fcdfdb70740 1 --2- 172.21.15.99:0/2214740223 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c79aa26bc0 0x55c79a9e91d0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:10.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.753+0000 7fcdfdb70740 1 --2- 172.21.15.99:0/2214740223 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c79aa5c260 0x55c79aa26680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:10.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.753+0000 7fcdfdb70740 1 --2- 172.21.15.99:0/2214740223 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c79aa262a0 0x55c79aa5bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:10.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.753+0000 7fcdfdb70740 1 -- 172.21.15.99:0/2214740223 >> 172.21.15.99:0/2214740223 conn(0x55c79a9b56b0 msgr2=0x55c79a9ed190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:11:10.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.753+0000 7fcdfdb70740 1 -- 172.21.15.99:0/2214740223 shutdown_connections 2024-02-21T23:11:10.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.753+0000 7fcdfdb70740 1 -- 172.21.15.99:0/2214740223 wait complete. 2024-02-21T23:11:10.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.755+0000 7fcdfdb70740 1 -- start start 2024-02-21T23:11:10.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.755+0000 7fcdfdb70740 1 Processor -- start 2024-02-21T23:11:10.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.757+0000 7fcdfdb70740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c79aa262a0 0x55c79aa6eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:10.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.757+0000 7fcdfdb70740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c79aa26bc0 0x55c79aa71620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:10.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.757+0000 7fcdfdb70740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c79aa5c260 0x55c79aa2e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:10.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.757+0000 7fcdfdb70740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c79a9f4f30 con 0x55c79aa5c260 2024-02-21T23:11:10.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.757+0000 7fcdfdb70740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c79a8f11c0 con 0x55c79aa26bc0 2024-02-21T23:11:10.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.757+0000 7fcdfdb70740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c79aa5d930 con 0x55c79aa262a0 2024-02-21T23:11:10.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.758+0000 7fcdfdb70740 10 client.0 _ll_register_callbacks cb 0x55c79a90e930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:11:10.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.758+0000 7fcdf3e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c79aa262a0 0x55c79aa6eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:10.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.758+0000 7fcdf3e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c79aa262a0 0x55c79aa6eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:41254/0 (socket says 172.21.15.99:41254) 2024-02-21T23:11:10.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.758+0000 7fcdf3e00640 1 -- 172.21.15.99:0/2672721231 learned_addr learned my addr 172.21.15.99:0/2672721231 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:11:10.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.758+0000 7fcdf8c00640 1 --2- 172.21.15.99:0/2672721231 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c79aa5c260 0x55c79aa2e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:10.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.758+0000 7fcdf3400640 1 --2- 172.21.15.99:0/2672721231 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c79aa26bc0 0x55c79aa71620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:10.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.759+0000 7fcdf3e00640 1 -- 172.21.15.99:0/2672721231 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c79aa26bc0 msgr2=0x55c79aa71620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:10.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.759+0000 7fcdf3e00640 1 --2- 172.21.15.99:0/2672721231 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c79aa26bc0 0x55c79aa71620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:10.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.759+0000 7fcdf3e00640 1 -- 172.21.15.99:0/2672721231 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c79aa5c260 msgr2=0x55c79aa2e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:10.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.759+0000 7fcdf3e00640 1 --2- 172.21.15.99:0/2672721231 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c79aa5c260 0x55c79aa2e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:10.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.759+0000 7fcdf3e00640 1 -- 172.21.15.99:0/2672721231 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c79a6673f0 con 0x55c79aa262a0 2024-02-21T23:11:10.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.760+0000 7fcdf3e00640 1 --2- 172.21.15.99:0/2672721231 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c79aa262a0 0x55c79aa6eca0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fcde4035040 tx=0x7fcde4004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5abacb4bd0300cd server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:10.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.760+0000 7fcddcc00640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-02-21T23:11:10.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.760+0000 7fcddcc00640 1 -- 172.21.15.99:0/2672721231 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde4037040 con 0x55c79aa262a0 2024-02-21T23:11:10.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.760+0000 7fcddcc00640 1 -- 172.21.15.99:0/2672721231 <== mon.2 v2:172.21.15.181:3300/0 2 ==== osd_map(37..37 src has 1..37) v4 ==== 8965+0+0 (secure 0 0 0) 0x7fcde4004030 con 0x55c79aa262a0 2024-02-21T23:11:10.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.760+0000 7fcdfdb70740 1 -- 172.21.15.99:0/2672721231 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcdec018070 con 0x55c79aa262a0 2024-02-21T23:11:10.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.761+0000 7fcddcc00640 1 -- 172.21.15.99:0/2672721231 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcde4030e80 con 0x55c79aa262a0 2024-02-21T23:11:10.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.761+0000 7fcdfdb70740 10 client.7019 fetch_fsmap learned FSMap version 17 2024-02-21T23:11:10.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.761+0000 7fcdfdb70740 1 -- 172.21.15.99:0/2672721231 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55c79a6270f0 con 0x55c79aa262a0 2024-02-21T23:11:10.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.761+0000 7fcddcc00640 1 -- 172.21.15.99:0/2672721231 <== mon.2 v2:172.21.15.181:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdec018070 con 0x55c79aa262a0 2024-02-21T23:11:10.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.761+0000 7fcddcc00640 1 -- 172.21.15.99:0/2672721231 <== mon.2 v2:172.21.15.181:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fcde4004230 con 0x55c79aa262a0 2024-02-21T23:11:10.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.762+0000 7fcdfdb70740 10 client.7019 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:11:10.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.762+0000 7fcdfdb70740 10 client.7019 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:11:10.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.762+0000 7fcdfdb70740 20 client.7019 populate_metadata read hostname 'smithi099' 2024-02-21T23:11:10.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.762+0000 7fcdfdb70740 1 --2- 172.21.15.99:0/2672721231 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55c79aa2edb0 0x55c79aa256a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:10.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.762+0000 7fcdfdb70740 4 client.7019 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:11:10.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.762+0000 7fcdfdb70740 1 -- 172.21.15.99:0/2672721231 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c79a95ffd0 con 0x55c79aa2edb0 2024-02-21T23:11:10.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.763+0000 7fcdf3400640 1 --2- 172.21.15.99:0/2672721231 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55c79aa2edb0 0x55c79aa256a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:10.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.764+0000 7fcdf3400640 1 --2- 172.21.15.99:0/2672721231 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55c79aa2edb0 0x55c79aa256a0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f15188767a69df6c server_cookie=cbe2950f61c9669b in_seq=0 out_seq=0 2024-02-21T23:11:10.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.764+0000 7fcddcc00640 10 client.7019 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:11:10.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.766+0000 7fcddcc00640 1 -- 172.21.15.99:0/2672721231 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55c79a95ffd0 con 0x55c79aa2edb0 2024-02-21T23:11:10.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.766+0000 7fcddcc00640 10 client.7019 handle_command_reply: tid=0 2024-02-21T23:11:10.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.766+0000 7fcdfdb70740 1 client.7019 shutdown 2024-02-21T23:11:10.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.766+0000 7fcdfdb70740 1 -- 172.21.15.99:0/2672721231 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c79aa262a0 msgr2=0x55c79aa6eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:10.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.766+0000 7fcdfdb70740 1 --2- 172.21.15.99:0/2672721231 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c79aa262a0 0x55c79aa6eca0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fcde4035040 tx=0x7fcde4004730 comp rx=0 tx=0).stop 2024-02-21T23:11:10.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.766+0000 7fcdfdb70740 1 -- 172.21.15.99:0/2672721231 shutdown_connections 2024-02-21T23:11:10.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.766+0000 7fcdfdb70740 1 --2- 172.21.15.99:0/2672721231 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55c79aa2edb0 0x55c79aa256a0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:10.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.767+0000 7fcdfdb70740 1 --2- 172.21.15.99:0/2672721231 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c79aa5c260 0x55c79aa2e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:10.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.767+0000 7fcdfdb70740 1 --2- 172.21.15.99:0/2672721231 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c79aa26bc0 0x55c79aa71620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:10.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.767+0000 7fcdfdb70740 1 --2- 172.21.15.99:0/2672721231 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c79aa262a0 0x55c79aa6eca0 secure :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fcde4035040 tx=0x7fcde4004730 comp rx=0 tx=0).stop 2024-02-21T23:11:10.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.767+0000 7fcdfdb70740 1 -- 172.21.15.99:0/2672721231 >> 172.21.15.99:0/2672721231 conn(0x55c79a9b56b0 msgr2=0x55c79aa5baa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:11:10.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.767+0000 7fcddcc00640 0 client.7019 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:11:10.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.767+0000 7fcdfdb70740 1 -- 172.21.15.99:0/2672721231 shutdown_connections 2024-02-21T23:11:10.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.767+0000 7fcdfdb70740 1 -- 172.21.15.99:0/2672721231 wait complete. 2024-02-21T23:11:10.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.767+0000 7fcdfdb70740 20 client.7019 trim_cache size 0 max 16384 2024-02-21T23:11:10.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.790+0000 7fcdfdb70740 1 Processor -- start 2024-02-21T23:11:10.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.790+0000 7fcdfdb70740 1 -- start start 2024-02-21T23:11:10.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.791+0000 7fcdfdb70740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c79aa26bc0 0x55c79a9ebaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:10.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.792+0000 7fcdfdb70740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c79aa5c260 0x55c79aa256a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:10.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.792+0000 7fcdfdb70740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c79a9ee3c0 0x55c79aa15570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:10.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.792+0000 7fcdfdb70740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf4231260 con 0x55c79aa5c260 2024-02-21T23:11:10.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.792+0000 7fcdfdb70740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf422ee00 con 0x55c79aa26bc0 2024-02-21T23:11:10.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.792+0000 7fcdfdb70740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf422cee0 con 0x55c79a9ee3c0 2024-02-21T23:11:10.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.792+0000 7fcdf3400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c79aa5c260 0x55c79aa256a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:10.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.792+0000 7fcdf3e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c79aa26bc0 0x55c79a9ebaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:10.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.792+0000 7fcdf3400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c79aa5c260 0x55c79aa256a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:34440/0 (socket says 172.21.15.99:34440) 2024-02-21T23:11:10.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.792+0000 7fcdf3400640 1 -- 172.21.15.99:0/1809079420 learned_addr learned my addr 172.21.15.99:0/1809079420 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:11:10.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.793+0000 7fcdf8c00640 1 --2- 172.21.15.99:0/1809079420 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c79a9ee3c0 0x55c79aa15570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:10.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.794+0000 7fcdf3e00640 1 -- 172.21.15.99:0/1809079420 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c79a9ee3c0 msgr2=0x55c79aa15570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:10.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.794+0000 7fcdf3e00640 1 --2- 172.21.15.99:0/1809079420 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c79a9ee3c0 0x55c79aa15570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:10.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.794+0000 7fcdf3e00640 1 -- 172.21.15.99:0/1809079420 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c79aa5c260 msgr2=0x55c79aa256a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:10.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.794+0000 7fcdf3e00640 1 --2- 172.21.15.99:0/1809079420 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c79aa5c260 0x55c79aa256a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:10.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.794+0000 7fcdf3e00640 1 -- 172.21.15.99:0/1809079420 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c79a9ee170 con 0x55c79aa26bc0 2024-02-21T23:11:10.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.794+0000 7fcdf8c00640 1 --2- 172.21.15.99:0/1809079420 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c79a9ee3c0 0x55c79aa15570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:11:10.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.794+0000 7fcdf3400640 1 --2- 172.21.15.99:0/1809079420 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c79aa5c260 0x55c79aa256a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:11:10.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.794+0000 7fcdf3e00640 1 --2- 172.21.15.99:0/1809079420 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c79aa26bc0 0x55c79a9ebaa0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fcde4045000 tx=0x7fcde4041050 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3dcd7a2282e5b82a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:10.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.795+0000 7fcddf400640 1 -- 172.21.15.99:0/1809079420 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde4030e80 con 0x55c79aa26bc0 2024-02-21T23:11:10.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.795+0000 7fcddf400640 1 -- 172.21.15.99:0/1809079420 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcde403f910 con 0x55c79aa26bc0 2024-02-21T23:11:10.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.795+0000 7fcddf400640 1 -- 172.21.15.99:0/1809079420 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde4004230 con 0x55c79aa26bc0 2024-02-21T23:11:10.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.795+0000 7fcdfdb70740 1 -- 172.21.15.99:0/1809079420 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c79aa26bc0 msgr2=0x55c79a9ebaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:10.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.795+0000 7fcdfdb70740 1 --2- 172.21.15.99:0/1809079420 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c79aa26bc0 0x55c79a9ebaa0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fcde4045000 tx=0x7fcde4041050 comp rx=0 tx=0).stop 2024-02-21T23:11:10.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.796+0000 7fcdfdb70740 1 -- 172.21.15.99:0/1809079420 shutdown_connections 2024-02-21T23:11:10.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.796+0000 7fcdfdb70740 1 --2- 172.21.15.99:0/1809079420 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c79a9ee3c0 0x55c79aa15570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:10.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.796+0000 7fcdfdb70740 1 --2- 172.21.15.99:0/1809079420 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c79aa5c260 0x55c79aa256a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:10.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.796+0000 7fcdfdb70740 1 --2- 172.21.15.99:0/1809079420 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c79aa26bc0 0x55c79a9ebaa0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:10.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.796+0000 7fcdfdb70740 1 -- 172.21.15.99:0/1809079420 >> 172.21.15.99:0/1809079420 conn(0x55c79a9b56b0 msgr2=0x55c79aa5baa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:11:10.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.796+0000 7fcdfdb70740 1 -- 172.21.15.99:0/1809079420 shutdown_connections 2024-02-21T23:11:10.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.797+0000 7fcdfdb70740 1 -- 172.21.15.99:0/1809079420 wait complete. 2024-02-21T23:11:10.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.797+0000 7fcdfdb70740 1 -- start start 2024-02-21T23:11:10.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.798+0000 7fcdfdb70740 1 Processor -- start 2024-02-21T23:11:10.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.799+0000 7fcdfdb70740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c79a9ee3c0 0x55c79a9ea650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:10.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.799+0000 7fcdfdb70740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c79aa26bc0 0x55c79aad0840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:10.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.799+0000 7fcdfdb70740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c79aa5c260 0x55c79aaa2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:10.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.799+0000 7fcdfdb70740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf422d4e0 con 0x55c79a9ee3c0 2024-02-21T23:11:10.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.799+0000 7fcdfdb70740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf422e7a0 con 0x55c79aa5c260 2024-02-21T23:11:10.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.799+0000 7fcdfdb70740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf422dae0 con 0x55c79aa26bc0 2024-02-21T23:11:10.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.799+0000 7fcdfdb70740 10 client.0 _ll_register_callbacks cb 0x7fcde4030bc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:11:10.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.799+0000 7fcdf8c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c79aa5c260 0x55c79aaa2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:10.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.800+0000 7fcdf8c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c79aa5c260 0x55c79aaa2bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:58854/0 (socket says 172.21.15.99:58854) 2024-02-21T23:11:10.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.800+0000 7fcdf8c00640 1 -- 172.21.15.99:0/579602653 learned_addr learned my addr 172.21.15.99:0/579602653 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:11:10.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.800+0000 7fcdf3e00640 1 --2- 172.21.15.99:0/579602653 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c79a9ee3c0 0x55c79a9ea650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:10.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.800+0000 7fcdf3400640 1 --2- 172.21.15.99:0/579602653 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c79aa26bc0 0x55c79aad0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:10.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.800+0000 7fcdf8c00640 1 -- 172.21.15.99:0/579602653 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c79aa26bc0 msgr2=0x55c79aad0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:10.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.800+0000 7fcdf8c00640 1 --2- 172.21.15.99:0/579602653 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c79aa26bc0 0x55c79aad0840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:10.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.800+0000 7fcdf8c00640 1 -- 172.21.15.99:0/579602653 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c79a9ee3c0 msgr2=0x55c79a9ea650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:10.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.800+0000 7fcdf8c00640 1 --2- 172.21.15.99:0/579602653 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c79a9ee3c0 0x55c79a9ea650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:10.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.800+0000 7fcdf8c00640 1 -- 172.21.15.99:0/579602653 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c79aaccee0 con 0x55c79aa5c260 2024-02-21T23:11:10.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.800+0000 7fcdf3400640 1 --2- 172.21.15.99:0/579602653 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c79aa26bc0 0x55c79aad0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:11:10.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.800+0000 7fcdf8c00640 1 --2- 172.21.15.99:0/579602653 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c79aa5c260 0x55c79aaa2bc0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fcdec001ae0 tx=0x7fcdec001250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8b1047918789453 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:10.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.800+0000 7fcddcc00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-02-21T23:11:10.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.801+0000 7fcddcc00640 1 -- 172.21.15.99:0/579602653 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdec03c060 con 0x55c79aa5c260 2024-02-21T23:11:10.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.801+0000 7fcdfdb70740 1 -- 172.21.15.99:0/579602653 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcde403f910 con 0x55c79aa5c260 2024-02-21T23:11:10.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.801+0000 7fcddcc00640 1 -- 172.21.15.99:0/579602653 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(37..37 src has 1..37) v4 ==== 8965+0+0 (secure 0 0 0) 0x7fcdec01db10 con 0x55c79aa5c260 2024-02-21T23:11:10.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.801+0000 7fcddcc00640 1 -- 172.21.15.99:0/579602653 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcdec043050 con 0x55c79aa5c260 2024-02-21T23:11:10.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.801+0000 7fcdfdb70740 10 client.7087 fetch_fsmap learned FSMap version 17 2024-02-21T23:11:10.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.801+0000 7fcdfdb70740 1 -- 172.21.15.99:0/579602653 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55c79aa5be20 con 0x55c79aa5c260 2024-02-21T23:11:10.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.801+0000 7fcddcc00640 1 -- 172.21.15.99:0/579602653 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcde403f910 con 0x55c79aa5c260 2024-02-21T23:11:10.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.802+0000 7fcddcc00640 1 -- 172.21.15.99:0/579602653 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fcdec037400 con 0x55c79aa5c260 2024-02-21T23:11:10.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.802+0000 7fcdfdb70740 10 client.7087 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:11:10.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.802+0000 7fcdfdb70740 10 client.7087 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:11:10.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.802+0000 7fcdfdb70740 20 client.7087 populate_metadata read hostname 'smithi099' 2024-02-21T23:11:10.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.802+0000 7fcdfdb70740 1 --2- 172.21.15.99:0/579602653 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55c79aa5d980 0x55c79aaa3100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:10.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.802+0000 7fcdfdb70740 4 client.7087 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T23:11:10.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.802+0000 7fcdfdb70740 1 -- 172.21.15.99:0/579602653 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55c79a95a320 con 0x55c79aa5d980 2024-02-21T23:11:10.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.802+0000 7fcdf3e00640 1 --2- 172.21.15.99:0/579602653 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55c79aa5d980 0x55c79aaa3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:10.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.803+0000 7fcdf3e00640 1 --2- 172.21.15.99:0/579602653 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55c79aa5d980 0x55c79aaa3100 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3e09333ca409cac server_cookie=2af025734c955b95 in_seq=0 out_seq=0 2024-02-21T23:11:10.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.804+0000 7fcddcc00640 10 client.7087 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:11:10.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.805+0000 7fcddcc00640 1 -- 172.21.15.99:0/579602653 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x55c79a95a320 con 0x55c79aa5d980 2024-02-21T23:11:10.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.805+0000 7fcddcc00640 10 client.7087 handle_command_reply: tid=0 2024-02-21T23:11:10.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.805+0000 7fcdfdb70740 1 client.7087 shutdown 2024-02-21T23:11:10.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.805+0000 7fcdfdb70740 1 -- 172.21.15.99:0/579602653 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c79aa5c260 msgr2=0x55c79aaa2bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:10.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.805+0000 7fcdfdb70740 1 --2- 172.21.15.99:0/579602653 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c79aa5c260 0x55c79aaa2bc0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fcdec001ae0 tx=0x7fcdec001250 comp rx=0 tx=0).stop 2024-02-21T23:11:10.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.805+0000 7fcdfdb70740 1 -- 172.21.15.99:0/579602653 shutdown_connections 2024-02-21T23:11:10.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.805+0000 7fcdfdb70740 1 --2- 172.21.15.99:0/579602653 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55c79aa5d980 0x55c79aaa3100 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:10.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.805+0000 7fcdfdb70740 1 --2- 172.21.15.99:0/579602653 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55c79aa5c260 0x55c79aaa2bc0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:10.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.805+0000 7fcdfdb70740 1 --2- 172.21.15.99:0/579602653 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55c79aa26bc0 0x55c79aad0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:10.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.805+0000 7fcdfdb70740 1 --2- 172.21.15.99:0/579602653 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55c79a9ee3c0 0x55c79a9ea650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:10.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.805+0000 7fcddcc00640 0 client.7087 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:11:10.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.805+0000 7fcdfdb70740 1 -- 172.21.15.99:0/579602653 >> 172.21.15.99:0/579602653 conn(0x55c79a9b56b0 msgr2=0x55c79a9e3dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:11:10.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.806+0000 7fcdfdb70740 1 -- 172.21.15.99:0/579602653 shutdown_connections 2024-02-21T23:11:10.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.806+0000 7fcdfdb70740 1 -- 172.21.15.99:0/579602653 wait complete. 2024-02-21T23:11:10.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.806+0000 7fcdfdb70740 20 client.7087 trim_cache size 0 max 16384 2024-02-21T23:11:10.798 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-02-21T23:11:10.798 INFO:teuthology.orchestra.run.smithi099.stdout: "status": "scrub active (979 inodes in the stack)", 2024-02-21T23:11:10.798 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubs": { 2024-02-21T23:11:10.798 INFO:teuthology.orchestra.run.smithi099.stdout: "c8f157a3-2a37-44ac-bb6f-9c02338a2f00": { 2024-02-21T23:11:10.799 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/", 2024-02-21T23:11:10.799 INFO:teuthology.orchestra.run.smithi099.stdout: "tag": "c8f157a3-2a37-44ac-bb6f-9c02338a2f00", 2024-02-21T23:11:10.799 INFO:teuthology.orchestra.run.smithi099.stdout: "options": "recursive,force" 2024-02-21T23:11:10.799 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:11:10.799 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:11:10.799 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-02-21T23:11:10.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.807+0000 7fcdf9600640 1 -- 172.21.15.99:0/3761751773 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fcdd409eed0 msgr2=0x7fcdd40a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:10.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.807+0000 7fcdf9600640 1 --2- 172.21.15.99:0/3761751773 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fcdd409eed0 0x7fcdd40a1390 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fcde4034000 tx=0x7fcde4008030 comp rx=0 tx=0).stop 2024-02-21T23:11:10.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.807+0000 7fcdf9600640 1 -- 172.21.15.99:0/3761751773 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcdf40f65d0 msgr2=0x7fcdf40f7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:10.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.807+0000 7fcdf9600640 1 --2- 172.21.15.99:0/3761751773 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcdf40f65d0 0x7fcdf40f7bb0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fcde000c750 tx=0x7fcde000cc10 comp rx=0 tx=0).stop 2024-02-21T23:11:10.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.807+0000 7fcdf9600640 1 -- 172.21.15.99:0/3761751773 shutdown_connections 2024-02-21T23:11:10.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.807+0000 7fcdf9600640 1 --2- 172.21.15.99:0/3761751773 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fcdd409eed0 0x7fcdd40a1390 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:10.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.807+0000 7fcdf9600640 1 --2- 172.21.15.99:0/3761751773 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcdf4182cb0 0x7fcdf406c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:10.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.807+0000 7fcdf9600640 1 --2- 172.21.15.99:0/3761751773 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcdf40f65d0 0x7fcdf40f7bb0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:10.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.807+0000 7fcdf9600640 1 --2- 172.21.15.99:0/3761751773 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcdf40f6150 0x7fcdf416b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:10.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.807+0000 7fcdf9600640 1 -- 172.21.15.99:0/3761751773 >> 172.21.15.99:0/3761751773 conn(0x7fcdf40ce4b0 msgr2=0x7fcdf4072ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:11:10.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.807+0000 7fcdf9600640 1 -- 172.21.15.99:0/3761751773 shutdown_connections 2024-02-21T23:11:10.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:10.807+0000 7fcdf9600640 1 -- 172.21.15.99:0/3761751773 wait complete. 2024-02-21T23:11:10.821 INFO:tasks.cephfs.filesystem:scrub status for tag:c8f157a3-2a37-44ac-bb6f-9c02338a2f00 - {'path': '/', 'tag': 'c8f157a3-2a37-44ac-bb6f-9c02338a2f00', 'options': 'recursive,force'} 2024-02-21T23:11:14.103 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:11:14.111 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:11:14.113 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:11:40.822 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T23:11:40.823 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T23:11:41.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.058+0000 7fc8c7e00640 1 Processor -- start 2024-02-21T23:11:41.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.058+0000 7fc8c7e00640 1 -- start start 2024-02-21T23:11:41.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.060+0000 7fc8c7e00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fc8c80d60b0 0x7fc8c80fc990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:41.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.060+0000 7fc8c7e00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8c80d6dd0 con 0x7fc8c818b230 2024-02-21T23:11:41.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.060+0000 7fc8c7e00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8c81614c0 con 0x7fc8c817f490 2024-02-21T23:11:41.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.060+0000 7fc8c7e00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8c80d6810 con 0x7fc8c80d60b0 2024-02-21T23:11:41.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.060+0000 7fc8c6000640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fc8c818b230 0x7fc8c80fc280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:44828/0 (socket says 172.21.15.99:44828) 2024-02-21T23:11:41.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.060+0000 7fc8c6000640 1 -- 172.21.15.99:0/146754648 learned_addr learned my addr 172.21.15.99:0/146754648 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:11:41.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.060+0000 7fc8c7400640 1 --2- 172.21.15.99:0/146754648 >> v2:172.21.15.181:3300/0 conn(0x7fc8c80d60b0 0x7fc8c80fc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:41.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.061+0000 7fc8c7400640 1 -- 172.21.15.99:0/146754648 >> v1:172.21.15.181:6789/0 conn(0x7fc8c817f490 legacy=0x7fc8c818ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:41.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.061+0000 7fc8c7400640 1 -- 172.21.15.99:0/146754648 >> v1:172.21.15.99:6789/0 conn(0x7fc8c818b230 legacy=0x7fc8c80fc280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:41.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.061+0000 7fc8c7400640 1 -- 172.21.15.99:0/146754648 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8c80d6af0 con 0x7fc8c80d60b0 2024-02-21T23:11:41.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.062+0000 7fc8c7400640 1 --2- 172.21.15.99:0/146754648 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc8c80d60b0 0x7fc8c80fc990 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fc8c0009d90 tx=0x7fc8c002bf40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36fddb85ccb7c271 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:41.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.062+0000 7fc8c5600640 1 -- 172.21.15.99:0/146754648 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c0039070 con 0x7fc8c80d60b0 2024-02-21T23:11:41.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.062+0000 7fc8c5600640 1 -- 172.21.15.99:0/146754648 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8c002ccf0 con 0x7fc8c80d60b0 2024-02-21T23:11:41.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.062+0000 7fc8c5600640 1 -- 172.21.15.99:0/146754648 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c0034660 con 0x7fc8c80d60b0 2024-02-21T23:11:41.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.063+0000 7fc8c7e00640 1 -- 172.21.15.99:0/146754648 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc8c80d60b0 msgr2=0x7fc8c80fc990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:41.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.063+0000 7fc8c7e00640 1 --2- 172.21.15.99:0/146754648 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc8c80d60b0 0x7fc8c80fc990 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fc8c0009d90 tx=0x7fc8c002bf40 comp rx=0 tx=0).stop 2024-02-21T23:11:41.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.063+0000 7fc8c7e00640 1 -- 172.21.15.99:0/146754648 shutdown_connections 2024-02-21T23:11:41.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.063+0000 7fc8c7e00640 1 --2- 172.21.15.99:0/146754648 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc8c80d60b0 0x7fc8c80fc990 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:41.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.063+0000 7fc8c7e00640 1 -- 172.21.15.99:0/146754648 >> 172.21.15.99:0/146754648 conn(0x7fc8c80d29b0 msgr2=0x7fc8c80d2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:11:41.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.063+0000 7fc8c7e00640 1 -- 172.21.15.99:0/146754648 shutdown_connections 2024-02-21T23:11:41.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.063+0000 7fc8c7e00640 1 -- 172.21.15.99:0/146754648 wait complete. 2024-02-21T23:11:41.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.065+0000 7fc8c7e00640 1 Processor -- start 2024-02-21T23:11:41.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.065+0000 7fc8c7e00640 1 -- start start 2024-02-21T23:11:41.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.066+0000 7fc8c7e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc8c80d60b0 0x7fc8c80fbf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:41.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.066+0000 7fc8c7e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8c817f490 0x7fc8c8221ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:41.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.066+0000 7fc8c7e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8c818b230 0x7fc8c8220690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:41.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.066+0000 7fc8c7e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c818a600 con 0x7fc8c817f490 2024-02-21T23:11:41.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.067+0000 7fc8c7e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c818a320 con 0x7fc8c818b230 2024-02-21T23:11:41.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.067+0000 7fc8c7e00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c80d6500 con 0x7fc8c80d60b0 2024-02-21T23:11:41.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.067+0000 7fc8c6000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8c817f490 0x7fc8c8221ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:41.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.067+0000 7fc8c6a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc8c80d60b0 0x7fc8c80fbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:41.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.067+0000 7fc8c6a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc8c80d60b0 0x7fc8c80fbf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:46444/0 (socket says 172.21.15.99:46444) 2024-02-21T23:11:41.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.067+0000 7fc8c6a00640 1 -- 172.21.15.99:0/2759969158 learned_addr learned my addr 172.21.15.99:0/2759969158 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:11:41.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.067+0000 7fc8c7400640 1 --2- 172.21.15.99:0/2759969158 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8c818b230 0x7fc8c8220690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:41.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.067+0000 7fc8c6a00640 1 -- 172.21.15.99:0/2759969158 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8c818b230 msgr2=0x7fc8c8220690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:41.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.067+0000 7fc8c6a00640 1 --2- 172.21.15.99:0/2759969158 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8c818b230 0x7fc8c8220690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:41.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.067+0000 7fc8c6a00640 1 -- 172.21.15.99:0/2759969158 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8c817f490 msgr2=0x7fc8c8221ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:41.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.068+0000 7fc8c6a00640 1 --2- 172.21.15.99:0/2759969158 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8c817f490 0x7fc8c8221ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:41.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.068+0000 7fc8c6a00640 1 -- 172.21.15.99:0/2759969158 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8c821fdd0 con 0x7fc8c80d60b0 2024-02-21T23:11:41.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.068+0000 7fc8c6000640 1 --2- 172.21.15.99:0/2759969158 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8c817f490 0x7fc8c8221ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:11:41.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.068+0000 7fc8c6a00640 1 --2- 172.21.15.99:0/2759969158 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc8c80d60b0 0x7fc8c80fbf50 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fc8b800c430 tx=0x7fc8b800c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:41.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.068+0000 7fc8bf400640 1 -- 172.21.15.99:0/2759969158 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b80052d0 con 0x7fc8c80d60b0 2024-02-21T23:11:41.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.068+0000 7fc8bf400640 1 -- 172.21.15.99:0/2759969158 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8b8005490 con 0x7fc8c80d60b0 2024-02-21T23:11:41.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.068+0000 7fc8bf400640 1 -- 172.21.15.99:0/2759969158 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b8007260 con 0x7fc8c80d60b0 2024-02-21T23:11:41.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.068+0000 7fc8c7e00640 1 -- 172.21.15.99:0/2759969158 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8c80fc850 con 0x7fc8c80d60b0 2024-02-21T23:11:41.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.068+0000 7fc8c7e00640 1 -- 172.21.15.99:0/2759969158 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8c80fce10 con 0x7fc8c80d60b0 2024-02-21T23:11:41.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.072+0000 7fc8bf400640 1 -- 172.21.15.99:0/2759969158 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7fc8b8007400 con 0x7fc8c80d60b0 2024-02-21T23:11:41.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.074+0000 7fc8bf400640 1 --2- 172.21.15.99:0/2759969158 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fc8a809ef00 0x7fc8a80a13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:41.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.074+0000 7fc8bf400640 1 -- 172.21.15.99:0/2759969158 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 8877+0+0 (secure 0 0 0) 0x7fc8b80c92b0 con 0x7fc8c80d60b0 2024-02-21T23:11:41.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.074+0000 7fc8c6000640 1 --2- 172.21.15.99:0/2759969158 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fc8a809ef00 0x7fc8a80a13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:41.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.075+0000 7fc8d0c77740 1 Processor -- start 2024-02-21T23:11:41.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.075+0000 7fc8d0c77740 1 -- start start 2024-02-21T23:11:41.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.075+0000 7fc8c6000640 1 --2- 172.21.15.99:0/2759969158 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fc8a809ef00 0x7fc8a80a13c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc8c8183020 tx=0x7fc8b4007e80 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:41.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.077+0000 7fc8d0c77740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d6503a32a0 0x55d6503d8d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:41.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.077+0000 7fc8d0c77740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d6503d9260 0x55d6503a3680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:41.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.077+0000 7fc8d0c77740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d6503a3bc0 0x55d6503661d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:41.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.077+0000 7fc8d0c77740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6502cfa90 con 0x55d6503a3bc0 2024-02-21T23:11:41.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.077+0000 7fc8d0c77740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d650278b10 con 0x55d6503a32a0 2024-02-21T23:11:41.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.077+0000 7fc8d0c77740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6502cbb30 con 0x55d6503d9260 2024-02-21T23:11:41.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.077+0000 7fc8c6000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d6503d9260 0x55d6503a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:41.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.077+0000 7fc8c7400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d6503a3bc0 0x55d6503661d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:41.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.077+0000 7fc8c6a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d6503a32a0 0x55d6503d8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:41.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.077+0000 7fc8c6a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d6503a32a0 0x55d6503d8d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:38966/0 (socket says 172.21.15.99:38966) 2024-02-21T23:11:41.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.077+0000 7fc8c6a00640 1 -- 172.21.15.99:0/283520643 learned_addr learned my addr 172.21.15.99:0/283520643 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:11:41.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.078+0000 7fc8c6a00640 1 -- 172.21.15.99:0/283520643 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d6503d9260 msgr2=0x55d6503a3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:41.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.078+0000 7fc8c6a00640 1 --2- 172.21.15.99:0/283520643 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d6503d9260 0x55d6503a3680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:41.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.078+0000 7fc8c6a00640 1 -- 172.21.15.99:0/283520643 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d6503a3bc0 msgr2=0x55d6503661d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:41.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.078+0000 7fc8c6a00640 1 --2- 172.21.15.99:0/283520643 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d6503a3bc0 0x55d6503661d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:41.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.078+0000 7fc8c6a00640 1 -- 172.21.15.99:0/283520643 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d6500ae7d0 con 0x55d6503a32a0 2024-02-21T23:11:41.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.078+0000 7fc8c6a00640 1 --2- 172.21.15.99:0/283520643 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d6503a32a0 0x55d6503d8d20 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fc8b80c68f0 tx=0x7fc8b8000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3090d13824ecd74d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:41.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.078+0000 7fc8b3400640 1 -- 172.21.15.99:0/283520643 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b809f2a0 con 0x55d6503a32a0 2024-02-21T23:11:41.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.078+0000 7fc8b3400640 1 -- 172.21.15.99:0/283520643 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8b80c6ac0 con 0x55d6503a32a0 2024-02-21T23:11:41.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.078+0000 7fc8b3400640 1 -- 172.21.15.99:0/283520643 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b8096090 con 0x55d6503a32a0 2024-02-21T23:11:41.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.079+0000 7fc8d0c77740 1 -- 172.21.15.99:0/283520643 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d6503a32a0 msgr2=0x55d6503d8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:41.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.079+0000 7fc8d0c77740 1 --2- 172.21.15.99:0/283520643 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d6503a32a0 0x55d6503d8d20 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fc8b80c68f0 tx=0x7fc8b8000bc0 comp rx=0 tx=0).stop 2024-02-21T23:11:41.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.079+0000 7fc8d0c77740 1 -- 172.21.15.99:0/283520643 shutdown_connections 2024-02-21T23:11:41.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.079+0000 7fc8d0c77740 1 --2- 172.21.15.99:0/283520643 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d6503a3bc0 0x55d6503661d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:41.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.079+0000 7fc8d0c77740 1 --2- 172.21.15.99:0/283520643 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d6503d9260 0x55d6503a3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:41.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.079+0000 7fc8d0c77740 1 --2- 172.21.15.99:0/283520643 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d6503a32a0 0x55d6503d8d20 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:41.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.079+0000 7fc8d0c77740 1 -- 172.21.15.99:0/283520643 >> 172.21.15.99:0/283520643 conn(0x55d6503326b0 msgr2=0x55d65036a190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:11:41.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.079+0000 7fc8d0c77740 1 -- 172.21.15.99:0/283520643 shutdown_connections 2024-02-21T23:11:41.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.079+0000 7fc8d0c77740 1 -- 172.21.15.99:0/283520643 wait complete. 2024-02-21T23:11:41.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.080+0000 7fc8d0c77740 1 -- start start 2024-02-21T23:11:41.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.080+0000 7fc8d0c77740 1 Processor -- start 2024-02-21T23:11:41.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.082+0000 7fc8d0c77740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d6503a32a0 0x55d6503ec320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:41.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.082+0000 7fc8d0c77740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d6503a3bc0 0x55d6503992b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:41.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.082+0000 7fc8d0c77740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d6503d9260 0x55d650370980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:41.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.082+0000 7fc8d0c77740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d650371f30 con 0x55d6503a3bc0 2024-02-21T23:11:41.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.082+0000 7fc8d0c77740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d65026e1c0 con 0x55d6503d9260 2024-02-21T23:11:41.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.082+0000 7fc8d0c77740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6503da930 con 0x55d6503a32a0 2024-02-21T23:11:41.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.082+0000 7fc8d0c77740 10 client.0 _ll_register_callbacks cb 0x55d65028b930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:11:41.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.082+0000 7fc8c6a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d6503a32a0 0x55d6503ec320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:41.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.082+0000 7fc8c6000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d6503a3bc0 0x55d6503992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:41.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.082+0000 7fc8c6a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d6503a32a0 0x55d6503ec320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:46460/0 (socket says 172.21.15.99:46460) 2024-02-21T23:11:41.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.082+0000 7fc8c6a00640 1 -- 172.21.15.99:0/2774006312 learned_addr learned my addr 172.21.15.99:0/2774006312 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:11:41.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.082+0000 7fc8c7400640 1 --2- 172.21.15.99:0/2774006312 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d6503d9260 0x55d650370980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:41.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.082+0000 7fc8c6a00640 1 -- 172.21.15.99:0/2774006312 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d6503d9260 msgr2=0x55d650370980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:41.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.082+0000 7fc8c6a00640 1 --2- 172.21.15.99:0/2774006312 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d6503d9260 0x55d650370980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:41.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.082+0000 7fc8c6a00640 1 -- 172.21.15.99:0/2774006312 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d6503a3bc0 msgr2=0x55d6503992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:41.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.082+0000 7fc8c6a00640 1 --2- 172.21.15.99:0/2774006312 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d6503a3bc0 0x55d6503992b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:41.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.082+0000 7fc8c6a00640 1 -- 172.21.15.99:0/2774006312 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d64ffe43f0 con 0x55d6503a32a0 2024-02-21T23:11:41.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.083+0000 7fc8c6a00640 1 --2- 172.21.15.99:0/2774006312 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d6503a32a0 0x55d6503ec320 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fc8b8096e00 tx=0x7fc8b80c8040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3bcafcf42856a29 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:41.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.083+0000 7fc8a7e00640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-02-21T23:11:41.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.083+0000 7fc8a7e00640 1 -- 172.21.15.99:0/2774006312 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b809f2a0 con 0x55d6503a32a0 2024-02-21T23:11:41.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.083+0000 7fc8d0c77740 1 -- 172.21.15.99:0/2774006312 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc8b80c6ac0 con 0x55d6503a32a0 2024-02-21T23:11:41.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.083+0000 7fc8a7e00640 1 -- 172.21.15.99:0/2774006312 <== mon.2 v2:172.21.15.181:3300/0 2 ==== osd_map(38..38 src has 1..38) v4 ==== 8877+0+0 (secure 0 0 0) 0x7fc8b80aad50 con 0x55d6503a32a0 2024-02-21T23:11:41.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.083+0000 7fc8a7e00640 1 -- 172.21.15.99:0/2774006312 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc8b8096090 con 0x55d6503a32a0 2024-02-21T23:11:41.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.083+0000 7fc8d0c77740 10 client.7040 fetch_fsmap learned FSMap version 17 2024-02-21T23:11:41.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.083+0000 7fc8d0c77740 1 -- 172.21.15.99:0/2774006312 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55d64ffa40f0 con 0x55d6503a32a0 2024-02-21T23:11:41.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.083+0000 7fc8a7e00640 1 -- 172.21.15.99:0/2774006312 <== mon.2 v2:172.21.15.181:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8b80c6ac0 con 0x55d6503a32a0 2024-02-21T23:11:41.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.084+0000 7fc8a7e00640 1 -- 172.21.15.99:0/2774006312 <== mon.2 v2:172.21.15.181:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fc8b8096230 con 0x55d6503a32a0 2024-02-21T23:11:41.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.084+0000 7fc8d0c77740 10 client.7040 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:11:41.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.084+0000 7fc8d0c77740 10 client.7040 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:11:41.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.084+0000 7fc8d0c77740 20 client.7040 populate_metadata read hostname 'smithi099' 2024-02-21T23:11:41.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.084+0000 7fc8d0c77740 1 --2- 172.21.15.99:0/2774006312 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55d650370ec0 0x55d6503ead70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:41.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.084+0000 7fc8d0c77740 4 client.7040 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:11:41.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.084+0000 7fc8d0c77740 1 -- 172.21.15.99:0/2774006312 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d6502dcfd0 con 0x55d650370ec0 2024-02-21T23:11:41.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.084+0000 7fc8c6000640 1 --2- 172.21.15.99:0/2774006312 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55d650370ec0 0x55d6503ead70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:41.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.085+0000 7fc8c6000640 1 --2- 172.21.15.99:0/2774006312 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55d650370ec0 0x55d6503ead70 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd345765f9de4b58 server_cookie=e51768b5335ca072 in_seq=0 out_seq=0 2024-02-21T23:11:41.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.085+0000 7fc8a7e00640 10 client.7040 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:11:41.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.086+0000 7fc8a7e00640 1 -- 172.21.15.99:0/2774006312 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55d6502dcfd0 con 0x55d650370ec0 2024-02-21T23:11:41.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.086+0000 7fc8a7e00640 10 client.7040 handle_command_reply: tid=0 2024-02-21T23:11:41.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.086+0000 7fc8d0c77740 1 client.7040 shutdown 2024-02-21T23:11:41.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.086+0000 7fc8d0c77740 1 -- 172.21.15.99:0/2774006312 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d6503a32a0 msgr2=0x55d6503ec320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:41.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.086+0000 7fc8d0c77740 1 --2- 172.21.15.99:0/2774006312 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d6503a32a0 0x55d6503ec320 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fc8b8096e00 tx=0x7fc8b80c8040 comp rx=0 tx=0).stop 2024-02-21T23:11:41.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.086+0000 7fc8d0c77740 1 -- 172.21.15.99:0/2774006312 shutdown_connections 2024-02-21T23:11:41.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.087+0000 7fc8d0c77740 1 --2- 172.21.15.99:0/2774006312 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55d650370ec0 0x55d6503ead70 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:41.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.087+0000 7fc8d0c77740 1 --2- 172.21.15.99:0/2774006312 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d6503d9260 0x55d650370980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:41.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.087+0000 7fc8d0c77740 1 --2- 172.21.15.99:0/2774006312 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d6503a3bc0 0x55d6503992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:41.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.087+0000 7fc8d0c77740 1 --2- 172.21.15.99:0/2774006312 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d6503a32a0 0x55d6503ec320 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:41.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.087+0000 7fc8d0c77740 1 -- 172.21.15.99:0/2774006312 >> 172.21.15.99:0/2774006312 conn(0x55d6503326b0 msgr2=0x55d65036ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:11:41.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.087+0000 7fc8a7e00640 0 client.7040 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:11:41.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.087+0000 7fc8d0c77740 1 -- 172.21.15.99:0/2774006312 shutdown_connections 2024-02-21T23:11:41.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.087+0000 7fc8d0c77740 1 -- 172.21.15.99:0/2774006312 wait complete. 2024-02-21T23:11:41.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.087+0000 7fc8d0c77740 20 client.7040 trim_cache size 0 max 16384 2024-02-21T23:11:41.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.110+0000 7fc8d0c77740 1 Processor -- start 2024-02-21T23:11:41.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.110+0000 7fc8d0c77740 1 -- start start 2024-02-21T23:11:41.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.112+0000 7fc8d0c77740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d6503a32a0 0x55d6503eb740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:41.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.112+0000 7fc8d0c77740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d6503a3bc0 0x55d650371810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:41.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.112+0000 7fc8d0c77740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d6503d9260 0x55d650391c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:41.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.112+0000 7fc8d0c77740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c822cbf0 con 0x55d6503a32a0 2024-02-21T23:11:41.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.112+0000 7fc8d0c77740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c822a790 con 0x55d6503d9260 2024-02-21T23:11:41.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.112+0000 7fc8d0c77740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c8228950 con 0x55d6503a3bc0 2024-02-21T23:11:41.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.112+0000 7fc8c6a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d6503a32a0 0x55d6503eb740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:41.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.112+0000 7fc8c6000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d6503a3bc0 0x55d650371810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:41.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.113+0000 7fc8c6a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d6503a32a0 0x55d6503eb740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:43252/0 (socket says 172.21.15.99:43252) 2024-02-21T23:11:41.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.113+0000 7fc8c6a00640 1 -- 172.21.15.99:0/3995562150 learned_addr learned my addr 172.21.15.99:0/3995562150 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:11:41.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.113+0000 7fc8c7400640 1 --2- 172.21.15.99:0/3995562150 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d6503d9260 0x55d650391c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:41.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.113+0000 7fc8c6a00640 1 -- 172.21.15.99:0/3995562150 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d6503a3bc0 msgr2=0x55d650371810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:41.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.113+0000 7fc8c6a00640 1 --2- 172.21.15.99:0/3995562150 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d6503a3bc0 0x55d650371810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:41.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.113+0000 7fc8c6a00640 1 -- 172.21.15.99:0/3995562150 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d6503d9260 msgr2=0x55d650391c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:41.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.113+0000 7fc8c6a00640 1 --2- 172.21.15.99:0/3995562150 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d6503d9260 0x55d650391c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:41.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.113+0000 7fc8c6a00640 1 -- 172.21.15.99:0/3995562150 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d650371d50 con 0x55d6503a32a0 2024-02-21T23:11:41.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.113+0000 7fc8c6000640 1 --2- 172.21.15.99:0/3995562150 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d6503a3bc0 0x55d650371810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:11:41.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.113+0000 7fc8c6a00640 1 --2- 172.21.15.99:0/3995562150 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d6503a32a0 0x55d6503eb740 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fc8b8094ef0 tx=0x7fc8b8013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=333913938384dafa server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:41.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.114+0000 7fc8b2a00640 1 -- 172.21.15.99:0/3995562150 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b80aee30 con 0x55d6503a32a0 2024-02-21T23:11:41.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.114+0000 7fc8b2a00640 1 -- 172.21.15.99:0/3995562150 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8b809f2a0 con 0x55d6503a32a0 2024-02-21T23:11:41.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.114+0000 7fc8b2a00640 1 -- 172.21.15.99:0/3995562150 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b80c6c50 con 0x55d6503a32a0 2024-02-21T23:11:41.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.114+0000 7fc8d0c77740 1 -- 172.21.15.99:0/3995562150 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d6503a32a0 msgr2=0x55d6503eb740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:41.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.114+0000 7fc8d0c77740 1 --2- 172.21.15.99:0/3995562150 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d6503a32a0 0x55d6503eb740 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fc8b8094ef0 tx=0x7fc8b8013000 comp rx=0 tx=0).stop 2024-02-21T23:11:41.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.114+0000 7fc8d0c77740 1 -- 172.21.15.99:0/3995562150 shutdown_connections 2024-02-21T23:11:41.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.114+0000 7fc8d0c77740 1 --2- 172.21.15.99:0/3995562150 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d6503d9260 0x55d650391c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:41.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.114+0000 7fc8d0c77740 1 --2- 172.21.15.99:0/3995562150 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d6503a3bc0 0x55d650371810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:41.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.114+0000 7fc8d0c77740 1 --2- 172.21.15.99:0/3995562150 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d6503a32a0 0x55d6503eb740 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:41.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.114+0000 7fc8d0c77740 1 -- 172.21.15.99:0/3995562150 >> 172.21.15.99:0/3995562150 conn(0x55d6503326b0 msgr2=0x55d6503d8980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:11:41.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.115+0000 7fc8d0c77740 1 -- 172.21.15.99:0/3995562150 shutdown_connections 2024-02-21T23:11:41.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.115+0000 7fc8d0c77740 1 -- 172.21.15.99:0/3995562150 wait complete. 2024-02-21T23:11:41.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.115+0000 7fc8d0c77740 1 -- start start 2024-02-21T23:11:41.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.116+0000 7fc8d0c77740 1 Processor -- start 2024-02-21T23:11:41.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.117+0000 7fc8d0c77740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d6503a32a0 0x55d650392e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:41.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.117+0000 7fc8d0c77740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d6503a3bc0 0x55d650446980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:41.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.117+0000 7fc8d0c77740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d6503d9260 0x55d65039b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:41.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.117+0000 7fc8d0c77740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c8228e50 con 0x55d6503a32a0 2024-02-21T23:11:41.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.117+0000 7fc8d0c77740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c822a130 con 0x55d6503a3bc0 2024-02-21T23:11:41.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.117+0000 7fc8d0c77740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c8229470 con 0x55d6503d9260 2024-02-21T23:11:41.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.117+0000 7fc8d0c77740 10 client.0 _ll_register_callbacks cb 0x7fc8b4004b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:11:41.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.117+0000 7fc8c6a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d6503a32a0 0x55d650392e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:41.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.117+0000 7fc8c6a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d6503a32a0 0x55d650392e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:43260/0 (socket says 172.21.15.99:43260) 2024-02-21T23:11:41.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.117+0000 7fc8c6000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d6503a3bc0 0x55d650446980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:41.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.117+0000 7fc8c6a00640 1 -- 172.21.15.99:0/884317505 learned_addr learned my addr 172.21.15.99:0/884317505 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:11:41.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.117+0000 7fc8c7400640 1 --2- 172.21.15.99:0/884317505 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d6503d9260 0x55d65039b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:41.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.118+0000 7fc8c6000640 1 -- 172.21.15.99:0/884317505 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d6503d9260 msgr2=0x55d65039b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:41.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.118+0000 7fc8c6000640 1 --2- 172.21.15.99:0/884317505 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d6503d9260 0x55d65039b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:41.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.118+0000 7fc8c6000640 1 -- 172.21.15.99:0/884317505 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d6503a32a0 msgr2=0x55d650392e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:41.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.118+0000 7fc8c6000640 1 --2- 172.21.15.99:0/884317505 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d6503a32a0 0x55d650392e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:41.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.118+0000 7fc8c6000640 1 -- 172.21.15.99:0/884317505 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d650360dd0 con 0x55d6503a3bc0 2024-02-21T23:11:41.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.118+0000 7fc8c6a00640 1 --2- 172.21.15.99:0/884317505 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d6503a32a0 0x55d650392e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:11:41.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.118+0000 7fc8c7400640 1 --2- 172.21.15.99:0/884317505 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d6503d9260 0x55d65039b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:11:41.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.118+0000 7fc8c6000640 1 --2- 172.21.15.99:0/884317505 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d6503a3bc0 0x55d650446980 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fc8c815ff10 tx=0x7fc8b4013000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=64ca5738ad20cf76 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:41.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.118+0000 7fc8a7e00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-02-21T23:11:41.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.119+0000 7fc8a7e00640 1 -- 172.21.15.99:0/884317505 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b40223f0 con 0x55d6503a3bc0 2024-02-21T23:11:41.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.119+0000 7fc8d0c77740 1 -- 172.21.15.99:0/884317505 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc8b809f2a0 con 0x55d6503a3bc0 2024-02-21T23:11:41.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.119+0000 7fc8a7e00640 1 -- 172.21.15.99:0/884317505 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(38..38 src has 1..38) v4 ==== 8877+0+0 (secure 0 0 0) 0x7fc8b4022590 con 0x55d6503a3bc0 2024-02-21T23:11:41.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.119+0000 7fc8a7e00640 1 -- 172.21.15.99:0/884317505 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc8b4039050 con 0x55d6503a3bc0 2024-02-21T23:11:41.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.119+0000 7fc8d0c77740 10 client.7102 fetch_fsmap learned FSMap version 17 2024-02-21T23:11:41.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.119+0000 7fc8d0c77740 1 -- 172.21.15.99:0/884317505 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55d650395600 con 0x55d6503a3bc0 2024-02-21T23:11:41.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.119+0000 7fc8a7e00640 1 -- 172.21.15.99:0/884317505 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8b809f2a0 con 0x55d6503a3bc0 2024-02-21T23:11:41.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.119+0000 7fc8a7e00640 1 -- 172.21.15.99:0/884317505 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fc8b4022790 con 0x55d6503a3bc0 2024-02-21T23:11:41.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.119+0000 7fc8d0c77740 10 client.7102 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:11:41.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.119+0000 7fc8d0c77740 10 client.7102 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:11:41.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.120+0000 7fc8d0c77740 20 client.7102 populate_metadata read hostname 'smithi099' 2024-02-21T23:11:41.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.120+0000 7fc8d0c77740 1 --2- 172.21.15.99:0/884317505 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55d6503a1610 0x55d65044c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:41.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.120+0000 7fc8d0c77740 4 client.7102 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T23:11:41.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.120+0000 7fc8d0c77740 1 -- 172.21.15.99:0/884317505 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55d6502d7320 con 0x55d6503a1610 2024-02-21T23:11:41.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.120+0000 7fc8c6a00640 1 --2- 172.21.15.99:0/884317505 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55d6503a1610 0x55d65044c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:41.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.120+0000 7fc8c6a00640 1 --2- 172.21.15.99:0/884317505 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55d6503a1610 0x55d65044c650 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9df5fb8188d0a727 server_cookie=25a0df7632daa401 in_seq=0 out_seq=0 2024-02-21T23:11:41.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.120+0000 7fc8a7e00640 10 client.7102 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:11:41.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.121+0000 7fc8a7e00640 1 -- 172.21.15.99:0/884317505 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55d6502d7320 con 0x55d6503a1610 2024-02-21T23:11:41.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.121+0000 7fc8a7e00640 10 client.7102 handle_command_reply: tid=0 2024-02-21T23:11:41.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.121+0000 7fc8d0c77740 1 client.7102 shutdown 2024-02-21T23:11:41.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.121+0000 7fc8d0c77740 1 -- 172.21.15.99:0/884317505 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d6503a3bc0 msgr2=0x55d650446980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:41.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.121+0000 7fc8d0c77740 1 --2- 172.21.15.99:0/884317505 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d6503a3bc0 0x55d650446980 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fc8c815ff10 tx=0x7fc8b4013000 comp rx=0 tx=0).stop 2024-02-21T23:11:41.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.121+0000 7fc8d0c77740 1 -- 172.21.15.99:0/884317505 shutdown_connections 2024-02-21T23:11:41.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.121+0000 7fc8d0c77740 1 --2- 172.21.15.99:0/884317505 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55d6503a1610 0x55d65044c650 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:41.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.121+0000 7fc8d0c77740 1 --2- 172.21.15.99:0/884317505 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55d6503d9260 0x55d65039b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:41.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.121+0000 7fc8d0c77740 1 --2- 172.21.15.99:0/884317505 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d6503a3bc0 0x55d650446980 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:41.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.121+0000 7fc8d0c77740 1 --2- 172.21.15.99:0/884317505 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55d6503a32a0 0x55d650392e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:41.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.121+0000 7fc8a7e00640 0 client.7102 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:11:41.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.121+0000 7fc8d0c77740 1 -- 172.21.15.99:0/884317505 >> 172.21.15.99:0/884317505 conn(0x55d6503326b0 msgr2=0x55d6503dab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:11:41.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.121+0000 7fc8d0c77740 1 -- 172.21.15.99:0/884317505 shutdown_connections 2024-02-21T23:11:41.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.121+0000 7fc8d0c77740 1 -- 172.21.15.99:0/884317505 wait complete. 2024-02-21T23:11:41.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.121+0000 7fc8d0c77740 20 client.7102 trim_cache size 0 max 16384 2024-02-21T23:11:41.116 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-02-21T23:11:41.117 INFO:teuthology.orchestra.run.smithi099.stdout: "status": "no active scrubs running", 2024-02-21T23:11:41.117 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubs": {} 2024-02-21T23:11:41.117 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-02-21T23:11:41.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.122+0000 7fc8c7e00640 1 -- 172.21.15.99:0/2759969158 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fc8a809ef00 msgr2=0x7fc8a80a13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:41.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.122+0000 7fc8c7e00640 1 --2- 172.21.15.99:0/2759969158 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fc8a809ef00 0x7fc8a80a13c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc8c8183020 tx=0x7fc8b4007e80 comp rx=0 tx=0).stop 2024-02-21T23:11:41.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.122+0000 7fc8c7e00640 1 -- 172.21.15.99:0/2759969158 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc8c80d60b0 msgr2=0x7fc8c80fbf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:41.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.122+0000 7fc8c7e00640 1 --2- 172.21.15.99:0/2759969158 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc8c80d60b0 0x7fc8c80fbf50 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fc8b800c430 tx=0x7fc8b800c8f0 comp rx=0 tx=0).stop 2024-02-21T23:11:41.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.122+0000 7fc8c7e00640 1 -- 172.21.15.99:0/2759969158 shutdown_connections 2024-02-21T23:11:41.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.122+0000 7fc8c7e00640 1 --2- 172.21.15.99:0/2759969158 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fc8a809ef00 0x7fc8a80a13c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:41.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.122+0000 7fc8c7e00640 1 --2- 172.21.15.99:0/2759969158 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8c818b230 0x7fc8c8220690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:41.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.122+0000 7fc8c7e00640 1 --2- 172.21.15.99:0/2759969158 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8c817f490 0x7fc8c8221ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:41.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.122+0000 7fc8c7e00640 1 --2- 172.21.15.99:0/2759969158 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc8c80d60b0 0x7fc8c80fbf50 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:41.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.122+0000 7fc8c7e00640 1 -- 172.21.15.99:0/2759969158 >> 172.21.15.99:0/2759969158 conn(0x7fc8c80d29b0 msgr2=0x7fc8c8160ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:11:41.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.122+0000 7fc8c7e00640 1 -- 172.21.15.99:0/2759969158 shutdown_connections 2024-02-21T23:11:41.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.122+0000 7fc8c7e00640 1 -- 172.21.15.99:0/2759969158 wait complete. 2024-02-21T23:11:41.126 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-02-21T23:11:41.127 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T23:11:41.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.337+0000 7ffa58e00640 1 Processor -- start 2024-02-21T23:11:41.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.337+0000 7ffa58e00640 1 -- start start 2024-02-21T23:11:41.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.339+0000 7ffa58e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ffa540fde40 0x7ffa5418b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:41.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.339+0000 7ffa58e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa5418a600 con 0x7ffa54182a80 2024-02-21T23:11:41.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.339+0000 7ffa58e00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa5418a8e0 con 0x7ffa5418a010 2024-02-21T23:11:41.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.339+0000 7ffa58e00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa5418bec0 con 0x7ffa540fde40 2024-02-21T23:11:41.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.339+0000 7ffa52a00640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7ffa5418a010 0x7ffa540719b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:40302/0 (socket says 172.21.15.99:40302) 2024-02-21T23:11:41.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.339+0000 7ffa53400640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7ffa54182a80 0x7ffa54186a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.99:50254/0 (socket says 172.21.15.99:50254) 2024-02-21T23:11:41.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.339+0000 7ffa53400640 1 -- 172.21.15.99:0/3215798253 learned_addr learned my addr 172.21.15.99:0/3215798253 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:11:41.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.339+0000 7ffa53e00640 1 --2- 172.21.15.99:0/3215798253 >> v2:172.21.15.162:3300/0 conn(0x7ffa540fde40 0x7ffa5418b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:41.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.340+0000 7ffa52000640 1 -- 172.21.15.99:0/3215798253 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3515838248 0 0) 0x7ffa5418a600 con 0x7ffa54182a80 2024-02-21T23:11:41.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.340+0000 7ffa52000640 1 -- 172.21.15.99:0/3215798253 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa38003520 con 0x7ffa54182a80 2024-02-21T23:11:41.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.340+0000 7ffa53e00640 1 -- 172.21.15.99:0/3215798253 >> v1:172.21.15.181:6789/0 conn(0x7ffa5418a010 legacy=0x7ffa540719b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:41.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.340+0000 7ffa53e00640 1 -- 172.21.15.99:0/3215798253 >> v1:172.21.15.162:6789/0 conn(0x7ffa54182a80 legacy=0x7ffa54186a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:41.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.340+0000 7ffa53e00640 1 -- 172.21.15.99:0/3215798253 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa5418abc0 con 0x7ffa540fde40 2024-02-21T23:11:41.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.341+0000 7ffa53e00640 1 --2- 172.21.15.99:0/3215798253 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa540fde40 0x7ffa5418b980 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c009d90 tx=0x7ffa4c02be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34c24213a7f7cd8d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:41.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.341+0000 7ffa52000640 1 -- 172.21.15.99:0/3215798253 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4c039070 con 0x7ffa540fde40 2024-02-21T23:11:41.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.341+0000 7ffa52000640 1 -- 172.21.15.99:0/3215798253 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa4c02cbd0 con 0x7ffa540fde40 2024-02-21T23:11:41.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.341+0000 7ffa52000640 1 -- 172.21.15.99:0/3215798253 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4c034440 con 0x7ffa540fde40 2024-02-21T23:11:41.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.342+0000 7ffa58e00640 1 -- 172.21.15.99:0/3215798253 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa540fde40 msgr2=0x7ffa5418b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:41.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.342+0000 7ffa58e00640 1 --2- 172.21.15.99:0/3215798253 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa540fde40 0x7ffa5418b980 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c009d90 tx=0x7ffa4c02be20 comp rx=0 tx=0).stop 2024-02-21T23:11:41.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.342+0000 7ffa58e00640 1 -- 172.21.15.99:0/3215798253 shutdown_connections 2024-02-21T23:11:41.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.342+0000 7ffa58e00640 1 --2- 172.21.15.99:0/3215798253 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa540fde40 0x7ffa5418b980 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:41.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.342+0000 7ffa58e00640 1 -- 172.21.15.99:0/3215798253 >> 172.21.15.99:0/3215798253 conn(0x7ffa540d29f0 msgr2=0x7ffa540d2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:11:41.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.342+0000 7ffa58e00640 1 -- 172.21.15.99:0/3215798253 shutdown_connections 2024-02-21T23:11:41.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.342+0000 7ffa58e00640 1 -- 172.21.15.99:0/3215798253 wait complete. 2024-02-21T23:11:41.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.344+0000 7ffa58e00640 1 Processor -- start 2024-02-21T23:11:41.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.344+0000 7ffa58e00640 1 -- start start 2024-02-21T23:11:41.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.346+0000 7ffa58e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa540fde40 0x7ffa540f9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:41.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.346+0000 7ffa58e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffa54182a80 0x7ffa5415fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:41.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.346+0000 7ffa58e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa5418a010 0x7ffa54220050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:41.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.346+0000 7ffa58e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5418b460 con 0x7ffa5418a010 2024-02-21T23:11:41.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.346+0000 7ffa58e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5418b180 con 0x7ffa540fde40 2024-02-21T23:11:41.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.346+0000 7ffa58e00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa54182e60 con 0x7ffa54182a80 2024-02-21T23:11:41.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.346+0000 7ffa53400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa540fde40 0x7ffa540f9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:41.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.346+0000 7ffa52a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffa54182a80 0x7ffa5415fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:41.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.346+0000 7ffa53400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa540fde40 0x7ffa540f9100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:39008/0 (socket says 172.21.15.99:39008) 2024-02-21T23:11:41.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.346+0000 7ffa53400640 1 -- 172.21.15.99:0/3352392341 learned_addr learned my addr 172.21.15.99:0/3352392341 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:11:41.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.346+0000 7ffa53e00640 1 --2- 172.21.15.99:0/3352392341 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa5418a010 0x7ffa54220050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:41.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.347+0000 7ffa53400640 1 -- 172.21.15.99:0/3352392341 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffa54182a80 msgr2=0x7ffa5415fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:41.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.347+0000 7ffa53400640 1 --2- 172.21.15.99:0/3352392341 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffa54182a80 0x7ffa5415fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:41.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.347+0000 7ffa53400640 1 -- 172.21.15.99:0/3352392341 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa5418a010 msgr2=0x7ffa54220050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:41.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.347+0000 7ffa53400640 1 --2- 172.21.15.99:0/3352392341 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa5418a010 0x7ffa54220050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:41.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.347+0000 7ffa53400640 1 -- 172.21.15.99:0/3352392341 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa540d2710 con 0x7ffa540fde40 2024-02-21T23:11:41.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.347+0000 7ffa53400640 1 --2- 172.21.15.99:0/3352392341 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa540fde40 0x7ffa540f9100 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7ffa4400c500 tx=0x7ffa4400c9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:41.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.347+0000 7ffa4b400640 1 -- 172.21.15.99:0/3352392341 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa44017070 con 0x7ffa540fde40 2024-02-21T23:11:41.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.347+0000 7ffa4b400640 1 -- 172.21.15.99:0/3352392341 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa44005ce0 con 0x7ffa540fde40 2024-02-21T23:11:41.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.347+0000 7ffa4b400640 1 -- 172.21.15.99:0/3352392341 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa44007330 con 0x7ffa540fde40 2024-02-21T23:11:41.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.347+0000 7ffa58e00640 1 -- 172.21.15.99:0/3352392341 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa540f9a40 con 0x7ffa540fde40 2024-02-21T23:11:41.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.348+0000 7ffa58e00640 1 -- 172.21.15.99:0/3352392341 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa540fa000 con 0x7ffa540fde40 2024-02-21T23:11:41.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.349+0000 7ffa58e00640 1 -- 172.21.15.99:0/3352392341 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa540fcc10 con 0x7ffa540fde40 2024-02-21T23:11:41.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.351+0000 7ffa4b400640 1 -- 172.21.15.99:0/3352392341 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7ffa4401a070 con 0x7ffa540fde40 2024-02-21T23:11:41.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.352+0000 7ffa4b400640 1 --2- 172.21.15.99:0/3352392341 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7ffa3409ee50 0x7ffa340a1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:41.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.352+0000 7ffa4b400640 1 -- 172.21.15.99:0/3352392341 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 8877+0+0 (secure 0 0 0) 0x7ffa440c9420 con 0x7ffa540fde40 2024-02-21T23:11:41.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.352+0000 7ffa52a00640 1 --2- 172.21.15.99:0/3352392341 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7ffa3409ee50 0x7ffa340a1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:41.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.353+0000 7ffa52a00640 1 --2- 172.21.15.99:0/3352392341 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7ffa3409ee50 0x7ffa340a1310 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ffa5421fd10 tx=0x7ffa40007e70 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:41.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.355+0000 7ffa4b400640 1 -- 172.21.15.99:0/3352392341 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7ffa44096d20 con 0x7ffa540fde40 2024-02-21T23:11:41.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.643+0000 7ffa58e00640 1 -- 172.21.15.99:0/3352392341 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffa54068300 con 0x7ffa540fde40 2024-02-21T23:11:41.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.644+0000 7ffa4b400640 1 -- 172.21.15.99:0/3352392341 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+11335 (secure 0 0 0) 0x7ffa4409adc0 con 0x7ffa540fde40 2024-02-21T23:11:41.633 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T23:11:41.633 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4307,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/3514452812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3514452812},{"type":"v1","addr":"172.21.15.162:6836","nonce":3514452812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4312,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6838/2169982089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":2169982089},{"type":"v1","addr":"172.21.15.162:6838","nonce":2169982089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4315,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6839/3335972724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6837","nonce":3335972724},{"type":"v1","addr":"172.21.15.162:6839","nonce":3335972724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4318,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6841/2135456697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6840","nonce":2135456697},{"type":"v1","addr":"172.21.15.162:6841","nonce":2135456697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4325,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2452242758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2452242758},{"type":"v1","addr":"172.21.15.181:6833","nonce":2452242758}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4328,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6836/2751486400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":2751486400},{"type":"v1","addr":"172.21.15.181:6836","nonce":2751486400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":17,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-21T23:01:02.656130+0000","modified":"2024-02-21T23:07:03.165223+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4355,"mds_1":4352,"mds_2":4348},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4331":{"gid":4331,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6838/3728901330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6835","nonce":3728901330},{"type":"v1","addr":"172.21.15.181:6838","nonce":3728901330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4339":{"gid":4339,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6839/3357929641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6837","nonce":3357929641},{"type":"v1","addr":"172.21.15.181:6839","nonce":3357929641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4343":{"gid":4343,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6833/2793485078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":2793485078},{"type":"v1","addr":"172.21.15.99:6833","nonce":2793485078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4348":{"gid":4348,"name":"d","rank":2,"incarnation":12,"state":"up:active","state_seq":10,"addr":"172.21.15.99:6835/2243461688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2243461688},{"type":"v1","addr":"172.21.15.99:6835","nonce":2243461688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4352":{"gid":4352,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.99:6837/1676159950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":1676159950},{"type":"v1","addr":"172.21.15.99:6837","nonce":1676159950}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4355":{"gid":4355,"name":"j","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6839/4239008786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":4239008786},{"type":"v1","addr":"172.21.15.99:6839","nonce":4239008786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-21T23:11:41.633 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 17 2024-02-21T23:11:41.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.648+0000 7ffa58e00640 1 -- 172.21.15.99:0/3352392341 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7ffa3409ee50 msgr2=0x7ffa340a1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:41.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.648+0000 7ffa58e00640 1 --2- 172.21.15.99:0/3352392341 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7ffa3409ee50 0x7ffa340a1310 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ffa5421fd10 tx=0x7ffa40007e70 comp rx=0 tx=0).stop 2024-02-21T23:11:41.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.648+0000 7ffa58e00640 1 -- 172.21.15.99:0/3352392341 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa540fde40 msgr2=0x7ffa540f9100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:41.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.648+0000 7ffa58e00640 1 --2- 172.21.15.99:0/3352392341 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa540fde40 0x7ffa540f9100 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7ffa4400c500 tx=0x7ffa4400c9c0 comp rx=0 tx=0).stop 2024-02-21T23:11:41.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.648+0000 7ffa58e00640 1 -- 172.21.15.99:0/3352392341 shutdown_connections 2024-02-21T23:11:41.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.648+0000 7ffa58e00640 1 --2- 172.21.15.99:0/3352392341 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7ffa3409ee50 0x7ffa340a1310 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:41.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.648+0000 7ffa58e00640 1 --2- 172.21.15.99:0/3352392341 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa5418a010 0x7ffa54220050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:41.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.648+0000 7ffa58e00640 1 --2- 172.21.15.99:0/3352392341 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffa54182a80 0x7ffa5415fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:41.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.648+0000 7ffa58e00640 1 --2- 172.21.15.99:0/3352392341 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa540fde40 0x7ffa540f9100 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:41.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.648+0000 7ffa58e00640 1 -- 172.21.15.99:0/3352392341 >> 172.21.15.99:0/3352392341 conn(0x7ffa540d29f0 msgr2=0x7ffa5418c040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:11:41.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.648+0000 7ffa58e00640 1 -- 172.21.15.99:0/3352392341 shutdown_connections 2024-02-21T23:11:41.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.648+0000 7ffa58e00640 1 -- 172.21.15.99:0/3352392341 wait complete. 2024-02-21T23:11:41.654 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T23:11:41.654 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-02-21T23:11:41.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.891+0000 7f0495800640 1 Processor -- start 2024-02-21T23:11:41.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.892+0000 7f0495800640 1 -- start start 2024-02-21T23:11:41.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.895+0000 7f0495800640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f0490189560 0x7f04900f8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:41.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.895+0000 7f0495800640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0490189b70 con 0x7f04900f8940 2024-02-21T23:11:41.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.895+0000 7f0495800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0490186fa0 con 0x7f04900f8020 2024-02-21T23:11:41.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.895+0000 7f0495800640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0490186d50 con 0x7f0490189560 2024-02-21T23:11:41.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.895+0000 7f048ea00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f04900f8020 0x7f0490188e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.99:50258/0 (socket says 172.21.15.99:50258) 2024-02-21T23:11:41.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.895+0000 7f048ea00640 1 -- 172.21.15.99:0/883661930 learned_addr learned my addr 172.21.15.99:0/883661930 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:11:41.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.895+0000 7f0487e00640 1 --2- 172.21.15.99:0/883661930 >> v2:172.21.15.181:3300/0 conn(0x7f0490189560 0x7f04900f8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:41.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.896+0000 7f048e000640 1 -- 172.21.15.99:0/883661930 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3172768886 0 0) 0x7f0490189b70 con 0x7f04900f8940 2024-02-21T23:11:41.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.896+0000 7f0487e00640 1 -- 172.21.15.99:0/883661930 >> v1:172.21.15.162:6789/0 conn(0x7f04900f8020 legacy=0x7f0490188e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:41.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.896+0000 7f0487e00640 1 -- 172.21.15.99:0/883661930 >> v1:172.21.15.99:6789/0 conn(0x7f04900f8940 legacy=0x7f0490187d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:41.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.896+0000 7f0487e00640 1 -- 172.21.15.99:0/883661930 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0490187280 con 0x7f0490189560 2024-02-21T23:11:41.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.897+0000 7f0487e00640 1 --2- 172.21.15.99:0/883661930 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0490189560 0x7f04900f8400 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f0478009720 tx=0x7f047802b6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8a6e34c069106b0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:41.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.897+0000 7f048e000640 1 -- 172.21.15.99:0/883661930 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0478037070 con 0x7f0490189560 2024-02-21T23:11:41.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.897+0000 7f048e000640 1 -- 172.21.15.99:0/883661930 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0478030710 con 0x7f0490189560 2024-02-21T23:11:41.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.897+0000 7f048e000640 1 -- 172.21.15.99:0/883661930 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0478030ae0 con 0x7f0490189560 2024-02-21T23:11:41.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.898+0000 7f0495800640 1 -- 172.21.15.99:0/883661930 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0490189560 msgr2=0x7f04900f8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:41.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.898+0000 7f0495800640 1 --2- 172.21.15.99:0/883661930 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0490189560 0x7f04900f8400 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f0478009720 tx=0x7f047802b6a0 comp rx=0 tx=0).stop 2024-02-21T23:11:41.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.898+0000 7f0495800640 1 -- 172.21.15.99:0/883661930 shutdown_connections 2024-02-21T23:11:41.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.898+0000 7f0495800640 1 --2- 172.21.15.99:0/883661930 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0490189560 0x7f04900f8400 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:41.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.898+0000 7f0495800640 1 -- 172.21.15.99:0/883661930 >> 172.21.15.99:0/883661930 conn(0x7f04900ce5f0 msgr2=0x7f04900cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:11:41.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.899+0000 7f0495800640 1 -- 172.21.15.99:0/883661930 shutdown_connections 2024-02-21T23:11:41.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.899+0000 7f0495800640 1 -- 172.21.15.99:0/883661930 wait complete. 2024-02-21T23:11:41.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.902+0000 7f0495800640 1 Processor -- start 2024-02-21T23:11:41.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.902+0000 7f0495800640 1 -- start start 2024-02-21T23:11:41.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.904+0000 7f0495800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f04900f8020 0x7f04900722c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:41.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.904+0000 7f0495800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f04900f8940 0x7f0490072800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:41.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.904+0000 7f0495800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0490189560 0x7f049015cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:41.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.904+0000 7f0495800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04900f9f60 con 0x7f0490189560 2024-02-21T23:11:41.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.904+0000 7f0495800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04901878d0 con 0x7f04900f8020 2024-02-21T23:11:41.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.904+0000 7f0495800640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f049017c660 con 0x7f04900f8940 2024-02-21T23:11:41.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.904+0000 7f048ea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f04900f8020 0x7f04900722c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:41.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.904+0000 7f048f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0490189560 0x7f049015cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:41.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.904+0000 7f048ea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f04900f8020 0x7f04900722c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:39020/0 (socket says 172.21.15.99:39020) 2024-02-21T23:11:41.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.904+0000 7f048f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0490189560 0x7f049015cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:43278/0 (socket says 172.21.15.99:43278) 2024-02-21T23:11:41.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.904+0000 7f048ea00640 1 -- 172.21.15.99:0/3411426967 learned_addr learned my addr 172.21.15.99:0/3411426967 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:11:41.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.904+0000 7f0487e00640 1 --2- 172.21.15.99:0/3411426967 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f04900f8940 0x7f0490072800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:41.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.905+0000 7f048ea00640 1 -- 172.21.15.99:0/3411426967 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f04900f8940 msgr2=0x7f0490072800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:41.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.905+0000 7f048ea00640 1 --2- 172.21.15.99:0/3411426967 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f04900f8940 0x7f0490072800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:41.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.905+0000 7f048ea00640 1 -- 172.21.15.99:0/3411426967 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0490189560 msgr2=0x7f049015cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:41.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.905+0000 7f048ea00640 1 --2- 172.21.15.99:0/3411426967 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0490189560 0x7f049015cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:41.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.905+0000 7f048ea00640 1 -- 172.21.15.99:0/3411426967 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f049018f1d0 con 0x7f04900f8020 2024-02-21T23:11:41.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.905+0000 7f048ea00640 1 --2- 172.21.15.99:0/3411426967 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f04900f8020 0x7f04900722c0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f048000c540 tx=0x7f048000ca00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:41.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.905+0000 7f0486a00640 1 -- 172.21.15.99:0/3411426967 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0480018070 con 0x7f04900f8020 2024-02-21T23:11:41.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.906+0000 7f0486a00640 1 -- 172.21.15.99:0/3411426967 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0480007500 con 0x7f04900f8020 2024-02-21T23:11:41.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.906+0000 7f0486a00640 1 -- 172.21.15.99:0/3411426967 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0480004a20 con 0x7f04900f8020 2024-02-21T23:11:41.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.906+0000 7f0495800640 1 -- 172.21.15.99:0/3411426967 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f049018f4b0 con 0x7f04900f8020 2024-02-21T23:11:41.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.906+0000 7f0495800640 1 -- 172.21.15.99:0/3411426967 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f049018fa70 con 0x7f04900f8020 2024-02-21T23:11:41.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.909+0000 7f0486a00640 1 -- 172.21.15.99:0/3411426967 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f0480004bc0 con 0x7f04900f8020 2024-02-21T23:11:41.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.910+0000 7f0486a00640 1 --2- 172.21.15.99:0/3411426967 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f046c09ef00 0x7f046c0a13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:41.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.910+0000 7f0486a00640 1 -- 172.21.15.99:0/3411426967 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f04800c9120 con 0x7f04900f8020 2024-02-21T23:11:41.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.910+0000 7f0487e00640 1 --2- 172.21.15.99:0/3411426967 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f046c09ef00 0x7f046c0a13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:41.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.911+0000 7f0487e00640 1 --2- 172.21.15.99:0/3411426967 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f046c09ef00 0x7f046c0a13c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0478034000 tx=0x7f0478008030 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:41.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.912+0000 7f0498781740 1 Processor -- start 2024-02-21T23:11:41.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.912+0000 7f0498781740 1 -- start start 2024-02-21T23:11:41.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.914+0000 7f0498781740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5575283d44b0 0x5575283d4890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:41.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.914+0000 7f0498781740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55752840f180 0x55752840f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:41.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.914+0000 7f0498781740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55752840fb40 0x5575284103b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:41.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.914+0000 7f0498781740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575282fcb50 con 0x5575283d44b0 2024-02-21T23:11:41.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.914+0000 7f0498781740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575282a5da0 con 0x55752840fb40 2024-02-21T23:11:41.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.914+0000 7f0498781740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575282f8bf0 con 0x55752840f180 2024-02-21T23:11:41.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.914+0000 7f048ea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5575283d44b0 0x5575283d4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:41.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.914+0000 7f048ea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5575283d44b0 0x5575283d4890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:43284/0 (socket says 172.21.15.99:43284) 2024-02-21T23:11:41.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.914+0000 7f048ea00640 1 -- 172.21.15.99:0/3178753185 learned_addr learned my addr 172.21.15.99:0/3178753185 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:11:41.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.914+0000 7f0487e00640 1 --2- 172.21.15.99:0/3178753185 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55752840f180 0x55752840f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:41.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.915+0000 7f048f400640 1 --2- 172.21.15.99:0/3178753185 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55752840fb40 0x5575284103b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:41.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.915+0000 7f048ea00640 1 -- 172.21.15.99:0/3178753185 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55752840f180 msgr2=0x55752840f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:41.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.915+0000 7f048ea00640 1 --2- 172.21.15.99:0/3178753185 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55752840f180 0x55752840f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:41.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.915+0000 7f048ea00640 1 -- 172.21.15.99:0/3178753185 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55752840fb40 msgr2=0x5575284103b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:41.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.915+0000 7f048ea00640 1 --2- 172.21.15.99:0/3178753185 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55752840fb40 0x5575284103b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:41.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.915+0000 7f048ea00640 1 -- 172.21.15.99:0/3178753185 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5575282c8f80 con 0x5575283d44b0 2024-02-21T23:11:41.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.915+0000 7f048ea00640 1 --2- 172.21.15.99:0/3178753185 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5575283d44b0 0x5575283d4890 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f0480001230 tx=0x7f0480096ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f927d4bd676448fc server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:41.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.915+0000 7f047f400640 1 -- 172.21.15.99:0/3178753185 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0480094d20 con 0x5575283d44b0 2024-02-21T23:11:41.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.916+0000 7f047f400640 1 -- 172.21.15.99:0/3178753185 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0480093090 con 0x5575283d44b0 2024-02-21T23:11:41.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.916+0000 7f047f400640 1 -- 172.21.15.99:0/3178753185 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0480095e70 con 0x5575283d44b0 2024-02-21T23:11:41.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.916+0000 7f0498781740 1 -- 172.21.15.99:0/3178753185 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5575283d44b0 msgr2=0x5575283d4890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:41.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.916+0000 7f0498781740 1 --2- 172.21.15.99:0/3178753185 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5575283d44b0 0x5575283d4890 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f0480001230 tx=0x7f0480096ae0 comp rx=0 tx=0).stop 2024-02-21T23:11:41.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.916+0000 7f0498781740 1 -- 172.21.15.99:0/3178753185 shutdown_connections 2024-02-21T23:11:41.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.916+0000 7f0498781740 1 --2- 172.21.15.99:0/3178753185 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55752840fb40 0x5575284103b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:41.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.916+0000 7f0498781740 1 --2- 172.21.15.99:0/3178753185 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55752840f180 0x55752840f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:41.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.916+0000 7f0498781740 1 --2- 172.21.15.99:0/3178753185 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5575283d44b0 0x5575283d4890 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:41.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.916+0000 7f0498781740 1 -- 172.21.15.99:0/3178753185 >> 172.21.15.99:0/3178753185 conn(0x557528396520 msgr2=0x5575283975a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:11:41.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.916+0000 7f0498781740 1 -- 172.21.15.99:0/3178753185 shutdown_connections 2024-02-21T23:11:41.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.916+0000 7f0498781740 1 -- 172.21.15.99:0/3178753185 wait complete. 2024-02-21T23:11:41.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.917+0000 7f0498781740 1 -- start start 2024-02-21T23:11:41.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.917+0000 7f0498781740 1 Processor -- start 2024-02-21T23:11:41.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.919+0000 7f0498781740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55752840f180 0x5575283c7f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:41.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.919+0000 7f0498781740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55752840fb40 0x5575283c3540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:41.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.919+0000 7f0498781740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5575283cef00 0x5575283cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:41.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.919+0000 7f0498781740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55752840def0 con 0x55752840fb40 2024-02-21T23:11:41.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.919+0000 7f0498781740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55752829b380 con 0x5575283cef00 2024-02-21T23:11:41.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.919+0000 7f0498781740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55752840dc10 con 0x55752840f180 2024-02-21T23:11:41.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.919+0000 7f0498781740 10 client.0 _ll_register_callbacks cb 0x5575282f4280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:11:41.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.919+0000 7f0487e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55752840fb40 0x5575283c3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:41.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.919+0000 7f0487e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55752840fb40 0x5575283c3540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:43298/0 (socket says 172.21.15.99:43298) 2024-02-21T23:11:41.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.919+0000 7f048ea00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55752840f180 0x5575283c7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:41.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.919+0000 7f0487e00640 1 -- 172.21.15.99:0/3857042783 learned_addr learned my addr 172.21.15.99:0/3857042783 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:11:41.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.919+0000 7f048f400640 1 --2- 172.21.15.99:0/3857042783 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5575283cef00 0x5575283cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:41.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.919+0000 7f048ea00640 1 -- 172.21.15.99:0/3857042783 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5575283cef00 msgr2=0x5575283cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:41.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.919+0000 7f048ea00640 1 --2- 172.21.15.99:0/3857042783 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5575283cef00 0x5575283cf710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:41.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.919+0000 7f048ea00640 1 -- 172.21.15.99:0/3857042783 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55752840fb40 msgr2=0x5575283c3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:41.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.919+0000 7f048ea00640 1 --2- 172.21.15.99:0/3857042783 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55752840fb40 0x5575283c3540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:41.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.920+0000 7f048ea00640 1 -- 172.21.15.99:0/3857042783 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5575282c3c20 con 0x55752840f180 2024-02-21T23:11:41.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.920+0000 7f048f400640 1 --2- 172.21.15.99:0/3857042783 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5575283cef00 0x5575283cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:11:41.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.920+0000 7f0487e00640 1 --2- 172.21.15.99:0/3857042783 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55752840fb40 0x5575283c3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:11:41.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.920+0000 7f048ea00640 1 --2- 172.21.15.99:0/3857042783 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55752840f180 0x5575283c7f90 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f048000cf00 tx=0x7f0480000f60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=196c549d489d69c2 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:41.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.920+0000 7f0473e00640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-02-21T23:11:41.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.920+0000 7f0473e00640 1 -- 172.21.15.99:0/3857042783 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04800b2030 con 0x55752840f180 2024-02-21T23:11:41.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.920+0000 7f0498781740 1 -- 172.21.15.99:0/3857042783 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0480093090 con 0x55752840f180 2024-02-21T23:11:41.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.920+0000 7f0473e00640 1 -- 172.21.15.99:0/3857042783 <== mon.2 v2:172.21.15.181:3300/0 2 ==== osd_map(38..38 src has 1..38) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f0480096080 con 0x55752840f180 2024-02-21T23:11:41.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.920+0000 7f0473e00640 1 -- 172.21.15.99:0/3857042783 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0480092770 con 0x55752840f180 2024-02-21T23:11:41.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.920+0000 7f0498781740 10 client.7064 fetch_fsmap learned FSMap version 17 2024-02-21T23:11:41.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.920+0000 7f0498781740 1 -- 172.21.15.99:0/3857042783 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5575280113f0 con 0x55752840f180 2024-02-21T23:11:41.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.921+0000 7f0473e00640 1 -- 172.21.15.99:0/3857042783 <== mon.2 v2:172.21.15.181:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0480093090 con 0x55752840f180 2024-02-21T23:11:41.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.921+0000 7f0473e00640 1 -- 172.21.15.99:0/3857042783 <== mon.2 v2:172.21.15.181:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f0480092910 con 0x55752840f180 2024-02-21T23:11:41.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.921+0000 7f0498781740 10 client.7064 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:11:41.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.921+0000 7f0498781740 10 client.7064 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.d 2024-02-21T23:11:41.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.921+0000 7f0498781740 20 client.7064 populate_metadata read hostname 'smithi099' 2024-02-21T23:11:41.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.921+0000 7f0498781740 1 --2- 172.21.15.99:0/3857042783 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x557528419580 0x55752841bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:41.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.921+0000 7f0498781740 4 client.7064 mds_command: new command op to 4348 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:11:41.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.921+0000 7f0498781740 1 -- 172.21.15.99:0/3857042783 --> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55752830a090 con 0x557528419580 2024-02-21T23:11:41.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.921+0000 7f0487e00640 1 --2- 172.21.15.99:0/3857042783 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x557528419580 0x55752841bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:41.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.922+0000 7f0473e00640 10 client.7064 ms_handle_connect on v2:172.21.15.99:6834/2243461688 2024-02-21T23:11:41.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.922+0000 7f0487e00640 1 --2- 172.21.15.99:0/3857042783 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x557528419580 0x55752841bec0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=487619416111225c server_cookie=715f7c77a24cdd94 in_seq=0 out_seq=0 2024-02-21T23:11:41.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.923+0000 7f0473e00640 1 -- 172.21.15.99:0/3857042783 <== mds.2 v2:172.21.15.99:6834/2243461688 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55752830a090 con 0x557528419580 2024-02-21T23:11:41.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.923+0000 7f0473e00640 10 client.7064 handle_command_reply: tid=0 2024-02-21T23:11:41.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.923+0000 7f0498781740 1 client.7064 shutdown 2024-02-21T23:11:41.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.923+0000 7f0498781740 1 -- 172.21.15.99:0/3857042783 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55752840f180 msgr2=0x5575283c7f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:41.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.923+0000 7f0498781740 1 --2- 172.21.15.99:0/3857042783 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55752840f180 0x5575283c7f90 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f048000cf00 tx=0x7f0480000f60 comp rx=0 tx=0).stop 2024-02-21T23:11:41.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.924+0000 7f0498781740 1 -- 172.21.15.99:0/3857042783 shutdown_connections 2024-02-21T23:11:41.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.924+0000 7f0498781740 1 --2- 172.21.15.99:0/3857042783 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x557528419580 0x55752841bec0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:41.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.924+0000 7f0498781740 1 --2- 172.21.15.99:0/3857042783 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5575283cef00 0x5575283cf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:41.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.924+0000 7f0498781740 1 --2- 172.21.15.99:0/3857042783 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55752840fb40 0x5575283c3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:41.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.924+0000 7f0498781740 1 --2- 172.21.15.99:0/3857042783 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55752840f180 0x5575283c7f90 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:41.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.924+0000 7f0473e00640 0 client.7064 ms_handle_reset on v2:172.21.15.99:6834/2243461688 2024-02-21T23:11:41.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.924+0000 7f0498781740 1 -- 172.21.15.99:0/3857042783 >> 172.21.15.99:0/3857042783 conn(0x5575283d44b0 msgr2=0x5575283cdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:11:41.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.924+0000 7f0498781740 1 -- 172.21.15.99:0/3857042783 shutdown_connections 2024-02-21T23:11:41.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.924+0000 7f0498781740 1 -- 172.21.15.99:0/3857042783 wait complete. 2024-02-21T23:11:41.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.924+0000 7f0498781740 20 client.7064 trim_cache size 0 max 16384 2024-02-21T23:11:41.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.937+0000 7f0498781740 1 Processor -- start 2024-02-21T23:11:41.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.938+0000 7f0498781740 1 -- start start 2024-02-21T23:11:41.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.939+0000 7f0498781740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5575283cef00 0x55752840f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:41.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.939+0000 7f0498781740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55752840f180 0x5575283df6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:41.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.939+0000 7f0498781740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55752840fb40 0x557528418950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:41.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.939+0000 7f0498781740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f049022cb90 con 0x55752840f180 2024-02-21T23:11:41.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.939+0000 7f0498781740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f049022a730 con 0x5575283cef00 2024-02-21T23:11:41.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.939+0000 7f0498781740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04902231d0 con 0x55752840fb40 2024-02-21T23:11:41.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.939+0000 7f0487e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55752840f180 0x5575283df6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:41.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.939+0000 7f0487e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55752840f180 0x5575283df6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:43310/0 (socket says 172.21.15.99:43310) 2024-02-21T23:11:41.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.939+0000 7f0487e00640 1 -- 172.21.15.99:0/1602712884 learned_addr learned my addr 172.21.15.99:0/1602712884 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:11:41.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.939+0000 7f048ea00640 1 --2- 172.21.15.99:0/1602712884 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5575283cef00 0x55752840f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:41.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.939+0000 7f048f400640 1 --2- 172.21.15.99:0/1602712884 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55752840fb40 0x557528418950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:41.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.939+0000 7f0487e00640 1 -- 172.21.15.99:0/1602712884 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55752840fb40 msgr2=0x557528418950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:41.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.939+0000 7f0487e00640 1 --2- 172.21.15.99:0/1602712884 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55752840fb40 0x557528418950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:41.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.939+0000 7f0487e00640 1 -- 172.21.15.99:0/1602712884 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5575283cef00 msgr2=0x55752840f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:41.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.939+0000 7f0487e00640 1 --2- 172.21.15.99:0/1602712884 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5575283cef00 0x55752840f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:41.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.939+0000 7f0487e00640 1 -- 172.21.15.99:0/1602712884 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5575280db7d0 con 0x55752840f180 2024-02-21T23:11:41.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.940+0000 7f048ea00640 1 --2- 172.21.15.99:0/1602712884 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5575283cef00 0x55752840f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:11:41.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.940+0000 7f0487e00640 1 --2- 172.21.15.99:0/1602712884 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55752840f180 0x5575283df6b0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f0478009810 tx=0x7f047802f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b739eea11bde26ac server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:41.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.940+0000 7f047ea00640 1 -- 172.21.15.99:0/1602712884 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0478042070 con 0x55752840f180 2024-02-21T23:11:41.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.940+0000 7f047ea00640 1 -- 172.21.15.99:0/1602712884 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04780559a0 con 0x55752840f180 2024-02-21T23:11:41.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.940+0000 7f047ea00640 1 -- 172.21.15.99:0/1602712884 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0478037040 con 0x55752840f180 2024-02-21T23:11:41.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.941+0000 7f0498781740 1 -- 172.21.15.99:0/1602712884 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55752840f180 msgr2=0x5575283df6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:41.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.941+0000 7f0498781740 1 --2- 172.21.15.99:0/1602712884 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55752840f180 0x5575283df6b0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f0478009810 tx=0x7f047802f000 comp rx=0 tx=0).stop 2024-02-21T23:11:41.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.941+0000 7f0498781740 1 -- 172.21.15.99:0/1602712884 shutdown_connections 2024-02-21T23:11:41.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.941+0000 7f0498781740 1 --2- 172.21.15.99:0/1602712884 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55752840fb40 0x557528418950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:41.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.941+0000 7f0498781740 1 --2- 172.21.15.99:0/1602712884 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55752840f180 0x5575283df6b0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:41.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.941+0000 7f0498781740 1 --2- 172.21.15.99:0/1602712884 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5575283cef00 0x55752840f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:41.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.941+0000 7f0498781740 1 -- 172.21.15.99:0/1602712884 >> 172.21.15.99:0/1602712884 conn(0x5575283d44b0 msgr2=0x5575283c3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:11:41.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.941+0000 7f0498781740 1 -- 172.21.15.99:0/1602712884 shutdown_connections 2024-02-21T23:11:41.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.941+0000 7f0498781740 1 -- 172.21.15.99:0/1602712884 wait complete. 2024-02-21T23:11:41.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.942+0000 7f0498781740 1 -- start start 2024-02-21T23:11:41.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.942+0000 7f0498781740 1 Processor -- start 2024-02-21T23:11:41.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.943+0000 7f0498781740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5575283cef00 0x55752847b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:41.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.943+0000 7f0498781740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55752840f180 0x557528474630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:41.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.943+0000 7f0498781740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55752840fb40 0x55752841be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:41.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.943+0000 7f0498781740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0490228e30 con 0x55752840fb40 2024-02-21T23:11:41.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.943+0000 7f0498781740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f049022a0d0 con 0x55752840f180 2024-02-21T23:11:41.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.943+0000 7f0498781740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0490229430 con 0x5575283cef00 2024-02-21T23:11:41.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.943+0000 7f0498781740 10 client.0 _ll_register_callbacks cb 0x7f0480015070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:11:41.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.944+0000 7f048f400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55752840fb40 0x55752841be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:41.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.944+0000 7f0487e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55752840f180 0x557528474630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:41.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.944+0000 7f0487e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55752840f180 0x557528474630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:39044/0 (socket says 172.21.15.99:39044) 2024-02-21T23:11:41.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.944+0000 7f048ea00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5575283cef00 0x55752847b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:41.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.944+0000 7f0487e00640 1 -- 172.21.15.99:0/246593625 learned_addr learned my addr 172.21.15.99:0/246593625 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:11:41.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.944+0000 7f0487e00640 1 -- 172.21.15.99:0/246593625 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5575283cef00 msgr2=0x55752847b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:41.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.944+0000 7f0487e00640 1 --2- 172.21.15.99:0/246593625 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5575283cef00 0x55752847b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:41.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.944+0000 7f0487e00640 1 -- 172.21.15.99:0/246593625 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55752840fb40 msgr2=0x55752841be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:41.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.944+0000 7f0487e00640 1 --2- 172.21.15.99:0/246593625 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55752840fb40 0x55752841be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:41.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.944+0000 7f0487e00640 1 -- 172.21.15.99:0/246593625 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557528477040 con 0x55752840f180 2024-02-21T23:11:41.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.944+0000 7f048ea00640 1 --2- 172.21.15.99:0/246593625 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5575283cef00 0x55752847b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:11:41.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.945+0000 7f0487e00640 1 --2- 172.21.15.99:0/246593625 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55752840f180 0x557528474630 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f0478041040 tx=0x7f0478004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46776efdfc535e4d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:41.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.945+0000 7f0473e00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-02-21T23:11:41.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.945+0000 7f0473e00640 1 -- 172.21.15.99:0/246593625 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0478065060 con 0x55752840f180 2024-02-21T23:11:41.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.945+0000 7f0498781740 1 -- 172.21.15.99:0/246593625 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f04780559a0 con 0x55752840f180 2024-02-21T23:11:41.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.945+0000 7f0473e00640 1 -- 172.21.15.99:0/246593625 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(38..38 src has 1..38) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f0478052040 con 0x55752840f180 2024-02-21T23:11:41.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.945+0000 7f0473e00640 1 -- 172.21.15.99:0/246593625 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0478042040 con 0x55752840f180 2024-02-21T23:11:41.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.946+0000 7f0498781740 10 client.7129 fetch_fsmap learned FSMap version 17 2024-02-21T23:11:41.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.946+0000 7f0498781740 1 -- 172.21.15.99:0/246593625 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55752847a8f0 con 0x55752840f180 2024-02-21T23:11:41.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.946+0000 7f0473e00640 1 -- 172.21.15.99:0/246593625 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04780559a0 con 0x55752840f180 2024-02-21T23:11:41.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.946+0000 7f0473e00640 1 -- 172.21.15.99:0/246593625 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f0478055b50 con 0x55752840f180 2024-02-21T23:11:41.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.946+0000 7f0498781740 10 client.7129 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:11:41.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.946+0000 7f0498781740 10 client.7129 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.d 2024-02-21T23:11:41.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.946+0000 7f0498781740 20 client.7129 populate_metadata read hostname 'smithi099' 2024-02-21T23:11:41.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.946+0000 7f0498781740 1 --2- 172.21.15.99:0/246593625 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x55752840d7d0 0x55752841c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:41.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.946+0000 7f0498781740 4 client.7129 mds_command: new command op to 4348 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T23:11:41.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.946+0000 7f0498781740 1 -- 172.21.15.99:0/246593625 --> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5575283043e0 con 0x55752840d7d0 2024-02-21T23:11:41.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.947+0000 7f048ea00640 1 --2- 172.21.15.99:0/246593625 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x55752840d7d0 0x55752841c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:41.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.947+0000 7f048ea00640 1 --2- 172.21.15.99:0/246593625 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x55752840d7d0 0x55752841c390 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=82223d3ba33d76ba server_cookie=9272c85e11b866ef in_seq=0 out_seq=0 2024-02-21T23:11:41.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.947+0000 7f0473e00640 10 client.7129 ms_handle_connect on v2:172.21.15.99:6834/2243461688 2024-02-21T23:11:41.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.947+0000 7f0473e00640 1 -- 172.21.15.99:0/246593625 <== mds.2 v2:172.21.15.99:6834/2243461688 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5575283043e0 con 0x55752840d7d0 2024-02-21T23:11:41.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.947+0000 7f0473e00640 10 client.7129 handle_command_reply: tid=0 2024-02-21T23:11:41.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.947+0000 7f0498781740 1 client.7129 shutdown 2024-02-21T23:11:41.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.948+0000 7f0498781740 1 -- 172.21.15.99:0/246593625 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55752840f180 msgr2=0x557528474630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:41.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.948+0000 7f0498781740 1 --2- 172.21.15.99:0/246593625 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55752840f180 0x557528474630 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f0478041040 tx=0x7f0478004730 comp rx=0 tx=0).stop 2024-02-21T23:11:41.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.948+0000 7f0498781740 1 -- 172.21.15.99:0/246593625 shutdown_connections 2024-02-21T23:11:41.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.948+0000 7f0498781740 1 --2- 172.21.15.99:0/246593625 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x55752840d7d0 0x55752841c390 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:41.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.948+0000 7f0498781740 1 --2- 172.21.15.99:0/246593625 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55752840fb40 0x55752841be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:41.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.948+0000 7f0498781740 1 --2- 172.21.15.99:0/246593625 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55752840f180 0x557528474630 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:41.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.948+0000 7f0498781740 1 --2- 172.21.15.99:0/246593625 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5575283cef00 0x55752847b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:41.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.948+0000 7f0498781740 1 -- 172.21.15.99:0/246593625 >> 172.21.15.99:0/246593625 conn(0x5575283d44b0 msgr2=0x55752839e940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:11:41.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.948+0000 7f0473e00640 0 client.7129 ms_handle_reset on v2:172.21.15.99:6834/2243461688 2024-02-21T23:11:41.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.948+0000 7f0498781740 1 -- 172.21.15.99:0/246593625 shutdown_connections 2024-02-21T23:11:41.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.948+0000 7f0498781740 1 -- 172.21.15.99:0/246593625 wait complete. 2024-02-21T23:11:41.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.948+0000 7f0498781740 20 client.7129 trim_cache size 0 max 16384 2024-02-21T23:11:41.947 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-02-21T23:11:41.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.949+0000 7f0495800640 1 -- 172.21.15.99:0/3411426967 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f046c09ef00 msgr2=0x7f046c0a13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:41.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.949+0000 7f0495800640 1 --2- 172.21.15.99:0/3411426967 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f046c09ef00 0x7f046c0a13c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0478034000 tx=0x7f0478008030 comp rx=0 tx=0).stop 2024-02-21T23:11:41.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.949+0000 7f0495800640 1 -- 172.21.15.99:0/3411426967 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f04900f8020 msgr2=0x7f04900722c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:41.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.949+0000 7f0495800640 1 --2- 172.21.15.99:0/3411426967 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f04900f8020 0x7f04900722c0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f048000c540 tx=0x7f048000ca00 comp rx=0 tx=0).stop 2024-02-21T23:11:41.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.949+0000 7f0495800640 1 -- 172.21.15.99:0/3411426967 shutdown_connections 2024-02-21T23:11:41.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.949+0000 7f0495800640 1 --2- 172.21.15.99:0/3411426967 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f046c09ef00 0x7f046c0a13c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:41.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.949+0000 7f0495800640 1 --2- 172.21.15.99:0/3411426967 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0490189560 0x7f049015cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:41.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.949+0000 7f0495800640 1 --2- 172.21.15.99:0/3411426967 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f04900f8940 0x7f0490072800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:41.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.949+0000 7f0495800640 1 --2- 172.21.15.99:0/3411426967 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f04900f8020 0x7f04900722c0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:41.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.949+0000 7f0495800640 1 -- 172.21.15.99:0/3411426967 >> 172.21.15.99:0/3411426967 conn(0x7f04900ce5f0 msgr2=0x7f04900f5880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:11:41.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.949+0000 7f0495800640 1 -- 172.21.15.99:0/3411426967 shutdown_connections 2024-02-21T23:11:41.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:41.949+0000 7f0495800640 1 -- 172.21.15.99:0/3411426967 wait complete. 2024-02-21T23:11:41.953 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T23:11:41.953 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-02-21T23:11:42.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.191+0000 7fc837c00640 1 Processor -- start 2024-02-21T23:11:42.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.192+0000 7fc837c00640 1 -- start start 2024-02-21T23:11:42.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.195+0000 7fc837c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc8301867e0 0x7fc8301881e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:42.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.195+0000 7fc837c00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc830188720 con 0x7fc830186400 2024-02-21T23:11:42.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.195+0000 7fc837c00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8300cf820 con 0x7fc8300d4320 2024-02-21T23:11:42.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.195+0000 7fc837c00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc830187640 con 0x7fc8301867e0 2024-02-21T23:11:42.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.195+0000 7fc835200640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fc830186400 0x7fc830187ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:44842/0 (socket says 172.21.15.99:44842) 2024-02-21T23:11:42.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.195+0000 7fc835200640 1 -- 172.21.15.99:0/2977919046 learned_addr learned my addr 172.21.15.99:0/2977919046 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:11:42.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.195+0000 7fc82fe00640 1 --2- 172.21.15.99:0/2977919046 >> v2:172.21.15.162:3300/0 conn(0x7fc8301867e0 0x7fc8301881e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:42.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.196+0000 7fc82fe00640 1 -- 172.21.15.99:0/2977919046 >> v1:172.21.15.181:6789/0 conn(0x7fc8300d4320 legacy=0x7fc8300d4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:42.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.196+0000 7fc82f400640 1 -- 172.21.15.99:0/2977919046 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1459514035 0 0) 0x7fc830188720 con 0x7fc830186400 2024-02-21T23:11:42.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.196+0000 7fc82fe00640 1 -- 172.21.15.99:0/2977919046 >> v1:172.21.15.99:6789/0 conn(0x7fc830186400 legacy=0x7fc830187ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:42.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.196+0000 7fc82fe00640 1 -- 172.21.15.99:0/2977919046 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8300cfb00 con 0x7fc8301867e0 2024-02-21T23:11:42.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.197+0000 7fc82fe00640 1 --2- 172.21.15.99:0/2977919046 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8301867e0 0x7fc8301881e0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fc81c0097a0 tx=0x7fc81c02b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad859e8a08c33112 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:42.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.198+0000 7fc82f400640 1 -- 172.21.15.99:0/2977919046 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81c0315a0 con 0x7fc8301867e0 2024-02-21T23:11:42.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.198+0000 7fc82f400640 1 -- 172.21.15.99:0/2977919046 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc81c037070 con 0x7fc8301867e0 2024-02-21T23:11:42.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.198+0000 7fc82f400640 1 -- 172.21.15.99:0/2977919046 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81c031960 con 0x7fc8301867e0 2024-02-21T23:11:42.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.199+0000 7fc837c00640 1 -- 172.21.15.99:0/2977919046 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8301867e0 msgr2=0x7fc8301881e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:42.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.199+0000 7fc837c00640 1 --2- 172.21.15.99:0/2977919046 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8301867e0 0x7fc8301881e0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fc81c0097a0 tx=0x7fc81c02b840 comp rx=0 tx=0).stop 2024-02-21T23:11:42.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.199+0000 7fc837c00640 1 -- 172.21.15.99:0/2977919046 shutdown_connections 2024-02-21T23:11:42.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.199+0000 7fc837c00640 1 --2- 172.21.15.99:0/2977919046 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8301867e0 0x7fc8301881e0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:42.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.199+0000 7fc837c00640 1 -- 172.21.15.99:0/2977919046 >> 172.21.15.99:0/2977919046 conn(0x7fc8300d6af0 msgr2=0x7fc8300740b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:11:42.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.199+0000 7fc837c00640 1 -- 172.21.15.99:0/2977919046 shutdown_connections 2024-02-21T23:11:42.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.199+0000 7fc837c00640 1 -- 172.21.15.99:0/2977919046 wait complete. 2024-02-21T23:11:42.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.202+0000 7fc837c00640 1 Processor -- start 2024-02-21T23:11:42.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.202+0000 7fc837c00640 1 -- start start 2024-02-21T23:11:42.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.204+0000 7fc837c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8300d4320 0x7fc830171e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:42.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.205+0000 7fc837c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc830186400 0x7fc830178b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:42.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.205+0000 7fc837c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8301867e0 0x7fc8301847a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:42.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.205+0000 7fc837c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8301872d0 con 0x7fc8301867e0 2024-02-21T23:11:42.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.205+0000 7fc837c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc830186ff0 con 0x7fc8300d4320 2024-02-21T23:11:42.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.205+0000 7fc837c00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8300ceeb0 con 0x7fc830186400 2024-02-21T23:11:42.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.205+0000 7fc835200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8300d4320 0x7fc830171e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:42.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.205+0000 7fc835200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8300d4320 0x7fc830171e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:39060/0 (socket says 172.21.15.99:39060) 2024-02-21T23:11:42.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.205+0000 7fc835200640 1 -- 172.21.15.99:0/1910135470 learned_addr learned my addr 172.21.15.99:0/1910135470 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:11:42.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.205+0000 7fc835c00640 1 --2- 172.21.15.99:0/1910135470 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8301867e0 0x7fc8301847a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:42.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.205+0000 7fc82fe00640 1 --2- 172.21.15.99:0/1910135470 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc830186400 0x7fc830178b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:42.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.205+0000 7fc835200640 1 -- 172.21.15.99:0/1910135470 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc830186400 msgr2=0x7fc830178b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:42.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.205+0000 7fc835200640 1 --2- 172.21.15.99:0/1910135470 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc830186400 0x7fc830178b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:42.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.205+0000 7fc835200640 1 -- 172.21.15.99:0/1910135470 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8301867e0 msgr2=0x7fc8301847a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:42.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.206+0000 7fc835200640 1 --2- 172.21.15.99:0/1910135470 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8301867e0 0x7fc8301847a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:42.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.206+0000 7fc835200640 1 -- 172.21.15.99:0/1910135470 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8301749f0 con 0x7fc8300d4320 2024-02-21T23:11:42.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.206+0000 7fc835200640 1 --2- 172.21.15.99:0/1910135470 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8300d4320 0x7fc830171e40 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fc82400c4d0 tx=0x7fc82400c990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:42.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.206+0000 7fc82cc00640 1 -- 172.21.15.99:0/1910135470 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc824018070 con 0x7fc8300d4320 2024-02-21T23:11:42.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.206+0000 7fc82cc00640 1 -- 172.21.15.99:0/1910135470 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8240074e0 con 0x7fc8300d4320 2024-02-21T23:11:42.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.206+0000 7fc82cc00640 1 -- 172.21.15.99:0/1910135470 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc824004a20 con 0x7fc8300d4320 2024-02-21T23:11:42.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.206+0000 7fc837c00640 1 -- 172.21.15.99:0/1910135470 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc830179660 con 0x7fc8300d4320 2024-02-21T23:11:42.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.206+0000 7fc837c00640 1 -- 172.21.15.99:0/1910135470 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc830183cc0 con 0x7fc8300d4320 2024-02-21T23:11:42.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.210+0000 7fc82cc00640 1 -- 172.21.15.99:0/1910135470 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7fc824004bc0 con 0x7fc8300d4320 2024-02-21T23:11:42.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.212+0000 7fc82cc00640 1 --2- 172.21.15.99:0/1910135470 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fc81009eed0 0x7fc8100a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:42.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.212+0000 7fc82cc00640 1 -- 172.21.15.99:0/1910135470 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 8877+0+0 (secure 0 0 0) 0x7fc8240c91a0 con 0x7fc8300d4320 2024-02-21T23:11:42.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.212+0000 7fc82fe00640 1 --2- 172.21.15.99:0/1910135470 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fc81009eed0 0x7fc8100a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:42.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.213+0000 7fc83aa49740 1 Processor -- start 2024-02-21T23:11:42.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.213+0000 7fc83aa49740 1 -- start start 2024-02-21T23:11:42.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.213+0000 7fc82fe00640 1 --2- 172.21.15.99:0/1910135470 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fc81009eed0 0x7fc8100a1390 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc81c036000 tx=0x7fc81c03d040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:42.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.215+0000 7fc83aa49740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b06cdd4b0 0x564b06cdd890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:42.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.215+0000 7fc83aa49740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564b06d18180 0x564b06d18600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:42.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.215+0000 7fc83aa49740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b06d18b40 0x564b06d193b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:42.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.215+0000 7fc83aa49740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b06c05b50 con 0x564b06d18180 2024-02-21T23:11:42.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.215+0000 7fc83aa49740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b06baeda0 con 0x564b06d18b40 2024-02-21T23:11:42.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.215+0000 7fc83aa49740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b06c01bf0 con 0x564b06cdd4b0 2024-02-21T23:11:42.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.215+0000 7fc82fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564b06d18180 0x564b06d18600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:42.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.215+0000 7fc82fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564b06d18180 0x564b06d18600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:43344/0 (socket says 172.21.15.99:43344) 2024-02-21T23:11:42.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.215+0000 7fc82fe00640 1 -- 172.21.15.99:0/558140427 learned_addr learned my addr 172.21.15.99:0/558140427 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:11:42.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.215+0000 7fc835200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b06cdd4b0 0x564b06cdd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:42.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.215+0000 7fc835c00640 1 --2- 172.21.15.99:0/558140427 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b06d18b40 0x564b06d193b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:42.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.215+0000 7fc835200640 1 -- 172.21.15.99:0/558140427 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b06d18b40 msgr2=0x564b06d193b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:42.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.215+0000 7fc835200640 1 --2- 172.21.15.99:0/558140427 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b06d18b40 0x564b06d193b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:42.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.215+0000 7fc835200640 1 -- 172.21.15.99:0/558140427 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564b06d18180 msgr2=0x564b06d18600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:42.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.216+0000 7fc835200640 1 --2- 172.21.15.99:0/558140427 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564b06d18180 0x564b06d18600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:42.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.216+0000 7fc835200640 1 -- 172.21.15.99:0/558140427 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564b06bd1f80 con 0x564b06cdd4b0 2024-02-21T23:11:42.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.216+0000 7fc835200640 1 --2- 172.21.15.99:0/558140427 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b06cdd4b0 0x564b06cdd890 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fc8240c6810 tx=0x7fc824092d40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8df8cf4b5c39d2e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:42.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.216+0000 7fc821600640 1 -- 172.21.15.99:0/558140427 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc824093110 con 0x564b06cdd4b0 2024-02-21T23:11:42.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.216+0000 7fc821600640 1 -- 172.21.15.99:0/558140427 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8240c69b0 con 0x564b06cdd4b0 2024-02-21T23:11:42.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.216+0000 7fc821600640 1 -- 172.21.15.99:0/558140427 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8240932b0 con 0x564b06cdd4b0 2024-02-21T23:11:42.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.217+0000 7fc83aa49740 1 -- 172.21.15.99:0/558140427 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b06cdd4b0 msgr2=0x564b06cdd890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:42.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.217+0000 7fc83aa49740 1 --2- 172.21.15.99:0/558140427 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b06cdd4b0 0x564b06cdd890 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fc8240c6810 tx=0x7fc824092d40 comp rx=0 tx=0).stop 2024-02-21T23:11:42.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.217+0000 7fc83aa49740 1 -- 172.21.15.99:0/558140427 shutdown_connections 2024-02-21T23:11:42.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.217+0000 7fc83aa49740 1 --2- 172.21.15.99:0/558140427 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b06d18b40 0x564b06d193b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:42.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.217+0000 7fc83aa49740 1 --2- 172.21.15.99:0/558140427 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564b06d18180 0x564b06d18600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:42.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.217+0000 7fc83aa49740 1 --2- 172.21.15.99:0/558140427 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b06cdd4b0 0x564b06cdd890 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:42.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.217+0000 7fc83aa49740 1 -- 172.21.15.99:0/558140427 >> 172.21.15.99:0/558140427 conn(0x564b06c9f520 msgr2=0x564b06ca05a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:11:42.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.217+0000 7fc83aa49740 1 -- 172.21.15.99:0/558140427 shutdown_connections 2024-02-21T23:11:42.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.217+0000 7fc83aa49740 1 -- 172.21.15.99:0/558140427 wait complete. 2024-02-21T23:11:42.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.218+0000 7fc83aa49740 1 -- start start 2024-02-21T23:11:42.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.218+0000 7fc83aa49740 1 Processor -- start 2024-02-21T23:11:42.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.219+0000 7fc83aa49740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b06d18180 0x564b06d20510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:42.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.219+0000 7fc83aa49740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b06d18b40 0x564b06cd5a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:42.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.219+0000 7fc83aa49740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564b06d12bf0 0x564b06d11b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:42.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.219+0000 7fc83aa49740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b06c01bf0 con 0x564b06d12bf0 2024-02-21T23:11:42.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.219+0000 7fc83aa49740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b06ba4380 con 0x564b06d18180 2024-02-21T23:11:42.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.219+0000 7fc83aa49740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b06d16ef0 con 0x564b06d18b40 2024-02-21T23:11:42.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.219+0000 7fc83aa49740 10 client.0 _ll_register_callbacks cb 0x564b06bfd280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:11:42.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.220+0000 7fc835200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b06d18180 0x564b06d20510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:42.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.220+0000 7fc835200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b06d18180 0x564b06d20510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:39082/0 (socket says 172.21.15.99:39082) 2024-02-21T23:11:42.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.220+0000 7fc835200640 1 -- 172.21.15.99:0/4046226778 learned_addr learned my addr 172.21.15.99:0/4046226778 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:11:42.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.220+0000 7fc835c00640 1 --2- 172.21.15.99:0/4046226778 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564b06d12bf0 0x564b06d11b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:42.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.220+0000 7fc82fe00640 1 --2- 172.21.15.99:0/4046226778 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b06d18b40 0x564b06cd5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:42.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.220+0000 7fc835200640 1 -- 172.21.15.99:0/4046226778 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b06d18b40 msgr2=0x564b06cd5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:42.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.220+0000 7fc835200640 1 --2- 172.21.15.99:0/4046226778 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b06d18b40 0x564b06cd5a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:42.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.220+0000 7fc835200640 1 -- 172.21.15.99:0/4046226778 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564b06d12bf0 msgr2=0x564b06d11b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:42.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.220+0000 7fc835200640 1 --2- 172.21.15.99:0/4046226778 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564b06d12bf0 0x564b06d11b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:42.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.220+0000 7fc835200640 1 -- 172.21.15.99:0/4046226778 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564b06bccc20 con 0x564b06d18180 2024-02-21T23:11:42.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.220+0000 7fc82fe00640 1 --2- 172.21.15.99:0/4046226778 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b06d18b40 0x564b06cd5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:11:42.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.220+0000 7fc835200640 1 --2- 172.21.15.99:0/4046226778 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b06d18180 0x564b06d20510 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fc8240967a0 tx=0x7fc824092e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f7b8ee053d69d87 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:42.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.220+0000 7fc816000640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-02-21T23:11:42.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.221+0000 7fc816000640 1 -- 172.21.15.99:0/4046226778 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8240927f0 con 0x564b06d18180 2024-02-21T23:11:42.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.221+0000 7fc816000640 1 -- 172.21.15.99:0/4046226778 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(38..38 src has 1..38) v4 ==== 8877+0+0 (secure 0 0 0) 0x7fc824092990 con 0x564b06d18180 2024-02-21T23:11:42.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.221+0000 7fc83aa49740 1 -- 172.21.15.99:0/4046226778 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc8240c69b0 con 0x564b06d18180 2024-02-21T23:11:42.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.221+0000 7fc816000640 1 -- 172.21.15.99:0/4046226778 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc824095960 con 0x564b06d18180 2024-02-21T23:11:42.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.221+0000 7fc83aa49740 10 client.7141 fetch_fsmap learned FSMap version 17 2024-02-21T23:11:42.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.221+0000 7fc83aa49740 1 -- 172.21.15.99:0/4046226778 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x564b0691a3f0 con 0x564b06d18180 2024-02-21T23:11:42.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.221+0000 7fc816000640 1 -- 172.21.15.99:0/4046226778 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8240c69b0 con 0x564b06d18180 2024-02-21T23:11:42.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.221+0000 7fc816000640 1 -- 172.21.15.99:0/4046226778 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fc824095b00 con 0x564b06d18180 2024-02-21T23:11:42.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.222+0000 7fc83aa49740 10 client.7141 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:11:42.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.222+0000 7fc83aa49740 10 client.7141 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2024-02-21T23:11:42.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.222+0000 7fc83aa49740 20 client.7141 populate_metadata read hostname 'smithi099' 2024-02-21T23:11:42.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.222+0000 7fc83aa49740 1 --2- 172.21.15.99:0/4046226778 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x564b06d13070 0x564b06d24cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:42.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.222+0000 7fc83aa49740 4 client.7141 mds_command: new command op to 4352 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:11:42.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.222+0000 7fc83aa49740 1 -- 172.21.15.99:0/4046226778 --> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564b06c13090 con 0x564b06d13070 2024-02-21T23:11:42.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.222+0000 7fc82fe00640 1 --2- 172.21.15.99:0/4046226778 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x564b06d13070 0x564b06d24cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:42.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.223+0000 7fc82fe00640 1 --2- 172.21.15.99:0/4046226778 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x564b06d13070 0x564b06d24cb0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9cbe036a8aaee89b server_cookie=19d57a21b5350ffb in_seq=0 out_seq=0 2024-02-21T23:11:42.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.223+0000 7fc816000640 10 client.7141 ms_handle_connect on v2:172.21.15.99:6836/1676159950 2024-02-21T23:11:42.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.223+0000 7fc816000640 1 -- 172.21.15.99:0/4046226778 <== mds.1 v2:172.21.15.99:6836/1676159950 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x564b06c13090 con 0x564b06d13070 2024-02-21T23:11:42.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.223+0000 7fc816000640 10 client.7141 handle_command_reply: tid=0 2024-02-21T23:11:42.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.223+0000 7fc83aa49740 1 client.7141 shutdown 2024-02-21T23:11:42.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.224+0000 7fc83aa49740 1 -- 172.21.15.99:0/4046226778 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b06d18180 msgr2=0x564b06d20510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:42.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.224+0000 7fc83aa49740 1 --2- 172.21.15.99:0/4046226778 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b06d18180 0x564b06d20510 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fc8240967a0 tx=0x7fc824092e70 comp rx=0 tx=0).stop 2024-02-21T23:11:42.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.224+0000 7fc83aa49740 1 -- 172.21.15.99:0/4046226778 shutdown_connections 2024-02-21T23:11:42.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.224+0000 7fc83aa49740 1 --2- 172.21.15.99:0/4046226778 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x564b06d13070 0x564b06d24cb0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:42.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.224+0000 7fc83aa49740 1 --2- 172.21.15.99:0/4046226778 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564b06d12bf0 0x564b06d11b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:42.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.224+0000 7fc83aa49740 1 --2- 172.21.15.99:0/4046226778 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b06d18b40 0x564b06cd5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:42.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.224+0000 7fc83aa49740 1 --2- 172.21.15.99:0/4046226778 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b06d18180 0x564b06d20510 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:42.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.224+0000 7fc816000640 0 client.7141 ms_handle_reset on v2:172.21.15.99:6836/1676159950 2024-02-21T23:11:42.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.224+0000 7fc83aa49740 1 -- 172.21.15.99:0/4046226778 >> 172.21.15.99:0/4046226778 conn(0x564b06cdd4b0 msgr2=0x564b06ce8e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:11:42.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.224+0000 7fc83aa49740 1 -- 172.21.15.99:0/4046226778 shutdown_connections 2024-02-21T23:11:42.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.224+0000 7fc83aa49740 1 -- 172.21.15.99:0/4046226778 wait complete. 2024-02-21T23:11:42.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.224+0000 7fc83aa49740 20 client.7141 trim_cache size 0 max 16384 2024-02-21T23:11:42.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.246+0000 7fc83aa49740 1 Processor -- start 2024-02-21T23:11:42.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.246+0000 7fc83aa49740 1 -- start start 2024-02-21T23:11:42.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.247+0000 7fc83aa49740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b06d12bf0 0x564b06d0d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:42.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.247+0000 7fc83aa49740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b06d18180 0x564b06ce7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:42.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.247+0000 7fc83aa49740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564b06d18b40 0x564b06c975d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:42.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.247+0000 7fc83aa49740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc83022ca60 con 0x564b06d18b40 2024-02-21T23:11:42.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.247+0000 7fc83aa49740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc83022a600 con 0x564b06d12bf0 2024-02-21T23:11:42.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.247+0000 7fc83aa49740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc83017ee50 con 0x564b06d18180 2024-02-21T23:11:42.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.247+0000 7fc835200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b06d12bf0 0x564b06d0d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:42.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.248+0000 7fc82fe00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b06d18180 0x564b06ce7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:42.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.248+0000 7fc835200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b06d12bf0 0x564b06d0d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:39086/0 (socket says 172.21.15.99:39086) 2024-02-21T23:11:42.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.248+0000 7fc835200640 1 -- 172.21.15.99:0/421045584 learned_addr learned my addr 172.21.15.99:0/421045584 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:11:42.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.248+0000 7fc835c00640 1 --2- 172.21.15.99:0/421045584 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564b06d18b40 0x564b06c975d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:42.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.248+0000 7fc82fe00640 1 -- 172.21.15.99:0/421045584 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b06d12bf0 msgr2=0x564b06d0d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:42.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.248+0000 7fc82fe00640 1 --2- 172.21.15.99:0/421045584 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b06d12bf0 0x564b06d0d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:42.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.248+0000 7fc82fe00640 1 -- 172.21.15.99:0/421045584 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564b06d18b40 msgr2=0x564b06c975d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:42.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.248+0000 7fc82fe00640 1 --2- 172.21.15.99:0/421045584 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564b06d18b40 0x564b06c975d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:42.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.248+0000 7fc82fe00640 1 -- 172.21.15.99:0/421045584 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564b06d0dcc0 con 0x564b06d18180 2024-02-21T23:11:42.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.248+0000 7fc82fe00640 1 --2- 172.21.15.99:0/421045584 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b06d18180 0x564b06ce7aa0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x564b06ce1690 tx=0x7fc81c030000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82444f7c9c6e00a7 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:42.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.249+0000 7fc820c00640 1 -- 172.21.15.99:0/421045584 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81c058070 con 0x564b06d18180 2024-02-21T23:11:42.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.249+0000 7fc820c00640 1 -- 172.21.15.99:0/421045584 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc81c037040 con 0x564b06d18180 2024-02-21T23:11:42.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.249+0000 7fc820c00640 1 -- 172.21.15.99:0/421045584 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81c054760 con 0x564b06d18180 2024-02-21T23:11:42.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.249+0000 7fc83aa49740 1 -- 172.21.15.99:0/421045584 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b06d18180 msgr2=0x564b06ce7aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:42.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.249+0000 7fc83aa49740 1 --2- 172.21.15.99:0/421045584 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b06d18180 0x564b06ce7aa0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x564b06ce1690 tx=0x7fc81c030000 comp rx=0 tx=0).stop 2024-02-21T23:11:42.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.250+0000 7fc83aa49740 1 -- 172.21.15.99:0/421045584 shutdown_connections 2024-02-21T23:11:42.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.250+0000 7fc83aa49740 1 --2- 172.21.15.99:0/421045584 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564b06d18b40 0x564b06c975d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:42.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.250+0000 7fc83aa49740 1 --2- 172.21.15.99:0/421045584 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b06d18180 0x564b06ce7aa0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:42.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.250+0000 7fc83aa49740 1 --2- 172.21.15.99:0/421045584 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b06d12bf0 0x564b06d0d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:42.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.250+0000 7fc83aa49740 1 -- 172.21.15.99:0/421045584 >> 172.21.15.99:0/421045584 conn(0x564b06cdd4b0 msgr2=0x564b06c9ed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:11:42.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.250+0000 7fc83aa49740 1 -- 172.21.15.99:0/421045584 shutdown_connections 2024-02-21T23:11:42.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.250+0000 7fc83aa49740 1 -- 172.21.15.99:0/421045584 wait complete. 2024-02-21T23:11:42.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.251+0000 7fc83aa49740 1 -- start start 2024-02-21T23:11:42.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.251+0000 7fc83aa49740 1 Processor -- start 2024-02-21T23:11:42.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.253+0000 7fc83aa49740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564b06d12bf0 0x564b06d212a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:42.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.253+0000 7fc83aa49740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b06d18180 0x564b06d11b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:42.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.253+0000 7fc83aa49740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b06d18b40 0x564b06d21800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:42.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.253+0000 7fc83aa49740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc83017f450 con 0x564b06d12bf0 2024-02-21T23:11:42.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.253+0000 7fc83aa49740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc830229fa0 con 0x564b06d18b40 2024-02-21T23:11:42.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.253+0000 7fc83aa49740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8302292e0 con 0x564b06d18180 2024-02-21T23:11:42.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.254+0000 7fc83aa49740 10 client.0 _ll_register_callbacks cb 0x7fc81c0318b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:11:42.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.254+0000 7fc835200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564b06d12bf0 0x564b06d212a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:42.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.254+0000 7fc835200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564b06d12bf0 0x564b06d212a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:43366/0 (socket says 172.21.15.99:43366) 2024-02-21T23:11:42.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.254+0000 7fc835200640 1 -- 172.21.15.99:0/1290772333 learned_addr learned my addr 172.21.15.99:0/1290772333 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:11:42.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.254+0000 7fc82fe00640 1 --2- 172.21.15.99:0/1290772333 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b06d18180 0x564b06d11b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:42.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.254+0000 7fc835c00640 1 --2- 172.21.15.99:0/1290772333 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b06d18b40 0x564b06d21800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:42.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.254+0000 7fc835200640 1 -- 172.21.15.99:0/1290772333 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b06d18180 msgr2=0x564b06d11b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:42.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.254+0000 7fc835200640 1 --2- 172.21.15.99:0/1290772333 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b06d18180 0x564b06d11b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:42.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.254+0000 7fc835200640 1 -- 172.21.15.99:0/1290772333 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b06d18b40 msgr2=0x564b06d21800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:42.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.254+0000 7fc835200640 1 --2- 172.21.15.99:0/1290772333 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b06d18b40 0x564b06d21800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:42.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.254+0000 7fc835200640 1 -- 172.21.15.99:0/1290772333 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564b069e47d0 con 0x564b06d12bf0 2024-02-21T23:11:42.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.254+0000 7fc82fe00640 1 --2- 172.21.15.99:0/1290772333 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b06d18180 0x564b06d11b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:11:42.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.254+0000 7fc835c00640 1 --2- 172.21.15.99:0/1290772333 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b06d18b40 0x564b06d21800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:11:42.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.255+0000 7fc835200640 1 --2- 172.21.15.99:0/1290772333 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564b06d12bf0 0x564b06d212a0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fc8240ae2d0 tx=0x7fc8240c8040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d354451b35bc75b6 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:42.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.255+0000 7fc816000640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:11:42.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.255+0000 7fc816000640 1 -- 172.21.15.99:0/1290772333 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc824096400 con 0x564b06d12bf0 2024-02-21T23:11:42.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.255+0000 7fc816000640 1 -- 172.21.15.99:0/1290772333 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(38..38 src has 1..38) v4 ==== 8877+0+0 (secure 0 0 0) 0x7fc8240ae350 con 0x564b06d12bf0 2024-02-21T23:11:42.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.255+0000 7fc83aa49740 1 -- 172.21.15.99:0/1290772333 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc81c037040 con 0x564b06d12bf0 2024-02-21T23:11:42.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.255+0000 7fc816000640 1 -- 172.21.15.99:0/1290772333 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc8240ae0c0 con 0x564b06d12bf0 2024-02-21T23:11:42.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.255+0000 7fc83aa49740 10 client.6951 fetch_fsmap learned FSMap version 17 2024-02-21T23:11:42.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.255+0000 7fc83aa49740 1 -- 172.21.15.99:0/1290772333 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x564b06d28c80 con 0x564b06d12bf0 2024-02-21T23:11:42.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.255+0000 7fc816000640 1 -- 172.21.15.99:0/1290772333 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc81c037040 con 0x564b06d12bf0 2024-02-21T23:11:42.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.256+0000 7fc816000640 1 -- 172.21.15.99:0/1290772333 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fc8240927f0 con 0x564b06d12bf0 2024-02-21T23:11:42.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.256+0000 7fc83aa49740 10 client.6951 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:11:42.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.256+0000 7fc83aa49740 10 client.6951 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2024-02-21T23:11:42.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.256+0000 7fc83aa49740 20 client.6951 populate_metadata read hostname 'smithi099' 2024-02-21T23:11:42.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.256+0000 7fc83aa49740 1 --2- 172.21.15.99:0/1290772333 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x564b06ca7ed0 0x564b06d29410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:42.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.256+0000 7fc83aa49740 4 client.6951 mds_command: new command op to 4352 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T23:11:42.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.256+0000 7fc83aa49740 1 -- 172.21.15.99:0/1290772333 --> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x564b06c0d3e0 con 0x564b06ca7ed0 2024-02-21T23:11:42.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.256+0000 7fc82fe00640 1 --2- 172.21.15.99:0/1290772333 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x564b06ca7ed0 0x564b06d29410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:42.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.257+0000 7fc82fe00640 1 --2- 172.21.15.99:0/1290772333 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x564b06ca7ed0 0x564b06d29410 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9c815ec770e7e83f server_cookie=a8c1d0fb75f9d57e in_seq=0 out_seq=0 2024-02-21T23:11:42.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.257+0000 7fc816000640 10 client.6951 ms_handle_connect on v2:172.21.15.99:6836/1676159950 2024-02-21T23:11:42.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.257+0000 7fc816000640 1 -- 172.21.15.99:0/1290772333 <== mds.1 v2:172.21.15.99:6836/1676159950 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x564b06c0d3e0 con 0x564b06ca7ed0 2024-02-21T23:11:42.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.257+0000 7fc816000640 10 client.6951 handle_command_reply: tid=0 2024-02-21T23:11:42.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.257+0000 7fc83aa49740 1 client.6951 shutdown 2024-02-21T23:11:42.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.257+0000 7fc83aa49740 1 -- 172.21.15.99:0/1290772333 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564b06d12bf0 msgr2=0x564b06d212a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:42.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.257+0000 7fc83aa49740 1 --2- 172.21.15.99:0/1290772333 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564b06d12bf0 0x564b06d212a0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fc8240ae2d0 tx=0x7fc8240c8040 comp rx=0 tx=0).stop 2024-02-21T23:11:42.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.257+0000 7fc83aa49740 1 -- 172.21.15.99:0/1290772333 shutdown_connections 2024-02-21T23:11:42.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.257+0000 7fc83aa49740 1 --2- 172.21.15.99:0/1290772333 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x564b06ca7ed0 0x564b06d29410 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:42.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.257+0000 7fc83aa49740 1 --2- 172.21.15.99:0/1290772333 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b06d18b40 0x564b06d21800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:42.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.257+0000 7fc83aa49740 1 --2- 172.21.15.99:0/1290772333 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b06d18180 0x564b06d11b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:42.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.257+0000 7fc83aa49740 1 --2- 172.21.15.99:0/1290772333 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564b06d12bf0 0x564b06d212a0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:42.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.257+0000 7fc83aa49740 1 -- 172.21.15.99:0/1290772333 >> 172.21.15.99:0/1290772333 conn(0x564b06cdd4b0 msgr2=0x564b06d68210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:11:42.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.257+0000 7fc816000640 0 client.6951 ms_handle_reset on v2:172.21.15.99:6836/1676159950 2024-02-21T23:11:42.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.257+0000 7fc83aa49740 1 -- 172.21.15.99:0/1290772333 shutdown_connections 2024-02-21T23:11:42.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.258+0000 7fc83aa49740 1 -- 172.21.15.99:0/1290772333 wait complete. 2024-02-21T23:11:42.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.258+0000 7fc83aa49740 20 client.6951 trim_cache size 0 max 16384 2024-02-21T23:11:42.254 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-02-21T23:11:42.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.258+0000 7fc837c00640 1 -- 172.21.15.99:0/1910135470 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fc81009eed0 msgr2=0x7fc8100a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:42.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.258+0000 7fc837c00640 1 --2- 172.21.15.99:0/1910135470 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fc81009eed0 0x7fc8100a1390 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc81c036000 tx=0x7fc81c03d040 comp rx=0 tx=0).stop 2024-02-21T23:11:42.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.258+0000 7fc837c00640 1 -- 172.21.15.99:0/1910135470 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8300d4320 msgr2=0x7fc830171e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:42.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.258+0000 7fc837c00640 1 --2- 172.21.15.99:0/1910135470 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8300d4320 0x7fc830171e40 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fc82400c4d0 tx=0x7fc82400c990 comp rx=0 tx=0).stop 2024-02-21T23:11:42.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.259+0000 7fc837c00640 1 -- 172.21.15.99:0/1910135470 shutdown_connections 2024-02-21T23:11:42.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.259+0000 7fc837c00640 1 --2- 172.21.15.99:0/1910135470 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fc81009eed0 0x7fc8100a1390 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:42.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.259+0000 7fc837c00640 1 --2- 172.21.15.99:0/1910135470 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc8301867e0 0x7fc8301847a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:42.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.259+0000 7fc837c00640 1 --2- 172.21.15.99:0/1910135470 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc830186400 0x7fc830178b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:42.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.259+0000 7fc837c00640 1 --2- 172.21.15.99:0/1910135470 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8300d4320 0x7fc830171e40 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:42.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.259+0000 7fc837c00640 1 -- 172.21.15.99:0/1910135470 >> 172.21.15.99:0/1910135470 conn(0x7fc8300d6af0 msgr2=0x7fc83018b420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:11:42.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.259+0000 7fc837c00640 1 -- 172.21.15.99:0/1910135470 shutdown_connections 2024-02-21T23:11:42.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.259+0000 7fc837c00640 1 -- 172.21.15.99:0/1910135470 wait complete. 2024-02-21T23:11:42.265 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T23:11:42.265 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-02-21T23:11:42.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.507+0000 7fcbf7200640 1 Processor -- start 2024-02-21T23:11:42.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.507+0000 7fcbf7200640 1 -- start start 2024-02-21T23:11:42.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.510+0000 7fcbf7200640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fcbf80f5c10 0x7fcbf80cc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:42.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.510+0000 7fcbf7200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbf8187800 con 0x7fcbf8180ab0 2024-02-21T23:11:42.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.510+0000 7fcbf7200640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbf80f6610 con 0x7fcbf81893b0 2024-02-21T23:11:42.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.510+0000 7fcbf7200640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbf8188810 con 0x7fcbf80f5c10 2024-02-21T23:11:42.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.510+0000 7fcbf5e00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fcbf8180ab0 0x7fcbf8188ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:44844/0 (socket says 172.21.15.99:44844) 2024-02-21T23:11:42.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.510+0000 7fcbf5e00640 1 -- 172.21.15.99:0/3962065990 learned_addr learned my addr 172.21.15.99:0/3962065990 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:11:42.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.510+0000 7fcbf6800640 1 --2- 172.21.15.99:0/3962065990 >> v2:172.21.15.181:3300/0 conn(0x7fcbf80f5c10 0x7fcbf80cc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:42.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.511+0000 7fcbf4a00640 1 -- 172.21.15.99:0/3962065990 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1672270699 0 0) 0x7fcbf8187800 con 0x7fcbf8180ab0 2024-02-21T23:11:42.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.511+0000 7fcbf6800640 1 -- 172.21.15.99:0/3962065990 >> v1:172.21.15.181:6789/0 conn(0x7fcbf81893b0 legacy=0x7fcbf80cc2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:42.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.511+0000 7fcbf6800640 1 -- 172.21.15.99:0/3962065990 >> v1:172.21.15.99:6789/0 conn(0x7fcbf8180ab0 legacy=0x7fcbf8188ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:42.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.511+0000 7fcbf6800640 1 -- 172.21.15.99:0/3962065990 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbf8187ee0 con 0x7fcbf80f5c10 2024-02-21T23:11:42.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.513+0000 7fcbf6800640 1 --2- 172.21.15.99:0/3962065990 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcbf80f5c10 0x7fcbf80cc9c0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fcbf0009d90 tx=0x7fcbf002be20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=196ecadc8bd5d4fa server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:42.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.513+0000 7fcbf4a00640 1 -- 172.21.15.99:0/3962065990 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf0039070 con 0x7fcbf80f5c10 2024-02-21T23:11:42.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.513+0000 7fcbf4a00640 1 -- 172.21.15.99:0/3962065990 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbf002cbd0 con 0x7fcbf80f5c10 2024-02-21T23:11:42.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.513+0000 7fcbf4a00640 1 -- 172.21.15.99:0/3962065990 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf0034440 con 0x7fcbf80f5c10 2024-02-21T23:11:42.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.514+0000 7fcbf7200640 1 -- 172.21.15.99:0/3962065990 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcbf80f5c10 msgr2=0x7fcbf80cc9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:42.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.514+0000 7fcbf7200640 1 --2- 172.21.15.99:0/3962065990 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcbf80f5c10 0x7fcbf80cc9c0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fcbf0009d90 tx=0x7fcbf002be20 comp rx=0 tx=0).stop 2024-02-21T23:11:42.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.514+0000 7fcbf7200640 1 -- 172.21.15.99:0/3962065990 shutdown_connections 2024-02-21T23:11:42.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.514+0000 7fcbf7200640 1 --2- 172.21.15.99:0/3962065990 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcbf80f5c10 0x7fcbf80cc9c0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:42.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.514+0000 7fcbf7200640 1 -- 172.21.15.99:0/3962065990 >> 172.21.15.99:0/3962065990 conn(0x7fcbf80ce4b0 msgr2=0x7fcbf80ce8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:11:42.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.514+0000 7fcbf7200640 1 -- 172.21.15.99:0/3962065990 shutdown_connections 2024-02-21T23:11:42.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.514+0000 7fcbf7200640 1 -- 172.21.15.99:0/3962065990 wait complete. 2024-02-21T23:11:42.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.516+0000 7fcbf7200640 1 Processor -- start 2024-02-21T23:11:42.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.516+0000 7fcbf7200640 1 -- start start 2024-02-21T23:11:42.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.517+0000 7fcbf7200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcbf80f5c10 0x7fcbf8169f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:42.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.517+0000 7fcbf7200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcbf8180ab0 0x7fcbf821f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:42.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.517+0000 7fcbf7200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcbf81893b0 0x7fcbf8221d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:42.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.517+0000 7fcbf7200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf8189830 con 0x7fcbf8180ab0 2024-02-21T23:11:42.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.517+0000 7fcbf7200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf81884a0 con 0x7fcbf80f5c10 2024-02-21T23:11:42.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.517+0000 7fcbf7200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf80f6060 con 0x7fcbf81893b0 2024-02-21T23:11:42.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.517+0000 7fcbf5400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcbf8180ab0 0x7fcbf821f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:42.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.518+0000 7fcbf5400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcbf8180ab0 0x7fcbf821f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:43368/0 (socket says 172.21.15.99:43368) 2024-02-21T23:11:42.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.518+0000 7fcbf5400640 1 -- 172.21.15.99:0/1380179252 learned_addr learned my addr 172.21.15.99:0/1380179252 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:11:42.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.518+0000 7fcbf5e00640 1 --2- 172.21.15.99:0/1380179252 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcbf80f5c10 0x7fcbf8169f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:42.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.518+0000 7fcbf6800640 1 --2- 172.21.15.99:0/1380179252 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcbf81893b0 0x7fcbf8221d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:42.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.518+0000 7fcbf5400640 1 -- 172.21.15.99:0/1380179252 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcbf81893b0 msgr2=0x7fcbf8221d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:42.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.518+0000 7fcbf5400640 1 --2- 172.21.15.99:0/1380179252 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcbf81893b0 0x7fcbf8221d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:42.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.518+0000 7fcbf5400640 1 -- 172.21.15.99:0/1380179252 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcbf80f5c10 msgr2=0x7fcbf8169f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:42.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.518+0000 7fcbf5400640 1 --2- 172.21.15.99:0/1380179252 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcbf80f5c10 0x7fcbf8169f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:42.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.518+0000 7fcbf5400640 1 -- 172.21.15.99:0/1380179252 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbf8220980 con 0x7fcbf8180ab0 2024-02-21T23:11:42.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.518+0000 7fcbf5400640 1 --2- 172.21.15.99:0/1380179252 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcbf8180ab0 0x7fcbf821f9d0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fcbe400c3f0 tx=0x7fcbe400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:42.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.519+0000 7fcbee000640 1 -- 172.21.15.99:0/1380179252 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe40052d0 con 0x7fcbf8180ab0 2024-02-21T23:11:42.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.519+0000 7fcbee000640 1 -- 172.21.15.99:0/1380179252 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbe4005490 con 0x7fcbf8180ab0 2024-02-21T23:11:42.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.519+0000 7fcbf7200640 1 -- 172.21.15.99:0/1380179252 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbf8220c60 con 0x7fcbf8180ab0 2024-02-21T23:11:42.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.519+0000 7fcbee000640 1 -- 172.21.15.99:0/1380179252 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe4007260 con 0x7fcbf8180ab0 2024-02-21T23:11:42.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.519+0000 7fcbf7200640 1 -- 172.21.15.99:0/1380179252 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbf8221220 con 0x7fcbf8180ab0 2024-02-21T23:11:42.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.523+0000 7fcbee000640 1 -- 172.21.15.99:0/1380179252 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7fcbe4007400 con 0x7fcbf8180ab0 2024-02-21T23:11:42.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.525+0000 7fcbee000640 1 --2- 172.21.15.99:0/1380179252 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fcbd809eed0 0x7fcbd80a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:42.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.525+0000 7fcbff97c740 1 Processor -- start 2024-02-21T23:11:42.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.525+0000 7fcbee000640 1 -- 172.21.15.99:0/1380179252 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 8877+0+0 (secure 0 0 0) 0x7fcbe40c92d0 con 0x7fcbf8180ab0 2024-02-21T23:11:42.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.525+0000 7fcbff97c740 1 -- start start 2024-02-21T23:11:42.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.525+0000 7fcbf5e00640 1 --2- 172.21.15.99:0/1380179252 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fcbd809eed0 0x7fcbd80a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:42.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.526+0000 7fcbf5e00640 1 --2- 172.21.15.99:0/1380179252 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fcbd809eed0 0x7fcbd80a1390 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fcbe8000f60 tx=0x7fcbe8007d50 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:42.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.527+0000 7fcbff97c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558b35db0660 0x558b35db0a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:42.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.527+0000 7fcbff97c740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558b35deb330 0x558b35deb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:42.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.527+0000 7fcbff97c740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558b35debcf0 0x558b35dec560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:42.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.527+0000 7fcbff97c740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b35cd8b50 con 0x558b35deb330 2024-02-21T23:11:42.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.527+0000 7fcbff97c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b35c81da0 con 0x558b35db0660 2024-02-21T23:11:42.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.527+0000 7fcbff97c740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b35cd4bf0 con 0x558b35debcf0 2024-02-21T23:11:42.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.527+0000 7fcbf5e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558b35db0660 0x558b35db0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:42.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.527+0000 7fcbf5e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558b35db0660 0x558b35db0a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:39106/0 (socket says 172.21.15.99:39106) 2024-02-21T23:11:42.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.527+0000 7fcbf5e00640 1 -- 172.21.15.99:0/4195312987 learned_addr learned my addr 172.21.15.99:0/4195312987 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:11:42.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.527+0000 7fcbf5400640 1 --2- 172.21.15.99:0/4195312987 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558b35deb330 0x558b35deb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:42.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.527+0000 7fcbf6800640 1 --2- 172.21.15.99:0/4195312987 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558b35debcf0 0x558b35dec560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:42.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.527+0000 7fcbf5e00640 1 -- 172.21.15.99:0/4195312987 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558b35debcf0 msgr2=0x558b35dec560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:42.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.527+0000 7fcbf5e00640 1 --2- 172.21.15.99:0/4195312987 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558b35debcf0 0x558b35dec560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:42.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.527+0000 7fcbf5e00640 1 -- 172.21.15.99:0/4195312987 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558b35deb330 msgr2=0x558b35deb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:42.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.527+0000 7fcbf5e00640 1 --2- 172.21.15.99:0/4195312987 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558b35deb330 0x558b35deb7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:42.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.528+0000 7fcbf5e00640 1 -- 172.21.15.99:0/4195312987 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558b35ca4f80 con 0x558b35db0660 2024-02-21T23:11:42.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.528+0000 7fcbf5e00640 1 --2- 172.21.15.99:0/4195312987 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558b35db0660 0x558b35db0a40 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fcbe8001920 tx=0x7fcbe8013000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5bbf7e77831319c0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:42.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.528+0000 7fcbe2600640 1 -- 172.21.15.99:0/4195312987 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe8026070 con 0x558b35db0660 2024-02-21T23:11:42.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.531+0000 7fcbe2600640 1 -- 172.21.15.99:0/4195312987 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbe8013b80 con 0x558b35db0660 2024-02-21T23:11:42.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.531+0000 7fcbe2600640 1 -- 172.21.15.99:0/4195312987 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe8012350 con 0x558b35db0660 2024-02-21T23:11:42.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.532+0000 7fcbff97c740 1 -- 172.21.15.99:0/4195312987 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558b35db0660 msgr2=0x558b35db0a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:42.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.532+0000 7fcbff97c740 1 --2- 172.21.15.99:0/4195312987 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558b35db0660 0x558b35db0a40 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fcbe8001920 tx=0x7fcbe8013000 comp rx=0 tx=0).stop 2024-02-21T23:11:42.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.532+0000 7fcbff97c740 1 -- 172.21.15.99:0/4195312987 shutdown_connections 2024-02-21T23:11:42.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.532+0000 7fcbff97c740 1 --2- 172.21.15.99:0/4195312987 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558b35debcf0 0x558b35dec560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:42.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.532+0000 7fcbff97c740 1 --2- 172.21.15.99:0/4195312987 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558b35deb330 0x558b35deb7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:42.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.532+0000 7fcbff97c740 1 --2- 172.21.15.99:0/4195312987 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558b35db0660 0x558b35db0a40 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:42.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.532+0000 7fcbff97c740 1 -- 172.21.15.99:0/4195312987 >> 172.21.15.99:0/4195312987 conn(0x558b35d726d0 msgr2=0x558b35d73750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:11:42.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.532+0000 7fcbff97c740 1 -- 172.21.15.99:0/4195312987 shutdown_connections 2024-02-21T23:11:42.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.532+0000 7fcbff97c740 1 -- 172.21.15.99:0/4195312987 wait complete. 2024-02-21T23:11:42.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.533+0000 7fcbff97c740 1 -- start start 2024-02-21T23:11:42.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.533+0000 7fcbff97c740 1 Processor -- start 2024-02-21T23:11:42.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.534+0000 7fcbff97c740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558b35deb330 0x558b35d708f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:42.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.534+0000 7fcbff97c740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558b35debcf0 0x558b35db91f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:42.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.534+0000 7fcbff97c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558b35da58c0 0x558b35db9970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:42.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.534+0000 7fcbff97c740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b35dea0a0 con 0x558b35deb330 2024-02-21T23:11:42.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.534+0000 7fcbff97c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b35c77380 con 0x558b35da58c0 2024-02-21T23:11:42.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.534+0000 7fcbff97c740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b35de9dc0 con 0x558b35debcf0 2024-02-21T23:11:42.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.535+0000 7fcbff97c740 10 client.0 _ll_register_callbacks cb 0x558b35cd0280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:11:42.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.535+0000 7fcbf5e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558b35deb330 0x558b35d708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:42.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.535+0000 7fcbf5400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558b35debcf0 0x558b35db91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:42.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.535+0000 7fcbf5e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558b35deb330 0x558b35d708f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:43380/0 (socket says 172.21.15.99:43380) 2024-02-21T23:11:42.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.535+0000 7fcbf5e00640 1 -- 172.21.15.99:0/1653946712 learned_addr learned my addr 172.21.15.99:0/1653946712 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:11:42.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.535+0000 7fcbf6800640 1 --2- 172.21.15.99:0/1653946712 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558b35da58c0 0x558b35db9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:42.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.535+0000 7fcbf5400640 1 -- 172.21.15.99:0/1653946712 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558b35da58c0 msgr2=0x558b35db9970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:42.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.535+0000 7fcbf5400640 1 --2- 172.21.15.99:0/1653946712 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558b35da58c0 0x558b35db9970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:42.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.535+0000 7fcbf5400640 1 -- 172.21.15.99:0/1653946712 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558b35deb330 msgr2=0x558b35d708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:42.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.535+0000 7fcbf5400640 1 --2- 172.21.15.99:0/1653946712 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558b35deb330 0x558b35d708f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:42.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.535+0000 7fcbf5400640 1 -- 172.21.15.99:0/1653946712 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558b35c9fc20 con 0x558b35debcf0 2024-02-21T23:11:42.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.536+0000 7fcbf5400640 1 --2- 172.21.15.99:0/1653946712 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558b35debcf0 0x558b35db91f0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fcbe40c69d0 tx=0x7fcbe4096cb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f0e76df61042335 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:42.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.536+0000 7fcbd6a00640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-02-21T23:11:42.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.536+0000 7fcbd6a00640 1 -- 172.21.15.99:0/1653946712 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe40932a0 con 0x558b35debcf0 2024-02-21T23:11:42.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.536+0000 7fcbff97c740 1 -- 172.21.15.99:0/1653946712 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcbe8013b80 con 0x558b35debcf0 2024-02-21T23:11:42.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.536+0000 7fcbd6a00640 1 -- 172.21.15.99:0/1653946712 <== mon.2 v2:172.21.15.181:3300/0 2 ==== osd_map(38..38 src has 1..38) v4 ==== 8877+0+0 (secure 0 0 0) 0x7fcbe40aabd0 con 0x558b35debcf0 2024-02-21T23:11:42.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.536+0000 7fcbd6a00640 1 -- 172.21.15.99:0/1653946712 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcbe4093440 con 0x558b35debcf0 2024-02-21T23:11:42.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.536+0000 7fcbff97c740 10 client.7103 fetch_fsmap learned FSMap version 17 2024-02-21T23:11:42.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.536+0000 7fcbff97c740 1 -- 172.21.15.99:0/1653946712 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x558b359ed3f0 con 0x558b35debcf0 2024-02-21T23:11:42.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.536+0000 7fcbd6a00640 1 -- 172.21.15.99:0/1653946712 <== mon.2 v2:172.21.15.181:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbe8013b80 con 0x558b35debcf0 2024-02-21T23:11:42.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.537+0000 7fcbd6a00640 1 -- 172.21.15.99:0/1653946712 <== mon.2 v2:172.21.15.181:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fcbe4096080 con 0x558b35debcf0 2024-02-21T23:11:42.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.537+0000 7fcbff97c740 10 client.7103 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:11:42.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.537+0000 7fcbff97c740 10 client.7103 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:11:42.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.537+0000 7fcbff97c740 20 client.7103 populate_metadata read hostname 'smithi099' 2024-02-21T23:11:42.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.537+0000 7fcbff97c740 1 --2- 172.21.15.99:0/1653946712 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x558b35df5250 0x558b35df7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:42.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.537+0000 7fcbff97c740 4 client.7103 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:11:42.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.537+0000 7fcbff97c740 1 -- 172.21.15.99:0/1653946712 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558b35ce6090 con 0x558b35df5250 2024-02-21T23:11:42.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.537+0000 7fcbf5e00640 1 --2- 172.21.15.99:0/1653946712 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x558b35df5250 0x558b35df7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:42.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.538+0000 7fcbf5e00640 1 --2- 172.21.15.99:0/1653946712 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x558b35df5250 0x558b35df7dc0 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d43e135b9ddcd525 server_cookie=b6010642a2829e9a in_seq=0 out_seq=0 2024-02-21T23:11:42.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.538+0000 7fcbd6a00640 10 client.7103 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:11:42.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.539+0000 7fcbd6a00640 1 -- 172.21.15.99:0/1653946712 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x558b35ce6090 con 0x558b35df5250 2024-02-21T23:11:42.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.539+0000 7fcbd6a00640 10 client.7103 handle_command_reply: tid=0 2024-02-21T23:11:42.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.539+0000 7fcbff97c740 1 client.7103 shutdown 2024-02-21T23:11:42.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.539+0000 7fcbff97c740 1 -- 172.21.15.99:0/1653946712 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558b35debcf0 msgr2=0x558b35db91f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:42.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.539+0000 7fcbff97c740 1 --2- 172.21.15.99:0/1653946712 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558b35debcf0 0x558b35db91f0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fcbe40c69d0 tx=0x7fcbe4096cb0 comp rx=0 tx=0).stop 2024-02-21T23:11:42.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.539+0000 7fcbff97c740 1 -- 172.21.15.99:0/1653946712 shutdown_connections 2024-02-21T23:11:42.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.539+0000 7fcbff97c740 1 --2- 172.21.15.99:0/1653946712 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x558b35df5250 0x558b35df7dc0 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:42.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.539+0000 7fcbff97c740 1 --2- 172.21.15.99:0/1653946712 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558b35da58c0 0x558b35db9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:42.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.539+0000 7fcbff97c740 1 --2- 172.21.15.99:0/1653946712 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558b35debcf0 0x558b35db91f0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:42.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.539+0000 7fcbff97c740 1 --2- 172.21.15.99:0/1653946712 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558b35deb330 0x558b35d708f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:42.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.539+0000 7fcbff97c740 1 -- 172.21.15.99:0/1653946712 >> 172.21.15.99:0/1653946712 conn(0x558b35db0660 msgr2=0x558b35dea7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:11:42.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.539+0000 7fcbd6a00640 0 client.7103 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:11:42.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.539+0000 7fcbff97c740 1 -- 172.21.15.99:0/1653946712 shutdown_connections 2024-02-21T23:11:42.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.539+0000 7fcbff97c740 1 -- 172.21.15.99:0/1653946712 wait complete. 2024-02-21T23:11:42.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.540+0000 7fcbff97c740 20 client.7103 trim_cache size 0 max 16384 2024-02-21T23:11:42.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.566+0000 7fcbff97c740 1 Processor -- start 2024-02-21T23:11:42.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.567+0000 7fcbff97c740 1 -- start start 2024-02-21T23:11:42.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.568+0000 7fcbff97c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558b35da58c0 0x558b35db5e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:42.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.568+0000 7fcbff97c740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558b35deb330 0x558b35d6a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:42.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.568+0000 7fcbff97c740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558b35debcf0 0x558b35db89b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:42.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.568+0000 7fcbff97c740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf822c8d0 con 0x558b35debcf0 2024-02-21T23:11:42.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.568+0000 7fcbff97c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf822a470 con 0x558b35da58c0 2024-02-21T23:11:42.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.568+0000 7fcbff97c740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf814c6e0 con 0x558b35deb330 2024-02-21T23:11:42.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.569+0000 7fcbf5e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558b35da58c0 0x558b35db5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:42.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.569+0000 7fcbf6800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558b35debcf0 0x558b35db89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:42.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.569+0000 7fcbf5e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558b35da58c0 0x558b35db5e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:39120/0 (socket says 172.21.15.99:39120) 2024-02-21T23:11:42.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.569+0000 7fcbf5e00640 1 -- 172.21.15.99:0/2034439826 learned_addr learned my addr 172.21.15.99:0/2034439826 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:11:42.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.569+0000 7fcbf5400640 1 --2- 172.21.15.99:0/2034439826 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558b35deb330 0x558b35d6a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:42.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.569+0000 7fcbf5e00640 1 -- 172.21.15.99:0/2034439826 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558b35deb330 msgr2=0x558b35d6a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:42.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.569+0000 7fcbf5e00640 1 --2- 172.21.15.99:0/2034439826 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558b35deb330 0x558b35d6a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:42.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.569+0000 7fcbf5e00640 1 -- 172.21.15.99:0/2034439826 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558b35debcf0 msgr2=0x558b35db89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:42.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.569+0000 7fcbf5e00640 1 --2- 172.21.15.99:0/2034439826 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558b35debcf0 0x558b35db89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:42.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.569+0000 7fcbf5e00640 1 -- 172.21.15.99:0/2034439826 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558b35ab77d0 con 0x558b35da58c0 2024-02-21T23:11:42.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.570+0000 7fcbf5e00640 1 --2- 172.21.15.99:0/2034439826 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558b35da58c0 0x558b35db5e50 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fcbe80011e0 tx=0x7fcbe8014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4ad9ade50720a76 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:42.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.570+0000 7fcbe1c00640 1 -- 172.21.15.99:0/2034439826 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe8037070 con 0x558b35da58c0 2024-02-21T23:11:42.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.570+0000 7fcbe1c00640 1 -- 172.21.15.99:0/2034439826 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbe8027040 con 0x558b35da58c0 2024-02-21T23:11:42.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.570+0000 7fcbe1c00640 1 -- 172.21.15.99:0/2034439826 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe8026040 con 0x558b35da58c0 2024-02-21T23:11:42.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.571+0000 7fcbff97c740 1 -- 172.21.15.99:0/2034439826 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558b35da58c0 msgr2=0x558b35db5e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:42.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.571+0000 7fcbff97c740 1 --2- 172.21.15.99:0/2034439826 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558b35da58c0 0x558b35db5e50 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fcbe80011e0 tx=0x7fcbe8014000 comp rx=0 tx=0).stop 2024-02-21T23:11:42.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.571+0000 7fcbff97c740 1 -- 172.21.15.99:0/2034439826 shutdown_connections 2024-02-21T23:11:42.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.571+0000 7fcbff97c740 1 --2- 172.21.15.99:0/2034439826 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558b35debcf0 0x558b35db89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:42.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.571+0000 7fcbff97c740 1 --2- 172.21.15.99:0/2034439826 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558b35deb330 0x558b35d6a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:42.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.571+0000 7fcbff97c740 1 --2- 172.21.15.99:0/2034439826 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558b35da58c0 0x558b35db5e50 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:42.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.571+0000 7fcbff97c740 1 -- 172.21.15.99:0/2034439826 >> 172.21.15.99:0/2034439826 conn(0x558b35db0660 msgr2=0x558b35dbbe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:11:42.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.571+0000 7fcbff97c740 1 -- 172.21.15.99:0/2034439826 shutdown_connections 2024-02-21T23:11:42.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.571+0000 7fcbff97c740 1 -- 172.21.15.99:0/2034439826 wait complete. 2024-02-21T23:11:42.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.572+0000 7fcbff97c740 1 -- start start 2024-02-21T23:11:42.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.572+0000 7fcbff97c740 1 Processor -- start 2024-02-21T23:11:42.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.575+0000 7fcbff97c740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558b35da58c0 0x558b35db52e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:42.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.575+0000 7fcbff97c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558b35deb330 0x558b35db5e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:42.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.575+0000 7fcbff97c740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558b35debcf0 0x558b35e517f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:42.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.575+0000 7fcbff97c740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf814cce0 con 0x558b35da58c0 2024-02-21T23:11:42.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.575+0000 7fcbff97c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf8229e10 con 0x558b35deb330 2024-02-21T23:11:42.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.575+0000 7fcbff97c740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf8229190 con 0x558b35debcf0 2024-02-21T23:11:42.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.575+0000 7fcbff97c740 10 client.0 _ll_register_callbacks cb 0x7fcbe400c340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:11:42.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.575+0000 7fcbf6800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558b35debcf0 0x558b35e517f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:42.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.575+0000 7fcbf5e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558b35da58c0 0x558b35db52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:42.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.575+0000 7fcbf6800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558b35debcf0 0x558b35e517f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:46630/0 (socket says 172.21.15.99:46630) 2024-02-21T23:11:42.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.575+0000 7fcbf6800640 1 -- 172.21.15.99:0/3506116727 learned_addr learned my addr 172.21.15.99:0/3506116727 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:11:42.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.575+0000 7fcbf5400640 1 --2- 172.21.15.99:0/3506116727 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558b35deb330 0x558b35db5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:42.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.575+0000 7fcbf6800640 1 -- 172.21.15.99:0/3506116727 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558b35deb330 msgr2=0x558b35db5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:42.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.575+0000 7fcbf6800640 1 --2- 172.21.15.99:0/3506116727 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558b35deb330 0x558b35db5e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:42.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.575+0000 7fcbf6800640 1 -- 172.21.15.99:0/3506116727 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558b35da58c0 msgr2=0x558b35db52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:42.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.575+0000 7fcbf6800640 1 --2- 172.21.15.99:0/3506116727 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558b35da58c0 0x558b35db52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:42.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.575+0000 7fcbf6800640 1 -- 172.21.15.99:0/3506116727 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558b35dbea80 con 0x558b35debcf0 2024-02-21T23:11:42.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.575+0000 7fcbf5400640 1 --2- 172.21.15.99:0/3506116727 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558b35deb330 0x558b35db5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:11:42.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.576+0000 7fcbf6800640 1 --2- 172.21.15.99:0/3506116727 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558b35debcf0 0x558b35e517f0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fcbf0009eb0 tx=0x7fcbf002e070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=912e06e904d99ad0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:42.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.576+0000 7fcbd6a00640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-02-21T23:11:42.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.576+0000 7fcbd6a00640 1 -- 172.21.15.99:0/3506116727 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf0050060 con 0x558b35debcf0 2024-02-21T23:11:42.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.576+0000 7fcbff97c740 1 -- 172.21.15.99:0/3506116727 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcbe8027040 con 0x558b35debcf0 2024-02-21T23:11:42.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.576+0000 7fcbd6a00640 1 -- 172.21.15.99:0/3506116727 <== mon.2 v2:172.21.15.181:3300/0 2 ==== osd_map(38..38 src has 1..38) v4 ==== 8877+0+0 (secure 0 0 0) 0x7fcbf0041e00 con 0x558b35debcf0 2024-02-21T23:11:42.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.576+0000 7fcbd6a00640 1 -- 172.21.15.99:0/3506116727 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcbf0057050 con 0x558b35debcf0 2024-02-21T23:11:42.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.577+0000 7fcbff97c740 10 client.7109 fetch_fsmap learned FSMap version 17 2024-02-21T23:11:42.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.577+0000 7fcbff97c740 1 -- 172.21.15.99:0/3506116727 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x558b35df59b0 con 0x558b35debcf0 2024-02-21T23:11:42.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.577+0000 7fcbd6a00640 1 -- 172.21.15.99:0/3506116727 <== mon.2 v2:172.21.15.181:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbe8027040 con 0x558b35debcf0 2024-02-21T23:11:42.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.577+0000 7fcbd6a00640 1 -- 172.21.15.99:0/3506116727 <== mon.2 v2:172.21.15.181:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fcbf004b440 con 0x558b35debcf0 2024-02-21T23:11:42.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.577+0000 7fcbff97c740 10 client.7109 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:11:42.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.577+0000 7fcbff97c740 10 client.7109 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:11:42.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.577+0000 7fcbff97c740 20 client.7109 populate_metadata read hostname 'smithi099' 2024-02-21T23:11:42.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.577+0000 7fcbff97c740 1 --2- 172.21.15.99:0/3506116727 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x558b35d70610 0x558b35e575c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:42.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.577+0000 7fcbff97c740 4 client.7109 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T23:11:42.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.577+0000 7fcbff97c740 1 -- 172.21.15.99:0/3506116727 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x558b35d72e30 con 0x558b35d70610 2024-02-21T23:11:42.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.578+0000 7fcbf5e00640 1 --2- 172.21.15.99:0/3506116727 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x558b35d70610 0x558b35e575c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:42.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.578+0000 7fcbf5e00640 1 --2- 172.21.15.99:0/3506116727 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x558b35d70610 0x558b35e575c0 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af6d1a4009fb17a2 server_cookie=6d011fb2158cf782 in_seq=0 out_seq=0 2024-02-21T23:11:42.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.578+0000 7fcbd6a00640 10 client.7109 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:11:42.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.578+0000 7fcbd6a00640 1 -- 172.21.15.99:0/3506116727 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x558b35d72e30 con 0x558b35d70610 2024-02-21T23:11:42.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.578+0000 7fcbd6a00640 10 client.7109 handle_command_reply: tid=0 2024-02-21T23:11:42.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.578+0000 7fcbff97c740 1 client.7109 shutdown 2024-02-21T23:11:42.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.579+0000 7fcbff97c740 1 -- 172.21.15.99:0/3506116727 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558b35debcf0 msgr2=0x558b35e517f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:42.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.579+0000 7fcbff97c740 1 --2- 172.21.15.99:0/3506116727 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558b35debcf0 0x558b35e517f0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fcbf0009eb0 tx=0x7fcbf002e070 comp rx=0 tx=0).stop 2024-02-21T23:11:42.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.579+0000 7fcbff97c740 1 -- 172.21.15.99:0/3506116727 shutdown_connections 2024-02-21T23:11:42.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.579+0000 7fcbff97c740 1 --2- 172.21.15.99:0/3506116727 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x558b35d70610 0x558b35e575c0 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:42.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.579+0000 7fcbff97c740 1 --2- 172.21.15.99:0/3506116727 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x558b35debcf0 0x558b35e517f0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:42.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.579+0000 7fcbff97c740 1 --2- 172.21.15.99:0/3506116727 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x558b35deb330 0x558b35db5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:42.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.579+0000 7fcbff97c740 1 --2- 172.21.15.99:0/3506116727 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x558b35da58c0 0x558b35db52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:42.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.579+0000 7fcbd6a00640 0 client.7109 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:11:42.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.579+0000 7fcbff97c740 1 -- 172.21.15.99:0/3506116727 >> 172.21.15.99:0/3506116727 conn(0x558b35db0660 msgr2=0x558b35dea480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:11:42.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.579+0000 7fcbff97c740 1 -- 172.21.15.99:0/3506116727 shutdown_connections 2024-02-21T23:11:42.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.579+0000 7fcbff97c740 1 -- 172.21.15.99:0/3506116727 wait complete. 2024-02-21T23:11:42.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.579+0000 7fcbff97c740 20 client.7109 trim_cache size 0 max 16384 2024-02-21T23:11:42.573 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-02-21T23:11:42.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.580+0000 7fcbf7200640 1 -- 172.21.15.99:0/1380179252 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fcbd809eed0 msgr2=0x7fcbd80a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:42.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.580+0000 7fcbf7200640 1 --2- 172.21.15.99:0/1380179252 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fcbd809eed0 0x7fcbd80a1390 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fcbe8000f60 tx=0x7fcbe8007d50 comp rx=0 tx=0).stop 2024-02-21T23:11:42.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.580+0000 7fcbf7200640 1 -- 172.21.15.99:0/1380179252 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcbf8180ab0 msgr2=0x7fcbf821f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:42.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.580+0000 7fcbf7200640 1 --2- 172.21.15.99:0/1380179252 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcbf8180ab0 0x7fcbf821f9d0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fcbe400c3f0 tx=0x7fcbe400c8b0 comp rx=0 tx=0).stop 2024-02-21T23:11:42.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.580+0000 7fcbf7200640 1 -- 172.21.15.99:0/1380179252 shutdown_connections 2024-02-21T23:11:42.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.580+0000 7fcbf7200640 1 --2- 172.21.15.99:0/1380179252 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fcbd809eed0 0x7fcbd80a1390 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:42.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.580+0000 7fcbf7200640 1 --2- 172.21.15.99:0/1380179252 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fcbf81893b0 0x7fcbf8221d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:42.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.580+0000 7fcbf7200640 1 --2- 172.21.15.99:0/1380179252 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fcbf8180ab0 0x7fcbf821f9d0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:42.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.580+0000 7fcbf7200640 1 --2- 172.21.15.99:0/1380179252 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcbf80f5c10 0x7fcbf8169f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:42.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.580+0000 7fcbf7200640 1 -- 172.21.15.99:0/1380179252 >> 172.21.15.99:0/1380179252 conn(0x7fcbf80ce4b0 msgr2=0x7fcbf818a660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:11:42.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.580+0000 7fcbf7200640 1 -- 172.21.15.99:0/1380179252 shutdown_connections 2024-02-21T23:11:42.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:42.580+0000 7fcbf7200640 1 -- 172.21.15.99:0/1380179252 wait complete. 2024-02-21T23:11:43.587 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-02-21T23:11:43.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T23:11:43.587 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-02-21T23:11:43.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.824+0000 7efe13200640 1 Processor -- start 2024-02-21T23:11:43.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.824+0000 7efe13200640 1 -- start start 2024-02-21T23:11:43.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.827+0000 7efe13200640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7efe14186640 0x7efe1406f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:43.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.827+0000 7efe13200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7efe1418a920 0x7efe14188da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:43.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.827+0000 7efe13200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe14186a20 con 0x7efe1406f770 2024-02-21T23:11:43.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.827+0000 7efe13200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe14071810 con 0x7efe1418a920 2024-02-21T23:11:43.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.827+0000 7efe13200640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe140f6c00 con 0x7efe14186640 2024-02-21T23:11:43.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.827+0000 7efe12800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7efe1418a920 0x7efe14188da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:43.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.827+0000 7efe0be00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7efe1406f770 0x7efe1418a210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.99:50266/0 (socket says 172.21.15.99:50266) 2024-02-21T23:11:43.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.827+0000 7efe12800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7efe1418a920 0x7efe14188da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:43400/0 (socket says 172.21.15.99:43400) 2024-02-21T23:11:43.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.828+0000 7efe0be00640 1 -- 172.21.15.99:0/846946362 learned_addr learned my addr 172.21.15.99:0/846946362 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:11:43.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.828+0000 7efe11e00640 1 --2- 172.21.15.99:0/846946362 >> v2:172.21.15.181:3300/0 conn(0x7efe14186640 0x7efe1406f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:43.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.828+0000 7efe11400640 1 -- 172.21.15.99:0/846946362 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2425067135 0 0) 0x7efe14186a20 con 0x7efe1406f770 2024-02-21T23:11:43.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.828+0000 7efe11e00640 1 -- 172.21.15.99:0/846946362 >> v2:172.21.15.99:3300/0 conn(0x7efe1418a920 msgr2=0x7efe14188da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:43.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.828+0000 7efe11e00640 1 --2- 172.21.15.99:0/846946362 >> v2:172.21.15.99:3300/0 conn(0x7efe1418a920 0x7efe14188da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:43.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.828+0000 7efe11e00640 1 -- 172.21.15.99:0/846946362 >> v1:172.21.15.162:6789/0 conn(0x7efe1406f770 legacy=0x7efe1418a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:43.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.828+0000 7efe11e00640 1 -- 172.21.15.99:0/846946362 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe140f7090 con 0x7efe14186640 2024-02-21T23:11:43.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.828+0000 7efe12800640 1 --2- 172.21.15.99:0/846946362 >> v2:172.21.15.99:3300/0 conn(0x7efe1418a920 0x7efe14188da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:11:43.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.830+0000 7efe11e00640 1 --2- 172.21.15.99:0/846946362 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efe14186640 0x7efe1406f230 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7efe140fb990 tx=0x7efe0402b7c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf0fa6d03ce5baf1 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:43.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.830+0000 7efe11400640 1 -- 172.21.15.99:0/846946362 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe04038070 con 0x7efe14186640 2024-02-21T23:11:43.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.830+0000 7efe11400640 1 -- 172.21.15.99:0/846946362 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe04031520 con 0x7efe14186640 2024-02-21T23:11:43.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.830+0000 7efe11400640 1 -- 172.21.15.99:0/846946362 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe040318f0 con 0x7efe14186640 2024-02-21T23:11:43.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.831+0000 7efe13200640 1 -- 172.21.15.99:0/846946362 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efe14186640 msgr2=0x7efe1406f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:43.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.831+0000 7efe13200640 1 --2- 172.21.15.99:0/846946362 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efe14186640 0x7efe1406f230 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7efe140fb990 tx=0x7efe0402b7c0 comp rx=0 tx=0).stop 2024-02-21T23:11:43.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.831+0000 7efe13200640 1 -- 172.21.15.99:0/846946362 shutdown_connections 2024-02-21T23:11:43.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.831+0000 7efe13200640 1 --2- 172.21.15.99:0/846946362 >> v2:172.21.15.99:3300/0 conn(0x7efe1418a920 0x7efe14188da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:43.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.831+0000 7efe13200640 1 --2- 172.21.15.99:0/846946362 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efe14186640 0x7efe1406f230 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:43.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.831+0000 7efe13200640 1 -- 172.21.15.99:0/846946362 >> 172.21.15.99:0/846946362 conn(0x7efe140ced60 msgr2=0x7efe140cf170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:11:43.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.831+0000 7efe13200640 1 -- 172.21.15.99:0/846946362 shutdown_connections 2024-02-21T23:11:43.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.831+0000 7efe13200640 1 -- 172.21.15.99:0/846946362 wait complete. 2024-02-21T23:11:43.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.833+0000 7efe13200640 1 Processor -- start 2024-02-21T23:11:43.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.833+0000 7efe13200640 1 -- start start 2024-02-21T23:11:43.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.834+0000 7efe13200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efe1406f770 0x7efe1417df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:43.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.835+0000 7efe13200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efe14186640 0x7efe140cc370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:43.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.835+0000 7efe13200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efe1418a920 0x7efe140ce120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:43.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.835+0000 7efe13200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe140f62d0 con 0x7efe14186640 2024-02-21T23:11:43.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.835+0000 7efe13200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe140f5ff0 con 0x7efe1406f770 2024-02-21T23:11:43.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.835+0000 7efe13200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe140f65b0 con 0x7efe1418a920 2024-02-21T23:11:43.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.835+0000 7efe0be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efe14186640 0x7efe140cc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:43.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.835+0000 7efe11e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efe1406f770 0x7efe1417df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:43.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.835+0000 7efe0be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efe14186640 0x7efe140cc370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:43408/0 (socket says 172.21.15.99:43408) 2024-02-21T23:11:43.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.835+0000 7efe0be00640 1 -- 172.21.15.99:0/692399396 learned_addr learned my addr 172.21.15.99:0/692399396 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:11:43.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.835+0000 7efe12800640 1 --2- 172.21.15.99:0/692399396 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efe1418a920 0x7efe140ce120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:43.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.835+0000 7efe11e00640 1 -- 172.21.15.99:0/692399396 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efe1418a920 msgr2=0x7efe140ce120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:43.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.835+0000 7efe11e00640 1 --2- 172.21.15.99:0/692399396 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efe1418a920 0x7efe140ce120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:43.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.835+0000 7efe11e00640 1 -- 172.21.15.99:0/692399396 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efe14186640 msgr2=0x7efe140cc370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:43.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.835+0000 7efe11e00640 1 --2- 172.21.15.99:0/692399396 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efe14186640 0x7efe140cc370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:43.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.835+0000 7efe11e00640 1 -- 172.21.15.99:0/692399396 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe1421fd90 con 0x7efe1406f770 2024-02-21T23:11:43.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.836+0000 7efe12800640 1 --2- 172.21.15.99:0/692399396 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efe1418a920 0x7efe140ce120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:11:43.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.836+0000 7efe0be00640 1 --2- 172.21.15.99:0/692399396 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efe14186640 0x7efe140cc370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:11:43.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.836+0000 7efe11e00640 1 --2- 172.21.15.99:0/692399396 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efe1406f770 0x7efe1417df30 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7efe04033000 tx=0x7efe040046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:43.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.836+0000 7efe0a000640 1 -- 172.21.15.99:0/692399396 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe04038040 con 0x7efe1406f770 2024-02-21T23:11:43.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.836+0000 7efe0a000640 1 -- 172.21.15.99:0/692399396 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe04004230 con 0x7efe1406f770 2024-02-21T23:11:43.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.836+0000 7efe0a000640 1 -- 172.21.15.99:0/692399396 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe04006e10 con 0x7efe1406f770 2024-02-21T23:11:43.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.836+0000 7efe13200640 1 -- 172.21.15.99:0/692399396 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe140cd380 con 0x7efe1406f770 2024-02-21T23:11:43.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.836+0000 7efe13200640 1 -- 172.21.15.99:0/692399396 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe140f2ef0 con 0x7efe1406f770 2024-02-21T23:11:43.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.839+0000 7efe0a000640 1 -- 172.21.15.99:0/692399396 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7efe04033840 con 0x7efe1406f770 2024-02-21T23:11:43.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.841+0000 7efe1c1b0740 1 Processor -- start 2024-02-21T23:11:43.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.842+0000 7efe1c1b0740 1 -- start start 2024-02-21T23:11:43.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.842+0000 7efe0a000640 1 --2- 172.21.15.99:0/692399396 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7efdf009eed0 0x7efdf00a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:43.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.842+0000 7efe0a000640 1 -- 172.21.15.99:0/692399396 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 8877+0+0 (secure 0 0 0) 0x7efe040ec010 con 0x7efe1406f770 2024-02-21T23:11:43.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.842+0000 7efe12800640 1 --2- 172.21.15.99:0/692399396 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7efdf009eed0 0x7efdf00a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:43.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.843+0000 7efe12800640 1 --2- 172.21.15.99:0/692399396 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7efdf009eed0 0x7efdf00a1390 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7efe0c003c00 tx=0x7efe0c00b040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:43.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.844+0000 7efe1c1b0740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5647a76754c0 0x5647a76758a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:43.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.844+0000 7efe1c1b0740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5647a7675de0 0x5647a76b0650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:43.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.844+0000 7efe1c1b0740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5647a76b0b90 0x5647a76b1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:43.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.844+0000 7efe1c1b0740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647a759d790 con 0x5647a76754c0 2024-02-21T23:11:43.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.844+0000 7efe1c1b0740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647a7546bf0 con 0x5647a76b0b90 2024-02-21T23:11:43.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.844+0000 7efe1c1b0740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647a7599830 con 0x5647a7675de0 2024-02-21T23:11:43.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.844+0000 7efe11e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5647a76754c0 0x5647a76758a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:43.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.844+0000 7efe12800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5647a76b0b90 0x5647a76b1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:43.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.844+0000 7efe11e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5647a76754c0 0x5647a76758a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:43418/0 (socket says 172.21.15.99:43418) 2024-02-21T23:11:43.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.844+0000 7efe11e00640 1 -- 172.21.15.99:0/1556078714 learned_addr learned my addr 172.21.15.99:0/1556078714 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:11:43.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.844+0000 7efe0be00640 1 --2- 172.21.15.99:0/1556078714 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5647a7675de0 0x5647a76b0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:43.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.844+0000 7efe12800640 1 -- 172.21.15.99:0/1556078714 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5647a7675de0 msgr2=0x5647a76b0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:43.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.844+0000 7efe12800640 1 --2- 172.21.15.99:0/1556078714 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5647a7675de0 0x5647a76b0650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:43.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.844+0000 7efe12800640 1 -- 172.21.15.99:0/1556078714 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5647a76754c0 msgr2=0x5647a76758a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:43.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.844+0000 7efe12800640 1 --2- 172.21.15.99:0/1556078714 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5647a76754c0 0x5647a76758a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:43.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.845+0000 7efe12800640 1 -- 172.21.15.99:0/1556078714 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5647a7564c40 con 0x5647a76b0b90 2024-02-21T23:11:43.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.845+0000 7efe11e00640 1 --2- 172.21.15.99:0/1556078714 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5647a76754c0 0x5647a76758a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:11:43.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.845+0000 7efe12800640 1 --2- 172.21.15.99:0/1556078714 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5647a76b0b90 0x5647a76b1920 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7efe0c00e680 tx=0x7efe0c014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42de59551bfd9cc2 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:43.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.845+0000 7efe02a00640 1 -- 172.21.15.99:0/1556078714 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe0c01b070 con 0x5647a76b0b90 2024-02-21T23:11:43.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.845+0000 7efe02a00640 1 -- 172.21.15.99:0/1556078714 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe0c027070 con 0x5647a76b0b90 2024-02-21T23:11:43.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.845+0000 7efe02a00640 1 -- 172.21.15.99:0/1556078714 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe0c017cd0 con 0x5647a76b0b90 2024-02-21T23:11:43.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.846+0000 7efe1c1b0740 1 -- 172.21.15.99:0/1556078714 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5647a76b0b90 msgr2=0x5647a76b1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:43.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.846+0000 7efe1c1b0740 1 --2- 172.21.15.99:0/1556078714 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5647a76b0b90 0x5647a76b1920 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7efe0c00e680 tx=0x7efe0c014000 comp rx=0 tx=0).stop 2024-02-21T23:11:43.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.846+0000 7efe1c1b0740 1 -- 172.21.15.99:0/1556078714 shutdown_connections 2024-02-21T23:11:43.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.846+0000 7efe1c1b0740 1 --2- 172.21.15.99:0/1556078714 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5647a76b0b90 0x5647a76b1920 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:43.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.846+0000 7efe1c1b0740 1 --2- 172.21.15.99:0/1556078714 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5647a7675de0 0x5647a76b0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:43.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.846+0000 7efe1c1b0740 1 --2- 172.21.15.99:0/1556078714 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5647a76754c0 0x5647a76758a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:43.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.846+0000 7efe1c1b0740 1 -- 172.21.15.99:0/1556078714 >> 172.21.15.99:0/1556078714 conn(0x5647a7637a90 msgr2=0x5647a7638b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:11:43.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.846+0000 7efe1c1b0740 1 -- 172.21.15.99:0/1556078714 shutdown_connections 2024-02-21T23:11:43.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.846+0000 7efe1c1b0740 1 -- 172.21.15.99:0/1556078714 wait complete. 2024-02-21T23:11:43.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.847+0000 7efe1c1b0740 1 -- start start 2024-02-21T23:11:43.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.847+0000 7efe1c1b0740 1 Processor -- start 2024-02-21T23:11:43.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.849+0000 7efe1c1b0740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5647a7675de0 0x5647a766c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:43.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.849+0000 7efe1c1b0740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5647a76b0b90 0x5647a76341c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:43.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.849+0000 7efe1c1b0740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5647a7666160 0x5647a76665e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:43.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.849+0000 7efe1c1b0740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647a76af070 con 0x5647a7666160 2024-02-21T23:11:43.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.849+0000 7efe1c1b0740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647a753c1d0 con 0x5647a76b0b90 2024-02-21T23:11:43.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.849+0000 7efe1c1b0740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647a76af350 con 0x5647a7675de0 2024-02-21T23:11:43.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.849+0000 7efe1c1b0740 10 client.0 _ll_register_callbacks cb 0x5647a72b1c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:11:43.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.849+0000 7efe11e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5647a7675de0 0x5647a766c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:43.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.849+0000 7efe12800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5647a7666160 0x5647a76665e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:43.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.849+0000 7efe11e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5647a7675de0 0x5647a766c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:46666/0 (socket says 172.21.15.99:46666) 2024-02-21T23:11:43.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.849+0000 7efe11e00640 1 -- 172.21.15.99:0/3314166716 learned_addr learned my addr 172.21.15.99:0/3314166716 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:11:43.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.849+0000 7efe0be00640 1 --2- 172.21.15.99:0/3314166716 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5647a76b0b90 0x5647a76341c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:43.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.849+0000 7efe11e00640 1 -- 172.21.15.99:0/3314166716 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5647a76b0b90 msgr2=0x5647a76341c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:43.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.849+0000 7efe11e00640 1 --2- 172.21.15.99:0/3314166716 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5647a76b0b90 0x5647a76341c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:43.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.849+0000 7efe11e00640 1 -- 172.21.15.99:0/3314166716 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5647a7666160 msgr2=0x5647a76665e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:43.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.849+0000 7efe11e00640 1 --2- 172.21.15.99:0/3314166716 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5647a7666160 0x5647a76665e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:43.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.849+0000 7efe11e00640 1 -- 172.21.15.99:0/3314166716 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5647a737a7e0 con 0x5647a7675de0 2024-02-21T23:11:43.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.850+0000 7efe11e00640 1 --2- 172.21.15.99:0/3314166716 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5647a7675de0 0x5647a766c810 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7efe0402bdd0 tx=0x7efe040093c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49ca0bb83867dd79 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:43.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.850+0000 7efdf7400640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-02-21T23:11:43.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.850+0000 7efdf7400640 1 -- 172.21.15.99:0/3314166716 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe040d1370 con 0x5647a7675de0 2024-02-21T23:11:43.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.850+0000 7efdf7400640 1 -- 172.21.15.99:0/3314166716 <== mon.2 v2:172.21.15.181:3300/0 2 ==== osd_map(38..38 src has 1..38) v4 ==== 8877+0+0 (secure 0 0 0) 0x7efe040c1ac0 con 0x5647a7675de0 2024-02-21T23:11:43.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.850+0000 7efe1c1b0740 1 -- 172.21.15.99:0/3314166716 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efe0c027070 con 0x5647a7675de0 2024-02-21T23:11:43.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.850+0000 7efdf7400640 1 -- 172.21.15.99:0/3314166716 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7efe040b97b0 con 0x5647a7675de0 2024-02-21T23:11:43.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.850+0000 7efe1c1b0740 10 client.7121 fetch_fsmap learned FSMap version 17 2024-02-21T23:11:43.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.851+0000 7efe1c1b0740 1 -- 172.21.15.99:0/3314166716 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5647a73daf70 con 0x5647a7675de0 2024-02-21T23:11:43.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.851+0000 7efdf7400640 1 -- 172.21.15.99:0/3314166716 <== mon.2 v2:172.21.15.181:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe0c027070 con 0x5647a7675de0 2024-02-21T23:11:43.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.851+0000 7efdf7400640 1 -- 172.21.15.99:0/3314166716 <== mon.2 v2:172.21.15.181:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7efe04050060 con 0x5647a7675de0 2024-02-21T23:11:43.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.851+0000 7efe1c1b0740 10 client.7121 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:11:43.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.851+0000 7efe1c1b0740 10 client.7121 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:11:43.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.851+0000 7efe1c1b0740 20 client.7121 populate_metadata read hostname 'smithi099' 2024-02-21T23:11:43.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.851+0000 7efe1c1b0740 1 --2- 172.21.15.99:0/3314166716 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5647a7636af0 0x5647a766cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:43.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.851+0000 7efe1c1b0740 4 client.7121 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:11:43.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.851+0000 7efe1c1b0740 1 -- 172.21.15.99:0/3314166716 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5647a75aacd0 con 0x5647a7636af0 2024-02-21T23:11:43.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.852+0000 7efe0be00640 1 --2- 172.21.15.99:0/3314166716 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5647a7636af0 0x5647a766cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:43.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.852+0000 7efe0be00640 1 --2- 172.21.15.99:0/3314166716 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5647a7636af0 0x5647a766cd50 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac893a9618a86f87 server_cookie=e5db90aecc84dbda in_seq=0 out_seq=0 2024-02-21T23:11:43.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.852+0000 7efdf7400640 10 client.7121 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:11:43.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.853+0000 7efdf7400640 1 -- 172.21.15.99:0/3314166716 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x5647a75aacd0 con 0x5647a7636af0 2024-02-21T23:11:43.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.853+0000 7efdf7400640 10 client.7121 handle_command_reply: tid=0 2024-02-21T23:11:43.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.853+0000 7efe1c1b0740 1 client.7121 shutdown 2024-02-21T23:11:43.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.853+0000 7efe1c1b0740 1 -- 172.21.15.99:0/3314166716 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5647a7675de0 msgr2=0x5647a766c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:43.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.854+0000 7efe1c1b0740 1 --2- 172.21.15.99:0/3314166716 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5647a7675de0 0x5647a766c810 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7efe0402bdd0 tx=0x7efe040093c0 comp rx=0 tx=0).stop 2024-02-21T23:11:43.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.854+0000 7efe1c1b0740 1 -- 172.21.15.99:0/3314166716 shutdown_connections 2024-02-21T23:11:43.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.854+0000 7efe1c1b0740 1 --2- 172.21.15.99:0/3314166716 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5647a7636af0 0x5647a766cd50 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:43.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.854+0000 7efe1c1b0740 1 --2- 172.21.15.99:0/3314166716 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5647a7666160 0x5647a76665e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:43.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.854+0000 7efe1c1b0740 1 --2- 172.21.15.99:0/3314166716 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5647a76b0b90 0x5647a76341c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:43.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.854+0000 7efe1c1b0740 1 --2- 172.21.15.99:0/3314166716 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5647a7675de0 0x5647a766c810 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:43.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.854+0000 7efdf7400640 0 client.7121 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:11:43.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.854+0000 7efe1c1b0740 1 -- 172.21.15.99:0/3314166716 >> 172.21.15.99:0/3314166716 conn(0x5647a76754c0 msgr2=0x5647a7639500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:11:43.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.854+0000 7efe1c1b0740 1 -- 172.21.15.99:0/3314166716 shutdown_connections 2024-02-21T23:11:43.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.854+0000 7efe1c1b0740 1 -- 172.21.15.99:0/3314166716 wait complete. 2024-02-21T23:11:43.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.854+0000 7efe1c1b0740 20 client.7121 trim_cache size 0 max 16384 2024-02-21T23:11:43.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.889+0000 7efe1c1b0740 1 Processor -- start 2024-02-21T23:11:43.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.889+0000 7efe1c1b0740 1 -- start start 2024-02-21T23:11:43.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.891+0000 7efe1c1b0740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5647a7666160 0x5647a76b0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:43.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.891+0000 7efe1c1b0740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5647a7675de0 0x5647a76677a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:43.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.891+0000 7efe1c1b0740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5647a76b0b90 0x5647a770d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:43.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.891+0000 7efe1c1b0740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe1422ca20 con 0x5647a76b0b90 2024-02-21T23:11:43.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.891+0000 7efe1c1b0740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe1422a5c0 con 0x5647a7666160 2024-02-21T23:11:43.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.891+0000 7efe1c1b0740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe14228680 con 0x5647a7675de0 2024-02-21T23:11:43.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.891+0000 7efe12800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5647a76b0b90 0x5647a770d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:43.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.891+0000 7efe11e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5647a7666160 0x5647a76b0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:43.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.891+0000 7efe12800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5647a76b0b90 0x5647a770d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:43436/0 (socket says 172.21.15.99:43436) 2024-02-21T23:11:43.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.892+0000 7efe11e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5647a7666160 0x5647a76b0550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:39166/0 (socket says 172.21.15.99:39166) 2024-02-21T23:11:43.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.892+0000 7efe12800640 1 -- 172.21.15.99:0/2324447923 learned_addr learned my addr 172.21.15.99:0/2324447923 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:11:43.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.892+0000 7efe0be00640 1 --2- 172.21.15.99:0/2324447923 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5647a7675de0 0x5647a76677a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:43.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.892+0000 7efe11e00640 1 -- 172.21.15.99:0/2324447923 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5647a7675de0 msgr2=0x5647a76677a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:43.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.892+0000 7efe11e00640 1 --2- 172.21.15.99:0/2324447923 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5647a7675de0 0x5647a76677a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:43.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.892+0000 7efe11e00640 1 -- 172.21.15.99:0/2324447923 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5647a76b0b90 msgr2=0x5647a770d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:43.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.892+0000 7efe11e00640 1 --2- 172.21.15.99:0/2324447923 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5647a76b0b90 0x5647a770d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:43.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.892+0000 7efe11e00640 1 -- 172.21.15.99:0/2324447923 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5647a7272170 con 0x5647a7666160 2024-02-21T23:11:43.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.892+0000 7efe11e00640 1 --2- 172.21.15.99:0/2324447923 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5647a7666160 0x5647a76b0550 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7efe040b7a60 tx=0x7efe040eb000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc5af5a17e007a2c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:43.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.892+0000 7efe02000640 1 -- 172.21.15.99:0/2324447923 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe040c1f50 con 0x5647a7666160 2024-02-21T23:11:43.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.893+0000 7efe02000640 1 -- 172.21.15.99:0/2324447923 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe040d1170 con 0x5647a7666160 2024-02-21T23:11:43.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.893+0000 7efe02000640 1 -- 172.21.15.99:0/2324447923 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe040c1ac0 con 0x5647a7666160 2024-02-21T23:11:43.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.893+0000 7efe1c1b0740 1 -- 172.21.15.99:0/2324447923 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5647a7666160 msgr2=0x5647a76b0550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:43.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.893+0000 7efe1c1b0740 1 --2- 172.21.15.99:0/2324447923 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5647a7666160 0x5647a76b0550 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7efe040b7a60 tx=0x7efe040eb000 comp rx=0 tx=0).stop 2024-02-21T23:11:43.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.893+0000 7efe1c1b0740 1 -- 172.21.15.99:0/2324447923 shutdown_connections 2024-02-21T23:11:43.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.893+0000 7efe1c1b0740 1 --2- 172.21.15.99:0/2324447923 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5647a76b0b90 0x5647a770d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:43.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.893+0000 7efe1c1b0740 1 --2- 172.21.15.99:0/2324447923 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5647a7675de0 0x5647a76677a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:43.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.893+0000 7efe1c1b0740 1 --2- 172.21.15.99:0/2324447923 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5647a7666160 0x5647a76b0550 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:43.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.893+0000 7efe1c1b0740 1 -- 172.21.15.99:0/2324447923 >> 172.21.15.99:0/2324447923 conn(0x5647a76754c0 msgr2=0x5647a7639500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:11:43.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.893+0000 7efe1c1b0740 1 -- 172.21.15.99:0/2324447923 shutdown_connections 2024-02-21T23:11:43.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.894+0000 7efe1c1b0740 1 -- 172.21.15.99:0/2324447923 wait complete. 2024-02-21T23:11:43.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.894+0000 7efe1c1b0740 1 -- start start 2024-02-21T23:11:43.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.894+0000 7efe1c1b0740 1 Processor -- start 2024-02-21T23:11:43.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.896+0000 7efe1c1b0740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5647a7666160 0x5647a76c1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:43.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.896+0000 7efe1c1b0740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5647a7675de0 0x5647a770c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:43.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.896+0000 7efe1c1b0740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5647a76b0b90 0x5647a76ac240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:43.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.896+0000 7efe1c1b0740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe14228c80 con 0x5647a76b0b90 2024-02-21T23:11:43.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.896+0000 7efe1c1b0740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe14229f60 con 0x5647a7666160 2024-02-21T23:11:43.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.896+0000 7efe1c1b0740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe142292a0 con 0x5647a7675de0 2024-02-21T23:11:43.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.896+0000 7efe1c1b0740 10 client.0 _ll_register_callbacks cb 0x7efe040b9110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:11:43.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.896+0000 7efe11e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5647a7666160 0x5647a76c1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:43.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.896+0000 7efe12800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5647a76b0b90 0x5647a76ac240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:43.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.896+0000 7efe11e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5647a7666160 0x5647a76c1ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:39174/0 (socket says 172.21.15.99:39174) 2024-02-21T23:11:43.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.896+0000 7efe11e00640 1 -- 172.21.15.99:0/966176416 learned_addr learned my addr 172.21.15.99:0/966176416 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:11:43.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.896+0000 7efe0be00640 1 --2- 172.21.15.99:0/966176416 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5647a7675de0 0x5647a770c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:43.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.897+0000 7efe11e00640 1 -- 172.21.15.99:0/966176416 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5647a7675de0 msgr2=0x5647a770c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:43.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.897+0000 7efe11e00640 1 --2- 172.21.15.99:0/966176416 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5647a7675de0 0x5647a770c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:43.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.897+0000 7efe11e00640 1 -- 172.21.15.99:0/966176416 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5647a76b0b90 msgr2=0x5647a76ac240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:43.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.897+0000 7efe11e00640 1 --2- 172.21.15.99:0/966176416 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5647a76b0b90 0x5647a76ac240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:43.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.897+0000 7efe11e00640 1 -- 172.21.15.99:0/966176416 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5647a7667740 con 0x5647a7666160 2024-02-21T23:11:43.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.897+0000 7efe11e00640 1 --2- 172.21.15.99:0/966176416 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5647a7666160 0x5647a76c1ca0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7efe040b94b0 tx=0x7efe04000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=596b89cae09a1800 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:43.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.897+0000 7efdf7400640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-02-21T23:11:43.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.897+0000 7efdf7400640 1 -- 172.21.15.99:0/966176416 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe0409e060 con 0x5647a7666160 2024-02-21T23:11:43.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.897+0000 7efdf7400640 1 -- 172.21.15.99:0/966176416 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(38..38 src has 1..38) v4 ==== 8877+0+0 (secure 0 0 0) 0x7efe040c1ac0 con 0x5647a7666160 2024-02-21T23:11:43.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.897+0000 7efe1c1b0740 1 -- 172.21.15.99:0/966176416 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efe040d1170 con 0x5647a7666160 2024-02-21T23:11:43.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.897+0000 7efdf7400640 1 -- 172.21.15.99:0/966176416 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7efe040c1f50 con 0x5647a7666160 2024-02-21T23:11:43.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.897+0000 7efe1c1b0740 10 client.7180 fetch_fsmap learned FSMap version 17 2024-02-21T23:11:43.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.897+0000 7efe1c1b0740 1 -- 172.21.15.99:0/966176416 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5647a7667740 con 0x5647a7666160 2024-02-21T23:11:43.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.898+0000 7efdf7400640 1 -- 172.21.15.99:0/966176416 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe040d1170 con 0x5647a7666160 2024-02-21T23:11:43.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.898+0000 7efdf7400640 1 -- 172.21.15.99:0/966176416 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7efe040a40b0 con 0x5647a7666160 2024-02-21T23:11:43.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.898+0000 7efe1c1b0740 10 client.7180 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:11:43.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.898+0000 7efe1c1b0740 10 client.7180 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:11:43.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.898+0000 7efe1c1b0740 20 client.7180 populate_metadata read hostname 'smithi099' 2024-02-21T23:11:43.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.898+0000 7efe1c1b0740 1 --2- 172.21.15.99:0/966176416 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5647a763f540 0x5647a76a8b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:43.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.898+0000 7efe1c1b0740 4 client.7180 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-02-21T23:11:43.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.898+0000 7efe1c1b0740 1 -- 172.21.15.99:0/966176416 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x5647a766ea20 con 0x5647a763f540 2024-02-21T23:11:43.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.898+0000 7efe0be00640 1 --2- 172.21.15.99:0/966176416 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5647a763f540 0x5647a76a8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:43.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.899+0000 7efe0be00640 1 --2- 172.21.15.99:0/966176416 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5647a763f540 0x5647a76a8b50 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e7bf970407d1a21 server_cookie=2ada13ddfb35076d in_seq=0 out_seq=0 2024-02-21T23:11:43.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.899+0000 7efdf7400640 10 client.7180 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:11:43.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.900+0000 7efdf7400640 1 -- 172.21.15.99:0/966176416 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5647a766ea20 con 0x5647a763f540 2024-02-21T23:11:43.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.900+0000 7efdf7400640 10 client.7180 handle_command_reply: tid=0 2024-02-21T23:11:43.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.900+0000 7efe1c1b0740 1 client.7180 shutdown 2024-02-21T23:11:43.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.900+0000 7efe1c1b0740 1 -- 172.21.15.99:0/966176416 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5647a7666160 msgr2=0x5647a76c1ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:43.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.900+0000 7efe1c1b0740 1 --2- 172.21.15.99:0/966176416 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5647a7666160 0x5647a76c1ca0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7efe040b94b0 tx=0x7efe04000bc0 comp rx=0 tx=0).stop 2024-02-21T23:11:43.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.900+0000 7efe1c1b0740 1 -- 172.21.15.99:0/966176416 shutdown_connections 2024-02-21T23:11:43.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.900+0000 7efe1c1b0740 1 --2- 172.21.15.99:0/966176416 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5647a763f540 0x5647a76a8b50 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:43.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.900+0000 7efe1c1b0740 1 --2- 172.21.15.99:0/966176416 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5647a76b0b90 0x5647a76ac240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:43.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.900+0000 7efe1c1b0740 1 --2- 172.21.15.99:0/966176416 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5647a7675de0 0x5647a770c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:43.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.900+0000 7efe1c1b0740 1 --2- 172.21.15.99:0/966176416 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5647a7666160 0x5647a76c1ca0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:43.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.900+0000 7efe1c1b0740 1 -- 172.21.15.99:0/966176416 >> 172.21.15.99:0/966176416 conn(0x5647a76754c0 msgr2=0x5647a76af490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:11:43.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.900+0000 7efdf7400640 0 client.7180 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:11:43.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.901+0000 7efe1c1b0740 1 -- 172.21.15.99:0/966176416 shutdown_connections 2024-02-21T23:11:43.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.901+0000 7efe1c1b0740 1 -- 172.21.15.99:0/966176416 wait complete. 2024-02-21T23:11:43.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.901+0000 7efe1c1b0740 20 client.7180 trim_cache size 0 max 16384 2024-02-21T23:11:43.900 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-02-21T23:11:43.900 INFO:teuthology.orchestra.run.smithi099.stdout: "return_code": 0, 2024-02-21T23:11:43.901 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_tag": "ce61f4ab-a9be-430c-9973-f5fb97752fe3", 2024-02-21T23:11:43.901 INFO:teuthology.orchestra.run.smithi099.stdout: "mode": "asynchronous" 2024-02-21T23:11:43.901 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-02-21T23:11:43.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.902+0000 7efe13200640 1 -- 172.21.15.99:0/692399396 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7efdf009eed0 msgr2=0x7efdf00a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:43.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.902+0000 7efe13200640 1 --2- 172.21.15.99:0/692399396 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7efdf009eed0 0x7efdf00a1390 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7efe0c003c00 tx=0x7efe0c00b040 comp rx=0 tx=0).stop 2024-02-21T23:11:43.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.902+0000 7efe13200640 1 -- 172.21.15.99:0/692399396 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efe1406f770 msgr2=0x7efe1417df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:43.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.902+0000 7efe13200640 1 --2- 172.21.15.99:0/692399396 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efe1406f770 0x7efe1417df30 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7efe04033000 tx=0x7efe040046c0 comp rx=0 tx=0).stop 2024-02-21T23:11:43.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.902+0000 7efe13200640 1 -- 172.21.15.99:0/692399396 shutdown_connections 2024-02-21T23:11:43.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.902+0000 7efe13200640 1 --2- 172.21.15.99:0/692399396 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7efdf009eed0 0x7efdf00a1390 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:43.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.902+0000 7efe13200640 1 --2- 172.21.15.99:0/692399396 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7efe1418a920 0x7efe140ce120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:43.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.902+0000 7efe13200640 1 --2- 172.21.15.99:0/692399396 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7efe14186640 0x7efe140cc370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:43.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.902+0000 7efe13200640 1 --2- 172.21.15.99:0/692399396 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efe1406f770 0x7efe1417df30 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:43.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.902+0000 7efe13200640 1 -- 172.21.15.99:0/692399396 >> 172.21.15.99:0/692399396 conn(0x7efe140ced60 msgr2=0x7efe14185850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:11:43.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.903+0000 7efe13200640 1 -- 172.21.15.99:0/692399396 shutdown_connections 2024-02-21T23:11:43.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:43.903+0000 7efe13200640 1 -- 172.21.15.99:0/692399396 wait complete. 2024-02-21T23:11:43.915 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T23:11:43.915 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T23:11:44.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.214+0000 7f21e7000640 1 Processor -- start 2024-02-21T23:11:44.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.214+0000 7f21e7000640 1 -- start start 2024-02-21T23:11:44.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.217+0000 7f21e7000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f21e0188140 0x7f21e00f5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:44.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.217+0000 7f21e7000640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f21e0071880 0x7f21e0071cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:44.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.217+0000 7f21e7000640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21e017efe0 con 0x7f21e00f5580 2024-02-21T23:11:44.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.217+0000 7f21e7000640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21e00f5a10 con 0x7f21e0188140 2024-02-21T23:11:44.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.217+0000 7f21e7000640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21e00f5cf0 con 0x7f21e0071880 2024-02-21T23:11:44.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.217+0000 7f21e5000640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f21e0071880 0x7f21e0071cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:44.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.217+0000 7f21e5000640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f21e0071880 0x7f21e0071cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:46702/0 (socket says 172.21.15.99:46702) 2024-02-21T23:11:44.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.217+0000 7f21e5000640 1 -- 172.21.15.99:0/1339549204 learned_addr learned my addr 172.21.15.99:0/1339549204 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:11:44.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.218+0000 7f21e5000640 1 -- 172.21.15.99:0/1339549204 >> v2:172.21.15.99:3300/0 conn(0x7f21e0188140 msgr2=0x7f21e00f5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:44.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.218+0000 7f21dfe00640 1 --2- 172.21.15.99:0/1339549204 >> v2:172.21.15.99:3300/0 conn(0x7f21e0188140 0x7f21e00f5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:44.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.218+0000 7f21e5000640 1 --2- 172.21.15.99:0/1339549204 >> v2:172.21.15.99:3300/0 conn(0x7f21e0188140 0x7f21e00f5040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:44.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.218+0000 7f21e5000640 1 -- 172.21.15.99:0/1339549204 >> v1:172.21.15.181:6789/0 conn(0x7f21e00f5580 legacy=0x7f21e006f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:44.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.218+0000 7f21e5000640 1 -- 172.21.15.99:0/1339549204 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21e00f5fd0 con 0x7f21e0071880 2024-02-21T23:11:44.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.220+0000 7f21e5000640 1 --2- 172.21.15.99:0/1339549204 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f21e0071880 0x7f21e0071cb0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f21e00cc4a0 tx=0x7f21d802caf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5c7797d1ed6dcc8 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:44.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.220+0000 7f21dea00640 1 -- 172.21.15.99:0/1339549204 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d8034070 con 0x7f21e0071880 2024-02-21T23:11:44.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.220+0000 7f21dea00640 1 -- 172.21.15.99:0/1339549204 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21d802e6a0 con 0x7f21e0071880 2024-02-21T23:11:44.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.220+0000 7f21dea00640 1 -- 172.21.15.99:0/1339549204 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d802ea70 con 0x7f21e0071880 2024-02-21T23:11:44.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.221+0000 7f21e7000640 1 -- 172.21.15.99:0/1339549204 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f21e0071880 msgr2=0x7f21e0071cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:44.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.221+0000 7f21e7000640 1 --2- 172.21.15.99:0/1339549204 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f21e0071880 0x7f21e0071cb0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f21e00cc4a0 tx=0x7f21d802caf0 comp rx=0 tx=0).stop 2024-02-21T23:11:44.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.221+0000 7f21e7000640 1 -- 172.21.15.99:0/1339549204 shutdown_connections 2024-02-21T23:11:44.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.221+0000 7f21e7000640 1 --2- 172.21.15.99:0/1339549204 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f21e0071880 0x7f21e0071cb0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:44.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.221+0000 7f21e7000640 1 --2- 172.21.15.99:0/1339549204 >> v2:172.21.15.99:3300/0 conn(0x7f21e0188140 0x7f21e00f5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:44.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.221+0000 7f21e7000640 1 -- 172.21.15.99:0/1339549204 >> 172.21.15.99:0/1339549204 conn(0x7f21e00ce5f0 msgr2=0x7f21e00cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:11:44.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.222+0000 7f21e7000640 1 -- 172.21.15.99:0/1339549204 shutdown_connections 2024-02-21T23:11:44.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.222+0000 7f21e7000640 1 -- 172.21.15.99:0/1339549204 wait complete. 2024-02-21T23:11:44.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.225+0000 7f21e7000640 1 Processor -- start 2024-02-21T23:11:44.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.225+0000 7f21e7000640 1 -- start start 2024-02-21T23:11:44.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.228+0000 7f21e7000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f21e0071880 0x7f21e021a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:44.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.228+0000 7f21e7000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21e0188140 0x7f21e017dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:44.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.228+0000 7f21e7000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f21e00cdfb0 0x7f21e016aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:44.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.228+0000 7f21e7000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e00f6870 con 0x7f21e0071880 2024-02-21T23:11:44.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.228+0000 7f21e7000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e00f6590 con 0x7f21e0188140 2024-02-21T23:11:44.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.228+0000 7f21e7000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e006f9b0 con 0x7f21e00cdfb0 2024-02-21T23:11:44.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.228+0000 7f21e5000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f21e00cdfb0 0x7f21e016aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:44.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.228+0000 7f21e5000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f21e00cdfb0 0x7f21e016aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:46718/0 (socket says 172.21.15.99:46718) 2024-02-21T23:11:44.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.228+0000 7f21e5000640 1 -- 172.21.15.99:0/2328027738 learned_addr learned my addr 172.21.15.99:0/2328027738 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:11:44.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.229+0000 7f21e5000640 1 -- 172.21.15.99:0/2328027738 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21e0188140 msgr2=0x7f21e017dba0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-21T23:11:44.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.229+0000 7f21e5000640 1 --2- 172.21.15.99:0/2328027738 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21e0188140 0x7f21e017dba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:44.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.229+0000 7f21e5000640 1 -- 172.21.15.99:0/2328027738 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f21e0071880 msgr2=0x7f21e021a390 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-21T23:11:44.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.229+0000 7f21dfe00640 1 --2- 172.21.15.99:0/2328027738 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f21e0071880 0x7f21e021a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:44.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.229+0000 7f21e5000640 1 --2- 172.21.15.99:0/2328027738 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f21e0071880 0x7f21e021a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:44.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.229+0000 7f21e5000640 1 -- 172.21.15.99:0/2328027738 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21e006d410 con 0x7f21e00cdfb0 2024-02-21T23:11:44.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.231+0000 7f21e5000640 1 --2- 172.21.15.99:0/2328027738 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f21e00cdfb0 0x7f21e016aaf0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f21d800c830 tx=0x7f21d8004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:44.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.231+0000 7f21d7e00640 1 -- 172.21.15.99:0/2328027738 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d8034070 con 0x7f21e00cdfb0 2024-02-21T23:11:44.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.231+0000 7f21d7e00640 1 -- 172.21.15.99:0/2328027738 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21d802ee30 con 0x7f21e00cdfb0 2024-02-21T23:11:44.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.231+0000 7f21d7e00640 1 -- 172.21.15.99:0/2328027738 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d802f480 con 0x7f21e00cdfb0 2024-02-21T23:11:44.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.231+0000 7f21e7000640 1 -- 172.21.15.99:0/2328027738 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21e006d6d0 con 0x7f21e00cdfb0 2024-02-21T23:11:44.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.231+0000 7f21e7000640 1 -- 172.21.15.99:0/2328027738 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21e006dc90 con 0x7f21e00cdfb0 2024-02-21T23:11:44.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.236+0000 7f21d7e00640 1 -- 172.21.15.99:0/2328027738 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f21d8037070 con 0x7f21e00cdfb0 2024-02-21T23:11:44.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.238+0000 7f21e9e00740 1 Processor -- start 2024-02-21T23:11:44.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.238+0000 7f21e9e00740 1 -- start start 2024-02-21T23:11:44.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.239+0000 7f21d7e00640 1 --2- 172.21.15.99:0/2328027738 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f21c009efd0 0x7f21c00a1490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:44.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.239+0000 7f21d7e00640 1 -- 172.21.15.99:0/2328027738 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f21d80ec2e0 con 0x7f21e00cdfb0 2024-02-21T23:11:44.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.240+0000 7f21df400640 1 --2- 172.21.15.99:0/2328027738 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f21c009efd0 0x7f21c00a1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:44.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.240+0000 7f21e9e00740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560b097e20d0 0x560b09817b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:44.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.241+0000 7f21e9e00740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560b09818090 0x560b097e24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:44.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.241+0000 7f21e9e00740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560b097e29f0 0x560b097a5000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:44.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.241+0000 7f21e9e00740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b0970ea90 con 0x560b097e29f0 2024-02-21T23:11:44.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.241+0000 7f21e9e00740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b096b7b10 con 0x560b097e20d0 2024-02-21T23:11:44.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.241+0000 7f21e9e00740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b0970ab30 con 0x560b09818090 2024-02-21T23:11:44.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.241+0000 7f21dfe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560b097e20d0 0x560b09817b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:44.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.241+0000 7f21df400640 1 --2- 172.21.15.99:0/2328027738 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f21c009efd0 0x7f21c00a1490 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f21cc000f60 tx=0x7f21cc0079b0 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:44.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.241+0000 7f21dfe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560b097e20d0 0x560b09817b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:39180/0 (socket says 172.21.15.99:39180) 2024-02-21T23:11:44.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.241+0000 7f21dfe00640 1 -- 172.21.15.99:0/1084021208 learned_addr learned my addr 172.21.15.99:0/1084021208 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:11:44.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.241+0000 7f21e5000640 1 --2- 172.21.15.99:0/1084021208 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560b097e29f0 0x560b097a5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:44.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.241+0000 7f21df400640 1 --2- 172.21.15.99:0/1084021208 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560b09818090 0x560b097e24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:44.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.242+0000 7f21e5000640 1 -- 172.21.15.99:0/1084021208 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560b09818090 msgr2=0x560b097e24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:44.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.242+0000 7f21e5000640 1 --2- 172.21.15.99:0/1084021208 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560b09818090 0x560b097e24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:44.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.242+0000 7f21e5000640 1 -- 172.21.15.99:0/1084021208 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560b097e20d0 msgr2=0x560b09817b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:44.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.242+0000 7f21e5000640 1 --2- 172.21.15.99:0/1084021208 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560b097e20d0 0x560b09817b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:44.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.242+0000 7f21e5000640 1 -- 172.21.15.99:0/1084021208 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560b094ed7d0 con 0x560b097e29f0 2024-02-21T23:11:44.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.242+0000 7f21dfe00640 1 --2- 172.21.15.99:0/1084021208 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560b097e20d0 0x560b09817b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:11:44.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.242+0000 7f21e5000640 1 --2- 172.21.15.99:0/1084021208 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560b097e29f0 0x560b097a5000 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f21d80e9870 tx=0x7f21d80423d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9971dd309f1c6c1b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:44.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.243+0000 7f21d4c00640 1 -- 172.21.15.99:0/1084021208 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d80b9a20 con 0x560b097e29f0 2024-02-21T23:11:44.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.243+0000 7f21d4c00640 1 -- 172.21.15.99:0/1084021208 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21d80bdb70 con 0x560b097e29f0 2024-02-21T23:11:44.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.243+0000 7f21d4c00640 1 -- 172.21.15.99:0/1084021208 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d80b9a20 con 0x560b097e29f0 2024-02-21T23:11:44.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.244+0000 7f21e9e00740 1 -- 172.21.15.99:0/1084021208 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560b097e29f0 msgr2=0x560b097a5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:44.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.244+0000 7f21e9e00740 1 --2- 172.21.15.99:0/1084021208 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560b097e29f0 0x560b097a5000 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f21d80e9870 tx=0x7f21d80423d0 comp rx=0 tx=0).stop 2024-02-21T23:11:44.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.245+0000 7f21e9e00740 1 -- 172.21.15.99:0/1084021208 shutdown_connections 2024-02-21T23:11:44.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.245+0000 7f21e9e00740 1 --2- 172.21.15.99:0/1084021208 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560b097e29f0 0x560b097a5000 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:44.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.245+0000 7f21e9e00740 1 --2- 172.21.15.99:0/1084021208 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560b09818090 0x560b097e24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:44.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.245+0000 7f21e9e00740 1 --2- 172.21.15.99:0/1084021208 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560b097e20d0 0x560b09817b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:44.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.245+0000 7f21e9e00740 1 -- 172.21.15.99:0/1084021208 >> 172.21.15.99:0/1084021208 conn(0x560b097716b0 msgr2=0x560b097a8fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:11:44.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.245+0000 7f21e9e00740 1 -- 172.21.15.99:0/1084021208 shutdown_connections 2024-02-21T23:11:44.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.245+0000 7f21e9e00740 1 -- 172.21.15.99:0/1084021208 wait complete. 2024-02-21T23:11:44.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.246+0000 7f21e9e00740 1 -- start start 2024-02-21T23:11:44.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.247+0000 7f21e9e00740 1 Processor -- start 2024-02-21T23:11:44.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.250+0000 7f21e9e00740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560b097e20d0 0x560b097d8050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:44.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.250+0000 7f21e9e00740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560b097e29f0 0x560b097ecfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:44.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.250+0000 7f21e9e00740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560b09818090 0x560b0982d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:44.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.250+0000 7f21e9e00740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b0970ea90 con 0x560b097e29f0 2024-02-21T23:11:44.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.250+0000 7f21e9e00740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b096ad1c0 con 0x560b09818090 2024-02-21T23:11:44.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.250+0000 7f21e9e00740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b097b0d60 con 0x560b097e20d0 2024-02-21T23:11:44.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.250+0000 7f21e9e00740 10 client.0 _ll_register_callbacks cb 0x560b096ca930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:11:44.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.250+0000 7f21dfe00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560b097e20d0 0x560b097d8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:44.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.250+0000 7f21dfe00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560b097e20d0 0x560b097d8050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:46722/0 (socket says 172.21.15.99:46722) 2024-02-21T23:11:44.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.250+0000 7f21dfe00640 1 -- 172.21.15.99:0/2966713894 learned_addr learned my addr 172.21.15.99:0/2966713894 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:11:44.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.250+0000 7f21e5000640 1 --2- 172.21.15.99:0/2966713894 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560b09818090 0x560b0982d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:44.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.251+0000 7f21df400640 1 --2- 172.21.15.99:0/2966713894 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560b097e29f0 0x560b097ecfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:44.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.251+0000 7f21dfe00640 1 -- 172.21.15.99:0/2966713894 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560b09818090 msgr2=0x560b0982d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:44.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.251+0000 7f21dfe00640 1 --2- 172.21.15.99:0/2966713894 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560b09818090 0x560b0982d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:44.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.251+0000 7f21dfe00640 1 -- 172.21.15.99:0/2966713894 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560b097e29f0 msgr2=0x560b097ecfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:44.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.252+0000 7f21dfe00640 1 --2- 172.21.15.99:0/2966713894 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560b097e29f0 0x560b097ecfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:44.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.252+0000 7f21dfe00640 1 -- 172.21.15.99:0/2966713894 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560b094233f0 con 0x560b097e20d0 2024-02-21T23:11:44.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.252+0000 7f21df400640 1 --2- 172.21.15.99:0/2966713894 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560b097e29f0 0x560b097ecfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T23:11:44.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.252+0000 7f21e5000640 1 --2- 172.21.15.99:0/2966713894 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560b09818090 0x560b0982d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:11:44.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.252+0000 7f21dfe00640 1 --2- 172.21.15.99:0/2966713894 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560b097e20d0 0x560b097d8050 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f21d00105c0 tx=0x7f21d0010a80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dead8695aa0b1e43 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:44.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.252+0000 7f21c9600640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-02-21T23:11:44.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.253+0000 7f21c9600640 1 -- 172.21.15.99:0/2966713894 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d0012860 con 0x560b097e20d0 2024-02-21T23:11:44.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.253+0000 7f21c9600640 1 -- 172.21.15.99:0/2966713894 <== mon.2 v2:172.21.15.181:3300/0 2 ==== osd_map(38..38 src has 1..38) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f21d0012a00 con 0x560b097e20d0 2024-02-21T23:11:44.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.253+0000 7f21e9e00740 1 -- 172.21.15.99:0/2966713894 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f21d80bdb70 con 0x560b097e20d0 2024-02-21T23:11:44.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.254+0000 7f21c9600640 1 -- 172.21.15.99:0/2966713894 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f21d0012c00 con 0x560b097e20d0 2024-02-21T23:11:44.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.254+0000 7f21e9e00740 10 client.7142 fetch_fsmap learned FSMap version 17 2024-02-21T23:11:44.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.254+0000 7f21e9e00740 1 -- 172.21.15.99:0/2966713894 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x560b093e30f0 con 0x560b097e20d0 2024-02-21T23:11:44.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.254+0000 7f21c9600640 1 -- 172.21.15.99:0/2966713894 <== mon.2 v2:172.21.15.181:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21d80bdb70 con 0x560b097e20d0 2024-02-21T23:11:44.245 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:11:44.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.254+0000 7f21c9600640 1 -- 172.21.15.99:0/2966713894 <== mon.2 v2:172.21.15.181:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f21d0013430 con 0x560b097e20d0 2024-02-21T23:11:44.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.255+0000 7f21e9e00740 10 client.7142 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:11:44.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.255+0000 7f21e9e00740 10 client.7142 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:11:44.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.255+0000 7f21e9e00740 20 client.7142 populate_metadata read hostname 'smithi099' 2024-02-21T23:11:44.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.255+0000 7f21e9e00740 1 --2- 172.21.15.99:0/2966713894 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x560b09819040 0x560b097e0d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:44.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.255+0000 7f21e9e00740 4 client.7142 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:11:44.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.255+0000 7f21e9e00740 1 -- 172.21.15.99:0/2966713894 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560b0971bfd0 con 0x560b09819040 2024-02-21T23:11:44.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.255+0000 7f21df400640 1 --2- 172.21.15.99:0/2966713894 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x560b09819040 0x560b097e0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:44.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.256+0000 7f21df400640 1 --2- 172.21.15.99:0/2966713894 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x560b09819040 0x560b097e0d20 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68c2bc946ecc3421 server_cookie=4cfeb8921a1565c7 in_seq=0 out_seq=0 2024-02-21T23:11:44.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.256+0000 7f21c9600640 10 client.7142 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:11:44.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.258+0000 7f21c9600640 1 -- 172.21.15.99:0/2966713894 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x560b0971bfd0 con 0x560b09819040 2024-02-21T23:11:44.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.258+0000 7f21c9600640 10 client.7142 handle_command_reply: tid=0 2024-02-21T23:11:44.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.258+0000 7f21e9e00740 1 client.7142 shutdown 2024-02-21T23:11:44.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.258+0000 7f21e9e00740 1 -- 172.21.15.99:0/2966713894 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560b097e20d0 msgr2=0x560b097d8050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:44.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.258+0000 7f21e9e00740 1 --2- 172.21.15.99:0/2966713894 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560b097e20d0 0x560b097d8050 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f21d00105c0 tx=0x7f21d0010a80 comp rx=0 tx=0).stop 2024-02-21T23:11:44.251 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:11:44.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.259+0000 7f21e9e00740 1 -- 172.21.15.99:0/2966713894 shutdown_connections 2024-02-21T23:11:44.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.259+0000 7f21e9e00740 1 --2- 172.21.15.99:0/2966713894 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x560b09819040 0x560b097e0d20 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:44.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.259+0000 7f21e9e00740 1 --2- 172.21.15.99:0/2966713894 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560b09818090 0x560b0982d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:44.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.259+0000 7f21e9e00740 1 --2- 172.21.15.99:0/2966713894 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560b097e29f0 0x560b097ecfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:44.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.259+0000 7f21e9e00740 1 --2- 172.21.15.99:0/2966713894 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560b097e20d0 0x560b097d8050 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:44.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.259+0000 7f21e9e00740 1 -- 172.21.15.99:0/2966713894 >> 172.21.15.99:0/2966713894 conn(0x560b097716b0 msgr2=0x560b098178d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:11:44.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.259+0000 7f21c9600640 0 client.7142 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:11:44.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.260+0000 7f21e9e00740 1 -- 172.21.15.99:0/2966713894 shutdown_connections 2024-02-21T23:11:44.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.260+0000 7f21e9e00740 1 -- 172.21.15.99:0/2966713894 wait complete. 2024-02-21T23:11:44.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.260+0000 7f21e9e00740 20 client.7142 trim_cache size 0 max 16384 2024-02-21T23:11:44.255 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:11:44.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.296+0000 7f21e9e00740 1 Processor -- start 2024-02-21T23:11:44.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.296+0000 7f21e9e00740 1 -- start start 2024-02-21T23:11:44.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.298+0000 7f21e9e00740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560b097e20d0 0x560b097ecfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:44.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.298+0000 7f21e9e00740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560b097e29f0 0x560b097df720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:44.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.298+0000 7f21e9e00740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560b09818090 0x560b097a7f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:44.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.298+0000 7f21e9e00740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e0231150 con 0x560b097e29f0 2024-02-21T23:11:44.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.298+0000 7f21e9e00740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e022ecf0 con 0x560b097e20d0 2024-02-21T23:11:44.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.298+0000 7f21e9e00740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e02270e0 con 0x560b09818090 2024-02-21T23:11:44.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.298+0000 7f21e5000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560b09818090 0x560b097a7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:44.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.298+0000 7f21dfe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560b097e20d0 0x560b097ecfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:44.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.298+0000 7f21e5000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560b09818090 0x560b097a7f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:46728/0 (socket says 172.21.15.99:46728) 2024-02-21T23:11:44.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.299+0000 7f21e5000640 1 -- 172.21.15.99:0/1652077153 learned_addr learned my addr 172.21.15.99:0/1652077153 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:11:44.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.299+0000 7f21df400640 1 --2- 172.21.15.99:0/1652077153 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560b097e29f0 0x560b097df720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:44.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.299+0000 7f21dfe00640 1 -- 172.21.15.99:0/1652077153 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560b09818090 msgr2=0x560b097a7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:44.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.299+0000 7f21dfe00640 1 --2- 172.21.15.99:0/1652077153 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560b09818090 0x560b097a7f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:44.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.299+0000 7f21dfe00640 1 -- 172.21.15.99:0/1652077153 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560b097e29f0 msgr2=0x560b097df720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:44.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.299+0000 7f21dfe00640 1 --2- 172.21.15.99:0/1652077153 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560b097e29f0 0x560b097df720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:44.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.299+0000 7f21dfe00640 1 -- 172.21.15.99:0/1652077153 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560b097e2820 con 0x560b097e20d0 2024-02-21T23:11:44.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.299+0000 7f21df400640 1 --2- 172.21.15.99:0/1652077153 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560b097e29f0 0x560b097df720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:11:44.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.300+0000 7f21dfe00640 1 --2- 172.21.15.99:0/1652077153 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560b097e20d0 0x560b097ecfb0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f21d000bab0 tx=0x7f21d0015000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8950947bed48f9f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:44.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.300+0000 7f21cbe00640 1 -- 172.21.15.99:0/1652077153 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d0034070 con 0x560b097e20d0 2024-02-21T23:11:44.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.300+0000 7f21cbe00640 1 -- 172.21.15.99:0/1652077153 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21d0013430 con 0x560b097e20d0 2024-02-21T23:11:44.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.300+0000 7f21cbe00640 1 -- 172.21.15.99:0/1652077153 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d0012660 con 0x560b097e20d0 2024-02-21T23:11:44.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.301+0000 7f21e9e00740 1 -- 172.21.15.99:0/1652077153 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560b097e20d0 msgr2=0x560b097ecfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:44.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.301+0000 7f21e9e00740 1 --2- 172.21.15.99:0/1652077153 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560b097e20d0 0x560b097ecfb0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f21d000bab0 tx=0x7f21d0015000 comp rx=0 tx=0).stop 2024-02-21T23:11:44.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.301+0000 7f21e9e00740 1 -- 172.21.15.99:0/1652077153 shutdown_connections 2024-02-21T23:11:44.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.301+0000 7f21e9e00740 1 --2- 172.21.15.99:0/1652077153 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560b09818090 0x560b097a7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:44.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.301+0000 7f21e9e00740 1 --2- 172.21.15.99:0/1652077153 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560b097e29f0 0x560b097df720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:44.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.301+0000 7f21e9e00740 1 --2- 172.21.15.99:0/1652077153 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560b097e20d0 0x560b097ecfb0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:44.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.301+0000 7f21e9e00740 1 -- 172.21.15.99:0/1652077153 >> 172.21.15.99:0/1652077153 conn(0x560b097716b0 msgr2=0x560b097d7e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:11:44.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.302+0000 7f21e9e00740 1 -- 172.21.15.99:0/1652077153 shutdown_connections 2024-02-21T23:11:44.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.302+0000 7f21e9e00740 1 -- 172.21.15.99:0/1652077153 wait complete. 2024-02-21T23:11:44.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.303+0000 7f21e9e00740 1 -- start start 2024-02-21T23:11:44.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.303+0000 7f21e9e00740 1 Processor -- start 2024-02-21T23:11:44.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.305+0000 7f21e9e00740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560b097e20d0 0x560b097e5880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:44.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.305+0000 7f21e9e00740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560b097e29f0 0x560b097edf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:44.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.305+0000 7f21e9e00740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560b09818090 0x560b09885b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:44.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.305+0000 7f21e9e00740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e02276e0 con 0x560b097e20d0 2024-02-21T23:11:44.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.305+0000 7f21e9e00740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e022e690 con 0x560b09818090 2024-02-21T23:11:44.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.305+0000 7f21e9e00740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e022d9f0 con 0x560b097e29f0 2024-02-21T23:11:44.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.305+0000 7f21e9e00740 10 client.0 _ll_register_callbacks cb 0x7f21d000bd80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:11:44.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.306+0000 7f21df400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560b097e29f0 0x560b097edf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:44.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.306+0000 7f21df400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560b097e29f0 0x560b097edf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:46732/0 (socket says 172.21.15.99:46732) 2024-02-21T23:11:44.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.306+0000 7f21df400640 1 -- 172.21.15.99:0/4139414287 learned_addr learned my addr 172.21.15.99:0/4139414287 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:11:44.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.306+0000 7f21dfe00640 1 --2- 172.21.15.99:0/4139414287 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560b097e20d0 0x560b097e5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:44.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.306+0000 7f21e5000640 1 --2- 172.21.15.99:0/4139414287 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560b09818090 0x560b09885b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:44.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.307+0000 7f21dfe00640 1 -- 172.21.15.99:0/4139414287 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560b097e29f0 msgr2=0x560b097edf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:44.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.307+0000 7f21dfe00640 1 --2- 172.21.15.99:0/4139414287 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560b097e29f0 0x560b097edf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:44.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.307+0000 7f21dfe00640 1 -- 172.21.15.99:0/4139414287 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560b09818090 msgr2=0x560b09885b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:11:44.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.307+0000 7f21dfe00640 1 --2- 172.21.15.99:0/4139414287 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560b09818090 0x560b09885b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:44.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.307+0000 7f21dfe00640 1 -- 172.21.15.99:0/4139414287 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560b097d7cf0 con 0x560b097e20d0 2024-02-21T23:11:44.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.308+0000 7f21dfe00640 1 --2- 172.21.15.99:0/4139414287 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560b097e20d0 0x560b097e5880 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x560b09817c00 tx=0x7f21d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77e79febafcbc175 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:11:44.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.308+0000 7f21c9600640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:11:44.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.308+0000 7f21c9600640 1 -- 172.21.15.99:0/4139414287 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d003d060 con 0x560b097e20d0 2024-02-21T23:11:44.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.308+0000 7f21c9600640 1 -- 172.21.15.99:0/4139414287 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(38..38 src has 1..38) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f21d0012660 con 0x560b097e20d0 2024-02-21T23:11:44.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.309+0000 7f21e9e00740 1 -- 172.21.15.99:0/4139414287 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f21d0013430 con 0x560b097e20d0 2024-02-21T23:11:44.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.309+0000 7f21c9600640 1 -- 172.21.15.99:0/4139414287 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f21d0034040 con 0x560b097e20d0 2024-02-21T23:11:44.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.309+0000 7f21e9e00740 10 client.6996 fetch_fsmap learned FSMap version 17 2024-02-21T23:11:44.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.309+0000 7f21e9e00740 1 -- 172.21.15.99:0/4139414287 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x560b097e5080 con 0x560b097e20d0 2024-02-21T23:11:44.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.310+0000 7f21c9600640 1 -- 172.21.15.99:0/4139414287 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21d0013430 con 0x560b097e20d0 2024-02-21T23:11:44.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.310+0000 7f21c9600640 1 -- 172.21.15.99:0/4139414287 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f21d0012880 con 0x560b097e20d0 2024-02-21T23:11:44.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.310+0000 7f21e9e00740 10 client.6996 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:11:44.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.310+0000 7f21e9e00740 10 client.6996 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:11:44.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.310+0000 7f21e9e00740 20 client.6996 populate_metadata read hostname 'smithi099' 2024-02-21T23:11:44.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.310+0000 7f21e9e00740 1 --2- 172.21.15.99:0/4139414287 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x560b097a77d0 0x560b097b0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:11:44.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.310+0000 7f21e9e00740 4 client.6996 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T23:11:44.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.310+0000 7f21e9e00740 1 -- 172.21.15.99:0/4139414287 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x560b09716320 con 0x560b097a77d0 2024-02-21T23:11:44.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.311+0000 7f21df400640 1 --2- 172.21.15.99:0/4139414287 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x560b097a77d0 0x560b097b0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:11:44.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.312+0000 7f21df400640 1 --2- 172.21.15.99:0/4139414287 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x560b097a77d0 0x560b097b0670 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7336216600be97e8 server_cookie=13e76c07ad2d66bc in_seq=0 out_seq=0 2024-02-21T23:11:44.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.312+0000 7f21c9600640 10 client.6996 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:11:44.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.313+0000 7f21c9600640 1 -- 172.21.15.99:0/4139414287 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x560b09716320 con 0x560b097a77d0 2024-02-21T23:11:44.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.313+0000 7f21c9600640 10 client.6996 handle_command_reply: tid=0 2024-02-21T23:11:44.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.313+0000 7f21e9e00740 1 client.6996 shutdown 2024-02-21T23:11:44.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.313+0000 7f21e9e00740 1 -- 172.21.15.99:0/4139414287 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560b097e20d0 msgr2=0x560b097e5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:44.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.313+0000 7f21e9e00740 1 --2- 172.21.15.99:0/4139414287 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560b097e20d0 0x560b097e5880 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x560b09817c00 tx=0x7f21d00046c0 comp rx=0 tx=0).stop 2024-02-21T23:11:44.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.314+0000 7f21e9e00740 1 -- 172.21.15.99:0/4139414287 shutdown_connections 2024-02-21T23:11:44.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.314+0000 7f21e9e00740 1 --2- 172.21.15.99:0/4139414287 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x560b097a77d0 0x560b097b0670 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:44.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.314+0000 7f21e9e00740 1 --2- 172.21.15.99:0/4139414287 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560b09818090 0x560b09885b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:44.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.314+0000 7f21e9e00740 1 --2- 172.21.15.99:0/4139414287 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560b097e29f0 0x560b097edf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:44.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.314+0000 7f21e9e00740 1 --2- 172.21.15.99:0/4139414287 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560b097e20d0 0x560b097e5880 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:44.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.314+0000 7f21e9e00740 1 -- 172.21.15.99:0/4139414287 >> 172.21.15.99:0/4139414287 conn(0x560b097716b0 msgr2=0x560b097a99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:11:44.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.314+0000 7f21c9600640 0 client.6996 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:11:44.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.314+0000 7f21e9e00740 1 -- 172.21.15.99:0/4139414287 shutdown_connections 2024-02-21T23:11:44.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.314+0000 7f21e9e00740 1 -- 172.21.15.99:0/4139414287 wait complete. 2024-02-21T23:11:44.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.315+0000 7f21e9e00740 20 client.6996 trim_cache size 0 max 16384 2024-02-21T23:11:44.305 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-02-21T23:11:44.305 INFO:teuthology.orchestra.run.smithi099.stdout: "status": "scrub active (979 inodes in the stack)", 2024-02-21T23:11:44.305 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubs": { 2024-02-21T23:11:44.305 INFO:teuthology.orchestra.run.smithi099.stdout: "ce61f4ab-a9be-430c-9973-f5fb97752fe3": { 2024-02-21T23:11:44.305 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/", 2024-02-21T23:11:44.305 INFO:teuthology.orchestra.run.smithi099.stdout: "tag": "ce61f4ab-a9be-430c-9973-f5fb97752fe3", 2024-02-21T23:11:44.305 INFO:teuthology.orchestra.run.smithi099.stdout: "options": "recursive,force" 2024-02-21T23:11:44.305 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:11:44.306 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:11:44.306 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-02-21T23:11:44.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.316+0000 7f21e7000640 1 -- 172.21.15.99:0/2328027738 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f21c009efd0 msgr2=0x7f21c00a1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:44.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.316+0000 7f21e7000640 1 --2- 172.21.15.99:0/2328027738 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f21c009efd0 0x7f21c00a1490 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f21cc000f60 tx=0x7f21cc0079b0 comp rx=0 tx=0).stop 2024-02-21T23:11:44.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.316+0000 7f21e7000640 1 -- 172.21.15.99:0/2328027738 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f21e00cdfb0 msgr2=0x7f21e016aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:11:44.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.316+0000 7f21e7000640 1 --2- 172.21.15.99:0/2328027738 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f21e00cdfb0 0x7f21e016aaf0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f21d800c830 tx=0x7f21d8004a40 comp rx=0 tx=0).stop 2024-02-21T23:11:44.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.316+0000 7f21e7000640 1 -- 172.21.15.99:0/2328027738 shutdown_connections 2024-02-21T23:11:44.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.316+0000 7f21e7000640 1 --2- 172.21.15.99:0/2328027738 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f21c009efd0 0x7f21c00a1490 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:44.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.316+0000 7f21e7000640 1 --2- 172.21.15.99:0/2328027738 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f21e00cdfb0 0x7f21e016aaf0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:44.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.316+0000 7f21e7000640 1 --2- 172.21.15.99:0/2328027738 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21e0188140 0x7f21e017dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:44.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.316+0000 7f21e7000640 1 --2- 172.21.15.99:0/2328027738 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f21e0071880 0x7f21e021a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:11:44.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.316+0000 7f21e7000640 1 -- 172.21.15.99:0/2328027738 >> 172.21.15.99:0/2328027738 conn(0x7f21e00ce5f0 msgr2=0x7f21e0188520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:11:44.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.317+0000 7f21e7000640 1 -- 172.21.15.99:0/2328027738 shutdown_connections 2024-02-21T23:11:44.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:11:44.317+0000 7f21e7000640 1 -- 172.21.15.99:0/2328027738 wait complete. 2024-02-21T23:11:44.329 INFO:tasks.cephfs.filesystem:scrub status for tag:ce61f4ab-a9be-430c-9973-f5fb97752fe3 - {'path': '/', 'tag': 'ce61f4ab-a9be-430c-9973-f5fb97752fe3', 'options': 'recursive,force'} 2024-02-21T23:12:14.330 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T23:12:14.331 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T23:12:14.387 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:12:14.392 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:12:14.395 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:12:14.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.589+0000 7fa283e00640 1 Processor -- start 2024-02-21T23:12:14.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.589+0000 7fa283e00640 1 -- start start 2024-02-21T23:12:14.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.591+0000 7fa283e00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fa28417f490 0x7fa28418ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:14.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.592+0000 7fa283e00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2840d6dd0 con 0x7fa28418b4f0 2024-02-21T23:12:14.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.592+0000 7fa283e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2841614c0 con 0x7fa28418b060 2024-02-21T23:12:14.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.592+0000 7fa283e00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2840d6810 con 0x7fa28417f490 2024-02-21T23:12:14.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.592+0000 7fa282a00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fa28417f490 0x7fa28418ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:14.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.592+0000 7fa283400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fa28418b4f0 0x7fa284189150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:40294/0 (socket says 172.21.15.99:40294) 2024-02-21T23:12:14.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.592+0000 7fa283400640 1 -- 172.21.15.99:0/3863713800 learned_addr learned my addr 172.21.15.99:0/3863713800 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:12:14.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.592+0000 7fa282000640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fa28418b060 0x7fa284188a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.99:37672/0 (socket says 172.21.15.99:37672) 2024-02-21T23:12:14.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.592+0000 7fa282a00640 1 -- 172.21.15.99:0/3863713800 >> v1:172.21.15.162:6789/0 conn(0x7fa28418b060 legacy=0x7fa284188a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:14.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.592+0000 7fa282a00640 1 -- 172.21.15.99:0/3863713800 >> v1:172.21.15.99:6789/0 conn(0x7fa28418b4f0 legacy=0x7fa284189150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:14.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.592+0000 7fa282a00640 1 -- 172.21.15.99:0/3863713800 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2840d6af0 con 0x7fa28417f490 2024-02-21T23:12:14.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.592+0000 7fa281600640 1 -- 172.21.15.99:0/3863713800 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4088175446 0 0) 0x7fa2840d6dd0 con 0x7fa28418b4f0 2024-02-21T23:12:14.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.594+0000 7fa282a00640 1 --2- 172.21.15.99:0/3863713800 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa28417f490 0x7fa28418ab20 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fa2740097a0 tx=0x7fa27402b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c6a789dd2816f20 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:14.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.594+0000 7fa281600640 1 -- 172.21.15.99:0/3863713800 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa274034070 con 0x7fa28417f490 2024-02-21T23:12:14.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.594+0000 7fa281600640 1 -- 172.21.15.99:0/3863713800 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa274030610 con 0x7fa28417f490 2024-02-21T23:12:14.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.594+0000 7fa281600640 1 -- 172.21.15.99:0/3863713800 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2740309e0 con 0x7fa28417f490 2024-02-21T23:12:14.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.595+0000 7fa283e00640 1 -- 172.21.15.99:0/3863713800 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa28417f490 msgr2=0x7fa28418ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:14.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.595+0000 7fa283e00640 1 --2- 172.21.15.99:0/3863713800 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa28417f490 0x7fa28418ab20 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fa2740097a0 tx=0x7fa27402b960 comp rx=0 tx=0).stop 2024-02-21T23:12:14.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.595+0000 7fa283e00640 1 -- 172.21.15.99:0/3863713800 shutdown_connections 2024-02-21T23:12:14.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.595+0000 7fa283e00640 1 --2- 172.21.15.99:0/3863713800 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa28417f490 0x7fa28418ab20 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:14.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.595+0000 7fa283e00640 1 -- 172.21.15.99:0/3863713800 >> 172.21.15.99:0/3863713800 conn(0x7fa2840d29b0 msgr2=0x7fa2840d2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:14.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.595+0000 7fa283e00640 1 -- 172.21.15.99:0/3863713800 shutdown_connections 2024-02-21T23:12:14.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.595+0000 7fa283e00640 1 -- 172.21.15.99:0/3863713800 wait complete. 2024-02-21T23:12:14.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.597+0000 7fa283e00640 1 Processor -- start 2024-02-21T23:12:14.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.597+0000 7fa283e00640 1 -- start start 2024-02-21T23:12:14.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.599+0000 7fa283e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa28417f490 0x7fa28421f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:14.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.599+0000 7fa283e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa28418b060 0x7fa284174d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:14.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.599+0000 7fa283e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa28418b4f0 0x7fa284220180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:14.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.599+0000 7fa283e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa28418a600 con 0x7fa28417f490 2024-02-21T23:12:14.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.599+0000 7fa283e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa28418a320 con 0x7fa28418b4f0 2024-02-21T23:12:14.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.599+0000 7fa283e00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa28417f870 con 0x7fa28418b060 2024-02-21T23:12:14.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.599+0000 7fa282a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa28417f490 0x7fa28421f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:14.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.599+0000 7fa282000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa28418b060 0x7fa284174d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:14.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.599+0000 7fa282a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa28417f490 0x7fa28421f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60402/0 (socket says 172.21.15.99:60402) 2024-02-21T23:12:14.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.599+0000 7fa282a00640 1 -- 172.21.15.99:0/873462417 learned_addr learned my addr 172.21.15.99:0/873462417 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:12:14.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.600+0000 7fa283400640 1 --2- 172.21.15.99:0/873462417 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa28418b4f0 0x7fa284220180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:14.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.600+0000 7fa282000640 1 -- 172.21.15.99:0/873462417 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa28418b4f0 msgr2=0x7fa284220180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:14.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.600+0000 7fa282000640 1 --2- 172.21.15.99:0/873462417 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa28418b4f0 0x7fa284220180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:14.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.600+0000 7fa282000640 1 -- 172.21.15.99:0/873462417 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa28417f490 msgr2=0x7fa28421f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:14.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.600+0000 7fa282000640 1 --2- 172.21.15.99:0/873462417 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa28417f490 0x7fa28421f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:14.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.600+0000 7fa282000640 1 -- 172.21.15.99:0/873462417 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa28415cb80 con 0x7fa28418b060 2024-02-21T23:12:14.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.600+0000 7fa283400640 1 --2- 172.21.15.99:0/873462417 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa28418b4f0 0x7fa284220180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:12:14.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.600+0000 7fa282000640 1 --2- 172.21.15.99:0/873462417 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa28418b060 0x7fa284174d30 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fa27000c430 tx=0x7fa27000c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:14.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.601+0000 7fa27aa00640 1 -- 172.21.15.99:0/873462417 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2700074e0 con 0x7fa28418b060 2024-02-21T23:12:14.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.601+0000 7fa27aa00640 1 -- 172.21.15.99:0/873462417 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa270007680 con 0x7fa28418b060 2024-02-21T23:12:14.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.601+0000 7fa283e00640 1 -- 172.21.15.99:0/873462417 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa28415ce60 con 0x7fa28418b060 2024-02-21T23:12:14.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.601+0000 7fa27aa00640 1 -- 172.21.15.99:0/873462417 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2700049e0 con 0x7fa28418b060 2024-02-21T23:12:14.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.601+0000 7fa283e00640 1 -- 172.21.15.99:0/873462417 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa28415d420 con 0x7fa28418b060 2024-02-21T23:12:14.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.604+0000 7fa27aa00640 1 -- 172.21.15.99:0/873462417 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7fa27001a020 con 0x7fa28418b060 2024-02-21T23:12:14.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.605+0000 7fa27aa00640 1 --2- 172.21.15.99:0/873462417 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa26409eed0 0x7fa2640a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:14.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.605+0000 7fa27aa00640 1 -- 172.21.15.99:0/873462417 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 8965+0+0 (secure 0 0 0) 0x7fa2700c9690 con 0x7fa28418b060 2024-02-21T23:12:14.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.606+0000 7fa282a00640 1 --2- 172.21.15.99:0/873462417 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa26409eed0 0x7fa2640a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:14.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.607+0000 7fa282a00640 1 --2- 172.21.15.99:0/873462417 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa26409eed0 0x7fa2640a1390 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa274009560 tx=0x7fa27403b040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:14.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.607+0000 7fa28ca0d740 1 Processor -- start 2024-02-21T23:12:14.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.607+0000 7fa28ca0d740 1 -- start start 2024-02-21T23:12:14.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.609+0000 7fa28ca0d740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5632f3a5d2a0 0x5632f3a92d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:14.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.609+0000 7fa28ca0d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5632f3a93260 0x5632f3a5d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:14.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.609+0000 7fa28ca0d740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5632f3a5dbc0 0x5632f3a201d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:14.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.609+0000 7fa28ca0d740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632f3989a90 con 0x5632f3a5d2a0 2024-02-21T23:12:14.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.609+0000 7fa28ca0d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632f3932b10 con 0x5632f3a93260 2024-02-21T23:12:14.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.609+0000 7fa28ca0d740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632f3985b30 con 0x5632f3a5dbc0 2024-02-21T23:12:14.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.609+0000 7fa282a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5632f3a5d2a0 0x5632f3a92d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:14.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.609+0000 7fa282000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5632f3a93260 0x5632f3a5d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:14.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.609+0000 7fa282a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5632f3a5d2a0 0x5632f3a92d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60408/0 (socket says 172.21.15.99:60408) 2024-02-21T23:12:14.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.609+0000 7fa282000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5632f3a93260 0x5632f3a5d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:51034/0 (socket says 172.21.15.99:51034) 2024-02-21T23:12:14.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.609+0000 7fa282a00640 1 -- 172.21.15.99:0/3997727616 learned_addr learned my addr 172.21.15.99:0/3997727616 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:12:14.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.609+0000 7fa283400640 1 --2- 172.21.15.99:0/3997727616 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5632f3a5dbc0 0x5632f3a201d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:14.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.610+0000 7fa282000640 1 -- 172.21.15.99:0/3997727616 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5632f3a5dbc0 msgr2=0x5632f3a201d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:14.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.610+0000 7fa282000640 1 --2- 172.21.15.99:0/3997727616 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5632f3a5dbc0 0x5632f3a201d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:14.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.610+0000 7fa282000640 1 -- 172.21.15.99:0/3997727616 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5632f3a5d2a0 msgr2=0x5632f3a92d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:14.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.610+0000 7fa282000640 1 --2- 172.21.15.99:0/3997727616 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5632f3a5d2a0 0x5632f3a92d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:14.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.610+0000 7fa282000640 1 -- 172.21.15.99:0/3997727616 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5632f37687d0 con 0x5632f3a93260 2024-02-21T23:12:14.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.610+0000 7fa282000640 1 --2- 172.21.15.99:0/3997727616 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5632f3a93260 0x5632f3a5d680 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fa2700c6ca0 tx=0x7fa270096b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7cd15743342c8c4a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:14.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.610+0000 7fa26f400640 1 -- 172.21.15.99:0/3997727616 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2700c6e40 con 0x5632f3a93260 2024-02-21T23:12:14.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.610+0000 7fa26f400640 1 -- 172.21.15.99:0/3997727616 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa270093580 con 0x5632f3a93260 2024-02-21T23:12:14.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.610+0000 7fa26f400640 1 -- 172.21.15.99:0/3997727616 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2700973b0 con 0x5632f3a93260 2024-02-21T23:12:14.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.611+0000 7fa28ca0d740 1 -- 172.21.15.99:0/3997727616 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5632f3a93260 msgr2=0x5632f3a5d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:14.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.611+0000 7fa28ca0d740 1 --2- 172.21.15.99:0/3997727616 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5632f3a93260 0x5632f3a5d680 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fa2700c6ca0 tx=0x7fa270096b80 comp rx=0 tx=0).stop 2024-02-21T23:12:14.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.611+0000 7fa28ca0d740 1 -- 172.21.15.99:0/3997727616 shutdown_connections 2024-02-21T23:12:14.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.611+0000 7fa28ca0d740 1 --2- 172.21.15.99:0/3997727616 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5632f3a5dbc0 0x5632f3a201d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:14.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.611+0000 7fa28ca0d740 1 --2- 172.21.15.99:0/3997727616 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5632f3a93260 0x5632f3a5d680 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:14.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.611+0000 7fa28ca0d740 1 --2- 172.21.15.99:0/3997727616 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5632f3a5d2a0 0x5632f3a92d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:14.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.611+0000 7fa28ca0d740 1 -- 172.21.15.99:0/3997727616 >> 172.21.15.99:0/3997727616 conn(0x5632f39ec6b0 msgr2=0x5632f3a24190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:14.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.611+0000 7fa28ca0d740 1 -- 172.21.15.99:0/3997727616 shutdown_connections 2024-02-21T23:12:14.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.611+0000 7fa28ca0d740 1 -- 172.21.15.99:0/3997727616 wait complete. 2024-02-21T23:12:14.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.612+0000 7fa28ca0d740 1 -- start start 2024-02-21T23:12:14.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.613+0000 7fa28ca0d740 1 Processor -- start 2024-02-21T23:12:14.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.614+0000 7fa28ca0d740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5632f3a5d2a0 0x5632f3aa4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:14.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.614+0000 7fa28ca0d740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5632f3a5dbc0 0x5632f3a906c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:14.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.614+0000 7fa28ca0d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5632f3a93260 0x5632f3a8eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:14.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.614+0000 7fa28ca0d740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632f3a2bf30 con 0x5632f3a5d2a0 2024-02-21T23:12:14.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.614+0000 7fa28ca0d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632f39281c0 con 0x5632f3a93260 2024-02-21T23:12:14.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.614+0000 7fa28ca0d740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632f3a94930 con 0x5632f3a5dbc0 2024-02-21T23:12:14.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.614+0000 7fa28ca0d740 10 client.0 _ll_register_callbacks cb 0x5632f3945930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:12:14.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.614+0000 7fa282a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5632f3a5d2a0 0x5632f3aa4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:14.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.614+0000 7fa282a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5632f3a5d2a0 0x5632f3aa4d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60410/0 (socket says 172.21.15.99:60410) 2024-02-21T23:12:14.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.615+0000 7fa282a00640 1 -- 172.21.15.99:0/2150881483 learned_addr learned my addr 172.21.15.99:0/2150881483 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:12:14.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.615+0000 7fa282000640 1 --2- 172.21.15.99:0/2150881483 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5632f3a5dbc0 0x5632f3a906c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:14.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.615+0000 7fa283400640 1 --2- 172.21.15.99:0/2150881483 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5632f3a93260 0x5632f3a8eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:14.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.615+0000 7fa282000640 1 -- 172.21.15.99:0/2150881483 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5632f3a93260 msgr2=0x5632f3a8eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:14.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.615+0000 7fa282000640 1 --2- 172.21.15.99:0/2150881483 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5632f3a93260 0x5632f3a8eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:14.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.615+0000 7fa282000640 1 -- 172.21.15.99:0/2150881483 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5632f3a5d2a0 msgr2=0x5632f3aa4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:14.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.615+0000 7fa282000640 1 --2- 172.21.15.99:0/2150881483 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5632f3a5d2a0 0x5632f3aa4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:14.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.615+0000 7fa282000640 1 -- 172.21.15.99:0/2150881483 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5632f369e3f0 con 0x5632f3a5dbc0 2024-02-21T23:12:14.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.615+0000 7fa282a00640 1 --2- 172.21.15.99:0/2150881483 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5632f3a5d2a0 0x5632f3aa4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:12:14.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.615+0000 7fa282000640 1 --2- 172.21.15.99:0/2150881483 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5632f3a5dbc0 0x5632f3a906c0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fa27000c400 tx=0x7fa270001120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56d644ec3f365189 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:14.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.615+0000 7fa263e00640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-02-21T23:12:14.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.616+0000 7fa263e00640 1 -- 172.21.15.99:0/2150881483 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2700b3060 con 0x5632f3a5dbc0 2024-02-21T23:12:14.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.616+0000 7fa263e00640 1 -- 172.21.15.99:0/2150881483 <== mon.2 v2:172.21.15.181:3300/0 2 ==== osd_map(39..39 src has 1..39) v4 ==== 8965+0+0 (secure 0 0 0) 0x7fa270004b80 con 0x5632f3a5dbc0 2024-02-21T23:12:14.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.616+0000 7fa28ca0d740 1 -- 172.21.15.99:0/2150881483 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa270093580 con 0x5632f3a5dbc0 2024-02-21T23:12:14.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.617+0000 7fa263e00640 1 -- 172.21.15.99:0/2150881483 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa270004d80 con 0x5632f3a5dbc0 2024-02-21T23:12:14.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.617+0000 7fa28ca0d740 10 client.7160 fetch_fsmap learned FSMap version 17 2024-02-21T23:12:14.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.617+0000 7fa28ca0d740 1 -- 172.21.15.99:0/2150881483 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5632f365e0f0 con 0x5632f3a5dbc0 2024-02-21T23:12:14.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.617+0000 7fa263e00640 1 -- 172.21.15.99:0/2150881483 <== mon.2 v2:172.21.15.181:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa270093580 con 0x5632f3a5dbc0 2024-02-21T23:12:14.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.617+0000 7fa263e00640 1 -- 172.21.15.99:0/2150881483 <== mon.2 v2:172.21.15.181:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fa2700c6e40 con 0x5632f3a5dbc0 2024-02-21T23:12:14.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.617+0000 7fa28ca0d740 10 client.7160 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:12:14.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.617+0000 7fa28ca0d740 10 client.7160 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:12:14.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.617+0000 7fa28ca0d740 20 client.7160 populate_metadata read hostname 'smithi099' 2024-02-21T23:12:14.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.617+0000 7fa28ca0d740 1 --2- 172.21.15.99:0/2150881483 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5632f3a4faa0 0x5632f3a55490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:14.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.617+0000 7fa28ca0d740 4 client.7160 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:12:14.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.617+0000 7fa28ca0d740 1 -- 172.21.15.99:0/2150881483 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5632f3996fd0 con 0x5632f3a4faa0 2024-02-21T23:12:14.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.618+0000 7fa282a00640 1 --2- 172.21.15.99:0/2150881483 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5632f3a4faa0 0x5632f3a55490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:14.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.618+0000 7fa282a00640 1 --2- 172.21.15.99:0/2150881483 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5632f3a4faa0 0x5632f3a55490 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7aadcbb8e57e548f server_cookie=61e140918f28cb34 in_seq=0 out_seq=0 2024-02-21T23:12:14.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.618+0000 7fa263e00640 10 client.7160 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:12:14.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.619+0000 7fa263e00640 1 -- 172.21.15.99:0/2150881483 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x5632f3996fd0 con 0x5632f3a4faa0 2024-02-21T23:12:14.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.619+0000 7fa263e00640 10 client.7160 handle_command_reply: tid=0 2024-02-21T23:12:14.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.619+0000 7fa28ca0d740 1 client.7160 shutdown 2024-02-21T23:12:14.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.620+0000 7fa28ca0d740 1 -- 172.21.15.99:0/2150881483 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5632f3a5dbc0 msgr2=0x5632f3a906c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:14.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.620+0000 7fa28ca0d740 1 --2- 172.21.15.99:0/2150881483 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5632f3a5dbc0 0x5632f3a906c0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fa27000c400 tx=0x7fa270001120 comp rx=0 tx=0).stop 2024-02-21T23:12:14.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.620+0000 7fa28ca0d740 1 -- 172.21.15.99:0/2150881483 shutdown_connections 2024-02-21T23:12:14.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.620+0000 7fa28ca0d740 1 --2- 172.21.15.99:0/2150881483 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5632f3a4faa0 0x5632f3a55490 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:14.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.620+0000 7fa28ca0d740 1 --2- 172.21.15.99:0/2150881483 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5632f3a93260 0x5632f3a8eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:14.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.620+0000 7fa28ca0d740 1 --2- 172.21.15.99:0/2150881483 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5632f3a5dbc0 0x5632f3a906c0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:14.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.620+0000 7fa263e00640 0 client.7160 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:12:14.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.620+0000 7fa28ca0d740 1 --2- 172.21.15.99:0/2150881483 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5632f3a5d2a0 0x5632f3aa4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:14.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.620+0000 7fa28ca0d740 1 -- 172.21.15.99:0/2150881483 >> 172.21.15.99:0/2150881483 conn(0x5632f39ec6b0 msgr2=0x5632f3a92a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:14.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.620+0000 7fa28ca0d740 1 -- 172.21.15.99:0/2150881483 shutdown_connections 2024-02-21T23:12:14.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.620+0000 7fa28ca0d740 1 -- 172.21.15.99:0/2150881483 wait complete. 2024-02-21T23:12:14.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.620+0000 7fa28ca0d740 20 client.7160 trim_cache size 0 max 16384 2024-02-21T23:12:14.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.638+0000 7fa28ca0d740 1 Processor -- start 2024-02-21T23:12:14.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.638+0000 7fa28ca0d740 1 -- start start 2024-02-21T23:12:14.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.640+0000 7fa28ca0d740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5632f3a5d2a0 0x5632f3a905c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:14.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.640+0000 7fa28ca0d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5632f3a5dbc0 0x5632f3a59ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:14.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.640+0000 7fa28ca0d740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5632f3a93260 0x5632f3a1e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:14.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.640+0000 7fa28ca0d740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa28422c9a0 con 0x5632f3a5d2a0 2024-02-21T23:12:14.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.640+0000 7fa28ca0d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa28422a540 con 0x5632f3a5dbc0 2024-02-21T23:12:14.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.640+0000 7fa28ca0d740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2842287b0 con 0x5632f3a93260 2024-02-21T23:12:14.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.640+0000 7fa282a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5632f3a5d2a0 0x5632f3a905c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:14.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.641+0000 7fa282a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5632f3a5d2a0 0x5632f3a905c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60414/0 (socket says 172.21.15.99:60414) 2024-02-21T23:12:14.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.641+0000 7fa282a00640 1 -- 172.21.15.99:0/1452361727 learned_addr learned my addr 172.21.15.99:0/1452361727 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:12:14.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.641+0000 7fa282000640 1 --2- 172.21.15.99:0/1452361727 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5632f3a5dbc0 0x5632f3a59ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:14.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.641+0000 7fa283400640 1 --2- 172.21.15.99:0/1452361727 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5632f3a93260 0x5632f3a1e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:14.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.641+0000 7fa282000640 1 -- 172.21.15.99:0/1452361727 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5632f3a93260 msgr2=0x5632f3a1e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:14.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.641+0000 7fa282000640 1 --2- 172.21.15.99:0/1452361727 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5632f3a93260 0x5632f3a1e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:14.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.641+0000 7fa282000640 1 -- 172.21.15.99:0/1452361727 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5632f3a5d2a0 msgr2=0x5632f3a905c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:14.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.641+0000 7fa282000640 1 --2- 172.21.15.99:0/1452361727 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5632f3a5d2a0 0x5632f3a905c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:14.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.641+0000 7fa282000640 1 -- 172.21.15.99:0/1452361727 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5632f3a5d720 con 0x5632f3a5dbc0 2024-02-21T23:12:14.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.641+0000 7fa282a00640 1 --2- 172.21.15.99:0/1452361727 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5632f3a5d2a0 0x5632f3a905c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:12:14.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.641+0000 7fa282000640 1 --2- 172.21.15.99:0/1452361727 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5632f3a5dbc0 0x5632f3a59ef0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fa270004f40 tx=0x7fa2700ac040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74509f8ee0f60be4 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:14.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.641+0000 7fa26ea00640 1 -- 172.21.15.99:0/1452361727 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27007a070 con 0x5632f3a5dbc0 2024-02-21T23:12:14.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.642+0000 7fa26ea00640 1 -- 172.21.15.99:0/1452361727 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa270004b80 con 0x5632f3a5dbc0 2024-02-21T23:12:14.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.642+0000 7fa26ea00640 1 -- 172.21.15.99:0/1452361727 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2700b3040 con 0x5632f3a5dbc0 2024-02-21T23:12:14.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.642+0000 7fa28ca0d740 1 -- 172.21.15.99:0/1452361727 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5632f3a5dbc0 msgr2=0x5632f3a59ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:14.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.642+0000 7fa28ca0d740 1 --2- 172.21.15.99:0/1452361727 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5632f3a5dbc0 0x5632f3a59ef0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fa270004f40 tx=0x7fa2700ac040 comp rx=0 tx=0).stop 2024-02-21T23:12:14.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.642+0000 7fa28ca0d740 1 -- 172.21.15.99:0/1452361727 shutdown_connections 2024-02-21T23:12:14.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.642+0000 7fa28ca0d740 1 --2- 172.21.15.99:0/1452361727 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5632f3a93260 0x5632f3a1e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:14.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.642+0000 7fa28ca0d740 1 --2- 172.21.15.99:0/1452361727 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5632f3a5dbc0 0x5632f3a59ef0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:14.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.642+0000 7fa28ca0d740 1 --2- 172.21.15.99:0/1452361727 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5632f3a5d2a0 0x5632f3a905c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:14.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.643+0000 7fa28ca0d740 1 -- 172.21.15.99:0/1452361727 >> 172.21.15.99:0/1452361727 conn(0x5632f39ec6b0 msgr2=0x5632f3aa4c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:14.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.643+0000 7fa28ca0d740 1 -- 172.21.15.99:0/1452361727 shutdown_connections 2024-02-21T23:12:14.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.643+0000 7fa28ca0d740 1 -- 172.21.15.99:0/1452361727 wait complete. 2024-02-21T23:12:14.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.644+0000 7fa28ca0d740 1 -- start start 2024-02-21T23:12:14.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.644+0000 7fa28ca0d740 1 Processor -- start 2024-02-21T23:12:14.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.646+0000 7fa28ca0d740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5632f3a5d2a0 0x5632f3b06c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:14.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.646+0000 7fa28ca0d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5632f3a5dbc0 0x5632f3a92600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:14.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.646+0000 7fa28ca0d740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5632f3a93260 0x5632f3aec4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:14.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.646+0000 7fa28ca0d740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa284228c60 con 0x5632f3a5d2a0 2024-02-21T23:12:14.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.646+0000 7fa28ca0d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa284229ee0 con 0x5632f3a5dbc0 2024-02-21T23:12:14.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.646+0000 7fa28ca0d740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa284229260 con 0x5632f3a93260 2024-02-21T23:12:14.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.647+0000 7fa28ca0d740 10 client.0 _ll_register_callbacks cb 0x7fa2700976a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:12:14.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.647+0000 7fa282a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5632f3a5d2a0 0x5632f3b06c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:14.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.647+0000 7fa282a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5632f3a5d2a0 0x5632f3b06c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60428/0 (socket says 172.21.15.99:60428) 2024-02-21T23:12:14.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.647+0000 7fa282a00640 1 -- 172.21.15.99:0/1875015199 learned_addr learned my addr 172.21.15.99:0/1875015199 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:12:14.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.647+0000 7fa282000640 1 --2- 172.21.15.99:0/1875015199 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5632f3a5dbc0 0x5632f3a92600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:14.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.647+0000 7fa283400640 1 --2- 172.21.15.99:0/1875015199 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5632f3a93260 0x5632f3aec4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:14.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.647+0000 7fa282a00640 1 -- 172.21.15.99:0/1875015199 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5632f3a93260 msgr2=0x5632f3aec4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:14.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.647+0000 7fa282a00640 1 --2- 172.21.15.99:0/1875015199 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5632f3a93260 0x5632f3aec4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:14.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.647+0000 7fa282a00640 1 -- 172.21.15.99:0/1875015199 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5632f3a5dbc0 msgr2=0x5632f3a92600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:14.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.647+0000 7fa282a00640 1 --2- 172.21.15.99:0/1875015199 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5632f3a5dbc0 0x5632f3a92600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:14.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.647+0000 7fa282a00640 1 -- 172.21.15.99:0/1875015199 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5632f3b06190 con 0x5632f3a5d2a0 2024-02-21T23:12:14.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.647+0000 7fa282a00640 1 --2- 172.21.15.99:0/1875015199 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5632f3a5d2a0 0x5632f3b06c30 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x5632f3985c50 tx=0x7fa274004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba443b694222f540 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:14.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.647+0000 7fa263e00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:12:14.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.648+0000 7fa263e00640 1 -- 172.21.15.99:0/1875015199 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa274061060 con 0x5632f3a5d2a0 2024-02-21T23:12:14.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.648+0000 7fa263e00640 1 -- 172.21.15.99:0/1875015199 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(39..39 src has 1..39) v4 ==== 8965+0+0 (secure 0 0 0) 0x7fa274052790 con 0x5632f3a5d2a0 2024-02-21T23:12:14.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.648+0000 7fa28ca0d740 1 -- 172.21.15.99:0/1875015199 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa270004b80 con 0x5632f3a5d2a0 2024-02-21T23:12:14.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.648+0000 7fa263e00640 1 -- 172.21.15.99:0/1875015199 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa274034040 con 0x5632f3a5d2a0 2024-02-21T23:12:14.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.648+0000 7fa28ca0d740 10 client.7014 fetch_fsmap learned FSMap version 17 2024-02-21T23:12:14.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.648+0000 7fa28ca0d740 1 -- 172.21.15.99:0/1875015199 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5632f3b06490 con 0x5632f3a5d2a0 2024-02-21T23:12:14.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.649+0000 7fa263e00640 1 -- 172.21.15.99:0/1875015199 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa270004b80 con 0x5632f3a5d2a0 2024-02-21T23:12:14.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.649+0000 7fa263e00640 1 -- 172.21.15.99:0/1875015199 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fa27402f050 con 0x5632f3a5d2a0 2024-02-21T23:12:14.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.649+0000 7fa28ca0d740 10 client.7014 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:12:14.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.649+0000 7fa28ca0d740 10 client.7014 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:12:14.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.649+0000 7fa28ca0d740 20 client.7014 populate_metadata read hostname 'smithi099' 2024-02-21T23:12:14.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.649+0000 7fa28ca0d740 1 --2- 172.21.15.99:0/1875015199 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5632f3a8ffa0 0x5632f3af4390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:14.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.649+0000 7fa28ca0d740 4 client.7014 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T23:12:14.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.649+0000 7fa28ca0d740 1 -- 172.21.15.99:0/1875015199 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5632f3991320 con 0x5632f3a8ffa0 2024-02-21T23:12:14.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.649+0000 7fa282000640 1 --2- 172.21.15.99:0/1875015199 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5632f3a8ffa0 0x5632f3af4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:14.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.650+0000 7fa282000640 1 --2- 172.21.15.99:0/1875015199 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5632f3a8ffa0 0x5632f3af4390 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=87bf6e2632b59fc5 server_cookie=475f63ebf1b5f607 in_seq=0 out_seq=0 2024-02-21T23:12:14.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.650+0000 7fa263e00640 10 client.7014 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:12:14.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.650+0000 7fa263e00640 1 -- 172.21.15.99:0/1875015199 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5632f3991320 con 0x5632f3a8ffa0 2024-02-21T23:12:14.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.650+0000 7fa263e00640 10 client.7014 handle_command_reply: tid=0 2024-02-21T23:12:14.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.650+0000 7fa28ca0d740 1 client.7014 shutdown 2024-02-21T23:12:14.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.650+0000 7fa28ca0d740 1 -- 172.21.15.99:0/1875015199 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5632f3a5d2a0 msgr2=0x5632f3b06c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:14.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.650+0000 7fa28ca0d740 1 --2- 172.21.15.99:0/1875015199 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5632f3a5d2a0 0x5632f3b06c30 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x5632f3985c50 tx=0x7fa274004730 comp rx=0 tx=0).stop 2024-02-21T23:12:14.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.650+0000 7fa28ca0d740 1 -- 172.21.15.99:0/1875015199 shutdown_connections 2024-02-21T23:12:14.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.650+0000 7fa28ca0d740 1 --2- 172.21.15.99:0/1875015199 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x5632f3a8ffa0 0x5632f3af4390 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:14.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.650+0000 7fa28ca0d740 1 --2- 172.21.15.99:0/1875015199 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x5632f3a93260 0x5632f3aec4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:14.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.650+0000 7fa28ca0d740 1 --2- 172.21.15.99:0/1875015199 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5632f3a5dbc0 0x5632f3a92600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:14.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.650+0000 7fa28ca0d740 1 --2- 172.21.15.99:0/1875015199 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x5632f3a5d2a0 0x5632f3b06c30 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:14.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.650+0000 7fa263e00640 0 client.7014 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:12:14.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.650+0000 7fa28ca0d740 1 -- 172.21.15.99:0/1875015199 >> 172.21.15.99:0/1875015199 conn(0x5632f39ec6b0 msgr2=0x5632f3a90410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:14.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.650+0000 7fa28ca0d740 1 -- 172.21.15.99:0/1875015199 shutdown_connections 2024-02-21T23:12:14.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.651+0000 7fa28ca0d740 1 -- 172.21.15.99:0/1875015199 wait complete. 2024-02-21T23:12:14.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.651+0000 7fa28ca0d740 20 client.7014 trim_cache size 0 max 16384 2024-02-21T23:12:14.644 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-02-21T23:12:14.644 INFO:teuthology.orchestra.run.smithi099.stdout: "status": "no active scrubs running", 2024-02-21T23:12:14.644 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubs": {} 2024-02-21T23:12:14.644 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-02-21T23:12:14.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.651+0000 7fa283e00640 1 -- 172.21.15.99:0/873462417 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa26409eed0 msgr2=0x7fa2640a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:14.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.651+0000 7fa283e00640 1 --2- 172.21.15.99:0/873462417 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa26409eed0 0x7fa2640a1390 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa274009560 tx=0x7fa27403b040 comp rx=0 tx=0).stop 2024-02-21T23:12:14.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.651+0000 7fa283e00640 1 -- 172.21.15.99:0/873462417 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa28418b060 msgr2=0x7fa284174d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:14.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.651+0000 7fa283e00640 1 --2- 172.21.15.99:0/873462417 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa28418b060 0x7fa284174d30 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fa27000c430 tx=0x7fa27000c8f0 comp rx=0 tx=0).stop 2024-02-21T23:12:14.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.652+0000 7fa283e00640 1 -- 172.21.15.99:0/873462417 shutdown_connections 2024-02-21T23:12:14.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.652+0000 7fa283e00640 1 --2- 172.21.15.99:0/873462417 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa26409eed0 0x7fa2640a1390 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:14.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.652+0000 7fa283e00640 1 --2- 172.21.15.99:0/873462417 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa28418b4f0 0x7fa284220180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:14.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.652+0000 7fa283e00640 1 --2- 172.21.15.99:0/873462417 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa28418b060 0x7fa284174d30 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:14.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.652+0000 7fa283e00640 1 --2- 172.21.15.99:0/873462417 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa28417f490 0x7fa28421f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:14.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.652+0000 7fa283e00640 1 -- 172.21.15.99:0/873462417 >> 172.21.15.99:0/873462417 conn(0x7fa2840d29b0 msgr2=0x7fa28415e850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:14.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.652+0000 7fa283e00640 1 -- 172.21.15.99:0/873462417 shutdown_connections 2024-02-21T23:12:14.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.652+0000 7fa283e00640 1 -- 172.21.15.99:0/873462417 wait complete. 2024-02-21T23:12:14.656 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-02-21T23:12:14.656 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T23:12:14.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.871+0000 7f6e37e00640 1 Processor -- start 2024-02-21T23:12:14.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.871+0000 7f6e37e00640 1 -- start start 2024-02-21T23:12:14.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.874+0000 7f6e37e00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f6e3806f1c0 0x7f6e3806f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:14.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.874+0000 7f6e37e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f6e3806fae0 0x7f6e3806af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:14.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.874+0000 7f6e37e00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e380fa160 con 0x7f6e3806b4c0 2024-02-21T23:12:14.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.874+0000 7f6e37e00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e380fad70 con 0x7f6e3806fae0 2024-02-21T23:12:14.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.874+0000 7f6e37e00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e38189a60 con 0x7f6e3806f1c0 2024-02-21T23:12:14.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.874+0000 7f6e36a00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f6e3806f1c0 0x7f6e3806f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:14.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.874+0000 7f6e36000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f6e3806fae0 0x7f6e3806af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:14.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.874+0000 7f6e36a00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f6e3806f1c0 0x7f6e3806f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:46788/0 (socket says 172.21.15.99:46788) 2024-02-21T23:12:14.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.874+0000 7f6e36a00640 1 -- 172.21.15.99:0/168882204 learned_addr learned my addr 172.21.15.99:0/168882204 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:12:14.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.874+0000 7f6e36000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f6e3806fae0 0x7f6e3806af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:51070/0 (socket says 172.21.15.99:51070) 2024-02-21T23:12:14.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.874+0000 7f6e37400640 1 --1- 172.21.15.99:0/168882204 >> v1:172.21.15.99:6789/0 conn(0x7f6e3806b4c0 0x7f6e38186a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:40308/0 (socket says 172.21.15.99:40308) 2024-02-21T23:12:14.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.874+0000 7f6e36a00640 1 -- 172.21.15.99:0/168882204 >> v2:172.21.15.162:3300/0 conn(0x7f6e3806fae0 msgr2=0x7f6e3806af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:14.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.874+0000 7f6e36a00640 1 --2- 172.21.15.99:0/168882204 >> v2:172.21.15.162:3300/0 conn(0x7f6e3806fae0 0x7f6e3806af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:14.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.874+0000 7f6e36a00640 1 -- 172.21.15.99:0/168882204 >> v1:172.21.15.99:6789/0 conn(0x7f6e3806b4c0 legacy=0x7f6e38186a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:14.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.874+0000 7f6e36a00640 1 -- 172.21.15.99:0/168882204 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e380fa440 con 0x7f6e3806f1c0 2024-02-21T23:12:14.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.876+0000 7f6e36a00640 1 --2- 172.21.15.99:0/168882204 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6e3806f1c0 0x7f6e3806f5a0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f6e38073640 tx=0x7f6e2802b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f7cd6f2dc15d360 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:14.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.876+0000 7f6e35600640 1 -- 172.21.15.99:0/168882204 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e28035020 con 0x7f6e3806f1c0 2024-02-21T23:12:14.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.876+0000 7f6e35600640 1 -- 172.21.15.99:0/168882204 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e28031870 con 0x7f6e3806f1c0 2024-02-21T23:12:14.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.876+0000 7f6e35600640 1 -- 172.21.15.99:0/168882204 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e28031c40 con 0x7f6e3806f1c0 2024-02-21T23:12:14.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.877+0000 7f6e37e00640 1 -- 172.21.15.99:0/168882204 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6e3806f1c0 msgr2=0x7f6e3806f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:14.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.877+0000 7f6e37e00640 1 --2- 172.21.15.99:0/168882204 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6e3806f1c0 0x7f6e3806f5a0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f6e38073640 tx=0x7f6e2802b910 comp rx=0 tx=0).stop 2024-02-21T23:12:14.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.877+0000 7f6e37e00640 1 -- 172.21.15.99:0/168882204 shutdown_connections 2024-02-21T23:12:14.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.877+0000 7f6e37e00640 1 --2- 172.21.15.99:0/168882204 >> v2:172.21.15.162:3300/0 conn(0x7f6e3806fae0 0x7f6e3806af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:14.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.877+0000 7f6e37e00640 1 --2- 172.21.15.99:0/168882204 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6e3806f1c0 0x7f6e3806f5a0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:14.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.877+0000 7f6e37e00640 1 -- 172.21.15.99:0/168882204 >> 172.21.15.99:0/168882204 conn(0x7f6e380f8bb0 msgr2=0x7f6e380f8fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:14.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.877+0000 7f6e37e00640 1 -- 172.21.15.99:0/168882204 shutdown_connections 2024-02-21T23:12:14.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.877+0000 7f6e37e00640 1 -- 172.21.15.99:0/168882204 wait complete. 2024-02-21T23:12:14.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.880+0000 7f6e37e00640 1 Processor -- start 2024-02-21T23:12:14.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.880+0000 7f6e37e00640 1 -- start start 2024-02-21T23:12:14.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.882+0000 7f6e37e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6e3806b4c0 0x7f6e381878e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:14.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.882+0000 7f6e37e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6e3806f1c0 0x7f6e38170ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:14.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.882+0000 7f6e37e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e3806fae0 0x7f6e380f69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:14.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.882+0000 7f6e37e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e38186640 con 0x7f6e3806fae0 2024-02-21T23:12:14.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.882+0000 7f6e37e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e380faa00 con 0x7f6e3806b4c0 2024-02-21T23:12:14.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.882+0000 7f6e37e00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3806ff20 con 0x7f6e3806f1c0 2024-02-21T23:12:14.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.883+0000 7f6e37400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e3806fae0 0x7f6e380f69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:14.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.883+0000 7f6e36a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6e3806b4c0 0x7f6e381878e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:14.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.883+0000 7f6e36a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6e3806b4c0 0x7f6e381878e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:51084/0 (socket says 172.21.15.99:51084) 2024-02-21T23:12:14.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.883+0000 7f6e36a00640 1 -- 172.21.15.99:0/785934854 learned_addr learned my addr 172.21.15.99:0/785934854 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:12:14.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.883+0000 7f6e36000640 1 --2- 172.21.15.99:0/785934854 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6e3806f1c0 0x7f6e38170ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:14.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.883+0000 7f6e36a00640 1 -- 172.21.15.99:0/785934854 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6e3806f1c0 msgr2=0x7f6e38170ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:14.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.883+0000 7f6e36a00640 1 --2- 172.21.15.99:0/785934854 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6e3806f1c0 0x7f6e38170ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:14.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.883+0000 7f6e36a00640 1 -- 172.21.15.99:0/785934854 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e3806fae0 msgr2=0x7f6e380f69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:14.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.883+0000 7f6e36a00640 1 --2- 172.21.15.99:0/785934854 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e3806fae0 0x7f6e380f69b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:14.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.883+0000 7f6e36a00640 1 -- 172.21.15.99:0/785934854 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e38184f20 con 0x7f6e3806b4c0 2024-02-21T23:12:14.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.884+0000 7f6e36a00640 1 --2- 172.21.15.99:0/785934854 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6e3806b4c0 0x7f6e381878e0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f6e2802b950 tx=0x7f6e280046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:14.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.884+0000 7f6e2ea00640 1 -- 172.21.15.99:0/785934854 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e28040070 con 0x7f6e3806b4c0 2024-02-21T23:12:14.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.884+0000 7f6e2ea00640 1 -- 172.21.15.99:0/785934854 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e28030d00 con 0x7f6e3806b4c0 2024-02-21T23:12:14.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.884+0000 7f6e37e00640 1 -- 172.21.15.99:0/785934854 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e38186b20 con 0x7f6e3806b4c0 2024-02-21T23:12:14.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.884+0000 7f6e2ea00640 1 -- 172.21.15.99:0/785934854 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e28035040 con 0x7f6e3806b4c0 2024-02-21T23:12:14.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.884+0000 7f6e37e00640 1 -- 172.21.15.99:0/785934854 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e381870e0 con 0x7f6e3806b4c0 2024-02-21T23:12:14.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.885+0000 7f6e37e00640 1 -- 172.21.15.99:0/785934854 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e38068320 con 0x7f6e3806b4c0 2024-02-21T23:12:14.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.887+0000 7f6e2ea00640 1 -- 172.21.15.99:0/785934854 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f6e2804b060 con 0x7f6e3806b4c0 2024-02-21T23:12:14.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.890+0000 7f6e2ea00640 1 --2- 172.21.15.99:0/785934854 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f6e1809ef00 0x7f6e180a13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:14.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.890+0000 7f6e2ea00640 1 -- 172.21.15.99:0/785934854 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f6e280ebf20 con 0x7f6e3806b4c0 2024-02-21T23:12:14.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.890+0000 7f6e36000640 1 --2- 172.21.15.99:0/785934854 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f6e1809ef00 0x7f6e180a13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:14.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.891+0000 7f6e2ea00640 1 -- 172.21.15.99:0/785934854 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f6e280b9ed0 con 0x7f6e3806b4c0 2024-02-21T23:12:14.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:14.891+0000 7f6e36000640 1 --2- 172.21.15.99:0/785934854 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f6e1809ef00 0x7f6e180a13c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6e380f2f00 tx=0x7f6e24009190 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:15.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.234+0000 7f6e37e00640 1 -- 172.21.15.99:0/785934854 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6e3806b950 con 0x7f6e3806b4c0 2024-02-21T23:12:15.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.235+0000 7f6e2ea00640 1 -- 172.21.15.99:0/785934854 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+11335 (secure 0 0 0) 0x7f6e280b97d0 con 0x7f6e3806b4c0 2024-02-21T23:12:15.223 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T23:12:15.223 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4307,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/3514452812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3514452812},{"type":"v1","addr":"172.21.15.162:6836","nonce":3514452812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4312,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6838/2169982089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":2169982089},{"type":"v1","addr":"172.21.15.162:6838","nonce":2169982089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4315,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6839/3335972724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6837","nonce":3335972724},{"type":"v1","addr":"172.21.15.162:6839","nonce":3335972724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4318,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6841/2135456697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6840","nonce":2135456697},{"type":"v1","addr":"172.21.15.162:6841","nonce":2135456697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4325,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2452242758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2452242758},{"type":"v1","addr":"172.21.15.181:6833","nonce":2452242758}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4328,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6836/2751486400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":2751486400},{"type":"v1","addr":"172.21.15.181:6836","nonce":2751486400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":17,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-21T23:01:02.656130+0000","modified":"2024-02-21T23:07:03.165223+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4355,"mds_1":4352,"mds_2":4348},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4331":{"gid":4331,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6838/3728901330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6835","nonce":3728901330},{"type":"v1","addr":"172.21.15.181:6838","nonce":3728901330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4339":{"gid":4339,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6839/3357929641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6837","nonce":3357929641},{"type":"v1","addr":"172.21.15.181:6839","nonce":3357929641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4343":{"gid":4343,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6833/2793485078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":2793485078},{"type":"v1","addr":"172.21.15.99:6833","nonce":2793485078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4348":{"gid":4348,"name":"d","rank":2,"incarnation":12,"state":"up:active","state_seq":10,"addr":"172.21.15.99:6835/2243461688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2243461688},{"type":"v1","addr":"172.21.15.99:6835","nonce":2243461688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4352":{"gid":4352,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.99:6837/1676159950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":1676159950},{"type":"v1","addr":"172.21.15.99:6837","nonce":1676159950}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4355":{"gid":4355,"name":"j","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6839/4239008786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":4239008786},{"type":"v1","addr":"172.21.15.99:6839","nonce":4239008786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-21T23:12:15.223 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 17 2024-02-21T23:12:15.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.238+0000 7f6e37e00640 1 -- 172.21.15.99:0/785934854 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f6e1809ef00 msgr2=0x7f6e180a13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:15.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.238+0000 7f6e37e00640 1 --2- 172.21.15.99:0/785934854 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f6e1809ef00 0x7f6e180a13c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6e380f2f00 tx=0x7f6e24009190 comp rx=0 tx=0).stop 2024-02-21T23:12:15.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.238+0000 7f6e37e00640 1 -- 172.21.15.99:0/785934854 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6e3806b4c0 msgr2=0x7f6e381878e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:15.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.238+0000 7f6e37e00640 1 --2- 172.21.15.99:0/785934854 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6e3806b4c0 0x7f6e381878e0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f6e2802b950 tx=0x7f6e280046c0 comp rx=0 tx=0).stop 2024-02-21T23:12:15.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.238+0000 7f6e37e00640 1 -- 172.21.15.99:0/785934854 shutdown_connections 2024-02-21T23:12:15.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.238+0000 7f6e37e00640 1 --2- 172.21.15.99:0/785934854 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f6e1809ef00 0x7f6e180a13c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:15.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.238+0000 7f6e37e00640 1 --2- 172.21.15.99:0/785934854 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6e3806fae0 0x7f6e380f69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:15.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.238+0000 7f6e37e00640 1 --2- 172.21.15.99:0/785934854 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6e3806f1c0 0x7f6e38170ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:15.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.238+0000 7f6e37e00640 1 --2- 172.21.15.99:0/785934854 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6e3806b4c0 0x7f6e381878e0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:15.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.238+0000 7f6e37e00640 1 -- 172.21.15.99:0/785934854 >> 172.21.15.99:0/785934854 conn(0x7f6e380f8bb0 msgr2=0x7f6e38066c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:15.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.239+0000 7f6e37e00640 1 -- 172.21.15.99:0/785934854 shutdown_connections 2024-02-21T23:12:15.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.239+0000 7f6e37e00640 1 -- 172.21.15.99:0/785934854 wait complete. 2024-02-21T23:12:15.252 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T23:12:15.253 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-02-21T23:12:15.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.477+0000 7fb15a600640 1 Processor -- start 2024-02-21T23:12:15.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.477+0000 7fb15a600640 1 -- start start 2024-02-21T23:12:15.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.479+0000 7fb15a600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb1540d60b0 0x7fb1540fc990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:15.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.479+0000 7fb15a600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1540d6dd0 con 0x7fb15418b230 2024-02-21T23:12:15.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.480+0000 7fb15a600640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1541614c0 con 0x7fb15417f490 2024-02-21T23:12:15.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.480+0000 7fb15a600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1540d6810 con 0x7fb1540d60b0 2024-02-21T23:12:15.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.480+0000 7fb159c00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb1540d60b0 0x7fb1540fc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:15.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.480+0000 7fb159200640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fb15417f490 0x7fb15418ab20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:57948/0 (socket says 172.21.15.99:57948) 2024-02-21T23:12:15.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.480+0000 7fb159200640 1 -- 172.21.15.99:0/1731148402 learned_addr learned my addr 172.21.15.99:0/1731148402 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:12:15.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.480+0000 7fb153400640 1 -- 172.21.15.99:0/1731148402 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1320334479 0 0) 0x7fb1541614c0 con 0x7fb15417f490 2024-02-21T23:12:15.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.480+0000 7fb159c00640 1 -- 172.21.15.99:0/1731148402 >> v1:172.21.15.181:6789/0 conn(0x7fb15417f490 legacy=0x7fb15418ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:15.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.480+0000 7fb159c00640 1 -- 172.21.15.99:0/1731148402 >> v1:172.21.15.162:6789/0 conn(0x7fb15418b230 legacy=0x7fb1540fc280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:15.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.480+0000 7fb159c00640 1 -- 172.21.15.99:0/1731148402 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1540d6af0 con 0x7fb1540d60b0 2024-02-21T23:12:15.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.482+0000 7fb159c00640 1 --2- 172.21.15.99:0/1731148402 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb1540d60b0 0x7fb1540fc990 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fb14c009d90 tx=0x7fb14c02bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=289aa7fa60aa6adc server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:15.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.482+0000 7fb153400640 1 -- 172.21.15.99:0/1731148402 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb14c039070 con 0x7fb1540d60b0 2024-02-21T23:12:15.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.482+0000 7fb153400640 1 -- 172.21.15.99:0/1731148402 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb14c02cd00 con 0x7fb1540d60b0 2024-02-21T23:12:15.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.482+0000 7fb153400640 1 -- 172.21.15.99:0/1731148402 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb14c034660 con 0x7fb1540d60b0 2024-02-21T23:12:15.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.483+0000 7fb15a600640 1 -- 172.21.15.99:0/1731148402 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb1540d60b0 msgr2=0x7fb1540fc990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:15.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.483+0000 7fb15a600640 1 --2- 172.21.15.99:0/1731148402 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb1540d60b0 0x7fb1540fc990 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fb14c009d90 tx=0x7fb14c02bf50 comp rx=0 tx=0).stop 2024-02-21T23:12:15.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.483+0000 7fb15a600640 1 -- 172.21.15.99:0/1731148402 shutdown_connections 2024-02-21T23:12:15.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.483+0000 7fb15a600640 1 --2- 172.21.15.99:0/1731148402 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb1540d60b0 0x7fb1540fc990 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:15.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.483+0000 7fb15a600640 1 -- 172.21.15.99:0/1731148402 >> 172.21.15.99:0/1731148402 conn(0x7fb1540d29b0 msgr2=0x7fb1540d2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:15.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.483+0000 7fb15a600640 1 -- 172.21.15.99:0/1731148402 shutdown_connections 2024-02-21T23:12:15.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.483+0000 7fb15a600640 1 -- 172.21.15.99:0/1731148402 wait complete. 2024-02-21T23:12:15.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.485+0000 7fb15a600640 1 Processor -- start 2024-02-21T23:12:15.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.485+0000 7fb15a600640 1 -- start start 2024-02-21T23:12:15.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.486+0000 7fb15a600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb1540d60b0 0x7fb154179a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:15.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.486+0000 7fb15a600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb15417f490 0x7fb154171f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:15.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.486+0000 7fb15a600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb15418b230 0x7fb154220400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:15.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.486+0000 7fb15a600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb15418a600 con 0x7fb1540d60b0 2024-02-21T23:12:15.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.486+0000 7fb15a600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb15418a320 con 0x7fb15418b230 2024-02-21T23:12:15.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.486+0000 7fb15a600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1540d6500 con 0x7fb15417f490 2024-02-21T23:12:15.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.487+0000 7fb159200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb1540d60b0 0x7fb154179a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:15.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.487+0000 7fb159200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb1540d60b0 0x7fb154179a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60458/0 (socket says 172.21.15.99:60458) 2024-02-21T23:12:15.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.487+0000 7fb159200640 1 -- 172.21.15.99:0/3231047385 learned_addr learned my addr 172.21.15.99:0/3231047385 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:12:15.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.487+0000 7fb153e00640 1 --2- 172.21.15.99:0/3231047385 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb15417f490 0x7fb154171f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:15.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.487+0000 7fb159c00640 1 --2- 172.21.15.99:0/3231047385 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb15418b230 0x7fb154220400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:15.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.487+0000 7fb159200640 1 -- 172.21.15.99:0/3231047385 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb15417f490 msgr2=0x7fb154171f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:15.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.487+0000 7fb159200640 1 --2- 172.21.15.99:0/3231047385 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb15417f490 0x7fb154171f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:15.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.487+0000 7fb159200640 1 -- 172.21.15.99:0/3231047385 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb15418b230 msgr2=0x7fb154220400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:15.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.487+0000 7fb159200640 1 --2- 172.21.15.99:0/3231047385 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb15418b230 0x7fb154220400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:15.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.487+0000 7fb159200640 1 -- 172.21.15.99:0/3231047385 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb15417a190 con 0x7fb1540d60b0 2024-02-21T23:12:15.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.488+0000 7fb159200640 1 --2- 172.21.15.99:0/3231047385 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb1540d60b0 0x7fb154179a30 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fb14800c4d0 tx=0x7fb14800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:15.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.488+0000 7fb150c00640 1 -- 172.21.15.99:0/3231047385 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb148018070 con 0x7fb1540d60b0 2024-02-21T23:12:15.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.488+0000 7fb150c00640 1 -- 172.21.15.99:0/3231047385 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb148007500 con 0x7fb1540d60b0 2024-02-21T23:12:15.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.488+0000 7fb15a600640 1 -- 172.21.15.99:0/3231047385 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb15417a470 con 0x7fb1540d60b0 2024-02-21T23:12:15.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.488+0000 7fb150c00640 1 -- 172.21.15.99:0/3231047385 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb148004a20 con 0x7fb1540d60b0 2024-02-21T23:12:15.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.488+0000 7fb15a600640 1 -- 172.21.15.99:0/3231047385 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb15417aa30 con 0x7fb1540d60b0 2024-02-21T23:12:15.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.494+0000 7fb150c00640 1 -- 172.21.15.99:0/3231047385 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7fb14801b070 con 0x7fb1540d60b0 2024-02-21T23:12:15.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.494+0000 7fb15eb6f740 1 Processor -- start 2024-02-21T23:12:15.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.494+0000 7fb15eb6f740 1 -- start start 2024-02-21T23:12:15.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.495+0000 7fb150c00640 1 --2- 172.21.15.99:0/3231047385 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fb13409eed0 0x7fb1340a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:15.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.495+0000 7fb150c00640 1 -- 172.21.15.99:0/3231047385 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 8877+0+0 (secure 0 0 0) 0x7fb1480c9190 con 0x7fb1540d60b0 2024-02-21T23:12:15.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.495+0000 7fb159c00640 1 --2- 172.21.15.99:0/3231047385 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fb13409eed0 0x7fb1340a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:15.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.496+0000 7fb15eb6f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f0272c0660 0x55f0272c0a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:15.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.496+0000 7fb15eb6f740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f0272fb330 0x55f0272fb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:15.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.496+0000 7fb15eb6f740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f0272fbcf0 0x55f0272fc560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:15.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.496+0000 7fb15eb6f740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0271e8b50 con 0x55f0272fbcf0 2024-02-21T23:12:15.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.496+0000 7fb15eb6f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f027191da0 con 0x55f0272c0660 2024-02-21T23:12:15.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.496+0000 7fb15eb6f740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0271e4bf0 con 0x55f0272fb330 2024-02-21T23:12:15.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.496+0000 7fb159200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f0272c0660 0x55f0272c0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:15.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.496+0000 7fb159200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f0272c0660 0x55f0272c0a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:51112/0 (socket says 172.21.15.99:51112) 2024-02-21T23:12:15.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.496+0000 7fb159200640 1 -- 172.21.15.99:0/468125254 learned_addr learned my addr 172.21.15.99:0/468125254 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:12:15.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.496+0000 7fb159c00640 1 --2- 172.21.15.99:0/3231047385 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fb13409eed0 0x7fb1340a1390 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb14c036000 tx=0x7fb14c030000 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:15.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.496+0000 7fb159c00640 1 --2- 172.21.15.99:0/468125254 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f0272fbcf0 0x55f0272fc560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:15.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.496+0000 7fb153e00640 1 --2- 172.21.15.99:0/468125254 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f0272fb330 0x55f0272fb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:15.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.497+0000 7fb159200640 1 -- 172.21.15.99:0/468125254 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f0272fb330 msgr2=0x55f0272fb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:15.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.497+0000 7fb159200640 1 --2- 172.21.15.99:0/468125254 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f0272fb330 0x55f0272fb7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:15.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.497+0000 7fb159200640 1 -- 172.21.15.99:0/468125254 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f0272fbcf0 msgr2=0x55f0272fc560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:15.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.497+0000 7fb159200640 1 --2- 172.21.15.99:0/468125254 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f0272fbcf0 0x55f0272fc560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:15.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.497+0000 7fb159200640 1 -- 172.21.15.99:0/468125254 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f0271b4f80 con 0x55f0272c0660 2024-02-21T23:12:15.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.497+0000 7fb159c00640 1 --2- 172.21.15.99:0/468125254 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f0272fbcf0 0x55f0272fc560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:12:15.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.497+0000 7fb159200640 1 --2- 172.21.15.99:0/468125254 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f0272c0660 0x55f0272c0a40 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fb14809ec50 tx=0x7fb148096c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=259da4af0ad7d178 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:15.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.497+0000 7fb145600640 1 -- 172.21.15.99:0/468125254 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1480c69a0 con 0x55f0272c0660 2024-02-21T23:12:15.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.497+0000 7fb145600640 1 -- 172.21.15.99:0/468125254 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1480c6b40 con 0x55f0272c0660 2024-02-21T23:12:15.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.497+0000 7fb145600640 1 -- 172.21.15.99:0/468125254 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb148004dc0 con 0x55f0272c0660 2024-02-21T23:12:15.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.498+0000 7fb15eb6f740 1 -- 172.21.15.99:0/468125254 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f0272c0660 msgr2=0x55f0272c0a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:15.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.498+0000 7fb15eb6f740 1 --2- 172.21.15.99:0/468125254 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f0272c0660 0x55f0272c0a40 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fb14809ec50 tx=0x7fb148096c10 comp rx=0 tx=0).stop 2024-02-21T23:12:15.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.498+0000 7fb15eb6f740 1 -- 172.21.15.99:0/468125254 shutdown_connections 2024-02-21T23:12:15.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.498+0000 7fb15eb6f740 1 --2- 172.21.15.99:0/468125254 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f0272fbcf0 0x55f0272fc560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:15.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.498+0000 7fb15eb6f740 1 --2- 172.21.15.99:0/468125254 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f0272fb330 0x55f0272fb7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:15.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.498+0000 7fb15eb6f740 1 --2- 172.21.15.99:0/468125254 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f0272c0660 0x55f0272c0a40 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:15.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.498+0000 7fb15eb6f740 1 -- 172.21.15.99:0/468125254 >> 172.21.15.99:0/468125254 conn(0x55f0272826d0 msgr2=0x55f027283750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:15.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.498+0000 7fb15eb6f740 1 -- 172.21.15.99:0/468125254 shutdown_connections 2024-02-21T23:12:15.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.499+0000 7fb15eb6f740 1 -- 172.21.15.99:0/468125254 wait complete. 2024-02-21T23:12:15.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.499+0000 7fb15eb6f740 1 -- start start 2024-02-21T23:12:15.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.500+0000 7fb15eb6f740 1 Processor -- start 2024-02-21T23:12:15.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.501+0000 7fb15eb6f740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f0272fb330 0x55f0272f4e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:15.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.501+0000 7fb15eb6f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f0272fbcf0 0x55f0272b6740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:15.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.501+0000 7fb15eb6f740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f027302d60 0x55f027304e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:15.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.501+0000 7fb15eb6f740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f027191da0 con 0x55f0272fb330 2024-02-21T23:12:15.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.501+0000 7fb15eb6f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f027187380 con 0x55f0272fbcf0 2024-02-21T23:12:15.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.501+0000 7fb15eb6f740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0272fa0a0 con 0x55f027302d60 2024-02-21T23:12:15.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.501+0000 7fb15eb6f740 10 client.0 _ll_register_callbacks cb 0x55f0271e0280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:12:15.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.501+0000 7fb159200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f0272fb330 0x55f0272f4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:15.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.501+0000 7fb159200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f0272fb330 0x55f0272f4e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60476/0 (socket says 172.21.15.99:60476) 2024-02-21T23:12:15.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.501+0000 7fb159200640 1 -- 172.21.15.99:0/3908953994 learned_addr learned my addr 172.21.15.99:0/3908953994 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:12:15.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.501+0000 7fb159c00640 1 --2- 172.21.15.99:0/3908953994 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f027302d60 0x55f027304e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:15.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.502+0000 7fb153e00640 1 --2- 172.21.15.99:0/3908953994 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f0272fbcf0 0x55f0272b6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:15.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.502+0000 7fb159c00640 1 -- 172.21.15.99:0/3908953994 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f0272fbcf0 msgr2=0x55f0272b6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:15.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.502+0000 7fb159c00640 1 --2- 172.21.15.99:0/3908953994 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f0272fbcf0 0x55f0272b6740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:15.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.502+0000 7fb159c00640 1 -- 172.21.15.99:0/3908953994 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f0272fb330 msgr2=0x55f0272f4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:15.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.502+0000 7fb159c00640 1 --2- 172.21.15.99:0/3908953994 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f0272fb330 0x55f0272f4e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:15.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.502+0000 7fb159c00640 1 -- 172.21.15.99:0/3908953994 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f0271afc20 con 0x55f027302d60 2024-02-21T23:12:15.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.502+0000 7fb159200640 1 --2- 172.21.15.99:0/3908953994 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f0272fb330 0x55f0272f4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:12:15.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.503+0000 7fb159c00640 1 --2- 172.21.15.99:0/3908953994 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f027302d60 0x55f027304e80 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fb154160a80 tx=0x7fb14c004ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f7ea5e5e9810871 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:15.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.503+0000 7fb13a000640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-02-21T23:12:15.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.503+0000 7fb13a000640 1 -- 172.21.15.99:0/3908953994 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb14c04f030 con 0x55f027302d60 2024-02-21T23:12:15.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.503+0000 7fb15eb6f740 1 -- 172.21.15.99:0/3908953994 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb1480c6b40 con 0x55f027302d60 2024-02-21T23:12:15.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.503+0000 7fb13a000640 1 -- 172.21.15.99:0/3908953994 <== mon.2 v2:172.21.15.181:3300/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 8877+0+0 (secure 0 0 0) 0x7fb14c0047a0 con 0x55f027302d60 2024-02-21T23:12:15.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.503+0000 7fb13a000640 1 -- 172.21.15.99:0/3908953994 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb14c043040 con 0x55f027302d60 2024-02-21T23:12:15.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.503+0000 7fb15eb6f740 10 client.7184 fetch_fsmap learned FSMap version 17 2024-02-21T23:12:15.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.503+0000 7fb15eb6f740 1 -- 172.21.15.99:0/3908953994 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55f026efd3f0 con 0x55f027302d60 2024-02-21T23:12:15.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.504+0000 7fb13a000640 1 -- 172.21.15.99:0/3908953994 <== mon.2 v2:172.21.15.181:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1480c6b40 con 0x55f027302d60 2024-02-21T23:12:15.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.504+0000 7fb13a000640 1 -- 172.21.15.99:0/3908953994 <== mon.2 v2:172.21.15.181:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fb14c049040 con 0x55f027302d60 2024-02-21T23:12:15.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.504+0000 7fb15eb6f740 10 client.7184 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:12:15.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.504+0000 7fb15eb6f740 10 client.7184 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.d 2024-02-21T23:12:15.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.504+0000 7fb15eb6f740 20 client.7184 populate_metadata read hostname 'smithi099' 2024-02-21T23:12:15.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.504+0000 7fb15eb6f740 1 --2- 172.21.15.99:0/3908953994 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x55f0273031e0 0x55f0272f5570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:15.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.504+0000 7fb15eb6f740 4 client.7184 mds_command: new command op to 4348 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:12:15.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.504+0000 7fb15eb6f740 1 -- 172.21.15.99:0/3908953994 --> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f0271f6090 con 0x55f0273031e0 2024-02-21T23:12:15.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.504+0000 7fb159200640 1 --2- 172.21.15.99:0/3908953994 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x55f0273031e0 0x55f0272f5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:15.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.505+0000 7fb159200640 1 --2- 172.21.15.99:0/3908953994 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x55f0273031e0 0x55f0272f5570 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=85c30930f8170fea server_cookie=3e4818cae587cedd in_seq=0 out_seq=0 2024-02-21T23:12:15.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.505+0000 7fb13a000640 10 client.7184 ms_handle_connect on v2:172.21.15.99:6834/2243461688 2024-02-21T23:12:15.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.506+0000 7fb13a000640 1 -- 172.21.15.99:0/3908953994 <== mds.2 v2:172.21.15.99:6834/2243461688 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55f0271f6090 con 0x55f0273031e0 2024-02-21T23:12:15.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.506+0000 7fb13a000640 10 client.7184 handle_command_reply: tid=0 2024-02-21T23:12:15.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.506+0000 7fb15eb6f740 1 client.7184 shutdown 2024-02-21T23:12:15.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.506+0000 7fb15eb6f740 1 -- 172.21.15.99:0/3908953994 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f027302d60 msgr2=0x55f027304e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:15.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.506+0000 7fb15eb6f740 1 --2- 172.21.15.99:0/3908953994 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f027302d60 0x55f027304e80 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fb154160a80 tx=0x7fb14c004ab0 comp rx=0 tx=0).stop 2024-02-21T23:12:15.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.506+0000 7fb15eb6f740 1 -- 172.21.15.99:0/3908953994 shutdown_connections 2024-02-21T23:12:15.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.506+0000 7fb15eb6f740 1 --2- 172.21.15.99:0/3908953994 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x55f0273031e0 0x55f0272f5570 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:15.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.507+0000 7fb15eb6f740 1 --2- 172.21.15.99:0/3908953994 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f027302d60 0x55f027304e80 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:15.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.507+0000 7fb15eb6f740 1 --2- 172.21.15.99:0/3908953994 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f0272fbcf0 0x55f0272b6740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:15.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.507+0000 7fb15eb6f740 1 --2- 172.21.15.99:0/3908953994 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f0272fb330 0x55f0272f4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:15.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.507+0000 7fb15eb6f740 1 -- 172.21.15.99:0/3908953994 >> 172.21.15.99:0/3908953994 conn(0x55f0272c0660 msgr2=0x55f0272fa570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:15.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.507+0000 7fb13a000640 0 client.7184 ms_handle_reset on v2:172.21.15.99:6834/2243461688 2024-02-21T23:12:15.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.507+0000 7fb15eb6f740 1 -- 172.21.15.99:0/3908953994 shutdown_connections 2024-02-21T23:12:15.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.507+0000 7fb15eb6f740 1 -- 172.21.15.99:0/3908953994 wait complete. 2024-02-21T23:12:15.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.507+0000 7fb15eb6f740 20 client.7184 trim_cache size 0 max 16384 2024-02-21T23:12:15.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.520+0000 7fb15eb6f740 1 Processor -- start 2024-02-21T23:12:15.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.520+0000 7fb15eb6f740 1 -- start start 2024-02-21T23:12:15.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.521+0000 7fb15eb6f740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f0272fb330 0x55f0272fb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:15.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.522+0000 7fb15eb6f740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f0272fbcf0 0x55f0272c8b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:15.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.522+0000 7fb15eb6f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f027302d60 0x55f02727e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:15.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.522+0000 7fb15eb6f740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb15422c940 con 0x55f0272fb330 2024-02-21T23:12:15.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.522+0000 7fb15eb6f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb15422a4e0 con 0x55f027302d60 2024-02-21T23:12:15.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.522+0000 7fb15eb6f740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb15406c260 con 0x55f0272fbcf0 2024-02-21T23:12:15.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.522+0000 7fb159200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f0272fb330 0x55f0272fb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:15.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.522+0000 7fb159200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f0272fb330 0x55f0272fb7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60490/0 (socket says 172.21.15.99:60490) 2024-02-21T23:12:15.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.522+0000 7fb159200640 1 -- 172.21.15.99:0/1129316048 learned_addr learned my addr 172.21.15.99:0/1129316048 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:12:15.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.522+0000 7fb153e00640 1 --2- 172.21.15.99:0/1129316048 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f0272fbcf0 0x55f0272c8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:15.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.522+0000 7fb159c00640 1 --2- 172.21.15.99:0/1129316048 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f027302d60 0x55f02727e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:15.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.522+0000 7fb159200640 1 -- 172.21.15.99:0/1129316048 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f0272fbcf0 msgr2=0x55f0272c8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:15.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.522+0000 7fb159200640 1 --2- 172.21.15.99:0/1129316048 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f0272fbcf0 0x55f0272c8b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:15.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.522+0000 7fb159200640 1 -- 172.21.15.99:0/1129316048 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f027302d60 msgr2=0x55f02727e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:15.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.522+0000 7fb159200640 1 --2- 172.21.15.99:0/1129316048 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f027302d60 0x55f02727e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:15.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.522+0000 7fb159200640 1 -- 172.21.15.99:0/1129316048 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f02728aee0 con 0x55f0272fb330 2024-02-21T23:12:15.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.522+0000 7fb159c00640 1 --2- 172.21.15.99:0/1129316048 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f027302d60 0x55f02727e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:12:15.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.523+0000 7fb159200640 1 --2- 172.21.15.99:0/1129316048 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f0272fb330 0x55f0272fb7a0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fb14800ce90 tx=0x7fb14801e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68bab9ca530dc60f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:15.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.523+0000 7fb144c00640 1 -- 172.21.15.99:0/1129316048 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1480c6b10 con 0x55f0272fb330 2024-02-21T23:12:15.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.523+0000 7fb144c00640 1 -- 172.21.15.99:0/1129316048 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1480c6080 con 0x55f0272fb330 2024-02-21T23:12:15.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.523+0000 7fb144c00640 1 -- 172.21.15.99:0/1129316048 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb148004bc0 con 0x55f0272fb330 2024-02-21T23:12:15.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.523+0000 7fb15eb6f740 1 -- 172.21.15.99:0/1129316048 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f0272fb330 msgr2=0x55f0272fb7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:15.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.523+0000 7fb15eb6f740 1 --2- 172.21.15.99:0/1129316048 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f0272fb330 0x55f0272fb7a0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fb14800ce90 tx=0x7fb14801e000 comp rx=0 tx=0).stop 2024-02-21T23:12:15.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.524+0000 7fb15eb6f740 1 -- 172.21.15.99:0/1129316048 shutdown_connections 2024-02-21T23:12:15.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.524+0000 7fb15eb6f740 1 --2- 172.21.15.99:0/1129316048 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f027302d60 0x55f02727e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:15.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.524+0000 7fb15eb6f740 1 --2- 172.21.15.99:0/1129316048 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f0272fbcf0 0x55f0272c8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:15.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.524+0000 7fb15eb6f740 1 --2- 172.21.15.99:0/1129316048 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f0272fb330 0x55f0272fb7a0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:15.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.524+0000 7fb15eb6f740 1 -- 172.21.15.99:0/1129316048 >> 172.21.15.99:0/1129316048 conn(0x55f0272c0660 msgr2=0x55f027280080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:15.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.524+0000 7fb15eb6f740 1 -- 172.21.15.99:0/1129316048 shutdown_connections 2024-02-21T23:12:15.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.524+0000 7fb15eb6f740 1 -- 172.21.15.99:0/1129316048 wait complete. 2024-02-21T23:12:15.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.525+0000 7fb15eb6f740 1 -- start start 2024-02-21T23:12:15.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.525+0000 7fb15eb6f740 1 Processor -- start 2024-02-21T23:12:15.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.527+0000 7fb15eb6f740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f0272fb330 0x55f027361390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:15.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.527+0000 7fb15eb6f740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f0272fbcf0 0x55f027304dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:15.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.527+0000 7fb15eb6f740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f027302d60 0x55f027289f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:15.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.527+0000 7fb15eb6f740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb154228ba0 con 0x55f0272fb330 2024-02-21T23:12:15.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.527+0000 7fb15eb6f740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb154229e80 con 0x55f027302d60 2024-02-21T23:12:15.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.527+0000 7fb15eb6f740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1542291c0 con 0x55f0272fbcf0 2024-02-21T23:12:15.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.527+0000 7fb15eb6f740 10 client.0 _ll_register_callbacks cb 0x7fb14c009c90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:12:15.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.527+0000 7fb159200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f0272fb330 0x55f027361390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:15.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.527+0000 7fb159200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f0272fb330 0x55f027361390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60502/0 (socket says 172.21.15.99:60502) 2024-02-21T23:12:15.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.527+0000 7fb159200640 1 -- 172.21.15.99:0/4187286707 learned_addr learned my addr 172.21.15.99:0/4187286707 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:12:15.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.527+0000 7fb159c00640 1 --2- 172.21.15.99:0/4187286707 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f027302d60 0x55f027289f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:15.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.527+0000 7fb153e00640 1 --2- 172.21.15.99:0/4187286707 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f0272fbcf0 0x55f027304dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:15.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.528+0000 7fb159200640 1 -- 172.21.15.99:0/4187286707 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f0272fbcf0 msgr2=0x55f027304dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:15.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.528+0000 7fb159200640 1 --2- 172.21.15.99:0/4187286707 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f0272fbcf0 0x55f027304dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:15.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.528+0000 7fb159200640 1 -- 172.21.15.99:0/4187286707 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f027302d60 msgr2=0x55f027289f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:15.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.528+0000 7fb159200640 1 --2- 172.21.15.99:0/4187286707 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f027302d60 0x55f027289f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:15.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.528+0000 7fb159200640 1 -- 172.21.15.99:0/4187286707 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f026fc77d0 con 0x55f0272fb330 2024-02-21T23:12:15.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.528+0000 7fb159c00640 1 --2- 172.21.15.99:0/4187286707 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f027302d60 0x55f027289f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:12:15.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.528+0000 7fb159200640 1 --2- 172.21.15.99:0/4187286707 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f0272fb330 0x55f027361390 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fb14809acf0 tx=0x7fb1480c9040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23d2c12a33c4fc2f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:15.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.528+0000 7fb13a000640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:12:15.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.528+0000 7fb13a000640 1 -- 172.21.15.99:0/4187286707 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1480c6910 con 0x55f0272fb330 2024-02-21T23:12:15.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.528+0000 7fb13a000640 1 -- 172.21.15.99:0/4187286707 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 8877+0+0 (secure 0 0 0) 0x7fb1480c6ab0 con 0x55f0272fb330 2024-02-21T23:12:15.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.528+0000 7fb15eb6f740 1 -- 172.21.15.99:0/4187286707 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb1480c6080 con 0x55f0272fb330 2024-02-21T23:12:15.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.529+0000 7fb13a000640 1 -- 172.21.15.99:0/4187286707 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb148004bc0 con 0x55f0272fb330 2024-02-21T23:12:15.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.529+0000 7fb15eb6f740 10 client.7038 fetch_fsmap learned FSMap version 17 2024-02-21T23:12:15.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.529+0000 7fb15eb6f740 1 -- 172.21.15.99:0/4187286707 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55f02727ea80 con 0x55f0272fb330 2024-02-21T23:12:15.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.529+0000 7fb13a000640 1 -- 172.21.15.99:0/4187286707 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1480c6080 con 0x55f0272fb330 2024-02-21T23:12:15.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.529+0000 7fb13a000640 1 -- 172.21.15.99:0/4187286707 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fb148095ee0 con 0x55f0272fb330 2024-02-21T23:12:15.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.529+0000 7fb15eb6f740 10 client.7038 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:12:15.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.529+0000 7fb15eb6f740 10 client.7038 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.d 2024-02-21T23:12:15.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.529+0000 7fb15eb6f740 20 client.7038 populate_metadata read hostname 'smithi099' 2024-02-21T23:12:15.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.529+0000 7fb15eb6f740 1 --2- 172.21.15.99:0/4187286707 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x55f027303830 0x55f02727e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:15.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.529+0000 7fb15eb6f740 4 client.7038 mds_command: new command op to 4348 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T23:12:15.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.529+0000 7fb15eb6f740 1 -- 172.21.15.99:0/4187286707 --> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55f027282e30 con 0x55f027303830 2024-02-21T23:12:15.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.530+0000 7fb153e00640 1 --2- 172.21.15.99:0/4187286707 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x55f027303830 0x55f02727e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:15.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.530+0000 7fb153e00640 1 --2- 172.21.15.99:0/4187286707 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x55f027303830 0x55f02727e070 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=cbe20811197a6989 server_cookie=4ef2713f6209926f in_seq=0 out_seq=0 2024-02-21T23:12:15.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.530+0000 7fb13a000640 10 client.7038 ms_handle_connect on v2:172.21.15.99:6834/2243461688 2024-02-21T23:12:15.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.530+0000 7fb13a000640 1 -- 172.21.15.99:0/4187286707 <== mds.2 v2:172.21.15.99:6834/2243461688 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55f027282e30 con 0x55f027303830 2024-02-21T23:12:15.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.530+0000 7fb13a000640 10 client.7038 handle_command_reply: tid=0 2024-02-21T23:12:15.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.530+0000 7fb15eb6f740 1 client.7038 shutdown 2024-02-21T23:12:15.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.531+0000 7fb15eb6f740 1 -- 172.21.15.99:0/4187286707 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f0272fb330 msgr2=0x55f027361390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:15.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.531+0000 7fb15eb6f740 1 --2- 172.21.15.99:0/4187286707 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f0272fb330 0x55f027361390 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fb14809acf0 tx=0x7fb1480c9040 comp rx=0 tx=0).stop 2024-02-21T23:12:15.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.531+0000 7fb15eb6f740 1 -- 172.21.15.99:0/4187286707 shutdown_connections 2024-02-21T23:12:15.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.531+0000 7fb15eb6f740 1 --2- 172.21.15.99:0/4187286707 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x55f027303830 0x55f02727e070 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:15.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.531+0000 7fb15eb6f740 1 --2- 172.21.15.99:0/4187286707 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f027302d60 0x55f027289f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:15.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.531+0000 7fb15eb6f740 1 --2- 172.21.15.99:0/4187286707 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f0272fbcf0 0x55f027304dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:15.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.531+0000 7fb15eb6f740 1 --2- 172.21.15.99:0/4187286707 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f0272fb330 0x55f027361390 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:15.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.531+0000 7fb15eb6f740 1 -- 172.21.15.99:0/4187286707 >> 172.21.15.99:0/4187286707 conn(0x55f0272c0660 msgr2=0x55f0272c3b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:15.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.531+0000 7fb13a000640 0 client.7038 ms_handle_reset on v2:172.21.15.99:6834/2243461688 2024-02-21T23:12:15.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.531+0000 7fb15eb6f740 1 -- 172.21.15.99:0/4187286707 shutdown_connections 2024-02-21T23:12:15.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.531+0000 7fb15eb6f740 1 -- 172.21.15.99:0/4187286707 wait complete. 2024-02-21T23:12:15.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.531+0000 7fb15eb6f740 20 client.7038 trim_cache size 0 max 16384 2024-02-21T23:12:15.527 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-02-21T23:12:15.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.532+0000 7fb15a600640 1 -- 172.21.15.99:0/3231047385 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fb13409eed0 msgr2=0x7fb1340a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:15.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.532+0000 7fb15a600640 1 --2- 172.21.15.99:0/3231047385 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fb13409eed0 0x7fb1340a1390 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb14c036000 tx=0x7fb14c030000 comp rx=0 tx=0).stop 2024-02-21T23:12:15.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.532+0000 7fb15a600640 1 -- 172.21.15.99:0/3231047385 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb1540d60b0 msgr2=0x7fb154179a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:15.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.532+0000 7fb15a600640 1 --2- 172.21.15.99:0/3231047385 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb1540d60b0 0x7fb154179a30 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fb14800c4d0 tx=0x7fb14800c990 comp rx=0 tx=0).stop 2024-02-21T23:12:15.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.532+0000 7fb15a600640 1 -- 172.21.15.99:0/3231047385 shutdown_connections 2024-02-21T23:12:15.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.532+0000 7fb15a600640 1 --2- 172.21.15.99:0/3231047385 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fb13409eed0 0x7fb1340a1390 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:15.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.532+0000 7fb15a600640 1 --2- 172.21.15.99:0/3231047385 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb15418b230 0x7fb154220400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:15.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.532+0000 7fb15a600640 1 --2- 172.21.15.99:0/3231047385 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb15417f490 0x7fb154171f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:15.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.532+0000 7fb15a600640 1 --2- 172.21.15.99:0/3231047385 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb1540d60b0 0x7fb154179a30 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:15.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.532+0000 7fb15a600640 1 -- 172.21.15.99:0/3231047385 >> 172.21.15.99:0/3231047385 conn(0x7fb1540d29b0 msgr2=0x7fb1540d0580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:15.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.533+0000 7fb15a600640 1 -- 172.21.15.99:0/3231047385 shutdown_connections 2024-02-21T23:12:15.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.533+0000 7fb15a600640 1 -- 172.21.15.99:0/3231047385 wait complete. 2024-02-21T23:12:15.538 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T23:12:15.538 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-02-21T23:12:15.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.771+0000 7f6852600640 1 Processor -- start 2024-02-21T23:12:15.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.771+0000 7f6852600640 1 -- start start 2024-02-21T23:12:15.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.772+0000 7f6852600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f684c18b230 0x7f684c0fc280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:15.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.773+0000 7f6852600640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f684c0fc7c0 0x7f684c0fcc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:15.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.773+0000 7f6852600640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f684c0d6dd0 con 0x7f684c17f490 2024-02-21T23:12:15.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.773+0000 7f6852600640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f684c1614c0 con 0x7f684c18b230 2024-02-21T23:12:15.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.773+0000 7f6852600640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f684c0d6810 con 0x7f684c0fc7c0 2024-02-21T23:12:15.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.773+0000 7f6851200640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f684c17f490 0x7f684c18ab20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:40312/0 (socket says 172.21.15.99:40312) 2024-02-21T23:12:15.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.773+0000 7f6851200640 1 -- 172.21.15.99:0/277720314 learned_addr learned my addr 172.21.15.99:0/277720314 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:12:15.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.773+0000 7f6851c00640 1 --2- 172.21.15.99:0/277720314 >> v2:172.21.15.181:3300/0 conn(0x7f684c0fc7c0 0x7f684c0fcc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:15.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.773+0000 7f684be00640 1 --2- 172.21.15.99:0/277720314 >> v2:172.21.15.162:3300/0 conn(0x7f684c18b230 0x7f684c0fc280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:15.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.773+0000 7f6851c00640 1 -- 172.21.15.99:0/277720314 >> v2:172.21.15.162:3300/0 conn(0x7f684c18b230 msgr2=0x7f684c0fc280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:15.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.773+0000 7f6851c00640 1 --2- 172.21.15.99:0/277720314 >> v2:172.21.15.162:3300/0 conn(0x7f684c18b230 0x7f684c0fc280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:15.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.773+0000 7f6851c00640 1 -- 172.21.15.99:0/277720314 >> v1:172.21.15.99:6789/0 conn(0x7f684c17f490 legacy=0x7f684c18ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:15.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.774+0000 7f6851c00640 1 -- 172.21.15.99:0/277720314 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f684c0d6af0 con 0x7f684c0fc7c0 2024-02-21T23:12:15.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.773+0000 7f684b400640 1 -- 172.21.15.99:0/277720314 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2674380017 0 0) 0x7f684c0d6dd0 con 0x7f684c17f490 2024-02-21T23:12:15.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.775+0000 7f6851c00640 1 --2- 172.21.15.99:0/277720314 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f684c0fc7c0 0x7f684c0fcc10 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f684c186580 tx=0x7f684402bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0d2d9dda272a8ce server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:15.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.776+0000 7f684b400640 1 -- 172.21.15.99:0/277720314 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6844039070 con 0x7f684c0fc7c0 2024-02-21T23:12:15.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.776+0000 7f684b400640 1 -- 172.21.15.99:0/277720314 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f684402cc80 con 0x7f684c0fc7c0 2024-02-21T23:12:15.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.776+0000 7f684b400640 1 -- 172.21.15.99:0/277720314 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6844034660 con 0x7f684c0fc7c0 2024-02-21T23:12:15.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.776+0000 7f6852600640 1 -- 172.21.15.99:0/277720314 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f684c0fc7c0 msgr2=0x7f684c0fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:15.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.776+0000 7f6852600640 1 --2- 172.21.15.99:0/277720314 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f684c0fc7c0 0x7f684c0fcc10 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f684c186580 tx=0x7f684402bed0 comp rx=0 tx=0).stop 2024-02-21T23:12:15.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.776+0000 7f6852600640 1 -- 172.21.15.99:0/277720314 shutdown_connections 2024-02-21T23:12:15.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.776+0000 7f6852600640 1 --2- 172.21.15.99:0/277720314 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f684c0fc7c0 0x7f684c0fcc10 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:15.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.776+0000 7f6852600640 1 --2- 172.21.15.99:0/277720314 >> v2:172.21.15.162:3300/0 conn(0x7f684c18b230 0x7f684c0fc280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:15.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.776+0000 7f6852600640 1 -- 172.21.15.99:0/277720314 >> 172.21.15.99:0/277720314 conn(0x7f684c0d29b0 msgr2=0x7f684c0d2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:15.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.776+0000 7f6852600640 1 -- 172.21.15.99:0/277720314 shutdown_connections 2024-02-21T23:12:15.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.776+0000 7f6852600640 1 -- 172.21.15.99:0/277720314 wait complete. 2024-02-21T23:12:15.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.779+0000 7f6852600640 1 Processor -- start 2024-02-21T23:12:15.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.780+0000 7f6852600640 1 -- start start 2024-02-21T23:12:15.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.782+0000 7f6852600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f684c0fc7c0 0x7f684c175f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:15.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.782+0000 7f6852600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f684c17f490 0x7f684c1594c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:15.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.782+0000 7f6852600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f684c18b230 0x7f684c2202b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:15.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.782+0000 7f6852600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f684c18a600 con 0x7f684c0fc7c0 2024-02-21T23:12:15.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.782+0000 7f6852600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f684c18a320 con 0x7f684c18b230 2024-02-21T23:12:15.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.782+0000 7f6852600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f684c18b6c0 con 0x7f684c17f490 2024-02-21T23:12:15.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.782+0000 7f6851200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f684c0fc7c0 0x7f684c175f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:15.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.782+0000 7f6851200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f684c0fc7c0 0x7f684c175f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60504/0 (socket says 172.21.15.99:60504) 2024-02-21T23:12:15.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.782+0000 7f6851200640 1 -- 172.21.15.99:0/1206991438 learned_addr learned my addr 172.21.15.99:0/1206991438 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:12:15.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.782+0000 7f684be00640 1 --2- 172.21.15.99:0/1206991438 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f684c17f490 0x7f684c1594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:15.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.782+0000 7f6851c00640 1 --2- 172.21.15.99:0/1206991438 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f684c18b230 0x7f684c2202b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:15.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.783+0000 7f684be00640 1 -- 172.21.15.99:0/1206991438 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f684c18b230 msgr2=0x7f684c2202b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:15.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.783+0000 7f684be00640 1 --2- 172.21.15.99:0/1206991438 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f684c18b230 0x7f684c2202b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:15.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.783+0000 7f684be00640 1 -- 172.21.15.99:0/1206991438 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f684c0fc7c0 msgr2=0x7f684c175f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:15.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.783+0000 7f684be00640 1 --2- 172.21.15.99:0/1206991438 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f684c0fc7c0 0x7f684c175f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:15.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.783+0000 7f684be00640 1 -- 172.21.15.99:0/1206991438 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f684c176820 con 0x7f684c17f490 2024-02-21T23:12:15.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.783+0000 7f684be00640 1 --2- 172.21.15.99:0/1206991438 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f684c17f490 0x7f684c1594c0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f683800e870 tx=0x7f683800ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:15.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.783+0000 7f6848c00640 1 -- 172.21.15.99:0/1206991438 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6838017070 con 0x7f684c17f490 2024-02-21T23:12:15.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.783+0000 7f6848c00640 1 -- 172.21.15.99:0/1206991438 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f683800ee60 con 0x7f684c17f490 2024-02-21T23:12:15.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.783+0000 7f6852600640 1 -- 172.21.15.99:0/1206991438 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f684c176b00 con 0x7f684c17f490 2024-02-21T23:12:15.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.783+0000 7f6848c00640 1 -- 172.21.15.99:0/1206991438 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f683800cb60 con 0x7f684c17f490 2024-02-21T23:12:15.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.783+0000 7f6852600640 1 -- 172.21.15.99:0/1206991438 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f684c1770c0 con 0x7f684c17f490 2024-02-21T23:12:15.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.787+0000 7f6848c00640 1 -- 172.21.15.99:0/1206991438 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f683801a070 con 0x7f684c17f490 2024-02-21T23:12:15.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.788+0000 7f6848c00640 1 --2- 172.21.15.99:0/1206991438 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f682c09ef00 0x7f682c0a13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:15.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.788+0000 7f6848c00640 1 -- 172.21.15.99:0/1206991438 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f68380c9fe0 con 0x7f684c17f490 2024-02-21T23:12:15.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.788+0000 7f6851200640 1 --2- 172.21.15.99:0/1206991438 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f682c09ef00 0x7f682c0a13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:15.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.789+0000 7f6851200640 1 --2- 172.21.15.99:0/1206991438 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f682c09ef00 0x7f682c0a13c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6840007b10 tx=0x7f6840007a60 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:15.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.790+0000 7f6856a83740 1 Processor -- start 2024-02-21T23:12:15.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.790+0000 7f6856a83740 1 -- start start 2024-02-21T23:12:15.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.792+0000 7f6856a83740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bcfd8ec660 0x55bcfd8eca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:15.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.792+0000 7f6856a83740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bcfd927330 0x55bcfd9277b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:15.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.792+0000 7f6856a83740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bcfd927cf0 0x55bcfd928560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:15.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.792+0000 7f6856a83740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bcfd814b50 con 0x55bcfd927330 2024-02-21T23:12:15.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.792+0000 7f6856a83740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bcfd7bdda0 con 0x55bcfd8ec660 2024-02-21T23:12:15.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.792+0000 7f6856a83740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bcfd810bf0 con 0x55bcfd927cf0 2024-02-21T23:12:15.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.792+0000 7f684be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bcfd927330 0x55bcfd9277b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:15.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.792+0000 7f6851200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bcfd8ec660 0x55bcfd8eca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:15.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.792+0000 7f6851c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bcfd927cf0 0x55bcfd928560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:15.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.792+0000 7f6851200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bcfd8ec660 0x55bcfd8eca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:51170/0 (socket says 172.21.15.99:51170) 2024-02-21T23:12:15.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.792+0000 7f6851200640 1 -- 172.21.15.99:0/1355347159 learned_addr learned my addr 172.21.15.99:0/1355347159 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:12:15.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.793+0000 7f6851200640 1 -- 172.21.15.99:0/1355347159 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bcfd927cf0 msgr2=0x55bcfd928560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:15.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.793+0000 7f6851200640 1 --2- 172.21.15.99:0/1355347159 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bcfd927cf0 0x55bcfd928560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:15.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.793+0000 7f6851200640 1 -- 172.21.15.99:0/1355347159 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bcfd927330 msgr2=0x55bcfd9277b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:15.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.793+0000 7f6851200640 1 --2- 172.21.15.99:0/1355347159 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bcfd927330 0x55bcfd9277b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:15.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.793+0000 7f6851200640 1 -- 172.21.15.99:0/1355347159 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bcfd7e0f80 con 0x55bcfd8ec660 2024-02-21T23:12:15.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.793+0000 7f6851200640 1 --2- 172.21.15.99:0/1355347159 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bcfd8ec660 0x55bcfd8eca40 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f6840001990 tx=0x7f6840013000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70bd2af5e3ac08ff server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:15.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.793+0000 7f683d600640 1 -- 172.21.15.99:0/1355347159 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6840026070 con 0x55bcfd8ec660 2024-02-21T23:12:15.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.793+0000 7f683d600640 1 -- 172.21.15.99:0/1355347159 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6840013b80 con 0x55bcfd8ec660 2024-02-21T23:12:15.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.793+0000 7f683d600640 1 -- 172.21.15.99:0/1355347159 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6840012350 con 0x55bcfd8ec660 2024-02-21T23:12:15.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.794+0000 7f6856a83740 1 -- 172.21.15.99:0/1355347159 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bcfd8ec660 msgr2=0x55bcfd8eca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:15.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.794+0000 7f6856a83740 1 --2- 172.21.15.99:0/1355347159 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bcfd8ec660 0x55bcfd8eca40 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f6840001990 tx=0x7f6840013000 comp rx=0 tx=0).stop 2024-02-21T23:12:15.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.794+0000 7f6856a83740 1 -- 172.21.15.99:0/1355347159 shutdown_connections 2024-02-21T23:12:15.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.794+0000 7f6856a83740 1 --2- 172.21.15.99:0/1355347159 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bcfd927cf0 0x55bcfd928560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:15.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.794+0000 7f6856a83740 1 --2- 172.21.15.99:0/1355347159 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bcfd927330 0x55bcfd9277b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:15.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.794+0000 7f6856a83740 1 --2- 172.21.15.99:0/1355347159 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bcfd8ec660 0x55bcfd8eca40 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:15.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.794+0000 7f6856a83740 1 -- 172.21.15.99:0/1355347159 >> 172.21.15.99:0/1355347159 conn(0x55bcfd8ae6d0 msgr2=0x55bcfd8af750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:15.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.794+0000 7f6856a83740 1 -- 172.21.15.99:0/1355347159 shutdown_connections 2024-02-21T23:12:15.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.794+0000 7f6856a83740 1 -- 172.21.15.99:0/1355347159 wait complete. 2024-02-21T23:12:15.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.795+0000 7f6856a83740 1 -- start start 2024-02-21T23:12:15.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.795+0000 7f6856a83740 1 Processor -- start 2024-02-21T23:12:15.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.797+0000 7f6856a83740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bcfd927330 0x55bcfd8f51f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:15.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.797+0000 7f6856a83740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bcfd927cf0 0x55bcfd8e29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:15.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.797+0000 7f6856a83740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bcfd8f6cb0 0x55bcfd91bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:15.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.797+0000 7f6856a83740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bcfd9260a0 con 0x55bcfd927330 2024-02-21T23:12:15.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.797+0000 7f6856a83740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bcfd7b3380 con 0x55bcfd8f6cb0 2024-02-21T23:12:15.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.797+0000 7f6856a83740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bcfd925dc0 con 0x55bcfd927cf0 2024-02-21T23:12:15.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.798+0000 7f6856a83740 10 client.0 _ll_register_callbacks cb 0x55bcfd80c280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:12:15.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.798+0000 7f6851200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bcfd927330 0x55bcfd8f51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:15.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.798+0000 7f6851200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bcfd927330 0x55bcfd8f51f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60518/0 (socket says 172.21.15.99:60518) 2024-02-21T23:12:15.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.798+0000 7f6851200640 1 -- 172.21.15.99:0/3240869708 learned_addr learned my addr 172.21.15.99:0/3240869708 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:12:15.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.798+0000 7f684be00640 1 --2- 172.21.15.99:0/3240869708 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bcfd927cf0 0x55bcfd8e29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:15.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.798+0000 7f6851c00640 1 --2- 172.21.15.99:0/3240869708 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bcfd8f6cb0 0x55bcfd91bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:15.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.798+0000 7f6851200640 1 -- 172.21.15.99:0/3240869708 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bcfd927cf0 msgr2=0x55bcfd8e29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:15.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.798+0000 7f6851200640 1 --2- 172.21.15.99:0/3240869708 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bcfd927cf0 0x55bcfd8e29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:15.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.798+0000 7f6851200640 1 -- 172.21.15.99:0/3240869708 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bcfd8f6cb0 msgr2=0x55bcfd91bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:15.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.798+0000 7f6851200640 1 --2- 172.21.15.99:0/3240869708 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bcfd8f6cb0 0x55bcfd91bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:15.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.798+0000 7f6851200640 1 -- 172.21.15.99:0/3240869708 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bcfd7dbc20 con 0x55bcfd927330 2024-02-21T23:12:15.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.799+0000 7f6851200640 1 --2- 172.21.15.99:0/3240869708 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bcfd927330 0x55bcfd8f51f0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f6840000f60 tx=0x7f6840007da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2e39a13ada64f6a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:15.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.799+0000 7f6832000640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:12:15.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.799+0000 7f6832000640 1 -- 172.21.15.99:0/3240869708 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6840030060 con 0x55bcfd927330 2024-02-21T23:12:15.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.799+0000 7f6832000640 1 -- 172.21.15.99:0/3240869708 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f6840021bd0 con 0x55bcfd927330 2024-02-21T23:12:15.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.799+0000 7f6856a83740 1 -- 172.21.15.99:0/3240869708 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6840013b80 con 0x55bcfd927330 2024-02-21T23:12:15.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.799+0000 7f6832000640 1 -- 172.21.15.99:0/3240869708 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6840037050 con 0x55bcfd927330 2024-02-21T23:12:15.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.799+0000 7f6856a83740 10 client.7050 fetch_fsmap learned FSMap version 17 2024-02-21T23:12:15.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.799+0000 7f6856a83740 1 -- 172.21.15.99:0/3240869708 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55bcfd5293f0 con 0x55bcfd927330 2024-02-21T23:12:15.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.800+0000 7f6832000640 1 -- 172.21.15.99:0/3240869708 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6840013b80 con 0x55bcfd927330 2024-02-21T23:12:15.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.800+0000 7f6832000640 1 -- 172.21.15.99:0/3240869708 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f684002b400 con 0x55bcfd927330 2024-02-21T23:12:15.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.800+0000 7f6856a83740 10 client.7050 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:12:15.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.800+0000 7f6856a83740 10 client.7050 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2024-02-21T23:12:15.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.800+0000 7f6856a83740 20 client.7050 populate_metadata read hostname 'smithi099' 2024-02-21T23:12:15.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.800+0000 7f6856a83740 1 --2- 172.21.15.99:0/3240869708 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x55bcfd91c590 0x55bcfd933a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:15.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.800+0000 7f6856a83740 4 client.7050 mds_command: new command op to 4352 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:12:15.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.800+0000 7f6856a83740 1 -- 172.21.15.99:0/3240869708 --> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bcfd822090 con 0x55bcfd91c590 2024-02-21T23:12:15.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.800+0000 7f684be00640 1 --2- 172.21.15.99:0/3240869708 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x55bcfd91c590 0x55bcfd933a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:15.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.801+0000 7f684be00640 1 --2- 172.21.15.99:0/3240869708 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x55bcfd91c590 0x55bcfd933a90 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=24c89794c78d7774 server_cookie=3addd84e09d1303a in_seq=0 out_seq=0 2024-02-21T23:12:15.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.801+0000 7f6832000640 10 client.7050 ms_handle_connect on v2:172.21.15.99:6836/1676159950 2024-02-21T23:12:15.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.802+0000 7f6832000640 1 -- 172.21.15.99:0/3240869708 <== mds.1 v2:172.21.15.99:6836/1676159950 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55bcfd822090 con 0x55bcfd91c590 2024-02-21T23:12:15.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.802+0000 7f6832000640 10 client.7050 handle_command_reply: tid=0 2024-02-21T23:12:15.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.802+0000 7f6856a83740 1 client.7050 shutdown 2024-02-21T23:12:15.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.802+0000 7f6856a83740 1 -- 172.21.15.99:0/3240869708 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bcfd927330 msgr2=0x55bcfd8f51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:15.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.802+0000 7f6856a83740 1 --2- 172.21.15.99:0/3240869708 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bcfd927330 0x55bcfd8f51f0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f6840000f60 tx=0x7f6840007da0 comp rx=0 tx=0).stop 2024-02-21T23:12:15.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.802+0000 7f6856a83740 1 -- 172.21.15.99:0/3240869708 shutdown_connections 2024-02-21T23:12:15.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.802+0000 7f6856a83740 1 --2- 172.21.15.99:0/3240869708 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x55bcfd91c590 0x55bcfd933a90 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:15.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.802+0000 7f6856a83740 1 --2- 172.21.15.99:0/3240869708 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bcfd8f6cb0 0x55bcfd91bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:15.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.802+0000 7f6856a83740 1 --2- 172.21.15.99:0/3240869708 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bcfd927cf0 0x55bcfd8e29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:15.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.802+0000 7f6856a83740 1 --2- 172.21.15.99:0/3240869708 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bcfd927330 0x55bcfd8f51f0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:15.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.802+0000 7f6832000640 0 client.7050 ms_handle_reset on v2:172.21.15.99:6836/1676159950 2024-02-21T23:12:15.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.802+0000 7f6856a83740 1 -- 172.21.15.99:0/3240869708 >> 172.21.15.99:0/3240869708 conn(0x55bcfd8ec660 msgr2=0x55bcfd9267b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:15.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.802+0000 7f6856a83740 1 -- 172.21.15.99:0/3240869708 shutdown_connections 2024-02-21T23:12:15.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.802+0000 7f6856a83740 1 -- 172.21.15.99:0/3240869708 wait complete. 2024-02-21T23:12:15.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.803+0000 7f6856a83740 20 client.7050 trim_cache size 0 max 16384 2024-02-21T23:12:15.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.816+0000 7f6856a83740 1 Processor -- start 2024-02-21T23:12:15.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.816+0000 7f6856a83740 1 -- start start 2024-02-21T23:12:15.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.817+0000 7f6856a83740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bcfd8f6cb0 0x55bcfd927710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:15.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.817+0000 7f6856a83740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bcfd927330 0x55bcfd8afb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:15.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.817+0000 7f6856a83740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bcfd927cf0 0x55bcfd926980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:15.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.817+0000 7f6856a83740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f684c22c8a0 con 0x55bcfd8f6cb0 2024-02-21T23:12:15.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.817+0000 7f6856a83740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f684c22a440 con 0x55bcfd927330 2024-02-21T23:12:15.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.817+0000 7f6856a83740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f684c175810 con 0x55bcfd927cf0 2024-02-21T23:12:15.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.818+0000 7f6851200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bcfd8f6cb0 0x55bcfd927710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:15.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.818+0000 7f6851c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bcfd927cf0 0x55bcfd926980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:15.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.818+0000 7f6851200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bcfd8f6cb0 0x55bcfd927710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60524/0 (socket says 172.21.15.99:60524) 2024-02-21T23:12:15.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.818+0000 7f6851200640 1 -- 172.21.15.99:0/3518968269 learned_addr learned my addr 172.21.15.99:0/3518968269 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:12:15.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.818+0000 7f6851c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bcfd927cf0 0x55bcfd926980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:46884/0 (socket says 172.21.15.99:46884) 2024-02-21T23:12:15.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.818+0000 7f684be00640 1 --2- 172.21.15.99:0/3518968269 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bcfd927330 0x55bcfd8afb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:15.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.818+0000 7f6851200640 1 -- 172.21.15.99:0/3518968269 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bcfd927cf0 msgr2=0x55bcfd926980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:15.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.818+0000 7f6851200640 1 --2- 172.21.15.99:0/3518968269 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bcfd927cf0 0x55bcfd926980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:15.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.818+0000 7f6851200640 1 -- 172.21.15.99:0/3518968269 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bcfd927330 msgr2=0x55bcfd8afb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:15.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.818+0000 7f6851200640 1 --2- 172.21.15.99:0/3518968269 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bcfd927330 0x55bcfd8afb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:15.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.818+0000 7f6851200640 1 -- 172.21.15.99:0/3518968269 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bcfd5f37d0 con 0x55bcfd8f6cb0 2024-02-21T23:12:15.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.818+0000 7f684be00640 1 --2- 172.21.15.99:0/3518968269 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bcfd927330 0x55bcfd8afb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:12:15.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.819+0000 7f6851200640 1 --2- 172.21.15.99:0/3518968269 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bcfd8f6cb0 0x55bcfd927710 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f6840013f70 tx=0x7f6840029000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=617e4f7cd1315bbc server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:15.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.819+0000 7f683cc00640 1 -- 172.21.15.99:0/3518968269 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6840030070 con 0x55bcfd8f6cb0 2024-02-21T23:12:15.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.819+0000 7f683cc00640 1 -- 172.21.15.99:0/3518968269 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6840027040 con 0x55bcfd8f6cb0 2024-02-21T23:12:15.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.819+0000 7f683cc00640 1 -- 172.21.15.99:0/3518968269 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6840026070 con 0x55bcfd8f6cb0 2024-02-21T23:12:15.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.819+0000 7f6856a83740 1 -- 172.21.15.99:0/3518968269 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bcfd8f6cb0 msgr2=0x55bcfd927710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:15.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.819+0000 7f6856a83740 1 --2- 172.21.15.99:0/3518968269 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bcfd8f6cb0 0x55bcfd927710 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f6840013f70 tx=0x7f6840029000 comp rx=0 tx=0).stop 2024-02-21T23:12:15.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.819+0000 7f6856a83740 1 -- 172.21.15.99:0/3518968269 shutdown_connections 2024-02-21T23:12:15.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.819+0000 7f6856a83740 1 --2- 172.21.15.99:0/3518968269 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bcfd927cf0 0x55bcfd926980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:15.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.819+0000 7f6856a83740 1 --2- 172.21.15.99:0/3518968269 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bcfd927330 0x55bcfd8afb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:15.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.819+0000 7f6856a83740 1 --2- 172.21.15.99:0/3518968269 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bcfd8f6cb0 0x55bcfd927710 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:15.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.819+0000 7f6856a83740 1 -- 172.21.15.99:0/3518968269 >> 172.21.15.99:0/3518968269 conn(0x55bcfd8ec660 msgr2=0x55bcfd8b6190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:15.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.820+0000 7f6856a83740 1 -- 172.21.15.99:0/3518968269 shutdown_connections 2024-02-21T23:12:15.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.820+0000 7f6856a83740 1 -- 172.21.15.99:0/3518968269 wait complete. 2024-02-21T23:12:15.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.821+0000 7f6856a83740 1 -- start start 2024-02-21T23:12:15.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.821+0000 7f6856a83740 1 Processor -- start 2024-02-21T23:12:15.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.822+0000 7f6856a83740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bcfd8f6cb0 0x55bcfd98d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:15.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.822+0000 7f6856a83740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bcfd927330 0x55bcfd8d8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:15.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.822+0000 7f6856a83740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bcfd927cf0 0x55bcfd9939e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:15.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.822+0000 7f6856a83740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f684c228b20 con 0x55bcfd8f6cb0 2024-02-21T23:12:15.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.822+0000 7f6856a83740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f684c229de0 con 0x55bcfd927330 2024-02-21T23:12:15.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.822+0000 7f6856a83740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f684c229120 con 0x55bcfd927cf0 2024-02-21T23:12:15.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.822+0000 7f6856a83740 10 client.0 _ll_register_callbacks cb 0x7f6840024070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:12:15.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.823+0000 7f6851200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bcfd8f6cb0 0x55bcfd98d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:15.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.823+0000 7f6851200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bcfd8f6cb0 0x55bcfd98d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60528/0 (socket says 172.21.15.99:60528) 2024-02-21T23:12:15.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.823+0000 7f6851200640 1 -- 172.21.15.99:0/1293124899 learned_addr learned my addr 172.21.15.99:0/1293124899 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:12:15.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.823+0000 7f684be00640 1 --2- 172.21.15.99:0/1293124899 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bcfd927330 0x55bcfd8d8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:15.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.823+0000 7f6851c00640 1 --2- 172.21.15.99:0/1293124899 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bcfd927cf0 0x55bcfd9939e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:15.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.823+0000 7f684be00640 1 -- 172.21.15.99:0/1293124899 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bcfd927cf0 msgr2=0x55bcfd9939e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:15.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.823+0000 7f684be00640 1 --2- 172.21.15.99:0/1293124899 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bcfd927cf0 0x55bcfd9939e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:15.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.823+0000 7f684be00640 1 -- 172.21.15.99:0/1293124899 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bcfd8f6cb0 msgr2=0x55bcfd98d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:15.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.823+0000 7f684be00640 1 --2- 172.21.15.99:0/1293124899 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bcfd8f6cb0 0x55bcfd98d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:15.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.823+0000 7f684be00640 1 -- 172.21.15.99:0/1293124899 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bcfd993f20 con 0x55bcfd927330 2024-02-21T23:12:15.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.823+0000 7f6851200640 1 --2- 172.21.15.99:0/1293124899 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bcfd8f6cb0 0x55bcfd98d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:12:15.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.824+0000 7f684be00640 1 --2- 172.21.15.99:0/1293124899 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bcfd927330 0x55bcfd8d8bc0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f68380c7670 tx=0x7f6838009300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e38f0d17fb10cc7e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:15.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.824+0000 7f6832000640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-02-21T23:12:15.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.824+0000 7f6832000640 1 -- 172.21.15.99:0/1293124899 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68380c4020 con 0x55bcfd927330 2024-02-21T23:12:15.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.824+0000 7f6832000640 1 -- 172.21.15.99:0/1293124899 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f68380c7810 con 0x55bcfd927330 2024-02-21T23:12:15.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.824+0000 7f6856a83740 1 -- 172.21.15.99:0/1293124899 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6840027040 con 0x55bcfd927330 2024-02-21T23:12:15.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.824+0000 7f6832000640 1 -- 172.21.15.99:0/1293124899 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6838021040 con 0x55bcfd927330 2024-02-21T23:12:15.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.824+0000 7f6856a83740 10 client.7252 fetch_fsmap learned FSMap version 17 2024-02-21T23:12:15.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.824+0000 7f6856a83740 1 -- 172.21.15.99:0/1293124899 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55bcfd926730 con 0x55bcfd927330 2024-02-21T23:12:15.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.824+0000 7f6832000640 1 -- 172.21.15.99:0/1293124899 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6840027040 con 0x55bcfd927330 2024-02-21T23:12:15.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.824+0000 7f6832000640 1 -- 172.21.15.99:0/1293124899 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f6838093f70 con 0x55bcfd927330 2024-02-21T23:12:15.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.825+0000 7f6856a83740 10 client.7252 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:12:15.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.825+0000 7f6856a83740 10 client.7252 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2024-02-21T23:12:15.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.825+0000 7f6856a83740 20 client.7252 populate_metadata read hostname 'smithi099' 2024-02-21T23:12:15.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.825+0000 7f6856a83740 1 --2- 172.21.15.99:0/1293124899 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x55bcfd8b7130 0x55bcfd8e47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:15.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.825+0000 7f6856a83740 4 client.7252 mds_command: new command op to 4352 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T23:12:15.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.825+0000 7f6856a83740 1 -- 172.21.15.99:0/1293124899 --> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55bcfd81c3e0 con 0x55bcfd8b7130 2024-02-21T23:12:15.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.825+0000 7f6851200640 1 --2- 172.21.15.99:0/1293124899 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x55bcfd8b7130 0x55bcfd8e47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:15.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.826+0000 7f6851200640 1 --2- 172.21.15.99:0/1293124899 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x55bcfd8b7130 0x55bcfd8e47e0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b4e8a7fcd939cce4 server_cookie=cf7a49210cc86bd9 in_seq=0 out_seq=0 2024-02-21T23:12:15.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.826+0000 7f6832000640 10 client.7252 ms_handle_connect on v2:172.21.15.99:6836/1676159950 2024-02-21T23:12:15.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.826+0000 7f6832000640 1 -- 172.21.15.99:0/1293124899 <== mds.1 v2:172.21.15.99:6836/1676159950 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55bcfd81c3e0 con 0x55bcfd8b7130 2024-02-21T23:12:15.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.826+0000 7f6832000640 10 client.7252 handle_command_reply: tid=0 2024-02-21T23:12:15.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.826+0000 7f6856a83740 1 client.7252 shutdown 2024-02-21T23:12:15.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.826+0000 7f6856a83740 1 -- 172.21.15.99:0/1293124899 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bcfd927330 msgr2=0x55bcfd8d8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:15.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.826+0000 7f6856a83740 1 --2- 172.21.15.99:0/1293124899 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bcfd927330 0x55bcfd8d8bc0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f68380c7670 tx=0x7f6838009300 comp rx=0 tx=0).stop 2024-02-21T23:12:15.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.826+0000 7f6856a83740 1 -- 172.21.15.99:0/1293124899 shutdown_connections 2024-02-21T23:12:15.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.826+0000 7f6856a83740 1 --2- 172.21.15.99:0/1293124899 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x55bcfd8b7130 0x55bcfd8e47e0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:15.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.826+0000 7f6856a83740 1 --2- 172.21.15.99:0/1293124899 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bcfd927cf0 0x55bcfd9939e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:15.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.826+0000 7f6856a83740 1 --2- 172.21.15.99:0/1293124899 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bcfd927330 0x55bcfd8d8bc0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:15.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.826+0000 7f6856a83740 1 --2- 172.21.15.99:0/1293124899 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bcfd8f6cb0 0x55bcfd98d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:15.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.826+0000 7f6856a83740 1 -- 172.21.15.99:0/1293124899 >> 172.21.15.99:0/1293124899 conn(0x55bcfd8ec660 msgr2=0x55bcfd923c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:15.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.826+0000 7f6832000640 0 client.7252 ms_handle_reset on v2:172.21.15.99:6836/1676159950 2024-02-21T23:12:15.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.826+0000 7f6856a83740 1 -- 172.21.15.99:0/1293124899 shutdown_connections 2024-02-21T23:12:15.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.826+0000 7f6856a83740 1 -- 172.21.15.99:0/1293124899 wait complete. 2024-02-21T23:12:15.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.827+0000 7f6856a83740 20 client.7252 trim_cache size 0 max 16384 2024-02-21T23:12:15.822 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-02-21T23:12:15.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.827+0000 7f6852600640 1 -- 172.21.15.99:0/1206991438 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f682c09ef00 msgr2=0x7f682c0a13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:15.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.827+0000 7f6852600640 1 --2- 172.21.15.99:0/1206991438 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f682c09ef00 0x7f682c0a13c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6840007b10 tx=0x7f6840007a60 comp rx=0 tx=0).stop 2024-02-21T23:12:15.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.827+0000 7f6852600640 1 -- 172.21.15.99:0/1206991438 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f684c17f490 msgr2=0x7f684c1594c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:15.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.827+0000 7f6852600640 1 --2- 172.21.15.99:0/1206991438 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f684c17f490 0x7f684c1594c0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f683800e870 tx=0x7f683800ed30 comp rx=0 tx=0).stop 2024-02-21T23:12:15.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.827+0000 7f6852600640 1 -- 172.21.15.99:0/1206991438 shutdown_connections 2024-02-21T23:12:15.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.827+0000 7f6852600640 1 --2- 172.21.15.99:0/1206991438 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f682c09ef00 0x7f682c0a13c0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:15.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.827+0000 7f6852600640 1 --2- 172.21.15.99:0/1206991438 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f684c18b230 0x7f684c2202b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:15.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.827+0000 7f6852600640 1 --2- 172.21.15.99:0/1206991438 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f684c17f490 0x7f684c1594c0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:15.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.827+0000 7f6852600640 1 --2- 172.21.15.99:0/1206991438 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f684c0fc7c0 0x7f684c175f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:15.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.827+0000 7f6852600640 1 -- 172.21.15.99:0/1206991438 >> 172.21.15.99:0/1206991438 conn(0x7f684c0d29b0 msgr2=0x7f684c0fbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:15.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.828+0000 7f6852600640 1 -- 172.21.15.99:0/1206991438 shutdown_connections 2024-02-21T23:12:15.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:15.828+0000 7f6852600640 1 -- 172.21.15.99:0/1206991438 wait complete. 2024-02-21T23:12:15.832 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T23:12:15.832 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-02-21T23:12:16.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.053+0000 7fe256600640 1 Processor -- start 2024-02-21T23:12:16.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.053+0000 7fe256600640 1 -- start start 2024-02-21T23:12:16.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.056+0000 7fe256600640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fe25017f490 0x7fe25018ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:16.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.056+0000 7fe256600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe25018b4f0 0x7fe2500fd290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:16.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.056+0000 7fe256600640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2500d6dd0 con 0x7fe25018b060 2024-02-21T23:12:16.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.056+0000 7fe256600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2501614c0 con 0x7fe25018b4f0 2024-02-21T23:12:16.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.056+0000 7fe256600640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2500d6810 con 0x7fe25017f490 2024-02-21T23:12:16.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.057+0000 7fe255c00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe25018b4f0 0x7fe2500fd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:16.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.057+0000 7fe255200640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fe25017f490 0x7fe25018ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:16.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.057+0000 7fe255c00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fe25018b4f0 0x7fe2500fd290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60544/0 (socket says 172.21.15.99:60544) 2024-02-21T23:12:16.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.057+0000 7fe255c00640 1 -- 172.21.15.99:0/1667353146 learned_addr learned my addr 172.21.15.99:0/1667353146 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:12:16.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.057+0000 7fe24fe00640 1 --1- 172.21.15.99:0/1667353146 >> v1:172.21.15.181:6789/0 conn(0x7fe25018b060 0x7fe250188a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:57962/0 (socket says 172.21.15.99:57962) 2024-02-21T23:12:16.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.057+0000 7fe255c00640 1 -- 172.21.15.99:0/1667353146 >> v2:172.21.15.181:3300/0 conn(0x7fe25017f490 msgr2=0x7fe25018ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:16.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.057+0000 7fe255c00640 1 --2- 172.21.15.99:0/1667353146 >> v2:172.21.15.181:3300/0 conn(0x7fe25017f490 0x7fe25018ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:16.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.057+0000 7fe24f400640 1 -- 172.21.15.99:0/1667353146 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2901791575 0 0) 0x7fe2500d6dd0 con 0x7fe25018b060 2024-02-21T23:12:16.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.057+0000 7fe255c00640 1 -- 172.21.15.99:0/1667353146 >> v1:172.21.15.181:6789/0 conn(0x7fe25018b060 legacy=0x7fe250188a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:16.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.057+0000 7fe255c00640 1 -- 172.21.15.99:0/1667353146 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2500d6af0 con 0x7fe25018b4f0 2024-02-21T23:12:16.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.057+0000 7fe255200640 1 --2- 172.21.15.99:0/1667353146 >> v2:172.21.15.181:3300/0 conn(0x7fe25017f490 0x7fe25018ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:12:16.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.059+0000 7fe255c00640 1 --2- 172.21.15.99:0/1667353146 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe25018b4f0 0x7fe2500fd290 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fe250067c30 tx=0x7fe24802bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30e8845d9ef2d0fe server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:16.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.059+0000 7fe24f400640 1 -- 172.21.15.99:0/1667353146 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe24802cb10 con 0x7fe25018b4f0 2024-02-21T23:12:16.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.060+0000 7fe24f400640 1 -- 172.21.15.99:0/1667353146 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe24802ccb0 con 0x7fe25018b4f0 2024-02-21T23:12:16.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.060+0000 7fe24f400640 1 -- 172.21.15.99:0/1667353146 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe24802ce60 con 0x7fe25018b4f0 2024-02-21T23:12:16.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.060+0000 7fe256600640 1 -- 172.21.15.99:0/1667353146 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe25018b4f0 msgr2=0x7fe2500fd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:16.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.060+0000 7fe256600640 1 --2- 172.21.15.99:0/1667353146 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe25018b4f0 0x7fe2500fd290 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fe250067c30 tx=0x7fe24802bf70 comp rx=0 tx=0).stop 2024-02-21T23:12:16.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.060+0000 7fe256600640 1 -- 172.21.15.99:0/1667353146 shutdown_connections 2024-02-21T23:12:16.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.060+0000 7fe256600640 1 --2- 172.21.15.99:0/1667353146 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe25018b4f0 0x7fe2500fd290 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:16.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.060+0000 7fe256600640 1 --2- 172.21.15.99:0/1667353146 >> v2:172.21.15.181:3300/0 conn(0x7fe25017f490 0x7fe25018ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:16.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.060+0000 7fe256600640 1 -- 172.21.15.99:0/1667353146 >> 172.21.15.99:0/1667353146 conn(0x7fe2500d29b0 msgr2=0x7fe2500d2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:16.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.061+0000 7fe256600640 1 -- 172.21.15.99:0/1667353146 shutdown_connections 2024-02-21T23:12:16.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.061+0000 7fe256600640 1 -- 172.21.15.99:0/1667353146 wait complete. 2024-02-21T23:12:16.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.064+0000 7fe256600640 1 Processor -- start 2024-02-21T23:12:16.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.064+0000 7fe256600640 1 -- start start 2024-02-21T23:12:16.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.066+0000 7fe256600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe25017f490 0x7fe25021f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:16.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.066+0000 7fe256600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe25018b060 0x7fe250178440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:16.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.066+0000 7fe256600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe25018b4f0 0x7fe25021d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:16.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.066+0000 7fe256600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe25018a600 con 0x7fe25018b4f0 2024-02-21T23:12:16.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.066+0000 7fe256600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe25018a320 con 0x7fe25017f490 2024-02-21T23:12:16.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.066+0000 7fe256600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe25017f870 con 0x7fe25018b060 2024-02-21T23:12:16.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.066+0000 7fe255c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe25018b4f0 0x7fe25021d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:16.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.066+0000 7fe255c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe25018b4f0 0x7fe25021d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60560/0 (socket says 172.21.15.99:60560) 2024-02-21T23:12:16.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.066+0000 7fe255c00640 1 -- 172.21.15.99:0/3784193559 learned_addr learned my addr 172.21.15.99:0/3784193559 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:12:16.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.066+0000 7fe24fe00640 1 --2- 172.21.15.99:0/3784193559 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe25018b060 0x7fe250178440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:16.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.067+0000 7fe255200640 1 --2- 172.21.15.99:0/3784193559 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe25017f490 0x7fe25021f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:16.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.067+0000 7fe255c00640 1 -- 172.21.15.99:0/3784193559 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe25018b060 msgr2=0x7fe250178440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:16.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.067+0000 7fe255c00640 1 --2- 172.21.15.99:0/3784193559 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe25018b060 0x7fe250178440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:16.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.067+0000 7fe255c00640 1 -- 172.21.15.99:0/3784193559 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe25017f490 msgr2=0x7fe25021f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:16.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.067+0000 7fe255c00640 1 --2- 172.21.15.99:0/3784193559 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe25017f490 0x7fe25021f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:16.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.067+0000 7fe255c00640 1 -- 172.21.15.99:0/3784193559 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe25021e960 con 0x7fe25018b4f0 2024-02-21T23:12:16.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.067+0000 7fe255c00640 1 --2- 172.21.15.99:0/3784193559 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe25018b4f0 0x7fe25021d060 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fe248036040 tx=0x7fe248004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:16.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.068+0000 7fe24cc00640 1 -- 172.21.15.99:0/3784193559 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe248043030 con 0x7fe25018b4f0 2024-02-21T23:12:16.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.068+0000 7fe24cc00640 1 -- 172.21.15.99:0/3784193559 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe24803e450 con 0x7fe25018b4f0 2024-02-21T23:12:16.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.068+0000 7fe256600640 1 -- 172.21.15.99:0/3784193559 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe250221270 con 0x7fe25018b4f0 2024-02-21T23:12:16.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.068+0000 7fe24cc00640 1 -- 172.21.15.99:0/3784193559 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe24802ce60 con 0x7fe25018b4f0 2024-02-21T23:12:16.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.068+0000 7fe256600640 1 -- 172.21.15.99:0/3784193559 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe250221830 con 0x7fe25018b4f0 2024-02-21T23:12:16.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.072+0000 7fe25ac15740 1 Processor -- start 2024-02-21T23:12:16.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.072+0000 7fe24cc00640 1 -- 172.21.15.99:0/3784193559 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7fe248046070 con 0x7fe25018b4f0 2024-02-21T23:12:16.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.072+0000 7fe25ac15740 1 -- start start 2024-02-21T23:12:16.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.074+0000 7fe25ac15740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f598116660 0x55f598116a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:16.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.074+0000 7fe24cc00640 1 --2- 172.21.15.99:0/3784193559 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fe23009eed0 0x7fe2300a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:16.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.074+0000 7fe25ac15740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f598151330 0x55f5981517b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:16.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.074+0000 7fe25ac15740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f598151cf0 0x55f598152560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:16.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.074+0000 7fe25ac15740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f59803eb50 con 0x55f598151330 2024-02-21T23:12:16.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.074+0000 7fe25ac15740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f597fe7da0 con 0x55f598116660 2024-02-21T23:12:16.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.074+0000 7fe25ac15740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f59803abf0 con 0x55f598151cf0 2024-02-21T23:12:16.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.075+0000 7fe24cc00640 1 -- 172.21.15.99:0/3784193559 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 8877+0+0 (secure 0 0 0) 0x7fe2480ec0c0 con 0x7fe25018b4f0 2024-02-21T23:12:16.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.075+0000 7fe24fe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f598116660 0x55f598116a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:16.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.075+0000 7fe24fe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f598116660 0x55f598116a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:51216/0 (socket says 172.21.15.99:51216) 2024-02-21T23:12:16.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.075+0000 7fe24fe00640 1 -- 172.21.15.99:0/3872877604 learned_addr learned my addr 172.21.15.99:0/3872877604 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:12:16.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.075+0000 7fe255200640 1 --2- 172.21.15.99:0/3784193559 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fe23009eed0 0x7fe2300a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:16.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.075+0000 7fe24fe00640 1 --2- 172.21.15.99:0/3872877604 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f598151330 0x55f5981517b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:16.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.075+0000 7fe255c00640 1 --2- 172.21.15.99:0/3872877604 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f598151cf0 0x55f598152560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:16.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.075+0000 7fe24fe00640 1 -- 172.21.15.99:0/3872877604 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f598151cf0 msgr2=0x55f598152560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:16.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.075+0000 7fe24fe00640 1 --2- 172.21.15.99:0/3872877604 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f598151cf0 0x55f598152560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:16.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.075+0000 7fe24fe00640 1 -- 172.21.15.99:0/3872877604 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f598151330 msgr2=0x55f5981517b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:16.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.075+0000 7fe24fe00640 1 --2- 172.21.15.99:0/3872877604 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f598151330 0x55f5981517b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:16.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.075+0000 7fe24fe00640 1 -- 172.21.15.99:0/3872877604 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f59800af80 con 0x55f598116660 2024-02-21T23:12:16.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.075+0000 7fe255c00640 1 --2- 172.21.15.99:0/3872877604 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f598151cf0 0x55f598152560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:12:16.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.076+0000 7fe24fe00640 1 --2- 172.21.15.99:0/3872877604 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f598116660 0x55f598116a40 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fe23c018730 tx=0x7fe23c001400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15d9df7cce59318 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:16.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.076+0000 7fe241600640 1 -- 172.21.15.99:0/3872877604 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe23c007120 con 0x55f598116660 2024-02-21T23:12:16.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.076+0000 7fe255200640 1 --2- 172.21.15.99:0/3784193559 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fe23009eed0 0x7fe2300a1390 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe244009560 tx=0x7fe244009190 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:16.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.076+0000 7fe241600640 1 -- 172.21.15.99:0/3872877604 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe23c0072c0 con 0x55f598116660 2024-02-21T23:12:16.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.076+0000 7fe241600640 1 -- 172.21.15.99:0/3872877604 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe23c007670 con 0x55f598116660 2024-02-21T23:12:16.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.077+0000 7fe25ac15740 1 -- 172.21.15.99:0/3872877604 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f598116660 msgr2=0x55f598116a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:16.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.077+0000 7fe25ac15740 1 --2- 172.21.15.99:0/3872877604 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f598116660 0x55f598116a40 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fe23c018730 tx=0x7fe23c001400 comp rx=0 tx=0).stop 2024-02-21T23:12:16.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.077+0000 7fe25ac15740 1 -- 172.21.15.99:0/3872877604 shutdown_connections 2024-02-21T23:12:16.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.077+0000 7fe25ac15740 1 --2- 172.21.15.99:0/3872877604 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f598151cf0 0x55f598152560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:16.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.077+0000 7fe25ac15740 1 --2- 172.21.15.99:0/3872877604 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f598151330 0x55f5981517b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:16.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.077+0000 7fe25ac15740 1 --2- 172.21.15.99:0/3872877604 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f598116660 0x55f598116a40 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:16.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.077+0000 7fe25ac15740 1 -- 172.21.15.99:0/3872877604 >> 172.21.15.99:0/3872877604 conn(0x55f5980d86d0 msgr2=0x55f5980d9750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:16.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.077+0000 7fe25ac15740 1 -- 172.21.15.99:0/3872877604 shutdown_connections 2024-02-21T23:12:16.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.077+0000 7fe25ac15740 1 -- 172.21.15.99:0/3872877604 wait complete. 2024-02-21T23:12:16.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.078+0000 7fe25ac15740 1 -- start start 2024-02-21T23:12:16.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.078+0000 7fe25ac15740 1 Processor -- start 2024-02-21T23:12:16.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.080+0000 7fe25ac15740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f598151330 0x55f598145000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:16.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.080+0000 7fe25ac15740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f598151cf0 0x55f598108aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:16.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.080+0000 7fe25ac15740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f59810b430 0x55f59810b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:16.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.080+0000 7fe25ac15740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5981500a0 con 0x55f598151330 2024-02-21T23:12:16.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.080+0000 7fe25ac15740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f597fdd380 con 0x55f59810b430 2024-02-21T23:12:16.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.080+0000 7fe25ac15740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f59814fdc0 con 0x55f598151cf0 2024-02-21T23:12:16.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.080+0000 7fe25ac15740 10 client.0 _ll_register_callbacks cb 0x55f598036280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:12:16.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.080+0000 7fe24fe00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f598151cf0 0x55f598108aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:16.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.080+0000 7fe24fe00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f598151cf0 0x55f598108aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:46948/0 (socket says 172.21.15.99:46948) 2024-02-21T23:12:16.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.080+0000 7fe24fe00640 1 -- 172.21.15.99:0/507439833 learned_addr learned my addr 172.21.15.99:0/507439833 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:12:16.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.080+0000 7fe255c00640 1 --2- 172.21.15.99:0/507439833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f59810b430 0x55f59810b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:16.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.080+0000 7fe255200640 1 --2- 172.21.15.99:0/507439833 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f598151330 0x55f598145000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:16.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.080+0000 7fe24fe00640 1 -- 172.21.15.99:0/507439833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f59810b430 msgr2=0x55f59810b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:16.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.080+0000 7fe24fe00640 1 --2- 172.21.15.99:0/507439833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f59810b430 0x55f59810b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:16.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.080+0000 7fe24fe00640 1 -- 172.21.15.99:0/507439833 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f598151330 msgr2=0x55f598145000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:16.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.080+0000 7fe24fe00640 1 --2- 172.21.15.99:0/507439833 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f598151330 0x55f598145000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:16.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.081+0000 7fe24fe00640 1 -- 172.21.15.99:0/507439833 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f598005c20 con 0x55f598151cf0 2024-02-21T23:12:16.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.081+0000 7fe255200640 1 --2- 172.21.15.99:0/507439833 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f598151330 0x55f598145000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:12:16.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.081+0000 7fe24fe00640 1 --2- 172.21.15.99:0/507439833 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f598151cf0 0x55f598108aa0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fe23c007f70 tx=0x7fe23c007d10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5bc72c6ff3518d1d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:16.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.081+0000 7fe236000640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-02-21T23:12:16.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.081+0000 7fe236000640 1 -- 172.21.15.99:0/507439833 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe23c007120 con 0x55f598151cf0 2024-02-21T23:12:16.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.081+0000 7fe25ac15740 1 -- 172.21.15.99:0/507439833 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe23c0072c0 con 0x55f598151cf0 2024-02-21T23:12:16.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.081+0000 7fe236000640 1 -- 172.21.15.99:0/507439833 <== mon.2 v2:172.21.15.181:3300/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 8877+0+0 (secure 0 0 0) 0x7fe23c0049f0 con 0x55f598151cf0 2024-02-21T23:12:16.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.082+0000 7fe236000640 1 -- 172.21.15.99:0/507439833 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe23c032050 con 0x55f598151cf0 2024-02-21T23:12:16.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.082+0000 7fe25ac15740 10 client.7223 fetch_fsmap learned FSMap version 17 2024-02-21T23:12:16.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.082+0000 7fe25ac15740 1 -- 172.21.15.99:0/507439833 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55f597d533f0 con 0x55f598151cf0 2024-02-21T23:12:16.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.082+0000 7fe236000640 1 -- 172.21.15.99:0/507439833 <== mon.2 v2:172.21.15.181:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe23c0072c0 con 0x55f598151cf0 2024-02-21T23:12:16.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.082+0000 7fe236000640 1 -- 172.21.15.99:0/507439833 <== mon.2 v2:172.21.15.181:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fe23c004bf0 con 0x55f598151cf0 2024-02-21T23:12:16.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.082+0000 7fe25ac15740 10 client.7223 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:12:16.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.082+0000 7fe25ac15740 10 client.7223 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:12:16.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.082+0000 7fe25ac15740 20 client.7223 populate_metadata read hostname 'smithi099' 2024-02-21T23:12:16.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.082+0000 7fe25ac15740 1 --2- 172.21.15.99:0/507439833 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55f598109b80 0x55f598109fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:16.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.082+0000 7fe25ac15740 4 client.7223 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:12:16.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.082+0000 7fe25ac15740 1 -- 172.21.15.99:0/507439833 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f59804c090 con 0x55f598109b80 2024-02-21T23:12:16.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.083+0000 7fe255200640 1 --2- 172.21.15.99:0/507439833 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55f598109b80 0x55f598109fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:16.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.084+0000 7fe255200640 1 --2- 172.21.15.99:0/507439833 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55f598109b80 0x55f598109fb0 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=189aefa8656cdb19 server_cookie=ad7446c4a3d5c169 in_seq=0 out_seq=0 2024-02-21T23:12:16.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.084+0000 7fe236000640 10 client.7223 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:12:16.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.084+0000 7fe236000640 1 -- 172.21.15.99:0/507439833 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55f59804c090 con 0x55f598109b80 2024-02-21T23:12:16.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.084+0000 7fe236000640 10 client.7223 handle_command_reply: tid=0 2024-02-21T23:12:16.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.085+0000 7fe25ac15740 1 client.7223 shutdown 2024-02-21T23:12:16.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.085+0000 7fe25ac15740 1 -- 172.21.15.99:0/507439833 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f598151cf0 msgr2=0x55f598108aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:16.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.085+0000 7fe25ac15740 1 --2- 172.21.15.99:0/507439833 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f598151cf0 0x55f598108aa0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fe23c007f70 tx=0x7fe23c007d10 comp rx=0 tx=0).stop 2024-02-21T23:12:16.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.085+0000 7fe25ac15740 1 -- 172.21.15.99:0/507439833 shutdown_connections 2024-02-21T23:12:16.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.085+0000 7fe25ac15740 1 --2- 172.21.15.99:0/507439833 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55f598109b80 0x55f598109fb0 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:16.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.085+0000 7fe25ac15740 1 --2- 172.21.15.99:0/507439833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f59810b430 0x55f59810b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:16.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.085+0000 7fe25ac15740 1 --2- 172.21.15.99:0/507439833 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f598151cf0 0x55f598108aa0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:16.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.085+0000 7fe25ac15740 1 --2- 172.21.15.99:0/507439833 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f598151330 0x55f598145000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:16.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.085+0000 7fe25ac15740 1 -- 172.21.15.99:0/507439833 >> 172.21.15.99:0/507439833 conn(0x55f598116660 msgr2=0x55f598110090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:16.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.085+0000 7fe236000640 0 client.7223 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:12:16.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.085+0000 7fe25ac15740 1 -- 172.21.15.99:0/507439833 shutdown_connections 2024-02-21T23:12:16.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.085+0000 7fe25ac15740 1 -- 172.21.15.99:0/507439833 wait complete. 2024-02-21T23:12:16.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.085+0000 7fe25ac15740 20 client.7223 trim_cache size 0 max 16384 2024-02-21T23:12:16.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.099+0000 7fe25ac15740 1 Processor -- start 2024-02-21T23:12:16.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.099+0000 7fe25ac15740 1 -- start start 2024-02-21T23:12:16.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.100+0000 7fe25ac15740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f59810b430 0x55f598112ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:16.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.100+0000 7fe25ac15740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f598151330 0x55f5980d6740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:16.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.100+0000 7fe25ac15740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f598151cf0 0x55f5981a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:16.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.100+0000 7fe25ac15740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe25022c870 con 0x55f598151330 2024-02-21T23:12:16.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.100+0000 7fe25ac15740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe25022a410 con 0x55f59810b430 2024-02-21T23:12:16.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.100+0000 7fe25ac15740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2502285d0 con 0x55f598151cf0 2024-02-21T23:12:16.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.101+0000 7fe24fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f598151330 0x55f5980d6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:16.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.101+0000 7fe24fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f598151330 0x55f5980d6740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60582/0 (socket says 172.21.15.99:60582) 2024-02-21T23:12:16.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.101+0000 7fe24fe00640 1 -- 172.21.15.99:0/3716289697 learned_addr learned my addr 172.21.15.99:0/3716289697 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:12:16.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.101+0000 7fe255c00640 1 --2- 172.21.15.99:0/3716289697 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f598151cf0 0x55f5981a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:16.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.101+0000 7fe255200640 1 --2- 172.21.15.99:0/3716289697 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f59810b430 0x55f598112ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:16.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.101+0000 7fe24fe00640 1 -- 172.21.15.99:0/3716289697 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f598151cf0 msgr2=0x55f5981a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:16.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.101+0000 7fe24fe00640 1 --2- 172.21.15.99:0/3716289697 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f598151cf0 0x55f5981a6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:16.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.101+0000 7fe24fe00640 1 -- 172.21.15.99:0/3716289697 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f59810b430 msgr2=0x55f598112ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:16.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.101+0000 7fe24fe00640 1 --2- 172.21.15.99:0/3716289697 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f59810b430 0x55f598112ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:16.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.101+0000 7fe24fe00640 1 -- 172.21.15.99:0/3716289697 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f597e1d7d0 con 0x55f598151330 2024-02-21T23:12:16.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.101+0000 7fe24fe00640 1 --2- 172.21.15.99:0/3716289697 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f598151330 0x55f5980d6740 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fe23c0017b0 tx=0x7fe23c023000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=446aebe07d9d5d2c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:16.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.102+0000 7fe240c00640 1 -- 172.21.15.99:0/3716289697 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe23c03b070 con 0x55f598151330 2024-02-21T23:12:16.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.102+0000 7fe240c00640 1 -- 172.21.15.99:0/3716289697 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe23c029070 con 0x55f598151330 2024-02-21T23:12:16.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.102+0000 7fe240c00640 1 -- 172.21.15.99:0/3716289697 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe23c0012b0 con 0x55f598151330 2024-02-21T23:12:16.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.103+0000 7fe25ac15740 1 -- 172.21.15.99:0/3716289697 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f598151330 msgr2=0x55f5980d6740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:16.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.103+0000 7fe25ac15740 1 --2- 172.21.15.99:0/3716289697 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f598151330 0x55f5980d6740 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fe23c0017b0 tx=0x7fe23c023000 comp rx=0 tx=0).stop 2024-02-21T23:12:16.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.103+0000 7fe25ac15740 1 -- 172.21.15.99:0/3716289697 shutdown_connections 2024-02-21T23:12:16.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.103+0000 7fe25ac15740 1 --2- 172.21.15.99:0/3716289697 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f598151cf0 0x55f5981a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:16.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.103+0000 7fe25ac15740 1 --2- 172.21.15.99:0/3716289697 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f598151330 0x55f5980d6740 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:16.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.103+0000 7fe25ac15740 1 --2- 172.21.15.99:0/3716289697 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f59810b430 0x55f598112ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:16.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.103+0000 7fe25ac15740 1 -- 172.21.15.99:0/3716289697 >> 172.21.15.99:0/3716289697 conn(0x55f598116660 msgr2=0x55f598145660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:16.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.103+0000 7fe25ac15740 1 -- 172.21.15.99:0/3716289697 shutdown_connections 2024-02-21T23:12:16.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.103+0000 7fe25ac15740 1 -- 172.21.15.99:0/3716289697 wait complete. 2024-02-21T23:12:16.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.104+0000 7fe25ac15740 1 -- start start 2024-02-21T23:12:16.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.104+0000 7fe25ac15740 1 Processor -- start 2024-02-21T23:12:16.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.105+0000 7fe25ac15740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f59810b430 0x55f59819b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:16.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.105+0000 7fe25ac15740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f598151330 0x55f598151710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:16.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.105+0000 7fe25ac15740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f598151cf0 0x55f59819af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:16.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.105+0000 7fe25ac15740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe250228ad0 con 0x55f598151330 2024-02-21T23:12:16.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.105+0000 7fe25ac15740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe250229db0 con 0x55f59810b430 2024-02-21T23:12:16.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.105+0000 7fe25ac15740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2502290f0 con 0x55f598151cf0 2024-02-21T23:12:16.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.105+0000 7fe25ac15740 10 client.0 _ll_register_callbacks cb 0x7fe23c001b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:12:16.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.105+0000 7fe24fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f598151330 0x55f598151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:16.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.105+0000 7fe24fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f598151330 0x55f598151710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:60588/0 (socket says 172.21.15.99:60588) 2024-02-21T23:12:16.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.105+0000 7fe24fe00640 1 -- 172.21.15.99:0/1823956906 learned_addr learned my addr 172.21.15.99:0/1823956906 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:12:16.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.106+0000 7fe255200640 1 --2- 172.21.15.99:0/1823956906 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f59810b430 0x55f59819b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:16.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.106+0000 7fe255c00640 1 --2- 172.21.15.99:0/1823956906 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f598151cf0 0x55f59819af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:16.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.106+0000 7fe24fe00640 1 -- 172.21.15.99:0/1823956906 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f598151cf0 msgr2=0x55f59819af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:16.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.106+0000 7fe24fe00640 1 --2- 172.21.15.99:0/1823956906 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f598151cf0 0x55f59819af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:16.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.106+0000 7fe24fe00640 1 -- 172.21.15.99:0/1823956906 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f59810b430 msgr2=0x55f59819b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:16.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.106+0000 7fe24fe00640 1 --2- 172.21.15.99:0/1823956906 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f59810b430 0x55f59819b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:16.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.106+0000 7fe24fe00640 1 -- 172.21.15.99:0/1823956906 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f59811ac00 con 0x55f598151330 2024-02-21T23:12:16.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.106+0000 7fe255200640 1 --2- 172.21.15.99:0/1823956906 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f59810b430 0x55f59819b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:12:16.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.106+0000 7fe24fe00640 1 --2- 172.21.15.99:0/1823956906 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f598151330 0x55f598151710 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fe23c006040 tx=0x7fe23c0017e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cb1377cfaa16d67 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:16.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.106+0000 7fe236000640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:12:16.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.107+0000 7fe236000640 1 -- 172.21.15.99:0/1823956906 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe23c044060 con 0x55f598151330 2024-02-21T23:12:16.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.107+0000 7fe236000640 1 -- 172.21.15.99:0/1823956906 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 8877+0+0 (secure 0 0 0) 0x7fe23c0049f0 con 0x55f598151330 2024-02-21T23:12:16.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.107+0000 7fe25ac15740 1 -- 172.21.15.99:0/1823956906 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe23c029070 con 0x55f598151330 2024-02-21T23:12:16.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.107+0000 7fe236000640 1 -- 172.21.15.99:0/1823956906 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe23c03b040 con 0x55f598151330 2024-02-21T23:12:16.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.107+0000 7fe25ac15740 10 client.7074 fetch_fsmap learned FSMap version 17 2024-02-21T23:12:16.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.107+0000 7fe25ac15740 1 -- 172.21.15.99:0/1823956906 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55f59811b1c0 con 0x55f598151330 2024-02-21T23:12:16.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.107+0000 7fe236000640 1 -- 172.21.15.99:0/1823956906 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe23c029070 con 0x55f598151330 2024-02-21T23:12:16.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.107+0000 7fe236000640 1 -- 172.21.15.99:0/1823956906 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fe23c03e070 con 0x55f598151330 2024-02-21T23:12:16.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.107+0000 7fe25ac15740 10 client.7074 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:12:16.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.107+0000 7fe25ac15740 10 client.7074 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:12:16.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.107+0000 7fe25ac15740 20 client.7074 populate_metadata read hostname 'smithi099' 2024-02-21T23:12:16.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.108+0000 7fe25ac15740 1 --2- 172.21.15.99:0/1823956906 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55f5980dfdc0 0x55f598149790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:16.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.108+0000 7fe25ac15740 4 client.7074 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T23:12:16.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.108+0000 7fe25ac15740 1 -- 172.21.15.99:0/1823956906 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55f5980463e0 con 0x55f5980dfdc0 2024-02-21T23:12:16.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.108+0000 7fe255200640 1 --2- 172.21.15.99:0/1823956906 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55f5980dfdc0 0x55f598149790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:16.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.108+0000 7fe255200640 1 --2- 172.21.15.99:0/1823956906 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55f5980dfdc0 0x55f598149790 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76ae9875a67e3618 server_cookie=f382517c1361cdc2 in_seq=0 out_seq=0 2024-02-21T23:12:16.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.108+0000 7fe236000640 10 client.7074 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:12:16.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.109+0000 7fe236000640 1 -- 172.21.15.99:0/1823956906 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55f5980463e0 con 0x55f5980dfdc0 2024-02-21T23:12:16.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.109+0000 7fe236000640 10 client.7074 handle_command_reply: tid=0 2024-02-21T23:12:16.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.109+0000 7fe25ac15740 1 client.7074 shutdown 2024-02-21T23:12:16.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.109+0000 7fe25ac15740 1 -- 172.21.15.99:0/1823956906 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f598151330 msgr2=0x55f598151710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:16.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.109+0000 7fe25ac15740 1 --2- 172.21.15.99:0/1823956906 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f598151330 0x55f598151710 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fe23c006040 tx=0x7fe23c0017e0 comp rx=0 tx=0).stop 2024-02-21T23:12:16.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.109+0000 7fe25ac15740 1 -- 172.21.15.99:0/1823956906 shutdown_connections 2024-02-21T23:12:16.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.109+0000 7fe25ac15740 1 --2- 172.21.15.99:0/1823956906 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55f5980dfdc0 0x55f598149790 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:16.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.109+0000 7fe25ac15740 1 --2- 172.21.15.99:0/1823956906 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55f598151cf0 0x55f59819af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:16.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.109+0000 7fe25ac15740 1 --2- 172.21.15.99:0/1823956906 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55f598151330 0x55f598151710 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:16.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.109+0000 7fe25ac15740 1 --2- 172.21.15.99:0/1823956906 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55f59810b430 0x55f59819b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:16.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.109+0000 7fe25ac15740 1 -- 172.21.15.99:0/1823956906 >> 172.21.15.99:0/1823956906 conn(0x55f598116660 msgr2=0x55f59810abc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:16.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.109+0000 7fe236000640 0 client.7074 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:12:16.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.109+0000 7fe25ac15740 1 -- 172.21.15.99:0/1823956906 shutdown_connections 2024-02-21T23:12:16.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.109+0000 7fe25ac15740 1 -- 172.21.15.99:0/1823956906 wait complete. 2024-02-21T23:12:16.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.109+0000 7fe25ac15740 20 client.7074 trim_cache size 0 max 16384 2024-02-21T23:12:16.106 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-02-21T23:12:16.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.110+0000 7fe256600640 1 -- 172.21.15.99:0/3784193559 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fe23009eed0 msgr2=0x7fe2300a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:16.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.110+0000 7fe256600640 1 --2- 172.21.15.99:0/3784193559 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fe23009eed0 0x7fe2300a1390 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe244009560 tx=0x7fe244009190 comp rx=0 tx=0).stop 2024-02-21T23:12:16.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.110+0000 7fe256600640 1 -- 172.21.15.99:0/3784193559 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe25018b4f0 msgr2=0x7fe25021d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:16.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.110+0000 7fe256600640 1 --2- 172.21.15.99:0/3784193559 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe25018b4f0 0x7fe25021d060 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fe248036040 tx=0x7fe248004a40 comp rx=0 tx=0).stop 2024-02-21T23:12:16.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.110+0000 7fe256600640 1 -- 172.21.15.99:0/3784193559 shutdown_connections 2024-02-21T23:12:16.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.110+0000 7fe256600640 1 --2- 172.21.15.99:0/3784193559 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fe23009eed0 0x7fe2300a1390 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:16.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.110+0000 7fe256600640 1 --2- 172.21.15.99:0/3784193559 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe25018b4f0 0x7fe25021d060 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:16.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.110+0000 7fe256600640 1 --2- 172.21.15.99:0/3784193559 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe25018b060 0x7fe250178440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:16.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.110+0000 7fe256600640 1 --2- 172.21.15.99:0/3784193559 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe25017f490 0x7fe25021f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:16.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.110+0000 7fe256600640 1 -- 172.21.15.99:0/3784193559 >> 172.21.15.99:0/3784193559 conn(0x7fe2500d29b0 msgr2=0x7fe2500fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:16.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.110+0000 7fe256600640 1 -- 172.21.15.99:0/3784193559 shutdown_connections 2024-02-21T23:12:16.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:16.111+0000 7fe256600640 1 -- 172.21.15.99:0/3784193559 wait complete. 2024-02-21T23:12:17.117 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-02-21T23:12:17.117 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T23:12:17.117 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-02-21T23:12:17.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.354+0000 7f4021600640 1 Processor -- start 2024-02-21T23:12:17.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.354+0000 7f4021600640 1 -- start start 2024-02-21T23:12:17.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.356+0000 7f4021600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f401c189f40 0x7f401c18b920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:17.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.356+0000 7f4021600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f401c071c20 0x7f401c072080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:17.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.356+0000 7f4021600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f401c18a5a0 con 0x7f401c17f710 2024-02-21T23:12:17.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.356+0000 7f4021600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f401c18a880 con 0x7f401c189f40 2024-02-21T23:12:17.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.356+0000 7f4021600640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f401c18ab60 con 0x7f401c071c20 2024-02-21T23:12:17.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.357+0000 7f4013e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f401c189f40 0x7f401c18b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:17.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.357+0000 7f401be00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f401c17f710 0x7f401c15e490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.99:56580/0 (socket says 172.21.15.99:56580) 2024-02-21T23:12:17.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.357+0000 7f401be00640 1 -- 172.21.15.99:0/4046634872 learned_addr learned my addr 172.21.15.99:0/4046634872 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:12:17.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.357+0000 7f4020c00640 1 --2- 172.21.15.99:0/4046634872 >> v2:172.21.15.162:3300/0 conn(0x7f401c071c20 0x7f401c072080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:17.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.357+0000 7f4013e00640 1 -- 172.21.15.99:0/4046634872 >> v2:172.21.15.162:3300/0 conn(0x7f401c071c20 msgr2=0x7f401c072080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:17.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.357+0000 7f4013e00640 1 --2- 172.21.15.99:0/4046634872 >> v2:172.21.15.162:3300/0 conn(0x7f401c071c20 0x7f401c072080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:17.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.357+0000 7f4013e00640 1 -- 172.21.15.99:0/4046634872 >> v1:172.21.15.162:6789/0 conn(0x7f401c17f710 legacy=0x7f401c15e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:17.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.357+0000 7f4013e00640 1 -- 172.21.15.99:0/4046634872 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f401c18ae40 con 0x7f401c189f40 2024-02-21T23:12:17.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.357+0000 7f401b400640 1 -- 172.21.15.99:0/4046634872 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 504148278 0 0) 0x7f401c18a5a0 con 0x7f401c17f710 2024-02-21T23:12:17.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.358+0000 7f4013e00640 1 --2- 172.21.15.99:0/4046634872 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f401c189f40 0x7f401c18b920 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f401c0ff3e0 tx=0x7f400402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9f31be9c792b2a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:17.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.359+0000 7f401b400640 1 -- 172.21.15.99:0/4046634872 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4004035020 con 0x7f401c189f40 2024-02-21T23:12:17.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.359+0000 7f401b400640 1 -- 172.21.15.99:0/4046634872 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4004031830 con 0x7f401c189f40 2024-02-21T23:12:17.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.359+0000 7f401b400640 1 -- 172.21.15.99:0/4046634872 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4004031c00 con 0x7f401c189f40 2024-02-21T23:12:17.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.359+0000 7f4021600640 1 -- 172.21.15.99:0/4046634872 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f401c189f40 msgr2=0x7f401c18b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:17.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.359+0000 7f4021600640 1 --2- 172.21.15.99:0/4046634872 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f401c189f40 0x7f401c18b920 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f401c0ff3e0 tx=0x7f400402b8d0 comp rx=0 tx=0).stop 2024-02-21T23:12:17.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.359+0000 7f4021600640 1 -- 172.21.15.99:0/4046634872 shutdown_connections 2024-02-21T23:12:17.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.359+0000 7f4021600640 1 --2- 172.21.15.99:0/4046634872 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f401c189f40 0x7f401c18b920 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:17.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.359+0000 7f4021600640 1 --2- 172.21.15.99:0/4046634872 >> v2:172.21.15.162:3300/0 conn(0x7f401c071c20 0x7f401c072080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:17.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.359+0000 7f4021600640 1 -- 172.21.15.99:0/4046634872 >> 172.21.15.99:0/4046634872 conn(0x7f401c0fe310 msgr2=0x7f401c0fe720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:17.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.359+0000 7f4021600640 1 -- 172.21.15.99:0/4046634872 shutdown_connections 2024-02-21T23:12:17.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.359+0000 7f4021600640 1 -- 172.21.15.99:0/4046634872 wait complete. 2024-02-21T23:12:17.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.361+0000 7f4021600640 1 Processor -- start 2024-02-21T23:12:17.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.362+0000 7f4021600640 1 -- start start 2024-02-21T23:12:17.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.364+0000 7f4021600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f401c071c20 0x7f401c17cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:17.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.364+0000 7f4021600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f401c17f710 0x7f401c15fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:17.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.364+0000 7f4021600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f401c189f40 0x7f401c0f7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:17.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.364+0000 7f4021600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f401c0d5170 con 0x7f401c17f710 2024-02-21T23:12:17.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.364+0000 7f4021600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f401c0d4ff0 con 0x7f401c071c20 2024-02-21T23:12:17.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.364+0000 7f4021600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f401c0d52f0 con 0x7f401c189f40 2024-02-21T23:12:17.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.364+0000 7f401be00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f401c071c20 0x7f401c17cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:17.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.364+0000 7f4013e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f401c17f710 0x7f401c15fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:17.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.364+0000 7f401be00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f401c071c20 0x7f401c17cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:38424/0 (socket says 172.21.15.99:38424) 2024-02-21T23:12:17.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.364+0000 7f401be00640 1 -- 172.21.15.99:0/2568289895 learned_addr learned my addr 172.21.15.99:0/2568289895 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:12:17.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.364+0000 7f4020c00640 1 --2- 172.21.15.99:0/2568289895 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f401c189f40 0x7f401c0f7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:17.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.364+0000 7f401be00640 1 -- 172.21.15.99:0/2568289895 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f401c189f40 msgr2=0x7f401c0f7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:17.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.365+0000 7f401be00640 1 --2- 172.21.15.99:0/2568289895 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f401c189f40 0x7f401c0f7360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:17.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.365+0000 7f401be00640 1 -- 172.21.15.99:0/2568289895 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f401c17f710 msgr2=0x7f401c15fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:17.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.365+0000 7f401be00640 1 --2- 172.21.15.99:0/2568289895 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f401c17f710 0x7f401c15fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:17.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.365+0000 7f401be00640 1 -- 172.21.15.99:0/2568289895 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f401c177c90 con 0x7f401c071c20 2024-02-21T23:12:17.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.365+0000 7f4013e00640 1 --2- 172.21.15.99:0/2568289895 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f401c17f710 0x7f401c15fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:12:17.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.365+0000 7f401be00640 1 --2- 172.21.15.99:0/2568289895 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f401c071c20 0x7f401c17cdb0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f400c00c4a0 tx=0x7f400c00c960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:17.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.365+0000 7f4018c00640 1 -- 172.21.15.99:0/2568289895 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400c018070 con 0x7f401c071c20 2024-02-21T23:12:17.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.365+0000 7f4018c00640 1 -- 172.21.15.99:0/2568289895 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f400c0075a0 con 0x7f401c071c20 2024-02-21T23:12:17.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.365+0000 7f4021600640 1 -- 172.21.15.99:0/2568289895 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f401c21cd20 con 0x7f401c071c20 2024-02-21T23:12:17.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.365+0000 7f4018c00640 1 -- 172.21.15.99:0/2568289895 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400c004a20 con 0x7f401c071c20 2024-02-21T23:12:17.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.365+0000 7f4021600640 1 -- 172.21.15.99:0/2568289895 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f401c21d2e0 con 0x7f401c071c20 2024-02-21T23:12:17.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.368+0000 7f4018c00640 1 -- 172.21.15.99:0/2568289895 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f400c01b070 con 0x7f401c071c20 2024-02-21T23:12:17.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.370+0000 7f4025a69740 1 Processor -- start 2024-02-21T23:12:17.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.371+0000 7f4025a69740 1 -- start start 2024-02-21T23:12:17.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.371+0000 7f4018c00640 1 --2- 172.21.15.99:0/2568289895 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f3ff809eed0 0x7f3ff80a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:17.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.371+0000 7f4018c00640 1 -- 172.21.15.99:0/2568289895 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f400c0c91c0 con 0x7f401c071c20 2024-02-21T23:12:17.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.371+0000 7f4020c00640 1 --2- 172.21.15.99:0/2568289895 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f3ff809eed0 0x7f3ff80a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:17.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.372+0000 7f4025a69740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56129e7044c0 0x56129e7048a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:17.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.372+0000 7f4020c00640 1 --2- 172.21.15.99:0/2568289895 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f3ff809eed0 0x7f3ff80a1390 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f40140113e0 tx=0x7f401400b040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:17.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.372+0000 7f4025a69740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56129e704de0 0x56129e73f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:17.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.372+0000 7f4025a69740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56129e73fb90 0x56129e740920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:17.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.372+0000 7f4025a69740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x56129e62c790 con 0x56129e704de0 2024-02-21T23:12:17.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.372+0000 7f4025a69740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x56129e5d5bf0 con 0x56129e7044c0 2024-02-21T23:12:17.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.372+0000 7f4025a69740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x56129e628830 con 0x56129e73fb90 2024-02-21T23:12:17.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.372+0000 7f401be00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56129e7044c0 0x56129e7048a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:17.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.372+0000 7f401be00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56129e7044c0 0x56129e7048a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:38428/0 (socket says 172.21.15.99:38428) 2024-02-21T23:12:17.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.372+0000 7f401be00640 1 -- 172.21.15.99:0/805224191 learned_addr learned my addr 172.21.15.99:0/805224191 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:12:17.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.372+0000 7f4020c00640 1 --2- 172.21.15.99:0/805224191 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56129e73fb90 0x56129e740920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:17.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.372+0000 7f401be00640 1 -- 172.21.15.99:0/805224191 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56129e73fb90 msgr2=0x56129e740920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:17.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.372+0000 7f401be00640 1 --2- 172.21.15.99:0/805224191 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56129e73fb90 0x56129e740920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:17.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.372+0000 7f401be00640 1 -- 172.21.15.99:0/805224191 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56129e704de0 msgr2=0x56129e73f650 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-02-21T23:12:17.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.373+0000 7f4013e00640 1 --2- 172.21.15.99:0/805224191 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56129e704de0 0x56129e73f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:17.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.373+0000 7f401be00640 1 --2- 172.21.15.99:0/805224191 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56129e704de0 0x56129e73f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:17.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.373+0000 7f401be00640 1 -- 172.21.15.99:0/805224191 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56129e5f3c40 con 0x56129e7044c0 2024-02-21T23:12:17.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.373+0000 7f4013e00640 1 --2- 172.21.15.99:0/805224191 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56129e704de0 0x56129e73f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T23:12:17.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.374+0000 7f401be00640 1 --2- 172.21.15.99:0/805224191 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56129e7044c0 0x56129e7048a0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f400c0c6800 tx=0x7f400c094cc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0241411c0b57303 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:17.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.374+0000 7f400be00640 1 -- 172.21.15.99:0/805224191 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400c0930a0 con 0x56129e7044c0 2024-02-21T23:12:17.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.374+0000 7f400be00640 1 -- 172.21.15.99:0/805224191 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f400c004bc0 con 0x56129e7044c0 2024-02-21T23:12:17.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.374+0000 7f400be00640 1 -- 172.21.15.99:0/805224191 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400c093240 con 0x56129e7044c0 2024-02-21T23:12:17.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.374+0000 7f4025a69740 1 -- 172.21.15.99:0/805224191 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56129e7044c0 msgr2=0x56129e7048a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:17.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.374+0000 7f4025a69740 1 --2- 172.21.15.99:0/805224191 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56129e7044c0 0x56129e7048a0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f400c0c6800 tx=0x7f400c094cc0 comp rx=0 tx=0).stop 2024-02-21T23:12:17.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.374+0000 7f4025a69740 1 -- 172.21.15.99:0/805224191 shutdown_connections 2024-02-21T23:12:17.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.374+0000 7f4025a69740 1 --2- 172.21.15.99:0/805224191 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56129e73fb90 0x56129e740920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:17.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.374+0000 7f4025a69740 1 --2- 172.21.15.99:0/805224191 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56129e704de0 0x56129e73f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:17.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.374+0000 7f4025a69740 1 --2- 172.21.15.99:0/805224191 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56129e7044c0 0x56129e7048a0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:17.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.375+0000 7f4025a69740 1 -- 172.21.15.99:0/805224191 >> 172.21.15.99:0/805224191 conn(0x56129e6c6a90 msgr2=0x56129e6c7b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:17.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.376+0000 7f4025a69740 1 -- 172.21.15.99:0/805224191 shutdown_connections 2024-02-21T23:12:17.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.377+0000 7f4025a69740 1 -- 172.21.15.99:0/805224191 wait complete. 2024-02-21T23:12:17.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.377+0000 7f4025a69740 1 -- start start 2024-02-21T23:12:17.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.378+0000 7f4025a69740 1 Processor -- start 2024-02-21T23:12:17.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.379+0000 7f4025a69740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56129e704de0 0x56129e6fa740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:17.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.379+0000 7f4025a69740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56129e73fb90 0x56129e74a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:17.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.379+0000 7f4025a69740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56129e746e70 0x56129e7495d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:17.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.379+0000 7f4025a69740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x56129e73e070 con 0x56129e704de0 2024-02-21T23:12:17.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.379+0000 7f4025a69740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x56129e5cb1d0 con 0x56129e73fb90 2024-02-21T23:12:17.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.379+0000 7f4025a69740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x56129e73e350 con 0x56129e746e70 2024-02-21T23:12:17.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.379+0000 7f4025a69740 10 client.0 _ll_register_callbacks cb 0x56129e340c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:12:17.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.379+0000 7f401be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56129e704de0 0x56129e6fa740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:17.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.379+0000 7f401be00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56129e704de0 0x56129e6fa740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56888/0 (socket says 172.21.15.99:56888) 2024-02-21T23:12:17.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.379+0000 7f401be00640 1 -- 172.21.15.99:0/1029379270 learned_addr learned my addr 172.21.15.99:0/1029379270 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:12:17.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.380+0000 7f4013e00640 1 --2- 172.21.15.99:0/1029379270 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56129e73fb90 0x56129e74a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:17.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.379+0000 7f4020c00640 1 --2- 172.21.15.99:0/1029379270 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56129e746e70 0x56129e7495d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:17.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.380+0000 7f401be00640 1 -- 172.21.15.99:0/1029379270 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56129e746e70 msgr2=0x56129e7495d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:17.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.380+0000 7f401be00640 1 --2- 172.21.15.99:0/1029379270 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56129e746e70 0x56129e7495d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:17.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.380+0000 7f401be00640 1 -- 172.21.15.99:0/1029379270 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56129e73fb90 msgr2=0x56129e74a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:17.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.380+0000 7f401be00640 1 --2- 172.21.15.99:0/1029379270 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56129e73fb90 0x56129e74a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:17.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.380+0000 7f401be00640 1 -- 172.21.15.99:0/1029379270 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56129e4097e0 con 0x56129e704de0 2024-02-21T23:12:17.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.380+0000 7f4013e00640 1 --2- 172.21.15.99:0/1029379270 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56129e73fb90 0x56129e74a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:12:17.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.380+0000 7f401be00640 1 --2- 172.21.15.99:0/1029379270 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56129e704de0 0x56129e6fa740 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f400c00ce60 tx=0x7f400c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adb7798f1a42a04 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:17.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.380+0000 7f4008c00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:12:17.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.380+0000 7f4008c00640 1 -- 172.21.15.99:0/1029379270 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400c0b4050 con 0x56129e704de0 2024-02-21T23:12:17.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.380+0000 7f4008c00640 1 -- 172.21.15.99:0/1029379270 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f400c096110 con 0x56129e704de0 2024-02-21T23:12:17.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.380+0000 7f4025a69740 1 -- 172.21.15.99:0/1029379270 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f400c004bc0 con 0x56129e704de0 2024-02-21T23:12:17.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.380+0000 7f4008c00640 1 -- 172.21.15.99:0/1029379270 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f400c092780 con 0x56129e704de0 2024-02-21T23:12:17.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.381+0000 7f4025a69740 10 client.7083 fetch_fsmap learned FSMap version 17 2024-02-21T23:12:17.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.381+0000 7f4025a69740 1 -- 172.21.15.99:0/1029379270 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x56129e469f70 con 0x56129e704de0 2024-02-21T23:12:17.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.381+0000 7f4008c00640 1 -- 172.21.15.99:0/1029379270 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f400c004bc0 con 0x56129e704de0 2024-02-21T23:12:17.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.381+0000 7f4008c00640 1 -- 172.21.15.99:0/1029379270 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f400c092920 con 0x56129e704de0 2024-02-21T23:12:17.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.381+0000 7f4025a69740 10 client.7083 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:12:17.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.381+0000 7f4025a69740 10 client.7083 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:12:17.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.381+0000 7f4025a69740 20 client.7083 populate_metadata read hostname 'smithi099' 2024-02-21T23:12:17.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.381+0000 7f4025a69740 1 --2- 172.21.15.99:0/1029379270 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x56129e7031a0 0x56129e74c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:17.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.381+0000 7f4025a69740 4 client.7083 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:12:17.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.381+0000 7f4025a69740 1 -- 172.21.15.99:0/1029379270 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56129e639cd0 con 0x56129e7031a0 2024-02-21T23:12:17.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.381+0000 7f4013e00640 1 --2- 172.21.15.99:0/1029379270 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x56129e7031a0 0x56129e74c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:17.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.382+0000 7f4013e00640 1 --2- 172.21.15.99:0/1029379270 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x56129e7031a0 0x56129e74c940 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d11f9db320d995bd server_cookie=83cbc3085db5cb0b in_seq=0 out_seq=0 2024-02-21T23:12:17.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.382+0000 7f4008c00640 10 client.7083 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:12:17.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.383+0000 7f4008c00640 1 -- 172.21.15.99:0/1029379270 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x56129e639cd0 con 0x56129e7031a0 2024-02-21T23:12:17.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.383+0000 7f4008c00640 10 client.7083 handle_command_reply: tid=0 2024-02-21T23:12:17.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.383+0000 7f4025a69740 1 client.7083 shutdown 2024-02-21T23:12:17.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.383+0000 7f4025a69740 1 -- 172.21.15.99:0/1029379270 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56129e704de0 msgr2=0x56129e6fa740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:17.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.383+0000 7f4025a69740 1 --2- 172.21.15.99:0/1029379270 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56129e704de0 0x56129e6fa740 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f400c00ce60 tx=0x7f400c00cf90 comp rx=0 tx=0).stop 2024-02-21T23:12:17.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.383+0000 7f4025a69740 1 -- 172.21.15.99:0/1029379270 shutdown_connections 2024-02-21T23:12:17.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.383+0000 7f4025a69740 1 --2- 172.21.15.99:0/1029379270 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x56129e7031a0 0x56129e74c940 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:17.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.383+0000 7f4025a69740 1 --2- 172.21.15.99:0/1029379270 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56129e746e70 0x56129e7495d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:17.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.383+0000 7f4025a69740 1 --2- 172.21.15.99:0/1029379270 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56129e73fb90 0x56129e74a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:17.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.383+0000 7f4025a69740 1 --2- 172.21.15.99:0/1029379270 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56129e704de0 0x56129e6fa740 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:17.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.383+0000 7f4025a69740 1 -- 172.21.15.99:0/1029379270 >> 172.21.15.99:0/1029379270 conn(0x56129e7044c0 msgr2=0x56129e73d8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:17.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.383+0000 7f4008c00640 0 client.7083 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:12:17.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.384+0000 7f4025a69740 1 -- 172.21.15.99:0/1029379270 shutdown_connections 2024-02-21T23:12:17.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.384+0000 7f4025a69740 1 -- 172.21.15.99:0/1029379270 wait complete. 2024-02-21T23:12:17.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.384+0000 7f4025a69740 20 client.7083 trim_cache size 0 max 16384 2024-02-21T23:12:17.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.409+0000 7f4025a69740 1 Processor -- start 2024-02-21T23:12:17.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.409+0000 7f4025a69740 1 -- start start 2024-02-21T23:12:17.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.411+0000 7f4025a69740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56129e704de0 0x56129e73d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:17.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.411+0000 7f4025a69740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56129e73fb90 0x56129e6fdd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:17.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.411+0000 7f4025a69740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56129e746e70 0x56129e73d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:17.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.411+0000 7f4025a69740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f401c22c8a0 con 0x56129e746e70 2024-02-21T23:12:17.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.411+0000 7f4025a69740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f401c22a440 con 0x56129e73fb90 2024-02-21T23:12:17.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.411+0000 7f4025a69740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f401c228530 con 0x56129e704de0 2024-02-21T23:12:17.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.412+0000 7f401be00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56129e704de0 0x56129e73d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:17.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.412+0000 7f4020c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56129e746e70 0x56129e73d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:17.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.412+0000 7f401be00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56129e704de0 0x56129e73d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:55128/0 (socket says 172.21.15.99:55128) 2024-02-21T23:12:17.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.412+0000 7f401be00640 1 -- 172.21.15.99:0/2853906405 learned_addr learned my addr 172.21.15.99:0/2853906405 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:12:17.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.412+0000 7f4013e00640 1 --2- 172.21.15.99:0/2853906405 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56129e73fb90 0x56129e6fdd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:17.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.412+0000 7f401be00640 1 -- 172.21.15.99:0/2853906405 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56129e73fb90 msgr2=0x56129e6fdd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:17.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.412+0000 7f401be00640 1 --2- 172.21.15.99:0/2853906405 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56129e73fb90 0x56129e6fdd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:17.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.412+0000 7f401be00640 1 -- 172.21.15.99:0/2853906405 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56129e746e70 msgr2=0x56129e73d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:17.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.412+0000 7f401be00640 1 --2- 172.21.15.99:0/2853906405 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56129e746e70 0x56129e73d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:17.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.412+0000 7f401be00640 1 -- 172.21.15.99:0/2853906405 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56129e301170 con 0x56129e704de0 2024-02-21T23:12:17.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.412+0000 7f401be00640 1 --2- 172.21.15.99:0/2853906405 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56129e704de0 0x56129e73d2e0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f400c09ec80 tx=0x7f400c0b0040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7947bdea44eda9ef server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:17.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.413+0000 7f400b400640 1 -- 172.21.15.99:0/2853906405 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400c096420 con 0x56129e704de0 2024-02-21T23:12:17.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.413+0000 7f400b400640 1 -- 172.21.15.99:0/2853906405 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f400c0815b0 con 0x56129e704de0 2024-02-21T23:12:17.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.413+0000 7f400b400640 1 -- 172.21.15.99:0/2853906405 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400c09f1b0 con 0x56129e704de0 2024-02-21T23:12:17.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.413+0000 7f4025a69740 1 -- 172.21.15.99:0/2853906405 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56129e704de0 msgr2=0x56129e73d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:17.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.413+0000 7f4025a69740 1 --2- 172.21.15.99:0/2853906405 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56129e704de0 0x56129e73d2e0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f400c09ec80 tx=0x7f400c0b0040 comp rx=0 tx=0).stop 2024-02-21T23:12:17.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.413+0000 7f4025a69740 1 -- 172.21.15.99:0/2853906405 shutdown_connections 2024-02-21T23:12:17.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.413+0000 7f4025a69740 1 --2- 172.21.15.99:0/2853906405 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56129e746e70 0x56129e73d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:17.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.413+0000 7f4025a69740 1 --2- 172.21.15.99:0/2853906405 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56129e73fb90 0x56129e6fdd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:17.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.413+0000 7f4025a69740 1 --2- 172.21.15.99:0/2853906405 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56129e704de0 0x56129e73d2e0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:17.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.413+0000 7f4025a69740 1 -- 172.21.15.99:0/2853906405 >> 172.21.15.99:0/2853906405 conn(0x56129e7044c0 msgr2=0x56129e6be570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:17.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.414+0000 7f4025a69740 1 -- 172.21.15.99:0/2853906405 shutdown_connections 2024-02-21T23:12:17.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.414+0000 7f4025a69740 1 -- 172.21.15.99:0/2853906405 wait complete. 2024-02-21T23:12:17.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.414+0000 7f4025a69740 1 -- start start 2024-02-21T23:12:17.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.415+0000 7f4025a69740 1 Processor -- start 2024-02-21T23:12:17.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.416+0000 7f4025a69740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56129e704de0 0x56129e7309d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:17.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.416+0000 7f4025a69740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56129e73fb90 0x56129e7a57a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:17.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.416+0000 7f4025a69740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56129e746e70 0x56129e7a8680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:17.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.416+0000 7f4025a69740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f401c228b00 con 0x56129e73fb90 2024-02-21T23:12:17.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.416+0000 7f4025a69740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f401c229de0 con 0x56129e746e70 2024-02-21T23:12:17.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.416+0000 7f4025a69740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f401c229120 con 0x56129e704de0 2024-02-21T23:12:17.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.416+0000 7f4025a69740 10 client.0 _ll_register_callbacks cb 0x7f4014009c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:12:17.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.416+0000 7f4013e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56129e73fb90 0x56129e7a57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:17.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.416+0000 7f401be00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56129e704de0 0x56129e7309d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:17.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.416+0000 7f4013e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56129e73fb90 0x56129e7a57a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56916/0 (socket says 172.21.15.99:56916) 2024-02-21T23:12:17.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.416+0000 7f4013e00640 1 -- 172.21.15.99:0/3526324269 learned_addr learned my addr 172.21.15.99:0/3526324269 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:12:17.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.416+0000 7f4020c00640 1 --2- 172.21.15.99:0/3526324269 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56129e746e70 0x56129e7a8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:17.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.417+0000 7f4013e00640 1 -- 172.21.15.99:0/3526324269 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56129e704de0 msgr2=0x56129e7309d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:17.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.417+0000 7f4013e00640 1 --2- 172.21.15.99:0/3526324269 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56129e704de0 0x56129e7309d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:17.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.417+0000 7f4013e00640 1 -- 172.21.15.99:0/3526324269 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56129e746e70 msgr2=0x56129e7a8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:17.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.417+0000 7f4013e00640 1 --2- 172.21.15.99:0/3526324269 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56129e746e70 0x56129e7a8680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:17.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.417+0000 7f4013e00640 1 -- 172.21.15.99:0/3526324269 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56129e7a8bc0 con 0x56129e73fb90 2024-02-21T23:12:17.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.417+0000 7f4013e00640 1 --2- 172.21.15.99:0/3526324269 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56129e73fb90 0x56129e7a57a0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f4004000c00 tx=0x7f4004004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfff6e7db5633c8e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:17.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.417+0000 7f4008c00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:12:17.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.417+0000 7f4008c00640 1 -- 172.21.15.99:0/3526324269 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4004035040 con 0x56129e73fb90 2024-02-21T23:12:17.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.417+0000 7f4025a69740 1 -- 172.21.15.99:0/3526324269 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f400c0815b0 con 0x56129e73fb90 2024-02-21T23:12:17.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.417+0000 7f4008c00640 1 -- 172.21.15.99:0/3526324269 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f4004004030 con 0x56129e73fb90 2024-02-21T23:12:17.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.418+0000 7f4008c00640 1 -- 172.21.15.99:0/3526324269 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4004059050 con 0x56129e73fb90 2024-02-21T23:12:17.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.418+0000 7f4025a69740 10 client.7089 fetch_fsmap learned FSMap version 17 2024-02-21T23:12:17.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.418+0000 7f4025a69740 1 -- 172.21.15.99:0/3526324269 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x56129e7abeb0 con 0x56129e73fb90 2024-02-21T23:12:17.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.418+0000 7f4008c00640 1 -- 172.21.15.99:0/3526324269 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f400c0815b0 con 0x56129e73fb90 2024-02-21T23:12:17.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.418+0000 7f4008c00640 1 -- 172.21.15.99:0/3526324269 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f4004044050 con 0x56129e73fb90 2024-02-21T23:12:17.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.418+0000 7f4025a69740 10 client.7089 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:12:17.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.418+0000 7f4025a69740 10 client.7089 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:12:17.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.418+0000 7f4025a69740 20 client.7089 populate_metadata read hostname 'smithi099' 2024-02-21T23:12:17.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.418+0000 7f4025a69740 1 --2- 172.21.15.99:0/3526324269 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x56129e731df0 0x56129e700350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:17.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.418+0000 7f4025a69740 4 client.7089 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-02-21T23:12:17.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.418+0000 7f4025a69740 1 -- 172.21.15.99:0/3526324269 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x56129e634020 con 0x56129e731df0 2024-02-21T23:12:17.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.419+0000 7f401be00640 1 --2- 172.21.15.99:0/3526324269 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x56129e731df0 0x56129e700350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:17.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.419+0000 7f401be00640 1 --2- 172.21.15.99:0/3526324269 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x56129e731df0 0x56129e700350 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1e463560add20a5 server_cookie=7f92804f58039095 in_seq=0 out_seq=0 2024-02-21T23:12:17.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.419+0000 7f4008c00640 10 client.7089 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:12:17.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.421+0000 7f4008c00640 1 -- 172.21.15.99:0/3526324269 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x56129e634020 con 0x56129e731df0 2024-02-21T23:12:17.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.421+0000 7f4008c00640 10 client.7089 handle_command_reply: tid=0 2024-02-21T23:12:17.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.421+0000 7f4025a69740 1 client.7089 shutdown 2024-02-21T23:12:17.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.421+0000 7f4025a69740 1 -- 172.21.15.99:0/3526324269 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56129e73fb90 msgr2=0x56129e7a57a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:17.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.421+0000 7f4025a69740 1 --2- 172.21.15.99:0/3526324269 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56129e73fb90 0x56129e7a57a0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f4004000c00 tx=0x7f4004004730 comp rx=0 tx=0).stop 2024-02-21T23:12:17.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.421+0000 7f4025a69740 1 -- 172.21.15.99:0/3526324269 shutdown_connections 2024-02-21T23:12:17.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.421+0000 7f4025a69740 1 --2- 172.21.15.99:0/3526324269 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x56129e731df0 0x56129e700350 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:17.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.421+0000 7f4025a69740 1 --2- 172.21.15.99:0/3526324269 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56129e746e70 0x56129e7a8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:17.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.421+0000 7f4025a69740 1 --2- 172.21.15.99:0/3526324269 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x56129e73fb90 0x56129e7a57a0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:17.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.421+0000 7f4025a69740 1 --2- 172.21.15.99:0/3526324269 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x56129e704de0 0x56129e7309d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:17.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.421+0000 7f4025a69740 1 -- 172.21.15.99:0/3526324269 >> 172.21.15.99:0/3526324269 conn(0x56129e7044c0 msgr2=0x56129e703ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:17.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.421+0000 7f4008c00640 0 client.7089 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:12:17.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.422+0000 7f4025a69740 1 -- 172.21.15.99:0/3526324269 shutdown_connections 2024-02-21T23:12:17.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.422+0000 7f4025a69740 1 -- 172.21.15.99:0/3526324269 wait complete. 2024-02-21T23:12:17.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.422+0000 7f4025a69740 20 client.7089 trim_cache size 0 max 16384 2024-02-21T23:12:17.415 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-02-21T23:12:17.416 INFO:teuthology.orchestra.run.smithi099.stdout: "return_code": 0, 2024-02-21T23:12:17.416 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_tag": "e3331264-d0d0-48c9-b2aa-44b638018ab2", 2024-02-21T23:12:17.416 INFO:teuthology.orchestra.run.smithi099.stdout: "mode": "asynchronous" 2024-02-21T23:12:17.416 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-02-21T23:12:17.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.423+0000 7f4021600640 1 -- 172.21.15.99:0/2568289895 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f3ff809eed0 msgr2=0x7f3ff80a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:17.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.423+0000 7f4021600640 1 --2- 172.21.15.99:0/2568289895 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f3ff809eed0 0x7f3ff80a1390 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f40140113e0 tx=0x7f401400b040 comp rx=0 tx=0).stop 2024-02-21T23:12:17.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.423+0000 7f4021600640 1 -- 172.21.15.99:0/2568289895 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f401c071c20 msgr2=0x7f401c17cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:17.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.423+0000 7f4021600640 1 --2- 172.21.15.99:0/2568289895 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f401c071c20 0x7f401c17cdb0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f400c00c4a0 tx=0x7f400c00c960 comp rx=0 tx=0).stop 2024-02-21T23:12:17.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.423+0000 7f4021600640 1 -- 172.21.15.99:0/2568289895 shutdown_connections 2024-02-21T23:12:17.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.423+0000 7f4021600640 1 --2- 172.21.15.99:0/2568289895 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f3ff809eed0 0x7f3ff80a1390 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:17.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.423+0000 7f4021600640 1 --2- 172.21.15.99:0/2568289895 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f401c189f40 0x7f401c0f7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:17.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.423+0000 7f4021600640 1 --2- 172.21.15.99:0/2568289895 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f401c17f710 0x7f401c15fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:17.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.423+0000 7f4021600640 1 --2- 172.21.15.99:0/2568289895 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f401c071c20 0x7f401c17cdb0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:17.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.424+0000 7f4021600640 1 -- 172.21.15.99:0/2568289895 >> 172.21.15.99:0/2568289895 conn(0x7f401c0fe310 msgr2=0x7f401c072080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:17.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.424+0000 7f4021600640 1 -- 172.21.15.99:0/2568289895 shutdown_connections 2024-02-21T23:12:17.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.424+0000 7f4021600640 1 -- 172.21.15.99:0/2568289895 wait complete. 2024-02-21T23:12:17.419 DEBUG:teuthology.orchestra.run.smithi099:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-02-21T23:12:17.437 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T23:12:17.437 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T23:12:17.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.715+0000 7f29e6400640 1 Processor -- start 2024-02-21T23:12:17.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.715+0000 7f29e6400640 1 -- start start 2024-02-21T23:12:17.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.719+0000 7f29e6400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f29e0182c60 0x7f29e00fd350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:17.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.719+0000 7f29df400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f29e0182c60 0x7f29e00fd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:17.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.719+0000 7f29df400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f29e0182c60 0x7f29e00fd350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:38450/0 (socket says 172.21.15.99:38450) 2024-02-21T23:12:17.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.719+0000 7f29df400640 1 -- 172.21.15.99:0/3606654269 learned_addr learned my addr 172.21.15.99:0/3606654269 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:12:17.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.720+0000 7f29e6400640 1 -- 172.21.15.99:0/3606654269 --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29e00d05b0 con 0x7f29e018c920 2024-02-21T23:12:17.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.720+0000 7f29e6400640 1 -- 172.21.15.99:0/3606654269 --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29e00facc0 con 0x7f29e00fd890 2024-02-21T23:12:17.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.720+0000 7f29e6400640 1 -- 172.21.15.99:0/3606654269 --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29e00ff510 con 0x7f29e0182c60 2024-02-21T23:12:17.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.721+0000 7f29df400640 1 -- 172.21.15.99:0/3606654269 >> v1:172.21.15.162:6789/0 conn(0x7f29e00fd890 legacy=0x7f29e018c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:17.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.721+0000 7f29df400640 1 -- 172.21.15.99:0/3606654269 >> v1:172.21.15.99:6789/0 conn(0x7f29e018c920 legacy=0x7f29e00cee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:17.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.721+0000 7f29df400640 1 -- 172.21.15.99:0/3606654269 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e00fc590 con 0x7f29e0182c60 2024-02-21T23:12:17.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.723+0000 7f29df400640 1 --2- 172.21.15.99:0/3606654269 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29e0182c60 0x7f29e00fd350 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f29d8009e50 tx=0x7f29d802bdb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=afe8fb5091f59866 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:17.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.723+0000 7f29de000640 1 -- 172.21.15.99:0/3606654269 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d802c8d0 con 0x7f29e0182c60 2024-02-21T23:12:17.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.723+0000 7f29de000640 1 -- 172.21.15.99:0/3606654269 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29d802ca70 con 0x7f29e0182c60 2024-02-21T23:12:17.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.723+0000 7f29de000640 1 -- 172.21.15.99:0/3606654269 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d802ce40 con 0x7f29e0182c60 2024-02-21T23:12:17.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.724+0000 7f29e6400640 1 -- 172.21.15.99:0/3606654269 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29e0182c60 msgr2=0x7f29e00fd350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:17.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.724+0000 7f29e6400640 1 --2- 172.21.15.99:0/3606654269 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29e0182c60 0x7f29e00fd350 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f29d8009e50 tx=0x7f29d802bdb0 comp rx=0 tx=0).stop 2024-02-21T23:12:17.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.725+0000 7f29e6400640 1 -- 172.21.15.99:0/3606654269 shutdown_connections 2024-02-21T23:12:17.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.725+0000 7f29e6400640 1 --2- 172.21.15.99:0/3606654269 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29e0182c60 0x7f29e00fd350 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:17.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.725+0000 7f29e6400640 1 -- 172.21.15.99:0/3606654269 >> 172.21.15.99:0/3606654269 conn(0x7f29e0072bb0 msgr2=0x7f29e0066c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:17.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.725+0000 7f29e6400640 1 -- 172.21.15.99:0/3606654269 shutdown_connections 2024-02-21T23:12:17.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.725+0000 7f29e6400640 1 -- 172.21.15.99:0/3606654269 wait complete. 2024-02-21T23:12:17.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.729+0000 7f29e6400640 1 Processor -- start 2024-02-21T23:12:17.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.730+0000 7f29e6400640 1 -- start start 2024-02-21T23:12:17.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.733+0000 7f29e6400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29e00fd890 0x7f29e0171020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:17.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.733+0000 7f29e6400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29e0182c60 0x7f29e01881d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:17.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.733+0000 7f29e6400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f29e018c920 0x7f29e017ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:17.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.733+0000 7f29e6400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29e00fcb50 con 0x7f29e0182c60 2024-02-21T23:12:17.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.733+0000 7f29e6400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29e00fafa0 con 0x7f29e00fd890 2024-02-21T23:12:17.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.733+0000 7f29e6400640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29e00fce30 con 0x7f29e018c920 2024-02-21T23:12:17.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.734+0000 7f29df400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29e00fd890 0x7f29e0171020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:17.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.734+0000 7f29dfe00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f29e018c920 0x7f29e017ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:17.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.734+0000 7f29dfe00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f29e018c920 0x7f29e017ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:55142/0 (socket says 172.21.15.99:55142) 2024-02-21T23:12:17.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.734+0000 7f29dfe00640 1 -- 172.21.15.99:0/1283411231 learned_addr learned my addr 172.21.15.99:0/1283411231 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:12:17.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.734+0000 7f29dea00640 1 --2- 172.21.15.99:0/1283411231 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29e0182c60 0x7f29e01881d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:17.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.735+0000 7f29dfe00640 1 -- 172.21.15.99:0/1283411231 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29e00fd890 msgr2=0x7f29e0171020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:17.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.735+0000 7f29dfe00640 1 --2- 172.21.15.99:0/1283411231 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29e00fd890 0x7f29e0171020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:17.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.735+0000 7f29dfe00640 1 -- 172.21.15.99:0/1283411231 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29e0182c60 msgr2=0x7f29e01881d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:17.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.735+0000 7f29dfe00640 1 --2- 172.21.15.99:0/1283411231 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29e0182c60 0x7f29e01881d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:17.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.736+0000 7f29dfe00640 1 -- 172.21.15.99:0/1283411231 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e018b150 con 0x7f29e018c920 2024-02-21T23:12:17.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.737+0000 7f29dfe00640 1 --2- 172.21.15.99:0/1283411231 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f29e018c920 0x7f29e017ef60 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f29d000c780 tx=0x7f29d000cc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:17.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.737+0000 7f29d7400640 1 -- 172.21.15.99:0/1283411231 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d0017070 con 0x7f29e018c920 2024-02-21T23:12:17.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.737+0000 7f29d7400640 1 -- 172.21.15.99:0/1283411231 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29d0005480 con 0x7f29e018c920 2024-02-21T23:12:17.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.737+0000 7f29d7400640 1 -- 172.21.15.99:0/1283411231 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d0003830 con 0x7f29e018c920 2024-02-21T23:12:17.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.738+0000 7f29e6400640 1 -- 172.21.15.99:0/1283411231 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29e018b430 con 0x7f29e018c920 2024-02-21T23:12:17.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.738+0000 7f29e6400640 1 -- 172.21.15.99:0/1283411231 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29e017e760 con 0x7f29e018c920 2024-02-21T23:12:17.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.740+0000 7f29e6400640 1 -- 172.21.15.99:0/1283411231 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29e018b950 con 0x7f29e018c920 2024-02-21T23:12:17.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.744+0000 7f29d7400640 1 -- 172.21.15.99:0/1283411231 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f29d001a070 con 0x7f29e018c920 2024-02-21T23:12:17.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.747+0000 7f29d7400640 1 --2- 172.21.15.99:0/1283411231 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f29bc09f020 0x7f29bc0a14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:17.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.747+0000 7f29d7400640 1 -- 172.21.15.99:0/1283411231 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f29d00c9420 con 0x7f29e018c920 2024-02-21T23:12:17.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.748+0000 7f29df400640 1 --2- 172.21.15.99:0/1283411231 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f29bc09f020 0x7f29bc0a14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:17.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.749+0000 7f29df400640 1 --2- 172.21.15.99:0/1283411231 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f29bc09f020 0x7f29bc0a14e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f29d8035000 tx=0x7f29d8030000 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:17.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.751+0000 7f29d7400640 1 -- 172.21.15.99:0/1283411231 <== mon.2 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f29e018b950 con 0x7f29e018c920 2024-02-21T23:12:17.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.773+0000 7f99bb200640 1 Processor -- start 2024-02-21T23:12:17.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.774+0000 7f99bb200640 1 -- start start 2024-02-21T23:12:17.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.777+0000 7f99bb200640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f99bc17f490 0x7f99bc18ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:17.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.777+0000 7f99b9e00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f99bc17f490 0x7f99bc18ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:17.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.777+0000 7f99b9e00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f99bc17f490 0x7f99bc18ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:55150/0 (socket says 172.21.15.99:55150) 2024-02-21T23:12:17.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.777+0000 7f99bb200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f99bc18b4f0 0x7f99bc0fd290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:17.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.778+0000 7f99bb200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99bc0d6dd0 con 0x7f99bc18b060 2024-02-21T23:12:17.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.778+0000 7f99bb200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99bc1614c0 con 0x7f99bc18b4f0 2024-02-21T23:12:17.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.778+0000 7f99bb200640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99bc0d6810 con 0x7f99bc17f490 2024-02-21T23:12:17.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.778+0000 7f99b9e00640 1 -- 172.21.15.99:0/968874796 learned_addr learned my addr 172.21.15.99:0/968874796 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:12:17.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.778+0000 7f99b9e00640 1 -- 172.21.15.99:0/968874796 >> v2:172.21.15.162:3300/0 conn(0x7f99bc18b4f0 msgr2=0x7f99bc0fd290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:17.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.778+0000 7f99ba800640 1 --2- 172.21.15.99:0/968874796 >> v2:172.21.15.162:3300/0 conn(0x7f99bc18b4f0 0x7f99bc0fd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:17.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.779+0000 7f99b9e00640 1 --2- 172.21.15.99:0/968874796 >> v2:172.21.15.162:3300/0 conn(0x7f99bc18b4f0 0x7f99bc0fd290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:17.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.779+0000 7f99b9e00640 1 -- 172.21.15.99:0/968874796 >> v1:172.21.15.162:6789/0 conn(0x7f99bc18b060 legacy=0x7f99bc188a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:17.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.779+0000 7f99b9e00640 1 -- 172.21.15.99:0/968874796 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99bc0d6af0 con 0x7f99bc17f490 2024-02-21T23:12:17.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.779+0000 7f99ba800640 1 --2- 172.21.15.99:0/968874796 >> v2:172.21.15.162:3300/0 conn(0x7f99bc18b4f0 0x7f99bc0fd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T23:12:17.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.782+0000 7f99b9e00640 1 --2- 172.21.15.99:0/968874796 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f99bc17f490 0x7f99bc18ab20 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f99bc067c30 tx=0x7f99ac02b9b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=636f26de1f068469 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:17.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.782+0000 7f99b8a00640 1 -- 172.21.15.99:0/968874796 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac034070 con 0x7f99bc17f490 2024-02-21T23:12:17.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.782+0000 7f99b8a00640 1 -- 172.21.15.99:0/968874796 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99ac030870 con 0x7f99bc17f490 2024-02-21T23:12:17.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.782+0000 7f99b8a00640 1 -- 172.21.15.99:0/968874796 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac030c40 con 0x7f99bc17f490 2024-02-21T23:12:17.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.783+0000 7f99bb200640 1 -- 172.21.15.99:0/968874796 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f99bc17f490 msgr2=0x7f99bc18ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:17.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.783+0000 7f99bb200640 1 --2- 172.21.15.99:0/968874796 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f99bc17f490 0x7f99bc18ab20 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f99bc067c30 tx=0x7f99ac02b9b0 comp rx=0 tx=0).stop 2024-02-21T23:12:17.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.783+0000 7f99bb200640 1 -- 172.21.15.99:0/968874796 shutdown_connections 2024-02-21T23:12:17.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.783+0000 7f99bb200640 1 --2- 172.21.15.99:0/968874796 >> v2:172.21.15.162:3300/0 conn(0x7f99bc18b4f0 0x7f99bc0fd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:17.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.783+0000 7f99bb200640 1 --2- 172.21.15.99:0/968874796 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f99bc17f490 0x7f99bc18ab20 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:17.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.783+0000 7f99bb200640 1 -- 172.21.15.99:0/968874796 >> 172.21.15.99:0/968874796 conn(0x7f99bc0d29b0 msgr2=0x7f99bc0d2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:17.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.784+0000 7f99bb200640 1 -- 172.21.15.99:0/968874796 shutdown_connections 2024-02-21T23:12:17.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.784+0000 7f99bb200640 1 -- 172.21.15.99:0/968874796 wait complete. 2024-02-21T23:12:17.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.787+0000 7f99bb200640 1 Processor -- start 2024-02-21T23:12:17.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.787+0000 7f99bb200640 1 -- start start 2024-02-21T23:12:17.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.790+0000 7f99bb200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f99bc17f490 0x7f99bc220110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:17.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.790+0000 7f99bb200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f99bc18b060 0x7f99bc21cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:17.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.790+0000 7f99bb200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f99bc18b4f0 0x7f99bc21d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:17.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.790+0000 7f99bb200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc18a600 con 0x7f99bc18b4f0 2024-02-21T23:12:17.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.790+0000 7f99bb200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc18a320 con 0x7f99bc18b060 2024-02-21T23:12:17.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.790+0000 7f99bb200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc17f870 con 0x7f99bc17f490 2024-02-21T23:12:17.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.790+0000 7f99b9400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f99bc18b060 0x7f99bc21cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:17.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.790+0000 7f99b9400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f99bc18b060 0x7f99bc21cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:38466/0 (socket says 172.21.15.99:38466) 2024-02-21T23:12:17.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.790+0000 7f99b9400640 1 -- 172.21.15.99:0/3479354036 learned_addr learned my addr 172.21.15.99:0/3479354036 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:12:17.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.790+0000 7f99b9e00640 1 --2- 172.21.15.99:0/3479354036 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f99bc17f490 0x7f99bc220110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:17.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.791+0000 7f99ba800640 1 --2- 172.21.15.99:0/3479354036 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f99bc18b4f0 0x7f99bc21d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:17.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.791+0000 7f99b9400640 1 -- 172.21.15.99:0/3479354036 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f99bc17f490 msgr2=0x7f99bc220110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:17.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.791+0000 7f99b9400640 1 --2- 172.21.15.99:0/3479354036 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f99bc17f490 0x7f99bc220110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:17.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.791+0000 7f99b9400640 1 -- 172.21.15.99:0/3479354036 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f99bc18b4f0 msgr2=0x7f99bc21d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:17.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.791+0000 7f99b9400640 1 --2- 172.21.15.99:0/3479354036 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f99bc18b4f0 0x7f99bc21d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:17.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.791+0000 7f99b9400640 1 -- 172.21.15.99:0/3479354036 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99bc221f80 con 0x7f99bc18b060 2024-02-21T23:12:17.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.791+0000 7f99ba800640 1 --2- 172.21.15.99:0/3479354036 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f99bc18b4f0 0x7f99bc21d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T23:12:17.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.792+0000 7f99b9400640 1 --2- 172.21.15.99:0/3479354036 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f99bc18b060 0x7f99bc21cc10 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f99a800c430 tx=0x7f99a800c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:17.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.792+0000 7f99b2000640 1 -- 172.21.15.99:0/3479354036 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a80052d0 con 0x7f99bc18b060 2024-02-21T23:12:17.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.792+0000 7f99b2000640 1 -- 172.21.15.99:0/3479354036 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99a8005470 con 0x7f99bc18b060 2024-02-21T23:12:17.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.792+0000 7f99b2000640 1 -- 172.21.15.99:0/3479354036 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a8007220 con 0x7f99bc18b060 2024-02-21T23:12:17.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.792+0000 7f99bb200640 1 -- 172.21.15.99:0/3479354036 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99bc220c00 con 0x7f99bc18b060 2024-02-21T23:12:17.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.792+0000 7f99bb200640 1 -- 172.21.15.99:0/3479354036 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99bc2211c0 con 0x7f99bc18b060 2024-02-21T23:12:17.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.798+0000 7f99b2000640 1 -- 172.21.15.99:0/3479354036 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f99a80073c0 con 0x7f99bc18b060 2024-02-21T23:12:17.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.802+0000 7f99c3c20740 1 Processor -- start 2024-02-21T23:12:17.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.802+0000 7f99b2000640 1 --2- 172.21.15.99:0/3479354036 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f999c09efa0 0x7f999c0a1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:17.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.802+0000 7f99b2000640 1 -- 172.21.15.99:0/3479354036 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f99a80c94d0 con 0x7f99bc18b060 2024-02-21T23:12:17.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.802+0000 7f99ba800640 1 --2- 172.21.15.99:0/3479354036 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f999c09efa0 0x7f999c0a1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:17.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.802+0000 7f99c3c20740 1 -- start start 2024-02-21T23:12:17.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.804+0000 7f99ba800640 1 --2- 172.21.15.99:0/3479354036 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f999c09efa0 0x7f999c0a1460 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f99bc0911f0 tx=0x7f99b4007490 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:17.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.804+0000 7f99c3c20740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bd7a4c22a0 0x55bd7a4f7d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:17.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.804+0000 7f99c3c20740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bd7a4f8260 0x55bd7a4c2680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:17.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.804+0000 7f99c3c20740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bd7a4c2bc0 0x55bd7a4851d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:17.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.804+0000 7f99c3c20740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd7a3eea90 con 0x55bd7a4c2bc0 2024-02-21T23:12:17.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.805+0000 7f99c3c20740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd7a397b10 con 0x55bd7a4c22a0 2024-02-21T23:12:17.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.805+0000 7f99c3c20740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd7a3eab30 con 0x55bd7a4f8260 2024-02-21T23:12:17.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.805+0000 7f99b9e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bd7a4c22a0 0x55bd7a4f7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:17.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.805+0000 7f99b9e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bd7a4c22a0 0x55bd7a4f7d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:38472/0 (socket says 172.21.15.99:38472) 2024-02-21T23:12:17.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.805+0000 7f99b9e00640 1 -- 172.21.15.99:0/592123636 learned_addr learned my addr 172.21.15.99:0/592123636 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:12:17.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.805+0000 7f99b9400640 1 --2- 172.21.15.99:0/592123636 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bd7a4f8260 0x55bd7a4c2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:17.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.805+0000 7f99ba800640 1 --2- 172.21.15.99:0/592123636 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bd7a4c2bc0 0x55bd7a4851d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:17.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.806+0000 7f99ba800640 1 -- 172.21.15.99:0/592123636 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bd7a4f8260 msgr2=0x55bd7a4c2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:17.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.807+0000 7f99ba800640 1 --2- 172.21.15.99:0/592123636 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bd7a4f8260 0x55bd7a4c2680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:17.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.807+0000 7f99ba800640 1 -- 172.21.15.99:0/592123636 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bd7a4c22a0 msgr2=0x55bd7a4f7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:17.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.807+0000 7f99ba800640 1 --2- 172.21.15.99:0/592123636 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bd7a4c22a0 0x55bd7a4f7d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:17.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.807+0000 7f99ba800640 1 -- 172.21.15.99:0/592123636 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bd7a1cd7d0 con 0x55bd7a4c2bc0 2024-02-21T23:12:17.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.807+0000 7f99b9e00640 1 --2- 172.21.15.99:0/592123636 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bd7a4c22a0 0x55bd7a4f7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:12:17.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.807+0000 7f99b9400640 1 --2- 172.21.15.99:0/592123636 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bd7a4f8260 0x55bd7a4c2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:12:17.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.808+0000 7f99ba800640 1 --2- 172.21.15.99:0/592123636 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bd7a4c2bc0 0x55bd7a4851d0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f99b400dbd0 tx=0x7f99b4010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c41eee6b04f50597 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:17.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.808+0000 7f99a6600640 1 -- 172.21.15.99:0/592123636 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b400bb00 con 0x55bd7a4c2bc0 2024-02-21T23:12:17.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.808+0000 7f99a6600640 1 -- 172.21.15.99:0/592123636 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99b400bca0 con 0x55bd7a4c2bc0 2024-02-21T23:12:17.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.808+0000 7f99a6600640 1 -- 172.21.15.99:0/592123636 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b400bb00 con 0x55bd7a4c2bc0 2024-02-21T23:12:17.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.809+0000 7f99c3c20740 1 -- 172.21.15.99:0/592123636 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bd7a4c2bc0 msgr2=0x55bd7a4851d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:17.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.809+0000 7f99c3c20740 1 --2- 172.21.15.99:0/592123636 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bd7a4c2bc0 0x55bd7a4851d0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f99b400dbd0 tx=0x7f99b4010000 comp rx=0 tx=0).stop 2024-02-21T23:12:17.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.810+0000 7f99c3c20740 1 -- 172.21.15.99:0/592123636 shutdown_connections 2024-02-21T23:12:17.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.810+0000 7f99c3c20740 1 --2- 172.21.15.99:0/592123636 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bd7a4c2bc0 0x55bd7a4851d0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:17.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.810+0000 7f99c3c20740 1 --2- 172.21.15.99:0/592123636 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bd7a4f8260 0x55bd7a4c2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:17.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.810+0000 7f99c3c20740 1 --2- 172.21.15.99:0/592123636 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bd7a4c22a0 0x55bd7a4f7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:17.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.810+0000 7f99c3c20740 1 -- 172.21.15.99:0/592123636 >> 172.21.15.99:0/592123636 conn(0x55bd7a4516b0 msgr2=0x55bd7a489190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:17.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.810+0000 7f99c3c20740 1 -- 172.21.15.99:0/592123636 shutdown_connections 2024-02-21T23:12:17.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.811+0000 7f99c3c20740 1 -- 172.21.15.99:0/592123636 wait complete. 2024-02-21T23:12:17.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.812+0000 7f99c3c20740 1 -- start start 2024-02-21T23:12:17.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.812+0000 7f99c3c20740 1 Processor -- start 2024-02-21T23:12:17.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.814+0000 7f99c3c20740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bd7a4c22a0 0x55bd7a4c1390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:17.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.814+0000 7f99c3c20740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bd7a4c2bc0 0x55bd7a4ebe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:17.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.814+0000 7f99c3c20740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bd7a4f8260 0x55bd7a4b3210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:17.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.814+0000 7f99c3c20740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd7a490f30 con 0x55bd7a4f8260 2024-02-21T23:12:17.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.814+0000 7f99c3c20740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd7a38d1c0 con 0x55bd7a4c2bc0 2024-02-21T23:12:17.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.814+0000 7f99c3c20740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd7a4f9930 con 0x55bd7a4c22a0 2024-02-21T23:12:17.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.814+0000 7f99c3c20740 10 client.0 _ll_register_callbacks cb 0x55bd7a3aa930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:12:17.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.814+0000 7f99b9e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bd7a4c22a0 0x55bd7a4c1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:17.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.815+0000 7f99b9400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bd7a4c2bc0 0x55bd7a4ebe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:17.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.815+0000 7f99b9e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bd7a4c22a0 0x55bd7a4c1390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:55170/0 (socket says 172.21.15.99:55170) 2024-02-21T23:12:17.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.815+0000 7f99b9e00640 1 -- 172.21.15.99:0/2790499421 learned_addr learned my addr 172.21.15.99:0/2790499421 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:12:17.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.815+0000 7f99ba800640 1 --2- 172.21.15.99:0/2790499421 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bd7a4f8260 0x55bd7a4b3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:17.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.815+0000 7f99b9e00640 1 -- 172.21.15.99:0/2790499421 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bd7a4c2bc0 msgr2=0x55bd7a4ebe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:17.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.815+0000 7f99b9e00640 1 --2- 172.21.15.99:0/2790499421 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bd7a4c2bc0 0x55bd7a4ebe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:17.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.815+0000 7f99b9e00640 1 -- 172.21.15.99:0/2790499421 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bd7a4f8260 msgr2=0x55bd7a4b3210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:17.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.816+0000 7f99b9e00640 1 --2- 172.21.15.99:0/2790499421 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bd7a4f8260 0x55bd7a4b3210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:17.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.816+0000 7f99b9e00640 1 -- 172.21.15.99:0/2790499421 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bd7a1033f0 con 0x55bd7a4c22a0 2024-02-21T23:12:17.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.816+0000 7f99ba800640 1 --2- 172.21.15.99:0/2790499421 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bd7a4f8260 0x55bd7a4b3210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T23:12:17.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.816+0000 7f99b9e00640 1 --2- 172.21.15.99:0/2790499421 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bd7a4c22a0 0x55bd7a4c1390 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f99ac009930 tx=0x7f99ac004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f017bd178cac2fc server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:17.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.817+0000 7f999aa00640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-02-21T23:12:17.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.817+0000 7f999aa00640 1 -- 172.21.15.99:0/2790499421 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac034040 con 0x55bd7a4c22a0 2024-02-21T23:12:17.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.817+0000 7f999aa00640 1 -- 172.21.15.99:0/2790499421 <== mon.2 v2:172.21.15.181:3300/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f99ac043890 con 0x55bd7a4c22a0 2024-02-21T23:12:17.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.817+0000 7f99c3c20740 1 -- 172.21.15.99:0/2790499421 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f99b400bca0 con 0x55bd7a4c22a0 2024-02-21T23:12:17.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.818+0000 7f999aa00640 1 -- 172.21.15.99:0/2790499421 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f99ac043a90 con 0x55bd7a4c22a0 2024-02-21T23:12:17.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.818+0000 7f99c3c20740 10 client.7259 fetch_fsmap learned FSMap version 17 2024-02-21T23:12:17.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.818+0000 7f99c3c20740 1 -- 172.21.15.99:0/2790499421 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55bd7a0c30f0 con 0x55bd7a4c22a0 2024-02-21T23:12:17.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.819+0000 7f999aa00640 1 -- 172.21.15.99:0/2790499421 <== mon.2 v2:172.21.15.181:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99b400bca0 con 0x55bd7a4c22a0 2024-02-21T23:12:17.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.819+0000 7f999aa00640 1 -- 172.21.15.99:0/2790499421 <== mon.2 v2:172.21.15.181:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f99ac055020 con 0x55bd7a4c22a0 2024-02-21T23:12:17.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.819+0000 7f99c3c20740 10 client.7259 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:12:17.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.819+0000 7f99c3c20740 10 client.7259 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:12:17.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.819+0000 7f99c3c20740 20 client.7259 populate_metadata read hostname 'smithi099' 2024-02-21T23:12:17.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.819+0000 7f99c3c20740 1 --2- 172.21.15.99:0/2790499421 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55bd7a4b21d0 0x55bd7a51e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:17.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.819+0000 7f99c3c20740 4 client.7259 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:12:17.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.819+0000 7f99c3c20740 1 -- 172.21.15.99:0/2790499421 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bd7a3fbfd0 con 0x55bd7a4b21d0 2024-02-21T23:12:17.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.821+0000 7f99b9400640 1 --2- 172.21.15.99:0/2790499421 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55bd7a4b21d0 0x55bd7a51e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:17.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.823+0000 7f999aa00640 10 client.7259 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:12:17.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.823+0000 7f99b9400640 1 --2- 172.21.15.99:0/2790499421 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55bd7a4b21d0 0x55bd7a51e430 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9a810244ada75be server_cookie=5dc928c70c0546f8 in_seq=0 out_seq=0 2024-02-21T23:12:17.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.825+0000 7f999aa00640 1 -- 172.21.15.99:0/2790499421 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55bd7a3fbfd0 con 0x55bd7a4b21d0 2024-02-21T23:12:17.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.825+0000 7f999aa00640 10 client.7259 handle_command_reply: tid=0 2024-02-21T23:12:17.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.825+0000 7f99c3c20740 1 client.7259 shutdown 2024-02-21T23:12:17.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.825+0000 7f99c3c20740 1 -- 172.21.15.99:0/2790499421 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bd7a4c22a0 msgr2=0x55bd7a4c1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:17.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.825+0000 7f99c3c20740 1 --2- 172.21.15.99:0/2790499421 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bd7a4c22a0 0x55bd7a4c1390 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f99ac009930 tx=0x7f99ac004730 comp rx=0 tx=0).stop 2024-02-21T23:12:17.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.826+0000 7f99c3c20740 1 -- 172.21.15.99:0/2790499421 shutdown_connections 2024-02-21T23:12:17.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.826+0000 7f99c3c20740 1 --2- 172.21.15.99:0/2790499421 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55bd7a4b21d0 0x55bd7a51e430 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:17.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.826+0000 7f99c3c20740 1 --2- 172.21.15.99:0/2790499421 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bd7a4f8260 0x55bd7a4b3210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:17.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.826+0000 7f99c3c20740 1 --2- 172.21.15.99:0/2790499421 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bd7a4c2bc0 0x55bd7a4ebe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:17.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.826+0000 7f99c3c20740 1 --2- 172.21.15.99:0/2790499421 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bd7a4c22a0 0x55bd7a4c1390 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:17.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.826+0000 7f999aa00640 0 client.7259 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:12:17.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.826+0000 7f99c3c20740 1 -- 172.21.15.99:0/2790499421 >> 172.21.15.99:0/2790499421 conn(0x55bd7a4516b0 msgr2=0x55bd7a4f7ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:17.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.826+0000 7f99c3c20740 1 -- 172.21.15.99:0/2790499421 shutdown_connections 2024-02-21T23:12:17.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.827+0000 7f99c3c20740 1 -- 172.21.15.99:0/2790499421 wait complete. 2024-02-21T23:12:17.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.827+0000 7f99c3c20740 20 client.7259 trim_cache size 0 max 16384 2024-02-21T23:12:17.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.867+0000 7f99c3c20740 1 Processor -- start 2024-02-21T23:12:17.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.867+0000 7f99c3c20740 1 -- start start 2024-02-21T23:12:17.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.869+0000 7f99c3c20740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bd7a4c22a0 0x55bd7a4c9070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:17.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.869+0000 7f99c3c20740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bd7a4c2bc0 0x55bd7a56e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:17.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.869+0000 7f99c3c20740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bd7a4f8260 0x55bd7a56e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:17.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.869+0000 7f99c3c20740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc228630 con 0x55bd7a4c22a0 2024-02-21T23:12:17.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.869+0000 7f99c3c20740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc0701b0 con 0x55bd7a4f8260 2024-02-21T23:12:17.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.869+0000 7f99c3c20740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc0f7f30 con 0x55bd7a4c2bc0 2024-02-21T23:12:17.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.869+0000 7f99b9e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bd7a4c22a0 0x55bd7a4c9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:17.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.869+0000 7f99ba800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bd7a4f8260 0x55bd7a56e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:17.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.869+0000 7f99b9e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bd7a4c22a0 0x55bd7a4c9070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56964/0 (socket says 172.21.15.99:56964) 2024-02-21T23:12:17.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.869+0000 7f99b9e00640 1 -- 172.21.15.99:0/2147641533 learned_addr learned my addr 172.21.15.99:0/2147641533 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:12:17.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.870+0000 7f99b9e00640 1 -- 172.21.15.99:0/2147641533 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bd7a4c2bc0 msgr2=0x55bd7a56e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:17.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.870+0000 7f99b9e00640 1 --2- 172.21.15.99:0/2147641533 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bd7a4c2bc0 0x55bd7a56e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:17.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.870+0000 7f99b9e00640 1 -- 172.21.15.99:0/2147641533 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bd7a4f8260 msgr2=0x55bd7a56e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:17.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.870+0000 7f99b9e00640 1 --2- 172.21.15.99:0/2147641533 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bd7a4f8260 0x55bd7a56e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:17.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.870+0000 7f99b9e00640 1 -- 172.21.15.99:0/2147641533 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bd7a489780 con 0x55bd7a4c22a0 2024-02-21T23:12:17.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.870+0000 7f99ba800640 1 --2- 172.21.15.99:0/2147641533 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bd7a4f8260 0x55bd7a56e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:12:17.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.870+0000 7f99b9e00640 1 --2- 172.21.15.99:0/2147641533 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bd7a4c22a0 0x55bd7a4c9070 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f99ac043e40 tx=0x7f99ac041000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7754b04954b25465 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:17.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.871+0000 7f99a5c00640 1 -- 172.21.15.99:0/2147641533 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac043a90 con 0x55bd7a4c22a0 2024-02-21T23:12:17.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.871+0000 7f99a5c00640 1 -- 172.21.15.99:0/2147641533 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99ac043890 con 0x55bd7a4c22a0 2024-02-21T23:12:17.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.871+0000 7f99a5c00640 1 -- 172.21.15.99:0/2147641533 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac004230 con 0x55bd7a4c22a0 2024-02-21T23:12:17.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.871+0000 7f99c3c20740 1 -- 172.21.15.99:0/2147641533 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bd7a4c22a0 msgr2=0x55bd7a4c9070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:17.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.871+0000 7f99c3c20740 1 --2- 172.21.15.99:0/2147641533 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bd7a4c22a0 0x55bd7a4c9070 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f99ac043e40 tx=0x7f99ac041000 comp rx=0 tx=0).stop 2024-02-21T23:12:17.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.872+0000 7f99c3c20740 1 -- 172.21.15.99:0/2147641533 shutdown_connections 2024-02-21T23:12:17.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.872+0000 7f99c3c20740 1 --2- 172.21.15.99:0/2147641533 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bd7a4f8260 0x55bd7a56e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:17.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.872+0000 7f99c3c20740 1 --2- 172.21.15.99:0/2147641533 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bd7a4c2bc0 0x55bd7a56e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:17.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.872+0000 7f99c3c20740 1 --2- 172.21.15.99:0/2147641533 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bd7a4c22a0 0x55bd7a4c9070 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:17.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.872+0000 7f99c3c20740 1 -- 172.21.15.99:0/2147641533 >> 172.21.15.99:0/2147641533 conn(0x55bd7a4516b0 msgr2=0x55bd7a4e1f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:17.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.872+0000 7f99c3c20740 1 -- 172.21.15.99:0/2147641533 shutdown_connections 2024-02-21T23:12:17.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.872+0000 7f99c3c20740 1 -- 172.21.15.99:0/2147641533 wait complete. 2024-02-21T23:12:17.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.873+0000 7f99c3c20740 1 -- start start 2024-02-21T23:12:17.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.873+0000 7f99c3c20740 1 Processor -- start 2024-02-21T23:12:17.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.875+0000 7f99c3c20740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bd7a4c22a0 0x55bd7a4f5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:17.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.875+0000 7f99c3c20740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bd7a4c2bc0 0x55bd7a57dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:17.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.875+0000 7f99c3c20740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bd7a4f8260 0x55bd7a56a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:17.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.875+0000 7f99c3c20740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc0f8530 con 0x55bd7a4c22a0 2024-02-21T23:12:17.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.875+0000 7f99c3c20740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc06fb50 con 0x55bd7a4c2bc0 2024-02-21T23:12:17.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.875+0000 7f99c3c20740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc06eeb0 con 0x55bd7a4f8260 2024-02-21T23:12:17.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.875+0000 7f99c3c20740 10 client.0 _ll_register_callbacks cb 0x7f99ac030a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:12:17.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.876+0000 7f99b9e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bd7a4c22a0 0x55bd7a4f5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:17.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.876+0000 7f99b9e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bd7a4c22a0 0x55bd7a4f5990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56978/0 (socket says 172.21.15.99:56978) 2024-02-21T23:12:17.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.876+0000 7f99b9e00640 1 -- 172.21.15.99:0/360391248 learned_addr learned my addr 172.21.15.99:0/360391248 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:12:17.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.876+0000 7f99b9400640 1 --2- 172.21.15.99:0/360391248 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bd7a4c2bc0 0x55bd7a57dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:17.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.876+0000 7f99ba800640 1 --2- 172.21.15.99:0/360391248 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bd7a4f8260 0x55bd7a56a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:17.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.877+0000 7f99b9e00640 1 -- 172.21.15.99:0/360391248 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bd7a4f8260 msgr2=0x55bd7a56a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:17.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.877+0000 7f99b9e00640 1 --2- 172.21.15.99:0/360391248 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bd7a4f8260 0x55bd7a56a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:17.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.877+0000 7f99b9e00640 1 -- 172.21.15.99:0/360391248 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bd7a4c2bc0 msgr2=0x55bd7a57dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:17.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.877+0000 7f99b9e00640 1 --2- 172.21.15.99:0/360391248 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bd7a4c2bc0 0x55bd7a57dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:17.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.877+0000 7f99b9e00640 1 -- 172.21.15.99:0/360391248 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bd7a57e2e0 con 0x55bd7a4c22a0 2024-02-21T23:12:17.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.878+0000 7f99b9e00640 1 --2- 172.21.15.99:0/360391248 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bd7a4c22a0 0x55bd7a4f5990 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f99ac043e40 tx=0x7f99ac031000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed3804a8bc9757ab server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:17.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.878+0000 7f999aa00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:12:17.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.879+0000 7f999aa00640 1 -- 172.21.15.99:0/360391248 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac004230 con 0x55bd7a4c22a0 2024-02-21T23:12:17.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.879+0000 7f999aa00640 1 -- 172.21.15.99:0/360391248 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f99ac0043d0 con 0x55bd7a4c22a0 2024-02-21T23:12:17.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.879+0000 7f99c3c20740 1 -- 172.21.15.99:0/360391248 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f99ac043890 con 0x55bd7a4c22a0 2024-02-21T23:12:17.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.879+0000 7f999aa00640 1 -- 172.21.15.99:0/360391248 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f99ac003610 con 0x55bd7a4c22a0 2024-02-21T23:12:17.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.879+0000 7f99c3c20740 10 client.7104 fetch_fsmap learned FSMap version 17 2024-02-21T23:12:17.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.879+0000 7f99c3c20740 1 -- 172.21.15.99:0/360391248 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55bd7a522f30 con 0x55bd7a4c22a0 2024-02-21T23:12:17.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.880+0000 7f999aa00640 1 -- 172.21.15.99:0/360391248 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99ac043890 con 0x55bd7a4c22a0 2024-02-21T23:12:17.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.880+0000 7f999aa00640 1 -- 172.21.15.99:0/360391248 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f99ac055040 con 0x55bd7a4c22a0 2024-02-21T23:12:17.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.880+0000 7f99c3c20740 10 client.7104 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:12:17.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.880+0000 7f99c3c20740 10 client.7104 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:12:17.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.880+0000 7f99c3c20740 20 client.7104 populate_metadata read hostname 'smithi099' 2024-02-21T23:12:17.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.880+0000 7f99c3c20740 1 --2- 172.21.15.99:0/360391248 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55bd7a56ad10 0x55bd7a4e8020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:17.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.880+0000 7f99c3c20740 4 client.7104 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T23:12:17.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.880+0000 7f99c3c20740 1 -- 172.21.15.99:0/360391248 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55bd7a3f6320 con 0x55bd7a56ad10 2024-02-21T23:12:17.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.881+0000 7f99b9400640 1 --2- 172.21.15.99:0/360391248 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55bd7a56ad10 0x55bd7a4e8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:17.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.883+0000 7f999aa00640 10 client.7104 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:12:17.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.883+0000 7f99b9400640 1 --2- 172.21.15.99:0/360391248 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55bd7a56ad10 0x55bd7a4e8020 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5fffa974939f43e4 server_cookie=a5d2e79ddb7f434f in_seq=0 out_seq=0 2024-02-21T23:12:17.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.883+0000 7f999aa00640 1 -- 172.21.15.99:0/360391248 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+268 (crc 0 0 0) 0x55bd7a3f6320 con 0x55bd7a56ad10 2024-02-21T23:12:17.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.883+0000 7f999aa00640 10 client.7104 handle_command_reply: tid=0 2024-02-21T23:12:17.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.884+0000 7f99c3c20740 1 client.7104 shutdown 2024-02-21T23:12:17.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.884+0000 7f99c3c20740 1 -- 172.21.15.99:0/360391248 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bd7a4c22a0 msgr2=0x55bd7a4f5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:17.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.884+0000 7f99c3c20740 1 --2- 172.21.15.99:0/360391248 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bd7a4c22a0 0x55bd7a4f5990 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f99ac043e40 tx=0x7f99ac031000 comp rx=0 tx=0).stop 2024-02-21T23:12:17.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.884+0000 7f99c3c20740 1 -- 172.21.15.99:0/360391248 shutdown_connections 2024-02-21T23:12:17.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.884+0000 7f99c3c20740 1 --2- 172.21.15.99:0/360391248 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55bd7a56ad10 0x55bd7a4e8020 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:17.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.885+0000 7f99c3c20740 1 --2- 172.21.15.99:0/360391248 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55bd7a4f8260 0x55bd7a56a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:17.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.885+0000 7f99c3c20740 1 --2- 172.21.15.99:0/360391248 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55bd7a4c2bc0 0x55bd7a57dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:17.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.885+0000 7f99c3c20740 1 --2- 172.21.15.99:0/360391248 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55bd7a4c22a0 0x55bd7a4f5990 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:17.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.885+0000 7f99c3c20740 1 -- 172.21.15.99:0/360391248 >> 172.21.15.99:0/360391248 conn(0x55bd7a4516b0 msgr2=0x55bd7a4c10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:17.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.885+0000 7f999aa00640 0 client.7104 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:12:17.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.885+0000 7f99c3c20740 1 -- 172.21.15.99:0/360391248 shutdown_connections 2024-02-21T23:12:17.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.886+0000 7f99c3c20740 1 -- 172.21.15.99:0/360391248 wait complete. 2024-02-21T23:12:17.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.886+0000 7f99c3c20740 20 client.7104 trim_cache size 0 max 16384 2024-02-21T23:12:17.875 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-02-21T23:12:17.875 INFO:teuthology.orchestra.run.smithi099.stdout: "status": "scrub active (1066 inodes in the stack)", 2024-02-21T23:12:17.875 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubs": { 2024-02-21T23:12:17.875 INFO:teuthology.orchestra.run.smithi099.stdout: "e3331264-d0d0-48c9-b2aa-44b638018ab2": { 2024-02-21T23:12:17.875 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/", 2024-02-21T23:12:17.875 INFO:teuthology.orchestra.run.smithi099.stdout: "tag": "e3331264-d0d0-48c9-b2aa-44b638018ab2", 2024-02-21T23:12:17.875 INFO:teuthology.orchestra.run.smithi099.stdout: "options": "recursive,force" 2024-02-21T23:12:17.876 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:17.876 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:17.876 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-02-21T23:12:17.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.888+0000 7f99bb200640 1 -- 172.21.15.99:0/3479354036 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f999c09efa0 msgr2=0x7f999c0a1460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:17.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.888+0000 7f99bb200640 1 --2- 172.21.15.99:0/3479354036 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f999c09efa0 0x7f999c0a1460 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f99bc0911f0 tx=0x7f99b4007490 comp rx=0 tx=0).stop 2024-02-21T23:12:17.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.888+0000 7f99bb200640 1 -- 172.21.15.99:0/3479354036 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f99bc18b060 msgr2=0x7f99bc21cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:17.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.888+0000 7f99bb200640 1 --2- 172.21.15.99:0/3479354036 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f99bc18b060 0x7f99bc21cc10 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f99a800c430 tx=0x7f99a800c8f0 comp rx=0 tx=0).stop 2024-02-21T23:12:17.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.889+0000 7f99bb200640 1 -- 172.21.15.99:0/3479354036 shutdown_connections 2024-02-21T23:12:17.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.889+0000 7f99bb200640 1 --2- 172.21.15.99:0/3479354036 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f999c09efa0 0x7f999c0a1460 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:17.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.889+0000 7f99bb200640 1 --2- 172.21.15.99:0/3479354036 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f99bc18b4f0 0x7f99bc21d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:17.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.889+0000 7f99bb200640 1 --2- 172.21.15.99:0/3479354036 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f99bc18b060 0x7f99bc21cc10 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:17.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.889+0000 7f99bb200640 1 --2- 172.21.15.99:0/3479354036 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f99bc17f490 0x7f99bc220110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:17.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.889+0000 7f99bb200640 1 -- 172.21.15.99:0/3479354036 >> 172.21.15.99:0/3479354036 conn(0x7f99bc0d29b0 msgr2=0x7f99bc0d4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:17.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.889+0000 7f99bb200640 1 -- 172.21.15.99:0/3479354036 shutdown_connections 2024-02-21T23:12:17.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:17.889+0000 7f99bb200640 1 -- 172.21.15.99:0/3479354036 wait complete. 2024-02-21T23:12:17.900 INFO:tasks.cephfs.filesystem:scrub status for tag:e3331264-d0d0-48c9-b2aa-44b638018ab2 - {'path': '/', 'tag': 'e3331264-d0d0-48c9-b2aa-44b638018ab2', 'options': 'recursive,force'} 2024-02-21T23:12:18.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.112+0000 7f29e6400640 1 -- 172.21.15.99:0/1283411231 --> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) v1 -- 0x7f29e0069440 con 0x7f29bc09f020 2024-02-21T23:12:18.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.121+0000 7f29d7400640 1 -- 172.21.15.99:0/1283411231 <== mgr.5131 v2:172.21.15.162:6800/631076050 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+350 (secure 0 0 0) 0x7f29e0069440 con 0x7f29bc09f020 2024-02-21T23:12:18.109 INFO:teuthology.orchestra.run.smithi099.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-02-21T00:00:00", "created": "2024-02-21T23:02:15", "first": "2024-02-21T23:03:00", "last": "2024-02-21T23:12:00", "last_pruned": "2024-02-21T23:12:00", "created_count": 10, "pruned_count": 4, "active": true} 2024-02-21T23:12:18.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.123+0000 7f29e6400640 1 -- 172.21.15.99:0/1283411231 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f29bc09f020 msgr2=0x7f29bc0a14e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:18.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.123+0000 7f29e6400640 1 --2- 172.21.15.99:0/1283411231 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f29bc09f020 0x7f29bc0a14e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f29d8035000 tx=0x7f29d8030000 comp rx=0 tx=0).stop 2024-02-21T23:12:18.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.123+0000 7f29e6400640 1 -- 172.21.15.99:0/1283411231 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f29e018c920 msgr2=0x7f29e017ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:18.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.123+0000 7f29e6400640 1 --2- 172.21.15.99:0/1283411231 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f29e018c920 0x7f29e017ef60 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f29d000c780 tx=0x7f29d000cc40 comp rx=0 tx=0).stop 2024-02-21T23:12:18.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.123+0000 7f29e6400640 1 -- 172.21.15.99:0/1283411231 shutdown_connections 2024-02-21T23:12:18.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.123+0000 7f29e6400640 1 --2- 172.21.15.99:0/1283411231 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f29bc09f020 0x7f29bc0a14e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:18.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.123+0000 7f29e6400640 1 --2- 172.21.15.99:0/1283411231 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f29e018c920 0x7f29e017ef60 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:18.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.123+0000 7f29e6400640 1 --2- 172.21.15.99:0/1283411231 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f29e0182c60 0x7f29e01881d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:18.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.123+0000 7f29e6400640 1 --2- 172.21.15.99:0/1283411231 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29e00fd890 0x7f29e0171020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:18.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.123+0000 7f29e6400640 1 -- 172.21.15.99:0/1283411231 >> 172.21.15.99:0/1283411231 conn(0x7f29e0072bb0 msgr2=0x7f29e00fb150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:18.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.123+0000 7f29e6400640 1 -- 172.21.15.99:0/1283411231 shutdown_connections 2024-02-21T23:12:18.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.123+0000 7f29e6400640 1 -- 172.21.15.99:0/1283411231 wait complete. 2024-02-21T23:12:18.128 DEBUG:teuthology.orchestra.run.smithi099:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-02-21T23:12:18.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.379+0000 7f1fdbe00640 1 Processor -- start 2024-02-21T23:12:18.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.379+0000 7f1fdbe00640 1 -- start start 2024-02-21T23:12:18.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.382+0000 7f1fdbe00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f1fdc0f9080 0x7f1fdc06b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:18.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.382+0000 7f1fdbe00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fdc0f9640 con 0x7f1fdc06ae50 2024-02-21T23:12:18.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.382+0000 7f1fdbe00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fdc0f9920 con 0x7f1fdc072050 2024-02-21T23:12:18.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.382+0000 7f1fdbe00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fdc0fa530 con 0x7f1fdc0f9080 2024-02-21T23:12:18.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.383+0000 7f1fdaa00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f1fdc06ae50 0x7f1fdc06b230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:38172/0 (socket says 172.21.15.99:38172) 2024-02-21T23:12:18.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.383+0000 7f1fdaa00640 1 -- 172.21.15.99:0/4239137838 learned_addr learned my addr 172.21.15.99:0/4239137838 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:12:18.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.383+0000 7f1fda000640 1 --2- 172.21.15.99:0/4239137838 >> v2:172.21.15.162:3300/0 conn(0x7f1fdc0f9080 0x7f1fdc06b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:18.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.383+0000 7f1fd9600640 1 -- 172.21.15.99:0/4239137838 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2306406152 0 0) 0x7f1fdc0f9640 con 0x7f1fdc06ae50 2024-02-21T23:12:18.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.383+0000 7f1fd9600640 1 -- 172.21.15.99:0/4239137838 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1fc0003520 con 0x7f1fdc06ae50 2024-02-21T23:12:18.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.383+0000 7f1fd9600640 1 -- 172.21.15.99:0/4239137838 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2543825138 0 0) 0x7f1fdc0f9920 con 0x7f1fdc072050 2024-02-21T23:12:18.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.383+0000 7f1fd9600640 1 -- 172.21.15.99:0/4239137838 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1fdc0f9640 con 0x7f1fdc072050 2024-02-21T23:12:18.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.383+0000 7f1fda000640 1 -- 172.21.15.99:0/4239137838 >> v1:172.21.15.162:6789/0 conn(0x7f1fdc072050 legacy=0x7f1fdc072480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:18.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.383+0000 7f1fda000640 1 -- 172.21.15.99:0/4239137838 >> v1:172.21.15.99:6789/0 conn(0x7f1fdc06ae50 legacy=0x7f1fdc06b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:18.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.383+0000 7f1fda000640 1 -- 172.21.15.99:0/4239137838 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fdc0f9c00 con 0x7f1fdc0f9080 2024-02-21T23:12:18.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.384+0000 7f1fda000640 1 --2- 172.21.15.99:0/4239137838 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1fdc0f9080 0x7f1fdc06b940 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f1fc80097a0 tx=0x7f1fc802b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=211a59a10d7bf0cb server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:18.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.385+0000 7f1fd9600640 1 -- 172.21.15.99:0/4239137838 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc8034070 con 0x7f1fdc0f9080 2024-02-21T23:12:18.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.385+0000 7f1fd9600640 1 -- 172.21.15.99:0/4239137838 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fc8030610 con 0x7f1fdc0f9080 2024-02-21T23:12:18.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.385+0000 7f1fd9600640 1 -- 172.21.15.99:0/4239137838 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc80309e0 con 0x7f1fdc0f9080 2024-02-21T23:12:18.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.385+0000 7f1fdbe00640 1 -- 172.21.15.99:0/4239137838 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1fdc0f9080 msgr2=0x7f1fdc06b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:18.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.385+0000 7f1fdbe00640 1 --2- 172.21.15.99:0/4239137838 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1fdc0f9080 0x7f1fdc06b940 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f1fc80097a0 tx=0x7f1fc802b960 comp rx=0 tx=0).stop 2024-02-21T23:12:18.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.385+0000 7f1fdbe00640 1 -- 172.21.15.99:0/4239137838 shutdown_connections 2024-02-21T23:12:18.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.385+0000 7f1fdbe00640 1 --2- 172.21.15.99:0/4239137838 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1fdc0f9080 0x7f1fdc06b940 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:18.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.385+0000 7f1fdbe00640 1 -- 172.21.15.99:0/4239137838 >> 172.21.15.99:0/4239137838 conn(0x7f1fdc0cf650 msgr2=0x7f1fdc0cfa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:18.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.385+0000 7f1fdbe00640 1 -- 172.21.15.99:0/4239137838 shutdown_connections 2024-02-21T23:12:18.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.386+0000 7f1fdbe00640 1 -- 172.21.15.99:0/4239137838 wait complete. 2024-02-21T23:12:18.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.387+0000 7f1fdbe00640 1 Processor -- start 2024-02-21T23:12:18.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.387+0000 7f1fdbe00640 1 -- start start 2024-02-21T23:12:18.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.388+0000 7f1fdbe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1fdc06ae50 0x7f1fdc222500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:18.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.389+0000 7f1fdbe00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1fdc072050 0x7f1fdc222a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:18.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.389+0000 7f1fdbe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1fdc0f9080 0x7f1fdc17d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:18.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.389+0000 7f1fdbe00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fdc072b90 con 0x7f1fdc0f9080 2024-02-21T23:12:18.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.389+0000 7f1fdbe00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fdc0fa1c0 con 0x7f1fdc06ae50 2024-02-21T23:12:18.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.389+0000 7f1fdbe00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fdc072d10 con 0x7f1fdc072050 2024-02-21T23:12:18.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.389+0000 7f1fdaa00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1fdc06ae50 0x7f1fdc222500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:18.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.389+0000 7f1fdaa00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1fdc06ae50 0x7f1fdc222500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:38532/0 (socket says 172.21.15.99:38532) 2024-02-21T23:12:18.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.389+0000 7f1fdaa00640 1 -- 172.21.15.99:0/4056006664 learned_addr learned my addr 172.21.15.99:0/4056006664 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:12:18.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.389+0000 7f1fdb400640 1 --2- 172.21.15.99:0/4056006664 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1fdc0f9080 0x7f1fdc17d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:18.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.389+0000 7f1fda000640 1 --2- 172.21.15.99:0/4056006664 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1fdc072050 0x7f1fdc222a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:18.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.389+0000 7f1fdaa00640 1 -- 172.21.15.99:0/4056006664 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1fdc072050 msgr2=0x7f1fdc222a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:18.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.389+0000 7f1fdaa00640 1 --2- 172.21.15.99:0/4056006664 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1fdc072050 0x7f1fdc222a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:18.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.389+0000 7f1fdaa00640 1 -- 172.21.15.99:0/4056006664 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1fdc0f9080 msgr2=0x7f1fdc17d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:18.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.389+0000 7f1fdaa00640 1 --2- 172.21.15.99:0/4056006664 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1fdc0f9080 0x7f1fdc17d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:18.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.389+0000 7f1fdaa00640 1 -- 172.21.15.99:0/4056006664 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fdc17ddc0 con 0x7f1fdc06ae50 2024-02-21T23:12:18.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.389+0000 7f1fda000640 1 --2- 172.21.15.99:0/4056006664 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1fdc072050 0x7f1fdc222a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:12:18.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.390+0000 7f1fdaa00640 1 --2- 172.21.15.99:0/4056006664 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1fdc06ae50 0x7f1fdc222500 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc00c3c0 tx=0x7f1fcc00c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:18.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.390+0000 7f1fd2a00640 1 -- 172.21.15.99:0/4056006664 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc017070 con 0x7f1fdc06ae50 2024-02-21T23:12:18.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.390+0000 7f1fd2a00640 1 -- 172.21.15.99:0/4056006664 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fcc005ce0 con 0x7f1fdc06ae50 2024-02-21T23:12:18.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.390+0000 7f1fdbe00640 1 -- 172.21.15.99:0/4056006664 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fdc17e0a0 con 0x7f1fdc06ae50 2024-02-21T23:12:18.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.390+0000 7f1fd2a00640 1 -- 172.21.15.99:0/4056006664 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc007310 con 0x7f1fdc06ae50 2024-02-21T23:12:18.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.390+0000 7f1fdbe00640 1 -- 172.21.15.99:0/4056006664 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fdc220080 con 0x7f1fdc06ae50 2024-02-21T23:12:18.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.391+0000 7f1fdbe00640 1 -- 172.21.15.99:0/4056006664 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fdc068230 con 0x7f1fdc06ae50 2024-02-21T23:12:18.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.393+0000 7f1fd2a00640 1 -- 172.21.15.99:0/4056006664 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f1fcc01a070 con 0x7f1fdc06ae50 2024-02-21T23:12:18.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.394+0000 7f1fd2a00640 1 --2- 172.21.15.99:0/4056006664 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f1fbc09ef00 0x7f1fbc0a13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:18.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.394+0000 7f1fd2a00640 1 -- 172.21.15.99:0/4056006664 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f1fcc0c9280 con 0x7f1fdc06ae50 2024-02-21T23:12:18.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.394+0000 7f1fda000640 1 --2- 172.21.15.99:0/4056006664 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f1fbc09ef00 0x7f1fbc0a13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:18.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.395+0000 7f1fda000640 1 --2- 172.21.15.99:0/4056006664 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f1fbc09ef00 0x7f1fbc0a13c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1fc8036000 tx=0x7f1fc803b040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:18.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.398+0000 7f1fd2a00640 1 -- 172.21.15.99:0/4056006664 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f1fcc0971d0 con 0x7f1fdc06ae50 2024-02-21T23:12:18.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.721+0000 7f1fdbe00640 1 -- 172.21.15.99:0/4056006664 --> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f1fdc222f80 con 0x7f1fbc09ef00 2024-02-21T23:12:18.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.730+0000 7f1fd2a00640 1 -- 172.21.15.99:0/4056006664 <== mgr.5131 v2:172.21.15.162:6800/631076050 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+10 (secure 0 0 0) 0x7f1fc80396d0 con 0x7f1fbc09ef00 2024-02-21T23:12:18.718 INFO:teuthology.orchestra.run.smithi099.stdout:/ 1m 6m3h 2024-02-21T23:12:18.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.732+0000 7f1fdbe00640 1 -- 172.21.15.99:0/4056006664 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f1fbc09ef00 msgr2=0x7f1fbc0a13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:18.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.732+0000 7f1fdbe00640 1 --2- 172.21.15.99:0/4056006664 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f1fbc09ef00 0x7f1fbc0a13c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1fc8036000 tx=0x7f1fc803b040 comp rx=0 tx=0).stop 2024-02-21T23:12:18.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.732+0000 7f1fdbe00640 1 -- 172.21.15.99:0/4056006664 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1fdc06ae50 msgr2=0x7f1fdc222500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:18.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.732+0000 7f1fdbe00640 1 --2- 172.21.15.99:0/4056006664 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1fdc06ae50 0x7f1fdc222500 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc00c3c0 tx=0x7f1fcc00c880 comp rx=0 tx=0).stop 2024-02-21T23:12:18.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.732+0000 7f1fdbe00640 1 -- 172.21.15.99:0/4056006664 shutdown_connections 2024-02-21T23:12:18.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.732+0000 7f1fdbe00640 1 --2- 172.21.15.99:0/4056006664 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f1fbc09ef00 0x7f1fbc0a13c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:18.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.732+0000 7f1fdbe00640 1 --2- 172.21.15.99:0/4056006664 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1fdc0f9080 0x7f1fdc17d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:18.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.732+0000 7f1fdbe00640 1 --2- 172.21.15.99:0/4056006664 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1fdc072050 0x7f1fdc222a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:18.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.732+0000 7f1fdbe00640 1 --2- 172.21.15.99:0/4056006664 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1fdc06ae50 0x7f1fdc222500 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:18.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.732+0000 7f1fdbe00640 1 -- 172.21.15.99:0/4056006664 >> 172.21.15.99:0/4056006664 conn(0x7f1fdc0cf650 msgr2=0x7f1fdc181f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:18.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.732+0000 7f1fdbe00640 1 -- 172.21.15.99:0/4056006664 shutdown_connections 2024-02-21T23:12:18.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:18.732+0000 7f1fdbe00640 1 -- 172.21.15.99:0/4056006664 wait complete. 2024-02-21T23:12:18.736 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-02-21T23:12:18.746 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-02-21T23:12:44.507 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:12:44.513 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:12:44.516 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:12:47.902 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-02-21T23:12:47.902 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-02-21T23:12:48.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.117+0000 7ff1a6000640 1 Processor -- start 2024-02-21T23:12:48.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.117+0000 7ff1a6000640 1 -- start start 2024-02-21T23:12:48.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.119+0000 7ff1a6000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff1a00d60b0 0x7ff1a00fc990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:48.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.119+0000 7ff1a6000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1a00d6dd0 con 0x7ff1a017f490 2024-02-21T23:12:48.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.119+0000 7ff1a6000640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1a01614c0 con 0x7ff1a018b230 2024-02-21T23:12:48.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.119+0000 7ff1a6000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1a00d6810 con 0x7ff1a00d60b0 2024-02-21T23:12:48.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.120+0000 7ff1a4c00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7ff1a017f490 0x7ff1a018ab20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.99:60988/0 (socket says 172.21.15.99:60988) 2024-02-21T23:12:48.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.120+0000 7ff1a4c00640 1 -- 172.21.15.99:0/3413545596 learned_addr learned my addr 172.21.15.99:0/3413545596 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:12:48.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.120+0000 7ff1a5600640 1 --2- 172.21.15.99:0/3413545596 >> v2:172.21.15.162:3300/0 conn(0x7ff1a00d60b0 0x7ff1a00fc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:48.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.120+0000 7ff19f400640 1 -- 172.21.15.99:0/3413545596 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3505584551 0 0) 0x7ff1a00d6dd0 con 0x7ff1a017f490 2024-02-21T23:12:48.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.120+0000 7ff19f400640 1 -- 172.21.15.99:0/3413545596 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff188003520 con 0x7ff1a017f490 2024-02-21T23:12:48.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.120+0000 7ff1a5600640 1 -- 172.21.15.99:0/3413545596 >> v1:172.21.15.181:6789/0 conn(0x7ff1a018b230 legacy=0x7ff1a00fc280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:48.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.120+0000 7ff1a5600640 1 -- 172.21.15.99:0/3413545596 >> v1:172.21.15.162:6789/0 conn(0x7ff1a017f490 legacy=0x7ff1a018ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:48.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.120+0000 7ff1a5600640 1 -- 172.21.15.99:0/3413545596 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1a00d6af0 con 0x7ff1a00d60b0 2024-02-21T23:12:48.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.121+0000 7ff1a5600640 1 --2- 172.21.15.99:0/3413545596 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff1a00d60b0 0x7ff1a00fc990 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7ff198009d90 tx=0x7ff19802bdb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b979e7be7ed64402 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:48.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.122+0000 7ff19f400640 1 -- 172.21.15.99:0/3413545596 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff198039070 con 0x7ff1a00d60b0 2024-02-21T23:12:48.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.122+0000 7ff19f400640 1 -- 172.21.15.99:0/3413545596 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff19802cae0 con 0x7ff1a00d60b0 2024-02-21T23:12:48.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.122+0000 7ff19f400640 1 -- 172.21.15.99:0/3413545596 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff198034440 con 0x7ff1a00d60b0 2024-02-21T23:12:48.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.122+0000 7ff1a6000640 1 -- 172.21.15.99:0/3413545596 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff1a00d60b0 msgr2=0x7ff1a00fc990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:48.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.122+0000 7ff1a6000640 1 --2- 172.21.15.99:0/3413545596 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff1a00d60b0 0x7ff1a00fc990 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7ff198009d90 tx=0x7ff19802bdb0 comp rx=0 tx=0).stop 2024-02-21T23:12:48.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.122+0000 7ff1a6000640 1 -- 172.21.15.99:0/3413545596 shutdown_connections 2024-02-21T23:12:48.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.122+0000 7ff1a6000640 1 --2- 172.21.15.99:0/3413545596 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff1a00d60b0 0x7ff1a00fc990 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:48.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.122+0000 7ff1a6000640 1 -- 172.21.15.99:0/3413545596 >> 172.21.15.99:0/3413545596 conn(0x7ff1a00d29b0 msgr2=0x7ff1a00d2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:48.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.122+0000 7ff1a6000640 1 -- 172.21.15.99:0/3413545596 shutdown_connections 2024-02-21T23:12:48.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.122+0000 7ff1a6000640 1 -- 172.21.15.99:0/3413545596 wait complete. 2024-02-21T23:12:48.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.124+0000 7ff1a6000640 1 Processor -- start 2024-02-21T23:12:48.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.124+0000 7ff1a6000640 1 -- start start 2024-02-21T23:12:48.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.126+0000 7ff1a6000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff1a00d60b0 0x7ff1a017e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:48.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.126+0000 7ff1a6000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff1a017f490 0x7ff1a0172250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:48.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.126+0000 7ff1a6000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff1a018b230 0x7ff1a0177830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:48.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.127+0000 7ff1a6000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a018a600 con 0x7ff1a017f490 2024-02-21T23:12:48.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.127+0000 7ff1a6000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a018a320 con 0x7ff1a00d60b0 2024-02-21T23:12:48.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.127+0000 7ff1a6000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a00d6500 con 0x7ff1a018b230 2024-02-21T23:12:48.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.127+0000 7ff1a4c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff1a00d60b0 0x7ff1a017e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:48.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.127+0000 7ff19fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff1a017f490 0x7ff1a0172250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:48.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.127+0000 7ff19fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff1a017f490 0x7ff1a0172250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:39812/0 (socket says 172.21.15.99:39812) 2024-02-21T23:12:48.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.127+0000 7ff19fe00640 1 -- 172.21.15.99:0/1248457202 learned_addr learned my addr 172.21.15.99:0/1248457202 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:12:48.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.127+0000 7ff1a5600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff1a018b230 0x7ff1a0177830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:48.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.127+0000 7ff19fe00640 1 -- 172.21.15.99:0/1248457202 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff1a018b230 msgr2=0x7ff1a0177830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:48.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.127+0000 7ff19fe00640 1 --2- 172.21.15.99:0/1248457202 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff1a018b230 0x7ff1a0177830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:48.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.127+0000 7ff19fe00640 1 -- 172.21.15.99:0/1248457202 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff1a00d60b0 msgr2=0x7ff1a017e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:48.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.127+0000 7ff19fe00640 1 --2- 172.21.15.99:0/1248457202 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff1a00d60b0 0x7ff1a017e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:48.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.127+0000 7ff19fe00640 1 -- 172.21.15.99:0/1248457202 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1a0223190 con 0x7ff1a017f490 2024-02-21T23:12:48.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.127+0000 7ff1a5600640 1 --2- 172.21.15.99:0/1248457202 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff1a018b230 0x7ff1a0177830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:12:48.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.128+0000 7ff19fe00640 1 --2- 172.21.15.99:0/1248457202 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff1a017f490 0x7ff1a0172250 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7ff18c00c780 tx=0x7ff18c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:48.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.128+0000 7ff19cc00640 1 -- 172.21.15.99:0/1248457202 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff18c017070 con 0x7ff1a017f490 2024-02-21T23:12:48.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.128+0000 7ff19cc00640 1 -- 172.21.15.99:0/1248457202 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff18c005270 con 0x7ff1a017f490 2024-02-21T23:12:48.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.128+0000 7ff1a6000640 1 -- 172.21.15.99:0/1248457202 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1a017da20 con 0x7ff1a017f490 2024-02-21T23:12:48.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.128+0000 7ff19cc00640 1 -- 172.21.15.99:0/1248457202 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff18c003830 con 0x7ff1a017f490 2024-02-21T23:12:48.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.128+0000 7ff1a6000640 1 -- 172.21.15.99:0/1248457202 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1a017dfe0 con 0x7ff1a017f490 2024-02-21T23:12:48.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.132+0000 7ff19cc00640 1 -- 172.21.15.99:0/1248457202 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7ff18c01a070 con 0x7ff1a017f490 2024-02-21T23:12:48.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.133+0000 7ff19cc00640 1 --2- 172.21.15.99:0/1248457202 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7ff18009eed0 0x7ff1800a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:48.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.133+0000 7ff19cc00640 1 -- 172.21.15.99:0/1248457202 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 8877+0+0 (secure 0 0 0) 0x7ff18c0c92d0 con 0x7ff1a017f490 2024-02-21T23:12:48.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.133+0000 7ff1a4c00640 1 --2- 172.21.15.99:0/1248457202 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7ff18009eed0 0x7ff1800a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:48.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.134+0000 7ff1a4c00640 1 --2- 172.21.15.99:0/1248457202 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7ff18009eed0 0x7ff1800a1390 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff194005880 tx=0x7ff194009040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:48.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.135+0000 7ff1aa5d7740 1 Processor -- start 2024-02-21T23:12:48.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.135+0000 7ff1aa5d7740 1 -- start start 2024-02-21T23:12:48.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.137+0000 7ff1aa5d7740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b6e41262a0 0x55b6e415bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:48.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.137+0000 7ff1aa5d7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6e415c260 0x55b6e4126680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:48.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.137+0000 7ff1aa5d7740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b6e4126bc0 0x55b6e40e91d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:48.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.137+0000 7ff1aa5d7740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6e4052a90 con 0x55b6e41262a0 2024-02-21T23:12:48.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.137+0000 7ff1aa5d7740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6e3ffbb10 con 0x55b6e415c260 2024-02-21T23:12:48.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.137+0000 7ff1aa5d7740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6e404eb30 con 0x55b6e4126bc0 2024-02-21T23:12:48.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.137+0000 7ff1a4c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b6e41262a0 0x55b6e415bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:48.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.137+0000 7ff1a4c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b6e41262a0 0x55b6e415bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:39818/0 (socket says 172.21.15.99:39818) 2024-02-21T23:12:48.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.137+0000 7ff1a4c00640 1 -- 172.21.15.99:0/3942617541 learned_addr learned my addr 172.21.15.99:0/3942617541 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:12:48.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.137+0000 7ff1a5600640 1 --2- 172.21.15.99:0/3942617541 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b6e4126bc0 0x55b6e40e91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:48.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.137+0000 7ff19fe00640 1 --2- 172.21.15.99:0/3942617541 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6e415c260 0x55b6e4126680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:48.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.138+0000 7ff1a4c00640 1 -- 172.21.15.99:0/3942617541 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b6e4126bc0 msgr2=0x55b6e40e91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:48.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.138+0000 7ff1a4c00640 1 --2- 172.21.15.99:0/3942617541 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b6e4126bc0 0x55b6e40e91d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:48.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.138+0000 7ff1a4c00640 1 -- 172.21.15.99:0/3942617541 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6e415c260 msgr2=0x55b6e4126680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:48.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.138+0000 7ff1a4c00640 1 --2- 172.21.15.99:0/3942617541 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6e415c260 0x55b6e4126680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:48.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.138+0000 7ff1a4c00640 1 -- 172.21.15.99:0/3942617541 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b6e3e317d0 con 0x55b6e41262a0 2024-02-21T23:12:48.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.138+0000 7ff19fe00640 1 --2- 172.21.15.99:0/3942617541 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6e415c260 0x55b6e4126680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:12:48.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.138+0000 7ff1a4c00640 1 --2- 172.21.15.99:0/3942617541 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b6e41262a0 0x55b6e415bd20 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7ff19400fab0 tx=0x7ff194000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=264f6e703879e6f8 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:48.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.138+0000 7ff191200640 1 -- 172.21.15.99:0/3942617541 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff194025070 con 0x55b6e41262a0 2024-02-21T23:12:48.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.139+0000 7ff191200640 1 -- 172.21.15.99:0/3942617541 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff194015cb0 con 0x55b6e41262a0 2024-02-21T23:12:48.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.139+0000 7ff191200640 1 -- 172.21.15.99:0/3942617541 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff194015e60 con 0x55b6e41262a0 2024-02-21T23:12:48.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.139+0000 7ff1aa5d7740 1 -- 172.21.15.99:0/3942617541 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b6e41262a0 msgr2=0x55b6e415bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:48.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.139+0000 7ff1aa5d7740 1 --2- 172.21.15.99:0/3942617541 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b6e41262a0 0x55b6e415bd20 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7ff19400fab0 tx=0x7ff194000ed0 comp rx=0 tx=0).stop 2024-02-21T23:12:48.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.139+0000 7ff1aa5d7740 1 -- 172.21.15.99:0/3942617541 shutdown_connections 2024-02-21T23:12:48.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.139+0000 7ff1aa5d7740 1 --2- 172.21.15.99:0/3942617541 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b6e4126bc0 0x55b6e40e91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:48.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.139+0000 7ff1aa5d7740 1 --2- 172.21.15.99:0/3942617541 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6e415c260 0x55b6e4126680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:48.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.139+0000 7ff1aa5d7740 1 --2- 172.21.15.99:0/3942617541 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b6e41262a0 0x55b6e415bd20 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:48.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.139+0000 7ff1aa5d7740 1 -- 172.21.15.99:0/3942617541 >> 172.21.15.99:0/3942617541 conn(0x55b6e40b56b0 msgr2=0x55b6e40ed190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:48.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.139+0000 7ff1aa5d7740 1 -- 172.21.15.99:0/3942617541 shutdown_connections 2024-02-21T23:12:48.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.139+0000 7ff1aa5d7740 1 -- 172.21.15.99:0/3942617541 wait complete. 2024-02-21T23:12:48.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.140+0000 7ff1aa5d7740 1 -- start start 2024-02-21T23:12:48.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.141+0000 7ff1aa5d7740 1 Processor -- start 2024-02-21T23:12:48.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.142+0000 7ff1aa5d7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6e41262a0 0x55b6e411c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:48.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.142+0000 7ff1aa5d7740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b6e4126bc0 0x55b6e41240e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:48.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.142+0000 7ff1aa5d7740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b6e415c260 0x55b6e415efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:48.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.142+0000 7ff1aa5d7740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6e40f4f30 con 0x55b6e415c260 2024-02-21T23:12:48.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.142+0000 7ff1aa5d7740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6e3ff11c0 con 0x55b6e41262a0 2024-02-21T23:12:48.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.142+0000 7ff1aa5d7740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6e415d930 con 0x55b6e4126bc0 2024-02-21T23:12:48.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.142+0000 7ff1aa5d7740 10 client.0 _ll_register_callbacks cb 0x55b6e400e930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:12:48.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.142+0000 7ff1a4c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6e41262a0 0x55b6e411c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:48.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.142+0000 7ff1a4c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6e41262a0 0x55b6e411c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:59680/0 (socket says 172.21.15.99:59680) 2024-02-21T23:12:48.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.142+0000 7ff1a4c00640 1 -- 172.21.15.99:0/626701790 learned_addr learned my addr 172.21.15.99:0/626701790 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:12:48.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.142+0000 7ff19fe00640 1 --2- 172.21.15.99:0/626701790 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b6e4126bc0 0x55b6e41240e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:48.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.142+0000 7ff1a5600640 1 --2- 172.21.15.99:0/626701790 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b6e415c260 0x55b6e415efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:48.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.143+0000 7ff19fe00640 1 -- 172.21.15.99:0/626701790 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6e41262a0 msgr2=0x55b6e411c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:48.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.143+0000 7ff19fe00640 1 --2- 172.21.15.99:0/626701790 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6e41262a0 0x55b6e411c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:48.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.143+0000 7ff19fe00640 1 -- 172.21.15.99:0/626701790 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b6e415c260 msgr2=0x55b6e415efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:48.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.143+0000 7ff19fe00640 1 --2- 172.21.15.99:0/626701790 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b6e415c260 0x55b6e415efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:48.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.143+0000 7ff19fe00640 1 -- 172.21.15.99:0/626701790 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b6e3d673f0 con 0x55b6e4126bc0 2024-02-21T23:12:48.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.143+0000 7ff1a5600640 1 --2- 172.21.15.99:0/626701790 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b6e415c260 0x55b6e415efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:12:48.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.143+0000 7ff1a4c00640 1 --2- 172.21.15.99:0/626701790 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6e41262a0 0x55b6e411c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:12:48.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.143+0000 7ff19fe00640 1 --2- 172.21.15.99:0/626701790 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b6e4126bc0 0x55b6e41240e0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7ff18c0c69a0 tx=0x7ff18c09ad90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44a69b7c19bab2dc server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:48.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.143+0000 7ff185600640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-02-21T23:12:48.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.143+0000 7ff185600640 1 -- 172.21.15.99:0/626701790 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff18c0aabd0 con 0x55b6e4126bc0 2024-02-21T23:12:48.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.143+0000 7ff1aa5d7740 1 -- 172.21.15.99:0/626701790 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff194015cb0 con 0x55b6e4126bc0 2024-02-21T23:12:48.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.143+0000 7ff185600640 1 -- 172.21.15.99:0/626701790 <== mon.2 v2:172.21.15.181:3300/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 8877+0+0 (secure 0 0 0) 0x7ff18c0aad70 con 0x55b6e4126bc0 2024-02-21T23:12:48.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.144+0000 7ff185600640 1 -- 172.21.15.99:0/626701790 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff18c09ee90 con 0x55b6e4126bc0 2024-02-21T23:12:48.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.144+0000 7ff1aa5d7740 10 client.7277 fetch_fsmap learned FSMap version 17 2024-02-21T23:12:48.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.144+0000 7ff1aa5d7740 1 -- 172.21.15.99:0/626701790 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55b6e3d270f0 con 0x55b6e4126bc0 2024-02-21T23:12:48.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.144+0000 7ff185600640 1 -- 172.21.15.99:0/626701790 <== mon.2 v2:172.21.15.181:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff194015cb0 con 0x55b6e4126bc0 2024-02-21T23:12:48.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.144+0000 7ff185600640 1 -- 172.21.15.99:0/626701790 <== mon.2 v2:172.21.15.181:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7ff18c096080 con 0x55b6e4126bc0 2024-02-21T23:12:48.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.144+0000 7ff1aa5d7740 10 client.7277 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:12:48.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.144+0000 7ff1aa5d7740 10 client.7277 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:12:48.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.144+0000 7ff1aa5d7740 20 client.7277 populate_metadata read hostname 'smithi099' 2024-02-21T23:12:48.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.144+0000 7ff1aa5d7740 1 --2- 172.21.15.99:0/626701790 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55b6e416e060 0x55b6e416e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:48.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.144+0000 7ff1aa5d7740 4 client.7277 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:12:48.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.144+0000 7ff1aa5d7740 1 -- 172.21.15.99:0/626701790 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b6e405ffd0 con 0x55b6e416e060 2024-02-21T23:12:48.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.145+0000 7ff1a4c00640 1 --2- 172.21.15.99:0/626701790 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55b6e416e060 0x55b6e416e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:48.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.145+0000 7ff1a4c00640 1 --2- 172.21.15.99:0/626701790 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55b6e416e060 0x55b6e416e440 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8c87863df91b9d2 server_cookie=e5257b0c6ad072a6 in_seq=0 out_seq=0 2024-02-21T23:12:48.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.145+0000 7ff185600640 10 client.7277 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:12:48.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.146+0000 7ff185600640 1 -- 172.21.15.99:0/626701790 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55b6e405ffd0 con 0x55b6e416e060 2024-02-21T23:12:48.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.146+0000 7ff185600640 10 client.7277 handle_command_reply: tid=0 2024-02-21T23:12:48.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.147+0000 7ff1aa5d7740 1 client.7277 shutdown 2024-02-21T23:12:48.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.147+0000 7ff1aa5d7740 1 -- 172.21.15.99:0/626701790 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b6e4126bc0 msgr2=0x55b6e41240e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:48.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.147+0000 7ff1aa5d7740 1 --2- 172.21.15.99:0/626701790 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b6e4126bc0 0x55b6e41240e0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7ff18c0c69a0 tx=0x7ff18c09ad90 comp rx=0 tx=0).stop 2024-02-21T23:12:48.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.147+0000 7ff1aa5d7740 1 -- 172.21.15.99:0/626701790 shutdown_connections 2024-02-21T23:12:48.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.147+0000 7ff1aa5d7740 1 --2- 172.21.15.99:0/626701790 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55b6e416e060 0x55b6e416e440 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:48.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.147+0000 7ff185600640 0 client.7277 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:12:48.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.147+0000 7ff1aa5d7740 1 --2- 172.21.15.99:0/626701790 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b6e415c260 0x55b6e415efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:48.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.147+0000 7ff1aa5d7740 1 --2- 172.21.15.99:0/626701790 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b6e4126bc0 0x55b6e41240e0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:48.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.147+0000 7ff1aa5d7740 1 --2- 172.21.15.99:0/626701790 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6e41262a0 0x55b6e411c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:48.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.147+0000 7ff1aa5d7740 1 -- 172.21.15.99:0/626701790 >> 172.21.15.99:0/626701790 conn(0x55b6e40b56b0 msgr2=0x55b6e40edb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:48.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.147+0000 7ff1aa5d7740 1 -- 172.21.15.99:0/626701790 shutdown_connections 2024-02-21T23:12:48.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.148+0000 7ff1aa5d7740 1 -- 172.21.15.99:0/626701790 wait complete. 2024-02-21T23:12:48.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.148+0000 7ff1aa5d7740 20 client.7277 trim_cache size 0 max 16384 2024-02-21T23:12:48.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.183+0000 7ff1aa5d7740 1 Processor -- start 2024-02-21T23:12:48.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.183+0000 7ff1aa5d7740 1 -- start start 2024-02-21T23:12:48.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.185+0000 7ff1aa5d7740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b6e41262a0 0x55b6e40f4c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:48.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.185+0000 7ff1aa5d7740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b6e4126bc0 0x55b6e412f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:48.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.185+0000 7ff1aa5d7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6e415c260 0x55b6e41c23b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:48.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.185+0000 7ff1aa5d7740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a022c990 con 0x55b6e4126bc0 2024-02-21T23:12:48.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.185+0000 7ff1aa5d7740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a022a530 con 0x55b6e415c260 2024-02-21T23:12:48.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.185+0000 7ff1aa5d7740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a021fbd0 con 0x55b6e41262a0 2024-02-21T23:12:48.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.185+0000 7ff19fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b6e4126bc0 0x55b6e412f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:48.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.185+0000 7ff19fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b6e4126bc0 0x55b6e412f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:39842/0 (socket says 172.21.15.99:39842) 2024-02-21T23:12:48.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.185+0000 7ff19fe00640 1 -- 172.21.15.99:0/1649439105 learned_addr learned my addr 172.21.15.99:0/1649439105 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:12:48.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.186+0000 7ff1a5600640 1 --2- 172.21.15.99:0/1649439105 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6e415c260 0x55b6e41c23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:48.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.186+0000 7ff19fe00640 1 -- 172.21.15.99:0/1649439105 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b6e41262a0 msgr2=0x55b6e40f4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:48.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.186+0000 7ff19fe00640 1 --2- 172.21.15.99:0/1649439105 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b6e41262a0 0x55b6e40f4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:48.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.186+0000 7ff19fe00640 1 -- 172.21.15.99:0/1649439105 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6e415c260 msgr2=0x55b6e41c23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:48.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.186+0000 7ff19fe00640 1 --2- 172.21.15.99:0/1649439105 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6e415c260 0x55b6e41c23b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:48.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.186+0000 7ff19fe00640 1 -- 172.21.15.99:0/1649439105 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b6e415cee0 con 0x55b6e4126bc0 2024-02-21T23:12:48.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.186+0000 7ff19fe00640 1 --2- 172.21.15.99:0/1649439105 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b6e4126bc0 0x55b6e412f2f0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7ff18c00a430 tx=0x7ff18c098000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e8ee59634cc2b11 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:48.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.186+0000 7ff187e00640 1 -- 172.21.15.99:0/1649439105 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff18c0932a0 con 0x55b6e4126bc0 2024-02-21T23:12:48.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.186+0000 7ff187e00640 1 -- 172.21.15.99:0/1649439105 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff18c0aabd0 con 0x55b6e4126bc0 2024-02-21T23:12:48.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.186+0000 7ff187e00640 1 -- 172.21.15.99:0/1649439105 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff18c093440 con 0x55b6e4126bc0 2024-02-21T23:12:48.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.187+0000 7ff1aa5d7740 1 -- 172.21.15.99:0/1649439105 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b6e4126bc0 msgr2=0x55b6e412f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:48.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.187+0000 7ff1aa5d7740 1 --2- 172.21.15.99:0/1649439105 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b6e4126bc0 0x55b6e412f2f0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7ff18c00a430 tx=0x7ff18c098000 comp rx=0 tx=0).stop 2024-02-21T23:12:48.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.187+0000 7ff1aa5d7740 1 -- 172.21.15.99:0/1649439105 shutdown_connections 2024-02-21T23:12:48.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.187+0000 7ff1aa5d7740 1 --2- 172.21.15.99:0/1649439105 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6e415c260 0x55b6e41c23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:48.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.187+0000 7ff1aa5d7740 1 --2- 172.21.15.99:0/1649439105 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b6e4126bc0 0x55b6e412f2f0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:48.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.187+0000 7ff1aa5d7740 1 --2- 172.21.15.99:0/1649439105 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b6e41262a0 0x55b6e40f4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:48.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.187+0000 7ff1aa5d7740 1 -- 172.21.15.99:0/1649439105 >> 172.21.15.99:0/1649439105 conn(0x55b6e40b56b0 msgr2=0x55b6e40ea8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:48.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.187+0000 7ff1aa5d7740 1 -- 172.21.15.99:0/1649439105 shutdown_connections 2024-02-21T23:12:48.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.187+0000 7ff1aa5d7740 1 -- 172.21.15.99:0/1649439105 wait complete. 2024-02-21T23:12:48.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.189+0000 7ff1aa5d7740 1 -- start start 2024-02-21T23:12:48.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.189+0000 7ff1aa5d7740 1 Processor -- start 2024-02-21T23:12:48.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.191+0000 7ff1aa5d7740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b6e41262a0 0x55b6e41d8a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:48.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.191+0000 7ff1aa5d7740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b6e4126bc0 0x55b6e41c1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:48.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.191+0000 7ff1aa5d7740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6e415c260 0x55b6e412c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:48.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.191+0000 7ff1aa5d7740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a0215bc0 con 0x55b6e41262a0 2024-02-21T23:12:48.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.191+0000 7ff1aa5d7740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a0229ed0 con 0x55b6e415c260 2024-02-21T23:12:48.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.191+0000 7ff1aa5d7740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a0229280 con 0x55b6e4126bc0 2024-02-21T23:12:48.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.191+0000 7ff1aa5d7740 10 client.0 _ll_register_callbacks cb 0x7ff18c005480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:12:48.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.191+0000 7ff1a4c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b6e41262a0 0x55b6e41d8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:48.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.191+0000 7ff1a4c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b6e41262a0 0x55b6e41d8a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:39858/0 (socket says 172.21.15.99:39858) 2024-02-21T23:12:48.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.191+0000 7ff1a4c00640 1 -- 172.21.15.99:0/3125760764 learned_addr learned my addr 172.21.15.99:0/3125760764 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:12:48.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.192+0000 7ff19fe00640 1 --2- 172.21.15.99:0/3125760764 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b6e4126bc0 0x55b6e41c1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:48.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.192+0000 7ff1a5600640 1 --2- 172.21.15.99:0/3125760764 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6e415c260 0x55b6e412c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:48.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.192+0000 7ff1a4c00640 1 -- 172.21.15.99:0/3125760764 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b6e4126bc0 msgr2=0x55b6e41c1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:48.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.192+0000 7ff1a4c00640 1 --2- 172.21.15.99:0/3125760764 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b6e4126bc0 0x55b6e41c1bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:48.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.192+0000 7ff1a4c00640 1 -- 172.21.15.99:0/3125760764 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6e415c260 msgr2=0x55b6e412c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:48.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.192+0000 7ff1a4c00640 1 --2- 172.21.15.99:0/3125760764 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6e415c260 0x55b6e412c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:48.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.192+0000 7ff1a4c00640 1 -- 172.21.15.99:0/3125760764 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b6e4122f50 con 0x55b6e41262a0 2024-02-21T23:12:48.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.192+0000 7ff1a4c00640 1 --2- 172.21.15.99:0/3125760764 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b6e41262a0 0x55b6e41d8a90 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7ff194023040 tx=0x7ff194007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62993b0769815267 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:48.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.192+0000 7ff185600640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:12:48.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.193+0000 7ff185600640 1 -- 172.21.15.99:0/3125760764 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff194025040 con 0x55b6e41262a0 2024-02-21T23:12:48.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.193+0000 7ff1aa5d7740 1 -- 172.21.15.99:0/3125760764 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff18c0aabd0 con 0x55b6e41262a0 2024-02-21T23:12:48.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.193+0000 7ff185600640 1 -- 172.21.15.99:0/3125760764 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 8877+0+0 (secure 0 0 0) 0x7ff194020bb0 con 0x55b6e41262a0 2024-02-21T23:12:48.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.193+0000 7ff185600640 1 -- 172.21.15.99:0/3125760764 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff194043050 con 0x55b6e41262a0 2024-02-21T23:12:48.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.193+0000 7ff1aa5d7740 10 client.7125 fetch_fsmap learned FSMap version 17 2024-02-21T23:12:48.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.193+0000 7ff1aa5d7740 1 -- 172.21.15.99:0/3125760764 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55b6e4159dd0 con 0x55b6e41262a0 2024-02-21T23:12:48.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.193+0000 7ff185600640 1 -- 172.21.15.99:0/3125760764 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff18c0aabd0 con 0x55b6e41262a0 2024-02-21T23:12:48.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.194+0000 7ff185600640 1 -- 172.21.15.99:0/3125760764 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7ff1940338b0 con 0x55b6e41262a0 2024-02-21T23:12:48.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.194+0000 7ff1aa5d7740 10 client.7125 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:12:48.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.194+0000 7ff1aa5d7740 10 client.7125 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:12:48.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.194+0000 7ff1aa5d7740 20 client.7125 populate_metadata read hostname 'smithi099' 2024-02-21T23:12:48.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.194+0000 7ff1aa5d7740 1 --2- 172.21.15.99:0/3125760764 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55b6e416e060 0x55b6e4125610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:48.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.194+0000 7ff1aa5d7740 4 client.7125 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-02-21T23:12:48.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.194+0000 7ff1aa5d7740 1 -- 172.21.15.99:0/3125760764 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55b6e405a320 con 0x55b6e416e060 2024-02-21T23:12:48.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.194+0000 7ff19fe00640 1 --2- 172.21.15.99:0/3125760764 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55b6e416e060 0x55b6e4125610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:48.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.195+0000 7ff185600640 10 client.7125 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:12:48.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.195+0000 7ff19fe00640 1 --2- 172.21.15.99:0/3125760764 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55b6e416e060 0x55b6e4125610 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=873b2c525ecc644 server_cookie=621c8125f2553238 in_seq=0 out_seq=0 2024-02-21T23:12:48.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.195+0000 7ff185600640 1 -- 172.21.15.99:0/3125760764 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55b6e405a320 con 0x55b6e416e060 2024-02-21T23:12:48.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.195+0000 7ff185600640 10 client.7125 handle_command_reply: tid=0 2024-02-21T23:12:48.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.195+0000 7ff1aa5d7740 1 client.7125 shutdown 2024-02-21T23:12:48.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.195+0000 7ff1aa5d7740 1 -- 172.21.15.99:0/3125760764 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b6e41262a0 msgr2=0x55b6e41d8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:48.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.195+0000 7ff1aa5d7740 1 --2- 172.21.15.99:0/3125760764 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b6e41262a0 0x55b6e41d8a90 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7ff194023040 tx=0x7ff194007d10 comp rx=0 tx=0).stop 2024-02-21T23:12:48.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.195+0000 7ff1aa5d7740 1 -- 172.21.15.99:0/3125760764 shutdown_connections 2024-02-21T23:12:48.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.195+0000 7ff1aa5d7740 1 --2- 172.21.15.99:0/3125760764 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x55b6e416e060 0x55b6e4125610 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:48.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.195+0000 7ff1aa5d7740 1 --2- 172.21.15.99:0/3125760764 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b6e415c260 0x55b6e412c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:48.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.195+0000 7ff1aa5d7740 1 --2- 172.21.15.99:0/3125760764 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x55b6e4126bc0 0x55b6e41c1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:48.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.195+0000 7ff1aa5d7740 1 --2- 172.21.15.99:0/3125760764 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x55b6e41262a0 0x55b6e41d8a90 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:48.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.195+0000 7ff1aa5d7740 1 -- 172.21.15.99:0/3125760764 >> 172.21.15.99:0/3125760764 conn(0x55b6e40b56b0 msgr2=0x55b6e412f2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:48.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.195+0000 7ff185600640 0 client.7125 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:12:48.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.196+0000 7ff1aa5d7740 1 -- 172.21.15.99:0/3125760764 shutdown_connections 2024-02-21T23:12:48.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.196+0000 7ff1aa5d7740 1 -- 172.21.15.99:0/3125760764 wait complete. 2024-02-21T23:12:48.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.196+0000 7ff1aa5d7740 20 client.7125 trim_cache size 0 max 16384 2024-02-21T23:12:48.190 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-02-21T23:12:48.190 INFO:teuthology.orchestra.run.smithi099.stdout: "status": "no active scrubs running", 2024-02-21T23:12:48.190 INFO:teuthology.orchestra.run.smithi099.stdout: "scrubs": {} 2024-02-21T23:12:48.190 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-02-21T23:12:48.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.197+0000 7ff1a6000640 1 -- 172.21.15.99:0/1248457202 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7ff18009eed0 msgr2=0x7ff1800a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:48.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.197+0000 7ff1a6000640 1 --2- 172.21.15.99:0/1248457202 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7ff18009eed0 0x7ff1800a1390 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff194005880 tx=0x7ff194009040 comp rx=0 tx=0).stop 2024-02-21T23:12:48.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.197+0000 7ff1a6000640 1 -- 172.21.15.99:0/1248457202 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff1a017f490 msgr2=0x7ff1a0172250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:48.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.197+0000 7ff1a6000640 1 --2- 172.21.15.99:0/1248457202 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff1a017f490 0x7ff1a0172250 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7ff18c00c780 tx=0x7ff18c00cc40 comp rx=0 tx=0).stop 2024-02-21T23:12:48.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.197+0000 7ff1a6000640 1 -- 172.21.15.99:0/1248457202 shutdown_connections 2024-02-21T23:12:48.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.197+0000 7ff1a6000640 1 --2- 172.21.15.99:0/1248457202 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7ff18009eed0 0x7ff1800a1390 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:48.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.197+0000 7ff1a6000640 1 --2- 172.21.15.99:0/1248457202 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff1a018b230 0x7ff1a0177830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:48.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.197+0000 7ff1a6000640 1 --2- 172.21.15.99:0/1248457202 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff1a017f490 0x7ff1a0172250 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:48.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.197+0000 7ff1a6000640 1 --2- 172.21.15.99:0/1248457202 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff1a00d60b0 0x7ff1a017e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:48.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.197+0000 7ff1a6000640 1 -- 172.21.15.99:0/1248457202 >> 172.21.15.99:0/1248457202 conn(0x7ff1a00d29b0 msgr2=0x7ff1a0179730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:48.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.197+0000 7ff1a6000640 1 -- 172.21.15.99:0/1248457202 shutdown_connections 2024-02-21T23:12:48.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.197+0000 7ff1a6000640 1 -- 172.21.15.99:0/1248457202 wait complete. 2024-02-21T23:12:48.208 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-02-21T23:12:48.209 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T23:12:48.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.426+0000 7fa3b9e00640 1 Processor -- start 2024-02-21T23:12:48.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.426+0000 7fa3b9e00640 1 -- start start 2024-02-21T23:12:48.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.428+0000 7fa3b9e00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fa3b4182a80 0x7fa3b418a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:48.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.429+0000 7fa3b9e00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3b418a600 con 0x7fa3b418b980 2024-02-21T23:12:48.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.429+0000 7fa3b9e00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3b418a8e0 con 0x7fa3b40719b0 2024-02-21T23:12:48.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.429+0000 7fa3b9e00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3b418abc0 con 0x7fa3b4182a80 2024-02-21T23:12:48.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.429+0000 7fa3b3e00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fa3b418b980 0x7fa3b4186a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:54780/0 (socket says 172.21.15.99:54780) 2024-02-21T23:12:48.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.429+0000 7fa3b3e00640 1 -- 172.21.15.99:0/401214257 learned_addr learned my addr 172.21.15.99:0/401214257 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:12:48.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.429+0000 7fa3b8a00640 1 --2- 172.21.15.99:0/401214257 >> v2:172.21.15.181:3300/0 conn(0x7fa3b4182a80 0x7fa3b418a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:48.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.429+0000 7fa3b8a00640 1 -- 172.21.15.99:0/401214257 >> v1:172.21.15.181:6789/0 conn(0x7fa3b40719b0 legacy=0x7fa3b4071e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:48.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.430+0000 7fa3b3400640 1 -- 172.21.15.99:0/401214257 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1878414878 0 0) 0x7fa3b418a8e0 con 0x7fa3b40719b0 2024-02-21T23:12:48.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.430+0000 7fa3b8a00640 1 -- 172.21.15.99:0/401214257 >> v1:172.21.15.99:6789/0 conn(0x7fa3b418b980 legacy=0x7fa3b4186a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:48.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.430+0000 7fa3b8a00640 1 -- 172.21.15.99:0/401214257 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3b418aea0 con 0x7fa3b4182a80 2024-02-21T23:12:48.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.431+0000 7fa3b8a00640 1 --2- 172.21.15.99:0/401214257 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa3b4182a80 0x7fa3b418a010 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fa3a80097a0 tx=0x7fa3a802b680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88939946021b77df server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:48.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.431+0000 7fa3b3400640 1 -- 172.21.15.99:0/401214257 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a8037070 con 0x7fa3b4182a80 2024-02-21T23:12:48.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.431+0000 7fa3b3400640 1 -- 172.21.15.99:0/401214257 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3a8030710 con 0x7fa3b4182a80 2024-02-21T23:12:48.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.431+0000 7fa3b3400640 1 -- 172.21.15.99:0/401214257 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a8030ae0 con 0x7fa3b4182a80 2024-02-21T23:12:48.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.432+0000 7fa3b9e00640 1 -- 172.21.15.99:0/401214257 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa3b4182a80 msgr2=0x7fa3b418a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:48.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.432+0000 7fa3b9e00640 1 --2- 172.21.15.99:0/401214257 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa3b4182a80 0x7fa3b418a010 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fa3a80097a0 tx=0x7fa3a802b680 comp rx=0 tx=0).stop 2024-02-21T23:12:48.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.432+0000 7fa3b9e00640 1 -- 172.21.15.99:0/401214257 shutdown_connections 2024-02-21T23:12:48.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.432+0000 7fa3b9e00640 1 --2- 172.21.15.99:0/401214257 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa3b4182a80 0x7fa3b418a010 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:48.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.432+0000 7fa3b9e00640 1 -- 172.21.15.99:0/401214257 >> 172.21.15.99:0/401214257 conn(0x7fa3b40d29f0 msgr2=0x7fa3b40d2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:48.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.432+0000 7fa3b9e00640 1 -- 172.21.15.99:0/401214257 shutdown_connections 2024-02-21T23:12:48.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.432+0000 7fa3b9e00640 1 -- 172.21.15.99:0/401214257 wait complete. 2024-02-21T23:12:48.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.434+0000 7fa3b9e00640 1 Processor -- start 2024-02-21T23:12:48.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.434+0000 7fa3b9e00640 1 -- start start 2024-02-21T23:12:48.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.435+0000 7fa3b9e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3b40719b0 0x7fa3b42203b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:48.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.435+0000 7fa3b9e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa3b4182a80 0x7fa3b4221d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:48.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.435+0000 7fa3b9e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3b418b980 0x7fa3b40cf880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:48.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.435+0000 7fa3b9e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b418be00 con 0x7fa3b40719b0 2024-02-21T23:12:48.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.435+0000 7fa3b9e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b418b460 con 0x7fa3b418b980 2024-02-21T23:12:48.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.435+0000 7fa3b9e00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b4182e60 con 0x7fa3b4182a80 2024-02-21T23:12:48.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.436+0000 7fa3b8a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3b40719b0 0x7fa3b42203b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:48.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.436+0000 7fa3b8a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3b40719b0 0x7fa3b42203b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:39874/0 (socket says 172.21.15.99:39874) 2024-02-21T23:12:48.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.436+0000 7fa3b8a00640 1 -- 172.21.15.99:0/2473255318 learned_addr learned my addr 172.21.15.99:0/2473255318 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:12:48.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.436+0000 7fa3b3e00640 1 --2- 172.21.15.99:0/2473255318 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa3b4182a80 0x7fa3b4221d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:48.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.436+0000 7fa3b9400640 1 --2- 172.21.15.99:0/2473255318 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3b418b980 0x7fa3b40cf880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:48.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.436+0000 7fa3b8a00640 1 -- 172.21.15.99:0/2473255318 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa3b4182a80 msgr2=0x7fa3b4221d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:48.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.436+0000 7fa3b8a00640 1 --2- 172.21.15.99:0/2473255318 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa3b4182a80 0x7fa3b4221d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:48.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.436+0000 7fa3b8a00640 1 -- 172.21.15.99:0/2473255318 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3b418b980 msgr2=0x7fa3b40cf880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:48.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.436+0000 7fa3b8a00640 1 --2- 172.21.15.99:0/2473255318 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3b418b980 0x7fa3b40cf880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:48.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.436+0000 7fa3b8a00640 1 -- 172.21.15.99:0/2473255318 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3b40cfdc0 con 0x7fa3b40719b0 2024-02-21T23:12:48.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.436+0000 7fa3b3e00640 1 --2- 172.21.15.99:0/2473255318 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa3b4182a80 0x7fa3b4221d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:12:48.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.436+0000 7fa3b9400640 1 --2- 172.21.15.99:0/2473255318 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3b418b980 0x7fa3b40cf880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:12:48.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.437+0000 7fa3b8a00640 1 --2- 172.21.15.99:0/2473255318 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3b40719b0 0x7fa3b42203b0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fa3a802bc90 tx=0x7fa3a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:48.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.437+0000 7fa3b0c00640 1 -- 172.21.15.99:0/2473255318 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a8042070 con 0x7fa3b40719b0 2024-02-21T23:12:48.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.437+0000 7fa3b0c00640 1 -- 172.21.15.99:0/2473255318 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3a8032a40 con 0x7fa3b40719b0 2024-02-21T23:12:48.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.437+0000 7fa3b9e00640 1 -- 172.21.15.99:0/2473255318 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3b4220a10 con 0x7fa3b40719b0 2024-02-21T23:12:48.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.437+0000 7fa3b0c00640 1 -- 172.21.15.99:0/2473255318 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a8037040 con 0x7fa3b40719b0 2024-02-21T23:12:48.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.437+0000 7fa3b9e00640 1 -- 172.21.15.99:0/2473255318 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3b4220fd0 con 0x7fa3b40719b0 2024-02-21T23:12:48.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.438+0000 7fa3b9e00640 1 -- 172.21.15.99:0/2473255318 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3b4068320 con 0x7fa3b40719b0 2024-02-21T23:12:48.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.442+0000 7fa3b0c00640 1 -- 172.21.15.99:0/2473255318 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7fa3a8045070 con 0x7fa3b40719b0 2024-02-21T23:12:48.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.444+0000 7fa3b0c00640 1 --2- 172.21.15.99:0/2473255318 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa39409eed0 0x7fa3940a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:48.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.444+0000 7fa3b0c00640 1 -- 172.21.15.99:0/2473255318 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 8877+0+0 (secure 0 0 0) 0x7fa3a80ec1e0 con 0x7fa3b40719b0 2024-02-21T23:12:48.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.445+0000 7fa3b3e00640 1 --2- 172.21.15.99:0/2473255318 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa39409eed0 0x7fa3940a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:48.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.445+0000 7fa3b0c00640 1 -- 172.21.15.99:0/2473255318 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fa3a80b99d0 con 0x7fa3b40719b0 2024-02-21T23:12:48.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.445+0000 7fa3b3e00640 1 --2- 172.21.15.99:0/2473255318 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa39409eed0 0x7fa3940a1390 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa3b4160560 tx=0x7fa3a0009040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:48.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.724+0000 7fa3b9e00640 1 -- 172.21.15.99:0/2473255318 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa3b418a310 con 0x7fa3b40719b0 2024-02-21T23:12:48.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.726+0000 7fa3b0c00640 1 -- 172.21.15.99:0/2473255318 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+11335 (secure 0 0 0) 0x7fa3a80bda70 con 0x7fa3b40719b0 2024-02-21T23:12:48.714 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T23:12:48.714 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4307,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/3514452812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3514452812},{"type":"v1","addr":"172.21.15.162:6836","nonce":3514452812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4312,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6838/2169982089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":2169982089},{"type":"v1","addr":"172.21.15.162:6838","nonce":2169982089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4315,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6839/3335972724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6837","nonce":3335972724},{"type":"v1","addr":"172.21.15.162:6839","nonce":3335972724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4318,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6841/2135456697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6840","nonce":2135456697},{"type":"v1","addr":"172.21.15.162:6841","nonce":2135456697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4325,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2452242758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2452242758},{"type":"v1","addr":"172.21.15.181:6833","nonce":2452242758}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4328,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6836/2751486400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":2751486400},{"type":"v1","addr":"172.21.15.181:6836","nonce":2751486400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":17,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-21T23:01:02.656130+0000","modified":"2024-02-21T23:07:03.165223+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4355,"mds_1":4352,"mds_2":4348},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4331":{"gid":4331,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6838/3728901330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6835","nonce":3728901330},{"type":"v1","addr":"172.21.15.181:6838","nonce":3728901330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4339":{"gid":4339,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6839/3357929641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6837","nonce":3357929641},{"type":"v1","addr":"172.21.15.181:6839","nonce":3357929641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4343":{"gid":4343,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6833/2793485078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":2793485078},{"type":"v1","addr":"172.21.15.99:6833","nonce":2793485078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4348":{"gid":4348,"name":"d","rank":2,"incarnation":12,"state":"up:active","state_seq":10,"addr":"172.21.15.99:6835/2243461688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2243461688},{"type":"v1","addr":"172.21.15.99:6835","nonce":2243461688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4352":{"gid":4352,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.99:6837/1676159950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":1676159950},{"type":"v1","addr":"172.21.15.99:6837","nonce":1676159950}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4355":{"gid":4355,"name":"j","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6839/4239008786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":4239008786},{"type":"v1","addr":"172.21.15.99:6839","nonce":4239008786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-21T23:12:48.714 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 17 2024-02-21T23:12:48.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.728+0000 7fa3b9e00640 1 -- 172.21.15.99:0/2473255318 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa39409eed0 msgr2=0x7fa3940a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:48.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.728+0000 7fa3b9e00640 1 --2- 172.21.15.99:0/2473255318 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa39409eed0 0x7fa3940a1390 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa3b4160560 tx=0x7fa3a0009040 comp rx=0 tx=0).stop 2024-02-21T23:12:48.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.728+0000 7fa3b9e00640 1 -- 172.21.15.99:0/2473255318 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3b40719b0 msgr2=0x7fa3b42203b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:48.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.728+0000 7fa3b9e00640 1 --2- 172.21.15.99:0/2473255318 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3b40719b0 0x7fa3b42203b0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fa3a802bc90 tx=0x7fa3a80046c0 comp rx=0 tx=0).stop 2024-02-21T23:12:48.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.728+0000 7fa3b9e00640 1 -- 172.21.15.99:0/2473255318 shutdown_connections 2024-02-21T23:12:48.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.728+0000 7fa3b9e00640 1 --2- 172.21.15.99:0/2473255318 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa39409eed0 0x7fa3940a1390 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:48.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.728+0000 7fa3b9e00640 1 --2- 172.21.15.99:0/2473255318 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3b418b980 0x7fa3b40cf880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:48.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.728+0000 7fa3b9e00640 1 --2- 172.21.15.99:0/2473255318 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa3b4182a80 0x7fa3b4221d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:48.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.728+0000 7fa3b9e00640 1 --2- 172.21.15.99:0/2473255318 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3b40719b0 0x7fa3b42203b0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:48.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.728+0000 7fa3b9e00640 1 -- 172.21.15.99:0/2473255318 >> 172.21.15.99:0/2473255318 conn(0x7fa3b40d29f0 msgr2=0x7fa3b40d2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:48.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.728+0000 7fa3b9e00640 1 -- 172.21.15.99:0/2473255318 shutdown_connections 2024-02-21T23:12:48.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.728+0000 7fa3b9e00640 1 -- 172.21.15.99:0/2473255318 wait complete. 2024-02-21T23:12:48.733 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T23:12:48.733 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-02-21T23:12:48.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.939+0000 7f0d0d600640 1 Processor -- start 2024-02-21T23:12:48.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.940+0000 7f0d0d600640 1 -- start start 2024-02-21T23:12:48.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.942+0000 7f0d0d600640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f0d0818ce60 0x7f0d08071bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:48.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.942+0000 7f0d0d600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f0d080f6340 0x7f0d080720f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:48.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.942+0000 7f0d0d600640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d0808cfd0 con 0x7f0d08186680 2024-02-21T23:12:48.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.942+0000 7f0d0d600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d0808e610 con 0x7f0d080f6340 2024-02-21T23:12:48.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.942+0000 7f0d0d600640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d0808d290 con 0x7f0d0818ce60 2024-02-21T23:12:48.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.942+0000 7f0d07400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f0d080f6340 0x7f0d080720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:48.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.942+0000 7f0d06a00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f0d08186680 0x7f0d080f5c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.99:32772/0 (socket says 172.21.15.99:32772) 2024-02-21T23:12:48.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.942+0000 7f0d06a00640 1 -- 172.21.15.99:0/860192502 learned_addr learned my addr 172.21.15.99:0/860192502 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:12:48.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.942+0000 7f0d06000640 1 --2- 172.21.15.99:0/860192502 >> v2:172.21.15.181:3300/0 conn(0x7f0d0818ce60 0x7f0d08071bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:48.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.942+0000 7f0d05600640 1 -- 172.21.15.99:0/860192502 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2930052857 0 0) 0x7f0d0808cfd0 con 0x7f0d08186680 2024-02-21T23:12:48.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.943+0000 7f0d05600640 1 -- 172.21.15.99:0/860192502 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0cec003520 con 0x7f0d08186680 2024-02-21T23:12:48.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.943+0000 7f0d06000640 1 -- 172.21.15.99:0/860192502 >> v2:172.21.15.99:3300/0 conn(0x7f0d080f6340 msgr2=0x7f0d080720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:48.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.943+0000 7f0d06000640 1 --2- 172.21.15.99:0/860192502 >> v2:172.21.15.99:3300/0 conn(0x7f0d080f6340 0x7f0d080720f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:48.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.943+0000 7f0d06000640 1 -- 172.21.15.99:0/860192502 >> v1:172.21.15.162:6789/0 conn(0x7f0d08186680 legacy=0x7f0d080f5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:48.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.943+0000 7f0d06000640 1 -- 172.21.15.99:0/860192502 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d0808d570 con 0x7f0d0818ce60 2024-02-21T23:12:48.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.943+0000 7f0d07400640 1 --2- 172.21.15.99:0/860192502 >> v2:172.21.15.99:3300/0 conn(0x7f0d080f6340 0x7f0d080720f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:12:48.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.944+0000 7f0d06000640 1 --2- 172.21.15.99:0/860192502 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0d0818ce60 0x7f0d08071bb0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f0d080fc3b0 tx=0x7f0cf402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e4ce9269d8abb02 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:48.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.945+0000 7f0d05600640 1 -- 172.21.15.99:0/860192502 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf4035020 con 0x7f0d0818ce60 2024-02-21T23:12:48.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.945+0000 7f0d05600640 1 -- 172.21.15.99:0/860192502 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cf4031830 con 0x7f0d0818ce60 2024-02-21T23:12:48.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.945+0000 7f0d05600640 1 -- 172.21.15.99:0/860192502 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf4031c00 con 0x7f0d0818ce60 2024-02-21T23:12:48.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.946+0000 7f0d0d600640 1 -- 172.21.15.99:0/860192502 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0d0818ce60 msgr2=0x7f0d08071bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:48.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.946+0000 7f0d0d600640 1 --2- 172.21.15.99:0/860192502 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0d0818ce60 0x7f0d08071bb0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f0d080fc3b0 tx=0x7f0cf402b8d0 comp rx=0 tx=0).stop 2024-02-21T23:12:48.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.946+0000 7f0d0d600640 1 -- 172.21.15.99:0/860192502 shutdown_connections 2024-02-21T23:12:48.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.946+0000 7f0d0d600640 1 --2- 172.21.15.99:0/860192502 >> v2:172.21.15.99:3300/0 conn(0x7f0d080f6340 0x7f0d080720f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:48.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.946+0000 7f0d0d600640 1 --2- 172.21.15.99:0/860192502 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0d0818ce60 0x7f0d08071bb0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:48.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.946+0000 7f0d0d600640 1 -- 172.21.15.99:0/860192502 >> 172.21.15.99:0/860192502 conn(0x7f0d080cf780 msgr2=0x7f0d080cfb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:48.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.946+0000 7f0d0d600640 1 -- 172.21.15.99:0/860192502 shutdown_connections 2024-02-21T23:12:48.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.946+0000 7f0d0d600640 1 -- 172.21.15.99:0/860192502 wait complete. 2024-02-21T23:12:48.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.948+0000 7f0d0d600640 1 Processor -- start 2024-02-21T23:12:48.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.948+0000 7f0d0d600640 1 -- start start 2024-02-21T23:12:48.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.949+0000 7f0d0d600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0d080f6340 0x7f0d081746b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:48.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.949+0000 7f0d0d600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d08186680 0x7f0d08220f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:48.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.949+0000 7f0d0d600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d08159960 0x7f0d082214c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:48.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.949+0000 7f0d0d600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0808de10 con 0x7f0d08186680 2024-02-21T23:12:48.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.949+0000 7f0d0d600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0808db30 con 0x7f0d08159960 2024-02-21T23:12:48.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.949+0000 7f0d0d600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0808e0f0 con 0x7f0d080f6340 2024-02-21T23:12:48.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.949+0000 7f0d06a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0d080f6340 0x7f0d081746b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:48.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.949+0000 7f0d06000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d08186680 0x7f0d08220f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:48.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.950+0000 7f0d06000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d08186680 0x7f0d08220f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:39904/0 (socket says 172.21.15.99:39904) 2024-02-21T23:12:48.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.950+0000 7f0d06000640 1 -- 172.21.15.99:0/241057444 learned_addr learned my addr 172.21.15.99:0/241057444 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:12:48.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.950+0000 7f0d06a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0d080f6340 0x7f0d081746b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:47416/0 (socket says 172.21.15.99:47416) 2024-02-21T23:12:48.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.950+0000 7f0d07400640 1 --2- 172.21.15.99:0/241057444 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d08159960 0x7f0d082214c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:48.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.950+0000 7f0d06000640 1 -- 172.21.15.99:0/241057444 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0d080f6340 msgr2=0x7f0d081746b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:48.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.950+0000 7f0d06000640 1 --2- 172.21.15.99:0/241057444 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0d080f6340 0x7f0d081746b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:48.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.950+0000 7f0d06000640 1 -- 172.21.15.99:0/241057444 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d08159960 msgr2=0x7f0d082214c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:48.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.950+0000 7f0d06000640 1 --2- 172.21.15.99:0/241057444 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d08159960 0x7f0d082214c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:48.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.950+0000 7f0d06000640 1 -- 172.21.15.99:0/241057444 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d080fae10 con 0x7f0d08186680 2024-02-21T23:12:48.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.950+0000 7f0d06a00640 1 --2- 172.21.15.99:0/241057444 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0d080f6340 0x7f0d081746b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:12:48.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.950+0000 7f0d06000640 1 --2- 172.21.15.99:0/241057444 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d08186680 0x7f0d08220f80 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f0cf4009860 tx=0x7f0cf40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:48.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.951+0000 7f0cfea00640 1 -- 172.21.15.99:0/241057444 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf4035040 con 0x7f0d08186680 2024-02-21T23:12:48.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.951+0000 7f0cfea00640 1 -- 172.21.15.99:0/241057444 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cf403b860 con 0x7f0d08186680 2024-02-21T23:12:48.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.951+0000 7f0d0d600640 1 -- 172.21.15.99:0/241057444 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d082201c0 con 0x7f0d08186680 2024-02-21T23:12:48.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.951+0000 7f0cfea00640 1 -- 172.21.15.99:0/241057444 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf403bc50 con 0x7f0d08186680 2024-02-21T23:12:48.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.951+0000 7f0d0d600640 1 -- 172.21.15.99:0/241057444 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d08220780 con 0x7f0d08186680 2024-02-21T23:12:48.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.955+0000 7f0cfea00640 1 -- 172.21.15.99:0/241057444 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f0cf4038020 con 0x7f0d08186680 2024-02-21T23:12:48.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.957+0000 7f0d1046c740 1 Processor -- start 2024-02-21T23:12:48.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.957+0000 7f0d1046c740 1 -- start start 2024-02-21T23:12:48.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.958+0000 7f0cfea00640 1 --2- 172.21.15.99:0/241057444 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f0ce809ef00 0x7f0ce80a13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:48.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.958+0000 7f0cfea00640 1 -- 172.21.15.99:0/241057444 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f0cf40ebad0 con 0x7f0d08186680 2024-02-21T23:12:48.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.958+0000 7f0d07400640 1 --2- 172.21.15.99:0/241057444 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f0ce809ef00 0x7f0ce80a13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:48.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.958+0000 7f0d1046c740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564b4078c4b0 0x564b4078c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:48.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.959+0000 7f0d1046c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b407c7180 0x564b407c7600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:48.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.959+0000 7f0d1046c740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b407c7b40 0x564b407c83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:48.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.959+0000 7f0d1046c740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b406b4b50 con 0x564b4078c4b0 2024-02-21T23:12:48.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.959+0000 7f0d1046c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b4065dda0 con 0x564b407c7180 2024-02-21T23:12:48.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.959+0000 7f0d1046c740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b406b0bf0 con 0x564b407c7b40 2024-02-21T23:12:48.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.959+0000 7f0d06a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564b4078c4b0 0x564b4078c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:48.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.959+0000 7f0d06000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b407c7180 0x564b407c7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:48.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.959+0000 7f0d07400640 1 --2- 172.21.15.99:0/241057444 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f0ce809ef00 0x7f0ce80a13c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0d00007440 tx=0x7f0d0000b040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:48.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.959+0000 7f0d06000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b407c7180 0x564b407c7600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:59710/0 (socket says 172.21.15.99:59710) 2024-02-21T23:12:48.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.959+0000 7f0d06000640 1 -- 172.21.15.99:0/2512989056 learned_addr learned my addr 172.21.15.99:0/2512989056 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:12:48.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.959+0000 7f0d07400640 1 --2- 172.21.15.99:0/2512989056 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b407c7b40 0x564b407c83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:48.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.959+0000 7f0d06000640 1 -- 172.21.15.99:0/2512989056 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b407c7b40 msgr2=0x564b407c83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:48.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.959+0000 7f0d06000640 1 --2- 172.21.15.99:0/2512989056 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b407c7b40 0x564b407c83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:48.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.959+0000 7f0d06000640 1 -- 172.21.15.99:0/2512989056 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564b4078c4b0 msgr2=0x564b4078c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:48.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.959+0000 7f0d06000640 1 --2- 172.21.15.99:0/2512989056 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564b4078c4b0 0x564b4078c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:48.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.959+0000 7f0d06000640 1 -- 172.21.15.99:0/2512989056 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564b40680f80 con 0x564b407c7180 2024-02-21T23:12:48.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.960+0000 7f0d06000640 1 --2- 172.21.15.99:0/2512989056 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b407c7180 0x564b407c7600 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f0cf4006a30 tx=0x7f0cf40b8e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f70303a871c217b7 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:48.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.960+0000 7f0cf3000640 1 -- 172.21.15.99:0/2512989056 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf40b9410 con 0x564b407c7180 2024-02-21T23:12:48.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.960+0000 7f0cf3000640 1 -- 172.21.15.99:0/2512989056 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cf40bd560 con 0x564b407c7180 2024-02-21T23:12:48.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.960+0000 7f0cf3000640 1 -- 172.21.15.99:0/2512989056 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf40c1b20 con 0x564b407c7180 2024-02-21T23:12:48.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.961+0000 7f0d1046c740 1 -- 172.21.15.99:0/2512989056 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b407c7180 msgr2=0x564b407c7600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:48.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.961+0000 7f0d1046c740 1 --2- 172.21.15.99:0/2512989056 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b407c7180 0x564b407c7600 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f0cf4006a30 tx=0x7f0cf40b8e70 comp rx=0 tx=0).stop 2024-02-21T23:12:48.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.961+0000 7f0d1046c740 1 -- 172.21.15.99:0/2512989056 shutdown_connections 2024-02-21T23:12:48.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.961+0000 7f0d1046c740 1 --2- 172.21.15.99:0/2512989056 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b407c7b40 0x564b407c83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:48.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.961+0000 7f0d1046c740 1 --2- 172.21.15.99:0/2512989056 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b407c7180 0x564b407c7600 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:48.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.961+0000 7f0d1046c740 1 --2- 172.21.15.99:0/2512989056 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564b4078c4b0 0x564b4078c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:48.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.961+0000 7f0d1046c740 1 -- 172.21.15.99:0/2512989056 >> 172.21.15.99:0/2512989056 conn(0x564b4074e520 msgr2=0x564b4074f5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:48.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.961+0000 7f0d1046c740 1 -- 172.21.15.99:0/2512989056 shutdown_connections 2024-02-21T23:12:48.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.961+0000 7f0d1046c740 1 -- 172.21.15.99:0/2512989056 wait complete. 2024-02-21T23:12:48.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.962+0000 7f0d1046c740 1 -- start start 2024-02-21T23:12:48.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.962+0000 7f0d1046c740 1 Processor -- start 2024-02-21T23:12:48.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.964+0000 7f0d1046c740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564b407c7180 0x564b407902c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:48.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.964+0000 7f0d1046c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b407c7b40 0x564b40792ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:48.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.964+0000 7f0d1046c740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b407c3ee0 0x564b4077ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:48.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.964+0000 7f0d1046c740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b406b4b50 con 0x564b407c7180 2024-02-21T23:12:48.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.965+0000 7f0d1046c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b40653380 con 0x564b407c7b40 2024-02-21T23:12:48.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.965+0000 7f0d1046c740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b4065dda0 con 0x564b407c3ee0 2024-02-21T23:12:48.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.965+0000 7f0d1046c740 10 client.0 _ll_register_callbacks cb 0x564b406ac280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:12:48.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.965+0000 7f0d06a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564b407c7180 0x564b407902c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:48.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.965+0000 7f0d06a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564b407c7180 0x564b407902c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:39928/0 (socket says 172.21.15.99:39928) 2024-02-21T23:12:48.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.965+0000 7f0d06a00640 1 -- 172.21.15.99:0/42549936 learned_addr learned my addr 172.21.15.99:0/42549936 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:12:48.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.965+0000 7f0d06000640 1 --2- 172.21.15.99:0/42549936 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b407c7b40 0x564b40792ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:48.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.965+0000 7f0d07400640 1 --2- 172.21.15.99:0/42549936 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b407c3ee0 0x564b4077ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:48.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.965+0000 7f0d06a00640 1 -- 172.21.15.99:0/42549936 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b407c3ee0 msgr2=0x564b4077ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:48.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.965+0000 7f0d06a00640 1 --2- 172.21.15.99:0/42549936 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b407c3ee0 0x564b4077ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:48.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.965+0000 7f0d06a00640 1 -- 172.21.15.99:0/42549936 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b407c7b40 msgr2=0x564b40792ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:48.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.965+0000 7f0d06a00640 1 --2- 172.21.15.99:0/42549936 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b407c7b40 0x564b40792ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:48.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.965+0000 7f0d06a00640 1 -- 172.21.15.99:0/42549936 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564b4067bc20 con 0x564b407c7180 2024-02-21T23:12:48.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.965+0000 7f0d06000640 1 --2- 172.21.15.99:0/42549936 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b407c7b40 0x564b40792ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:12:48.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.966+0000 7f0d06a00640 1 --2- 172.21.15.99:0/42549936 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564b407c7180 0x564b407902c0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f0cf80128a0 tx=0x7f0cf8012d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3514b3a8efec2399 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:48.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.966+0000 7f0ce7400640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:12:48.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.966+0000 7f0ce7400640 1 -- 172.21.15.99:0/42549936 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf8019020 con 0x564b407c7180 2024-02-21T23:12:48.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.966+0000 7f0ce7400640 1 -- 172.21.15.99:0/42549936 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f0cf8005ac0 con 0x564b407c7180 2024-02-21T23:12:48.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.966+0000 7f0d1046c740 1 -- 172.21.15.99:0/42549936 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0cf40bd560 con 0x564b407c7180 2024-02-21T23:12:48.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.966+0000 7f0ce7400640 1 -- 172.21.15.99:0/42549936 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0cf8024050 con 0x564b407c7180 2024-02-21T23:12:48.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.966+0000 7f0d1046c740 10 client.7143 fetch_fsmap learned FSMap version 17 2024-02-21T23:12:48.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.966+0000 7f0d1046c740 1 -- 172.21.15.99:0/42549936 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x564b403c93f0 con 0x564b407c7180 2024-02-21T23:12:48.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.967+0000 7f0ce7400640 1 -- 172.21.15.99:0/42549936 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cf40bd560 con 0x564b407c7180 2024-02-21T23:12:48.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.967+0000 7f0ce7400640 1 -- 172.21.15.99:0/42549936 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f0cf8005cc0 con 0x564b407c7180 2024-02-21T23:12:48.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.967+0000 7f0d1046c740 10 client.7143 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:12:48.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.967+0000 7f0d1046c740 10 client.7143 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.d 2024-02-21T23:12:48.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.967+0000 7f0d1046c740 20 client.7143 populate_metadata read hostname 'smithi099' 2024-02-21T23:12:48.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.967+0000 7f0d1046c740 1 --2- 172.21.15.99:0/42549936 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x564b407c1060 0x564b407d3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:48.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.967+0000 7f0d1046c740 4 client.7143 mds_command: new command op to 4348 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:12:48.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.967+0000 7f0d1046c740 1 -- 172.21.15.99:0/42549936 --> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564b406c2090 con 0x564b407c1060 2024-02-21T23:12:48.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.967+0000 7f0d06000640 1 --2- 172.21.15.99:0/42549936 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x564b407c1060 0x564b407d3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:48.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.968+0000 7f0d06000640 1 --2- 172.21.15.99:0/42549936 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x564b407c1060 0x564b407d3fa0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=40dbd1fb3c00f6a server_cookie=5113a0adfae6d60f in_seq=0 out_seq=0 2024-02-21T23:12:48.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.968+0000 7f0ce7400640 10 client.7143 ms_handle_connect on v2:172.21.15.99:6834/2243461688 2024-02-21T23:12:48.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.969+0000 7f0ce7400640 1 -- 172.21.15.99:0/42549936 <== mds.2 v2:172.21.15.99:6834/2243461688 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x564b406c2090 con 0x564b407c1060 2024-02-21T23:12:48.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.969+0000 7f0ce7400640 10 client.7143 handle_command_reply: tid=0 2024-02-21T23:12:48.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.969+0000 7f0d1046c740 1 client.7143 shutdown 2024-02-21T23:12:48.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.969+0000 7f0d1046c740 1 -- 172.21.15.99:0/42549936 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564b407c7180 msgr2=0x564b407902c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:48.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.969+0000 7f0d1046c740 1 --2- 172.21.15.99:0/42549936 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564b407c7180 0x564b407902c0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f0cf80128a0 tx=0x7f0cf8012d60 comp rx=0 tx=0).stop 2024-02-21T23:12:48.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.970+0000 7f0d1046c740 1 -- 172.21.15.99:0/42549936 shutdown_connections 2024-02-21T23:12:48.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.970+0000 7f0d1046c740 1 --2- 172.21.15.99:0/42549936 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x564b407c1060 0x564b407d3fa0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:48.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.970+0000 7f0d1046c740 1 --2- 172.21.15.99:0/42549936 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b407c3ee0 0x564b4077ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:48.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.970+0000 7f0d1046c740 1 --2- 172.21.15.99:0/42549936 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b407c7b40 0x564b40792ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:48.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.970+0000 7f0d1046c740 1 --2- 172.21.15.99:0/42549936 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564b407c7180 0x564b407902c0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:48.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.970+0000 7f0d1046c740 1 -- 172.21.15.99:0/42549936 >> 172.21.15.99:0/42549936 conn(0x564b4078c4b0 msgr2=0x564b40797c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:48.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.970+0000 7f0ce7400640 0 client.7143 ms_handle_reset on v2:172.21.15.99:6834/2243461688 2024-02-21T23:12:48.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.970+0000 7f0d1046c740 1 -- 172.21.15.99:0/42549936 shutdown_connections 2024-02-21T23:12:48.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.970+0000 7f0d1046c740 1 -- 172.21.15.99:0/42549936 wait complete. 2024-02-21T23:12:48.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.970+0000 7f0d1046c740 20 client.7143 trim_cache size 0 max 16384 2024-02-21T23:12:48.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.984+0000 7f0d1046c740 1 Processor -- start 2024-02-21T23:12:48.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.984+0000 7f0d1046c740 1 -- start start 2024-02-21T23:12:48.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.986+0000 7f0d1046c740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b407c3ee0 0x564b407929d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:48.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.986+0000 7f0d1046c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b407c7180 0x564b40772a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:48.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.986+0000 7f0d1046c740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564b407c7b40 0x564b407465d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:48.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.986+0000 7f0d1046c740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d08228c90 con 0x564b407c7b40 2024-02-21T23:12:48.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.986+0000 7f0d1046c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d080e62d0 con 0x564b407c7180 2024-02-21T23:12:48.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.986+0000 7f0d1046c740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d080fabd0 con 0x564b407c3ee0 2024-02-21T23:12:48.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.987+0000 7f0d06000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b407c7180 0x564b40772a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:48.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.987+0000 7f0d07400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564b407c7b40 0x564b407465d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:48.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.987+0000 7f0d06000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b407c7180 0x564b40772a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:59716/0 (socket says 172.21.15.99:59716) 2024-02-21T23:12:48.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.987+0000 7f0d06000640 1 -- 172.21.15.99:0/1169529962 learned_addr learned my addr 172.21.15.99:0/1169529962 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:12:48.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.987+0000 7f0d06a00640 1 --2- 172.21.15.99:0/1169529962 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b407c3ee0 0x564b407929d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:48.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.987+0000 7f0d06000640 1 -- 172.21.15.99:0/1169529962 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b407c3ee0 msgr2=0x564b407929d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:48.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.987+0000 7f0d06000640 1 --2- 172.21.15.99:0/1169529962 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b407c3ee0 0x564b407929d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:48.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.987+0000 7f0d06000640 1 -- 172.21.15.99:0/1169529962 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564b407c7b40 msgr2=0x564b407465d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:48.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.987+0000 7f0d06000640 1 --2- 172.21.15.99:0/1169529962 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564b407c7b40 0x564b407465d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:48.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.987+0000 7f0d06000640 1 -- 172.21.15.99:0/1169529962 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564b404937d0 con 0x564b407c7180 2024-02-21T23:12:48.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.987+0000 7f0d06000640 1 --2- 172.21.15.99:0/1169529962 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b407c7180 0x564b40772a60 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f0cf40e96c0 tx=0x7f0cf403c000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d6c39ef42ef6219 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:48.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.987+0000 7f0cf2600640 1 -- 172.21.15.99:0/1169529962 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf40b9410 con 0x564b407c7180 2024-02-21T23:12:48.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.988+0000 7f0cf2600640 1 -- 172.21.15.99:0/1169529962 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cf40b7710 con 0x564b407c7180 2024-02-21T23:12:48.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.988+0000 7f0cf2600640 1 -- 172.21.15.99:0/1169529962 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf40b5a80 con 0x564b407c7180 2024-02-21T23:12:48.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.988+0000 7f0d1046c740 1 -- 172.21.15.99:0/1169529962 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b407c7180 msgr2=0x564b40772a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:48.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.988+0000 7f0d1046c740 1 --2- 172.21.15.99:0/1169529962 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b407c7180 0x564b40772a60 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f0cf40e96c0 tx=0x7f0cf403c000 comp rx=0 tx=0).stop 2024-02-21T23:12:48.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.988+0000 7f0d1046c740 1 -- 172.21.15.99:0/1169529962 shutdown_connections 2024-02-21T23:12:48.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.988+0000 7f0d1046c740 1 --2- 172.21.15.99:0/1169529962 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564b407c7b40 0x564b407465d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:48.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.988+0000 7f0d1046c740 1 --2- 172.21.15.99:0/1169529962 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b407c7180 0x564b40772a60 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:48.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.988+0000 7f0d1046c740 1 --2- 172.21.15.99:0/1169529962 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b407c3ee0 0x564b407929d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:48.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.988+0000 7f0d1046c740 1 -- 172.21.15.99:0/1169529962 >> 172.21.15.99:0/1169529962 conn(0x564b4078c4b0 msgr2=0x564b407bbe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:48.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.989+0000 7f0d1046c740 1 -- 172.21.15.99:0/1169529962 shutdown_connections 2024-02-21T23:12:48.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.989+0000 7f0d1046c740 1 -- 172.21.15.99:0/1169529962 wait complete. 2024-02-21T23:12:48.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.990+0000 7f0d1046c740 1 -- start start 2024-02-21T23:12:48.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.990+0000 7f0d1046c740 1 Processor -- start 2024-02-21T23:12:48.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.992+0000 7f0d1046c740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b407c3ee0 0x564b407d0a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:48.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.992+0000 7f0d1046c740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564b407c7180 0x564b4077c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:48.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.992+0000 7f0d1046c740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b407c7b40 0x564b4081f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:48.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.992+0000 7f0d1046c740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d080e49d0 con 0x564b407c7180 2024-02-21T23:12:48.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.992+0000 7f0d1046c740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d080e5c70 con 0x564b407c7b40 2024-02-21T23:12:48.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.992+0000 7f0d1046c740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d080e4fd0 con 0x564b407c3ee0 2024-02-21T23:12:48.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.992+0000 7f0d1046c740 10 client.0 _ll_register_callbacks cb 0x7f0cf8001770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:12:48.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.993+0000 7f0d06a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b407c3ee0 0x564b407d0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:48.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.993+0000 7f0d06000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564b407c7180 0x564b4077c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:48.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.993+0000 7f0d07400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b407c7b40 0x564b4081f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:48.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.993+0000 7f0d06000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564b407c7180 0x564b4077c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:39954/0 (socket says 172.21.15.99:39954) 2024-02-21T23:12:48.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.993+0000 7f0d06000640 1 -- 172.21.15.99:0/376411928 learned_addr learned my addr 172.21.15.99:0/376411928 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:12:48.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.993+0000 7f0d06a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b407c3ee0 0x564b407d0a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:47448/0 (socket says 172.21.15.99:47448) 2024-02-21T23:12:48.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.993+0000 7f0d06000640 1 -- 172.21.15.99:0/376411928 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b407c3ee0 msgr2=0x564b407d0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:48.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.993+0000 7f0d06000640 1 --2- 172.21.15.99:0/376411928 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b407c3ee0 0x564b407d0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:48.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.993+0000 7f0d06000640 1 -- 172.21.15.99:0/376411928 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b407c7b40 msgr2=0x564b4081f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:48.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.993+0000 7f0d06000640 1 --2- 172.21.15.99:0/376411928 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b407c7b40 0x564b4081f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:48.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.993+0000 7f0d06000640 1 -- 172.21.15.99:0/376411928 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564b407d1180 con 0x564b407c7180 2024-02-21T23:12:48.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.993+0000 7f0d06a00640 1 --2- 172.21.15.99:0/376411928 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b407c3ee0 0x564b407d0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:12:48.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.993+0000 7f0d06000640 1 --2- 172.21.15.99:0/376411928 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564b407c7180 0x564b4077c680 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f0cf4006a30 tx=0x7f0cf40069c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee7e505593a2bffc server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:48.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.993+0000 7f0ce7400640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:12:48.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.994+0000 7f0ce7400640 1 -- 172.21.15.99:0/376411928 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf40e7060 con 0x564b407c7180 2024-02-21T23:12:48.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.994+0000 7f0ce7400640 1 -- 172.21.15.99:0/376411928 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f0cf40e92b0 con 0x564b407c7180 2024-02-21T23:12:48.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.994+0000 7f0d1046c740 1 -- 172.21.15.99:0/376411928 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0cf40b7710 con 0x564b407c7180 2024-02-21T23:12:48.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.994+0000 7f0ce7400640 1 -- 172.21.15.99:0/376411928 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0cf40e94b0 con 0x564b407c7180 2024-02-21T23:12:48.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.994+0000 7f0d1046c740 10 client.7149 fetch_fsmap learned FSMap version 17 2024-02-21T23:12:48.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.994+0000 7f0d1046c740 1 -- 172.21.15.99:0/376411928 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x564b407d1180 con 0x564b407c7180 2024-02-21T23:12:48.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.994+0000 7f0ce7400640 1 -- 172.21.15.99:0/376411928 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cf40b7710 con 0x564b407c7180 2024-02-21T23:12:48.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.994+0000 7f0ce7400640 1 -- 172.21.15.99:0/376411928 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f0cf404e030 con 0x564b407c7180 2024-02-21T23:12:48.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.995+0000 7f0d1046c740 10 client.7149 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:12:48.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.995+0000 7f0d1046c740 10 client.7149 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.d 2024-02-21T23:12:48.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.995+0000 7f0d1046c740 20 client.7149 populate_metadata read hostname 'smithi099' 2024-02-21T23:12:48.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.995+0000 7f0d1046c740 1 --2- 172.21.15.99:0/376411928 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x564b407bcd60 0x564b4081fb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:48.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.995+0000 7f0d1046c740 4 client.7149 mds_command: new command op to 4348 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T23:12:48.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.995+0000 7f0d1046c740 1 -- 172.21.15.99:0/376411928 --> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x564b406bc3e0 con 0x564b407bcd60 2024-02-21T23:12:48.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.995+0000 7f0d06a00640 1 --2- 172.21.15.99:0/376411928 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x564b407bcd60 0x564b4081fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:48.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.996+0000 7f0d06a00640 1 --2- 172.21.15.99:0/376411928 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x564b407bcd60 0x564b4081fb30 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f2c67fc840c8549f server_cookie=84ac853ba20e4955 in_seq=0 out_seq=0 2024-02-21T23:12:48.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.996+0000 7f0ce7400640 10 client.7149 ms_handle_connect on v2:172.21.15.99:6834/2243461688 2024-02-21T23:12:48.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.996+0000 7f0ce7400640 1 -- 172.21.15.99:0/376411928 <== mds.2 v2:172.21.15.99:6834/2243461688 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x564b406bc3e0 con 0x564b407bcd60 2024-02-21T23:12:48.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.996+0000 7f0ce7400640 10 client.7149 handle_command_reply: tid=0 2024-02-21T23:12:48.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.996+0000 7f0d1046c740 1 client.7149 shutdown 2024-02-21T23:12:48.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.996+0000 7f0d1046c740 1 -- 172.21.15.99:0/376411928 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564b407c7180 msgr2=0x564b4077c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:48.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.996+0000 7f0d1046c740 1 --2- 172.21.15.99:0/376411928 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564b407c7180 0x564b4077c680 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f0cf4006a30 tx=0x7f0cf40069c0 comp rx=0 tx=0).stop 2024-02-21T23:12:48.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.996+0000 7f0d1046c740 1 -- 172.21.15.99:0/376411928 shutdown_connections 2024-02-21T23:12:48.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.996+0000 7f0d1046c740 1 --2- 172.21.15.99:0/376411928 >> [v2:172.21.15.99:6834/2243461688,v1:172.21.15.99:6835/2243461688] conn(0x564b407bcd60 0x564b4081fb30 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:48.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.996+0000 7f0d1046c740 1 --2- 172.21.15.99:0/376411928 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564b407c7b40 0x564b4081f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:48.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.996+0000 7f0d1046c740 1 --2- 172.21.15.99:0/376411928 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x564b407c7180 0x564b4077c680 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:48.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.996+0000 7f0d1046c740 1 --2- 172.21.15.99:0/376411928 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x564b407c3ee0 0x564b407d0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:48.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.996+0000 7f0d1046c740 1 -- 172.21.15.99:0/376411928 >> 172.21.15.99:0/376411928 conn(0x564b4078c4b0 msgr2=0x564b40749f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:48.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.996+0000 7f0ce7400640 0 client.7149 ms_handle_reset on v2:172.21.15.99:6834/2243461688 2024-02-21T23:12:48.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.996+0000 7f0d1046c740 1 -- 172.21.15.99:0/376411928 shutdown_connections 2024-02-21T23:12:48.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.996+0000 7f0d1046c740 1 -- 172.21.15.99:0/376411928 wait complete. 2024-02-21T23:12:48.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.997+0000 7f0d1046c740 20 client.7149 trim_cache size 0 max 16384 2024-02-21T23:12:48.992 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-02-21T23:12:48.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.997+0000 7f0d0d600640 1 -- 172.21.15.99:0/241057444 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f0ce809ef00 msgr2=0x7f0ce80a13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:48.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.997+0000 7f0d0d600640 1 --2- 172.21.15.99:0/241057444 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f0ce809ef00 0x7f0ce80a13c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0d00007440 tx=0x7f0d0000b040 comp rx=0 tx=0).stop 2024-02-21T23:12:48.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.997+0000 7f0d0d600640 1 -- 172.21.15.99:0/241057444 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d08186680 msgr2=0x7f0d08220f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:48.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.997+0000 7f0d0d600640 1 --2- 172.21.15.99:0/241057444 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d08186680 0x7f0d08220f80 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f0cf4009860 tx=0x7f0cf40046c0 comp rx=0 tx=0).stop 2024-02-21T23:12:48.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.998+0000 7f0d0d600640 1 -- 172.21.15.99:0/241057444 shutdown_connections 2024-02-21T23:12:48.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.998+0000 7f0d0d600640 1 --2- 172.21.15.99:0/241057444 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f0ce809ef00 0x7f0ce80a13c0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:48.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.998+0000 7f0d0d600640 1 --2- 172.21.15.99:0/241057444 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d08159960 0x7f0d082214c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:48.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.998+0000 7f0d0d600640 1 --2- 172.21.15.99:0/241057444 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0d08186680 0x7f0d08220f80 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:48.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.998+0000 7f0d0d600640 1 --2- 172.21.15.99:0/241057444 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0d080f6340 0x7f0d081746b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:48.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.998+0000 7f0d0d600640 1 -- 172.21.15.99:0/241057444 >> 172.21.15.99:0/241057444 conn(0x7f0d080cf780 msgr2=0x7f0d08074940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:48.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.998+0000 7f0d0d600640 1 -- 172.21.15.99:0/241057444 shutdown_connections 2024-02-21T23:12:48.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:48.998+0000 7f0d0d600640 1 -- 172.21.15.99:0/241057444 wait complete. 2024-02-21T23:12:49.004 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T23:12:49.004 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-02-21T23:12:49.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.199+0000 7f6b5e600640 1 Processor -- start 2024-02-21T23:12:49.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.199+0000 7f6b5e600640 1 -- start start 2024-02-21T23:12:49.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.201+0000 7f6b5e600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f6b580f8f20 0x7f6b5818a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:49.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.201+0000 7f6b5e600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f6b5818aaa0 0x7f6b580cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:49.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.201+0000 7f6b5e600640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b580f9540 con 0x7f6b5817f7b0 2024-02-21T23:12:49.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.201+0000 7f6b5e600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b580f9820 con 0x7f6b5818aaa0 2024-02-21T23:12:49.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.201+0000 7f6b5e600640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b580f9b00 con 0x7f6b580f8f20 2024-02-21T23:12:49.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.201+0000 7f6b57400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f6b5817f7b0 0x7f6b580facd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:54794/0 (socket says 172.21.15.99:54794) 2024-02-21T23:12:49.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.201+0000 7f6b57400640 1 -- 172.21.15.99:0/983486585 learned_addr learned my addr 172.21.15.99:0/983486585 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:12:49.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.201+0000 7f6b56a00640 1 --2- 172.21.15.99:0/983486585 >> v2:172.21.15.162:3300/0 conn(0x7f6b580f8f20 0x7f6b5818a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:49.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.201+0000 7f6b57e00640 1 --2- 172.21.15.99:0/983486585 >> v2:172.21.15.99:3300/0 conn(0x7f6b5818aaa0 0x7f6b580cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:49.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.202+0000 7f6b56a00640 1 -- 172.21.15.99:0/983486585 >> v2:172.21.15.99:3300/0 conn(0x7f6b5818aaa0 msgr2=0x7f6b580cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:49.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.202+0000 7f6b56a00640 1 --2- 172.21.15.99:0/983486585 >> v2:172.21.15.99:3300/0 conn(0x7f6b5818aaa0 0x7f6b580cef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:49.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.202+0000 7f6b56a00640 1 -- 172.21.15.99:0/983486585 >> v1:172.21.15.99:6789/0 conn(0x7f6b5817f7b0 legacy=0x7f6b580facd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:49.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.202+0000 7f6b56a00640 1 -- 172.21.15.99:0/983486585 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b580f9de0 con 0x7f6b580f8f20 2024-02-21T23:12:49.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.203+0000 7f6b56a00640 1 --2- 172.21.15.99:0/983486585 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b580f8f20 0x7f6b5818a560 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f6b580d6580 tx=0x7f6b4402b710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=438d9566fa6230aa server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:49.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.203+0000 7f6b56000640 1 -- 172.21.15.99:0/983486585 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b44037070 con 0x7f6b580f8f20 2024-02-21T23:12:49.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.203+0000 7f6b56000640 1 -- 172.21.15.99:0/983486585 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b44030710 con 0x7f6b580f8f20 2024-02-21T23:12:49.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.203+0000 7f6b56000640 1 -- 172.21.15.99:0/983486585 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b44030ae0 con 0x7f6b580f8f20 2024-02-21T23:12:49.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.204+0000 7f6b5e600640 1 -- 172.21.15.99:0/983486585 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b580f8f20 msgr2=0x7f6b5818a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:49.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.204+0000 7f6b5e600640 1 --2- 172.21.15.99:0/983486585 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b580f8f20 0x7f6b5818a560 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f6b580d6580 tx=0x7f6b4402b710 comp rx=0 tx=0).stop 2024-02-21T23:12:49.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.204+0000 7f6b5e600640 1 -- 172.21.15.99:0/983486585 shutdown_connections 2024-02-21T23:12:49.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.204+0000 7f6b5e600640 1 --2- 172.21.15.99:0/983486585 >> v2:172.21.15.99:3300/0 conn(0x7f6b5818aaa0 0x7f6b580cef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:49.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.204+0000 7f6b5e600640 1 --2- 172.21.15.99:0/983486585 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b580f8f20 0x7f6b5818a560 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:49.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.204+0000 7f6b5e600640 1 -- 172.21.15.99:0/983486585 >> 172.21.15.99:0/983486585 conn(0x7f6b580740b0 msgr2=0x7f6b580744c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:49.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.204+0000 7f6b5e600640 1 -- 172.21.15.99:0/983486585 shutdown_connections 2024-02-21T23:12:49.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.204+0000 7f6b5e600640 1 -- 172.21.15.99:0/983486585 wait complete. 2024-02-21T23:12:49.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.207+0000 7f6b5e600640 1 Processor -- start 2024-02-21T23:12:49.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.208+0000 7f6b5e600640 1 -- start start 2024-02-21T23:12:49.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.210+0000 7f6b5e600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6b580f8f20 0x7f6b5816b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:49.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.210+0000 7f6b5e600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6b5817f7b0 0x7f6b5816be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:49.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.210+0000 7f6b5e600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b5818aaa0 0x7f6b58179b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:49.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.210+0000 7f6b5e600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5818aeb0 con 0x7f6b580f8f20 2024-02-21T23:12:49.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.210+0000 7f6b5e600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5818a040 con 0x7f6b5818aaa0 2024-02-21T23:12:49.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.210+0000 7f6b5e600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5818b030 con 0x7f6b5817f7b0 2024-02-21T23:12:49.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.210+0000 7f6b57400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6b580f8f20 0x7f6b5816b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:49.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.210+0000 7f6b57400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6b580f8f20 0x7f6b5816b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:39968/0 (socket says 172.21.15.99:39968) 2024-02-21T23:12:49.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.210+0000 7f6b57400640 1 -- 172.21.15.99:0/906683258 learned_addr learned my addr 172.21.15.99:0/906683258 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:12:49.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.210+0000 7f6b56a00640 1 --2- 172.21.15.99:0/906683258 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6b5817f7b0 0x7f6b5816be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:49.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.210+0000 7f6b57e00640 1 --2- 172.21.15.99:0/906683258 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b5818aaa0 0x7f6b58179b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:49.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.211+0000 7f6b57400640 1 -- 172.21.15.99:0/906683258 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6b5817f7b0 msgr2=0x7f6b5816be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:49.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.211+0000 7f6b57400640 1 --2- 172.21.15.99:0/906683258 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6b5817f7b0 0x7f6b5816be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:49.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.211+0000 7f6b57400640 1 -- 172.21.15.99:0/906683258 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b5818aaa0 msgr2=0x7f6b58179b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:49.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.211+0000 7f6b57400640 1 --2- 172.21.15.99:0/906683258 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b5818aaa0 0x7f6b58179b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:49.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.211+0000 7f6b57400640 1 -- 172.21.15.99:0/906683258 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b58215420 con 0x7f6b580f8f20 2024-02-21T23:12:49.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.211+0000 7f6b56a00640 1 --2- 172.21.15.99:0/906683258 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6b5817f7b0 0x7f6b5816be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:12:49.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.211+0000 7f6b57e00640 1 --2- 172.21.15.99:0/906683258 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b5818aaa0 0x7f6b58179b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:12:49.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.211+0000 7f6b57400640 1 --2- 172.21.15.99:0/906683258 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6b580f8f20 0x7f6b5816b900 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f6b4800caf0 tx=0x7f6b48002120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:49.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.211+0000 7f6b4f400640 1 -- 172.21.15.99:0/906683258 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b48018070 con 0x7f6b580f8f20 2024-02-21T23:12:49.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.211+0000 7f6b4f400640 1 -- 172.21.15.99:0/906683258 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b4800a760 con 0x7f6b580f8f20 2024-02-21T23:12:49.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.211+0000 7f6b5e600640 1 -- 172.21.15.99:0/906683258 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b58215700 con 0x7f6b580f8f20 2024-02-21T23:12:49.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.211+0000 7f6b4f400640 1 -- 172.21.15.99:0/906683258 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b4800ab90 con 0x7f6b580f8f20 2024-02-21T23:12:49.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.212+0000 7f6b5e600640 1 -- 172.21.15.99:0/906683258 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b58215cc0 con 0x7f6b580f8f20 2024-02-21T23:12:49.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.216+0000 7f6b4f400640 1 -- 172.21.15.99:0/906683258 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f6b4801b070 con 0x7f6b580f8f20 2024-02-21T23:12:49.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.217+0000 7f6b613f9740 1 Processor -- start 2024-02-21T23:12:49.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.217+0000 7f6b613f9740 1 -- start start 2024-02-21T23:12:49.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.218+0000 7f6b4f400640 1 --2- 172.21.15.99:0/906683258 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f6b3809ef00 0x7f6b380a13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:49.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.218+0000 7f6b4f400640 1 -- 172.21.15.99:0/906683258 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f6b480c9640 con 0x7f6b580f8f20 2024-02-21T23:12:49.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.218+0000 7f6b57e00640 1 --2- 172.21.15.99:0/906683258 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f6b3809ef00 0x7f6b380a13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:49.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.219+0000 7f6b613f9740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556231a584b0 0x556231a58890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:49.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.219+0000 7f6b57e00640 1 --2- 172.21.15.99:0/906683258 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f6b3809ef00 0x7f6b380a13c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6b50009e90 tx=0x7f6b50009190 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:49.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.219+0000 7f6b613f9740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556231a93180 0x556231a93600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:49.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.219+0000 7f6b613f9740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556231a93b40 0x556231a943b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:49.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.219+0000 7f6b613f9740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x556231980b50 con 0x556231a93b40 2024-02-21T23:12:49.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.219+0000 7f6b613f9740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x556231929da0 con 0x556231a93180 2024-02-21T23:12:49.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.219+0000 7f6b613f9740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x55623197cbf0 con 0x556231a584b0 2024-02-21T23:12:49.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.219+0000 7f6b56a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556231a93180 0x556231a93600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:49.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.219+0000 7f6b57400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556231a584b0 0x556231a58890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:49.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.219+0000 7f6b57e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556231a93b40 0x556231a943b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:49.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.219+0000 7f6b56a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556231a93180 0x556231a93600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:59744/0 (socket says 172.21.15.99:59744) 2024-02-21T23:12:49.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.219+0000 7f6b56a00640 1 -- 172.21.15.99:0/2588311541 learned_addr learned my addr 172.21.15.99:0/2588311541 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:12:49.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.220+0000 7f6b56a00640 1 -- 172.21.15.99:0/2588311541 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556231a584b0 msgr2=0x556231a58890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:49.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.220+0000 7f6b56a00640 1 --2- 172.21.15.99:0/2588311541 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556231a584b0 0x556231a58890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:49.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.220+0000 7f6b56a00640 1 -- 172.21.15.99:0/2588311541 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556231a93b40 msgr2=0x556231a943b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:49.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.220+0000 7f6b56a00640 1 --2- 172.21.15.99:0/2588311541 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556231a93b40 0x556231a943b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:49.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.220+0000 7f6b56a00640 1 -- 172.21.15.99:0/2588311541 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55623194cf80 con 0x556231a93180 2024-02-21T23:12:49.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.220+0000 7f6b57e00640 1 --2- 172.21.15.99:0/2588311541 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556231a93b40 0x556231a943b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:12:49.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.220+0000 7f6b57400640 1 --2- 172.21.15.99:0/2588311541 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556231a584b0 0x556231a58890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:12:49.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.220+0000 7f6b56a00640 1 --2- 172.21.15.99:0/2588311541 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556231a93180 0x556231a93600 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f6b44009890 tx=0x7f6b4402f000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b30ad9934e7c23fb server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:49.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.221+0000 7f6b43e00640 1 -- 172.21.15.99:0/2588311541 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b44037040 con 0x556231a93180 2024-02-21T23:12:49.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.221+0000 7f6b43e00640 1 -- 172.21.15.99:0/2588311541 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b44030e70 con 0x556231a93180 2024-02-21T23:12:49.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.221+0000 7f6b43e00640 1 -- 172.21.15.99:0/2588311541 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b4403c610 con 0x556231a93180 2024-02-21T23:12:49.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.223+0000 7f6b613f9740 1 -- 172.21.15.99:0/2588311541 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556231a93180 msgr2=0x556231a93600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:49.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.223+0000 7f6b613f9740 1 --2- 172.21.15.99:0/2588311541 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556231a93180 0x556231a93600 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f6b44009890 tx=0x7f6b4402f000 comp rx=0 tx=0).stop 2024-02-21T23:12:49.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.223+0000 7f6b613f9740 1 -- 172.21.15.99:0/2588311541 shutdown_connections 2024-02-21T23:12:49.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.223+0000 7f6b613f9740 1 --2- 172.21.15.99:0/2588311541 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556231a93b40 0x556231a943b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:49.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.223+0000 7f6b613f9740 1 --2- 172.21.15.99:0/2588311541 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556231a93180 0x556231a93600 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:49.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.223+0000 7f6b613f9740 1 --2- 172.21.15.99:0/2588311541 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556231a584b0 0x556231a58890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:49.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.223+0000 7f6b613f9740 1 -- 172.21.15.99:0/2588311541 >> 172.21.15.99:0/2588311541 conn(0x556231a1a520 msgr2=0x556231a1b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:49.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.223+0000 7f6b613f9740 1 -- 172.21.15.99:0/2588311541 shutdown_connections 2024-02-21T23:12:49.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.223+0000 7f6b613f9740 1 -- 172.21.15.99:0/2588311541 wait complete. 2024-02-21T23:12:49.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.225+0000 7f6b613f9740 1 -- start start 2024-02-21T23:12:49.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.225+0000 7f6b613f9740 1 Processor -- start 2024-02-21T23:12:49.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.227+0000 7f6b613f9740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556231a93180 0x556231a527d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:49.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.227+0000 7f6b613f9740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556231a93b40 0x556231a51ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:49.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.227+0000 7f6b613f9740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556231a634d0 0x556231a53160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:49.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.227+0000 7f6b613f9740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x556231a91ef0 con 0x556231a93b40 2024-02-21T23:12:49.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.227+0000 7f6b613f9740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55623191f380 con 0x556231a634d0 2024-02-21T23:12:49.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.227+0000 7f6b613f9740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x556231a91c10 con 0x556231a93180 2024-02-21T23:12:49.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.227+0000 7f6b613f9740 10 client.0 _ll_register_callbacks cb 0x556231978280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:12:49.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.228+0000 7f6b56a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556231a93b40 0x556231a51ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:49.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.228+0000 7f6b57400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556231a93180 0x556231a527d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:49.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.228+0000 7f6b56a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556231a93b40 0x556231a51ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:39988/0 (socket says 172.21.15.99:39988) 2024-02-21T23:12:49.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.228+0000 7f6b56a00640 1 -- 172.21.15.99:0/1168978704 learned_addr learned my addr 172.21.15.99:0/1168978704 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:12:49.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.228+0000 7f6b57e00640 1 --2- 172.21.15.99:0/1168978704 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556231a634d0 0x556231a53160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:49.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.228+0000 7f6b57400640 1 -- 172.21.15.99:0/1168978704 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556231a634d0 msgr2=0x556231a53160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:49.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.228+0000 7f6b57400640 1 --2- 172.21.15.99:0/1168978704 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556231a634d0 0x556231a53160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:49.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.228+0000 7f6b57400640 1 -- 172.21.15.99:0/1168978704 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556231a93b40 msgr2=0x556231a51ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:49.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.228+0000 7f6b57400640 1 --2- 172.21.15.99:0/1168978704 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556231a93b40 0x556231a51ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:49.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.228+0000 7f6b57400640 1 -- 172.21.15.99:0/1168978704 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556231947c20 con 0x556231a93180 2024-02-21T23:12:49.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.228+0000 7f6b56a00640 1 --2- 172.21.15.99:0/1168978704 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556231a93b40 0x556231a51ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:12:49.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.228+0000 7f6b57400640 1 --2- 172.21.15.99:0/1168978704 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556231a93180 0x556231a527d0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f6b480c6d40 tx=0x7f6b4809f690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3aa512a96c44e0f3 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:49.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.228+0000 7f6b40c00640 10 client.0 ms_handle_connect on v2:172.21.15.181:3300/0 2024-02-21T23:12:49.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.229+0000 7f6b40c00640 1 -- 172.21.15.99:0/1168978704 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b480963f0 con 0x556231a93180 2024-02-21T23:12:49.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.229+0000 7f6b613f9740 1 -- 172.21.15.99:0/1168978704 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6b44030e70 con 0x556231a93180 2024-02-21T23:12:49.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.229+0000 7f6b40c00640 1 -- 172.21.15.99:0/1168978704 <== mon.2 v2:172.21.15.181:3300/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f6b48096590 con 0x556231a93180 2024-02-21T23:12:49.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.229+0000 7f6b40c00640 1 -- 172.21.15.99:0/1168978704 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6b480b4420 con 0x556231a93180 2024-02-21T23:12:49.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.229+0000 7f6b613f9740 10 client.7316 fetch_fsmap learned FSMap version 17 2024-02-21T23:12:49.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.229+0000 7f6b613f9740 1 -- 172.21.15.99:0/1168978704 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5562316953f0 con 0x556231a93180 2024-02-21T23:12:49.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.229+0000 7f6b40c00640 1 -- 172.21.15.99:0/1168978704 <== mon.2 v2:172.21.15.181:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b44030e70 con 0x556231a93180 2024-02-21T23:12:49.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.229+0000 7f6b40c00640 1 -- 172.21.15.99:0/1168978704 <== mon.2 v2:172.21.15.181:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f6b48092cf0 con 0x556231a93180 2024-02-21T23:12:49.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.229+0000 7f6b613f9740 10 client.7316 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:12:49.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.229+0000 7f6b613f9740 10 client.7316 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2024-02-21T23:12:49.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.229+0000 7f6b613f9740 20 client.7316 populate_metadata read hostname 'smithi099' 2024-02-21T23:12:49.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.230+0000 7f6b613f9740 1 --2- 172.21.15.99:0/1168978704 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x556231a61a60 0x556231aa8630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:49.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.230+0000 7f6b613f9740 4 client.7316 mds_command: new command op to 4352 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:12:49.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.230+0000 7f6b613f9740 1 -- 172.21.15.99:0/1168978704 --> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55623198e090 con 0x556231a61a60 2024-02-21T23:12:49.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.230+0000 7f6b56a00640 1 --2- 172.21.15.99:0/1168978704 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x556231a61a60 0x556231aa8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:49.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.230+0000 7f6b56a00640 1 --2- 172.21.15.99:0/1168978704 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x556231a61a60 0x556231aa8630 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c97b61606081e68e server_cookie=eebcf90d36156bc7 in_seq=0 out_seq=0 2024-02-21T23:12:49.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.230+0000 7f6b40c00640 10 client.7316 ms_handle_connect on v2:172.21.15.99:6836/1676159950 2024-02-21T23:12:49.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.231+0000 7f6b40c00640 1 -- 172.21.15.99:0/1168978704 <== mds.1 v2:172.21.15.99:6836/1676159950 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x55623198e090 con 0x556231a61a60 2024-02-21T23:12:49.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.231+0000 7f6b40c00640 10 client.7316 handle_command_reply: tid=0 2024-02-21T23:12:49.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.231+0000 7f6b613f9740 1 client.7316 shutdown 2024-02-21T23:12:49.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.232+0000 7f6b613f9740 1 -- 172.21.15.99:0/1168978704 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556231a93180 msgr2=0x556231a527d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:49.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.232+0000 7f6b613f9740 1 --2- 172.21.15.99:0/1168978704 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556231a93180 0x556231a527d0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f6b480c6d40 tx=0x7f6b4809f690 comp rx=0 tx=0).stop 2024-02-21T23:12:49.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.232+0000 7f6b613f9740 1 -- 172.21.15.99:0/1168978704 shutdown_connections 2024-02-21T23:12:49.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.232+0000 7f6b613f9740 1 --2- 172.21.15.99:0/1168978704 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x556231a61a60 0x556231aa8630 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:49.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.232+0000 7f6b613f9740 1 --2- 172.21.15.99:0/1168978704 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556231a634d0 0x556231a53160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:49.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.232+0000 7f6b613f9740 1 --2- 172.21.15.99:0/1168978704 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556231a93b40 0x556231a51ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:49.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.232+0000 7f6b613f9740 1 --2- 172.21.15.99:0/1168978704 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556231a93180 0x556231a527d0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:49.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.232+0000 7f6b40c00640 0 client.7316 ms_handle_reset on v2:172.21.15.99:6836/1676159950 2024-02-21T23:12:49.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.232+0000 7f6b613f9740 1 -- 172.21.15.99:0/1168978704 >> 172.21.15.99:0/1168978704 conn(0x556231a584b0 msgr2=0x556231a63c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:49.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.232+0000 7f6b613f9740 1 -- 172.21.15.99:0/1168978704 shutdown_connections 2024-02-21T23:12:49.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.232+0000 7f6b613f9740 1 -- 172.21.15.99:0/1168978704 wait complete. 2024-02-21T23:12:49.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.232+0000 7f6b613f9740 20 client.7316 trim_cache size 0 max 16384 2024-02-21T23:12:49.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.246+0000 7f6b613f9740 1 Processor -- start 2024-02-21T23:12:49.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.246+0000 7f6b613f9740 1 -- start start 2024-02-21T23:12:49.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.247+0000 7f6b613f9740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556231a634d0 0x556231a4bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:49.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.247+0000 7f6b613f9740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556231a93180 0x556231a53e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:49.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.247+0000 7f6b613f9740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556231a93b40 0x556231af8200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:49.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.247+0000 7f6b613f9740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b58228960 con 0x556231a93180 2024-02-21T23:12:49.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.247+0000 7f6b613f9740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b58070060 con 0x556231a93b40 2024-02-21T23:12:49.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.247+0000 7f6b613f9740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b58223330 con 0x556231a634d0 2024-02-21T23:12:49.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.247+0000 7f6b56a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556231a93180 0x556231a53e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:49.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.247+0000 7f6b57400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556231a634d0 0x556231a4bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:49.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.247+0000 7f6b56a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556231a93180 0x556231a53e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40004/0 (socket says 172.21.15.99:40004) 2024-02-21T23:12:49.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.247+0000 7f6b57400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556231a634d0 0x556231a4bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:47482/0 (socket says 172.21.15.99:47482) 2024-02-21T23:12:49.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.247+0000 7f6b56a00640 1 -- 172.21.15.99:0/569075800 learned_addr learned my addr 172.21.15.99:0/569075800 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:12:49.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.247+0000 7f6b57e00640 1 --2- 172.21.15.99:0/569075800 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556231a93b40 0x556231af8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:49.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.248+0000 7f6b56a00640 1 -- 172.21.15.99:0/569075800 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556231a634d0 msgr2=0x556231a4bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:49.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.248+0000 7f6b56a00640 1 --2- 172.21.15.99:0/569075800 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556231a634d0 0x556231a4bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:49.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.248+0000 7f6b56a00640 1 -- 172.21.15.99:0/569075800 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556231a93b40 msgr2=0x556231af8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:49.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.248+0000 7f6b56a00640 1 --2- 172.21.15.99:0/569075800 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556231a93b40 0x556231af8200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:49.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.248+0000 7f6b56a00640 1 -- 172.21.15.99:0/569075800 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55623175f7d0 con 0x556231a93180 2024-02-21T23:12:49.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.248+0000 7f6b56a00640 1 --2- 172.21.15.99:0/569075800 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556231a93180 0x556231a53e50 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f6b4402bd20 tx=0x7f6b44030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a201ced1c1fd0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:49.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.248+0000 7f6b43400640 1 -- 172.21.15.99:0/569075800 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b44037040 con 0x556231a93180 2024-02-21T23:12:49.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.248+0000 7f6b43400640 1 -- 172.21.15.99:0/569075800 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b44030690 con 0x556231a93180 2024-02-21T23:12:49.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.248+0000 7f6b43400640 1 -- 172.21.15.99:0/569075800 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b44004350 con 0x556231a93180 2024-02-21T23:12:49.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.249+0000 7f6b613f9740 1 -- 172.21.15.99:0/569075800 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556231a93180 msgr2=0x556231a53e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:49.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.249+0000 7f6b613f9740 1 --2- 172.21.15.99:0/569075800 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556231a93180 0x556231a53e50 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f6b4402bd20 tx=0x7f6b44030000 comp rx=0 tx=0).stop 2024-02-21T23:12:49.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.249+0000 7f6b613f9740 1 -- 172.21.15.99:0/569075800 shutdown_connections 2024-02-21T23:12:49.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.249+0000 7f6b613f9740 1 --2- 172.21.15.99:0/569075800 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556231a93b40 0x556231af8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:49.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.249+0000 7f6b613f9740 1 --2- 172.21.15.99:0/569075800 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556231a93180 0x556231a53e50 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:49.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.249+0000 7f6b613f9740 1 --2- 172.21.15.99:0/569075800 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556231a634d0 0x556231a4bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:49.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.249+0000 7f6b613f9740 1 -- 172.21.15.99:0/569075800 >> 172.21.15.99:0/569075800 conn(0x556231a584b0 msgr2=0x556231a8fbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:49.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.249+0000 7f6b613f9740 1 -- 172.21.15.99:0/569075800 shutdown_connections 2024-02-21T23:12:49.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.249+0000 7f6b613f9740 1 -- 172.21.15.99:0/569075800 wait complete. 2024-02-21T23:12:49.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.250+0000 7f6b613f9740 1 -- start start 2024-02-21T23:12:49.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.251+0000 7f6b613f9740 1 Processor -- start 2024-02-21T23:12:49.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.253+0000 7f6b613f9740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556231a634d0 0x556231a53da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:49.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.253+0000 7f6b613f9740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556231a93180 0x556231a53160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:49.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.253+0000 7f6b613f9740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556231a93b40 0x556231af6970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:49.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.253+0000 7f6b613f9740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b580d56c0 con 0x556231a93180 2024-02-21T23:12:49.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.253+0000 7f6b613f9740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5806fa00 con 0x556231a634d0 2024-02-21T23:12:49.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.253+0000 7f6b613f9740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5806ed40 con 0x556231a93b40 2024-02-21T23:12:49.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.253+0000 7f6b613f9740 10 client.0 _ll_register_callbacks cb 0x7f6b48001250 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:12:49.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.253+0000 7f6b57400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556231a634d0 0x556231a53da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:49.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.253+0000 7f6b56a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556231a93180 0x556231a53160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:49.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.253+0000 7f6b57400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556231a634d0 0x556231a53da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:59780/0 (socket says 172.21.15.99:59780) 2024-02-21T23:12:49.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.253+0000 7f6b57400640 1 -- 172.21.15.99:0/884652444 learned_addr learned my addr 172.21.15.99:0/884652444 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:12:49.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.253+0000 7f6b57e00640 1 --2- 172.21.15.99:0/884652444 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556231a93b40 0x556231af6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:49.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.254+0000 7f6b57400640 1 -- 172.21.15.99:0/884652444 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556231a93b40 msgr2=0x556231af6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:49.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.254+0000 7f6b57400640 1 --2- 172.21.15.99:0/884652444 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556231a93b40 0x556231af6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:49.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.254+0000 7f6b57400640 1 -- 172.21.15.99:0/884652444 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556231a93180 msgr2=0x556231a53160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:49.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.254+0000 7f6b57400640 1 --2- 172.21.15.99:0/884652444 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556231a93180 0x556231a53160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:49.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.254+0000 7f6b57400640 1 -- 172.21.15.99:0/884652444 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556231b084f0 con 0x556231a634d0 2024-02-21T23:12:49.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.254+0000 7f6b57e00640 1 --2- 172.21.15.99:0/884652444 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556231a93b40 0x556231af6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T23:12:49.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.254+0000 7f6b57400640 1 --2- 172.21.15.99:0/884652444 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556231a634d0 0x556231a53da0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f6b48095250 tx=0x7f6b48000f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e4f03ae91bbb975 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:49.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.254+0000 7f6b40c00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-02-21T23:12:49.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.254+0000 7f6b40c00640 1 -- 172.21.15.99:0/884652444 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b4807c060 con 0x556231a634d0 2024-02-21T23:12:49.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.254+0000 7f6b40c00640 1 -- 172.21.15.99:0/884652444 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f6b480965f0 con 0x556231a634d0 2024-02-21T23:12:49.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.254+0000 7f6b613f9740 1 -- 172.21.15.99:0/884652444 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6b44030690 con 0x556231a634d0 2024-02-21T23:12:49.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.254+0000 7f6b40c00640 1 -- 172.21.15.99:0/884652444 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6b480800d0 con 0x556231a634d0 2024-02-21T23:12:49.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.255+0000 7f6b613f9740 10 client.7384 fetch_fsmap learned FSMap version 17 2024-02-21T23:12:49.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.255+0000 7f6b613f9740 1 -- 172.21.15.99:0/884652444 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x556231a8bcb0 con 0x556231a634d0 2024-02-21T23:12:49.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.255+0000 7f6b40c00640 1 -- 172.21.15.99:0/884652444 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b44030690 con 0x556231a634d0 2024-02-21T23:12:49.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.255+0000 7f6b40c00640 1 -- 172.21.15.99:0/884652444 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f6b48080270 con 0x556231a634d0 2024-02-21T23:12:49.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.255+0000 7f6b613f9740 10 client.7384 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:12:49.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.255+0000 7f6b613f9740 10 client.7384 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2024-02-21T23:12:49.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.255+0000 7f6b613f9740 20 client.7384 populate_metadata read hostname 'smithi099' 2024-02-21T23:12:49.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.255+0000 7f6b613f9740 1 --2- 172.21.15.99:0/884652444 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x556231a62570 0x556231b07820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:49.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.255+0000 7f6b613f9740 4 client.7384 mds_command: new command op to 4352 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T23:12:49.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.255+0000 7f6b613f9740 1 -- 172.21.15.99:0/884652444 --> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5562319883e0 con 0x556231a62570 2024-02-21T23:12:49.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.255+0000 7f6b56a00640 1 --2- 172.21.15.99:0/884652444 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x556231a62570 0x556231b07820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:49.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.256+0000 7f6b40c00640 10 client.7384 ms_handle_connect on v2:172.21.15.99:6836/1676159950 2024-02-21T23:12:49.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.256+0000 7f6b56a00640 1 --2- 172.21.15.99:0/884652444 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x556231a62570 0x556231b07820 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=df0705560fc643c4 server_cookie=46255e0a65ed9b70 in_seq=0 out_seq=0 2024-02-21T23:12:49.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.256+0000 7f6b40c00640 1 -- 172.21.15.99:0/884652444 <== mds.1 v2:172.21.15.99:6836/1676159950 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5562319883e0 con 0x556231a62570 2024-02-21T23:12:49.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.256+0000 7f6b40c00640 10 client.7384 handle_command_reply: tid=0 2024-02-21T23:12:49.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.256+0000 7f6b613f9740 1 client.7384 shutdown 2024-02-21T23:12:49.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.256+0000 7f6b613f9740 1 -- 172.21.15.99:0/884652444 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556231a634d0 msgr2=0x556231a53da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:49.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.256+0000 7f6b613f9740 1 --2- 172.21.15.99:0/884652444 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556231a634d0 0x556231a53da0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f6b48095250 tx=0x7f6b48000f40 comp rx=0 tx=0).stop 2024-02-21T23:12:49.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.257+0000 7f6b613f9740 1 -- 172.21.15.99:0/884652444 shutdown_connections 2024-02-21T23:12:49.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.257+0000 7f6b613f9740 1 --2- 172.21.15.99:0/884652444 >> [v2:172.21.15.99:6836/1676159950,v1:172.21.15.99:6837/1676159950] conn(0x556231a62570 0x556231b07820 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:49.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.257+0000 7f6b613f9740 1 --2- 172.21.15.99:0/884652444 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x556231a93b40 0x556231af6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:49.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.257+0000 7f6b613f9740 1 --2- 172.21.15.99:0/884652444 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x556231a93180 0x556231a53160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:49.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.257+0000 7f6b613f9740 1 --2- 172.21.15.99:0/884652444 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556231a634d0 0x556231a53da0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:49.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.257+0000 7f6b40c00640 0 client.7384 ms_handle_reset on v2:172.21.15.99:6836/1676159950 2024-02-21T23:12:49.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.257+0000 7f6b613f9740 1 -- 172.21.15.99:0/884652444 >> 172.21.15.99:0/884652444 conn(0x556231a584b0 msgr2=0x556231a913a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:49.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.257+0000 7f6b613f9740 1 -- 172.21.15.99:0/884652444 shutdown_connections 2024-02-21T23:12:49.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.257+0000 7f6b613f9740 1 -- 172.21.15.99:0/884652444 wait complete. 2024-02-21T23:12:49.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.257+0000 7f6b613f9740 20 client.7384 trim_cache size 0 max 16384 2024-02-21T23:12:49.251 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-02-21T23:12:49.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.258+0000 7f6b5e600640 1 -- 172.21.15.99:0/906683258 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f6b3809ef00 msgr2=0x7f6b380a13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:49.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.258+0000 7f6b5e600640 1 --2- 172.21.15.99:0/906683258 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f6b3809ef00 0x7f6b380a13c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6b50009e90 tx=0x7f6b50009190 comp rx=0 tx=0).stop 2024-02-21T23:12:49.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.258+0000 7f6b5e600640 1 -- 172.21.15.99:0/906683258 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6b580f8f20 msgr2=0x7f6b5816b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:49.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.258+0000 7f6b5e600640 1 --2- 172.21.15.99:0/906683258 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6b580f8f20 0x7f6b5816b900 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f6b4800caf0 tx=0x7f6b48002120 comp rx=0 tx=0).stop 2024-02-21T23:12:49.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.258+0000 7f6b5e600640 1 -- 172.21.15.99:0/906683258 shutdown_connections 2024-02-21T23:12:49.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.258+0000 7f6b5e600640 1 --2- 172.21.15.99:0/906683258 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f6b3809ef00 0x7f6b380a13c0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:49.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.258+0000 7f6b5e600640 1 --2- 172.21.15.99:0/906683258 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b5818aaa0 0x7f6b58179b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:49.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.258+0000 7f6b5e600640 1 --2- 172.21.15.99:0/906683258 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f6b5817f7b0 0x7f6b5816be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:49.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.258+0000 7f6b5e600640 1 --2- 172.21.15.99:0/906683258 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f6b580f8f20 0x7f6b5816b900 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:49.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.258+0000 7f6b5e600640 1 -- 172.21.15.99:0/906683258 >> 172.21.15.99:0/906683258 conn(0x7f6b580740b0 msgr2=0x7f6b58074490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:49.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.258+0000 7f6b5e600640 1 -- 172.21.15.99:0/906683258 shutdown_connections 2024-02-21T23:12:49.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.258+0000 7f6b5e600640 1 -- 172.21.15.99:0/906683258 wait complete. 2024-02-21T23:12:49.264 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-02-21T23:12:49.265 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-02-21T23:12:49.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.471+0000 7f5c38c00640 1 Processor -- start 2024-02-21T23:12:49.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.471+0000 7f5c38c00640 1 -- start start 2024-02-21T23:12:49.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.474+0000 7f5c38c00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f5c3417f490 0x7f5c3418ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:49.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.474+0000 7f5c38c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5c3418b4f0 0x7f5c340fd290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:49.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.474+0000 7f5c38c00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c340d6dd0 con 0x7f5c3418b060 2024-02-21T23:12:49.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.474+0000 7f5c38c00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c341614c0 con 0x7f5c3417f490 2024-02-21T23:12:49.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.474+0000 7f5c38c00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c340d6810 con 0x7f5c3418b4f0 2024-02-21T23:12:49.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.474+0000 7f5c33400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f5c3417f490 0x7f5c3418ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:49.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.475+0000 7f5c33400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f5c3417f490 0x7f5c3418ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40032/0 (socket says 172.21.15.99:40032) 2024-02-21T23:12:49.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.475+0000 7f5c33400640 1 -- 172.21.15.99:0/2620763134 learned_addr learned my addr 172.21.15.99:0/2620763134 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:12:49.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.475+0000 7f5c33e00640 1 --2- 172.21.15.99:0/2620763134 >> v2:172.21.15.162:3300/0 conn(0x7f5c3418b4f0 0x7f5c340fd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:49.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.475+0000 7f5c33400640 1 -- 172.21.15.99:0/2620763134 >> v2:172.21.15.162:3300/0 conn(0x7f5c3418b4f0 msgr2=0x7f5c340fd290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:49.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.475+0000 7f5c33400640 1 --2- 172.21.15.99:0/2620763134 >> v2:172.21.15.162:3300/0 conn(0x7f5c3418b4f0 0x7f5c340fd290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:49.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.475+0000 7f5c33400640 1 -- 172.21.15.99:0/2620763134 >> v1:172.21.15.99:6789/0 conn(0x7f5c3418b060 legacy=0x7f5c34188a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:49.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.475+0000 7f5c33400640 1 -- 172.21.15.99:0/2620763134 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c340d6af0 con 0x7f5c3417f490 2024-02-21T23:12:49.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.475+0000 7f5c32000640 1 -- 172.21.15.99:0/2620763134 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1129241815 0 0) 0x7f5c340d6dd0 con 0x7f5c3418b060 2024-02-21T23:12:49.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.476+0000 7f5c33400640 1 --2- 172.21.15.99:0/2620763134 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5c3417f490 0x7f5c3418ab20 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f5c34186580 tx=0x7f5c2402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=393c472263d3f57b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:49.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.477+0000 7f5c32000640 1 -- 172.21.15.99:0/2620763134 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c24034070 con 0x7f5c3417f490 2024-02-21T23:12:49.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.477+0000 7f5c32000640 1 -- 172.21.15.99:0/2620763134 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c24030860 con 0x7f5c3417f490 2024-02-21T23:12:49.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.477+0000 7f5c32000640 1 -- 172.21.15.99:0/2620763134 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c24030c30 con 0x7f5c3417f490 2024-02-21T23:12:49.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.477+0000 7f5c38c00640 1 -- 172.21.15.99:0/2620763134 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5c3417f490 msgr2=0x7f5c3418ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:49.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.477+0000 7f5c38c00640 1 --2- 172.21.15.99:0/2620763134 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5c3417f490 0x7f5c3418ab20 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f5c34186580 tx=0x7f5c2402b9a0 comp rx=0 tx=0).stop 2024-02-21T23:12:49.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.478+0000 7f5c38c00640 1 -- 172.21.15.99:0/2620763134 shutdown_connections 2024-02-21T23:12:49.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.478+0000 7f5c38c00640 1 --2- 172.21.15.99:0/2620763134 >> v2:172.21.15.162:3300/0 conn(0x7f5c3418b4f0 0x7f5c340fd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:49.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.478+0000 7f5c38c00640 1 --2- 172.21.15.99:0/2620763134 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5c3417f490 0x7f5c3418ab20 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:49.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.478+0000 7f5c38c00640 1 -- 172.21.15.99:0/2620763134 >> 172.21.15.99:0/2620763134 conn(0x7f5c340d29b0 msgr2=0x7f5c340d2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:49.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.478+0000 7f5c38c00640 1 -- 172.21.15.99:0/2620763134 shutdown_connections 2024-02-21T23:12:49.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.478+0000 7f5c38c00640 1 -- 172.21.15.99:0/2620763134 wait complete. 2024-02-21T23:12:49.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.480+0000 7f5c38c00640 1 Processor -- start 2024-02-21T23:12:49.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.480+0000 7f5c38c00640 1 -- start start 2024-02-21T23:12:49.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.481+0000 7f5c38c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5c3417f490 0x7f5c34172cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:49.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.481+0000 7f5c38c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5c3418b060 0x7f5c3406b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:49.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.481+0000 7f5c38c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5c3418b4f0 0x7f5c3415ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:49.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.481+0000 7f5c38c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c3418a600 con 0x7f5c3418b060 2024-02-21T23:12:49.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.481+0000 7f5c38c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c3418a320 con 0x7f5c3417f490 2024-02-21T23:12:49.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.481+0000 7f5c38c00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c3417f870 con 0x7f5c3418b4f0 2024-02-21T23:12:49.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.481+0000 7f5c33400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5c3417f490 0x7f5c34172cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:49.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.481+0000 7f5c32a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5c3418b060 0x7f5c3406b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:49.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.481+0000 7f5c33400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5c3417f490 0x7f5c34172cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:59798/0 (socket says 172.21.15.99:59798) 2024-02-21T23:12:49.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.481+0000 7f5c33400640 1 -- 172.21.15.99:0/2042850721 learned_addr learned my addr 172.21.15.99:0/2042850721 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:12:49.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.482+0000 7f5c33e00640 1 --2- 172.21.15.99:0/2042850721 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5c3418b4f0 0x7f5c3415ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:49.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.482+0000 7f5c33400640 1 -- 172.21.15.99:0/2042850721 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5c3418b4f0 msgr2=0x7f5c3415ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:49.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.482+0000 7f5c33400640 1 --2- 172.21.15.99:0/2042850721 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5c3418b4f0 0x7f5c3415ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:49.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.482+0000 7f5c33400640 1 -- 172.21.15.99:0/2042850721 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5c3418b060 msgr2=0x7f5c3406b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:49.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.482+0000 7f5c33400640 1 --2- 172.21.15.99:0/2042850721 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5c3418b060 0x7f5c3406b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:49.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.482+0000 7f5c33400640 1 -- 172.21.15.99:0/2042850721 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c3406be90 con 0x7f5c3417f490 2024-02-21T23:12:49.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.482+0000 7f5c33e00640 1 --2- 172.21.15.99:0/2042850721 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5c3418b4f0 0x7f5c3415ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:12:49.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.482+0000 7f5c33400640 1 --2- 172.21.15.99:0/2042850721 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5c3417f490 0x7f5c34172cf0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f5c2402b9e0 tx=0x7f5c240046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:49.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.483+0000 7f5c2b400640 1 -- 172.21.15.99:0/2042850721 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c24034040 con 0x7f5c3417f490 2024-02-21T23:12:49.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.483+0000 7f5c2b400640 1 -- 172.21.15.99:0/2042850721 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c24039d90 con 0x7f5c3417f490 2024-02-21T23:12:49.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.483+0000 7f5c2b400640 1 -- 172.21.15.99:0/2042850721 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c24043610 con 0x7f5c3417f490 2024-02-21T23:12:49.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.483+0000 7f5c38c00640 1 -- 172.21.15.99:0/2042850721 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c3406c160 con 0x7f5c3417f490 2024-02-21T23:12:49.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.483+0000 7f5c38c00640 1 -- 172.21.15.99:0/2042850721 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c3406c720 con 0x7f5c3417f490 2024-02-21T23:12:49.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.487+0000 7f5c3d21a740 1 Processor -- start 2024-02-21T23:12:49.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.487+0000 7f5c3d21a740 1 -- start start 2024-02-21T23:12:49.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.487+0000 7f5c2b400640 1 -- 172.21.15.99:0/2042850721 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f5c2404a060 con 0x7f5c3417f490 2024-02-21T23:12:49.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.489+0000 7f5c2b400640 1 --2- 172.21.15.99:0/2042850721 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f5c1409eed0 0x7f5c140a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:49.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.489+0000 7f5c2b400640 1 -- 172.21.15.99:0/2042850721 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f5c240ec180 con 0x7f5c3417f490 2024-02-21T23:12:49.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.489+0000 7f5c3d21a740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560fcfaa5660 0x560fcfaa5a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:49.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.489+0000 7f5c3d21a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560fcfae0330 0x560fcfae07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:49.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.489+0000 7f5c3d21a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560fcfae0cf0 0x560fcfae1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:49.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.489+0000 7f5c3d21a740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fcf9cdb50 con 0x560fcfaa5660 2024-02-21T23:12:49.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.489+0000 7f5c3d21a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fcf976da0 con 0x560fcfae0cf0 2024-02-21T23:12:49.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.489+0000 7f5c3d21a740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fcf9c9bf0 con 0x560fcfae0330 2024-02-21T23:12:49.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.489+0000 7f5c33e00640 1 --2- 172.21.15.99:0/2042850721 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f5c1409eed0 0x7f5c140a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:49.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.489+0000 7f5c33400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560fcfaa5660 0x560fcfaa5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:49.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.489+0000 7f5c32a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560fcfae0330 0x560fcfae07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:49.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.489+0000 7f5c33400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560fcfaa5660 0x560fcfaa5a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40044/0 (socket says 172.21.15.99:40044) 2024-02-21T23:12:49.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.489+0000 7f5c32a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560fcfae0330 0x560fcfae07b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:47510/0 (socket says 172.21.15.99:47510) 2024-02-21T23:12:49.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.489+0000 7f5c33400640 1 -- 172.21.15.99:0/2387742527 learned_addr learned my addr 172.21.15.99:0/2387742527 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:12:49.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.490+0000 7f5c33e00640 1 --2- 172.21.15.99:0/2387742527 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560fcfae0cf0 0x560fcfae1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:49.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.490+0000 7f5c32a00640 1 -- 172.21.15.99:0/2387742527 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560fcfae0cf0 msgr2=0x560fcfae1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:49.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.490+0000 7f5c32a00640 1 --2- 172.21.15.99:0/2387742527 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560fcfae0cf0 0x560fcfae1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:49.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.490+0000 7f5c32a00640 1 -- 172.21.15.99:0/2387742527 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560fcfaa5660 msgr2=0x560fcfaa5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:49.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.490+0000 7f5c32a00640 1 --2- 172.21.15.99:0/2387742527 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560fcfaa5660 0x560fcfaa5a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:49.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.490+0000 7f5c32a00640 1 -- 172.21.15.99:0/2387742527 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560fcf999f80 con 0x560fcfae0330 2024-02-21T23:12:49.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.490+0000 7f5c33400640 1 --2- 172.21.15.99:0/2387742527 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560fcfaa5660 0x560fcfaa5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:12:49.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.490+0000 7f5c32a00640 1 --2- 172.21.15.99:0/2387742527 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560fcfae0330 0x560fcfae07b0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f5c20000f60 tx=0x7f5c20001c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ae0de4ad6c30d17 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:49.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.490+0000 7f5c33e00640 1 --2- 172.21.15.99:0/2042850721 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f5c1409eed0 0x7f5c140a1390 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c007870 tx=0x7f5c2c007c70 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:49.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.490+0000 7f5c1f400640 1 -- 172.21.15.99:0/2387742527 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c200052e0 con 0x560fcfae0330 2024-02-21T23:12:49.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.490+0000 7f5c1f400640 1 -- 172.21.15.99:0/2387742527 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c20018070 con 0x560fcfae0330 2024-02-21T23:12:49.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.491+0000 7f5c1f400640 1 -- 172.21.15.99:0/2387742527 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c2000f9f0 con 0x560fcfae0330 2024-02-21T23:12:49.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.491+0000 7f5c3d21a740 1 -- 172.21.15.99:0/2387742527 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560fcfae0330 msgr2=0x560fcfae07b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:49.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.491+0000 7f5c3d21a740 1 --2- 172.21.15.99:0/2387742527 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560fcfae0330 0x560fcfae07b0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f5c20000f60 tx=0x7f5c20001c30 comp rx=0 tx=0).stop 2024-02-21T23:12:49.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.491+0000 7f5c3d21a740 1 -- 172.21.15.99:0/2387742527 shutdown_connections 2024-02-21T23:12:49.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.491+0000 7f5c3d21a740 1 --2- 172.21.15.99:0/2387742527 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560fcfae0cf0 0x560fcfae1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:49.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.491+0000 7f5c3d21a740 1 --2- 172.21.15.99:0/2387742527 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560fcfae0330 0x560fcfae07b0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:49.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.491+0000 7f5c3d21a740 1 --2- 172.21.15.99:0/2387742527 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560fcfaa5660 0x560fcfaa5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:49.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.491+0000 7f5c3d21a740 1 -- 172.21.15.99:0/2387742527 >> 172.21.15.99:0/2387742527 conn(0x560fcfa676d0 msgr2=0x560fcfa68750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:49.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.492+0000 7f5c3d21a740 1 -- 172.21.15.99:0/2387742527 shutdown_connections 2024-02-21T23:12:49.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.492+0000 7f5c3d21a740 1 -- 172.21.15.99:0/2387742527 wait complete. 2024-02-21T23:12:49.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.492+0000 7f5c3d21a740 1 -- start start 2024-02-21T23:12:49.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.493+0000 7f5c3d21a740 1 Processor -- start 2024-02-21T23:12:49.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.494+0000 7f5c3d21a740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560fcfae0330 0x560fcfaacce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:49.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.494+0000 7f5c3d21a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560fcfae0cf0 0x560fcfaae310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:49.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.494+0000 7f5c3d21a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560fcfa9e130 0x560fcfa9f980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:49.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.494+0000 7f5c3d21a740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fcfadf0a0 con 0x560fcfae0330 2024-02-21T23:12:49.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.494+0000 7f5c3d21a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fcf96c380 con 0x560fcfae0cf0 2024-02-21T23:12:49.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.494+0000 7f5c3d21a740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fcfadedc0 con 0x560fcfa9e130 2024-02-21T23:12:49.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.494+0000 7f5c3d21a740 10 client.0 _ll_register_callbacks cb 0x560fcf9c5280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:12:49.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.494+0000 7f5c33400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560fcfae0330 0x560fcfaacce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:49.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.494+0000 7f5c32a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560fcfae0cf0 0x560fcfaae310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:49.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.494+0000 7f5c32a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560fcfae0cf0 0x560fcfaae310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:59818/0 (socket says 172.21.15.99:59818) 2024-02-21T23:12:49.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.494+0000 7f5c32a00640 1 -- 172.21.15.99:0/2407241727 learned_addr learned my addr 172.21.15.99:0/2407241727 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:12:49.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.494+0000 7f5c33e00640 1 --2- 172.21.15.99:0/2407241727 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560fcfa9e130 0x560fcfa9f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:49.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.495+0000 7f5c32a00640 1 -- 172.21.15.99:0/2407241727 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560fcfa9e130 msgr2=0x560fcfa9f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:49.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.495+0000 7f5c32a00640 1 --2- 172.21.15.99:0/2407241727 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560fcfa9e130 0x560fcfa9f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:49.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.495+0000 7f5c32a00640 1 -- 172.21.15.99:0/2407241727 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560fcfae0330 msgr2=0x560fcfaacce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:49.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.495+0000 7f5c32a00640 1 --2- 172.21.15.99:0/2407241727 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560fcfae0330 0x560fcfaacce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:49.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.495+0000 7f5c32a00640 1 -- 172.21.15.99:0/2407241727 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560fcf994c20 con 0x560fcfae0cf0 2024-02-21T23:12:49.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.495+0000 7f5c33e00640 1 --2- 172.21.15.99:0/2407241727 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560fcfa9e130 0x560fcfa9f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-21T23:12:49.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.495+0000 7f5c33400640 1 --2- 172.21.15.99:0/2407241727 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560fcfae0330 0x560fcfaacce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:12:49.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.495+0000 7f5c32a00640 1 --2- 172.21.15.99:0/2407241727 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560fcfae0cf0 0x560fcfaae310 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f5c20014000 tx=0x7f5c20007d00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aabd023392c5b9b6 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:49.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.495+0000 7f5c13e00640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-02-21T23:12:49.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.495+0000 7f5c13e00640 1 -- 172.21.15.99:0/2407241727 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c20001420 con 0x560fcfae0cf0 2024-02-21T23:12:49.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.495+0000 7f5c3d21a740 1 -- 172.21.15.99:0/2407241727 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5c20018070 con 0x560fcfae0cf0 2024-02-21T23:12:49.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.495+0000 7f5c13e00640 1 -- 172.21.15.99:0/2407241727 <== mon.1 v2:172.21.15.162:3300/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f5c20007030 con 0x560fcfae0cf0 2024-02-21T23:12:49.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.496+0000 7f5c13e00640 1 -- 172.21.15.99:0/2407241727 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5c2002d050 con 0x560fcfae0cf0 2024-02-21T23:12:49.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.496+0000 7f5c3d21a740 10 client.7396 fetch_fsmap learned FSMap version 17 2024-02-21T23:12:49.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.496+0000 7f5c3d21a740 1 -- 172.21.15.99:0/2407241727 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x560fcf6e23f0 con 0x560fcfae0cf0 2024-02-21T23:12:49.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.496+0000 7f5c13e00640 1 -- 172.21.15.99:0/2407241727 <== mon.1 v2:172.21.15.162:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c20018070 con 0x560fcfae0cf0 2024-02-21T23:12:49.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.496+0000 7f5c13e00640 1 -- 172.21.15.99:0/2407241727 <== mon.1 v2:172.21.15.162:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f5c20007230 con 0x560fcfae0cf0 2024-02-21T23:12:49.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.496+0000 7f5c3d21a740 10 client.7396 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:12:49.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.496+0000 7f5c3d21a740 10 client.7396 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:12:49.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.496+0000 7f5c3d21a740 20 client.7396 populate_metadata read hostname 'smithi099' 2024-02-21T23:12:49.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.496+0000 7f5c3d21a740 1 --2- 172.21.15.99:0/2407241727 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x560fcfa9e510 0x560fcfaece90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:49.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.496+0000 7f5c3d21a740 4 client.7396 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-02-21T23:12:49.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.496+0000 7f5c3d21a740 1 -- 172.21.15.99:0/2407241727 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560fcf9db090 con 0x560fcfa9e510 2024-02-21T23:12:49.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.497+0000 7f5c33400640 1 --2- 172.21.15.99:0/2407241727 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x560fcfa9e510 0x560fcfaece90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:49.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.497+0000 7f5c33400640 1 --2- 172.21.15.99:0/2407241727 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x560fcfa9e510 0x560fcfaece90 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b9c92d61a66937b server_cookie=6eaa8500bf5b6d67 in_seq=0 out_seq=0 2024-02-21T23:12:49.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.497+0000 7f5c13e00640 10 client.7396 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:12:49.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.498+0000 7f5c13e00640 1 -- 172.21.15.99:0/2407241727 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x560fcf9db090 con 0x560fcfa9e510 2024-02-21T23:12:49.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.498+0000 7f5c13e00640 10 client.7396 handle_command_reply: tid=0 2024-02-21T23:12:49.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.498+0000 7f5c3d21a740 1 client.7396 shutdown 2024-02-21T23:12:49.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.498+0000 7f5c3d21a740 1 -- 172.21.15.99:0/2407241727 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560fcfae0cf0 msgr2=0x560fcfaae310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:49.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.498+0000 7f5c3d21a740 1 --2- 172.21.15.99:0/2407241727 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560fcfae0cf0 0x560fcfaae310 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f5c20014000 tx=0x7f5c20007d00 comp rx=0 tx=0).stop 2024-02-21T23:12:49.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.498+0000 7f5c3d21a740 1 -- 172.21.15.99:0/2407241727 shutdown_connections 2024-02-21T23:12:49.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.498+0000 7f5c3d21a740 1 --2- 172.21.15.99:0/2407241727 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x560fcfa9e510 0x560fcfaece90 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:49.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.498+0000 7f5c3d21a740 1 --2- 172.21.15.99:0/2407241727 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560fcfa9e130 0x560fcfa9f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:49.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.498+0000 7f5c3d21a740 1 --2- 172.21.15.99:0/2407241727 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560fcfae0cf0 0x560fcfaae310 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:49.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.498+0000 7f5c3d21a740 1 --2- 172.21.15.99:0/2407241727 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560fcfae0330 0x560fcfaacce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:49.496 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.498+0000 7f5c3d21a740 1 -- 172.21.15.99:0/2407241727 >> 172.21.15.99:0/2407241727 conn(0x560fcfaa5660 msgr2=0x560fcfadf7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:49.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.498+0000 7f5c13e00640 0 client.7396 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:12:49.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.499+0000 7f5c3d21a740 1 -- 172.21.15.99:0/2407241727 shutdown_connections 2024-02-21T23:12:49.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.499+0000 7f5c3d21a740 1 -- 172.21.15.99:0/2407241727 wait complete. 2024-02-21T23:12:49.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.499+0000 7f5c3d21a740 20 client.7396 trim_cache size 0 max 16384 2024-02-21T23:12:49.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.525+0000 7f5c3d21a740 1 Processor -- start 2024-02-21T23:12:49.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.525+0000 7f5c3d21a740 1 -- start start 2024-02-21T23:12:49.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.527+0000 7f5c3d21a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560fcfa9e130 0x560fcfaaccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:49.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.527+0000 7f5c3d21a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560fcfae0330 0x560fcfb43450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:49.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.527+0000 7f5c3d21a740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560fcfae0cf0 0x560fcfb43990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:49.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.527+0000 7f5c3d21a740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c3422c890 con 0x560fcfae0cf0 2024-02-21T23:12:49.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.527+0000 7f5c3d21a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c3422a430 con 0x560fcfa9e130 2024-02-21T23:12:49.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.527+0000 7f5c3d21a740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c3417b200 con 0x560fcfae0330 2024-02-21T23:12:49.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.527+0000 7f5c33e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560fcfae0cf0 0x560fcfb43990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:49.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.527+0000 7f5c33e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560fcfae0cf0 0x560fcfb43990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40064/0 (socket says 172.21.15.99:40064) 2024-02-21T23:12:49.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.527+0000 7f5c33e00640 1 -- 172.21.15.99:0/997178135 learned_addr learned my addr 172.21.15.99:0/997178135 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:12:49.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.528+0000 7f5c32a00640 1 --2- 172.21.15.99:0/997178135 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560fcfae0330 0x560fcfb43450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:49.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.528+0000 7f5c33400640 1 --2- 172.21.15.99:0/997178135 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560fcfa9e130 0x560fcfaaccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:49.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.528+0000 7f5c33e00640 1 -- 172.21.15.99:0/997178135 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560fcfae0330 msgr2=0x560fcfb43450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:49.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.528+0000 7f5c33e00640 1 --2- 172.21.15.99:0/997178135 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560fcfae0330 0x560fcfb43450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:49.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.528+0000 7f5c33e00640 1 -- 172.21.15.99:0/997178135 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560fcfa9e130 msgr2=0x560fcfaaccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:49.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.528+0000 7f5c33e00640 1 --2- 172.21.15.99:0/997178135 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560fcfa9e130 0x560fcfaaccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:49.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.528+0000 7f5c33e00640 1 -- 172.21.15.99:0/997178135 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560fcf7ac7d0 con 0x560fcfae0cf0 2024-02-21T23:12:49.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.528+0000 7f5c33e00640 1 --2- 172.21.15.99:0/997178135 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560fcfae0cf0 0x560fcfb43990 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c018cb0 tx=0x7f5c2c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c2a0ecc29bd5858 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:49.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.529+0000 7f5c1ea00640 1 -- 172.21.15.99:0/997178135 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c2c02d070 con 0x560fcfae0cf0 2024-02-21T23:12:49.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.529+0000 7f5c1ea00640 1 -- 172.21.15.99:0/997178135 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c2c024040 con 0x560fcfae0cf0 2024-02-21T23:12:49.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.529+0000 7f5c1ea00640 1 -- 172.21.15.99:0/997178135 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c2c028630 con 0x560fcfae0cf0 2024-02-21T23:12:49.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.530+0000 7f5c3d21a740 1 -- 172.21.15.99:0/997178135 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560fcfae0cf0 msgr2=0x560fcfb43990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:49.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.530+0000 7f5c3d21a740 1 --2- 172.21.15.99:0/997178135 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560fcfae0cf0 0x560fcfb43990 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c018cb0 tx=0x7f5c2c00b040 comp rx=0 tx=0).stop 2024-02-21T23:12:49.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.530+0000 7f5c3d21a740 1 -- 172.21.15.99:0/997178135 shutdown_connections 2024-02-21T23:12:49.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.530+0000 7f5c3d21a740 1 --2- 172.21.15.99:0/997178135 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560fcfae0cf0 0x560fcfb43990 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:49.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.530+0000 7f5c3d21a740 1 --2- 172.21.15.99:0/997178135 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560fcfae0330 0x560fcfb43450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:49.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.530+0000 7f5c3d21a740 1 --2- 172.21.15.99:0/997178135 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560fcfa9e130 0x560fcfaaccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:49.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.530+0000 7f5c3d21a740 1 -- 172.21.15.99:0/997178135 >> 172.21.15.99:0/997178135 conn(0x560fcfaa5660 msgr2=0x560fcfaadb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:49.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.530+0000 7f5c3d21a740 1 -- 172.21.15.99:0/997178135 shutdown_connections 2024-02-21T23:12:49.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.530+0000 7f5c3d21a740 1 -- 172.21.15.99:0/997178135 wait complete. 2024-02-21T23:12:49.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.531+0000 7f5c3d21a740 1 -- start start 2024-02-21T23:12:49.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.531+0000 7f5c3d21a740 1 Processor -- start 2024-02-21T23:12:49.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.534+0000 7f5c3d21a740 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560fcfa9e130 0x560fcfa97e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:49.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.534+0000 7f5c3d21a740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560fcfae0330 0x560fcfadee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:49.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.534+0000 7f5c3d21a740 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560fcfae0cf0 0x560fcfb49170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:49.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.534+0000 7f5c3d21a740 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c34228af0 con 0x560fcfae0cf0 2024-02-21T23:12:49.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.534+0000 7f5c3d21a740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c34229dd0 con 0x560fcfae0330 2024-02-21T23:12:49.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.534+0000 7f5c3d21a740 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c34229110 con 0x560fcfa9e130 2024-02-21T23:12:49.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.534+0000 7f5c3d21a740 10 client.0 _ll_register_callbacks cb 0x7f5c240094d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-02-21T23:12:49.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.534+0000 7f5c33e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560fcfae0cf0 0x560fcfb49170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:49.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.534+0000 7f5c33400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560fcfa9e130 0x560fcfa97e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:49.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.534+0000 7f5c33e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560fcfae0cf0 0x560fcfb49170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40074/0 (socket says 172.21.15.99:40074) 2024-02-21T23:12:49.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.534+0000 7f5c33e00640 1 -- 172.21.15.99:0/2538474802 learned_addr learned my addr 172.21.15.99:0/2538474802 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:12:49.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.534+0000 7f5c32a00640 1 --2- 172.21.15.99:0/2538474802 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560fcfae0330 0x560fcfadee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:49.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.534+0000 7f5c33e00640 1 -- 172.21.15.99:0/2538474802 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560fcfa9e130 msgr2=0x560fcfa97e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:49.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.534+0000 7f5c33e00640 1 --2- 172.21.15.99:0/2538474802 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560fcfa9e130 0x560fcfa97e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:49.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.535+0000 7f5c33e00640 1 -- 172.21.15.99:0/2538474802 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560fcfae0330 msgr2=0x560fcfadee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:49.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.535+0000 7f5c33e00640 1 --2- 172.21.15.99:0/2538474802 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560fcfae0330 0x560fcfadee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:49.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.535+0000 7f5c33e00640 1 -- 172.21.15.99:0/2538474802 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560fcfb486b0 con 0x560fcfae0cf0 2024-02-21T23:12:49.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.535+0000 7f5c32a00640 1 --2- 172.21.15.99:0/2538474802 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560fcfae0330 0x560fcfadee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:12:49.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.535+0000 7f5c33e00640 1 --2- 172.21.15.99:0/2538474802 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560fcfae0cf0 0x560fcfb49170 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c01d010 tx=0x7f5c2c01b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8a42a1601035b3 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:49.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.535+0000 7f5c13e00640 10 client.0 ms_handle_connect on v2:172.21.15.99:3300/0 2024-02-21T23:12:49.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.535+0000 7f5c13e00640 1 -- 172.21.15.99:0/2538474802 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c2c02d040 con 0x560fcfae0cf0 2024-02-21T23:12:49.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.535+0000 7f5c13e00640 1 -- 172.21.15.99:0/2538474802 <== mon.0 v2:172.21.15.99:3300/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f5c2c033650 con 0x560fcfae0cf0 2024-02-21T23:12:49.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.535+0000 7f5c3d21a740 1 -- 172.21.15.99:0/2538474802 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5c2c024040 con 0x560fcfae0cf0 2024-02-21T23:12:49.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.536+0000 7f5c13e00640 1 -- 172.21.15.99:0/2538474802 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5c2c041050 con 0x560fcfae0cf0 2024-02-21T23:12:49.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.536+0000 7f5c3d21a740 10 client.7191 fetch_fsmap learned FSMap version 17 2024-02-21T23:12:49.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.536+0000 7f5c3d21a740 1 -- 172.21.15.99:0/2538474802 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x560fcfb489d0 con 0x560fcfae0cf0 2024-02-21T23:12:49.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.536+0000 7f5c13e00640 1 -- 172.21.15.99:0/2538474802 <== mon.0 v2:172.21.15.99:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c2c024040 con 0x560fcfae0cf0 2024-02-21T23:12:49.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.536+0000 7f5c13e00640 1 -- 172.21.15.99:0/2538474802 <== mon.0 v2:172.21.15.99:3300/0 5 ==== fsmap(e 17) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f5c2c033850 con 0x560fcfae0cf0 2024-02-21T23:12:49.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.536+0000 7f5c3d21a740 10 client.7191 fetch_fsmap finished waiting for FSMap version 17 2024-02-21T23:12:49.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.536+0000 7f5c3d21a740 10 client.7191 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.j 2024-02-21T23:12:49.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.536+0000 7f5c3d21a740 20 client.7191 populate_metadata read hostname 'smithi099' 2024-02-21T23:12:49.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.536+0000 7f5c3d21a740 1 --2- 172.21.15.99:0/2538474802 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x560fcfa6db20 0x560fcfa9a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:49.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.536+0000 7f5c3d21a740 4 client.7191 mds_command: new command op to 4355 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-02-21T23:12:49.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.536+0000 7f5c3d21a740 1 -- 172.21.15.99:0/2538474802 --> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x560fcf9d53e0 con 0x560fcfa6db20 2024-02-21T23:12:49.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.537+0000 7f5c33400640 1 --2- 172.21.15.99:0/2538474802 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x560fcfa6db20 0x560fcfa9a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:49.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.537+0000 7f5c13e00640 10 client.7191 ms_handle_connect on v2:172.21.15.99:6838/4239008786 2024-02-21T23:12:49.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.537+0000 7f5c33400640 1 --2- 172.21.15.99:0/2538474802 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x560fcfa6db20 0x560fcfa9a370 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d94db3e9939b1be server_cookie=5435431c98be58b6 in_seq=0 out_seq=0 2024-02-21T23:12:49.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.537+0000 7f5c13e00640 1 -- 172.21.15.99:0/2538474802 <== mds.0 v2:172.21.15.99:6838/4239008786 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x560fcf9d53e0 con 0x560fcfa6db20 2024-02-21T23:12:49.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.537+0000 7f5c13e00640 10 client.7191 handle_command_reply: tid=0 2024-02-21T23:12:49.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.537+0000 7f5c3d21a740 1 client.7191 shutdown 2024-02-21T23:12:49.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.538+0000 7f5c3d21a740 1 -- 172.21.15.99:0/2538474802 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560fcfae0cf0 msgr2=0x560fcfb49170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:49.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.538+0000 7f5c3d21a740 1 --2- 172.21.15.99:0/2538474802 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560fcfae0cf0 0x560fcfb49170 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c01d010 tx=0x7f5c2c01b000 comp rx=0 tx=0).stop 2024-02-21T23:12:49.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.538+0000 7f5c3d21a740 1 -- 172.21.15.99:0/2538474802 shutdown_connections 2024-02-21T23:12:49.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.538+0000 7f5c3d21a740 1 --2- 172.21.15.99:0/2538474802 >> [v2:172.21.15.99:6838/4239008786,v1:172.21.15.99:6839/4239008786] conn(0x560fcfa6db20 0x560fcfa9a370 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:49.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.538+0000 7f5c3d21a740 1 --2- 172.21.15.99:0/2538474802 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560fcfae0cf0 0x560fcfb49170 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:49.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.538+0000 7f5c3d21a740 1 --2- 172.21.15.99:0/2538474802 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560fcfae0330 0x560fcfadee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:49.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.538+0000 7f5c13e00640 0 client.7191 ms_handle_reset on v2:172.21.15.99:6838/4239008786 2024-02-21T23:12:49.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.538+0000 7f5c3d21a740 1 --2- 172.21.15.99:0/2538474802 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x560fcfa9e130 0x560fcfa97e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:49.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.538+0000 7f5c3d21a740 1 -- 172.21.15.99:0/2538474802 >> 172.21.15.99:0/2538474802 conn(0x560fcfaa5660 msgr2=0x560fcfaaf980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:49.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.538+0000 7f5c3d21a740 1 -- 172.21.15.99:0/2538474802 shutdown_connections 2024-02-21T23:12:49.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.538+0000 7f5c3d21a740 1 -- 172.21.15.99:0/2538474802 wait complete. 2024-02-21T23:12:49.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.538+0000 7f5c3d21a740 20 client.7191 trim_cache size 0 max 16384 2024-02-21T23:12:49.531 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-02-21T23:12:49.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.539+0000 7f5c38c00640 1 -- 172.21.15.99:0/2042850721 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f5c1409eed0 msgr2=0x7f5c140a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:49.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.539+0000 7f5c38c00640 1 --2- 172.21.15.99:0/2042850721 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f5c1409eed0 0x7f5c140a1390 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c007870 tx=0x7f5c2c007c70 comp rx=0 tx=0).stop 2024-02-21T23:12:49.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.539+0000 7f5c38c00640 1 -- 172.21.15.99:0/2042850721 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5c3417f490 msgr2=0x7f5c34172cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:49.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.539+0000 7f5c38c00640 1 --2- 172.21.15.99:0/2042850721 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5c3417f490 0x7f5c34172cf0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f5c2402b9e0 tx=0x7f5c240046c0 comp rx=0 tx=0).stop 2024-02-21T23:12:49.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.539+0000 7f5c38c00640 1 -- 172.21.15.99:0/2042850721 shutdown_connections 2024-02-21T23:12:49.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.539+0000 7f5c38c00640 1 --2- 172.21.15.99:0/2042850721 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f5c1409eed0 0x7f5c140a1390 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:49.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.539+0000 7f5c38c00640 1 --2- 172.21.15.99:0/2042850721 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5c3418b4f0 0x7f5c3415ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:49.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.539+0000 7f5c38c00640 1 --2- 172.21.15.99:0/2042850721 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5c3418b060 0x7f5c3406b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:49.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.539+0000 7f5c38c00640 1 --2- 172.21.15.99:0/2042850721 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5c3417f490 0x7f5c34172cf0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:49.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.539+0000 7f5c38c00640 1 -- 172.21.15.99:0/2042850721 >> 172.21.15.99:0/2042850721 conn(0x7f5c340d29b0 msgr2=0x7f5c3415f210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:49.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.539+0000 7f5c38c00640 1 -- 172.21.15.99:0/2042850721 shutdown_connections 2024-02-21T23:12:49.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:49.539+0000 7f5c38c00640 1 -- 172.21.15.99:0/2042850721 wait complete. 2024-02-21T23:12:50.548 INFO:tasks.fwd_scrub.fs.[cephfs]:end scrubbing fs: cephfs 2024-02-21T23:12:50.548 INFO:tasks.fwd_scrub:done joining 2024-02-21T23:12:50.549 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-02-21T23:12:50.560 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T23:12:50.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:50.777+0000 7f34eae00640 1 Processor -- start 2024-02-21T23:12:50.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:50.777+0000 7f34eae00640 1 -- start start 2024-02-21T23:12:50.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:50.781+0000 7f34eae00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f34e40740b0 0x7f34e4188f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:50.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:50.781+0000 7f34eae00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34e406dd90 con 0x7f34e4074ba0 2024-02-21T23:12:50.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:50.781+0000 7f34eae00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34e40f91b0 con 0x7f34e4189450 2024-02-21T23:12:50.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:50.781+0000 7f34eae00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34e4074fb0 con 0x7f34e40740b0 2024-02-21T23:12:50.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:50.781+0000 7f34e9a00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f34e40740b0 0x7f34e4188f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:50.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:50.782+0000 7f34e9000640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f34e4189450 0x7f34e4074490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:35068/0 (socket says 172.21.15.99:35068) 2024-02-21T23:12:50.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:50.782+0000 7f34e9000640 1 -- 172.21.15.99:0/3986046945 learned_addr learned my addr 172.21.15.99:0/3986046945 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:12:50.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:50.781+0000 7f34ea400640 1 --1- 172.21.15.99:0/3986046945 >> v1:172.21.15.99:6789/0 conn(0x7f34e4074ba0 0x7f34e40fa250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:54814/0 (socket says 172.21.15.99:54814) 2024-02-21T23:12:50.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:50.782+0000 7f34e9a00640 1 -- 172.21.15.99:0/3986046945 >> v1:172.21.15.181:6789/0 conn(0x7f34e4189450 legacy=0x7f34e4074490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:50.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:50.782+0000 7f34e9a00640 1 -- 172.21.15.99:0/3986046945 >> v1:172.21.15.99:6789/0 conn(0x7f34e4074ba0 legacy=0x7f34e40fa250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:50.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:50.782+0000 7f34e9a00640 1 -- 172.21.15.99:0/3986046945 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34e40f9490 con 0x7f34e40740b0 2024-02-21T23:12:50.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:50.784+0000 7f34e9a00640 1 --2- 172.21.15.99:0/3986046945 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f34e40740b0 0x7f34e4188f10 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f34d80097a0 tx=0x7f34d802b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f554d8895558c208 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:50.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:50.784+0000 7f34e3e00640 1 -- 172.21.15.99:0/3986046945 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d8034070 con 0x7f34e40740b0 2024-02-21T23:12:50.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:50.784+0000 7f34e3e00640 1 -- 172.21.15.99:0/3986046945 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34d8030610 con 0x7f34e40740b0 2024-02-21T23:12:50.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:50.784+0000 7f34e3e00640 1 -- 172.21.15.99:0/3986046945 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d80309e0 con 0x7f34e40740b0 2024-02-21T23:12:50.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:50.785+0000 7f34eae00640 1 -- 172.21.15.99:0/3986046945 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f34e40740b0 msgr2=0x7f34e4188f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:50.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:50.785+0000 7f34eae00640 1 --2- 172.21.15.99:0/3986046945 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f34e40740b0 0x7f34e4188f10 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f34d80097a0 tx=0x7f34d802b960 comp rx=0 tx=0).stop 2024-02-21T23:12:50.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:50.785+0000 7f34eae00640 1 -- 172.21.15.99:0/3986046945 shutdown_connections 2024-02-21T23:12:50.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:50.785+0000 7f34eae00640 1 --2- 172.21.15.99:0/3986046945 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f34e40740b0 0x7f34e4188f10 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:50.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:50.785+0000 7f34eae00640 1 -- 172.21.15.99:0/3986046945 >> 172.21.15.99:0/3986046945 conn(0x7f34e408cfd0 msgr2=0x7f34e408d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:50.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:50.785+0000 7f34eae00640 1 -- 172.21.15.99:0/3986046945 shutdown_connections 2024-02-21T23:12:50.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:50.785+0000 7f34eae00640 1 -- 172.21.15.99:0/3986046945 wait complete. 2024-02-21T23:12:50.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:50.787+0000 7f34eae00640 1 Processor -- start 2024-02-21T23:12:50.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:50.787+0000 7f34eae00640 1 -- start start 2024-02-21T23:12:50.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:50.788+0000 7f34eae00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34e40740b0 0x7f34e4171380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:50.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:50.788+0000 7f34eae00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f34e4074ba0 0x7f34e4167150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:50.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:50.788+0000 7f34eae00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f34e4189450 0x7f34e40cea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:50.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:50.788+0000 7f34eae00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34e40f9d30 con 0x7f34e4074ba0 2024-02-21T23:12:50.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:50.788+0000 7f34eae00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34e40f9a50 con 0x7f34e40740b0 2024-02-21T23:12:50.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:50.788+0000 7f34eae00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34e4186670 con 0x7f34e4189450 2024-02-21T23:12:50.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:50.789+0000 7f34e9000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f34e4074ba0 0x7f34e4167150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:50.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:50.789+0000 7f34e9000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f34e4074ba0 0x7f34e4167150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40076/0 (socket says 172.21.15.99:40076) 2024-02-21T23:12:50.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:50.789+0000 7f34e9000640 1 -- 172.21.15.99:0/3971973613 learned_addr learned my addr 172.21.15.99:0/3971973613 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:12:50.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:50.789+0000 7f34e9a00640 1 --2- 172.21.15.99:0/3971973613 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34e40740b0 0x7f34e4171380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:50.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:50.789+0000 7f34ea400640 1 --2- 172.21.15.99:0/3971973613 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f34e4189450 0x7f34e40cea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:50.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:50.789+0000 7f34e9000640 1 -- 172.21.15.99:0/3971973613 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f34e4189450 msgr2=0x7f34e40cea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:50.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:50.789+0000 7f34e9000640 1 --2- 172.21.15.99:0/3971973613 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f34e4189450 0x7f34e40cea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:50.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:50.789+0000 7f34e9000640 1 -- 172.21.15.99:0/3971973613 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34e40740b0 msgr2=0x7f34e4171380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:50.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:50.789+0000 7f34e9000640 1 --2- 172.21.15.99:0/3971973613 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34e40740b0 0x7f34e4171380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:50.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:50.789+0000 7f34e9000640 1 -- 172.21.15.99:0/3971973613 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34e418a9f0 con 0x7f34e4074ba0 2024-02-21T23:12:50.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:50.789+0000 7f34e9000640 1 --2- 172.21.15.99:0/3971973613 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f34e4074ba0 0x7f34e4167150 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f34d000c4d0 tx=0x7f34d000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:50.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:50.790+0000 7f34e1600640 1 -- 172.21.15.99:0/3971973613 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d0017070 con 0x7f34e4074ba0 2024-02-21T23:12:50.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:50.790+0000 7f34e1600640 1 -- 172.21.15.99:0/3971973613 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34d0005ce0 con 0x7f34e4074ba0 2024-02-21T23:12:50.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:50.790+0000 7f34eae00640 1 -- 172.21.15.99:0/3971973613 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34e418acd0 con 0x7f34e4074ba0 2024-02-21T23:12:50.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:50.790+0000 7f34e1600640 1 -- 172.21.15.99:0/3971973613 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d0007270 con 0x7f34e4074ba0 2024-02-21T23:12:50.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:50.790+0000 7f34eae00640 1 -- 172.21.15.99:0/3971973613 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34e418b290 con 0x7f34e4074ba0 2024-02-21T23:12:50.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:50.792+0000 7f34eae00640 1 -- 172.21.15.99:0/3971973613 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34e4068320 con 0x7f34e4074ba0 2024-02-21T23:12:50.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:50.795+0000 7f34e1600640 1 -- 172.21.15.99:0/3971973613 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f34d001a070 con 0x7f34e4074ba0 2024-02-21T23:12:50.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:50.797+0000 7f34e1600640 1 --2- 172.21.15.99:0/3971973613 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f34c409eed0 0x7f34c40a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:50.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:50.797+0000 7f34e1600640 1 -- 172.21.15.99:0/3971973613 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f34d00c9170 con 0x7f34e4074ba0 2024-02-21T23:12:50.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:50.797+0000 7f34e9a00640 1 --2- 172.21.15.99:0/3971973613 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f34c409eed0 0x7f34c40a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:50.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:50.798+0000 7f34e9a00640 1 --2- 172.21.15.99:0/3971973613 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f34c409eed0 0x7f34c40a1390 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f34d8036000 tx=0x7f34d803b040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:50.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:50.805+0000 7f34e1600640 1 -- 172.21.15.99:0/3971973613 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f34d0096ad0 con 0x7f34e4074ba0 2024-02-21T23:12:51.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.066+0000 7f34eae00640 1 -- 172.21.15.99:0/3971973613 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f34e4070790 con 0x7f34e4074ba0 2024-02-21T23:12:51.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.067+0000 7f34e1600640 1 -- 172.21.15.99:0/3971973613 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+24383 (secure 0 0 0) 0x7f34d009ab70 con 0x7f34e4074ba0 2024-02-21T23:12:51.055 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T23:12:51.056 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":40,"fsid":"e8af98cd-45a1-425f-96a7-f24da8ee4efb","created":"2024-02-21T23:00:44.699708+0000","modified":"2024-02-21T23:12:14.816230+0000","last_up_change":"2024-02-21T23:00:55.749829+0000","last_in_change":"2024-02-21T23:00:48.332297+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T23:00:57.020557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":11.760000228881836,"score_stable":11.760000228881836,"optimal_score":0.17000000178813934,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-21T23:01:01.124398+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-21T23:01:01.684258+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":39,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-21T23:01:05.290089+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":39,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c49de9b2-dc53-4882-b14c-7059ed40bf59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6809","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6811","nonce":1026112937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6813","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6815","nonce":1026112937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6823","nonce":1026112937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6819","nonce":1026112937}]},"public_addr":"172.21.15.99:6811/1026112937","cluster_addr":"172.21.15.99:6815/1026112937","heartbeat_back_addr":"172.21.15.99:6823/1026112937","heartbeat_front_addr":"172.21.15.99:6819/1026112937","state":["exists","up"]},{"osd":1,"uuid":"58398292-2fe5-4291-94fd-03a0ca29d49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6827","nonce":3030871566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6829","nonce":3030871566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6833","nonce":3030871566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6831","nonce":3030871566}]},"public_addr":"172.21.15.162:6827/3030871566","cluster_addr":"172.21.15.162:6829/3030871566","heartbeat_back_addr":"172.21.15.162:6833/3030871566","heartbeat_front_addr":"172.21.15.162:6831/3030871566","state":["exists","up"]},{"osd":2,"uuid":"94cddec1-e08f-438d-a7c8-48a0e47d71a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6818","nonce":2782386148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6821","nonce":2782386148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6827","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6829","nonce":2782386148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6823","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6825","nonce":2782386148}]},"public_addr":"172.21.15.181:6818/2782386148","cluster_addr":"172.21.15.181:6821/2782386148","heartbeat_back_addr":"172.21.15.181:6829/2782386148","heartbeat_front_addr":"172.21.15.181:6825/2782386148","state":["exists","up"]},{"osd":3,"uuid":"d29abb74-9b89-4fd7-88b1-7c2eb8231189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6801","nonce":2316185310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6803","nonce":2316185310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6807","nonce":2316185310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6805","nonce":2316185310}]},"public_addr":"172.21.15.99:6801/2316185310","cluster_addr":"172.21.15.99:6803/2316185310","heartbeat_back_addr":"172.21.15.99:6807/2316185310","heartbeat_front_addr":"172.21.15.99:6805/2316185310","state":["exists","up"]},{"osd":4,"uuid":"0d8c9ea3-880a-4d69-9dcb-cf7d35abd449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6811","nonce":3137681258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6813","nonce":3137681258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6817","nonce":3137681258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6815","nonce":3137681258}]},"public_addr":"172.21.15.162:6811/3137681258","cluster_addr":"172.21.15.162:6813/3137681258","heartbeat_back_addr":"172.21.15.162:6817/3137681258","heartbeat_front_addr":"172.21.15.162:6815/3137681258","state":["exists","up"]},{"osd":5,"uuid":"2e3a9340-6fd0-4d7a-8e00-fe305649296e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6801","nonce":2011264527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6803","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6805","nonce":2011264527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6811","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6813","nonce":2011264527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6807","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6809","nonce":2011264527}]},"public_addr":"172.21.15.181:6801/2011264527","cluster_addr":"172.21.15.181:6805/2011264527","heartbeat_back_addr":"172.21.15.181:6813/2011264527","heartbeat_front_addr":"172.21.15.181:6809/2011264527","state":["exists","up"]},{"osd":6,"uuid":"d9e37ce7-1b0e-4019-8f2e-b670403abf7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6810","nonce":753870050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6814","nonce":753870050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6822","nonce":753870050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6818","nonce":753870050}]},"public_addr":"172.21.15.99:6810/753870050","cluster_addr":"172.21.15.99:6814/753870050","heartbeat_back_addr":"172.21.15.99:6822/753870050","heartbeat_front_addr":"172.21.15.99:6818/753870050","state":["exists","up"]},{"osd":7,"uuid":"49988754-232e-4b8c-bd72-bfa25b418e5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6803","nonce":1659412949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6805","nonce":1659412949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6809","nonce":1659412949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6807","nonce":1659412949}]},"public_addr":"172.21.15.162:6803/1659412949","cluster_addr":"172.21.15.162:6805/1659412949","heartbeat_back_addr":"172.21.15.162:6809/1659412949","heartbeat_front_addr":"172.21.15.162:6807/1659412949","state":["exists","up"]},{"osd":8,"uuid":"ebc6e462-8368-4d64-b242-9c8735ac672c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6804","nonce":3389807042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6808","nonce":3389807042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6815","nonce":3389807042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6812","nonce":3389807042}]},"public_addr":"172.21.15.181:6804/3389807042","cluster_addr":"172.21.15.181:6808/3389807042","heartbeat_back_addr":"172.21.15.181:6815/3389807042","heartbeat_front_addr":"172.21.15.181:6812/3389807042","state":["exists","up"]},{"osd":9,"uuid":"72af1b02-b965-4d6a-8964-527ec24c4daa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6825","nonce":4055669590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6827","nonce":4055669590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6831","nonce":4055669590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6829","nonce":4055669590}]},"public_addr":"172.21.15.99:6825/4055669590","cluster_addr":"172.21.15.99:6827/4055669590","heartbeat_back_addr":"172.21.15.99:6831/4055669590","heartbeat_front_addr":"172.21.15.99:6829/4055669590","state":["exists","up"]},{"osd":10,"uuid":"adb5cb06-6453-41e4-b847-d7c78bbb7d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6819","nonce":1421879617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6821","nonce":1421879617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6825","nonce":1421879617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6823","nonce":1421879617}]},"public_addr":"172.21.15.162:6819/1421879617","cluster_addr":"172.21.15.162:6821/1421879617","heartbeat_back_addr":"172.21.15.162:6825/1421879617","heartbeat_front_addr":"172.21.15.162:6823/1421879617","state":["exists","up"]},{"osd":11,"uuid":"118563d9-1e8f-4dc7-a92c-2f4c4dc3e20f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6817","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6819","nonce":3219928272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6824","nonce":3219928272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6831","nonce":3219928272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6828","nonce":3219928272}]},"public_addr":"172.21.15.181:6819/3219928272","cluster_addr":"172.21.15.181:6824/3219928272","heartbeat_back_addr":"172.21.15.181:6831/3219928272","heartbeat_front_addr":"172.21.15.181:6828/3219928272","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.651219+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.549859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.529659+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.591004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.440836+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.414250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.630130+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.411954+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.439371+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.428173+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.511203+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.482806+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.6","mappings":[{"from":9,"to":11}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.14","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.162:0/612025202":"2024-02-22T23:02:14.008014+0000","172.21.15.162:0/1516346096":"2024-02-22T23:02:14.008014+0000","172.21.15.162:0/328516024":"2024-02-22T23:02:14.008014+0000","172.21.15.162:0/3695581546":"2024-02-22T23:02:14.008014+0000","172.21.15.162:6801/1717094936":"2024-02-22T23:02:14.008014+0000","172.21.15.162:0/506228072":"2024-02-22T23:02:14.008014+0000","172.21.15.162:6800/1717094936":"2024-02-22T23:02:14.008014+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]},{"pool":4,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T23:12:51.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.070+0000 7f34eae00640 1 -- 172.21.15.99:0/3971973613 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f34c409eed0 msgr2=0x7f34c40a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:51.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.070+0000 7f34eae00640 1 --2- 172.21.15.99:0/3971973613 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f34c409eed0 0x7f34c40a1390 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f34d8036000 tx=0x7f34d803b040 comp rx=0 tx=0).stop 2024-02-21T23:12:51.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.070+0000 7f34eae00640 1 -- 172.21.15.99:0/3971973613 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f34e4074ba0 msgr2=0x7f34e4167150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:51.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.070+0000 7f34eae00640 1 --2- 172.21.15.99:0/3971973613 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f34e4074ba0 0x7f34e4167150 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f34d000c4d0 tx=0x7f34d000c990 comp rx=0 tx=0).stop 2024-02-21T23:12:51.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.070+0000 7f34eae00640 1 -- 172.21.15.99:0/3971973613 shutdown_connections 2024-02-21T23:12:51.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.070+0000 7f34eae00640 1 --2- 172.21.15.99:0/3971973613 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f34c409eed0 0x7f34c40a1390 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:51.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.070+0000 7f34eae00640 1 --2- 172.21.15.99:0/3971973613 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f34e4189450 0x7f34e40cea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:51.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.070+0000 7f34eae00640 1 --2- 172.21.15.99:0/3971973613 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f34e4074ba0 0x7f34e4167150 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:51.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.070+0000 7f34eae00640 1 --2- 172.21.15.99:0/3971973613 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34e40740b0 0x7f34e4171380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:51.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.070+0000 7f34eae00640 1 -- 172.21.15.99:0/3971973613 >> 172.21.15.99:0/3971973613 conn(0x7f34e408cfd0 msgr2=0x7f34e4066c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:51.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.070+0000 7f34eae00640 1 -- 172.21.15.99:0/3971973613 shutdown_connections 2024-02-21T23:12:51.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.070+0000 7f34eae00640 1 -- 172.21.15.99:0/3971973613 wait complete. 2024-02-21T23:12:51.079 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-21T23:00:57.020557+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 11.760000228881836, 'score_stable': 11.760000228881836, 'optimal_score': 0.17000000178813934, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-21T23:01:01.124398+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-21T23:01:01.684258+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 15, 'snap_epoch': 39, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-02-21T23:01:05.290089+0000', 'flags': 8197, 'flags_names': 'hashpspool,ec_overwrites,selfmanaged_snaps', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 15, 'snap_epoch': 39, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-02-21T23:12:51.080 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-21T23:12:51.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.308+0000 7fce9b800640 1 Processor -- start 2024-02-21T23:12:51.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.308+0000 7fce9b800640 1 -- start start 2024-02-21T23:12:51.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.310+0000 7fce9b800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fce941899b0 0x7fce9406e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:51.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.310+0000 7fce9b800640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce9418a330 con 0x7fce94186650 2024-02-21T23:12:51.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.310+0000 7fce9b800640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce9418a610 con 0x7fce9406ee50 2024-02-21T23:12:51.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.310+0000 7fce9b800640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce9418a0e0 con 0x7fce941899b0 2024-02-21T23:12:51.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.310+0000 7fce93e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fce941899b0 0x7fce9406e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:51.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.310+0000 7fce98e00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fce94186650 0x7fce9418b6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:54824/0 (socket says 172.21.15.99:54824) 2024-02-21T23:12:51.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.310+0000 7fce93e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fce941899b0 0x7fce9406e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40082/0 (socket says 172.21.15.99:40082) 2024-02-21T23:12:51.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.310+0000 7fce98e00640 1 -- 172.21.15.99:0/3136255972 learned_addr learned my addr 172.21.15.99:0/3136255972 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:12:51.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.311+0000 7fce93e00640 1 -- 172.21.15.99:0/3136255972 >> v1:172.21.15.181:6789/0 conn(0x7fce9406ee50 legacy=0x7fce9406f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:51.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.311+0000 7fce93e00640 1 -- 172.21.15.99:0/3136255972 >> v1:172.21.15.99:6789/0 conn(0x7fce94186650 legacy=0x7fce9418b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:51.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.311+0000 7fce93e00640 1 -- 172.21.15.99:0/3136255972 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce9418a8f0 con 0x7fce941899b0 2024-02-21T23:12:51.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.312+0000 7fce93e00640 1 --2- 172.21.15.99:0/3136255972 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce941899b0 0x7fce9406e910 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fce80009720 tx=0x7fce8002b450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d1f400268cb2e57 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:51.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.313+0000 7fce93400640 1 -- 172.21.15.99:0/3136255972 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce80037070 con 0x7fce941899b0 2024-02-21T23:12:51.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.313+0000 7fce93400640 1 -- 172.21.15.99:0/3136255972 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce80030710 con 0x7fce941899b0 2024-02-21T23:12:51.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.313+0000 7fce93400640 1 -- 172.21.15.99:0/3136255972 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce80030ae0 con 0x7fce941899b0 2024-02-21T23:12:51.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.314+0000 7fce9b800640 1 -- 172.21.15.99:0/3136255972 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce941899b0 msgr2=0x7fce9406e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:51.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.314+0000 7fce9b800640 1 --2- 172.21.15.99:0/3136255972 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce941899b0 0x7fce9406e910 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fce80009720 tx=0x7fce8002b450 comp rx=0 tx=0).stop 2024-02-21T23:12:51.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.314+0000 7fce9b800640 1 -- 172.21.15.99:0/3136255972 shutdown_connections 2024-02-21T23:12:51.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.314+0000 7fce9b800640 1 --2- 172.21.15.99:0/3136255972 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce941899b0 0x7fce9406e910 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:51.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.314+0000 7fce9b800640 1 -- 172.21.15.99:0/3136255972 >> 172.21.15.99:0/3136255972 conn(0x7fce940ce5f0 msgr2=0x7fce940cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:51.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.314+0000 7fce9b800640 1 -- 172.21.15.99:0/3136255972 shutdown_connections 2024-02-21T23:12:51.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.314+0000 7fce9b800640 1 -- 172.21.15.99:0/3136255972 wait complete. 2024-02-21T23:12:51.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.316+0000 7fce9b800640 1 Processor -- start 2024-02-21T23:12:51.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.316+0000 7fce9b800640 1 -- start start 2024-02-21T23:12:51.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.318+0000 7fce9b800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce9406ee50 0x7fce94169530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:51.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.319+0000 7fce9b800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce94186650 0x7fce9416ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:51.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.319+0000 7fce9b800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fce941899b0 0x7fce9418bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:51.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.319+0000 7fce9b800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce9418b190 con 0x7fce94186650 2024-02-21T23:12:51.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.319+0000 7fce9b800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce9418aeb0 con 0x7fce9406ee50 2024-02-21T23:12:51.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.319+0000 7fce9b800640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce94186b60 con 0x7fce941899b0 2024-02-21T23:12:51.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.319+0000 7fce93e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce94186650 0x7fce9416ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:51.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.319+0000 7fce99800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fce941899b0 0x7fce9418bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:51.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.319+0000 7fce93e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce94186650 0x7fce9416ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40090/0 (socket says 172.21.15.99:40090) 2024-02-21T23:12:51.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.319+0000 7fce93e00640 1 -- 172.21.15.99:0/3774674208 learned_addr learned my addr 172.21.15.99:0/3774674208 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:12:51.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.320+0000 7fce93e00640 1 -- 172.21.15.99:0/3774674208 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fce941899b0 msgr2=0x7fce9418bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:51.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.320+0000 7fce93e00640 1 --2- 172.21.15.99:0/3774674208 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fce941899b0 0x7fce9418bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:51.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.320+0000 7fce93e00640 1 -- 172.21.15.99:0/3774674208 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce9406ee50 msgr2=0x7fce94169530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:51.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.320+0000 7fce93e00640 1 --2- 172.21.15.99:0/3774674208 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce9406ee50 0x7fce94169530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:51.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.320+0000 7fce93e00640 1 -- 172.21.15.99:0/3774674208 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce942225c0 con 0x7fce94186650 2024-02-21T23:12:51.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.320+0000 7fce93e00640 1 --2- 172.21.15.99:0/3774674208 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce94186650 0x7fce9416ed00 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fce80009840 tx=0x7fce800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:51.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.321+0000 7fce90c00640 1 -- 172.21.15.99:0/3774674208 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce80041020 con 0x7fce94186650 2024-02-21T23:12:51.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.321+0000 7fce90c00640 1 -- 172.21.15.99:0/3774674208 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce8003d750 con 0x7fce94186650 2024-02-21T23:12:51.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.321+0000 7fce90c00640 1 -- 172.21.15.99:0/3774674208 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce80037040 con 0x7fce94186650 2024-02-21T23:12:51.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.321+0000 7fce9b800640 1 -- 172.21.15.99:0/3774674208 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce942228a0 con 0x7fce94186650 2024-02-21T23:12:51.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.322+0000 7fce9b800640 1 -- 172.21.15.99:0/3774674208 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce94222e60 con 0x7fce94186650 2024-02-21T23:12:51.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.323+0000 7fce9b800640 1 -- 172.21.15.99:0/3774674208 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce940cf260 con 0x7fce94186650 2024-02-21T23:12:51.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.325+0000 7fce90c00640 1 -- 172.21.15.99:0/3774674208 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7fce80044020 con 0x7fce94186650 2024-02-21T23:12:51.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.327+0000 7fce90c00640 1 --2- 172.21.15.99:0/3774674208 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fce7409eed0 0x7fce740a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:51.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.327+0000 7fce90c00640 1 -- 172.21.15.99:0/3774674208 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 8877+0+0 (secure 0 0 0) 0x7fce800ebd10 con 0x7fce94186650 2024-02-21T23:12:51.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.327+0000 7fce98e00640 1 --2- 172.21.15.99:0/3774674208 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fce7409eed0 0x7fce740a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:51.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.328+0000 7fce98e00640 1 --2- 172.21.15.99:0/3774674208 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fce7409eed0 0x7fce740a1390 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fce88000c00 tx=0x7fce88007a60 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:51.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.333+0000 7fce90c00640 1 -- 172.21.15.99:0/3774674208 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fce940cf260 con 0x7fce94186650 2024-02-21T23:12:51.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.531+0000 7fce9b800640 1 -- 172.21.15.99:0/3774674208 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fce94068780 con 0x7fce94186650 2024-02-21T23:12:51.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.531+0000 7fce90c00640 1 -- 172.21.15.99:0/3774674208 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7fce8004b030 con 0x7fce94186650 2024-02-21T23:12:51.519 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 1 2024-02-21T23:12:51.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.534+0000 7fce9b800640 1 -- 172.21.15.99:0/3774674208 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fce7409eed0 msgr2=0x7fce740a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:51.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.534+0000 7fce9b800640 1 --2- 172.21.15.99:0/3774674208 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fce7409eed0 0x7fce740a1390 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fce88000c00 tx=0x7fce88007a60 comp rx=0 tx=0).stop 2024-02-21T23:12:51.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.534+0000 7fce9b800640 1 -- 172.21.15.99:0/3774674208 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce94186650 msgr2=0x7fce9416ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:51.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.534+0000 7fce9b800640 1 --2- 172.21.15.99:0/3774674208 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce94186650 0x7fce9416ed00 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fce80009840 tx=0x7fce800046c0 comp rx=0 tx=0).stop 2024-02-21T23:12:51.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.534+0000 7fce9b800640 1 -- 172.21.15.99:0/3774674208 shutdown_connections 2024-02-21T23:12:51.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.534+0000 7fce9b800640 1 --2- 172.21.15.99:0/3774674208 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fce7409eed0 0x7fce740a1390 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:51.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.534+0000 7fce9b800640 1 --2- 172.21.15.99:0/3774674208 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fce941899b0 0x7fce9418bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:51.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.534+0000 7fce9b800640 1 --2- 172.21.15.99:0/3774674208 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fce94186650 0x7fce9416ed00 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:51.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.534+0000 7fce9b800640 1 --2- 172.21.15.99:0/3774674208 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce9406ee50 0x7fce94169530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:51.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.535+0000 7fce9b800640 1 -- 172.21.15.99:0/3774674208 >> 172.21.15.99:0/3774674208 conn(0x7fce940ce5f0 msgr2=0x7fce94181530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:51.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.535+0000 7fce9b800640 1 -- 172.21.15.99:0/3774674208 shutdown_connections 2024-02-21T23:12:51.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.535+0000 7fce9b800640 1 -- 172.21.15.99:0/3774674208 wait complete. 2024-02-21T23:12:51.541 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-21T23:12:51.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.747+0000 7f88a5e00640 1 Processor -- start 2024-02-21T23:12:51.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.747+0000 7f88a5e00640 1 -- start start 2024-02-21T23:12:51.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.749+0000 7f88a5e00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f88a00fce30 0x7f88a00fb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:51.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.749+0000 7f88a5e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f88a0187440 0x7f88a018f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:51.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.749+0000 7f88a5e00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88a00fd490 con 0x7f88a01648c0 2024-02-21T23:12:51.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.749+0000 7f88a5e00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88a00fd770 con 0x7f88a0187440 2024-02-21T23:12:51.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.749+0000 7f88a5e00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88a00fda50 con 0x7f88a00fce30 2024-02-21T23:12:51.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.749+0000 7f88a4a00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f88a01648c0 0x7f88a0186d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:54826/0 (socket says 172.21.15.99:54826) 2024-02-21T23:12:51.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.749+0000 7f88a4a00640 1 -- 172.21.15.99:0/768617150 learned_addr learned my addr 172.21.15.99:0/768617150 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:12:51.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.749+0000 7f889fe00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f88a00fce30 0x7f88a00fb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:51.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.750+0000 7f88a5400640 1 --2- 172.21.15.99:0/768617150 >> v2:172.21.15.162:3300/0 conn(0x7f88a0187440 0x7f88a018f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:51.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.750+0000 7f889fe00640 1 -- 172.21.15.99:0/768617150 >> v2:172.21.15.162:3300/0 conn(0x7f88a0187440 msgr2=0x7f88a018f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:51.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.750+0000 7f889fe00640 1 --2- 172.21.15.99:0/768617150 >> v2:172.21.15.162:3300/0 conn(0x7f88a0187440 0x7f88a018f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:51.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.750+0000 7f889fe00640 1 -- 172.21.15.99:0/768617150 >> v1:172.21.15.99:6789/0 conn(0x7f88a01648c0 legacy=0x7f88a0186d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:51.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.750+0000 7f889fe00640 1 -- 172.21.15.99:0/768617150 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88a00fdd30 con 0x7f88a00fce30 2024-02-21T23:12:51.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.750+0000 7f889f400640 1 -- 172.21.15.99:0/768617150 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3096530711 0 0) 0x7f88a00fd490 con 0x7f88a01648c0 2024-02-21T23:12:51.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.751+0000 7f889fe00640 1 --2- 172.21.15.99:0/768617150 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f88a00fce30 0x7f88a00fb9e0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f88a0186820 tx=0x7f888c02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7550cd084272f03 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:51.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.751+0000 7f889f400640 1 -- 172.21.15.99:0/768617150 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f888c035020 con 0x7f88a00fce30 2024-02-21T23:12:51.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.752+0000 7f889f400640 1 -- 172.21.15.99:0/768617150 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f888c031830 con 0x7f88a00fce30 2024-02-21T23:12:51.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.752+0000 7f889f400640 1 -- 172.21.15.99:0/768617150 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f888c031c00 con 0x7f88a00fce30 2024-02-21T23:12:51.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.752+0000 7f88a5e00640 1 -- 172.21.15.99:0/768617150 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f88a00fce30 msgr2=0x7f88a00fb9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:51.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.752+0000 7f88a5e00640 1 --2- 172.21.15.99:0/768617150 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f88a00fce30 0x7f88a00fb9e0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f88a0186820 tx=0x7f888c02b8d0 comp rx=0 tx=0).stop 2024-02-21T23:12:51.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.752+0000 7f88a5e00640 1 -- 172.21.15.99:0/768617150 shutdown_connections 2024-02-21T23:12:51.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.752+0000 7f88a5e00640 1 --2- 172.21.15.99:0/768617150 >> v2:172.21.15.162:3300/0 conn(0x7f88a0187440 0x7f88a018f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:51.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.752+0000 7f88a5e00640 1 --2- 172.21.15.99:0/768617150 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f88a00fce30 0x7f88a00fb9e0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:51.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.752+0000 7f88a5e00640 1 -- 172.21.15.99:0/768617150 >> 172.21.15.99:0/768617150 conn(0x7f88a00d29c0 msgr2=0x7f88a00d2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:51.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.753+0000 7f88a5e00640 1 -- 172.21.15.99:0/768617150 shutdown_connections 2024-02-21T23:12:51.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.753+0000 7f88a5e00640 1 -- 172.21.15.99:0/768617150 wait complete. 2024-02-21T23:12:51.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.756+0000 7f88a5e00640 1 Processor -- start 2024-02-21T23:12:51.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.756+0000 7f88a5e00640 1 -- start start 2024-02-21T23:12:51.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.758+0000 7f88a5e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f88a00fce30 0x7f88a01627d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:51.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.758+0000 7f88a5e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88a01648c0 0x7f88a00fbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:51.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.758+0000 7f88a5e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f88a0187440 0x7f88a021dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:51.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.758+0000 7f88a5e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88a01878d0 con 0x7f88a01648c0 2024-02-21T23:12:51.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.758+0000 7f88a5e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88a0072920 con 0x7f88a00fce30 2024-02-21T23:12:51.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.758+0000 7f88a5e00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88a018f880 con 0x7f88a0187440 2024-02-21T23:12:51.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.758+0000 7f889fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88a01648c0 0x7f88a00fbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:51.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.758+0000 7f889fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88a01648c0 0x7f88a00fbbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40106/0 (socket says 172.21.15.99:40106) 2024-02-21T23:12:51.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.758+0000 7f889fe00640 1 -- 172.21.15.99:0/1057316952 learned_addr learned my addr 172.21.15.99:0/1057316952 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:12:51.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.758+0000 7f88a4a00640 1 --2- 172.21.15.99:0/1057316952 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f88a00fce30 0x7f88a01627d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:51.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.759+0000 7f88a5400640 1 --2- 172.21.15.99:0/1057316952 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f88a0187440 0x7f88a021dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:51.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.759+0000 7f889fe00640 1 -- 172.21.15.99:0/1057316952 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f88a0187440 msgr2=0x7f88a021dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:51.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.759+0000 7f889fe00640 1 --2- 172.21.15.99:0/1057316952 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f88a0187440 0x7f88a021dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:51.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.759+0000 7f889fe00640 1 -- 172.21.15.99:0/1057316952 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f88a00fce30 msgr2=0x7f88a01627d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:51.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.759+0000 7f889fe00640 1 --2- 172.21.15.99:0/1057316952 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f88a00fce30 0x7f88a01627d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:51.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.759+0000 7f889fe00640 1 -- 172.21.15.99:0/1057316952 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88a00d22f0 con 0x7f88a01648c0 2024-02-21T23:12:51.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.759+0000 7f88a4a00640 1 --2- 172.21.15.99:0/1057316952 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f88a00fce30 0x7f88a01627d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:12:51.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.759+0000 7f889fe00640 1 --2- 172.21.15.99:0/1057316952 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88a01648c0 0x7f88a00fbbf0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f888c000c00 tx=0x7f888c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:51.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.760+0000 7f889cc00640 1 -- 172.21.15.99:0/1057316952 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f888c040070 con 0x7f88a01648c0 2024-02-21T23:12:51.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.760+0000 7f889cc00640 1 -- 172.21.15.99:0/1057316952 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f888c03a910 con 0x7f88a01648c0 2024-02-21T23:12:51.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.760+0000 7f889cc00640 1 -- 172.21.15.99:0/1057316952 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f888c035040 con 0x7f88a01648c0 2024-02-21T23:12:51.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.760+0000 7f88a5e00640 1 -- 172.21.15.99:0/1057316952 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88a00d1a10 con 0x7f88a01648c0 2024-02-21T23:12:51.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.760+0000 7f88a5e00640 1 -- 172.21.15.99:0/1057316952 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88a021d0e0 con 0x7f88a01648c0 2024-02-21T23:12:51.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.761+0000 7f88a5e00640 1 -- 172.21.15.99:0/1057316952 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88a00ff320 con 0x7f88a01648c0 2024-02-21T23:12:51.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.763+0000 7f889cc00640 1 -- 172.21.15.99:0/1057316952 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f888c04b060 con 0x7f88a01648c0 2024-02-21T23:12:51.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.766+0000 7f889cc00640 1 --2- 172.21.15.99:0/1057316952 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f888009eed0 0x7f88800a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:51.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.766+0000 7f889cc00640 1 -- 172.21.15.99:0/1057316952 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f888c0eba70 con 0x7f88a01648c0 2024-02-21T23:12:51.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.766+0000 7f88a4a00640 1 --2- 172.21.15.99:0/1057316952 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f888009eed0 0x7f88800a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:51.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.767+0000 7f88a4a00640 1 --2- 172.21.15.99:0/1057316952 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f888009eed0 0x7f88800a1390 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8894000f60 tx=0x7f8894007e40 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:51.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:51.769+0000 7f889cc00640 1 -- 172.21.15.99:0/1057316952 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f88a00ff320 con 0x7f88a01648c0 2024-02-21T23:12:51.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.005+0000 7f88a5e00640 1 -- 172.21.15.99:0/1057316952 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f88a0068320 con 0x7f88a01648c0 2024-02-21T23:12:51.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.006+0000 7f889cc00640 1 -- 172.21.15.99:0/1057316952 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v40) v1 ==== 104+0+11 (secure 0 0 0) 0x7f888c0b9a20 con 0x7f88a01648c0 2024-02-21T23:12:51.994 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 32 2024-02-21T23:12:51.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.008+0000 7f88a5e00640 1 -- 172.21.15.99:0/1057316952 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f888009eed0 msgr2=0x7f88800a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:51.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.008+0000 7f88a5e00640 1 --2- 172.21.15.99:0/1057316952 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f888009eed0 0x7f88800a1390 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8894000f60 tx=0x7f8894007e40 comp rx=0 tx=0).stop 2024-02-21T23:12:51.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.008+0000 7f88a5e00640 1 -- 172.21.15.99:0/1057316952 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88a01648c0 msgr2=0x7f88a00fbbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:51.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.008+0000 7f88a5e00640 1 --2- 172.21.15.99:0/1057316952 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88a01648c0 0x7f88a00fbbf0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f888c000c00 tx=0x7f888c0046c0 comp rx=0 tx=0).stop 2024-02-21T23:12:51.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.008+0000 7f88a5e00640 1 -- 172.21.15.99:0/1057316952 shutdown_connections 2024-02-21T23:12:51.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.008+0000 7f88a5e00640 1 --2- 172.21.15.99:0/1057316952 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f888009eed0 0x7f88800a1390 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:51.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.008+0000 7f88a5e00640 1 --2- 172.21.15.99:0/1057316952 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f88a0187440 0x7f88a021dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:51.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.008+0000 7f88a5e00640 1 --2- 172.21.15.99:0/1057316952 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f88a01648c0 0x7f88a00fbbf0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:51.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.008+0000 7f88a5e00640 1 --2- 172.21.15.99:0/1057316952 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f88a00fce30 0x7f88a01627d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:51.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.008+0000 7f88a5e00640 1 -- 172.21.15.99:0/1057316952 >> 172.21.15.99:0/1057316952 conn(0x7f88a00d29c0 msgr2=0x7f88a00d2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:51.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.008+0000 7f88a5e00640 1 -- 172.21.15.99:0/1057316952 shutdown_connections 2024-02-21T23:12:51.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.008+0000 7f88a5e00640 1 -- 172.21.15.99:0/1057316952 wait complete. 2024-02-21T23:12:52.014 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-21T23:12:52.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.214+0000 7fb82ca00640 1 Processor -- start 2024-02-21T23:12:52.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.214+0000 7fb82ca00640 1 -- start start 2024-02-21T23:12:52.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.216+0000 7fb82ca00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb8280fce30 0x7fb8280fb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:52.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.216+0000 7fb82ca00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8280fd490 con 0x7fb8281648c0 2024-02-21T23:12:52.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.216+0000 7fb82ca00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8280fd770 con 0x7fb828187440 2024-02-21T23:12:52.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.216+0000 7fb82ca00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8280fda50 con 0x7fb8280fce30 2024-02-21T23:12:52.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.216+0000 7fb81ea00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb8280fce30 0x7fb8280fb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:52.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.216+0000 7fb81ea00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fb8280fce30 0x7fb8280fb9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40108/0 (socket says 172.21.15.99:40108) 2024-02-21T23:12:52.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.216+0000 7fb81ea00640 1 -- 172.21.15.99:0/498890326 learned_addr learned my addr 172.21.15.99:0/498890326 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:12:52.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.216+0000 7fb81ea00640 1 -- 172.21.15.99:0/498890326 >> v1:172.21.15.162:6789/0 conn(0x7fb828187440 legacy=0x7fb82818f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:52.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.216+0000 7fb81ea00640 1 -- 172.21.15.99:0/498890326 >> v1:172.21.15.99:6789/0 conn(0x7fb8281648c0 legacy=0x7fb828186d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:52.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.217+0000 7fb81ea00640 1 -- 172.21.15.99:0/498890326 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8280fdd30 con 0x7fb8280fce30 2024-02-21T23:12:52.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.218+0000 7fb81ea00640 1 --2- 172.21.15.99:0/498890326 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb8280fce30 0x7fb8280fb9e0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fb810009870 tx=0x7fb81002ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85ddc0402b7ca75b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:52.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.218+0000 7fb826a00640 1 -- 172.21.15.99:0/498890326 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81002f850 con 0x7fb8280fce30 2024-02-21T23:12:52.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.218+0000 7fb826a00640 1 -- 172.21.15.99:0/498890326 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb81002f9f0 con 0x7fb8280fce30 2024-02-21T23:12:52.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.218+0000 7fb826a00640 1 -- 172.21.15.99:0/498890326 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81002fdc0 con 0x7fb8280fce30 2024-02-21T23:12:52.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.218+0000 7fb82ca00640 1 -- 172.21.15.99:0/498890326 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb8280fce30 msgr2=0x7fb8280fb9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:52.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.218+0000 7fb82ca00640 1 --2- 172.21.15.99:0/498890326 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb8280fce30 0x7fb8280fb9e0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fb810009870 tx=0x7fb81002ba30 comp rx=0 tx=0).stop 2024-02-21T23:12:52.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.219+0000 7fb82ca00640 1 -- 172.21.15.99:0/498890326 shutdown_connections 2024-02-21T23:12:52.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.219+0000 7fb82ca00640 1 --2- 172.21.15.99:0/498890326 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb8280fce30 0x7fb8280fb9e0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:52.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.219+0000 7fb82ca00640 1 -- 172.21.15.99:0/498890326 >> 172.21.15.99:0/498890326 conn(0x7fb8280d29c0 msgr2=0x7fb8280d2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:52.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.219+0000 7fb82ca00640 1 -- 172.21.15.99:0/498890326 shutdown_connections 2024-02-21T23:12:52.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.219+0000 7fb82ca00640 1 -- 172.21.15.99:0/498890326 wait complete. 2024-02-21T23:12:52.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.221+0000 7fb82ca00640 1 Processor -- start 2024-02-21T23:12:52.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.221+0000 7fb82ca00640 1 -- start start 2024-02-21T23:12:52.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.222+0000 7fb82ca00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb8280fce30 0x7fb82817aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:52.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.222+0000 7fb82ca00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8281648c0 0x7fb8280d0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:52.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.222+0000 7fb82ca00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb828187440 0x7fb828160ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:52.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.222+0000 7fb82ca00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8281878d0 con 0x7fb828187440 2024-02-21T23:12:52.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.222+0000 7fb82ca00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb828072920 con 0x7fb8281648c0 2024-02-21T23:12:52.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.222+0000 7fb82ca00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb828190a60 con 0x7fb8280fce30 2024-02-21T23:12:52.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.222+0000 7fb827e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb828187440 0x7fb828160ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:52.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.222+0000 7fb81ea00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8281648c0 0x7fb8280d0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:52.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.222+0000 7fb827e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb828187440 0x7fb828160ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40120/0 (socket says 172.21.15.99:40120) 2024-02-21T23:12:52.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.222+0000 7fb827e00640 1 -- 172.21.15.99:0/2112228910 learned_addr learned my addr 172.21.15.99:0/2112228910 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:12:52.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.222+0000 7fb827400640 1 --2- 172.21.15.99:0/2112228910 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb8280fce30 0x7fb82817aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:52.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.223+0000 7fb81ea00640 1 -- 172.21.15.99:0/2112228910 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb8280fce30 msgr2=0x7fb82817aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:52.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.223+0000 7fb81ea00640 1 --2- 172.21.15.99:0/2112228910 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb8280fce30 0x7fb82817aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:52.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.223+0000 7fb81ea00640 1 -- 172.21.15.99:0/2112228910 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb828187440 msgr2=0x7fb828160ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:52.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.223+0000 7fb81ea00640 1 --2- 172.21.15.99:0/2112228910 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb828187440 0x7fb828160ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:52.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.223+0000 7fb81ea00640 1 -- 172.21.15.99:0/2112228910 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8280d05b0 con 0x7fb8281648c0 2024-02-21T23:12:52.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.223+0000 7fb827e00640 1 --2- 172.21.15.99:0/2112228910 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb828187440 0x7fb828160ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:12:52.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.223+0000 7fb81ea00640 1 --2- 172.21.15.99:0/2112228910 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8281648c0 0x7fb8280d0d70 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fb810033000 tx=0x7fb810004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:52.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.224+0000 7fb81fe00640 1 -- 172.21.15.99:0/2112228910 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb810041400 con 0x7fb8281648c0 2024-02-21T23:12:52.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.224+0000 7fb81fe00640 1 -- 172.21.15.99:0/2112228910 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb810046070 con 0x7fb8281648c0 2024-02-21T23:12:52.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.224+0000 7fb81fe00640 1 -- 172.21.15.99:0/2112228910 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8100417e0 con 0x7fb8281648c0 2024-02-21T23:12:52.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.224+0000 7fb82ca00640 1 -- 172.21.15.99:0/2112228910 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb82821f560 con 0x7fb8281648c0 2024-02-21T23:12:52.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.224+0000 7fb82ca00640 1 -- 172.21.15.99:0/2112228910 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb82821fb20 con 0x7fb8281648c0 2024-02-21T23:12:52.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.225+0000 7fb82ca00640 1 -- 172.21.15.99:0/2112228910 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb828068320 con 0x7fb8281648c0 2024-02-21T23:12:52.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.228+0000 7fb81fe00640 1 -- 172.21.15.99:0/2112228910 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7fb810040070 con 0x7fb8281648c0 2024-02-21T23:12:52.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.230+0000 7fb81fe00640 1 --2- 172.21.15.99:0/2112228910 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fb80409eed0 0x7fb8040a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:52.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.230+0000 7fb81fe00640 1 -- 172.21.15.99:0/2112228910 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 8877+0+0 (secure 0 0 0) 0x7fb8100ec6a0 con 0x7fb8281648c0 2024-02-21T23:12:52.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.230+0000 7fb827400640 1 --2- 172.21.15.99:0/2112228910 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fb80409eed0 0x7fb8040a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:52.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.231+0000 7fb827400640 1 --2- 172.21.15.99:0/2112228910 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fb80409eed0 0x7fb8040a1390 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb8281642d0 tx=0x7fb818009040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:52.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.234+0000 7fb81fe00640 1 -- 172.21.15.99:0/2112228910 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fb810033030 con 0x7fb8281648c0 2024-02-21T23:12:52.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.539+0000 7fb82ca00640 1 -- 172.21.15.99:0/2112228910 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb8281632e0 con 0x7fb8281648c0 2024-02-21T23:12:52.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.539+0000 7fb81fe00640 1 -- 172.21.15.99:0/2112228910 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v40) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb8100ba540 con 0x7fb8281648c0 2024-02-21T23:12:52.527 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 64 2024-02-21T23:12:52.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.542+0000 7fb82ca00640 1 -- 172.21.15.99:0/2112228910 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fb80409eed0 msgr2=0x7fb8040a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:52.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.542+0000 7fb82ca00640 1 --2- 172.21.15.99:0/2112228910 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fb80409eed0 0x7fb8040a1390 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb8281642d0 tx=0x7fb818009040 comp rx=0 tx=0).stop 2024-02-21T23:12:52.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.542+0000 7fb82ca00640 1 -- 172.21.15.99:0/2112228910 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8281648c0 msgr2=0x7fb8280d0d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:52.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.542+0000 7fb82ca00640 1 --2- 172.21.15.99:0/2112228910 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8281648c0 0x7fb8280d0d70 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fb810033000 tx=0x7fb810004730 comp rx=0 tx=0).stop 2024-02-21T23:12:52.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.542+0000 7fb82ca00640 1 -- 172.21.15.99:0/2112228910 shutdown_connections 2024-02-21T23:12:52.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.542+0000 7fb82ca00640 1 --2- 172.21.15.99:0/2112228910 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fb80409eed0 0x7fb8040a1390 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:52.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.542+0000 7fb82ca00640 1 --2- 172.21.15.99:0/2112228910 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb828187440 0x7fb828160ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:52.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.542+0000 7fb82ca00640 1 --2- 172.21.15.99:0/2112228910 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8281648c0 0x7fb8280d0d70 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:52.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.542+0000 7fb82ca00640 1 --2- 172.21.15.99:0/2112228910 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb8280fce30 0x7fb82817aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:52.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.542+0000 7fb82ca00640 1 -- 172.21.15.99:0/2112228910 >> 172.21.15.99:0/2112228910 conn(0x7fb8280d29c0 msgr2=0x7fb828186d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:52.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.542+0000 7fb82ca00640 1 -- 172.21.15.99:0/2112228910 shutdown_connections 2024-02-21T23:12:52.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.543+0000 7fb82ca00640 1 -- 172.21.15.99:0/2112228910 wait complete. 2024-02-21T23:12:52.553 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-02-21T23:12:52.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.783+0000 7f9926600640 1 Processor -- start 2024-02-21T23:12:52.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.784+0000 7f9926600640 1 -- start start 2024-02-21T23:12:52.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.785+0000 7f9926600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f99201648c0 0x7f99200fce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:52.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.785+0000 7f9926600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f9920186d30 0x7f99200fb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:52.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.785+0000 7f9926600640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f9920187190 0x7f9920187620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:52.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.786+0000 7f9926600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99200fd490 con 0x7f9920186d30 2024-02-21T23:12:52.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.786+0000 7f9926600640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99200fd770 con 0x7f99201648c0 2024-02-21T23:12:52.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.786+0000 7f9926600640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99200fda50 con 0x7f9920187190 2024-02-21T23:12:52.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.786+0000 7f991fe00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f9920186d30 0x7f99200fb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:52.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.786+0000 7f9925200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f99201648c0 0x7f99200fce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:52.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.786+0000 7f991fe00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f9920186d30 0x7f99200fb9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40136/0 (socket says 172.21.15.99:40136) 2024-02-21T23:12:52.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.786+0000 7f991fe00640 1 -- 172.21.15.99:0/3469875727 learned_addr learned my addr 172.21.15.99:0/3469875727 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:12:52.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.786+0000 7f9925c00640 1 --2- 172.21.15.99:0/3469875727 >> v2:172.21.15.181:3300/0 conn(0x7f9920187190 0x7f9920187620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:52.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.786+0000 7f9925200640 1 -- 172.21.15.99:0/3469875727 >> v2:172.21.15.181:3300/0 conn(0x7f9920187190 msgr2=0x7f9920187620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:52.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.786+0000 7f9925200640 1 --2- 172.21.15.99:0/3469875727 >> v2:172.21.15.181:3300/0 conn(0x7f9920187190 0x7f9920187620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:52.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.786+0000 7f9925200640 1 -- 172.21.15.99:0/3469875727 >> v2:172.21.15.99:3300/0 conn(0x7f9920186d30 msgr2=0x7f99200fb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:52.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.786+0000 7f9925200640 1 --2- 172.21.15.99:0/3469875727 >> v2:172.21.15.99:3300/0 conn(0x7f9920186d30 0x7f99200fb9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:52.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.786+0000 7f9925200640 1 -- 172.21.15.99:0/3469875727 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99200fdd30 con 0x7f99201648c0 2024-02-21T23:12:52.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.788+0000 7f9925200640 1 --2- 172.21.15.99:0/3469875727 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f99201648c0 0x7f99200fce30 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f9920072300 tx=0x7f991402b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=febf0e66679c7492 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:52.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.789+0000 7f991f400640 1 -- 172.21.15.99:0/3469875727 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99140317c0 con 0x7f99201648c0 2024-02-21T23:12:52.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.789+0000 7f991f400640 1 -- 172.21.15.99:0/3469875727 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9914037070 con 0x7f99201648c0 2024-02-21T23:12:52.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.789+0000 7f991f400640 1 -- 172.21.15.99:0/3469875727 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9914031b80 con 0x7f99201648c0 2024-02-21T23:12:52.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.789+0000 7f9926600640 1 -- 172.21.15.99:0/3469875727 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f99201648c0 msgr2=0x7f99200fce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:52.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.789+0000 7f9926600640 1 --2- 172.21.15.99:0/3469875727 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f99201648c0 0x7f99200fce30 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f9920072300 tx=0x7f991402b860 comp rx=0 tx=0).stop 2024-02-21T23:12:52.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.789+0000 7f9926600640 1 -- 172.21.15.99:0/3469875727 shutdown_connections 2024-02-21T23:12:52.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.789+0000 7f9926600640 1 --2- 172.21.15.99:0/3469875727 >> v2:172.21.15.99:3300/0 conn(0x7f9920186d30 0x7f99200fb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:52.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.789+0000 7f9926600640 1 --2- 172.21.15.99:0/3469875727 >> v2:172.21.15.181:3300/0 conn(0x7f9920187190 0x7f9920187620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:52.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.789+0000 7f9926600640 1 --2- 172.21.15.99:0/3469875727 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f99201648c0 0x7f99200fce30 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:52.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.789+0000 7f9926600640 1 -- 172.21.15.99:0/3469875727 >> 172.21.15.99:0/3469875727 conn(0x7f99200d29c0 msgr2=0x7f99200d2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:52.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.790+0000 7f9926600640 1 -- 172.21.15.99:0/3469875727 shutdown_connections 2024-02-21T23:12:52.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.790+0000 7f9926600640 1 -- 172.21.15.99:0/3469875727 wait complete. 2024-02-21T23:12:52.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.792+0000 7f9926600640 1 Processor -- start 2024-02-21T23:12:52.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.793+0000 7f9926600640 1 -- start start 2024-02-21T23:12:52.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.794+0000 7f9926600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f99201648c0 0x7f9920161970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:52.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.794+0000 7f9926600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9920186d30 0x7f99200fa220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:52.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.794+0000 7f9926600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9920187190 0x7f992018a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:52.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.794+0000 7f9926600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99201889e0 con 0x7f9920186d30 2024-02-21T23:12:52.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.794+0000 7f9926600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9920072920 con 0x7f99201648c0 2024-02-21T23:12:52.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.794+0000 7f9926600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9920188b60 con 0x7f9920187190 2024-02-21T23:12:52.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.794+0000 7f991fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9920186d30 0x7f99200fa220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:52.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.794+0000 7f9925200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f99201648c0 0x7f9920161970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:52.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.794+0000 7f991fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9920186d30 0x7f99200fa220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40140/0 (socket says 172.21.15.99:40140) 2024-02-21T23:12:52.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.794+0000 7f991fe00640 1 -- 172.21.15.99:0/355085371 learned_addr learned my addr 172.21.15.99:0/355085371 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:12:52.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.794+0000 7f9925c00640 1 --2- 172.21.15.99:0/355085371 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9920187190 0x7f992018a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:52.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.795+0000 7f991fe00640 1 -- 172.21.15.99:0/355085371 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9920187190 msgr2=0x7f992018a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:52.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.795+0000 7f991fe00640 1 --2- 172.21.15.99:0/355085371 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9920187190 0x7f992018a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:52.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.795+0000 7f991fe00640 1 -- 172.21.15.99:0/355085371 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f99201648c0 msgr2=0x7f9920161970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:52.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.795+0000 7f991fe00640 1 --2- 172.21.15.99:0/355085371 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f99201648c0 0x7f9920161970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:52.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.795+0000 7f991fe00640 1 -- 172.21.15.99:0/355085371 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99200fab50 con 0x7f9920186d30 2024-02-21T23:12:52.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.795+0000 7f991fe00640 1 --2- 172.21.15.99:0/355085371 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9920186d30 0x7f99200fa220 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f990c00e8d0 tx=0x7f990c00ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:52.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.795+0000 7f991cc00640 1 -- 172.21.15.99:0/355085371 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f990c017070 con 0x7f9920186d30 2024-02-21T23:12:52.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.795+0000 7f991cc00640 1 -- 172.21.15.99:0/355085371 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f990c00c940 con 0x7f9920186d30 2024-02-21T23:12:52.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.795+0000 7f991cc00640 1 -- 172.21.15.99:0/355085371 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f990c00ccf0 con 0x7f9920186d30 2024-02-21T23:12:52.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.795+0000 7f9926600640 1 -- 172.21.15.99:0/355085371 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99200fae30 con 0x7f9920186d30 2024-02-21T23:12:52.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.796+0000 7f9926600640 1 -- 172.21.15.99:0/355085371 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99200fb3f0 con 0x7f9920186d30 2024-02-21T23:12:52.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.797+0000 7f9926600640 1 -- 172.21.15.99:0/355085371 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9920068320 con 0x7f9920186d30 2024-02-21T23:12:52.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.801+0000 7f991cc00640 1 -- 172.21.15.99:0/355085371 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f990c01a070 con 0x7f9920186d30 2024-02-21T23:12:52.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.803+0000 7f991cc00640 1 --2- 172.21.15.99:0/355085371 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f990009eed0 0x7f99000a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:52.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.803+0000 7f9925200640 1 --2- 172.21.15.99:0/355085371 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f990009eed0 0x7f99000a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:52.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.803+0000 7f991cc00640 1 -- 172.21.15.99:0/355085371 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f990c0ca580 con 0x7f9920186d30 2024-02-21T23:12:52.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.804+0000 7f991cc00640 1 -- 172.21.15.99:0/355085371 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f990c097ee0 con 0x7f9920186d30 2024-02-21T23:12:52.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:52.804+0000 7f9925200640 1 --2- 172.21.15.99:0/355085371 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f990009eed0 0x7f99000a1390 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9914036000 tx=0x7f991403d040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:53.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.072+0000 7f9926600640 1 -- 172.21.15.99:0/355085371 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f9920162980 con 0x7f9920186d30 2024-02-21T23:12:53.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.073+0000 7f991cc00640 1 -- 172.21.15.99:0/355085371 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v40) v1 ==== 103+0+11 (secure 0 0 0) 0x7f990c09bf80 con 0x7f9920186d30 2024-02-21T23:12:53.061 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 32 2024-02-21T23:12:53.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.075+0000 7f9926600640 1 -- 172.21.15.99:0/355085371 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f990009eed0 msgr2=0x7f99000a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:53.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.075+0000 7f9926600640 1 --2- 172.21.15.99:0/355085371 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f990009eed0 0x7f99000a1390 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9914036000 tx=0x7f991403d040 comp rx=0 tx=0).stop 2024-02-21T23:12:53.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.075+0000 7f9926600640 1 -- 172.21.15.99:0/355085371 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9920186d30 msgr2=0x7f99200fa220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:53.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.075+0000 7f9926600640 1 --2- 172.21.15.99:0/355085371 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9920186d30 0x7f99200fa220 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f990c00e8d0 tx=0x7f990c00ed90 comp rx=0 tx=0).stop 2024-02-21T23:12:53.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.075+0000 7f9926600640 1 -- 172.21.15.99:0/355085371 shutdown_connections 2024-02-21T23:12:53.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.075+0000 7f9926600640 1 --2- 172.21.15.99:0/355085371 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f990009eed0 0x7f99000a1390 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:53.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.075+0000 7f9926600640 1 --2- 172.21.15.99:0/355085371 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9920187190 0x7f992018a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:53.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.075+0000 7f9926600640 1 --2- 172.21.15.99:0/355085371 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9920186d30 0x7f99200fa220 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:53.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.075+0000 7f9926600640 1 --2- 172.21.15.99:0/355085371 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f99201648c0 0x7f9920161970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:53.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.075+0000 7f9926600640 1 -- 172.21.15.99:0/355085371 >> 172.21.15.99:0/355085371 conn(0x7f99200d29c0 msgr2=0x7f99200fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:53.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.076+0000 7f9926600640 1 -- 172.21.15.99:0/355085371 shutdown_connections 2024-02-21T23:12:53.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.076+0000 7f9926600640 1 -- 172.21.15.99:0/355085371 wait complete. 2024-02-21T23:12:53.089 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-02-21T23:12:53.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.310+0000 7fa997800640 1 Processor -- start 2024-02-21T23:12:53.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.310+0000 7fa997800640 1 -- start start 2024-02-21T23:12:53.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.314+0000 7fa997800640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9900fd900 con 0x7fa9900f8f00 2024-02-21T23:12:53.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.314+0000 7fa997800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa990188ac0 con 0x7fa9900fd490 2024-02-21T23:12:53.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.314+0000 7fa997800640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa990187030 con 0x7fa990182e90 2024-02-21T23:12:53.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.314+0000 7fa98fe00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fa9900f8f00 0x7fa99018c250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:54840/0 (socket says 172.21.15.99:54840) 2024-02-21T23:12:53.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.314+0000 7fa98fe00640 1 -- 172.21.15.99:0/249037757 learned_addr learned my addr 172.21.15.99:0/249037757 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:12:53.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.314+0000 7fa994e00640 1 --1- 172.21.15.99:0/249037757 >> v1:172.21.15.181:6789/0 conn(0x7fa990182e90 0x7fa9901883b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:35086/0 (socket says 172.21.15.99:35086) 2024-02-21T23:12:53.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.314+0000 7fa98f400640 1 -- 172.21.15.99:0/249037757 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1211574601 0 0) 0x7fa990187030 con 0x7fa990182e90 2024-02-21T23:12:53.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.315+0000 7fa98f400640 1 -- 172.21.15.99:0/249037757 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa978003520 con 0x7fa990182e90 2024-02-21T23:12:53.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.315+0000 7fa98f400640 1 -- 172.21.15.99:0/249037757 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3798397227 0 0) 0x7fa9900fd900 con 0x7fa9900f8f00 2024-02-21T23:12:53.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.315+0000 7fa98f400640 1 -- 172.21.15.99:0/249037757 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa990187030 con 0x7fa9900f8f00 2024-02-21T23:12:53.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.315+0000 7fa98f400640 1 -- 172.21.15.99:0/249037757 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1258588410 0 0) 0x7fa990188ac0 con 0x7fa9900fd490 2024-02-21T23:12:53.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.315+0000 7fa98f400640 1 -- 172.21.15.99:0/249037757 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9900fd900 con 0x7fa9900fd490 2024-02-21T23:12:53.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.315+0000 7fa98f400640 1 -- 172.21.15.99:0/249037757 <== mon.2 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3708739039 0 0) 0x7fa978003520 con 0x7fa990182e90 2024-02-21T23:12:53.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.315+0000 7fa98f400640 1 -- 172.21.15.99:0/249037757 >> v1:172.21.15.162:6789/0 conn(0x7fa9900fd490 legacy=0x7fa99018c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:53.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.315+0000 7fa98f400640 1 -- 172.21.15.99:0/249037757 >> v1:172.21.15.99:6789/0 conn(0x7fa9900f8f00 legacy=0x7fa99018c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:53.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.315+0000 7fa98f400640 1 -- 172.21.15.99:0/249037757 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa990187310 con 0x7fa990182e90 2024-02-21T23:12:53.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.315+0000 7fa98f400640 1 -- 172.21.15.99:0/249037757 <== mon.2 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2069890144 0 0) 0x7fa984001670 con 0x7fa990182e90 2024-02-21T23:12:53.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.315+0000 7fa98f400640 1 -- 172.21.15.99:0/249037757 >> v1:172.21.15.181:6789/0 conn(0x7fa990182e90 legacy=0x7fa9901883b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:53.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.315+0000 7fa98f400640 1 --2- 172.21.15.99:0/249037757 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa978004d80 0x7fa978005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:53.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.315+0000 7fa98f400640 1 --2- 172.21.15.99:0/249037757 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa978003810 0x7fa978003c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:53.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.315+0000 7fa98f400640 1 --2- 172.21.15.99:0/249037757 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9780043a0 0x7fa97800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:53.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.315+0000 7fa98f400640 1 -- 172.21.15.99:0/249037757 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa97800c310 con 0x7fa978004d80 2024-02-21T23:12:53.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.315+0000 7fa98f400640 1 -- 172.21.15.99:0/249037757 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa97800c4c0 con 0x7fa9780043a0 2024-02-21T23:12:53.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.315+0000 7fa98f400640 1 -- 172.21.15.99:0/249037757 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa97800c6c0 con 0x7fa978003810 2024-02-21T23:12:53.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.315+0000 7fa98fe00640 1 --2- 172.21.15.99:0/249037757 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa978003810 0x7fa978003c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:53.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.315+0000 7fa994e00640 1 --2- 172.21.15.99:0/249037757 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa978004d80 0x7fa978005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:53.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.316+0000 7fa995800640 1 --2- 172.21.15.99:0/249037757 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9780043a0 0x7fa97800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:53.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.316+0000 7fa98fe00640 1 -- 172.21.15.99:0/249037757 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9780043a0 msgr2=0x7fa97800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:53.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.316+0000 7fa98fe00640 1 --2- 172.21.15.99:0/249037757 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9780043a0 0x7fa97800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:53.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.316+0000 7fa98fe00640 1 -- 172.21.15.99:0/249037757 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa978004d80 msgr2=0x7fa978005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:53.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.316+0000 7fa98fe00640 1 --2- 172.21.15.99:0/249037757 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa978004d80 0x7fa978005160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:53.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.316+0000 7fa98fe00640 1 -- 172.21.15.99:0/249037757 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa990187310 con 0x7fa978003810 2024-02-21T23:12:53.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.316+0000 7fa995800640 1 -- 172.21.15.99:0/249037757 reap_dead start 2024-02-21T23:12:53.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.316+0000 7fa994e00640 1 --2- 172.21.15.99:0/249037757 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa978004d80 0x7fa978005160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:12:53.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.317+0000 7fa98fe00640 1 --2- 172.21.15.99:0/249037757 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa978003810 0x7fa978003c90 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fa97c001980 tx=0x7fa978005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=245c70fdd08bcf6 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:53.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.317+0000 7fa98f400640 1 -- 172.21.15.99:0/249037757 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97c037070 con 0x7fa978003810 2024-02-21T23:12:53.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.318+0000 7fa98f400640 1 -- 172.21.15.99:0/249037757 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa97c004aa0 con 0x7fa978003810 2024-02-21T23:12:53.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.318+0000 7fa98f400640 1 -- 172.21.15.99:0/249037757 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97c0015d0 con 0x7fa978003810 2024-02-21T23:12:53.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.318+0000 7fa997800640 1 -- 172.21.15.99:0/249037757 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa978003810 msgr2=0x7fa978003c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:53.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.318+0000 7fa997800640 1 --2- 172.21.15.99:0/249037757 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa978003810 0x7fa978003c90 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fa97c001980 tx=0x7fa978005830 comp rx=0 tx=0).stop 2024-02-21T23:12:53.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.318+0000 7fa997800640 1 -- 172.21.15.99:0/249037757 shutdown_connections 2024-02-21T23:12:53.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.318+0000 7fa997800640 1 --2- 172.21.15.99:0/249037757 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa978003810 0x7fa978003c90 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:53.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.318+0000 7fa997800640 1 -- 172.21.15.99:0/249037757 >> 172.21.15.99:0/249037757 conn(0x7fa9900fe580 msgr2=0x7fa9900fe960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:53.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.318+0000 7fa997800640 1 -- 172.21.15.99:0/249037757 shutdown_connections 2024-02-21T23:12:53.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.318+0000 7fa997800640 1 -- 172.21.15.99:0/249037757 wait complete. 2024-02-21T23:12:53.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.322+0000 7fa997800640 1 Processor -- start 2024-02-21T23:12:53.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.322+0000 7fa997800640 1 -- start start 2024-02-21T23:12:53.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.324+0000 7fa997800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa978003810 0x7fa9900fa160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:53.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.324+0000 7fa997800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9900fbc40 0x7fa9901610a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:53.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.324+0000 7fa997800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa990176b20 0x7fa990176fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:53.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.324+0000 7fa997800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9901878d0 con 0x7fa978003810 2024-02-21T23:12:53.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.324+0000 7fa997800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa990187f20 con 0x7fa990176b20 2024-02-21T23:12:53.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.324+0000 7fa997800640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa990187bb0 con 0x7fa9900fbc40 2024-02-21T23:12:53.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.324+0000 7fa994e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa978003810 0x7fa9900fa160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:53.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.324+0000 7fa994e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa978003810 0x7fa9900fa160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:40160/0 (socket says 172.21.15.99:40160) 2024-02-21T23:12:53.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.324+0000 7fa994e00640 1 -- 172.21.15.99:0/1313421806 learned_addr learned my addr 172.21.15.99:0/1313421806 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:12:53.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.324+0000 7fa98fe00640 1 --2- 172.21.15.99:0/1313421806 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9900fbc40 0x7fa9901610a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:53.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.324+0000 7fa995800640 1 --2- 172.21.15.99:0/1313421806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa990176b20 0x7fa990176fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:53.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.325+0000 7fa994e00640 1 -- 172.21.15.99:0/1313421806 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9900fbc40 msgr2=0x7fa9901610a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:53.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.325+0000 7fa994e00640 1 --2- 172.21.15.99:0/1313421806 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9900fbc40 0x7fa9901610a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:53.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.325+0000 7fa994e00640 1 -- 172.21.15.99:0/1313421806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa990176b20 msgr2=0x7fa990176fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:53.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.325+0000 7fa994e00640 1 --2- 172.21.15.99:0/1313421806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa990176b20 0x7fa990176fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:53.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.325+0000 7fa994e00640 1 -- 172.21.15.99:0/1313421806 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9900fa8c0 con 0x7fa978003810 2024-02-21T23:12:53.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.325+0000 7fa994e00640 1 --2- 172.21.15.99:0/1313421806 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa978003810 0x7fa9900fa160 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fa984004a10 tx=0x7fa984004ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:53.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.326+0000 7fa98cc00640 1 -- 172.21.15.99:0/1313421806 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa98401a070 con 0x7fa978003810 2024-02-21T23:12:53.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.326+0000 7fa98cc00640 1 -- 172.21.15.99:0/1313421806 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa98400f8e0 con 0x7fa978003810 2024-02-21T23:12:53.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.326+0000 7fa997800640 1 -- 172.21.15.99:0/1313421806 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9900faba0 con 0x7fa978003810 2024-02-21T23:12:53.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.326+0000 7fa98cc00640 1 -- 172.21.15.99:0/1313421806 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa984007c50 con 0x7fa978003810 2024-02-21T23:12:53.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.326+0000 7fa997800640 1 -- 172.21.15.99:0/1313421806 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9900fb160 con 0x7fa978003810 2024-02-21T23:12:53.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.327+0000 7fa997800640 1 -- 172.21.15.99:0/1313421806 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa990068390 con 0x7fa978003810 2024-02-21T23:12:53.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.331+0000 7fa98cc00640 1 -- 172.21.15.99:0/1313421806 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7fa98401d070 con 0x7fa978003810 2024-02-21T23:12:53.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.333+0000 7fa98cc00640 1 --2- 172.21.15.99:0/1313421806 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa97009ef00 0x7fa9700a13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:53.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.333+0000 7fa98cc00640 1 -- 172.21.15.99:0/1313421806 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 8877+0+0 (secure 0 0 0) 0x7fa9840c9b90 con 0x7fa978003810 2024-02-21T23:12:53.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.333+0000 7fa98fe00640 1 --2- 172.21.15.99:0/1313421806 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa97009ef00 0x7fa9700a13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:53.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.334+0000 7fa98fe00640 1 --2- 172.21.15.99:0/1313421806 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa97009ef00 0x7fa9700a13c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa97c034000 tx=0x7fa97c009030 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:53.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.335+0000 7fa98cc00640 1 -- 172.21.15.99:0/1313421806 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fa984024020 con 0x7fa978003810 2024-02-21T23:12:53.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.675+0000 7fa997800640 1 -- 172.21.15.99:0/1313421806 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) v1 -- 0x7fa9900f8880 con 0x7fa978003810 2024-02-21T23:12:53.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.700+0000 7fa98cc00640 1 -- 172.21.15.99:0/1313421806 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v14) v1 ==== 81+0+724120 (secure 0 0 0) 0x7fa9840974f0 con 0x7fa978003810 2024-02-21T23:12:53.700 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T23:12:53.700 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-02-21T23:12:53.700 INFO:teuthology.orchestra.run.smithi099.stdout: "epoch": 14, 2024-02-21T23:12:53.700 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.700 INFO:teuthology.orchestra.run.smithi099.stdout: "active_gid": 5131, 2024-02-21T23:12:53.700 INFO:teuthology.orchestra.run.smithi099.stdout: "active_name": "y", 2024-02-21T23:12:53.701 INFO:teuthology.orchestra.run.smithi099.stdout: "active_addrs": { 2024-02-21T23:12:53.701 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-02-21T23:12:53.701 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:53.701 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-02-21T23:12:53.701 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.162:6800", 2024-02-21T23:12:53.701 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 631076050 2024-02-21T23:12:53.701 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.702 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:53.702 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-02-21T23:12:53.702 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.162:6801", 2024-02-21T23:12:53.702 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 631076050 2024-02-21T23:12:53.702 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:53.702 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-02-21T23:12:53.702 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.702 INFO:teuthology.orchestra.run.smithi099.stdout: "active_addr": "172.21.15.162:6801/631076050", 2024-02-21T23:12:53.703 INFO:teuthology.orchestra.run.smithi099.stdout: "active_change": "2024-02-21T23:02:14.008346+0000", 2024-02-21T23:12:53.703 INFO:teuthology.orchestra.run.smithi099.stdout: "active_mgr_features": 4540701547738038271, 2024-02-21T23:12:53.703 INFO:teuthology.orchestra.run.smithi099.stdout: "available": true, 2024-02-21T23:12:53.703 INFO:teuthology.orchestra.run.smithi099.stdout: "standbys": [ 2024-02-21T23:12:53.703 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:53.703 INFO:teuthology.orchestra.run.smithi099.stdout: "gid": 5055, 2024-02-21T23:12:53.704 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "x", 2024-02-21T23:12:53.704 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr_features": 4540701547738038271, 2024-02-21T23:12:53.704 INFO:teuthology.orchestra.run.smithi099.stdout: "available_modules": [ 2024-02-21T23:12:53.704 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:53.704 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "alerts", 2024-02-21T23:12:53.704 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:53.704 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:53.705 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:53.705 INFO:teuthology.orchestra.run.smithi099.stdout: "interval": { 2024-02-21T23:12:53.705 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "interval", 2024-02-21T23:12:53.705 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-02-21T23:12:53.705 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.705 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:53.705 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "60", 2024-02-21T23:12:53.705 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.705 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.706 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.706 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "How frequently to reexamine health status", 2024-02-21T23:12:53.706 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.706 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.706 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.706 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.706 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:53.706 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:53.707 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:53.707 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.707 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:53.707 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:53.707 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.707 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.707 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:53.707 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:53.707 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:53.708 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:53.708 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:53.708 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:53.708 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:53.708 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:53.708 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:53.708 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.708 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.709 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.709 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.709 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:53.709 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:53.709 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:53.709 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.709 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:53.709 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:53.710 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.710 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.710 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.710 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:53.710 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.710 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.710 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.710 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.710 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:53.711 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:53.711 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:53.711 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.711 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:53.711 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:53.711 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.711 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.711 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:53.712 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:53.712 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:53.712 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:53.712 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:53.712 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:53.712 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:53.712 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:53.712 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:53.713 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.713 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.713 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.713 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.713 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:53.713 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:53.713 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:53.713 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.713 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:53.714 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:53.714 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.714 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.714 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.714 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:53.714 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.714 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.714 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.715 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.715 INFO:teuthology.orchestra.run.smithi099.stdout: "smtp_destination": { 2024-02-21T23:12:53.715 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "smtp_destination", 2024-02-21T23:12:53.715 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:53.715 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.716 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:53.716 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:53.716 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.716 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.716 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.716 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Email address to send alerts to", 2024-02-21T23:12:53.716 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.717 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.717 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.717 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.717 INFO:teuthology.orchestra.run.smithi099.stdout: "smtp_from_name": { 2024-02-21T23:12:53.717 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "smtp_from_name", 2024-02-21T23:12:53.717 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:53.717 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.718 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:53.718 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "Ceph", 2024-02-21T23:12:53.718 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.718 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.718 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.718 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Email From: name", 2024-02-21T23:12:53.719 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.719 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.719 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.719 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.719 INFO:teuthology.orchestra.run.smithi099.stdout: "smtp_host": { 2024-02-21T23:12:53.719 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "smtp_host", 2024-02-21T23:12:53.719 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:53.719 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.720 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:53.720 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:53.720 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.720 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.720 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.720 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "SMTP server", 2024-02-21T23:12:53.720 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.721 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.721 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.721 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.721 INFO:teuthology.orchestra.run.smithi099.stdout: "smtp_password": { 2024-02-21T23:12:53.721 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "smtp_password", 2024-02-21T23:12:53.721 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:53.721 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.721 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:53.722 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:53.722 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.722 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.722 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.722 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Password to authenticate with", 2024-02-21T23:12:53.722 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.723 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.723 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.723 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.723 INFO:teuthology.orchestra.run.smithi099.stdout: "smtp_port": { 2024-02-21T23:12:53.723 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "smtp_port", 2024-02-21T23:12:53.723 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:53.724 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.724 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:53.724 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "465", 2024-02-21T23:12:53.724 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.724 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.724 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.724 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "SMTP port", 2024-02-21T23:12:53.724 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.725 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.725 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.725 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.725 INFO:teuthology.orchestra.run.smithi099.stdout: "smtp_sender": { 2024-02-21T23:12:53.725 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "smtp_sender", 2024-02-21T23:12:53.725 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:53.725 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.725 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:53.726 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:53.726 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.726 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.726 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.726 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "SMTP envelope sender", 2024-02-21T23:12:53.726 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.726 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.727 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.727 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.727 INFO:teuthology.orchestra.run.smithi099.stdout: "smtp_ssl": { 2024-02-21T23:12:53.727 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "smtp_ssl", 2024-02-21T23:12:53.727 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:53.727 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.727 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:53.727 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:53.728 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.728 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.728 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.728 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Use SSL to connect to SMTP server", 2024-02-21T23:12:53.728 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.728 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.728 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.728 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.729 INFO:teuthology.orchestra.run.smithi099.stdout: "smtp_user": { 2024-02-21T23:12:53.729 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "smtp_user", 2024-02-21T23:12:53.729 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:53.729 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.729 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:53.729 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:53.729 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.729 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.730 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.730 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "User to authenticate as", 2024-02-21T23:12:53.730 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.730 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.730 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.730 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:53.730 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:53.730 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.730 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:53.731 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "balancer", 2024-02-21T23:12:53.731 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:53.731 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:53.731 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:53.731 INFO:teuthology.orchestra.run.smithi099.stdout: "active": { 2024-02-21T23:12:53.731 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "active", 2024-02-21T23:12:53.731 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:53.731 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.732 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:53.732 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:53.733 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.733 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.733 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.733 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "automatically balance PGs across cluster", 2024-02-21T23:12:53.733 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.733 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.734 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.734 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.734 INFO:teuthology.orchestra.run.smithi099.stdout: "begin_time": { 2024-02-21T23:12:53.734 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "begin_time", 2024-02-21T23:12:53.734 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:53.734 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.734 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:53.734 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "0000", 2024-02-21T23:12:53.735 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.735 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.735 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.735 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "beginning time of day to automatically balance", 2024-02-21T23:12:53.735 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-02-21T23:12:53.735 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.735 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.735 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.736 INFO:teuthology.orchestra.run.smithi099.stdout: "begin_weekday": { 2024-02-21T23:12:53.736 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "begin_weekday", 2024-02-21T23:12:53.736 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "uint", 2024-02-21T23:12:53.736 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.736 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:53.736 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "0", 2024-02-21T23:12:53.736 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "0", 2024-02-21T23:12:53.736 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "6", 2024-02-21T23:12:53.737 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.737 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-02-21T23:12:53.737 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-02-21T23:12:53.737 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.737 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.737 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.737 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_compat_max_iterations": { 2024-02-21T23:12:53.737 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "crush_compat_max_iterations", 2024-02-21T23:12:53.738 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "uint", 2024-02-21T23:12:53.738 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.738 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:53.738 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "25", 2024-02-21T23:12:53.738 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "1", 2024-02-21T23:12:53.738 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "250", 2024-02-21T23:12:53.738 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.738 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-02-21T23:12:53.739 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.739 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.739 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.739 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.739 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_compat_metrics": { 2024-02-21T23:12:53.739 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "crush_compat_metrics", 2024-02-21T23:12:53.739 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:53.739 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.739 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:53.740 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "pgs,objects,bytes", 2024-02-21T23:12:53.740 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.740 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.740 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.740 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-02-21T23:12:53.740 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-02-21T23:12:53.740 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.740 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.741 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.741 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_compat_step": { 2024-02-21T23:12:53.741 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "crush_compat_step", 2024-02-21T23:12:53.741 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "float", 2024-02-21T23:12:53.741 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.741 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:53.741 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "0.5", 2024-02-21T23:12:53.741 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "0.001", 2024-02-21T23:12:53.742 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "0.999", 2024-02-21T23:12:53.742 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.742 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "aggressiveness of optimization", 2024-02-21T23:12:53.742 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-02-21T23:12:53.742 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.742 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.742 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.742 INFO:teuthology.orchestra.run.smithi099.stdout: "end_time": { 2024-02-21T23:12:53.743 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "end_time", 2024-02-21T23:12:53.743 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:53.743 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.743 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:53.743 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "2359", 2024-02-21T23:12:53.744 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.744 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.744 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.744 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "ending time of day to automatically balance", 2024-02-21T23:12:53.744 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-02-21T23:12:53.744 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.744 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.745 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.745 INFO:teuthology.orchestra.run.smithi099.stdout: "end_weekday": { 2024-02-21T23:12:53.745 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "end_weekday", 2024-02-21T23:12:53.745 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "uint", 2024-02-21T23:12:53.745 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.745 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:53.745 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "0", 2024-02-21T23:12:53.746 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "0", 2024-02-21T23:12:53.746 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "6", 2024-02-21T23:12:53.746 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.746 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-02-21T23:12:53.746 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-02-21T23:12:53.746 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.747 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.747 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.747 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:53.747 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:53.747 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:53.747 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.747 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:53.747 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:53.748 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.748 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.748 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:53.748 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:53.748 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:53.748 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:53.748 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:53.748 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:53.749 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:53.749 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:53.749 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:53.749 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.749 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.749 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.749 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.749 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:53.750 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:53.750 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:53.750 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.750 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:53.750 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:53.750 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.750 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.751 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.751 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:53.751 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.751 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.751 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.751 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.751 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:53.751 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:53.751 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:53.752 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.752 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:53.752 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:53.752 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.752 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.752 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:53.752 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:53.752 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:53.753 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:53.753 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:53.753 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:53.753 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:53.753 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:53.753 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:53.753 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.753 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.754 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.754 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.754 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:53.754 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:53.754 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:53.754 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.754 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:53.754 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:53.755 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.755 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.755 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.755 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:53.755 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.755 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.755 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.756 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.756 INFO:teuthology.orchestra.run.smithi099.stdout: "min_score": { 2024-02-21T23:12:53.756 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "min_score", 2024-02-21T23:12:53.756 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "float", 2024-02-21T23:12:53.756 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.756 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:53.756 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "0", 2024-02-21T23:12:53.756 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.757 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.757 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.757 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-02-21T23:12:53.757 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.757 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.757 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.757 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.757 INFO:teuthology.orchestra.run.smithi099.stdout: "mode": { 2024-02-21T23:12:53.758 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "mode", 2024-02-21T23:12:53.758 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:53.758 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.758 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:53.758 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "upmap", 2024-02-21T23:12:53.758 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.758 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.758 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:53.759 INFO:teuthology.orchestra.run.smithi099.stdout: "crush-compat", 2024-02-21T23:12:53.759 INFO:teuthology.orchestra.run.smithi099.stdout: "none", 2024-02-21T23:12:53.759 INFO:teuthology.orchestra.run.smithi099.stdout: "read", 2024-02-21T23:12:53.759 INFO:teuthology.orchestra.run.smithi099.stdout: "upmap", 2024-02-21T23:12:53.759 INFO:teuthology.orchestra.run.smithi099.stdout: "upmap-read" 2024-02-21T23:12:53.759 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:53.759 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Balancer mode", 2024-02-21T23:12:53.759 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.759 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.760 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.760 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.760 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_ids": { 2024-02-21T23:12:53.760 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "pool_ids", 2024-02-21T23:12:53.760 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:53.760 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.760 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:53.760 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:53.761 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.761 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.761 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.761 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-02-21T23:12:53.761 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.761 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.761 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.762 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.762 INFO:teuthology.orchestra.run.smithi099.stdout: "sleep_interval": { 2024-02-21T23:12:53.762 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "sleep_interval", 2024-02-21T23:12:53.762 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-02-21T23:12:53.762 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.762 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:53.762 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "60", 2024-02-21T23:12:53.762 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.763 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.763 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.763 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-02-21T23:12:53.763 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.763 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.763 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.763 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.763 INFO:teuthology.orchestra.run.smithi099.stdout: "upmap_max_deviation": { 2024-02-21T23:12:53.764 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "upmap_max_deviation", 2024-02-21T23:12:53.764 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:53.764 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.764 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:53.764 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "5", 2024-02-21T23:12:53.764 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "1", 2024-02-21T23:12:53.764 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.764 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.765 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "deviation below which no optimization is attempted", 2024-02-21T23:12:53.765 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-02-21T23:12:53.765 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.765 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.765 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.765 INFO:teuthology.orchestra.run.smithi099.stdout: "upmap_max_optimizations": { 2024-02-21T23:12:53.765 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "upmap_max_optimizations", 2024-02-21T23:12:53.765 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "uint", 2024-02-21T23:12:53.765 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.766 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:53.766 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "10", 2024-02-21T23:12:53.766 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.766 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.766 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.766 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-02-21T23:12:53.766 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.766 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.767 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.767 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:53.767 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:53.767 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.767 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:53.767 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "cephadm", 2024-02-21T23:12:53.767 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:53.767 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:53.767 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:53.768 INFO:teuthology.orchestra.run.smithi099.stdout: "agent_down_multiplier": { 2024-02-21T23:12:53.768 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "agent_down_multiplier", 2024-02-21T23:12:53.768 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "float", 2024-02-21T23:12:53.768 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.768 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.768 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "3.0", 2024-02-21T23:12:53.768 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.769 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.769 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.769 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-02-21T23:12:53.769 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.769 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.769 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.770 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.770 INFO:teuthology.orchestra.run.smithi099.stdout: "agent_refresh_rate": { 2024-02-21T23:12:53.770 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "agent_refresh_rate", 2024-02-21T23:12:53.770 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-02-21T23:12:53.770 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.770 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.770 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "20", 2024-02-21T23:12:53.770 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.771 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.771 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.771 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-02-21T23:12:53.771 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.771 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.771 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.771 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.771 INFO:teuthology.orchestra.run.smithi099.stdout: "agent_starting_port": { 2024-02-21T23:12:53.772 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "agent_starting_port", 2024-02-21T23:12:53.772 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:53.772 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.772 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.772 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "4721", 2024-02-21T23:12:53.772 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.772 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.772 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.773 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-02-21T23:12:53.773 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.773 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.773 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.773 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.773 INFO:teuthology.orchestra.run.smithi099.stdout: "allow_ptrace": { 2024-02-21T23:12:53.773 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "allow_ptrace", 2024-02-21T23:12:53.774 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:53.774 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.774 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.774 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:53.774 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.774 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.774 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.774 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-02-21T23:12:53.775 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-02-21T23:12:53.775 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.775 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.775 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.775 INFO:teuthology.orchestra.run.smithi099.stdout: "autotune_interval": { 2024-02-21T23:12:53.775 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "autotune_interval", 2024-02-21T23:12:53.775 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-02-21T23:12:53.775 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.776 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.776 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "600", 2024-02-21T23:12:53.776 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.776 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.776 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.776 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "how frequently to autotune daemon memory", 2024-02-21T23:12:53.776 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.776 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.777 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.777 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.777 INFO:teuthology.orchestra.run.smithi099.stdout: "autotune_memory_target_ratio": { 2024-02-21T23:12:53.777 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "autotune_memory_target_ratio", 2024-02-21T23:12:53.777 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "float", 2024-02-21T23:12:53.777 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.777 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.777 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "0.7", 2024-02-21T23:12:53.777 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.778 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.778 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.778 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-02-21T23:12:53.778 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.778 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.778 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.778 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.779 INFO:teuthology.orchestra.run.smithi099.stdout: "cephadm_log_destination": { 2024-02-21T23:12:53.779 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "cephadm_log_destination", 2024-02-21T23:12:53.779 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:53.779 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.779 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.779 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:53.779 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.779 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.780 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:53.780 INFO:teuthology.orchestra.run.smithi099.stdout: "file", 2024-02-21T23:12:53.780 INFO:teuthology.orchestra.run.smithi099.stdout: "file,syslog", 2024-02-21T23:12:53.780 INFO:teuthology.orchestra.run.smithi099.stdout: "syslog" 2024-02-21T23:12:53.780 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:53.780 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-02-21T23:12:53.780 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.780 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.781 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.781 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.781 INFO:teuthology.orchestra.run.smithi099.stdout: "cgroups_split": { 2024-02-21T23:12:53.781 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "cgroups_split", 2024-02-21T23:12:53.781 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:53.781 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.781 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.781 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:53.782 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.782 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.782 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.782 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-02-21T23:12:53.782 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.782 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.782 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.782 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.783 INFO:teuthology.orchestra.run.smithi099.stdout: "config_checks_enabled": { 2024-02-21T23:12:53.783 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "config_checks_enabled", 2024-02-21T23:12:53.783 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:53.783 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.783 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.783 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:53.783 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.784 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.784 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.784 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-02-21T23:12:53.784 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.784 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.784 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.784 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.785 INFO:teuthology.orchestra.run.smithi099.stdout: "config_dashboard": { 2024-02-21T23:12:53.785 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "config_dashboard", 2024-02-21T23:12:53.785 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:53.785 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.785 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.785 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:53.785 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.785 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.785 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.786 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-02-21T23:12:53.786 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.786 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.786 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.786 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.786 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_alertmanager": { 2024-02-21T23:12:53.786 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_alertmanager", 2024-02-21T23:12:53.786 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:53.787 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.787 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.787 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-02-21T23:12:53.787 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.787 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.787 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.787 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Prometheus container image", 2024-02-21T23:12:53.787 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.788 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.788 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.788 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.788 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_base": { 2024-02-21T23:12:53.788 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_base", 2024-02-21T23:12:53.788 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:53.788 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.788 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:53.789 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "quay.io/ceph/ceph", 2024-02-21T23:12:53.789 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.789 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.789 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.789 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Container image name, without the tag", 2024-02-21T23:12:53.789 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.789 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.789 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.790 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.790 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_elasticsearch": { 2024-02-21T23:12:53.790 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_elasticsearch", 2024-02-21T23:12:53.790 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:53.790 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.790 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.790 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-02-21T23:12:53.790 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.791 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.791 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.791 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "elasticsearch container image", 2024-02-21T23:12:53.791 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.791 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.791 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.791 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.791 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_grafana": { 2024-02-21T23:12:53.792 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_grafana", 2024-02-21T23:12:53.792 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:53.792 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.792 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.792 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.12", 2024-02-21T23:12:53.792 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.792 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.792 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.793 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Prometheus container image", 2024-02-21T23:12:53.793 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.793 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.793 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.793 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.793 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_haproxy": { 2024-02-21T23:12:53.793 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_haproxy", 2024-02-21T23:12:53.793 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:53.793 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.795 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.795 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-02-21T23:12:53.796 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.797 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.797 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.797 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "HAproxy container image", 2024-02-21T23:12:53.797 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.797 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.797 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.797 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.797 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_jaeger_agent": { 2024-02-21T23:12:53.798 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_jaeger_agent", 2024-02-21T23:12:53.798 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:53.798 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.798 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.798 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-02-21T23:12:53.798 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.798 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.798 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.799 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Jaeger agent container image", 2024-02-21T23:12:53.799 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.799 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.799 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.799 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.799 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_jaeger_collector": { 2024-02-21T23:12:53.799 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_jaeger_collector", 2024-02-21T23:12:53.799 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:53.800 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.800 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.800 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-02-21T23:12:53.800 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.800 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.800 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.800 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Jaeger collector container image", 2024-02-21T23:12:53.800 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.801 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.801 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.801 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.801 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_jaeger_query": { 2024-02-21T23:12:53.801 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_jaeger_query", 2024-02-21T23:12:53.801 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:53.801 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.801 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.801 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-02-21T23:12:53.802 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.802 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.802 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.802 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Jaeger query container image", 2024-02-21T23:12:53.802 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.802 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.802 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.802 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.803 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_keepalived": { 2024-02-21T23:12:53.803 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_keepalived", 2024-02-21T23:12:53.803 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:53.803 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.803 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.803 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-02-21T23:12:53.803 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.803 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.804 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.804 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Keepalived container image", 2024-02-21T23:12:53.804 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.804 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.804 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.804 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.804 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_loki": { 2024-02-21T23:12:53.804 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_loki", 2024-02-21T23:12:53.805 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:53.805 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.805 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.805 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-02-21T23:12:53.805 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.805 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.805 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.805 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Loki container image", 2024-02-21T23:12:53.806 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.806 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.806 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.806 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.806 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_node_exporter": { 2024-02-21T23:12:53.806 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_node_exporter", 2024-02-21T23:12:53.806 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:53.806 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.807 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.807 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-02-21T23:12:53.807 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.807 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.807 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.807 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Prometheus container image", 2024-02-21T23:12:53.807 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.807 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.808 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.808 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.808 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_nvmeof": { 2024-02-21T23:12:53.808 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_nvmeof", 2024-02-21T23:12:53.808 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:53.808 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.808 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.808 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "quay.io/ceph/nvmeof:latest", 2024-02-21T23:12:53.809 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.809 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.809 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.809 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Nvme-of container image", 2024-02-21T23:12:53.809 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.809 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.809 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.810 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.810 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_prometheus": { 2024-02-21T23:12:53.810 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_prometheus", 2024-02-21T23:12:53.810 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:53.810 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.810 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.810 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-02-21T23:12:53.810 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.811 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.811 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.811 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Prometheus container image", 2024-02-21T23:12:53.811 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.811 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.811 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.811 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.811 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_promtail": { 2024-02-21T23:12:53.812 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_promtail", 2024-02-21T23:12:53.812 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:53.812 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.812 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.812 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-02-21T23:12:53.812 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.812 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.813 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.813 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Promtail container image", 2024-02-21T23:12:53.813 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.813 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.813 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.813 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.813 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_snmp_gateway": { 2024-02-21T23:12:53.813 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_snmp_gateway", 2024-02-21T23:12:53.814 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:53.814 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.814 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.814 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-02-21T23:12:53.814 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.814 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.814 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.815 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "SNMP Gateway container image", 2024-02-21T23:12:53.815 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.815 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.815 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.815 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.815 INFO:teuthology.orchestra.run.smithi099.stdout: "container_init": { 2024-02-21T23:12:53.815 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_init", 2024-02-21T23:12:53.815 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:53.816 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.816 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.816 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:53.816 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.816 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.816 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.816 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Run podman/docker with `--init`", 2024-02-21T23:12:53.816 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.817 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.817 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.817 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.817 INFO:teuthology.orchestra.run.smithi099.stdout: "daemon_cache_timeout": { 2024-02-21T23:12:53.817 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "daemon_cache_timeout", 2024-02-21T23:12:53.817 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-02-21T23:12:53.817 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.817 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.818 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "600", 2024-02-21T23:12:53.818 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.818 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.818 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.818 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-02-21T23:12:53.818 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.818 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.818 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.819 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.819 INFO:teuthology.orchestra.run.smithi099.stdout: "default_cephadm_command_timeout": { 2024-02-21T23:12:53.819 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "default_cephadm_command_timeout", 2024-02-21T23:12:53.819 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:53.819 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.819 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.819 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "900", 2024-02-21T23:12:53.819 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.820 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.820 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.820 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-02-21T23:12:53.820 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.820 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.820 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.820 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.820 INFO:teuthology.orchestra.run.smithi099.stdout: "default_registry": { 2024-02-21T23:12:53.821 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "default_registry", 2024-02-21T23:12:53.821 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:53.821 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.821 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.821 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "docker.io", 2024-02-21T23:12:53.821 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.821 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.821 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.822 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-02-21T23:12:53.822 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.822 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.822 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.822 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.822 INFO:teuthology.orchestra.run.smithi099.stdout: "device_cache_timeout": { 2024-02-21T23:12:53.822 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "device_cache_timeout", 2024-02-21T23:12:53.822 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-02-21T23:12:53.823 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.823 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.823 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "1800", 2024-02-21T23:12:53.823 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.823 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.823 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.823 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "seconds to cache device inventory", 2024-02-21T23:12:53.823 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.824 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.824 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.824 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.824 INFO:teuthology.orchestra.run.smithi099.stdout: "device_enhanced_scan": { 2024-02-21T23:12:53.824 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "device_enhanced_scan", 2024-02-21T23:12:53.824 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:53.824 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.825 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.825 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:53.825 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.825 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.825 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.825 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Use libstoragemgmt during device scans", 2024-02-21T23:12:53.825 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.825 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.826 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.826 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.826 INFO:teuthology.orchestra.run.smithi099.stdout: "facts_cache_timeout": { 2024-02-21T23:12:53.826 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "facts_cache_timeout", 2024-02-21T23:12:53.826 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-02-21T23:12:53.826 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.826 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.826 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "60", 2024-02-21T23:12:53.827 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.827 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.827 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.827 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "seconds to cache host facts data", 2024-02-21T23:12:53.827 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.827 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.827 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.827 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.827 INFO:teuthology.orchestra.run.smithi099.stdout: "host_check_interval": { 2024-02-21T23:12:53.828 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "host_check_interval", 2024-02-21T23:12:53.828 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-02-21T23:12:53.828 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.828 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.828 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "600", 2024-02-21T23:12:53.828 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.828 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.828 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.829 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "how frequently to perform a host check", 2024-02-21T23:12:53.829 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.829 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.829 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.829 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.829 INFO:teuthology.orchestra.run.smithi099.stdout: "hw_monitoring": { 2024-02-21T23:12:53.829 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "hw_monitoring", 2024-02-21T23:12:53.829 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:53.830 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.830 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.830 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:53.830 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.830 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.830 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.830 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-02-21T23:12:53.830 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.831 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.831 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.831 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.831 INFO:teuthology.orchestra.run.smithi099.stdout: "inventory_list_all": { 2024-02-21T23:12:53.831 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "inventory_list_all", 2024-02-21T23:12:53.831 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:53.831 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.831 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.831 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:53.832 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.832 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.832 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.832 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-02-21T23:12:53.832 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.832 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.832 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.832 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.833 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:53.833 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:53.833 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:53.833 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.833 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:53.833 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:53.833 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.833 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.834 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:53.834 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:53.834 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:53.834 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:53.834 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:53.834 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:53.834 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:53.834 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:53.835 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:53.835 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.835 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.835 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.835 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.835 INFO:teuthology.orchestra.run.smithi099.stdout: "log_refresh_metadata": { 2024-02-21T23:12:53.835 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_refresh_metadata", 2024-02-21T23:12:53.835 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:53.835 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.836 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.836 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:53.836 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.836 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.836 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.836 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-02-21T23:12:53.836 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.836 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.837 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.837 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.837 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:53.837 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:53.837 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:53.837 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.837 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.837 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:53.838 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.838 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.838 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.838 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-02-21T23:12:53.838 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.838 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.838 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.838 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.839 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:53.839 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:53.839 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:53.839 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.839 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:53.839 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:53.839 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.839 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.840 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:53.840 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:53.840 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:53.840 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:53.840 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:53.840 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:53.840 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:53.840 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:53.841 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:53.841 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.841 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.841 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.841 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.841 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:53.841 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:53.841 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:53.842 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.842 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:53.842 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:53.842 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.842 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.842 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.842 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:53.842 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.843 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.843 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.843 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.843 INFO:teuthology.orchestra.run.smithi099.stdout: "manage_etc_ceph_ceph_conf": { 2024-02-21T23:12:53.843 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-02-21T23:12:53.843 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:53.843 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.843 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.843 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:53.844 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.844 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.844 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.844 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-02-21T23:12:53.844 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.844 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.844 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.844 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.845 INFO:teuthology.orchestra.run.smithi099.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-02-21T23:12:53.845 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-02-21T23:12:53.845 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:53.845 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.845 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.845 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "*", 2024-02-21T23:12:53.845 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.845 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.846 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.846 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-02-21T23:12:53.846 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.846 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.846 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.846 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.846 INFO:teuthology.orchestra.run.smithi099.stdout: "max_count_per_host": { 2024-02-21T23:12:53.846 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "max_count_per_host", 2024-02-21T23:12:53.846 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:53.847 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.847 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.847 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "10", 2024-02-21T23:12:53.847 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.847 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.847 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.847 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "max number of daemons per service per host", 2024-02-21T23:12:53.847 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.848 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.848 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.848 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.848 INFO:teuthology.orchestra.run.smithi099.stdout: "max_osd_draining_count": { 2024-02-21T23:12:53.848 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "max_osd_draining_count", 2024-02-21T23:12:53.848 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:53.848 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.848 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.849 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "10", 2024-02-21T23:12:53.849 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.849 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.849 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.849 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-02-21T23:12:53.849 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.849 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.849 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.850 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.850 INFO:teuthology.orchestra.run.smithi099.stdout: "migration_current": { 2024-02-21T23:12:53.850 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "migration_current", 2024-02-21T23:12:53.850 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:53.850 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.850 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.850 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:53.850 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.851 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.851 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.851 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "internal - do not modify", 2024-02-21T23:12:53.851 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.851 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.851 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.851 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.851 INFO:teuthology.orchestra.run.smithi099.stdout: "mode": { 2024-02-21T23:12:53.851 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "mode", 2024-02-21T23:12:53.852 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:53.852 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.852 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.852 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "root", 2024-02-21T23:12:53.852 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.852 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.852 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:53.852 INFO:teuthology.orchestra.run.smithi099.stdout: "cephadm-package", 2024-02-21T23:12:53.853 INFO:teuthology.orchestra.run.smithi099.stdout: "root" 2024-02-21T23:12:53.853 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:53.853 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "mode for remote execution of cephadm", 2024-02-21T23:12:53.853 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.853 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.853 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.853 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.853 INFO:teuthology.orchestra.run.smithi099.stdout: "oob_default_addr": { 2024-02-21T23:12:53.854 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "oob_default_addr", 2024-02-21T23:12:53.854 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:53.854 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.854 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.854 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "169.254.1.1", 2024-02-21T23:12:53.854 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.854 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.854 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.855 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Default address for RedFish API (oob management).", 2024-02-21T23:12:53.855 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.855 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.855 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.855 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.855 INFO:teuthology.orchestra.run.smithi099.stdout: "prometheus_alerts_path": { 2024-02-21T23:12:53.855 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "prometheus_alerts_path", 2024-02-21T23:12:53.855 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:53.855 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.856 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.856 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-02-21T23:12:53.856 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.856 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.856 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.856 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-02-21T23:12:53.856 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.856 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.857 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.857 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.857 INFO:teuthology.orchestra.run.smithi099.stdout: "registry_insecure": { 2024-02-21T23:12:53.857 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "registry_insecure", 2024-02-21T23:12:53.857 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:53.857 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.857 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.857 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:53.858 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.858 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.858 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.858 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-02-21T23:12:53.858 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.858 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.858 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.858 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.859 INFO:teuthology.orchestra.run.smithi099.stdout: "registry_password": { 2024-02-21T23:12:53.859 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "registry_password", 2024-02-21T23:12:53.859 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:53.859 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.859 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.859 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:53.859 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.859 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.859 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.860 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-02-21T23:12:53.860 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.860 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.860 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.860 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.860 INFO:teuthology.orchestra.run.smithi099.stdout: "registry_url": { 2024-02-21T23:12:53.860 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "registry_url", 2024-02-21T23:12:53.861 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:53.861 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.861 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.861 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:53.861 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.861 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.861 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.862 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-02-21T23:12:53.862 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.862 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.862 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.862 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.862 INFO:teuthology.orchestra.run.smithi099.stdout: "registry_username": { 2024-02-21T23:12:53.862 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "registry_username", 2024-02-21T23:12:53.862 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:53.863 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.863 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.863 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:53.863 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.863 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.863 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.863 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-02-21T23:12:53.863 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.863 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.864 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.864 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.864 INFO:teuthology.orchestra.run.smithi099.stdout: "secure_monitoring_stack": { 2024-02-21T23:12:53.864 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "secure_monitoring_stack", 2024-02-21T23:12:53.864 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:53.864 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.864 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.864 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:53.865 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.865 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.865 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.865 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-02-21T23:12:53.865 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.865 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.865 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.865 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.866 INFO:teuthology.orchestra.run.smithi099.stdout: "service_discovery_port": { 2024-02-21T23:12:53.866 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "service_discovery_port", 2024-02-21T23:12:53.866 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:53.866 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.866 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.866 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "8765", 2024-02-21T23:12:53.866 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.866 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.867 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.867 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "cephadm service discovery port", 2024-02-21T23:12:53.867 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.867 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.867 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.867 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.867 INFO:teuthology.orchestra.run.smithi099.stdout: "ssh_config_file": { 2024-02-21T23:12:53.867 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "ssh_config_file", 2024-02-21T23:12:53.867 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:53.868 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.868 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.868 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:53.868 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.868 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.868 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.868 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-02-21T23:12:53.868 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.869 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.869 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.869 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.869 INFO:teuthology.orchestra.run.smithi099.stdout: "use_agent": { 2024-02-21T23:12:53.869 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "use_agent", 2024-02-21T23:12:53.869 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:53.869 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.869 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.870 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:53.870 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.870 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.870 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.870 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-02-21T23:12:53.870 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.870 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.870 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.871 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.871 INFO:teuthology.orchestra.run.smithi099.stdout: "use_repo_digest": { 2024-02-21T23:12:53.871 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "use_repo_digest", 2024-02-21T23:12:53.871 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:53.871 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.871 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.871 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:53.871 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.871 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.872 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.872 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-02-21T23:12:53.872 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.872 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.872 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.872 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.872 INFO:teuthology.orchestra.run.smithi099.stdout: "warn_on_failed_host_check": { 2024-02-21T23:12:53.873 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "warn_on_failed_host_check", 2024-02-21T23:12:53.873 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:53.873 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.873 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.873 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:53.873 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.873 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.873 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.873 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "raise a health warning if the host check fails", 2024-02-21T23:12:53.874 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.874 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.874 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.874 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.874 INFO:teuthology.orchestra.run.smithi099.stdout: "warn_on_stray_daemons": { 2024-02-21T23:12:53.874 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "warn_on_stray_daemons", 2024-02-21T23:12:53.874 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:53.874 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.875 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.875 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:53.875 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.875 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.875 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.875 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-02-21T23:12:53.875 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.875 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.876 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.876 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.876 INFO:teuthology.orchestra.run.smithi099.stdout: "warn_on_stray_hosts": { 2024-02-21T23:12:53.876 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "warn_on_stray_hosts", 2024-02-21T23:12:53.876 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:53.876 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.876 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.876 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:53.877 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.877 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.877 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.877 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-02-21T23:12:53.877 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.877 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.877 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.878 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:53.878 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:53.878 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.878 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:53.878 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "crash", 2024-02-21T23:12:53.878 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:53.878 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:53.878 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:53.879 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:53.879 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:53.879 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:53.879 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.879 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:53.879 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:53.879 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.879 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.880 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:53.880 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:53.880 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:53.880 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:53.880 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:53.880 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:53.880 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:53.880 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:53.881 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:53.881 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.881 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.881 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.881 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.881 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:53.881 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:53.881 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:53.881 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.882 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:53.882 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:53.882 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.882 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.882 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.882 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:53.882 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.883 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.883 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.883 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.883 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:53.883 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:53.883 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:53.883 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.883 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:53.884 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:53.884 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.884 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.884 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:53.884 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:53.884 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:53.884 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:53.884 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:53.885 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:53.885 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:53.885 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:53.885 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:53.885 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.885 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.885 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.885 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.886 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:53.886 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:53.886 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:53.886 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.886 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:53.886 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:53.886 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.886 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.887 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.887 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:53.887 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.887 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.887 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.887 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.887 INFO:teuthology.orchestra.run.smithi099.stdout: "retain_interval": { 2024-02-21T23:12:53.887 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "retain_interval", 2024-02-21T23:12:53.888 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-02-21T23:12:53.888 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.888 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:53.888 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "31536000", 2024-02-21T23:12:53.888 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.888 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.888 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.888 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "how long to retain crashes before pruning them", 2024-02-21T23:12:53.889 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.889 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.889 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.889 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.889 INFO:teuthology.orchestra.run.smithi099.stdout: "warn_recent_interval": { 2024-02-21T23:12:53.889 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "warn_recent_interval", 2024-02-21T23:12:53.889 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-02-21T23:12:53.889 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.890 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:53.890 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "1209600", 2024-02-21T23:12:53.890 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.890 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.890 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.890 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "time interval in which to warn about recent crashes", 2024-02-21T23:12:53.890 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.890 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.891 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.891 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:53.891 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:53.891 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.891 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:53.891 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "dashboard", 2024-02-21T23:12:53.891 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:53.892 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:53.892 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:53.892 INFO:teuthology.orchestra.run.smithi099.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-02-21T23:12:53.892 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-02-21T23:12:53.892 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:53.892 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.892 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.892 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "10", 2024-02-21T23:12:53.893 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.893 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.893 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.893 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:53.893 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.893 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.893 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.893 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.893 INFO:teuthology.orchestra.run.smithi099.stdout: "ALERTMANAGER_API_HOST": { 2024-02-21T23:12:53.894 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "ALERTMANAGER_API_HOST", 2024-02-21T23:12:53.894 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:53.894 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.894 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.894 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:53.894 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.894 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.894 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.895 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:53.895 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.895 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.895 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.895 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.895 INFO:teuthology.orchestra.run.smithi099.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-02-21T23:12:53.895 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-02-21T23:12:53.895 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:53.896 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.896 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.896 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:53.896 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.896 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.896 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.896 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:53.896 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.897 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.897 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.897 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.897 INFO:teuthology.orchestra.run.smithi099.stdout: "AUDIT_API_ENABLED": { 2024-02-21T23:12:53.897 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "AUDIT_API_ENABLED", 2024-02-21T23:12:53.897 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:53.897 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.897 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.898 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:53.898 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.898 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.898 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.898 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:53.898 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.898 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.898 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.898 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.899 INFO:teuthology.orchestra.run.smithi099.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-02-21T23:12:53.899 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-02-21T23:12:53.899 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:53.899 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.899 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.899 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:53.899 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.899 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.900 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.900 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:53.900 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.900 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.900 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.900 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.900 INFO:teuthology.orchestra.run.smithi099.stdout: "ENABLE_BROWSABLE_API": { 2024-02-21T23:12:53.900 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "ENABLE_BROWSABLE_API", 2024-02-21T23:12:53.901 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:53.901 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.901 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.901 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:53.901 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.901 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.901 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.901 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:53.901 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.902 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.902 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.902 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.902 INFO:teuthology.orchestra.run.smithi099.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-02-21T23:12:53.902 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-02-21T23:12:53.902 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:53.902 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.902 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.903 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:53.903 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.903 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.903 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.903 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:53.903 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.903 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.904 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.904 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.904 INFO:teuthology.orchestra.run.smithi099.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-02-21T23:12:53.904 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-02-21T23:12:53.904 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:53.904 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.904 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.904 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:53.905 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.905 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.905 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.905 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:53.905 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.905 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.905 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.905 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.906 INFO:teuthology.orchestra.run.smithi099.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-02-21T23:12:53.906 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-02-21T23:12:53.906 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:53.906 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.906 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.906 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:53.906 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.907 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.907 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.907 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:53.907 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.907 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.907 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.907 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.907 INFO:teuthology.orchestra.run.smithi099.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-02-21T23:12:53.907 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-02-21T23:12:53.908 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:53.908 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.908 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.908 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:53.908 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.908 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.908 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.908 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:53.909 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.909 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.909 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.909 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.909 INFO:teuthology.orchestra.run.smithi099.stdout: "FEATURE_TOGGLE_NFS": { 2024-02-21T23:12:53.909 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-02-21T23:12:53.909 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:53.909 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.910 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.910 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:53.910 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.910 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.910 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.910 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:53.910 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.910 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.911 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.911 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.911 INFO:teuthology.orchestra.run.smithi099.stdout: "FEATURE_TOGGLE_RBD": { 2024-02-21T23:12:53.911 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-02-21T23:12:53.911 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:53.911 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.911 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.911 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:53.912 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.912 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.912 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.912 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:53.912 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.912 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.912 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.912 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.913 INFO:teuthology.orchestra.run.smithi099.stdout: "FEATURE_TOGGLE_RGW": { 2024-02-21T23:12:53.913 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-02-21T23:12:53.913 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:53.913 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.913 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.913 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:53.913 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.913 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.913 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.914 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:53.914 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.914 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.914 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.914 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.914 INFO:teuthology.orchestra.run.smithi099.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-02-21T23:12:53.914 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-02-21T23:12:53.915 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:53.915 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.915 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.915 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:53.915 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.915 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.915 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.915 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:53.916 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.916 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.916 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.916 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.916 INFO:teuthology.orchestra.run.smithi099.stdout: "GRAFANA_API_PASSWORD": { 2024-02-21T23:12:53.916 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "GRAFANA_API_PASSWORD", 2024-02-21T23:12:53.916 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:53.916 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.917 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.917 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "admin", 2024-02-21T23:12:53.917 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.917 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.917 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.917 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:53.917 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.917 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.917 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.918 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.918 INFO:teuthology.orchestra.run.smithi099.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-02-21T23:12:53.918 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-02-21T23:12:53.918 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:53.918 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.918 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.918 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:53.918 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.919 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.919 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.919 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:53.919 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.919 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.919 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.919 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.920 INFO:teuthology.orchestra.run.smithi099.stdout: "GRAFANA_API_URL": { 2024-02-21T23:12:53.920 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "GRAFANA_API_URL", 2024-02-21T23:12:53.920 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:53.920 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.920 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.920 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:53.920 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.920 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.921 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.921 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:53.921 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.921 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.921 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.921 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.921 INFO:teuthology.orchestra.run.smithi099.stdout: "GRAFANA_API_USERNAME": { 2024-02-21T23:12:53.921 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "GRAFANA_API_USERNAME", 2024-02-21T23:12:53.922 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:53.922 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.922 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.922 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "admin", 2024-02-21T23:12:53.922 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.922 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.922 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.922 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:53.923 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.923 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.923 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.923 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.923 INFO:teuthology.orchestra.run.smithi099.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-02-21T23:12:53.923 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-02-21T23:12:53.923 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:53.923 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.923 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.924 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:53.924 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.924 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.924 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.924 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:53.924 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.924 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.924 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.925 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.925 INFO:teuthology.orchestra.run.smithi099.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-02-21T23:12:53.925 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-02-21T23:12:53.925 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:53.925 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.925 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.925 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:53.925 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.926 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.926 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.926 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:53.926 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.926 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.926 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.926 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.926 INFO:teuthology.orchestra.run.smithi099.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-02-21T23:12:53.926 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-02-21T23:12:53.927 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:53.927 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.927 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.927 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:53.927 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.927 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.927 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.927 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:53.928 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.928 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.928 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.928 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.928 INFO:teuthology.orchestra.run.smithi099.stdout: "ISSUE_TRACKER_API_KEY": { 2024-02-21T23:12:53.928 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-02-21T23:12:53.928 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:53.928 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.929 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.929 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:53.929 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.929 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.929 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.929 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:53.929 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.929 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.930 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.930 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.930 INFO:teuthology.orchestra.run.smithi099.stdout: "PROMETHEUS_API_HOST": { 2024-02-21T23:12:53.930 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "PROMETHEUS_API_HOST", 2024-02-21T23:12:53.930 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:53.930 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.930 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.930 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:53.931 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.931 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.931 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.931 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:53.931 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.931 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.931 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.931 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.931 INFO:teuthology.orchestra.run.smithi099.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-02-21T23:12:53.932 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-02-21T23:12:53.932 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:53.932 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.932 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.932 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:53.932 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.932 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.932 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.933 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:53.933 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.933 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.933 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.933 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.933 INFO:teuthology.orchestra.run.smithi099.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-02-21T23:12:53.933 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-02-21T23:12:53.933 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:53.934 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.934 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.934 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:53.934 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.934 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.934 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.934 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:53.934 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.935 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.935 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.935 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.935 INFO:teuthology.orchestra.run.smithi099.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-02-21T23:12:53.935 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-02-21T23:12:53.935 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:53.935 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.935 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.936 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:53.936 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.936 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.936 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.936 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:53.936 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.936 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.936 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.937 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.937 INFO:teuthology.orchestra.run.smithi099.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-02-21T23:12:53.937 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-02-21T23:12:53.937 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:53.937 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.937 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.937 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:53.937 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.937 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.938 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.938 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:53.938 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.938 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.938 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.938 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.938 INFO:teuthology.orchestra.run.smithi099.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-02-21T23:12:53.938 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-02-21T23:12:53.939 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:53.939 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.939 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.939 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:53.939 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.939 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.939 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.939 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:53.940 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.940 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.940 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.940 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.940 INFO:teuthology.orchestra.run.smithi099.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-02-21T23:12:53.940 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-02-21T23:12:53.940 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:53.940 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.941 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.941 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:53.941 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.941 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.941 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.941 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:53.941 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.941 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.941 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.942 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.942 INFO:teuthology.orchestra.run.smithi099.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-02-21T23:12:53.942 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-02-21T23:12:53.942 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:53.942 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.942 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.942 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:53.942 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.943 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.943 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.943 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:53.943 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.943 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.943 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.943 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.943 INFO:teuthology.orchestra.run.smithi099.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-02-21T23:12:53.943 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-02-21T23:12:53.944 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:53.944 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.944 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.944 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:53.944 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.944 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.944 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.944 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:53.945 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.945 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.945 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.945 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.945 INFO:teuthology.orchestra.run.smithi099.stdout: "PWD_POLICY_ENABLED": { 2024-02-21T23:12:53.945 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "PWD_POLICY_ENABLED", 2024-02-21T23:12:53.945 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:53.945 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.946 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.946 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:53.946 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.946 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.946 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.946 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:53.946 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.946 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.947 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.947 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.947 INFO:teuthology.orchestra.run.smithi099.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-02-21T23:12:53.947 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-02-21T23:12:53.947 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:53.947 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.947 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.947 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-02-21T23:12:53.948 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.948 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.948 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.948 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:53.948 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.948 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.948 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.948 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.948 INFO:teuthology.orchestra.run.smithi099.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-02-21T23:12:53.949 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-02-21T23:12:53.949 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:53.949 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.949 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.949 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "10", 2024-02-21T23:12:53.949 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.949 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.949 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.950 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:53.950 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.950 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.950 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.950 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.950 INFO:teuthology.orchestra.run.smithi099.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-02-21T23:12:53.950 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-02-21T23:12:53.951 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:53.951 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.951 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.951 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "8", 2024-02-21T23:12:53.951 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.951 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.951 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.951 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:53.952 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.952 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.952 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.952 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.952 INFO:teuthology.orchestra.run.smithi099.stdout: "REST_REQUESTS_TIMEOUT": { 2024-02-21T23:12:53.952 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-02-21T23:12:53.952 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:53.952 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.953 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.953 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "45", 2024-02-21T23:12:53.953 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.953 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.953 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.953 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:53.953 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.953 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.953 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.954 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.954 INFO:teuthology.orchestra.run.smithi099.stdout: "RGW_API_ACCESS_KEY": { 2024-02-21T23:12:53.954 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "RGW_API_ACCESS_KEY", 2024-02-21T23:12:53.954 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:53.954 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.954 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.954 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:53.954 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.955 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.955 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.955 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:53.955 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.955 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.955 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.955 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.955 INFO:teuthology.orchestra.run.smithi099.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-02-21T23:12:53.956 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-02-21T23:12:53.956 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:53.956 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.956 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.956 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "admin", 2024-02-21T23:12:53.956 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.956 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.956 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.957 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:53.957 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.957 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.957 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.957 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.957 INFO:teuthology.orchestra.run.smithi099.stdout: "RGW_API_SECRET_KEY": { 2024-02-21T23:12:53.957 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "RGW_API_SECRET_KEY", 2024-02-21T23:12:53.957 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:53.958 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.958 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.958 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:53.958 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.958 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.958 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.958 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:53.958 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.958 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.959 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.959 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.959 INFO:teuthology.orchestra.run.smithi099.stdout: "RGW_API_SSL_VERIFY": { 2024-02-21T23:12:53.959 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "RGW_API_SSL_VERIFY", 2024-02-21T23:12:53.959 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:53.959 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.959 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.959 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:53.960 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.960 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.960 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.960 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:53.960 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.960 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.960 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.960 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.961 INFO:teuthology.orchestra.run.smithi099.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-02-21T23:12:53.961 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-02-21T23:12:53.961 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:53.961 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.961 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.961 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "0", 2024-02-21T23:12:53.961 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.961 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.962 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.962 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:53.962 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.962 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.962 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.962 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.962 INFO:teuthology.orchestra.run.smithi099.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-02-21T23:12:53.962 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-02-21T23:12:53.963 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:53.963 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.963 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.963 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "10", 2024-02-21T23:12:53.963 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.963 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.963 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.963 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:53.963 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.964 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.964 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.964 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.964 INFO:teuthology.orchestra.run.smithi099.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-02-21T23:12:53.964 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-02-21T23:12:53.964 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:53.964 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.965 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.965 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "5", 2024-02-21T23:12:53.965 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.965 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.965 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.965 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:53.965 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.965 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.965 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.966 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.966 INFO:teuthology.orchestra.run.smithi099.stdout: "cross_origin_url": { 2024-02-21T23:12:53.966 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "cross_origin_url", 2024-02-21T23:12:53.966 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:53.966 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.966 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.966 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:53.966 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.967 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.967 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.967 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:53.967 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.967 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.967 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.967 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.967 INFO:teuthology.orchestra.run.smithi099.stdout: "crt_file": { 2024-02-21T23:12:53.968 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "crt_file", 2024-02-21T23:12:53.968 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:53.968 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.968 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.968 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:53.968 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.968 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.968 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.969 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:53.969 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.969 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.969 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.969 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.969 INFO:teuthology.orchestra.run.smithi099.stdout: "debug": { 2024-02-21T23:12:53.969 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "debug", 2024-02-21T23:12:53.969 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:53.969 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.970 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.970 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:53.970 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.970 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.970 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.970 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Enable/disable debug options", 2024-02-21T23:12:53.970 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.970 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.971 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.971 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.971 INFO:teuthology.orchestra.run.smithi099.stdout: "jwt_token_ttl": { 2024-02-21T23:12:53.971 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "jwt_token_ttl", 2024-02-21T23:12:53.971 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:53.971 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.971 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.971 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "28800", 2024-02-21T23:12:53.972 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.972 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.972 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.972 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:53.972 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.972 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.972 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.972 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.973 INFO:teuthology.orchestra.run.smithi099.stdout: "key_file": { 2024-02-21T23:12:53.973 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "key_file", 2024-02-21T23:12:53.973 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:53.973 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.973 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.973 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:53.974 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.974 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.974 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.974 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:53.974 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.974 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.974 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.974 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.975 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:53.975 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:53.975 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:53.975 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.975 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:53.975 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:53.975 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.975 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.976 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:53.976 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:53.976 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:53.976 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:53.976 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:53.976 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:53.976 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:53.977 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:53.977 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:53.977 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.977 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.977 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.977 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.977 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:53.977 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:53.978 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:53.978 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.978 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:53.978 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:53.978 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.978 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.978 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.978 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:53.979 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.979 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.979 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.979 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.979 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:53.979 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:53.979 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:53.979 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.980 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:53.980 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:53.980 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.980 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.980 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:53.980 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:53.980 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:53.980 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:53.981 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:53.981 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:53.981 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:53.981 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:53.981 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:53.981 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.981 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.981 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.982 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.982 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:53.982 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:53.982 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:53.982 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.982 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:53.982 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:53.982 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.982 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.983 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.983 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:53.983 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.983 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.983 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.983 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.983 INFO:teuthology.orchestra.run.smithi099.stdout: "motd": { 2024-02-21T23:12:53.983 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "motd", 2024-02-21T23:12:53.984 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:53.984 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.984 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.984 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:53.984 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.984 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.984 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.984 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "The message of the day", 2024-02-21T23:12:53.985 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.985 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.985 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.985 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.985 INFO:teuthology.orchestra.run.smithi099.stdout: "redirect_resolve_ip_addr": { 2024-02-21T23:12:53.985 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "redirect_resolve_ip_addr", 2024-02-21T23:12:53.985 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:53.985 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.986 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.986 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:53.986 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.986 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.986 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.986 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:53.986 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.986 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.987 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.987 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.987 INFO:teuthology.orchestra.run.smithi099.stdout: "server_addr": { 2024-02-21T23:12:53.987 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "server_addr", 2024-02-21T23:12:53.987 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:53.987 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.987 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.987 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "::", 2024-02-21T23:12:53.987 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.988 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.988 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.988 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:53.988 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.988 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.988 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.988 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.988 INFO:teuthology.orchestra.run.smithi099.stdout: "server_port": { 2024-02-21T23:12:53.989 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "server_port", 2024-02-21T23:12:53.989 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:53.989 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.989 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.989 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "8080", 2024-02-21T23:12:53.989 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.989 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.989 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.989 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:53.990 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.990 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.990 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.990 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.990 INFO:teuthology.orchestra.run.smithi099.stdout: "ssl": { 2024-02-21T23:12:53.990 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "ssl", 2024-02-21T23:12:53.990 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:53.990 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.991 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.991 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:53.991 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.991 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.991 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.991 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:53.991 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.991 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.992 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.992 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.992 INFO:teuthology.orchestra.run.smithi099.stdout: "ssl_server_port": { 2024-02-21T23:12:53.992 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "ssl_server_port", 2024-02-21T23:12:53.992 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:53.992 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.992 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.992 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "8443", 2024-02-21T23:12:53.993 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.993 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.993 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.993 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:53.993 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.993 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.993 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.993 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.994 INFO:teuthology.orchestra.run.smithi099.stdout: "standby_behaviour": { 2024-02-21T23:12:53.994 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "standby_behaviour", 2024-02-21T23:12:53.994 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:53.994 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.994 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.994 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "redirect", 2024-02-21T23:12:53.994 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:53.994 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:53.995 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:53.995 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:53.995 INFO:teuthology.orchestra.run.smithi099.stdout: "redirect" 2024-02-21T23:12:53.995 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:53.995 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:53.995 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:53.995 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:53.995 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:53.996 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:53.996 INFO:teuthology.orchestra.run.smithi099.stdout: "standby_error_status_code": { 2024-02-21T23:12:53.996 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "standby_error_status_code", 2024-02-21T23:12:53.996 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:53.996 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:53.996 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:53.997 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "500", 2024-02-21T23:12:53.999 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "400", 2024-02-21T23:12:53.999 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "599", 2024-02-21T23:12:53.999 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:53.999 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.000 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.000 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.000 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.000 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.000 INFO:teuthology.orchestra.run.smithi099.stdout: "url_prefix": { 2024-02-21T23:12:54.000 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "url_prefix", 2024-02-21T23:12:54.000 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.001 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.001 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.001 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.001 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.001 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.001 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.001 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.001 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.002 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.002 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.002 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.002 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.002 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.002 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:54.002 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "devicehealth", 2024-02-21T23:12:54.003 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:54.003 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:54.003 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:54.003 INFO:teuthology.orchestra.run.smithi099.stdout: "enable_monitoring": { 2024-02-21T23:12:54.003 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "enable_monitoring", 2024-02-21T23:12:54.003 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.003 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.003 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.004 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:54.004 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.004 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.004 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.004 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "monitor device health metrics", 2024-02-21T23:12:54.004 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.004 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.004 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.005 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.005 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:54.005 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:54.005 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.005 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.005 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.005 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.005 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.006 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.006 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.006 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.006 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.006 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.006 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.006 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.006 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.006 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.007 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.007 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.007 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.007 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.007 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.007 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:54.007 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:54.007 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.008 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.008 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.008 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.008 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.008 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.008 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.008 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.008 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.009 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.009 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.009 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.009 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:54.009 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:54.009 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.009 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.009 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.010 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:54.010 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.010 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.010 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.010 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.010 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.010 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.010 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.010 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.011 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.011 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.011 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.011 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.011 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.011 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.011 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.011 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:54.012 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:54.012 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.012 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.012 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.012 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.012 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.012 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.012 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.013 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.013 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.013 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.013 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.013 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.013 INFO:teuthology.orchestra.run.smithi099.stdout: "mark_out_threshold": { 2024-02-21T23:12:54.013 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "mark_out_threshold", 2024-02-21T23:12:54.013 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-02-21T23:12:54.014 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.014 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.014 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "2419200", 2024-02-21T23:12:54.014 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.014 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.014 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.014 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-02-21T23:12:54.014 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.014 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.015 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.015 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.015 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": { 2024-02-21T23:12:54.015 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "pool_name", 2024-02-21T23:12:54.015 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.015 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.015 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.015 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "device_health_metrics", 2024-02-21T23:12:54.016 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.016 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.016 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.016 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "name of pool in which to store device health metrics", 2024-02-21T23:12:54.016 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.016 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.016 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.016 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.017 INFO:teuthology.orchestra.run.smithi099.stdout: "retention_period": { 2024-02-21T23:12:54.017 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "retention_period", 2024-02-21T23:12:54.017 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-02-21T23:12:54.017 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.017 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.017 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "15552000", 2024-02-21T23:12:54.017 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.017 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.017 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.018 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "how long to retain device health metrics", 2024-02-21T23:12:54.018 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.018 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.018 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.018 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.018 INFO:teuthology.orchestra.run.smithi099.stdout: "scrape_frequency": { 2024-02-21T23:12:54.018 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "scrape_frequency", 2024-02-21T23:12:54.018 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-02-21T23:12:54.019 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.019 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.019 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "86400", 2024-02-21T23:12:54.019 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.019 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.019 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.019 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "how frequently to scrape device health metrics", 2024-02-21T23:12:54.019 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.019 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.020 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.020 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.020 INFO:teuthology.orchestra.run.smithi099.stdout: "self_heal": { 2024-02-21T23:12:54.020 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "self_heal", 2024-02-21T23:12:54.020 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.020 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.020 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.021 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:54.021 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.021 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.021 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.021 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-02-21T23:12:54.021 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.021 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.021 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.021 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.022 INFO:teuthology.orchestra.run.smithi099.stdout: "sleep_interval": { 2024-02-21T23:12:54.022 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "sleep_interval", 2024-02-21T23:12:54.022 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-02-21T23:12:54.022 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.022 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.022 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "600", 2024-02-21T23:12:54.022 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.022 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.023 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.023 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "how frequently to wake up and check device health", 2024-02-21T23:12:54.023 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.023 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.023 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.023 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.023 INFO:teuthology.orchestra.run.smithi099.stdout: "warn_threshold": { 2024-02-21T23:12:54.024 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "warn_threshold", 2024-02-21T23:12:54.024 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-02-21T23:12:54.024 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.024 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.024 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "7257600", 2024-02-21T23:12:54.024 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.024 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.025 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.025 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-02-21T23:12:54.025 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.025 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.025 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.025 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.025 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.025 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.026 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:54.026 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "diskprediction_local", 2024-02-21T23:12:54.026 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:54.026 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:54.026 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:54.026 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:54.026 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:54.026 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.027 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.027 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.027 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.027 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.027 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.027 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.027 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.027 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.028 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.028 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.028 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.028 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.028 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.028 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.028 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.028 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.029 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.029 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.029 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:54.029 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:54.029 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.029 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.029 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.029 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.030 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.030 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.030 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.030 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.030 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.030 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.030 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.030 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.031 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:54.031 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:54.031 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.031 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.031 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.031 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:54.031 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.031 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.032 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.032 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.032 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.032 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.032 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.032 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.032 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.033 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.033 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.033 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.033 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.033 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.033 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.033 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:54.033 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:54.033 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.034 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.034 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.034 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.034 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.034 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.034 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.034 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.034 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.035 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.035 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.035 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.035 INFO:teuthology.orchestra.run.smithi099.stdout: "predict_interval": { 2024-02-21T23:12:54.035 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "predict_interval", 2024-02-21T23:12:54.035 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.035 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.035 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.036 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "86400", 2024-02-21T23:12:54.036 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.036 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.036 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.036 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.036 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.036 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.036 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.037 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.037 INFO:teuthology.orchestra.run.smithi099.stdout: "predictor_model": { 2024-02-21T23:12:54.037 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "predictor_model", 2024-02-21T23:12:54.037 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.037 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.037 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.037 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "prophetstor", 2024-02-21T23:12:54.037 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.038 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.038 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.038 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.038 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.038 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.038 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.038 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.038 INFO:teuthology.orchestra.run.smithi099.stdout: "sleep_interval": { 2024-02-21T23:12:54.038 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "sleep_interval", 2024-02-21T23:12:54.039 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.039 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.039 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.039 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "600", 2024-02-21T23:12:54.039 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.039 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.039 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.039 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.040 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.040 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.040 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.040 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.040 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.040 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.040 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:54.040 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "influx", 2024-02-21T23:12:54.041 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": false, 2024-02-21T23:12:54.041 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "influxdb python module not found", 2024-02-21T23:12:54.041 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:54.041 INFO:teuthology.orchestra.run.smithi099.stdout: "batch_size": { 2024-02-21T23:12:54.041 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "batch_size", 2024-02-21T23:12:54.041 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:54.041 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.041 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.042 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "5000", 2024-02-21T23:12:54.042 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.042 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.042 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.042 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-02-21T23:12:54.042 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.042 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.042 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.043 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.043 INFO:teuthology.orchestra.run.smithi099.stdout: "database": { 2024-02-21T23:12:54.043 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "database", 2024-02-21T23:12:54.043 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.043 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.043 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.043 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "ceph", 2024-02-21T23:12:54.043 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.044 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.044 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.044 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-02-21T23:12:54.044 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.044 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.044 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.044 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.044 INFO:teuthology.orchestra.run.smithi099.stdout: "hostname": { 2024-02-21T23:12:54.045 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "hostname", 2024-02-21T23:12:54.045 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.045 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.045 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.045 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.045 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.045 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.045 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.046 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "InfluxDB server hostname", 2024-02-21T23:12:54.046 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.046 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.046 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.046 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.046 INFO:teuthology.orchestra.run.smithi099.stdout: "interval": { 2024-02-21T23:12:54.046 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "interval", 2024-02-21T23:12:54.047 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-02-21T23:12:54.047 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.047 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.047 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "30", 2024-02-21T23:12:54.047 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "5", 2024-02-21T23:12:54.047 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.047 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.047 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-02-21T23:12:54.048 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.048 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.048 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.048 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.048 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:54.048 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:54.048 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.048 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.049 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.049 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.049 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.049 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.049 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.049 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.049 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.049 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.049 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.050 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.050 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.050 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.050 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.050 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.050 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.050 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.050 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.051 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:54.051 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:54.051 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.051 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.051 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.051 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.051 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.051 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.052 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.052 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.052 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.052 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.052 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.052 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.053 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:54.053 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:54.053 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.053 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.053 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.053 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:54.053 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.053 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.054 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.054 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.054 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.054 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.054 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.054 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.054 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.054 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.054 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.055 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.055 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.055 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.055 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.055 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:54.055 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:54.055 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.055 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.056 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.056 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.056 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.056 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.056 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.056 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.056 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.056 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.057 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.057 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.057 INFO:teuthology.orchestra.run.smithi099.stdout: "password": { 2024-02-21T23:12:54.057 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "password", 2024-02-21T23:12:54.057 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.057 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.057 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.057 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.058 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.058 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.058 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.058 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "password of InfluxDB server user", 2024-02-21T23:12:54.058 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.058 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.058 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.058 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.059 INFO:teuthology.orchestra.run.smithi099.stdout: "port": { 2024-02-21T23:12:54.059 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "port", 2024-02-21T23:12:54.059 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:54.059 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.059 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.059 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "8086", 2024-02-21T23:12:54.059 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.059 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.059 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.060 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "InfluxDB server port", 2024-02-21T23:12:54.060 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.060 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.060 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.060 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.060 INFO:teuthology.orchestra.run.smithi099.stdout: "ssl": { 2024-02-21T23:12:54.060 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "ssl", 2024-02-21T23:12:54.060 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.061 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.061 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.061 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "false", 2024-02-21T23:12:54.061 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.061 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.061 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.061 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-02-21T23:12:54.061 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.062 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.062 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.062 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.062 INFO:teuthology.orchestra.run.smithi099.stdout: "threads": { 2024-02-21T23:12:54.062 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "threads", 2024-02-21T23:12:54.062 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:54.062 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.062 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.062 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "5", 2024-02-21T23:12:54.063 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "1", 2024-02-21T23:12:54.063 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "32", 2024-02-21T23:12:54.063 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.063 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-02-21T23:12:54.063 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.063 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.063 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.063 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.064 INFO:teuthology.orchestra.run.smithi099.stdout: "username": { 2024-02-21T23:12:54.064 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "username", 2024-02-21T23:12:54.064 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.064 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.064 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.064 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.064 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.064 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.065 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.065 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "username of InfluxDB server user", 2024-02-21T23:12:54.065 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.065 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.065 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.065 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.065 INFO:teuthology.orchestra.run.smithi099.stdout: "verify_ssl": { 2024-02-21T23:12:54.065 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "verify_ssl", 2024-02-21T23:12:54.066 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.066 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.066 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.066 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "true", 2024-02-21T23:12:54.066 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.066 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.066 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.066 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-02-21T23:12:54.067 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.067 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.067 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.067 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.067 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.067 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.067 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:54.067 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "insights", 2024-02-21T23:12:54.068 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:54.068 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:54.068 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:54.068 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:54.068 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:54.068 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.068 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.068 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.068 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.069 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.069 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.069 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.069 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.069 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.069 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.069 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.069 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.070 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.070 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.070 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.070 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.070 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.070 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.070 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.071 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:54.071 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:54.071 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.071 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.071 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.071 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.071 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.071 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.072 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.072 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.072 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.072 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.072 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.072 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.072 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:54.072 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:54.073 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.073 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.073 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.073 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:54.073 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.073 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.073 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.073 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.074 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.074 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.074 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.074 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.074 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.074 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.074 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.074 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.075 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.075 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.075 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.075 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:54.075 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:54.075 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.075 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.076 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.076 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.076 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.076 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.076 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.076 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.076 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.076 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.077 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.077 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.077 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.077 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.077 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:54.077 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "iostat", 2024-02-21T23:12:54.077 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:54.077 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:54.078 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:54.078 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:54.078 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:54.078 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.078 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.078 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.078 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.078 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.079 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.079 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.079 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.079 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.079 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.079 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.079 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.079 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.079 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.080 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.080 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.080 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.080 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.080 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.080 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:54.080 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:54.080 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.081 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.081 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.081 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.081 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.081 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.081 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.081 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.081 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.082 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.082 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.082 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.082 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:54.082 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:54.082 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.082 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.082 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.082 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:54.083 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.083 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.083 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.083 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.083 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.083 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.083 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.084 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.084 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.084 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.084 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.084 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.084 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.084 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.085 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:54.085 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:54.085 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.085 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.085 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.085 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.085 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.085 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.086 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.086 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.086 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.086 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.086 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.086 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.086 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.087 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:54.087 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "localpool", 2024-02-21T23:12:54.087 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:54.087 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:54.087 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:54.087 INFO:teuthology.orchestra.run.smithi099.stdout: "failure_domain": { 2024-02-21T23:12:54.087 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "failure_domain", 2024-02-21T23:12:54.087 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.088 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.088 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.088 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "host", 2024-02-21T23:12:54.088 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.088 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.088 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.088 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "failure domain for any created local pool", 2024-02-21T23:12:54.089 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-02-21T23:12:54.089 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.089 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.089 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.089 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:54.089 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:54.089 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.090 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.090 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.090 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.090 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.090 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.090 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.090 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.090 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.090 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.091 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.091 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.091 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.091 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.091 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.091 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.091 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.091 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.092 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.092 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:54.092 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:54.092 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.092 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.092 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.092 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.092 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.093 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.093 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.093 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.093 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.093 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.093 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.093 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.093 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:54.094 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:54.094 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.094 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.094 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.094 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:54.094 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.095 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.095 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.095 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.095 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.095 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.095 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.095 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.095 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.096 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.096 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.096 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.096 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.096 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.096 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.096 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:54.096 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:54.097 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.097 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.097 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.097 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.097 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.097 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.097 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.097 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.098 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.098 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.098 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.098 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.098 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": { 2024-02-21T23:12:54.098 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "min_size", 2024-02-21T23:12:54.098 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:54.099 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.099 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.099 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.099 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.099 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.099 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.099 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "default min_size for any created local pool", 2024-02-21T23:12:54.099 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-02-21T23:12:54.099 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.100 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.100 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.100 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rep": { 2024-02-21T23:12:54.100 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "num_rep", 2024-02-21T23:12:54.100 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:54.100 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.100 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.100 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "3", 2024-02-21T23:12:54.101 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.101 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.101 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.101 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "default replica count for any created local pool", 2024-02-21T23:12:54.101 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.101 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.101 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.101 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.102 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": { 2024-02-21T23:12:54.102 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "pg_num", 2024-02-21T23:12:54.102 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:54.102 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.102 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.102 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "128", 2024-02-21T23:12:54.102 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.102 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.103 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.103 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "default pg_num for any created local pool", 2024-02-21T23:12:54.103 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.103 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.103 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.103 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.103 INFO:teuthology.orchestra.run.smithi099.stdout: "prefix": { 2024-02-21T23:12:54.103 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "prefix", 2024-02-21T23:12:54.104 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.104 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.104 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.104 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.104 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.104 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.104 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.104 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "name prefix for any created local pool", 2024-02-21T23:12:54.105 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.105 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.105 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.105 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.105 INFO:teuthology.orchestra.run.smithi099.stdout: "subtree": { 2024-02-21T23:12:54.105 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "subtree", 2024-02-21T23:12:54.105 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.105 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.106 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.106 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "rack", 2024-02-21T23:12:54.106 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.106 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.106 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.106 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "CRUSH level for which to create a local pool", 2024-02-21T23:12:54.106 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-02-21T23:12:54.106 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.107 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.107 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.107 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.107 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.107 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:54.107 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "mds_autoscaler", 2024-02-21T23:12:54.107 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:54.107 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:54.108 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:54.108 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:54.108 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:54.108 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.108 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.108 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.108 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.108 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.109 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.109 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.109 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.109 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.109 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.109 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.109 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.109 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.109 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.110 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.110 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.110 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.110 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.110 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.110 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:54.110 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:54.110 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.111 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.111 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.111 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.111 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.111 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.111 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.111 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.111 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.112 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.112 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.112 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.112 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:54.112 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:54.112 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.112 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.112 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.112 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:54.113 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.113 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.113 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.113 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.113 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.113 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.113 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.113 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.114 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.114 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.114 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.114 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.114 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.114 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.114 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.114 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:54.115 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:54.115 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.115 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.115 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.115 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.115 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.115 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.115 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.115 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.116 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.116 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.116 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.116 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.116 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.116 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.116 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:54.116 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "mirroring", 2024-02-21T23:12:54.117 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:54.117 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:54.117 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:54.117 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:54.117 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:54.117 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.117 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.117 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.118 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.118 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.118 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.118 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.118 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.118 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.118 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.119 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.119 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.119 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.119 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.119 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.119 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.119 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.119 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.119 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.120 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:54.120 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:54.120 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.120 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.120 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.120 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.120 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.120 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.121 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.121 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.121 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.121 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.121 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.121 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.121 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:54.121 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:54.122 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.122 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.122 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.122 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:54.122 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.122 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.122 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.122 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.123 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.123 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.123 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.123 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.123 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.123 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.123 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.123 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.123 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.124 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.124 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.124 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:54.124 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:54.124 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.124 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.124 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.124 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.125 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.125 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.125 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.125 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.125 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.125 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.125 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.125 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.126 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.126 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.126 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:54.126 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "nfs", 2024-02-21T23:12:54.126 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:54.126 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:54.126 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:54.126 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:54.126 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:54.127 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.127 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.127 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.127 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.127 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.127 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.127 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.127 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.128 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.128 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.128 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.128 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.128 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.128 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.128 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.128 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.129 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.129 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.129 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.129 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:54.129 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:54.129 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.129 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.129 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.130 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.130 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.130 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.130 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.130 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.130 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.130 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.130 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.130 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.131 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:54.131 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:54.131 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.131 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.131 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.131 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:54.131 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.131 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.132 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.132 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.132 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.132 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.132 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.132 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.132 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.132 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.133 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.133 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.133 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.133 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.133 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.133 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:54.133 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:54.133 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.134 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.134 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.134 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.134 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.134 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.134 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.134 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.135 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.135 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.135 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.135 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.135 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.135 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.135 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:54.135 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "orchestrator", 2024-02-21T23:12:54.135 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:54.136 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:54.136 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:54.136 INFO:teuthology.orchestra.run.smithi099.stdout: "fail_fs": { 2024-02-21T23:12:54.136 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "fail_fs", 2024-02-21T23:12:54.136 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.136 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.136 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.137 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.137 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.137 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.137 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.137 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-02-21T23:12:54.137 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.137 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.137 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.138 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.138 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:54.138 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:54.138 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.138 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.138 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.138 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.138 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.138 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.139 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.139 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.139 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.139 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.139 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.139 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.139 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.139 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.140 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.140 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.140 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.140 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.140 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.140 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:54.140 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:54.140 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.141 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.141 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.141 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.141 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.141 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.141 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.141 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.141 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.142 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.142 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.142 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.142 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:54.142 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:54.142 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.142 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.143 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.143 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:54.143 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.143 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.143 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.143 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.143 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.143 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.144 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.144 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.144 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.144 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.144 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.144 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.144 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.144 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.145 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.145 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:54.145 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:54.145 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.145 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.145 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.145 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.145 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.146 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.146 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.146 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.146 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.146 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.146 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.146 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.146 INFO:teuthology.orchestra.run.smithi099.stdout: "orchestrator": { 2024-02-21T23:12:54.147 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "orchestrator", 2024-02-21T23:12:54.147 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.147 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.147 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.147 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.147 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.147 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.148 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.148 INFO:teuthology.orchestra.run.smithi099.stdout: "cephadm", 2024-02-21T23:12:54.148 INFO:teuthology.orchestra.run.smithi099.stdout: "rook", 2024-02-21T23:12:54.148 INFO:teuthology.orchestra.run.smithi099.stdout: "test_orchestrator" 2024-02-21T23:12:54.148 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.148 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Orchestrator backend", 2024-02-21T23:12:54.148 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.148 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.149 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.149 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.149 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.149 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.149 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:54.149 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "osd_perf_query", 2024-02-21T23:12:54.149 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:54.150 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:54.150 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:54.150 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:54.150 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:54.150 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.150 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.150 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.151 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.151 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.151 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.151 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.151 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.151 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.151 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.152 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.152 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.152 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.152 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.152 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.152 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.152 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.152 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.153 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.153 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:54.153 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:54.153 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.153 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.153 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.153 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.154 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.154 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.154 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.154 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.154 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.154 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.154 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.154 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.155 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:54.155 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:54.155 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.155 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.155 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.155 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:54.155 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.155 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.156 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.156 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.156 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.156 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.156 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.156 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.156 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.156 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.157 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.157 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.157 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.157 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.157 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.157 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:54.157 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:54.157 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.158 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.158 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.158 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.158 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.158 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.158 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.158 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.158 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.158 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.159 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.159 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.159 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.159 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.159 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:54.159 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "osd_support", 2024-02-21T23:12:54.159 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:54.159 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:54.160 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:54.160 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:54.160 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:54.160 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.160 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.160 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.160 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.160 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.161 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.161 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.161 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.161 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.161 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.161 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.161 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.161 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.162 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.162 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.162 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.162 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.162 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.162 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.162 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:54.162 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:54.162 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.163 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.163 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.163 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.163 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.163 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.163 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.163 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.163 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.164 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.164 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.164 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.164 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:54.164 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:54.164 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.164 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.164 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.165 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:54.165 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.165 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.165 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.165 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.165 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.165 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.165 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.166 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.166 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.166 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.166 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.166 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.166 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.166 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.166 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.167 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:54.167 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:54.167 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.167 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.167 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.167 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.167 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.168 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.168 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.168 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.168 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.168 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.168 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.168 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.169 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.169 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.169 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:54.169 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "pg_autoscaler", 2024-02-21T23:12:54.169 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:54.169 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:54.169 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:54.169 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:54.170 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:54.170 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.170 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.170 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.170 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.170 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.170 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.170 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.170 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.171 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.171 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.171 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.171 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.171 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.171 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.171 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.171 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.172 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.172 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.172 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.172 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:54.172 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:54.172 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.172 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.172 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.173 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.173 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.173 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.173 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.173 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.173 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.173 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.173 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.174 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.174 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:54.174 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:54.174 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.174 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.174 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.174 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:54.174 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.175 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.175 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.175 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.175 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.175 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.175 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.175 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.175 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.176 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.176 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.176 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.176 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.176 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.176 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.176 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:54.176 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:54.177 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.177 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.177 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.177 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.177 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.177 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.177 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.177 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.178 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.178 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.178 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.178 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.178 INFO:teuthology.orchestra.run.smithi099.stdout: "sleep_interval": { 2024-02-21T23:12:54.178 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "sleep_interval", 2024-02-21T23:12:54.178 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-02-21T23:12:54.178 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.178 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.179 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "60", 2024-02-21T23:12:54.179 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.179 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.179 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.179 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.179 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.179 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.180 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.180 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.180 INFO:teuthology.orchestra.run.smithi099.stdout: "threshold": { 2024-02-21T23:12:54.180 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "threshold", 2024-02-21T23:12:54.180 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "float", 2024-02-21T23:12:54.180 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.180 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.180 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "3.0", 2024-02-21T23:12:54.181 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "1.0", 2024-02-21T23:12:54.181 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.181 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.181 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "scaling threshold", 2024-02-21T23:12:54.181 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-02-21T23:12:54.181 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.181 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.182 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.182 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.182 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.182 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:54.182 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "progress", 2024-02-21T23:12:54.182 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:54.182 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:54.182 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:54.183 INFO:teuthology.orchestra.run.smithi099.stdout: "allow_pg_recovery_event": { 2024-02-21T23:12:54.183 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "allow_pg_recovery_event", 2024-02-21T23:12:54.183 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.183 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.183 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.183 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.183 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.183 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.183 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.184 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "allow the module to show pg recovery progress", 2024-02-21T23:12:54.184 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.184 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.184 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.184 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.184 INFO:teuthology.orchestra.run.smithi099.stdout: "enabled": { 2024-02-21T23:12:54.184 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "enabled", 2024-02-21T23:12:54.184 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.185 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.185 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.185 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:54.185 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.185 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.185 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.185 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.185 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.186 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.186 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.186 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.186 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:54.186 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:54.186 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.186 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.186 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.187 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.187 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.187 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.187 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.187 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.187 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.187 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.187 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.188 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.188 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.188 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.188 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.188 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.188 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.188 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.188 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.189 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:54.189 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:54.189 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.189 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.189 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.189 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.189 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.189 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.189 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.190 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.190 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.190 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.190 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.190 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.190 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:54.190 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:54.190 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.191 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.191 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.191 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:54.191 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.191 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.191 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.191 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.191 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.192 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.192 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.192 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.192 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.192 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.192 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.192 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.192 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.193 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.193 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.193 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:54.193 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:54.193 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.193 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.193 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.193 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.194 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.194 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.194 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.194 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.194 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.194 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.194 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.194 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.195 INFO:teuthology.orchestra.run.smithi099.stdout: "max_completed_events": { 2024-02-21T23:12:54.195 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "max_completed_events", 2024-02-21T23:12:54.195 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:54.195 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.195 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.195 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "50", 2024-02-21T23:12:54.195 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.195 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.196 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.196 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "number of past completed events to remember", 2024-02-21T23:12:54.196 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.196 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.196 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.196 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.196 INFO:teuthology.orchestra.run.smithi099.stdout: "sleep_interval": { 2024-02-21T23:12:54.197 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "sleep_interval", 2024-02-21T23:12:54.197 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-02-21T23:12:54.197 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.197 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.197 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "5", 2024-02-21T23:12:54.197 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.197 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.197 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.197 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "how long the module is going to sleep", 2024-02-21T23:12:54.198 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.198 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.198 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.198 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.198 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.198 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.198 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:54.198 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "prometheus", 2024-02-21T23:12:54.199 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:54.199 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:54.199 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:54.199 INFO:teuthology.orchestra.run.smithi099.stdout: "cache": { 2024-02-21T23:12:54.199 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "cache", 2024-02-21T23:12:54.199 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.199 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.199 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.199 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:54.200 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.200 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.200 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.203 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.203 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.203 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.204 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.204 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.204 INFO:teuthology.orchestra.run.smithi099.stdout: "exclude_perf_counters": { 2024-02-21T23:12:54.204 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "exclude_perf_counters", 2024-02-21T23:12:54.204 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.204 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.204 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.204 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:54.205 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.205 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.205 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.205 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-02-21T23:12:54.205 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-02-21T23:12:54.205 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.205 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.205 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.206 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:54.206 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:54.206 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.206 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.206 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.206 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.206 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.206 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.207 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.207 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.207 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.207 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.207 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.207 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.207 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.207 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.208 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.208 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.208 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.208 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.208 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.208 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:54.208 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:54.208 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.208 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.209 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.209 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.209 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.209 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.209 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.209 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.209 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.209 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.210 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.210 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.210 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:54.210 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:54.210 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.210 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.210 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.210 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:54.211 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.211 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.211 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.211 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.211 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.211 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.211 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.211 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.212 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.212 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.212 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.212 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.212 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.212 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.212 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.212 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:54.213 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:54.213 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.213 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.213 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.213 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.213 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.213 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.213 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.214 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.214 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.214 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.214 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.214 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.214 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_stats_pools": { 2024-02-21T23:12:54.214 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "rbd_stats_pools", 2024-02-21T23:12:54.214 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.215 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.215 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.215 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.215 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.215 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.215 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.215 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.215 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.216 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.216 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.216 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.216 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_stats_pools_refresh_interval": { 2024-02-21T23:12:54.216 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-02-21T23:12:54.216 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:54.216 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.216 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.217 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "300", 2024-02-21T23:12:54.217 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.217 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.217 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.217 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.217 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.218 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.218 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.218 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.218 INFO:teuthology.orchestra.run.smithi099.stdout: "scrape_interval": { 2024-02-21T23:12:54.218 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "scrape_interval", 2024-02-21T23:12:54.218 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "float", 2024-02-21T23:12:54.218 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.218 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.219 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "15.0", 2024-02-21T23:12:54.219 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.219 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.219 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.219 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.219 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.219 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.219 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.220 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.220 INFO:teuthology.orchestra.run.smithi099.stdout: "server_addr": { 2024-02-21T23:12:54.220 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "server_addr", 2024-02-21T23:12:54.220 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.220 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.220 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.220 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "::", 2024-02-21T23:12:54.220 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.221 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.221 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.221 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-02-21T23:12:54.221 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.221 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.221 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.221 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.221 INFO:teuthology.orchestra.run.smithi099.stdout: "server_port": { 2024-02-21T23:12:54.222 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "server_port", 2024-02-21T23:12:54.222 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:54.222 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.222 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.222 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "9283", 2024-02-21T23:12:54.222 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.222 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.222 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.222 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-02-21T23:12:54.223 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.223 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.223 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.223 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.223 INFO:teuthology.orchestra.run.smithi099.stdout: "stale_cache_strategy": { 2024-02-21T23:12:54.223 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "stale_cache_strategy", 2024-02-21T23:12:54.223 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.223 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.224 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.224 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "log", 2024-02-21T23:12:54.224 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.224 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.224 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.224 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.224 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.224 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.225 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.225 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.225 INFO:teuthology.orchestra.run.smithi099.stdout: "standby_behaviour": { 2024-02-21T23:12:54.225 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "standby_behaviour", 2024-02-21T23:12:54.225 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.225 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.225 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.225 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "default", 2024-02-21T23:12:54.225 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.226 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.226 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.226 INFO:teuthology.orchestra.run.smithi099.stdout: "default", 2024-02-21T23:12:54.226 INFO:teuthology.orchestra.run.smithi099.stdout: "error" 2024-02-21T23:12:54.226 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.226 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.226 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.226 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.227 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.227 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.227 INFO:teuthology.orchestra.run.smithi099.stdout: "standby_error_status_code": { 2024-02-21T23:12:54.227 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "standby_error_status_code", 2024-02-21T23:12:54.227 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:54.227 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.227 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.227 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "500", 2024-02-21T23:12:54.227 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "400", 2024-02-21T23:12:54.228 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "599", 2024-02-21T23:12:54.228 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.228 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.228 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.228 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.228 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.228 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.228 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.229 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.229 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:54.229 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "rbd_support", 2024-02-21T23:12:54.229 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:54.229 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:54.229 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:54.229 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:54.229 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:54.230 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.230 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.230 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.230 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.230 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.230 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.231 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.231 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.231 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.231 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.231 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.231 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.231 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.231 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.232 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.232 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.232 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.232 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.232 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.232 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:54.232 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:54.232 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.233 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.233 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.233 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.233 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.233 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.233 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.233 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.233 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.233 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.234 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.234 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.234 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:54.234 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:54.234 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.234 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.234 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.234 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:54.235 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.235 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.235 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.235 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.235 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.235 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.235 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.235 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.235 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.236 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.236 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.236 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.236 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.236 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.236 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.236 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:54.236 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:54.237 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.237 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.237 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.237 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.237 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.237 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.237 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.237 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.238 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.238 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.238 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.238 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.238 INFO:teuthology.orchestra.run.smithi099.stdout: "max_concurrent_snap_create": { 2024-02-21T23:12:54.238 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "max_concurrent_snap_create", 2024-02-21T23:12:54.238 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:54.238 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.238 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.239 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "10", 2024-02-21T23:12:54.239 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.239 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.239 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.239 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.239 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.239 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.239 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.240 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.240 INFO:teuthology.orchestra.run.smithi099.stdout: "mirror_snapshot_schedule": { 2024-02-21T23:12:54.240 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "mirror_snapshot_schedule", 2024-02-21T23:12:54.240 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.240 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.240 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.241 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.241 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.241 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.241 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.241 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.241 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.241 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.242 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.242 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.242 INFO:teuthology.orchestra.run.smithi099.stdout: "trash_purge_schedule": { 2024-02-21T23:12:54.242 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "trash_purge_schedule", 2024-02-21T23:12:54.242 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.242 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.242 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.242 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.242 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.243 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.243 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.243 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.243 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.243 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.243 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.243 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.243 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.244 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.244 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:54.244 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "restful", 2024-02-21T23:12:54.244 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:54.244 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:54.244 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:54.244 INFO:teuthology.orchestra.run.smithi099.stdout: "enable_auth": { 2024-02-21T23:12:54.244 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "enable_auth", 2024-02-21T23:12:54.245 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.245 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.245 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.245 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:54.245 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.245 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.245 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.245 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.246 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.246 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.246 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.246 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.246 INFO:teuthology.orchestra.run.smithi099.stdout: "key_file": { 2024-02-21T23:12:54.246 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "key_file", 2024-02-21T23:12:54.246 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.246 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.247 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.247 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.247 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.247 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.247 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.247 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.247 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.247 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.247 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.248 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.248 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:54.248 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:54.248 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.248 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.248 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.248 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.248 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.249 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.249 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.249 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.249 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.249 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.249 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.249 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.249 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.250 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.250 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.250 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.250 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.250 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.250 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.250 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:54.250 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:54.250 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.251 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.251 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.251 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.251 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.251 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.251 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.251 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.251 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.252 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.252 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.252 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.252 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:54.252 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:54.252 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.252 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.252 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.253 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:54.253 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.253 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.253 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.253 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.253 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.253 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.253 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.254 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.254 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.254 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.254 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.254 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.254 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.254 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.254 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.255 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:54.255 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:54.255 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.255 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.255 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.255 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.255 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.255 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.256 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.256 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.256 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.256 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.256 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.256 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.256 INFO:teuthology.orchestra.run.smithi099.stdout: "server_addr": { 2024-02-21T23:12:54.256 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "server_addr", 2024-02-21T23:12:54.257 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.257 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.257 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.257 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.257 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.257 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.257 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.257 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.257 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.258 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.258 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.258 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.258 INFO:teuthology.orchestra.run.smithi099.stdout: "server_port": { 2024-02-21T23:12:54.258 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "server_port", 2024-02-21T23:12:54.259 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.259 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.259 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.260 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.260 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.260 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.260 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.260 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.260 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.260 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.261 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.261 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.261 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.261 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.261 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:54.261 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "rgw", 2024-02-21T23:12:54.261 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:54.261 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:54.262 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:54.262 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:54.262 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:54.262 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.262 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.262 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.262 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.262 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.263 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.263 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.263 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.263 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.263 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.263 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.263 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.263 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.263 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.264 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.264 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.264 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.264 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.264 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.264 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:54.264 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:54.265 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.265 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.265 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.265 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.265 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.265 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.265 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.265 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.265 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.266 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.266 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.266 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.266 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:54.266 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:54.266 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.266 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.267 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.267 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:54.267 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.267 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.268 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.268 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.268 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.268 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.268 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.268 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.268 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.269 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.269 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.269 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.269 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.269 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.269 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.269 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:54.270 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:54.270 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.270 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.270 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.270 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.270 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.270 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.271 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.271 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.271 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.271 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.271 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.271 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.272 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.272 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.272 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:54.272 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "rook", 2024-02-21T23:12:54.272 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:54.272 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:54.272 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:54.272 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:54.273 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:54.273 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.273 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.273 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.273 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.273 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.273 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.273 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.274 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.274 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.274 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.274 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.274 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.274 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.274 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.274 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.275 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.275 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.275 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.275 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.275 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:54.275 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:54.275 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.275 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.276 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.276 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.276 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.276 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.276 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.276 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.276 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.276 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.277 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.277 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.277 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:54.277 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:54.277 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.277 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.277 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.277 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:54.278 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.278 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.278 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.278 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.279 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.279 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.279 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.279 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.279 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.279 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.279 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.279 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.280 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.280 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.280 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.280 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:54.280 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:54.281 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.281 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.281 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.281 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.281 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.281 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.281 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.281 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.282 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.282 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.282 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.282 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.282 INFO:teuthology.orchestra.run.smithi099.stdout: "storage_class": { 2024-02-21T23:12:54.282 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "storage_class", 2024-02-21T23:12:54.282 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.283 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.283 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.283 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "local", 2024-02-21T23:12:54.283 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.283 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.283 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.283 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-02-21T23:12:54.283 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.284 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.284 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.284 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.284 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.284 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.284 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:54.285 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "selftest", 2024-02-21T23:12:54.285 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:54.285 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:54.285 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:54.285 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:54.285 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:54.285 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.285 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.286 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.286 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.286 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.286 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.286 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.286 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.286 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.287 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.287 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.287 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.287 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.287 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.287 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.287 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.287 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.287 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.288 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.288 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:54.288 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:54.288 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.288 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.288 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.288 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.289 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.289 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.289 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.289 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.289 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.289 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.289 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.289 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.290 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:54.290 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:54.290 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.290 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.290 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.290 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:54.290 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.290 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.291 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.291 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.291 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.291 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.291 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.291 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.291 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.291 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.292 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.292 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.292 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.292 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.292 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.292 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:54.292 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:54.292 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.293 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.293 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.293 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.293 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.293 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.293 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.293 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.294 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.294 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.294 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.294 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.294 INFO:teuthology.orchestra.run.smithi099.stdout: "roption1": { 2024-02-21T23:12:54.294 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "roption1", 2024-02-21T23:12:54.294 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.295 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.295 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.295 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.295 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.295 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.295 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.295 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.295 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.296 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.296 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.296 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.296 INFO:teuthology.orchestra.run.smithi099.stdout: "roption2": { 2024-02-21T23:12:54.296 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "roption2", 2024-02-21T23:12:54.296 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.296 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.296 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.297 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "xyz", 2024-02-21T23:12:54.297 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.297 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.297 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.297 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.297 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.297 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.297 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.298 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.298 INFO:teuthology.orchestra.run.smithi099.stdout: "rwoption1": { 2024-02-21T23:12:54.298 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "rwoption1", 2024-02-21T23:12:54.298 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.298 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.298 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.298 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.298 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.299 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.299 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.299 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.299 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.299 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.299 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.299 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.299 INFO:teuthology.orchestra.run.smithi099.stdout: "rwoption2": { 2024-02-21T23:12:54.300 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "rwoption2", 2024-02-21T23:12:54.300 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:54.300 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.300 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.300 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.300 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.300 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.300 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.301 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.301 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.301 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.301 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.301 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.301 INFO:teuthology.orchestra.run.smithi099.stdout: "rwoption3": { 2024-02-21T23:12:54.301 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "rwoption3", 2024-02-21T23:12:54.301 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "float", 2024-02-21T23:12:54.302 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.302 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.302 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.302 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.302 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.302 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.302 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.302 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.303 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.303 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.303 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.303 INFO:teuthology.orchestra.run.smithi099.stdout: "rwoption4": { 2024-02-21T23:12:54.304 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "rwoption4", 2024-02-21T23:12:54.304 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.304 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.304 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.304 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.304 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.305 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.305 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.305 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.305 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.305 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.305 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.305 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.306 INFO:teuthology.orchestra.run.smithi099.stdout: "rwoption5": { 2024-02-21T23:12:54.306 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "rwoption5", 2024-02-21T23:12:54.306 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.306 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.306 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.306 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.306 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.306 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.307 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.307 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.307 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.307 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.307 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.307 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.307 INFO:teuthology.orchestra.run.smithi099.stdout: "rwoption6": { 2024-02-21T23:12:54.307 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "rwoption6", 2024-02-21T23:12:54.308 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.308 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.308 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.308 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:54.308 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.309 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.309 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.309 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.309 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.309 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.309 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.309 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.309 INFO:teuthology.orchestra.run.smithi099.stdout: "rwoption7": { 2024-02-21T23:12:54.310 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "rwoption7", 2024-02-21T23:12:54.310 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:54.310 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.310 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.310 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.310 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "1", 2024-02-21T23:12:54.311 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "42", 2024-02-21T23:12:54.311 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.311 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.311 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.311 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.311 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.311 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.312 INFO:teuthology.orchestra.run.smithi099.stdout: "testkey": { 2024-02-21T23:12:54.312 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "testkey", 2024-02-21T23:12:54.312 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.312 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.312 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.312 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.312 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.312 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.313 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.313 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.313 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.313 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.313 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.313 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.313 INFO:teuthology.orchestra.run.smithi099.stdout: "testlkey": { 2024-02-21T23:12:54.313 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "testlkey", 2024-02-21T23:12:54.314 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.314 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.314 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.314 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.314 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.314 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.314 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.314 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.315 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.315 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.315 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.315 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.315 INFO:teuthology.orchestra.run.smithi099.stdout: "testnewline": { 2024-02-21T23:12:54.315 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "testnewline", 2024-02-21T23:12:54.315 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.315 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.316 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.316 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.316 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.316 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.316 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.316 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.316 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.316 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.317 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.317 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.317 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.317 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.317 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:54.317 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "snap_schedule", 2024-02-21T23:12:54.317 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:54.317 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:54.318 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:54.318 INFO:teuthology.orchestra.run.smithi099.stdout: "allow_m_granularity": { 2024-02-21T23:12:54.318 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "allow_m_granularity", 2024-02-21T23:12:54.318 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.318 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.318 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.318 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.318 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.319 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.319 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.319 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "allow minute scheduled snapshots", 2024-02-21T23:12:54.319 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.319 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.319 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.319 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.320 INFO:teuthology.orchestra.run.smithi099.stdout: "dump_on_update": { 2024-02-21T23:12:54.320 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "dump_on_update", 2024-02-21T23:12:54.320 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.320 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.320 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.320 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.320 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.320 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.321 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.321 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "dump database to debug log on update", 2024-02-21T23:12:54.321 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.321 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.321 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.321 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.321 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:54.321 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:54.322 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.322 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.322 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.322 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.322 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.322 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.322 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.322 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.323 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.323 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.323 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.323 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.323 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.323 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.323 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.323 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.324 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.324 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.324 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.324 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:54.324 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:54.324 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.324 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.324 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.325 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.325 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.325 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.325 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.325 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.325 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.325 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.325 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.326 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.326 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:54.326 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:54.326 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.326 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.326 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.326 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:54.326 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.327 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.327 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.327 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.327 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.327 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.327 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.327 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.327 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.328 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.328 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.328 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.328 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.328 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.328 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.328 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:54.329 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:54.329 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.329 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.329 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.329 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.329 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.329 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.329 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.330 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.330 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.330 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.330 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.330 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.330 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.330 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.330 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:54.331 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "stats", 2024-02-21T23:12:54.331 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:54.331 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:54.331 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:54.331 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:54.331 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:54.331 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.332 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.332 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.332 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.332 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.332 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.332 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.332 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.332 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.333 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.333 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.333 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.333 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.333 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.333 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.333 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.333 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.334 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.334 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.334 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:54.334 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:54.334 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.334 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.334 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.334 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.335 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.335 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.335 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.335 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.335 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.335 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.335 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.335 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.336 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:54.336 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:54.336 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.336 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.336 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.336 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:54.336 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.336 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.337 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.337 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.337 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.337 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.337 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.337 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.337 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.337 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.338 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.338 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.338 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.338 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.338 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.338 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:54.338 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:54.338 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.339 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.339 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.339 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.339 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.339 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.339 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.339 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.339 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.340 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.340 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.340 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.340 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.340 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.340 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:54.340 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "status", 2024-02-21T23:12:54.341 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:54.341 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:54.341 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:54.341 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:54.341 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:54.341 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.341 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.341 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.342 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.342 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.342 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.342 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.342 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.342 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.342 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.342 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.343 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.343 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.343 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.343 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.343 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.343 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.344 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.344 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.344 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:54.344 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:54.344 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.344 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.344 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.345 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.345 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.345 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.345 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.345 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.345 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.345 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.346 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.346 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.346 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:54.346 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:54.346 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.346 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.346 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.346 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:54.347 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.347 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.347 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.347 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.347 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.347 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.347 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.347 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.348 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.348 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.348 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.348 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.348 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.348 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.348 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.348 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:54.349 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:54.349 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.349 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.349 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.349 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.349 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.349 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.349 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.350 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.350 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.350 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.350 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.350 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.350 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.350 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.351 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:54.351 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "telegraf", 2024-02-21T23:12:54.351 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:54.351 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:54.351 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:54.351 INFO:teuthology.orchestra.run.smithi099.stdout: "address": { 2024-02-21T23:12:54.351 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "address", 2024-02-21T23:12:54.351 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.351 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.352 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.352 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-02-21T23:12:54.352 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.352 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.352 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.352 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.352 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.353 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.353 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.353 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.353 INFO:teuthology.orchestra.run.smithi099.stdout: "interval": { 2024-02-21T23:12:54.353 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "interval", 2024-02-21T23:12:54.353 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-02-21T23:12:54.353 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.353 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.354 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "15", 2024-02-21T23:12:54.354 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.354 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.354 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.354 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.354 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.354 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.354 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.355 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.355 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:54.355 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:54.355 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.355 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.355 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.355 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.355 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.356 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.356 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.356 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.356 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.356 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.356 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.356 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.356 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.357 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.357 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.357 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.357 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.357 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.357 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.357 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:54.357 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:54.358 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.358 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.358 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.358 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.358 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.358 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.358 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.358 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.359 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.359 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.360 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.360 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.361 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:54.361 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:54.361 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.361 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.361 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.361 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:54.361 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.361 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.362 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.362 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.362 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.362 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.362 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.362 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.362 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.362 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.363 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.363 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.363 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.363 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.363 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.363 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:54.363 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:54.363 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.363 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.364 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.365 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.365 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.365 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.365 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.365 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.366 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.366 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.366 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.366 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.366 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.366 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.366 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:54.366 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "telemetry", 2024-02-21T23:12:54.367 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:54.367 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:54.367 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:54.367 INFO:teuthology.orchestra.run.smithi099.stdout: "channel_basic": { 2024-02-21T23:12:54.367 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "channel_basic", 2024-02-21T23:12:54.367 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.367 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.367 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.367 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:54.368 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.368 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.368 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.368 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Share basic cluster information (size, version)", 2024-02-21T23:12:54.368 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.368 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.368 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.368 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.369 INFO:teuthology.orchestra.run.smithi099.stdout: "channel_crash": { 2024-02-21T23:12:54.369 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "channel_crash", 2024-02-21T23:12:54.369 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.369 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.369 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.369 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:54.369 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.369 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.370 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.370 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-02-21T23:12:54.370 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.370 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.370 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.370 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.370 INFO:teuthology.orchestra.run.smithi099.stdout: "channel_device": { 2024-02-21T23:12:54.370 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "channel_device", 2024-02-21T23:12:54.371 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.371 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.371 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.371 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:54.371 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.371 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.371 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.371 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-02-21T23:12:54.372 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.372 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.372 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.372 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.372 INFO:teuthology.orchestra.run.smithi099.stdout: "channel_ident": { 2024-02-21T23:12:54.372 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "channel_ident", 2024-02-21T23:12:54.372 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.372 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.373 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.373 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.373 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.373 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.373 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.373 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-02-21T23:12:54.373 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.373 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.374 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.374 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.374 INFO:teuthology.orchestra.run.smithi099.stdout: "channel_perf": { 2024-02-21T23:12:54.374 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "channel_perf", 2024-02-21T23:12:54.374 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.374 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.374 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.374 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.375 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.375 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.375 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.375 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Share various performance metrics of a cluster", 2024-02-21T23:12:54.375 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.375 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.375 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.375 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.375 INFO:teuthology.orchestra.run.smithi099.stdout: "contact": { 2024-02-21T23:12:54.376 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "contact", 2024-02-21T23:12:54.376 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.376 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.376 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.376 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.376 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.376 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.376 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.377 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.377 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.377 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.377 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.377 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.377 INFO:teuthology.orchestra.run.smithi099.stdout: "description": { 2024-02-21T23:12:54.377 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "description", 2024-02-21T23:12:54.377 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.378 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.378 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.378 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.378 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.378 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.378 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.378 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.378 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.378 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.379 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.379 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.379 INFO:teuthology.orchestra.run.smithi099.stdout: "device_url": { 2024-02-21T23:12:54.379 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "device_url", 2024-02-21T23:12:54.379 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.379 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.379 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.379 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-02-21T23:12:54.380 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.380 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.380 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.380 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.380 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.380 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.380 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.380 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.381 INFO:teuthology.orchestra.run.smithi099.stdout: "enabled": { 2024-02-21T23:12:54.381 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "enabled", 2024-02-21T23:12:54.381 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.381 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.381 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.381 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.381 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.381 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.381 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.382 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.382 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.382 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.382 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.382 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.382 INFO:teuthology.orchestra.run.smithi099.stdout: "interval": { 2024-02-21T23:12:54.382 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "interval", 2024-02-21T23:12:54.382 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:54.383 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.383 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.383 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "24", 2024-02-21T23:12:54.383 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "8", 2024-02-21T23:12:54.383 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.383 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.383 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.383 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.384 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.384 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.384 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.384 INFO:teuthology.orchestra.run.smithi099.stdout: "last_opt_revision": { 2024-02-21T23:12:54.384 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "last_opt_revision", 2024-02-21T23:12:54.384 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:54.384 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.384 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.385 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "1", 2024-02-21T23:12:54.385 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.385 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.385 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.385 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.385 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.385 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.385 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.385 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.386 INFO:teuthology.orchestra.run.smithi099.stdout: "leaderboard": { 2024-02-21T23:12:54.386 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "leaderboard", 2024-02-21T23:12:54.386 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.386 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.386 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.386 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.386 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.386 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.387 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.387 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.387 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.387 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.387 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.387 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.387 INFO:teuthology.orchestra.run.smithi099.stdout: "leaderboard_description": { 2024-02-21T23:12:54.387 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "leaderboard_description", 2024-02-21T23:12:54.388 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.388 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.388 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.388 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.388 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.388 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.388 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.388 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.389 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.389 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.389 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.389 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.389 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:54.389 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:54.389 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.389 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.390 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.390 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.390 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.390 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.390 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.390 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.390 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.390 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.390 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.391 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.391 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.391 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.391 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.391 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.391 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.391 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.391 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.392 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:54.392 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:54.392 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.392 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.392 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.392 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.392 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.392 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.393 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.393 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.393 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.393 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.393 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.393 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.393 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:54.393 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:54.393 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.394 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.394 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.394 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:54.394 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.394 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.394 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.394 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.395 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.395 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.395 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.395 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.395 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.395 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.395 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.395 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.395 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.396 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.396 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.396 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:54.396 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:54.396 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.396 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.396 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.396 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.397 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.397 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.397 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.397 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.397 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.397 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.397 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.397 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.398 INFO:teuthology.orchestra.run.smithi099.stdout: "organization": { 2024-02-21T23:12:54.398 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "organization", 2024-02-21T23:12:54.398 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.398 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.398 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.398 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.398 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.398 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.399 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.399 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.399 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.399 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.399 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.399 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.399 INFO:teuthology.orchestra.run.smithi099.stdout: "proxy": { 2024-02-21T23:12:54.399 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "proxy", 2024-02-21T23:12:54.399 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.400 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.400 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.400 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.400 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.400 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.400 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.400 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.400 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.401 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.401 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.401 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.401 INFO:teuthology.orchestra.run.smithi099.stdout: "url": { 2024-02-21T23:12:54.401 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "url", 2024-02-21T23:12:54.401 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.401 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.401 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.402 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-02-21T23:12:54.402 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.402 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.402 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.402 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.402 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.402 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.402 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.403 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.403 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.403 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.403 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:54.403 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "test_orchestrator", 2024-02-21T23:12:54.403 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:54.403 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:54.403 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:54.404 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:54.404 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:54.404 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.404 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.404 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.404 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.404 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.404 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.405 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.405 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.405 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.405 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.405 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.407 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.407 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.407 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.407 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.407 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.408 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.408 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.408 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.408 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:54.408 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:54.408 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.408 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.408 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.409 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.409 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.409 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.409 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.409 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.409 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.409 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.409 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.410 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.410 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:54.410 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:54.410 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.410 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.410 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.410 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:54.410 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.411 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.411 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.411 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.411 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.411 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.411 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.411 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.411 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.411 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.412 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.412 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.412 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.412 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.412 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.412 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:54.412 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:54.412 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.413 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.413 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.413 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.413 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.413 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.413 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.413 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.413 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.414 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.414 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.414 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.414 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.414 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.414 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:54.414 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "volumes", 2024-02-21T23:12:54.414 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:54.414 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:54.415 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:54.415 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:54.415 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:54.415 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.415 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.415 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.415 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.415 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.416 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.416 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.416 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.416 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.416 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.416 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.416 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.416 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.417 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.417 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.417 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.417 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.417 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.417 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.417 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:54.417 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:54.417 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.418 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.418 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.418 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.418 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.418 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.418 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.418 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.418 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.419 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.419 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.419 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.419 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:54.419 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:54.419 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.419 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.419 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.420 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:54.420 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.420 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.420 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.420 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.420 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.420 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.421 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.421 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.421 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.421 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.421 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.421 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.421 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.421 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.421 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.422 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:54.422 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:54.422 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.422 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.422 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.423 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.423 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.423 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.424 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.424 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.424 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.424 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.424 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.424 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.424 INFO:teuthology.orchestra.run.smithi099.stdout: "max_concurrent_clones": { 2024-02-21T23:12:54.424 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "max_concurrent_clones", 2024-02-21T23:12:54.425 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:54.425 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.425 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.425 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "4", 2024-02-21T23:12:54.425 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.425 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.425 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.425 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Number of asynchronous cloner threads", 2024-02-21T23:12:54.426 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.426 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.426 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.426 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.426 INFO:teuthology.orchestra.run.smithi099.stdout: "periodic_async_work": { 2024-02-21T23:12:54.426 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "periodic_async_work", 2024-02-21T23:12:54.426 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.426 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.427 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.427 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.427 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.427 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.428 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.428 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Periodically check for async work", 2024-02-21T23:12:54.428 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.428 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.428 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.429 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.429 INFO:teuthology.orchestra.run.smithi099.stdout: "snapshot_clone_delay": { 2024-02-21T23:12:54.429 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "snapshot_clone_delay", 2024-02-21T23:12:54.429 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:54.429 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.429 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.429 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "0", 2024-02-21T23:12:54.429 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.430 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.430 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.430 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-02-21T23:12:54.430 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.430 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.430 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.430 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.431 INFO:teuthology.orchestra.run.smithi099.stdout: "snapshot_clone_no_wait": { 2024-02-21T23:12:54.431 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "snapshot_clone_no_wait", 2024-02-21T23:12:54.431 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.431 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.431 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.431 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:54.431 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.432 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.432 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.432 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-02-21T23:12:54.432 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.432 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.432 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.433 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.433 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.433 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.433 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:54.433 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "zabbix", 2024-02-21T23:12:54.433 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:54.433 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:54.434 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:54.434 INFO:teuthology.orchestra.run.smithi099.stdout: "discovery_interval": { 2024-02-21T23:12:54.434 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "discovery_interval", 2024-02-21T23:12:54.434 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "uint", 2024-02-21T23:12:54.434 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.434 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.435 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "100", 2024-02-21T23:12:54.435 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.435 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.435 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.435 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.435 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.435 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.436 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.436 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.436 INFO:teuthology.orchestra.run.smithi099.stdout: "identifier": { 2024-02-21T23:12:54.436 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "identifier", 2024-02-21T23:12:54.436 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.436 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.437 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.437 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.437 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.437 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.437 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.437 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.438 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.438 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.438 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.438 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.438 INFO:teuthology.orchestra.run.smithi099.stdout: "interval": { 2024-02-21T23:12:54.438 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "interval", 2024-02-21T23:12:54.438 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-02-21T23:12:54.439 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.439 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.439 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "60", 2024-02-21T23:12:54.439 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.439 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.439 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.439 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.439 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.440 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.440 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.440 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.440 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:54.440 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:54.440 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.440 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.440 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.441 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.441 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.441 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.441 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.441 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.441 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.441 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.441 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.442 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.442 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.442 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.442 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.442 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.442 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.442 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.443 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.443 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:54.443 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:54.443 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.443 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.443 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.443 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.443 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.444 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.444 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.444 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.444 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.444 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.444 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.444 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.445 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:54.445 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:54.445 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.445 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.445 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.445 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:54.445 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.445 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.445 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.446 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.446 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.446 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.446 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.447 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.447 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.447 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.447 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.448 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.448 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.448 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.448 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.448 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:54.448 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:54.449 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.449 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.449 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.449 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.449 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.449 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.450 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.450 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.450 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.450 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.450 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.450 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.450 INFO:teuthology.orchestra.run.smithi099.stdout: "zabbix_host": { 2024-02-21T23:12:54.451 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "zabbix_host", 2024-02-21T23:12:54.451 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.451 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.452 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.452 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.452 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.452 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.452 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.452 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.452 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.453 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.453 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.453 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.453 INFO:teuthology.orchestra.run.smithi099.stdout: "zabbix_port": { 2024-02-21T23:12:54.453 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "zabbix_port", 2024-02-21T23:12:54.453 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:54.453 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.454 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.454 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "10051", 2024-02-21T23:12:54.454 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.454 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.454 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.454 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.454 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.455 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.455 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.455 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.455 INFO:teuthology.orchestra.run.smithi099.stdout: "zabbix_sender": { 2024-02-21T23:12:54.455 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "zabbix_sender", 2024-02-21T23:12:54.456 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.456 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.456 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.456 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-02-21T23:12:54.456 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.456 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.456 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.457 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.457 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.457 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.457 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.457 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.457 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.457 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.458 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-02-21T23:12:54.458 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.458 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:54.459 INFO:teuthology.orchestra.run.smithi099.stdout: "gid": 5114, 2024-02-21T23:12:54.459 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "z", 2024-02-21T23:12:54.459 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr_features": 4540701547738038271, 2024-02-21T23:12:54.459 INFO:teuthology.orchestra.run.smithi099.stdout: "available_modules": [ 2024-02-21T23:12:54.459 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:54.459 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "alerts", 2024-02-21T23:12:54.460 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:54.460 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:54.460 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:54.460 INFO:teuthology.orchestra.run.smithi099.stdout: "interval": { 2024-02-21T23:12:54.460 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "interval", 2024-02-21T23:12:54.460 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-02-21T23:12:54.460 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.461 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.461 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "60", 2024-02-21T23:12:54.461 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.461 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.461 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.461 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "How frequently to reexamine health status", 2024-02-21T23:12:54.461 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.461 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.462 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.462 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.462 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:54.462 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:54.462 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.462 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.462 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.462 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.463 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.463 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.463 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.463 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.463 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.463 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.463 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.463 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.464 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.464 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.464 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.464 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.464 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.464 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.464 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.464 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:54.465 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:54.465 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.465 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.465 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.465 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.465 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.465 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.465 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.466 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.466 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.466 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.466 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.466 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.466 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:54.466 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:54.466 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.466 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.467 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.467 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:54.467 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.467 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.467 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.467 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.467 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.467 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.468 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.468 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.468 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.468 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.468 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.468 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.468 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.469 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.469 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.469 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:54.469 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:54.469 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.469 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.469 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.469 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.470 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.470 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.470 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.470 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.470 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.470 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.470 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.470 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.471 INFO:teuthology.orchestra.run.smithi099.stdout: "smtp_destination": { 2024-02-21T23:12:54.471 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "smtp_destination", 2024-02-21T23:12:54.471 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.471 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.471 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.471 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.471 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.471 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.472 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.472 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Email address to send alerts to", 2024-02-21T23:12:54.472 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.472 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.472 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.472 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.472 INFO:teuthology.orchestra.run.smithi099.stdout: "smtp_from_name": { 2024-02-21T23:12:54.472 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "smtp_from_name", 2024-02-21T23:12:54.473 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.473 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.473 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.473 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "Ceph", 2024-02-21T23:12:54.473 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.473 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.473 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.473 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Email From: name", 2024-02-21T23:12:54.473 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.474 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.474 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.474 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.474 INFO:teuthology.orchestra.run.smithi099.stdout: "smtp_host": { 2024-02-21T23:12:54.474 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "smtp_host", 2024-02-21T23:12:54.474 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.474 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.474 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.475 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.475 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.475 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.475 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.475 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "SMTP server", 2024-02-21T23:12:54.475 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.475 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.475 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.476 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.476 INFO:teuthology.orchestra.run.smithi099.stdout: "smtp_password": { 2024-02-21T23:12:54.476 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "smtp_password", 2024-02-21T23:12:54.476 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.476 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.476 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.476 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.477 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.477 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.477 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.477 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Password to authenticate with", 2024-02-21T23:12:54.477 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.477 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.477 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.477 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.478 INFO:teuthology.orchestra.run.smithi099.stdout: "smtp_port": { 2024-02-21T23:12:54.478 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "smtp_port", 2024-02-21T23:12:54.478 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:54.478 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.478 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.478 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "465", 2024-02-21T23:12:54.478 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.478 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.479 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.479 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "SMTP port", 2024-02-21T23:12:54.479 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.479 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.479 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.479 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.479 INFO:teuthology.orchestra.run.smithi099.stdout: "smtp_sender": { 2024-02-21T23:12:54.479 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "smtp_sender", 2024-02-21T23:12:54.480 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.480 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.480 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.480 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.480 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.480 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.480 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.480 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "SMTP envelope sender", 2024-02-21T23:12:54.481 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.481 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.481 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.481 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.481 INFO:teuthology.orchestra.run.smithi099.stdout: "smtp_ssl": { 2024-02-21T23:12:54.481 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "smtp_ssl", 2024-02-21T23:12:54.481 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.481 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.482 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.482 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:54.482 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.482 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.482 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.482 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Use SSL to connect to SMTP server", 2024-02-21T23:12:54.482 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.482 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.483 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.483 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.483 INFO:teuthology.orchestra.run.smithi099.stdout: "smtp_user": { 2024-02-21T23:12:54.483 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "smtp_user", 2024-02-21T23:12:54.483 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.483 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.483 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.483 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.484 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.484 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.484 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.484 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "User to authenticate as", 2024-02-21T23:12:54.484 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.484 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.484 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.484 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.485 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.485 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.485 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:54.485 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "balancer", 2024-02-21T23:12:54.485 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:54.485 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:54.485 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:54.485 INFO:teuthology.orchestra.run.smithi099.stdout: "active": { 2024-02-21T23:12:54.485 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "active", 2024-02-21T23:12:54.486 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.486 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.486 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.486 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:54.486 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.486 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.486 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.486 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "automatically balance PGs across cluster", 2024-02-21T23:12:54.487 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.487 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.487 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.487 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.487 INFO:teuthology.orchestra.run.smithi099.stdout: "begin_time": { 2024-02-21T23:12:54.487 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "begin_time", 2024-02-21T23:12:54.487 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.487 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.488 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.488 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "0000", 2024-02-21T23:12:54.488 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.488 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.488 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.488 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "beginning time of day to automatically balance", 2024-02-21T23:12:54.488 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-02-21T23:12:54.488 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.489 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.489 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.489 INFO:teuthology.orchestra.run.smithi099.stdout: "begin_weekday": { 2024-02-21T23:12:54.489 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "begin_weekday", 2024-02-21T23:12:54.489 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "uint", 2024-02-21T23:12:54.489 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.489 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.489 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "0", 2024-02-21T23:12:54.490 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "0", 2024-02-21T23:12:54.490 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "6", 2024-02-21T23:12:54.490 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.490 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-02-21T23:12:54.490 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-02-21T23:12:54.490 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.490 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.490 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.490 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_compat_max_iterations": { 2024-02-21T23:12:54.491 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "crush_compat_max_iterations", 2024-02-21T23:12:54.491 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "uint", 2024-02-21T23:12:54.491 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.491 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.491 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "25", 2024-02-21T23:12:54.491 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "1", 2024-02-21T23:12:54.491 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "250", 2024-02-21T23:12:54.492 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.492 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-02-21T23:12:54.492 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.492 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.492 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.492 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.492 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_compat_metrics": { 2024-02-21T23:12:54.492 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "crush_compat_metrics", 2024-02-21T23:12:54.493 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.493 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.493 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.493 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "pgs,objects,bytes", 2024-02-21T23:12:54.493 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.493 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.493 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.493 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-02-21T23:12:54.494 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-02-21T23:12:54.494 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.494 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.494 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.494 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_compat_step": { 2024-02-21T23:12:54.494 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "crush_compat_step", 2024-02-21T23:12:54.494 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "float", 2024-02-21T23:12:54.494 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.495 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.495 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "0.5", 2024-02-21T23:12:54.495 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "0.001", 2024-02-21T23:12:54.495 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "0.999", 2024-02-21T23:12:54.495 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.495 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "aggressiveness of optimization", 2024-02-21T23:12:54.495 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-02-21T23:12:54.495 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.496 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.496 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.496 INFO:teuthology.orchestra.run.smithi099.stdout: "end_time": { 2024-02-21T23:12:54.496 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "end_time", 2024-02-21T23:12:54.496 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.496 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.496 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.496 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "2359", 2024-02-21T23:12:54.497 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.497 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.497 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.497 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "ending time of day to automatically balance", 2024-02-21T23:12:54.497 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-02-21T23:12:54.497 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.497 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.497 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.498 INFO:teuthology.orchestra.run.smithi099.stdout: "end_weekday": { 2024-02-21T23:12:54.498 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "end_weekday", 2024-02-21T23:12:54.498 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "uint", 2024-02-21T23:12:54.498 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.498 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.498 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "0", 2024-02-21T23:12:54.498 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "0", 2024-02-21T23:12:54.498 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "6", 2024-02-21T23:12:54.499 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.499 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-02-21T23:12:54.499 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-02-21T23:12:54.499 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.499 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.499 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.499 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:54.499 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:54.500 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.500 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.500 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.500 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.500 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.500 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.500 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.500 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.501 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.501 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.501 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.501 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.501 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.501 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.501 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.501 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.502 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.502 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.502 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.502 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:54.502 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:54.502 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.502 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.502 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.503 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.503 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.503 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.503 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.503 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.503 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.503 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.503 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.504 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.504 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:54.504 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:54.504 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.504 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.504 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.504 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:54.504 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.505 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.505 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.505 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.505 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.505 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.505 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.505 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.505 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.506 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.506 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.506 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.506 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.506 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.507 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.507 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:54.507 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:54.507 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.507 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.507 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.507 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.508 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.508 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.508 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.508 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.508 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.508 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.508 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.509 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.509 INFO:teuthology.orchestra.run.smithi099.stdout: "min_score": { 2024-02-21T23:12:54.509 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "min_score", 2024-02-21T23:12:54.509 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "float", 2024-02-21T23:12:54.509 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.509 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.509 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "0", 2024-02-21T23:12:54.509 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.510 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.510 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.510 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-02-21T23:12:54.510 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.510 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.510 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.510 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.510 INFO:teuthology.orchestra.run.smithi099.stdout: "mode": { 2024-02-21T23:12:54.510 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "mode", 2024-02-21T23:12:54.511 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.511 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.511 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.511 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "upmap", 2024-02-21T23:12:54.511 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.511 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.511 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.511 INFO:teuthology.orchestra.run.smithi099.stdout: "crush-compat", 2024-02-21T23:12:54.512 INFO:teuthology.orchestra.run.smithi099.stdout: "none", 2024-02-21T23:12:54.512 INFO:teuthology.orchestra.run.smithi099.stdout: "read", 2024-02-21T23:12:54.512 INFO:teuthology.orchestra.run.smithi099.stdout: "upmap", 2024-02-21T23:12:54.512 INFO:teuthology.orchestra.run.smithi099.stdout: "upmap-read" 2024-02-21T23:12:54.512 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.512 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Balancer mode", 2024-02-21T23:12:54.512 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.512 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.513 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.513 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.513 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_ids": { 2024-02-21T23:12:54.513 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "pool_ids", 2024-02-21T23:12:54.513 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.513 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.513 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.513 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.514 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.514 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.514 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.514 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-02-21T23:12:54.514 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.514 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.514 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.514 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.515 INFO:teuthology.orchestra.run.smithi099.stdout: "sleep_interval": { 2024-02-21T23:12:54.515 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "sleep_interval", 2024-02-21T23:12:54.515 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-02-21T23:12:54.515 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.515 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.515 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "60", 2024-02-21T23:12:54.515 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.515 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.516 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.516 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-02-21T23:12:54.516 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.516 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.516 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.516 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.516 INFO:teuthology.orchestra.run.smithi099.stdout: "upmap_max_deviation": { 2024-02-21T23:12:54.516 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "upmap_max_deviation", 2024-02-21T23:12:54.517 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:54.517 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.517 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.517 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "5", 2024-02-21T23:12:54.517 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "1", 2024-02-21T23:12:54.517 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.517 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.517 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "deviation below which no optimization is attempted", 2024-02-21T23:12:54.517 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-02-21T23:12:54.518 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.518 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.518 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.518 INFO:teuthology.orchestra.run.smithi099.stdout: "upmap_max_optimizations": { 2024-02-21T23:12:54.518 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "upmap_max_optimizations", 2024-02-21T23:12:54.518 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "uint", 2024-02-21T23:12:54.518 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.519 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.519 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "10", 2024-02-21T23:12:54.519 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.519 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.519 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.519 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-02-21T23:12:54.519 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.519 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.520 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.520 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.520 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.520 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.520 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:54.520 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "cephadm", 2024-02-21T23:12:54.520 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:54.520 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:54.521 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:54.521 INFO:teuthology.orchestra.run.smithi099.stdout: "agent_down_multiplier": { 2024-02-21T23:12:54.521 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "agent_down_multiplier", 2024-02-21T23:12:54.521 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "float", 2024-02-21T23:12:54.521 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.521 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.521 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "3.0", 2024-02-21T23:12:54.521 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.522 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.522 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.522 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-02-21T23:12:54.522 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.522 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.522 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.522 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.523 INFO:teuthology.orchestra.run.smithi099.stdout: "agent_refresh_rate": { 2024-02-21T23:12:54.523 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "agent_refresh_rate", 2024-02-21T23:12:54.523 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-02-21T23:12:54.523 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.523 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.523 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "20", 2024-02-21T23:12:54.523 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.523 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.523 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.524 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-02-21T23:12:54.524 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.524 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.524 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.524 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.524 INFO:teuthology.orchestra.run.smithi099.stdout: "agent_starting_port": { 2024-02-21T23:12:54.524 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "agent_starting_port", 2024-02-21T23:12:54.524 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:54.525 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.525 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.525 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "4721", 2024-02-21T23:12:54.525 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.525 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.525 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.525 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-02-21T23:12:54.525 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.526 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.526 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.526 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.526 INFO:teuthology.orchestra.run.smithi099.stdout: "allow_ptrace": { 2024-02-21T23:12:54.526 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "allow_ptrace", 2024-02-21T23:12:54.526 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.526 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.526 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.527 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.527 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.527 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.527 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.527 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-02-21T23:12:54.527 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-02-21T23:12:54.527 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.527 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.528 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.528 INFO:teuthology.orchestra.run.smithi099.stdout: "autotune_interval": { 2024-02-21T23:12:54.528 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "autotune_interval", 2024-02-21T23:12:54.528 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-02-21T23:12:54.528 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.528 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.529 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "600", 2024-02-21T23:12:54.529 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.529 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.529 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.529 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "how frequently to autotune daemon memory", 2024-02-21T23:12:54.529 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.529 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.530 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.530 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.530 INFO:teuthology.orchestra.run.smithi099.stdout: "autotune_memory_target_ratio": { 2024-02-21T23:12:54.530 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "autotune_memory_target_ratio", 2024-02-21T23:12:54.530 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "float", 2024-02-21T23:12:54.530 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.531 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.531 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "0.7", 2024-02-21T23:12:54.531 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.531 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.531 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.531 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-02-21T23:12:54.531 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.531 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.532 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.532 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.532 INFO:teuthology.orchestra.run.smithi099.stdout: "cephadm_log_destination": { 2024-02-21T23:12:54.532 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "cephadm_log_destination", 2024-02-21T23:12:54.532 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.532 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.532 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.532 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.533 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.533 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.533 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.533 INFO:teuthology.orchestra.run.smithi099.stdout: "file", 2024-02-21T23:12:54.533 INFO:teuthology.orchestra.run.smithi099.stdout: "file,syslog", 2024-02-21T23:12:54.533 INFO:teuthology.orchestra.run.smithi099.stdout: "syslog" 2024-02-21T23:12:54.533 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.533 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-02-21T23:12:54.533 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.534 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.534 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.534 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.534 INFO:teuthology.orchestra.run.smithi099.stdout: "cgroups_split": { 2024-02-21T23:12:54.534 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "cgroups_split", 2024-02-21T23:12:54.534 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.534 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.534 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.535 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:54.535 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.535 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.535 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.535 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-02-21T23:12:54.535 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.535 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.535 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.536 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.536 INFO:teuthology.orchestra.run.smithi099.stdout: "config_checks_enabled": { 2024-02-21T23:12:54.536 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "config_checks_enabled", 2024-02-21T23:12:54.536 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.536 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.536 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.536 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.536 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.537 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.537 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.537 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-02-21T23:12:54.537 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.537 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.537 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.537 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.537 INFO:teuthology.orchestra.run.smithi099.stdout: "config_dashboard": { 2024-02-21T23:12:54.538 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "config_dashboard", 2024-02-21T23:12:54.538 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.538 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.538 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.538 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:54.538 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.538 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.538 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.538 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-02-21T23:12:54.539 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.539 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.539 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.539 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.539 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_alertmanager": { 2024-02-21T23:12:54.539 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_alertmanager", 2024-02-21T23:12:54.539 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.539 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.540 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.540 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-02-21T23:12:54.540 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.540 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.540 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.540 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Prometheus container image", 2024-02-21T23:12:54.540 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.540 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.541 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.541 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.541 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_base": { 2024-02-21T23:12:54.541 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_base", 2024-02-21T23:12:54.541 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.541 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.541 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.541 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "quay.io/ceph/ceph", 2024-02-21T23:12:54.542 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.542 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.542 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.542 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Container image name, without the tag", 2024-02-21T23:12:54.542 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.542 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.542 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.542 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.543 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_elasticsearch": { 2024-02-21T23:12:54.543 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_elasticsearch", 2024-02-21T23:12:54.543 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.543 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.543 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.543 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-02-21T23:12:54.543 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.544 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.544 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.544 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "elasticsearch container image", 2024-02-21T23:12:54.544 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.544 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.544 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.544 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.544 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_grafana": { 2024-02-21T23:12:54.545 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_grafana", 2024-02-21T23:12:54.545 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.545 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.545 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.545 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.12", 2024-02-21T23:12:54.545 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.545 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.545 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.546 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Prometheus container image", 2024-02-21T23:12:54.546 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.546 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.546 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.546 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.546 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_haproxy": { 2024-02-21T23:12:54.546 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_haproxy", 2024-02-21T23:12:54.547 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.547 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.547 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.547 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-02-21T23:12:54.547 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.547 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.547 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.547 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "HAproxy container image", 2024-02-21T23:12:54.548 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.548 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.548 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.548 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.548 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_jaeger_agent": { 2024-02-21T23:12:54.548 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_jaeger_agent", 2024-02-21T23:12:54.548 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.548 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.549 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.549 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-02-21T23:12:54.549 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.549 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.549 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.549 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Jaeger agent container image", 2024-02-21T23:12:54.549 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.549 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.550 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.550 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.550 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_jaeger_collector": { 2024-02-21T23:12:54.550 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_jaeger_collector", 2024-02-21T23:12:54.550 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.550 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.550 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.550 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-02-21T23:12:54.551 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.551 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.551 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.551 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Jaeger collector container image", 2024-02-21T23:12:54.551 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.551 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.551 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.551 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.552 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_jaeger_query": { 2024-02-21T23:12:54.552 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_jaeger_query", 2024-02-21T23:12:54.552 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.552 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.552 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.552 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-02-21T23:12:54.552 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.553 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.553 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.553 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Jaeger query container image", 2024-02-21T23:12:54.553 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.553 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.553 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.553 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.553 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_keepalived": { 2024-02-21T23:12:54.554 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_keepalived", 2024-02-21T23:12:54.554 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.554 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.554 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.554 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-02-21T23:12:54.554 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.554 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.554 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.554 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Keepalived container image", 2024-02-21T23:12:54.555 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.555 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.555 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.555 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.555 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_loki": { 2024-02-21T23:12:54.555 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_loki", 2024-02-21T23:12:54.555 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.555 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.556 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.556 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-02-21T23:12:54.556 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.556 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.556 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.556 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Loki container image", 2024-02-21T23:12:54.556 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.556 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.557 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.557 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.557 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_node_exporter": { 2024-02-21T23:12:54.557 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_node_exporter", 2024-02-21T23:12:54.557 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.557 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.557 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.557 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-02-21T23:12:54.558 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.558 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.558 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.558 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Prometheus container image", 2024-02-21T23:12:54.558 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.558 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.558 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.558 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.559 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_nvmeof": { 2024-02-21T23:12:54.559 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_nvmeof", 2024-02-21T23:12:54.559 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.559 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.559 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.559 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "quay.io/ceph/nvmeof:latest", 2024-02-21T23:12:54.559 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.559 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.560 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.560 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Nvme-of container image", 2024-02-21T23:12:54.560 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.560 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.560 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.560 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.560 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_prometheus": { 2024-02-21T23:12:54.560 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_prometheus", 2024-02-21T23:12:54.561 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.561 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.561 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.561 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-02-21T23:12:54.561 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.561 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.561 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.561 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Prometheus container image", 2024-02-21T23:12:54.562 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.562 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.562 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.562 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.562 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_promtail": { 2024-02-21T23:12:54.562 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_promtail", 2024-02-21T23:12:54.562 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.562 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.563 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.563 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-02-21T23:12:54.563 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.563 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.563 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.563 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Promtail container image", 2024-02-21T23:12:54.563 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.563 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.564 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.564 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.564 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_snmp_gateway": { 2024-02-21T23:12:54.564 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_snmp_gateway", 2024-02-21T23:12:54.564 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.564 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.565 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.565 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-02-21T23:12:54.565 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.565 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.565 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.565 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "SNMP Gateway container image", 2024-02-21T23:12:54.565 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.565 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.566 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.566 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.566 INFO:teuthology.orchestra.run.smithi099.stdout: "container_init": { 2024-02-21T23:12:54.566 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_init", 2024-02-21T23:12:54.566 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.566 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.566 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.566 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:54.566 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.567 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.567 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.567 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Run podman/docker with `--init`", 2024-02-21T23:12:54.567 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.567 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.567 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.567 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.567 INFO:teuthology.orchestra.run.smithi099.stdout: "daemon_cache_timeout": { 2024-02-21T23:12:54.567 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "daemon_cache_timeout", 2024-02-21T23:12:54.568 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-02-21T23:12:54.568 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.568 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.568 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "600", 2024-02-21T23:12:54.568 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.568 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.568 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.568 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-02-21T23:12:54.569 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.569 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.569 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.569 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.569 INFO:teuthology.orchestra.run.smithi099.stdout: "default_cephadm_command_timeout": { 2024-02-21T23:12:54.569 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "default_cephadm_command_timeout", 2024-02-21T23:12:54.569 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:54.569 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.570 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.570 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "900", 2024-02-21T23:12:54.570 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.570 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.570 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.570 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-02-21T23:12:54.570 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.570 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.571 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.571 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.571 INFO:teuthology.orchestra.run.smithi099.stdout: "default_registry": { 2024-02-21T23:12:54.571 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "default_registry", 2024-02-21T23:12:54.571 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.571 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.571 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.571 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "docker.io", 2024-02-21T23:12:54.571 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.572 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.572 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.572 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-02-21T23:12:54.572 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.572 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.572 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.572 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.572 INFO:teuthology.orchestra.run.smithi099.stdout: "device_cache_timeout": { 2024-02-21T23:12:54.573 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "device_cache_timeout", 2024-02-21T23:12:54.573 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-02-21T23:12:54.573 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.573 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.573 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "1800", 2024-02-21T23:12:54.573 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.573 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.573 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.574 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "seconds to cache device inventory", 2024-02-21T23:12:54.574 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.574 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.574 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.574 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.574 INFO:teuthology.orchestra.run.smithi099.stdout: "device_enhanced_scan": { 2024-02-21T23:12:54.574 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "device_enhanced_scan", 2024-02-21T23:12:54.574 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.575 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.575 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.575 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.575 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.575 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.575 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.575 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Use libstoragemgmt during device scans", 2024-02-21T23:12:54.575 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.576 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.576 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.576 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.576 INFO:teuthology.orchestra.run.smithi099.stdout: "facts_cache_timeout": { 2024-02-21T23:12:54.576 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "facts_cache_timeout", 2024-02-21T23:12:54.576 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-02-21T23:12:54.576 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.576 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.577 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "60", 2024-02-21T23:12:54.577 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.577 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.577 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.577 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "seconds to cache host facts data", 2024-02-21T23:12:54.577 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.577 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.577 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.578 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.578 INFO:teuthology.orchestra.run.smithi099.stdout: "host_check_interval": { 2024-02-21T23:12:54.578 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "host_check_interval", 2024-02-21T23:12:54.578 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-02-21T23:12:54.578 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.578 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.578 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "600", 2024-02-21T23:12:54.578 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.579 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.579 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.579 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "how frequently to perform a host check", 2024-02-21T23:12:54.579 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.579 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.579 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.579 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.579 INFO:teuthology.orchestra.run.smithi099.stdout: "hw_monitoring": { 2024-02-21T23:12:54.580 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "hw_monitoring", 2024-02-21T23:12:54.580 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.580 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.580 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.580 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.581 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.581 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.581 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.581 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-02-21T23:12:54.581 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.581 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.581 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.581 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.582 INFO:teuthology.orchestra.run.smithi099.stdout: "inventory_list_all": { 2024-02-21T23:12:54.582 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "inventory_list_all", 2024-02-21T23:12:54.582 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.582 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.582 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.582 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.582 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.582 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.583 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.583 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-02-21T23:12:54.583 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.583 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.583 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.583 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.583 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:54.583 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:54.584 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.584 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.584 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.584 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.584 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.584 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.584 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.584 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.585 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.585 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.585 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.585 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.585 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.585 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.585 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.585 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.586 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.586 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.586 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.586 INFO:teuthology.orchestra.run.smithi099.stdout: "log_refresh_metadata": { 2024-02-21T23:12:54.586 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_refresh_metadata", 2024-02-21T23:12:54.586 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.586 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.587 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.587 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.587 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.587 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.587 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.587 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-02-21T23:12:54.587 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.587 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.588 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.588 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.588 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:54.588 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:54.588 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.588 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.588 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.589 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:54.589 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.589 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.589 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.589 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-02-21T23:12:54.589 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.589 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.589 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.590 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.590 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:54.590 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:54.590 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.590 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.590 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.590 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:54.590 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.591 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.591 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.591 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.591 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.591 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.591 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.591 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.591 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.592 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.592 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.592 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.592 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.592 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.593 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.593 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:54.593 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:54.593 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.593 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.593 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.593 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.593 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.594 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.594 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.594 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.594 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.594 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.594 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.595 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.595 INFO:teuthology.orchestra.run.smithi099.stdout: "manage_etc_ceph_ceph_conf": { 2024-02-21T23:12:54.595 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-02-21T23:12:54.595 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.595 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.595 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.595 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.596 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.596 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.596 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.596 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-02-21T23:12:54.596 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.596 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.597 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.597 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.597 INFO:teuthology.orchestra.run.smithi099.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-02-21T23:12:54.597 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-02-21T23:12:54.597 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.597 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.597 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.598 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "*", 2024-02-21T23:12:54.598 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.598 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.598 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.598 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-02-21T23:12:54.598 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.598 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.598 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.599 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.599 INFO:teuthology.orchestra.run.smithi099.stdout: "max_count_per_host": { 2024-02-21T23:12:54.599 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "max_count_per_host", 2024-02-21T23:12:54.599 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:54.599 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.599 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.599 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "10", 2024-02-21T23:12:54.600 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.600 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.600 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.600 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "max number of daemons per service per host", 2024-02-21T23:12:54.600 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.600 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.600 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.600 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.601 INFO:teuthology.orchestra.run.smithi099.stdout: "max_osd_draining_count": { 2024-02-21T23:12:54.601 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "max_osd_draining_count", 2024-02-21T23:12:54.601 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:54.601 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.601 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.601 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "10", 2024-02-21T23:12:54.601 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.601 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.602 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.602 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-02-21T23:12:54.602 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.602 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.602 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.602 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.602 INFO:teuthology.orchestra.run.smithi099.stdout: "migration_current": { 2024-02-21T23:12:54.603 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "migration_current", 2024-02-21T23:12:54.603 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:54.603 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.603 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.603 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.603 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.603 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.603 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.604 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "internal - do not modify", 2024-02-21T23:12:54.604 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.604 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.604 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.604 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.604 INFO:teuthology.orchestra.run.smithi099.stdout: "mode": { 2024-02-21T23:12:54.604 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "mode", 2024-02-21T23:12:54.605 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.605 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.605 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.605 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "root", 2024-02-21T23:12:54.605 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.605 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.605 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.605 INFO:teuthology.orchestra.run.smithi099.stdout: "cephadm-package", 2024-02-21T23:12:54.606 INFO:teuthology.orchestra.run.smithi099.stdout: "root" 2024-02-21T23:12:54.606 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.606 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "mode for remote execution of cephadm", 2024-02-21T23:12:54.606 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.606 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.606 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.606 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.606 INFO:teuthology.orchestra.run.smithi099.stdout: "oob_default_addr": { 2024-02-21T23:12:54.607 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "oob_default_addr", 2024-02-21T23:12:54.607 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.607 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.607 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.607 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "169.254.1.1", 2024-02-21T23:12:54.607 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.607 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.607 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.608 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Default address for RedFish API (oob management).", 2024-02-21T23:12:54.608 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.608 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.608 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.608 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.608 INFO:teuthology.orchestra.run.smithi099.stdout: "prometheus_alerts_path": { 2024-02-21T23:12:54.608 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "prometheus_alerts_path", 2024-02-21T23:12:54.608 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.609 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.609 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.609 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-02-21T23:12:54.609 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.609 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.609 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.609 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-02-21T23:12:54.609 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.610 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.610 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.610 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.610 INFO:teuthology.orchestra.run.smithi099.stdout: "registry_insecure": { 2024-02-21T23:12:54.610 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "registry_insecure", 2024-02-21T23:12:54.610 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.610 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.611 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.611 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.611 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.611 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.611 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.611 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-02-21T23:12:54.611 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.611 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.612 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.612 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.612 INFO:teuthology.orchestra.run.smithi099.stdout: "registry_password": { 2024-02-21T23:12:54.612 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "registry_password", 2024-02-21T23:12:54.612 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.612 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.612 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.612 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.613 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.613 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.613 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.613 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-02-21T23:12:54.613 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.613 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.613 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.613 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.614 INFO:teuthology.orchestra.run.smithi099.stdout: "registry_url": { 2024-02-21T23:12:54.614 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "registry_url", 2024-02-21T23:12:54.614 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.614 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.614 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.614 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.614 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.614 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.615 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.615 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-02-21T23:12:54.615 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.615 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.615 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.615 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.615 INFO:teuthology.orchestra.run.smithi099.stdout: "registry_username": { 2024-02-21T23:12:54.615 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "registry_username", 2024-02-21T23:12:54.616 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.616 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.616 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.616 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.617 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.617 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.617 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.617 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-02-21T23:12:54.617 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.617 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.617 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.618 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.618 INFO:teuthology.orchestra.run.smithi099.stdout: "secure_monitoring_stack": { 2024-02-21T23:12:54.618 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "secure_monitoring_stack", 2024-02-21T23:12:54.618 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.618 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.618 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.619 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.619 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.619 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.619 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.619 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-02-21T23:12:54.619 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.619 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.620 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.620 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.620 INFO:teuthology.orchestra.run.smithi099.stdout: "service_discovery_port": { 2024-02-21T23:12:54.620 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "service_discovery_port", 2024-02-21T23:12:54.620 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:54.620 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.620 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.621 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "8765", 2024-02-21T23:12:54.621 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.621 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.621 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.621 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "cephadm service discovery port", 2024-02-21T23:12:54.621 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.622 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.622 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.622 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.622 INFO:teuthology.orchestra.run.smithi099.stdout: "ssh_config_file": { 2024-02-21T23:12:54.622 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "ssh_config_file", 2024-02-21T23:12:54.622 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.622 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.622 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.623 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.623 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.623 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.623 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.623 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-02-21T23:12:54.623 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.623 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.624 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.624 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.624 INFO:teuthology.orchestra.run.smithi099.stdout: "use_agent": { 2024-02-21T23:12:54.624 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "use_agent", 2024-02-21T23:12:54.624 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.624 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.625 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.625 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.625 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.625 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.625 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.625 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-02-21T23:12:54.625 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.626 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.626 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.626 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.626 INFO:teuthology.orchestra.run.smithi099.stdout: "use_repo_digest": { 2024-02-21T23:12:54.626 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "use_repo_digest", 2024-02-21T23:12:54.626 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.627 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.627 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.627 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:54.627 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.627 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.627 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.627 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-02-21T23:12:54.627 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.628 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.628 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.628 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.628 INFO:teuthology.orchestra.run.smithi099.stdout: "warn_on_failed_host_check": { 2024-02-21T23:12:54.628 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "warn_on_failed_host_check", 2024-02-21T23:12:54.628 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.628 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.628 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.629 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:54.629 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.629 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.629 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.629 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "raise a health warning if the host check fails", 2024-02-21T23:12:54.629 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.629 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.630 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.630 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.630 INFO:teuthology.orchestra.run.smithi099.stdout: "warn_on_stray_daemons": { 2024-02-21T23:12:54.630 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "warn_on_stray_daemons", 2024-02-21T23:12:54.630 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.630 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.630 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.630 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:54.631 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.631 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.631 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.631 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-02-21T23:12:54.631 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.631 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.631 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.631 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.632 INFO:teuthology.orchestra.run.smithi099.stdout: "warn_on_stray_hosts": { 2024-02-21T23:12:54.632 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "warn_on_stray_hosts", 2024-02-21T23:12:54.632 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.632 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.632 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.632 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:54.632 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.633 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.633 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.633 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-02-21T23:12:54.633 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.633 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.633 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.633 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.634 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.634 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.634 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:54.634 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "crash", 2024-02-21T23:12:54.634 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:54.634 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:54.634 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:54.634 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:54.635 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:54.635 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.635 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.635 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.635 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.635 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.635 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.636 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.636 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.636 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.636 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.636 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.636 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.636 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.636 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.637 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.637 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.637 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.637 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.637 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.637 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:54.637 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:54.638 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.638 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.638 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.638 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.638 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.638 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.638 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.638 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.639 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.639 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.639 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.639 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.639 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:54.639 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:54.639 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.639 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.640 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.640 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:54.640 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.640 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.640 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.640 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.640 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.640 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.641 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.641 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.641 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.641 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.641 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.641 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.641 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.641 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.642 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.642 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:54.642 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:54.642 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.642 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.642 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.642 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.643 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.643 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.643 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.643 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.643 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.643 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.643 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.643 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.644 INFO:teuthology.orchestra.run.smithi099.stdout: "retain_interval": { 2024-02-21T23:12:54.644 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "retain_interval", 2024-02-21T23:12:54.644 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-02-21T23:12:54.644 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.644 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.644 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "31536000", 2024-02-21T23:12:54.644 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.644 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.645 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.645 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "how long to retain crashes before pruning them", 2024-02-21T23:12:54.645 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.645 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.645 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.645 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.645 INFO:teuthology.orchestra.run.smithi099.stdout: "warn_recent_interval": { 2024-02-21T23:12:54.645 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "warn_recent_interval", 2024-02-21T23:12:54.646 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-02-21T23:12:54.646 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.646 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.646 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "1209600", 2024-02-21T23:12:54.646 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.646 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.646 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.646 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "time interval in which to warn about recent crashes", 2024-02-21T23:12:54.647 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.647 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.647 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.647 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.647 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.647 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.647 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:54.647 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "dashboard", 2024-02-21T23:12:54.647 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:54.648 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:54.648 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:54.648 INFO:teuthology.orchestra.run.smithi099.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-02-21T23:12:54.648 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-02-21T23:12:54.648 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:54.648 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.648 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.649 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "10", 2024-02-21T23:12:54.649 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.649 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.649 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.649 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.649 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.649 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.649 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.650 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.650 INFO:teuthology.orchestra.run.smithi099.stdout: "ALERTMANAGER_API_HOST": { 2024-02-21T23:12:54.650 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "ALERTMANAGER_API_HOST", 2024-02-21T23:12:54.650 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.650 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.650 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.650 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.650 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.651 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.651 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.651 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.651 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.651 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.651 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.651 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.651 INFO:teuthology.orchestra.run.smithi099.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-02-21T23:12:54.651 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-02-21T23:12:54.652 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.652 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.652 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.652 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:54.652 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.652 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.652 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.653 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.653 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.653 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.653 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.653 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.653 INFO:teuthology.orchestra.run.smithi099.stdout: "AUDIT_API_ENABLED": { 2024-02-21T23:12:54.653 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "AUDIT_API_ENABLED", 2024-02-21T23:12:54.654 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.654 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.654 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.654 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.654 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.654 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.655 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.655 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.655 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.655 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.655 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.655 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.655 INFO:teuthology.orchestra.run.smithi099.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-02-21T23:12:54.656 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-02-21T23:12:54.656 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.656 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.656 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.656 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:54.656 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.657 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.657 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.657 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.657 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.657 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.657 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.657 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.658 INFO:teuthology.orchestra.run.smithi099.stdout: "ENABLE_BROWSABLE_API": { 2024-02-21T23:12:54.658 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "ENABLE_BROWSABLE_API", 2024-02-21T23:12:54.658 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.658 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.658 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.658 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:54.658 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.659 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.659 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.659 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.659 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.659 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.659 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.659 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.659 INFO:teuthology.orchestra.run.smithi099.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-02-21T23:12:54.660 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-02-21T23:12:54.660 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.660 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.660 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.660 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:54.660 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.660 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.660 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.661 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.661 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.661 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.661 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.661 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.661 INFO:teuthology.orchestra.run.smithi099.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-02-21T23:12:54.661 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-02-21T23:12:54.661 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.662 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.662 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.662 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:54.662 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.662 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.662 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.662 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.662 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.663 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.663 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.663 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.663 INFO:teuthology.orchestra.run.smithi099.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-02-21T23:12:54.663 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-02-21T23:12:54.663 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.663 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.663 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.664 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:54.664 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.664 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.664 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.664 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.664 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.664 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.665 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.665 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.665 INFO:teuthology.orchestra.run.smithi099.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-02-21T23:12:54.665 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-02-21T23:12:54.665 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.665 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.665 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.665 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:54.666 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.666 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.666 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.666 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.666 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.666 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.666 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.666 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.667 INFO:teuthology.orchestra.run.smithi099.stdout: "FEATURE_TOGGLE_NFS": { 2024-02-21T23:12:54.667 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-02-21T23:12:54.667 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.667 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.667 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.667 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:54.667 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.667 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.668 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.668 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.668 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.668 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.668 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.668 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.668 INFO:teuthology.orchestra.run.smithi099.stdout: "FEATURE_TOGGLE_RBD": { 2024-02-21T23:12:54.669 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-02-21T23:12:54.669 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.669 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.669 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.669 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:54.669 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.669 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.670 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.670 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.670 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.670 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.670 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.670 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.670 INFO:teuthology.orchestra.run.smithi099.stdout: "FEATURE_TOGGLE_RGW": { 2024-02-21T23:12:54.670 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-02-21T23:12:54.670 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.671 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.671 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.671 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:54.671 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.671 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.671 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.671 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.671 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.672 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.672 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.672 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.672 INFO:teuthology.orchestra.run.smithi099.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-02-21T23:12:54.672 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-02-21T23:12:54.672 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.672 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.673 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.673 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.673 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.673 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.673 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.673 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.673 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.673 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.674 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.674 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.674 INFO:teuthology.orchestra.run.smithi099.stdout: "GRAFANA_API_PASSWORD": { 2024-02-21T23:12:54.674 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "GRAFANA_API_PASSWORD", 2024-02-21T23:12:54.674 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.674 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.674 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.674 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "admin", 2024-02-21T23:12:54.675 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.675 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.675 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.675 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.675 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.675 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.675 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.675 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.676 INFO:teuthology.orchestra.run.smithi099.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-02-21T23:12:54.676 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-02-21T23:12:54.676 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.676 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.676 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.676 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:54.676 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.676 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.677 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.677 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.677 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.677 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.677 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.677 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.677 INFO:teuthology.orchestra.run.smithi099.stdout: "GRAFANA_API_URL": { 2024-02-21T23:12:54.677 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "GRAFANA_API_URL", 2024-02-21T23:12:54.678 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.678 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.678 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.678 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.678 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.678 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.678 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.678 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.679 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.679 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.679 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.679 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.679 INFO:teuthology.orchestra.run.smithi099.stdout: "GRAFANA_API_USERNAME": { 2024-02-21T23:12:54.679 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "GRAFANA_API_USERNAME", 2024-02-21T23:12:54.679 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.679 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.679 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.680 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "admin", 2024-02-21T23:12:54.680 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.680 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.680 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.680 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.680 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.680 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.680 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.681 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.681 INFO:teuthology.orchestra.run.smithi099.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-02-21T23:12:54.681 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-02-21T23:12:54.681 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.681 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.681 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.681 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.682 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.682 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.682 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.682 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.682 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.682 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.682 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.682 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.683 INFO:teuthology.orchestra.run.smithi099.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-02-21T23:12:54.683 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-02-21T23:12:54.683 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.683 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.683 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.683 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.683 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.683 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.683 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.684 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.684 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.684 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.684 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.684 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.684 INFO:teuthology.orchestra.run.smithi099.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-02-21T23:12:54.684 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-02-21T23:12:54.685 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.685 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.685 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.685 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:54.685 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.685 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.685 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.685 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.686 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.686 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.686 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.686 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.686 INFO:teuthology.orchestra.run.smithi099.stdout: "ISSUE_TRACKER_API_KEY": { 2024-02-21T23:12:54.686 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-02-21T23:12:54.686 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.687 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.687 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.687 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.687 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.687 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.687 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.687 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.688 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.688 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.688 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.688 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.688 INFO:teuthology.orchestra.run.smithi099.stdout: "PROMETHEUS_API_HOST": { 2024-02-21T23:12:54.688 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "PROMETHEUS_API_HOST", 2024-02-21T23:12:54.688 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.689 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.689 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.689 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.689 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.689 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.689 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.689 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.689 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.690 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.690 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.690 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.690 INFO:teuthology.orchestra.run.smithi099.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-02-21T23:12:54.690 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-02-21T23:12:54.690 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.690 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.690 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.691 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:54.691 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.691 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.691 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.691 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.691 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.691 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.691 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.692 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.692 INFO:teuthology.orchestra.run.smithi099.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-02-21T23:12:54.692 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-02-21T23:12:54.692 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.692 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.692 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.692 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.692 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.693 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.693 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.693 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.693 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.693 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.693 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.693 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.693 INFO:teuthology.orchestra.run.smithi099.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-02-21T23:12:54.693 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-02-21T23:12:54.694 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.694 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.694 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.694 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.694 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.694 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.694 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.694 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.695 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.695 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.695 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.695 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.695 INFO:teuthology.orchestra.run.smithi099.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-02-21T23:12:54.695 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-02-21T23:12:54.695 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.695 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.696 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.696 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:54.696 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.696 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.696 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.696 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.696 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.696 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.697 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.697 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.697 INFO:teuthology.orchestra.run.smithi099.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-02-21T23:12:54.697 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-02-21T23:12:54.697 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.697 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.697 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.697 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:54.698 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.698 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.698 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.698 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.698 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.698 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.698 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.698 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.699 INFO:teuthology.orchestra.run.smithi099.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-02-21T23:12:54.699 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-02-21T23:12:54.699 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.699 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.699 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.699 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.699 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.699 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.700 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.700 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.700 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.700 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.700 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.700 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.700 INFO:teuthology.orchestra.run.smithi099.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-02-21T23:12:54.700 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-02-21T23:12:54.701 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.701 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.701 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.701 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.701 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.701 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.701 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.701 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.702 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.702 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.702 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.702 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.702 INFO:teuthology.orchestra.run.smithi099.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-02-21T23:12:54.702 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-02-21T23:12:54.702 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.702 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.703 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.703 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.703 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.703 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.703 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.703 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.703 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.703 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.704 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.704 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.704 INFO:teuthology.orchestra.run.smithi099.stdout: "PWD_POLICY_ENABLED": { 2024-02-21T23:12:54.704 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "PWD_POLICY_ENABLED", 2024-02-21T23:12:54.704 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.704 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.704 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.705 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:54.705 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.705 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.705 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.705 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.705 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.705 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.705 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.706 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.706 INFO:teuthology.orchestra.run.smithi099.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-02-21T23:12:54.706 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-02-21T23:12:54.706 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.706 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.706 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.706 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-02-21T23:12:54.706 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.707 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.707 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.707 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.707 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.707 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.707 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.707 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.707 INFO:teuthology.orchestra.run.smithi099.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-02-21T23:12:54.707 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-02-21T23:12:54.708 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:54.708 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.708 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.708 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "10", 2024-02-21T23:12:54.708 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.708 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.708 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.708 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.709 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.709 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.709 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.709 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.709 INFO:teuthology.orchestra.run.smithi099.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-02-21T23:12:54.709 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-02-21T23:12:54.709 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:54.709 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.710 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.710 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "8", 2024-02-21T23:12:54.710 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.710 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.710 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.710 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.710 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.710 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.711 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.711 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.711 INFO:teuthology.orchestra.run.smithi099.stdout: "REST_REQUESTS_TIMEOUT": { 2024-02-21T23:12:54.711 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-02-21T23:12:54.711 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:54.711 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.711 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.711 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "45", 2024-02-21T23:12:54.712 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.712 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.712 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.712 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.712 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.712 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.712 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.712 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.713 INFO:teuthology.orchestra.run.smithi099.stdout: "RGW_API_ACCESS_KEY": { 2024-02-21T23:12:54.713 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "RGW_API_ACCESS_KEY", 2024-02-21T23:12:54.713 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.713 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.713 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.713 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.713 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.714 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.714 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.714 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.714 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.714 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.714 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.714 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.714 INFO:teuthology.orchestra.run.smithi099.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-02-21T23:12:54.714 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-02-21T23:12:54.715 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.715 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.715 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.715 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "admin", 2024-02-21T23:12:54.715 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.715 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.715 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.715 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.716 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.716 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.716 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.716 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.716 INFO:teuthology.orchestra.run.smithi099.stdout: "RGW_API_SECRET_KEY": { 2024-02-21T23:12:54.716 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "RGW_API_SECRET_KEY", 2024-02-21T23:12:54.716 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.716 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.717 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.717 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.717 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.717 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.717 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.717 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.717 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.717 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.718 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.718 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.718 INFO:teuthology.orchestra.run.smithi099.stdout: "RGW_API_SSL_VERIFY": { 2024-02-21T23:12:54.718 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "RGW_API_SSL_VERIFY", 2024-02-21T23:12:54.718 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.718 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.718 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.718 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:54.719 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.719 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.719 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.719 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.719 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.719 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.719 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.719 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.720 INFO:teuthology.orchestra.run.smithi099.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-02-21T23:12:54.720 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-02-21T23:12:54.720 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:54.720 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.720 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.720 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "0", 2024-02-21T23:12:54.720 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.720 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.721 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.721 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.721 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.721 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.721 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.721 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.721 INFO:teuthology.orchestra.run.smithi099.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-02-21T23:12:54.721 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-02-21T23:12:54.722 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:54.722 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.722 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.722 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "10", 2024-02-21T23:12:54.722 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.722 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.722 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.722 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.723 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.723 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.723 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.723 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.723 INFO:teuthology.orchestra.run.smithi099.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-02-21T23:12:54.723 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-02-21T23:12:54.723 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:54.723 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.724 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.724 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "5", 2024-02-21T23:12:54.724 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.724 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.724 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.724 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.724 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.725 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.725 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.725 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.725 INFO:teuthology.orchestra.run.smithi099.stdout: "cross_origin_url": { 2024-02-21T23:12:54.725 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "cross_origin_url", 2024-02-21T23:12:54.725 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.725 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.725 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.726 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.726 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.726 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.726 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.726 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.726 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.726 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.727 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.727 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.727 INFO:teuthology.orchestra.run.smithi099.stdout: "crt_file": { 2024-02-21T23:12:54.727 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "crt_file", 2024-02-21T23:12:54.727 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.727 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.727 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.727 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.728 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.728 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.728 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.728 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.728 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.728 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.728 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.728 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.729 INFO:teuthology.orchestra.run.smithi099.stdout: "debug": { 2024-02-21T23:12:54.729 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "debug", 2024-02-21T23:12:54.729 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.729 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.729 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.729 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.729 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.729 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.730 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.730 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Enable/disable debug options", 2024-02-21T23:12:54.730 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.730 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.730 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.730 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.730 INFO:teuthology.orchestra.run.smithi099.stdout: "jwt_token_ttl": { 2024-02-21T23:12:54.730 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "jwt_token_ttl", 2024-02-21T23:12:54.731 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:54.731 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.731 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.731 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "28800", 2024-02-21T23:12:54.731 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.731 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.731 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.731 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.732 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.732 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.732 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.732 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.732 INFO:teuthology.orchestra.run.smithi099.stdout: "key_file": { 2024-02-21T23:12:54.732 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "key_file", 2024-02-21T23:12:54.732 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.732 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.733 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.733 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.733 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.733 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.733 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.733 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.733 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.733 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.733 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.734 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.734 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:54.734 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:54.734 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.734 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.734 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.734 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.734 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.735 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.735 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.735 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.735 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.735 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.735 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.735 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.735 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.736 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.736 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.736 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.736 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.736 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.736 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.736 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:54.736 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:54.737 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.737 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.737 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.737 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.737 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.737 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.737 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.737 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.738 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.738 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.738 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.738 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.738 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:54.738 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:54.738 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.738 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.739 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.739 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:54.739 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.739 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.739 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.739 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.739 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.739 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.740 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.740 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.740 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.740 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.740 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.740 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.740 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.740 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.741 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.741 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:54.741 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:54.741 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.741 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.741 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.741 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.741 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.742 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.742 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.742 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.742 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.742 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.742 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.742 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.742 INFO:teuthology.orchestra.run.smithi099.stdout: "motd": { 2024-02-21T23:12:54.743 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "motd", 2024-02-21T23:12:54.743 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.743 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.743 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.743 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.743 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.743 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.743 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.744 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "The message of the day", 2024-02-21T23:12:54.744 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.744 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.744 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.744 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.744 INFO:teuthology.orchestra.run.smithi099.stdout: "redirect_resolve_ip_addr": { 2024-02-21T23:12:54.744 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "redirect_resolve_ip_addr", 2024-02-21T23:12:54.744 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.744 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.745 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.745 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.745 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.745 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.745 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.745 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.745 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.746 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.746 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.746 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.746 INFO:teuthology.orchestra.run.smithi099.stdout: "server_addr": { 2024-02-21T23:12:54.746 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "server_addr", 2024-02-21T23:12:54.746 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.746 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.746 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.747 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "::", 2024-02-21T23:12:54.747 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.747 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.747 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.747 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.747 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.747 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.747 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.748 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.748 INFO:teuthology.orchestra.run.smithi099.stdout: "server_port": { 2024-02-21T23:12:54.748 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "server_port", 2024-02-21T23:12:54.748 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:54.748 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.748 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.748 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "8080", 2024-02-21T23:12:54.748 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.749 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.749 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.749 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.749 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.749 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.749 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.749 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.749 INFO:teuthology.orchestra.run.smithi099.stdout: "ssl": { 2024-02-21T23:12:54.749 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "ssl", 2024-02-21T23:12:54.750 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.750 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.750 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.750 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:54.750 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.750 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.750 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.751 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.751 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.751 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.751 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.751 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.751 INFO:teuthology.orchestra.run.smithi099.stdout: "ssl_server_port": { 2024-02-21T23:12:54.751 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "ssl_server_port", 2024-02-21T23:12:54.751 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:54.752 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.752 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.752 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "8443", 2024-02-21T23:12:54.752 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.752 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.752 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.752 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.752 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.753 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.753 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.753 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.753 INFO:teuthology.orchestra.run.smithi099.stdout: "standby_behaviour": { 2024-02-21T23:12:54.753 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "standby_behaviour", 2024-02-21T23:12:54.753 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.753 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.753 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.754 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "redirect", 2024-02-21T23:12:54.754 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.754 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.754 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.754 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.754 INFO:teuthology.orchestra.run.smithi099.stdout: "redirect" 2024-02-21T23:12:54.754 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.755 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.755 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.755 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.755 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.755 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.755 INFO:teuthology.orchestra.run.smithi099.stdout: "standby_error_status_code": { 2024-02-21T23:12:54.755 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "standby_error_status_code", 2024-02-21T23:12:54.755 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:54.756 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.756 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.756 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "500", 2024-02-21T23:12:54.756 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "400", 2024-02-21T23:12:54.756 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "599", 2024-02-21T23:12:54.756 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.756 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.756 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.757 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.757 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.757 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.757 INFO:teuthology.orchestra.run.smithi099.stdout: "url_prefix": { 2024-02-21T23:12:54.757 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "url_prefix", 2024-02-21T23:12:54.757 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.757 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.757 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.757 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.758 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.758 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.758 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.758 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.758 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.758 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.758 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.758 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.759 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.759 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.759 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:54.759 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "devicehealth", 2024-02-21T23:12:54.759 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:54.759 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:54.759 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:54.760 INFO:teuthology.orchestra.run.smithi099.stdout: "enable_monitoring": { 2024-02-21T23:12:54.760 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "enable_monitoring", 2024-02-21T23:12:54.760 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.760 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.760 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.760 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:54.760 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.760 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.761 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.761 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "monitor device health metrics", 2024-02-21T23:12:54.761 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.761 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.761 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.761 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.761 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:54.761 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:54.761 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.762 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.762 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.762 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.762 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.762 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.762 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.762 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.762 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.763 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.763 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.763 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.763 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.763 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.763 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.763 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.763 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.764 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.764 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.764 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:54.764 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:54.764 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.764 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.764 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.764 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.765 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.765 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.765 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.765 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.765 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.765 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.765 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.765 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.766 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:54.766 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:54.766 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.766 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.766 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.766 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:54.766 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.766 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.767 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.767 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.767 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.767 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.767 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.767 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.767 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.767 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.768 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.768 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.768 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.768 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.768 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.768 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:54.768 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:54.768 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.769 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.769 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.769 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.769 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.769 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.769 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.769 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.769 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.769 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.770 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.770 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.770 INFO:teuthology.orchestra.run.smithi099.stdout: "mark_out_threshold": { 2024-02-21T23:12:54.770 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "mark_out_threshold", 2024-02-21T23:12:54.770 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-02-21T23:12:54.770 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.770 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.770 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "2419200", 2024-02-21T23:12:54.771 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.771 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.771 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.771 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-02-21T23:12:54.771 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.771 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.771 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.771 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.772 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": { 2024-02-21T23:12:54.772 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "pool_name", 2024-02-21T23:12:54.772 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.772 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.772 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.772 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "device_health_metrics", 2024-02-21T23:12:54.772 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.772 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.773 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.773 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "name of pool in which to store device health metrics", 2024-02-21T23:12:54.773 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.773 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.773 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.773 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.773 INFO:teuthology.orchestra.run.smithi099.stdout: "retention_period": { 2024-02-21T23:12:54.773 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "retention_period", 2024-02-21T23:12:54.774 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-02-21T23:12:54.774 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.774 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.774 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "15552000", 2024-02-21T23:12:54.774 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.774 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.774 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.774 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "how long to retain device health metrics", 2024-02-21T23:12:54.774 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.775 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.775 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.775 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.775 INFO:teuthology.orchestra.run.smithi099.stdout: "scrape_frequency": { 2024-02-21T23:12:54.775 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "scrape_frequency", 2024-02-21T23:12:54.775 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-02-21T23:12:54.775 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.776 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.776 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "86400", 2024-02-21T23:12:54.776 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.776 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.776 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.776 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "how frequently to scrape device health metrics", 2024-02-21T23:12:54.776 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.776 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.777 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.777 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.777 INFO:teuthology.orchestra.run.smithi099.stdout: "self_heal": { 2024-02-21T23:12:54.777 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "self_heal", 2024-02-21T23:12:54.777 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.777 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.777 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.777 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:54.778 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.778 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.778 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.778 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-02-21T23:12:54.778 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.778 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.778 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.778 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.779 INFO:teuthology.orchestra.run.smithi099.stdout: "sleep_interval": { 2024-02-21T23:12:54.779 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "sleep_interval", 2024-02-21T23:12:54.779 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-02-21T23:12:54.779 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.779 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.779 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "600", 2024-02-21T23:12:54.779 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.779 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.779 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.780 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "how frequently to wake up and check device health", 2024-02-21T23:12:54.780 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.780 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.780 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.780 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.780 INFO:teuthology.orchestra.run.smithi099.stdout: "warn_threshold": { 2024-02-21T23:12:54.780 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "warn_threshold", 2024-02-21T23:12:54.780 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-02-21T23:12:54.781 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.781 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.781 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "7257600", 2024-02-21T23:12:54.781 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.781 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.781 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.781 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-02-21T23:12:54.781 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.782 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.782 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.782 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.782 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.782 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.782 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:54.782 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "diskprediction_local", 2024-02-21T23:12:54.782 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:54.783 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:54.783 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:54.783 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:54.783 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:54.783 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.783 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.783 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.784 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.784 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.784 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.784 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.784 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.784 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.784 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.784 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.785 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.785 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.785 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.785 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.785 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.785 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.785 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.786 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.786 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:54.786 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:54.786 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.786 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.786 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.786 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.786 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.787 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.787 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.787 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.787 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.787 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.787 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.787 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.787 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:54.788 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:54.788 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.788 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.788 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.788 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:54.788 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.788 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.788 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.789 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.789 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.789 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.789 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.789 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.789 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.789 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.789 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.790 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.790 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.790 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.790 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.790 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:54.790 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:54.790 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.790 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.791 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.791 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.791 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.791 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.791 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.791 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.791 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.791 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.791 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.792 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.792 INFO:teuthology.orchestra.run.smithi099.stdout: "predict_interval": { 2024-02-21T23:12:54.792 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "predict_interval", 2024-02-21T23:12:54.792 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.792 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.792 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.792 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "86400", 2024-02-21T23:12:54.792 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.793 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.793 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.793 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.793 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.793 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.793 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.793 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.793 INFO:teuthology.orchestra.run.smithi099.stdout: "predictor_model": { 2024-02-21T23:12:54.794 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "predictor_model", 2024-02-21T23:12:54.794 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.794 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.794 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.794 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "prophetstor", 2024-02-21T23:12:54.794 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.794 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.794 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.795 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.795 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.795 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.795 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.795 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.795 INFO:teuthology.orchestra.run.smithi099.stdout: "sleep_interval": { 2024-02-21T23:12:54.795 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "sleep_interval", 2024-02-21T23:12:54.795 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.795 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.796 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.796 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "600", 2024-02-21T23:12:54.796 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.796 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.796 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.796 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.796 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.797 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.797 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.797 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.797 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.797 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.797 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:54.797 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "influx", 2024-02-21T23:12:54.797 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": false, 2024-02-21T23:12:54.797 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "influxdb python module not found", 2024-02-21T23:12:54.798 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:54.798 INFO:teuthology.orchestra.run.smithi099.stdout: "batch_size": { 2024-02-21T23:12:54.798 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "batch_size", 2024-02-21T23:12:54.798 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:54.798 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.798 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.798 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "5000", 2024-02-21T23:12:54.798 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.799 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.799 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.799 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-02-21T23:12:54.799 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.799 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.799 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.799 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.800 INFO:teuthology.orchestra.run.smithi099.stdout: "database": { 2024-02-21T23:12:54.800 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "database", 2024-02-21T23:12:54.800 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.800 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.800 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.800 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "ceph", 2024-02-21T23:12:54.800 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.800 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.801 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.801 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-02-21T23:12:54.801 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.801 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.801 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.801 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.801 INFO:teuthology.orchestra.run.smithi099.stdout: "hostname": { 2024-02-21T23:12:54.801 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "hostname", 2024-02-21T23:12:54.801 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.802 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.802 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.802 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.802 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.802 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.802 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.802 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "InfluxDB server hostname", 2024-02-21T23:12:54.802 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.803 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.803 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.803 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.803 INFO:teuthology.orchestra.run.smithi099.stdout: "interval": { 2024-02-21T23:12:54.803 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "interval", 2024-02-21T23:12:54.803 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-02-21T23:12:54.803 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.803 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.804 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "30", 2024-02-21T23:12:54.804 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "5", 2024-02-21T23:12:54.804 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.804 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.804 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-02-21T23:12:54.804 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.804 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.804 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.805 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.805 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:54.805 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:54.805 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.805 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.805 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.805 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.805 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.806 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.806 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.806 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.806 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.806 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.806 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.806 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.806 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.807 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.807 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.807 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.807 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.807 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.807 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.807 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:54.807 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:54.808 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.808 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.808 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.808 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.808 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.808 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.808 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.808 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.809 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.809 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.809 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.809 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.809 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:54.809 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:54.809 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.809 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.809 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.810 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:54.810 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.810 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.810 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.810 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.810 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.810 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.810 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.811 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.811 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.811 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.811 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.811 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.811 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.811 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.811 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.812 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:54.812 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:54.812 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.812 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.812 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.812 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.812 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.812 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.815 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.815 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.815 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.816 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.816 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.816 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.816 INFO:teuthology.orchestra.run.smithi099.stdout: "password": { 2024-02-21T23:12:54.816 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "password", 2024-02-21T23:12:54.816 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.816 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.816 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.817 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.817 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.817 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.817 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.817 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "password of InfluxDB server user", 2024-02-21T23:12:54.817 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.817 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.817 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.818 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.818 INFO:teuthology.orchestra.run.smithi099.stdout: "port": { 2024-02-21T23:12:54.818 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "port", 2024-02-21T23:12:54.818 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:54.818 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.818 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.818 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "8086", 2024-02-21T23:12:54.819 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.819 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.819 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.819 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "InfluxDB server port", 2024-02-21T23:12:54.819 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.819 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.819 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.819 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.820 INFO:teuthology.orchestra.run.smithi099.stdout: "ssl": { 2024-02-21T23:12:54.820 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "ssl", 2024-02-21T23:12:54.820 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.820 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.820 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.820 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "false", 2024-02-21T23:12:54.820 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.820 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.821 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.821 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-02-21T23:12:54.821 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.821 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.821 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.821 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.821 INFO:teuthology.orchestra.run.smithi099.stdout: "threads": { 2024-02-21T23:12:54.821 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "threads", 2024-02-21T23:12:54.822 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:54.822 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.822 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.822 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "5", 2024-02-21T23:12:54.822 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "1", 2024-02-21T23:12:54.822 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "32", 2024-02-21T23:12:54.822 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.822 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-02-21T23:12:54.823 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.823 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.823 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.823 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.823 INFO:teuthology.orchestra.run.smithi099.stdout: "username": { 2024-02-21T23:12:54.823 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "username", 2024-02-21T23:12:54.823 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.823 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.824 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.824 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.824 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.824 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.824 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.824 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "username of InfluxDB server user", 2024-02-21T23:12:54.824 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.825 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.825 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.825 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.825 INFO:teuthology.orchestra.run.smithi099.stdout: "verify_ssl": { 2024-02-21T23:12:54.825 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "verify_ssl", 2024-02-21T23:12:54.825 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.825 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.825 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.826 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "true", 2024-02-21T23:12:54.826 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.826 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.826 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.826 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-02-21T23:12:54.826 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.826 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.826 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.827 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.827 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.827 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.827 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:54.827 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "insights", 2024-02-21T23:12:54.827 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:54.827 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:54.827 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:54.828 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:54.828 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:54.828 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.828 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.828 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.828 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.828 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.828 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.829 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.829 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.829 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.829 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.829 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.829 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.829 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.829 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.830 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.830 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.830 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.830 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.830 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.830 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:54.830 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:54.830 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.831 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.831 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.831 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.831 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.831 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.831 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.831 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.831 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.831 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.832 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.832 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.832 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:54.832 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:54.832 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.832 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.832 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.832 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:54.833 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.833 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.833 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.833 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.833 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.833 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.833 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.833 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.834 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.834 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.834 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.834 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.834 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.834 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.834 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.834 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:54.834 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:54.835 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.835 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.835 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.835 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.835 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.835 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.835 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.835 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.836 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.836 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.836 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.836 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.836 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.836 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.836 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:54.836 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "iostat", 2024-02-21T23:12:54.837 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:54.837 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:54.837 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:54.837 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:54.837 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:54.837 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.837 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.837 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.838 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.838 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.838 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.838 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.838 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.838 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.838 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.838 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.839 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.839 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.839 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.839 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.839 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.839 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.839 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.839 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.839 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:54.840 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:54.840 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.840 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.840 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.840 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.840 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.840 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.840 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.841 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.841 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.841 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.841 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.841 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.841 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:54.841 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:54.841 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.842 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.842 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.842 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:54.842 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.842 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.842 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.842 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.842 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.843 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.843 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.843 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.843 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.843 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.843 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.843 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.843 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.844 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.844 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.844 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:54.844 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:54.844 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.844 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.844 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.844 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.845 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.845 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.845 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.845 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.845 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.845 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.845 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.845 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.846 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.846 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.846 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:54.846 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "localpool", 2024-02-21T23:12:54.846 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:54.846 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:54.846 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:54.846 INFO:teuthology.orchestra.run.smithi099.stdout: "failure_domain": { 2024-02-21T23:12:54.847 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "failure_domain", 2024-02-21T23:12:54.847 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.847 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.847 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.847 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "host", 2024-02-21T23:12:54.847 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.847 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.847 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.847 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "failure domain for any created local pool", 2024-02-21T23:12:54.848 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-02-21T23:12:54.848 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.848 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.848 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.848 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:54.848 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:54.848 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.849 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.849 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.849 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.849 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.849 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.849 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.849 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.849 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.850 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.850 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.850 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.850 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.850 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.850 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.850 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.850 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.851 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.851 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.851 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:54.851 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:54.851 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.851 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.851 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.851 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.852 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.852 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.852 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.852 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.852 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.852 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.852 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.852 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.853 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:54.853 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:54.853 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.853 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.853 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.853 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:54.853 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.853 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.854 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.854 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.854 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.854 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.854 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.854 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.854 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.854 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.854 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.855 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.855 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.855 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.855 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.855 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:54.855 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:54.855 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.855 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.856 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.856 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.856 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.856 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.856 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.856 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.856 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.856 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.857 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.857 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.857 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": { 2024-02-21T23:12:54.857 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "min_size", 2024-02-21T23:12:54.857 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:54.857 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.857 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.857 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.857 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.858 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.858 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.858 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "default min_size for any created local pool", 2024-02-21T23:12:54.858 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-02-21T23:12:54.858 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.858 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.858 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.858 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rep": { 2024-02-21T23:12:54.859 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "num_rep", 2024-02-21T23:12:54.859 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:54.859 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.859 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.859 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "3", 2024-02-21T23:12:54.859 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.859 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.859 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.860 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "default replica count for any created local pool", 2024-02-21T23:12:54.860 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.860 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.860 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.860 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.860 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": { 2024-02-21T23:12:54.860 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "pg_num", 2024-02-21T23:12:54.860 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:54.861 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.861 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.861 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "128", 2024-02-21T23:12:54.861 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.861 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.861 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.861 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "default pg_num for any created local pool", 2024-02-21T23:12:54.861 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.861 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.862 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.862 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.862 INFO:teuthology.orchestra.run.smithi099.stdout: "prefix": { 2024-02-21T23:12:54.862 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "prefix", 2024-02-21T23:12:54.862 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.862 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.862 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.862 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.863 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.863 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.863 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.863 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "name prefix for any created local pool", 2024-02-21T23:12:54.863 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.863 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.863 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.863 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.864 INFO:teuthology.orchestra.run.smithi099.stdout: "subtree": { 2024-02-21T23:12:54.864 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "subtree", 2024-02-21T23:12:54.864 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.864 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.864 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.864 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "rack", 2024-02-21T23:12:54.864 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.865 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.865 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.865 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "CRUSH level for which to create a local pool", 2024-02-21T23:12:54.865 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-02-21T23:12:54.865 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.865 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.865 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.865 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.865 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.866 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:54.866 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "mds_autoscaler", 2024-02-21T23:12:54.866 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:54.866 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:54.866 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:54.866 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:54.866 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:54.866 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.867 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.867 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.867 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.867 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.867 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.867 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.867 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.867 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.868 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.868 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.868 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.868 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.868 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.868 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.868 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.869 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.869 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.869 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.869 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:54.869 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:54.869 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.869 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.869 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.869 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.870 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.870 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.870 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.870 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.870 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.870 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.870 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.870 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.871 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:54.871 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:54.871 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.871 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.871 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.872 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:54.872 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.872 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.872 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.872 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.872 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.872 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.872 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.873 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.873 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.873 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.873 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.873 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.873 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.873 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.873 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.874 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:54.874 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:54.874 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.874 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.874 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.874 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.874 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.874 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.875 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.875 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.875 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.875 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.875 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.875 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.875 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.875 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.876 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:54.876 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "mirroring", 2024-02-21T23:12:54.876 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:54.876 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:54.876 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:54.876 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:54.876 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:54.876 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.877 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.877 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.877 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.877 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.877 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.877 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.877 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.877 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.877 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.878 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.878 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.878 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.878 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.878 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.878 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.878 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.878 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.879 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.879 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:54.879 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:54.879 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.879 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.879 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.879 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.879 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.880 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.880 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.880 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.880 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.880 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.880 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.880 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.880 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:54.881 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:54.881 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.881 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.881 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.881 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:54.881 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.881 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.882 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.882 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.882 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.882 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.882 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.882 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.882 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.882 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.882 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.883 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.883 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.883 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.883 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.883 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:54.883 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:54.883 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.883 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.884 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.884 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.884 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.884 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.884 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.884 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.884 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.884 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.885 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.885 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.885 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.885 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.885 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:54.885 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "nfs", 2024-02-21T23:12:54.885 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:54.885 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:54.886 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:54.886 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:54.886 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:54.886 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.886 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.886 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.886 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.886 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.886 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.887 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.887 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.887 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.887 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.887 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.887 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.887 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.887 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.888 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.888 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.888 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.888 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.888 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.888 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:54.888 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:54.888 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.889 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.889 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.889 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.889 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.889 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.889 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.889 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.889 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.890 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.890 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.890 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.890 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:54.890 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:54.890 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.890 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.890 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.891 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:54.891 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.891 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.891 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.891 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.891 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.891 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.891 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.892 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.892 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.892 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.892 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.892 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.892 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.892 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.892 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.892 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:54.893 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:54.893 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.893 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.893 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.893 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.893 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.893 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.893 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.894 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.894 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.894 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.894 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.894 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.894 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.894 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.894 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:54.895 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "orchestrator", 2024-02-21T23:12:54.895 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:54.895 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:54.895 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:54.895 INFO:teuthology.orchestra.run.smithi099.stdout: "fail_fs": { 2024-02-21T23:12:54.895 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "fail_fs", 2024-02-21T23:12:54.895 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.895 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.895 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.896 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.896 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.896 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.896 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.896 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-02-21T23:12:54.896 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.896 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.897 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.897 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.897 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:54.897 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:54.897 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.897 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.897 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.897 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.898 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.898 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.898 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.898 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.898 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.898 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.898 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.898 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.899 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.899 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.899 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.899 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.899 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.899 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.899 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.899 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:54.900 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:54.900 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.900 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.900 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.900 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.900 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.900 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.900 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.901 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.901 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.901 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.901 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.901 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.901 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:54.901 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:54.901 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.901 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.902 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.902 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:54.902 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.902 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.902 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.902 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.902 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.902 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.903 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.903 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.903 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.903 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.903 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.903 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.903 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.903 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.904 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.904 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:54.904 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:54.904 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.904 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.904 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.904 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.904 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.905 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.905 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.905 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.905 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.905 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.905 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.905 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.905 INFO:teuthology.orchestra.run.smithi099.stdout: "orchestrator": { 2024-02-21T23:12:54.906 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "orchestrator", 2024-02-21T23:12:54.906 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.906 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.906 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.906 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.906 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.906 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.906 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.907 INFO:teuthology.orchestra.run.smithi099.stdout: "cephadm", 2024-02-21T23:12:54.907 INFO:teuthology.orchestra.run.smithi099.stdout: "rook", 2024-02-21T23:12:54.907 INFO:teuthology.orchestra.run.smithi099.stdout: "test_orchestrator" 2024-02-21T23:12:54.907 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.907 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Orchestrator backend", 2024-02-21T23:12:54.907 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.907 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.907 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.908 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.908 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.908 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.908 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:54.908 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "osd_perf_query", 2024-02-21T23:12:54.908 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:54.908 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:54.908 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:54.909 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:54.909 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:54.909 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.909 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.909 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.909 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.909 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.909 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.909 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.910 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.910 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.910 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.910 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.910 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.910 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.910 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.910 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.911 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.911 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.911 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.911 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.911 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:54.911 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:54.911 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.911 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.912 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.912 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.912 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.912 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.912 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.912 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.912 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.912 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.913 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.913 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.913 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:54.913 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:54.913 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.913 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.913 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.913 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:54.913 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.914 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.914 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.914 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.914 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.914 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.914 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.914 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.914 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.915 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.915 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.915 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.915 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.915 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.915 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.915 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:54.915 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:54.916 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.916 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.916 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.916 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.916 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.916 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.916 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.917 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.917 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.917 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.917 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.917 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.917 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.917 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.917 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:54.917 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "osd_support", 2024-02-21T23:12:54.918 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:54.918 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:54.918 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:54.918 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:54.918 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:54.918 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.918 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.918 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.919 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.919 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.919 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.919 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.919 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.919 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.919 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.920 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.920 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.920 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.920 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.920 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.920 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.920 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.920 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.921 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.921 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:54.921 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:54.921 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.921 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.921 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.921 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.922 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.922 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.922 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.922 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.922 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.922 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.922 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.922 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.922 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:54.923 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:54.923 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.923 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.923 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.923 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:54.923 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.923 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.923 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.924 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.924 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.924 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.924 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.924 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.924 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.924 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.924 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.925 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.925 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.925 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.925 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.925 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:54.925 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:54.925 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.925 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.926 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.926 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.926 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.926 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.926 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.926 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.926 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.926 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.927 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.927 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.927 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.927 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.927 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:54.927 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "pg_autoscaler", 2024-02-21T23:12:54.927 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:54.928 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:54.928 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:54.928 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:54.928 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:54.928 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.928 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.928 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.928 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.929 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.929 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.929 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.929 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.929 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.929 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.929 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.929 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.929 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.930 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.930 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.930 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.930 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.930 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.930 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.930 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:54.930 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:54.931 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.931 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.931 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.931 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.931 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.931 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.931 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.931 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.932 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.932 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.932 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.932 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.932 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:54.932 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:54.932 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.932 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.933 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.933 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:54.933 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.933 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.933 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.933 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.933 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.933 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.934 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.934 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.934 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.934 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.934 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.934 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.934 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.934 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.935 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.935 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:54.935 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:54.935 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.935 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.935 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.935 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.935 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.935 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.936 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.936 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.936 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.936 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.936 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.936 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.936 INFO:teuthology.orchestra.run.smithi099.stdout: "sleep_interval": { 2024-02-21T23:12:54.937 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "sleep_interval", 2024-02-21T23:12:54.937 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-02-21T23:12:54.937 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.937 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.937 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "60", 2024-02-21T23:12:54.937 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.937 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.937 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.938 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.938 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.938 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.938 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.938 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.938 INFO:teuthology.orchestra.run.smithi099.stdout: "threshold": { 2024-02-21T23:12:54.938 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "threshold", 2024-02-21T23:12:54.938 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "float", 2024-02-21T23:12:54.938 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.939 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.939 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "3.0", 2024-02-21T23:12:54.939 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "1.0", 2024-02-21T23:12:54.939 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.939 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.939 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "scaling threshold", 2024-02-21T23:12:54.939 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-02-21T23:12:54.939 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.940 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.940 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.940 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.940 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.940 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:54.940 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "progress", 2024-02-21T23:12:54.940 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:54.941 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:54.941 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:54.941 INFO:teuthology.orchestra.run.smithi099.stdout: "allow_pg_recovery_event": { 2024-02-21T23:12:54.941 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "allow_pg_recovery_event", 2024-02-21T23:12:54.941 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.941 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.941 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.941 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.941 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.942 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.942 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.942 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "allow the module to show pg recovery progress", 2024-02-21T23:12:54.942 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.942 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.942 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.942 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.942 INFO:teuthology.orchestra.run.smithi099.stdout: "enabled": { 2024-02-21T23:12:54.943 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "enabled", 2024-02-21T23:12:54.943 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.943 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.943 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.943 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:54.943 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.943 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.943 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.944 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.944 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.944 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.944 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.944 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.944 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:54.944 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:54.945 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.945 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.945 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.945 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.945 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.945 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.945 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.945 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.946 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.946 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.946 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.946 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.946 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.946 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.946 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.947 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.947 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.947 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.947 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.947 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:54.947 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:54.947 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.947 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.948 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.948 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.948 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.948 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.948 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.948 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.948 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.949 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.949 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.949 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.949 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:54.949 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:54.949 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.949 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.949 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.950 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:54.950 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.950 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.950 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.950 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.950 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.950 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.951 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.951 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.951 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.951 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.951 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.951 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.951 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.952 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.952 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.952 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:54.952 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:54.952 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.952 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.952 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.952 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.953 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.953 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.953 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.953 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.953 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.953 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.953 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.954 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.954 INFO:teuthology.orchestra.run.smithi099.stdout: "max_completed_events": { 2024-02-21T23:12:54.954 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "max_completed_events", 2024-02-21T23:12:54.954 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:54.954 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.954 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.954 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "50", 2024-02-21T23:12:54.954 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.955 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.955 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.955 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "number of past completed events to remember", 2024-02-21T23:12:54.955 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.955 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.955 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.955 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.955 INFO:teuthology.orchestra.run.smithi099.stdout: "sleep_interval": { 2024-02-21T23:12:54.956 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "sleep_interval", 2024-02-21T23:12:54.956 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-02-21T23:12:54.956 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.956 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.956 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "5", 2024-02-21T23:12:54.956 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.956 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.956 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.957 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "how long the module is going to sleep", 2024-02-21T23:12:54.957 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.957 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.957 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.957 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.957 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.957 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.957 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:54.958 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "prometheus", 2024-02-21T23:12:54.958 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:54.958 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:54.958 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:54.958 INFO:teuthology.orchestra.run.smithi099.stdout: "cache": { 2024-02-21T23:12:54.958 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "cache", 2024-02-21T23:12:54.958 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.959 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.959 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.959 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:54.959 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.959 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.959 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.959 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.959 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.960 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.960 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.960 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.960 INFO:teuthology.orchestra.run.smithi099.stdout: "exclude_perf_counters": { 2024-02-21T23:12:54.960 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "exclude_perf_counters", 2024-02-21T23:12:54.960 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.960 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.960 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.961 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:54.961 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.961 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.961 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.961 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-02-21T23:12:54.961 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-02-21T23:12:54.962 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.962 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.962 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.962 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:54.962 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:54.962 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.962 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.963 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.963 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.963 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.963 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.963 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.963 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.963 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.964 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.964 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.964 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.964 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.964 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.964 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.964 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.964 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.965 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.965 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.965 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:54.965 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:54.965 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.965 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.965 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.965 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.966 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.966 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.966 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.966 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.966 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.966 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.966 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.966 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.967 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:54.967 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:54.967 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.967 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.967 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.967 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:54.967 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.967 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.967 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.968 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.968 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.968 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.968 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.968 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.968 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.968 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.968 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.969 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.969 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.969 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.969 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.969 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:54.969 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:54.969 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.970 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.970 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.970 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.970 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.970 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.970 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.970 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.970 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.970 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.971 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.971 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.971 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_stats_pools": { 2024-02-21T23:12:54.971 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "rbd_stats_pools", 2024-02-21T23:12:54.971 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.971 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.971 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.971 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.972 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.972 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.972 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.972 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.972 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.972 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.972 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.972 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.973 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_stats_pools_refresh_interval": { 2024-02-21T23:12:54.973 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-02-21T23:12:54.973 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:54.973 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.973 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.973 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "300", 2024-02-21T23:12:54.973 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.973 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.974 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.974 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.974 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.974 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.974 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.974 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.974 INFO:teuthology.orchestra.run.smithi099.stdout: "scrape_interval": { 2024-02-21T23:12:54.975 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "scrape_interval", 2024-02-21T23:12:54.975 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "float", 2024-02-21T23:12:54.975 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.975 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.975 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "15.0", 2024-02-21T23:12:54.975 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.975 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.976 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.976 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.976 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.976 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.976 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.976 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.976 INFO:teuthology.orchestra.run.smithi099.stdout: "server_addr": { 2024-02-21T23:12:54.977 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "server_addr", 2024-02-21T23:12:54.977 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.977 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.977 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.977 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "::", 2024-02-21T23:12:54.977 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.977 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.978 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.978 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-02-21T23:12:54.978 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.978 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.978 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.978 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.979 INFO:teuthology.orchestra.run.smithi099.stdout: "server_port": { 2024-02-21T23:12:54.979 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "server_port", 2024-02-21T23:12:54.979 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:54.979 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.979 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.979 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "9283", 2024-02-21T23:12:54.979 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.980 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.980 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.980 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-02-21T23:12:54.980 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.980 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.980 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.981 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.981 INFO:teuthology.orchestra.run.smithi099.stdout: "stale_cache_strategy": { 2024-02-21T23:12:54.981 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "stale_cache_strategy", 2024-02-21T23:12:54.981 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.981 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.981 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.981 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "log", 2024-02-21T23:12:54.982 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.982 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.982 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.982 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.982 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.982 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.983 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.983 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.983 INFO:teuthology.orchestra.run.smithi099.stdout: "standby_behaviour": { 2024-02-21T23:12:54.983 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "standby_behaviour", 2024-02-21T23:12:54.983 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.983 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.983 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.984 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "default", 2024-02-21T23:12:54.984 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.984 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.984 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.984 INFO:teuthology.orchestra.run.smithi099.stdout: "default", 2024-02-21T23:12:54.984 INFO:teuthology.orchestra.run.smithi099.stdout: "error" 2024-02-21T23:12:54.984 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.985 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.985 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.985 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.985 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.985 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.985 INFO:teuthology.orchestra.run.smithi099.stdout: "standby_error_status_code": { 2024-02-21T23:12:54.986 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "standby_error_status_code", 2024-02-21T23:12:54.986 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:54.986 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.986 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.986 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "500", 2024-02-21T23:12:54.986 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "400", 2024-02-21T23:12:54.987 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "599", 2024-02-21T23:12:54.987 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.987 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.987 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.987 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.987 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.987 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.988 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:54.988 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.988 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:54.988 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "rbd_support", 2024-02-21T23:12:54.988 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:54.988 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:54.989 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:54.989 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:54.989 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:54.989 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.989 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.989 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.989 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:54.989 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.990 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.990 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.990 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.990 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.990 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.990 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.990 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.990 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.991 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.991 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.991 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.991 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.991 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.991 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.991 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:54.991 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:54.992 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.992 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.992 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.992 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.992 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.992 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.992 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.993 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.993 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.993 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.993 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.993 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.993 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:54.993 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:54.993 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:54.994 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.994 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.994 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:54.994 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.994 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.994 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:54.994 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:54.994 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:54.994 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:54.995 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:54.995 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:54.995 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:54.995 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:54.995 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.995 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.995 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.996 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.996 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.996 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:54.996 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:54.996 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:54.996 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.996 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:54.996 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:54.997 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.997 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.997 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.997 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.997 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.997 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.997 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.997 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.998 INFO:teuthology.orchestra.run.smithi099.stdout: "max_concurrent_snap_create": { 2024-02-21T23:12:54.998 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "max_concurrent_snap_create", 2024-02-21T23:12:54.998 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:54.998 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:54.998 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:54.998 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "10", 2024-02-21T23:12:54.998 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:54.998 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:54.998 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:54.999 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:54.999 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:54.999 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:54.999 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:54.999 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:54.999 INFO:teuthology.orchestra.run.smithi099.stdout: "mirror_snapshot_schedule": { 2024-02-21T23:12:54.999 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "mirror_snapshot_schedule", 2024-02-21T23:12:54.999 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.000 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.000 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.000 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.000 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.000 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.000 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.000 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.000 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.001 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.001 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.001 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.001 INFO:teuthology.orchestra.run.smithi099.stdout: "trash_purge_schedule": { 2024-02-21T23:12:55.001 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "trash_purge_schedule", 2024-02-21T23:12:55.001 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.001 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.001 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.002 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.002 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.002 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.002 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.002 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.002 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.002 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.002 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.002 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.003 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.003 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.003 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:55.003 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "restful", 2024-02-21T23:12:55.003 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:55.003 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:55.003 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:55.003 INFO:teuthology.orchestra.run.smithi099.stdout: "enable_auth": { 2024-02-21T23:12:55.004 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "enable_auth", 2024-02-21T23:12:55.004 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.004 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.004 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.004 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:55.004 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.004 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.004 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.005 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.005 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.005 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.005 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.005 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.005 INFO:teuthology.orchestra.run.smithi099.stdout: "key_file": { 2024-02-21T23:12:55.005 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "key_file", 2024-02-21T23:12:55.005 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.006 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.006 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.006 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.006 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.006 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.006 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.006 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.006 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.007 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.007 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.007 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.007 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:55.007 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:55.007 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.007 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.007 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.007 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.008 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.008 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.008 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.008 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.008 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.008 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.008 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.008 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.009 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.009 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.009 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.009 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.009 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.009 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.009 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.009 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:55.010 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:55.010 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.010 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.010 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.010 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.010 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.011 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.011 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.011 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.011 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.011 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.011 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.011 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.011 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:55.012 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:55.012 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.012 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.012 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.012 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:55.012 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.013 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.013 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.013 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.013 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.013 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.013 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.013 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.014 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.014 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.014 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.014 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.014 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.014 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.014 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.014 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:55.015 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:55.015 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.015 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.015 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.015 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.015 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.015 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.015 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.016 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.016 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.016 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.016 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.016 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.016 INFO:teuthology.orchestra.run.smithi099.stdout: "server_addr": { 2024-02-21T23:12:55.016 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "server_addr", 2024-02-21T23:12:55.016 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.017 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.017 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.017 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.017 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.017 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.017 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.017 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.017 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.018 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.018 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.018 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.018 INFO:teuthology.orchestra.run.smithi099.stdout: "server_port": { 2024-02-21T23:12:55.018 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "server_port", 2024-02-21T23:12:55.018 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.019 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.019 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.019 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.019 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.019 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.019 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.019 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.020 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.020 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.020 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.020 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.020 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.020 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.021 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:55.021 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "rgw", 2024-02-21T23:12:55.021 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:55.021 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:55.021 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:55.021 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:55.021 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:55.022 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.022 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.022 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.022 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.022 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.022 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.022 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.022 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.023 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.023 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.023 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.023 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.023 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.023 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.023 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.023 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.024 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.024 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.024 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.024 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:55.024 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:55.024 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.024 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.025 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.025 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.025 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.025 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.025 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.025 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.025 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.025 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.026 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.026 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.026 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:55.026 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:55.026 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.026 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.026 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.026 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:55.027 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.027 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.027 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.027 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.027 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.027 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.027 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.027 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.027 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.028 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.028 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.028 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.028 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.028 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.028 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.028 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:55.028 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:55.029 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.029 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.029 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.029 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.029 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.029 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.029 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.029 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.030 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.030 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.030 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.030 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.030 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.030 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.030 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:55.030 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "rook", 2024-02-21T23:12:55.031 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:55.031 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:55.031 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:55.031 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:55.031 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:55.031 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.031 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.031 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.032 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.032 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.032 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.032 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.032 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.032 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.032 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.032 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.033 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.033 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.033 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.033 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.033 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.033 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.033 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.033 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.033 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:55.034 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:55.034 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.034 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.034 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.034 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.034 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.034 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.034 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.035 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.035 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.035 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.035 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.035 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.035 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:55.035 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:55.035 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.036 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.036 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.036 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:55.036 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.036 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.036 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.036 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.036 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.037 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.037 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.037 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.037 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.037 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.037 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.037 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.037 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.038 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.038 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.038 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:55.038 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:55.038 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.038 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.038 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.038 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.039 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.039 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.039 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.039 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.039 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.039 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.039 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.039 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.040 INFO:teuthology.orchestra.run.smithi099.stdout: "storage_class": { 2024-02-21T23:12:55.040 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "storage_class", 2024-02-21T23:12:55.040 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.040 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.040 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.040 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "local", 2024-02-21T23:12:55.040 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.040 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.041 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.041 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-02-21T23:12:55.041 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.041 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.041 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.041 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.041 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.041 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.042 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:55.042 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "selftest", 2024-02-21T23:12:55.042 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:55.042 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:55.042 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:55.042 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:55.042 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:55.042 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.042 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.043 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.043 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.043 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.043 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.043 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.043 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.043 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.044 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.044 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.044 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.044 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.044 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.044 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.044 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.045 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.045 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.045 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.045 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:55.045 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:55.045 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.046 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.046 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.046 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.046 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.046 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.046 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.047 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.047 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.047 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.047 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.047 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.047 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:55.047 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:55.048 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.048 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.048 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.048 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:55.048 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.048 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.049 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.049 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.049 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.049 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.049 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.049 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.049 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.049 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.050 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.050 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.050 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.050 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.050 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.050 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:55.050 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:55.050 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.051 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.051 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.051 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.051 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.051 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.051 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.051 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.051 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.052 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.052 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.052 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.052 INFO:teuthology.orchestra.run.smithi099.stdout: "roption1": { 2024-02-21T23:12:55.052 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "roption1", 2024-02-21T23:12:55.052 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.052 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.052 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.053 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.053 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.053 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.053 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.053 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.053 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.053 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.054 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.054 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.054 INFO:teuthology.orchestra.run.smithi099.stdout: "roption2": { 2024-02-21T23:12:55.054 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "roption2", 2024-02-21T23:12:55.054 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.054 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.054 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.054 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "xyz", 2024-02-21T23:12:55.055 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.055 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.055 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.055 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.055 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.055 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.055 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.055 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.056 INFO:teuthology.orchestra.run.smithi099.stdout: "rwoption1": { 2024-02-21T23:12:55.056 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "rwoption1", 2024-02-21T23:12:55.056 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.056 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.056 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.056 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.056 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.056 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.057 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.057 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.057 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.057 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.057 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.057 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.057 INFO:teuthology.orchestra.run.smithi099.stdout: "rwoption2": { 2024-02-21T23:12:55.057 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "rwoption2", 2024-02-21T23:12:55.058 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:55.058 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.058 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.058 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.058 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.058 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.058 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.058 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.059 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.059 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.059 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.059 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.059 INFO:teuthology.orchestra.run.smithi099.stdout: "rwoption3": { 2024-02-21T23:12:55.059 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "rwoption3", 2024-02-21T23:12:55.059 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "float", 2024-02-21T23:12:55.059 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.059 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.060 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.060 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.060 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.060 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.060 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.060 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.060 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.060 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.061 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.061 INFO:teuthology.orchestra.run.smithi099.stdout: "rwoption4": { 2024-02-21T23:12:55.061 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "rwoption4", 2024-02-21T23:12:55.061 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.061 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.061 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.061 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.061 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.062 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.062 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.062 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.062 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.062 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.062 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.062 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.062 INFO:teuthology.orchestra.run.smithi099.stdout: "rwoption5": { 2024-02-21T23:12:55.063 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "rwoption5", 2024-02-21T23:12:55.063 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.063 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.063 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.063 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.063 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.063 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.063 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.064 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.064 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.064 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.064 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.064 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.064 INFO:teuthology.orchestra.run.smithi099.stdout: "rwoption6": { 2024-02-21T23:12:55.064 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "rwoption6", 2024-02-21T23:12:55.064 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.065 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.065 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.065 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:55.065 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.065 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.065 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.065 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.065 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.066 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.066 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.066 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.066 INFO:teuthology.orchestra.run.smithi099.stdout: "rwoption7": { 2024-02-21T23:12:55.066 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "rwoption7", 2024-02-21T23:12:55.066 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:55.066 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.066 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.067 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.067 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "1", 2024-02-21T23:12:55.067 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "42", 2024-02-21T23:12:55.067 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.067 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.067 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.067 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.067 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.068 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.068 INFO:teuthology.orchestra.run.smithi099.stdout: "testkey": { 2024-02-21T23:12:55.068 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "testkey", 2024-02-21T23:12:55.068 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.068 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.068 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.068 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.068 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.069 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.069 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.071 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.071 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.072 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.072 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.072 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.072 INFO:teuthology.orchestra.run.smithi099.stdout: "testlkey": { 2024-02-21T23:12:55.072 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "testlkey", 2024-02-21T23:12:55.072 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.072 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.072 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.073 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.073 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.073 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.073 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.073 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.073 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.073 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.074 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.074 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.074 INFO:teuthology.orchestra.run.smithi099.stdout: "testnewline": { 2024-02-21T23:12:55.074 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "testnewline", 2024-02-21T23:12:55.074 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.074 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.074 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.074 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.075 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.075 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.075 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.075 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.075 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.075 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.075 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.075 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.075 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.076 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.076 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:55.076 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "snap_schedule", 2024-02-21T23:12:55.076 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:55.076 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:55.076 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:55.076 INFO:teuthology.orchestra.run.smithi099.stdout: "allow_m_granularity": { 2024-02-21T23:12:55.076 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "allow_m_granularity", 2024-02-21T23:12:55.077 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.077 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.077 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.077 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.077 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.077 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.077 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.077 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "allow minute scheduled snapshots", 2024-02-21T23:12:55.078 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.078 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.078 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.078 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.078 INFO:teuthology.orchestra.run.smithi099.stdout: "dump_on_update": { 2024-02-21T23:12:55.078 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "dump_on_update", 2024-02-21T23:12:55.078 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.078 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.079 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.079 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.079 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.079 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.079 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.079 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "dump database to debug log on update", 2024-02-21T23:12:55.079 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.079 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.079 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.080 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.080 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:55.080 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:55.080 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.080 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.080 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.080 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.080 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.081 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.081 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.081 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.081 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.081 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.081 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.081 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.081 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.082 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.082 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.082 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.082 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.082 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.082 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.082 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:55.082 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:55.083 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.083 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.083 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.083 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.083 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.083 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.083 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.083 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.083 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.084 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.084 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.084 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:55.084 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:55.084 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.084 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.084 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.085 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:55.085 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.085 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.085 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.085 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.085 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.085 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.085 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.086 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.086 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.086 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.086 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.086 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.086 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.086 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.087 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:55.087 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:55.087 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.087 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.087 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.087 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.087 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.087 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.087 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.088 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.088 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.088 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.088 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.088 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.088 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.088 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.088 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:55.089 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "stats", 2024-02-21T23:12:55.089 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:55.089 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:55.089 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:55.089 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:55.089 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:55.089 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.089 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.090 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.090 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.090 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.090 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.090 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.090 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.090 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.090 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.090 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.091 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.091 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.091 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.091 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.091 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.091 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.091 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.092 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:55.092 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:55.092 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.092 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.092 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.092 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.092 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.092 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.093 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.093 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.093 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.093 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.093 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.093 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.093 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:55.093 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:55.094 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.094 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.094 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.094 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:55.094 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.094 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.094 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.094 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.094 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.095 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.095 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.095 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.095 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.095 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.095 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.095 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.095 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.096 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.096 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.096 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:55.096 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:55.096 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.096 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.096 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.097 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.097 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.097 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.097 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.097 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.097 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.097 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.097 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.097 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.098 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.098 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.098 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:55.098 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "status", 2024-02-21T23:12:55.098 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:55.098 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:55.098 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:55.098 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:55.099 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:55.099 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.099 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.099 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.099 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.099 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.099 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.099 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.100 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.100 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.100 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.100 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.100 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.100 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.100 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.100 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.101 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.101 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.101 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.101 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.101 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:55.101 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:55.101 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.101 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.102 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.102 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.102 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.102 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.102 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.102 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.102 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.102 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.103 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.103 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.103 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:55.103 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:55.103 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.103 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.103 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.103 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:55.103 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.104 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.104 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.104 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.104 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.104 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.104 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.104 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.104 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.105 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.105 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.105 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.105 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.105 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.105 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.105 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:55.105 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:55.106 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.106 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.106 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.106 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.106 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.106 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.106 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.106 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.106 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.107 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.107 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.107 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.107 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.107 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.107 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:55.107 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "telegraf", 2024-02-21T23:12:55.107 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:55.108 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:55.108 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:55.108 INFO:teuthology.orchestra.run.smithi099.stdout: "address": { 2024-02-21T23:12:55.108 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "address", 2024-02-21T23:12:55.108 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.108 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.108 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.108 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-02-21T23:12:55.109 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.109 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.109 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.109 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.109 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.109 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.109 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.109 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.110 INFO:teuthology.orchestra.run.smithi099.stdout: "interval": { 2024-02-21T23:12:55.110 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "interval", 2024-02-21T23:12:55.110 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-02-21T23:12:55.110 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.110 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.110 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "15", 2024-02-21T23:12:55.110 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.110 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.110 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.111 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.111 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.111 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.111 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.111 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.111 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:55.111 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:55.112 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.112 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.112 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.112 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.112 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.112 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.112 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.112 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.112 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.113 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.113 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.113 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.113 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.113 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.113 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.113 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.113 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.114 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.114 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.114 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:55.114 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:55.114 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.114 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.114 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.114 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.115 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.115 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.115 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.115 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.115 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.115 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.115 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.115 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.115 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:55.116 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:55.116 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.116 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.116 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.116 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:55.116 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.116 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.116 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.117 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.117 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.117 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.117 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.117 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.117 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.117 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.117 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.118 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.118 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.118 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.118 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.118 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:55.118 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:55.118 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.118 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.119 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.119 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.119 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.119 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.119 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.119 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.119 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.119 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.119 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.120 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.120 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.120 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.120 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:55.120 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "telemetry", 2024-02-21T23:12:55.120 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:55.120 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:55.120 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:55.121 INFO:teuthology.orchestra.run.smithi099.stdout: "channel_basic": { 2024-02-21T23:12:55.121 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "channel_basic", 2024-02-21T23:12:55.121 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.121 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.121 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.121 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:55.121 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.121 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.122 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.122 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Share basic cluster information (size, version)", 2024-02-21T23:12:55.122 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.122 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.122 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.122 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.122 INFO:teuthology.orchestra.run.smithi099.stdout: "channel_crash": { 2024-02-21T23:12:55.122 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "channel_crash", 2024-02-21T23:12:55.123 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.123 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.123 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.123 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:55.123 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.123 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.123 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.123 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-02-21T23:12:55.124 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.124 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.124 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.124 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.124 INFO:teuthology.orchestra.run.smithi099.stdout: "channel_device": { 2024-02-21T23:12:55.124 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "channel_device", 2024-02-21T23:12:55.124 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.124 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.125 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.125 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:55.125 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.125 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.125 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.125 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-02-21T23:12:55.125 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.125 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.126 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.126 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.126 INFO:teuthology.orchestra.run.smithi099.stdout: "channel_ident": { 2024-02-21T23:12:55.126 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "channel_ident", 2024-02-21T23:12:55.126 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.126 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.126 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.126 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.127 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.127 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.127 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.127 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-02-21T23:12:55.127 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.127 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.127 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.127 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.127 INFO:teuthology.orchestra.run.smithi099.stdout: "channel_perf": { 2024-02-21T23:12:55.128 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "channel_perf", 2024-02-21T23:12:55.128 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.128 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.128 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.128 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.128 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.128 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.128 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.129 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Share various performance metrics of a cluster", 2024-02-21T23:12:55.129 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.129 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.129 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.129 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.129 INFO:teuthology.orchestra.run.smithi099.stdout: "contact": { 2024-02-21T23:12:55.129 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "contact", 2024-02-21T23:12:55.129 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.130 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.130 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.130 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.130 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.130 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.130 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.130 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.130 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.130 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.131 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.131 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.131 INFO:teuthology.orchestra.run.smithi099.stdout: "description": { 2024-02-21T23:12:55.131 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "description", 2024-02-21T23:12:55.131 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.131 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.131 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.131 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.132 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.132 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.132 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.132 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.132 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.132 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.132 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.132 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.133 INFO:teuthology.orchestra.run.smithi099.stdout: "device_url": { 2024-02-21T23:12:55.133 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "device_url", 2024-02-21T23:12:55.133 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.133 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.133 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.133 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-02-21T23:12:55.133 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.133 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.133 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.134 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.134 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.134 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.134 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.134 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.134 INFO:teuthology.orchestra.run.smithi099.stdout: "enabled": { 2024-02-21T23:12:55.134 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "enabled", 2024-02-21T23:12:55.134 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.135 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.135 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.135 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.135 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.135 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.135 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.135 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.135 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.136 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.136 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.136 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.136 INFO:teuthology.orchestra.run.smithi099.stdout: "interval": { 2024-02-21T23:12:55.136 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "interval", 2024-02-21T23:12:55.136 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:55.136 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.136 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.137 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "24", 2024-02-21T23:12:55.137 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "8", 2024-02-21T23:12:55.137 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.137 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.137 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.137 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.137 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.137 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.137 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.138 INFO:teuthology.orchestra.run.smithi099.stdout: "last_opt_revision": { 2024-02-21T23:12:55.138 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "last_opt_revision", 2024-02-21T23:12:55.138 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:55.138 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.138 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.138 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "1", 2024-02-21T23:12:55.138 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.138 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.139 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.139 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.139 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.139 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.139 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.139 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.139 INFO:teuthology.orchestra.run.smithi099.stdout: "leaderboard": { 2024-02-21T23:12:55.139 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "leaderboard", 2024-02-21T23:12:55.139 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.140 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.140 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.140 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.140 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.140 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.140 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.140 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.140 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.141 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.141 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.141 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.141 INFO:teuthology.orchestra.run.smithi099.stdout: "leaderboard_description": { 2024-02-21T23:12:55.141 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "leaderboard_description", 2024-02-21T23:12:55.141 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.141 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.141 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.142 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.142 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.142 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.142 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.142 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.142 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.142 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.142 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.143 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.143 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:55.143 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:55.143 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.143 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.143 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.143 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.143 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.144 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.144 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.144 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.144 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.144 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.144 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.144 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.144 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.145 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.145 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.145 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.145 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.145 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.145 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.145 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:55.145 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:55.146 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.146 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.146 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.146 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.146 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.146 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.146 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.146 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.146 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.147 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.147 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.147 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.147 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:55.147 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:55.147 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.147 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.147 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.148 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:55.148 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.148 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.148 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.148 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.148 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.148 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.148 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.149 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.149 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.149 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.149 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.149 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.149 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.149 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.149 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.150 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:55.150 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:55.150 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.150 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.150 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.150 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.150 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.150 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.151 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.151 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.151 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.151 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.151 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.151 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.151 INFO:teuthology.orchestra.run.smithi099.stdout: "organization": { 2024-02-21T23:12:55.151 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "organization", 2024-02-21T23:12:55.151 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.152 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.152 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.152 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.152 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.152 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.152 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.152 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.152 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.153 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.153 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.153 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.153 INFO:teuthology.orchestra.run.smithi099.stdout: "proxy": { 2024-02-21T23:12:55.153 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "proxy", 2024-02-21T23:12:55.153 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.153 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.153 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.154 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.154 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.154 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.154 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.154 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.154 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.154 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.154 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.155 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.155 INFO:teuthology.orchestra.run.smithi099.stdout: "url": { 2024-02-21T23:12:55.155 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "url", 2024-02-21T23:12:55.155 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.155 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.155 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.155 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-02-21T23:12:55.155 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.155 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.156 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.156 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.156 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.156 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.156 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.156 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.156 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.156 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.157 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:55.157 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "test_orchestrator", 2024-02-21T23:12:55.157 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:55.157 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:55.157 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:55.157 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:55.157 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:55.157 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.158 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.158 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.158 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.158 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.158 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.158 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.158 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.158 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.159 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.159 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.159 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.159 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.159 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.159 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.159 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.159 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.159 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.160 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.160 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:55.160 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:55.160 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.160 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.160 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.160 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.160 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.161 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.161 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.161 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.161 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.161 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.161 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.161 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.161 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:55.162 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:55.162 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.162 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.162 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.162 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:55.162 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.162 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.162 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.162 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.163 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.163 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.163 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.163 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.163 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.163 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.163 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.163 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.164 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.164 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.164 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.164 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:55.164 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:55.164 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.164 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.164 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.165 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.165 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.165 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.165 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.165 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.165 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.165 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.165 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.165 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.166 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.166 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.166 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:55.166 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "volumes", 2024-02-21T23:12:55.166 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:55.166 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:55.166 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:55.166 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:55.167 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:55.167 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.167 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.167 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.167 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.167 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.167 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.167 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.168 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.168 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.168 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.168 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.168 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.168 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.168 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.168 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.169 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.169 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.169 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.169 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.169 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:55.169 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:55.169 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.169 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.170 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.170 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.170 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.170 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.170 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.170 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.170 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.170 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.170 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.171 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.171 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:55.171 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:55.171 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.171 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.171 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.171 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:55.171 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.172 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.172 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.172 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.172 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.172 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.172 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.172 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.172 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.173 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.173 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.173 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.173 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.173 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.173 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.173 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:55.173 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:55.174 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.174 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.174 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.174 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.174 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.174 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.174 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.174 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.174 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.175 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.175 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.175 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.175 INFO:teuthology.orchestra.run.smithi099.stdout: "max_concurrent_clones": { 2024-02-21T23:12:55.175 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "max_concurrent_clones", 2024-02-21T23:12:55.175 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:55.175 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.175 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.176 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "4", 2024-02-21T23:12:55.176 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.176 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.176 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.176 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Number of asynchronous cloner threads", 2024-02-21T23:12:55.176 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.176 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.176 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.177 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.177 INFO:teuthology.orchestra.run.smithi099.stdout: "periodic_async_work": { 2024-02-21T23:12:55.177 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "periodic_async_work", 2024-02-21T23:12:55.177 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.177 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.177 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.177 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.177 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.177 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.178 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.178 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Periodically check for async work", 2024-02-21T23:12:55.178 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.178 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.178 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.178 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.178 INFO:teuthology.orchestra.run.smithi099.stdout: "snapshot_clone_delay": { 2024-02-21T23:12:55.178 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "snapshot_clone_delay", 2024-02-21T23:12:55.179 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:55.179 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.179 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.179 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "0", 2024-02-21T23:12:55.179 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.179 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.179 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.179 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-02-21T23:12:55.179 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.180 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.180 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.180 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.180 INFO:teuthology.orchestra.run.smithi099.stdout: "snapshot_clone_no_wait": { 2024-02-21T23:12:55.180 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "snapshot_clone_no_wait", 2024-02-21T23:12:55.180 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.180 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.180 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.181 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:55.181 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.181 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.181 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.181 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-02-21T23:12:55.181 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.181 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.181 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.182 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.182 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.182 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.182 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:55.182 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "zabbix", 2024-02-21T23:12:55.182 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:55.182 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:55.182 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:55.183 INFO:teuthology.orchestra.run.smithi099.stdout: "discovery_interval": { 2024-02-21T23:12:55.183 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "discovery_interval", 2024-02-21T23:12:55.183 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "uint", 2024-02-21T23:12:55.183 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.183 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.183 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "100", 2024-02-21T23:12:55.183 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.183 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.183 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.184 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.184 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.184 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.184 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.184 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.184 INFO:teuthology.orchestra.run.smithi099.stdout: "identifier": { 2024-02-21T23:12:55.184 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "identifier", 2024-02-21T23:12:55.184 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.185 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.185 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.185 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.185 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.185 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.185 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.185 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.185 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.186 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.186 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.186 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.186 INFO:teuthology.orchestra.run.smithi099.stdout: "interval": { 2024-02-21T23:12:55.186 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "interval", 2024-02-21T23:12:55.186 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-02-21T23:12:55.186 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.186 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.187 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "60", 2024-02-21T23:12:55.187 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.187 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.187 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.187 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.187 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.187 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.187 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.187 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.188 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:55.188 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:55.188 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.188 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.188 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.188 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.188 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.188 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.189 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.189 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.189 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.189 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.189 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.189 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.189 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.189 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.190 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.190 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.190 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.190 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.190 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.190 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:55.190 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:55.190 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.191 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.191 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.191 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.191 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.191 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.191 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.191 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.191 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.192 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.192 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.192 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.192 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:55.192 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:55.192 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.192 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.192 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.193 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:55.193 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.193 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.193 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.193 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.193 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.193 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.193 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.193 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.194 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.194 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.194 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.194 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.194 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.194 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.194 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.194 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:55.195 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:55.195 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.195 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.195 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.195 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.195 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.195 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.195 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.196 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.196 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.196 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.196 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.196 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.196 INFO:teuthology.orchestra.run.smithi099.stdout: "zabbix_host": { 2024-02-21T23:12:55.196 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "zabbix_host", 2024-02-21T23:12:55.196 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.197 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.197 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.197 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.197 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.197 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.197 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.197 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.197 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.197 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.198 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.198 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.198 INFO:teuthology.orchestra.run.smithi099.stdout: "zabbix_port": { 2024-02-21T23:12:55.198 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "zabbix_port", 2024-02-21T23:12:55.198 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:55.198 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.198 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.198 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "10051", 2024-02-21T23:12:55.199 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.199 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.199 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.199 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.199 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.199 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.199 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.199 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.200 INFO:teuthology.orchestra.run.smithi099.stdout: "zabbix_sender": { 2024-02-21T23:12:55.200 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "zabbix_sender", 2024-02-21T23:12:55.200 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.200 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.200 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.200 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-02-21T23:12:55.200 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.200 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.201 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.201 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.201 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.201 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.201 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.201 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.201 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.201 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.201 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-02-21T23:12:55.202 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.202 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.202 INFO:teuthology.orchestra.run.smithi099.stdout: "modules": [ 2024-02-21T23:12:55.202 INFO:teuthology.orchestra.run.smithi099.stdout: "iostat", 2024-02-21T23:12:55.202 INFO:teuthology.orchestra.run.smithi099.stdout: "nfs", 2024-02-21T23:12:55.202 INFO:teuthology.orchestra.run.smithi099.stdout: "restful", 2024-02-21T23:12:55.202 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_schedule" 2024-02-21T23:12:55.202 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.203 INFO:teuthology.orchestra.run.smithi099.stdout: "available_modules": [ 2024-02-21T23:12:55.203 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:55.203 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "alerts", 2024-02-21T23:12:55.203 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:55.203 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:55.203 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:55.203 INFO:teuthology.orchestra.run.smithi099.stdout: "interval": { 2024-02-21T23:12:55.203 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "interval", 2024-02-21T23:12:55.203 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-02-21T23:12:55.204 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.204 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.204 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "60", 2024-02-21T23:12:55.204 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.204 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.204 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.204 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "How frequently to reexamine health status", 2024-02-21T23:12:55.204 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.205 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.205 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.205 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.205 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:55.205 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:55.205 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.205 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.205 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.206 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.206 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.206 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.206 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.206 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.206 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.206 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.206 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.207 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.207 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.207 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.207 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.207 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.207 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.207 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.207 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.207 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:55.208 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:55.208 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.208 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.208 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.208 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.208 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.208 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.208 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.209 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.209 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.209 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.209 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.209 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.209 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:55.209 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:55.209 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.210 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.210 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.210 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:55.210 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.210 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.210 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.210 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.210 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.211 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.211 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.211 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.211 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.211 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.211 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.211 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.212 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.212 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.212 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.212 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:55.212 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:55.212 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.212 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.212 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.212 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.213 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.213 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.213 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.213 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.213 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.213 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.213 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.213 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.214 INFO:teuthology.orchestra.run.smithi099.stdout: "smtp_destination": { 2024-02-21T23:12:55.214 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "smtp_destination", 2024-02-21T23:12:55.214 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.214 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.214 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.214 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.214 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.214 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.215 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.215 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Email address to send alerts to", 2024-02-21T23:12:55.215 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.215 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.215 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.215 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.215 INFO:teuthology.orchestra.run.smithi099.stdout: "smtp_from_name": { 2024-02-21T23:12:55.215 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "smtp_from_name", 2024-02-21T23:12:55.216 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.216 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.216 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.216 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "Ceph", 2024-02-21T23:12:55.216 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.216 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.216 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.216 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Email From: name", 2024-02-21T23:12:55.217 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.217 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.217 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.217 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.217 INFO:teuthology.orchestra.run.smithi099.stdout: "smtp_host": { 2024-02-21T23:12:55.217 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "smtp_host", 2024-02-21T23:12:55.217 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.217 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.218 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.218 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.218 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.218 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.218 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.218 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "SMTP server", 2024-02-21T23:12:55.218 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.218 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.219 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.219 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.219 INFO:teuthology.orchestra.run.smithi099.stdout: "smtp_password": { 2024-02-21T23:12:55.219 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "smtp_password", 2024-02-21T23:12:55.219 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.219 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.219 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.219 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.220 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.220 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.220 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.220 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Password to authenticate with", 2024-02-21T23:12:55.220 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.220 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.220 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.220 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.221 INFO:teuthology.orchestra.run.smithi099.stdout: "smtp_port": { 2024-02-21T23:12:55.221 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "smtp_port", 2024-02-21T23:12:55.221 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:55.221 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.221 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.221 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "465", 2024-02-21T23:12:55.221 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.221 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.222 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.222 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "SMTP port", 2024-02-21T23:12:55.222 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.222 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.222 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.222 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.222 INFO:teuthology.orchestra.run.smithi099.stdout: "smtp_sender": { 2024-02-21T23:12:55.222 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "smtp_sender", 2024-02-21T23:12:55.223 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.223 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.223 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.223 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.223 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.223 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.223 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.223 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "SMTP envelope sender", 2024-02-21T23:12:55.224 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.224 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.224 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.224 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.224 INFO:teuthology.orchestra.run.smithi099.stdout: "smtp_ssl": { 2024-02-21T23:12:55.224 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "smtp_ssl", 2024-02-21T23:12:55.224 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.224 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.225 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.225 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:55.225 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.225 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.225 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.225 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Use SSL to connect to SMTP server", 2024-02-21T23:12:55.225 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.225 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.226 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.226 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.226 INFO:teuthology.orchestra.run.smithi099.stdout: "smtp_user": { 2024-02-21T23:12:55.226 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "smtp_user", 2024-02-21T23:12:55.226 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.226 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.226 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.226 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.226 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.227 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.227 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.227 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "User to authenticate as", 2024-02-21T23:12:55.227 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.227 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.227 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.227 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.227 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.228 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.228 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:55.228 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "balancer", 2024-02-21T23:12:55.228 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:55.228 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:55.228 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:55.228 INFO:teuthology.orchestra.run.smithi099.stdout: "active": { 2024-02-21T23:12:55.228 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "active", 2024-02-21T23:12:55.229 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.229 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.229 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.229 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:55.229 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.229 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.229 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.229 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "automatically balance PGs across cluster", 2024-02-21T23:12:55.230 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.230 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.230 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.230 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.230 INFO:teuthology.orchestra.run.smithi099.stdout: "begin_time": { 2024-02-21T23:12:55.230 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "begin_time", 2024-02-21T23:12:55.230 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.230 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.230 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.231 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "0000", 2024-02-21T23:12:55.231 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.231 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.231 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.231 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "beginning time of day to automatically balance", 2024-02-21T23:12:55.231 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-02-21T23:12:55.231 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.231 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.232 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.232 INFO:teuthology.orchestra.run.smithi099.stdout: "begin_weekday": { 2024-02-21T23:12:55.232 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "begin_weekday", 2024-02-21T23:12:55.232 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "uint", 2024-02-21T23:12:55.232 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.232 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.232 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "0", 2024-02-21T23:12:55.232 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "0", 2024-02-21T23:12:55.232 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "6", 2024-02-21T23:12:55.233 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.233 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-02-21T23:12:55.233 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-02-21T23:12:55.233 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.233 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.233 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.233 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_compat_max_iterations": { 2024-02-21T23:12:55.234 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "crush_compat_max_iterations", 2024-02-21T23:12:55.234 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "uint", 2024-02-21T23:12:55.234 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.234 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.234 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "25", 2024-02-21T23:12:55.234 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "1", 2024-02-21T23:12:55.234 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "250", 2024-02-21T23:12:55.234 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.234 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-02-21T23:12:55.235 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.235 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.235 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.235 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.235 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_compat_metrics": { 2024-02-21T23:12:55.235 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "crush_compat_metrics", 2024-02-21T23:12:55.235 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.235 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.236 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.236 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "pgs,objects,bytes", 2024-02-21T23:12:55.236 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.236 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.236 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.236 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-02-21T23:12:55.236 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-02-21T23:12:55.236 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.237 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.237 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.237 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_compat_step": { 2024-02-21T23:12:55.237 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "crush_compat_step", 2024-02-21T23:12:55.237 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "float", 2024-02-21T23:12:55.237 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.237 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.237 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "0.5", 2024-02-21T23:12:55.238 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "0.001", 2024-02-21T23:12:55.238 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "0.999", 2024-02-21T23:12:55.238 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.238 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "aggressiveness of optimization", 2024-02-21T23:12:55.238 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-02-21T23:12:55.238 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.238 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.238 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.239 INFO:teuthology.orchestra.run.smithi099.stdout: "end_time": { 2024-02-21T23:12:55.239 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "end_time", 2024-02-21T23:12:55.239 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.239 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.239 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.239 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "2359", 2024-02-21T23:12:55.239 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.239 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.240 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.240 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "ending time of day to automatically balance", 2024-02-21T23:12:55.240 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-02-21T23:12:55.240 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.240 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.240 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.240 INFO:teuthology.orchestra.run.smithi099.stdout: "end_weekday": { 2024-02-21T23:12:55.240 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "end_weekday", 2024-02-21T23:12:55.241 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "uint", 2024-02-21T23:12:55.241 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.241 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.241 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "0", 2024-02-21T23:12:55.241 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "0", 2024-02-21T23:12:55.241 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "6", 2024-02-21T23:12:55.241 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.241 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-02-21T23:12:55.241 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-02-21T23:12:55.242 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.242 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.242 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.242 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:55.242 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:55.242 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.242 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.242 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.243 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.243 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.243 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.243 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.243 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.243 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.243 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.243 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.244 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.244 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.244 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.244 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.244 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.244 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.244 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.244 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.245 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:55.245 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:55.245 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.245 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.245 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.245 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.245 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.245 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.246 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.246 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.246 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.246 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.246 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.246 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.246 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:55.246 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:55.247 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.247 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.247 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.247 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:55.247 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.247 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.247 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.247 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.248 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.248 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.248 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.248 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.248 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.249 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.249 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.249 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.249 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.249 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.250 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.250 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:55.250 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:55.250 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.251 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.251 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.251 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.251 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.251 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.252 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.252 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.252 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.252 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.253 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.253 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.253 INFO:teuthology.orchestra.run.smithi099.stdout: "min_score": { 2024-02-21T23:12:55.253 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "min_score", 2024-02-21T23:12:55.253 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "float", 2024-02-21T23:12:55.254 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.254 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.254 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "0", 2024-02-21T23:12:55.254 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.255 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.255 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.255 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-02-21T23:12:55.255 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.255 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.256 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.256 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.256 INFO:teuthology.orchestra.run.smithi099.stdout: "mode": { 2024-02-21T23:12:55.256 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "mode", 2024-02-21T23:12:55.256 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.257 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.257 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.257 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "upmap", 2024-02-21T23:12:55.257 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.258 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.258 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.258 INFO:teuthology.orchestra.run.smithi099.stdout: "crush-compat", 2024-02-21T23:12:55.258 INFO:teuthology.orchestra.run.smithi099.stdout: "none", 2024-02-21T23:12:55.258 INFO:teuthology.orchestra.run.smithi099.stdout: "read", 2024-02-21T23:12:55.259 INFO:teuthology.orchestra.run.smithi099.stdout: "upmap", 2024-02-21T23:12:55.259 INFO:teuthology.orchestra.run.smithi099.stdout: "upmap-read" 2024-02-21T23:12:55.259 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.259 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Balancer mode", 2024-02-21T23:12:55.259 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.260 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.260 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.260 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.260 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_ids": { 2024-02-21T23:12:55.260 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "pool_ids", 2024-02-21T23:12:55.260 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.260 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.260 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.261 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.261 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.261 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.261 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.261 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-02-21T23:12:55.261 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.261 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.261 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.262 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.262 INFO:teuthology.orchestra.run.smithi099.stdout: "sleep_interval": { 2024-02-21T23:12:55.262 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "sleep_interval", 2024-02-21T23:12:55.262 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-02-21T23:12:55.262 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.262 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.262 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "60", 2024-02-21T23:12:55.262 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.263 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.263 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.263 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-02-21T23:12:55.263 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.263 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.263 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.263 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.263 INFO:teuthology.orchestra.run.smithi099.stdout: "upmap_max_deviation": { 2024-02-21T23:12:55.263 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "upmap_max_deviation", 2024-02-21T23:12:55.264 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:55.264 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.264 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.264 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "5", 2024-02-21T23:12:55.264 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "1", 2024-02-21T23:12:55.264 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.264 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.264 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "deviation below which no optimization is attempted", 2024-02-21T23:12:55.265 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-02-21T23:12:55.265 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.265 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.265 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.265 INFO:teuthology.orchestra.run.smithi099.stdout: "upmap_max_optimizations": { 2024-02-21T23:12:55.265 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "upmap_max_optimizations", 2024-02-21T23:12:55.265 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "uint", 2024-02-21T23:12:55.265 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.266 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.266 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "10", 2024-02-21T23:12:55.266 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.266 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.266 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.266 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-02-21T23:12:55.266 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.266 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.267 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.267 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.267 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.267 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.267 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:55.267 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "cephadm", 2024-02-21T23:12:55.267 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:55.268 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:55.268 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:55.268 INFO:teuthology.orchestra.run.smithi099.stdout: "agent_down_multiplier": { 2024-02-21T23:12:55.268 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "agent_down_multiplier", 2024-02-21T23:12:55.268 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "float", 2024-02-21T23:12:55.268 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.268 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.268 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "3.0", 2024-02-21T23:12:55.269 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.269 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.269 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.269 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-02-21T23:12:55.269 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.269 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.269 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.269 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.270 INFO:teuthology.orchestra.run.smithi099.stdout: "agent_refresh_rate": { 2024-02-21T23:12:55.270 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "agent_refresh_rate", 2024-02-21T23:12:55.270 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-02-21T23:12:55.270 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.270 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.270 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "20", 2024-02-21T23:12:55.270 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.270 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.271 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.271 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-02-21T23:12:55.271 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.271 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.271 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.271 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.271 INFO:teuthology.orchestra.run.smithi099.stdout: "agent_starting_port": { 2024-02-21T23:12:55.271 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "agent_starting_port", 2024-02-21T23:12:55.271 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:55.272 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.272 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.272 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "4721", 2024-02-21T23:12:55.272 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.272 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.272 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.272 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-02-21T23:12:55.273 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.273 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.273 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.273 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.273 INFO:teuthology.orchestra.run.smithi099.stdout: "allow_ptrace": { 2024-02-21T23:12:55.273 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "allow_ptrace", 2024-02-21T23:12:55.273 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.273 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.273 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.274 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.274 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.274 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.274 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.274 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-02-21T23:12:55.274 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-02-21T23:12:55.274 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.275 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.275 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.275 INFO:teuthology.orchestra.run.smithi099.stdout: "autotune_interval": { 2024-02-21T23:12:55.275 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "autotune_interval", 2024-02-21T23:12:55.275 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-02-21T23:12:55.275 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.275 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.275 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "600", 2024-02-21T23:12:55.276 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.276 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.276 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.276 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "how frequently to autotune daemon memory", 2024-02-21T23:12:55.276 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.276 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.276 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.276 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.277 INFO:teuthology.orchestra.run.smithi099.stdout: "autotune_memory_target_ratio": { 2024-02-21T23:12:55.277 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "autotune_memory_target_ratio", 2024-02-21T23:12:55.277 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "float", 2024-02-21T23:12:55.277 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.277 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.277 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "0.7", 2024-02-21T23:12:55.277 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.277 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.278 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.278 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-02-21T23:12:55.278 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.278 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.278 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.278 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.278 INFO:teuthology.orchestra.run.smithi099.stdout: "cephadm_log_destination": { 2024-02-21T23:12:55.278 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "cephadm_log_destination", 2024-02-21T23:12:55.278 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.279 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.279 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.279 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.279 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.279 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.279 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.279 INFO:teuthology.orchestra.run.smithi099.stdout: "file", 2024-02-21T23:12:55.279 INFO:teuthology.orchestra.run.smithi099.stdout: "file,syslog", 2024-02-21T23:12:55.280 INFO:teuthology.orchestra.run.smithi099.stdout: "syslog" 2024-02-21T23:12:55.280 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.280 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-02-21T23:12:55.280 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.280 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.280 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.280 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.280 INFO:teuthology.orchestra.run.smithi099.stdout: "cgroups_split": { 2024-02-21T23:12:55.281 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "cgroups_split", 2024-02-21T23:12:55.281 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.281 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.281 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.281 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:55.281 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.281 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.281 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.282 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-02-21T23:12:55.282 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.282 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.282 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.282 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.282 INFO:teuthology.orchestra.run.smithi099.stdout: "config_checks_enabled": { 2024-02-21T23:12:55.282 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "config_checks_enabled", 2024-02-21T23:12:55.282 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.283 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.283 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.283 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.283 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.283 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.283 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.283 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-02-21T23:12:55.283 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.284 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.284 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.284 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.284 INFO:teuthology.orchestra.run.smithi099.stdout: "config_dashboard": { 2024-02-21T23:12:55.284 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "config_dashboard", 2024-02-21T23:12:55.284 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.284 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.284 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.285 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:55.285 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.285 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.285 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.285 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-02-21T23:12:55.285 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.285 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.285 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.285 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.286 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_alertmanager": { 2024-02-21T23:12:55.286 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_alertmanager", 2024-02-21T23:12:55.286 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.286 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.286 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.286 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-02-21T23:12:55.286 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.286 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.287 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.287 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Prometheus container image", 2024-02-21T23:12:55.287 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.287 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.287 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.287 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.287 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_base": { 2024-02-21T23:12:55.287 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_base", 2024-02-21T23:12:55.288 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.288 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.288 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.288 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "quay.io/ceph/ceph", 2024-02-21T23:12:55.288 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.288 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.288 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.288 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Container image name, without the tag", 2024-02-21T23:12:55.288 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.289 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.289 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.289 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.289 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_elasticsearch": { 2024-02-21T23:12:55.289 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_elasticsearch", 2024-02-21T23:12:55.289 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.289 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.289 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.290 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-02-21T23:12:55.290 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.290 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.290 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.290 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "elasticsearch container image", 2024-02-21T23:12:55.290 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.290 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.290 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.291 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.291 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_grafana": { 2024-02-21T23:12:55.291 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_grafana", 2024-02-21T23:12:55.291 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.291 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.291 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.291 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.12", 2024-02-21T23:12:55.291 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.292 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.292 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.292 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Prometheus container image", 2024-02-21T23:12:55.292 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.292 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.292 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.292 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.292 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_haproxy": { 2024-02-21T23:12:55.292 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_haproxy", 2024-02-21T23:12:55.293 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.293 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.293 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.293 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-02-21T23:12:55.293 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.293 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.293 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.294 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "HAproxy container image", 2024-02-21T23:12:55.294 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.294 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.294 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.294 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.294 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_jaeger_agent": { 2024-02-21T23:12:55.294 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_jaeger_agent", 2024-02-21T23:12:55.294 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.294 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.295 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.295 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-02-21T23:12:55.295 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.295 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.295 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.295 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Jaeger agent container image", 2024-02-21T23:12:55.295 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.295 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.296 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.296 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.296 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_jaeger_collector": { 2024-02-21T23:12:55.296 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_jaeger_collector", 2024-02-21T23:12:55.296 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.296 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.296 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.297 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-02-21T23:12:55.297 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.297 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.297 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.297 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Jaeger collector container image", 2024-02-21T23:12:55.297 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.297 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.297 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.297 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.298 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_jaeger_query": { 2024-02-21T23:12:55.298 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_jaeger_query", 2024-02-21T23:12:55.298 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.298 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.298 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.298 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-02-21T23:12:55.298 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.298 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.299 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.299 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Jaeger query container image", 2024-02-21T23:12:55.299 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.299 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.299 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.299 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.299 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_keepalived": { 2024-02-21T23:12:55.300 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_keepalived", 2024-02-21T23:12:55.300 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.300 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.300 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.300 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-02-21T23:12:55.300 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.300 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.300 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.300 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Keepalived container image", 2024-02-21T23:12:55.301 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.301 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.301 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.301 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.301 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_loki": { 2024-02-21T23:12:55.301 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_loki", 2024-02-21T23:12:55.301 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.301 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.302 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.302 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-02-21T23:12:55.302 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.302 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.302 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.302 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Loki container image", 2024-02-21T23:12:55.302 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.302 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.303 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.303 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.303 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_node_exporter": { 2024-02-21T23:12:55.303 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_node_exporter", 2024-02-21T23:12:55.303 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.303 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.303 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.303 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-02-21T23:12:55.304 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.304 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.304 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.304 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Prometheus container image", 2024-02-21T23:12:55.304 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.304 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.304 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.304 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.305 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_nvmeof": { 2024-02-21T23:12:55.305 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_nvmeof", 2024-02-21T23:12:55.305 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.305 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.305 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.305 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "quay.io/ceph/nvmeof:latest", 2024-02-21T23:12:55.305 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.305 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.305 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.306 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Nvme-of container image", 2024-02-21T23:12:55.306 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.306 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.306 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.306 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.306 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_prometheus": { 2024-02-21T23:12:55.306 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_prometheus", 2024-02-21T23:12:55.306 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.307 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.307 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.307 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-02-21T23:12:55.307 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.307 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.307 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.307 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Prometheus container image", 2024-02-21T23:12:55.307 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.308 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.308 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.308 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.308 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_promtail": { 2024-02-21T23:12:55.308 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_promtail", 2024-02-21T23:12:55.308 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.308 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.308 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.309 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-02-21T23:12:55.309 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.309 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.309 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.309 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Promtail container image", 2024-02-21T23:12:55.309 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.309 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.309 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.309 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.310 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image_snmp_gateway": { 2024-02-21T23:12:55.310 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_image_snmp_gateway", 2024-02-21T23:12:55.310 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.310 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.310 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.310 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-02-21T23:12:55.310 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.310 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.311 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.311 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "SNMP Gateway container image", 2024-02-21T23:12:55.311 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.311 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.311 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.311 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.311 INFO:teuthology.orchestra.run.smithi099.stdout: "container_init": { 2024-02-21T23:12:55.311 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "container_init", 2024-02-21T23:12:55.312 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.312 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.312 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.312 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:55.312 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.312 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.312 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.312 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Run podman/docker with `--init`", 2024-02-21T23:12:55.313 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.313 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.313 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.313 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.313 INFO:teuthology.orchestra.run.smithi099.stdout: "daemon_cache_timeout": { 2024-02-21T23:12:55.313 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "daemon_cache_timeout", 2024-02-21T23:12:55.313 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-02-21T23:12:55.313 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.313 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.314 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "600", 2024-02-21T23:12:55.314 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.314 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.314 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.314 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-02-21T23:12:55.314 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.314 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.314 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.315 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.315 INFO:teuthology.orchestra.run.smithi099.stdout: "default_cephadm_command_timeout": { 2024-02-21T23:12:55.315 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "default_cephadm_command_timeout", 2024-02-21T23:12:55.315 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:55.315 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.315 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.315 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "900", 2024-02-21T23:12:55.315 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.316 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.316 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.316 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-02-21T23:12:55.316 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.316 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.316 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.316 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.316 INFO:teuthology.orchestra.run.smithi099.stdout: "default_registry": { 2024-02-21T23:12:55.316 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "default_registry", 2024-02-21T23:12:55.317 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.317 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.317 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.317 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "docker.io", 2024-02-21T23:12:55.317 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.317 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.317 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.317 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-02-21T23:12:55.318 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.318 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.318 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.318 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.318 INFO:teuthology.orchestra.run.smithi099.stdout: "device_cache_timeout": { 2024-02-21T23:12:55.318 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "device_cache_timeout", 2024-02-21T23:12:55.318 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-02-21T23:12:55.318 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.319 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.319 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "1800", 2024-02-21T23:12:55.319 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.319 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.319 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.319 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "seconds to cache device inventory", 2024-02-21T23:12:55.319 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.319 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.319 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.320 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.320 INFO:teuthology.orchestra.run.smithi099.stdout: "device_enhanced_scan": { 2024-02-21T23:12:55.320 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "device_enhanced_scan", 2024-02-21T23:12:55.320 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.320 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.320 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.320 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.320 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.321 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.321 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.321 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Use libstoragemgmt during device scans", 2024-02-21T23:12:55.321 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.321 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.321 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.321 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.321 INFO:teuthology.orchestra.run.smithi099.stdout: "facts_cache_timeout": { 2024-02-21T23:12:55.322 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "facts_cache_timeout", 2024-02-21T23:12:55.322 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-02-21T23:12:55.322 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.322 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.322 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "60", 2024-02-21T23:12:55.322 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.322 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.322 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.323 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "seconds to cache host facts data", 2024-02-21T23:12:55.323 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.323 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.323 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.323 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.323 INFO:teuthology.orchestra.run.smithi099.stdout: "host_check_interval": { 2024-02-21T23:12:55.323 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "host_check_interval", 2024-02-21T23:12:55.323 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-02-21T23:12:55.323 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.324 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.324 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "600", 2024-02-21T23:12:55.324 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.324 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.324 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.324 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "how frequently to perform a host check", 2024-02-21T23:12:55.324 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.325 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.325 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.325 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.325 INFO:teuthology.orchestra.run.smithi099.stdout: "hw_monitoring": { 2024-02-21T23:12:55.325 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "hw_monitoring", 2024-02-21T23:12:55.325 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.325 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.325 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.326 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.326 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.326 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.326 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.326 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-02-21T23:12:55.326 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.326 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.326 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.326 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.327 INFO:teuthology.orchestra.run.smithi099.stdout: "inventory_list_all": { 2024-02-21T23:12:55.327 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "inventory_list_all", 2024-02-21T23:12:55.327 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.327 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.327 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.327 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.327 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.327 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.328 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.328 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-02-21T23:12:55.328 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.328 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.328 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.328 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.328 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:55.328 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:55.329 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.329 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.329 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.329 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.329 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.329 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.329 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.329 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.330 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.330 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.330 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.330 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.330 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.330 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.330 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.330 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.330 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.331 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.331 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.331 INFO:teuthology.orchestra.run.smithi099.stdout: "log_refresh_metadata": { 2024-02-21T23:12:55.331 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_refresh_metadata", 2024-02-21T23:12:55.331 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.331 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.331 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.331 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.332 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.332 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.332 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.332 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-02-21T23:12:55.332 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.332 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.332 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.332 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.333 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:55.333 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:55.333 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.333 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.333 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.333 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:55.333 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.333 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.333 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.334 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-02-21T23:12:55.334 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.334 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.334 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.334 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.334 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:55.334 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:55.334 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.335 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.335 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.335 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:55.335 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.335 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.335 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.335 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.335 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.336 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.336 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.336 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.336 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.336 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.336 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.336 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.336 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.337 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.337 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.337 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:55.337 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:55.337 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.337 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.337 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.337 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.337 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.338 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.338 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.338 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.338 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.338 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.338 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.338 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.339 INFO:teuthology.orchestra.run.smithi099.stdout: "manage_etc_ceph_ceph_conf": { 2024-02-21T23:12:55.339 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-02-21T23:12:55.339 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.339 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.339 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.339 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.339 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.339 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.340 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.340 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-02-21T23:12:55.340 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.340 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.340 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.340 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.340 INFO:teuthology.orchestra.run.smithi099.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-02-21T23:12:55.340 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-02-21T23:12:55.341 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.341 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.341 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.341 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "*", 2024-02-21T23:12:55.341 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.341 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.341 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.341 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-02-21T23:12:55.341 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.342 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.342 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.342 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.342 INFO:teuthology.orchestra.run.smithi099.stdout: "max_count_per_host": { 2024-02-21T23:12:55.342 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "max_count_per_host", 2024-02-21T23:12:55.342 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:55.342 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.342 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.343 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "10", 2024-02-21T23:12:55.343 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.343 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.343 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.343 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "max number of daemons per service per host", 2024-02-21T23:12:55.343 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.343 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.343 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.344 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.344 INFO:teuthology.orchestra.run.smithi099.stdout: "max_osd_draining_count": { 2024-02-21T23:12:55.344 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "max_osd_draining_count", 2024-02-21T23:12:55.344 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:55.344 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.344 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.344 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "10", 2024-02-21T23:12:55.344 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.345 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.345 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.345 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-02-21T23:12:55.345 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.345 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.345 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.345 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.345 INFO:teuthology.orchestra.run.smithi099.stdout: "migration_current": { 2024-02-21T23:12:55.345 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "migration_current", 2024-02-21T23:12:55.346 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:55.346 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.346 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.346 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.346 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.346 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.346 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.346 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "internal - do not modify", 2024-02-21T23:12:55.347 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.347 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.347 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.347 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.347 INFO:teuthology.orchestra.run.smithi099.stdout: "mode": { 2024-02-21T23:12:55.347 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "mode", 2024-02-21T23:12:55.347 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.347 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.347 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.348 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "root", 2024-02-21T23:12:55.348 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.348 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.348 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.348 INFO:teuthology.orchestra.run.smithi099.stdout: "cephadm-package", 2024-02-21T23:12:55.348 INFO:teuthology.orchestra.run.smithi099.stdout: "root" 2024-02-21T23:12:55.348 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.348 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "mode for remote execution of cephadm", 2024-02-21T23:12:55.349 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.349 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.349 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.349 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.349 INFO:teuthology.orchestra.run.smithi099.stdout: "oob_default_addr": { 2024-02-21T23:12:55.349 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "oob_default_addr", 2024-02-21T23:12:55.349 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.349 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.350 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.350 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "169.254.1.1", 2024-02-21T23:12:55.350 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.350 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.350 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.350 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Default address for RedFish API (oob management).", 2024-02-21T23:12:55.350 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.350 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.351 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.351 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.351 INFO:teuthology.orchestra.run.smithi099.stdout: "prometheus_alerts_path": { 2024-02-21T23:12:55.351 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "prometheus_alerts_path", 2024-02-21T23:12:55.351 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.351 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.351 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.351 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-02-21T23:12:55.352 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.352 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.352 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.352 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-02-21T23:12:55.352 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.352 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.352 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.352 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.353 INFO:teuthology.orchestra.run.smithi099.stdout: "registry_insecure": { 2024-02-21T23:12:55.353 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "registry_insecure", 2024-02-21T23:12:55.353 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.353 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.353 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.353 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.353 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.353 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.353 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.354 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-02-21T23:12:55.354 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.354 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.354 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.354 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.354 INFO:teuthology.orchestra.run.smithi099.stdout: "registry_password": { 2024-02-21T23:12:55.354 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "registry_password", 2024-02-21T23:12:55.354 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.355 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.355 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.355 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.355 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.355 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.355 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.355 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-02-21T23:12:55.355 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.356 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.356 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.356 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.356 INFO:teuthology.orchestra.run.smithi099.stdout: "registry_url": { 2024-02-21T23:12:55.356 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "registry_url", 2024-02-21T23:12:55.356 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.356 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.356 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.357 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.357 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.357 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.357 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.357 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-02-21T23:12:55.357 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.357 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.357 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.357 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.358 INFO:teuthology.orchestra.run.smithi099.stdout: "registry_username": { 2024-02-21T23:12:55.358 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "registry_username", 2024-02-21T23:12:55.358 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.358 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.358 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.358 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.358 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.358 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.359 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.359 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-02-21T23:12:55.359 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.359 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.359 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.359 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.359 INFO:teuthology.orchestra.run.smithi099.stdout: "secure_monitoring_stack": { 2024-02-21T23:12:55.359 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "secure_monitoring_stack", 2024-02-21T23:12:55.359 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.360 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.360 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.360 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.360 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.360 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.360 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.360 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-02-21T23:12:55.360 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.361 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.361 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.361 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.361 INFO:teuthology.orchestra.run.smithi099.stdout: "service_discovery_port": { 2024-02-21T23:12:55.361 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "service_discovery_port", 2024-02-21T23:12:55.361 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:55.361 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.361 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.362 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "8765", 2024-02-21T23:12:55.362 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.362 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.362 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.362 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "cephadm service discovery port", 2024-02-21T23:12:55.362 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.362 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.362 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.363 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.363 INFO:teuthology.orchestra.run.smithi099.stdout: "ssh_config_file": { 2024-02-21T23:12:55.363 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "ssh_config_file", 2024-02-21T23:12:55.363 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.363 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.363 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.363 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.363 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.364 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.364 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.364 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-02-21T23:12:55.364 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.364 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.364 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.364 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.364 INFO:teuthology.orchestra.run.smithi099.stdout: "use_agent": { 2024-02-21T23:12:55.364 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "use_agent", 2024-02-21T23:12:55.365 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.365 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.365 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.365 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.365 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.365 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.365 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.365 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-02-21T23:12:55.366 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.366 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.366 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.366 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.366 INFO:teuthology.orchestra.run.smithi099.stdout: "use_repo_digest": { 2024-02-21T23:12:55.366 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "use_repo_digest", 2024-02-21T23:12:55.366 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.366 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.367 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.367 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:55.367 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.367 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.367 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.367 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-02-21T23:12:55.367 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.367 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.367 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.368 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.368 INFO:teuthology.orchestra.run.smithi099.stdout: "warn_on_failed_host_check": { 2024-02-21T23:12:55.368 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "warn_on_failed_host_check", 2024-02-21T23:12:55.368 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.368 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.368 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.368 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:55.368 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.369 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.369 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.369 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "raise a health warning if the host check fails", 2024-02-21T23:12:55.369 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.369 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.369 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.369 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.369 INFO:teuthology.orchestra.run.smithi099.stdout: "warn_on_stray_daemons": { 2024-02-21T23:12:55.370 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "warn_on_stray_daemons", 2024-02-21T23:12:55.370 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.370 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.370 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.370 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:55.370 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.370 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.370 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.371 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-02-21T23:12:55.371 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.371 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.371 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.371 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.371 INFO:teuthology.orchestra.run.smithi099.stdout: "warn_on_stray_hosts": { 2024-02-21T23:12:55.371 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "warn_on_stray_hosts", 2024-02-21T23:12:55.371 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.371 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.372 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.372 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:55.372 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.372 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.372 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.372 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-02-21T23:12:55.372 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.372 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.373 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.373 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.373 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.373 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.373 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:55.373 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "crash", 2024-02-21T23:12:55.373 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:55.373 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:55.374 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:55.374 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:55.374 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:55.374 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.374 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.374 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.374 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.374 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.375 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.375 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.375 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.375 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.375 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.375 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.375 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.375 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.376 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.376 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.376 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.376 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.376 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.376 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.376 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:55.376 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:55.377 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.377 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.377 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.377 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.377 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.377 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.377 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.377 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.378 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.378 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.378 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.378 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.378 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:55.378 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:55.378 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.378 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.378 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.379 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:55.379 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.379 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.379 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.379 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.379 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.379 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.379 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.380 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.380 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.380 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.380 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.380 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.380 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.380 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.380 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.381 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:55.381 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:55.381 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.381 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.381 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.381 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.381 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.381 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.381 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.382 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.382 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.382 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.382 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.382 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.382 INFO:teuthology.orchestra.run.smithi099.stdout: "retain_interval": { 2024-02-21T23:12:55.382 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "retain_interval", 2024-02-21T23:12:55.382 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-02-21T23:12:55.383 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.383 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.383 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "31536000", 2024-02-21T23:12:55.383 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.383 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.383 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.383 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "how long to retain crashes before pruning them", 2024-02-21T23:12:55.383 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.384 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.384 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.384 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.384 INFO:teuthology.orchestra.run.smithi099.stdout: "warn_recent_interval": { 2024-02-21T23:12:55.384 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "warn_recent_interval", 2024-02-21T23:12:55.384 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-02-21T23:12:55.384 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.384 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.385 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "1209600", 2024-02-21T23:12:55.385 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.385 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.385 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.385 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "time interval in which to warn about recent crashes", 2024-02-21T23:12:55.385 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.385 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.385 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.385 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.386 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.386 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.386 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:55.386 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "dashboard", 2024-02-21T23:12:55.386 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:55.386 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:55.386 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:55.386 INFO:teuthology.orchestra.run.smithi099.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-02-21T23:12:55.387 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-02-21T23:12:55.387 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:55.387 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.387 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.387 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "10", 2024-02-21T23:12:55.387 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.387 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.387 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.387 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.388 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.388 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.388 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.388 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.388 INFO:teuthology.orchestra.run.smithi099.stdout: "ALERTMANAGER_API_HOST": { 2024-02-21T23:12:55.388 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "ALERTMANAGER_API_HOST", 2024-02-21T23:12:55.388 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.388 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.389 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.389 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.389 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.389 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.389 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.389 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.389 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.389 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.390 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.390 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.390 INFO:teuthology.orchestra.run.smithi099.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-02-21T23:12:55.390 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-02-21T23:12:55.390 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.390 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.390 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.390 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:55.391 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.391 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.391 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.391 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.391 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.391 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.391 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.391 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.391 INFO:teuthology.orchestra.run.smithi099.stdout: "AUDIT_API_ENABLED": { 2024-02-21T23:12:55.392 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "AUDIT_API_ENABLED", 2024-02-21T23:12:55.392 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.392 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.392 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.392 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.392 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.392 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.392 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.393 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.393 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.393 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.393 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.393 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.393 INFO:teuthology.orchestra.run.smithi099.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-02-21T23:12:55.393 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-02-21T23:12:55.393 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.394 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.394 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.394 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:55.394 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.394 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.394 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.394 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.394 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.394 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.395 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.395 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.395 INFO:teuthology.orchestra.run.smithi099.stdout: "ENABLE_BROWSABLE_API": { 2024-02-21T23:12:55.395 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "ENABLE_BROWSABLE_API", 2024-02-21T23:12:55.395 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.395 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.395 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.395 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:55.396 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.396 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.396 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.396 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.396 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.396 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.396 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.396 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.397 INFO:teuthology.orchestra.run.smithi099.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-02-21T23:12:55.397 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-02-21T23:12:55.397 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.397 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.397 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.397 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:55.397 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.397 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.397 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.398 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.398 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.398 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.398 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.398 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.398 INFO:teuthology.orchestra.run.smithi099.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-02-21T23:12:55.398 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-02-21T23:12:55.398 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.399 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.399 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.399 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:55.399 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.399 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.399 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.399 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.399 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.399 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.400 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.400 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.400 INFO:teuthology.orchestra.run.smithi099.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-02-21T23:12:55.400 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-02-21T23:12:55.400 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.400 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.400 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.400 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:55.401 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.401 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.401 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.401 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.401 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.401 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.401 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.401 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.402 INFO:teuthology.orchestra.run.smithi099.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-02-21T23:12:55.402 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-02-21T23:12:55.402 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.402 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.402 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.402 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:55.402 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.402 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.403 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.403 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.403 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.403 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.403 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.403 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.403 INFO:teuthology.orchestra.run.smithi099.stdout: "FEATURE_TOGGLE_NFS": { 2024-02-21T23:12:55.403 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-02-21T23:12:55.404 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.404 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.404 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.404 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:55.404 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.404 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.404 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.404 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.405 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.405 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.405 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.405 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.405 INFO:teuthology.orchestra.run.smithi099.stdout: "FEATURE_TOGGLE_RBD": { 2024-02-21T23:12:55.405 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-02-21T23:12:55.405 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.405 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.406 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.406 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:55.406 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.406 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.406 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.406 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.406 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.406 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.406 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.407 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.407 INFO:teuthology.orchestra.run.smithi099.stdout: "FEATURE_TOGGLE_RGW": { 2024-02-21T23:12:55.407 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-02-21T23:12:55.407 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.407 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.407 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.407 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:55.407 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.408 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.408 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.408 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.408 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.408 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.408 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.408 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.408 INFO:teuthology.orchestra.run.smithi099.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-02-21T23:12:55.409 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-02-21T23:12:55.409 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.409 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.409 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.409 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.409 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.409 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.409 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.410 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.410 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.410 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.410 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.410 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.410 INFO:teuthology.orchestra.run.smithi099.stdout: "GRAFANA_API_PASSWORD": { 2024-02-21T23:12:55.410 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "GRAFANA_API_PASSWORD", 2024-02-21T23:12:55.410 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.410 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.411 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.411 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "admin", 2024-02-21T23:12:55.411 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.411 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.411 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.411 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.411 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.411 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.412 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.412 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.412 INFO:teuthology.orchestra.run.smithi099.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-02-21T23:12:55.412 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-02-21T23:12:55.412 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.412 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.412 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.412 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:55.413 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.413 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.413 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.413 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.413 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.413 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.413 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.413 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.414 INFO:teuthology.orchestra.run.smithi099.stdout: "GRAFANA_API_URL": { 2024-02-21T23:12:55.414 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "GRAFANA_API_URL", 2024-02-21T23:12:55.414 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.414 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.414 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.414 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.414 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.414 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.414 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.415 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.415 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.415 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.415 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.415 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.415 INFO:teuthology.orchestra.run.smithi099.stdout: "GRAFANA_API_USERNAME": { 2024-02-21T23:12:55.415 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "GRAFANA_API_USERNAME", 2024-02-21T23:12:55.415 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.416 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.416 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.416 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "admin", 2024-02-21T23:12:55.416 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.416 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.416 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.416 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.416 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.417 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.417 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.417 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.417 INFO:teuthology.orchestra.run.smithi099.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-02-21T23:12:55.417 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-02-21T23:12:55.417 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.417 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.417 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.417 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.418 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.418 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.418 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.418 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.418 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.418 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.418 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.418 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.419 INFO:teuthology.orchestra.run.smithi099.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-02-21T23:12:55.419 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-02-21T23:12:55.419 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.419 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.419 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.419 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.419 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.419 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.420 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.420 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.420 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.420 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.420 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.420 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.420 INFO:teuthology.orchestra.run.smithi099.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-02-21T23:12:55.420 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-02-21T23:12:55.421 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.421 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.421 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.421 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:55.421 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.421 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.421 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.421 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.421 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.422 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.422 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.422 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.422 INFO:teuthology.orchestra.run.smithi099.stdout: "ISSUE_TRACKER_API_KEY": { 2024-02-21T23:12:55.422 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-02-21T23:12:55.422 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.422 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.422 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.423 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.423 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.423 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.423 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.423 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.423 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.423 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.423 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.423 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.424 INFO:teuthology.orchestra.run.smithi099.stdout: "PROMETHEUS_API_HOST": { 2024-02-21T23:12:55.424 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "PROMETHEUS_API_HOST", 2024-02-21T23:12:55.424 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.424 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.424 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.424 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.424 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.424 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.425 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.425 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.425 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.425 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.425 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.425 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.425 INFO:teuthology.orchestra.run.smithi099.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-02-21T23:12:55.425 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-02-21T23:12:55.426 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.426 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.426 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.426 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:55.426 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.426 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.426 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.426 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.427 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.427 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.427 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.427 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.427 INFO:teuthology.orchestra.run.smithi099.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-02-21T23:12:55.427 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-02-21T23:12:55.427 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.427 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.427 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.428 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.428 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.428 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.428 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.428 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.428 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.428 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.428 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.431 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.431 INFO:teuthology.orchestra.run.smithi099.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-02-21T23:12:55.431 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-02-21T23:12:55.432 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.432 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.432 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.432 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.432 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.432 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.432 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.432 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.433 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.433 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.433 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.433 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.433 INFO:teuthology.orchestra.run.smithi099.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-02-21T23:12:55.433 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-02-21T23:12:55.433 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.433 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.434 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.434 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:55.434 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.434 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.434 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.434 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.434 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.434 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.435 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.435 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.435 INFO:teuthology.orchestra.run.smithi099.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-02-21T23:12:55.435 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-02-21T23:12:55.435 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.435 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.435 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.435 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:55.436 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.436 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.436 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.436 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.436 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.436 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.436 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.436 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.437 INFO:teuthology.orchestra.run.smithi099.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-02-21T23:12:55.437 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-02-21T23:12:55.437 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.437 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.437 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.437 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.437 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.437 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.438 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.438 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.438 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.438 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.438 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.438 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.438 INFO:teuthology.orchestra.run.smithi099.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-02-21T23:12:55.438 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-02-21T23:12:55.438 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.439 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.439 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.439 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.439 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.439 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.439 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.439 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.439 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.440 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.440 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.440 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.440 INFO:teuthology.orchestra.run.smithi099.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-02-21T23:12:55.440 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-02-21T23:12:55.440 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.440 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.440 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.441 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.441 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.441 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.441 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.441 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.441 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.441 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.441 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.442 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.442 INFO:teuthology.orchestra.run.smithi099.stdout: "PWD_POLICY_ENABLED": { 2024-02-21T23:12:55.442 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "PWD_POLICY_ENABLED", 2024-02-21T23:12:55.442 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.442 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.442 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.442 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:55.442 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.442 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.443 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.443 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.443 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.443 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.443 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.443 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.443 INFO:teuthology.orchestra.run.smithi099.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-02-21T23:12:55.443 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-02-21T23:12:55.444 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.444 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.444 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.444 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-02-21T23:12:55.444 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.444 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.444 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.444 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.445 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.445 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.445 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.445 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.445 INFO:teuthology.orchestra.run.smithi099.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-02-21T23:12:55.445 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-02-21T23:12:55.445 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:55.445 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.445 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.446 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "10", 2024-02-21T23:12:55.446 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.446 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.446 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.446 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.446 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.446 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.446 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.447 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.447 INFO:teuthology.orchestra.run.smithi099.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-02-21T23:12:55.447 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-02-21T23:12:55.447 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:55.447 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.447 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.447 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "8", 2024-02-21T23:12:55.447 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.448 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.448 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.448 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.448 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.448 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.448 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.448 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.448 INFO:teuthology.orchestra.run.smithi099.stdout: "REST_REQUESTS_TIMEOUT": { 2024-02-21T23:12:55.449 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-02-21T23:12:55.449 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:55.449 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.449 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.449 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "45", 2024-02-21T23:12:55.449 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.449 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.449 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.450 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.450 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.450 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.450 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.450 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.450 INFO:teuthology.orchestra.run.smithi099.stdout: "RGW_API_ACCESS_KEY": { 2024-02-21T23:12:55.450 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "RGW_API_ACCESS_KEY", 2024-02-21T23:12:55.450 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.450 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.451 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.451 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.451 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.451 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.451 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.451 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.451 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.451 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.452 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.452 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.452 INFO:teuthology.orchestra.run.smithi099.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-02-21T23:12:55.452 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-02-21T23:12:55.452 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.452 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.452 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.452 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "admin", 2024-02-21T23:12:55.453 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.453 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.453 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.453 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.453 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.453 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.453 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.453 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.453 INFO:teuthology.orchestra.run.smithi099.stdout: "RGW_API_SECRET_KEY": { 2024-02-21T23:12:55.454 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "RGW_API_SECRET_KEY", 2024-02-21T23:12:55.454 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.454 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.454 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.454 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.454 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.454 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.454 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.455 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.455 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.455 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.455 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.455 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.455 INFO:teuthology.orchestra.run.smithi099.stdout: "RGW_API_SSL_VERIFY": { 2024-02-21T23:12:55.455 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "RGW_API_SSL_VERIFY", 2024-02-21T23:12:55.455 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.456 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.456 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.456 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:55.456 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.456 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.456 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.456 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.456 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.456 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.457 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.457 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.457 INFO:teuthology.orchestra.run.smithi099.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-02-21T23:12:55.457 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-02-21T23:12:55.457 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:55.457 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.457 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.457 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "0", 2024-02-21T23:12:55.458 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.458 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.458 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.458 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.458 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.458 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.458 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.458 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.458 INFO:teuthology.orchestra.run.smithi099.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-02-21T23:12:55.459 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-02-21T23:12:55.459 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:55.459 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.459 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.459 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "10", 2024-02-21T23:12:55.459 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.459 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.459 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.460 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.460 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.460 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.460 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.460 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.460 INFO:teuthology.orchestra.run.smithi099.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-02-21T23:12:55.460 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-02-21T23:12:55.461 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:55.461 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.461 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.461 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "5", 2024-02-21T23:12:55.461 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.461 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.461 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.461 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.461 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.462 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.462 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.462 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.462 INFO:teuthology.orchestra.run.smithi099.stdout: "cross_origin_url": { 2024-02-21T23:12:55.462 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "cross_origin_url", 2024-02-21T23:12:55.462 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.462 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.462 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.463 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.463 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.463 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.463 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.463 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.463 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.463 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.463 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.464 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.464 INFO:teuthology.orchestra.run.smithi099.stdout: "crt_file": { 2024-02-21T23:12:55.464 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "crt_file", 2024-02-21T23:12:55.464 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.464 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.464 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.464 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.464 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.465 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.465 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.465 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.465 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.465 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.465 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.465 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.465 INFO:teuthology.orchestra.run.smithi099.stdout: "debug": { 2024-02-21T23:12:55.466 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "debug", 2024-02-21T23:12:55.466 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.466 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.466 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.466 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.466 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.466 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.466 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.467 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Enable/disable debug options", 2024-02-21T23:12:55.467 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.467 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.467 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.467 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.467 INFO:teuthology.orchestra.run.smithi099.stdout: "jwt_token_ttl": { 2024-02-21T23:12:55.467 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "jwt_token_ttl", 2024-02-21T23:12:55.467 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:55.468 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.468 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.468 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "28800", 2024-02-21T23:12:55.468 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.468 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.468 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.468 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.468 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.469 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.469 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.469 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.469 INFO:teuthology.orchestra.run.smithi099.stdout: "key_file": { 2024-02-21T23:12:55.469 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "key_file", 2024-02-21T23:12:55.469 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.469 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.469 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.470 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.470 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.470 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.470 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.470 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.470 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.470 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.470 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.470 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.471 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:55.471 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:55.471 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.471 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.471 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.471 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.471 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.471 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.472 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.472 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.472 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.472 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.472 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.472 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.472 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.472 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.473 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.473 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.473 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.473 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.473 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.473 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:55.473 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:55.473 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.474 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.474 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.474 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.474 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.474 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.474 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.474 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.474 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.474 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.475 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.475 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.475 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:55.475 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:55.475 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.475 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.475 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.475 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:55.476 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.476 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.476 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.476 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.476 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.476 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.476 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.476 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.477 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.477 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.477 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.477 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.477 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.477 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.477 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.477 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:55.477 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:55.478 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.478 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.478 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.478 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.478 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.478 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.478 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.478 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.479 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.479 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.479 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.479 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.479 INFO:teuthology.orchestra.run.smithi099.stdout: "motd": { 2024-02-21T23:12:55.479 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "motd", 2024-02-21T23:12:55.479 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.479 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.480 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.480 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.480 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.480 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.480 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.480 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "The message of the day", 2024-02-21T23:12:55.480 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.480 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.480 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.481 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.481 INFO:teuthology.orchestra.run.smithi099.stdout: "redirect_resolve_ip_addr": { 2024-02-21T23:12:55.481 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "redirect_resolve_ip_addr", 2024-02-21T23:12:55.481 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.481 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.481 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.481 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.481 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.482 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.482 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.482 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.482 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.482 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.482 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.482 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.482 INFO:teuthology.orchestra.run.smithi099.stdout: "server_addr": { 2024-02-21T23:12:55.483 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "server_addr", 2024-02-21T23:12:55.483 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.483 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.483 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.483 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "::", 2024-02-21T23:12:55.483 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.483 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.483 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.483 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.484 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.484 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.484 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.484 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.484 INFO:teuthology.orchestra.run.smithi099.stdout: "server_port": { 2024-02-21T23:12:55.484 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "server_port", 2024-02-21T23:12:55.484 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:55.484 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.485 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.485 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "8080", 2024-02-21T23:12:55.485 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.485 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.485 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.485 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.485 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.485 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.486 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.486 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.486 INFO:teuthology.orchestra.run.smithi099.stdout: "ssl": { 2024-02-21T23:12:55.486 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "ssl", 2024-02-21T23:12:55.486 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.486 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.486 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.486 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:55.487 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.487 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.487 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.487 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.487 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.487 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.487 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.487 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.487 INFO:teuthology.orchestra.run.smithi099.stdout: "ssl_server_port": { 2024-02-21T23:12:55.488 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "ssl_server_port", 2024-02-21T23:12:55.488 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:55.488 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.488 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.488 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "8443", 2024-02-21T23:12:55.488 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.488 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.489 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.489 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.489 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.489 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.489 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.489 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.489 INFO:teuthology.orchestra.run.smithi099.stdout: "standby_behaviour": { 2024-02-21T23:12:55.489 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "standby_behaviour", 2024-02-21T23:12:55.489 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.490 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.490 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.490 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "redirect", 2024-02-21T23:12:55.490 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.490 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.490 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.490 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.490 INFO:teuthology.orchestra.run.smithi099.stdout: "redirect" 2024-02-21T23:12:55.491 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.491 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.491 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.491 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.491 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.491 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.491 INFO:teuthology.orchestra.run.smithi099.stdout: "standby_error_status_code": { 2024-02-21T23:12:55.491 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "standby_error_status_code", 2024-02-21T23:12:55.492 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:55.492 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.492 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.492 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "500", 2024-02-21T23:12:55.492 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "400", 2024-02-21T23:12:55.492 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "599", 2024-02-21T23:12:55.492 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.492 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.493 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.493 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.493 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.493 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.493 INFO:teuthology.orchestra.run.smithi099.stdout: "url_prefix": { 2024-02-21T23:12:55.493 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "url_prefix", 2024-02-21T23:12:55.493 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.493 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.494 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.494 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.494 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.494 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.494 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.494 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.494 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.494 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.494 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.495 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.495 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.495 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.495 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:55.495 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "devicehealth", 2024-02-21T23:12:55.495 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:55.495 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:55.495 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:55.496 INFO:teuthology.orchestra.run.smithi099.stdout: "enable_monitoring": { 2024-02-21T23:12:55.496 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "enable_monitoring", 2024-02-21T23:12:55.496 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.496 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.496 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.496 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:55.496 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.496 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.497 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.497 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "monitor device health metrics", 2024-02-21T23:12:55.497 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.497 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.497 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.497 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.497 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:55.497 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:55.498 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.498 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.498 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.498 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.498 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.498 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.498 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.498 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.498 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.499 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.499 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.499 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.499 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.499 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.499 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.499 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.499 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.500 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.500 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.500 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:55.500 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:55.500 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.500 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.500 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.500 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.501 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.501 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.501 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.501 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.501 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.501 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.501 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.501 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.502 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:55.502 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:55.502 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.502 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.502 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.502 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:55.502 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.502 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.502 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.503 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.503 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.503 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.503 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.503 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.503 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.503 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.503 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.504 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.504 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.504 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.504 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.504 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:55.504 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:55.504 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.504 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.505 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.505 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.505 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.505 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.505 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.505 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.505 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.505 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.505 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.506 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.506 INFO:teuthology.orchestra.run.smithi099.stdout: "mark_out_threshold": { 2024-02-21T23:12:55.506 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "mark_out_threshold", 2024-02-21T23:12:55.506 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-02-21T23:12:55.506 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.506 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.506 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "2419200", 2024-02-21T23:12:55.506 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.507 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.507 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.507 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-02-21T23:12:55.507 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.507 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.507 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.507 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.507 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": { 2024-02-21T23:12:55.508 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "pool_name", 2024-02-21T23:12:55.508 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.508 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.508 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.508 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "device_health_metrics", 2024-02-21T23:12:55.508 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.508 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.508 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.509 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "name of pool in which to store device health metrics", 2024-02-21T23:12:55.509 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.509 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.509 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.509 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.509 INFO:teuthology.orchestra.run.smithi099.stdout: "retention_period": { 2024-02-21T23:12:55.509 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "retention_period", 2024-02-21T23:12:55.509 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-02-21T23:12:55.509 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.510 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.510 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "15552000", 2024-02-21T23:12:55.510 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.510 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.510 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.510 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "how long to retain device health metrics", 2024-02-21T23:12:55.510 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.510 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.511 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.511 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.511 INFO:teuthology.orchestra.run.smithi099.stdout: "scrape_frequency": { 2024-02-21T23:12:55.511 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "scrape_frequency", 2024-02-21T23:12:55.511 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-02-21T23:12:55.511 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.511 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.511 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "86400", 2024-02-21T23:12:55.512 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.512 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.512 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.512 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "how frequently to scrape device health metrics", 2024-02-21T23:12:55.512 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.512 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.512 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.512 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.513 INFO:teuthology.orchestra.run.smithi099.stdout: "self_heal": { 2024-02-21T23:12:55.513 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "self_heal", 2024-02-21T23:12:55.513 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.513 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.513 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.513 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:55.513 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.513 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.513 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.514 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-02-21T23:12:55.514 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.514 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.514 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.514 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.514 INFO:teuthology.orchestra.run.smithi099.stdout: "sleep_interval": { 2024-02-21T23:12:55.514 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "sleep_interval", 2024-02-21T23:12:55.514 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-02-21T23:12:55.515 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.515 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.515 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "600", 2024-02-21T23:12:55.515 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.515 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.515 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.515 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "how frequently to wake up and check device health", 2024-02-21T23:12:55.515 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.515 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.516 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.516 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.516 INFO:teuthology.orchestra.run.smithi099.stdout: "warn_threshold": { 2024-02-21T23:12:55.516 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "warn_threshold", 2024-02-21T23:12:55.516 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-02-21T23:12:55.516 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.516 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.517 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "7257600", 2024-02-21T23:12:55.517 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.517 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.517 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.517 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-02-21T23:12:55.517 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.517 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.517 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.518 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.518 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.518 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.518 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:55.518 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "diskprediction_local", 2024-02-21T23:12:55.518 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:55.518 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:55.518 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:55.518 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:55.519 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:55.519 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.519 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.519 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.519 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.519 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.519 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.519 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.520 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.520 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.520 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.520 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.520 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.520 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.520 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.520 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.521 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.521 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.521 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.521 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.521 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:55.521 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:55.521 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.521 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.521 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.522 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.522 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.522 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.522 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.522 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.522 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.522 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.522 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.523 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.523 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:55.523 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:55.523 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.523 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.523 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.523 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:55.523 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.524 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.524 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.524 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.524 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.524 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.524 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.524 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.524 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.525 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.525 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.525 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.525 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.525 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.525 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.525 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:55.525 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:55.525 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.526 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.526 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.526 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.526 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.526 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.526 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.526 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.526 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.527 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.527 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.527 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.527 INFO:teuthology.orchestra.run.smithi099.stdout: "predict_interval": { 2024-02-21T23:12:55.527 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "predict_interval", 2024-02-21T23:12:55.527 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.527 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.527 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.528 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "86400", 2024-02-21T23:12:55.528 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.528 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.528 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.528 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.528 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.528 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.528 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.528 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.529 INFO:teuthology.orchestra.run.smithi099.stdout: "predictor_model": { 2024-02-21T23:12:55.529 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "predictor_model", 2024-02-21T23:12:55.529 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.529 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.529 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.529 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "prophetstor", 2024-02-21T23:12:55.529 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.529 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.530 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.530 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.530 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.530 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.530 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.530 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.530 INFO:teuthology.orchestra.run.smithi099.stdout: "sleep_interval": { 2024-02-21T23:12:55.530 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "sleep_interval", 2024-02-21T23:12:55.531 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.531 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.531 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.531 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "600", 2024-02-21T23:12:55.531 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.531 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.531 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.531 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.532 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.532 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.532 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.532 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.532 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.532 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.532 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:55.532 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "influx", 2024-02-21T23:12:55.533 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": false, 2024-02-21T23:12:55.533 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "influxdb python module not found", 2024-02-21T23:12:55.533 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:55.533 INFO:teuthology.orchestra.run.smithi099.stdout: "batch_size": { 2024-02-21T23:12:55.533 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "batch_size", 2024-02-21T23:12:55.533 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:55.533 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.533 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.534 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "5000", 2024-02-21T23:12:55.534 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.534 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.534 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.534 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-02-21T23:12:55.534 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.534 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.534 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.535 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.535 INFO:teuthology.orchestra.run.smithi099.stdout: "database": { 2024-02-21T23:12:55.535 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "database", 2024-02-21T23:12:55.535 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.535 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.535 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.535 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "ceph", 2024-02-21T23:12:55.535 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.535 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.536 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.536 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-02-21T23:12:55.536 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.536 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.536 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.536 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.536 INFO:teuthology.orchestra.run.smithi099.stdout: "hostname": { 2024-02-21T23:12:55.536 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "hostname", 2024-02-21T23:12:55.537 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.537 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.537 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.537 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.537 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.537 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.537 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.537 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "InfluxDB server hostname", 2024-02-21T23:12:55.538 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.538 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.538 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.538 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.538 INFO:teuthology.orchestra.run.smithi099.stdout: "interval": { 2024-02-21T23:12:55.538 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "interval", 2024-02-21T23:12:55.538 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-02-21T23:12:55.538 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.539 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.539 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "30", 2024-02-21T23:12:55.539 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "5", 2024-02-21T23:12:55.539 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.539 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.539 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-02-21T23:12:55.539 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.539 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.539 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.540 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.540 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:55.540 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:55.540 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.540 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.540 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.540 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.540 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.541 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.541 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.541 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.541 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.541 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.541 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.541 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.541 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.542 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.542 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.542 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.542 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.542 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.542 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.542 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:55.542 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:55.543 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.543 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.543 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.543 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.543 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.543 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.543 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.543 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.543 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.544 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.544 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.544 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.544 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:55.544 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:55.545 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.545 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.545 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.545 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:55.545 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.545 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.545 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.545 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.546 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.546 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.546 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.546 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.546 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.546 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.546 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.546 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.547 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.547 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.547 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.547 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:55.547 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:55.547 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.547 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.547 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.547 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.548 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.548 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.548 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.548 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.548 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.548 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.548 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.548 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.549 INFO:teuthology.orchestra.run.smithi099.stdout: "password": { 2024-02-21T23:12:55.549 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "password", 2024-02-21T23:12:55.549 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.549 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.549 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.549 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.549 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.549 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.550 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.550 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "password of InfluxDB server user", 2024-02-21T23:12:55.550 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.550 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.550 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.550 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.550 INFO:teuthology.orchestra.run.smithi099.stdout: "port": { 2024-02-21T23:12:55.550 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "port", 2024-02-21T23:12:55.551 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:55.551 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.551 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.551 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "8086", 2024-02-21T23:12:55.551 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.551 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.551 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.551 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "InfluxDB server port", 2024-02-21T23:12:55.551 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.552 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.552 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.552 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.552 INFO:teuthology.orchestra.run.smithi099.stdout: "ssl": { 2024-02-21T23:12:55.552 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "ssl", 2024-02-21T23:12:55.552 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.552 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.552 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.553 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "false", 2024-02-21T23:12:55.553 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.553 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.553 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.553 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-02-21T23:12:55.553 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.553 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.553 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.554 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.554 INFO:teuthology.orchestra.run.smithi099.stdout: "threads": { 2024-02-21T23:12:55.554 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "threads", 2024-02-21T23:12:55.554 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:55.554 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.554 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.554 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "5", 2024-02-21T23:12:55.554 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "1", 2024-02-21T23:12:55.555 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "32", 2024-02-21T23:12:55.555 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.555 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-02-21T23:12:55.555 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.555 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.555 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.555 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.555 INFO:teuthology.orchestra.run.smithi099.stdout: "username": { 2024-02-21T23:12:55.555 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "username", 2024-02-21T23:12:55.556 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.556 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.556 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.556 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.556 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.556 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.556 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.556 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "username of InfluxDB server user", 2024-02-21T23:12:55.557 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.557 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.557 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.557 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.557 INFO:teuthology.orchestra.run.smithi099.stdout: "verify_ssl": { 2024-02-21T23:12:55.557 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "verify_ssl", 2024-02-21T23:12:55.557 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.557 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.558 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.558 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "true", 2024-02-21T23:12:55.558 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.558 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.558 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.558 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-02-21T23:12:55.558 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.558 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.559 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.559 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.559 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.559 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.559 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:55.559 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "insights", 2024-02-21T23:12:55.559 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:55.559 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:55.559 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:55.560 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:55.560 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:55.560 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.560 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.560 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.560 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.560 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.560 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.561 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.561 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.561 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.561 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.561 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.561 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.561 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.561 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.562 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.562 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.562 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.562 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.562 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.562 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:55.562 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:55.562 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.563 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.563 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.563 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.563 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.563 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.563 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.563 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.563 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.564 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.564 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.564 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.564 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:55.564 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:55.564 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.564 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.564 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.565 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:55.565 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.565 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.565 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.565 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.565 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.565 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.565 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.566 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.566 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.566 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.566 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.566 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.566 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.566 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.566 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.567 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:55.567 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:55.567 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.567 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.567 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.567 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.567 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.567 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.567 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.568 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.568 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.568 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.568 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.568 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.568 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.568 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.568 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:55.569 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "iostat", 2024-02-21T23:12:55.569 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:55.569 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:55.569 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:55.569 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:55.569 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:55.569 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.569 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.570 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.570 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.570 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.570 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.570 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.570 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.570 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.570 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.571 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.571 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.571 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.571 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.571 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.571 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.571 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.571 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.571 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.572 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:55.572 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:55.572 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.572 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.572 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.572 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.572 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.572 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.573 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.573 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.573 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.573 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.573 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.573 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.573 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:55.574 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:55.574 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.574 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.574 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.574 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:55.574 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.574 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.574 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.574 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.575 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.575 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.575 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.575 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.575 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.575 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.575 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.575 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.576 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.576 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.576 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.576 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:55.576 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:55.576 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.576 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.576 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.577 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.577 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.577 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.577 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.577 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.577 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.577 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.577 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.578 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.578 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.578 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.578 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:55.578 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "localpool", 2024-02-21T23:12:55.578 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:55.578 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:55.578 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:55.578 INFO:teuthology.orchestra.run.smithi099.stdout: "failure_domain": { 2024-02-21T23:12:55.579 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "failure_domain", 2024-02-21T23:12:55.579 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.579 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.579 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.579 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "host", 2024-02-21T23:12:55.579 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.579 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.579 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.580 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "failure domain for any created local pool", 2024-02-21T23:12:55.580 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-02-21T23:12:55.580 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.580 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.580 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.580 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:55.580 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:55.580 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.581 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.581 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.581 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.581 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.581 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.581 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.581 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.581 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.582 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.582 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.582 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.582 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.582 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.582 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.582 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.582 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.582 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.583 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.583 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:55.583 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:55.583 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.583 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.583 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.583 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.583 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.584 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.584 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.584 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.584 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.584 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.584 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.584 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.584 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:55.585 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:55.585 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.585 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.585 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.585 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:55.585 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.585 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.585 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.586 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.586 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.586 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.586 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.586 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.586 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.586 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.586 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.587 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.587 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.587 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.587 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.587 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:55.587 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:55.587 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.587 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.587 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.588 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.588 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.588 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.588 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.588 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.588 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.588 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.588 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.589 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.589 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": { 2024-02-21T23:12:55.589 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "min_size", 2024-02-21T23:12:55.589 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:55.589 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.589 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.589 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.589 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.590 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.590 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.590 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "default min_size for any created local pool", 2024-02-21T23:12:55.590 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-02-21T23:12:55.590 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.590 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.590 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.590 INFO:teuthology.orchestra.run.smithi099.stdout: "num_rep": { 2024-02-21T23:12:55.591 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "num_rep", 2024-02-21T23:12:55.591 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:55.591 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.591 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.591 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "3", 2024-02-21T23:12:55.591 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.591 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.591 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.592 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "default replica count for any created local pool", 2024-02-21T23:12:55.592 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.592 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.592 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.592 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.592 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": { 2024-02-21T23:12:55.592 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "pg_num", 2024-02-21T23:12:55.592 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:55.593 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.593 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.593 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "128", 2024-02-21T23:12:55.593 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.593 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.593 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.593 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "default pg_num for any created local pool", 2024-02-21T23:12:55.593 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.593 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.594 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.594 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.594 INFO:teuthology.orchestra.run.smithi099.stdout: "prefix": { 2024-02-21T23:12:55.594 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "prefix", 2024-02-21T23:12:55.594 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.594 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.594 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.594 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.595 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.595 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.595 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.595 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "name prefix for any created local pool", 2024-02-21T23:12:55.595 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.595 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.595 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.595 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.596 INFO:teuthology.orchestra.run.smithi099.stdout: "subtree": { 2024-02-21T23:12:55.596 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "subtree", 2024-02-21T23:12:55.596 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.596 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.596 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.596 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "rack", 2024-02-21T23:12:55.596 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.596 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.597 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.597 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "CRUSH level for which to create a local pool", 2024-02-21T23:12:55.597 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-02-21T23:12:55.597 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.597 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.597 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.597 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.597 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.598 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:55.598 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "mds_autoscaler", 2024-02-21T23:12:55.598 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:55.598 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:55.598 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:55.598 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:55.598 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:55.598 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.598 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.599 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.599 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.599 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.599 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.599 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.599 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.599 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.599 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.600 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.600 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.600 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.600 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.600 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.600 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.600 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.600 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.601 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.601 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:55.601 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:55.601 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.601 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.601 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.601 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.601 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.602 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.602 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.602 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.602 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.602 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.602 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.602 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.602 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:55.603 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:55.603 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.603 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.603 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.603 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:55.603 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.603 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.603 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.604 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.604 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.604 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.604 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.604 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.604 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.604 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.604 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.605 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.605 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.605 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.605 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.605 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:55.605 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:55.605 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.605 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.606 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.606 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.606 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.606 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.606 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.606 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.606 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.606 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.607 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.607 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.607 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.607 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.607 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:55.607 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "mirroring", 2024-02-21T23:12:55.607 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:55.607 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:55.607 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:55.608 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:55.608 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:55.608 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.608 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.608 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.608 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.608 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.608 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.609 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.609 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.609 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.609 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.609 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.609 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.609 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.609 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.610 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.610 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.610 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.610 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.610 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.610 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:55.610 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:55.610 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.611 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.611 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.611 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.611 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.611 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.611 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.611 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.611 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.611 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.612 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.612 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.612 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:55.612 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:55.612 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.612 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.612 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.612 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:55.613 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.613 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.613 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.613 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.613 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.613 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.613 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.613 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.614 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.614 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.614 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.614 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.614 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.614 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.614 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.614 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:55.615 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:55.615 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.615 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.615 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.615 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.615 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.615 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.615 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.616 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.616 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.616 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.616 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.616 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.616 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.616 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.616 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:55.617 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "nfs", 2024-02-21T23:12:55.617 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:55.617 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:55.617 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:55.617 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:55.617 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:55.617 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.617 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.617 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.618 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.618 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.618 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.618 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.618 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.618 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.618 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.618 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.619 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.619 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.619 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.619 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.619 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.619 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.619 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.619 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.620 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:55.620 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:55.620 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.620 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.620 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.620 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.620 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.620 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.621 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.621 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.621 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.621 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.621 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.621 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.621 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:55.621 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:55.622 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.622 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.622 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.622 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:55.622 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.622 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.622 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.622 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.622 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.623 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.623 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.623 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.623 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.623 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.623 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.623 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.623 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.624 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.624 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.624 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:55.624 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:55.624 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.624 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.624 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.624 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.625 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.625 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.625 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.625 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.625 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.625 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.625 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.625 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.626 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.626 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.626 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:55.626 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "orchestrator", 2024-02-21T23:12:55.626 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:55.626 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:55.626 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:55.626 INFO:teuthology.orchestra.run.smithi099.stdout: "fail_fs": { 2024-02-21T23:12:55.627 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "fail_fs", 2024-02-21T23:12:55.627 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.627 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.627 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.627 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.627 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.627 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.627 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.627 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-02-21T23:12:55.628 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.628 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.628 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.628 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.628 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:55.628 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:55.628 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.628 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.629 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.629 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.629 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.629 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.629 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.629 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.629 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.629 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.630 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.630 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.630 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.630 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.630 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.630 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.630 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.630 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.631 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.631 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:55.631 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:55.631 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.631 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.631 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.631 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.631 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.632 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.632 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.632 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.635 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.635 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.635 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.635 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.635 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:55.636 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:55.636 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.636 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.636 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.636 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:55.636 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.636 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.636 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.637 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.637 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.637 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.637 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.637 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.637 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.637 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.637 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.638 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.638 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.638 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.638 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.638 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:55.638 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:55.638 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.638 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.638 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.639 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.639 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.639 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.639 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.639 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.639 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.639 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.639 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.640 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.640 INFO:teuthology.orchestra.run.smithi099.stdout: "orchestrator": { 2024-02-21T23:12:55.640 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "orchestrator", 2024-02-21T23:12:55.640 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.640 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.640 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.640 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.640 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.641 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.641 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.641 INFO:teuthology.orchestra.run.smithi099.stdout: "cephadm", 2024-02-21T23:12:55.641 INFO:teuthology.orchestra.run.smithi099.stdout: "rook", 2024-02-21T23:12:55.641 INFO:teuthology.orchestra.run.smithi099.stdout: "test_orchestrator" 2024-02-21T23:12:55.641 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.641 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Orchestrator backend", 2024-02-21T23:12:55.641 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.642 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.642 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.642 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.642 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.642 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.642 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:55.642 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "osd_perf_query", 2024-02-21T23:12:55.642 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:55.643 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:55.643 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:55.643 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:55.643 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:55.643 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.643 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.643 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.643 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.643 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.644 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.644 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.644 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.644 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.644 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.644 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.644 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.644 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.645 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.645 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.645 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.645 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.645 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.645 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.645 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:55.645 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:55.646 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.646 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.646 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.646 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.646 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.646 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.646 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.646 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.646 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.647 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.647 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.647 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.647 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:55.647 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:55.647 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.647 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.647 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.648 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:55.648 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.648 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.648 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.648 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.648 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.648 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.648 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.649 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.649 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.649 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.649 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.649 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.649 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.649 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.649 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.650 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:55.650 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:55.650 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.650 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.650 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.650 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.650 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.650 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.651 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.651 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.651 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.651 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.651 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.651 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.651 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.651 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.651 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:55.652 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "osd_support", 2024-02-21T23:12:55.652 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:55.652 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:55.652 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:55.652 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:55.652 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:55.652 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.652 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.653 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.653 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.653 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.653 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.653 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.653 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.653 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.654 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.654 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.654 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.654 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.654 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.654 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.654 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.654 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.655 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.655 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.655 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:55.655 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:55.655 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.655 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.655 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.655 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.655 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.656 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.656 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.656 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.656 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.656 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.656 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.656 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.656 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:55.657 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:55.657 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.657 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.657 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.657 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:55.657 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.657 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.657 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.658 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.658 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.658 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.658 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.658 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.658 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.658 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.658 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.659 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.659 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.659 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.659 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.659 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:55.659 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:55.659 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.659 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.659 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.660 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.660 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.660 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.660 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.660 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.660 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.660 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.660 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.661 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.661 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.661 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.661 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:55.661 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "pg_autoscaler", 2024-02-21T23:12:55.661 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:55.661 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:55.661 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:55.662 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:55.662 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:55.662 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.662 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.662 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.662 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.662 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.662 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.663 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.663 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.663 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.663 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.663 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.663 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.663 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.663 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.663 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.664 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.664 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.664 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.664 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.664 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:55.664 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:55.664 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.664 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.665 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.665 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.665 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.665 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.665 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.665 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.665 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.665 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.666 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.666 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.666 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:55.666 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:55.666 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.666 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.666 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.666 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:55.667 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.667 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.667 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.667 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.667 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.667 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.667 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.667 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.668 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.668 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.668 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.668 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.668 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.668 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.668 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.668 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:55.669 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:55.669 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.669 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.669 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.669 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.669 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.669 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.669 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.669 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.670 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.670 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.670 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.670 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.670 INFO:teuthology.orchestra.run.smithi099.stdout: "sleep_interval": { 2024-02-21T23:12:55.670 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "sleep_interval", 2024-02-21T23:12:55.670 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-02-21T23:12:55.670 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.671 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.671 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "60", 2024-02-21T23:12:55.671 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.671 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.671 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.671 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.671 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.671 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.672 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.672 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.672 INFO:teuthology.orchestra.run.smithi099.stdout: "threshold": { 2024-02-21T23:12:55.672 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "threshold", 2024-02-21T23:12:55.672 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "float", 2024-02-21T23:12:55.672 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.672 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.672 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "3.0", 2024-02-21T23:12:55.673 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "1.0", 2024-02-21T23:12:55.673 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.673 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.673 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "scaling threshold", 2024-02-21T23:12:55.673 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-02-21T23:12:55.673 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.673 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.673 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.673 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.674 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.674 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:55.674 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "progress", 2024-02-21T23:12:55.674 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:55.674 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:55.674 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:55.674 INFO:teuthology.orchestra.run.smithi099.stdout: "allow_pg_recovery_event": { 2024-02-21T23:12:55.674 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "allow_pg_recovery_event", 2024-02-21T23:12:55.675 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.675 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.675 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.675 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.675 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.675 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.675 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.675 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "allow the module to show pg recovery progress", 2024-02-21T23:12:55.676 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.676 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.676 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.676 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.676 INFO:teuthology.orchestra.run.smithi099.stdout: "enabled": { 2024-02-21T23:12:55.676 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "enabled", 2024-02-21T23:12:55.676 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.676 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.677 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.677 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:55.677 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.677 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.677 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.677 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.677 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.677 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.677 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.678 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.678 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:55.678 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:55.678 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.678 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.678 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.678 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.678 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.679 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.679 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.679 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.679 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.679 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.679 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.679 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.679 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.679 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.680 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.680 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.680 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.680 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.680 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.680 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:55.680 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:55.680 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.681 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.681 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.681 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.681 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.681 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.681 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.681 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.681 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.682 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.682 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.682 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.682 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:55.682 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:55.682 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.682 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.682 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.683 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:55.683 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.683 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.683 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.683 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.683 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.683 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.683 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.683 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.684 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.684 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.684 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.684 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.684 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.684 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.684 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.684 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:55.685 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:55.685 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.685 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.685 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.685 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.685 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.685 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.685 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.686 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.686 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.686 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.686 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.686 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.686 INFO:teuthology.orchestra.run.smithi099.stdout: "max_completed_events": { 2024-02-21T23:12:55.686 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "max_completed_events", 2024-02-21T23:12:55.686 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:55.686 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.687 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.687 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "50", 2024-02-21T23:12:55.687 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.687 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.687 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.687 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "number of past completed events to remember", 2024-02-21T23:12:55.687 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.687 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.688 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.688 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.688 INFO:teuthology.orchestra.run.smithi099.stdout: "sleep_interval": { 2024-02-21T23:12:55.688 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "sleep_interval", 2024-02-21T23:12:55.688 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-02-21T23:12:55.688 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.688 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.688 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "5", 2024-02-21T23:12:55.689 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.689 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.689 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.689 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "how long the module is going to sleep", 2024-02-21T23:12:55.689 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.689 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.689 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.689 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.690 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.690 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.690 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:55.690 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "prometheus", 2024-02-21T23:12:55.690 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:55.690 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:55.690 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:55.690 INFO:teuthology.orchestra.run.smithi099.stdout: "cache": { 2024-02-21T23:12:55.691 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "cache", 2024-02-21T23:12:55.691 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.691 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.691 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.691 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:55.691 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.691 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.691 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.692 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.692 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.692 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.692 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.692 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.692 INFO:teuthology.orchestra.run.smithi099.stdout: "exclude_perf_counters": { 2024-02-21T23:12:55.692 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "exclude_perf_counters", 2024-02-21T23:12:55.692 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.693 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.693 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.693 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:55.693 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.693 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.693 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.693 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-02-21T23:12:55.693 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-02-21T23:12:55.694 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.694 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.694 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.694 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:55.694 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:55.694 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.694 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.694 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.695 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.695 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.695 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.695 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.695 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.695 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.695 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.695 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.695 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.696 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.696 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.696 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.696 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.696 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.696 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.696 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.696 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:55.697 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:55.697 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.697 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.697 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.697 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.697 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.697 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.697 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.698 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.698 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.698 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.698 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.698 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.698 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:55.698 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:55.698 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.699 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.699 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.699 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:55.699 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.699 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.699 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.699 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.699 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.699 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.700 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.700 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.700 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.700 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.700 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.700 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.700 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.700 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.701 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.701 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:55.701 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:55.701 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.701 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.701 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.701 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.701 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.702 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.702 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.702 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.702 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.702 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.702 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.702 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.702 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_stats_pools": { 2024-02-21T23:12:55.703 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "rbd_stats_pools", 2024-02-21T23:12:55.703 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.703 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.703 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.703 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.703 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.703 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.703 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.703 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.704 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.704 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.704 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.704 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.704 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_stats_pools_refresh_interval": { 2024-02-21T23:12:55.704 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-02-21T23:12:55.704 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:55.704 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.705 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.705 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "300", 2024-02-21T23:12:55.705 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.705 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.705 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.705 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.705 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.705 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.706 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.706 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.706 INFO:teuthology.orchestra.run.smithi099.stdout: "scrape_interval": { 2024-02-21T23:12:55.706 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "scrape_interval", 2024-02-21T23:12:55.706 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "float", 2024-02-21T23:12:55.706 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.706 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.706 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "15.0", 2024-02-21T23:12:55.706 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.707 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.707 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.707 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.707 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.707 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.707 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.707 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.707 INFO:teuthology.orchestra.run.smithi099.stdout: "server_addr": { 2024-02-21T23:12:55.708 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "server_addr", 2024-02-21T23:12:55.708 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.708 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.708 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.708 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "::", 2024-02-21T23:12:55.708 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.708 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.708 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.709 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-02-21T23:12:55.709 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.709 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.709 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.709 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.709 INFO:teuthology.orchestra.run.smithi099.stdout: "server_port": { 2024-02-21T23:12:55.709 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "server_port", 2024-02-21T23:12:55.709 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:55.710 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.710 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.710 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "9283", 2024-02-21T23:12:55.710 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.710 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.710 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.710 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-02-21T23:12:55.710 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.711 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.711 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.711 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.711 INFO:teuthology.orchestra.run.smithi099.stdout: "stale_cache_strategy": { 2024-02-21T23:12:55.711 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "stale_cache_strategy", 2024-02-21T23:12:55.711 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.711 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.711 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.712 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "log", 2024-02-21T23:12:55.712 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.712 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.712 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.712 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.712 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.712 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.712 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.712 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.713 INFO:teuthology.orchestra.run.smithi099.stdout: "standby_behaviour": { 2024-02-21T23:12:55.713 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "standby_behaviour", 2024-02-21T23:12:55.713 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.713 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.713 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.713 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "default", 2024-02-21T23:12:55.713 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.713 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.714 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.714 INFO:teuthology.orchestra.run.smithi099.stdout: "default", 2024-02-21T23:12:55.714 INFO:teuthology.orchestra.run.smithi099.stdout: "error" 2024-02-21T23:12:55.714 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.714 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.714 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.714 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.714 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.715 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.715 INFO:teuthology.orchestra.run.smithi099.stdout: "standby_error_status_code": { 2024-02-21T23:12:55.715 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "standby_error_status_code", 2024-02-21T23:12:55.715 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:55.715 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.715 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.715 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "500", 2024-02-21T23:12:55.715 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "400", 2024-02-21T23:12:55.716 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "599", 2024-02-21T23:12:55.716 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.716 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.716 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.716 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.716 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.716 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.716 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.716 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.717 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:55.717 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "rbd_support", 2024-02-21T23:12:55.717 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:55.717 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:55.717 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:55.717 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:55.717 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:55.717 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.718 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.718 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.718 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.718 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.718 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.718 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.718 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.718 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.719 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.719 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.719 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.719 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.719 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.719 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.719 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.719 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.720 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.720 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.720 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:55.720 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:55.720 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.720 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.720 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.720 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.721 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.721 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.721 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.721 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.721 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.721 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.721 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.721 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.722 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:55.722 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:55.722 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.722 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.722 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.722 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:55.722 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.722 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.723 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.723 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.723 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.723 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.723 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.723 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.723 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.723 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.723 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.724 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.724 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.724 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.724 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.724 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:55.724 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:55.724 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.724 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.725 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.725 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.725 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.725 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.725 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.725 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.725 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.725 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.726 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.726 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.726 INFO:teuthology.orchestra.run.smithi099.stdout: "max_concurrent_snap_create": { 2024-02-21T23:12:55.726 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "max_concurrent_snap_create", 2024-02-21T23:12:55.726 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:55.726 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.726 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.726 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "10", 2024-02-21T23:12:55.727 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.727 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.727 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.727 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.727 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.727 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.727 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.727 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.728 INFO:teuthology.orchestra.run.smithi099.stdout: "mirror_snapshot_schedule": { 2024-02-21T23:12:55.728 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "mirror_snapshot_schedule", 2024-02-21T23:12:55.728 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.728 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.728 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.728 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.728 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.728 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.729 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.729 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.729 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.729 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.729 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.729 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.729 INFO:teuthology.orchestra.run.smithi099.stdout: "trash_purge_schedule": { 2024-02-21T23:12:55.729 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "trash_purge_schedule", 2024-02-21T23:12:55.729 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.730 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.730 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.730 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.730 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.730 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.730 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.730 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.730 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.731 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.731 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.731 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.731 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.731 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.731 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:55.731 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "restful", 2024-02-21T23:12:55.731 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:55.732 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:55.732 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:55.732 INFO:teuthology.orchestra.run.smithi099.stdout: "enable_auth": { 2024-02-21T23:12:55.732 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "enable_auth", 2024-02-21T23:12:55.732 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.732 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.732 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.732 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:55.733 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.733 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.733 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.733 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.733 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.733 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.733 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.733 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.733 INFO:teuthology.orchestra.run.smithi099.stdout: "key_file": { 2024-02-21T23:12:55.734 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "key_file", 2024-02-21T23:12:55.734 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.734 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.734 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.734 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.734 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.734 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.734 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.735 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.735 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.735 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.735 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.735 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.735 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:55.735 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:55.735 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.735 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.736 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.736 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.736 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.736 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.736 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.736 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.736 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.736 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.737 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.737 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.737 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.737 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.737 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.737 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.737 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.737 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.738 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.738 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:55.738 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:55.738 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.738 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.738 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.738 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.738 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.739 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.739 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.739 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.739 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.739 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.739 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.739 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.739 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:55.739 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:55.740 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.740 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.740 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.740 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:55.740 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.740 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.740 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.740 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.741 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.741 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.741 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.741 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.741 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.741 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.741 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.741 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.742 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.742 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.742 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.742 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:55.742 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:55.742 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.742 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.742 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.743 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.743 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.743 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.743 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.743 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.743 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.743 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.743 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.743 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.744 INFO:teuthology.orchestra.run.smithi099.stdout: "server_addr": { 2024-02-21T23:12:55.744 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "server_addr", 2024-02-21T23:12:55.744 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.744 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.744 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.744 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.744 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.744 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.745 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.745 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.745 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.745 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.745 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.745 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.745 INFO:teuthology.orchestra.run.smithi099.stdout: "server_port": { 2024-02-21T23:12:55.745 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "server_port", 2024-02-21T23:12:55.746 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.746 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.746 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.746 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.746 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.746 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.746 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.746 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.747 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.747 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.747 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.747 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.747 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.747 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.747 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:55.747 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "rgw", 2024-02-21T23:12:55.748 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:55.748 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:55.748 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:55.748 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:55.748 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:55.748 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.748 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.748 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.749 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.749 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.749 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.749 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.749 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.749 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.749 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.749 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.750 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.750 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.750 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.750 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.750 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.750 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.750 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.750 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.750 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:55.751 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:55.751 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.751 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.751 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.751 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.751 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.751 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.751 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.752 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.752 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.752 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.752 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.752 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.752 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:55.752 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:55.752 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.753 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.753 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.753 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:55.753 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.753 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.753 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.753 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.753 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.754 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.754 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.754 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.754 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.754 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.754 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.754 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.754 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.754 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.755 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.755 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:55.755 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:55.755 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.755 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.755 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.755 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.755 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.756 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.756 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.756 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.756 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.756 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.756 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.756 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.756 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.757 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.757 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:55.757 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "rook", 2024-02-21T23:12:55.757 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:55.757 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:55.757 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:55.757 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:55.757 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:55.757 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.758 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.758 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.758 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.758 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.758 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.758 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.758 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.758 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.759 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.759 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.759 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.759 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.759 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.759 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.759 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.759 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.760 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.760 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.760 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:55.760 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:55.760 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.760 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.760 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.760 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.761 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.761 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.761 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.761 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.761 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.761 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.761 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.761 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.762 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:55.762 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:55.762 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.762 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.762 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.762 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:55.762 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.762 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.762 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.763 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.763 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.763 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.763 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.763 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.763 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.763 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.763 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.764 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.764 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.764 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.764 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.764 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:55.764 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:55.764 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.764 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.765 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.765 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.765 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.765 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.765 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.765 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.765 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.765 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.766 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.766 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.766 INFO:teuthology.orchestra.run.smithi099.stdout: "storage_class": { 2024-02-21T23:12:55.766 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "storage_class", 2024-02-21T23:12:55.766 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.766 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.766 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.766 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "local", 2024-02-21T23:12:55.766 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.767 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.767 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.767 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-02-21T23:12:55.767 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.767 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.767 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.767 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.767 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.768 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.768 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:55.768 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "selftest", 2024-02-21T23:12:55.768 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:55.768 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:55.768 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:55.768 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:55.768 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:55.769 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.769 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.769 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.769 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.769 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.769 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.769 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.769 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.769 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.770 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.770 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.770 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.770 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.770 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.770 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.770 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.770 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.771 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.771 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.771 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:55.771 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:55.771 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.771 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.771 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.771 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.772 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.772 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.772 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.772 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.772 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.772 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.772 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.772 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.773 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:55.773 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:55.773 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.773 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.773 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.773 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:55.773 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.773 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.774 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.774 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.774 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.774 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.774 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.774 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.774 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.774 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.775 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.775 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.775 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.775 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.775 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.775 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:55.775 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:55.775 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.775 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.776 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.776 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.776 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.776 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.776 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.776 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.776 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.776 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.777 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.777 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.777 INFO:teuthology.orchestra.run.smithi099.stdout: "roption1": { 2024-02-21T23:12:55.777 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "roption1", 2024-02-21T23:12:55.777 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.777 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.777 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.777 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.778 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.778 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.778 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.778 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.778 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.778 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.778 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.778 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.779 INFO:teuthology.orchestra.run.smithi099.stdout: "roption2": { 2024-02-21T23:12:55.779 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "roption2", 2024-02-21T23:12:55.779 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.779 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.779 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.779 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "xyz", 2024-02-21T23:12:55.779 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.779 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.780 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.780 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.780 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.780 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.780 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.780 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.780 INFO:teuthology.orchestra.run.smithi099.stdout: "rwoption1": { 2024-02-21T23:12:55.780 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "rwoption1", 2024-02-21T23:12:55.781 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.781 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.781 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.781 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.781 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.781 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.781 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.781 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.782 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.782 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.782 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.782 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.782 INFO:teuthology.orchestra.run.smithi099.stdout: "rwoption2": { 2024-02-21T23:12:55.782 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "rwoption2", 2024-02-21T23:12:55.782 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:55.782 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.782 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.783 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.783 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.783 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.783 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.783 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.783 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.783 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.783 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.784 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.784 INFO:teuthology.orchestra.run.smithi099.stdout: "rwoption3": { 2024-02-21T23:12:55.784 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "rwoption3", 2024-02-21T23:12:55.784 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "float", 2024-02-21T23:12:55.784 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.784 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.784 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.784 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.785 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.785 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.785 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.785 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.785 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.785 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.785 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.785 INFO:teuthology.orchestra.run.smithi099.stdout: "rwoption4": { 2024-02-21T23:12:55.786 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "rwoption4", 2024-02-21T23:12:55.786 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.786 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.786 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.786 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.786 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.786 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.786 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.786 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.787 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.787 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.787 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.787 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.787 INFO:teuthology.orchestra.run.smithi099.stdout: "rwoption5": { 2024-02-21T23:12:55.787 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "rwoption5", 2024-02-21T23:12:55.787 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.787 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.788 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.788 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.788 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.788 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.788 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.788 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.788 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.788 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.789 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.789 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.789 INFO:teuthology.orchestra.run.smithi099.stdout: "rwoption6": { 2024-02-21T23:12:55.789 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "rwoption6", 2024-02-21T23:12:55.789 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.789 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.789 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.789 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:55.790 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.790 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.790 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.790 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.790 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.790 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.790 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.790 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.790 INFO:teuthology.orchestra.run.smithi099.stdout: "rwoption7": { 2024-02-21T23:12:55.791 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "rwoption7", 2024-02-21T23:12:55.791 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:55.791 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.791 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.791 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.791 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "1", 2024-02-21T23:12:55.791 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "42", 2024-02-21T23:12:55.791 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.792 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.792 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.792 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.792 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.792 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.792 INFO:teuthology.orchestra.run.smithi099.stdout: "testkey": { 2024-02-21T23:12:55.792 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "testkey", 2024-02-21T23:12:55.792 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.793 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.793 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.793 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.793 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.793 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.793 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.793 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.793 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.794 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.794 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.794 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.794 INFO:teuthology.orchestra.run.smithi099.stdout: "testlkey": { 2024-02-21T23:12:55.794 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "testlkey", 2024-02-21T23:12:55.794 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.794 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.794 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.795 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.795 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.795 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.795 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.795 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.795 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.795 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.795 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.796 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.796 INFO:teuthology.orchestra.run.smithi099.stdout: "testnewline": { 2024-02-21T23:12:55.796 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "testnewline", 2024-02-21T23:12:55.796 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.796 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.796 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.796 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.796 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.797 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.797 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.797 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.797 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.797 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.797 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.797 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.797 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.797 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.798 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:55.798 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "snap_schedule", 2024-02-21T23:12:55.798 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:55.798 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:55.798 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:55.798 INFO:teuthology.orchestra.run.smithi099.stdout: "allow_m_granularity": { 2024-02-21T23:12:55.798 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "allow_m_granularity", 2024-02-21T23:12:55.798 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.799 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.799 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.799 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.799 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.799 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.799 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.799 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "allow minute scheduled snapshots", 2024-02-21T23:12:55.799 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.800 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.800 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.800 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.800 INFO:teuthology.orchestra.run.smithi099.stdout: "dump_on_update": { 2024-02-21T23:12:55.800 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "dump_on_update", 2024-02-21T23:12:55.800 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.800 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.800 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.801 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.801 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.801 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.801 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.801 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "dump database to debug log on update", 2024-02-21T23:12:55.801 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.801 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.801 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.802 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.802 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:55.802 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:55.802 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.802 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.802 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.802 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.802 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.802 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.803 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.803 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.803 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.803 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.803 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.803 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.803 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.803 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.804 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.804 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.804 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.804 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.804 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.804 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:55.804 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:55.804 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.805 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.805 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.805 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.805 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.805 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.805 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.805 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.805 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.805 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.806 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.806 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.806 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:55.806 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:55.806 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.806 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.806 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.806 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:55.807 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.807 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.807 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.807 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.807 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.807 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.807 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.807 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.808 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.808 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.808 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.808 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.808 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.808 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.808 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.808 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:55.809 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:55.809 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.809 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.809 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.809 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.809 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.809 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.809 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.810 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.810 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.810 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.810 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.810 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.810 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.810 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.810 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:55.810 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "stats", 2024-02-21T23:12:55.811 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:55.811 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:55.811 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:55.811 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:55.811 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:55.811 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.811 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.811 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.812 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.812 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.812 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.812 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.812 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.812 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.812 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.812 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.813 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.813 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.813 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.813 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.813 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.813 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.813 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.813 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.814 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:55.814 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:55.814 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.814 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.814 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.814 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.814 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.814 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.814 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.815 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.815 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.815 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.815 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.815 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.815 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:55.815 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:55.815 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.816 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.816 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.816 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:55.816 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.816 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.816 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.816 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.816 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.817 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.817 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.817 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.817 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.817 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.817 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.817 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.817 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.818 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.818 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.818 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:55.818 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:55.818 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.818 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.818 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.818 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.818 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.819 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.819 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.819 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.819 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.819 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.819 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.819 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.819 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.820 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.820 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:55.820 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "status", 2024-02-21T23:12:55.820 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:55.820 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:55.820 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:55.820 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:55.820 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:55.821 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.821 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.821 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.821 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.821 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.821 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.821 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.821 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.822 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.822 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.822 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.822 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.822 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.822 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.822 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.822 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.822 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.823 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.823 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.823 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:55.823 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:55.823 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.823 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.823 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.823 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.824 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.824 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.824 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.824 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.824 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.824 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.824 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.824 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.825 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:55.825 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:55.825 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.825 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.825 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.825 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:55.825 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.825 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.826 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.826 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.826 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.826 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.826 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.826 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.826 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.826 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.826 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.827 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.827 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.827 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.827 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.827 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:55.827 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:55.827 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.827 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.828 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.828 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.828 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.828 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.828 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.828 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.828 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.828 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.829 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.829 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.829 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.829 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.829 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:55.829 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "telegraf", 2024-02-21T23:12:55.829 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:55.829 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:55.830 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:55.830 INFO:teuthology.orchestra.run.smithi099.stdout: "address": { 2024-02-21T23:12:55.830 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "address", 2024-02-21T23:12:55.830 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.830 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.830 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.830 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-02-21T23:12:55.830 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.831 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.831 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.831 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.831 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.831 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.831 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.831 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.831 INFO:teuthology.orchestra.run.smithi099.stdout: "interval": { 2024-02-21T23:12:55.831 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "interval", 2024-02-21T23:12:55.832 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-02-21T23:12:55.832 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.832 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.832 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "15", 2024-02-21T23:12:55.832 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.832 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.832 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.832 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.833 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.833 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.833 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.833 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.833 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:55.833 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:55.833 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.833 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.834 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.834 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.834 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.834 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.834 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.834 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.834 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.834 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.834 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.835 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.835 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.835 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.835 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.835 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.835 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.835 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.835 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.836 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:55.836 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:55.836 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.836 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.836 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.836 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.839 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.839 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.839 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.839 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.840 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.840 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.840 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.840 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.840 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:55.840 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:55.840 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.841 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.841 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.841 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:55.841 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.841 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.841 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.841 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.841 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.841 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.842 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.842 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.842 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.842 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.842 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.842 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.842 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.842 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.843 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.843 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:55.843 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:55.843 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.843 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.843 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.843 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.843 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.844 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.844 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.844 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.844 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.844 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.844 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.844 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.844 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.845 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.845 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:55.845 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "telemetry", 2024-02-21T23:12:55.845 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:55.845 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:55.845 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:55.845 INFO:teuthology.orchestra.run.smithi099.stdout: "channel_basic": { 2024-02-21T23:12:55.845 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "channel_basic", 2024-02-21T23:12:55.846 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.846 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.846 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.846 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:55.846 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.846 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.846 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.846 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Share basic cluster information (size, version)", 2024-02-21T23:12:55.847 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.847 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.847 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.847 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.847 INFO:teuthology.orchestra.run.smithi099.stdout: "channel_crash": { 2024-02-21T23:12:55.847 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "channel_crash", 2024-02-21T23:12:55.847 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.847 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.847 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.848 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:55.848 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.848 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.848 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.848 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-02-21T23:12:55.848 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.848 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.848 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.849 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.849 INFO:teuthology.orchestra.run.smithi099.stdout: "channel_device": { 2024-02-21T23:12:55.849 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "channel_device", 2024-02-21T23:12:55.849 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.849 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.849 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.849 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:55.849 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.850 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.850 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.850 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-02-21T23:12:55.850 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.850 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.850 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.850 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.850 INFO:teuthology.orchestra.run.smithi099.stdout: "channel_ident": { 2024-02-21T23:12:55.851 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "channel_ident", 2024-02-21T23:12:55.851 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.851 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.851 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.851 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.851 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.851 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.851 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.852 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-02-21T23:12:55.852 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.852 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.852 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.852 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.852 INFO:teuthology.orchestra.run.smithi099.stdout: "channel_perf": { 2024-02-21T23:12:55.852 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "channel_perf", 2024-02-21T23:12:55.852 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.853 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.853 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.853 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.853 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.853 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.853 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.853 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Share various performance metrics of a cluster", 2024-02-21T23:12:55.853 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.854 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.854 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.854 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.854 INFO:teuthology.orchestra.run.smithi099.stdout: "contact": { 2024-02-21T23:12:55.854 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "contact", 2024-02-21T23:12:55.854 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.854 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.854 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.854 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.855 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.855 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.855 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.855 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.855 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.855 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.855 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.855 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.856 INFO:teuthology.orchestra.run.smithi099.stdout: "description": { 2024-02-21T23:12:55.856 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "description", 2024-02-21T23:12:55.856 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.856 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.856 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.856 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.856 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.856 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.857 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.857 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.857 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.857 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.857 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.857 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.857 INFO:teuthology.orchestra.run.smithi099.stdout: "device_url": { 2024-02-21T23:12:55.857 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "device_url", 2024-02-21T23:12:55.858 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.858 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.858 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.858 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-02-21T23:12:55.858 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.858 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.858 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.858 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.859 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.859 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.859 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.859 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.859 INFO:teuthology.orchestra.run.smithi099.stdout: "enabled": { 2024-02-21T23:12:55.859 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "enabled", 2024-02-21T23:12:55.859 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.859 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.860 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.860 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.860 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.860 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.860 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.860 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.860 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.860 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.861 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.861 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.861 INFO:teuthology.orchestra.run.smithi099.stdout: "interval": { 2024-02-21T23:12:55.861 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "interval", 2024-02-21T23:12:55.861 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:55.861 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.861 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.861 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "24", 2024-02-21T23:12:55.861 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "8", 2024-02-21T23:12:55.862 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.862 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.862 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.862 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.862 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.862 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.862 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.862 INFO:teuthology.orchestra.run.smithi099.stdout: "last_opt_revision": { 2024-02-21T23:12:55.863 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "last_opt_revision", 2024-02-21T23:12:55.863 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:55.863 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.863 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.863 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "1", 2024-02-21T23:12:55.863 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.863 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.863 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.864 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.864 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.864 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.864 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.864 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.864 INFO:teuthology.orchestra.run.smithi099.stdout: "leaderboard": { 2024-02-21T23:12:55.864 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "leaderboard", 2024-02-21T23:12:55.864 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.865 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.865 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.865 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.865 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.865 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.865 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.865 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.865 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.865 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.866 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.866 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.866 INFO:teuthology.orchestra.run.smithi099.stdout: "leaderboard_description": { 2024-02-21T23:12:55.866 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "leaderboard_description", 2024-02-21T23:12:55.866 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.866 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.866 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.866 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.867 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.867 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.867 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.867 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.867 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.867 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.867 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.867 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.868 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:55.868 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:55.868 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.868 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.868 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.868 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.868 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.868 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.869 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.869 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.869 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.869 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.869 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.869 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.869 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.869 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.870 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.870 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.870 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.870 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.870 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.870 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:55.870 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:55.870 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.871 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.871 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.871 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.871 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.871 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.871 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.871 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.871 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.871 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.872 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.872 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.872 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:55.872 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:55.872 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.872 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.872 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.873 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:55.873 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.873 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.873 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.873 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.873 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.873 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.873 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.873 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.874 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.874 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.874 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.874 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.874 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.874 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.874 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.874 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:55.875 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:55.875 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.875 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.875 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.875 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.875 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.875 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.875 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.876 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.876 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.876 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.876 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.876 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.876 INFO:teuthology.orchestra.run.smithi099.stdout: "organization": { 2024-02-21T23:12:55.876 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "organization", 2024-02-21T23:12:55.876 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.877 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.877 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.877 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.877 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.877 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.877 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.877 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.877 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.878 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.878 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.878 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.878 INFO:teuthology.orchestra.run.smithi099.stdout: "proxy": { 2024-02-21T23:12:55.878 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "proxy", 2024-02-21T23:12:55.878 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.878 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.878 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.879 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.879 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.879 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.879 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.879 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.879 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.879 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.879 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.880 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.880 INFO:teuthology.orchestra.run.smithi099.stdout: "url": { 2024-02-21T23:12:55.880 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "url", 2024-02-21T23:12:55.880 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.880 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.880 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.880 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-02-21T23:12:55.880 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.881 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.881 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.881 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.881 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.881 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.881 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.881 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.881 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.881 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.882 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:55.882 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "test_orchestrator", 2024-02-21T23:12:55.882 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:55.882 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:55.882 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:55.882 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:55.882 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:55.883 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.883 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.883 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.883 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.883 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.883 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.883 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.883 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.884 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.884 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.884 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.884 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.884 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.884 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.884 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.884 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.885 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.885 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.885 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.885 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:55.885 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:55.885 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.885 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.885 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.886 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.886 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.886 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.886 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.886 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.886 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.886 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.886 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.886 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.887 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:55.887 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:55.887 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.887 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.887 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.887 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:55.887 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.887 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.888 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.888 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.888 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.888 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.888 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.888 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.888 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.888 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.889 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.889 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.889 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.889 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.889 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.889 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:55.889 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:55.889 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.890 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.890 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.890 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.890 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.890 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.890 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.890 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.890 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.890 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.891 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.891 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.891 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.891 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.891 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:55.891 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "volumes", 2024-02-21T23:12:55.891 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:55.891 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:55.892 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:55.892 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:55.892 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:55.892 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.892 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.892 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.892 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.892 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.893 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.893 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.893 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.893 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.893 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.893 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.893 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.893 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.894 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.894 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.894 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.894 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.894 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.894 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.894 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:55.894 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:55.895 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.895 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.895 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.895 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.895 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.895 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.895 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.895 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.896 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.896 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.896 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.896 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.896 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:55.896 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:55.896 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.896 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.897 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.897 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:55.897 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.897 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.897 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.897 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.897 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.897 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.898 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.898 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.898 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.898 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.898 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.898 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.898 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.898 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.899 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.899 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:55.899 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:55.899 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.899 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.899 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.899 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.899 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.900 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.900 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.900 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.900 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.900 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.900 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.900 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.901 INFO:teuthology.orchestra.run.smithi099.stdout: "max_concurrent_clones": { 2024-02-21T23:12:55.901 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "max_concurrent_clones", 2024-02-21T23:12:55.901 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:55.901 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.901 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.901 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "4", 2024-02-21T23:12:55.901 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.901 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.902 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.902 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Number of asynchronous cloner threads", 2024-02-21T23:12:55.902 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.902 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.902 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.902 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.902 INFO:teuthology.orchestra.run.smithi099.stdout: "periodic_async_work": { 2024-02-21T23:12:55.902 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "periodic_async_work", 2024-02-21T23:12:55.903 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.903 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.903 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.903 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.903 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.903 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.903 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.903 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Periodically check for async work", 2024-02-21T23:12:55.904 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.904 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.904 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.904 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.904 INFO:teuthology.orchestra.run.smithi099.stdout: "snapshot_clone_delay": { 2024-02-21T23:12:55.904 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "snapshot_clone_delay", 2024-02-21T23:12:55.904 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:55.904 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.905 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.905 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "0", 2024-02-21T23:12:55.905 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.905 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.905 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.905 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-02-21T23:12:55.905 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.905 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.905 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.906 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.906 INFO:teuthology.orchestra.run.smithi099.stdout: "snapshot_clone_no_wait": { 2024-02-21T23:12:55.906 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "snapshot_clone_no_wait", 2024-02-21T23:12:55.906 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.906 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.906 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.906 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "True", 2024-02-21T23:12:55.906 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.907 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.907 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.907 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-02-21T23:12:55.907 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.907 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.907 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.907 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.907 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.908 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.908 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:55.908 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "zabbix", 2024-02-21T23:12:55.908 INFO:teuthology.orchestra.run.smithi099.stdout: "can_run": true, 2024-02-21T23:12:55.908 INFO:teuthology.orchestra.run.smithi099.stdout: "error_string": "", 2024-02-21T23:12:55.908 INFO:teuthology.orchestra.run.smithi099.stdout: "module_options": { 2024-02-21T23:12:55.908 INFO:teuthology.orchestra.run.smithi099.stdout: "discovery_interval": { 2024-02-21T23:12:55.908 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "discovery_interval", 2024-02-21T23:12:55.909 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "uint", 2024-02-21T23:12:55.909 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.909 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.909 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "100", 2024-02-21T23:12:55.909 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.909 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.909 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.909 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.910 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.910 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.910 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.910 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.910 INFO:teuthology.orchestra.run.smithi099.stdout: "identifier": { 2024-02-21T23:12:55.910 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "identifier", 2024-02-21T23:12:55.910 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.910 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.911 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.911 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.911 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.911 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.911 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.911 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.911 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.911 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.911 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.912 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.912 INFO:teuthology.orchestra.run.smithi099.stdout: "interval": { 2024-02-21T23:12:55.912 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "interval", 2024-02-21T23:12:55.912 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "secs", 2024-02-21T23:12:55.912 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.912 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.912 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "60", 2024-02-21T23:12:55.912 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.913 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.913 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.913 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.913 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.913 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.913 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.913 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.913 INFO:teuthology.orchestra.run.smithi099.stdout: "log_level": { 2024-02-21T23:12:55.914 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_level", 2024-02-21T23:12:55.914 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.914 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.914 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.914 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.914 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.914 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.914 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.915 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.915 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.915 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.915 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.915 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.915 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.915 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.915 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.915 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.916 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.916 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.916 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.916 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster": { 2024-02-21T23:12:55.916 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster", 2024-02-21T23:12:55.916 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.916 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.916 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.917 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.917 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.917 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.917 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.917 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.917 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.917 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.917 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.918 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.918 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_cluster_level": { 2024-02-21T23:12:55.918 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_cluster_level", 2024-02-21T23:12:55.918 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.918 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.918 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.918 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "info", 2024-02-21T23:12:55.918 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.918 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.919 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [ 2024-02-21T23:12:55.919 INFO:teuthology.orchestra.run.smithi099.stdout: "", 2024-02-21T23:12:55.919 INFO:teuthology.orchestra.run.smithi099.stdout: "critical", 2024-02-21T23:12:55.919 INFO:teuthology.orchestra.run.smithi099.stdout: "debug", 2024-02-21T23:12:55.919 INFO:teuthology.orchestra.run.smithi099.stdout: "error", 2024-02-21T23:12:55.919 INFO:teuthology.orchestra.run.smithi099.stdout: "info", 2024-02-21T23:12:55.919 INFO:teuthology.orchestra.run.smithi099.stdout: "warning" 2024-02-21T23:12:55.919 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.920 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.920 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.920 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.920 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.920 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.920 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": { 2024-02-21T23:12:55.920 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "log_to_file", 2024-02-21T23:12:55.920 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "bool", 2024-02-21T23:12:55.921 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.921 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-02-21T23:12:55.921 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "False", 2024-02-21T23:12:55.921 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.921 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.921 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.921 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.921 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.922 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.922 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.922 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.922 INFO:teuthology.orchestra.run.smithi099.stdout: "zabbix_host": { 2024-02-21T23:12:55.922 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "zabbix_host", 2024-02-21T23:12:55.922 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.922 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.922 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.923 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "", 2024-02-21T23:12:55.923 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.923 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.923 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.923 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.923 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.923 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.923 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.923 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.924 INFO:teuthology.orchestra.run.smithi099.stdout: "zabbix_port": { 2024-02-21T23:12:55.924 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "zabbix_port", 2024-02-21T23:12:55.924 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "int", 2024-02-21T23:12:55.924 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.924 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.924 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "10051", 2024-02-21T23:12:55.924 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.924 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.925 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.925 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.925 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.925 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.925 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.925 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.925 INFO:teuthology.orchestra.run.smithi099.stdout: "zabbix_sender": { 2024-02-21T23:12:55.925 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "zabbix_sender", 2024-02-21T23:12:55.926 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "str", 2024-02-21T23:12:55.926 INFO:teuthology.orchestra.run.smithi099.stdout: "level": "advanced", 2024-02-21T23:12:55.926 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 0, 2024-02-21T23:12:55.926 INFO:teuthology.orchestra.run.smithi099.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-02-21T23:12:55.926 INFO:teuthology.orchestra.run.smithi099.stdout: "min": "", 2024-02-21T23:12:55.926 INFO:teuthology.orchestra.run.smithi099.stdout: "max": "", 2024-02-21T23:12:55.926 INFO:teuthology.orchestra.run.smithi099.stdout: "enum_allowed": [], 2024-02-21T23:12:55.926 INFO:teuthology.orchestra.run.smithi099.stdout: "desc": "", 2024-02-21T23:12:55.927 INFO:teuthology.orchestra.run.smithi099.stdout: "long_desc": "", 2024-02-21T23:12:55.927 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-02-21T23:12:55.927 INFO:teuthology.orchestra.run.smithi099.stdout: "see_also": [] 2024-02-21T23:12:55.927 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.927 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.927 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.927 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.927 INFO:teuthology.orchestra.run.smithi099.stdout: "services": {}, 2024-02-21T23:12:55.927 INFO:teuthology.orchestra.run.smithi099.stdout: "always_on_modules": { 2024-02-21T23:12:55.928 INFO:teuthology.orchestra.run.smithi099.stdout: "octopus": [ 2024-02-21T23:12:55.928 INFO:teuthology.orchestra.run.smithi099.stdout: "balancer", 2024-02-21T23:12:55.928 INFO:teuthology.orchestra.run.smithi099.stdout: "crash", 2024-02-21T23:12:55.928 INFO:teuthology.orchestra.run.smithi099.stdout: "devicehealth", 2024-02-21T23:12:55.928 INFO:teuthology.orchestra.run.smithi099.stdout: "orchestrator", 2024-02-21T23:12:55.928 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscaler", 2024-02-21T23:12:55.928 INFO:teuthology.orchestra.run.smithi099.stdout: "progress", 2024-02-21T23:12:55.928 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_support", 2024-02-21T23:12:55.929 INFO:teuthology.orchestra.run.smithi099.stdout: "status", 2024-02-21T23:12:55.929 INFO:teuthology.orchestra.run.smithi099.stdout: "telemetry", 2024-02-21T23:12:55.929 INFO:teuthology.orchestra.run.smithi099.stdout: "volumes" 2024-02-21T23:12:55.929 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.929 INFO:teuthology.orchestra.run.smithi099.stdout: "pacific": [ 2024-02-21T23:12:55.929 INFO:teuthology.orchestra.run.smithi099.stdout: "balancer", 2024-02-21T23:12:55.929 INFO:teuthology.orchestra.run.smithi099.stdout: "crash", 2024-02-21T23:12:55.929 INFO:teuthology.orchestra.run.smithi099.stdout: "devicehealth", 2024-02-21T23:12:55.930 INFO:teuthology.orchestra.run.smithi099.stdout: "orchestrator", 2024-02-21T23:12:55.930 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscaler", 2024-02-21T23:12:55.930 INFO:teuthology.orchestra.run.smithi099.stdout: "progress", 2024-02-21T23:12:55.930 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_support", 2024-02-21T23:12:55.930 INFO:teuthology.orchestra.run.smithi099.stdout: "status", 2024-02-21T23:12:55.930 INFO:teuthology.orchestra.run.smithi099.stdout: "telemetry", 2024-02-21T23:12:55.930 INFO:teuthology.orchestra.run.smithi099.stdout: "volumes" 2024-02-21T23:12:55.930 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.931 INFO:teuthology.orchestra.run.smithi099.stdout: "quincy": [ 2024-02-21T23:12:55.931 INFO:teuthology.orchestra.run.smithi099.stdout: "balancer", 2024-02-21T23:12:55.931 INFO:teuthology.orchestra.run.smithi099.stdout: "crash", 2024-02-21T23:12:55.931 INFO:teuthology.orchestra.run.smithi099.stdout: "devicehealth", 2024-02-21T23:12:55.931 INFO:teuthology.orchestra.run.smithi099.stdout: "orchestrator", 2024-02-21T23:12:55.931 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscaler", 2024-02-21T23:12:55.931 INFO:teuthology.orchestra.run.smithi099.stdout: "progress", 2024-02-21T23:12:55.931 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_support", 2024-02-21T23:12:55.931 INFO:teuthology.orchestra.run.smithi099.stdout: "status", 2024-02-21T23:12:55.932 INFO:teuthology.orchestra.run.smithi099.stdout: "telemetry", 2024-02-21T23:12:55.932 INFO:teuthology.orchestra.run.smithi099.stdout: "volumes" 2024-02-21T23:12:55.932 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.932 INFO:teuthology.orchestra.run.smithi099.stdout: "reef": [ 2024-02-21T23:12:55.932 INFO:teuthology.orchestra.run.smithi099.stdout: "balancer", 2024-02-21T23:12:55.932 INFO:teuthology.orchestra.run.smithi099.stdout: "crash", 2024-02-21T23:12:55.932 INFO:teuthology.orchestra.run.smithi099.stdout: "devicehealth", 2024-02-21T23:12:55.932 INFO:teuthology.orchestra.run.smithi099.stdout: "orchestrator", 2024-02-21T23:12:55.933 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscaler", 2024-02-21T23:12:55.933 INFO:teuthology.orchestra.run.smithi099.stdout: "progress", 2024-02-21T23:12:55.933 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_support", 2024-02-21T23:12:55.933 INFO:teuthology.orchestra.run.smithi099.stdout: "status", 2024-02-21T23:12:55.933 INFO:teuthology.orchestra.run.smithi099.stdout: "telemetry", 2024-02-21T23:12:55.933 INFO:teuthology.orchestra.run.smithi099.stdout: "volumes" 2024-02-21T23:12:55.933 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-02-21T23:12:55.933 INFO:teuthology.orchestra.run.smithi099.stdout: "squid": [ 2024-02-21T23:12:55.934 INFO:teuthology.orchestra.run.smithi099.stdout: "balancer", 2024-02-21T23:12:55.934 INFO:teuthology.orchestra.run.smithi099.stdout: "crash", 2024-02-21T23:12:55.934 INFO:teuthology.orchestra.run.smithi099.stdout: "devicehealth", 2024-02-21T23:12:55.934 INFO:teuthology.orchestra.run.smithi099.stdout: "orchestrator", 2024-02-21T23:12:55.934 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscaler", 2024-02-21T23:12:55.934 INFO:teuthology.orchestra.run.smithi099.stdout: "progress", 2024-02-21T23:12:55.934 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_support", 2024-02-21T23:12:55.934 INFO:teuthology.orchestra.run.smithi099.stdout: "status", 2024-02-21T23:12:55.934 INFO:teuthology.orchestra.run.smithi099.stdout: "telemetry", 2024-02-21T23:12:55.935 INFO:teuthology.orchestra.run.smithi099.stdout: "volumes" 2024-02-21T23:12:55.935 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-02-21T23:12:55.935 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.935 INFO:teuthology.orchestra.run.smithi099.stdout: "last_failure_osd_epoch": 32, 2024-02-21T23:12:55.935 INFO:teuthology.orchestra.run.smithi099.stdout: "active_clients": [ 2024-02-21T23:12:55.935 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:55.935 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "devicehealth", 2024-02-21T23:12:55.935 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-02-21T23:12:55.936 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:55.936 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-02-21T23:12:55.936 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.162:0", 2024-02-21T23:12:55.936 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1681849890 2024-02-21T23:12:55.936 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.936 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-02-21T23:12:55.936 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.936 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:55.937 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "libcephsqlite", 2024-02-21T23:12:55.937 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-02-21T23:12:55.937 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:55.937 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-02-21T23:12:55.937 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.162:0", 2024-02-21T23:12:55.937 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2534859150 2024-02-21T23:12:55.937 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.937 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-02-21T23:12:55.938 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.938 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:55.938 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "rbd_support", 2024-02-21T23:12:55.938 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-02-21T23:12:55.938 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:55.938 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-02-21T23:12:55.938 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.162:0", 2024-02-21T23:12:55.938 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1735356207 2024-02-21T23:12:55.938 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.939 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-02-21T23:12:55.939 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.939 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:55.939 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "snap_schedule", 2024-02-21T23:12:55.939 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-02-21T23:12:55.939 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:55.939 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-02-21T23:12:55.939 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.162:0", 2024-02-21T23:12:55.940 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1366235016 2024-02-21T23:12:55.940 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.940 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-02-21T23:12:55.940 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.940 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:55.940 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "snap_schedule", 2024-02-21T23:12:55.940 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-02-21T23:12:55.940 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:55.941 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-02-21T23:12:55.941 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.162:0", 2024-02-21T23:12:55.941 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1401331361 2024-02-21T23:12:55.941 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.941 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-02-21T23:12:55.941 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:55.941 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:55.941 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "volumes", 2024-02-21T23:12:55.942 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-02-21T23:12:55.942 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-02-21T23:12:55.942 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-02-21T23:12:55.942 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.162:0", 2024-02-21T23:12:55.942 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 529813500 2024-02-21T23:12:55.942 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.942 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-02-21T23:12:55.942 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:55.942 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-02-21T23:12:55.943 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-02-21T23:12:55.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.710+0000 7fa997800640 1 -- 172.21.15.99:0/1313421806 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa97009ef00 msgr2=0x7fa9700a13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:55.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.710+0000 7fa997800640 1 --2- 172.21.15.99:0/1313421806 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa97009ef00 0x7fa9700a13c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa97c034000 tx=0x7fa97c009030 comp rx=0 tx=0).stop 2024-02-21T23:12:55.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.711+0000 7fa997800640 1 -- 172.21.15.99:0/1313421806 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa978003810 msgr2=0x7fa9900fa160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:55.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.711+0000 7fa997800640 1 --2- 172.21.15.99:0/1313421806 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa978003810 0x7fa9900fa160 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fa984004a10 tx=0x7fa984004ed0 comp rx=0 tx=0).stop 2024-02-21T23:12:55.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.711+0000 7fa997800640 1 -- 172.21.15.99:0/1313421806 shutdown_connections 2024-02-21T23:12:55.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.711+0000 7fa997800640 1 --2- 172.21.15.99:0/1313421806 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa97009ef00 0x7fa9700a13c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:55.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.711+0000 7fa997800640 1 --2- 172.21.15.99:0/1313421806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa990176b20 0x7fa990176fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:55.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.711+0000 7fa997800640 1 --2- 172.21.15.99:0/1313421806 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa9900fbc40 0x7fa9901610a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:55.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.711+0000 7fa997800640 1 --2- 172.21.15.99:0/1313421806 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa978003810 0x7fa9900fa160 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:55.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.711+0000 7fa997800640 1 -- 172.21.15.99:0/1313421806 >> 172.21.15.99:0/1313421806 conn(0x7fa9900fe580 msgr2=0x7fa990186540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:55.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.711+0000 7fa997800640 1 -- 172.21.15.99:0/1313421806 shutdown_connections 2024-02-21T23:12:55.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:53.711+0000 7fa997800640 1 -- 172.21.15.99:0/1313421806 wait complete. 2024-02-21T23:12:55.952 DEBUG:tasks.check_counter:Getting stats from a 2024-02-21T23:12:55.952 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok perf dump 2024-02-21T23:12:56.165 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-02-21T23:12:56.166 INFO:teuthology.orchestra.run.smithi099.stdout: "AsyncMessenger::Worker-0": { 2024-02-21T23:12:56.166 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_messages": 6122, 2024-02-21T23:12:56.166 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_messages": 7856, 2024-02-21T23:12:56.166 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_bytes": 3313107, 2024-02-21T23:12:56.166 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_bytes": 9310411, 2024-02-21T23:12:56.166 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_created_connections": 45, 2024-02-21T23:12:56.167 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_active_connections": 9, 2024-02-21T23:12:56.167 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_total_time": 0.962937153, 2024-02-21T23:12:56.167 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_send_time": 0.551612024, 2024-02-21T23:12:56.167 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_recv_time": 0.583295478, 2024-02-21T23:12:56.167 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_fast_dispatch_time": 0.091164076, 2024-02-21T23:12:56.167 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_messages_queue_lat": { 2024-02-21T23:12:56.167 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 7851, 2024-02-21T23:12:56.167 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 1.752819583, 2024-02-21T23:12:56.168 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000223260 2024-02-21T23:12:56.168 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.168 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_handle_ack_lat": { 2024-02-21T23:12:56.168 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 3657, 2024-02-21T23:12:56.168 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.001361085, 2024-02-21T23:12:56.168 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000372 2024-02-21T23:12:56.168 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.168 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_encrypted_bytes": 1592256, 2024-02-21T23:12:56.169 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_encrypted_bytes": 155808 2024-02-21T23:12:56.169 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.169 INFO:teuthology.orchestra.run.smithi099.stdout: "AsyncMessenger::Worker-1": { 2024-02-21T23:12:56.169 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_messages": 3429, 2024-02-21T23:12:56.169 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_messages": 3365, 2024-02-21T23:12:56.169 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_bytes": 1788848, 2024-02-21T23:12:56.169 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_bytes": 1440125, 2024-02-21T23:12:56.169 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_created_connections": 15, 2024-02-21T23:12:56.170 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_active_connections": 5, 2024-02-21T23:12:56.170 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_total_time": 0.504462403, 2024-02-21T23:12:56.170 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_send_time": 0.253256941, 2024-02-21T23:12:56.170 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_recv_time": 0.180383950, 2024-02-21T23:12:56.170 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_fast_dispatch_time": 0.067362997, 2024-02-21T23:12:56.170 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_messages_queue_lat": { 2024-02-21T23:12:56.170 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 3367, 2024-02-21T23:12:56.170 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.525730279, 2024-02-21T23:12:56.171 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000156142 2024-02-21T23:12:56.171 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.171 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_handle_ack_lat": { 2024-02-21T23:12:56.171 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 2571, 2024-02-21T23:12:56.171 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000701285, 2024-02-21T23:12:56.171 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000272 2024-02-21T23:12:56.171 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.171 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_encrypted_bytes": 5152, 2024-02-21T23:12:56.172 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_encrypted_bytes": 79360 2024-02-21T23:12:56.172 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.172 INFO:teuthology.orchestra.run.smithi099.stdout: "AsyncMessenger::Worker-2": { 2024-02-21T23:12:56.172 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_messages": 4978, 2024-02-21T23:12:56.172 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_messages": 5109, 2024-02-21T23:12:56.172 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_bytes": 1327529, 2024-02-21T23:12:56.172 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_bytes": 2187013, 2024-02-21T23:12:56.172 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_created_connections": 12, 2024-02-21T23:12:56.173 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_active_connections": 6, 2024-02-21T23:12:56.173 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_total_time": 0.598056242, 2024-02-21T23:12:56.173 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_send_time": 0.259320774, 2024-02-21T23:12:56.173 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_recv_time": 0.116259008, 2024-02-21T23:12:56.173 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_fast_dispatch_time": 0.160326097, 2024-02-21T23:12:56.173 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_messages_queue_lat": { 2024-02-21T23:12:56.173 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 5107, 2024-02-21T23:12:56.173 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.991858673, 2024-02-21T23:12:56.174 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000194215 2024-02-21T23:12:56.174 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.174 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_handle_ack_lat": { 2024-02-21T23:12:56.174 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 4, 2024-02-21T23:12:56.174 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000572, 2024-02-21T23:12:56.175 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000143 2024-02-21T23:12:56.175 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.175 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_encrypted_bytes": 160, 2024-02-21T23:12:56.175 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_encrypted_bytes": 285184 2024-02-21T23:12:56.175 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.175 INFO:teuthology.orchestra.run.smithi099.stdout: "cct": { 2024-02-21T23:12:56.175 INFO:teuthology.orchestra.run.smithi099.stdout: "total_workers": 1, 2024-02-21T23:12:56.175 INFO:teuthology.orchestra.run.smithi099.stdout: "unhealthy_workers": 0 2024-02-21T23:12:56.176 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.176 INFO:teuthology.orchestra.run.smithi099.stdout: "finisher-MDSRank": { 2024-02-21T23:12:56.176 INFO:teuthology.orchestra.run.smithi099.stdout: "queue_len": 0, 2024-02-21T23:12:56.176 INFO:teuthology.orchestra.run.smithi099.stdout: "complete_latency": { 2024-02-21T23:12:56.176 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 5104, 2024-02-21T23:12:56.176 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 2.581722046, 2024-02-21T23:12:56.176 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000505823 2024-02-21T23:12:56.176 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:56.177 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.177 INFO:teuthology.orchestra.run.smithi099.stdout: "finisher-PurgeQueue": { 2024-02-21T23:12:56.177 INFO:teuthology.orchestra.run.smithi099.stdout: "queue_len": 0, 2024-02-21T23:12:56.177 INFO:teuthology.orchestra.run.smithi099.stdout: "complete_latency": { 2024-02-21T23:12:56.177 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 822, 2024-02-21T23:12:56.177 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.116553640, 2024-02-21T23:12:56.177 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000141792 2024-02-21T23:12:56.177 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:56.177 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.178 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": { 2024-02-21T23:12:56.178 INFO:teuthology.orchestra.run.smithi099.stdout: "request": 2130, 2024-02-21T23:12:56.178 INFO:teuthology.orchestra.run.smithi099.stdout: "reply": 2125, 2024-02-21T23:12:56.178 INFO:teuthology.orchestra.run.smithi099.stdout: "reply_latency": { 2024-02-21T23:12:56.178 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 2125, 2024-02-21T23:12:56.178 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 1.627515769, 2024-02-21T23:12:56.178 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000765889 2024-02-21T23:12:56.178 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.179 INFO:teuthology.orchestra.run.smithi099.stdout: "slow_reply": 0, 2024-02-21T23:12:56.179 INFO:teuthology.orchestra.run.smithi099.stdout: "forward": 5, 2024-02-21T23:12:56.179 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_fetch_complete": 0, 2024-02-21T23:12:56.179 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_fetch_keys": 0, 2024-02-21T23:12:56.179 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_commit": 11, 2024-02-21T23:12:56.179 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_split": 0, 2024-02-21T23:12:56.179 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_merge": 0, 2024-02-21T23:12:56.179 INFO:teuthology.orchestra.run.smithi099.stdout: "inodes": 1102, 2024-02-21T23:12:56.179 INFO:teuthology.orchestra.run.smithi099.stdout: "inodes_top": 4, 2024-02-21T23:12:56.180 INFO:teuthology.orchestra.run.smithi099.stdout: "inodes_bottom": 1098, 2024-02-21T23:12:56.180 INFO:teuthology.orchestra.run.smithi099.stdout: "inodes_pin_tail": 0, 2024-02-21T23:12:56.180 INFO:teuthology.orchestra.run.smithi099.stdout: "inodes_pinned": 1096, 2024-02-21T23:12:56.180 INFO:teuthology.orchestra.run.smithi099.stdout: "inodes_expired": 1, 2024-02-21T23:12:56.180 INFO:teuthology.orchestra.run.smithi099.stdout: "inodes_with_caps": 43, 2024-02-21T23:12:56.180 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": 43, 2024-02-21T23:12:56.180 INFO:teuthology.orchestra.run.smithi099.stdout: "subtrees": 21, 2024-02-21T23:12:56.180 INFO:teuthology.orchestra.run.smithi099.stdout: "traverse": 3464, 2024-02-21T23:12:56.181 INFO:teuthology.orchestra.run.smithi099.stdout: "traverse_hit": 3363, 2024-02-21T23:12:56.181 INFO:teuthology.orchestra.run.smithi099.stdout: "traverse_forward": 2, 2024-02-21T23:12:56.181 INFO:teuthology.orchestra.run.smithi099.stdout: "traverse_discover": 21, 2024-02-21T23:12:56.181 INFO:teuthology.orchestra.run.smithi099.stdout: "traverse_dir_fetch": 0, 2024-02-21T23:12:56.181 INFO:teuthology.orchestra.run.smithi099.stdout: "traverse_remote_ino": 0, 2024-02-21T23:12:56.181 INFO:teuthology.orchestra.run.smithi099.stdout: "traverse_lock": 0, 2024-02-21T23:12:56.181 INFO:teuthology.orchestra.run.smithi099.stdout: "load_cent": 0, 2024-02-21T23:12:56.181 INFO:teuthology.orchestra.run.smithi099.stdout: "q": 0, 2024-02-21T23:12:56.182 INFO:teuthology.orchestra.run.smithi099.stdout: "exported": 0, 2024-02-21T23:12:56.182 INFO:teuthology.orchestra.run.smithi099.stdout: "exported_inodes": 0, 2024-02-21T23:12:56.182 INFO:teuthology.orchestra.run.smithi099.stdout: "imported": 19, 2024-02-21T23:12:56.182 INFO:teuthology.orchestra.run.smithi099.stdout: "imported_inodes": 813, 2024-02-21T23:12:56.182 INFO:teuthology.orchestra.run.smithi099.stdout: "openino_dir_fetch": 0, 2024-02-21T23:12:56.182 INFO:teuthology.orchestra.run.smithi099.stdout: "openino_backtrace_fetch": 8280, 2024-02-21T23:12:56.182 INFO:teuthology.orchestra.run.smithi099.stdout: "openino_peer_discover": 1, 2024-02-21T23:12:56.182 INFO:teuthology.orchestra.run.smithi099.stdout: "root_rfiles": 3452, 2024-02-21T23:12:56.183 INFO:teuthology.orchestra.run.smithi099.stdout: "root_rbytes": 26460394, 2024-02-21T23:12:56.183 INFO:teuthology.orchestra.run.smithi099.stdout: "root_rsnaps": 6, 2024-02-21T23:12:56.183 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_backtrace_fetch": 8280, 2024-02-21T23:12:56.183 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_set_tag": 0, 2024-02-21T23:12:56.183 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_backtrace_repaired": 0, 2024-02-21T23:12:56.183 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_inotable_repaired": 0, 2024-02-21T23:12:56.183 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_dir_inodes": 0, 2024-02-21T23:12:56.183 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_dir_base_inodes": 0, 2024-02-21T23:12:56.183 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_dirfrag_rstats": 0, 2024-02-21T23:12:56.184 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_file_inodes": 8280, 2024-02-21T23:12:56.184 INFO:teuthology.orchestra.run.smithi099.stdout: "handle_inode_file_caps": 0, 2024-02-21T23:12:56.184 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_cap_op_revoke": 6, 2024-02-21T23:12:56.184 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_cap_op_grant": 870, 2024-02-21T23:12:56.184 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_cap_op_trunc": 0, 2024-02-21T23:12:56.184 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-02-21T23:12:56.184 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_cap_op_flush_ack": 0, 2024-02-21T23:12:56.185 INFO:teuthology.orchestra.run.smithi099.stdout: "handle_client_caps": 1125, 2024-02-21T23:12:56.185 INFO:teuthology.orchestra.run.smithi099.stdout: "handle_client_caps_dirty": 314, 2024-02-21T23:12:56.185 INFO:teuthology.orchestra.run.smithi099.stdout: "handle_client_cap_release": 13, 2024-02-21T23:12:56.185 INFO:teuthology.orchestra.run.smithi099.stdout: "process_request_cap_release": 1118 2024-02-21T23:12:56.185 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.185 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_cache": { 2024-02-21T23:12:56.185 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_update": 0, 2024-02-21T23:12:56.185 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_update_receipt": 0, 2024-02-21T23:12:56.185 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_try_discover": 0, 2024-02-21T23:12:56.186 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_send_discover": 15, 2024-02-21T23:12:56.186 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_handle_discover": 0, 2024-02-21T23:12:56.186 INFO:teuthology.orchestra.run.smithi099.stdout: "num_strays": 0, 2024-02-21T23:12:56.186 INFO:teuthology.orchestra.run.smithi099.stdout: "num_strays_delayed": 0, 2024-02-21T23:12:56.186 INFO:teuthology.orchestra.run.smithi099.stdout: "num_strays_enqueuing": 0, 2024-02-21T23:12:56.186 INFO:teuthology.orchestra.run.smithi099.stdout: "strays_created": 557, 2024-02-21T23:12:56.186 INFO:teuthology.orchestra.run.smithi099.stdout: "strays_enqueued": 557, 2024-02-21T23:12:56.186 INFO:teuthology.orchestra.run.smithi099.stdout: "strays_reintegrated": 0, 2024-02-21T23:12:56.187 INFO:teuthology.orchestra.run.smithi099.stdout: "strays_migrated": 0, 2024-02-21T23:12:56.187 INFO:teuthology.orchestra.run.smithi099.stdout: "num_recovering_processing": 0, 2024-02-21T23:12:56.187 INFO:teuthology.orchestra.run.smithi099.stdout: "num_recovering_enqueued": 0, 2024-02-21T23:12:56.187 INFO:teuthology.orchestra.run.smithi099.stdout: "num_recovering_prioritized": 0, 2024-02-21T23:12:56.187 INFO:teuthology.orchestra.run.smithi099.stdout: "recovery_started": 0, 2024-02-21T23:12:56.187 INFO:teuthology.orchestra.run.smithi099.stdout: "recovery_completed": 0, 2024-02-21T23:12:56.187 INFO:teuthology.orchestra.run.smithi099.stdout: "ireq_enqueue_scrub": 0, 2024-02-21T23:12:56.187 INFO:teuthology.orchestra.run.smithi099.stdout: "ireq_exportdir": 0, 2024-02-21T23:12:56.188 INFO:teuthology.orchestra.run.smithi099.stdout: "ireq_flush": 0, 2024-02-21T23:12:56.188 INFO:teuthology.orchestra.run.smithi099.stdout: "ireq_fragmentdir": 0, 2024-02-21T23:12:56.188 INFO:teuthology.orchestra.run.smithi099.stdout: "ireq_fragstats": 0, 2024-02-21T23:12:56.188 INFO:teuthology.orchestra.run.smithi099.stdout: "ireq_inodestats": 0 2024-02-21T23:12:56.188 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.188 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_log": { 2024-02-21T23:12:56.188 INFO:teuthology.orchestra.run.smithi099.stdout: "evlrg": 0, 2024-02-21T23:12:56.188 INFO:teuthology.orchestra.run.smithi099.stdout: "evadd": 2934, 2024-02-21T23:12:56.188 INFO:teuthology.orchestra.run.smithi099.stdout: "evex": 0, 2024-02-21T23:12:56.189 INFO:teuthology.orchestra.run.smithi099.stdout: "evtrm": 0, 2024-02-21T23:12:56.189 INFO:teuthology.orchestra.run.smithi099.stdout: "ev": 2934, 2024-02-21T23:12:56.189 INFO:teuthology.orchestra.run.smithi099.stdout: "evexg": 0, 2024-02-21T23:12:56.189 INFO:teuthology.orchestra.run.smithi099.stdout: "evexd": 0, 2024-02-21T23:12:56.189 INFO:teuthology.orchestra.run.smithi099.stdout: "segadd": 5, 2024-02-21T23:12:56.189 INFO:teuthology.orchestra.run.smithi099.stdout: "segex": 0, 2024-02-21T23:12:56.189 INFO:teuthology.orchestra.run.smithi099.stdout: "segtrm": 0, 2024-02-21T23:12:56.189 INFO:teuthology.orchestra.run.smithi099.stdout: "seg": 5, 2024-02-21T23:12:56.190 INFO:teuthology.orchestra.run.smithi099.stdout: "segmjr": 2, 2024-02-21T23:12:56.190 INFO:teuthology.orchestra.run.smithi099.stdout: "segexg": 0, 2024-02-21T23:12:56.190 INFO:teuthology.orchestra.run.smithi099.stdout: "segexd": 0, 2024-02-21T23:12:56.190 INFO:teuthology.orchestra.run.smithi099.stdout: "expos": 4194304, 2024-02-21T23:12:56.190 INFO:teuthology.orchestra.run.smithi099.stdout: "wrpos": 9892219, 2024-02-21T23:12:56.190 INFO:teuthology.orchestra.run.smithi099.stdout: "rdpos": 0, 2024-02-21T23:12:56.190 INFO:teuthology.orchestra.run.smithi099.stdout: "jlat": { 2024-02-21T23:12:56.190 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 45, 2024-02-21T23:12:56.190 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.229939054, 2024-02-21T23:12:56.191 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.005109756 2024-02-21T23:12:56.191 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.191 INFO:teuthology.orchestra.run.smithi099.stdout: "replayed": 0 2024-02-21T23:12:56.191 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.191 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_mem": { 2024-02-21T23:12:56.191 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 839, 2024-02-21T23:12:56.191 INFO:teuthology.orchestra.run.smithi099.stdout: "ino+": 1396, 2024-02-21T23:12:56.191 INFO:teuthology.orchestra.run.smithi099.stdout: "ino-": 557, 2024-02-21T23:12:56.192 INFO:teuthology.orchestra.run.smithi099.stdout: "dir": 44, 2024-02-21T23:12:56.192 INFO:teuthology.orchestra.run.smithi099.stdout: "dir+": 45, 2024-02-21T23:12:56.192 INFO:teuthology.orchestra.run.smithi099.stdout: "dir-": 1, 2024-02-21T23:12:56.192 INFO:teuthology.orchestra.run.smithi099.stdout: "dn": 1102, 2024-02-21T23:12:56.192 INFO:teuthology.orchestra.run.smithi099.stdout: "dn+": 1662, 2024-02-21T23:12:56.192 INFO:teuthology.orchestra.run.smithi099.stdout: "dn-": 560, 2024-02-21T23:12:56.192 INFO:teuthology.orchestra.run.smithi099.stdout: "cap": 43, 2024-02-21T23:12:56.192 INFO:teuthology.orchestra.run.smithi099.stdout: "cap+": 1156, 2024-02-21T23:12:56.193 INFO:teuthology.orchestra.run.smithi099.stdout: "cap-": 1113, 2024-02-21T23:12:56.193 INFO:teuthology.orchestra.run.smithi099.stdout: "rss": 68876, 2024-02-21T23:12:56.193 INFO:teuthology.orchestra.run.smithi099.stdout: "heap": 223588 2024-02-21T23:12:56.193 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.193 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_server": { 2024-02-21T23:12:56.193 INFO:teuthology.orchestra.run.smithi099.stdout: "dispatch_client_request": 2241, 2024-02-21T23:12:56.193 INFO:teuthology.orchestra.run.smithi099.stdout: "dispatch_server_request": 2, 2024-02-21T23:12:56.193 INFO:teuthology.orchestra.run.smithi099.stdout: "handle_client_request": 2130, 2024-02-21T23:12:56.193 INFO:teuthology.orchestra.run.smithi099.stdout: "handle_client_session": 28, 2024-02-21T23:12:56.194 INFO:teuthology.orchestra.run.smithi099.stdout: "handle_peer_request": 12, 2024-02-21T23:12:56.194 INFO:teuthology.orchestra.run.smithi099.stdout: "req_create_latency": { 2024-02-21T23:12:56.194 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 301, 2024-02-21T23:12:56.194 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.219342015, 2024-02-21T23:12:56.194 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000728711 2024-02-21T23:12:56.194 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.194 INFO:teuthology.orchestra.run.smithi099.stdout: "req_getattr_latency": { 2024-02-21T23:12:56.194 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 3, 2024-02-21T23:12:56.195 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000850955, 2024-02-21T23:12:56.195 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000283651 2024-02-21T23:12:56.195 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.195 INFO:teuthology.orchestra.run.smithi099.stdout: "req_getfilelock_latency": { 2024-02-21T23:12:56.195 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.195 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.195 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.195 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.196 INFO:teuthology.orchestra.run.smithi099.stdout: "req_link_latency": { 2024-02-21T23:12:56.196 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.196 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.196 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.196 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.196 INFO:teuthology.orchestra.run.smithi099.stdout: "req_lookup_latency": { 2024-02-21T23:12:56.196 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 1260, 2024-02-21T23:12:56.196 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.642849481, 2024-02-21T23:12:56.196 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000510198 2024-02-21T23:12:56.197 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.197 INFO:teuthology.orchestra.run.smithi099.stdout: "req_lookuphash_latency": { 2024-02-21T23:12:56.197 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.197 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.197 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.197 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.197 INFO:teuthology.orchestra.run.smithi099.stdout: "req_lookupino_latency": { 2024-02-21T23:12:56.197 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.198 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.198 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.198 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.198 INFO:teuthology.orchestra.run.smithi099.stdout: "req_lookupname_latency": { 2024-02-21T23:12:56.198 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.198 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.198 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.198 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.198 INFO:teuthology.orchestra.run.smithi099.stdout: "req_lookupparent_latency": { 2024-02-21T23:12:56.199 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.199 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.199 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.199 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.199 INFO:teuthology.orchestra.run.smithi099.stdout: "req_lookupsnap_latency": { 2024-02-21T23:12:56.199 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.199 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.199 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.200 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.200 INFO:teuthology.orchestra.run.smithi099.stdout: "req_lssnap_latency": { 2024-02-21T23:12:56.200 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.200 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.200 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.200 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.200 INFO:teuthology.orchestra.run.smithi099.stdout: "req_mkdir_latency": { 2024-02-21T23:12:56.200 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.201 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.201 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.201 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.201 INFO:teuthology.orchestra.run.smithi099.stdout: "req_mknod_latency": { 2024-02-21T23:12:56.201 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.201 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.201 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.201 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.202 INFO:teuthology.orchestra.run.smithi099.stdout: "req_mksnap_latency": { 2024-02-21T23:12:56.202 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.202 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.202 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.202 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.202 INFO:teuthology.orchestra.run.smithi099.stdout: "req_open_latency": { 2024-02-21T23:12:56.202 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 3, 2024-02-21T23:12:56.202 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000650701, 2024-02-21T23:12:56.202 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000216900 2024-02-21T23:12:56.203 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.203 INFO:teuthology.orchestra.run.smithi099.stdout: "req_readdir_latency": { 2024-02-21T23:12:56.203 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 1, 2024-02-21T23:12:56.203 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.001162629, 2024-02-21T23:12:56.203 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.001162629 2024-02-21T23:12:56.203 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.203 INFO:teuthology.orchestra.run.smithi099.stdout: "req_rename_latency": { 2024-02-21T23:12:56.203 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.204 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.204 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.204 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.204 INFO:teuthology.orchestra.run.smithi099.stdout: "req_renamesnap_latency": { 2024-02-21T23:12:56.204 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.204 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.204 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.204 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.205 INFO:teuthology.orchestra.run.smithi099.stdout: "req_snapdiff_latency": { 2024-02-21T23:12:56.205 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.205 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.205 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.205 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.205 INFO:teuthology.orchestra.run.smithi099.stdout: "req_rmdir_latency": { 2024-02-21T23:12:56.205 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.205 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.205 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.206 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.206 INFO:teuthology.orchestra.run.smithi099.stdout: "req_rmsnap_latency": { 2024-02-21T23:12:56.206 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.206 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.206 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.206 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.206 INFO:teuthology.orchestra.run.smithi099.stdout: "req_rmxattr_latency": { 2024-02-21T23:12:56.206 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.207 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.207 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.207 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.207 INFO:teuthology.orchestra.run.smithi099.stdout: "req_setattr_latency": { 2024-02-21T23:12:56.207 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.207 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.207 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.207 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.207 INFO:teuthology.orchestra.run.smithi099.stdout: "req_setdirlayout_latency": { 2024-02-21T23:12:56.208 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.208 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.208 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.208 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.208 INFO:teuthology.orchestra.run.smithi099.stdout: "req_setfilelock_latency": { 2024-02-21T23:12:56.208 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.208 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.208 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.209 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.209 INFO:teuthology.orchestra.run.smithi099.stdout: "req_setlayout_latency": { 2024-02-21T23:12:56.209 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.209 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.209 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.209 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.209 INFO:teuthology.orchestra.run.smithi099.stdout: "req_setxattr_latency": { 2024-02-21T23:12:56.209 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.210 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.210 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.210 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.210 INFO:teuthology.orchestra.run.smithi099.stdout: "req_symlink_latency": { 2024-02-21T23:12:56.210 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.210 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.210 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.210 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.211 INFO:teuthology.orchestra.run.smithi099.stdout: "req_unlink_latency": { 2024-02-21T23:12:56.211 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 557, 2024-02-21T23:12:56.211 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.762659988, 2024-02-21T23:12:56.211 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.001369227 2024-02-21T23:12:56.211 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.211 INFO:teuthology.orchestra.run.smithi099.stdout: "cap_revoke_eviction": 0, 2024-02-21T23:12:56.211 INFO:teuthology.orchestra.run.smithi099.stdout: "cap_acquisition_throttle": 0, 2024-02-21T23:12:56.211 INFO:teuthology.orchestra.run.smithi099.stdout: "req_getvxattr_latency": { 2024-02-21T23:12:56.211 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.212 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.212 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.212 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:56.212 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.212 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_sessions": { 2024-02-21T23:12:56.212 INFO:teuthology.orchestra.run.smithi099.stdout: "session_count": 2, 2024-02-21T23:12:56.212 INFO:teuthology.orchestra.run.smithi099.stdout: "session_add": 5, 2024-02-21T23:12:56.212 INFO:teuthology.orchestra.run.smithi099.stdout: "session_remove": 3, 2024-02-21T23:12:56.213 INFO:teuthology.orchestra.run.smithi099.stdout: "sessions_open": 2, 2024-02-21T23:12:56.213 INFO:teuthology.orchestra.run.smithi099.stdout: "sessions_stale": 0, 2024-02-21T23:12:56.213 INFO:teuthology.orchestra.run.smithi099.stdout: "total_load": 1289, 2024-02-21T23:12:56.213 INFO:teuthology.orchestra.run.smithi099.stdout: "average_load": 644, 2024-02-21T23:12:56.213 INFO:teuthology.orchestra.run.smithi099.stdout: "avg_session_uptime": 613, 2024-02-21T23:12:56.213 INFO:teuthology.orchestra.run.smithi099.stdout: "mdthresh_evicted": 0 2024-02-21T23:12:56.213 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.213 INFO:teuthology.orchestra.run.smithi099.stdout: "mempool": { 2024-02-21T23:12:56.214 INFO:teuthology.orchestra.run.smithi099.stdout: "bloom_filter_bytes": 0, 2024-02-21T23:12:56.214 INFO:teuthology.orchestra.run.smithi099.stdout: "bloom_filter_items": 0, 2024-02-21T23:12:56.214 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_alloc_bytes": 0, 2024-02-21T23:12:56.214 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_alloc_items": 0, 2024-02-21T23:12:56.214 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_data_bytes": 0, 2024-02-21T23:12:56.214 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_data_items": 0, 2024-02-21T23:12:56.214 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_onode_bytes": 0, 2024-02-21T23:12:56.214 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_onode_items": 0, 2024-02-21T23:12:56.215 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_meta_bytes": 0, 2024-02-21T23:12:56.215 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_meta_items": 0, 2024-02-21T23:12:56.215 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_other_bytes": 0, 2024-02-21T23:12:56.215 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_other_items": 0, 2024-02-21T23:12:56.215 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_buffer_bytes": 0, 2024-02-21T23:12:56.215 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_buffer_items": 0, 2024-02-21T23:12:56.215 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_extent_bytes": 0, 2024-02-21T23:12:56.215 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_extent_items": 0, 2024-02-21T23:12:56.215 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_blob_bytes": 0, 2024-02-21T23:12:56.216 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_blob_items": 0, 2024-02-21T23:12:56.216 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_shared_blob_bytes": 0, 2024-02-21T23:12:56.216 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_shared_blob_items": 0, 2024-02-21T23:12:56.216 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_inline_bl_bytes": 0, 2024-02-21T23:12:56.216 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_inline_bl_items": 0, 2024-02-21T23:12:56.216 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_fsck_bytes": 0, 2024-02-21T23:12:56.216 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_fsck_items": 0, 2024-02-21T23:12:56.216 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_txc_bytes": 0, 2024-02-21T23:12:56.217 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_txc_items": 0, 2024-02-21T23:12:56.217 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_writing_deferred_bytes": 0, 2024-02-21T23:12:56.217 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_writing_deferred_items": 0, 2024-02-21T23:12:56.217 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_writing_bytes": 0, 2024-02-21T23:12:56.217 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_writing_items": 0, 2024-02-21T23:12:56.217 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_bytes": 0, 2024-02-21T23:12:56.217 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_items": 0, 2024-02-21T23:12:56.217 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_file_reader_bytes": 0, 2024-02-21T23:12:56.218 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_file_reader_items": 0, 2024-02-21T23:12:56.218 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_file_writer_bytes": 0, 2024-02-21T23:12:56.218 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_file_writer_items": 0, 2024-02-21T23:12:56.218 INFO:teuthology.orchestra.run.smithi099.stdout: "buffer_anon_bytes": 316059, 2024-02-21T23:12:56.218 INFO:teuthology.orchestra.run.smithi099.stdout: "buffer_anon_items": 953, 2024-02-21T23:12:56.218 INFO:teuthology.orchestra.run.smithi099.stdout: "buffer_meta_bytes": 880, 2024-02-21T23:12:56.218 INFO:teuthology.orchestra.run.smithi099.stdout: "buffer_meta_items": 10, 2024-02-21T23:12:56.218 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_bytes": 0, 2024-02-21T23:12:56.218 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_items": 0, 2024-02-21T23:12:56.219 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_mapbl_bytes": 0, 2024-02-21T23:12:56.219 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_mapbl_items": 0, 2024-02-21T23:12:56.219 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_pglog_bytes": 0, 2024-02-21T23:12:56.219 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_pglog_items": 0, 2024-02-21T23:12:56.219 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_bytes": 8136, 2024-02-21T23:12:56.219 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_items": 153, 2024-02-21T23:12:56.219 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_mapping_bytes": 0, 2024-02-21T23:12:56.219 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_mapping_items": 0, 2024-02-21T23:12:56.220 INFO:teuthology.orchestra.run.smithi099.stdout: "pgmap_bytes": 0, 2024-02-21T23:12:56.220 INFO:teuthology.orchestra.run.smithi099.stdout: "pgmap_items": 0, 2024-02-21T23:12:56.220 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_co_bytes": 2845211, 2024-02-21T23:12:56.220 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_co_items": 36299, 2024-02-21T23:12:56.220 INFO:teuthology.orchestra.run.smithi099.stdout: "unittest_1_bytes": 0, 2024-02-21T23:12:56.220 INFO:teuthology.orchestra.run.smithi099.stdout: "unittest_1_items": 0, 2024-02-21T23:12:56.220 INFO:teuthology.orchestra.run.smithi099.stdout: "unittest_2_bytes": 0, 2024-02-21T23:12:56.220 INFO:teuthology.orchestra.run.smithi099.stdout: "unittest_2_items": 0 2024-02-21T23:12:56.221 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.221 INFO:teuthology.orchestra.run.smithi099.stdout: "objecter": { 2024-02-21T23:12:56.221 INFO:teuthology.orchestra.run.smithi099.stdout: "op_active": 0, 2024-02-21T23:12:56.221 INFO:teuthology.orchestra.run.smithi099.stdout: "op_laggy": 0, 2024-02-21T23:12:56.221 INFO:teuthology.orchestra.run.smithi099.stdout: "op_send": 9520, 2024-02-21T23:12:56.221 INFO:teuthology.orchestra.run.smithi099.stdout: "op_send_bytes": 5958105, 2024-02-21T23:12:56.221 INFO:teuthology.orchestra.run.smithi099.stdout: "op_resend": 27, 2024-02-21T23:12:56.221 INFO:teuthology.orchestra.run.smithi099.stdout: "op_reply": 9520, 2024-02-21T23:12:56.222 INFO:teuthology.orchestra.run.smithi099.stdout: "op_latency": { 2024-02-21T23:12:56.222 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 9520, 2024-02-21T23:12:56.222 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 16.213624567, 2024-02-21T23:12:56.222 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.001703111 2024-02-21T23:12:56.222 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.222 INFO:teuthology.orchestra.run.smithi099.stdout: "op_inflight": 0, 2024-02-21T23:12:56.222 INFO:teuthology.orchestra.run.smithi099.stdout: "oplen_avg": { 2024-02-21T23:12:56.222 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 9520, 2024-02-21T23:12:56.222 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 9562 2024-02-21T23:12:56.223 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.223 INFO:teuthology.orchestra.run.smithi099.stdout: "op": 9520, 2024-02-21T23:12:56.223 INFO:teuthology.orchestra.run.smithi099.stdout: "op_r": 8286, 2024-02-21T23:12:56.223 INFO:teuthology.orchestra.run.smithi099.stdout: "op_w": 1234, 2024-02-21T23:12:56.223 INFO:teuthology.orchestra.run.smithi099.stdout: "op_rmw": 0, 2024-02-21T23:12:56.223 INFO:teuthology.orchestra.run.smithi099.stdout: "op_pg": 0, 2024-02-21T23:12:56.223 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_stat": 0, 2024-02-21T23:12:56.223 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_create": 10, 2024-02-21T23:12:56.224 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_read": 6, 2024-02-21T23:12:56.224 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_write": 51, 2024-02-21T23:12:56.224 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_writefull": 13, 2024-02-21T23:12:56.224 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_writesame": 0, 2024-02-21T23:12:56.224 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_append": 0, 2024-02-21T23:12:56.224 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_zero": 0, 2024-02-21T23:12:56.224 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_truncate": 0, 2024-02-21T23:12:56.224 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_delete": 1127, 2024-02-21T23:12:56.225 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_mapext": 0, 2024-02-21T23:12:56.225 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_sparse_read": 0, 2024-02-21T23:12:56.225 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_clonerange": 0, 2024-02-21T23:12:56.225 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_getxattr": 8280, 2024-02-21T23:12:56.225 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_setxattr": 20, 2024-02-21T23:12:56.225 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_cmpxattr": 0, 2024-02-21T23:12:56.225 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_rmxattr": 0, 2024-02-21T23:12:56.225 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_resetxattrs": 0, 2024-02-21T23:12:56.225 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_call": 0, 2024-02-21T23:12:56.226 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_watch": 0, 2024-02-21T23:12:56.226 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_notify": 0, 2024-02-21T23:12:56.226 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_src_cmpxattr": 0, 2024-02-21T23:12:56.226 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_pgls": 0, 2024-02-21T23:12:56.226 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_pgls_filter": 0, 2024-02-21T23:12:56.226 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_other": 0, 2024-02-21T23:12:56.226 INFO:teuthology.orchestra.run.smithi099.stdout: "linger_active": 0, 2024-02-21T23:12:56.226 INFO:teuthology.orchestra.run.smithi099.stdout: "linger_send": 0, 2024-02-21T23:12:56.227 INFO:teuthology.orchestra.run.smithi099.stdout: "linger_resend": 0, 2024-02-21T23:12:56.227 INFO:teuthology.orchestra.run.smithi099.stdout: "linger_ping": 0, 2024-02-21T23:12:56.227 INFO:teuthology.orchestra.run.smithi099.stdout: "poolop_active": 0, 2024-02-21T23:12:56.227 INFO:teuthology.orchestra.run.smithi099.stdout: "poolop_send": 0, 2024-02-21T23:12:56.227 INFO:teuthology.orchestra.run.smithi099.stdout: "poolop_resend": 0, 2024-02-21T23:12:56.227 INFO:teuthology.orchestra.run.smithi099.stdout: "poolstat_active": 0, 2024-02-21T23:12:56.227 INFO:teuthology.orchestra.run.smithi099.stdout: "poolstat_send": 0, 2024-02-21T23:12:56.227 INFO:teuthology.orchestra.run.smithi099.stdout: "poolstat_resend": 0, 2024-02-21T23:12:56.227 INFO:teuthology.orchestra.run.smithi099.stdout: "statfs_active": 0, 2024-02-21T23:12:56.228 INFO:teuthology.orchestra.run.smithi099.stdout: "statfs_send": 0, 2024-02-21T23:12:56.228 INFO:teuthology.orchestra.run.smithi099.stdout: "statfs_resend": 0, 2024-02-21T23:12:56.228 INFO:teuthology.orchestra.run.smithi099.stdout: "command_active": 0, 2024-02-21T23:12:56.228 INFO:teuthology.orchestra.run.smithi099.stdout: "command_send": 0, 2024-02-21T23:12:56.228 INFO:teuthology.orchestra.run.smithi099.stdout: "command_resend": 0, 2024-02-21T23:12:56.228 INFO:teuthology.orchestra.run.smithi099.stdout: "map_epoch": 40, 2024-02-21T23:12:56.228 INFO:teuthology.orchestra.run.smithi099.stdout: "map_full": 0, 2024-02-21T23:12:56.228 INFO:teuthology.orchestra.run.smithi099.stdout: "map_inc": 11, 2024-02-21T23:12:56.229 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_sessions": 12, 2024-02-21T23:12:56.229 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_session_open": 12, 2024-02-21T23:12:56.229 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_session_close": 0, 2024-02-21T23:12:56.229 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_laggy": 0, 2024-02-21T23:12:56.229 INFO:teuthology.orchestra.run.smithi099.stdout: "omap_wr": 47, 2024-02-21T23:12:56.229 INFO:teuthology.orchestra.run.smithi099.stdout: "omap_rd": 0, 2024-02-21T23:12:56.229 INFO:teuthology.orchestra.run.smithi099.stdout: "omap_del": 8 2024-02-21T23:12:56.229 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.230 INFO:teuthology.orchestra.run.smithi099.stdout: "oft": { 2024-02-21T23:12:56.230 INFO:teuthology.orchestra.run.smithi099.stdout: "omap_total_objs": 1, 2024-02-21T23:12:56.230 INFO:teuthology.orchestra.run.smithi099.stdout: "omap_total_kv_pairs": 0, 2024-02-21T23:12:56.230 INFO:teuthology.orchestra.run.smithi099.stdout: "omap_total_updates": 0, 2024-02-21T23:12:56.230 INFO:teuthology.orchestra.run.smithi099.stdout: "omap_total_removes": 0 2024-02-21T23:12:56.230 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.230 INFO:teuthology.orchestra.run.smithi099.stdout: "osd-slow-ops": { 2024-02-21T23:12:56.230 INFO:teuthology.orchestra.run.smithi099.stdout: "slow_ops_count": 0 2024-02-21T23:12:56.231 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.231 INFO:teuthology.orchestra.run.smithi099.stdout: "purge_queue": { 2024-02-21T23:12:56.231 INFO:teuthology.orchestra.run.smithi099.stdout: "pq_executing_ops": 0, 2024-02-21T23:12:56.231 INFO:teuthology.orchestra.run.smithi099.stdout: "pq_executing_ops_high_water": 16, 2024-02-21T23:12:56.231 INFO:teuthology.orchestra.run.smithi099.stdout: "pq_executing": 0, 2024-02-21T23:12:56.231 INFO:teuthology.orchestra.run.smithi099.stdout: "pq_executing_high_water": 8, 2024-02-21T23:12:56.232 INFO:teuthology.orchestra.run.smithi099.stdout: "pq_executed_ops": 1114, 2024-02-21T23:12:56.232 INFO:teuthology.orchestra.run.smithi099.stdout: "pq_executed": 557, 2024-02-21T23:12:56.232 INFO:teuthology.orchestra.run.smithi099.stdout: "pq_item_in_journal": 0 2024-02-21T23:12:56.232 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.232 INFO:teuthology.orchestra.run.smithi099.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-02-21T23:12:56.232 INFO:teuthology.orchestra.run.smithi099.stdout: "val": 0, 2024-02-21T23:12:56.232 INFO:teuthology.orchestra.run.smithi099.stdout: "max": 104857600, 2024-02-21T23:12:56.232 INFO:teuthology.orchestra.run.smithi099.stdout: "get_started": 0, 2024-02-21T23:12:56.233 INFO:teuthology.orchestra.run.smithi099.stdout: "get": 14525, 2024-02-21T23:12:56.233 INFO:teuthology.orchestra.run.smithi099.stdout: "get_sum": 5157419, 2024-02-21T23:12:56.233 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_fail": 0, 2024-02-21T23:12:56.233 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_success": 14525, 2024-02-21T23:12:56.233 INFO:teuthology.orchestra.run.smithi099.stdout: "take": 0, 2024-02-21T23:12:56.233 INFO:teuthology.orchestra.run.smithi099.stdout: "take_sum": 0, 2024-02-21T23:12:56.233 INFO:teuthology.orchestra.run.smithi099.stdout: "put": 14525, 2024-02-21T23:12:56.233 INFO:teuthology.orchestra.run.smithi099.stdout: "put_sum": 5157419, 2024-02-21T23:12:56.233 INFO:teuthology.orchestra.run.smithi099.stdout: "wait": { 2024-02-21T23:12:56.234 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.234 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.234 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.234 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:56.234 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.234 INFO:teuthology.orchestra.run.smithi099.stdout: "throttle-objecter_bytes": { 2024-02-21T23:12:56.234 INFO:teuthology.orchestra.run.smithi099.stdout: "val": 0, 2024-02-21T23:12:56.234 INFO:teuthology.orchestra.run.smithi099.stdout: "max": 104857600, 2024-02-21T23:12:56.235 INFO:teuthology.orchestra.run.smithi099.stdout: "get_started": 0, 2024-02-21T23:12:56.235 INFO:teuthology.orchestra.run.smithi099.stdout: "get": 0, 2024-02-21T23:12:56.235 INFO:teuthology.orchestra.run.smithi099.stdout: "get_sum": 0, 2024-02-21T23:12:56.235 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_fail": 0, 2024-02-21T23:12:56.235 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_success": 0, 2024-02-21T23:12:56.235 INFO:teuthology.orchestra.run.smithi099.stdout: "take": 9520, 2024-02-21T23:12:56.235 INFO:teuthology.orchestra.run.smithi099.stdout: "take_sum": 6020842, 2024-02-21T23:12:56.235 INFO:teuthology.orchestra.run.smithi099.stdout: "put": 9520, 2024-02-21T23:12:56.236 INFO:teuthology.orchestra.run.smithi099.stdout: "put_sum": 6020842, 2024-02-21T23:12:56.236 INFO:teuthology.orchestra.run.smithi099.stdout: "wait": { 2024-02-21T23:12:56.236 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.236 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.236 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.236 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:56.236 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.236 INFO:teuthology.orchestra.run.smithi099.stdout: "throttle-objecter_ops": { 2024-02-21T23:12:56.237 INFO:teuthology.orchestra.run.smithi099.stdout: "val": 0, 2024-02-21T23:12:56.237 INFO:teuthology.orchestra.run.smithi099.stdout: "max": 1024, 2024-02-21T23:12:56.237 INFO:teuthology.orchestra.run.smithi099.stdout: "get_started": 0, 2024-02-21T23:12:56.237 INFO:teuthology.orchestra.run.smithi099.stdout: "get": 0, 2024-02-21T23:12:56.237 INFO:teuthology.orchestra.run.smithi099.stdout: "get_sum": 0, 2024-02-21T23:12:56.237 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_fail": 0, 2024-02-21T23:12:56.237 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_success": 0, 2024-02-21T23:12:56.237 INFO:teuthology.orchestra.run.smithi099.stdout: "take": 9520, 2024-02-21T23:12:56.238 INFO:teuthology.orchestra.run.smithi099.stdout: "take_sum": 9520, 2024-02-21T23:12:56.238 INFO:teuthology.orchestra.run.smithi099.stdout: "put": 9520, 2024-02-21T23:12:56.238 INFO:teuthology.orchestra.run.smithi099.stdout: "put_sum": 9520, 2024-02-21T23:12:56.238 INFO:teuthology.orchestra.run.smithi099.stdout: "wait": { 2024-02-21T23:12:56.238 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.238 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.238 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.238 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:56.238 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.239 INFO:teuthology.orchestra.run.smithi099.stdout: "throttle-write_buf_throttle": { 2024-02-21T23:12:56.239 INFO:teuthology.orchestra.run.smithi099.stdout: "val": 0, 2024-02-21T23:12:56.239 INFO:teuthology.orchestra.run.smithi099.stdout: "max": 3758096384, 2024-02-21T23:12:56.239 INFO:teuthology.orchestra.run.smithi099.stdout: "get_started": 0, 2024-02-21T23:12:56.239 INFO:teuthology.orchestra.run.smithi099.stdout: "get": 557, 2024-02-21T23:12:56.239 INFO:teuthology.orchestra.run.smithi099.stdout: "get_sum": 62737, 2024-02-21T23:12:56.239 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_fail": 0, 2024-02-21T23:12:56.239 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_success": 557, 2024-02-21T23:12:56.240 INFO:teuthology.orchestra.run.smithi099.stdout: "take": 0, 2024-02-21T23:12:56.240 INFO:teuthology.orchestra.run.smithi099.stdout: "take_sum": 0, 2024-02-21T23:12:56.240 INFO:teuthology.orchestra.run.smithi099.stdout: "put": 6, 2024-02-21T23:12:56.240 INFO:teuthology.orchestra.run.smithi099.stdout: "put_sum": 62737, 2024-02-21T23:12:56.240 INFO:teuthology.orchestra.run.smithi099.stdout: "wait": { 2024-02-21T23:12:56.240 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.240 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.240 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.241 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:56.241 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.241 INFO:teuthology.orchestra.run.smithi099.stdout: "throttle-write_buf_throttle-0x5580bd4ca6e0": { 2024-02-21T23:12:56.241 INFO:teuthology.orchestra.run.smithi099.stdout: "val": 0, 2024-02-21T23:12:56.241 INFO:teuthology.orchestra.run.smithi099.stdout: "max": 3758096384, 2024-02-21T23:12:56.241 INFO:teuthology.orchestra.run.smithi099.stdout: "get_started": 0, 2024-02-21T23:12:56.241 INFO:teuthology.orchestra.run.smithi099.stdout: "get": 2934, 2024-02-21T23:12:56.241 INFO:teuthology.orchestra.run.smithi099.stdout: "get_sum": 5697915, 2024-02-21T23:12:56.241 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_fail": 0, 2024-02-21T23:12:56.242 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_success": 2934, 2024-02-21T23:12:56.242 INFO:teuthology.orchestra.run.smithi099.stdout: "take": 0, 2024-02-21T23:12:56.242 INFO:teuthology.orchestra.run.smithi099.stdout: "take_sum": 0, 2024-02-21T23:12:56.242 INFO:teuthology.orchestra.run.smithi099.stdout: "put": 45, 2024-02-21T23:12:56.242 INFO:teuthology.orchestra.run.smithi099.stdout: "put_sum": 5697915, 2024-02-21T23:12:56.242 INFO:teuthology.orchestra.run.smithi099.stdout: "wait": { 2024-02-21T23:12:56.242 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.242 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.243 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.243 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:56.243 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:56.243 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-02-21T23:12:56.247 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2024-02-21T23:12:56.248 INFO:tasks.check_counter:Daemon mds.a mds.imported=19 2024-02-21T23:12:56.248 INFO:tasks.check_counter:Daemon mds.a mds.root_rsnaps=6 2024-02-21T23:12:56.248 INFO:tasks.check_counter:Daemon mds.a mds_server.req_mksnap_latency.avgcount=0 2024-02-21T23:12:56.248 INFO:tasks.check_counter:Daemon mds.a mds_server.req_rmsnap_latency.avgcount=0 2024-02-21T23:12:56.248 INFO:tasks.check_counter:Daemon mds.a mds.dir_split=0 2024-02-21T23:12:56.248 DEBUG:tasks.check_counter:Getting stats from d 2024-02-21T23:12:56.248 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok perf dump 2024-02-21T23:12:56.484 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-02-21T23:12:56.484 INFO:teuthology.orchestra.run.smithi099.stdout: "AsyncMessenger::Worker-0": { 2024-02-21T23:12:56.484 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_messages": 490, 2024-02-21T23:12:56.484 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_messages": 551, 2024-02-21T23:12:56.484 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_bytes": 144732, 2024-02-21T23:12:56.485 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_bytes": 112358, 2024-02-21T23:12:56.485 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_created_connections": 8, 2024-02-21T23:12:56.485 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_active_connections": 2, 2024-02-21T23:12:56.485 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_total_time": 0.120726435, 2024-02-21T23:12:56.485 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_send_time": 0.064763593, 2024-02-21T23:12:56.485 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_recv_time": 0.045598165, 2024-02-21T23:12:56.485 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_fast_dispatch_time": 0.004572583, 2024-02-21T23:12:56.485 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_messages_queue_lat": { 2024-02-21T23:12:56.486 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 554, 2024-02-21T23:12:56.486 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.072379900, 2024-02-21T23:12:56.486 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000130649 2024-02-21T23:12:56.486 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.486 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_handle_ack_lat": { 2024-02-21T23:12:56.486 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 978, 2024-02-21T23:12:56.486 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000295423, 2024-02-21T23:12:56.486 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000302 2024-02-21T23:12:56.487 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.487 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_encrypted_bytes": 0, 2024-02-21T23:12:56.487 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_encrypted_bytes": 0 2024-02-21T23:12:56.487 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.487 INFO:teuthology.orchestra.run.smithi099.stdout: "AsyncMessenger::Worker-1": { 2024-02-21T23:12:56.487 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_messages": 269, 2024-02-21T23:12:56.487 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_messages": 253, 2024-02-21T23:12:56.487 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_bytes": 1583313, 2024-02-21T23:12:56.487 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_bytes": 200289, 2024-02-21T23:12:56.488 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_created_connections": 11, 2024-02-21T23:12:56.488 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_active_connections": 4, 2024-02-21T23:12:56.488 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_total_time": 0.074600911, 2024-02-21T23:12:56.488 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_send_time": 0.017414428, 2024-02-21T23:12:56.488 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_recv_time": 0.067168873, 2024-02-21T23:12:56.488 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_fast_dispatch_time": 0.007509142, 2024-02-21T23:12:56.488 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_messages_queue_lat": { 2024-02-21T23:12:56.488 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 252, 2024-02-21T23:12:56.489 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.034335040, 2024-02-21T23:12:56.489 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000136250 2024-02-21T23:12:56.489 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.489 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_handle_ack_lat": { 2024-02-21T23:12:56.489 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 6, 2024-02-21T23:12:56.489 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000950, 2024-02-21T23:12:56.489 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000158 2024-02-21T23:12:56.489 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.490 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_encrypted_bytes": 1578656, 2024-02-21T23:12:56.490 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_encrypted_bytes": 122608 2024-02-21T23:12:56.490 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.490 INFO:teuthology.orchestra.run.smithi099.stdout: "AsyncMessenger::Worker-2": { 2024-02-21T23:12:56.490 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_messages": 51, 2024-02-21T23:12:56.490 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_messages": 201, 2024-02-21T23:12:56.490 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_bytes": 9413, 2024-02-21T23:12:56.490 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_bytes": 753130, 2024-02-21T23:12:56.491 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_created_connections": 45, 2024-02-21T23:12:56.491 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_active_connections": 6, 2024-02-21T23:12:56.491 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_total_time": 0.047058852, 2024-02-21T23:12:56.491 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_send_time": 0.013286994, 2024-02-21T23:12:56.491 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_recv_time": 0.027411957, 2024-02-21T23:12:56.491 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_fast_dispatch_time": 0.000153230, 2024-02-21T23:12:56.491 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_messages_queue_lat": { 2024-02-21T23:12:56.491 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 195, 2024-02-21T23:12:56.492 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.064998530, 2024-02-21T23:12:56.492 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000333325 2024-02-21T23:12:56.492 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.492 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_handle_ack_lat": { 2024-02-21T23:12:56.492 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 44, 2024-02-21T23:12:56.493 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000007089, 2024-02-21T23:12:56.493 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000161 2024-02-21T23:12:56.493 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.493 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_encrypted_bytes": 2816, 2024-02-21T23:12:56.493 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_encrypted_bytes": 356848 2024-02-21T23:12:56.493 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.494 INFO:teuthology.orchestra.run.smithi099.stdout: "cct": { 2024-02-21T23:12:56.494 INFO:teuthology.orchestra.run.smithi099.stdout: "total_workers": 1, 2024-02-21T23:12:56.494 INFO:teuthology.orchestra.run.smithi099.stdout: "unhealthy_workers": 0 2024-02-21T23:12:56.494 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.494 INFO:teuthology.orchestra.run.smithi099.stdout: "finisher-MDSRank": { 2024-02-21T23:12:56.494 INFO:teuthology.orchestra.run.smithi099.stdout: "queue_len": 0, 2024-02-21T23:12:56.494 INFO:teuthology.orchestra.run.smithi099.stdout: "complete_latency": { 2024-02-21T23:12:56.494 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 29, 2024-02-21T23:12:56.495 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.002155481, 2024-02-21T23:12:56.495 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000074326 2024-02-21T23:12:56.495 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:56.495 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.495 INFO:teuthology.orchestra.run.smithi099.stdout: "finisher-PurgeQueue": { 2024-02-21T23:12:56.495 INFO:teuthology.orchestra.run.smithi099.stdout: "queue_len": 0, 2024-02-21T23:12:56.496 INFO:teuthology.orchestra.run.smithi099.stdout: "complete_latency": { 2024-02-21T23:12:56.496 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 2, 2024-02-21T23:12:56.496 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000018812, 2024-02-21T23:12:56.496 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000009406 2024-02-21T23:12:56.496 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:56.496 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.496 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": { 2024-02-21T23:12:56.497 INFO:teuthology.orchestra.run.smithi099.stdout: "request": 0, 2024-02-21T23:12:56.497 INFO:teuthology.orchestra.run.smithi099.stdout: "reply": 0, 2024-02-21T23:12:56.497 INFO:teuthology.orchestra.run.smithi099.stdout: "reply_latency": { 2024-02-21T23:12:56.497 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.497 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.497 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.497 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.497 INFO:teuthology.orchestra.run.smithi099.stdout: "slow_reply": 0, 2024-02-21T23:12:56.497 INFO:teuthology.orchestra.run.smithi099.stdout: "forward": 0, 2024-02-21T23:12:56.498 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_fetch_complete": 0, 2024-02-21T23:12:56.498 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_fetch_keys": 0, 2024-02-21T23:12:56.498 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_commit": 11, 2024-02-21T23:12:56.498 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_split": 0, 2024-02-21T23:12:56.498 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_merge": 0, 2024-02-21T23:12:56.499 INFO:teuthology.orchestra.run.smithi099.stdout: "inodes": 17, 2024-02-21T23:12:56.499 INFO:teuthology.orchestra.run.smithi099.stdout: "inodes_top": 0, 2024-02-21T23:12:56.499 INFO:teuthology.orchestra.run.smithi099.stdout: "inodes_bottom": 17, 2024-02-21T23:12:56.499 INFO:teuthology.orchestra.run.smithi099.stdout: "inodes_pin_tail": 0, 2024-02-21T23:12:56.499 INFO:teuthology.orchestra.run.smithi099.stdout: "inodes_pinned": 16, 2024-02-21T23:12:56.499 INFO:teuthology.orchestra.run.smithi099.stdout: "inodes_expired": 0, 2024-02-21T23:12:56.499 INFO:teuthology.orchestra.run.smithi099.stdout: "inodes_with_caps": 0, 2024-02-21T23:12:56.499 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": 0, 2024-02-21T23:12:56.500 INFO:teuthology.orchestra.run.smithi099.stdout: "subtrees": 2, 2024-02-21T23:12:56.500 INFO:teuthology.orchestra.run.smithi099.stdout: "traverse": 2, 2024-02-21T23:12:56.500 INFO:teuthology.orchestra.run.smithi099.stdout: "traverse_hit": 1, 2024-02-21T23:12:56.500 INFO:teuthology.orchestra.run.smithi099.stdout: "traverse_forward": 0, 2024-02-21T23:12:56.500 INFO:teuthology.orchestra.run.smithi099.stdout: "traverse_discover": 1, 2024-02-21T23:12:56.500 INFO:teuthology.orchestra.run.smithi099.stdout: "traverse_dir_fetch": 0, 2024-02-21T23:12:56.500 INFO:teuthology.orchestra.run.smithi099.stdout: "traverse_remote_ino": 0, 2024-02-21T23:12:56.500 INFO:teuthology.orchestra.run.smithi099.stdout: "traverse_lock": 0, 2024-02-21T23:12:56.501 INFO:teuthology.orchestra.run.smithi099.stdout: "load_cent": 0, 2024-02-21T23:12:56.501 INFO:teuthology.orchestra.run.smithi099.stdout: "q": 0, 2024-02-21T23:12:56.501 INFO:teuthology.orchestra.run.smithi099.stdout: "exported": 0, 2024-02-21T23:12:56.501 INFO:teuthology.orchestra.run.smithi099.stdout: "exported_inodes": 0, 2024-02-21T23:12:56.501 INFO:teuthology.orchestra.run.smithi099.stdout: "imported": 0, 2024-02-21T23:12:56.501 INFO:teuthology.orchestra.run.smithi099.stdout: "imported_inodes": 0, 2024-02-21T23:12:56.501 INFO:teuthology.orchestra.run.smithi099.stdout: "openino_dir_fetch": 0, 2024-02-21T23:12:56.502 INFO:teuthology.orchestra.run.smithi099.stdout: "openino_backtrace_fetch": 0, 2024-02-21T23:12:56.502 INFO:teuthology.orchestra.run.smithi099.stdout: "openino_peer_discover": 0, 2024-02-21T23:12:56.502 INFO:teuthology.orchestra.run.smithi099.stdout: "root_rfiles": 3452, 2024-02-21T23:12:56.502 INFO:teuthology.orchestra.run.smithi099.stdout: "root_rbytes": 26460394, 2024-02-21T23:12:56.502 INFO:teuthology.orchestra.run.smithi099.stdout: "root_rsnaps": 6, 2024-02-21T23:12:56.502 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_backtrace_fetch": 0, 2024-02-21T23:12:56.502 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_set_tag": 0, 2024-02-21T23:12:56.502 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_backtrace_repaired": 0, 2024-02-21T23:12:56.503 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_inotable_repaired": 0, 2024-02-21T23:12:56.503 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_dir_inodes": 0, 2024-02-21T23:12:56.503 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_dir_base_inodes": 0, 2024-02-21T23:12:56.503 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_dirfrag_rstats": 0, 2024-02-21T23:12:56.503 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_file_inodes": 0, 2024-02-21T23:12:56.503 INFO:teuthology.orchestra.run.smithi099.stdout: "handle_inode_file_caps": 0, 2024-02-21T23:12:56.503 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_cap_op_revoke": 0, 2024-02-21T23:12:56.503 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_cap_op_grant": 0, 2024-02-21T23:12:56.504 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_cap_op_trunc": 0, 2024-02-21T23:12:56.504 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-02-21T23:12:56.504 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_cap_op_flush_ack": 0, 2024-02-21T23:12:56.504 INFO:teuthology.orchestra.run.smithi099.stdout: "handle_client_caps": 0, 2024-02-21T23:12:56.504 INFO:teuthology.orchestra.run.smithi099.stdout: "handle_client_caps_dirty": 0, 2024-02-21T23:12:56.504 INFO:teuthology.orchestra.run.smithi099.stdout: "handle_client_cap_release": 0, 2024-02-21T23:12:56.505 INFO:teuthology.orchestra.run.smithi099.stdout: "process_request_cap_release": 0 2024-02-21T23:12:56.505 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.505 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_cache": { 2024-02-21T23:12:56.505 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_update": 0, 2024-02-21T23:12:56.505 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_update_receipt": 3, 2024-02-21T23:12:56.505 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_try_discover": 2, 2024-02-21T23:12:56.505 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_send_discover": 3, 2024-02-21T23:12:56.505 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_handle_discover": 0, 2024-02-21T23:12:56.506 INFO:teuthology.orchestra.run.smithi099.stdout: "num_strays": 0, 2024-02-21T23:12:56.506 INFO:teuthology.orchestra.run.smithi099.stdout: "num_strays_delayed": 0, 2024-02-21T23:12:56.506 INFO:teuthology.orchestra.run.smithi099.stdout: "num_strays_enqueuing": 0, 2024-02-21T23:12:56.506 INFO:teuthology.orchestra.run.smithi099.stdout: "strays_created": 0, 2024-02-21T23:12:56.506 INFO:teuthology.orchestra.run.smithi099.stdout: "strays_enqueued": 0, 2024-02-21T23:12:56.506 INFO:teuthology.orchestra.run.smithi099.stdout: "strays_reintegrated": 0, 2024-02-21T23:12:56.506 INFO:teuthology.orchestra.run.smithi099.stdout: "strays_migrated": 0, 2024-02-21T23:12:56.506 INFO:teuthology.orchestra.run.smithi099.stdout: "num_recovering_processing": 0, 2024-02-21T23:12:56.507 INFO:teuthology.orchestra.run.smithi099.stdout: "num_recovering_enqueued": 0, 2024-02-21T23:12:56.507 INFO:teuthology.orchestra.run.smithi099.stdout: "num_recovering_prioritized": 0, 2024-02-21T23:12:56.507 INFO:teuthology.orchestra.run.smithi099.stdout: "recovery_started": 0, 2024-02-21T23:12:56.507 INFO:teuthology.orchestra.run.smithi099.stdout: "recovery_completed": 0, 2024-02-21T23:12:56.507 INFO:teuthology.orchestra.run.smithi099.stdout: "ireq_enqueue_scrub": 0, 2024-02-21T23:12:56.507 INFO:teuthology.orchestra.run.smithi099.stdout: "ireq_exportdir": 0, 2024-02-21T23:12:56.507 INFO:teuthology.orchestra.run.smithi099.stdout: "ireq_flush": 0, 2024-02-21T23:12:56.507 INFO:teuthology.orchestra.run.smithi099.stdout: "ireq_fragmentdir": 0, 2024-02-21T23:12:56.507 INFO:teuthology.orchestra.run.smithi099.stdout: "ireq_fragstats": 0, 2024-02-21T23:12:56.508 INFO:teuthology.orchestra.run.smithi099.stdout: "ireq_inodestats": 0 2024-02-21T23:12:56.508 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.508 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_log": { 2024-02-21T23:12:56.508 INFO:teuthology.orchestra.run.smithi099.stdout: "evlrg": 0, 2024-02-21T23:12:56.508 INFO:teuthology.orchestra.run.smithi099.stdout: "evadd": 4, 2024-02-21T23:12:56.508 INFO:teuthology.orchestra.run.smithi099.stdout: "evex": 0, 2024-02-21T23:12:56.508 INFO:teuthology.orchestra.run.smithi099.stdout: "evtrm": 0, 2024-02-21T23:12:56.509 INFO:teuthology.orchestra.run.smithi099.stdout: "ev": 4, 2024-02-21T23:12:56.509 INFO:teuthology.orchestra.run.smithi099.stdout: "evexg": 0, 2024-02-21T23:12:56.509 INFO:teuthology.orchestra.run.smithi099.stdout: "evexd": 0, 2024-02-21T23:12:56.509 INFO:teuthology.orchestra.run.smithi099.stdout: "segadd": 2, 2024-02-21T23:12:56.509 INFO:teuthology.orchestra.run.smithi099.stdout: "segex": 0, 2024-02-21T23:12:56.509 INFO:teuthology.orchestra.run.smithi099.stdout: "segtrm": 0, 2024-02-21T23:12:56.509 INFO:teuthology.orchestra.run.smithi099.stdout: "seg": 2, 2024-02-21T23:12:56.509 INFO:teuthology.orchestra.run.smithi099.stdout: "segmjr": 2, 2024-02-21T23:12:56.509 INFO:teuthology.orchestra.run.smithi099.stdout: "segexg": 0, 2024-02-21T23:12:56.510 INFO:teuthology.orchestra.run.smithi099.stdout: "segexd": 0, 2024-02-21T23:12:56.510 INFO:teuthology.orchestra.run.smithi099.stdout: "expos": 4194304, 2024-02-21T23:12:56.510 INFO:teuthology.orchestra.run.smithi099.stdout: "wrpos": 4195428, 2024-02-21T23:12:56.510 INFO:teuthology.orchestra.run.smithi099.stdout: "rdpos": 0, 2024-02-21T23:12:56.510 INFO:teuthology.orchestra.run.smithi099.stdout: "jlat": { 2024-02-21T23:12:56.510 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 3, 2024-02-21T23:12:56.510 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.008801428, 2024-02-21T23:12:56.510 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.002933809 2024-02-21T23:12:56.511 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.511 INFO:teuthology.orchestra.run.smithi099.stdout: "replayed": 0 2024-02-21T23:12:56.511 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.511 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_mem": { 2024-02-21T23:12:56.512 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 20, 2024-02-21T23:12:56.512 INFO:teuthology.orchestra.run.smithi099.stdout: "ino+": 20, 2024-02-21T23:12:56.512 INFO:teuthology.orchestra.run.smithi099.stdout: "ino-": 0, 2024-02-21T23:12:56.512 INFO:teuthology.orchestra.run.smithi099.stdout: "dir": 19, 2024-02-21T23:12:56.512 INFO:teuthology.orchestra.run.smithi099.stdout: "dir+": 20, 2024-02-21T23:12:56.512 INFO:teuthology.orchestra.run.smithi099.stdout: "dir-": 1, 2024-02-21T23:12:56.512 INFO:teuthology.orchestra.run.smithi099.stdout: "dn": 17, 2024-02-21T23:12:56.513 INFO:teuthology.orchestra.run.smithi099.stdout: "dn+": 17, 2024-02-21T23:12:56.513 INFO:teuthology.orchestra.run.smithi099.stdout: "dn-": 0, 2024-02-21T23:12:56.513 INFO:teuthology.orchestra.run.smithi099.stdout: "cap": 0, 2024-02-21T23:12:56.513 INFO:teuthology.orchestra.run.smithi099.stdout: "cap+": 0, 2024-02-21T23:12:56.513 INFO:teuthology.orchestra.run.smithi099.stdout: "cap-": 0, 2024-02-21T23:12:56.513 INFO:teuthology.orchestra.run.smithi099.stdout: "rss": 50048, 2024-02-21T23:12:56.513 INFO:teuthology.orchestra.run.smithi099.stdout: "heap": 223588 2024-02-21T23:12:56.513 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.513 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_server": { 2024-02-21T23:12:56.514 INFO:teuthology.orchestra.run.smithi099.stdout: "dispatch_client_request": 0, 2024-02-21T23:12:56.514 INFO:teuthology.orchestra.run.smithi099.stdout: "dispatch_server_request": 0, 2024-02-21T23:12:56.514 INFO:teuthology.orchestra.run.smithi099.stdout: "handle_client_request": 0, 2024-02-21T23:12:56.514 INFO:teuthology.orchestra.run.smithi099.stdout: "handle_client_session": 4, 2024-02-21T23:12:56.514 INFO:teuthology.orchestra.run.smithi099.stdout: "handle_peer_request": 0, 2024-02-21T23:12:56.514 INFO:teuthology.orchestra.run.smithi099.stdout: "req_create_latency": { 2024-02-21T23:12:56.514 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.514 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.515 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.515 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.515 INFO:teuthology.orchestra.run.smithi099.stdout: "req_getattr_latency": { 2024-02-21T23:12:56.515 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.515 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.515 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.515 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.515 INFO:teuthology.orchestra.run.smithi099.stdout: "req_getfilelock_latency": { 2024-02-21T23:12:56.516 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.516 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.516 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.516 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.516 INFO:teuthology.orchestra.run.smithi099.stdout: "req_link_latency": { 2024-02-21T23:12:56.516 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.516 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.517 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.517 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.517 INFO:teuthology.orchestra.run.smithi099.stdout: "req_lookup_latency": { 2024-02-21T23:12:56.517 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.517 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.517 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.517 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.517 INFO:teuthology.orchestra.run.smithi099.stdout: "req_lookuphash_latency": { 2024-02-21T23:12:56.518 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.518 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.518 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.518 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.518 INFO:teuthology.orchestra.run.smithi099.stdout: "req_lookupino_latency": { 2024-02-21T23:12:56.518 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.519 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.519 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.519 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.519 INFO:teuthology.orchestra.run.smithi099.stdout: "req_lookupname_latency": { 2024-02-21T23:12:56.519 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.519 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.519 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.519 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.520 INFO:teuthology.orchestra.run.smithi099.stdout: "req_lookupparent_latency": { 2024-02-21T23:12:56.520 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.520 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.520 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.520 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.520 INFO:teuthology.orchestra.run.smithi099.stdout: "req_lookupsnap_latency": { 2024-02-21T23:12:56.520 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.520 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.521 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.521 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.521 INFO:teuthology.orchestra.run.smithi099.stdout: "req_lssnap_latency": { 2024-02-21T23:12:56.521 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.521 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.521 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.521 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.522 INFO:teuthology.orchestra.run.smithi099.stdout: "req_mkdir_latency": { 2024-02-21T23:12:56.522 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.522 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.522 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.522 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.522 INFO:teuthology.orchestra.run.smithi099.stdout: "req_mknod_latency": { 2024-02-21T23:12:56.522 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.523 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.523 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.523 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.523 INFO:teuthology.orchestra.run.smithi099.stdout: "req_mksnap_latency": { 2024-02-21T23:12:56.523 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.523 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.524 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.524 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.524 INFO:teuthology.orchestra.run.smithi099.stdout: "req_open_latency": { 2024-02-21T23:12:56.524 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.524 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.524 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.525 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.525 INFO:teuthology.orchestra.run.smithi099.stdout: "req_readdir_latency": { 2024-02-21T23:12:56.525 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.525 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.525 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.525 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.526 INFO:teuthology.orchestra.run.smithi099.stdout: "req_rename_latency": { 2024-02-21T23:12:56.526 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.526 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.526 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.526 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.526 INFO:teuthology.orchestra.run.smithi099.stdout: "req_renamesnap_latency": { 2024-02-21T23:12:56.526 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.526 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.527 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.527 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.527 INFO:teuthology.orchestra.run.smithi099.stdout: "req_snapdiff_latency": { 2024-02-21T23:12:56.527 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.527 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.527 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.527 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.527 INFO:teuthology.orchestra.run.smithi099.stdout: "req_rmdir_latency": { 2024-02-21T23:12:56.528 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.528 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.528 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.528 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.528 INFO:teuthology.orchestra.run.smithi099.stdout: "req_rmsnap_latency": { 2024-02-21T23:12:56.528 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.528 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.528 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.529 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.529 INFO:teuthology.orchestra.run.smithi099.stdout: "req_rmxattr_latency": { 2024-02-21T23:12:56.529 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.529 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.529 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.529 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.529 INFO:teuthology.orchestra.run.smithi099.stdout: "req_setattr_latency": { 2024-02-21T23:12:56.529 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.529 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.530 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.530 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.530 INFO:teuthology.orchestra.run.smithi099.stdout: "req_setdirlayout_latency": { 2024-02-21T23:12:56.530 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.530 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.530 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.530 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.530 INFO:teuthology.orchestra.run.smithi099.stdout: "req_setfilelock_latency": { 2024-02-21T23:12:56.531 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.531 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.531 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.531 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.531 INFO:teuthology.orchestra.run.smithi099.stdout: "req_setlayout_latency": { 2024-02-21T23:12:56.531 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.531 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.531 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.532 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.532 INFO:teuthology.orchestra.run.smithi099.stdout: "req_setxattr_latency": { 2024-02-21T23:12:56.532 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.532 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.532 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.532 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.532 INFO:teuthology.orchestra.run.smithi099.stdout: "req_symlink_latency": { 2024-02-21T23:12:56.532 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.533 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.533 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.533 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.533 INFO:teuthology.orchestra.run.smithi099.stdout: "req_unlink_latency": { 2024-02-21T23:12:56.533 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.533 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.533 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.533 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.534 INFO:teuthology.orchestra.run.smithi099.stdout: "cap_revoke_eviction": 0, 2024-02-21T23:12:56.534 INFO:teuthology.orchestra.run.smithi099.stdout: "cap_acquisition_throttle": 0, 2024-02-21T23:12:56.534 INFO:teuthology.orchestra.run.smithi099.stdout: "req_getvxattr_latency": { 2024-02-21T23:12:56.534 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.534 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.534 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.534 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:56.534 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.535 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_sessions": { 2024-02-21T23:12:56.535 INFO:teuthology.orchestra.run.smithi099.stdout: "session_count": 0, 2024-02-21T23:12:56.535 INFO:teuthology.orchestra.run.smithi099.stdout: "session_add": 1, 2024-02-21T23:12:56.535 INFO:teuthology.orchestra.run.smithi099.stdout: "session_remove": 1, 2024-02-21T23:12:56.535 INFO:teuthology.orchestra.run.smithi099.stdout: "sessions_open": 0, 2024-02-21T23:12:56.535 INFO:teuthology.orchestra.run.smithi099.stdout: "sessions_stale": 0, 2024-02-21T23:12:56.535 INFO:teuthology.orchestra.run.smithi099.stdout: "total_load": 0, 2024-02-21T23:12:56.535 INFO:teuthology.orchestra.run.smithi099.stdout: "average_load": 0, 2024-02-21T23:12:56.536 INFO:teuthology.orchestra.run.smithi099.stdout: "avg_session_uptime": 88, 2024-02-21T23:12:56.536 INFO:teuthology.orchestra.run.smithi099.stdout: "mdthresh_evicted": 0 2024-02-21T23:12:56.536 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.536 INFO:teuthology.orchestra.run.smithi099.stdout: "mempool": { 2024-02-21T23:12:56.536 INFO:teuthology.orchestra.run.smithi099.stdout: "bloom_filter_bytes": 0, 2024-02-21T23:12:56.536 INFO:teuthology.orchestra.run.smithi099.stdout: "bloom_filter_items": 0, 2024-02-21T23:12:56.536 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_alloc_bytes": 0, 2024-02-21T23:12:56.536 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_alloc_items": 0, 2024-02-21T23:12:56.537 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_data_bytes": 0, 2024-02-21T23:12:56.537 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_data_items": 0, 2024-02-21T23:12:56.537 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_onode_bytes": 0, 2024-02-21T23:12:56.537 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_onode_items": 0, 2024-02-21T23:12:56.537 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_meta_bytes": 0, 2024-02-21T23:12:56.537 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_meta_items": 0, 2024-02-21T23:12:56.537 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_other_bytes": 0, 2024-02-21T23:12:56.537 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_other_items": 0, 2024-02-21T23:12:56.538 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_buffer_bytes": 0, 2024-02-21T23:12:56.538 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_buffer_items": 0, 2024-02-21T23:12:56.538 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_extent_bytes": 0, 2024-02-21T23:12:56.538 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_extent_items": 0, 2024-02-21T23:12:56.538 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_blob_bytes": 0, 2024-02-21T23:12:56.538 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_blob_items": 0, 2024-02-21T23:12:56.539 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_shared_blob_bytes": 0, 2024-02-21T23:12:56.539 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_shared_blob_items": 0, 2024-02-21T23:12:56.539 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_inline_bl_bytes": 0, 2024-02-21T23:12:56.539 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_inline_bl_items": 0, 2024-02-21T23:12:56.539 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_fsck_bytes": 0, 2024-02-21T23:12:56.539 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_fsck_items": 0, 2024-02-21T23:12:56.540 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_txc_bytes": 0, 2024-02-21T23:12:56.540 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_txc_items": 0, 2024-02-21T23:12:56.540 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_writing_deferred_bytes": 0, 2024-02-21T23:12:56.540 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_writing_deferred_items": 0, 2024-02-21T23:12:56.540 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_writing_bytes": 0, 2024-02-21T23:12:56.540 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_writing_items": 0, 2024-02-21T23:12:56.540 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_bytes": 0, 2024-02-21T23:12:56.541 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_items": 0, 2024-02-21T23:12:56.541 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_file_reader_bytes": 0, 2024-02-21T23:12:56.541 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_file_reader_items": 0, 2024-02-21T23:12:56.542 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_file_writer_bytes": 0, 2024-02-21T23:12:56.542 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_file_writer_items": 0, 2024-02-21T23:12:56.542 INFO:teuthology.orchestra.run.smithi099.stdout: "buffer_anon_bytes": 230170, 2024-02-21T23:12:56.542 INFO:teuthology.orchestra.run.smithi099.stdout: "buffer_anon_items": 76, 2024-02-21T23:12:56.542 INFO:teuthology.orchestra.run.smithi099.stdout: "buffer_meta_bytes": 0, 2024-02-21T23:12:56.542 INFO:teuthology.orchestra.run.smithi099.stdout: "buffer_meta_items": 0, 2024-02-21T23:12:56.543 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_bytes": 0, 2024-02-21T23:12:56.543 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_items": 0, 2024-02-21T23:12:56.543 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_mapbl_bytes": 0, 2024-02-21T23:12:56.543 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_mapbl_items": 0, 2024-02-21T23:12:56.543 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_pglog_bytes": 0, 2024-02-21T23:12:56.543 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_pglog_items": 0, 2024-02-21T23:12:56.543 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_bytes": 8136, 2024-02-21T23:12:56.543 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_items": 153, 2024-02-21T23:12:56.544 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_mapping_bytes": 0, 2024-02-21T23:12:56.544 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_mapping_items": 0, 2024-02-21T23:12:56.544 INFO:teuthology.orchestra.run.smithi099.stdout: "pgmap_bytes": 0, 2024-02-21T23:12:56.544 INFO:teuthology.orchestra.run.smithi099.stdout: "pgmap_items": 0, 2024-02-21T23:12:56.544 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_co_bytes": 90924, 2024-02-21T23:12:56.544 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_co_items": 461, 2024-02-21T23:12:56.544 INFO:teuthology.orchestra.run.smithi099.stdout: "unittest_1_bytes": 0, 2024-02-21T23:12:56.544 INFO:teuthology.orchestra.run.smithi099.stdout: "unittest_1_items": 0, 2024-02-21T23:12:56.545 INFO:teuthology.orchestra.run.smithi099.stdout: "unittest_2_bytes": 0, 2024-02-21T23:12:56.545 INFO:teuthology.orchestra.run.smithi099.stdout: "unittest_2_items": 0 2024-02-21T23:12:56.545 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.545 INFO:teuthology.orchestra.run.smithi099.stdout: "objecter": { 2024-02-21T23:12:56.545 INFO:teuthology.orchestra.run.smithi099.stdout: "op_active": 0, 2024-02-21T23:12:56.545 INFO:teuthology.orchestra.run.smithi099.stdout: "op_laggy": 0, 2024-02-21T23:12:56.545 INFO:teuthology.orchestra.run.smithi099.stdout: "op_send": 39, 2024-02-21T23:12:56.545 INFO:teuthology.orchestra.run.smithi099.stdout: "op_send_bytes": 11426, 2024-02-21T23:12:56.546 INFO:teuthology.orchestra.run.smithi099.stdout: "op_resend": 28, 2024-02-21T23:12:56.546 INFO:teuthology.orchestra.run.smithi099.stdout: "op_reply": 39, 2024-02-21T23:12:56.546 INFO:teuthology.orchestra.run.smithi099.stdout: "op_latency": { 2024-02-21T23:12:56.546 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 39, 2024-02-21T23:12:56.546 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.309992769, 2024-02-21T23:12:56.546 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.007948532 2024-02-21T23:12:56.546 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.546 INFO:teuthology.orchestra.run.smithi099.stdout: "op_inflight": 0, 2024-02-21T23:12:56.547 INFO:teuthology.orchestra.run.smithi099.stdout: "oplen_avg": { 2024-02-21T23:12:56.547 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 39, 2024-02-21T23:12:56.547 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 61 2024-02-21T23:12:56.547 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.547 INFO:teuthology.orchestra.run.smithi099.stdout: "op": 39, 2024-02-21T23:12:56.547 INFO:teuthology.orchestra.run.smithi099.stdout: "op_r": 0, 2024-02-21T23:12:56.547 INFO:teuthology.orchestra.run.smithi099.stdout: "op_w": 39, 2024-02-21T23:12:56.547 INFO:teuthology.orchestra.run.smithi099.stdout: "op_rmw": 0, 2024-02-21T23:12:56.547 INFO:teuthology.orchestra.run.smithi099.stdout: "op_pg": 0, 2024-02-21T23:12:56.548 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_stat": 0, 2024-02-21T23:12:56.548 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_create": 10, 2024-02-21T23:12:56.548 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_read": 0, 2024-02-21T23:12:56.548 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_write": 3, 2024-02-21T23:12:56.548 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_writefull": 7, 2024-02-21T23:12:56.548 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_writesame": 0, 2024-02-21T23:12:56.548 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_append": 0, 2024-02-21T23:12:56.548 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_zero": 0, 2024-02-21T23:12:56.549 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_truncate": 0, 2024-02-21T23:12:56.549 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_delete": 6, 2024-02-21T23:12:56.549 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_mapext": 0, 2024-02-21T23:12:56.549 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_sparse_read": 0, 2024-02-21T23:12:56.549 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_clonerange": 0, 2024-02-21T23:12:56.549 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_getxattr": 0, 2024-02-21T23:12:56.549 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_setxattr": 20, 2024-02-21T23:12:56.549 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_cmpxattr": 0, 2024-02-21T23:12:56.550 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_rmxattr": 0, 2024-02-21T23:12:56.550 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_resetxattrs": 0, 2024-02-21T23:12:56.550 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_call": 0, 2024-02-21T23:12:56.550 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_watch": 0, 2024-02-21T23:12:56.550 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_notify": 0, 2024-02-21T23:12:56.550 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_src_cmpxattr": 0, 2024-02-21T23:12:56.550 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_pgls": 0, 2024-02-21T23:12:56.550 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_pgls_filter": 0, 2024-02-21T23:12:56.550 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_other": 0, 2024-02-21T23:12:56.551 INFO:teuthology.orchestra.run.smithi099.stdout: "linger_active": 0, 2024-02-21T23:12:56.551 INFO:teuthology.orchestra.run.smithi099.stdout: "linger_send": 0, 2024-02-21T23:12:56.551 INFO:teuthology.orchestra.run.smithi099.stdout: "linger_resend": 0, 2024-02-21T23:12:56.551 INFO:teuthology.orchestra.run.smithi099.stdout: "linger_ping": 0, 2024-02-21T23:12:56.551 INFO:teuthology.orchestra.run.smithi099.stdout: "poolop_active": 0, 2024-02-21T23:12:56.551 INFO:teuthology.orchestra.run.smithi099.stdout: "poolop_send": 0, 2024-02-21T23:12:56.551 INFO:teuthology.orchestra.run.smithi099.stdout: "poolop_resend": 0, 2024-02-21T23:12:56.551 INFO:teuthology.orchestra.run.smithi099.stdout: "poolstat_active": 0, 2024-02-21T23:12:56.552 INFO:teuthology.orchestra.run.smithi099.stdout: "poolstat_send": 0, 2024-02-21T23:12:56.552 INFO:teuthology.orchestra.run.smithi099.stdout: "poolstat_resend": 0, 2024-02-21T23:12:56.552 INFO:teuthology.orchestra.run.smithi099.stdout: "statfs_active": 0, 2024-02-21T23:12:56.552 INFO:teuthology.orchestra.run.smithi099.stdout: "statfs_send": 0, 2024-02-21T23:12:56.552 INFO:teuthology.orchestra.run.smithi099.stdout: "statfs_resend": 0, 2024-02-21T23:12:56.552 INFO:teuthology.orchestra.run.smithi099.stdout: "command_active": 0, 2024-02-21T23:12:56.553 INFO:teuthology.orchestra.run.smithi099.stdout: "command_send": 0, 2024-02-21T23:12:56.553 INFO:teuthology.orchestra.run.smithi099.stdout: "command_resend": 0, 2024-02-21T23:12:56.553 INFO:teuthology.orchestra.run.smithi099.stdout: "map_epoch": 40, 2024-02-21T23:12:56.553 INFO:teuthology.orchestra.run.smithi099.stdout: "map_full": 0, 2024-02-21T23:12:56.553 INFO:teuthology.orchestra.run.smithi099.stdout: "map_inc": 11, 2024-02-21T23:12:56.553 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_sessions": 8, 2024-02-21T23:12:56.553 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_session_open": 8, 2024-02-21T23:12:56.553 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_session_close": 0, 2024-02-21T23:12:56.553 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_laggy": 0, 2024-02-21T23:12:56.554 INFO:teuthology.orchestra.run.smithi099.stdout: "omap_wr": 14, 2024-02-21T23:12:56.554 INFO:teuthology.orchestra.run.smithi099.stdout: "omap_rd": 0, 2024-02-21T23:12:56.554 INFO:teuthology.orchestra.run.smithi099.stdout: "omap_del": 1 2024-02-21T23:12:56.554 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.554 INFO:teuthology.orchestra.run.smithi099.stdout: "oft": { 2024-02-21T23:12:56.554 INFO:teuthology.orchestra.run.smithi099.stdout: "omap_total_objs": 1, 2024-02-21T23:12:56.554 INFO:teuthology.orchestra.run.smithi099.stdout: "omap_total_kv_pairs": 0, 2024-02-21T23:12:56.554 INFO:teuthology.orchestra.run.smithi099.stdout: "omap_total_updates": 0, 2024-02-21T23:12:56.555 INFO:teuthology.orchestra.run.smithi099.stdout: "omap_total_removes": 0 2024-02-21T23:12:56.555 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.555 INFO:teuthology.orchestra.run.smithi099.stdout: "osd-slow-ops": { 2024-02-21T23:12:56.555 INFO:teuthology.orchestra.run.smithi099.stdout: "slow_ops_count": 0 2024-02-21T23:12:56.555 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.555 INFO:teuthology.orchestra.run.smithi099.stdout: "purge_queue": { 2024-02-21T23:12:56.555 INFO:teuthology.orchestra.run.smithi099.stdout: "pq_executing_ops": 0, 2024-02-21T23:12:56.555 INFO:teuthology.orchestra.run.smithi099.stdout: "pq_executing_ops_high_water": 0, 2024-02-21T23:12:56.556 INFO:teuthology.orchestra.run.smithi099.stdout: "pq_executing": 0, 2024-02-21T23:12:56.556 INFO:teuthology.orchestra.run.smithi099.stdout: "pq_executing_high_water": 0, 2024-02-21T23:12:56.556 INFO:teuthology.orchestra.run.smithi099.stdout: "pq_executed_ops": 0, 2024-02-21T23:12:56.556 INFO:teuthology.orchestra.run.smithi099.stdout: "pq_executed": 0, 2024-02-21T23:12:56.556 INFO:teuthology.orchestra.run.smithi099.stdout: "pq_item_in_journal": 0 2024-02-21T23:12:56.556 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.556 INFO:teuthology.orchestra.run.smithi099.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-02-21T23:12:56.556 INFO:teuthology.orchestra.run.smithi099.stdout: "val": 0, 2024-02-21T23:12:56.557 INFO:teuthology.orchestra.run.smithi099.stdout: "max": 104857600, 2024-02-21T23:12:56.557 INFO:teuthology.orchestra.run.smithi099.stdout: "get_started": 0, 2024-02-21T23:12:56.557 INFO:teuthology.orchestra.run.smithi099.stdout: "get": 805, 2024-02-21T23:12:56.557 INFO:teuthology.orchestra.run.smithi099.stdout: "get_sum": 1650535, 2024-02-21T23:12:56.557 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_fail": 0, 2024-02-21T23:12:56.557 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_success": 805, 2024-02-21T23:12:56.557 INFO:teuthology.orchestra.run.smithi099.stdout: "take": 0, 2024-02-21T23:12:56.557 INFO:teuthology.orchestra.run.smithi099.stdout: "take_sum": 0, 2024-02-21T23:12:56.558 INFO:teuthology.orchestra.run.smithi099.stdout: "put": 805, 2024-02-21T23:12:56.558 INFO:teuthology.orchestra.run.smithi099.stdout: "put_sum": 1650535, 2024-02-21T23:12:56.558 INFO:teuthology.orchestra.run.smithi099.stdout: "wait": { 2024-02-21T23:12:56.558 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.558 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.558 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.558 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:56.558 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.558 INFO:teuthology.orchestra.run.smithi099.stdout: "throttle-objecter_bytes": { 2024-02-21T23:12:56.559 INFO:teuthology.orchestra.run.smithi099.stdout: "val": 0, 2024-02-21T23:12:56.559 INFO:teuthology.orchestra.run.smithi099.stdout: "max": 104857600, 2024-02-21T23:12:56.559 INFO:teuthology.orchestra.run.smithi099.stdout: "get_started": 0, 2024-02-21T23:12:56.559 INFO:teuthology.orchestra.run.smithi099.stdout: "get": 0, 2024-02-21T23:12:56.559 INFO:teuthology.orchestra.run.smithi099.stdout: "get_sum": 0, 2024-02-21T23:12:56.559 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_fail": 0, 2024-02-21T23:12:56.559 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_success": 0, 2024-02-21T23:12:56.559 INFO:teuthology.orchestra.run.smithi099.stdout: "take": 39, 2024-02-21T23:12:56.560 INFO:teuthology.orchestra.run.smithi099.stdout: "take_sum": 11426, 2024-02-21T23:12:56.560 INFO:teuthology.orchestra.run.smithi099.stdout: "put": 39, 2024-02-21T23:12:56.560 INFO:teuthology.orchestra.run.smithi099.stdout: "put_sum": 11426, 2024-02-21T23:12:56.560 INFO:teuthology.orchestra.run.smithi099.stdout: "wait": { 2024-02-21T23:12:56.560 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.560 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.560 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.560 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:56.561 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.561 INFO:teuthology.orchestra.run.smithi099.stdout: "throttle-objecter_ops": { 2024-02-21T23:12:56.561 INFO:teuthology.orchestra.run.smithi099.stdout: "val": 0, 2024-02-21T23:12:56.561 INFO:teuthology.orchestra.run.smithi099.stdout: "max": 1024, 2024-02-21T23:12:56.561 INFO:teuthology.orchestra.run.smithi099.stdout: "get_started": 0, 2024-02-21T23:12:56.561 INFO:teuthology.orchestra.run.smithi099.stdout: "get": 0, 2024-02-21T23:12:56.561 INFO:teuthology.orchestra.run.smithi099.stdout: "get_sum": 0, 2024-02-21T23:12:56.561 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_fail": 0, 2024-02-21T23:12:56.562 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_success": 0, 2024-02-21T23:12:56.562 INFO:teuthology.orchestra.run.smithi099.stdout: "take": 39, 2024-02-21T23:12:56.562 INFO:teuthology.orchestra.run.smithi099.stdout: "take_sum": 39, 2024-02-21T23:12:56.562 INFO:teuthology.orchestra.run.smithi099.stdout: "put": 39, 2024-02-21T23:12:56.562 INFO:teuthology.orchestra.run.smithi099.stdout: "put_sum": 39, 2024-02-21T23:12:56.562 INFO:teuthology.orchestra.run.smithi099.stdout: "wait": { 2024-02-21T23:12:56.562 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.562 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.563 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.563 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:56.563 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.563 INFO:teuthology.orchestra.run.smithi099.stdout: "throttle-write_buf_throttle": { 2024-02-21T23:12:56.563 INFO:teuthology.orchestra.run.smithi099.stdout: "val": 0, 2024-02-21T23:12:56.563 INFO:teuthology.orchestra.run.smithi099.stdout: "max": 3758096384, 2024-02-21T23:12:56.563 INFO:teuthology.orchestra.run.smithi099.stdout: "get_started": 0, 2024-02-21T23:12:56.563 INFO:teuthology.orchestra.run.smithi099.stdout: "get": 0, 2024-02-21T23:12:56.564 INFO:teuthology.orchestra.run.smithi099.stdout: "get_sum": 0, 2024-02-21T23:12:56.564 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_fail": 0, 2024-02-21T23:12:56.564 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_success": 0, 2024-02-21T23:12:56.564 INFO:teuthology.orchestra.run.smithi099.stdout: "take": 0, 2024-02-21T23:12:56.564 INFO:teuthology.orchestra.run.smithi099.stdout: "take_sum": 0, 2024-02-21T23:12:56.564 INFO:teuthology.orchestra.run.smithi099.stdout: "put": 0, 2024-02-21T23:12:56.564 INFO:teuthology.orchestra.run.smithi099.stdout: "put_sum": 0, 2024-02-21T23:12:56.565 INFO:teuthology.orchestra.run.smithi099.stdout: "wait": { 2024-02-21T23:12:56.565 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.565 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.565 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.565 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:56.565 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.565 INFO:teuthology.orchestra.run.smithi099.stdout: "throttle-write_buf_throttle-0x55f1ec8aa6e0": { 2024-02-21T23:12:56.565 INFO:teuthology.orchestra.run.smithi099.stdout: "val": 0, 2024-02-21T23:12:56.565 INFO:teuthology.orchestra.run.smithi099.stdout: "max": 3758096384, 2024-02-21T23:12:56.566 INFO:teuthology.orchestra.run.smithi099.stdout: "get_started": 0, 2024-02-21T23:12:56.566 INFO:teuthology.orchestra.run.smithi099.stdout: "get": 4, 2024-02-21T23:12:56.566 INFO:teuthology.orchestra.run.smithi099.stdout: "get_sum": 1124, 2024-02-21T23:12:56.566 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_fail": 0, 2024-02-21T23:12:56.566 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_success": 4, 2024-02-21T23:12:56.566 INFO:teuthology.orchestra.run.smithi099.stdout: "take": 0, 2024-02-21T23:12:56.566 INFO:teuthology.orchestra.run.smithi099.stdout: "take_sum": 0, 2024-02-21T23:12:56.566 INFO:teuthology.orchestra.run.smithi099.stdout: "put": 3, 2024-02-21T23:12:56.567 INFO:teuthology.orchestra.run.smithi099.stdout: "put_sum": 1124, 2024-02-21T23:12:56.567 INFO:teuthology.orchestra.run.smithi099.stdout: "wait": { 2024-02-21T23:12:56.567 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.567 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.567 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.567 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:56.567 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:56.568 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-02-21T23:12:56.569 INFO:tasks.check_counter:Daemon mds.d mds.exported=0 2024-02-21T23:12:56.569 INFO:tasks.check_counter:Daemon mds.d mds.imported=0 2024-02-21T23:12:56.570 INFO:tasks.check_counter:Daemon mds.d mds.root_rsnaps=6 2024-02-21T23:12:56.570 INFO:tasks.check_counter:Daemon mds.d mds_server.req_mksnap_latency.avgcount=0 2024-02-21T23:12:56.570 INFO:tasks.check_counter:Daemon mds.d mds_server.req_rmsnap_latency.avgcount=0 2024-02-21T23:12:56.570 INFO:tasks.check_counter:Daemon mds.d mds.dir_split=0 2024-02-21T23:12:56.570 DEBUG:tasks.check_counter:Getting stats from g 2024-02-21T23:12:56.570 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.g.asok perf dump 2024-02-21T23:12:56.761 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-02-21T23:12:56.761 INFO:teuthology.orchestra.run.smithi099.stdout: "AsyncMessenger::Worker-0": { 2024-02-21T23:12:56.761 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_messages": 1503, 2024-02-21T23:12:56.761 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_messages": 1505, 2024-02-21T23:12:56.762 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_bytes": 29479923, 2024-02-21T23:12:56.762 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_bytes": 478095, 2024-02-21T23:12:56.762 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_created_connections": 7, 2024-02-21T23:12:56.762 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_active_connections": 3, 2024-02-21T23:12:56.762 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_total_time": 0.281656305, 2024-02-21T23:12:56.762 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_send_time": 0.075595664, 2024-02-21T23:12:56.762 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_recv_time": 0.120824234, 2024-02-21T23:12:56.762 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_fast_dispatch_time": 0.060158133, 2024-02-21T23:12:56.763 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_messages_queue_lat": { 2024-02-21T23:12:56.763 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 1504, 2024-02-21T23:12:56.763 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.093223390, 2024-02-21T23:12:56.763 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000061983 2024-02-21T23:12:56.763 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.763 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_handle_ack_lat": { 2024-02-21T23:12:56.763 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.763 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.764 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.764 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.764 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_encrypted_bytes": 0, 2024-02-21T23:12:56.764 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_encrypted_bytes": 0 2024-02-21T23:12:56.764 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.764 INFO:teuthology.orchestra.run.smithi099.stdout: "AsyncMessenger::Worker-1": { 2024-02-21T23:12:56.764 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_messages": 280, 2024-02-21T23:12:56.765 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_messages": 264, 2024-02-21T23:12:56.765 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_bytes": 18368097, 2024-02-21T23:12:56.765 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_bytes": 135830, 2024-02-21T23:12:56.765 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_created_connections": 4, 2024-02-21T23:12:56.765 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_active_connections": 3, 2024-02-21T23:12:56.765 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_total_time": 0.105312719, 2024-02-21T23:12:56.765 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_send_time": 0.018244720, 2024-02-21T23:12:56.765 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_recv_time": 0.093438154, 2024-02-21T23:12:56.766 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_fast_dispatch_time": 0.009008730, 2024-02-21T23:12:56.766 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_messages_queue_lat": { 2024-02-21T23:12:56.766 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 264, 2024-02-21T23:12:56.766 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.033472249, 2024-02-21T23:12:56.766 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000126788 2024-02-21T23:12:56.766 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.767 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_handle_ack_lat": { 2024-02-21T23:12:56.767 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.767 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.767 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.767 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.767 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_encrypted_bytes": 1571216, 2024-02-21T23:12:56.768 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_encrypted_bytes": 118592 2024-02-21T23:12:56.768 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.768 INFO:teuthology.orchestra.run.smithi099.stdout: "AsyncMessenger::Worker-2": { 2024-02-21T23:12:56.768 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_messages": 657, 2024-02-21T23:12:56.768 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_messages": 804, 2024-02-21T23:12:56.768 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_bytes": 8550529, 2024-02-21T23:12:56.769 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_bytes": 563715, 2024-02-21T23:12:56.769 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_created_connections": 7, 2024-02-21T23:12:56.769 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_active_connections": 5, 2024-02-21T23:12:56.769 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_total_time": 0.139778758, 2024-02-21T23:12:56.769 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_send_time": 0.043540770, 2024-02-21T23:12:56.769 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_recv_time": 0.049438617, 2024-02-21T23:12:56.769 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_fast_dispatch_time": 0.033739039, 2024-02-21T23:12:56.769 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_messages_queue_lat": { 2024-02-21T23:12:56.770 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 801, 2024-02-21T23:12:56.770 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.066166584, 2024-02-21T23:12:56.770 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000082604 2024-02-21T23:12:56.770 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.770 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_handle_ack_lat": { 2024-02-21T23:12:56.770 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.770 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.770 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.771 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.771 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_encrypted_bytes": 320, 2024-02-21T23:12:56.771 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_encrypted_bytes": 355424 2024-02-21T23:12:56.771 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.771 INFO:teuthology.orchestra.run.smithi099.stdout: "cct": { 2024-02-21T23:12:56.771 INFO:teuthology.orchestra.run.smithi099.stdout: "total_workers": 1, 2024-02-21T23:12:56.771 INFO:teuthology.orchestra.run.smithi099.stdout: "unhealthy_workers": 0 2024-02-21T23:12:56.771 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.772 INFO:teuthology.orchestra.run.smithi099.stdout: "finisher-MDSRank": { 2024-02-21T23:12:56.772 INFO:teuthology.orchestra.run.smithi099.stdout: "queue_len": 0, 2024-02-21T23:12:56.772 INFO:teuthology.orchestra.run.smithi099.stdout: "complete_latency": { 2024-02-21T23:12:56.772 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 3547, 2024-02-21T23:12:56.772 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.138728802, 2024-02-21T23:12:56.772 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000039111 2024-02-21T23:12:56.772 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:56.773 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.773 INFO:teuthology.orchestra.run.smithi099.stdout: "finisher-PurgeQueue": { 2024-02-21T23:12:56.773 INFO:teuthology.orchestra.run.smithi099.stdout: "queue_len": 0, 2024-02-21T23:12:56.773 INFO:teuthology.orchestra.run.smithi099.stdout: "complete_latency": { 2024-02-21T23:12:56.773 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.773 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.773 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.773 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:56.774 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.774 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": { 2024-02-21T23:12:56.774 INFO:teuthology.orchestra.run.smithi099.stdout: "request": 0, 2024-02-21T23:12:56.774 INFO:teuthology.orchestra.run.smithi099.stdout: "reply": 0, 2024-02-21T23:12:56.774 INFO:teuthology.orchestra.run.smithi099.stdout: "reply_latency": { 2024-02-21T23:12:56.774 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.774 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.775 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.775 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.775 INFO:teuthology.orchestra.run.smithi099.stdout: "slow_reply": 0, 2024-02-21T23:12:56.775 INFO:teuthology.orchestra.run.smithi099.stdout: "forward": 0, 2024-02-21T23:12:56.775 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_fetch_complete": 0, 2024-02-21T23:12:56.775 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_fetch_keys": 0, 2024-02-21T23:12:56.775 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_commit": 0, 2024-02-21T23:12:56.775 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_split": 0, 2024-02-21T23:12:56.776 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_merge": 0, 2024-02-21T23:12:56.776 INFO:teuthology.orchestra.run.smithi099.stdout: "inodes": 6683, 2024-02-21T23:12:56.776 INFO:teuthology.orchestra.run.smithi099.stdout: "inodes_top": 0, 2024-02-21T23:12:56.776 INFO:teuthology.orchestra.run.smithi099.stdout: "inodes_bottom": 6683, 2024-02-21T23:12:56.776 INFO:teuthology.orchestra.run.smithi099.stdout: "inodes_pin_tail": 0, 2024-02-21T23:12:56.776 INFO:teuthology.orchestra.run.smithi099.stdout: "inodes_pinned": 6683, 2024-02-21T23:12:56.776 INFO:teuthology.orchestra.run.smithi099.stdout: "inodes_expired": 0, 2024-02-21T23:12:56.777 INFO:teuthology.orchestra.run.smithi099.stdout: "inodes_with_caps": 0, 2024-02-21T23:12:56.777 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": 0, 2024-02-21T23:12:56.777 INFO:teuthology.orchestra.run.smithi099.stdout: "subtrees": 21, 2024-02-21T23:12:56.777 INFO:teuthology.orchestra.run.smithi099.stdout: "traverse": 0, 2024-02-21T23:12:56.777 INFO:teuthology.orchestra.run.smithi099.stdout: "traverse_hit": 0, 2024-02-21T23:12:56.777 INFO:teuthology.orchestra.run.smithi099.stdout: "traverse_forward": 0, 2024-02-21T23:12:56.777 INFO:teuthology.orchestra.run.smithi099.stdout: "traverse_discover": 0, 2024-02-21T23:12:56.777 INFO:teuthology.orchestra.run.smithi099.stdout: "traverse_dir_fetch": 0, 2024-02-21T23:12:56.778 INFO:teuthology.orchestra.run.smithi099.stdout: "traverse_remote_ino": 0, 2024-02-21T23:12:56.778 INFO:teuthology.orchestra.run.smithi099.stdout: "traverse_lock": 0, 2024-02-21T23:12:56.778 INFO:teuthology.orchestra.run.smithi099.stdout: "load_cent": 0, 2024-02-21T23:12:56.778 INFO:teuthology.orchestra.run.smithi099.stdout: "q": 0, 2024-02-21T23:12:56.778 INFO:teuthology.orchestra.run.smithi099.stdout: "exported": 0, 2024-02-21T23:12:56.778 INFO:teuthology.orchestra.run.smithi099.stdout: "exported_inodes": 0, 2024-02-21T23:12:56.779 INFO:teuthology.orchestra.run.smithi099.stdout: "imported": 0, 2024-02-21T23:12:56.779 INFO:teuthology.orchestra.run.smithi099.stdout: "imported_inodes": 0, 2024-02-21T23:12:56.779 INFO:teuthology.orchestra.run.smithi099.stdout: "openino_dir_fetch": 0, 2024-02-21T23:12:56.779 INFO:teuthology.orchestra.run.smithi099.stdout: "openino_backtrace_fetch": 0, 2024-02-21T23:12:56.779 INFO:teuthology.orchestra.run.smithi099.stdout: "openino_peer_discover": 0, 2024-02-21T23:12:56.779 INFO:teuthology.orchestra.run.smithi099.stdout: "root_rfiles": 3452, 2024-02-21T23:12:56.779 INFO:teuthology.orchestra.run.smithi099.stdout: "root_rbytes": 26460394, 2024-02-21T23:12:56.780 INFO:teuthology.orchestra.run.smithi099.stdout: "root_rsnaps": 6, 2024-02-21T23:12:56.780 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_backtrace_fetch": 0, 2024-02-21T23:12:56.780 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_set_tag": 0, 2024-02-21T23:12:56.780 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_backtrace_repaired": 0, 2024-02-21T23:12:56.780 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_inotable_repaired": 0, 2024-02-21T23:12:56.780 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_dir_inodes": 0, 2024-02-21T23:12:56.780 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_dir_base_inodes": 0, 2024-02-21T23:12:56.780 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_dirfrag_rstats": 0, 2024-02-21T23:12:56.781 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_file_inodes": 0, 2024-02-21T23:12:56.781 INFO:teuthology.orchestra.run.smithi099.stdout: "handle_inode_file_caps": 0, 2024-02-21T23:12:56.781 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_cap_op_revoke": 0, 2024-02-21T23:12:56.781 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_cap_op_grant": 0, 2024-02-21T23:12:56.781 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_cap_op_trunc": 0, 2024-02-21T23:12:56.781 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-02-21T23:12:56.781 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_cap_op_flush_ack": 0, 2024-02-21T23:12:56.782 INFO:teuthology.orchestra.run.smithi099.stdout: "handle_client_caps": 0, 2024-02-21T23:12:56.782 INFO:teuthology.orchestra.run.smithi099.stdout: "handle_client_caps_dirty": 0, 2024-02-21T23:12:56.782 INFO:teuthology.orchestra.run.smithi099.stdout: "handle_client_cap_release": 0, 2024-02-21T23:12:56.782 INFO:teuthology.orchestra.run.smithi099.stdout: "process_request_cap_release": 0 2024-02-21T23:12:56.782 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.782 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_cache": { 2024-02-21T23:12:56.782 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_update": 0, 2024-02-21T23:12:56.782 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_update_receipt": 0, 2024-02-21T23:12:56.783 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_try_discover": 0, 2024-02-21T23:12:56.783 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_send_discover": 0, 2024-02-21T23:12:56.783 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_handle_discover": 0, 2024-02-21T23:12:56.783 INFO:teuthology.orchestra.run.smithi099.stdout: "num_strays": 0, 2024-02-21T23:12:56.783 INFO:teuthology.orchestra.run.smithi099.stdout: "num_strays_delayed": 0, 2024-02-21T23:12:56.783 INFO:teuthology.orchestra.run.smithi099.stdout: "num_strays_enqueuing": 0, 2024-02-21T23:12:56.783 INFO:teuthology.orchestra.run.smithi099.stdout: "strays_created": 0, 2024-02-21T23:12:56.783 INFO:teuthology.orchestra.run.smithi099.stdout: "strays_enqueued": 0, 2024-02-21T23:12:56.784 INFO:teuthology.orchestra.run.smithi099.stdout: "strays_reintegrated": 0, 2024-02-21T23:12:56.784 INFO:teuthology.orchestra.run.smithi099.stdout: "strays_migrated": 0, 2024-02-21T23:12:56.784 INFO:teuthology.orchestra.run.smithi099.stdout: "num_recovering_processing": 0, 2024-02-21T23:12:56.784 INFO:teuthology.orchestra.run.smithi099.stdout: "num_recovering_enqueued": 0, 2024-02-21T23:12:56.784 INFO:teuthology.orchestra.run.smithi099.stdout: "num_recovering_prioritized": 0, 2024-02-21T23:12:56.784 INFO:teuthology.orchestra.run.smithi099.stdout: "recovery_started": 0, 2024-02-21T23:12:56.784 INFO:teuthology.orchestra.run.smithi099.stdout: "recovery_completed": 0, 2024-02-21T23:12:56.784 INFO:teuthology.orchestra.run.smithi099.stdout: "ireq_enqueue_scrub": 0, 2024-02-21T23:12:56.785 INFO:teuthology.orchestra.run.smithi099.stdout: "ireq_exportdir": 0, 2024-02-21T23:12:56.785 INFO:teuthology.orchestra.run.smithi099.stdout: "ireq_flush": 0, 2024-02-21T23:12:56.785 INFO:teuthology.orchestra.run.smithi099.stdout: "ireq_fragmentdir": 0, 2024-02-21T23:12:56.785 INFO:teuthology.orchestra.run.smithi099.stdout: "ireq_fragstats": 0, 2024-02-21T23:12:56.785 INFO:teuthology.orchestra.run.smithi099.stdout: "ireq_inodestats": 0 2024-02-21T23:12:56.785 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.785 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_log": { 2024-02-21T23:12:56.785 INFO:teuthology.orchestra.run.smithi099.stdout: "evlrg": 0, 2024-02-21T23:12:56.786 INFO:teuthology.orchestra.run.smithi099.stdout: "evadd": 0, 2024-02-21T23:12:56.786 INFO:teuthology.orchestra.run.smithi099.stdout: "evex": 0, 2024-02-21T23:12:56.786 INFO:teuthology.orchestra.run.smithi099.stdout: "evtrm": 0, 2024-02-21T23:12:56.786 INFO:teuthology.orchestra.run.smithi099.stdout: "ev": 23296, 2024-02-21T23:12:56.786 INFO:teuthology.orchestra.run.smithi099.stdout: "evexg": 0, 2024-02-21T23:12:56.786 INFO:teuthology.orchestra.run.smithi099.stdout: "evexd": 0, 2024-02-21T23:12:56.786 INFO:teuthology.orchestra.run.smithi099.stdout: "segadd": 0, 2024-02-21T23:12:56.786 INFO:teuthology.orchestra.run.smithi099.stdout: "segex": 0, 2024-02-21T23:12:56.787 INFO:teuthology.orchestra.run.smithi099.stdout: "segtrm": 0, 2024-02-21T23:12:56.787 INFO:teuthology.orchestra.run.smithi099.stdout: "seg": 30, 2024-02-21T23:12:56.787 INFO:teuthology.orchestra.run.smithi099.stdout: "segmjr": 3, 2024-02-21T23:12:56.787 INFO:teuthology.orchestra.run.smithi099.stdout: "segexg": 0, 2024-02-21T23:12:56.787 INFO:teuthology.orchestra.run.smithi099.stdout: "segexd": 0, 2024-02-21T23:12:56.787 INFO:teuthology.orchestra.run.smithi099.stdout: "expos": 4194304, 2024-02-21T23:12:56.787 INFO:teuthology.orchestra.run.smithi099.stdout: "wrpos": 58392084, 2024-02-21T23:12:56.787 INFO:teuthology.orchestra.run.smithi099.stdout: "rdpos": 58391948, 2024-02-21T23:12:56.788 INFO:teuthology.orchestra.run.smithi099.stdout: "jlat": { 2024-02-21T23:12:56.788 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.788 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.788 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.788 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.788 INFO:teuthology.orchestra.run.smithi099.stdout: "replayed": 23296 2024-02-21T23:12:56.788 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.788 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_mem": { 2024-02-21T23:12:56.789 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 3163, 2024-02-21T23:12:56.789 INFO:teuthology.orchestra.run.smithi099.stdout: "ino+": 6621, 2024-02-21T23:12:56.789 INFO:teuthology.orchestra.run.smithi099.stdout: "ino-": 3458, 2024-02-21T23:12:56.789 INFO:teuthology.orchestra.run.smithi099.stdout: "dir": 262, 2024-02-21T23:12:56.789 INFO:teuthology.orchestra.run.smithi099.stdout: "dir+": 305, 2024-02-21T23:12:56.789 INFO:teuthology.orchestra.run.smithi099.stdout: "dir-": 43, 2024-02-21T23:12:56.789 INFO:teuthology.orchestra.run.smithi099.stdout: "dn": 6683, 2024-02-21T23:12:56.789 INFO:teuthology.orchestra.run.smithi099.stdout: "dn+": 7532, 2024-02-21T23:12:56.790 INFO:teuthology.orchestra.run.smithi099.stdout: "dn-": 849, 2024-02-21T23:12:56.790 INFO:teuthology.orchestra.run.smithi099.stdout: "cap": 0, 2024-02-21T23:12:56.790 INFO:teuthology.orchestra.run.smithi099.stdout: "cap+": 0, 2024-02-21T23:12:56.790 INFO:teuthology.orchestra.run.smithi099.stdout: "cap-": 0, 2024-02-21T23:12:56.790 INFO:teuthology.orchestra.run.smithi099.stdout: "rss": 70224, 2024-02-21T23:12:56.790 INFO:teuthology.orchestra.run.smithi099.stdout: "heap": 215396 2024-02-21T23:12:56.791 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.792 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_server": { 2024-02-21T23:12:56.792 INFO:teuthology.orchestra.run.smithi099.stdout: "dispatch_client_request": 0, 2024-02-21T23:12:56.792 INFO:teuthology.orchestra.run.smithi099.stdout: "dispatch_server_request": 0, 2024-02-21T23:12:56.792 INFO:teuthology.orchestra.run.smithi099.stdout: "handle_client_request": 0, 2024-02-21T23:12:56.792 INFO:teuthology.orchestra.run.smithi099.stdout: "handle_client_session": 0, 2024-02-21T23:12:56.792 INFO:teuthology.orchestra.run.smithi099.stdout: "handle_peer_request": 0, 2024-02-21T23:12:56.792 INFO:teuthology.orchestra.run.smithi099.stdout: "req_create_latency": { 2024-02-21T23:12:56.793 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.793 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.793 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.793 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.793 INFO:teuthology.orchestra.run.smithi099.stdout: "req_getattr_latency": { 2024-02-21T23:12:56.793 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.793 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.793 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.794 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.794 INFO:teuthology.orchestra.run.smithi099.stdout: "req_getfilelock_latency": { 2024-02-21T23:12:56.794 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.794 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.794 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.794 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.794 INFO:teuthology.orchestra.run.smithi099.stdout: "req_link_latency": { 2024-02-21T23:12:56.794 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.795 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.795 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.795 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.795 INFO:teuthology.orchestra.run.smithi099.stdout: "req_lookup_latency": { 2024-02-21T23:12:56.795 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.795 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.795 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.795 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.796 INFO:teuthology.orchestra.run.smithi099.stdout: "req_lookuphash_latency": { 2024-02-21T23:12:56.796 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.796 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.796 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.796 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.796 INFO:teuthology.orchestra.run.smithi099.stdout: "req_lookupino_latency": { 2024-02-21T23:12:56.796 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.796 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.797 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.797 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.797 INFO:teuthology.orchestra.run.smithi099.stdout: "req_lookupname_latency": { 2024-02-21T23:12:56.797 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.797 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.798 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.798 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.798 INFO:teuthology.orchestra.run.smithi099.stdout: "req_lookupparent_latency": { 2024-02-21T23:12:56.798 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.798 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.798 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.798 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.798 INFO:teuthology.orchestra.run.smithi099.stdout: "req_lookupsnap_latency": { 2024-02-21T23:12:56.799 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.799 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.799 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.799 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.799 INFO:teuthology.orchestra.run.smithi099.stdout: "req_lssnap_latency": { 2024-02-21T23:12:56.799 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.799 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.799 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.800 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.800 INFO:teuthology.orchestra.run.smithi099.stdout: "req_mkdir_latency": { 2024-02-21T23:12:56.800 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.800 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.800 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.800 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.801 INFO:teuthology.orchestra.run.smithi099.stdout: "req_mknod_latency": { 2024-02-21T23:12:56.801 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.801 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.801 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.801 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.801 INFO:teuthology.orchestra.run.smithi099.stdout: "req_mksnap_latency": { 2024-02-21T23:12:56.801 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.802 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.802 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.802 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.802 INFO:teuthology.orchestra.run.smithi099.stdout: "req_open_latency": { 2024-02-21T23:12:56.802 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.802 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.802 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.802 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.803 INFO:teuthology.orchestra.run.smithi099.stdout: "req_readdir_latency": { 2024-02-21T23:12:56.803 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.803 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.803 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.803 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.803 INFO:teuthology.orchestra.run.smithi099.stdout: "req_rename_latency": { 2024-02-21T23:12:56.803 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.803 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.804 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.804 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.804 INFO:teuthology.orchestra.run.smithi099.stdout: "req_renamesnap_latency": { 2024-02-21T23:12:56.804 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.804 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.804 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.804 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.804 INFO:teuthology.orchestra.run.smithi099.stdout: "req_snapdiff_latency": { 2024-02-21T23:12:56.805 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.805 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.805 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.805 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.805 INFO:teuthology.orchestra.run.smithi099.stdout: "req_rmdir_latency": { 2024-02-21T23:12:56.805 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.805 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.805 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.806 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.806 INFO:teuthology.orchestra.run.smithi099.stdout: "req_rmsnap_latency": { 2024-02-21T23:12:56.806 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.806 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.806 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.806 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.806 INFO:teuthology.orchestra.run.smithi099.stdout: "req_rmxattr_latency": { 2024-02-21T23:12:56.806 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.807 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.807 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.807 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.807 INFO:teuthology.orchestra.run.smithi099.stdout: "req_setattr_latency": { 2024-02-21T23:12:56.807 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.807 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.807 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.807 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.808 INFO:teuthology.orchestra.run.smithi099.stdout: "req_setdirlayout_latency": { 2024-02-21T23:12:56.808 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.808 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.808 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.808 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.808 INFO:teuthology.orchestra.run.smithi099.stdout: "req_setfilelock_latency": { 2024-02-21T23:12:56.809 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.809 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.809 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.809 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.809 INFO:teuthology.orchestra.run.smithi099.stdout: "req_setlayout_latency": { 2024-02-21T23:12:56.809 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.809 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.809 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.810 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.810 INFO:teuthology.orchestra.run.smithi099.stdout: "req_setxattr_latency": { 2024-02-21T23:12:56.810 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.810 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.810 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.810 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.810 INFO:teuthology.orchestra.run.smithi099.stdout: "req_symlink_latency": { 2024-02-21T23:12:56.810 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.811 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.811 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.811 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.811 INFO:teuthology.orchestra.run.smithi099.stdout: "req_unlink_latency": { 2024-02-21T23:12:56.811 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.811 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.811 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.811 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.812 INFO:teuthology.orchestra.run.smithi099.stdout: "cap_revoke_eviction": 0, 2024-02-21T23:12:56.812 INFO:teuthology.orchestra.run.smithi099.stdout: "cap_acquisition_throttle": 0, 2024-02-21T23:12:56.812 INFO:teuthology.orchestra.run.smithi099.stdout: "req_getvxattr_latency": { 2024-02-21T23:12:56.812 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.812 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.812 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.812 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:56.812 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.813 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_sessions": { 2024-02-21T23:12:56.813 INFO:teuthology.orchestra.run.smithi099.stdout: "session_count": 2, 2024-02-21T23:12:56.813 INFO:teuthology.orchestra.run.smithi099.stdout: "session_add": 5, 2024-02-21T23:12:56.813 INFO:teuthology.orchestra.run.smithi099.stdout: "session_remove": 3, 2024-02-21T23:12:56.813 INFO:teuthology.orchestra.run.smithi099.stdout: "sessions_open": 3, 2024-02-21T23:12:56.813 INFO:teuthology.orchestra.run.smithi099.stdout: "sessions_stale": 0, 2024-02-21T23:12:56.813 INFO:teuthology.orchestra.run.smithi099.stdout: "total_load": 0, 2024-02-21T23:12:56.813 INFO:teuthology.orchestra.run.smithi099.stdout: "average_load": 0, 2024-02-21T23:12:56.814 INFO:teuthology.orchestra.run.smithi099.stdout: "avg_session_uptime": 2679, 2024-02-21T23:12:56.814 INFO:teuthology.orchestra.run.smithi099.stdout: "mdthresh_evicted": 0 2024-02-21T23:12:56.814 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.814 INFO:teuthology.orchestra.run.smithi099.stdout: "mempool": { 2024-02-21T23:12:56.814 INFO:teuthology.orchestra.run.smithi099.stdout: "bloom_filter_bytes": 0, 2024-02-21T23:12:56.814 INFO:teuthology.orchestra.run.smithi099.stdout: "bloom_filter_items": 0, 2024-02-21T23:12:56.814 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_alloc_bytes": 0, 2024-02-21T23:12:56.814 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_alloc_items": 0, 2024-02-21T23:12:56.815 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_data_bytes": 0, 2024-02-21T23:12:56.815 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_data_items": 0, 2024-02-21T23:12:56.815 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_onode_bytes": 0, 2024-02-21T23:12:56.815 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_onode_items": 0, 2024-02-21T23:12:56.815 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_meta_bytes": 0, 2024-02-21T23:12:56.815 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_meta_items": 0, 2024-02-21T23:12:56.815 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_other_bytes": 0, 2024-02-21T23:12:56.815 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_other_items": 0, 2024-02-21T23:12:56.816 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_buffer_bytes": 0, 2024-02-21T23:12:56.816 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_buffer_items": 0, 2024-02-21T23:12:56.816 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_extent_bytes": 0, 2024-02-21T23:12:56.816 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_extent_items": 0, 2024-02-21T23:12:56.816 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_blob_bytes": 0, 2024-02-21T23:12:56.816 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_blob_items": 0, 2024-02-21T23:12:56.816 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_shared_blob_bytes": 0, 2024-02-21T23:12:56.816 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_shared_blob_items": 0, 2024-02-21T23:12:56.817 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_inline_bl_bytes": 0, 2024-02-21T23:12:56.817 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_inline_bl_items": 0, 2024-02-21T23:12:56.817 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_fsck_bytes": 0, 2024-02-21T23:12:56.817 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_fsck_items": 0, 2024-02-21T23:12:56.817 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_txc_bytes": 0, 2024-02-21T23:12:56.817 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_txc_items": 0, 2024-02-21T23:12:56.817 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_writing_deferred_bytes": 0, 2024-02-21T23:12:56.817 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_writing_deferred_items": 0, 2024-02-21T23:12:56.818 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_writing_bytes": 0, 2024-02-21T23:12:56.818 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_writing_items": 0, 2024-02-21T23:12:56.818 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_bytes": 0, 2024-02-21T23:12:56.818 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_items": 0, 2024-02-21T23:12:56.818 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_file_reader_bytes": 0, 2024-02-21T23:12:56.818 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_file_reader_items": 0, 2024-02-21T23:12:56.818 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_file_writer_bytes": 0, 2024-02-21T23:12:56.818 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_file_writer_items": 0, 2024-02-21T23:12:56.819 INFO:teuthology.orchestra.run.smithi099.stdout: "buffer_anon_bytes": 326826, 2024-02-21T23:12:56.819 INFO:teuthology.orchestra.run.smithi099.stdout: "buffer_anon_items": 3263, 2024-02-21T23:12:56.819 INFO:teuthology.orchestra.run.smithi099.stdout: "buffer_meta_bytes": 0, 2024-02-21T23:12:56.819 INFO:teuthology.orchestra.run.smithi099.stdout: "buffer_meta_items": 0, 2024-02-21T23:12:56.819 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_bytes": 0, 2024-02-21T23:12:56.819 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_items": 0, 2024-02-21T23:12:56.819 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_mapbl_bytes": 0, 2024-02-21T23:12:56.819 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_mapbl_items": 0, 2024-02-21T23:12:56.819 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_pglog_bytes": 0, 2024-02-21T23:12:56.820 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_pglog_items": 0, 2024-02-21T23:12:56.820 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_bytes": 8136, 2024-02-21T23:12:56.820 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_items": 153, 2024-02-21T23:12:56.820 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_mapping_bytes": 0, 2024-02-21T23:12:56.820 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_mapping_items": 0, 2024-02-21T23:12:56.820 INFO:teuthology.orchestra.run.smithi099.stdout: "pgmap_bytes": 0, 2024-02-21T23:12:56.820 INFO:teuthology.orchestra.run.smithi099.stdout: "pgmap_items": 0, 2024-02-21T23:12:56.820 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_co_bytes": 12292357, 2024-02-21T23:12:56.821 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_co_items": 109595, 2024-02-21T23:12:56.821 INFO:teuthology.orchestra.run.smithi099.stdout: "unittest_1_bytes": 0, 2024-02-21T23:12:56.821 INFO:teuthology.orchestra.run.smithi099.stdout: "unittest_1_items": 0, 2024-02-21T23:12:56.821 INFO:teuthology.orchestra.run.smithi099.stdout: "unittest_2_bytes": 0, 2024-02-21T23:12:56.821 INFO:teuthology.orchestra.run.smithi099.stdout: "unittest_2_items": 0 2024-02-21T23:12:56.821 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.821 INFO:teuthology.orchestra.run.smithi099.stdout: "objecter": { 2024-02-21T23:12:56.821 INFO:teuthology.orchestra.run.smithi099.stdout: "op_active": 0, 2024-02-21T23:12:56.822 INFO:teuthology.orchestra.run.smithi099.stdout: "op_laggy": 0, 2024-02-21T23:12:56.822 INFO:teuthology.orchestra.run.smithi099.stdout: "op_send": 2212, 2024-02-21T23:12:56.822 INFO:teuthology.orchestra.run.smithi099.stdout: "op_send_bytes": 26, 2024-02-21T23:12:56.822 INFO:teuthology.orchestra.run.smithi099.stdout: "op_resend": 4, 2024-02-21T23:12:56.822 INFO:teuthology.orchestra.run.smithi099.stdout: "op_reply": 2212, 2024-02-21T23:12:56.822 INFO:teuthology.orchestra.run.smithi099.stdout: "op_latency": { 2024-02-21T23:12:56.822 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 2212, 2024-02-21T23:12:56.822 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 1.688961051, 2024-02-21T23:12:56.823 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000763544 2024-02-21T23:12:56.823 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.823 INFO:teuthology.orchestra.run.smithi099.stdout: "op_inflight": 0, 2024-02-21T23:12:56.823 INFO:teuthology.orchestra.run.smithi099.stdout: "oplen_avg": { 2024-02-21T23:12:56.823 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 2212, 2024-02-21T23:12:56.823 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 2213 2024-02-21T23:12:56.823 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.823 INFO:teuthology.orchestra.run.smithi099.stdout: "op": 2212, 2024-02-21T23:12:56.824 INFO:teuthology.orchestra.run.smithi099.stdout: "op_r": 2212, 2024-02-21T23:12:56.824 INFO:teuthology.orchestra.run.smithi099.stdout: "op_w": 0, 2024-02-21T23:12:56.824 INFO:teuthology.orchestra.run.smithi099.stdout: "op_rmw": 0, 2024-02-21T23:12:56.824 INFO:teuthology.orchestra.run.smithi099.stdout: "op_pg": 0, 2024-02-21T23:12:56.824 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_stat": 1410, 2024-02-21T23:12:56.824 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_create": 0, 2024-02-21T23:12:56.824 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_read": 799, 2024-02-21T23:12:56.824 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_write": 0, 2024-02-21T23:12:56.825 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_writefull": 0, 2024-02-21T23:12:56.825 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_writesame": 0, 2024-02-21T23:12:56.825 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_append": 0, 2024-02-21T23:12:56.825 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_zero": 0, 2024-02-21T23:12:56.825 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_truncate": 0, 2024-02-21T23:12:56.825 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_delete": 0, 2024-02-21T23:12:56.825 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_mapext": 0, 2024-02-21T23:12:56.825 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_sparse_read": 0, 2024-02-21T23:12:56.825 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_clonerange": 0, 2024-02-21T23:12:56.826 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_getxattr": 2, 2024-02-21T23:12:56.826 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_setxattr": 0, 2024-02-21T23:12:56.826 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_cmpxattr": 0, 2024-02-21T23:12:56.826 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_rmxattr": 0, 2024-02-21T23:12:56.826 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_resetxattrs": 0, 2024-02-21T23:12:56.826 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_call": 0, 2024-02-21T23:12:56.826 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_watch": 0, 2024-02-21T23:12:56.826 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_notify": 0, 2024-02-21T23:12:56.827 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_src_cmpxattr": 0, 2024-02-21T23:12:56.827 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_pgls": 0, 2024-02-21T23:12:56.827 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_pgls_filter": 0, 2024-02-21T23:12:56.827 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_other": 0, 2024-02-21T23:12:56.827 INFO:teuthology.orchestra.run.smithi099.stdout: "linger_active": 0, 2024-02-21T23:12:56.827 INFO:teuthology.orchestra.run.smithi099.stdout: "linger_send": 0, 2024-02-21T23:12:56.827 INFO:teuthology.orchestra.run.smithi099.stdout: "linger_resend": 0, 2024-02-21T23:12:56.827 INFO:teuthology.orchestra.run.smithi099.stdout: "linger_ping": 0, 2024-02-21T23:12:56.828 INFO:teuthology.orchestra.run.smithi099.stdout: "poolop_active": 0, 2024-02-21T23:12:56.828 INFO:teuthology.orchestra.run.smithi099.stdout: "poolop_send": 0, 2024-02-21T23:12:56.828 INFO:teuthology.orchestra.run.smithi099.stdout: "poolop_resend": 0, 2024-02-21T23:12:56.828 INFO:teuthology.orchestra.run.smithi099.stdout: "poolstat_active": 0, 2024-02-21T23:12:56.828 INFO:teuthology.orchestra.run.smithi099.stdout: "poolstat_send": 0, 2024-02-21T23:12:56.828 INFO:teuthology.orchestra.run.smithi099.stdout: "poolstat_resend": 0, 2024-02-21T23:12:56.828 INFO:teuthology.orchestra.run.smithi099.stdout: "statfs_active": 0, 2024-02-21T23:12:56.828 INFO:teuthology.orchestra.run.smithi099.stdout: "statfs_send": 0, 2024-02-21T23:12:56.828 INFO:teuthology.orchestra.run.smithi099.stdout: "statfs_resend": 0, 2024-02-21T23:12:56.829 INFO:teuthology.orchestra.run.smithi099.stdout: "command_active": 0, 2024-02-21T23:12:56.829 INFO:teuthology.orchestra.run.smithi099.stdout: "command_send": 0, 2024-02-21T23:12:56.829 INFO:teuthology.orchestra.run.smithi099.stdout: "command_resend": 0, 2024-02-21T23:12:56.829 INFO:teuthology.orchestra.run.smithi099.stdout: "map_epoch": 40, 2024-02-21T23:12:56.829 INFO:teuthology.orchestra.run.smithi099.stdout: "map_full": 0, 2024-02-21T23:12:56.829 INFO:teuthology.orchestra.run.smithi099.stdout: "map_inc": 11, 2024-02-21T23:12:56.829 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_sessions": 7, 2024-02-21T23:12:56.829 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_session_open": 7, 2024-02-21T23:12:56.830 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_session_close": 0, 2024-02-21T23:12:56.830 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_laggy": 0, 2024-02-21T23:12:56.830 INFO:teuthology.orchestra.run.smithi099.stdout: "omap_wr": 0, 2024-02-21T23:12:56.830 INFO:teuthology.orchestra.run.smithi099.stdout: "omap_rd": 2, 2024-02-21T23:12:56.830 INFO:teuthology.orchestra.run.smithi099.stdout: "omap_del": 0 2024-02-21T23:12:56.830 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.830 INFO:teuthology.orchestra.run.smithi099.stdout: "oft": { 2024-02-21T23:12:56.830 INFO:teuthology.orchestra.run.smithi099.stdout: "omap_total_objs": 0, 2024-02-21T23:12:56.831 INFO:teuthology.orchestra.run.smithi099.stdout: "omap_total_kv_pairs": 0, 2024-02-21T23:12:56.831 INFO:teuthology.orchestra.run.smithi099.stdout: "omap_total_updates": 0, 2024-02-21T23:12:56.831 INFO:teuthology.orchestra.run.smithi099.stdout: "omap_total_removes": 0 2024-02-21T23:12:56.831 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.831 INFO:teuthology.orchestra.run.smithi099.stdout: "osd-slow-ops": { 2024-02-21T23:12:56.831 INFO:teuthology.orchestra.run.smithi099.stdout: "slow_ops_count": 0 2024-02-21T23:12:56.831 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.831 INFO:teuthology.orchestra.run.smithi099.stdout: "purge_queue": { 2024-02-21T23:12:56.831 INFO:teuthology.orchestra.run.smithi099.stdout: "pq_executing_ops": 0, 2024-02-21T23:12:56.832 INFO:teuthology.orchestra.run.smithi099.stdout: "pq_executing_ops_high_water": 0, 2024-02-21T23:12:56.832 INFO:teuthology.orchestra.run.smithi099.stdout: "pq_executing": 0, 2024-02-21T23:12:56.832 INFO:teuthology.orchestra.run.smithi099.stdout: "pq_executing_high_water": 0, 2024-02-21T23:12:56.832 INFO:teuthology.orchestra.run.smithi099.stdout: "pq_executed_ops": 0, 2024-02-21T23:12:56.832 INFO:teuthology.orchestra.run.smithi099.stdout: "pq_executed": 0, 2024-02-21T23:12:56.832 INFO:teuthology.orchestra.run.smithi099.stdout: "pq_item_in_journal": 0 2024-02-21T23:12:56.832 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.833 INFO:teuthology.orchestra.run.smithi099.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-02-21T23:12:56.833 INFO:teuthology.orchestra.run.smithi099.stdout: "val": 0, 2024-02-21T23:12:56.833 INFO:teuthology.orchestra.run.smithi099.stdout: "max": 104857600, 2024-02-21T23:12:56.833 INFO:teuthology.orchestra.run.smithi099.stdout: "get_started": 0, 2024-02-21T23:12:56.833 INFO:teuthology.orchestra.run.smithi099.stdout: "get": 2436, 2024-02-21T23:12:56.833 INFO:teuthology.orchestra.run.smithi099.stdout: "get_sum": 56166347, 2024-02-21T23:12:56.833 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_fail": 0, 2024-02-21T23:12:56.833 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_success": 2436, 2024-02-21T23:12:56.833 INFO:teuthology.orchestra.run.smithi099.stdout: "take": 0, 2024-02-21T23:12:56.834 INFO:teuthology.orchestra.run.smithi099.stdout: "take_sum": 0, 2024-02-21T23:12:56.834 INFO:teuthology.orchestra.run.smithi099.stdout: "put": 2436, 2024-02-21T23:12:56.834 INFO:teuthology.orchestra.run.smithi099.stdout: "put_sum": 56166347, 2024-02-21T23:12:56.834 INFO:teuthology.orchestra.run.smithi099.stdout: "wait": { 2024-02-21T23:12:56.834 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.834 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.834 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.834 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:56.835 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.835 INFO:teuthology.orchestra.run.smithi099.stdout: "throttle-objecter_bytes": { 2024-02-21T23:12:56.835 INFO:teuthology.orchestra.run.smithi099.stdout: "val": 0, 2024-02-21T23:12:56.835 INFO:teuthology.orchestra.run.smithi099.stdout: "max": 104857600, 2024-02-21T23:12:56.835 INFO:teuthology.orchestra.run.smithi099.stdout: "get_started": 0, 2024-02-21T23:12:56.835 INFO:teuthology.orchestra.run.smithi099.stdout: "get": 0, 2024-02-21T23:12:56.835 INFO:teuthology.orchestra.run.smithi099.stdout: "get_sum": 0, 2024-02-21T23:12:56.835 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_fail": 0, 2024-02-21T23:12:56.836 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_success": 0, 2024-02-21T23:12:56.836 INFO:teuthology.orchestra.run.smithi099.stdout: "take": 2212, 2024-02-21T23:12:56.836 INFO:teuthology.orchestra.run.smithi099.stdout: "take_sum": 54207891, 2024-02-21T23:12:56.836 INFO:teuthology.orchestra.run.smithi099.stdout: "put": 2212, 2024-02-21T23:12:56.836 INFO:teuthology.orchestra.run.smithi099.stdout: "put_sum": 54207891, 2024-02-21T23:12:56.836 INFO:teuthology.orchestra.run.smithi099.stdout: "wait": { 2024-02-21T23:12:56.836 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.836 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.837 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.837 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:56.837 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.837 INFO:teuthology.orchestra.run.smithi099.stdout: "throttle-objecter_ops": { 2024-02-21T23:12:56.837 INFO:teuthology.orchestra.run.smithi099.stdout: "val": 0, 2024-02-21T23:12:56.837 INFO:teuthology.orchestra.run.smithi099.stdout: "max": 1024, 2024-02-21T23:12:56.837 INFO:teuthology.orchestra.run.smithi099.stdout: "get_started": 0, 2024-02-21T23:12:56.837 INFO:teuthology.orchestra.run.smithi099.stdout: "get": 0, 2024-02-21T23:12:56.837 INFO:teuthology.orchestra.run.smithi099.stdout: "get_sum": 0, 2024-02-21T23:12:56.838 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_fail": 0, 2024-02-21T23:12:56.838 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_success": 0, 2024-02-21T23:12:56.838 INFO:teuthology.orchestra.run.smithi099.stdout: "take": 2212, 2024-02-21T23:12:56.838 INFO:teuthology.orchestra.run.smithi099.stdout: "take_sum": 2212, 2024-02-21T23:12:56.838 INFO:teuthology.orchestra.run.smithi099.stdout: "put": 2212, 2024-02-21T23:12:56.838 INFO:teuthology.orchestra.run.smithi099.stdout: "put_sum": 2212, 2024-02-21T23:12:56.838 INFO:teuthology.orchestra.run.smithi099.stdout: "wait": { 2024-02-21T23:12:56.838 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.839 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.839 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.839 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:56.839 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.839 INFO:teuthology.orchestra.run.smithi099.stdout: "throttle-write_buf_throttle": { 2024-02-21T23:12:56.839 INFO:teuthology.orchestra.run.smithi099.stdout: "val": 0, 2024-02-21T23:12:56.839 INFO:teuthology.orchestra.run.smithi099.stdout: "max": 3758096384, 2024-02-21T23:12:56.839 INFO:teuthology.orchestra.run.smithi099.stdout: "get_started": 0, 2024-02-21T23:12:56.840 INFO:teuthology.orchestra.run.smithi099.stdout: "get": 0, 2024-02-21T23:12:56.840 INFO:teuthology.orchestra.run.smithi099.stdout: "get_sum": 0, 2024-02-21T23:12:56.840 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_fail": 0, 2024-02-21T23:12:56.840 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_success": 0, 2024-02-21T23:12:56.840 INFO:teuthology.orchestra.run.smithi099.stdout: "take": 0, 2024-02-21T23:12:56.840 INFO:teuthology.orchestra.run.smithi099.stdout: "take_sum": 0, 2024-02-21T23:12:56.840 INFO:teuthology.orchestra.run.smithi099.stdout: "put": 0, 2024-02-21T23:12:56.840 INFO:teuthology.orchestra.run.smithi099.stdout: "put_sum": 0, 2024-02-21T23:12:56.841 INFO:teuthology.orchestra.run.smithi099.stdout: "wait": { 2024-02-21T23:12:56.841 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.841 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.841 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.841 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:56.841 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:56.841 INFO:teuthology.orchestra.run.smithi099.stdout: "throttle-write_buf_throttle-0x556808424a00": { 2024-02-21T23:12:56.841 INFO:teuthology.orchestra.run.smithi099.stdout: "val": 0, 2024-02-21T23:12:56.841 INFO:teuthology.orchestra.run.smithi099.stdout: "max": 3758096384, 2024-02-21T23:12:56.842 INFO:teuthology.orchestra.run.smithi099.stdout: "get_started": 0, 2024-02-21T23:12:56.842 INFO:teuthology.orchestra.run.smithi099.stdout: "get": 0, 2024-02-21T23:12:56.842 INFO:teuthology.orchestra.run.smithi099.stdout: "get_sum": 0, 2024-02-21T23:12:56.842 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_fail": 0, 2024-02-21T23:12:56.842 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_success": 0, 2024-02-21T23:12:56.842 INFO:teuthology.orchestra.run.smithi099.stdout: "take": 0, 2024-02-21T23:12:56.842 INFO:teuthology.orchestra.run.smithi099.stdout: "take_sum": 0, 2024-02-21T23:12:56.842 INFO:teuthology.orchestra.run.smithi099.stdout: "put": 0, 2024-02-21T23:12:56.843 INFO:teuthology.orchestra.run.smithi099.stdout: "put_sum": 0, 2024-02-21T23:12:56.843 INFO:teuthology.orchestra.run.smithi099.stdout: "wait": { 2024-02-21T23:12:56.843 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:56.843 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:56.843 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:56.843 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:56.843 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:56.843 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-02-21T23:12:56.845 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2024-02-21T23:12:56.845 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2024-02-21T23:12:56.845 INFO:tasks.check_counter:Daemon mds.g mds.root_rsnaps=6 2024-02-21T23:12:56.845 INFO:tasks.check_counter:Daemon mds.g mds_server.req_mksnap_latency.avgcount=0 2024-02-21T23:12:56.846 INFO:tasks.check_counter:Daemon mds.g mds_server.req_rmsnap_latency.avgcount=0 2024-02-21T23:12:56.846 INFO:tasks.check_counter:Daemon mds.g mds.dir_split=0 2024-02-21T23:12:56.846 DEBUG:tasks.check_counter:Getting stats from j 2024-02-21T23:12:56.846 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.j.asok perf dump 2024-02-21T23:12:57.058 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-02-21T23:12:57.058 INFO:teuthology.orchestra.run.smithi099.stdout: "AsyncMessenger::Worker-0": { 2024-02-21T23:12:57.059 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_messages": 17290, 2024-02-21T23:12:57.059 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_messages": 17227, 2024-02-21T23:12:57.059 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_bytes": 4370190, 2024-02-21T23:12:57.059 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_bytes": 33410991, 2024-02-21T23:12:57.059 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_created_connections": 13, 2024-02-21T23:12:57.059 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_active_connections": 4, 2024-02-21T23:12:57.059 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_total_time": 1.845379469, 2024-02-21T23:12:57.059 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_send_time": 0.670216548, 2024-02-21T23:12:57.060 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_recv_time": 0.398246593, 2024-02-21T23:12:57.060 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_fast_dispatch_time": 0.559944836, 2024-02-21T23:12:57.060 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_messages_queue_lat": { 2024-02-21T23:12:57.060 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 17226, 2024-02-21T23:12:57.060 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 4.218561085, 2024-02-21T23:12:57.064 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000244894 2024-02-21T23:12:57.064 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:57.064 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_handle_ack_lat": { 2024-02-21T23:12:57.064 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 974, 2024-02-21T23:12:57.064 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000351588, 2024-02-21T23:12:57.065 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000360 2024-02-21T23:12:57.065 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:57.065 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_encrypted_bytes": 0, 2024-02-21T23:12:57.065 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_encrypted_bytes": 0 2024-02-21T23:12:57.065 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:57.065 INFO:teuthology.orchestra.run.smithi099.stdout: "AsyncMessenger::Worker-1": { 2024-02-21T23:12:57.065 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_messages": 18222, 2024-02-21T23:12:57.065 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_messages": 17691, 2024-02-21T23:12:57.065 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_bytes": 5068120, 2024-02-21T23:12:57.066 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_bytes": 24690680, 2024-02-21T23:12:57.066 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_created_connections": 161, 2024-02-21T23:12:57.066 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_active_connections": 5, 2024-02-21T23:12:57.066 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_total_time": 2.353090512, 2024-02-21T23:12:57.066 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_send_time": 1.019930983, 2024-02-21T23:12:57.066 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_recv_time": 0.545733137, 2024-02-21T23:12:57.066 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_fast_dispatch_time": 0.585478185, 2024-02-21T23:12:57.066 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_messages_queue_lat": { 2024-02-21T23:12:57.067 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 17688, 2024-02-21T23:12:57.067 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 4.032953700, 2024-02-21T23:12:57.067 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000228005 2024-02-21T23:12:57.067 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:57.067 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_handle_ack_lat": { 2024-02-21T23:12:57.067 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 1249, 2024-02-21T23:12:57.067 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000244789, 2024-02-21T23:12:57.068 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000195 2024-02-21T23:12:57.068 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:57.068 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_encrypted_bytes": 390832, 2024-02-21T23:12:57.068 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_encrypted_bytes": 490272 2024-02-21T23:12:57.068 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:57.068 INFO:teuthology.orchestra.run.smithi099.stdout: "AsyncMessenger::Worker-2": { 2024-02-21T23:12:57.068 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_messages": 42703, 2024-02-21T23:12:57.069 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_messages": 56428, 2024-02-21T23:12:57.069 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_bytes": 14642861, 2024-02-21T23:12:57.069 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_bytes": 30619182, 2024-02-21T23:12:57.069 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_created_connections": 20, 2024-02-21T23:12:57.069 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_active_connections": 6, 2024-02-21T23:12:57.069 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_total_time": 6.087232435, 2024-02-21T23:12:57.070 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_send_time": 3.864064013, 2024-02-21T23:12:57.070 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_recv_time": 2.864272388, 2024-02-21T23:12:57.070 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_running_fast_dispatch_time": 0.592167063, 2024-02-21T23:12:57.070 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_messages_queue_lat": { 2024-02-21T23:12:57.070 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 56428, 2024-02-21T23:12:57.070 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 5.546896026, 2024-02-21T23:12:57.070 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000098300 2024-02-21T23:12:57.070 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:57.071 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_handle_ack_lat": { 2024-02-21T23:12:57.071 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 35388, 2024-02-21T23:12:57.071 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.010370793, 2024-02-21T23:12:57.071 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000293 2024-02-21T23:12:57.071 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:57.071 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_recv_encrypted_bytes": 1604144, 2024-02-21T23:12:57.071 INFO:teuthology.orchestra.run.smithi099.stdout: "msgr_send_encrypted_bytes": 150880 2024-02-21T23:12:57.071 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:57.072 INFO:teuthology.orchestra.run.smithi099.stdout: "cct": { 2024-02-21T23:12:57.072 INFO:teuthology.orchestra.run.smithi099.stdout: "total_workers": 1, 2024-02-21T23:12:57.072 INFO:teuthology.orchestra.run.smithi099.stdout: "unhealthy_workers": 0 2024-02-21T23:12:57.072 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:57.072 INFO:teuthology.orchestra.run.smithi099.stdout: "finisher-MDSRank": { 2024-02-21T23:12:57.072 INFO:teuthology.orchestra.run.smithi099.stdout: "queue_len": 0, 2024-02-21T23:12:57.072 INFO:teuthology.orchestra.run.smithi099.stdout: "complete_latency": { 2024-02-21T23:12:57.072 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 30232, 2024-02-21T23:12:57.073 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 22.755374192, 2024-02-21T23:12:57.073 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000752691 2024-02-21T23:12:57.073 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:57.073 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:57.073 INFO:teuthology.orchestra.run.smithi099.stdout: "finisher-PurgeQueue": { 2024-02-21T23:12:57.073 INFO:teuthology.orchestra.run.smithi099.stdout: "queue_len": 0, 2024-02-21T23:12:57.073 INFO:teuthology.orchestra.run.smithi099.stdout: "complete_latency": { 2024-02-21T23:12:57.073 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 3634, 2024-02-21T23:12:57.074 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 1.543339948, 2024-02-21T23:12:57.074 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000424694 2024-02-21T23:12:57.074 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:57.074 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:57.074 INFO:teuthology.orchestra.run.smithi099.stdout: "mds": { 2024-02-21T23:12:57.074 INFO:teuthology.orchestra.run.smithi099.stdout: "request": 10908, 2024-02-21T23:12:57.074 INFO:teuthology.orchestra.run.smithi099.stdout: "reply": 10885, 2024-02-21T23:12:57.074 INFO:teuthology.orchestra.run.smithi099.stdout: "reply_latency": { 2024-02-21T23:12:57.075 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 10885, 2024-02-21T23:12:57.075 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 637.725323719, 2024-02-21T23:12:57.075 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.058587535 2024-02-21T23:12:57.075 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:57.075 INFO:teuthology.orchestra.run.smithi099.stdout: "slow_reply": 0, 2024-02-21T23:12:57.075 INFO:teuthology.orchestra.run.smithi099.stdout: "forward": 23, 2024-02-21T23:12:57.075 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_fetch_complete": 0, 2024-02-21T23:12:57.075 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_fetch_keys": 0, 2024-02-21T23:12:57.076 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_commit": 227, 2024-02-21T23:12:57.076 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_split": 26, 2024-02-21T23:12:57.076 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_merge": 1, 2024-02-21T23:12:57.076 INFO:teuthology.orchestra.run.smithi099.stdout: "inodes": 5431, 2024-02-21T23:12:57.076 INFO:teuthology.orchestra.run.smithi099.stdout: "inodes_top": 543, 2024-02-21T23:12:57.076 INFO:teuthology.orchestra.run.smithi099.stdout: "inodes_bottom": 4607, 2024-02-21T23:12:57.076 INFO:teuthology.orchestra.run.smithi099.stdout: "inodes_pin_tail": 281, 2024-02-21T23:12:57.077 INFO:teuthology.orchestra.run.smithi099.stdout: "inodes_pinned": 4656, 2024-02-21T23:12:57.077 INFO:teuthology.orchestra.run.smithi099.stdout: "inodes_expired": 872, 2024-02-21T23:12:57.077 INFO:teuthology.orchestra.run.smithi099.stdout: "inodes_with_caps": 1933, 2024-02-21T23:12:57.077 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": 1934, 2024-02-21T23:12:57.077 INFO:teuthology.orchestra.run.smithi099.stdout: "subtrees": 88, 2024-02-21T23:12:57.077 INFO:teuthology.orchestra.run.smithi099.stdout: "traverse": 12191, 2024-02-21T23:12:57.077 INFO:teuthology.orchestra.run.smithi099.stdout: "traverse_hit": 11612, 2024-02-21T23:12:57.077 INFO:teuthology.orchestra.run.smithi099.stdout: "traverse_forward": 23, 2024-02-21T23:12:57.077 INFO:teuthology.orchestra.run.smithi099.stdout: "traverse_discover": 0, 2024-02-21T23:12:57.078 INFO:teuthology.orchestra.run.smithi099.stdout: "traverse_dir_fetch": 0, 2024-02-21T23:12:57.078 INFO:teuthology.orchestra.run.smithi099.stdout: "traverse_remote_ino": 0, 2024-02-21T23:12:57.078 INFO:teuthology.orchestra.run.smithi099.stdout: "traverse_lock": 12, 2024-02-21T23:12:57.078 INFO:teuthology.orchestra.run.smithi099.stdout: "load_cent": 0, 2024-02-21T23:12:57.078 INFO:teuthology.orchestra.run.smithi099.stdout: "q": 0, 2024-02-21T23:12:57.078 INFO:teuthology.orchestra.run.smithi099.stdout: "exported": 19, 2024-02-21T23:12:57.078 INFO:teuthology.orchestra.run.smithi099.stdout: "exported_inodes": 813, 2024-02-21T23:12:57.078 INFO:teuthology.orchestra.run.smithi099.stdout: "imported": 0, 2024-02-21T23:12:57.079 INFO:teuthology.orchestra.run.smithi099.stdout: "imported_inodes": 0, 2024-02-21T23:12:57.079 INFO:teuthology.orchestra.run.smithi099.stdout: "openino_dir_fetch": 0, 2024-02-21T23:12:57.079 INFO:teuthology.orchestra.run.smithi099.stdout: "openino_backtrace_fetch": 44578, 2024-02-21T23:12:57.079 INFO:teuthology.orchestra.run.smithi099.stdout: "openino_peer_discover": 0, 2024-02-21T23:12:57.079 INFO:teuthology.orchestra.run.smithi099.stdout: "root_rfiles": 3452, 2024-02-21T23:12:57.079 INFO:teuthology.orchestra.run.smithi099.stdout: "root_rbytes": 26460394, 2024-02-21T23:12:57.079 INFO:teuthology.orchestra.run.smithi099.stdout: "root_rsnaps": 6, 2024-02-21T23:12:57.079 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_backtrace_fetch": 44578, 2024-02-21T23:12:57.080 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_set_tag": 0, 2024-02-21T23:12:57.080 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_backtrace_repaired": 0, 2024-02-21T23:12:57.080 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_inotable_repaired": 0, 2024-02-21T23:12:57.080 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_dir_inodes": 1174, 2024-02-21T23:12:57.080 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_dir_base_inodes": 20, 2024-02-21T23:12:57.080 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_dirfrag_rstats": 1154, 2024-02-21T23:12:57.080 INFO:teuthology.orchestra.run.smithi099.stdout: "scrub_file_inodes": 43404, 2024-02-21T23:12:57.081 INFO:teuthology.orchestra.run.smithi099.stdout: "handle_inode_file_caps": 3, 2024-02-21T23:12:57.081 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_cap_op_revoke": 305, 2024-02-21T23:12:57.081 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_cap_op_grant": 9890, 2024-02-21T23:12:57.081 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_cap_op_trunc": 8, 2024-02-21T23:12:57.081 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-02-21T23:12:57.081 INFO:teuthology.orchestra.run.smithi099.stdout: "ceph_cap_op_flush_ack": 0, 2024-02-21T23:12:57.081 INFO:teuthology.orchestra.run.smithi099.stdout: "handle_client_caps": 11726, 2024-02-21T23:12:57.081 INFO:teuthology.orchestra.run.smithi099.stdout: "handle_client_caps_dirty": 6332, 2024-02-21T23:12:57.082 INFO:teuthology.orchestra.run.smithi099.stdout: "handle_client_cap_release": 722, 2024-02-21T23:12:57.082 INFO:teuthology.orchestra.run.smithi099.stdout: "process_request_cap_release": 3894 2024-02-21T23:12:57.082 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:57.082 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_cache": { 2024-02-21T23:12:57.082 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_update": 1, 2024-02-21T23:12:57.082 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_update_receipt": 0, 2024-02-21T23:12:57.082 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_try_discover": 0, 2024-02-21T23:12:57.082 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_send_discover": 0, 2024-02-21T23:12:57.082 INFO:teuthology.orchestra.run.smithi099.stdout: "dir_handle_discover": 18, 2024-02-21T23:12:57.083 INFO:teuthology.orchestra.run.smithi099.stdout: "num_strays": 1, 2024-02-21T23:12:57.083 INFO:teuthology.orchestra.run.smithi099.stdout: "num_strays_delayed": 0, 2024-02-21T23:12:57.083 INFO:teuthology.orchestra.run.smithi099.stdout: "num_strays_enqueuing": 0, 2024-02-21T23:12:57.083 INFO:teuthology.orchestra.run.smithi099.stdout: "strays_created": 2653, 2024-02-21T23:12:57.083 INFO:teuthology.orchestra.run.smithi099.stdout: "strays_enqueued": 2650, 2024-02-21T23:12:57.083 INFO:teuthology.orchestra.run.smithi099.stdout: "strays_reintegrated": 2, 2024-02-21T23:12:57.083 INFO:teuthology.orchestra.run.smithi099.stdout: "strays_migrated": 0, 2024-02-21T23:12:57.084 INFO:teuthology.orchestra.run.smithi099.stdout: "num_recovering_processing": 0, 2024-02-21T23:12:57.084 INFO:teuthology.orchestra.run.smithi099.stdout: "num_recovering_enqueued": 0, 2024-02-21T23:12:57.084 INFO:teuthology.orchestra.run.smithi099.stdout: "num_recovering_prioritized": 0, 2024-02-21T23:12:57.084 INFO:teuthology.orchestra.run.smithi099.stdout: "recovery_started": 0, 2024-02-21T23:12:57.084 INFO:teuthology.orchestra.run.smithi099.stdout: "recovery_completed": 0, 2024-02-21T23:12:57.084 INFO:teuthology.orchestra.run.smithi099.stdout: "ireq_enqueue_scrub": 20, 2024-02-21T23:12:57.084 INFO:teuthology.orchestra.run.smithi099.stdout: "ireq_exportdir": 19, 2024-02-21T23:12:57.084 INFO:teuthology.orchestra.run.smithi099.stdout: "ireq_flush": 0, 2024-02-21T23:12:57.085 INFO:teuthology.orchestra.run.smithi099.stdout: "ireq_fragmentdir": 27, 2024-02-21T23:12:57.085 INFO:teuthology.orchestra.run.smithi099.stdout: "ireq_fragstats": 0, 2024-02-21T23:12:57.085 INFO:teuthology.orchestra.run.smithi099.stdout: "ireq_inodestats": 0 2024-02-21T23:12:57.085 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:57.085 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_log": { 2024-02-21T23:12:57.085 INFO:teuthology.orchestra.run.smithi099.stdout: "evlrg": 0, 2024-02-21T23:12:57.085 INFO:teuthology.orchestra.run.smithi099.stdout: "evadd": 23296, 2024-02-21T23:12:57.085 INFO:teuthology.orchestra.run.smithi099.stdout: "evex": 0, 2024-02-21T23:12:57.086 INFO:teuthology.orchestra.run.smithi099.stdout: "evtrm": 0, 2024-02-21T23:12:57.086 INFO:teuthology.orchestra.run.smithi099.stdout: "ev": 23296, 2024-02-21T23:12:57.086 INFO:teuthology.orchestra.run.smithi099.stdout: "evexg": 0, 2024-02-21T23:12:57.086 INFO:teuthology.orchestra.run.smithi099.stdout: "evexd": 0, 2024-02-21T23:12:57.086 INFO:teuthology.orchestra.run.smithi099.stdout: "segadd": 30, 2024-02-21T23:12:57.086 INFO:teuthology.orchestra.run.smithi099.stdout: "segex": 0, 2024-02-21T23:12:57.086 INFO:teuthology.orchestra.run.smithi099.stdout: "segtrm": 0, 2024-02-21T23:12:57.086 INFO:teuthology.orchestra.run.smithi099.stdout: "seg": 30, 2024-02-21T23:12:57.086 INFO:teuthology.orchestra.run.smithi099.stdout: "segmjr": 3, 2024-02-21T23:12:57.087 INFO:teuthology.orchestra.run.smithi099.stdout: "segexg": 0, 2024-02-21T23:12:57.087 INFO:teuthology.orchestra.run.smithi099.stdout: "segexd": 0, 2024-02-21T23:12:57.087 INFO:teuthology.orchestra.run.smithi099.stdout: "expos": 4194304, 2024-02-21T23:12:57.087 INFO:teuthology.orchestra.run.smithi099.stdout: "wrpos": 58392084, 2024-02-21T23:12:57.087 INFO:teuthology.orchestra.run.smithi099.stdout: "rdpos": 0, 2024-02-21T23:12:57.087 INFO:teuthology.orchestra.run.smithi099.stdout: "jlat": { 2024-02-21T23:12:57.087 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 478, 2024-02-21T23:12:57.087 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 20.883270776, 2024-02-21T23:12:57.088 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.043688850 2024-02-21T23:12:57.088 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:57.088 INFO:teuthology.orchestra.run.smithi099.stdout: "replayed": 0 2024-02-21T23:12:57.088 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:57.088 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_mem": { 2024-02-21T23:12:57.088 INFO:teuthology.orchestra.run.smithi099.stdout: "ino": 3166, 2024-02-21T23:12:57.088 INFO:teuthology.orchestra.run.smithi099.stdout: "ino+": 6644, 2024-02-21T23:12:57.089 INFO:teuthology.orchestra.run.smithi099.stdout: "ino-": 3478, 2024-02-21T23:12:57.089 INFO:teuthology.orchestra.run.smithi099.stdout: "dir": 265, 2024-02-21T23:12:57.089 INFO:teuthology.orchestra.run.smithi099.stdout: "dir+": 308, 2024-02-21T23:12:57.089 INFO:teuthology.orchestra.run.smithi099.stdout: "dir-": 43, 2024-02-21T23:12:57.089 INFO:teuthology.orchestra.run.smithi099.stdout: "dn": 5431, 2024-02-21T23:12:57.089 INFO:teuthology.orchestra.run.smithi099.stdout: "dn+": 8005, 2024-02-21T23:12:57.089 INFO:teuthology.orchestra.run.smithi099.stdout: "dn-": 2574, 2024-02-21T23:12:57.089 INFO:teuthology.orchestra.run.smithi099.stdout: "cap": 1934, 2024-02-21T23:12:57.089 INFO:teuthology.orchestra.run.smithi099.stdout: "cap+": 6442, 2024-02-21T23:12:57.090 INFO:teuthology.orchestra.run.smithi099.stdout: "cap-": 4508, 2024-02-21T23:12:57.090 INFO:teuthology.orchestra.run.smithi099.stdout: "rss": 97008, 2024-02-21T23:12:57.090 INFO:teuthology.orchestra.run.smithi099.stdout: "heap": 231780 2024-02-21T23:12:57.090 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:57.090 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_server": { 2024-02-21T23:12:57.090 INFO:teuthology.orchestra.run.smithi099.stdout: "dispatch_client_request": 11221, 2024-02-21T23:12:57.090 INFO:teuthology.orchestra.run.smithi099.stdout: "dispatch_server_request": 8, 2024-02-21T23:12:57.090 INFO:teuthology.orchestra.run.smithi099.stdout: "handle_client_request": 10908, 2024-02-21T23:12:57.091 INFO:teuthology.orchestra.run.smithi099.stdout: "handle_client_session": 50, 2024-02-21T23:12:57.091 INFO:teuthology.orchestra.run.smithi099.stdout: "handle_peer_request": 18, 2024-02-21T23:12:57.091 INFO:teuthology.orchestra.run.smithi099.stdout: "req_create_latency": { 2024-02-21T23:12:57.091 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 6342, 2024-02-21T23:12:57.091 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 626.278138709, 2024-02-21T23:12:57.091 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.098750889 2024-02-21T23:12:57.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:57.091 INFO:teuthology.orchestra.run.smithi099.stdout: "req_getattr_latency": { 2024-02-21T23:12:57.092 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 191, 2024-02-21T23:12:57.092 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.193329529, 2024-02-21T23:12:57.092 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.001012196 2024-02-21T23:12:57.092 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:57.092 INFO:teuthology.orchestra.run.smithi099.stdout: "req_getfilelock_latency": { 2024-02-21T23:12:57.092 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:57.092 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:57.092 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:57.093 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:57.093 INFO:teuthology.orchestra.run.smithi099.stdout: "req_link_latency": { 2024-02-21T23:12:57.093 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 2, 2024-02-21T23:12:57.093 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.003571505, 2024-02-21T23:12:57.093 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.001785752 2024-02-21T23:12:57.093 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:57.093 INFO:teuthology.orchestra.run.smithi099.stdout: "req_lookup_latency": { 2024-02-21T23:12:57.093 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 964, 2024-02-21T23:12:57.094 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.659756810, 2024-02-21T23:12:57.094 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000684395 2024-02-21T23:12:57.094 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:57.094 INFO:teuthology.orchestra.run.smithi099.stdout: "req_lookuphash_latency": { 2024-02-21T23:12:57.094 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:57.094 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:57.094 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:57.094 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:57.094 INFO:teuthology.orchestra.run.smithi099.stdout: "req_lookupino_latency": { 2024-02-21T23:12:57.095 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 2, 2024-02-21T23:12:57.095 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000299536, 2024-02-21T23:12:57.095 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000149768 2024-02-21T23:12:57.095 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:57.095 INFO:teuthology.orchestra.run.smithi099.stdout: "req_lookupname_latency": { 2024-02-21T23:12:57.095 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:57.095 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:57.095 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:57.096 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:57.096 INFO:teuthology.orchestra.run.smithi099.stdout: "req_lookupparent_latency": { 2024-02-21T23:12:57.096 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:57.097 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:57.097 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:57.097 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:57.097 INFO:teuthology.orchestra.run.smithi099.stdout: "req_lookupsnap_latency": { 2024-02-21T23:12:57.097 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:57.097 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:57.097 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:57.097 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:57.098 INFO:teuthology.orchestra.run.smithi099.stdout: "req_lssnap_latency": { 2024-02-21T23:12:57.098 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 10, 2024-02-21T23:12:57.098 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.003711991, 2024-02-21T23:12:57.098 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000371199 2024-02-21T23:12:57.098 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:57.098 INFO:teuthology.orchestra.run.smithi099.stdout: "req_mkdir_latency": { 2024-02-21T23:12:57.098 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 85, 2024-02-21T23:12:57.099 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 1.511749604, 2024-02-21T23:12:57.099 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.017785289 2024-02-21T23:12:57.099 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:57.099 INFO:teuthology.orchestra.run.smithi099.stdout: "req_mknod_latency": { 2024-02-21T23:12:57.099 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:57.099 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:57.099 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:57.099 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:57.100 INFO:teuthology.orchestra.run.smithi099.stdout: "req_mksnap_latency": { 2024-02-21T23:12:57.100 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 10, 2024-02-21T23:12:57.100 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.392430348, 2024-02-21T23:12:57.100 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.039243034 2024-02-21T23:12:57.100 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:57.100 INFO:teuthology.orchestra.run.smithi099.stdout: "req_open_latency": { 2024-02-21T23:12:57.100 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 438, 2024-02-21T23:12:57.100 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.753315028, 2024-02-21T23:12:57.101 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.001719897 2024-02-21T23:12:57.101 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:57.101 INFO:teuthology.orchestra.run.smithi099.stdout: "req_readdir_latency": { 2024-02-21T23:12:57.101 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 106, 2024-02-21T23:12:57.101 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 1.078763637, 2024-02-21T23:12:57.101 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.010177015 2024-02-21T23:12:57.101 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:57.101 INFO:teuthology.orchestra.run.smithi099.stdout: "req_rename_latency": { 2024-02-21T23:12:57.102 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 81, 2024-02-21T23:12:57.102 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.257606875, 2024-02-21T23:12:57.102 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.003180331 2024-02-21T23:12:57.102 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:57.102 INFO:teuthology.orchestra.run.smithi099.stdout: "req_renamesnap_latency": { 2024-02-21T23:12:57.102 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:57.102 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:57.102 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:57.103 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:57.103 INFO:teuthology.orchestra.run.smithi099.stdout: "req_snapdiff_latency": { 2024-02-21T23:12:57.103 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:57.103 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:57.103 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:57.103 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:57.103 INFO:teuthology.orchestra.run.smithi099.stdout: "req_rmdir_latency": { 2024-02-21T23:12:57.103 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 22, 2024-02-21T23:12:57.104 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.940445416, 2024-02-21T23:12:57.104 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.042747518 2024-02-21T23:12:57.104 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:57.104 INFO:teuthology.orchestra.run.smithi099.stdout: "req_rmsnap_latency": { 2024-02-21T23:12:57.104 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 4, 2024-02-21T23:12:57.104 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.023779183, 2024-02-21T23:12:57.104 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.005944795 2024-02-21T23:12:57.105 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:57.105 INFO:teuthology.orchestra.run.smithi099.stdout: "req_rmxattr_latency": { 2024-02-21T23:12:57.105 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:57.105 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:57.105 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:57.105 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:57.105 INFO:teuthology.orchestra.run.smithi099.stdout: "req_setattr_latency": { 2024-02-21T23:12:57.105 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 10, 2024-02-21T23:12:57.105 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.456110864, 2024-02-21T23:12:57.106 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.045611086 2024-02-21T23:12:57.106 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:57.106 INFO:teuthology.orchestra.run.smithi099.stdout: "req_setdirlayout_latency": { 2024-02-21T23:12:57.106 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:57.106 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:57.106 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:57.106 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:57.106 INFO:teuthology.orchestra.run.smithi099.stdout: "req_setfilelock_latency": { 2024-02-21T23:12:57.107 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 8, 2024-02-21T23:12:57.107 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.007348849, 2024-02-21T23:12:57.107 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000918606 2024-02-21T23:12:57.107 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:57.107 INFO:teuthology.orchestra.run.smithi099.stdout: "req_setlayout_latency": { 2024-02-21T23:12:57.107 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:57.107 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:57.108 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:57.108 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:57.108 INFO:teuthology.orchestra.run.smithi099.stdout: "req_setxattr_latency": { 2024-02-21T23:12:57.108 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 9, 2024-02-21T23:12:57.108 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.034026662, 2024-02-21T23:12:57.108 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.003780740 2024-02-21T23:12:57.108 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:57.108 INFO:teuthology.orchestra.run.smithi099.stdout: "req_symlink_latency": { 2024-02-21T23:12:57.109 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 7, 2024-02-21T23:12:57.109 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.006320558, 2024-02-21T23:12:57.109 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000902936 2024-02-21T23:12:57.109 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:57.109 INFO:teuthology.orchestra.run.smithi099.stdout: "req_unlink_latency": { 2024-02-21T23:12:57.109 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 2594, 2024-02-21T23:12:57.109 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 5.124618615, 2024-02-21T23:12:57.109 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.001975566 2024-02-21T23:12:57.110 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:57.110 INFO:teuthology.orchestra.run.smithi099.stdout: "cap_revoke_eviction": 0, 2024-02-21T23:12:57.110 INFO:teuthology.orchestra.run.smithi099.stdout: "cap_acquisition_throttle": 0, 2024-02-21T23:12:57.110 INFO:teuthology.orchestra.run.smithi099.stdout: "req_getvxattr_latency": { 2024-02-21T23:12:57.110 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:57.110 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:57.110 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:57.110 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:57.111 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:57.111 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_sessions": { 2024-02-21T23:12:57.111 INFO:teuthology.orchestra.run.smithi099.stdout: "session_count": 2, 2024-02-21T23:12:57.111 INFO:teuthology.orchestra.run.smithi099.stdout: "session_add": 5, 2024-02-21T23:12:57.111 INFO:teuthology.orchestra.run.smithi099.stdout: "session_remove": 3, 2024-02-21T23:12:57.111 INFO:teuthology.orchestra.run.smithi099.stdout: "sessions_open": 2, 2024-02-21T23:12:57.111 INFO:teuthology.orchestra.run.smithi099.stdout: "sessions_stale": 0, 2024-02-21T23:12:57.111 INFO:teuthology.orchestra.run.smithi099.stdout: "total_load": 78, 2024-02-21T23:12:57.112 INFO:teuthology.orchestra.run.smithi099.stdout: "average_load": 39, 2024-02-21T23:12:57.112 INFO:teuthology.orchestra.run.smithi099.stdout: "avg_session_uptime": 624, 2024-02-21T23:12:57.112 INFO:teuthology.orchestra.run.smithi099.stdout: "mdthresh_evicted": 0 2024-02-21T23:12:57.112 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:57.112 INFO:teuthology.orchestra.run.smithi099.stdout: "mempool": { 2024-02-21T23:12:57.112 INFO:teuthology.orchestra.run.smithi099.stdout: "bloom_filter_bytes": 0, 2024-02-21T23:12:57.112 INFO:teuthology.orchestra.run.smithi099.stdout: "bloom_filter_items": 0, 2024-02-21T23:12:57.112 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_alloc_bytes": 0, 2024-02-21T23:12:57.113 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_alloc_items": 0, 2024-02-21T23:12:57.113 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_data_bytes": 0, 2024-02-21T23:12:57.113 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_data_items": 0, 2024-02-21T23:12:57.113 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_onode_bytes": 0, 2024-02-21T23:12:57.113 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_onode_items": 0, 2024-02-21T23:12:57.113 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_meta_bytes": 0, 2024-02-21T23:12:57.113 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_meta_items": 0, 2024-02-21T23:12:57.113 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_other_bytes": 0, 2024-02-21T23:12:57.114 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_other_items": 0, 2024-02-21T23:12:57.114 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_buffer_bytes": 0, 2024-02-21T23:12:57.114 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_buffer_items": 0, 2024-02-21T23:12:57.114 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_extent_bytes": 0, 2024-02-21T23:12:57.114 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_extent_items": 0, 2024-02-21T23:12:57.114 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_blob_bytes": 0, 2024-02-21T23:12:57.114 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_blob_items": 0, 2024-02-21T23:12:57.114 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_shared_blob_bytes": 0, 2024-02-21T23:12:57.115 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_shared_blob_items": 0, 2024-02-21T23:12:57.115 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_inline_bl_bytes": 0, 2024-02-21T23:12:57.115 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_inline_bl_items": 0, 2024-02-21T23:12:57.115 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_fsck_bytes": 0, 2024-02-21T23:12:57.115 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_fsck_items": 0, 2024-02-21T23:12:57.115 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_txc_bytes": 0, 2024-02-21T23:12:57.115 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_txc_items": 0, 2024-02-21T23:12:57.115 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_writing_deferred_bytes": 0, 2024-02-21T23:12:57.116 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_writing_deferred_items": 0, 2024-02-21T23:12:57.116 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_writing_bytes": 0, 2024-02-21T23:12:57.116 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_writing_items": 0, 2024-02-21T23:12:57.116 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_bytes": 0, 2024-02-21T23:12:57.116 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_items": 0, 2024-02-21T23:12:57.116 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_file_reader_bytes": 0, 2024-02-21T23:12:57.116 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_file_reader_items": 0, 2024-02-21T23:12:57.116 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_file_writer_bytes": 0, 2024-02-21T23:12:57.117 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_file_writer_items": 0, 2024-02-21T23:12:57.117 INFO:teuthology.orchestra.run.smithi099.stdout: "buffer_anon_bytes": 429251, 2024-02-21T23:12:57.117 INFO:teuthology.orchestra.run.smithi099.stdout: "buffer_anon_items": 3211, 2024-02-21T23:12:57.117 INFO:teuthology.orchestra.run.smithi099.stdout: "buffer_meta_bytes": 1584, 2024-02-21T23:12:57.117 INFO:teuthology.orchestra.run.smithi099.stdout: "buffer_meta_items": 18, 2024-02-21T23:12:57.117 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_bytes": 0, 2024-02-21T23:12:57.117 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_items": 0, 2024-02-21T23:12:57.118 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_mapbl_bytes": 0, 2024-02-21T23:12:57.118 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_mapbl_items": 0, 2024-02-21T23:12:57.118 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_pglog_bytes": 0, 2024-02-21T23:12:57.118 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_pglog_items": 0, 2024-02-21T23:12:57.118 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_bytes": 8136, 2024-02-21T23:12:57.118 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_items": 153, 2024-02-21T23:12:57.118 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_mapping_bytes": 0, 2024-02-21T23:12:57.118 INFO:teuthology.orchestra.run.smithi099.stdout: "osdmap_mapping_items": 0, 2024-02-21T23:12:57.119 INFO:teuthology.orchestra.run.smithi099.stdout: "pgmap_bytes": 0, 2024-02-21T23:12:57.119 INFO:teuthology.orchestra.run.smithi099.stdout: "pgmap_items": 0, 2024-02-21T23:12:57.119 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_co_bytes": 12510803, 2024-02-21T23:12:57.119 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_co_items": 154332, 2024-02-21T23:12:57.119 INFO:teuthology.orchestra.run.smithi099.stdout: "unittest_1_bytes": 0, 2024-02-21T23:12:57.119 INFO:teuthology.orchestra.run.smithi099.stdout: "unittest_1_items": 0, 2024-02-21T23:12:57.119 INFO:teuthology.orchestra.run.smithi099.stdout: "unittest_2_bytes": 0, 2024-02-21T23:12:57.119 INFO:teuthology.orchestra.run.smithi099.stdout: "unittest_2_items": 0 2024-02-21T23:12:57.120 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:57.120 INFO:teuthology.orchestra.run.smithi099.stdout: "objecter": { 2024-02-21T23:12:57.120 INFO:teuthology.orchestra.run.smithi099.stdout: "op_active": 0, 2024-02-21T23:12:57.120 INFO:teuthology.orchestra.run.smithi099.stdout: "op_laggy": 0, 2024-02-21T23:12:57.120 INFO:teuthology.orchestra.run.smithi099.stdout: "op_send": 51402, 2024-02-21T23:12:57.120 INFO:teuthology.orchestra.run.smithi099.stdout: "op_send_bytes": 59341017, 2024-02-21T23:12:57.120 INFO:teuthology.orchestra.run.smithi099.stdout: "op_resend": 31, 2024-02-21T23:12:57.120 INFO:teuthology.orchestra.run.smithi099.stdout: "op_reply": 51402, 2024-02-21T23:12:57.121 INFO:teuthology.orchestra.run.smithi099.stdout: "op_latency": { 2024-02-21T23:12:57.121 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 51402, 2024-02-21T23:12:57.121 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 87.306974954, 2024-02-21T23:12:57.121 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.001698513 2024-02-21T23:12:57.121 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:57.121 INFO:teuthology.orchestra.run.smithi099.stdout: "op_inflight": 0, 2024-02-21T23:12:57.121 INFO:teuthology.orchestra.run.smithi099.stdout: "oplen_avg": { 2024-02-21T23:12:57.121 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 51402, 2024-02-21T23:12:57.122 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 51752 2024-02-21T23:12:57.122 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:57.122 INFO:teuthology.orchestra.run.smithi099.stdout: "op": 51402, 2024-02-21T23:12:57.122 INFO:teuthology.orchestra.run.smithi099.stdout: "op_r": 44661, 2024-02-21T23:12:57.122 INFO:teuthology.orchestra.run.smithi099.stdout: "op_w": 6741, 2024-02-21T23:12:57.122 INFO:teuthology.orchestra.run.smithi099.stdout: "op_rmw": 0, 2024-02-21T23:12:57.122 INFO:teuthology.orchestra.run.smithi099.stdout: "op_pg": 0, 2024-02-21T23:12:57.122 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_stat": 0, 2024-02-21T23:12:57.123 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_create": 11, 2024-02-21T23:12:57.123 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_read": 63, 2024-02-21T23:12:57.123 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_write": 521, 2024-02-21T23:12:57.123 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_writefull": 49, 2024-02-21T23:12:57.123 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_writesame": 0, 2024-02-21T23:12:57.123 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_append": 0, 2024-02-21T23:12:57.123 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_zero": 0, 2024-02-21T23:12:57.123 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_truncate": 10, 2024-02-21T23:12:57.124 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_delete": 5834, 2024-02-21T23:12:57.124 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_mapext": 0, 2024-02-21T23:12:57.124 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_sparse_read": 0, 2024-02-21T23:12:57.124 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_clonerange": 0, 2024-02-21T23:12:57.124 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_getxattr": 44598, 2024-02-21T23:12:57.124 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_setxattr": 22, 2024-02-21T23:12:57.124 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_cmpxattr": 0, 2024-02-21T23:12:57.124 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_rmxattr": 0, 2024-02-21T23:12:57.125 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_resetxattrs": 0, 2024-02-21T23:12:57.125 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_call": 0, 2024-02-21T23:12:57.125 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_watch": 0, 2024-02-21T23:12:57.125 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_notify": 0, 2024-02-21T23:12:57.125 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_src_cmpxattr": 0, 2024-02-21T23:12:57.125 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_pgls": 0, 2024-02-21T23:12:57.125 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_pgls_filter": 0, 2024-02-21T23:12:57.125 INFO:teuthology.orchestra.run.smithi099.stdout: "osdop_other": 8, 2024-02-21T23:12:57.126 INFO:teuthology.orchestra.run.smithi099.stdout: "linger_active": 0, 2024-02-21T23:12:57.126 INFO:teuthology.orchestra.run.smithi099.stdout: "linger_send": 0, 2024-02-21T23:12:57.126 INFO:teuthology.orchestra.run.smithi099.stdout: "linger_resend": 0, 2024-02-21T23:12:57.126 INFO:teuthology.orchestra.run.smithi099.stdout: "linger_ping": 0, 2024-02-21T23:12:57.126 INFO:teuthology.orchestra.run.smithi099.stdout: "poolop_active": 0, 2024-02-21T23:12:57.126 INFO:teuthology.orchestra.run.smithi099.stdout: "poolop_send": 0, 2024-02-21T23:12:57.126 INFO:teuthology.orchestra.run.smithi099.stdout: "poolop_resend": 0, 2024-02-21T23:12:57.126 INFO:teuthology.orchestra.run.smithi099.stdout: "poolstat_active": 0, 2024-02-21T23:12:57.127 INFO:teuthology.orchestra.run.smithi099.stdout: "poolstat_send": 0, 2024-02-21T23:12:57.127 INFO:teuthology.orchestra.run.smithi099.stdout: "poolstat_resend": 0, 2024-02-21T23:12:57.127 INFO:teuthology.orchestra.run.smithi099.stdout: "statfs_active": 0, 2024-02-21T23:12:57.127 INFO:teuthology.orchestra.run.smithi099.stdout: "statfs_send": 0, 2024-02-21T23:12:57.127 INFO:teuthology.orchestra.run.smithi099.stdout: "statfs_resend": 0, 2024-02-21T23:12:57.127 INFO:teuthology.orchestra.run.smithi099.stdout: "command_active": 0, 2024-02-21T23:12:57.127 INFO:teuthology.orchestra.run.smithi099.stdout: "command_send": 0, 2024-02-21T23:12:57.127 INFO:teuthology.orchestra.run.smithi099.stdout: "command_resend": 0, 2024-02-21T23:12:57.128 INFO:teuthology.orchestra.run.smithi099.stdout: "map_epoch": 40, 2024-02-21T23:12:57.128 INFO:teuthology.orchestra.run.smithi099.stdout: "map_full": 0, 2024-02-21T23:12:57.128 INFO:teuthology.orchestra.run.smithi099.stdout: "map_inc": 16, 2024-02-21T23:12:57.128 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_sessions": 12, 2024-02-21T23:12:57.128 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_session_open": 12, 2024-02-21T23:12:57.128 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_session_close": 0, 2024-02-21T23:12:57.128 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_laggy": 0, 2024-02-21T23:12:57.128 INFO:teuthology.orchestra.run.smithi099.stdout: "omap_wr": 591, 2024-02-21T23:12:57.129 INFO:teuthology.orchestra.run.smithi099.stdout: "omap_rd": 0, 2024-02-21T23:12:57.129 INFO:teuthology.orchestra.run.smithi099.stdout: "omap_del": 45 2024-02-21T23:12:57.129 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:57.129 INFO:teuthology.orchestra.run.smithi099.stdout: "oft": { 2024-02-21T23:12:57.129 INFO:teuthology.orchestra.run.smithi099.stdout: "omap_total_objs": 1, 2024-02-21T23:12:57.129 INFO:teuthology.orchestra.run.smithi099.stdout: "omap_total_kv_pairs": 0, 2024-02-21T23:12:57.129 INFO:teuthology.orchestra.run.smithi099.stdout: "omap_total_updates": 0, 2024-02-21T23:12:57.129 INFO:teuthology.orchestra.run.smithi099.stdout: "omap_total_removes": 0 2024-02-21T23:12:57.129 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:57.130 INFO:teuthology.orchestra.run.smithi099.stdout: "osd-slow-ops": { 2024-02-21T23:12:57.130 INFO:teuthology.orchestra.run.smithi099.stdout: "slow_ops_count": 0 2024-02-21T23:12:57.130 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:57.130 INFO:teuthology.orchestra.run.smithi099.stdout: "purge_queue": { 2024-02-21T23:12:57.130 INFO:teuthology.orchestra.run.smithi099.stdout: "pq_executing_ops": 0, 2024-02-21T23:12:57.130 INFO:teuthology.orchestra.run.smithi099.stdout: "pq_executing_ops_high_water": 17, 2024-02-21T23:12:57.130 INFO:teuthology.orchestra.run.smithi099.stdout: "pq_executing": 0, 2024-02-21T23:12:57.130 INFO:teuthology.orchestra.run.smithi099.stdout: "pq_executing_high_water": 10, 2024-02-21T23:12:57.131 INFO:teuthology.orchestra.run.smithi099.stdout: "pq_executed_ops": 5286, 2024-02-21T23:12:57.131 INFO:teuthology.orchestra.run.smithi099.stdout: "pq_executed": 2650, 2024-02-21T23:12:57.131 INFO:teuthology.orchestra.run.smithi099.stdout: "pq_item_in_journal": 0 2024-02-21T23:12:57.131 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:57.131 INFO:teuthology.orchestra.run.smithi099.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-02-21T23:12:57.131 INFO:teuthology.orchestra.run.smithi099.stdout: "val": 0, 2024-02-21T23:12:57.131 INFO:teuthology.orchestra.run.smithi099.stdout: "max": 104857600, 2024-02-21T23:12:57.131 INFO:teuthology.orchestra.run.smithi099.stdout: "get_started": 0, 2024-02-21T23:12:57.132 INFO:teuthology.orchestra.run.smithi099.stdout: "get": 78210, 2024-02-21T23:12:57.132 INFO:teuthology.orchestra.run.smithi099.stdout: "get_sum": 17361372, 2024-02-21T23:12:57.132 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_fail": 0, 2024-02-21T23:12:57.132 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_success": 78210, 2024-02-21T23:12:57.132 INFO:teuthology.orchestra.run.smithi099.stdout: "take": 0, 2024-02-21T23:12:57.132 INFO:teuthology.orchestra.run.smithi099.stdout: "take_sum": 0, 2024-02-21T23:12:57.132 INFO:teuthology.orchestra.run.smithi099.stdout: "put": 78210, 2024-02-21T23:12:57.132 INFO:teuthology.orchestra.run.smithi099.stdout: "put_sum": 17361372, 2024-02-21T23:12:57.133 INFO:teuthology.orchestra.run.smithi099.stdout: "wait": { 2024-02-21T23:12:57.133 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:57.133 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:57.133 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:57.133 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:57.133 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:57.133 INFO:teuthology.orchestra.run.smithi099.stdout: "throttle-objecter_bytes": { 2024-02-21T23:12:57.133 INFO:teuthology.orchestra.run.smithi099.stdout: "val": 0, 2024-02-21T23:12:57.134 INFO:teuthology.orchestra.run.smithi099.stdout: "max": 104857600, 2024-02-21T23:12:57.134 INFO:teuthology.orchestra.run.smithi099.stdout: "get_started": 0, 2024-02-21T23:12:57.134 INFO:teuthology.orchestra.run.smithi099.stdout: "get": 0, 2024-02-21T23:12:57.134 INFO:teuthology.orchestra.run.smithi099.stdout: "get_sum": 0, 2024-02-21T23:12:57.134 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_fail": 0, 2024-02-21T23:12:57.134 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_success": 0, 2024-02-21T23:12:57.134 INFO:teuthology.orchestra.run.smithi099.stdout: "take": 51402, 2024-02-21T23:12:57.134 INFO:teuthology.orchestra.run.smithi099.stdout: "take_sum": 59630603, 2024-02-21T23:12:57.135 INFO:teuthology.orchestra.run.smithi099.stdout: "put": 51402, 2024-02-21T23:12:57.135 INFO:teuthology.orchestra.run.smithi099.stdout: "put_sum": 59630603, 2024-02-21T23:12:57.135 INFO:teuthology.orchestra.run.smithi099.stdout: "wait": { 2024-02-21T23:12:57.135 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:57.135 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:57.135 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:57.135 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:57.135 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:57.136 INFO:teuthology.orchestra.run.smithi099.stdout: "throttle-objecter_ops": { 2024-02-21T23:12:57.136 INFO:teuthology.orchestra.run.smithi099.stdout: "val": 0, 2024-02-21T23:12:57.136 INFO:teuthology.orchestra.run.smithi099.stdout: "max": 1024, 2024-02-21T23:12:57.136 INFO:teuthology.orchestra.run.smithi099.stdout: "get_started": 0, 2024-02-21T23:12:57.136 INFO:teuthology.orchestra.run.smithi099.stdout: "get": 0, 2024-02-21T23:12:57.136 INFO:teuthology.orchestra.run.smithi099.stdout: "get_sum": 0, 2024-02-21T23:12:57.136 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_fail": 0, 2024-02-21T23:12:57.137 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_success": 0, 2024-02-21T23:12:57.137 INFO:teuthology.orchestra.run.smithi099.stdout: "take": 51402, 2024-02-21T23:12:57.137 INFO:teuthology.orchestra.run.smithi099.stdout: "take_sum": 51402, 2024-02-21T23:12:57.137 INFO:teuthology.orchestra.run.smithi099.stdout: "put": 51402, 2024-02-21T23:12:57.137 INFO:teuthology.orchestra.run.smithi099.stdout: "put_sum": 51402, 2024-02-21T23:12:57.137 INFO:teuthology.orchestra.run.smithi099.stdout: "wait": { 2024-02-21T23:12:57.137 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:57.137 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:57.137 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:57.138 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:57.138 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:57.138 INFO:teuthology.orchestra.run.smithi099.stdout: "throttle-write_buf_throttle": { 2024-02-21T23:12:57.138 INFO:teuthology.orchestra.run.smithi099.stdout: "val": 0, 2024-02-21T23:12:57.138 INFO:teuthology.orchestra.run.smithi099.stdout: "max": 3758096384, 2024-02-21T23:12:57.138 INFO:teuthology.orchestra.run.smithi099.stdout: "get_started": 0, 2024-02-21T23:12:57.138 INFO:teuthology.orchestra.run.smithi099.stdout: "get": 2650, 2024-02-21T23:12:57.138 INFO:teuthology.orchestra.run.smithi099.stdout: "get_sum": 289586, 2024-02-21T23:12:57.139 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_fail": 0, 2024-02-21T23:12:57.139 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_success": 2650, 2024-02-21T23:12:57.139 INFO:teuthology.orchestra.run.smithi099.stdout: "take": 0, 2024-02-21T23:12:57.139 INFO:teuthology.orchestra.run.smithi099.stdout: "take_sum": 0, 2024-02-21T23:12:57.139 INFO:teuthology.orchestra.run.smithi099.stdout: "put": 43, 2024-02-21T23:12:57.139 INFO:teuthology.orchestra.run.smithi099.stdout: "put_sum": 289586, 2024-02-21T23:12:57.139 INFO:teuthology.orchestra.run.smithi099.stdout: "wait": { 2024-02-21T23:12:57.139 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:57.140 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:57.140 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:57.140 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:57.140 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-02-21T23:12:57.140 INFO:teuthology.orchestra.run.smithi099.stdout: "throttle-write_buf_throttle-0x56291d5b86e0": { 2024-02-21T23:12:57.140 INFO:teuthology.orchestra.run.smithi099.stdout: "val": 0, 2024-02-21T23:12:57.140 INFO:teuthology.orchestra.run.smithi099.stdout: "max": 3758096384, 2024-02-21T23:12:57.140 INFO:teuthology.orchestra.run.smithi099.stdout: "get_started": 0, 2024-02-21T23:12:57.141 INFO:teuthology.orchestra.run.smithi099.stdout: "get": 23296, 2024-02-21T23:12:57.141 INFO:teuthology.orchestra.run.smithi099.stdout: "get_sum": 54197780, 2024-02-21T23:12:57.141 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_fail": 0, 2024-02-21T23:12:57.141 INFO:teuthology.orchestra.run.smithi099.stdout: "get_or_fail_success": 23296, 2024-02-21T23:12:57.141 INFO:teuthology.orchestra.run.smithi099.stdout: "take": 0, 2024-02-21T23:12:57.141 INFO:teuthology.orchestra.run.smithi099.stdout: "take_sum": 0, 2024-02-21T23:12:57.141 INFO:teuthology.orchestra.run.smithi099.stdout: "put": 478, 2024-02-21T23:12:57.141 INFO:teuthology.orchestra.run.smithi099.stdout: "put_sum": 54197780, 2024-02-21T23:12:57.142 INFO:teuthology.orchestra.run.smithi099.stdout: "wait": { 2024-02-21T23:12:57.142 INFO:teuthology.orchestra.run.smithi099.stdout: "avgcount": 0, 2024-02-21T23:12:57.142 INFO:teuthology.orchestra.run.smithi099.stdout: "sum": 0.000000000, 2024-02-21T23:12:57.142 INFO:teuthology.orchestra.run.smithi099.stdout: "avgtime": 0.000000000 2024-02-21T23:12:57.142 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:57.142 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-02-21T23:12:57.142 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-02-21T23:12:57.144 INFO:tasks.check_counter:Daemon mds.j mds.exported=19 2024-02-21T23:12:57.144 INFO:tasks.check_counter:Daemon mds.j mds.imported=0 2024-02-21T23:12:57.144 INFO:tasks.check_counter:Daemon mds.j mds.root_rsnaps=6 2024-02-21T23:12:57.144 INFO:tasks.check_counter:Daemon mds.j mds_server.req_mksnap_latency.avgcount=10 2024-02-21T23:12:57.144 INFO:tasks.check_counter:Daemon mds.j mds_server.req_rmsnap_latency.avgcount=4 2024-02-21T23:12:57.145 INFO:tasks.check_counter:Daemon mds.j mds.dir_split=26 2024-02-21T23:12:57.145 DEBUG:tasks.check_counter:Getting stats from b 2024-02-21T23:12:57.145 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok perf dump 2024-02-21T23:12:57.262 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-02-21T23:12:57.263 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-0": { 2024-02-21T23:12:57.263 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 0, 2024-02-21T23:12:57.263 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 2, 2024-02-21T23:12:57.263 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 0, 2024-02-21T23:12:57.263 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 131, 2024-02-21T23:12:57.263 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 4, 2024-02-21T23:12:57.264 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 0, 2024-02-21T23:12:57.264 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.001562596, 2024-02-21T23:12:57.264 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.000019333, 2024-02-21T23:12:57.264 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.000282261, 2024-02-21T23:12:57.264 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-02-21T23:12:57.264 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-02-21T23:12:57.264 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 1, 2024-02-21T23:12:57.264 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000484013, 2024-02-21T23:12:57.265 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000484013 2024-02-21T23:12:57.265 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-02-21T23:12:57.265 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-02-21T23:12:57.265 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-02-21T23:12:57.265 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-02-21T23:12:57.265 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-02-21T23:12:57.265 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-02-21T23:12:57.266 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 0, 2024-02-21T23:12:57.266 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 0 2024-02-21T23:12:57.266 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-02-21T23:12:57.266 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-1": { 2024-02-21T23:12:57.266 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 2, 2024-02-21T23:12:57.267 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 149, 2024-02-21T23:12:57.267 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 320, 2024-02-21T23:12:57.267 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 180928, 2024-02-21T23:12:57.267 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 5, 2024-02-21T23:12:57.267 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 3, 2024-02-21T23:12:57.267 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.013686740, 2024-02-21T23:12:57.267 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.009229022, 2024-02-21T23:12:57.267 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.002254968, 2024-02-21T23:12:57.268 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-02-21T23:12:57.268 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-02-21T23:12:57.268 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 146, 2024-02-21T23:12:57.268 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.011411292, 2024-02-21T23:12:57.268 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000078159 2024-02-21T23:12:57.269 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-02-21T23:12:57.269 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-02-21T23:12:57.269 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-02-21T23:12:57.269 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-02-21T23:12:57.269 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-02-21T23:12:57.269 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-02-21T23:12:57.269 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 320, 2024-02-21T23:12:57.269 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 180928 2024-02-21T23:12:57.270 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-02-21T23:12:57.270 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-2": { 2024-02-21T23:12:57.270 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 206, 2024-02-21T23:12:57.270 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 193, 2024-02-21T23:12:57.270 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 1536608, 2024-02-21T23:12:57.270 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 115664, 2024-02-21T23:12:57.270 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 2, 2024-02-21T23:12:57.270 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 1, 2024-02-21T23:12:57.270 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.045752271, 2024-02-21T23:12:57.271 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.012207796, 2024-02-21T23:12:57.271 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.038516621, 2024-02-21T23:12:57.271 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.004908465, 2024-02-21T23:12:57.271 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-02-21T23:12:57.271 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 193, 2024-02-21T23:12:57.271 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.015024953, 2024-02-21T23:12:57.271 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000077849 2024-02-21T23:12:57.271 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-02-21T23:12:57.272 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-02-21T23:12:57.272 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-02-21T23:12:57.272 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-02-21T23:12:57.272 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-02-21T23:12:57.272 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-02-21T23:12:57.272 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 1536608, 2024-02-21T23:12:57.273 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 115664 2024-02-21T23:12:57.273 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-02-21T23:12:57.273 INFO:teuthology.orchestra.run.smithi162.stdout: "cct": { 2024-02-21T23:12:57.273 INFO:teuthology.orchestra.run.smithi162.stdout: "total_workers": 0, 2024-02-21T23:12:57.273 INFO:teuthology.orchestra.run.smithi162.stdout: "unhealthy_workers": 0 2024-02-21T23:12:57.273 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-02-21T23:12:57.273 INFO:teuthology.orchestra.run.smithi162.stdout: "mempool": { 2024-02-21T23:12:57.274 INFO:teuthology.orchestra.run.smithi162.stdout: "bloom_filter_bytes": 0, 2024-02-21T23:12:57.274 INFO:teuthology.orchestra.run.smithi162.stdout: "bloom_filter_items": 0, 2024-02-21T23:12:57.274 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_alloc_bytes": 0, 2024-02-21T23:12:57.274 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_alloc_items": 0, 2024-02-21T23:12:57.274 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_data_bytes": 0, 2024-02-21T23:12:57.274 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_data_items": 0, 2024-02-21T23:12:57.274 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_onode_bytes": 0, 2024-02-21T23:12:57.274 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_onode_items": 0, 2024-02-21T23:12:57.275 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_meta_bytes": 0, 2024-02-21T23:12:57.275 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_meta_items": 0, 2024-02-21T23:12:57.275 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_other_bytes": 0, 2024-02-21T23:12:57.275 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_other_items": 0, 2024-02-21T23:12:57.275 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_buffer_bytes": 0, 2024-02-21T23:12:57.275 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_buffer_items": 0, 2024-02-21T23:12:57.275 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_extent_bytes": 0, 2024-02-21T23:12:57.275 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_extent_items": 0, 2024-02-21T23:12:57.276 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_blob_bytes": 0, 2024-02-21T23:12:57.276 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_blob_items": 0, 2024-02-21T23:12:57.276 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_shared_blob_bytes": 0, 2024-02-21T23:12:57.276 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_shared_blob_items": 0, 2024-02-21T23:12:57.276 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_inline_bl_bytes": 0, 2024-02-21T23:12:57.276 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_inline_bl_items": 0, 2024-02-21T23:12:57.276 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_fsck_bytes": 0, 2024-02-21T23:12:57.276 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_fsck_items": 0, 2024-02-21T23:12:57.277 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_txc_bytes": 0, 2024-02-21T23:12:57.277 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_txc_items": 0, 2024-02-21T23:12:57.277 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_deferred_bytes": 0, 2024-02-21T23:12:57.277 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_deferred_items": 0, 2024-02-21T23:12:57.277 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_bytes": 0, 2024-02-21T23:12:57.277 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_items": 0, 2024-02-21T23:12:57.277 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_bytes": 0, 2024-02-21T23:12:57.277 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_items": 0, 2024-02-21T23:12:57.278 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_reader_bytes": 0, 2024-02-21T23:12:57.278 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_reader_items": 0, 2024-02-21T23:12:57.278 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_writer_bytes": 0, 2024-02-21T23:12:57.278 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_writer_items": 0, 2024-02-21T23:12:57.278 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_anon_bytes": 149017, 2024-02-21T23:12:57.278 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_anon_items": 31, 2024-02-21T23:12:57.278 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_meta_bytes": 0, 2024-02-21T23:12:57.278 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_meta_items": 0, 2024-02-21T23:12:57.278 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_bytes": 0, 2024-02-21T23:12:57.279 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_items": 0, 2024-02-21T23:12:57.279 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_mapbl_bytes": 0, 2024-02-21T23:12:57.279 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_mapbl_items": 0, 2024-02-21T23:12:57.279 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_pglog_bytes": 0, 2024-02-21T23:12:57.279 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_pglog_items": 0, 2024-02-21T23:12:57.279 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_bytes": 0, 2024-02-21T23:12:57.279 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_items": 0, 2024-02-21T23:12:57.279 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_mapping_bytes": 0, 2024-02-21T23:12:57.280 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_mapping_items": 0, 2024-02-21T23:12:57.280 INFO:teuthology.orchestra.run.smithi162.stdout: "pgmap_bytes": 0, 2024-02-21T23:12:57.280 INFO:teuthology.orchestra.run.smithi162.stdout: "pgmap_items": 0, 2024-02-21T23:12:57.280 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_co_bytes": 928, 2024-02-21T23:12:57.280 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_co_items": 2, 2024-02-21T23:12:57.280 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_1_bytes": 0, 2024-02-21T23:12:57.280 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_1_items": 0, 2024-02-21T23:12:57.280 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_2_bytes": 0, 2024-02-21T23:12:57.281 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_2_items": 0 2024-02-21T23:12:57.281 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-02-21T23:12:57.281 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-02-21T23:12:57.281 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-02-21T23:12:57.281 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 104857600, 2024-02-21T23:12:57.281 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-02-21T23:12:57.281 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 204, 2024-02-21T23:12:57.281 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 1506553, 2024-02-21T23:12:57.281 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-02-21T23:12:57.282 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 204, 2024-02-21T23:12:57.282 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 0, 2024-02-21T23:12:57.282 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 0, 2024-02-21T23:12:57.282 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 204, 2024-02-21T23:12:57.282 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 1506553, 2024-02-21T23:12:57.282 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-02-21T23:12:57.282 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-02-21T23:12:57.282 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-02-21T23:12:57.283 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-02-21T23:12:57.283 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-02-21T23:12:57.283 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-02-21T23:12:57.283 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-02-21T23:12:57.284 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.b 2024-02-21T23:12:57.284 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.b 2024-02-21T23:12:57.285 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.b 2024-02-21T23:12:57.285 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.b 2024-02-21T23:12:57.285 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.b 2024-02-21T23:12:57.285 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.b 2024-02-21T23:12:57.285 DEBUG:tasks.check_counter:Getting stats from e 2024-02-21T23:12:57.285 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.e.asok perf dump 2024-02-21T23:12:57.393 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-02-21T23:12:57.394 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-0": { 2024-02-21T23:12:57.394 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 3, 2024-02-21T23:12:57.394 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 3, 2024-02-21T23:12:57.394 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 882, 2024-02-21T23:12:57.394 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 272, 2024-02-21T23:12:57.394 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 4, 2024-02-21T23:12:57.394 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 0, 2024-02-21T23:12:57.395 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.001438887, 2024-02-21T23:12:57.395 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.000058223, 2024-02-21T23:12:57.395 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.000543654, 2024-02-21T23:12:57.395 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-02-21T23:12:57.395 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-02-21T23:12:57.395 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 2, 2024-02-21T23:12:57.395 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000357917, 2024-02-21T23:12:57.396 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000178958 2024-02-21T23:12:57.396 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-02-21T23:12:57.396 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-02-21T23:12:57.396 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-02-21T23:12:57.396 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-02-21T23:12:57.396 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-02-21T23:12:57.396 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-02-21T23:12:57.396 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 0, 2024-02-21T23:12:57.397 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 0 2024-02-21T23:12:57.397 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-02-21T23:12:57.397 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-1": { 2024-02-21T23:12:57.397 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 2, 2024-02-21T23:12:57.397 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 149, 2024-02-21T23:12:57.397 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 320, 2024-02-21T23:12:57.397 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 181059, 2024-02-21T23:12:57.397 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 5, 2024-02-21T23:12:57.398 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 3, 2024-02-21T23:12:57.398 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.012889630, 2024-02-21T23:12:57.398 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.008784362, 2024-02-21T23:12:57.398 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.001831449, 2024-02-21T23:12:57.398 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-02-21T23:12:57.398 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-02-21T23:12:57.398 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 147, 2024-02-21T23:12:57.398 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.009522312, 2024-02-21T23:12:57.398 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000064777 2024-02-21T23:12:57.399 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-02-21T23:12:57.399 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-02-21T23:12:57.399 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-02-21T23:12:57.399 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-02-21T23:12:57.399 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-02-21T23:12:57.399 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-02-21T23:12:57.400 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 320, 2024-02-21T23:12:57.400 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 180928 2024-02-21T23:12:57.400 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-02-21T23:12:57.400 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-2": { 2024-02-21T23:12:57.400 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 207, 2024-02-21T23:12:57.400 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 193, 2024-02-21T23:12:57.400 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 1536976, 2024-02-21T23:12:57.401 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 115664, 2024-02-21T23:12:57.401 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 2, 2024-02-21T23:12:57.401 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 1, 2024-02-21T23:12:57.401 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.048271869, 2024-02-21T23:12:57.401 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.012386433, 2024-02-21T23:12:57.401 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.040823064, 2024-02-21T23:12:57.401 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.005075636, 2024-02-21T23:12:57.401 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-02-21T23:12:57.402 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 193, 2024-02-21T23:12:57.402 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.017259774, 2024-02-21T23:12:57.402 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000089428 2024-02-21T23:12:57.402 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-02-21T23:12:57.402 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-02-21T23:12:57.402 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-02-21T23:12:57.402 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-02-21T23:12:57.403 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-02-21T23:12:57.403 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-02-21T23:12:57.403 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 1536976, 2024-02-21T23:12:57.403 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 115664 2024-02-21T23:12:57.403 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-02-21T23:12:57.403 INFO:teuthology.orchestra.run.smithi162.stdout: "cct": { 2024-02-21T23:12:57.403 INFO:teuthology.orchestra.run.smithi162.stdout: "total_workers": 0, 2024-02-21T23:12:57.403 INFO:teuthology.orchestra.run.smithi162.stdout: "unhealthy_workers": 0 2024-02-21T23:12:57.404 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-02-21T23:12:57.404 INFO:teuthology.orchestra.run.smithi162.stdout: "mempool": { 2024-02-21T23:12:57.404 INFO:teuthology.orchestra.run.smithi162.stdout: "bloom_filter_bytes": 0, 2024-02-21T23:12:57.404 INFO:teuthology.orchestra.run.smithi162.stdout: "bloom_filter_items": 0, 2024-02-21T23:12:57.404 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_alloc_bytes": 0, 2024-02-21T23:12:57.404 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_alloc_items": 0, 2024-02-21T23:12:57.404 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_data_bytes": 0, 2024-02-21T23:12:57.404 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_data_items": 0, 2024-02-21T23:12:57.405 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_onode_bytes": 0, 2024-02-21T23:12:57.405 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_onode_items": 0, 2024-02-21T23:12:57.405 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_meta_bytes": 0, 2024-02-21T23:12:57.405 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_meta_items": 0, 2024-02-21T23:12:57.405 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_other_bytes": 0, 2024-02-21T23:12:57.405 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_other_items": 0, 2024-02-21T23:12:57.405 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_buffer_bytes": 0, 2024-02-21T23:12:57.405 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_buffer_items": 0, 2024-02-21T23:12:57.406 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_extent_bytes": 0, 2024-02-21T23:12:57.406 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_extent_items": 0, 2024-02-21T23:12:57.406 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_blob_bytes": 0, 2024-02-21T23:12:57.406 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_blob_items": 0, 2024-02-21T23:12:57.406 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_shared_blob_bytes": 0, 2024-02-21T23:12:57.406 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_shared_blob_items": 0, 2024-02-21T23:12:57.406 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_inline_bl_bytes": 0, 2024-02-21T23:12:57.406 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_inline_bl_items": 0, 2024-02-21T23:12:57.407 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_fsck_bytes": 0, 2024-02-21T23:12:57.407 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_fsck_items": 0, 2024-02-21T23:12:57.407 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_txc_bytes": 0, 2024-02-21T23:12:57.407 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_txc_items": 0, 2024-02-21T23:12:57.407 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_deferred_bytes": 0, 2024-02-21T23:12:57.407 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_deferred_items": 0, 2024-02-21T23:12:57.407 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_bytes": 0, 2024-02-21T23:12:57.407 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_items": 0, 2024-02-21T23:12:57.408 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_bytes": 0, 2024-02-21T23:12:57.408 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_items": 0, 2024-02-21T23:12:57.408 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_reader_bytes": 0, 2024-02-21T23:12:57.408 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_reader_items": 0, 2024-02-21T23:12:57.408 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_writer_bytes": 0, 2024-02-21T23:12:57.408 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_writer_items": 0, 2024-02-21T23:12:57.408 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_anon_bytes": 149034, 2024-02-21T23:12:57.408 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_anon_items": 32, 2024-02-21T23:12:57.409 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_meta_bytes": 0, 2024-02-21T23:12:57.409 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_meta_items": 0, 2024-02-21T23:12:57.409 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_bytes": 0, 2024-02-21T23:12:57.409 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_items": 0, 2024-02-21T23:12:57.409 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_mapbl_bytes": 0, 2024-02-21T23:12:57.409 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_mapbl_items": 0, 2024-02-21T23:12:57.409 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_pglog_bytes": 0, 2024-02-21T23:12:57.409 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_pglog_items": 0, 2024-02-21T23:12:57.410 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_bytes": 0, 2024-02-21T23:12:57.410 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_items": 0, 2024-02-21T23:12:57.410 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_mapping_bytes": 0, 2024-02-21T23:12:57.410 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_mapping_items": 0, 2024-02-21T23:12:57.410 INFO:teuthology.orchestra.run.smithi162.stdout: "pgmap_bytes": 0, 2024-02-21T23:12:57.410 INFO:teuthology.orchestra.run.smithi162.stdout: "pgmap_items": 0, 2024-02-21T23:12:57.410 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_co_bytes": 928, 2024-02-21T23:12:57.410 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_co_items": 2, 2024-02-21T23:12:57.411 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_1_bytes": 0, 2024-02-21T23:12:57.411 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_1_items": 0, 2024-02-21T23:12:57.411 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_2_bytes": 0, 2024-02-21T23:12:57.411 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_2_items": 0 2024-02-21T23:12:57.411 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-02-21T23:12:57.411 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-02-21T23:12:57.411 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-02-21T23:12:57.411 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 104857600, 2024-02-21T23:12:57.412 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-02-21T23:12:57.412 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 205, 2024-02-21T23:12:57.412 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 1506778, 2024-02-21T23:12:57.412 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-02-21T23:12:57.412 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 205, 2024-02-21T23:12:57.412 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 0, 2024-02-21T23:12:57.412 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 0, 2024-02-21T23:12:57.412 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 205, 2024-02-21T23:12:57.413 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 1506778, 2024-02-21T23:12:57.413 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-02-21T23:12:57.413 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-02-21T23:12:57.413 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-02-21T23:12:57.413 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-02-21T23:12:57.413 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-02-21T23:12:57.413 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-02-21T23:12:57.413 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-02-21T23:12:57.415 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.e 2024-02-21T23:12:57.415 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.e 2024-02-21T23:12:57.415 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.e 2024-02-21T23:12:57.415 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.e 2024-02-21T23:12:57.415 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.e 2024-02-21T23:12:57.415 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.e 2024-02-21T23:12:57.416 DEBUG:tasks.check_counter:Getting stats from h 2024-02-21T23:12:57.416 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.h.asok perf dump 2024-02-21T23:12:57.523 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-02-21T23:12:57.523 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-0": { 2024-02-21T23:12:57.523 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 0, 2024-02-21T23:12:57.523 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 2, 2024-02-21T23:12:57.523 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 0, 2024-02-21T23:12:57.523 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 0, 2024-02-21T23:12:57.524 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 4, 2024-02-21T23:12:57.524 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 0, 2024-02-21T23:12:57.524 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.002187712, 2024-02-21T23:12:57.524 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.000000000, 2024-02-21T23:12:57.524 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.000766188, 2024-02-21T23:12:57.524 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-02-21T23:12:57.525 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-02-21T23:12:57.525 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-02-21T23:12:57.525 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-02-21T23:12:57.525 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-02-21T23:12:57.525 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-02-21T23:12:57.525 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-02-21T23:12:57.526 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-02-21T23:12:57.526 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-02-21T23:12:57.526 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-02-21T23:12:57.526 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-02-21T23:12:57.526 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 0, 2024-02-21T23:12:57.526 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 0 2024-02-21T23:12:57.526 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-02-21T23:12:57.526 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-1": { 2024-02-21T23:12:57.527 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 2, 2024-02-21T23:12:57.527 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 149, 2024-02-21T23:12:57.527 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 320, 2024-02-21T23:12:57.527 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 180928, 2024-02-21T23:12:57.527 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 5, 2024-02-21T23:12:57.527 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 3, 2024-02-21T23:12:57.527 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.013244981, 2024-02-21T23:12:57.527 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.008332022, 2024-02-21T23:12:57.527 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.002430019, 2024-02-21T23:12:57.528 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-02-21T23:12:57.528 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-02-21T23:12:57.528 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 146, 2024-02-21T23:12:57.528 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.016389783, 2024-02-21T23:12:57.528 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000112258 2024-02-21T23:12:57.528 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-02-21T23:12:57.528 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-02-21T23:12:57.528 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-02-21T23:12:57.529 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-02-21T23:12:57.529 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-02-21T23:12:57.529 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-02-21T23:12:57.529 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 320, 2024-02-21T23:12:57.529 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 180928 2024-02-21T23:12:57.529 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-02-21T23:12:57.529 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-2": { 2024-02-21T23:12:57.529 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 207, 2024-02-21T23:12:57.530 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 193, 2024-02-21T23:12:57.530 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 1536976, 2024-02-21T23:12:57.530 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 115664, 2024-02-21T23:12:57.532 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 2, 2024-02-21T23:12:57.532 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 1, 2024-02-21T23:12:57.532 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.046615474, 2024-02-21T23:12:57.533 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.010506229, 2024-02-21T23:12:57.533 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.038311195, 2024-02-21T23:12:57.533 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.006325626, 2024-02-21T23:12:57.533 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-02-21T23:12:57.533 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 193, 2024-02-21T23:12:57.533 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.014484981, 2024-02-21T23:12:57.533 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000075051 2024-02-21T23:12:57.534 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-02-21T23:12:57.534 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-02-21T23:12:57.534 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-02-21T23:12:57.534 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-02-21T23:12:57.534 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-02-21T23:12:57.534 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-02-21T23:12:57.534 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 1536976, 2024-02-21T23:12:57.534 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 115664 2024-02-21T23:12:57.535 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-02-21T23:12:57.535 INFO:teuthology.orchestra.run.smithi162.stdout: "cct": { 2024-02-21T23:12:57.535 INFO:teuthology.orchestra.run.smithi162.stdout: "total_workers": 0, 2024-02-21T23:12:57.535 INFO:teuthology.orchestra.run.smithi162.stdout: "unhealthy_workers": 0 2024-02-21T23:12:57.535 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-02-21T23:12:57.535 INFO:teuthology.orchestra.run.smithi162.stdout: "mempool": { 2024-02-21T23:12:57.535 INFO:teuthology.orchestra.run.smithi162.stdout: "bloom_filter_bytes": 0, 2024-02-21T23:12:57.535 INFO:teuthology.orchestra.run.smithi162.stdout: "bloom_filter_items": 0, 2024-02-21T23:12:57.536 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_alloc_bytes": 0, 2024-02-21T23:12:57.536 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_alloc_items": 0, 2024-02-21T23:12:57.536 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_data_bytes": 0, 2024-02-21T23:12:57.536 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_data_items": 0, 2024-02-21T23:12:57.536 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_onode_bytes": 0, 2024-02-21T23:12:57.536 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_onode_items": 0, 2024-02-21T23:12:57.536 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_meta_bytes": 0, 2024-02-21T23:12:57.537 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_meta_items": 0, 2024-02-21T23:12:57.537 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_other_bytes": 0, 2024-02-21T23:12:57.537 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_other_items": 0, 2024-02-21T23:12:57.537 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_buffer_bytes": 0, 2024-02-21T23:12:57.537 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_buffer_items": 0, 2024-02-21T23:12:57.537 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_extent_bytes": 0, 2024-02-21T23:12:57.537 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_extent_items": 0, 2024-02-21T23:12:57.537 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_blob_bytes": 0, 2024-02-21T23:12:57.538 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_blob_items": 0, 2024-02-21T23:12:57.538 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_shared_blob_bytes": 0, 2024-02-21T23:12:57.538 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_shared_blob_items": 0, 2024-02-21T23:12:57.538 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_inline_bl_bytes": 0, 2024-02-21T23:12:57.538 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_inline_bl_items": 0, 2024-02-21T23:12:57.539 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_fsck_bytes": 0, 2024-02-21T23:12:57.539 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_fsck_items": 0, 2024-02-21T23:12:57.539 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_txc_bytes": 0, 2024-02-21T23:12:57.539 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_txc_items": 0, 2024-02-21T23:12:57.539 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_deferred_bytes": 0, 2024-02-21T23:12:57.539 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_deferred_items": 0, 2024-02-21T23:12:57.539 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_bytes": 0, 2024-02-21T23:12:57.540 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_items": 0, 2024-02-21T23:12:57.540 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_bytes": 0, 2024-02-21T23:12:57.540 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_items": 0, 2024-02-21T23:12:57.540 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_reader_bytes": 0, 2024-02-21T23:12:57.540 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_reader_items": 0, 2024-02-21T23:12:57.540 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_writer_bytes": 0, 2024-02-21T23:12:57.540 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_writer_items": 0, 2024-02-21T23:12:57.540 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_anon_bytes": 150008, 2024-02-21T23:12:57.541 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_anon_items": 31, 2024-02-21T23:12:57.541 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_meta_bytes": 0, 2024-02-21T23:12:57.541 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_meta_items": 0, 2024-02-21T23:12:57.541 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_bytes": 0, 2024-02-21T23:12:57.541 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_items": 0, 2024-02-21T23:12:57.541 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_mapbl_bytes": 0, 2024-02-21T23:12:57.541 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_mapbl_items": 0, 2024-02-21T23:12:57.542 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_pglog_bytes": 0, 2024-02-21T23:12:57.542 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_pglog_items": 0, 2024-02-21T23:12:57.542 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_bytes": 0, 2024-02-21T23:12:57.542 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_items": 0, 2024-02-21T23:12:57.542 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_mapping_bytes": 0, 2024-02-21T23:12:57.542 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_mapping_items": 0, 2024-02-21T23:12:57.542 INFO:teuthology.orchestra.run.smithi162.stdout: "pgmap_bytes": 0, 2024-02-21T23:12:57.542 INFO:teuthology.orchestra.run.smithi162.stdout: "pgmap_items": 0, 2024-02-21T23:12:57.543 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_co_bytes": 928, 2024-02-21T23:12:57.543 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_co_items": 2, 2024-02-21T23:12:57.543 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_1_bytes": 0, 2024-02-21T23:12:57.543 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_1_items": 0, 2024-02-21T23:12:57.543 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_2_bytes": 0, 2024-02-21T23:12:57.543 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_2_items": 0 2024-02-21T23:12:57.543 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-02-21T23:12:57.543 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-02-21T23:12:57.543 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-02-21T23:12:57.544 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 104857600, 2024-02-21T23:12:57.544 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-02-21T23:12:57.544 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 205, 2024-02-21T23:12:57.544 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 1506778, 2024-02-21T23:12:57.544 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-02-21T23:12:57.544 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 205, 2024-02-21T23:12:57.544 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 0, 2024-02-21T23:12:57.544 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 0, 2024-02-21T23:12:57.545 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 205, 2024-02-21T23:12:57.545 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 1506778, 2024-02-21T23:12:57.545 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-02-21T23:12:57.545 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-02-21T23:12:57.545 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-02-21T23:12:57.545 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-02-21T23:12:57.545 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-02-21T23:12:57.545 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-02-21T23:12:57.546 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-02-21T23:12:57.547 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.h 2024-02-21T23:12:57.547 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.h 2024-02-21T23:12:57.547 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.h 2024-02-21T23:12:57.547 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.h 2024-02-21T23:12:57.547 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.h 2024-02-21T23:12:57.547 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.h 2024-02-21T23:12:57.548 DEBUG:tasks.check_counter:Getting stats from k 2024-02-21T23:12:57.548 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.k.asok perf dump 2024-02-21T23:12:57.654 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-02-21T23:12:57.654 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-0": { 2024-02-21T23:12:57.655 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 1, 2024-02-21T23:12:57.655 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 3, 2024-02-21T23:12:57.655 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 107, 2024-02-21T23:12:57.655 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 272, 2024-02-21T23:12:57.655 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 4, 2024-02-21T23:12:57.655 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 0, 2024-02-21T23:12:57.655 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.001437464, 2024-02-21T23:12:57.656 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.000023003, 2024-02-21T23:12:57.656 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.000293817, 2024-02-21T23:12:57.656 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-02-21T23:12:57.656 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-02-21T23:12:57.656 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 2, 2024-02-21T23:12:57.656 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000354706, 2024-02-21T23:12:57.656 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000177353 2024-02-21T23:12:57.656 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-02-21T23:12:57.657 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-02-21T23:12:57.657 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-02-21T23:12:57.657 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-02-21T23:12:57.657 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-02-21T23:12:57.657 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-02-21T23:12:57.657 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 0, 2024-02-21T23:12:57.657 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 0 2024-02-21T23:12:57.657 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-02-21T23:12:57.658 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-1": { 2024-02-21T23:12:57.658 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 206, 2024-02-21T23:12:57.658 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 193, 2024-02-21T23:12:57.658 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 1536608, 2024-02-21T23:12:57.658 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 115664, 2024-02-21T23:12:57.658 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 2, 2024-02-21T23:12:57.658 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 1, 2024-02-21T23:12:57.659 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.048416257, 2024-02-21T23:12:57.659 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.012198733, 2024-02-21T23:12:57.659 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.041228702, 2024-02-21T23:12:57.659 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.005239474, 2024-02-21T23:12:57.659 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-02-21T23:12:57.659 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 193, 2024-02-21T23:12:57.659 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.017340872, 2024-02-21T23:12:57.659 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000089849 2024-02-21T23:12:57.660 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-02-21T23:12:57.660 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-02-21T23:12:57.660 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-02-21T23:12:57.660 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-02-21T23:12:57.660 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-02-21T23:12:57.660 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-02-21T23:12:57.660 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 1536608, 2024-02-21T23:12:57.660 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 115664 2024-02-21T23:12:57.661 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-02-21T23:12:57.661 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-2": { 2024-02-21T23:12:57.661 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 3, 2024-02-21T23:12:57.661 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 150, 2024-02-21T23:12:57.661 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 427, 2024-02-21T23:12:57.661 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 181200, 2024-02-21T23:12:57.661 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 5, 2024-02-21T23:12:57.661 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 3, 2024-02-21T23:12:57.662 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.013290697, 2024-02-21T23:12:57.662 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.008646921, 2024-02-21T23:12:57.662 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.002520351, 2024-02-21T23:12:57.662 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-02-21T23:12:57.662 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-02-21T23:12:57.662 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 148, 2024-02-21T23:12:57.662 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.009480353, 2024-02-21T23:12:57.662 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000064056 2024-02-21T23:12:57.663 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-02-21T23:12:57.663 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-02-21T23:12:57.663 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-02-21T23:12:57.663 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-02-21T23:12:57.663 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-02-21T23:12:57.663 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-02-21T23:12:57.663 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 320, 2024-02-21T23:12:57.663 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 180928 2024-02-21T23:12:57.664 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-02-21T23:12:57.664 INFO:teuthology.orchestra.run.smithi162.stdout: "cct": { 2024-02-21T23:12:57.664 INFO:teuthology.orchestra.run.smithi162.stdout: "total_workers": 0, 2024-02-21T23:12:57.664 INFO:teuthology.orchestra.run.smithi162.stdout: "unhealthy_workers": 0 2024-02-21T23:12:57.664 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-02-21T23:12:57.664 INFO:teuthology.orchestra.run.smithi162.stdout: "mempool": { 2024-02-21T23:12:57.664 INFO:teuthology.orchestra.run.smithi162.stdout: "bloom_filter_bytes": 0, 2024-02-21T23:12:57.664 INFO:teuthology.orchestra.run.smithi162.stdout: "bloom_filter_items": 0, 2024-02-21T23:12:57.665 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_alloc_bytes": 0, 2024-02-21T23:12:57.665 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_alloc_items": 0, 2024-02-21T23:12:57.665 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_data_bytes": 0, 2024-02-21T23:12:57.665 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_data_items": 0, 2024-02-21T23:12:57.665 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_onode_bytes": 0, 2024-02-21T23:12:57.665 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_onode_items": 0, 2024-02-21T23:12:57.665 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_meta_bytes": 0, 2024-02-21T23:12:57.665 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_meta_items": 0, 2024-02-21T23:12:57.666 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_other_bytes": 0, 2024-02-21T23:12:57.666 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_other_items": 0, 2024-02-21T23:12:57.666 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_buffer_bytes": 0, 2024-02-21T23:12:57.666 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_buffer_items": 0, 2024-02-21T23:12:57.666 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_extent_bytes": 0, 2024-02-21T23:12:57.666 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_extent_items": 0, 2024-02-21T23:12:57.666 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_blob_bytes": 0, 2024-02-21T23:12:57.666 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_blob_items": 0, 2024-02-21T23:12:57.667 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_shared_blob_bytes": 0, 2024-02-21T23:12:57.667 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_shared_blob_items": 0, 2024-02-21T23:12:57.667 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_inline_bl_bytes": 0, 2024-02-21T23:12:57.667 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_inline_bl_items": 0, 2024-02-21T23:12:57.667 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_fsck_bytes": 0, 2024-02-21T23:12:57.667 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_fsck_items": 0, 2024-02-21T23:12:57.667 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_txc_bytes": 0, 2024-02-21T23:12:57.667 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_txc_items": 0, 2024-02-21T23:12:57.668 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_deferred_bytes": 0, 2024-02-21T23:12:57.668 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_deferred_items": 0, 2024-02-21T23:12:57.668 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_bytes": 0, 2024-02-21T23:12:57.668 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_items": 0, 2024-02-21T23:12:57.668 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_bytes": 0, 2024-02-21T23:12:57.669 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_items": 0, 2024-02-21T23:12:57.669 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_reader_bytes": 0, 2024-02-21T23:12:57.669 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_reader_items": 0, 2024-02-21T23:12:57.669 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_writer_bytes": 0, 2024-02-21T23:12:57.669 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_writer_items": 0, 2024-02-21T23:12:57.669 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_anon_bytes": 148994, 2024-02-21T23:12:57.669 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_anon_items": 31, 2024-02-21T23:12:57.669 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_meta_bytes": 0, 2024-02-21T23:12:57.670 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_meta_items": 0, 2024-02-21T23:12:57.670 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_bytes": 0, 2024-02-21T23:12:57.670 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_items": 0, 2024-02-21T23:12:57.671 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_mapbl_bytes": 0, 2024-02-21T23:12:57.671 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_mapbl_items": 0, 2024-02-21T23:12:57.671 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_pglog_bytes": 0, 2024-02-21T23:12:57.671 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_pglog_items": 0, 2024-02-21T23:12:57.671 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_bytes": 0, 2024-02-21T23:12:57.671 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_items": 0, 2024-02-21T23:12:57.671 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_mapping_bytes": 0, 2024-02-21T23:12:57.671 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_mapping_items": 0, 2024-02-21T23:12:57.672 INFO:teuthology.orchestra.run.smithi162.stdout: "pgmap_bytes": 0, 2024-02-21T23:12:57.672 INFO:teuthology.orchestra.run.smithi162.stdout: "pgmap_items": 0, 2024-02-21T23:12:57.672 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_co_bytes": 928, 2024-02-21T23:12:57.672 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_co_items": 2, 2024-02-21T23:12:57.672 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_1_bytes": 0, 2024-02-21T23:12:57.672 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_1_items": 0, 2024-02-21T23:12:57.672 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_2_bytes": 0, 2024-02-21T23:12:57.672 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_2_items": 0 2024-02-21T23:12:57.673 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-02-21T23:12:57.673 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-02-21T23:12:57.673 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-02-21T23:12:57.673 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 104857600, 2024-02-21T23:12:57.673 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-02-21T23:12:57.673 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 204, 2024-02-21T23:12:57.673 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 1506553, 2024-02-21T23:12:57.673 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-02-21T23:12:57.674 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 204, 2024-02-21T23:12:57.674 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 0, 2024-02-21T23:12:57.674 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 0, 2024-02-21T23:12:57.674 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 204, 2024-02-21T23:12:57.674 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 1506553, 2024-02-21T23:12:57.674 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-02-21T23:12:57.674 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-02-21T23:12:57.674 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-02-21T23:12:57.675 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-02-21T23:12:57.675 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-02-21T23:12:57.675 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-02-21T23:12:57.675 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-02-21T23:12:57.679 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.k 2024-02-21T23:12:57.679 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.k 2024-02-21T23:12:57.679 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.k 2024-02-21T23:12:57.680 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.k 2024-02-21T23:12:57.680 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.k 2024-02-21T23:12:57.680 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.k 2024-02-21T23:12:57.680 DEBUG:tasks.check_counter:Getting stats from c 2024-02-21T23:12:57.681 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok perf dump 2024-02-21T23:12:57.801 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-02-21T23:12:57.801 INFO:teuthology.orchestra.run.smithi181.stdout: "AsyncMessenger::Worker-0": { 2024-02-21T23:12:57.801 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_messages": 0, 2024-02-21T23:12:57.801 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages": 2, 2024-02-21T23:12:57.801 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_bytes": 0, 2024-02-21T23:12:57.802 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_bytes": 131, 2024-02-21T23:12:57.802 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_created_connections": 4, 2024-02-21T23:12:57.802 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_active_connections": 0, 2024-02-21T23:12:57.802 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_total_time": 0.001510771, 2024-02-21T23:12:57.802 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_send_time": 0.000019680, 2024-02-21T23:12:57.802 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_recv_time": 0.000484576, 2024-02-21T23:12:57.802 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-02-21T23:12:57.802 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages_queue_lat": { 2024-02-21T23:12:57.802 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 1, 2024-02-21T23:12:57.803 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000203213, 2024-02-21T23:12:57.803 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000203213 2024-02-21T23:12:57.803 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:57.803 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_handle_ack_lat": { 2024-02-21T23:12:57.803 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:57.803 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:57.803 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:57.803 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:57.804 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_encrypted_bytes": 0, 2024-02-21T23:12:57.804 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_encrypted_bytes": 0 2024-02-21T23:12:57.804 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:57.804 INFO:teuthology.orchestra.run.smithi181.stdout: "AsyncMessenger::Worker-1": { 2024-02-21T23:12:57.804 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_messages": 202, 2024-02-21T23:12:57.804 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages": 191, 2024-02-21T23:12:57.804 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_bytes": 1535040, 2024-02-21T23:12:57.804 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_bytes": 115347, 2024-02-21T23:12:57.805 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_created_connections": 2, 2024-02-21T23:12:57.805 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_active_connections": 1, 2024-02-21T23:12:57.805 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_total_time": 0.042254871, 2024-02-21T23:12:57.805 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_send_time": 0.011367332, 2024-02-21T23:12:57.805 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_recv_time": 0.035890322, 2024-02-21T23:12:57.805 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_fast_dispatch_time": 0.004644289, 2024-02-21T23:12:57.805 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages_queue_lat": { 2024-02-21T23:12:57.805 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 191, 2024-02-21T23:12:57.806 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.008741642, 2024-02-21T23:12:57.806 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000045767 2024-02-21T23:12:57.806 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:57.806 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_handle_ack_lat": { 2024-02-21T23:12:57.806 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:57.806 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:57.806 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:57.806 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:57.807 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_encrypted_bytes": 1535040, 2024-02-21T23:12:57.807 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_encrypted_bytes": 115216 2024-02-21T23:12:57.807 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:57.807 INFO:teuthology.orchestra.run.smithi181.stdout: "AsyncMessenger::Worker-2": { 2024-02-21T23:12:57.807 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_messages": 6, 2024-02-21T23:12:57.807 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages": 151, 2024-02-21T23:12:57.807 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_bytes": 1888, 2024-02-21T23:12:57.807 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_bytes": 181376, 2024-02-21T23:12:57.808 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_created_connections": 5, 2024-02-21T23:12:57.808 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_active_connections": 3, 2024-02-21T23:12:57.808 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_total_time": 0.012231030, 2024-02-21T23:12:57.808 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_send_time": 0.006682914, 2024-02-21T23:12:57.808 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_recv_time": 0.003571528, 2024-02-21T23:12:57.808 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-02-21T23:12:57.808 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages_queue_lat": { 2024-02-21T23:12:57.808 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 149, 2024-02-21T23:12:57.809 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.018098784, 2024-02-21T23:12:57.809 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000121468 2024-02-21T23:12:57.809 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:57.809 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_handle_ack_lat": { 2024-02-21T23:12:57.809 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:57.809 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:57.809 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:57.809 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:57.810 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_encrypted_bytes": 1888, 2024-02-21T23:12:57.810 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_encrypted_bytes": 181376 2024-02-21T23:12:57.810 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:57.810 INFO:teuthology.orchestra.run.smithi181.stdout: "cct": { 2024-02-21T23:12:57.810 INFO:teuthology.orchestra.run.smithi181.stdout: "total_workers": 0, 2024-02-21T23:12:57.810 INFO:teuthology.orchestra.run.smithi181.stdout: "unhealthy_workers": 0 2024-02-21T23:12:57.810 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:57.810 INFO:teuthology.orchestra.run.smithi181.stdout: "mempool": { 2024-02-21T23:12:57.810 INFO:teuthology.orchestra.run.smithi181.stdout: "bloom_filter_bytes": 0, 2024-02-21T23:12:57.811 INFO:teuthology.orchestra.run.smithi181.stdout: "bloom_filter_items": 0, 2024-02-21T23:12:57.811 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_alloc_bytes": 0, 2024-02-21T23:12:57.811 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_alloc_items": 0, 2024-02-21T23:12:57.811 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_data_bytes": 0, 2024-02-21T23:12:57.811 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_data_items": 0, 2024-02-21T23:12:57.811 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_onode_bytes": 0, 2024-02-21T23:12:57.811 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_onode_items": 0, 2024-02-21T23:12:57.811 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_meta_bytes": 0, 2024-02-21T23:12:57.811 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_meta_items": 0, 2024-02-21T23:12:57.811 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_other_bytes": 0, 2024-02-21T23:12:57.812 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_other_items": 0, 2024-02-21T23:12:57.812 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_buffer_bytes": 0, 2024-02-21T23:12:57.812 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_buffer_items": 0, 2024-02-21T23:12:57.812 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_extent_bytes": 0, 2024-02-21T23:12:57.812 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_extent_items": 0, 2024-02-21T23:12:57.812 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_blob_bytes": 0, 2024-02-21T23:12:57.812 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_blob_items": 0, 2024-02-21T23:12:57.812 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_shared_blob_bytes": 0, 2024-02-21T23:12:57.813 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_shared_blob_items": 0, 2024-02-21T23:12:57.813 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_inline_bl_bytes": 0, 2024-02-21T23:12:57.813 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_inline_bl_items": 0, 2024-02-21T23:12:57.813 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_fsck_bytes": 0, 2024-02-21T23:12:57.813 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_fsck_items": 0, 2024-02-21T23:12:57.813 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_txc_bytes": 0, 2024-02-21T23:12:57.813 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_txc_items": 0, 2024-02-21T23:12:57.813 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_deferred_bytes": 0, 2024-02-21T23:12:57.814 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_deferred_items": 0, 2024-02-21T23:12:57.814 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_bytes": 0, 2024-02-21T23:12:57.814 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_items": 0, 2024-02-21T23:12:57.814 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_bytes": 0, 2024-02-21T23:12:57.814 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_items": 0, 2024-02-21T23:12:57.814 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_reader_bytes": 0, 2024-02-21T23:12:57.814 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_reader_items": 0, 2024-02-21T23:12:57.815 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_writer_bytes": 0, 2024-02-21T23:12:57.815 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_writer_items": 0, 2024-02-21T23:12:57.815 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_anon_bytes": 150008, 2024-02-21T23:12:57.816 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_anon_items": 31, 2024-02-21T23:12:57.816 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_meta_bytes": 0, 2024-02-21T23:12:57.816 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_meta_items": 0, 2024-02-21T23:12:57.816 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_bytes": 0, 2024-02-21T23:12:57.816 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_items": 0, 2024-02-21T23:12:57.816 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_mapbl_bytes": 0, 2024-02-21T23:12:57.816 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_mapbl_items": 0, 2024-02-21T23:12:57.816 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_pglog_bytes": 0, 2024-02-21T23:12:57.817 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_pglog_items": 0, 2024-02-21T23:12:57.817 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_bytes": 0, 2024-02-21T23:12:57.817 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_items": 0, 2024-02-21T23:12:57.817 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_mapping_bytes": 0, 2024-02-21T23:12:57.817 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_mapping_items": 0, 2024-02-21T23:12:57.817 INFO:teuthology.orchestra.run.smithi181.stdout: "pgmap_bytes": 0, 2024-02-21T23:12:57.817 INFO:teuthology.orchestra.run.smithi181.stdout: "pgmap_items": 0, 2024-02-21T23:12:57.817 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_co_bytes": 928, 2024-02-21T23:12:57.818 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_co_items": 2, 2024-02-21T23:12:57.818 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_1_bytes": 0, 2024-02-21T23:12:57.818 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_1_items": 0, 2024-02-21T23:12:57.818 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_2_bytes": 0, 2024-02-21T23:12:57.818 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_2_items": 0 2024-02-21T23:12:57.818 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:57.818 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-02-21T23:12:57.818 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-02-21T23:12:57.818 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 104857600, 2024-02-21T23:12:57.819 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-02-21T23:12:57.819 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 204, 2024-02-21T23:12:57.819 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 1506553, 2024-02-21T23:12:57.819 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-02-21T23:12:57.819 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 204, 2024-02-21T23:12:57.819 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 0, 2024-02-21T23:12:57.819 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 0, 2024-02-21T23:12:57.820 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 204, 2024-02-21T23:12:57.820 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 1506553, 2024-02-21T23:12:57.820 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-02-21T23:12:57.820 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:57.820 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:57.820 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:57.820 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-02-21T23:12:57.820 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-02-21T23:12:57.821 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-02-21T23:12:57.822 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.c 2024-02-21T23:12:57.822 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.c 2024-02-21T23:12:57.822 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.c 2024-02-21T23:12:57.822 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.c 2024-02-21T23:12:57.822 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.c 2024-02-21T23:12:57.822 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.c 2024-02-21T23:12:57.822 DEBUG:tasks.check_counter:Getting stats from f 2024-02-21T23:12:57.823 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.f.asok perf dump 2024-02-21T23:12:57.931 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-02-21T23:12:57.931 INFO:teuthology.orchestra.run.smithi181.stdout: "AsyncMessenger::Worker-0": { 2024-02-21T23:12:57.931 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_messages": 0, 2024-02-21T23:12:57.932 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages": 2, 2024-02-21T23:12:57.932 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_bytes": 0, 2024-02-21T23:12:57.932 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_bytes": 0, 2024-02-21T23:12:57.932 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_created_connections": 4, 2024-02-21T23:12:57.932 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_active_connections": 0, 2024-02-21T23:12:57.932 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_total_time": 0.001610691, 2024-02-21T23:12:57.932 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_send_time": 0.000000000, 2024-02-21T23:12:57.932 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_recv_time": 0.000463354, 2024-02-21T23:12:57.933 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-02-21T23:12:57.933 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages_queue_lat": { 2024-02-21T23:12:57.933 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:57.933 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:57.933 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:57.933 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:57.933 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_handle_ack_lat": { 2024-02-21T23:12:57.933 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:57.934 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:57.934 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:57.934 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:57.934 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_encrypted_bytes": 0, 2024-02-21T23:12:57.934 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_encrypted_bytes": 0 2024-02-21T23:12:57.934 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:57.934 INFO:teuthology.orchestra.run.smithi181.stdout: "AsyncMessenger::Worker-1": { 2024-02-21T23:12:57.935 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_messages": 6, 2024-02-21T23:12:57.935 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages": 151, 2024-02-21T23:12:57.935 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_bytes": 1888, 2024-02-21T23:12:57.935 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_bytes": 181376, 2024-02-21T23:12:57.935 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_created_connections": 5, 2024-02-21T23:12:57.935 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_active_connections": 3, 2024-02-21T23:12:57.935 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_total_time": 0.013115613, 2024-02-21T23:12:57.935 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_send_time": 0.006527561, 2024-02-21T23:12:57.935 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_recv_time": 0.004544757, 2024-02-21T23:12:57.936 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-02-21T23:12:57.936 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages_queue_lat": { 2024-02-21T23:12:57.936 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 149, 2024-02-21T23:12:57.936 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.021593337, 2024-02-21T23:12:57.936 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000144921 2024-02-21T23:12:57.936 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:57.937 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_handle_ack_lat": { 2024-02-21T23:12:57.937 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:57.937 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:57.937 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:57.937 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:57.937 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_encrypted_bytes": 1888, 2024-02-21T23:12:57.938 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_encrypted_bytes": 181376 2024-02-21T23:12:57.938 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:57.938 INFO:teuthology.orchestra.run.smithi181.stdout: "AsyncMessenger::Worker-2": { 2024-02-21T23:12:57.938 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_messages": 202, 2024-02-21T23:12:57.938 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages": 191, 2024-02-21T23:12:57.938 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_bytes": 1535040, 2024-02-21T23:12:57.938 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_bytes": 115347, 2024-02-21T23:12:57.939 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_created_connections": 2, 2024-02-21T23:12:57.939 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_active_connections": 1, 2024-02-21T23:12:57.939 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_total_time": 0.040940310, 2024-02-21T23:12:57.939 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_send_time": 0.011451837, 2024-02-21T23:12:57.939 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_recv_time": 0.035030248, 2024-02-21T23:12:57.940 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_fast_dispatch_time": 0.004680655, 2024-02-21T23:12:57.940 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages_queue_lat": { 2024-02-21T23:12:57.940 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 191, 2024-02-21T23:12:57.941 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.008685831, 2024-02-21T23:12:57.941 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000045475 2024-02-21T23:12:57.941 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:57.941 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_handle_ack_lat": { 2024-02-21T23:12:57.941 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:57.941 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:57.942 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:57.942 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:57.942 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_encrypted_bytes": 1535040, 2024-02-21T23:12:57.942 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_encrypted_bytes": 115216 2024-02-21T23:12:57.942 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:57.942 INFO:teuthology.orchestra.run.smithi181.stdout: "cct": { 2024-02-21T23:12:57.942 INFO:teuthology.orchestra.run.smithi181.stdout: "total_workers": 0, 2024-02-21T23:12:57.942 INFO:teuthology.orchestra.run.smithi181.stdout: "unhealthy_workers": 0 2024-02-21T23:12:57.943 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:57.943 INFO:teuthology.orchestra.run.smithi181.stdout: "mempool": { 2024-02-21T23:12:57.943 INFO:teuthology.orchestra.run.smithi181.stdout: "bloom_filter_bytes": 0, 2024-02-21T23:12:57.943 INFO:teuthology.orchestra.run.smithi181.stdout: "bloom_filter_items": 0, 2024-02-21T23:12:57.943 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_alloc_bytes": 0, 2024-02-21T23:12:57.944 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_alloc_items": 0, 2024-02-21T23:12:57.944 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_data_bytes": 0, 2024-02-21T23:12:57.944 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_data_items": 0, 2024-02-21T23:12:57.944 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_onode_bytes": 0, 2024-02-21T23:12:57.944 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_onode_items": 0, 2024-02-21T23:12:57.944 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_meta_bytes": 0, 2024-02-21T23:12:57.945 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_meta_items": 0, 2024-02-21T23:12:57.945 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_other_bytes": 0, 2024-02-21T23:12:57.945 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_other_items": 0, 2024-02-21T23:12:57.945 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_buffer_bytes": 0, 2024-02-21T23:12:57.945 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_buffer_items": 0, 2024-02-21T23:12:57.945 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_extent_bytes": 0, 2024-02-21T23:12:57.945 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_extent_items": 0, 2024-02-21T23:12:57.945 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_blob_bytes": 0, 2024-02-21T23:12:57.946 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_blob_items": 0, 2024-02-21T23:12:57.946 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_shared_blob_bytes": 0, 2024-02-21T23:12:57.946 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_shared_blob_items": 0, 2024-02-21T23:12:57.946 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_inline_bl_bytes": 0, 2024-02-21T23:12:57.946 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_inline_bl_items": 0, 2024-02-21T23:12:57.946 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_fsck_bytes": 0, 2024-02-21T23:12:57.947 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_fsck_items": 0, 2024-02-21T23:12:57.947 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_txc_bytes": 0, 2024-02-21T23:12:57.947 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_txc_items": 0, 2024-02-21T23:12:57.947 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_deferred_bytes": 0, 2024-02-21T23:12:57.947 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_deferred_items": 0, 2024-02-21T23:12:57.947 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_bytes": 0, 2024-02-21T23:12:57.947 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_items": 0, 2024-02-21T23:12:57.947 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_bytes": 0, 2024-02-21T23:12:57.947 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_items": 0, 2024-02-21T23:12:57.948 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_reader_bytes": 0, 2024-02-21T23:12:57.948 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_reader_items": 0, 2024-02-21T23:12:57.948 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_writer_bytes": 0, 2024-02-21T23:12:57.948 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_writer_items": 0, 2024-02-21T23:12:57.948 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_anon_bytes": 148994, 2024-02-21T23:12:57.948 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_anon_items": 31, 2024-02-21T23:12:57.948 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_meta_bytes": 0, 2024-02-21T23:12:57.948 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_meta_items": 0, 2024-02-21T23:12:57.949 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_bytes": 0, 2024-02-21T23:12:57.949 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_items": 0, 2024-02-21T23:12:57.949 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_mapbl_bytes": 0, 2024-02-21T23:12:57.949 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_mapbl_items": 0, 2024-02-21T23:12:57.949 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_pglog_bytes": 0, 2024-02-21T23:12:57.949 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_pglog_items": 0, 2024-02-21T23:12:57.949 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_bytes": 0, 2024-02-21T23:12:57.949 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_items": 0, 2024-02-21T23:12:57.950 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_mapping_bytes": 0, 2024-02-21T23:12:57.950 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_mapping_items": 0, 2024-02-21T23:12:57.950 INFO:teuthology.orchestra.run.smithi181.stdout: "pgmap_bytes": 0, 2024-02-21T23:12:57.951 INFO:teuthology.orchestra.run.smithi181.stdout: "pgmap_items": 0, 2024-02-21T23:12:57.951 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_co_bytes": 928, 2024-02-21T23:12:57.951 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_co_items": 2, 2024-02-21T23:12:57.951 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_1_bytes": 0, 2024-02-21T23:12:57.951 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_1_items": 0, 2024-02-21T23:12:57.951 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_2_bytes": 0, 2024-02-21T23:12:57.951 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_2_items": 0 2024-02-21T23:12:57.952 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:57.952 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-02-21T23:12:57.952 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-02-21T23:12:57.952 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 104857600, 2024-02-21T23:12:57.952 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-02-21T23:12:57.952 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 204, 2024-02-21T23:12:57.952 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 1506553, 2024-02-21T23:12:57.953 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-02-21T23:12:57.953 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 204, 2024-02-21T23:12:57.953 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 0, 2024-02-21T23:12:57.953 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 0, 2024-02-21T23:12:57.953 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 204, 2024-02-21T23:12:57.953 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 1506553, 2024-02-21T23:12:57.953 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-02-21T23:12:57.953 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:57.953 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:57.954 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:57.954 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-02-21T23:12:57.954 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-02-21T23:12:57.954 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-02-21T23:12:57.955 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.f 2024-02-21T23:12:57.955 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.f 2024-02-21T23:12:57.956 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.f 2024-02-21T23:12:57.956 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.f 2024-02-21T23:12:57.956 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.f 2024-02-21T23:12:57.956 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.f 2024-02-21T23:12:57.956 DEBUG:tasks.check_counter:Getting stats from i 2024-02-21T23:12:57.956 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.i.asok perf dump 2024-02-21T23:12:58.063 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-02-21T23:12:58.064 INFO:teuthology.orchestra.run.smithi181.stdout: "AsyncMessenger::Worker-0": { 2024-02-21T23:12:58.064 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_messages": 905, 2024-02-21T23:12:58.064 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages": 891, 2024-02-21T23:12:58.064 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_bytes": 1799312, 2024-02-21T23:12:58.064 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_bytes": 335627, 2024-02-21T23:12:58.064 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_created_connections": 5, 2024-02-21T23:12:58.064 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_active_connections": 1, 2024-02-21T23:12:58.065 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_total_time": 0.123773294, 2024-02-21T23:12:58.065 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_send_time": 0.033817386, 2024-02-21T23:12:58.065 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_recv_time": 0.055781802, 2024-02-21T23:12:58.065 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_fast_dispatch_time": 0.033539021, 2024-02-21T23:12:58.065 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages_queue_lat": { 2024-02-21T23:12:58.065 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 891, 2024-02-21T23:12:58.065 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.046815252, 2024-02-21T23:12:58.065 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000052542 2024-02-21T23:12:58.065 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.066 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_handle_ack_lat": { 2024-02-21T23:12:58.066 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:58.066 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:58.066 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:58.066 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.066 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_encrypted_bytes": 1569488, 2024-02-21T23:12:58.066 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_encrypted_bytes": 117984 2024-02-21T23:12:58.066 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.067 INFO:teuthology.orchestra.run.smithi181.stdout: "AsyncMessenger::Worker-1": { 2024-02-21T23:12:58.067 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_messages": 4, 2024-02-21T23:12:58.067 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages": 151, 2024-02-21T23:12:58.067 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_bytes": 876, 2024-02-21T23:12:58.067 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_bytes": 419165, 2024-02-21T23:12:58.067 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_created_connections": 6, 2024-02-21T23:12:58.067 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_active_connections": 4, 2024-02-21T23:12:58.067 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_total_time": 0.009787385, 2024-02-21T23:12:58.068 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_send_time": 0.005629667, 2024-02-21T23:12:58.068 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_recv_time": 0.002402587, 2024-02-21T23:12:58.068 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_fast_dispatch_time": 0.000076606, 2024-02-21T23:12:58.068 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages_queue_lat": { 2024-02-21T23:12:58.068 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 149, 2024-02-21T23:12:58.068 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.011252058, 2024-02-21T23:12:58.068 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000075517 2024-02-21T23:12:58.068 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.069 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_handle_ack_lat": { 2024-02-21T23:12:58.069 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:58.069 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:58.069 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:58.069 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.069 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_encrypted_bytes": 320, 2024-02-21T23:12:58.069 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_encrypted_bytes": 418336 2024-02-21T23:12:58.069 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.070 INFO:teuthology.orchestra.run.smithi181.stdout: "AsyncMessenger::Worker-2": { 2024-02-21T23:12:58.070 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_messages": 1353, 2024-02-21T23:12:58.070 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages": 1353, 2024-02-21T23:12:58.070 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_bytes": 6051874, 2024-02-21T23:12:58.070 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_bytes": 429437, 2024-02-21T23:12:58.070 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_created_connections": 4, 2024-02-21T23:12:58.070 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_active_connections": 3, 2024-02-21T23:12:58.070 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_total_time": 0.091187789, 2024-02-21T23:12:58.071 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_send_time": 0.030760215, 2024-02-21T23:12:58.071 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_recv_time": 0.026945763, 2024-02-21T23:12:58.071 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_fast_dispatch_time": 0.026712045, 2024-02-21T23:12:58.071 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages_queue_lat": { 2024-02-21T23:12:58.071 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 1352, 2024-02-21T23:12:58.071 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.057605415, 2024-02-21T23:12:58.071 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000042607 2024-02-21T23:12:58.071 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.072 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_handle_ack_lat": { 2024-02-21T23:12:58.072 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:58.072 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:58.072 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:58.072 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.073 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_encrypted_bytes": 1568, 2024-02-21T23:12:58.073 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_encrypted_bytes": 448 2024-02-21T23:12:58.073 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.073 INFO:teuthology.orchestra.run.smithi181.stdout: "cct": { 2024-02-21T23:12:58.073 INFO:teuthology.orchestra.run.smithi181.stdout: "total_workers": 1, 2024-02-21T23:12:58.073 INFO:teuthology.orchestra.run.smithi181.stdout: "unhealthy_workers": 0 2024-02-21T23:12:58.073 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.073 INFO:teuthology.orchestra.run.smithi181.stdout: "finisher-MDSRank": { 2024-02-21T23:12:58.074 INFO:teuthology.orchestra.run.smithi181.stdout: "queue_len": 0, 2024-02-21T23:12:58.074 INFO:teuthology.orchestra.run.smithi181.stdout: "complete_latency": { 2024-02-21T23:12:58.074 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 3418, 2024-02-21T23:12:58.074 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.097271034, 2024-02-21T23:12:58.074 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000028458 2024-02-21T23:12:58.074 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-02-21T23:12:58.074 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.074 INFO:teuthology.orchestra.run.smithi181.stdout: "finisher-PurgeQueue": { 2024-02-21T23:12:58.074 INFO:teuthology.orchestra.run.smithi181.stdout: "queue_len": 0, 2024-02-21T23:12:58.075 INFO:teuthology.orchestra.run.smithi181.stdout: "complete_latency": { 2024-02-21T23:12:58.075 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:58.075 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:58.075 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:58.075 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-02-21T23:12:58.075 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.075 INFO:teuthology.orchestra.run.smithi181.stdout: "mds": { 2024-02-21T23:12:58.075 INFO:teuthology.orchestra.run.smithi181.stdout: "request": 0, 2024-02-21T23:12:58.076 INFO:teuthology.orchestra.run.smithi181.stdout: "reply": 0, 2024-02-21T23:12:58.076 INFO:teuthology.orchestra.run.smithi181.stdout: "reply_latency": { 2024-02-21T23:12:58.076 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:58.076 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:58.076 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:58.076 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.076 INFO:teuthology.orchestra.run.smithi181.stdout: "slow_reply": 0, 2024-02-21T23:12:58.077 INFO:teuthology.orchestra.run.smithi181.stdout: "forward": 0, 2024-02-21T23:12:58.077 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_fetch_complete": 0, 2024-02-21T23:12:58.077 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_fetch_keys": 0, 2024-02-21T23:12:58.077 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_commit": 0, 2024-02-21T23:12:58.077 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_split": 0, 2024-02-21T23:12:58.077 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_merge": 0, 2024-02-21T23:12:58.077 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes": 1648, 2024-02-21T23:12:58.077 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_top": 2, 2024-02-21T23:12:58.077 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_bottom": 1646, 2024-02-21T23:12:58.078 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_pin_tail": 0, 2024-02-21T23:12:58.078 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_pinned": 1644, 2024-02-21T23:12:58.078 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_expired": 0, 2024-02-21T23:12:58.078 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_with_caps": 0, 2024-02-21T23:12:58.078 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": 0, 2024-02-21T23:12:58.078 INFO:teuthology.orchestra.run.smithi181.stdout: "subtrees": 21, 2024-02-21T23:12:58.079 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse": 0, 2024-02-21T23:12:58.079 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_hit": 0, 2024-02-21T23:12:58.079 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_forward": 0, 2024-02-21T23:12:58.079 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_discover": 0, 2024-02-21T23:12:58.079 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_dir_fetch": 0, 2024-02-21T23:12:58.079 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_remote_ino": 0, 2024-02-21T23:12:58.079 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_lock": 0, 2024-02-21T23:12:58.079 INFO:teuthology.orchestra.run.smithi181.stdout: "load_cent": 0, 2024-02-21T23:12:58.080 INFO:teuthology.orchestra.run.smithi181.stdout: "q": 0, 2024-02-21T23:12:58.080 INFO:teuthology.orchestra.run.smithi181.stdout: "exported": 0, 2024-02-21T23:12:58.080 INFO:teuthology.orchestra.run.smithi181.stdout: "exported_inodes": 0, 2024-02-21T23:12:58.080 INFO:teuthology.orchestra.run.smithi181.stdout: "imported": 0, 2024-02-21T23:12:58.080 INFO:teuthology.orchestra.run.smithi181.stdout: "imported_inodes": 0, 2024-02-21T23:12:58.080 INFO:teuthology.orchestra.run.smithi181.stdout: "openino_dir_fetch": 0, 2024-02-21T23:12:58.080 INFO:teuthology.orchestra.run.smithi181.stdout: "openino_backtrace_fetch": 0, 2024-02-21T23:12:58.080 INFO:teuthology.orchestra.run.smithi181.stdout: "openino_peer_discover": 0, 2024-02-21T23:12:58.081 INFO:teuthology.orchestra.run.smithi181.stdout: "root_rfiles": 0, 2024-02-21T23:12:58.081 INFO:teuthology.orchestra.run.smithi181.stdout: "root_rbytes": 0, 2024-02-21T23:12:58.081 INFO:teuthology.orchestra.run.smithi181.stdout: "root_rsnaps": 0, 2024-02-21T23:12:58.081 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_backtrace_fetch": 0, 2024-02-21T23:12:58.081 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_set_tag": 0, 2024-02-21T23:12:58.082 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_backtrace_repaired": 0, 2024-02-21T23:12:58.082 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_inotable_repaired": 0, 2024-02-21T23:12:58.082 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_dir_inodes": 0, 2024-02-21T23:12:58.082 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_dir_base_inodes": 0, 2024-02-21T23:12:58.083 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_dirfrag_rstats": 0, 2024-02-21T23:12:58.083 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_file_inodes": 0, 2024-02-21T23:12:58.083 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_inode_file_caps": 0, 2024-02-21T23:12:58.083 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_revoke": 0, 2024-02-21T23:12:58.083 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_grant": 0, 2024-02-21T23:12:58.083 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_trunc": 0, 2024-02-21T23:12:58.083 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-02-21T23:12:58.083 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_flush_ack": 0, 2024-02-21T23:12:58.084 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_caps": 0, 2024-02-21T23:12:58.084 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_caps_dirty": 0, 2024-02-21T23:12:58.084 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_cap_release": 0, 2024-02-21T23:12:58.084 INFO:teuthology.orchestra.run.smithi181.stdout: "process_request_cap_release": 0 2024-02-21T23:12:58.084 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.084 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_cache": { 2024-02-21T23:12:58.084 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_update": 0, 2024-02-21T23:12:58.087 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_update_receipt": 0, 2024-02-21T23:12:58.088 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_try_discover": 0, 2024-02-21T23:12:58.088 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_send_discover": 0, 2024-02-21T23:12:58.088 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_handle_discover": 0, 2024-02-21T23:12:58.088 INFO:teuthology.orchestra.run.smithi181.stdout: "num_strays": 0, 2024-02-21T23:12:58.088 INFO:teuthology.orchestra.run.smithi181.stdout: "num_strays_delayed": 0, 2024-02-21T23:12:58.088 INFO:teuthology.orchestra.run.smithi181.stdout: "num_strays_enqueuing": 0, 2024-02-21T23:12:58.088 INFO:teuthology.orchestra.run.smithi181.stdout: "strays_created": 0, 2024-02-21T23:12:58.089 INFO:teuthology.orchestra.run.smithi181.stdout: "strays_enqueued": 0, 2024-02-21T23:12:58.089 INFO:teuthology.orchestra.run.smithi181.stdout: "strays_reintegrated": 0, 2024-02-21T23:12:58.089 INFO:teuthology.orchestra.run.smithi181.stdout: "strays_migrated": 0, 2024-02-21T23:12:58.089 INFO:teuthology.orchestra.run.smithi181.stdout: "num_recovering_processing": 0, 2024-02-21T23:12:58.089 INFO:teuthology.orchestra.run.smithi181.stdout: "num_recovering_enqueued": 0, 2024-02-21T23:12:58.089 INFO:teuthology.orchestra.run.smithi181.stdout: "num_recovering_prioritized": 0, 2024-02-21T23:12:58.089 INFO:teuthology.orchestra.run.smithi181.stdout: "recovery_started": 0, 2024-02-21T23:12:58.089 INFO:teuthology.orchestra.run.smithi181.stdout: "recovery_completed": 0, 2024-02-21T23:12:58.089 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_enqueue_scrub": 0, 2024-02-21T23:12:58.090 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_exportdir": 0, 2024-02-21T23:12:58.090 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_flush": 0, 2024-02-21T23:12:58.090 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_fragmentdir": 0, 2024-02-21T23:12:58.090 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_fragstats": 0, 2024-02-21T23:12:58.090 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_inodestats": 0 2024-02-21T23:12:58.090 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.090 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_log": { 2024-02-21T23:12:58.090 INFO:teuthology.orchestra.run.smithi181.stdout: "evlrg": 0, 2024-02-21T23:12:58.091 INFO:teuthology.orchestra.run.smithi181.stdout: "evadd": 0, 2024-02-21T23:12:58.091 INFO:teuthology.orchestra.run.smithi181.stdout: "evex": 0, 2024-02-21T23:12:58.091 INFO:teuthology.orchestra.run.smithi181.stdout: "evtrm": 0, 2024-02-21T23:12:58.091 INFO:teuthology.orchestra.run.smithi181.stdout: "ev": 2934, 2024-02-21T23:12:58.091 INFO:teuthology.orchestra.run.smithi181.stdout: "evexg": 0, 2024-02-21T23:12:58.091 INFO:teuthology.orchestra.run.smithi181.stdout: "evexd": 0, 2024-02-21T23:12:58.091 INFO:teuthology.orchestra.run.smithi181.stdout: "segadd": 0, 2024-02-21T23:12:58.091 INFO:teuthology.orchestra.run.smithi181.stdout: "segex": 0, 2024-02-21T23:12:58.092 INFO:teuthology.orchestra.run.smithi181.stdout: "segtrm": 0, 2024-02-21T23:12:58.092 INFO:teuthology.orchestra.run.smithi181.stdout: "seg": 5, 2024-02-21T23:12:58.092 INFO:teuthology.orchestra.run.smithi181.stdout: "segmjr": 2, 2024-02-21T23:12:58.092 INFO:teuthology.orchestra.run.smithi181.stdout: "segexg": 0, 2024-02-21T23:12:58.092 INFO:teuthology.orchestra.run.smithi181.stdout: "segexd": 0, 2024-02-21T23:12:58.092 INFO:teuthology.orchestra.run.smithi181.stdout: "expos": 4194304, 2024-02-21T23:12:58.092 INFO:teuthology.orchestra.run.smithi181.stdout: "wrpos": 9892219, 2024-02-21T23:12:58.092 INFO:teuthology.orchestra.run.smithi181.stdout: "rdpos": 9891645, 2024-02-21T23:12:58.093 INFO:teuthology.orchestra.run.smithi181.stdout: "jlat": { 2024-02-21T23:12:58.093 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:58.093 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:58.093 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:58.093 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.093 INFO:teuthology.orchestra.run.smithi181.stdout: "replayed": 2934 2024-02-21T23:12:58.093 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.093 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_mem": { 2024-02-21T23:12:58.094 INFO:teuthology.orchestra.run.smithi181.stdout: "ino": 830, 2024-02-21T23:12:58.094 INFO:teuthology.orchestra.run.smithi181.stdout: "ino+": 1387, 2024-02-21T23:12:58.094 INFO:teuthology.orchestra.run.smithi181.stdout: "ino-": 557, 2024-02-21T23:12:58.094 INFO:teuthology.orchestra.run.smithi181.stdout: "dir": 35, 2024-02-21T23:12:58.094 INFO:teuthology.orchestra.run.smithi181.stdout: "dir+": 35, 2024-02-21T23:12:58.094 INFO:teuthology.orchestra.run.smithi181.stdout: "dir-": 0, 2024-02-21T23:12:58.094 INFO:teuthology.orchestra.run.smithi181.stdout: "dn": 1648, 2024-02-21T23:12:58.094 INFO:teuthology.orchestra.run.smithi181.stdout: "dn+": 1648, 2024-02-21T23:12:58.095 INFO:teuthology.orchestra.run.smithi181.stdout: "dn-": 0, 2024-02-21T23:12:58.095 INFO:teuthology.orchestra.run.smithi181.stdout: "cap": 0, 2024-02-21T23:12:58.095 INFO:teuthology.orchestra.run.smithi181.stdout: "cap+": 0, 2024-02-21T23:12:58.095 INFO:teuthology.orchestra.run.smithi181.stdout: "cap-": 0, 2024-02-21T23:12:58.095 INFO:teuthology.orchestra.run.smithi181.stdout: "rss": 54448, 2024-02-21T23:12:58.095 INFO:teuthology.orchestra.run.smithi181.stdout: "heap": 215396 2024-02-21T23:12:58.095 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.095 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_server": { 2024-02-21T23:12:58.095 INFO:teuthology.orchestra.run.smithi181.stdout: "dispatch_client_request": 0, 2024-02-21T23:12:58.096 INFO:teuthology.orchestra.run.smithi181.stdout: "dispatch_server_request": 0, 2024-02-21T23:12:58.096 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_request": 0, 2024-02-21T23:12:58.096 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_session": 0, 2024-02-21T23:12:58.096 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_peer_request": 0, 2024-02-21T23:12:58.096 INFO:teuthology.orchestra.run.smithi181.stdout: "req_create_latency": { 2024-02-21T23:12:58.096 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:58.096 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:58.097 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:58.097 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.097 INFO:teuthology.orchestra.run.smithi181.stdout: "req_getattr_latency": { 2024-02-21T23:12:58.097 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:58.097 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:58.097 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:58.097 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.097 INFO:teuthology.orchestra.run.smithi181.stdout: "req_getfilelock_latency": { 2024-02-21T23:12:58.098 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:58.098 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:58.098 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:58.098 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.098 INFO:teuthology.orchestra.run.smithi181.stdout: "req_link_latency": { 2024-02-21T23:12:58.098 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:58.098 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:58.099 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:58.099 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.099 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookup_latency": { 2024-02-21T23:12:58.099 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:58.099 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:58.099 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:58.099 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.099 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookuphash_latency": { 2024-02-21T23:12:58.100 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:58.100 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:58.100 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:58.100 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.100 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookupino_latency": { 2024-02-21T23:12:58.100 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:58.100 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:58.101 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:58.101 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.101 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookupname_latency": { 2024-02-21T23:12:58.101 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:58.101 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:58.101 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:58.101 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.102 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookupparent_latency": { 2024-02-21T23:12:58.102 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:58.102 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:58.102 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:58.102 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.102 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookupsnap_latency": { 2024-02-21T23:12:58.103 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:58.103 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:58.103 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:58.103 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.103 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lssnap_latency": { 2024-02-21T23:12:58.103 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:58.103 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:58.103 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:58.104 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.104 INFO:teuthology.orchestra.run.smithi181.stdout: "req_mkdir_latency": { 2024-02-21T23:12:58.104 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:58.104 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:58.104 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:58.104 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.104 INFO:teuthology.orchestra.run.smithi181.stdout: "req_mknod_latency": { 2024-02-21T23:12:58.105 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:58.105 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:58.105 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:58.105 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.105 INFO:teuthology.orchestra.run.smithi181.stdout: "req_mksnap_latency": { 2024-02-21T23:12:58.105 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:58.105 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:58.105 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:58.105 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.106 INFO:teuthology.orchestra.run.smithi181.stdout: "req_open_latency": { 2024-02-21T23:12:58.106 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:58.106 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:58.106 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:58.106 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.106 INFO:teuthology.orchestra.run.smithi181.stdout: "req_readdir_latency": { 2024-02-21T23:12:58.106 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:58.106 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:58.107 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:58.107 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.107 INFO:teuthology.orchestra.run.smithi181.stdout: "req_rename_latency": { 2024-02-21T23:12:58.107 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:58.107 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:58.107 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:58.107 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.107 INFO:teuthology.orchestra.run.smithi181.stdout: "req_renamesnap_latency": { 2024-02-21T23:12:58.108 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:58.108 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:58.108 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:58.108 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.108 INFO:teuthology.orchestra.run.smithi181.stdout: "req_snapdiff_latency": { 2024-02-21T23:12:58.108 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:58.108 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:58.108 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:58.109 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.109 INFO:teuthology.orchestra.run.smithi181.stdout: "req_rmdir_latency": { 2024-02-21T23:12:58.109 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:58.109 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:58.109 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:58.109 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.109 INFO:teuthology.orchestra.run.smithi181.stdout: "req_rmsnap_latency": { 2024-02-21T23:12:58.109 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:58.109 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:58.110 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:58.110 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.110 INFO:teuthology.orchestra.run.smithi181.stdout: "req_rmxattr_latency": { 2024-02-21T23:12:58.110 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:58.110 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:58.110 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:58.110 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.110 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setattr_latency": { 2024-02-21T23:12:58.111 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:58.111 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:58.111 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:58.111 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.111 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setdirlayout_latency": { 2024-02-21T23:12:58.111 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:58.111 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:58.111 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:58.111 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.112 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setfilelock_latency": { 2024-02-21T23:12:58.112 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:58.112 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:58.112 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:58.112 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.112 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setlayout_latency": { 2024-02-21T23:12:58.112 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:58.113 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:58.113 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:58.113 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.113 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setxattr_latency": { 2024-02-21T23:12:58.113 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:58.113 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:58.113 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:58.113 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.113 INFO:teuthology.orchestra.run.smithi181.stdout: "req_symlink_latency": { 2024-02-21T23:12:58.114 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:58.114 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:58.114 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:58.114 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.114 INFO:teuthology.orchestra.run.smithi181.stdout: "req_unlink_latency": { 2024-02-21T23:12:58.114 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:58.114 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:58.114 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:58.115 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.115 INFO:teuthology.orchestra.run.smithi181.stdout: "cap_revoke_eviction": 0, 2024-02-21T23:12:58.115 INFO:teuthology.orchestra.run.smithi181.stdout: "cap_acquisition_throttle": 0, 2024-02-21T23:12:58.115 INFO:teuthology.orchestra.run.smithi181.stdout: "req_getvxattr_latency": { 2024-02-21T23:12:58.115 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:58.115 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:58.115 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:58.115 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-02-21T23:12:58.116 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.116 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_sessions": { 2024-02-21T23:12:58.116 INFO:teuthology.orchestra.run.smithi181.stdout: "session_count": 2, 2024-02-21T23:12:58.116 INFO:teuthology.orchestra.run.smithi181.stdout: "session_add": 5, 2024-02-21T23:12:58.116 INFO:teuthology.orchestra.run.smithi181.stdout: "session_remove": 3, 2024-02-21T23:12:58.116 INFO:teuthology.orchestra.run.smithi181.stdout: "sessions_open": 4, 2024-02-21T23:12:58.116 INFO:teuthology.orchestra.run.smithi181.stdout: "sessions_stale": 0, 2024-02-21T23:12:58.116 INFO:teuthology.orchestra.run.smithi181.stdout: "total_load": 0, 2024-02-21T23:12:58.117 INFO:teuthology.orchestra.run.smithi181.stdout: "average_load": 0, 2024-02-21T23:12:58.117 INFO:teuthology.orchestra.run.smithi181.stdout: "avg_session_uptime": 3372, 2024-02-21T23:12:58.117 INFO:teuthology.orchestra.run.smithi181.stdout: "mdthresh_evicted": 0 2024-02-21T23:12:58.117 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.117 INFO:teuthology.orchestra.run.smithi181.stdout: "mempool": { 2024-02-21T23:12:58.117 INFO:teuthology.orchestra.run.smithi181.stdout: "bloom_filter_bytes": 0, 2024-02-21T23:12:58.117 INFO:teuthology.orchestra.run.smithi181.stdout: "bloom_filter_items": 0, 2024-02-21T23:12:58.117 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_alloc_bytes": 0, 2024-02-21T23:12:58.118 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_alloc_items": 0, 2024-02-21T23:12:58.118 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_data_bytes": 0, 2024-02-21T23:12:58.118 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_data_items": 0, 2024-02-21T23:12:58.118 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_onode_bytes": 0, 2024-02-21T23:12:58.118 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_onode_items": 0, 2024-02-21T23:12:58.118 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_meta_bytes": 0, 2024-02-21T23:12:58.118 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_meta_items": 0, 2024-02-21T23:12:58.118 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_other_bytes": 0, 2024-02-21T23:12:58.118 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_other_items": 0, 2024-02-21T23:12:58.119 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_buffer_bytes": 0, 2024-02-21T23:12:58.119 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_buffer_items": 0, 2024-02-21T23:12:58.119 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_extent_bytes": 0, 2024-02-21T23:12:58.119 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_extent_items": 0, 2024-02-21T23:12:58.119 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_blob_bytes": 0, 2024-02-21T23:12:58.119 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_blob_items": 0, 2024-02-21T23:12:58.119 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_shared_blob_bytes": 0, 2024-02-21T23:12:58.119 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_shared_blob_items": 0, 2024-02-21T23:12:58.120 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_inline_bl_bytes": 0, 2024-02-21T23:12:58.120 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_inline_bl_items": 0, 2024-02-21T23:12:58.120 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_fsck_bytes": 0, 2024-02-21T23:12:58.120 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_fsck_items": 0, 2024-02-21T23:12:58.120 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_txc_bytes": 0, 2024-02-21T23:12:58.120 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_txc_items": 0, 2024-02-21T23:12:58.120 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_deferred_bytes": 0, 2024-02-21T23:12:58.120 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_deferred_items": 0, 2024-02-21T23:12:58.121 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_bytes": 0, 2024-02-21T23:12:58.121 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_items": 0, 2024-02-21T23:12:58.121 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_bytes": 0, 2024-02-21T23:12:58.121 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_items": 0, 2024-02-21T23:12:58.121 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_reader_bytes": 0, 2024-02-21T23:12:58.121 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_reader_items": 0, 2024-02-21T23:12:58.121 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_writer_bytes": 0, 2024-02-21T23:12:58.121 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_writer_items": 0, 2024-02-21T23:12:58.122 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_anon_bytes": 212847, 2024-02-21T23:12:58.122 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_anon_items": 873, 2024-02-21T23:12:58.122 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_meta_bytes": 0, 2024-02-21T23:12:58.122 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_meta_items": 0, 2024-02-21T23:12:58.122 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_bytes": 0, 2024-02-21T23:12:58.122 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_items": 0, 2024-02-21T23:12:58.122 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_mapbl_bytes": 0, 2024-02-21T23:12:58.122 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_mapbl_items": 0, 2024-02-21T23:12:58.123 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_pglog_bytes": 0, 2024-02-21T23:12:58.123 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_pglog_items": 0, 2024-02-21T23:12:58.123 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_bytes": 8136, 2024-02-21T23:12:58.123 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_items": 153, 2024-02-21T23:12:58.123 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_mapping_bytes": 0, 2024-02-21T23:12:58.123 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_mapping_items": 0, 2024-02-21T23:12:58.123 INFO:teuthology.orchestra.run.smithi181.stdout: "pgmap_bytes": 0, 2024-02-21T23:12:58.123 INFO:teuthology.orchestra.run.smithi181.stdout: "pgmap_items": 0, 2024-02-21T23:12:58.123 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_co_bytes": 3086285, 2024-02-21T23:12:58.124 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_co_items": 26389, 2024-02-21T23:12:58.124 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_1_bytes": 0, 2024-02-21T23:12:58.124 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_1_items": 0, 2024-02-21T23:12:58.124 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_2_bytes": 0, 2024-02-21T23:12:58.124 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_2_items": 0 2024-02-21T23:12:58.124 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.124 INFO:teuthology.orchestra.run.smithi181.stdout: "objecter": { 2024-02-21T23:12:58.125 INFO:teuthology.orchestra.run.smithi181.stdout: "op_active": 0, 2024-02-21T23:12:58.125 INFO:teuthology.orchestra.run.smithi181.stdout: "op_laggy": 0, 2024-02-21T23:12:58.125 INFO:teuthology.orchestra.run.smithi181.stdout: "op_send": 2035, 2024-02-21T23:12:58.125 INFO:teuthology.orchestra.run.smithi181.stdout: "op_send_bytes": 21, 2024-02-21T23:12:58.125 INFO:teuthology.orchestra.run.smithi181.stdout: "op_resend": 3, 2024-02-21T23:12:58.125 INFO:teuthology.orchestra.run.smithi181.stdout: "op_reply": 2035, 2024-02-21T23:12:58.125 INFO:teuthology.orchestra.run.smithi181.stdout: "op_latency": { 2024-02-21T23:12:58.125 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 2035, 2024-02-21T23:12:58.126 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 1.070979654, 2024-02-21T23:12:58.126 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000526279 2024-02-21T23:12:58.126 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.126 INFO:teuthology.orchestra.run.smithi181.stdout: "op_inflight": 0, 2024-02-21T23:12:58.126 INFO:teuthology.orchestra.run.smithi181.stdout: "oplen_avg": { 2024-02-21T23:12:58.126 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 2035, 2024-02-21T23:12:58.126 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 2036 2024-02-21T23:12:58.126 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.127 INFO:teuthology.orchestra.run.smithi181.stdout: "op": 2035, 2024-02-21T23:12:58.127 INFO:teuthology.orchestra.run.smithi181.stdout: "op_r": 2035, 2024-02-21T23:12:58.127 INFO:teuthology.orchestra.run.smithi181.stdout: "op_w": 0, 2024-02-21T23:12:58.127 INFO:teuthology.orchestra.run.smithi181.stdout: "op_rmw": 0, 2024-02-21T23:12:58.127 INFO:teuthology.orchestra.run.smithi181.stdout: "op_pg": 0, 2024-02-21T23:12:58.127 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_stat": 1327, 2024-02-21T23:12:58.127 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_create": 0, 2024-02-21T23:12:58.127 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_read": 706, 2024-02-21T23:12:58.127 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_write": 0, 2024-02-21T23:12:58.128 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_writefull": 0, 2024-02-21T23:12:58.128 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_writesame": 0, 2024-02-21T23:12:58.128 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_append": 0, 2024-02-21T23:12:58.128 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_zero": 0, 2024-02-21T23:12:58.128 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_truncate": 0, 2024-02-21T23:12:58.128 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_delete": 0, 2024-02-21T23:12:58.128 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_mapext": 0, 2024-02-21T23:12:58.129 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_sparse_read": 0, 2024-02-21T23:12:58.129 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_clonerange": 0, 2024-02-21T23:12:58.129 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_getxattr": 1, 2024-02-21T23:12:58.129 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_setxattr": 0, 2024-02-21T23:12:58.129 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_cmpxattr": 0, 2024-02-21T23:12:58.129 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_rmxattr": 0, 2024-02-21T23:12:58.129 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_resetxattrs": 0, 2024-02-21T23:12:58.129 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_call": 0, 2024-02-21T23:12:58.129 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_watch": 0, 2024-02-21T23:12:58.130 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_notify": 0, 2024-02-21T23:12:58.130 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_src_cmpxattr": 0, 2024-02-21T23:12:58.130 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_pgls": 0, 2024-02-21T23:12:58.130 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_pgls_filter": 0, 2024-02-21T23:12:58.130 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_other": 0, 2024-02-21T23:12:58.130 INFO:teuthology.orchestra.run.smithi181.stdout: "linger_active": 0, 2024-02-21T23:12:58.130 INFO:teuthology.orchestra.run.smithi181.stdout: "linger_send": 0, 2024-02-21T23:12:58.130 INFO:teuthology.orchestra.run.smithi181.stdout: "linger_resend": 0, 2024-02-21T23:12:58.131 INFO:teuthology.orchestra.run.smithi181.stdout: "linger_ping": 0, 2024-02-21T23:12:58.131 INFO:teuthology.orchestra.run.smithi181.stdout: "poolop_active": 0, 2024-02-21T23:12:58.131 INFO:teuthology.orchestra.run.smithi181.stdout: "poolop_send": 0, 2024-02-21T23:12:58.131 INFO:teuthology.orchestra.run.smithi181.stdout: "poolop_resend": 0, 2024-02-21T23:12:58.131 INFO:teuthology.orchestra.run.smithi181.stdout: "poolstat_active": 0, 2024-02-21T23:12:58.131 INFO:teuthology.orchestra.run.smithi181.stdout: "poolstat_send": 0, 2024-02-21T23:12:58.131 INFO:teuthology.orchestra.run.smithi181.stdout: "poolstat_resend": 0, 2024-02-21T23:12:58.131 INFO:teuthology.orchestra.run.smithi181.stdout: "statfs_active": 0, 2024-02-21T23:12:58.131 INFO:teuthology.orchestra.run.smithi181.stdout: "statfs_send": 0, 2024-02-21T23:12:58.132 INFO:teuthology.orchestra.run.smithi181.stdout: "statfs_resend": 0, 2024-02-21T23:12:58.132 INFO:teuthology.orchestra.run.smithi181.stdout: "command_active": 0, 2024-02-21T23:12:58.132 INFO:teuthology.orchestra.run.smithi181.stdout: "command_send": 0, 2024-02-21T23:12:58.132 INFO:teuthology.orchestra.run.smithi181.stdout: "command_resend": 0, 2024-02-21T23:12:58.132 INFO:teuthology.orchestra.run.smithi181.stdout: "map_epoch": 40, 2024-02-21T23:12:58.132 INFO:teuthology.orchestra.run.smithi181.stdout: "map_full": 0, 2024-02-21T23:12:58.132 INFO:teuthology.orchestra.run.smithi181.stdout: "map_inc": 11, 2024-02-21T23:12:58.132 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_sessions": 4, 2024-02-21T23:12:58.133 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_session_open": 4, 2024-02-21T23:12:58.133 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_session_close": 0, 2024-02-21T23:12:58.133 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_laggy": 0, 2024-02-21T23:12:58.133 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_wr": 0, 2024-02-21T23:12:58.133 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_rd": 2, 2024-02-21T23:12:58.133 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_del": 0 2024-02-21T23:12:58.133 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.133 INFO:teuthology.orchestra.run.smithi181.stdout: "oft": { 2024-02-21T23:12:58.134 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_total_objs": 0, 2024-02-21T23:12:58.134 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_total_kv_pairs": 0, 2024-02-21T23:12:58.134 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_total_updates": 0, 2024-02-21T23:12:58.134 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_total_removes": 0 2024-02-21T23:12:58.134 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.134 INFO:teuthology.orchestra.run.smithi181.stdout: "osd-slow-ops": { 2024-02-21T23:12:58.134 INFO:teuthology.orchestra.run.smithi181.stdout: "slow_ops_count": 0 2024-02-21T23:12:58.134 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.135 INFO:teuthology.orchestra.run.smithi181.stdout: "purge_queue": { 2024-02-21T23:12:58.135 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executing_ops": 0, 2024-02-21T23:12:58.135 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executing_ops_high_water": 0, 2024-02-21T23:12:58.135 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executing": 0, 2024-02-21T23:12:58.135 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executing_high_water": 0, 2024-02-21T23:12:58.135 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executed_ops": 0, 2024-02-21T23:12:58.135 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executed": 0, 2024-02-21T23:12:58.135 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_item_in_journal": 0 2024-02-21T23:12:58.136 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.136 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-02-21T23:12:58.136 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-02-21T23:12:58.136 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 104857600, 2024-02-21T23:12:58.136 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-02-21T23:12:58.136 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 2258, 2024-02-21T23:12:58.136 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 7635926, 2024-02-21T23:12:58.136 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-02-21T23:12:58.137 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 2258, 2024-02-21T23:12:58.137 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 0, 2024-02-21T23:12:58.137 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 0, 2024-02-21T23:12:58.137 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 2258, 2024-02-21T23:12:58.137 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 7635926, 2024-02-21T23:12:58.137 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-02-21T23:12:58.137 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:58.137 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:58.138 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:58.138 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-02-21T23:12:58.138 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.138 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-objecter_bytes": { 2024-02-21T23:12:58.138 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-02-21T23:12:58.138 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 104857600, 2024-02-21T23:12:58.138 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-02-21T23:12:58.138 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 0, 2024-02-21T23:12:58.138 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 0, 2024-02-21T23:12:58.139 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-02-21T23:12:58.139 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 0, 2024-02-21T23:12:58.139 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 2035, 2024-02-21T23:12:58.139 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 5698644, 2024-02-21T23:12:58.139 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 2035, 2024-02-21T23:12:58.139 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 5698644, 2024-02-21T23:12:58.139 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-02-21T23:12:58.139 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:58.139 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:58.140 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:58.140 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-02-21T23:12:58.140 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.140 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-objecter_ops": { 2024-02-21T23:12:58.140 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-02-21T23:12:58.140 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 1024, 2024-02-21T23:12:58.140 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-02-21T23:12:58.141 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 0, 2024-02-21T23:12:58.141 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 0, 2024-02-21T23:12:58.141 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-02-21T23:12:58.141 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 0, 2024-02-21T23:12:58.141 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 2035, 2024-02-21T23:12:58.141 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 2035, 2024-02-21T23:12:58.141 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 2035, 2024-02-21T23:12:58.141 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 2035, 2024-02-21T23:12:58.142 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-02-21T23:12:58.142 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:58.142 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:58.142 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:58.142 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-02-21T23:12:58.142 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.143 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-write_buf_throttle": { 2024-02-21T23:12:58.143 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-02-21T23:12:58.143 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 3758096384, 2024-02-21T23:12:58.143 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-02-21T23:12:58.143 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 0, 2024-02-21T23:12:58.143 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 0, 2024-02-21T23:12:58.144 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-02-21T23:12:58.144 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 0, 2024-02-21T23:12:58.144 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 0, 2024-02-21T23:12:58.144 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 0, 2024-02-21T23:12:58.144 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 0, 2024-02-21T23:12:58.144 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 0, 2024-02-21T23:12:58.144 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-02-21T23:12:58.144 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:58.144 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:58.145 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:58.145 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-02-21T23:12:58.145 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.145 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-write_buf_throttle-0x565155108960": { 2024-02-21T23:12:58.145 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-02-21T23:12:58.145 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 3758096384, 2024-02-21T23:12:58.145 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-02-21T23:12:58.146 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 0, 2024-02-21T23:12:58.146 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 0, 2024-02-21T23:12:58.146 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-02-21T23:12:58.146 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 0, 2024-02-21T23:12:58.146 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 0, 2024-02-21T23:12:58.146 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 0, 2024-02-21T23:12:58.146 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 0, 2024-02-21T23:12:58.146 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 0, 2024-02-21T23:12:58.147 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-02-21T23:12:58.147 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:58.147 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:58.147 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:58.147 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-02-21T23:12:58.147 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-02-21T23:12:58.147 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-02-21T23:12:58.149 INFO:tasks.check_counter:Daemon mds.i mds.exported=0 2024-02-21T23:12:58.149 INFO:tasks.check_counter:Daemon mds.i mds.imported=0 2024-02-21T23:12:58.149 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=0 2024-02-21T23:12:58.149 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=0 2024-02-21T23:12:58.149 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=0 2024-02-21T23:12:58.149 INFO:tasks.check_counter:Daemon mds.i mds.dir_split=0 2024-02-21T23:12:58.150 DEBUG:tasks.check_counter:Getting stats from l 2024-02-21T23:12:58.150 DEBUG:teuthology.orchestra.run.smithi181:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.l.asok perf dump 2024-02-21T23:12:58.256 INFO:teuthology.orchestra.run.smithi181.stdout:{ 2024-02-21T23:12:58.257 INFO:teuthology.orchestra.run.smithi181.stdout: "AsyncMessenger::Worker-0": { 2024-02-21T23:12:58.257 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_messages": 694, 2024-02-21T23:12:58.257 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages": 694, 2024-02-21T23:12:58.257 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_bytes": 184063, 2024-02-21T23:12:58.257 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_bytes": 219932, 2024-02-21T23:12:58.257 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_created_connections": 6, 2024-02-21T23:12:58.258 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_active_connections": 2, 2024-02-21T23:12:58.258 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_total_time": 0.070188614, 2024-02-21T23:12:58.258 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_send_time": 0.020014303, 2024-02-21T23:12:58.258 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_recv_time": 0.020883473, 2024-02-21T23:12:58.258 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_fast_dispatch_time": 0.021770805, 2024-02-21T23:12:58.258 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages_queue_lat": { 2024-02-21T23:12:58.258 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 693, 2024-02-21T23:12:58.259 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.031709485, 2024-02-21T23:12:58.259 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000045756 2024-02-21T23:12:58.259 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.259 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_handle_ack_lat": { 2024-02-21T23:12:58.259 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:58.259 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:58.259 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:58.259 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.259 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_encrypted_bytes": 1568, 2024-02-21T23:12:58.260 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_encrypted_bytes": 448 2024-02-21T23:12:58.260 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.260 INFO:teuthology.orchestra.run.smithi181.stdout: "AsyncMessenger::Worker-1": { 2024-02-21T23:12:58.260 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_messages": 226, 2024-02-21T23:12:58.260 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages": 341, 2024-02-21T23:12:58.260 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_bytes": 1571330, 2024-02-21T23:12:58.260 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_bytes": 435716, 2024-02-21T23:12:58.260 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_created_connections": 4, 2024-02-21T23:12:58.261 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_active_connections": 3, 2024-02-21T23:12:58.261 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_total_time": 0.049026242, 2024-02-21T23:12:58.261 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_send_time": 0.016282457, 2024-02-21T23:12:58.261 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_recv_time": 0.037603821, 2024-02-21T23:12:58.261 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_fast_dispatch_time": 0.004798570, 2024-02-21T23:12:58.261 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages_queue_lat": { 2024-02-21T23:12:58.261 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 341, 2024-02-21T23:12:58.261 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.017472808, 2024-02-21T23:12:58.261 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000051239 2024-02-21T23:12:58.262 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.262 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_handle_ack_lat": { 2024-02-21T23:12:58.262 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:58.262 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:58.262 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:58.262 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.262 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_encrypted_bytes": 1570816, 2024-02-21T23:12:58.262 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_encrypted_bytes": 434944 2024-02-21T23:12:58.263 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.263 INFO:teuthology.orchestra.run.smithi181.stdout: "AsyncMessenger::Worker-2": { 2024-02-21T23:12:58.263 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_messages": 1328, 2024-02-21T23:12:58.263 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages": 1346, 2024-02-21T23:12:58.263 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_bytes": 388162, 2024-02-21T23:12:58.263 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_bytes": 524453, 2024-02-21T23:12:58.263 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_created_connections": 6, 2024-02-21T23:12:58.263 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_active_connections": 4, 2024-02-21T23:12:58.263 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_total_time": 0.145392213, 2024-02-21T23:12:58.264 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_send_time": 0.041407757, 2024-02-21T23:12:58.264 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_recv_time": 0.039071132, 2024-02-21T23:12:58.264 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_running_fast_dispatch_time": 0.052064219, 2024-02-21T23:12:58.264 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_messages_queue_lat": { 2024-02-21T23:12:58.264 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 1344, 2024-02-21T23:12:58.264 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.053336973, 2024-02-21T23:12:58.264 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000039685 2024-02-21T23:12:58.265 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.265 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_handle_ack_lat": { 2024-02-21T23:12:58.265 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:58.265 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:58.265 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:58.265 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.265 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_recv_encrypted_bytes": 160, 2024-02-21T23:12:58.265 INFO:teuthology.orchestra.run.smithi181.stdout: "msgr_send_encrypted_bytes": 102336 2024-02-21T23:12:58.265 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.266 INFO:teuthology.orchestra.run.smithi181.stdout: "cct": { 2024-02-21T23:12:58.266 INFO:teuthology.orchestra.run.smithi181.stdout: "total_workers": 1, 2024-02-21T23:12:58.266 INFO:teuthology.orchestra.run.smithi181.stdout: "unhealthy_workers": 0 2024-02-21T23:12:58.266 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.266 INFO:teuthology.orchestra.run.smithi181.stdout: "finisher-MDSRank": { 2024-02-21T23:12:58.266 INFO:teuthology.orchestra.run.smithi181.stdout: "queue_len": 0, 2024-02-21T23:12:58.266 INFO:teuthology.orchestra.run.smithi181.stdout: "complete_latency": { 2024-02-21T23:12:58.267 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 3273, 2024-02-21T23:12:58.267 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.097991667, 2024-02-21T23:12:58.267 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000029939 2024-02-21T23:12:58.267 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-02-21T23:12:58.267 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.267 INFO:teuthology.orchestra.run.smithi181.stdout: "finisher-PurgeQueue": { 2024-02-21T23:12:58.267 INFO:teuthology.orchestra.run.smithi181.stdout: "queue_len": 0, 2024-02-21T23:12:58.267 INFO:teuthology.orchestra.run.smithi181.stdout: "complete_latency": { 2024-02-21T23:12:58.268 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:58.268 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:58.268 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:58.268 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-02-21T23:12:58.268 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.268 INFO:teuthology.orchestra.run.smithi181.stdout: "mds": { 2024-02-21T23:12:58.268 INFO:teuthology.orchestra.run.smithi181.stdout: "request": 0, 2024-02-21T23:12:58.268 INFO:teuthology.orchestra.run.smithi181.stdout: "reply": 0, 2024-02-21T23:12:58.269 INFO:teuthology.orchestra.run.smithi181.stdout: "reply_latency": { 2024-02-21T23:12:58.269 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:58.269 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:58.269 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:58.269 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.269 INFO:teuthology.orchestra.run.smithi181.stdout: "slow_reply": 0, 2024-02-21T23:12:58.269 INFO:teuthology.orchestra.run.smithi181.stdout: "forward": 0, 2024-02-21T23:12:58.269 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_fetch_complete": 0, 2024-02-21T23:12:58.269 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_fetch_keys": 0, 2024-02-21T23:12:58.270 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_commit": 0, 2024-02-21T23:12:58.270 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_split": 0, 2024-02-21T23:12:58.270 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_merge": 0, 2024-02-21T23:12:58.270 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes": 0, 2024-02-21T23:12:58.270 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_top": 0, 2024-02-21T23:12:58.270 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_bottom": 0, 2024-02-21T23:12:58.270 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_pin_tail": 0, 2024-02-21T23:12:58.270 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_pinned": 0, 2024-02-21T23:12:58.271 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_expired": 0, 2024-02-21T23:12:58.271 INFO:teuthology.orchestra.run.smithi181.stdout: "inodes_with_caps": 0, 2024-02-21T23:12:58.271 INFO:teuthology.orchestra.run.smithi181.stdout: "caps": 0, 2024-02-21T23:12:58.271 INFO:teuthology.orchestra.run.smithi181.stdout: "subtrees": 1, 2024-02-21T23:12:58.271 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse": 0, 2024-02-21T23:12:58.271 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_hit": 0, 2024-02-21T23:12:58.271 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_forward": 0, 2024-02-21T23:12:58.271 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_discover": 0, 2024-02-21T23:12:58.271 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_dir_fetch": 0, 2024-02-21T23:12:58.272 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_remote_ino": 0, 2024-02-21T23:12:58.272 INFO:teuthology.orchestra.run.smithi181.stdout: "traverse_lock": 0, 2024-02-21T23:12:58.272 INFO:teuthology.orchestra.run.smithi181.stdout: "load_cent": 0, 2024-02-21T23:12:58.272 INFO:teuthology.orchestra.run.smithi181.stdout: "q": 0, 2024-02-21T23:12:58.272 INFO:teuthology.orchestra.run.smithi181.stdout: "exported": 0, 2024-02-21T23:12:58.272 INFO:teuthology.orchestra.run.smithi181.stdout: "exported_inodes": 0, 2024-02-21T23:12:58.272 INFO:teuthology.orchestra.run.smithi181.stdout: "imported": 0, 2024-02-21T23:12:58.272 INFO:teuthology.orchestra.run.smithi181.stdout: "imported_inodes": 0, 2024-02-21T23:12:58.273 INFO:teuthology.orchestra.run.smithi181.stdout: "openino_dir_fetch": 0, 2024-02-21T23:12:58.273 INFO:teuthology.orchestra.run.smithi181.stdout: "openino_backtrace_fetch": 0, 2024-02-21T23:12:58.273 INFO:teuthology.orchestra.run.smithi181.stdout: "openino_peer_discover": 0, 2024-02-21T23:12:58.273 INFO:teuthology.orchestra.run.smithi181.stdout: "root_rfiles": 0, 2024-02-21T23:12:58.273 INFO:teuthology.orchestra.run.smithi181.stdout: "root_rbytes": 0, 2024-02-21T23:12:58.273 INFO:teuthology.orchestra.run.smithi181.stdout: "root_rsnaps": 0, 2024-02-21T23:12:58.274 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_backtrace_fetch": 0, 2024-02-21T23:12:58.274 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_set_tag": 0, 2024-02-21T23:12:58.274 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_backtrace_repaired": 0, 2024-02-21T23:12:58.274 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_inotable_repaired": 0, 2024-02-21T23:12:58.274 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_dir_inodes": 0, 2024-02-21T23:12:58.274 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_dir_base_inodes": 0, 2024-02-21T23:12:58.274 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_dirfrag_rstats": 0, 2024-02-21T23:12:58.275 INFO:teuthology.orchestra.run.smithi181.stdout: "scrub_file_inodes": 0, 2024-02-21T23:12:58.275 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_inode_file_caps": 0, 2024-02-21T23:12:58.275 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_revoke": 0, 2024-02-21T23:12:58.275 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_grant": 0, 2024-02-21T23:12:58.275 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_trunc": 0, 2024-02-21T23:12:58.275 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-02-21T23:12:58.275 INFO:teuthology.orchestra.run.smithi181.stdout: "ceph_cap_op_flush_ack": 0, 2024-02-21T23:12:58.275 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_caps": 0, 2024-02-21T23:12:58.275 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_caps_dirty": 0, 2024-02-21T23:12:58.276 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_cap_release": 0, 2024-02-21T23:12:58.276 INFO:teuthology.orchestra.run.smithi181.stdout: "process_request_cap_release": 0 2024-02-21T23:12:58.276 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.276 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_cache": { 2024-02-21T23:12:58.276 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_update": 0, 2024-02-21T23:12:58.276 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_update_receipt": 0, 2024-02-21T23:12:58.276 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_try_discover": 0, 2024-02-21T23:12:58.277 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_send_discover": 0, 2024-02-21T23:12:58.277 INFO:teuthology.orchestra.run.smithi181.stdout: "dir_handle_discover": 0, 2024-02-21T23:12:58.277 INFO:teuthology.orchestra.run.smithi181.stdout: "num_strays": 0, 2024-02-21T23:12:58.277 INFO:teuthology.orchestra.run.smithi181.stdout: "num_strays_delayed": 0, 2024-02-21T23:12:58.277 INFO:teuthology.orchestra.run.smithi181.stdout: "num_strays_enqueuing": 0, 2024-02-21T23:12:58.277 INFO:teuthology.orchestra.run.smithi181.stdout: "strays_created": 0, 2024-02-21T23:12:58.277 INFO:teuthology.orchestra.run.smithi181.stdout: "strays_enqueued": 0, 2024-02-21T23:12:58.277 INFO:teuthology.orchestra.run.smithi181.stdout: "strays_reintegrated": 0, 2024-02-21T23:12:58.278 INFO:teuthology.orchestra.run.smithi181.stdout: "strays_migrated": 0, 2024-02-21T23:12:58.278 INFO:teuthology.orchestra.run.smithi181.stdout: "num_recovering_processing": 0, 2024-02-21T23:12:58.278 INFO:teuthology.orchestra.run.smithi181.stdout: "num_recovering_enqueued": 0, 2024-02-21T23:12:58.278 INFO:teuthology.orchestra.run.smithi181.stdout: "num_recovering_prioritized": 0, 2024-02-21T23:12:58.278 INFO:teuthology.orchestra.run.smithi181.stdout: "recovery_started": 0, 2024-02-21T23:12:58.278 INFO:teuthology.orchestra.run.smithi181.stdout: "recovery_completed": 0, 2024-02-21T23:12:58.278 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_enqueue_scrub": 0, 2024-02-21T23:12:58.278 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_exportdir": 0, 2024-02-21T23:12:58.279 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_flush": 0, 2024-02-21T23:12:58.279 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_fragmentdir": 0, 2024-02-21T23:12:58.279 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_fragstats": 0, 2024-02-21T23:12:58.279 INFO:teuthology.orchestra.run.smithi181.stdout: "ireq_inodestats": 0 2024-02-21T23:12:58.279 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.279 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_log": { 2024-02-21T23:12:58.279 INFO:teuthology.orchestra.run.smithi181.stdout: "evlrg": 0, 2024-02-21T23:12:58.279 INFO:teuthology.orchestra.run.smithi181.stdout: "evadd": 0, 2024-02-21T23:12:58.280 INFO:teuthology.orchestra.run.smithi181.stdout: "evex": 0, 2024-02-21T23:12:58.280 INFO:teuthology.orchestra.run.smithi181.stdout: "evtrm": 0, 2024-02-21T23:12:58.280 INFO:teuthology.orchestra.run.smithi181.stdout: "ev": 4, 2024-02-21T23:12:58.280 INFO:teuthology.orchestra.run.smithi181.stdout: "evexg": 0, 2024-02-21T23:12:58.280 INFO:teuthology.orchestra.run.smithi181.stdout: "evexd": 0, 2024-02-21T23:12:58.280 INFO:teuthology.orchestra.run.smithi181.stdout: "segadd": 0, 2024-02-21T23:12:58.280 INFO:teuthology.orchestra.run.smithi181.stdout: "segex": 0, 2024-02-21T23:12:58.280 INFO:teuthology.orchestra.run.smithi181.stdout: "segtrm": 0, 2024-02-21T23:12:58.281 INFO:teuthology.orchestra.run.smithi181.stdout: "seg": 2, 2024-02-21T23:12:58.281 INFO:teuthology.orchestra.run.smithi181.stdout: "segmjr": 2, 2024-02-21T23:12:58.281 INFO:teuthology.orchestra.run.smithi181.stdout: "segexg": 0, 2024-02-21T23:12:58.281 INFO:teuthology.orchestra.run.smithi181.stdout: "segexd": 0, 2024-02-21T23:12:58.281 INFO:teuthology.orchestra.run.smithi181.stdout: "expos": 4194304, 2024-02-21T23:12:58.281 INFO:teuthology.orchestra.run.smithi181.stdout: "wrpos": 4195428, 2024-02-21T23:12:58.281 INFO:teuthology.orchestra.run.smithi181.stdout: "rdpos": 4195287, 2024-02-21T23:12:58.281 INFO:teuthology.orchestra.run.smithi181.stdout: "jlat": { 2024-02-21T23:12:58.282 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:58.282 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:58.282 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:58.282 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.282 INFO:teuthology.orchestra.run.smithi181.stdout: "replayed": 4 2024-02-21T23:12:58.282 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.282 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_mem": { 2024-02-21T23:12:58.282 INFO:teuthology.orchestra.run.smithi181.stdout: "ino": 3, 2024-02-21T23:12:58.283 INFO:teuthology.orchestra.run.smithi181.stdout: "ino+": 3, 2024-02-21T23:12:58.283 INFO:teuthology.orchestra.run.smithi181.stdout: "ino-": 0, 2024-02-21T23:12:58.283 INFO:teuthology.orchestra.run.smithi181.stdout: "dir": 1, 2024-02-21T23:12:58.283 INFO:teuthology.orchestra.run.smithi181.stdout: "dir+": 1, 2024-02-21T23:12:58.283 INFO:teuthology.orchestra.run.smithi181.stdout: "dir-": 0, 2024-02-21T23:12:58.283 INFO:teuthology.orchestra.run.smithi181.stdout: "dn": 0, 2024-02-21T23:12:58.283 INFO:teuthology.orchestra.run.smithi181.stdout: "dn+": 0, 2024-02-21T23:12:58.283 INFO:teuthology.orchestra.run.smithi181.stdout: "dn-": 0, 2024-02-21T23:12:58.284 INFO:teuthology.orchestra.run.smithi181.stdout: "cap": 0, 2024-02-21T23:12:58.284 INFO:teuthology.orchestra.run.smithi181.stdout: "cap+": 0, 2024-02-21T23:12:58.284 INFO:teuthology.orchestra.run.smithi181.stdout: "cap-": 0, 2024-02-21T23:12:58.284 INFO:teuthology.orchestra.run.smithi181.stdout: "rss": 48904, 2024-02-21T23:12:58.284 INFO:teuthology.orchestra.run.smithi181.stdout: "heap": 215396 2024-02-21T23:12:58.284 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.284 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_server": { 2024-02-21T23:12:58.285 INFO:teuthology.orchestra.run.smithi181.stdout: "dispatch_client_request": 0, 2024-02-21T23:12:58.285 INFO:teuthology.orchestra.run.smithi181.stdout: "dispatch_server_request": 0, 2024-02-21T23:12:58.285 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_request": 0, 2024-02-21T23:12:58.285 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_client_session": 0, 2024-02-21T23:12:58.285 INFO:teuthology.orchestra.run.smithi181.stdout: "handle_peer_request": 0, 2024-02-21T23:12:58.285 INFO:teuthology.orchestra.run.smithi181.stdout: "req_create_latency": { 2024-02-21T23:12:58.285 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:58.285 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:58.286 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:58.286 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.286 INFO:teuthology.orchestra.run.smithi181.stdout: "req_getattr_latency": { 2024-02-21T23:12:58.286 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:58.286 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:58.286 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:58.286 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.286 INFO:teuthology.orchestra.run.smithi181.stdout: "req_getfilelock_latency": { 2024-02-21T23:12:58.286 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:58.287 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:58.287 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:58.287 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.287 INFO:teuthology.orchestra.run.smithi181.stdout: "req_link_latency": { 2024-02-21T23:12:58.287 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:58.287 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:58.287 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:58.288 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.288 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookup_latency": { 2024-02-21T23:12:58.288 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:58.288 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:58.288 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:58.288 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.289 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookuphash_latency": { 2024-02-21T23:12:58.289 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:58.289 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:58.289 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:58.289 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.289 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookupino_latency": { 2024-02-21T23:12:58.291 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:58.291 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:58.291 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:58.292 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.292 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookupname_latency": { 2024-02-21T23:12:58.292 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:58.292 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:58.292 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:58.292 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.293 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookupparent_latency": { 2024-02-21T23:12:58.293 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:58.293 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:58.293 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:58.293 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.293 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lookupsnap_latency": { 2024-02-21T23:12:58.293 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:58.294 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:58.294 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:58.294 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.294 INFO:teuthology.orchestra.run.smithi181.stdout: "req_lssnap_latency": { 2024-02-21T23:12:58.294 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:58.294 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:58.294 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:58.294 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.295 INFO:teuthology.orchestra.run.smithi181.stdout: "req_mkdir_latency": { 2024-02-21T23:12:58.295 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:58.295 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:58.295 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:58.295 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.296 INFO:teuthology.orchestra.run.smithi181.stdout: "req_mknod_latency": { 2024-02-21T23:12:58.296 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:58.296 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:58.296 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:58.296 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.296 INFO:teuthology.orchestra.run.smithi181.stdout: "req_mksnap_latency": { 2024-02-21T23:12:58.296 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:58.297 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:58.297 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:58.297 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.297 INFO:teuthology.orchestra.run.smithi181.stdout: "req_open_latency": { 2024-02-21T23:12:58.297 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:58.297 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:58.297 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:58.297 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.298 INFO:teuthology.orchestra.run.smithi181.stdout: "req_readdir_latency": { 2024-02-21T23:12:58.298 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:58.298 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:58.298 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:58.298 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.298 INFO:teuthology.orchestra.run.smithi181.stdout: "req_rename_latency": { 2024-02-21T23:12:58.298 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:58.298 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:58.299 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:58.299 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.299 INFO:teuthology.orchestra.run.smithi181.stdout: "req_renamesnap_latency": { 2024-02-21T23:12:58.299 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:58.299 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:58.300 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:58.300 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.300 INFO:teuthology.orchestra.run.smithi181.stdout: "req_snapdiff_latency": { 2024-02-21T23:12:58.300 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:58.301 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:58.301 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:58.301 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.301 INFO:teuthology.orchestra.run.smithi181.stdout: "req_rmdir_latency": { 2024-02-21T23:12:58.301 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:58.301 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:58.301 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:58.301 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.302 INFO:teuthology.orchestra.run.smithi181.stdout: "req_rmsnap_latency": { 2024-02-21T23:12:58.302 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:58.302 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:58.302 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:58.302 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.302 INFO:teuthology.orchestra.run.smithi181.stdout: "req_rmxattr_latency": { 2024-02-21T23:12:58.302 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:58.302 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:58.303 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:58.303 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.303 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setattr_latency": { 2024-02-21T23:12:58.303 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:58.303 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:58.303 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:58.303 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.303 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setdirlayout_latency": { 2024-02-21T23:12:58.304 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:58.304 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:58.304 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:58.304 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.304 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setfilelock_latency": { 2024-02-21T23:12:58.304 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:58.304 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:58.304 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:58.305 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.305 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setlayout_latency": { 2024-02-21T23:12:58.305 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:58.305 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:58.305 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:58.305 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.305 INFO:teuthology.orchestra.run.smithi181.stdout: "req_setxattr_latency": { 2024-02-21T23:12:58.305 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:58.306 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:58.306 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:58.306 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.306 INFO:teuthology.orchestra.run.smithi181.stdout: "req_symlink_latency": { 2024-02-21T23:12:58.306 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:58.306 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:58.306 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:58.306 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.307 INFO:teuthology.orchestra.run.smithi181.stdout: "req_unlink_latency": { 2024-02-21T23:12:58.307 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:58.307 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:58.307 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:58.307 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.307 INFO:teuthology.orchestra.run.smithi181.stdout: "cap_revoke_eviction": 0, 2024-02-21T23:12:58.307 INFO:teuthology.orchestra.run.smithi181.stdout: "cap_acquisition_throttle": 0, 2024-02-21T23:12:58.307 INFO:teuthology.orchestra.run.smithi181.stdout: "req_getvxattr_latency": { 2024-02-21T23:12:58.308 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:58.308 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:58.308 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:58.308 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-02-21T23:12:58.308 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.308 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_sessions": { 2024-02-21T23:12:58.308 INFO:teuthology.orchestra.run.smithi181.stdout: "session_count": 0, 2024-02-21T23:12:58.308 INFO:teuthology.orchestra.run.smithi181.stdout: "session_add": 1, 2024-02-21T23:12:58.309 INFO:teuthology.orchestra.run.smithi181.stdout: "session_remove": 1, 2024-02-21T23:12:58.309 INFO:teuthology.orchestra.run.smithi181.stdout: "sessions_open": 1, 2024-02-21T23:12:58.309 INFO:teuthology.orchestra.run.smithi181.stdout: "sessions_stale": 0, 2024-02-21T23:12:58.309 INFO:teuthology.orchestra.run.smithi181.stdout: "total_load": 0, 2024-02-21T23:12:58.309 INFO:teuthology.orchestra.run.smithi181.stdout: "average_load": 0, 2024-02-21T23:12:58.309 INFO:teuthology.orchestra.run.smithi181.stdout: "avg_session_uptime": 1455, 2024-02-21T23:12:58.309 INFO:teuthology.orchestra.run.smithi181.stdout: "mdthresh_evicted": 0 2024-02-21T23:12:58.309 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.310 INFO:teuthology.orchestra.run.smithi181.stdout: "mempool": { 2024-02-21T23:12:58.310 INFO:teuthology.orchestra.run.smithi181.stdout: "bloom_filter_bytes": 0, 2024-02-21T23:12:58.310 INFO:teuthology.orchestra.run.smithi181.stdout: "bloom_filter_items": 0, 2024-02-21T23:12:58.310 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_alloc_bytes": 0, 2024-02-21T23:12:58.310 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_alloc_items": 0, 2024-02-21T23:12:58.310 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_data_bytes": 0, 2024-02-21T23:12:58.310 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_data_items": 0, 2024-02-21T23:12:58.310 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_onode_bytes": 0, 2024-02-21T23:12:58.311 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_onode_items": 0, 2024-02-21T23:12:58.311 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_meta_bytes": 0, 2024-02-21T23:12:58.311 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_meta_items": 0, 2024-02-21T23:12:58.311 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_other_bytes": 0, 2024-02-21T23:12:58.311 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_other_items": 0, 2024-02-21T23:12:58.311 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_buffer_bytes": 0, 2024-02-21T23:12:58.311 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_cache_buffer_items": 0, 2024-02-21T23:12:58.311 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_extent_bytes": 0, 2024-02-21T23:12:58.312 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_extent_items": 0, 2024-02-21T23:12:58.312 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_blob_bytes": 0, 2024-02-21T23:12:58.312 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_blob_items": 0, 2024-02-21T23:12:58.312 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_shared_blob_bytes": 0, 2024-02-21T23:12:58.312 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_shared_blob_items": 0, 2024-02-21T23:12:58.312 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_inline_bl_bytes": 0, 2024-02-21T23:12:58.312 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_inline_bl_items": 0, 2024-02-21T23:12:58.313 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_fsck_bytes": 0, 2024-02-21T23:12:58.313 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_fsck_items": 0, 2024-02-21T23:12:58.313 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_txc_bytes": 0, 2024-02-21T23:12:58.313 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_txc_items": 0, 2024-02-21T23:12:58.313 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_deferred_bytes": 0, 2024-02-21T23:12:58.313 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_deferred_items": 0, 2024-02-21T23:12:58.313 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_bytes": 0, 2024-02-21T23:12:58.313 INFO:teuthology.orchestra.run.smithi181.stdout: "bluestore_writing_items": 0, 2024-02-21T23:12:58.314 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_bytes": 0, 2024-02-21T23:12:58.314 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_items": 0, 2024-02-21T23:12:58.314 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_reader_bytes": 0, 2024-02-21T23:12:58.314 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_reader_items": 0, 2024-02-21T23:12:58.314 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_writer_bytes": 0, 2024-02-21T23:12:58.314 INFO:teuthology.orchestra.run.smithi181.stdout: "bluefs_file_writer_items": 0, 2024-02-21T23:12:58.314 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_anon_bytes": 189393, 2024-02-21T23:12:58.314 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_anon_items": 51, 2024-02-21T23:12:58.315 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_meta_bytes": 0, 2024-02-21T23:12:58.315 INFO:teuthology.orchestra.run.smithi181.stdout: "buffer_meta_items": 0, 2024-02-21T23:12:58.315 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_bytes": 0, 2024-02-21T23:12:58.315 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_items": 0, 2024-02-21T23:12:58.315 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_mapbl_bytes": 0, 2024-02-21T23:12:58.315 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_mapbl_items": 0, 2024-02-21T23:12:58.315 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_pglog_bytes": 0, 2024-02-21T23:12:58.315 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_pglog_items": 0, 2024-02-21T23:12:58.316 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_bytes": 8136, 2024-02-21T23:12:58.316 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_items": 153, 2024-02-21T23:12:58.316 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_mapping_bytes": 0, 2024-02-21T23:12:58.316 INFO:teuthology.orchestra.run.smithi181.stdout: "osdmap_mapping_items": 0, 2024-02-21T23:12:58.316 INFO:teuthology.orchestra.run.smithi181.stdout: "pgmap_bytes": 0, 2024-02-21T23:12:58.316 INFO:teuthology.orchestra.run.smithi181.stdout: "pgmap_items": 0, 2024-02-21T23:12:58.316 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_co_bytes": 8320, 2024-02-21T23:12:58.316 INFO:teuthology.orchestra.run.smithi181.stdout: "mds_co_items": 13, 2024-02-21T23:12:58.317 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_1_bytes": 0, 2024-02-21T23:12:58.317 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_1_items": 0, 2024-02-21T23:12:58.317 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_2_bytes": 0, 2024-02-21T23:12:58.317 INFO:teuthology.orchestra.run.smithi181.stdout: "unittest_2_items": 0 2024-02-21T23:12:58.317 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.317 INFO:teuthology.orchestra.run.smithi181.stdout: "objecter": { 2024-02-21T23:12:58.317 INFO:teuthology.orchestra.run.smithi181.stdout: "op_active": 0, 2024-02-21T23:12:58.317 INFO:teuthology.orchestra.run.smithi181.stdout: "op_laggy": 0, 2024-02-21T23:12:58.318 INFO:teuthology.orchestra.run.smithi181.stdout: "op_send": 2019, 2024-02-21T23:12:58.318 INFO:teuthology.orchestra.run.smithi181.stdout: "op_send_bytes": 21, 2024-02-21T23:12:58.318 INFO:teuthology.orchestra.run.smithi181.stdout: "op_resend": 3, 2024-02-21T23:12:58.318 INFO:teuthology.orchestra.run.smithi181.stdout: "op_reply": 2019, 2024-02-21T23:12:58.318 INFO:teuthology.orchestra.run.smithi181.stdout: "op_latency": { 2024-02-21T23:12:58.318 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 2019, 2024-02-21T23:12:58.318 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 1.421972968, 2024-02-21T23:12:58.318 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000704295 2024-02-21T23:12:58.319 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.319 INFO:teuthology.orchestra.run.smithi181.stdout: "op_inflight": 0, 2024-02-21T23:12:58.319 INFO:teuthology.orchestra.run.smithi181.stdout: "oplen_avg": { 2024-02-21T23:12:58.319 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 2019, 2024-02-21T23:12:58.319 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 2020 2024-02-21T23:12:58.319 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.319 INFO:teuthology.orchestra.run.smithi181.stdout: "op": 2019, 2024-02-21T23:12:58.319 INFO:teuthology.orchestra.run.smithi181.stdout: "op_r": 2019, 2024-02-21T23:12:58.320 INFO:teuthology.orchestra.run.smithi181.stdout: "op_w": 0, 2024-02-21T23:12:58.320 INFO:teuthology.orchestra.run.smithi181.stdout: "op_rmw": 0, 2024-02-21T23:12:58.320 INFO:teuthology.orchestra.run.smithi181.stdout: "op_pg": 0, 2024-02-21T23:12:58.320 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_stat": 1327, 2024-02-21T23:12:58.320 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_create": 0, 2024-02-21T23:12:58.320 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_read": 690, 2024-02-21T23:12:58.320 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_write": 0, 2024-02-21T23:12:58.320 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_writefull": 0, 2024-02-21T23:12:58.321 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_writesame": 0, 2024-02-21T23:12:58.321 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_append": 0, 2024-02-21T23:12:58.321 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_zero": 0, 2024-02-21T23:12:58.321 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_truncate": 0, 2024-02-21T23:12:58.321 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_delete": 0, 2024-02-21T23:12:58.321 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_mapext": 0, 2024-02-21T23:12:58.321 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_sparse_read": 0, 2024-02-21T23:12:58.321 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_clonerange": 0, 2024-02-21T23:12:58.322 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_getxattr": 1, 2024-02-21T23:12:58.322 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_setxattr": 0, 2024-02-21T23:12:58.322 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_cmpxattr": 0, 2024-02-21T23:12:58.322 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_rmxattr": 0, 2024-02-21T23:12:58.322 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_resetxattrs": 0, 2024-02-21T23:12:58.322 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_call": 0, 2024-02-21T23:12:58.322 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_watch": 0, 2024-02-21T23:12:58.323 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_notify": 0, 2024-02-21T23:12:58.323 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_src_cmpxattr": 0, 2024-02-21T23:12:58.323 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_pgls": 0, 2024-02-21T23:12:58.323 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_pgls_filter": 0, 2024-02-21T23:12:58.323 INFO:teuthology.orchestra.run.smithi181.stdout: "osdop_other": 0, 2024-02-21T23:12:58.323 INFO:teuthology.orchestra.run.smithi181.stdout: "linger_active": 0, 2024-02-21T23:12:58.323 INFO:teuthology.orchestra.run.smithi181.stdout: "linger_send": 0, 2024-02-21T23:12:58.323 INFO:teuthology.orchestra.run.smithi181.stdout: "linger_resend": 0, 2024-02-21T23:12:58.324 INFO:teuthology.orchestra.run.smithi181.stdout: "linger_ping": 0, 2024-02-21T23:12:58.324 INFO:teuthology.orchestra.run.smithi181.stdout: "poolop_active": 0, 2024-02-21T23:12:58.324 INFO:teuthology.orchestra.run.smithi181.stdout: "poolop_send": 0, 2024-02-21T23:12:58.324 INFO:teuthology.orchestra.run.smithi181.stdout: "poolop_resend": 0, 2024-02-21T23:12:58.324 INFO:teuthology.orchestra.run.smithi181.stdout: "poolstat_active": 0, 2024-02-21T23:12:58.324 INFO:teuthology.orchestra.run.smithi181.stdout: "poolstat_send": 0, 2024-02-21T23:12:58.324 INFO:teuthology.orchestra.run.smithi181.stdout: "poolstat_resend": 0, 2024-02-21T23:12:58.324 INFO:teuthology.orchestra.run.smithi181.stdout: "statfs_active": 0, 2024-02-21T23:12:58.325 INFO:teuthology.orchestra.run.smithi181.stdout: "statfs_send": 0, 2024-02-21T23:12:58.325 INFO:teuthology.orchestra.run.smithi181.stdout: "statfs_resend": 0, 2024-02-21T23:12:58.325 INFO:teuthology.orchestra.run.smithi181.stdout: "command_active": 0, 2024-02-21T23:12:58.325 INFO:teuthology.orchestra.run.smithi181.stdout: "command_send": 0, 2024-02-21T23:12:58.325 INFO:teuthology.orchestra.run.smithi181.stdout: "command_resend": 0, 2024-02-21T23:12:58.325 INFO:teuthology.orchestra.run.smithi181.stdout: "map_epoch": 40, 2024-02-21T23:12:58.325 INFO:teuthology.orchestra.run.smithi181.stdout: "map_full": 0, 2024-02-21T23:12:58.325 INFO:teuthology.orchestra.run.smithi181.stdout: "map_inc": 11, 2024-02-21T23:12:58.326 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_sessions": 5, 2024-02-21T23:12:58.326 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_session_open": 5, 2024-02-21T23:12:58.326 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_session_close": 0, 2024-02-21T23:12:58.326 INFO:teuthology.orchestra.run.smithi181.stdout: "osd_laggy": 0, 2024-02-21T23:12:58.326 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_wr": 0, 2024-02-21T23:12:58.326 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_rd": 2, 2024-02-21T23:12:58.326 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_del": 0 2024-02-21T23:12:58.326 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.327 INFO:teuthology.orchestra.run.smithi181.stdout: "oft": { 2024-02-21T23:12:58.327 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_total_objs": 0, 2024-02-21T23:12:58.327 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_total_kv_pairs": 0, 2024-02-21T23:12:58.327 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_total_updates": 0, 2024-02-21T23:12:58.327 INFO:teuthology.orchestra.run.smithi181.stdout: "omap_total_removes": 0 2024-02-21T23:12:58.327 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.327 INFO:teuthology.orchestra.run.smithi181.stdout: "osd-slow-ops": { 2024-02-21T23:12:58.327 INFO:teuthology.orchestra.run.smithi181.stdout: "slow_ops_count": 0 2024-02-21T23:12:58.328 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.328 INFO:teuthology.orchestra.run.smithi181.stdout: "purge_queue": { 2024-02-21T23:12:58.328 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executing_ops": 0, 2024-02-21T23:12:58.328 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executing_ops_high_water": 0, 2024-02-21T23:12:58.328 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executing": 0, 2024-02-21T23:12:58.328 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executing_high_water": 0, 2024-02-21T23:12:58.328 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executed_ops": 0, 2024-02-21T23:12:58.329 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_executed": 0, 2024-02-21T23:12:58.329 INFO:teuthology.orchestra.run.smithi181.stdout: "pq_item_in_journal": 0 2024-02-21T23:12:58.329 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.329 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-02-21T23:12:58.329 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-02-21T23:12:58.329 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 104857600, 2024-02-21T23:12:58.329 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-02-21T23:12:58.329 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 2244, 2024-02-21T23:12:58.330 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 1928588, 2024-02-21T23:12:58.330 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-02-21T23:12:58.330 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 2244, 2024-02-21T23:12:58.330 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 0, 2024-02-21T23:12:58.330 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 0, 2024-02-21T23:12:58.330 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 2244, 2024-02-21T23:12:58.330 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 1928588, 2024-02-21T23:12:58.331 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-02-21T23:12:58.331 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:58.331 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:58.331 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:58.331 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-02-21T23:12:58.331 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.331 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-objecter_bytes": { 2024-02-21T23:12:58.331 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-02-21T23:12:58.331 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 104857600, 2024-02-21T23:12:58.332 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-02-21T23:12:58.332 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 0, 2024-02-21T23:12:58.332 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 0, 2024-02-21T23:12:58.332 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-02-21T23:12:58.332 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 0, 2024-02-21T23:12:58.332 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 2019, 2024-02-21T23:12:58.332 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 1129, 2024-02-21T23:12:58.333 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 2019, 2024-02-21T23:12:58.333 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 1129, 2024-02-21T23:12:58.333 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-02-21T23:12:58.333 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:58.333 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:58.333 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:58.333 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-02-21T23:12:58.333 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.334 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-objecter_ops": { 2024-02-21T23:12:58.334 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-02-21T23:12:58.334 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 1024, 2024-02-21T23:12:58.334 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-02-21T23:12:58.334 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 0, 2024-02-21T23:12:58.334 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 0, 2024-02-21T23:12:58.334 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-02-21T23:12:58.334 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 0, 2024-02-21T23:12:58.335 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 2019, 2024-02-21T23:12:58.335 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 2019, 2024-02-21T23:12:58.335 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 2019, 2024-02-21T23:12:58.335 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 2019, 2024-02-21T23:12:58.335 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-02-21T23:12:58.335 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:58.335 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:58.335 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:58.336 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-02-21T23:12:58.336 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.336 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-write_buf_throttle": { 2024-02-21T23:12:58.336 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-02-21T23:12:58.336 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 3758096384, 2024-02-21T23:12:58.336 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-02-21T23:12:58.336 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 0, 2024-02-21T23:12:58.336 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 0, 2024-02-21T23:12:58.337 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-02-21T23:12:58.337 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 0, 2024-02-21T23:12:58.337 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 0, 2024-02-21T23:12:58.337 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 0, 2024-02-21T23:12:58.337 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 0, 2024-02-21T23:12:58.337 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 0, 2024-02-21T23:12:58.337 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-02-21T23:12:58.337 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:58.337 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:58.338 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:58.338 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-02-21T23:12:58.338 INFO:teuthology.orchestra.run.smithi181.stdout: }, 2024-02-21T23:12:58.338 INFO:teuthology.orchestra.run.smithi181.stdout: "throttle-write_buf_throttle-0x561fc538a960": { 2024-02-21T23:12:58.338 INFO:teuthology.orchestra.run.smithi181.stdout: "val": 0, 2024-02-21T23:12:58.338 INFO:teuthology.orchestra.run.smithi181.stdout: "max": 3758096384, 2024-02-21T23:12:58.338 INFO:teuthology.orchestra.run.smithi181.stdout: "get_started": 0, 2024-02-21T23:12:58.338 INFO:teuthology.orchestra.run.smithi181.stdout: "get": 0, 2024-02-21T23:12:58.339 INFO:teuthology.orchestra.run.smithi181.stdout: "get_sum": 0, 2024-02-21T23:12:58.339 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_fail": 0, 2024-02-21T23:12:58.339 INFO:teuthology.orchestra.run.smithi181.stdout: "get_or_fail_success": 0, 2024-02-21T23:12:58.339 INFO:teuthology.orchestra.run.smithi181.stdout: "take": 0, 2024-02-21T23:12:58.339 INFO:teuthology.orchestra.run.smithi181.stdout: "take_sum": 0, 2024-02-21T23:12:58.339 INFO:teuthology.orchestra.run.smithi181.stdout: "put": 0, 2024-02-21T23:12:58.339 INFO:teuthology.orchestra.run.smithi181.stdout: "put_sum": 0, 2024-02-21T23:12:58.339 INFO:teuthology.orchestra.run.smithi181.stdout: "wait": { 2024-02-21T23:12:58.340 INFO:teuthology.orchestra.run.smithi181.stdout: "avgcount": 0, 2024-02-21T23:12:58.340 INFO:teuthology.orchestra.run.smithi181.stdout: "sum": 0.000000000, 2024-02-21T23:12:58.340 INFO:teuthology.orchestra.run.smithi181.stdout: "avgtime": 0.000000000 2024-02-21T23:12:58.340 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-02-21T23:12:58.340 INFO:teuthology.orchestra.run.smithi181.stdout: } 2024-02-21T23:12:58.340 INFO:teuthology.orchestra.run.smithi181.stdout:} 2024-02-21T23:12:58.342 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2024-02-21T23:12:58.342 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2024-02-21T23:12:58.342 INFO:tasks.check_counter:Daemon mds.l mds.root_rsnaps=0 2024-02-21T23:12:58.342 INFO:tasks.check_counter:Daemon mds.l mds_server.req_mksnap_latency.avgcount=0 2024-02-21T23:12:58.342 INFO:tasks.check_counter:Daemon mds.l mds_server.req_rmsnap_latency.avgcount=0 2024-02-21T23:12:58.342 INFO:tasks.check_counter:Daemon mds.l mds.dir_split=0 2024-02-21T23:12:58.343 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-02-21T23:12:58.354 INFO:tasks.kclient:Unmounting kernel clients... 2024-02-21T23:12:58.354 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-02-21T23:12:58.354 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-21T23:12:58.401 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-02-21T23:12:58.401 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-21T23:12:58.496 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T23:12:58.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:58.770+0000 7f1e9e600640 1 Processor -- start 2024-02-21T23:12:58.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:58.771+0000 7f1e9e600640 1 -- start start 2024-02-21T23:12:58.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:58.773+0000 7f1e9e600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f1e98189230 0x7f1e9806c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:58.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:58.774+0000 7f1e9e600640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f1e9806cf10 0x7f1e980740b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:58.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:58.774+0000 7f1e9e600640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e9806d3a0 con 0x7f1e98186520 2024-02-21T23:12:58.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:58.774+0000 7f1e9e600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e980723a0 con 0x7f1e98189230 2024-02-21T23:12:58.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:58.774+0000 7f1e9e600640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e98189740 con 0x7f1e9806cf10 2024-02-21T23:12:58.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:58.774+0000 7f1e96a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f1e98189230 0x7f1e9806c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:58.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:58.774+0000 7f1e96a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f1e98189230 0x7f1e9806c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53018/0 (socket says 172.21.15.99:53018) 2024-02-21T23:12:58.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:58.774+0000 7f1e96a00640 1 -- 172.21.15.99:0/1843623534 learned_addr learned my addr 172.21.15.99:0/1843623534 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:12:58.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:58.774+0000 7f1e97e00640 1 --2- 172.21.15.99:0/1843623534 >> v2:172.21.15.162:3300/0 conn(0x7f1e9806cf10 0x7f1e980740b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:58.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:58.774+0000 7f1e96a00640 1 -- 172.21.15.99:0/1843623534 >> v2:172.21.15.162:3300/0 conn(0x7f1e9806cf10 msgr2=0x7f1e980740b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:58.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:58.774+0000 7f1e96a00640 1 --2- 172.21.15.99:0/1843623534 >> v2:172.21.15.162:3300/0 conn(0x7f1e9806cf10 0x7f1e980740b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:58.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:58.775+0000 7f1e96a00640 1 -- 172.21.15.99:0/1843623534 >> v1:172.21.15.99:6789/0 conn(0x7f1e98186520 legacy=0x7f1e98188b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:58.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:58.775+0000 7f1e96a00640 1 -- 172.21.15.99:0/1843623534 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e98189a20 con 0x7f1e98189230 2024-02-21T23:12:58.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:58.775+0000 7f1e96000640 1 -- 172.21.15.99:0/1843623534 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1194946811 0 0) 0x7f1e9806d3a0 con 0x7f1e98186520 2024-02-21T23:12:58.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:58.776+0000 7f1e96a00640 1 --2- 172.21.15.99:0/1843623534 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e98189230 0x7f1e9806c9d0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f1e980eed10 tx=0x7f1e8402b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=957eebd5a960d11a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:58.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:58.776+0000 7f1e96000640 1 -- 172.21.15.99:0/1843623534 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e84035020 con 0x7f1e98189230 2024-02-21T23:12:58.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:58.777+0000 7f1e96000640 1 -- 172.21.15.99:0/1843623534 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e84031800 con 0x7f1e98189230 2024-02-21T23:12:58.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:58.777+0000 7f1e96000640 1 -- 172.21.15.99:0/1843623534 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e84031bd0 con 0x7f1e98189230 2024-02-21T23:12:58.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:58.777+0000 7f1e9e600640 1 -- 172.21.15.99:0/1843623534 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e98189230 msgr2=0x7f1e9806c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:58.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:58.777+0000 7f1e9e600640 1 --2- 172.21.15.99:0/1843623534 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e98189230 0x7f1e9806c9d0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f1e980eed10 tx=0x7f1e8402b8a0 comp rx=0 tx=0).stop 2024-02-21T23:12:58.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:58.777+0000 7f1e9e600640 1 -- 172.21.15.99:0/1843623534 shutdown_connections 2024-02-21T23:12:58.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:58.777+0000 7f1e9e600640 1 --2- 172.21.15.99:0/1843623534 >> v2:172.21.15.162:3300/0 conn(0x7f1e9806cf10 0x7f1e980740b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:58.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:58.777+0000 7f1e9e600640 1 --2- 172.21.15.99:0/1843623534 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e98189230 0x7f1e9806c9d0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:58.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:58.777+0000 7f1e9e600640 1 -- 172.21.15.99:0/1843623534 >> 172.21.15.99:0/1843623534 conn(0x7f1e9806e410 msgr2=0x7f1e9806e820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:58.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:58.778+0000 7f1e9e600640 1 -- 172.21.15.99:0/1843623534 shutdown_connections 2024-02-21T23:12:58.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:58.778+0000 7f1e9e600640 1 -- 172.21.15.99:0/1843623534 wait complete. 2024-02-21T23:12:58.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:58.779+0000 7f1e9e600640 1 Processor -- start 2024-02-21T23:12:58.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:58.780+0000 7f1e9e600640 1 -- start start 2024-02-21T23:12:58.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:58.781+0000 7f1e9e600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e9806cf10 0x7f1e9815e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:58.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:58.781+0000 7f1e9e600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e98186520 0x7f1e98187ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:58.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:58.781+0000 7f1e9e600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1e98189230 0x7f1e98188410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:58.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:58.781+0000 7f1e9e600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e98072030 con 0x7f1e98186520 2024-02-21T23:12:58.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:58.781+0000 7f1e9e600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e98071d50 con 0x7f1e9806cf10 2024-02-21T23:12:58.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:58.781+0000 7f1e9e600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e98072830 con 0x7f1e98189230 2024-02-21T23:12:58.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:58.781+0000 7f1e96a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e98186520 0x7f1e98187ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:58.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:58.781+0000 7f1e97400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e9806cf10 0x7f1e9815e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:58.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:58.781+0000 7f1e96a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e98186520 0x7f1e98187ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53022/0 (socket says 172.21.15.99:53022) 2024-02-21T23:12:58.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:58.781+0000 7f1e96a00640 1 -- 172.21.15.99:0/3952737887 learned_addr learned my addr 172.21.15.99:0/3952737887 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:12:58.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:58.781+0000 7f1e97e00640 1 --2- 172.21.15.99:0/3952737887 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1e98189230 0x7f1e98188410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:58.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:58.782+0000 7f1e97400640 1 -- 172.21.15.99:0/3952737887 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1e98189230 msgr2=0x7f1e98188410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:58.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:58.782+0000 7f1e97400640 1 --2- 172.21.15.99:0/3952737887 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1e98189230 0x7f1e98188410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:58.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:58.782+0000 7f1e97400640 1 -- 172.21.15.99:0/3952737887 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e98186520 msgr2=0x7f1e98187ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:58.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:58.782+0000 7f1e97400640 1 --2- 172.21.15.99:0/3952737887 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e98186520 0x7f1e98187ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:58.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:58.782+0000 7f1e97400640 1 -- 172.21.15.99:0/3952737887 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e980f6cf0 con 0x7f1e9806cf10 2024-02-21T23:12:58.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:58.782+0000 7f1e96a00640 1 --2- 172.21.15.99:0/3952737887 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e98186520 0x7f1e98187ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:12:58.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:58.782+0000 7f1e97400640 1 --2- 172.21.15.99:0/3952737887 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e9806cf10 0x7f1e9815e1a0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f1e8800c410 tx=0x7f1e8800c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:58.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:58.782+0000 7f1e8f400640 1 -- 172.21.15.99:0/3952737887 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e88017070 con 0x7f1e9806cf10 2024-02-21T23:12:58.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:58.782+0000 7f1e8f400640 1 -- 172.21.15.99:0/3952737887 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e880035f0 con 0x7f1e9806cf10 2024-02-21T23:12:58.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:58.782+0000 7f1e9e600640 1 -- 172.21.15.99:0/3952737887 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e980f6fd0 con 0x7f1e9806cf10 2024-02-21T23:12:58.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:58.782+0000 7f1e8f400640 1 -- 172.21.15.99:0/3952737887 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e880039e0 con 0x7f1e9806cf10 2024-02-21T23:12:58.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:58.783+0000 7f1e9e600640 1 -- 172.21.15.99:0/3952737887 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e980f7590 con 0x7f1e9806cf10 2024-02-21T23:12:58.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:58.784+0000 7f1e9e600640 1 -- 172.21.15.99:0/3952737887 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e980cd2d0 con 0x7f1e9806cf10 2024-02-21T23:12:58.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:58.786+0000 7f1e8f400640 1 -- 172.21.15.99:0/3952737887 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f1e8801a070 con 0x7f1e9806cf10 2024-02-21T23:12:58.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:58.788+0000 7f1e8f400640 1 --2- 172.21.15.99:0/3952737887 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f1e7809eed0 0x7f1e780a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:58.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:58.788+0000 7f1e96a00640 1 --2- 172.21.15.99:0/3952737887 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f1e7809eed0 0x7f1e780a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:58.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:58.788+0000 7f1e8f400640 1 -- 172.21.15.99:0/3952737887 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f1e880c91f0 con 0x7f1e9806cf10 2024-02-21T23:12:58.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:58.789+0000 7f1e96a00640 1 --2- 172.21.15.99:0/3952737887 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f1e7809eed0 0x7f1e780a1390 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1e98179f50 tx=0x7f1e8403c040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:58.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:58.791+0000 7f1e8f400640 1 -- 172.21.15.99:0/3952737887 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f1e88096af0 con 0x7f1e9806cf10 2024-02-21T23:12:59.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.015+0000 7f1e9e600640 1 -- 172.21.15.99:0/3952737887 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1e9818d040 con 0x7f1e9806cf10 2024-02-21T23:12:59.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.016+0000 7f1e8f400640 1 -- 172.21.15.99:0/3952737887 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+24383 (secure 0 0 0) 0x7f1e8809ab90 con 0x7f1e9806cf10 2024-02-21T23:12:59.005 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T23:12:59.005 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":40,"fsid":"e8af98cd-45a1-425f-96a7-f24da8ee4efb","created":"2024-02-21T23:00:44.699708+0000","modified":"2024-02-21T23:12:14.816230+0000","last_up_change":"2024-02-21T23:00:55.749829+0000","last_in_change":"2024-02-21T23:00:48.332297+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T23:00:57.020557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":11.760000228881836,"score_stable":11.760000228881836,"optimal_score":0.17000000178813934,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-21T23:01:01.124398+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-21T23:01:01.684258+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":39,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-21T23:01:05.290089+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":39,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c49de9b2-dc53-4882-b14c-7059ed40bf59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6809","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6811","nonce":1026112937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6813","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6815","nonce":1026112937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6823","nonce":1026112937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6819","nonce":1026112937}]},"public_addr":"172.21.15.99:6811/1026112937","cluster_addr":"172.21.15.99:6815/1026112937","heartbeat_back_addr":"172.21.15.99:6823/1026112937","heartbeat_front_addr":"172.21.15.99:6819/1026112937","state":["exists","up"]},{"osd":1,"uuid":"58398292-2fe5-4291-94fd-03a0ca29d49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6827","nonce":3030871566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6829","nonce":3030871566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6833","nonce":3030871566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6831","nonce":3030871566}]},"public_addr":"172.21.15.162:6827/3030871566","cluster_addr":"172.21.15.162:6829/3030871566","heartbeat_back_addr":"172.21.15.162:6833/3030871566","heartbeat_front_addr":"172.21.15.162:6831/3030871566","state":["exists","up"]},{"osd":2,"uuid":"94cddec1-e08f-438d-a7c8-48a0e47d71a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6818","nonce":2782386148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6821","nonce":2782386148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6827","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6829","nonce":2782386148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6823","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6825","nonce":2782386148}]},"public_addr":"172.21.15.181:6818/2782386148","cluster_addr":"172.21.15.181:6821/2782386148","heartbeat_back_addr":"172.21.15.181:6829/2782386148","heartbeat_front_addr":"172.21.15.181:6825/2782386148","state":["exists","up"]},{"osd":3,"uuid":"d29abb74-9b89-4fd7-88b1-7c2eb8231189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6801","nonce":2316185310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6803","nonce":2316185310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6807","nonce":2316185310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6805","nonce":2316185310}]},"public_addr":"172.21.15.99:6801/2316185310","cluster_addr":"172.21.15.99:6803/2316185310","heartbeat_back_addr":"172.21.15.99:6807/2316185310","heartbeat_front_addr":"172.21.15.99:6805/2316185310","state":["exists","up"]},{"osd":4,"uuid":"0d8c9ea3-880a-4d69-9dcb-cf7d35abd449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6811","nonce":3137681258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6813","nonce":3137681258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6817","nonce":3137681258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6815","nonce":3137681258}]},"public_addr":"172.21.15.162:6811/3137681258","cluster_addr":"172.21.15.162:6813/3137681258","heartbeat_back_addr":"172.21.15.162:6817/3137681258","heartbeat_front_addr":"172.21.15.162:6815/3137681258","state":["exists","up"]},{"osd":5,"uuid":"2e3a9340-6fd0-4d7a-8e00-fe305649296e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6801","nonce":2011264527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6803","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6805","nonce":2011264527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6811","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6813","nonce":2011264527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6807","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6809","nonce":2011264527}]},"public_addr":"172.21.15.181:6801/2011264527","cluster_addr":"172.21.15.181:6805/2011264527","heartbeat_back_addr":"172.21.15.181:6813/2011264527","heartbeat_front_addr":"172.21.15.181:6809/2011264527","state":["exists","up"]},{"osd":6,"uuid":"d9e37ce7-1b0e-4019-8f2e-b670403abf7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6810","nonce":753870050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6814","nonce":753870050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6822","nonce":753870050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6818","nonce":753870050}]},"public_addr":"172.21.15.99:6810/753870050","cluster_addr":"172.21.15.99:6814/753870050","heartbeat_back_addr":"172.21.15.99:6822/753870050","heartbeat_front_addr":"172.21.15.99:6818/753870050","state":["exists","up"]},{"osd":7,"uuid":"49988754-232e-4b8c-bd72-bfa25b418e5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6803","nonce":1659412949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6805","nonce":1659412949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6809","nonce":1659412949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6807","nonce":1659412949}]},"public_addr":"172.21.15.162:6803/1659412949","cluster_addr":"172.21.15.162:6805/1659412949","heartbeat_back_addr":"172.21.15.162:6809/1659412949","heartbeat_front_addr":"172.21.15.162:6807/1659412949","state":["exists","up"]},{"osd":8,"uuid":"ebc6e462-8368-4d64-b242-9c8735ac672c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6804","nonce":3389807042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6808","nonce":3389807042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6815","nonce":3389807042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6812","nonce":3389807042}]},"public_addr":"172.21.15.181:6804/3389807042","cluster_addr":"172.21.15.181:6808/3389807042","heartbeat_back_addr":"172.21.15.181:6815/3389807042","heartbeat_front_addr":"172.21.15.181:6812/3389807042","state":["exists","up"]},{"osd":9,"uuid":"72af1b02-b965-4d6a-8964-527ec24c4daa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6825","nonce":4055669590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6827","nonce":4055669590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6831","nonce":4055669590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6829","nonce":4055669590}]},"public_addr":"172.21.15.99:6825/4055669590","cluster_addr":"172.21.15.99:6827/4055669590","heartbeat_back_addr":"172.21.15.99:6831/4055669590","heartbeat_front_addr":"172.21.15.99:6829/4055669590","state":["exists","up"]},{"osd":10,"uuid":"adb5cb06-6453-41e4-b847-d7c78bbb7d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6819","nonce":1421879617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6821","nonce":1421879617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6825","nonce":1421879617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6823","nonce":1421879617}]},"public_addr":"172.21.15.162:6819/1421879617","cluster_addr":"172.21.15.162:6821/1421879617","heartbeat_back_addr":"172.21.15.162:6825/1421879617","heartbeat_front_addr":"172.21.15.162:6823/1421879617","state":["exists","up"]},{"osd":11,"uuid":"118563d9-1e8f-4dc7-a92c-2f4c4dc3e20f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6817","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6819","nonce":3219928272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6824","nonce":3219928272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6831","nonce":3219928272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6828","nonce":3219928272}]},"public_addr":"172.21.15.181:6819/3219928272","cluster_addr":"172.21.15.181:6824/3219928272","heartbeat_back_addr":"172.21.15.181:6831/3219928272","heartbeat_front_addr":"172.21.15.181:6828/3219928272","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.651219+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.549859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.529659+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.591004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.440836+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.414250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.630130+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.411954+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.439371+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.428173+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.511203+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.482806+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.6","mappings":[{"from":9,"to":11}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.14","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.162:0/612025202":"2024-02-22T23:02:14.008014+0000","172.21.15.162:0/1516346096":"2024-02-22T23:02:14.008014+0000","172.21.15.162:0/328516024":"2024-02-22T23:02:14.008014+0000","172.21.15.162:0/3695581546":"2024-02-22T23:02:14.008014+0000","172.21.15.162:6801/1717094936":"2024-02-22T23:02:14.008014+0000","172.21.15.162:0/506228072":"2024-02-22T23:02:14.008014+0000","172.21.15.162:6800/1717094936":"2024-02-22T23:02:14.008014+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]},{"pool":4,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T23:12:59.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.020+0000 7f1e9e600640 1 -- 172.21.15.99:0/3952737887 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f1e7809eed0 msgr2=0x7f1e780a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:59.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.020+0000 7f1e9e600640 1 --2- 172.21.15.99:0/3952737887 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f1e7809eed0 0x7f1e780a1390 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1e98179f50 tx=0x7f1e8403c040 comp rx=0 tx=0).stop 2024-02-21T23:12:59.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.020+0000 7f1e9e600640 1 -- 172.21.15.99:0/3952737887 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e9806cf10 msgr2=0x7f1e9815e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:59.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.020+0000 7f1e9e600640 1 --2- 172.21.15.99:0/3952737887 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e9806cf10 0x7f1e9815e1a0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f1e8800c410 tx=0x7f1e8800c8d0 comp rx=0 tx=0).stop 2024-02-21T23:12:59.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.020+0000 7f1e9e600640 1 -- 172.21.15.99:0/3952737887 shutdown_connections 2024-02-21T23:12:59.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.020+0000 7f1e9e600640 1 --2- 172.21.15.99:0/3952737887 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f1e7809eed0 0x7f1e780a1390 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:59.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.020+0000 7f1e9e600640 1 --2- 172.21.15.99:0/3952737887 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1e98189230 0x7f1e98188410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:59.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.020+0000 7f1e9e600640 1 --2- 172.21.15.99:0/3952737887 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e98186520 0x7f1e98187ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:59.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.020+0000 7f1e9e600640 1 --2- 172.21.15.99:0/3952737887 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e9806cf10 0x7f1e9815e1a0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:59.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.020+0000 7f1e9e600640 1 -- 172.21.15.99:0/3952737887 >> 172.21.15.99:0/3952737887 conn(0x7f1e9806e410 msgr2=0x7f1e981821c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:59.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.020+0000 7f1e9e600640 1 -- 172.21.15.99:0/3952737887 shutdown_connections 2024-02-21T23:12:59.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.020+0000 7f1e9e600640 1 -- 172.21.15.99:0/3952737887 wait complete. 2024-02-21T23:12:59.027 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-21T23:00:57.020557+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 11.760000228881836, 'score_stable': 11.760000228881836, 'optimal_score': 0.17000000178813934, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-02-21T23:01:01.124398+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-02-21T23:01:01.684258+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 15, 'snap_epoch': 39, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-02-21T23:01:05.290089+0000', 'flags': 8197, 'flags_names': 'hashpspool,ec_overwrites,selfmanaged_snaps', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 15, 'snap_epoch': 39, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-02-21T23:12:59.028 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-21T23:12:59.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.242+0000 7f8610000640 1 Processor -- start 2024-02-21T23:12:59.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.242+0000 7f8610000640 1 -- start start 2024-02-21T23:12:59.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.245+0000 7f8610000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f8608186dc0 0x7f860808d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:59.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.245+0000 7f8610000640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f86081878b0 0x7f86080f73b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:59.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.245+0000 7f8610000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86080f8290 con 0x7f860808da40 2024-02-21T23:12:59.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.245+0000 7f8610000640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86080f8570 con 0x7f8608186dc0 2024-02-21T23:12:59.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.245+0000 7f8610000640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86080f8850 con 0x7f86081878b0 2024-02-21T23:12:59.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.245+0000 7f860d600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f8608186dc0 0x7f860808d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:59.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.245+0000 7f860d600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f8608186dc0 0x7f860808d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53030/0 (socket says 172.21.15.99:53030) 2024-02-21T23:12:59.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.245+0000 7f860d600640 1 -- 172.21.15.99:0/2601365498 learned_addr learned my addr 172.21.15.99:0/2601365498 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:12:59.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.245+0000 7f860cc00640 1 --1- 172.21.15.99:0/2601365498 >> v1:172.21.15.99:6789/0 conn(0x7f860808da40 0x7f86081871a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:33838/0 (socket says 172.21.15.99:33838) 2024-02-21T23:12:59.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.245+0000 7f860e000640 1 --2- 172.21.15.99:0/2601365498 >> v2:172.21.15.181:3300/0 conn(0x7f86081878b0 0x7f86080f73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:59.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.246+0000 7f860d600640 1 -- 172.21.15.99:0/2601365498 >> v2:172.21.15.181:3300/0 conn(0x7f86081878b0 msgr2=0x7f86080f73b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:59.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.246+0000 7f860d600640 1 --2- 172.21.15.99:0/2601365498 >> v2:172.21.15.181:3300/0 conn(0x7f86081878b0 0x7f86080f73b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:59.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.246+0000 7f860d600640 1 -- 172.21.15.99:0/2601365498 >> v1:172.21.15.99:6789/0 conn(0x7f860808da40 legacy=0x7f86081871a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:59.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.246+0000 7f860d600640 1 -- 172.21.15.99:0/2601365498 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8608188350 con 0x7f8608186dc0 2024-02-21T23:12:59.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.247+0000 7f860d600640 1 --2- 172.21.15.99:0/2601365498 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8608186dc0 0x7f860808d500 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f86080757a0 tx=0x7f85fc02b9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf0604d04c36e6e7 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:59.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.247+0000 7f8607e00640 1 -- 172.21.15.99:0/2601365498 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85fc034070 con 0x7f8608186dc0 2024-02-21T23:12:59.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.247+0000 7f8607e00640 1 -- 172.21.15.99:0/2601365498 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85fc030870 con 0x7f8608186dc0 2024-02-21T23:12:59.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.247+0000 7f8607e00640 1 -- 172.21.15.99:0/2601365498 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85fc030ca0 con 0x7f8608186dc0 2024-02-21T23:12:59.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.248+0000 7f8610000640 1 -- 172.21.15.99:0/2601365498 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8608186dc0 msgr2=0x7f860808d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:59.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.248+0000 7f8610000640 1 --2- 172.21.15.99:0/2601365498 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8608186dc0 0x7f860808d500 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f86080757a0 tx=0x7f85fc02b9d0 comp rx=0 tx=0).stop 2024-02-21T23:12:59.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.248+0000 7f8610000640 1 -- 172.21.15.99:0/2601365498 shutdown_connections 2024-02-21T23:12:59.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.248+0000 7f8610000640 1 --2- 172.21.15.99:0/2601365498 >> v2:172.21.15.181:3300/0 conn(0x7f86081878b0 0x7f86080f73b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:59.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.248+0000 7f8610000640 1 --2- 172.21.15.99:0/2601365498 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8608186dc0 0x7f860808d500 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:59.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.248+0000 7f8610000640 1 -- 172.21.15.99:0/2601365498 >> 172.21.15.99:0/2601365498 conn(0x7f86080f8e30 msgr2=0x7f86080f9240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:59.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.248+0000 7f8610000640 1 -- 172.21.15.99:0/2601365498 shutdown_connections 2024-02-21T23:12:59.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.248+0000 7f8610000640 1 -- 172.21.15.99:0/2601365498 wait complete. 2024-02-21T23:12:59.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.252+0000 7f8610000640 1 Processor -- start 2024-02-21T23:12:59.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.252+0000 7f8610000640 1 -- start start 2024-02-21T23:12:59.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.254+0000 7f8610000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f860808da40 0x7f860816fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:59.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.254+0000 7f8610000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8608186dc0 0x7f8608170190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:59.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.254+0000 7f8610000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86081878b0 0x7f86080efec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:59.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.254+0000 7f8610000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f860817da20 con 0x7f860808da40 2024-02-21T23:12:59.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.254+0000 7f8610000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f860808dea0 con 0x7f86081878b0 2024-02-21T23:12:59.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.254+0000 7f8610000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f860817dba0 con 0x7f8608186dc0 2024-02-21T23:12:59.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.254+0000 7f860d600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f860808da40 0x7f860816fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:59.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.254+0000 7f860d600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f860808da40 0x7f860816fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53046/0 (socket says 172.21.15.99:53046) 2024-02-21T23:12:59.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.254+0000 7f860d600640 1 -- 172.21.15.99:0/3618206206 learned_addr learned my addr 172.21.15.99:0/3618206206 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:12:59.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.255+0000 7f860cc00640 1 --2- 172.21.15.99:0/3618206206 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8608186dc0 0x7f8608170190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:59.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.255+0000 7f860e000640 1 --2- 172.21.15.99:0/3618206206 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86081878b0 0x7f86080efec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:59.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.255+0000 7f860d600640 1 -- 172.21.15.99:0/3618206206 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8608186dc0 msgr2=0x7f8608170190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:59.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.255+0000 7f860d600640 1 --2- 172.21.15.99:0/3618206206 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8608186dc0 0x7f8608170190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:59.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.255+0000 7f860d600640 1 -- 172.21.15.99:0/3618206206 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86081878b0 msgr2=0x7f86080efec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:59.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.255+0000 7f860d600640 1 --2- 172.21.15.99:0/3618206206 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86081878b0 0x7f86080efec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:59.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.255+0000 7f860d600640 1 -- 172.21.15.99:0/3618206206 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86080f0dc0 con 0x7f860808da40 2024-02-21T23:12:59.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.255+0000 7f860e000640 1 --2- 172.21.15.99:0/3618206206 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86081878b0 0x7f86080efec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:12:59.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.255+0000 7f860d600640 1 --2- 172.21.15.99:0/3618206206 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f860808da40 0x7f860816fc50 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f85fc000c00 tx=0x7f85fc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:59.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.255+0000 7f8605600640 1 -- 172.21.15.99:0/3618206206 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85fc034040 con 0x7f860808da40 2024-02-21T23:12:59.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.256+0000 7f8605600640 1 -- 172.21.15.99:0/3618206206 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85fc003820 con 0x7f860808da40 2024-02-21T23:12:59.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.256+0000 7f8605600640 1 -- 172.21.15.99:0/3618206206 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85fc003bd0 con 0x7f860808da40 2024-02-21T23:12:59.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.256+0000 7f8610000640 1 -- 172.21.15.99:0/3618206206 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86080f0ae0 con 0x7f860808da40 2024-02-21T23:12:59.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.256+0000 7f8610000640 1 -- 172.21.15.99:0/3618206206 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8608189770 con 0x7f860808da40 2024-02-21T23:12:59.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.257+0000 7f8610000640 1 -- 172.21.15.99:0/3618206206 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8608070c30 con 0x7f860808da40 2024-02-21T23:12:59.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.260+0000 7f8605600640 1 -- 172.21.15.99:0/3618206206 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f85fc037070 con 0x7f860808da40 2024-02-21T23:12:59.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.262+0000 7f8605600640 1 --2- 172.21.15.99:0/3618206206 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f85e809eed0 0x7f85e80a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:59.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.263+0000 7f8605600640 1 -- 172.21.15.99:0/3618206206 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f85fc0ec100 con 0x7f860808da40 2024-02-21T23:12:59.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.263+0000 7f860cc00640 1 --2- 172.21.15.99:0/3618206206 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f85e809eed0 0x7f85e80a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:59.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.264+0000 7f860cc00640 1 --2- 172.21.15.99:0/3618206206 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f85e809eed0 0x7f85e80a1390 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8608170c10 tx=0x7f85f4007e80 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:59.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.267+0000 7f8605600640 1 -- 172.21.15.99:0/3618206206 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f8608070c30 con 0x7f860808da40 2024-02-21T23:12:59.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.595+0000 7f8610000640 1 -- 172.21.15.99:0/3618206206 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f86080f7190 con 0x7f860808da40 2024-02-21T23:12:59.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.595+0000 7f8605600640 1 -- 172.21.15.99:0/3618206206 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7f85fc03e070 con 0x7f860808da40 2024-02-21T23:12:59.584 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 1 2024-02-21T23:12:59.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.598+0000 7f8610000640 1 -- 172.21.15.99:0/3618206206 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f85e809eed0 msgr2=0x7f85e80a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:59.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.598+0000 7f8610000640 1 --2- 172.21.15.99:0/3618206206 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f85e809eed0 0x7f85e80a1390 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8608170c10 tx=0x7f85f4007e80 comp rx=0 tx=0).stop 2024-02-21T23:12:59.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.598+0000 7f8610000640 1 -- 172.21.15.99:0/3618206206 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f860808da40 msgr2=0x7f860816fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:59.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.598+0000 7f8610000640 1 --2- 172.21.15.99:0/3618206206 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f860808da40 0x7f860816fc50 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f85fc000c00 tx=0x7f85fc0046c0 comp rx=0 tx=0).stop 2024-02-21T23:12:59.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.598+0000 7f8610000640 1 -- 172.21.15.99:0/3618206206 shutdown_connections 2024-02-21T23:12:59.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.598+0000 7f8610000640 1 --2- 172.21.15.99:0/3618206206 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f85e809eed0 0x7f85e80a1390 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:59.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.598+0000 7f8610000640 1 --2- 172.21.15.99:0/3618206206 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f86081878b0 0x7f86080efec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:59.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.598+0000 7f8610000640 1 --2- 172.21.15.99:0/3618206206 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8608186dc0 0x7f8608170190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:59.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.598+0000 7f8610000640 1 --2- 172.21.15.99:0/3618206206 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f860808da40 0x7f860816fc50 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:59.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.598+0000 7f8610000640 1 -- 172.21.15.99:0/3618206206 >> 172.21.15.99:0/3618206206 conn(0x7f86080f8e30 msgr2=0x7f8608173760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:59.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.598+0000 7f8610000640 1 -- 172.21.15.99:0/3618206206 shutdown_connections 2024-02-21T23:12:59.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.598+0000 7f8610000640 1 -- 172.21.15.99:0/3618206206 wait complete. 2024-02-21T23:12:59.609 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-02-21T23:12:59.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.848+0000 7f49c3200640 1 Processor -- start 2024-02-21T23:12:59.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.848+0000 7f49c3200640 1 -- start start 2024-02-21T23:12:59.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.851+0000 7f49c3200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49c40f6190 con 0x7f49c4070ef0 2024-02-21T23:12:59.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.852+0000 7f49c3200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49c406fb70 con 0x7f49c4073100 2024-02-21T23:12:59.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.852+0000 7f49c3200640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49c406fe50 con 0x7f49c417d330 2024-02-21T23:12:59.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.852+0000 7f49c1e00640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f49c417d330 0x7f49c40f5a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:58156/0 (socket says 172.21.15.99:58156) 2024-02-21T23:12:59.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.852+0000 7f49c1e00640 1 -- 172.21.15.99:0/284303810 learned_addr learned my addr 172.21.15.99:0/284303810 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:12:59.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.852+0000 7f49c1400640 1 --1- 172.21.15.99:0/284303810 >> v1:172.21.15.99:6789/0 conn(0x7f49c4070ef0 0x7f49c40740b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:33850/0 (socket says 172.21.15.99:33850) 2024-02-21T23:12:59.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.852+0000 7f49c0a00640 1 -- 172.21.15.99:0/284303810 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4281801202 0 0) 0x7f49c406fe50 con 0x7f49c417d330 2024-02-21T23:12:59.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.852+0000 7f49c0a00640 1 -- 172.21.15.99:0/284303810 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49a8003520 con 0x7f49c417d330 2024-02-21T23:12:59.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.852+0000 7f49c0a00640 1 -- 172.21.15.99:0/284303810 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 241022318 0 0) 0x7f49c406fb70 con 0x7f49c4073100 2024-02-21T23:12:59.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.852+0000 7f49c0a00640 1 -- 172.21.15.99:0/284303810 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49c406fe50 con 0x7f49c4073100 2024-02-21T23:12:59.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.852+0000 7f49c0a00640 1 -- 172.21.15.99:0/284303810 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2038521161 0 0) 0x7f49c40f6190 con 0x7f49c4070ef0 2024-02-21T23:12:59.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.852+0000 7f49c0a00640 1 -- 172.21.15.99:0/284303810 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49c406fb70 con 0x7f49c4070ef0 2024-02-21T23:12:59.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.853+0000 7f49c0a00640 1 -- 172.21.15.99:0/284303810 <== mon.1 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2151188372 0 0) 0x7f49c406fe50 con 0x7f49c4073100 2024-02-21T23:12:59.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.853+0000 7f49c0a00640 1 -- 172.21.15.99:0/284303810 >> v1:172.21.15.181:6789/0 conn(0x7f49c417d330 legacy=0x7f49c40f5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:59.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.853+0000 7f49c0a00640 1 -- 172.21.15.99:0/284303810 >> v1:172.21.15.99:6789/0 conn(0x7f49c4070ef0 legacy=0x7f49c40740b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:59.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.853+0000 7f49c0a00640 1 -- 172.21.15.99:0/284303810 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49c4070130 con 0x7f49c4073100 2024-02-21T23:12:59.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.853+0000 7f49c0a00640 1 -- 172.21.15.99:0/284303810 <== mon.1 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2069890144 0 0) 0x7f49bc001900 con 0x7f49c4073100 2024-02-21T23:12:59.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.853+0000 7f49c0a00640 1 -- 172.21.15.99:0/284303810 >> v1:172.21.15.162:6789/0 conn(0x7f49c4073100 legacy=0x7f49c40747c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:59.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.853+0000 7f49c0a00640 1 --2- 172.21.15.99:0/284303810 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f49a8004e50 0x7f49a8005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:59.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.853+0000 7f49c0a00640 1 --2- 172.21.15.99:0/284303810 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f49a8003860 0x7f49a8003ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:59.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.853+0000 7f49c0a00640 1 --2- 172.21.15.99:0/284303810 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f49a80099b0 0x7f49a800bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:59.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.853+0000 7f49c0a00640 1 -- 172.21.15.99:0/284303810 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a800c330 con 0x7f49a8004e50 2024-02-21T23:12:59.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.853+0000 7f49c0a00640 1 -- 172.21.15.99:0/284303810 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a800c4e0 con 0x7f49a80099b0 2024-02-21T23:12:59.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.853+0000 7f49c0a00640 1 -- 172.21.15.99:0/284303810 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a800c6e0 con 0x7f49a8003860 2024-02-21T23:12:59.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.853+0000 7f49c1400640 1 --2- 172.21.15.99:0/284303810 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f49a8003860 0x7f49a8003ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:59.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.853+0000 7f49c1e00640 1 --2- 172.21.15.99:0/284303810 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f49a8004e50 0x7f49a8005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:59.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.853+0000 7f49c2800640 1 --2- 172.21.15.99:0/284303810 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f49a80099b0 0x7f49a800bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:59.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.854+0000 7f49c1400640 1 -- 172.21.15.99:0/284303810 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f49a80099b0 msgr2=0x7f49a800bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:59.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.854+0000 7f49c1400640 1 --2- 172.21.15.99:0/284303810 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f49a80099b0 0x7f49a800bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:59.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.854+0000 7f49c1400640 1 -- 172.21.15.99:0/284303810 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f49a8004e50 msgr2=0x7f49a8005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:12:59.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.854+0000 7f49c1400640 1 --2- 172.21.15.99:0/284303810 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f49a8004e50 0x7f49a8005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:59.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.854+0000 7f49c1400640 1 -- 172.21.15.99:0/284303810 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49c406fe50 con 0x7f49a8003860 2024-02-21T23:12:59.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.854+0000 7f49c2800640 1 --2- 172.21.15.99:0/284303810 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f49a80099b0 0x7f49a800bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:12:59.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.854+0000 7f49c2800640 1 -- 172.21.15.99:0/284303810 reap_dead start 2024-02-21T23:12:59.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.855+0000 7f49c1400640 1 --2- 172.21.15.99:0/284303810 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f49a8003860 0x7f49a8003ce0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f49b00018c0 tx=0x7f49a8005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=851a2cf7de95fa1d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:59.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.856+0000 7f49c0a00640 1 -- 172.21.15.99:0/284303810 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b00014e0 con 0x7f49a8003860 2024-02-21T23:12:59.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.856+0000 7f49c0a00640 1 -- 172.21.15.99:0/284303810 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49b0007290 con 0x7f49a8003860 2024-02-21T23:12:59.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.856+0000 7f49c0a00640 1 -- 172.21.15.99:0/284303810 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b0007680 con 0x7f49a8003860 2024-02-21T23:12:59.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.856+0000 7f49c3200640 1 -- 172.21.15.99:0/284303810 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f49a8003860 msgr2=0x7f49a8003ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:59.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.856+0000 7f49c3200640 1 --2- 172.21.15.99:0/284303810 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f49a8003860 0x7f49a8003ce0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f49b00018c0 tx=0x7f49a8005830 comp rx=0 tx=0).stop 2024-02-21T23:12:59.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.856+0000 7f49c3200640 1 -- 172.21.15.99:0/284303810 shutdown_connections 2024-02-21T23:12:59.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.856+0000 7f49c3200640 1 --2- 172.21.15.99:0/284303810 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f49a8003860 0x7f49a8003ce0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:59.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.856+0000 7f49c3200640 1 -- 172.21.15.99:0/284303810 >> 172.21.15.99:0/284303810 conn(0x7f49c406e210 msgr2=0x7f49c406e620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:12:59.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.857+0000 7f49c3200640 1 -- 172.21.15.99:0/284303810 shutdown_connections 2024-02-21T23:12:59.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.857+0000 7f49c3200640 1 -- 172.21.15.99:0/284303810 wait complete. 2024-02-21T23:12:59.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.859+0000 7f49c3200640 1 Processor -- start 2024-02-21T23:12:59.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.859+0000 7f49c3200640 1 -- start start 2024-02-21T23:12:59.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.860+0000 7f49c3200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f49a8003860 0x7f49c4167ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:59.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.860+0000 7f49c3200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f49c40cb500 0x7f49c40cb980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:59.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.860+0000 7f49c3200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f49c4178530 0x7f49c41789b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:59.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.860+0000 7f49c3200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49c4070a60 con 0x7f49c4178530 2024-02-21T23:12:59.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.860+0000 7f49c3200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49c4073590 con 0x7f49c40cb500 2024-02-21T23:12:59.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.860+0000 7f49c3200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49c40706f0 con 0x7f49a8003860 2024-02-21T23:12:59.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.860+0000 7f49c1e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f49a8003860 0x7f49c4167ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:59.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.860+0000 7f49c1e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f49a8003860 0x7f49c4167ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:53566/0 (socket says 172.21.15.99:53566) 2024-02-21T23:12:59.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.861+0000 7f49c1e00640 1 -- 172.21.15.99:0/1384411768 learned_addr learned my addr 172.21.15.99:0/1384411768 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:12:59.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.861+0000 7f49c2800640 1 --2- 172.21.15.99:0/1384411768 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f49c4178530 0x7f49c41789b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:59.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.861+0000 7f49c1400640 1 --2- 172.21.15.99:0/1384411768 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f49c40cb500 0x7f49c40cb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:59.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.861+0000 7f49c1e00640 1 -- 172.21.15.99:0/1384411768 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f49c40cb500 msgr2=0x7f49c40cb980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:59.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.861+0000 7f49c1e00640 1 --2- 172.21.15.99:0/1384411768 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f49c40cb500 0x7f49c40cb980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:59.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.861+0000 7f49c1e00640 1 -- 172.21.15.99:0/1384411768 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f49c4178530 msgr2=0x7f49c41789b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:12:59.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.861+0000 7f49c1e00640 1 --2- 172.21.15.99:0/1384411768 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f49c4178530 0x7f49c41789b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:12:59.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.861+0000 7f49c1e00640 1 -- 172.21.15.99:0/1384411768 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49c40f5bd0 con 0x7f49a8003860 2024-02-21T23:12:59.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.861+0000 7f49c1e00640 1 --2- 172.21.15.99:0/1384411768 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f49a8003860 0x7f49c4167ac0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f49b40017b0 tx=0x7f49b4001c70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:59.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.862+0000 7f49ba000640 1 -- 172.21.15.99:0/1384411768 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b4007740 con 0x7f49a8003860 2024-02-21T23:12:59.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.862+0000 7f49c3200640 1 -- 172.21.15.99:0/1384411768 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49c40f5eb0 con 0x7f49a8003860 2024-02-21T23:12:59.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.862+0000 7f49ba000640 1 -- 172.21.15.99:0/1384411768 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49b4018070 con 0x7f49a8003860 2024-02-21T23:12:59.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.862+0000 7f49ba000640 1 -- 172.21.15.99:0/1384411768 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b400fbc0 con 0x7f49a8003860 2024-02-21T23:12:59.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.862+0000 7f49c3200640 1 -- 172.21.15.99:0/1384411768 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49c40f6470 con 0x7f49a8003860 2024-02-21T23:12:59.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.863+0000 7f49c3200640 1 -- 172.21.15.99:0/1384411768 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49c4068320 con 0x7f49a8003860 2024-02-21T23:12:59.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.865+0000 7f49ba000640 1 -- 172.21.15.99:0/1384411768 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f49b401d460 con 0x7f49a8003860 2024-02-21T23:12:59.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.867+0000 7f49ba000640 1 --2- 172.21.15.99:0/1384411768 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f49a409ee50 0x7f49a40a1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:12:59.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.867+0000 7f49ba000640 1 -- 172.21.15.99:0/1384411768 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f49b40c9d80 con 0x7f49a8003860 2024-02-21T23:12:59.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.867+0000 7f49c1400640 1 --2- 172.21.15.99:0/1384411768 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f49a409ee50 0x7f49a40a1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:12:59.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.868+0000 7f49c1400640 1 --2- 172.21.15.99:0/1384411768 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f49a409ee50 0x7f49a40a1310 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f49b0034000 tx=0x7f49b0009030 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:12:59.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:12:59.870+0000 7f49ba000640 1 -- 172.21.15.99:0/1384411768 <== mon.2 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f49b4097d60 con 0x7f49a8003860 2024-02-21T23:13:00.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.175+0000 7f49c3200640 1 -- 172.21.15.99:0/1384411768 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f49c4180740 con 0x7f49a8003860 2024-02-21T23:13:00.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.176+0000 7f49ba000640 1 -- 172.21.15.99:0/1384411768 <== mon.2 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v40) v1 ==== 104+0+11 (secure 0 0 0) 0x7f49b4097660 con 0x7f49a8003860 2024-02-21T23:13:00.165 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 32 2024-02-21T23:13:00.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.180+0000 7f49c3200640 1 -- 172.21.15.99:0/1384411768 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f49a409ee50 msgr2=0x7f49a40a1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:00.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.180+0000 7f49c3200640 1 --2- 172.21.15.99:0/1384411768 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f49a409ee50 0x7f49a40a1310 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f49b0034000 tx=0x7f49b0009030 comp rx=0 tx=0).stop 2024-02-21T23:13:00.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.180+0000 7f49c3200640 1 -- 172.21.15.99:0/1384411768 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f49a8003860 msgr2=0x7f49c4167ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:00.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.180+0000 7f49c3200640 1 --2- 172.21.15.99:0/1384411768 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f49a8003860 0x7f49c4167ac0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f49b40017b0 tx=0x7f49b4001c70 comp rx=0 tx=0).stop 2024-02-21T23:13:00.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.180+0000 7f49c3200640 1 -- 172.21.15.99:0/1384411768 shutdown_connections 2024-02-21T23:13:00.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.180+0000 7f49c3200640 1 --2- 172.21.15.99:0/1384411768 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f49a409ee50 0x7f49a40a1310 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:00.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.180+0000 7f49c3200640 1 --2- 172.21.15.99:0/1384411768 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f49c4178530 0x7f49c41789b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:00.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.180+0000 7f49c3200640 1 --2- 172.21.15.99:0/1384411768 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f49c40cb500 0x7f49c40cb980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:00.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.180+0000 7f49c3200640 1 --2- 172.21.15.99:0/1384411768 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f49a8003860 0x7f49c4167ac0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:00.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.180+0000 7f49c3200640 1 -- 172.21.15.99:0/1384411768 >> 172.21.15.99:0/1384411768 conn(0x7f49c406e210 msgr2=0x7f49c4066c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:00.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.181+0000 7f49c3200640 1 -- 172.21.15.99:0/1384411768 shutdown_connections 2024-02-21T23:13:00.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.181+0000 7f49c3200640 1 -- 172.21.15.99:0/1384411768 wait complete. 2024-02-21T23:13:00.194 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-02-21T23:13:00.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.433+0000 7f2325600640 1 Processor -- start 2024-02-21T23:13:00.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.434+0000 7f2325600640 1 -- start start 2024-02-21T23:13:00.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.435+0000 7f2325600640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f2320180c80 0x7f2320187f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:00.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.435+0000 7f2325600640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f232006e910 0x7f23200cb420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:00.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.435+0000 7f2325600640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f232006ee40 con 0x7f2320188440 2024-02-21T23:13:00.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.435+0000 7f2325600640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f232006f120 con 0x7f2320180c80 2024-02-21T23:13:00.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.435+0000 7f2325600640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f232006f400 con 0x7f232006e910 2024-02-21T23:13:00.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.436+0000 7f231ea00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f2320180c80 0x7f2320187f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:00.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.436+0000 7f231ea00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f2320180c80 0x7f2320187f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53074/0 (socket says 172.21.15.99:53074) 2024-02-21T23:13:00.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.436+0000 7f231ea00640 1 -- 172.21.15.99:0/1242713506 learned_addr learned my addr 172.21.15.99:0/1242713506 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:13:00.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.436+0000 7f231e000640 1 --2- 172.21.15.99:0/1242713506 >> v2:172.21.15.181:3300/0 conn(0x7f232006e910 0x7f23200cb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:00.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.436+0000 7f231ea00640 1 -- 172.21.15.99:0/1242713506 >> v2:172.21.15.181:3300/0 conn(0x7f232006e910 msgr2=0x7f23200cb420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:13:00.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.436+0000 7f231ea00640 1 --2- 172.21.15.99:0/1242713506 >> v2:172.21.15.181:3300/0 conn(0x7f232006e910 0x7f23200cb420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:00.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.436+0000 7f231ea00640 1 -- 172.21.15.99:0/1242713506 >> v1:172.21.15.181:6789/0 conn(0x7f2320188440 legacy=0x7f23200cb960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:00.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.436+0000 7f231ea00640 1 -- 172.21.15.99:0/1242713506 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f232006f6e0 con 0x7f2320180c80 2024-02-21T23:13:00.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.438+0000 7f231ea00640 1 --2- 172.21.15.99:0/1242713506 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2320180c80 0x7f2320187f00 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f2320184600 tx=0x7f231002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1484f6b1f8acbc27 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:00.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.438+0000 7f231d600640 1 -- 172.21.15.99:0/1242713506 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2310035020 con 0x7f2320180c80 2024-02-21T23:13:00.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.438+0000 7f231d600640 1 -- 172.21.15.99:0/1242713506 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2310031870 con 0x7f2320180c80 2024-02-21T23:13:00.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.438+0000 7f231d600640 1 -- 172.21.15.99:0/1242713506 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2310031c40 con 0x7f2320180c80 2024-02-21T23:13:00.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.439+0000 7f2325600640 1 -- 172.21.15.99:0/1242713506 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2320180c80 msgr2=0x7f2320187f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:00.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.439+0000 7f2325600640 1 --2- 172.21.15.99:0/1242713506 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2320180c80 0x7f2320187f00 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f2320184600 tx=0x7f231002b910 comp rx=0 tx=0).stop 2024-02-21T23:13:00.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.439+0000 7f2325600640 1 -- 172.21.15.99:0/1242713506 shutdown_connections 2024-02-21T23:13:00.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.439+0000 7f2325600640 1 --2- 172.21.15.99:0/1242713506 >> v2:172.21.15.181:3300/0 conn(0x7f232006e910 0x7f23200cb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:00.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.439+0000 7f2325600640 1 --2- 172.21.15.99:0/1242713506 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2320180c80 0x7f2320187f00 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:00.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.439+0000 7f2325600640 1 -- 172.21.15.99:0/1242713506 >> 172.21.15.99:0/1242713506 conn(0x7f23200ce5f0 msgr2=0x7f23200cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:00.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.439+0000 7f2325600640 1 -- 172.21.15.99:0/1242713506 shutdown_connections 2024-02-21T23:13:00.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.440+0000 7f2325600640 1 -- 172.21.15.99:0/1242713506 wait complete. 2024-02-21T23:13:00.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.442+0000 7f2325600640 1 Processor -- start 2024-02-21T23:13:00.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.442+0000 7f2325600640 1 -- start start 2024-02-21T23:13:00.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.443+0000 7f2325600640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f232006e910 0x7f2320159150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:00.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.443+0000 7f2325600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2320180c80 0x7f2320220510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:00.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.443+0000 7f2325600640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2320188440 0x7f2320220a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:00.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.443+0000 7f2325600640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23200701c0 con 0x7f2320188440 2024-02-21T23:13:00.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.443+0000 7f2325600640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f232006fca0 con 0x7f2320180c80 2024-02-21T23:13:00.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.443+0000 7f2325600640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2320070340 con 0x7f232006e910 2024-02-21T23:13:00.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.443+0000 7f231ea00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f232006e910 0x7f2320159150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:00.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.443+0000 7f231ea00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f232006e910 0x7f2320159150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:53578/0 (socket says 172.21.15.99:53578) 2024-02-21T23:13:00.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.443+0000 7f231ea00640 1 -- 172.21.15.99:0/2881158640 learned_addr learned my addr 172.21.15.99:0/2881158640 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:13:00.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.443+0000 7f231f400640 1 --2- 172.21.15.99:0/2881158640 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2320188440 0x7f2320220a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:00.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.444+0000 7f231e000640 1 --2- 172.21.15.99:0/2881158640 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2320180c80 0x7f2320220510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:00.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.444+0000 7f231e000640 1 -- 172.21.15.99:0/2881158640 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f232006e910 msgr2=0x7f2320159150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:00.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.444+0000 7f231e000640 1 --2- 172.21.15.99:0/2881158640 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f232006e910 0x7f2320159150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:00.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.444+0000 7f231e000640 1 -- 172.21.15.99:0/2881158640 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2320188440 msgr2=0x7f2320220a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:00.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.444+0000 7f231e000640 1 --2- 172.21.15.99:0/2881158640 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2320188440 0x7f2320220a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:00.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.444+0000 7f231e000640 1 -- 172.21.15.99:0/2881158640 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23201857f0 con 0x7f2320180c80 2024-02-21T23:13:00.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.444+0000 7f231ea00640 1 --2- 172.21.15.99:0/2881158640 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f232006e910 0x7f2320159150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:13:00.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.444+0000 7f231f400640 1 --2- 172.21.15.99:0/2881158640 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2320188440 0x7f2320220a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:13:00.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.444+0000 7f231e000640 1 --2- 172.21.15.99:0/2881158640 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2320180c80 0x7f2320220510 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f230c00e840 tx=0x7f230c00ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:00.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.445+0000 7f2316a00640 1 -- 172.21.15.99:0/2881158640 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230c017070 con 0x7f2320180c80 2024-02-21T23:13:00.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.445+0000 7f2316a00640 1 -- 172.21.15.99:0/2881158640 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f230c00c730 con 0x7f2320180c80 2024-02-21T23:13:00.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.445+0000 7f2316a00640 1 -- 172.21.15.99:0/2881158640 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230c00cb00 con 0x7f2320180c80 2024-02-21T23:13:00.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.445+0000 7f2325600640 1 -- 172.21.15.99:0/2881158640 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2320185ad0 con 0x7f2320180c80 2024-02-21T23:13:00.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.445+0000 7f2325600640 1 -- 172.21.15.99:0/2881158640 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2320186090 con 0x7f2320180c80 2024-02-21T23:13:00.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.446+0000 7f2325600640 1 -- 172.21.15.99:0/2881158640 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2320068780 con 0x7f2320180c80 2024-02-21T23:13:00.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.448+0000 7f2316a00640 1 -- 172.21.15.99:0/2881158640 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f230c01a070 con 0x7f2320180c80 2024-02-21T23:13:00.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.451+0000 7f2316a00640 1 --2- 172.21.15.99:0/2881158640 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f230009eed0 0x7f23000a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:00.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.451+0000 7f2316a00640 1 -- 172.21.15.99:0/2881158640 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f230c0ca3a0 con 0x7f2320180c80 2024-02-21T23:13:00.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.451+0000 7f231ea00640 1 --2- 172.21.15.99:0/2881158640 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f230009eed0 0x7f23000a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:00.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.452+0000 7f2316a00640 1 -- 172.21.15.99:0/2881158640 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f230c097ca0 con 0x7f2320180c80 2024-02-21T23:13:00.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.452+0000 7f231ea00640 1 --2- 172.21.15.99:0/2881158640 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f230009eed0 0x7f23000a1390 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2310034040 tx=0x7f231003c040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:00.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.649+0000 7f2325600640 1 -- 172.21.15.99:0/2881158640 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f23200eda00 con 0x7f2320180c80 2024-02-21T23:13:00.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.650+0000 7f2316a00640 1 -- 172.21.15.99:0/2881158640 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v40) v1 ==== 100+0+11 (secure 0 0 0) 0x7f230c09bd40 con 0x7f2320180c80 2024-02-21T23:13:00.637 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 64 2024-02-21T23:13:00.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.652+0000 7f2325600640 1 -- 172.21.15.99:0/2881158640 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f230009eed0 msgr2=0x7f23000a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:00.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.652+0000 7f2325600640 1 --2- 172.21.15.99:0/2881158640 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f230009eed0 0x7f23000a1390 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2310034040 tx=0x7f231003c040 comp rx=0 tx=0).stop 2024-02-21T23:13:00.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.652+0000 7f2325600640 1 -- 172.21.15.99:0/2881158640 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2320180c80 msgr2=0x7f2320220510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:00.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.652+0000 7f2325600640 1 --2- 172.21.15.99:0/2881158640 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2320180c80 0x7f2320220510 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f230c00e840 tx=0x7f230c00ed00 comp rx=0 tx=0).stop 2024-02-21T23:13:00.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.652+0000 7f2325600640 1 -- 172.21.15.99:0/2881158640 shutdown_connections 2024-02-21T23:13:00.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.652+0000 7f2325600640 1 --2- 172.21.15.99:0/2881158640 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f230009eed0 0x7f23000a1390 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:00.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.652+0000 7f2325600640 1 --2- 172.21.15.99:0/2881158640 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f2320188440 0x7f2320220a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:00.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.652+0000 7f2325600640 1 --2- 172.21.15.99:0/2881158640 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2320180c80 0x7f2320220510 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:00.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.652+0000 7f2325600640 1 --2- 172.21.15.99:0/2881158640 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f232006e910 0x7f2320159150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:00.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.652+0000 7f2325600640 1 -- 172.21.15.99:0/2881158640 >> 172.21.15.99:0/2881158640 conn(0x7f23200ce5f0 msgr2=0x7f2320176610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:00.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.653+0000 7f2325600640 1 -- 172.21.15.99:0/2881158640 shutdown_connections 2024-02-21T23:13:00.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.653+0000 7f2325600640 1 -- 172.21.15.99:0/2881158640 wait complete. 2024-02-21T23:13:00.659 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-02-21T23:13:00.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.902+0000 7fb5a0c00640 1 Processor -- start 2024-02-21T23:13:00.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.902+0000 7fb5a0c00640 1 -- start start 2024-02-21T23:13:00.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.903+0000 7fb5a0c00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fb59c0fb9e0 0x7fb59c190350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:00.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.903+0000 7fb5a0c00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb59c0fd490 con 0x7fb59c0fce30 2024-02-21T23:13:00.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.903+0000 7fb5a0c00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb59c0fd770 con 0x7fb59c1648c0 2024-02-21T23:13:00.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.903+0000 7fb5a0c00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb59c0fbe70 con 0x7fb59c0fb9e0 2024-02-21T23:13:00.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.904+0000 7fb593e00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fb59c0fce30 0x7fb59c187440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:33856/0 (socket says 172.21.15.99:33856) 2024-02-21T23:13:00.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.904+0000 7fb593e00640 1 -- 172.21.15.99:0/2421245055 learned_addr learned my addr 172.21.15.99:0/2421245055 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:13:00.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.904+0000 7fb59be00640 1 --2- 172.21.15.99:0/2421245055 >> v2:172.21.15.181:3300/0 conn(0x7fb59c0fb9e0 0x7fb59c190350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:00.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.904+0000 7fb59be00640 1 -- 172.21.15.99:0/2421245055 >> v1:172.21.15.181:6789/0 conn(0x7fb59c1648c0 legacy=0x7fb59c186d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:00.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.904+0000 7fb59aa00640 1 -- 172.21.15.99:0/2421245055 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1323893788 0 0) 0x7fb59c0fd770 con 0x7fb59c1648c0 2024-02-21T23:13:00.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.904+0000 7fb59be00640 1 -- 172.21.15.99:0/2421245055 >> v1:172.21.15.99:6789/0 conn(0x7fb59c0fce30 legacy=0x7fb59c187440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:00.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.904+0000 7fb59be00640 1 -- 172.21.15.99:0/2421245055 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb59c0fda50 con 0x7fb59c0fb9e0 2024-02-21T23:13:00.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.906+0000 7fb59be00640 1 --2- 172.21.15.99:0/2421245055 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb59c0fb9e0 0x7fb59c190350 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fb594009d90 tx=0x7fb59402bd80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0a39fb6ca0a98df server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:00.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.906+0000 7fb59aa00640 1 -- 172.21.15.99:0/2421245055 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb594039070 con 0x7fb59c0fb9e0 2024-02-21T23:13:00.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.906+0000 7fb59aa00640 1 -- 172.21.15.99:0/2421245055 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb59402cab0 con 0x7fb59c0fb9e0 2024-02-21T23:13:00.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.906+0000 7fb59aa00640 1 -- 172.21.15.99:0/2421245055 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb594034440 con 0x7fb59c0fb9e0 2024-02-21T23:13:00.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.907+0000 7fb5a0c00640 1 -- 172.21.15.99:0/2421245055 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb59c0fb9e0 msgr2=0x7fb59c190350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:00.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.907+0000 7fb5a0c00640 1 --2- 172.21.15.99:0/2421245055 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb59c0fb9e0 0x7fb59c190350 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fb594009d90 tx=0x7fb59402bd80 comp rx=0 tx=0).stop 2024-02-21T23:13:00.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.907+0000 7fb5a0c00640 1 -- 172.21.15.99:0/2421245055 shutdown_connections 2024-02-21T23:13:00.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.907+0000 7fb5a0c00640 1 --2- 172.21.15.99:0/2421245055 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb59c0fb9e0 0x7fb59c190350 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:00.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.907+0000 7fb5a0c00640 1 -- 172.21.15.99:0/2421245055 >> 172.21.15.99:0/2421245055 conn(0x7fb59c0d29c0 msgr2=0x7fb59c0d2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:00.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.907+0000 7fb5a0c00640 1 -- 172.21.15.99:0/2421245055 shutdown_connections 2024-02-21T23:13:00.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.907+0000 7fb5a0c00640 1 -- 172.21.15.99:0/2421245055 wait complete. 2024-02-21T23:13:00.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.910+0000 7fb5a0c00640 1 Processor -- start 2024-02-21T23:13:00.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.911+0000 7fb5a0c00640 1 -- start start 2024-02-21T23:13:00.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.913+0000 7fb5a0c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb59c0fb9e0 0x7fb59c161f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:00.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.913+0000 7fb5a0c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb59c0fce30 0x7fb59c221510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:00.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.913+0000 7fb5a0c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb59c1648c0 0x7fb59c221a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:00.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.913+0000 7fb5a0c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb59c072920 con 0x7fb59c0fb9e0 2024-02-21T23:13:00.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.913+0000 7fb5a0c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb59c0fe010 con 0x7fb59c0fce30 2024-02-21T23:13:00.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.913+0000 7fb5a0c00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb59c190890 con 0x7fb59c1648c0 2024-02-21T23:13:00.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.913+0000 7fb59b400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb59c0fb9e0 0x7fb59c161f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:00.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.913+0000 7fb59b400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb59c0fb9e0 0x7fb59c161f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53096/0 (socket says 172.21.15.99:53096) 2024-02-21T23:13:00.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.913+0000 7fb59b400640 1 -- 172.21.15.99:0/1207586148 learned_addr learned my addr 172.21.15.99:0/1207586148 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:13:00.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.913+0000 7fb59be00640 1 --2- 172.21.15.99:0/1207586148 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb59c1648c0 0x7fb59c221a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:00.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.913+0000 7fb593e00640 1 --2- 172.21.15.99:0/1207586148 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb59c0fce30 0x7fb59c221510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:00.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.914+0000 7fb59be00640 1 -- 172.21.15.99:0/1207586148 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb59c0fce30 msgr2=0x7fb59c221510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:00.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.914+0000 7fb59be00640 1 --2- 172.21.15.99:0/1207586148 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb59c0fce30 0x7fb59c221510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:00.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.914+0000 7fb59be00640 1 -- 172.21.15.99:0/1207586148 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb59c0fb9e0 msgr2=0x7fb59c161f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:00.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.914+0000 7fb59be00640 1 --2- 172.21.15.99:0/1207586148 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb59c0fb9e0 0x7fb59c161f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:00.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.914+0000 7fb59be00640 1 -- 172.21.15.99:0/1207586148 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb59c162490 con 0x7fb59c1648c0 2024-02-21T23:13:00.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.914+0000 7fb59b400640 1 --2- 172.21.15.99:0/1207586148 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb59c0fb9e0 0x7fb59c161f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:13:00.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.914+0000 7fb59be00640 1 --2- 172.21.15.99:0/1207586148 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb59c1648c0 0x7fb59c221a50 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fb594033000 tx=0x7fb594004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:00.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.914+0000 7fb593400640 1 -- 172.21.15.99:0/1207586148 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb594044030 con 0x7fb59c1648c0 2024-02-21T23:13:00.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.914+0000 7fb5a0c00640 1 -- 172.21.15.99:0/1207586148 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb59c0f6fe0 con 0x7fb59c1648c0 2024-02-21T23:13:00.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.914+0000 7fb593400640 1 -- 172.21.15.99:0/1207586148 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb59403f470 con 0x7fb59c1648c0 2024-02-21T23:13:00.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.914+0000 7fb593400640 1 -- 172.21.15.99:0/1207586148 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb594039040 con 0x7fb59c1648c0 2024-02-21T23:13:00.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.915+0000 7fb5a0c00640 1 -- 172.21.15.99:0/1207586148 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb59c220750 con 0x7fb59c1648c0 2024-02-21T23:13:00.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.916+0000 7fb5a0c00640 1 -- 172.21.15.99:0/1207586148 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb59c0d1d40 con 0x7fb59c1648c0 2024-02-21T23:13:00.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.919+0000 7fb593400640 1 -- 172.21.15.99:0/1207586148 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7fb594047070 con 0x7fb59c1648c0 2024-02-21T23:13:00.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.921+0000 7fb593400640 1 --2- 172.21.15.99:0/1207586148 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fb57809ee50 0x7fb5780a1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:00.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.921+0000 7fb593400640 1 -- 172.21.15.99:0/1207586148 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 8877+0+0 (secure 0 0 0) 0x7fb5940ecf40 con 0x7fb59c1648c0 2024-02-21T23:13:00.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.921+0000 7fb59b400640 1 --2- 172.21.15.99:0/1207586148 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fb57809ee50 0x7fb5780a1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:00.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.922+0000 7fb59b400640 1 --2- 172.21.15.99:0/1207586148 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fb57809ee50 0x7fb5780a1310 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb58c007fd0 tx=0x7fb58c009040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:00.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:00.922+0000 7fb593400640 1 -- 172.21.15.99:0/1207586148 <== mon.2 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fb59c0d1d40 con 0x7fb59c1648c0 2024-02-21T23:13:01.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.277+0000 7fb5a0c00640 1 -- 172.21.15.99:0/1207586148 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fb59c0ff320 con 0x7fb59c1648c0 2024-02-21T23:13:01.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.278+0000 7fb593400640 1 -- 172.21.15.99:0/1207586148 <== mon.2 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v40) v1 ==== 103+0+11 (secure 0 0 0) 0x7fb59c0ff320 con 0x7fb59c1648c0 2024-02-21T23:13:01.266 INFO:teuthology.orchestra.run.smithi099.stdout:pg_num: 32 2024-02-21T23:13:01.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.280+0000 7fb5a0c00640 1 -- 172.21.15.99:0/1207586148 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fb57809ee50 msgr2=0x7fb5780a1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:01.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.280+0000 7fb5a0c00640 1 --2- 172.21.15.99:0/1207586148 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fb57809ee50 0x7fb5780a1310 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb58c007fd0 tx=0x7fb58c009040 comp rx=0 tx=0).stop 2024-02-21T23:13:01.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.280+0000 7fb5a0c00640 1 -- 172.21.15.99:0/1207586148 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb59c1648c0 msgr2=0x7fb59c221a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:01.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.280+0000 7fb5a0c00640 1 --2- 172.21.15.99:0/1207586148 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb59c1648c0 0x7fb59c221a50 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fb594033000 tx=0x7fb594004a40 comp rx=0 tx=0).stop 2024-02-21T23:13:01.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.280+0000 7fb5a0c00640 1 -- 172.21.15.99:0/1207586148 shutdown_connections 2024-02-21T23:13:01.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.280+0000 7fb5a0c00640 1 --2- 172.21.15.99:0/1207586148 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fb57809ee50 0x7fb5780a1310 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:01.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.280+0000 7fb5a0c00640 1 --2- 172.21.15.99:0/1207586148 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb59c1648c0 0x7fb59c221a50 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:01.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.280+0000 7fb5a0c00640 1 --2- 172.21.15.99:0/1207586148 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb59c0fce30 0x7fb59c221510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:01.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.280+0000 7fb5a0c00640 1 --2- 172.21.15.99:0/1207586148 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb59c0fb9e0 0x7fb59c161f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:01.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.280+0000 7fb5a0c00640 1 -- 172.21.15.99:0/1207586148 >> 172.21.15.99:0/1207586148 conn(0x7fb59c0d29c0 msgr2=0x7fb59c0d2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:01.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.280+0000 7fb5a0c00640 1 -- 172.21.15.99:0/1207586148 shutdown_connections 2024-02-21T23:13:01.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.280+0000 7fb5a0c00640 1 -- 172.21.15.99:0/1207586148 wait complete. 2024-02-21T23:13:01.292 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-21T23:13:01.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.490+0000 7f070da00640 1 Processor -- start 2024-02-21T23:13:01.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.490+0000 7f070da00640 1 -- start start 2024-02-21T23:13:01.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.492+0000 7f070da00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f070818c3c0 0x7f07080fa600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:01.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.492+0000 7f070da00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f070818a9d0 0x7f070818c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:01.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.492+0000 7f070da00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07080717b0 con 0x7f07080fab40 2024-02-21T23:13:01.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.492+0000 7f070da00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0708189de0 con 0x7f070818a9d0 2024-02-21T23:13:01.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.492+0000 7f070da00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0708071a90 con 0x7f070818c3c0 2024-02-21T23:13:01.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.492+0000 7f0707400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f070818a9d0 0x7f070818c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:01.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.493+0000 7f0707400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f070818a9d0 0x7f070818c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53110/0 (socket says 172.21.15.99:53110) 2024-02-21T23:13:01.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.493+0000 7f0707400640 1 -- 172.21.15.99:0/2103037134 learned_addr learned my addr 172.21.15.99:0/2103037134 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:13:01.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.493+0000 7f0706a00640 1 --2- 172.21.15.99:0/2103037134 >> v2:172.21.15.181:3300/0 conn(0x7f070818c3c0 0x7f07080fa600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:01.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.493+0000 7f0706000640 1 --1- 172.21.15.99:0/2103037134 >> v1:172.21.15.162:6789/0 conn(0x7f07080fab40 0x7f070818a2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.99:45782/0 (socket says 172.21.15.99:45782) 2024-02-21T23:13:01.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.493+0000 7f0706a00640 1 -- 172.21.15.99:0/2103037134 >> v2:172.21.15.99:3300/0 conn(0x7f070818a9d0 msgr2=0x7f070818c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:13:01.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.493+0000 7f0706a00640 1 --2- 172.21.15.99:0/2103037134 >> v2:172.21.15.99:3300/0 conn(0x7f070818a9d0 0x7f070818c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:01.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.493+0000 7f0706a00640 1 -- 172.21.15.99:0/2103037134 >> v1:172.21.15.162:6789/0 conn(0x7f07080fab40 legacy=0x7f070818a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:01.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.493+0000 7f0705600640 1 -- 172.21.15.99:0/2103037134 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1779751109 0 0) 0x7f07080717b0 con 0x7f07080fab40 2024-02-21T23:13:01.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.493+0000 7f0706a00640 1 -- 172.21.15.99:0/2103037134 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0708071d70 con 0x7f070818c3c0 2024-02-21T23:13:01.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.494+0000 7f0706a00640 1 --2- 172.21.15.99:0/2103037134 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f070818c3c0 0x7f07080fa600 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f070806d090 tx=0x7f06f802b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5625e8044cee07c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:01.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.494+0000 7f0705600640 1 -- 172.21.15.99:0/2103037134 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f80315a0 con 0x7f070818c3c0 2024-02-21T23:13:01.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.494+0000 7f0705600640 1 -- 172.21.15.99:0/2103037134 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06f8037070 con 0x7f070818c3c0 2024-02-21T23:13:01.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.495+0000 7f0705600640 1 -- 172.21.15.99:0/2103037134 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f8031960 con 0x7f070818c3c0 2024-02-21T23:13:01.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.495+0000 7f070da00640 1 -- 172.21.15.99:0/2103037134 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f070818c3c0 msgr2=0x7f07080fa600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:01.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.495+0000 7f070da00640 1 --2- 172.21.15.99:0/2103037134 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f070818c3c0 0x7f07080fa600 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f070806d090 tx=0x7f06f802b840 comp rx=0 tx=0).stop 2024-02-21T23:13:01.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.495+0000 7f070da00640 1 -- 172.21.15.99:0/2103037134 shutdown_connections 2024-02-21T23:13:01.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.495+0000 7f070da00640 1 --2- 172.21.15.99:0/2103037134 >> v2:172.21.15.99:3300/0 conn(0x7f070818a9d0 0x7f070818c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:01.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.495+0000 7f070da00640 1 --2- 172.21.15.99:0/2103037134 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f070818c3c0 0x7f07080fa600 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:01.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.495+0000 7f070da00640 1 -- 172.21.15.99:0/2103037134 >> 172.21.15.99:0/2103037134 conn(0x7f07080740b0 msgr2=0x7f07080744c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:01.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.495+0000 7f070da00640 1 -- 172.21.15.99:0/2103037134 shutdown_connections 2024-02-21T23:13:01.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.495+0000 7f070da00640 1 -- 172.21.15.99:0/2103037134 wait complete. 2024-02-21T23:13:01.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.498+0000 7f070da00640 1 Processor -- start 2024-02-21T23:13:01.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.499+0000 7f070da00640 1 -- start start 2024-02-21T23:13:01.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.500+0000 7f070da00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f07080fab40 0x7f07080f82e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:01.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.500+0000 7f070da00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f070818a9d0 0x7f0708175180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:01.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.501+0000 7f070da00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f070818c3c0 0x7f07081756c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:01.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.501+0000 7f070da00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0708072610 con 0x7f07080fab40 2024-02-21T23:13:01.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.501+0000 7f070da00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0708072330 con 0x7f070818c3c0 2024-02-21T23:13:01.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.501+0000 7f070da00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0708183460 con 0x7f070818a9d0 2024-02-21T23:13:01.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.501+0000 7f0706a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f07080fab40 0x7f07080f82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:01.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.501+0000 7f0706a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f07080fab40 0x7f07080f82e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53124/0 (socket says 172.21.15.99:53124) 2024-02-21T23:13:01.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.501+0000 7f0706a00640 1 -- 172.21.15.99:0/1911495469 learned_addr learned my addr 172.21.15.99:0/1911495469 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:13:01.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.501+0000 7f0706000640 1 --2- 172.21.15.99:0/1911495469 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f070818a9d0 0x7f0708175180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:01.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.501+0000 7f0707400640 1 --2- 172.21.15.99:0/1911495469 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f070818c3c0 0x7f07081756c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:01.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.501+0000 7f0706a00640 1 -- 172.21.15.99:0/1911495469 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f070818a9d0 msgr2=0x7f0708175180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:01.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.501+0000 7f0706a00640 1 --2- 172.21.15.99:0/1911495469 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f070818a9d0 0x7f0708175180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:01.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.501+0000 7f0706a00640 1 -- 172.21.15.99:0/1911495469 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f070818c3c0 msgr2=0x7f07081756c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:01.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.501+0000 7f0706a00640 1 --2- 172.21.15.99:0/1911495469 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f070818c3c0 0x7f07081756c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:01.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.501+0000 7f0706a00640 1 -- 172.21.15.99:0/1911495469 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07080d1490 con 0x7f07080fab40 2024-02-21T23:13:01.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.502+0000 7f0706a00640 1 --2- 172.21.15.99:0/1911495469 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f07080fab40 0x7f07080f82e0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f06f8009890 tx=0x7f06f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:01.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.502+0000 7f06fea00640 1 -- 172.21.15.99:0/1911495469 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f8004230 con 0x7f07080fab40 2024-02-21T23:13:01.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.502+0000 7f06fea00640 1 -- 172.21.15.99:0/1911495469 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06f80043d0 con 0x7f07080fab40 2024-02-21T23:13:01.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.502+0000 7f06fea00640 1 -- 172.21.15.99:0/1911495469 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f8003810 con 0x7f07080fab40 2024-02-21T23:13:01.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.502+0000 7f070da00640 1 -- 172.21.15.99:0/1911495469 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07080d1770 con 0x7f07080fab40 2024-02-21T23:13:01.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.502+0000 7f070da00640 1 -- 172.21.15.99:0/1911495469 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07080d1d30 con 0x7f07080fab40 2024-02-21T23:13:01.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.503+0000 7f070da00640 1 -- 172.21.15.99:0/1911495469 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07080d08d0 con 0x7f07080fab40 2024-02-21T23:13:01.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.507+0000 7f06fea00640 1 -- 172.21.15.99:0/1911495469 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f06f80039b0 con 0x7f07080fab40 2024-02-21T23:13:01.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.509+0000 7f06fea00640 1 --2- 172.21.15.99:0/1911495469 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f06e809eed0 0x7f06e80a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:01.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.509+0000 7f06fea00640 1 -- 172.21.15.99:0/1911495469 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f06f802f030 con 0x7f07080fab40 2024-02-21T23:13:01.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.509+0000 7f0706000640 1 --2- 172.21.15.99:0/1911495469 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f06e809eed0 0x7f06e80a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:01.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.510+0000 7f0706000640 1 --2- 172.21.15.99:0/1911495469 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f06e809eed0 0x7f06e80a1390 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0708177720 tx=0x7f06f4007e40 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:01.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.510+0000 7f06fea00640 1 -- 172.21.15.99:0/1911495469 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f06f8041070 con 0x7f07080fab40 2024-02-21T23:13:01.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.710+0000 7f070da00640 1 -- 172.21.15.99:0/1911495469 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f07080fe3f0 con 0x7f07080fab40 2024-02-21T23:13:01.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.711+0000 7f06fea00640 1 -- 172.21.15.99:0/1911495469 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 7 entries v40) v1 ==== 80+0+416 (secure 0 0 0) 0x7f06f80b9f50 con 0x7f07080fab40 2024-02-21T23:13:01.699 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.162:0/612025202 2024-02-22T23:02:14.008014+0000 2024-02-21T23:13:01.699 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.162:0/1516346096 2024-02-22T23:02:14.008014+0000 2024-02-21T23:13:01.699 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.162:0/328516024 2024-02-22T23:02:14.008014+0000 2024-02-21T23:13:01.699 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.162:0/3695581546 2024-02-22T23:02:14.008014+0000 2024-02-21T23:13:01.699 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.162:6801/1717094936 2024-02-22T23:02:14.008014+0000 2024-02-21T23:13:01.700 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.162:0/506228072 2024-02-22T23:02:14.008014+0000 2024-02-21T23:13:01.700 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.162:6800/1717094936 2024-02-22T23:02:14.008014+0000 2024-02-21T23:13:01.701 INFO:teuthology.orchestra.run.smithi099.stderr:listed 7 entries 2024-02-21T23:13:01.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.713+0000 7f070da00640 1 -- 172.21.15.99:0/1911495469 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f06e809eed0 msgr2=0x7f06e80a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:01.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.713+0000 7f070da00640 1 --2- 172.21.15.99:0/1911495469 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f06e809eed0 0x7f06e80a1390 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0708177720 tx=0x7f06f4007e40 comp rx=0 tx=0).stop 2024-02-21T23:13:01.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.713+0000 7f070da00640 1 -- 172.21.15.99:0/1911495469 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f07080fab40 msgr2=0x7f07080f82e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:01.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.713+0000 7f070da00640 1 --2- 172.21.15.99:0/1911495469 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f07080fab40 0x7f07080f82e0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f06f8009890 tx=0x7f06f80046c0 comp rx=0 tx=0).stop 2024-02-21T23:13:01.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.713+0000 7f070da00640 1 -- 172.21.15.99:0/1911495469 shutdown_connections 2024-02-21T23:13:01.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.713+0000 7f070da00640 1 --2- 172.21.15.99:0/1911495469 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f06e809eed0 0x7f06e80a1390 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:01.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.713+0000 7f070da00640 1 --2- 172.21.15.99:0/1911495469 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f070818c3c0 0x7f07081756c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:01.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.713+0000 7f070da00640 1 --2- 172.21.15.99:0/1911495469 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f070818a9d0 0x7f0708175180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:01.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.713+0000 7f070da00640 1 --2- 172.21.15.99:0/1911495469 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f07080fab40 0x7f07080f82e0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:01.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.713+0000 7f070da00640 1 -- 172.21.15.99:0/1911495469 >> 172.21.15.99:0/1911495469 conn(0x7f07080740b0 msgr2=0x7f07080fa390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:01.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.713+0000 7f070da00640 1 -- 172.21.15.99:0/1911495469 shutdown_connections 2024-02-21T23:13:01.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:01.713+0000 7f070da00640 1 -- 172.21.15.99:0/1911495469 wait complete. 2024-02-21T23:13:01.717 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-02-21T23:13:01.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T23:13:01.718 DEBUG:teuthology.orchestra.run.smithi099:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-02-21T23:13:01.899 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi099.front.sepia.ceph.com 2024-02-21T23:13:01.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T23:13:01.900 DEBUG:teuthology.orchestra.run.smithi099:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-02-21T23:13:01.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T23:13:01.951 DEBUG:teuthology.orchestra.run.smithi099:> ip netns list 2024-02-21T23:13:01.987 INFO:teuthology.orchestra.run.smithi099.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-02-21T23:13:01.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T23:13:01.988 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-21T23:13:02.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-21T23:13:02.104 DEBUG:teuthology.orchestra.run.smithi099:> sudo ip link delete ceph-brx 2024-02-21T23:13:02.207 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-02-21T23:13:02.220 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-02-21T23:13:02.220 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-21T23:13:02.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.422+0000 7fc336000640 1 Processor -- start 2024-02-21T23:13:02.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.422+0000 7fc336000640 1 -- start start 2024-02-21T23:13:02.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.425+0000 7fc336000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3300f2b00 con 0x7fc33018ca00 2024-02-21T23:13:02.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.425+0000 7fc336000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3301865a0 con 0x7fc3300f3cb0 2024-02-21T23:13:02.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.425+0000 7fc336000640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc33018ce60 con 0x7fc3301861c0 2024-02-21T23:13:02.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.426+0000 7fc334c00640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fc3301861c0 0x7fc33018c2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:58190/0 (socket says 172.21.15.99:58190) 2024-02-21T23:13:02.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.426+0000 7fc334c00640 1 -- 172.21.15.99:0/1180115503 learned_addr learned my addr 172.21.15.99:0/1180115503 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:13:02.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.426+0000 7fc32f400640 1 -- 172.21.15.99:0/1180115503 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 686722777 0 0) 0x7fc33018ce60 con 0x7fc3301861c0 2024-02-21T23:13:02.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.426+0000 7fc32f400640 1 -- 172.21.15.99:0/1180115503 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc318003520 con 0x7fc3301861c0 2024-02-21T23:13:02.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.426+0000 7fc32f400640 1 -- 172.21.15.99:0/1180115503 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3543926177 0 0) 0x7fc3301865a0 con 0x7fc3300f3cb0 2024-02-21T23:13:02.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.426+0000 7fc32f400640 1 -- 172.21.15.99:0/1180115503 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc33018ce60 con 0x7fc3300f3cb0 2024-02-21T23:13:02.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.426+0000 7fc32f400640 1 -- 172.21.15.99:0/1180115503 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2937590845 0 0) 0x7fc3300f2b00 con 0x7fc33018ca00 2024-02-21T23:13:02.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.426+0000 7fc32f400640 1 -- 172.21.15.99:0/1180115503 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3301865a0 con 0x7fc33018ca00 2024-02-21T23:13:02.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.426+0000 7fc32f400640 1 -- 172.21.15.99:0/1180115503 <== mon.2 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2293799404 0 0) 0x7fc318003520 con 0x7fc3301861c0 2024-02-21T23:13:02.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.426+0000 7fc32f400640 1 -- 172.21.15.99:0/1180115503 >> v1:172.21.15.162:6789/0 conn(0x7fc3300f3cb0 legacy=0x7fc3300cb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:02.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.426+0000 7fc32f400640 1 -- 172.21.15.99:0/1180115503 >> v1:172.21.15.99:6789/0 conn(0x7fc33018ca00 legacy=0x7fc3300f35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:02.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.426+0000 7fc32f400640 1 -- 172.21.15.99:0/1180115503 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3300cc950 con 0x7fc3301861c0 2024-02-21T23:13:02.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.426+0000 7fc32f400640 1 -- 172.21.15.99:0/1180115503 <== mon.2 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2069890144 0 0) 0x7fc324001670 con 0x7fc3301861c0 2024-02-21T23:13:02.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.427+0000 7fc32f400640 1 -- 172.21.15.99:0/1180115503 >> v1:172.21.15.181:6789/0 conn(0x7fc3301861c0 legacy=0x7fc33018c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:02.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.427+0000 7fc32f400640 1 --2- 172.21.15.99:0/1180115503 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc318003d70 0x7fc318004150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:02.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.427+0000 7fc32f400640 1 --2- 172.21.15.99:0/1180115503 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc318004850 0x7fc318004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:02.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.427+0000 7fc32f400640 1 --2- 172.21.15.99:0/1180115503 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc3180053e0 0x7fc31800ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:02.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.427+0000 7fc32f400640 1 -- 172.21.15.99:0/1180115503 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc31800c2d0 con 0x7fc3180053e0 2024-02-21T23:13:02.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.427+0000 7fc32f400640 1 -- 172.21.15.99:0/1180115503 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc31800c480 con 0x7fc318003d70 2024-02-21T23:13:02.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.427+0000 7fc32f400640 1 -- 172.21.15.99:0/1180115503 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc31800c680 con 0x7fc318004850 2024-02-21T23:13:02.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.427+0000 7fc334c00640 1 --2- 172.21.15.99:0/1180115503 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc318003d70 0x7fc318004150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:02.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.427+0000 7fc32fe00640 1 --2- 172.21.15.99:0/1180115503 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc318004850 0x7fc318004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:02.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.427+0000 7fc335600640 1 --2- 172.21.15.99:0/1180115503 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc3180053e0 0x7fc31800ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:02.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.427+0000 7fc334c00640 1 -- 172.21.15.99:0/1180115503 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc318004850 msgr2=0x7fc318004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:13:02.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.427+0000 7fc334c00640 1 --2- 172.21.15.99:0/1180115503 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc318004850 0x7fc318004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:02.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.427+0000 7fc334c00640 1 -- 172.21.15.99:0/1180115503 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc3180053e0 msgr2=0x7fc31800ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:13:02.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.427+0000 7fc334c00640 1 --2- 172.21.15.99:0/1180115503 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc3180053e0 0x7fc31800ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:02.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.427+0000 7fc334c00640 1 -- 172.21.15.99:0/1180115503 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc318003520 con 0x7fc318003d70 2024-02-21T23:13:02.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.427+0000 7fc335600640 1 -- 172.21.15.99:0/1180115503 reap_dead start 2024-02-21T23:13:02.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.429+0000 7fc334c00640 1 --2- 172.21.15.99:0/1180115503 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc318003d70 0x7fc318004150 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fc324007fc0 tx=0x7fc318005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=392aee3c7e5290ed server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:02.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.429+0000 7fc32f400640 1 -- 172.21.15.99:0/1180115503 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc324007be0 con 0x7fc318003d70 2024-02-21T23:13:02.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.429+0000 7fc32f400640 1 -- 172.21.15.99:0/1180115503 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc324030070 con 0x7fc318003d70 2024-02-21T23:13:02.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.429+0000 7fc32f400640 1 -- 172.21.15.99:0/1180115503 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc324005d70 con 0x7fc318003d70 2024-02-21T23:13:02.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.430+0000 7fc336000640 1 -- 172.21.15.99:0/1180115503 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc318003d70 msgr2=0x7fc318004150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:02.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.430+0000 7fc336000640 1 --2- 172.21.15.99:0/1180115503 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc318003d70 0x7fc318004150 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fc324007fc0 tx=0x7fc318005830 comp rx=0 tx=0).stop 2024-02-21T23:13:02.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.430+0000 7fc336000640 1 -- 172.21.15.99:0/1180115503 shutdown_connections 2024-02-21T23:13:02.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.430+0000 7fc336000640 1 --2- 172.21.15.99:0/1180115503 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc318003d70 0x7fc318004150 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:02.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.430+0000 7fc336000640 1 -- 172.21.15.99:0/1180115503 >> 172.21.15.99:0/1180115503 conn(0x7fc33008cfd0 msgr2=0x7fc33008d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:02.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.430+0000 7fc336000640 1 -- 172.21.15.99:0/1180115503 shutdown_connections 2024-02-21T23:13:02.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.430+0000 7fc336000640 1 -- 172.21.15.99:0/1180115503 wait complete. 2024-02-21T23:13:02.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.432+0000 7fc336000640 1 Processor -- start 2024-02-21T23:13:02.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.433+0000 7fc336000640 1 -- start start 2024-02-21T23:13:02.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.434+0000 7fc336000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc318003d70 0x7fc33016f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:02.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.434+0000 7fc336000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc330177800 0x7fc330177c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:02.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.434+0000 7fc336000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc33021d4d0 0x7fc33021d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:02.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.434+0000 7fc336000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3300ccf10 con 0x7fc318003d70 2024-02-21T23:13:02.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.434+0000 7fc336000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3300f2da0 con 0x7fc33021d4d0 2024-02-21T23:13:02.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.434+0000 7fc336000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3301783b0 con 0x7fc330177800 2024-02-21T23:13:02.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.434+0000 7fc334c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc318003d70 0x7fc33016f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:02.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.434+0000 7fc334c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc318003d70 0x7fc33016f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53150/0 (socket says 172.21.15.99:53150) 2024-02-21T23:13:02.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.434+0000 7fc334c00640 1 -- 172.21.15.99:0/1636985528 learned_addr learned my addr 172.21.15.99:0/1636985528 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:13:02.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.434+0000 7fc32fe00640 1 --2- 172.21.15.99:0/1636985528 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc330177800 0x7fc330177c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:02.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.434+0000 7fc335600640 1 --2- 172.21.15.99:0/1636985528 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc33021d4d0 0x7fc33021d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:02.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.435+0000 7fc32fe00640 1 -- 172.21.15.99:0/1636985528 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc33021d4d0 msgr2=0x7fc33021d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:02.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.435+0000 7fc32fe00640 1 --2- 172.21.15.99:0/1636985528 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc33021d4d0 0x7fc33021d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:02.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.435+0000 7fc32fe00640 1 -- 172.21.15.99:0/1636985528 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc318003d70 msgr2=0x7fc33016f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:02.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.435+0000 7fc32fe00640 1 --2- 172.21.15.99:0/1636985528 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc318003d70 0x7fc33016f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:02.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.435+0000 7fc32fe00640 1 -- 172.21.15.99:0/1636985528 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc330178690 con 0x7fc330177800 2024-02-21T23:13:02.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.435+0000 7fc334c00640 1 --2- 172.21.15.99:0/1636985528 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc318003d70 0x7fc33016f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:13:02.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.435+0000 7fc32fe00640 1 --2- 172.21.15.99:0/1636985528 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc330177800 0x7fc330177c80 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fc330050b90 tx=0x7fc31c00fb40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:02.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.435+0000 7fc32cc00640 1 -- 172.21.15.99:0/1636985528 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31c00fe80 con 0x7fc330177800 2024-02-21T23:13:02.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.435+0000 7fc32cc00640 1 -- 172.21.15.99:0/1636985528 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc31c018070 con 0x7fc330177800 2024-02-21T23:13:02.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.435+0000 7fc32cc00640 1 -- 172.21.15.99:0/1636985528 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31c005310 con 0x7fc330177800 2024-02-21T23:13:02.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.435+0000 7fc336000640 1 -- 172.21.15.99:0/1636985528 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc330178970 con 0x7fc330177800 2024-02-21T23:13:02.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.436+0000 7fc336000640 1 -- 172.21.15.99:0/1636985528 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc33021ccd0 con 0x7fc330177800 2024-02-21T23:13:02.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.437+0000 7fc336000640 1 -- 172.21.15.99:0/1636985528 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc330068320 con 0x7fc330177800 2024-02-21T23:13:02.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.438+0000 7fc32cc00640 1 -- 172.21.15.99:0/1636985528 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7fc31c00d6b0 con 0x7fc330177800 2024-02-21T23:13:02.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.439+0000 7fc32cc00640 1 --2- 172.21.15.99:0/1636985528 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fc31009eed0 0x7fc3100a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:02.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.440+0000 7fc32cc00640 1 -- 172.21.15.99:0/1636985528 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 8877+0+0 (secure 0 0 0) 0x7fc31c0c9ca0 con 0x7fc330177800 2024-02-21T23:13:02.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.440+0000 7fc334c00640 1 --2- 172.21.15.99:0/1636985528 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fc31009eed0 0x7fc3100a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:02.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.440+0000 7fc334c00640 1 --2- 172.21.15.99:0/1636985528 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fc31009eed0 0x7fc3100a1390 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc324000fb0 tx=0x7fc324009030 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:02.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.443+0000 7fc32cc00640 1 -- 172.21.15.99:0/1636985528 <== mon.2 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fc31c097bf0 con 0x7fc330177800 2024-02-21T23:13:02.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.741+0000 7fc336000640 1 -- 172.21.15.99:0/1636985528 --> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc3300cb770 con 0x7fc31009eed0 2024-02-21T23:13:02.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.751+0000 7fc32cc00640 1 -- 172.21.15.99:0/1636985528 <== mgr.5131 v2:172.21.15.162:6800/631076050 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+342680 (secure 0 0 0) 0x7fc3300cb770 con 0x7fc31009eed0 2024-02-21T23:13:02.741 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T23:13:02.746 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-02-21T23:13:02.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.760+0000 7fc336000640 1 -- 172.21.15.99:0/1636985528 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fc31009eed0 msgr2=0x7fc3100a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:02.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.760+0000 7fc336000640 1 --2- 172.21.15.99:0/1636985528 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fc31009eed0 0x7fc3100a1390 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc324000fb0 tx=0x7fc324009030 comp rx=0 tx=0).stop 2024-02-21T23:13:02.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.760+0000 7fc336000640 1 -- 172.21.15.99:0/1636985528 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc330177800 msgr2=0x7fc330177c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:02.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.760+0000 7fc336000640 1 --2- 172.21.15.99:0/1636985528 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc330177800 0x7fc330177c80 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fc330050b90 tx=0x7fc31c00fb40 comp rx=0 tx=0).stop 2024-02-21T23:13:02.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.760+0000 7fc336000640 1 -- 172.21.15.99:0/1636985528 shutdown_connections 2024-02-21T23:13:02.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.760+0000 7fc336000640 1 --2- 172.21.15.99:0/1636985528 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fc31009eed0 0x7fc3100a1390 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:02.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.760+0000 7fc336000640 1 --2- 172.21.15.99:0/1636985528 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc33021d4d0 0x7fc33021d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:02.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.760+0000 7fc336000640 1 --2- 172.21.15.99:0/1636985528 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc330177800 0x7fc330177c80 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:02.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.760+0000 7fc336000640 1 --2- 172.21.15.99:0/1636985528 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc318003d70 0x7fc33016f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:02.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.760+0000 7fc336000640 1 -- 172.21.15.99:0/1636985528 >> 172.21.15.99:0/1636985528 conn(0x7fc33008cfd0 msgr2=0x7fc3300f8df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:02.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.760+0000 7fc336000640 1 -- 172.21.15.99:0/1636985528 shutdown_connections 2024-02-21T23:13:02.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:02.760+0000 7fc336000640 1 -- 172.21.15.99:0/1636985528 wait complete. 2024-02-21T23:13:02.767 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":335,"stamp":"2024-02-21T23:13:02.221630+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":88024435,"num_objects":3718,"num_object_clones":0,"num_object_copies":14334,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3718,"num_whiteouts":0,"num_read":6823,"num_read_kb":64138,"num_write":12118,"num_write_kb":110997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":221,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16310,"ondisk_log_size":16310,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1132462080,"kb_used":561516,"kb_used_data":120804,"kb_used_omap":18,"kb_used_meta":440557,"kb_avail":1131900564,"statfs":{"total":1159641169920,"available":1159066177536,"internally_reserved":0,"allocated":123703296,"data_stored":224468500,"data_compressed":23090928,"data_compressed_allocated":29089792,"data_compressed_original":133033984,"omap_allocated":19138,"internal_metadata":451130686},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":30,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003462"},"pg_stats":[{"pgid":"2.1f","version":"32'20","reported_seq":96,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.157454+0000","last_change":"2024-02-21T23:01:02.208441+0000","last_active":"2024-02-21T23:12:15.157454+0000","last_peered":"2024-02-21T23:12:15.157454+0000","last_clean":"2024-02-21T23:12:15.157454+0000","last_became_active":"2024-02-21T23:01:02.208124+0000","last_became_peered":"2024-02-21T23:01:02.208124+0000","last_unstale":"2024-02-21T23:12:15.157454+0000","last_undegraded":"2024-02-21T23:12:15.157454+0000","last_fullsized":"2024-02-21T23:12:15.157454+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:21:29.919968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":27,"num_read_kb":4118,"num_write":27,"num_write_kb":4186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7],"acting":[9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"32'57","reported_seq":140,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.826448+0000","last_change":"2024-02-21T23:12:08.621080+0000","last_active":"2024-02-21T23:12:14.826448+0000","last_peered":"2024-02-21T23:12:14.826448+0000","last_clean":"2024-02-21T23:12:14.826448+0000","last_became_active":"2024-02-21T23:01:03.214170+0000","last_became_peered":"2024-02-21T23:01:03.214170+0000","last_unstale":"2024-02-21T23:12:14.826448+0000","last_undegraded":"2024-02-21T23:12:14.826448+0000","last_fullsized":"2024-02-21T23:12:14.826448+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:51:26.354389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010343064000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"35'364","reported_seq":424,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.821913+0000","last_change":"2024-02-21T23:12:08.712606+0000","last_active":"2024-02-21T23:12:14.821913+0000","last_peered":"2024-02-21T23:12:14.821913+0000","last_clean":"2024-02-21T23:12:14.821913+0000","last_became_active":"2024-02-21T23:01:07.276192+0000","last_became_peered":"2024-02-21T23:01:07.276192+0000","last_unstale":"2024-02-21T23:12:14.821913+0000","last_undegraded":"2024-02-21T23:12:14.821913+0000","last_fullsized":"2024-02-21T23:12:14.821913+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:31:37.375726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0031732990000000001,"stat_sum":{"num_bytes":264461,"num_objects":111,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":111,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":325,"num_write_kb":605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"32'19","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.826733+0000","last_change":"2024-02-21T23:01:02.221231+0000","last_active":"2024-02-21T23:12:14.826733+0000","last_peered":"2024-02-21T23:12:14.826733+0000","last_clean":"2024-02-21T23:12:14.826733+0000","last_became_active":"2024-02-21T23:01:02.220941+0000","last_became_peered":"2024-02-21T23:01:02.220941+0000","last_unstale":"2024-02-21T23:12:14.826733+0000","last_undegraded":"2024-02-21T23:12:14.826733+0000","last_fullsized":"2024-02-21T23:12:14.826733+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:17:06.353018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":17,"num_read_kb":4097,"num_write":22,"num_write_kb":4218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"32'51","reported_seq":134,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.960486+0000","last_change":"2024-02-21T23:12:08.706819+0000","last_active":"2024-02-21T23:12:14.960486+0000","last_peered":"2024-02-21T23:12:14.960486+0000","last_clean":"2024-02-21T23:12:14.960486+0000","last_became_active":"2024-02-21T23:01:03.219221+0000","last_became_peered":"2024-02-21T23:01:03.219221+0000","last_unstale":"2024-02-21T23:12:14.960486+0000","last_undegraded":"2024-02-21T23:12:14.960486+0000","last_fullsized":"2024-02-21T23:12:14.960486+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:13:25.637195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0047645949999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"35'354","reported_seq":414,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.822432+0000","last_change":"2024-02-21T23:12:08.715099+0000","last_active":"2024-02-21T23:12:14.822432+0000","last_peered":"2024-02-21T23:12:14.822432+0000","last_clean":"2024-02-21T23:12:14.822432+0000","last_became_active":"2024-02-21T23:01:07.268179+0000","last_became_peered":"2024-02-21T23:01:07.268179+0000","last_unstale":"2024-02-21T23:12:14.822432+0000","last_undegraded":"2024-02-21T23:12:14.822432+0000","last_fullsized":"2024-02-21T23:12:14.822432+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:12:49.052079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0062260340000000001,"stat_sum":{"num_bytes":615017,"num_objects":99,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":321,"num_write_kb":926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"32'21","reported_seq":94,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.062972+0000","last_change":"2024-02-21T23:01:02.208687+0000","last_active":"2024-02-21T23:12:15.062972+0000","last_peered":"2024-02-21T23:12:15.062972+0000","last_clean":"2024-02-21T23:12:15.062972+0000","last_became_active":"2024-02-21T23:01:02.208393+0000","last_became_peered":"2024-02-21T23:01:02.208393+0000","last_unstale":"2024-02-21T23:12:15.062972+0000","last_undegraded":"2024-02-21T23:12:15.062972+0000","last_fullsized":"2024-02-21T23:12:15.062972+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:41:54.477462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":25,"num_read_kb":8200,"num_write":25,"num_write_kb":8264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"32'66","reported_seq":148,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.240958+0000","last_change":"2024-02-21T23:12:08.608463+0000","last_active":"2024-02-21T23:12:15.240958+0000","last_peered":"2024-02-21T23:12:15.240958+0000","last_clean":"2024-02-21T23:12:15.240958+0000","last_became_active":"2024-02-21T23:01:03.214733+0000","last_became_peered":"2024-02-21T23:01:03.214733+0000","last_unstale":"2024-02-21T23:12:15.240958+0000","last_undegraded":"2024-02-21T23:12:15.240958+0000","last_fullsized":"2024-02-21T23:12:15.240958+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:37:38.558922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002499476,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"35'356","reported_seq":414,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.823223+0000","last_change":"2024-02-21T23:12:08.716734+0000","last_active":"2024-02-21T23:12:14.823223+0000","last_peered":"2024-02-21T23:12:14.823223+0000","last_clean":"2024-02-21T23:12:14.823223+0000","last_became_active":"2024-02-21T23:01:07.279360+0000","last_became_peered":"2024-02-21T23:01:07.279360+0000","last_unstale":"2024-02-21T23:12:14.823223+0000","last_undegraded":"2024-02-21T23:12:14.823223+0000","last_fullsized":"2024-02-21T23:12:14.823223+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":356,"log_dups_size":0,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:01:04.348854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0065566699999999997,"stat_sum":{"num_bytes":1138317,"num_objects":111,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":111,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":317,"num_write_kb":1526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"32'11","reported_seq":59,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.062765+0000","last_change":"2024-02-21T23:01:02.204774+0000","last_active":"2024-02-21T23:12:15.062765+0000","last_peered":"2024-02-21T23:12:15.062765+0000","last_clean":"2024-02-21T23:12:15.062765+0000","last_became_active":"2024-02-21T23:01:02.203992+0000","last_became_peered":"2024-02-21T23:01:02.203992+0000","last_unstale":"2024-02-21T23:12:15.062765+0000","last_undegraded":"2024-02-21T23:12:15.062765+0000","last_fullsized":"2024-02-21T23:12:15.062765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:27:54.333439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1],"acting":[8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"32'56","reported_seq":138,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.972421+0000","last_change":"2024-02-21T23:12:08.673470+0000","last_active":"2024-02-21T23:12:14.972421+0000","last_peered":"2024-02-21T23:12:14.972421+0000","last_clean":"2024-02-21T23:12:14.972421+0000","last_became_active":"2024-02-21T23:01:03.212702+0000","last_became_peered":"2024-02-21T23:01:03.212702+0000","last_unstale":"2024-02-21T23:12:14.972421+0000","last_undegraded":"2024-02-21T23:12:14.972421+0000","last_fullsized":"2024-02-21T23:12:14.972421+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:11:24.214077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003245398,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"35'320","reported_seq":383,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.822700+0000","last_change":"2024-02-21T23:12:08.711329+0000","last_active":"2024-02-21T23:12:14.822700+0000","last_peered":"2024-02-21T23:12:14.822700+0000","last_clean":"2024-02-21T23:12:14.822700+0000","last_became_active":"2024-02-21T23:01:07.268357+0000","last_became_peered":"2024-02-21T23:01:07.268357+0000","last_unstale":"2024-02-21T23:12:14.822700+0000","last_undegraded":"2024-02-21T23:12:14.822700+0000","last_fullsized":"2024-02-21T23:12:14.822700+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:44:32.467350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024180849999999999,"stat_sum":{"num_bytes":206516,"num_objects":100,"num_object_clones":0,"num_object_copies":400,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":290,"num_write_kb":521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"32'53","reported_seq":136,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.348758+0000","last_change":"2024-02-21T23:12:08.716291+0000","last_active":"2024-02-21T23:12:15.348758+0000","last_peered":"2024-02-21T23:12:15.348758+0000","last_clean":"2024-02-21T23:12:15.348758+0000","last_became_active":"2024-02-21T23:01:03.213186+0000","last_became_peered":"2024-02-21T23:01:03.213186+0000","last_unstale":"2024-02-21T23:12:15.348758+0000","last_undegraded":"2024-02-21T23:12:15.348758+0000","last_fullsized":"2024-02-21T23:12:15.348758+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:23:47.543277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0056316350000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"32'38","reported_seq":104,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.062681+0000","last_change":"2024-02-21T23:01:02.208608+0000","last_active":"2024-02-21T23:12:15.062681+0000","last_peered":"2024-02-21T23:12:15.062681+0000","last_clean":"2024-02-21T23:12:15.062681+0000","last_became_active":"2024-02-21T23:01:02.208293+0000","last_became_peered":"2024-02-21T23:01:02.208293+0000","last_unstale":"2024-02-21T23:12:15.062681+0000","last_undegraded":"2024-02-21T23:12:15.062681+0000","last_fullsized":"2024-02-21T23:12:15.062681+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:58:23.554457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":4101,"num_write":38,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"35'339","reported_seq":398,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.822932+0000","last_change":"2024-02-21T23:12:08.715626+0000","last_active":"2024-02-21T23:12:14.822932+0000","last_peered":"2024-02-21T23:12:14.822932+0000","last_clean":"2024-02-21T23:12:14.822932+0000","last_became_active":"2024-02-21T23:01:07.651241+0000","last_became_peered":"2024-02-21T23:01:07.651241+0000","last_unstale":"2024-02-21T23:12:14.822932+0000","last_undegraded":"2024-02-21T23:12:14.822932+0000","last_fullsized":"2024-02-21T23:12:14.822932+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:51:30.402466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0063569689999999996,"stat_sum":{"num_bytes":696245,"num_objects":110,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":302,"num_write_kb":1168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"32'59","reported_seq":142,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.826174+0000","last_change":"2024-02-21T23:12:08.620654+0000","last_active":"2024-02-21T23:12:14.826174+0000","last_peered":"2024-02-21T23:12:14.826174+0000","last_clean":"2024-02-21T23:12:14.826174+0000","last_became_active":"2024-02-21T23:01:03.219898+0000","last_became_peered":"2024-02-21T23:01:03.219898+0000","last_unstale":"2024-02-21T23:12:14.826174+0000","last_undegraded":"2024-02-21T23:12:14.826174+0000","last_fullsized":"2024-02-21T23:12:14.826174+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:01:36.467676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0098155299999999994,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"32'34","reported_seq":83,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.821840+0000","last_change":"2024-02-21T23:01:02.202866+0000","last_active":"2024-02-21T23:12:14.821840+0000","last_peered":"2024-02-21T23:12:14.821840+0000","last_clean":"2024-02-21T23:12:14.821840+0000","last_became_active":"2024-02-21T23:01:02.202585+0000","last_became_peered":"2024-02-21T23:01:02.202585+0000","last_unstale":"2024-02-21T23:12:14.821840+0000","last_undegraded":"2024-02-21T23:12:14.821840+0000","last_fullsized":"2024-02-21T23:12:14.821840+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:26:49.911102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"35'375","reported_seq":431,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.823213+0000","last_change":"2024-02-21T23:12:08.716762+0000","last_active":"2024-02-21T23:12:14.823213+0000","last_peered":"2024-02-21T23:12:14.823213+0000","last_clean":"2024-02-21T23:12:14.823213+0000","last_became_active":"2024-02-21T23:01:07.276577+0000","last_became_peered":"2024-02-21T23:01:07.276577+0000","last_unstale":"2024-02-21T23:12:14.823213+0000","last_undegraded":"2024-02-21T23:12:14.823213+0000","last_fullsized":"2024-02-21T23:12:14.823213+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:21:46.661574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0075563849999999997,"stat_sum":{"num_bytes":317135,"num_objects":109,"num_object_clones":0,"num_object_copies":436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":331,"num_write_kb":822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"32'59","reported_seq":142,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.627470+0000","last_change":"2024-02-21T23:12:08.667773+0000","last_active":"2024-02-21T23:12:15.627470+0000","last_peered":"2024-02-21T23:12:15.627470+0000","last_clean":"2024-02-21T23:12:15.627470+0000","last_became_active":"2024-02-21T23:01:03.218706+0000","last_became_peered":"2024-02-21T23:01:03.218706+0000","last_unstale":"2024-02-21T23:12:15.627470+0000","last_undegraded":"2024-02-21T23:12:15.627470+0000","last_fullsized":"2024-02-21T23:12:15.627470+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:11:24.214077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040903179999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"32'13","reported_seq":62,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.825654+0000","last_change":"2024-02-21T23:01:02.208912+0000","last_active":"2024-02-21T23:12:14.825654+0000","last_peered":"2024-02-21T23:12:14.825654+0000","last_clean":"2024-02-21T23:12:14.825654+0000","last_became_active":"2024-02-21T23:01:02.208542+0000","last_became_peered":"2024-02-21T23:01:02.208542+0000","last_unstale":"2024-02-21T23:12:14.825654+0000","last_undegraded":"2024-02-21T23:12:14.825654+0000","last_fullsized":"2024-02-21T23:12:14.825654+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:02:11.724233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9],"acting":[3,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"35'342","reported_seq":395,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.157292+0000","last_change":"2024-02-21T23:12:08.615509+0000","last_active":"2024-02-21T23:12:15.157292+0000","last_peered":"2024-02-21T23:12:15.157292+0000","last_clean":"2024-02-21T23:12:15.157292+0000","last_became_active":"2024-02-21T23:01:07.282506+0000","last_became_peered":"2024-02-21T23:01:07.282506+0000","last_unstale":"2024-02-21T23:12:15.157292+0000","last_undegraded":"2024-02-21T23:12:15.157292+0000","last_fullsized":"2024-02-21T23:12:15.157292+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:47:32.010203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.005933649,"stat_sum":{"num_bytes":321892,"num_objects":112,"num_object_clones":0,"num_object_copies":448,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":112,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":294,"num_write_kb":916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"32'47","reported_seq":130,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.062393+0000","last_change":"2024-02-21T23:12:08.713493+0000","last_active":"2024-02-21T23:12:15.062393+0000","last_peered":"2024-02-21T23:12:15.062393+0000","last_clean":"2024-02-21T23:12:15.062393+0000","last_became_active":"2024-02-21T23:01:03.211919+0000","last_became_peered":"2024-02-21T23:01:03.211919+0000","last_unstale":"2024-02-21T23:12:15.062393+0000","last_undegraded":"2024-02-21T23:12:15.062393+0000","last_fullsized":"2024-02-21T23:12:15.062393+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:47:27.962126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040799440000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"32'11","reported_seq":60,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.240916+0000","last_change":"2024-02-21T23:01:02.204071+0000","last_active":"2024-02-21T23:12:15.240916+0000","last_peered":"2024-02-21T23:12:15.240916+0000","last_clean":"2024-02-21T23:12:15.240916+0000","last_became_active":"2024-02-21T23:01:02.203761+0000","last_became_peered":"2024-02-21T23:01:02.203761+0000","last_unstale":"2024-02-21T23:12:15.240916+0000","last_undegraded":"2024-02-21T23:12:15.240916+0000","last_fullsized":"2024-02-21T23:12:15.240916+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:58:34.737670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"35'297","reported_seq":366,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.823041+0000","last_change":"2024-02-21T23:12:08.713241+0000","last_active":"2024-02-21T23:12:14.823041+0000","last_peered":"2024-02-21T23:12:14.823041+0000","last_clean":"2024-02-21T23:12:14.823041+0000","last_became_active":"2024-02-21T23:01:50.570965+0000","last_became_peered":"2024-02-21T23:01:50.570965+0000","last_unstale":"2024-02-21T23:12:14.823041+0000","last_undegraded":"2024-02-21T23:12:14.823041+0000","last_fullsized":"2024-02-21T23:12:14.823041+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:11:28.262155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042670420000000004,"stat_sum":{"num_bytes":200353,"num_objects":99,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":263,"num_write_kb":684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,10,9],"acting":[4,8,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"32'57","reported_seq":140,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.960621+0000","last_change":"2024-02-21T23:12:08.706090+0000","last_active":"2024-02-21T23:12:14.960621+0000","last_peered":"2024-02-21T23:12:14.960621+0000","last_clean":"2024-02-21T23:12:14.960621+0000","last_became_active":"2024-02-21T23:01:03.229873+0000","last_became_peered":"2024-02-21T23:01:03.229873+0000","last_unstale":"2024-02-21T23:12:14.960621+0000","last_undegraded":"2024-02-21T23:12:14.960621+0000","last_fullsized":"2024-02-21T23:12:14.960621+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:54:40.544963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.004035584,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"32'14","reported_seq":63,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.823102+0000","last_change":"2024-02-21T23:01:02.206586+0000","last_active":"2024-02-21T23:12:14.823102+0000","last_peered":"2024-02-21T23:12:14.823102+0000","last_clean":"2024-02-21T23:12:14.823102+0000","last_became_active":"2024-02-21T23:01:02.206230+0000","last_became_peered":"2024-02-21T23:01:02.206230+0000","last_unstale":"2024-02-21T23:12:14.823102+0000","last_undegraded":"2024-02-21T23:12:14.823102+0000","last_fullsized":"2024-02-21T23:12:14.823102+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:21:29.919968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11],"acting":[4,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"35'358","reported_seq":416,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.821522+0000","last_change":"2024-02-21T23:12:08.714187+0000","last_active":"2024-02-21T23:12:14.821522+0000","last_peered":"2024-02-21T23:12:14.821522+0000","last_clean":"2024-02-21T23:12:14.821522+0000","last_became_active":"2024-02-21T23:01:07.251670+0000","last_became_peered":"2024-02-21T23:01:07.251670+0000","last_unstale":"2024-02-21T23:12:14.821522+0000","last_undegraded":"2024-02-21T23:12:14.821522+0000","last_fullsized":"2024-02-21T23:12:14.821522+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:53:36.897051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.004207176,"stat_sum":{"num_bytes":4398222,"num_objects":112,"num_object_clones":0,"num_object_copies":448,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":112,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":314,"num_write_kb":4681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"32'56","reported_seq":139,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.827050+0000","last_change":"2024-02-21T23:12:08.621679+0000","last_active":"2024-02-21T23:12:14.827050+0000","last_peered":"2024-02-21T23:12:14.827050+0000","last_clean":"2024-02-21T23:12:14.827050+0000","last_became_active":"2024-02-21T23:01:03.206892+0000","last_became_peered":"2024-02-21T23:01:03.206892+0000","last_unstale":"2024-02-21T23:12:14.827050+0000","last_undegraded":"2024-02-21T23:12:14.827050+0000","last_fullsized":"2024-02-21T23:12:14.827050+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:21:42.613496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010016761000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"40'439","reported_seq":928,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:18.728492+0000","last_change":"2024-02-21T23:01:02.209850+0000","last_active":"2024-02-21T23:12:18.728492+0000","last_peered":"2024-02-21T23:12:18.728492+0000","last_clean":"2024-02-21T23:12:18.728492+0000","last_became_active":"2024-02-21T23:01:02.209601+0000","last_became_peered":"2024-02-21T23:01:02.209601+0000","last_unstale":"2024-02-21T23:12:18.728492+0000","last_undegraded":"2024-02-21T23:12:18.728492+0000","last_fullsized":"2024-02-21T23:12:18.728492+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:36:44.497886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1472,"num_read_kb":1321,"num_write":854,"num_write_kb":4014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"35'354","reported_seq":413,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.824941+0000","last_change":"2024-02-21T23:12:08.617892+0000","last_active":"2024-02-21T23:12:14.824941+0000","last_peered":"2024-02-21T23:12:14.824941+0000","last_clean":"2024-02-21T23:12:14.824941+0000","last_became_active":"2024-02-21T23:01:07.651431+0000","last_became_peered":"2024-02-21T23:01:07.651431+0000","last_unstale":"2024-02-21T23:12:14.824941+0000","last_undegraded":"2024-02-21T23:12:14.824941+0000","last_fullsized":"2024-02-21T23:12:14.824941+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:44:32.467350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0097316139999999995,"stat_sum":{"num_bytes":401739,"num_objects":113,"num_object_clones":0,"num_object_copies":452,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":113,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":314,"num_write_kb":708,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"32'53","reported_seq":136,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.844206+0000","last_change":"2024-02-21T23:12:08.720063+0000","last_active":"2024-02-21T23:12:14.844206+0000","last_peered":"2024-02-21T23:12:14.844206+0000","last_clean":"2024-02-21T23:12:14.844206+0000","last_became_active":"2024-02-21T23:01:03.221405+0000","last_became_peered":"2024-02-21T23:01:03.221405+0000","last_unstale":"2024-02-21T23:12:14.844206+0000","last_undegraded":"2024-02-21T23:12:14.844206+0000","last_fullsized":"2024-02-21T23:12:14.844206+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:53:08.201764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0094468999999999994,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"32'7","reported_seq":57,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.063100+0000","last_change":"2024-02-21T23:01:02.221218+0000","last_active":"2024-02-21T23:12:15.063100+0000","last_peered":"2024-02-21T23:12:15.063100+0000","last_clean":"2024-02-21T23:12:15.063100+0000","last_became_active":"2024-02-21T23:01:02.220923+0000","last_became_peered":"2024-02-21T23:01:02.220923+0000","last_unstale":"2024-02-21T23:12:15.063100+0000","last_undegraded":"2024-02-21T23:12:15.063100+0000","last_fullsized":"2024-02-21T23:12:15.063100+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:15.938263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":13,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"35'343","reported_seq":410,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.628338+0000","last_change":"2024-02-21T23:12:08.666642+0000","last_active":"2024-02-21T23:12:15.628338+0000","last_peered":"2024-02-21T23:12:15.628338+0000","last_clean":"2024-02-21T23:12:15.628338+0000","last_became_active":"2024-02-21T23:01:07.268210+0000","last_became_peered":"2024-02-21T23:01:07.268210+0000","last_unstale":"2024-02-21T23:12:15.628338+0000","last_undegraded":"2024-02-21T23:12:15.628338+0000","last_fullsized":"2024-02-21T23:12:15.628338+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":343,"log_dups_size":0,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:04:13.965614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0034086630000000001,"stat_sum":{"num_bytes":377358,"num_objects":123,"num_object_clones":0,"num_object_copies":492,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":123,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":315,"num_write_kb":765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"32'52","reported_seq":135,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.875928+0000","last_change":"2024-02-21T23:12:08.665860+0000","last_active":"2024-02-21T23:12:14.875928+0000","last_peered":"2024-02-21T23:12:14.875928+0000","last_clean":"2024-02-21T23:12:14.875928+0000","last_became_active":"2024-02-21T23:01:03.218081+0000","last_became_peered":"2024-02-21T23:01:03.218081+0000","last_unstale":"2024-02-21T23:12:14.875928+0000","last_undegraded":"2024-02-21T23:12:14.875928+0000","last_fullsized":"2024-02-21T23:12:14.875928+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:17:45.851604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015202530000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"32'10","reported_seq":59,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.156431+0000","last_change":"2024-02-21T23:01:02.207826+0000","last_active":"2024-02-21T23:12:15.156431+0000","last_peered":"2024-02-21T23:12:15.156431+0000","last_clean":"2024-02-21T23:12:15.156431+0000","last_became_active":"2024-02-21T23:01:02.206426+0000","last_became_peered":"2024-02-21T23:01:02.206426+0000","last_unstale":"2024-02-21T23:12:15.156431+0000","last_undegraded":"2024-02-21T23:12:15.156431+0000","last_fullsized":"2024-02-21T23:12:15.156431+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:17:06.353018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2],"acting":[9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"35'355","reported_seq":417,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.062929+0000","last_change":"2024-02-21T23:12:08.713641+0000","last_active":"2024-02-21T23:12:15.062929+0000","last_peered":"2024-02-21T23:12:15.062929+0000","last_clean":"2024-02-21T23:12:15.062929+0000","last_became_active":"2024-02-21T23:01:07.651384+0000","last_became_peered":"2024-02-21T23:01:07.651384+0000","last_unstale":"2024-02-21T23:12:15.062929+0000","last_undegraded":"2024-02-21T23:12:15.062929+0000","last_fullsized":"2024-02-21T23:12:15.062929+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:37:42.607000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0031726889999999998,"stat_sum":{"num_bytes":888761,"num_objects":113,"num_object_clones":0,"num_object_copies":452,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":113,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":323,"num_write_kb":1197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"32'54","reported_seq":137,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.875903+0000","last_change":"2024-02-21T23:12:08.665492+0000","last_active":"2024-02-21T23:12:14.875903+0000","last_peered":"2024-02-21T23:12:14.875903+0000","last_clean":"2024-02-21T23:12:14.875903+0000","last_became_active":"2024-02-21T23:01:03.210123+0000","last_became_peered":"2024-02-21T23:01:03.210123+0000","last_unstale":"2024-02-21T23:12:14.875903+0000","last_undegraded":"2024-02-21T23:12:14.875903+0000","last_fullsized":"2024-02-21T23:12:14.875903+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:32:04.964547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014139560000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4],"acting":[10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"32'38","reported_seq":108,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.348746+0000","last_change":"2024-02-21T23:01:02.217455+0000","last_active":"2024-02-21T23:12:15.348746+0000","last_peered":"2024-02-21T23:12:15.348746+0000","last_clean":"2024-02-21T23:12:15.348746+0000","last_became_active":"2024-02-21T23:01:02.217128+0000","last_became_peered":"2024-02-21T23:01:02.217128+0000","last_unstale":"2024-02-21T23:12:15.348746+0000","last_undegraded":"2024-02-21T23:12:15.348746+0000","last_fullsized":"2024-02-21T23:12:15.348746+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:23:41.295647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":21,"num_read_kb":4097,"num_write":45,"num_write_kb":4258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"35'307","reported_seq":371,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.843285+0000","last_change":"2024-02-21T23:12:08.718221+0000","last_active":"2024-02-21T23:12:14.843285+0000","last_peered":"2024-02-21T23:12:14.843285+0000","last_clean":"2024-02-21T23:12:14.843285+0000","last_became_active":"2024-02-21T23:01:07.266376+0000","last_became_peered":"2024-02-21T23:01:07.266376+0000","last_unstale":"2024-02-21T23:12:14.843285+0000","last_undegraded":"2024-02-21T23:12:14.843285+0000","last_fullsized":"2024-02-21T23:12:14.843285+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":307,"log_dups_size":0,"ondisk_log_size":307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:59:12.232049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0080237980000000004,"stat_sum":{"num_bytes":252650,"num_objects":112,"num_object_clones":0,"num_object_copies":448,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":112,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":278,"num_write_kb":523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"32'44","reported_seq":127,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.971854+0000","last_change":"2024-02-21T23:12:08.674994+0000","last_active":"2024-02-21T23:12:14.971854+0000","last_peered":"2024-02-21T23:12:14.971854+0000","last_clean":"2024-02-21T23:12:14.971854+0000","last_became_active":"2024-02-21T23:01:03.212019+0000","last_became_peered":"2024-02-21T23:01:03.212019+0000","last_unstale":"2024-02-21T23:12:14.971854+0000","last_undegraded":"2024-02-21T23:12:14.971854+0000","last_fullsized":"2024-02-21T23:12:14.971854+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:03:30.016061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040092829999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"32'61","reported_seq":839,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:58.814530+0000","last_change":"2024-02-21T23:01:02.219033+0000","last_active":"2024-02-21T23:12:58.814530+0000","last_peered":"2024-02-21T23:12:58.814530+0000","last_clean":"2024-02-21T23:12:58.814530+0000","last_became_active":"2024-02-21T23:01:02.218570+0000","last_became_peered":"2024-02-21T23:01:02.218570+0000","last_unstale":"2024-02-21T23:12:58.814530+0000","last_undegraded":"2024-02-21T23:12:58.814530+0000","last_fullsized":"2024-02-21T23:12:58.814530+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:21:29.919968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289676,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":729,"num_read_kb":999,"num_write":69,"num_write_kb":476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"35'326","reported_seq":389,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.843976+0000","last_change":"2024-02-21T23:12:08.718344+0000","last_active":"2024-02-21T23:12:14.843976+0000","last_peered":"2024-02-21T23:12:14.843976+0000","last_clean":"2024-02-21T23:12:14.843976+0000","last_became_active":"2024-02-21T23:01:07.653745+0000","last_became_peered":"2024-02-21T23:01:07.653745+0000","last_unstale":"2024-02-21T23:12:14.843976+0000","last_undegraded":"2024-02-21T23:12:14.843976+0000","last_fullsized":"2024-02-21T23:12:14.843976+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:03:56.907378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0081050040000000007,"stat_sum":{"num_bytes":1514271,"num_objects":111,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":111,"num_whiteouts":0,"num_read":1,"num_read_kb":1270,"num_write":292,"num_write_kb":1862,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"32'52","reported_seq":135,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.842173+0000","last_change":"2024-02-21T23:12:08.714060+0000","last_active":"2024-02-21T23:12:14.842173+0000","last_peered":"2024-02-21T23:12:14.842173+0000","last_clean":"2024-02-21T23:12:14.842173+0000","last_became_active":"2024-02-21T23:01:03.219834+0000","last_became_peered":"2024-02-21T23:01:03.219834+0000","last_unstale":"2024-02-21T23:12:14.842173+0000","last_undegraded":"2024-02-21T23:12:14.842173+0000","last_fullsized":"2024-02-21T23:12:14.842173+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:52:50.911363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0044708259999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"32'156","reported_seq":259,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.348474+0000","last_change":"2024-02-21T23:01:02.207052+0000","last_active":"2024-02-21T23:12:15.348474+0000","last_peered":"2024-02-21T23:12:15.348474+0000","last_clean":"2024-02-21T23:12:15.348474+0000","last_became_active":"2024-02-21T23:01:02.206146+0000","last_became_peered":"2024-02-21T23:01:02.206146+0000","last_unstale":"2024-02-21T23:12:15.348474+0000","last_undegraded":"2024-02-21T23:12:15.348474+0000","last_fullsized":"2024-02-21T23:12:15.348474+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:26:49.911102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":54,"num_read_kb":8202,"num_write":160,"num_write_kb":8393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"35'381","reported_seq":438,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.972474+0000","last_change":"2024-02-21T23:12:08.673718+0000","last_active":"2024-02-21T23:12:14.972474+0000","last_peered":"2024-02-21T23:12:14.972474+0000","last_clean":"2024-02-21T23:12:14.972474+0000","last_became_active":"2024-02-21T23:01:50.649190+0000","last_became_peered":"2024-02-21T23:01:50.649190+0000","last_unstale":"2024-02-21T23:12:14.972474+0000","last_undegraded":"2024-02-21T23:12:14.972474+0000","last_fullsized":"2024-02-21T23:12:14.972474+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:51:30.402466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00347759,"stat_sum":{"num_bytes":3892244,"num_objects":109,"num_object_clones":0,"num_object_copies":436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":323,"num_write_kb":4210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,11,6,10],"acting":[5,11,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"32'57","reported_seq":140,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.825107+0000","last_change":"2024-02-21T23:12:08.620001+0000","last_active":"2024-02-21T23:12:14.825107+0000","last_peered":"2024-02-21T23:12:14.825107+0000","last_clean":"2024-02-21T23:12:14.825107+0000","last_became_active":"2024-02-21T23:01:03.209007+0000","last_became_peered":"2024-02-21T23:01:03.209007+0000","last_unstale":"2024-02-21T23:12:14.825107+0000","last_undegraded":"2024-02-21T23:12:14.825107+0000","last_fullsized":"2024-02-21T23:12:14.825107+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:11:24.214077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0096099529999999992,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"32'9","reported_seq":60,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.823538+0000","last_change":"2024-02-21T23:01:02.203395+0000","last_active":"2024-02-21T23:12:14.823538+0000","last_peered":"2024-02-21T23:12:14.823538+0000","last_clean":"2024-02-21T23:12:14.823538+0000","last_became_active":"2024-02-21T23:01:02.203066+0000","last_became_peered":"2024-02-21T23:01:02.203066+0000","last_unstale":"2024-02-21T23:12:14.823538+0000","last_undegraded":"2024-02-21T23:12:14.823538+0000","last_fullsized":"2024-02-21T23:12:14.823538+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:26:49.911102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":16,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"32'148","reported_seq":282,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.348654+0000","last_change":"2024-02-21T23:00:58.830752+0000","last_active":"2024-02-21T23:12:15.348654+0000","last_peered":"2024-02-21T23:12:15.348654+0000","last_clean":"2024-02-21T23:12:15.348654+0000","last_became_active":"2024-02-21T23:00:58.830472+0000","last_became_peered":"2024-02-21T23:00:58.830472+0000","last_unstale":"2024-02-21T23:12:15.348654+0000","last_undegraded":"2024-02-21T23:12:15.348654+0000","last_fullsized":"2024-02-21T23:12:15.348654+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:00:57.811198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:00:57.811198+0000","last_clean_scrub_stamp":"2024-02-21T23:00:57.811198+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:58:31.374266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"35'303","reported_seq":368,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.348445+0000","last_change":"2024-02-21T23:12:08.713916+0000","last_active":"2024-02-21T23:12:15.348445+0000","last_peered":"2024-02-21T23:12:15.348445+0000","last_clean":"2024-02-21T23:12:15.348445+0000","last_became_active":"2024-02-21T23:01:07.276489+0000","last_became_peered":"2024-02-21T23:01:07.276489+0000","last_unstale":"2024-02-21T23:12:15.348445+0000","last_undegraded":"2024-02-21T23:12:15.348445+0000","last_fullsized":"2024-02-21T23:12:15.348445+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":303,"log_dups_size":0,"ondisk_log_size":303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:12:49.052079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0037280239999999999,"stat_sum":{"num_bytes":156768,"num_objects":95,"num_object_clones":0,"num_object_copies":380,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":275,"num_write_kb":444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"32'53","reported_seq":136,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.348793+0000","last_change":"2024-02-21T23:12:08.715540+0000","last_active":"2024-02-21T23:12:15.348793+0000","last_peered":"2024-02-21T23:12:15.348793+0000","last_clean":"2024-02-21T23:12:15.348793+0000","last_became_active":"2024-02-21T23:01:03.215904+0000","last_became_peered":"2024-02-21T23:01:03.215904+0000","last_unstale":"2024-02-21T23:12:15.348793+0000","last_undegraded":"2024-02-21T23:12:15.348793+0000","last_fullsized":"2024-02-21T23:12:15.348793+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:01:36.467676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0048898559999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"32'10","reported_seq":60,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.821877+0000","last_change":"2024-02-21T23:01:02.207406+0000","last_active":"2024-02-21T23:12:14.821877+0000","last_peered":"2024-02-21T23:12:14.821877+0000","last_clean":"2024-02-21T23:12:14.821877+0000","last_became_active":"2024-02-21T23:01:02.206219+0000","last_became_peered":"2024-02-21T23:01:02.206219+0000","last_unstale":"2024-02-21T23:12:14.821877+0000","last_undegraded":"2024-02-21T23:12:14.821877+0000","last_fullsized":"2024-02-21T23:12:14.821877+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:21:29.919968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":13,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11],"acting":[2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"35'322","reported_seq":390,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.240800+0000","last_change":"2024-02-21T23:12:08.607853+0000","last_active":"2024-02-21T23:12:15.240800+0000","last_peered":"2024-02-21T23:12:15.240800+0000","last_clean":"2024-02-21T23:12:15.240800+0000","last_became_active":"2024-02-21T23:01:07.265401+0000","last_became_peered":"2024-02-21T23:01:07.265401+0000","last_unstale":"2024-02-21T23:12:15.240800+0000","last_undegraded":"2024-02-21T23:12:15.240800+0000","last_fullsized":"2024-02-21T23:12:15.240800+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":322,"log_dups_size":0,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:32:15.029558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022768879999999999,"stat_sum":{"num_bytes":312332,"num_objects":114,"num_object_clones":0,"num_object_copies":456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":114,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":302,"num_write_kb":592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"32'60","reported_seq":143,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.347873+0000","last_change":"2024-02-21T23:12:08.715749+0000","last_active":"2024-02-21T23:12:15.347873+0000","last_peered":"2024-02-21T23:12:15.347873+0000","last_clean":"2024-02-21T23:12:15.347873+0000","last_became_active":"2024-02-21T23:01:03.220349+0000","last_became_peered":"2024-02-21T23:01:03.220349+0000","last_unstale":"2024-02-21T23:12:15.347873+0000","last_undegraded":"2024-02-21T23:12:15.347873+0000","last_fullsized":"2024-02-21T23:12:15.347873+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:01:00.300776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0046427739999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"38'186","reported_seq":382,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:18.728029+0000","last_change":"2024-02-21T23:01:02.206319+0000","last_active":"2024-02-21T23:12:18.728029+0000","last_peered":"2024-02-21T23:12:18.728029+0000","last_clean":"2024-02-21T23:12:18.728029+0000","last_became_active":"2024-02-21T23:01:02.205747+0000","last_became_peered":"2024-02-21T23:01:02.205747+0000","last_unstale":"2024-02-21T23:12:18.728029+0000","last_undegraded":"2024-02-21T23:12:18.728029+0000","last_fullsized":"2024-02-21T23:12:18.728029+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:10:09.680115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":328302,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":150,"num_read_kb":149,"num_write":203,"num_write_kb":2979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10],"acting":[5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"35'347","reported_seq":411,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.960221+0000","last_change":"2024-02-21T23:12:08.705514+0000","last_active":"2024-02-21T23:12:14.960221+0000","last_peered":"2024-02-21T23:12:14.960221+0000","last_clean":"2024-02-21T23:12:14.960221+0000","last_became_active":"2024-02-21T23:01:07.280193+0000","last_became_peered":"2024-02-21T23:01:07.280193+0000","last_unstale":"2024-02-21T23:12:14.960221+0000","last_undegraded":"2024-02-21T23:12:14.960221+0000","last_fullsized":"2024-02-21T23:12:14.960221+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":347,"log_dups_size":0,"ondisk_log_size":347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:03:56.907378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00381337,"stat_sum":{"num_bytes":4515871,"num_objects":114,"num_object_clones":0,"num_object_copies":456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":114,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":315,"num_write_kb":4679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"32'57","reported_seq":140,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.348620+0000","last_change":"2024-02-21T23:12:08.714545+0000","last_active":"2024-02-21T23:12:15.348620+0000","last_peered":"2024-02-21T23:12:15.348620+0000","last_clean":"2024-02-21T23:12:15.348620+0000","last_became_active":"2024-02-21T23:01:03.216578+0000","last_became_peered":"2024-02-21T23:01:03.216578+0000","last_unstale":"2024-02-21T23:12:15.348620+0000","last_undegraded":"2024-02-21T23:12:15.348620+0000","last_fullsized":"2024-02-21T23:12:15.348620+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:44:28.419272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0043269409999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"32'5","reported_seq":54,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.844695+0000","last_change":"2024-02-21T23:01:02.220913+0000","last_active":"2024-02-21T23:12:14.844695+0000","last_peered":"2024-02-21T23:12:14.844695+0000","last_clean":"2024-02-21T23:12:14.844695+0000","last_became_active":"2024-02-21T23:01:02.220554+0000","last_became_peered":"2024-02-21T23:01:02.220554+0000","last_unstale":"2024-02-21T23:12:14.844695+0000","last_undegraded":"2024-02-21T23:12:14.844695+0000","last_fullsized":"2024-02-21T23:12:14.844695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:36:44.497886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"35'327","reported_seq":391,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.971637+0000","last_change":"2024-02-21T23:12:08.674532+0000","last_active":"2024-02-21T23:12:14.971637+0000","last_peered":"2024-02-21T23:12:14.971637+0000","last_clean":"2024-02-21T23:12:14.971637+0000","last_became_active":"2024-02-21T23:01:07.257011+0000","last_became_peered":"2024-02-21T23:01:07.257011+0000","last_unstale":"2024-02-21T23:12:14.971637+0000","last_undegraded":"2024-02-21T23:12:14.971637+0000","last_fullsized":"2024-02-21T23:12:14.971637+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:21:46.661574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0038555350000000002,"stat_sum":{"num_bytes":448215,"num_objects":108,"num_object_clones":0,"num_object_copies":432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":292,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"32'39","reported_seq":122,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.627619+0000","last_change":"2024-02-21T23:12:08.667139+0000","last_active":"2024-02-21T23:12:15.627619+0000","last_peered":"2024-02-21T23:12:15.627619+0000","last_clean":"2024-02-21T23:12:15.627619+0000","last_became_active":"2024-02-21T23:01:03.211467+0000","last_became_peered":"2024-02-21T23:01:03.211467+0000","last_unstale":"2024-02-21T23:12:15.627619+0000","last_undegraded":"2024-02-21T23:12:15.627619+0000","last_fullsized":"2024-02-21T23:12:15.627619+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:54:40.544963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0035291530000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"32'15","reported_seq":65,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.062813+0000","last_change":"2024-02-21T23:01:02.211763+0000","last_active":"2024-02-21T23:12:15.062813+0000","last_peered":"2024-02-21T23:12:15.062813+0000","last_clean":"2024-02-21T23:12:15.062813+0000","last_became_active":"2024-02-21T23:01:02.211470+0000","last_became_peered":"2024-02-21T23:01:02.211470+0000","last_unstale":"2024-02-21T23:12:15.062813+0000","last_undegraded":"2024-02-21T23:12:15.062813+0000","last_fullsized":"2024-02-21T23:12:15.062813+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:23:41.295647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":24,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5],"acting":[8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"35'322","reported_seq":390,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.971734+0000","last_change":"2024-02-21T23:12:08.673325+0000","last_active":"2024-02-21T23:12:14.971734+0000","last_peered":"2024-02-21T23:12:14.971734+0000","last_clean":"2024-02-21T23:12:14.971734+0000","last_became_active":"2024-02-21T23:01:07.268681+0000","last_became_peered":"2024-02-21T23:01:07.268681+0000","last_unstale":"2024-02-21T23:12:14.971734+0000","last_undegraded":"2024-02-21T23:12:14.971734+0000","last_fullsized":"2024-02-21T23:12:14.971734+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":322,"log_dups_size":0,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:44:32.467350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0032686719999999998,"stat_sum":{"num_bytes":365874,"num_objects":113,"num_object_clones":0,"num_object_copies":452,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":113,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":301,"num_write_kb":637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"32'61","reported_seq":144,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.971994+0000","last_change":"2024-02-21T23:12:08.674464+0000","last_active":"2024-02-21T23:12:14.971994+0000","last_peered":"2024-02-21T23:12:14.971994+0000","last_clean":"2024-02-21T23:12:14.971994+0000","last_became_active":"2024-02-21T23:01:03.212634+0000","last_became_peered":"2024-02-21T23:01:03.212634+0000","last_unstale":"2024-02-21T23:12:14.971994+0000","last_undegraded":"2024-02-21T23:12:14.971994+0000","last_fullsized":"2024-02-21T23:12:14.971994+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:23:47.543277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039799579999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"32'26","reported_seq":76,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.062436+0000","last_change":"2024-02-21T23:01:02.221957+0000","last_active":"2024-02-21T23:12:15.062436+0000","last_peered":"2024-02-21T23:12:15.062436+0000","last_clean":"2024-02-21T23:12:15.062436+0000","last_became_active":"2024-02-21T23:01:02.221642+0000","last_became_peered":"2024-02-21T23:01:02.221642+0000","last_unstale":"2024-02-21T23:12:15.062436+0000","last_undegraded":"2024-02-21T23:12:15.062436+0000","last_fullsized":"2024-02-21T23:12:15.062436+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:10:09.680115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":39,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"35'397","reported_seq":443,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.844649+0000","last_change":"2024-02-21T23:12:08.717882+0000","last_active":"2024-02-21T23:12:14.844649+0000","last_peered":"2024-02-21T23:12:14.844649+0000","last_clean":"2024-02-21T23:12:14.844649+0000","last_became_active":"2024-02-21T23:01:07.267874+0000","last_became_peered":"2024-02-21T23:01:07.267874+0000","last_unstale":"2024-02-21T23:12:14.844649+0000","last_undegraded":"2024-02-21T23:12:14.844649+0000","last_fullsized":"2024-02-21T23:12:14.844649+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:39:46.450427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0076511119999999998,"stat_sum":{"num_bytes":500979,"num_objects":108,"num_object_clones":0,"num_object_copies":432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":334,"num_write_kb":931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"32'53","reported_seq":136,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.347593+0000","last_change":"2024-02-21T23:12:08.716946+0000","last_active":"2024-02-21T23:12:15.347593+0000","last_peered":"2024-02-21T23:12:15.347593+0000","last_clean":"2024-02-21T23:12:15.347593+0000","last_became_active":"2024-02-21T23:01:03.216466+0000","last_became_peered":"2024-02-21T23:01:03.216466+0000","last_unstale":"2024-02-21T23:12:15.347593+0000","last_undegraded":"2024-02-21T23:12:15.347593+0000","last_fullsized":"2024-02-21T23:12:15.347593+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:21:42.613496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0046640040000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"32'14","reported_seq":753,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:58.815511+0000","last_change":"2024-02-21T23:01:02.199060+0000","last_active":"2024-02-21T23:12:58.815511+0000","last_peered":"2024-02-21T23:12:58.815511+0000","last_clean":"2024-02-21T23:12:58.815511+0000","last_became_active":"2024-02-21T23:01:02.198709+0000","last_became_peered":"2024-02-21T23:01:02.198709+0000","last_unstale":"2024-02-21T23:12:58.815511+0000","last_undegraded":"2024-02-21T23:12:58.815511+0000","last_fullsized":"2024-02-21T23:12:58.815511+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:36:44.497886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1124,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":691,"num_read_kb":5,"num_write":18,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"35'357","reported_seq":411,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.156955+0000","last_change":"2024-02-21T23:12:08.617956+0000","last_active":"2024-02-21T23:12:15.156955+0000","last_peered":"2024-02-21T23:12:15.156955+0000","last_clean":"2024-02-21T23:12:15.156955+0000","last_became_active":"2024-02-21T23:01:07.277289+0000","last_became_peered":"2024-02-21T23:01:07.277289+0000","last_unstale":"2024-02-21T23:12:15.156955+0000","last_undegraded":"2024-02-21T23:12:15.156955+0000","last_fullsized":"2024-02-21T23:12:15.156955+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:32:15.029558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0081797620000000001,"stat_sum":{"num_bytes":280914,"num_objects":98,"num_object_clones":0,"num_object_copies":392,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":308,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"32'69","reported_seq":152,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.348045+0000","last_change":"2024-02-21T23:12:08.717128+0000","last_active":"2024-02-21T23:12:15.348045+0000","last_peered":"2024-02-21T23:12:15.348045+0000","last_clean":"2024-02-21T23:12:15.348045+0000","last_became_active":"2024-02-21T23:01:03.214507+0000","last_became_peered":"2024-02-21T23:01:03.214507+0000","last_unstale":"2024-02-21T23:12:15.348045+0000","last_undegraded":"2024-02-21T23:12:15.348045+0000","last_fullsized":"2024-02-21T23:12:15.348045+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:23:08.703440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036732959999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"32'15","reported_seq":64,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.971959+0000","last_change":"2024-02-21T23:01:02.209351+0000","last_active":"2024-02-21T23:12:14.971959+0000","last_peered":"2024-02-21T23:12:14.971959+0000","last_clean":"2024-02-21T23:12:14.971959+0000","last_became_active":"2024-02-21T23:01:02.208990+0000","last_became_peered":"2024-02-21T23:01:02.208990+0000","last_unstale":"2024-02-21T23:12:14.971959+0000","last_undegraded":"2024-02-21T23:12:14.971959+0000","last_fullsized":"2024-02-21T23:12:14.971959+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:36:44.497886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"35'314","reported_seq":378,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.628791+0000","last_change":"2024-02-21T23:12:08.666904+0000","last_active":"2024-02-21T23:12:15.628791+0000","last_peered":"2024-02-21T23:12:15.628791+0000","last_clean":"2024-02-21T23:12:15.628791+0000","last_became_active":"2024-02-21T23:01:50.649153+0000","last_became_peered":"2024-02-21T23:01:50.649153+0000","last_unstale":"2024-02-21T23:12:15.628791+0000","last_undegraded":"2024-02-21T23:12:15.628791+0000","last_fullsized":"2024-02-21T23:12:15.628791+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":314,"log_dups_size":0,"ondisk_log_size":314,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:53:12.249842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003571472,"stat_sum":{"num_bytes":262334,"num_objects":113,"num_object_clones":0,"num_object_copies":452,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":113,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":267,"num_write_kb":565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,7,6],"acting":[11,8,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"32'49","reported_seq":132,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.843028+0000","last_change":"2024-02-21T23:12:08.716229+0000","last_active":"2024-02-21T23:12:14.843028+0000","last_peered":"2024-02-21T23:12:14.843028+0000","last_clean":"2024-02-21T23:12:14.843028+0000","last_became_active":"2024-02-21T23:01:03.224451+0000","last_became_peered":"2024-02-21T23:01:03.224451+0000","last_unstale":"2024-02-21T23:12:14.843028+0000","last_undegraded":"2024-02-21T23:12:14.843028+0000","last_fullsized":"2024-02-21T23:12:14.843028+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:48:40.284242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0065637960000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"39'149","reported_seq":734,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:58.571232+0000","last_change":"2024-02-21T23:01:02.203410+0000","last_active":"2024-02-21T23:12:58.571232+0000","last_peered":"2024-02-21T23:12:58.571232+0000","last_clean":"2024-02-21T23:12:58.571232+0000","last_became_active":"2024-02-21T23:01:02.203081+0000","last_became_peered":"2024-02-21T23:01:02.203081+0000","last_unstale":"2024-02-21T23:12:58.571232+0000","last_undegraded":"2024-02-21T23:12:58.571232+0000","last_fullsized":"2024-02-21T23:12:58.571232+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:36:44.497886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8060470,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":536,"num_read_kb":7900,"num_write":154,"num_write_kb":8013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10],"acting":[2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"35'326","reported_seq":386,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.972434+0000","last_change":"2024-02-21T23:12:08.674143+0000","last_active":"2024-02-21T23:12:14.972434+0000","last_peered":"2024-02-21T23:12:14.972434+0000","last_clean":"2024-02-21T23:12:14.972434+0000","last_became_active":"2024-02-21T23:01:07.268436+0000","last_became_peered":"2024-02-21T23:01:07.268436+0000","last_unstale":"2024-02-21T23:12:14.972434+0000","last_undegraded":"2024-02-21T23:12:14.972434+0000","last_fullsized":"2024-02-21T23:12:14.972434+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:01:04.348854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036117860000000001,"stat_sum":{"num_bytes":527021,"num_objects":97,"num_object_clones":0,"num_object_copies":388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":97,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":289,"num_write_kb":781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"32'50","reported_seq":132,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.062938+0000","last_change":"2024-02-21T23:12:08.714680+0000","last_active":"2024-02-21T23:12:15.062938+0000","last_peered":"2024-02-21T23:12:15.062938+0000","last_clean":"2024-02-21T23:12:15.062938+0000","last_became_active":"2024-02-21T23:01:03.215888+0000","last_became_peered":"2024-02-21T23:01:03.215888+0000","last_unstale":"2024-02-21T23:12:15.062938+0000","last_undegraded":"2024-02-21T23:12:15.062938+0000","last_fullsized":"2024-02-21T23:12:15.062938+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:34:02.477270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036927029999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"38'103","reported_seq":1041,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:58.570285+0000","last_change":"2024-02-21T23:01:02.204595+0000","last_active":"2024-02-21T23:12:58.570285+0000","last_peered":"2024-02-21T23:12:58.570285+0000","last_clean":"2024-02-21T23:12:58.570285+0000","last_became_active":"2024-02-21T23:01:02.204123+0000","last_became_peered":"2024-02-21T23:01:02.204123+0000","last_unstale":"2024-02-21T23:12:58.570285+0000","last_undegraded":"2024-02-21T23:12:58.570285+0000","last_fullsized":"2024-02-21T23:12:58.570285+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:36:44.497886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":889,"num_read_kb":4819,"num_write":111,"num_write_kb":4274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1],"acting":[10,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"35'330","reported_seq":392,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.156250+0000","last_change":"2024-02-21T23:12:08.616456+0000","last_active":"2024-02-21T23:12:15.156250+0000","last_peered":"2024-02-21T23:12:15.156250+0000","last_clean":"2024-02-21T23:12:15.156250+0000","last_became_active":"2024-02-21T23:01:07.265618+0000","last_became_peered":"2024-02-21T23:01:07.265618+0000","last_unstale":"2024-02-21T23:12:15.156250+0000","last_undegraded":"2024-02-21T23:12:15.156250+0000","last_fullsized":"2024-02-21T23:12:15.156250+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":330,"log_dups_size":0,"ondisk_log_size":330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:40:40.382308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0078749619999999992,"stat_sum":{"num_bytes":397479,"num_objects":108,"num_object_clones":0,"num_object_copies":432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":298,"num_write_kb":795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"32'50","reported_seq":133,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.240895+0000","last_change":"2024-02-21T23:12:08.608746+0000","last_active":"2024-02-21T23:12:15.240895+0000","last_peered":"2024-02-21T23:12:15.240895+0000","last_clean":"2024-02-21T23:12:15.240895+0000","last_became_active":"2024-02-21T23:01:03.214580+0000","last_became_peered":"2024-02-21T23:01:03.214580+0000","last_unstale":"2024-02-21T23:12:15.240895+0000","last_undegraded":"2024-02-21T23:12:15.240895+0000","last_fullsized":"2024-02-21T23:12:15.240895+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:25:38.592184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027155230000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8],"acting":[1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"32'33","reported_seq":82,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.972631+0000","last_change":"2024-02-21T23:01:02.222064+0000","last_active":"2024-02-21T23:12:14.972631+0000","last_peered":"2024-02-21T23:12:14.972631+0000","last_clean":"2024-02-21T23:12:14.972631+0000","last_became_active":"2024-02-21T23:01:02.221735+0000","last_became_peered":"2024-02-21T23:01:02.221735+0000","last_unstale":"2024-02-21T23:12:14.972631+0000","last_undegraded":"2024-02-21T23:12:14.972631+0000","last_fullsized":"2024-02-21T23:12:14.972631+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:23:41.295647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":43,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"35'359","reported_seq":411,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.823158+0000","last_change":"2024-02-21T23:12:08.717375+0000","last_active":"2024-02-21T23:12:14.823158+0000","last_peered":"2024-02-21T23:12:14.823158+0000","last_clean":"2024-02-21T23:12:14.823158+0000","last_became_active":"2024-02-21T23:01:07.275982+0000","last_became_peered":"2024-02-21T23:01:07.275982+0000","last_unstale":"2024-02-21T23:12:14.823158+0000","last_undegraded":"2024-02-21T23:12:14.823158+0000","last_fullsized":"2024-02-21T23:12:14.823158+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:23:12.751518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0069532279999999997,"stat_sum":{"num_bytes":644576,"num_objects":99,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":303,"num_write_kb":1079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"32'60","reported_seq":142,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.960741+0000","last_change":"2024-02-21T23:12:08.707621+0000","last_active":"2024-02-21T23:12:14.960741+0000","last_peered":"2024-02-21T23:12:14.960741+0000","last_clean":"2024-02-21T23:12:14.960741+0000","last_became_active":"2024-02-21T23:01:03.229193+0000","last_became_peered":"2024-02-21T23:01:03.229193+0000","last_unstale":"2024-02-21T23:12:14.960741+0000","last_undegraded":"2024-02-21T23:12:14.960741+0000","last_fullsized":"2024-02-21T23:12:14.960741+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:44:28.419272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0055177610000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"32'3","reported_seq":51,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.348453+0000","last_change":"2024-02-21T23:01:02.197598+0000","last_active":"2024-02-21T23:12:15.348453+0000","last_peered":"2024-02-21T23:12:15.348453+0000","last_clean":"2024-02-21T23:12:15.348453+0000","last_became_active":"2024-02-21T23:01:02.197275+0000","last_became_peered":"2024-02-21T23:01:02.197275+0000","last_unstale":"2024-02-21T23:12:15.348453+0000","last_undegraded":"2024-02-21T23:12:15.348453+0000","last_fullsized":"2024-02-21T23:12:15.348453+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:36:44.497886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"35'338","reported_seq":396,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.062488+0000","last_change":"2024-02-21T23:12:08.713158+0000","last_active":"2024-02-21T23:12:15.062488+0000","last_peered":"2024-02-21T23:12:15.062488+0000","last_clean":"2024-02-21T23:12:15.062488+0000","last_became_active":"2024-02-21T23:01:50.554591+0000","last_became_peered":"2024-02-21T23:01:50.554591+0000","last_unstale":"2024-02-21T23:12:15.062488+0000","last_undegraded":"2024-02-21T23:12:15.062488+0000","last_fullsized":"2024-02-21T23:12:15.062488+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:32:15.029558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0034363990000000001,"stat_sum":{"num_bytes":332054,"num_objects":124,"num_object_clones":0,"num_object_copies":496,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":124,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":310,"num_write_kb":722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2,4],"acting":[8,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.16","version":"32'77","reported_seq":159,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.241055+0000","last_change":"2024-02-21T23:12:08.608792+0000","last_active":"2024-02-21T23:12:15.241055+0000","last_peered":"2024-02-21T23:12:15.241055+0000","last_clean":"2024-02-21T23:12:15.241055+0000","last_became_active":"2024-02-21T23:01:03.215004+0000","last_became_peered":"2024-02-21T23:01:03.215004+0000","last_unstale":"2024-02-21T23:12:15.241055+0000","last_undegraded":"2024-02-21T23:12:15.241055+0000","last_fullsized":"2024-02-21T23:12:15.241055+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:34:02.477270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024858219999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"32'15","reported_seq":749,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:58.753639+0000","last_change":"2024-02-21T23:01:02.207663+0000","last_active":"2024-02-21T23:12:58.753639+0000","last_peered":"2024-02-21T23:12:58.753639+0000","last_clean":"2024-02-21T23:12:58.753639+0000","last_became_active":"2024-02-21T23:01:02.207349+0000","last_became_peered":"2024-02-21T23:01:02.207349+0000","last_unstale":"2024-02-21T23:12:58.753639+0000","last_undegraded":"2024-02-21T23:12:58.753639+0000","last_fullsized":"2024-02-21T23:12:58.753639+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:21:29.919968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":686,"num_read_kb":686,"num_write":21,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5],"acting":[10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"35'344","reported_seq":403,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.825538+0000","last_change":"2024-02-21T23:12:08.622969+0000","last_active":"2024-02-21T23:12:14.825538+0000","last_peered":"2024-02-21T23:12:14.825538+0000","last_clean":"2024-02-21T23:12:14.825538+0000","last_became_active":"2024-02-21T23:01:07.268193+0000","last_became_peered":"2024-02-21T23:01:07.268193+0000","last_unstale":"2024-02-21T23:12:14.825538+0000","last_undegraded":"2024-02-21T23:12:14.825538+0000","last_fullsized":"2024-02-21T23:12:14.825538+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:03:34.064139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010511161999999999,"stat_sum":{"num_bytes":737229,"num_objects":93,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":303,"num_write_kb":1054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"35'297","reported_seq":362,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.960452+0000","last_change":"2024-02-21T23:12:08.705629+0000","last_active":"2024-02-21T23:12:14.960452+0000","last_peered":"2024-02-21T23:12:14.960452+0000","last_clean":"2024-02-21T23:12:14.960452+0000","last_became_active":"2024-02-21T23:01:07.271175+0000","last_became_peered":"2024-02-21T23:01:07.271175+0000","last_unstale":"2024-02-21T23:12:14.960452+0000","last_undegraded":"2024-02-21T23:12:14.960452+0000","last_fullsized":"2024-02-21T23:12:14.960452+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:04:13.965614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0038708390000000001,"stat_sum":{"num_bytes":430239,"num_objects":97,"num_object_clones":0,"num_object_copies":388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":97,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":271,"num_write_kb":710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"32'64","reported_seq":146,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.156340+0000","last_change":"2024-02-21T23:12:08.615458+0000","last_active":"2024-02-21T23:12:15.156340+0000","last_peered":"2024-02-21T23:12:15.156340+0000","last_clean":"2024-02-21T23:12:15.156340+0000","last_became_active":"2024-02-21T23:01:03.210599+0000","last_became_peered":"2024-02-21T23:01:03.210599+0000","last_unstale":"2024-02-21T23:12:15.156340+0000","last_undegraded":"2024-02-21T23:12:15.156340+0000","last_fullsized":"2024-02-21T23:12:15.156340+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:55:05.296534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0070665069999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"32'10","reported_seq":58,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.971977+0000","last_change":"2024-02-21T23:01:02.204603+0000","last_active":"2024-02-21T23:12:14.971977+0000","last_peered":"2024-02-21T23:12:14.971977+0000","last_clean":"2024-02-21T23:12:14.971977+0000","last_became_active":"2024-02-21T23:01:02.204304+0000","last_became_peered":"2024-02-21T23:01:02.204304+0000","last_unstale":"2024-02-21T23:12:14.971977+0000","last_undegraded":"2024-02-21T23:12:14.971977+0000","last_fullsized":"2024-02-21T23:12:14.971977+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:58:23.554457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"35'308","reported_seq":373,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.628894+0000","last_change":"2024-02-21T23:12:08.667582+0000","last_active":"2024-02-21T23:12:15.628894+0000","last_peered":"2024-02-21T23:12:15.628894+0000","last_clean":"2024-02-21T23:12:15.628894+0000","last_became_active":"2024-02-21T23:01:07.283568+0000","last_became_peered":"2024-02-21T23:01:07.283568+0000","last_unstale":"2024-02-21T23:12:15.628894+0000","last_undegraded":"2024-02-21T23:12:15.628894+0000","last_fullsized":"2024-02-21T23:12:15.628894+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":308,"log_dups_size":0,"ondisk_log_size":308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:44:32.467350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003898777,"stat_sum":{"num_bytes":444936,"num_objects":124,"num_object_clones":0,"num_object_copies":496,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":124,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":282,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"32'78","reported_seq":160,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.825260+0000","last_change":"2024-02-21T23:12:08.622094+0000","last_active":"2024-02-21T23:12:14.825260+0000","last_peered":"2024-02-21T23:12:14.825260+0000","last_clean":"2024-02-21T23:12:14.825260+0000","last_became_active":"2024-02-21T23:01:03.208141+0000","last_became_peered":"2024-02-21T23:01:03.208141+0000","last_unstale":"2024-02-21T23:12:14.825260+0000","last_undegraded":"2024-02-21T23:12:14.825260+0000","last_fullsized":"2024-02-21T23:12:14.825260+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:23:47.543277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010800880000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"32'20","reported_seq":74,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.842192+0000","last_change":"2024-02-21T23:01:02.218826+0000","last_active":"2024-02-21T23:12:14.842192+0000","last_peered":"2024-02-21T23:12:14.842192+0000","last_clean":"2024-02-21T23:12:14.842192+0000","last_became_active":"2024-02-21T23:01:02.218499+0000","last_became_peered":"2024-02-21T23:01:02.218499+0000","last_unstale":"2024-02-21T23:12:14.842192+0000","last_undegraded":"2024-02-21T23:12:14.842192+0000","last_fullsized":"2024-02-21T23:12:14.842192+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:17:06.353018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62737,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":6,"num_read_kb":64,"num_write":27,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"32'47","reported_seq":116,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.875654+0000","last_change":"2024-02-21T23:01:02.209061+0000","last_active":"2024-02-21T23:12:14.875654+0000","last_peered":"2024-02-21T23:12:14.875654+0000","last_clean":"2024-02-21T23:12:14.875654+0000","last_became_active":"2024-02-21T23:01:02.208779+0000","last_became_peered":"2024-02-21T23:01:02.208779+0000","last_unstale":"2024-02-21T23:12:14.875654+0000","last_undegraded":"2024-02-21T23:12:14.875654+0000","last_fullsized":"2024-02-21T23:12:14.875654+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:17:06.353018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":4098,"num_write":52,"num_write_kb":4233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8],"acting":[10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"32'62","reported_seq":144,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.972084+0000","last_change":"2024-02-21T23:12:08.673921+0000","last_active":"2024-02-21T23:12:14.972084+0000","last_peered":"2024-02-21T23:12:14.972084+0000","last_clean":"2024-02-21T23:12:14.972084+0000","last_became_active":"2024-02-21T23:01:03.212560+0000","last_became_peered":"2024-02-21T23:01:03.212560+0000","last_unstale":"2024-02-21T23:12:14.972084+0000","last_undegraded":"2024-02-21T23:12:14.972084+0000","last_fullsized":"2024-02-21T23:12:14.972084+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:01:36.467676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036569530000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"35'328","reported_seq":386,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.821605+0000","last_change":"2024-02-21T23:12:08.715992+0000","last_active":"2024-02-21T23:12:14.821605+0000","last_peered":"2024-02-21T23:12:14.821605+0000","last_clean":"2024-02-21T23:12:14.821605+0000","last_became_active":"2024-02-21T23:01:07.267796+0000","last_became_peered":"2024-02-21T23:01:07.267796+0000","last_unstale":"2024-02-21T23:12:14.821605+0000","last_undegraded":"2024-02-21T23:12:14.821605+0000","last_fullsized":"2024-02-21T23:12:14.821605+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:59:12.232049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0050978890000000004,"stat_sum":{"num_bytes":212072,"num_objects":97,"num_object_clones":0,"num_object_copies":388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":97,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":291,"num_write_kb":1346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"32'86","reported_seq":1369,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:59.755728+0000","last_change":"2024-02-21T23:01:02.206398+0000","last_active":"2024-02-21T23:12:59.755728+0000","last_peered":"2024-02-21T23:12:59.755728+0000","last_clean":"2024-02-21T23:12:59.755728+0000","last_became_active":"2024-02-21T23:01:02.206069+0000","last_became_peered":"2024-02-21T23:01:02.206069+0000","last_unstale":"2024-02-21T23:12:59.755728+0000","last_undegraded":"2024-02-21T23:12:59.755728+0000","last_fullsized":"2024-02-21T23:12:59.755728+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:26:49.911102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9892253,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":1235,"num_read_kb":9674,"num_write":91,"num_write_kb":9838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"32'52","reported_seq":134,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.062722+0000","last_change":"2024-02-21T23:12:08.714756+0000","last_active":"2024-02-21T23:12:15.062722+0000","last_peered":"2024-02-21T23:12:15.062722+0000","last_clean":"2024-02-21T23:12:15.062722+0000","last_became_active":"2024-02-21T23:01:03.220900+0000","last_became_peered":"2024-02-21T23:01:03.220900+0000","last_unstale":"2024-02-21T23:12:15.062722+0000","last_undegraded":"2024-02-21T23:12:15.062722+0000","last_fullsized":"2024-02-21T23:12:15.062722+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:25:38.592184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042536859999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9],"acting":[8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"35'336","reported_seq":393,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.822380+0000","last_change":"2024-02-21T23:12:08.716520+0000","last_active":"2024-02-21T23:12:14.822380+0000","last_peered":"2024-02-21T23:12:14.822380+0000","last_clean":"2024-02-21T23:12:14.822380+0000","last_became_active":"2024-02-21T23:01:07.256474+0000","last_became_peered":"2024-02-21T23:01:07.256474+0000","last_unstale":"2024-02-21T23:12:14.822380+0000","last_undegraded":"2024-02-21T23:12:14.822380+0000","last_fullsized":"2024-02-21T23:12:14.822380+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:03:56.907378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0052156759999999998,"stat_sum":{"num_bytes":406297,"num_objects":103,"num_object_clones":0,"num_object_copies":412,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":293,"num_write_kb":672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"32'75","reported_seq":158,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.627459+0000","last_change":"2024-02-21T23:12:08.667906+0000","last_active":"2024-02-21T23:12:15.627459+0000","last_peered":"2024-02-21T23:12:15.627459+0000","last_clean":"2024-02-21T23:12:15.627459+0000","last_became_active":"2024-02-21T23:01:03.215461+0000","last_became_peered":"2024-02-21T23:01:03.215461+0000","last_unstale":"2024-02-21T23:12:15.627459+0000","last_undegraded":"2024-02-21T23:12:15.627459+0000","last_fullsized":"2024-02-21T23:12:15.627459+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:51:26.354389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041591809999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"32'71","reported_seq":154,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.821930+0000","last_change":"2024-02-21T23:12:08.715407+0000","last_active":"2024-02-21T23:12:14.821930+0000","last_peered":"2024-02-21T23:12:14.821930+0000","last_clean":"2024-02-21T23:12:14.821930+0000","last_became_active":"2024-02-21T23:01:03.215639+0000","last_became_peered":"2024-02-21T23:01:03.215639+0000","last_unstale":"2024-02-21T23:12:14.821930+0000","last_undegraded":"2024-02-21T23:12:14.821930+0000","last_fullsized":"2024-02-21T23:12:14.821930+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:48:40.284242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0047914689999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"32'66","reported_seq":149,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.821515+0000","last_change":"2024-02-21T23:12:08.712004+0000","last_active":"2024-02-21T23:12:14.821515+0000","last_peered":"2024-02-21T23:12:14.821515+0000","last_clean":"2024-02-21T23:12:14.821515+0000","last_became_active":"2024-02-21T23:01:03.218377+0000","last_became_peered":"2024-02-21T23:01:03.218377+0000","last_unstale":"2024-02-21T23:12:14.821515+0000","last_undegraded":"2024-02-21T23:12:14.821515+0000","last_fullsized":"2024-02-21T23:12:14.821515+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:52:50.911363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019364429999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"32'63","reported_seq":146,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.960111+0000","last_change":"2024-02-21T23:12:08.705210+0000","last_active":"2024-02-21T23:12:14.960111+0000","last_peered":"2024-02-21T23:12:14.960111+0000","last_clean":"2024-02-21T23:12:14.960111+0000","last_became_active":"2024-02-21T23:01:03.225085+0000","last_became_peered":"2024-02-21T23:01:03.225085+0000","last_unstale":"2024-02-21T23:12:14.960111+0000","last_undegraded":"2024-02-21T23:12:14.960111+0000","last_fullsized":"2024-02-21T23:12:14.960111+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:39:42.402349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0037249340000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"32'45","reported_seq":128,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.843516+0000","last_change":"2024-02-21T23:12:08.719085+0000","last_active":"2024-02-21T23:12:14.843516+0000","last_peered":"2024-02-21T23:12:14.843516+0000","last_clean":"2024-02-21T23:12:14.843516+0000","last_became_active":"2024-02-21T23:01:03.225925+0000","last_became_peered":"2024-02-21T23:01:03.225925+0000","last_unstale":"2024-02-21T23:12:14.843516+0000","last_undegraded":"2024-02-21T23:12:14.843516+0000","last_fullsized":"2024-02-21T23:12:14.843516+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:04:09.917536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0086580830000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"32'52","reported_seq":135,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.627610+0000","last_change":"2024-02-21T23:12:08.667425+0000","last_active":"2024-02-21T23:12:15.627610+0000","last_peered":"2024-02-21T23:12:15.627610+0000","last_clean":"2024-02-21T23:12:15.627610+0000","last_became_active":"2024-02-21T23:01:03.214488+0000","last_became_peered":"2024-02-21T23:01:03.214488+0000","last_unstale":"2024-02-21T23:12:15.627610+0000","last_undegraded":"2024-02-21T23:12:15.627610+0000","last_fullsized":"2024-02-21T23:12:15.627610+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:12:45.004002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003806336,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8],"acting":[11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"32'76","reported_seq":159,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.822327+0000","last_change":"2024-02-21T23:12:08.715929+0000","last_active":"2024-02-21T23:12:14.822327+0000","last_peered":"2024-02-21T23:12:14.822327+0000","last_clean":"2024-02-21T23:12:14.822327+0000","last_became_active":"2024-02-21T23:01:03.208458+0000","last_became_peered":"2024-02-21T23:01:03.208458+0000","last_unstale":"2024-02-21T23:12:14.822327+0000","last_undegraded":"2024-02-21T23:12:14.822327+0000","last_fullsized":"2024-02-21T23:12:14.822327+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:39:42.402349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041855369999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8],"acting":[2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"32'45","reported_seq":128,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.826929+0000","last_change":"2024-02-21T23:12:08.622658+0000","last_active":"2024-02-21T23:12:14.826929+0000","last_peered":"2024-02-21T23:12:14.826929+0000","last_clean":"2024-02-21T23:12:14.826929+0000","last_became_active":"2024-02-21T23:01:03.206376+0000","last_became_peered":"2024-02-21T23:01:03.206376+0000","last_unstale":"2024-02-21T23:12:14.826929+0000","last_undegraded":"2024-02-21T23:12:14.826929+0000","last_fullsized":"2024-02-21T23:12:14.826929+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:01:00.300776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011228559000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"32'56","reported_seq":139,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.971688+0000","last_change":"2024-02-21T23:12:08.674979+0000","last_active":"2024-02-21T23:12:14.971688+0000","last_peered":"2024-02-21T23:12:14.971688+0000","last_clean":"2024-02-21T23:12:14.971688+0000","last_became_active":"2024-02-21T23:01:03.214922+0000","last_became_peered":"2024-02-21T23:01:03.214922+0000","last_unstale":"2024-02-21T23:12:14.971688+0000","last_undegraded":"2024-02-21T23:12:14.971688+0000","last_fullsized":"2024-02-21T23:12:14.971688+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:23:08.703440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040330870000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"32'59","reported_seq":142,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.825264+0000","last_change":"2024-02-21T23:12:08.623727+0000","last_active":"2024-02-21T23:12:14.825264+0000","last_peered":"2024-02-21T23:12:14.825264+0000","last_clean":"2024-02-21T23:12:14.825264+0000","last_became_active":"2024-02-21T23:01:03.213428+0000","last_became_peered":"2024-02-21T23:01:03.213428+0000","last_unstale":"2024-02-21T23:12:14.825264+0000","last_undegraded":"2024-02-21T23:12:14.825264+0000","last_fullsized":"2024-02-21T23:12:14.825264+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:37:40.493779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011202166,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"32'58","reported_seq":141,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.240978+0000","last_change":"2024-02-21T23:12:08.608072+0000","last_active":"2024-02-21T23:12:15.240978+0000","last_peered":"2024-02-21T23:12:15.240978+0000","last_clean":"2024-02-21T23:12:15.240978+0000","last_became_active":"2024-02-21T23:01:03.215580+0000","last_became_peered":"2024-02-21T23:01:03.215580+0000","last_unstale":"2024-02-21T23:12:15.240978+0000","last_undegraded":"2024-02-21T23:12:15.240978+0000","last_fullsized":"2024-02-21T23:12:15.240978+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:47:27.962126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023411170000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"32'65","reported_seq":148,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.843676+0000","last_change":"2024-02-21T23:12:08.718997+0000","last_active":"2024-02-21T23:12:14.843676+0000","last_peered":"2024-02-21T23:12:14.843676+0000","last_clean":"2024-02-21T23:12:14.843676+0000","last_became_active":"2024-02-21T23:01:03.223861+0000","last_became_peered":"2024-02-21T23:01:03.223861+0000","last_unstale":"2024-02-21T23:12:14.843676+0000","last_undegraded":"2024-02-21T23:12:14.843676+0000","last_fullsized":"2024-02-21T23:12:14.843676+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:13:25.637195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0087043620000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"32'67","reported_seq":150,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.627612+0000","last_change":"2024-02-21T23:12:08.666440+0000","last_active":"2024-02-21T23:12:15.627612+0000","last_peered":"2024-02-21T23:12:15.627612+0000","last_clean":"2024-02-21T23:12:15.627612+0000","last_became_active":"2024-02-21T23:01:03.212691+0000","last_became_peered":"2024-02-21T23:01:03.212691+0000","last_unstale":"2024-02-21T23:12:15.627612+0000","last_undegraded":"2024-02-21T23:12:15.627612+0000","last_fullsized":"2024-02-21T23:12:15.627612+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:13:25.637195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0030459049999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"32'58","reported_seq":141,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.822200+0000","last_change":"2024-02-21T23:12:08.716680+0000","last_active":"2024-02-21T23:12:14.822200+0000","last_peered":"2024-02-21T23:12:14.822200+0000","last_clean":"2024-02-21T23:12:14.822200+0000","last_became_active":"2024-02-21T23:01:03.217613+0000","last_became_peered":"2024-02-21T23:01:03.217613+0000","last_unstale":"2024-02-21T23:12:14.822200+0000","last_undegraded":"2024-02-21T23:12:14.822200+0000","last_fullsized":"2024-02-21T23:12:14.822200+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:04:09.917536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0051553379999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"32'62","reported_seq":145,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.156874+0000","last_change":"2024-02-21T23:12:08.616485+0000","last_active":"2024-02-21T23:12:15.156874+0000","last_peered":"2024-02-21T23:12:15.156874+0000","last_clean":"2024-02-21T23:12:15.156874+0000","last_became_active":"2024-02-21T23:01:03.214165+0000","last_became_peered":"2024-02-21T23:01:03.214165+0000","last_unstale":"2024-02-21T23:12:15.156874+0000","last_undegraded":"2024-02-21T23:12:15.156874+0000","last_fullsized":"2024-02-21T23:12:15.156874+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:44:37.422634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00687764,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1],"acting":[9,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"32'51","reported_seq":134,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.629222+0000","last_change":"2024-02-21T23:12:08.668135+0000","last_active":"2024-02-21T23:12:15.629222+0000","last_peered":"2024-02-21T23:12:15.629222+0000","last_clean":"2024-02-21T23:12:15.629222+0000","last_became_active":"2024-02-21T23:01:03.213755+0000","last_became_peered":"2024-02-21T23:01:03.213755+0000","last_unstale":"2024-02-21T23:12:15.629222+0000","last_undegraded":"2024-02-21T23:12:15.629222+0000","last_fullsized":"2024-02-21T23:12:15.629222+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:01:36.467676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041418410000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"32'59","reported_seq":142,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.241655+0000","last_change":"2024-02-21T23:12:08.608309+0000","last_active":"2024-02-21T23:12:15.241655+0000","last_peered":"2024-02-21T23:12:15.241655+0000","last_clean":"2024-02-21T23:12:15.241655+0000","last_became_active":"2024-02-21T23:01:03.216345+0000","last_became_peered":"2024-02-21T23:01:03.216345+0000","last_unstale":"2024-02-21T23:12:15.241655+0000","last_undegraded":"2024-02-21T23:12:15.241655+0000","last_fullsized":"2024-02-21T23:12:15.241655+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:44:37.422634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027043900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"32'62","reported_seq":145,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.959952+0000","last_change":"2024-02-21T23:12:08.706913+0000","last_active":"2024-02-21T23:12:14.959952+0000","last_peered":"2024-02-21T23:12:14.959952+0000","last_clean":"2024-02-21T23:12:14.959952+0000","last_became_active":"2024-02-21T23:01:03.225574+0000","last_became_peered":"2024-02-21T23:01:03.225574+0000","last_unstale":"2024-02-21T23:12:14.959952+0000","last_undegraded":"2024-02-21T23:12:14.959952+0000","last_fullsized":"2024-02-21T23:12:14.959952+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:12:45.004002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0048553650000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"32'64","reported_seq":147,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.959843+0000","last_change":"2024-02-21T23:12:08.704695+0000","last_active":"2024-02-21T23:12:14.959843+0000","last_peered":"2024-02-21T23:12:14.959843+0000","last_clean":"2024-02-21T23:12:14.959843+0000","last_became_active":"2024-02-21T23:01:03.217938+0000","last_became_peered":"2024-02-21T23:01:03.217938+0000","last_unstale":"2024-02-21T23:12:14.959843+0000","last_undegraded":"2024-02-21T23:12:14.959843+0000","last_fullsized":"2024-02-21T23:12:14.959843+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:59:08.183972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003564963,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8],"acting":[0,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"32'61","reported_seq":143,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.843531+0000","last_change":"2024-02-21T23:12:08.717094+0000","last_active":"2024-02-21T23:12:14.843531+0000","last_peered":"2024-02-21T23:12:14.843531+0000","last_clean":"2024-02-21T23:12:14.843531+0000","last_became_active":"2024-02-21T23:01:03.225449+0000","last_became_peered":"2024-02-21T23:01:03.225449+0000","last_unstale":"2024-02-21T23:12:14.843531+0000","last_undegraded":"2024-02-21T23:12:14.843531+0000","last_fullsized":"2024-02-21T23:12:14.843531+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:53:32.848973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.006971741,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10],"acting":[6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"32'49","reported_seq":131,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.823390+0000","last_change":"2024-02-21T23:12:08.717258+0000","last_active":"2024-02-21T23:12:14.823390+0000","last_peered":"2024-02-21T23:12:14.823390+0000","last_clean":"2024-02-21T23:12:14.823390+0000","last_became_active":"2024-02-21T23:01:03.208446+0000","last_became_peered":"2024-02-21T23:01:03.208446+0000","last_unstale":"2024-02-21T23:12:14.823390+0000","last_undegraded":"2024-02-21T23:12:14.823390+0000","last_fullsized":"2024-02-21T23:12:14.823390+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:23:47.543277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0075836849999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"32'63","reported_seq":145,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.347830+0000","last_change":"2024-02-21T23:12:08.714531+0000","last_active":"2024-02-21T23:12:15.347830+0000","last_peered":"2024-02-21T23:12:15.347830+0000","last_clean":"2024-02-21T23:12:15.347830+0000","last_became_active":"2024-02-21T23:01:03.217925+0000","last_became_peered":"2024-02-21T23:01:03.217925+0000","last_unstale":"2024-02-21T23:12:15.347830+0000","last_undegraded":"2024-02-21T23:12:15.347830+0000","last_fullsized":"2024-02-21T23:12:15.347830+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:11:24.214077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040956530000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8],"acting":[7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"32'65","reported_seq":147,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.876194+0000","last_change":"2024-02-21T23:12:08.665828+0000","last_active":"2024-02-21T23:12:14.876194+0000","last_peered":"2024-02-21T23:12:14.876194+0000","last_clean":"2024-02-21T23:12:14.876194+0000","last_became_active":"2024-02-21T23:01:03.211921+0000","last_became_peered":"2024-02-21T23:01:03.211921+0000","last_unstale":"2024-02-21T23:12:14.876194+0000","last_undegraded":"2024-02-21T23:12:14.876194+0000","last_fullsized":"2024-02-21T23:12:14.876194+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:39:43.532897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001167464,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2],"acting":[10,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"32'69","reported_seq":151,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.240765+0000","last_change":"2024-02-21T23:12:08.609207+0000","last_active":"2024-02-21T23:12:15.240765+0000","last_peered":"2024-02-21T23:12:15.240765+0000","last_clean":"2024-02-21T23:12:15.240765+0000","last_became_active":"2024-02-21T23:01:03.216580+0000","last_became_peered":"2024-02-21T23:01:03.216580+0000","last_unstale":"2024-02-21T23:12:15.240765+0000","last_undegraded":"2024-02-21T23:12:15.240765+0000","last_fullsized":"2024-02-21T23:12:15.240765+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:31:33.327648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028130189999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"32'51","reported_seq":133,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.825163+0000","last_change":"2024-02-21T23:12:08.622328+0000","last_active":"2024-02-21T23:12:14.825163+0000","last_peered":"2024-02-21T23:12:14.825163+0000","last_clean":"2024-02-21T23:12:14.825163+0000","last_became_active":"2024-02-21T23:01:03.211811+0000","last_became_peered":"2024-02-21T23:01:03.211811+0000","last_unstale":"2024-02-21T23:12:14.825163+0000","last_undegraded":"2024-02-21T23:12:14.825163+0000","last_fullsized":"2024-02-21T23:12:14.825163+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:23:08.703440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010173674000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"32'65","reported_seq":147,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.347545+0000","last_change":"2024-02-21T23:12:08.715177+0000","last_active":"2024-02-21T23:12:15.347545+0000","last_peered":"2024-02-21T23:12:15.347545+0000","last_clean":"2024-02-21T23:12:15.347545+0000","last_became_active":"2024-02-21T23:01:03.223255+0000","last_became_peered":"2024-02-21T23:01:03.223255+0000","last_unstale":"2024-02-21T23:12:15.347545+0000","last_undegraded":"2024-02-21T23:12:15.347545+0000","last_fullsized":"2024-02-21T23:12:15.347545+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:51:26.354389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0045391540000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9],"acting":[7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"32'59","reported_seq":141,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.875584+0000","last_change":"2024-02-21T23:12:08.665498+0000","last_active":"2024-02-21T23:12:14.875584+0000","last_peered":"2024-02-21T23:12:14.875584+0000","last_clean":"2024-02-21T23:12:14.875584+0000","last_became_active":"2024-02-21T23:01:03.209569+0000","last_became_peered":"2024-02-21T23:01:03.209569+0000","last_unstale":"2024-02-21T23:12:14.875584+0000","last_undegraded":"2024-02-21T23:12:14.875584+0000","last_fullsized":"2024-02-21T23:12:14.875584+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:20:38.984727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015588990000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9],"acting":[10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"32'56","reported_seq":138,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.062741+0000","last_change":"2024-02-21T23:12:08.713984+0000","last_active":"2024-02-21T23:12:15.062741+0000","last_peered":"2024-02-21T23:12:15.062741+0000","last_clean":"2024-02-21T23:12:15.062741+0000","last_became_active":"2024-02-21T23:01:03.213941+0000","last_became_peered":"2024-02-21T23:01:03.213941+0000","last_unstale":"2024-02-21T23:12:15.062741+0000","last_undegraded":"2024-02-21T23:12:15.062741+0000","last_fullsized":"2024-02-21T23:12:15.062741+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:44:37.422634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041976929999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3],"acting":[8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"32'49","reported_seq":132,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.823155+0000","last_change":"2024-02-21T23:12:08.716284+0000","last_active":"2024-02-21T23:12:14.823155+0000","last_peered":"2024-02-21T23:12:14.823155+0000","last_clean":"2024-02-21T23:12:14.823155+0000","last_became_active":"2024-02-21T23:01:03.206762+0000","last_became_peered":"2024-02-21T23:01:03.206762+0000","last_unstale":"2024-02-21T23:12:14.823155+0000","last_undegraded":"2024-02-21T23:12:14.823155+0000","last_fullsized":"2024-02-21T23:12:14.823155+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:01:36.467676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068220390000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8],"acting":[4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"32'65","reported_seq":148,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.960225+0000","last_change":"2024-02-21T23:12:08.708085+0000","last_active":"2024-02-21T23:12:14.960225+0000","last_peered":"2024-02-21T23:12:14.960225+0000","last_clean":"2024-02-21T23:12:14.960225+0000","last_became_active":"2024-02-21T23:01:03.221672+0000","last_became_peered":"2024-02-21T23:01:03.221672+0000","last_unstale":"2024-02-21T23:12:14.960225+0000","last_undegraded":"2024-02-21T23:12:14.960225+0000","last_fullsized":"2024-02-21T23:12:14.960225+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:11:24.214077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0057510360000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"32'41","reported_seq":124,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.960616+0000","last_change":"2024-02-21T23:12:08.706177+0000","last_active":"2024-02-21T23:12:14.960616+0000","last_peered":"2024-02-21T23:12:14.960616+0000","last_clean":"2024-02-21T23:12:14.960616+0000","last_became_active":"2024-02-21T23:01:03.219379+0000","last_became_peered":"2024-02-21T23:01:03.219379+0000","last_unstale":"2024-02-21T23:12:14.960616+0000","last_undegraded":"2024-02-21T23:12:14.960616+0000","last_fullsized":"2024-02-21T23:12:14.960616+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:53:08.201764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00417075,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11],"acting":[0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"32'44","reported_seq":127,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.629039+0000","last_change":"2024-02-21T23:12:08.668249+0000","last_active":"2024-02-21T23:12:15.629039+0000","last_peered":"2024-02-21T23:12:15.629039+0000","last_clean":"2024-02-21T23:12:15.629039+0000","last_became_active":"2024-02-21T23:01:03.212878+0000","last_became_peered":"2024-02-21T23:01:03.212878+0000","last_unstale":"2024-02-21T23:12:15.629039+0000","last_undegraded":"2024-02-21T23:12:15.629039+0000","last_fullsized":"2024-02-21T23:12:15.629039+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:23:47.543277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042655480000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":26460371,"num_objects":3449,"num_object_clones":0,"num_object_copies":13796,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3449,"num_whiteouts":0,"num_read":1,"num_read_kb":1270,"num_write":9636,"num_write_kb":38355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":91508736,"data_stored":98402304,"data_compressed":4659312,"data_compressed_allocated":5701632,"data_compressed_original":12595200,"omap_allocated":0,"internal_metadata":0},"log_size":10826,"ondisk_log_size":10826,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3698,"ondisk_log_size":3698,"up":128,"acting":128,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":60973696,"num_objects":267,"num_object_clones":0,"num_object_copies":534,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":267,"num_whiteouts":0,"num_read":6585,"num_read_kb":62538,"num_write":2281,"num_write_kb":69704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":221,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":26804224,"data_stored":121947392,"data_compressed":17887090,"data_compressed_allocated":22609920,"data_compressed_original":117915648,"omap_allocated":0,"internal_metadata":0},"log_size":1638,"ondisk_log_size":1638,"up":64,"acting":64,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66458,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":11,"up_from":17,"seq":73014444179,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46372,"kb_used_data":6872,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94325468,"statfs":{"total":96636764160,"available":96589279232,"internally_reserved":0,"allocated":7036928,"data_stored":7192237,"data_compressed":328586,"data_compressed_allocated":405504,"data_compressed_original":815104,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":17,"seq":73014444178,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49200,"kb_used_data":9700,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94322640,"statfs":{"total":96636764160,"available":96586383360,"internally_reserved":0,"allocated":9932800,"data_stored":22999079,"data_compressed":2652432,"data_compressed_allocated":3399680,"data_compressed_original":16744448,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":17,"seq":73014444179,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50584,"kb_used_data":11088,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94321256,"statfs":{"total":96636764160,"available":96584966144,"internally_reserved":0,"allocated":11354112,"data_stored":15511303,"data_compressed":1072430,"data_compressed_allocated":1388544,"data_compressed_original":5804032,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":17,"seq":73014444178,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47140,"kb_used_data":7644,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94324700,"statfs":{"total":96636764160,"available":96588492800,"internally_reserved":0,"allocated":7827456,"data_stored":21888259,"data_compressed":2896373,"data_compressed_allocated":3649536,"data_compressed_original":17977344,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,3,4,5,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":17,"seq":73014444179,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39008,"kb_used_data":11988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94332832,"statfs":{"total":96636764160,"available":96596819968,"internally_reserved":0,"allocated":12275712,"data_stored":26096945,"data_compressed":2815859,"data_compressed_allocated":3579904,"data_compressed_original":17661952,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":17,"seq":73014444178,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44888,"kb_used_data":9548,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94326952,"statfs":{"total":96636764160,"available":96590798848,"internally_reserved":0,"allocated":9777152,"data_stored":13577476,"data_compressed":1118839,"data_compressed_allocated":1355776,"data_compressed_original":5414912,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":17,"seq":73014444179,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41616,"kb_used_data":14596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94330224,"statfs":{"total":96636764160,"available":96594149376,"internally_reserved":0,"allocated":14946304,"data_stored":30254498,"data_compressed":3332972,"data_compressed_allocated":4235264,"data_compressed_original":19828736,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":17,"seq":73014444179,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49440,"kb_used_data":9940,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94322400,"statfs":{"total":96636764160,"available":96586137600,"internally_reserved":0,"allocated":10178560,"data_stored":10999294,"data_compressed":671953,"data_compressed_allocated":815104,"data_compressed_original":1896448,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":17,"seq":73014444179,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46940,"kb_used_data":7440,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94324900,"statfs":{"total":96636764160,"available":96588697600,"internally_reserved":0,"allocated":7618560,"data_stored":11946061,"data_compressed":1296354,"data_compressed_allocated":1605632,"data_compressed_original":6193152,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444179,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52736,"kb_used_data":13236,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94319104,"statfs":{"total":96636764160,"available":96582762496,"internally_reserved":0,"allocated":13553664,"data_stored":37826176,"data_compressed":5011784,"data_compressed_allocated":6279168,"data_compressed_original":30818304,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":17,"seq":73014444179,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49508,"kb_used_data":10008,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94322332,"statfs":{"total":96636764160,"available":96586067968,"internally_reserved":0,"allocated":10248192,"data_stored":13655815,"data_compressed":1001090,"data_compressed_allocated":1249280,"data_compressed_original":4915200,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":17,"seq":73014444179,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44084,"kb_used_data":8744,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327756,"statfs":{"total":96636764160,"available":96591622144,"internally_reserved":0,"allocated":8953856,"data_stored":12521357,"data_compressed":892256,"data_compressed_allocated":1126400,"data_compressed_original":4964352,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33229,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33229,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":831488,"data_stored":4195110,"data_compressed":654518,"data_compressed_allocated":794624,"data_compressed_original":4177920,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":983040,"data_stored":4194976,"data_compressed":615592,"data_compressed_allocated":782336,"data_compressed_original":4001792,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6569984,"data_stored":30536217,"data_compressed":4544343,"data_compressed_allocated":5718016,"data_compressed_original":29700096,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":962560,"data_stored":4484070,"data_compressed":694867,"data_compressed_allocated":851968,"data_compressed_original":4382720,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":63895,"data_compressed":8106,"data_compressed_allocated":12288,"data_compressed_original":36864,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4325376,"data_stored":18609947,"data_compressed":2736860,"data_compressed_allocated":3469312,"data_compressed_original":17784832,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1032192,"data_stored":4546717,"data_compressed":692215,"data_compressed_allocated":839680,"data_compressed_original":4362240,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":3792896,"data_stored":16778922,"data_compressed":2462264,"data_compressed_allocated":3121152,"data_compressed_original":16113664,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":3510272,"data_stored":17170588,"data_compressed":2509837,"data_compressed_allocated":3166208,"data_compressed_original":16842752,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":827392,"data_stored":4588192,"data_compressed":597133,"data_compressed_allocated":802816,"data_compressed_original":4571136,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":3915776,"data_stored":16778176,"data_compressed":2371355,"data_compressed_allocated":3051520,"data_compressed_original":15941632,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":7684096,"data_stored":8081408,"data_compressed":197899,"data_compressed_allocated":274432,"data_compressed_original":671744,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8826880,"data_stored":9216000,"data_compressed":345659,"data_compressed_allocated":409600,"data_compressed_original":798720,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6545408,"data_stored":7045120,"data_compressed":427602,"data_compressed_allocated":503808,"data_compressed_original":1003520,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6217728,"data_stored":7217152,"data_compressed":561648,"data_compressed_allocated":696320,"data_compressed_original":1695744,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":9691136,"data_stored":10690560,"data_compressed":624008,"data_compressed_allocated":745472,"data_compressed_original":1744896,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":10117120,"data_stored":10809344,"data_compressed":523044,"data_compressed_allocated":663552,"data_compressed_original":1355776,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8306688,"data_stored":8785920,"data_compressed":386785,"data_compressed_allocated":458752,"data_compressed_original":937984,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":7979008,"data_stored":8482816,"data_compressed":280527,"data_compressed_allocated":356352,"data_compressed_original":860160,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":3878912,"data_stored":4472832,"data_compressed":346697,"data_compressed_allocated":425984,"data_compressed_original":1019904,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":10088448,"data_stored":10678272,"data_compressed":435458,"data_compressed_allocated":528384,"data_compressed_original":1118208,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":5578752,"data_stored":5976064,"data_compressed":241238,"data_compressed_allocated":290816,"data_compressed_original":688128,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":6594560,"data_stored":6946816,"data_compressed":288747,"data_compressed_allocated":348160,"data_compressed_original":700416,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-21T23:13:02.774 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-21T23:13:03.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.057+0000 7f8937200640 1 Processor -- start 2024-02-21T23:13:03.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.057+0000 7f8937200640 1 -- start start 2024-02-21T23:13:03.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.059+0000 7f8937200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f893818a010 0x7f893818b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:03.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.059+0000 7f8937200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f89380719b0 0x7f8938071e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:03.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.059+0000 7f8937200640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f893818a600 con 0x7f8938182a80 2024-02-21T23:13:03.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.059+0000 7f8937200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f893818bec0 con 0x7f89380719b0 2024-02-21T23:13:03.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.059+0000 7f8937200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f893818a8e0 con 0x7f893818a010 2024-02-21T23:13:03.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.059+0000 7f8935e00640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f8938182a80 0x7f8938186a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:58192/0 (socket says 172.21.15.99:58192) 2024-02-21T23:13:03.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.059+0000 7f8935e00640 1 -- 172.21.15.99:0/179825152 learned_addr learned my addr 172.21.15.99:0/179825152 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:13:03.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.059+0000 7f8936800640 1 --2- 172.21.15.99:0/179825152 >> v2:172.21.15.99:3300/0 conn(0x7f89380719b0 0x7f8938071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:03.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.059+0000 7f8935400640 1 --2- 172.21.15.99:0/179825152 >> v2:172.21.15.162:3300/0 conn(0x7f893818a010 0x7f893818b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:03.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.060+0000 7f8934a00640 1 -- 172.21.15.99:0/179825152 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3394372080 0 0) 0x7f893818a600 con 0x7f8938182a80 2024-02-21T23:13:03.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.060+0000 7f8934a00640 1 -- 172.21.15.99:0/179825152 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f891c003520 con 0x7f8938182a80 2024-02-21T23:13:03.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.060+0000 7f8936800640 1 -- 172.21.15.99:0/179825152 >> v2:172.21.15.162:3300/0 conn(0x7f893818a010 msgr2=0x7f893818b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:13:03.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.060+0000 7f8936800640 1 --2- 172.21.15.99:0/179825152 >> v2:172.21.15.162:3300/0 conn(0x7f893818a010 0x7f893818b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:03.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.060+0000 7f8936800640 1 -- 172.21.15.99:0/179825152 >> v1:172.21.15.181:6789/0 conn(0x7f8938182a80 legacy=0x7f8938186a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:03.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.060+0000 7f8936800640 1 -- 172.21.15.99:0/179825152 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f893818abc0 con 0x7f89380719b0 2024-02-21T23:13:03.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.060+0000 7f8935400640 1 --2- 172.21.15.99:0/179825152 >> v2:172.21.15.162:3300/0 conn(0x7f893818a010 0x7f893818b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:13:03.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.061+0000 7f8936800640 1 --2- 172.21.15.99:0/179825152 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89380719b0 0x7f8938071e40 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f893815afe0 tx=0x7f893002bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ca55aada5350866 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:03.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.062+0000 7f8934a00640 1 -- 172.21.15.99:0/179825152 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8930039070 con 0x7f89380719b0 2024-02-21T23:13:03.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.062+0000 7f8934a00640 1 -- 172.21.15.99:0/179825152 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f893002cb50 con 0x7f89380719b0 2024-02-21T23:13:03.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.062+0000 7f8934a00640 1 -- 172.21.15.99:0/179825152 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8930034440 con 0x7f89380719b0 2024-02-21T23:13:03.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.062+0000 7f8937200640 1 -- 172.21.15.99:0/179825152 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89380719b0 msgr2=0x7f8938071e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:03.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.062+0000 7f8937200640 1 --2- 172.21.15.99:0/179825152 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89380719b0 0x7f8938071e40 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f893815afe0 tx=0x7f893002bda0 comp rx=0 tx=0).stop 2024-02-21T23:13:03.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.062+0000 7f8937200640 1 -- 172.21.15.99:0/179825152 shutdown_connections 2024-02-21T23:13:03.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.062+0000 7f8937200640 1 --2- 172.21.15.99:0/179825152 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f89380719b0 0x7f8938071e40 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:03.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.062+0000 7f8937200640 1 --2- 172.21.15.99:0/179825152 >> v2:172.21.15.162:3300/0 conn(0x7f893818a010 0x7f893818b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:03.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.062+0000 7f8937200640 1 -- 172.21.15.99:0/179825152 >> 172.21.15.99:0/179825152 conn(0x7f89380d29f0 msgr2=0x7f89380d2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:03.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.062+0000 7f8937200640 1 -- 172.21.15.99:0/179825152 shutdown_connections 2024-02-21T23:13:03.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.063+0000 7f8937200640 1 -- 172.21.15.99:0/179825152 wait complete. 2024-02-21T23:13:03.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.066+0000 7f8937200640 1 Processor -- start 2024-02-21T23:13:03.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.066+0000 7f8937200640 1 -- start start 2024-02-21T23:13:03.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.068+0000 7f8937200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f89380719b0 0x7f893817f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:03.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.068+0000 7f8937200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8938182a80 0x7f89380f9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:03.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.068+0000 7f8937200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f893818a010 0x7f893821c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:03.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.068+0000 7f8937200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f893818b460 con 0x7f8938182a80 2024-02-21T23:13:03.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.068+0000 7f8937200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f893818b180 con 0x7f893818a010 2024-02-21T23:13:03.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.068+0000 7f8937200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8938182e60 con 0x7f89380719b0 2024-02-21T23:13:03.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.068+0000 7f8935400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8938182a80 0x7f89380f9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:03.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.068+0000 7f8935400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8938182a80 0x7f89380f9100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53158/0 (socket says 172.21.15.99:53158) 2024-02-21T23:13:03.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.068+0000 7f8935400640 1 -- 172.21.15.99:0/2395051855 learned_addr learned my addr 172.21.15.99:0/2395051855 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:13:03.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.068+0000 7f8935e00640 1 --2- 172.21.15.99:0/2395051855 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f89380719b0 0x7f893817f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:03.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.068+0000 7f8936800640 1 --2- 172.21.15.99:0/2395051855 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f893818a010 0x7f893821c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:03.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.069+0000 7f8935400640 1 -- 172.21.15.99:0/2395051855 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f89380719b0 msgr2=0x7f893817f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:03.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.069+0000 7f8935400640 1 --2- 172.21.15.99:0/2395051855 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f89380719b0 0x7f893817f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:03.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.069+0000 7f8935400640 1 -- 172.21.15.99:0/2395051855 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f893818a010 msgr2=0x7f893821c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:03.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.069+0000 7f8935400640 1 --2- 172.21.15.99:0/2395051855 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f893818a010 0x7f893821c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:03.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.069+0000 7f8935400640 1 -- 172.21.15.99:0/2395051855 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f893817f620 con 0x7f8938182a80 2024-02-21T23:13:03.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.069+0000 7f8935400640 1 --2- 172.21.15.99:0/2395051855 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8938182a80 0x7f89380f9100 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f892400ebe0 tx=0x7f892400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:03.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.069+0000 7f892e000640 1 -- 172.21.15.99:0/2395051855 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892400cc30 con 0x7f8938182a80 2024-02-21T23:13:03.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.069+0000 7f892e000640 1 -- 172.21.15.99:0/2395051855 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f892400cdd0 con 0x7f8938182a80 2024-02-21T23:13:03.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.069+0000 7f892e000640 1 -- 172.21.15.99:0/2395051855 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8924005bb0 con 0x7f8938182a80 2024-02-21T23:13:03.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.069+0000 7f8937200640 1 -- 172.21.15.99:0/2395051855 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89380f9a40 con 0x7f8938182a80 2024-02-21T23:13:03.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.069+0000 7f8937200640 1 -- 172.21.15.99:0/2395051855 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89380fa000 con 0x7f8938182a80 2024-02-21T23:13:03.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.071+0000 7f8937200640 1 -- 172.21.15.99:0/2395051855 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8938068320 con 0x7f8938182a80 2024-02-21T23:13:03.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.073+0000 7f892e000640 1 -- 172.21.15.99:0/2395051855 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f8924006030 con 0x7f8938182a80 2024-02-21T23:13:03.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.074+0000 7f892e000640 1 --2- 172.21.15.99:0/2395051855 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f891809eed0 0x7f89180a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:03.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.074+0000 7f892e000640 1 -- 172.21.15.99:0/2395051855 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f89240ca6a0 con 0x7f8938182a80 2024-02-21T23:13:03.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.074+0000 7f8935e00640 1 --2- 172.21.15.99:0/2395051855 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f891809eed0 0x7f89180a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:03.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.075+0000 7f8935e00640 1 --2- 172.21.15.99:0/2395051855 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f891809eed0 0x7f89180a1390 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f89280011e0 tx=0x7f8928007d30 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:03.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.081+0000 7f892e000640 1 -- 172.21.15.99:0/2395051855 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f8924017020 con 0x7f8938182a80 2024-02-21T23:13:03.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.279+0000 7f8937200640 1 -- 172.21.15.99:0/2395051855 --> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f89380cfdc0 con 0x7f891809eed0 2024-02-21T23:13:03.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.289+0000 7f892e000640 1 -- 172.21.15.99:0/2395051855 <== mgr.5131 v2:172.21.15.162:6800/631076050 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+342680 (secure 0 0 0) 0x7f89380cfdc0 con 0x7f891809eed0 2024-02-21T23:13:03.282 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T23:13:03.284 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-02-21T23:13:03.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.295+0000 7f8937200640 1 -- 172.21.15.99:0/2395051855 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f891809eed0 msgr2=0x7f89180a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:03.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.295+0000 7f8937200640 1 --2- 172.21.15.99:0/2395051855 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f891809eed0 0x7f89180a1390 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f89280011e0 tx=0x7f8928007d30 comp rx=0 tx=0).stop 2024-02-21T23:13:03.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.295+0000 7f8937200640 1 -- 172.21.15.99:0/2395051855 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8938182a80 msgr2=0x7f89380f9100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:03.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.295+0000 7f8937200640 1 --2- 172.21.15.99:0/2395051855 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8938182a80 0x7f89380f9100 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f892400ebe0 tx=0x7f892400c520 comp rx=0 tx=0).stop 2024-02-21T23:13:03.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.296+0000 7f8937200640 1 -- 172.21.15.99:0/2395051855 shutdown_connections 2024-02-21T23:13:03.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.296+0000 7f8937200640 1 --2- 172.21.15.99:0/2395051855 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f891809eed0 0x7f89180a1390 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:03.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.296+0000 7f8937200640 1 --2- 172.21.15.99:0/2395051855 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f893818a010 0x7f893821c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:03.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.296+0000 7f8937200640 1 --2- 172.21.15.99:0/2395051855 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8938182a80 0x7f89380f9100 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:03.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.296+0000 7f8937200640 1 --2- 172.21.15.99:0/2395051855 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f89380719b0 0x7f893817f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:03.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.296+0000 7f8937200640 1 -- 172.21.15.99:0/2395051855 >> 172.21.15.99:0/2395051855 conn(0x7f89380d29f0 msgr2=0x7f89380d2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:03.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.296+0000 7f8937200640 1 -- 172.21.15.99:0/2395051855 shutdown_connections 2024-02-21T23:13:03.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.296+0000 7f8937200640 1 -- 172.21.15.99:0/2395051855 wait complete. 2024-02-21T23:13:03.306 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":335,"stamp":"2024-02-21T23:13:02.221630+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":88024435,"num_objects":3718,"num_object_clones":0,"num_object_copies":14334,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3718,"num_whiteouts":0,"num_read":6823,"num_read_kb":64138,"num_write":12118,"num_write_kb":110997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":221,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16310,"ondisk_log_size":16310,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1132462080,"kb_used":561516,"kb_used_data":120804,"kb_used_omap":18,"kb_used_meta":440557,"kb_avail":1131900564,"statfs":{"total":1159641169920,"available":1159066177536,"internally_reserved":0,"allocated":123703296,"data_stored":224468500,"data_compressed":23090928,"data_compressed_allocated":29089792,"data_compressed_original":133033984,"omap_allocated":19138,"internal_metadata":451130686},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":30,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003462"},"pg_stats":[{"pgid":"2.1f","version":"32'20","reported_seq":96,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.157454+0000","last_change":"2024-02-21T23:01:02.208441+0000","last_active":"2024-02-21T23:12:15.157454+0000","last_peered":"2024-02-21T23:12:15.157454+0000","last_clean":"2024-02-21T23:12:15.157454+0000","last_became_active":"2024-02-21T23:01:02.208124+0000","last_became_peered":"2024-02-21T23:01:02.208124+0000","last_unstale":"2024-02-21T23:12:15.157454+0000","last_undegraded":"2024-02-21T23:12:15.157454+0000","last_fullsized":"2024-02-21T23:12:15.157454+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:21:29.919968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":27,"num_read_kb":4118,"num_write":27,"num_write_kb":4186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7],"acting":[9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"32'57","reported_seq":140,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.826448+0000","last_change":"2024-02-21T23:12:08.621080+0000","last_active":"2024-02-21T23:12:14.826448+0000","last_peered":"2024-02-21T23:12:14.826448+0000","last_clean":"2024-02-21T23:12:14.826448+0000","last_became_active":"2024-02-21T23:01:03.214170+0000","last_became_peered":"2024-02-21T23:01:03.214170+0000","last_unstale":"2024-02-21T23:12:14.826448+0000","last_undegraded":"2024-02-21T23:12:14.826448+0000","last_fullsized":"2024-02-21T23:12:14.826448+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:51:26.354389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010343064000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"35'364","reported_seq":424,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.821913+0000","last_change":"2024-02-21T23:12:08.712606+0000","last_active":"2024-02-21T23:12:14.821913+0000","last_peered":"2024-02-21T23:12:14.821913+0000","last_clean":"2024-02-21T23:12:14.821913+0000","last_became_active":"2024-02-21T23:01:07.276192+0000","last_became_peered":"2024-02-21T23:01:07.276192+0000","last_unstale":"2024-02-21T23:12:14.821913+0000","last_undegraded":"2024-02-21T23:12:14.821913+0000","last_fullsized":"2024-02-21T23:12:14.821913+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:31:37.375726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0031732990000000001,"stat_sum":{"num_bytes":264461,"num_objects":111,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":111,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":325,"num_write_kb":605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"32'19","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.826733+0000","last_change":"2024-02-21T23:01:02.221231+0000","last_active":"2024-02-21T23:12:14.826733+0000","last_peered":"2024-02-21T23:12:14.826733+0000","last_clean":"2024-02-21T23:12:14.826733+0000","last_became_active":"2024-02-21T23:01:02.220941+0000","last_became_peered":"2024-02-21T23:01:02.220941+0000","last_unstale":"2024-02-21T23:12:14.826733+0000","last_undegraded":"2024-02-21T23:12:14.826733+0000","last_fullsized":"2024-02-21T23:12:14.826733+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:17:06.353018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":17,"num_read_kb":4097,"num_write":22,"num_write_kb":4218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"32'51","reported_seq":134,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.960486+0000","last_change":"2024-02-21T23:12:08.706819+0000","last_active":"2024-02-21T23:12:14.960486+0000","last_peered":"2024-02-21T23:12:14.960486+0000","last_clean":"2024-02-21T23:12:14.960486+0000","last_became_active":"2024-02-21T23:01:03.219221+0000","last_became_peered":"2024-02-21T23:01:03.219221+0000","last_unstale":"2024-02-21T23:12:14.960486+0000","last_undegraded":"2024-02-21T23:12:14.960486+0000","last_fullsized":"2024-02-21T23:12:14.960486+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:13:25.637195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0047645949999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"35'354","reported_seq":414,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.822432+0000","last_change":"2024-02-21T23:12:08.715099+0000","last_active":"2024-02-21T23:12:14.822432+0000","last_peered":"2024-02-21T23:12:14.822432+0000","last_clean":"2024-02-21T23:12:14.822432+0000","last_became_active":"2024-02-21T23:01:07.268179+0000","last_became_peered":"2024-02-21T23:01:07.268179+0000","last_unstale":"2024-02-21T23:12:14.822432+0000","last_undegraded":"2024-02-21T23:12:14.822432+0000","last_fullsized":"2024-02-21T23:12:14.822432+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:12:49.052079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0062260340000000001,"stat_sum":{"num_bytes":615017,"num_objects":99,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":321,"num_write_kb":926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"32'21","reported_seq":94,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.062972+0000","last_change":"2024-02-21T23:01:02.208687+0000","last_active":"2024-02-21T23:12:15.062972+0000","last_peered":"2024-02-21T23:12:15.062972+0000","last_clean":"2024-02-21T23:12:15.062972+0000","last_became_active":"2024-02-21T23:01:02.208393+0000","last_became_peered":"2024-02-21T23:01:02.208393+0000","last_unstale":"2024-02-21T23:12:15.062972+0000","last_undegraded":"2024-02-21T23:12:15.062972+0000","last_fullsized":"2024-02-21T23:12:15.062972+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:41:54.477462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":25,"num_read_kb":8200,"num_write":25,"num_write_kb":8264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"32'66","reported_seq":148,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.240958+0000","last_change":"2024-02-21T23:12:08.608463+0000","last_active":"2024-02-21T23:12:15.240958+0000","last_peered":"2024-02-21T23:12:15.240958+0000","last_clean":"2024-02-21T23:12:15.240958+0000","last_became_active":"2024-02-21T23:01:03.214733+0000","last_became_peered":"2024-02-21T23:01:03.214733+0000","last_unstale":"2024-02-21T23:12:15.240958+0000","last_undegraded":"2024-02-21T23:12:15.240958+0000","last_fullsized":"2024-02-21T23:12:15.240958+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:37:38.558922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002499476,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"35'356","reported_seq":414,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.823223+0000","last_change":"2024-02-21T23:12:08.716734+0000","last_active":"2024-02-21T23:12:14.823223+0000","last_peered":"2024-02-21T23:12:14.823223+0000","last_clean":"2024-02-21T23:12:14.823223+0000","last_became_active":"2024-02-21T23:01:07.279360+0000","last_became_peered":"2024-02-21T23:01:07.279360+0000","last_unstale":"2024-02-21T23:12:14.823223+0000","last_undegraded":"2024-02-21T23:12:14.823223+0000","last_fullsized":"2024-02-21T23:12:14.823223+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":356,"log_dups_size":0,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:01:04.348854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0065566699999999997,"stat_sum":{"num_bytes":1138317,"num_objects":111,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":111,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":317,"num_write_kb":1526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"32'11","reported_seq":59,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.062765+0000","last_change":"2024-02-21T23:01:02.204774+0000","last_active":"2024-02-21T23:12:15.062765+0000","last_peered":"2024-02-21T23:12:15.062765+0000","last_clean":"2024-02-21T23:12:15.062765+0000","last_became_active":"2024-02-21T23:01:02.203992+0000","last_became_peered":"2024-02-21T23:01:02.203992+0000","last_unstale":"2024-02-21T23:12:15.062765+0000","last_undegraded":"2024-02-21T23:12:15.062765+0000","last_fullsized":"2024-02-21T23:12:15.062765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:27:54.333439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1],"acting":[8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"32'56","reported_seq":138,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.972421+0000","last_change":"2024-02-21T23:12:08.673470+0000","last_active":"2024-02-21T23:12:14.972421+0000","last_peered":"2024-02-21T23:12:14.972421+0000","last_clean":"2024-02-21T23:12:14.972421+0000","last_became_active":"2024-02-21T23:01:03.212702+0000","last_became_peered":"2024-02-21T23:01:03.212702+0000","last_unstale":"2024-02-21T23:12:14.972421+0000","last_undegraded":"2024-02-21T23:12:14.972421+0000","last_fullsized":"2024-02-21T23:12:14.972421+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:11:24.214077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003245398,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"35'320","reported_seq":383,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.822700+0000","last_change":"2024-02-21T23:12:08.711329+0000","last_active":"2024-02-21T23:12:14.822700+0000","last_peered":"2024-02-21T23:12:14.822700+0000","last_clean":"2024-02-21T23:12:14.822700+0000","last_became_active":"2024-02-21T23:01:07.268357+0000","last_became_peered":"2024-02-21T23:01:07.268357+0000","last_unstale":"2024-02-21T23:12:14.822700+0000","last_undegraded":"2024-02-21T23:12:14.822700+0000","last_fullsized":"2024-02-21T23:12:14.822700+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:44:32.467350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024180849999999999,"stat_sum":{"num_bytes":206516,"num_objects":100,"num_object_clones":0,"num_object_copies":400,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":290,"num_write_kb":521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"32'53","reported_seq":136,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.348758+0000","last_change":"2024-02-21T23:12:08.716291+0000","last_active":"2024-02-21T23:12:15.348758+0000","last_peered":"2024-02-21T23:12:15.348758+0000","last_clean":"2024-02-21T23:12:15.348758+0000","last_became_active":"2024-02-21T23:01:03.213186+0000","last_became_peered":"2024-02-21T23:01:03.213186+0000","last_unstale":"2024-02-21T23:12:15.348758+0000","last_undegraded":"2024-02-21T23:12:15.348758+0000","last_fullsized":"2024-02-21T23:12:15.348758+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:23:47.543277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0056316350000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"32'38","reported_seq":104,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.062681+0000","last_change":"2024-02-21T23:01:02.208608+0000","last_active":"2024-02-21T23:12:15.062681+0000","last_peered":"2024-02-21T23:12:15.062681+0000","last_clean":"2024-02-21T23:12:15.062681+0000","last_became_active":"2024-02-21T23:01:02.208293+0000","last_became_peered":"2024-02-21T23:01:02.208293+0000","last_unstale":"2024-02-21T23:12:15.062681+0000","last_undegraded":"2024-02-21T23:12:15.062681+0000","last_fullsized":"2024-02-21T23:12:15.062681+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:58:23.554457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":4101,"num_write":38,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"35'339","reported_seq":398,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.822932+0000","last_change":"2024-02-21T23:12:08.715626+0000","last_active":"2024-02-21T23:12:14.822932+0000","last_peered":"2024-02-21T23:12:14.822932+0000","last_clean":"2024-02-21T23:12:14.822932+0000","last_became_active":"2024-02-21T23:01:07.651241+0000","last_became_peered":"2024-02-21T23:01:07.651241+0000","last_unstale":"2024-02-21T23:12:14.822932+0000","last_undegraded":"2024-02-21T23:12:14.822932+0000","last_fullsized":"2024-02-21T23:12:14.822932+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:51:30.402466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0063569689999999996,"stat_sum":{"num_bytes":696245,"num_objects":110,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":302,"num_write_kb":1168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"32'59","reported_seq":142,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.826174+0000","last_change":"2024-02-21T23:12:08.620654+0000","last_active":"2024-02-21T23:12:14.826174+0000","last_peered":"2024-02-21T23:12:14.826174+0000","last_clean":"2024-02-21T23:12:14.826174+0000","last_became_active":"2024-02-21T23:01:03.219898+0000","last_became_peered":"2024-02-21T23:01:03.219898+0000","last_unstale":"2024-02-21T23:12:14.826174+0000","last_undegraded":"2024-02-21T23:12:14.826174+0000","last_fullsized":"2024-02-21T23:12:14.826174+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:01:36.467676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0098155299999999994,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"32'34","reported_seq":83,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.821840+0000","last_change":"2024-02-21T23:01:02.202866+0000","last_active":"2024-02-21T23:12:14.821840+0000","last_peered":"2024-02-21T23:12:14.821840+0000","last_clean":"2024-02-21T23:12:14.821840+0000","last_became_active":"2024-02-21T23:01:02.202585+0000","last_became_peered":"2024-02-21T23:01:02.202585+0000","last_unstale":"2024-02-21T23:12:14.821840+0000","last_undegraded":"2024-02-21T23:12:14.821840+0000","last_fullsized":"2024-02-21T23:12:14.821840+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:26:49.911102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"35'375","reported_seq":431,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.823213+0000","last_change":"2024-02-21T23:12:08.716762+0000","last_active":"2024-02-21T23:12:14.823213+0000","last_peered":"2024-02-21T23:12:14.823213+0000","last_clean":"2024-02-21T23:12:14.823213+0000","last_became_active":"2024-02-21T23:01:07.276577+0000","last_became_peered":"2024-02-21T23:01:07.276577+0000","last_unstale":"2024-02-21T23:12:14.823213+0000","last_undegraded":"2024-02-21T23:12:14.823213+0000","last_fullsized":"2024-02-21T23:12:14.823213+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:21:46.661574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0075563849999999997,"stat_sum":{"num_bytes":317135,"num_objects":109,"num_object_clones":0,"num_object_copies":436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":331,"num_write_kb":822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"32'59","reported_seq":142,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.627470+0000","last_change":"2024-02-21T23:12:08.667773+0000","last_active":"2024-02-21T23:12:15.627470+0000","last_peered":"2024-02-21T23:12:15.627470+0000","last_clean":"2024-02-21T23:12:15.627470+0000","last_became_active":"2024-02-21T23:01:03.218706+0000","last_became_peered":"2024-02-21T23:01:03.218706+0000","last_unstale":"2024-02-21T23:12:15.627470+0000","last_undegraded":"2024-02-21T23:12:15.627470+0000","last_fullsized":"2024-02-21T23:12:15.627470+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:11:24.214077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040903179999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"32'13","reported_seq":62,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.825654+0000","last_change":"2024-02-21T23:01:02.208912+0000","last_active":"2024-02-21T23:12:14.825654+0000","last_peered":"2024-02-21T23:12:14.825654+0000","last_clean":"2024-02-21T23:12:14.825654+0000","last_became_active":"2024-02-21T23:01:02.208542+0000","last_became_peered":"2024-02-21T23:01:02.208542+0000","last_unstale":"2024-02-21T23:12:14.825654+0000","last_undegraded":"2024-02-21T23:12:14.825654+0000","last_fullsized":"2024-02-21T23:12:14.825654+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:02:11.724233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9],"acting":[3,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"35'342","reported_seq":395,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.157292+0000","last_change":"2024-02-21T23:12:08.615509+0000","last_active":"2024-02-21T23:12:15.157292+0000","last_peered":"2024-02-21T23:12:15.157292+0000","last_clean":"2024-02-21T23:12:15.157292+0000","last_became_active":"2024-02-21T23:01:07.282506+0000","last_became_peered":"2024-02-21T23:01:07.282506+0000","last_unstale":"2024-02-21T23:12:15.157292+0000","last_undegraded":"2024-02-21T23:12:15.157292+0000","last_fullsized":"2024-02-21T23:12:15.157292+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:47:32.010203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.005933649,"stat_sum":{"num_bytes":321892,"num_objects":112,"num_object_clones":0,"num_object_copies":448,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":112,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":294,"num_write_kb":916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"32'47","reported_seq":130,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.062393+0000","last_change":"2024-02-21T23:12:08.713493+0000","last_active":"2024-02-21T23:12:15.062393+0000","last_peered":"2024-02-21T23:12:15.062393+0000","last_clean":"2024-02-21T23:12:15.062393+0000","last_became_active":"2024-02-21T23:01:03.211919+0000","last_became_peered":"2024-02-21T23:01:03.211919+0000","last_unstale":"2024-02-21T23:12:15.062393+0000","last_undegraded":"2024-02-21T23:12:15.062393+0000","last_fullsized":"2024-02-21T23:12:15.062393+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:47:27.962126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040799440000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"32'11","reported_seq":60,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.240916+0000","last_change":"2024-02-21T23:01:02.204071+0000","last_active":"2024-02-21T23:12:15.240916+0000","last_peered":"2024-02-21T23:12:15.240916+0000","last_clean":"2024-02-21T23:12:15.240916+0000","last_became_active":"2024-02-21T23:01:02.203761+0000","last_became_peered":"2024-02-21T23:01:02.203761+0000","last_unstale":"2024-02-21T23:12:15.240916+0000","last_undegraded":"2024-02-21T23:12:15.240916+0000","last_fullsized":"2024-02-21T23:12:15.240916+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:58:34.737670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"35'297","reported_seq":366,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.823041+0000","last_change":"2024-02-21T23:12:08.713241+0000","last_active":"2024-02-21T23:12:14.823041+0000","last_peered":"2024-02-21T23:12:14.823041+0000","last_clean":"2024-02-21T23:12:14.823041+0000","last_became_active":"2024-02-21T23:01:50.570965+0000","last_became_peered":"2024-02-21T23:01:50.570965+0000","last_unstale":"2024-02-21T23:12:14.823041+0000","last_undegraded":"2024-02-21T23:12:14.823041+0000","last_fullsized":"2024-02-21T23:12:14.823041+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:11:28.262155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042670420000000004,"stat_sum":{"num_bytes":200353,"num_objects":99,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":263,"num_write_kb":684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,10,9],"acting":[4,8,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"32'57","reported_seq":140,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.960621+0000","last_change":"2024-02-21T23:12:08.706090+0000","last_active":"2024-02-21T23:12:14.960621+0000","last_peered":"2024-02-21T23:12:14.960621+0000","last_clean":"2024-02-21T23:12:14.960621+0000","last_became_active":"2024-02-21T23:01:03.229873+0000","last_became_peered":"2024-02-21T23:01:03.229873+0000","last_unstale":"2024-02-21T23:12:14.960621+0000","last_undegraded":"2024-02-21T23:12:14.960621+0000","last_fullsized":"2024-02-21T23:12:14.960621+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:54:40.544963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.004035584,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"32'14","reported_seq":63,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.823102+0000","last_change":"2024-02-21T23:01:02.206586+0000","last_active":"2024-02-21T23:12:14.823102+0000","last_peered":"2024-02-21T23:12:14.823102+0000","last_clean":"2024-02-21T23:12:14.823102+0000","last_became_active":"2024-02-21T23:01:02.206230+0000","last_became_peered":"2024-02-21T23:01:02.206230+0000","last_unstale":"2024-02-21T23:12:14.823102+0000","last_undegraded":"2024-02-21T23:12:14.823102+0000","last_fullsized":"2024-02-21T23:12:14.823102+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:21:29.919968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11],"acting":[4,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"35'358","reported_seq":416,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.821522+0000","last_change":"2024-02-21T23:12:08.714187+0000","last_active":"2024-02-21T23:12:14.821522+0000","last_peered":"2024-02-21T23:12:14.821522+0000","last_clean":"2024-02-21T23:12:14.821522+0000","last_became_active":"2024-02-21T23:01:07.251670+0000","last_became_peered":"2024-02-21T23:01:07.251670+0000","last_unstale":"2024-02-21T23:12:14.821522+0000","last_undegraded":"2024-02-21T23:12:14.821522+0000","last_fullsized":"2024-02-21T23:12:14.821522+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:53:36.897051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.004207176,"stat_sum":{"num_bytes":4398222,"num_objects":112,"num_object_clones":0,"num_object_copies":448,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":112,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":314,"num_write_kb":4681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"32'56","reported_seq":139,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.827050+0000","last_change":"2024-02-21T23:12:08.621679+0000","last_active":"2024-02-21T23:12:14.827050+0000","last_peered":"2024-02-21T23:12:14.827050+0000","last_clean":"2024-02-21T23:12:14.827050+0000","last_became_active":"2024-02-21T23:01:03.206892+0000","last_became_peered":"2024-02-21T23:01:03.206892+0000","last_unstale":"2024-02-21T23:12:14.827050+0000","last_undegraded":"2024-02-21T23:12:14.827050+0000","last_fullsized":"2024-02-21T23:12:14.827050+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:21:42.613496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010016761000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"40'439","reported_seq":928,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:18.728492+0000","last_change":"2024-02-21T23:01:02.209850+0000","last_active":"2024-02-21T23:12:18.728492+0000","last_peered":"2024-02-21T23:12:18.728492+0000","last_clean":"2024-02-21T23:12:18.728492+0000","last_became_active":"2024-02-21T23:01:02.209601+0000","last_became_peered":"2024-02-21T23:01:02.209601+0000","last_unstale":"2024-02-21T23:12:18.728492+0000","last_undegraded":"2024-02-21T23:12:18.728492+0000","last_fullsized":"2024-02-21T23:12:18.728492+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:36:44.497886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1472,"num_read_kb":1321,"num_write":854,"num_write_kb":4014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"35'354","reported_seq":413,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.824941+0000","last_change":"2024-02-21T23:12:08.617892+0000","last_active":"2024-02-21T23:12:14.824941+0000","last_peered":"2024-02-21T23:12:14.824941+0000","last_clean":"2024-02-21T23:12:14.824941+0000","last_became_active":"2024-02-21T23:01:07.651431+0000","last_became_peered":"2024-02-21T23:01:07.651431+0000","last_unstale":"2024-02-21T23:12:14.824941+0000","last_undegraded":"2024-02-21T23:12:14.824941+0000","last_fullsized":"2024-02-21T23:12:14.824941+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:44:32.467350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0097316139999999995,"stat_sum":{"num_bytes":401739,"num_objects":113,"num_object_clones":0,"num_object_copies":452,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":113,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":314,"num_write_kb":708,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"32'53","reported_seq":136,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.844206+0000","last_change":"2024-02-21T23:12:08.720063+0000","last_active":"2024-02-21T23:12:14.844206+0000","last_peered":"2024-02-21T23:12:14.844206+0000","last_clean":"2024-02-21T23:12:14.844206+0000","last_became_active":"2024-02-21T23:01:03.221405+0000","last_became_peered":"2024-02-21T23:01:03.221405+0000","last_unstale":"2024-02-21T23:12:14.844206+0000","last_undegraded":"2024-02-21T23:12:14.844206+0000","last_fullsized":"2024-02-21T23:12:14.844206+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:53:08.201764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0094468999999999994,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"32'7","reported_seq":57,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.063100+0000","last_change":"2024-02-21T23:01:02.221218+0000","last_active":"2024-02-21T23:12:15.063100+0000","last_peered":"2024-02-21T23:12:15.063100+0000","last_clean":"2024-02-21T23:12:15.063100+0000","last_became_active":"2024-02-21T23:01:02.220923+0000","last_became_peered":"2024-02-21T23:01:02.220923+0000","last_unstale":"2024-02-21T23:12:15.063100+0000","last_undegraded":"2024-02-21T23:12:15.063100+0000","last_fullsized":"2024-02-21T23:12:15.063100+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:15.938263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":13,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"35'343","reported_seq":410,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.628338+0000","last_change":"2024-02-21T23:12:08.666642+0000","last_active":"2024-02-21T23:12:15.628338+0000","last_peered":"2024-02-21T23:12:15.628338+0000","last_clean":"2024-02-21T23:12:15.628338+0000","last_became_active":"2024-02-21T23:01:07.268210+0000","last_became_peered":"2024-02-21T23:01:07.268210+0000","last_unstale":"2024-02-21T23:12:15.628338+0000","last_undegraded":"2024-02-21T23:12:15.628338+0000","last_fullsized":"2024-02-21T23:12:15.628338+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":343,"log_dups_size":0,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:04:13.965614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0034086630000000001,"stat_sum":{"num_bytes":377358,"num_objects":123,"num_object_clones":0,"num_object_copies":492,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":123,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":315,"num_write_kb":765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"32'52","reported_seq":135,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.875928+0000","last_change":"2024-02-21T23:12:08.665860+0000","last_active":"2024-02-21T23:12:14.875928+0000","last_peered":"2024-02-21T23:12:14.875928+0000","last_clean":"2024-02-21T23:12:14.875928+0000","last_became_active":"2024-02-21T23:01:03.218081+0000","last_became_peered":"2024-02-21T23:01:03.218081+0000","last_unstale":"2024-02-21T23:12:14.875928+0000","last_undegraded":"2024-02-21T23:12:14.875928+0000","last_fullsized":"2024-02-21T23:12:14.875928+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:17:45.851604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015202530000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"32'10","reported_seq":59,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.156431+0000","last_change":"2024-02-21T23:01:02.207826+0000","last_active":"2024-02-21T23:12:15.156431+0000","last_peered":"2024-02-21T23:12:15.156431+0000","last_clean":"2024-02-21T23:12:15.156431+0000","last_became_active":"2024-02-21T23:01:02.206426+0000","last_became_peered":"2024-02-21T23:01:02.206426+0000","last_unstale":"2024-02-21T23:12:15.156431+0000","last_undegraded":"2024-02-21T23:12:15.156431+0000","last_fullsized":"2024-02-21T23:12:15.156431+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:17:06.353018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2],"acting":[9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"35'355","reported_seq":417,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.062929+0000","last_change":"2024-02-21T23:12:08.713641+0000","last_active":"2024-02-21T23:12:15.062929+0000","last_peered":"2024-02-21T23:12:15.062929+0000","last_clean":"2024-02-21T23:12:15.062929+0000","last_became_active":"2024-02-21T23:01:07.651384+0000","last_became_peered":"2024-02-21T23:01:07.651384+0000","last_unstale":"2024-02-21T23:12:15.062929+0000","last_undegraded":"2024-02-21T23:12:15.062929+0000","last_fullsized":"2024-02-21T23:12:15.062929+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:37:42.607000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0031726889999999998,"stat_sum":{"num_bytes":888761,"num_objects":113,"num_object_clones":0,"num_object_copies":452,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":113,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":323,"num_write_kb":1197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"32'54","reported_seq":137,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.875903+0000","last_change":"2024-02-21T23:12:08.665492+0000","last_active":"2024-02-21T23:12:14.875903+0000","last_peered":"2024-02-21T23:12:14.875903+0000","last_clean":"2024-02-21T23:12:14.875903+0000","last_became_active":"2024-02-21T23:01:03.210123+0000","last_became_peered":"2024-02-21T23:01:03.210123+0000","last_unstale":"2024-02-21T23:12:14.875903+0000","last_undegraded":"2024-02-21T23:12:14.875903+0000","last_fullsized":"2024-02-21T23:12:14.875903+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:32:04.964547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014139560000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4],"acting":[10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"32'38","reported_seq":108,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.348746+0000","last_change":"2024-02-21T23:01:02.217455+0000","last_active":"2024-02-21T23:12:15.348746+0000","last_peered":"2024-02-21T23:12:15.348746+0000","last_clean":"2024-02-21T23:12:15.348746+0000","last_became_active":"2024-02-21T23:01:02.217128+0000","last_became_peered":"2024-02-21T23:01:02.217128+0000","last_unstale":"2024-02-21T23:12:15.348746+0000","last_undegraded":"2024-02-21T23:12:15.348746+0000","last_fullsized":"2024-02-21T23:12:15.348746+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:23:41.295647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":21,"num_read_kb":4097,"num_write":45,"num_write_kb":4258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"35'307","reported_seq":371,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.843285+0000","last_change":"2024-02-21T23:12:08.718221+0000","last_active":"2024-02-21T23:12:14.843285+0000","last_peered":"2024-02-21T23:12:14.843285+0000","last_clean":"2024-02-21T23:12:14.843285+0000","last_became_active":"2024-02-21T23:01:07.266376+0000","last_became_peered":"2024-02-21T23:01:07.266376+0000","last_unstale":"2024-02-21T23:12:14.843285+0000","last_undegraded":"2024-02-21T23:12:14.843285+0000","last_fullsized":"2024-02-21T23:12:14.843285+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":307,"log_dups_size":0,"ondisk_log_size":307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:59:12.232049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0080237980000000004,"stat_sum":{"num_bytes":252650,"num_objects":112,"num_object_clones":0,"num_object_copies":448,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":112,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":278,"num_write_kb":523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"32'44","reported_seq":127,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.971854+0000","last_change":"2024-02-21T23:12:08.674994+0000","last_active":"2024-02-21T23:12:14.971854+0000","last_peered":"2024-02-21T23:12:14.971854+0000","last_clean":"2024-02-21T23:12:14.971854+0000","last_became_active":"2024-02-21T23:01:03.212019+0000","last_became_peered":"2024-02-21T23:01:03.212019+0000","last_unstale":"2024-02-21T23:12:14.971854+0000","last_undegraded":"2024-02-21T23:12:14.971854+0000","last_fullsized":"2024-02-21T23:12:14.971854+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:03:30.016061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040092829999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"32'61","reported_seq":839,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:58.814530+0000","last_change":"2024-02-21T23:01:02.219033+0000","last_active":"2024-02-21T23:12:58.814530+0000","last_peered":"2024-02-21T23:12:58.814530+0000","last_clean":"2024-02-21T23:12:58.814530+0000","last_became_active":"2024-02-21T23:01:02.218570+0000","last_became_peered":"2024-02-21T23:01:02.218570+0000","last_unstale":"2024-02-21T23:12:58.814530+0000","last_undegraded":"2024-02-21T23:12:58.814530+0000","last_fullsized":"2024-02-21T23:12:58.814530+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:21:29.919968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289676,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":729,"num_read_kb":999,"num_write":69,"num_write_kb":476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"35'326","reported_seq":389,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.843976+0000","last_change":"2024-02-21T23:12:08.718344+0000","last_active":"2024-02-21T23:12:14.843976+0000","last_peered":"2024-02-21T23:12:14.843976+0000","last_clean":"2024-02-21T23:12:14.843976+0000","last_became_active":"2024-02-21T23:01:07.653745+0000","last_became_peered":"2024-02-21T23:01:07.653745+0000","last_unstale":"2024-02-21T23:12:14.843976+0000","last_undegraded":"2024-02-21T23:12:14.843976+0000","last_fullsized":"2024-02-21T23:12:14.843976+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:03:56.907378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0081050040000000007,"stat_sum":{"num_bytes":1514271,"num_objects":111,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":111,"num_whiteouts":0,"num_read":1,"num_read_kb":1270,"num_write":292,"num_write_kb":1862,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"32'52","reported_seq":135,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.842173+0000","last_change":"2024-02-21T23:12:08.714060+0000","last_active":"2024-02-21T23:12:14.842173+0000","last_peered":"2024-02-21T23:12:14.842173+0000","last_clean":"2024-02-21T23:12:14.842173+0000","last_became_active":"2024-02-21T23:01:03.219834+0000","last_became_peered":"2024-02-21T23:01:03.219834+0000","last_unstale":"2024-02-21T23:12:14.842173+0000","last_undegraded":"2024-02-21T23:12:14.842173+0000","last_fullsized":"2024-02-21T23:12:14.842173+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:52:50.911363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0044708259999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"32'156","reported_seq":259,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.348474+0000","last_change":"2024-02-21T23:01:02.207052+0000","last_active":"2024-02-21T23:12:15.348474+0000","last_peered":"2024-02-21T23:12:15.348474+0000","last_clean":"2024-02-21T23:12:15.348474+0000","last_became_active":"2024-02-21T23:01:02.206146+0000","last_became_peered":"2024-02-21T23:01:02.206146+0000","last_unstale":"2024-02-21T23:12:15.348474+0000","last_undegraded":"2024-02-21T23:12:15.348474+0000","last_fullsized":"2024-02-21T23:12:15.348474+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:26:49.911102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":54,"num_read_kb":8202,"num_write":160,"num_write_kb":8393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"35'381","reported_seq":438,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.972474+0000","last_change":"2024-02-21T23:12:08.673718+0000","last_active":"2024-02-21T23:12:14.972474+0000","last_peered":"2024-02-21T23:12:14.972474+0000","last_clean":"2024-02-21T23:12:14.972474+0000","last_became_active":"2024-02-21T23:01:50.649190+0000","last_became_peered":"2024-02-21T23:01:50.649190+0000","last_unstale":"2024-02-21T23:12:14.972474+0000","last_undegraded":"2024-02-21T23:12:14.972474+0000","last_fullsized":"2024-02-21T23:12:14.972474+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:51:30.402466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00347759,"stat_sum":{"num_bytes":3892244,"num_objects":109,"num_object_clones":0,"num_object_copies":436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":323,"num_write_kb":4210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,11,6,10],"acting":[5,11,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"32'57","reported_seq":140,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.825107+0000","last_change":"2024-02-21T23:12:08.620001+0000","last_active":"2024-02-21T23:12:14.825107+0000","last_peered":"2024-02-21T23:12:14.825107+0000","last_clean":"2024-02-21T23:12:14.825107+0000","last_became_active":"2024-02-21T23:01:03.209007+0000","last_became_peered":"2024-02-21T23:01:03.209007+0000","last_unstale":"2024-02-21T23:12:14.825107+0000","last_undegraded":"2024-02-21T23:12:14.825107+0000","last_fullsized":"2024-02-21T23:12:14.825107+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:11:24.214077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0096099529999999992,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"32'9","reported_seq":60,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.823538+0000","last_change":"2024-02-21T23:01:02.203395+0000","last_active":"2024-02-21T23:12:14.823538+0000","last_peered":"2024-02-21T23:12:14.823538+0000","last_clean":"2024-02-21T23:12:14.823538+0000","last_became_active":"2024-02-21T23:01:02.203066+0000","last_became_peered":"2024-02-21T23:01:02.203066+0000","last_unstale":"2024-02-21T23:12:14.823538+0000","last_undegraded":"2024-02-21T23:12:14.823538+0000","last_fullsized":"2024-02-21T23:12:14.823538+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:26:49.911102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":16,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"32'148","reported_seq":282,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.348654+0000","last_change":"2024-02-21T23:00:58.830752+0000","last_active":"2024-02-21T23:12:15.348654+0000","last_peered":"2024-02-21T23:12:15.348654+0000","last_clean":"2024-02-21T23:12:15.348654+0000","last_became_active":"2024-02-21T23:00:58.830472+0000","last_became_peered":"2024-02-21T23:00:58.830472+0000","last_unstale":"2024-02-21T23:12:15.348654+0000","last_undegraded":"2024-02-21T23:12:15.348654+0000","last_fullsized":"2024-02-21T23:12:15.348654+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:00:57.811198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:00:57.811198+0000","last_clean_scrub_stamp":"2024-02-21T23:00:57.811198+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:58:31.374266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"35'303","reported_seq":368,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.348445+0000","last_change":"2024-02-21T23:12:08.713916+0000","last_active":"2024-02-21T23:12:15.348445+0000","last_peered":"2024-02-21T23:12:15.348445+0000","last_clean":"2024-02-21T23:12:15.348445+0000","last_became_active":"2024-02-21T23:01:07.276489+0000","last_became_peered":"2024-02-21T23:01:07.276489+0000","last_unstale":"2024-02-21T23:12:15.348445+0000","last_undegraded":"2024-02-21T23:12:15.348445+0000","last_fullsized":"2024-02-21T23:12:15.348445+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":303,"log_dups_size":0,"ondisk_log_size":303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:12:49.052079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0037280239999999999,"stat_sum":{"num_bytes":156768,"num_objects":95,"num_object_clones":0,"num_object_copies":380,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":275,"num_write_kb":444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"32'53","reported_seq":136,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.348793+0000","last_change":"2024-02-21T23:12:08.715540+0000","last_active":"2024-02-21T23:12:15.348793+0000","last_peered":"2024-02-21T23:12:15.348793+0000","last_clean":"2024-02-21T23:12:15.348793+0000","last_became_active":"2024-02-21T23:01:03.215904+0000","last_became_peered":"2024-02-21T23:01:03.215904+0000","last_unstale":"2024-02-21T23:12:15.348793+0000","last_undegraded":"2024-02-21T23:12:15.348793+0000","last_fullsized":"2024-02-21T23:12:15.348793+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:01:36.467676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0048898559999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"32'10","reported_seq":60,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.821877+0000","last_change":"2024-02-21T23:01:02.207406+0000","last_active":"2024-02-21T23:12:14.821877+0000","last_peered":"2024-02-21T23:12:14.821877+0000","last_clean":"2024-02-21T23:12:14.821877+0000","last_became_active":"2024-02-21T23:01:02.206219+0000","last_became_peered":"2024-02-21T23:01:02.206219+0000","last_unstale":"2024-02-21T23:12:14.821877+0000","last_undegraded":"2024-02-21T23:12:14.821877+0000","last_fullsized":"2024-02-21T23:12:14.821877+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:21:29.919968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":13,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11],"acting":[2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"35'322","reported_seq":390,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.240800+0000","last_change":"2024-02-21T23:12:08.607853+0000","last_active":"2024-02-21T23:12:15.240800+0000","last_peered":"2024-02-21T23:12:15.240800+0000","last_clean":"2024-02-21T23:12:15.240800+0000","last_became_active":"2024-02-21T23:01:07.265401+0000","last_became_peered":"2024-02-21T23:01:07.265401+0000","last_unstale":"2024-02-21T23:12:15.240800+0000","last_undegraded":"2024-02-21T23:12:15.240800+0000","last_fullsized":"2024-02-21T23:12:15.240800+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":322,"log_dups_size":0,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:32:15.029558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022768879999999999,"stat_sum":{"num_bytes":312332,"num_objects":114,"num_object_clones":0,"num_object_copies":456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":114,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":302,"num_write_kb":592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"32'60","reported_seq":143,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.347873+0000","last_change":"2024-02-21T23:12:08.715749+0000","last_active":"2024-02-21T23:12:15.347873+0000","last_peered":"2024-02-21T23:12:15.347873+0000","last_clean":"2024-02-21T23:12:15.347873+0000","last_became_active":"2024-02-21T23:01:03.220349+0000","last_became_peered":"2024-02-21T23:01:03.220349+0000","last_unstale":"2024-02-21T23:12:15.347873+0000","last_undegraded":"2024-02-21T23:12:15.347873+0000","last_fullsized":"2024-02-21T23:12:15.347873+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:01:00.300776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0046427739999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"38'186","reported_seq":382,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:18.728029+0000","last_change":"2024-02-21T23:01:02.206319+0000","last_active":"2024-02-21T23:12:18.728029+0000","last_peered":"2024-02-21T23:12:18.728029+0000","last_clean":"2024-02-21T23:12:18.728029+0000","last_became_active":"2024-02-21T23:01:02.205747+0000","last_became_peered":"2024-02-21T23:01:02.205747+0000","last_unstale":"2024-02-21T23:12:18.728029+0000","last_undegraded":"2024-02-21T23:12:18.728029+0000","last_fullsized":"2024-02-21T23:12:18.728029+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:10:09.680115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":328302,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":150,"num_read_kb":149,"num_write":203,"num_write_kb":2979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10],"acting":[5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"35'347","reported_seq":411,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.960221+0000","last_change":"2024-02-21T23:12:08.705514+0000","last_active":"2024-02-21T23:12:14.960221+0000","last_peered":"2024-02-21T23:12:14.960221+0000","last_clean":"2024-02-21T23:12:14.960221+0000","last_became_active":"2024-02-21T23:01:07.280193+0000","last_became_peered":"2024-02-21T23:01:07.280193+0000","last_unstale":"2024-02-21T23:12:14.960221+0000","last_undegraded":"2024-02-21T23:12:14.960221+0000","last_fullsized":"2024-02-21T23:12:14.960221+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":347,"log_dups_size":0,"ondisk_log_size":347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:03:56.907378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00381337,"stat_sum":{"num_bytes":4515871,"num_objects":114,"num_object_clones":0,"num_object_copies":456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":114,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":315,"num_write_kb":4679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"32'57","reported_seq":140,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.348620+0000","last_change":"2024-02-21T23:12:08.714545+0000","last_active":"2024-02-21T23:12:15.348620+0000","last_peered":"2024-02-21T23:12:15.348620+0000","last_clean":"2024-02-21T23:12:15.348620+0000","last_became_active":"2024-02-21T23:01:03.216578+0000","last_became_peered":"2024-02-21T23:01:03.216578+0000","last_unstale":"2024-02-21T23:12:15.348620+0000","last_undegraded":"2024-02-21T23:12:15.348620+0000","last_fullsized":"2024-02-21T23:12:15.348620+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:44:28.419272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0043269409999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"32'5","reported_seq":54,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.844695+0000","last_change":"2024-02-21T23:01:02.220913+0000","last_active":"2024-02-21T23:12:14.844695+0000","last_peered":"2024-02-21T23:12:14.844695+0000","last_clean":"2024-02-21T23:12:14.844695+0000","last_became_active":"2024-02-21T23:01:02.220554+0000","last_became_peered":"2024-02-21T23:01:02.220554+0000","last_unstale":"2024-02-21T23:12:14.844695+0000","last_undegraded":"2024-02-21T23:12:14.844695+0000","last_fullsized":"2024-02-21T23:12:14.844695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:36:44.497886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"35'327","reported_seq":391,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.971637+0000","last_change":"2024-02-21T23:12:08.674532+0000","last_active":"2024-02-21T23:12:14.971637+0000","last_peered":"2024-02-21T23:12:14.971637+0000","last_clean":"2024-02-21T23:12:14.971637+0000","last_became_active":"2024-02-21T23:01:07.257011+0000","last_became_peered":"2024-02-21T23:01:07.257011+0000","last_unstale":"2024-02-21T23:12:14.971637+0000","last_undegraded":"2024-02-21T23:12:14.971637+0000","last_fullsized":"2024-02-21T23:12:14.971637+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:21:46.661574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0038555350000000002,"stat_sum":{"num_bytes":448215,"num_objects":108,"num_object_clones":0,"num_object_copies":432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":292,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"32'39","reported_seq":122,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.627619+0000","last_change":"2024-02-21T23:12:08.667139+0000","last_active":"2024-02-21T23:12:15.627619+0000","last_peered":"2024-02-21T23:12:15.627619+0000","last_clean":"2024-02-21T23:12:15.627619+0000","last_became_active":"2024-02-21T23:01:03.211467+0000","last_became_peered":"2024-02-21T23:01:03.211467+0000","last_unstale":"2024-02-21T23:12:15.627619+0000","last_undegraded":"2024-02-21T23:12:15.627619+0000","last_fullsized":"2024-02-21T23:12:15.627619+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:54:40.544963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0035291530000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"32'15","reported_seq":65,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.062813+0000","last_change":"2024-02-21T23:01:02.211763+0000","last_active":"2024-02-21T23:12:15.062813+0000","last_peered":"2024-02-21T23:12:15.062813+0000","last_clean":"2024-02-21T23:12:15.062813+0000","last_became_active":"2024-02-21T23:01:02.211470+0000","last_became_peered":"2024-02-21T23:01:02.211470+0000","last_unstale":"2024-02-21T23:12:15.062813+0000","last_undegraded":"2024-02-21T23:12:15.062813+0000","last_fullsized":"2024-02-21T23:12:15.062813+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:23:41.295647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":24,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5],"acting":[8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"35'322","reported_seq":390,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.971734+0000","last_change":"2024-02-21T23:12:08.673325+0000","last_active":"2024-02-21T23:12:14.971734+0000","last_peered":"2024-02-21T23:12:14.971734+0000","last_clean":"2024-02-21T23:12:14.971734+0000","last_became_active":"2024-02-21T23:01:07.268681+0000","last_became_peered":"2024-02-21T23:01:07.268681+0000","last_unstale":"2024-02-21T23:12:14.971734+0000","last_undegraded":"2024-02-21T23:12:14.971734+0000","last_fullsized":"2024-02-21T23:12:14.971734+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":322,"log_dups_size":0,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:44:32.467350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0032686719999999998,"stat_sum":{"num_bytes":365874,"num_objects":113,"num_object_clones":0,"num_object_copies":452,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":113,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":301,"num_write_kb":637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"32'61","reported_seq":144,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.971994+0000","last_change":"2024-02-21T23:12:08.674464+0000","last_active":"2024-02-21T23:12:14.971994+0000","last_peered":"2024-02-21T23:12:14.971994+0000","last_clean":"2024-02-21T23:12:14.971994+0000","last_became_active":"2024-02-21T23:01:03.212634+0000","last_became_peered":"2024-02-21T23:01:03.212634+0000","last_unstale":"2024-02-21T23:12:14.971994+0000","last_undegraded":"2024-02-21T23:12:14.971994+0000","last_fullsized":"2024-02-21T23:12:14.971994+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:23:47.543277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039799579999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"32'26","reported_seq":76,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.062436+0000","last_change":"2024-02-21T23:01:02.221957+0000","last_active":"2024-02-21T23:12:15.062436+0000","last_peered":"2024-02-21T23:12:15.062436+0000","last_clean":"2024-02-21T23:12:15.062436+0000","last_became_active":"2024-02-21T23:01:02.221642+0000","last_became_peered":"2024-02-21T23:01:02.221642+0000","last_unstale":"2024-02-21T23:12:15.062436+0000","last_undegraded":"2024-02-21T23:12:15.062436+0000","last_fullsized":"2024-02-21T23:12:15.062436+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:10:09.680115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":39,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"35'397","reported_seq":443,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.844649+0000","last_change":"2024-02-21T23:12:08.717882+0000","last_active":"2024-02-21T23:12:14.844649+0000","last_peered":"2024-02-21T23:12:14.844649+0000","last_clean":"2024-02-21T23:12:14.844649+0000","last_became_active":"2024-02-21T23:01:07.267874+0000","last_became_peered":"2024-02-21T23:01:07.267874+0000","last_unstale":"2024-02-21T23:12:14.844649+0000","last_undegraded":"2024-02-21T23:12:14.844649+0000","last_fullsized":"2024-02-21T23:12:14.844649+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:39:46.450427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0076511119999999998,"stat_sum":{"num_bytes":500979,"num_objects":108,"num_object_clones":0,"num_object_copies":432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":334,"num_write_kb":931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"32'53","reported_seq":136,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.347593+0000","last_change":"2024-02-21T23:12:08.716946+0000","last_active":"2024-02-21T23:12:15.347593+0000","last_peered":"2024-02-21T23:12:15.347593+0000","last_clean":"2024-02-21T23:12:15.347593+0000","last_became_active":"2024-02-21T23:01:03.216466+0000","last_became_peered":"2024-02-21T23:01:03.216466+0000","last_unstale":"2024-02-21T23:12:15.347593+0000","last_undegraded":"2024-02-21T23:12:15.347593+0000","last_fullsized":"2024-02-21T23:12:15.347593+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:21:42.613496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0046640040000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"32'14","reported_seq":753,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:58.815511+0000","last_change":"2024-02-21T23:01:02.199060+0000","last_active":"2024-02-21T23:12:58.815511+0000","last_peered":"2024-02-21T23:12:58.815511+0000","last_clean":"2024-02-21T23:12:58.815511+0000","last_became_active":"2024-02-21T23:01:02.198709+0000","last_became_peered":"2024-02-21T23:01:02.198709+0000","last_unstale":"2024-02-21T23:12:58.815511+0000","last_undegraded":"2024-02-21T23:12:58.815511+0000","last_fullsized":"2024-02-21T23:12:58.815511+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:36:44.497886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1124,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":691,"num_read_kb":5,"num_write":18,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"35'357","reported_seq":411,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.156955+0000","last_change":"2024-02-21T23:12:08.617956+0000","last_active":"2024-02-21T23:12:15.156955+0000","last_peered":"2024-02-21T23:12:15.156955+0000","last_clean":"2024-02-21T23:12:15.156955+0000","last_became_active":"2024-02-21T23:01:07.277289+0000","last_became_peered":"2024-02-21T23:01:07.277289+0000","last_unstale":"2024-02-21T23:12:15.156955+0000","last_undegraded":"2024-02-21T23:12:15.156955+0000","last_fullsized":"2024-02-21T23:12:15.156955+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:32:15.029558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0081797620000000001,"stat_sum":{"num_bytes":280914,"num_objects":98,"num_object_clones":0,"num_object_copies":392,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":308,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"32'69","reported_seq":152,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.348045+0000","last_change":"2024-02-21T23:12:08.717128+0000","last_active":"2024-02-21T23:12:15.348045+0000","last_peered":"2024-02-21T23:12:15.348045+0000","last_clean":"2024-02-21T23:12:15.348045+0000","last_became_active":"2024-02-21T23:01:03.214507+0000","last_became_peered":"2024-02-21T23:01:03.214507+0000","last_unstale":"2024-02-21T23:12:15.348045+0000","last_undegraded":"2024-02-21T23:12:15.348045+0000","last_fullsized":"2024-02-21T23:12:15.348045+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:23:08.703440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036732959999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"32'15","reported_seq":64,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.971959+0000","last_change":"2024-02-21T23:01:02.209351+0000","last_active":"2024-02-21T23:12:14.971959+0000","last_peered":"2024-02-21T23:12:14.971959+0000","last_clean":"2024-02-21T23:12:14.971959+0000","last_became_active":"2024-02-21T23:01:02.208990+0000","last_became_peered":"2024-02-21T23:01:02.208990+0000","last_unstale":"2024-02-21T23:12:14.971959+0000","last_undegraded":"2024-02-21T23:12:14.971959+0000","last_fullsized":"2024-02-21T23:12:14.971959+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:36:44.497886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"35'314","reported_seq":378,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.628791+0000","last_change":"2024-02-21T23:12:08.666904+0000","last_active":"2024-02-21T23:12:15.628791+0000","last_peered":"2024-02-21T23:12:15.628791+0000","last_clean":"2024-02-21T23:12:15.628791+0000","last_became_active":"2024-02-21T23:01:50.649153+0000","last_became_peered":"2024-02-21T23:01:50.649153+0000","last_unstale":"2024-02-21T23:12:15.628791+0000","last_undegraded":"2024-02-21T23:12:15.628791+0000","last_fullsized":"2024-02-21T23:12:15.628791+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":314,"log_dups_size":0,"ondisk_log_size":314,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:53:12.249842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003571472,"stat_sum":{"num_bytes":262334,"num_objects":113,"num_object_clones":0,"num_object_copies":452,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":113,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":267,"num_write_kb":565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,7,6],"acting":[11,8,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"32'49","reported_seq":132,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.843028+0000","last_change":"2024-02-21T23:12:08.716229+0000","last_active":"2024-02-21T23:12:14.843028+0000","last_peered":"2024-02-21T23:12:14.843028+0000","last_clean":"2024-02-21T23:12:14.843028+0000","last_became_active":"2024-02-21T23:01:03.224451+0000","last_became_peered":"2024-02-21T23:01:03.224451+0000","last_unstale":"2024-02-21T23:12:14.843028+0000","last_undegraded":"2024-02-21T23:12:14.843028+0000","last_fullsized":"2024-02-21T23:12:14.843028+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:48:40.284242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0065637960000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"39'149","reported_seq":734,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:58.571232+0000","last_change":"2024-02-21T23:01:02.203410+0000","last_active":"2024-02-21T23:12:58.571232+0000","last_peered":"2024-02-21T23:12:58.571232+0000","last_clean":"2024-02-21T23:12:58.571232+0000","last_became_active":"2024-02-21T23:01:02.203081+0000","last_became_peered":"2024-02-21T23:01:02.203081+0000","last_unstale":"2024-02-21T23:12:58.571232+0000","last_undegraded":"2024-02-21T23:12:58.571232+0000","last_fullsized":"2024-02-21T23:12:58.571232+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:36:44.497886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8060470,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":536,"num_read_kb":7900,"num_write":154,"num_write_kb":8013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10],"acting":[2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"35'326","reported_seq":386,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.972434+0000","last_change":"2024-02-21T23:12:08.674143+0000","last_active":"2024-02-21T23:12:14.972434+0000","last_peered":"2024-02-21T23:12:14.972434+0000","last_clean":"2024-02-21T23:12:14.972434+0000","last_became_active":"2024-02-21T23:01:07.268436+0000","last_became_peered":"2024-02-21T23:01:07.268436+0000","last_unstale":"2024-02-21T23:12:14.972434+0000","last_undegraded":"2024-02-21T23:12:14.972434+0000","last_fullsized":"2024-02-21T23:12:14.972434+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:01:04.348854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036117860000000001,"stat_sum":{"num_bytes":527021,"num_objects":97,"num_object_clones":0,"num_object_copies":388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":97,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":289,"num_write_kb":781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"32'50","reported_seq":132,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.062938+0000","last_change":"2024-02-21T23:12:08.714680+0000","last_active":"2024-02-21T23:12:15.062938+0000","last_peered":"2024-02-21T23:12:15.062938+0000","last_clean":"2024-02-21T23:12:15.062938+0000","last_became_active":"2024-02-21T23:01:03.215888+0000","last_became_peered":"2024-02-21T23:01:03.215888+0000","last_unstale":"2024-02-21T23:12:15.062938+0000","last_undegraded":"2024-02-21T23:12:15.062938+0000","last_fullsized":"2024-02-21T23:12:15.062938+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:34:02.477270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036927029999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"38'103","reported_seq":1041,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:58.570285+0000","last_change":"2024-02-21T23:01:02.204595+0000","last_active":"2024-02-21T23:12:58.570285+0000","last_peered":"2024-02-21T23:12:58.570285+0000","last_clean":"2024-02-21T23:12:58.570285+0000","last_became_active":"2024-02-21T23:01:02.204123+0000","last_became_peered":"2024-02-21T23:01:02.204123+0000","last_unstale":"2024-02-21T23:12:58.570285+0000","last_undegraded":"2024-02-21T23:12:58.570285+0000","last_fullsized":"2024-02-21T23:12:58.570285+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:36:44.497886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":889,"num_read_kb":4819,"num_write":111,"num_write_kb":4274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1],"acting":[10,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"35'330","reported_seq":392,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.156250+0000","last_change":"2024-02-21T23:12:08.616456+0000","last_active":"2024-02-21T23:12:15.156250+0000","last_peered":"2024-02-21T23:12:15.156250+0000","last_clean":"2024-02-21T23:12:15.156250+0000","last_became_active":"2024-02-21T23:01:07.265618+0000","last_became_peered":"2024-02-21T23:01:07.265618+0000","last_unstale":"2024-02-21T23:12:15.156250+0000","last_undegraded":"2024-02-21T23:12:15.156250+0000","last_fullsized":"2024-02-21T23:12:15.156250+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":330,"log_dups_size":0,"ondisk_log_size":330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:40:40.382308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0078749619999999992,"stat_sum":{"num_bytes":397479,"num_objects":108,"num_object_clones":0,"num_object_copies":432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":298,"num_write_kb":795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"32'50","reported_seq":133,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.240895+0000","last_change":"2024-02-21T23:12:08.608746+0000","last_active":"2024-02-21T23:12:15.240895+0000","last_peered":"2024-02-21T23:12:15.240895+0000","last_clean":"2024-02-21T23:12:15.240895+0000","last_became_active":"2024-02-21T23:01:03.214580+0000","last_became_peered":"2024-02-21T23:01:03.214580+0000","last_unstale":"2024-02-21T23:12:15.240895+0000","last_undegraded":"2024-02-21T23:12:15.240895+0000","last_fullsized":"2024-02-21T23:12:15.240895+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:25:38.592184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027155230000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8],"acting":[1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"32'33","reported_seq":82,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.972631+0000","last_change":"2024-02-21T23:01:02.222064+0000","last_active":"2024-02-21T23:12:14.972631+0000","last_peered":"2024-02-21T23:12:14.972631+0000","last_clean":"2024-02-21T23:12:14.972631+0000","last_became_active":"2024-02-21T23:01:02.221735+0000","last_became_peered":"2024-02-21T23:01:02.221735+0000","last_unstale":"2024-02-21T23:12:14.972631+0000","last_undegraded":"2024-02-21T23:12:14.972631+0000","last_fullsized":"2024-02-21T23:12:14.972631+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:23:41.295647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":43,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"35'359","reported_seq":411,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.823158+0000","last_change":"2024-02-21T23:12:08.717375+0000","last_active":"2024-02-21T23:12:14.823158+0000","last_peered":"2024-02-21T23:12:14.823158+0000","last_clean":"2024-02-21T23:12:14.823158+0000","last_became_active":"2024-02-21T23:01:07.275982+0000","last_became_peered":"2024-02-21T23:01:07.275982+0000","last_unstale":"2024-02-21T23:12:14.823158+0000","last_undegraded":"2024-02-21T23:12:14.823158+0000","last_fullsized":"2024-02-21T23:12:14.823158+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:23:12.751518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0069532279999999997,"stat_sum":{"num_bytes":644576,"num_objects":99,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":303,"num_write_kb":1079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"32'60","reported_seq":142,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.960741+0000","last_change":"2024-02-21T23:12:08.707621+0000","last_active":"2024-02-21T23:12:14.960741+0000","last_peered":"2024-02-21T23:12:14.960741+0000","last_clean":"2024-02-21T23:12:14.960741+0000","last_became_active":"2024-02-21T23:01:03.229193+0000","last_became_peered":"2024-02-21T23:01:03.229193+0000","last_unstale":"2024-02-21T23:12:14.960741+0000","last_undegraded":"2024-02-21T23:12:14.960741+0000","last_fullsized":"2024-02-21T23:12:14.960741+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:44:28.419272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0055177610000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"32'3","reported_seq":51,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.348453+0000","last_change":"2024-02-21T23:01:02.197598+0000","last_active":"2024-02-21T23:12:15.348453+0000","last_peered":"2024-02-21T23:12:15.348453+0000","last_clean":"2024-02-21T23:12:15.348453+0000","last_became_active":"2024-02-21T23:01:02.197275+0000","last_became_peered":"2024-02-21T23:01:02.197275+0000","last_unstale":"2024-02-21T23:12:15.348453+0000","last_undegraded":"2024-02-21T23:12:15.348453+0000","last_fullsized":"2024-02-21T23:12:15.348453+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:36:44.497886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"35'338","reported_seq":396,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.062488+0000","last_change":"2024-02-21T23:12:08.713158+0000","last_active":"2024-02-21T23:12:15.062488+0000","last_peered":"2024-02-21T23:12:15.062488+0000","last_clean":"2024-02-21T23:12:15.062488+0000","last_became_active":"2024-02-21T23:01:50.554591+0000","last_became_peered":"2024-02-21T23:01:50.554591+0000","last_unstale":"2024-02-21T23:12:15.062488+0000","last_undegraded":"2024-02-21T23:12:15.062488+0000","last_fullsized":"2024-02-21T23:12:15.062488+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:32:15.029558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0034363990000000001,"stat_sum":{"num_bytes":332054,"num_objects":124,"num_object_clones":0,"num_object_copies":496,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":124,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":310,"num_write_kb":722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2,4],"acting":[8,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.16","version":"32'77","reported_seq":159,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.241055+0000","last_change":"2024-02-21T23:12:08.608792+0000","last_active":"2024-02-21T23:12:15.241055+0000","last_peered":"2024-02-21T23:12:15.241055+0000","last_clean":"2024-02-21T23:12:15.241055+0000","last_became_active":"2024-02-21T23:01:03.215004+0000","last_became_peered":"2024-02-21T23:01:03.215004+0000","last_unstale":"2024-02-21T23:12:15.241055+0000","last_undegraded":"2024-02-21T23:12:15.241055+0000","last_fullsized":"2024-02-21T23:12:15.241055+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:34:02.477270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024858219999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"32'15","reported_seq":749,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:58.753639+0000","last_change":"2024-02-21T23:01:02.207663+0000","last_active":"2024-02-21T23:12:58.753639+0000","last_peered":"2024-02-21T23:12:58.753639+0000","last_clean":"2024-02-21T23:12:58.753639+0000","last_became_active":"2024-02-21T23:01:02.207349+0000","last_became_peered":"2024-02-21T23:01:02.207349+0000","last_unstale":"2024-02-21T23:12:58.753639+0000","last_undegraded":"2024-02-21T23:12:58.753639+0000","last_fullsized":"2024-02-21T23:12:58.753639+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:21:29.919968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":686,"num_read_kb":686,"num_write":21,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5],"acting":[10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"35'344","reported_seq":403,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.825538+0000","last_change":"2024-02-21T23:12:08.622969+0000","last_active":"2024-02-21T23:12:14.825538+0000","last_peered":"2024-02-21T23:12:14.825538+0000","last_clean":"2024-02-21T23:12:14.825538+0000","last_became_active":"2024-02-21T23:01:07.268193+0000","last_became_peered":"2024-02-21T23:01:07.268193+0000","last_unstale":"2024-02-21T23:12:14.825538+0000","last_undegraded":"2024-02-21T23:12:14.825538+0000","last_fullsized":"2024-02-21T23:12:14.825538+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:03:34.064139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010511161999999999,"stat_sum":{"num_bytes":737229,"num_objects":93,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":303,"num_write_kb":1054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"35'297","reported_seq":362,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.960452+0000","last_change":"2024-02-21T23:12:08.705629+0000","last_active":"2024-02-21T23:12:14.960452+0000","last_peered":"2024-02-21T23:12:14.960452+0000","last_clean":"2024-02-21T23:12:14.960452+0000","last_became_active":"2024-02-21T23:01:07.271175+0000","last_became_peered":"2024-02-21T23:01:07.271175+0000","last_unstale":"2024-02-21T23:12:14.960452+0000","last_undegraded":"2024-02-21T23:12:14.960452+0000","last_fullsized":"2024-02-21T23:12:14.960452+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:04:13.965614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0038708390000000001,"stat_sum":{"num_bytes":430239,"num_objects":97,"num_object_clones":0,"num_object_copies":388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":97,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":271,"num_write_kb":710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"32'64","reported_seq":146,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.156340+0000","last_change":"2024-02-21T23:12:08.615458+0000","last_active":"2024-02-21T23:12:15.156340+0000","last_peered":"2024-02-21T23:12:15.156340+0000","last_clean":"2024-02-21T23:12:15.156340+0000","last_became_active":"2024-02-21T23:01:03.210599+0000","last_became_peered":"2024-02-21T23:01:03.210599+0000","last_unstale":"2024-02-21T23:12:15.156340+0000","last_undegraded":"2024-02-21T23:12:15.156340+0000","last_fullsized":"2024-02-21T23:12:15.156340+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:55:05.296534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0070665069999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"32'10","reported_seq":58,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.971977+0000","last_change":"2024-02-21T23:01:02.204603+0000","last_active":"2024-02-21T23:12:14.971977+0000","last_peered":"2024-02-21T23:12:14.971977+0000","last_clean":"2024-02-21T23:12:14.971977+0000","last_became_active":"2024-02-21T23:01:02.204304+0000","last_became_peered":"2024-02-21T23:01:02.204304+0000","last_unstale":"2024-02-21T23:12:14.971977+0000","last_undegraded":"2024-02-21T23:12:14.971977+0000","last_fullsized":"2024-02-21T23:12:14.971977+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:58:23.554457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"35'308","reported_seq":373,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.628894+0000","last_change":"2024-02-21T23:12:08.667582+0000","last_active":"2024-02-21T23:12:15.628894+0000","last_peered":"2024-02-21T23:12:15.628894+0000","last_clean":"2024-02-21T23:12:15.628894+0000","last_became_active":"2024-02-21T23:01:07.283568+0000","last_became_peered":"2024-02-21T23:01:07.283568+0000","last_unstale":"2024-02-21T23:12:15.628894+0000","last_undegraded":"2024-02-21T23:12:15.628894+0000","last_fullsized":"2024-02-21T23:12:15.628894+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":308,"log_dups_size":0,"ondisk_log_size":308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:44:32.467350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003898777,"stat_sum":{"num_bytes":444936,"num_objects":124,"num_object_clones":0,"num_object_copies":496,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":124,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":282,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"32'78","reported_seq":160,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.825260+0000","last_change":"2024-02-21T23:12:08.622094+0000","last_active":"2024-02-21T23:12:14.825260+0000","last_peered":"2024-02-21T23:12:14.825260+0000","last_clean":"2024-02-21T23:12:14.825260+0000","last_became_active":"2024-02-21T23:01:03.208141+0000","last_became_peered":"2024-02-21T23:01:03.208141+0000","last_unstale":"2024-02-21T23:12:14.825260+0000","last_undegraded":"2024-02-21T23:12:14.825260+0000","last_fullsized":"2024-02-21T23:12:14.825260+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:23:47.543277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010800880000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"32'20","reported_seq":74,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.842192+0000","last_change":"2024-02-21T23:01:02.218826+0000","last_active":"2024-02-21T23:12:14.842192+0000","last_peered":"2024-02-21T23:12:14.842192+0000","last_clean":"2024-02-21T23:12:14.842192+0000","last_became_active":"2024-02-21T23:01:02.218499+0000","last_became_peered":"2024-02-21T23:01:02.218499+0000","last_unstale":"2024-02-21T23:12:14.842192+0000","last_undegraded":"2024-02-21T23:12:14.842192+0000","last_fullsized":"2024-02-21T23:12:14.842192+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:17:06.353018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62737,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":6,"num_read_kb":64,"num_write":27,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"32'47","reported_seq":116,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.875654+0000","last_change":"2024-02-21T23:01:02.209061+0000","last_active":"2024-02-21T23:12:14.875654+0000","last_peered":"2024-02-21T23:12:14.875654+0000","last_clean":"2024-02-21T23:12:14.875654+0000","last_became_active":"2024-02-21T23:01:02.208779+0000","last_became_peered":"2024-02-21T23:01:02.208779+0000","last_unstale":"2024-02-21T23:12:14.875654+0000","last_undegraded":"2024-02-21T23:12:14.875654+0000","last_fullsized":"2024-02-21T23:12:14.875654+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:17:06.353018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":4098,"num_write":52,"num_write_kb":4233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8],"acting":[10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"32'62","reported_seq":144,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.972084+0000","last_change":"2024-02-21T23:12:08.673921+0000","last_active":"2024-02-21T23:12:14.972084+0000","last_peered":"2024-02-21T23:12:14.972084+0000","last_clean":"2024-02-21T23:12:14.972084+0000","last_became_active":"2024-02-21T23:01:03.212560+0000","last_became_peered":"2024-02-21T23:01:03.212560+0000","last_unstale":"2024-02-21T23:12:14.972084+0000","last_undegraded":"2024-02-21T23:12:14.972084+0000","last_fullsized":"2024-02-21T23:12:14.972084+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:01:36.467676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036569530000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"35'328","reported_seq":386,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.821605+0000","last_change":"2024-02-21T23:12:08.715992+0000","last_active":"2024-02-21T23:12:14.821605+0000","last_peered":"2024-02-21T23:12:14.821605+0000","last_clean":"2024-02-21T23:12:14.821605+0000","last_became_active":"2024-02-21T23:01:07.267796+0000","last_became_peered":"2024-02-21T23:01:07.267796+0000","last_unstale":"2024-02-21T23:12:14.821605+0000","last_undegraded":"2024-02-21T23:12:14.821605+0000","last_fullsized":"2024-02-21T23:12:14.821605+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:59:12.232049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0050978890000000004,"stat_sum":{"num_bytes":212072,"num_objects":97,"num_object_clones":0,"num_object_copies":388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":97,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":291,"num_write_kb":1346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"32'86","reported_seq":1369,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:59.755728+0000","last_change":"2024-02-21T23:01:02.206398+0000","last_active":"2024-02-21T23:12:59.755728+0000","last_peered":"2024-02-21T23:12:59.755728+0000","last_clean":"2024-02-21T23:12:59.755728+0000","last_became_active":"2024-02-21T23:01:02.206069+0000","last_became_peered":"2024-02-21T23:01:02.206069+0000","last_unstale":"2024-02-21T23:12:59.755728+0000","last_undegraded":"2024-02-21T23:12:59.755728+0000","last_fullsized":"2024-02-21T23:12:59.755728+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:26:49.911102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9892253,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":1235,"num_read_kb":9674,"num_write":91,"num_write_kb":9838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"32'52","reported_seq":134,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.062722+0000","last_change":"2024-02-21T23:12:08.714756+0000","last_active":"2024-02-21T23:12:15.062722+0000","last_peered":"2024-02-21T23:12:15.062722+0000","last_clean":"2024-02-21T23:12:15.062722+0000","last_became_active":"2024-02-21T23:01:03.220900+0000","last_became_peered":"2024-02-21T23:01:03.220900+0000","last_unstale":"2024-02-21T23:12:15.062722+0000","last_undegraded":"2024-02-21T23:12:15.062722+0000","last_fullsized":"2024-02-21T23:12:15.062722+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:25:38.592184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042536859999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9],"acting":[8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"35'336","reported_seq":393,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.822380+0000","last_change":"2024-02-21T23:12:08.716520+0000","last_active":"2024-02-21T23:12:14.822380+0000","last_peered":"2024-02-21T23:12:14.822380+0000","last_clean":"2024-02-21T23:12:14.822380+0000","last_became_active":"2024-02-21T23:01:07.256474+0000","last_became_peered":"2024-02-21T23:01:07.256474+0000","last_unstale":"2024-02-21T23:12:14.822380+0000","last_undegraded":"2024-02-21T23:12:14.822380+0000","last_fullsized":"2024-02-21T23:12:14.822380+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:03:56.907378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0052156759999999998,"stat_sum":{"num_bytes":406297,"num_objects":103,"num_object_clones":0,"num_object_copies":412,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":293,"num_write_kb":672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"32'75","reported_seq":158,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.627459+0000","last_change":"2024-02-21T23:12:08.667906+0000","last_active":"2024-02-21T23:12:15.627459+0000","last_peered":"2024-02-21T23:12:15.627459+0000","last_clean":"2024-02-21T23:12:15.627459+0000","last_became_active":"2024-02-21T23:01:03.215461+0000","last_became_peered":"2024-02-21T23:01:03.215461+0000","last_unstale":"2024-02-21T23:12:15.627459+0000","last_undegraded":"2024-02-21T23:12:15.627459+0000","last_fullsized":"2024-02-21T23:12:15.627459+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:51:26.354389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041591809999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"32'71","reported_seq":154,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.821930+0000","last_change":"2024-02-21T23:12:08.715407+0000","last_active":"2024-02-21T23:12:14.821930+0000","last_peered":"2024-02-21T23:12:14.821930+0000","last_clean":"2024-02-21T23:12:14.821930+0000","last_became_active":"2024-02-21T23:01:03.215639+0000","last_became_peered":"2024-02-21T23:01:03.215639+0000","last_unstale":"2024-02-21T23:12:14.821930+0000","last_undegraded":"2024-02-21T23:12:14.821930+0000","last_fullsized":"2024-02-21T23:12:14.821930+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:48:40.284242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0047914689999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"32'66","reported_seq":149,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.821515+0000","last_change":"2024-02-21T23:12:08.712004+0000","last_active":"2024-02-21T23:12:14.821515+0000","last_peered":"2024-02-21T23:12:14.821515+0000","last_clean":"2024-02-21T23:12:14.821515+0000","last_became_active":"2024-02-21T23:01:03.218377+0000","last_became_peered":"2024-02-21T23:01:03.218377+0000","last_unstale":"2024-02-21T23:12:14.821515+0000","last_undegraded":"2024-02-21T23:12:14.821515+0000","last_fullsized":"2024-02-21T23:12:14.821515+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:52:50.911363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019364429999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"32'63","reported_seq":146,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.960111+0000","last_change":"2024-02-21T23:12:08.705210+0000","last_active":"2024-02-21T23:12:14.960111+0000","last_peered":"2024-02-21T23:12:14.960111+0000","last_clean":"2024-02-21T23:12:14.960111+0000","last_became_active":"2024-02-21T23:01:03.225085+0000","last_became_peered":"2024-02-21T23:01:03.225085+0000","last_unstale":"2024-02-21T23:12:14.960111+0000","last_undegraded":"2024-02-21T23:12:14.960111+0000","last_fullsized":"2024-02-21T23:12:14.960111+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:39:42.402349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0037249340000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"32'45","reported_seq":128,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.843516+0000","last_change":"2024-02-21T23:12:08.719085+0000","last_active":"2024-02-21T23:12:14.843516+0000","last_peered":"2024-02-21T23:12:14.843516+0000","last_clean":"2024-02-21T23:12:14.843516+0000","last_became_active":"2024-02-21T23:01:03.225925+0000","last_became_peered":"2024-02-21T23:01:03.225925+0000","last_unstale":"2024-02-21T23:12:14.843516+0000","last_undegraded":"2024-02-21T23:12:14.843516+0000","last_fullsized":"2024-02-21T23:12:14.843516+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:04:09.917536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0086580830000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"32'52","reported_seq":135,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.627610+0000","last_change":"2024-02-21T23:12:08.667425+0000","last_active":"2024-02-21T23:12:15.627610+0000","last_peered":"2024-02-21T23:12:15.627610+0000","last_clean":"2024-02-21T23:12:15.627610+0000","last_became_active":"2024-02-21T23:01:03.214488+0000","last_became_peered":"2024-02-21T23:01:03.214488+0000","last_unstale":"2024-02-21T23:12:15.627610+0000","last_undegraded":"2024-02-21T23:12:15.627610+0000","last_fullsized":"2024-02-21T23:12:15.627610+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:12:45.004002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003806336,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8],"acting":[11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"32'76","reported_seq":159,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.822327+0000","last_change":"2024-02-21T23:12:08.715929+0000","last_active":"2024-02-21T23:12:14.822327+0000","last_peered":"2024-02-21T23:12:14.822327+0000","last_clean":"2024-02-21T23:12:14.822327+0000","last_became_active":"2024-02-21T23:01:03.208458+0000","last_became_peered":"2024-02-21T23:01:03.208458+0000","last_unstale":"2024-02-21T23:12:14.822327+0000","last_undegraded":"2024-02-21T23:12:14.822327+0000","last_fullsized":"2024-02-21T23:12:14.822327+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:39:42.402349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041855369999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8],"acting":[2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"32'45","reported_seq":128,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.826929+0000","last_change":"2024-02-21T23:12:08.622658+0000","last_active":"2024-02-21T23:12:14.826929+0000","last_peered":"2024-02-21T23:12:14.826929+0000","last_clean":"2024-02-21T23:12:14.826929+0000","last_became_active":"2024-02-21T23:01:03.206376+0000","last_became_peered":"2024-02-21T23:01:03.206376+0000","last_unstale":"2024-02-21T23:12:14.826929+0000","last_undegraded":"2024-02-21T23:12:14.826929+0000","last_fullsized":"2024-02-21T23:12:14.826929+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:01:00.300776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011228559000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"32'56","reported_seq":139,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.971688+0000","last_change":"2024-02-21T23:12:08.674979+0000","last_active":"2024-02-21T23:12:14.971688+0000","last_peered":"2024-02-21T23:12:14.971688+0000","last_clean":"2024-02-21T23:12:14.971688+0000","last_became_active":"2024-02-21T23:01:03.214922+0000","last_became_peered":"2024-02-21T23:01:03.214922+0000","last_unstale":"2024-02-21T23:12:14.971688+0000","last_undegraded":"2024-02-21T23:12:14.971688+0000","last_fullsized":"2024-02-21T23:12:14.971688+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:23:08.703440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040330870000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"32'59","reported_seq":142,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.825264+0000","last_change":"2024-02-21T23:12:08.623727+0000","last_active":"2024-02-21T23:12:14.825264+0000","last_peered":"2024-02-21T23:12:14.825264+0000","last_clean":"2024-02-21T23:12:14.825264+0000","last_became_active":"2024-02-21T23:01:03.213428+0000","last_became_peered":"2024-02-21T23:01:03.213428+0000","last_unstale":"2024-02-21T23:12:14.825264+0000","last_undegraded":"2024-02-21T23:12:14.825264+0000","last_fullsized":"2024-02-21T23:12:14.825264+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:37:40.493779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011202166,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"32'58","reported_seq":141,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.240978+0000","last_change":"2024-02-21T23:12:08.608072+0000","last_active":"2024-02-21T23:12:15.240978+0000","last_peered":"2024-02-21T23:12:15.240978+0000","last_clean":"2024-02-21T23:12:15.240978+0000","last_became_active":"2024-02-21T23:01:03.215580+0000","last_became_peered":"2024-02-21T23:01:03.215580+0000","last_unstale":"2024-02-21T23:12:15.240978+0000","last_undegraded":"2024-02-21T23:12:15.240978+0000","last_fullsized":"2024-02-21T23:12:15.240978+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:47:27.962126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023411170000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"32'65","reported_seq":148,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.843676+0000","last_change":"2024-02-21T23:12:08.718997+0000","last_active":"2024-02-21T23:12:14.843676+0000","last_peered":"2024-02-21T23:12:14.843676+0000","last_clean":"2024-02-21T23:12:14.843676+0000","last_became_active":"2024-02-21T23:01:03.223861+0000","last_became_peered":"2024-02-21T23:01:03.223861+0000","last_unstale":"2024-02-21T23:12:14.843676+0000","last_undegraded":"2024-02-21T23:12:14.843676+0000","last_fullsized":"2024-02-21T23:12:14.843676+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:13:25.637195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0087043620000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"32'67","reported_seq":150,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.627612+0000","last_change":"2024-02-21T23:12:08.666440+0000","last_active":"2024-02-21T23:12:15.627612+0000","last_peered":"2024-02-21T23:12:15.627612+0000","last_clean":"2024-02-21T23:12:15.627612+0000","last_became_active":"2024-02-21T23:01:03.212691+0000","last_became_peered":"2024-02-21T23:01:03.212691+0000","last_unstale":"2024-02-21T23:12:15.627612+0000","last_undegraded":"2024-02-21T23:12:15.627612+0000","last_fullsized":"2024-02-21T23:12:15.627612+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:13:25.637195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0030459049999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"32'58","reported_seq":141,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.822200+0000","last_change":"2024-02-21T23:12:08.716680+0000","last_active":"2024-02-21T23:12:14.822200+0000","last_peered":"2024-02-21T23:12:14.822200+0000","last_clean":"2024-02-21T23:12:14.822200+0000","last_became_active":"2024-02-21T23:01:03.217613+0000","last_became_peered":"2024-02-21T23:01:03.217613+0000","last_unstale":"2024-02-21T23:12:14.822200+0000","last_undegraded":"2024-02-21T23:12:14.822200+0000","last_fullsized":"2024-02-21T23:12:14.822200+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:04:09.917536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0051553379999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"32'62","reported_seq":145,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.156874+0000","last_change":"2024-02-21T23:12:08.616485+0000","last_active":"2024-02-21T23:12:15.156874+0000","last_peered":"2024-02-21T23:12:15.156874+0000","last_clean":"2024-02-21T23:12:15.156874+0000","last_became_active":"2024-02-21T23:01:03.214165+0000","last_became_peered":"2024-02-21T23:01:03.214165+0000","last_unstale":"2024-02-21T23:12:15.156874+0000","last_undegraded":"2024-02-21T23:12:15.156874+0000","last_fullsized":"2024-02-21T23:12:15.156874+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:44:37.422634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00687764,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1],"acting":[9,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"32'51","reported_seq":134,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.629222+0000","last_change":"2024-02-21T23:12:08.668135+0000","last_active":"2024-02-21T23:12:15.629222+0000","last_peered":"2024-02-21T23:12:15.629222+0000","last_clean":"2024-02-21T23:12:15.629222+0000","last_became_active":"2024-02-21T23:01:03.213755+0000","last_became_peered":"2024-02-21T23:01:03.213755+0000","last_unstale":"2024-02-21T23:12:15.629222+0000","last_undegraded":"2024-02-21T23:12:15.629222+0000","last_fullsized":"2024-02-21T23:12:15.629222+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:01:36.467676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041418410000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"32'59","reported_seq":142,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.241655+0000","last_change":"2024-02-21T23:12:08.608309+0000","last_active":"2024-02-21T23:12:15.241655+0000","last_peered":"2024-02-21T23:12:15.241655+0000","last_clean":"2024-02-21T23:12:15.241655+0000","last_became_active":"2024-02-21T23:01:03.216345+0000","last_became_peered":"2024-02-21T23:01:03.216345+0000","last_unstale":"2024-02-21T23:12:15.241655+0000","last_undegraded":"2024-02-21T23:12:15.241655+0000","last_fullsized":"2024-02-21T23:12:15.241655+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:44:37.422634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027043900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"32'62","reported_seq":145,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.959952+0000","last_change":"2024-02-21T23:12:08.706913+0000","last_active":"2024-02-21T23:12:14.959952+0000","last_peered":"2024-02-21T23:12:14.959952+0000","last_clean":"2024-02-21T23:12:14.959952+0000","last_became_active":"2024-02-21T23:01:03.225574+0000","last_became_peered":"2024-02-21T23:01:03.225574+0000","last_unstale":"2024-02-21T23:12:14.959952+0000","last_undegraded":"2024-02-21T23:12:14.959952+0000","last_fullsized":"2024-02-21T23:12:14.959952+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:12:45.004002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0048553650000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"32'64","reported_seq":147,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.959843+0000","last_change":"2024-02-21T23:12:08.704695+0000","last_active":"2024-02-21T23:12:14.959843+0000","last_peered":"2024-02-21T23:12:14.959843+0000","last_clean":"2024-02-21T23:12:14.959843+0000","last_became_active":"2024-02-21T23:01:03.217938+0000","last_became_peered":"2024-02-21T23:01:03.217938+0000","last_unstale":"2024-02-21T23:12:14.959843+0000","last_undegraded":"2024-02-21T23:12:14.959843+0000","last_fullsized":"2024-02-21T23:12:14.959843+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:59:08.183972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003564963,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8],"acting":[0,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"32'61","reported_seq":143,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.843531+0000","last_change":"2024-02-21T23:12:08.717094+0000","last_active":"2024-02-21T23:12:14.843531+0000","last_peered":"2024-02-21T23:12:14.843531+0000","last_clean":"2024-02-21T23:12:14.843531+0000","last_became_active":"2024-02-21T23:01:03.225449+0000","last_became_peered":"2024-02-21T23:01:03.225449+0000","last_unstale":"2024-02-21T23:12:14.843531+0000","last_undegraded":"2024-02-21T23:12:14.843531+0000","last_fullsized":"2024-02-21T23:12:14.843531+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:53:32.848973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.006971741,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10],"acting":[6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"32'49","reported_seq":131,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.823390+0000","last_change":"2024-02-21T23:12:08.717258+0000","last_active":"2024-02-21T23:12:14.823390+0000","last_peered":"2024-02-21T23:12:14.823390+0000","last_clean":"2024-02-21T23:12:14.823390+0000","last_became_active":"2024-02-21T23:01:03.208446+0000","last_became_peered":"2024-02-21T23:01:03.208446+0000","last_unstale":"2024-02-21T23:12:14.823390+0000","last_undegraded":"2024-02-21T23:12:14.823390+0000","last_fullsized":"2024-02-21T23:12:14.823390+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:23:47.543277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0075836849999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"32'63","reported_seq":145,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.347830+0000","last_change":"2024-02-21T23:12:08.714531+0000","last_active":"2024-02-21T23:12:15.347830+0000","last_peered":"2024-02-21T23:12:15.347830+0000","last_clean":"2024-02-21T23:12:15.347830+0000","last_became_active":"2024-02-21T23:01:03.217925+0000","last_became_peered":"2024-02-21T23:01:03.217925+0000","last_unstale":"2024-02-21T23:12:15.347830+0000","last_undegraded":"2024-02-21T23:12:15.347830+0000","last_fullsized":"2024-02-21T23:12:15.347830+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:11:24.214077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040956530000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8],"acting":[7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"32'65","reported_seq":147,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.876194+0000","last_change":"2024-02-21T23:12:08.665828+0000","last_active":"2024-02-21T23:12:14.876194+0000","last_peered":"2024-02-21T23:12:14.876194+0000","last_clean":"2024-02-21T23:12:14.876194+0000","last_became_active":"2024-02-21T23:01:03.211921+0000","last_became_peered":"2024-02-21T23:01:03.211921+0000","last_unstale":"2024-02-21T23:12:14.876194+0000","last_undegraded":"2024-02-21T23:12:14.876194+0000","last_fullsized":"2024-02-21T23:12:14.876194+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:39:43.532897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001167464,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2],"acting":[10,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"32'69","reported_seq":151,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.240765+0000","last_change":"2024-02-21T23:12:08.609207+0000","last_active":"2024-02-21T23:12:15.240765+0000","last_peered":"2024-02-21T23:12:15.240765+0000","last_clean":"2024-02-21T23:12:15.240765+0000","last_became_active":"2024-02-21T23:01:03.216580+0000","last_became_peered":"2024-02-21T23:01:03.216580+0000","last_unstale":"2024-02-21T23:12:15.240765+0000","last_undegraded":"2024-02-21T23:12:15.240765+0000","last_fullsized":"2024-02-21T23:12:15.240765+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:31:33.327648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028130189999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"32'51","reported_seq":133,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.825163+0000","last_change":"2024-02-21T23:12:08.622328+0000","last_active":"2024-02-21T23:12:14.825163+0000","last_peered":"2024-02-21T23:12:14.825163+0000","last_clean":"2024-02-21T23:12:14.825163+0000","last_became_active":"2024-02-21T23:01:03.211811+0000","last_became_peered":"2024-02-21T23:01:03.211811+0000","last_unstale":"2024-02-21T23:12:14.825163+0000","last_undegraded":"2024-02-21T23:12:14.825163+0000","last_fullsized":"2024-02-21T23:12:14.825163+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:23:08.703440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010173674000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"32'65","reported_seq":147,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.347545+0000","last_change":"2024-02-21T23:12:08.715177+0000","last_active":"2024-02-21T23:12:15.347545+0000","last_peered":"2024-02-21T23:12:15.347545+0000","last_clean":"2024-02-21T23:12:15.347545+0000","last_became_active":"2024-02-21T23:01:03.223255+0000","last_became_peered":"2024-02-21T23:01:03.223255+0000","last_unstale":"2024-02-21T23:12:15.347545+0000","last_undegraded":"2024-02-21T23:12:15.347545+0000","last_fullsized":"2024-02-21T23:12:15.347545+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:51:26.354389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0045391540000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9],"acting":[7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"32'59","reported_seq":141,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.875584+0000","last_change":"2024-02-21T23:12:08.665498+0000","last_active":"2024-02-21T23:12:14.875584+0000","last_peered":"2024-02-21T23:12:14.875584+0000","last_clean":"2024-02-21T23:12:14.875584+0000","last_became_active":"2024-02-21T23:01:03.209569+0000","last_became_peered":"2024-02-21T23:01:03.209569+0000","last_unstale":"2024-02-21T23:12:14.875584+0000","last_undegraded":"2024-02-21T23:12:14.875584+0000","last_fullsized":"2024-02-21T23:12:14.875584+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:20:38.984727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015588990000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9],"acting":[10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"32'56","reported_seq":138,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.062741+0000","last_change":"2024-02-21T23:12:08.713984+0000","last_active":"2024-02-21T23:12:15.062741+0000","last_peered":"2024-02-21T23:12:15.062741+0000","last_clean":"2024-02-21T23:12:15.062741+0000","last_became_active":"2024-02-21T23:01:03.213941+0000","last_became_peered":"2024-02-21T23:01:03.213941+0000","last_unstale":"2024-02-21T23:12:15.062741+0000","last_undegraded":"2024-02-21T23:12:15.062741+0000","last_fullsized":"2024-02-21T23:12:15.062741+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:44:37.422634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041976929999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3],"acting":[8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"32'49","reported_seq":132,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.823155+0000","last_change":"2024-02-21T23:12:08.716284+0000","last_active":"2024-02-21T23:12:14.823155+0000","last_peered":"2024-02-21T23:12:14.823155+0000","last_clean":"2024-02-21T23:12:14.823155+0000","last_became_active":"2024-02-21T23:01:03.206762+0000","last_became_peered":"2024-02-21T23:01:03.206762+0000","last_unstale":"2024-02-21T23:12:14.823155+0000","last_undegraded":"2024-02-21T23:12:14.823155+0000","last_fullsized":"2024-02-21T23:12:14.823155+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:01:36.467676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068220390000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8],"acting":[4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"32'65","reported_seq":148,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.960225+0000","last_change":"2024-02-21T23:12:08.708085+0000","last_active":"2024-02-21T23:12:14.960225+0000","last_peered":"2024-02-21T23:12:14.960225+0000","last_clean":"2024-02-21T23:12:14.960225+0000","last_became_active":"2024-02-21T23:01:03.221672+0000","last_became_peered":"2024-02-21T23:01:03.221672+0000","last_unstale":"2024-02-21T23:12:14.960225+0000","last_undegraded":"2024-02-21T23:12:14.960225+0000","last_fullsized":"2024-02-21T23:12:14.960225+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:11:24.214077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0057510360000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"32'41","reported_seq":124,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.960616+0000","last_change":"2024-02-21T23:12:08.706177+0000","last_active":"2024-02-21T23:12:14.960616+0000","last_peered":"2024-02-21T23:12:14.960616+0000","last_clean":"2024-02-21T23:12:14.960616+0000","last_became_active":"2024-02-21T23:01:03.219379+0000","last_became_peered":"2024-02-21T23:01:03.219379+0000","last_unstale":"2024-02-21T23:12:14.960616+0000","last_undegraded":"2024-02-21T23:12:14.960616+0000","last_fullsized":"2024-02-21T23:12:14.960616+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:53:08.201764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00417075,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11],"acting":[0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"32'44","reported_seq":127,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.629039+0000","last_change":"2024-02-21T23:12:08.668249+0000","last_active":"2024-02-21T23:12:15.629039+0000","last_peered":"2024-02-21T23:12:15.629039+0000","last_clean":"2024-02-21T23:12:15.629039+0000","last_became_active":"2024-02-21T23:01:03.212878+0000","last_became_peered":"2024-02-21T23:01:03.212878+0000","last_unstale":"2024-02-21T23:12:15.629039+0000","last_undegraded":"2024-02-21T23:12:15.629039+0000","last_fullsized":"2024-02-21T23:12:15.629039+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:23:47.543277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042655480000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":26460371,"num_objects":3449,"num_object_clones":0,"num_object_copies":13796,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3449,"num_whiteouts":0,"num_read":1,"num_read_kb":1270,"num_write":9636,"num_write_kb":38355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":91508736,"data_stored":98402304,"data_compressed":4659312,"data_compressed_allocated":5701632,"data_compressed_original":12595200,"omap_allocated":0,"internal_metadata":0},"log_size":10826,"ondisk_log_size":10826,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3698,"ondisk_log_size":3698,"up":128,"acting":128,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":60973696,"num_objects":267,"num_object_clones":0,"num_object_copies":534,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":267,"num_whiteouts":0,"num_read":6585,"num_read_kb":62538,"num_write":2281,"num_write_kb":69704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":221,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":26804224,"data_stored":121947392,"data_compressed":17887090,"data_compressed_allocated":22609920,"data_compressed_original":117915648,"omap_allocated":0,"internal_metadata":0},"log_size":1638,"ondisk_log_size":1638,"up":64,"acting":64,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66458,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":11,"up_from":17,"seq":73014444179,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46372,"kb_used_data":6872,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94325468,"statfs":{"total":96636764160,"available":96589279232,"internally_reserved":0,"allocated":7036928,"data_stored":7192237,"data_compressed":328586,"data_compressed_allocated":405504,"data_compressed_original":815104,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":17,"seq":73014444178,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49200,"kb_used_data":9700,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94322640,"statfs":{"total":96636764160,"available":96586383360,"internally_reserved":0,"allocated":9932800,"data_stored":22999079,"data_compressed":2652432,"data_compressed_allocated":3399680,"data_compressed_original":16744448,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":17,"seq":73014444179,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50584,"kb_used_data":11088,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94321256,"statfs":{"total":96636764160,"available":96584966144,"internally_reserved":0,"allocated":11354112,"data_stored":15511303,"data_compressed":1072430,"data_compressed_allocated":1388544,"data_compressed_original":5804032,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":17,"seq":73014444178,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47140,"kb_used_data":7644,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94324700,"statfs":{"total":96636764160,"available":96588492800,"internally_reserved":0,"allocated":7827456,"data_stored":21888259,"data_compressed":2896373,"data_compressed_allocated":3649536,"data_compressed_original":17977344,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,3,4,5,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":17,"seq":73014444179,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39008,"kb_used_data":11988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94332832,"statfs":{"total":96636764160,"available":96596819968,"internally_reserved":0,"allocated":12275712,"data_stored":26096945,"data_compressed":2815859,"data_compressed_allocated":3579904,"data_compressed_original":17661952,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":17,"seq":73014444178,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44888,"kb_used_data":9548,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94326952,"statfs":{"total":96636764160,"available":96590798848,"internally_reserved":0,"allocated":9777152,"data_stored":13577476,"data_compressed":1118839,"data_compressed_allocated":1355776,"data_compressed_original":5414912,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":17,"seq":73014444179,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41616,"kb_used_data":14596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94330224,"statfs":{"total":96636764160,"available":96594149376,"internally_reserved":0,"allocated":14946304,"data_stored":30254498,"data_compressed":3332972,"data_compressed_allocated":4235264,"data_compressed_original":19828736,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":17,"seq":73014444179,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49440,"kb_used_data":9940,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94322400,"statfs":{"total":96636764160,"available":96586137600,"internally_reserved":0,"allocated":10178560,"data_stored":10999294,"data_compressed":671953,"data_compressed_allocated":815104,"data_compressed_original":1896448,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":17,"seq":73014444179,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46940,"kb_used_data":7440,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94324900,"statfs":{"total":96636764160,"available":96588697600,"internally_reserved":0,"allocated":7618560,"data_stored":11946061,"data_compressed":1296354,"data_compressed_allocated":1605632,"data_compressed_original":6193152,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444179,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52736,"kb_used_data":13236,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94319104,"statfs":{"total":96636764160,"available":96582762496,"internally_reserved":0,"allocated":13553664,"data_stored":37826176,"data_compressed":5011784,"data_compressed_allocated":6279168,"data_compressed_original":30818304,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":17,"seq":73014444179,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49508,"kb_used_data":10008,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94322332,"statfs":{"total":96636764160,"available":96586067968,"internally_reserved":0,"allocated":10248192,"data_stored":13655815,"data_compressed":1001090,"data_compressed_allocated":1249280,"data_compressed_original":4915200,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":17,"seq":73014444179,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44084,"kb_used_data":8744,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327756,"statfs":{"total":96636764160,"available":96591622144,"internally_reserved":0,"allocated":8953856,"data_stored":12521357,"data_compressed":892256,"data_compressed_allocated":1126400,"data_compressed_original":4964352,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33229,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33229,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":831488,"data_stored":4195110,"data_compressed":654518,"data_compressed_allocated":794624,"data_compressed_original":4177920,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":983040,"data_stored":4194976,"data_compressed":615592,"data_compressed_allocated":782336,"data_compressed_original":4001792,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6569984,"data_stored":30536217,"data_compressed":4544343,"data_compressed_allocated":5718016,"data_compressed_original":29700096,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":962560,"data_stored":4484070,"data_compressed":694867,"data_compressed_allocated":851968,"data_compressed_original":4382720,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":63895,"data_compressed":8106,"data_compressed_allocated":12288,"data_compressed_original":36864,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4325376,"data_stored":18609947,"data_compressed":2736860,"data_compressed_allocated":3469312,"data_compressed_original":17784832,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1032192,"data_stored":4546717,"data_compressed":692215,"data_compressed_allocated":839680,"data_compressed_original":4362240,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":3792896,"data_stored":16778922,"data_compressed":2462264,"data_compressed_allocated":3121152,"data_compressed_original":16113664,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":3510272,"data_stored":17170588,"data_compressed":2509837,"data_compressed_allocated":3166208,"data_compressed_original":16842752,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":827392,"data_stored":4588192,"data_compressed":597133,"data_compressed_allocated":802816,"data_compressed_original":4571136,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":3915776,"data_stored":16778176,"data_compressed":2371355,"data_compressed_allocated":3051520,"data_compressed_original":15941632,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":7684096,"data_stored":8081408,"data_compressed":197899,"data_compressed_allocated":274432,"data_compressed_original":671744,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8826880,"data_stored":9216000,"data_compressed":345659,"data_compressed_allocated":409600,"data_compressed_original":798720,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6545408,"data_stored":7045120,"data_compressed":427602,"data_compressed_allocated":503808,"data_compressed_original":1003520,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6217728,"data_stored":7217152,"data_compressed":561648,"data_compressed_allocated":696320,"data_compressed_original":1695744,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":9691136,"data_stored":10690560,"data_compressed":624008,"data_compressed_allocated":745472,"data_compressed_original":1744896,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":10117120,"data_stored":10809344,"data_compressed":523044,"data_compressed_allocated":663552,"data_compressed_original":1355776,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8306688,"data_stored":8785920,"data_compressed":386785,"data_compressed_allocated":458752,"data_compressed_original":937984,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":7979008,"data_stored":8482816,"data_compressed":280527,"data_compressed_allocated":356352,"data_compressed_original":860160,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":3878912,"data_stored":4472832,"data_compressed":346697,"data_compressed_allocated":425984,"data_compressed_original":1019904,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":10088448,"data_stored":10678272,"data_compressed":435458,"data_compressed_allocated":528384,"data_compressed_original":1118208,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":5578752,"data_stored":5976064,"data_compressed":241238,"data_compressed_allocated":290816,"data_compressed_original":688128,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":6594560,"data_stored":6946816,"data_compressed":288747,"data_compressed_allocated":348160,"data_compressed_original":700416,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-21T23:13:03.311 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-02-21T23:13:03.311 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-21T23:13:03.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.547+0000 7f9605e00640 1 Processor -- start 2024-02-21T23:13:03.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.547+0000 7f9605e00640 1 -- start start 2024-02-21T23:13:03.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.550+0000 7f9605e00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f9600182b80 0x7f96000f8020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:03.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.550+0000 7f9605e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f96000f5860 0x7f96000f5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:03.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.550+0000 7f9605e00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96000f8c60 con 0x7f96000f9d00 2024-02-21T23:13:03.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.550+0000 7f9605e00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9600070300 con 0x7f96000f5860 2024-02-21T23:13:03.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.550+0000 7f9605e00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96000f8f40 con 0x7f9600182b80 2024-02-21T23:13:03.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.550+0000 7f95ff400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f96000f5860 0x7f96000f5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:03.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.551+0000 7f95f6000640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f96000f9d00 0x7f96000c95a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:58194/0 (socket says 172.21.15.99:58194) 2024-02-21T23:13:03.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.551+0000 7f95f6000640 1 -- 172.21.15.99:0/3830882484 learned_addr learned my addr 172.21.15.99:0/3830882484 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:13:03.539 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.551+0000 7f95fea00640 1 --2- 172.21.15.99:0/3830882484 >> v2:172.21.15.162:3300/0 conn(0x7f9600182b80 0x7f96000f8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:03.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.551+0000 7f95fe000640 1 -- 172.21.15.99:0/3830882484 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 673339548 0 0) 0x7f96000f8c60 con 0x7f96000f9d00 2024-02-21T23:13:03.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.551+0000 7f95fe000640 1 -- 172.21.15.99:0/3830882484 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95e4003520 con 0x7f96000f9d00 2024-02-21T23:13:03.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.551+0000 7f95ff400640 1 -- 172.21.15.99:0/3830882484 >> v2:172.21.15.162:3300/0 conn(0x7f9600182b80 msgr2=0x7f96000f8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:13:03.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.551+0000 7f95ff400640 1 --2- 172.21.15.99:0/3830882484 >> v2:172.21.15.162:3300/0 conn(0x7f9600182b80 0x7f96000f8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:03.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.551+0000 7f95ff400640 1 -- 172.21.15.99:0/3830882484 >> v1:172.21.15.181:6789/0 conn(0x7f96000f9d00 legacy=0x7f96000c95a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:03.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.551+0000 7f95ff400640 1 -- 172.21.15.99:0/3830882484 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96000f9220 con 0x7f96000f5860 2024-02-21T23:13:03.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.553+0000 7f95ff400640 1 --2- 172.21.15.99:0/3830882484 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f96000f5860 0x7f96000f5cf0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f9600075120 tx=0x7f95f802bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b43ab2c02272b18f server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:03.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.553+0000 7f95fe000640 1 -- 172.21.15.99:0/3830882484 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f8039070 con 0x7f96000f5860 2024-02-21T23:13:03.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.553+0000 7f95fe000640 1 -- 172.21.15.99:0/3830882484 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95f802cb60 con 0x7f96000f5860 2024-02-21T23:13:03.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.553+0000 7f95fe000640 1 -- 172.21.15.99:0/3830882484 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f8034440 con 0x7f96000f5860 2024-02-21T23:13:03.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.554+0000 7f9605e00640 1 -- 172.21.15.99:0/3830882484 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f96000f5860 msgr2=0x7f96000f5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:03.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.554+0000 7f9605e00640 1 --2- 172.21.15.99:0/3830882484 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f96000f5860 0x7f96000f5cf0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f9600075120 tx=0x7f95f802bdb0 comp rx=0 tx=0).stop 2024-02-21T23:13:03.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.554+0000 7f9605e00640 1 -- 172.21.15.99:0/3830882484 shutdown_connections 2024-02-21T23:13:03.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.554+0000 7f9605e00640 1 --2- 172.21.15.99:0/3830882484 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f96000f5860 0x7f96000f5cf0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:03.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.554+0000 7f9605e00640 1 --2- 172.21.15.99:0/3830882484 >> v2:172.21.15.162:3300/0 conn(0x7f9600182b80 0x7f96000f8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:03.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.554+0000 7f9605e00640 1 -- 172.21.15.99:0/3830882484 >> 172.21.15.99:0/3830882484 conn(0x7f96000ce5f0 msgr2=0x7f96000cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:03.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.554+0000 7f9605e00640 1 -- 172.21.15.99:0/3830882484 shutdown_connections 2024-02-21T23:13:03.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.554+0000 7f9605e00640 1 -- 172.21.15.99:0/3830882484 wait complete. 2024-02-21T23:13:03.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.556+0000 7f9605e00640 1 Processor -- start 2024-02-21T23:13:03.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.556+0000 7f9605e00640 1 -- start start 2024-02-21T23:13:03.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.557+0000 7f9605e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f96000f5860 0x7f9600161060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:03.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.557+0000 7f9605e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f96000f9d00 0x7f96001615a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:03.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.557+0000 7f9605e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9600182b80 0x7f9600225bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:03.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.557+0000 7f9605e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96001860c0 con 0x7f96000f5860 2024-02-21T23:13:03.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.557+0000 7f9605e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96000f97e0 con 0x7f9600182b80 2024-02-21T23:13:03.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.557+0000 7f9605e00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96000f8560 con 0x7f96000f9d00 2024-02-21T23:13:03.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.558+0000 7f95fea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f96000f5860 0x7f9600161060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:03.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.558+0000 7f95fea00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f96000f5860 0x7f9600161060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53174/0 (socket says 172.21.15.99:53174) 2024-02-21T23:13:03.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.558+0000 7f95fea00640 1 -- 172.21.15.99:0/1270683116 learned_addr learned my addr 172.21.15.99:0/1270683116 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:13:03.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.558+0000 7f95f6000640 1 --2- 172.21.15.99:0/1270683116 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f96000f9d00 0x7f96001615a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:03.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.558+0000 7f95ff400640 1 --2- 172.21.15.99:0/1270683116 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9600182b80 0x7f9600225bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:03.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.558+0000 7f95fea00640 1 -- 172.21.15.99:0/1270683116 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f96000f9d00 msgr2=0x7f96001615a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:03.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.558+0000 7f95fea00640 1 --2- 172.21.15.99:0/1270683116 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f96000f9d00 0x7f96001615a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:03.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.558+0000 7f95fea00640 1 -- 172.21.15.99:0/1270683116 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9600182b80 msgr2=0x7f9600225bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:03.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.558+0000 7f95fea00640 1 --2- 172.21.15.99:0/1270683116 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9600182b80 0x7f9600225bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:03.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.558+0000 7f95fea00640 1 -- 172.21.15.99:0/1270683116 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9600224b50 con 0x7f96000f5860 2024-02-21T23:13:03.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.558+0000 7f95fea00640 1 --2- 172.21.15.99:0/1270683116 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f96000f5860 0x7f9600161060 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f95f000e9b0 tx=0x7f95f000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:03.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.559+0000 7f95f7e00640 1 -- 172.21.15.99:0/1270683116 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f0017070 con 0x7f96000f5860 2024-02-21T23:13:03.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.559+0000 7f95f7e00640 1 -- 172.21.15.99:0/1270683116 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95f000c9a0 con 0x7f96000f5860 2024-02-21T23:13:03.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.559+0000 7f9605e00640 1 -- 172.21.15.99:0/1270683116 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9600224e30 con 0x7f96000f5860 2024-02-21T23:13:03.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.559+0000 7f95f7e00640 1 -- 172.21.15.99:0/1270683116 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f000cd90 con 0x7f96000f5860 2024-02-21T23:13:03.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.559+0000 7f9605e00640 1 -- 172.21.15.99:0/1270683116 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96002253f0 con 0x7f96000f5860 2024-02-21T23:13:03.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.560+0000 7f9605e00640 1 -- 172.21.15.99:0/1270683116 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9600182730 con 0x7f96000f5860 2024-02-21T23:13:03.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.562+0000 7f95f7e00640 1 -- 172.21.15.99:0/1270683116 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f95f001a070 con 0x7f96000f5860 2024-02-21T23:13:03.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.564+0000 7f95f7e00640 1 --2- 172.21.15.99:0/1270683116 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f95dc09eed0 0x7f95dc0a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:03.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.565+0000 7f95f7e00640 1 -- 172.21.15.99:0/1270683116 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 8965+0+0 (secure 0 0 0) 0x7f95f00c9e00 con 0x7f96000f5860 2024-02-21T23:13:03.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.565+0000 7f95f6000640 1 --2- 172.21.15.99:0/1270683116 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f95dc09eed0 0x7f95dc0a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:03.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.566+0000 7f95f6000640 1 --2- 172.21.15.99:0/1270683116 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f95dc09eed0 0x7f95dc0a1390 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f96000726d0 tx=0x7f95e8009040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:03.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.567+0000 7f95f7e00640 1 -- 172.21.15.99:0/1270683116 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f9600182730 con 0x7f96000f5860 2024-02-21T23:13:03.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.790+0000 7f9605e00640 1 -- 172.21.15.99:0/1270683116 --> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9600168880 con 0x7f95dc09eed0 2024-02-21T23:13:03.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.800+0000 7f95f7e00640 1 -- 172.21.15.99:0/1270683116 <== mgr.5131 v2:172.21.15.162:6800/631076050 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+342680 (secure 0 0 0) 0x7f9600168880 con 0x7f95dc09eed0 2024-02-21T23:13:03.792 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T23:13:03.794 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-02-21T23:13:03.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.805+0000 7f9605e00640 1 -- 172.21.15.99:0/1270683116 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f95dc09eed0 msgr2=0x7f95dc0a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:03.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.805+0000 7f9605e00640 1 --2- 172.21.15.99:0/1270683116 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f95dc09eed0 0x7f95dc0a1390 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f96000726d0 tx=0x7f95e8009040 comp rx=0 tx=0).stop 2024-02-21T23:13:03.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.805+0000 7f9605e00640 1 -- 172.21.15.99:0/1270683116 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f96000f5860 msgr2=0x7f9600161060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:03.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.805+0000 7f9605e00640 1 --2- 172.21.15.99:0/1270683116 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f96000f5860 0x7f9600161060 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f95f000e9b0 tx=0x7f95f000ee70 comp rx=0 tx=0).stop 2024-02-21T23:13:03.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.805+0000 7f9605e00640 1 -- 172.21.15.99:0/1270683116 shutdown_connections 2024-02-21T23:13:03.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.805+0000 7f9605e00640 1 --2- 172.21.15.99:0/1270683116 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f95dc09eed0 0x7f95dc0a1390 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:03.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.805+0000 7f9605e00640 1 --2- 172.21.15.99:0/1270683116 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9600182b80 0x7f9600225bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:03.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.805+0000 7f9605e00640 1 --2- 172.21.15.99:0/1270683116 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f96000f9d00 0x7f96001615a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:03.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.805+0000 7f9605e00640 1 --2- 172.21.15.99:0/1270683116 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f96000f5860 0x7f9600161060 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:03.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.805+0000 7f9605e00640 1 -- 172.21.15.99:0/1270683116 >> 172.21.15.99:0/1270683116 conn(0x7f96000ce5f0 msgr2=0x7f96000f6100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:03.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.805+0000 7f9605e00640 1 -- 172.21.15.99:0/1270683116 shutdown_connections 2024-02-21T23:13:03.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:03.805+0000 7f9605e00640 1 -- 172.21.15.99:0/1270683116 wait complete. 2024-02-21T23:13:03.813 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":336,"stamp":"2024-02-21T23:13:03.297362+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":88024435,"num_objects":3718,"num_object_clones":0,"num_object_copies":14334,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3718,"num_whiteouts":0,"num_read":6823,"num_read_kb":64138,"num_write":12118,"num_write_kb":110997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":221,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16310,"ondisk_log_size":16310,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1132462080,"kb_used":561516,"kb_used_data":120804,"kb_used_omap":18,"kb_used_meta":440557,"kb_avail":1131900564,"statfs":{"total":1159641169920,"available":1159066177536,"internally_reserved":0,"allocated":123703296,"data_stored":224468500,"data_compressed":23090928,"data_compressed_allocated":29089792,"data_compressed_original":133033984,"omap_allocated":19138,"internal_metadata":451130686},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":30,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.078572"},"pg_stats":[{"pgid":"2.1f","version":"32'20","reported_seq":96,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.157454+0000","last_change":"2024-02-21T23:01:02.208441+0000","last_active":"2024-02-21T23:12:15.157454+0000","last_peered":"2024-02-21T23:12:15.157454+0000","last_clean":"2024-02-21T23:12:15.157454+0000","last_became_active":"2024-02-21T23:01:02.208124+0000","last_became_peered":"2024-02-21T23:01:02.208124+0000","last_unstale":"2024-02-21T23:12:15.157454+0000","last_undegraded":"2024-02-21T23:12:15.157454+0000","last_fullsized":"2024-02-21T23:12:15.157454+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:21:29.919968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":27,"num_read_kb":4118,"num_write":27,"num_write_kb":4186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7],"acting":[9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"32'57","reported_seq":140,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.826448+0000","last_change":"2024-02-21T23:12:08.621080+0000","last_active":"2024-02-21T23:12:14.826448+0000","last_peered":"2024-02-21T23:12:14.826448+0000","last_clean":"2024-02-21T23:12:14.826448+0000","last_became_active":"2024-02-21T23:01:03.214170+0000","last_became_peered":"2024-02-21T23:01:03.214170+0000","last_unstale":"2024-02-21T23:12:14.826448+0000","last_undegraded":"2024-02-21T23:12:14.826448+0000","last_fullsized":"2024-02-21T23:12:14.826448+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:51:26.354389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010343064000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"35'364","reported_seq":424,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.821913+0000","last_change":"2024-02-21T23:12:08.712606+0000","last_active":"2024-02-21T23:12:14.821913+0000","last_peered":"2024-02-21T23:12:14.821913+0000","last_clean":"2024-02-21T23:12:14.821913+0000","last_became_active":"2024-02-21T23:01:07.276192+0000","last_became_peered":"2024-02-21T23:01:07.276192+0000","last_unstale":"2024-02-21T23:12:14.821913+0000","last_undegraded":"2024-02-21T23:12:14.821913+0000","last_fullsized":"2024-02-21T23:12:14.821913+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:31:37.375726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0031732990000000001,"stat_sum":{"num_bytes":264461,"num_objects":111,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":111,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":325,"num_write_kb":605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"32'19","reported_seq":85,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.826733+0000","last_change":"2024-02-21T23:01:02.221231+0000","last_active":"2024-02-21T23:12:14.826733+0000","last_peered":"2024-02-21T23:12:14.826733+0000","last_clean":"2024-02-21T23:12:14.826733+0000","last_became_active":"2024-02-21T23:01:02.220941+0000","last_became_peered":"2024-02-21T23:01:02.220941+0000","last_unstale":"2024-02-21T23:12:14.826733+0000","last_undegraded":"2024-02-21T23:12:14.826733+0000","last_fullsized":"2024-02-21T23:12:14.826733+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:17:06.353018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":17,"num_read_kb":4097,"num_write":22,"num_write_kb":4218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"32'51","reported_seq":134,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.960486+0000","last_change":"2024-02-21T23:12:08.706819+0000","last_active":"2024-02-21T23:12:14.960486+0000","last_peered":"2024-02-21T23:12:14.960486+0000","last_clean":"2024-02-21T23:12:14.960486+0000","last_became_active":"2024-02-21T23:01:03.219221+0000","last_became_peered":"2024-02-21T23:01:03.219221+0000","last_unstale":"2024-02-21T23:12:14.960486+0000","last_undegraded":"2024-02-21T23:12:14.960486+0000","last_fullsized":"2024-02-21T23:12:14.960486+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:13:25.637195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0047645949999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"35'354","reported_seq":414,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.822432+0000","last_change":"2024-02-21T23:12:08.715099+0000","last_active":"2024-02-21T23:12:14.822432+0000","last_peered":"2024-02-21T23:12:14.822432+0000","last_clean":"2024-02-21T23:12:14.822432+0000","last_became_active":"2024-02-21T23:01:07.268179+0000","last_became_peered":"2024-02-21T23:01:07.268179+0000","last_unstale":"2024-02-21T23:12:14.822432+0000","last_undegraded":"2024-02-21T23:12:14.822432+0000","last_fullsized":"2024-02-21T23:12:14.822432+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:12:49.052079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0062260340000000001,"stat_sum":{"num_bytes":615017,"num_objects":99,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":321,"num_write_kb":926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"32'21","reported_seq":94,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.062972+0000","last_change":"2024-02-21T23:01:02.208687+0000","last_active":"2024-02-21T23:12:15.062972+0000","last_peered":"2024-02-21T23:12:15.062972+0000","last_clean":"2024-02-21T23:12:15.062972+0000","last_became_active":"2024-02-21T23:01:02.208393+0000","last_became_peered":"2024-02-21T23:01:02.208393+0000","last_unstale":"2024-02-21T23:12:15.062972+0000","last_undegraded":"2024-02-21T23:12:15.062972+0000","last_fullsized":"2024-02-21T23:12:15.062972+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:41:54.477462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":25,"num_read_kb":8200,"num_write":25,"num_write_kb":8264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"32'66","reported_seq":148,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.240958+0000","last_change":"2024-02-21T23:12:08.608463+0000","last_active":"2024-02-21T23:12:15.240958+0000","last_peered":"2024-02-21T23:12:15.240958+0000","last_clean":"2024-02-21T23:12:15.240958+0000","last_became_active":"2024-02-21T23:01:03.214733+0000","last_became_peered":"2024-02-21T23:01:03.214733+0000","last_unstale":"2024-02-21T23:12:15.240958+0000","last_undegraded":"2024-02-21T23:12:15.240958+0000","last_fullsized":"2024-02-21T23:12:15.240958+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:37:38.558922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002499476,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"35'356","reported_seq":414,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.823223+0000","last_change":"2024-02-21T23:12:08.716734+0000","last_active":"2024-02-21T23:12:14.823223+0000","last_peered":"2024-02-21T23:12:14.823223+0000","last_clean":"2024-02-21T23:12:14.823223+0000","last_became_active":"2024-02-21T23:01:07.279360+0000","last_became_peered":"2024-02-21T23:01:07.279360+0000","last_unstale":"2024-02-21T23:12:14.823223+0000","last_undegraded":"2024-02-21T23:12:14.823223+0000","last_fullsized":"2024-02-21T23:12:14.823223+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":356,"log_dups_size":0,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:01:04.348854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0065566699999999997,"stat_sum":{"num_bytes":1138317,"num_objects":111,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":111,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":317,"num_write_kb":1526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"32'11","reported_seq":59,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.062765+0000","last_change":"2024-02-21T23:01:02.204774+0000","last_active":"2024-02-21T23:12:15.062765+0000","last_peered":"2024-02-21T23:12:15.062765+0000","last_clean":"2024-02-21T23:12:15.062765+0000","last_became_active":"2024-02-21T23:01:02.203992+0000","last_became_peered":"2024-02-21T23:01:02.203992+0000","last_unstale":"2024-02-21T23:12:15.062765+0000","last_undegraded":"2024-02-21T23:12:15.062765+0000","last_fullsized":"2024-02-21T23:12:15.062765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:27:54.333439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1],"acting":[8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"32'56","reported_seq":138,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.972421+0000","last_change":"2024-02-21T23:12:08.673470+0000","last_active":"2024-02-21T23:12:14.972421+0000","last_peered":"2024-02-21T23:12:14.972421+0000","last_clean":"2024-02-21T23:12:14.972421+0000","last_became_active":"2024-02-21T23:01:03.212702+0000","last_became_peered":"2024-02-21T23:01:03.212702+0000","last_unstale":"2024-02-21T23:12:14.972421+0000","last_undegraded":"2024-02-21T23:12:14.972421+0000","last_fullsized":"2024-02-21T23:12:14.972421+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:11:24.214077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003245398,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"35'320","reported_seq":383,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.822700+0000","last_change":"2024-02-21T23:12:08.711329+0000","last_active":"2024-02-21T23:12:14.822700+0000","last_peered":"2024-02-21T23:12:14.822700+0000","last_clean":"2024-02-21T23:12:14.822700+0000","last_became_active":"2024-02-21T23:01:07.268357+0000","last_became_peered":"2024-02-21T23:01:07.268357+0000","last_unstale":"2024-02-21T23:12:14.822700+0000","last_undegraded":"2024-02-21T23:12:14.822700+0000","last_fullsized":"2024-02-21T23:12:14.822700+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:44:32.467350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024180849999999999,"stat_sum":{"num_bytes":206516,"num_objects":100,"num_object_clones":0,"num_object_copies":400,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":290,"num_write_kb":521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"32'53","reported_seq":136,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.348758+0000","last_change":"2024-02-21T23:12:08.716291+0000","last_active":"2024-02-21T23:12:15.348758+0000","last_peered":"2024-02-21T23:12:15.348758+0000","last_clean":"2024-02-21T23:12:15.348758+0000","last_became_active":"2024-02-21T23:01:03.213186+0000","last_became_peered":"2024-02-21T23:01:03.213186+0000","last_unstale":"2024-02-21T23:12:15.348758+0000","last_undegraded":"2024-02-21T23:12:15.348758+0000","last_fullsized":"2024-02-21T23:12:15.348758+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:23:47.543277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0056316350000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"32'38","reported_seq":104,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.062681+0000","last_change":"2024-02-21T23:01:02.208608+0000","last_active":"2024-02-21T23:12:15.062681+0000","last_peered":"2024-02-21T23:12:15.062681+0000","last_clean":"2024-02-21T23:12:15.062681+0000","last_became_active":"2024-02-21T23:01:02.208293+0000","last_became_peered":"2024-02-21T23:01:02.208293+0000","last_unstale":"2024-02-21T23:12:15.062681+0000","last_undegraded":"2024-02-21T23:12:15.062681+0000","last_fullsized":"2024-02-21T23:12:15.062681+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:58:23.554457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":4101,"num_write":38,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"35'339","reported_seq":398,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.822932+0000","last_change":"2024-02-21T23:12:08.715626+0000","last_active":"2024-02-21T23:12:14.822932+0000","last_peered":"2024-02-21T23:12:14.822932+0000","last_clean":"2024-02-21T23:12:14.822932+0000","last_became_active":"2024-02-21T23:01:07.651241+0000","last_became_peered":"2024-02-21T23:01:07.651241+0000","last_unstale":"2024-02-21T23:12:14.822932+0000","last_undegraded":"2024-02-21T23:12:14.822932+0000","last_fullsized":"2024-02-21T23:12:14.822932+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:51:30.402466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0063569689999999996,"stat_sum":{"num_bytes":696245,"num_objects":110,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":302,"num_write_kb":1168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"32'59","reported_seq":142,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.826174+0000","last_change":"2024-02-21T23:12:08.620654+0000","last_active":"2024-02-21T23:12:14.826174+0000","last_peered":"2024-02-21T23:12:14.826174+0000","last_clean":"2024-02-21T23:12:14.826174+0000","last_became_active":"2024-02-21T23:01:03.219898+0000","last_became_peered":"2024-02-21T23:01:03.219898+0000","last_unstale":"2024-02-21T23:12:14.826174+0000","last_undegraded":"2024-02-21T23:12:14.826174+0000","last_fullsized":"2024-02-21T23:12:14.826174+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:01:36.467676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0098155299999999994,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"32'34","reported_seq":83,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.821840+0000","last_change":"2024-02-21T23:01:02.202866+0000","last_active":"2024-02-21T23:12:14.821840+0000","last_peered":"2024-02-21T23:12:14.821840+0000","last_clean":"2024-02-21T23:12:14.821840+0000","last_became_active":"2024-02-21T23:01:02.202585+0000","last_became_peered":"2024-02-21T23:01:02.202585+0000","last_unstale":"2024-02-21T23:12:14.821840+0000","last_undegraded":"2024-02-21T23:12:14.821840+0000","last_fullsized":"2024-02-21T23:12:14.821840+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:26:49.911102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"35'375","reported_seq":431,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.823213+0000","last_change":"2024-02-21T23:12:08.716762+0000","last_active":"2024-02-21T23:12:14.823213+0000","last_peered":"2024-02-21T23:12:14.823213+0000","last_clean":"2024-02-21T23:12:14.823213+0000","last_became_active":"2024-02-21T23:01:07.276577+0000","last_became_peered":"2024-02-21T23:01:07.276577+0000","last_unstale":"2024-02-21T23:12:14.823213+0000","last_undegraded":"2024-02-21T23:12:14.823213+0000","last_fullsized":"2024-02-21T23:12:14.823213+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:21:46.661574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0075563849999999997,"stat_sum":{"num_bytes":317135,"num_objects":109,"num_object_clones":0,"num_object_copies":436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":331,"num_write_kb":822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"32'59","reported_seq":142,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.627470+0000","last_change":"2024-02-21T23:12:08.667773+0000","last_active":"2024-02-21T23:12:15.627470+0000","last_peered":"2024-02-21T23:12:15.627470+0000","last_clean":"2024-02-21T23:12:15.627470+0000","last_became_active":"2024-02-21T23:01:03.218706+0000","last_became_peered":"2024-02-21T23:01:03.218706+0000","last_unstale":"2024-02-21T23:12:15.627470+0000","last_undegraded":"2024-02-21T23:12:15.627470+0000","last_fullsized":"2024-02-21T23:12:15.627470+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:11:24.214077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040903179999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"32'13","reported_seq":62,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.825654+0000","last_change":"2024-02-21T23:01:02.208912+0000","last_active":"2024-02-21T23:12:14.825654+0000","last_peered":"2024-02-21T23:12:14.825654+0000","last_clean":"2024-02-21T23:12:14.825654+0000","last_became_active":"2024-02-21T23:01:02.208542+0000","last_became_peered":"2024-02-21T23:01:02.208542+0000","last_unstale":"2024-02-21T23:12:14.825654+0000","last_undegraded":"2024-02-21T23:12:14.825654+0000","last_fullsized":"2024-02-21T23:12:14.825654+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:02:11.724233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9],"acting":[3,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"35'342","reported_seq":395,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.157292+0000","last_change":"2024-02-21T23:12:08.615509+0000","last_active":"2024-02-21T23:12:15.157292+0000","last_peered":"2024-02-21T23:12:15.157292+0000","last_clean":"2024-02-21T23:12:15.157292+0000","last_became_active":"2024-02-21T23:01:07.282506+0000","last_became_peered":"2024-02-21T23:01:07.282506+0000","last_unstale":"2024-02-21T23:12:15.157292+0000","last_undegraded":"2024-02-21T23:12:15.157292+0000","last_fullsized":"2024-02-21T23:12:15.157292+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:47:32.010203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.005933649,"stat_sum":{"num_bytes":321892,"num_objects":112,"num_object_clones":0,"num_object_copies":448,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":112,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":294,"num_write_kb":916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"32'47","reported_seq":130,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.062393+0000","last_change":"2024-02-21T23:12:08.713493+0000","last_active":"2024-02-21T23:12:15.062393+0000","last_peered":"2024-02-21T23:12:15.062393+0000","last_clean":"2024-02-21T23:12:15.062393+0000","last_became_active":"2024-02-21T23:01:03.211919+0000","last_became_peered":"2024-02-21T23:01:03.211919+0000","last_unstale":"2024-02-21T23:12:15.062393+0000","last_undegraded":"2024-02-21T23:12:15.062393+0000","last_fullsized":"2024-02-21T23:12:15.062393+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:47:27.962126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040799440000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"32'11","reported_seq":60,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.240916+0000","last_change":"2024-02-21T23:01:02.204071+0000","last_active":"2024-02-21T23:12:15.240916+0000","last_peered":"2024-02-21T23:12:15.240916+0000","last_clean":"2024-02-21T23:12:15.240916+0000","last_became_active":"2024-02-21T23:01:02.203761+0000","last_became_peered":"2024-02-21T23:01:02.203761+0000","last_unstale":"2024-02-21T23:12:15.240916+0000","last_undegraded":"2024-02-21T23:12:15.240916+0000","last_fullsized":"2024-02-21T23:12:15.240916+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:58:34.737670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"35'297","reported_seq":366,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.823041+0000","last_change":"2024-02-21T23:12:08.713241+0000","last_active":"2024-02-21T23:12:14.823041+0000","last_peered":"2024-02-21T23:12:14.823041+0000","last_clean":"2024-02-21T23:12:14.823041+0000","last_became_active":"2024-02-21T23:01:50.570965+0000","last_became_peered":"2024-02-21T23:01:50.570965+0000","last_unstale":"2024-02-21T23:12:14.823041+0000","last_undegraded":"2024-02-21T23:12:14.823041+0000","last_fullsized":"2024-02-21T23:12:14.823041+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:11:28.262155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042670420000000004,"stat_sum":{"num_bytes":200353,"num_objects":99,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":263,"num_write_kb":684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,10,9],"acting":[4,8,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"32'57","reported_seq":140,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.960621+0000","last_change":"2024-02-21T23:12:08.706090+0000","last_active":"2024-02-21T23:12:14.960621+0000","last_peered":"2024-02-21T23:12:14.960621+0000","last_clean":"2024-02-21T23:12:14.960621+0000","last_became_active":"2024-02-21T23:01:03.229873+0000","last_became_peered":"2024-02-21T23:01:03.229873+0000","last_unstale":"2024-02-21T23:12:14.960621+0000","last_undegraded":"2024-02-21T23:12:14.960621+0000","last_fullsized":"2024-02-21T23:12:14.960621+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:54:40.544963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.004035584,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"32'14","reported_seq":63,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.823102+0000","last_change":"2024-02-21T23:01:02.206586+0000","last_active":"2024-02-21T23:12:14.823102+0000","last_peered":"2024-02-21T23:12:14.823102+0000","last_clean":"2024-02-21T23:12:14.823102+0000","last_became_active":"2024-02-21T23:01:02.206230+0000","last_became_peered":"2024-02-21T23:01:02.206230+0000","last_unstale":"2024-02-21T23:12:14.823102+0000","last_undegraded":"2024-02-21T23:12:14.823102+0000","last_fullsized":"2024-02-21T23:12:14.823102+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:21:29.919968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11],"acting":[4,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"35'358","reported_seq":416,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.821522+0000","last_change":"2024-02-21T23:12:08.714187+0000","last_active":"2024-02-21T23:12:14.821522+0000","last_peered":"2024-02-21T23:12:14.821522+0000","last_clean":"2024-02-21T23:12:14.821522+0000","last_became_active":"2024-02-21T23:01:07.251670+0000","last_became_peered":"2024-02-21T23:01:07.251670+0000","last_unstale":"2024-02-21T23:12:14.821522+0000","last_undegraded":"2024-02-21T23:12:14.821522+0000","last_fullsized":"2024-02-21T23:12:14.821522+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:53:36.897051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.004207176,"stat_sum":{"num_bytes":4398222,"num_objects":112,"num_object_clones":0,"num_object_copies":448,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":112,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":314,"num_write_kb":4681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"32'56","reported_seq":139,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.827050+0000","last_change":"2024-02-21T23:12:08.621679+0000","last_active":"2024-02-21T23:12:14.827050+0000","last_peered":"2024-02-21T23:12:14.827050+0000","last_clean":"2024-02-21T23:12:14.827050+0000","last_became_active":"2024-02-21T23:01:03.206892+0000","last_became_peered":"2024-02-21T23:01:03.206892+0000","last_unstale":"2024-02-21T23:12:14.827050+0000","last_undegraded":"2024-02-21T23:12:14.827050+0000","last_fullsized":"2024-02-21T23:12:14.827050+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:21:42.613496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010016761000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"40'439","reported_seq":928,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:18.728492+0000","last_change":"2024-02-21T23:01:02.209850+0000","last_active":"2024-02-21T23:12:18.728492+0000","last_peered":"2024-02-21T23:12:18.728492+0000","last_clean":"2024-02-21T23:12:18.728492+0000","last_became_active":"2024-02-21T23:01:02.209601+0000","last_became_peered":"2024-02-21T23:01:02.209601+0000","last_unstale":"2024-02-21T23:12:18.728492+0000","last_undegraded":"2024-02-21T23:12:18.728492+0000","last_fullsized":"2024-02-21T23:12:18.728492+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:36:44.497886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1472,"num_read_kb":1321,"num_write":854,"num_write_kb":4014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"35'354","reported_seq":413,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.824941+0000","last_change":"2024-02-21T23:12:08.617892+0000","last_active":"2024-02-21T23:12:14.824941+0000","last_peered":"2024-02-21T23:12:14.824941+0000","last_clean":"2024-02-21T23:12:14.824941+0000","last_became_active":"2024-02-21T23:01:07.651431+0000","last_became_peered":"2024-02-21T23:01:07.651431+0000","last_unstale":"2024-02-21T23:12:14.824941+0000","last_undegraded":"2024-02-21T23:12:14.824941+0000","last_fullsized":"2024-02-21T23:12:14.824941+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:44:32.467350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0097316139999999995,"stat_sum":{"num_bytes":401739,"num_objects":113,"num_object_clones":0,"num_object_copies":452,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":113,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":314,"num_write_kb":708,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"32'53","reported_seq":136,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.844206+0000","last_change":"2024-02-21T23:12:08.720063+0000","last_active":"2024-02-21T23:12:14.844206+0000","last_peered":"2024-02-21T23:12:14.844206+0000","last_clean":"2024-02-21T23:12:14.844206+0000","last_became_active":"2024-02-21T23:01:03.221405+0000","last_became_peered":"2024-02-21T23:01:03.221405+0000","last_unstale":"2024-02-21T23:12:14.844206+0000","last_undegraded":"2024-02-21T23:12:14.844206+0000","last_fullsized":"2024-02-21T23:12:14.844206+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:53:08.201764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0094468999999999994,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"32'7","reported_seq":57,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.063100+0000","last_change":"2024-02-21T23:01:02.221218+0000","last_active":"2024-02-21T23:12:15.063100+0000","last_peered":"2024-02-21T23:12:15.063100+0000","last_clean":"2024-02-21T23:12:15.063100+0000","last_became_active":"2024-02-21T23:01:02.220923+0000","last_became_peered":"2024-02-21T23:01:02.220923+0000","last_unstale":"2024-02-21T23:12:15.063100+0000","last_undegraded":"2024-02-21T23:12:15.063100+0000","last_fullsized":"2024-02-21T23:12:15.063100+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:15.938263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":13,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"35'343","reported_seq":410,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.628338+0000","last_change":"2024-02-21T23:12:08.666642+0000","last_active":"2024-02-21T23:12:15.628338+0000","last_peered":"2024-02-21T23:12:15.628338+0000","last_clean":"2024-02-21T23:12:15.628338+0000","last_became_active":"2024-02-21T23:01:07.268210+0000","last_became_peered":"2024-02-21T23:01:07.268210+0000","last_unstale":"2024-02-21T23:12:15.628338+0000","last_undegraded":"2024-02-21T23:12:15.628338+0000","last_fullsized":"2024-02-21T23:12:15.628338+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":343,"log_dups_size":0,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:04:13.965614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0034086630000000001,"stat_sum":{"num_bytes":377358,"num_objects":123,"num_object_clones":0,"num_object_copies":492,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":123,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":315,"num_write_kb":765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"32'52","reported_seq":135,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.875928+0000","last_change":"2024-02-21T23:12:08.665860+0000","last_active":"2024-02-21T23:12:14.875928+0000","last_peered":"2024-02-21T23:12:14.875928+0000","last_clean":"2024-02-21T23:12:14.875928+0000","last_became_active":"2024-02-21T23:01:03.218081+0000","last_became_peered":"2024-02-21T23:01:03.218081+0000","last_unstale":"2024-02-21T23:12:14.875928+0000","last_undegraded":"2024-02-21T23:12:14.875928+0000","last_fullsized":"2024-02-21T23:12:14.875928+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:17:45.851604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015202530000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"32'10","reported_seq":59,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.156431+0000","last_change":"2024-02-21T23:01:02.207826+0000","last_active":"2024-02-21T23:12:15.156431+0000","last_peered":"2024-02-21T23:12:15.156431+0000","last_clean":"2024-02-21T23:12:15.156431+0000","last_became_active":"2024-02-21T23:01:02.206426+0000","last_became_peered":"2024-02-21T23:01:02.206426+0000","last_unstale":"2024-02-21T23:12:15.156431+0000","last_undegraded":"2024-02-21T23:12:15.156431+0000","last_fullsized":"2024-02-21T23:12:15.156431+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:17:06.353018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2],"acting":[9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"35'355","reported_seq":417,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.062929+0000","last_change":"2024-02-21T23:12:08.713641+0000","last_active":"2024-02-21T23:12:15.062929+0000","last_peered":"2024-02-21T23:12:15.062929+0000","last_clean":"2024-02-21T23:12:15.062929+0000","last_became_active":"2024-02-21T23:01:07.651384+0000","last_became_peered":"2024-02-21T23:01:07.651384+0000","last_unstale":"2024-02-21T23:12:15.062929+0000","last_undegraded":"2024-02-21T23:12:15.062929+0000","last_fullsized":"2024-02-21T23:12:15.062929+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:37:42.607000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0031726889999999998,"stat_sum":{"num_bytes":888761,"num_objects":113,"num_object_clones":0,"num_object_copies":452,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":113,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":323,"num_write_kb":1197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"32'54","reported_seq":137,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.875903+0000","last_change":"2024-02-21T23:12:08.665492+0000","last_active":"2024-02-21T23:12:14.875903+0000","last_peered":"2024-02-21T23:12:14.875903+0000","last_clean":"2024-02-21T23:12:14.875903+0000","last_became_active":"2024-02-21T23:01:03.210123+0000","last_became_peered":"2024-02-21T23:01:03.210123+0000","last_unstale":"2024-02-21T23:12:14.875903+0000","last_undegraded":"2024-02-21T23:12:14.875903+0000","last_fullsized":"2024-02-21T23:12:14.875903+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:32:04.964547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014139560000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4],"acting":[10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"32'38","reported_seq":108,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.348746+0000","last_change":"2024-02-21T23:01:02.217455+0000","last_active":"2024-02-21T23:12:15.348746+0000","last_peered":"2024-02-21T23:12:15.348746+0000","last_clean":"2024-02-21T23:12:15.348746+0000","last_became_active":"2024-02-21T23:01:02.217128+0000","last_became_peered":"2024-02-21T23:01:02.217128+0000","last_unstale":"2024-02-21T23:12:15.348746+0000","last_undegraded":"2024-02-21T23:12:15.348746+0000","last_fullsized":"2024-02-21T23:12:15.348746+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:23:41.295647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":21,"num_read_kb":4097,"num_write":45,"num_write_kb":4258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"35'307","reported_seq":371,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.843285+0000","last_change":"2024-02-21T23:12:08.718221+0000","last_active":"2024-02-21T23:12:14.843285+0000","last_peered":"2024-02-21T23:12:14.843285+0000","last_clean":"2024-02-21T23:12:14.843285+0000","last_became_active":"2024-02-21T23:01:07.266376+0000","last_became_peered":"2024-02-21T23:01:07.266376+0000","last_unstale":"2024-02-21T23:12:14.843285+0000","last_undegraded":"2024-02-21T23:12:14.843285+0000","last_fullsized":"2024-02-21T23:12:14.843285+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":307,"log_dups_size":0,"ondisk_log_size":307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:59:12.232049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0080237980000000004,"stat_sum":{"num_bytes":252650,"num_objects":112,"num_object_clones":0,"num_object_copies":448,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":112,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":278,"num_write_kb":523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"32'44","reported_seq":127,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.971854+0000","last_change":"2024-02-21T23:12:08.674994+0000","last_active":"2024-02-21T23:12:14.971854+0000","last_peered":"2024-02-21T23:12:14.971854+0000","last_clean":"2024-02-21T23:12:14.971854+0000","last_became_active":"2024-02-21T23:01:03.212019+0000","last_became_peered":"2024-02-21T23:01:03.212019+0000","last_unstale":"2024-02-21T23:12:14.971854+0000","last_undegraded":"2024-02-21T23:12:14.971854+0000","last_fullsized":"2024-02-21T23:12:14.971854+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:03:30.016061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040092829999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"32'61","reported_seq":839,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:58.814530+0000","last_change":"2024-02-21T23:01:02.219033+0000","last_active":"2024-02-21T23:12:58.814530+0000","last_peered":"2024-02-21T23:12:58.814530+0000","last_clean":"2024-02-21T23:12:58.814530+0000","last_became_active":"2024-02-21T23:01:02.218570+0000","last_became_peered":"2024-02-21T23:01:02.218570+0000","last_unstale":"2024-02-21T23:12:58.814530+0000","last_undegraded":"2024-02-21T23:12:58.814530+0000","last_fullsized":"2024-02-21T23:12:58.814530+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:21:29.919968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289676,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":729,"num_read_kb":999,"num_write":69,"num_write_kb":476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"35'326","reported_seq":389,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.843976+0000","last_change":"2024-02-21T23:12:08.718344+0000","last_active":"2024-02-21T23:12:14.843976+0000","last_peered":"2024-02-21T23:12:14.843976+0000","last_clean":"2024-02-21T23:12:14.843976+0000","last_became_active":"2024-02-21T23:01:07.653745+0000","last_became_peered":"2024-02-21T23:01:07.653745+0000","last_unstale":"2024-02-21T23:12:14.843976+0000","last_undegraded":"2024-02-21T23:12:14.843976+0000","last_fullsized":"2024-02-21T23:12:14.843976+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:03:56.907378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0081050040000000007,"stat_sum":{"num_bytes":1514271,"num_objects":111,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":111,"num_whiteouts":0,"num_read":1,"num_read_kb":1270,"num_write":292,"num_write_kb":1862,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"32'52","reported_seq":135,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.842173+0000","last_change":"2024-02-21T23:12:08.714060+0000","last_active":"2024-02-21T23:12:14.842173+0000","last_peered":"2024-02-21T23:12:14.842173+0000","last_clean":"2024-02-21T23:12:14.842173+0000","last_became_active":"2024-02-21T23:01:03.219834+0000","last_became_peered":"2024-02-21T23:01:03.219834+0000","last_unstale":"2024-02-21T23:12:14.842173+0000","last_undegraded":"2024-02-21T23:12:14.842173+0000","last_fullsized":"2024-02-21T23:12:14.842173+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:52:50.911363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0044708259999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"32'156","reported_seq":259,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.348474+0000","last_change":"2024-02-21T23:01:02.207052+0000","last_active":"2024-02-21T23:12:15.348474+0000","last_peered":"2024-02-21T23:12:15.348474+0000","last_clean":"2024-02-21T23:12:15.348474+0000","last_became_active":"2024-02-21T23:01:02.206146+0000","last_became_peered":"2024-02-21T23:01:02.206146+0000","last_unstale":"2024-02-21T23:12:15.348474+0000","last_undegraded":"2024-02-21T23:12:15.348474+0000","last_fullsized":"2024-02-21T23:12:15.348474+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:26:49.911102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":54,"num_read_kb":8202,"num_write":160,"num_write_kb":8393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"35'381","reported_seq":438,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.972474+0000","last_change":"2024-02-21T23:12:08.673718+0000","last_active":"2024-02-21T23:12:14.972474+0000","last_peered":"2024-02-21T23:12:14.972474+0000","last_clean":"2024-02-21T23:12:14.972474+0000","last_became_active":"2024-02-21T23:01:50.649190+0000","last_became_peered":"2024-02-21T23:01:50.649190+0000","last_unstale":"2024-02-21T23:12:14.972474+0000","last_undegraded":"2024-02-21T23:12:14.972474+0000","last_fullsized":"2024-02-21T23:12:14.972474+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:51:30.402466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00347759,"stat_sum":{"num_bytes":3892244,"num_objects":109,"num_object_clones":0,"num_object_copies":436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":323,"num_write_kb":4210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,11,6,10],"acting":[5,11,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"32'57","reported_seq":140,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.825107+0000","last_change":"2024-02-21T23:12:08.620001+0000","last_active":"2024-02-21T23:12:14.825107+0000","last_peered":"2024-02-21T23:12:14.825107+0000","last_clean":"2024-02-21T23:12:14.825107+0000","last_became_active":"2024-02-21T23:01:03.209007+0000","last_became_peered":"2024-02-21T23:01:03.209007+0000","last_unstale":"2024-02-21T23:12:14.825107+0000","last_undegraded":"2024-02-21T23:12:14.825107+0000","last_fullsized":"2024-02-21T23:12:14.825107+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:11:24.214077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0096099529999999992,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"32'9","reported_seq":60,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.823538+0000","last_change":"2024-02-21T23:01:02.203395+0000","last_active":"2024-02-21T23:12:14.823538+0000","last_peered":"2024-02-21T23:12:14.823538+0000","last_clean":"2024-02-21T23:12:14.823538+0000","last_became_active":"2024-02-21T23:01:02.203066+0000","last_became_peered":"2024-02-21T23:01:02.203066+0000","last_unstale":"2024-02-21T23:12:14.823538+0000","last_undegraded":"2024-02-21T23:12:14.823538+0000","last_fullsized":"2024-02-21T23:12:14.823538+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:26:49.911102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":16,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"32'148","reported_seq":282,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.348654+0000","last_change":"2024-02-21T23:00:58.830752+0000","last_active":"2024-02-21T23:12:15.348654+0000","last_peered":"2024-02-21T23:12:15.348654+0000","last_clean":"2024-02-21T23:12:15.348654+0000","last_became_active":"2024-02-21T23:00:58.830472+0000","last_became_peered":"2024-02-21T23:00:58.830472+0000","last_unstale":"2024-02-21T23:12:15.348654+0000","last_undegraded":"2024-02-21T23:12:15.348654+0000","last_fullsized":"2024-02-21T23:12:15.348654+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:00:57.811198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:00:57.811198+0000","last_clean_scrub_stamp":"2024-02-21T23:00:57.811198+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:58:31.374266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"35'303","reported_seq":368,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.348445+0000","last_change":"2024-02-21T23:12:08.713916+0000","last_active":"2024-02-21T23:12:15.348445+0000","last_peered":"2024-02-21T23:12:15.348445+0000","last_clean":"2024-02-21T23:12:15.348445+0000","last_became_active":"2024-02-21T23:01:07.276489+0000","last_became_peered":"2024-02-21T23:01:07.276489+0000","last_unstale":"2024-02-21T23:12:15.348445+0000","last_undegraded":"2024-02-21T23:12:15.348445+0000","last_fullsized":"2024-02-21T23:12:15.348445+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":303,"log_dups_size":0,"ondisk_log_size":303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:12:49.052079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0037280239999999999,"stat_sum":{"num_bytes":156768,"num_objects":95,"num_object_clones":0,"num_object_copies":380,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":275,"num_write_kb":444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"32'53","reported_seq":136,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.348793+0000","last_change":"2024-02-21T23:12:08.715540+0000","last_active":"2024-02-21T23:12:15.348793+0000","last_peered":"2024-02-21T23:12:15.348793+0000","last_clean":"2024-02-21T23:12:15.348793+0000","last_became_active":"2024-02-21T23:01:03.215904+0000","last_became_peered":"2024-02-21T23:01:03.215904+0000","last_unstale":"2024-02-21T23:12:15.348793+0000","last_undegraded":"2024-02-21T23:12:15.348793+0000","last_fullsized":"2024-02-21T23:12:15.348793+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:01:36.467676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0048898559999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"32'10","reported_seq":60,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.821877+0000","last_change":"2024-02-21T23:01:02.207406+0000","last_active":"2024-02-21T23:12:14.821877+0000","last_peered":"2024-02-21T23:12:14.821877+0000","last_clean":"2024-02-21T23:12:14.821877+0000","last_became_active":"2024-02-21T23:01:02.206219+0000","last_became_peered":"2024-02-21T23:01:02.206219+0000","last_unstale":"2024-02-21T23:12:14.821877+0000","last_undegraded":"2024-02-21T23:12:14.821877+0000","last_fullsized":"2024-02-21T23:12:14.821877+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:21:29.919968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":13,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11],"acting":[2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"35'322","reported_seq":390,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.240800+0000","last_change":"2024-02-21T23:12:08.607853+0000","last_active":"2024-02-21T23:12:15.240800+0000","last_peered":"2024-02-21T23:12:15.240800+0000","last_clean":"2024-02-21T23:12:15.240800+0000","last_became_active":"2024-02-21T23:01:07.265401+0000","last_became_peered":"2024-02-21T23:01:07.265401+0000","last_unstale":"2024-02-21T23:12:15.240800+0000","last_undegraded":"2024-02-21T23:12:15.240800+0000","last_fullsized":"2024-02-21T23:12:15.240800+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":322,"log_dups_size":0,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:32:15.029558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022768879999999999,"stat_sum":{"num_bytes":312332,"num_objects":114,"num_object_clones":0,"num_object_copies":456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":114,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":302,"num_write_kb":592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"32'60","reported_seq":143,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.347873+0000","last_change":"2024-02-21T23:12:08.715749+0000","last_active":"2024-02-21T23:12:15.347873+0000","last_peered":"2024-02-21T23:12:15.347873+0000","last_clean":"2024-02-21T23:12:15.347873+0000","last_became_active":"2024-02-21T23:01:03.220349+0000","last_became_peered":"2024-02-21T23:01:03.220349+0000","last_unstale":"2024-02-21T23:12:15.347873+0000","last_undegraded":"2024-02-21T23:12:15.347873+0000","last_fullsized":"2024-02-21T23:12:15.347873+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:01:00.300776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0046427739999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"38'186","reported_seq":382,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:18.728029+0000","last_change":"2024-02-21T23:01:02.206319+0000","last_active":"2024-02-21T23:12:18.728029+0000","last_peered":"2024-02-21T23:12:18.728029+0000","last_clean":"2024-02-21T23:12:18.728029+0000","last_became_active":"2024-02-21T23:01:02.205747+0000","last_became_peered":"2024-02-21T23:01:02.205747+0000","last_unstale":"2024-02-21T23:12:18.728029+0000","last_undegraded":"2024-02-21T23:12:18.728029+0000","last_fullsized":"2024-02-21T23:12:18.728029+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:10:09.680115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":328302,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":150,"num_read_kb":149,"num_write":203,"num_write_kb":2979,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10],"acting":[5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"35'347","reported_seq":411,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.960221+0000","last_change":"2024-02-21T23:12:08.705514+0000","last_active":"2024-02-21T23:12:14.960221+0000","last_peered":"2024-02-21T23:12:14.960221+0000","last_clean":"2024-02-21T23:12:14.960221+0000","last_became_active":"2024-02-21T23:01:07.280193+0000","last_became_peered":"2024-02-21T23:01:07.280193+0000","last_unstale":"2024-02-21T23:12:14.960221+0000","last_undegraded":"2024-02-21T23:12:14.960221+0000","last_fullsized":"2024-02-21T23:12:14.960221+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":347,"log_dups_size":0,"ondisk_log_size":347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:03:56.907378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00381337,"stat_sum":{"num_bytes":4515871,"num_objects":114,"num_object_clones":0,"num_object_copies":456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":114,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":315,"num_write_kb":4679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"32'57","reported_seq":140,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.348620+0000","last_change":"2024-02-21T23:12:08.714545+0000","last_active":"2024-02-21T23:12:15.348620+0000","last_peered":"2024-02-21T23:12:15.348620+0000","last_clean":"2024-02-21T23:12:15.348620+0000","last_became_active":"2024-02-21T23:01:03.216578+0000","last_became_peered":"2024-02-21T23:01:03.216578+0000","last_unstale":"2024-02-21T23:12:15.348620+0000","last_undegraded":"2024-02-21T23:12:15.348620+0000","last_fullsized":"2024-02-21T23:12:15.348620+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:44:28.419272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0043269409999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"32'5","reported_seq":54,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.844695+0000","last_change":"2024-02-21T23:01:02.220913+0000","last_active":"2024-02-21T23:12:14.844695+0000","last_peered":"2024-02-21T23:12:14.844695+0000","last_clean":"2024-02-21T23:12:14.844695+0000","last_became_active":"2024-02-21T23:01:02.220554+0000","last_became_peered":"2024-02-21T23:01:02.220554+0000","last_unstale":"2024-02-21T23:12:14.844695+0000","last_undegraded":"2024-02-21T23:12:14.844695+0000","last_fullsized":"2024-02-21T23:12:14.844695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:36:44.497886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"35'327","reported_seq":391,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.971637+0000","last_change":"2024-02-21T23:12:08.674532+0000","last_active":"2024-02-21T23:12:14.971637+0000","last_peered":"2024-02-21T23:12:14.971637+0000","last_clean":"2024-02-21T23:12:14.971637+0000","last_became_active":"2024-02-21T23:01:07.257011+0000","last_became_peered":"2024-02-21T23:01:07.257011+0000","last_unstale":"2024-02-21T23:12:14.971637+0000","last_undegraded":"2024-02-21T23:12:14.971637+0000","last_fullsized":"2024-02-21T23:12:14.971637+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:21:46.661574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0038555350000000002,"stat_sum":{"num_bytes":448215,"num_objects":108,"num_object_clones":0,"num_object_copies":432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":292,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"32'39","reported_seq":122,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.627619+0000","last_change":"2024-02-21T23:12:08.667139+0000","last_active":"2024-02-21T23:12:15.627619+0000","last_peered":"2024-02-21T23:12:15.627619+0000","last_clean":"2024-02-21T23:12:15.627619+0000","last_became_active":"2024-02-21T23:01:03.211467+0000","last_became_peered":"2024-02-21T23:01:03.211467+0000","last_unstale":"2024-02-21T23:12:15.627619+0000","last_undegraded":"2024-02-21T23:12:15.627619+0000","last_fullsized":"2024-02-21T23:12:15.627619+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:54:40.544963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0035291530000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"32'15","reported_seq":65,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.062813+0000","last_change":"2024-02-21T23:01:02.211763+0000","last_active":"2024-02-21T23:12:15.062813+0000","last_peered":"2024-02-21T23:12:15.062813+0000","last_clean":"2024-02-21T23:12:15.062813+0000","last_became_active":"2024-02-21T23:01:02.211470+0000","last_became_peered":"2024-02-21T23:01:02.211470+0000","last_unstale":"2024-02-21T23:12:15.062813+0000","last_undegraded":"2024-02-21T23:12:15.062813+0000","last_fullsized":"2024-02-21T23:12:15.062813+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:23:41.295647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":24,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5],"acting":[8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"35'322","reported_seq":390,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.971734+0000","last_change":"2024-02-21T23:12:08.673325+0000","last_active":"2024-02-21T23:12:14.971734+0000","last_peered":"2024-02-21T23:12:14.971734+0000","last_clean":"2024-02-21T23:12:14.971734+0000","last_became_active":"2024-02-21T23:01:07.268681+0000","last_became_peered":"2024-02-21T23:01:07.268681+0000","last_unstale":"2024-02-21T23:12:14.971734+0000","last_undegraded":"2024-02-21T23:12:14.971734+0000","last_fullsized":"2024-02-21T23:12:14.971734+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":322,"log_dups_size":0,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:44:32.467350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0032686719999999998,"stat_sum":{"num_bytes":365874,"num_objects":113,"num_object_clones":0,"num_object_copies":452,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":113,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":301,"num_write_kb":637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"32'61","reported_seq":144,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.971994+0000","last_change":"2024-02-21T23:12:08.674464+0000","last_active":"2024-02-21T23:12:14.971994+0000","last_peered":"2024-02-21T23:12:14.971994+0000","last_clean":"2024-02-21T23:12:14.971994+0000","last_became_active":"2024-02-21T23:01:03.212634+0000","last_became_peered":"2024-02-21T23:01:03.212634+0000","last_unstale":"2024-02-21T23:12:14.971994+0000","last_undegraded":"2024-02-21T23:12:14.971994+0000","last_fullsized":"2024-02-21T23:12:14.971994+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:23:47.543277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039799579999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"32'26","reported_seq":76,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.062436+0000","last_change":"2024-02-21T23:01:02.221957+0000","last_active":"2024-02-21T23:12:15.062436+0000","last_peered":"2024-02-21T23:12:15.062436+0000","last_clean":"2024-02-21T23:12:15.062436+0000","last_became_active":"2024-02-21T23:01:02.221642+0000","last_became_peered":"2024-02-21T23:01:02.221642+0000","last_unstale":"2024-02-21T23:12:15.062436+0000","last_undegraded":"2024-02-21T23:12:15.062436+0000","last_fullsized":"2024-02-21T23:12:15.062436+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:10:09.680115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":39,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"35'397","reported_seq":443,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.844649+0000","last_change":"2024-02-21T23:12:08.717882+0000","last_active":"2024-02-21T23:12:14.844649+0000","last_peered":"2024-02-21T23:12:14.844649+0000","last_clean":"2024-02-21T23:12:14.844649+0000","last_became_active":"2024-02-21T23:01:07.267874+0000","last_became_peered":"2024-02-21T23:01:07.267874+0000","last_unstale":"2024-02-21T23:12:14.844649+0000","last_undegraded":"2024-02-21T23:12:14.844649+0000","last_fullsized":"2024-02-21T23:12:14.844649+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:39:46.450427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0076511119999999998,"stat_sum":{"num_bytes":500979,"num_objects":108,"num_object_clones":0,"num_object_copies":432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":334,"num_write_kb":931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"32'53","reported_seq":136,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.347593+0000","last_change":"2024-02-21T23:12:08.716946+0000","last_active":"2024-02-21T23:12:15.347593+0000","last_peered":"2024-02-21T23:12:15.347593+0000","last_clean":"2024-02-21T23:12:15.347593+0000","last_became_active":"2024-02-21T23:01:03.216466+0000","last_became_peered":"2024-02-21T23:01:03.216466+0000","last_unstale":"2024-02-21T23:12:15.347593+0000","last_undegraded":"2024-02-21T23:12:15.347593+0000","last_fullsized":"2024-02-21T23:12:15.347593+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:21:42.613496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0046640040000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"32'14","reported_seq":753,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:58.815511+0000","last_change":"2024-02-21T23:01:02.199060+0000","last_active":"2024-02-21T23:12:58.815511+0000","last_peered":"2024-02-21T23:12:58.815511+0000","last_clean":"2024-02-21T23:12:58.815511+0000","last_became_active":"2024-02-21T23:01:02.198709+0000","last_became_peered":"2024-02-21T23:01:02.198709+0000","last_unstale":"2024-02-21T23:12:58.815511+0000","last_undegraded":"2024-02-21T23:12:58.815511+0000","last_fullsized":"2024-02-21T23:12:58.815511+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:36:44.497886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1124,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":691,"num_read_kb":5,"num_write":18,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"35'357","reported_seq":411,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.156955+0000","last_change":"2024-02-21T23:12:08.617956+0000","last_active":"2024-02-21T23:12:15.156955+0000","last_peered":"2024-02-21T23:12:15.156955+0000","last_clean":"2024-02-21T23:12:15.156955+0000","last_became_active":"2024-02-21T23:01:07.277289+0000","last_became_peered":"2024-02-21T23:01:07.277289+0000","last_unstale":"2024-02-21T23:12:15.156955+0000","last_undegraded":"2024-02-21T23:12:15.156955+0000","last_fullsized":"2024-02-21T23:12:15.156955+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:32:15.029558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0081797620000000001,"stat_sum":{"num_bytes":280914,"num_objects":98,"num_object_clones":0,"num_object_copies":392,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":308,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"32'69","reported_seq":152,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.348045+0000","last_change":"2024-02-21T23:12:08.717128+0000","last_active":"2024-02-21T23:12:15.348045+0000","last_peered":"2024-02-21T23:12:15.348045+0000","last_clean":"2024-02-21T23:12:15.348045+0000","last_became_active":"2024-02-21T23:01:03.214507+0000","last_became_peered":"2024-02-21T23:01:03.214507+0000","last_unstale":"2024-02-21T23:12:15.348045+0000","last_undegraded":"2024-02-21T23:12:15.348045+0000","last_fullsized":"2024-02-21T23:12:15.348045+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:23:08.703440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036732959999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"32'15","reported_seq":64,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.971959+0000","last_change":"2024-02-21T23:01:02.209351+0000","last_active":"2024-02-21T23:12:14.971959+0000","last_peered":"2024-02-21T23:12:14.971959+0000","last_clean":"2024-02-21T23:12:14.971959+0000","last_became_active":"2024-02-21T23:01:02.208990+0000","last_became_peered":"2024-02-21T23:01:02.208990+0000","last_unstale":"2024-02-21T23:12:14.971959+0000","last_undegraded":"2024-02-21T23:12:14.971959+0000","last_fullsized":"2024-02-21T23:12:14.971959+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:36:44.497886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"35'314","reported_seq":378,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.628791+0000","last_change":"2024-02-21T23:12:08.666904+0000","last_active":"2024-02-21T23:12:15.628791+0000","last_peered":"2024-02-21T23:12:15.628791+0000","last_clean":"2024-02-21T23:12:15.628791+0000","last_became_active":"2024-02-21T23:01:50.649153+0000","last_became_peered":"2024-02-21T23:01:50.649153+0000","last_unstale":"2024-02-21T23:12:15.628791+0000","last_undegraded":"2024-02-21T23:12:15.628791+0000","last_fullsized":"2024-02-21T23:12:15.628791+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":314,"log_dups_size":0,"ondisk_log_size":314,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:53:12.249842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003571472,"stat_sum":{"num_bytes":262334,"num_objects":113,"num_object_clones":0,"num_object_copies":452,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":113,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":267,"num_write_kb":565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,7,6],"acting":[11,8,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"32'49","reported_seq":132,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.843028+0000","last_change":"2024-02-21T23:12:08.716229+0000","last_active":"2024-02-21T23:12:14.843028+0000","last_peered":"2024-02-21T23:12:14.843028+0000","last_clean":"2024-02-21T23:12:14.843028+0000","last_became_active":"2024-02-21T23:01:03.224451+0000","last_became_peered":"2024-02-21T23:01:03.224451+0000","last_unstale":"2024-02-21T23:12:14.843028+0000","last_undegraded":"2024-02-21T23:12:14.843028+0000","last_fullsized":"2024-02-21T23:12:14.843028+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:48:40.284242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0065637960000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"39'149","reported_seq":734,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:58.571232+0000","last_change":"2024-02-21T23:01:02.203410+0000","last_active":"2024-02-21T23:12:58.571232+0000","last_peered":"2024-02-21T23:12:58.571232+0000","last_clean":"2024-02-21T23:12:58.571232+0000","last_became_active":"2024-02-21T23:01:02.203081+0000","last_became_peered":"2024-02-21T23:01:02.203081+0000","last_unstale":"2024-02-21T23:12:58.571232+0000","last_undegraded":"2024-02-21T23:12:58.571232+0000","last_fullsized":"2024-02-21T23:12:58.571232+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:36:44.497886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8060470,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":536,"num_read_kb":7900,"num_write":154,"num_write_kb":8013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10],"acting":[2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"35'326","reported_seq":386,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.972434+0000","last_change":"2024-02-21T23:12:08.674143+0000","last_active":"2024-02-21T23:12:14.972434+0000","last_peered":"2024-02-21T23:12:14.972434+0000","last_clean":"2024-02-21T23:12:14.972434+0000","last_became_active":"2024-02-21T23:01:07.268436+0000","last_became_peered":"2024-02-21T23:01:07.268436+0000","last_unstale":"2024-02-21T23:12:14.972434+0000","last_undegraded":"2024-02-21T23:12:14.972434+0000","last_fullsized":"2024-02-21T23:12:14.972434+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:01:04.348854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036117860000000001,"stat_sum":{"num_bytes":527021,"num_objects":97,"num_object_clones":0,"num_object_copies":388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":97,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":289,"num_write_kb":781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"32'50","reported_seq":132,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.062938+0000","last_change":"2024-02-21T23:12:08.714680+0000","last_active":"2024-02-21T23:12:15.062938+0000","last_peered":"2024-02-21T23:12:15.062938+0000","last_clean":"2024-02-21T23:12:15.062938+0000","last_became_active":"2024-02-21T23:01:03.215888+0000","last_became_peered":"2024-02-21T23:01:03.215888+0000","last_unstale":"2024-02-21T23:12:15.062938+0000","last_undegraded":"2024-02-21T23:12:15.062938+0000","last_fullsized":"2024-02-21T23:12:15.062938+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:34:02.477270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036927029999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"38'103","reported_seq":1041,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:58.570285+0000","last_change":"2024-02-21T23:01:02.204595+0000","last_active":"2024-02-21T23:12:58.570285+0000","last_peered":"2024-02-21T23:12:58.570285+0000","last_clean":"2024-02-21T23:12:58.570285+0000","last_became_active":"2024-02-21T23:01:02.204123+0000","last_became_peered":"2024-02-21T23:01:02.204123+0000","last_unstale":"2024-02-21T23:12:58.570285+0000","last_undegraded":"2024-02-21T23:12:58.570285+0000","last_fullsized":"2024-02-21T23:12:58.570285+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:36:44.497886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":889,"num_read_kb":4819,"num_write":111,"num_write_kb":4274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1],"acting":[10,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"35'330","reported_seq":392,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.156250+0000","last_change":"2024-02-21T23:12:08.616456+0000","last_active":"2024-02-21T23:12:15.156250+0000","last_peered":"2024-02-21T23:12:15.156250+0000","last_clean":"2024-02-21T23:12:15.156250+0000","last_became_active":"2024-02-21T23:01:07.265618+0000","last_became_peered":"2024-02-21T23:01:07.265618+0000","last_unstale":"2024-02-21T23:12:15.156250+0000","last_undegraded":"2024-02-21T23:12:15.156250+0000","last_fullsized":"2024-02-21T23:12:15.156250+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":330,"log_dups_size":0,"ondisk_log_size":330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:40:40.382308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0078749619999999992,"stat_sum":{"num_bytes":397479,"num_objects":108,"num_object_clones":0,"num_object_copies":432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":298,"num_write_kb":795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"32'50","reported_seq":133,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.240895+0000","last_change":"2024-02-21T23:12:08.608746+0000","last_active":"2024-02-21T23:12:15.240895+0000","last_peered":"2024-02-21T23:12:15.240895+0000","last_clean":"2024-02-21T23:12:15.240895+0000","last_became_active":"2024-02-21T23:01:03.214580+0000","last_became_peered":"2024-02-21T23:01:03.214580+0000","last_unstale":"2024-02-21T23:12:15.240895+0000","last_undegraded":"2024-02-21T23:12:15.240895+0000","last_fullsized":"2024-02-21T23:12:15.240895+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:25:38.592184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027155230000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8],"acting":[1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"32'33","reported_seq":82,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.972631+0000","last_change":"2024-02-21T23:01:02.222064+0000","last_active":"2024-02-21T23:12:14.972631+0000","last_peered":"2024-02-21T23:12:14.972631+0000","last_clean":"2024-02-21T23:12:14.972631+0000","last_became_active":"2024-02-21T23:01:02.221735+0000","last_became_peered":"2024-02-21T23:01:02.221735+0000","last_unstale":"2024-02-21T23:12:14.972631+0000","last_undegraded":"2024-02-21T23:12:14.972631+0000","last_fullsized":"2024-02-21T23:12:14.972631+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:23:41.295647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":43,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"35'359","reported_seq":411,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.823158+0000","last_change":"2024-02-21T23:12:08.717375+0000","last_active":"2024-02-21T23:12:14.823158+0000","last_peered":"2024-02-21T23:12:14.823158+0000","last_clean":"2024-02-21T23:12:14.823158+0000","last_became_active":"2024-02-21T23:01:07.275982+0000","last_became_peered":"2024-02-21T23:01:07.275982+0000","last_unstale":"2024-02-21T23:12:14.823158+0000","last_undegraded":"2024-02-21T23:12:14.823158+0000","last_fullsized":"2024-02-21T23:12:14.823158+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:23:12.751518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0069532279999999997,"stat_sum":{"num_bytes":644576,"num_objects":99,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":303,"num_write_kb":1079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"32'60","reported_seq":142,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.960741+0000","last_change":"2024-02-21T23:12:08.707621+0000","last_active":"2024-02-21T23:12:14.960741+0000","last_peered":"2024-02-21T23:12:14.960741+0000","last_clean":"2024-02-21T23:12:14.960741+0000","last_became_active":"2024-02-21T23:01:03.229193+0000","last_became_peered":"2024-02-21T23:01:03.229193+0000","last_unstale":"2024-02-21T23:12:14.960741+0000","last_undegraded":"2024-02-21T23:12:14.960741+0000","last_fullsized":"2024-02-21T23:12:14.960741+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:44:28.419272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0055177610000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"32'3","reported_seq":51,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.348453+0000","last_change":"2024-02-21T23:01:02.197598+0000","last_active":"2024-02-21T23:12:15.348453+0000","last_peered":"2024-02-21T23:12:15.348453+0000","last_clean":"2024-02-21T23:12:15.348453+0000","last_became_active":"2024-02-21T23:01:02.197275+0000","last_became_peered":"2024-02-21T23:01:02.197275+0000","last_unstale":"2024-02-21T23:12:15.348453+0000","last_undegraded":"2024-02-21T23:12:15.348453+0000","last_fullsized":"2024-02-21T23:12:15.348453+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:36:44.497886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"35'338","reported_seq":396,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.062488+0000","last_change":"2024-02-21T23:12:08.713158+0000","last_active":"2024-02-21T23:12:15.062488+0000","last_peered":"2024-02-21T23:12:15.062488+0000","last_clean":"2024-02-21T23:12:15.062488+0000","last_became_active":"2024-02-21T23:01:50.554591+0000","last_became_peered":"2024-02-21T23:01:50.554591+0000","last_unstale":"2024-02-21T23:12:15.062488+0000","last_undegraded":"2024-02-21T23:12:15.062488+0000","last_fullsized":"2024-02-21T23:12:15.062488+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:32:15.029558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0034363990000000001,"stat_sum":{"num_bytes":332054,"num_objects":124,"num_object_clones":0,"num_object_copies":496,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":124,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":310,"num_write_kb":722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2,4],"acting":[8,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.16","version":"32'77","reported_seq":159,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.241055+0000","last_change":"2024-02-21T23:12:08.608792+0000","last_active":"2024-02-21T23:12:15.241055+0000","last_peered":"2024-02-21T23:12:15.241055+0000","last_clean":"2024-02-21T23:12:15.241055+0000","last_became_active":"2024-02-21T23:01:03.215004+0000","last_became_peered":"2024-02-21T23:01:03.215004+0000","last_unstale":"2024-02-21T23:12:15.241055+0000","last_undegraded":"2024-02-21T23:12:15.241055+0000","last_fullsized":"2024-02-21T23:12:15.241055+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:34:02.477270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024858219999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"32'15","reported_seq":749,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:58.753639+0000","last_change":"2024-02-21T23:01:02.207663+0000","last_active":"2024-02-21T23:12:58.753639+0000","last_peered":"2024-02-21T23:12:58.753639+0000","last_clean":"2024-02-21T23:12:58.753639+0000","last_became_active":"2024-02-21T23:01:02.207349+0000","last_became_peered":"2024-02-21T23:01:02.207349+0000","last_unstale":"2024-02-21T23:12:58.753639+0000","last_undegraded":"2024-02-21T23:12:58.753639+0000","last_fullsized":"2024-02-21T23:12:58.753639+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:21:29.919968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":686,"num_read_kb":686,"num_write":21,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5],"acting":[10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"35'344","reported_seq":403,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.825538+0000","last_change":"2024-02-21T23:12:08.622969+0000","last_active":"2024-02-21T23:12:14.825538+0000","last_peered":"2024-02-21T23:12:14.825538+0000","last_clean":"2024-02-21T23:12:14.825538+0000","last_became_active":"2024-02-21T23:01:07.268193+0000","last_became_peered":"2024-02-21T23:01:07.268193+0000","last_unstale":"2024-02-21T23:12:14.825538+0000","last_undegraded":"2024-02-21T23:12:14.825538+0000","last_fullsized":"2024-02-21T23:12:14.825538+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:03:34.064139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010511161999999999,"stat_sum":{"num_bytes":737229,"num_objects":93,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":303,"num_write_kb":1054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"35'297","reported_seq":362,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.960452+0000","last_change":"2024-02-21T23:12:08.705629+0000","last_active":"2024-02-21T23:12:14.960452+0000","last_peered":"2024-02-21T23:12:14.960452+0000","last_clean":"2024-02-21T23:12:14.960452+0000","last_became_active":"2024-02-21T23:01:07.271175+0000","last_became_peered":"2024-02-21T23:01:07.271175+0000","last_unstale":"2024-02-21T23:12:14.960452+0000","last_undegraded":"2024-02-21T23:12:14.960452+0000","last_fullsized":"2024-02-21T23:12:14.960452+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:04:13.965614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0038708390000000001,"stat_sum":{"num_bytes":430239,"num_objects":97,"num_object_clones":0,"num_object_copies":388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":97,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":271,"num_write_kb":710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"32'64","reported_seq":146,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.156340+0000","last_change":"2024-02-21T23:12:08.615458+0000","last_active":"2024-02-21T23:12:15.156340+0000","last_peered":"2024-02-21T23:12:15.156340+0000","last_clean":"2024-02-21T23:12:15.156340+0000","last_became_active":"2024-02-21T23:01:03.210599+0000","last_became_peered":"2024-02-21T23:01:03.210599+0000","last_unstale":"2024-02-21T23:12:15.156340+0000","last_undegraded":"2024-02-21T23:12:15.156340+0000","last_fullsized":"2024-02-21T23:12:15.156340+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:55:05.296534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0070665069999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"32'10","reported_seq":58,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.971977+0000","last_change":"2024-02-21T23:01:02.204603+0000","last_active":"2024-02-21T23:12:14.971977+0000","last_peered":"2024-02-21T23:12:14.971977+0000","last_clean":"2024-02-21T23:12:14.971977+0000","last_became_active":"2024-02-21T23:01:02.204304+0000","last_became_peered":"2024-02-21T23:01:02.204304+0000","last_unstale":"2024-02-21T23:12:14.971977+0000","last_undegraded":"2024-02-21T23:12:14.971977+0000","last_fullsized":"2024-02-21T23:12:14.971977+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:58:23.554457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"35'308","reported_seq":373,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.628894+0000","last_change":"2024-02-21T23:12:08.667582+0000","last_active":"2024-02-21T23:12:15.628894+0000","last_peered":"2024-02-21T23:12:15.628894+0000","last_clean":"2024-02-21T23:12:15.628894+0000","last_became_active":"2024-02-21T23:01:07.283568+0000","last_became_peered":"2024-02-21T23:01:07.283568+0000","last_unstale":"2024-02-21T23:12:15.628894+0000","last_undegraded":"2024-02-21T23:12:15.628894+0000","last_fullsized":"2024-02-21T23:12:15.628894+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":308,"log_dups_size":0,"ondisk_log_size":308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:44:32.467350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003898777,"stat_sum":{"num_bytes":444936,"num_objects":124,"num_object_clones":0,"num_object_copies":496,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":124,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":282,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"32'78","reported_seq":160,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.825260+0000","last_change":"2024-02-21T23:12:08.622094+0000","last_active":"2024-02-21T23:12:14.825260+0000","last_peered":"2024-02-21T23:12:14.825260+0000","last_clean":"2024-02-21T23:12:14.825260+0000","last_became_active":"2024-02-21T23:01:03.208141+0000","last_became_peered":"2024-02-21T23:01:03.208141+0000","last_unstale":"2024-02-21T23:12:14.825260+0000","last_undegraded":"2024-02-21T23:12:14.825260+0000","last_fullsized":"2024-02-21T23:12:14.825260+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:23:47.543277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010800880000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"32'20","reported_seq":74,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.842192+0000","last_change":"2024-02-21T23:01:02.218826+0000","last_active":"2024-02-21T23:12:14.842192+0000","last_peered":"2024-02-21T23:12:14.842192+0000","last_clean":"2024-02-21T23:12:14.842192+0000","last_became_active":"2024-02-21T23:01:02.218499+0000","last_became_peered":"2024-02-21T23:01:02.218499+0000","last_unstale":"2024-02-21T23:12:14.842192+0000","last_undegraded":"2024-02-21T23:12:14.842192+0000","last_fullsized":"2024-02-21T23:12:14.842192+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:17:06.353018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62737,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":6,"num_read_kb":64,"num_write":27,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"32'47","reported_seq":116,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.875654+0000","last_change":"2024-02-21T23:01:02.209061+0000","last_active":"2024-02-21T23:12:14.875654+0000","last_peered":"2024-02-21T23:12:14.875654+0000","last_clean":"2024-02-21T23:12:14.875654+0000","last_became_active":"2024-02-21T23:01:02.208779+0000","last_became_peered":"2024-02-21T23:01:02.208779+0000","last_unstale":"2024-02-21T23:12:14.875654+0000","last_undegraded":"2024-02-21T23:12:14.875654+0000","last_fullsized":"2024-02-21T23:12:14.875654+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:17:06.353018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":4098,"num_write":52,"num_write_kb":4233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8],"acting":[10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"32'62","reported_seq":144,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.972084+0000","last_change":"2024-02-21T23:12:08.673921+0000","last_active":"2024-02-21T23:12:14.972084+0000","last_peered":"2024-02-21T23:12:14.972084+0000","last_clean":"2024-02-21T23:12:14.972084+0000","last_became_active":"2024-02-21T23:01:03.212560+0000","last_became_peered":"2024-02-21T23:01:03.212560+0000","last_unstale":"2024-02-21T23:12:14.972084+0000","last_undegraded":"2024-02-21T23:12:14.972084+0000","last_fullsized":"2024-02-21T23:12:14.972084+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:01:36.467676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036569530000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"35'328","reported_seq":386,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.821605+0000","last_change":"2024-02-21T23:12:08.715992+0000","last_active":"2024-02-21T23:12:14.821605+0000","last_peered":"2024-02-21T23:12:14.821605+0000","last_clean":"2024-02-21T23:12:14.821605+0000","last_became_active":"2024-02-21T23:01:07.267796+0000","last_became_peered":"2024-02-21T23:01:07.267796+0000","last_unstale":"2024-02-21T23:12:14.821605+0000","last_undegraded":"2024-02-21T23:12:14.821605+0000","last_fullsized":"2024-02-21T23:12:14.821605+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:59:12.232049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0050978890000000004,"stat_sum":{"num_bytes":212072,"num_objects":97,"num_object_clones":0,"num_object_copies":388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":97,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":291,"num_write_kb":1346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"32'86","reported_seq":1369,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:59.755728+0000","last_change":"2024-02-21T23:01:02.206398+0000","last_active":"2024-02-21T23:12:59.755728+0000","last_peered":"2024-02-21T23:12:59.755728+0000","last_clean":"2024-02-21T23:12:59.755728+0000","last_became_active":"2024-02-21T23:01:02.206069+0000","last_became_peered":"2024-02-21T23:01:02.206069+0000","last_unstale":"2024-02-21T23:12:59.755728+0000","last_undegraded":"2024-02-21T23:12:59.755728+0000","last_fullsized":"2024-02-21T23:12:59.755728+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:26:49.911102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9892253,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":1235,"num_read_kb":9674,"num_write":91,"num_write_kb":9838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"32'52","reported_seq":134,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.062722+0000","last_change":"2024-02-21T23:12:08.714756+0000","last_active":"2024-02-21T23:12:15.062722+0000","last_peered":"2024-02-21T23:12:15.062722+0000","last_clean":"2024-02-21T23:12:15.062722+0000","last_became_active":"2024-02-21T23:01:03.220900+0000","last_became_peered":"2024-02-21T23:01:03.220900+0000","last_unstale":"2024-02-21T23:12:15.062722+0000","last_undegraded":"2024-02-21T23:12:15.062722+0000","last_fullsized":"2024-02-21T23:12:15.062722+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:25:38.592184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042536859999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9],"acting":[8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"35'336","reported_seq":393,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.822380+0000","last_change":"2024-02-21T23:12:08.716520+0000","last_active":"2024-02-21T23:12:14.822380+0000","last_peered":"2024-02-21T23:12:14.822380+0000","last_clean":"2024-02-21T23:12:14.822380+0000","last_became_active":"2024-02-21T23:01:07.256474+0000","last_became_peered":"2024-02-21T23:01:07.256474+0000","last_unstale":"2024-02-21T23:12:14.822380+0000","last_undegraded":"2024-02-21T23:12:14.822380+0000","last_fullsized":"2024-02-21T23:12:14.822380+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:03:56.907378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0052156759999999998,"stat_sum":{"num_bytes":406297,"num_objects":103,"num_object_clones":0,"num_object_copies":412,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":293,"num_write_kb":672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"32'75","reported_seq":158,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.627459+0000","last_change":"2024-02-21T23:12:08.667906+0000","last_active":"2024-02-21T23:12:15.627459+0000","last_peered":"2024-02-21T23:12:15.627459+0000","last_clean":"2024-02-21T23:12:15.627459+0000","last_became_active":"2024-02-21T23:01:03.215461+0000","last_became_peered":"2024-02-21T23:01:03.215461+0000","last_unstale":"2024-02-21T23:12:15.627459+0000","last_undegraded":"2024-02-21T23:12:15.627459+0000","last_fullsized":"2024-02-21T23:12:15.627459+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:51:26.354389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041591809999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"32'71","reported_seq":154,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.821930+0000","last_change":"2024-02-21T23:12:08.715407+0000","last_active":"2024-02-21T23:12:14.821930+0000","last_peered":"2024-02-21T23:12:14.821930+0000","last_clean":"2024-02-21T23:12:14.821930+0000","last_became_active":"2024-02-21T23:01:03.215639+0000","last_became_peered":"2024-02-21T23:01:03.215639+0000","last_unstale":"2024-02-21T23:12:14.821930+0000","last_undegraded":"2024-02-21T23:12:14.821930+0000","last_fullsized":"2024-02-21T23:12:14.821930+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:48:40.284242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0047914689999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"32'66","reported_seq":149,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.821515+0000","last_change":"2024-02-21T23:12:08.712004+0000","last_active":"2024-02-21T23:12:14.821515+0000","last_peered":"2024-02-21T23:12:14.821515+0000","last_clean":"2024-02-21T23:12:14.821515+0000","last_became_active":"2024-02-21T23:01:03.218377+0000","last_became_peered":"2024-02-21T23:01:03.218377+0000","last_unstale":"2024-02-21T23:12:14.821515+0000","last_undegraded":"2024-02-21T23:12:14.821515+0000","last_fullsized":"2024-02-21T23:12:14.821515+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:52:50.911363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019364429999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"32'63","reported_seq":146,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.960111+0000","last_change":"2024-02-21T23:12:08.705210+0000","last_active":"2024-02-21T23:12:14.960111+0000","last_peered":"2024-02-21T23:12:14.960111+0000","last_clean":"2024-02-21T23:12:14.960111+0000","last_became_active":"2024-02-21T23:01:03.225085+0000","last_became_peered":"2024-02-21T23:01:03.225085+0000","last_unstale":"2024-02-21T23:12:14.960111+0000","last_undegraded":"2024-02-21T23:12:14.960111+0000","last_fullsized":"2024-02-21T23:12:14.960111+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:39:42.402349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0037249340000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"32'45","reported_seq":128,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.843516+0000","last_change":"2024-02-21T23:12:08.719085+0000","last_active":"2024-02-21T23:12:14.843516+0000","last_peered":"2024-02-21T23:12:14.843516+0000","last_clean":"2024-02-21T23:12:14.843516+0000","last_became_active":"2024-02-21T23:01:03.225925+0000","last_became_peered":"2024-02-21T23:01:03.225925+0000","last_unstale":"2024-02-21T23:12:14.843516+0000","last_undegraded":"2024-02-21T23:12:14.843516+0000","last_fullsized":"2024-02-21T23:12:14.843516+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:04:09.917536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0086580830000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"32'52","reported_seq":135,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.627610+0000","last_change":"2024-02-21T23:12:08.667425+0000","last_active":"2024-02-21T23:12:15.627610+0000","last_peered":"2024-02-21T23:12:15.627610+0000","last_clean":"2024-02-21T23:12:15.627610+0000","last_became_active":"2024-02-21T23:01:03.214488+0000","last_became_peered":"2024-02-21T23:01:03.214488+0000","last_unstale":"2024-02-21T23:12:15.627610+0000","last_undegraded":"2024-02-21T23:12:15.627610+0000","last_fullsized":"2024-02-21T23:12:15.627610+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:12:45.004002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003806336,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8],"acting":[11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"32'76","reported_seq":159,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.822327+0000","last_change":"2024-02-21T23:12:08.715929+0000","last_active":"2024-02-21T23:12:14.822327+0000","last_peered":"2024-02-21T23:12:14.822327+0000","last_clean":"2024-02-21T23:12:14.822327+0000","last_became_active":"2024-02-21T23:01:03.208458+0000","last_became_peered":"2024-02-21T23:01:03.208458+0000","last_unstale":"2024-02-21T23:12:14.822327+0000","last_undegraded":"2024-02-21T23:12:14.822327+0000","last_fullsized":"2024-02-21T23:12:14.822327+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:39:42.402349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041855369999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8],"acting":[2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"32'45","reported_seq":128,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.826929+0000","last_change":"2024-02-21T23:12:08.622658+0000","last_active":"2024-02-21T23:12:14.826929+0000","last_peered":"2024-02-21T23:12:14.826929+0000","last_clean":"2024-02-21T23:12:14.826929+0000","last_became_active":"2024-02-21T23:01:03.206376+0000","last_became_peered":"2024-02-21T23:01:03.206376+0000","last_unstale":"2024-02-21T23:12:14.826929+0000","last_undegraded":"2024-02-21T23:12:14.826929+0000","last_fullsized":"2024-02-21T23:12:14.826929+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:01:00.300776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011228559000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"32'56","reported_seq":139,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.971688+0000","last_change":"2024-02-21T23:12:08.674979+0000","last_active":"2024-02-21T23:12:14.971688+0000","last_peered":"2024-02-21T23:12:14.971688+0000","last_clean":"2024-02-21T23:12:14.971688+0000","last_became_active":"2024-02-21T23:01:03.214922+0000","last_became_peered":"2024-02-21T23:01:03.214922+0000","last_unstale":"2024-02-21T23:12:14.971688+0000","last_undegraded":"2024-02-21T23:12:14.971688+0000","last_fullsized":"2024-02-21T23:12:14.971688+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:23:08.703440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040330870000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"32'59","reported_seq":142,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.825264+0000","last_change":"2024-02-21T23:12:08.623727+0000","last_active":"2024-02-21T23:12:14.825264+0000","last_peered":"2024-02-21T23:12:14.825264+0000","last_clean":"2024-02-21T23:12:14.825264+0000","last_became_active":"2024-02-21T23:01:03.213428+0000","last_became_peered":"2024-02-21T23:01:03.213428+0000","last_unstale":"2024-02-21T23:12:14.825264+0000","last_undegraded":"2024-02-21T23:12:14.825264+0000","last_fullsized":"2024-02-21T23:12:14.825264+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:37:40.493779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.011202166,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"32'58","reported_seq":141,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.240978+0000","last_change":"2024-02-21T23:12:08.608072+0000","last_active":"2024-02-21T23:12:15.240978+0000","last_peered":"2024-02-21T23:12:15.240978+0000","last_clean":"2024-02-21T23:12:15.240978+0000","last_became_active":"2024-02-21T23:01:03.215580+0000","last_became_peered":"2024-02-21T23:01:03.215580+0000","last_unstale":"2024-02-21T23:12:15.240978+0000","last_undegraded":"2024-02-21T23:12:15.240978+0000","last_fullsized":"2024-02-21T23:12:15.240978+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:47:27.962126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023411170000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"32'65","reported_seq":148,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.843676+0000","last_change":"2024-02-21T23:12:08.718997+0000","last_active":"2024-02-21T23:12:14.843676+0000","last_peered":"2024-02-21T23:12:14.843676+0000","last_clean":"2024-02-21T23:12:14.843676+0000","last_became_active":"2024-02-21T23:01:03.223861+0000","last_became_peered":"2024-02-21T23:01:03.223861+0000","last_unstale":"2024-02-21T23:12:14.843676+0000","last_undegraded":"2024-02-21T23:12:14.843676+0000","last_fullsized":"2024-02-21T23:12:14.843676+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:13:25.637195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0087043620000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"32'67","reported_seq":150,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.627612+0000","last_change":"2024-02-21T23:12:08.666440+0000","last_active":"2024-02-21T23:12:15.627612+0000","last_peered":"2024-02-21T23:12:15.627612+0000","last_clean":"2024-02-21T23:12:15.627612+0000","last_became_active":"2024-02-21T23:01:03.212691+0000","last_became_peered":"2024-02-21T23:01:03.212691+0000","last_unstale":"2024-02-21T23:12:15.627612+0000","last_undegraded":"2024-02-21T23:12:15.627612+0000","last_fullsized":"2024-02-21T23:12:15.627612+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:13:25.637195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0030459049999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"32'58","reported_seq":141,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.822200+0000","last_change":"2024-02-21T23:12:08.716680+0000","last_active":"2024-02-21T23:12:14.822200+0000","last_peered":"2024-02-21T23:12:14.822200+0000","last_clean":"2024-02-21T23:12:14.822200+0000","last_became_active":"2024-02-21T23:01:03.217613+0000","last_became_peered":"2024-02-21T23:01:03.217613+0000","last_unstale":"2024-02-21T23:12:14.822200+0000","last_undegraded":"2024-02-21T23:12:14.822200+0000","last_fullsized":"2024-02-21T23:12:14.822200+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:04:09.917536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0051553379999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"32'62","reported_seq":145,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.156874+0000","last_change":"2024-02-21T23:12:08.616485+0000","last_active":"2024-02-21T23:12:15.156874+0000","last_peered":"2024-02-21T23:12:15.156874+0000","last_clean":"2024-02-21T23:12:15.156874+0000","last_became_active":"2024-02-21T23:01:03.214165+0000","last_became_peered":"2024-02-21T23:01:03.214165+0000","last_unstale":"2024-02-21T23:12:15.156874+0000","last_undegraded":"2024-02-21T23:12:15.156874+0000","last_fullsized":"2024-02-21T23:12:15.156874+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:44:37.422634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00687764,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1],"acting":[9,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"32'51","reported_seq":134,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.629222+0000","last_change":"2024-02-21T23:12:08.668135+0000","last_active":"2024-02-21T23:12:15.629222+0000","last_peered":"2024-02-21T23:12:15.629222+0000","last_clean":"2024-02-21T23:12:15.629222+0000","last_became_active":"2024-02-21T23:01:03.213755+0000","last_became_peered":"2024-02-21T23:01:03.213755+0000","last_unstale":"2024-02-21T23:12:15.629222+0000","last_undegraded":"2024-02-21T23:12:15.629222+0000","last_fullsized":"2024-02-21T23:12:15.629222+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:01:36.467676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041418410000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"32'59","reported_seq":142,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.241655+0000","last_change":"2024-02-21T23:12:08.608309+0000","last_active":"2024-02-21T23:12:15.241655+0000","last_peered":"2024-02-21T23:12:15.241655+0000","last_clean":"2024-02-21T23:12:15.241655+0000","last_became_active":"2024-02-21T23:01:03.216345+0000","last_became_peered":"2024-02-21T23:01:03.216345+0000","last_unstale":"2024-02-21T23:12:15.241655+0000","last_undegraded":"2024-02-21T23:12:15.241655+0000","last_fullsized":"2024-02-21T23:12:15.241655+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:44:37.422634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027043900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"32'62","reported_seq":145,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.959952+0000","last_change":"2024-02-21T23:12:08.706913+0000","last_active":"2024-02-21T23:12:14.959952+0000","last_peered":"2024-02-21T23:12:14.959952+0000","last_clean":"2024-02-21T23:12:14.959952+0000","last_became_active":"2024-02-21T23:01:03.225574+0000","last_became_peered":"2024-02-21T23:01:03.225574+0000","last_unstale":"2024-02-21T23:12:14.959952+0000","last_undegraded":"2024-02-21T23:12:14.959952+0000","last_fullsized":"2024-02-21T23:12:14.959952+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:12:45.004002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0048553650000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"32'64","reported_seq":147,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.959843+0000","last_change":"2024-02-21T23:12:08.704695+0000","last_active":"2024-02-21T23:12:14.959843+0000","last_peered":"2024-02-21T23:12:14.959843+0000","last_clean":"2024-02-21T23:12:14.959843+0000","last_became_active":"2024-02-21T23:01:03.217938+0000","last_became_peered":"2024-02-21T23:01:03.217938+0000","last_unstale":"2024-02-21T23:12:14.959843+0000","last_undegraded":"2024-02-21T23:12:14.959843+0000","last_fullsized":"2024-02-21T23:12:14.959843+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:59:08.183972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003564963,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8],"acting":[0,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"32'61","reported_seq":143,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.843531+0000","last_change":"2024-02-21T23:12:08.717094+0000","last_active":"2024-02-21T23:12:14.843531+0000","last_peered":"2024-02-21T23:12:14.843531+0000","last_clean":"2024-02-21T23:12:14.843531+0000","last_became_active":"2024-02-21T23:01:03.225449+0000","last_became_peered":"2024-02-21T23:01:03.225449+0000","last_unstale":"2024-02-21T23:12:14.843531+0000","last_undegraded":"2024-02-21T23:12:14.843531+0000","last_fullsized":"2024-02-21T23:12:14.843531+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:53:32.848973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.006971741,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10],"acting":[6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"32'49","reported_seq":131,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.823390+0000","last_change":"2024-02-21T23:12:08.717258+0000","last_active":"2024-02-21T23:12:14.823390+0000","last_peered":"2024-02-21T23:12:14.823390+0000","last_clean":"2024-02-21T23:12:14.823390+0000","last_became_active":"2024-02-21T23:01:03.208446+0000","last_became_peered":"2024-02-21T23:01:03.208446+0000","last_unstale":"2024-02-21T23:12:14.823390+0000","last_undegraded":"2024-02-21T23:12:14.823390+0000","last_fullsized":"2024-02-21T23:12:14.823390+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:23:47.543277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0075836849999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"32'63","reported_seq":145,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.347830+0000","last_change":"2024-02-21T23:12:08.714531+0000","last_active":"2024-02-21T23:12:15.347830+0000","last_peered":"2024-02-21T23:12:15.347830+0000","last_clean":"2024-02-21T23:12:15.347830+0000","last_became_active":"2024-02-21T23:01:03.217925+0000","last_became_peered":"2024-02-21T23:01:03.217925+0000","last_unstale":"2024-02-21T23:12:15.347830+0000","last_undegraded":"2024-02-21T23:12:15.347830+0000","last_fullsized":"2024-02-21T23:12:15.347830+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:11:24.214077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040956530000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8],"acting":[7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"32'65","reported_seq":147,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.876194+0000","last_change":"2024-02-21T23:12:08.665828+0000","last_active":"2024-02-21T23:12:14.876194+0000","last_peered":"2024-02-21T23:12:14.876194+0000","last_clean":"2024-02-21T23:12:14.876194+0000","last_became_active":"2024-02-21T23:01:03.211921+0000","last_became_peered":"2024-02-21T23:01:03.211921+0000","last_unstale":"2024-02-21T23:12:14.876194+0000","last_undegraded":"2024-02-21T23:12:14.876194+0000","last_fullsized":"2024-02-21T23:12:14.876194+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:39:43.532897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001167464,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2],"acting":[10,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"32'69","reported_seq":151,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.240765+0000","last_change":"2024-02-21T23:12:08.609207+0000","last_active":"2024-02-21T23:12:15.240765+0000","last_peered":"2024-02-21T23:12:15.240765+0000","last_clean":"2024-02-21T23:12:15.240765+0000","last_became_active":"2024-02-21T23:01:03.216580+0000","last_became_peered":"2024-02-21T23:01:03.216580+0000","last_unstale":"2024-02-21T23:12:15.240765+0000","last_undegraded":"2024-02-21T23:12:15.240765+0000","last_fullsized":"2024-02-21T23:12:15.240765+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:31:33.327648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028130189999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"32'51","reported_seq":133,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.825163+0000","last_change":"2024-02-21T23:12:08.622328+0000","last_active":"2024-02-21T23:12:14.825163+0000","last_peered":"2024-02-21T23:12:14.825163+0000","last_clean":"2024-02-21T23:12:14.825163+0000","last_became_active":"2024-02-21T23:01:03.211811+0000","last_became_peered":"2024-02-21T23:01:03.211811+0000","last_unstale":"2024-02-21T23:12:14.825163+0000","last_undegraded":"2024-02-21T23:12:14.825163+0000","last_fullsized":"2024-02-21T23:12:14.825163+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:23:08.703440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.010173674000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"32'65","reported_seq":147,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.347545+0000","last_change":"2024-02-21T23:12:08.715177+0000","last_active":"2024-02-21T23:12:15.347545+0000","last_peered":"2024-02-21T23:12:15.347545+0000","last_clean":"2024-02-21T23:12:15.347545+0000","last_became_active":"2024-02-21T23:01:03.223255+0000","last_became_peered":"2024-02-21T23:01:03.223255+0000","last_unstale":"2024-02-21T23:12:15.347545+0000","last_undegraded":"2024-02-21T23:12:15.347545+0000","last_fullsized":"2024-02-21T23:12:15.347545+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:51:26.354389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0045391540000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9],"acting":[7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"32'59","reported_seq":141,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.875584+0000","last_change":"2024-02-21T23:12:08.665498+0000","last_active":"2024-02-21T23:12:14.875584+0000","last_peered":"2024-02-21T23:12:14.875584+0000","last_clean":"2024-02-21T23:12:14.875584+0000","last_became_active":"2024-02-21T23:01:03.209569+0000","last_became_peered":"2024-02-21T23:01:03.209569+0000","last_unstale":"2024-02-21T23:12:14.875584+0000","last_undegraded":"2024-02-21T23:12:14.875584+0000","last_fullsized":"2024-02-21T23:12:14.875584+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:20:38.984727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015588990000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9],"acting":[10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"32'56","reported_seq":138,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.062741+0000","last_change":"2024-02-21T23:12:08.713984+0000","last_active":"2024-02-21T23:12:15.062741+0000","last_peered":"2024-02-21T23:12:15.062741+0000","last_clean":"2024-02-21T23:12:15.062741+0000","last_became_active":"2024-02-21T23:01:03.213941+0000","last_became_peered":"2024-02-21T23:01:03.213941+0000","last_unstale":"2024-02-21T23:12:15.062741+0000","last_undegraded":"2024-02-21T23:12:15.062741+0000","last_fullsized":"2024-02-21T23:12:15.062741+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:44:37.422634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041976929999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3],"acting":[8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"32'49","reported_seq":132,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.823155+0000","last_change":"2024-02-21T23:12:08.716284+0000","last_active":"2024-02-21T23:12:14.823155+0000","last_peered":"2024-02-21T23:12:14.823155+0000","last_clean":"2024-02-21T23:12:14.823155+0000","last_became_active":"2024-02-21T23:01:03.206762+0000","last_became_peered":"2024-02-21T23:01:03.206762+0000","last_unstale":"2024-02-21T23:12:14.823155+0000","last_undegraded":"2024-02-21T23:12:14.823155+0000","last_fullsized":"2024-02-21T23:12:14.823155+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:01:36.467676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068220390000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8],"acting":[4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"32'65","reported_seq":148,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.960225+0000","last_change":"2024-02-21T23:12:08.708085+0000","last_active":"2024-02-21T23:12:14.960225+0000","last_peered":"2024-02-21T23:12:14.960225+0000","last_clean":"2024-02-21T23:12:14.960225+0000","last_became_active":"2024-02-21T23:01:03.221672+0000","last_became_peered":"2024-02-21T23:01:03.221672+0000","last_unstale":"2024-02-21T23:12:14.960225+0000","last_undegraded":"2024-02-21T23:12:14.960225+0000","last_fullsized":"2024-02-21T23:12:14.960225+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:11:24.214077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0057510360000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"32'41","reported_seq":124,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:14.960616+0000","last_change":"2024-02-21T23:12:08.706177+0000","last_active":"2024-02-21T23:12:14.960616+0000","last_peered":"2024-02-21T23:12:14.960616+0000","last_clean":"2024-02-21T23:12:14.960616+0000","last_became_active":"2024-02-21T23:01:03.219379+0000","last_became_peered":"2024-02-21T23:01:03.219379+0000","last_unstale":"2024-02-21T23:12:14.960616+0000","last_undegraded":"2024-02-21T23:12:14.960616+0000","last_fullsized":"2024-02-21T23:12:14.960616+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:53:08.201764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00417075,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11],"acting":[0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"32'44","reported_seq":127,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-02-21T23:12:15.629039+0000","last_change":"2024-02-21T23:12:08.668249+0000","last_active":"2024-02-21T23:12:15.629039+0000","last_peered":"2024-02-21T23:12:15.629039+0000","last_clean":"2024-02-21T23:12:15.629039+0000","last_became_active":"2024-02-21T23:01:03.212878+0000","last_became_peered":"2024-02-21T23:01:03.212878+0000","last_unstale":"2024-02-21T23:12:15.629039+0000","last_undegraded":"2024-02-21T23:12:15.629039+0000","last_fullsized":"2024-02-21T23:12:15.629039+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:23:47.543277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042655480000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":26460371,"num_objects":3449,"num_object_clones":0,"num_object_copies":13796,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3449,"num_whiteouts":0,"num_read":1,"num_read_kb":1270,"num_write":9636,"num_write_kb":38355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":91508736,"data_stored":98402304,"data_compressed":4659312,"data_compressed_allocated":5701632,"data_compressed_original":12595200,"omap_allocated":0,"internal_metadata":0},"log_size":10826,"ondisk_log_size":10826,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3698,"ondisk_log_size":3698,"up":128,"acting":128,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":60973696,"num_objects":267,"num_object_clones":0,"num_object_copies":534,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":267,"num_whiteouts":0,"num_read":6585,"num_read_kb":62538,"num_write":2281,"num_write_kb":69704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":221,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":26804224,"data_stored":121947392,"data_compressed":17887090,"data_compressed_allocated":22609920,"data_compressed_original":117915648,"omap_allocated":0,"internal_metadata":0},"log_size":1638,"ondisk_log_size":1638,"up":64,"acting":64,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66458,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":11,"up_from":17,"seq":73014444179,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46372,"kb_used_data":6872,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94325468,"statfs":{"total":96636764160,"available":96589279232,"internally_reserved":0,"allocated":7036928,"data_stored":7192237,"data_compressed":328586,"data_compressed_allocated":405504,"data_compressed_original":815104,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":17,"seq":73014444178,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49200,"kb_used_data":9700,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94322640,"statfs":{"total":96636764160,"available":96586383360,"internally_reserved":0,"allocated":9932800,"data_stored":22999079,"data_compressed":2652432,"data_compressed_allocated":3399680,"data_compressed_original":16744448,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":17,"seq":73014444179,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50584,"kb_used_data":11088,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94321256,"statfs":{"total":96636764160,"available":96584966144,"internally_reserved":0,"allocated":11354112,"data_stored":15511303,"data_compressed":1072430,"data_compressed_allocated":1388544,"data_compressed_original":5804032,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":17,"seq":73014444178,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47140,"kb_used_data":7644,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94324700,"statfs":{"total":96636764160,"available":96588492800,"internally_reserved":0,"allocated":7827456,"data_stored":21888259,"data_compressed":2896373,"data_compressed_allocated":3649536,"data_compressed_original":17977344,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,3,4,5,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":17,"seq":73014444179,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39008,"kb_used_data":11988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94332832,"statfs":{"total":96636764160,"available":96596819968,"internally_reserved":0,"allocated":12275712,"data_stored":26096945,"data_compressed":2815859,"data_compressed_allocated":3579904,"data_compressed_original":17661952,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":17,"seq":73014444178,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44888,"kb_used_data":9548,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94326952,"statfs":{"total":96636764160,"available":96590798848,"internally_reserved":0,"allocated":9777152,"data_stored":13577476,"data_compressed":1118839,"data_compressed_allocated":1355776,"data_compressed_original":5414912,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":17,"seq":73014444179,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41616,"kb_used_data":14596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94330224,"statfs":{"total":96636764160,"available":96594149376,"internally_reserved":0,"allocated":14946304,"data_stored":30254498,"data_compressed":3332972,"data_compressed_allocated":4235264,"data_compressed_original":19828736,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":17,"seq":73014444179,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49440,"kb_used_data":9940,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94322400,"statfs":{"total":96636764160,"available":96586137600,"internally_reserved":0,"allocated":10178560,"data_stored":10999294,"data_compressed":671953,"data_compressed_allocated":815104,"data_compressed_original":1896448,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":17,"seq":73014444179,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46940,"kb_used_data":7440,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94324900,"statfs":{"total":96636764160,"available":96588697600,"internally_reserved":0,"allocated":7618560,"data_stored":11946061,"data_compressed":1296354,"data_compressed_allocated":1605632,"data_compressed_original":6193152,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444179,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52736,"kb_used_data":13236,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94319104,"statfs":{"total":96636764160,"available":96582762496,"internally_reserved":0,"allocated":13553664,"data_stored":37826176,"data_compressed":5011784,"data_compressed_allocated":6279168,"data_compressed_original":30818304,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":17,"seq":73014444179,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49508,"kb_used_data":10008,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94322332,"statfs":{"total":96636764160,"available":96586067968,"internally_reserved":0,"allocated":10248192,"data_stored":13655815,"data_compressed":1001090,"data_compressed_allocated":1249280,"data_compressed_original":4915200,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":17,"seq":73014444179,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44084,"kb_used_data":8744,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327756,"statfs":{"total":96636764160,"available":96591622144,"internally_reserved":0,"allocated":8953856,"data_stored":12521357,"data_compressed":892256,"data_compressed_allocated":1126400,"data_compressed_original":4964352,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33229,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33229,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":831488,"data_stored":4195110,"data_compressed":654518,"data_compressed_allocated":794624,"data_compressed_original":4177920,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":983040,"data_stored":4194976,"data_compressed":615592,"data_compressed_allocated":782336,"data_compressed_original":4001792,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6569984,"data_stored":30536217,"data_compressed":4544343,"data_compressed_allocated":5718016,"data_compressed_original":29700096,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":962560,"data_stored":4484070,"data_compressed":694867,"data_compressed_allocated":851968,"data_compressed_original":4382720,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":63895,"data_compressed":8106,"data_compressed_allocated":12288,"data_compressed_original":36864,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4325376,"data_stored":18609947,"data_compressed":2736860,"data_compressed_allocated":3469312,"data_compressed_original":17784832,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1032192,"data_stored":4546717,"data_compressed":692215,"data_compressed_allocated":839680,"data_compressed_original":4362240,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":3792896,"data_stored":16778922,"data_compressed":2462264,"data_compressed_allocated":3121152,"data_compressed_original":16113664,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":3510272,"data_stored":17170588,"data_compressed":2509837,"data_compressed_allocated":3166208,"data_compressed_original":16842752,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":827392,"data_stored":4588192,"data_compressed":597133,"data_compressed_allocated":802816,"data_compressed_original":4571136,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":3915776,"data_stored":16778176,"data_compressed":2371355,"data_compressed_allocated":3051520,"data_compressed_original":15941632,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":7684096,"data_stored":8081408,"data_compressed":197899,"data_compressed_allocated":274432,"data_compressed_original":671744,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8826880,"data_stored":9216000,"data_compressed":345659,"data_compressed_allocated":409600,"data_compressed_original":798720,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6545408,"data_stored":7045120,"data_compressed":427602,"data_compressed_allocated":503808,"data_compressed_original":1003520,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6217728,"data_stored":7217152,"data_compressed":561648,"data_compressed_allocated":696320,"data_compressed_original":1695744,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":9691136,"data_stored":10690560,"data_compressed":624008,"data_compressed_allocated":745472,"data_compressed_original":1744896,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":10117120,"data_stored":10809344,"data_compressed":523044,"data_compressed_allocated":663552,"data_compressed_original":1355776,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8306688,"data_stored":8785920,"data_compressed":386785,"data_compressed_allocated":458752,"data_compressed_original":937984,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":7979008,"data_stored":8482816,"data_compressed":280527,"data_compressed_allocated":356352,"data_compressed_original":860160,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":3878912,"data_stored":4472832,"data_compressed":346697,"data_compressed_allocated":425984,"data_compressed_original":1019904,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":10088448,"data_stored":10678272,"data_compressed":435458,"data_compressed_allocated":528384,"data_compressed_original":1118208,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":5578752,"data_stored":5976064,"data_compressed":241238,"data_compressed_allocated":290816,"data_compressed_original":688128,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":6594560,"data_stored":6946816,"data_compressed":288747,"data_compressed_allocated":348160,"data_compressed_original":700416,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-21T23:13:03.818 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T23:13:04.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:04.054+0000 7f131f200640 1 Processor -- start 2024-02-21T23:13:04.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:04.055+0000 7f131f200640 1 -- start start 2024-02-21T23:13:04.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:04.057+0000 7f131f200640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f1320072e30 0x7f13201836a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:04.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:04.057+0000 7f131f200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1320187560 con 0x7f13200732b0 2024-02-21T23:13:04.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:04.057+0000 7f131f200640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1320187840 con 0x7f1320188d20 2024-02-21T23:13:04.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:04.057+0000 7f131f200640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1320187330 con 0x7f1320072e30 2024-02-21T23:13:04.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:04.057+0000 7f131d400640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f1320072e30 0x7f13201836a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:04.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:04.057+0000 7f131d400640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f1320072e30 0x7f13201836a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:53664/0 (socket says 172.21.15.99:53664) 2024-02-21T23:13:04.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:04.057+0000 7f131d400640 1 -- 172.21.15.99:0/1788014411 learned_addr learned my addr 172.21.15.99:0/1788014411 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:13:04.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:04.057+0000 7f131d400640 1 -- 172.21.15.99:0/1788014411 >> v1:172.21.15.181:6789/0 conn(0x7f1320188d20 legacy=0x7f1320186c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:04.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:04.058+0000 7f131d400640 1 -- 172.21.15.99:0/1788014411 >> v1:172.21.15.162:6789/0 conn(0x7f13200732b0 legacy=0x7f1320189100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:04.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:04.058+0000 7f131d400640 1 -- 172.21.15.99:0/1788014411 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1320187b20 con 0x7f1320072e30 2024-02-21T23:13:04.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:04.057+0000 7f131ca00640 1 -- 172.21.15.99:0/1788014411 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2133151184 0 0) 0x7f1320187840 con 0x7f1320188d20 2024-02-21T23:13:04.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:04.059+0000 7f131d400640 1 --2- 172.21.15.99:0/1788014411 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1320072e30 0x7f13201836a0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f130c009870 tx=0x7f130c02b990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a568607439aac77 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:04.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:04.059+0000 7f131ca00640 1 -- 172.21.15.99:0/1788014411 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130c034070 con 0x7f1320072e30 2024-02-21T23:13:04.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:04.059+0000 7f131ca00640 1 -- 172.21.15.99:0/1788014411 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f130c030850 con 0x7f1320072e30 2024-02-21T23:13:04.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:04.060+0000 7f131ca00640 1 -- 172.21.15.99:0/1788014411 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130c030c20 con 0x7f1320072e30 2024-02-21T23:13:04.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:04.060+0000 7f131f200640 1 -- 172.21.15.99:0/1788014411 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1320072e30 msgr2=0x7f13201836a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:04.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:04.060+0000 7f131f200640 1 --2- 172.21.15.99:0/1788014411 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1320072e30 0x7f13201836a0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f130c009870 tx=0x7f130c02b990 comp rx=0 tx=0).stop 2024-02-21T23:13:04.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:04.060+0000 7f131f200640 1 -- 172.21.15.99:0/1788014411 shutdown_connections 2024-02-21T23:13:04.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:04.060+0000 7f131f200640 1 --2- 172.21.15.99:0/1788014411 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1320072e30 0x7f13201836a0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:04.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:04.060+0000 7f131f200640 1 -- 172.21.15.99:0/1788014411 >> 172.21.15.99:0/1788014411 conn(0x7f132006e210 msgr2=0x7f132006e620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:04.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:04.060+0000 7f131f200640 1 -- 172.21.15.99:0/1788014411 shutdown_connections 2024-02-21T23:13:04.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:04.060+0000 7f131f200640 1 -- 172.21.15.99:0/1788014411 wait complete. 2024-02-21T23:13:04.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:04.063+0000 7f131f200640 1 Processor -- start 2024-02-21T23:13:04.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:04.063+0000 7f131f200640 1 -- start start 2024-02-21T23:13:04.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:04.064+0000 7f131f200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1320072e30 0x7f132021edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:04.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:04.064+0000 7f131f200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f13200732b0 0x7f132015dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:04.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:04.064+0000 7f131f200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1320188d20 0x7f132015e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:04.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:04.064+0000 7f131f200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13201880e0 con 0x7f13200732b0 2024-02-21T23:13:04.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:04.064+0000 7f131f200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f132017fc50 con 0x7f1320188d20 2024-02-21T23:13:04.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:04.064+0000 7f131f200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13201883c0 con 0x7f1320072e30 2024-02-21T23:13:04.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:04.064+0000 7f131d400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f13200732b0 0x7f132015dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:04.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:04.065+0000 7f131d400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f13200732b0 0x7f132015dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53188/0 (socket says 172.21.15.99:53188) 2024-02-21T23:13:04.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:04.065+0000 7f131d400640 1 -- 172.21.15.99:0/3868389041 learned_addr learned my addr 172.21.15.99:0/3868389041 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:13:04.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:04.065+0000 7f131de00640 1 --2- 172.21.15.99:0/3868389041 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1320072e30 0x7f132021edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:04.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:04.065+0000 7f131e800640 1 --2- 172.21.15.99:0/3868389041 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1320188d20 0x7f132015e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:04.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:04.065+0000 7f131de00640 1 -- 172.21.15.99:0/3868389041 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1320188d20 msgr2=0x7f132015e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:04.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:04.065+0000 7f131de00640 1 --2- 172.21.15.99:0/3868389041 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1320188d20 0x7f132015e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:04.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:04.065+0000 7f131de00640 1 -- 172.21.15.99:0/3868389041 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f13200732b0 msgr2=0x7f132015dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:04.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:04.065+0000 7f131de00640 1 --2- 172.21.15.99:0/3868389041 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f13200732b0 0x7f132015dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:04.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:04.065+0000 7f131de00640 1 -- 172.21.15.99:0/3868389041 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f132021f880 con 0x7f1320072e30 2024-02-21T23:13:04.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:04.065+0000 7f131d400640 1 --2- 172.21.15.99:0/3868389041 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f13200732b0 0x7f132015dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:13:04.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:04.065+0000 7f131de00640 1 --2- 172.21.15.99:0/3868389041 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1320072e30 0x7f132021edd0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f131000c3e0 tx=0x7f131000c8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:04.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:04.066+0000 7f1316000640 1 -- 172.21.15.99:0/3868389041 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1310017070 con 0x7f1320072e30 2024-02-21T23:13:04.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:04.066+0000 7f1316000640 1 -- 172.21.15.99:0/3868389041 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13100035f0 con 0x7f1320072e30 2024-02-21T23:13:04.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:04.066+0000 7f1316000640 1 -- 172.21.15.99:0/3868389041 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13100039e0 con 0x7f1320072e30 2024-02-21T23:13:04.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:04.066+0000 7f131f200640 1 -- 172.21.15.99:0/3868389041 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f132021fb60 con 0x7f1320072e30 2024-02-21T23:13:04.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:04.066+0000 7f131f200640 1 -- 172.21.15.99:0/3868389041 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1320183a30 con 0x7f1320072e30 2024-02-21T23:13:04.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:04.067+0000 7f131f200640 1 -- 172.21.15.99:0/3868389041 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1320068320 con 0x7f1320072e30 2024-02-21T23:13:04.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:04.071+0000 7f1316000640 1 -- 172.21.15.99:0/3868389041 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f131001a070 con 0x7f1320072e30 2024-02-21T23:13:04.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:04.073+0000 7f1316000640 1 --2- 172.21.15.99:0/3868389041 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f130009eed0 0x7f13000a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:04.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:04.073+0000 7f1316000640 1 -- 172.21.15.99:0/3868389041 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 8965+0+0 (secure 0 0 0) 0x7f13100c90e0 con 0x7f1320072e30 2024-02-21T23:13:04.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:04.073+0000 7f131d400640 1 --2- 172.21.15.99:0/3868389041 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f130009eed0 0x7f13000a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:04.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:04.074+0000 7f131d400640 1 --2- 172.21.15.99:0/3868389041 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f130009eed0 0x7f13000a1390 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f130c0090b0 tx=0x7f130c03b040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:04.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:04.076+0000 7f1316000640 1 -- 172.21.15.99:0/3868389041 <== mon.2 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f1310096a70 con 0x7f1320072e30 2024-02-21T23:13:04.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:04.332+0000 7f131f200640 1 -- 172.21.15.99:0/3868389041 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f132006dfb0 con 0x7f1320072e30 2024-02-21T23:13:04.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:04.333+0000 7f1316000640 1 -- 172.21.15.99:0/3868389041 <== mon.2 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+24518 (secure 0 0 0) 0x7f131009ab10 con 0x7f1320072e30 2024-02-21T23:13:04.322 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T23:13:04.322 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":41,"fsid":"e8af98cd-45a1-425f-96a7-f24da8ee4efb","created":"2024-02-21T23:00:44.699708+0000","modified":"2024-02-21T23:13:03.294168+0000","last_up_change":"2024-02-21T23:00:55.749829+0000","last_in_change":"2024-02-21T23:00:48.332297+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T23:00:57.020557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":11.760000228881836,"score_stable":11.760000228881836,"optimal_score":0.17000000178813934,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-21T23:01:01.124398+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-21T23:01:01.684258+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-21T23:01:05.290089+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c49de9b2-dc53-4882-b14c-7059ed40bf59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6809","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6811","nonce":1026112937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6813","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6815","nonce":1026112937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6823","nonce":1026112937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6819","nonce":1026112937}]},"public_addr":"172.21.15.99:6811/1026112937","cluster_addr":"172.21.15.99:6815/1026112937","heartbeat_back_addr":"172.21.15.99:6823/1026112937","heartbeat_front_addr":"172.21.15.99:6819/1026112937","state":["exists","up"]},{"osd":1,"uuid":"58398292-2fe5-4291-94fd-03a0ca29d49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6827","nonce":3030871566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6829","nonce":3030871566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6833","nonce":3030871566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6831","nonce":3030871566}]},"public_addr":"172.21.15.162:6827/3030871566","cluster_addr":"172.21.15.162:6829/3030871566","heartbeat_back_addr":"172.21.15.162:6833/3030871566","heartbeat_front_addr":"172.21.15.162:6831/3030871566","state":["exists","up"]},{"osd":2,"uuid":"94cddec1-e08f-438d-a7c8-48a0e47d71a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6818","nonce":2782386148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6821","nonce":2782386148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6827","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6829","nonce":2782386148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6823","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6825","nonce":2782386148}]},"public_addr":"172.21.15.181:6818/2782386148","cluster_addr":"172.21.15.181:6821/2782386148","heartbeat_back_addr":"172.21.15.181:6829/2782386148","heartbeat_front_addr":"172.21.15.181:6825/2782386148","state":["exists","up"]},{"osd":3,"uuid":"d29abb74-9b89-4fd7-88b1-7c2eb8231189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6801","nonce":2316185310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6803","nonce":2316185310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6807","nonce":2316185310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6805","nonce":2316185310}]},"public_addr":"172.21.15.99:6801/2316185310","cluster_addr":"172.21.15.99:6803/2316185310","heartbeat_back_addr":"172.21.15.99:6807/2316185310","heartbeat_front_addr":"172.21.15.99:6805/2316185310","state":["exists","up"]},{"osd":4,"uuid":"0d8c9ea3-880a-4d69-9dcb-cf7d35abd449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6811","nonce":3137681258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6813","nonce":3137681258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6817","nonce":3137681258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6815","nonce":3137681258}]},"public_addr":"172.21.15.162:6811/3137681258","cluster_addr":"172.21.15.162:6813/3137681258","heartbeat_back_addr":"172.21.15.162:6817/3137681258","heartbeat_front_addr":"172.21.15.162:6815/3137681258","state":["exists","up"]},{"osd":5,"uuid":"2e3a9340-6fd0-4d7a-8e00-fe305649296e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6801","nonce":2011264527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6803","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6805","nonce":2011264527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6811","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6813","nonce":2011264527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6807","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6809","nonce":2011264527}]},"public_addr":"172.21.15.181:6801/2011264527","cluster_addr":"172.21.15.181:6805/2011264527","heartbeat_back_addr":"172.21.15.181:6813/2011264527","heartbeat_front_addr":"172.21.15.181:6809/2011264527","state":["exists","up"]},{"osd":6,"uuid":"d9e37ce7-1b0e-4019-8f2e-b670403abf7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6810","nonce":753870050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6814","nonce":753870050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6822","nonce":753870050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6818","nonce":753870050}]},"public_addr":"172.21.15.99:6810/753870050","cluster_addr":"172.21.15.99:6814/753870050","heartbeat_back_addr":"172.21.15.99:6822/753870050","heartbeat_front_addr":"172.21.15.99:6818/753870050","state":["exists","up"]},{"osd":7,"uuid":"49988754-232e-4b8c-bd72-bfa25b418e5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6803","nonce":1659412949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6805","nonce":1659412949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6809","nonce":1659412949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6807","nonce":1659412949}]},"public_addr":"172.21.15.162:6803/1659412949","cluster_addr":"172.21.15.162:6805/1659412949","heartbeat_back_addr":"172.21.15.162:6809/1659412949","heartbeat_front_addr":"172.21.15.162:6807/1659412949","state":["exists","up"]},{"osd":8,"uuid":"ebc6e462-8368-4d64-b242-9c8735ac672c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6804","nonce":3389807042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6808","nonce":3389807042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6815","nonce":3389807042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6812","nonce":3389807042}]},"public_addr":"172.21.15.181:6804/3389807042","cluster_addr":"172.21.15.181:6808/3389807042","heartbeat_back_addr":"172.21.15.181:6815/3389807042","heartbeat_front_addr":"172.21.15.181:6812/3389807042","state":["exists","up"]},{"osd":9,"uuid":"72af1b02-b965-4d6a-8964-527ec24c4daa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6825","nonce":4055669590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6827","nonce":4055669590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6831","nonce":4055669590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6829","nonce":4055669590}]},"public_addr":"172.21.15.99:6825/4055669590","cluster_addr":"172.21.15.99:6827/4055669590","heartbeat_back_addr":"172.21.15.99:6831/4055669590","heartbeat_front_addr":"172.21.15.99:6829/4055669590","state":["exists","up"]},{"osd":10,"uuid":"adb5cb06-6453-41e4-b847-d7c78bbb7d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6819","nonce":1421879617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6821","nonce":1421879617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6825","nonce":1421879617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6823","nonce":1421879617}]},"public_addr":"172.21.15.162:6819/1421879617","cluster_addr":"172.21.15.162:6821/1421879617","heartbeat_back_addr":"172.21.15.162:6825/1421879617","heartbeat_front_addr":"172.21.15.162:6823/1421879617","state":["exists","up"]},{"osd":11,"uuid":"118563d9-1e8f-4dc7-a92c-2f4c4dc3e20f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6817","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6819","nonce":3219928272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6824","nonce":3219928272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6831","nonce":3219928272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6828","nonce":3219928272}]},"public_addr":"172.21.15.181:6819/3219928272","cluster_addr":"172.21.15.181:6824/3219928272","heartbeat_back_addr":"172.21.15.181:6831/3219928272","heartbeat_front_addr":"172.21.15.181:6828/3219928272","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.651219+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.549859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.529659+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.591004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.440836+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.414250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.630130+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.411954+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.439371+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.428173+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.511203+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.482806+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.6","mappings":[{"from":9,"to":11}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.14","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.162:0/612025202":"2024-02-22T23:02:14.008014+0000","172.21.15.162:0/1516346096":"2024-02-22T23:02:14.008014+0000","172.21.15.162:0/328516024":"2024-02-22T23:02:14.008014+0000","172.21.15.162:0/3695581546":"2024-02-22T23:02:14.008014+0000","172.21.15.162:6801/1717094936":"2024-02-22T23:02:14.008014+0000","172.21.15.162:0/506228072":"2024-02-22T23:02:14.008014+0000","172.21.15.162:6800/1717094936":"2024-02-22T23:02:14.008014+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]},{"pool":4,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]}],"new_removed_snaps":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]},{"pool":4,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T23:13:04.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:04.337+0000 7f131f200640 1 -- 172.21.15.99:0/3868389041 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f130009eed0 msgr2=0x7f13000a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:04.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:04.337+0000 7f131f200640 1 --2- 172.21.15.99:0/3868389041 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f130009eed0 0x7f13000a1390 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f130c0090b0 tx=0x7f130c03b040 comp rx=0 tx=0).stop 2024-02-21T23:13:04.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:04.337+0000 7f131f200640 1 -- 172.21.15.99:0/3868389041 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1320072e30 msgr2=0x7f132021edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:04.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:04.337+0000 7f131f200640 1 --2- 172.21.15.99:0/3868389041 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1320072e30 0x7f132021edd0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f131000c3e0 tx=0x7f131000c8a0 comp rx=0 tx=0).stop 2024-02-21T23:13:04.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:04.337+0000 7f131f200640 1 -- 172.21.15.99:0/3868389041 shutdown_connections 2024-02-21T23:13:04.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:04.337+0000 7f131f200640 1 --2- 172.21.15.99:0/3868389041 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f130009eed0 0x7f13000a1390 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:04.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:04.337+0000 7f131f200640 1 --2- 172.21.15.99:0/3868389041 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1320188d20 0x7f132015e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:04.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:04.337+0000 7f131f200640 1 --2- 172.21.15.99:0/3868389041 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f13200732b0 0x7f132015dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:04.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:04.337+0000 7f131f200640 1 --2- 172.21.15.99:0/3868389041 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1320072e30 0x7f132021edd0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:04.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:04.337+0000 7f131f200640 1 -- 172.21.15.99:0/3868389041 >> 172.21.15.99:0/3868389041 conn(0x7f132006e210 msgr2=0x7f1320066c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:04.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:04.337+0000 7f131f200640 1 -- 172.21.15.99:0/3868389041 shutdown_connections 2024-02-21T23:13:04.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:04.337+0000 7f131f200640 1 -- 172.21.15.99:0/3868389041 wait complete. 2024-02-21T23:13:05.348 INFO:tasks.ceph:Scrubbing osd.0 2024-02-21T23:13:05.348 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-02-21T23:13:05.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.617+0000 7fab2ac00640 1 Processor -- start 2024-02-21T23:13:05.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.617+0000 7fab2ac00640 1 -- start start 2024-02-21T23:13:05.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.620+0000 7fab2ac00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fab24188d00 0x7fab24073030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:05.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.620+0000 7fab2ac00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fab24183d90 0x7fab241890e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:05.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.620+0000 7fab2ac00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab24187600 con 0x7fab24186c00 2024-02-21T23:13:05.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.620+0000 7fab2ac00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab24073570 con 0x7fab24188d00 2024-02-21T23:13:05.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.620+0000 7fab2ac00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab241878e0 con 0x7fab24183d90 2024-02-21T23:13:05.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.620+0000 7fab29800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fab24188d00 0x7fab24073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:05.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.621+0000 7fab2a200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fab24183d90 0x7fab241890e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:05.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.621+0000 7fab29800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fab24188d00 0x7fab24073030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53204/0 (socket says 172.21.15.99:53204) 2024-02-21T23:13:05.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.621+0000 7fab29800640 1 -- 172.21.15.99:0/1953579767 learned_addr learned my addr 172.21.15.99:0/1953579767 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:13:05.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.621+0000 7fab28e00640 1 --1- 172.21.15.99:0/1953579767 >> v1:172.21.15.162:6789/0 conn(0x7fab24186c00 0x7fab24183680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.99:45798/0 (socket says 172.21.15.99:45798) 2024-02-21T23:13:05.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.621+0000 7fab2a200640 1 -- 172.21.15.99:0/1953579767 >> v2:172.21.15.99:3300/0 conn(0x7fab24188d00 msgr2=0x7fab24073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:13:05.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.621+0000 7fab2a200640 1 --2- 172.21.15.99:0/1953579767 >> v2:172.21.15.99:3300/0 conn(0x7fab24188d00 0x7fab24073030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:05.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.621+0000 7fab2a200640 1 -- 172.21.15.99:0/1953579767 >> v1:172.21.15.162:6789/0 conn(0x7fab24186c00 legacy=0x7fab24183680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:05.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.621+0000 7fab23e00640 1 -- 172.21.15.99:0/1953579767 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2879006261 0 0) 0x7fab24187600 con 0x7fab24186c00 2024-02-21T23:13:05.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.621+0000 7fab2a200640 1 -- 172.21.15.99:0/1953579767 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab24187bc0 con 0x7fab24183d90 2024-02-21T23:13:05.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.622+0000 7fab2a200640 1 --2- 172.21.15.99:0/1953579767 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab24183d90 0x7fab241890e0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fab2408f880 tx=0x7fab1c02bdb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a87940debf54918 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:05.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.622+0000 7fab23e00640 1 -- 172.21.15.99:0/1953579767 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab1c039070 con 0x7fab24183d90 2024-02-21T23:13:05.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.622+0000 7fab23e00640 1 -- 172.21.15.99:0/1953579767 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab1c02cb60 con 0x7fab24183d90 2024-02-21T23:13:05.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.622+0000 7fab23e00640 1 -- 172.21.15.99:0/1953579767 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab1c034440 con 0x7fab24183d90 2024-02-21T23:13:05.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.623+0000 7fab2ac00640 1 -- 172.21.15.99:0/1953579767 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab24183d90 msgr2=0x7fab241890e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:05.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.623+0000 7fab2ac00640 1 --2- 172.21.15.99:0/1953579767 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab24183d90 0x7fab241890e0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fab2408f880 tx=0x7fab1c02bdb0 comp rx=0 tx=0).stop 2024-02-21T23:13:05.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.623+0000 7fab2ac00640 1 -- 172.21.15.99:0/1953579767 shutdown_connections 2024-02-21T23:13:05.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.623+0000 7fab2ac00640 1 --2- 172.21.15.99:0/1953579767 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab24183d90 0x7fab241890e0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:05.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.623+0000 7fab2ac00640 1 --2- 172.21.15.99:0/1953579767 >> v2:172.21.15.99:3300/0 conn(0x7fab24188d00 0x7fab24073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:05.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.623+0000 7fab2ac00640 1 -- 172.21.15.99:0/1953579767 >> 172.21.15.99:0/1953579767 conn(0x7fab2406e210 msgr2=0x7fab2406e620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:05.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.623+0000 7fab2ac00640 1 -- 172.21.15.99:0/1953579767 shutdown_connections 2024-02-21T23:13:05.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.623+0000 7fab2ac00640 1 -- 172.21.15.99:0/1953579767 wait complete. 2024-02-21T23:13:05.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.626+0000 7fab2ac00640 1 Processor -- start 2024-02-21T23:13:05.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.627+0000 7fab2ac00640 1 -- start start 2024-02-21T23:13:05.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.629+0000 7fab2ac00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fab24183d90 0x7fab2421c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:05.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.629+0000 7fab2ac00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab24186c00 0x7fab2408dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:05.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.629+0000 7fab2ac00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab24188d00 0x7fab2418e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:05.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.629+0000 7fab2ac00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab24188460 con 0x7fab24186c00 2024-02-21T23:13:05.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.629+0000 7fab2ac00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab24188180 con 0x7fab24188d00 2024-02-21T23:13:05.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.629+0000 7fab2ac00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab24188980 con 0x7fab24183d90 2024-02-21T23:13:05.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.629+0000 7fab28e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab24186c00 0x7fab2408dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:05.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.629+0000 7fab28e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab24186c00 0x7fab2408dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53210/0 (socket says 172.21.15.99:53210) 2024-02-21T23:13:05.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.629+0000 7fab28e00640 1 -- 172.21.15.99:0/2252238262 learned_addr learned my addr 172.21.15.99:0/2252238262 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:13:05.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.629+0000 7fab29800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fab24183d90 0x7fab2421c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:05.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.629+0000 7fab2a200640 1 --2- 172.21.15.99:0/2252238262 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab24188d00 0x7fab2418e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:05.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.629+0000 7fab28e00640 1 -- 172.21.15.99:0/2252238262 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fab24183d90 msgr2=0x7fab2421c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:05.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.629+0000 7fab28e00640 1 --2- 172.21.15.99:0/2252238262 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fab24183d90 0x7fab2421c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:05.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.629+0000 7fab28e00640 1 -- 172.21.15.99:0/2252238262 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab24188d00 msgr2=0x7fab2418e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:05.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.629+0000 7fab28e00640 1 --2- 172.21.15.99:0/2252238262 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab24188d00 0x7fab2418e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:05.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.629+0000 7fab28e00640 1 -- 172.21.15.99:0/2252238262 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab2421f320 con 0x7fab24186c00 2024-02-21T23:13:05.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.630+0000 7fab2a200640 1 --2- 172.21.15.99:0/2252238262 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab24188d00 0x7fab2418e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:13:05.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.630+0000 7fab28e00640 1 --2- 172.21.15.99:0/2252238262 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab24186c00 0x7fab2408dbe0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fab1000c3f0 tx=0x7fab1000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:05.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.630+0000 7fab21600640 1 -- 172.21.15.99:0/2252238262 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab100074e0 con 0x7fab24186c00 2024-02-21T23:13:05.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.630+0000 7fab21600640 1 -- 172.21.15.99:0/2252238262 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab100047e0 con 0x7fab24186c00 2024-02-21T23:13:05.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.630+0000 7fab21600640 1 -- 172.21.15.99:0/2252238262 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab10004c10 con 0x7fab24186c00 2024-02-21T23:13:05.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.630+0000 7fab2ac00640 1 -- 172.21.15.99:0/2252238262 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab2421f600 con 0x7fab24186c00 2024-02-21T23:13:05.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.630+0000 7fab2ac00640 1 -- 172.21.15.99:0/2252238262 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab2421fbc0 con 0x7fab24186c00 2024-02-21T23:13:05.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.631+0000 7fab2ac00640 1 -- 172.21.15.99:0/2252238262 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fab240682b0 con 0x7fab24186c00 2024-02-21T23:13:05.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.635+0000 7fab21600640 1 -- 172.21.15.99:0/2252238262 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7fab10011070 con 0x7fab24186c00 2024-02-21T23:13:05.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.637+0000 7fab21600640 1 --2- 172.21.15.99:0/2252238262 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fab0409eed0 0x7fab040a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:05.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.637+0000 7fab21600640 1 -- 172.21.15.99:0/2252238262 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 8965+0+0 (secure 0 0 0) 0x7fab100ca330 con 0x7fab24186c00 2024-02-21T23:13:05.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.637+0000 7fab29800640 1 --2- 172.21.15.99:0/2252238262 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fab0409eed0 0x7fab040a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:05.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.637+0000 7fab21600640 1 --2- 172.21.15.99:0/2252238262 >> [v2:172.21.15.99:6809/1026112937,v1:172.21.15.99:6811/1026112937] conn(0x7fab040a9f00 0x7fab040ac380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:05.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.637+0000 7fab21600640 1 -- 172.21.15.99:0/2252238262 --> [v2:172.21.15.99:6809/1026112937,v1:172.21.15.99:6811/1026112937] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fab10009e50 con 0x7fab040a9f00 2024-02-21T23:13:05.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.637+0000 7fab21600640 1 -- 172.21.15.99:0/2252238262 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fab100ca6e0 con 0x7fab24186c00 2024-02-21T23:13:05.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.637+0000 7fab2a200640 1 --2- 172.21.15.99:0/2252238262 >> [v2:172.21.15.99:6809/1026112937,v1:172.21.15.99:6811/1026112937] conn(0x7fab040a9f00 0x7fab040ac380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:05.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.638+0000 7fab29800640 1 --2- 172.21.15.99:0/2252238262 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fab0409eed0 0x7fab040a1390 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fab18009b30 tx=0x7fab18009240 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:05.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.638+0000 7fab2a200640 1 --2- 172.21.15.99:0/2252238262 >> [v2:172.21.15.99:6809/1026112937,v1:172.21.15.99:6811/1026112937] conn(0x7fab040a9f00 0x7fab040ac380 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:05.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.639+0000 7fab21600640 1 -- 172.21.15.99:0/2252238262 <== osd.0 v2:172.21.15.99:6809/1026112937 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fab10009e50 con 0x7fab040a9f00 2024-02-21T23:13:05.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.668+0000 7fab2ac00640 1 -- 172.21.15.99:0/2252238262 --> [v2:172.21.15.99:6809/1026112937,v1:172.21.15.99:6811/1026112937] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fab24183a40 con 0x7fab040a9f00 2024-02-21T23:13:05.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.668+0000 7fab21600640 1 -- 172.21.15.99:0/2252238262 <== osd.0 v2:172.21.15.99:6809/1026112937 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fab24183a40 con 0x7fab040a9f00 2024-02-21T23:13:05.656 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-02-21T23:13:05.656 INFO:teuthology.orchestra.run.smithi099.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-21T23:13:05.657 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-02-21T23:13:05.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.669+0000 7fab2ac00640 1 -- 172.21.15.99:0/2252238262 >> [v2:172.21.15.99:6809/1026112937,v1:172.21.15.99:6811/1026112937] conn(0x7fab040a9f00 msgr2=0x7fab040ac380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:05.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.669+0000 7fab2ac00640 1 --2- 172.21.15.99:0/2252238262 >> [v2:172.21.15.99:6809/1026112937,v1:172.21.15.99:6811/1026112937] conn(0x7fab040a9f00 0x7fab040ac380 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:05.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.669+0000 7fab2ac00640 1 -- 172.21.15.99:0/2252238262 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fab0409eed0 msgr2=0x7fab040a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:05.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.669+0000 7fab2ac00640 1 --2- 172.21.15.99:0/2252238262 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fab0409eed0 0x7fab040a1390 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fab18009b30 tx=0x7fab18009240 comp rx=0 tx=0).stop 2024-02-21T23:13:05.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.669+0000 7fab2ac00640 1 -- 172.21.15.99:0/2252238262 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab24186c00 msgr2=0x7fab2408dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:05.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.669+0000 7fab2ac00640 1 --2- 172.21.15.99:0/2252238262 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fab24186c00 0x7fab2408dbe0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fab1000c3f0 tx=0x7fab1000c8b0 comp rx=0 tx=0).stop 2024-02-21T23:13:05.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.669+0000 7fab2a200640 1 -- 172.21.15.99:0/2252238262 reap_dead start 2024-02-21T23:13:05.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.669+0000 7fab2ac00640 1 -- 172.21.15.99:0/2252238262 shutdown_connections 2024-02-21T23:13:05.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.669+0000 7fab2ac00640 1 -- 172.21.15.99:0/2252238262 >> 172.21.15.99:0/2252238262 conn(0x7fab2406e210 msgr2=0x7fab2416ff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:05.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.669+0000 7fab2ac00640 1 -- 172.21.15.99:0/2252238262 shutdown_connections 2024-02-21T23:13:05.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.669+0000 7fab2ac00640 1 -- 172.21.15.99:0/2252238262 wait complete. 2024-02-21T23:13:05.672 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-02-21T23:13:05.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.919+0000 7f888b200640 1 Processor -- start 2024-02-21T23:13:05.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.919+0000 7f888b200640 1 -- start start 2024-02-21T23:13:05.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.921+0000 7f888b200640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f888c188a90 0x7f888c0fca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:05.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.921+0000 7f888b200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f888c0fcf40 0x7f888c188e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:05.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.921+0000 7f888b200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f888c187ae0 con 0x7f888c1893b0 2024-02-21T23:13:05.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.921+0000 7f888b200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f888c0d0820 con 0x7f888c0fcf40 2024-02-21T23:13:05.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.921+0000 7f888b200640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f888c187dc0 con 0x7f888c188a90 2024-02-21T23:13:05.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.922+0000 7f8889e00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f888c188a90 0x7f888c0fca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:05.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.922+0000 7f8889400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f888c0fcf40 0x7f888c188e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:05.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.922+0000 7f8889e00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f888c188a90 0x7f888c0fca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:53686/0 (socket says 172.21.15.99:53686) 2024-02-21T23:13:05.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.922+0000 7f8889e00640 1 -- 172.21.15.99:0/2795273378 learned_addr learned my addr 172.21.15.99:0/2795273378 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:13:05.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.922+0000 7f8889e00640 1 -- 172.21.15.99:0/2795273378 >> v2:172.21.15.162:3300/0 conn(0x7f888c0fcf40 msgr2=0x7f888c188e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:13:05.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.922+0000 7f8889e00640 1 --2- 172.21.15.99:0/2795273378 >> v2:172.21.15.162:3300/0 conn(0x7f888c0fcf40 0x7f888c188e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:05.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.922+0000 7f8889e00640 1 -- 172.21.15.99:0/2795273378 >> v1:172.21.15.162:6789/0 conn(0x7f888c1893b0 legacy=0x7f888c0d0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:05.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.922+0000 7f8889e00640 1 -- 172.21.15.99:0/2795273378 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f888c1880a0 con 0x7f888c188a90 2024-02-21T23:13:05.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.924+0000 7f8889e00640 1 --2- 172.21.15.99:0/2795273378 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f888c188a90 0x7f888c0fca00 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f888c0d3990 tx=0x7f887c02b9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12a6b14530e5e1ba server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:05.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.924+0000 7f8888a00640 1 -- 172.21.15.99:0/2795273378 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f887c034070 con 0x7f888c188a90 2024-02-21T23:13:05.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.924+0000 7f8888a00640 1 -- 172.21.15.99:0/2795273378 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f887c030860 con 0x7f888c188a90 2024-02-21T23:13:05.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.924+0000 7f8888a00640 1 -- 172.21.15.99:0/2795273378 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f887c030c30 con 0x7f888c188a90 2024-02-21T23:13:05.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.925+0000 7f888b200640 1 -- 172.21.15.99:0/2795273378 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f888c188a90 msgr2=0x7f888c0fca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:05.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.925+0000 7f888b200640 1 --2- 172.21.15.99:0/2795273378 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f888c188a90 0x7f888c0fca00 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f888c0d3990 tx=0x7f887c02b9a0 comp rx=0 tx=0).stop 2024-02-21T23:13:05.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.925+0000 7f888b200640 1 -- 172.21.15.99:0/2795273378 shutdown_connections 2024-02-21T23:13:05.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.925+0000 7f888b200640 1 --2- 172.21.15.99:0/2795273378 >> v2:172.21.15.162:3300/0 conn(0x7f888c0fcf40 0x7f888c188e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:05.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.925+0000 7f888b200640 1 --2- 172.21.15.99:0/2795273378 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f888c188a90 0x7f888c0fca00 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:05.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.925+0000 7f888b200640 1 -- 172.21.15.99:0/2795273378 >> 172.21.15.99:0/2795273378 conn(0x7f888c0fe3d0 msgr2=0x7f888c0fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:05.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.925+0000 7f888b200640 1 -- 172.21.15.99:0/2795273378 shutdown_connections 2024-02-21T23:13:05.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.925+0000 7f888b200640 1 -- 172.21.15.99:0/2795273378 wait complete. 2024-02-21T23:13:05.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.928+0000 7f888b200640 1 Processor -- start 2024-02-21T23:13:05.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.929+0000 7f888b200640 1 -- start start 2024-02-21T23:13:05.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.931+0000 7f888b200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f888c0fcf40 0x7f888c161be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:05.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.931+0000 7f888b200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f888c188a90 0x7f888c21f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:05.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.931+0000 7f888b200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f888c1893b0 0x7f888c21f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:05.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.931+0000 7f888b200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f888c164aa0 con 0x7f888c1893b0 2024-02-21T23:13:05.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.931+0000 7f888b200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f888c188660 con 0x7f888c0fcf40 2024-02-21T23:13:05.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.931+0000 7f888b200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f888c189860 con 0x7f888c188a90 2024-02-21T23:13:05.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.931+0000 7f8889e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f888c0fcf40 0x7f888c161be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:05.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.931+0000 7f8889e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f888c0fcf40 0x7f888c161be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:54372/0 (socket says 172.21.15.99:54372) 2024-02-21T23:13:05.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.931+0000 7f8889e00640 1 -- 172.21.15.99:0/156356294 learned_addr learned my addr 172.21.15.99:0/156356294 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:13:05.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.931+0000 7f888a800640 1 --2- 172.21.15.99:0/156356294 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f888c1893b0 0x7f888c21f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:05.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.931+0000 7f8889400640 1 --2- 172.21.15.99:0/156356294 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f888c188a90 0x7f888c21f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:05.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.932+0000 7f8889e00640 1 -- 172.21.15.99:0/156356294 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f888c188a90 msgr2=0x7f888c21f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:05.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.932+0000 7f8889e00640 1 --2- 172.21.15.99:0/156356294 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f888c188a90 0x7f888c21f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:05.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.932+0000 7f8889e00640 1 -- 172.21.15.99:0/156356294 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f888c1893b0 msgr2=0x7f888c21f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:05.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.932+0000 7f8889e00640 1 --2- 172.21.15.99:0/156356294 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f888c1893b0 0x7f888c21f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:05.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.932+0000 7f8889e00640 1 -- 172.21.15.99:0/156356294 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f888c17d510 con 0x7f888c0fcf40 2024-02-21T23:13:05.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.932+0000 7f8889e00640 1 --2- 172.21.15.99:0/156356294 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f888c0fcf40 0x7f888c161be0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f887c000c00 tx=0x7f887c004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:05.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.932+0000 7f8882000640 1 -- 172.21.15.99:0/156356294 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f887c048070 con 0x7f888c0fcf40 2024-02-21T23:13:05.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.932+0000 7f8882000640 1 -- 172.21.15.99:0/156356294 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f887c030660 con 0x7f888c0fcf40 2024-02-21T23:13:05.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.932+0000 7f888b200640 1 -- 172.21.15.99:0/156356294 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f888c17d7f0 con 0x7f888c0fcf40 2024-02-21T23:13:05.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.932+0000 7f8882000640 1 -- 172.21.15.99:0/156356294 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f887c034040 con 0x7f888c0fcf40 2024-02-21T23:13:05.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.933+0000 7f888b200640 1 -- 172.21.15.99:0/156356294 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f888c17ddb0 con 0x7f888c0fcf40 2024-02-21T23:13:05.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.934+0000 7f888b200640 1 -- 172.21.15.99:0/156356294 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f888c068320 con 0x7f888c0fcf40 2024-02-21T23:13:05.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.937+0000 7f8882000640 1 -- 172.21.15.99:0/156356294 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f887c04b070 con 0x7f888c0fcf40 2024-02-21T23:13:05.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.938+0000 7f8882000640 1 --2- 172.21.15.99:0/156356294 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f886c09eed0 0x7f886c0a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:05.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.939+0000 7f8882000640 1 -- 172.21.15.99:0/156356294 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 8965+0+0 (secure 0 0 0) 0x7f887c0ec250 con 0x7f888c0fcf40 2024-02-21T23:13:05.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.939+0000 7f8889400640 1 --2- 172.21.15.99:0/156356294 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f886c09eed0 0x7f886c0a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:05.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.939+0000 7f8882000640 1 -- 172.21.15.99:0/156356294 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f887c0b99e0 con 0x7f888c0fcf40 2024-02-21T23:13:05.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:05.939+0000 7f8889400640 1 --2- 172.21.15.99:0/156356294 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f886c09eed0 0x7f886c0a1390 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f888c18b240 tx=0x7f8878009190 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:06.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.136+0000 7f888b200640 1 -- 172.21.15.99:0/156356294 --> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f888c21fc30 con 0x7f886c09eed0 2024-02-21T23:13:06.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.136+0000 7f8882000640 1 -- 172.21.15.99:0/156356294 <== mgr.5131 v2:172.21.15.162:6800/631076050 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f888c21fc30 con 0x7f886c09eed0 2024-02-21T23:13:06.124 INFO:teuthology.orchestra.run.smithi099.stderr:instructed osd(s) 0 to deep-scrub 2024-02-21T23:13:06.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.140+0000 7f888b200640 1 -- 172.21.15.99:0/156356294 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f886c09eed0 msgr2=0x7f886c0a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:06.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.140+0000 7f888b200640 1 --2- 172.21.15.99:0/156356294 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f886c09eed0 0x7f886c0a1390 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f888c18b240 tx=0x7f8878009190 comp rx=0 tx=0).stop 2024-02-21T23:13:06.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.140+0000 7f888b200640 1 -- 172.21.15.99:0/156356294 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f888c0fcf40 msgr2=0x7f888c161be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:06.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.140+0000 7f888b200640 1 --2- 172.21.15.99:0/156356294 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f888c0fcf40 0x7f888c161be0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f887c000c00 tx=0x7f887c004730 comp rx=0 tx=0).stop 2024-02-21T23:13:06.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.140+0000 7f888b200640 1 -- 172.21.15.99:0/156356294 shutdown_connections 2024-02-21T23:13:06.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.140+0000 7f888b200640 1 --2- 172.21.15.99:0/156356294 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f886c09eed0 0x7f886c0a1390 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:06.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.140+0000 7f888b200640 1 --2- 172.21.15.99:0/156356294 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f888c1893b0 0x7f888c21f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:06.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.140+0000 7f888b200640 1 --2- 172.21.15.99:0/156356294 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f888c188a90 0x7f888c21f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:06.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.140+0000 7f888b200640 1 --2- 172.21.15.99:0/156356294 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f888c0fcf40 0x7f888c161be0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:06.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.140+0000 7f888b200640 1 -- 172.21.15.99:0/156356294 >> 172.21.15.99:0/156356294 conn(0x7f888c0fe3d0 msgr2=0x7f888c0fc830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:06.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.140+0000 7f888b200640 1 -- 172.21.15.99:0/156356294 shutdown_connections 2024-02-21T23:13:06.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.140+0000 7f888b200640 1 -- 172.21.15.99:0/156356294 wait complete. 2024-02-21T23:13:06.155 INFO:tasks.ceph:Scrubbing osd.3 2024-02-21T23:13:06.155 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-02-21T23:13:06.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.356+0000 7fa3f0400640 1 Processor -- start 2024-02-21T23:13:06.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.357+0000 7fa3f0400640 1 -- start start 2024-02-21T23:13:06.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.360+0000 7fa3f0400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa3e815e250 0x7fa3e818a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:06.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.361+0000 7fa3f0400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa3e818bcf0 0x7fa3e818c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:06.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.361+0000 7fa3f0400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3e818a970 con 0x7fa3e815de70 2024-02-21T23:13:06.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.361+0000 7fa3f0400640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3e818c180 con 0x7fa3e818bcf0 2024-02-21T23:13:06.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.361+0000 7fa3f0400640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3e818b860 con 0x7fa3e815e250 2024-02-21T23:13:06.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.361+0000 7fa3ee400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa3e818bcf0 0x7fa3e818c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:06.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.361+0000 7fa3ed000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa3e815e250 0x7fa3e818a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:06.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.361+0000 7fa3ee400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fa3e818bcf0 0x7fa3e818c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53234/0 (socket says 172.21.15.99:53234) 2024-02-21T23:13:06.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.361+0000 7fa3ee400640 1 -- 172.21.15.99:0/4093146808 learned_addr learned my addr 172.21.15.99:0/4093146808 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:13:06.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.361+0000 7fa3ed000640 1 -- 172.21.15.99:0/4093146808 >> v2:172.21.15.99:3300/0 conn(0x7fa3e818bcf0 msgr2=0x7fa3e818c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:13:06.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.361+0000 7fa3ed000640 1 --2- 172.21.15.99:0/4093146808 >> v2:172.21.15.99:3300/0 conn(0x7fa3e818bcf0 0x7fa3e818c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:06.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.361+0000 7fa3ed000640 1 -- 172.21.15.99:0/4093146808 >> v1:172.21.15.162:6789/0 conn(0x7fa3e815de70 legacy=0x7fa3e8186d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:06.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.362+0000 7fa3e7e00640 1 -- 172.21.15.99:0/4093146808 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 362476042 0 0) 0x7fa3e818a970 con 0x7fa3e815de70 2024-02-21T23:13:06.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.362+0000 7fa3ed000640 1 -- 172.21.15.99:0/4093146808 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3e818ac50 con 0x7fa3e815e250 2024-02-21T23:13:06.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.363+0000 7fa3ed000640 1 --2- 172.21.15.99:0/4093146808 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3e815e250 0x7fa3e818a310 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fa3e808d8d0 tx=0x7fa3d402b7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38d987abbf4ef955 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:06.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.363+0000 7fa3e7e00640 1 -- 172.21.15.99:0/4093146808 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d4038070 con 0x7fa3e815e250 2024-02-21T23:13:06.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.363+0000 7fa3e7e00640 1 -- 172.21.15.99:0/4093146808 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3d4031710 con 0x7fa3e815e250 2024-02-21T23:13:06.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.363+0000 7fa3e7e00640 1 -- 172.21.15.99:0/4093146808 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d4031ae0 con 0x7fa3e815e250 2024-02-21T23:13:06.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.364+0000 7fa3f0400640 1 -- 172.21.15.99:0/4093146808 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3e815e250 msgr2=0x7fa3e818a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:06.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.364+0000 7fa3f0400640 1 --2- 172.21.15.99:0/4093146808 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3e815e250 0x7fa3e818a310 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fa3e808d8d0 tx=0x7fa3d402b7b0 comp rx=0 tx=0).stop 2024-02-21T23:13:06.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.364+0000 7fa3f0400640 1 -- 172.21.15.99:0/4093146808 shutdown_connections 2024-02-21T23:13:06.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.364+0000 7fa3f0400640 1 --2- 172.21.15.99:0/4093146808 >> v2:172.21.15.99:3300/0 conn(0x7fa3e818bcf0 0x7fa3e818c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:06.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.364+0000 7fa3f0400640 1 --2- 172.21.15.99:0/4093146808 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3e815e250 0x7fa3e818a310 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:06.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.364+0000 7fa3f0400640 1 -- 172.21.15.99:0/4093146808 >> 172.21.15.99:0/4093146808 conn(0x7fa3e80740b0 msgr2=0x7fa3e80744c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:06.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.364+0000 7fa3f0400640 1 -- 172.21.15.99:0/4093146808 shutdown_connections 2024-02-21T23:13:06.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.364+0000 7fa3f0400640 1 -- 172.21.15.99:0/4093146808 wait complete. 2024-02-21T23:13:06.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.367+0000 7fa3f0400640 1 Processor -- start 2024-02-21T23:13:06.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.368+0000 7fa3f0400640 1 -- start start 2024-02-21T23:13:06.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.370+0000 7fa3f0400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3e815de70 0x7fa3e821fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:06.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.370+0000 7fa3f0400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3e818bcf0 0x7fa3e8221790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:06.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.370+0000 7fa3f0400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa3e8157e30 0x7fa3e821c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:06.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.370+0000 7fa3f0400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e818b4f0 con 0x7fa3e815de70 2024-02-21T23:13:06.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.370+0000 7fa3f0400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e818b210 con 0x7fa3e818bcf0 2024-02-21T23:13:06.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.370+0000 7fa3f0400640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e8189d50 con 0x7fa3e8157e30 2024-02-21T23:13:06.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.370+0000 7fa3eda00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3e815de70 0x7fa3e821fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:06.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.370+0000 7fa3eda00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3e815de70 0x7fa3e821fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53244/0 (socket says 172.21.15.99:53244) 2024-02-21T23:13:06.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.370+0000 7fa3eda00640 1 -- 172.21.15.99:0/823765797 learned_addr learned my addr 172.21.15.99:0/823765797 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:13:06.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.370+0000 7fa3ed000640 1 --2- 172.21.15.99:0/823765797 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3e818bcf0 0x7fa3e8221790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:06.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.370+0000 7fa3ee400640 1 --2- 172.21.15.99:0/823765797 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa3e8157e30 0x7fa3e821c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:06.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.371+0000 7fa3ed000640 1 -- 172.21.15.99:0/823765797 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa3e8157e30 msgr2=0x7fa3e821c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:06.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.371+0000 7fa3ed000640 1 --2- 172.21.15.99:0/823765797 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa3e8157e30 0x7fa3e821c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:06.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.371+0000 7fa3ed000640 1 -- 172.21.15.99:0/823765797 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3e815de70 msgr2=0x7fa3e821fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:06.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.371+0000 7fa3ed000640 1 --2- 172.21.15.99:0/823765797 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa3e815de70 0x7fa3e821fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:06.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.371+0000 7fa3ed000640 1 -- 172.21.15.99:0/823765797 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3e8220410 con 0x7fa3e818bcf0 2024-02-21T23:13:06.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.371+0000 7fa3ed000640 1 --2- 172.21.15.99:0/823765797 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3e818bcf0 0x7fa3e8221790 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fa3e818b9e0 tx=0x7fa3d40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:06.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.371+0000 7fa3e5600640 1 -- 172.21.15.99:0/823765797 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d4042030 con 0x7fa3e818bcf0 2024-02-21T23:13:06.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.371+0000 7fa3f0400640 1 -- 172.21.15.99:0/823765797 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3e82206f0 con 0x7fa3e818bcf0 2024-02-21T23:13:06.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.371+0000 7fa3e5600640 1 -- 172.21.15.99:0/823765797 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3d4031510 con 0x7fa3e818bcf0 2024-02-21T23:13:06.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.371+0000 7fa3e5600640 1 -- 172.21.15.99:0/823765797 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d4038040 con 0x7fa3e818bcf0 2024-02-21T23:13:06.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.372+0000 7fa3f0400640 1 -- 172.21.15.99:0/823765797 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3e8220cb0 con 0x7fa3e818bcf0 2024-02-21T23:13:06.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.373+0000 7fa3f0400640 1 -- 172.21.15.99:0/823765797 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa3e80683c0 con 0x7fa3e818bcf0 2024-02-21T23:13:06.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.375+0000 7fa3e5600640 1 -- 172.21.15.99:0/823765797 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7fa3d4045070 con 0x7fa3e818bcf0 2024-02-21T23:13:06.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.376+0000 7fa3e5600640 1 --2- 172.21.15.99:0/823765797 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa3c809ee80 0x7fa3c80a1340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:06.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.376+0000 7fa3e5600640 1 -- 172.21.15.99:0/823765797 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 8965+0+0 (secure 0 0 0) 0x7fa3d40eb4a0 con 0x7fa3e818bcf0 2024-02-21T23:13:06.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.376+0000 7fa3eda00640 1 --2- 172.21.15.99:0/823765797 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa3c809ee80 0x7fa3c80a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:06.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.377+0000 7fa3e5600640 1 --2- 172.21.15.99:0/823765797 >> [v2:172.21.15.99:6800/2316185310,v1:172.21.15.99:6801/2316185310] conn(0x7fa3c80a9eb0 0x7fa3c80ac330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:06.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.377+0000 7fa3e5600640 1 -- 172.21.15.99:0/823765797 --> [v2:172.21.15.99:6800/2316185310,v1:172.21.15.99:6801/2316185310] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa3d40067f0 con 0x7fa3c80a9eb0 2024-02-21T23:13:06.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.377+0000 7fa3e5600640 1 -- 172.21.15.99:0/823765797 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa3d40f2050 con 0x7fa3e818bcf0 2024-02-21T23:13:06.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.377+0000 7fa3ee400640 1 --2- 172.21.15.99:0/823765797 >> [v2:172.21.15.99:6800/2316185310,v1:172.21.15.99:6801/2316185310] conn(0x7fa3c80a9eb0 0x7fa3c80ac330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:06.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.377+0000 7fa3eda00640 1 --2- 172.21.15.99:0/823765797 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa3c809ee80 0x7fa3c80a1340 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa3e8177a50 tx=0x7fa3dc009040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:06.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.378+0000 7fa3ee400640 1 --2- 172.21.15.99:0/823765797 >> [v2:172.21.15.99:6800/2316185310,v1:172.21.15.99:6801/2316185310] conn(0x7fa3c80a9eb0 0x7fa3c80ac330 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:06.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.379+0000 7fa3e5600640 1 -- 172.21.15.99:0/823765797 <== osd.3 v2:172.21.15.99:6800/2316185310 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fa3d40067f0 con 0x7fa3c80a9eb0 2024-02-21T23:13:06.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.407+0000 7fa3f0400640 1 -- 172.21.15.99:0/823765797 --> [v2:172.21.15.99:6800/2316185310,v1:172.21.15.99:6801/2316185310] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa3e81878e0 con 0x7fa3c80a9eb0 2024-02-21T23:13:06.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.408+0000 7fa3e5600640 1 -- 172.21.15.99:0/823765797 <== osd.3 v2:172.21.15.99:6800/2316185310 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fa3e81878e0 con 0x7fa3c80a9eb0 2024-02-21T23:13:06.396 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-02-21T23:13:06.396 INFO:teuthology.orchestra.run.smithi099.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-21T23:13:06.396 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-02-21T23:13:06.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.408+0000 7fa3f0400640 1 -- 172.21.15.99:0/823765797 >> [v2:172.21.15.99:6800/2316185310,v1:172.21.15.99:6801/2316185310] conn(0x7fa3c80a9eb0 msgr2=0x7fa3c80ac330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:06.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.408+0000 7fa3f0400640 1 --2- 172.21.15.99:0/823765797 >> [v2:172.21.15.99:6800/2316185310,v1:172.21.15.99:6801/2316185310] conn(0x7fa3c80a9eb0 0x7fa3c80ac330 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:06.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.408+0000 7fa3f0400640 1 -- 172.21.15.99:0/823765797 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa3c809ee80 msgr2=0x7fa3c80a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:06.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.408+0000 7fa3f0400640 1 --2- 172.21.15.99:0/823765797 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa3c809ee80 0x7fa3c80a1340 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa3e8177a50 tx=0x7fa3dc009040 comp rx=0 tx=0).stop 2024-02-21T23:13:06.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.408+0000 7fa3f0400640 1 -- 172.21.15.99:0/823765797 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3e818bcf0 msgr2=0x7fa3e8221790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:06.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.408+0000 7fa3f0400640 1 --2- 172.21.15.99:0/823765797 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3e818bcf0 0x7fa3e8221790 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fa3e818b9e0 tx=0x7fa3d40046c0 comp rx=0 tx=0).stop 2024-02-21T23:13:06.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.408+0000 7fa3ee400640 1 -- 172.21.15.99:0/823765797 reap_dead start 2024-02-21T23:13:06.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.409+0000 7fa3f0400640 1 -- 172.21.15.99:0/823765797 shutdown_connections 2024-02-21T23:13:06.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.409+0000 7fa3f0400640 1 -- 172.21.15.99:0/823765797 >> 172.21.15.99:0/823765797 conn(0x7fa3e80740b0 msgr2=0x7fa3e80fb740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:06.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.409+0000 7fa3f0400640 1 -- 172.21.15.99:0/823765797 shutdown_connections 2024-02-21T23:13:06.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.409+0000 7fa3f0400640 1 -- 172.21.15.99:0/823765797 wait complete. 2024-02-21T23:13:06.415 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-02-21T23:13:06.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.619+0000 7f3ca7e00640 1 Processor -- start 2024-02-21T23:13:06.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.619+0000 7f3ca7e00640 1 -- start start 2024-02-21T23:13:06.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.620+0000 7f3ca7e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f3ca80f16d0 0x7f3ca8183c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:06.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.620+0000 7f3ca7e00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f3ca8184170 0x7f3ca80cf7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:06.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.620+0000 7f3ca7e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ca80f1d70 con 0x7f3ca8183030 2024-02-21T23:13:06.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.620+0000 7f3ca7e00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ca8186640 con 0x7f3ca80f16d0 2024-02-21T23:13:06.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.621+0000 7f3ca7e00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ca80f2050 con 0x7f3ca8184170 2024-02-21T23:13:06.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.621+0000 7f3ca6000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f3ca80f16d0 0x7f3ca8183c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:06.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.621+0000 7f3ca6a00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f3ca8183030 0x7f3ca80f0fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.99:45810/0 (socket says 172.21.15.99:45810) 2024-02-21T23:13:06.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.621+0000 7f3ca6a00640 1 -- 172.21.15.99:0/2191868976 learned_addr learned my addr 172.21.15.99:0/2191868976 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:13:06.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.621+0000 7f3ca7400640 1 --2- 172.21.15.99:0/2191868976 >> v2:172.21.15.181:3300/0 conn(0x7f3ca8184170 0x7f3ca80cf7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:06.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.621+0000 7f3ca6000640 1 -- 172.21.15.99:0/2191868976 >> v2:172.21.15.181:3300/0 conn(0x7f3ca8184170 msgr2=0x7f3ca80cf7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:13:06.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.621+0000 7f3ca6000640 1 --2- 172.21.15.99:0/2191868976 >> v2:172.21.15.181:3300/0 conn(0x7f3ca8184170 0x7f3ca80cf7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:06.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.621+0000 7f3ca5600640 1 -- 172.21.15.99:0/2191868976 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2174604342 0 0) 0x7f3ca80f1d70 con 0x7f3ca8183030 2024-02-21T23:13:06.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.621+0000 7f3ca6000640 1 -- 172.21.15.99:0/2191868976 >> v1:172.21.15.162:6789/0 conn(0x7f3ca8183030 legacy=0x7f3ca80f0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:06.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.621+0000 7f3ca6000640 1 -- 172.21.15.99:0/2191868976 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ca80f2330 con 0x7f3ca80f16d0 2024-02-21T23:13:06.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.623+0000 7f3ca6000640 1 --2- 172.21.15.99:0/2191868976 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ca80f16d0 0x7f3ca8183c30 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f3ca80cbe20 tx=0x7f3c9402b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66519081d087bb21 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:06.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.623+0000 7f3ca5600640 1 -- 172.21.15.99:0/2191868976 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c94038070 con 0x7f3ca80f16d0 2024-02-21T23:13:06.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.623+0000 7f3ca5600640 1 -- 172.21.15.99:0/2191868976 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c94031710 con 0x7f3ca80f16d0 2024-02-21T23:13:06.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.623+0000 7f3ca5600640 1 -- 172.21.15.99:0/2191868976 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c94031ae0 con 0x7f3ca80f16d0 2024-02-21T23:13:06.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.624+0000 7f3ca7e00640 1 -- 172.21.15.99:0/2191868976 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ca80f16d0 msgr2=0x7f3ca8183c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:06.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.624+0000 7f3ca7e00640 1 --2- 172.21.15.99:0/2191868976 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ca80f16d0 0x7f3ca8183c30 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f3ca80cbe20 tx=0x7f3c9402b7b0 comp rx=0 tx=0).stop 2024-02-21T23:13:06.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.624+0000 7f3ca7e00640 1 -- 172.21.15.99:0/2191868976 shutdown_connections 2024-02-21T23:13:06.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.624+0000 7f3ca7e00640 1 --2- 172.21.15.99:0/2191868976 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ca80f16d0 0x7f3ca8183c30 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:06.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.624+0000 7f3ca7e00640 1 --2- 172.21.15.99:0/2191868976 >> v2:172.21.15.181:3300/0 conn(0x7f3ca8184170 0x7f3ca80cf7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:06.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.624+0000 7f3ca7e00640 1 -- 172.21.15.99:0/2191868976 >> 172.21.15.99:0/2191868976 conn(0x7f3ca80ce3c0 msgr2=0x7f3ca80ce7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:06.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.624+0000 7f3ca7e00640 1 -- 172.21.15.99:0/2191868976 shutdown_connections 2024-02-21T23:13:06.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.624+0000 7f3ca7e00640 1 -- 172.21.15.99:0/2191868976 wait complete. 2024-02-21T23:13:06.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.626+0000 7f3ca7e00640 1 Processor -- start 2024-02-21T23:13:06.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.626+0000 7f3ca7e00640 1 -- start start 2024-02-21T23:13:06.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.627+0000 7f3ca7e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ca80f16d0 0x7f3ca8186a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:06.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.627+0000 7f3ca7e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3ca8183030 0x7f3ca8179090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:06.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.627+0000 7f3ca7e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ca8184170 0x7f3ca8166de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:06.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.627+0000 7f3ca7e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca80f28f0 con 0x7f3ca80f16d0 2024-02-21T23:13:06.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.627+0000 7f3ca7e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca8183710 con 0x7f3ca8184170 2024-02-21T23:13:06.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.627+0000 7f3ca7e00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca8184600 con 0x7f3ca8183030 2024-02-21T23:13:06.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.627+0000 7f3ca6a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ca80f16d0 0x7f3ca8186a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:06.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.628+0000 7f3ca6a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ca80f16d0 0x7f3ca8186a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:53264/0 (socket says 172.21.15.99:53264) 2024-02-21T23:13:06.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.628+0000 7f3ca6a00640 1 -- 172.21.15.99:0/566343696 learned_addr learned my addr 172.21.15.99:0/566343696 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:13:06.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.628+0000 7f3ca6000640 1 --2- 172.21.15.99:0/566343696 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3ca8183030 0x7f3ca8179090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:06.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.628+0000 7f3ca7400640 1 --2- 172.21.15.99:0/566343696 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ca8184170 0x7f3ca8166de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:06.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.628+0000 7f3ca6a00640 1 -- 172.21.15.99:0/566343696 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3ca8183030 msgr2=0x7f3ca8179090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:06.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.628+0000 7f3ca6a00640 1 --2- 172.21.15.99:0/566343696 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3ca8183030 0x7f3ca8179090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:06.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.628+0000 7f3ca6a00640 1 -- 172.21.15.99:0/566343696 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ca8184170 msgr2=0x7f3ca8166de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:06.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.628+0000 7f3ca6a00640 1 --2- 172.21.15.99:0/566343696 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ca8184170 0x7f3ca8166de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:06.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.628+0000 7f3ca6a00640 1 -- 172.21.15.99:0/566343696 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ca816a9b0 con 0x7f3ca80f16d0 2024-02-21T23:13:06.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.628+0000 7f3ca6a00640 1 --2- 172.21.15.99:0/566343696 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ca80f16d0 0x7f3ca8186a10 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f3c9800c4a0 tx=0x7f3c9800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:06.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.629+0000 7f3c9ea00640 1 -- 172.21.15.99:0/566343696 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c98018070 con 0x7f3ca80f16d0 2024-02-21T23:13:06.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.629+0000 7f3c9ea00640 1 -- 172.21.15.99:0/566343696 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c980075a0 con 0x7f3ca80f16d0 2024-02-21T23:13:06.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.629+0000 7f3c9ea00640 1 -- 172.21.15.99:0/566343696 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c98004a20 con 0x7f3ca80f16d0 2024-02-21T23:13:06.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.629+0000 7f3ca7e00640 1 -- 172.21.15.99:0/566343696 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ca8186f50 con 0x7f3ca80f16d0 2024-02-21T23:13:06.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.629+0000 7f3ca7e00640 1 -- 172.21.15.99:0/566343696 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ca816a6d0 con 0x7f3ca80f16d0 2024-02-21T23:13:06.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.630+0000 7f3ca7e00640 1 -- 172.21.15.99:0/566343696 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ca8068320 con 0x7f3ca80f16d0 2024-02-21T23:13:06.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.634+0000 7f3c9ea00640 1 -- 172.21.15.99:0/566343696 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f3c9801b070 con 0x7f3ca80f16d0 2024-02-21T23:13:06.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.636+0000 7f3c9ea00640 1 --2- 172.21.15.99:0/566343696 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f3c8809ef00 0x7f3c880a13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:06.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.636+0000 7f3c9ea00640 1 -- 172.21.15.99:0/566343696 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 8965+0+0 (secure 0 0 0) 0x7f3c980c9500 con 0x7f3ca80f16d0 2024-02-21T23:13:06.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.636+0000 7f3ca6000640 1 --2- 172.21.15.99:0/566343696 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f3c8809ef00 0x7f3c880a13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:06.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.637+0000 7f3c9ea00640 1 -- 172.21.15.99:0/566343696 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f3c98096da0 con 0x7f3ca80f16d0 2024-02-21T23:13:06.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.637+0000 7f3ca6000640 1 --2- 172.21.15.99:0/566343696 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f3c8809ef00 0x7f3c880a13c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3c94035000 tx=0x7f3c94008030 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:06.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.920+0000 7f3ca7e00640 1 -- 172.21.15.99:0/566343696 --> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f3ca80ed7d0 con 0x7f3c8809ef00 2024-02-21T23:13:06.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.921+0000 7f3c9ea00640 1 -- 172.21.15.99:0/566343696 <== mgr.5131 v2:172.21.15.162:6800/631076050 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3ca80ed7d0 con 0x7f3c8809ef00 2024-02-21T23:13:06.909 INFO:teuthology.orchestra.run.smithi099.stderr:instructed osd(s) 3 to deep-scrub 2024-02-21T23:13:06.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.923+0000 7f3ca7e00640 1 -- 172.21.15.99:0/566343696 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f3c8809ef00 msgr2=0x7f3c880a13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:06.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.923+0000 7f3ca7e00640 1 --2- 172.21.15.99:0/566343696 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f3c8809ef00 0x7f3c880a13c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3c94035000 tx=0x7f3c94008030 comp rx=0 tx=0).stop 2024-02-21T23:13:06.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.924+0000 7f3ca7e00640 1 -- 172.21.15.99:0/566343696 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ca80f16d0 msgr2=0x7f3ca8186a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:06.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.924+0000 7f3ca7e00640 1 --2- 172.21.15.99:0/566343696 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ca80f16d0 0x7f3ca8186a10 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f3c9800c4a0 tx=0x7f3c9800c960 comp rx=0 tx=0).stop 2024-02-21T23:13:06.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.924+0000 7f3ca7e00640 1 -- 172.21.15.99:0/566343696 shutdown_connections 2024-02-21T23:13:06.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.924+0000 7f3ca7e00640 1 --2- 172.21.15.99:0/566343696 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f3c8809ef00 0x7f3c880a13c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:06.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.924+0000 7f3ca7e00640 1 --2- 172.21.15.99:0/566343696 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ca8184170 0x7f3ca8166de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:06.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.924+0000 7f3ca7e00640 1 --2- 172.21.15.99:0/566343696 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3ca8183030 0x7f3ca8179090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:06.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.924+0000 7f3ca7e00640 1 --2- 172.21.15.99:0/566343696 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ca80f16d0 0x7f3ca8186a10 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:06.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.924+0000 7f3ca7e00640 1 -- 172.21.15.99:0/566343696 >> 172.21.15.99:0/566343696 conn(0x7f3ca80ce3c0 msgr2=0x7f3ca816c330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:06.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.924+0000 7f3ca7e00640 1 -- 172.21.15.99:0/566343696 shutdown_connections 2024-02-21T23:13:06.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:06.924+0000 7f3ca7e00640 1 -- 172.21.15.99:0/566343696 wait complete. 2024-02-21T23:13:06.930 INFO:tasks.ceph:Scrubbing osd.6 2024-02-21T23:13:06.931 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-02-21T23:13:07.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.143+0000 7ff7a6e00640 1 Processor -- start 2024-02-21T23:13:07.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.143+0000 7ff7a6e00640 1 -- start start 2024-02-21T23:13:07.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.146+0000 7ff7a6e00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7ff7a0185950 0x7ff7a006e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:07.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.146+0000 7ff7a6e00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7a00f8f30 con 0x7ff7a006ecc0 2024-02-21T23:13:07.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.146+0000 7ff7a6e00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7a0183aa0 con 0x7ff7a0186440 2024-02-21T23:13:07.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.146+0000 7ff7a6e00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7a0183850 con 0x7ff7a0185950 2024-02-21T23:13:07.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.146+0000 7ff7a5000640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7ff7a006ecc0 0x7ff7a0185d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:58168/0 (socket says 172.21.15.99:58168) 2024-02-21T23:13:07.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.146+0000 7ff7a5000640 1 -- 172.21.15.99:0/4154699019 learned_addr learned my addr 172.21.15.99:0/4154699019 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:13:07.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.146+0000 7ff7a5a00640 1 --2- 172.21.15.99:0/4154699019 >> v2:172.21.15.181:3300/0 conn(0x7ff7a0185950 0x7ff7a006e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:07.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.147+0000 7ff7a5a00640 1 -- 172.21.15.99:0/4154699019 >> v1:172.21.15.162:6789/0 conn(0x7ff7a0186440 legacy=0x7ff7a0184860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:07.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.147+0000 7ff7a5a00640 1 -- 172.21.15.99:0/4154699019 >> v1:172.21.15.99:6789/0 conn(0x7ff7a006ecc0 legacy=0x7ff7a0185d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:07.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.147+0000 7ff7a5a00640 1 -- 172.21.15.99:0/4154699019 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7a0183d80 con 0x7ff7a0185950 2024-02-21T23:13:07.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.147+0000 7ff79fe00640 1 -- 172.21.15.99:0/4154699019 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 814203786 0 0) 0x7ff7a00f8f30 con 0x7ff7a006ecc0 2024-02-21T23:13:07.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.148+0000 7ff7a5a00640 1 --2- 172.21.15.99:0/4154699019 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff7a0185950 0x7ff7a006e780 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7ff7940097a0 tx=0x7ff79402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da9f598b3ce5b591 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:07.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.148+0000 7ff79fe00640 1 -- 172.21.15.99:0/4154699019 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff794035020 con 0x7ff7a0185950 2024-02-21T23:13:07.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.148+0000 7ff79fe00640 1 -- 172.21.15.99:0/4154699019 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff794031830 con 0x7ff7a0185950 2024-02-21T23:13:07.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.148+0000 7ff79fe00640 1 -- 172.21.15.99:0/4154699019 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff794031c00 con 0x7ff7a0185950 2024-02-21T23:13:07.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.149+0000 7ff7a6e00640 1 -- 172.21.15.99:0/4154699019 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff7a0185950 msgr2=0x7ff7a006e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:07.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.149+0000 7ff7a6e00640 1 --2- 172.21.15.99:0/4154699019 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff7a0185950 0x7ff7a006e780 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7ff7940097a0 tx=0x7ff79402b8d0 comp rx=0 tx=0).stop 2024-02-21T23:13:07.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.149+0000 7ff7a6e00640 1 -- 172.21.15.99:0/4154699019 shutdown_connections 2024-02-21T23:13:07.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.149+0000 7ff7a6e00640 1 --2- 172.21.15.99:0/4154699019 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff7a0185950 0x7ff7a006e780 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:07.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.149+0000 7ff7a6e00640 1 -- 172.21.15.99:0/4154699019 >> 172.21.15.99:0/4154699019 conn(0x7ff7a00ce3d0 msgr2=0x7ff7a00ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:07.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.149+0000 7ff7a6e00640 1 -- 172.21.15.99:0/4154699019 shutdown_connections 2024-02-21T23:13:07.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.149+0000 7ff7a6e00640 1 -- 172.21.15.99:0/4154699019 wait complete. 2024-02-21T23:13:07.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.152+0000 7ff7a6e00640 1 Processor -- start 2024-02-21T23:13:07.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.152+0000 7ff7a6e00640 1 -- start start 2024-02-21T23:13:07.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.154+0000 7ff7a6e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff7a006ecc0 0x7ff7a0157330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:07.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.154+0000 7ff7a6e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff7a0185950 0x7ff7a0157870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:07.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.154+0000 7ff7a6e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7a0186440 0x7ff7a00d0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:07.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.154+0000 7ff7a6e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a0184340 con 0x7ff7a006ecc0 2024-02-21T23:13:07.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.154+0000 7ff7a6e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a0186850 con 0x7ff7a0186440 2024-02-21T23:13:07.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.154+0000 7ff7a6e00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a017c660 con 0x7ff7a0185950 2024-02-21T23:13:07.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.154+0000 7ff7a5a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff7a006ecc0 0x7ff7a0157330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:07.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.154+0000 7ff7a5a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff7a006ecc0 0x7ff7a0157330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:55994/0 (socket says 172.21.15.99:55994) 2024-02-21T23:13:07.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.154+0000 7ff7a5a00640 1 -- 172.21.15.99:0/1686200558 learned_addr learned my addr 172.21.15.99:0/1686200558 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:13:07.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.154+0000 7ff7a5000640 1 --2- 172.21.15.99:0/1686200558 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff7a0185950 0x7ff7a0157870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:07.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.155+0000 7ff7a6400640 1 --2- 172.21.15.99:0/1686200558 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7a0186440 0x7ff7a00d0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:07.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.155+0000 7ff7a5000640 1 -- 172.21.15.99:0/1686200558 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7a0186440 msgr2=0x7ff7a00d0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:07.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.155+0000 7ff7a5000640 1 --2- 172.21.15.99:0/1686200558 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7a0186440 0x7ff7a00d0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:07.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.155+0000 7ff7a5000640 1 -- 172.21.15.99:0/1686200558 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff7a006ecc0 msgr2=0x7ff7a0157330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:07.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.155+0000 7ff7a5000640 1 --2- 172.21.15.99:0/1686200558 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff7a006ecc0 0x7ff7a0157330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:07.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.155+0000 7ff7a5000640 1 -- 172.21.15.99:0/1686200558 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7a00d1910 con 0x7ff7a0185950 2024-02-21T23:13:07.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.155+0000 7ff7a5a00640 1 --2- 172.21.15.99:0/1686200558 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ff7a006ecc0 0x7ff7a0157330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:13:07.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.155+0000 7ff7a5000640 1 --2- 172.21.15.99:0/1686200558 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff7a0185950 0x7ff7a0157870 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7ff78c00c410 tx=0x7ff78c00c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:07.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.156+0000 7ff79d600640 1 -- 172.21.15.99:0/1686200558 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff78c0074e0 con 0x7ff7a0185950 2024-02-21T23:13:07.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.156+0000 7ff79d600640 1 -- 172.21.15.99:0/1686200558 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff78c0047e0 con 0x7ff7a0185950 2024-02-21T23:13:07.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.156+0000 7ff79d600640 1 -- 172.21.15.99:0/1686200558 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff78c004bd0 con 0x7ff7a0185950 2024-02-21T23:13:07.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.156+0000 7ff7a6e00640 1 -- 172.21.15.99:0/1686200558 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7a00d1bf0 con 0x7ff7a0185950 2024-02-21T23:13:07.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.156+0000 7ff7a6e00640 1 -- 172.21.15.99:0/1686200558 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7a00d21b0 con 0x7ff7a0185950 2024-02-21T23:13:07.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.157+0000 7ff7a6e00640 1 -- 172.21.15.99:0/1686200558 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff7a021dfd0 con 0x7ff7a0185950 2024-02-21T23:13:07.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.159+0000 7ff79d600640 1 -- 172.21.15.99:0/1686200558 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7ff78c011070 con 0x7ff7a0185950 2024-02-21T23:13:07.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.160+0000 7ff79d600640 1 --2- 172.21.15.99:0/1686200558 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7ff78009eed0 0x7ff7800a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:07.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.160+0000 7ff79d600640 1 -- 172.21.15.99:0/1686200558 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 8965+0+0 (secure 0 0 0) 0x7ff78c0ca290 con 0x7ff7a0185950 2024-02-21T23:13:07.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.160+0000 7ff79d600640 1 --2- 172.21.15.99:0/1686200558 >> [v2:172.21.15.99:6808/753870050,v1:172.21.15.99:6810/753870050] conn(0x7ff7800a9f00 0x7ff7800ac380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:07.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.160+0000 7ff79d600640 1 -- 172.21.15.99:0/1686200558 --> [v2:172.21.15.99:6808/753870050,v1:172.21.15.99:6810/753870050] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff78c009e50 con 0x7ff7800a9f00 2024-02-21T23:13:07.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.160+0000 7ff79d600640 1 -- 172.21.15.99:0/1686200558 <== mon.2 v2:172.21.15.181:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff78c0ca6e0 con 0x7ff7a0185950 2024-02-21T23:13:07.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.160+0000 7ff7a5a00640 1 --2- 172.21.15.99:0/1686200558 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7ff78009eed0 0x7ff7800a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:07.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.161+0000 7ff7a6400640 1 --2- 172.21.15.99:0/1686200558 >> [v2:172.21.15.99:6808/753870050,v1:172.21.15.99:6810/753870050] conn(0x7ff7800a9f00 0x7ff7800ac380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:07.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.161+0000 7ff7a5a00640 1 --2- 172.21.15.99:0/1686200558 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7ff78009eed0 0x7ff7800a1390 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff79402b910 tx=0x7ff79403c040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:07.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.161+0000 7ff7a6400640 1 --2- 172.21.15.99:0/1686200558 >> [v2:172.21.15.99:6808/753870050,v1:172.21.15.99:6810/753870050] conn(0x7ff7800a9f00 0x7ff7800ac380 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:07.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.162+0000 7ff79d600640 1 -- 172.21.15.99:0/1686200558 <== osd.6 v2:172.21.15.99:6808/753870050 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7ff78c009e50 con 0x7ff7800a9f00 2024-02-21T23:13:07.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.191+0000 7ff7a6e00640 1 -- 172.21.15.99:0/1686200558 --> [v2:172.21.15.99:6808/753870050,v1:172.21.15.99:6810/753870050] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff7a00682b0 con 0x7ff7800a9f00 2024-02-21T23:13:07.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.191+0000 7ff79d600640 1 -- 172.21.15.99:0/1686200558 <== osd.6 v2:172.21.15.99:6808/753870050 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7ff7a00682b0 con 0x7ff7800a9f00 2024-02-21T23:13:07.179 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-02-21T23:13:07.179 INFO:teuthology.orchestra.run.smithi099.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-21T23:13:07.179 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-02-21T23:13:07.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.191+0000 7ff7a6e00640 1 -- 172.21.15.99:0/1686200558 >> [v2:172.21.15.99:6808/753870050,v1:172.21.15.99:6810/753870050] conn(0x7ff7800a9f00 msgr2=0x7ff7800ac380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:07.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.191+0000 7ff7a6e00640 1 --2- 172.21.15.99:0/1686200558 >> [v2:172.21.15.99:6808/753870050,v1:172.21.15.99:6810/753870050] conn(0x7ff7800a9f00 0x7ff7800ac380 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:07.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.192+0000 7ff7a6e00640 1 -- 172.21.15.99:0/1686200558 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7ff78009eed0 msgr2=0x7ff7800a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:07.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.192+0000 7ff7a6e00640 1 --2- 172.21.15.99:0/1686200558 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7ff78009eed0 0x7ff7800a1390 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff79402b910 tx=0x7ff79403c040 comp rx=0 tx=0).stop 2024-02-21T23:13:07.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.192+0000 7ff7a6e00640 1 -- 172.21.15.99:0/1686200558 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff7a0185950 msgr2=0x7ff7a0157870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:07.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.192+0000 7ff7a6e00640 1 --2- 172.21.15.99:0/1686200558 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ff7a0185950 0x7ff7a0157870 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7ff78c00c410 tx=0x7ff78c00c8d0 comp rx=0 tx=0).stop 2024-02-21T23:13:07.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.192+0000 7ff7a6400640 1 -- 172.21.15.99:0/1686200558 reap_dead start 2024-02-21T23:13:07.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.192+0000 7ff7a6e00640 1 -- 172.21.15.99:0/1686200558 shutdown_connections 2024-02-21T23:13:07.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.192+0000 7ff7a6e00640 1 -- 172.21.15.99:0/1686200558 >> 172.21.15.99:0/1686200558 conn(0x7ff7a00ce3d0 msgr2=0x7ff7a0179e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:07.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.192+0000 7ff7a6e00640 1 -- 172.21.15.99:0/1686200558 shutdown_connections 2024-02-21T23:13:07.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.192+0000 7ff7a6e00640 1 -- 172.21.15.99:0/1686200558 wait complete. 2024-02-21T23:13:07.201 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-02-21T23:13:07.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.423+0000 7fa943200640 1 Processor -- start 2024-02-21T23:13:07.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.423+0000 7fa943200640 1 -- start start 2024-02-21T23:13:07.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.426+0000 7fa943200640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fa944183030 0x7fa9440f0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:07.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.426+0000 7fa943200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa944184340 0x7fa9440cf7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:07.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.426+0000 7fa943200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9440f1d70 con 0x7fa9440f1500 2024-02-21T23:13:07.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.426+0000 7fa943200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa944186640 con 0x7fa944184340 2024-02-21T23:13:07.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.426+0000 7fa943200640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9440f2050 con 0x7fa944183030 2024-02-21T23:13:07.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.426+0000 7fa941400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fa9440f1500 0x7fa944183c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:58178/0 (socket says 172.21.15.99:58178) 2024-02-21T23:13:07.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.426+0000 7fa941400640 1 -- 172.21.15.99:0/2122104610 learned_addr learned my addr 172.21.15.99:0/2122104610 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:13:07.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.426+0000 7fa941e00640 1 --2- 172.21.15.99:0/2122104610 >> v2:172.21.15.181:3300/0 conn(0x7fa944183030 0x7fa9440f0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:07.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.426+0000 7fa942800640 1 --2- 172.21.15.99:0/2122104610 >> v2:172.21.15.162:3300/0 conn(0x7fa944184340 0x7fa9440cf7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:07.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.427+0000 7fa940a00640 1 -- 172.21.15.99:0/2122104610 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1971805069 0 0) 0x7fa9440f1d70 con 0x7fa9440f1500 2024-02-21T23:13:07.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.427+0000 7fa940a00640 1 -- 172.21.15.99:0/2122104610 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa928003520 con 0x7fa9440f1500 2024-02-21T23:13:07.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.427+0000 7fa942800640 1 -- 172.21.15.99:0/2122104610 >> v2:172.21.15.181:3300/0 conn(0x7fa944183030 msgr2=0x7fa9440f0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:13:07.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.427+0000 7fa942800640 1 --2- 172.21.15.99:0/2122104610 >> v2:172.21.15.181:3300/0 conn(0x7fa944183030 0x7fa9440f0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:07.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.427+0000 7fa942800640 1 -- 172.21.15.99:0/2122104610 >> v1:172.21.15.99:6789/0 conn(0x7fa9440f1500 legacy=0x7fa944183c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:07.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.427+0000 7fa942800640 1 -- 172.21.15.99:0/2122104610 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9440f2330 con 0x7fa944184340 2024-02-21T23:13:07.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.427+0000 7fa941e00640 1 --2- 172.21.15.99:0/2122104610 >> v2:172.21.15.181:3300/0 conn(0x7fa944183030 0x7fa9440f0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:13:07.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.428+0000 7fa942800640 1 --2- 172.21.15.99:0/2122104610 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa944184340 0x7fa9440cf7b0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fa94408e270 tx=0x7fa93c02bda0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b53b52d83e8d832c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:07.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.428+0000 7fa940a00640 1 -- 172.21.15.99:0/2122104610 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa93c039070 con 0x7fa944184340 2024-02-21T23:13:07.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.428+0000 7fa940a00640 1 -- 172.21.15.99:0/2122104610 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa93c02cb50 con 0x7fa944184340 2024-02-21T23:13:07.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.428+0000 7fa940a00640 1 -- 172.21.15.99:0/2122104610 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa93c034440 con 0x7fa944184340 2024-02-21T23:13:07.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.429+0000 7fa943200640 1 -- 172.21.15.99:0/2122104610 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa944184340 msgr2=0x7fa9440cf7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:07.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.429+0000 7fa943200640 1 --2- 172.21.15.99:0/2122104610 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa944184340 0x7fa9440cf7b0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fa94408e270 tx=0x7fa93c02bda0 comp rx=0 tx=0).stop 2024-02-21T23:13:07.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.429+0000 7fa943200640 1 -- 172.21.15.99:0/2122104610 shutdown_connections 2024-02-21T23:13:07.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.429+0000 7fa943200640 1 --2- 172.21.15.99:0/2122104610 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa944184340 0x7fa9440cf7b0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:07.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.429+0000 7fa943200640 1 --2- 172.21.15.99:0/2122104610 >> v2:172.21.15.181:3300/0 conn(0x7fa944183030 0x7fa9440f0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:07.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.429+0000 7fa943200640 1 -- 172.21.15.99:0/2122104610 >> 172.21.15.99:0/2122104610 conn(0x7fa9440ce3c0 msgr2=0x7fa9440ce7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:07.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.429+0000 7fa943200640 1 -- 172.21.15.99:0/2122104610 shutdown_connections 2024-02-21T23:13:07.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.429+0000 7fa943200640 1 -- 172.21.15.99:0/2122104610 wait complete. 2024-02-21T23:13:07.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.431+0000 7fa943200640 1 Processor -- start 2024-02-21T23:13:07.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.431+0000 7fa943200640 1 -- start start 2024-02-21T23:13:07.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.433+0000 7fa943200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9440f1500 0x7fa94416f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:07.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.433+0000 7fa943200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa944183030 0x7fa9440efa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:07.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.433+0000 7fa943200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa944184340 0x7fa9440cc9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:07.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.433+0000 7fa943200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9440f28f0 con 0x7fa944183030 2024-02-21T23:13:07.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.433+0000 7fa943200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa944183710 con 0x7fa9440f1500 2024-02-21T23:13:07.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.433+0000 7fa943200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9441847d0 con 0x7fa944184340 2024-02-21T23:13:07.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.433+0000 7fa941e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9440f1500 0x7fa94416f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:07.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.433+0000 7fa941e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9440f1500 0x7fa94416f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:56050/0 (socket says 172.21.15.99:56050) 2024-02-21T23:13:07.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.433+0000 7fa941e00640 1 -- 172.21.15.99:0/2178755547 learned_addr learned my addr 172.21.15.99:0/2178755547 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:13:07.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.433+0000 7fa941400640 1 --2- 172.21.15.99:0/2178755547 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa944183030 0x7fa9440efa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:07.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.433+0000 7fa942800640 1 --2- 172.21.15.99:0/2178755547 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa944184340 0x7fa9440cc9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:07.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.434+0000 7fa941e00640 1 -- 172.21.15.99:0/2178755547 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa944184340 msgr2=0x7fa9440cc9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:07.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.434+0000 7fa941e00640 1 --2- 172.21.15.99:0/2178755547 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa944184340 0x7fa9440cc9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:07.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.434+0000 7fa941e00640 1 -- 172.21.15.99:0/2178755547 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa944183030 msgr2=0x7fa9440efa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:07.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.434+0000 7fa941e00640 1 --2- 172.21.15.99:0/2178755547 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa944183030 0x7fa9440efa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:07.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.434+0000 7fa941e00640 1 -- 172.21.15.99:0/2178755547 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa94416f630 con 0x7fa9440f1500 2024-02-21T23:13:07.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.434+0000 7fa942800640 1 --2- 172.21.15.99:0/2178755547 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa944184340 0x7fa9440cc9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:13:07.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.434+0000 7fa941400640 1 --2- 172.21.15.99:0/2178755547 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa944183030 0x7fa9440efa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:13:07.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.434+0000 7fa941e00640 1 --2- 172.21.15.99:0/2178755547 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9440f1500 0x7fa94416f0f0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fa93400e960 tx=0x7fa93400ee20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:07.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.435+0000 7fa93a000640 1 -- 172.21.15.99:0/2178755547 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa934017070 con 0x7fa9440f1500 2024-02-21T23:13:07.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.435+0000 7fa93a000640 1 -- 172.21.15.99:0/2178755547 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa93400c9a0 con 0x7fa9440f1500 2024-02-21T23:13:07.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.435+0000 7fa93a000640 1 -- 172.21.15.99:0/2178755547 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa93400cd70 con 0x7fa9440f1500 2024-02-21T23:13:07.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.435+0000 7fa943200640 1 -- 172.21.15.99:0/2178755547 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9440f0340 con 0x7fa9440f1500 2024-02-21T23:13:07.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.435+0000 7fa943200640 1 -- 172.21.15.99:0/2178755547 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9440f0900 con 0x7fa9440f1500 2024-02-21T23:13:07.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.436+0000 7fa943200640 1 -- 172.21.15.99:0/2178755547 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa944068320 con 0x7fa9440f1500 2024-02-21T23:13:07.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.438+0000 7fa93a000640 1 -- 172.21.15.99:0/2178755547 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7fa93401a070 con 0x7fa9440f1500 2024-02-21T23:13:07.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.440+0000 7fa93a000640 1 --2- 172.21.15.99:0/2178755547 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa92409eed0 0x7fa9240a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:07.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.440+0000 7fa93a000640 1 -- 172.21.15.99:0/2178755547 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 8965+0+0 (secure 0 0 0) 0x7fa9340ca340 con 0x7fa9440f1500 2024-02-21T23:13:07.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.440+0000 7fa941400640 1 --2- 172.21.15.99:0/2178755547 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa92409eed0 0x7fa9240a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:07.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.441+0000 7fa941400640 1 --2- 172.21.15.99:0/2178755547 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa92409eed0 0x7fa9240a1390 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa944188830 tx=0x7fa930009040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:07.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.443+0000 7fa93a000640 1 -- 172.21.15.99:0/2178755547 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fa934098230 con 0x7fa9440f1500 2024-02-21T23:13:07.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.763+0000 7fa943200640 1 -- 172.21.15.99:0/2178755547 --> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fa944073540 con 0x7fa92409eed0 2024-02-21T23:13:07.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.764+0000 7fa93a000640 1 -- 172.21.15.99:0/2178755547 <== mgr.5131 v2:172.21.15.162:6800/631076050 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa944073540 con 0x7fa92409eed0 2024-02-21T23:13:07.752 INFO:teuthology.orchestra.run.smithi099.stderr:instructed osd(s) 6 to deep-scrub 2024-02-21T23:13:07.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.767+0000 7fa943200640 1 -- 172.21.15.99:0/2178755547 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa92409eed0 msgr2=0x7fa9240a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:07.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.767+0000 7fa943200640 1 --2- 172.21.15.99:0/2178755547 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa92409eed0 0x7fa9240a1390 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa944188830 tx=0x7fa930009040 comp rx=0 tx=0).stop 2024-02-21T23:13:07.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.767+0000 7fa943200640 1 -- 172.21.15.99:0/2178755547 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9440f1500 msgr2=0x7fa94416f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:07.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.767+0000 7fa943200640 1 --2- 172.21.15.99:0/2178755547 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9440f1500 0x7fa94416f0f0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fa93400e960 tx=0x7fa93400ee20 comp rx=0 tx=0).stop 2024-02-21T23:13:07.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.767+0000 7fa943200640 1 -- 172.21.15.99:0/2178755547 shutdown_connections 2024-02-21T23:13:07.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.767+0000 7fa943200640 1 --2- 172.21.15.99:0/2178755547 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fa92409eed0 0x7fa9240a1390 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:07.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.767+0000 7fa943200640 1 --2- 172.21.15.99:0/2178755547 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fa944184340 0x7fa9440cc9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:07.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.767+0000 7fa943200640 1 --2- 172.21.15.99:0/2178755547 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fa944183030 0x7fa9440efa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:07.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.767+0000 7fa943200640 1 --2- 172.21.15.99:0/2178755547 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9440f1500 0x7fa94416f0f0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:07.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.767+0000 7fa943200640 1 -- 172.21.15.99:0/2178755547 >> 172.21.15.99:0/2178755547 conn(0x7fa9440ce3c0 msgr2=0x7fa9440f5a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:07.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.767+0000 7fa943200640 1 -- 172.21.15.99:0/2178755547 shutdown_connections 2024-02-21T23:13:07.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:07.767+0000 7fa943200640 1 -- 172.21.15.99:0/2178755547 wait complete. 2024-02-21T23:13:07.775 INFO:tasks.ceph:Scrubbing osd.9 2024-02-21T23:13:07.775 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.9 config set osd_debug_deep_scrub_sleep 0 2024-02-21T23:13:08.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.035+0000 7fc60e200640 1 Processor -- start 2024-02-21T23:13:08.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.036+0000 7fc60e200640 1 -- start start 2024-02-21T23:13:08.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.038+0000 7fc60e200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6080725a0 con 0x7fc608184130 2024-02-21T23:13:08.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.039+0000 7fc60e200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc608072880 con 0x7fc608071e70 2024-02-21T23:13:08.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.039+0000 7fc60e200640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc608072b60 con 0x7fc608187340 2024-02-21T23:13:08.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.039+0000 7fc60ce00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fc608184130 0x7fc608071760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:58194/0 (socket says 172.21.15.99:58194) 2024-02-21T23:13:08.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.039+0000 7fc60ce00640 1 -- 172.21.15.99:0/2551958120 learned_addr learned my addr 172.21.15.99:0/2551958120 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:13:08.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.039+0000 7fc607400640 1 -- 172.21.15.99:0/2551958120 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1660957953 0 0) 0x7fc6080725a0 con 0x7fc608184130 2024-02-21T23:13:08.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.039+0000 7fc607400640 1 -- 172.21.15.99:0/2551958120 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5f0003520 con 0x7fc608184130 2024-02-21T23:13:08.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.039+0000 7fc607400640 1 -- 172.21.15.99:0/2551958120 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3148953444 0 0) 0x7fc608072880 con 0x7fc608071e70 2024-02-21T23:13:08.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.039+0000 7fc607400640 1 -- 172.21.15.99:0/2551958120 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6080725a0 con 0x7fc608071e70 2024-02-21T23:13:08.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.039+0000 7fc607400640 1 -- 172.21.15.99:0/2551958120 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1049186841 0 0) 0x7fc608072b60 con 0x7fc608187340 2024-02-21T23:13:08.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.039+0000 7fc607400640 1 -- 172.21.15.99:0/2551958120 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc608072880 con 0x7fc608187340 2024-02-21T23:13:08.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.040+0000 7fc607400640 1 -- 172.21.15.99:0/2551958120 <== mon.1 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 247071203 0 0) 0x7fc6080725a0 con 0x7fc608071e70 2024-02-21T23:13:08.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.040+0000 7fc607400640 1 -- 172.21.15.99:0/2551958120 >> v1:172.21.15.181:6789/0 conn(0x7fc608187340 legacy=0x7fc608187e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:08.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.040+0000 7fc607400640 1 -- 172.21.15.99:0/2551958120 >> v1:172.21.15.99:6789/0 conn(0x7fc608184130 legacy=0x7fc608071760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:08.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.040+0000 7fc607400640 1 -- 172.21.15.99:0/2551958120 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc608072e40 con 0x7fc608071e70 2024-02-21T23:13:08.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.040+0000 7fc607400640 1 -- 172.21.15.99:0/2551958120 <== mon.1 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2069890144 0 0) 0x7fc6000019d0 con 0x7fc608071e70 2024-02-21T23:13:08.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.040+0000 7fc607400640 1 -- 172.21.15.99:0/2551958120 >> v1:172.21.15.162:6789/0 conn(0x7fc608071e70 legacy=0x7fc608188560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:08.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.040+0000 7fc607400640 1 --2- 172.21.15.99:0/2551958120 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc5f0004db0 0x7fc5f0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:08.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.040+0000 7fc607400640 1 --2- 172.21.15.99:0/2551958120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5f00037a0 0x7fc5f0003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:08.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.040+0000 7fc607400640 1 --2- 172.21.15.99:0/2551958120 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5f0004380 0x7fc5f000ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:08.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.040+0000 7fc607400640 1 -- 172.21.15.99:0/2551958120 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f000c2f0 con 0x7fc5f0004380 2024-02-21T23:13:08.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.040+0000 7fc607400640 1 -- 172.21.15.99:0/2551958120 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f000c4a0 con 0x7fc5f00037a0 2024-02-21T23:13:08.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.040+0000 7fc607400640 1 -- 172.21.15.99:0/2551958120 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f000c6a0 con 0x7fc5f0004db0 2024-02-21T23:13:08.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.040+0000 7fc60ce00640 1 --2- 172.21.15.99:0/2551958120 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc5f0004db0 0x7fc5f0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:08.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.040+0000 7fc607e00640 1 --2- 172.21.15.99:0/2551958120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5f00037a0 0x7fc5f0003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:08.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.040+0000 7fc60d800640 1 --2- 172.21.15.99:0/2551958120 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5f0004380 0x7fc5f000ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:08.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.041+0000 7fc607e00640 1 -- 172.21.15.99:0/2551958120 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc5f0004db0 msgr2=0x7fc5f0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:13:08.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.041+0000 7fc607e00640 1 --2- 172.21.15.99:0/2551958120 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc5f0004db0 0x7fc5f0005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:08.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.041+0000 7fc607e00640 1 -- 172.21.15.99:0/2551958120 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5f0004380 msgr2=0x7fc5f000ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:13:08.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.041+0000 7fc607e00640 1 --2- 172.21.15.99:0/2551958120 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc5f0004380 0x7fc5f000ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:08.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.041+0000 7fc607e00640 1 -- 172.21.15.99:0/2551958120 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc608072e40 con 0x7fc5f00037a0 2024-02-21T23:13:08.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.041+0000 7fc60d800640 1 -- 172.21.15.99:0/2551958120 reap_dead start 2024-02-21T23:13:08.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.042+0000 7fc607e00640 1 --2- 172.21.15.99:0/2551958120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5f00037a0 0x7fc5f0003c20 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fc5f40013b0 tx=0x7fc5f0005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a730c48fc8b0f8aa server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:08.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.042+0000 7fc607400640 1 -- 172.21.15.99:0/2551958120 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f40013f0 con 0x7fc5f00037a0 2024-02-21T23:13:08.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.042+0000 7fc607400640 1 -- 172.21.15.99:0/2551958120 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5f40052d0 con 0x7fc5f00037a0 2024-02-21T23:13:08.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.042+0000 7fc607400640 1 -- 172.21.15.99:0/2551958120 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f4003810 con 0x7fc5f00037a0 2024-02-21T23:13:08.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.043+0000 7fc60e200640 1 -- 172.21.15.99:0/2551958120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5f00037a0 msgr2=0x7fc5f0003c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:08.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.043+0000 7fc60e200640 1 --2- 172.21.15.99:0/2551958120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5f00037a0 0x7fc5f0003c20 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fc5f40013b0 tx=0x7fc5f0005830 comp rx=0 tx=0).stop 2024-02-21T23:13:08.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.043+0000 7fc60e200640 1 -- 172.21.15.99:0/2551958120 shutdown_connections 2024-02-21T23:13:08.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.043+0000 7fc60e200640 1 --2- 172.21.15.99:0/2551958120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5f00037a0 0x7fc5f0003c20 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:08.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.043+0000 7fc60e200640 1 -- 172.21.15.99:0/2551958120 >> 172.21.15.99:0/2551958120 conn(0x7fc60808cfd0 msgr2=0x7fc60808d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:08.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.043+0000 7fc60e200640 1 -- 172.21.15.99:0/2551958120 shutdown_connections 2024-02-21T23:13:08.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.043+0000 7fc60e200640 1 -- 172.21.15.99:0/2551958120 wait complete. 2024-02-21T23:13:08.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.046+0000 7fc60e200640 1 Processor -- start 2024-02-21T23:13:08.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.047+0000 7fc60e200640 1 -- start start 2024-02-21T23:13:08.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.049+0000 7fc60e200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc5f00037a0 0x7fc6080fa990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:08.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.049+0000 7fc60e200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc60821b050 0x7fc6080cd440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:08.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.049+0000 7fc60e200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc608070c30 0x7fc60815b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:08.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.049+0000 7fc60e200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6080722c0 con 0x7fc60821b050 2024-02-21T23:13:08.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.049+0000 7fc60e200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc608187780 con 0x7fc608070c30 2024-02-21T23:13:08.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.049+0000 7fc60e200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc608071760 con 0x7fc5f00037a0 2024-02-21T23:13:08.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.049+0000 7fc60ce00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc5f00037a0 0x7fc6080fa990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:08.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.049+0000 7fc607e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc60821b050 0x7fc6080cd440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:08.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.049+0000 7fc60ce00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc5f00037a0 0x7fc6080fa990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:37132/0 (socket says 172.21.15.99:37132) 2024-02-21T23:13:08.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.049+0000 7fc60ce00640 1 -- 172.21.15.99:0/2532254153 learned_addr learned my addr 172.21.15.99:0/2532254153 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:13:08.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.049+0000 7fc60d800640 1 --2- 172.21.15.99:0/2532254153 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc608070c30 0x7fc60815b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:08.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.050+0000 7fc60d800640 1 -- 172.21.15.99:0/2532254153 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc5f00037a0 msgr2=0x7fc6080fa990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:08.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.050+0000 7fc60d800640 1 --2- 172.21.15.99:0/2532254153 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fc5f00037a0 0x7fc6080fa990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:08.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.050+0000 7fc60d800640 1 -- 172.21.15.99:0/2532254153 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc60821b050 msgr2=0x7fc6080cd440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:08.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.050+0000 7fc60d800640 1 --2- 172.21.15.99:0/2532254153 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc60821b050 0x7fc6080cd440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:08.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.050+0000 7fc60d800640 1 -- 172.21.15.99:0/2532254153 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6080cd980 con 0x7fc608070c30 2024-02-21T23:13:08.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.050+0000 7fc607e00640 1 --2- 172.21.15.99:0/2532254153 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fc60821b050 0x7fc6080cd440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:13:08.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.050+0000 7fc60d800640 1 --2- 172.21.15.99:0/2532254153 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc608070c30 0x7fc60815b6e0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fc6080ca1a0 tx=0x7fc60000d520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:08.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.050+0000 7fc604c00640 1 -- 172.21.15.99:0/2532254153 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc60001a070 con 0x7fc608070c30 2024-02-21T23:13:08.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.050+0000 7fc604c00640 1 -- 172.21.15.99:0/2532254153 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc600006b50 con 0x7fc608070c30 2024-02-21T23:13:08.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.050+0000 7fc604c00640 1 -- 172.21.15.99:0/2532254153 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc60000db20 con 0x7fc608070c30 2024-02-21T23:13:08.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.050+0000 7fc60e200640 1 -- 172.21.15.99:0/2532254153 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc60815d9f0 con 0x7fc608070c30 2024-02-21T23:13:08.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.051+0000 7fc60e200640 1 -- 172.21.15.99:0/2532254153 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6080f9eb0 con 0x7fc608070c30 2024-02-21T23:13:08.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.052+0000 7fc60e200640 1 -- 172.21.15.99:0/2532254153 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc60815dcd0 con 0x7fc608070c30 2024-02-21T23:13:08.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.054+0000 7fc604c00640 1 -- 172.21.15.99:0/2532254153 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7fc60000dcc0 con 0x7fc608070c30 2024-02-21T23:13:08.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.056+0000 7fc604c00640 1 --2- 172.21.15.99:0/2532254153 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fc5e809ef00 0x7fc5e80a13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:08.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.056+0000 7fc604c00640 1 -- 172.21.15.99:0/2532254153 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 8965+0+0 (secure 0 0 0) 0x7fc6000c9fe0 con 0x7fc608070c30 2024-02-21T23:13:08.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.056+0000 7fc60ce00640 1 --2- 172.21.15.99:0/2532254153 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fc5e809ef00 0x7fc5e80a13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:08.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.057+0000 7fc604c00640 1 --2- 172.21.15.99:0/2532254153 >> [v2:172.21.15.99:6824/4055669590,v1:172.21.15.99:6825/4055669590] conn(0x7fc5e80a9f30 0x7fc5e80ac3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:08.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.057+0000 7fc604c00640 1 -- 172.21.15.99:0/2532254153 --> [v2:172.21.15.99:6824/4055669590,v1:172.21.15.99:6825/4055669590] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc60000ce50 con 0x7fc5e80a9f30 2024-02-21T23:13:08.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.057+0000 7fc604c00640 1 -- 172.21.15.99:0/2532254153 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc6000ca3b0 con 0x7fc608070c30 2024-02-21T23:13:08.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.057+0000 7fc607e00640 1 --2- 172.21.15.99:0/2532254153 >> [v2:172.21.15.99:6824/4055669590,v1:172.21.15.99:6825/4055669590] conn(0x7fc5e80a9f30 0x7fc5e80ac3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:08.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.057+0000 7fc60ce00640 1 --2- 172.21.15.99:0/2532254153 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fc5e809ef00 0x7fc5e80a13c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc001340 tx=0x7fc5fc000ef0 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:08.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.058+0000 7fc607e00640 1 --2- 172.21.15.99:0/2532254153 >> [v2:172.21.15.99:6824/4055669590,v1:172.21.15.99:6825/4055669590] conn(0x7fc5e80a9f30 0x7fc5e80ac3b0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:08.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.058+0000 7fc604c00640 1 -- 172.21.15.99:0/2532254153 <== osd.9 v2:172.21.15.99:6824/4055669590 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fc60000ce50 con 0x7fc5e80a9f30 2024-02-21T23:13:08.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.073+0000 7fc60e200640 1 -- 172.21.15.99:0/2532254153 --> [v2:172.21.15.99:6824/4055669590,v1:172.21.15.99:6825/4055669590] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc6080faed0 con 0x7fc5e80a9f30 2024-02-21T23:13:08.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.073+0000 7fc604c00640 1 -- 172.21.15.99:0/2532254153 <== osd.9 v2:172.21.15.99:6824/4055669590 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fc5f4001480 con 0x7fc5e80a9f30 2024-02-21T23:13:08.061 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-02-21T23:13:08.061 INFO:teuthology.orchestra.run.smithi099.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-21T23:13:08.061 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-02-21T23:13:08.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.074+0000 7fc60e200640 1 -- 172.21.15.99:0/2532254153 >> [v2:172.21.15.99:6824/4055669590,v1:172.21.15.99:6825/4055669590] conn(0x7fc5e80a9f30 msgr2=0x7fc5e80ac3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:08.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.074+0000 7fc60e200640 1 --2- 172.21.15.99:0/2532254153 >> [v2:172.21.15.99:6824/4055669590,v1:172.21.15.99:6825/4055669590] conn(0x7fc5e80a9f30 0x7fc5e80ac3b0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:08.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.074+0000 7fc60e200640 1 -- 172.21.15.99:0/2532254153 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fc5e809ef00 msgr2=0x7fc5e80a13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:08.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.074+0000 7fc60e200640 1 --2- 172.21.15.99:0/2532254153 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fc5e809ef00 0x7fc5e80a13c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc001340 tx=0x7fc5fc000ef0 comp rx=0 tx=0).stop 2024-02-21T23:13:08.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.074+0000 7fc60e200640 1 -- 172.21.15.99:0/2532254153 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc608070c30 msgr2=0x7fc60815b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:08.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.074+0000 7fc60e200640 1 --2- 172.21.15.99:0/2532254153 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc608070c30 0x7fc60815b6e0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fc6080ca1a0 tx=0x7fc60000d520 comp rx=0 tx=0).stop 2024-02-21T23:13:08.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.074+0000 7fc60d800640 1 -- 172.21.15.99:0/2532254153 reap_dead start 2024-02-21T23:13:08.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.074+0000 7fc60e200640 1 -- 172.21.15.99:0/2532254153 shutdown_connections 2024-02-21T23:13:08.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.074+0000 7fc60e200640 1 -- 172.21.15.99:0/2532254153 >> 172.21.15.99:0/2532254153 conn(0x7fc60808cfd0 msgr2=0x7fc608161820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:08.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.074+0000 7fc60e200640 1 -- 172.21.15.99:0/2532254153 shutdown_connections 2024-02-21T23:13:08.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.074+0000 7fc60e200640 1 -- 172.21.15.99:0/2532254153 wait complete. 2024-02-21T23:13:08.083 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 9 2024-02-21T23:13:08.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.316+0000 7f589ca00640 1 Processor -- start 2024-02-21T23:13:08.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.316+0000 7f589ca00640 1 -- start start 2024-02-21T23:13:08.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.318+0000 7f589ca00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f5898182a80 0x7f589818a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:08.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.318+0000 7f589ca00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f58980719b0 0x7f5898071e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:08.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.318+0000 7f589ca00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f589818a600 con 0x7f589818b980 2024-02-21T23:13:08.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.318+0000 7f589ca00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f589818a8e0 con 0x7f5898182a80 2024-02-21T23:13:08.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.318+0000 7f589ca00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f589818abc0 con 0x7f58980719b0 2024-02-21T23:13:08.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.319+0000 7f5895e00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f589818b980 0x7f5898186a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.99:45410/0 (socket says 172.21.15.99:45410) 2024-02-21T23:13:08.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.319+0000 7f5895e00640 1 -- 172.21.15.99:0/810718650 learned_addr learned my addr 172.21.15.99:0/810718650 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:13:08.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.319+0000 7f5897200640 1 --2- 172.21.15.99:0/810718650 >> v2:172.21.15.162:3300/0 conn(0x7f58980719b0 0x7f5898071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:08.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.319+0000 7f5896800640 1 --2- 172.21.15.99:0/810718650 >> v2:172.21.15.99:3300/0 conn(0x7f5898182a80 0x7f589818a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:08.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.319+0000 7f5896800640 1 -- 172.21.15.99:0/810718650 >> v2:172.21.15.162:3300/0 conn(0x7f58980719b0 msgr2=0x7f5898071e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:13:08.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.319+0000 7f5896800640 1 --2- 172.21.15.99:0/810718650 >> v2:172.21.15.162:3300/0 conn(0x7f58980719b0 0x7f5898071e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:08.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.319+0000 7f5896800640 1 -- 172.21.15.99:0/810718650 >> v1:172.21.15.162:6789/0 conn(0x7f589818b980 legacy=0x7f5898186a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:08.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.319+0000 7f5896800640 1 -- 172.21.15.99:0/810718650 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f589818aea0 con 0x7f5898182a80 2024-02-21T23:13:08.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.321+0000 7f5896800640 1 --2- 172.21.15.99:0/810718650 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5898182a80 0x7f589818a010 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f589818c720 tx=0x7f588802b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=739ba54890939f49 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:08.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.322+0000 7f5895400640 1 -- 172.21.15.99:0/810718650 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5888038070 con 0x7f5898182a80 2024-02-21T23:13:08.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.322+0000 7f5895400640 1 -- 172.21.15.99:0/810718650 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5888031520 con 0x7f5898182a80 2024-02-21T23:13:08.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.322+0000 7f5895400640 1 -- 172.21.15.99:0/810718650 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58880318f0 con 0x7f5898182a80 2024-02-21T23:13:08.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.323+0000 7f589ca00640 1 -- 172.21.15.99:0/810718650 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5898182a80 msgr2=0x7f589818a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:08.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.323+0000 7f589ca00640 1 --2- 172.21.15.99:0/810718650 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5898182a80 0x7f589818a010 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f589818c720 tx=0x7f588802b7c0 comp rx=0 tx=0).stop 2024-02-21T23:13:08.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.323+0000 7f589ca00640 1 -- 172.21.15.99:0/810718650 shutdown_connections 2024-02-21T23:13:08.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.323+0000 7f589ca00640 1 --2- 172.21.15.99:0/810718650 >> v2:172.21.15.162:3300/0 conn(0x7f58980719b0 0x7f5898071e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:08.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.323+0000 7f589ca00640 1 --2- 172.21.15.99:0/810718650 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f5898182a80 0x7f589818a010 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:08.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.323+0000 7f589ca00640 1 -- 172.21.15.99:0/810718650 >> 172.21.15.99:0/810718650 conn(0x7f58980d29f0 msgr2=0x7f58980d2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:08.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.323+0000 7f589ca00640 1 -- 172.21.15.99:0/810718650 shutdown_connections 2024-02-21T23:13:08.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.323+0000 7f589ca00640 1 -- 172.21.15.99:0/810718650 wait complete. 2024-02-21T23:13:08.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.325+0000 7f589ca00640 1 Processor -- start 2024-02-21T23:13:08.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.325+0000 7f589ca00640 1 -- start start 2024-02-21T23:13:08.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.327+0000 7f589ca00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58980719b0 0x7f58980d5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:08.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.327+0000 7f589ca00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5898182a80 0x7f58980f46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:08.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.328+0000 7f589ca00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f589818b980 0x7f58980d4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:08.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.328+0000 7f589ca00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f589818be00 con 0x7f589818b980 2024-02-21T23:13:08.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.328+0000 7f589ca00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f589818b460 con 0x7f58980719b0 2024-02-21T23:13:08.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.328+0000 7f589ca00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5898182e60 con 0x7f5898182a80 2024-02-21T23:13:08.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.328+0000 7f5896800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58980719b0 0x7f58980d5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:08.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.328+0000 7f5896800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58980719b0 0x7f58980d5c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:56080/0 (socket says 172.21.15.99:56080) 2024-02-21T23:13:08.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.328+0000 7f5896800640 1 -- 172.21.15.99:0/2071775766 learned_addr learned my addr 172.21.15.99:0/2071775766 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:13:08.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.328+0000 7f5895e00640 1 --2- 172.21.15.99:0/2071775766 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5898182a80 0x7f58980f46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:08.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.328+0000 7f5897200640 1 --2- 172.21.15.99:0/2071775766 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f589818b980 0x7f58980d4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:08.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.328+0000 7f5896800640 1 -- 172.21.15.99:0/2071775766 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5898182a80 msgr2=0x7f58980f46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:08.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.328+0000 7f5896800640 1 --2- 172.21.15.99:0/2071775766 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5898182a80 0x7f58980f46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:08.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.328+0000 7f5896800640 1 -- 172.21.15.99:0/2071775766 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f589818b980 msgr2=0x7f58980d4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:08.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.328+0000 7f5896800640 1 --2- 172.21.15.99:0/2071775766 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f589818b980 0x7f58980d4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:08.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.328+0000 7f5896800640 1 -- 172.21.15.99:0/2071775766 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58980d4ad0 con 0x7f58980719b0 2024-02-21T23:13:08.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.329+0000 7f5896800640 1 --2- 172.21.15.99:0/2071775766 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58980719b0 0x7f58980d5c40 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f5888000c00 tx=0x7f58880046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:08.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.330+0000 7f588ea00640 1 -- 172.21.15.99:0/2071775766 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5888042070 con 0x7f58980719b0 2024-02-21T23:13:08.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.330+0000 7f588ea00640 1 -- 172.21.15.99:0/2071775766 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f588803d890 con 0x7f58980719b0 2024-02-21T23:13:08.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.330+0000 7f589ca00640 1 -- 172.21.15.99:0/2071775766 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58980d4db0 con 0x7f58980719b0 2024-02-21T23:13:08.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.330+0000 7f588ea00640 1 -- 172.21.15.99:0/2071775766 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5888038040 con 0x7f58980719b0 2024-02-21T23:13:08.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.330+0000 7f589ca00640 1 -- 172.21.15.99:0/2071775766 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58982208c0 con 0x7f58980719b0 2024-02-21T23:13:08.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.331+0000 7f589ca00640 1 -- 172.21.15.99:0/2071775766 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5898072f40 con 0x7f58980719b0 2024-02-21T23:13:08.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.333+0000 7f588ea00640 1 -- 172.21.15.99:0/2071775766 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f5888045070 con 0x7f58980719b0 2024-02-21T23:13:08.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.335+0000 7f588ea00640 1 --2- 172.21.15.99:0/2071775766 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f587809eed0 0x7f58780a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:08.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.335+0000 7f588ea00640 1 -- 172.21.15.99:0/2071775766 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 8965+0+0 (secure 0 0 0) 0x7f58880ebbe0 con 0x7f58980719b0 2024-02-21T23:13:08.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.335+0000 7f5895e00640 1 --2- 172.21.15.99:0/2071775766 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f587809eed0 0x7f58780a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:08.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.336+0000 7f5895e00640 1 --2- 172.21.15.99:0/2071775766 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f587809eed0 0x7f58780a1390 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f58980fb170 tx=0x7f5884009040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:08.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.338+0000 7f588ea00640 1 -- 172.21.15.99:0/2071775766 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f5898072f40 con 0x7f58980719b0 2024-02-21T23:13:08.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.583+0000 7f589ca00640 1 -- 172.21.15.99:0/2071775766 --> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "9", "target": ["mon-mgr", ""]}) v1 -- 0x7f5898068320 con 0x7f587809eed0 2024-02-21T23:13:08.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.584+0000 7f588ea00640 1 -- 172.21.15.99:0/2071775766 <== mgr.5131 v2:172.21.15.162:6800/631076050 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 9 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f5898068320 con 0x7f587809eed0 2024-02-21T23:13:08.571 INFO:teuthology.orchestra.run.smithi099.stderr:instructed osd(s) 9 to deep-scrub 2024-02-21T23:13:08.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.586+0000 7f589ca00640 1 -- 172.21.15.99:0/2071775766 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f587809eed0 msgr2=0x7f58780a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:08.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.586+0000 7f589ca00640 1 --2- 172.21.15.99:0/2071775766 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f587809eed0 0x7f58780a1390 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f58980fb170 tx=0x7f5884009040 comp rx=0 tx=0).stop 2024-02-21T23:13:08.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.586+0000 7f589ca00640 1 -- 172.21.15.99:0/2071775766 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58980719b0 msgr2=0x7f58980d5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:08.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.586+0000 7f589ca00640 1 --2- 172.21.15.99:0/2071775766 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58980719b0 0x7f58980d5c40 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f5888000c00 tx=0x7f58880046c0 comp rx=0 tx=0).stop 2024-02-21T23:13:08.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.587+0000 7f589ca00640 1 -- 172.21.15.99:0/2071775766 shutdown_connections 2024-02-21T23:13:08.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.587+0000 7f589ca00640 1 --2- 172.21.15.99:0/2071775766 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f587809eed0 0x7f58780a1390 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:08.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.587+0000 7f589ca00640 1 --2- 172.21.15.99:0/2071775766 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f589818b980 0x7f58980d4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:08.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.587+0000 7f589ca00640 1 --2- 172.21.15.99:0/2071775766 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f5898182a80 0x7f58980f46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:08.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.587+0000 7f589ca00640 1 --2- 172.21.15.99:0/2071775766 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58980719b0 0x7f58980d5c40 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:08.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.587+0000 7f589ca00640 1 -- 172.21.15.99:0/2071775766 >> 172.21.15.99:0/2071775766 conn(0x7f58980d29f0 msgr2=0x7f589818bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:08.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.587+0000 7f589ca00640 1 -- 172.21.15.99:0/2071775766 shutdown_connections 2024-02-21T23:13:08.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.587+0000 7f589ca00640 1 -- 172.21.15.99:0/2071775766 wait complete. 2024-02-21T23:13:08.596 INFO:tasks.ceph:Scrubbing osd.1 2024-02-21T23:13:08.597 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-02-21T23:13:08.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.833+0000 7f3ef5000640 1 Processor -- start 2024-02-21T23:13:08.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.834+0000 7f3ef5000640 1 -- start start 2024-02-21T23:13:08.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.835+0000 7f3ef5000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f3ef017f710 0x7f3ef0189f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:08.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.835+0000 7f3ef5000640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f3ef0071c20 0x7f3ef0072080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:08.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.835+0000 7f3ef5000640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ef018a5a0 con 0x7f3ef018b920 2024-02-21T23:13:08.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.835+0000 7f3ef5000640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ef018bda0 con 0x7f3ef017f710 2024-02-21T23:13:08.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.835+0000 7f3ef5000640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ef018a880 con 0x7f3ef0071c20 2024-02-21T23:13:08.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.836+0000 7f3eef400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f3ef017f710 0x7f3ef0189f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:08.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.836+0000 7f3eef400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f3ef017f710 0x7f3ef0189f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56042/0 (socket says 172.21.15.99:56042) 2024-02-21T23:13:08.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.836+0000 7f3eef400640 1 -- 172.21.15.99:0/932916692 learned_addr learned my addr 172.21.15.99:0/932916692 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:13:08.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.836+0000 7f3eeea00640 1 --1- 172.21.15.99:0/932916692 >> v1:172.21.15.162:6789/0 conn(0x7f3ef018b920 0x7f3ef015e490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.99:45422/0 (socket says 172.21.15.99:45422) 2024-02-21T23:13:08.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.836+0000 7f3eefe00640 1 --2- 172.21.15.99:0/932916692 >> v2:172.21.15.181:3300/0 conn(0x7f3ef0071c20 0x7f3ef0072080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:08.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.836+0000 7f3eee000640 1 -- 172.21.15.99:0/932916692 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1467582113 0 0) 0x7f3ef018a5a0 con 0x7f3ef018b920 2024-02-21T23:13:08.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.836+0000 7f3eee000640 1 -- 172.21.15.99:0/932916692 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ed4003520 con 0x7f3ef018b920 2024-02-21T23:13:08.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.836+0000 7f3eef400640 1 -- 172.21.15.99:0/932916692 >> v2:172.21.15.181:3300/0 conn(0x7f3ef0071c20 msgr2=0x7f3ef0072080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:13:08.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.836+0000 7f3eef400640 1 --2- 172.21.15.99:0/932916692 >> v2:172.21.15.181:3300/0 conn(0x7f3ef0071c20 0x7f3ef0072080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:08.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.836+0000 7f3eef400640 1 -- 172.21.15.99:0/932916692 >> v1:172.21.15.162:6789/0 conn(0x7f3ef018b920 legacy=0x7f3ef015e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:08.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.836+0000 7f3eef400640 1 -- 172.21.15.99:0/932916692 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ef018ab60 con 0x7f3ef017f710 2024-02-21T23:13:08.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.838+0000 7f3eef400640 1 --2- 172.21.15.99:0/932916692 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ef017f710 0x7f3ef0189f40 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f3ef00ff3e0 tx=0x7f3ee002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce36a2c1111732cd server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:08.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.838+0000 7f3eee000640 1 -- 172.21.15.99:0/932916692 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee0034070 con 0x7f3ef017f710 2024-02-21T23:13:08.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.838+0000 7f3eee000640 1 -- 172.21.15.99:0/932916692 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ee0030860 con 0x7f3ef017f710 2024-02-21T23:13:08.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.838+0000 7f3eee000640 1 -- 172.21.15.99:0/932916692 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee0030c30 con 0x7f3ef017f710 2024-02-21T23:13:08.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.839+0000 7f3ef5000640 1 -- 172.21.15.99:0/932916692 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ef017f710 msgr2=0x7f3ef0189f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:08.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.839+0000 7f3ef5000640 1 --2- 172.21.15.99:0/932916692 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ef017f710 0x7f3ef0189f40 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f3ef00ff3e0 tx=0x7f3ee002b9a0 comp rx=0 tx=0).stop 2024-02-21T23:13:08.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.839+0000 7f3ef5000640 1 -- 172.21.15.99:0/932916692 shutdown_connections 2024-02-21T23:13:08.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.839+0000 7f3ef5000640 1 --2- 172.21.15.99:0/932916692 >> v2:172.21.15.181:3300/0 conn(0x7f3ef0071c20 0x7f3ef0072080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:08.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.839+0000 7f3ef5000640 1 --2- 172.21.15.99:0/932916692 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ef017f710 0x7f3ef0189f40 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:08.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.839+0000 7f3ef5000640 1 -- 172.21.15.99:0/932916692 >> 172.21.15.99:0/932916692 conn(0x7f3ef00fe310 msgr2=0x7f3ef00fe720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:08.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.839+0000 7f3ef5000640 1 -- 172.21.15.99:0/932916692 shutdown_connections 2024-02-21T23:13:08.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.839+0000 7f3ef5000640 1 -- 172.21.15.99:0/932916692 wait complete. 2024-02-21T23:13:08.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.841+0000 7f3ef5000640 1 Processor -- start 2024-02-21T23:13:08.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.841+0000 7f3ef5000640 1 -- start start 2024-02-21T23:13:08.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.843+0000 7f3ef5000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3ef0071c20 0x7f3ef00fc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:08.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.843+0000 7f3ef5000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ef017f710 0x7f3ef0177b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:08.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.843+0000 7f3ef5000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ef018b920 0x7f3ef0160090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:08.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.843+0000 7f3ef5000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef00d4ff0 con 0x7f3ef018b920 2024-02-21T23:13:08.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.843+0000 7f3ef5000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef018b120 con 0x7f3ef017f710 2024-02-21T23:13:08.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.843+0000 7f3ef5000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef00d5170 con 0x7f3ef0071c20 2024-02-21T23:13:08.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.843+0000 7f3eefe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ef018b920 0x7f3ef0160090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:08.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.843+0000 7f3eef400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3ef0071c20 0x7f3ef00fc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:08.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.843+0000 7f3eef400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3ef0071c20 0x7f3ef00fc7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:37166/0 (socket says 172.21.15.99:37166) 2024-02-21T23:13:08.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.843+0000 7f3eef400640 1 -- 172.21.15.99:0/179811717 learned_addr learned my addr 172.21.15.99:0/179811717 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:13:08.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.843+0000 7f3eeea00640 1 --2- 172.21.15.99:0/179811717 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ef017f710 0x7f3ef0177b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:08.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.843+0000 7f3eefe00640 1 -- 172.21.15.99:0/179811717 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3ef0071c20 msgr2=0x7f3ef00fc7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:08.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.843+0000 7f3eefe00640 1 --2- 172.21.15.99:0/179811717 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f3ef0071c20 0x7f3ef00fc7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:08.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.843+0000 7f3eefe00640 1 -- 172.21.15.99:0/179811717 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ef017f710 msgr2=0x7f3ef0177b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:08.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.843+0000 7f3eefe00640 1 --2- 172.21.15.99:0/179811717 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ef017f710 0x7f3ef0177b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:08.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.843+0000 7f3eefe00640 1 -- 172.21.15.99:0/179811717 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ef0178050 con 0x7f3ef018b920 2024-02-21T23:13:08.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.844+0000 7f3eefe00640 1 --2- 172.21.15.99:0/179811717 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ef018b920 0x7f3ef0160090 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f3ee800efc0 tx=0x7f3ee800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:08.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.844+0000 7f3ee7400640 1 -- 172.21.15.99:0/179811717 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee8018020 con 0x7f3ef018b920 2024-02-21T23:13:08.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.844+0000 7f3ee7400640 1 -- 172.21.15.99:0/179811717 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ee8014480 con 0x7f3ef018b920 2024-02-21T23:13:08.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.844+0000 7f3ee7400640 1 -- 172.21.15.99:0/179811717 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee8014870 con 0x7f3ef018b920 2024-02-21T23:13:08.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.844+0000 7f3ef5000640 1 -- 172.21.15.99:0/179811717 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ef0178320 con 0x7f3ef018b920 2024-02-21T23:13:08.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.844+0000 7f3ef5000640 1 -- 172.21.15.99:0/179811717 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ef01788e0 con 0x7f3ef018b920 2024-02-21T23:13:08.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.846+0000 7f3ef5000640 1 -- 172.21.15.99:0/179811717 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3ef00682b0 con 0x7f3ef018b920 2024-02-21T23:13:08.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.849+0000 7f3ee7400640 1 -- 172.21.15.99:0/179811717 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f3ee8005d10 con 0x7f3ef018b920 2024-02-21T23:13:08.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.850+0000 7f3ee7400640 1 --2- 172.21.15.99:0/179811717 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f3ed009efa0 0x7f3ed00a1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:08.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.850+0000 7f3ee7400640 1 -- 172.21.15.99:0/179811717 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 8965+0+0 (secure 0 0 0) 0x7f3ee80cb6f0 con 0x7f3ef018b920 2024-02-21T23:13:08.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.851+0000 7f3ee7400640 1 --2- 172.21.15.99:0/179811717 >> [v2:172.21.15.162:6826/3030871566,v1:172.21.15.162:6827/3030871566] conn(0x7f3ed00a9fe0 0x7f3ed00ac460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:08.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.851+0000 7f3ee7400640 1 -- 172.21.15.99:0/179811717 --> [v2:172.21.15.162:6826/3030871566,v1:172.21.15.162:6827/3030871566] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3ed00acb30 con 0x7f3ed00a9fe0 2024-02-21T23:13:08.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.851+0000 7f3ee7400640 1 -- 172.21.15.99:0/179811717 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3ee80cbb40 con 0x7f3ef018b920 2024-02-21T23:13:08.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.851+0000 7f3eef400640 1 --2- 172.21.15.99:0/179811717 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f3ed009efa0 0x7f3ed00a1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:08.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.851+0000 7f3eeea00640 1 --2- 172.21.15.99:0/179811717 >> [v2:172.21.15.162:6826/3030871566,v1:172.21.15.162:6827/3030871566] conn(0x7f3ed00a9fe0 0x7f3ed00ac460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:08.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.852+0000 7f3eef400640 1 --2- 172.21.15.99:0/179811717 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f3ed009efa0 0x7f3ed00a1460 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3ee0009630 tx=0x7f3ee0008030 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:08.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.852+0000 7f3eeea00640 1 --2- 172.21.15.99:0/179811717 >> [v2:172.21.15.162:6826/3030871566,v1:172.21.15.162:6827/3030871566] conn(0x7f3ed00a9fe0 0x7f3ed00ac460 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:08.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.853+0000 7f3ee7400640 1 -- 172.21.15.99:0/179811717 <== osd.1 v2:172.21.15.162:6826/3030871566 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f3ed00acb30 con 0x7f3ed00a9fe0 2024-02-21T23:13:08.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.881+0000 7f3ef5000640 1 -- 172.21.15.99:0/179811717 --> [v2:172.21.15.162:6826/3030871566,v1:172.21.15.162:6827/3030871566] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f3ef00d6ca0 con 0x7f3ed00a9fe0 2024-02-21T23:13:08.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.882+0000 7f3ee7400640 1 -- 172.21.15.99:0/179811717 <== osd.1 v2:172.21.15.162:6826/3030871566 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f3ef00d6ca0 con 0x7f3ed00a9fe0 2024-02-21T23:13:08.870 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-02-21T23:13:08.870 INFO:teuthology.orchestra.run.smithi099.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-21T23:13:08.870 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-02-21T23:13:08.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.882+0000 7f3ef5000640 1 -- 172.21.15.99:0/179811717 >> [v2:172.21.15.162:6826/3030871566,v1:172.21.15.162:6827/3030871566] conn(0x7f3ed00a9fe0 msgr2=0x7f3ed00ac460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:08.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.882+0000 7f3ef5000640 1 --2- 172.21.15.99:0/179811717 >> [v2:172.21.15.162:6826/3030871566,v1:172.21.15.162:6827/3030871566] conn(0x7f3ed00a9fe0 0x7f3ed00ac460 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:08.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.882+0000 7f3ef5000640 1 -- 172.21.15.99:0/179811717 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f3ed009efa0 msgr2=0x7f3ed00a1460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:08.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.882+0000 7f3ef5000640 1 --2- 172.21.15.99:0/179811717 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f3ed009efa0 0x7f3ed00a1460 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3ee0009630 tx=0x7f3ee0008030 comp rx=0 tx=0).stop 2024-02-21T23:13:08.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.882+0000 7f3ef5000640 1 -- 172.21.15.99:0/179811717 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ef018b920 msgr2=0x7f3ef0160090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:08.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.882+0000 7f3ef5000640 1 --2- 172.21.15.99:0/179811717 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f3ef018b920 0x7f3ef0160090 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f3ee800efc0 tx=0x7f3ee800c490 comp rx=0 tx=0).stop 2024-02-21T23:13:08.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.882+0000 7f3eefe00640 1 -- 172.21.15.99:0/179811717 reap_dead start 2024-02-21T23:13:08.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.882+0000 7f3ef5000640 1 -- 172.21.15.99:0/179811717 shutdown_connections 2024-02-21T23:13:08.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.882+0000 7f3ef5000640 1 -- 172.21.15.99:0/179811717 >> 172.21.15.99:0/179811717 conn(0x7f3ef00fe310 msgr2=0x7f3ef00fce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:08.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.883+0000 7f3ef5000640 1 -- 172.21.15.99:0/179811717 shutdown_connections 2024-02-21T23:13:08.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:08.883+0000 7f3ef5000640 1 -- 172.21.15.99:0/179811717 wait complete. 2024-02-21T23:13:08.887 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-02-21T23:13:09.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.101+0000 7f24df400640 1 Processor -- start 2024-02-21T23:13:09.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.101+0000 7f24df400640 1 -- start start 2024-02-21T23:13:09.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.104+0000 7f24df400640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f24d8182b80 0x7f24d80f8020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:09.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.104+0000 7f24df400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f24d80f5860 0x7f24d80f5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:09.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.104+0000 7f24df400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24d80f8c60 con 0x7f24d80f9d00 2024-02-21T23:13:09.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.104+0000 7f24df400640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24d8070300 con 0x7f24d80f5860 2024-02-21T23:13:09.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.104+0000 7f24df400640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24d80f8f40 con 0x7f24d8182b80 2024-02-21T23:13:09.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.104+0000 7f24d7e00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f24d80f9d00 0x7f24d80c95a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.99:45426/0 (socket says 172.21.15.99:45426) 2024-02-21T23:13:09.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.104+0000 7f24dd400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f24d80f5860 0x7f24d80f5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:09.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.104+0000 7f24d7e00640 1 -- 172.21.15.99:0/683761904 learned_addr learned my addr 172.21.15.99:0/683761904 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:13:09.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.104+0000 7f24dca00640 1 --2- 172.21.15.99:0/683761904 >> v2:172.21.15.181:3300/0 conn(0x7f24d8182b80 0x7f24d80f8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:09.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.105+0000 7f24d7400640 1 -- 172.21.15.99:0/683761904 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 982970040 0 0) 0x7f24d80f8c60 con 0x7f24d80f9d00 2024-02-21T23:13:09.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.105+0000 7f24d7400640 1 -- 172.21.15.99:0/683761904 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24c0003520 con 0x7f24d80f9d00 2024-02-21T23:13:09.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.105+0000 7f24dd400640 1 -- 172.21.15.99:0/683761904 >> v2:172.21.15.181:3300/0 conn(0x7f24d8182b80 msgr2=0x7f24d80f8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:13:09.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.105+0000 7f24dd400640 1 --2- 172.21.15.99:0/683761904 >> v2:172.21.15.181:3300/0 conn(0x7f24d8182b80 0x7f24d80f8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:09.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.105+0000 7f24dd400640 1 -- 172.21.15.99:0/683761904 >> v1:172.21.15.162:6789/0 conn(0x7f24d80f9d00 legacy=0x7f24d80c95a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:09.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.105+0000 7f24dd400640 1 -- 172.21.15.99:0/683761904 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24d80f9220 con 0x7f24d80f5860 2024-02-21T23:13:09.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.105+0000 7f24dca00640 1 --2- 172.21.15.99:0/683761904 >> v2:172.21.15.181:3300/0 conn(0x7f24d8182b80 0x7f24d80f8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:13:09.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.107+0000 7f24dd400640 1 --2- 172.21.15.99:0/683761904 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f24d80f5860 0x7f24d80f5cf0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f24d8075120 tx=0x7f24d002bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=609145b940ad7dc6 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:09.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.107+0000 7f24d7400640 1 -- 172.21.15.99:0/683761904 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d0039070 con 0x7f24d80f5860 2024-02-21T23:13:09.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.107+0000 7f24d7400640 1 -- 172.21.15.99:0/683761904 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24d002cb50 con 0x7f24d80f5860 2024-02-21T23:13:09.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.107+0000 7f24d7400640 1 -- 172.21.15.99:0/683761904 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d0034440 con 0x7f24d80f5860 2024-02-21T23:13:09.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.108+0000 7f24df400640 1 -- 172.21.15.99:0/683761904 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f24d80f5860 msgr2=0x7f24d80f5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:09.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.108+0000 7f24df400640 1 --2- 172.21.15.99:0/683761904 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f24d80f5860 0x7f24d80f5cf0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f24d8075120 tx=0x7f24d002bda0 comp rx=0 tx=0).stop 2024-02-21T23:13:09.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.108+0000 7f24df400640 1 -- 172.21.15.99:0/683761904 shutdown_connections 2024-02-21T23:13:09.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.108+0000 7f24df400640 1 --2- 172.21.15.99:0/683761904 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f24d80f5860 0x7f24d80f5cf0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:09.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.108+0000 7f24df400640 1 --2- 172.21.15.99:0/683761904 >> v2:172.21.15.181:3300/0 conn(0x7f24d8182b80 0x7f24d80f8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:09.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.108+0000 7f24df400640 1 -- 172.21.15.99:0/683761904 >> 172.21.15.99:0/683761904 conn(0x7f24d80ce5f0 msgr2=0x7f24d80cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:09.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.108+0000 7f24df400640 1 -- 172.21.15.99:0/683761904 shutdown_connections 2024-02-21T23:13:09.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.108+0000 7f24df400640 1 -- 172.21.15.99:0/683761904 wait complete. 2024-02-21T23:13:09.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.111+0000 7f24df400640 1 Processor -- start 2024-02-21T23:13:09.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.111+0000 7f24df400640 1 -- start start 2024-02-21T23:13:09.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.113+0000 7f24df400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f24d80f5860 0x7f24d816acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:09.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.113+0000 7f24df400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f24d80f9d00 0x7f24d806ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:09.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.113+0000 7f24df400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f24d8182b80 0x7f24d80ccc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:09.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.113+0000 7f24df400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24d81860c0 con 0x7f24d80f9d00 2024-02-21T23:13:09.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.113+0000 7f24df400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24d80f97e0 con 0x7f24d8182b80 2024-02-21T23:13:09.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.114+0000 7f24df400640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24d80f8560 con 0x7f24d80f5860 2024-02-21T23:13:09.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.114+0000 7f24dca00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f24d80f5860 0x7f24d816acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:09.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.114+0000 7f24dca00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f24d80f5860 0x7f24d816acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:37184/0 (socket says 172.21.15.99:37184) 2024-02-21T23:13:09.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.114+0000 7f24dca00640 1 -- 172.21.15.99:0/521790094 learned_addr learned my addr 172.21.15.99:0/521790094 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:13:09.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.114+0000 7f24d7e00640 1 --2- 172.21.15.99:0/521790094 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f24d80f9d00 0x7f24d806ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:09.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.114+0000 7f24dca00640 1 -- 172.21.15.99:0/521790094 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f24d8182b80 msgr2=0x7f24d80ccc40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-02-21T23:13:09.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.114+0000 7f24dca00640 1 --2- 172.21.15.99:0/521790094 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f24d8182b80 0x7f24d80ccc40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:09.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.114+0000 7f24dca00640 1 -- 172.21.15.99:0/521790094 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f24d80f9d00 msgr2=0x7f24d806ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:09.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.114+0000 7f24dca00640 1 --2- 172.21.15.99:0/521790094 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f24d80f9d00 0x7f24d806ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:09.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.114+0000 7f24dca00640 1 -- 172.21.15.99:0/521790094 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24d81820f0 con 0x7f24d80f5860 2024-02-21T23:13:09.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.115+0000 7f24dca00640 1 --2- 172.21.15.99:0/521790094 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f24d80f5860 0x7f24d816acb0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f24cc00ec40 tx=0x7f24cc00c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:09.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.115+0000 7f24d4c00640 1 -- 172.21.15.99:0/521790094 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24cc017070 con 0x7f24d80f5860 2024-02-21T23:13:09.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.115+0000 7f24d4c00640 1 -- 172.21.15.99:0/521790094 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24cc00cbd0 con 0x7f24d80f5860 2024-02-21T23:13:09.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.115+0000 7f24df400640 1 -- 172.21.15.99:0/521790094 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24d806bc70 con 0x7f24d80f5860 2024-02-21T23:13:09.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.115+0000 7f24d4c00640 1 -- 172.21.15.99:0/521790094 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24cc013470 con 0x7f24d80f5860 2024-02-21T23:13:09.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.115+0000 7f24df400640 1 -- 172.21.15.99:0/521790094 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24d806c230 con 0x7f24d80f5860 2024-02-21T23:13:09.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.117+0000 7f24df400640 1 -- 172.21.15.99:0/521790094 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24d80cc1c0 con 0x7f24d80f5860 2024-02-21T23:13:09.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.120+0000 7f24d4c00640 1 -- 172.21.15.99:0/521790094 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f24cc01a070 con 0x7f24d80f5860 2024-02-21T23:13:09.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.122+0000 7f24d4c00640 1 --2- 172.21.15.99:0/521790094 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f24b809ef80 0x7f24b80a1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:09.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.122+0000 7f24d4c00640 1 -- 172.21.15.99:0/521790094 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 8965+0+0 (secure 0 0 0) 0x7f24cc0ca1a0 con 0x7f24d80f5860 2024-02-21T23:13:09.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.122+0000 7f24d7e00640 1 --2- 172.21.15.99:0/521790094 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f24b809ef80 0x7f24b80a1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:09.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.123+0000 7f24d7e00640 1 --2- 172.21.15.99:0/521790094 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f24b809ef80 0x7f24b80a1440 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f24d80cb710 tx=0x7f24c4009040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:09.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.125+0000 7f24d4c00640 1 -- 172.21.15.99:0/521790094 <== mon.2 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f24cc098120 con 0x7f24d80f5860 2024-02-21T23:13:09.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.347+0000 7f24df400640 1 -- 172.21.15.99:0/521790094 --> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f24d80cca20 con 0x7f24b809ef80 2024-02-21T23:13:09.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.348+0000 7f24d4c00640 1 -- 172.21.15.99:0/521790094 <== mgr.5131 v2:172.21.15.162:6800/631076050 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f24d80cca20 con 0x7f24b809ef80 2024-02-21T23:13:09.336 INFO:teuthology.orchestra.run.smithi099.stderr:instructed osd(s) 1 to deep-scrub 2024-02-21T23:13:09.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.351+0000 7f24df400640 1 -- 172.21.15.99:0/521790094 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f24b809ef80 msgr2=0x7f24b80a1440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:09.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.351+0000 7f24df400640 1 --2- 172.21.15.99:0/521790094 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f24b809ef80 0x7f24b80a1440 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f24d80cb710 tx=0x7f24c4009040 comp rx=0 tx=0).stop 2024-02-21T23:13:09.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.351+0000 7f24df400640 1 -- 172.21.15.99:0/521790094 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f24d80f5860 msgr2=0x7f24d816acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:09.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.351+0000 7f24df400640 1 --2- 172.21.15.99:0/521790094 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f24d80f5860 0x7f24d816acb0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f24cc00ec40 tx=0x7f24cc00c520 comp rx=0 tx=0).stop 2024-02-21T23:13:09.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.351+0000 7f24df400640 1 -- 172.21.15.99:0/521790094 shutdown_connections 2024-02-21T23:13:09.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.351+0000 7f24df400640 1 --2- 172.21.15.99:0/521790094 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f24b809ef80 0x7f24b80a1440 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:09.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.351+0000 7f24df400640 1 --2- 172.21.15.99:0/521790094 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f24d8182b80 0x7f24d80ccc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:09.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.351+0000 7f24df400640 1 --2- 172.21.15.99:0/521790094 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f24d80f9d00 0x7f24d806ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:09.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.351+0000 7f24df400640 1 --2- 172.21.15.99:0/521790094 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f24d80f5860 0x7f24d816acb0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:09.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.351+0000 7f24df400640 1 -- 172.21.15.99:0/521790094 >> 172.21.15.99:0/521790094 conn(0x7f24d80ce5f0 msgr2=0x7f24d80f6120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:09.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.351+0000 7f24df400640 1 -- 172.21.15.99:0/521790094 shutdown_connections 2024-02-21T23:13:09.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.352+0000 7f24df400640 1 -- 172.21.15.99:0/521790094 wait complete. 2024-02-21T23:13:09.357 INFO:tasks.ceph:Scrubbing osd.4 2024-02-21T23:13:09.357 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-02-21T23:13:09.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.613+0000 7feddbe00640 1 Processor -- start 2024-02-21T23:13:09.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.613+0000 7feddbe00640 1 -- start start 2024-02-21T23:13:09.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.616+0000 7feddbe00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fedd417f5e0 0x7fedd4071e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:09.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.616+0000 7feddbe00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedd40727f0 con 0x7fedd4187c90 2024-02-21T23:13:09.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.616+0000 7feddbe00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedd40cfeb0 con 0x7fedd4072370 2024-02-21T23:13:09.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.616+0000 7feddbe00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedd4186b30 con 0x7fedd417f5e0 2024-02-21T23:13:09.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.617+0000 7fedd9e00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fedd4187c90 0x7fedd40cee80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:58204/0 (socket says 172.21.15.99:58204) 2024-02-21T23:13:09.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.617+0000 7fedd9e00640 1 -- 172.21.15.99:0/2273413682 learned_addr learned my addr 172.21.15.99:0/2273413682 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:13:09.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.617+0000 7fedd9400640 1 --2- 172.21.15.99:0/2273413682 >> v2:172.21.15.181:3300/0 conn(0x7fedd417f5e0 0x7fedd4071e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:09.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.617+0000 7fedd3e00640 1 -- 172.21.15.99:0/2273413682 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4240794792 0 0) 0x7fedd40727f0 con 0x7fedd4187c90 2024-02-21T23:13:09.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.617+0000 7fedd9400640 1 -- 172.21.15.99:0/2273413682 >> v1:172.21.15.181:6789/0 conn(0x7fedd4072370 legacy=0x7fedd4187580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:09.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.617+0000 7fedd9400640 1 -- 172.21.15.99:0/2273413682 >> v1:172.21.15.99:6789/0 conn(0x7fedd4187c90 legacy=0x7fedd40cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:09.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.618+0000 7fedd9400640 1 -- 172.21.15.99:0/2273413682 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedd40d0190 con 0x7fedd417f5e0 2024-02-21T23:13:09.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.620+0000 7fedd9400640 1 --2- 172.21.15.99:0/2273413682 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fedd417f5e0 0x7fedd4071e30 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fedc8009720 tx=0x7fedc802b6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1e46a50ae71a69d server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:09.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.620+0000 7fedd3e00640 1 -- 172.21.15.99:0/2273413682 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc8037070 con 0x7fedd417f5e0 2024-02-21T23:13:09.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.620+0000 7fedd3e00640 1 -- 172.21.15.99:0/2273413682 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedc8030710 con 0x7fedd417f5e0 2024-02-21T23:13:09.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.620+0000 7fedd3e00640 1 -- 172.21.15.99:0/2273413682 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc8030ae0 con 0x7fedd417f5e0 2024-02-21T23:13:09.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.621+0000 7feddbe00640 1 -- 172.21.15.99:0/2273413682 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fedd417f5e0 msgr2=0x7fedd4071e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:09.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.621+0000 7feddbe00640 1 --2- 172.21.15.99:0/2273413682 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fedd417f5e0 0x7fedd4071e30 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fedc8009720 tx=0x7fedc802b6a0 comp rx=0 tx=0).stop 2024-02-21T23:13:09.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.621+0000 7feddbe00640 1 -- 172.21.15.99:0/2273413682 shutdown_connections 2024-02-21T23:13:09.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.621+0000 7feddbe00640 1 --2- 172.21.15.99:0/2273413682 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fedd417f5e0 0x7fedd4071e30 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:09.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.621+0000 7feddbe00640 1 -- 172.21.15.99:0/2273413682 >> 172.21.15.99:0/2273413682 conn(0x7fedd40fe610 msgr2=0x7fedd40fea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:09.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.621+0000 7feddbe00640 1 -- 172.21.15.99:0/2273413682 shutdown_connections 2024-02-21T23:13:09.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.621+0000 7feddbe00640 1 -- 172.21.15.99:0/2273413682 wait complete. 2024-02-21T23:13:09.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.623+0000 7feddbe00640 1 Processor -- start 2024-02-21T23:13:09.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.623+0000 7feddbe00640 1 -- start start 2024-02-21T23:13:09.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.624+0000 7feddbe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fedd4072370 0x7fedd40d2670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:09.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.624+0000 7feddbe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fedd417f5e0 0x7fedd4168390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:09.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.624+0000 7feddbe00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fedd4187c90 0x7fedd4188bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:09.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.624+0000 7feddbe00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedd4187060 con 0x7fedd4072370 2024-02-21T23:13:09.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.624+0000 7feddbe00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedd4186d80 con 0x7fedd417f5e0 2024-02-21T23:13:09.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.624+0000 7feddbe00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedd417f9c0 con 0x7fedd4187c90 2024-02-21T23:13:09.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.625+0000 7fedd9400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fedd4072370 0x7fedd40d2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:09.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.625+0000 7fedd9400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fedd4072370 0x7fedd40d2670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56074/0 (socket says 172.21.15.99:56074) 2024-02-21T23:13:09.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.625+0000 7fedd9400640 1 -- 172.21.15.99:0/2917460191 learned_addr learned my addr 172.21.15.99:0/2917460191 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:13:09.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.625+0000 7fedd9e00640 1 --2- 172.21.15.99:0/2917460191 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fedd4187c90 0x7fedd4188bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:09.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.625+0000 7fedd8a00640 1 --2- 172.21.15.99:0/2917460191 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fedd417f5e0 0x7fedd4168390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:09.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.625+0000 7fedd9400640 1 -- 172.21.15.99:0/2917460191 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fedd4187c90 msgr2=0x7fedd4188bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:09.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.625+0000 7fedd9400640 1 --2- 172.21.15.99:0/2917460191 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fedd4187c90 0x7fedd4188bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:09.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.625+0000 7fedd9400640 1 -- 172.21.15.99:0/2917460191 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fedd417f5e0 msgr2=0x7fedd4168390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:09.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.625+0000 7fedd9400640 1 --2- 172.21.15.99:0/2917460191 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fedd417f5e0 0x7fedd4168390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:09.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.625+0000 7fedd9400640 1 -- 172.21.15.99:0/2917460191 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedd40d12f0 con 0x7fedd4072370 2024-02-21T23:13:09.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.625+0000 7fedd9e00640 1 --2- 172.21.15.99:0/2917460191 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fedd4187c90 0x7fedd4188bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:13:09.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.626+0000 7fedd9400640 1 --2- 172.21.15.99:0/2917460191 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fedd4072370 0x7fedd40d2670 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fedc8000c00 tx=0x7fedc80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:09.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.626+0000 7fedd1600640 1 -- 172.21.15.99:0/2917460191 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc8042070 con 0x7fedd4072370 2024-02-21T23:13:09.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.626+0000 7fedd1600640 1 -- 172.21.15.99:0/2917460191 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedc8032a40 con 0x7fedd4072370 2024-02-21T23:13:09.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.626+0000 7fedd1600640 1 -- 172.21.15.99:0/2917460191 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc8037040 con 0x7fedd4072370 2024-02-21T23:13:09.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.626+0000 7feddbe00640 1 -- 172.21.15.99:0/2917460191 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedd40d15d0 con 0x7fedd4072370 2024-02-21T23:13:09.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.626+0000 7feddbe00640 1 -- 172.21.15.99:0/2917460191 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedd40d1b90 con 0x7fedd4072370 2024-02-21T23:13:09.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.627+0000 7feddbe00640 1 -- 172.21.15.99:0/2917460191 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fedd41866c0 con 0x7fedd4072370 2024-02-21T23:13:09.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.631+0000 7fedd1600640 1 -- 172.21.15.99:0/2917460191 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7fedc8045070 con 0x7fedd4072370 2024-02-21T23:13:09.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.632+0000 7fedd1600640 1 --2- 172.21.15.99:0/2917460191 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fedb409eed0 0x7fedb40a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:09.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.632+0000 7fedd1600640 1 -- 172.21.15.99:0/2917460191 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 8965+0+0 (secure 0 0 0) 0x7fedc80ebdc0 con 0x7fedd4072370 2024-02-21T23:13:09.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.632+0000 7fedd1600640 1 --2- 172.21.15.99:0/2917460191 >> [v2:172.21.15.162:6810/3137681258,v1:172.21.15.162:6811/3137681258] conn(0x7fedb40a9f00 0x7fedb40ac380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:09.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.632+0000 7fedd1600640 1 -- 172.21.15.99:0/2917460191 --> [v2:172.21.15.162:6810/3137681258,v1:172.21.15.162:6811/3137681258] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fedc8008eb0 con 0x7fedb40a9f00 2024-02-21T23:13:09.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.632+0000 7fedd1600640 1 -- 172.21.15.99:0/2917460191 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fedc80ee3e0 con 0x7fedd4072370 2024-02-21T23:13:09.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.633+0000 7fedd8a00640 1 --2- 172.21.15.99:0/2917460191 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fedb409eed0 0x7fedb40a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:09.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.633+0000 7fedd9e00640 1 --2- 172.21.15.99:0/2917460191 >> [v2:172.21.15.162:6810/3137681258,v1:172.21.15.162:6811/3137681258] conn(0x7fedb40a9f00 0x7fedb40ac380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:09.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.633+0000 7fedd8a00640 1 --2- 172.21.15.99:0/2917460191 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fedb409eed0 0x7fedb40a1390 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fedd4091150 tx=0x7fedc0009040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:09.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.633+0000 7fedd9e00640 1 --2- 172.21.15.99:0/2917460191 >> [v2:172.21.15.162:6810/3137681258,v1:172.21.15.162:6811/3137681258] conn(0x7fedb40a9f00 0x7fedb40ac380 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:09.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.634+0000 7fedd1600640 1 -- 172.21.15.99:0/2917460191 <== osd.4 v2:172.21.15.162:6810/3137681258 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fedc8008eb0 con 0x7fedb40a9f00 2024-02-21T23:13:09.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.648+0000 7feddbe00640 1 -- 172.21.15.99:0/2917460191 --> [v2:172.21.15.162:6810/3137681258,v1:172.21.15.162:6811/3137681258] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fedd4068780 con 0x7fedb40a9f00 2024-02-21T23:13:09.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.649+0000 7fedd1600640 1 -- 172.21.15.99:0/2917460191 <== osd.4 v2:172.21.15.162:6810/3137681258 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fedd4068780 con 0x7fedb40a9f00 2024-02-21T23:13:09.637 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-02-21T23:13:09.637 INFO:teuthology.orchestra.run.smithi099.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-21T23:13:09.637 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-02-21T23:13:09.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.649+0000 7feddbe00640 1 -- 172.21.15.99:0/2917460191 >> [v2:172.21.15.162:6810/3137681258,v1:172.21.15.162:6811/3137681258] conn(0x7fedb40a9f00 msgr2=0x7fedb40ac380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:09.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.649+0000 7feddbe00640 1 --2- 172.21.15.99:0/2917460191 >> [v2:172.21.15.162:6810/3137681258,v1:172.21.15.162:6811/3137681258] conn(0x7fedb40a9f00 0x7fedb40ac380 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:09.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.650+0000 7feddbe00640 1 -- 172.21.15.99:0/2917460191 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fedb409eed0 msgr2=0x7fedb40a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:09.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.650+0000 7feddbe00640 1 --2- 172.21.15.99:0/2917460191 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fedb409eed0 0x7fedb40a1390 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fedd4091150 tx=0x7fedc0009040 comp rx=0 tx=0).stop 2024-02-21T23:13:09.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.650+0000 7feddbe00640 1 -- 172.21.15.99:0/2917460191 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fedd4072370 msgr2=0x7fedd40d2670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:09.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.650+0000 7feddbe00640 1 --2- 172.21.15.99:0/2917460191 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fedd4072370 0x7fedd40d2670 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fedc8000c00 tx=0x7fedc80046c0 comp rx=0 tx=0).stop 2024-02-21T23:13:09.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.650+0000 7fedd9e00640 1 -- 172.21.15.99:0/2917460191 reap_dead start 2024-02-21T23:13:09.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.650+0000 7feddbe00640 1 -- 172.21.15.99:0/2917460191 shutdown_connections 2024-02-21T23:13:09.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.650+0000 7feddbe00640 1 -- 172.21.15.99:0/2917460191 >> 172.21.15.99:0/2917460191 conn(0x7fedd40fe610 msgr2=0x7fedd418c140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:09.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.650+0000 7feddbe00640 1 -- 172.21.15.99:0/2917460191 shutdown_connections 2024-02-21T23:13:09.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.650+0000 7feddbe00640 1 -- 172.21.15.99:0/2917460191 wait complete. 2024-02-21T23:13:09.655 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-02-21T23:13:09.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.873+0000 7f12f3200640 1 Processor -- start 2024-02-21T23:13:09.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.873+0000 7f12f3200640 1 -- start start 2024-02-21T23:13:09.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.875+0000 7f12f3200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f12f4183030 0x7f12f40f0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:09.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.875+0000 7f12f3200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12f4186640 con 0x7f12f40f1500 2024-02-21T23:13:09.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.875+0000 7f12f3200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12f40f1d70 con 0x7f12f4184340 2024-02-21T23:13:09.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.875+0000 7f12f3200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12f40f2050 con 0x7f12f4183030 2024-02-21T23:13:09.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.876+0000 7f12ebe00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f12f40f1500 0x7f12f4183c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:58212/0 (socket says 172.21.15.99:58212) 2024-02-21T23:13:09.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.876+0000 7f12ebe00640 1 -- 172.21.15.99:0/3565070685 learned_addr learned my addr 172.21.15.99:0/3565070685 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:13:09.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.876+0000 7f12f1e00640 1 --2- 172.21.15.99:0/3565070685 >> v2:172.21.15.162:3300/0 conn(0x7f12f4183030 0x7f12f40f0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:09.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.876+0000 7f12f1400640 1 -- 172.21.15.99:0/3565070685 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 585808974 0 0) 0x7f12f4186640 con 0x7f12f40f1500 2024-02-21T23:13:09.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.876+0000 7f12f1e00640 1 -- 172.21.15.99:0/3565070685 >> v1:172.21.15.162:6789/0 conn(0x7f12f4184340 legacy=0x7f12f40cf7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:09.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.876+0000 7f12f1e00640 1 -- 172.21.15.99:0/3565070685 >> v1:172.21.15.99:6789/0 conn(0x7f12f40f1500 legacy=0x7f12f4183c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:09.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.876+0000 7f12f1e00640 1 -- 172.21.15.99:0/3565070685 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12f40f2330 con 0x7f12f4183030 2024-02-21T23:13:09.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.878+0000 7f12f1e00640 1 --2- 172.21.15.99:0/3565070685 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f12f4183030 0x7f12f40f0fc0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f12e4009720 tx=0x7f12e402b620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2657214fab67d40 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:09.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.878+0000 7f12f1400640 1 -- 172.21.15.99:0/3565070685 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e4037070 con 0x7f12f4183030 2024-02-21T23:13:09.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.878+0000 7f12f1400640 1 -- 172.21.15.99:0/3565070685 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12e4030710 con 0x7f12f4183030 2024-02-21T23:13:09.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.878+0000 7f12f1400640 1 -- 172.21.15.99:0/3565070685 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e4030ae0 con 0x7f12f4183030 2024-02-21T23:13:09.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.879+0000 7f12f3200640 1 -- 172.21.15.99:0/3565070685 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f12f4183030 msgr2=0x7f12f40f0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:09.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.879+0000 7f12f3200640 1 --2- 172.21.15.99:0/3565070685 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f12f4183030 0x7f12f40f0fc0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f12e4009720 tx=0x7f12e402b620 comp rx=0 tx=0).stop 2024-02-21T23:13:09.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.879+0000 7f12f3200640 1 -- 172.21.15.99:0/3565070685 shutdown_connections 2024-02-21T23:13:09.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.879+0000 7f12f3200640 1 --2- 172.21.15.99:0/3565070685 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f12f4183030 0x7f12f40f0fc0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:09.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.879+0000 7f12f3200640 1 -- 172.21.15.99:0/3565070685 >> 172.21.15.99:0/3565070685 conn(0x7f12f40ce3c0 msgr2=0x7f12f40ce7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:09.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.879+0000 7f12f3200640 1 -- 172.21.15.99:0/3565070685 shutdown_connections 2024-02-21T23:13:09.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.879+0000 7f12f3200640 1 -- 172.21.15.99:0/3565070685 wait complete. 2024-02-21T23:13:09.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.883+0000 7f12f3200640 1 Processor -- start 2024-02-21T23:13:09.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.883+0000 7f12f3200640 1 -- start start 2024-02-21T23:13:09.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.885+0000 7f12f3200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f12f40f1500 0x7f12f4185360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:09.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.885+0000 7f12f3200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12f4183030 0x7f12f42222d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:09.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.885+0000 7f12f3200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f12f4184340 0x7f12f4169170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:09.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.885+0000 7f12f3200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12f40f28f0 con 0x7f12f4183030 2024-02-21T23:13:09.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.885+0000 7f12f3200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12f4183710 con 0x7f12f4184340 2024-02-21T23:13:09.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.885+0000 7f12f3200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12f41847d0 con 0x7f12f40f1500 2024-02-21T23:13:09.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.885+0000 7f12ebe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12f4183030 0x7f12f42222d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:09.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.885+0000 7f12f1e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f12f40f1500 0x7f12f4185360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:09.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.885+0000 7f12f1e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f12f40f1500 0x7f12f4185360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:37216/0 (socket says 172.21.15.99:37216) 2024-02-21T23:13:09.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.885+0000 7f12f1e00640 1 -- 172.21.15.99:0/2739833227 learned_addr learned my addr 172.21.15.99:0/2739833227 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:13:09.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.885+0000 7f12f2800640 1 --2- 172.21.15.99:0/2739833227 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f12f4184340 0x7f12f4169170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:09.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.886+0000 7f12f1e00640 1 -- 172.21.15.99:0/2739833227 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f12f4184340 msgr2=0x7f12f4169170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:09.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.886+0000 7f12f1e00640 1 --2- 172.21.15.99:0/2739833227 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f12f4184340 0x7f12f4169170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:09.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.886+0000 7f12f1e00640 1 -- 172.21.15.99:0/2739833227 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12f4183030 msgr2=0x7f12f42222d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:09.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.886+0000 7f12f1e00640 1 --2- 172.21.15.99:0/2739833227 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12f4183030 0x7f12f42222d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:09.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.886+0000 7f12f1e00640 1 -- 172.21.15.99:0/2739833227 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12f4222a30 con 0x7f12f40f1500 2024-02-21T23:13:09.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.886+0000 7f12ebe00640 1 --2- 172.21.15.99:0/2739833227 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12f4183030 0x7f12f42222d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:13:09.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.886+0000 7f12f1e00640 1 --2- 172.21.15.99:0/2739833227 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f12f40f1500 0x7f12f4185360 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f12e4009720 tx=0x7f12e40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:09.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.886+0000 7f12ea000640 1 -- 172.21.15.99:0/2739833227 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e4037040 con 0x7f12f40f1500 2024-02-21T23:13:09.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.886+0000 7f12ea000640 1 -- 172.21.15.99:0/2739833227 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12e4004250 con 0x7f12f40f1500 2024-02-21T23:13:09.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.886+0000 7f12ea000640 1 -- 172.21.15.99:0/2739833227 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e40327b0 con 0x7f12f40f1500 2024-02-21T23:13:09.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.887+0000 7f12f3200640 1 -- 172.21.15.99:0/2739833227 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12f4222d10 con 0x7f12f40f1500 2024-02-21T23:13:09.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.887+0000 7f12f3200640 1 -- 172.21.15.99:0/2739833227 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12f416c160 con 0x7f12f40f1500 2024-02-21T23:13:09.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.888+0000 7f12f3200640 1 -- 172.21.15.99:0/2739833227 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12f4068320 con 0x7f12f40f1500 2024-02-21T23:13:09.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.891+0000 7f12ea000640 1 -- 172.21.15.99:0/2739833227 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f12e40305d0 con 0x7f12f40f1500 2024-02-21T23:13:09.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.893+0000 7f12ea000640 1 --2- 172.21.15.99:0/2739833227 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f12d009eed0 0x7f12d00a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:09.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.894+0000 7f12ea000640 1 -- 172.21.15.99:0/2739833227 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f12e40ec430 con 0x7f12f40f1500 2024-02-21T23:13:09.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.894+0000 7f12ebe00640 1 --2- 172.21.15.99:0/2739833227 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f12d009eed0 0x7f12d00a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:09.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.894+0000 7f12ebe00640 1 --2- 172.21.15.99:0/2739833227 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f12d009eed0 0x7f12d00a1390 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f12f4179720 tx=0x7f12dc007de0 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:09.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:09.896+0000 7f12ea000640 1 -- 172.21.15.99:0/2739833227 <== mon.2 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f12e40ba270 con 0x7f12f40f1500 2024-02-21T23:13:10.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.138+0000 7f12f3200640 1 -- 172.21.15.99:0/2739833227 --> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f12f406e600 con 0x7f12d009eed0 2024-02-21T23:13:10.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.139+0000 7f12ea000640 1 -- 172.21.15.99:0/2739833227 <== mgr.5131 v2:172.21.15.162:6800/631076050 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f12f406e600 con 0x7f12d009eed0 2024-02-21T23:13:10.126 INFO:teuthology.orchestra.run.smithi099.stderr:instructed osd(s) 4 to deep-scrub 2024-02-21T23:13:10.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.141+0000 7f12f3200640 1 -- 172.21.15.99:0/2739833227 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f12d009eed0 msgr2=0x7f12d00a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:10.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.141+0000 7f12f3200640 1 --2- 172.21.15.99:0/2739833227 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f12d009eed0 0x7f12d00a1390 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f12f4179720 tx=0x7f12dc007de0 comp rx=0 tx=0).stop 2024-02-21T23:13:10.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.141+0000 7f12f3200640 1 -- 172.21.15.99:0/2739833227 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f12f40f1500 msgr2=0x7f12f4185360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:10.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.141+0000 7f12f3200640 1 --2- 172.21.15.99:0/2739833227 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f12f40f1500 0x7f12f4185360 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f12e4009720 tx=0x7f12e40046c0 comp rx=0 tx=0).stop 2024-02-21T23:13:10.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.142+0000 7f12f3200640 1 -- 172.21.15.99:0/2739833227 shutdown_connections 2024-02-21T23:13:10.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.142+0000 7f12f3200640 1 --2- 172.21.15.99:0/2739833227 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f12d009eed0 0x7f12d00a1390 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:10.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.142+0000 7f12f3200640 1 --2- 172.21.15.99:0/2739833227 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f12f4184340 0x7f12f4169170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:10.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.142+0000 7f12f3200640 1 --2- 172.21.15.99:0/2739833227 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f12f4183030 0x7f12f42222d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:10.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.142+0000 7f12f3200640 1 --2- 172.21.15.99:0/2739833227 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f12f40f1500 0x7f12f4185360 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:10.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.142+0000 7f12f3200640 1 -- 172.21.15.99:0/2739833227 >> 172.21.15.99:0/2739833227 conn(0x7f12f40ce3c0 msgr2=0x7f12f4072fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:10.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.142+0000 7f12f3200640 1 -- 172.21.15.99:0/2739833227 shutdown_connections 2024-02-21T23:13:10.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.142+0000 7f12f3200640 1 -- 172.21.15.99:0/2739833227 wait complete. 2024-02-21T23:13:10.153 INFO:tasks.ceph:Scrubbing osd.7 2024-02-21T23:13:10.153 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-02-21T23:13:10.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.367+0000 7f7556c00640 1 Processor -- start 2024-02-21T23:13:10.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.367+0000 7f7556c00640 1 -- start start 2024-02-21T23:13:10.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.370+0000 7f7556c00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f755017d630 0x7f75500f6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:10.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.370+0000 7f7556c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f755018ab60 0x7f7550071080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:10.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.370+0000 7f7556c00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7550070ba0 con 0x7f75500715c0 2024-02-21T23:13:10.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.370+0000 7f7556c00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75500f7230 con 0x7f755017d630 2024-02-21T23:13:10.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.370+0000 7f7556c00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75500f7450 con 0x7f755018ab60 2024-02-21T23:13:10.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.371+0000 7f754fe00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f755017d630 0x7f75500f6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:10.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.371+0000 7f754fe00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f755017d630 0x7f75500f6cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56094/0 (socket says 172.21.15.99:56094) 2024-02-21T23:13:10.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.371+0000 7f754fe00640 1 -- 172.21.15.99:0/265193136 learned_addr learned my addr 172.21.15.99:0/265193136 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:13:10.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.371+0000 7f754f400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f755018ab60 0x7f7550071080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:10.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.371+0000 7f754fe00640 1 -- 172.21.15.99:0/265193136 >> v2:172.21.15.162:3300/0 conn(0x7f755018ab60 msgr2=0x7f7550071080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:13:10.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.371+0000 7f754fe00640 1 --2- 172.21.15.99:0/265193136 >> v2:172.21.15.162:3300/0 conn(0x7f755018ab60 0x7f7550071080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:10.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.371+0000 7f754fe00640 1 -- 172.21.15.99:0/265193136 >> v1:172.21.15.162:6789/0 conn(0x7f75500715c0 legacy=0x7f755015e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:10.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.371+0000 7f754ea00640 1 -- 172.21.15.99:0/265193136 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3414378711 0 0) 0x7f7550070ba0 con 0x7f75500715c0 2024-02-21T23:13:10.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.371+0000 7f754fe00640 1 -- 172.21.15.99:0/265193136 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75500f7730 con 0x7f755017d630 2024-02-21T23:13:10.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.373+0000 7f754fe00640 1 --2- 172.21.15.99:0/265193136 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f755017d630 0x7f75500f6cf0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f755008e470 tx=0x7f754002b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e925f06d4f0307cb server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:10.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.373+0000 7f754ea00640 1 -- 172.21.15.99:0/265193136 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7540034070 con 0x7f755017d630 2024-02-21T23:13:10.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.373+0000 7f754ea00640 1 -- 172.21.15.99:0/265193136 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7540030870 con 0x7f755017d630 2024-02-21T23:13:10.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.373+0000 7f754ea00640 1 -- 172.21.15.99:0/265193136 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7540030c40 con 0x7f755017d630 2024-02-21T23:13:10.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.374+0000 7f7556c00640 1 -- 172.21.15.99:0/265193136 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f755017d630 msgr2=0x7f75500f6cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:10.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.374+0000 7f7556c00640 1 --2- 172.21.15.99:0/265193136 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f755017d630 0x7f75500f6cf0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f755008e470 tx=0x7f754002b9b0 comp rx=0 tx=0).stop 2024-02-21T23:13:10.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.374+0000 7f7556c00640 1 -- 172.21.15.99:0/265193136 shutdown_connections 2024-02-21T23:13:10.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.374+0000 7f7556c00640 1 --2- 172.21.15.99:0/265193136 >> v2:172.21.15.162:3300/0 conn(0x7f755018ab60 0x7f7550071080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:10.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.374+0000 7f7556c00640 1 --2- 172.21.15.99:0/265193136 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f755017d630 0x7f75500f6cf0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:10.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.374+0000 7f7556c00640 1 -- 172.21.15.99:0/265193136 >> 172.21.15.99:0/265193136 conn(0x7f75500f8df0 msgr2=0x7f75500f91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:10.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.374+0000 7f7556c00640 1 -- 172.21.15.99:0/265193136 shutdown_connections 2024-02-21T23:13:10.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.374+0000 7f7556c00640 1 -- 172.21.15.99:0/265193136 wait complete. 2024-02-21T23:13:10.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.376+0000 7f7556c00640 1 Processor -- start 2024-02-21T23:13:10.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.377+0000 7f7556c00640 1 -- start start 2024-02-21T23:13:10.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.378+0000 7f7556c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f75500715c0 0x7f755021f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:10.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.378+0000 7f7556c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f755017d630 0x7f7550158430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:10.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.378+0000 7f7556c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f755018ab60 0x7f7550158970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:10.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.378+0000 7f7556c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75500f7fd0 con 0x7f75500715c0 2024-02-21T23:13:10.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.378+0000 7f7556c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75500f7cf0 con 0x7f755018ab60 2024-02-21T23:13:10.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.378+0000 7f7556c00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7550071a50 con 0x7f755017d630 2024-02-21T23:13:10.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.378+0000 7f754fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f75500715c0 0x7f755021f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:10.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.378+0000 7f754fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f75500715c0 0x7f755021f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56102/0 (socket says 172.21.15.99:56102) 2024-02-21T23:13:10.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.378+0000 7f754fe00640 1 -- 172.21.15.99:0/987800866 learned_addr learned my addr 172.21.15.99:0/987800866 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:13:10.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.378+0000 7f7554c00640 1 --2- 172.21.15.99:0/987800866 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f755018ab60 0x7f7550158970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:10.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.378+0000 7f754f400640 1 --2- 172.21.15.99:0/987800866 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f755017d630 0x7f7550158430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:10.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.379+0000 7f754fe00640 1 -- 172.21.15.99:0/987800866 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f755017d630 msgr2=0x7f7550158430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:10.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.379+0000 7f754fe00640 1 --2- 172.21.15.99:0/987800866 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f755017d630 0x7f7550158430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:10.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.379+0000 7f754fe00640 1 -- 172.21.15.99:0/987800866 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f755018ab60 msgr2=0x7f7550158970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:10.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.379+0000 7f754fe00640 1 --2- 172.21.15.99:0/987800866 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f755018ab60 0x7f7550158970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:10.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.379+0000 7f754fe00640 1 -- 172.21.15.99:0/987800866 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f755021c8c0 con 0x7f75500715c0 2024-02-21T23:13:10.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.379+0000 7f754fe00640 1 --2- 172.21.15.99:0/987800866 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f75500715c0 0x7f755021f1a0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f75400090b0 tx=0x7f75400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:10.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.380+0000 7f7547e00640 1 -- 172.21.15.99:0/987800866 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7540034040 con 0x7f75500715c0 2024-02-21T23:13:10.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.380+0000 7f7547e00640 1 -- 172.21.15.99:0/987800866 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7540030670 con 0x7f75500715c0 2024-02-21T23:13:10.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.380+0000 7f7547e00640 1 -- 172.21.15.99:0/987800866 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7540039d40 con 0x7f75500715c0 2024-02-21T23:13:10.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.380+0000 7f7556c00640 1 -- 172.21.15.99:0/987800866 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7550220fb0 con 0x7f75500715c0 2024-02-21T23:13:10.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.380+0000 7f7556c00640 1 -- 172.21.15.99:0/987800866 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7550221570 con 0x7f75500715c0 2024-02-21T23:13:10.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.381+0000 7f7556c00640 1 -- 172.21.15.99:0/987800866 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7550066c60 con 0x7f75500715c0 2024-02-21T23:13:10.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.383+0000 7f7547e00640 1 -- 172.21.15.99:0/987800866 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f7540037070 con 0x7f75500715c0 2024-02-21T23:13:10.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.386+0000 7f7547e00640 1 --2- 172.21.15.99:0/987800866 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f753009eed0 0x7f75300a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:10.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.386+0000 7f7547e00640 1 -- 172.21.15.99:0/987800866 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f75400ec4b0 con 0x7f75500715c0 2024-02-21T23:13:10.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.386+0000 7f754f400640 1 --2- 172.21.15.99:0/987800866 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f753009eed0 0x7f75300a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:10.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.386+0000 7f7547e00640 1 --2- 172.21.15.99:0/987800866 >> [v2:172.21.15.162:6802/1659412949,v1:172.21.15.162:6803/1659412949] conn(0x7f75300a9de0 0x7f75300ac260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:10.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.386+0000 7f7547e00640 1 -- 172.21.15.99:0/987800866 --> [v2:172.21.15.162:6802/1659412949,v1:172.21.15.162:6803/1659412949] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f75400094b0 con 0x7f75300a9de0 2024-02-21T23:13:10.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.386+0000 7f7547e00640 1 -- 172.21.15.99:0/987800866 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f75400ec900 con 0x7f75500715c0 2024-02-21T23:13:10.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.387+0000 7f7554c00640 1 --2- 172.21.15.99:0/987800866 >> [v2:172.21.15.162:6802/1659412949,v1:172.21.15.162:6803/1659412949] conn(0x7f75300a9de0 0x7f75300ac260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:10.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.387+0000 7f754f400640 1 --2- 172.21.15.99:0/987800866 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f753009eed0 0x7f75300a1390 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7550070690 tx=0x7f753c009190 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:10.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.387+0000 7f7554c00640 1 --2- 172.21.15.99:0/987800866 >> [v2:172.21.15.162:6802/1659412949,v1:172.21.15.162:6803/1659412949] conn(0x7f75300a9de0 0x7f75300ac260 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:10.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.388+0000 7f7547e00640 1 -- 172.21.15.99:0/987800866 <== osd.7 v2:172.21.15.162:6802/1659412949 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f75400094b0 con 0x7f75300a9de0 2024-02-21T23:13:10.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.402+0000 7f7556c00640 1 -- 172.21.15.99:0/987800866 --> [v2:172.21.15.162:6802/1659412949,v1:172.21.15.162:6803/1659412949] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f7550184500 con 0x7f75300a9de0 2024-02-21T23:13:10.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.403+0000 7f7547e00640 1 -- 172.21.15.99:0/987800866 <== osd.7 v2:172.21.15.162:6802/1659412949 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f7550184500 con 0x7f75300a9de0 2024-02-21T23:13:10.391 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-02-21T23:13:10.391 INFO:teuthology.orchestra.run.smithi099.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-21T23:13:10.391 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-02-21T23:13:10.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.403+0000 7f7556c00640 1 -- 172.21.15.99:0/987800866 >> [v2:172.21.15.162:6802/1659412949,v1:172.21.15.162:6803/1659412949] conn(0x7f75300a9de0 msgr2=0x7f75300ac260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:10.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.403+0000 7f7556c00640 1 --2- 172.21.15.99:0/987800866 >> [v2:172.21.15.162:6802/1659412949,v1:172.21.15.162:6803/1659412949] conn(0x7f75300a9de0 0x7f75300ac260 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:10.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.403+0000 7f7556c00640 1 -- 172.21.15.99:0/987800866 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f753009eed0 msgr2=0x7f75300a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:10.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.403+0000 7f7556c00640 1 --2- 172.21.15.99:0/987800866 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f753009eed0 0x7f75300a1390 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7550070690 tx=0x7f753c009190 comp rx=0 tx=0).stop 2024-02-21T23:13:10.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.404+0000 7f7556c00640 1 -- 172.21.15.99:0/987800866 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f75500715c0 msgr2=0x7f755021f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:10.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.404+0000 7f7556c00640 1 --2- 172.21.15.99:0/987800866 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f75500715c0 0x7f755021f1a0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f75400090b0 tx=0x7f75400046c0 comp rx=0 tx=0).stop 2024-02-21T23:13:10.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.404+0000 7f7554c00640 1 -- 172.21.15.99:0/987800866 reap_dead start 2024-02-21T23:13:10.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.404+0000 7f7556c00640 1 -- 172.21.15.99:0/987800866 shutdown_connections 2024-02-21T23:13:10.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.404+0000 7f7556c00640 1 -- 172.21.15.99:0/987800866 >> 172.21.15.99:0/987800866 conn(0x7f75500f8df0 msgr2=0x7f7550068e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:10.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.404+0000 7f7556c00640 1 -- 172.21.15.99:0/987800866 shutdown_connections 2024-02-21T23:13:10.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.404+0000 7f7556c00640 1 -- 172.21.15.99:0/987800866 wait complete. 2024-02-21T23:13:10.410 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-02-21T23:13:10.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.638+0000 7fb86c400640 1 Processor -- start 2024-02-21T23:13:10.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.639+0000 7fb86c400640 1 -- start start 2024-02-21T23:13:10.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.640+0000 7fb86c400640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fb8640f8730 0x7fb8641845c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:10.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.640+0000 7fb86c400640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8640f8c40 con 0x7fb864184b00 2024-02-21T23:13:10.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.640+0000 7fb86c400640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8640f8f20 con 0x7fb8641833f0 2024-02-21T23:13:10.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.640+0000 7fb86c400640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb864186a10 con 0x7fb8640f8730 2024-02-21T23:13:10.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.641+0000 7fb86a400640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fb864184b00 0x7fb86406e310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:58226/0 (socket says 172.21.15.99:58226) 2024-02-21T23:13:10.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.641+0000 7fb86a400640 1 -- 172.21.15.99:0/4110496474 learned_addr learned my addr 172.21.15.99:0/4110496474 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:13:10.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.641+0000 7fb869000640 1 --2- 172.21.15.99:0/4110496474 >> v2:172.21.15.181:3300/0 conn(0x7fb8640f8730 0x7fb8641845c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:10.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.641+0000 7fb869000640 1 -- 172.21.15.99:0/4110496474 >> v1:172.21.15.181:6789/0 conn(0x7fb8641833f0 legacy=0x7fb8640f8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:10.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.641+0000 7fb869000640 1 -- 172.21.15.99:0/4110496474 >> v1:172.21.15.99:6789/0 conn(0x7fb864184b00 legacy=0x7fb86406e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:10.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.641+0000 7fb863e00640 1 -- 172.21.15.99:0/4110496474 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3740598870 0 0) 0x7fb8640f8f20 con 0x7fb8641833f0 2024-02-21T23:13:10.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.641+0000 7fb869000640 1 -- 172.21.15.99:0/4110496474 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb864183ae0 con 0x7fb8640f8730 2024-02-21T23:13:10.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.642+0000 7fb869000640 1 --2- 172.21.15.99:0/4110496474 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb8640f8730 0x7fb8641845c0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fb8500097a0 tx=0x7fb85002b710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f182e165492fe1b5 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:10.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.643+0000 7fb863e00640 1 -- 172.21.15.99:0/4110496474 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb850037070 con 0x7fb8640f8730 2024-02-21T23:13:10.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.643+0000 7fb863e00640 1 -- 172.21.15.99:0/4110496474 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb850030710 con 0x7fb8640f8730 2024-02-21T23:13:10.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.643+0000 7fb863e00640 1 -- 172.21.15.99:0/4110496474 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb850030ae0 con 0x7fb8640f8730 2024-02-21T23:13:10.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.643+0000 7fb86c400640 1 -- 172.21.15.99:0/4110496474 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb8640f8730 msgr2=0x7fb8641845c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:10.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.643+0000 7fb86c400640 1 --2- 172.21.15.99:0/4110496474 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb8640f8730 0x7fb8641845c0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fb8500097a0 tx=0x7fb85002b710 comp rx=0 tx=0).stop 2024-02-21T23:13:10.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.644+0000 7fb86c400640 1 -- 172.21.15.99:0/4110496474 shutdown_connections 2024-02-21T23:13:10.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.644+0000 7fb86c400640 1 --2- 172.21.15.99:0/4110496474 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb8640f8730 0x7fb8641845c0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:10.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.644+0000 7fb86c400640 1 -- 172.21.15.99:0/4110496474 >> 172.21.15.99:0/4110496474 conn(0x7fb8640ce5f0 msgr2=0x7fb8640cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:10.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.644+0000 7fb86c400640 1 -- 172.21.15.99:0/4110496474 shutdown_connections 2024-02-21T23:13:10.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.644+0000 7fb86c400640 1 -- 172.21.15.99:0/4110496474 wait complete. 2024-02-21T23:13:10.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.647+0000 7fb86c400640 1 Processor -- start 2024-02-21T23:13:10.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.647+0000 7fb86c400640 1 -- start start 2024-02-21T23:13:10.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.649+0000 7fb86c400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8640f8730 0x7fb86421c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:10.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.649+0000 7fb86c400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb8641833f0 0x7fb864071e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:10.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.649+0000 7fb86c400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb864184b00 0x7fb8640723b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:10.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.649+0000 7fb86c400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb864184f90 con 0x7fb864184b00 2024-02-21T23:13:10.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.649+0000 7fb86c400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8641840a0 con 0x7fb8640f8730 2024-02-21T23:13:10.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.649+0000 7fb86c400640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb864185110 con 0x7fb8641833f0 2024-02-21T23:13:10.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.650+0000 7fb86a400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb864184b00 0x7fb8640723b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:10.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.650+0000 7fb869a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8640f8730 0x7fb86421c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:10.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.650+0000 7fb869a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8640f8730 0x7fb86421c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:56128/0 (socket says 172.21.15.99:56128) 2024-02-21T23:13:10.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.650+0000 7fb869a00640 1 -- 172.21.15.99:0/3379012799 learned_addr learned my addr 172.21.15.99:0/3379012799 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:13:10.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.650+0000 7fb86a400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb864184b00 0x7fb8640723b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56114/0 (socket says 172.21.15.99:56114) 2024-02-21T23:13:10.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.650+0000 7fb869000640 1 --2- 172.21.15.99:0/3379012799 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb8641833f0 0x7fb864071e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:10.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.650+0000 7fb869a00640 1 -- 172.21.15.99:0/3379012799 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb8641833f0 msgr2=0x7fb864071e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:10.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.650+0000 7fb869a00640 1 --2- 172.21.15.99:0/3379012799 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb8641833f0 0x7fb864071e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:10.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.650+0000 7fb869a00640 1 -- 172.21.15.99:0/3379012799 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb864184b00 msgr2=0x7fb8640723b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:10.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.650+0000 7fb869a00640 1 --2- 172.21.15.99:0/3379012799 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb864184b00 0x7fb8640723b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:10.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.650+0000 7fb869a00640 1 -- 172.21.15.99:0/3379012799 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb864175770 con 0x7fb8640f8730 2024-02-21T23:13:10.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.650+0000 7fb869a00640 1 --2- 172.21.15.99:0/3379012799 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8640f8730 0x7fb86421c880 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fb85800c410 tx=0x7fb85800c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:10.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.651+0000 7fb861600640 1 -- 172.21.15.99:0/3379012799 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb858017070 con 0x7fb8640f8730 2024-02-21T23:13:10.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.651+0000 7fb861600640 1 -- 172.21.15.99:0/3379012799 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8580035f0 con 0x7fb8640f8730 2024-02-21T23:13:10.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.651+0000 7fb86c400640 1 -- 172.21.15.99:0/3379012799 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb864175a50 con 0x7fb8640f8730 2024-02-21T23:13:10.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.651+0000 7fb861600640 1 -- 172.21.15.99:0/3379012799 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8580039e0 con 0x7fb8640f8730 2024-02-21T23:13:10.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.651+0000 7fb86c400640 1 -- 172.21.15.99:0/3379012799 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8640c9f90 con 0x7fb8640f8730 2024-02-21T23:13:10.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.652+0000 7fb86c400640 1 -- 172.21.15.99:0/3379012799 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8640d2aa0 con 0x7fb8640f8730 2024-02-21T23:13:10.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.654+0000 7fb861600640 1 -- 172.21.15.99:0/3379012799 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7fb85801a070 con 0x7fb8640f8730 2024-02-21T23:13:10.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.655+0000 7fb861600640 1 --2- 172.21.15.99:0/3379012799 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fb84409eed0 0x7fb8440a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:10.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.656+0000 7fb861600640 1 -- 172.21.15.99:0/3379012799 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 8877+0+0 (secure 0 0 0) 0x7fb8580c92a0 con 0x7fb8640f8730 2024-02-21T23:13:10.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.656+0000 7fb869000640 1 --2- 172.21.15.99:0/3379012799 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fb84409eed0 0x7fb8440a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:10.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.656+0000 7fb869000640 1 --2- 172.21.15.99:0/3379012799 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fb84409eed0 0x7fb8440a1390 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb850034000 tx=0x7fb850008030 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:10.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.658+0000 7fb861600640 1 -- 172.21.15.99:0/3379012799 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fb858096c30 con 0x7fb8640f8730 2024-02-21T23:13:10.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.906+0000 7fb86c400640 1 -- 172.21.15.99:0/3379012799 --> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fb8640728f0 con 0x7fb84409eed0 2024-02-21T23:13:10.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.906+0000 7fb861600640 1 -- 172.21.15.99:0/3379012799 <== mgr.5131 v2:172.21.15.162:6800/631076050 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb8640728f0 con 0x7fb84409eed0 2024-02-21T23:13:10.894 INFO:teuthology.orchestra.run.smithi099.stderr:instructed osd(s) 7 to deep-scrub 2024-02-21T23:13:10.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.909+0000 7fb86c400640 1 -- 172.21.15.99:0/3379012799 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fb84409eed0 msgr2=0x7fb8440a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:10.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.909+0000 7fb86c400640 1 --2- 172.21.15.99:0/3379012799 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fb84409eed0 0x7fb8440a1390 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb850034000 tx=0x7fb850008030 comp rx=0 tx=0).stop 2024-02-21T23:13:10.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.909+0000 7fb86c400640 1 -- 172.21.15.99:0/3379012799 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8640f8730 msgr2=0x7fb86421c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:10.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.909+0000 7fb86c400640 1 --2- 172.21.15.99:0/3379012799 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8640f8730 0x7fb86421c880 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fb85800c410 tx=0x7fb85800c8d0 comp rx=0 tx=0).stop 2024-02-21T23:13:10.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.909+0000 7fb86c400640 1 -- 172.21.15.99:0/3379012799 shutdown_connections 2024-02-21T23:13:10.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.909+0000 7fb86c400640 1 --2- 172.21.15.99:0/3379012799 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fb84409eed0 0x7fb8440a1390 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:10.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.909+0000 7fb86c400640 1 --2- 172.21.15.99:0/3379012799 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fb864184b00 0x7fb8640723b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:10.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.909+0000 7fb86c400640 1 --2- 172.21.15.99:0/3379012799 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fb8641833f0 0x7fb864071e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:10.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.909+0000 7fb86c400640 1 --2- 172.21.15.99:0/3379012799 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8640f8730 0x7fb86421c880 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:10.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.909+0000 7fb86c400640 1 -- 172.21.15.99:0/3379012799 >> 172.21.15.99:0/3379012799 conn(0x7fb8640ce5f0 msgr2=0x7fb864188550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:10.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.909+0000 7fb86c400640 1 -- 172.21.15.99:0/3379012799 shutdown_connections 2024-02-21T23:13:10.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:10.909+0000 7fb86c400640 1 -- 172.21.15.99:0/3379012799 wait complete. 2024-02-21T23:13:10.916 INFO:tasks.ceph:Scrubbing osd.10 2024-02-21T23:13:10.916 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.10 config set osd_debug_deep_scrub_sleep 0 2024-02-21T23:13:11.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.155+0000 7fe533000640 1 Processor -- start 2024-02-21T23:13:11.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.155+0000 7fe533000640 1 -- start start 2024-02-21T23:13:11.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.157+0000 7fe533000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe52c189f40 0x7fe52c18b920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:11.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.157+0000 7fe533000640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fe52c071c20 0x7fe52c072080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:11.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.157+0000 7fe533000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe52c18a5a0 con 0x7fe52c17f710 2024-02-21T23:13:11.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.157+0000 7fe533000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe52c18a880 con 0x7fe52c189f40 2024-02-21T23:13:11.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.157+0000 7fe533000640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe52c18ab60 con 0x7fe52c071c20 2024-02-21T23:13:11.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.157+0000 7fe531c00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fe52c17f710 0x7fe52c15e490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:58236/0 (socket says 172.21.15.99:58236) 2024-02-21T23:13:11.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.157+0000 7fe531c00640 1 -- 172.21.15.99:0/3924443750 learned_addr learned my addr 172.21.15.99:0/3924443750 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:13:11.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.157+0000 7fe532600640 1 --2- 172.21.15.99:0/3924443750 >> v2:172.21.15.181:3300/0 conn(0x7fe52c071c20 0x7fe52c072080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:11.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.157+0000 7fe531200640 1 --2- 172.21.15.99:0/3924443750 >> v2:172.21.15.162:3300/0 conn(0x7fe52c189f40 0x7fe52c18b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:11.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.158+0000 7fe52be00640 1 -- 172.21.15.99:0/3924443750 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2713493782 0 0) 0x7fe52c18a5a0 con 0x7fe52c17f710 2024-02-21T23:13:11.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.158+0000 7fe52be00640 1 -- 172.21.15.99:0/3924443750 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe514003520 con 0x7fe52c17f710 2024-02-21T23:13:11.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.158+0000 7fe532600640 1 -- 172.21.15.99:0/3924443750 >> v2:172.21.15.162:3300/0 conn(0x7fe52c189f40 msgr2=0x7fe52c18b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:13:11.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.158+0000 7fe532600640 1 --2- 172.21.15.99:0/3924443750 >> v2:172.21.15.162:3300/0 conn(0x7fe52c189f40 0x7fe52c18b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:11.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.158+0000 7fe532600640 1 -- 172.21.15.99:0/3924443750 >> v1:172.21.15.99:6789/0 conn(0x7fe52c17f710 legacy=0x7fe52c15e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:11.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.158+0000 7fe532600640 1 -- 172.21.15.99:0/3924443750 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe52c18ae40 con 0x7fe52c071c20 2024-02-21T23:13:11.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.158+0000 7fe531200640 1 --2- 172.21.15.99:0/3924443750 >> v2:172.21.15.162:3300/0 conn(0x7fe52c189f40 0x7fe52c18b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:13:11.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.159+0000 7fe532600640 1 --2- 172.21.15.99:0/3924443750 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe52c071c20 0x7fe52c072080 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fe52c0ff3e0 tx=0x7fe52402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d328ab91599075a5 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:11.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.159+0000 7fe52be00640 1 -- 172.21.15.99:0/3924443750 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe524035020 con 0x7fe52c071c20 2024-02-21T23:13:11.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.160+0000 7fe52be00640 1 -- 172.21.15.99:0/3924443750 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe524031830 con 0x7fe52c071c20 2024-02-21T23:13:11.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.160+0000 7fe52be00640 1 -- 172.21.15.99:0/3924443750 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe524031be0 con 0x7fe52c071c20 2024-02-21T23:13:11.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.160+0000 7fe533000640 1 -- 172.21.15.99:0/3924443750 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe52c071c20 msgr2=0x7fe52c072080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:11.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.160+0000 7fe533000640 1 --2- 172.21.15.99:0/3924443750 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe52c071c20 0x7fe52c072080 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fe52c0ff3e0 tx=0x7fe52402b8d0 comp rx=0 tx=0).stop 2024-02-21T23:13:11.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.160+0000 7fe533000640 1 -- 172.21.15.99:0/3924443750 shutdown_connections 2024-02-21T23:13:11.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.160+0000 7fe533000640 1 --2- 172.21.15.99:0/3924443750 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe52c071c20 0x7fe52c072080 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:11.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.160+0000 7fe533000640 1 --2- 172.21.15.99:0/3924443750 >> v2:172.21.15.162:3300/0 conn(0x7fe52c189f40 0x7fe52c18b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:11.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.160+0000 7fe533000640 1 -- 172.21.15.99:0/3924443750 >> 172.21.15.99:0/3924443750 conn(0x7fe52c0fe310 msgr2=0x7fe52c0fe720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:11.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.160+0000 7fe533000640 1 -- 172.21.15.99:0/3924443750 shutdown_connections 2024-02-21T23:13:11.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.160+0000 7fe533000640 1 -- 172.21.15.99:0/3924443750 wait complete. 2024-02-21T23:13:11.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.162+0000 7fe533000640 1 Processor -- start 2024-02-21T23:13:11.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.162+0000 7fe533000640 1 -- start start 2024-02-21T23:13:11.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.164+0000 7fe533000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe52c071c20 0x7fe52c15da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:11.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.164+0000 7fe533000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe52c17f710 0x7fe52c21d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:11.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.164+0000 7fe533000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe52c189f40 0x7fe52c21d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:11.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.164+0000 7fe533000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe52c0d5170 con 0x7fe52c071c20 2024-02-21T23:13:11.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.164+0000 7fe533000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe52c0d4ff0 con 0x7fe52c189f40 2024-02-21T23:13:11.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.164+0000 7fe533000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe52c0d52f0 con 0x7fe52c17f710 2024-02-21T23:13:11.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.164+0000 7fe531c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe52c071c20 0x7fe52c15da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:11.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.164+0000 7fe532600640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe52c189f40 0x7fe52c21d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:11.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.164+0000 7fe531200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe52c17f710 0x7fe52c21d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:11.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.164+0000 7fe531c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe52c071c20 0x7fe52c15da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56126/0 (socket says 172.21.15.99:56126) 2024-02-21T23:13:11.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.164+0000 7fe531c00640 1 -- 172.21.15.99:0/2384118853 learned_addr learned my addr 172.21.15.99:0/2384118853 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:13:11.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.165+0000 7fe531c00640 1 -- 172.21.15.99:0/2384118853 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe52c17f710 msgr2=0x7fe52c21d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:11.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.165+0000 7fe531c00640 1 --2- 172.21.15.99:0/2384118853 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe52c17f710 0x7fe52c21d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:11.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.165+0000 7fe531c00640 1 -- 172.21.15.99:0/2384118853 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe52c189f40 msgr2=0x7fe52c21d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:11.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.165+0000 7fe531c00640 1 --2- 172.21.15.99:0/2384118853 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe52c189f40 0x7fe52c21d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:11.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.165+0000 7fe531c00640 1 -- 172.21.15.99:0/2384118853 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe52c221390 con 0x7fe52c071c20 2024-02-21T23:13:11.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.165+0000 7fe531200640 1 --2- 172.21.15.99:0/2384118853 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe52c17f710 0x7fe52c21d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:13:11.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.165+0000 7fe532600640 1 --2- 172.21.15.99:0/2384118853 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe52c189f40 0x7fe52c21d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:13:11.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.165+0000 7fe531c00640 1 --2- 172.21.15.99:0/2384118853 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe52c071c20 0x7fe52c15da00 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fe52000cb70 tx=0x7fe52000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:11.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.165+0000 7fe529600640 1 -- 172.21.15.99:0/2384118853 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe520017070 con 0x7fe52c071c20 2024-02-21T23:13:11.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.165+0000 7fe529600640 1 -- 172.21.15.99:0/2384118853 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe52000ad40 con 0x7fe52c071c20 2024-02-21T23:13:11.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.165+0000 7fe533000640 1 -- 172.21.15.99:0/2384118853 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe52c221670 con 0x7fe52c071c20 2024-02-21T23:13:11.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.165+0000 7fe529600640 1 -- 172.21.15.99:0/2384118853 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe520012620 con 0x7fe52c071c20 2024-02-21T23:13:11.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.165+0000 7fe533000640 1 -- 172.21.15.99:0/2384118853 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe52c221c30 con 0x7fe52c071c20 2024-02-21T23:13:11.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.167+0000 7fe533000640 1 -- 172.21.15.99:0/2384118853 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe52c068780 con 0x7fe52c071c20 2024-02-21T23:13:11.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.168+0000 7fe529600640 1 -- 172.21.15.99:0/2384118853 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7fe52001a070 con 0x7fe52c071c20 2024-02-21T23:13:11.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.170+0000 7fe529600640 1 --2- 172.21.15.99:0/2384118853 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fe50c09eed0 0x7fe50c0a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:11.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.170+0000 7fe529600640 1 -- 172.21.15.99:0/2384118853 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 8877+0+0 (secure 0 0 0) 0x7fe5200c9c70 con 0x7fe52c071c20 2024-02-21T23:13:11.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.170+0000 7fe531200640 1 --2- 172.21.15.99:0/2384118853 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fe50c09eed0 0x7fe50c0a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:11.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.170+0000 7fe529600640 1 --2- 172.21.15.99:0/2384118853 >> [v2:172.21.15.162:6818/1421879617,v1:172.21.15.162:6819/1421879617] conn(0x7fe50c0a9de0 0x7fe50c0ac260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:11.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.170+0000 7fe529600640 1 -- 172.21.15.99:0/2384118853 --> [v2:172.21.15.162:6818/1421879617,v1:172.21.15.162:6819/1421879617] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe50c0ac930 con 0x7fe50c0a9de0 2024-02-21T23:13:11.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.170+0000 7fe529600640 1 -- 172.21.15.99:0/2384118853 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe5200cf340 con 0x7fe52c071c20 2024-02-21T23:13:11.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.171+0000 7fe532600640 1 --2- 172.21.15.99:0/2384118853 >> [v2:172.21.15.162:6818/1421879617,v1:172.21.15.162:6819/1421879617] conn(0x7fe50c0a9de0 0x7fe50c0ac260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:11.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.171+0000 7fe531200640 1 --2- 172.21.15.99:0/2384118853 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fe50c09eed0 0x7fe50c0a1390 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe52c0d6de0 tx=0x7fe518009190 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:11.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.171+0000 7fe532600640 1 --2- 172.21.15.99:0/2384118853 >> [v2:172.21.15.162:6818/1421879617,v1:172.21.15.162:6819/1421879617] conn(0x7fe50c0a9de0 0x7fe50c0ac260 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:11.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.172+0000 7fe529600640 1 -- 172.21.15.99:0/2384118853 <== osd.10 v2:172.21.15.162:6818/1421879617 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fe50c0ac930 con 0x7fe50c0a9de0 2024-02-21T23:13:11.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.201+0000 7fe533000640 1 -- 172.21.15.99:0/2384118853 --> [v2:172.21.15.162:6818/1421879617,v1:172.21.15.162:6819/1421879617] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe52c0682b0 con 0x7fe50c0a9de0 2024-02-21T23:13:11.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.201+0000 7fe529600640 1 -- 172.21.15.99:0/2384118853 <== osd.10 v2:172.21.15.162:6818/1421879617 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fe52c0682b0 con 0x7fe50c0a9de0 2024-02-21T23:13:11.189 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-02-21T23:13:11.190 INFO:teuthology.orchestra.run.smithi099.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-21T23:13:11.190 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-02-21T23:13:11.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.202+0000 7fe533000640 1 -- 172.21.15.99:0/2384118853 >> [v2:172.21.15.162:6818/1421879617,v1:172.21.15.162:6819/1421879617] conn(0x7fe50c0a9de0 msgr2=0x7fe50c0ac260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:11.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.202+0000 7fe533000640 1 --2- 172.21.15.99:0/2384118853 >> [v2:172.21.15.162:6818/1421879617,v1:172.21.15.162:6819/1421879617] conn(0x7fe50c0a9de0 0x7fe50c0ac260 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:11.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.202+0000 7fe533000640 1 -- 172.21.15.99:0/2384118853 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fe50c09eed0 msgr2=0x7fe50c0a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:11.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.202+0000 7fe533000640 1 --2- 172.21.15.99:0/2384118853 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fe50c09eed0 0x7fe50c0a1390 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe52c0d6de0 tx=0x7fe518009190 comp rx=0 tx=0).stop 2024-02-21T23:13:11.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.202+0000 7fe533000640 1 -- 172.21.15.99:0/2384118853 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe52c071c20 msgr2=0x7fe52c15da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:11.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.202+0000 7fe533000640 1 --2- 172.21.15.99:0/2384118853 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe52c071c20 0x7fe52c15da00 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fe52000cb70 tx=0x7fe52000a430 comp rx=0 tx=0).stop 2024-02-21T23:13:11.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.202+0000 7fe532600640 1 -- 172.21.15.99:0/2384118853 reap_dead start 2024-02-21T23:13:11.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.202+0000 7fe533000640 1 -- 172.21.15.99:0/2384118853 shutdown_connections 2024-02-21T23:13:11.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.202+0000 7fe533000640 1 -- 172.21.15.99:0/2384118853 >> 172.21.15.99:0/2384118853 conn(0x7fe52c0fe310 msgr2=0x7fe52c072060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:11.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.202+0000 7fe533000640 1 -- 172.21.15.99:0/2384118853 shutdown_connections 2024-02-21T23:13:11.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.202+0000 7fe533000640 1 -- 172.21.15.99:0/2384118853 wait complete. 2024-02-21T23:13:11.208 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 10 2024-02-21T23:13:11.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.430+0000 7f4449400640 1 Processor -- start 2024-02-21T23:13:11.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.430+0000 7f4449400640 1 -- start start 2024-02-21T23:13:11.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.431+0000 7f4449400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f4444182a80 0x7f444418a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:11.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.431+0000 7f4449400640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f44440719b0 0x7f4444071e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:11.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.431+0000 7f4449400640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f444418a600 con 0x7f444418b980 2024-02-21T23:13:11.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.432+0000 7f4449400640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f444418a8e0 con 0x7f4444182a80 2024-02-21T23:13:11.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.432+0000 7f4449400640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f444418abc0 con 0x7f44440719b0 2024-02-21T23:13:11.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.432+0000 7f4443e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f4444182a80 0x7f444418a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:11.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.432+0000 7f4443400640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f444418b980 0x7f4444186a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.99:45442/0 (socket says 172.21.15.99:45442) 2024-02-21T23:13:11.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.432+0000 7f4443400640 1 -- 172.21.15.99:0/2382971004 learned_addr learned my addr 172.21.15.99:0/2382971004 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:13:11.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.432+0000 7f4448a00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f44440719b0 0x7f4444071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:11.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.432+0000 7f4442a00640 1 -- 172.21.15.99:0/2382971004 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2553911838 0 0) 0x7f444418a600 con 0x7f444418b980 2024-02-21T23:13:11.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.432+0000 7f4442a00640 1 -- 172.21.15.99:0/2382971004 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4428003520 con 0x7f444418b980 2024-02-21T23:13:11.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.433+0000 7f4448a00640 1 -- 172.21.15.99:0/2382971004 >> v2:172.21.15.99:3300/0 conn(0x7f4444182a80 msgr2=0x7f444418a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:13:11.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.433+0000 7f4448a00640 1 --2- 172.21.15.99:0/2382971004 >> v2:172.21.15.99:3300/0 conn(0x7f4444182a80 0x7f444418a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:11.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.433+0000 7f4448a00640 1 -- 172.21.15.99:0/2382971004 >> v1:172.21.15.162:6789/0 conn(0x7f444418b980 legacy=0x7f4444186a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:11.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.433+0000 7f4448a00640 1 -- 172.21.15.99:0/2382971004 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f444418aea0 con 0x7f44440719b0 2024-02-21T23:13:11.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.433+0000 7f4443e00640 1 --2- 172.21.15.99:0/2382971004 >> v2:172.21.15.99:3300/0 conn(0x7f4444182a80 0x7f444418a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:13:11.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.434+0000 7f4448a00640 1 --2- 172.21.15.99:0/2382971004 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f44440719b0 0x7f4444071e40 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f444418c720 tx=0x7f443c02bda0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db1ab5c780c11367 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:11.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.434+0000 7f4442a00640 1 -- 172.21.15.99:0/2382971004 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f443c039070 con 0x7f44440719b0 2024-02-21T23:13:11.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.434+0000 7f4442a00640 1 -- 172.21.15.99:0/2382971004 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f443c02cb50 con 0x7f44440719b0 2024-02-21T23:13:11.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.434+0000 7f4442a00640 1 -- 172.21.15.99:0/2382971004 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f443c034440 con 0x7f44440719b0 2024-02-21T23:13:11.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.435+0000 7f4449400640 1 -- 172.21.15.99:0/2382971004 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f44440719b0 msgr2=0x7f4444071e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:11.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.435+0000 7f4449400640 1 --2- 172.21.15.99:0/2382971004 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f44440719b0 0x7f4444071e40 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f444418c720 tx=0x7f443c02bda0 comp rx=0 tx=0).stop 2024-02-21T23:13:11.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.435+0000 7f4449400640 1 -- 172.21.15.99:0/2382971004 shutdown_connections 2024-02-21T23:13:11.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.435+0000 7f4449400640 1 --2- 172.21.15.99:0/2382971004 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f44440719b0 0x7f4444071e40 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:11.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.435+0000 7f4449400640 1 --2- 172.21.15.99:0/2382971004 >> v2:172.21.15.99:3300/0 conn(0x7f4444182a80 0x7f444418a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:11.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.435+0000 7f4449400640 1 -- 172.21.15.99:0/2382971004 >> 172.21.15.99:0/2382971004 conn(0x7f44440d29f0 msgr2=0x7f44440d2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:11.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.435+0000 7f4449400640 1 -- 172.21.15.99:0/2382971004 shutdown_connections 2024-02-21T23:13:11.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.435+0000 7f4449400640 1 -- 172.21.15.99:0/2382971004 wait complete. 2024-02-21T23:13:11.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.438+0000 7f4449400640 1 Processor -- start 2024-02-21T23:13:11.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.438+0000 7f4449400640 1 -- start start 2024-02-21T23:13:11.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.440+0000 7f4449400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44440719b0 0x7f44440f5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:11.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.440+0000 7f4449400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4444182a80 0x7f4444178e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:11.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.441+0000 7f4449400640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f444418b980 0x7f444417d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:11.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.441+0000 7f4449400640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f444418be00 con 0x7f44440719b0 2024-02-21T23:13:11.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.441+0000 7f4449400640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f444418b460 con 0x7f4444182a80 2024-02-21T23:13:11.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.441+0000 7f4449400640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4444182e60 con 0x7f444418b980 2024-02-21T23:13:11.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.441+0000 7f4443e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44440719b0 0x7f44440f5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:11.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.441+0000 7f4443400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4444182a80 0x7f4444178e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:11.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.441+0000 7f4443e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44440719b0 0x7f44440f5890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56142/0 (socket says 172.21.15.99:56142) 2024-02-21T23:13:11.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.441+0000 7f4443e00640 1 -- 172.21.15.99:0/2130359289 learned_addr learned my addr 172.21.15.99:0/2130359289 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:13:11.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.441+0000 7f4448a00640 1 --2- 172.21.15.99:0/2130359289 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f444418b980 0x7f444417d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:11.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.441+0000 7f4443400640 1 -- 172.21.15.99:0/2130359289 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f444418b980 msgr2=0x7f444417d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:11.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.441+0000 7f4443400640 1 --2- 172.21.15.99:0/2130359289 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f444418b980 0x7f444417d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:11.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.441+0000 7f4443400640 1 -- 172.21.15.99:0/2130359289 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44440719b0 msgr2=0x7f44440f5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:11.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.441+0000 7f4443400640 1 --2- 172.21.15.99:0/2130359289 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44440719b0 0x7f44440f5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:11.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.441+0000 7f4443400640 1 -- 172.21.15.99:0/2130359289 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44440d4410 con 0x7f4444182a80 2024-02-21T23:13:11.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.442+0000 7f4443400640 1 --2- 172.21.15.99:0/2130359289 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4444182a80 0x7f4444178e80 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f4430000fb0 tx=0x7f443000c870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:11.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.442+0000 7f443be00640 1 -- 172.21.15.99:0/2130359289 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4430017070 con 0x7f4444182a80 2024-02-21T23:13:11.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.442+0000 7f443be00640 1 -- 172.21.15.99:0/2130359289 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4430005d50 con 0x7f4444182a80 2024-02-21T23:13:11.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.442+0000 7f443be00640 1 -- 172.21.15.99:0/2130359289 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4430007310 con 0x7f4444182a80 2024-02-21T23:13:11.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.442+0000 7f4449400640 1 -- 172.21.15.99:0/2130359289 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44440d46f0 con 0x7f4444182a80 2024-02-21T23:13:11.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.442+0000 7f4449400640 1 -- 172.21.15.99:0/2130359289 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44440d4cb0 con 0x7f4444182a80 2024-02-21T23:13:11.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.443+0000 7f4449400640 1 -- 172.21.15.99:0/2130359289 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4444068320 con 0x7f4444182a80 2024-02-21T23:13:11.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.447+0000 7f443be00640 1 -- 172.21.15.99:0/2130359289 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f443001a070 con 0x7f4444182a80 2024-02-21T23:13:11.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.448+0000 7f443be00640 1 --2- 172.21.15.99:0/2130359289 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f442409eed0 0x7f44240a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:11.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.448+0000 7f443be00640 1 -- 172.21.15.99:0/2130359289 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f44300c9200 con 0x7f4444182a80 2024-02-21T23:13:11.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.449+0000 7f4443e00640 1 --2- 172.21.15.99:0/2130359289 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f442409eed0 0x7f44240a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:11.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.449+0000 7f4443e00640 1 --2- 172.21.15.99:0/2130359289 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f442409eed0 0x7f44240a1390 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f44340095e0 tx=0x7f4434009190 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:11.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.453+0000 7f443be00640 1 -- 172.21.15.99:0/2130359289 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f4430096b60 con 0x7f4444182a80 2024-02-21T23:13:11.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.680+0000 7f4449400640 1 -- 172.21.15.99:0/2130359289 --> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "10", "target": ["mon-mgr", ""]}) v1 -- 0x7f44440d3b90 con 0x7f442409eed0 2024-02-21T23:13:11.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.680+0000 7f443be00640 1 -- 172.21.15.99:0/2130359289 <== mgr.5131 v2:172.21.15.162:6800/631076050 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 10 to deep-scrub) v1 ==== 42+0+0 (secure 0 0 0) 0x7f44440d3b90 con 0x7f442409eed0 2024-02-21T23:13:11.668 INFO:teuthology.orchestra.run.smithi099.stderr:instructed osd(s) 10 to deep-scrub 2024-02-21T23:13:11.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.684+0000 7f4449400640 1 -- 172.21.15.99:0/2130359289 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f442409eed0 msgr2=0x7f44240a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:11.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.684+0000 7f4449400640 1 --2- 172.21.15.99:0/2130359289 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f442409eed0 0x7f44240a1390 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f44340095e0 tx=0x7f4434009190 comp rx=0 tx=0).stop 2024-02-21T23:13:11.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.684+0000 7f4449400640 1 -- 172.21.15.99:0/2130359289 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4444182a80 msgr2=0x7f4444178e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:11.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.684+0000 7f4449400640 1 --2- 172.21.15.99:0/2130359289 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4444182a80 0x7f4444178e80 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f4430000fb0 tx=0x7f443000c870 comp rx=0 tx=0).stop 2024-02-21T23:13:11.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.684+0000 7f4449400640 1 -- 172.21.15.99:0/2130359289 shutdown_connections 2024-02-21T23:13:11.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.684+0000 7f4449400640 1 --2- 172.21.15.99:0/2130359289 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f442409eed0 0x7f44240a1390 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:11.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.684+0000 7f4449400640 1 --2- 172.21.15.99:0/2130359289 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f444418b980 0x7f444417d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:11.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.684+0000 7f4449400640 1 --2- 172.21.15.99:0/2130359289 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4444182a80 0x7f4444178e80 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:11.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.684+0000 7f4449400640 1 --2- 172.21.15.99:0/2130359289 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f44440719b0 0x7f44440f5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:11.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.684+0000 7f4449400640 1 -- 172.21.15.99:0/2130359289 >> 172.21.15.99:0/2130359289 conn(0x7f44440d29f0 msgr2=0x7f444417fd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:11.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.684+0000 7f4449400640 1 -- 172.21.15.99:0/2130359289 shutdown_connections 2024-02-21T23:13:11.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.684+0000 7f4449400640 1 -- 172.21.15.99:0/2130359289 wait complete. 2024-02-21T23:13:11.696 INFO:tasks.ceph:Scrubbing osd.2 2024-02-21T23:13:11.696 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-02-21T23:13:11.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.900+0000 7f5481e00640 1 Processor -- start 2024-02-21T23:13:11.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.900+0000 7f5481e00640 1 -- start start 2024-02-21T23:13:11.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.902+0000 7f5481e00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f547c17f710 0x7f547c189f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:11.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.902+0000 7f5481e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f547c18b920 0x7f547c15e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:11.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.902+0000 7f5481e00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f547c18a5a0 con 0x7f547c071c20 2024-02-21T23:13:11.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.902+0000 7f5481e00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f547c18bda0 con 0x7f547c18b920 2024-02-21T23:13:11.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.902+0000 7f5481e00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f547c18a880 con 0x7f547c17f710 2024-02-21T23:13:11.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.902+0000 7f5480a00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f547c17f710 0x7f547c189f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:11.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.902+0000 7f547be00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f547c18b920 0x7f547c15e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:11.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.902+0000 7f5480a00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f547c17f710 0x7f547c189f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:37278/0 (socket says 172.21.15.99:37278) 2024-02-21T23:13:11.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.902+0000 7f5480a00640 1 -- 172.21.15.99:0/3595052994 learned_addr learned my addr 172.21.15.99:0/3595052994 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:13:11.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.902+0000 7f5481400640 1 --1- 172.21.15.99:0/3595052994 >> v1:172.21.15.99:6789/0 conn(0x7f547c071c20 0x7f547c188a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:58252/0 (socket says 172.21.15.99:58252) 2024-02-21T23:13:11.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.903+0000 7f5480a00640 1 -- 172.21.15.99:0/3595052994 >> v2:172.21.15.99:3300/0 conn(0x7f547c18b920 msgr2=0x7f547c15e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:13:11.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.903+0000 7f5480a00640 1 --2- 172.21.15.99:0/3595052994 >> v2:172.21.15.99:3300/0 conn(0x7f547c18b920 0x7f547c15e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:11.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.903+0000 7f5480a00640 1 -- 172.21.15.99:0/3595052994 >> v1:172.21.15.99:6789/0 conn(0x7f547c071c20 legacy=0x7f547c188a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:11.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.903+0000 7f5480a00640 1 -- 172.21.15.99:0/3595052994 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f547c18ab60 con 0x7f547c17f710 2024-02-21T23:13:11.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.904+0000 7f5480a00640 1 --2- 172.21.15.99:0/3595052994 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f547c17f710 0x7f547c189f40 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f547c0fbe00 tx=0x7f547002b9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a70a766ca3a758c server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:11.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.904+0000 7f547b400640 1 -- 172.21.15.99:0/3595052994 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5470034070 con 0x7f547c17f710 2024-02-21T23:13:11.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.904+0000 7f547b400640 1 -- 172.21.15.99:0/3595052994 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5470030860 con 0x7f547c17f710 2024-02-21T23:13:11.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.904+0000 7f547b400640 1 -- 172.21.15.99:0/3595052994 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5470030c30 con 0x7f547c17f710 2024-02-21T23:13:11.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.905+0000 7f5481e00640 1 -- 172.21.15.99:0/3595052994 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f547c17f710 msgr2=0x7f547c189f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:11.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.905+0000 7f5481e00640 1 --2- 172.21.15.99:0/3595052994 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f547c17f710 0x7f547c189f40 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f547c0fbe00 tx=0x7f547002b9a0 comp rx=0 tx=0).stop 2024-02-21T23:13:11.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.905+0000 7f5481e00640 1 -- 172.21.15.99:0/3595052994 shutdown_connections 2024-02-21T23:13:11.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.905+0000 7f5481e00640 1 --2- 172.21.15.99:0/3595052994 >> v2:172.21.15.99:3300/0 conn(0x7f547c18b920 0x7f547c15e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:11.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.905+0000 7f5481e00640 1 --2- 172.21.15.99:0/3595052994 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f547c17f710 0x7f547c189f40 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:11.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.905+0000 7f5481e00640 1 -- 172.21.15.99:0/3595052994 >> 172.21.15.99:0/3595052994 conn(0x7f547c0fe310 msgr2=0x7f547c0fe720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:11.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.905+0000 7f5481e00640 1 -- 172.21.15.99:0/3595052994 shutdown_connections 2024-02-21T23:13:11.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.905+0000 7f5481e00640 1 -- 172.21.15.99:0/3595052994 wait complete. 2024-02-21T23:13:11.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.907+0000 7f5481e00640 1 Processor -- start 2024-02-21T23:13:11.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.907+0000 7f5481e00640 1 -- start start 2024-02-21T23:13:11.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.908+0000 7f5481e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f547c071c20 0x7f547c221400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:11.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.908+0000 7f5481e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f547c17f710 0x7f547c17e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:11.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.908+0000 7f5481e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f547c18b920 0x7f547c17ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:11.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.908+0000 7f5481e00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f547c15e9d0 con 0x7f547c071c20 2024-02-21T23:13:11.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.908+0000 7f5481e00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f547c18b120 con 0x7f547c18b920 2024-02-21T23:13:11.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.908+0000 7f5481e00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f547c15eb50 con 0x7f547c17f710 2024-02-21T23:13:11.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.908+0000 7f5480a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f547c071c20 0x7f547c221400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:11.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.909+0000 7f5480a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f547c071c20 0x7f547c221400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56152/0 (socket says 172.21.15.99:56152) 2024-02-21T23:13:11.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.909+0000 7f5480a00640 1 -- 172.21.15.99:0/1133721725 learned_addr learned my addr 172.21.15.99:0/1133721725 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:13:11.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.909+0000 7f547be00640 1 --2- 172.21.15.99:0/1133721725 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f547c17f710 0x7f547c17e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:11.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.909+0000 7f5481400640 1 --2- 172.21.15.99:0/1133721725 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f547c18b920 0x7f547c17ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:11.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.909+0000 7f5480a00640 1 -- 172.21.15.99:0/1133721725 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f547c17f710 msgr2=0x7f547c17e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:11.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.909+0000 7f5480a00640 1 --2- 172.21.15.99:0/1133721725 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f547c17f710 0x7f547c17e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:11.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.909+0000 7f5480a00640 1 -- 172.21.15.99:0/1133721725 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f547c18b920 msgr2=0x7f547c17ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:11.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.909+0000 7f5480a00640 1 --2- 172.21.15.99:0/1133721725 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f547c18b920 0x7f547c17ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:11.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.909+0000 7f5480a00640 1 -- 172.21.15.99:0/1133721725 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f547c17ef80 con 0x7f547c071c20 2024-02-21T23:13:11.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.909+0000 7f5481400640 1 --2- 172.21.15.99:0/1133721725 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f547c18b920 0x7f547c17ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:13:11.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.909+0000 7f5480a00640 1 --2- 172.21.15.99:0/1133721725 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f547c071c20 0x7f547c221400 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f54700097c0 tx=0x7f54700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:11.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.910+0000 7f5478c00640 1 -- 172.21.15.99:0/1133721725 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5470034040 con 0x7f547c071c20 2024-02-21T23:13:11.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.910+0000 7f5478c00640 1 -- 172.21.15.99:0/1133721725 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5470039d90 con 0x7f547c071c20 2024-02-21T23:13:11.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.910+0000 7f5481e00640 1 -- 172.21.15.99:0/1133721725 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f547c178150 con 0x7f547c071c20 2024-02-21T23:13:11.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.910+0000 7f5478c00640 1 -- 172.21.15.99:0/1133721725 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5470043630 con 0x7f547c071c20 2024-02-21T23:13:11.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.910+0000 7f5481e00640 1 -- 172.21.15.99:0/1133721725 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f547c178710 con 0x7f547c071c20 2024-02-21T23:13:11.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.911+0000 7f5481e00640 1 -- 172.21.15.99:0/1133721725 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f547c0682b0 con 0x7f547c071c20 2024-02-21T23:13:11.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.915+0000 7f5478c00640 1 -- 172.21.15.99:0/1133721725 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f547004a060 con 0x7f547c071c20 2024-02-21T23:13:11.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.917+0000 7f5478c00640 1 --2- 172.21.15.99:0/1133721725 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f545c09eed0 0x7f545c0a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:11.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.917+0000 7f5478c00640 1 -- 172.21.15.99:0/1133721725 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f54700ec660 con 0x7f547c071c20 2024-02-21T23:13:11.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.917+0000 7f547be00640 1 --2- 172.21.15.99:0/1133721725 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f545c09eed0 0x7f545c0a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:11.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.918+0000 7f5478c00640 1 --2- 172.21.15.99:0/1133721725 >> [v2:172.21.15.181:6816/2782386148,v1:172.21.15.181:6818/2782386148] conn(0x7f545c0a9de0 0x7f545c0ac260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:11.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.918+0000 7f5478c00640 1 -- 172.21.15.99:0/1133721725 --> [v2:172.21.15.181:6816/2782386148,v1:172.21.15.181:6818/2782386148] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5470001d30 con 0x7f545c0a9de0 2024-02-21T23:13:11.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.918+0000 7f5478c00640 1 -- 172.21.15.99:0/1133721725 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f54700eca10 con 0x7f547c071c20 2024-02-21T23:13:11.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.918+0000 7f5481400640 1 --2- 172.21.15.99:0/1133721725 >> [v2:172.21.15.181:6816/2782386148,v1:172.21.15.181:6818/2782386148] conn(0x7f545c0a9de0 0x7f545c0ac260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:11.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.918+0000 7f547be00640 1 --2- 172.21.15.99:0/1133721725 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f545c09eed0 0x7f545c0a1390 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f547c0fedc0 tx=0x7f5468009190 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:11.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.918+0000 7f5481400640 1 --2- 172.21.15.99:0/1133721725 >> [v2:172.21.15.181:6816/2782386148,v1:172.21.15.181:6818/2782386148] conn(0x7f545c0a9de0 0x7f545c0ac260 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:11.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.919+0000 7f5478c00640 1 -- 172.21.15.99:0/1133721725 <== osd.2 v2:172.21.15.181:6816/2782386148 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f5470001d30 con 0x7f545c0a9de0 2024-02-21T23:13:11.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.933+0000 7f5481e00640 1 -- 172.21.15.99:0/1133721725 --> [v2:172.21.15.181:6816/2782386148,v1:172.21.15.181:6818/2782386148] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f547c15f150 con 0x7f545c0a9de0 2024-02-21T23:13:11.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.934+0000 7f5478c00640 1 -- 172.21.15.99:0/1133721725 <== osd.2 v2:172.21.15.181:6816/2782386148 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f547c15f150 con 0x7f545c0a9de0 2024-02-21T23:13:11.922 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-02-21T23:13:11.923 INFO:teuthology.orchestra.run.smithi099.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-21T23:13:11.923 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-02-21T23:13:11.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.934+0000 7f5481e00640 1 -- 172.21.15.99:0/1133721725 >> [v2:172.21.15.181:6816/2782386148,v1:172.21.15.181:6818/2782386148] conn(0x7f545c0a9de0 msgr2=0x7f545c0ac260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:11.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.934+0000 7f5481e00640 1 --2- 172.21.15.99:0/1133721725 >> [v2:172.21.15.181:6816/2782386148,v1:172.21.15.181:6818/2782386148] conn(0x7f545c0a9de0 0x7f545c0ac260 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:11.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.935+0000 7f5481e00640 1 -- 172.21.15.99:0/1133721725 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f545c09eed0 msgr2=0x7f545c0a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:11.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.935+0000 7f5481e00640 1 --2- 172.21.15.99:0/1133721725 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f545c09eed0 0x7f545c0a1390 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f547c0fedc0 tx=0x7f5468009190 comp rx=0 tx=0).stop 2024-02-21T23:13:11.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.935+0000 7f5481e00640 1 -- 172.21.15.99:0/1133721725 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f547c071c20 msgr2=0x7f547c221400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:11.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.935+0000 7f5481e00640 1 --2- 172.21.15.99:0/1133721725 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f547c071c20 0x7f547c221400 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f54700097c0 tx=0x7f54700046c0 comp rx=0 tx=0).stop 2024-02-21T23:13:11.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.935+0000 7f5481400640 1 -- 172.21.15.99:0/1133721725 reap_dead start 2024-02-21T23:13:11.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.935+0000 7f5481e00640 1 -- 172.21.15.99:0/1133721725 shutdown_connections 2024-02-21T23:13:11.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.935+0000 7f5481e00640 1 -- 172.21.15.99:0/1133721725 >> 172.21.15.99:0/1133721725 conn(0x7f547c0fe310 msgr2=0x7f547c0fda90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:11.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.935+0000 7f5481e00640 1 -- 172.21.15.99:0/1133721725 shutdown_connections 2024-02-21T23:13:11.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:11.935+0000 7f5481e00640 1 -- 172.21.15.99:0/1133721725 wait complete. 2024-02-21T23:13:11.939 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-02-21T23:13:12.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.171+0000 7f7e0b200640 1 Processor -- start 2024-02-21T23:13:12.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.172+0000 7f7e0b200640 1 -- start start 2024-02-21T23:13:12.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.173+0000 7f7e0b200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7e0c182940 0x7f7e0c072010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:12.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.174+0000 7f7e0b200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e0c0727b0 con 0x7f7e0c0f7a40 2024-02-21T23:13:12.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.174+0000 7f7e0b200640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e0c072a90 con 0x7f7e0c182d20 2024-02-21T23:13:12.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.174+0000 7f7e0b200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e0c189a60 con 0x7f7e0c182940 2024-02-21T23:13:12.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.174+0000 7f7e09e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7e0c182940 0x7f7e0c072010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:12.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.174+0000 7f7e09400640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7f7e0c182d20 0x7f7e0c0f7330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:58984/0 (socket says 172.21.15.99:58984) 2024-02-21T23:13:12.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.174+0000 7f7e09e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f7e0c182940 0x7f7e0c072010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56158/0 (socket says 172.21.15.99:56158) 2024-02-21T23:13:12.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.174+0000 7f7e09400640 1 -- 172.21.15.99:0/3787424622 learned_addr learned my addr 172.21.15.99:0/3787424622 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:13:12.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.174+0000 7f7e08a00640 1 -- 172.21.15.99:0/3787424622 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4259252229 0 0) 0x7f7e0c072a90 con 0x7f7e0c182d20 2024-02-21T23:13:12.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.175+0000 7f7e08a00640 1 -- 172.21.15.99:0/3787424622 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7df0003520 con 0x7f7e0c182d20 2024-02-21T23:13:12.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.175+0000 7f7e09e00640 1 -- 172.21.15.99:0/3787424622 >> v1:172.21.15.181:6789/0 conn(0x7f7e0c182d20 legacy=0x7f7e0c0f7330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:12.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.175+0000 7f7e09e00640 1 -- 172.21.15.99:0/3787424622 >> v1:172.21.15.99:6789/0 conn(0x7f7e0c0f7a40 legacy=0x7f7e0c18c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:12.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.175+0000 7f7e08a00640 1 -- 172.21.15.99:0/3787424622 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2521425480 0 0) 0x7f7e0c0727b0 con 0x7f7e0c0f7a40 2024-02-21T23:13:12.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.175+0000 7f7e09e00640 1 -- 172.21.15.99:0/3787424622 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e0c072d70 con 0x7f7e0c182940 2024-02-21T23:13:12.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.176+0000 7f7e09e00640 1 --2- 172.21.15.99:0/3787424622 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e0c182940 0x7f7e0c072010 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc0097a0 tx=0x7f7dfc02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f81d25caa2ddedc server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:12.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.176+0000 7f7e08a00640 1 -- 172.21.15.99:0/3787424622 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dfc035020 con 0x7f7e0c182940 2024-02-21T23:13:12.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.176+0000 7f7e08a00640 1 -- 172.21.15.99:0/3787424622 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dfc031640 con 0x7f7e0c182940 2024-02-21T23:13:12.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.176+0000 7f7e08a00640 1 -- 172.21.15.99:0/3787424622 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dfc02d040 con 0x7f7e0c182940 2024-02-21T23:13:12.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.177+0000 7f7e0b200640 1 -- 172.21.15.99:0/3787424622 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e0c182940 msgr2=0x7f7e0c072010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:12.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.177+0000 7f7e0b200640 1 --2- 172.21.15.99:0/3787424622 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e0c182940 0x7f7e0c072010 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc0097a0 tx=0x7f7dfc02b8f0 comp rx=0 tx=0).stop 2024-02-21T23:13:12.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.177+0000 7f7e0b200640 1 -- 172.21.15.99:0/3787424622 shutdown_connections 2024-02-21T23:13:12.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.177+0000 7f7e0b200640 1 --2- 172.21.15.99:0/3787424622 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e0c182940 0x7f7e0c072010 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:12.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.177+0000 7f7e0b200640 1 -- 172.21.15.99:0/3787424622 >> 172.21.15.99:0/3787424622 conn(0x7f7e0c0d05e0 msgr2=0x7f7e0c0d09f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:12.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.177+0000 7f7e0b200640 1 -- 172.21.15.99:0/3787424622 shutdown_connections 2024-02-21T23:13:12.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.177+0000 7f7e0b200640 1 -- 172.21.15.99:0/3787424622 wait complete. 2024-02-21T23:13:12.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.180+0000 7f7e0b200640 1 Processor -- start 2024-02-21T23:13:12.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.180+0000 7f7e0b200640 1 -- start start 2024-02-21T23:13:12.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.182+0000 7f7e0b200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7e0c0f7a40 0x7f7e0c21ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:12.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.182+0000 7f7e0b200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e0c182940 0x7f7e0c16d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:12.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.182+0000 7f7e0b200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e0c220480 0x7f7e0c21ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:12.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.182+0000 7f7e0b200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0c0f6b30 con 0x7f7e0c220480 2024-02-21T23:13:12.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.182+0000 7f7e0b200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0c072550 con 0x7f7e0c182940 2024-02-21T23:13:12.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.182+0000 7f7e0b200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0c0f6e10 con 0x7f7e0c0f7a40 2024-02-21T23:13:12.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.182+0000 7f7e09e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7e0c0f7a40 0x7f7e0c21ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:12.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.182+0000 7f7e0a800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e0c220480 0x7f7e0c21ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:12.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.182+0000 7f7e09e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7e0c0f7a40 0x7f7e0c21ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:37290/0 (socket says 172.21.15.99:37290) 2024-02-21T23:13:12.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.182+0000 7f7e09e00640 1 -- 172.21.15.99:0/2758445517 learned_addr learned my addr 172.21.15.99:0/2758445517 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:13:12.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.182+0000 7f7e09400640 1 --2- 172.21.15.99:0/2758445517 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e0c182940 0x7f7e0c16d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:12.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.183+0000 7f7e0a800640 1 -- 172.21.15.99:0/2758445517 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7e0c0f7a40 msgr2=0x7f7e0c21ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:12.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.183+0000 7f7e0a800640 1 --2- 172.21.15.99:0/2758445517 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7e0c0f7a40 0x7f7e0c21ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:12.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.183+0000 7f7e0a800640 1 -- 172.21.15.99:0/2758445517 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e0c182940 msgr2=0x7f7e0c16d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:12.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.183+0000 7f7e0a800640 1 --2- 172.21.15.99:0/2758445517 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e0c182940 0x7f7e0c16d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:12.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.183+0000 7f7e0a800640 1 -- 172.21.15.99:0/2758445517 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e0c21f990 con 0x7f7e0c220480 2024-02-21T23:13:12.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.183+0000 7f7e0a800640 1 --2- 172.21.15.99:0/2758445517 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e0c220480 0x7f7e0c21ca40 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c0d1700 tx=0x7f7e0400cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:12.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.183+0000 7f7e02000640 1 -- 172.21.15.99:0/2758445517 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e04003b70 con 0x7f7e0c220480 2024-02-21T23:13:12.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.183+0000 7f7e02000640 1 -- 172.21.15.99:0/2758445517 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e04003d10 con 0x7f7e0c220480 2024-02-21T23:13:12.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.183+0000 7f7e0b200640 1 -- 172.21.15.99:0/2758445517 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e0c220980 con 0x7f7e0c220480 2024-02-21T23:13:12.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.183+0000 7f7e02000640 1 -- 172.21.15.99:0/2758445517 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e040052b0 con 0x7f7e0c220480 2024-02-21T23:13:12.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.184+0000 7f7e0b200640 1 -- 172.21.15.99:0/2758445517 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e0c220f40 con 0x7f7e0c220480 2024-02-21T23:13:12.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.186+0000 7f7e0b200640 1 -- 172.21.15.99:0/2758445517 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e0c0d09c0 con 0x7f7e0c220480 2024-02-21T23:13:12.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.187+0000 7f7e02000640 1 -- 172.21.15.99:0/2758445517 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f7e04005450 con 0x7f7e0c220480 2024-02-21T23:13:12.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.189+0000 7f7e02000640 1 --2- 172.21.15.99:0/2758445517 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f7dec09ef00 0x7f7dec0a13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:12.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.189+0000 7f7e02000640 1 -- 172.21.15.99:0/2758445517 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f7e040c9af0 con 0x7f7e0c220480 2024-02-21T23:13:12.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.190+0000 7f7e09e00640 1 --2- 172.21.15.99:0/2758445517 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f7dec09ef00 0x7f7dec0a13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:12.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.190+0000 7f7e09e00640 1 --2- 172.21.15.99:0/2758445517 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f7dec09ef00 0x7f7dec0a13c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc034040 tx=0x7f7dfc03c040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:12.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.198+0000 7f7e02000640 1 -- 172.21.15.99:0/2758445517 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f7e0c0d09c0 con 0x7f7e0c220480 2024-02-21T23:13:12.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.481+0000 7f7e0b200640 1 -- 172.21.15.99:0/2758445517 --> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f7e0c0f9ce0 con 0x7f7dec09ef00 2024-02-21T23:13:12.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.482+0000 7f7e02000640 1 -- 172.21.15.99:0/2758445517 <== mgr.5131 v2:172.21.15.162:6800/631076050 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f7e0c0f9ce0 con 0x7f7dec09ef00 2024-02-21T23:13:12.571 INFO:teuthology.orchestra.run.smithi099.stderr:instructed osd(s) 2 to deep-scrub 2024-02-21T23:13:12.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.486+0000 7f7e0b200640 1 -- 172.21.15.99:0/2758445517 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f7dec09ef00 msgr2=0x7f7dec0a13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:12.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.486+0000 7f7e0b200640 1 --2- 172.21.15.99:0/2758445517 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f7dec09ef00 0x7f7dec0a13c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc034040 tx=0x7f7dfc03c040 comp rx=0 tx=0).stop 2024-02-21T23:13:12.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.486+0000 7f7e0b200640 1 -- 172.21.15.99:0/2758445517 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e0c220480 msgr2=0x7f7e0c21ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:12.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.486+0000 7f7e0b200640 1 --2- 172.21.15.99:0/2758445517 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e0c220480 0x7f7e0c21ca40 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c0d1700 tx=0x7f7e0400cbe0 comp rx=0 tx=0).stop 2024-02-21T23:13:12.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.486+0000 7f7e0b200640 1 -- 172.21.15.99:0/2758445517 shutdown_connections 2024-02-21T23:13:12.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.486+0000 7f7e0b200640 1 --2- 172.21.15.99:0/2758445517 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f7dec09ef00 0x7f7dec0a13c0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:12.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.486+0000 7f7e0b200640 1 --2- 172.21.15.99:0/2758445517 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f7e0c220480 0x7f7e0c21ca40 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:12.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.486+0000 7f7e0b200640 1 --2- 172.21.15.99:0/2758445517 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e0c182940 0x7f7e0c16d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:12.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.486+0000 7f7e0b200640 1 --2- 172.21.15.99:0/2758445517 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f7e0c0f7a40 0x7f7e0c21ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:12.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.486+0000 7f7e0b200640 1 -- 172.21.15.99:0/2758445517 >> 172.21.15.99:0/2758445517 conn(0x7f7e0c0d05e0 msgr2=0x7f7e0c0f9f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:12.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.486+0000 7f7e0b200640 1 -- 172.21.15.99:0/2758445517 shutdown_connections 2024-02-21T23:13:12.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.486+0000 7f7e0b200640 1 -- 172.21.15.99:0/2758445517 wait complete. 2024-02-21T23:13:12.574 INFO:tasks.ceph:Scrubbing osd.5 2024-02-21T23:13:12.574 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-02-21T23:13:12.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.813+0000 7f7513200640 1 Processor -- start 2024-02-21T23:13:12.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.814+0000 7f7513200640 1 -- start start 2024-02-21T23:13:12.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.815+0000 7f7513200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f751418bfd0 0x7f75141890b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:12.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.815+0000 7f7513200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7514186650 con 0x7f751418cac0 2024-02-21T23:13:12.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.815+0000 7f7513200640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7514071b10 con 0x7f75141895f0 2024-02-21T23:13:12.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.815+0000 7f7513200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7514071df0 con 0x7f751418bfd0 2024-02-21T23:13:12.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.816+0000 7f7512800640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f751418cac0 0x7f7514189ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:58282/0 (socket says 172.21.15.99:58282) 2024-02-21T23:13:12.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.816+0000 7f7512800640 1 -- 172.21.15.99:0/2811779371 learned_addr learned my addr 172.21.15.99:0/2811779371 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:13:12.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.816+0000 7f7511e00640 1 --2- 172.21.15.99:0/2811779371 >> v2:172.21.15.162:3300/0 conn(0x7f751418bfd0 0x7f75141890b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:12.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.816+0000 7f7511400640 1 -- 172.21.15.99:0/2811779371 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1042514090 0 0) 0x7f7514186650 con 0x7f751418cac0 2024-02-21T23:13:12.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.816+0000 7f7511400640 1 -- 172.21.15.99:0/2811779371 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74f8003520 con 0x7f751418cac0 2024-02-21T23:13:12.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.816+0000 7f7511400640 1 -- 172.21.15.99:0/2811779371 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 370256033 0 0) 0x7f7514071b10 con 0x7f75141895f0 2024-02-21T23:13:12.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.816+0000 7f7511400640 1 -- 172.21.15.99:0/2811779371 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7514186650 con 0x7f75141895f0 2024-02-21T23:13:12.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.816+0000 7f7511e00640 1 -- 172.21.15.99:0/2811779371 >> v1:172.21.15.181:6789/0 conn(0x7f75141895f0 legacy=0x7f751418c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:12.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.816+0000 7f7511e00640 1 -- 172.21.15.99:0/2811779371 >> v1:172.21.15.99:6789/0 conn(0x7f751418cac0 legacy=0x7f7514189ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:12.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.816+0000 7f7511e00640 1 -- 172.21.15.99:0/2811779371 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75140720d0 con 0x7f751418bfd0 2024-02-21T23:13:12.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.818+0000 7f7511e00640 1 --2- 172.21.15.99:0/2811779371 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f751418bfd0 0x7f75141890b0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f75040097a0 tx=0x7f750402b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4319aeb309d3642b server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:12.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.818+0000 7f7511400640 1 -- 172.21.15.99:0/2811779371 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7504034070 con 0x7f751418bfd0 2024-02-21T23:13:12.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.818+0000 7f7511400640 1 -- 172.21.15.99:0/2811779371 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7504030610 con 0x7f751418bfd0 2024-02-21T23:13:12.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.819+0000 7f7511400640 1 -- 172.21.15.99:0/2811779371 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75040309e0 con 0x7f751418bfd0 2024-02-21T23:13:12.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.819+0000 7f7513200640 1 -- 172.21.15.99:0/2811779371 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f751418bfd0 msgr2=0x7f75141890b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:12.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.819+0000 7f7513200640 1 --2- 172.21.15.99:0/2811779371 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f751418bfd0 0x7f75141890b0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f75040097a0 tx=0x7f750402b960 comp rx=0 tx=0).stop 2024-02-21T23:13:12.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.819+0000 7f7513200640 1 -- 172.21.15.99:0/2811779371 shutdown_connections 2024-02-21T23:13:12.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.819+0000 7f7513200640 1 --2- 172.21.15.99:0/2811779371 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f751418bfd0 0x7f75141890b0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:12.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.819+0000 7f7513200640 1 -- 172.21.15.99:0/2811779371 >> 172.21.15.99:0/2811779371 conn(0x7f751406e210 msgr2=0x7f751406e620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:12.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.820+0000 7f7513200640 1 -- 172.21.15.99:0/2811779371 shutdown_connections 2024-02-21T23:13:12.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.820+0000 7f7513200640 1 -- 172.21.15.99:0/2811779371 wait complete. 2024-02-21T23:13:12.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.823+0000 7f7513200640 1 Processor -- start 2024-02-21T23:13:12.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.823+0000 7f7513200640 1 -- start start 2024-02-21T23:13:12.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.825+0000 7f7513200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f75141895f0 0x7f751416cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:12.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.825+0000 7f7513200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f751418bfd0 0x7f75142120b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:12.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.825+0000 7f7513200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f751418cac0 0x7f75142125f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:12.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.825+0000 7f7513200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7514072970 con 0x7f751418cac0 2024-02-21T23:13:12.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.825+0000 7f7513200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7514072690 con 0x7f751418bfd0 2024-02-21T23:13:12.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.825+0000 7f7513200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75140cce60 con 0x7f75141895f0 2024-02-21T23:13:12.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.825+0000 7f7512800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f751418cac0 0x7f75142125f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:12.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.825+0000 7f7511e00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f75141895f0 0x7f751416cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:12.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.825+0000 7f7512800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f751418cac0 0x7f75142125f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56186/0 (socket says 172.21.15.99:56186) 2024-02-21T23:13:12.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.825+0000 7f7512800640 1 -- 172.21.15.99:0/20937204 learned_addr learned my addr 172.21.15.99:0/20937204 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:13:12.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.825+0000 7f750be00640 1 --2- 172.21.15.99:0/20937204 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f751418bfd0 0x7f75142120b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:12.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.826+0000 7f7511e00640 1 -- 172.21.15.99:0/20937204 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f751418bfd0 msgr2=0x7f75142120b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:12.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.826+0000 7f7511e00640 1 --2- 172.21.15.99:0/20937204 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f751418bfd0 0x7f75142120b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:12.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.826+0000 7f7511e00640 1 -- 172.21.15.99:0/20937204 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f751418cac0 msgr2=0x7f75142125f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:12.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.826+0000 7f7511e00640 1 --2- 172.21.15.99:0/20937204 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f751418cac0 0x7f75142125f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:12.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.826+0000 7f7511e00640 1 -- 172.21.15.99:0/20937204 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7514212c30 con 0x7f75141895f0 2024-02-21T23:13:12.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.826+0000 7f7511e00640 1 --2- 172.21.15.99:0/20937204 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f75141895f0 0x7f751416cd10 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f7504033000 tx=0x7f75040046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:12.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.826+0000 7f750a000640 1 -- 172.21.15.99:0/20937204 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7504034040 con 0x7f75141895f0 2024-02-21T23:13:12.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.827+0000 7f750a000640 1 -- 172.21.15.99:0/20937204 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f750403aaa0 con 0x7f75141895f0 2024-02-21T23:13:12.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.827+0000 7f750a000640 1 -- 172.21.15.99:0/20937204 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7504006e10 con 0x7f75141895f0 2024-02-21T23:13:12.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.827+0000 7f7513200640 1 -- 172.21.15.99:0/20937204 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7514212f10 con 0x7f75141895f0 2024-02-21T23:13:12.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.827+0000 7f7513200640 1 -- 172.21.15.99:0/20937204 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75142134d0 con 0x7f75141895f0 2024-02-21T23:13:12.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.828+0000 7f7513200640 1 -- 172.21.15.99:0/20937204 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f75140682b0 con 0x7f75141895f0 2024-02-21T23:13:12.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.830+0000 7f750a000640 1 -- 172.21.15.99:0/20937204 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f750404b060 con 0x7f75141895f0 2024-02-21T23:13:12.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.832+0000 7f750a000640 1 --2- 172.21.15.99:0/20937204 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f74f009eed0 0x7f74f00a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:12.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.832+0000 7f750a000640 1 -- 172.21.15.99:0/20937204 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f75040ec310 con 0x7f75141895f0 2024-02-21T23:13:12.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.832+0000 7f750be00640 1 --2- 172.21.15.99:0/20937204 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f74f009eed0 0x7f74f00a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:12.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.833+0000 7f750a000640 1 --2- 172.21.15.99:0/20937204 >> [v2:172.21.15.181:6800/2011264527,v1:172.21.15.181:6801/2011264527] conn(0x7f74f00a9de0 0x7f74f00ac260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:12.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.833+0000 7f750a000640 1 -- 172.21.15.99:0/20937204 --> [v2:172.21.15.181:6800/2011264527,v1:172.21.15.181:6801/2011264527] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7504031e90 con 0x7f74f00a9de0 2024-02-21T23:13:12.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.833+0000 7f750a000640 1 -- 172.21.15.99:0/20937204 <== mon.2 v2:172.21.15.181:3300/0 6 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f75040ec6c0 con 0x7f75141895f0 2024-02-21T23:13:12.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.833+0000 7f7512800640 1 --2- 172.21.15.99:0/20937204 >> [v2:172.21.15.181:6800/2011264527,v1:172.21.15.181:6801/2011264527] conn(0x7f74f00a9de0 0x7f74f00ac260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:12.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.833+0000 7f750be00640 1 --2- 172.21.15.99:0/20937204 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f74f009eed0 0x7f74f00a1390 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f74fc007fd0 tx=0x7f74fc009040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:12.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.834+0000 7f7512800640 1 --2- 172.21.15.99:0/20937204 >> [v2:172.21.15.181:6800/2011264527,v1:172.21.15.181:6801/2011264527] conn(0x7f74f00a9de0 0x7f74f00ac260 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:12.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.834+0000 7f750a000640 1 -- 172.21.15.99:0/20937204 <== osd.5 v2:172.21.15.181:6800/2011264527 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f7504031e90 con 0x7f74f00a9de0 2024-02-21T23:13:12.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.851+0000 7f7513200640 1 -- 172.21.15.99:0/20937204 --> [v2:172.21.15.181:6800/2011264527,v1:172.21.15.181:6801/2011264527] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f751406dfb0 con 0x7f74f00a9de0 2024-02-21T23:13:12.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.852+0000 7f750a000640 1 -- 172.21.15.99:0/20937204 <== osd.5 v2:172.21.15.181:6800/2011264527 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f751406dfb0 con 0x7f74f00a9de0 2024-02-21T23:13:12.840 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-02-21T23:13:12.840 INFO:teuthology.orchestra.run.smithi099.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-21T23:13:12.840 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-02-21T23:13:12.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.852+0000 7f7513200640 1 -- 172.21.15.99:0/20937204 >> [v2:172.21.15.181:6800/2011264527,v1:172.21.15.181:6801/2011264527] conn(0x7f74f00a9de0 msgr2=0x7f74f00ac260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:12.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.852+0000 7f7513200640 1 --2- 172.21.15.99:0/20937204 >> [v2:172.21.15.181:6800/2011264527,v1:172.21.15.181:6801/2011264527] conn(0x7f74f00a9de0 0x7f74f00ac260 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:12.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.853+0000 7f7513200640 1 -- 172.21.15.99:0/20937204 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f74f009eed0 msgr2=0x7f74f00a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:12.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.853+0000 7f7513200640 1 --2- 172.21.15.99:0/20937204 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f74f009eed0 0x7f74f00a1390 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f74fc007fd0 tx=0x7f74fc009040 comp rx=0 tx=0).stop 2024-02-21T23:13:12.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.853+0000 7f7513200640 1 -- 172.21.15.99:0/20937204 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f75141895f0 msgr2=0x7f751416cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:12.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.853+0000 7f7513200640 1 --2- 172.21.15.99:0/20937204 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f75141895f0 0x7f751416cd10 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f7504033000 tx=0x7f75040046c0 comp rx=0 tx=0).stop 2024-02-21T23:13:12.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.853+0000 7f7512800640 1 -- 172.21.15.99:0/20937204 reap_dead start 2024-02-21T23:13:12.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.853+0000 7f7513200640 1 -- 172.21.15.99:0/20937204 shutdown_connections 2024-02-21T23:13:12.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.853+0000 7f7513200640 1 -- 172.21.15.99:0/20937204 >> 172.21.15.99:0/20937204 conn(0x7f751406e210 msgr2=0x7f751406e5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:12.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.853+0000 7f7513200640 1 -- 172.21.15.99:0/20937204 shutdown_connections 2024-02-21T23:13:12.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:12.853+0000 7f7513200640 1 -- 172.21.15.99:0/20937204 wait complete. 2024-02-21T23:13:12.861 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-02-21T23:13:13.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.077+0000 7fac09800640 1 Processor -- start 2024-02-21T23:13:13.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.077+0000 7fac09800640 1 -- start start 2024-02-21T23:13:13.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.080+0000 7fac09800640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fac040d1ef0 0x7fac04186c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:13.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.080+0000 7fac09800640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac040f4b80 con 0x7fac04186830 2024-02-21T23:13:13.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.080+0000 7fac09800640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac040f4e60 con 0x7fac040d1a70 2024-02-21T23:13:13.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.080+0000 7fac09800640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac040f5140 con 0x7fac040d1ef0 2024-02-21T23:13:13.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.080+0000 7fac03e00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fac04186830 0x7fac04072f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:58284/0 (socket says 172.21.15.99:58284) 2024-02-21T23:13:13.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.080+0000 7fac08e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7fac040d1ef0 0x7fac04186c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:13.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.080+0000 7fac03400640 1 --1- >> v1:172.21.15.181:6789/0 conn(0x7fac040d1a70 0x7fac040cb5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:58994/0 (socket says 172.21.15.99:58994) 2024-02-21T23:13:13.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.080+0000 7fac03e00640 1 -- 172.21.15.99:0/3813039080 learned_addr learned my addr 172.21.15.99:0/3813039080 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:13:13.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.081+0000 7fac02a00640 1 -- 172.21.15.99:0/3813039080 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1300938257 0 0) 0x7fac040f4e60 con 0x7fac040d1a70 2024-02-21T23:13:13.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.081+0000 7fac02a00640 1 -- 172.21.15.99:0/3813039080 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabe8003520 con 0x7fac040d1a70 2024-02-21T23:13:13.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.081+0000 7fac08e00640 1 -- 172.21.15.99:0/3813039080 >> v1:172.21.15.181:6789/0 conn(0x7fac040d1a70 legacy=0x7fac040cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:13.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.081+0000 7fac08e00640 1 -- 172.21.15.99:0/3813039080 >> v1:172.21.15.99:6789/0 conn(0x7fac04186830 legacy=0x7fac04072f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:13.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.081+0000 7fac02a00640 1 -- 172.21.15.99:0/3813039080 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1946747145 0 0) 0x7fac040f4b80 con 0x7fac04186830 2024-02-21T23:13:13.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.081+0000 7fac08e00640 1 -- 172.21.15.99:0/3813039080 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac040f5420 con 0x7fac040d1ef0 2024-02-21T23:13:13.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.082+0000 7fac08e00640 1 --2- 172.21.15.99:0/3813039080 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fac040d1ef0 0x7fac04186c10 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fabfc009d90 tx=0x7fabfc02bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc072d02a61eedb server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:13.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.083+0000 7fac02a00640 1 -- 172.21.15.99:0/3813039080 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabfc039070 con 0x7fac040d1ef0 2024-02-21T23:13:13.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.083+0000 7fac02a00640 1 -- 172.21.15.99:0/3813039080 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabfc02cd00 con 0x7fac040d1ef0 2024-02-21T23:13:13.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.083+0000 7fac02a00640 1 -- 172.21.15.99:0/3813039080 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabfc034660 con 0x7fac040d1ef0 2024-02-21T23:13:13.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.083+0000 7fac09800640 1 -- 172.21.15.99:0/3813039080 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fac040d1ef0 msgr2=0x7fac04186c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:13.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.083+0000 7fac09800640 1 --2- 172.21.15.99:0/3813039080 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fac040d1ef0 0x7fac04186c10 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fabfc009d90 tx=0x7fabfc02bf50 comp rx=0 tx=0).stop 2024-02-21T23:13:13.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.083+0000 7fac09800640 1 -- 172.21.15.99:0/3813039080 shutdown_connections 2024-02-21T23:13:13.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.083+0000 7fac09800640 1 --2- 172.21.15.99:0/3813039080 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fac040d1ef0 0x7fac04186c10 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:13.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.083+0000 7fac09800640 1 -- 172.21.15.99:0/3813039080 >> 172.21.15.99:0/3813039080 conn(0x7fac040ce3c0 msgr2=0x7fac040ce7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:13.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.084+0000 7fac09800640 1 -- 172.21.15.99:0/3813039080 shutdown_connections 2024-02-21T23:13:13.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.084+0000 7fac09800640 1 -- 172.21.15.99:0/3813039080 wait complete. 2024-02-21T23:13:13.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.087+0000 7fac09800640 1 Processor -- start 2024-02-21T23:13:13.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.087+0000 7fac09800640 1 -- start start 2024-02-21T23:13:13.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.089+0000 7fac09800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fac040d1a70 0x7fac041669d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:13.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.089+0000 7fac09800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fac040d1ef0 0x7fac0421f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:13.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.089+0000 7fac09800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac04186830 0x7fac04220ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:13.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.089+0000 7fac09800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac040f4870 con 0x7fac040d1a70 2024-02-21T23:13:13.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.089+0000 7fac09800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac040f59e0 con 0x7fac04186830 2024-02-21T23:13:13.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.089+0000 7fac09800640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac04180b50 con 0x7fac040d1ef0 2024-02-21T23:13:13.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.089+0000 7fac03e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fac040d1a70 0x7fac041669d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:13.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.089+0000 7fac03e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fac040d1a70 0x7fac041669d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56204/0 (socket says 172.21.15.99:56204) 2024-02-21T23:13:13.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.089+0000 7fac03e00640 1 -- 172.21.15.99:0/15415855 learned_addr learned my addr 172.21.15.99:0/15415855 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:13:13.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.089+0000 7fac03400640 1 --2- 172.21.15.99:0/15415855 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fac040d1ef0 0x7fac0421f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:13.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.090+0000 7fac08e00640 1 --2- 172.21.15.99:0/15415855 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac04186830 0x7fac04220ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:13.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.090+0000 7fac03e00640 1 -- 172.21.15.99:0/15415855 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fac040d1ef0 msgr2=0x7fac0421f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:13.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.090+0000 7fac03e00640 1 --2- 172.21.15.99:0/15415855 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fac040d1ef0 0x7fac0421f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:13.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.090+0000 7fac03e00640 1 -- 172.21.15.99:0/15415855 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac04186830 msgr2=0x7fac04220ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:13.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.090+0000 7fac03e00640 1 --2- 172.21.15.99:0/15415855 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac04186830 0x7fac04220ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:13.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.090+0000 7fac03e00640 1 -- 172.21.15.99:0/15415855 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac040c9eb0 con 0x7fac040d1a70 2024-02-21T23:13:13.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.090+0000 7fac03e00640 1 --2- 172.21.15.99:0/15415855 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fac040d1a70 0x7fac041669d0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fabf400c4d0 tx=0x7fabf400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:13.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.091+0000 7fabfbe00640 1 -- 172.21.15.99:0/15415855 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf4018070 con 0x7fac040d1a70 2024-02-21T23:13:13.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.091+0000 7fabfbe00640 1 -- 172.21.15.99:0/15415855 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabf40075a0 con 0x7fac040d1a70 2024-02-21T23:13:13.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.091+0000 7fac09800640 1 -- 172.21.15.99:0/15415855 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac04220130 con 0x7fac040d1a70 2024-02-21T23:13:13.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.091+0000 7fabfbe00640 1 -- 172.21.15.99:0/15415855 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf40049e0 con 0x7fac040d1a70 2024-02-21T23:13:13.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.091+0000 7fac09800640 1 -- 172.21.15.99:0/15415855 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac042206f0 con 0x7fac040d1a70 2024-02-21T23:13:13.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.092+0000 7fac09800640 1 -- 172.21.15.99:0/15415855 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac04068320 con 0x7fac040d1a70 2024-02-21T23:13:13.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.094+0000 7fabfbe00640 1 -- 172.21.15.99:0/15415855 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7fabf401b070 con 0x7fac040d1a70 2024-02-21T23:13:13.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.096+0000 7fabfbe00640 1 --2- 172.21.15.99:0/15415855 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fabe409eed0 0x7fabe40a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:13.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.097+0000 7fabfbe00640 1 -- 172.21.15.99:0/15415855 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 8877+0+0 (secure 0 0 0) 0x7fabf40c9430 con 0x7fac040d1a70 2024-02-21T23:13:13.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.097+0000 7fac03400640 1 --2- 172.21.15.99:0/15415855 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fabe409eed0 0x7fabe40a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:13.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.097+0000 7fac03400640 1 --2- 172.21.15.99:0/15415855 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fabe409eed0 0x7fabe40a1390 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fac0421c960 tx=0x7fabf0007d30 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:13.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.098+0000 7fabfbe00640 1 -- 172.21.15.99:0/15415855 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fabf4022080 con 0x7fac040d1a70 2024-02-21T23:13:13.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.338+0000 7fac09800640 1 -- 172.21.15.99:0/15415855 --> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fac040d1850 con 0x7fabe409eed0 2024-02-21T23:13:13.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.339+0000 7fabfbe00640 1 -- 172.21.15.99:0/15415855 <== mgr.5131 v2:172.21.15.162:6800/631076050 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fac040d1850 con 0x7fabe409eed0 2024-02-21T23:13:13.327 INFO:teuthology.orchestra.run.smithi099.stderr:instructed osd(s) 5 to deep-scrub 2024-02-21T23:13:13.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.342+0000 7fac09800640 1 -- 172.21.15.99:0/15415855 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fabe409eed0 msgr2=0x7fabe40a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:13.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.342+0000 7fac09800640 1 --2- 172.21.15.99:0/15415855 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fabe409eed0 0x7fabe40a1390 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fac0421c960 tx=0x7fabf0007d30 comp rx=0 tx=0).stop 2024-02-21T23:13:13.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.342+0000 7fac09800640 1 -- 172.21.15.99:0/15415855 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fac040d1a70 msgr2=0x7fac041669d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:13.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.342+0000 7fac09800640 1 --2- 172.21.15.99:0/15415855 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fac040d1a70 0x7fac041669d0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fabf400c4d0 tx=0x7fabf400c990 comp rx=0 tx=0).stop 2024-02-21T23:13:13.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.342+0000 7fac09800640 1 -- 172.21.15.99:0/15415855 shutdown_connections 2024-02-21T23:13:13.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.342+0000 7fac09800640 1 --2- 172.21.15.99:0/15415855 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fabe409eed0 0x7fabe40a1390 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:13.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.342+0000 7fac09800640 1 --2- 172.21.15.99:0/15415855 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac04186830 0x7fac04220ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:13.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.342+0000 7fac09800640 1 --2- 172.21.15.99:0/15415855 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fac040d1ef0 0x7fac0421f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:13.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.342+0000 7fac09800640 1 --2- 172.21.15.99:0/15415855 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fac040d1a70 0x7fac041669d0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:13.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.342+0000 7fac09800640 1 -- 172.21.15.99:0/15415855 >> 172.21.15.99:0/15415855 conn(0x7fac040ce3c0 msgr2=0x7fac040f06c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:13.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.342+0000 7fac09800640 1 -- 172.21.15.99:0/15415855 shutdown_connections 2024-02-21T23:13:13.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.342+0000 7fac09800640 1 -- 172.21.15.99:0/15415855 wait complete. 2024-02-21T23:13:13.355 INFO:tasks.ceph:Scrubbing osd.8 2024-02-21T23:13:13.355 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.8 config set osd_debug_deep_scrub_sleep 0 2024-02-21T23:13:13.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.599+0000 7f954f200640 1 Processor -- start 2024-02-21T23:13:13.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.599+0000 7f954f200640 1 -- start start 2024-02-21T23:13:13.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.601+0000 7f954f200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f955017f710 0x7f9550189f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:13.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.601+0000 7f954f200640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f955018b920 0x7f955015e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:13.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.601+0000 7f954f200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f955018a5a0 con 0x7f9550071c20 2024-02-21T23:13:13.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.601+0000 7f954f200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f955018bda0 con 0x7f955017f710 2024-02-21T23:13:13.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.601+0000 7f954f200640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f955018a880 con 0x7f955018b920 2024-02-21T23:13:13.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.602+0000 7f954e800640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f9550071c20 0x7f9550188a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:58300/0 (socket says 172.21.15.99:58300) 2024-02-21T23:13:13.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.602+0000 7f954e800640 1 -- 172.21.15.99:0/1624361435 learned_addr learned my addr 172.21.15.99:0/1624361435 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:13:13.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.602+0000 7f954de00640 1 --2- 172.21.15.99:0/1624361435 >> v2:172.21.15.162:3300/0 conn(0x7f955017f710 0x7f9550189f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:13.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.602+0000 7f954d400640 1 --2- 172.21.15.99:0/1624361435 >> v2:172.21.15.181:3300/0 conn(0x7f955018b920 0x7f955015e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:13.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.602+0000 7f954de00640 1 -- 172.21.15.99:0/1624361435 >> v2:172.21.15.181:3300/0 conn(0x7f955018b920 msgr2=0x7f955015e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:13:13.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.602+0000 7f954de00640 1 --2- 172.21.15.99:0/1624361435 >> v2:172.21.15.181:3300/0 conn(0x7f955018b920 0x7f955015e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:13.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.602+0000 7f954de00640 1 -- 172.21.15.99:0/1624361435 >> v1:172.21.15.99:6789/0 conn(0x7f9550071c20 legacy=0x7f9550188a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:13.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.602+0000 7f954de00640 1 -- 172.21.15.99:0/1624361435 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f955018ab60 con 0x7f955017f710 2024-02-21T23:13:13.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.602+0000 7f954ca00640 1 -- 172.21.15.99:0/1624361435 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1124124413 0 0) 0x7f955018a5a0 con 0x7f9550071c20 2024-02-21T23:13:13.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.602+0000 7f954d400640 1 --2- 172.21.15.99:0/1624361435 >> v2:172.21.15.181:3300/0 conn(0x7f955018b920 0x7f955015e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:13:13.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.604+0000 7f954de00640 1 --2- 172.21.15.99:0/1624361435 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f955017f710 0x7f9550189f40 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f95500d0390 tx=0x7f954002b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de5de2eb52458f28 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:13.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.604+0000 7f954ca00640 1 -- 172.21.15.99:0/1624361435 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9540035020 con 0x7f955017f710 2024-02-21T23:13:13.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.604+0000 7f954ca00640 1 -- 172.21.15.99:0/1624361435 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9540031830 con 0x7f955017f710 2024-02-21T23:13:13.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.604+0000 7f954ca00640 1 -- 172.21.15.99:0/1624361435 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9540031c00 con 0x7f955017f710 2024-02-21T23:13:13.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.605+0000 7f954f200640 1 -- 172.21.15.99:0/1624361435 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f955017f710 msgr2=0x7f9550189f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:13.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.605+0000 7f954f200640 1 --2- 172.21.15.99:0/1624361435 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f955017f710 0x7f9550189f40 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f95500d0390 tx=0x7f954002b8d0 comp rx=0 tx=0).stop 2024-02-21T23:13:13.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.605+0000 7f954f200640 1 -- 172.21.15.99:0/1624361435 shutdown_connections 2024-02-21T23:13:13.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.605+0000 7f954f200640 1 --2- 172.21.15.99:0/1624361435 >> v2:172.21.15.181:3300/0 conn(0x7f955018b920 0x7f955015e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:13.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.605+0000 7f954f200640 1 --2- 172.21.15.99:0/1624361435 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f955017f710 0x7f9550189f40 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:13.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.605+0000 7f954f200640 1 -- 172.21.15.99:0/1624361435 >> 172.21.15.99:0/1624361435 conn(0x7f95500fe310 msgr2=0x7f95500fe720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:13.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.605+0000 7f954f200640 1 -- 172.21.15.99:0/1624361435 shutdown_connections 2024-02-21T23:13:13.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.605+0000 7f954f200640 1 -- 172.21.15.99:0/1624361435 wait complete. 2024-02-21T23:13:13.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.608+0000 7f954f200640 1 Processor -- start 2024-02-21T23:13:13.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.609+0000 7f954f200640 1 -- start start 2024-02-21T23:13:13.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.611+0000 7f954f200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9550071c20 0x7f9550178570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:13.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.611+0000 7f954f200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f955017f710 0x7f95500f9650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:13.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.611+0000 7f954f200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f955018b920 0x7f95500f53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:13.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.611+0000 7f954f200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f955015e9d0 con 0x7f955017f710 2024-02-21T23:13:13.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.611+0000 7f954f200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f955018b120 con 0x7f955018b920 2024-02-21T23:13:13.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.611+0000 7f954f200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f955015eb50 con 0x7f9550071c20 2024-02-21T23:13:13.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.611+0000 7f954d400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f955017f710 0x7f95500f9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:13.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.611+0000 7f954d400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f955017f710 0x7f95500f9650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56216/0 (socket says 172.21.15.99:56216) 2024-02-21T23:13:13.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.611+0000 7f954d400640 1 -- 172.21.15.99:0/1880953041 learned_addr learned my addr 172.21.15.99:0/1880953041 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:13:13.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.611+0000 7f954e800640 1 --2- 172.21.15.99:0/1880953041 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f955018b920 0x7f95500f53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:13.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.611+0000 7f954de00640 1 --2- 172.21.15.99:0/1880953041 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9550071c20 0x7f9550178570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:13.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.612+0000 7f954d400640 1 -- 172.21.15.99:0/1880953041 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9550071c20 msgr2=0x7f9550178570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:13.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.612+0000 7f954d400640 1 --2- 172.21.15.99:0/1880953041 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9550071c20 0x7f9550178570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:13.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.612+0000 7f954d400640 1 -- 172.21.15.99:0/1880953041 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f955018b920 msgr2=0x7f95500f53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:13.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.612+0000 7f954d400640 1 --2- 172.21.15.99:0/1880953041 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f955018b920 0x7f95500f53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:13.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.612+0000 7f954d400640 1 -- 172.21.15.99:0/1880953041 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95500f6000 con 0x7f955017f710 2024-02-21T23:13:13.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.612+0000 7f954de00640 1 --2- 172.21.15.99:0/1880953041 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f9550071c20 0x7f9550178570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:13:13.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.612+0000 7f954e800640 1 --2- 172.21.15.99:0/1880953041 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f955018b920 0x7f95500f53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:13:13.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.612+0000 7f954d400640 1 --2- 172.21.15.99:0/1880953041 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f955017f710 0x7f95500f9650 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f953c00e990 tx=0x7f953c00ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:13.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.612+0000 7f9546000640 1 -- 172.21.15.99:0/1880953041 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f953c017070 con 0x7f955017f710 2024-02-21T23:13:13.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.612+0000 7f9546000640 1 -- 172.21.15.99:0/1880953041 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f953c00c9e0 con 0x7f955017f710 2024-02-21T23:13:13.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.612+0000 7f9546000640 1 -- 172.21.15.99:0/1880953041 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f953c00cdb0 con 0x7f955017f710 2024-02-21T23:13:13.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.612+0000 7f954f200640 1 -- 172.21.15.99:0/1880953041 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95500f62e0 con 0x7f955017f710 2024-02-21T23:13:13.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.613+0000 7f954f200640 1 -- 172.21.15.99:0/1880953041 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95500f68a0 con 0x7f955017f710 2024-02-21T23:13:13.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.613+0000 7f954f200640 1 -- 172.21.15.99:0/1880953041 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f95500682b0 con 0x7f955017f710 2024-02-21T23:13:13.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.617+0000 7f9546000640 1 -- 172.21.15.99:0/1880953041 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f953c01a070 con 0x7f955017f710 2024-02-21T23:13:13.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.619+0000 7f9546000640 1 --2- 172.21.15.99:0/1880953041 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f953009eed0 0x7f95300a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:13.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.619+0000 7f9546000640 1 -- 172.21.15.99:0/1880953041 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f953c0ca5a0 con 0x7f955017f710 2024-02-21T23:13:13.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.619+0000 7f9546000640 1 --2- 172.21.15.99:0/1880953041 >> [v2:172.21.15.181:6802/3389807042,v1:172.21.15.181:6804/3389807042] conn(0x7f95300a9de0 0x7f95300ac260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:13.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.619+0000 7f9546000640 1 -- 172.21.15.99:0/1880953041 --> [v2:172.21.15.181:6802/3389807042,v1:172.21.15.181:6804/3389807042] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f953c001d30 con 0x7f95300a9de0 2024-02-21T23:13:13.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.619+0000 7f954de00640 1 --2- 172.21.15.99:0/1880953041 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f953009eed0 0x7f95300a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:13.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.619+0000 7f9546000640 1 -- 172.21.15.99:0/1880953041 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f953c0ca950 con 0x7f955017f710 2024-02-21T23:13:13.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.620+0000 7f954e800640 1 --2- 172.21.15.99:0/1880953041 >> [v2:172.21.15.181:6802/3389807042,v1:172.21.15.181:6804/3389807042] conn(0x7f95300a9de0 0x7f95300ac260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:13.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.620+0000 7f954de00640 1 --2- 172.21.15.99:0/1880953041 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f953009eed0 0x7f95300a1390 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9540036000 tx=0x7f954003c040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:13.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.620+0000 7f954e800640 1 --2- 172.21.15.99:0/1880953041 >> [v2:172.21.15.181:6802/3389807042,v1:172.21.15.181:6804/3389807042] conn(0x7f95300a9de0 0x7f95300ac260 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:13.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.621+0000 7f9546000640 1 -- 172.21.15.99:0/1880953041 <== osd.8 v2:172.21.15.181:6802/3389807042 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f953c001d30 con 0x7f95300a9de0 2024-02-21T23:13:13.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.650+0000 7f954f200640 1 -- 172.21.15.99:0/1880953041 --> [v2:172.21.15.181:6802/3389807042,v1:172.21.15.181:6804/3389807042] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f95501865e0 con 0x7f95300a9de0 2024-02-21T23:13:13.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.650+0000 7f9546000640 1 -- 172.21.15.99:0/1880953041 <== osd.8 v2:172.21.15.181:6802/3389807042 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f95501865e0 con 0x7f95300a9de0 2024-02-21T23:13:13.638 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-02-21T23:13:13.638 INFO:teuthology.orchestra.run.smithi099.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-21T23:13:13.638 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-02-21T23:13:13.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.651+0000 7f954f200640 1 -- 172.21.15.99:0/1880953041 >> [v2:172.21.15.181:6802/3389807042,v1:172.21.15.181:6804/3389807042] conn(0x7f95300a9de0 msgr2=0x7f95300ac260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:13.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.651+0000 7f954f200640 1 --2- 172.21.15.99:0/1880953041 >> [v2:172.21.15.181:6802/3389807042,v1:172.21.15.181:6804/3389807042] conn(0x7f95300a9de0 0x7f95300ac260 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:13.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.651+0000 7f954f200640 1 -- 172.21.15.99:0/1880953041 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f953009eed0 msgr2=0x7f95300a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:13.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.651+0000 7f954f200640 1 --2- 172.21.15.99:0/1880953041 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f953009eed0 0x7f95300a1390 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9540036000 tx=0x7f954003c040 comp rx=0 tx=0).stop 2024-02-21T23:13:13.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.651+0000 7f954f200640 1 -- 172.21.15.99:0/1880953041 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f955017f710 msgr2=0x7f95500f9650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:13.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.651+0000 7f954f200640 1 --2- 172.21.15.99:0/1880953041 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f955017f710 0x7f95500f9650 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f953c00e990 tx=0x7f953c00ee50 comp rx=0 tx=0).stop 2024-02-21T23:13:13.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.651+0000 7f954e800640 1 -- 172.21.15.99:0/1880953041 reap_dead start 2024-02-21T23:13:13.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.651+0000 7f954f200640 1 -- 172.21.15.99:0/1880953041 shutdown_connections 2024-02-21T23:13:13.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.651+0000 7f954f200640 1 -- 172.21.15.99:0/1880953041 >> 172.21.15.99:0/1880953041 conn(0x7f95500fe310 msgr2=0x7f955018c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:13.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.651+0000 7f954f200640 1 -- 172.21.15.99:0/1880953041 shutdown_connections 2024-02-21T23:13:13.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.651+0000 7f954f200640 1 -- 172.21.15.99:0/1880953041 wait complete. 2024-02-21T23:13:13.658 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 8 2024-02-21T23:13:13.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.877+0000 7f747c200640 1 Processor -- start 2024-02-21T23:13:13.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.877+0000 7f747c200640 1 -- start start 2024-02-21T23:13:13.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.879+0000 7f747c200640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f747417d980 con 0x7f7474186b90 2024-02-21T23:13:13.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.879+0000 7f747c200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7474185950 con 0x7f7474187680 2024-02-21T23:13:13.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.879+0000 7f747c200640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7474185c30 con 0x7f747418ab00 2024-02-21T23:13:13.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.879+0000 7f7479800640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f7474186b90 0x7f7474186f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:58314/0 (socket says 172.21.15.99:58314) 2024-02-21T23:13:13.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.879+0000 7f7479800640 1 -- 172.21.15.99:0/4125218970 learned_addr learned my addr 172.21.15.99:0/4125218970 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:13:13.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.880+0000 7f7473e00640 1 -- 172.21.15.99:0/4125218970 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1334679765 0 0) 0x7f7474185c30 con 0x7f747418ab00 2024-02-21T23:13:13.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.880+0000 7f7473e00640 1 -- 172.21.15.99:0/4125218970 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f745c003520 con 0x7f747418ab00 2024-02-21T23:13:13.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.880+0000 7f7473e00640 1 -- 172.21.15.99:0/4125218970 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1671009273 0 0) 0x7f7474185950 con 0x7f7474187680 2024-02-21T23:13:13.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.880+0000 7f7473e00640 1 -- 172.21.15.99:0/4125218970 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7474185c30 con 0x7f7474187680 2024-02-21T23:13:13.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.880+0000 7f7473e00640 1 -- 172.21.15.99:0/4125218970 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3361348631 0 0) 0x7f747417d980 con 0x7f7474186b90 2024-02-21T23:13:13.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.880+0000 7f7473e00640 1 -- 172.21.15.99:0/4125218970 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7474185950 con 0x7f7474186b90 2024-02-21T23:13:13.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.880+0000 7f7473e00640 1 -- 172.21.15.99:0/4125218970 <== mon.2 v1:172.21.15.181:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4274561383 0 0) 0x7f745c003520 con 0x7f747418ab00 2024-02-21T23:13:13.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.880+0000 7f7473e00640 1 -- 172.21.15.99:0/4125218970 >> v1:172.21.15.162:6789/0 conn(0x7f7474187680 legacy=0x7f747418a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:13.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.880+0000 7f7473e00640 1 -- 172.21.15.99:0/4125218970 >> v1:172.21.15.99:6789/0 conn(0x7f7474186b90 legacy=0x7f7474186f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:13.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.880+0000 7f7473e00640 1 -- 172.21.15.99:0/4125218970 --> v1:172.21.15.181:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7474185f10 con 0x7f747418ab00 2024-02-21T23:13:13.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.880+0000 7f7473e00640 1 -- 172.21.15.99:0/4125218970 <== mon.2 v1:172.21.15.181:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2069890144 0 0) 0x7f746c001920 con 0x7f747418ab00 2024-02-21T23:13:13.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.880+0000 7f7473e00640 1 -- 172.21.15.99:0/4125218970 >> v1:172.21.15.181:6789/0 conn(0x7f747418ab00 legacy=0x7f7474184a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:13.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.880+0000 7f7473e00640 1 --2- 172.21.15.99:0/4125218970 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f745c004e70 0x7f745c005250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:13.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.880+0000 7f7473e00640 1 --2- 172.21.15.99:0/4125218970 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f745c003860 0x7f745c003ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:13.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.880+0000 7f7473e00640 1 --2- 172.21.15.99:0/4125218970 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f745c004350 0x7f745c00ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:13.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.880+0000 7f7473e00640 1 -- 172.21.15.99:0/4125218970 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f745c00c2d0 con 0x7f745c004e70 2024-02-21T23:13:13.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.880+0000 7f7473e00640 1 -- 172.21.15.99:0/4125218970 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f745c00c480 con 0x7f745c004350 2024-02-21T23:13:13.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.880+0000 7f7473e00640 1 -- 172.21.15.99:0/4125218970 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f745c00c680 con 0x7f745c003860 2024-02-21T23:13:13.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.880+0000 7f7479800640 1 --2- 172.21.15.99:0/4125218970 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f745c004e70 0x7f745c005250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:13.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.881+0000 7f747a200640 1 --2- 172.21.15.99:0/4125218970 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f745c004350 0x7f745c00ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:13.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.881+0000 7f7478e00640 1 --2- 172.21.15.99:0/4125218970 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f745c003860 0x7f745c003ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:13.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.881+0000 7f7479800640 1 -- 172.21.15.99:0/4125218970 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f745c003860 msgr2=0x7f745c003ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:13:13.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.881+0000 7f7479800640 1 --2- 172.21.15.99:0/4125218970 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f745c003860 0x7f745c003ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:13.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.881+0000 7f7479800640 1 -- 172.21.15.99:0/4125218970 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f745c004350 msgr2=0x7f745c00ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:13:13.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.881+0000 7f7479800640 1 --2- 172.21.15.99:0/4125218970 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f745c004350 0x7f745c00ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:13.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.881+0000 7f7479800640 1 -- 172.21.15.99:0/4125218970 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f745c003520 con 0x7f745c004e70 2024-02-21T23:13:13.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.881+0000 7f747a200640 1 -- 172.21.15.99:0/4125218970 reap_dead start 2024-02-21T23:13:13.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.882+0000 7f7479800640 1 --2- 172.21.15.99:0/4125218970 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f745c004e70 0x7f745c005250 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f74680018d0 tx=0x7f745c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54d3f865fd635d18 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:13.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.882+0000 7f7473e00640 1 -- 172.21.15.99:0/4125218970 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7468001520 con 0x7f745c004e70 2024-02-21T23:13:13.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.882+0000 7f7473e00640 1 -- 172.21.15.99:0/4125218970 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7468004aa0 con 0x7f745c004e70 2024-02-21T23:13:13.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.882+0000 7f7473e00640 1 -- 172.21.15.99:0/4125218970 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7468007070 con 0x7f745c004e70 2024-02-21T23:13:13.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.883+0000 7f747c200640 1 -- 172.21.15.99:0/4125218970 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f745c004e70 msgr2=0x7f745c005250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:13.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.883+0000 7f747c200640 1 --2- 172.21.15.99:0/4125218970 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f745c004e70 0x7f745c005250 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f74680018d0 tx=0x7f745c005830 comp rx=0 tx=0).stop 2024-02-21T23:13:13.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.883+0000 7f747c200640 1 -- 172.21.15.99:0/4125218970 shutdown_connections 2024-02-21T23:13:13.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.883+0000 7f747c200640 1 --2- 172.21.15.99:0/4125218970 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f745c004e70 0x7f745c005250 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:13.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.883+0000 7f747c200640 1 -- 172.21.15.99:0/4125218970 >> 172.21.15.99:0/4125218970 conn(0x7f74740ce5f0 msgr2=0x7f74740cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:13.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.883+0000 7f747c200640 1 -- 172.21.15.99:0/4125218970 shutdown_connections 2024-02-21T23:13:13.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.883+0000 7f747c200640 1 -- 172.21.15.99:0/4125218970 wait complete. 2024-02-21T23:13:13.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.885+0000 7f747c200640 1 Processor -- start 2024-02-21T23:13:13.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.886+0000 7f747c200640 1 -- start start 2024-02-21T23:13:13.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.887+0000 7f747c200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f745c004e70 0x7f7474170230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:13.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.887+0000 7f747c200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f747417afc0 0x7f747417ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:13.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.887+0000 7f747c200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f747417b440 0x7f747417ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:13.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.887+0000 7f747c200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74741867b0 con 0x7f745c004e70 2024-02-21T23:13:13.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.887+0000 7f747c200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74741864d0 con 0x7f747417afc0 2024-02-21T23:13:13.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.887+0000 7f747c200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f747418af10 con 0x7f747417b440 2024-02-21T23:13:13.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.887+0000 7f7479800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f745c004e70 0x7f7474170230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:13.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.887+0000 7f7479800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f745c004e70 0x7f7474170230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56240/0 (socket says 172.21.15.99:56240) 2024-02-21T23:13:13.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.887+0000 7f7479800640 1 -- 172.21.15.99:0/3045735639 learned_addr learned my addr 172.21.15.99:0/3045735639 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:13:13.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.887+0000 7f7478e00640 1 --2- 172.21.15.99:0/3045735639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f747417afc0 0x7f747417ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:13.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.887+0000 7f747a200640 1 --2- 172.21.15.99:0/3045735639 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f747417b440 0x7f747417ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:13.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.888+0000 7f7478e00640 1 -- 172.21.15.99:0/3045735639 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f747417b440 msgr2=0x7f747417ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:13.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.888+0000 7f7478e00640 1 --2- 172.21.15.99:0/3045735639 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f747417b440 0x7f747417ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:13.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.888+0000 7f7478e00640 1 -- 172.21.15.99:0/3045735639 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f745c004e70 msgr2=0x7f7474170230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:13.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.888+0000 7f7478e00640 1 --2- 172.21.15.99:0/3045735639 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f745c004e70 0x7f7474170230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:13.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.888+0000 7f7478e00640 1 -- 172.21.15.99:0/3045735639 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f747417c230 con 0x7f747417afc0 2024-02-21T23:13:13.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.888+0000 7f7479800640 1 --2- 172.21.15.99:0/3045735639 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f745c004e70 0x7f7474170230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:13:13.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.888+0000 7f7478e00640 1 --2- 172.21.15.99:0/3045735639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f747417afc0 0x7f747417ea50 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f746000f610 tx=0x7f746000fad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:13.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.888+0000 7f7471600640 1 -- 172.21.15.99:0/3045735639 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f746001a070 con 0x7f747417afc0 2024-02-21T23:13:13.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.888+0000 7f7471600640 1 -- 172.21.15.99:0/3045735639 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7460005320 con 0x7f747417afc0 2024-02-21T23:13:13.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.888+0000 7f7471600640 1 -- 172.21.15.99:0/3045735639 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7460007270 con 0x7f747417afc0 2024-02-21T23:13:13.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.888+0000 7f747c200640 1 -- 172.21.15.99:0/3045735639 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f747417b990 con 0x7f747417afc0 2024-02-21T23:13:13.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.888+0000 7f747c200640 1 -- 172.21.15.99:0/3045735639 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f747417bf50 con 0x7f747417afc0 2024-02-21T23:13:13.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.890+0000 7f747c200640 1 -- 172.21.15.99:0/3045735639 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74740ca4c0 con 0x7f747417afc0 2024-02-21T23:13:13.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.892+0000 7f7471600640 1 -- 172.21.15.99:0/3045735639 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f7460007410 con 0x7f747417afc0 2024-02-21T23:13:13.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.893+0000 7f7471600640 1 --2- 172.21.15.99:0/3045735639 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f745409eed0 0x7f74540a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:13.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.893+0000 7f7471600640 1 -- 172.21.15.99:0/3045735639 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f74600c9660 con 0x7f747417afc0 2024-02-21T23:13:13.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.893+0000 7f7479800640 1 --2- 172.21.15.99:0/3045735639 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f745409eed0 0x7f74540a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:13.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.894+0000 7f7479800640 1 --2- 172.21.15.99:0/3045735639 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f745409eed0 0x7f74540a1390 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7468000f60 tx=0x7f746802f000 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:13.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:13.897+0000 7f7471600640 1 -- 172.21.15.99:0/3045735639 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f74740ca4c0 con 0x7f747417afc0 2024-02-21T23:13:14.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.251+0000 7f747c200640 1 -- 172.21.15.99:0/3045735639 --> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "8", "target": ["mon-mgr", ""]}) v1 -- 0x7f74740ce9d0 con 0x7f745409eed0 2024-02-21T23:13:14.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.252+0000 7f7471600640 1 -- 172.21.15.99:0/3045735639 <== mgr.5131 v2:172.21.15.162:6800/631076050 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 8 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f74740ce9d0 con 0x7f745409eed0 2024-02-21T23:13:14.240 INFO:teuthology.orchestra.run.smithi099.stderr:instructed osd(s) 8 to deep-scrub 2024-02-21T23:13:14.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.254+0000 7f747c200640 1 -- 172.21.15.99:0/3045735639 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f745409eed0 msgr2=0x7f74540a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:14.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.254+0000 7f747c200640 1 --2- 172.21.15.99:0/3045735639 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f745409eed0 0x7f74540a1390 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7468000f60 tx=0x7f746802f000 comp rx=0 tx=0).stop 2024-02-21T23:13:14.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.254+0000 7f747c200640 1 -- 172.21.15.99:0/3045735639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f747417afc0 msgr2=0x7f747417ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:14.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.254+0000 7f747c200640 1 --2- 172.21.15.99:0/3045735639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f747417afc0 0x7f747417ea50 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f746000f610 tx=0x7f746000fad0 comp rx=0 tx=0).stop 2024-02-21T23:13:14.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.254+0000 7f747c200640 1 -- 172.21.15.99:0/3045735639 shutdown_connections 2024-02-21T23:13:14.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.254+0000 7f747c200640 1 --2- 172.21.15.99:0/3045735639 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f745409eed0 0x7f74540a1390 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:14.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.254+0000 7f747c200640 1 --2- 172.21.15.99:0/3045735639 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f747417b440 0x7f747417ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:14.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.254+0000 7f747c200640 1 --2- 172.21.15.99:0/3045735639 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f747417afc0 0x7f747417ea50 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:14.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.254+0000 7f747c200640 1 --2- 172.21.15.99:0/3045735639 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f745c004e70 0x7f7474170230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:14.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.254+0000 7f747c200640 1 -- 172.21.15.99:0/3045735639 >> 172.21.15.99:0/3045735639 conn(0x7f74740ce5f0 msgr2=0x7f7474186f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:14.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.254+0000 7f747c200640 1 -- 172.21.15.99:0/3045735639 shutdown_connections 2024-02-21T23:13:14.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.254+0000 7f747c200640 1 -- 172.21.15.99:0/3045735639 wait complete. 2024-02-21T23:13:14.261 INFO:tasks.ceph:Scrubbing osd.11 2024-02-21T23:13:14.261 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.11 config set osd_debug_deep_scrub_sleep 0 2024-02-21T23:13:14.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.506+0000 7f1e25c00640 1 Processor -- start 2024-02-21T23:13:14.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.506+0000 7f1e25c00640 1 -- start start 2024-02-21T23:13:14.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.509+0000 7f1e25c00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f1e200740b0 0x7f1e200f5a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:14.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.509+0000 7f1e25c00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f1e20074ba0 0x7f1e20187d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:14.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.509+0000 7f1e25c00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e200f60f0 con 0x7f1e2006d3c0 2024-02-21T23:13:14.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.509+0000 7f1e25c00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e20187850 con 0x7f1e200740b0 2024-02-21T23:13:14.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.509+0000 7f1e25c00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e200f6fe0 con 0x7f1e20074ba0 2024-02-21T23:13:14.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.509+0000 7f1e1fe00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f1e200740b0 0x7f1e200f5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:14.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.509+0000 7f1e1fe00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f1e200740b0 0x7f1e200f5a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56248/0 (socket says 172.21.15.99:56248) 2024-02-21T23:13:14.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.509+0000 7f1e1fe00640 1 -- 172.21.15.99:0/3882115483 learned_addr learned my addr 172.21.15.99:0/3882115483 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:13:14.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.509+0000 7f1e1f400640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f1e2006d3c0 0x7f1e20074490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.99:45456/0 (socket says 172.21.15.99:45456) 2024-02-21T23:13:14.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.509+0000 7f1e25200640 1 --2- 172.21.15.99:0/3882115483 >> v2:172.21.15.162:3300/0 conn(0x7f1e20074ba0 0x7f1e20187d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:14.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.510+0000 7f1e1fe00640 1 -- 172.21.15.99:0/3882115483 >> v2:172.21.15.162:3300/0 conn(0x7f1e20074ba0 msgr2=0x7f1e20187d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:13:14.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.510+0000 7f1e1fe00640 1 --2- 172.21.15.99:0/3882115483 >> v2:172.21.15.162:3300/0 conn(0x7f1e20074ba0 0x7f1e20187d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:14.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.510+0000 7f1e1fe00640 1 -- 172.21.15.99:0/3882115483 >> v1:172.21.15.162:6789/0 conn(0x7f1e2006d3c0 legacy=0x7f1e20074490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:14.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.510+0000 7f1e1ea00640 1 -- 172.21.15.99:0/3882115483 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3156376041 0 0) 0x7f1e200f60f0 con 0x7f1e2006d3c0 2024-02-21T23:13:14.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.510+0000 7f1e1fe00640 1 -- 172.21.15.99:0/3882115483 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e200f63d0 con 0x7f1e200740b0 2024-02-21T23:13:14.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.512+0000 7f1e1fe00640 1 --2- 172.21.15.99:0/3882115483 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e200740b0 0x7f1e200f5a00 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f1e2008f8d0 tx=0x7f1e1002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37f64470b236585e server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:14.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.512+0000 7f1e1ea00640 1 -- 172.21.15.99:0/3882115483 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e10035020 con 0x7f1e200740b0 2024-02-21T23:13:14.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.512+0000 7f1e1ea00640 1 -- 172.21.15.99:0/3882115483 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e10031870 con 0x7f1e200740b0 2024-02-21T23:13:14.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.512+0000 7f1e1ea00640 1 -- 172.21.15.99:0/3882115483 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e10031c40 con 0x7f1e200740b0 2024-02-21T23:13:14.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.512+0000 7f1e25c00640 1 -- 172.21.15.99:0/3882115483 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e200740b0 msgr2=0x7f1e200f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:14.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.512+0000 7f1e25c00640 1 --2- 172.21.15.99:0/3882115483 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e200740b0 0x7f1e200f5a00 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f1e2008f8d0 tx=0x7f1e1002b910 comp rx=0 tx=0).stop 2024-02-21T23:13:14.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.513+0000 7f1e25c00640 1 -- 172.21.15.99:0/3882115483 shutdown_connections 2024-02-21T23:13:14.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.513+0000 7f1e25c00640 1 --2- 172.21.15.99:0/3882115483 >> v2:172.21.15.162:3300/0 conn(0x7f1e20074ba0 0x7f1e20187d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:14.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.513+0000 7f1e25c00640 1 --2- 172.21.15.99:0/3882115483 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e200740b0 0x7f1e200f5a00 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:14.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.513+0000 7f1e25c00640 1 -- 172.21.15.99:0/3882115483 >> 172.21.15.99:0/3882115483 conn(0x7f1e2008cfd0 msgr2=0x7f1e2008d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:14.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.513+0000 7f1e25c00640 1 -- 172.21.15.99:0/3882115483 shutdown_connections 2024-02-21T23:13:14.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.513+0000 7f1e25c00640 1 -- 172.21.15.99:0/3882115483 wait complete. 2024-02-21T23:13:14.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.516+0000 7f1e25c00640 1 Processor -- start 2024-02-21T23:13:14.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.516+0000 7f1e25c00640 1 -- start start 2024-02-21T23:13:14.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.518+0000 7f1e25c00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e2006d3c0 0x7f1e2015ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:14.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.518+0000 7f1e25c00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1e200740b0 0x7f1e20210e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:14.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.518+0000 7f1e25c00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e20074ba0 0x7f1e20211390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:14.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.518+0000 7f1e25c00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e200f6c70 con 0x7f1e2006d3c0 2024-02-21T23:13:14.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.518+0000 7f1e25c00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e200f6990 con 0x7f1e20074ba0 2024-02-21T23:13:14.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.518+0000 7f1e25c00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2017d5d0 con 0x7f1e200740b0 2024-02-21T23:13:14.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.519+0000 7f1e1fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e2006d3c0 0x7f1e2015ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:14.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.519+0000 7f1e1fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e2006d3c0 0x7f1e2015ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:56262/0 (socket says 172.21.15.99:56262) 2024-02-21T23:13:14.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.519+0000 7f1e1fe00640 1 -- 172.21.15.99:0/2236185000 learned_addr learned my addr 172.21.15.99:0/2236185000 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:13:14.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.519+0000 7f1e25200640 1 --2- 172.21.15.99:0/2236185000 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e20074ba0 0x7f1e20211390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:14.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.519+0000 7f1e1f400640 1 --2- 172.21.15.99:0/2236185000 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1e200740b0 0x7f1e20210e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:14.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.519+0000 7f1e1fe00640 1 -- 172.21.15.99:0/2236185000 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1e200740b0 msgr2=0x7f1e20210e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:14.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.519+0000 7f1e1fe00640 1 --2- 172.21.15.99:0/2236185000 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f1e200740b0 0x7f1e20210e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:14.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.519+0000 7f1e1fe00640 1 -- 172.21.15.99:0/2236185000 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e20074ba0 msgr2=0x7f1e20211390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:14.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.519+0000 7f1e1fe00640 1 --2- 172.21.15.99:0/2236185000 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e20074ba0 0x7f1e20211390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:14.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.519+0000 7f1e1fe00640 1 -- 172.21.15.99:0/2236185000 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e202128d0 con 0x7f1e2006d3c0 2024-02-21T23:13:14.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.520+0000 7f1e1fe00640 1 --2- 172.21.15.99:0/2236185000 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e2006d3c0 0x7f1e2015ff90 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f1e1002b950 tx=0x7f1e100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:14.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.520+0000 7f1e17e00640 1 -- 172.21.15.99:0/2236185000 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e10040070 con 0x7f1e2006d3c0 2024-02-21T23:13:14.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.520+0000 7f1e17e00640 1 -- 172.21.15.99:0/2236185000 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e10030d00 con 0x7f1e2006d3c0 2024-02-21T23:13:14.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.520+0000 7f1e17e00640 1 -- 172.21.15.99:0/2236185000 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e10035040 con 0x7f1e2006d3c0 2024-02-21T23:13:14.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.520+0000 7f1e25c00640 1 -- 172.21.15.99:0/2236185000 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e20211a70 con 0x7f1e2006d3c0 2024-02-21T23:13:14.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.520+0000 7f1e25c00640 1 -- 172.21.15.99:0/2236185000 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e20212030 con 0x7f1e2006d3c0 2024-02-21T23:13:14.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.521+0000 7f1e25c00640 1 -- 172.21.15.99:0/2236185000 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1e200682b0 con 0x7f1e2006d3c0 2024-02-21T23:13:14.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.523+0000 7f1e17e00640 1 -- 172.21.15.99:0/2236185000 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f1e1004b060 con 0x7f1e2006d3c0 2024-02-21T23:13:14.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.525+0000 7f1e17e00640 1 --2- 172.21.15.99:0/2236185000 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f1e0009eed0 0x7f1e000a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:14.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.525+0000 7f1e17e00640 1 -- 172.21.15.99:0/2236185000 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f1e100ec100 con 0x7f1e2006d3c0 2024-02-21T23:13:14.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.525+0000 7f1e1f400640 1 --2- 172.21.15.99:0/2236185000 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f1e0009eed0 0x7f1e000a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:14.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.525+0000 7f1e17e00640 1 --2- 172.21.15.99:0/2236185000 >> [v2:172.21.15.181:6817/3219928272,v1:172.21.15.181:6819/3219928272] conn(0x7f1e000a9df0 0x7f1e000ac270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:14.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.525+0000 7f1e17e00640 1 -- 172.21.15.99:0/2236185000 --> [v2:172.21.15.181:6817/3219928272,v1:172.21.15.181:6819/3219928272] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1e1004fe80 con 0x7f1e000a9df0 2024-02-21T23:13:14.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.525+0000 7f1e17e00640 1 -- 172.21.15.99:0/2236185000 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1e100ec4b0 con 0x7f1e2006d3c0 2024-02-21T23:13:14.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.526+0000 7f1e25200640 1 --2- 172.21.15.99:0/2236185000 >> [v2:172.21.15.181:6817/3219928272,v1:172.21.15.181:6819/3219928272] conn(0x7f1e000a9df0 0x7f1e000ac270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:14.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.526+0000 7f1e1f400640 1 --2- 172.21.15.99:0/2236185000 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f1e0009eed0 0x7f1e000a1390 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1e201697c0 tx=0x7f1e0c007e40 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:14.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.526+0000 7f1e25200640 1 --2- 172.21.15.99:0/2236185000 >> [v2:172.21.15.181:6817/3219928272,v1:172.21.15.181:6819/3219928272] conn(0x7f1e000a9df0 0x7f1e000ac270 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:14.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.527+0000 7f1e17e00640 1 -- 172.21.15.99:0/2236185000 <== osd.11 v2:172.21.15.181:6817/3219928272 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f1e1004fe80 con 0x7f1e000a9df0 2024-02-21T23:13:14.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.556+0000 7f1e25c00640 1 -- 172.21.15.99:0/2236185000 --> [v2:172.21.15.181:6817/3219928272,v1:172.21.15.181:6819/3219928272] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f1e20070d40 con 0x7f1e000a9df0 2024-02-21T23:13:14.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.556+0000 7f1e17e00640 1 -- 172.21.15.99:0/2236185000 <== osd.11 v2:172.21.15.181:6817/3219928272 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f1e20070d40 con 0x7f1e000a9df0 2024-02-21T23:13:14.545 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-02-21T23:13:14.545 INFO:teuthology.orchestra.run.smithi099.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-02-21T23:13:14.545 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-02-21T23:13:14.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.557+0000 7f1e25c00640 1 -- 172.21.15.99:0/2236185000 >> [v2:172.21.15.181:6817/3219928272,v1:172.21.15.181:6819/3219928272] conn(0x7f1e000a9df0 msgr2=0x7f1e000ac270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:14.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.557+0000 7f1e25c00640 1 --2- 172.21.15.99:0/2236185000 >> [v2:172.21.15.181:6817/3219928272,v1:172.21.15.181:6819/3219928272] conn(0x7f1e000a9df0 0x7f1e000ac270 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:14.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.557+0000 7f1e25c00640 1 -- 172.21.15.99:0/2236185000 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f1e0009eed0 msgr2=0x7f1e000a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:14.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.557+0000 7f1e25c00640 1 --2- 172.21.15.99:0/2236185000 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f1e0009eed0 0x7f1e000a1390 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1e201697c0 tx=0x7f1e0c007e40 comp rx=0 tx=0).stop 2024-02-21T23:13:14.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.557+0000 7f1e25c00640 1 -- 172.21.15.99:0/2236185000 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e2006d3c0 msgr2=0x7f1e2015ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:14.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.557+0000 7f1e25c00640 1 --2- 172.21.15.99:0/2236185000 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f1e2006d3c0 0x7f1e2015ff90 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f1e1002b950 tx=0x7f1e100046c0 comp rx=0 tx=0).stop 2024-02-21T23:13:14.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.557+0000 7f1e25200640 1 -- 172.21.15.99:0/2236185000 reap_dead start 2024-02-21T23:13:14.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.557+0000 7f1e25c00640 1 -- 172.21.15.99:0/2236185000 shutdown_connections 2024-02-21T23:13:14.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.557+0000 7f1e25c00640 1 -- 172.21.15.99:0/2236185000 >> 172.21.15.99:0/2236185000 conn(0x7f1e2008cfd0 msgr2=0x7f1e2016c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:14.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.557+0000 7f1e25c00640 1 -- 172.21.15.99:0/2236185000 shutdown_connections 2024-02-21T23:13:14.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.557+0000 7f1e25c00640 1 -- 172.21.15.99:0/2236185000 wait complete. 2024-02-21T23:13:14.566 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 11 2024-02-21T23:13:14.635 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:13:14.641 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:13:14.645 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:13:14.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.802+0000 7f36cbe00640 1 Processor -- start 2024-02-21T23:13:14.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.802+0000 7f36cbe00640 1 -- start start 2024-02-21T23:13:14.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.805+0000 7f36cbe00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f36cc182a80 0x7f36cc18a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:14.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.805+0000 7f36cbe00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36cc18a600 con 0x7f36cc18b980 2024-02-21T23:13:14.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.805+0000 7f36cbe00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36cc18a8e0 con 0x7f36cc0719b0 2024-02-21T23:13:14.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.805+0000 7f36cbe00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36cc18abc0 con 0x7f36cc182a80 2024-02-21T23:13:14.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.806+0000 7f36caa00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f36cc182a80 0x7f36cc18a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:14.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.806+0000 7f36ca000640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f36cc18b980 0x7f36cc186a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:58322/0 (socket says 172.21.15.99:58322) 2024-02-21T23:13:14.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.806+0000 7f36ca000640 1 -- 172.21.15.99:0/346977279 learned_addr learned my addr 172.21.15.99:0/346977279 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:13:14.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.806+0000 7f36caa00640 1 -- 172.21.15.99:0/346977279 >> v1:172.21.15.181:6789/0 conn(0x7f36cc0719b0 legacy=0x7f36cc071e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:14.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.806+0000 7f36caa00640 1 -- 172.21.15.99:0/346977279 >> v1:172.21.15.99:6789/0 conn(0x7f36cc18b980 legacy=0x7f36cc186a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:14.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.806+0000 7f36caa00640 1 -- 172.21.15.99:0/346977279 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36cc18aea0 con 0x7f36cc182a80 2024-02-21T23:13:14.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.808+0000 7f36caa00640 1 --2- 172.21.15.99:0/346977279 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f36cc182a80 0x7f36cc18a010 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f36bc009720 tx=0x7f36bc02b620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=597b4a27f49749f2 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:14.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.808+0000 7f36c9600640 1 -- 172.21.15.99:0/346977279 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36bc037070 con 0x7f36cc182a80 2024-02-21T23:13:14.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.808+0000 7f36c9600640 1 -- 172.21.15.99:0/346977279 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36bc030710 con 0x7f36cc182a80 2024-02-21T23:13:14.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.808+0000 7f36c9600640 1 -- 172.21.15.99:0/346977279 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36bc030ae0 con 0x7f36cc182a80 2024-02-21T23:13:14.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.809+0000 7f36cbe00640 1 -- 172.21.15.99:0/346977279 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f36cc182a80 msgr2=0x7f36cc18a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:14.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.809+0000 7f36cbe00640 1 --2- 172.21.15.99:0/346977279 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f36cc182a80 0x7f36cc18a010 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f36bc009720 tx=0x7f36bc02b620 comp rx=0 tx=0).stop 2024-02-21T23:13:14.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.809+0000 7f36cbe00640 1 -- 172.21.15.99:0/346977279 shutdown_connections 2024-02-21T23:13:14.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.809+0000 7f36cbe00640 1 --2- 172.21.15.99:0/346977279 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f36cc182a80 0x7f36cc18a010 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:14.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.809+0000 7f36cbe00640 1 -- 172.21.15.99:0/346977279 >> 172.21.15.99:0/346977279 conn(0x7f36cc0d29f0 msgr2=0x7f36cc0d2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:14.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.810+0000 7f36cbe00640 1 -- 172.21.15.99:0/346977279 shutdown_connections 2024-02-21T23:13:14.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.810+0000 7f36cbe00640 1 -- 172.21.15.99:0/346977279 wait complete. 2024-02-21T23:13:14.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.813+0000 7f36cbe00640 1 Processor -- start 2024-02-21T23:13:14.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.813+0000 7f36cbe00640 1 -- start start 2024-02-21T23:13:14.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.815+0000 7f36cbe00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f36cc0719b0 0x7f36cc1792d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:14.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.815+0000 7f36cbe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f36cc182a80 0x7f36cc17ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:14.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.815+0000 7f36cbe00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36cc18b980 0x7f36cc17f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:14.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.815+0000 7f36cbe00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36cc18be00 con 0x7f36cc182a80 2024-02-21T23:13:14.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.815+0000 7f36cbe00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36cc18b460 con 0x7f36cc18b980 2024-02-21T23:13:14.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.815+0000 7f36cbe00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36cc182e60 con 0x7f36cc0719b0 2024-02-21T23:13:14.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.816+0000 7f36cb400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36cc18b980 0x7f36cc17f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:14.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.816+0000 7f36caa00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f36cc0719b0 0x7f36cc1792d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:14.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.816+0000 7f36cb400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36cc18b980 0x7f36cc17f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:56254/0 (socket says 172.21.15.99:56254) 2024-02-21T23:13:14.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.816+0000 7f36cb400640 1 -- 172.21.15.99:0/2490048100 learned_addr learned my addr 172.21.15.99:0/2490048100 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:13:14.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.816+0000 7f36ca000640 1 --2- 172.21.15.99:0/2490048100 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f36cc182a80 0x7f36cc17ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:14.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.816+0000 7f36cb400640 1 -- 172.21.15.99:0/2490048100 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f36cc0719b0 msgr2=0x7f36cc1792d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:14.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.816+0000 7f36cb400640 1 --2- 172.21.15.99:0/2490048100 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f36cc0719b0 0x7f36cc1792d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:14.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.816+0000 7f36cb400640 1 -- 172.21.15.99:0/2490048100 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f36cc182a80 msgr2=0x7f36cc17ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:14.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.816+0000 7f36cb400640 1 --2- 172.21.15.99:0/2490048100 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f36cc182a80 0x7f36cc17ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:14.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.816+0000 7f36cb400640 1 -- 172.21.15.99:0/2490048100 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36cc0f9100 con 0x7f36cc18b980 2024-02-21T23:13:14.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.817+0000 7f36cb400640 1 --2- 172.21.15.99:0/2490048100 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36cc18b980 0x7f36cc17f120 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f36c400caf0 tx=0x7f36c40020b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:14.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.817+0000 7f36c2a00640 1 -- 172.21.15.99:0/2490048100 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c4017070 con 0x7f36cc18b980 2024-02-21T23:13:14.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.817+0000 7f36c2a00640 1 -- 172.21.15.99:0/2490048100 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36c4003da0 con 0x7f36cc18b980 2024-02-21T23:13:14.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.817+0000 7f36c2a00640 1 -- 172.21.15.99:0/2490048100 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c400a900 con 0x7f36cc18b980 2024-02-21T23:13:14.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.817+0000 7f36cbe00640 1 -- 172.21.15.99:0/2490048100 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36cc17d860 con 0x7f36cc18b980 2024-02-21T23:13:14.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.818+0000 7f36cbe00640 1 -- 172.21.15.99:0/2490048100 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36cc17de20 con 0x7f36cc18b980 2024-02-21T23:13:14.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.819+0000 7f36cbe00640 1 -- 172.21.15.99:0/2490048100 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36cc17f660 con 0x7f36cc18b980 2024-02-21T23:13:14.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.822+0000 7f36c2a00640 1 -- 172.21.15.99:0/2490048100 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f36c401a070 con 0x7f36cc18b980 2024-02-21T23:13:14.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.825+0000 7f36c2a00640 1 --2- 172.21.15.99:0/2490048100 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f36ac09eed0 0x7f36ac0a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:14.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.825+0000 7f36c2a00640 1 -- 172.21.15.99:0/2490048100 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f36c40c9890 con 0x7f36cc18b980 2024-02-21T23:13:14.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.825+0000 7f36caa00640 1 --2- 172.21.15.99:0/2490048100 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f36ac09eed0 0x7f36ac0a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:14.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.826+0000 7f36caa00640 1 --2- 172.21.15.99:0/2490048100 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f36ac09eed0 0x7f36ac0a1390 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f36bc034000 tx=0x7f36bc008030 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:14.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:14.828+0000 7f36c2a00640 1 -- 172.21.15.99:0/2490048100 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f36c40977e0 con 0x7f36cc18b980 2024-02-21T23:13:15.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.158+0000 7f36cbe00640 1 -- 172.21.15.99:0/2490048100 --> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "11", "target": ["mon-mgr", ""]}) v1 -- 0x7f36cc17d610 con 0x7f36ac09eed0 2024-02-21T23:13:15.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.159+0000 7f36c2a00640 1 -- 172.21.15.99:0/2490048100 <== mgr.5131 v2:172.21.15.162:6800/631076050 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 11 to deep-scrub) v1 ==== 42+0+0 (secure 0 0 0) 0x7f36cc17d610 con 0x7f36ac09eed0 2024-02-21T23:13:15.147 INFO:teuthology.orchestra.run.smithi099.stderr:instructed osd(s) 11 to deep-scrub 2024-02-21T23:13:15.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.162+0000 7f36cbe00640 1 -- 172.21.15.99:0/2490048100 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f36ac09eed0 msgr2=0x7f36ac0a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:15.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.162+0000 7f36cbe00640 1 --2- 172.21.15.99:0/2490048100 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f36ac09eed0 0x7f36ac0a1390 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f36bc034000 tx=0x7f36bc008030 comp rx=0 tx=0).stop 2024-02-21T23:13:15.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.162+0000 7f36cbe00640 1 -- 172.21.15.99:0/2490048100 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36cc18b980 msgr2=0x7f36cc17f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:15.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.162+0000 7f36cbe00640 1 --2- 172.21.15.99:0/2490048100 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36cc18b980 0x7f36cc17f120 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f36c400caf0 tx=0x7f36c40020b0 comp rx=0 tx=0).stop 2024-02-21T23:13:15.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.162+0000 7f36cbe00640 1 -- 172.21.15.99:0/2490048100 shutdown_connections 2024-02-21T23:13:15.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.162+0000 7f36cbe00640 1 --2- 172.21.15.99:0/2490048100 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f36ac09eed0 0x7f36ac0a1390 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:15.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.162+0000 7f36cbe00640 1 --2- 172.21.15.99:0/2490048100 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36cc18b980 0x7f36cc17f120 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:15.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.162+0000 7f36cbe00640 1 --2- 172.21.15.99:0/2490048100 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f36cc182a80 0x7f36cc17ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:15.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.162+0000 7f36cbe00640 1 --2- 172.21.15.99:0/2490048100 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f36cc0719b0 0x7f36cc1792d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:15.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.162+0000 7f36cbe00640 1 -- 172.21.15.99:0/2490048100 >> 172.21.15.99:0/2490048100 conn(0x7f36cc0d29f0 msgr2=0x7f36cc0d2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:15.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.163+0000 7f36cbe00640 1 -- 172.21.15.99:0/2490048100 shutdown_connections 2024-02-21T23:13:15.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.163+0000 7f36cbe00640 1 -- 172.21.15.99:0/2490048100 wait complete. 2024-02-21T23:13:15.172 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-21T23:13:15.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.459+0000 7f13fde00640 1 Processor -- start 2024-02-21T23:13:15.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.459+0000 7f13fde00640 1 -- start start 2024-02-21T23:13:15.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.462+0000 7f13fde00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f13f818a010 0x7f13f818b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:15.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.462+0000 7f13fde00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f13f80719b0 0x7f13f8071e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:15.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.462+0000 7f13fde00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13f818a600 con 0x7f13f8182a80 2024-02-21T23:13:15.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.462+0000 7f13fde00640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13f818bec0 con 0x7f13f80719b0 2024-02-21T23:13:15.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.462+0000 7f13fde00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13f818a8e0 con 0x7f13f818a010 2024-02-21T23:13:15.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.462+0000 7f13fca00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f13f8182a80 0x7f13f8186a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:58336/0 (socket says 172.21.15.99:58336) 2024-02-21T23:13:15.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.462+0000 7f13fca00640 1 -- 172.21.15.99:0/3756821835 learned_addr learned my addr 172.21.15.99:0/3756821835 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:13:15.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.462+0000 7f13fd400640 1 --2- 172.21.15.99:0/3756821835 >> v2:172.21.15.162:3300/0 conn(0x7f13f80719b0 0x7f13f8071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:15.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.462+0000 7f13f7e00640 1 --2- 172.21.15.99:0/3756821835 >> v2:172.21.15.181:3300/0 conn(0x7f13f818a010 0x7f13f818b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:15.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.463+0000 7f13f7400640 1 -- 172.21.15.99:0/3756821835 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1962799998 0 0) 0x7f13f818a600 con 0x7f13f8182a80 2024-02-21T23:13:15.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.463+0000 7f13fd400640 1 -- 172.21.15.99:0/3756821835 >> v2:172.21.15.181:3300/0 conn(0x7f13f818a010 msgr2=0x7f13f818b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:13:15.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.463+0000 7f13fd400640 1 --2- 172.21.15.99:0/3756821835 >> v2:172.21.15.181:3300/0 conn(0x7f13f818a010 0x7f13f818b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:15.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.463+0000 7f13fd400640 1 -- 172.21.15.99:0/3756821835 >> v1:172.21.15.99:6789/0 conn(0x7f13f8182a80 legacy=0x7f13f8186a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:15.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.463+0000 7f13fd400640 1 -- 172.21.15.99:0/3756821835 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13f818abc0 con 0x7f13f80719b0 2024-02-21T23:13:15.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.463+0000 7f13f7e00640 1 --2- 172.21.15.99:0/3756821835 >> v2:172.21.15.181:3300/0 conn(0x7f13f818a010 0x7f13f818b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:13:15.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.465+0000 7f13fd400640 1 --2- 172.21.15.99:0/3756821835 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13f80719b0 0x7f13f8071e40 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f13f815afe0 tx=0x7f13f002bda0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=151e4194164e0818 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:15.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.465+0000 7f13f7400640 1 -- 172.21.15.99:0/3756821835 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f0039070 con 0x7f13f80719b0 2024-02-21T23:13:15.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.465+0000 7f13f7400640 1 -- 172.21.15.99:0/3756821835 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13f002cb50 con 0x7f13f80719b0 2024-02-21T23:13:15.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.465+0000 7f13f7400640 1 -- 172.21.15.99:0/3756821835 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f0034440 con 0x7f13f80719b0 2024-02-21T23:13:15.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.466+0000 7f13fde00640 1 -- 172.21.15.99:0/3756821835 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13f80719b0 msgr2=0x7f13f8071e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:15.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.466+0000 7f13fde00640 1 --2- 172.21.15.99:0/3756821835 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13f80719b0 0x7f13f8071e40 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f13f815afe0 tx=0x7f13f002bda0 comp rx=0 tx=0).stop 2024-02-21T23:13:15.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.466+0000 7f13fde00640 1 -- 172.21.15.99:0/3756821835 shutdown_connections 2024-02-21T23:13:15.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.466+0000 7f13fde00640 1 --2- 172.21.15.99:0/3756821835 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13f80719b0 0x7f13f8071e40 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:15.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.466+0000 7f13fde00640 1 --2- 172.21.15.99:0/3756821835 >> v2:172.21.15.181:3300/0 conn(0x7f13f818a010 0x7f13f818b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:15.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.466+0000 7f13fde00640 1 -- 172.21.15.99:0/3756821835 >> 172.21.15.99:0/3756821835 conn(0x7f13f80d29f0 msgr2=0x7f13f80d2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:15.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.466+0000 7f13fde00640 1 -- 172.21.15.99:0/3756821835 shutdown_connections 2024-02-21T23:13:15.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.466+0000 7f13fde00640 1 -- 172.21.15.99:0/3756821835 wait complete. 2024-02-21T23:13:15.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.469+0000 7f13fde00640 1 Processor -- start 2024-02-21T23:13:15.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.470+0000 7f13fde00640 1 -- start start 2024-02-21T23:13:15.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.472+0000 7f13fde00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13f80719b0 0x7f13f80f9b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:15.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.472+0000 7f13fde00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f13f8182a80 0x7f13f817c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:15.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.472+0000 7f13fde00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f13f818a010 0x7f13f817c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:15.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.472+0000 7f13fde00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f818b460 con 0x7f13f8182a80 2024-02-21T23:13:15.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.472+0000 7f13fde00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f818b180 con 0x7f13f80719b0 2024-02-21T23:13:15.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.472+0000 7f13fde00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f8182e60 con 0x7f13f818a010 2024-02-21T23:13:15.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.472+0000 7f13fca00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13f80719b0 0x7f13f80f9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:15.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.472+0000 7f13fca00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13f80719b0 0x7f13f80f9b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:56266/0 (socket says 172.21.15.99:56266) 2024-02-21T23:13:15.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.472+0000 7f13fca00640 1 -- 172.21.15.99:0/1616738258 learned_addr learned my addr 172.21.15.99:0/1616738258 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:13:15.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.472+0000 7f13f7e00640 1 --2- 172.21.15.99:0/1616738258 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f13f8182a80 0x7f13f817c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:15.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.472+0000 7f13fd400640 1 --2- 172.21.15.99:0/1616738258 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f13f818a010 0x7f13f817c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:15.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.473+0000 7f13fca00640 1 -- 172.21.15.99:0/1616738258 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f13f818a010 msgr2=0x7f13f817c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:15.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.473+0000 7f13fca00640 1 --2- 172.21.15.99:0/1616738258 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f13f818a010 0x7f13f817c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:15.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.473+0000 7f13fca00640 1 -- 172.21.15.99:0/1616738258 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f13f8182a80 msgr2=0x7f13f817c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:15.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.473+0000 7f13fca00640 1 --2- 172.21.15.99:0/1616738258 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f13f8182a80 0x7f13f817c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:15.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.473+0000 7f13fca00640 1 -- 172.21.15.99:0/1616738258 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13f80f8270 con 0x7f13f80719b0 2024-02-21T23:13:15.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.474+0000 7f13fca00640 1 --2- 172.21.15.99:0/1616738258 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13f80719b0 0x7f13f80f9b00 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f13ec00c3f0 tx=0x7f13ec00c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:15.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.474+0000 7f13f4c00640 1 -- 172.21.15.99:0/1616738258 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13ec0074e0 con 0x7f13f80719b0 2024-02-21T23:13:15.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.474+0000 7f13f4c00640 1 -- 172.21.15.99:0/1616738258 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13ec0047e0 con 0x7f13f80719b0 2024-02-21T23:13:15.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.474+0000 7f13f4c00640 1 -- 172.21.15.99:0/1616738258 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13ec004c10 con 0x7f13f80719b0 2024-02-21T23:13:15.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.475+0000 7f13fde00640 1 -- 172.21.15.99:0/1616738258 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13f80fa5f0 con 0x7f13f80719b0 2024-02-21T23:13:15.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.475+0000 7f13fde00640 1 -- 172.21.15.99:0/1616738258 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13f80fabb0 con 0x7f13f80719b0 2024-02-21T23:13:15.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.477+0000 7f13fde00640 1 -- 172.21.15.99:0/1616738258 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13f8068320 con 0x7f13f80719b0 2024-02-21T23:13:15.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.483+0000 7f13f4c00640 1 -- 172.21.15.99:0/1616738258 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f13ec011070 con 0x7f13f80719b0 2024-02-21T23:13:15.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.485+0000 7f13f4c00640 1 --2- 172.21.15.99:0/1616738258 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f13d809f020 0x7f13d80a14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:15.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.485+0000 7f13f4c00640 1 -- 172.21.15.99:0/1616738258 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f13ec0c9b10 con 0x7f13f80719b0 2024-02-21T23:13:15.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.485+0000 7f13f7e00640 1 --2- 172.21.15.99:0/1616738258 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f13d809f020 0x7f13d80a14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:15.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.486+0000 7f13f7e00640 1 --2- 172.21.15.99:0/1616738258 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f13d809f020 0x7f13d80a14e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f13e4009500 tx=0x7f13e4008040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:15.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.488+0000 7f13f4c00640 1 -- 172.21.15.99:0/1616738258 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f13ec097a60 con 0x7f13f80719b0 2024-02-21T23:13:15.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.860+0000 7f13fde00640 1 -- 172.21.15.99:0/1616738258 --> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f13f80fcc10 con 0x7f13d809f020 2024-02-21T23:13:15.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.869+0000 7f13f4c00640 1 -- 172.21.15.99:0/1616738258 <== mgr.5131 v2:172.21.15.162:6800/631076050 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+344292 (secure 0 0 0) 0x7f13f80fcc10 con 0x7f13d809f020 2024-02-21T23:13:15.862 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T23:13:15.864 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-02-21T23:13:15.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.876+0000 7f13fde00640 1 -- 172.21.15.99:0/1616738258 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f13d809f020 msgr2=0x7f13d80a14e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:15.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.876+0000 7f13fde00640 1 --2- 172.21.15.99:0/1616738258 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f13d809f020 0x7f13d80a14e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f13e4009500 tx=0x7f13e4008040 comp rx=0 tx=0).stop 2024-02-21T23:13:15.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.876+0000 7f13fde00640 1 -- 172.21.15.99:0/1616738258 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13f80719b0 msgr2=0x7f13f80f9b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:15.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.876+0000 7f13fde00640 1 --2- 172.21.15.99:0/1616738258 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13f80719b0 0x7f13f80f9b00 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f13ec00c3f0 tx=0x7f13ec00c8b0 comp rx=0 tx=0).stop 2024-02-21T23:13:15.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.876+0000 7f13fde00640 1 -- 172.21.15.99:0/1616738258 shutdown_connections 2024-02-21T23:13:15.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.876+0000 7f13fde00640 1 --2- 172.21.15.99:0/1616738258 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f13d809f020 0x7f13d80a14e0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:15.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.876+0000 7f13fde00640 1 --2- 172.21.15.99:0/1616738258 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f13f818a010 0x7f13f817c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:15.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.876+0000 7f13fde00640 1 --2- 172.21.15.99:0/1616738258 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f13f8182a80 0x7f13f817c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:15.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.876+0000 7f13fde00640 1 --2- 172.21.15.99:0/1616738258 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f13f80719b0 0x7f13f80f9b00 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:15.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.876+0000 7f13fde00640 1 -- 172.21.15.99:0/1616738258 >> 172.21.15.99:0/1616738258 conn(0x7f13f80d29f0 msgr2=0x7f13f818c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:15.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.876+0000 7f13fde00640 1 -- 172.21.15.99:0/1616738258 shutdown_connections 2024-02-21T23:13:15.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:15.876+0000 7f13fde00640 1 -- 172.21.15.99:0/1616738258 wait complete. 2024-02-21T23:13:15.880 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":343,"stamp":"2024-02-21T23:13:14.225397+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":88028359,"num_objects":3718,"num_object_clones":0,"num_object_copies":14334,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3718,"num_whiteouts":0,"num_read":7021,"num_read_kb":64295,"num_write":12202,"num_write_kb":111535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":221,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":488352,"num_omap_keys":785,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17381,"ondisk_log_size":17381,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1132462080,"kb_used":565828,"kb_used_data":120968,"kb_used_omap":18,"kb_used_meta":444717,"kb_avail":1131896252,"statfs":{"total":1159641169920,"available":1159061762048,"internally_reserved":0,"allocated":123871232,"data_stored":224606101,"data_compressed":23128212,"data_compressed_allocated":29143040,"data_compressed_original":133140480,"omap_allocated":19138,"internal_metadata":455390526},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3924,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":157,"num_write":84,"num_write_kb":538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":488352,"num_omap_keys":785,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003273"},"pg_stats":[{"pgid":"2.1f","version":"32'20","reported_seq":99,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-21T23:13:03.629650+0000","last_change":"2024-02-21T23:01:02.208441+0000","last_active":"2024-02-21T23:13:03.629650+0000","last_peered":"2024-02-21T23:13:03.629650+0000","last_clean":"2024-02-21T23:13:03.629650+0000","last_became_active":"2024-02-21T23:01:02.208124+0000","last_became_peered":"2024-02-21T23:01:02.208124+0000","last_unstale":"2024-02-21T23:13:03.629650+0000","last_undegraded":"2024-02-21T23:13:03.629650+0000","last_fullsized":"2024-02-21T23:13:03.629650+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":27,"num_read_kb":4118,"num_write":27,"num_write_kb":4186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7],"acting":[9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"40'67","reported_seq":165,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:10.006622+0000","last_change":"2024-02-21T23:13:03.636708+0000","last_active":"2024-02-21T23:13:10.006622+0000","last_peered":"2024-02-21T23:13:10.006622+0000","last_clean":"2024-02-21T23:13:10.006622+0000","last_became_active":"2024-02-21T23:01:03.214170+0000","last_became_peered":"2024-02-21T23:01:03.214170+0000","last_unstale":"2024-02-21T23:13:10.006622+0000","last_undegraded":"2024-02-21T23:13:10.006622+0000","last_fullsized":"2024-02-21T23:13:10.006622+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0079956079999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"35'364","reported_seq":437,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:09.839892+0000","last_change":"2024-02-21T23:13:03.302073+0000","last_active":"2024-02-21T23:13:09.839892+0000","last_peered":"2024-02-21T23:13:09.839892+0000","last_clean":"2024-02-21T23:13:09.839892+0000","last_became_active":"2024-02-21T23:01:07.276192+0000","last_became_peered":"2024-02-21T23:01:07.276192+0000","last_unstale":"2024-02-21T23:13:09.839892+0000","last_undegraded":"2024-02-21T23:13:09.839892+0000","last_fullsized":"2024-02-21T23:13:09.839892+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:57:37.178183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0032262720000000001,"stat_sum":{"num_bytes":264461,"num_objects":111,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":111,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":325,"num_write_kb":605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"41'27","reported_seq":107,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:10.006637+0000","last_change":"2024-02-21T23:13:08.030343+0000","last_active":"2024-02-21T23:13:10.006637+0000","last_peered":"2024-02-21T23:13:10.006637+0000","last_clean":"2024-02-21T23:13:10.006637+0000","last_became_active":"2024-02-21T23:01:02.220941+0000","last_became_peered":"2024-02-21T23:01:02.220941+0000","last_unstale":"2024-02-21T23:13:10.006637+0000","last_undegraded":"2024-02-21T23:13:10.006637+0000","last_fullsized":"2024-02-21T23:13:10.006637+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'27","last_scrub_stamp":"2024-02-21T23:13:08.030183+0000","last_deep_scrub":"41'27","last_deep_scrub_stamp":"2024-02-21T23:13:08.030183+0000","last_clean_scrub_stamp":"2024-02-21T23:13:08.030183+0000","objects_scrubbed":8,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:48:20.989074+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":17,"num_read_kb":4097,"num_write":22,"num_write_kb":4218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":76581,"num_omap_keys":123,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"40'63","reported_seq":166,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-21T23:13:06.429184+0000","last_change":"2024-02-21T23:13:06.429230+0000","last_active":"2024-02-21T23:13:06.429184+0000","last_peered":"2024-02-21T23:13:06.429184+0000","last_clean":"2024-02-21T23:13:06.429184+0000","last_became_active":"2024-02-21T23:01:03.219221+0000","last_became_peered":"2024-02-21T23:01:03.219221+0000","last_unstale":"2024-02-21T23:13:06.429184+0000","last_undegraded":"2024-02-21T23:13:06.429184+0000","last_fullsized":"2024-02-21T23:13:06.429184+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'63","last_scrub_stamp":"2024-02-21T23:13:06.429073+0000","last_deep_scrub":"40'63","last_deep_scrub_stamp":"2024-02-21T23:13:06.429073+0000","last_clean_scrub_stamp":"2024-02-21T23:13:06.429073+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:06:25.761302+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.0044182249999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"6","length":"1"},{"start":"11","length":"1"}]},{"pgid":"4.18","version":"35'354","reported_seq":425,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-21T23:13:03.357455+0000","last_change":"2024-02-21T23:13:03.357798+0000","last_active":"2024-02-21T23:13:03.357455+0000","last_peered":"2024-02-21T23:13:03.357455+0000","last_clean":"2024-02-21T23:13:03.357455+0000","last_became_active":"2024-02-21T23:01:07.268179+0000","last_became_peered":"2024-02-21T23:01:07.268179+0000","last_unstale":"2024-02-21T23:13:03.357455+0000","last_undegraded":"2024-02-21T23:13:03.357455+0000","last_fullsized":"2024-02-21T23:13:03.357455+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:55:20.195326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002755478,"stat_sum":{"num_bytes":615017,"num_objects":99,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":321,"num_write_kb":926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"6","length":"1"},{"start":"11","length":"1"}]},{"pgid":"2.1d","version":"32'21","reported_seq":98,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:10.076270+0000","last_change":"2024-02-21T23:01:02.208687+0000","last_active":"2024-02-21T23:13:10.076270+0000","last_peered":"2024-02-21T23:13:10.076270+0000","last_clean":"2024-02-21T23:13:10.076270+0000","last_became_active":"2024-02-21T23:01:02.208393+0000","last_became_peered":"2024-02-21T23:01:02.208393+0000","last_unstale":"2024-02-21T23:13:10.076270+0000","last_undegraded":"2024-02-21T23:13:10.076270+0000","last_fullsized":"2024-02-21T23:13:10.076270+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:41:54.477462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":25,"num_read_kb":8200,"num_write":25,"num_write_kb":8264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"40'78","reported_seq":174,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:09.844483+0000","last_change":"2024-02-21T23:13:03.322212+0000","last_active":"2024-02-21T23:13:09.844483+0000","last_peered":"2024-02-21T23:13:09.844483+0000","last_clean":"2024-02-21T23:13:09.844483+0000","last_became_active":"2024-02-21T23:01:03.214733+0000","last_became_peered":"2024-02-21T23:01:03.214733+0000","last_unstale":"2024-02-21T23:13:09.844483+0000","last_undegraded":"2024-02-21T23:13:09.844483+0000","last_fullsized":"2024-02-21T23:13:09.844483+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023581750000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"35'356","reported_seq":425,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-21T23:13:03.358819+0000","last_change":"2024-02-21T23:13:03.359113+0000","last_active":"2024-02-21T23:13:03.358819+0000","last_peered":"2024-02-21T23:13:03.358819+0000","last_clean":"2024-02-21T23:13:03.358819+0000","last_became_active":"2024-02-21T23:01:07.279360+0000","last_became_peered":"2024-02-21T23:01:07.279360+0000","last_unstale":"2024-02-21T23:13:03.358819+0000","last_undegraded":"2024-02-21T23:13:03.358819+0000","last_fullsized":"2024-02-21T23:13:03.358819+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":356,"log_dups_size":0,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:43:04.363142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036991189999999998,"stat_sum":{"num_bytes":1138317,"num_objects":111,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":111,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":317,"num_write_kb":1526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"6","length":"1"},{"start":"11","length":"1"}]},{"pgid":"2.1c","version":"32'11","reported_seq":63,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:10.076125+0000","last_change":"2024-02-21T23:01:02.204774+0000","last_active":"2024-02-21T23:13:10.076125+0000","last_peered":"2024-02-21T23:13:10.076125+0000","last_clean":"2024-02-21T23:13:10.076125+0000","last_became_active":"2024-02-21T23:01:02.203992+0000","last_became_peered":"2024-02-21T23:01:02.203992+0000","last_unstale":"2024-02-21T23:13:10.076125+0000","last_undegraded":"2024-02-21T23:13:10.076125+0000","last_fullsized":"2024-02-21T23:13:10.076125+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:27:54.333439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1],"acting":[8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"40'76","reported_seq":169,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-21T23:13:03.591255+0000","last_change":"2024-02-21T23:13:03.591786+0000","last_active":"2024-02-21T23:13:03.591255+0000","last_peered":"2024-02-21T23:13:03.591255+0000","last_clean":"2024-02-21T23:13:03.591255+0000","last_became_active":"2024-02-21T23:01:03.212702+0000","last_became_peered":"2024-02-21T23:01:03.212702+0000","last_unstale":"2024-02-21T23:13:03.591255+0000","last_undegraded":"2024-02-21T23:13:03.591255+0000","last_fullsized":"2024-02-21T23:13:03.591255+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:04:15.031256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0049110159999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"6","length":"1"},{"start":"11","length":"1"}]},{"pgid":"4.1a","version":"35'320","reported_seq":394,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-21T23:13:03.357841+0000","last_change":"2024-02-21T23:13:03.358305+0000","last_active":"2024-02-21T23:13:03.357841+0000","last_peered":"2024-02-21T23:13:03.357841+0000","last_clean":"2024-02-21T23:13:03.357841+0000","last_became_active":"2024-02-21T23:01:07.268357+0000","last_became_peered":"2024-02-21T23:01:07.268357+0000","last_unstale":"2024-02-21T23:13:03.357841+0000","last_undegraded":"2024-02-21T23:13:03.357841+0000","last_fullsized":"2024-02-21T23:13:03.357841+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:52:18.569386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003219375,"stat_sum":{"num_bytes":206516,"num_objects":100,"num_object_clones":0,"num_object_copies":400,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":290,"num_write_kb":521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"6","length":"1"},{"start":"11","length":"1"}]},{"pgid":"3.a","version":"40'70","reported_seq":164,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-21T23:13:03.302996+0000","last_change":"2024-02-21T23:13:03.303282+0000","last_active":"2024-02-21T23:13:03.302996+0000","last_peered":"2024-02-21T23:13:03.302996+0000","last_clean":"2024-02-21T23:13:03.302996+0000","last_became_active":"2024-02-21T23:01:03.213186+0000","last_became_peered":"2024-02-21T23:01:03.213186+0000","last_unstale":"2024-02-21T23:13:03.302996+0000","last_undegraded":"2024-02-21T23:13:03.302996+0000","last_fullsized":"2024-02-21T23:13:03.302996+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:43:34.600230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0034724209999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"6","length":"1"},{"start":"11","length":"1"}]},{"pgid":"2.b","version":"32'38","reported_seq":108,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:10.075644+0000","last_change":"2024-02-21T23:01:02.208608+0000","last_active":"2024-02-21T23:13:10.075644+0000","last_peered":"2024-02-21T23:13:10.075644+0000","last_clean":"2024-02-21T23:13:10.075644+0000","last_became_active":"2024-02-21T23:01:02.208293+0000","last_became_peered":"2024-02-21T23:01:02.208293+0000","last_unstale":"2024-02-21T23:13:10.075644+0000","last_undegraded":"2024-02-21T23:13:10.075644+0000","last_fullsized":"2024-02-21T23:13:10.075644+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:58:23.554457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":4101,"num_write":38,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"35'339","reported_seq":409,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-21T23:13:03.357903+0000","last_change":"2024-02-21T23:13:03.358303+0000","last_active":"2024-02-21T23:13:03.357903+0000","last_peered":"2024-02-21T23:13:03.357903+0000","last_clean":"2024-02-21T23:13:03.357903+0000","last_became_active":"2024-02-21T23:01:07.651241+0000","last_became_peered":"2024-02-21T23:01:07.651241+0000","last_unstale":"2024-02-21T23:13:03.357903+0000","last_undegraded":"2024-02-21T23:13:03.357903+0000","last_fullsized":"2024-02-21T23:13:03.357903+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:04:01.390898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0030606520000000001,"stat_sum":{"num_bytes":696245,"num_objects":110,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":302,"num_write_kb":1168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"6","length":"1"},{"start":"11","length":"1"}]},{"pgid":"3.b","version":"40'73","reported_seq":170,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:10.006004+0000","last_change":"2024-02-21T23:13:03.636106+0000","last_active":"2024-02-21T23:13:10.006004+0000","last_peered":"2024-02-21T23:13:10.006004+0000","last_clean":"2024-02-21T23:13:10.006004+0000","last_became_active":"2024-02-21T23:01:03.219898+0000","last_became_peered":"2024-02-21T23:01:03.219898+0000","last_unstale":"2024-02-21T23:13:10.006004+0000","last_undegraded":"2024-02-21T23:13:10.006004+0000","last_fullsized":"2024-02-21T23:13:10.006004+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0092717189999999994,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"40'35","reported_seq":88,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:09.840082+0000","last_change":"2024-02-21T23:01:02.202866+0000","last_active":"2024-02-21T23:13:09.840082+0000","last_peered":"2024-02-21T23:13:09.840082+0000","last_clean":"2024-02-21T23:13:09.840082+0000","last_became_active":"2024-02-21T23:01:02.202585+0000","last_became_peered":"2024-02-21T23:01:02.202585+0000","last_unstale":"2024-02-21T23:13:09.840082+0000","last_undegraded":"2024-02-21T23:13:09.840082+0000","last_fullsized":"2024-02-21T23:13:09.840082+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:26:49.911102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"35'375","reported_seq":442,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-21T23:13:03.359160+0000","last_change":"2024-02-21T23:13:03.359382+0000","last_active":"2024-02-21T23:13:03.359160+0000","last_peered":"2024-02-21T23:13:03.359160+0000","last_clean":"2024-02-21T23:13:03.359160+0000","last_became_active":"2024-02-21T23:01:07.276577+0000","last_became_peered":"2024-02-21T23:01:07.276577+0000","last_unstale":"2024-02-21T23:13:03.359160+0000","last_undegraded":"2024-02-21T23:13:03.359160+0000","last_fullsized":"2024-02-21T23:13:03.359160+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:05:42.226913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042116009999999997,"stat_sum":{"num_bytes":317135,"num_objects":109,"num_object_clones":0,"num_object_copies":436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":331,"num_write_kb":822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"6","length":"1"},{"start":"11","length":"1"}]},{"pgid":"3.8","version":"40'69","reported_seq":163,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-21T23:13:03.631059+0000","last_change":"2024-02-21T23:13:03.631440+0000","last_active":"2024-02-21T23:13:03.631059+0000","last_peered":"2024-02-21T23:13:03.631059+0000","last_clean":"2024-02-21T23:13:03.631059+0000","last_became_active":"2024-02-21T23:01:03.218706+0000","last_became_peered":"2024-02-21T23:01:03.218706+0000","last_unstale":"2024-02-21T23:13:03.631059+0000","last_undegraded":"2024-02-21T23:13:03.631059+0000","last_fullsized":"2024-02-21T23:13:03.631059+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:54:21.514719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.005533998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[{"start":"6","length":"1"},{"start":"11","length":"1"}]},{"pgid":"2.9","version":"41'20","reported_seq":82,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:10.005541+0000","last_change":"2024-02-21T23:13:07.064073+0000","last_active":"2024-02-21T23:13:10.005541+0000","last_peered":"2024-02-21T23:13:10.005541+0000","last_clean":"2024-02-21T23:13:10.005541+0000","last_became_active":"2024-02-21T23:01:02.208542+0000","last_became_peered":"2024-02-21T23:01:02.208542+0000","last_unstale":"2024-02-21T23:13:10.005541+0000","last_undegraded":"2024-02-21T23:13:10.005541+0000","last_fullsized":"2024-02-21T23:13:10.005541+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'20","last_scrub_stamp":"2024-02-21T23:13:07.063969+0000","last_deep_scrub":"41'20","last_deep_scrub_stamp":"2024-02-21T23:13:07.063969+0000","last_clean_scrub_stamp":"2024-02-21T23:13:07.063969+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:09:10.687052+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":57195,"num_omap_keys":93,"num_objects_repaired":0},"up":[3,9],"acting":[3,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"35'342","reported_seq":407,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-21T23:13:03.634219+0000","last_change":"2024-02-21T23:13:03.634219+0000","last_active":"2024-02-21T23:13:03.634219+0000","last_peered":"2024-02-21T23:13:03.634219+0000","last_clean":"2024-02-21T23:13:03.634219+0000","last_became_active":"2024-02-21T23:01:07.282506+0000","last_became_peered":"2024-02-21T23:01:07.282506+0000","last_unstale":"2024-02-21T23:13:03.634219+0000","last_undegraded":"2024-02-21T23:13:03.634219+0000","last_fullsized":"2024-02-21T23:13:03.634219+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0047509290000000001,"stat_sum":{"num_bytes":321892,"num_objects":112,"num_object_clones":0,"num_object_copies":448,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":112,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":294,"num_write_kb":916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[{"start":"6","length":"1"},{"start":"11","length":"1"}]},{"pgid":"3.9","version":"40'60","reported_seq":156,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:10.075613+0000","last_change":"2024-02-21T23:13:03.627993+0000","last_active":"2024-02-21T23:13:10.075613+0000","last_peered":"2024-02-21T23:13:10.075613+0000","last_clean":"2024-02-21T23:13:10.075613+0000","last_became_active":"2024-02-21T23:01:03.211919+0000","last_became_peered":"2024-02-21T23:01:03.211919+0000","last_unstale":"2024-02-21T23:13:10.075613+0000","last_undegraded":"2024-02-21T23:13:10.075613+0000","last_fullsized":"2024-02-21T23:13:10.075613+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:23:08.703440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041254509999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"41'19","reported_seq":81,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:09.844157+0000","last_change":"2024-02-21T23:13:09.396691+0000","last_active":"2024-02-21T23:13:09.844157+0000","last_peered":"2024-02-21T23:13:09.844157+0000","last_clean":"2024-02-21T23:13:09.844157+0000","last_became_active":"2024-02-21T23:01:02.203761+0000","last_became_peered":"2024-02-21T23:01:02.203761+0000","last_unstale":"2024-02-21T23:13:09.844157+0000","last_undegraded":"2024-02-21T23:13:09.844157+0000","last_fullsized":"2024-02-21T23:13:09.844157+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'19","last_scrub_stamp":"2024-02-21T23:13:09.396581+0000","last_deep_scrub":"41'19","last_deep_scrub_stamp":"2024-02-21T23:13:09.396581+0000","last_clean_scrub_stamp":"2024-02-21T23:13:09.396581+0000","objects_scrubbed":8,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:45:57.394534+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":83247,"num_omap_keys":134,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"35'297","reported_seq":377,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-21T23:13:03.358385+0000","last_change":"2024-02-21T23:13:03.358761+0000","last_active":"2024-02-21T23:13:03.358385+0000","last_peered":"2024-02-21T23:13:03.358385+0000","last_clean":"2024-02-21T23:13:03.358385+0000","last_became_active":"2024-02-21T23:01:50.570965+0000","last_became_peered":"2024-02-21T23:01:50.570965+0000","last_unstale":"2024-02-21T23:13:03.358385+0000","last_undegraded":"2024-02-21T23:13:03.358385+0000","last_fullsized":"2024-02-21T23:13:03.358385+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:59:38.126360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00358377,"stat_sum":{"num_bytes":200353,"num_objects":99,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":263,"num_write_kb":684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,10,9],"acting":[4,8,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"6","length":"1"},{"start":"11","length":"1"}]},{"pgid":"3.6","version":"40'66","reported_seq":161,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-21T23:13:03.521516+0000","last_change":"2024-02-21T23:13:03.521516+0000","last_active":"2024-02-21T23:13:03.521516+0000","last_peered":"2024-02-21T23:13:03.521516+0000","last_clean":"2024-02-21T23:13:03.521516+0000","last_became_active":"2024-02-21T23:01:03.229873+0000","last_became_peered":"2024-02-21T23:01:03.229873+0000","last_unstale":"2024-02-21T23:13:03.521516+0000","last_undegraded":"2024-02-21T23:13:03.521516+0000","last_fullsized":"2024-02-21T23:13:03.521516+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0043383639999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"6","length":"1"},{"start":"11","length":"1"}]},{"pgid":"2.7","version":"32'14","reported_seq":65,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-21T23:13:03.355597+0000","last_change":"2024-02-21T23:01:02.206586+0000","last_active":"2024-02-21T23:13:03.355597+0000","last_peered":"2024-02-21T23:13:03.355597+0000","last_clean":"2024-02-21T23:13:03.355597+0000","last_became_active":"2024-02-21T23:01:02.206230+0000","last_became_peered":"2024-02-21T23:01:02.206230+0000","last_unstale":"2024-02-21T23:13:03.355597+0000","last_undegraded":"2024-02-21T23:13:03.355597+0000","last_fullsized":"2024-02-21T23:13:03.355597+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:21:29.919968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11],"acting":[4,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"35'358","reported_seq":429,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:09.839847+0000","last_change":"2024-02-21T23:13:03.302484+0000","last_active":"2024-02-21T23:13:09.839847+0000","last_peered":"2024-02-21T23:13:09.839847+0000","last_clean":"2024-02-21T23:13:09.839847+0000","last_became_active":"2024-02-21T23:01:07.251670+0000","last_became_peered":"2024-02-21T23:01:07.251670+0000","last_unstale":"2024-02-21T23:13:09.839847+0000","last_undegraded":"2024-02-21T23:13:09.839847+0000","last_fullsized":"2024-02-21T23:13:09.839847+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:44:02.957798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0033260199999999998,"stat_sum":{"num_bytes":4398222,"num_objects":112,"num_object_clones":0,"num_object_copies":448,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":112,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":314,"num_write_kb":4681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"40'66","reported_seq":171,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:10.006787+0000","last_change":"2024-02-21T23:13:10.004467+0000","last_active":"2024-02-21T23:13:10.006787+0000","last_peered":"2024-02-21T23:13:10.006787+0000","last_clean":"2024-02-21T23:13:10.006787+0000","last_became_active":"2024-02-21T23:01:03.206892+0000","last_became_peered":"2024-02-21T23:01:03.206892+0000","last_unstale":"2024-02-21T23:13:10.006787+0000","last_undegraded":"2024-02-21T23:13:10.006787+0000","last_fullsized":"2024-02-21T23:13:10.006787+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'66","last_scrub_stamp":"2024-02-21T23:13:10.004279+0000","last_deep_scrub":"40'66","last_deep_scrub_stamp":"2024-02-21T23:13:10.004279+0000","last_clean_scrub_stamp":"2024-02-21T23:13:10.004279+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:09:51.286268+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.0079926949999999993,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"40'468","reported_seq":996,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-21T23:13:03.629007+0000","last_change":"2024-02-21T23:01:02.209850+0000","last_active":"2024-02-21T23:13:03.629007+0000","last_peered":"2024-02-21T23:13:03.629007+0000","last_clean":"2024-02-21T23:13:03.629007+0000","last_became_active":"2024-02-21T23:01:02.209601+0000","last_became_peered":"2024-02-21T23:01:02.209601+0000","last_unstale":"2024-02-21T23:13:03.629007+0000","last_undegraded":"2024-02-21T23:13:03.629007+0000","last_fullsized":"2024-02-21T23:13:03.629007+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1592,"num_read_kb":1429,"num_write":908,"num_write_kb":4270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"35'354","reported_seq":427,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:10.004814+0000","last_change":"2024-02-21T23:13:03.628918+0000","last_active":"2024-02-21T23:13:10.004814+0000","last_peered":"2024-02-21T23:13:10.004814+0000","last_clean":"2024-02-21T23:13:10.004814+0000","last_became_active":"2024-02-21T23:01:07.651431+0000","last_became_peered":"2024-02-21T23:01:07.651431+0000","last_unstale":"2024-02-21T23:13:10.004814+0000","last_undegraded":"2024-02-21T23:13:10.004814+0000","last_fullsized":"2024-02-21T23:13:10.004814+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0051655870000000001,"stat_sum":{"num_bytes":401739,"num_objects":113,"num_object_clones":0,"num_object_copies":452,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":113,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":314,"num_write_kb":708,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"40'71","reported_seq":168,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:09.840203+0000","last_change":"2024-02-21T23:13:03.307165+0000","last_active":"2024-02-21T23:13:09.840203+0000","last_peered":"2024-02-21T23:13:09.840203+0000","last_clean":"2024-02-21T23:13:09.840203+0000","last_became_active":"2024-02-21T23:01:03.221405+0000","last_became_peered":"2024-02-21T23:01:03.221405+0000","last_unstale":"2024-02-21T23:13:09.840203+0000","last_undegraded":"2024-02-21T23:13:09.840203+0000","last_fullsized":"2024-02-21T23:13:09.840203+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0075840730000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"32'7","reported_seq":61,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:10.076378+0000","last_change":"2024-02-21T23:01:02.221218+0000","last_active":"2024-02-21T23:13:10.076378+0000","last_peered":"2024-02-21T23:13:10.076378+0000","last_clean":"2024-02-21T23:13:10.076378+0000","last_became_active":"2024-02-21T23:01:02.220923+0000","last_became_peered":"2024-02-21T23:01:02.220923+0000","last_unstale":"2024-02-21T23:13:10.076378+0000","last_undegraded":"2024-02-21T23:13:10.076378+0000","last_fullsized":"2024-02-21T23:13:10.076378+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:38:15.938263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":13,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"35'343","reported_seq":421,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-21T23:13:03.627159+0000","last_change":"2024-02-21T23:13:03.627650+0000","last_active":"2024-02-21T23:13:03.627159+0000","last_peered":"2024-02-21T23:13:03.627159+0000","last_clean":"2024-02-21T23:13:03.627159+0000","last_became_active":"2024-02-21T23:01:07.268210+0000","last_became_peered":"2024-02-21T23:01:07.268210+0000","last_unstale":"2024-02-21T23:13:03.627159+0000","last_undegraded":"2024-02-21T23:13:03.627159+0000","last_fullsized":"2024-02-21T23:13:03.627159+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":343,"log_dups_size":0,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:47:14.671635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003384537,"stat_sum":{"num_bytes":377358,"num_objects":123,"num_object_clones":0,"num_object_copies":492,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":123,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":315,"num_write_kb":765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[{"start":"6","length":"1"},{"start":"11","length":"1"}]},{"pgid":"3.5","version":"40'65","reported_seq":161,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:09.883740+0000","last_change":"2024-02-21T23:13:03.584647+0000","last_active":"2024-02-21T23:13:09.883740+0000","last_peered":"2024-02-21T23:13:09.883740+0000","last_clean":"2024-02-21T23:13:09.883740+0000","last_became_active":"2024-02-21T23:01:03.218081+0000","last_became_peered":"2024-02-21T23:01:03.218081+0000","last_unstale":"2024-02-21T23:13:09.883740+0000","last_undegraded":"2024-02-21T23:13:09.883740+0000","last_fullsized":"2024-02-21T23:13:09.883740+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:48:40.284242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001400519,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"41'16","reported_seq":76,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-21T23:13:09.115294+0000","last_change":"2024-02-21T23:13:09.115351+0000","last_active":"2024-02-21T23:13:09.115294+0000","last_peered":"2024-02-21T23:13:09.115294+0000","last_clean":"2024-02-21T23:13:09.115294+0000","last_became_active":"2024-02-21T23:01:02.206426+0000","last_became_peered":"2024-02-21T23:01:02.206426+0000","last_unstale":"2024-02-21T23:13:09.115294+0000","last_undegraded":"2024-02-21T23:13:09.115294+0000","last_fullsized":"2024-02-21T23:13:09.115294+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'16","last_scrub_stamp":"2024-02-21T23:13:09.115194+0000","last_deep_scrub":"41'16","last_deep_scrub_stamp":"2024-02-21T23:13:09.115194+0000","last_clean_scrub_stamp":"2024-02-21T23:13:09.115194+0000","objects_scrubbed":6,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:25:39.892427+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":100431,"num_omap_keys":157,"num_objects_repaired":0},"up":[9,2],"acting":[9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"35'355","reported_seq":430,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:10.075728+0000","last_change":"2024-02-21T23:13:03.628645+0000","last_active":"2024-02-21T23:13:10.075728+0000","last_peered":"2024-02-21T23:13:10.075728+0000","last_clean":"2024-02-21T23:13:10.075728+0000","last_became_active":"2024-02-21T23:01:07.651384+0000","last_became_peered":"2024-02-21T23:01:07.651384+0000","last_unstale":"2024-02-21T23:13:10.075728+0000","last_undegraded":"2024-02-21T23:13:10.075728+0000","last_fullsized":"2024-02-21T23:13:10.075728+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:37:44.541856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040139030000000001,"stat_sum":{"num_bytes":888761,"num_objects":113,"num_object_clones":0,"num_object_copies":452,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":113,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":323,"num_write_kb":1197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"40'74","reported_seq":170,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:09.883468+0000","last_change":"2024-02-21T23:13:03.584438+0000","last_active":"2024-02-21T23:13:09.883468+0000","last_peered":"2024-02-21T23:13:09.883468+0000","last_clean":"2024-02-21T23:13:09.883468+0000","last_became_active":"2024-02-21T23:01:03.210123+0000","last_became_peered":"2024-02-21T23:01:03.210123+0000","last_unstale":"2024-02-21T23:13:09.883468+0000","last_undegraded":"2024-02-21T23:13:09.883468+0000","last_fullsized":"2024-02-21T23:13:09.883468+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:52:50.911363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015019429999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4],"acting":[10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"32'38","reported_seq":110,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-21T23:13:03.299212+0000","last_change":"2024-02-21T23:01:02.217455+0000","last_active":"2024-02-21T23:13:03.299212+0000","last_peered":"2024-02-21T23:13:03.299212+0000","last_clean":"2024-02-21T23:13:03.299212+0000","last_became_active":"2024-02-21T23:01:02.217128+0000","last_became_peered":"2024-02-21T23:01:02.217128+0000","last_unstale":"2024-02-21T23:13:03.299212+0000","last_undegraded":"2024-02-21T23:13:03.299212+0000","last_fullsized":"2024-02-21T23:13:03.299212+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:23:41.295647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":21,"num_read_kb":4097,"num_write":45,"num_write_kb":4258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"35'307","reported_seq":385,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:09.839765+0000","last_change":"2024-02-21T23:13:03.306209+0000","last_active":"2024-02-21T23:13:09.839765+0000","last_peered":"2024-02-21T23:13:09.839765+0000","last_clean":"2024-02-21T23:13:09.839765+0000","last_became_active":"2024-02-21T23:01:07.266376+0000","last_became_peered":"2024-02-21T23:01:07.266376+0000","last_unstale":"2024-02-21T23:13:09.839765+0000","last_undegraded":"2024-02-21T23:13:09.839765+0000","last_fullsized":"2024-02-21T23:13:09.839765+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":307,"log_dups_size":0,"ondisk_log_size":307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068521040000000004,"stat_sum":{"num_bytes":252650,"num_objects":112,"num_object_clones":0,"num_object_copies":448,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":112,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":278,"num_write_kb":523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"40'58","reported_seq":153,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-21T23:13:03.590626+0000","last_change":"2024-02-21T23:13:03.590626+0000","last_active":"2024-02-21T23:13:03.590626+0000","last_peered":"2024-02-21T23:13:03.590626+0000","last_clean":"2024-02-21T23:13:03.590626+0000","last_became_active":"2024-02-21T23:01:03.212019+0000","last_became_peered":"2024-02-21T23:01:03.212019+0000","last_unstale":"2024-02-21T23:13:03.590626+0000","last_undegraded":"2024-02-21T23:13:03.590626+0000","last_fullsized":"2024-02-21T23:13:03.590626+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:05:38.178836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041421360000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"6","length":"1"},{"start":"11","length":"1"}]},{"pgid":"2.1","version":"41'71","reported_seq":872,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:09.839459+0000","last_change":"2024-02-21T23:13:09.097804+0000","last_active":"2024-02-21T23:13:09.839459+0000","last_peered":"2024-02-21T23:13:09.839459+0000","last_clean":"2024-02-21T23:13:09.839459+0000","last_became_active":"2024-02-21T23:01:02.218570+0000","last_became_peered":"2024-02-21T23:01:02.218570+0000","last_unstale":"2024-02-21T23:13:09.839459+0000","last_undegraded":"2024-02-21T23:13:09.839459+0000","last_fullsized":"2024-02-21T23:13:09.839459+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'71","last_scrub_stamp":"2024-02-21T23:13:09.097624+0000","last_deep_scrub":"41'71","last_deep_scrub_stamp":"2024-02-21T23:13:09.097624+0000","last_clean_scrub_stamp":"2024-02-21T23:13:09.097624+0000","objects_scrubbed":10,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:13:44.699928+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289676,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":739,"num_read_kb":1009,"num_write":69,"num_write_kb":476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":93416,"num_omap_keys":152,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"35'326","reported_seq":403,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:09.840093+0000","last_change":"2024-02-21T23:13:03.304577+0000","last_active":"2024-02-21T23:13:09.840093+0000","last_peered":"2024-02-21T23:13:09.840093+0000","last_clean":"2024-02-21T23:13:09.840093+0000","last_became_active":"2024-02-21T23:01:07.653745+0000","last_became_peered":"2024-02-21T23:01:07.653745+0000","last_unstale":"2024-02-21T23:13:09.840093+0000","last_undegraded":"2024-02-21T23:13:09.840093+0000","last_fullsized":"2024-02-21T23:13:09.840093+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0057630249999999997,"stat_sum":{"num_bytes":1514271,"num_objects":111,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":111,"num_whiteouts":0,"num_read":1,"num_read_kb":1270,"num_write":292,"num_write_kb":1862,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"40'69","reported_seq":166,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:09.839170+0000","last_change":"2024-02-21T23:13:03.305084+0000","last_active":"2024-02-21T23:13:09.839170+0000","last_peered":"2024-02-21T23:13:09.839170+0000","last_clean":"2024-02-21T23:13:09.839170+0000","last_became_active":"2024-02-21T23:01:03.219834+0000","last_became_peered":"2024-02-21T23:01:03.219834+0000","last_unstale":"2024-02-21T23:13:09.839170+0000","last_undegraded":"2024-02-21T23:13:09.839170+0000","last_fullsized":"2024-02-21T23:13:09.839170+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0064462069999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"32'156","reported_seq":262,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-21T23:13:03.298960+0000","last_change":"2024-02-21T23:01:02.207052+0000","last_active":"2024-02-21T23:13:03.298960+0000","last_peered":"2024-02-21T23:13:03.298960+0000","last_clean":"2024-02-21T23:13:03.298960+0000","last_became_active":"2024-02-21T23:01:02.206146+0000","last_became_peered":"2024-02-21T23:01:02.206146+0000","last_unstale":"2024-02-21T23:13:03.298960+0000","last_undegraded":"2024-02-21T23:13:03.298960+0000","last_fullsized":"2024-02-21T23:13:03.298960+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:26:49.911102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":54,"num_read_kb":8202,"num_write":160,"num_write_kb":8393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"35'381","reported_seq":449,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-21T23:13:03.591190+0000","last_change":"2024-02-21T23:13:03.591643+0000","last_active":"2024-02-21T23:13:03.591190+0000","last_peered":"2024-02-21T23:13:03.591190+0000","last_clean":"2024-02-21T23:13:03.591190+0000","last_became_active":"2024-02-21T23:01:50.649190+0000","last_became_peered":"2024-02-21T23:01:50.649190+0000","last_unstale":"2024-02-21T23:13:03.591190+0000","last_undegraded":"2024-02-21T23:13:03.591190+0000","last_fullsized":"2024-02-21T23:13:03.591190+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:54:23.681083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.004903569,"stat_sum":{"num_bytes":3892244,"num_objects":109,"num_object_clones":0,"num_object_copies":436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":323,"num_write_kb":4210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,11,6,10],"acting":[5,11,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"6","length":"1"},{"start":"11","length":"1"}]},{"pgid":"3.2","version":"40'70","reported_seq":167,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:10.005926+0000","last_change":"2024-02-21T23:13:03.635295+0000","last_active":"2024-02-21T23:13:10.005926+0000","last_peered":"2024-02-21T23:13:10.005926+0000","last_clean":"2024-02-21T23:13:10.005926+0000","last_became_active":"2024-02-21T23:01:03.209007+0000","last_became_peered":"2024-02-21T23:01:03.209007+0000","last_unstale":"2024-02-21T23:13:10.005926+0000","last_undegraded":"2024-02-21T23:13:10.005926+0000","last_fullsized":"2024-02-21T23:13:10.005926+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0085662210000000006,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"32'9","reported_seq":62,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-21T23:13:03.356066+0000","last_change":"2024-02-21T23:01:02.203395+0000","last_active":"2024-02-21T23:13:03.356066+0000","last_peered":"2024-02-21T23:13:03.356066+0000","last_clean":"2024-02-21T23:13:03.356066+0000","last_became_active":"2024-02-21T23:01:02.203066+0000","last_became_peered":"2024-02-21T23:01:02.203066+0000","last_unstale":"2024-02-21T23:13:03.356066+0000","last_undegraded":"2024-02-21T23:13:03.356066+0000","last_fullsized":"2024-02-21T23:13:03.356066+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:26:49.911102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":16,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"32'148","reported_seq":285,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-21T23:13:03.299326+0000","last_change":"2024-02-21T23:00:58.830752+0000","last_active":"2024-02-21T23:13:03.299326+0000","last_peered":"2024-02-21T23:13:03.299326+0000","last_clean":"2024-02-21T23:13:03.299326+0000","last_became_active":"2024-02-21T23:00:58.830472+0000","last_became_peered":"2024-02-21T23:00:58.830472+0000","last_unstale":"2024-02-21T23:13:03.299326+0000","last_undegraded":"2024-02-21T23:13:03.299326+0000","last_fullsized":"2024-02-21T23:13:03.299326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:00:57.811198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:00:57.811198+0000","last_clean_scrub_stamp":"2024-02-21T23:00:57.811198+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:58:31.374266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"35'303","reported_seq":379,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-21T23:13:03.302343+0000","last_change":"2024-02-21T23:13:03.302700+0000","last_active":"2024-02-21T23:13:03.302343+0000","last_peered":"2024-02-21T23:13:03.302343+0000","last_clean":"2024-02-21T23:13:03.302343+0000","last_became_active":"2024-02-21T23:01:07.276489+0000","last_became_peered":"2024-02-21T23:01:07.276489+0000","last_unstale":"2024-02-21T23:13:03.302343+0000","last_undegraded":"2024-02-21T23:13:03.302343+0000","last_fullsized":"2024-02-21T23:13:03.302343+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":303,"log_dups_size":0,"ondisk_log_size":303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:43:04.363142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0031857460000000002,"stat_sum":{"num_bytes":156768,"num_objects":95,"num_object_clones":0,"num_object_copies":380,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":275,"num_write_kb":444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"6","length":"1"},{"start":"11","length":"1"}]},{"pgid":"3.d","version":"40'69","reported_seq":163,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-21T23:13:03.303092+0000","last_change":"2024-02-21T23:13:03.303339+0000","last_active":"2024-02-21T23:13:03.303092+0000","last_peered":"2024-02-21T23:13:03.303092+0000","last_clean":"2024-02-21T23:13:03.303092+0000","last_became_active":"2024-02-21T23:01:03.215904+0000","last_became_peered":"2024-02-21T23:01:03.215904+0000","last_unstale":"2024-02-21T23:13:03.303092+0000","last_undegraded":"2024-02-21T23:13:03.303092+0000","last_fullsized":"2024-02-21T23:13:03.303092+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:28:23.539623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0034327609999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"6","length":"1"},{"start":"11","length":"1"}]},{"pgid":"2.c","version":"32'10","reported_seq":64,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:09.840476+0000","last_change":"2024-02-21T23:01:02.207406+0000","last_active":"2024-02-21T23:13:09.840476+0000","last_peered":"2024-02-21T23:13:09.840476+0000","last_clean":"2024-02-21T23:13:09.840476+0000","last_became_active":"2024-02-21T23:01:02.206219+0000","last_became_peered":"2024-02-21T23:01:02.206219+0000","last_unstale":"2024-02-21T23:13:09.840476+0000","last_undegraded":"2024-02-21T23:13:09.840476+0000","last_fullsized":"2024-02-21T23:13:09.840476+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:21:29.919968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":13,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11],"acting":[2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"35'322","reported_seq":404,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:09.843951+0000","last_change":"2024-02-21T23:13:03.321521+0000","last_active":"2024-02-21T23:13:09.843951+0000","last_peered":"2024-02-21T23:13:09.843951+0000","last_clean":"2024-02-21T23:13:09.843951+0000","last_became_active":"2024-02-21T23:01:07.265401+0000","last_became_peered":"2024-02-21T23:01:07.265401+0000","last_unstale":"2024-02-21T23:13:09.843951+0000","last_undegraded":"2024-02-21T23:13:09.843951+0000","last_fullsized":"2024-02-21T23:13:09.843951+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":322,"log_dups_size":0,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021836339999999998,"stat_sum":{"num_bytes":312332,"num_objects":114,"num_object_clones":0,"num_object_copies":456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":114,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":302,"num_write_kb":592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"40'80","reported_seq":174,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-21T23:13:03.302259+0000","last_change":"2024-02-21T23:13:03.302532+0000","last_active":"2024-02-21T23:13:03.302259+0000","last_peered":"2024-02-21T23:13:03.302259+0000","last_clean":"2024-02-21T23:13:03.302259+0000","last_became_active":"2024-02-21T23:01:03.220349+0000","last_became_peered":"2024-02-21T23:01:03.220349+0000","last_unstale":"2024-02-21T23:13:03.302259+0000","last_undegraded":"2024-02-21T23:13:03.302259+0000","last_fullsized":"2024-02-21T23:13:03.302259+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:03:57.342820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003133243,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"6","length":"1"},{"start":"11","length":"1"}]},{"pgid":"2.d","version":"40'202","reported_seq":412,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-21T23:13:03.587010+0000","last_change":"2024-02-21T23:01:02.206319+0000","last_active":"2024-02-21T23:13:03.587010+0000","last_peered":"2024-02-21T23:13:03.587010+0000","last_clean":"2024-02-21T23:13:03.587010+0000","last_became_active":"2024-02-21T23:01:02.205747+0000","last_became_peered":"2024-02-21T23:01:02.205747+0000","last_unstale":"2024-02-21T23:13:03.587010+0000","last_undegraded":"2024-02-21T23:13:03.587010+0000","last_fullsized":"2024-02-21T23:13:03.587010+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:10:09.680115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":328302,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":162,"num_read_kb":161,"num_write":219,"num_write_kb":3247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10],"acting":[5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"35'347","reported_seq":423,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-21T23:13:03.519588+0000","last_change":"2024-02-21T23:13:03.519588+0000","last_active":"2024-02-21T23:13:03.519588+0000","last_peered":"2024-02-21T23:13:03.519588+0000","last_clean":"2024-02-21T23:13:03.519588+0000","last_became_active":"2024-02-21T23:01:07.280193+0000","last_became_peered":"2024-02-21T23:01:07.280193+0000","last_unstale":"2024-02-21T23:13:03.519588+0000","last_undegraded":"2024-02-21T23:13:03.519588+0000","last_fullsized":"2024-02-21T23:13:03.519588+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":347,"log_dups_size":0,"ondisk_log_size":347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003048345,"stat_sum":{"num_bytes":4515871,"num_objects":114,"num_object_clones":0,"num_object_copies":456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":114,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":315,"num_write_kb":4679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"6","length":"1"},{"start":"11","length":"1"}]},{"pgid":"3.f","version":"40'68","reported_seq":162,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-21T23:13:03.302636+0000","last_change":"2024-02-21T23:13:03.302958+0000","last_active":"2024-02-21T23:13:03.302636+0000","last_peered":"2024-02-21T23:13:03.302636+0000","last_clean":"2024-02-21T23:13:03.302636+0000","last_became_active":"2024-02-21T23:01:03.216578+0000","last_became_peered":"2024-02-21T23:01:03.216578+0000","last_unstale":"2024-02-21T23:13:03.302636+0000","last_undegraded":"2024-02-21T23:13:03.302636+0000","last_fullsized":"2024-02-21T23:13:03.302636+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:54:21.514719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0031926939999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"6","length":"1"},{"start":"11","length":"1"}]},{"pgid":"2.e","version":"42'7","reported_seq":69,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:10.121023+0000","last_change":"2024-02-21T23:13:10.121069+0000","last_active":"2024-02-21T23:13:10.121023+0000","last_peered":"2024-02-21T23:13:10.121023+0000","last_clean":"2024-02-21T23:13:10.121023+0000","last_became_active":"2024-02-21T23:01:02.220554+0000","last_became_peered":"2024-02-21T23:01:02.220554+0000","last_unstale":"2024-02-21T23:13:10.121023+0000","last_undegraded":"2024-02-21T23:13:10.121023+0000","last_fullsized":"2024-02-21T23:13:10.121023+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'7","last_scrub_stamp":"2024-02-21T23:13:10.120905+0000","last_deep_scrub":"42'7","last_deep_scrub_stamp":"2024-02-21T23:13:10.120905+0000","last_clean_scrub_stamp":"2024-02-21T23:13:10.120905+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:11:42.016697+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":14145,"num_omap_keys":23,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"35'327","reported_seq":402,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-21T23:13:03.589252+0000","last_change":"2024-02-21T23:13:03.589672+0000","last_active":"2024-02-21T23:13:03.589252+0000","last_peered":"2024-02-21T23:13:03.589252+0000","last_clean":"2024-02-21T23:13:03.589252+0000","last_became_active":"2024-02-21T23:01:07.257011+0000","last_became_peered":"2024-02-21T23:01:07.257011+0000","last_unstale":"2024-02-21T23:13:03.589252+0000","last_undegraded":"2024-02-21T23:13:03.589252+0000","last_fullsized":"2024-02-21T23:13:03.589252+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:55:20.195326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0037009130000000001,"stat_sum":{"num_bytes":448215,"num_objects":108,"num_object_clones":0,"num_object_copies":432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":292,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"6","length":"1"},{"start":"11","length":"1"}]},{"pgid":"3.e","version":"40'48","reported_seq":142,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-21T23:13:03.630705+0000","last_change":"2024-02-21T23:13:03.631008+0000","last_active":"2024-02-21T23:13:03.630705+0000","last_peered":"2024-02-21T23:13:03.630705+0000","last_clean":"2024-02-21T23:13:03.630705+0000","last_became_active":"2024-02-21T23:01:03.211467+0000","last_became_peered":"2024-02-21T23:01:03.211467+0000","last_unstale":"2024-02-21T23:13:03.630705+0000","last_undegraded":"2024-02-21T23:13:03.630705+0000","last_fullsized":"2024-02-21T23:13:03.630705+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:43:00.315064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0054206840000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[{"start":"6","length":"1"},{"start":"11","length":"1"}]},{"pgid":"2.f","version":"32'15","reported_seq":69,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:10.076394+0000","last_change":"2024-02-21T23:01:02.211763+0000","last_active":"2024-02-21T23:13:10.076394+0000","last_peered":"2024-02-21T23:13:10.076394+0000","last_clean":"2024-02-21T23:13:10.076394+0000","last_became_active":"2024-02-21T23:01:02.211470+0000","last_became_peered":"2024-02-21T23:01:02.211470+0000","last_unstale":"2024-02-21T23:13:10.076394+0000","last_undegraded":"2024-02-21T23:13:10.076394+0000","last_fullsized":"2024-02-21T23:13:10.076394+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:23:41.295647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":24,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5],"acting":[8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"35'322","reported_seq":401,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-21T23:13:03.589723+0000","last_change":"2024-02-21T23:13:03.590169+0000","last_active":"2024-02-21T23:13:03.589723+0000","last_peered":"2024-02-21T23:13:03.589723+0000","last_clean":"2024-02-21T23:13:03.589723+0000","last_became_active":"2024-02-21T23:01:07.268681+0000","last_became_peered":"2024-02-21T23:01:07.268681+0000","last_unstale":"2024-02-21T23:13:03.589723+0000","last_undegraded":"2024-02-21T23:13:03.589723+0000","last_fullsized":"2024-02-21T23:13:03.589723+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":322,"log_dups_size":0,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:43:04.363142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003843469,"stat_sum":{"num_bytes":365874,"num_objects":113,"num_object_clones":0,"num_object_copies":452,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":113,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":301,"num_write_kb":637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"6","length":"1"},{"start":"11","length":"1"}]},{"pgid":"3.11","version":"40'80","reported_seq":174,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-21T23:13:03.590622+0000","last_change":"2024-02-21T23:13:03.591089+0000","last_active":"2024-02-21T23:13:03.590622+0000","last_peered":"2024-02-21T23:13:03.590622+0000","last_clean":"2024-02-21T23:13:03.590622+0000","last_became_active":"2024-02-21T23:01:03.212634+0000","last_became_peered":"2024-02-21T23:01:03.212634+0000","last_unstale":"2024-02-21T23:13:03.590622+0000","last_undegraded":"2024-02-21T23:13:03.590622+0000","last_fullsized":"2024-02-21T23:13:03.590622+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:43:34.600230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0044168710000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"6","length":"1"},{"start":"11","length":"1"}]},{"pgid":"2.10","version":"32'26","reported_seq":80,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:10.075545+0000","last_change":"2024-02-21T23:01:02.221957+0000","last_active":"2024-02-21T23:13:10.075545+0000","last_peered":"2024-02-21T23:13:10.075545+0000","last_clean":"2024-02-21T23:13:10.075545+0000","last_became_active":"2024-02-21T23:01:02.221642+0000","last_became_peered":"2024-02-21T23:01:02.221642+0000","last_unstale":"2024-02-21T23:13:10.075545+0000","last_undegraded":"2024-02-21T23:13:10.075545+0000","last_fullsized":"2024-02-21T23:13:10.075545+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:10:09.680115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":39,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"35'397","reported_seq":457,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:09.842090+0000","last_change":"2024-02-21T23:13:03.305738+0000","last_active":"2024-02-21T23:13:09.842090+0000","last_peered":"2024-02-21T23:13:09.842090+0000","last_clean":"2024-02-21T23:13:09.842090+0000","last_became_active":"2024-02-21T23:01:07.267874+0000","last_became_peered":"2024-02-21T23:01:07.267874+0000","last_unstale":"2024-02-21T23:13:09.842090+0000","last_undegraded":"2024-02-21T23:13:09.842090+0000","last_fullsized":"2024-02-21T23:13:09.842090+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0066329539999999999,"stat_sum":{"num_bytes":500979,"num_objects":108,"num_object_clones":0,"num_object_copies":432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":334,"num_write_kb":931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"40'60","reported_seq":154,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-21T23:13:03.301870+0000","last_change":"2024-02-21T23:13:03.302220+0000","last_active":"2024-02-21T23:13:03.301870+0000","last_peered":"2024-02-21T23:13:03.301870+0000","last_clean":"2024-02-21T23:13:03.301870+0000","last_became_active":"2024-02-21T23:01:03.216466+0000","last_became_peered":"2024-02-21T23:01:03.216466+0000","last_unstale":"2024-02-21T23:13:03.301870+0000","last_undegraded":"2024-02-21T23:13:03.301870+0000","last_fullsized":"2024-02-21T23:13:03.301870+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:59:34.078282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0030070510000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"6","length":"1"},{"start":"11","length":"1"}]},{"pgid":"2.11","version":"32'14","reported_seq":765,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-21T23:13:08.834438+0000","last_change":"2024-02-21T23:01:02.199060+0000","last_active":"2024-02-21T23:13:08.834438+0000","last_peered":"2024-02-21T23:13:08.834438+0000","last_clean":"2024-02-21T23:13:08.834438+0000","last_became_active":"2024-02-21T23:01:02.198709+0000","last_became_peered":"2024-02-21T23:01:02.198709+0000","last_unstale":"2024-02-21T23:13:08.834438+0000","last_undegraded":"2024-02-21T23:13:08.834438+0000","last_fullsized":"2024-02-21T23:13:08.834438+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:36:44.497886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1124,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":701,"num_read_kb":5,"num_write":18,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"35'357","reported_seq":423,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-21T23:13:03.634696+0000","last_change":"2024-02-21T23:13:03.634696+0000","last_active":"2024-02-21T23:13:03.634696+0000","last_peered":"2024-02-21T23:13:03.634696+0000","last_clean":"2024-02-21T23:13:03.634696+0000","last_became_active":"2024-02-21T23:01:07.277289+0000","last_became_peered":"2024-02-21T23:01:07.277289+0000","last_unstale":"2024-02-21T23:13:03.634696+0000","last_undegraded":"2024-02-21T23:13:03.634696+0000","last_fullsized":"2024-02-21T23:13:03.634696+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0038048510000000002,"stat_sum":{"num_bytes":280914,"num_objects":98,"num_object_clones":0,"num_object_copies":392,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":308,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[{"start":"6","length":"1"},{"start":"11","length":"1"}]},{"pgid":"3.13","version":"40'84","reported_seq":178,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-21T23:13:03.301988+0000","last_change":"2024-02-21T23:13:03.302296+0000","last_active":"2024-02-21T23:13:03.301988+0000","last_peered":"2024-02-21T23:13:03.301988+0000","last_clean":"2024-02-21T23:13:03.301988+0000","last_became_active":"2024-02-21T23:01:03.214507+0000","last_became_peered":"2024-02-21T23:01:03.214507+0000","last_unstale":"2024-02-21T23:13:03.301988+0000","last_undegraded":"2024-02-21T23:13:03.301988+0000","last_fullsized":"2024-02-21T23:13:03.301988+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:55:16.147248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003048425,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"6","length":"1"},{"start":"11","length":"1"}]},{"pgid":"2.12","version":"32'15","reported_seq":66,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-21T23:13:03.586554+0000","last_change":"2024-02-21T23:01:02.209351+0000","last_active":"2024-02-21T23:13:03.586554+0000","last_peered":"2024-02-21T23:13:03.586554+0000","last_clean":"2024-02-21T23:13:03.586554+0000","last_became_active":"2024-02-21T23:01:02.208990+0000","last_became_peered":"2024-02-21T23:01:02.208990+0000","last_unstale":"2024-02-21T23:13:03.586554+0000","last_undegraded":"2024-02-21T23:13:03.586554+0000","last_fullsized":"2024-02-21T23:13:03.586554+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:36:44.497886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"35'314","reported_seq":389,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-21T23:13:03.629364+0000","last_change":"2024-02-21T23:13:03.629828+0000","last_active":"2024-02-21T23:13:03.629364+0000","last_peered":"2024-02-21T23:13:03.629364+0000","last_clean":"2024-02-21T23:13:03.629364+0000","last_became_active":"2024-02-21T23:01:50.649153+0000","last_became_peered":"2024-02-21T23:01:50.649153+0000","last_unstale":"2024-02-21T23:13:03.629364+0000","last_undegraded":"2024-02-21T23:13:03.629364+0000","last_fullsized":"2024-02-21T23:13:03.629364+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":314,"log_dups_size":0,"ondisk_log_size":314,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:00:12.550112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0055873019999999997,"stat_sum":{"num_bytes":262334,"num_objects":113,"num_object_clones":0,"num_object_copies":452,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":113,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":267,"num_write_kb":565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,7,6],"acting":[11,8,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[{"start":"6","length":"1"},{"start":"11","length":"1"}]},{"pgid":"3.12","version":"40'62","reported_seq":159,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:09.839379+0000","last_change":"2024-02-21T23:13:03.307050+0000","last_active":"2024-02-21T23:13:09.839379+0000","last_peered":"2024-02-21T23:13:09.839379+0000","last_clean":"2024-02-21T23:13:09.839379+0000","last_became_active":"2024-02-21T23:01:03.224451+0000","last_became_peered":"2024-02-21T23:01:03.224451+0000","last_unstale":"2024-02-21T23:13:09.839379+0000","last_undegraded":"2024-02-21T23:13:09.839379+0000","last_fullsized":"2024-02-21T23:13:09.839379+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0075807410000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"41'157","reported_seq":759,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:09.840079+0000","last_change":"2024-02-21T23:01:02.203410+0000","last_active":"2024-02-21T23:13:09.840079+0000","last_peered":"2024-02-21T23:13:09.840079+0000","last_clean":"2024-02-21T23:13:09.840079+0000","last_became_active":"2024-02-21T23:01:02.203081+0000","last_became_peered":"2024-02-21T23:01:02.203081+0000","last_unstale":"2024-02-21T23:13:09.840079+0000","last_undegraded":"2024-02-21T23:13:09.840079+0000","last_fullsized":"2024-02-21T23:13:09.840079+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:36:44.497886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8064145,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":549,"num_read_kb":7906,"num_write":162,"num_write_kb":8023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10],"acting":[2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"35'326","reported_seq":397,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-21T23:13:03.590677+0000","last_change":"2024-02-21T23:13:03.591118+0000","last_active":"2024-02-21T23:13:03.590677+0000","last_peered":"2024-02-21T23:13:03.590677+0000","last_clean":"2024-02-21T23:13:03.590677+0000","last_became_active":"2024-02-21T23:01:07.268436+0000","last_became_peered":"2024-02-21T23:01:07.268436+0000","last_unstale":"2024-02-21T23:13:03.590677+0000","last_undegraded":"2024-02-21T23:13:03.590677+0000","last_fullsized":"2024-02-21T23:13:03.590677+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:28:27.587700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0044097060000000002,"stat_sum":{"num_bytes":527021,"num_objects":97,"num_object_clones":0,"num_object_copies":388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":97,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":289,"num_write_kb":781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"6","length":"1"},{"start":"11","length":"1"}]},{"pgid":"3.15","version":"40'68","reported_seq":164,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:10.076069+0000","last_change":"2024-02-21T23:13:03.629499+0000","last_active":"2024-02-21T23:13:10.076069+0000","last_peered":"2024-02-21T23:13:10.076069+0000","last_clean":"2024-02-21T23:13:10.076069+0000","last_became_active":"2024-02-21T23:01:03.215888+0000","last_became_peered":"2024-02-21T23:01:03.215888+0000","last_unstale":"2024-02-21T23:13:10.076069+0000","last_undegraded":"2024-02-21T23:13:10.076069+0000","last_fullsized":"2024-02-21T23:13:10.076069+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:57:33.130105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036458770000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"40'104","reported_seq":1056,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:09.883559+0000","last_change":"2024-02-21T23:01:02.204595+0000","last_active":"2024-02-21T23:13:09.883559+0000","last_peered":"2024-02-21T23:13:09.883559+0000","last_clean":"2024-02-21T23:13:09.883559+0000","last_became_active":"2024-02-21T23:01:02.204123+0000","last_became_peered":"2024-02-21T23:01:02.204123+0000","last_unstale":"2024-02-21T23:13:09.883559+0000","last_undegraded":"2024-02-21T23:13:09.883559+0000","last_fullsized":"2024-02-21T23:13:09.883559+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:36:44.497886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":899,"num_read_kb":4829,"num_write":112,"num_write_kb":4275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1],"acting":[10,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"35'330","reported_seq":404,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-21T23:13:03.634440+0000","last_change":"2024-02-21T23:13:03.634440+0000","last_active":"2024-02-21T23:13:03.634440+0000","last_peered":"2024-02-21T23:13:03.634440+0000","last_clean":"2024-02-21T23:13:03.634440+0000","last_became_active":"2024-02-21T23:01:07.265618+0000","last_became_peered":"2024-02-21T23:01:07.265618+0000","last_unstale":"2024-02-21T23:13:03.634440+0000","last_undegraded":"2024-02-21T23:13:03.634440+0000","last_fullsized":"2024-02-21T23:13:03.634440+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":330,"log_dups_size":0,"ondisk_log_size":330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0045476609999999997,"stat_sum":{"num_bytes":397479,"num_objects":108,"num_object_clones":0,"num_object_copies":432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":298,"num_write_kb":795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[{"start":"6","length":"1"},{"start":"11","length":"1"}]},{"pgid":"3.14","version":"40'66","reported_seq":163,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:09.844262+0000","last_change":"2024-02-21T23:13:03.322290+0000","last_active":"2024-02-21T23:13:09.844262+0000","last_peered":"2024-02-21T23:13:09.844262+0000","last_clean":"2024-02-21T23:13:09.844262+0000","last_became_active":"2024-02-21T23:01:03.214580+0000","last_became_peered":"2024-02-21T23:01:03.214580+0000","last_unstale":"2024-02-21T23:13:09.844262+0000","last_undegraded":"2024-02-21T23:13:09.844262+0000","last_fullsized":"2024-02-21T23:13:09.844262+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022134519999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8],"acting":[1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"32'33","reported_seq":85,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-21T23:13:03.586944+0000","last_change":"2024-02-21T23:01:02.222064+0000","last_active":"2024-02-21T23:13:03.586944+0000","last_peered":"2024-02-21T23:13:03.586944+0000","last_clean":"2024-02-21T23:13:03.586944+0000","last_became_active":"2024-02-21T23:01:02.221735+0000","last_became_peered":"2024-02-21T23:01:02.221735+0000","last_unstale":"2024-02-21T23:13:03.586944+0000","last_undegraded":"2024-02-21T23:13:03.586944+0000","last_fullsized":"2024-02-21T23:13:03.586944+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:23:41.295647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":43,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"35'359","reported_seq":422,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-21T23:13:03.358457+0000","last_change":"2024-02-21T23:13:03.358767+0000","last_active":"2024-02-21T23:13:03.358457+0000","last_peered":"2024-02-21T23:13:03.358457+0000","last_clean":"2024-02-21T23:13:03.358457+0000","last_became_active":"2024-02-21T23:01:07.275982+0000","last_became_peered":"2024-02-21T23:01:07.275982+0000","last_unstale":"2024-02-21T23:13:03.358457+0000","last_undegraded":"2024-02-21T23:13:03.358457+0000","last_fullsized":"2024-02-21T23:13:03.358457+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:28:27.587700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0033710960000000001,"stat_sum":{"num_bytes":644576,"num_objects":99,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":303,"num_write_kb":1079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"6","length":"1"},{"start":"11","length":"1"}]},{"pgid":"3.17","version":"40'78","reported_seq":173,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-21T23:13:06.137782+0000","last_change":"2024-02-21T23:13:03.522059+0000","last_active":"2024-02-21T23:13:06.137782+0000","last_peered":"2024-02-21T23:13:06.137782+0000","last_clean":"2024-02-21T23:13:06.137782+0000","last_became_active":"2024-02-21T23:01:03.229193+0000","last_became_peered":"2024-02-21T23:01:03.229193+0000","last_unstale":"2024-02-21T23:13:06.137782+0000","last_undegraded":"2024-02-21T23:13:06.137782+0000","last_fullsized":"2024-02-21T23:13:06.137782+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041575850000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"6","length":"1"},{"start":"11","length":"1"}]},{"pgid":"2.16","version":"32'3","reported_seq":54,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-21T23:13:03.299521+0000","last_change":"2024-02-21T23:01:02.197598+0000","last_active":"2024-02-21T23:13:03.299521+0000","last_peered":"2024-02-21T23:13:03.299521+0000","last_clean":"2024-02-21T23:13:03.299521+0000","last_became_active":"2024-02-21T23:01:02.197275+0000","last_became_peered":"2024-02-21T23:01:02.197275+0000","last_unstale":"2024-02-21T23:13:03.299521+0000","last_undegraded":"2024-02-21T23:13:03.299521+0000","last_fullsized":"2024-02-21T23:13:03.299521+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:36:44.497886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"35'338","reported_seq":409,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:10.075751+0000","last_change":"2024-02-21T23:13:03.628108+0000","last_active":"2024-02-21T23:13:10.075751+0000","last_peered":"2024-02-21T23:13:10.075751+0000","last_clean":"2024-02-21T23:13:10.075751+0000","last_became_active":"2024-02-21T23:01:50.554591+0000","last_became_peered":"2024-02-21T23:01:50.554591+0000","last_unstale":"2024-02-21T23:13:10.075751+0000","last_undegraded":"2024-02-21T23:13:10.075751+0000","last_fullsized":"2024-02-21T23:13:10.075751+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:03:34.064139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039370250000000002,"stat_sum":{"num_bytes":332054,"num_objects":124,"num_object_clones":0,"num_object_copies":496,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":124,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":310,"num_write_kb":722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2,4],"acting":[8,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.16","version":"40'88","reported_seq":185,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:09.844350+0000","last_change":"2024-02-21T23:13:03.321843+0000","last_active":"2024-02-21T23:13:09.844350+0000","last_peered":"2024-02-21T23:13:09.844350+0000","last_clean":"2024-02-21T23:13:09.844350+0000","last_became_active":"2024-02-21T23:01:03.215004+0000","last_became_peered":"2024-02-21T23:01:03.215004+0000","last_unstale":"2024-02-21T23:13:09.844350+0000","last_undegraded":"2024-02-21T23:13:09.844350+0000","last_fullsized":"2024-02-21T23:13:09.844350+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00222376,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"40'16","reported_seq":765,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:09.883786+0000","last_change":"2024-02-21T23:01:02.207663+0000","last_active":"2024-02-21T23:13:09.883786+0000","last_peered":"2024-02-21T23:13:09.883786+0000","last_clean":"2024-02-21T23:13:09.883786+0000","last_became_active":"2024-02-21T23:01:02.207349+0000","last_became_peered":"2024-02-21T23:01:02.207349+0000","last_unstale":"2024-02-21T23:13:09.883786+0000","last_undegraded":"2024-02-21T23:13:09.883786+0000","last_fullsized":"2024-02-21T23:13:09.883786+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:21:29.919968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":696,"num_read_kb":696,"num_write":22,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5],"acting":[10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"35'344","reported_seq":417,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:10.005529+0000","last_change":"2024-02-21T23:13:03.634090+0000","last_active":"2024-02-21T23:13:10.005529+0000","last_peered":"2024-02-21T23:13:10.005529+0000","last_clean":"2024-02-21T23:13:10.005529+0000","last_became_active":"2024-02-21T23:01:07.268193+0000","last_became_peered":"2024-02-21T23:01:07.268193+0000","last_unstale":"2024-02-21T23:13:10.005529+0000","last_undegraded":"2024-02-21T23:13:10.005529+0000","last_fullsized":"2024-02-21T23:13:10.005529+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0080841690000000004,"stat_sum":{"num_bytes":737229,"num_objects":93,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":303,"num_write_kb":1054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"35'297","reported_seq":374,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-21T23:13:03.520848+0000","last_change":"2024-02-21T23:13:03.520848+0000","last_active":"2024-02-21T23:13:03.520848+0000","last_peered":"2024-02-21T23:13:03.520848+0000","last_clean":"2024-02-21T23:13:03.520848+0000","last_became_active":"2024-02-21T23:01:07.271175+0000","last_became_peered":"2024-02-21T23:01:07.271175+0000","last_unstale":"2024-02-21T23:13:03.520848+0000","last_undegraded":"2024-02-21T23:13:03.520848+0000","last_fullsized":"2024-02-21T23:13:03.520848+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0039500689999999996,"stat_sum":{"num_bytes":430239,"num_objects":97,"num_object_clones":0,"num_object_copies":388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":97,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":271,"num_write_kb":710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"6","length":"1"},{"start":"11","length":"1"}]},{"pgid":"3.19","version":"40'84","reported_seq":178,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-21T23:13:03.629552+0000","last_change":"2024-02-21T23:13:03.629552+0000","last_active":"2024-02-21T23:13:03.629552+0000","last_peered":"2024-02-21T23:13:03.629552+0000","last_clean":"2024-02-21T23:13:03.629552+0000","last_became_active":"2024-02-21T23:01:03.210599+0000","last_became_peered":"2024-02-21T23:01:03.210599+0000","last_unstale":"2024-02-21T23:13:03.629552+0000","last_undegraded":"2024-02-21T23:13:03.629552+0000","last_fullsized":"2024-02-21T23:13:03.629552+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022244510000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[{"start":"6","length":"1"},{"start":"11","length":"1"}]},{"pgid":"2.18","version":"32'10","reported_seq":61,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-21T23:13:03.587007+0000","last_change":"2024-02-21T23:01:02.204603+0000","last_active":"2024-02-21T23:13:03.587007+0000","last_peered":"2024-02-21T23:13:03.587007+0000","last_clean":"2024-02-21T23:13:03.587007+0000","last_became_active":"2024-02-21T23:01:02.204304+0000","last_became_peered":"2024-02-21T23:01:02.204304+0000","last_unstale":"2024-02-21T23:13:03.587007+0000","last_undegraded":"2024-02-21T23:13:03.587007+0000","last_fullsized":"2024-02-21T23:13:03.587007+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:58:23.554457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"35'308","reported_seq":384,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-21T23:13:03.629944+0000","last_change":"2024-02-21T23:13:03.630369+0000","last_active":"2024-02-21T23:13:03.629944+0000","last_peered":"2024-02-21T23:13:03.629944+0000","last_clean":"2024-02-21T23:13:03.629944+0000","last_became_active":"2024-02-21T23:01:07.283568+0000","last_became_peered":"2024-02-21T23:01:07.283568+0000","last_unstale":"2024-02-21T23:13:03.629944+0000","last_undegraded":"2024-02-21T23:13:03.629944+0000","last_fullsized":"2024-02-21T23:13:03.629944+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":308,"log_dups_size":0,"ondisk_log_size":308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:59:38.126360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0050747270000000002,"stat_sum":{"num_bytes":444936,"num_objects":124,"num_object_clones":0,"num_object_copies":496,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":124,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":282,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[{"start":"6","length":"1"},{"start":"11","length":"1"}]},{"pgid":"3.18","version":"40'95","reported_seq":192,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:10.005136+0000","last_change":"2024-02-21T23:13:03.636668+0000","last_active":"2024-02-21T23:13:10.005136+0000","last_peered":"2024-02-21T23:13:10.005136+0000","last_clean":"2024-02-21T23:13:10.005136+0000","last_became_active":"2024-02-21T23:01:03.208141+0000","last_became_peered":"2024-02-21T23:01:03.208141+0000","last_unstale":"2024-02-21T23:13:10.005136+0000","last_undegraded":"2024-02-21T23:13:10.005136+0000","last_fullsized":"2024-02-21T23:13:10.005136+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0090850089999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"41'29","reported_seq":96,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:09.839342+0000","last_change":"2024-02-21T23:13:08.125951+0000","last_active":"2024-02-21T23:13:09.839342+0000","last_peered":"2024-02-21T23:13:09.839342+0000","last_clean":"2024-02-21T23:13:09.839342+0000","last_became_active":"2024-02-21T23:01:02.218499+0000","last_became_peered":"2024-02-21T23:01:02.218499+0000","last_unstale":"2024-02-21T23:13:09.839342+0000","last_undegraded":"2024-02-21T23:13:09.839342+0000","last_fullsized":"2024-02-21T23:13:09.839342+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'29","last_scrub_stamp":"2024-02-21T23:13:08.125776+0000","last_deep_scrub":"41'29","last_deep_scrub_stamp":"2024-02-21T23:13:08.125776+0000","last_clean_scrub_stamp":"2024-02-21T23:13:08.125776+0000","objects_scrubbed":9,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:12:14.445320+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62737,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":6,"num_read_kb":64,"num_write":27,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":63337,"num_omap_keys":103,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"32'47","reported_seq":120,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:09.883423+0000","last_change":"2024-02-21T23:01:02.209061+0000","last_active":"2024-02-21T23:13:09.883423+0000","last_peered":"2024-02-21T23:13:09.883423+0000","last_clean":"2024-02-21T23:13:09.883423+0000","last_became_active":"2024-02-21T23:01:02.208779+0000","last_became_peered":"2024-02-21T23:01:02.208779+0000","last_unstale":"2024-02-21T23:13:09.883423+0000","last_undegraded":"2024-02-21T23:13:09.883423+0000","last_fullsized":"2024-02-21T23:13:09.883423+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:17:06.353018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":4098,"num_write":52,"num_write_kb":4233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8],"acting":[10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"40'78","reported_seq":171,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-21T23:13:03.590254+0000","last_change":"2024-02-21T23:13:03.590567+0000","last_active":"2024-02-21T23:13:03.590254+0000","last_peered":"2024-02-21T23:13:03.590254+0000","last_clean":"2024-02-21T23:13:03.590254+0000","last_became_active":"2024-02-21T23:01:03.212560+0000","last_became_peered":"2024-02-21T23:01:03.212560+0000","last_unstale":"2024-02-21T23:13:03.590254+0000","last_undegraded":"2024-02-21T23:13:03.590254+0000","last_fullsized":"2024-02-21T23:13:03.590254+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:54:21.514719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040607100000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"6","length":"1"},{"start":"11","length":"1"}]},{"pgid":"4.1c","version":"35'328","reported_seq":399,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:09.839928+0000","last_change":"2024-02-21T23:13:03.301928+0000","last_active":"2024-02-21T23:13:09.839928+0000","last_peered":"2024-02-21T23:13:09.839928+0000","last_clean":"2024-02-21T23:13:09.839928+0000","last_became_active":"2024-02-21T23:01:07.267796+0000","last_became_peered":"2024-02-21T23:01:07.267796+0000","last_unstale":"2024-02-21T23:13:09.839928+0000","last_undegraded":"2024-02-21T23:13:09.839928+0000","last_fullsized":"2024-02-21T23:13:09.839928+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:17:18.693596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0029824690000000002,"stat_sum":{"num_bytes":212072,"num_objects":97,"num_object_clones":0,"num_object_copies":388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":97,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":291,"num_write_kb":1346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"40'88","reported_seq":1386,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-21T23:13:08.770311+0000","last_change":"2024-02-21T23:01:02.206398+0000","last_active":"2024-02-21T23:13:08.770311+0000","last_peered":"2024-02-21T23:13:08.770311+0000","last_clean":"2024-02-21T23:13:08.770311+0000","last_became_active":"2024-02-21T23:01:02.206069+0000","last_became_peered":"2024-02-21T23:01:02.206069+0000","last_unstale":"2024-02-21T23:13:08.770311+0000","last_undegraded":"2024-02-21T23:13:08.770311+0000","last_fullsized":"2024-02-21T23:13:08.770311+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:01.174601+0000","last_clean_scrub_stamp":"2024-02-21T23:01:01.174601+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:26:49.911102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9892502,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":1248,"num_read_kb":9675,"num_write":93,"num_write_kb":9840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"40'68","reported_seq":163,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:10.076215+0000","last_change":"2024-02-21T23:13:03.629023+0000","last_active":"2024-02-21T23:13:10.076215+0000","last_peered":"2024-02-21T23:13:10.076215+0000","last_clean":"2024-02-21T23:13:10.076215+0000","last_became_active":"2024-02-21T23:01:03.220900+0000","last_became_peered":"2024-02-21T23:01:03.220900+0000","last_unstale":"2024-02-21T23:13:10.076215+0000","last_undegraded":"2024-02-21T23:13:10.076215+0000","last_fullsized":"2024-02-21T23:13:10.076215+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:13:32.959723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040531330000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9],"acting":[8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"35'336","reported_seq":406,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:09.840384+0000","last_change":"2024-02-21T23:13:03.302724+0000","last_active":"2024-02-21T23:13:09.840384+0000","last_peered":"2024-02-21T23:13:09.840384+0000","last_clean":"2024-02-21T23:13:09.840384+0000","last_became_active":"2024-02-21T23:01:07.256474+0000","last_became_peered":"2024-02-21T23:01:07.256474+0000","last_unstale":"2024-02-21T23:13:09.840384+0000","last_undegraded":"2024-02-21T23:13:09.840384+0000","last_fullsized":"2024-02-21T23:13:09.840384+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:06.230568+0000","last_clean_scrub_stamp":"2024-02-21T23:01:06.230568+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:08:39.367472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0033662710000000001,"stat_sum":{"num_bytes":406297,"num_objects":103,"num_object_clones":0,"num_object_copies":412,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":293,"num_write_kb":672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"40'83","reported_seq":177,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-21T23:13:03.630762+0000","last_change":"2024-02-21T23:13:03.631027+0000","last_active":"2024-02-21T23:13:03.630762+0000","last_peered":"2024-02-21T23:13:03.630762+0000","last_clean":"2024-02-21T23:13:03.630762+0000","last_became_active":"2024-02-21T23:01:03.215461+0000","last_became_peered":"2024-02-21T23:01:03.215461+0000","last_unstale":"2024-02-21T23:13:03.630762+0000","last_undegraded":"2024-02-21T23:13:03.630762+0000","last_fullsized":"2024-02-21T23:13:03.630762+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:05:38.178836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0051664090000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[{"start":"6","length":"1"},{"start":"11","length":"1"}]},{"pgid":"3.21","version":"40'98","reported_seq":194,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:09.840336+0000","last_change":"2024-02-21T23:13:03.303223+0000","last_active":"2024-02-21T23:13:09.840336+0000","last_peered":"2024-02-21T23:13:09.840336+0000","last_clean":"2024-02-21T23:13:09.840336+0000","last_became_active":"2024-02-21T23:01:03.215639+0000","last_became_peered":"2024-02-21T23:01:03.215639+0000","last_unstale":"2024-02-21T23:13:09.840336+0000","last_undegraded":"2024-02-21T23:13:09.840336+0000","last_fullsized":"2024-02-21T23:13:09.840336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:21:18.135145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0038139580000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"40'76","reported_seq":172,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:09.839842+0000","last_change":"2024-02-21T23:13:03.302366+0000","last_active":"2024-02-21T23:13:09.839842+0000","last_peered":"2024-02-21T23:13:09.839842+0000","last_clean":"2024-02-21T23:13:09.839842+0000","last_became_active":"2024-02-21T23:01:03.218377+0000","last_became_peered":"2024-02-21T23:01:03.218377+0000","last_unstale":"2024-02-21T23:13:09.839842+0000","last_undegraded":"2024-02-21T23:13:09.839842+0000","last_fullsized":"2024-02-21T23:13:09.839842+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:44:41.758734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0034104930000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"40'76","reported_seq":179,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-21T23:13:09.455413+0000","last_change":"2024-02-21T23:13:09.455456+0000","last_active":"2024-02-21T23:13:09.455413+0000","last_peered":"2024-02-21T23:13:09.455413+0000","last_clean":"2024-02-21T23:13:09.455413+0000","last_became_active":"2024-02-21T23:01:03.225085+0000","last_became_peered":"2024-02-21T23:01:03.225085+0000","last_unstale":"2024-02-21T23:13:09.455413+0000","last_undegraded":"2024-02-21T23:13:09.455413+0000","last_fullsized":"2024-02-21T23:13:09.455413+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'76","last_scrub_stamp":"2024-02-21T23:13:09.455289+0000","last_deep_scrub":"40'76","last_deep_scrub_stamp":"2024-02-21T23:13:09.455289+0000","last_clean_scrub_stamp":"2024-02-21T23:13:09.455289+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:53:00.615324+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.0039260240000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"6","length":"1"},{"start":"11","length":"1"}]},{"pgid":"3.24","version":"40'54","reported_seq":151,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:09.839966+0000","last_change":"2024-02-21T23:13:03.306221+0000","last_active":"2024-02-21T23:13:09.839966+0000","last_peered":"2024-02-21T23:13:09.839966+0000","last_clean":"2024-02-21T23:13:09.839966+0000","last_became_active":"2024-02-21T23:01:03.225925+0000","last_became_peered":"2024-02-21T23:01:03.225925+0000","last_unstale":"2024-02-21T23:13:09.839966+0000","last_undegraded":"2024-02-21T23:13:09.839966+0000","last_fullsized":"2024-02-21T23:13:09.839966+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.006870653,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"40'71","reported_seq":165,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-21T23:13:03.629788+0000","last_change":"2024-02-21T23:13:03.630273+0000","last_active":"2024-02-21T23:13:03.629788+0000","last_peered":"2024-02-21T23:13:03.629788+0000","last_clean":"2024-02-21T23:13:03.629788+0000","last_became_active":"2024-02-21T23:01:03.214488+0000","last_became_peered":"2024-02-21T23:01:03.214488+0000","last_unstale":"2024-02-21T23:13:03.629788+0000","last_undegraded":"2024-02-21T23:13:03.629788+0000","last_fullsized":"2024-02-21T23:13:03.629788+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:52:14.521309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0056728819999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8],"acting":[11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[{"start":"6","length":"1"},{"start":"11","length":"1"}]},{"pgid":"3.26","version":"40'93","reported_seq":189,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:09.840426+0000","last_change":"2024-02-21T23:13:03.302782+0000","last_active":"2024-02-21T23:13:09.840426+0000","last_peered":"2024-02-21T23:13:09.840426+0000","last_clean":"2024-02-21T23:13:09.840426+0000","last_became_active":"2024-02-21T23:01:03.208458+0000","last_became_peered":"2024-02-21T23:01:03.208458+0000","last_unstale":"2024-02-21T23:13:09.840426+0000","last_undegraded":"2024-02-21T23:13:09.840426+0000","last_fullsized":"2024-02-21T23:13:09.840426+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:00:49.885643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003379922,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8],"acting":[2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"40'56","reported_seq":161,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:10.006704+0000","last_change":"2024-02-21T23:13:09.015577+0000","last_active":"2024-02-21T23:13:10.006704+0000","last_peered":"2024-02-21T23:13:10.006704+0000","last_clean":"2024-02-21T23:13:10.006704+0000","last_became_active":"2024-02-21T23:01:03.206376+0000","last_became_peered":"2024-02-21T23:01:03.206376+0000","last_unstale":"2024-02-21T23:13:10.006704+0000","last_undegraded":"2024-02-21T23:13:10.006704+0000","last_fullsized":"2024-02-21T23:13:10.006704+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'56","last_scrub_stamp":"2024-02-21T23:13:09.015385+0000","last_deep_scrub":"40'56","last_deep_scrub_stamp":"2024-02-21T23:13:09.015385+0000","last_clean_scrub_stamp":"2024-02-21T23:13:09.015385+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:19:03.199560+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.0081511220000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"40'66","reported_seq":160,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-21T23:13:03.589551+0000","last_change":"2024-02-21T23:13:03.590059+0000","last_active":"2024-02-21T23:13:03.589551+0000","last_peered":"2024-02-21T23:13:03.589551+0000","last_clean":"2024-02-21T23:13:03.589551+0000","last_became_active":"2024-02-21T23:01:03.214922+0000","last_became_peered":"2024-02-21T23:01:03.214922+0000","last_unstale":"2024-02-21T23:13:03.589551+0000","last_undegraded":"2024-02-21T23:13:03.589551+0000","last_fullsized":"2024-02-21T23:13:03.589551+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:03:57.342820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0037744219999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"6","length":"1"},{"start":"11","length":"1"}]},{"pgid":"3.29","version":"40'75","reported_seq":172,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:10.005304+0000","last_change":"2024-02-21T23:13:03.632777+0000","last_active":"2024-02-21T23:13:10.005304+0000","last_peered":"2024-02-21T23:13:10.005304+0000","last_clean":"2024-02-21T23:13:10.005304+0000","last_became_active":"2024-02-21T23:01:03.213428+0000","last_became_peered":"2024-02-21T23:01:03.213428+0000","last_unstale":"2024-02-21T23:13:10.005304+0000","last_undegraded":"2024-02-21T23:13:10.005304+0000","last_fullsized":"2024-02-21T23:13:10.005304+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0068692420000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"40'77","reported_seq":174,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:09.844303+0000","last_change":"2024-02-21T23:13:03.321620+0000","last_active":"2024-02-21T23:13:09.844303+0000","last_peered":"2024-02-21T23:13:09.844303+0000","last_clean":"2024-02-21T23:13:09.844303+0000","last_became_active":"2024-02-21T23:01:03.215580+0000","last_became_peered":"2024-02-21T23:01:03.215580+0000","last_unstale":"2024-02-21T23:13:09.844303+0000","last_undegraded":"2024-02-21T23:13:09.844303+0000","last_fullsized":"2024-02-21T23:13:09.844303+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021775449999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"40'74","reported_seq":171,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:09.839450+0000","last_change":"2024-02-21T23:13:03.305586+0000","last_active":"2024-02-21T23:13:09.839450+0000","last_peered":"2024-02-21T23:13:09.839450+0000","last_clean":"2024-02-21T23:13:09.839450+0000","last_became_active":"2024-02-21T23:01:03.223861+0000","last_became_peered":"2024-02-21T23:01:03.223861+0000","last_unstale":"2024-02-21T23:13:09.839450+0000","last_undegraded":"2024-02-21T23:13:09.839450+0000","last_fullsized":"2024-02-21T23:13:09.839450+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0064779520000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"40'80","reported_seq":174,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-21T23:13:03.629304+0000","last_change":"2024-02-21T23:13:03.629720+0000","last_active":"2024-02-21T23:13:03.629304+0000","last_peered":"2024-02-21T23:13:03.629304+0000","last_clean":"2024-02-21T23:13:03.629304+0000","last_became_active":"2024-02-21T23:01:03.212691+0000","last_became_peered":"2024-02-21T23:01:03.212691+0000","last_unstale":"2024-02-21T23:13:03.629304+0000","last_undegraded":"2024-02-21T23:13:03.629304+0000","last_fullsized":"2024-02-21T23:13:03.629304+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:01:37.784795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0052158400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[{"start":"6","length":"1"},{"start":"11","length":"1"}]},{"pgid":"3.2d","version":"40'78","reported_seq":174,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:09.840363+0000","last_change":"2024-02-21T23:13:03.303314+0000","last_active":"2024-02-21T23:13:09.840363+0000","last_peered":"2024-02-21T23:13:09.840363+0000","last_clean":"2024-02-21T23:13:09.840363+0000","last_became_active":"2024-02-21T23:01:03.217613+0000","last_became_peered":"2024-02-21T23:01:03.217613+0000","last_unstale":"2024-02-21T23:13:09.840363+0000","last_undegraded":"2024-02-21T23:13:09.840363+0000","last_fullsized":"2024-02-21T23:13:09.840363+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:33:50.180443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0037090880000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"40'75","reported_seq":170,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-21T23:13:03.633776+0000","last_change":"2024-02-21T23:13:03.633776+0000","last_active":"2024-02-21T23:13:03.633776+0000","last_peered":"2024-02-21T23:13:03.633776+0000","last_clean":"2024-02-21T23:13:03.633776+0000","last_became_active":"2024-02-21T23:01:03.214165+0000","last_became_peered":"2024-02-21T23:01:03.214165+0000","last_unstale":"2024-02-21T23:13:03.633776+0000","last_undegraded":"2024-02-21T23:13:03.633776+0000","last_fullsized":"2024-02-21T23:13:03.633776+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0049436819999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1],"acting":[9,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[{"start":"6","length":"1"},{"start":"11","length":"1"}]},{"pgid":"3.2f","version":"40'60","reported_seq":154,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-21T23:13:03.630418+0000","last_change":"2024-02-21T23:13:03.630653+0000","last_active":"2024-02-21T23:13:03.630418+0000","last_peered":"2024-02-21T23:13:03.630418+0000","last_clean":"2024-02-21T23:13:03.630418+0000","last_became_active":"2024-02-21T23:01:03.213755+0000","last_became_peered":"2024-02-21T23:01:03.213755+0000","last_unstale":"2024-02-21T23:13:03.630418+0000","last_undegraded":"2024-02-21T23:13:03.630418+0000","last_fullsized":"2024-02-21T23:13:03.630418+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:03:57.342820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0051223900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[{"start":"6","length":"1"},{"start":"11","length":"1"}]},{"pgid":"3.30","version":"40'82","reported_seq":179,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:09.843920+0000","last_change":"2024-02-21T23:13:03.321056+0000","last_active":"2024-02-21T23:13:09.843920+0000","last_peered":"2024-02-21T23:13:09.843920+0000","last_clean":"2024-02-21T23:13:09.843920+0000","last_became_active":"2024-02-21T23:01:03.216345+0000","last_became_peered":"2024-02-21T23:01:03.216345+0000","last_unstale":"2024-02-21T23:13:09.843920+0000","last_undegraded":"2024-02-21T23:13:09.843920+0000","last_fullsized":"2024-02-21T23:13:09.843920+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017199909999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"40'82","reported_seq":177,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-21T23:13:03.519420+0000","last_change":"2024-02-21T23:13:03.519420+0000","last_active":"2024-02-21T23:13:03.519420+0000","last_peered":"2024-02-21T23:13:03.519420+0000","last_clean":"2024-02-21T23:13:03.519420+0000","last_became_active":"2024-02-21T23:01:03.225574+0000","last_became_peered":"2024-02-21T23:01:03.225574+0000","last_unstale":"2024-02-21T23:13:03.519420+0000","last_undegraded":"2024-02-21T23:13:03.519420+0000","last_fullsized":"2024-02-21T23:13:03.519420+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0027999029999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"6","length":"1"},{"start":"11","length":"1"}]},{"pgid":"3.32","version":"40'86","reported_seq":181,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-21T23:13:03.520377+0000","last_change":"2024-02-21T23:13:03.520377+0000","last_active":"2024-02-21T23:13:03.520377+0000","last_peered":"2024-02-21T23:13:03.520377+0000","last_clean":"2024-02-21T23:13:03.520377+0000","last_became_active":"2024-02-21T23:01:03.217938+0000","last_became_peered":"2024-02-21T23:01:03.217938+0000","last_unstale":"2024-02-21T23:13:03.520377+0000","last_undegraded":"2024-02-21T23:13:03.520377+0000","last_fullsized":"2024-02-21T23:13:03.520377+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0037110289999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8],"acting":[0,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"6","length":"1"},{"start":"11","length":"1"}]},{"pgid":"3.33","version":"40'70","reported_seq":167,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:09.839686+0000","last_change":"2024-02-21T23:13:03.305215+0000","last_active":"2024-02-21T23:13:09.839686+0000","last_peered":"2024-02-21T23:13:09.839686+0000","last_clean":"2024-02-21T23:13:09.839686+0000","last_became_active":"2024-02-21T23:01:03.225449+0000","last_became_peered":"2024-02-21T23:01:03.225449+0000","last_unstale":"2024-02-21T23:13:09.839686+0000","last_undegraded":"2024-02-21T23:13:09.839686+0000","last_fullsized":"2024-02-21T23:13:09.839686+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.006321821,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10],"acting":[6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"40'64","reported_seq":158,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-21T23:13:03.359502+0000","last_change":"2024-02-21T23:13:03.359502+0000","last_active":"2024-02-21T23:13:03.359502+0000","last_peered":"2024-02-21T23:13:03.359502+0000","last_clean":"2024-02-21T23:13:03.359502+0000","last_became_active":"2024-02-21T23:01:03.208446+0000","last_became_peered":"2024-02-21T23:01:03.208446+0000","last_unstale":"2024-02-21T23:13:03.359502+0000","last_undegraded":"2024-02-21T23:13:03.359502+0000","last_fullsized":"2024-02-21T23:13:03.359502+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:43:34.600230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003791258,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"6","length":"1"},{"start":"11","length":"1"}]},{"pgid":"3.35","version":"40'79","reported_seq":173,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-21T23:13:03.303063+0000","last_change":"2024-02-21T23:13:03.303063+0000","last_active":"2024-02-21T23:13:03.303063+0000","last_peered":"2024-02-21T23:13:03.303063+0000","last_clean":"2024-02-21T23:13:03.303063+0000","last_became_active":"2024-02-21T23:01:03.217925+0000","last_became_peered":"2024-02-21T23:01:03.217925+0000","last_unstale":"2024-02-21T23:13:03.303063+0000","last_undegraded":"2024-02-21T23:13:03.303063+0000","last_fullsized":"2024-02-21T23:13:03.303063+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:05:38.178836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0033063070000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8],"acting":[7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"6","length":"1"},{"start":"11","length":"1"}]},{"pgid":"3.36","version":"40'74","reported_seq":170,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:09.883926+0000","last_change":"2024-02-21T23:13:03.584774+0000","last_active":"2024-02-21T23:13:09.883926+0000","last_peered":"2024-02-21T23:13:09.883926+0000","last_clean":"2024-02-21T23:13:09.883926+0000","last_became_active":"2024-02-21T23:01:03.211921+0000","last_became_peered":"2024-02-21T23:01:03.211921+0000","last_unstale":"2024-02-21T23:13:09.883926+0000","last_undegraded":"2024-02-21T23:13:09.883926+0000","last_fullsized":"2024-02-21T23:13:09.883926+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:53:32.848973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014721059999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2],"acting":[10,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"40'90","reported_seq":186,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:09.844753+0000","last_change":"2024-02-21T23:13:03.321948+0000","last_active":"2024-02-21T23:13:09.844753+0000","last_peered":"2024-02-21T23:13:09.844753+0000","last_clean":"2024-02-21T23:13:09.844753+0000","last_became_active":"2024-02-21T23:01:03.216580+0000","last_became_peered":"2024-02-21T23:01:03.216580+0000","last_unstale":"2024-02-21T23:13:09.844753+0000","last_undegraded":"2024-02-21T23:13:09.844753+0000","last_fullsized":"2024-02-21T23:13:09.844753+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022026120000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"40'72","reported_seq":168,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:10.004811+0000","last_change":"2024-02-21T23:13:03.630678+0000","last_active":"2024-02-21T23:13:10.004811+0000","last_peered":"2024-02-21T23:13:10.004811+0000","last_clean":"2024-02-21T23:13:10.004811+0000","last_became_active":"2024-02-21T23:01:03.211811+0000","last_became_peered":"2024-02-21T23:01:03.211811+0000","last_unstale":"2024-02-21T23:13:10.004811+0000","last_undegraded":"2024-02-21T23:13:10.004811+0000","last_fullsized":"2024-02-21T23:13:10.004811+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0066682540000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"40'80","reported_seq":173,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-21T23:13:03.301611+0000","last_change":"2024-02-21T23:13:03.301950+0000","last_active":"2024-02-21T23:13:03.301611+0000","last_peered":"2024-02-21T23:13:03.301611+0000","last_clean":"2024-02-21T23:13:03.301611+0000","last_became_active":"2024-02-21T23:01:03.223255+0000","last_became_peered":"2024-02-21T23:01:03.223255+0000","last_unstale":"2024-02-21T23:13:03.301611+0000","last_undegraded":"2024-02-21T23:13:03.301611+0000","last_fullsized":"2024-02-21T23:13:03.301611+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:52:14.521309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002877391,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9],"acting":[7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"6","length":"1"},{"start":"11","length":"1"}]},{"pgid":"3.3a","version":"40'78","reported_seq":173,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:09.883445+0000","last_change":"2024-02-21T23:13:03.584270+0000","last_active":"2024-02-21T23:13:09.883445+0000","last_peered":"2024-02-21T23:13:09.883445+0000","last_clean":"2024-02-21T23:13:09.883445+0000","last_became_active":"2024-02-21T23:01:03.209569+0000","last_became_peered":"2024-02-21T23:01:03.209569+0000","last_unstale":"2024-02-21T23:13:09.883445+0000","last_undegraded":"2024-02-21T23:13:09.883445+0000","last_fullsized":"2024-02-21T23:13:09.883445+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:31:33.327648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001512382,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9],"acting":[10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"40'74","reported_seq":169,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:10.075635+0000","last_change":"2024-02-21T23:13:03.627480+0000","last_active":"2024-02-21T23:13:10.075635+0000","last_peered":"2024-02-21T23:13:10.075635+0000","last_clean":"2024-02-21T23:13:10.075635+0000","last_became_active":"2024-02-21T23:01:03.213941+0000","last_became_peered":"2024-02-21T23:01:03.213941+0000","last_unstale":"2024-02-21T23:13:10.075635+0000","last_undegraded":"2024-02-21T23:13:10.075635+0000","last_fullsized":"2024-02-21T23:13:10.075635+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:21:42.613496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036313349999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3],"acting":[8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"40'67","reported_seq":162,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-21T23:13:03.359229+0000","last_change":"2024-02-21T23:13:03.359229+0000","last_active":"2024-02-21T23:13:03.359229+0000","last_peered":"2024-02-21T23:13:03.359229+0000","last_clean":"2024-02-21T23:13:03.359229+0000","last_became_active":"2024-02-21T23:01:03.206762+0000","last_became_peered":"2024-02-21T23:01:03.206762+0000","last_unstale":"2024-02-21T23:13:03.359229+0000","last_undegraded":"2024-02-21T23:13:03.359229+0000","last_fullsized":"2024-02-21T23:13:03.359229+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:54:21.514719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0035603570000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8],"acting":[4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"6","length":"1"},{"start":"11","length":"1"}]},{"pgid":"3.3d","version":"40'79","reported_seq":182,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-21T23:13:08.458520+0000","last_change":"2024-02-21T23:13:08.458565+0000","last_active":"2024-02-21T23:13:08.458520+0000","last_peered":"2024-02-21T23:13:08.458520+0000","last_clean":"2024-02-21T23:13:08.458520+0000","last_became_active":"2024-02-21T23:01:03.221672+0000","last_became_peered":"2024-02-21T23:01:03.221672+0000","last_unstale":"2024-02-21T23:13:08.458520+0000","last_undegraded":"2024-02-21T23:13:08.458520+0000","last_fullsized":"2024-02-21T23:13:08.458520+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'79","last_scrub_stamp":"2024-02-21T23:13:08.458368+0000","last_deep_scrub":"40'79","last_deep_scrub_stamp":"2024-02-21T23:13:08.458368+0000","last_clean_scrub_stamp":"2024-02-21T23:13:08.458368+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:02:36.336451+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.0035512949999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"6","length":"1"},{"start":"11","length":"1"}]},{"pgid":"3.3e","version":"40'56","reported_seq":159,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-21T23:13:07.435641+0000","last_change":"2024-02-21T23:13:07.435683+0000","last_active":"2024-02-21T23:13:07.435641+0000","last_peered":"2024-02-21T23:13:07.435641+0000","last_clean":"2024-02-21T23:13:07.435641+0000","last_became_active":"2024-02-21T23:01:03.219379+0000","last_became_peered":"2024-02-21T23:01:03.219379+0000","last_unstale":"2024-02-21T23:13:07.435641+0000","last_undegraded":"2024-02-21T23:13:07.435641+0000","last_fullsized":"2024-02-21T23:13:07.435641+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'56","last_scrub_stamp":"2024-02-21T23:13:07.435524+0000","last_deep_scrub":"40'56","last_deep_scrub_stamp":"2024-02-21T23:13:07.435524+0000","last_clean_scrub_stamp":"2024-02-21T23:13:07.435524+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:40:28.792657+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.0043096130000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11],"acting":[0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"6","length":"1"},{"start":"11","length":"1"}]},{"pgid":"3.3f","version":"40'65","reported_seq":159,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-02-21T23:13:03.630340+0000","last_change":"2024-02-21T23:13:03.630657+0000","last_active":"2024-02-21T23:13:03.630340+0000","last_peered":"2024-02-21T23:13:03.630340+0000","last_clean":"2024-02-21T23:13:03.630340+0000","last_became_active":"2024-02-21T23:01:03.212878+0000","last_became_peered":"2024-02-21T23:01:03.212878+0000","last_unstale":"2024-02-21T23:13:03.630340+0000","last_undegraded":"2024-02-21T23:13:03.630340+0000","last_fullsized":"2024-02-21T23:13:03.630340+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-21T23:01:02.182490+0000","last_clean_scrub_stamp":"2024-02-21T23:01:02.182490+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:55:16.147248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0052400579999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[{"start":"6","length":"1"},{"start":"11","length":"1"}]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":26460371,"num_objects":3449,"num_object_clones":0,"num_object_copies":13796,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3449,"num_whiteouts":0,"num_read":1,"num_read_kb":1270,"num_write":9636,"num_write_kb":38355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":91508736,"data_stored":98402304,"data_compressed":4659312,"data_compressed_allocated":5701632,"data_compressed_original":12595200,"omap_allocated":0,"internal_metadata":0},"log_size":10826,"ondisk_log_size":10826,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4661,"ondisk_log_size":4661,"up":128,"acting":128,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":60977620,"num_objects":267,"num_object_clones":0,"num_object_copies":534,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":267,"num_whiteouts":0,"num_read":6783,"num_read_kb":62695,"num_write":2365,"num_write_kb":70242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":221,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":488352,"num_omap_keys":785,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":26812416,"data_stored":121955240,"data_compressed":17887088,"data_compressed_allocated":22609920,"data_compressed_original":117915648,"omap_allocated":0,"internal_metadata":0},"log_size":1746,"ondisk_log_size":1746,"up":64,"acting":64,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66458,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":11,"up_from":17,"seq":73014444181,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46384,"kb_used_data":6884,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94325456,"statfs":{"total":96636764160,"available":96589266944,"internally_reserved":0,"allocated":7049216,"data_stored":7202286,"data_compressed":331454,"data_compressed_allocated":409600,"data_compressed_original":823296,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":17,"seq":73014444180,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49216,"kb_used_data":9716,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94322624,"statfs":{"total":96636764160,"available":96586366976,"internally_reserved":0,"allocated":9949184,"data_stored":23012803,"data_compressed":2655300,"data_compressed_allocated":3403776,"data_compressed_original":16752640,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":17,"seq":73014444181,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50596,"kb_used_data":11100,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94321244,"statfs":{"total":96636764160,"available":96584953856,"internally_reserved":0,"allocated":11366400,"data_stored":15521352,"data_compressed":1075297,"data_compressed_allocated":1392640,"data_compressed_original":5812224,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":17,"seq":73014444180,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47156,"kb_used_data":7656,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94324684,"statfs":{"total":96636764160,"available":96588476416,"internally_reserved":0,"allocated":7839744,"data_stored":21898308,"data_compressed":2899240,"data_compressed_allocated":3653632,"data_compressed_original":17985536,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,3,4,5,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":17,"seq":73014444181,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39020,"kb_used_data":12000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94332820,"statfs":{"total":96636764160,"available":96596807680,"internally_reserved":0,"allocated":12288000,"data_stored":26106994,"data_compressed":2818727,"data_compressed_allocated":3584000,"data_compressed_original":17670144,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":17,"seq":73014444180,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44912,"kb_used_data":9572,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94326928,"statfs":{"total":96636764160,"available":96590774272,"internally_reserved":0,"allocated":9801728,"data_stored":13596690,"data_compressed":1124577,"data_compressed_allocated":1363968,"data_compressed_original":5431296,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":17,"seq":73014444181,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41628,"kb_used_data":14608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94330212,"statfs":{"total":96636764160,"available":96594137088,"internally_reserved":0,"allocated":14958592,"data_stored":30264796,"data_compressed":3335840,"data_compressed_allocated":4239360,"data_compressed_original":19836928,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":17,"seq":73014444181,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49448,"kb_used_data":9952,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94322392,"statfs":{"total":96636764160,"available":96586129408,"internally_reserved":0,"allocated":10190848,"data_stored":11009343,"data_compressed":674821,"data_compressed_allocated":819200,"data_compressed_original":1904640,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":17,"seq":73014444181,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46948,"kb_used_data":7452,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94324892,"statfs":{"total":96636764160,"available":96588689408,"internally_reserved":0,"allocated":7630848,"data_stored":11956110,"data_compressed":1299222,"data_compressed_allocated":1609728,"data_compressed_original":6201344,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444181,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52748,"kb_used_data":13252,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94319092,"statfs":{"total":96636764160,"available":96582750208,"internally_reserved":0,"allocated":13570048,"data_stored":37840149,"data_compressed":5014652,"data_compressed_allocated":6283264,"data_compressed_original":30826496,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":17,"seq":73014444181,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53680,"kb_used_data":10020,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94318160,"statfs":{"total":96636764160,"available":96581795840,"internally_reserved":0,"allocated":10260480,"data_stored":13665864,"data_compressed":1003958,"data_compressed_allocated":1253376,"data_compressed_original":4923392,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":17,"seq":73014444181,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44092,"kb_used_data":8756,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327748,"statfs":{"total":96636764160,"available":96591613952,"internally_reserved":0,"allocated":8966144,"data_stored":12531406,"data_compressed":895124,"data_compressed_allocated":1130496,"data_compressed_original":4972544,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33229,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33229,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":831488,"data_stored":4195110,"data_compressed":654518,"data_compressed_allocated":794624,"data_compressed_original":4177920,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":983040,"data_stored":4194976,"data_compressed":615592,"data_compressed_allocated":782336,"data_compressed_original":4001792,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6574080,"data_stored":30540141,"data_compressed":4544343,"data_compressed_allocated":5718016,"data_compressed_original":29700096,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":962560,"data_stored":4484070,"data_compressed":694867,"data_compressed_allocated":851968,"data_compressed_original":4382720,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":63895,"data_compressed":8106,"data_compressed_allocated":12288,"data_compressed_original":36864,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4325376,"data_stored":18610196,"data_compressed":2736860,"data_compressed_allocated":3469312,"data_compressed_original":17784832,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1032192,"data_stored":4546717,"data_compressed":692215,"data_compressed_allocated":839680,"data_compressed_original":4362240,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":3792896,"data_stored":16778922,"data_compressed":2462264,"data_compressed_allocated":3121152,"data_compressed_original":16113664,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":3510272,"data_stored":17170588,"data_compressed":2509836,"data_compressed_allocated":3166208,"data_compressed_original":16842752,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":827392,"data_stored":4588192,"data_compressed":597132,"data_compressed_allocated":802816,"data_compressed_original":4571136,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":3919872,"data_stored":16781851,"data_compressed":2371355,"data_compressed_allocated":3051520,"data_compressed_original":15941632,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":7684096,"data_stored":8081408,"data_compressed":197899,"data_compressed_allocated":274432,"data_compressed_original":671744,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8826880,"data_stored":9216000,"data_compressed":345659,"data_compressed_allocated":409600,"data_compressed_original":798720,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6545408,"data_stored":7045120,"data_compressed":427602,"data_compressed_allocated":503808,"data_compressed_original":1003520,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6217728,"data_stored":7217152,"data_compressed":561648,"data_compressed_allocated":696320,"data_compressed_original":1695744,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":9691136,"data_stored":10690560,"data_compressed":624008,"data_compressed_allocated":745472,"data_compressed_original":1744896,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":10117120,"data_stored":10809344,"data_compressed":523044,"data_compressed_allocated":663552,"data_compressed_original":1355776,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8306688,"data_stored":8785920,"data_compressed":386785,"data_compressed_allocated":458752,"data_compressed_original":937984,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":7979008,"data_stored":8482816,"data_compressed":280527,"data_compressed_allocated":356352,"data_compressed_original":860160,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":3878912,"data_stored":4472832,"data_compressed":346697,"data_compressed_allocated":425984,"data_compressed_original":1019904,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":10088448,"data_stored":10678272,"data_compressed":435458,"data_compressed_allocated":528384,"data_compressed_original":1118208,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":5578752,"data_stored":5976064,"data_compressed":241238,"data_compressed_allocated":290816,"data_compressed_original":688128,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":6594560,"data_stored":6946816,"data_compressed":288747,"data_compressed_allocated":348160,"data_compressed_original":700416,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-21T23:13:15.889 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-02-21T23:01:01.174601+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=1, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.890 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-02-21T23:01:02.182490+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.890 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-02-21T23:01:06.230568+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.890 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-02-21T23:01:06.230568+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.890 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-02-21T23:01:01.174601+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=1, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.890 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-02-21T23:01:02.182490+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.891 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-02-21T23:01:06.230568+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.891 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-02-21T23:01:01.174601+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=1, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.891 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-02-21T23:01:02.182490+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.891 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-02-21T23:01:06.230568+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.891 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-02-21T23:01:02.182490+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.891 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-02-21T23:01:01.174601+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=1, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.892 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-02-21T23:01:06.230568+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.892 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-02-21T23:01:02.182490+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.892 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-02-21T23:01:01.174601+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=1, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.892 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-02-21T23:01:06.230568+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.892 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-02-21T23:01:02.182490+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.892 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-02-21T23:01:06.230568+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.893 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-02-21T23:01:02.182490+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.893 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-02-21T23:01:06.230568+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.893 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-02-21T23:01:02.182490+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.893 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-02-21T23:01:01.174601+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=1, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.893 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-02-21T23:01:06.230568+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.893 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-02-21T23:01:01.174601+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=1, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.894 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-02-21T23:01:06.230568+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.894 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-02-21T23:01:02.182490+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.894 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-02-21T23:01:01.174601+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=1, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.894 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-02-21T23:01:06.230568+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.894 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-02-21T23:01:02.182490+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.894 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-02-21T23:01:06.230568+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.895 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-02-21T23:01:02.182490+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.895 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-02-21T23:01:01.174601+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=1, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.895 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-02-21T23:01:06.230568+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.895 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-02-21T23:01:02.182490+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.895 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-02-21T23:01:06.230568+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.895 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-02-21T23:01:02.182490+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.896 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-02-21T23:01:01.174601+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=1, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.896 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-02-21T23:01:06.230568+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.896 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-02-21T23:01:02.182490+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.896 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-02-21T23:01:01.174601+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=1, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.896 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-02-21T23:00:57.811198+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.896 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-02-21T23:01:06.230568+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.897 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-02-21T23:01:02.182490+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.897 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-02-21T23:01:01.174601+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=1, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.897 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-02-21T23:01:06.230568+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.897 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-02-21T23:01:02.182490+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.897 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-02-21T23:01:01.174601+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=1, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.897 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-02-21T23:01:06.230568+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.898 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-02-21T23:01:02.182490+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.898 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-02-21T23:01:06.230568+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.898 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-02-21T23:01:02.182490+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.898 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-02-21T23:01:01.174601+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=1, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.898 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-02-21T23:01:06.230568+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.898 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-02-21T23:01:02.182490+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.899 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-02-21T23:01:01.174601+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=1, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.899 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-02-21T23:01:06.230568+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.899 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-02-21T23:01:02.182490+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.899 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-02-21T23:01:01.174601+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=1, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.899 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-02-21T23:01:06.230568+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.899 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-02-21T23:01:02.182490+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.900 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-02-21T23:01:01.174601+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=1, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.900 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-02-21T23:01:06.230568+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.900 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-02-21T23:01:02.182490+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.901 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-02-21T23:01:01.174601+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=1, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.901 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-02-21T23:01:06.230568+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.901 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-02-21T23:01:02.182490+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.901 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-02-21T23:01:01.174601+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=1, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.901 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-02-21T23:01:06.230568+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.902 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-02-21T23:01:02.182490+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.902 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-02-21T23:01:01.174601+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=1, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.902 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-02-21T23:01:06.230568+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.902 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-02-21T23:01:02.182490+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.902 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-02-21T23:01:01.174601+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=1, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.902 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-02-21T23:01:06.230568+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.903 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-02-21T23:01:02.182490+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.903 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-02-21T23:01:01.174601+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=1, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.903 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-02-21T23:01:06.230568+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.903 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-02-21T23:01:06.230568+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.903 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-02-21T23:01:02.182490+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.903 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-02-21T23:01:01.174601+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=1, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.904 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-02-21T23:01:06.230568+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.904 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-02-21T23:01:02.182490+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.904 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-02-21T23:01:01.174601+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=1, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.904 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-02-21T23:01:02.182490+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.904 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-02-21T23:01:06.230568+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.904 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-02-21T23:01:01.174601+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=1, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.905 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-02-21T23:01:02.182490+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.905 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-02-21T23:01:06.230568+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.905 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-02-21T23:01:02.182490+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.905 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-02-21T23:01:02.182490+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.905 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-02-21T23:01:02.182490+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.905 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-02-21T23:01:02.182490+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.906 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-02-21T23:01:02.182490+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.906 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-02-21T23:01:02.182490+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.906 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-02-21T23:01:02.182490+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.906 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-02-21T23:01:02.182490+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.906 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-02-21T23:01:02.182490+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.906 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-02-21T23:01:02.182490+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.907 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-02-21T23:01:02.182490+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.907 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-02-21T23:01:02.182490+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.907 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-02-21T23:01:02.182490+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.907 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-02-21T23:01:02.182490+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.907 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-02-21T23:01:02.182490+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.907 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-02-21T23:01:02.182490+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.908 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-02-21T23:01:02.182490+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.908 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-02-21T23:01:02.182490+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.908 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-02-21T23:01:02.182490+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.908 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-02-21T23:01:02.182490+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.908 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-02-21T23:01:02.182490+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.908 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-02-21T23:01:02.182490+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.909 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-02-21T23:01:02.182490+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.909 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-02-21T23:01:02.182490+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.909 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-02-21T23:01:02.182490+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.909 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-02-21T23:01:02.182490+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.909 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-02-21T23:01:02.182490+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.909 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-02-21T23:01:02.182490+0000 time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=52, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=2, tm_mday=21, tm_hour=23, tm_min=13, tm_sec=4, tm_wday=2, tm_yday=52, tm_isdst=0) 2024-02-21T23:13:15.910 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-02-21T23:13:35.912 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-02-21T23:13:36.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.163+0000 7f3823200640 1 Processor -- start 2024-02-21T23:13:36.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.163+0000 7f3823200640 1 -- start start 2024-02-21T23:13:36.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.165+0000 7f3823200640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f382418b940 0x7f3824189ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:36.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.165+0000 7f3823200640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f38240d2c80 0x7f38240d30b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:36.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.165+0000 7f3823200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f382418a5c0 con 0x7f382415dc20 2024-02-21T23:13:36.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.165+0000 7f3823200640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f382418bdc0 con 0x7f382418b940 2024-02-21T23:13:36.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.165+0000 7f3823200640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f382418b4b0 con 0x7f38240d2c80 2024-02-21T23:13:36.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.165+0000 7f3821400640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f382418b940 0x7f3824189ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:36.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.165+0000 7f3821e00640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f382415dc20 0x7f3824186950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.99:37560/0 (socket says 172.21.15.99:37560) 2024-02-21T23:13:36.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.165+0000 7f3821e00640 1 -- 172.21.15.99:0/3480769382 learned_addr learned my addr 172.21.15.99:0/3480769382 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:13:36.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.165+0000 7f3822800640 1 --2- 172.21.15.99:0/3480769382 >> v2:172.21.15.181:3300/0 conn(0x7f38240d2c80 0x7f38240d30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:36.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.166+0000 7f3820a00640 1 -- 172.21.15.99:0/3480769382 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3078069564 0 0) 0x7f382418a5c0 con 0x7f382415dc20 2024-02-21T23:13:36.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.166+0000 7f3820a00640 1 -- 172.21.15.99:0/3480769382 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3808003520 con 0x7f382415dc20 2024-02-21T23:13:36.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.166+0000 7f3821400640 1 -- 172.21.15.99:0/3480769382 >> v2:172.21.15.181:3300/0 conn(0x7f38240d2c80 msgr2=0x7f38240d30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:13:36.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.166+0000 7f3821400640 1 --2- 172.21.15.99:0/3480769382 >> v2:172.21.15.181:3300/0 conn(0x7f38240d2c80 0x7f38240d30b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:36.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.166+0000 7f3821400640 1 -- 172.21.15.99:0/3480769382 >> v1:172.21.15.162:6789/0 conn(0x7f382415dc20 legacy=0x7f3824186950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:36.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.166+0000 7f3821400640 1 -- 172.21.15.99:0/3480769382 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f382418a8a0 con 0x7f382418b940 2024-02-21T23:13:36.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.166+0000 7f3822800640 1 --2- 172.21.15.99:0/3480769382 >> v2:172.21.15.181:3300/0 conn(0x7f38240d2c80 0x7f38240d30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:13:36.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.168+0000 7f3821400640 1 --2- 172.21.15.99:0/3480769382 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f382418b940 0x7f3824189ed0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f3824092dc0 tx=0x7f381002b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bdbb2eaba1005187 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:36.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.168+0000 7f3820a00640 1 -- 172.21.15.99:0/3480769382 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3810035020 con 0x7f382418b940 2024-02-21T23:13:36.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.168+0000 7f3820a00640 1 -- 172.21.15.99:0/3480769382 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3810031830 con 0x7f382418b940 2024-02-21T23:13:36.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.168+0000 7f3820a00640 1 -- 172.21.15.99:0/3480769382 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3810031be0 con 0x7f382418b940 2024-02-21T23:13:36.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.169+0000 7f3823200640 1 -- 172.21.15.99:0/3480769382 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f382418b940 msgr2=0x7f3824189ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:36.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.169+0000 7f3823200640 1 --2- 172.21.15.99:0/3480769382 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f382418b940 0x7f3824189ed0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f3824092dc0 tx=0x7f381002b8d0 comp rx=0 tx=0).stop 2024-02-21T23:13:36.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.169+0000 7f3823200640 1 -- 172.21.15.99:0/3480769382 shutdown_connections 2024-02-21T23:13:36.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.169+0000 7f3823200640 1 --2- 172.21.15.99:0/3480769382 >> v2:172.21.15.181:3300/0 conn(0x7f38240d2c80 0x7f38240d30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:36.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.169+0000 7f3823200640 1 --2- 172.21.15.99:0/3480769382 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f382418b940 0x7f3824189ed0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:36.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.169+0000 7f3823200640 1 -- 172.21.15.99:0/3480769382 >> 172.21.15.99:0/3480769382 conn(0x7f3824072210 msgr2=0x7f382408cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:36.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.169+0000 7f3823200640 1 -- 172.21.15.99:0/3480769382 shutdown_connections 2024-02-21T23:13:36.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.169+0000 7f3823200640 1 -- 172.21.15.99:0/3480769382 wait complete. 2024-02-21T23:13:36.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.172+0000 7f3823200640 1 Processor -- start 2024-02-21T23:13:36.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.172+0000 7f3823200640 1 -- start start 2024-02-21T23:13:36.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.173+0000 7f3823200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f38240d2c80 0x7f382415e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:36.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.173+0000 7f3823200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f382415dc20 0x7f382417d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:36.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.173+0000 7f3823200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f382418b940 0x7f38240d4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:36.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.173+0000 7f3823200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f382418b140 con 0x7f38240d2c80 2024-02-21T23:13:36.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.173+0000 7f3823200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f382418ae60 con 0x7f382415dc20 2024-02-21T23:13:36.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.173+0000 7f3823200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f382415e000 con 0x7f382418b940 2024-02-21T23:13:36.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.173+0000 7f3821e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f38240d2c80 0x7f382415e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:36.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.173+0000 7f3821e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f38240d2c80 0x7f382415e640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:38882/0 (socket says 172.21.15.99:38882) 2024-02-21T23:13:36.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.173+0000 7f3821e00640 1 -- 172.21.15.99:0/976816521 learned_addr learned my addr 172.21.15.99:0/976816521 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:13:36.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.173+0000 7f3821400640 1 --2- 172.21.15.99:0/976816521 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f382415dc20 0x7f382417d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:36.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.174+0000 7f3822800640 1 --2- 172.21.15.99:0/976816521 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f382418b940 0x7f38240d4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:36.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.174+0000 7f3821e00640 1 -- 172.21.15.99:0/976816521 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f382418b940 msgr2=0x7f38240d4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:36.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.174+0000 7f3821e00640 1 --2- 172.21.15.99:0/976816521 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f382418b940 0x7f38240d4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:36.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.174+0000 7f3821e00640 1 -- 172.21.15.99:0/976816521 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f382415dc20 msgr2=0x7f382417d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:36.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.174+0000 7f3821e00640 1 --2- 172.21.15.99:0/976816521 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f382415dc20 0x7f382417d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:36.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.174+0000 7f3821e00640 1 -- 172.21.15.99:0/976816521 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f382415f0f0 con 0x7f38240d2c80 2024-02-21T23:13:36.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.174+0000 7f3821e00640 1 --2- 172.21.15.99:0/976816521 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f38240d2c80 0x7f382415e640 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f381400c430 tx=0x7f381400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:36.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.175+0000 7f381a000640 1 -- 172.21.15.99:0/976816521 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3814017070 con 0x7f38240d2c80 2024-02-21T23:13:36.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.175+0000 7f381a000640 1 -- 172.21.15.99:0/976816521 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3814005ce0 con 0x7f38240d2c80 2024-02-21T23:13:36.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.175+0000 7f381a000640 1 -- 172.21.15.99:0/976816521 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38140072f0 con 0x7f38240d2c80 2024-02-21T23:13:36.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.175+0000 7f3823200640 1 -- 172.21.15.99:0/976816521 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f382415f3d0 con 0x7f38240d2c80 2024-02-21T23:13:36.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.175+0000 7f3823200640 1 -- 172.21.15.99:0/976816521 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f382415f990 con 0x7f38240d2c80 2024-02-21T23:13:36.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.176+0000 7f3823200640 1 -- 172.21.15.99:0/976816521 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3824068320 con 0x7f38240d2c80 2024-02-21T23:13:36.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.179+0000 7f381a000640 1 -- 172.21.15.99:0/976816521 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f381401a070 con 0x7f38240d2c80 2024-02-21T23:13:36.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.181+0000 7f381a000640 1 --2- 172.21.15.99:0/976816521 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f380409eed0 0x7f38040a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:36.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.181+0000 7f381a000640 1 -- 172.21.15.99:0/976816521 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f38140c9790 con 0x7f38240d2c80 2024-02-21T23:13:36.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.182+0000 7f3821400640 1 --2- 172.21.15.99:0/976816521 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f380409eed0 0x7f38040a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:36.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.182+0000 7f3821400640 1 --2- 172.21.15.99:0/976816521 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f380409eed0 0x7f38040a1390 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3810036000 tx=0x7f3810008030 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:36.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.186+0000 7f381a000640 1 -- 172.21.15.99:0/976816521 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f3814021020 con 0x7f38240d2c80 2024-02-21T23:13:36.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.432+0000 7f3823200640 1 -- 172.21.15.99:0/976816521 --> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3824188910 con 0x7f380409eed0 2024-02-21T23:13:36.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.443+0000 7f381a000640 1 -- 172.21.15.99:0/976816521 <== mgr.5131 v2:172.21.15.162:6800/631076050 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+343594 (secure 0 0 0) 0x7f3824188910 con 0x7f380409eed0 2024-02-21T23:13:36.436 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T23:13:36.438 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-02-21T23:13:36.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.448+0000 7f3823200640 1 -- 172.21.15.99:0/976816521 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f380409eed0 msgr2=0x7f38040a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:36.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.448+0000 7f3823200640 1 --2- 172.21.15.99:0/976816521 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f380409eed0 0x7f38040a1390 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3810036000 tx=0x7f3810008030 comp rx=0 tx=0).stop 2024-02-21T23:13:36.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.448+0000 7f3823200640 1 -- 172.21.15.99:0/976816521 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f38240d2c80 msgr2=0x7f382415e640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:36.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.448+0000 7f3823200640 1 --2- 172.21.15.99:0/976816521 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f38240d2c80 0x7f382415e640 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f381400c430 tx=0x7f381400c830 comp rx=0 tx=0).stop 2024-02-21T23:13:36.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.448+0000 7f3823200640 1 -- 172.21.15.99:0/976816521 shutdown_connections 2024-02-21T23:13:36.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.448+0000 7f3823200640 1 --2- 172.21.15.99:0/976816521 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f380409eed0 0x7f38040a1390 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:36.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.448+0000 7f3823200640 1 --2- 172.21.15.99:0/976816521 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f382418b940 0x7f38240d4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:36.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.448+0000 7f3823200640 1 --2- 172.21.15.99:0/976816521 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f382415dc20 0x7f382417d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:36.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.448+0000 7f3823200640 1 --2- 172.21.15.99:0/976816521 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f38240d2c80 0x7f382415e640 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:36.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.448+0000 7f3823200640 1 -- 172.21.15.99:0/976816521 >> 172.21.15.99:0/976816521 conn(0x7f3824072210 msgr2=0x7f3824186aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:36.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.449+0000 7f3823200640 1 -- 172.21.15.99:0/976816521 shutdown_connections 2024-02-21T23:13:36.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.449+0000 7f3823200640 1 -- 172.21.15.99:0/976816521 wait complete. 2024-02-21T23:13:36.455 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":354,"stamp":"2024-02-21T23:13:36.231578+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":88028359,"num_objects":3718,"num_object_clones":0,"num_object_copies":14334,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3718,"num_whiteouts":0,"num_read":7171,"num_read_kb":64370,"num_write":12202,"num_write_kb":111535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":221,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2615571,"num_omap_keys":4185,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17592,"ondisk_log_size":17592,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1132462080,"kb_used":570092,"kb_used_data":121100,"kb_used_omap":18,"kb_used_meta":448877,"kb_avail":1131891988,"statfs":{"total":1159641169920,"available":1159057395712,"internally_reserved":0,"allocated":124006400,"data_stored":224706916,"data_compressed":23159782,"data_compressed_allocated":29188096,"data_compressed_original":133230592,"omap_allocated":19138,"internal_metadata":459650366},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":45,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003355"},"pg_stats":[{"pgid":"2.1f","version":"42'31","reported_seq":121,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:10.172283+0000","last_change":"2024-02-21T23:13:10.172283+0000","last_active":"2024-02-21T23:13:10.172283+0000","last_peered":"2024-02-21T23:13:10.172283+0000","last_clean":"2024-02-21T23:13:10.172283+0000","last_became_active":"2024-02-21T23:01:02.208124+0000","last_became_peered":"2024-02-21T23:01:02.208124+0000","last_unstale":"2024-02-21T23:13:10.172283+0000","last_undegraded":"2024-02-21T23:13:10.172283+0000","last_fullsized":"2024-02-21T23:13:10.172283+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'31","last_scrub_stamp":"2024-02-21T23:13:10.172118+0000","last_deep_scrub":"42'31","last_deep_scrub_stamp":"2024-02-21T23:13:10.172118+0000","last_clean_scrub_stamp":"2024-02-21T23:13:10.172118+0000","objects_scrubbed":11,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:56:49.748362+0000","scrub_duration":22,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":27,"num_read_kb":4118,"num_write":27,"num_write_kb":4186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":83025,"num_omap_keys":135,"num_objects_repaired":0},"up":[9,7],"acting":[9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"40'67","reported_seq":173,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:15.012840+0000","last_change":"2024-02-21T23:13:15.012885+0000","last_active":"2024-02-21T23:13:15.012840+0000","last_peered":"2024-02-21T23:13:15.012840+0000","last_clean":"2024-02-21T23:13:15.012840+0000","last_became_active":"2024-02-21T23:01:03.214170+0000","last_became_peered":"2024-02-21T23:01:03.214170+0000","last_unstale":"2024-02-21T23:13:15.012840+0000","last_undegraded":"2024-02-21T23:13:15.012840+0000","last_fullsized":"2024-02-21T23:13:15.012840+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'67","last_scrub_stamp":"2024-02-21T23:13:15.012718+0000","last_deep_scrub":"40'67","last_deep_scrub_stamp":"2024-02-21T23:13:15.012718+0000","last_clean_scrub_stamp":"2024-02-21T23:13:15.012718+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:55:34.255287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0079956079999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"35'364","reported_seq":451,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:23.438113+0000","last_change":"2024-02-21T23:13:23.438189+0000","last_active":"2024-02-21T23:13:23.438113+0000","last_peered":"2024-02-21T23:13:23.438113+0000","last_clean":"2024-02-21T23:13:23.438113+0000","last_became_active":"2024-02-21T23:01:07.276192+0000","last_became_peered":"2024-02-21T23:01:07.276192+0000","last_unstale":"2024-02-21T23:13:23.438113+0000","last_undegraded":"2024-02-21T23:13:23.438113+0000","last_fullsized":"2024-02-21T23:13:23.438113+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'364","last_scrub_stamp":"2024-02-21T23:13:23.437981+0000","last_deep_scrub":"35'364","last_deep_scrub_stamp":"2024-02-21T23:13:23.437981+0000","last_clean_scrub_stamp":"2024-02-21T23:13:23.437981+0000","objects_scrubbed":111,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:19:17.622156+0000","scrub_duration":46,"objects_trimmed":0,"snaptrim_duration":0.0032262720000000001,"stat_sum":{"num_bytes":264461,"num_objects":111,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":111,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":325,"num_write_kb":605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"41'27","reported_seq":107,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:10.006637+0000","last_change":"2024-02-21T23:13:08.030343+0000","last_active":"2024-02-21T23:13:10.006637+0000","last_peered":"2024-02-21T23:13:10.006637+0000","last_clean":"2024-02-21T23:13:10.006637+0000","last_became_active":"2024-02-21T23:01:02.220941+0000","last_became_peered":"2024-02-21T23:01:02.220941+0000","last_unstale":"2024-02-21T23:13:10.006637+0000","last_undegraded":"2024-02-21T23:13:10.006637+0000","last_fullsized":"2024-02-21T23:13:10.006637+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'27","last_scrub_stamp":"2024-02-21T23:13:08.030183+0000","last_deep_scrub":"41'27","last_deep_scrub_stamp":"2024-02-21T23:13:08.030183+0000","last_clean_scrub_stamp":"2024-02-21T23:13:08.030183+0000","objects_scrubbed":8,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:48:20.989074+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":17,"num_read_kb":4097,"num_write":22,"num_write_kb":4218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":76581,"num_omap_keys":123,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"40'63","reported_seq":169,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:10.357854+0000","last_change":"2024-02-21T23:13:06.429230+0000","last_active":"2024-02-21T23:13:10.357854+0000","last_peered":"2024-02-21T23:13:10.357854+0000","last_clean":"2024-02-21T23:13:10.357854+0000","last_became_active":"2024-02-21T23:01:03.219221+0000","last_became_peered":"2024-02-21T23:01:03.219221+0000","last_unstale":"2024-02-21T23:13:10.357854+0000","last_undegraded":"2024-02-21T23:13:10.357854+0000","last_fullsized":"2024-02-21T23:13:10.357854+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'63","last_scrub_stamp":"2024-02-21T23:13:06.429073+0000","last_deep_scrub":"40'63","last_deep_scrub_stamp":"2024-02-21T23:13:06.429073+0000","last_clean_scrub_stamp":"2024-02-21T23:13:06.429073+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:06:25.761302+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.0044182249999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"35'354","reported_seq":440,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:16.400619+0000","last_change":"2024-02-21T23:13:16.400698+0000","last_active":"2024-02-21T23:13:16.400619+0000","last_peered":"2024-02-21T23:13:16.400619+0000","last_clean":"2024-02-21T23:13:16.400619+0000","last_became_active":"2024-02-21T23:01:07.268179+0000","last_became_peered":"2024-02-21T23:01:07.268179+0000","last_unstale":"2024-02-21T23:13:16.400619+0000","last_undegraded":"2024-02-21T23:13:16.400619+0000","last_fullsized":"2024-02-21T23:13:16.400619+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'354","last_scrub_stamp":"2024-02-21T23:13:16.400515+0000","last_deep_scrub":"35'354","last_deep_scrub_stamp":"2024-02-21T23:13:16.400515+0000","last_clean_scrub_stamp":"2024-02-21T23:13:16.400515+0000","objects_scrubbed":99,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:02:21.824410+0000","scrub_duration":40,"objects_trimmed":0,"snaptrim_duration":0.002755478,"stat_sum":{"num_bytes":615017,"num_objects":99,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":321,"num_write_kb":926,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"42'30","reported_seq":117,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:17.109488+0000","last_change":"2024-02-21T23:13:17.109488+0000","last_active":"2024-02-21T23:13:17.109488+0000","last_peered":"2024-02-21T23:13:17.109488+0000","last_clean":"2024-02-21T23:13:17.109488+0000","last_became_active":"2024-02-21T23:01:02.208393+0000","last_became_peered":"2024-02-21T23:01:02.208393+0000","last_unstale":"2024-02-21T23:13:17.109488+0000","last_undegraded":"2024-02-21T23:13:17.109488+0000","last_fullsized":"2024-02-21T23:13:17.109488+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'30","last_scrub_stamp":"2024-02-21T23:13:17.109332+0000","last_deep_scrub":"42'30","last_deep_scrub_stamp":"2024-02-21T23:13:17.109332+0000","last_clean_scrub_stamp":"2024-02-21T23:13:17.109332+0000","objects_scrubbed":9,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:56:34.873609+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":25,"num_read_kb":8200,"num_write":25,"num_write_kb":8264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":65262,"num_omap_keys":108,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"40'78","reported_seq":183,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:11.438664+0000","last_change":"2024-02-21T23:13:11.438664+0000","last_active":"2024-02-21T23:13:11.438664+0000","last_peered":"2024-02-21T23:13:11.438664+0000","last_clean":"2024-02-21T23:13:11.438664+0000","last_became_active":"2024-02-21T23:01:03.214733+0000","last_became_peered":"2024-02-21T23:01:03.214733+0000","last_unstale":"2024-02-21T23:13:11.438664+0000","last_undegraded":"2024-02-21T23:13:11.438664+0000","last_fullsized":"2024-02-21T23:13:11.438664+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'78","last_scrub_stamp":"2024-02-21T23:13:11.438511+0000","last_deep_scrub":"40'78","last_deep_scrub_stamp":"2024-02-21T23:13:11.438511+0000","last_clean_scrub_stamp":"2024-02-21T23:13:11.438511+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:56:29.202788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023581750000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"35'356","reported_seq":440,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:20.413552+0000","last_change":"2024-02-21T23:13:20.413588+0000","last_active":"2024-02-21T23:13:20.413552+0000","last_peered":"2024-02-21T23:13:20.413552+0000","last_clean":"2024-02-21T23:13:20.413552+0000","last_became_active":"2024-02-21T23:01:07.279360+0000","last_became_peered":"2024-02-21T23:01:07.279360+0000","last_unstale":"2024-02-21T23:13:20.413552+0000","last_undegraded":"2024-02-21T23:13:20.413552+0000","last_fullsized":"2024-02-21T23:13:20.413552+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'356","last_scrub_stamp":"2024-02-21T23:13:20.413464+0000","last_deep_scrub":"35'356","last_deep_scrub_stamp":"2024-02-21T23:13:20.413464+0000","last_clean_scrub_stamp":"2024-02-21T23:13:20.413464+0000","objects_scrubbed":111,"log_size":356,"log_dups_size":0,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:55:39.656032+0000","scrub_duration":48,"objects_trimmed":0,"snaptrim_duration":0.0036991189999999998,"stat_sum":{"num_bytes":1138317,"num_objects":111,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":111,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":317,"num_write_kb":1526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"42'19","reported_seq":81,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:15.126825+0000","last_change":"2024-02-21T23:13:15.126825+0000","last_active":"2024-02-21T23:13:15.126825+0000","last_peered":"2024-02-21T23:13:15.126825+0000","last_clean":"2024-02-21T23:13:15.126825+0000","last_became_active":"2024-02-21T23:01:02.203992+0000","last_became_peered":"2024-02-21T23:01:02.203992+0000","last_unstale":"2024-02-21T23:13:15.126825+0000","last_undegraded":"2024-02-21T23:13:15.126825+0000","last_fullsized":"2024-02-21T23:13:15.126825+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'19","last_scrub_stamp":"2024-02-21T23:13:15.126707+0000","last_deep_scrub":"42'19","last_deep_scrub_stamp":"2024-02-21T23:13:15.126707+0000","last_clean_scrub_stamp":"2024-02-21T23:13:15.126707+0000","objects_scrubbed":8,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:46:03.124660+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":100829,"num_omap_keys":158,"num_objects_repaired":0},"up":[8,1],"acting":[8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"40'76","reported_seq":181,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:21.194913+0000","last_change":"2024-02-21T23:13:21.194913+0000","last_active":"2024-02-21T23:13:21.194913+0000","last_peered":"2024-02-21T23:13:21.194913+0000","last_clean":"2024-02-21T23:13:21.194913+0000","last_became_active":"2024-02-21T23:01:03.212702+0000","last_became_peered":"2024-02-21T23:01:03.212702+0000","last_unstale":"2024-02-21T23:13:21.194913+0000","last_undegraded":"2024-02-21T23:13:21.194913+0000","last_fullsized":"2024-02-21T23:13:21.194913+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'76","last_scrub_stamp":"2024-02-21T23:13:21.194811+0000","last_deep_scrub":"40'76","last_deep_scrub_stamp":"2024-02-21T23:13:21.194811+0000","last_clean_scrub_stamp":"2024-02-21T23:13:21.194811+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:55:40.437379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0049110159999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"35'320","reported_seq":409,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:17.374241+0000","last_change":"2024-02-21T23:13:17.374274+0000","last_active":"2024-02-21T23:13:17.374241+0000","last_peered":"2024-02-21T23:13:17.374241+0000","last_clean":"2024-02-21T23:13:17.374241+0000","last_became_active":"2024-02-21T23:01:07.268357+0000","last_became_peered":"2024-02-21T23:01:07.268357+0000","last_unstale":"2024-02-21T23:13:17.374241+0000","last_undegraded":"2024-02-21T23:13:17.374241+0000","last_fullsized":"2024-02-21T23:13:17.374241+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'320","last_scrub_stamp":"2024-02-21T23:13:17.374137+0000","last_deep_scrub":"35'320","last_deep_scrub_stamp":"2024-02-21T23:13:17.374137+0000","last_clean_scrub_stamp":"2024-02-21T23:13:17.374137+0000","objects_scrubbed":100,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:52:53.202989+0000","scrub_duration":41,"objects_trimmed":0,"snaptrim_duration":0.003219375,"stat_sum":{"num_bytes":206516,"num_objects":100,"num_object_clones":0,"num_object_copies":400,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":290,"num_write_kb":521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"40'70","reported_seq":175,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:15.659599+0000","last_change":"2024-02-21T23:13:15.659626+0000","last_active":"2024-02-21T23:13:15.659599+0000","last_peered":"2024-02-21T23:13:15.659599+0000","last_clean":"2024-02-21T23:13:15.659599+0000","last_became_active":"2024-02-21T23:01:03.213186+0000","last_became_peered":"2024-02-21T23:01:03.213186+0000","last_unstale":"2024-02-21T23:13:15.659599+0000","last_undegraded":"2024-02-21T23:13:15.659599+0000","last_fullsized":"2024-02-21T23:13:15.659599+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'70","last_scrub_stamp":"2024-02-21T23:13:15.659462+0000","last_deep_scrub":"40'70","last_deep_scrub_stamp":"2024-02-21T23:13:15.659462+0000","last_clean_scrub_stamp":"2024-02-21T23:13:15.659462+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:02:21.083356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0034724209999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"42'42","reported_seq":121,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:16.125417+0000","last_change":"2024-02-21T23:13:16.125453+0000","last_active":"2024-02-21T23:13:16.125417+0000","last_peered":"2024-02-21T23:13:16.125417+0000","last_clean":"2024-02-21T23:13:16.125417+0000","last_became_active":"2024-02-21T23:01:02.208293+0000","last_became_peered":"2024-02-21T23:01:02.208293+0000","last_unstale":"2024-02-21T23:13:16.125417+0000","last_undegraded":"2024-02-21T23:13:16.125417+0000","last_fullsized":"2024-02-21T23:13:16.125417+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'42","last_scrub_stamp":"2024-02-21T23:13:16.125332+0000","last_deep_scrub":"42'42","last_deep_scrub_stamp":"2024-02-21T23:13:16.125332+0000","last_clean_scrub_stamp":"2024-02-21T23:13:16.125332+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:12:37.991129+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":4101,"num_write":38,"num_write_kb":4165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8610,"num_omap_keys":14,"num_objects_repaired":0},"up":[8,2],"acting":[8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"35'339","reported_seq":424,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:21.405458+0000","last_change":"2024-02-21T23:13:21.405540+0000","last_active":"2024-02-21T23:13:21.405458+0000","last_peered":"2024-02-21T23:13:21.405458+0000","last_clean":"2024-02-21T23:13:21.405458+0000","last_became_active":"2024-02-21T23:01:07.651241+0000","last_became_peered":"2024-02-21T23:01:07.651241+0000","last_unstale":"2024-02-21T23:13:21.405458+0000","last_undegraded":"2024-02-21T23:13:21.405458+0000","last_fullsized":"2024-02-21T23:13:21.405458+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'339","last_scrub_stamp":"2024-02-21T23:13:21.405367+0000","last_deep_scrub":"35'339","last_deep_scrub_stamp":"2024-02-21T23:13:21.405367+0000","last_clean_scrub_stamp":"2024-02-21T23:13:21.405367+0000","objects_scrubbed":110,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:52:22.797587+0000","scrub_duration":44,"objects_trimmed":0,"snaptrim_duration":0.0030606520000000001,"stat_sum":{"num_bytes":696245,"num_objects":110,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":302,"num_write_kb":1168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"40'73","reported_seq":178,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:16.005763+0000","last_change":"2024-02-21T23:13:16.005805+0000","last_active":"2024-02-21T23:13:16.005763+0000","last_peered":"2024-02-21T23:13:16.005763+0000","last_clean":"2024-02-21T23:13:16.005763+0000","last_became_active":"2024-02-21T23:01:03.219898+0000","last_became_peered":"2024-02-21T23:01:03.219898+0000","last_unstale":"2024-02-21T23:13:16.005763+0000","last_undegraded":"2024-02-21T23:13:16.005763+0000","last_fullsized":"2024-02-21T23:13:16.005763+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'73","last_scrub_stamp":"2024-02-21T23:13:16.005634+0000","last_deep_scrub":"40'73","last_deep_scrub_stamp":"2024-02-21T23:13:16.005634+0000","last_clean_scrub_stamp":"2024-02-21T23:13:16.005634+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:52:17.397854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0092717189999999994,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"42'47","reported_seq":109,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:13.305080+0000","last_change":"2024-02-21T23:13:13.305169+0000","last_active":"2024-02-21T23:13:13.305080+0000","last_peered":"2024-02-21T23:13:13.305080+0000","last_clean":"2024-02-21T23:13:13.305080+0000","last_became_active":"2024-02-21T23:01:02.202585+0000","last_became_peered":"2024-02-21T23:01:02.202585+0000","last_unstale":"2024-02-21T23:13:13.305080+0000","last_undegraded":"2024-02-21T23:13:13.305080+0000","last_fullsized":"2024-02-21T23:13:13.305080+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'47","last_scrub_stamp":"2024-02-21T23:13:13.304981+0000","last_deep_scrub":"42'47","last_deep_scrub_stamp":"2024-02-21T23:13:13.304981+0000","last_clean_scrub_stamp":"2024-02-21T23:13:13.304981+0000","objects_scrubbed":13,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:12:19.624525+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69,"num_write_kb":365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":147438,"num_omap_keys":235,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"35'375","reported_seq":457,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:19.414629+0000","last_change":"2024-02-21T23:13:19.414675+0000","last_active":"2024-02-21T23:13:19.414629+0000","last_peered":"2024-02-21T23:13:19.414629+0000","last_clean":"2024-02-21T23:13:19.414629+0000","last_became_active":"2024-02-21T23:01:07.276577+0000","last_became_peered":"2024-02-21T23:01:07.276577+0000","last_unstale":"2024-02-21T23:13:19.414629+0000","last_undegraded":"2024-02-21T23:13:19.414629+0000","last_fullsized":"2024-02-21T23:13:19.414629+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'375","last_scrub_stamp":"2024-02-21T23:13:19.414533+0000","last_deep_scrub":"35'375","last_deep_scrub_stamp":"2024-02-21T23:13:19.414533+0000","last_clean_scrub_stamp":"2024-02-21T23:13:19.414533+0000","objects_scrubbed":109,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:37:58.797638+0000","scrub_duration":48,"objects_trimmed":0,"snaptrim_duration":0.0042116009999999997,"stat_sum":{"num_bytes":317135,"num_objects":109,"num_object_clones":0,"num_object_copies":436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":331,"num_write_kb":822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"40'69","reported_seq":174,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:21.666369+0000","last_change":"2024-02-21T23:13:21.666395+0000","last_active":"2024-02-21T23:13:21.666369+0000","last_peered":"2024-02-21T23:13:21.666369+0000","last_clean":"2024-02-21T23:13:21.666369+0000","last_became_active":"2024-02-21T23:01:03.218706+0000","last_became_peered":"2024-02-21T23:01:03.218706+0000","last_unstale":"2024-02-21T23:13:21.666369+0000","last_undegraded":"2024-02-21T23:13:21.666369+0000","last_fullsized":"2024-02-21T23:13:21.666369+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'69","last_scrub_stamp":"2024-02-21T23:13:21.666258+0000","last_deep_scrub":"40'69","last_deep_scrub_stamp":"2024-02-21T23:13:21.666258+0000","last_clean_scrub_stamp":"2024-02-21T23:13:21.666258+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:39:29.153591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.005533998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0],"acting":[11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"41'20","reported_seq":82,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:10.005541+0000","last_change":"2024-02-21T23:13:07.064073+0000","last_active":"2024-02-21T23:13:10.005541+0000","last_peered":"2024-02-21T23:13:10.005541+0000","last_clean":"2024-02-21T23:13:10.005541+0000","last_became_active":"2024-02-21T23:01:02.208542+0000","last_became_peered":"2024-02-21T23:01:02.208542+0000","last_unstale":"2024-02-21T23:13:10.005541+0000","last_undegraded":"2024-02-21T23:13:10.005541+0000","last_fullsized":"2024-02-21T23:13:10.005541+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'20","last_scrub_stamp":"2024-02-21T23:13:07.063969+0000","last_deep_scrub":"41'20","last_deep_scrub_stamp":"2024-02-21T23:13:07.063969+0000","last_clean_scrub_stamp":"2024-02-21T23:13:07.063969+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:09:10.687052+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":57195,"num_omap_keys":93,"num_objects_repaired":0},"up":[3,9],"acting":[3,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"35'342","reported_seq":421,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:16.131383+0000","last_change":"2024-02-21T23:13:16.131449+0000","last_active":"2024-02-21T23:13:16.131383+0000","last_peered":"2024-02-21T23:13:16.131383+0000","last_clean":"2024-02-21T23:13:16.131383+0000","last_became_active":"2024-02-21T23:01:07.282506+0000","last_became_peered":"2024-02-21T23:01:07.282506+0000","last_unstale":"2024-02-21T23:13:16.131383+0000","last_undegraded":"2024-02-21T23:13:16.131383+0000","last_fullsized":"2024-02-21T23:13:16.131383+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'342","last_scrub_stamp":"2024-02-21T23:13:16.131246+0000","last_deep_scrub":"35'342","last_deep_scrub_stamp":"2024-02-21T23:13:16.131246+0000","last_clean_scrub_stamp":"2024-02-21T23:13:16.131246+0000","objects_scrubbed":112,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:13:51.733551+0000","scrub_duration":42,"objects_trimmed":0,"snaptrim_duration":0.0047509290000000001,"stat_sum":{"num_bytes":321892,"num_objects":112,"num_object_clones":0,"num_object_copies":448,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":112,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":294,"num_write_kb":916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"40'60","reported_seq":165,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:21.026615+0000","last_change":"2024-02-21T23:13:21.026641+0000","last_active":"2024-02-21T23:13:21.026615+0000","last_peered":"2024-02-21T23:13:21.026615+0000","last_clean":"2024-02-21T23:13:21.026615+0000","last_became_active":"2024-02-21T23:01:03.211919+0000","last_became_peered":"2024-02-21T23:01:03.211919+0000","last_unstale":"2024-02-21T23:13:21.026615+0000","last_undegraded":"2024-02-21T23:13:21.026615+0000","last_fullsized":"2024-02-21T23:13:21.026615+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'60","last_scrub_stamp":"2024-02-21T23:13:21.026532+0000","last_deep_scrub":"40'60","last_deep_scrub_stamp":"2024-02-21T23:13:21.026532+0000","last_clean_scrub_stamp":"2024-02-21T23:13:21.026532+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:17:57.022877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041254509999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"41'19","reported_seq":81,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:09.844157+0000","last_change":"2024-02-21T23:13:09.396691+0000","last_active":"2024-02-21T23:13:09.844157+0000","last_peered":"2024-02-21T23:13:09.844157+0000","last_clean":"2024-02-21T23:13:09.844157+0000","last_became_active":"2024-02-21T23:01:02.203761+0000","last_became_peered":"2024-02-21T23:01:02.203761+0000","last_unstale":"2024-02-21T23:13:09.844157+0000","last_undegraded":"2024-02-21T23:13:09.844157+0000","last_fullsized":"2024-02-21T23:13:09.844157+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'19","last_scrub_stamp":"2024-02-21T23:13:09.396581+0000","last_deep_scrub":"41'19","last_deep_scrub_stamp":"2024-02-21T23:13:09.396581+0000","last_clean_scrub_stamp":"2024-02-21T23:13:09.396581+0000","objects_scrubbed":8,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:45:57.394534+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":83247,"num_omap_keys":134,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"35'297","reported_seq":391,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:22.407102+0000","last_change":"2024-02-21T23:13:22.407178+0000","last_active":"2024-02-21T23:13:22.407102+0000","last_peered":"2024-02-21T23:13:22.407102+0000","last_clean":"2024-02-21T23:13:22.407102+0000","last_became_active":"2024-02-21T23:01:50.570965+0000","last_became_peered":"2024-02-21T23:01:50.570965+0000","last_unstale":"2024-02-21T23:13:22.407102+0000","last_undegraded":"2024-02-21T23:13:22.407102+0000","last_fullsized":"2024-02-21T23:13:22.407102+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'297","last_scrub_stamp":"2024-02-21T23:13:22.406991+0000","last_deep_scrub":"35'297","last_deep_scrub_stamp":"2024-02-21T23:13:22.406991+0000","last_clean_scrub_stamp":"2024-02-21T23:13:22.406991+0000","objects_scrubbed":99,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:19:45.156343+0000","scrub_duration":37,"objects_trimmed":0,"snaptrim_duration":0.00358377,"stat_sum":{"num_bytes":200353,"num_objects":99,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":263,"num_write_kb":684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,10,9],"acting":[4,8,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"40'66","reported_seq":171,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:13.409621+0000","last_change":"2024-02-21T23:13:13.409660+0000","last_active":"2024-02-21T23:13:13.409621+0000","last_peered":"2024-02-21T23:13:13.409621+0000","last_clean":"2024-02-21T23:13:13.409621+0000","last_became_active":"2024-02-21T23:01:03.229873+0000","last_became_peered":"2024-02-21T23:01:03.229873+0000","last_unstale":"2024-02-21T23:13:13.409621+0000","last_undegraded":"2024-02-21T23:13:13.409621+0000","last_fullsized":"2024-02-21T23:13:13.409621+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'66","last_scrub_stamp":"2024-02-21T23:13:13.409496+0000","last_deep_scrub":"40'66","last_deep_scrub_stamp":"2024-02-21T23:13:13.409496+0000","last_clean_scrub_stamp":"2024-02-21T23:13:13.409496+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:41:52.733666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0043383639999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"42'23","reported_seq":85,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:13.398979+0000","last_change":"2024-02-21T23:13:13.399020+0000","last_active":"2024-02-21T23:13:13.398979+0000","last_peered":"2024-02-21T23:13:13.398979+0000","last_clean":"2024-02-21T23:13:13.398979+0000","last_became_active":"2024-02-21T23:01:02.206230+0000","last_became_peered":"2024-02-21T23:01:02.206230+0000","last_unstale":"2024-02-21T23:13:13.398979+0000","last_undegraded":"2024-02-21T23:13:13.398979+0000","last_fullsized":"2024-02-21T23:13:13.398979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'23","last_scrub_stamp":"2024-02-21T23:13:13.398901+0000","last_deep_scrub":"42'23","last_deep_scrub_stamp":"2024-02-21T23:13:13.398901+0000","last_clean_scrub_stamp":"2024-02-21T23:13:13.398901+0000","objects_scrubbed":9,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:48:26.357793+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":102574,"num_omap_keys":160,"num_objects_repaired":0},"up":[4,11],"acting":[4,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"35'358","reported_seq":442,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:20.356905+0000","last_change":"2024-02-21T23:13:20.356955+0000","last_active":"2024-02-21T23:13:20.356905+0000","last_peered":"2024-02-21T23:13:20.356905+0000","last_clean":"2024-02-21T23:13:20.356905+0000","last_became_active":"2024-02-21T23:01:07.251670+0000","last_became_peered":"2024-02-21T23:01:07.251670+0000","last_unstale":"2024-02-21T23:13:20.356905+0000","last_undegraded":"2024-02-21T23:13:20.356905+0000","last_fullsized":"2024-02-21T23:13:20.356905+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'358","last_scrub_stamp":"2024-02-21T23:13:20.356785+0000","last_deep_scrub":"35'358","last_deep_scrub_stamp":"2024-02-21T23:13:20.356785+0000","last_clean_scrub_stamp":"2024-02-21T23:13:20.356785+0000","objects_scrubbed":112,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:53:11.516820+0000","scrub_duration":40,"objects_trimmed":0,"snaptrim_duration":0.0033260199999999998,"stat_sum":{"num_bytes":4398222,"num_objects":112,"num_object_clones":0,"num_object_copies":448,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":112,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":314,"num_write_kb":4681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"40'66","reported_seq":171,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:10.006787+0000","last_change":"2024-02-21T23:13:10.004467+0000","last_active":"2024-02-21T23:13:10.006787+0000","last_peered":"2024-02-21T23:13:10.006787+0000","last_clean":"2024-02-21T23:13:10.006787+0000","last_became_active":"2024-02-21T23:01:03.206892+0000","last_became_peered":"2024-02-21T23:01:03.206892+0000","last_unstale":"2024-02-21T23:13:10.006787+0000","last_undegraded":"2024-02-21T23:13:10.006787+0000","last_fullsized":"2024-02-21T23:13:10.006787+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'66","last_scrub_stamp":"2024-02-21T23:13:10.004279+0000","last_deep_scrub":"40'66","last_deep_scrub_stamp":"2024-02-21T23:13:10.004279+0000","last_clean_scrub_stamp":"2024-02-21T23:13:10.004279+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:09:51.286268+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.0079926949999999993,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"42'473","reported_seq":1011,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:11.143994+0000","last_change":"2024-02-21T23:13:11.144051+0000","last_active":"2024-02-21T23:13:11.143994+0000","last_peered":"2024-02-21T23:13:11.143994+0000","last_clean":"2024-02-21T23:13:11.143994+0000","last_became_active":"2024-02-21T23:01:02.209601+0000","last_became_peered":"2024-02-21T23:01:02.209601+0000","last_unstale":"2024-02-21T23:13:11.143994+0000","last_undegraded":"2024-02-21T23:13:11.143994+0000","last_fullsized":"2024-02-21T23:13:11.143994+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'473","last_scrub_stamp":"2024-02-21T23:13:11.143890+0000","last_deep_scrub":"42'473","last_deep_scrub_stamp":"2024-02-21T23:13:11.143890+0000","last_clean_scrub_stamp":"2024-02-21T23:13:11.143890+0000","objects_scrubbed":7,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:12:58.847043+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1592,"num_read_kb":1429,"num_write":908,"num_write_kb":4270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":64994,"num_omap_keys":103,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"35'354","reported_seq":440,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:18.087545+0000","last_change":"2024-02-21T23:13:18.087605+0000","last_active":"2024-02-21T23:13:18.087545+0000","last_peered":"2024-02-21T23:13:18.087545+0000","last_clean":"2024-02-21T23:13:18.087545+0000","last_became_active":"2024-02-21T23:01:07.651431+0000","last_became_peered":"2024-02-21T23:01:07.651431+0000","last_unstale":"2024-02-21T23:13:18.087545+0000","last_undegraded":"2024-02-21T23:13:18.087545+0000","last_fullsized":"2024-02-21T23:13:18.087545+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'354","last_scrub_stamp":"2024-02-21T23:13:18.087406+0000","last_deep_scrub":"35'354","last_deep_scrub_stamp":"2024-02-21T23:13:18.087406+0000","last_clean_scrub_stamp":"2024-02-21T23:13:18.087406+0000","objects_scrubbed":113,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:05:40.869572+0000","scrub_duration":53,"objects_trimmed":0,"snaptrim_duration":0.0051655870000000001,"stat_sum":{"num_bytes":401739,"num_objects":113,"num_object_clones":0,"num_object_copies":452,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":113,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":314,"num_write_kb":708,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"40'71","reported_seq":177,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:11.085664+0000","last_change":"2024-02-21T23:13:11.085664+0000","last_active":"2024-02-21T23:13:11.085664+0000","last_peered":"2024-02-21T23:13:11.085664+0000","last_clean":"2024-02-21T23:13:11.085664+0000","last_became_active":"2024-02-21T23:01:03.221405+0000","last_became_peered":"2024-02-21T23:01:03.221405+0000","last_unstale":"2024-02-21T23:13:11.085664+0000","last_undegraded":"2024-02-21T23:13:11.085664+0000","last_fullsized":"2024-02-21T23:13:11.085664+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'71","last_scrub_stamp":"2024-02-21T23:13:11.085518+0000","last_deep_scrub":"40'71","last_deep_scrub_stamp":"2024-02-21T23:13:11.085518+0000","last_clean_scrub_stamp":"2024-02-21T23:13:11.085518+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:55:09.218092+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.0075840730000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"42'14","reported_seq":77,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:19.098832+0000","last_change":"2024-02-21T23:13:19.098907+0000","last_active":"2024-02-21T23:13:19.098832+0000","last_peered":"2024-02-21T23:13:19.098832+0000","last_clean":"2024-02-21T23:13:19.098832+0000","last_became_active":"2024-02-21T23:01:02.220923+0000","last_became_peered":"2024-02-21T23:01:02.220923+0000","last_unstale":"2024-02-21T23:13:19.098832+0000","last_undegraded":"2024-02-21T23:13:19.098832+0000","last_fullsized":"2024-02-21T23:13:19.098832+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'14","last_scrub_stamp":"2024-02-21T23:13:19.098734+0000","last_deep_scrub":"42'14","last_deep_scrub_stamp":"2024-02-21T23:13:19.098734+0000","last_clean_scrub_stamp":"2024-02-21T23:13:19.098734+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:04:31.437552+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":13,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":89790,"num_omap_keys":146,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"35'343","reported_seq":436,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:22.729108+0000","last_change":"2024-02-21T23:13:22.729156+0000","last_active":"2024-02-21T23:13:22.729108+0000","last_peered":"2024-02-21T23:13:22.729108+0000","last_clean":"2024-02-21T23:13:22.729108+0000","last_became_active":"2024-02-21T23:01:07.268210+0000","last_became_peered":"2024-02-21T23:01:07.268210+0000","last_unstale":"2024-02-21T23:13:22.729108+0000","last_undegraded":"2024-02-21T23:13:22.729108+0000","last_fullsized":"2024-02-21T23:13:22.729108+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'343","last_scrub_stamp":"2024-02-21T23:13:22.729018+0000","last_deep_scrub":"35'343","last_deep_scrub_stamp":"2024-02-21T23:13:22.729018+0000","last_clean_scrub_stamp":"2024-02-21T23:13:22.729018+0000","objects_scrubbed":123,"log_size":343,"log_dups_size":0,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:52:46.811256+0000","scrub_duration":48,"objects_trimmed":0,"snaptrim_duration":0.003384537,"stat_sum":{"num_bytes":377358,"num_objects":123,"num_object_clones":0,"num_object_copies":492,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":123,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":315,"num_write_kb":765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"40'65","reported_seq":170,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:17.975850+0000","last_change":"2024-02-21T23:13:17.975892+0000","last_active":"2024-02-21T23:13:17.975850+0000","last_peered":"2024-02-21T23:13:17.975850+0000","last_clean":"2024-02-21T23:13:17.975850+0000","last_became_active":"2024-02-21T23:01:03.218081+0000","last_became_peered":"2024-02-21T23:01:03.218081+0000","last_unstale":"2024-02-21T23:13:17.975850+0000","last_undegraded":"2024-02-21T23:13:17.975850+0000","last_fullsized":"2024-02-21T23:13:17.975850+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'65","last_scrub_stamp":"2024-02-21T23:13:17.975754+0000","last_deep_scrub":"40'65","last_deep_scrub_stamp":"2024-02-21T23:13:17.975754+0000","last_clean_scrub_stamp":"2024-02-21T23:13:17.975754+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:29:30.438783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001400519,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"41'16","reported_seq":79,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:10.145292+0000","last_change":"2024-02-21T23:13:09.115351+0000","last_active":"2024-02-21T23:13:10.145292+0000","last_peered":"2024-02-21T23:13:10.145292+0000","last_clean":"2024-02-21T23:13:10.145292+0000","last_became_active":"2024-02-21T23:01:02.206426+0000","last_became_peered":"2024-02-21T23:01:02.206426+0000","last_unstale":"2024-02-21T23:13:10.145292+0000","last_undegraded":"2024-02-21T23:13:10.145292+0000","last_fullsized":"2024-02-21T23:13:10.145292+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'16","last_scrub_stamp":"2024-02-21T23:13:09.115194+0000","last_deep_scrub":"41'16","last_deep_scrub_stamp":"2024-02-21T23:13:09.115194+0000","last_clean_scrub_stamp":"2024-02-21T23:13:09.115194+0000","objects_scrubbed":6,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:25:39.892427+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":100431,"num_omap_keys":157,"num_objects_repaired":0},"up":[9,2],"acting":[9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"35'355","reported_seq":443,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:25.090532+0000","last_change":"2024-02-21T23:13:25.090572+0000","last_active":"2024-02-21T23:13:25.090532+0000","last_peered":"2024-02-21T23:13:25.090532+0000","last_clean":"2024-02-21T23:13:25.090532+0000","last_became_active":"2024-02-21T23:01:07.651384+0000","last_became_peered":"2024-02-21T23:01:07.651384+0000","last_unstale":"2024-02-21T23:13:25.090532+0000","last_undegraded":"2024-02-21T23:13:25.090532+0000","last_fullsized":"2024-02-21T23:13:25.090532+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'355","last_scrub_stamp":"2024-02-21T23:13:25.090410+0000","last_deep_scrub":"35'355","last_deep_scrub_stamp":"2024-02-21T23:13:25.090410+0000","last_clean_scrub_stamp":"2024-02-21T23:13:25.090410+0000","objects_scrubbed":113,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:53:16.250445+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0.0040139030000000001,"stat_sum":{"num_bytes":888761,"num_objects":113,"num_object_clones":0,"num_object_copies":452,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":113,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":323,"num_write_kb":1197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"40'74","reported_seq":180,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:15.941583+0000","last_change":"2024-02-21T23:13:15.941583+0000","last_active":"2024-02-21T23:13:15.941583+0000","last_peered":"2024-02-21T23:13:15.941583+0000","last_clean":"2024-02-21T23:13:15.941583+0000","last_became_active":"2024-02-21T23:01:03.210123+0000","last_became_peered":"2024-02-21T23:01:03.210123+0000","last_unstale":"2024-02-21T23:13:15.941583+0000","last_undegraded":"2024-02-21T23:13:15.941583+0000","last_fullsized":"2024-02-21T23:13:15.941583+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'74","last_scrub_stamp":"2024-02-21T23:13:15.941428+0000","last_deep_scrub":"40'74","last_deep_scrub_stamp":"2024-02-21T23:13:15.941428+0000","last_clean_scrub_stamp":"2024-02-21T23:13:15.941428+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:35:22.462378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015019429999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4],"acting":[10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"42'49","reported_seq":133,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:14.725180+0000","last_change":"2024-02-21T23:13:14.725180+0000","last_active":"2024-02-21T23:13:14.725180+0000","last_peered":"2024-02-21T23:13:14.725180+0000","last_clean":"2024-02-21T23:13:14.725180+0000","last_became_active":"2024-02-21T23:01:02.217128+0000","last_became_peered":"2024-02-21T23:01:02.217128+0000","last_unstale":"2024-02-21T23:13:14.725180+0000","last_undegraded":"2024-02-21T23:13:14.725180+0000","last_fullsized":"2024-02-21T23:13:14.725180+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'49","last_scrub_stamp":"2024-02-21T23:13:14.725057+0000","last_deep_scrub":"42'49","last_deep_scrub_stamp":"2024-02-21T23:13:14.725057+0000","last_clean_scrub_stamp":"2024-02-21T23:13:14.725057+0000","objects_scrubbed":11,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:41:54.049226+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":21,"num_read_kb":4097,"num_write":45,"num_write_kb":4258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":140249,"num_omap_keys":224,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"35'307","reported_seq":397,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:17.162393+0000","last_change":"2024-02-21T23:13:17.162427+0000","last_active":"2024-02-21T23:13:17.162393+0000","last_peered":"2024-02-21T23:13:17.162393+0000","last_clean":"2024-02-21T23:13:17.162393+0000","last_became_active":"2024-02-21T23:01:07.266376+0000","last_became_peered":"2024-02-21T23:01:07.266376+0000","last_unstale":"2024-02-21T23:13:17.162393+0000","last_undegraded":"2024-02-21T23:13:17.162393+0000","last_fullsized":"2024-02-21T23:13:17.162393+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'307","last_scrub_stamp":"2024-02-21T23:13:17.162316+0000","last_deep_scrub":"35'307","last_deep_scrub_stamp":"2024-02-21T23:13:17.162316+0000","last_clean_scrub_stamp":"2024-02-21T23:13:17.162316+0000","objects_scrubbed":112,"log_size":307,"log_dups_size":0,"ondisk_log_size":307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:48:30.121208+0000","scrub_duration":54,"objects_trimmed":0,"snaptrim_duration":0.0068521040000000004,"stat_sum":{"num_bytes":252650,"num_objects":112,"num_object_clones":0,"num_object_copies":448,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":112,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":278,"num_write_kb":523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"40'58","reported_seq":164,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:22.200470+0000","last_change":"2024-02-21T23:13:22.200511+0000","last_active":"2024-02-21T23:13:22.200470+0000","last_peered":"2024-02-21T23:13:22.200470+0000","last_clean":"2024-02-21T23:13:22.200470+0000","last_became_active":"2024-02-21T23:01:03.212019+0000","last_became_peered":"2024-02-21T23:01:03.212019+0000","last_unstale":"2024-02-21T23:13:22.200470+0000","last_undegraded":"2024-02-21T23:13:22.200470+0000","last_fullsized":"2024-02-21T23:13:22.200470+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'58","last_scrub_stamp":"2024-02-21T23:13:22.200372+0000","last_deep_scrub":"40'58","last_deep_scrub_stamp":"2024-02-21T23:13:22.200372+0000","last_clean_scrub_stamp":"2024-02-21T23:13:22.200372+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:52:23.592591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041421360000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"41'71","reported_seq":898,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:34.882628+0000","last_change":"2024-02-21T23:13:09.097804+0000","last_active":"2024-02-21T23:13:34.882628+0000","last_peered":"2024-02-21T23:13:34.882628+0000","last_clean":"2024-02-21T23:13:34.882628+0000","last_became_active":"2024-02-21T23:01:02.218570+0000","last_became_peered":"2024-02-21T23:01:02.218570+0000","last_unstale":"2024-02-21T23:13:34.882628+0000","last_undegraded":"2024-02-21T23:13:34.882628+0000","last_fullsized":"2024-02-21T23:13:34.882628+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'71","last_scrub_stamp":"2024-02-21T23:13:09.097624+0000","last_deep_scrub":"41'71","last_deep_scrub_stamp":"2024-02-21T23:13:09.097624+0000","last_clean_scrub_stamp":"2024-02-21T23:13:09.097624+0000","objects_scrubbed":10,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:13:44.699928+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289676,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":764,"num_read_kb":1034,"num_write":69,"num_write_kb":476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":93416,"num_omap_keys":152,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"35'326","reported_seq":415,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:19.106634+0000","last_change":"2024-02-21T23:13:19.106687+0000","last_active":"2024-02-21T23:13:19.106634+0000","last_peered":"2024-02-21T23:13:19.106634+0000","last_clean":"2024-02-21T23:13:19.106634+0000","last_became_active":"2024-02-21T23:01:07.653745+0000","last_became_peered":"2024-02-21T23:01:07.653745+0000","last_unstale":"2024-02-21T23:13:19.106634+0000","last_undegraded":"2024-02-21T23:13:19.106634+0000","last_fullsized":"2024-02-21T23:13:19.106634+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'326","last_scrub_stamp":"2024-02-21T23:13:19.106549+0000","last_deep_scrub":"35'326","last_deep_scrub_stamp":"2024-02-21T23:13:19.106549+0000","last_clean_scrub_stamp":"2024-02-21T23:13:19.106549+0000","objects_scrubbed":111,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:41:58.430719+0000","scrub_duration":54,"objects_trimmed":0,"snaptrim_duration":0.0057630249999999997,"stat_sum":{"num_bytes":1514271,"num_objects":111,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":111,"num_whiteouts":0,"num_read":1,"num_read_kb":1270,"num_write":292,"num_write_kb":1862,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"40'69","reported_seq":175,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:15.112382+0000","last_change":"2024-02-21T23:13:15.112382+0000","last_active":"2024-02-21T23:13:15.112382+0000","last_peered":"2024-02-21T23:13:15.112382+0000","last_clean":"2024-02-21T23:13:15.112382+0000","last_became_active":"2024-02-21T23:01:03.219834+0000","last_became_peered":"2024-02-21T23:01:03.219834+0000","last_unstale":"2024-02-21T23:13:15.112382+0000","last_undegraded":"2024-02-21T23:13:15.112382+0000","last_fullsized":"2024-02-21T23:13:15.112382+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'69","last_scrub_stamp":"2024-02-21T23:13:15.112256+0000","last_deep_scrub":"40'69","last_deep_scrub_stamp":"2024-02-21T23:13:15.112256+0000","last_clean_scrub_stamp":"2024-02-21T23:13:15.112256+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:53:06.272291+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.0064462069999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"42'163","reported_seq":280,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:13.680285+0000","last_change":"2024-02-21T23:13:13.680330+0000","last_active":"2024-02-21T23:13:13.680285+0000","last_peered":"2024-02-21T23:13:13.680285+0000","last_clean":"2024-02-21T23:13:13.680285+0000","last_became_active":"2024-02-21T23:01:02.206146+0000","last_became_peered":"2024-02-21T23:01:02.206146+0000","last_unstale":"2024-02-21T23:13:13.680285+0000","last_undegraded":"2024-02-21T23:13:13.680285+0000","last_fullsized":"2024-02-21T23:13:13.680285+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'163","last_scrub_stamp":"2024-02-21T23:13:13.680203+0000","last_deep_scrub":"42'163","last_deep_scrub_stamp":"2024-02-21T23:13:13.680203+0000","last_clean_scrub_stamp":"2024-02-21T23:13:13.680203+0000","objects_scrubbed":7,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:19:07.864378+0000","scrub_duration":22,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":54,"num_read_kb":8202,"num_write":160,"num_write_kb":8393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":65066,"num_omap_keys":99,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"35'381","reported_seq":464,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:27.204172+0000","last_change":"2024-02-21T23:13:27.204210+0000","last_active":"2024-02-21T23:13:27.204172+0000","last_peered":"2024-02-21T23:13:27.204172+0000","last_clean":"2024-02-21T23:13:27.204172+0000","last_became_active":"2024-02-21T23:01:50.649190+0000","last_became_peered":"2024-02-21T23:01:50.649190+0000","last_unstale":"2024-02-21T23:13:27.204172+0000","last_undegraded":"2024-02-21T23:13:27.204172+0000","last_fullsized":"2024-02-21T23:13:27.204172+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'381","last_scrub_stamp":"2024-02-21T23:13:27.204060+0000","last_deep_scrub":"35'381","last_deep_scrub_stamp":"2024-02-21T23:13:27.204060+0000","last_clean_scrub_stamp":"2024-02-21T23:13:27.204060+0000","objects_scrubbed":109,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:41:44.769343+0000","scrub_duration":52,"objects_trimmed":0,"snaptrim_duration":0.004903569,"stat_sum":{"num_bytes":3892244,"num_objects":109,"num_object_clones":0,"num_object_copies":436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":323,"num_write_kb":4210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,11,6,10],"acting":[5,11,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"40'70","reported_seq":176,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:12.046702+0000","last_change":"2024-02-21T23:13:12.046702+0000","last_active":"2024-02-21T23:13:12.046702+0000","last_peered":"2024-02-21T23:13:12.046702+0000","last_clean":"2024-02-21T23:13:12.046702+0000","last_became_active":"2024-02-21T23:01:03.209007+0000","last_became_peered":"2024-02-21T23:01:03.209007+0000","last_unstale":"2024-02-21T23:13:12.046702+0000","last_undegraded":"2024-02-21T23:13:12.046702+0000","last_fullsized":"2024-02-21T23:13:12.046702+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'70","last_scrub_stamp":"2024-02-21T23:13:12.046546+0000","last_deep_scrub":"40'70","last_deep_scrub_stamp":"2024-02-21T23:13:12.046546+0000","last_clean_scrub_stamp":"2024-02-21T23:13:12.046546+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:52:47.875397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0085662210000000006,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"42'18","reported_seq":83,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:12.397485+0000","last_change":"2024-02-21T23:13:12.397485+0000","last_active":"2024-02-21T23:13:12.397485+0000","last_peered":"2024-02-21T23:13:12.397485+0000","last_clean":"2024-02-21T23:13:12.397485+0000","last_became_active":"2024-02-21T23:01:02.203066+0000","last_became_peered":"2024-02-21T23:01:02.203066+0000","last_unstale":"2024-02-21T23:13:12.397485+0000","last_undegraded":"2024-02-21T23:13:12.397485+0000","last_fullsized":"2024-02-21T23:13:12.397485+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'18","last_scrub_stamp":"2024-02-21T23:13:12.397344+0000","last_deep_scrub":"42'18","last_deep_scrub_stamp":"2024-02-21T23:13:12.397344+0000","last_clean_scrub_stamp":"2024-02-21T23:13:12.397344+0000","objects_scrubbed":9,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:09:16.020428+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":16,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":86379,"num_omap_keys":140,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"42'150","reported_seq":298,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:11.612624+0000","last_change":"2024-02-21T23:13:11.612657+0000","last_active":"2024-02-21T23:13:11.612624+0000","last_peered":"2024-02-21T23:13:11.612624+0000","last_clean":"2024-02-21T23:13:11.612624+0000","last_became_active":"2024-02-21T23:00:58.830472+0000","last_became_peered":"2024-02-21T23:00:58.830472+0000","last_unstale":"2024-02-21T23:13:11.612624+0000","last_undegraded":"2024-02-21T23:13:11.612624+0000","last_fullsized":"2024-02-21T23:13:11.612624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'150","last_scrub_stamp":"2024-02-21T23:13:11.612551+0000","last_deep_scrub":"42'150","last_deep_scrub_stamp":"2024-02-21T23:13:11.612551+0000","last_clean_scrub_stamp":"2024-02-21T23:13:11.612551+0000","objects_scrubbed":2,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:05:27.844212+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"35'303","reported_seq":393,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:23.868595+0000","last_change":"2024-02-21T23:13:23.868637+0000","last_active":"2024-02-21T23:13:23.868595+0000","last_peered":"2024-02-21T23:13:23.868595+0000","last_clean":"2024-02-21T23:13:23.868595+0000","last_became_active":"2024-02-21T23:01:07.276489+0000","last_became_peered":"2024-02-21T23:01:07.276489+0000","last_unstale":"2024-02-21T23:13:23.868595+0000","last_undegraded":"2024-02-21T23:13:23.868595+0000","last_fullsized":"2024-02-21T23:13:23.868595+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'303","last_scrub_stamp":"2024-02-21T23:13:23.868508+0000","last_deep_scrub":"35'303","last_deep_scrub_stamp":"2024-02-21T23:13:23.868508+0000","last_clean_scrub_stamp":"2024-02-21T23:13:23.868508+0000","objects_scrubbed":95,"log_size":303,"log_dups_size":0,"ondisk_log_size":303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:38:05.177887+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0.0031857460000000002,"stat_sum":{"num_bytes":156768,"num_objects":95,"num_object_clones":0,"num_object_copies":380,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":275,"num_write_kb":444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"40'69","reported_seq":174,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:17.659724+0000","last_change":"2024-02-21T23:13:17.659752+0000","last_active":"2024-02-21T23:13:17.659724+0000","last_peered":"2024-02-21T23:13:17.659724+0000","last_clean":"2024-02-21T23:13:17.659724+0000","last_became_active":"2024-02-21T23:01:03.215904+0000","last_became_peered":"2024-02-21T23:01:03.215904+0000","last_unstale":"2024-02-21T23:13:17.659724+0000","last_undegraded":"2024-02-21T23:13:17.659724+0000","last_fullsized":"2024-02-21T23:13:17.659724+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'69","last_scrub_stamp":"2024-02-21T23:13:17.659638+0000","last_deep_scrub":"40'69","last_deep_scrub_stamp":"2024-02-21T23:13:17.659638+0000","last_clean_scrub_stamp":"2024-02-21T23:13:17.659638+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:39:25.146970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0034327609999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"42'15","reported_seq":78,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:15.331738+0000","last_change":"2024-02-21T23:13:15.331773+0000","last_active":"2024-02-21T23:13:15.331738+0000","last_peered":"2024-02-21T23:13:15.331738+0000","last_clean":"2024-02-21T23:13:15.331738+0000","last_became_active":"2024-02-21T23:01:02.206219+0000","last_became_peered":"2024-02-21T23:01:02.206219+0000","last_unstale":"2024-02-21T23:13:15.331738+0000","last_undegraded":"2024-02-21T23:13:15.331738+0000","last_fullsized":"2024-02-21T23:13:15.331738+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'15","last_scrub_stamp":"2024-02-21T23:13:15.331661+0000","last_deep_scrub":"42'15","last_deep_scrub_stamp":"2024-02-21T23:13:15.331661+0000","last_clean_scrub_stamp":"2024-02-21T23:13:15.331661+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:11:47.227453+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":13,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":39336,"num_omap_keys":64,"num_objects_repaired":0},"up":[2,11],"acting":[2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"35'322","reported_seq":416,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:16.397820+0000","last_change":"2024-02-21T23:13:16.397893+0000","last_active":"2024-02-21T23:13:16.397820+0000","last_peered":"2024-02-21T23:13:16.397820+0000","last_clean":"2024-02-21T23:13:16.397820+0000","last_became_active":"2024-02-21T23:01:07.265401+0000","last_became_peered":"2024-02-21T23:01:07.265401+0000","last_unstale":"2024-02-21T23:13:16.397820+0000","last_undegraded":"2024-02-21T23:13:16.397820+0000","last_fullsized":"2024-02-21T23:13:16.397820+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'322","last_scrub_stamp":"2024-02-21T23:13:16.397673+0000","last_deep_scrub":"35'322","last_deep_scrub_stamp":"2024-02-21T23:13:16.397673+0000","last_clean_scrub_stamp":"2024-02-21T23:13:16.397673+0000","objects_scrubbed":114,"log_size":322,"log_dups_size":0,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:55:48.815413+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0.0021836339999999998,"stat_sum":{"num_bytes":312332,"num_objects":114,"num_object_clones":0,"num_object_copies":456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":114,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":302,"num_write_kb":592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"40'80","reported_seq":185,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:21.750380+0000","last_change":"2024-02-21T23:13:21.750416+0000","last_active":"2024-02-21T23:13:21.750380+0000","last_peered":"2024-02-21T23:13:21.750380+0000","last_clean":"2024-02-21T23:13:21.750380+0000","last_became_active":"2024-02-21T23:01:03.220349+0000","last_became_peered":"2024-02-21T23:01:03.220349+0000","last_unstale":"2024-02-21T23:13:21.750380+0000","last_undegraded":"2024-02-21T23:13:21.750380+0000","last_fullsized":"2024-02-21T23:13:21.750380+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'80","last_scrub_stamp":"2024-02-21T23:13:21.750292+0000","last_deep_scrub":"40'80","last_deep_scrub_stamp":"2024-02-21T23:13:21.750292+0000","last_clean_scrub_stamp":"2024-02-21T23:13:21.750292+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T11:02:31.683712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003133243,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"42'209","reported_seq":430,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:15.207121+0000","last_change":"2024-02-21T23:13:15.207162+0000","last_active":"2024-02-21T23:13:15.207121+0000","last_peered":"2024-02-21T23:13:15.207121+0000","last_clean":"2024-02-21T23:13:15.207121+0000","last_became_active":"2024-02-21T23:01:02.205747+0000","last_became_peered":"2024-02-21T23:01:02.205747+0000","last_unstale":"2024-02-21T23:13:15.207121+0000","last_undegraded":"2024-02-21T23:13:15.207121+0000","last_fullsized":"2024-02-21T23:13:15.207121+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'209","last_scrub_stamp":"2024-02-21T23:13:15.207038+0000","last_deep_scrub":"42'209","last_deep_scrub_stamp":"2024-02-21T23:13:15.207038+0000","last_clean_scrub_stamp":"2024-02-21T23:13:15.207038+0000","objects_scrubbed":8,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:19:09.391213+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":328302,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":162,"num_read_kb":161,"num_write":219,"num_write_kb":3247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":111096,"num_omap_keys":169,"num_objects_repaired":0},"up":[5,10],"acting":[5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"35'347","reported_seq":437,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:15.477257+0000","last_change":"2024-02-21T23:13:15.477320+0000","last_active":"2024-02-21T23:13:15.477257+0000","last_peered":"2024-02-21T23:13:15.477257+0000","last_clean":"2024-02-21T23:13:15.477257+0000","last_became_active":"2024-02-21T23:01:07.280193+0000","last_became_peered":"2024-02-21T23:01:07.280193+0000","last_unstale":"2024-02-21T23:13:15.477257+0000","last_undegraded":"2024-02-21T23:13:15.477257+0000","last_fullsized":"2024-02-21T23:13:15.477257+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'347","last_scrub_stamp":"2024-02-21T23:13:15.477129+0000","last_deep_scrub":"35'347","last_deep_scrub_stamp":"2024-02-21T23:13:15.477129+0000","last_clean_scrub_stamp":"2024-02-21T23:13:15.477129+0000","objects_scrubbed":114,"log_size":347,"log_dups_size":0,"ondisk_log_size":347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:52:51.305981+0000","scrub_duration":54,"objects_trimmed":0,"snaptrim_duration":0.003048345,"stat_sum":{"num_bytes":4515871,"num_objects":114,"num_object_clones":0,"num_object_copies":456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":114,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":315,"num_write_kb":4679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"40'68","reported_seq":173,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:19.680276+0000","last_change":"2024-02-21T23:13:19.680321+0000","last_active":"2024-02-21T23:13:19.680276+0000","last_peered":"2024-02-21T23:13:19.680276+0000","last_clean":"2024-02-21T23:13:19.680276+0000","last_became_active":"2024-02-21T23:01:03.216578+0000","last_became_peered":"2024-02-21T23:01:03.216578+0000","last_unstale":"2024-02-21T23:13:19.680276+0000","last_undegraded":"2024-02-21T23:13:19.680276+0000","last_fullsized":"2024-02-21T23:13:19.680276+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'68","last_scrub_stamp":"2024-02-21T23:13:19.680169+0000","last_deep_scrub":"40'68","last_deep_scrub_stamp":"2024-02-21T23:13:19.680169+0000","last_clean_scrub_stamp":"2024-02-21T23:13:19.680169+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:47:45.076063+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.0031926939999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11],"acting":[7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"42'7","reported_seq":69,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:10.121023+0000","last_change":"2024-02-21T23:13:10.121069+0000","last_active":"2024-02-21T23:13:10.121023+0000","last_peered":"2024-02-21T23:13:10.121023+0000","last_clean":"2024-02-21T23:13:10.121023+0000","last_became_active":"2024-02-21T23:01:02.220554+0000","last_became_peered":"2024-02-21T23:01:02.220554+0000","last_unstale":"2024-02-21T23:13:10.121023+0000","last_undegraded":"2024-02-21T23:13:10.121023+0000","last_fullsized":"2024-02-21T23:13:10.121023+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'7","last_scrub_stamp":"2024-02-21T23:13:10.120905+0000","last_deep_scrub":"42'7","last_deep_scrub_stamp":"2024-02-21T23:13:10.120905+0000","last_clean_scrub_stamp":"2024-02-21T23:13:10.120905+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:11:42.016697+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":14145,"num_omap_keys":23,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"35'327","reported_seq":417,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:24.149196+0000","last_change":"2024-02-21T23:13:24.149238+0000","last_active":"2024-02-21T23:13:24.149196+0000","last_peered":"2024-02-21T23:13:24.149196+0000","last_clean":"2024-02-21T23:13:24.149196+0000","last_became_active":"2024-02-21T23:01:07.257011+0000","last_became_peered":"2024-02-21T23:01:07.257011+0000","last_unstale":"2024-02-21T23:13:24.149196+0000","last_undegraded":"2024-02-21T23:13:24.149196+0000","last_fullsized":"2024-02-21T23:13:24.149196+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'327","last_scrub_stamp":"2024-02-21T23:13:24.149102+0000","last_deep_scrub":"35'327","last_deep_scrub_stamp":"2024-02-21T23:13:24.149102+0000","last_clean_scrub_stamp":"2024-02-21T23:13:24.149102+0000","objects_scrubbed":108,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:05:46.931267+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0.0037009130000000001,"stat_sum":{"num_bytes":448215,"num_objects":108,"num_object_clones":0,"num_object_copies":432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":292,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"40'48","reported_seq":153,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:15.659787+0000","last_change":"2024-02-21T23:13:15.659835+0000","last_active":"2024-02-21T23:13:15.659787+0000","last_peered":"2024-02-21T23:13:15.659787+0000","last_clean":"2024-02-21T23:13:15.659787+0000","last_became_active":"2024-02-21T23:01:03.211467+0000","last_became_peered":"2024-02-21T23:01:03.211467+0000","last_unstale":"2024-02-21T23:13:15.659787+0000","last_undegraded":"2024-02-21T23:13:15.659787+0000","last_fullsized":"2024-02-21T23:13:15.659787+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'48","last_scrub_stamp":"2024-02-21T23:13:15.659688+0000","last_deep_scrub":"40'48","last_deep_scrub_stamp":"2024-02-21T23:13:15.659688+0000","last_clean_scrub_stamp":"2024-02-21T23:13:15.659688+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:15:14.315004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0054206840000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5],"acting":[11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"42'25","reported_seq":88,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:18.061981+0000","last_change":"2024-02-21T23:13:18.062030+0000","last_active":"2024-02-21T23:13:18.061981+0000","last_peered":"2024-02-21T23:13:18.061981+0000","last_clean":"2024-02-21T23:13:18.061981+0000","last_became_active":"2024-02-21T23:01:02.211470+0000","last_became_peered":"2024-02-21T23:01:02.211470+0000","last_unstale":"2024-02-21T23:13:18.061981+0000","last_undegraded":"2024-02-21T23:13:18.061981+0000","last_fullsized":"2024-02-21T23:13:18.061981+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'25","last_scrub_stamp":"2024-02-21T23:13:18.061888+0000","last_deep_scrub":"42'25","last_deep_scrub_stamp":"2024-02-21T23:13:18.061888+0000","last_clean_scrub_stamp":"2024-02-21T23:13:18.061888+0000","objects_scrubbed":10,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:12:24.381432+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":24,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94863,"num_omap_keys":152,"num_objects_repaired":0},"up":[8,5],"acting":[8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"35'322","reported_seq":416,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:26.160556+0000","last_change":"2024-02-21T23:13:26.160593+0000","last_active":"2024-02-21T23:13:26.160556+0000","last_peered":"2024-02-21T23:13:26.160556+0000","last_clean":"2024-02-21T23:13:26.160556+0000","last_became_active":"2024-02-21T23:01:07.268681+0000","last_became_peered":"2024-02-21T23:01:07.268681+0000","last_unstale":"2024-02-21T23:13:26.160556+0000","last_undegraded":"2024-02-21T23:13:26.160556+0000","last_fullsized":"2024-02-21T23:13:26.160556+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'322","last_scrub_stamp":"2024-02-21T23:13:26.160470+0000","last_deep_scrub":"35'322","last_deep_scrub_stamp":"2024-02-21T23:13:26.160470+0000","last_clean_scrub_stamp":"2024-02-21T23:13:26.160470+0000","objects_scrubbed":113,"log_size":322,"log_dups_size":0,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:11:15.443201+0000","scrub_duration":45,"objects_trimmed":0,"snaptrim_duration":0.003843469,"stat_sum":{"num_bytes":365874,"num_objects":113,"num_object_clones":0,"num_object_copies":452,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":113,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":301,"num_write_kb":637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"40'80","reported_seq":185,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:20.150045+0000","last_change":"2024-02-21T23:13:20.150070+0000","last_active":"2024-02-21T23:13:20.150045+0000","last_peered":"2024-02-21T23:13:20.150045+0000","last_clean":"2024-02-21T23:13:20.150045+0000","last_became_active":"2024-02-21T23:01:03.212634+0000","last_became_peered":"2024-02-21T23:01:03.212634+0000","last_unstale":"2024-02-21T23:13:20.150045+0000","last_undegraded":"2024-02-21T23:13:20.150045+0000","last_fullsized":"2024-02-21T23:13:20.150045+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'80","last_scrub_stamp":"2024-02-21T23:13:20.149963+0000","last_deep_scrub":"40'80","last_deep_scrub_stamp":"2024-02-21T23:13:20.149963+0000","last_clean_scrub_stamp":"2024-02-21T23:13:20.149963+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:52:44.232201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0044168710000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"42'37","reported_seq":100,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:20.053338+0000","last_change":"2024-02-21T23:13:20.053394+0000","last_active":"2024-02-21T23:13:20.053338+0000","last_peered":"2024-02-21T23:13:20.053338+0000","last_clean":"2024-02-21T23:13:20.053338+0000","last_became_active":"2024-02-21T23:01:02.221642+0000","last_became_peered":"2024-02-21T23:01:02.221642+0000","last_unstale":"2024-02-21T23:13:20.053338+0000","last_undegraded":"2024-02-21T23:13:20.053338+0000","last_fullsized":"2024-02-21T23:13:20.053338+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'37","last_scrub_stamp":"2024-02-21T23:13:20.053261+0000","last_deep_scrub":"42'37","last_deep_scrub_stamp":"2024-02-21T23:13:20.053261+0000","last_clean_scrub_stamp":"2024-02-21T23:13:20.053261+0000","objects_scrubbed":11,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:07:34.018019+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":39,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":48861,"num_omap_keys":74,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"35'397","reported_seq":470,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:18.106365+0000","last_change":"2024-02-21T23:13:18.106439+0000","last_active":"2024-02-21T23:13:18.106365+0000","last_peered":"2024-02-21T23:13:18.106365+0000","last_clean":"2024-02-21T23:13:18.106365+0000","last_became_active":"2024-02-21T23:01:07.267874+0000","last_became_peered":"2024-02-21T23:01:07.267874+0000","last_unstale":"2024-02-21T23:13:18.106365+0000","last_undegraded":"2024-02-21T23:13:18.106365+0000","last_fullsized":"2024-02-21T23:13:18.106365+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'397","last_scrub_stamp":"2024-02-21T23:13:18.106233+0000","last_deep_scrub":"35'397","last_deep_scrub_stamp":"2024-02-21T23:13:18.106233+0000","last_clean_scrub_stamp":"2024-02-21T23:13:18.106233+0000","objects_scrubbed":108,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:19:12.290408+0000","scrub_duration":46,"objects_trimmed":0,"snaptrim_duration":0.0066329539999999999,"stat_sum":{"num_bytes":500979,"num_objects":108,"num_object_clones":0,"num_object_copies":432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":334,"num_write_kb":931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"40'60","reported_seq":165,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:18.693620+0000","last_change":"2024-02-21T23:13:18.693649+0000","last_active":"2024-02-21T23:13:18.693620+0000","last_peered":"2024-02-21T23:13:18.693620+0000","last_clean":"2024-02-21T23:13:18.693620+0000","last_became_active":"2024-02-21T23:01:03.216466+0000","last_became_peered":"2024-02-21T23:01:03.216466+0000","last_unstale":"2024-02-21T23:13:18.693620+0000","last_undegraded":"2024-02-21T23:13:18.693620+0000","last_fullsized":"2024-02-21T23:13:18.693620+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'60","last_scrub_stamp":"2024-02-21T23:13:18.693530+0000","last_deep_scrub":"40'60","last_deep_scrub_stamp":"2024-02-21T23:13:18.693530+0000","last_clean_scrub_stamp":"2024-02-21T23:13:18.693530+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T00:52:42.775768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0030070510000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"42'23","reported_seq":810,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:33.881518+0000","last_change":"2024-02-21T23:13:11.358676+0000","last_active":"2024-02-21T23:13:33.881518+0000","last_peered":"2024-02-21T23:13:33.881518+0000","last_clean":"2024-02-21T23:13:33.881518+0000","last_became_active":"2024-02-21T23:01:02.198709+0000","last_became_peered":"2024-02-21T23:01:02.198709+0000","last_unstale":"2024-02-21T23:13:33.881518+0000","last_undegraded":"2024-02-21T23:13:33.881518+0000","last_fullsized":"2024-02-21T23:13:33.881518+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'23","last_scrub_stamp":"2024-02-21T23:13:11.358535+0000","last_deep_scrub":"42'23","last_deep_scrub_stamp":"2024-02-21T23:13:11.358535+0000","last_clean_scrub_stamp":"2024-02-21T23:13:11.358535+0000","objects_scrubbed":9,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:15:10.013851+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1124,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":726,"num_read_kb":5,"num_write":18,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":96021,"num_omap_keys":151,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"35'357","reported_seq":437,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:15.178495+0000","last_change":"2024-02-21T23:13:15.178649+0000","last_active":"2024-02-21T23:13:15.178495+0000","last_peered":"2024-02-21T23:13:15.178495+0000","last_clean":"2024-02-21T23:13:15.178495+0000","last_became_active":"2024-02-21T23:01:07.277289+0000","last_became_peered":"2024-02-21T23:01:07.277289+0000","last_unstale":"2024-02-21T23:13:15.178495+0000","last_undegraded":"2024-02-21T23:13:15.178495+0000","last_fullsized":"2024-02-21T23:13:15.178495+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'357","last_scrub_stamp":"2024-02-21T23:13:15.178361+0000","last_deep_scrub":"35'357","last_deep_scrub_stamp":"2024-02-21T23:13:15.178361+0000","last_clean_scrub_stamp":"2024-02-21T23:13:15.178361+0000","objects_scrubbed":98,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:12:21.497905+0000","scrub_duration":48,"objects_trimmed":0,"snaptrim_duration":0.0038048510000000002,"stat_sum":{"num_bytes":280914,"num_objects":98,"num_object_clones":0,"num_object_copies":392,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":308,"num_write_kb":627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"40'84","reported_seq":189,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:16.654192+0000","last_change":"2024-02-21T23:13:16.654222+0000","last_active":"2024-02-21T23:13:16.654192+0000","last_peered":"2024-02-21T23:13:16.654192+0000","last_clean":"2024-02-21T23:13:16.654192+0000","last_became_active":"2024-02-21T23:01:03.214507+0000","last_became_peered":"2024-02-21T23:01:03.214507+0000","last_unstale":"2024-02-21T23:13:16.654192+0000","last_undegraded":"2024-02-21T23:13:16.654192+0000","last_fullsized":"2024-02-21T23:13:16.654192+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'84","last_scrub_stamp":"2024-02-21T23:13:16.654092+0000","last_deep_scrub":"40'84","last_deep_scrub_stamp":"2024-02-21T23:13:16.654092+0000","last_clean_scrub_stamp":"2024-02-21T23:13:16.654092+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:52:52.482944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003048425,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"42'27","reported_seq":89,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:17.221428+0000","last_change":"2024-02-21T23:13:17.221462+0000","last_active":"2024-02-21T23:13:17.221428+0000","last_peered":"2024-02-21T23:13:17.221428+0000","last_clean":"2024-02-21T23:13:17.221428+0000","last_became_active":"2024-02-21T23:01:02.208990+0000","last_became_peered":"2024-02-21T23:01:02.208990+0000","last_unstale":"2024-02-21T23:13:17.221428+0000","last_undegraded":"2024-02-21T23:13:17.221428+0000","last_fullsized":"2024-02-21T23:13:17.221428+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'27","last_scrub_stamp":"2024-02-21T23:13:17.221354+0000","last_deep_scrub":"42'27","last_deep_scrub_stamp":"2024-02-21T23:13:17.221354+0000","last_clean_scrub_stamp":"2024-02-21T23:13:17.221354+0000","objects_scrubbed":12,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:02:22.645249+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":120824,"num_omap_keys":193,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"35'314","reported_seq":404,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:24.794961+0000","last_change":"2024-02-21T23:13:24.794996+0000","last_active":"2024-02-21T23:13:24.794961+0000","last_peered":"2024-02-21T23:13:24.794961+0000","last_clean":"2024-02-21T23:13:24.794961+0000","last_became_active":"2024-02-21T23:01:50.649153+0000","last_became_peered":"2024-02-21T23:01:50.649153+0000","last_unstale":"2024-02-21T23:13:24.794961+0000","last_undegraded":"2024-02-21T23:13:24.794961+0000","last_fullsized":"2024-02-21T23:13:24.794961+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'314","last_scrub_stamp":"2024-02-21T23:13:24.794863+0000","last_deep_scrub":"35'314","last_deep_scrub_stamp":"2024-02-21T23:13:24.794863+0000","last_clean_scrub_stamp":"2024-02-21T23:13:24.794863+0000","objects_scrubbed":113,"log_size":314,"log_dups_size":0,"ondisk_log_size":314,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:52:26.187082+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0.0055873019999999997,"stat_sum":{"num_bytes":262334,"num_objects":113,"num_object_clones":0,"num_object_copies":452,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":113,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":267,"num_write_kb":565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,7,6],"acting":[11,8,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"40'62","reported_seq":167,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:14.076803+0000","last_change":"2024-02-21T23:13:14.076861+0000","last_active":"2024-02-21T23:13:14.076803+0000","last_peered":"2024-02-21T23:13:14.076803+0000","last_clean":"2024-02-21T23:13:14.076803+0000","last_became_active":"2024-02-21T23:01:03.224451+0000","last_became_peered":"2024-02-21T23:01:03.224451+0000","last_unstale":"2024-02-21T23:13:14.076803+0000","last_undegraded":"2024-02-21T23:13:14.076803+0000","last_fullsized":"2024-02-21T23:13:14.076803+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'62","last_scrub_stamp":"2024-02-21T23:13:14.076679+0000","last_deep_scrub":"40'62","last_deep_scrub_stamp":"2024-02-21T23:13:14.076679+0000","last_clean_scrub_stamp":"2024-02-21T23:13:14.076679+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:16:26.925446+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.0075807410000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"42'166","reported_seq":802,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:33.642625+0000","last_change":"2024-02-21T23:13:14.338731+0000","last_active":"2024-02-21T23:13:33.642625+0000","last_peered":"2024-02-21T23:13:33.642625+0000","last_clean":"2024-02-21T23:13:33.642625+0000","last_became_active":"2024-02-21T23:01:02.203081+0000","last_became_peered":"2024-02-21T23:01:02.203081+0000","last_unstale":"2024-02-21T23:13:33.642625+0000","last_undegraded":"2024-02-21T23:13:33.642625+0000","last_fullsized":"2024-02-21T23:13:33.642625+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'166","last_scrub_stamp":"2024-02-21T23:13:14.338613+0000","last_deep_scrub":"42'166","last_deep_scrub_stamp":"2024-02-21T23:13:14.338613+0000","last_clean_scrub_stamp":"2024-02-21T23:13:14.338613+0000","objects_scrubbed":10,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:13:49.940917+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8064145,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":574,"num_read_kb":7906,"num_write":162,"num_write_kb":8023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":55414,"num_omap_keys":92,"num_objects_repaired":0},"up":[2,10],"acting":[2,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"35'326","reported_seq":412,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:25.206742+0000","last_change":"2024-02-21T23:13:25.206799+0000","last_active":"2024-02-21T23:13:25.206742+0000","last_peered":"2024-02-21T23:13:25.206742+0000","last_clean":"2024-02-21T23:13:25.206742+0000","last_became_active":"2024-02-21T23:01:07.268436+0000","last_became_peered":"2024-02-21T23:01:07.268436+0000","last_unstale":"2024-02-21T23:13:25.206742+0000","last_undegraded":"2024-02-21T23:13:25.206742+0000","last_fullsized":"2024-02-21T23:13:25.206742+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'326","last_scrub_stamp":"2024-02-21T23:13:25.206638+0000","last_deep_scrub":"35'326","last_deep_scrub_stamp":"2024-02-21T23:13:25.206638+0000","last_clean_scrub_stamp":"2024-02-21T23:13:25.206638+0000","objects_scrubbed":97,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:38:06.516017+0000","scrub_duration":46,"objects_trimmed":0,"snaptrim_duration":0.0044097060000000002,"stat_sum":{"num_bytes":527021,"num_objects":97,"num_object_clones":0,"num_object_copies":388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":97,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":289,"num_write_kb":781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"40'68","reported_seq":173,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:23.021508+0000","last_change":"2024-02-21T23:13:23.021533+0000","last_active":"2024-02-21T23:13:23.021508+0000","last_peered":"2024-02-21T23:13:23.021508+0000","last_clean":"2024-02-21T23:13:23.021508+0000","last_became_active":"2024-02-21T23:01:03.215888+0000","last_became_peered":"2024-02-21T23:01:03.215888+0000","last_unstale":"2024-02-21T23:13:23.021508+0000","last_undegraded":"2024-02-21T23:13:23.021508+0000","last_fullsized":"2024-02-21T23:13:23.021508+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'68","last_scrub_stamp":"2024-02-21T23:13:23.021422+0000","last_deep_scrub":"40'68","last_deep_scrub_stamp":"2024-02-21T23:13:23.021422+0000","last_clean_scrub_stamp":"2024-02-21T23:13:23.021422+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:06:40.471938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036458770000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"42'116","reported_seq":1102,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:33.641840+0000","last_change":"2024-02-21T23:13:11.962394+0000","last_active":"2024-02-21T23:13:33.641840+0000","last_peered":"2024-02-21T23:13:33.641840+0000","last_clean":"2024-02-21T23:13:33.641840+0000","last_became_active":"2024-02-21T23:01:02.204123+0000","last_became_peered":"2024-02-21T23:01:02.204123+0000","last_unstale":"2024-02-21T23:13:33.641840+0000","last_undegraded":"2024-02-21T23:13:33.641840+0000","last_fullsized":"2024-02-21T23:13:33.641840+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'116","last_scrub_stamp":"2024-02-21T23:13:11.962263+0000","last_deep_scrub":"42'116","last_deep_scrub_stamp":"2024-02-21T23:13:11.962263+0000","last_clean_scrub_stamp":"2024-02-21T23:13:11.962263+0000","objects_scrubbed":13,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:25:35.416968+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":924,"num_read_kb":4854,"num_write":112,"num_write_kb":4275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":113191,"num_omap_keys":182,"num_objects_repaired":0},"up":[10,1],"acting":[10,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"35'330","reported_seq":418,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:14.156809+0000","last_change":"2024-02-21T23:13:14.156866+0000","last_active":"2024-02-21T23:13:14.156809+0000","last_peered":"2024-02-21T23:13:14.156809+0000","last_clean":"2024-02-21T23:13:14.156809+0000","last_became_active":"2024-02-21T23:01:07.265618+0000","last_became_peered":"2024-02-21T23:01:07.265618+0000","last_unstale":"2024-02-21T23:13:14.156809+0000","last_undegraded":"2024-02-21T23:13:14.156809+0000","last_fullsized":"2024-02-21T23:13:14.156809+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'330","last_scrub_stamp":"2024-02-21T23:13:14.156674+0000","last_deep_scrub":"35'330","last_deep_scrub_stamp":"2024-02-21T23:13:14.156674+0000","last_clean_scrub_stamp":"2024-02-21T23:13:14.156674+0000","objects_scrubbed":108,"log_size":330,"log_dups_size":0,"ondisk_log_size":330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:33:40.256379+0000","scrub_duration":48,"objects_trimmed":0,"snaptrim_duration":0.0045476609999999997,"stat_sum":{"num_bytes":397479,"num_objects":108,"num_object_clones":0,"num_object_copies":432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":298,"num_write_kb":795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"40'66","reported_seq":171,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:13.419954+0000","last_change":"2024-02-21T23:13:13.419996+0000","last_active":"2024-02-21T23:13:13.419954+0000","last_peered":"2024-02-21T23:13:13.419954+0000","last_clean":"2024-02-21T23:13:13.419954+0000","last_became_active":"2024-02-21T23:01:03.214580+0000","last_became_peered":"2024-02-21T23:01:03.214580+0000","last_unstale":"2024-02-21T23:13:13.419954+0000","last_undegraded":"2024-02-21T23:13:13.419954+0000","last_fullsized":"2024-02-21T23:13:13.419954+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'66","last_scrub_stamp":"2024-02-21T23:13:13.419817+0000","last_deep_scrub":"40'66","last_deep_scrub_stamp":"2024-02-21T23:13:13.419817+0000","last_clean_scrub_stamp":"2024-02-21T23:13:13.419817+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:13:49.022122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022134519999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8],"acting":[1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"42'44","reported_seq":107,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:18.232018+0000","last_change":"2024-02-21T23:13:18.232058+0000","last_active":"2024-02-21T23:13:18.232018+0000","last_peered":"2024-02-21T23:13:18.232018+0000","last_clean":"2024-02-21T23:13:18.232018+0000","last_became_active":"2024-02-21T23:01:02.221735+0000","last_became_peered":"2024-02-21T23:01:02.221735+0000","last_unstale":"2024-02-21T23:13:18.232018+0000","last_undegraded":"2024-02-21T23:13:18.232018+0000","last_fullsized":"2024-02-21T23:13:18.232018+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'44","last_scrub_stamp":"2024-02-21T23:13:18.231927+0000","last_deep_scrub":"42'44","last_deep_scrub_stamp":"2024-02-21T23:13:18.231927+0000","last_clean_scrub_stamp":"2024-02-21T23:13:18.231927+0000","objects_scrubbed":11,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:52:54.060779+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":43,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":135268,"num_omap_keys":220,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"35'359","reported_seq":436,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:18.408823+0000","last_change":"2024-02-21T23:13:18.408869+0000","last_active":"2024-02-21T23:13:18.408823+0000","last_peered":"2024-02-21T23:13:18.408823+0000","last_clean":"2024-02-21T23:13:18.408823+0000","last_became_active":"2024-02-21T23:01:07.275982+0000","last_became_peered":"2024-02-21T23:01:07.275982+0000","last_unstale":"2024-02-21T23:13:18.408823+0000","last_undegraded":"2024-02-21T23:13:18.408823+0000","last_fullsized":"2024-02-21T23:13:18.408823+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'359","last_scrub_stamp":"2024-02-21T23:13:18.408715+0000","last_deep_scrub":"35'359","last_deep_scrub_stamp":"2024-02-21T23:13:18.408715+0000","last_clean_scrub_stamp":"2024-02-21T23:13:18.408715+0000","objects_scrubbed":99,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:53:29.839852+0000","scrub_duration":34,"objects_trimmed":0,"snaptrim_duration":0.0033710960000000001,"stat_sum":{"num_bytes":644576,"num_objects":99,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":303,"num_write_kb":1079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"40'78","reported_seq":183,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:12.398594+0000","last_change":"2024-02-21T23:13:12.398643+0000","last_active":"2024-02-21T23:13:12.398594+0000","last_peered":"2024-02-21T23:13:12.398594+0000","last_clean":"2024-02-21T23:13:12.398594+0000","last_became_active":"2024-02-21T23:01:03.229193+0000","last_became_peered":"2024-02-21T23:01:03.229193+0000","last_unstale":"2024-02-21T23:13:12.398594+0000","last_undegraded":"2024-02-21T23:13:12.398594+0000","last_fullsized":"2024-02-21T23:13:12.398594+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'78","last_scrub_stamp":"2024-02-21T23:13:12.398471+0000","last_deep_scrub":"40'78","last_deep_scrub_stamp":"2024-02-21T23:13:12.398471+0000","last_clean_scrub_stamp":"2024-02-21T23:13:12.398471+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:19:06.582646+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.0041575850000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"42'5","reported_seq":67,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:12.648549+0000","last_change":"2024-02-21T23:13:12.648583+0000","last_active":"2024-02-21T23:13:12.648549+0000","last_peered":"2024-02-21T23:13:12.648549+0000","last_clean":"2024-02-21T23:13:12.648549+0000","last_became_active":"2024-02-21T23:01:02.197275+0000","last_became_peered":"2024-02-21T23:01:02.197275+0000","last_unstale":"2024-02-21T23:13:12.648549+0000","last_undegraded":"2024-02-21T23:13:12.648549+0000","last_fullsized":"2024-02-21T23:13:12.648549+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'5","last_scrub_stamp":"2024-02-21T23:13:12.648468+0000","last_deep_scrub":"42'5","last_deep_scrub_stamp":"2024-02-21T23:13:12.648468+0000","last_clean_scrub_stamp":"2024-02-21T23:13:12.648468+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:48:25.607359+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8202,"num_omap_keys":12,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"35'338","reported_seq":423,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:26.049838+0000","last_change":"2024-02-21T23:13:26.049838+0000","last_active":"2024-02-21T23:13:26.049838+0000","last_peered":"2024-02-21T23:13:26.049838+0000","last_clean":"2024-02-21T23:13:26.049838+0000","last_became_active":"2024-02-21T23:01:50.554591+0000","last_became_peered":"2024-02-21T23:01:50.554591+0000","last_unstale":"2024-02-21T23:13:26.049838+0000","last_undegraded":"2024-02-21T23:13:26.049838+0000","last_fullsized":"2024-02-21T23:13:26.049838+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'338","last_scrub_stamp":"2024-02-21T23:13:26.049700+0000","last_deep_scrub":"35'338","last_deep_scrub_stamp":"2024-02-21T23:13:26.049700+0000","last_clean_scrub_stamp":"2024-02-21T23:13:26.049700+0000","objects_scrubbed":124,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:05:42.281361+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0.0039370250000000002,"stat_sum":{"num_bytes":332054,"num_objects":124,"num_object_clones":0,"num_object_copies":496,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":124,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":310,"num_write_kb":722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2,4],"acting":[8,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.16","version":"40'88","reported_seq":193,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:10.437029+0000","last_change":"2024-02-21T23:13:10.437057+0000","last_active":"2024-02-21T23:13:10.437029+0000","last_peered":"2024-02-21T23:13:10.437029+0000","last_clean":"2024-02-21T23:13:10.437029+0000","last_became_active":"2024-02-21T23:01:03.215004+0000","last_became_peered":"2024-02-21T23:01:03.215004+0000","last_unstale":"2024-02-21T23:13:10.437029+0000","last_undegraded":"2024-02-21T23:13:10.437029+0000","last_fullsized":"2024-02-21T23:13:10.437029+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'88","last_scrub_stamp":"2024-02-21T23:13:10.436943+0000","last_deep_scrub":"40'88","last_deep_scrub_stamp":"2024-02-21T23:13:10.436943+0000","last_clean_scrub_stamp":"2024-02-21T23:13:10.436943+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:12:32.302741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00222376,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10],"acting":[1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"42'23","reported_seq":806,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:33.806566+0000","last_change":"2024-02-21T23:13:12.962443+0000","last_active":"2024-02-21T23:13:33.806566+0000","last_peered":"2024-02-21T23:13:33.806566+0000","last_clean":"2024-02-21T23:13:33.806566+0000","last_became_active":"2024-02-21T23:01:02.207349+0000","last_became_peered":"2024-02-21T23:01:02.207349+0000","last_unstale":"2024-02-21T23:13:33.806566+0000","last_undegraded":"2024-02-21T23:13:33.806566+0000","last_fullsized":"2024-02-21T23:13:33.806566+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'23","last_scrub_stamp":"2024-02-21T23:13:12.962327+0000","last_deep_scrub":"42'23","last_deep_scrub_stamp":"2024-02-21T23:13:12.962327+0000","last_clean_scrub_stamp":"2024-02-21T23:13:12.962327+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:24:55.783839+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":721,"num_read_kb":721,"num_write":22,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":108855,"num_omap_keys":177,"num_objects_repaired":0},"up":[10,5],"acting":[10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"35'344","reported_seq":428,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:17.053269+0000","last_change":"2024-02-21T23:13:17.053346+0000","last_active":"2024-02-21T23:13:17.053269+0000","last_peered":"2024-02-21T23:13:17.053269+0000","last_clean":"2024-02-21T23:13:17.053269+0000","last_became_active":"2024-02-21T23:01:07.268193+0000","last_became_peered":"2024-02-21T23:01:07.268193+0000","last_unstale":"2024-02-21T23:13:17.053269+0000","last_undegraded":"2024-02-21T23:13:17.053269+0000","last_fullsized":"2024-02-21T23:13:17.053269+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'344","last_scrub_stamp":"2024-02-21T23:13:17.053126+0000","last_deep_scrub":"35'344","last_deep_scrub_stamp":"2024-02-21T23:13:17.053126+0000","last_clean_scrub_stamp":"2024-02-21T23:13:17.053126+0000","objects_scrubbed":93,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:19:39.802478+0000","scrub_duration":44,"objects_trimmed":0,"snaptrim_duration":0.0080841690000000004,"stat_sum":{"num_bytes":737229,"num_objects":93,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":303,"num_write_kb":1054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"35'297","reported_seq":388,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:14.433727+0000","last_change":"2024-02-21T23:13:14.433727+0000","last_active":"2024-02-21T23:13:14.433727+0000","last_peered":"2024-02-21T23:13:14.433727+0000","last_clean":"2024-02-21T23:13:14.433727+0000","last_became_active":"2024-02-21T23:01:07.271175+0000","last_became_peered":"2024-02-21T23:01:07.271175+0000","last_unstale":"2024-02-21T23:13:14.433727+0000","last_undegraded":"2024-02-21T23:13:14.433727+0000","last_fullsized":"2024-02-21T23:13:14.433727+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'297","last_scrub_stamp":"2024-02-21T23:13:14.433520+0000","last_deep_scrub":"35'297","last_deep_scrub_stamp":"2024-02-21T23:13:14.433520+0000","last_clean_scrub_stamp":"2024-02-21T23:13:14.433520+0000","objects_scrubbed":97,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:02:19.857415+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0.0039500689999999996,"stat_sum":{"num_bytes":430239,"num_objects":97,"num_object_clones":0,"num_object_copies":388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":97,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":271,"num_write_kb":710,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"40'84","reported_seq":189,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:12.147110+0000","last_change":"2024-02-21T23:13:12.147110+0000","last_active":"2024-02-21T23:13:12.147110+0000","last_peered":"2024-02-21T23:13:12.147110+0000","last_clean":"2024-02-21T23:13:12.147110+0000","last_became_active":"2024-02-21T23:01:03.210599+0000","last_became_peered":"2024-02-21T23:01:03.210599+0000","last_unstale":"2024-02-21T23:13:12.147110+0000","last_undegraded":"2024-02-21T23:13:12.147110+0000","last_fullsized":"2024-02-21T23:13:12.147110+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'84","last_scrub_stamp":"2024-02-21T23:13:12.146947+0000","last_deep_scrub":"40'84","last_deep_scrub_stamp":"2024-02-21T23:13:12.146947+0000","last_clean_scrub_stamp":"2024-02-21T23:13:12.146947+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T03:20:45.283851+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.0022244510000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"42'13","reported_seq":75,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:14.211287+0000","last_change":"2024-02-21T23:13:14.211317+0000","last_active":"2024-02-21T23:13:14.211287+0000","last_peered":"2024-02-21T23:13:14.211287+0000","last_clean":"2024-02-21T23:13:14.211287+0000","last_became_active":"2024-02-21T23:01:02.204304+0000","last_became_peered":"2024-02-21T23:01:02.204304+0000","last_unstale":"2024-02-21T23:13:14.211287+0000","last_undegraded":"2024-02-21T23:13:14.211287+0000","last_fullsized":"2024-02-21T23:13:14.211287+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'13","last_scrub_stamp":"2024-02-21T23:13:14.211203+0000","last_deep_scrub":"42'13","last_deep_scrub_stamp":"2024-02-21T23:13:14.211203+0000","last_clean_scrub_stamp":"2024-02-21T23:13:14.211203+0000","objects_scrubbed":3,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:48:27.170095+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":36900,"num_omap_keys":60,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"35'308","reported_seq":399,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:23.748179+0000","last_change":"2024-02-21T23:13:23.748236+0000","last_active":"2024-02-21T23:13:23.748179+0000","last_peered":"2024-02-21T23:13:23.748179+0000","last_clean":"2024-02-21T23:13:23.748179+0000","last_became_active":"2024-02-21T23:01:07.283568+0000","last_became_peered":"2024-02-21T23:01:07.283568+0000","last_unstale":"2024-02-21T23:13:23.748179+0000","last_undegraded":"2024-02-21T23:13:23.748179+0000","last_fullsized":"2024-02-21T23:13:23.748179+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'308","last_scrub_stamp":"2024-02-21T23:13:23.748089+0000","last_deep_scrub":"35'308","last_deep_scrub_stamp":"2024-02-21T23:13:23.748089+0000","last_clean_scrub_stamp":"2024-02-21T23:13:23.748089+0000","objects_scrubbed":124,"log_size":308,"log_dups_size":0,"ondisk_log_size":308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:47:49.143984+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0.0050747270000000002,"stat_sum":{"num_bytes":444936,"num_objects":124,"num_object_clones":0,"num_object_copies":496,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":124,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":282,"num_write_kb":647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"40'95","reported_seq":200,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:11.040234+0000","last_change":"2024-02-21T23:13:11.040270+0000","last_active":"2024-02-21T23:13:11.040234+0000","last_peered":"2024-02-21T23:13:11.040234+0000","last_clean":"2024-02-21T23:13:11.040234+0000","last_became_active":"2024-02-21T23:01:03.208141+0000","last_became_peered":"2024-02-21T23:01:03.208141+0000","last_unstale":"2024-02-21T23:13:11.040234+0000","last_undegraded":"2024-02-21T23:13:11.040234+0000","last_fullsized":"2024-02-21T23:13:11.040234+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'95","last_scrub_stamp":"2024-02-21T23:13:11.040154+0000","last_deep_scrub":"40'95","last_deep_scrub_stamp":"2024-02-21T23:13:11.040154+0000","last_clean_scrub_stamp":"2024-02-21T23:13:11.040154+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:02:16.464049+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.0090850089999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"41'29","reported_seq":97,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:09.839402+0000","last_change":"2024-02-21T23:13:08.125951+0000","last_active":"2024-02-21T23:13:09.839402+0000","last_peered":"2024-02-21T23:13:09.839402+0000","last_clean":"2024-02-21T23:13:09.839402+0000","last_became_active":"2024-02-21T23:01:02.218499+0000","last_became_peered":"2024-02-21T23:01:02.218499+0000","last_unstale":"2024-02-21T23:13:09.839402+0000","last_undegraded":"2024-02-21T23:13:09.839402+0000","last_fullsized":"2024-02-21T23:13:09.839402+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"41'29","last_scrub_stamp":"2024-02-21T23:13:08.125776+0000","last_deep_scrub":"41'29","last_deep_scrub_stamp":"2024-02-21T23:13:08.125776+0000","last_clean_scrub_stamp":"2024-02-21T23:13:08.125776+0000","objects_scrubbed":9,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:12:14.445320+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62737,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":6,"num_read_kb":64,"num_write":27,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":63337,"num_omap_keys":103,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"42'54","reported_seq":137,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:14.011271+0000","last_change":"2024-02-21T23:13:14.011271+0000","last_active":"2024-02-21T23:13:14.011271+0000","last_peered":"2024-02-21T23:13:14.011271+0000","last_clean":"2024-02-21T23:13:14.011271+0000","last_became_active":"2024-02-21T23:01:02.208779+0000","last_became_peered":"2024-02-21T23:01:02.208779+0000","last_unstale":"2024-02-21T23:13:14.011271+0000","last_undegraded":"2024-02-21T23:13:14.011271+0000","last_fullsized":"2024-02-21T23:13:14.011271+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'54","last_scrub_stamp":"2024-02-21T23:13:14.011132+0000","last_deep_scrub":"42'54","last_deep_scrub_stamp":"2024-02-21T23:13:14.011132+0000","last_clean_scrub_stamp":"2024-02-21T23:13:14.011132+0000","objects_scrubbed":7,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:23:36.042720+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":4098,"num_write":52,"num_write_kb":4233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":71955,"num_omap_keys":117,"num_objects_repaired":0},"up":[10,8],"acting":[10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"40'78","reported_seq":183,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:19.176914+0000","last_change":"2024-02-21T23:13:19.176914+0000","last_active":"2024-02-21T23:13:19.176914+0000","last_peered":"2024-02-21T23:13:19.176914+0000","last_clean":"2024-02-21T23:13:19.176914+0000","last_became_active":"2024-02-21T23:01:03.212560+0000","last_became_peered":"2024-02-21T23:01:03.212560+0000","last_unstale":"2024-02-21T23:13:19.176914+0000","last_undegraded":"2024-02-21T23:13:19.176914+0000","last_fullsized":"2024-02-21T23:13:19.176914+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'78","last_scrub_stamp":"2024-02-21T23:13:19.176808+0000","last_deep_scrub":"40'78","last_deep_scrub_stamp":"2024-02-21T23:13:19.176808+0000","last_clean_scrub_stamp":"2024-02-21T23:13:19.176808+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:39:26.664140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0040607100000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"35'328","reported_seq":411,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:22.396553+0000","last_change":"2024-02-21T23:13:22.396600+0000","last_active":"2024-02-21T23:13:22.396553+0000","last_peered":"2024-02-21T23:13:22.396553+0000","last_clean":"2024-02-21T23:13:22.396553+0000","last_became_active":"2024-02-21T23:01:07.267796+0000","last_became_peered":"2024-02-21T23:01:07.267796+0000","last_unstale":"2024-02-21T23:13:22.396553+0000","last_undegraded":"2024-02-21T23:13:22.396553+0000","last_fullsized":"2024-02-21T23:13:22.396553+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'328","last_scrub_stamp":"2024-02-21T23:13:22.396436+0000","last_deep_scrub":"35'328","last_deep_scrub_stamp":"2024-02-21T23:13:22.396436+0000","last_clean_scrub_stamp":"2024-02-21T23:13:22.396436+0000","objects_scrubbed":97,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:48:35.355328+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0.0029824690000000002,"stat_sum":{"num_bytes":212072,"num_objects":97,"num_object_clones":0,"num_object_copies":388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":97,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":291,"num_write_kb":1346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"42'100","reported_seq":1435,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:34.808825+0000","last_change":"2024-02-21T23:13:16.251956+0000","last_active":"2024-02-21T23:13:34.808825+0000","last_peered":"2024-02-21T23:13:34.808825+0000","last_clean":"2024-02-21T23:13:34.808825+0000","last_became_active":"2024-02-21T23:01:02.206069+0000","last_became_peered":"2024-02-21T23:01:02.206069+0000","last_unstale":"2024-02-21T23:13:34.808825+0000","last_undegraded":"2024-02-21T23:13:34.808825+0000","last_fullsized":"2024-02-21T23:13:34.808825+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"42'100","last_scrub_stamp":"2024-02-21T23:13:16.251840+0000","last_deep_scrub":"42'100","last_deep_scrub_stamp":"2024-02-21T23:13:16.251840+0000","last_clean_scrub_stamp":"2024-02-21T23:13:16.251840+0000","objects_scrubbed":13,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:41:55.576009+0000","scrub_duration":25,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9892502,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":1273,"num_read_kb":9675,"num_write":93,"num_write_kb":9840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":132217,"num_omap_keys":215,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"40'68","reported_seq":173,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:24.025360+0000","last_change":"2024-02-21T23:13:24.025360+0000","last_active":"2024-02-21T23:13:24.025360+0000","last_peered":"2024-02-21T23:13:24.025360+0000","last_clean":"2024-02-21T23:13:24.025360+0000","last_became_active":"2024-02-21T23:01:03.220900+0000","last_became_peered":"2024-02-21T23:01:03.220900+0000","last_unstale":"2024-02-21T23:13:24.025360+0000","last_undegraded":"2024-02-21T23:13:24.025360+0000","last_fullsized":"2024-02-21T23:13:24.025360+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'68","last_scrub_stamp":"2024-02-21T23:13:24.025252+0000","last_deep_scrub":"40'68","last_deep_scrub_stamp":"2024-02-21T23:13:24.025252+0000","last_clean_scrub_stamp":"2024-02-21T23:13:24.025252+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:02:51.903335+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.0040531330000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9],"acting":[8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"35'336","reported_seq":419,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:21.371891+0000","last_change":"2024-02-21T23:13:21.371925+0000","last_active":"2024-02-21T23:13:21.371891+0000","last_peered":"2024-02-21T23:13:21.371891+0000","last_clean":"2024-02-21T23:13:21.371891+0000","last_became_active":"2024-02-21T23:01:07.256474+0000","last_became_peered":"2024-02-21T23:01:07.256474+0000","last_unstale":"2024-02-21T23:13:21.371891+0000","last_undegraded":"2024-02-21T23:13:21.371891+0000","last_fullsized":"2024-02-21T23:13:21.371891+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'336","last_scrub_stamp":"2024-02-21T23:13:21.371784+0000","last_deep_scrub":"35'336","last_deep_scrub_stamp":"2024-02-21T23:13:21.371784+0000","last_clean_scrub_stamp":"2024-02-21T23:13:21.371784+0000","objects_scrubbed":103,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:09:24.994867+0000","scrub_duration":34,"objects_trimmed":0,"snaptrim_duration":0.0033662710000000001,"stat_sum":{"num_bytes":406297,"num_objects":103,"num_object_clones":0,"num_object_copies":412,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":293,"num_write_kb":672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"40'83","reported_seq":189,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:20.653389+0000","last_change":"2024-02-21T23:13:20.653389+0000","last_active":"2024-02-21T23:13:20.653389+0000","last_peered":"2024-02-21T23:13:20.653389+0000","last_clean":"2024-02-21T23:13:20.653389+0000","last_became_active":"2024-02-21T23:01:03.215461+0000","last_became_peered":"2024-02-21T23:01:03.215461+0000","last_unstale":"2024-02-21T23:13:20.653389+0000","last_undegraded":"2024-02-21T23:13:20.653389+0000","last_fullsized":"2024-02-21T23:13:20.653389+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'83","last_scrub_stamp":"2024-02-21T23:13:20.653232+0000","last_deep_scrub":"40'83","last_deep_scrub_stamp":"2024-02-21T23:13:20.653232+0000","last_clean_scrub_stamp":"2024-02-21T23:13:20.653232+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:52:56.482083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0051664090000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"40'98","reported_seq":204,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:17.286026+0000","last_change":"2024-02-21T23:13:17.286026+0000","last_active":"2024-02-21T23:13:17.286026+0000","last_peered":"2024-02-21T23:13:17.286026+0000","last_clean":"2024-02-21T23:13:17.286026+0000","last_became_active":"2024-02-21T23:01:03.215639+0000","last_became_peered":"2024-02-21T23:01:03.215639+0000","last_unstale":"2024-02-21T23:13:17.286026+0000","last_undegraded":"2024-02-21T23:13:17.286026+0000","last_fullsized":"2024-02-21T23:13:17.286026+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'98","last_scrub_stamp":"2024-02-21T23:13:17.285872+0000","last_deep_scrub":"40'98","last_deep_scrub_stamp":"2024-02-21T23:13:17.285872+0000","last_clean_scrub_stamp":"2024-02-21T23:13:17.285872+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:06:36.618102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0038139580000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"40'76","reported_seq":182,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:19.292168+0000","last_change":"2024-02-21T23:13:19.292168+0000","last_active":"2024-02-21T23:13:19.292168+0000","last_peered":"2024-02-21T23:13:19.292168+0000","last_clean":"2024-02-21T23:13:19.292168+0000","last_became_active":"2024-02-21T23:01:03.218377+0000","last_became_peered":"2024-02-21T23:01:03.218377+0000","last_unstale":"2024-02-21T23:13:19.292168+0000","last_undegraded":"2024-02-21T23:13:19.292168+0000","last_fullsized":"2024-02-21T23:13:19.292168+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'76","last_scrub_stamp":"2024-02-21T23:13:19.292059+0000","last_deep_scrub":"40'76","last_deep_scrub_stamp":"2024-02-21T23:13:19.292059+0000","last_clean_scrub_stamp":"2024-02-21T23:13:19.292059+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:16:32.140826+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.0034104930000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"40'76","reported_seq":181,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:10.357059+0000","last_change":"2024-02-21T23:13:09.455456+0000","last_active":"2024-02-21T23:13:10.357059+0000","last_peered":"2024-02-21T23:13:10.357059+0000","last_clean":"2024-02-21T23:13:10.357059+0000","last_became_active":"2024-02-21T23:01:03.225085+0000","last_became_peered":"2024-02-21T23:01:03.225085+0000","last_unstale":"2024-02-21T23:13:10.357059+0000","last_undegraded":"2024-02-21T23:13:10.357059+0000","last_fullsized":"2024-02-21T23:13:10.357059+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'76","last_scrub_stamp":"2024-02-21T23:13:09.455289+0000","last_deep_scrub":"40'76","last_deep_scrub_stamp":"2024-02-21T23:13:09.455289+0000","last_clean_scrub_stamp":"2024-02-21T23:13:09.455289+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:53:00.615324+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.0039260240000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"40'54","reported_seq":159,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:13.110354+0000","last_change":"2024-02-21T23:13:13.110399+0000","last_active":"2024-02-21T23:13:13.110354+0000","last_peered":"2024-02-21T23:13:13.110354+0000","last_clean":"2024-02-21T23:13:13.110354+0000","last_became_active":"2024-02-21T23:01:03.225925+0000","last_became_peered":"2024-02-21T23:01:03.225925+0000","last_unstale":"2024-02-21T23:13:13.110354+0000","last_undegraded":"2024-02-21T23:13:13.110354+0000","last_fullsized":"2024-02-21T23:13:13.110354+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'54","last_scrub_stamp":"2024-02-21T23:13:13.110244+0000","last_deep_scrub":"40'54","last_deep_scrub_stamp":"2024-02-21T23:13:13.110244+0000","last_clean_scrub_stamp":"2024-02-21T23:13:13.110244+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:40:34.467376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.006870653,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"40'71","reported_seq":176,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:19.674669+0000","last_change":"2024-02-21T23:13:19.674695+0000","last_active":"2024-02-21T23:13:19.674669+0000","last_peered":"2024-02-21T23:13:19.674669+0000","last_clean":"2024-02-21T23:13:19.674669+0000","last_became_active":"2024-02-21T23:01:03.214488+0000","last_became_peered":"2024-02-21T23:01:03.214488+0000","last_unstale":"2024-02-21T23:13:19.674669+0000","last_undegraded":"2024-02-21T23:13:19.674669+0000","last_fullsized":"2024-02-21T23:13:19.674669+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'71","last_scrub_stamp":"2024-02-21T23:13:19.674583+0000","last_deep_scrub":"40'71","last_deep_scrub_stamp":"2024-02-21T23:13:19.674583+0000","last_clean_scrub_stamp":"2024-02-21T23:13:19.674583+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:02:25.098478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0056728819999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8],"acting":[11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"40'93","reported_seq":198,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:16.282647+0000","last_change":"2024-02-21T23:13:16.282671+0000","last_active":"2024-02-21T23:13:16.282647+0000","last_peered":"2024-02-21T23:13:16.282647+0000","last_clean":"2024-02-21T23:13:16.282647+0000","last_became_active":"2024-02-21T23:01:03.208458+0000","last_became_peered":"2024-02-21T23:01:03.208458+0000","last_unstale":"2024-02-21T23:13:16.282647+0000","last_undegraded":"2024-02-21T23:13:16.282647+0000","last_fullsized":"2024-02-21T23:13:16.282647+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'93","last_scrub_stamp":"2024-02-21T23:13:16.282573+0000","last_deep_scrub":"40'93","last_deep_scrub_stamp":"2024-02-21T23:13:16.282573+0000","last_clean_scrub_stamp":"2024-02-21T23:13:16.282573+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:55:14.415147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003379922,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8],"acting":[2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"40'56","reported_seq":161,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:10.006704+0000","last_change":"2024-02-21T23:13:09.015577+0000","last_active":"2024-02-21T23:13:10.006704+0000","last_peered":"2024-02-21T23:13:10.006704+0000","last_clean":"2024-02-21T23:13:10.006704+0000","last_became_active":"2024-02-21T23:01:03.206376+0000","last_became_peered":"2024-02-21T23:01:03.206376+0000","last_unstale":"2024-02-21T23:13:10.006704+0000","last_undegraded":"2024-02-21T23:13:10.006704+0000","last_fullsized":"2024-02-21T23:13:10.006704+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'56","last_scrub_stamp":"2024-02-21T23:13:09.015385+0000","last_deep_scrub":"40'56","last_deep_scrub_stamp":"2024-02-21T23:13:09.015385+0000","last_clean_scrub_stamp":"2024-02-21T23:13:09.015385+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:19:03.199560+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.0081511220000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"40'66","reported_seq":171,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:23.164754+0000","last_change":"2024-02-21T23:13:23.164779+0000","last_active":"2024-02-21T23:13:23.164754+0000","last_peered":"2024-02-21T23:13:23.164754+0000","last_clean":"2024-02-21T23:13:23.164754+0000","last_became_active":"2024-02-21T23:01:03.214922+0000","last_became_peered":"2024-02-21T23:01:03.214922+0000","last_unstale":"2024-02-21T23:13:23.164754+0000","last_undegraded":"2024-02-21T23:13:23.164754+0000","last_fullsized":"2024-02-21T23:13:23.164754+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'66","last_scrub_stamp":"2024-02-21T23:13:23.164634+0000","last_deep_scrub":"40'66","last_deep_scrub_stamp":"2024-02-21T23:13:23.164634+0000","last_clean_scrub_stamp":"2024-02-21T23:13:23.164634+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T11:02:33.098053+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.0037744219999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9],"acting":[5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"40'75","reported_seq":180,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:14.035025+0000","last_change":"2024-02-21T23:13:14.035070+0000","last_active":"2024-02-21T23:13:14.035025+0000","last_peered":"2024-02-21T23:13:14.035025+0000","last_clean":"2024-02-21T23:13:14.035025+0000","last_became_active":"2024-02-21T23:01:03.213428+0000","last_became_peered":"2024-02-21T23:01:03.213428+0000","last_unstale":"2024-02-21T23:13:14.035025+0000","last_undegraded":"2024-02-21T23:13:14.035025+0000","last_fullsized":"2024-02-21T23:13:14.035025+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'75","last_scrub_stamp":"2024-02-21T23:13:14.034933+0000","last_deep_scrub":"40'75","last_deep_scrub_stamp":"2024-02-21T23:13:14.034933+0000","last_clean_scrub_stamp":"2024-02-21T23:13:14.034933+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:37:53.418038+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.0068692420000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"40'77","reported_seq":182,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:12.449378+0000","last_change":"2024-02-21T23:13:12.449404+0000","last_active":"2024-02-21T23:13:12.449378+0000","last_peered":"2024-02-21T23:13:12.449378+0000","last_clean":"2024-02-21T23:13:12.449378+0000","last_became_active":"2024-02-21T23:01:03.215580+0000","last_became_peered":"2024-02-21T23:01:03.215580+0000","last_unstale":"2024-02-21T23:13:12.449378+0000","last_undegraded":"2024-02-21T23:13:12.449378+0000","last_fullsized":"2024-02-21T23:13:12.449378+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'77","last_scrub_stamp":"2024-02-21T23:13:12.449295+0000","last_deep_scrub":"40'77","last_deep_scrub_stamp":"2024-02-21T23:13:12.449295+0000","last_clean_scrub_stamp":"2024-02-21T23:13:12.449295+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:12:18.768840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021775449999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"40'74","reported_seq":179,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:16.143568+0000","last_change":"2024-02-21T23:13:16.143645+0000","last_active":"2024-02-21T23:13:16.143568+0000","last_peered":"2024-02-21T23:13:16.143568+0000","last_clean":"2024-02-21T23:13:16.143568+0000","last_became_active":"2024-02-21T23:01:03.223861+0000","last_became_peered":"2024-02-21T23:01:03.223861+0000","last_unstale":"2024-02-21T23:13:16.143568+0000","last_undegraded":"2024-02-21T23:13:16.143568+0000","last_fullsized":"2024-02-21T23:13:16.143568+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'74","last_scrub_stamp":"2024-02-21T23:13:16.143426+0000","last_deep_scrub":"40'74","last_deep_scrub_stamp":"2024-02-21T23:13:16.143426+0000","last_clean_scrub_stamp":"2024-02-21T23:13:16.143426+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:05:32.375087+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.0064779520000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"40'80","reported_seq":185,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:16.642092+0000","last_change":"2024-02-21T23:13:16.642119+0000","last_active":"2024-02-21T23:13:16.642092+0000","last_peered":"2024-02-21T23:13:16.642092+0000","last_clean":"2024-02-21T23:13:16.642092+0000","last_became_active":"2024-02-21T23:01:03.212691+0000","last_became_peered":"2024-02-21T23:01:03.212691+0000","last_unstale":"2024-02-21T23:13:16.642092+0000","last_undegraded":"2024-02-21T23:13:16.642092+0000","last_fullsized":"2024-02-21T23:13:16.642092+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'80","last_scrub_stamp":"2024-02-21T23:13:16.642009+0000","last_deep_scrub":"40'80","last_deep_scrub_stamp":"2024-02-21T23:13:16.642009+0000","last_clean_scrub_stamp":"2024-02-21T23:13:16.642009+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:58:54.873548+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.0052158400000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"40'78","reported_seq":183,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:18.251835+0000","last_change":"2024-02-21T23:13:18.251859+0000","last_active":"2024-02-21T23:13:18.251835+0000","last_peered":"2024-02-21T23:13:18.251835+0000","last_clean":"2024-02-21T23:13:18.251835+0000","last_became_active":"2024-02-21T23:01:03.217613+0000","last_became_peered":"2024-02-21T23:01:03.217613+0000","last_unstale":"2024-02-21T23:13:18.251835+0000","last_undegraded":"2024-02-21T23:13:18.251835+0000","last_fullsized":"2024-02-21T23:13:18.251835+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'78","last_scrub_stamp":"2024-02-21T23:13:18.251757+0000","last_deep_scrub":"40'78","last_deep_scrub_stamp":"2024-02-21T23:13:18.251757+0000","last_clean_scrub_stamp":"2024-02-21T23:13:18.251757+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:40:39.608890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0037090880000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"40'75","reported_seq":180,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:13.121149+0000","last_change":"2024-02-21T23:13:13.121171+0000","last_active":"2024-02-21T23:13:13.121149+0000","last_peered":"2024-02-21T23:13:13.121149+0000","last_clean":"2024-02-21T23:13:13.121149+0000","last_became_active":"2024-02-21T23:01:03.214165+0000","last_became_peered":"2024-02-21T23:01:03.214165+0000","last_unstale":"2024-02-21T23:13:13.121149+0000","last_undegraded":"2024-02-21T23:13:13.121149+0000","last_fullsized":"2024-02-21T23:13:13.121149+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'75","last_scrub_stamp":"2024-02-21T23:13:13.121066+0000","last_deep_scrub":"40'75","last_deep_scrub_stamp":"2024-02-21T23:13:13.121066+0000","last_clean_scrub_stamp":"2024-02-21T23:13:13.121066+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T02:04:00.218860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0049436819999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1],"acting":[9,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"40'60","reported_seq":165,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:18.668901+0000","last_change":"2024-02-21T23:13:18.668925+0000","last_active":"2024-02-21T23:13:18.668901+0000","last_peered":"2024-02-21T23:13:18.668901+0000","last_clean":"2024-02-21T23:13:18.668901+0000","last_became_active":"2024-02-21T23:01:03.213755+0000","last_became_peered":"2024-02-21T23:01:03.213755+0000","last_unstale":"2024-02-21T23:13:18.668901+0000","last_undegraded":"2024-02-21T23:13:18.668901+0000","last_fullsized":"2024-02-21T23:13:18.668901+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'60","last_scrub_stamp":"2024-02-21T23:13:18.668811+0000","last_deep_scrub":"40'60","last_deep_scrub_stamp":"2024-02-21T23:13:18.668811+0000","last_clean_scrub_stamp":"2024-02-21T23:13:18.668811+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:41:57.992980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0051223900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"40'82","reported_seq":187,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:14.417655+0000","last_change":"2024-02-21T23:13:14.417697+0000","last_active":"2024-02-21T23:13:14.417655+0000","last_peered":"2024-02-21T23:13:14.417655+0000","last_clean":"2024-02-21T23:13:14.417655+0000","last_became_active":"2024-02-21T23:01:03.216345+0000","last_became_peered":"2024-02-21T23:01:03.216345+0000","last_unstale":"2024-02-21T23:13:14.417655+0000","last_undegraded":"2024-02-21T23:13:14.417655+0000","last_fullsized":"2024-02-21T23:13:14.417655+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'82","last_scrub_stamp":"2024-02-21T23:13:14.417562+0000","last_deep_scrub":"40'82","last_deep_scrub_stamp":"2024-02-21T23:13:14.417562+0000","last_clean_scrub_stamp":"2024-02-21T23:13:14.417562+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:07:28.382320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017199909999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"40'82","reported_seq":187,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:11.429142+0000","last_change":"2024-02-21T23:13:11.429163+0000","last_active":"2024-02-21T23:13:11.429142+0000","last_peered":"2024-02-21T23:13:11.429142+0000","last_clean":"2024-02-21T23:13:11.429142+0000","last_became_active":"2024-02-21T23:01:03.225574+0000","last_became_peered":"2024-02-21T23:01:03.225574+0000","last_unstale":"2024-02-21T23:13:11.429142+0000","last_undegraded":"2024-02-21T23:13:11.429142+0000","last_fullsized":"2024-02-21T23:13:11.429142+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'82","last_scrub_stamp":"2024-02-21T23:13:11.429071+0000","last_deep_scrub":"40'82","last_deep_scrub_stamp":"2024-02-21T23:13:11.429071+0000","last_clean_scrub_stamp":"2024-02-21T23:13:11.429071+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T09:48:24.387962+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.0027999029999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"40'86","reported_seq":191,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:10.434751+0000","last_change":"2024-02-21T23:13:10.434798+0000","last_active":"2024-02-21T23:13:10.434751+0000","last_peered":"2024-02-21T23:13:10.434751+0000","last_clean":"2024-02-21T23:13:10.434751+0000","last_became_active":"2024-02-21T23:01:03.217938+0000","last_became_peered":"2024-02-21T23:01:03.217938+0000","last_unstale":"2024-02-21T23:13:10.434751+0000","last_undegraded":"2024-02-21T23:13:10.434751+0000","last_fullsized":"2024-02-21T23:13:10.434751+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'86","last_scrub_stamp":"2024-02-21T23:13:10.434640+0000","last_deep_scrub":"40'86","last_deep_scrub_stamp":"2024-02-21T23:13:10.434640+0000","last_clean_scrub_stamp":"2024-02-21T23:13:10.434640+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:05:26.666301+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.0037110289999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8],"acting":[0,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"40'70","reported_seq":175,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:12.134705+0000","last_change":"2024-02-21T23:13:12.134787+0000","last_active":"2024-02-21T23:13:12.134705+0000","last_peered":"2024-02-21T23:13:12.134705+0000","last_clean":"2024-02-21T23:13:12.134705+0000","last_became_active":"2024-02-21T23:01:03.225449+0000","last_became_peered":"2024-02-21T23:01:03.225449+0000","last_unstale":"2024-02-21T23:13:12.134705+0000","last_undegraded":"2024-02-21T23:13:12.134705+0000","last_fullsized":"2024-02-21T23:13:12.134705+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'70","last_scrub_stamp":"2024-02-21T23:13:12.134519+0000","last_deep_scrub":"40'70","last_deep_scrub_stamp":"2024-02-21T23:13:12.134519+0000","last_clean_scrub_stamp":"2024-02-21T23:13:12.134519+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:06:31.466748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.006321821,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10],"acting":[6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"40'64","reported_seq":169,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:15.361900+0000","last_change":"2024-02-21T23:13:15.361926+0000","last_active":"2024-02-21T23:13:15.361900+0000","last_peered":"2024-02-21T23:13:15.361900+0000","last_clean":"2024-02-21T23:13:15.361900+0000","last_became_active":"2024-02-21T23:01:03.208446+0000","last_became_peered":"2024-02-21T23:01:03.208446+0000","last_unstale":"2024-02-21T23:13:15.361900+0000","last_undegraded":"2024-02-21T23:13:15.361900+0000","last_fullsized":"2024-02-21T23:13:15.361900+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'64","last_scrub_stamp":"2024-02-21T23:13:15.361811+0000","last_deep_scrub":"40'64","last_deep_scrub_stamp":"2024-02-21T23:13:15.361811+0000","last_clean_scrub_stamp":"2024-02-21T23:13:15.361811+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:09:56.643800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.003791258,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"40'79","reported_seq":184,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:20.704663+0000","last_change":"2024-02-21T23:13:20.704707+0000","last_active":"2024-02-21T23:13:20.704663+0000","last_peered":"2024-02-21T23:13:20.704663+0000","last_clean":"2024-02-21T23:13:20.704663+0000","last_became_active":"2024-02-21T23:01:03.217925+0000","last_became_peered":"2024-02-21T23:01:03.217925+0000","last_unstale":"2024-02-21T23:13:20.704663+0000","last_undegraded":"2024-02-21T23:13:20.704663+0000","last_fullsized":"2024-02-21T23:13:20.704663+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'79","last_scrub_stamp":"2024-02-21T23:13:20.704552+0000","last_deep_scrub":"40'79","last_deep_scrub_stamp":"2024-02-21T23:13:20.704552+0000","last_clean_scrub_stamp":"2024-02-21T23:13:20.704552+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T05:52:22.096771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0033063070000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8],"acting":[7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"40'74","reported_seq":179,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:16.988969+0000","last_change":"2024-02-21T23:13:16.988995+0000","last_active":"2024-02-21T23:13:16.988969+0000","last_peered":"2024-02-21T23:13:16.988969+0000","last_clean":"2024-02-21T23:13:16.988969+0000","last_became_active":"2024-02-21T23:01:03.211921+0000","last_became_peered":"2024-02-21T23:01:03.211921+0000","last_unstale":"2024-02-21T23:13:16.988969+0000","last_undegraded":"2024-02-21T23:13:16.988969+0000","last_fullsized":"2024-02-21T23:13:16.988969+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'74","last_scrub_stamp":"2024-02-21T23:13:16.988884+0000","last_deep_scrub":"40'74","last_deep_scrub_stamp":"2024-02-21T23:13:16.988884+0000","last_clean_scrub_stamp":"2024-02-21T23:13:16.988884+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:49:55.300172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014721059999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2],"acting":[10,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"40'90","reported_seq":195,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:15.373578+0000","last_change":"2024-02-21T23:13:15.373639+0000","last_active":"2024-02-21T23:13:15.373578+0000","last_peered":"2024-02-21T23:13:15.373578+0000","last_clean":"2024-02-21T23:13:15.373578+0000","last_became_active":"2024-02-21T23:01:03.216580+0000","last_became_peered":"2024-02-21T23:01:03.216580+0000","last_unstale":"2024-02-21T23:13:15.373578+0000","last_undegraded":"2024-02-21T23:13:15.373578+0000","last_fullsized":"2024-02-21T23:13:15.373578+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'90","last_scrub_stamp":"2024-02-21T23:13:15.373458+0000","last_deep_scrub":"40'90","last_deep_scrub_stamp":"2024-02-21T23:13:15.373458+0000","last_clean_scrub_stamp":"2024-02-21T23:13:15.373458+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T08:17:51.369803+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.0022026120000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"40'72","reported_seq":177,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:13.025469+0000","last_change":"2024-02-21T23:13:13.025469+0000","last_active":"2024-02-21T23:13:13.025469+0000","last_peered":"2024-02-21T23:13:13.025469+0000","last_clean":"2024-02-21T23:13:13.025469+0000","last_became_active":"2024-02-21T23:01:03.211811+0000","last_became_peered":"2024-02-21T23:01:03.211811+0000","last_unstale":"2024-02-21T23:13:13.025469+0000","last_undegraded":"2024-02-21T23:13:13.025469+0000","last_fullsized":"2024-02-21T23:13:13.025469+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'72","last_scrub_stamp":"2024-02-21T23:13:13.025275+0000","last_deep_scrub":"40'72","last_deep_scrub_stamp":"2024-02-21T23:13:13.025275+0000","last_clean_scrub_stamp":"2024-02-21T23:13:13.025275+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T06:53:24.456411+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.0066682540000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"40'80","reported_seq":185,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:22.799517+0000","last_change":"2024-02-21T23:13:22.799517+0000","last_active":"2024-02-21T23:13:22.799517+0000","last_peered":"2024-02-21T23:13:22.799517+0000","last_clean":"2024-02-21T23:13:22.799517+0000","last_became_active":"2024-02-21T23:01:03.223255+0000","last_became_peered":"2024-02-21T23:01:03.223255+0000","last_unstale":"2024-02-21T23:13:22.799517+0000","last_undegraded":"2024-02-21T23:13:22.799517+0000","last_fullsized":"2024-02-21T23:13:22.799517+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'80","last_scrub_stamp":"2024-02-21T23:13:22.799374+0000","last_deep_scrub":"40'80","last_deep_scrub_stamp":"2024-02-21T23:13:22.799374+0000","last_clean_scrub_stamp":"2024-02-21T23:13:22.799374+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T07:42:18.824687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002877391,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9],"acting":[7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"40'78","reported_seq":183,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:14.991027+0000","last_change":"2024-02-21T23:13:14.991027+0000","last_active":"2024-02-21T23:13:14.991027+0000","last_peered":"2024-02-21T23:13:14.991027+0000","last_clean":"2024-02-21T23:13:14.991027+0000","last_became_active":"2024-02-21T23:01:03.209569+0000","last_became_peered":"2024-02-21T23:01:03.209569+0000","last_unstale":"2024-02-21T23:13:14.991027+0000","last_undegraded":"2024-02-21T23:13:14.991027+0000","last_fullsized":"2024-02-21T23:13:14.991027+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'78","last_scrub_stamp":"2024-02-21T23:13:14.990882+0000","last_deep_scrub":"40'78","last_deep_scrub_stamp":"2024-02-21T23:13:14.990882+0000","last_clean_scrub_stamp":"2024-02-21T23:13:14.990882+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:36:00.351669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001512382,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9],"acting":[10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"40'74","reported_seq":179,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:22.035793+0000","last_change":"2024-02-21T23:13:22.035793+0000","last_active":"2024-02-21T23:13:22.035793+0000","last_peered":"2024-02-21T23:13:22.035793+0000","last_clean":"2024-02-21T23:13:22.035793+0000","last_became_active":"2024-02-21T23:01:03.213941+0000","last_became_peered":"2024-02-21T23:01:03.213941+0000","last_unstale":"2024-02-21T23:13:22.035793+0000","last_undegraded":"2024-02-21T23:13:22.035793+0000","last_fullsized":"2024-02-21T23:13:22.035793+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'74","last_scrub_stamp":"2024-02-21T23:13:22.035681+0000","last_deep_scrub":"40'74","last_deep_scrub_stamp":"2024-02-21T23:13:22.035681+0000","last_clean_scrub_stamp":"2024-02-21T23:13:22.035681+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-22T23:55:54.453421+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.0036313349999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3],"acting":[8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"40'67","reported_seq":173,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:14.397671+0000","last_change":"2024-02-21T23:13:14.397695+0000","last_active":"2024-02-21T23:13:14.397671+0000","last_peered":"2024-02-21T23:13:14.397671+0000","last_clean":"2024-02-21T23:13:14.397671+0000","last_became_active":"2024-02-21T23:01:03.206762+0000","last_became_peered":"2024-02-21T23:01:03.206762+0000","last_unstale":"2024-02-21T23:13:14.397671+0000","last_undegraded":"2024-02-21T23:13:14.397671+0000","last_fullsized":"2024-02-21T23:13:14.397671+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'67","last_scrub_stamp":"2024-02-21T23:13:14.397595+0000","last_deep_scrub":"40'67","last_deep_scrub_stamp":"2024-02-21T23:13:14.397595+0000","last_clean_scrub_stamp":"2024-02-21T23:13:14.397595+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:56:00.493390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0035603570000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8],"acting":[4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"40'79","reported_seq":185,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:10.357874+0000","last_change":"2024-02-21T23:13:08.458565+0000","last_active":"2024-02-21T23:13:10.357874+0000","last_peered":"2024-02-21T23:13:10.357874+0000","last_clean":"2024-02-21T23:13:10.357874+0000","last_became_active":"2024-02-21T23:01:03.221672+0000","last_became_peered":"2024-02-21T23:01:03.221672+0000","last_unstale":"2024-02-21T23:13:10.357874+0000","last_undegraded":"2024-02-21T23:13:10.357874+0000","last_fullsized":"2024-02-21T23:13:10.357874+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'79","last_scrub_stamp":"2024-02-21T23:13:08.458368+0000","last_deep_scrub":"40'79","last_deep_scrub_stamp":"2024-02-21T23:13:08.458368+0000","last_clean_scrub_stamp":"2024-02-21T23:13:08.458368+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T04:02:36.336451+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.0035512949999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"40'56","reported_seq":162,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:10.357733+0000","last_change":"2024-02-21T23:13:07.435683+0000","last_active":"2024-02-21T23:13:10.357733+0000","last_peered":"2024-02-21T23:13:10.357733+0000","last_clean":"2024-02-21T23:13:10.357733+0000","last_became_active":"2024-02-21T23:01:03.219379+0000","last_became_peered":"2024-02-21T23:01:03.219379+0000","last_unstale":"2024-02-21T23:13:10.357733+0000","last_undegraded":"2024-02-21T23:13:10.357733+0000","last_fullsized":"2024-02-21T23:13:10.357733+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'56","last_scrub_stamp":"2024-02-21T23:13:07.435524+0000","last_deep_scrub":"40'56","last_deep_scrub_stamp":"2024-02-21T23:13:07.435524+0000","last_clean_scrub_stamp":"2024-02-21T23:13:07.435524+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T10:40:28.792657+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.0043096130000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11],"acting":[0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"40'65","reported_seq":171,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-02-21T23:13:17.657693+0000","last_change":"2024-02-21T23:13:17.657693+0000","last_active":"2024-02-21T23:13:17.657693+0000","last_peered":"2024-02-21T23:13:17.657693+0000","last_clean":"2024-02-21T23:13:17.657693+0000","last_became_active":"2024-02-21T23:01:03.212878+0000","last_became_peered":"2024-02-21T23:01:03.212878+0000","last_unstale":"2024-02-21T23:13:17.657693+0000","last_undegraded":"2024-02-21T23:13:17.657693+0000","last_fullsized":"2024-02-21T23:13:17.657693+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'65","last_scrub_stamp":"2024-02-21T23:13:17.657586+0000","last_deep_scrub":"40'65","last_deep_scrub_stamp":"2024-02-21T23:13:17.657586+0000","last_clean_scrub_stamp":"2024-02-21T23:13:17.657586+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-23T01:19:11.841761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0052400579999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":26460371,"num_objects":3449,"num_object_clones":0,"num_object_copies":13796,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3449,"num_whiteouts":0,"num_read":1,"num_read_kb":1270,"num_write":9636,"num_write_kb":38355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":91508736,"data_stored":98402304,"data_compressed":4659312,"data_compressed_allocated":5701632,"data_compressed_original":12595200,"omap_allocated":0,"internal_metadata":0},"log_size":10826,"ondisk_log_size":10826,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4661,"ondisk_log_size":4661,"up":128,"acting":128,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":60977620,"num_objects":267,"num_object_clones":0,"num_object_copies":534,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":267,"num_whiteouts":0,"num_read":6933,"num_read_kb":62770,"num_write":2365,"num_write_kb":70242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":221,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2615571,"num_omap_keys":4185,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":26812416,"data_stored":121955240,"data_compressed":17887088,"data_compressed_allocated":22609920,"data_compressed_original":117915648,"omap_allocated":0,"internal_metadata":0},"log_size":1955,"ondisk_log_size":1955,"up":64,"acting":64,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66458,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":150,"ondisk_log_size":150,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":11,"up_from":17,"seq":73014444186,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46392,"kb_used_data":6896,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94325448,"statfs":{"total":96636764160,"available":96589258752,"internally_reserved":0,"allocated":7061504,"data_stored":7211451,"data_compressed":334324,"data_compressed_allocated":413696,"data_compressed_original":831488,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":17,"seq":73014444185,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49224,"kb_used_data":9728,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94322616,"statfs":{"total":96636764160,"available":96586358784,"internally_reserved":0,"allocated":9961472,"data_stored":23021968,"data_compressed":2658170,"data_compressed_allocated":3407872,"data_compressed_original":16760832,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":17,"seq":73014444186,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50608,"kb_used_data":11112,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94321232,"statfs":{"total":96636764160,"available":96584941568,"internally_reserved":0,"allocated":11378688,"data_stored":15530517,"data_compressed":1078167,"data_compressed_allocated":1396736,"data_compressed_original":5820416,"omap_allocated":1600,"internal_metadata":40434112},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":17,"seq":73014444185,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47164,"kb_used_data":7668,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94324676,"statfs":{"total":96636764160,"available":96588468224,"internally_reserved":0,"allocated":7852032,"data_stored":21907473,"data_compressed":2902110,"data_compressed_allocated":3657728,"data_compressed_original":17993728,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,3,4,5,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":17,"seq":73014444186,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39028,"kb_used_data":12012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94332812,"statfs":{"total":96636764160,"available":96596799488,"internally_reserved":0,"allocated":12300288,"data_stored":26116159,"data_compressed":2821597,"data_compressed_allocated":3588096,"data_compressed_original":17678336,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":17,"seq":73014444185,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44908,"kb_used_data":9572,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94326932,"statfs":{"total":96636764160,"available":96590778368,"internally_reserved":0,"allocated":9801728,"data_stored":13596690,"data_compressed":1124577,"data_compressed_allocated":1363968,"data_compressed_original":5431296,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":17,"seq":73014444186,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45796,"kb_used_data":14620,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94326044,"statfs":{"total":96636764160,"available":96589869056,"internally_reserved":0,"allocated":14970880,"data_stored":30273961,"data_compressed":3338710,"data_compressed_allocated":4243456,"data_compressed_original":19845120,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":17,"seq":73014444186,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49460,"kb_used_data":9964,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94322380,"statfs":{"total":96636764160,"available":96586117120,"internally_reserved":0,"allocated":10203136,"data_stored":11018508,"data_compressed":677691,"data_compressed_allocated":823296,"data_compressed_original":1912832,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":17,"seq":73014444186,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46960,"kb_used_data":7464,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94324880,"statfs":{"total":96636764160,"available":96588677120,"internally_reserved":0,"allocated":7643136,"data_stored":11965275,"data_compressed":1302092,"data_compressed_allocated":1613824,"data_compressed_original":6209536,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444186,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52760,"kb_used_data":13264,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94319080,"statfs":{"total":96636764160,"available":96582737920,"internally_reserved":0,"allocated":13582336,"data_stored":37849314,"data_compressed":5017522,"data_compressed_allocated":6287360,"data_compressed_original":30834688,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":17,"seq":73014444186,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53688,"kb_used_data":10032,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94318152,"statfs":{"total":96636764160,"available":96581787648,"internally_reserved":0,"allocated":10272768,"data_stored":13675029,"data_compressed":1006828,"data_compressed_allocated":1257472,"data_compressed_original":4931584,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":17,"seq":73014444186,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44104,"kb_used_data":8768,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327736,"statfs":{"total":96636764160,"available":96591601664,"internally_reserved":0,"allocated":8978432,"data_stored":12540571,"data_compressed":897994,"data_compressed_allocated":1134592,"data_compressed_original":4980736,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33229,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33229,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":831488,"data_stored":4195110,"data_compressed":654518,"data_compressed_allocated":794624,"data_compressed_original":4177920,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":983040,"data_stored":4194976,"data_compressed":615592,"data_compressed_allocated":782336,"data_compressed_original":4001792,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6574080,"data_stored":30540141,"data_compressed":4544343,"data_compressed_allocated":5718016,"data_compressed_original":29700096,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":962560,"data_stored":4484070,"data_compressed":694867,"data_compressed_allocated":851968,"data_compressed_original":4382720,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":63895,"data_compressed":8106,"data_compressed_allocated":12288,"data_compressed_original":36864,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4325376,"data_stored":18610196,"data_compressed":2736860,"data_compressed_allocated":3469312,"data_compressed_original":17784832,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1032192,"data_stored":4546717,"data_compressed":692215,"data_compressed_allocated":839680,"data_compressed_original":4362240,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":3792896,"data_stored":16778922,"data_compressed":2462264,"data_compressed_allocated":3121152,"data_compressed_original":16113664,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":3510272,"data_stored":17170588,"data_compressed":2509836,"data_compressed_allocated":3166208,"data_compressed_original":16842752,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":827392,"data_stored":4588192,"data_compressed":597132,"data_compressed_allocated":802816,"data_compressed_original":4571136,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":3919872,"data_stored":16781851,"data_compressed":2371355,"data_compressed_allocated":3051520,"data_compressed_original":15941632,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":7684096,"data_stored":8081408,"data_compressed":197899,"data_compressed_allocated":274432,"data_compressed_original":671744,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8826880,"data_stored":9216000,"data_compressed":345659,"data_compressed_allocated":409600,"data_compressed_original":798720,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6545408,"data_stored":7045120,"data_compressed":427602,"data_compressed_allocated":503808,"data_compressed_original":1003520,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6217728,"data_stored":7217152,"data_compressed":561648,"data_compressed_allocated":696320,"data_compressed_original":1695744,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":9691136,"data_stored":10690560,"data_compressed":624008,"data_compressed_allocated":745472,"data_compressed_original":1744896,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":10117120,"data_stored":10809344,"data_compressed":523044,"data_compressed_allocated":663552,"data_compressed_original":1355776,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8306688,"data_stored":8785920,"data_compressed":386785,"data_compressed_allocated":458752,"data_compressed_original":937984,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":7979008,"data_stored":8482816,"data_compressed":280527,"data_compressed_allocated":356352,"data_compressed_original":860160,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":3878912,"data_stored":4472832,"data_compressed":346697,"data_compressed_allocated":425984,"data_compressed_original":1019904,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":10088448,"data_stored":10678272,"data_compressed":435458,"data_compressed_allocated":528384,"data_compressed_original":1118208,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":5578752,"data_stored":5976064,"data_compressed":241238,"data_compressed_allocated":290816,"data_compressed_original":688128,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":6594560,"data_stored":6946816,"data_compressed":288747,"data_compressed_allocated":348160,"data_compressed_original":700416,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-21T23:13:36.464 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-02-21T23:13:36.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.714+0000 7faa5fa00640 1 Processor -- start 2024-02-21T23:13:36.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.714+0000 7faa5fa00640 1 -- start start 2024-02-21T23:13:36.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.716+0000 7faa5fa00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7faa5806e910 0x7faa580cb420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:36.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.716+0000 7faa5fa00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa5806ee40 con 0x7faa58180c80 2024-02-21T23:13:36.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.716+0000 7faa5fa00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa5806f120 con 0x7faa580701c0 2024-02-21T23:13:36.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.716+0000 7faa5fa00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa5806f400 con 0x7faa5806e910 2024-02-21T23:13:36.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.716+0000 7faa57e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7faa5806e910 0x7faa580cb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:36.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.716+0000 7faa57e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7faa5806e910 0x7faa580cb420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:38892/0 (socket says 172.21.15.99:38892) 2024-02-21T23:13:36.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.716+0000 7faa57e00640 1 -- 172.21.15.99:0/1223211514 learned_addr learned my addr 172.21.15.99:0/1223211514 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:13:36.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.717+0000 7faa57e00640 1 -- 172.21.15.99:0/1223211514 >> v1:172.21.15.181:6789/0 conn(0x7faa580701c0 legacy=0x7faa580cb960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:36.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.717+0000 7faa57400640 1 -- 172.21.15.99:0/1223211514 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3302099766 0 0) 0x7faa5806f120 con 0x7faa580701c0 2024-02-21T23:13:36.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.717+0000 7faa57e00640 1 -- 172.21.15.99:0/1223211514 >> v1:172.21.15.99:6789/0 conn(0x7faa58180c80 legacy=0x7faa58187f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:36.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.717+0000 7faa57e00640 1 -- 172.21.15.99:0/1223211514 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa5806f6e0 con 0x7faa5806e910 2024-02-21T23:13:36.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.718+0000 7faa57e00640 1 --2- 172.21.15.99:0/1223211514 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa5806e910 0x7faa580cb420 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7faa44009870 tx=0x7faa4402b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6441dd2e2f3a2861 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:36.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.718+0000 7faa57400640 1 -- 172.21.15.99:0/1223211514 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa44037070 con 0x7faa5806e910 2024-02-21T23:13:36.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.718+0000 7faa57400640 1 -- 172.21.15.99:0/1223211514 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa44004230 con 0x7faa5806e910 2024-02-21T23:13:36.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.718+0000 7faa57400640 1 -- 172.21.15.99:0/1223211514 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa44003610 con 0x7faa5806e910 2024-02-21T23:13:36.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.719+0000 7faa5fa00640 1 -- 172.21.15.99:0/1223211514 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa5806e910 msgr2=0x7faa580cb420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:36.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.719+0000 7faa5fa00640 1 --2- 172.21.15.99:0/1223211514 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa5806e910 0x7faa580cb420 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7faa44009870 tx=0x7faa4402b7e0 comp rx=0 tx=0).stop 2024-02-21T23:13:36.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.719+0000 7faa5fa00640 1 -- 172.21.15.99:0/1223211514 shutdown_connections 2024-02-21T23:13:36.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.719+0000 7faa5fa00640 1 --2- 172.21.15.99:0/1223211514 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa5806e910 0x7faa580cb420 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:36.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.719+0000 7faa5fa00640 1 -- 172.21.15.99:0/1223211514 >> 172.21.15.99:0/1223211514 conn(0x7faa580ce5f0 msgr2=0x7faa580cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:36.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.719+0000 7faa5fa00640 1 -- 172.21.15.99:0/1223211514 shutdown_connections 2024-02-21T23:13:36.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.719+0000 7faa5fa00640 1 -- 172.21.15.99:0/1223211514 wait complete. 2024-02-21T23:13:36.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.721+0000 7faa5fa00640 1 Processor -- start 2024-02-21T23:13:36.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.721+0000 7faa5fa00640 1 -- start start 2024-02-21T23:13:36.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.722+0000 7faa5fa00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa5806e910 0x7faa581727e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:36.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.722+0000 7faa5fa00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa580701c0 0x7faa5821eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:36.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.722+0000 7faa5fa00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faa58180c80 0x7faa5821f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:36.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.722+0000 7faa5fa00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa58188610 con 0x7faa580701c0 2024-02-21T23:13:36.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.722+0000 7faa5fa00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa5806fca0 con 0x7faa5806e910 2024-02-21T23:13:36.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.722+0000 7faa5fa00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa580f5f50 con 0x7faa58180c80 2024-02-21T23:13:36.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.723+0000 7faa57e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa580701c0 0x7faa5821eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:36.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.723+0000 7faa57e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa580701c0 0x7faa5821eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:38902/0 (socket says 172.21.15.99:38902) 2024-02-21T23:13:36.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.723+0000 7faa57e00640 1 -- 172.21.15.99:0/3371914157 learned_addr learned my addr 172.21.15.99:0/3371914157 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:13:36.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.723+0000 7faa5d000640 1 --2- 172.21.15.99:0/3371914157 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa5806e910 0x7faa581727e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:36.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.723+0000 7faa5da00640 1 --2- 172.21.15.99:0/3371914157 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faa58180c80 0x7faa5821f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:36.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.723+0000 7faa57e00640 1 -- 172.21.15.99:0/3371914157 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faa58180c80 msgr2=0x7faa5821f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:36.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.723+0000 7faa57e00640 1 --2- 172.21.15.99:0/3371914157 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faa58180c80 0x7faa5821f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:36.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.723+0000 7faa57e00640 1 -- 172.21.15.99:0/3371914157 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa5806e910 msgr2=0x7faa581727e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:36.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.723+0000 7faa57e00640 1 --2- 172.21.15.99:0/3371914157 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa5806e910 0x7faa581727e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:36.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.723+0000 7faa57e00640 1 -- 172.21.15.99:0/3371914157 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa5821f950 con 0x7faa580701c0 2024-02-21T23:13:36.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.723+0000 7faa5da00640 1 --2- 172.21.15.99:0/3371914157 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faa58180c80 0x7faa5821f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:13:36.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.724+0000 7faa57e00640 1 --2- 172.21.15.99:0/3371914157 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa580701c0 0x7faa5821eed0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7faa44009870 tx=0x7faa440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:36.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.724+0000 7faa54c00640 1 -- 172.21.15.99:0/3371914157 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa44042070 con 0x7faa580701c0 2024-02-21T23:13:36.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.724+0000 7faa54c00640 1 -- 172.21.15.99:0/3371914157 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa44030730 con 0x7faa580701c0 2024-02-21T23:13:36.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.724+0000 7faa5fa00640 1 -- 172.21.15.99:0/3371914157 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa580ce340 con 0x7faa580701c0 2024-02-21T23:13:36.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.724+0000 7faa54c00640 1 -- 172.21.15.99:0/3371914157 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa44037040 con 0x7faa580701c0 2024-02-21T23:13:36.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.724+0000 7faa5fa00640 1 -- 172.21.15.99:0/3371914157 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa58188830 con 0x7faa580701c0 2024-02-21T23:13:36.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.725+0000 7faa5fa00640 1 -- 172.21.15.99:0/3371914157 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa58068780 con 0x7faa580701c0 2024-02-21T23:13:36.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.729+0000 7faa54c00640 1 -- 172.21.15.99:0/3371914157 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7faa44045070 con 0x7faa580701c0 2024-02-21T23:13:36.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.731+0000 7faa54c00640 1 --2- 172.21.15.99:0/3371914157 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7faa3809eed0 0x7faa380a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:36.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.731+0000 7faa54c00640 1 -- 172.21.15.99:0/3371914157 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 8877+0+0 (secure 0 0 0) 0x7faa440ec2f0 con 0x7faa580701c0 2024-02-21T23:13:36.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.731+0000 7faa5d000640 1 --2- 172.21.15.99:0/3371914157 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7faa3809eed0 0x7faa380a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:36.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.732+0000 7faa54c00640 1 -- 172.21.15.99:0/3371914157 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7faa440b6070 con 0x7faa580701c0 2024-02-21T23:13:36.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.732+0000 7faa5d000640 1 --2- 172.21.15.99:0/3371914157 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7faa3809eed0 0x7faa380a1390 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7faa4c001900 tx=0x7faa4c009040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:36.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.988+0000 7faa5fa00640 1 -- 172.21.15.99:0/3371914157 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7faa580d2aa0 con 0x7faa580701c0 2024-02-21T23:13:36.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.992+0000 7faa54c00640 1 -- 172.21.15.99:0/3371914157 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v16)=0 v16) v1 ==== 123+0+0 (secure 0 0 0) 0x7faa440ba190 con 0x7faa580701c0 2024-02-21T23:13:36.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.993+0000 7faa54c00640 1 -- 172.21.15.99:0/3371914157 <== mon.0 v2:172.21.15.99:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7faa440b9a90 con 0x7faa580701c0 2024-02-21T23:13:36.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.996+0000 7faa5fa00640 1 -- 172.21.15.99:0/3371914157 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7faa3809eed0 msgr2=0x7faa380a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:36.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.996+0000 7faa5fa00640 1 --2- 172.21.15.99:0/3371914157 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7faa3809eed0 0x7faa380a1390 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7faa4c001900 tx=0x7faa4c009040 comp rx=0 tx=0).stop 2024-02-21T23:13:36.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.996+0000 7faa5fa00640 1 -- 172.21.15.99:0/3371914157 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa580701c0 msgr2=0x7faa5821eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:36.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.996+0000 7faa5fa00640 1 --2- 172.21.15.99:0/3371914157 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa580701c0 0x7faa5821eed0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7faa44009870 tx=0x7faa440046c0 comp rx=0 tx=0).stop 2024-02-21T23:13:36.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.996+0000 7faa5fa00640 1 -- 172.21.15.99:0/3371914157 shutdown_connections 2024-02-21T23:13:36.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.996+0000 7faa5fa00640 1 --2- 172.21.15.99:0/3371914157 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7faa3809eed0 0x7faa380a1390 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:36.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.996+0000 7faa5fa00640 1 --2- 172.21.15.99:0/3371914157 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7faa58180c80 0x7faa5821f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:36.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.996+0000 7faa5fa00640 1 --2- 172.21.15.99:0/3371914157 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7faa580701c0 0x7faa5821eed0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:36.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.996+0000 7faa5fa00640 1 --2- 172.21.15.99:0/3371914157 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa5806e910 0x7faa581727e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:36.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.996+0000 7faa5fa00640 1 -- 172.21.15.99:0/3371914157 >> 172.21.15.99:0/3371914157 conn(0x7faa580ce5f0 msgr2=0x7faa580f7d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:36.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.996+0000 7faa5fa00640 1 -- 172.21.15.99:0/3371914157 shutdown_connections 2024-02-21T23:13:36.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:36.996+0000 7faa5fa00640 1 -- 172.21.15.99:0/3371914157 wait complete. 2024-02-21T23:13:37.009 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-02-21T23:13:37.009 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T23:13:37.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.246+0000 7f059cc00640 1 Processor -- start 2024-02-21T23:13:37.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.246+0000 7f059cc00640 1 -- start start 2024-02-21T23:13:37.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.250+0000 7f059cc00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f059818a850 0x7f0598071ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:37.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.250+0000 7f059cc00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0598072420 con 0x7f059818a3d0 2024-02-21T23:13:37.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.250+0000 7f059cc00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0598070380 con 0x7f05981809a0 2024-02-21T23:13:37.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.250+0000 7f059cc00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0598070150 con 0x7f059818a850 2024-02-21T23:13:37.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.250+0000 7f0597400640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f05981809a0 0x7f059806fa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.99:33836/0 (socket says 172.21.15.99:33836) 2024-02-21T23:13:37.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.250+0000 7f0597400640 1 -- 172.21.15.99:0/1993472131 learned_addr learned my addr 172.21.15.99:0/1993472131 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:13:37.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.250+0000 7f0596a00640 1 --1- 172.21.15.99:0/1993472131 >> v1:172.21.15.99:6789/0 conn(0x7f059818a3d0 0x7f05980717d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:50292/0 (socket says 172.21.15.99:50292) 2024-02-21T23:13:37.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.250+0000 7f0597e00640 1 --2- 172.21.15.99:0/1993472131 >> v2:172.21.15.181:3300/0 conn(0x7f059818a850 0x7f0598071ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:37.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.251+0000 7f0596000640 1 -- 172.21.15.99:0/1993472131 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2442549122 0 0) 0x7f0598070380 con 0x7f05981809a0 2024-02-21T23:13:37.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.251+0000 7f0596000640 1 -- 172.21.15.99:0/1993472131 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f057c003520 con 0x7f05981809a0 2024-02-21T23:13:37.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.251+0000 7f0597e00640 1 -- 172.21.15.99:0/1993472131 >> v1:172.21.15.162:6789/0 conn(0x7f05981809a0 legacy=0x7f059806fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:37.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.251+0000 7f0597e00640 1 -- 172.21.15.99:0/1993472131 >> v1:172.21.15.99:6789/0 conn(0x7f059818a3d0 legacy=0x7f05980717d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:37.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.251+0000 7f0596000640 1 -- 172.21.15.99:0/1993472131 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3321631810 0 0) 0x7f0598072420 con 0x7f059818a3d0 2024-02-21T23:13:37.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.251+0000 7f0597e00640 1 -- 172.21.15.99:0/1993472131 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0598070660 con 0x7f059818a850 2024-02-21T23:13:37.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.253+0000 7f0597e00640 1 --2- 172.21.15.99:0/1993472131 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f059818a850 0x7f0598071ee0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f0590009d90 tx=0x7f059002be20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e721e76ea93e30a9 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:37.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.253+0000 7f0596000640 1 -- 172.21.15.99:0/1993472131 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0590039070 con 0x7f059818a850 2024-02-21T23:13:37.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.253+0000 7f0596000640 1 -- 172.21.15.99:0/1993472131 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f059002cbd0 con 0x7f059818a850 2024-02-21T23:13:37.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.253+0000 7f0596000640 1 -- 172.21.15.99:0/1993472131 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0590034440 con 0x7f059818a850 2024-02-21T23:13:37.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.254+0000 7f059cc00640 1 -- 172.21.15.99:0/1993472131 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f059818a850 msgr2=0x7f0598071ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:37.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.254+0000 7f059cc00640 1 --2- 172.21.15.99:0/1993472131 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f059818a850 0x7f0598071ee0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f0590009d90 tx=0x7f059002be20 comp rx=0 tx=0).stop 2024-02-21T23:13:37.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.254+0000 7f059cc00640 1 -- 172.21.15.99:0/1993472131 shutdown_connections 2024-02-21T23:13:37.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.254+0000 7f059cc00640 1 --2- 172.21.15.99:0/1993472131 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f059818a850 0x7f0598071ee0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:37.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.254+0000 7f059cc00640 1 -- 172.21.15.99:0/1993472131 >> 172.21.15.99:0/1993472131 conn(0x7f059806e210 msgr2=0x7f059806e620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:37.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.254+0000 7f059cc00640 1 -- 172.21.15.99:0/1993472131 shutdown_connections 2024-02-21T23:13:37.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.254+0000 7f059cc00640 1 -- 172.21.15.99:0/1993472131 wait complete. 2024-02-21T23:13:37.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.257+0000 7f059cc00640 1 Processor -- start 2024-02-21T23:13:37.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.258+0000 7f059cc00640 1 -- start start 2024-02-21T23:13:37.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.260+0000 7f059cc00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f05981809a0 0x7f05981745b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:37.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.260+0000 7f059cc00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f059818a3d0 0x7f05981595c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:37.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.260+0000 7f059cc00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f059818a850 0x7f05980c9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:37.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.260+0000 7f059cc00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0598070c20 con 0x7f05981809a0 2024-02-21T23:13:37.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.260+0000 7f059cc00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0598071270 con 0x7f059818a850 2024-02-21T23:13:37.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.260+0000 7f059cc00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0598070f00 con 0x7f059818a3d0 2024-02-21T23:13:37.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.260+0000 7f0597400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f05981809a0 0x7f05981745b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:37.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.260+0000 7f0596a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f059818a3d0 0x7f05981595c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:37.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.260+0000 7f0597400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f05981809a0 0x7f05981745b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:38314/0 (socket says 172.21.15.99:38314) 2024-02-21T23:13:37.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.260+0000 7f0597400640 1 -- 172.21.15.99:0/542454323 learned_addr learned my addr 172.21.15.99:0/542454323 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:13:37.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.260+0000 7f0597e00640 1 --2- 172.21.15.99:0/542454323 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f059818a850 0x7f05980c9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:37.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.261+0000 7f0596a00640 1 -- 172.21.15.99:0/542454323 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f059818a850 msgr2=0x7f05980c9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:37.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.261+0000 7f0596a00640 1 --2- 172.21.15.99:0/542454323 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f059818a850 0x7f05980c9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:37.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.261+0000 7f0596a00640 1 -- 172.21.15.99:0/542454323 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f05981809a0 msgr2=0x7f05981745b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:37.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.261+0000 7f0596a00640 1 --2- 172.21.15.99:0/542454323 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f05981809a0 0x7f05981745b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:37.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.261+0000 7f0596a00640 1 -- 172.21.15.99:0/542454323 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f059817b270 con 0x7f059818a3d0 2024-02-21T23:13:37.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.261+0000 7f0596a00640 1 --2- 172.21.15.99:0/542454323 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f059818a3d0 0x7f05981595c0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f058400c3e0 tx=0x7f058400c8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:37.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.261+0000 7f058f400640 1 -- 172.21.15.99:0/542454323 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05840074e0 con 0x7f059818a3d0 2024-02-21T23:13:37.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.261+0000 7f058f400640 1 -- 172.21.15.99:0/542454323 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f0584007680 con 0x7f059818a3d0 2024-02-21T23:13:37.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.261+0000 7f059cc00640 1 -- 172.21.15.99:0/542454323 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f059817b550 con 0x7f059818a3d0 2024-02-21T23:13:37.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.261+0000 7f058f400640 1 -- 172.21.15.99:0/542454323 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0584004a40 con 0x7f059818a3d0 2024-02-21T23:13:37.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.261+0000 7f059cc00640 1 -- 172.21.15.99:0/542454323 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f059817bb10 con 0x7f059818a3d0 2024-02-21T23:13:37.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.262+0000 7f059cc00640 1 -- 172.21.15.99:0/542454323 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0598068320 con 0x7f059818a3d0 2024-02-21T23:13:37.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.266+0000 7f058f400640 1 -- 172.21.15.99:0/542454323 <== mon.2 v2:172.21.15.181:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f0584011070 con 0x7f059818a3d0 2024-02-21T23:13:37.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.268+0000 7f058f400640 1 --2- 172.21.15.99:0/542454323 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f057809eed0 0x7f05780a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:37.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.269+0000 7f058f400640 1 -- 172.21.15.99:0/542454323 <== mon.2 v2:172.21.15.181:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f05840ca170 con 0x7f059818a3d0 2024-02-21T23:13:37.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.269+0000 7f0597400640 1 --2- 172.21.15.99:0/542454323 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f057809eed0 0x7f05780a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:37.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.269+0000 7f058f400640 1 -- 172.21.15.99:0/542454323 <== mon.2 v2:172.21.15.181:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f05840ca660 con 0x7f059818a3d0 2024-02-21T23:13:37.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.270+0000 7f0597400640 1 --2- 172.21.15.99:0/542454323 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f057809eed0 0x7f05780a1390 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f05880011e0 tx=0x7f0588009040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:37.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.600+0000 7f059cc00640 1 -- 172.21.15.99:0/542454323 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f059806dfb0 con 0x7f059818a3d0 2024-02-21T23:13:37.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.601+0000 7f058f400640 1 -- 172.21.15.99:0/542454323 <== mon.2 v2:172.21.15.181:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+11335 (secure 0 0 0) 0x7f0584098120 con 0x7f059818a3d0 2024-02-21T23:13:37.589 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T23:13:37.589 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4307,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/3514452812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3514452812},{"type":"v1","addr":"172.21.15.162:6836","nonce":3514452812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4312,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6838/2169982089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":2169982089},{"type":"v1","addr":"172.21.15.162:6838","nonce":2169982089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4315,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6839/3335972724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6837","nonce":3335972724},{"type":"v1","addr":"172.21.15.162:6839","nonce":3335972724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4318,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6841/2135456697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6840","nonce":2135456697},{"type":"v1","addr":"172.21.15.162:6841","nonce":2135456697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4325,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2452242758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2452242758},{"type":"v1","addr":"172.21.15.181:6833","nonce":2452242758}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4328,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6836/2751486400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":2751486400},{"type":"v1","addr":"172.21.15.181:6836","nonce":2751486400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":17,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-21T23:01:02.656130+0000","modified":"2024-02-21T23:07:03.165223+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4355,"mds_1":4352,"mds_2":4348},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4331":{"gid":4331,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6838/3728901330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6835","nonce":3728901330},{"type":"v1","addr":"172.21.15.181:6838","nonce":3728901330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4339":{"gid":4339,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6839/3357929641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6837","nonce":3357929641},{"type":"v1","addr":"172.21.15.181:6839","nonce":3357929641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4343":{"gid":4343,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6833/2793485078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":2793485078},{"type":"v1","addr":"172.21.15.99:6833","nonce":2793485078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4348":{"gid":4348,"name":"d","rank":2,"incarnation":12,"state":"up:active","state_seq":10,"addr":"172.21.15.99:6835/2243461688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2243461688},{"type":"v1","addr":"172.21.15.99:6835","nonce":2243461688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4352":{"gid":4352,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.99:6837/1676159950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":1676159950},{"type":"v1","addr":"172.21.15.99:6837","nonce":1676159950}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4355":{"gid":4355,"name":"j","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6839/4239008786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":4239008786},{"type":"v1","addr":"172.21.15.99:6839","nonce":4239008786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-21T23:13:37.589 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 17 2024-02-21T23:13:37.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.604+0000 7f059cc00640 1 -- 172.21.15.99:0/542454323 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f057809eed0 msgr2=0x7f05780a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:37.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.604+0000 7f059cc00640 1 --2- 172.21.15.99:0/542454323 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f057809eed0 0x7f05780a1390 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f05880011e0 tx=0x7f0588009040 comp rx=0 tx=0).stop 2024-02-21T23:13:37.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.604+0000 7f059cc00640 1 -- 172.21.15.99:0/542454323 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f059818a3d0 msgr2=0x7f05981595c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:37.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.604+0000 7f059cc00640 1 --2- 172.21.15.99:0/542454323 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f059818a3d0 0x7f05981595c0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f058400c3e0 tx=0x7f058400c8a0 comp rx=0 tx=0).stop 2024-02-21T23:13:37.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.604+0000 7f059cc00640 1 -- 172.21.15.99:0/542454323 shutdown_connections 2024-02-21T23:13:37.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.604+0000 7f059cc00640 1 --2- 172.21.15.99:0/542454323 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f057809eed0 0x7f05780a1390 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:37.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.604+0000 7f059cc00640 1 --2- 172.21.15.99:0/542454323 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f059818a850 0x7f05980c9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:37.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.604+0000 7f059cc00640 1 --2- 172.21.15.99:0/542454323 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f059818a3d0 0x7f05981595c0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:37.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.604+0000 7f059cc00640 1 --2- 172.21.15.99:0/542454323 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f05981809a0 0x7f05981745b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:37.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.604+0000 7f059cc00640 1 -- 172.21.15.99:0/542454323 >> 172.21.15.99:0/542454323 conn(0x7f059806e210 msgr2=0x7f0598066c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:37.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.604+0000 7f059cc00640 1 -- 172.21.15.99:0/542454323 shutdown_connections 2024-02-21T23:13:37.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.605+0000 7f059cc00640 1 -- 172.21.15.99:0/542454323 wait complete. 2024-02-21T23:13:37.611 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-21T23:13:37.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.834+0000 7f1771000640 1 Processor -- start 2024-02-21T23:13:37.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.834+0000 7f1771000640 1 -- start start 2024-02-21T23:13:37.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.838+0000 7f1771000640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f176c18a010 0x7f176c18b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:37.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.838+0000 7f1771000640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f176c0719b0 0x7f176c071e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:37.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.838+0000 7f1771000640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f176c18a600 con 0x7f176c182a80 2024-02-21T23:13:37.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.838+0000 7f1771000640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f176c18bec0 con 0x7f176c18a010 2024-02-21T23:13:37.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.838+0000 7f1771000640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f176c18a8e0 con 0x7f176c0719b0 2024-02-21T23:13:37.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.838+0000 7f1763e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f176c18a010 0x7f176c18b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:37.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.838+0000 7f176be00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f176c0719b0 0x7f176c071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:37.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.838+0000 7f1763e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f176c18a010 0x7f176c18b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:38322/0 (socket says 172.21.15.99:38322) 2024-02-21T23:13:37.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.838+0000 7f1763e00640 1 -- 172.21.15.99:0/2920571974 learned_addr learned my addr 172.21.15.99:0/2920571974 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:13:37.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.838+0000 7f176b400640 1 --1- 172.21.15.99:0/2920571974 >> v1:172.21.15.181:6789/0 conn(0x7f176c182a80 0x7f176c186a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.181:6789/0 says I am v1:172.21.15.99:52124/0 (socket says 172.21.15.99:52124) 2024-02-21T23:13:37.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.838+0000 7f176be00640 1 -- 172.21.15.99:0/2920571974 >> v2:172.21.15.99:3300/0 conn(0x7f176c18a010 msgr2=0x7f176c18b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:13:37.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.838+0000 7f176be00640 1 --2- 172.21.15.99:0/2920571974 >> v2:172.21.15.99:3300/0 conn(0x7f176c18a010 0x7f176c18b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:37.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.838+0000 7f176be00640 1 -- 172.21.15.99:0/2920571974 >> v1:172.21.15.181:6789/0 conn(0x7f176c182a80 legacy=0x7f176c186a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:37.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.838+0000 7f176be00640 1 -- 172.21.15.99:0/2920571974 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f176c18abc0 con 0x7f176c0719b0 2024-02-21T23:13:37.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.840+0000 7f176be00640 1 --2- 172.21.15.99:0/2920571974 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f176c0719b0 0x7f176c071e40 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f176c18c720 tx=0x7f176402bda0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=118b9fba0518ad6a server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:37.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.840+0000 7f176aa00640 1 -- 172.21.15.99:0/2920571974 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1764039070 con 0x7f176c0719b0 2024-02-21T23:13:37.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.840+0000 7f176aa00640 1 -- 172.21.15.99:0/2920571974 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f176402cb50 con 0x7f176c0719b0 2024-02-21T23:13:37.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.840+0000 7f176aa00640 1 -- 172.21.15.99:0/2920571974 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1764034440 con 0x7f176c0719b0 2024-02-21T23:13:37.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.840+0000 7f1771000640 1 -- 172.21.15.99:0/2920571974 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f176c0719b0 msgr2=0x7f176c071e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:37.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.840+0000 7f1771000640 1 --2- 172.21.15.99:0/2920571974 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f176c0719b0 0x7f176c071e40 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f176c18c720 tx=0x7f176402bda0 comp rx=0 tx=0).stop 2024-02-21T23:13:37.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.841+0000 7f1771000640 1 -- 172.21.15.99:0/2920571974 shutdown_connections 2024-02-21T23:13:37.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.841+0000 7f1771000640 1 --2- 172.21.15.99:0/2920571974 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f176c0719b0 0x7f176c071e40 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:37.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.841+0000 7f1771000640 1 --2- 172.21.15.99:0/2920571974 >> v2:172.21.15.99:3300/0 conn(0x7f176c18a010 0x7f176c18b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:37.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.841+0000 7f1771000640 1 -- 172.21.15.99:0/2920571974 >> 172.21.15.99:0/2920571974 conn(0x7f176c0d29f0 msgr2=0x7f176c0d2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:37.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.841+0000 7f1771000640 1 -- 172.21.15.99:0/2920571974 shutdown_connections 2024-02-21T23:13:37.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.841+0000 7f1771000640 1 -- 172.21.15.99:0/2920571974 wait complete. 2024-02-21T23:13:37.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.844+0000 7f1771000640 1 Processor -- start 2024-02-21T23:13:37.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.844+0000 7f1771000640 1 -- start start 2024-02-21T23:13:37.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.845+0000 7f1771000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f176c0719b0 0x7f176c178bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:37.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.845+0000 7f1771000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f176c182a80 0x7f176c179130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:37.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.845+0000 7f1771000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f176c18a010 0x7f176c0fdf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:37.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.845+0000 7f1771000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f176c18b460 con 0x7f176c182a80 2024-02-21T23:13:37.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.845+0000 7f1771000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f176c18b180 con 0x7f176c0719b0 2024-02-21T23:13:37.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.845+0000 7f1771000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f176c182e60 con 0x7f176c18a010 2024-02-21T23:13:37.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.846+0000 7f1763e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f176c182a80 0x7f176c179130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:37.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.846+0000 7f1763e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f176c182a80 0x7f176c179130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:38338/0 (socket says 172.21.15.99:38338) 2024-02-21T23:13:37.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.846+0000 7f176b400640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f176c0719b0 0x7f176c178bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:37.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.846+0000 7f1763e00640 1 -- 172.21.15.99:0/2927474693 learned_addr learned my addr 172.21.15.99:0/2927474693 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:13:37.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.846+0000 7f176be00640 1 --2- 172.21.15.99:0/2927474693 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f176c18a010 0x7f176c0fdf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:37.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.846+0000 7f1763e00640 1 -- 172.21.15.99:0/2927474693 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f176c18a010 msgr2=0x7f176c0fdf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:37.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.846+0000 7f1763e00640 1 --2- 172.21.15.99:0/2927474693 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f176c18a010 0x7f176c0fdf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:37.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.846+0000 7f1763e00640 1 -- 172.21.15.99:0/2927474693 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f176c0719b0 msgr2=0x7f176c178bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:37.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.846+0000 7f1763e00640 1 --2- 172.21.15.99:0/2927474693 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f176c0719b0 0x7f176c178bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:37.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.846+0000 7f1763e00640 1 -- 172.21.15.99:0/2927474693 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f176c0fced0 con 0x7f176c182a80 2024-02-21T23:13:37.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.846+0000 7f176b400640 1 --2- 172.21.15.99:0/2927474693 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f176c0719b0 0x7f176c178bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:13:37.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.847+0000 7f1763e00640 1 --2- 172.21.15.99:0/2927474693 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f176c182a80 0x7f176c179130 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f175400e8b0 tx=0x7f175400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:37.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.847+0000 7f1763400640 1 -- 172.21.15.99:0/2927474693 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1754017070 con 0x7f176c182a80 2024-02-21T23:13:37.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.847+0000 7f1763400640 1 -- 172.21.15.99:0/2927474693 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f175400c940 con 0x7f176c182a80 2024-02-21T23:13:37.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.847+0000 7f1763400640 1 -- 172.21.15.99:0/2927474693 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175400cd50 con 0x7f176c182a80 2024-02-21T23:13:37.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.847+0000 7f1771000640 1 -- 172.21.15.99:0/2927474693 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f176c0fd1b0 con 0x7f176c182a80 2024-02-21T23:13:37.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.847+0000 7f1771000640 1 -- 172.21.15.99:0/2927474693 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f176c0fd770 con 0x7f176c182a80 2024-02-21T23:13:37.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.849+0000 7f1771000640 1 -- 172.21.15.99:0/2927474693 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f176c068320 con 0x7f176c182a80 2024-02-21T23:13:37.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.851+0000 7f1763400640 1 -- 172.21.15.99:0/2927474693 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f175401a070 con 0x7f176c182a80 2024-02-21T23:13:37.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.852+0000 7f1763400640 1 --2- 172.21.15.99:0/2927474693 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f174809eed0 0x7f17480a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:37.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.852+0000 7f1763400640 1 -- 172.21.15.99:0/2927474693 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f17540ca220 con 0x7f176c182a80 2024-02-21T23:13:37.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.852+0000 7f176b400640 1 --2- 172.21.15.99:0/2927474693 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f174809eed0 0x7f17480a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:37.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.853+0000 7f176b400640 1 --2- 172.21.15.99:0/2927474693 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f174809eed0 0x7f17480a1390 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f176c179ba0 tx=0x7f175c007e80 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:37.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:37.860+0000 7f1763400640 1 -- 172.21.15.99:0/2927474693 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f1754097b20 con 0x7f176c182a80 2024-02-21T23:13:38.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.177+0000 7f1771000640 1 -- 172.21.15.99:0/2927474693 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f176c0fcc10 con 0x7f176c182a80 2024-02-21T23:13:38.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.178+0000 7f1763400640 1 -- 172.21.15.99:0/2927474693 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+11335 (secure 0 0 0) 0x7f175409bbc0 con 0x7f176c182a80 2024-02-21T23:13:38.165 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T23:13:38.166 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4307,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/3514452812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3514452812},{"type":"v1","addr":"172.21.15.162:6836","nonce":3514452812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4312,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6838/2169982089","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":2169982089},{"type":"v1","addr":"172.21.15.162:6838","nonce":2169982089}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4315,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6839/3335972724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6837","nonce":3335972724},{"type":"v1","addr":"172.21.15.162:6839","nonce":3335972724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4318,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6841/2135456697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6840","nonce":2135456697},{"type":"v1","addr":"172.21.15.162:6841","nonce":2135456697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4325,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6833/2452242758","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6832","nonce":2452242758},{"type":"v1","addr":"172.21.15.181:6833","nonce":2452242758}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4328,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.181:6836/2751486400","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6834","nonce":2751486400},{"type":"v1","addr":"172.21.15.181:6836","nonce":2751486400}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":17,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-21T23:01:02.656130+0000","modified":"2024-02-21T23:07:03.165223+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4355,"mds_1":4352,"mds_2":4348},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4331":{"gid":4331,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6838/3728901330","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6835","nonce":3728901330},{"type":"v1","addr":"172.21.15.181:6838","nonce":3728901330}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4339":{"gid":4339,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.181:6839/3357929641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6837","nonce":3357929641},{"type":"v1","addr":"172.21.15.181:6839","nonce":3357929641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4343":{"gid":4343,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.99:6833/2793485078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":2793485078},{"type":"v1","addr":"172.21.15.99:6833","nonce":2793485078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4348":{"gid":4348,"name":"d","rank":2,"incarnation":12,"state":"up:active","state_seq":10,"addr":"172.21.15.99:6835/2243461688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6834","nonce":2243461688},{"type":"v1","addr":"172.21.15.99:6835","nonce":2243461688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4352":{"gid":4352,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.99:6837/1676159950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6836","nonce":1676159950},{"type":"v1","addr":"172.21.15.99:6837","nonce":1676159950}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_4355":{"gid":4355,"name":"j","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.99:6839/4239008786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6838","nonce":4239008786},{"type":"v1","addr":"172.21.15.99:6839","nonce":4239008786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-02-21T23:13:38.166 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 17 2024-02-21T23:13:38.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.180+0000 7f1771000640 1 -- 172.21.15.99:0/2927474693 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f174809eed0 msgr2=0x7f17480a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:38.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.180+0000 7f1771000640 1 --2- 172.21.15.99:0/2927474693 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f174809eed0 0x7f17480a1390 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f176c179ba0 tx=0x7f175c007e80 comp rx=0 tx=0).stop 2024-02-21T23:13:38.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.180+0000 7f1771000640 1 -- 172.21.15.99:0/2927474693 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f176c182a80 msgr2=0x7f176c179130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:38.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.180+0000 7f1771000640 1 --2- 172.21.15.99:0/2927474693 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f176c182a80 0x7f176c179130 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f175400e8b0 tx=0x7f175400ed70 comp rx=0 tx=0).stop 2024-02-21T23:13:38.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.180+0000 7f1771000640 1 -- 172.21.15.99:0/2927474693 shutdown_connections 2024-02-21T23:13:38.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.180+0000 7f1771000640 1 --2- 172.21.15.99:0/2927474693 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f174809eed0 0x7f17480a1390 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:38.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.180+0000 7f1771000640 1 --2- 172.21.15.99:0/2927474693 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f176c18a010 0x7f176c0fdf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:38.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.180+0000 7f1771000640 1 --2- 172.21.15.99:0/2927474693 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f176c182a80 0x7f176c179130 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:38.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.180+0000 7f1771000640 1 --2- 172.21.15.99:0/2927474693 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f176c0719b0 0x7f176c178bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:38.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.181+0000 7f1771000640 1 -- 172.21.15.99:0/2927474693 >> 172.21.15.99:0/2927474693 conn(0x7f176c0d29f0 msgr2=0x7f176c18c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:38.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.181+0000 7f1771000640 1 -- 172.21.15.99:0/2927474693 shutdown_connections 2024-02-21T23:13:38.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.181+0000 7f1771000640 1 -- 172.21.15.99:0/2927474693 wait complete. 2024-02-21T23:13:38.195 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-21T23:13:38.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.434+0000 7fdaeca00640 1 Processor -- start 2024-02-21T23:13:38.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.434+0000 7fdaeca00640 1 -- start start 2024-02-21T23:13:38.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.437+0000 7fdaeca00640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7fdae80f0fc0 0x7fdae80f1450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:38.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.437+0000 7fdaeca00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdae8182ae0 con 0x7fdae8182700 2024-02-21T23:13:38.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.438+0000 7fdaeca00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdae80d12f0 con 0x7fdae80f5d90 2024-02-21T23:13:38.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.438+0000 7fdaeca00640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdae8185e60 con 0x7fdae80f0fc0 2024-02-21T23:13:38.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.438+0000 7fdae6800640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fdae8182700 0x7fdae80cff40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:50306/0 (socket says 172.21.15.99:50306) 2024-02-21T23:13:38.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.438+0000 7fdae6800640 1 -- 172.21.15.99:0/3307394082 learned_addr learned my addr 172.21.15.99:0/3307394082 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:13:38.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.438+0000 7fdae7200640 1 --2- 172.21.15.99:0/3307394082 >> v2:172.21.15.181:3300/0 conn(0x7fdae80f0fc0 0x7fdae80f1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:38.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.438+0000 7fdae7200640 1 -- 172.21.15.99:0/3307394082 >> v1:172.21.15.181:6789/0 conn(0x7fdae80f5d90 legacy=0x7fdae80d0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:38.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.438+0000 7fdae7200640 1 -- 172.21.15.99:0/3307394082 >> v1:172.21.15.99:6789/0 conn(0x7fdae8182700 legacy=0x7fdae80cff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:38.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.438+0000 7fdae7200640 1 -- 172.21.15.99:0/3307394082 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdae80f4a10 con 0x7fdae80f0fc0 2024-02-21T23:13:38.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.438+0000 7fdae5400640 1 -- 172.21.15.99:0/3307394082 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2498998457 0 0) 0x7fdad8001110 con 0x7fdae8182700 2024-02-21T23:13:38.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.440+0000 7fdae7200640 1 --2- 172.21.15.99:0/3307394082 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdae80f0fc0 0x7fdae80f1450 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fdae000aea0 tx=0x7fdae002cf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64afba0286fcbbbf server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:38.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.440+0000 7fdae5400640 1 -- 172.21.15.99:0/3307394082 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae002dac0 con 0x7fdae80f0fc0 2024-02-21T23:13:38.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.440+0000 7fdae5400640 1 -- 172.21.15.99:0/3307394082 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fdae002dc60 con 0x7fdae80f0fc0 2024-02-21T23:13:38.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.440+0000 7fdae5400640 1 -- 172.21.15.99:0/3307394082 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae0008680 con 0x7fdae80f0fc0 2024-02-21T23:13:38.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.440+0000 7fdaeca00640 1 -- 172.21.15.99:0/3307394082 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdae80f0fc0 msgr2=0x7fdae80f1450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:38.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.440+0000 7fdaeca00640 1 --2- 172.21.15.99:0/3307394082 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdae80f0fc0 0x7fdae80f1450 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fdae000aea0 tx=0x7fdae002cf20 comp rx=0 tx=0).stop 2024-02-21T23:13:38.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.440+0000 7fdaeca00640 1 -- 172.21.15.99:0/3307394082 shutdown_connections 2024-02-21T23:13:38.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.440+0000 7fdaeca00640 1 --2- 172.21.15.99:0/3307394082 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdae80f0fc0 0x7fdae80f1450 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:38.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.440+0000 7fdaeca00640 1 -- 172.21.15.99:0/3307394082 >> 172.21.15.99:0/3307394082 conn(0x7fdae80ce3c0 msgr2=0x7fdae80ce7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:38.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.441+0000 7fdaeca00640 1 -- 172.21.15.99:0/3307394082 shutdown_connections 2024-02-21T23:13:38.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.441+0000 7fdaeca00640 1 -- 172.21.15.99:0/3307394082 wait complete. 2024-02-21T23:13:38.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.443+0000 7fdaeca00640 1 Processor -- start 2024-02-21T23:13:38.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.443+0000 7fdaeca00640 1 -- start start 2024-02-21T23:13:38.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.445+0000 7fdaeca00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdae80f0fc0 0x7fdae816e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:38.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.445+0000 7fdaeca00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdae80f5d90 0x7fdae8219880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:38.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.445+0000 7fdaeca00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdae8182700 0x7fdae8219dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:38.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.445+0000 7fdaeca00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae80f4fd0 con 0x7fdae8182700 2024-02-21T23:13:38.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.445+0000 7fdaeca00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae80f5900 con 0x7fdae80f0fc0 2024-02-21T23:13:38.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.445+0000 7fdaeca00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae80f52b0 con 0x7fdae80f5d90 2024-02-21T23:13:38.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.445+0000 7fdae6800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdae80f0fc0 0x7fdae816e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:38.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.445+0000 7fdae6800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdae80f0fc0 0x7fdae816e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.99:40734/0 (socket says 172.21.15.99:40734) 2024-02-21T23:13:38.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.445+0000 7fdae6800640 1 -- 172.21.15.99:0/809776646 learned_addr learned my addr 172.21.15.99:0/809776646 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:13:38.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.445+0000 7fdae7200640 1 --2- 172.21.15.99:0/809776646 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdae8182700 0x7fdae8219dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:38.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.446+0000 7fdae5e00640 1 --2- 172.21.15.99:0/809776646 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdae80f5d90 0x7fdae8219880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:38.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.446+0000 7fdae6800640 1 -- 172.21.15.99:0/809776646 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdae80f5d90 msgr2=0x7fdae8219880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:38.435 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.446+0000 7fdae6800640 1 --2- 172.21.15.99:0/809776646 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdae80f5d90 0x7fdae8219880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:38.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.446+0000 7fdae6800640 1 -- 172.21.15.99:0/809776646 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdae8182700 msgr2=0x7fdae8219dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:38.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.446+0000 7fdae6800640 1 --2- 172.21.15.99:0/809776646 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdae8182700 0x7fdae8219dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:38.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.446+0000 7fdae6800640 1 -- 172.21.15.99:0/809776646 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdae821da60 con 0x7fdae80f0fc0 2024-02-21T23:13:38.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.446+0000 7fdae5e00640 1 --2- 172.21.15.99:0/809776646 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdae80f5d90 0x7fdae8219880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:13:38.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.446+0000 7fdae7200640 1 --2- 172.21.15.99:0/809776646 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdae8182700 0x7fdae8219dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:13:38.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.446+0000 7fdae6800640 1 --2- 172.21.15.99:0/809776646 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdae80f0fc0 0x7fdae816e2c0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fdad800c780 tx=0x7fdad800cc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:38.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.447+0000 7fdadea00640 1 -- 172.21.15.99:0/809776646 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad8018070 con 0x7fdae80f0fc0 2024-02-21T23:13:38.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.447+0000 7fdadea00640 1 -- 172.21.15.99:0/809776646 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fdad80072d0 con 0x7fdae80f0fc0 2024-02-21T23:13:38.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.447+0000 7fdadea00640 1 -- 172.21.15.99:0/809776646 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad80047e0 con 0x7fdae80f0fc0 2024-02-21T23:13:38.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.447+0000 7fdaeca00640 1 -- 172.21.15.99:0/809776646 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdae821dd40 con 0x7fdae80f0fc0 2024-02-21T23:13:38.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.447+0000 7fdaeca00640 1 -- 172.21.15.99:0/809776646 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdae8219080 con 0x7fdae80f0fc0 2024-02-21T23:13:38.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.448+0000 7fdaeca00640 1 -- 172.21.15.99:0/809776646 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdae8068320 con 0x7fdae80f0fc0 2024-02-21T23:13:38.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.452+0000 7fdadea00640 1 -- 172.21.15.99:0/809776646 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7fdad800a640 con 0x7fdae80f0fc0 2024-02-21T23:13:38.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.453+0000 7fdadea00640 1 --2- 172.21.15.99:0/809776646 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fdac809eed0 0x7fdac80a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:38.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.453+0000 7fdadea00640 1 -- 172.21.15.99:0/809776646 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 8877+0+0 (secure 0 0 0) 0x7fdad80c9680 con 0x7fdae80f0fc0 2024-02-21T23:13:38.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.454+0000 7fdae5e00640 1 --2- 172.21.15.99:0/809776646 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fdac809eed0 0x7fdac80a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:38.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.454+0000 7fdae5e00640 1 --2- 172.21.15.99:0/809776646 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fdac809eed0 0x7fdac80a1390 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fdae80f3ed0 tx=0x7fdad4009040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:38.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.455+0000 7fdadea00640 1 -- 172.21.15.99:0/809776646 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fdad8021020 con 0x7fdae80f0fc0 2024-02-21T23:13:38.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.764+0000 7fdaeca00640 1 -- 172.21.15.99:0/809776646 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdae80730b0 con 0x7fdae80f0fc0 2024-02-21T23:13:38.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.765+0000 7fdadea00640 1 -- 172.21.15.99:0/809776646 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+24383 (secure 0 0 0) 0x7fdae8182ae0 con 0x7fdae80f0fc0 2024-02-21T23:13:38.753 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-02-21T23:13:38.754 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":42,"fsid":"e8af98cd-45a1-425f-96a7-f24da8ee4efb","created":"2024-02-21T23:00:44.699708+0000","modified":"2024-02-21T23:13:09.834138+0000","last_up_change":"2024-02-21T23:00:55.749829+0000","last_in_change":"2024-02-21T23:00:48.332297+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-21T23:00:57.020557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":11.760000228881836,"score_stable":11.760000228881836,"optimal_score":0.17000000178813934,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-02-21T23:01:01.124398+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-02-21T23:01:01.684258+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-02-21T23:01:05.290089+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":41,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c49de9b2-dc53-4882-b14c-7059ed40bf59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6809","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6811","nonce":1026112937}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6813","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6815","nonce":1026112937}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6821","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6823","nonce":1026112937}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6817","nonce":1026112937},{"type":"v1","addr":"172.21.15.99:6819","nonce":1026112937}]},"public_addr":"172.21.15.99:6811/1026112937","cluster_addr":"172.21.15.99:6815/1026112937","heartbeat_back_addr":"172.21.15.99:6823/1026112937","heartbeat_front_addr":"172.21.15.99:6819/1026112937","state":["exists","up"]},{"osd":1,"uuid":"58398292-2fe5-4291-94fd-03a0ca29d49d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6827","nonce":3030871566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6829","nonce":3030871566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6833","nonce":3030871566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3030871566},{"type":"v1","addr":"172.21.15.162:6831","nonce":3030871566}]},"public_addr":"172.21.15.162:6827/3030871566","cluster_addr":"172.21.15.162:6829/3030871566","heartbeat_back_addr":"172.21.15.162:6833/3030871566","heartbeat_front_addr":"172.21.15.162:6831/3030871566","state":["exists","up"]},{"osd":2,"uuid":"94cddec1-e08f-438d-a7c8-48a0e47d71a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6816","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6818","nonce":2782386148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6820","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6821","nonce":2782386148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6827","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6829","nonce":2782386148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6823","nonce":2782386148},{"type":"v1","addr":"172.21.15.181:6825","nonce":2782386148}]},"public_addr":"172.21.15.181:6818/2782386148","cluster_addr":"172.21.15.181:6821/2782386148","heartbeat_back_addr":"172.21.15.181:6829/2782386148","heartbeat_front_addr":"172.21.15.181:6825/2782386148","state":["exists","up"]},{"osd":3,"uuid":"d29abb74-9b89-4fd7-88b1-7c2eb8231189","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6801","nonce":2316185310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6803","nonce":2316185310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6807","nonce":2316185310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":2316185310},{"type":"v1","addr":"172.21.15.99:6805","nonce":2316185310}]},"public_addr":"172.21.15.99:6801/2316185310","cluster_addr":"172.21.15.99:6803/2316185310","heartbeat_back_addr":"172.21.15.99:6807/2316185310","heartbeat_front_addr":"172.21.15.99:6805/2316185310","state":["exists","up"]},{"osd":4,"uuid":"0d8c9ea3-880a-4d69-9dcb-cf7d35abd449","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6811","nonce":3137681258}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6813","nonce":3137681258}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6817","nonce":3137681258}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":3137681258},{"type":"v1","addr":"172.21.15.162:6815","nonce":3137681258}]},"public_addr":"172.21.15.162:6811/3137681258","cluster_addr":"172.21.15.162:6813/3137681258","heartbeat_back_addr":"172.21.15.162:6817/3137681258","heartbeat_front_addr":"172.21.15.162:6815/3137681258","state":["exists","up"]},{"osd":5,"uuid":"2e3a9340-6fd0-4d7a-8e00-fe305649296e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6800","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6801","nonce":2011264527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6803","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6805","nonce":2011264527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6811","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6813","nonce":2011264527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6807","nonce":2011264527},{"type":"v1","addr":"172.21.15.181:6809","nonce":2011264527}]},"public_addr":"172.21.15.181:6801/2011264527","cluster_addr":"172.21.15.181:6805/2011264527","heartbeat_back_addr":"172.21.15.181:6813/2011264527","heartbeat_front_addr":"172.21.15.181:6809/2011264527","state":["exists","up"]},{"osd":6,"uuid":"d9e37ce7-1b0e-4019-8f2e-b670403abf7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6810","nonce":753870050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6814","nonce":753870050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6822","nonce":753870050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":753870050},{"type":"v1","addr":"172.21.15.99:6818","nonce":753870050}]},"public_addr":"172.21.15.99:6810/753870050","cluster_addr":"172.21.15.99:6814/753870050","heartbeat_back_addr":"172.21.15.99:6822/753870050","heartbeat_front_addr":"172.21.15.99:6818/753870050","state":["exists","up"]},{"osd":7,"uuid":"49988754-232e-4b8c-bd72-bfa25b418e5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6803","nonce":1659412949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6805","nonce":1659412949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6809","nonce":1659412949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1659412949},{"type":"v1","addr":"172.21.15.162:6807","nonce":1659412949}]},"public_addr":"172.21.15.162:6803/1659412949","cluster_addr":"172.21.15.162:6805/1659412949","heartbeat_back_addr":"172.21.15.162:6809/1659412949","heartbeat_front_addr":"172.21.15.162:6807/1659412949","state":["exists","up"]},{"osd":8,"uuid":"ebc6e462-8368-4d64-b242-9c8735ac672c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6802","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6804","nonce":3389807042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6806","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6808","nonce":3389807042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6814","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6815","nonce":3389807042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6810","nonce":3389807042},{"type":"v1","addr":"172.21.15.181:6812","nonce":3389807042}]},"public_addr":"172.21.15.181:6804/3389807042","cluster_addr":"172.21.15.181:6808/3389807042","heartbeat_back_addr":"172.21.15.181:6815/3389807042","heartbeat_front_addr":"172.21.15.181:6812/3389807042","state":["exists","up"]},{"osd":9,"uuid":"72af1b02-b965-4d6a-8964-527ec24c4daa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6825","nonce":4055669590}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6827","nonce":4055669590}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6831","nonce":4055669590}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":4055669590},{"type":"v1","addr":"172.21.15.99:6829","nonce":4055669590}]},"public_addr":"172.21.15.99:6825/4055669590","cluster_addr":"172.21.15.99:6827/4055669590","heartbeat_back_addr":"172.21.15.99:6831/4055669590","heartbeat_front_addr":"172.21.15.99:6829/4055669590","state":["exists","up"]},{"osd":10,"uuid":"adb5cb06-6453-41e4-b847-d7c78bbb7d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6819","nonce":1421879617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6821","nonce":1421879617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6825","nonce":1421879617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":1421879617},{"type":"v1","addr":"172.21.15.162:6823","nonce":1421879617}]},"public_addr":"172.21.15.162:6819/1421879617","cluster_addr":"172.21.15.162:6821/1421879617","heartbeat_back_addr":"172.21.15.162:6825/1421879617","heartbeat_front_addr":"172.21.15.162:6823/1421879617","state":["exists","up"]},{"osd":11,"uuid":"118563d9-1e8f-4dc7-a92c-2f4c4dc3e20f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6817","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6819","nonce":3219928272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6822","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6824","nonce":3219928272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6830","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6831","nonce":3219928272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.181:6826","nonce":3219928272},{"type":"v1","addr":"172.21.15.181:6828","nonce":3219928272}]},"public_addr":"172.21.15.181:6819/3219928272","cluster_addr":"172.21.15.181:6824/3219928272","heartbeat_back_addr":"172.21.15.181:6831/3219928272","heartbeat_front_addr":"172.21.15.181:6828/3219928272","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.651219+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.549859+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.529659+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.591004+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.440836+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.414250+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.630130+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.411954+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.439371+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.428173+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.511203+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-21T23:00:53.482806+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.6","mappings":[{"from":9,"to":11}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]},{"pgid":"4.14","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.162:0/612025202":"2024-02-22T23:02:14.008014+0000","172.21.15.162:0/1516346096":"2024-02-22T23:02:14.008014+0000","172.21.15.162:0/328516024":"2024-02-22T23:02:14.008014+0000","172.21.15.162:0/3695581546":"2024-02-22T23:02:14.008014+0000","172.21.15.162:6801/1717094936":"2024-02-22T23:02:14.008014+0000","172.21.15.162:0/506228072":"2024-02-22T23:02:14.008014+0000","172.21.15.162:6800/1717094936":"2024-02-22T23:02:14.008014+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]},{"pool":4,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-21T23:13:38.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.768+0000 7fdaeca00640 1 -- 172.21.15.99:0/809776646 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fdac809eed0 msgr2=0x7fdac80a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:38.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.768+0000 7fdaeca00640 1 --2- 172.21.15.99:0/809776646 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fdac809eed0 0x7fdac80a1390 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fdae80f3ed0 tx=0x7fdad4009040 comp rx=0 tx=0).stop 2024-02-21T23:13:38.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.768+0000 7fdaeca00640 1 -- 172.21.15.99:0/809776646 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdae80f0fc0 msgr2=0x7fdae816e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:38.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.768+0000 7fdaeca00640 1 --2- 172.21.15.99:0/809776646 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdae80f0fc0 0x7fdae816e2c0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fdad800c780 tx=0x7fdad800cc40 comp rx=0 tx=0).stop 2024-02-21T23:13:38.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.768+0000 7fdaeca00640 1 -- 172.21.15.99:0/809776646 shutdown_connections 2024-02-21T23:13:38.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.768+0000 7fdaeca00640 1 --2- 172.21.15.99:0/809776646 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fdac809eed0 0x7fdac80a1390 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:38.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.768+0000 7fdaeca00640 1 --2- 172.21.15.99:0/809776646 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fdae8182700 0x7fdae8219dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:38.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.768+0000 7fdaeca00640 1 --2- 172.21.15.99:0/809776646 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fdae80f5d90 0x7fdae8219880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:38.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.768+0000 7fdaeca00640 1 --2- 172.21.15.99:0/809776646 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdae80f0fc0 0x7fdae816e2c0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:38.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.768+0000 7fdaeca00640 1 -- 172.21.15.99:0/809776646 >> 172.21.15.99:0/809776646 conn(0x7fdae80ce3c0 msgr2=0x7fdae80d0920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:38.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.768+0000 7fdaeca00640 1 -- 172.21.15.99:0/809776646 shutdown_connections 2024-02-21T23:13:38.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:38.768+0000 7fdaeca00640 1 -- 172.21.15.99:0/809776646 wait complete. 2024-02-21T23:13:38.784 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-02-21T23:13:39.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.025+0000 7f0e1e000640 1 Processor -- start 2024-02-21T23:13:39.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.025+0000 7f0e1e000640 1 -- start start 2024-02-21T23:13:39.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.028+0000 7f0e1e000640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f0e181833f0 0x7f0e180f8020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:39.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.028+0000 7f0e1e000640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f0e180f8560 0x7f0e181845c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:39.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.028+0000 7f0e1e000640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e180f89a0 con 0x7f0e18184b00 2024-02-21T23:13:39.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.028+0000 7f0e1e000640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e18186a10 con 0x7f0e180f8560 2024-02-21T23:13:39.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.028+0000 7f0e1e000640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e180f8c40 con 0x7f0e181833f0 2024-02-21T23:13:39.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.028+0000 7f0e17400640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f0e181833f0 0x7f0e180f8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:39.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.028+0000 7f0e16a00640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f0e180f8560 0x7f0e181845c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:39.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.028+0000 7f0e17400640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f0e181833f0 0x7f0e180f8020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.181:3300/0 says I am v2:172.21.15.99:39980/0 (socket says 172.21.15.99:39980) 2024-02-21T23:13:39.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.028+0000 7f0e17e00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f0e18184b00 0x7f0e1806e310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:50308/0 (socket says 172.21.15.99:50308) 2024-02-21T23:13:39.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.028+0000 7f0e17400640 1 -- 172.21.15.99:0/2578908652 learned_addr learned my addr 172.21.15.99:0/2578908652 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:13:39.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.029+0000 7f0e17400640 1 -- 172.21.15.99:0/2578908652 >> v2:172.21.15.162:3300/0 conn(0x7f0e180f8560 msgr2=0x7f0e181845c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:13:39.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.029+0000 7f0e17400640 1 --2- 172.21.15.99:0/2578908652 >> v2:172.21.15.162:3300/0 conn(0x7f0e180f8560 0x7f0e181845c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:39.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.029+0000 7f0e17400640 1 -- 172.21.15.99:0/2578908652 >> v1:172.21.15.99:6789/0 conn(0x7f0e18184b00 legacy=0x7f0e1806e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:39.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.029+0000 7f0e17400640 1 -- 172.21.15.99:0/2578908652 --> v2:172.21.15.181:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e180f8f20 con 0x7f0e181833f0 2024-02-21T23:13:39.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.030+0000 7f0e17400640 1 --2- 172.21.15.99:0/2578908652 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0e181833f0 0x7f0e180f8020 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f0e180fb220 tx=0x7f0e0802b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5ab2a1d7a09fc27 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:39.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.031+0000 7f0e16000640 1 -- 172.21.15.99:0/2578908652 <== mon.2 v2:172.21.15.181:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e08035020 con 0x7f0e181833f0 2024-02-21T23:13:39.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.031+0000 7f0e16000640 1 -- 172.21.15.99:0/2578908652 <== mon.2 v2:172.21.15.181:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f0e08031870 con 0x7f0e181833f0 2024-02-21T23:13:39.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.031+0000 7f0e16000640 1 -- 172.21.15.99:0/2578908652 <== mon.2 v2:172.21.15.181:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e08031c60 con 0x7f0e181833f0 2024-02-21T23:13:39.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.031+0000 7f0e1e000640 1 -- 172.21.15.99:0/2578908652 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0e181833f0 msgr2=0x7f0e180f8020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:39.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.031+0000 7f0e1e000640 1 --2- 172.21.15.99:0/2578908652 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0e181833f0 0x7f0e180f8020 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f0e180fb220 tx=0x7f0e0802b910 comp rx=0 tx=0).stop 2024-02-21T23:13:39.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.032+0000 7f0e1e000640 1 -- 172.21.15.99:0/2578908652 shutdown_connections 2024-02-21T23:13:39.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.032+0000 7f0e1e000640 1 --2- 172.21.15.99:0/2578908652 >> v2:172.21.15.162:3300/0 conn(0x7f0e180f8560 0x7f0e181845c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:39.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.032+0000 7f0e1e000640 1 --2- 172.21.15.99:0/2578908652 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0e181833f0 0x7f0e180f8020 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:39.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.032+0000 7f0e1e000640 1 -- 172.21.15.99:0/2578908652 >> 172.21.15.99:0/2578908652 conn(0x7f0e180ce5f0 msgr2=0x7f0e180cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:39.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.032+0000 7f0e1e000640 1 -- 172.21.15.99:0/2578908652 shutdown_connections 2024-02-21T23:13:39.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.032+0000 7f0e1e000640 1 -- 172.21.15.99:0/2578908652 wait complete. 2024-02-21T23:13:39.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.035+0000 7f0e1e000640 1 Processor -- start 2024-02-21T23:13:39.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.035+0000 7f0e1e000640 1 -- start start 2024-02-21T23:13:39.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.037+0000 7f0e1e000640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0e180f8560 0x7f0e18164d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:39.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.037+0000 7f0e1e000640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e181833f0 0x7f0e18165240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:39.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.037+0000 7f0e1e000640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0e18184b00 0x7f0e18222530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:39.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.037+0000 7f0e1e000640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e181840a0 con 0x7f0e180f8560 2024-02-21T23:13:39.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.037+0000 7f0e1e000640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e18183dc0 con 0x7f0e181833f0 2024-02-21T23:13:39.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.037+0000 7f0e1e000640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e18184f30 con 0x7f0e18184b00 2024-02-21T23:13:39.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.037+0000 7f0e17400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0e180f8560 0x7f0e18164d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:39.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.037+0000 7f0e17400640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0e180f8560 0x7f0e18164d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:38344/0 (socket says 172.21.15.99:38344) 2024-02-21T23:13:39.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.037+0000 7f0e17400640 1 -- 172.21.15.99:0/3375713278 learned_addr learned my addr 172.21.15.99:0/3375713278 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:13:39.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.038+0000 7f0e16a00640 1 --2- 172.21.15.99:0/3375713278 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e181833f0 0x7f0e18165240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:39.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.038+0000 7f0e17e00640 1 --2- 172.21.15.99:0/3375713278 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0e18184b00 0x7f0e18222530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:39.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.038+0000 7f0e17400640 1 -- 172.21.15.99:0/3375713278 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0e18184b00 msgr2=0x7f0e18222530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:39.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.038+0000 7f0e17400640 1 --2- 172.21.15.99:0/3375713278 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0e18184b00 0x7f0e18222530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:39.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.038+0000 7f0e17400640 1 -- 172.21.15.99:0/3375713278 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e181833f0 msgr2=0x7f0e18165240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:39.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.038+0000 7f0e17400640 1 --2- 172.21.15.99:0/3375713278 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e181833f0 0x7f0e18165240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:39.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.038+0000 7f0e17400640 1 -- 172.21.15.99:0/3375713278 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e182211b0 con 0x7f0e180f8560 2024-02-21T23:13:39.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.038+0000 7f0e16a00640 1 --2- 172.21.15.99:0/3375713278 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e181833f0 0x7f0e18165240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:13:39.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.038+0000 7f0e17400640 1 --2- 172.21.15.99:0/3375713278 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0e180f8560 0x7f0e18164d00 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f0e08000c00 tx=0x7f0e080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:39.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.039+0000 7f0e0f400640 1 -- 172.21.15.99:0/3375713278 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e08040070 con 0x7f0e180f8560 2024-02-21T23:13:39.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.039+0000 7f0e0f400640 1 -- 172.21.15.99:0/3375713278 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f0e08030c50 con 0x7f0e180f8560 2024-02-21T23:13:39.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.039+0000 7f0e0f400640 1 -- 172.21.15.99:0/3375713278 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e08035040 con 0x7f0e180f8560 2024-02-21T23:13:39.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.039+0000 7f0e1e000640 1 -- 172.21.15.99:0/3375713278 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e18221490 con 0x7f0e180f8560 2024-02-21T23:13:39.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.039+0000 7f0e1e000640 1 -- 172.21.15.99:0/3375713278 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e18221a50 con 0x7f0e180f8560 2024-02-21T23:13:39.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.041+0000 7f0e1e000640 1 -- 172.21.15.99:0/3375713278 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e180f9de0 con 0x7f0e180f8560 2024-02-21T23:13:39.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.042+0000 7f0e0f400640 1 -- 172.21.15.99:0/3375713278 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f0e08038020 con 0x7f0e180f8560 2024-02-21T23:13:39.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.043+0000 7f0e0f400640 1 --2- 172.21.15.99:0/3375713278 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f0df809eed0 0x7f0df80a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:39.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.043+0000 7f0e0f400640 1 -- 172.21.15.99:0/3375713278 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 8877+0+0 (secure 0 0 0) 0x7f0e080ebe30 con 0x7f0e180f8560 2024-02-21T23:13:39.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.044+0000 7f0e16a00640 1 --2- 172.21.15.99:0/3375713278 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f0df809eed0 0x7f0df80a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:39.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.044+0000 7f0e16a00640 1 --2- 172.21.15.99:0/3375713278 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f0df809eed0 0x7f0df80a1390 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0e1817e670 tx=0x7f0e04009190 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:39.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.047+0000 7f0e0f400640 1 -- 172.21.15.99:0/3375713278 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f0e180f9de0 con 0x7f0e180f8560 2024-02-21T23:13:39.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.343+0000 7f0e1e000640 1 -- 172.21.15.99:0/3375713278 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f0e18172600 con 0x7f0e180f8560 2024-02-21T23:13:39.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.346+0000 7f0e0f400640 1 -- 172.21.15.99:0/3375713278 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v18) v1 ==== 161+0+0 (secure 0 0 0) 0x7f0e080b9730 con 0x7f0e180f8560 2024-02-21T23:13:39.334 INFO:teuthology.orchestra.run.smithi099.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-02-21T23:13:39.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.355+0000 7f0e1e000640 1 -- 172.21.15.99:0/3375713278 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f0df809eed0 msgr2=0x7f0df80a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:39.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.355+0000 7f0e1e000640 1 --2- 172.21.15.99:0/3375713278 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f0df809eed0 0x7f0df80a1390 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0e1817e670 tx=0x7f0e04009190 comp rx=0 tx=0).stop 2024-02-21T23:13:39.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.355+0000 7f0e1e000640 1 -- 172.21.15.99:0/3375713278 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0e180f8560 msgr2=0x7f0e18164d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:39.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.355+0000 7f0e1e000640 1 --2- 172.21.15.99:0/3375713278 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0e180f8560 0x7f0e18164d00 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f0e08000c00 tx=0x7f0e080046c0 comp rx=0 tx=0).stop 2024-02-21T23:13:39.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.355+0000 7f0e1e000640 1 -- 172.21.15.99:0/3375713278 shutdown_connections 2024-02-21T23:13:39.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.355+0000 7f0e1e000640 1 --2- 172.21.15.99:0/3375713278 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f0df809eed0 0x7f0df80a1390 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:39.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.355+0000 7f0e1e000640 1 --2- 172.21.15.99:0/3375713278 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f0e18184b00 0x7f0e18222530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:39.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.355+0000 7f0e1e000640 1 --2- 172.21.15.99:0/3375713278 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0e181833f0 0x7f0e18165240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:39.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.355+0000 7f0e1e000640 1 --2- 172.21.15.99:0/3375713278 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f0e180f8560 0x7f0e18164d00 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:39.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.355+0000 7f0e1e000640 1 -- 172.21.15.99:0/3375713278 >> 172.21.15.99:0/3375713278 conn(0x7f0e180ce5f0 msgr2=0x7f0e18186150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:39.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.355+0000 7f0e1e000640 1 -- 172.21.15.99:0/3375713278 shutdown_connections 2024-02-21T23:13:39.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.355+0000 7f0e1e000640 1 -- 172.21.15.99:0/3375713278 wait complete. 2024-02-21T23:13:39.373 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-02-21T23:13:39.386 INFO:tasks.ceph.mds.i.smithi181.stdout:starting mds.i at 2024-02-21T23:13:39.386 INFO:tasks.ceph.mds.l.smithi181.stdout:starting mds.l at 2024-02-21T23:13:39.433 INFO:tasks.ceph.mds.d.smithi099.stdout:starting mds.d at 2024-02-21T23:13:39.436 INFO:tasks.ceph.mds.a.smithi099.stdout:starting mds.a at 2024-02-21T23:13:39.450 INFO:tasks.ceph.mds.g.smithi099.stdout:starting mds.g at 2024-02-21T23:13:39.461 INFO:tasks.ceph.mds.j.smithi099.stdout:starting mds.j at 2024-02-21T23:13:39.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.578+0000 7f8e37200640 1 Processor -- start 2024-02-21T23:13:39.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.578+0000 7f8e37200640 1 -- start start 2024-02-21T23:13:39.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.580+0000 7f8e37200640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f8e300fe050 0x7f8e3018a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:39.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.580+0000 7f8e37200640 1 --2- >> v2:172.21.15.181:3300/0 conn(0x7f8e3018a5f0 0x7f8e3018c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:39.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.580+0000 7f8e37200640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e300fccd0 con 0x7f8e3015e0e0 2024-02-21T23:13:39.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.580+0000 7f8e37200640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e30189bd0 con 0x7f8e300fe050 2024-02-21T23:13:39.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.580+0000 7f8e37200640 1 -- --> v2:172.21.15.181:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e300fdbc0 con 0x7f8e3018a5f0 2024-02-21T23:13:39.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.580+0000 7f8e2f400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f8e300fe050 0x7f8e3018a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:39.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.580+0000 7f8e2f400640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7f8e300fe050 0x7f8e3018a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:38396/0 (socket says 172.21.15.99:38396) 2024-02-21T23:13:39.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.580+0000 7f8e2f400640 1 -- 172.21.15.99:0/4056437056 learned_addr learned my addr 172.21.15.99:0/4056437056 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:13:39.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.580+0000 7f8e2fe00640 1 --1- 172.21.15.99:0/4056437056 >> v1:172.21.15.162:6789/0 conn(0x7f8e3015e0e0 0x7f8e300fc4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.99:33854/0 (socket says 172.21.15.99:33854) 2024-02-21T23:13:39.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.581+0000 7f8e35200640 1 --2- 172.21.15.99:0/4056437056 >> v2:172.21.15.181:3300/0 conn(0x7f8e3018a5f0 0x7f8e3018c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:39.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.581+0000 7f8e2f400640 1 -- 172.21.15.99:0/4056437056 >> v2:172.21.15.181:3300/0 conn(0x7f8e3018a5f0 msgr2=0x7f8e3018c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:13:39.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.581+0000 7f8e2f400640 1 --2- 172.21.15.99:0/4056437056 >> v2:172.21.15.181:3300/0 conn(0x7f8e3018a5f0 0x7f8e3018c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:39.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.581+0000 7f8e2f400640 1 -- 172.21.15.99:0/4056437056 >> v1:172.21.15.162:6789/0 conn(0x7f8e3015e0e0 legacy=0x7f8e300fc4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:39.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.581+0000 7f8e2ea00640 1 -- 172.21.15.99:0/4056437056 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3003246807 0 0) 0x7f8e300fccd0 con 0x7f8e3015e0e0 2024-02-21T23:13:39.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.581+0000 7f8e2f400640 1 -- 172.21.15.99:0/4056437056 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e300fcfb0 con 0x7f8e300fe050 2024-02-21T23:13:39.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.582+0000 7f8e2f400640 1 --2- 172.21.15.99:0/4056437056 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8e300fe050 0x7f8e3018a0b0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f8e300ff640 tx=0x7f8e1802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a17d00a9a57ba055 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:39.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.582+0000 7f8e2ea00640 1 -- 172.21.15.99:0/4056437056 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1802e070 con 0x7f8e300fe050 2024-02-21T23:13:39.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.582+0000 7f8e2ea00640 1 -- 172.21.15.99:0/4056437056 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f8e18037070 con 0x7f8e300fe050 2024-02-21T23:13:39.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.582+0000 7f8e2ea00640 1 -- 172.21.15.99:0/4056437056 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e18031a20 con 0x7f8e300fe050 2024-02-21T23:13:39.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.583+0000 7f8e37200640 1 -- 172.21.15.99:0/4056437056 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8e300fe050 msgr2=0x7f8e3018a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:39.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.583+0000 7f8e37200640 1 --2- 172.21.15.99:0/4056437056 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8e300fe050 0x7f8e3018a0b0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f8e300ff640 tx=0x7f8e1802b880 comp rx=0 tx=0).stop 2024-02-21T23:13:39.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.583+0000 7f8e37200640 1 -- 172.21.15.99:0/4056437056 shutdown_connections 2024-02-21T23:13:39.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.583+0000 7f8e37200640 1 --2- 172.21.15.99:0/4056437056 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8e300fe050 0x7f8e3018a0b0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:39.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.583+0000 7f8e37200640 1 --2- 172.21.15.99:0/4056437056 >> v2:172.21.15.181:3300/0 conn(0x7f8e3018a5f0 0x7f8e3018c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:39.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.583+0000 7f8e37200640 1 -- 172.21.15.99:0/4056437056 >> 172.21.15.99:0/4056437056 conn(0x7f8e300d2cb0 msgr2=0x7f8e300d30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:39.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.583+0000 7f8e37200640 1 -- 172.21.15.99:0/4056437056 shutdown_connections 2024-02-21T23:13:39.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.583+0000 7f8e37200640 1 -- 172.21.15.99:0/4056437056 wait complete. 2024-02-21T23:13:39.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.585+0000 7f8e37200640 1 Processor -- start 2024-02-21T23:13:39.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.585+0000 7f8e37200640 1 -- start start 2024-02-21T23:13:39.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.586+0000 7f8e37200640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8e300fe050 0x7f8e3017d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:39.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.586+0000 7f8e37200640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8e3015e0e0 0x7f8e3017c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:39.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.586+0000 7f8e37200640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e3018a5f0 0x7f8e30210e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:39.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.586+0000 7f8e37200640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e300fd850 con 0x7f8e300fe050 2024-02-21T23:13:39.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.586+0000 7f8e37200640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e300fd570 con 0x7f8e3018a5f0 2024-02-21T23:13:39.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.586+0000 7f8e37200640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e300d4ae0 con 0x7f8e3015e0e0 2024-02-21T23:13:39.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.587+0000 7f8e2fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8e300fe050 0x7f8e3017d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:39.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.587+0000 7f8e2fe00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8e300fe050 0x7f8e3017d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:38400/0 (socket says 172.21.15.99:38400) 2024-02-21T23:13:39.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.587+0000 7f8e2fe00640 1 -- 172.21.15.99:0/3378135427 learned_addr learned my addr 172.21.15.99:0/3378135427 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:13:39.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.587+0000 7f8e35200640 1 --2- 172.21.15.99:0/3378135427 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e3018a5f0 0x7f8e30210e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:39.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.587+0000 7f8e2f400640 1 --2- 172.21.15.99:0/3378135427 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8e3015e0e0 0x7f8e3017c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:39.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.587+0000 7f8e2fe00640 1 -- 172.21.15.99:0/3378135427 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8e3015e0e0 msgr2=0x7f8e3017c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:39.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.587+0000 7f8e2fe00640 1 --2- 172.21.15.99:0/3378135427 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8e3015e0e0 0x7f8e3017c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:39.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.587+0000 7f8e2fe00640 1 -- 172.21.15.99:0/3378135427 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e3018a5f0 msgr2=0x7f8e30210e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:39.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.587+0000 7f8e2fe00640 1 --2- 172.21.15.99:0/3378135427 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e3018a5f0 0x7f8e30210e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:39.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.587+0000 7f8e2fe00640 1 -- 172.21.15.99:0/3378135427 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e30211390 con 0x7f8e300fe050 2024-02-21T23:13:39.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.587+0000 7f8e35200640 1 --2- 172.21.15.99:0/3378135427 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e3018a5f0 0x7f8e30210e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:13:39.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.587+0000 7f8e2fe00640 1 --2- 172.21.15.99:0/3378135427 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8e300fe050 0x7f8e3017d220 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f8e2000c8c0 tx=0x7f8e2000cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:39.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.588+0000 7f8e27e00640 1 -- 172.21.15.99:0/3378135427 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e20018070 con 0x7f8e300fe050 2024-02-21T23:13:39.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.588+0000 7f8e27e00640 1 -- 172.21.15.99:0/3378135427 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f8e2000a5e0 con 0x7f8e300fe050 2024-02-21T23:13:39.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.588+0000 7f8e27e00640 1 -- 172.21.15.99:0/3378135427 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2000aa30 con 0x7f8e300fe050 2024-02-21T23:13:39.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.588+0000 7f8e37200640 1 -- 172.21.15.99:0/3378135427 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e30211660 con 0x7f8e300fe050 2024-02-21T23:13:39.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.588+0000 7f8e37200640 1 -- 172.21.15.99:0/3378135427 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e30211c20 con 0x7f8e300fe050 2024-02-21T23:13:39.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.589+0000 7f8e37200640 1 -- 172.21.15.99:0/3378135427 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e30068780 con 0x7f8e300fe050 2024-02-21T23:13:39.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.591+0000 7f8e27e00640 1 -- 172.21.15.99:0/3378135427 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f8e2000abd0 con 0x7f8e300fe050 2024-02-21T23:13:39.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.592+0000 7f8e27e00640 1 --2- 172.21.15.99:0/3378135427 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f8e0c09ee80 0x7f8e0c0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:39.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.593+0000 7f8e27e00640 1 -- 172.21.15.99:0/3378135427 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 9047+0+0 (secure 0 0 0) 0x7f8e200c9600 con 0x7f8e300fe050 2024-02-21T23:13:39.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.593+0000 7f8e2f400640 1 --2- 172.21.15.99:0/3378135427 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f8e0c09ee80 0x7f8e0c0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:39.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.593+0000 7f8e2f400640 1 --2- 172.21.15.99:0/3378135427 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f8e0c09ee80 0x7f8e0c0a1340 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8e18036000 tx=0x7f8e18008030 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:39.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.596+0000 7f8e27e00640 1 -- 172.21.15.99:0/3378135427 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f8e20096e50 con 0x7f8e300fe050 2024-02-21T23:13:39.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:39.836+0000 7f8e37200640 1 -- 172.21.15.99:0/3378135427 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f8e3015d900 con 0x7f8e300fe050 2024-02-21T23:13:40.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:40.350+0000 7f8e27e00640 1 -- 172.21.15.99:0/3378135427 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8e2009aef0 con 0x7f8e300fe050 2024-02-21T23:13:40.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:40.354+0000 7f8e37200640 1 -- 172.21.15.99:0/3378135427 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f8e0c09ee80 msgr2=0x7f8e0c0a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:40.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:40.354+0000 7f8e37200640 1 --2- 172.21.15.99:0/3378135427 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f8e0c09ee80 0x7f8e0c0a1340 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8e18036000 tx=0x7f8e18008030 comp rx=0 tx=0).stop 2024-02-21T23:13:40.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:40.354+0000 7f8e37200640 1 -- 172.21.15.99:0/3378135427 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8e300fe050 msgr2=0x7f8e3017d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:40.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:40.354+0000 7f8e37200640 1 --2- 172.21.15.99:0/3378135427 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8e300fe050 0x7f8e3017d220 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f8e2000c8c0 tx=0x7f8e2000cd80 comp rx=0 tx=0).stop 2024-02-21T23:13:40.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:40.354+0000 7f8e37200640 1 -- 172.21.15.99:0/3378135427 shutdown_connections 2024-02-21T23:13:40.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:40.354+0000 7f8e37200640 1 --2- 172.21.15.99:0/3378135427 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f8e0c09ee80 0x7f8e0c0a1340 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:40.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:40.354+0000 7f8e37200640 1 --2- 172.21.15.99:0/3378135427 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e3018a5f0 0x7f8e30210e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:40.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:40.354+0000 7f8e37200640 1 --2- 172.21.15.99:0/3378135427 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f8e3015e0e0 0x7f8e3017c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:40.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:40.354+0000 7f8e37200640 1 --2- 172.21.15.99:0/3378135427 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f8e300fe050 0x7f8e3017d220 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:40.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:40.354+0000 7f8e37200640 1 -- 172.21.15.99:0/3378135427 >> 172.21.15.99:0/3378135427 conn(0x7f8e300d2cb0 msgr2=0x7f8e301805a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:40.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:40.354+0000 7f8e37200640 1 -- 172.21.15.99:0/3378135427 shutdown_connections 2024-02-21T23:13:40.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:40.354+0000 7f8e37200640 1 -- 172.21.15.99:0/3378135427 wait complete. 2024-02-21T23:13:40.367 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-02-21T23:13:40.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:40.590+0000 7f951b800640 1 Processor -- start 2024-02-21T23:13:40.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:40.591+0000 7f951b800640 1 -- start start 2024-02-21T23:13:40.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:40.593+0000 7f951b800640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f95141899a0 0x7f95140f8010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:40.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:40.593+0000 7f951b800640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95140f91d0 con 0x7f9514188eb0 2024-02-21T23:13:40.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:40.593+0000 7f951b800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95140f8ef0 con 0x7f95140f8550 2024-02-21T23:13:40.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:40.593+0000 7f951b800640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95141868d0 con 0x7f95141899a0 2024-02-21T23:13:40.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:40.593+0000 7f9518e00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7f9514188eb0 0x7f9514189290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:50352/0 (socket says 172.21.15.99:50352) 2024-02-21T23:13:40.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:40.593+0000 7f9518e00640 1 -- 172.21.15.99:0/714548425 learned_addr learned my addr 172.21.15.99:0/714548425 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:13:40.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:40.593+0000 7f9513e00640 1 --2- 172.21.15.99:0/714548425 >> v2:172.21.15.162:3300/0 conn(0x7f95141899a0 0x7f95140f8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:40.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:40.594+0000 7f9513400640 1 -- 172.21.15.99:0/714548425 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4042768809 0 0) 0x7f95140f91d0 con 0x7f9514188eb0 2024-02-21T23:13:40.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:40.594+0000 7f9513400640 1 -- 172.21.15.99:0/714548425 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94f8005730 con 0x7f9514188eb0 2024-02-21T23:13:40.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:40.594+0000 7f9513400640 1 -- 172.21.15.99:0/714548425 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3304483057 0 0) 0x7f95140f8ef0 con 0x7f95140f8550 2024-02-21T23:13:40.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:40.594+0000 7f9513400640 1 -- 172.21.15.99:0/714548425 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95140f91d0 con 0x7f95140f8550 2024-02-21T23:13:40.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:40.594+0000 7f9513e00640 1 -- 172.21.15.99:0/714548425 >> v1:172.21.15.162:6789/0 conn(0x7f95140f8550 legacy=0x7f9514184700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:40.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:40.594+0000 7f9513e00640 1 -- 172.21.15.99:0/714548425 >> v1:172.21.15.99:6789/0 conn(0x7f9514188eb0 legacy=0x7f9514189290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:40.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:40.594+0000 7f9513e00640 1 -- 172.21.15.99:0/714548425 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9514183940 con 0x7f95141899a0 2024-02-21T23:13:40.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:40.595+0000 7f9513e00640 1 --2- 172.21.15.99:0/714548425 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f95141899a0 0x7f95140f8010 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f94fc0097a0 tx=0x7f94fc02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b229f746f9c08d8 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:40.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:40.595+0000 7f9513400640 1 -- 172.21.15.99:0/714548425 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94fc035020 con 0x7f95141899a0 2024-02-21T23:13:40.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:40.595+0000 7f9513400640 1 -- 172.21.15.99:0/714548425 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f94fc031830 con 0x7f95141899a0 2024-02-21T23:13:40.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:40.595+0000 7f9513400640 1 -- 172.21.15.99:0/714548425 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94fc031c20 con 0x7f95141899a0 2024-02-21T23:13:40.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:40.596+0000 7f951b800640 1 -- 172.21.15.99:0/714548425 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f95141899a0 msgr2=0x7f95140f8010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:40.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:40.596+0000 7f951b800640 1 --2- 172.21.15.99:0/714548425 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f95141899a0 0x7f95140f8010 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f94fc0097a0 tx=0x7f94fc02b8d0 comp rx=0 tx=0).stop 2024-02-21T23:13:40.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:40.596+0000 7f951b800640 1 -- 172.21.15.99:0/714548425 shutdown_connections 2024-02-21T23:13:40.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:40.596+0000 7f951b800640 1 --2- 172.21.15.99:0/714548425 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f95141899a0 0x7f95140f8010 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:40.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:40.596+0000 7f951b800640 1 -- 172.21.15.99:0/714548425 >> 172.21.15.99:0/714548425 conn(0x7f95140ce5e0 msgr2=0x7f95140ce9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:40.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:40.596+0000 7f951b800640 1 -- 172.21.15.99:0/714548425 shutdown_connections 2024-02-21T23:13:40.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:40.596+0000 7f951b800640 1 -- 172.21.15.99:0/714548425 wait complete. 2024-02-21T23:13:40.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:40.599+0000 7f951b800640 1 Processor -- start 2024-02-21T23:13:40.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:40.599+0000 7f951b800640 1 -- start start 2024-02-21T23:13:40.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:40.600+0000 7f951b800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f95140f8550 0x7f9514178ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:40.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:40.600+0000 7f951b800640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9514188eb0 0x7f95141705e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:40.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:40.600+0000 7f951b800640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f95141899a0 0x7f95140caa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:40.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:40.600+0000 7f951b800640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95141833e0 con 0x7f9514188eb0 2024-02-21T23:13:40.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:40.600+0000 7f951b800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9514183f00 con 0x7f95140f8550 2024-02-21T23:13:40.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:40.600+0000 7f951b800640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9514183560 con 0x7f95141899a0 2024-02-21T23:13:40.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:40.601+0000 7f9513e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9514188eb0 0x7f95141705e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:40.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:40.601+0000 7f9518e00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f95140f8550 0x7f9514178ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:40.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:40.601+0000 7f9513e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9514188eb0 0x7f95141705e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:38414/0 (socket says 172.21.15.99:38414) 2024-02-21T23:13:40.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:40.601+0000 7f9513e00640 1 -- 172.21.15.99:0/253514579 learned_addr learned my addr 172.21.15.99:0/253514579 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:13:40.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:40.601+0000 7f9519800640 1 --2- 172.21.15.99:0/253514579 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f95141899a0 0x7f95140caa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:40.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:40.601+0000 7f9513e00640 1 -- 172.21.15.99:0/253514579 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f95141899a0 msgr2=0x7f95140caa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:40.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:40.601+0000 7f9513e00640 1 --2- 172.21.15.99:0/253514579 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f95141899a0 0x7f95140caa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:40.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:40.601+0000 7f9513e00640 1 -- 172.21.15.99:0/253514579 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f95140f8550 msgr2=0x7f9514178ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:40.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:40.601+0000 7f9513e00640 1 --2- 172.21.15.99:0/253514579 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f95140f8550 0x7f9514178ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:40.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:40.601+0000 7f9513e00640 1 -- 172.21.15.99:0/253514579 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9514172c10 con 0x7f9514188eb0 2024-02-21T23:13:40.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:40.601+0000 7f9518e00640 1 --2- 172.21.15.99:0/253514579 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f95140f8550 0x7f9514178ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-21T23:13:40.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:40.602+0000 7f9513e00640 1 --2- 172.21.15.99:0/253514579 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9514188eb0 0x7f95141705e0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f94fc000c00 tx=0x7f94fc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:40.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:40.602+0000 7f9510c00640 1 -- 172.21.15.99:0/253514579 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94fc040070 con 0x7f9514188eb0 2024-02-21T23:13:40.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:40.602+0000 7f9510c00640 1 -- 172.21.15.99:0/253514579 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f94fc0398e0 con 0x7f9514188eb0 2024-02-21T23:13:40.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:40.602+0000 7f9510c00640 1 -- 172.21.15.99:0/253514579 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94fc035040 con 0x7f9514188eb0 2024-02-21T23:13:40.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:40.602+0000 7f951b800640 1 -- 172.21.15.99:0/253514579 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9514172650 con 0x7f9514188eb0 2024-02-21T23:13:40.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:40.602+0000 7f951b800640 1 -- 172.21.15.99:0/253514579 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95140c9f80 con 0x7f9514188eb0 2024-02-21T23:13:40.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:40.603+0000 7f951b800640 1 -- 172.21.15.99:0/253514579 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95140f8ef0 con 0x7f9514188eb0 2024-02-21T23:13:40.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:40.605+0000 7f9510c00640 1 -- 172.21.15.99:0/253514579 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7f94fc038020 con 0x7f9514188eb0 2024-02-21T23:13:40.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:40.606+0000 7f9510c00640 1 --2- 172.21.15.99:0/253514579 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f94f009eed0 0x7f94f00a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:40.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:40.607+0000 7f9510c00640 1 -- 172.21.15.99:0/253514579 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 9047+0+0 (secure 0 0 0) 0x7f94fc0eb8c0 con 0x7f9514188eb0 2024-02-21T23:13:40.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:40.607+0000 7f9518e00640 1 --2- 172.21.15.99:0/253514579 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f94f009eed0 0x7f94f00a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:40.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:40.607+0000 7f9518e00640 1 --2- 172.21.15.99:0/253514579 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f94f009eed0 0x7f94f00a1390 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f95040012e0 tx=0x7f9504009040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:40.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:40.610+0000 7f9510c00640 1 -- 172.21.15.99:0/253514579 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7f95140f8ef0 con 0x7f9514188eb0 2024-02-21T23:13:40.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:40.806+0000 7f951b800640 1 -- 172.21.15.99:0/253514579 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f95140683c0 con 0x7f9514188eb0 2024-02-21T23:13:41.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:41.462+0000 7f9510c00640 1 -- 172.21.15.99:0/253514579 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v44) v1 ==== 181+0+0 (secure 0 0 0) 0x7f94fc0b9760 con 0x7f9514188eb0 2024-02-21T23:13:41.450 INFO:teuthology.orchestra.run.smithi099.stderr:pool 'cephfs_metadata' removed 2024-02-21T23:13:41.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:41.466+0000 7f951b800640 1 -- 172.21.15.99:0/253514579 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f94f009eed0 msgr2=0x7f94f00a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:41.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:41.466+0000 7f951b800640 1 --2- 172.21.15.99:0/253514579 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f94f009eed0 0x7f94f00a1390 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f95040012e0 tx=0x7f9504009040 comp rx=0 tx=0).stop 2024-02-21T23:13:41.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:41.466+0000 7f951b800640 1 -- 172.21.15.99:0/253514579 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9514188eb0 msgr2=0x7f95141705e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:41.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:41.466+0000 7f951b800640 1 --2- 172.21.15.99:0/253514579 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9514188eb0 0x7f95141705e0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f94fc000c00 tx=0x7f94fc0046c0 comp rx=0 tx=0).stop 2024-02-21T23:13:41.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:41.466+0000 7f951b800640 1 -- 172.21.15.99:0/253514579 shutdown_connections 2024-02-21T23:13:41.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:41.466+0000 7f951b800640 1 --2- 172.21.15.99:0/253514579 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7f94f009eed0 0x7f94f00a1390 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:41.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:41.466+0000 7f951b800640 1 --2- 172.21.15.99:0/253514579 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7f95141899a0 0x7f95140caa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:41.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:41.466+0000 7f951b800640 1 --2- 172.21.15.99:0/253514579 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7f9514188eb0 0x7f95141705e0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:41.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:41.466+0000 7f951b800640 1 --2- 172.21.15.99:0/253514579 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f95140f8550 0x7f9514178ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:41.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:41.466+0000 7f951b800640 1 -- 172.21.15.99:0/253514579 >> 172.21.15.99:0/253514579 conn(0x7f95140ce5e0 msgr2=0x7f9514189290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:41.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:41.467+0000 7f951b800640 1 -- 172.21.15.99:0/253514579 shutdown_connections 2024-02-21T23:13:41.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:41.467+0000 7f951b800640 1 -- 172.21.15.99:0/253514579 wait complete. 2024-02-21T23:13:41.479 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-02-21T23:13:41.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:41.698+0000 7ffa80a00640 1 Processor -- start 2024-02-21T23:13:41.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:41.698+0000 7ffa80a00640 1 -- start start 2024-02-21T23:13:41.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:41.700+0000 7ffa80a00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ffa7c187100 0x7ffa7c0f5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:41.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:41.700+0000 7ffa80a00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa7c071e70 con 0x7ffa7c0708e0 2024-02-21T23:13:41.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:41.700+0000 7ffa80a00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa7c071b90 con 0x7ffa7c18dde0 2024-02-21T23:13:41.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:41.700+0000 7ffa80a00640 1 -- --> v2:172.21.15.99:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa7c06e980 con 0x7ffa7c187100 2024-02-21T23:13:41.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:41.700+0000 7ffa79e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ffa7c187100 0x7ffa7c0f5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:41.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:41.700+0000 7ffa79e00640 1 --2- >> v2:172.21.15.99:3300/0 conn(0x7ffa7c187100 0x7ffa7c0f5ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:38426/0 (socket says 172.21.15.99:38426) 2024-02-21T23:13:41.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:41.700+0000 7ffa79e00640 1 -- 172.21.15.99:0/1260574406 learned_addr learned my addr 172.21.15.99:0/1260574406 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:13:41.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:41.700+0000 7ffa7a800640 1 --1- 172.21.15.99:0/1260574406 >> v1:172.21.15.99:6789/0 conn(0x7ffa7c0708e0 0x7ffa7c070d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:50362/0 (socket says 172.21.15.99:50362) 2024-02-21T23:13:41.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:41.701+0000 7ffa79e00640 1 -- 172.21.15.99:0/1260574406 >> v1:172.21.15.162:6789/0 conn(0x7ffa7c18dde0 legacy=0x7ffa7c0f6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:41.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:41.701+0000 7ffa79e00640 1 -- 172.21.15.99:0/1260574406 >> v1:172.21.15.99:6789/0 conn(0x7ffa7c0708e0 legacy=0x7ffa7c070d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:41.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:41.701+0000 7ffa79e00640 1 -- 172.21.15.99:0/1260574406 --> v2:172.21.15.99:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa7c0f5100 con 0x7ffa7c187100 2024-02-21T23:13:41.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:41.702+0000 7ffa79e00640 1 --2- 172.21.15.99:0/1260574406 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa7c187100 0x7ffa7c0f5ec0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c009870 tx=0x7ffa6c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eb918f2594717d4 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:41.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:41.702+0000 7ffa79400640 1 -- 172.21.15.99:0/1260574406 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa6c035020 con 0x7ffa7c187100 2024-02-21T23:13:41.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:41.702+0000 7ffa79400640 1 -- 172.21.15.99:0/1260574406 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ffa6c031870 con 0x7ffa7c187100 2024-02-21T23:13:41.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:41.702+0000 7ffa79400640 1 -- 172.21.15.99:0/1260574406 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa6c031c60 con 0x7ffa7c187100 2024-02-21T23:13:41.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:41.703+0000 7ffa80a00640 1 -- 172.21.15.99:0/1260574406 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa7c187100 msgr2=0x7ffa7c0f5ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:41.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:41.703+0000 7ffa80a00640 1 --2- 172.21.15.99:0/1260574406 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa7c187100 0x7ffa7c0f5ec0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c009870 tx=0x7ffa6c02b910 comp rx=0 tx=0).stop 2024-02-21T23:13:41.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:41.703+0000 7ffa80a00640 1 -- 172.21.15.99:0/1260574406 shutdown_connections 2024-02-21T23:13:41.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:41.703+0000 7ffa80a00640 1 --2- 172.21.15.99:0/1260574406 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa7c187100 0x7ffa7c0f5ec0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:41.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:41.703+0000 7ffa80a00640 1 -- 172.21.15.99:0/1260574406 >> 172.21.15.99:0/1260574406 conn(0x7ffa7c0ce5e0 msgr2=0x7ffa7c0ce9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:41.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:41.703+0000 7ffa80a00640 1 -- 172.21.15.99:0/1260574406 shutdown_connections 2024-02-21T23:13:41.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:41.703+0000 7ffa80a00640 1 -- 172.21.15.99:0/1260574406 wait complete. 2024-02-21T23:13:41.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:41.705+0000 7ffa80a00640 1 Processor -- start 2024-02-21T23:13:41.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:41.705+0000 7ffa80a00640 1 -- start start 2024-02-21T23:13:41.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:41.706+0000 7ffa80a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa7c0708e0 0x7ffa7c2245c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:41.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:41.707+0000 7ffa80a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa7c187100 0x7ffa7c06bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:41.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:41.707+0000 7ffa80a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffa7c18dde0 0x7ffa7c167b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:41.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:41.707+0000 7ffa80a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7c0f56c0 con 0x7ffa7c187100 2024-02-21T23:13:41.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:41.707+0000 7ffa80a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7c0f5a30 con 0x7ffa7c0708e0 2024-02-21T23:13:41.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:41.707+0000 7ffa80a00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7c1874e0 con 0x7ffa7c18dde0 2024-02-21T23:13:41.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:41.707+0000 7ffa73e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa7c187100 0x7ffa7c06bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:41.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:41.707+0000 7ffa73e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa7c187100 0x7ffa7c06bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:38442/0 (socket says 172.21.15.99:38442) 2024-02-21T23:13:41.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:41.707+0000 7ffa73e00640 1 -- 172.21.15.99:0/4143841709 learned_addr learned my addr 172.21.15.99:0/4143841709 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:13:41.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:41.707+0000 7ffa79e00640 1 --2- 172.21.15.99:0/4143841709 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa7c0708e0 0x7ffa7c2245c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:41.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:41.707+0000 7ffa7a800640 1 --2- 172.21.15.99:0/4143841709 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffa7c18dde0 0x7ffa7c167b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:41.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:41.707+0000 7ffa73e00640 1 -- 172.21.15.99:0/4143841709 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffa7c18dde0 msgr2=0x7ffa7c167b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:41.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:41.707+0000 7ffa73e00640 1 --2- 172.21.15.99:0/4143841709 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffa7c18dde0 0x7ffa7c167b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:41.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:41.707+0000 7ffa73e00640 1 -- 172.21.15.99:0/4143841709 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa7c0708e0 msgr2=0x7ffa7c2245c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:41.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:41.707+0000 7ffa73e00640 1 --2- 172.21.15.99:0/4143841709 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa7c0708e0 0x7ffa7c2245c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:41.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:41.707+0000 7ffa73e00640 1 -- 172.21.15.99:0/4143841709 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa7c224b00 con 0x7ffa7c187100 2024-02-21T23:13:41.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:41.708+0000 7ffa73e00640 1 --2- 172.21.15.99:0/4143841709 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa7c187100 0x7ffa7c06bd10 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7ffa6400c440 tx=0x7ffa6400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:41.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:41.708+0000 7ffa72000640 1 -- 172.21.15.99:0/4143841709 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa640052d0 con 0x7ffa7c187100 2024-02-21T23:13:41.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:41.708+0000 7ffa72000640 1 -- 172.21.15.99:0/4143841709 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ffa64005470 con 0x7ffa7c187100 2024-02-21T23:13:41.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:41.708+0000 7ffa72000640 1 -- 172.21.15.99:0/4143841709 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa64007280 con 0x7ffa7c187100 2024-02-21T23:13:41.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:41.708+0000 7ffa80a00640 1 -- 172.21.15.99:0/4143841709 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa7c06c250 con 0x7ffa7c187100 2024-02-21T23:13:41.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:41.708+0000 7ffa80a00640 1 -- 172.21.15.99:0/4143841709 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa7c174830 con 0x7ffa7c187100 2024-02-21T23:13:41.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:41.709+0000 7ffa80a00640 1 -- 172.21.15.99:0/4143841709 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa7c0683c0 con 0x7ffa7c187100 2024-02-21T23:13:41.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:41.711+0000 7ffa72000640 1 -- 172.21.15.99:0/4143841709 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7ffa64007420 con 0x7ffa7c187100 2024-02-21T23:13:41.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:41.712+0000 7ffa72000640 1 --2- 172.21.15.99:0/4143841709 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7ffa5809eed0 0x7ffa580a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:41.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:41.713+0000 7ffa72000640 1 -- 172.21.15.99:0/4143841709 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 8609+0+0 (secure 0 0 0) 0x7ffa640c9280 con 0x7ffa7c187100 2024-02-21T23:13:41.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:41.713+0000 7ffa79e00640 1 --2- 172.21.15.99:0/4143841709 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7ffa5809eed0 0x7ffa580a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:41.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:41.714+0000 7ffa79e00640 1 --2- 172.21.15.99:0/4143841709 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7ffa5809eed0 0x7ffa580a1390 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c036000 tx=0x7ffa6c03c040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:41.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:41.716+0000 7ffa72000640 1 -- 172.21.15.99:0/4143841709 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7ffa640972d0 con 0x7ffa7c187100 2024-02-21T23:13:41.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:41.914+0000 7ffa80a00640 1 -- 172.21.15.99:0/4143841709 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ffa7c0d2a90 con 0x7ffa7c187100 2024-02-21T23:13:42.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.474+0000 7ffa72000640 1 -- 172.21.15.99:0/4143841709 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v45) v1 ==== 169+0+0 (secure 0 0 0) 0x7ffa64096bd0 con 0x7ffa7c187100 2024-02-21T23:13:42.462 INFO:teuthology.orchestra.run.smithi099.stderr:pool 'cephfs_data' removed 2024-02-21T23:13:42.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.479+0000 7ffa80a00640 1 -- 172.21.15.99:0/4143841709 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7ffa5809eed0 msgr2=0x7ffa580a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:42.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.479+0000 7ffa80a00640 1 --2- 172.21.15.99:0/4143841709 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7ffa5809eed0 0x7ffa580a1390 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c036000 tx=0x7ffa6c03c040 comp rx=0 tx=0).stop 2024-02-21T23:13:42.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.479+0000 7ffa80a00640 1 -- 172.21.15.99:0/4143841709 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa7c187100 msgr2=0x7ffa7c06bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:42.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.479+0000 7ffa80a00640 1 --2- 172.21.15.99:0/4143841709 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa7c187100 0x7ffa7c06bd10 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7ffa6400c440 tx=0x7ffa6400c900 comp rx=0 tx=0).stop 2024-02-21T23:13:42.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.481+0000 7ffa80a00640 1 -- 172.21.15.99:0/4143841709 shutdown_connections 2024-02-21T23:13:42.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.481+0000 7ffa80a00640 1 --2- 172.21.15.99:0/4143841709 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7ffa5809eed0 0x7ffa580a1390 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:42.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.481+0000 7ffa80a00640 1 --2- 172.21.15.99:0/4143841709 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7ffa7c18dde0 0x7ffa7c167b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:42.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.481+0000 7ffa80a00640 1 --2- 172.21.15.99:0/4143841709 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7ffa7c187100 0x7ffa7c06bd10 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:42.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.481+0000 7ffa80a00640 1 --2- 172.21.15.99:0/4143841709 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa7c0708e0 0x7ffa7c2245c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:42.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.481+0000 7ffa80a00640 1 -- 172.21.15.99:0/4143841709 >> 172.21.15.99:0/4143841709 conn(0x7ffa7c0ce5e0 msgr2=0x7ffa7c176480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:42.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.481+0000 7ffa80a00640 1 -- 172.21.15.99:0/4143841709 shutdown_connections 2024-02-21T23:13:42.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.482+0000 7ffa80a00640 1 -- 172.21.15.99:0/4143841709 wait complete. 2024-02-21T23:13:42.492 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-02-21T23:13:42.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.708+0000 7fe980a00640 1 Processor -- start 2024-02-21T23:13:42.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.708+0000 7fe980a00640 1 -- start start 2024-02-21T23:13:42.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.710+0000 7fe980a00640 1 -- --> v1:172.21.15.99:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe97c070460 con 0x7fe97c17d640 2024-02-21T23:13:42.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.710+0000 7fe980a00640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe97c06f0e0 con 0x7fe97c0732d0 2024-02-21T23:13:42.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.710+0000 7fe980a00640 1 -- --> v1:172.21.15.181:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe97c06f3c0 con 0x7fe97c185090 2024-02-21T23:13:42.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.710+0000 7fe979e00640 1 --1- >> v1:172.21.15.99:6789/0 conn(0x7fe97c17d640 0x7fe97c184980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.99:6789/0 says I am v1:172.21.15.99:50372/0 (socket says 172.21.15.99:50372) 2024-02-21T23:13:42.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.710+0000 7fe979e00640 1 -- 172.21.15.99:0/4000796180 learned_addr learned my addr 172.21.15.99:0/4000796180 (peer_addr_for_me v1:172.21.15.99:0/0) 2024-02-21T23:13:42.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.710+0000 7fe979400640 1 -- 172.21.15.99:0/4000796180 <== mon.0 v1:172.21.15.99:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2938526061 0 0) 0x7fe97c070460 con 0x7fe97c17d640 2024-02-21T23:13:42.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.710+0000 7fe979400640 1 -- 172.21.15.99:0/4000796180 --> v1:172.21.15.99:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe960003520 con 0x7fe97c17d640 2024-02-21T23:13:42.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.711+0000 7fe979400640 1 -- 172.21.15.99:0/4000796180 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2259081985 0 0) 0x7fe97c06f0e0 con 0x7fe97c0732d0 2024-02-21T23:13:42.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.711+0000 7fe979400640 1 -- 172.21.15.99:0/4000796180 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe97c070460 con 0x7fe97c0732d0 2024-02-21T23:13:42.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.711+0000 7fe979400640 1 -- 172.21.15.99:0/4000796180 <== mon.2 v1:172.21.15.181:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2495373131 0 0) 0x7fe97c06f3c0 con 0x7fe97c185090 2024-02-21T23:13:42.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.711+0000 7fe979400640 1 -- 172.21.15.99:0/4000796180 --> v1:172.21.15.181:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe97c06f0e0 con 0x7fe97c185090 2024-02-21T23:13:42.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.711+0000 7fe979400640 1 -- 172.21.15.99:0/4000796180 <== mon.0 v1:172.21.15.99:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2226861205 0 0) 0x7fe960003520 con 0x7fe97c17d640 2024-02-21T23:13:42.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.711+0000 7fe979400640 1 -- 172.21.15.99:0/4000796180 >> v1:172.21.15.181:6789/0 conn(0x7fe97c185090 legacy=0x7fe97c187120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:42.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.711+0000 7fe979400640 1 -- 172.21.15.99:0/4000796180 >> v1:172.21.15.162:6789/0 conn(0x7fe97c0732d0 legacy=0x7fe97c186a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:42.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.711+0000 7fe979400640 1 -- 172.21.15.99:0/4000796180 --> v1:172.21.15.99:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe97c06f6a0 con 0x7fe97c17d640 2024-02-21T23:13:42.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.711+0000 7fe979400640 1 -- 172.21.15.99:0/4000796180 <== mon.0 v1:172.21.15.99:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2069890144 0 0) 0x7fe96c001670 con 0x7fe97c17d640 2024-02-21T23:13:42.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.711+0000 7fe979400640 1 -- 172.21.15.99:0/4000796180 >> v1:172.21.15.99:6789/0 conn(0x7fe97c17d640 legacy=0x7fe97c184980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:42.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.711+0000 7fe979400640 1 --2- 172.21.15.99:0/4000796180 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe960003d50 0x7fe960004130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:42.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.711+0000 7fe979400640 1 --2- 172.21.15.99:0/4000796180 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe960004800 0x7fe960004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:42.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.711+0000 7fe979400640 1 --2- 172.21.15.99:0/4000796180 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe960005340 0x7fe96000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:42.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.711+0000 7fe979400640 1 -- 172.21.15.99:0/4000796180 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe96000c250 con 0x7fe960004800 2024-02-21T23:13:42.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.711+0000 7fe979400640 1 -- 172.21.15.99:0/4000796180 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe96000c400 con 0x7fe960003d50 2024-02-21T23:13:42.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.711+0000 7fe979400640 1 -- 172.21.15.99:0/4000796180 --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe96000c600 con 0x7fe960005340 2024-02-21T23:13:42.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.711+0000 7fe979e00640 1 --2- 172.21.15.99:0/4000796180 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe960003d50 0x7fe960004130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:42.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.711+0000 7fe971400640 1 --2- 172.21.15.99:0/4000796180 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe960004800 0x7fe960004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:42.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.711+0000 7fe97a800640 1 --2- 172.21.15.99:0/4000796180 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe960005340 0x7fe96000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:42.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.712+0000 7fe979e00640 1 -- 172.21.15.99:0/4000796180 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe960005340 msgr2=0x7fe96000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:13:42.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.712+0000 7fe979e00640 1 --2- 172.21.15.99:0/4000796180 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe960005340 0x7fe96000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:42.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.712+0000 7fe979e00640 1 -- 172.21.15.99:0/4000796180 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe960004800 msgr2=0x7fe960004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-02-21T23:13:42.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.712+0000 7fe979e00640 1 --2- 172.21.15.99:0/4000796180 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe960004800 0x7fe960004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:42.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.712+0000 7fe979e00640 1 -- 172.21.15.99:0/4000796180 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe960003520 con 0x7fe960003d50 2024-02-21T23:13:42.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.712+0000 7fe97a800640 1 -- 172.21.15.99:0/4000796180 reap_dead start 2024-02-21T23:13:42.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.713+0000 7fe979e00640 1 --2- 172.21.15.99:0/4000796180 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe960003d50 0x7fe960004130 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fe96c00c1c0 tx=0x7fe960005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dbe64bb8e9550087 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:42.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.713+0000 7fe979400640 1 -- 172.21.15.99:0/4000796180 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96c007cc0 con 0x7fe960003d50 2024-02-21T23:13:42.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.713+0000 7fe979400640 1 -- 172.21.15.99:0/4000796180 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fe96c030070 con 0x7fe960003d50 2024-02-21T23:13:42.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.713+0000 7fe979400640 1 -- 172.21.15.99:0/4000796180 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96c005d70 con 0x7fe960003d50 2024-02-21T23:13:42.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.713+0000 7fe980a00640 1 -- 172.21.15.99:0/4000796180 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe960003d50 msgr2=0x7fe960004130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:42.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.713+0000 7fe980a00640 1 --2- 172.21.15.99:0/4000796180 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe960003d50 0x7fe960004130 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fe96c00c1c0 tx=0x7fe960005830 comp rx=0 tx=0).stop 2024-02-21T23:13:42.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.714+0000 7fe980a00640 1 -- 172.21.15.99:0/4000796180 shutdown_connections 2024-02-21T23:13:42.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.714+0000 7fe980a00640 1 --2- 172.21.15.99:0/4000796180 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe960003d50 0x7fe960004130 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:42.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.714+0000 7fe980a00640 1 -- 172.21.15.99:0/4000796180 >> 172.21.15.99:0/4000796180 conn(0x7fe97c0ce5e0 msgr2=0x7fe97c0ce9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:42.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.714+0000 7fe980a00640 1 -- 172.21.15.99:0/4000796180 shutdown_connections 2024-02-21T23:13:42.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.714+0000 7fe980a00640 1 -- 172.21.15.99:0/4000796180 wait complete. 2024-02-21T23:13:42.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.716+0000 7fe980a00640 1 Processor -- start 2024-02-21T23:13:42.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.716+0000 7fe980a00640 1 -- start start 2024-02-21T23:13:42.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.717+0000 7fe980a00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe960003d50 0x7fe97c0708e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:42.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.717+0000 7fe980a00640 1 --2- >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe97c070e20 0x7fe97c21be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:42.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.717+0000 7fe980a00640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe97c21c380 0x7fe97c169060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:42.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.717+0000 7fe980a00640 1 -- --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe97c06fc60 con 0x7fe960003d50 2024-02-21T23:13:42.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.717+0000 7fe980a00640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe97c06ffd0 con 0x7fe97c21c380 2024-02-21T23:13:42.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.717+0000 7fe980a00640 1 -- --> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe97c06e980 con 0x7fe97c070e20 2024-02-21T23:13:42.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.717+0000 7fe979e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe960003d50 0x7fe97c0708e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:42.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.717+0000 7fe979e00640 1 --2- >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe960003d50 0x7fe97c0708e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.99:3300/0 says I am v2:172.21.15.99:38454/0 (socket says 172.21.15.99:38454) 2024-02-21T23:13:42.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.717+0000 7fe979e00640 1 -- 172.21.15.99:0/1150778509 learned_addr learned my addr 172.21.15.99:0/1150778509 (peer_addr_for_me v2:172.21.15.99:0/0) 2024-02-21T23:13:42.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.718+0000 7fe971400640 1 --2- 172.21.15.99:0/1150778509 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe97c070e20 0x7fe97c21be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:42.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.718+0000 7fe97a800640 1 --2- 172.21.15.99:0/1150778509 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe97c21c380 0x7fe97c169060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:42.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.718+0000 7fe979e00640 1 -- 172.21.15.99:0/1150778509 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe97c070e20 msgr2=0x7fe97c21be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:42.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.718+0000 7fe979e00640 1 --2- 172.21.15.99:0/1150778509 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe97c070e20 0x7fe97c21be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:42.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.718+0000 7fe979e00640 1 -- 172.21.15.99:0/1150778509 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe97c21c380 msgr2=0x7fe97c169060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:42.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.718+0000 7fe979e00640 1 --2- 172.21.15.99:0/1150778509 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe97c21c380 0x7fe97c169060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:42.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.718+0000 7fe979e00640 1 -- 172.21.15.99:0/1150778509 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe97c172380 con 0x7fe960003d50 2024-02-21T23:13:42.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.718+0000 7fe97a800640 1 --2- 172.21.15.99:0/1150778509 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe97c21c380 0x7fe97c169060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-21T23:13:42.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.718+0000 7fe979e00640 1 --2- 172.21.15.99:0/1150778509 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe960003d50 0x7fe97c0708e0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fe96c00c2b0 tx=0x7fe96c001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:42.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.718+0000 7fe972a00640 1 -- 172.21.15.99:0/1150778509 <== mon.0 v2:172.21.15.99:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96c0049e0 con 0x7fe960003d50 2024-02-21T23:13:42.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.718+0000 7fe972a00640 1 -- 172.21.15.99:0/1150778509 <== mon.0 v2:172.21.15.99:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fe96c004b80 con 0x7fe960003d50 2024-02-21T23:13:42.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.718+0000 7fe972a00640 1 -- 172.21.15.99:0/1150778509 <== mon.0 v2:172.21.15.99:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96c007070 con 0x7fe960003d50 2024-02-21T23:13:42.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.718+0000 7fe980a00640 1 -- 172.21.15.99:0/1150778509 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe97c172640 con 0x7fe960003d50 2024-02-21T23:13:42.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.719+0000 7fe980a00640 1 -- 172.21.15.99:0/1150778509 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe97c172c00 con 0x7fe960003d50 2024-02-21T23:13:42.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.720+0000 7fe980a00640 1 -- 172.21.15.99:0/1150778509 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe97c0683c0 con 0x7fe960003d50 2024-02-21T23:13:42.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.722+0000 7fe972a00640 1 -- 172.21.15.99:0/1150778509 <== mon.0 v2:172.21.15.99:3300/0 4 ==== mgrmap(e 14) v1 ==== 134487+0+0 (secure 0 0 0) 0x7fe96c048020 con 0x7fe960003d50 2024-02-21T23:13:42.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.723+0000 7fe972a00640 1 --2- 172.21.15.99:0/1150778509 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fe95809ef00 0x7fe9580a13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-21T23:13:42.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.723+0000 7fe972a00640 1 -- 172.21.15.99:0/1150778509 <== mon.0 v2:172.21.15.99:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 8195+0+0 (secure 0 0 0) 0x7fe96c0eb770 con 0x7fe960003d50 2024-02-21T23:13:42.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.723+0000 7fe971400640 1 --2- 172.21.15.99:0/1150778509 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fe95809ef00 0x7fe9580a13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-21T23:13:42.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.724+0000 7fe971400640 1 --2- 172.21.15.99:0/1150778509 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fe95809ef00 0x7fe9580a13c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe97c06e630 tx=0x7fe964009040 comp rx=0 tx=0).ready entity=mgr.5131 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-21T23:13:42.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.725+0000 7fe972a00640 1 -- 172.21.15.99:0/1150778509 <== mon.0 v2:172.21.15.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183725 (secure 0 0 0) 0x7fe96c04f020 con 0x7fe960003d50 2024-02-21T23:13:42.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:42.921+0000 7fe980a00640 1 -- 172.21.15.99:0/1150778509 --> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe97c176ce0 con 0x7fe960003d50 2024-02-21T23:13:43.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:43.488+0000 7fe972a00640 1 -- 172.21.15.99:0/1150778509 <== mon.0 v2:172.21.15.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v46) v1 ==== 178+0+0 (secure 0 0 0) 0x7fe96c0b99e0 con 0x7fe960003d50 2024-02-21T23:13:43.476 INFO:teuthology.orchestra.run.smithi099.stderr:pool 'cephfs_data_ec' removed 2024-02-21T23:13:43.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:43.493+0000 7fe980a00640 1 -- 172.21.15.99:0/1150778509 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fe95809ef00 msgr2=0x7fe9580a13c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:43.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:43.493+0000 7fe980a00640 1 --2- 172.21.15.99:0/1150778509 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fe95809ef00 0x7fe9580a13c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe97c06e630 tx=0x7fe964009040 comp rx=0 tx=0).stop 2024-02-21T23:13:43.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:43.493+0000 7fe980a00640 1 -- 172.21.15.99:0/1150778509 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe960003d50 msgr2=0x7fe97c0708e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-21T23:13:43.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:43.493+0000 7fe980a00640 1 --2- 172.21.15.99:0/1150778509 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe960003d50 0x7fe97c0708e0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fe96c00c2b0 tx=0x7fe96c001a30 comp rx=0 tx=0).stop 2024-02-21T23:13:43.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:43.494+0000 7fe980a00640 1 -- 172.21.15.99:0/1150778509 shutdown_connections 2024-02-21T23:13:43.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:43.494+0000 7fe980a00640 1 --2- 172.21.15.99:0/1150778509 >> [v2:172.21.15.162:6800/631076050,v1:172.21.15.162:6801/631076050] conn(0x7fe95809ef00 0x7fe9580a13c0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:43.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:43.494+0000 7fe980a00640 1 --2- 172.21.15.99:0/1150778509 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe97c21c380 0x7fe97c169060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:43.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:43.494+0000 7fe980a00640 1 --2- 172.21.15.99:0/1150778509 >> [v2:172.21.15.181:3300/0,v1:172.21.15.181:6789/0] conn(0x7fe97c070e20 0x7fe97c21be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:43.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:43.494+0000 7fe980a00640 1 --2- 172.21.15.99:0/1150778509 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fe960003d50 0x7fe97c0708e0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-21T23:13:43.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:43.494+0000 7fe980a00640 1 -- 172.21.15.99:0/1150778509 >> 172.21.15.99:0/1150778509 conn(0x7fe97c0ce5e0 msgr2=0x7fe97c1710f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-21T23:13:43.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:43.495+0000 7fe980a00640 1 -- 172.21.15.99:0/1150778509 shutdown_connections 2024-02-21T23:13:43.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-02-21T23:13:43.495+0000 7fe980a00640 1 -- 172.21.15.99:0/1150778509 wait complete. 2024-02-21T23:13:43.510 INFO:teuthology.misc:Shutting down mds daemons... 2024-02-21T23:13:43.511 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-02-21T23:13:43.511 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T23:13:43.530 INFO:tasks.ceph.mds.a:Stopped 2024-02-21T23:13:43.530 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-02-21T23:13:43.530 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T23:13:43.593 INFO:tasks.ceph.mds.d:Stopped 2024-02-21T23:13:43.593 DEBUG:tasks.ceph.mds.g:waiting for process to exit 2024-02-21T23:13:43.593 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T23:13:43.657 INFO:tasks.ceph.mds.g:Stopped 2024-02-21T23:13:43.657 DEBUG:tasks.ceph.mds.j:waiting for process to exit 2024-02-21T23:13:43.657 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T23:13:43.722 INFO:tasks.ceph.mds.j:Stopped 2024-02-21T23:13:43.722 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-02-21T23:13:43.722 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T23:13:43.733 INFO:tasks.ceph.mds.b:Stopped 2024-02-21T23:13:43.733 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-02-21T23:13:43.733 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T23:13:43.783 INFO:tasks.ceph.mds.e:Stopped 2024-02-21T23:13:43.784 DEBUG:tasks.ceph.mds.h:waiting for process to exit 2024-02-21T23:13:43.784 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T23:13:43.833 INFO:tasks.ceph.mds.h:Stopped 2024-02-21T23:13:43.834 DEBUG:tasks.ceph.mds.k:waiting for process to exit 2024-02-21T23:13:43.834 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T23:13:43.883 INFO:tasks.ceph.mds.k:Stopped 2024-02-21T23:13:43.884 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-02-21T23:13:43.884 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T23:13:43.893 INFO:tasks.ceph.mds.c:Stopped 2024-02-21T23:13:43.894 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2024-02-21T23:13:43.894 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T23:13:43.943 INFO:tasks.ceph.mds.f:Stopped 2024-02-21T23:13:43.943 DEBUG:tasks.ceph.mds.i:waiting for process to exit 2024-02-21T23:13:43.943 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T23:13:43.993 INFO:tasks.ceph.mds.i:Stopped 2024-02-21T23:13:43.994 DEBUG:tasks.ceph.mds.l:waiting for process to exit 2024-02-21T23:13:43.994 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T23:13:44.043 INFO:tasks.ceph.mds.l:Stopped 2024-02-21T23:13:44.043 INFO:teuthology.misc:Shutting down osd daemons... 2024-02-21T23:13:44.044 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-02-21T23:13:44.044 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T23:13:44.104 INFO:tasks.ceph.osd.0:Stopped 2024-02-21T23:13:44.105 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-02-21T23:13:44.105 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T23:13:44.162 INFO:tasks.ceph.osd.3:Stopped 2024-02-21T23:13:44.163 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-02-21T23:13:44.163 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T23:13:44.233 INFO:tasks.ceph.osd.6:Stopped 2024-02-21T23:13:44.233 DEBUG:tasks.ceph.osd.9:waiting for process to exit 2024-02-21T23:13:44.234 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T23:13:44.324 INFO:tasks.ceph.osd.9:Stopped 2024-02-21T23:13:44.324 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-02-21T23:13:44.324 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T23:13:44.358 INFO:tasks.ceph.osd.1:Stopped 2024-02-21T23:13:44.359 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-02-21T23:13:44.359 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T23:13:44.435 INFO:tasks.ceph.osd.4:Stopped 2024-02-21T23:13:44.435 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-02-21T23:13:44.435 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T23:13:44.510 INFO:tasks.ceph.osd.7:Stopped 2024-02-21T23:13:44.511 DEBUG:tasks.ceph.osd.10:waiting for process to exit 2024-02-21T23:13:44.511 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T23:13:44.581 INFO:tasks.ceph.osd.10:Stopped 2024-02-21T23:13:44.581 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-02-21T23:13:44.582 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T23:13:44.617 INFO:tasks.ceph.osd.2:Stopped 2024-02-21T23:13:44.618 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-02-21T23:13:44.618 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T23:13:44.689 INFO:tasks.ceph.osd.5:Stopped 2024-02-21T23:13:44.690 DEBUG:tasks.ceph.osd.8:waiting for process to exit 2024-02-21T23:13:44.690 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T23:13:44.759 INFO:tasks.ceph.osd.8:Stopped 2024-02-21T23:13:44.759 DEBUG:tasks.ceph.osd.11:waiting for process to exit 2024-02-21T23:13:44.759 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T23:13:44.770 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:13:44.778 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:13:44.781 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:13:44.831 INFO:tasks.ceph.osd.11:Stopped 2024-02-21T23:13:44.831 INFO:teuthology.misc:Shutting down mgr daemons... 2024-02-21T23:13:44.832 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-02-21T23:13:44.832 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T23:13:44.917 INFO:tasks.ceph.mgr.x:Stopped 2024-02-21T23:13:44.917 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-02-21T23:13:44.917 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T23:13:44.948 INFO:tasks.ceph.mgr.y:Stopped 2024-02-21T23:13:44.948 DEBUG:tasks.ceph.mgr.z:waiting for process to exit 2024-02-21T23:13:44.948 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T23:13:44.974 INFO:tasks.ceph.mgr.z:Stopped 2024-02-21T23:13:44.975 INFO:teuthology.misc:Shutting down mon daemons... 2024-02-21T23:13:44.975 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-02-21T23:13:44.975 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T23:13:45.030 INFO:tasks.ceph.mon.a:Stopped 2024-02-21T23:13:45.031 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-02-21T23:13:45.031 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T23:13:45.044 INFO:tasks.ceph.mon.b:Stopped 2024-02-21T23:13:45.044 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-02-21T23:13:45.044 INFO:teuthology.orchestra.run:waiting for 300 2024-02-21T23:13:45.056 INFO:tasks.ceph.mon.c:Stopped 2024-02-21T23:13:45.057 INFO:tasks.ceph:Checking cluster log for badness... 2024-02-21T23:13:45.057 DEBUG:teuthology.orchestra.run.smithi099:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-02-21T23:13:45.160 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi099.front.sepia.ceph.com 2024-02-21T23:13:45.160 DEBUG:teuthology.orchestra.run.smithi099:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-02-21T23:13:45.833 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi099.front.sepia.ceph.com 2024-02-21T23:13:45.834 DEBUG:teuthology.orchestra.run.smithi099:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-02-21T23:13:45.978 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi099.front.sepia.ceph.com 2024-02-21T23:13:45.979 DEBUG:teuthology.orchestra.run.smithi099:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-02-21T23:13:46.113 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-9 on ubuntu@smithi099.front.sepia.ceph.com 2024-02-21T23:13:46.113 DEBUG:teuthology.orchestra.run.smithi099:> sync && sudo umount -f /var/lib/ceph/osd/ceph-9 2024-02-21T23:13:46.265 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi162.front.sepia.ceph.com 2024-02-21T23:13:46.265 DEBUG:teuthology.orchestra.run.smithi162:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-02-21T23:13:46.520 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi162.front.sepia.ceph.com 2024-02-21T23:13:46.520 DEBUG:teuthology.orchestra.run.smithi162:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-02-21T23:13:46.598 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi162.front.sepia.ceph.com 2024-02-21T23:13:46.598 DEBUG:teuthology.orchestra.run.smithi162:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-02-21T23:13:46.657 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-10 on ubuntu@smithi162.front.sepia.ceph.com 2024-02-21T23:13:46.657 DEBUG:teuthology.orchestra.run.smithi162:> sync && sudo umount -f /var/lib/ceph/osd/ceph-10 2024-02-21T23:13:46.714 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi181.front.sepia.ceph.com 2024-02-21T23:13:46.714 DEBUG:teuthology.orchestra.run.smithi181:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-02-21T23:13:47.180 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi181.front.sepia.ceph.com 2024-02-21T23:13:47.181 DEBUG:teuthology.orchestra.run.smithi181:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-02-21T23:13:47.244 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-8 on ubuntu@smithi181.front.sepia.ceph.com 2024-02-21T23:13:47.245 DEBUG:teuthology.orchestra.run.smithi181:> sync && sudo umount -f /var/lib/ceph/osd/ceph-8 2024-02-21T23:13:47.301 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-11 on ubuntu@smithi181.front.sepia.ceph.com 2024-02-21T23:13:47.301 DEBUG:teuthology.orchestra.run.smithi181:> sync && sudo umount -f /var/lib/ceph/osd/ceph-11 2024-02-21T23:13:47.360 INFO:tasks.ceph:Archiving mon data... 2024-02-21T23:13:47.361 DEBUG:teuthology.misc:Transferring archived files from smithi099:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/leonidus-2024-02-21_22:31:03-fs-wip-lusov-qdb-distro-default-smithi/7569996/data/mon.a.tgz 2024-02-21T23:13:47.361 DEBUG:teuthology.orchestra.run.smithi099:> mktemp 2024-02-21T23:13:47.417 INFO:teuthology.orchestra.run.smithi099.stdout:/tmp/tmp.ofsuLaE5M9 2024-02-21T23:13:47.417 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.ofsuLaE5M9 2024-02-21T23:13:47.657 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 0666 /tmp/tmp.ofsuLaE5M9 2024-02-21T23:13:47.806 DEBUG:teuthology.orchestra.remote:smithi099:/tmp/tmp.ofsuLaE5M9 is 633KB 2024-02-21T23:13:47.920 DEBUG:teuthology.orchestra.run.smithi099:> rm -fr /tmp/tmp.ofsuLaE5M9 2024-02-21T23:13:47.975 DEBUG:teuthology.misc:Transferring archived files from smithi162:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/leonidus-2024-02-21_22:31:03-fs-wip-lusov-qdb-distro-default-smithi/7569996/data/mon.b.tgz 2024-02-21T23:13:47.976 DEBUG:teuthology.orchestra.run.smithi162:> mktemp 2024-02-21T23:13:47.993 INFO:teuthology.orchestra.run.smithi162.stdout:/tmp/tmp.qLW4gV7xD2 2024-02-21T23:13:47.994 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.qLW4gV7xD2 2024-02-21T23:13:48.490 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 0666 /tmp/tmp.qLW4gV7xD2 2024-02-21T23:13:48.576 DEBUG:teuthology.orchestra.remote:smithi162:/tmp/tmp.qLW4gV7xD2 is 653KB 2024-02-21T23:13:48.687 DEBUG:teuthology.orchestra.run.smithi162:> rm -fr /tmp/tmp.qLW4gV7xD2 2024-02-21T23:13:48.702 DEBUG:teuthology.misc:Transferring archived files from smithi181:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/leonidus-2024-02-21_22:31:03-fs-wip-lusov-qdb-distro-default-smithi/7569996/data/mon.c.tgz 2024-02-21T23:13:48.702 DEBUG:teuthology.orchestra.run.smithi181:> mktemp 2024-02-21T23:13:48.720 INFO:teuthology.orchestra.run.smithi181.stdout:/tmp/tmp.084WzRYpnb 2024-02-21T23:13:48.721 DEBUG:teuthology.orchestra.run.smithi181:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.084WzRYpnb 2024-02-21T23:13:48.949 DEBUG:teuthology.orchestra.run.smithi181:> sudo chmod 0666 /tmp/tmp.084WzRYpnb 2024-02-21T23:13:49.034 DEBUG:teuthology.orchestra.remote:smithi181:/tmp/tmp.084WzRYpnb is 653KB 2024-02-21T23:13:49.137 DEBUG:teuthology.orchestra.run.smithi181:> rm -fr /tmp/tmp.084WzRYpnb 2024-02-21T23:13:49.155 INFO:tasks.ceph:Cleaning ceph cluster... 2024-02-21T23:13:49.155 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-02-21T23:13:49.163 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-02-21T23:13:49.166 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-02-21T23:13:49.302 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-02-21T23:13:49.317 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-02-21T23:13:49.332 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-02-21T23:13:49.332 INFO:tasks.ceph:Archiving crash dumps... 2024-02-21T23:13:49.334 DEBUG:teuthology.misc:Transferring archived files from smithi099:/var/lib/ceph/crash to /home/teuthworker/archive/leonidus-2024-02-21_22:31:03-fs-wip-lusov-qdb-distro-default-smithi/7569996/remote/smithi099/crash 2024-02-21T23:13:49.334 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-02-21T23:13:49.426 DEBUG:teuthology.misc:Transferring archived files from smithi162:/var/lib/ceph/crash to /home/teuthworker/archive/leonidus-2024-02-21_22:31:03-fs-wip-lusov-qdb-distro-default-smithi/7569996/remote/smithi162/crash 2024-02-21T23:13:49.427 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-02-21T23:13:49.454 DEBUG:teuthology.misc:Transferring archived files from smithi181:/var/lib/ceph/crash to /home/teuthworker/archive/leonidus-2024-02-21_22:31:03-fs-wip-lusov-qdb-distro-default-smithi/7569996/remote/smithi181/crash 2024-02-21T23:13:49.456 DEBUG:teuthology.orchestra.run.smithi181:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-02-21T23:13:49.483 INFO:tasks.ceph:Shutting down logrotate 2024-02-21T23:13:49.484 DEBUG:teuthology.orchestra.run.smithi099:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:13:49.492 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:13:49.500 DEBUG:teuthology.orchestra.run.smithi181:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-02-21T23:13:49.626 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-02-21T23:13:49.723 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-02-21T23:13:49.751 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-02-21T23:13:49.779 INFO:tasks.ceph:Compressing logs... 2024-02-21T23:13:49.780 DEBUG:teuthology.orchestra.run.smithi099:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-21T23:13:49.789 DEBUG:teuthology.orchestra.run.smithi162:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-21T23:13:49.793 DEBUG:teuthology.orchestra.run.smithi181:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-21T23:13:49.817 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.10.log 2024-02-21T23:13:49.817 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-02-21T23:13:49.817 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-02-21T23:13:49.818 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-osd.10.log: /var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-02-21T23:13:49.818 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-02-21T23:13:49.822 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.k.log 2024-02-21T23:13:49.823 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-osd.4.log: /var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.h.log 2024-02-21T23:13:49.823 INFO:teuthology.orchestra.run.smithi162.stderr:gzip/var/log/ceph/ceph-mds.k.log: -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-02-21T23:13:49.823 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-mds.h.log: 89.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-02-21T23:13:49.823 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.e.log 2024-02-21T23:13:49.823 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-02-21T23:13:49.823 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-mds.e.log: /var/log/ceph/ceph-osd.7.log: 93.7% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-02-21T23:13:49.823 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-02-21T23:13:49.824 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-mgr.y.log: 93.7% -- replaced with /var/log/ceph/ceph-mds.k.log.gz 2024-02-21T23:13:49.824 INFO:teuthology.orchestra.run.smithi162.stderr: 93.7% -- replaced with /var/log/ceph/ceph-mds.h.log.gz 2024-02-21T23:13:49.824 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-02-21T23:13:49.824 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-mon.b.log: 93.7% -- replaced with /var/log/ceph/ceph-mds.e.log.gz 2024-02-21T23:13:49.825 INFO:teuthology.orchestra.run.smithi162.stderr: 87.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-02-21T23:13:49.859 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38250.log 2024-02-21T23:13:49.860 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38010.log 2024-02-21T23:13:49.860 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.38250.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.l.log 2024-02-21T23:13:49.860 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.38010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38372.log 2024-02-21T23:13:49.860 INFO:teuthology.orchestra.run.smithi181.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38250.log.gz 2024-02-21T23:13:49.860 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-mds.l.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38010.log.gz 2024-02-21T23:13:49.860 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38330.log 2024-02-21T23:13:49.861 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.38372.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-02-21T23:13:49.861 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.38330.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38372.log.gz 2024-02-21T23:13:49.861 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.i.log 2024-02-21T23:13:49.861 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38130.log 2024-02-21T23:13:49.861 INFO:teuthology.orchestra.run.smithi181.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.38330.log.gz 2024-02-21T23:13:49.861 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38170.log 2024-02-21T23:13:49.861 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.38130.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.11.log 2024-02-21T23:13:49.861 INFO:teuthology.orchestra.run.smithi181.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38130.log.gz 2024-02-21T23:13:49.862 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.38170.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.z.log 2024-02-21T23:13:49.862 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-osd.11.log: 89.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-02-21T23:13:49.862 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37930.log 2024-02-21T23:13:49.862 INFO:teuthology.orchestra.run.smithi181.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38170.log.gz 2024-02-21T23:13:49.862 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.8.log 2024-02-21T23:13:49.862 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-mgr.z.log: /var/log/ceph/ceph-client.admin.37930.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-02-21T23:13:49.863 INFO:teuthology.orchestra.run.smithi181.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37930.log.gz 2024-02-21T23:13:49.863 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38290.log 2024-02-21T23:13:49.863 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.f.log 2024-02-21T23:13:49.863 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.38290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38210.log 2024-02-21T23:13:49.863 INFO:teuthology.orchestra.run.smithi181.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38290.log.gz 2024-02-21T23:13:49.863 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37970.log 2024-02-21T23:13:49.863 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.38210.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.38210.log.gz 2024-02-21T23:13:49.863 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-02-21T23:13:49.863 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.37970.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37970.log.gz 2024-02-21T23:13:49.864 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-02-21T23:13:49.868 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph.log: 93.8% -- replaced with /var/log/ceph/ceph-mds.f.log.gz 2024-02-21T23:13:49.868 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-02-21T23:13:49.868 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-osd.2.log: 87.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-02-21T23:13:49.869 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38050.log 2024-02-21T23:13:49.869 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-mds.c.log: 93.7% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-02-21T23:13:49.869 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38090.log 2024-02-21T23:13:49.869 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.38050.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38050.log.gz 2024-02-21T23:13:49.869 INFO:teuthology.orchestra.run.smithi181.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-02-21T23:13:49.869 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-client.admin.38090.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38090.log.gz 2024-02-21T23:13:49.869 INFO:teuthology.orchestra.run.smithi181.stderr: 93.7% -- replaced with /var/log/ceph/ceph-mgr.z.log.gz 2024-02-21T23:13:49.876 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58625.log 2024-02-21T23:13:49.877 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41760.log 2024-02-21T23:13:49.878 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.58625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62531.log 2024-02-21T23:13:49.879 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.41760.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.58625.log.gz 2024-02-21T23:13:49.880 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43430.log 2024-02-21T23:13:49.880 INFO:teuthology.orchestra.run.smithi099.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.41760.log.gz 2024-02-21T23:13:49.881 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.62531.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.62531.log.gz 2024-02-21T23:13:49.883 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41196.log 2024-02-21T23:13:49.884 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.43430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60851.log 2024-02-21T23:13:49.884 INFO:teuthology.orchestra.run.smithi099.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.43430.log.gz 2024-02-21T23:13:49.884 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.41196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49708.log 2024-02-21T23:13:49.884 INFO:teuthology.orchestra.run.smithi099.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41196.log.gz 2024-02-21T23:13:49.885 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.60851.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-02-21T23:13:49.885 INFO:teuthology.orchestra.run.smithi099.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.60851.log.gz 2024-02-21T23:13:49.886 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.49708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54203.log 2024-02-21T23:13:49.887 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-osd.6.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.49708.log.gz 2024-02-21T23:13:49.887 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61310.log 2024-02-21T23:13:49.888 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.54203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45383.log 2024-02-21T23:13:49.889 INFO:teuthology.orchestra.run.smithi099.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54203.log.gz 2024-02-21T23:13:49.890 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.61310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41046.log 2024-02-21T23:13:49.891 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.45383.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.61310.log.gz 2024-02-21T23:13:49.891 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-02-21T23:13:49.891 INFO:teuthology.orchestra.run.smithi099.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45383.log.gz 2024-02-21T23:13:49.892 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.41046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63068.log 2024-02-21T23:13:49.892 INFO:teuthology.orchestra.run.smithi099.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.41046.log.gz 2024-02-21T23:13:49.893 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64530.log 2024-02-21T23:13:49.895 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.63068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64151.log 2024-02-21T23:13:49.895 INFO:teuthology.orchestra.run.smithi099.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.63068.log.gz 2024-02-21T23:13:49.896 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.64530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43983.log 87.9% 2024-02-21T23:13:49.896 INFO:teuthology.orchestra.run.smithi099.stderr: -- replaced with /var/log/ceph/ceph-client.admin.64530.log.gz 2024-02-21T23:13:49.897 INFO:teuthology.orchestra.run.smithi181.stderr:/var/log/ceph/ceph-mon.c.log: 94.4% -- replaced with /var/log/ceph/ceph-mds.l.log.gz 2024-02-21T23:13:49.898 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.64151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45467.log 2024-02-21T23:13:49.898 INFO:teuthology.orchestra.run.smithi099.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.64151.log.gz 2024-02-21T23:13:49.899 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.43983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48778.log 2024-02-21T23:13:49.899 INFO:teuthology.orchestra.run.smithi099.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.43983.log.gz 2024-02-21T23:13:49.900 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.45467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47121.log 2024-02-21T23:13:49.900 INFO:teuthology.orchestra.run.smithi099.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45467.log.gz 2024-02-21T23:13:49.901 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.48778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46617.log 2024-02-21T23:13:49.901 INFO:teuthology.orchestra.run.smithi099.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.48778.log.gz 2024-02-21T23:13:49.903 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.47121.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47121.log.gz 2024-02-21T23:13:49.903 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64445.log 2024-02-21T23:13:49.904 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.46617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63392.log 2024-02-21T23:13:49.904 INFO:teuthology.orchestra.run.smithi099.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46617.log.gz 2024-02-21T23:13:49.905 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.64445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63672.log 2024-02-21T23:13:49.905 INFO:teuthology.orchestra.run.smithi099.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.64445.log.gz 2024-02-21T23:13:49.906 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.63392.log: 88.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.63392.log.gz 2024-02-21T23:13:49.906 INFO:teuthology.orchestra.run.smithi099.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.44507.log 2024-02-21T23:13:49.908 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.63672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41096.log 2024-02-21T23:13:49.908 INFO:teuthology.orchestra.run.smithi099.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.63672.log.gz 2024-02-21T23:13:49.909 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.44507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44501.log 2024-02-21T23:13:49.909 INFO:teuthology.orchestra.run.smithi099.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44507.log.gz 2024-02-21T23:13:49.910 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.41096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46533.log 2024-02-21T23:13:49.911 INFO:teuthology.orchestra.run.smithi099.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41096.log.gz 2024-02-21T23:13:49.911 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.44501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62941.log 2024-02-21T23:13:49.912 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.46533.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44501.log.gz 2024-02-21T23:13:49.912 INFO:teuthology.orchestra.run.smithi099.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46533.log.gz 2024-02-21T23:13:49.913 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44963.log 2024-02-21T23:13:49.914 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48670.log 2024-02-21T23:13:49.914 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.62941.log: /var/log/ceph/ceph-client.admin.44963.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.62941.log.gz 2024-02-21T23:13:49.915 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60258.log 2024-02-21T23:13:49.915 INFO:teuthology.orchestra.run.smithi099.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44963.log.gz 2024-02-21T23:13:49.916 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.48670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40950.log 2024-02-21T23:13:49.916 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.60258.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48670.log.gz 2024-02-21T23:13:49.917 INFO:teuthology.orchestra.run.smithi099.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.60258.log.gz 2024-02-21T23:13:49.917 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58949.log 2024-02-21T23:13:49.919 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.40950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54272.log 2024-02-21T23:13:49.919 INFO:teuthology.orchestra.run.smithi099.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40950.log.gz 2024-02-21T23:13:49.919 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.58949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63518.log 2024-02-21T23:13:49.920 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.54272.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.58949.log.gz 2024-02-21T23:13:49.921 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61136.log 2024-02-21T23:13:49.922 INFO:teuthology.orchestra.run.smithi099.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.54272.log.gz 2024-02-21T23:13:49.922 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48007.log 2024-02-21T23:13:49.922 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.63518.log: /var/log/ceph/ceph-client.admin.61136.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.63518.log.gz 2024-02-21T23:13:49.923 INFO:teuthology.orchestra.run.smithi099.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.61136.log.gz 2024-02-21T23:13:49.923 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60216.log 2024-02-21T23:13:49.924 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.48007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47590.log 2024-02-21T23:13:49.924 INFO:teuthology.orchestra.run.smithi099.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.48007.log.gz 2024-02-21T23:13:49.925 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.60216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42812.log 2024-02-21T23:13:49.925 INFO:teuthology.orchestra.run.smithi099.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.60216.log.gz 2024-02-21T23:13:49.927 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.47590.log: 87.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.47590.log.gz 2024-02-21T23:13:49.927 INFO:teuthology.orchestra.run.smithi099.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.41448.log 2024-02-21T23:13:49.928 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.42812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42770.log 2024-02-21T23:13:49.928 INFO:teuthology.orchestra.run.smithi099.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42812.log.gz 2024-02-21T23:13:49.932 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.41448.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41448.log.gz 2024-02-21T23:13:49.932 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59798.log 2024-02-21T23:13:49.933 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.42770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47163.log 2024-02-21T23:13:49.933 INFO:teuthology.orchestra.run.smithi099.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42770.log.gz 2024-02-21T23:13:49.933 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.59798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44921.log 2024-02-21T23:13:49.933 INFO:teuthology.orchestra.run.smithi099.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.59798.log.gz 2024-02-21T23:13:49.934 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.47163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46659.log 2024-02-21T23:13:49.934 INFO:teuthology.orchestra.run.smithi099.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47163.log.gz 2024-02-21T23:13:49.942 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.44921.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44921.log.gz 2024-02-21T23:13:49.942 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59015.log 2024-02-21T23:13:49.943 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.46659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40992.log 2024-02-21T23:13:49.943 INFO:teuthology.orchestra.run.smithi099.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46659.log.gz 2024-02-21T23:13:49.943 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.59015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45131.log 2024-02-21T23:13:49.944 INFO:teuthology.orchestra.run.smithi099.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.59015.log.gz 2024-02-21T23:13:49.944 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.40992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65399.log 2024-02-21T23:13:49.944 INFO:teuthology.orchestra.run.smithi099.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40992.log.gz 2024-02-21T23:13:49.944 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.45131.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45131.log.gz 2024-02-21T23:13:49.945 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59081.log 2024-02-21T23:13:49.945 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.65399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60984.log 2024-02-21T23:13:49.945 INFO:teuthology.orchestra.run.smithi099.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.65399.log.gz 2024-02-21T23:13:49.946 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.59081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49236.log 2024-02-21T23:13:49.946 INFO:teuthology.orchestra.run.smithi099.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.59081.log.gz 2024-02-21T23:13:49.946 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.60984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62161.log 2024-02-21T23:13:49.947 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.49236.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.60984.log.gz 2024-02-21T23:13:49.947 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61901.log 2024-02-21T23:13:49.947 INFO:teuthology.orchestra.run.smithi099.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.49236.log.gz 2024-02-21T23:13:49.957 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59930.log 2024-02-21T23:13:49.957 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.62161.log: /var/log/ceph/ceph-client.admin.61901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45173.log 2024-02-21T23:13:49.957 INFO:teuthology.orchestra.run.smithi099.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.62161.log.gz 2024-02-21T23:13:49.957 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.59930.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.61901.log.gz 2024-02-21T23:13:49.957 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49408.log 2024-02-21T23:13:49.958 INFO:teuthology.orchestra.run.smithi099.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.59930.log.gz 2024-02-21T23:13:49.958 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.45173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48712.log 2024-02-21T23:13:49.958 INFO:teuthology.orchestra.run.smithi099.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45173.log.gz 2024-02-21T23:13:49.958 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.49408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62847.log 2024-02-21T23:13:49.958 INFO:teuthology.orchestra.run.smithi099.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.49408.log.gz 2024-02-21T23:13:49.958 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.48712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43684.log 2024-02-21T23:13:49.958 INFO:teuthology.orchestra.run.smithi099.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.48712.log.gz 2024-02-21T23:13:49.958 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.62847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41146.log 2024-02-21T23:13:49.959 INFO:teuthology.orchestra.run.smithi099.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.62847.log.gz 2024-02-21T23:13:49.959 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.43684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41676.log 2024-02-21T23:13:49.959 INFO:teuthology.orchestra.run.smithi099.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43684.log.gz 2024-02-21T23:13:49.959 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.41146.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41146.log.gzgzip 2024-02-21T23:13:49.959 INFO:teuthology.orchestra.run.smithi099.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.58775.log 2024-02-21T23:13:49.959 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.41676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57907.log 2024-02-21T23:13:49.959 INFO:teuthology.orchestra.run.smithi099.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41676.log.gz 2024-02-21T23:13:49.959 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.58775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44534.log 2024-02-21T23:13:49.960 INFO:teuthology.orchestra.run.smithi099.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.58775.log.gz 2024-02-21T23:13:49.960 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.57907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63308.log 2024-02-21T23:13:49.960 INFO:teuthology.orchestra.run.smithi099.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.57907.log.gz 2024-02-21T23:13:49.960 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.44534.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44534.log.gz 2024-02-21T23:13:49.960 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64824.log 2024-02-21T23:13:49.960 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.63308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43963.log 2024-02-21T23:13:49.962 INFO:teuthology.orchestra.run.smithi099.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.63308.log.gz 2024-02-21T23:13:49.963 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.64824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64277.log 2024-02-21T23:13:49.963 INFO:teuthology.orchestra.run.smithi099.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.64824.log.gz 2024-02-21T23:13:49.963 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.43963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46449.log 2024-02-21T23:13:49.963 INFO:teuthology.orchestra.run.smithi099.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43963.log.gz 2024-02-21T23:13:49.963 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.64277.log: gzip 88.2% -- replaced with /var/log/ceph/ceph-client.admin.64277.log.gz -5 2024-02-21T23:13:49.963 INFO:teuthology.orchestra.run.smithi099.stderr: --verbose -- /var/log/ceph/ceph-client.admin.62359.log 2024-02-21T23:13:49.963 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.46449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62053.log 2024-02-21T23:13:49.964 INFO:teuthology.orchestra.run.smithi099.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46449.log.gz 2024-02-21T23:13:49.964 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.62359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43205.log 2024-02-21T23:13:49.964 INFO:teuthology.orchestra.run.smithi099.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.62359.log.gz 2024-02-21T23:13:49.966 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.62053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46280.log 2024-02-21T23:13:49.966 INFO:teuthology.orchestra.run.smithi099.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.62053.log.gz 2024-02-21T23:13:49.966 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.43205.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43205.log.gz 2024-02-21T23:13:49.966 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57147.log 2024-02-21T23:13:49.966 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.46280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41490.log 2024-02-21T23:13:49.967 INFO:teuthology.orchestra.run.smithi099.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.46280.log.gz 2024-02-21T23:13:49.967 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.57147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47394.log 2024-02-21T23:13:49.968 INFO:teuthology.orchestra.run.smithi099.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.57147.log.gz 2024-02-21T23:13:49.968 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.41490.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41490.log.gz 2024-02-21T23:13:49.968 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43515.log 2024-02-21T23:13:49.969 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.47394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48844.log 2024-02-21T23:13:49.969 INFO:teuthology.orchestra.run.smithi099.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47394.log.gz 2024-02-21T23:13:49.970 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.43515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58081.log 2024-02-21T23:13:49.970 INFO:teuthology.orchestra.run.smithi099.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43515.log.gz 2024-02-21T23:13:49.971 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.48844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60719.log 2024-02-21T23:13:49.972 INFO:teuthology.orchestra.run.smithi099.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.48844.log.gz 2024-02-21T23:13:49.977 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.58081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58883.log 2024-02-21T23:13:49.977 INFO:teuthology.orchestra.run.smithi099.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.58081.log.gz 2024-02-21T23:13:49.978 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.60719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43388.log 2024-02-21T23:13:49.978 INFO:teuthology.orchestra.run.smithi099.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.60719.log.gz 2024-02-21T23:13:49.978 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.58883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45089.log 2024-02-21T23:13:49.978 INFO:teuthology.orchestra.run.smithi099.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.58883.log.gz 2024-02-21T23:13:49.978 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.43388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42586.log 2024-02-21T23:13:49.978 INFO:teuthology.orchestra.run.smithi099.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43388.log.gz 2024-02-21T23:13:49.978 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.45089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44836.log 2024-02-21T23:13:49.979 INFO:teuthology.orchestra.run.smithi099.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45089.log.gz 2024-02-21T23:13:49.980 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.42586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48205.log 2024-02-21T23:13:49.980 INFO:teuthology.orchestra.run.smithi099.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42586.log.gz 2024-02-21T23:13:49.980 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.44836.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44836.log.gz 2024-02-21T23:13:49.980 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64951.log 2024-02-21T23:13:49.981 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.48205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45005.log 2024-02-21T23:13:49.981 INFO:teuthology.orchestra.run.smithi099.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48205.log.gz 2024-02-21T23:13:49.982 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.64951.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.64951.log.gz 2024-02-21T23:13:49.982 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42854.log 2024-02-21T23:13:49.983 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.45005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43261.log 2024-02-21T23:13:49.984 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.42854.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45005.log.gz 2024-02-21T23:13:49.984 INFO:teuthology.orchestra.run.smithi099.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42854.log.gz 2024-02-21T23:13:49.985 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41358.log 2024-02-21T23:13:49.985 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.43261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63883.log 2024-02-21T23:13:49.986 INFO:teuthology.orchestra.run.smithi099.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43261.log.gz 2024-02-21T23:13:49.987 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.41358.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41358.log.gz 2024-02-21T23:13:49.987 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65077.log 2024-02-21T23:13:49.988 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.63883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57841.log 2024-02-21T23:13:49.988 INFO:teuthology.orchestra.run.smithi099.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.63883.log.gz 2024-02-21T23:13:49.989 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.65077.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.65077.log.gz 2024-02-21T23:13:49.989 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64361.log 2024-02-21T23:13:49.990 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.57841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62705.log 2024-02-21T23:13:49.991 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.64361.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.57841.log.gz 2024-02-21T23:13:49.992 INFO:teuthology.orchestra.run.smithi099.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.64361.log.gz 2024-02-21T23:13:49.992 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42974.log 2024-02-21T23:13:49.993 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.62705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45575.log 2024-02-21T23:13:49.993 INFO:teuthology.orchestra.run.smithi099.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.62705.log.gz 2024-02-21T23:13:49.994 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.42974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48604.log 2024-02-21T23:13:49.994 INFO:teuthology.orchestra.run.smithi099.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42974.log.gz 2024-02-21T23:13:49.995 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.45575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49883.log 2024-02-21T23:13:49.995 INFO:teuthology.orchestra.run.smithi099.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.45575.log.gz 2024-02-21T23:13:49.996 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.48604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48073.log 2024-02-21T23:13:49.997 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.49883.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.48604.log.gz 2024-02-21T23:13:49.997 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57949.log 2024-02-21T23:13:49.998 INFO:teuthology.orchestra.run.smithi099.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.49883.log.gz 2024-02-21T23:13:49.998 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45341.log 2024-02-21T23:13:49.999 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.48073.log: /var/log/ceph/ceph-client.admin.57949.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.48073.log.gz 2024-02-21T23:13:50.000 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47458.log 2024-02-21T23:13:50.000 INFO:teuthology.orchestra.run.smithi099.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.57949.log.gz 2024-02-21T23:13:50.001 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.45341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43346.log 2024-02-21T23:13:50.001 INFO:teuthology.orchestra.run.smithi099.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45341.log.gz 2024-02-21T23:13:50.002 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.47458.log: gzip 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47458.log.gz -5 2024-02-21T23:13:50.002 INFO:teuthology.orchestra.run.smithi099.stderr: --verbose -- /var/log/ceph/ceph-client.admin.63110.log 2024-02-21T23:13:50.003 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.43346.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-02-21T23:13:50.003 INFO:teuthology.orchestra.run.smithi099.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43346.log.gz 2024-02-21T23:13:50.004 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.63110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63756.log 2024-02-21T23:13:50.004 INFO:teuthology.orchestra.run.smithi099.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.63110.log.gz 2024-02-21T23:13:50.005 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48139.log 2024-02-21T23:13:50.007 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.63756.log: 89.1%gzip -- replaced with /var/log/ceph/ceph.audit.log.gz -5 2024-02-21T23:13:50.007 INFO:teuthology.orchestra.run.smithi099.stderr: --verbose -- /var/log/ceph/ceph-client.admin.42544.log 2024-02-21T23:13:50.007 INFO:teuthology.orchestra.run.smithi099.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.63756.log.gz 2024-02-21T23:13:50.007 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.48139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64487.log 2024-02-21T23:13:50.008 INFO:teuthology.orchestra.run.smithi099.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.48139.log.gz 2024-02-21T23:13:50.009 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.42544.log: gzip 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42544.log.gz -5 2024-02-21T23:13:50.009 INFO:teuthology.orchestra.run.smithi099.stderr: --verbose -- /var/log/ceph/ceph-client.admin.44480.log 2024-02-21T23:13:50.010 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.64487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60150.log 2024-02-21T23:13:50.010 INFO:teuthology.orchestra.run.smithi099.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.64487.log.gz 2024-02-21T23:13:50.010 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.44480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61244.log 2024-02-21T23:13:50.011 INFO:teuthology.orchestra.run.smithi099.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44480.log.gz 2024-02-21T23:13:50.012 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.60150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48511.log 2024-02-21T23:13:50.012 INFO:teuthology.orchestra.run.smithi099.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.60150.log.gz 2024-02-21T23:13:50.013 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.61244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61070.log 2024-02-21T23:13:50.013 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.48511.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.61244.log.gz 2024-02-21T23:13:50.014 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46743.log 2024-02-21T23:13:50.015 INFO:teuthology.orchestra.run.smithi099.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.48511.log.gz 2024-02-21T23:13:50.015 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48379.log 2024-02-21T23:13:50.016 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.61070.log: /var/log/ceph/ceph-client.admin.46743.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.61070.log.gz 2024-02-21T23:13:50.016 INFO:teuthology.orchestra.run.smithi099.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46743.log.gz 2024-02-21T23:13:50.016 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64866.log 2024-02-21T23:13:50.017 INFO:teuthology.orchestra.run.smithi099.stderr:gzip/var/log/ceph/ceph-client.admin.48379.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.56906.log 2024-02-21T23:13:50.018 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.64866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44421.log 2024-02-21T23:13:50.018 INFO:teuthology.orchestra.run.smithi099.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.64866.log.gz 2024-02-21T23:13:50.018 INFO:teuthology.orchestra.run.smithi099.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.48379.log.gz 2024-02-21T23:13:50.019 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.56906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57080.log 2024-02-21T23:13:50.019 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.44421.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.56906.log.gz 2024-02-21T23:13:50.020 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63002.log 2024-02-21T23:13:50.020 INFO:teuthology.orchestra.run.smithi099.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44421.log.gz 2024-02-21T23:13:50.021 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.57080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45257.log 2024-02-21T23:13:50.022 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.63002.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.57080.log.gz 2024-02-21T23:13:50.022 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64067.log 2024-02-21T23:13:50.023 INFO:teuthology.orchestra.run.smithi099.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.63002.log.gz 2024-02-21T23:13:50.023 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.45257.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45257.log.gz 2024-02-21T23:13:50.024 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44435.log 2024-02-21T23:13:50.024 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.64067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42246.log 2024-02-21T23:13:50.025 INFO:teuthology.orchestra.run.smithi099.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.64067.log.gz 2024-02-21T23:13:50.025 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.44435.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44435.log.gz 2024-02-21T23:13:50.026 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56972.log 2024-02-21T23:13:50.026 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.42246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65357.log 2024-02-21T23:13:50.028 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.56972.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56972.log.gz 2024-02-21T23:13:50.028 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61637.log 2024-02-21T23:13:50.028 INFO:teuthology.orchestra.run.smithi099.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.42246.log.gz 2024-02-21T23:13:50.029 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.65357.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.65357.log.gz 2024-02-21T23:13:50.029 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59690.log 2024-02-21T23:13:50.030 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.61637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40832.log 2024-02-21T23:13:50.030 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.59690.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.61637.log.gz 2024-02-21T23:13:50.031 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42728.log 2024-02-21T23:13:50.032 INFO:teuthology.orchestra.run.smithi099.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.59690.log.gz 2024-02-21T23:13:50.032 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47875.log 2024-02-21T23:13:50.033 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.40832.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.40832.log.gz 2024-02-21T23:13:50.033 INFO:teuthology.orchestra.run.smithi181.stderr: 95.0% -- replaced with /var/log/ceph/ceph-mds.i.log.gz 2024-02-21T23:13:50.034 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.42728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43970.log 2024-02-21T23:13:50.034 INFO:teuthology.orchestra.run.smithi099.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42728.log.gz 2024-02-21T23:13:50.035 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.47875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44494.log 2024-02-21T23:13:50.035 INFO:teuthology.orchestra.run.smithi099.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.47875.log.gz 2024-02-21T23:13:50.036 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.43970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64024.log 2024-02-21T23:13:50.036 INFO:teuthology.orchestra.run.smithi099.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43970.log.gz 2024-02-21T23:13:50.036 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.44494.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44494.log.gz 2024-02-21T23:13:50.036 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47549.log 2024-02-21T23:13:50.037 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.64024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41616.log 2024-02-21T23:13:50.038 INFO:teuthology.orchestra.run.smithi099.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.64024.log.gz 2024-02-21T23:13:50.038 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.47549.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47549.log.gz 2024-02-21T23:13:50.039 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65225.log 2024-02-21T23:13:50.039 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.41616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61442.log 2024-02-21T23:13:50.040 INFO:teuthology.orchestra.run.smithi099.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.41616.log.gz 2024-02-21T23:13:50.041 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.65225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64782.log 2024-02-21T23:13:50.041 INFO:teuthology.orchestra.run.smithi099.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.65225.log.gz 2024-02-21T23:13:50.041 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.61442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63350.log 2024-02-21T23:13:50.042 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.64782.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.61442.log.gz 2024-02-21T23:13:50.043 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61769.log 2024-02-21T23:13:50.043 INFO:teuthology.orchestra.run.smithi099.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.64782.log.gz 2024-02-21T23:13:50.044 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.63350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58841.log 2024-02-21T23:13:50.044 INFO:teuthology.orchestra.run.smithi099.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.63350.log.gz 2024-02-21T23:13:50.045 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.61769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37084.log 2024-02-21T23:13:50.045 INFO:teuthology.orchestra.run.smithi099.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.61769.log.gz 2024-02-21T23:13:50.046 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.58841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65643.log 2024-02-21T23:13:50.046 INFO:teuthology.orchestra.run.smithi099.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.58841.log.gz 2024-02-21T23:13:50.047 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.37084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44458.log 2024-02-21T23:13:50.047 INFO:teuthology.orchestra.run.smithi099.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37084.log.gz 2024-02-21T23:13:50.048 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.65643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65275.log 2024-02-21T23:13:50.048 INFO:teuthology.orchestra.run.smithi099.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.65643.log.gz 2024-02-21T23:13:50.049 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.44458.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44458.log.gz 2024-02-21T23:13:50.049 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54423.log 2024-02-21T23:13:50.050 INFO:teuthology.orchestra.run.smithi162.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-02-21T23:13:50.051 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.65275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45425.log 2024-02-21T23:13:50.051 INFO:teuthology.orchestra.run.smithi099.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.65275.log.gz 2024-02-21T23:13:50.051 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.54423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60608.log 2024-02-21T23:13:50.052 INFO:teuthology.orchestra.run.smithi099.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.54423.log.gz 2024-02-21T23:13:50.052 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.45425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42628.log 2024-02-21T23:13:50.053 INFO:teuthology.orchestra.run.smithi099.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45425.log.gz 2024-02-21T23:13:50.053 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.60608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42896.log 2024-02-21T23:13:50.054 INFO:teuthology.orchestra.run.smithi099.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.60608.log.gz 2024-02-21T23:13:50.054 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.42628.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42628.log.gz 2024-02-21T23:13:50.055 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47223.log 2024-02-21T23:13:50.055 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.42896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43557.log 2024-02-21T23:13:50.056 INFO:teuthology.orchestra.run.smithi099.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42896.log.gz 2024-02-21T23:13:50.057 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.47223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57381.log 2024-02-21T23:13:50.057 INFO:teuthology.orchestra.run.smithi099.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.47223.log.gz 2024-02-21T23:13:50.058 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.43557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42418.log 2024-02-21T23:13:50.058 INFO:teuthology.orchestra.run.smithi099.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43557.log.gz 2024-02-21T23:13:50.059 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.57381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65035.log 2024-02-21T23:13:50.059 INFO:teuthology.orchestra.run.smithi099.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.57381.log.gz 2024-02-21T23:13:50.060 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.42418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46911.log 2024-02-21T23:13:50.060 INFO:teuthology.orchestra.run.smithi099.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42418.log.gz 2024-02-21T23:13:50.061 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.65035.log: gzip -5 88.0% --verbose -- replaced with /var/log/ceph/ceph-client.admin.65035.log.gz -- 2024-02-21T23:13:50.061 INFO:teuthology.orchestra.run.smithi099.stderr: /var/log/ceph/ceph-client.admin.41248.log 2024-02-21T23:13:50.062 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.46911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43984.log 2024-02-21T23:13:50.062 INFO:teuthology.orchestra.run.smithi099.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46911.log.gz 2024-02-21T23:13:50.063 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.41248.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.41248.log.gz 2024-02-21T23:13:50.063 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.g.log 2024-02-21T23:13:50.064 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.43984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54059.log 2024-02-21T23:13:50.065 INFO:teuthology.orchestra.run.smithi099.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43984.log.gz 2024-02-21T23:13:50.065 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46869.log 2024-02-21T23:13:50.066 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.54059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48445.log 2024-02-21T23:13:50.067 INFO:teuthology.orchestra.run.smithi099.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.54059.log.gz 2024-02-21T23:13:50.068 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.46869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44411.log 2024-02-21T23:13:50.068 INFO:teuthology.orchestra.run.smithi099.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.46869.log.gz 2024-02-21T23:13:50.069 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.48445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64740.log 2024-02-21T23:13:50.069 INFO:teuthology.orchestra.run.smithi099.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.48445.log.gz 2024-02-21T23:13:50.070 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.44411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43641.log 2024-02-21T23:13:50.071 INFO:teuthology.orchestra.run.smithi099.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44411.log.gz 2024-02-21T23:13:50.071 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.64740.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.64740.log.gz 2024-02-21T23:13:50.071 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58319.log 2024-02-21T23:13:50.072 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61987.log/var/log/ceph/ceph-client.admin.43641.log: 2024-02-21T23:13:50.073 INFO:teuthology.orchestra.run.smithi099.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43641.log.gz 2024-02-21T23:13:50.073 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.58319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41532.log 2024-02-21T23:13:50.074 INFO:teuthology.orchestra.run.smithi099.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.58319.log.gz 2024-02-21T23:13:50.075 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.61987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47815.log 2024-02-21T23:13:50.075 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.41532.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.61987.log.gz 2024-02-21T23:13:50.076 INFO:teuthology.orchestra.run.smithi099.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41532.log.gz 2024-02-21T23:13:50.076 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49170.log 2024-02-21T23:13:50.077 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46827.log 2024-02-21T23:13:50.078 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.47815.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47815.log.gz 2024-02-21T23:13:50.078 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.49170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61528.log 2024-02-21T23:13:50.079 INFO:teuthology.orchestra.run.smithi099.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.49170.log.gz 2024-02-21T23:13:50.079 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.46827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61835.log 2024-02-21T23:13:50.080 INFO:teuthology.orchestra.run.smithi099.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46827.log.gz 2024-02-21T23:13:50.081 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.61528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63841.log 2024-02-21T23:13:50.081 INFO:teuthology.orchestra.run.smithi099.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.61528.log.gz 2024-02-21T23:13:50.082 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.61835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43303.log 2024-02-21T23:13:50.082 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.63841.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.61835.log.gz 2024-02-21T23:13:50.083 INFO:teuthology.orchestra.run.smithi099.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.63841.log.gz 2024-02-21T23:13:50.083 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45509.log 2024-02-21T23:13:50.084 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64403.log 2024-02-21T23:13:50.084 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.43303.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43303.log.gz 2024-02-21T23:13:50.085 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.45509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47079.log 2024-02-21T23:13:50.085 INFO:teuthology.orchestra.run.smithi099.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.45509.log.gz 2024-02-21T23:13:50.086 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.64403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43981.log 2024-02-21T23:13:50.087 INFO:teuthology.orchestra.run.smithi099.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.64403.log.gz 2024-02-21T23:13:50.087 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.47079.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47079.log.gz 2024-02-21T23:13:50.088 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60457.log 2024-02-21T23:13:50.089 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.43981.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.j.log 2024-02-21T23:13:50.089 INFO:teuthology.orchestra.run.smithi099.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.43981.log.gz 2024-02-21T23:13:50.090 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.60457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65166.log 2024-02-21T23:13:50.090 INFO:teuthology.orchestra.run.smithi099.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.60457.log.gz 2024-02-21T23:13:50.091 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65685.log 2024-02-21T23:13:50.092 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.65166.log: gzip -5 --verbose -- 87.3% /var/log/ceph/ceph-client.admin.45215.log -- replaced with /var/log/ceph/ceph-client.admin.65166.log.gz 2024-02-21T23:13:50.093 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-02-21T23:13:50.094 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.65685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57447.log 2024-02-21T23:13:50.094 INFO:teuthology.orchestra.run.smithi099.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.65685.log.gz 2024-02-21T23:13:50.095 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.45215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42502.log 2024-02-21T23:13:50.095 INFO:teuthology.orchestra.run.smithi099.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45215.log.gz 2024-02-21T23:13:50.096 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.57447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49817.log 2024-02-21T23:13:50.097 INFO:teuthology.orchestra.run.smithi099.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.57447.log.gz 2024-02-21T23:13:50.097 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.42502.log: gzip 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42502.log.gz -5 2024-02-21T23:13:50.097 INFO:teuthology.orchestra.run.smithi099.stderr: --verbose -- /var/log/ceph/ceph-client.admin.58559.log 2024-02-21T23:13:50.098 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.49817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59474.log 2024-02-21T23:13:50.099 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.58559.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.49817.log.gz 2024-02-21T23:13:50.100 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-02-21T23:13:50.100 INFO:teuthology.orchestra.run.smithi099.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.58559.log.gz 2024-02-21T23:13:50.101 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.59474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63434.log 2024-02-21T23:13:50.101 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-osd.3.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.59474.log.gz 2024-02-21T23:13:50.102 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60676.log 2024-02-21T23:13:50.104 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.63434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59864.log 2024-02-21T23:13:50.104 INFO:teuthology.orchestra.run.smithi099.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.63434.log.gz 2024-02-21T23:13:50.105 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.60676.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.60676.log.gz 2024-02-21T23:13:50.107 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.59864.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.59864.log.gz 2024-02-21T23:13:50.107 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64572.log 2024-02-21T23:13:50.108 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64908.log 2024-02-21T23:13:50.110 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.64572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37208.log 2024-02-21T23:13:50.110 INFO:teuthology.orchestra.run.smithi099.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.64572.log.gz 2024-02-21T23:13:50.111 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.64908.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.64908.log.gz 2024-02-21T23:13:50.112 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.37208.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37208.log.gz 2024-02-21T23:13:50.113 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65587.log 2024-02-21T23:13:50.114 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62293.log 2024-02-21T23:13:50.116 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.65587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58385.log 2024-02-21T23:13:50.116 INFO:teuthology.orchestra.run.smithi099.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.65587.log.gz 2024-02-21T23:13:50.117 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.62293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61703.log 2024-02-21T23:13:50.117 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.58385.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.62293.log.gz 2024-02-21T23:13:50.118 INFO:teuthology.orchestra.run.smithi099.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.58385.log.gz 2024-02-21T23:13:50.119 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.61703.log: -- /var/log/ceph/ceph-client.admin.40698.log 2024-02-21T23:13:50.120 INFO:teuthology.orchestra.run.smithi099.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.61703.log.gz 2024-02-21T23:13:50.121 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45641.log 2024-02-21T23:13:50.122 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.40698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48910.log 2024-02-21T23:13:50.122 INFO:teuthology.orchestra.run.smithi099.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40698.log.gz 2024-02-21T23:13:50.124 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.45641.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.45641.log.gz 2024-02-21T23:13:50.124 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.48910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48247.log 2024-02-21T23:13:50.125 INFO:teuthology.orchestra.run.smithi099.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.48910.log.gz 2024-02-21T23:13:50.127 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.48247.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.48247.log.gz 2024-02-21T23:13:50.128 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48976.log 2024-02-21T23:13:50.129 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45047.log 2024-02-21T23:13:50.131 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.48976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62463.log 2024-02-21T23:13:50.132 INFO:teuthology.orchestra.run.smithi099.stderr: 91.0%/var/log/ceph/ceph-client.admin.45047.log: -- replaced with /var/log/ceph/ceph-client.admin.48976.log.gz 2024-02-21T23:13:50.132 INFO:teuthology.orchestra.run.smithi099.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45047.log.gz 2024-02-21T23:13:50.134 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.62463.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.62463.log.gz 2024-02-21T23:13:50.134 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.30494.log 2024-02-21T23:13:50.135 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48313.log 2024-02-21T23:13:50.137 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph.tmp-client.admin.30494.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.30494.log.gzgzip 2024-02-21T23:13:50.137 INFO:teuthology.orchestra.run.smithi099.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.63798.log 2024-02-21T23:13:50.138 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.48313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59234.log 2024-02-21T23:13:50.140 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.63798.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.48313.log.gz 2024-02-21T23:13:50.140 INFO:teuthology.orchestra.run.smithi099.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.63798.log.gz 2024-02-21T23:13:50.141 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.59234.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.59234.log.gz 2024-02-21T23:13:50.142 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45769.log 2024-02-21T23:13:50.143 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57214.log 2024-02-21T23:13:50.144 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.45769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43016.log 2024-02-21T23:13:50.145 INFO:teuthology.orchestra.run.smithi099.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45769.log.gz 2024-02-21T23:13:50.146 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.57214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64698.log 2024-02-21T23:13:50.146 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.43016.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.57214.log.gz 2024-02-21T23:13:50.147 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57555.log 2024-02-21T23:13:50.147 INFO:teuthology.orchestra.run.smithi099.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43016.log.gz 2024-02-21T23:13:50.148 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.64698.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.64698.log.gz 2024-02-21T23:13:50.149 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59756.log 2024-02-21T23:13:50.150 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.57555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57621.log 2024-02-21T23:13:50.150 INFO:teuthology.orchestra.run.smithi099.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.57555.log.gz 2024-02-21T23:13:50.151 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.59756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46407.log 2024-02-21T23:13:50.152 INFO:teuthology.orchestra.run.smithi099.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.59756.log.gz 2024-02-21T23:13:50.154 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.57621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54347.log 2024-02-21T23:13:50.154 INFO:teuthology.orchestra.run.smithi099.stderr: 90.8%/var/log/ceph/ceph-client.admin.46407.log: -- replaced with /var/log/ceph/ceph-client.admin.57621.log.gz 2024-02-21T23:13:50.154 INFO:teuthology.orchestra.run.smithi099.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46407.log.gz 2024-02-21T23:13:50.155 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60390.log 2024-02-21T23:13:50.156 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.54347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49949.log 2024-02-21T23:13:50.158 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.60390.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.54347.log.gz 2024-02-21T23:13:50.158 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47749.log 2024-02-21T23:13:50.159 INFO:teuthology.orchestra.run.smithi099.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.60390.log.gz 2024-02-21T23:13:50.160 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.49949.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.49949.log.gz 2024-02-21T23:13:50.160 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.47749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49302.log 2024-02-21T23:13:50.161 INFO:teuthology.orchestra.run.smithi099.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.47749.log.gz 2024-02-21T23:13:50.162 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43965.log 2024-02-21T23:13:50.164 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.49302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62639.log 2024-02-21T23:13:50.164 INFO:teuthology.orchestra.run.smithi099.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.49302.log.gz 2024-02-21T23:13:50.165 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.43965.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-02-21T23:13:50.165 INFO:teuthology.orchestra.run.smithi099.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43965.log.gz 2024-02-21T23:13:50.166 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.62639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57489.log 2024-02-21T23:13:50.167 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-mgr.x.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.62639.log.gz 2024-02-21T23:13:50.168 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43988.log 2024-02-21T23:13:50.171 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.57489.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.57489.log.gz 2024-02-21T23:13:50.171 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.43988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36834.log 2024-02-21T23:13:50.171 INFO:teuthology.orchestra.run.smithi099.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43988.log.gz 2024-02-21T23:13:50.172 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43980.log 2024-02-21T23:13:50.175 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.36834.log: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.36834.log.gz 2024-02-21T23:13:50.175 INFO:teuthology.orchestra.run.smithi099.stderr:gzip/var/log/ceph/ceph-client.admin.43980.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.54623.log 2024-02-21T23:13:50.175 INFO:teuthology.orchestra.run.smithi099.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.43980.log.gz 2024-02-21T23:13:50.182 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59300.log 2024-02-21T23:13:50.182 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.54623.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.54623.log.gz 2024-02-21T23:13:50.182 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.59300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47941.log 2024-02-21T23:13:50.182 INFO:teuthology.orchestra.run.smithi099.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.59300.log.gz 2024-02-21T23:13:50.182 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46995.log 2024-02-21T23:13:50.183 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.47941.log: 93.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-02-21T23:13:50.184 INFO:teuthology.orchestra.run.smithi099.stderr: 91.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59147.log 2024-02-21T23:13:50.184 INFO:teuthology.orchestra.run.smithi099.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47941.log.gz 2024-02-21T23:13:50.184 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.46995.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46995.log.gz 2024-02-21T23:13:50.186 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.59147.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.59147.log.gz 2024-02-21T23:13:50.186 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43964.log 2024-02-21T23:13:50.187 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58015.log 2024-02-21T23:13:50.189 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.43964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49062.log 2024-02-21T23:13:50.189 INFO:teuthology.orchestra.run.smithi099.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43964.log.gz 2024-02-21T23:13:50.191 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.58015.log: 91.0%/var/log/ceph/ceph-client.admin.49062.log: -- replaced with /var/log/ceph/ceph-client.admin.58015.log.gz 2024-02-21T23:13:50.192 INFO:teuthology.orchestra.run.smithi099.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.49062.log.gz 2024-02-21T23:13:50.192 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46085.log 2024-02-21T23:13:50.194 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44485.log 2024-02-21T23:13:50.195 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.46085.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.0.46085.log.gz -5 2024-02-21T23:13:50.195 INFO:teuthology.orchestra.run.smithi099.stderr: --verbose -- /var/log/ceph/ceph-client.admin.41404.log 2024-02-21T23:13:50.196 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.44485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46491.log 2024-02-21T23:13:50.197 INFO:teuthology.orchestra.run.smithi099.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44485.log.gz 2024-02-21T23:13:50.198 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.41404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42460.log 2024-02-21T23:13:50.198 INFO:teuthology.orchestra.run.smithi099.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.41404.log.gz 2024-02-21T23:13:50.199 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.46491.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46491.log.gz 2024-02-21T23:13:50.199 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65441.log 2024-02-21T23:13:50.200 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.42460.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42460.log.gz 2024-02-21T23:13:50.202 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.65441.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.65441.log.gz 2024-02-21T23:13:50.202 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62855.log 2024-02-21T23:13:50.204 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45299.log 2024-02-21T23:13:50.205 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.62855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62573.log 2024-02-21T23:13:50.207 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.45299.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.62855.log.gz 2024-02-21T23:13:50.207 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63714.log 2024-02-21T23:13:50.207 INFO:teuthology.orchestra.run.smithi099.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45299.log.gz 2024-02-21T23:13:50.208 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.62573.log: /var/log/ceph/ceph-client.admin.63714.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.62573.log.gz 2024-02-21T23:13:50.209 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60324.log 2024-02-21T23:13:50.209 INFO:teuthology.orchestra.run.smithi099.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.63714.log.gz 2024-02-21T23:13:50.210 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57688.log 2024-02-21T23:13:50.211 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.60324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43726.log 2024-02-21T23:13:50.212 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.57688.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.60324.log.gz 2024-02-21T23:13:50.213 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58147.log 2024-02-21T23:13:50.214 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.43726.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.57688.log.gz 2024-02-21T23:13:50.214 INFO:teuthology.orchestra.run.smithi099.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43726.log.gz 2024-02-21T23:13:50.215 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61594.log 2024-02-21T23:13:50.216 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.58147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60918.log 2024-02-21T23:13:50.216 INFO:teuthology.orchestra.run.smithi162.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-02-21T23:13:50.217 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.61594.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.58147.log.gz 2024-02-21T23:13:50.217 INFO:teuthology.orchestra.run.smithi099.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.61594.log.gz 2024-02-21T23:13:50.218 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44445.log 2024-02-21T23:13:50.219 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.60918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50135.log 2024-02-21T23:13:50.219 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.44445.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.60918.log.gz 2024-02-21T23:13:50.220 INFO:teuthology.orchestra.run.smithi099.stderr:gzip 87.0% -- replaced with /var/log/ceph/ceph-client.admin.44445.log.gz 2024-02-21T23:13:50.221 INFO:teuthology.orchestra.run.smithi099.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.47037.log 2024-02-21T23:13:50.222 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.50135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58691.log 2024-02-21T23:13:50.222 INFO:teuthology.orchestra.run.smithi099.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.50135.log.gz 2024-02-21T23:13:50.223 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.47037.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-02-21T23:13:50.224 INFO:teuthology.orchestra.run.smithi099.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47037.log.gz 2024-02-21T23:13:50.225 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.58691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43100.log 2024-02-21T23:13:50.225 INFO:teuthology.orchestra.run.smithi099.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.58691.log.gz 2024-02-21T23:13:50.228 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.43100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65483.log 2024-02-21T23:13:50.229 INFO:teuthology.orchestra.run.smithi099.stderr: 88.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41718.log 2024-02-21T23:13:50.229 INFO:teuthology.orchestra.run.smithi099.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43100.log.gz 2024-02-21T23:13:50.231 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.65483.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.65483.log.gz 2024-02-21T23:13:50.232 INFO:teuthology.orchestra.run.smithi099.stderr:gzip/var/log/ceph/ceph-client.admin.41718.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.47498.log 2024-02-21T23:13:50.232 INFO:teuthology.orchestra.run.smithi099.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41718.log.gz 2024-02-21T23:13:50.233 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59606.log 2024-02-21T23:13:50.236 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.47498.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47498.log.gz 2024-02-21T23:13:50.236 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59408.log/var/log/ceph/ceph-client.admin.59606.log: 2024-02-21T23:13:50.237 INFO:teuthology.orchestra.run.smithi099.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.59606.log.gz 2024-02-21T23:13:50.238 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.59408.log: /var/log/ceph/ceph-client.admin.62771.log 2024-02-21T23:13:50.240 INFO:teuthology.orchestra.run.smithi099.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.59408.log.gz 2024-02-21T23:13:50.240 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57281.log 2024-02-21T23:13:50.242 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.62771.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.62771.log.gz 2024-02-21T23:13:50.242 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.57281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59540.log 2024-02-21T23:13:50.244 INFO:teuthology.orchestra.run.smithi099.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.57281.log.gz 2024-02-21T23:13:50.244 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64319.log 2024-02-21T23:13:50.246 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.59540.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.59540.log.gz 2024-02-21T23:13:50.246 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.64319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49775.log 2024-02-21T23:13:50.247 INFO:teuthology.orchestra.run.smithi099.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.64319.log.gz 2024-02-21T23:13:50.248 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58493.log 2024-02-21T23:13:50.249 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.49775.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49775.log.gz 2024-02-21T23:13:50.250 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.58493.log: -- /var/log/ceph/ceph-client.admin.49496.log 2024-02-21T23:13:50.251 INFO:teuthology.orchestra.run.smithi099.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.58493.log.gz 2024-02-21T23:13:50.252 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43986.log 2024-02-21T23:13:50.253 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.49496.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.49496.log.gz 2024-02-21T23:13:50.254 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.43986.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43986.log.gz 2024-02-21T23:13:50.255 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64109.log 2024-02-21T23:13:50.256 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41826.log 2024-02-21T23:13:50.258 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.64109.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.64109.log.gz 2024-02-21T23:13:50.259 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.41826.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41826.log.gz 2024-02-21T23:13:50.259 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43960.log 2024-02-21T23:13:50.261 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49128.log 2024-02-21T23:13:50.262 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.43960.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43960.log.gz 2024-02-21T23:13:50.263 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-02-21T23:13:50.264 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.49128.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49128.log.gz 2024-02-21T23:13:50.265 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41307.log 2024-02-21T23:13:50.269 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.41307.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41307.log.gz 2024-02-21T23:13:50.269 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54527.log 2024-02-21T23:13:50.269 INFO:teuthology.orchestra.run.smithi099.stderr: 87.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-02-21T23:13:50.269 INFO:teuthology.orchestra.run.smithi181.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-02-21T23:13:50.271 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.54527.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.54527.log.gz 2024-02-21T23:13:50.271 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46785.log 2024-02-21T23:13:50.273 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61376.log 2024-02-21T23:13:50.274 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.46785.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46785.log.gz 2024-02-21T23:13:50.275 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63176.log 2024-02-21T23:13:50.277 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.61376.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.61376.log.gz 2024-02-21T23:13:50.277 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.63176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47309.log 2024-02-21T23:13:50.278 INFO:teuthology.orchestra.run.smithi099.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.63176.log.gz 2024-02-21T23:13:50.279 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61178.log 2024-02-21T23:13:50.281 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.47309.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.47309.log.gz 2024-02-21T23:13:50.281 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.61178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63476.log 2024-02-21T23:13:50.282 INFO:teuthology.orchestra.run.smithi099.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.61178.log.gz 2024-02-21T23:13:50.283 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62095.log 2024-02-21T23:13:50.284 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.63476.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.63476.log.gz 2024-02-21T23:13:50.285 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65119.log 2024-02-21T23:13:50.286 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.62095.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.62095.log.gz 2024-02-21T23:13:50.288 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42686.log 2024-02-21T23:13:50.289 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.65119.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.65119.log.gz 2024-02-21T23:13:50.289 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46701.log 2024-02-21T23:13:50.290 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.42686.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42686.log.gz 2024-02-21T23:13:50.291 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43058.log 2024-02-21T23:13:50.292 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.46701.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46701.log.gz 2024-02-21T23:13:50.293 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.9.log 2024-02-21T23:13:50.294 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.43058.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43058.log.gz 2024-02-21T23:13:50.295 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57014.log 2024-02-21T23:13:50.297 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-osd.9.log: /var/log/ceph/ceph-client.admin.57014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43472.log 2024-02-21T23:13:50.299 INFO:teuthology.orchestra.run.smithi099.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.57014.log.gz 2024-02-21T23:13:50.301 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65315.log 2024-02-21T23:13:50.303 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.43472.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43472.log.gz 2024-02-21T23:13:50.305 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.65315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41574.log 2024-02-21T23:13:50.307 INFO:teuthology.orchestra.run.smithi099.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.65315.log.gz 2024-02-21T23:13:50.307 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60062.log 2024-02-21T23:13:50.314 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.60062.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.60062.log.gz 2024-02-21T23:13:50.314 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.41574.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.41574.log.gz 2024-02-21T23:13:50.314 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46239.log 2024-02-21T23:13:50.315 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.46239.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46239.log.gz 2024-02-21T23:13:50.316 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64993.log 2024-02-21T23:13:50.318 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.64993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58427.log 2024-02-21T23:13:50.319 INFO:teuthology.orchestra.run.smithi099.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.64993.log.gz 2024-02-21T23:13:50.321 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.58427.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.58427.log.gz 2024-02-21T23:13:50.322 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57754.log 2024-02-21T23:13:50.324 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.57754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44794.log 2024-02-21T23:13:50.326 INFO:teuthology.orchestra.run.smithi099.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.57754.log.gz 2024-02-21T23:13:50.327 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43599.log 2024-02-21T23:13:50.331 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.44794.log: /var/log/ceph/ceph-client.admin.43599.log: 87.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62227.log 2024-02-21T23:13:50.331 INFO:teuthology.orchestra.run.smithi099.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44794.log.gz 2024-02-21T23:13:50.332 INFO:teuthology.orchestra.run.smithi099.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43599.log.gz 2024-02-21T23:13:50.334 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46575.log 2024-02-21T23:13:50.338 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.62227.log: /var/log/ceph/ceph-client.admin.46575.log: 90.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43151.log 2024-02-21T23:13:50.339 INFO:teuthology.orchestra.run.smithi099.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.62227.log.gz 2024-02-21T23:13:50.340 INFO:teuthology.orchestra.run.smithi099.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46575.log.gz 2024-02-21T23:13:50.341 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44511.log 2024-02-21T23:13:50.345 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.44511.log: /var/log/ceph/ceph-client.admin.43151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60785.log 88.3% 2024-02-21T23:13:50.346 INFO:teuthology.orchestra.run.smithi099.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43151.log.gz 2024-02-21T23:13:50.346 INFO:teuthology.orchestra.run.smithi099.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44511.log.gz 2024-02-21T23:13:50.348 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46322.log 2024-02-21T23:13:50.353 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.46322.log: /var/log/ceph/ceph-client.admin.60785.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.60785.log.gz 2024-02-21T23:13:50.353 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43975.log 2024-02-21T23:13:50.354 INFO:teuthology.orchestra.run.smithi099.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46322.log.gz 2024-02-21T23:13:50.355 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65727.log 2024-02-21T23:13:50.358 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.65727.log: /var/log/ceph/ceph-client.admin.43975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59342.log 2024-02-21T23:13:50.359 INFO:teuthology.orchestra.run.smithi099.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43975.log.gz 2024-02-21T23:13:50.361 INFO:teuthology.orchestra.run.smithi099.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.65727.log.gz 2024-02-21T23:13:50.362 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-02-21T23:13:50.365 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-mds.d.log: /var/log/ceph/ceph-client.admin.59342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46365.log 2024-02-21T23:13:50.369 INFO:teuthology.orchestra.run.smithi099.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.59342.log.gz 2024-02-21T23:13:50.371 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.46365.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.46365.log.gz 2024-02-21T23:13:50.372 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59996.log 2024-02-21T23:13:50.374 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47220.log 2024-02-21T23:13:50.377 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.59996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47630.log 2024-02-21T23:13:50.378 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.47220.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.59996.log.gz 2024-02-21T23:13:50.378 INFO:teuthology.orchestra.run.smithi099.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47220.log.gz 2024-02-21T23:13:50.381 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44878.log 2024-02-21T23:13:50.383 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.47630.log: 87.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64235.log 2024-02-21T23:13:50.385 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.44878.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44878.log.gz 2024-02-21T23:13:50.385 INFO:teuthology.orchestra.run.smithi099.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47630.log.gz 2024-02-21T23:13:50.388 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.64235.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-02-21T23:13:50.389 INFO:teuthology.orchestra.run.smithi099.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.64235.log.gz 2024-02-21T23:13:50.389 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46953.log 2024-02-21T23:13:50.393 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58231.log 2024-02-21T23:13:50.394 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.46953.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46953.log.gz 2024-02-21T23:13:50.395 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50281.log 2024-02-21T23:13:50.397 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.58231.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.58231.log.gz 2024-02-21T23:13:50.399 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64656.log 2024-02-21T23:13:50.401 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.50281.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.50281.log.gz 2024-02-21T23:13:50.404 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.64656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64193.log 2024-02-21T23:13:50.404 INFO:teuthology.orchestra.run.smithi099.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.64656.log.gz 2024-02-21T23:13:50.408 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60523.log 2024-02-21T23:13:50.409 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.64193.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.64193.log.gz 2024-02-21T23:13:50.413 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.60523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63242.log 2024-02-21T23:13:50.414 INFO:teuthology.orchestra.run.smithi099.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.60523.log.gz 2024-02-21T23:13:50.418 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64614.log 2024-02-21T23:13:50.420 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.63242.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.63242.log.gz 2024-02-21T23:13:50.423 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.64614.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.64614.log.gz 2024-02-21T23:13:50.489 INFO:teuthology.orchestra.run.smithi099.stderr: 93.0% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-02-21T23:13:50.708 INFO:teuthology.orchestra.run.smithi099.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-02-21T23:13:51.541 INFO:teuthology.orchestra.run.smithi162.stderr: 92.6% -- replaced with /var/log/ceph/ceph-osd.10.log.gz 2024-02-21T23:13:51.861 INFO:teuthology.orchestra.run.smithi099.stderr: 95.5% -- replaced with /var/log/ceph/ceph-mds.g.log.gz 2024-02-21T23:13:51.915 INFO:teuthology.orchestra.run.smithi162.stderr: 92.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-02-21T23:13:52.168 INFO:teuthology.orchestra.run.smithi181.stderr: 93.0% -- replaced with /var/log/ceph/ceph-osd.8.log.gz 2024-02-21T23:13:52.243 INFO:teuthology.orchestra.run.smithi162.stderr: 92.6% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-02-21T23:13:52.574 INFO:teuthology.orchestra.run.smithi181.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.11.log.gz 2024-02-21T23:13:52.691 INFO:teuthology.orchestra.run.smithi099.stderr: 93.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-02-21T23:13:52.971 INFO:teuthology.orchestra.run.smithi181.stderr: 93.0% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-02-21T23:13:53.150 INFO:teuthology.orchestra.run.smithi099.stderr: 94.3% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-02-21T23:13:53.497 INFO:teuthology.orchestra.run.smithi162.stderr: 93.1% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-02-21T23:13:53.499 INFO:teuthology.orchestra.run.smithi162.stderr: 2024-02-21T23:13:53.499 INFO:teuthology.orchestra.run.smithi162.stderr:real 0m3.695s 2024-02-21T23:13:53.499 INFO:teuthology.orchestra.run.smithi162.stderr:user 0m10.217s 2024-02-21T23:13:53.499 INFO:teuthology.orchestra.run.smithi162.stderr:sys 0m0.360s 2024-02-21T23:13:53.512 INFO:teuthology.orchestra.run.smithi181.stderr: 92.8% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-02-21T23:13:53.514 INFO:teuthology.orchestra.run.smithi181.stderr: 2024-02-21T23:13:53.514 INFO:teuthology.orchestra.run.smithi181.stderr:real 0m3.675s 2024-02-21T23:13:53.514 INFO:teuthology.orchestra.run.smithi181.stderr:user 0m12.037s 2024-02-21T23:13:53.514 INFO:teuthology.orchestra.run.smithi181.stderr:sys 0m0.435s 2024-02-21T23:13:53.647 INFO:teuthology.orchestra.run.smithi099.stderr: 92.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-02-21T23:13:53.763 INFO:teuthology.orchestra.run.smithi099.stderr: 92.9% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-02-21T23:13:54.254 INFO:teuthology.orchestra.run.smithi099.stderr: 93.0% -- replaced with /var/log/ceph/ceph-osd.9.log.gz 2024-02-21T23:14:06.200 INFO:teuthology.orchestra.run.smithi099.stderr: 93.4% -- replaced with /var/log/ceph/ceph-mds.j.log.gz 2024-02-21T23:14:06.206 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-02-21T23:14:06.206 INFO:teuthology.orchestra.run.smithi099.stderr:real 0m16.371s 2024-02-21T23:14:06.206 INFO:teuthology.orchestra.run.smithi099.stderr:user 0m33.026s 2024-02-21T23:14:06.206 INFO:teuthology.orchestra.run.smithi099.stderr:sys 0m3.406s 2024-02-21T23:14:06.208 INFO:tasks.ceph:Archiving logs... 2024-02-21T23:14:06.208 DEBUG:teuthology.misc:Transferring archived files from smithi099:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-02-21_22:31:03-fs-wip-lusov-qdb-distro-default-smithi/7569996/remote/smithi099/log 2024-02-21T23:14:06.209 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-21T23:14:10.969 DEBUG:teuthology.misc:Transferring archived files from smithi162:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-02-21_22:31:03-fs-wip-lusov-qdb-distro-default-smithi/7569996/remote/smithi162/log 2024-02-21T23:14:10.970 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-21T23:14:12.678 DEBUG:teuthology.misc:Transferring archived files from smithi181:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-02-21_22:31:03-fs-wip-lusov-qdb-distro-default-smithi/7569996/remote/smithi181/log 2024-02-21T23:14:12.679 DEBUG:teuthology.orchestra.run.smithi181:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-21T23:14:14.648 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-02-21T23:14:14.659 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-02-21T23:14:14.659 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-21T23:14:14.667 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-21T23:14:14.669 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-21T23:14:14.826 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-02-21T23:14:14.838 INFO:teuthology.task.clock:Checking final clock skew... 2024-02-21T23:14:14.838 DEBUG:teuthology.orchestra.run.smithi099:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-21T23:14:14.846 DEBUG:teuthology.orchestra.run.smithi162:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-21T23:14:14.849 DEBUG:teuthology.orchestra.run.smithi181:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-21T23:14:14.863 INFO:teuthology.orchestra.run.smithi162.stderr:bash: line 1: ntpq: command not found 2024-02-21T23:14:14.866 INFO:teuthology.orchestra.run.smithi181.stderr:bash: line 1: ntpq: command not found 2024-02-21T23:14:14.867 INFO:teuthology.orchestra.run.smithi162.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-21T23:14:14.868 INFO:teuthology.orchestra.run.smithi162.stdout:=============================================================================== 2024-02-21T23:14:14.868 INFO:teuthology.orchestra.run.smithi162.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 37 +516us[ +512us] +/- 100ms 2024-02-21T23:14:14.868 INFO:teuthology.orchestra.run.smithi162.stdout:^* hv02.front.sepia.ceph.com 3 6 377 35 -14us[ -18us] +/- 78ms 2024-02-21T23:14:14.868 INFO:teuthology.orchestra.run.smithi162.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 37 -354us[ -358us] +/- 79ms 2024-02-21T23:14:14.868 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-02-21T23:14:14.870 INFO:teuthology.orchestra.run.smithi181.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-21T23:14:14.870 INFO:teuthology.orchestra.run.smithi181.stdout:=============================================================================== 2024-02-21T23:14:14.870 INFO:teuthology.orchestra.run.smithi181.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 38 +502us[ +499us] +/- 100ms 2024-02-21T23:14:14.871 INFO:teuthology.orchestra.run.smithi181.stdout:^* hv02.front.sepia.ceph.com 3 6 377 38 -36us[ -40us] +/- 78ms 2024-02-21T23:14:14.871 INFO:teuthology.orchestra.run.smithi181.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 37 -356us[ -356us] +/- 79ms 2024-02-21T23:14:14.871 INFO:teuthology.orchestra.run.smithi181.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-02-21T23:14:14.893 INFO:teuthology.orchestra.run.smithi099.stderr:bash: line 1: ntpq: command not found 2024-02-21T23:14:14.903 INFO:teuthology.orchestra.run.smithi099.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-21T23:14:14.903 INFO:teuthology.orchestra.run.smithi099.stdout:=============================================================================== 2024-02-21T23:14:14.903 INFO:teuthology.orchestra.run.smithi099.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 37 +503us[ +509us] +/- 100ms 2024-02-21T23:14:14.903 INFO:teuthology.orchestra.run.smithi099.stdout:^* hv02.front.sepia.ceph.com 3 6 377 35 -30us[ -24us] +/- 78ms 2024-02-21T23:14:14.903 INFO:teuthology.orchestra.run.smithi099.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 37 -364us[ -358us] +/- 79ms 2024-02-21T23:14:14.904 INFO:teuthology.orchestra.run.smithi099.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-02-21T23:14:14.905 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-02-21T23:14:14.915 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-02-21T23:14:14.916 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-02-21T23:14:14.949 DEBUG:teuthology.orchestra.run.smithi099:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-02-21T23:14:15.165 DEBUG:teuthology.orchestra.run.smithi162:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-02-21T23:14:15.237 DEBUG:teuthology.orchestra.run.smithi181:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-02-21T23:14:15.305 DEBUG:teuthology.orchestra.run.smithi099:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-21T23:14:15.411 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-21T23:14:15.411 DEBUG:teuthology.orchestra.run.smithi162:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-21T23:14:15.446 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-21T23:14:15.447 DEBUG:teuthology.orchestra.run.smithi181:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-21T23:14:15.477 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-21T23:14:15.478 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-02-21T23:14:15.489 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-02-21T23:14:15.523 INFO:teuthology.task.internal:Duration was 1388.668441 seconds 2024-02-21T23:14:15.524 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-02-21T23:14:15.574 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-02-21T23:14:15.574 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-21T23:14:15.581 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-21T23:14:15.584 DEBUG:teuthology.orchestra.run.smithi181:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-21T23:14:15.627 INFO:teuthology.orchestra.run.smithi181.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-21T23:14:15.631 INFO:teuthology.orchestra.run.smithi162.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-21T23:14:15.737 INFO:teuthology.orchestra.run.smithi099.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-21T23:14:15.993 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-02-21T23:14:15.993 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi099.front.sepia.ceph.com 2024-02-21T23:14:15.993 DEBUG:teuthology.orchestra.run.smithi099:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-21T23:14:16.059 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi162.front.sepia.ceph.com 2024-02-21T23:14:16.060 DEBUG:teuthology.orchestra.run.smithi162:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-21T23:14:16.094 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi181.front.sepia.ceph.com 2024-02-21T23:14:16.095 DEBUG:teuthology.orchestra.run.smithi181:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-21T23:14:16.142 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-02-21T23:14:16.142 DEBUG:teuthology.orchestra.run.smithi099:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-21T23:14:16.149 DEBUG:teuthology.orchestra.run.smithi162:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-21T23:14:16.152 DEBUG:teuthology.orchestra.run.smithi181:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-21T23:14:16.240 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-02-21T23:14:16.240 DEBUG:teuthology.orchestra.run.smithi099:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-21T23:14:16.246 DEBUG:teuthology.orchestra.run.smithi162:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-21T23:14:16.249 DEBUG:teuthology.orchestra.run.smithi181:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-21T23:14:16.437 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-02-21T23:14:16.449 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-02-21T23:14:16.450 DEBUG:teuthology.orchestra.run.smithi099:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-21T23:14:16.540 DEBUG:teuthology.orchestra.run.smithi162:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-21T23:14:16.568 DEBUG:teuthology.orchestra.run.smithi181:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-21T23:14:16.596 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-02-21T23:14:16.608 DEBUG:teuthology.orchestra.run.smithi099:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-21T23:14:16.616 DEBUG:teuthology.orchestra.run.smithi162:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-21T23:14:16.618 DEBUG:teuthology.orchestra.run.smithi181:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-21T23:14:16.642 INFO:teuthology.orchestra.run.smithi162.stdout:kernel.core_pattern = core 2024-02-21T23:14:16.663 INFO:teuthology.orchestra.run.smithi181.stdout:kernel.core_pattern = core 2024-02-21T23:14:16.716 INFO:teuthology.orchestra.run.smithi099.stdout:kernel.core_pattern = core 2024-02-21T23:14:16.768 DEBUG:teuthology.orchestra.run.smithi099:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-21T23:14:16.815 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-21T23:14:16.816 DEBUG:teuthology.orchestra.run.smithi162:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-21T23:14:16.830 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-21T23:14:16.831 DEBUG:teuthology.orchestra.run.smithi181:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-21T23:14:16.845 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-21T23:14:16.846 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-02-21T23:14:16.863 INFO:teuthology.task.internal:Transferring archived files... 2024-02-21T23:14:16.864 DEBUG:teuthology.misc:Transferring archived files from smithi099:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-02-21_22:31:03-fs-wip-lusov-qdb-distro-default-smithi/7569996/remote/smithi099 2024-02-21T23:14:16.864 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-21T23:14:16.970 DEBUG:teuthology.misc:Transferring archived files from smithi162:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-02-21_22:31:03-fs-wip-lusov-qdb-distro-default-smithi/7569996/remote/smithi162 2024-02-21T23:14:16.970 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-21T23:14:17.007 DEBUG:teuthology.misc:Transferring archived files from smithi181:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-02-21_22:31:03-fs-wip-lusov-qdb-distro-default-smithi/7569996/remote/smithi181 2024-02-21T23:14:17.007 DEBUG:teuthology.orchestra.run.smithi181:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-21T23:14:17.047 INFO:teuthology.task.internal:Removing archive directory... 2024-02-21T23:14:17.048 DEBUG:teuthology.orchestra.run.smithi099:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-21T23:14:17.056 DEBUG:teuthology.orchestra.run.smithi162:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-21T23:14:17.059 DEBUG:teuthology.orchestra.run.smithi181:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-21T23:14:17.102 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-02-21T23:14:17.120 INFO:teuthology.task.internal:Not uploading archives. 2024-02-21T23:14:17.120 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-02-21T23:14:17.157 INFO:teuthology.task.internal:Tidying up after the test... 2024-02-21T23:14:17.157 DEBUG:teuthology.orchestra.run.smithi099:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-21T23:14:17.164 DEBUG:teuthology.orchestra.run.smithi162:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-21T23:14:17.167 DEBUG:teuthology.orchestra.run.smithi181:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-21T23:14:17.179 INFO:teuthology.orchestra.run.smithi162.stdout: 262162 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 21 23:14 /home/ubuntu/cephtest 2024-02-21T23:14:17.180 INFO:teuthology.orchestra.run.smithi181.stdout: 262162 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 21 23:14 /home/ubuntu/cephtest 2024-02-21T23:14:17.213 INFO:teuthology.orchestra.run.smithi099.stdout: 395555 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 21 23:14 /home/ubuntu/cephtest 2024-02-21T23:14:17.216 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-02-21T23:14:17.230 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-02-21T23:14:17.317 INFO:teuthology.nuke:Checking targets against current locks 2024-02-21T23:14:17.344 DEBUG:teuthology.nuke:shortname: smithi099 2024-02-21T23:14:17.345 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-21T23:14:17.369 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi099.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-02-21_22:31:03-fs-wip-lusov-qdb-distro-default-smithi/7569996', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-21 22:32:36.522543', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBbsxG0N50+UN7ym+G75bwvacDLBprjEIIj9m2NrEU4iIn2/F7gQVGeV0IiiqHiJuSbRXUhzkwQKdfhJ6It4JUM='} 2024-02-21T23:14:17.374 DEBUG:teuthology.nuke:shortname: smithi162 2024-02-21T23:14:17.374 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-21T23:14:17.398 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi162.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-02-21_22:31:03-fs-wip-lusov-qdb-distro-default-smithi/7569996', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-21 22:32:36.521466', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDprMEvFEYup72AphAePaVP9XF2ePgeJBRAf3tOCAQgpTqhVYgWnsMjGrpOMqA5baaIZh1IS815ukmQBDqOqO5c='} 2024-02-21T23:14:17.403 DEBUG:teuthology.nuke:shortname: smithi181 2024-02-21T23:14:17.404 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-21T23:14:17.434 INFO:teuthology.orchestra.console.smithi099:Power off 2024-02-21T23:14:17.434 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-21T23:14:17.447 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi181.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-02-21_22:31:03-fs-wip-lusov-qdb-distro-default-smithi/7569996', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-21 22:32:36.520346', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJGxpBmgiHFvfK24zkudM4plSU+FSLbF4SgKgRfpJDyL3jcS0bK3bS1V+K13Li1uzfMvSnWf10Veqka+JRjkhP4='} 2024-02-21T23:14:17.460 DEBUG:teuthology.orchestra.console.smithi099:power off output: Chassis Power Control: Down/Off 2024-02-21T23:14:17.460 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-21T23:14:17.488 INFO:teuthology.orchestra.console.smithi162:Power off 2024-02-21T23:14:17.488 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-21T23:14:17.499 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2024-02-21T23:14:17.512 DEBUG:teuthology.orchestra.console.smithi162:power off output: Chassis Power Control: Down/Off 2024-02-21T23:14:17.512 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-21T23:14:17.530 INFO:teuthology.orchestra.console.smithi181:Power off 2024-02-21T23:14:17.531 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-21T23:14:17.543 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is on 2024-02-21T23:14:17.567 DEBUG:teuthology.orchestra.console.smithi181:power off output: Chassis Power Control: Down/Off 2024-02-21T23:14:17.568 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-21T23:14:17.594 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is on 2024-02-21T23:14:21.501 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-21T23:14:21.544 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-21T23:14:21.595 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-21T23:14:21.612 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2024-02-21T23:14:21.654 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is on 2024-02-21T23:14:21.706 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is on 2024-02-21T23:14:25.614 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-21T23:14:25.655 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-21T23:14:25.708 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-21T23:14:25.726 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2024-02-21T23:14:25.768 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is off 2024-02-21T23:14:25.819 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is on 2024-02-21T23:14:25.869 INFO:teuthology.orchestra.console.smithi162:Power off completed 2024-02-21T23:14:29.728 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-21T23:14:29.819 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-21T23:14:29.840 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off 2024-02-21T23:14:29.930 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is off 2024-02-21T23:14:29.941 INFO:teuthology.orchestra.console.smithi099:Power off completed 2024-02-21T23:14:30.032 INFO:teuthology.orchestra.console.smithi181:Power off completed 2024-02-21T23:14:30.140 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 1130e053228021b1be9cac260b5ed52c5a9027c5 description: fs/workload/{0-centos_9.stream begin/{0-install 1-ceph 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-workunit/suites/fsx}} duration: 1388.6684412956238 failure_reason: 'Command failed (workunit test suites/fsx.sh) on smithi099 with status 2: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3bfc837d7b45ce8e095d92fa9c342964cea5e95f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsx.sh''' flavor: default owner: scheduled_leonidus@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=dea682e5d72846279c49b38bb5a438da status: fail success: false 2024-02-21T23:14:30.141 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T23:14:30.260 INFO:teuthology.run:FAIL